2024-05-08T06:14:16.071 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T06:14:16.071 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/kernel_untar_build}} --verbose --archive /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268 --name vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/orig.config.yaml 2024-05-08T06:14:16.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T06:14:16.217 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268 branch: wip-57676-3 description: fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/kernel_untar_build}} email: vshankar@redhat.com first_in_suite: false job_id: '7697268' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-57676-3 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount - mds.dir_split install: ceph: flavor: default sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-57676-3 sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5998 sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a sleep_before_teardown: 0 subset: 915/1024 suite: fs:workload suite_branch: wip-57676-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByaTvOVN4a4vRqIFmU5ANMQW8CL6moADjXa5PsbP2dTgy2r+72TTv6IAoFrxcvscGtEcEcvPo+apFfiSE3PGZc= smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqnOf/ygypimMDZKEGhIX7xHMSnkcI+04oh5vNd0ira2wt1SVymcUQGcmzUx5/uo6CSvCbUrQdxZWos5fnc+Wg= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDZvBCXy2hBXaWv7Ot2kjEAl1/x9vjaYjFfsHx0+vKVBhQ8x7QN0hGtAX5Nz1Y1VHGEAtnhh90o/g1pHdg+Kusc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - kernel_untar_build.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_04:00:39 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T06:14:16.217 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa; will attempt to use it 2024-05-08T06:14:16.218 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks 2024-05-08T06:14:16.218 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T06:14:16.219 INFO:teuthology.task.internal:Checking packages... 2024-05-08T06:14:16.240 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a' 2024-05-08T06:14:16.240 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T06:14:16.240 INFO:teuthology.packaging:ref: None 2024-05-08T06:14:16.240 INFO:teuthology.packaging:tag: None 2024-05-08T06:14:16.240 INFO:teuthology.packaging:branch: wip-57676-3 2024-05-08T06:14:16.240 INFO:teuthology.packaging:sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:14:16.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-57676-3 2024-05-08T06:14:16.457 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3538.gbee299f4 2024-05-08T06:14:16.459 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T06:14:16.466 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T06:14:16.466 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T06:14:16.472 INFO:teuthology.task.internal:Saving configuration 2024-05-08T06:14:16.493 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T06:14:16.499 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T06:14:16.526 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 06:09:06.764657', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByaTvOVN4a4vRqIFmU5ANMQW8CL6moADjXa5PsbP2dTgy2r+72TTv6IAoFrxcvscGtEcEcvPo+apFfiSE3PGZc='} 2024-05-08T06:14:16.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 06:09:06.761449', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqnOf/ygypimMDZKEGhIX7xHMSnkcI+04oh5vNd0ira2wt1SVymcUQGcmzUx5/uo6CSvCbUrQdxZWos5fnc+Wg='} 2024-05-08T06:14:16.577 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 06:09:06.763134', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDZvBCXy2hBXaWv7Ot2kjEAl1/x9vjaYjFfsHx0+vKVBhQ8x7QN0hGtAX5Nz1Y1VHGEAtnhh90o/g1pHdg+Kusc='} 2024-05-08T06:14:16.577 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T06:14:16.583 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-08T06:14:16.583 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-08T06:14:16.583 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-08T06:14:16.583 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T06:14:16.690 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc95079d0d0>, signals=[15]) 2024-05-08T06:14:16.690 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T06:14:16.697 INFO:teuthology.task.internal:Opening connections... 2024-05-08T06:14:16.697 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T06:14:16.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:14:16.778 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2024-05-08T06:14:16.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:14:16.850 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-05-08T06:14:16.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:14:16.921 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T06:14:16.927 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-05-08T06:14:16.946 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-05-08T06:14:16.946 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T06:14:17.003 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T06:14:17.004 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-05-08T06:14:17.028 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2024-05-08T06:14:17.046 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2024-05-08T06:14:17.046 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2024-05-08T06:14:17.103 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T06:14:17.104 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2024-05-08T06:14:17.104 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T06:14:17.104 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T06:14:17.104 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T06:14:17.104 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2024-05-08T06:14:17.128 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-05-08T06:14:17.146 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-05-08T06:14:17.146 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T06:14:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-05-08T06:14:17.205 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T06:14:17.205 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T06:14:17.205 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T06:14:17.205 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-05-08T06:14:17.228 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T06:14:17.239 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T06:14:17.302 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T06:14:17.303 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-05-08T06:14:17.305 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2024-05-08T06:14:17.307 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-05-08T06:14:17.323 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T06:14:17.330 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T06:14:17.330 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-05-08T06:14:17.361 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2024-05-08T06:14:17.364 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-05-08T06:14:17.633 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T06:14:17.711 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T06:14:17.725 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-05-08T06:14:17.725 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-05-08T06:14:17.726 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T06:14:17.726 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T06:14:17.726 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T06:14:17.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:14:17.743 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:17.743 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-08T06:14:17.744 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-05-08T06:14:17.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:14:17.745 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:14:17.745 DEBUG:teuthology.task.kernel:sha1 for mon.c is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:17.745 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-08T06:14:17.745 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-05-08T06:14:17.746 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:17.746 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-08T06:14:17.746 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-05-08T06:14:17.801 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-437.el9.x86_64 2024-05-08T06:14:17.801 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:17.802 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-08T06:14:17.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:17.806 INFO:teuthology.orchestra.run.smithi172.stdout:5.14.0-437.el9.x86_64 2024-05-08T06:14:17.806 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-437.el9.x86_64 2024-05-08T06:14:17.807 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:17.807 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-08T06:14:17.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:17.808 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:17.808 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-08T06:14:17.808 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:17.952 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum upgrade -y linux-firmware 2024-05-08T06:14:17.959 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum upgrade -y linux-firmware 2024-05-08T06:14:18.033 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum upgrade -y linux-firmware 2024-05-08T06:14:20.203 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-08T06:14:20.443 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.1 MB 00:00 2024-05-08T06:14:21.714 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.1 MB 00:02 2024-05-08T06:14:22.235 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-05-08T06:14:24.095 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 19 MB 00:02 2024-05-08T06:14:28.628 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.2 MB 00:00 2024-05-08T06:14:29.652 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.2 MB 00:03 2024-05-08T06:14:31.194 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-05-08T06:14:32.874 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-08T06:14:35.702 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 2.8 kB/s | 16 kB 00:05 2024-05-08T06:14:36.945 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-05-08T06:14:37.979 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-05-08T06:14:38.754 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-05-08T06:14:40.038 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-05-08T06:14:40.039 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-05-08T06:14:40.039 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-05-08T06:14:40.156 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-05-08T06:14:40.156 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:40.381 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-08T06:14:40.381 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-08T06:14:40.384 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi194.front.sepia.ceph.com to complete... 2024-05-08T06:14:42.137 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-08T06:14:44.232 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-08T06:14:44.232 INFO:teuthology.orchestra.run.smithi070.stdout:Nothing to do. 2024-05-08T06:14:44.233 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-08T06:14:44.348 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-05-08T06:14:44.349 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:44.498 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-08T06:14:44.499 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-08T06:14:44.501 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi070.front.sepia.ceph.com to complete... 2024-05-08T06:14:46.354 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.2 MB 00:03 2024-05-08T06:14:48.205 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-05-08T06:14:50.306 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-08T06:14:55.456 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-05-08T06:14:57.596 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-05-08T06:14:57.597 INFO:teuthology.orchestra.run.smithi172.stdout:Nothing to do. 2024-05-08T06:14:57.597 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-05-08T06:14:57.714 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-05-08T06:14:57.715 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T06:14:57.859 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-08T06:14:57.859 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-08T06:14:57.862 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi172.front.sepia.ceph.com to complete... 2024-05-08T06:16:02.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08 06:16:02 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-08T06:16:02.422 INFO:teuthology.orchestra.run.smithi194.stderr:FINISHED --2024-05-08 06:16:02-- 2024-05-08T06:16:02.422 INFO:teuthology.orchestra.run.smithi194.stderr:Total wall clock time: 1m 22s 2024-05-08T06:16:02.423 INFO:teuthology.orchestra.run.smithi194.stderr:Downloaded: 1 files, 341M in 1m 21s (4.19 MB/s) 2024-05-08T06:16:02.426 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-05-08T06:16:02.426 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-08T06:16:04.518 INFO:teuthology.orchestra.run.smithi194.stdout:Verifying... ######################################## 2024-05-08T06:16:04.725 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing... ######################################## 2024-05-08T06:16:04.840 INFO:teuthology.orchestra.run.smithi194.stdout:Updating / installing... 2024-05-08T06:16:10.932 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08 06:16:10 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-08T06:16:10.932 INFO:teuthology.orchestra.run.smithi172.stderr:FINISHED --2024-05-08 06:16:10-- 2024-05-08T06:16:10.932 INFO:teuthology.orchestra.run.smithi172.stderr:Total wall clock time: 1m 13s 2024-05-08T06:16:10.932 INFO:teuthology.orchestra.run.smithi172.stderr:Downloaded: 1 files, 341M in 1m 13s (4.69 MB/s) 2024-05-08T06:16:10.936 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-05-08T06:16:10.936 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-08T06:16:12.774 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-08T06:16:13.080 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying... ######################################## 2024-05-08T06:16:13.206 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing... ######################################## 2024-05-08T06:16:13.313 INFO:teuthology.orchestra.run.smithi172.stdout:Updating / installing... 2024-05-08T06:16:18.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08 06:16:18 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-08T06:16:18.070 INFO:teuthology.orchestra.run.smithi070.stderr:FINISHED --2024-05-08 06:16:18-- 2024-05-08T06:16:18.070 INFO:teuthology.orchestra.run.smithi070.stderr:Total wall clock time: 1m 34s 2024-05-08T06:16:18.070 INFO:teuthology.orchestra.run.smithi070.stderr:Downloaded: 1 files, 341M in 1m 33s (3.67 MB/s) 2024-05-08T06:16:18.073 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-05-08T06:16:18.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-08T06:16:20.215 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying... ######################################## 2024-05-08T06:16:20.436 INFO:teuthology.orchestra.run.smithi070.stdout:Preparing... ######################################## 2024-05-08T06:16:20.612 INFO:teuthology.orchestra.run.smithi070.stdout:Updating / installing... 2024-05-08T06:16:21.322 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-08T06:16:28.580 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-08T06:16:49.519 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-08T06:16:49.519 DEBUG:teuthology.orchestra.run.smithi194:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-08T06:16:49.603 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:49.603 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:49.603 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:49.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-08T06:16:49.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-08T06:16:49.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-08T06:16:49.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-08T06:16:49.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-08T06:16:49.603 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-08T06:16:49.604 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-08T06:16:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-08T06:16:49.606 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-08T06:16:49.607 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-08T06:16:49.608 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-08T06:16:49.609 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-08T06:16:49.610 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-08T06:16:49.611 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-08T06:16:49.612 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-08T06:16:49.613 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-08T06:16:49.614 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-08T06:16:49.615 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-08T06:16:49.616 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-08T06:16:49.617 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-08T06:16:49.618 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-08T06:16:49.619 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-08T06:16:49.620 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-08T06:16:49.621 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-08T06:16:49.622 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-08T06:16:49.623 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-08T06:16:49.624 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-08T06:16:49.625 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-08T06:16:49.626 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-08T06:16:49.627 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-08T06:16:49.628 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-08T06:16:49.629 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-08T06:16:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-08T06:16:49.631 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-08T06:16:49.632 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-08T06:16:49.633 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-08T06:16:49.634 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-08T06:16:49.635 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-08T06:16:49.636 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-08T06:16:49.637 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-08T06:16:49.638 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-08T06:16:49.639 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-08T06:16:49.640 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-08T06:16:49.641 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-08T06:16:49.642 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-08T06:16:49.643 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-08T06:16:49.644 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-08T06:16:49.645 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-08T06:16:49.646 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-08T06:16:49.647 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-08T06:16:49.648 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-08T06:16:49.649 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-08T06:16:49.650 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-08T06:16:49.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-08T06:16:49.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-08T06:16:49.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-08T06:16:49.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-08T06:16:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-08T06:16:49.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-08T06:16:49.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-08T06:16:49.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-08T06:16:49.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-08T06:16:49.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-08T06:16:49.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-08T06:16:49.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-08T06:16:49.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-08T06:16:49.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-08T06:16:49.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-08T06:16:49.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-08T06:16:49.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-08T06:16:49.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-08T06:16:49.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-08T06:16:49.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-08T06:16:49.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-08T06:16:49.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-08T06:16:49.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-08T06:16:49.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-08T06:16:49.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-08T06:16:49.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-08T06:16:49.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-08T06:16:49.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-08T06:16:49.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-08T06:16:49.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-08T06:16:49.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-08T06:16:49.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-08T06:16:49.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-08T06:16:49.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-08T06:16:49.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-08T06:16:49.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-08T06:16:49.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-08T06:16:49.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-08T06:16:49.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-08T06:16:49.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-08T06:16:49.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-08T06:16:49.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-08T06:16:49.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-08T06:16:49.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-08T06:16:49.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-08T06:16:49.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-08T06:16:49.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-08T06:16:49.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-08T06:16:49.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-08T06:16:49.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-08T06:16:49.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-08T06:16:49.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-08T06:16:49.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-08T06:16:49.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-08T06:16:49.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-08T06:16:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-08T06:16:49.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-08T06:16:49.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-08T06:16:49.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-08T06:16:49.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-08T06:16:49.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-08T06:16:49.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-08T06:16:49.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-08T06:16:49.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-08T06:16:49.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-08T06:16:49.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-08T06:16:49.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-08T06:16:49.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-08T06:16:49.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-08T06:16:49.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-08T06:16:49.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-08T06:16:49.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-08T06:16:49.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-08T06:16:49.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-08T06:16:49.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-08T06:16:49.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-08T06:16:49.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-08T06:16:49.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-08T06:16:49.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-08T06:16:49.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-08T06:16:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-08T06:16:49.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-08T06:16:49.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-08T06:16:49.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T06:16:49.738 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:49.738 DEBUG:teuthology.orchestra.run.smithi194:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout:postinstall scriptlet (using /bin/sh): 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout:for file in vmlinuz System.map config; do 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout: fi 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout:done 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-08T06:16:49.761 INFO:teuthology.orchestra.run.smithi194.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:49.762 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-05-08T06:16:49.763 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-05-08T06:16:49.843 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-05-08T06:16:49.843 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-05-08T06:16:49.843 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2024-05-08T06:16:49.843 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 68.el9 2024-05-08T06:16:49.843 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-05-08T06:16:49.843 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T06:16:49.843 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2024-05-08T06:16:49.843 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8264254 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-05-08T06:16:49.844 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:16:49.845 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T06:16:49.845 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T06:16:49.845 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:49.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T06:16:50.397 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-05-08T06:16:51.681 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T06:16:51.702 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-05-08T06:16:51.704 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-05-08T06:16:51.748 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.skTWazBBwp 2024-05-08T06:16:51.748 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.skTWazBBwp 2024-05-08T06:16:51.823 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.skTWazBBwp 2024-05-08T06:16:51.963 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.skTWazBBwp is 6KB 2024-05-08T06:16:51.983 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.skTWazBBwp 2024-05-08T06:16:51.997 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T06:16:52.058 INFO:teuthology.orchestra.run.smithi194.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T06:16:52.058 INFO:teuthology.orchestra.run.smithi194.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T06:16:52.058 INFO:teuthology.orchestra.run.smithi194.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T06:16:52.058 INFO:teuthology.orchestra.run.smithi194.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-08T06:16:52.060 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:52.236 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-05-08T06:16:58.028 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-08T06:16:58.028 DEBUG:teuthology.orchestra.run.smithi172:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-08T06:16:58.112 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-08T06:16:58.113 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-08T06:16:58.114 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-08T06:16:58.115 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-08T06:16:58.116 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-08T06:16:58.117 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-08T06:16:58.118 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-08T06:16:58.119 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-08T06:16:58.120 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-08T06:16:58.121 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-08T06:16:58.122 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-08T06:16:58.123 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-08T06:16:58.124 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-08T06:16:58.125 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-08T06:16:58.126 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-08T06:16:58.127 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-08T06:16:58.128 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-08T06:16:58.129 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-08T06:16:58.130 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-08T06:16:58.131 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-08T06:16:58.132 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-08T06:16:58.133 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-08T06:16:58.134 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-08T06:16:58.135 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-08T06:16:58.136 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-08T06:16:58.137 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-08T06:16:58.138 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-08T06:16:58.139 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-08T06:16:58.140 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-08T06:16:58.141 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-08T06:16:58.142 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-08T06:16:58.143 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-08T06:16:58.144 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-08T06:16:58.145 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-08T06:16:58.146 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-08T06:16:58.147 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-08T06:16:58.148 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-08T06:16:58.149 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-08T06:16:58.150 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-08T06:16:58.151 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-08T06:16:58.152 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-08T06:16:58.153 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-08T06:16:58.154 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-08T06:16:58.155 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-08T06:16:58.156 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-08T06:16:58.157 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-08T06:16:58.158 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-08T06:16:58.159 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-08T06:16:58.160 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-08T06:16:58.161 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-08T06:16:58.162 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-08T06:16:58.163 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-08T06:16:58.164 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-08T06:16:58.165 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-08T06:16:58.166 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-08T06:16:58.167 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-08T06:16:58.168 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-08T06:16:58.169 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-08T06:16:58.170 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-08T06:16:58.171 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-08T06:16:58.172 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-08T06:16:58.173 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-08T06:16:58.174 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-08T06:16:58.175 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-08T06:16:58.176 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-08T06:16:58.177 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-08T06:16:58.178 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-08T06:16:58.179 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-08T06:16:58.180 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-08T06:16:58.181 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-08T06:16:58.182 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-08T06:16:58.183 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-08T06:16:58.184 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-08T06:16:58.185 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-08T06:16:58.186 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-08T06:16:58.187 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-08T06:16:58.188 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-08T06:16:58.189 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-08T06:16:58.190 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-08T06:16:58.191 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-08T06:16:58.192 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-08T06:16:58.193 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-08T06:16:58.194 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-08T06:16:58.195 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-08T06:16:58.196 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-08T06:16:58.197 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-08T06:16:58.198 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-08T06:16:58.199 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-08T06:16:58.200 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-08T06:16:58.201 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-08T06:16:58.202 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-08T06:16:58.203 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-08T06:16:58.204 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-08T06:16:58.205 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-08T06:16:58.206 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-08T06:16:58.207 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-08T06:16:58.208 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-08T06:16:58.209 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-08T06:16:58.210 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-08T06:16:58.211 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-08T06:16:58.212 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-08T06:16:58.213 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-08T06:16:58.214 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-08T06:16:58.215 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-08T06:16:58.216 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-08T06:16:58.217 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-08T06:16:58.218 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-08T06:16:58.219 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-08T06:16:58.220 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-08T06:16:58.221 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-08T06:16:58.222 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-08T06:16:58.223 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-08T06:16:58.224 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-08T06:16:58.225 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-08T06:16:58.226 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-08T06:16:58.227 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-08T06:16:58.228 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-08T06:16:58.229 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-08T06:16:58.230 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-08T06:16:58.231 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-08T06:16:58.232 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-08T06:16:58.233 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-08T06:16:58.234 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-08T06:16:58.235 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-08T06:16:58.236 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-08T06:16:58.237 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-08T06:16:58.238 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-08T06:16:58.239 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-08T06:16:58.240 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-08T06:16:58.241 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-08T06:16:58.242 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-08T06:16:58.243 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-08T06:16:58.244 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-08T06:16:58.245 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-08T06:16:58.245 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-08T06:16:58.245 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-08T06:16:58.245 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-08T06:16:58.245 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-08T06:16:58.245 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-08T06:16:58.245 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-08T06:16:58.245 INFO:teuthology.orchestra.run.smithi172.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T06:16:58.249 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:58.249 DEBUG:teuthology.orchestra.run.smithi172:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout:postinstall scriptlet (using /bin/sh): 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout:for file in vmlinuz System.map config; do 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout: fi 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout:done 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-08T06:16:58.272 INFO:teuthology.orchestra.run.smithi172.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:58.273 INFO:teuthology.orchestra.run.smithi172.stdout:fi 2024-05-08T06:16:58.274 DEBUG:teuthology.orchestra.run.smithi172:> sudo rpm -qi grub2-tools 2024-05-08T06:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout:Name : grub2-tools 2024-05-08T06:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout:Epoch : 1 2024-05-08T06:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout:Version : 2.06 2024-05-08T06:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout:Release : 68.el9 2024-05-08T06:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: x86_64 2024-05-08T06:16:58.347 INFO:teuthology.orchestra.run.smithi172.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Group : Unspecified 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Size : 8264254 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:License : GPLv3+ 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Packager : builder@centos.org 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Vendor : CentOS 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Summary : Support tools for GRUB. 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:Description : 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T06:16:58.348 INFO:teuthology.orchestra.run.smithi172.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T06:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T06:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout:hardware devices. 2024-05-08T06:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:16:58.349 INFO:teuthology.orchestra.run.smithi172.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T06:16:58.350 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T06:16:58.350 INFO:teuthology.task.kernel:Updating grub on smithi172 to boot 6.9.0-rc3-g806ec36b2112 2024-05-08T06:16:58.350 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T06:16:58.911 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2024-05-08T06:17:00.301 INFO:teuthology.orchestra.run.smithi172.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T06:17:00.325 INFO:teuthology.orchestra.run.smithi172.stderr:done 2024-05-08T06:17:00.327 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2024-05-08T06:17:00.342 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.xX8ASN7yvY 2024-05-08T06:17:00.342 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xX8ASN7yvY 2024-05-08T06:17:00.409 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.xX8ASN7yvY 2024-05-08T06:17:00.548 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.xX8ASN7yvY is 6KB 2024-05-08T06:17:00.569 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.xX8ASN7yvY 2024-05-08T06:17:00.583 DEBUG:teuthology.orchestra.run.smithi172:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T06:17:00.644 INFO:teuthology.orchestra.run.smithi172.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T06:17:00.644 INFO:teuthology.orchestra.run.smithi172.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T06:17:00.645 INFO:teuthology.orchestra.run.smithi172.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T06:17:00.645 INFO:teuthology.orchestra.run.smithi172.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-08T06:17:00.646 DEBUG:teuthology.orchestra.run.smithi172:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-08T06:17:00.811 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2024-05-08T06:17:06.053 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-08T06:17:06.054 DEBUG:teuthology.orchestra.run.smithi070:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-08T06:17:06.135 INFO:teuthology.orchestra.run.smithi070.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-08T06:17:06.135 INFO:teuthology.orchestra.run.smithi070.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-08T06:17:06.135 INFO:teuthology.orchestra.run.smithi070.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-08T06:17:06.135 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-08T06:17:06.136 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-08T06:17:06.137 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-08T06:17:06.138 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-08T06:17:06.139 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-08T06:17:06.140 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-08T06:17:06.141 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-08T06:17:06.142 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-08T06:17:06.143 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-08T06:17:06.144 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-08T06:17:06.145 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-08T06:17:06.146 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-08T06:17:06.147 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-08T06:17:06.148 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-08T06:17:06.149 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-08T06:17:06.150 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-08T06:17:06.151 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-08T06:17:06.152 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-08T06:17:06.153 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-08T06:17:06.154 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-08T06:17:06.155 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-08T06:17:06.156 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-08T06:17:06.157 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-08T06:17:06.158 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-08T06:17:06.159 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-08T06:17:06.160 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-08T06:17:06.161 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-08T06:17:06.162 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-08T06:17:06.163 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-08T06:17:06.164 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-08T06:17:06.165 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-08T06:17:06.166 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-08T06:17:06.167 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-08T06:17:06.168 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-08T06:17:06.169 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-08T06:17:06.170 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-08T06:17:06.171 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-08T06:17:06.172 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-08T06:17:06.173 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-08T06:17:06.174 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-08T06:17:06.175 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-08T06:17:06.176 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-08T06:17:06.177 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-08T06:17:06.178 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-08T06:17:06.179 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-08T06:17:06.180 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-08T06:17:06.181 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-08T06:17:06.182 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-08T06:17:06.183 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-08T06:17:06.184 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-08T06:17:06.185 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-08T06:17:06.186 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-08T06:17:06.187 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-08T06:17:06.188 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-08T06:17:06.189 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-08T06:17:06.190 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-08T06:17:06.191 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-08T06:17:06.192 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-08T06:17:06.193 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-08T06:17:06.194 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-08T06:17:06.195 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-08T06:17:06.196 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-08T06:17:06.197 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-08T06:17:06.198 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-08T06:17:06.199 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-08T06:17:06.200 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-08T06:17:06.201 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-08T06:17:06.202 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-08T06:17:06.203 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-08T06:17:06.204 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-08T06:17:06.205 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-08T06:17:06.206 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-08T06:17:06.207 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-08T06:17:06.208 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-08T06:17:06.209 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-08T06:17:06.210 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-08T06:17:06.211 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-08T06:17:06.212 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-08T06:17:06.213 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-08T06:17:06.214 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-08T06:17:06.215 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-08T06:17:06.216 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-08T06:17:06.217 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-08T06:17:06.218 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-08T06:17:06.219 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-08T06:17:06.220 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-08T06:17:06.221 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-08T06:17:06.222 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-08T06:17:06.223 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-08T06:17:06.224 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-08T06:17:06.225 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-08T06:17:06.226 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-08T06:17:06.227 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-08T06:17:06.228 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-08T06:17:06.229 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-08T06:17:06.230 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-08T06:17:06.231 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-08T06:17:06.232 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-08T06:17:06.233 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-08T06:17:06.234 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-08T06:17:06.235 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-08T06:17:06.236 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-08T06:17:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-08T06:17:06.238 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-08T06:17:06.239 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-08T06:17:06.240 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-08T06:17:06.241 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-08T06:17:06.242 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-08T06:17:06.243 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-08T06:17:06.244 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-08T06:17:06.245 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-08T06:17:06.246 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-08T06:17:06.247 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-08T06:17:06.248 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-08T06:17:06.249 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-08T06:17:06.250 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-08T06:17:06.251 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-08T06:17:06.252 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-08T06:17:06.253 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-08T06:17:06.254 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-08T06:17:06.255 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-08T06:17:06.256 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-08T06:17:06.257 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-08T06:17:06.258 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-08T06:17:06.259 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-08T06:17:06.260 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-08T06:17:06.260 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-08T06:17:06.260 INFO:teuthology.orchestra.run.smithi070.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T06:17:06.263 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-08T06:17:06.263 DEBUG:teuthology.orchestra.run.smithi070:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-08T06:17:06.285 INFO:teuthology.orchestra.run.smithi070.stdout:postinstall scriptlet (using /bin/sh): 2024-05-08T06:17:06.285 INFO:teuthology.orchestra.run.smithi070.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T06:17:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T06:17:06.285 INFO:teuthology.orchestra.run.smithi070.stdout:fi 2024-05-08T06:17:06.285 INFO:teuthology.orchestra.run.smithi070.stdout:for file in vmlinuz System.map config; do 2024-05-08T06:17:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-08T06:17:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-08T06:17:06.285 INFO:teuthology.orchestra.run.smithi070.stdout: fi 2024-05-08T06:17:06.285 INFO:teuthology.orchestra.run.smithi070.stdout:done 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout:fi 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout:fi 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-08T06:17:06.286 INFO:teuthology.orchestra.run.smithi070.stdout:fi 2024-05-08T06:17:06.287 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -qi grub2-tools 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:Name : grub2-tools 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:Epoch : 1 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:Version : 2.06 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:Release : 68.el9 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: x86_64 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:Group : Unspecified 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:Size : 8264254 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:License : GPLv3+ 2024-05-08T06:17:06.358 INFO:teuthology.orchestra.run.smithi070.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:Packager : builder@centos.org 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:Vendor : CentOS 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:Summary : Support tools for GRUB. 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:Description : 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:hardware devices. 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:17:06.359 INFO:teuthology.orchestra.run.smithi070.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T06:17:06.360 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T06:17:06.360 INFO:teuthology.task.kernel:Updating grub on smithi070 to boot 6.9.0-rc3-g806ec36b2112 2024-05-08T06:17:06.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T06:17:06.996 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-05-08T06:17:08.375 INFO:teuthology.orchestra.run.smithi070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T06:17:08.406 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-05-08T06:17:08.408 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-05-08T06:17:08.433 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.nI6Qk93tR5 2024-05-08T06:17:08.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nI6Qk93tR5 2024-05-08T06:17:08.499 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.nI6Qk93tR5 2024-05-08T06:17:08.636 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.nI6Qk93tR5 is 6KB 2024-05-08T06:17:08.685 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.nI6Qk93tR5 2024-05-08T06:17:08.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T06:17:08.760 INFO:teuthology.orchestra.run.smithi070.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T06:17:08.760 INFO:teuthology.orchestra.run.smithi070.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T06:17:08.760 INFO:teuthology.orchestra.run.smithi070.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T06:17:08.760 INFO:teuthology.orchestra.run.smithi070.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-08T06:17:08.761 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-08T06:17:08.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-05-08T06:17:22.248 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-05-08T06:17:22.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-05-08T06:17:22.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:17:30.822 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-08T06:17:30.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-08T06:17:30.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:17:38.924 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T06:17:38.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-08T06:17:38.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:18:05.471 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2024-05-08T06:18:14.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-08T06:18:14.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:18:22.259 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T06:18:31.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-05-08T06:18:31.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:18:32.613 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-05-08T06:18:33.245 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-05-08T06:18:33.246 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.9.0-rc3-g806ec36b2112"... 2024-05-08T06:18:33.246 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-05-08T06:18:33.286 INFO:teuthology.orchestra.run.smithi194.stdout:6.9.0-rc3-g806ec36b2112 2024-05-08T06:18:33.286 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-08T06:18:33.287 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T06:18:33.287 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T06:18:34.287 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-05-08T06:18:34.288 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T06:18:34.417 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-05-08T06:18:34.465 DEBUG:teuthology.parallel:result is None 2024-05-08T06:18:38.927 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T06:18:47.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-08T06:18:47.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:18:50.194 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-05-08T06:18:50.804 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-08T06:18:50.805 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-05-08T06:18:50.805 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-05-08T06:18:50.844 INFO:teuthology.orchestra.run.smithi070.stdout:6.9.0-rc3-g806ec36b2112 2024-05-08T06:18:50.844 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-08T06:18:50.844 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T06:18:50.844 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T06:18:51.846 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T06:18:51.846 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T06:18:51.988 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-05-08T06:18:52.036 DEBUG:teuthology.parallel:result is None 2024-05-08T06:19:14.484 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T06:19:26.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-08T06:19:26.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:19:26.853 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-05-08T06:19:27.515 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-08T06:19:27.515 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-05-08T06:19:27.515 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2024-05-08T06:19:27.567 INFO:teuthology.orchestra.run.smithi172.stdout:6.9.0-rc3-g806ec36b2112 2024-05-08T06:19:27.568 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-08T06:19:27.568 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T06:19:27.568 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T06:19:28.568 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-08T06:19:28.569 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T06:19:28.696 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2024-05-08T06:19:28.795 DEBUG:teuthology.parallel:result is None 2024-05-08T06:19:28.795 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T06:19:28.803 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T06:19:28.803 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T06:19:28.813 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T06:19:28.820 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T06:19:28.880 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T06:19:28.887 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T06:19:28.897 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T06:19:28.897 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T06:19:28.903 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T06:19:28.908 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T06:19:28.976 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T06:19:28.983 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T06:19:28.984 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T06:19:28.991 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T06:19:28.999 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T06:19:29.079 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T06:19:29.092 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T06:19:29.099 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T06:19:29.109 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T06:19:29.123 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T06:19:29.131 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T06:19:29.135 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T06:19:29.143 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T06:19:29.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T06:19:29.148 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T06:19:29.155 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T06:19:29.242 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T06:19:29.253 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T06:19:29.254 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T06:19:29.261 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T06:19:29.269 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T06:19:29.323 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T06:19:29.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T06:19:29.498 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T06:19:29.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T06:19:29.670 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:19:29.670 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T06:19:29.755 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T06:19:29.843 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T06:19:29.941 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T06:19:30.023 DEBUG:teuthology.orchestra.run.smithi172:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T06:19:30.107 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:19:30.107 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T06:19:30.193 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T06:19:30.279 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T06:19:30.362 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T06:19:30.443 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T06:19:30.525 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:19:30.525 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T06:19:30.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-05-08T06:19:30.619 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2024-05-08T06:19:30.627 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-05-08T06:19:30.733 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T06:19:30.736 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T06:19:30.760 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T06:19:31.268 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T06:19:31.277 INFO:teuthology.task.internal:Starting timer... 2024-05-08T06:19:31.277 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T06:19:31.296 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T06:19:31.308 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-08T06:19:31.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-05-08T06:19:31.432 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-05-08T06:19:31.437 DEBUG:teuthology.orchestra.run.smithi172:> sudo service auditd rotate 2024-05-08T06:19:31.558 INFO:teuthology.orchestra.run.smithi172.stdout:Rotating logs: 2024-05-08T06:19:31.562 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-05-08T06:19:31.689 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-05-08T06:19:31.693 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T06:19:31.693 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-05-08T06:19:31.770 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-05-08T06:19:31.771 DEBUG:teuthology.orchestra.run.smithi172:> /usr/sbin/getenforce 2024-05-08T06:19:31.825 INFO:teuthology.orchestra.run.smithi172.stdout:Permissive 2024-05-08T06:19:31.826 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-05-08T06:19:31.897 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-05-08T06:19:31.897 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi172.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-05-08T06:19:31.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T06:19:31.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:19:31.967 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T06:19:32.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:19:32.038 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T06:19:32.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:19:32.116 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T06:19:32.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-05-08T06:19:32.197 DEBUG:teuthology.orchestra.run.smithi172:> sudo /usr/sbin/setenforce permissive 2024-05-08T06:19:32.265 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-05-08T06:19:32.355 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T06:19:32.369 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T06:19:32.400 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T06:19:32.401 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi172.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T06:25:19.704 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi172.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-05-08T06:25:19.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-08T06:25:19.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:25:19.817 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-05-08T06:25:19.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-05-08T06:25:19.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-08T06:25:19.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:25:20.075 DEBUG:teuthology.orchestra.run.smithi172:> true 2024-05-08T06:25:20.234 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2024-05-08T06:25:20.235 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-05-08T06:25:20.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T06:25:20.336 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-05-08T06:25:20.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-05-08T06:25:20.480 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T06:25:20.491 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T06:25:20.491 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T06:25:20.492 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T06:25:20.499 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T06:25:20.499 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T06:25:20.507 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T06:25:20.507 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T06:25:20.588 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T06:25:20.592 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T06:25:20.592 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T06:25:20.628 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T06:25:20.631 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T06:25:20.633 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T06:25:20.695 INFO:teuthology.orchestra.run.smithi172.stderr:sudo: ntpd: command not found 2024-05-08T06:25:20.703 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-05-08T06:25:20.708 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-05-08T06:25:20.723 INFO:teuthology.orchestra.run.smithi172.stdout:506 Cannot talk to daemon 2024-05-08T06:25:20.735 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-05-08T06:25:20.740 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-05-08T06:25:20.763 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T06:25:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T06:25:20.782 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T06:25:20.801 INFO:teuthology.orchestra.run.smithi172.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T06:25:20.816 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T06:25:20.827 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T06:25:20.934 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-05-08T06:25:20.943 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T06:25:20.943 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-05-08T06:25:20.943 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.943 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.943 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.943 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.956 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-05-08T06:25:20.964 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T06:25:20.965 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-05-08T06:25:20.965 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.965 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.965 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.965 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.968 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-05-08T06:25:20.978 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T06:25:20.978 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-05-08T06:25:20.978 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.978 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.979 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.979 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:25:20.980 INFO:teuthology.run_tasks:Running task install... 2024-05-08T06:25:20.989 DEBUG:teuthology.task.install:project ceph 2024-05-08T06:25:20.989 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a'}} 2024-05-08T06:25:20.990 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a'} 2024-05-08T06:25:20.990 INFO:teuthology.task.install:Using flavor: default 2024-05-08T06:25:20.996 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T06:25:20.996 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T06:25:20.997 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'tag': None, 'wait_for_package': False} 2024-05-08T06:25:20.997 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:25:21.000 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'tag': None, 'wait_for_package': False} 2024-05-08T06:25:21.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:25:21.001 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'tag': None, 'wait_for_package': False} 2024-05-08T06:25:21.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:25:21.150 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/ 2024-05-08T06:25:21.150 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gbee299f4 2024-05-08T06:25:21.225 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/ 2024-05-08T06:25:21.226 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gbee299f4 2024-05-08T06:25:21.229 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/ 2024-05-08T06:25:21.229 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gbee299f4 2024-05-08T06:25:21.285 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T06:25:21.286 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:25:21.286 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T06:25:21.353 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T06:25:21.353 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:25:21.353 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T06:25:21.375 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T06:25:21.375 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T06:25:21.413 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T06:25:21.413 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:25:21.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T06:25:21.444 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T06:25:21.444 DEBUG:teuthology.orchestra.run.smithi172:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T06:25:21.499 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T06:25:21.504 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T06:25:21.504 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T06:25:21.572 DEBUG:teuthology.orchestra.run.smithi172:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T06:25:21.608 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T06:25:21.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T06:25:21.685 DEBUG:teuthology.orchestra.run.smithi172:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T06:25:21.687 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-05-08T06:25:21.691 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-05-08T06:25:21.741 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T06:25:21.762 INFO:teuthology.orchestra.run.smithi172.stdout:check_obsoletes = 1 2024-05-08T06:25:21.767 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum clean all 2024-05-08T06:25:21.820 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-05-08T06:25:21.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-05-08T06:25:22.018 INFO:teuthology.orchestra.run.smithi194.stdout:54 files removed 2024-05-08T06:25:22.057 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T06:25:22.097 INFO:teuthology.orchestra.run.smithi172.stdout:54 files removed 2024-05-08T06:25:22.136 DEBUG:teuthology.orchestra.run.smithi172:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T06:25:22.148 INFO:teuthology.orchestra.run.smithi070.stdout:54 files removed 2024-05-08T06:25:22.187 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T06:25:23.148 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 158 kB/s | 84 kB 00:00 2024-05-08T06:25:23.151 INFO:teuthology.orchestra.run.smithi172.stdout:ceph packages for x86_64 145 kB/s | 84 kB 00:00 2024-05-08T06:25:23.161 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 126 kB/s | 84 kB 00:00 2024-05-08T06:25:23.748 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 23 kB/s | 12 kB 00:00 2024-05-08T06:25:23.877 INFO:teuthology.orchestra.run.smithi172.stdout:ceph noarch packages 19 kB/s | 12 kB 00:00 2024-05-08T06:25:23.878 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 19 kB/s | 12 kB 00:00 2024-05-08T06:25:24.461 INFO:teuthology.orchestra.run.smithi172.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2024-05-08T06:25:24.465 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 3.0 kB/s | 1.9 kB 00:00 2024-05-08T06:25:24.688 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 2.6 kB/s | 1.9 kB 00:00 2024-05-08T06:25:26.359 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.1 MB 00:01 2024-05-08T06:25:36.567 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 19 MB 00:08 2024-05-08T06:25:41.101 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.2 MB 00:00 2024-05-08T06:25:42.877 INFO:teuthology.orchestra.run.smithi172.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 16 kB 00:00 2024-05-08T06:25:45.510 INFO:teuthology.orchestra.run.smithi172.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 21 MB 00:02 2024-05-08T06:25:51.721 INFO:teuthology.orchestra.run.smithi172.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-08T06:25:54.246 INFO:teuthology.orchestra.run.smithi172.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T06:25:54.247 INFO:teuthology.orchestra.run.smithi172.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T06:25:54.267 INFO:teuthology.orchestra.run.smithi172.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T06:25:54.268 INFO:teuthology.orchestra.run.smithi172.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T06:25:54.269 INFO:teuthology.orchestra.run.smithi172.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T06:25:54.271 INFO:teuthology.orchestra.run.smithi172.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T06:25:54.273 INFO:teuthology.orchestra.run.smithi172.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T06:25:54.276 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T06:25:54.278 INFO:teuthology.orchestra.run.smithi172.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T06:25:54.348 INFO:teuthology.orchestra.run.smithi172.stdout:Dependencies resolved. 2024-05-08T06:25:54.366 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-05-08T06:25:54.366 INFO:teuthology.orchestra.run.smithi172.stdout: Package Arch Version Repository Size 2024-05-08T06:25:54.366 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-05-08T06:25:54.366 INFO:teuthology.orchestra.run.smithi172.stdout:Installing: 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 6.6 k 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 890 k 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 145 k 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 1.5 M 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 142 k 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 3.5 M 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 7.4 M 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 49 k 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 11 M 2024-05-08T06:25:54.367 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 49 M 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 273 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 763 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 225 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 27 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 18 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 32 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 747 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 127 k 2024-05-08T06:25:54.368 INFO:teuthology.orchestra.run.smithi172.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 161 k 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 321 k 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 299 k 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 100 k 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 85 k 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T06:25:54.369 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 171 k 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrading: 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: librados2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.4 M 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout:Installing dependencies: 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T06:25:54.370 INFO:teuthology.orchestra.run.smithi172.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 21 M 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 34 k 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 2.4 M 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 274 k 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 4.7 M 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 17 M 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 16 k 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 25 k 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T06:25:54.371 INFO:teuthology.orchestra.run.smithi172.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 163 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 500 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T06:25:54.372 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T06:25:54.373 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 45 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 135 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T06:25:54.374 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T06:25:54.375 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T06:25:54.376 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T06:25:54.377 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T06:25:54.378 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T06:25:54.379 INFO:teuthology.orchestra.run.smithi172.stdout:Installing weak dependencies: 2024-05-08T06:25:54.379 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T06:25:54.379 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:25:54.379 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction Summary 2024-05-08T06:25:54.379 INFO:teuthology.orchestra.run.smithi172.stdout:======================================================================================= 2024-05-08T06:25:54.379 INFO:teuthology.orchestra.run.smithi172.stdout:Install 148 Packages 2024-05-08T06:25:54.379 INFO:teuthology.orchestra.run.smithi172.stdout:Upgrade 8 Packages 2024-05-08T06:25:54.379 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:25:54.380 INFO:teuthology.orchestra.run.smithi172.stdout:Total download size: 226 M 2024-05-08T06:25:54.380 INFO:teuthology.orchestra.run.smithi172.stdout:Downloading Packages: 2024-05-08T06:25:55.430 INFO:teuthology.orchestra.run.smithi172.stdout:(1/156): ceph-19.0.0-3538.gbee299f4.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-05-08T06:25:55.739 INFO:teuthology.orchestra.run.smithi172.stdout:(2/156): ceph-fuse-19.0.0-3538.gbee299f4.el9.x8 2.8 MB/s | 890 kB 00:00 2024-05-08T06:25:55.806 INFO:teuthology.orchestra.run.smithi172.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 2.2 MB/s | 145 kB 00:00 2024-05-08T06:25:56.181 INFO:teuthology.orchestra.run.smithi172.stdout:(4/156): ceph-mds-19.0.0-3538.gbee299f4.el9.x86 6.3 MB/s | 2.4 MB 00:00 2024-05-08T06:25:56.356 INFO:teuthology.orchestra.run.smithi172.stdout:(5/156): ceph-mgr-19.0.0-3538.gbee299f4.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-05-08T06:25:56.740 INFO:teuthology.orchestra.run.smithi172.stdout:(6/156): ceph-mon-19.0.0-3538.gbee299f4.el9.x86 12 MB/s | 4.7 MB 00:00 2024-05-08T06:25:56.940 INFO:teuthology.orchestra.run.smithi172.stdout:(7/156): ceph-base-19.0.0-3538.gbee299f4.el9.x8 3.0 MB/s | 5.4 MB 00:01 2024-05-08T06:25:58.049 INFO:teuthology.orchestra.run.smithi172.stdout:(8/156): ceph-osd-19.0.0-3538.gbee299f4.el9.x86 13 MB/s | 17 MB 00:01 2024-05-08T06:25:58.099 INFO:teuthology.orchestra.run.smithi172.stdout:(9/156): ceph-selinux-19.0.0-3538.gbee299f4.el9 515 kB/s | 25 kB 00:00 2024-05-08T06:25:58.658 INFO:teuthology.orchestra.run.smithi172.stdout:(10/156): ceph-radosgw-19.0.0-3538.gbee299f4.el 6.2 MB/s | 11 MB 00:01 2024-05-08T06:25:58.967 INFO:teuthology.orchestra.run.smithi172.stdout:(11/156): ceph-common-19.0.0-3538.gbee299f4.el9 5.6 MB/s | 21 MB 00:03 2024-05-08T06:25:59.000 INFO:teuthology.orchestra.run.smithi172.stdout:(12/156): cephfs-mirror-19.0.0-3538.gbee299f4.e 660 kB/s | 225 kB 00:00 2024-05-08T06:25:59.025 INFO:teuthology.orchestra.run.smithi172.stdout:(13/156): cephfs-shell-19.0.0-3538.gbee299f4.el 471 kB/s | 27 kB 00:00 2024-05-08T06:25:59.059 INFO:teuthology.orchestra.run.smithi172.stdout:(14/156): libcephfs-devel-19.0.0-3538.gbee299f4 548 kB/s | 32 kB 00:00 2024-05-08T06:25:59.126 INFO:teuthology.orchestra.run.smithi172.stdout:(15/156): libcephsqlite-19.0.0-3538.gbee299f4.e 2.4 MB/s | 163 kB 00:00 2024-05-08T06:25:59.176 INFO:teuthology.orchestra.run.smithi172.stdout:(16/156): libcephfs2-19.0.0-3538.gbee299f4.el9. 4.9 MB/s | 747 kB 00:00 2024-05-08T06:25:59.210 INFO:teuthology.orchestra.run.smithi172.stdout:(17/156): librados-devel-19.0.0-3538.gbee299f4. 1.5 MB/s | 127 kB 00:00 2024-05-08T06:25:59.269 INFO:teuthology.orchestra.run.smithi172.stdout:(18/156): libradosstriper1-19.0.0-3538.gbee299f 5.4 MB/s | 500 kB 00:00 2024-05-08T06:25:59.361 INFO:teuthology.orchestra.run.smithi172.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gbe 497 kB/s | 45 kB 00:00 2024-05-08T06:25:59.444 INFO:teuthology.orchestra.run.smithi172.stdout:(20/156): python3-ceph-common-19.0.0-3538.gbee2 1.6 MB/s | 135 kB 00:00 2024-05-08T06:25:59.536 INFO:teuthology.orchestra.run.smithi172.stdout:(21/156): python3-cephfs-19.0.0-3538.gbee299f4. 1.7 MB/s | 161 kB 00:00 2024-05-08T06:25:59.628 INFO:teuthology.orchestra.run.smithi172.stdout:(22/156): python3-rados-19.0.0-3538.gbee299f4.e 3.5 MB/s | 321 kB 00:00 2024-05-08T06:25:59.737 INFO:teuthology.orchestra.run.smithi172.stdout:(23/156): python3-rbd-19.0.0-3538.gbee299f4.el9 2.7 MB/s | 299 kB 00:00 2024-05-08T06:25:59.829 INFO:teuthology.orchestra.run.smithi172.stdout:(24/156): python3-rgw-19.0.0-3538.gbee299f4.el9 1.1 MB/s | 100 kB 00:00 2024-05-08T06:25:59.904 INFO:teuthology.orchestra.run.smithi172.stdout:(25/156): rbd-fuse-19.0.0-3538.gbee299f4.el9.x8 1.1 MB/s | 85 kB 00:00 2024-05-08T06:26:00.030 INFO:teuthology.orchestra.run.smithi172.stdout:(26/156): librgw2-19.0.0-3538.gbee299f4.el9.x86 6.6 MB/s | 5.4 MB 00:00 2024-05-08T06:26:00.121 INFO:teuthology.orchestra.run.smithi172.stdout:(27/156): rbd-nbd-19.0.0-3538.gbee299f4.el9.x86 1.8 MB/s | 171 kB 00:00 2024-05-08T06:26:00.222 INFO:teuthology.orchestra.run.smithi172.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 345 kB/s | 34 kB 00:00 2024-05-08T06:26:00.297 INFO:teuthology.orchestra.run.smithi172.stdout:(29/156): rbd-mirror-19.0.0-3538.gbee299f4.el9. 7.9 MB/s | 3.1 MB 00:00 2024-05-08T06:26:00.640 INFO:teuthology.orchestra.run.smithi172.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3538.gbee29 10 MB/s | 3.5 MB 00:00 2024-05-08T06:26:00.672 INFO:teuthology.orchestra.run.smithi172.stdout:(31/156): ceph-mgr-cephadm-19.0.0-3538.gbee299f 317 kB/s | 142 kB 00:00 2024-05-08T06:26:00.748 INFO:teuthology.orchestra.run.smithi172.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gbe 3.6 MB/s | 274 kB 00:00 2024-05-08T06:26:00.840 INFO:teuthology.orchestra.run.smithi172.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gbee299f4.e 543 kB/s | 49 kB 00:00 2024-05-08T06:26:00.948 INFO:teuthology.orchestra.run.smithi172.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gb 153 kB/s | 16 kB 00:00 2024-05-08T06:26:01.074 INFO:teuthology.orchestra.run.smithi172.stdout:(35/156): ceph-volume-19.0.0-3538.gbee299f4.el9 2.2 MB/s | 273 kB 00:00 2024-05-08T06:26:01.207 INFO:teuthology.orchestra.run.smithi172.stdout:(36/156): cephadm-19.0.0-3538.gbee299f4.el9.noa 5.6 MB/s | 763 kB 00:00 2024-05-08T06:26:01.274 INFO:teuthology.orchestra.run.smithi172.stdout:(37/156): cephfs-top-19.0.0-3538.gbee299f4.el9. 277 kB/s | 18 kB 00:00 2024-05-08T06:26:01.369 INFO:teuthology.orchestra.run.smithi172.stdout:(38/156): ceph-mgr-diskprediction-local-19.0.0- 10 MB/s | 7.4 MB 00:00 2024-05-08T06:26:02.009 INFO:teuthology.orchestra.run.smithi172.stdout:(39/156): ceph-test-19.0.0-3538.gbee299f4.el9.x 13 MB/s | 49 MB 00:03 2024-05-08T06:26:02.034 INFO:teuthology.orchestra.run.smithi172.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 106 kB/s | 80 kB 00:00 2024-05-08T06:26:02.467 INFO:teuthology.orchestra.run.smithi172.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 585 kB/s | 253 kB 00:00 2024-05-08T06:26:02.517 INFO:teuthology.orchestra.run.smithi172.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 385 kB/s | 195 kB 00:00 2024-05-08T06:26:02.551 INFO:teuthology.orchestra.run.smithi172.stdout:(43/156): libgfortran-11.4.1-3.el9.x86_64.rpm 679 kB/s | 803 kB 00:01 2024-05-08T06:26:02.626 INFO:teuthology.orchestra.run.smithi172.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 984 kB/s | 106 kB 00:00 2024-05-08T06:26:02.660 INFO:teuthology.orchestra.run.smithi172.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-05-08T06:26:02.735 INFO:teuthology.orchestra.run.smithi172.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-05-08T06:26:02.777 INFO:teuthology.orchestra.run.smithi172.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.8 MB/s | 215 kB 00:00 2024-05-08T06:26:02.953 INFO:teuthology.orchestra.run.smithi172.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-05-08T06:26:03.006 INFO:teuthology.orchestra.run.smithi172.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-05-08T06:26:03.028 INFO:teuthology.orchestra.run.smithi172.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-05-08T06:26:03.053 INFO:teuthology.orchestra.run.smithi172.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 434 kB/s | 21 kB 00:00 2024-05-08T06:26:03.104 INFO:teuthology.orchestra.run.smithi172.stdout:(52/156): python3-cryptography-36.0.1-4.el9.x86 1.9 MB/s | 1.2 MB 00:00 2024-05-08T06:26:03.146 INFO:teuthology.orchestra.run.smithi172.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 359 kB/s | 33 kB 00:00 2024-05-08T06:26:03.179 INFO:teuthology.orchestra.run.smithi172.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-05-08T06:26:03.205 INFO:teuthology.orchestra.run.smithi172.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 315 kB/s | 18 kB 00:00 2024-05-08T06:26:03.230 INFO:teuthology.orchestra.run.smithi172.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 225 kB/s | 11 kB 00:00 2024-05-08T06:26:03.263 INFO:teuthology.orchestra.run.smithi172.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-08T06:26:03.289 INFO:teuthology.orchestra.run.smithi172.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 783 kB/s | 45 kB 00:00 2024-05-08T06:26:03.339 INFO:teuthology.orchestra.run.smithi172.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 8.7 MB/s | 662 kB 00:00 2024-05-08T06:26:03.381 INFO:teuthology.orchestra.run.smithi172.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 6.2 MB/s | 582 kB 00:00 2024-05-08T06:26:03.406 INFO:teuthology.orchestra.run.smithi172.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-05-08T06:26:03.432 INFO:teuthology.orchestra.run.smithi172.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 960 kB/s | 47 kB 00:00 2024-05-08T06:26:03.474 INFO:teuthology.orchestra.run.smithi172.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-05-08T06:26:03.507 INFO:teuthology.orchestra.run.smithi172.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-05-08T06:26:03.532 INFO:teuthology.orchestra.run.smithi172.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 610 kB/s | 35 kB 00:00 2024-05-08T06:26:03.633 INFO:teuthology.orchestra.run.smithi172.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.7 MB/s | 3.0 MB 00:00 2024-05-08T06:26:03.742 INFO:teuthology.orchestra.run.smithi172.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-05-08T06:26:03.842 INFO:teuthology.orchestra.run.smithi172.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-05-08T06:26:03.959 INFO:teuthology.orchestra.run.smithi172.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-05-08T06:26:03.993 INFO:teuthology.orchestra.run.smithi172.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 893 kB/s | 133 kB 00:00 2024-05-08T06:26:04.043 INFO:teuthology.orchestra.run.smithi172.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 3.0 MB/s | 911 kB 00:00 2024-05-08T06:26:04.085 INFO:teuthology.orchestra.run.smithi172.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 2.1 MB/s | 87 kB 00:00 2024-05-08T06:26:04.127 INFO:teuthology.orchestra.run.smithi172.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-05-08T06:26:04.177 INFO:teuthology.orchestra.run.smithi172.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-05-08T06:26:04.230 INFO:teuthology.orchestra.run.smithi172.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-05-08T06:26:04.269 INFO:teuthology.orchestra.run.smithi172.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 628 kB/s | 26 kB 00:00 2024-05-08T06:26:04.311 INFO:teuthology.orchestra.run.smithi172.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 469 kB/s | 19 kB 00:00 2024-05-08T06:26:04.362 INFO:teuthology.orchestra.run.smithi172.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-08T06:26:04.471 INFO:teuthology.orchestra.run.smithi172.stdout:(79/156): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-05-08T06:26:04.495 INFO:teuthology.orchestra.run.smithi172.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 261 kB/s | 35 kB 00:00 2024-05-08T06:26:04.629 INFO:teuthology.orchestra.run.smithi172.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-05-08T06:26:04.663 INFO:teuthology.orchestra.run.smithi172.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-05-08T06:26:04.696 INFO:teuthology.orchestra.run.smithi172.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.3 MB/s | 222 kB 00:00 2024-05-08T06:26:04.721 INFO:teuthology.orchestra.run.smithi172.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-08T06:26:04.747 INFO:teuthology.orchestra.run.smithi172.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 856 kB/s | 42 kB 00:00 2024-05-08T06:26:04.822 INFO:teuthology.orchestra.run.smithi172.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-05-08T06:26:04.847 INFO:teuthology.orchestra.run.smithi172.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-05-08T06:26:04.890 INFO:teuthology.orchestra.run.smithi172.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-05-08T06:26:04.923 INFO:teuthology.orchestra.run.smithi172.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 279 kB 00:00 2024-05-08T06:26:04.948 INFO:teuthology.orchestra.run.smithi172.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 929 kB/s | 54 kB 00:00 2024-05-08T06:26:05.066 INFO:teuthology.orchestra.run.smithi172.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.6 MB/s | 5.1 MB 00:00 2024-05-08T06:26:05.091 INFO:teuthology.orchestra.run.smithi172.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 295 kB/s | 42 kB 00:00 2024-05-08T06:26:05.116 INFO:teuthology.orchestra.run.smithi172.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 896 kB/s | 44 kB 00:00 2024-05-08T06:26:05.158 INFO:teuthology.orchestra.run.smithi172.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-08T06:26:05.175 INFO:teuthology.orchestra.run.smithi172.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 618 kB/s | 36 kB 00:00 2024-05-08T06:26:05.192 INFO:teuthology.orchestra.run.smithi172.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-05-08T06:26:05.242 INFO:teuthology.orchestra.run.smithi172.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-08T06:26:05.259 INFO:teuthology.orchestra.run.smithi172.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 872 kB/s | 58 kB 00:00 2024-05-08T06:26:05.293 INFO:teuthology.orchestra.run.smithi172.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.9 MB/s | 94 kB 00:00 2024-05-08T06:26:05.318 INFO:teuthology.orchestra.run.smithi172.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-08T06:26:05.343 INFO:teuthology.orchestra.run.smithi172.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 909 kB/s | 45 kB 00:00 2024-05-08T06:26:05.944 INFO:teuthology.orchestra.run.smithi172.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-05-08T06:26:06.069 INFO:teuthology.orchestra.run.smithi172.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 4.5 MB/s | 548 kB 00:00 2024-05-08T06:26:06.111 INFO:teuthology.orchestra.run.smithi172.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 7.4 MB/s | 309 kB 00:00 2024-05-08T06:26:06.144 INFO:teuthology.orchestra.run.smithi172.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 593 kB/s | 19 kB 00:00 2024-05-08T06:26:06.295 INFO:teuthology.orchestra.run.smithi172.stdout:(106/156): libarrow-9.0.0-11.el9.x86_64.rpm 30 MB/s | 4.4 MB 00:00 2024-05-08T06:26:06.328 INFO:teuthology.orchestra.run.smithi172.stdout:(107/156): lua-devel-5.4.4-4.el9.x86_64.rpm 22 kB/s | 22 kB 00:01 2024-05-08T06:26:06.354 INFO:teuthology.orchestra.run.smithi172.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 451 kB/s | 26 kB 00:00 2024-05-08T06:26:06.396 INFO:teuthology.orchestra.run.smithi172.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-05-08T06:26:06.421 INFO:teuthology.orchestra.run.smithi172.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 535 kB/s | 49 kB 00:00 2024-05-08T06:26:06.480 INFO:teuthology.orchestra.run.smithi172.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-05-08T06:26:06.530 INFO:teuthology.orchestra.run.smithi172.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-05-08T06:26:06.572 INFO:teuthology.orchestra.run.smithi172.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 839 kB 00:00 2024-05-08T06:26:06.589 INFO:teuthology.orchestra.run.smithi172.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 750 kB/s | 43 kB 00:00 2024-05-08T06:26:06.606 INFO:teuthology.orchestra.run.smithi172.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 985 kB/s | 32 kB 00:00 2024-05-08T06:26:06.623 INFO:teuthology.orchestra.run.smithi172.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 456 kB/s | 15 kB 00:00 2024-05-08T06:26:06.648 INFO:teuthology.orchestra.run.smithi172.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.1 MB/s | 172 kB 00:00 2024-05-08T06:26:06.682 INFO:teuthology.orchestra.run.smithi172.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 6.1 MB/s | 358 kB 00:00 2024-05-08T06:26:06.715 INFO:teuthology.orchestra.run.smithi172.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.5 MB/s | 303 kB 00:00 2024-05-08T06:26:06.740 INFO:teuthology.orchestra.run.smithi172.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 610 kB/s | 35 kB 00:00 2024-05-08T06:26:06.774 INFO:teuthology.orchestra.run.smithi172.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 3.5 MB/s | 206 kB 00:00 2024-05-08T06:26:06.816 INFO:teuthology.orchestra.run.smithi172.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-05-08T06:26:06.850 INFO:teuthology.orchestra.run.smithi172.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 329 kB/s | 11 kB 00:00 2024-05-08T06:26:06.909 INFO:teuthology.orchestra.run.smithi172.stdout:(124/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-05-08T06:26:06.934 INFO:teuthology.orchestra.run.smithi172.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 215 kB/s | 18 kB 00:00 2024-05-08T06:26:06.959 INFO:teuthology.orchestra.run.smithi172.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 467 kB/s | 23 kB 00:00 2024-05-08T06:26:06.984 INFO:teuthology.orchestra.run.smithi172.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 393 kB/s | 19 kB 00:00 2024-05-08T06:26:07.010 INFO:teuthology.orchestra.run.smithi172.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 397 kB/s | 20 kB 00:00 2024-05-08T06:26:07.068 INFO:teuthology.orchestra.run.smithi172.stdout:(129/156): protobuf-compiler-3.14.0-13.el9.x86_ 501 kB/s | 863 kB 00:01 2024-05-08T06:26:07.094 INFO:teuthology.orchestra.run.smithi172.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 560 kB/s | 46 kB 00:00 2024-05-08T06:26:07.119 INFO:teuthology.orchestra.run.smithi172.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-05-08T06:26:07.169 INFO:teuthology.orchestra.run.smithi172.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2024-05-08T06:26:07.194 INFO:teuthology.orchestra.run.smithi172.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 580 kB/s | 58 kB 00:00 2024-05-08T06:26:07.220 INFO:teuthology.orchestra.run.smithi172.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 332 kB/s | 16 kB 00:00 2024-05-08T06:26:07.262 INFO:teuthology.orchestra.run.smithi172.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-05-08T06:26:07.304 INFO:teuthology.orchestra.run.smithi172.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 831 kB/s | 90 kB 00:00 2024-05-08T06:26:07.329 INFO:teuthology.orchestra.run.smithi172.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 262 kB/s | 28 kB 00:00 2024-05-08T06:26:07.354 INFO:teuthology.orchestra.run.smithi172.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 337 kB/s | 31 kB 00:00 2024-05-08T06:26:07.379 INFO:teuthology.orchestra.run.smithi172.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-05-08T06:26:07.405 INFO:teuthology.orchestra.run.smithi172.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 724 kB/s | 36 kB 00:00 2024-05-08T06:26:07.430 INFO:teuthology.orchestra.run.smithi172.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-08T06:26:07.455 INFO:teuthology.orchestra.run.smithi172.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-05-08T06:26:07.481 INFO:teuthology.orchestra.run.smithi172.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-05-08T06:26:07.514 INFO:teuthology.orchestra.run.smithi172.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-05-08T06:26:07.540 INFO:teuthology.orchestra.run.smithi172.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 346 kB/s | 20 kB 00:00 2024-05-08T06:26:07.573 INFO:teuthology.orchestra.run.smithi172.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.3 MB/s | 192 kB 00:00 2024-05-08T06:26:07.615 INFO:teuthology.orchestra.run.smithi172.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-05-08T06:26:07.691 INFO:teuthology.orchestra.run.smithi172.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-08T06:26:07.891 INFO:teuthology.orchestra.run.smithi172.stdout:(149/156): librados2-19.0.0-3538.gbee299f4.el9. 11 MB/s | 3.4 MB 00:00 2024-05-08T06:26:08.166 INFO:teuthology.orchestra.run.smithi172.stdout:(150/156): librbd1-19.0.0-3538.gbee299f4.el9.x8 5.7 MB/s | 3.1 MB 00:00 2024-05-08T06:26:08.517 INFO:teuthology.orchestra.run.smithi172.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 119 kB/s | 42 kB 00:00 2024-05-08T06:26:08.717 INFO:teuthology.orchestra.run.smithi172.stdout:(152/156): NetworkManager-1.47.5-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:01 2024-05-08T06:26:08.850 INFO:teuthology.orchestra.run.smithi172.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 1.9 MB/s | 1.8 MB 00:00 2024-05-08T06:26:08.884 INFO:teuthology.orchestra.run.smithi172.stdout:(154/156): NetworkManager-tui-1.47.5-1.el9.x86_ 678 kB/s | 248 kB 00:00 2024-05-08T06:26:08.975 INFO:teuthology.orchestra.run.smithi172.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 5.3 MB/s | 1.3 MB 00:00 2024-05-08T06:26:09.210 INFO:teuthology.orchestra.run.smithi172.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 6.7 MB/s | 2.4 MB 00:00 2024-05-08T06:26:09.216 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2024-05-08T06:26:09.216 INFO:teuthology.orchestra.run.smithi172.stdout:Total 15 MB/s | 226 MB 00:14 2024-05-08T06:26:12.245 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction check 2024-05-08T06:26:12.489 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction check succeeded. 2024-05-08T06:26:12.489 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction test 2024-05-08T06:26:15.184 INFO:teuthology.orchestra.run.smithi172.stdout:Transaction test succeeded. 2024-05-08T06:26:15.184 INFO:teuthology.orchestra.run.smithi172.stdout:Running transaction 2024-05-08T06:26:21.754 INFO:teuthology.orchestra.run.smithi172.stdout: Preparing : 1/1 2024-05-08T06:26:21.919 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T06:26:22.007 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T06:26:22.129 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T06:26:22.189 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T06:26:22.227 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T06:26:22.374 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T06:26:22.822 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T06:26:22.933 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T06:26:23.113 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T06:26:23.142 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T06:26:23.253 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T06:26:23.291 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T06:26:23.597 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T06:26:23.663 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T06:26:23.688 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T06:26:23.835 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T06:26:23.865 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T06:26:23.984 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T06:26:24.016 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T06:26:24.091 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T06:26:24.377 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T06:26:24.693 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T06:26:24.877 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T06:26:24.960 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T06:26:25.158 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T06:26:25.267 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T06:26:25.599 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T06:26:25.778 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T06:26:25.818 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T06:26:25.868 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T06:26:25.985 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T06:26:26.036 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T06:26:26.100 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T06:26:26.151 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T06:26:26.188 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T06:26:26.323 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T06:26:26.392 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T06:26:26.431 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T06:26:26.487 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T06:26:26.595 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T06:26:26.635 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 32/164 2024-05-08T06:26:26.684 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 33/164 2024-05-08T06:26:26.716 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 34/164 2024-05-08T06:26:26.850 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T06:26:26.912 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T06:26:27.011 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T06:26:27.188 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T06:26:27.256 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T06:26:28.170 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T06:26:28.281 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T06:26:28.324 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T06:26:28.405 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T06:26:28.452 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 44/164 2024-05-08T06:26:28.519 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T06:26:28.741 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T06:26:28.842 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T06:26:28.971 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T06:26:29.037 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T06:26:29.122 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T06:26:29.191 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T06:26:29.233 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T06:26:29.301 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T06:26:29.342 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T06:26:29.405 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T06:26:29.470 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T06:26:29.669 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T06:26:29.732 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T06:26:29.768 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T06:26:29.816 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T06:26:29.936 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T06:26:29.976 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T06:26:30.047 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T06:26:30.084 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T06:26:30.117 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T06:26:30.297 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T06:26:30.475 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T06:26:30.523 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T06:26:30.565 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T06:26:30.609 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T06:26:30.666 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T06:26:30.717 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T06:26:30.760 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T06:26:30.805 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T06:26:30.880 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T06:26:30.948 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T06:26:30.989 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T06:26:31.128 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T06:26:31.194 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T06:26:31.238 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T06:26:31.307 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T06:26:31.453 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T06:26:31.524 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T06:26:32.485 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T06:26:32.541 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T06:26:32.574 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T06:26:32.699 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T06:26:32.760 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T06:26:32.858 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T06:26:32.909 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T06:26:33.146 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T06:26:33.181 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T06:26:33.297 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T06:26:34.152 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T06:26:34.294 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T06:26:35.866 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T06:26:35.973 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T06:26:35.997 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T06:26:36.026 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T06:26:36.399 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T06:26:36.450 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T06:26:36.573 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T06:26:36.607 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 102/164 2024-05-08T06:26:36.667 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T06:26:37.051 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 114 kB/s | 8.1 MB 01:12 2024-05-08T06:26:37.157 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 114 kB/s | 8.1 MB 01:12 2024-05-08T06:26:37.223 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T06:26:37.253 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T06:26:37.345 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T06:26:37.372 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 106/164 2024-05-08T06:26:40.018 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T06:26:40.068 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T06:26:40.706 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T06:26:40.755 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T06:26:40.933 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T06:26:40.934 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T06:26:40.934 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T06:26:40.934 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:26:40.981 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T06:26:41.408 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 19 MB 00:03 2024-05-08T06:26:47.800 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.2 MB 00:02 2024-05-08T06:26:49.475 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 16 kB 00:00 2024-05-08T06:26:51.766 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-05-08T06:26:53.637 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T06:26:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /sys 2024-05-08T06:26:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /proc 2024-05-08T06:26:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /mnt 2024-05-08T06:26:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /var/tmp 2024-05-08T06:26:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /home 2024-05-08T06:26:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /root 2024-05-08T06:26:53.638 INFO:teuthology.orchestra.run.smithi172.stdout:skipping the directory /tmp 2024-05-08T06:26:53.638 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:26:53.849 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T06:26:53.896 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T06:26:53.896 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:26:53.896 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T06:26:53.896 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:26:54.108 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-05-08T06:26:55.493 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T06:26:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T06:26:55.572 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:26:55.572 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T06:26:55.572 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T06:26:55.572 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T06:26:55.572 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:26:55.826 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T06:26:55.894 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T06:26:55.895 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:26:55.895 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T06:26:55.895 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T06:26:55.895 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T06:26:55.895 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:26:56.377 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T06:26:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T06:26:56.443 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:26:56.443 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T06:26:56.443 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T06:26:56.443 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T06:26:56.443 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:26:56.569 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T06:26:56.628 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T06:26:56.705 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T06:26:56.941 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T06:26:57.006 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T06:26:57.117 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T06:26:57.225 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T06:26:57.392 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T06:26:57.438 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T06:26:57.483 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T06:26:57.512 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T06:26:57.835 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-05-08T06:26:58.189 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T06:26:58.232 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T06:26:58.287 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 126/164 2024-05-08T06:26:58.397 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 127/164 2024-05-08T06:26:58.435 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T06:26:59.760 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T06:26:59.811 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T06:27:00.428 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T06:27:00.430 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T06:27:00.451 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T06:27:00.452 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T06:27:00.453 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T06:27:00.455 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T06:27:00.457 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T06:27:00.460 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T06:27:00.462 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T06:27:00.532 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-05-08T06:27:00.558 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-05-08T06:27:00.558 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 6.6 k 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 890 k 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 145 k 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 1.5 M 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 142 k 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 3.5 M 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 7.4 M 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 49 k 2024-05-08T06:27:00.559 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 11 M 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 49 M 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 273 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 763 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 225 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 27 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 18 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 32 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 747 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 127 k 2024-05-08T06:27:00.560 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 161 k 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 321 k 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 299 k 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 100 k 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 85 k 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T06:27:00.561 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 171 k 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.4 M 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T06:27:00.562 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 21 M 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 34 k 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 2.4 M 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 274 k 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 4.7 M 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 17 M 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 16 k 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 25 k 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T06:27:00.563 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 163 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 500 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T06:27:00.564 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T06:27:00.565 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 45 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 135 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T06:27:00.566 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T06:27:00.567 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T06:27:00.568 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T06:27:00.569 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T06:27:00.570 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-05-08T06:27:00.571 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T06:27:00.571 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:27:00.571 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-05-08T06:27:00.571 INFO:teuthology.orchestra.run.smithi070.stdout:======================================================================================= 2024-05-08T06:27:00.571 INFO:teuthology.orchestra.run.smithi070.stdout:Install 148 Packages 2024-05-08T06:27:00.571 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 8 Packages 2024-05-08T06:27:00.571 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:27:00.571 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 226 M 2024-05-08T06:27:00.572 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-05-08T06:27:00.921 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T06:27:00.952 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T06:27:01.109 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T06:27:01.200 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.2 MB 00:03 2024-05-08T06:27:01.283 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 131/164 2024-05-08T06:27:01.313 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T06:27:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T06:27:01.389 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:27:01.389 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T06:27:01.389 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T06:27:01.389 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T06:27:01.389 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:27:01.439 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T06:27:01.474 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T06:27:01.586 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 134/164 2024-05-08T06:27:01.661 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 135/164 2024-05-08T06:27:01.678 INFO:teuthology.orchestra.run.smithi070.stdout:(1/156): ceph-19.0.0-3538.gbee299f4.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-05-08T06:27:01.928 INFO:teuthology.orchestra.run.smithi070.stdout:(2/156): ceph-fuse-19.0.0-3538.gbee299f4.el9.x8 3.5 MB/s | 890 kB 00:00 2024-05-08T06:27:02.254 INFO:teuthology.orchestra.run.smithi070.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 447 kB/s | 145 kB 00:00 2024-05-08T06:27:02.666 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T06:27:02.700 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T06:27:02.774 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T06:27:02.774 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:27:02.774 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T06:27:02.774 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T06:27:02.775 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T06:27:02.775 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:27:02.821 INFO:teuthology.orchestra.run.smithi070.stdout:(4/156): ceph-mds-19.0.0-3538.gbee299f4.el9.x86 4.2 MB/s | 2.4 MB 00:00 2024-05-08T06:27:02.842 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T06:27:02.911 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T06:27:02.911 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:27:02.911 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T06:27:02.911 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:27:02.984 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T06:27:03.042 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-05-08T06:27:03.069 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T06:27:03.070 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:27:03.070 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T06:27:03.070 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T06:27:03.070 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T06:27:03.070 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:27:03.087 INFO:teuthology.orchestra.run.smithi070.stdout:(5/156): ceph-common-19.0.0-3538.gbee299f4.el9. 13 MB/s | 21 MB 00:01 2024-05-08T06:27:03.238 INFO:teuthology.orchestra.run.smithi070.stdout:(6/156): ceph-base-19.0.0-3538.gbee299f4.el9.x8 3.0 MB/s | 5.4 MB 00:01 2024-05-08T06:27:03.305 INFO:teuthology.orchestra.run.smithi070.stdout:(7/156): ceph-mgr-19.0.0-3538.gbee299f4.el9.x86 3.1 MB/s | 1.5 MB 00:00 2024-05-08T06:27:03.455 INFO:teuthology.orchestra.run.smithi070.stdout:(8/156): ceph-mon-19.0.0-3538.gbee299f4.el9.x86 13 MB/s | 4.7 MB 00:00 2024-05-08T06:27:03.468 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T06:27:03.513 INFO:teuthology.orchestra.run.smithi070.stdout:(9/156): ceph-selinux-19.0.0-3538.gbee299f4.el9 438 kB/s | 25 kB 00:00 2024-05-08T06:27:03.536 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T06:27:03.537 INFO:teuthology.orchestra.run.smithi172.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:27:03.537 INFO:teuthology.orchestra.run.smithi172.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T06:27:03.537 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T06:27:03.537 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T06:27:03.537 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:27:04.930 INFO:teuthology.orchestra.run.smithi070.stdout:(10/156): ceph-radosgw-19.0.0-3538.gbee299f4.el 6.5 MB/s | 11 MB 00:01 2024-05-08T06:27:04.989 INFO:teuthology.orchestra.run.smithi070.stdout:(11/156): cephfs-mirror-19.0.0-3538.gbee299f4.e 3.9 MB/s | 225 kB 00:00 2024-05-08T06:27:05.047 INFO:teuthology.orchestra.run.smithi070.stdout:(12/156): cephfs-shell-19.0.0-3538.gbee299f4.el 471 kB/s | 27 kB 00:00 2024-05-08T06:27:05.373 INFO:teuthology.orchestra.run.smithi070.stdout:(13/156): libcephfs-devel-19.0.0-3538.gbee299f4 98 kB/s | 32 kB 00:00 2024-05-08T06:27:05.723 INFO:teuthology.orchestra.run.smithi070.stdout:(14/156): libcephfs2-19.0.0-3538.gbee299f4.el9. 2.1 MB/s | 747 kB 00:00 2024-05-08T06:27:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:(15/156): libcephsqlite-19.0.0-3538.gbee299f4.e 1.8 MB/s | 163 kB 00:00 2024-05-08T06:27:05.907 INFO:teuthology.orchestra.run.smithi070.stdout:(16/156): librados-devel-19.0.0-3538.gbee299f4. 1.4 MB/s | 127 kB 00:00 2024-05-08T06:27:06.415 INFO:teuthology.orchestra.run.smithi070.stdout:(17/156): ceph-test-19.0.0-3538.gbee299f4.el9.x 17 MB/s | 49 MB 00:02 2024-05-08T06:27:06.466 INFO:teuthology.orchestra.run.smithi070.stdout:(18/156): libradosstriper1-19.0.0-3538.gbee299f 897 kB/s | 500 kB 00:00 2024-05-08T06:27:06.549 INFO:teuthology.orchestra.run.smithi070.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gbe 548 kB/s | 45 kB 00:00 2024-05-08T06:27:06.561 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 6.4 MB/s | 21 MB 00:03 2024-05-08T06:27:06.641 INFO:teuthology.orchestra.run.smithi070.stdout:(20/156): python3-ceph-common-19.0.0-3538.gbee2 1.5 MB/s | 135 kB 00:00 2024-05-08T06:27:06.800 INFO:teuthology.orchestra.run.smithi070.stdout:(21/156): librgw2-19.0.0-3538.gbee299f4.el9.x86 14 MB/s | 5.4 MB 00:00 2024-05-08T06:27:06.859 INFO:teuthology.orchestra.run.smithi070.stdout:(22/156): python3-cephfs-19.0.0-3538.gbee299f4. 748 kB/s | 161 kB 00:00 2024-05-08T06:27:06.925 INFO:teuthology.orchestra.run.smithi070.stdout:(23/156): python3-rados-19.0.0-3538.gbee299f4.e 2.5 MB/s | 321 kB 00:00 2024-05-08T06:27:06.959 INFO:teuthology.orchestra.run.smithi070.stdout:(24/156): python3-rbd-19.0.0-3538.gbee299f4.el9 2.9 MB/s | 299 kB 00:00 2024-05-08T06:27:06.993 INFO:teuthology.orchestra.run.smithi070.stdout:(25/156): python3-rgw-19.0.0-3538.gbee299f4.el9 1.5 MB/s | 100 kB 00:00 2024-05-08T06:27:07.018 INFO:teuthology.orchestra.run.smithi070.stdout:(26/156): rbd-fuse-19.0.0-3538.gbee299f4.el9.x8 1.4 MB/s | 85 kB 00:00 2024-05-08T06:27:07.270 INFO:teuthology.orchestra.run.smithi070.stdout:(27/156): ceph-osd-19.0.0-3538.gbee299f4.el9.x8 4.2 MB/s | 17 MB 00:04 2024-05-08T06:27:07.302 INFO:teuthology.orchestra.run.smithi070.stdout:(28/156): rbd-nbd-19.0.0-3538.gbee299f4.el9.x86 604 kB/s | 171 kB 00:00 2024-05-08T06:27:07.327 INFO:teuthology.orchestra.run.smithi070.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3538.g 610 kB/s | 34 kB 00:00 2024-05-08T06:27:07.352 INFO:teuthology.orchestra.run.smithi070.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3538.gbee299f 2.8 MB/s | 142 kB 00:00 2024-05-08T06:27:07.461 INFO:teuthology.orchestra.run.smithi070.stdout:(31/156): rbd-mirror-19.0.0-3538.gbee299f4.el9. 6.6 MB/s | 3.1 MB 00:00 2024-05-08T06:27:07.520 INFO:teuthology.orchestra.run.smithi070.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gbe 4.7 MB/s | 274 kB 00:00 2024-05-08T06:27:07.570 INFO:teuthology.orchestra.run.smithi070.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gbee299f4.e 1.0 MB/s | 49 kB 00:00 2024-05-08T06:27:07.620 INFO:teuthology.orchestra.run.smithi070.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gb 335 kB/s | 16 kB 00:00 2024-05-08T06:27:07.696 INFO:teuthology.orchestra.run.smithi070.stdout:(35/156): ceph-volume-19.0.0-3538.gbee299f4.el9 3.6 MB/s | 273 kB 00:00 2024-05-08T06:27:07.787 INFO:teuthology.orchestra.run.smithi070.stdout:(36/156): cephadm-19.0.0-3538.gbee299f4.el9.noa 8.2 MB/s | 763 kB 00:00 2024-05-08T06:27:07.838 INFO:teuthology.orchestra.run.smithi070.stdout:(37/156): cephfs-top-19.0.0-3538.gbee299f4.el9. 372 kB/s | 18 kB 00:00 2024-05-08T06:27:07.996 INFO:teuthology.orchestra.run.smithi070.stdout:(38/156): ceph-mgr-dashboard-19.0.0-3538.gbee29 5.3 MB/s | 3.5 MB 00:00 2024-05-08T06:27:08.022 INFO:teuthology.orchestra.run.smithi070.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 440 kB/s | 80 kB 00:00 2024-05-08T06:27:08.214 INFO:teuthology.orchestra.run.smithi070.stdout:(40/156): ceph-mgr-diskprediction-local-19.0.0- 8.6 MB/s | 7.4 MB 00:00 2024-05-08T06:27:08.247 INFO:teuthology.orchestra.run.smithi070.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 870 kB/s | 195 kB 00:00 2024-05-08T06:27:08.322 INFO:teuthology.orchestra.run.smithi070.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-05-08T06:27:08.372 INFO:teuthology.orchestra.run.smithi070.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-08T06:27:08.415 INFO:teuthology.orchestra.run.smithi070.stdout:(44/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-05-08T06:27:08.440 INFO:teuthology.orchestra.run.smithi070.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-08T06:27:08.494 INFO:teuthology.orchestra.run.smithi070.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-05-08T06:27:08.541 INFO:teuthology.orchestra.run.smithi070.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-05-08T06:27:08.585 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 141/164 2024-05-08T06:27:08.624 INFO:teuthology.orchestra.run.smithi070.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.3 MB/s | 1.2 MB 00:00 2024-05-08T06:27:08.643 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 142/164 2024-05-08T06:27:08.691 INFO:teuthology.orchestra.run.smithi070.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-05-08T06:27:08.720 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 143/164 2024-05-08T06:27:08.733 INFO:teuthology.orchestra.run.smithi070.stdout:(50/156): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-05-08T06:27:08.759 INFO:teuthology.orchestra.run.smithi070.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-05-08T06:27:08.767 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T06:27:08.783 INFO:teuthology.orchestra.run.smithi070.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 235 kB/s | 21 kB 00:00 2024-05-08T06:27:08.806 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T06:27:08.825 INFO:teuthology.orchestra.run.smithi070.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 495 kB/s | 33 kB 00:00 2024-05-08T06:27:08.859 INFO:teuthology.orchestra.run.smithi070.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.5 MB/s | 313 kB 00:00 2024-05-08T06:27:08.926 INFO:teuthology.orchestra.run.smithi070.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 183 kB/s | 18 kB 00:00 2024-05-08T06:27:08.943 INFO:teuthology.orchestra.run.smithi070.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 135 kB/s | 11 kB 00:00 2024-05-08T06:27:09.002 INFO:teuthology.orchestra.run.smithi070.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 788 kB/s | 45 kB 00:00 2024-05-08T06:27:09.027 INFO:teuthology.orchestra.run.smithi070.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-05-08T06:27:09.111 INFO:teuthology.orchestra.run.smithi070.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.2 MB/s | 3.0 MB 00:00 2024-05-08T06:27:09.112 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 146/164 2024-05-08T06:27:09.153 INFO:teuthology.orchestra.run.smithi070.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 624 kB/s | 25 kB 00:00 2024-05-08T06:27:09.172 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T06:27:09.202 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 148/164 2024-05-08T06:27:09.203 INFO:teuthology.orchestra.run.smithi070.stdout:(61/156): libtool-2.4.6-45.el9.x86_64.rpm 3.3 MB/s | 582 kB 00:00 2024-05-08T06:27:09.236 INFO:teuthology.orchestra.run.smithi070.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 662 kB 00:00 2024-05-08T06:27:09.253 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T06:27:09.253 INFO:teuthology.orchestra.run.smithi070.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 476 kB/s | 47 kB 00:00 2024-05-08T06:27:09.311 INFO:teuthology.orchestra.run.smithi172.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T06:27:09.329 INFO:teuthology.orchestra.run.smithi070.stdout:(64/156): openblas-0.3.21-2.el9.x86_64.rpm 476 kB/s | 35 kB 00:00 2024-05-08T06:27:09.362 INFO:teuthology.orchestra.run.smithi070.stdout:(65/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-05-08T06:27:09.388 INFO:teuthology.orchestra.run.smithi070.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-05-08T06:27:09.529 INFO:teuthology.orchestra.run.smithi070.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-05-08T06:27:09.663 INFO:teuthology.orchestra.run.smithi070.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-08T06:27:09.747 INFO:teuthology.orchestra.run.smithi070.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 4.1 MB/s | 911 kB 00:00 2024-05-08T06:27:09.855 INFO:teuthology.orchestra.run.smithi070.stdout:(70/156): openblas-openmp-0.3.21-2.el9.x86_64.r 9.0 MB/s | 4.7 MB 00:00 2024-05-08T06:27:09.881 INFO:teuthology.orchestra.run.smithi070.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 615 kB/s | 133 kB 00:00 2024-05-08T06:27:09.947 INFO:teuthology.orchestra.run.smithi070.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-08T06:27:10.006 INFO:teuthology.orchestra.run.smithi070.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-05-08T06:27:10.090 INFO:teuthology.orchestra.run.smithi070.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-08T06:27:10.248 INFO:teuthology.orchestra.run.smithi070.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-05-08T06:27:10.257 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T06:27:10.299 INFO:teuthology.orchestra.run.smithi070.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.2 MB/s | 248 kB 00:00 2024-05-08T06:27:10.299 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T06:27:10.358 INFO:teuthology.orchestra.run.smithi070.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 237 kB/s | 26 kB 00:00 2024-05-08T06:27:10.364 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T06:27:10.383 INFO:teuthology.orchestra.run.smithi070.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 231 kB/s | 19 kB 00:00 2024-05-08T06:27:10.539 INFO:teuthology.orchestra.run.smithi070.stdout:(79/156): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-05-08T06:27:10.575 INFO:teuthology.orchestra.run.smithi070.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 182 kB/s | 35 kB 00:00 2024-05-08T06:27:10.609 INFO:teuthology.orchestra.run.smithi070.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 689 kB/s | 172 kB 00:00 2024-05-08T06:27:10.676 INFO:teuthology.orchestra.run.smithi070.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.5 MB/s | 250 kB 00:00 2024-05-08T06:27:10.709 INFO:teuthology.orchestra.run.smithi070.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-05-08T06:27:10.759 INFO:teuthology.orchestra.run.smithi070.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 934 kB/s | 77 kB 00:00 2024-05-08T06:27:10.785 INFO:teuthology.orchestra.run.smithi070.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 566 kB/s | 42 kB 00:00 2024-05-08T06:27:10.860 INFO:teuthology.orchestra.run.smithi070.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.7 MB/s | 269 kB 00:00 2024-05-08T06:27:10.885 INFO:teuthology.orchestra.run.smithi070.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-05-08T06:27:11.002 INFO:teuthology.orchestra.run.smithi070.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-05-08T06:27:11.052 INFO:teuthology.orchestra.run.smithi070.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 307 kB/s | 51 kB 00:00 2024-05-08T06:27:11.078 INFO:teuthology.orchestra.run.smithi070.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 722 kB/s | 54 kB 00:00 2024-05-08T06:27:11.111 INFO:teuthology.orchestra.run.smithi070.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.1 MB/s | 279 kB 00:00 2024-05-08T06:27:11.162 INFO:teuthology.orchestra.run.smithi070.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 503 kB/s | 42 kB 00:00 2024-05-08T06:27:11.187 INFO:teuthology.orchestra.run.smithi070.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 594 kB/s | 44 kB 00:00 2024-05-08T06:27:11.246 INFO:teuthology.orchestra.run.smithi070.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 624 kB/s | 36 kB 00:00 2024-05-08T06:27:11.279 INFO:teuthology.orchestra.run.smithi070.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.9 MB/s | 221 kB 00:00 2024-05-08T06:27:11.355 INFO:teuthology.orchestra.run.smithi070.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-05-08T06:27:11.421 INFO:teuthology.orchestra.run.smithi070.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 2.1 MB/s | 305 kB 00:00 2024-05-08T06:27:11.447 INFO:teuthology.orchestra.run.smithi070.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 641 kB/s | 58 kB 00:00 2024-05-08T06:27:11.497 INFO:teuthology.orchestra.run.smithi070.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-05-08T06:27:11.514 INFO:teuthology.orchestra.run.smithi070.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 965 kB/s | 64 kB 00:00 2024-05-08T06:27:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 778 kB/s | 45 kB 00:00 2024-05-08T06:27:11.573 INFO:teuthology.orchestra.run.smithi070.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 385 kB/s | 22 kB 00:00 2024-05-08T06:27:11.692 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 152/164 2024-05-08T06:27:11.806 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T06:27:11.848 INFO:teuthology.orchestra.run.smithi070.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-05-08T06:27:11.882 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T06:27:11.890 INFO:teuthology.orchestra.run.smithi070.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-05-08T06:27:12.024 INFO:teuthology.orchestra.run.smithi070.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 147 kB/s | 19 kB 00:00 2024-05-08T06:27:12.037 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T06:27:12.074 INFO:teuthology.orchestra.run.smithi172.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T06:27:12.112 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T06:27:12.112 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T06:27:12.157 INFO:teuthology.orchestra.run.smithi070.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.0 MB/s | 309 kB 00:00 2024-05-08T06:27:12.240 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T06:27:12.241 INFO:teuthology.orchestra.run.smithi070.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 315 kB/s | 26 kB 00:00 2024-05-08T06:27:12.287 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T06:27:12.287 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T06:27:12.324 INFO:teuthology.orchestra.run.smithi070.stdout:(108/156): abseil-cpp-20211102.0-3.el9.x86_64.r 730 kB/s | 548 kB 00:00 2024-05-08T06:27:12.424 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T06:27:12.433 INFO:teuthology.orchestra.run.smithi070.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 254 kB/s | 49 kB 00:00 2024-05-08T06:27:12.459 INFO:teuthology.orchestra.run.smithi070.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 507 kB/s | 67 kB 00:00 2024-05-08T06:27:12.462 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T06:27:12.495 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T06:27:12.496 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T06:27:12.517 INFO:teuthology.orchestra.run.smithi070.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-05-08T06:27:12.639 INFO:teuthology.orchestra.run.smithi070.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2024-05-08T06:27:12.693 INFO:teuthology.orchestra.run.smithi070.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-05-08T06:27:12.718 INFO:teuthology.orchestra.run.smithi070.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 555 kB/s | 43 kB 00:00 2024-05-08T06:27:12.752 INFO:teuthology.orchestra.run.smithi070.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 557 kB/s | 32 kB 00:00 2024-05-08T06:27:12.760 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-05-08T06:27:12.777 INFO:teuthology.orchestra.run.smithi070.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 258 kB/s | 15 kB 00:00 2024-05-08T06:27:12.791 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T06:27:12.791 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T06:27:12.811 INFO:teuthology.orchestra.run.smithi070.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-05-08T06:27:12.844 INFO:teuthology.orchestra.run.smithi070.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.1 MB/s | 839 kB 00:00 2024-05-08T06:27:12.878 INFO:teuthology.orchestra.run.smithi070.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-05-08T06:27:12.903 INFO:teuthology.orchestra.run.smithi070.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 610 kB/s | 35 kB 00:00 2024-05-08T06:27:12.937 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T06:27:12.945 INFO:teuthology.orchestra.run.smithi070.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-05-08T06:27:12.979 INFO:teuthology.orchestra.run.smithi070.stdout:(122/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.8 MB/s | 303 kB 00:00 2024-05-08T06:27:13.012 INFO:teuthology.orchestra.run.smithi070.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-05-08T06:27:13.054 INFO:teuthology.orchestra.run.smithi070.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 144 kB/s | 11 kB 00:00 2024-05-08T06:27:13.069 INFO:teuthology.orchestra.run.smithi172.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T06:27:13.079 INFO:teuthology.orchestra.run.smithi070.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 266 kB/s | 18 kB 00:00 2024-05-08T06:27:13.122 INFO:teuthology.orchestra.run.smithi070.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 350 kB/s | 23 kB 00:00 2024-05-08T06:27:13.147 INFO:teuthology.orchestra.run.smithi070.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 293 kB/s | 19 kB 00:00 2024-05-08T06:27:13.213 INFO:teuthology.orchestra.run.smithi070.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-05-08T06:27:13.239 INFO:teuthology.orchestra.run.smithi070.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2024-05-08T06:27:13.298 INFO:teuthology.orchestra.run.smithi070.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-05-08T06:27:13.323 INFO:teuthology.orchestra.run.smithi070.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 426 kB/s | 46 kB 00:00 2024-05-08T06:27:13.326 INFO:teuthology.orchestra.run.smithi172.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T06:27:13.326 INFO:teuthology.orchestra.run.smithi172.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-08T06:27:13.326 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:27:13.340 INFO:teuthology.orchestra.run.smithi070.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 790 kB/s | 79 kB 00:00 2024-05-08T06:27:13.407 INFO:teuthology.orchestra.run.smithi070.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 248 kB/s | 16 kB 00:00 2024-05-08T06:27:13.465 INFO:teuthology.orchestra.run.smithi070.stdout:(134/156): python3-natsort-7.1.1-5.el9.noarch.r 348 kB/s | 58 kB 00:00 2024-05-08T06:27:13.499 INFO:teuthology.orchestra.run.smithi070.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 988 kB/s | 90 kB 00:00 2024-05-08T06:27:13.533 INFO:teuthology.orchestra.run.smithi070.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-05-08T06:27:13.558 INFO:teuthology.orchestra.run.smithi070.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 306 kB/s | 28 kB 00:00 2024-05-08T06:27:13.583 INFO:teuthology.orchestra.run.smithi070.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 371 kB/s | 31 kB 00:00 2024-05-08T06:27:13.617 INFO:teuthology.orchestra.run.smithi070.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-08T06:27:13.642 INFO:teuthology.orchestra.run.smithi070.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 619 kB/s | 36 kB 00:00 2024-05-08T06:27:13.667 INFO:teuthology.orchestra.run.smithi070.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-05-08T06:27:13.693 INFO:teuthology.orchestra.run.smithi070.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 682 kB/s | 51 kB 00:00 2024-05-08T06:27:13.726 INFO:teuthology.orchestra.run.smithi070.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-08T06:27:13.752 INFO:teuthology.orchestra.run.smithi070.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-05-08T06:27:13.785 INFO:teuthology.orchestra.run.smithi070.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2024-05-08T06:27:13.811 INFO:teuthology.orchestra.run.smithi070.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 241 kB/s | 20 kB 00:00 2024-05-08T06:27:13.894 INFO:teuthology.orchestra.run.smithi070.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-05-08T06:27:13.945 INFO:teuthology.orchestra.run.smithi070.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-05-08T06:27:14.220 INFO:teuthology.orchestra.run.smithi070.stdout:(149/156): librados2-19.0.0-3538.gbee299f4.el9. 8.3 MB/s | 3.4 MB 00:00 2024-05-08T06:27:14.320 INFO:teuthology.orchestra.run.smithi070.stdout:(150/156): NetworkManager-1.47.5-1.el9.x86_64.r 6.2 MB/s | 2.3 MB 00:00 2024-05-08T06:27:14.379 INFO:teuthology.orchestra.run.smithi070.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 728 kB/s | 42 kB 00:00 2024-05-08T06:27:14.439 INFO:teuthology.orchestra.run.smithi070.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-05-08T06:27:14.504 INFO:teuthology.orchestra.run.smithi070.stdout:(153/156): NetworkManager-libnm-1.47.5-1.el9.x8 6.5 MB/s | 1.8 MB 00:00 2024-05-08T06:27:14.630 INFO:teuthology.orchestra.run.smithi070.stdout:(154/156): librbd1-19.0.0-3538.gbee299f4.el9.x8 4.3 MB/s | 3.1 MB 00:00 2024-05-08T06:27:14.705 INFO:teuthology.orchestra.run.smithi070.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 5.1 MB/s | 1.3 MB 00:00 2024-05-08T06:27:14.780 INFO:teuthology.orchestra.run.smithi070.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 8.7 MB/s | 2.4 MB 00:00 2024-05-08T06:27:14.785 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-08T06:27:14.786 INFO:teuthology.orchestra.run.smithi070.stdout:Total 16 MB/s | 226 MB 00:14 2024-05-08T06:27:15.331 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T06:27:15.331 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T06:27:15.349 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T06:27:15.350 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T06:27:15.351 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T06:27:15.353 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T06:27:15.355 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T06:27:15.358 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T06:27:15.359 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T06:27:15.429 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-05-08T06:27:15.449 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-05-08T06:27:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-05-08T06:27:15.449 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-05-08T06:27:15.449 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-05-08T06:27:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T06:27:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 6.6 k 2024-05-08T06:27:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T06:27:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 890 k 2024-05-08T06:27:15.449 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 145 k 2024-05-08T06:27:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 1.5 M 2024-05-08T06:27:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 142 k 2024-05-08T06:27:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 3.5 M 2024-05-08T06:27:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 7.4 M 2024-05-08T06:27:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 49 k 2024-05-08T06:27:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 11 M 2024-05-08T06:27:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 49 M 2024-05-08T06:27:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 273 k 2024-05-08T06:27:15.450 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 763 k 2024-05-08T06:27:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 225 k 2024-05-08T06:27:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 27 k 2024-05-08T06:27:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 18 k 2024-05-08T06:27:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T06:27:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T06:27:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T06:27:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 32 k 2024-05-08T06:27:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 747 k 2024-05-08T06:27:15.451 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 127 k 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 161 k 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 321 k 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 299 k 2024-05-08T06:27:15.452 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 100 k 2024-05-08T06:27:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 85 k 2024-05-08T06:27:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T06:27:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 171 k 2024-05-08T06:27:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T06:27:15.453 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-05-08T06:27:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T06:27:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T06:27:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T06:27:15.453 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.4 M 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 21 M 2024-05-08T06:27:15.454 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 34 k 2024-05-08T06:27:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 2.4 M 2024-05-08T06:27:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 274 k 2024-05-08T06:27:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 4.7 M 2024-05-08T06:27:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 17 M 2024-05-08T06:27:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 16 k 2024-05-08T06:27:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 25 k 2024-05-08T06:27:15.455 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T06:27:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T06:27:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T06:27:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T06:27:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T06:27:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T06:27:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T06:27:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T06:27:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 163 k 2024-05-08T06:27:15.456 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 500 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T06:27:15.457 INFO:teuthology.orchestra.run.smithi194.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T06:27:15.458 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T06:27:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T06:27:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T06:27:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T06:27:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 45 k 2024-05-08T06:27:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 135 k 2024-05-08T06:27:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T06:27:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T06:27:15.459 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T06:27:15.460 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T06:27:15.461 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T06:27:15.462 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T06:27:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T06:27:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T06:27:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T06:27:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T06:27:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T06:27:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T06:27:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T06:27:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T06:27:15.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T06:27:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T06:27:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T06:27:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T06:27:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T06:27:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T06:27:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T06:27:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T06:27:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T06:27:15.464 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T06:27:15.465 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T06:27:15.466 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-05-08T06:27:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T06:27:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:27:15.466 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-05-08T06:27:15.466 INFO:teuthology.orchestra.run.smithi194.stdout:======================================================================================= 2024-05-08T06:27:15.466 INFO:teuthology.orchestra.run.smithi194.stdout:Install 148 Packages 2024-05-08T06:27:15.466 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 8 Packages 2024-05-08T06:27:15.466 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:27:15.467 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 226 M 2024-05-08T06:27:15.467 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-05-08T06:27:16.354 INFO:teuthology.orchestra.run.smithi194.stdout:(1/156): ceph-19.0.0-3538.gbee299f4.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-08T06:27:16.696 INFO:teuthology.orchestra.run.smithi194.stdout:(2/156): ceph-fuse-19.0.0-3538.gbee299f4.el9.x8 2.6 MB/s | 890 kB 00:00 2024-05-08T06:27:16.838 INFO:teuthology.orchestra.run.smithi194.stdout:(3/156): ceph-base-19.0.0-3538.gbee299f4.el9.x8 6.6 MB/s | 5.4 MB 00:00 2024-05-08T06:27:17.059 INFO:teuthology.orchestra.run.smithi194.stdout:(4/156): ceph-mds-19.0.0-3538.gbee299f4.el9.x86 11 MB/s | 2.4 MB 00:00 2024-05-08T06:27:17.096 INFO:teuthology.orchestra.run.smithi194.stdout:(5/156): ceph-immutable-object-cache-19.0.0-353 362 kB/s | 145 kB 00:00 2024-05-08T06:27:17.263 INFO:teuthology.orchestra.run.smithi194.stdout:(6/156): ceph-mgr-19.0.0-3538.gbee299f4.el9.x86 7.5 MB/s | 1.5 MB 00:00 2024-05-08T06:27:17.827 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-05-08T06:27:18.069 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-05-08T06:27:18.069 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-05-08T06:27:18.180 INFO:teuthology.orchestra.run.smithi194.stdout:(7/156): ceph-common-19.0.0-3538.gbee299f4.el9. 9.8 MB/s | 21 MB 00:02 2024-05-08T06:27:18.322 INFO:teuthology.orchestra.run.smithi194.stdout:(8/156): ceph-mon-19.0.0-3538.gbee299f4.el9.x86 3.8 MB/s | 4.7 MB 00:01 2024-05-08T06:27:18.431 INFO:teuthology.orchestra.run.smithi194.stdout:(9/156): ceph-selinux-19.0.0-3538.gbee299f4.el9 235 kB/s | 25 kB 00:00 2024-05-08T06:27:18.981 INFO:teuthology.orchestra.run.smithi194.stdout:(10/156): ceph-osd-19.0.0-3538.gbee299f4.el9.x8 9.8 MB/s | 17 MB 00:01 2024-05-08T06:27:19.025 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 1/164 2024-05-08T06:27:19.025 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2/164 2024-05-08T06:27:19.025 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 3/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 4/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 5/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 6/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 7/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 11/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 12/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 14/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 15/164 2024-05-08T06:27:19.026 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 16/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 17/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 18/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 19/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 20/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 21/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 22/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 23/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 24/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 25/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 26/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 27/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 28/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 29/164 2024-05-08T06:27:19.027 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 30/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 31/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 32/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 33/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 34/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 35/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 36/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 37/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 38/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 39/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T06:27:19.028 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T06:27:19.029 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T06:27:19.030 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T06:27:19.031 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T06:27:19.032 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T06:27:19.033 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T06:27:19.034 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T06:27:19.035 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T06:27:19.036 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 149/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 151/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T06:27:19.037 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T06:27:19.038 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T06:27:19.038 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T06:27:19.038 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T06:27:19.039 INFO:teuthology.orchestra.run.smithi194.stdout:(11/156): cephfs-mirror-19.0.0-3538.gbee299f4.e 3.8 MB/s | 225 kB 00:00 2024-05-08T06:27:19.090 INFO:teuthology.orchestra.run.smithi194.stdout:(12/156): cephfs-shell-19.0.0-3538.gbee299f4.el 552 kB/s | 27 kB 00:00 2024-05-08T06:27:19.248 INFO:teuthology.orchestra.run.smithi194.stdout:(13/156): ceph-radosgw-19.0.0-3538.gbee299f4.el 9.9 MB/s | 11 MB 00:01 2024-05-08T06:27:19.349 INFO:teuthology.orchestra.run.smithi194.stdout:(14/156): libcephfs2-19.0.0-3538.gbee299f4.el9. 7.3 MB/s | 747 kB 00:00 2024-05-08T06:27:19.374 INFO:teuthology.orchestra.run.smithi194.stdout:(15/156): libcephfs-devel-19.0.0-3538.gbee299f4 112 kB/s | 32 kB 00:00 2024-05-08T06:27:19.407 INFO:teuthology.orchestra.run.smithi194.stdout:(16/156): libcephsqlite-19.0.0-3538.gbee299f4.e 2.8 MB/s | 163 kB 00:00 2024-05-08T06:27:19.441 INFO:teuthology.orchestra.run.smithi194.stdout:(17/156): librados-devel-19.0.0-3538.gbee299f4. 1.9 MB/s | 127 kB 00:00 2024-05-08T06:27:19.484 INFO:teuthology.orchestra.run.smithi194.stdout:(18/156): libradosstriper1-19.0.0-3538.gbee299f 6.6 MB/s | 500 kB 00:00 2024-05-08T06:27:19.550 INFO:teuthology.orchestra.run.smithi194.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gbe 682 kB/s | 45 kB 00:00 2024-05-08T06:27:19.625 INFO:teuthology.orchestra.run.smithi194.stdout:(20/156): python3-ceph-common-19.0.0-3538.gbee2 1.8 MB/s | 135 kB 00:00 2024-05-08T06:27:19.701 INFO:teuthology.orchestra.run.smithi194.stdout:(21/156): python3-cephfs-19.0.0-3538.gbee299f4. 2.1 MB/s | 161 kB 00:00 2024-05-08T06:27:19.784 INFO:teuthology.orchestra.run.smithi194.stdout:(22/156): python3-rados-19.0.0-3538.gbee299f4.e 3.8 MB/s | 321 kB 00:00 2024-05-08T06:27:19.893 INFO:teuthology.orchestra.run.smithi194.stdout:(23/156): librgw2-19.0.0-3538.gbee299f4.el9.x86 12 MB/s | 5.4 MB 00:00 2024-05-08T06:27:19.926 INFO:teuthology.orchestra.run.smithi194.stdout:(24/156): python3-rbd-19.0.0-3538.gbee299f4.el9 2.1 MB/s | 299 kB 00:00 2024-05-08T06:27:19.960 INFO:teuthology.orchestra.run.smithi194.stdout:(25/156): python3-rgw-19.0.0-3538.gbee299f4.el9 1.5 MB/s | 100 kB 00:00 2024-05-08T06:27:19.985 INFO:teuthology.orchestra.run.smithi194.stdout:(26/156): rbd-fuse-19.0.0-3538.gbee299f4.el9.x8 1.4 MB/s | 85 kB 00:00 2024-05-08T06:27:20.043 INFO:teuthology.orchestra.run.smithi194.stdout:(27/156): rbd-nbd-19.0.0-3538.gbee299f4.el9.x86 2.9 MB/s | 171 kB 00:00 2024-05-08T06:27:20.111 INFO:teuthology.orchestra.run.smithi194.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 517 kB/s | 34 kB 00:00 2024-05-08T06:27:20.211 INFO:teuthology.orchestra.run.smithi194.stdout:(29/156): rbd-mirror-19.0.0-3538.gbee299f4.el9. 12 MB/s | 3.1 MB 00:00 2024-05-08T06:27:20.244 INFO:teuthology.orchestra.run.smithi194.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3538.gbee299f 1.0 MB/s | 142 kB 00:00 2024-05-08T06:27:20.553 INFO:teuthology.orchestra.run.smithi194.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3538.gbee29 10 MB/s | 3.5 MB 00:00 2024-05-08T06:27:20.646 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-05-08T06:27:20.646 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-05-08T06:27:20.662 INFO:teuthology.orchestra.run.smithi194.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gbe 2.5 MB/s | 274 kB 00:00 2024-05-08T06:27:20.754 INFO:teuthology.orchestra.run.smithi194.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gbee299f4.e 544 kB/s | 49 kB 00:00 2024-05-08T06:27:20.879 INFO:teuthology.orchestra.run.smithi194.stdout:(34/156): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-05-08T06:27:20.896 INFO:teuthology.orchestra.run.smithi194.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3538.gb 116 kB/s | 16 kB 00:00 2024-05-08T06:27:20.971 INFO:teuthology.orchestra.run.smithi194.stdout:(36/156): cephadm-19.0.0-3538.gbee299f4.el9.noa 10 MB/s | 763 kB 00:00 2024-05-08T06:27:21.022 INFO:teuthology.orchestra.run.smithi194.stdout:(37/156): cephfs-top-19.0.0-3538.gbee299f4.el9. 367 kB/s | 18 kB 00:00 2024-05-08T06:27:21.163 INFO:teuthology.orchestra.run.smithi194.stdout:(38/156): ceph-volume-19.0.0-3538.gbee299f4.el9 964 kB/s | 273 kB 00:00 2024-05-08T06:27:21.195 INFO:teuthology.orchestra.run.smithi172.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T06:27:21.195 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:27:21.195 INFO:teuthology.orchestra.run.smithi172.stdout:Upgraded: 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout:Installed: 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T06:27:21.196 INFO:teuthology.orchestra.run.smithi172.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.197 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:27:21.198 INFO:teuthology.orchestra.run.smithi172.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.199 INFO:teuthology.orchestra.run.smithi172.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T06:27:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T06:27:21.201 INFO:teuthology.orchestra.run.smithi172.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T06:27:21.202 INFO:teuthology.orchestra.run.smithi172.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T06:27:21.203 INFO:teuthology.orchestra.run.smithi172.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T06:27:21.204 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T06:27:21.205 INFO:teuthology.orchestra.run.smithi172.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.206 INFO:teuthology.orchestra.run.smithi172.stdout: rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:27:21.207 INFO:teuthology.orchestra.run.smithi172.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T06:27:21.207 INFO:teuthology.orchestra.run.smithi172.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T06:27:21.207 INFO:teuthology.orchestra.run.smithi172.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T06:27:21.207 INFO:teuthology.orchestra.run.smithi172.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T06:27:21.207 INFO:teuthology.orchestra.run.smithi172.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T06:27:21.207 INFO:teuthology.orchestra.run.smithi172.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T06:27:21.207 INFO:teuthology.orchestra.run.smithi172.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T06:27:21.207 INFO:teuthology.orchestra.run.smithi172.stdout: 2024-05-08T06:27:21.207 INFO:teuthology.orchestra.run.smithi172.stdout:Complete! 2024-05-08T06:27:21.372 INFO:teuthology.orchestra.run.smithi194.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 230 kB/s | 80 kB 00:00 2024-05-08T06:27:21.788 DEBUG:teuthology.parallel:result is None 2024-05-08T06:27:21.789 INFO:teuthology.orchestra.run.smithi194.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 470 kB/s | 195 kB 00:00 2024-05-08T06:27:22.081 INFO:teuthology.orchestra.run.smithi194.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 876 kB/s | 803 kB 00:00 2024-05-08T06:27:22.298 INFO:teuthology.orchestra.run.smithi194.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 499 kB/s | 253 kB 00:00 2024-05-08T06:27:22.715 INFO:teuthology.orchestra.run.smithi194.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 256 kB/s | 106 kB 00:00 2024-05-08T06:27:23.148 INFO:teuthology.orchestra.run.smithi194.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 312 kB/s | 135 kB 00:00 2024-05-08T06:27:23.582 INFO:teuthology.orchestra.run.smithi194.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 289 kB/s | 125 kB 00:00 2024-05-08T06:27:24.099 INFO:teuthology.orchestra.run.smithi194.stdout:(46/156): python3-urllib3-1.26.5-5.el9.noarch.r 416 kB/s | 215 kB 00:00 2024-05-08T06:27:24.591 INFO:teuthology.orchestra.run.smithi194.stdout:(47/156): ceph-test-19.0.0-3538.gbee299f4.el9.x 8.0 MB/s | 49 MB 00:06 2024-05-08T06:27:24.641 INFO:teuthology.orchestra.run.smithi194.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 491 kB/s | 1.2 MB 00:02 2024-05-08T06:27:24.850 INFO:teuthology.orchestra.run.smithi194.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 516 kB/s | 107 kB 00:00 2024-05-08T06:27:24.908 INFO:teuthology.orchestra.run.smithi194.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 374 kB/s | 21 kB 00:00 2024-05-08T06:27:25.008 INFO:teuthology.orchestra.run.smithi194.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-05-08T06:27:25.067 INFO:teuthology.orchestra.run.smithi194.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 567 kB/s | 33 kB 00:00 2024-05-08T06:27:25.276 INFO:teuthology.orchestra.run.smithi194.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 1.5 MB/s | 943 kB 00:00 2024-05-08T06:27:25.334 INFO:teuthology.orchestra.run.smithi194.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 316 kB/s | 18 kB 00:00 2024-05-08T06:27:25.409 INFO:teuthology.orchestra.run.smithi194.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.8 MB/s | 3.0 MB 00:00 2024-05-08T06:27:25.435 INFO:teuthology.orchestra.run.smithi194.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 112 kB/s | 11 kB 00:00 2024-05-08T06:27:25.493 INFO:teuthology.orchestra.run.smithi194.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 785 kB/s | 45 kB 00:00 2024-05-08T06:27:25.518 INFO:teuthology.orchestra.run.smithi194.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-08T06:27:25.602 INFO:teuthology.orchestra.run.smithi194.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-05-08T06:27:25.661 INFO:teuthology.orchestra.run.smithi194.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 442 kB/s | 25 kB 00:00 2024-05-08T06:27:25.719 INFO:teuthology.orchestra.run.smithi194.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 825 kB/s | 47 kB 00:00 2024-05-08T06:27:25.795 INFO:teuthology.orchestra.run.smithi194.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 2.1 MB/s | 582 kB 00:00 2024-05-08T06:27:25.837 INFO:teuthology.orchestra.run.smithi194.stdout:(63/156): automake-1.16.2-8.el9.noarch.rpm 397 kB/s | 689 kB 00:01 2024-05-08T06:27:25.862 INFO:teuthology.orchestra.run.smithi194.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-05-08T06:27:25.929 INFO:teuthology.orchestra.run.smithi194.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-05-08T06:27:25.954 INFO:teuthology.orchestra.run.smithi194.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 388 kB/s | 35 kB 00:00 2024-05-08T06:27:26.196 INFO:teuthology.orchestra.run.smithi194.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 14 MB/s | 4.7 MB 00:00 2024-05-08T06:27:26.305 INFO:teuthology.orchestra.run.smithi194.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 8.3 MB/s | 911 kB 00:00 2024-05-08T06:27:26.380 INFO:teuthology.orchestra.run.smithi194.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-05-08T06:27:26.413 INFO:teuthology.orchestra.run.smithi194.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.2 MB/s | 133 kB 00:00 2024-05-08T06:27:26.530 INFO:teuthology.orchestra.run.smithi194.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.7 MB/s | 1.0 MB 00:00 2024-05-08T06:27:26.589 INFO:teuthology.orchestra.run.smithi194.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-08T06:27:26.989 INFO:teuthology.orchestra.run.smithi194.stdout:(73/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-05-08T06:27:27.073 INFO:teuthology.orchestra.run.smithi194.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-08T06:27:27.156 INFO:teuthology.orchestra.run.smithi194.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-05-08T06:27:27.273 INFO:teuthology.orchestra.run.smithi194.stdout:(76/156): postgresql-server-13.14-1.el9.x86_64. 6.5 MB/s | 5.8 MB 00:00 2024-05-08T06:27:27.365 INFO:teuthology.orchestra.run.smithi194.stdout:(77/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.1 MB/s | 4.4 MB 00:01 2024-05-08T06:27:27.391 INFO:teuthology.orchestra.run.smithi194.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 110 kB/s | 26 kB 00:00 2024-05-08T06:27:27.424 INFO:teuthology.orchestra.run.smithi194.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-08T06:27:27.466 INFO:teuthology.orchestra.run.smithi194.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 465 kB/s | 35 kB 00:00 2024-05-08T06:27:27.558 INFO:teuthology.orchestra.run.smithi194.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-05-08T06:27:27.564 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-05-08T06:27:27.650 INFO:teuthology.orchestra.run.smithi194.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-05-08T06:27:27.662 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T06:27:27.848 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T06:27:27.892 INFO:teuthology.orchestra.run.smithi194.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 320 kB/s | 77 kB 00:00 2024-05-08T06:27:27.975 INFO:teuthology.orchestra.run.smithi194.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 512 kB/s | 42 kB 00:00 2024-05-08T06:27:28.062 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T06:27:28.067 INFO:teuthology.orchestra.run.smithi194.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-05-08T06:27:28.136 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T06:27:28.151 INFO:teuthology.orchestra.run.smithi194.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-05-08T06:27:28.173 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T06:27:28.269 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T06:27:28.301 INFO:teuthology.orchestra.run.smithi194.stdout:(87/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.8 MB/s | 5.1 MB 00:00 2024-05-08T06:27:28.335 INFO:teuthology.orchestra.run.smithi194.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-05-08T06:27:28.385 INFO:teuthology.orchestra.run.smithi194.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 614 kB/s | 51 kB 00:00 2024-05-08T06:27:28.411 INFO:teuthology.orchestra.run.smithi194.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 714 kB/s | 54 kB 00:00 2024-05-08T06:27:28.469 INFO:teuthology.orchestra.run.smithi194.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 721 kB/s | 42 kB 00:00 2024-05-08T06:27:28.528 INFO:teuthology.orchestra.run.smithi194.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 767 kB/s | 44 kB 00:00 2024-05-08T06:27:28.595 INFO:teuthology.orchestra.run.smithi194.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-08T06:27:28.653 INFO:teuthology.orchestra.run.smithi194.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 623 kB/s | 36 kB 00:00 2024-05-08T06:27:28.693 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T06:27:28.712 INFO:teuthology.orchestra.run.smithi194.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 822 kB/s | 47 kB 00:00 2024-05-08T06:27:28.794 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T06:27:28.795 INFO:teuthology.orchestra.run.smithi194.stdout:(96/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-05-08T06:27:28.871 INFO:teuthology.orchestra.run.smithi194.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 778 kB/s | 58 kB 00:00 2024-05-08T06:27:28.946 INFO:teuthology.orchestra.run.smithi194.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-05-08T06:27:28.972 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T06:27:29.003 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T06:27:29.021 INFO:teuthology.orchestra.run.smithi194.stdout:(99/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 858 kB/s | 64 kB 00:00 2024-05-08T06:27:29.080 INFO:teuthology.orchestra.run.smithi194.stdout:(100/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 777 kB/s | 45 kB 00:00 2024-05-08T06:27:29.147 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T06:27:29.194 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T06:27:29.197 INFO:teuthology.orchestra.run.smithi194.stdout:(101/156): python3-jsonpointer-2.0-4.el9.noarch 10 kB/s | 19 kB 00:01 2024-05-08T06:27:29.247 INFO:teuthology.orchestra.run.smithi194.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 134 kB/s | 22 kB 00:00 2024-05-08T06:27:29.464 INFO:teuthology.orchestra.run.smithi194.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-05-08T06:27:29.488 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T06:27:29.557 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T06:27:29.582 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T06:27:29.698 INFO:teuthology.orchestra.run.smithi194.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-05-08T06:27:29.731 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T06:27:29.759 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T06:27:29.844 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T06:27:29.903 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T06:27:29.986 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T06:27:29.999 INFO:teuthology.orchestra.run.smithi194.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 65 kB/s | 19 kB 00:00 2024-05-08T06:27:30.032 INFO:teuthology.orchestra.run.smithi194.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 546 kB/s | 309 kB 00:00 2024-05-08T06:27:30.073 INFO:teuthology.orchestra.run.smithi194.stdout:(107/156): abseil-cpp-20211102.0-3.el9.x86_64.r 664 kB/s | 548 kB 00:00 2024-05-08T06:27:30.099 INFO:teuthology.orchestra.run.smithi194.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 392 kB/s | 26 kB 00:00 2024-05-08T06:27:30.149 INFO:teuthology.orchestra.run.smithi194.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 651 kB/s | 49 kB 00:00 2024-05-08T06:27:30.183 INFO:teuthology.orchestra.run.smithi194.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 811 kB/s | 67 kB 00:00 2024-05-08T06:27:30.233 INFO:teuthology.orchestra.run.smithi194.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-05-08T06:27:30.273 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T06:27:30.358 INFO:teuthology.orchestra.run.smithi194.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-05-08T06:27:30.400 INFO:teuthology.orchestra.run.smithi194.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-05-08T06:27:30.442 INFO:teuthology.orchestra.run.smithi194.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 527 kB/s | 43 kB 00:00 2024-05-08T06:27:30.476 INFO:teuthology.orchestra.run.smithi194.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 433 kB/s | 32 kB 00:00 2024-05-08T06:27:30.518 INFO:teuthology.orchestra.run.smithi194.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 201 kB/s | 15 kB 00:00 2024-05-08T06:27:30.559 INFO:teuthology.orchestra.run.smithi194.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-05-08T06:27:30.621 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T06:27:30.676 INFO:teuthology.orchestra.run.smithi194.stdout:(118/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2024-05-08T06:27:30.710 INFO:teuthology.orchestra.run.smithi194.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2024-05-08T06:27:30.744 INFO:teuthology.orchestra.run.smithi194.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.6 MB/s | 303 kB 00:00 2024-05-08T06:27:30.769 INFO:teuthology.orchestra.run.smithi194.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 386 kB/s | 35 kB 00:00 2024-05-08T06:27:30.803 INFO:teuthology.orchestra.run.smithi194.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-05-08T06:27:30.853 INFO:teuthology.orchestra.run.smithi194.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-05-08T06:27:30.869 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T06:27:30.878 INFO:teuthology.orchestra.run.smithi194.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 144 kB/s | 11 kB 00:00 2024-05-08T06:27:30.962 INFO:teuthology.orchestra.run.smithi194.stdout:(125/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.4 MB/s | 2.0 MB 00:00 2024-05-08T06:27:30.962 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T06:27:30.987 INFO:teuthology.orchestra.run.smithi194.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 133 kB/s | 18 kB 00:00 2024-05-08T06:27:31.012 INFO:teuthology.orchestra.run.smithi194.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 174 kB/s | 23 kB 00:00 2024-05-08T06:27:31.063 INFO:teuthology.orchestra.run.smithi194.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 262 kB/s | 19 kB 00:00 2024-05-08T06:27:31.088 INFO:teuthology.orchestra.run.smithi194.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 198 kB/s | 20 kB 00:00 2024-05-08T06:27:31.139 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T06:27:31.146 INFO:teuthology.orchestra.run.smithi194.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 7.7 MB/s | 1.0 MB 00:00 2024-05-08T06:27:31.172 INFO:teuthology.orchestra.run.smithi194.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 562 kB/s | 46 kB 00:00 2024-05-08T06:27:31.197 INFO:teuthology.orchestra.run.smithi194.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 733 kB/s | 79 kB 00:00 2024-05-08T06:27:31.222 INFO:teuthology.orchestra.run.smithi194.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 775 kB/s | 58 kB 00:00 2024-05-08T06:27:31.264 INFO:teuthology.orchestra.run.smithi194.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-05-08T06:27:31.265 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T06:27:31.289 INFO:teuthology.orchestra.run.smithi194.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-05-08T06:27:31.315 INFO:teuthology.orchestra.run.smithi194.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 984 kB/s | 90 kB 00:00 2024-05-08T06:27:31.340 INFO:teuthology.orchestra.run.smithi194.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 378 kB/s | 28 kB 00:00 2024-05-08T06:27:31.365 INFO:teuthology.orchestra.run.smithi194.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 411 kB/s | 31 kB 00:00 2024-05-08T06:27:31.399 INFO:teuthology.orchestra.run.smithi194.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-05-08T06:27:31.424 INFO:teuthology.orchestra.run.smithi194.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 711 kB/s | 59 kB 00:00 2024-05-08T06:27:31.449 INFO:teuthology.orchestra.run.smithi194.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 429 kB/s | 36 kB 00:00 2024-05-08T06:27:31.474 INFO:teuthology.orchestra.run.smithi194.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 683 kB/s | 51 kB 00:00 2024-05-08T06:27:31.542 INFO:teuthology.orchestra.run.smithi194.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-05-08T06:27:31.567 INFO:teuthology.orchestra.run.smithi194.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 769 kB/s | 90 kB 00:00 2024-05-08T06:27:31.625 INFO:teuthology.orchestra.run.smithi194.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-05-08T06:27:31.644 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T06:27:31.650 INFO:teuthology.orchestra.run.smithi194.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2024-05-08T06:27:31.684 INFO:teuthology.orchestra.run.smithi194.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-05-08T06:27:31.760 INFO:teuthology.orchestra.run.smithi194.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-08T06:27:31.864 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T06:27:31.900 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T06:27:31.947 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T06:27:32.043 INFO:teuthology.orchestra.run.smithi194.stdout:(149/156): librbd1-19.0.0-3538.gbee299f4.el9.x8 8.8 MB/s | 3.1 MB 00:00 2024-05-08T06:27:32.054 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T06:27:32.130 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T06:27:32.176 INFO:teuthology.orchestra.run.smithi194.stdout:(150/156): librados2-19.0.0-3538.gbee299f4.el9. 6.5 MB/s | 3.4 MB 00:00 2024-05-08T06:27:32.198 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T06:27:32.243 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T06:27:32.282 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T06:27:32.400 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T06:27:32.480 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T06:27:32.517 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T06:27:32.527 INFO:teuthology.orchestra.run.smithi194.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 119 kB/s | 42 kB 00:00 2024-05-08T06:27:32.572 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T06:27:32.680 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T06:27:32.720 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 32/164 2024-05-08T06:27:32.768 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 33/164 2024-05-08T06:27:32.801 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 34/164 2024-05-08T06:27:33.019 INFO:teuthology.orchestra.run.smithi194.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 506 kB/s | 248 kB 00:00 2024-05-08T06:27:33.086 INFO:teuthology.orchestra.run.smithi194.stdout:(153/156): NetworkManager-1.47.5-1.el9.x86_64.r 1.7 MB/s | 2.3 MB 00:01 2024-05-08T06:27:33.090 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T06:27:33.159 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T06:27:33.270 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T06:27:33.445 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T06:27:33.509 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T06:27:34.200 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T06:27:34.219 INFO:teuthology.orchestra.run.smithi194.stdout:(154/156): NetworkManager-libnm-1.47.5-1.el9.x8 860 kB/s | 1.8 MB 00:02 2024-05-08T06:27:34.298 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T06:27:34.353 INFO:teuthology.orchestra.run.smithi194.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 1.0 MB/s | 1.3 MB 00:01 2024-05-08T06:27:34.358 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T06:27:34.410 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T06:27:34.447 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 44/164 2024-05-08T06:27:34.507 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T06:27:34.719 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T06:27:34.794 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T06:27:34.922 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T06:27:34.996 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T06:27:35.080 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T06:27:35.136 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T06:27:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T06:27:35.243 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T06:27:35.284 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T06:27:35.345 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T06:27:35.421 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T06:27:35.503 INFO:teuthology.orchestra.run.smithi194.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 1.0 MB/s | 2.4 MB 00:02 2024-05-08T06:27:35.515 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-05-08T06:27:35.515 INFO:teuthology.orchestra.run.smithi194.stdout:Total 11 MB/s | 226 MB 00:20 2024-05-08T06:27:35.629 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T06:27:35.674 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T06:27:35.711 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T06:27:35.767 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T06:27:35.884 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T06:27:35.927 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T06:27:35.974 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T06:27:36.009 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T06:27:36.042 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T06:27:36.223 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T06:27:36.404 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T06:27:36.449 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T06:27:36.488 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T06:27:36.533 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T06:27:36.590 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T06:27:36.642 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T06:27:36.702 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T06:27:36.749 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T06:27:36.799 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T06:27:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T06:27:36.921 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T06:27:37.064 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T06:27:37.125 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T06:27:37.169 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T06:27:37.238 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T06:27:37.388 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T06:27:37.458 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T06:27:38.433 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T06:27:38.482 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T06:27:38.516 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T06:27:38.573 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-05-08T06:27:38.637 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T06:27:38.731 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T06:27:38.814 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-05-08T06:27:38.814 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-05-08T06:27:38.845 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T06:27:38.884 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T06:27:39.117 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T06:27:39.156 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T06:27:39.261 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T06:27:40.083 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T06:27:40.228 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T06:27:41.474 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-05-08T06:27:41.474 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-05-08T06:27:41.864 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T06:27:41.981 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T06:27:42.013 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T06:27:42.050 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T06:27:42.420 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T06:27:42.466 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T06:27:42.586 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T06:27:42.622 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 102/164 2024-05-08T06:27:42.679 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T06:27:43.224 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T06:27:43.260 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T06:27:43.352 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T06:27:43.379 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 106/164 2024-05-08T06:27:46.016 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T06:27:46.085 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T06:27:46.724 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T06:27:46.770 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T06:27:46.923 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T06:27:46.924 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T06:27:46.924 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T06:27:46.924 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:27:46.971 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T06:27:48.140 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-05-08T06:27:48.250 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T06:27:48.328 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T06:27:48.427 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T06:27:48.478 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T06:27:48.510 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T06:27:48.610 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T06:27:49.021 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T06:27:49.125 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T06:27:49.301 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T06:27:49.326 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T06:27:49.450 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T06:27:49.484 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T06:27:49.798 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T06:27:49.872 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T06:27:49.897 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T06:27:50.046 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T06:27:50.081 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T06:27:50.167 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T06:27:50.207 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T06:27:50.287 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T06:27:50.603 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T06:27:50.933 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T06:27:51.080 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T06:27:51.168 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T06:27:51.368 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T06:27:51.492 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T06:27:51.811 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T06:27:52.014 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T06:27:52.064 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T06:27:52.118 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T06:27:52.222 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T06:27:52.286 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T06:27:52.350 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T06:27:52.404 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T06:27:52.438 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T06:27:52.551 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T06:27:52.618 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T06:27:52.676 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T06:27:52.711 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T06:27:52.820 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T06:27:52.860 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 32/164 2024-05-08T06:27:52.908 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 33/164 2024-05-08T06:27:52.940 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 34/164 2024-05-08T06:27:53.053 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T06:27:53.110 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T06:27:53.235 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T06:27:53.418 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T06:27:53.490 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T06:27:54.188 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T06:27:54.295 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T06:27:54.355 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T06:27:54.404 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T06:27:54.452 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 44/164 2024-05-08T06:27:54.516 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T06:27:54.729 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T06:27:54.791 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T06:27:54.915 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T06:27:54.993 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T06:27:55.078 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T06:27:55.116 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T06:27:55.154 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T06:27:55.219 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T06:27:55.263 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T06:27:55.324 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T06:27:55.384 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T06:27:55.581 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T06:27:55.637 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T06:27:55.674 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T06:27:55.731 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T06:27:55.860 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T06:27:55.918 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T06:27:55.973 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T06:27:56.014 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T06:27:56.047 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T06:27:56.230 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T06:27:56.417 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T06:27:56.461 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T06:27:56.491 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T06:27:56.545 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T06:27:56.628 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T06:27:56.708 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T06:27:56.792 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T06:27:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T06:27:56.923 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T06:27:57.024 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T06:27:57.093 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T06:27:57.271 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T06:27:57.347 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T06:27:57.418 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T06:27:57.517 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T06:27:57.693 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T06:27:57.797 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T06:27:58.813 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T06:27:58.895 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T06:27:58.955 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T06:27:59.115 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T06:27:59.198 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T06:27:59.336 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T06:27:59.396 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T06:27:59.680 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T06:27:59.735 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T06:27:59.863 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T06:27:59.930 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T06:27:59.930 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-05-08T06:27:59.930 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-05-08T06:27:59.931 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-05-08T06:27:59.931 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-05-08T06:27:59.931 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-05-08T06:27:59.931 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-05-08T06:27:59.931 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-05-08T06:27:59.931 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:00.194 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T06:28:00.241 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T06:28:00.241 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:00.241 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T06:28:00.241 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:00.780 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T06:28:00.915 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T06:28:01.931 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T06:28:02.015 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T06:28:02.015 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:02.015 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T06:28:02.015 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T06:28:02.016 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T06:28:02.016 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:02.264 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T06:28:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T06:28:02.332 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:02.332 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T06:28:02.332 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T06:28:02.332 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T06:28:02.332 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:02.529 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T06:28:02.832 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T06:28:02.899 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T06:28:02.899 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:02.899 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T06:28:02.899 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T06:28:02.899 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T06:28:02.899 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:03.032 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T06:28:03.095 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T06:28:03.136 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T06:28:03.180 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T06:28:03.191 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T06:28:03.231 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T06:28:03.449 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T06:28:03.513 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T06:28:03.625 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T06:28:03.638 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T06:28:03.694 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T06:28:03.748 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T06:28:03.818 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T06:28:03.859 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 102/164 2024-05-08T06:28:03.918 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T06:28:03.922 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T06:28:03.993 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T06:28:04.042 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T06:28:04.075 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T06:28:04.494 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T06:28:04.522 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T06:28:04.621 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T06:28:04.649 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 106/164 2024-05-08T06:28:04.749 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T06:28:04.812 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T06:28:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 126/164 2024-05-08T06:28:04.979 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 127/164 2024-05-08T06:28:05.013 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T06:28:06.339 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T06:28:06.390 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T06:28:07.346 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T06:28:07.395 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T06:28:07.496 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T06:28:07.532 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T06:28:07.688 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T06:28:07.872 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 131/164 2024-05-08T06:28:07.900 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T06:28:07.977 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T06:28:07.977 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:07.977 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T06:28:07.978 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T06:28:07.978 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T06:28:07.978 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:08.045 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T06:28:08.056 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T06:28:08.090 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T06:28:08.092 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T06:28:08.216 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 134/164 2024-05-08T06:28:08.291 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T06:28:08.291 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T06:28:08.291 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T06:28:08.291 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:08.294 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 135/164 2024-05-08T06:28:08.341 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T06:28:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T06:28:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T06:28:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T06:28:09.438 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:09.438 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T06:28:09.439 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T06:28:09.439 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T06:28:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T06:28:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T06:28:09.563 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:09.563 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T06:28:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T06:28:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T06:28:09.711 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:09.711 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T06:28:09.711 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T06:28:09.711 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T06:28:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T06:28:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T06:28:10.176 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:10.176 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T06:28:10.176 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T06:28:10.176 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T06:28:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:15.221 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 141/164 2024-05-08T06:28:15.287 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 142/164 2024-05-08T06:28:15.353 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 143/164 2024-05-08T06:28:15.395 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T06:28:15.458 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T06:28:15.774 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 146/164 2024-05-08T06:28:15.874 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T06:28:15.911 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 148/164 2024-05-08T06:28:15.959 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T06:28:16.005 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T06:28:16.901 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T06:28:16.950 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T06:28:17.006 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T06:28:18.384 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 152/164 2024-05-08T06:28:18.509 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T06:28:18.575 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T06:28:18.725 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T06:28:18.766 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T06:28:18.804 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T06:28:18.804 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T06:28:18.933 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T06:28:18.987 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T06:28:18.987 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T06:28:19.133 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T06:28:19.171 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T06:28:19.204 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T06:28:19.204 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T06:28:19.549 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T06:28:19.549 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T06:28:19.687 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T06:28:19.818 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T06:28:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T06:28:20.110 INFO:teuthology.orchestra.run.smithi070.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-08T06:28:20.110 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:21.157 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T06:28:21.158 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-05-08T06:28:21.158 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-05-08T06:28:21.158 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-05-08T06:28:21.158 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-05-08T06:28:21.158 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-05-08T06:28:21.158 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-05-08T06:28:21.158 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-05-08T06:28:21.158 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:21.382 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T06:28:21.433 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T06:28:21.433 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:21.433 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T06:28:21.433 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:23.050 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T06:28:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T06:28:23.128 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:23.128 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T06:28:23.128 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T06:28:23.128 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T06:28:23.128 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:23.384 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T06:28:23.455 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T06:28:23.456 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:23.456 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T06:28:23.456 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T06:28:23.456 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T06:28:23.456 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:23.935 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T06:28:24.013 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T06:28:24.013 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:24.013 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T06:28:24.014 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T06:28:24.014 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T06:28:24.014 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:24.152 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T06:28:24.215 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T06:28:24.307 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T06:28:24.554 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T06:28:24.622 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T06:28:24.708 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T06:28:24.818 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T06:28:24.986 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T06:28:25.038 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T06:28:25.081 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T06:28:25.111 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T06:28:25.790 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T06:28:25.830 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T06:28:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 1/164 2024-05-08T06:28:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2/164 2024-05-08T06:28:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 3/164 2024-05-08T06:28:25.860 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 4/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 5/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 6/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 7/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 11/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 12/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 14/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 15/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 16/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 17/164 2024-05-08T06:28:25.861 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 18/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 19/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 20/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 21/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 22/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 23/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 24/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 25/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 26/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 27/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 28/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 29/164 2024-05-08T06:28:25.862 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 30/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 31/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 32/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 33/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 34/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 35/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 36/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 37/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 38/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 39/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T06:28:25.863 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T06:28:25.864 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T06:28:25.865 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T06:28:25.866 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T06:28:25.867 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T06:28:25.868 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T06:28:25.869 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T06:28:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T06:28:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 149/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 151/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T06:28:25.872 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T06:28:25.873 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T06:28:25.873 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T06:28:25.873 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T06:28:25.873 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T06:28:25.873 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T06:28:25.885 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 126/164 2024-05-08T06:28:25.995 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 127/164 2024-05-08T06:28:26.033 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T06:28:27.363 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T06:28:27.410 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T06:28:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T06:28:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:28.073 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-05-08T06:28:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T06:28:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T06:28:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T06:28:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T06:28:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.073 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.074 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.075 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T06:28:28.076 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T06:28:28.077 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T06:28:28.078 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.079 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T06:28:28.080 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T06:28:28.081 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T06:28:28.082 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T06:28:28.083 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T06:28:28.084 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T06:28:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T06:28:28.085 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:28:28.085 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-05-08T06:28:28.516 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T06:28:28.551 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T06:28:28.708 DEBUG:teuthology.parallel:result is None 2024-05-08T06:28:28.709 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T06:28:28.893 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 131/164 2024-05-08T06:28:28.928 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T06:28:28.999 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T06:28:28.999 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:28.999 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T06:28:29.000 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T06:28:29.000 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T06:28:29.000 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:29.054 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T06:28:29.091 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T06:28:29.210 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 134/164 2024-05-08T06:28:29.292 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 135/164 2024-05-08T06:28:30.329 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T06:28:30.365 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T06:28:30.438 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T06:28:30.438 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:30.438 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T06:28:30.439 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T06:28:30.439 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T06:28:30.439 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:30.499 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T06:28:30.573 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T06:28:30.573 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:30.574 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T06:28:30.574 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:30.658 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T06:28:30.732 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T06:28:30.732 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:30.732 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T06:28:30.732 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T06:28:30.732 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T06:28:30.733 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:31.117 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T06:28:31.192 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T06:28:31.192 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T06:28:31.192 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T06:28:31.192 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T06:28:31.192 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T06:28:31.192 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:36.274 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 141/164 2024-05-08T06:28:36.334 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 142/164 2024-05-08T06:28:36.393 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 143/164 2024-05-08T06:28:36.431 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T06:28:36.461 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T06:28:36.765 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 146/164 2024-05-08T06:28:36.819 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T06:28:36.856 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 148/164 2024-05-08T06:28:36.900 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T06:28:36.966 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T06:28:37.820 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T06:28:37.871 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T06:28:37.926 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T06:28:39.276 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 152/164 2024-05-08T06:28:39.385 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T06:28:39.455 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T06:28:39.605 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T06:28:39.654 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T06:28:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T06:28:39.692 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T06:28:39.818 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T06:28:39.866 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T06:28:39.866 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T06:28:40.003 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T06:28:40.041 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T06:28:40.074 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T06:28:40.075 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T06:28:40.422 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T06:28:40.422 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T06:28:40.590 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T06:28:40.721 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T06:28:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T06:28:40.978 INFO:teuthology.orchestra.run.smithi194.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-08T06:28:40.978 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:46.788 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 1/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 3/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 4/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 5/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 6/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 7/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 11/164 2024-05-08T06:28:46.789 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 12/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 14/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 15/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 16/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 17/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 18/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 19/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 20/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 21/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 22/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 23/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 24/164 2024-05-08T06:28:46.790 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 25/164 2024-05-08T06:28:46.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 26/164 2024-05-08T06:28:46.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 27/164 2024-05-08T06:28:46.791 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 28/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 29/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 30/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 31/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 32/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 33/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 34/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 35/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 36/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 37/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 38/164 2024-05-08T06:28:46.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 39/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T06:28:46.805 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T06:28:46.806 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T06:28:46.807 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T06:28:46.808 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T06:28:46.809 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T06:28:46.810 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T06:28:46.811 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T06:28:46.812 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 149/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 151/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T06:28:46.813 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T06:28:46.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T06:28:46.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T06:28:46.814 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T06:28:49.021 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T06:28:49.021 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:49.021 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-05-08T06:28:49.021 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T06:28:49.021 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.022 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.023 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T06:28:49.024 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T06:28:49.025 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T06:28:49.026 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T06:28:49.027 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T06:28:49.028 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T06:28:49.029 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T06:28:49.030 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T06:28:49.031 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T06:28:49.032 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T06:28:49.033 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T06:28:49.033 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T06:28:49.033 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T06:28:49.033 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T06:28:49.033 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T06:28:49.033 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T06:28:49.033 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:28:49.033 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-05-08T06:28:49.619 DEBUG:teuthology.parallel:result is None 2024-05-08T06:28:49.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:28:49.840 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T06:28:49.911 INFO:teuthology.orchestra.run.smithi070.stdout:19.0.0-3538.gbee299f4.el9 2024-05-08T06:28:49.911 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gbee299f4.el9 2024-05-08T06:28:49.911 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gbee299f4 is installed. 2024-05-08T06:28:49.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:28:50.131 DEBUG:teuthology.orchestra.run.smithi172:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T06:28:50.204 INFO:teuthology.orchestra.run.smithi172.stdout:19.0.0-3538.gbee299f4.el9 2024-05-08T06:28:50.204 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gbee299f4.el9 2024-05-08T06:28:50.205 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gbee299f4 is installed. 2024-05-08T06:28:50.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:28:50.422 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T06:28:50.474 INFO:teuthology.orchestra.run.smithi194.stdout:19.0.0-3538.gbee299f4.el9 2024-05-08T06:28:50.475 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gbee299f4.el9 2024-05-08T06:28:50.475 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gbee299f4 is installed. 2024-05-08T06:28:50.476 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T06:28:50.477 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:28:50.477 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T06:28:50.572 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:28:50.572 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T06:28:50.663 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:28:50.663 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T06:28:50.728 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T06:28:50.729 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:28:50.729 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T06:28:50.819 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T06:28:50.948 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:28:50.949 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T06:28:51.036 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T06:28:51.164 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:28:51.165 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T06:28:51.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T06:28:51.359 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T06:28:51.360 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:28:51.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T06:28:51.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T06:28:51.574 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:28:51.574 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T06:28:51.663 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T06:28:51.791 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:28:51.791 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T06:28:51.856 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T06:28:51.958 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T06:28:51.958 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:28:51.958 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T06:28:52.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T06:28:52.122 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:28:52.123 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T06:28:52.211 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T06:28:52.295 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:28:52.295 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T06:28:52.354 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T06:28:52.468 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-08T06:28:52.572 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-05-08T06:28:52.572 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:28:52.573 INFO:tasks.cephadm:Cluster fsid is 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:28:52.573 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-08T06:28:52.573 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.70', 'mon.b': '172.21.15.172', 'mon.c': '172.21.15.194'} 2024-05-08T06:28:52.573 INFO:tasks.cephadm:First mon is mon.a on smithi070 2024-05-08T06:28:52.573 INFO:tasks.cephadm:First mgr is x 2024-05-08T06:28:52.573 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-08T06:28:52.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname $(hostname -s) 2024-05-08T06:28:52.662 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2024-05-08T06:28:52.753 DEBUG:teuthology.orchestra.run.smithi194:> sudo hostname $(hostname -s) 2024-05-08T06:28:52.814 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-08T06:28:52.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:28:52.952 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79166/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3538-gbee299f4', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3538.gbee299f4'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-07 17:50:48.409840', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-57676-3', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-08T06:28:53.115 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-57676-3, sha1 bee299f4ac344e4c45e550d7a80abcadd7bc3d5a from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:28:53.117 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm 2024-05-08T06:28:53.117 DEBUG:teuthology.orchestra.run.smithi070:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T06:28:53.881 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r--. 1 ubuntu ubuntu 782795 May 8 06:28 /home/ubuntu/cephtest/cephadm 2024-05-08T06:28:53.881 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T06:28:54.770 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-r--r--. 1 ubuntu ubuntu 782795 May 8 06:28 /home/ubuntu/cephtest/cephadm 2024-05-08T06:28:54.770 DEBUG:teuthology.orchestra.run.smithi194:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T06:28:55.542 INFO:teuthology.orchestra.run.smithi194.stdout:-rw-r--r--. 1 ubuntu ubuntu 782795 May 8 06:28 /home/ubuntu/cephtest/cephadm 2024-05-08T06:28:55.543 DEBUG:teuthology.orchestra.run.smithi070:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T06:28:55.604 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T06:28:55.663 DEBUG:teuthology.orchestra.run.smithi194:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T06:28:55.831 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a on all hosts... 2024-05-08T06:28:55.832 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a pull 2024-05-08T06:28:55.840 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a pull 2024-05-08T06:28:55.849 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a pull 2024-05-08T06:28:57.683 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T06:28:57.857 INFO:teuthology.orchestra.run.smithi070.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T06:28:57.889 INFO:teuthology.orchestra.run.smithi194.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T06:29:34.252 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:29:34.252 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T06:29:34.252 INFO:teuthology.orchestra.run.smithi070.stdout: "image_id": "352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce", 2024-05-08T06:29:34.252 INFO:teuthology.orchestra.run.smithi070.stdout: "repo_digests": [ 2024-05-08T06:29:34.252 INFO:teuthology.orchestra.run.smithi070.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c" 2024-05-08T06:29:34.252 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T06:29:34.252 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:29:35.184 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-08T06:29:35.184 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T06:29:35.184 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce", 2024-05-08T06:29:35.184 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2024-05-08T06:29:35.184 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c" 2024-05-08T06:29:35.184 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2024-05-08T06:29:35.184 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-08T06:29:52.360 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-05-08T06:29:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T06:29:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "image_id": "352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce", 2024-05-08T06:29:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "repo_digests": [ 2024-05-08T06:29:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c" 2024-05-08T06:29:52.360 INFO:teuthology.orchestra.run.smithi194.stdout: ] 2024-05-08T06:29:52.361 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-05-08T06:29:52.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph 2024-05-08T06:29:52.501 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2024-05-08T06:29:52.595 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph 2024-05-08T06:29:52.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /etc/ceph 2024-05-08T06:29:52.777 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2024-05-08T06:29:52.855 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /etc/ceph 2024-05-08T06:29:52.946 INFO:tasks.cephadm:Writing seed config... 2024-05-08T06:29:52.948 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-08T06:29:52.948 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-08T06:29:52.948 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-08T06:29:52.948 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-08T06:29:52.948 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-08T06:29:52.948 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-08T06:29:52.948 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-08T06:29:52.949 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-08T06:29:52.950 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-08T06:29:52.951 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-05-08T06:29:52.952 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:29:52.952 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-08T06:29:53.007 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 3cf89df8-0d04-11ef-bc97-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-08T06:29:53.007 DEBUG:teuthology.orchestra.run.smithi070:mon.a> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.a.service 2024-05-08T06:29:53.055 DEBUG:teuthology.orchestra.run.smithi070:mgr.x> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.x.service 2024-05-08T06:29:53.103 INFO:tasks.cephadm:Bootstrapping... 2024-05-08T06:29:53.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a -v bootstrap --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.70 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-08T06:29:53.360 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-05-08T06:29:53.360 INFO:teuthology.orchestra.run.smithi070.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', '-v', 'bootstrap', '--fsid', '3cf89df8-0d04-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.70', '--skip-admin-label'] 2024-05-08T06:29:53.361 INFO:teuthology.orchestra.run.smithi070.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-08T06:29:53.361 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying podman|docker is present... 2024-05-08T06:29:53.424 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-08T06:29:53.424 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying lvm2 is present... 2024-05-08T06:29:53.424 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying time synchronization is in place... 2024-05-08T06:29:53.440 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T06:29:53.440 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T06:29:53.455 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T06:29:53.455 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-05-08T06:29:53.469 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-05-08T06:29:53.483 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-05-08T06:29:53.483 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-05-08T06:29:53.483 INFO:teuthology.orchestra.run.smithi070.stdout:Repeating the final host check... 2024-05-08T06:29:53.540 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-08T06:29:53.540 INFO:teuthology.orchestra.run.smithi070.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-08T06:29:53.540 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl is present 2024-05-08T06:29:53.540 INFO:teuthology.orchestra.run.smithi070.stdout:lvcreate is present 2024-05-08T06:29:53.554 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T06:29:53.554 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T06:29:53.568 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T06:29:53.569 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-05-08T06:29:53.590 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-05-08T06:29:53.609 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-05-08T06:29:53.610 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-05-08T06:29:53.610 INFO:teuthology.orchestra.run.smithi070.stdout:Host looks OK 2024-05-08T06:29:53.610 INFO:teuthology.orchestra.run.smithi070.stdout:Cluster fsid: 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:29:53.610 INFO:teuthology.orchestra.run.smithi070.stdout:Acquiring lock 139817291804096 on /run/cephadm/3cf89df8-0d04-11ef-bc97-c7b262605968.lock 2024-05-08T06:29:53.611 INFO:teuthology.orchestra.run.smithi070.stdout:Lock 139817291804096 acquired on /run/cephadm/3cf89df8-0d04-11ef-bc97-c7b262605968.lock 2024-05-08T06:29:53.612 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 3300 ... 2024-05-08T06:29:53.612 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 6789 ... 2024-05-08T06:29:53.613 INFO:teuthology.orchestra.run.smithi070.stdout:Base mon IP(s) is [172.21.15.70:3300, 172.21.15.70:6789], mon addrv is [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-05-08T06:29:53.627 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.70 metric 100 2024-05-08T06:29:53.627 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.70 metric 100 2024-05-08T06:29:53.639 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-08T06:29:53.639 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-08T06:29:53.639 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1791sec hoplimit 64 pref medium 2024-05-08T06:29:53.648 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-08T06:29:53.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-08T06:29:53.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T06:29:53.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-08T06:29:53.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2024-05-08T06:29:53.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T06:29:53.651 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-05-08T06:29:53.651 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-05-08T06:29:53.651 INFO:teuthology.orchestra.run.smithi070.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-08T06:29:53.654 INFO:teuthology.orchestra.run.smithi070.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-08T06:29:53.656 INFO:teuthology.orchestra.run.smithi070.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T06:29:54.224 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce 2024-05-08T06:29:54.224 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T06:29:54.224 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Getting image source signatures 2024-05-08T06:29:54.224 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-08T06:29:54.224 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:f08a3efca46759c0efc03dda6bb4c9adf7daf77004822005f2f0da3e8d1877bb 2024-05-08T06:29:54.224 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying config sha256:352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce 2024-05-08T06:29:54.224 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-08T06:29:55.474 INFO:teuthology.orchestra.run.smithi070.stdout:ceph: stdout ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev) 2024-05-08T06:29:55.474 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph version: ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev) 2024-05-08T06:29:55.475 INFO:teuthology.orchestra.run.smithi070.stdout:Extracting ceph user uid/gid from container image... 2024-05-08T06:29:56.597 INFO:teuthology.orchestra.run.smithi070.stdout:stat: stdout 167 167 2024-05-08T06:29:56.597 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial keys... 2024-05-08T06:29:57.804 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDlGztmxPiPBRAAlY+qidXYFkM5L73iD8gGsQ== 2024-05-08T06:29:58.949 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDmGztmv14hERAAp37LqgAZuDIp1prpBDXouA== 2024-05-08T06:30:00.086 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDnGztmZ+tHGRAAgRfU5TFaD/zXOTiwLH0laA== 2024-05-08T06:30:00.089 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial monmap... 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool for a [v2:172.21.15.70:3300,v1:172.21.15.70:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: set fsid to 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:30:01.250 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mon... 2024-05-08T06:30:02.366 INFO:teuthology.orchestra.run.smithi070.stdout:create mon.a on 2024-05-08T06:30:02.728 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-08T06:30:02.973 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-08T06:30:03.278 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968.target. 2024-05-08T06:30:03.278 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968.target. 2024-05-08T06:30:03.661 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.a 2024-05-08T06:30:03.661 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-08T06:30:03.965 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968.target.wants/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@.service. 2024-05-08T06:30:04.606 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:04 smithi070 podman[29206]: 2024-05-08 06:30:04.373778186 +0000 UTC m=+0.136934076 container create bc5a8b70107c2bc7e5bd91227c663cdd4619226a4dd6c3a02e047610b3d7cc2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-08T06:30:04.796 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T06:30:04.796 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-05-08T06:30:04.811 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T06:30:04.812 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-05-08T06:30:04.812 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-05-08T06:30:04.812 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T06:30:04.812 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon to start... 2024-05-08T06:30:04.812 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon... 2024-05-08T06:30:04.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:04 smithi070 podman[29206]: 2024-05-08 06:30:04.686044044 +0000 UTC m=+0.449199958 container init bc5a8b70107c2bc7e5bd91227c663cdd4619226a4dd6c3a02e047610b3d7cc2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:30:04.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:04 smithi070 podman[29206]: 2024-05-08 06:30:04.696339562 +0000 UTC m=+0.459495496 container start bc5a8b70107c2bc7e5bd91227c663cdd4619226a4dd6c3a02e047610b3d7cc2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-08T06:30:04.959 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:04 smithi070 bash[29206]: bc5a8b70107c2bc7e5bd91227c663cdd4619226a4dd6c3a02e047610b3d7cc2b 2024-05-08T06:30:04.959 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:04 smithi070 systemd[1]: Started Ceph mon.a for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:30:04.959 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:04 smithi070 ceph-mon[29225]: mkfs 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:04.959 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:04 smithi070 ceph-mon[29225]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T06:30:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T06:30:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: monmap epoch 1 2024-05-08T06:30:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: last_changed 2024-05-08T06:30:00.612071+0000 2024-05-08T06:30:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: created 2024-05-08T06:30:00.612071+0000 2024-05-08T06:30:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: min_mon_release 19 (squid) 2024-05-08T06:30:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: election_strategy: 1 2024-05-08T06:30:05.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-05-08T06:30:05.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: fsmap 2024-05-08T06:30:05.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T06:30:05.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: mgrmap e1: no daemons active 2024-05-08T06:30:05.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:05 smithi070 ceph-mon[29225]: from='client.? 172.21.15.70:0/320207758' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-08T06:30:06.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout cluster: 2024-05-08T06:30:06.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout id: 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout services: 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.86436s) 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout data: 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-08T06:30:06.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pgs: 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.542+0000 7f8865c00700 1 Processor -- start 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.542+0000 7f8865c00700 1 -- start start 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.543+0000 7f8865c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f8860108ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.543+0000 7f8865c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8860109490 con 0x7f8860108aa0 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.544+0000 7f885fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f8860108ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.544+0000 7f885fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f8860108ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37538/0 (socket says 172.21.15.70:37538) 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.544+0000 7f885fe00700 1 -- 172.21.15.70:0/2907207088 learned_addr learned my addr 172.21.15.70:0/2907207088 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.545+0000 7f885fe00700 1 -- 172.21.15.70:0/2907207088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8860109ca0 con 0x7f8860108aa0 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.545+0000 7f885fe00700 1 --2- 172.21.15.70:0/2907207088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f8860108ec0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f88500098a0 tx=0x7f8850009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdd1c6da37681a8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:06.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.545+0000 7f885ea00700 1 -- 172.21.15.70:0/2907207088 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8850004160 con 0x7f8860108aa0 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.545+0000 7f885ea00700 1 -- 172.21.15.70:0/2907207088 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8850004300 con 0x7f8860108aa0 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.545+0000 7f885ea00700 1 -- 172.21.15.70:0/2907207088 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88500036a0 con 0x7f8860108aa0 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.546+0000 7f8865c00700 1 -- 172.21.15.70:0/2907207088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 msgr2=0x7f8860108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.546+0000 7f8865c00700 1 --2- 172.21.15.70:0/2907207088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f8860108ec0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f88500098a0 tx=0x7f8850009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.546+0000 7f8865c00700 1 -- 172.21.15.70:0/2907207088 shutdown_connections 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.546+0000 7f8865c00700 1 --2- 172.21.15.70:0/2907207088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f8860108ec0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.546+0000 7f8865c00700 1 -- 172.21.15.70:0/2907207088 >> 172.21.15.70:0/2907207088 conn(0x7f8860104040 msgr2=0x7f8860106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.546+0000 7f8865c00700 1 -- 172.21.15.70:0/2907207088 shutdown_connections 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.546+0000 7f8865c00700 1 -- 172.21.15.70:0/2907207088 wait complete. 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.548+0000 7f8865c00700 1 Processor -- start 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.548+0000 7f8865c00700 1 -- start start 2024-05-08T06:30:06.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.548+0000 7f8865c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f886019e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:06.313 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.548+0000 7f8865c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f886010a1d0 con 0x7f8860108aa0 2024-05-08T06:30:06.313 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.549+0000 7f885fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f886019e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:06.313 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.549+0000 7f885fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f886019e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37542/0 (socket says 172.21.15.70:37542) 2024-05-08T06:30:06.313 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.549+0000 7f885fe00700 1 -- 172.21.15.70:0/320207758 learned_addr learned my addr 172.21.15.70:0/320207758 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:06.313 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.549+0000 7f885fe00700 1 -- 172.21.15.70:0/320207758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f886019e920 con 0x7f8860108aa0 2024-05-08T06:30:06.313 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.549+0000 7f885fe00700 1 --2- 172.21.15.70:0/320207758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f886019e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8850000c00 tx=0x7f8850004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:06.313 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.550+0000 7f885cc00700 1 -- 172.21.15.70:0/320207758 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8850003db0 con 0x7f8860108aa0 2024-05-08T06:30:06.313 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.550+0000 7f885cc00700 1 -- 172.21.15.70:0/320207758 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8850011630 con 0x7f8860108aa0 2024-05-08T06:30:06.313 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.550+0000 7f8865c00700 1 -- 172.21.15.70:0/320207758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f886019ebb0 con 0x7f8860108aa0 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.550+0000 7f885cc00700 1 -- 172.21.15.70:0/320207758 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8850011950 con 0x7f8860108aa0 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.550+0000 7f8865c00700 1 -- 172.21.15.70:0/320207758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88601a18a0 con 0x7f8860108aa0 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.550+0000 7f885cc00700 1 -- 172.21.15.70:0/320207758 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8850011af0 con 0x7f8860108aa0 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.550+0000 7f885cc00700 1 -- 172.21.15.70:0/320207758 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f885001c450 con 0x7f8860108aa0 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.551+0000 7f8865c00700 1 -- 172.21.15.70:0/320207758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8860064b00 con 0x7f8860108aa0 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.554+0000 7f885cc00700 1 -- 172.21.15.70:0/320207758 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8850032020 con 0x7f8860108aa0 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.634+0000 7f8865c00700 1 -- 172.21.15.70:0/320207758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f88601a1d90 con 0x7f8860108aa0 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.635+0000 7f885cc00700 1 -- 172.21.15.70:0/320207758 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f8850004260 con 0x7f8860108aa0 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.636+0000 7f8865c00700 1 -- 172.21.15.70:0/320207758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 msgr2=0x7f886019e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.636+0000 7f8865c00700 1 --2- 172.21.15.70:0/320207758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f886019e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8850000c00 tx=0x7f8850004750 comp rx=0 tx=0).stop 2024-05-08T06:30:06.314 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.636+0000 7f8865c00700 1 -- 172.21.15.70:0/320207758 shutdown_connections 2024-05-08T06:30:06.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.636+0000 7f8865c00700 1 --2- 172.21.15.70:0/320207758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8860108aa0 0x7f886019e3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:06.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.636+0000 7f8865c00700 1 -- 172.21.15.70:0/320207758 >> 172.21.15.70:0/320207758 conn(0x7f8860104040 msgr2=0x7f886007d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:06.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.636+0000 7f8865c00700 1 -- 172.21.15.70:0/320207758 shutdown_connections 2024-05-08T06:30:06.315 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:05.637+0000 7f8865c00700 1 -- 172.21.15.70:0/320207758 wait complete. 2024-05-08T06:30:06.315 INFO:teuthology.orchestra.run.smithi070.stdout:mon is available 2024-05-08T06:30:06.315 INFO:teuthology.orchestra.run.smithi070.stdout:Assimilating anything we can from ceph.conf... 2024-05-08T06:30:07.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:07 smithi070 ceph-mon[29225]: from='client.? 172.21.15.70:0/2799288138' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T06:30:07.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:07 smithi070 ceph-mon[29225]: from='client.? 172.21.15.70:0/2799288138' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-08T06:30:07.648 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:07.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T06:30:07.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:07.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-08T06:30:07.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-05-08T06:30:07.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T06:30:07.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T06:30:07.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T06:30:07.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T06:30:07.682 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.941+0000 7f6677200700 1 Processor -- start 2024-05-08T06:30:07.683 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.941+0000 7f6677200700 1 -- start start 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.942+0000 7f6677200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f6678111cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.942+0000 7f6677200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f66781122a0 con 0x7f6678083280 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.942+0000 7f6675e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f6678111cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.942+0000 7f6675e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f6678111cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37548/0 (socket says 172.21.15.70:37548) 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.942+0000 7f6675e00700 1 -- 172.21.15.70:0/3693075323 learned_addr learned my addr 172.21.15.70:0/3693075323 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.942+0000 7f6675e00700 1 -- 172.21.15.70:0/3693075323 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6678112420 con 0x7f6678083280 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.943+0000 7f6675e00700 1 --2- 172.21.15.70:0/3693075323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f6678111cd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f66680098a0 tx=0x7f6668009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64205f4f825e68e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.943+0000 7f6675400700 1 -- 172.21.15.70:0/3693075323 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6668004160 con 0x7f6678083280 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.943+0000 7f6675400700 1 -- 172.21.15.70:0/3693075323 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6668004300 con 0x7f6678083280 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.943+0000 7f6675400700 1 -- 172.21.15.70:0/3693075323 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66680036a0 con 0x7f6678083280 2024-05-08T06:30:07.684 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.944+0000 7f6677200700 1 -- 172.21.15.70:0/3693075323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 msgr2=0x7f6678111cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.944+0000 7f6677200700 1 --2- 172.21.15.70:0/3693075323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f6678111cd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f66680098a0 tx=0x7f6668009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.944+0000 7f6677200700 1 -- 172.21.15.70:0/3693075323 shutdown_connections 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.944+0000 7f6677200700 1 --2- 172.21.15.70:0/3693075323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f6678111cd0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.944+0000 7f6677200700 1 -- 172.21.15.70:0/3693075323 >> 172.21.15.70:0/3693075323 conn(0x7f667807e050 msgr2=0x7f66780804b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.944+0000 7f6677200700 1 -- 172.21.15.70:0/3693075323 shutdown_connections 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.944+0000 7f6677200700 1 -- 172.21.15.70:0/3693075323 wait complete. 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.945+0000 7f6677200700 1 Processor -- start 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.945+0000 7f6677200700 1 -- start start 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.945+0000 7f6677200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f66781a2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.945+0000 7f6677200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6678112950 con 0x7f6678083280 2024-05-08T06:30:07.685 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.946+0000 7f6675e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f66781a2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.946+0000 7f6675e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f66781a2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37560/0 (socket says 172.21.15.70:37560) 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.946+0000 7f6675e00700 1 -- 172.21.15.70:0/2799288138 learned_addr learned my addr 172.21.15.70:0/2799288138 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.946+0000 7f6675e00700 1 -- 172.21.15.70:0/2799288138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66781a2cb0 con 0x7f6678083280 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.946+0000 7f6675e00700 1 --2- 172.21.15.70:0/2799288138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f66781a2770 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6668000c00 tx=0x7f6668004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.946+0000 7f666ea00700 1 -- 172.21.15.70:0/2799288138 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6668003db0 con 0x7f6678083280 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.946+0000 7f666ea00700 1 -- 172.21.15.70:0/2799288138 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6668011630 con 0x7f6678083280 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.947+0000 7f6677200700 1 -- 172.21.15.70:0/2799288138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66781a2f40 con 0x7f6678083280 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.947+0000 7f666ea00700 1 -- 172.21.15.70:0/2799288138 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6668011950 con 0x7f6678083280 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.947+0000 7f6677200700 1 -- 172.21.15.70:0/2799288138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66781a5c30 con 0x7f6678083280 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.947+0000 7f666ea00700 1 -- 172.21.15.70:0/2799288138 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6668011af0 con 0x7f6678083280 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.947+0000 7f666ea00700 1 -- 172.21.15.70:0/2799288138 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f666801c450 con 0x7f6678083280 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.948+0000 7f6677200700 1 -- 172.21.15.70:0/2799288138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6678064b00 con 0x7f6678083280 2024-05-08T06:30:07.686 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:06.951+0000 7f666ea00700 1 -- 172.21.15.70:0/2799288138 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6668004260 con 0x7f6678083280 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.027+0000 7f6677200700 1 -- 172.21.15.70:0/2799288138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f667802e710 con 0x7f6678083280 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.035+0000 7f666ea00700 1 -- 172.21.15.70:0/2799288138 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f666801b450 con 0x7f6678083280 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.036+0000 7f666ea00700 1 -- 172.21.15.70:0/2799288138 <== mon.0 v2:172.21.15.70:3300/0 8 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f666801b630 con 0x7f6678083280 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.037+0000 7f6677200700 1 -- 172.21.15.70:0/2799288138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 msgr2=0x7f66781a2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.037+0000 7f6677200700 1 --2- 172.21.15.70:0/2799288138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f66781a2770 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6668000c00 tx=0x7f6668004750 comp rx=0 tx=0).stop 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.037+0000 7f6677200700 1 -- 172.21.15.70:0/2799288138 shutdown_connections 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.037+0000 7f6677200700 1 --2- 172.21.15.70:0/2799288138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6678083280 0x7f66781a2770 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.037+0000 7f6677200700 1 -- 172.21.15.70:0/2799288138 >> 172.21.15.70:0/2799288138 conn(0x7f667807e050 msgr2=0x7f6678080340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.038+0000 7f6677200700 1 -- 172.21.15.70:0/2799288138 shutdown_connections 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:07.038+0000 7f6677200700 1 -- 172.21.15.70:0/2799288138 wait complete. 2024-05-08T06:30:07.687 INFO:teuthology.orchestra.run.smithi070.stdout:Generating new minimal ceph.conf... 2024-05-08T06:30:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:08 smithi070 ceph-mon[29225]: from='client.? 172.21.15.70:0/3390182325' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:30:09.105 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.270+0000 7fcbffe00700 1 Processor -- start 2024-05-08T06:30:09.106 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.271+0000 7fcbffe00700 1 -- start start 2024-05-08T06:30:09.106 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.271+0000 7fcbffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf807fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:09.106 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.271+0000 7fcbffe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8080240 con 0x7fcbf807f850 2024-05-08T06:30:09.106 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.271+0000 7fcbfd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf807fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:09.106 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.271+0000 7fcbfd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf807fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42242/0 (socket says 172.21.15.70:42242) 2024-05-08T06:30:09.106 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.271+0000 7fcbfd400700 1 -- 172.21.15.70:0/3354049643 learned_addr learned my addr 172.21.15.70:0/3354049643 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:09.106 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.272+0000 7fcbfd400700 1 -- 172.21.15.70:0/3354049643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf8080a50 con 0x7fcbf807f850 2024-05-08T06:30:09.106 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.272+0000 7fcbfd400700 1 --2- 172.21.15.70:0/3354049643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf807fc70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0098a0 tx=0x7fcbec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73101f6e82c05fb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:09.106 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.272+0000 7fcbf7e00700 1 -- 172.21.15.70:0/3354049643 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbec004160 con 0x7fcbf807f850 2024-05-08T06:30:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.272+0000 7fcbf7e00700 1 -- 172.21.15.70:0/3354049643 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fcbec004300 con 0x7fcbf807f850 2024-05-08T06:30:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.272+0000 7fcbf7e00700 1 -- 172.21.15.70:0/3354049643 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbec0119e0 con 0x7fcbf807f850 2024-05-08T06:30:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.273+0000 7fcbffe00700 1 -- 172.21.15.70:0/3354049643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 msgr2=0x7fcbf807fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.273+0000 7fcbffe00700 1 --2- 172.21.15.70:0/3354049643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf807fc70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcbec0098a0 tx=0x7fcbec009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.273+0000 7fcbffe00700 1 -- 172.21.15.70:0/3354049643 shutdown_connections 2024-05-08T06:30:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.273+0000 7fcbffe00700 1 --2- 172.21.15.70:0/3354049643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf807fc70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.273+0000 7fcbffe00700 1 -- 172.21.15.70:0/3354049643 >> 172.21.15.70:0/3354049643 conn(0x7fcbf807e280 msgr2=0x7fcbf807e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.273+0000 7fcbffe00700 1 -- 172.21.15.70:0/3354049643 shutdown_connections 2024-05-08T06:30:09.107 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.273+0000 7fcbffe00700 1 -- 172.21.15.70:0/3354049643 wait complete. 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.274+0000 7fcbffe00700 1 Processor -- start 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.274+0000 7fcbffe00700 1 -- start start 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.275+0000 7fcbffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf81a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.275+0000 7fcbffe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8081c90 con 0x7fcbf807f850 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.275+0000 7fcbfd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf81a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.275+0000 7fcbfd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf81a30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42256/0 (socket says 172.21.15.70:42256) 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.275+0000 7fcbfd400700 1 -- 172.21.15.70:0/3390182325 learned_addr learned my addr 172.21.15.70:0/3390182325 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.275+0000 7fcbfd400700 1 -- 172.21.15.70:0/3390182325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf81a35f0 con 0x7fcbf807f850 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.276+0000 7fcbfd400700 1 --2- 172.21.15.70:0/3390182325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf81a30b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009130 tx=0x7fcbec011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.276+0000 7fcbf6000700 1 -- 172.21.15.70:0/3390182325 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbec003b20 con 0x7fcbf807f850 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.276+0000 7fcbf6000700 1 -- 172.21.15.70:0/3390182325 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fcbec01a8a0 con 0x7fcbf807f850 2024-05-08T06:30:09.108 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.276+0000 7fcbffe00700 1 -- 172.21.15.70:0/3390182325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf81a3880 con 0x7fcbf807f850 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.276+0000 7fcbf6000700 1 -- 172.21.15.70:0/3390182325 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbec024810 con 0x7fcbf807f850 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.276+0000 7fcbffe00700 1 -- 172.21.15.70:0/3390182325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf81a6570 con 0x7fcbf807f850 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.277+0000 7fcbf6000700 1 -- 172.21.15.70:0/3390182325 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcbec022020 con 0x7fcbf807f850 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.277+0000 7fcbf6000700 1 -- 172.21.15.70:0/3390182325 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcbec02dd90 con 0x7fcbf807f850 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.278+0000 7fcbffe00700 1 -- 172.21.15.70:0/3390182325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf8064b00 con 0x7fcbf807f850 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.280+0000 7fcbf6000700 1 -- 172.21.15.70:0/3390182325 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fcbec043ec0 con 0x7fcbf807f850 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.356+0000 7fcbffe00700 1 -- 172.21.15.70:0/3390182325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fcbf819c610 con 0x7fcbf807f850 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.357+0000 7fcbf6000700 1 -- 172.21.15.70:0/3390182325 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fcbf819c610 con 0x7fcbf807f850 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.359+0000 7fcbffe00700 1 -- 172.21.15.70:0/3390182325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 msgr2=0x7fcbf81a30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:09.109 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.359+0000 7fcbffe00700 1 --2- 172.21.15.70:0/3390182325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf81a30b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009130 tx=0x7fcbec011a60 comp rx=0 tx=0).stop 2024-05-08T06:30:09.110 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.359+0000 7fcbffe00700 1 -- 172.21.15.70:0/3390182325 shutdown_connections 2024-05-08T06:30:09.110 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.359+0000 7fcbffe00700 1 --2- 172.21.15.70:0/3390182325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcbf807f850 0x7fcbf81a30b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:09.110 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.359+0000 7fcbffe00700 1 -- 172.21.15.70:0/3390182325 >> 172.21.15.70:0/3390182325 conn(0x7fcbf807e280 msgr2=0x7fcbf81097d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:09.110 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.359+0000 7fcbffe00700 1 -- 172.21.15.70:0/3390182325 shutdown_connections 2024-05-08T06:30:09.110 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:08.359+0000 7fcbffe00700 1 -- 172.21.15.70:0/3390182325 wait complete. 2024-05-08T06:30:09.110 INFO:teuthology.orchestra.run.smithi070.stdout:Restarting the monitor... 2024-05-08T06:30:09.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:09 smithi070 systemd[1]: Stopping Ceph mon.a for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:30:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:09 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a[29221]: 2024-05-08T06:30:09.597+0000 7fec1ce00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:30:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:09 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a[29221]: 2024-05-08T06:30:09.597+0000 7fec1ce00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-08T06:30:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:09 smithi070 podman[29467]: 2024-05-08 06:30:09.836620654 +0000 UTC m=+0.362427534 container died bc5a8b70107c2bc7e5bd91227c663cdd4619226a4dd6c3a02e047610b3d7cc2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:30:10.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:10 smithi070 podman[29467]: 2024-05-08 06:30:10.231847465 +0000 UTC m=+0.757654365 container cleanup bc5a8b70107c2bc7e5bd91227c663cdd4619226a4dd6c3a02e047610b3d7cc2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-08T06:30:10.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:10 smithi070 bash[29467]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a 2024-05-08T06:30:10.782 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:10 smithi070 podman[29481]: 2024-05-08 06:30:10.515843798 +0000 UTC m=+0.661078297 container remove bc5a8b70107c2bc7e5bd91227c663cdd4619226a4dd6c3a02e047610b3d7cc2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:30:11.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:10 smithi070 systemd[1]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-08T06:30:11.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:10 smithi070 systemd[1]: Stopped Ceph mon.a for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:30:11.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:10 smithi070 systemd[1]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.a.service: Consumed 1.819s CPU time. 2024-05-08T06:30:11.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:10 smithi070 systemd[1]: Starting Ceph mon.a for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:30:11.461 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 podman[29572]: 2024-05-08 06:30:11.065087296 +0000 UTC m=+0.033346518 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:30:11.461 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 podman[29572]: 2024-05-08 06:30:11.175375149 +0000 UTC m=+0.143634394 container create 65b3c1175be85fae198ea76d8bbc1d523b5d14dedf20f3de17fa1bf887936b67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-08T06:30:11.461 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 podman[29572]: 2024-05-08 06:30:11.461939671 +0000 UTC m=+0.430198931 container init 65b3c1175be85fae198ea76d8bbc1d523b5d14dedf20f3de17fa1bf887936b67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-08T06:30:11.553 INFO:teuthology.orchestra.run.smithi070.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-08T06:30:11.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 podman[29572]: 2024-05-08 06:30:11.472820325 +0000 UTC m=+0.441079582 container start 65b3c1175be85fae198ea76d8bbc1d523b5d14dedf20f3de17fa1bf887936b67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, ceph=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD) 2024-05-08T06:30:11.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T06:30:11.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev), process ceph-mon, pid 2 2024-05-08T06:30:11.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: pidfile_write: ignore empty --pid-file 2024-05-08T06:30:11.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: load: jerasure load: lrc 2024-05-08T06:30:11.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: RocksDB version: 7.9.2 2024-05-08T06:30:11.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Git sha 0 2024-05-08T06:30:11.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Compile date 2024-05-07 11:18:56 2024-05-08T06:30:11.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: DB SUMMARY 2024-05-08T06:30:11.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: DB Session ID: 4LNHKC0NPDN43QZD1LG2 2024-05-08T06:30:11.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: CURRENT file: CURRENT 2024-05-08T06:30:11.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T06:30:11.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-08T06:30:11.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-08T06:30:11.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 103994 ; 2024-05-08T06:30:11.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.error_if_exists: 0 2024-05-08T06:30:11.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.create_if_missing: 0 2024-05-08T06:30:11.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.paranoid_checks: 1 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.env: 0x55815ab5fcc0 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.info_log: 0x55815b4ffde0 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.statistics: (nil) 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.use_fsync: 0 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_log_file_size: 0 2024-05-08T06:30:11.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.allow_fallocate: 1 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.use_direct_reads: 0 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T06:30:11.859 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.db_log_dir: 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.wal_dir: 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.write_buffer_manager: 0x55815b4d10e0 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T06:30:11.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.unordered_write: 0 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.row_cache: None 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.wal_filter: None 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.two_write_queues: 0 2024-05-08T06:30:11.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.wal_compression: 0 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.atomic_flush: 0 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.log_readahead_size: 0 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T06:30:11.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_background_jobs: 2 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_background_compactions: -1 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_subcompactions: 1 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_open_files: -1 2024-05-08T06:30:11.863 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_background_flushes: -1 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Compression algorithms supported: 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: kZSTD supported: 0 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: kXpressCompression supported: 0 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: kZlibCompression supported: 1 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: kSnappyCompression supported: 1 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: kLZ4Compression supported: 1 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: kBZip2Compression supported: 0 2024-05-08T06:30:11.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.merge_operator: 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_filter: None 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55815b4fffa0) 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks: 1 2024-05-08T06:30:11.865 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_top_level_index_and_filter: 1 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_type: 0 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_index_type: 0 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_shortening: 1 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: checksum: 4 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: no_block_cache: 0 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache: 0x55815b5031f0 2024-05-08T06:30:11.866 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_name: BinnedLRUCache 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_options: 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: capacity : 536870912 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_shard_bits : 4 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: strict_capacity_limit : 0 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: high_pri_pool_ratio: 0.000 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_compressed: (nil) 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: persistent_cache: (nil) 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size: 4096 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size_deviation: 10 2024-05-08T06:30:11.867 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_restart_interval: 16 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_block_restart_interval: 1 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: metadata_block_size: 4096 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: partition_filters: 0 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: use_delta_encoding: 1 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: filter_policy: bloomfilter 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: whole_key_filtering: 1 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: verify_compression: 0 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: read_amp_bytes_per_bit: 0 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: format_version: 5 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_index_compression: 1 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_align: 0 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: max_auto_readahead_size: 262144 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: prepopulate_block_cache: 0 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: initial_auto_readahead_size: 8192 2024-05-08T06:30:11.868 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T06:30:11.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T06:30:11.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T06:30:11.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression: NoCompression 2024-05-08T06:30:11.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T06:30:11.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T06:30:11.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T06:30:11.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.num_levels: 7 2024-05-08T06:30:11.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T06:30:11.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T06:30:11.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T06:30:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T06:30:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T06:30:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T06:30:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T06:30:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T06:30:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T06:30:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T06:30:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T06:30:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T06:30:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-08T06:30:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.inplace_update_support: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.bloom_locality: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.max_successive_merges: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.ttl: 2592000 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T06:30:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.enable_blob_files: false 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.min_blob_size: 0 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-08T06:30:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cb5a79ed-9a82-4f7d-8af2-9d8b066eefff 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715149811531338, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715149811532802, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99237, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 322, "table_properties": {"data_size": 97183, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13903, "raw_average_key_size": 49, "raw_value_size": 89576, "raw_average_value_size": 318, "num_data_blocks": 12, "num_entries": 281, "num_filter_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715149811, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cb5a79ed-9a82-4f7d-8af2-9d8b066eefff", "db_session_id": "4LNHKC0NPDN43QZD1LG2", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715149811533068, "job": 1, "event": "recovery_finished"} 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55815b620000 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: DB pointer 0x55815b60c000 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** DB Stats ** 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T06:30:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: L0 2/0 98.77 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: Sum 2/0 98.77 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:30:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 102.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T06:30:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative compaction: 0.00 GB write, 14.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval compaction: 0.00 GB write, 14.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache BinnedLRUCache@0x55815b5031f0#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: starting mon.a rank 0 at public addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] at bind addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mon.a@-1(???) e1 preinit fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mon.a@-1(???).mds e1 new map 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mon.a@-1(???).mds e1 print_map 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: e1 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T06:30:11.881 INFO:journalctl@ceph.mon.a.smithi070.stdout: legacy client fscid: -1 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout: No filesystems configured 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 bash[29572]: 65b3c1175be85fae198ea76d8bbc1d523b5d14dedf20f3de17fa1bf887936b67 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 systemd[1]: Started Ceph mon.a for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: monmap epoch 1 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: last_changed 2024-05-08T06:30:00.612071+0000 2024-05-08T06:30:11.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: created 2024-05-08T06:30:00.612071+0000 2024-05-08T06:30:11.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: min_mon_release 19 (squid) 2024-05-08T06:30:11.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: election_strategy: 1 2024-05-08T06:30:11.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-05-08T06:30:11.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: fsmap 2024-05-08T06:30:11.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T06:30:11.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:11 smithi070 ceph-mon[29591]: mgrmap e1: no daemons active 2024-05-08T06:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.158+0000 7efdd2800700 1 Processor -- start 2024-05-08T06:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.158+0000 7efdd2800700 1 -- start start 2024-05-08T06:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.158+0000 7efdd2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc107950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.158+0000 7efdd2800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc07ce60 con 0x7efdcc107530 2024-05-08T06:30:12.895 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.159+0000 7efdcb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc107950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.159+0000 7efdcb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc107950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42270/0 (socket says 172.21.15.70:42270) 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.159+0000 7efdcb400700 1 -- 172.21.15.70:0/2864470685 learned_addr learned my addr 172.21.15.70:0/2864470685 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.160+0000 7efdcb400700 1 -- 172.21.15.70:0/2864470685 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc107e90 con 0x7efdcc107530 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.160+0000 7efdcb400700 1 --2- 172.21.15.70:0/2864470685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc107950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0098a0 tx=0x7efdbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34257f91c31f4efe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.160+0000 7efdca000700 1 -- 172.21.15.70:0/2864470685 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdbc004160 con 0x7efdcc107530 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.160+0000 7efdca000700 1 -- 172.21.15.70:0/2864470685 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7efdbc004300 con 0x7efdcc107530 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.161+0000 7efdca000700 1 -- 172.21.15.70:0/2864470685 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdbc0119e0 con 0x7efdcc107530 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.161+0000 7efdd2800700 1 -- 172.21.15.70:0/2864470685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 msgr2=0x7efdcc107950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.161+0000 7efdd2800700 1 --2- 172.21.15.70:0/2864470685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc107950 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efdbc0098a0 tx=0x7efdbc009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.161+0000 7efdd2800700 1 -- 172.21.15.70:0/2864470685 shutdown_connections 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.161+0000 7efdd2800700 1 --2- 172.21.15.70:0/2864470685 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc107950 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.161+0000 7efdd2800700 1 -- 172.21.15.70:0/2864470685 >> 172.21.15.70:0/2864470685 conn(0x7efdcc103130 msgr2=0x7efdcc105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.161+0000 7efdd2800700 1 -- 172.21.15.70:0/2864470685 shutdown_connections 2024-05-08T06:30:12.896 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.161+0000 7efdd2800700 1 -- 172.21.15.70:0/2864470685 wait complete. 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.162+0000 7efdd2800700 1 Processor -- start 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.163+0000 7efdd2800700 1 -- start start 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.163+0000 7efdd2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc19ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.163+0000 7efdd2800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efdcc108e60 con 0x7efdcc107530 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.163+0000 7efdcb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc19ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.163+0000 7efdcb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc19ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42282/0 (socket says 172.21.15.70:42282) 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.163+0000 7efdcb400700 1 -- 172.21.15.70:0/4233373597 learned_addr learned my addr 172.21.15.70:0/4233373597 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.164+0000 7efdcb400700 1 -- 172.21.15.70:0/4233373597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdcc19f1d0 con 0x7efdcc107530 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.164+0000 7efdcb400700 1 --2- 172.21.15.70:0/4233373597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc19ec90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009130 tx=0x7efdbc011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.164+0000 7efdc3e00700 1 -- 172.21.15.70:0/4233373597 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdbc003b20 con 0x7efdcc107530 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.164+0000 7efdc3e00700 1 -- 172.21.15.70:0/4233373597 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7efdbc01a8a0 con 0x7efdcc107530 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.164+0000 7efdd2800700 1 -- 172.21.15.70:0/4233373597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdcc19f460 con 0x7efdcc107530 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.164+0000 7efdc3e00700 1 -- 172.21.15.70:0/4233373597 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efdbc024810 con 0x7efdcc107530 2024-05-08T06:30:12.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.164+0000 7efdd2800700 1 -- 172.21.15.70:0/4233373597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdcc1a2150 con 0x7efdcc107530 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.165+0000 7efdc3e00700 1 -- 172.21.15.70:0/4233373597 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efdbc022020 con 0x7efdcc107530 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.165+0000 7efdc3e00700 1 -- 172.21.15.70:0/4233373597 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efdbc0193c0 con 0x7efdcc107530 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.166+0000 7efdd2800700 1 -- 172.21.15.70:0/4233373597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdcc064b00 con 0x7efdcc107530 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.169+0000 7efdc3e00700 1 -- 172.21.15.70:0/4233373597 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7efdbc0094f0 con 0x7efdcc107530 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.244+0000 7efdd2800700 1 -- 172.21.15.70:0/4233373597 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7efdcc02e7d0 con 0x7efdcc107530 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.247+0000 7efdc3e00700 1 -- 172.21.15.70:0/4233373597 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7efdbc02dde0 con 0x7efdcc107530 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.248+0000 7efdd2800700 1 -- 172.21.15.70:0/4233373597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 msgr2=0x7efdcc19ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.248+0000 7efdd2800700 1 --2- 172.21.15.70:0/4233373597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc19ec90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efdbc009130 tx=0x7efdbc011a60 comp rx=0 tx=0).stop 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.249+0000 7efdd2800700 1 -- 172.21.15.70:0/4233373597 shutdown_connections 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.249+0000 7efdd2800700 1 --2- 172.21.15.70:0/4233373597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdcc107530 0x7efdcc19ec90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.249+0000 7efdd2800700 1 -- 172.21.15.70:0/4233373597 >> 172.21.15.70:0/4233373597 conn(0x7efdcc103130 msgr2=0x7efdcc195950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.249+0000 7efdd2800700 1 -- 172.21.15.70:0/4233373597 shutdown_connections 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:12.249+0000 7efdd2800700 1 -- 172.21.15.70:0/4233373597 wait complete. 2024-05-08T06:30:12.898 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-08T06:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-08T06:30:12.915 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mgr... 2024-05-08T06:30:12.917 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-08T06:30:12.918 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-08T06:30:13.365 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.x 2024-05-08T06:30:13.365 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-08T06:30:13.625 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968.target.wants/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@.service. 2024-05-08T06:30:13.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4233373597' entity='client.admin' 2024-05-08T06:30:14.070 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:13 smithi070 systemd[1]: Starting Ceph mgr.x for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:30:14.348 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:14 smithi070 podman[29805]: 2024-05-08 06:30:13.953231593 +0000 UTC m=+0.034134273 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:30:14.349 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:14 smithi070 podman[29805]: 2024-05-08 06:30:14.05245342 +0000 UTC m=+0.133356120 container create b3eb8e91a91d103ed9297a2b296b7ac80fc951f8826a25cf1cc303ee5254fffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-08T06:30:14.349 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:14 smithi070 podman[29805]: 2024-05-08 06:30:14.347763214 +0000 UTC m=+0.428665954 container init b3eb8e91a91d103ed9297a2b296b7ac80fc951f8826a25cf1cc303ee5254fffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True) 2024-05-08T06:30:14.484 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T06:30:14.485 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-05-08T06:30:14.501 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T06:30:14.501 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-05-08T06:30:14.502 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-05-08T06:30:14.502 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T06:30:14.531 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T06:30:14.531 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-05-08T06:30:14.551 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T06:30:14.551 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-05-08T06:30:14.551 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-05-08T06:30:14.551 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-08T06:30:14.552 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr to start... 2024-05-08T06:30:14.552 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr... 2024-05-08T06:30:14.617 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:14 smithi070 podman[29805]: 2024-05-08 06:30:14.3578675 +0000 UTC m=+0.438770190 container start b3eb8e91a91d103ed9297a2b296b7ac80fc951f8826a25cf1cc303ee5254fffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True) 2024-05-08T06:30:14.617 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:14 smithi070 bash[29805]: b3eb8e91a91d103ed9297a2b296b7ac80fc951f8826a25cf1cc303ee5254fffd 2024-05-08T06:30:14.617 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:14 smithi070 systemd[1]: Started Ceph mgr.x for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:30:14.879 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:14 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:14.616+0000 7f40e2d5c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T06:30:15.284 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:14 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:14.881+0000 7f40e2d5c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:30:15.284 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:15 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:15.025+0000 7f40e2d5c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T06:30:15.575 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:15 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/642890340' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T06:30:15.575 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:15 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:15.462+0000 7f40e2d5c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T06:30:15.575 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:15 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:15.575+0000 7f40e2d5c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T06:30:16.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:16.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-05-08T06:30:16.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:30:16.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T06:30:16.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T06:30:16.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T06:30:16.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T06:30:16.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:16.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T06:30:16.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:16.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T06:30:16.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T06:30:16.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T06:30:16.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T06:30:16.118 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T06:30:16.118 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T06:30:16.118 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:16.118 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T06:30:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T06:30:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T06:30:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T06:30:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T06:30:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T06:30:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T06:30:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T06:30:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T06:30:16.119 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:16.123 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T06:30:16.123 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:16.123 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T06:30:16.123 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T06:30:16.123 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:16.123 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T06:30:16.123 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:16.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T06:30:04.773342+0000", 2024-05-08T06:30:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T06:30:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T06:30:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-05-08T06:30:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.283+0000 7f1ee9e00700 1 Processor -- start 2024-05-08T06:30:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.283+0000 7f1ee9e00700 1 -- start start 2024-05-08T06:30:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.283+0000 7f1ee9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee4107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.284+0000 7f1ee9e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee407cea0 con 0x7f1ee41074f0 2024-05-08T06:30:16.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.284+0000 7f1ee2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee4107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.284+0000 7f1ee2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee4107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42304/0 (socket says 172.21.15.70:42304) 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.284+0000 7f1ee2a00700 1 -- 172.21.15.70:0/2875040422 learned_addr learned my addr 172.21.15.70:0/2875040422 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.285+0000 7f1ee2a00700 1 -- 172.21.15.70:0/2875040422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee4107e50 con 0x7f1ee41074f0 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.285+0000 7f1ee2a00700 1 --2- 172.21.15.70:0/2875040422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee4107910 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40098a0 tx=0x7f1ed4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd50ee7fa37446fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.285+0000 7f1ee1600700 1 -- 172.21.15.70:0/2875040422 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed4004160 con 0x7f1ee41074f0 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.285+0000 7f1ee1600700 1 -- 172.21.15.70:0/2875040422 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1ed4004300 con 0x7f1ee41074f0 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.285+0000 7f1ee1600700 1 -- 172.21.15.70:0/2875040422 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed40119e0 con 0x7f1ee41074f0 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.286+0000 7f1ee9e00700 1 -- 172.21.15.70:0/2875040422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 msgr2=0x7f1ee4107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.286+0000 7f1ee9e00700 1 --2- 172.21.15.70:0/2875040422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee4107910 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40098a0 tx=0x7f1ed4009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.286+0000 7f1ee9e00700 1 -- 172.21.15.70:0/2875040422 shutdown_connections 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.286+0000 7f1ee9e00700 1 --2- 172.21.15.70:0/2875040422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee4107910 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.286+0000 7f1ee9e00700 1 -- 172.21.15.70:0/2875040422 >> 172.21.15.70:0/2875040422 conn(0x7f1ee4103130 msgr2=0x7f1ee4105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:16.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.286+0000 7f1ee9e00700 1 -- 172.21.15.70:0/2875040422 shutdown_connections 2024-05-08T06:30:16.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.286+0000 7f1ee9e00700 1 -- 172.21.15.70:0/2875040422 wait complete. 2024-05-08T06:30:16.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.287+0000 7f1ee9e00700 1 Processor -- start 2024-05-08T06:30:16.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.287+0000 7f1ee9e00700 1 -- start start 2024-05-08T06:30:16.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.288+0000 7f1ee9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee419ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:16.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.288+0000 7f1ee9e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4108e20 con 0x7f1ee41074f0 2024-05-08T06:30:16.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.288+0000 7f1ee2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee419ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:16.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.288+0000 7f1ee2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee419ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42316/0 (socket says 172.21.15.70:42316) 2024-05-08T06:30:16.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.288+0000 7f1ee2a00700 1 -- 172.21.15.70:0/642890340 learned_addr learned my addr 172.21.15.70:0/642890340 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:16.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.288+0000 7f1ee2a00700 1 -- 172.21.15.70:0/642890340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee419f210 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.288+0000 7f1ee2a00700 1 --2- 172.21.15.70:0/642890340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee419ecd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40119b0 tx=0x7f1ed4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.289+0000 7f1ee8a00700 1 -- 172.21.15.70:0/642890340 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed40039f0 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.289+0000 7f1ee8a00700 1 -- 172.21.15.70:0/642890340 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f1ed4003b90 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.289+0000 7f1ee9e00700 1 -- 172.21.15.70:0/642890340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee419f4a0 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.289+0000 7f1ee8a00700 1 -- 172.21.15.70:0/642890340 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ed401a620 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.289+0000 7f1ee9e00700 1 -- 172.21.15.70:0/642890340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee41a2180 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.289+0000 7f1ee8a00700 1 -- 172.21.15.70:0/642890340 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ed401ac80 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.289+0000 7f1ee8a00700 1 -- 172.21.15.70:0/642890340 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1ed4019700 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.290+0000 7f1ee9e00700 1 -- 172.21.15.70:0/642890340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee4064b00 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.293+0000 7f1ee8a00700 1 -- 172.21.15.70:0/642890340 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1ed4024a50 con 0x7f1ee41074f0 2024-05-08T06:30:16.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.371+0000 7f1ee9e00700 1 -- 172.21.15.70:0/642890340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1ee402e760 con 0x7f1ee41074f0 2024-05-08T06:30:16.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.372+0000 7f1ee8a00700 1 -- 172.21.15.70:0/642890340 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f1ed4024430 con 0x7f1ee41074f0 2024-05-08T06:30:16.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.373+0000 7f1ee9e00700 1 -- 172.21.15.70:0/642890340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 msgr2=0x7f1ee419ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:16.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.373+0000 7f1ee9e00700 1 --2- 172.21.15.70:0/642890340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee419ecd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1ed40119b0 tx=0x7f1ed4011a90 comp rx=0 tx=0).stop 2024-05-08T06:30:16.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.373+0000 7f1ee9e00700 1 -- 172.21.15.70:0/642890340 shutdown_connections 2024-05-08T06:30:16.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.373+0000 7f1ee9e00700 1 --2- 172.21.15.70:0/642890340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ee41074f0 0x7f1ee419ecd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:16.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.373+0000 7f1ee9e00700 1 -- 172.21.15.70:0/642890340 >> 172.21.15.70:0/642890340 conn(0x7f1ee4103130 msgr2=0x7f1ee4195910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:16.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.373+0000 7f1ee9e00700 1 -- 172.21.15.70:0/642890340 shutdown_connections 2024-05-08T06:30:16.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:15.373+0000 7f1ee9e00700 1 -- 172.21.15.70:0/642890340 wait complete. 2024-05-08T06:30:16.129 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (1/15)... 2024-05-08T06:30:17.597 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:17 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:17.157+0000 7f40e2d5c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T06:30:17.597 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:17 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:17.384+0000 7f40e2d5c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T06:30:17.597 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:17 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:17.597+0000 7f40e2d5c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T06:30:18.280 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:17 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:17.977+0000 7f40e2d5c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T06:30:18.280 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:18 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:18.099+0000 7f40e2d5c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T06:30:18.587 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:18 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:18.355+0000 7f40e2d5c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T06:30:18.844 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:18 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:18.621+0000 7f40e2d5c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:30:19.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:18 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3971173776' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T06:30:19.468 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:19 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:19.431+0000 7f40e2d5c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T06:30:19.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:19.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-05-08T06:30:19.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:30:19.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T06:30:19.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:19.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T06:30:19.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:19.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T06:30:04.773342+0000", 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T06:30:19.492 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:19.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T06:30:19.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-05-08T06:30:19.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.738+0000 7f5d3fe00700 1 Processor -- start 2024-05-08T06:30:19.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.739+0000 7f5d3fe00700 1 -- start start 2024-05-08T06:30:19.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.739+0000 7f5d3fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4007d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:19.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.739+0000 7f5d3fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4007d8e0 con 0x7f5d4007eeb0 2024-05-08T06:30:19.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.739+0000 7f5d3ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4007d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:19.493 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.739+0000 7f5d3ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4007d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60030/0 (socket says 172.21.15.70:60030) 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.739+0000 7f5d3ea00700 1 -- 172.21.15.70:0/3384859737 learned_addr learned my addr 172.21.15.70:0/3384859737 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.740+0000 7f5d3ea00700 1 -- 172.21.15.70:0/3384859737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4007da60 con 0x7f5d4007eeb0 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.740+0000 7f5d3ea00700 1 --2- 172.21.15.70:0/3384859737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4007d310 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5d300098a0 tx=0x7f5d30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba24312c53df0be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.740+0000 7f5d3d600700 1 -- 172.21.15.70:0/3384859737 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d30004160 con 0x7f5d4007eeb0 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.740+0000 7f5d3d600700 1 -- 172.21.15.70:0/3384859737 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f5d30004300 con 0x7f5d4007eeb0 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.740+0000 7f5d3d600700 1 -- 172.21.15.70:0/3384859737 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d300119e0 con 0x7f5d4007eeb0 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.741+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3384859737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 msgr2=0x7f5d4007d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.741+0000 7f5d3fe00700 1 --2- 172.21.15.70:0/3384859737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4007d310 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5d300098a0 tx=0x7f5d30009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.741+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3384859737 shutdown_connections 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.741+0000 7f5d3fe00700 1 --2- 172.21.15.70:0/3384859737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4007d310 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.741+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3384859737 >> 172.21.15.70:0/3384859737 conn(0x7f5d40104040 msgr2=0x7f5d40106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:19.494 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.742+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3384859737 shutdown_connections 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.742+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3384859737 wait complete. 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.743+0000 7f5d3fe00700 1 Processor -- start 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.743+0000 7f5d3fe00700 1 -- start start 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.743+0000 7f5d3fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4019eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.743+0000 7f5d3fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4010efd0 con 0x7f5d4007eeb0 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.744+0000 7f5d3ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4019eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.744+0000 7f5d3ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4019eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60040/0 (socket says 172.21.15.70:60040) 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.744+0000 7f5d3ea00700 1 -- 172.21.15.70:0/3971173776 learned_addr learned my addr 172.21.15.70:0/3971173776 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.744+0000 7f5d3ea00700 1 -- 172.21.15.70:0/3971173776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4019f030 con 0x7f5d4007eeb0 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.744+0000 7f5d3ea00700 1 --2- 172.21.15.70:0/3971173776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4019eaf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d300119b0 tx=0x7f5d30011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.745+0000 7f5d37400700 1 -- 172.21.15.70:0/3971173776 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d30003af0 con 0x7f5d4007eeb0 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.745+0000 7f5d37400700 1 -- 172.21.15.70:0/3971173776 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f5d3001a8a0 con 0x7f5d4007eeb0 2024-05-08T06:30:19.495 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.745+0000 7f5d37400700 1 -- 172.21.15.70:0/3971173776 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d30024830 con 0x7f5d4007eeb0 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.745+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3971173776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4019f2c0 con 0x7f5d4007eeb0 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.745+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3971173776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d401a1fb0 con 0x7f5d4007eeb0 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.745+0000 7f5d37400700 1 -- 172.21.15.70:0/3971173776 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d30022020 con 0x7f5d4007eeb0 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.745+0000 7f5d37400700 1 -- 172.21.15.70:0/3971173776 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5d3002d990 con 0x7f5d4007eeb0 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.746+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3971173776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d40064b00 con 0x7f5d4007eeb0 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.748+0000 7f5d37400700 1 -- 172.21.15.70:0/3971173776 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5d3001aa70 con 0x7f5d4007eeb0 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.826+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3971173776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5d401a24f0 con 0x7f5d4007eeb0 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.827+0000 7f5d37400700 1 -- 172.21.15.70:0/3971173776 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f5d30032030 con 0x7f5d4007eeb0 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.828+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3971173776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 msgr2=0x7f5d4019eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.828+0000 7f5d3fe00700 1 --2- 172.21.15.70:0/3971173776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4019eaf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d300119b0 tx=0x7f5d30011a90 comp rx=0 tx=0).stop 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.828+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3971173776 shutdown_connections 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.828+0000 7f5d3fe00700 1 --2- 172.21.15.70:0/3971173776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d4007eeb0 0x7f5d4019eaf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.828+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3971173776 >> 172.21.15.70:0/3971173776 conn(0x7f5d40104040 msgr2=0x7f5d40104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.828+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3971173776 shutdown_connections 2024-05-08T06:30:19.496 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:18.828+0000 7f5d3fe00700 1 -- 172.21.15.70:0/3971173776 wait complete. 2024-05-08T06:30:19.497 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (2/15)... 2024-05-08T06:30:20.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:19 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:19.718+0000 7f40e2d5c200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T06:30:20.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:20 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:20.268+0000 7f40e2d5c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T06:30:20.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:20 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:20.395+0000 7f40e2d5c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T06:30:21.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:20 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:20.854+0000 7f40e2d5c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T06:30:21.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:21 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:21.298+0000 7f40e2d5c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T06:30:21.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:21 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:21.423+0000 7f40e2d5c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T06:30:21.935 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:21 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:21.753+0000 7f40e2d5c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T06:30:22.200 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:21 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:21.935+0000 7f40e2d5c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T06:30:22.200 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:22 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:22.067+0000 7f40e2d5c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T06:30:22.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4014768135' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T06:30:22.878 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:22 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:22.484+0000 7f40e2d5c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T06:30:22.879 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:22 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:22.613+0000 7f40e2d5c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-05-08T06:30:22.893 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T06:30:22.894 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T06:30:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:22.904 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T06:30:04.773342+0000", 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.110+0000 7f0662a00700 1 Processor -- start 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.110+0000 7f0662a00700 1 -- start start 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.110+0000 7f0662a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c1090d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.110+0000 7f0662a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f065c1096a0 con 0x7f065c108cb0 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.111+0000 7f065be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c1090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:22.905 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.111+0000 7f065be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c1090d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60048/0 (socket says 172.21.15.70:60048) 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.111+0000 7f065be00700 1 -- 172.21.15.70:0/594433070 learned_addr learned my addr 172.21.15.70:0/594433070 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.111+0000 7f065be00700 1 -- 172.21.15.70:0/594433070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c109e60 con 0x7f065c108cb0 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.112+0000 7f065be00700 1 --2- 172.21.15.70:0/594433070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c1090d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f064c0098a0 tx=0x7f064c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b0953769683d33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.112+0000 7f065aa00700 1 -- 172.21.15.70:0/594433070 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c004160 con 0x7f065c108cb0 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.112+0000 7f065aa00700 1 -- 172.21.15.70:0/594433070 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f064c004300 con 0x7f065c108cb0 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.112+0000 7f065aa00700 1 -- 172.21.15.70:0/594433070 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c0119e0 con 0x7f065c108cb0 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.113+0000 7f0662a00700 1 -- 172.21.15.70:0/594433070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 msgr2=0x7f065c1090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.113+0000 7f0662a00700 1 --2- 172.21.15.70:0/594433070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c1090d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f064c0098a0 tx=0x7f064c009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.113+0000 7f0662a00700 1 -- 172.21.15.70:0/594433070 shutdown_connections 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.113+0000 7f0662a00700 1 --2- 172.21.15.70:0/594433070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c1090d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.113+0000 7f0662a00700 1 -- 172.21.15.70:0/594433070 >> 172.21.15.70:0/594433070 conn(0x7f065c104270 msgr2=0x7f065c106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.113+0000 7f0662a00700 1 -- 172.21.15.70:0/594433070 shutdown_connections 2024-05-08T06:30:22.906 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.113+0000 7f0662a00700 1 -- 172.21.15.70:0/594433070 wait complete. 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.114+0000 7f0662a00700 1 Processor -- start 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.114+0000 7f0662a00700 1 -- start start 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.114+0000 7f0662a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c19cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.114+0000 7f0662a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f065c10d090 con 0x7f065c108cb0 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.115+0000 7f065be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c19cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.115+0000 7f065be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c19cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60054/0 (socket says 172.21.15.70:60054) 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.115+0000 7f065be00700 1 -- 172.21.15.70:0/4014768135 learned_addr learned my addr 172.21.15.70:0/4014768135 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.115+0000 7f065be00700 1 -- 172.21.15.70:0/4014768135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065c19d000 con 0x7f065c108cb0 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.115+0000 7f065be00700 1 --2- 172.21.15.70:0/4014768135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c19cac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f064c0119b0 tx=0x7f064c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.116+0000 7f0658c00700 1 -- 172.21.15.70:0/4014768135 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c003af0 con 0x7f065c108cb0 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.116+0000 7f0658c00700 1 -- 172.21.15.70:0/4014768135 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f064c01a8a0 con 0x7f065c108cb0 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.116+0000 7f0662a00700 1 -- 172.21.15.70:0/4014768135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065c19d290 con 0x7f065c108cb0 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.116+0000 7f0658c00700 1 -- 172.21.15.70:0/4014768135 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f064c024830 con 0x7f065c108cb0 2024-05-08T06:30:22.907 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.116+0000 7f0662a00700 1 -- 172.21.15.70:0/4014768135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f065c19ff80 con 0x7f065c108cb0 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.116+0000 7f0658c00700 1 -- 172.21.15.70:0/4014768135 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f064c022020 con 0x7f065c108cb0 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.116+0000 7f0658c00700 1 -- 172.21.15.70:0/4014768135 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f064c02ddf0 con 0x7f065c108cb0 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.117+0000 7f0662a00700 1 -- 172.21.15.70:0/4014768135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f065c064b00 con 0x7f065c108cb0 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.120+0000 7f0658c00700 1 -- 172.21.15.70:0/4014768135 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f064c042ec0 con 0x7f065c108cb0 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.200+0000 7f0662a00700 1 -- 172.21.15.70:0/4014768135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f065c07d0d0 con 0x7f065c108cb0 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.201+0000 7f0658c00700 1 -- 172.21.15.70:0/4014768135 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f064c031020 con 0x7f065c108cb0 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.202+0000 7f0662a00700 1 -- 172.21.15.70:0/4014768135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 msgr2=0x7f065c19cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.202+0000 7f0662a00700 1 --2- 172.21.15.70:0/4014768135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c19cac0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f064c0119b0 tx=0x7f064c011a90 comp rx=0 tx=0).stop 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.203+0000 7f0662a00700 1 -- 172.21.15.70:0/4014768135 shutdown_connections 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.203+0000 7f0662a00700 1 --2- 172.21.15.70:0/4014768135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f065c108cb0 0x7f065c19cac0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.203+0000 7f0662a00700 1 -- 172.21.15.70:0/4014768135 >> 172.21.15.70:0/4014768135 conn(0x7f065c104270 msgr2=0x7f065c104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.203+0000 7f0662a00700 1 -- 172.21.15.70:0/4014768135 shutdown_connections 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:22.203+0000 7f0662a00700 1 -- 172.21.15.70:0/4014768135 wait complete. 2024-05-08T06:30:22.908 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (3/15)... 2024-05-08T06:30:23.673 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:23.389+0000 7f40e2d5c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T06:30:24.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:23.672+0000 7f40e2d5c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T06:30:24.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: Activating manager daemon x 2024-05-08T06:30:24.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: mgrmap e2: x(active, starting, since 0.0115276s) 2024-05-08T06:30:24.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T06:30:24.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T06:30:24.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T06:30:24.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:30:24.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T06:30:24.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: Manager daemon x is now available 2024-05-08T06:30:24.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T06:30:24.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' 2024-05-08T06:30:24.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T06:30:24.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' 2024-05-08T06:30:24.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:23 smithi070 ceph-mon[29591]: from='mgr.14100 172.21.15.70:0/325341234' entity='mgr.x' 2024-05-08T06:30:26.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:25 smithi070 ceph-mon[29591]: mgrmap e3: x(active, since 1.02359s) 2024-05-08T06:30:26.659 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:26.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-05-08T06:30:26.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:30:26.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T06:30:26.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T06:30:26.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T06:30:26.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T06:30:26.662 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:26.663 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T06:30:26.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T06:30:26.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:26.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T06:30:26.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:26.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T06:30:26.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T06:30:26.664 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T06:30:26.673 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T06:30:26.673 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T06:30:26.673 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T06:30:26.673 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:26.673 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T06:30:26.673 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T06:30:26.674 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T06:30:04.773342+0000", 2024-05-08T06:30:26.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.487+0000 7fc45aa00700 1 Processor -- start 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.487+0000 7fc45aa00700 1 -- start start 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.487+0000 7fc45aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.487+0000 7fc45aa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc4540834d0 con 0x7fc45410fcc0 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.488+0000 7fc453e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.488+0000 7fc453e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60122/0 (socket says 172.21.15.70:60122) 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.488+0000 7fc453e00700 1 -- 172.21.15.70:0/3488733041 learned_addr learned my addr 172.21.15.70:0/3488733041 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.488+0000 7fc453e00700 1 -- 172.21.15.70:0/3488733041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4541125f0 con 0x7fc45410fcc0 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.489+0000 7fc453e00700 1 --2- 172.21.15.70:0/3488733041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541120b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4440098a0 tx=0x7fc444009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7799a3a9312ace6c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.489+0000 7fc452a00700 1 -- 172.21.15.70:0/3488733041 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc444004160 con 0x7fc45410fcc0 2024-05-08T06:30:26.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.489+0000 7fc452a00700 1 -- 172.21.15.70:0/3488733041 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fc444004300 con 0x7fc45410fcc0 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.489+0000 7fc452a00700 1 -- 172.21.15.70:0/3488733041 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4440119e0 con 0x7fc45410fcc0 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.489+0000 7fc45aa00700 1 -- 172.21.15.70:0/3488733041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 msgr2=0x7fc4541120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.489+0000 7fc45aa00700 1 --2- 172.21.15.70:0/3488733041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541120b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc4440098a0 tx=0x7fc444009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.490+0000 7fc45aa00700 1 -- 172.21.15.70:0/3488733041 shutdown_connections 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.490+0000 7fc45aa00700 1 --2- 172.21.15.70:0/3488733041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541120b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.490+0000 7fc45aa00700 1 -- 172.21.15.70:0/3488733041 >> 172.21.15.70:0/3488733041 conn(0x7fc45407e280 msgr2=0x7fc4540806c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.490+0000 7fc45aa00700 1 -- 172.21.15.70:0/3488733041 shutdown_connections 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.490+0000 7fc45aa00700 1 -- 172.21.15.70:0/3488733041 wait complete. 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.491+0000 7fc45aa00700 1 Processor -- start 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.491+0000 7fc45aa00700 1 -- start start 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.491+0000 7fc45aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.491+0000 7fc45aa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541135b0 con 0x7fc45410fcc0 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.491+0000 7fc453e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.491+0000 7fc453e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541a30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60128/0 (socket says 172.21.15.70:60128) 2024-05-08T06:30:26.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.491+0000 7fc453e00700 1 -- 172.21.15.70:0/4216865761 learned_addr learned my addr 172.21.15.70:0/4216865761 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.492+0000 7fc453e00700 1 -- 172.21.15.70:0/4216865761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4541a35f0 con 0x7fc45410fcc0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.492+0000 7fc453e00700 1 --2- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541a30b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc444009130 tx=0x7fc444011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.492+0000 7fc450c00700 1 -- 172.21.15.70:0/4216865761 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc444003b20 con 0x7fc45410fcc0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.492+0000 7fc450c00700 1 -- 172.21.15.70:0/4216865761 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fc44401a8a0 con 0x7fc45410fcc0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.492+0000 7fc450c00700 1 -- 172.21.15.70:0/4216865761 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc444024810 con 0x7fc45410fcc0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.493+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4541a3880 con 0x7fc45410fcc0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.493+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4541a6570 con 0x7fc45410fcc0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.494+0000 7fc450c00700 1 -- 172.21.15.70:0/4216865761 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 3) ==== 50105+0+0 (secure 0 0 0) 0x7fc444022020 con 0x7fc45410fcc0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.494+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc454064b00 con 0x7fc45410fcc0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.494+0000 7fc450c00700 1 --2- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fc43803e350 0x7fc438040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.494+0000 7fc450c00700 1 -- 172.21.15.70:0/4216865761 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc444053310 con 0x7fc45410fcc0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.495+0000 7fc453400700 1 --2- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fc43803e350 0x7fc438040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:26.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.495+0000 7fc453400700 1 --2- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fc43803e350 0x7fc438040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc440006fd0 tx=0x7fc440006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.501+0000 7fc450c00700 1 -- 172.21.15.70:0/4216865761 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc44401aa50 con 0x7fc45410fcc0 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.700+0000 7fc450c00700 1 -- 172.21.15.70:0/4216865761 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fc44401a430 con 0x7fc45410fcc0 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.818+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fc4541a6740 con 0x7fc45410fcc0 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.819+0000 7fc450c00700 1 -- 172.21.15.70:0/4216865761 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7fc4541a6740 con 0x7fc45410fcc0 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fc43803e350 msgr2=0x7fc438040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 --2- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fc43803e350 0x7fc438040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc440006fd0 tx=0x7fc440006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 msgr2=0x7fc4541a30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 --2- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541a30b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc444009130 tx=0x7fc444011a60 comp rx=0 tx=0).stop 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 shutdown_connections 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 --2- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fc43803e350 0x7fc438040810 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 --2- 172.21.15.70:0/4216865761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc45410fcc0 0x7fc4541a30b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 >> 172.21.15.70:0/4216865761 conn(0x7fc45407e280 msgr2=0x7fc45407ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 shutdown_connections 2024-05-08T06:30:26.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:25.822+0000 7fc45aa00700 1 -- 172.21.15.70:0/4216865761 wait complete. 2024-05-08T06:30:26.680 INFO:teuthology.orchestra.run.smithi070.stdout:mgr is available 2024-05-08T06:30:26.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:26 smithi070 ceph-mon[29591]: mgrmap e4: x(active, since 2s) 2024-05-08T06:30:26.958 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:26 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4216865761' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T06:30:28.094 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:27 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4221009848' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T06:30:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T06:30:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-08T06:30:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T06:30:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T06:30:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T06:30:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T06:30:28.112 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.240+0000 7f8a6be00700 1 Processor -- start 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.240+0000 7f8a6be00700 1 -- start start 2024-05-08T06:30:28.113 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.240+0000 7f8a6be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c10b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.240+0000 7f8a6be00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c07cde0 con 0x7f8a6c1095f0 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.241+0000 7f8a6aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c10b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.241+0000 7f8a6aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c10b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54286/0 (socket says 172.21.15.70:54286) 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.241+0000 7f8a6aa00700 1 -- 172.21.15.70:0/2020163847 learned_addr learned my addr 172.21.15.70:0/2020163847 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.241+0000 7f8a6aa00700 1 -- 172.21.15.70:0/2020163847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c10bf20 con 0x7f8a6c1095f0 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.241+0000 7f8a6aa00700 1 --2- 172.21.15.70:0/2020163847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c10b9e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0098a0 tx=0x7f8a5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b634b4d1a3c7897 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.242+0000 7f8a6a000700 1 -- 172.21.15.70:0/2020163847 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a5c004160 con 0x7f8a6c1095f0 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.242+0000 7f8a6a000700 1 -- 172.21.15.70:0/2020163847 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8a5c004300 con 0x7f8a6c1095f0 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.242+0000 7f8a6a000700 1 -- 172.21.15.70:0/2020163847 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a5c0119e0 con 0x7f8a6c1095f0 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.242+0000 7f8a6be00700 1 -- 172.21.15.70:0/2020163847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 msgr2=0x7f8a6c10b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:28.114 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.242+0000 7f8a6be00700 1 --2- 172.21.15.70:0/2020163847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c10b9e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c0098a0 tx=0x7f8a5c009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.242+0000 7f8a6be00700 1 -- 172.21.15.70:0/2020163847 shutdown_connections 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.242+0000 7f8a6be00700 1 --2- 172.21.15.70:0/2020163847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c10b9e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.242+0000 7f8a6be00700 1 -- 172.21.15.70:0/2020163847 >> 172.21.15.70:0/2020163847 conn(0x7f8a6c102f60 msgr2=0x7f8a6c1053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.243+0000 7f8a6be00700 1 -- 172.21.15.70:0/2020163847 shutdown_connections 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.243+0000 7f8a6be00700 1 -- 172.21.15.70:0/2020163847 wait complete. 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.244+0000 7f8a6be00700 1 Processor -- start 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.244+0000 7f8a6be00700 1 -- start start 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.244+0000 7f8a6be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c19c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.244+0000 7f8a6be00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c10cdd0 con 0x7f8a6c1095f0 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.244+0000 7f8a6aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c19c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.244+0000 7f8a6aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c19c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54292/0 (socket says 172.21.15.70:54292) 2024-05-08T06:30:28.115 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.244+0000 7f8a6aa00700 1 -- 172.21.15.70:0/4221009848 learned_addr learned my addr 172.21.15.70:0/4221009848 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.245+0000 7f8a6aa00700 1 -- 172.21.15.70:0/4221009848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c19cde0 con 0x7f8a6c1095f0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.245+0000 7f8a6aa00700 1 --2- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c19c8a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009130 tx=0x7f8a5c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.245+0000 7f8a63e00700 1 -- 172.21.15.70:0/4221009848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a5c003b20 con 0x7f8a6c1095f0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.245+0000 7f8a63e00700 1 -- 172.21.15.70:0/4221009848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8a5c01a8a0 con 0x7f8a6c1095f0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.245+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6c19d070 con 0x7f8a6c1095f0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.245+0000 7f8a63e00700 1 -- 172.21.15.70:0/4221009848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a5c024810 con 0x7f8a6c1095f0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.245+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6c19fd60 con 0x7f8a6c1095f0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.246+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6c064b00 con 0x7f8a6c1095f0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.246+0000 7f8a63e00700 1 -- 172.21.15.70:0/4221009848 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f8a5c022020 con 0x7f8a6c1095f0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.247+0000 7f8a63e00700 1 --2- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f8a5003e420 0x7f8a500408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.247+0000 7f8a63e00700 1 -- 172.21.15.70:0/4221009848 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a5c053570 con 0x7f8a6c1095f0 2024-05-08T06:30:28.116 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.247+0000 7f8a62000700 1 --2- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f8a5003e420 0x7f8a500408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.248+0000 7f8a62000700 1 --2- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f8a5003e420 0x7f8a500408e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8a54006fd0 tx=0x7f8a54006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.253+0000 7f8a63e00700 1 -- 172.21.15.70:0/4221009848 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8a5c005a20 con 0x7f8a6c1095f0 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.464+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f8a6c19ff30 con 0x7f8a6c1095f0 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.465+0000 7f8a63e00700 1 -- 172.21.15.70:0/4221009848 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f8a6c19ff30 con 0x7f8a6c1095f0 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.468+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f8a5003e420 msgr2=0x7f8a500408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.468+0000 7f8a6be00700 1 --2- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f8a5003e420 0x7f8a500408e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8a54006fd0 tx=0x7f8a54006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.468+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 msgr2=0x7f8a6c19c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.468+0000 7f8a6be00700 1 --2- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c19c8a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c009130 tx=0x7f8a5c011a60 comp rx=0 tx=0).stop 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.468+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 shutdown_connections 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.468+0000 7f8a6be00700 1 --2- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f8a5003e420 0x7f8a500408e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.468+0000 7f8a6be00700 1 --2- 172.21.15.70:0/4221009848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8a6c1095f0 0x7f8a6c19c8a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.468+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 >> 172.21.15.70:0/4221009848 conn(0x7f8a6c102f60 msgr2=0x7f8a6c1039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:28.117 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.469+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 shutdown_connections 2024-05-08T06:30:28.118 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:27.469+0000 7f8a6be00700 1 -- 172.21.15.70:0/4221009848 wait complete. 2024-05-08T06:30:28.118 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling cephadm module... 2024-05-08T06:30:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:29 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1476160451' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-08T06:30:29.373 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: ignoring --setuser ceph since I am not root 2024-05-08T06:30:29.373 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: ignoring --setgroup ceph since I am not root 2024-05-08T06:30:29.374 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:29.373+0000 7f84def31200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T06:30:29.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:29.614+0000 7f84def31200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:30:29.838 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.714+0000 7fefb1600700 1 Processor -- start 2024-05-08T06:30:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.714+0000 7fefb1600700 1 -- start start 2024-05-08T06:30:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.715+0000 7fefb1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac1090d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.715+0000 7fefb1600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefac1096a0 con 0x7fefac108cb0 2024-05-08T06:30:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.715+0000 7fefaaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac1090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.715+0000 7fefaaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac1090d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54306/0 (socket says 172.21.15.70:54306) 2024-05-08T06:30:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.715+0000 7fefaaa00700 1 -- 172.21.15.70:0/2373916888 learned_addr learned my addr 172.21.15.70:0/2373916888 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.716+0000 7fefaaa00700 1 -- 172.21.15.70:0/2373916888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac109e60 con 0x7fefac108cb0 2024-05-08T06:30:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.716+0000 7fefaaa00700 1 --2- 172.21.15.70:0/2373916888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac1090d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0098a0 tx=0x7fef9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb9963ebb89725e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:29.839 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.716+0000 7fefa9600700 1 -- 172.21.15.70:0/2373916888 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9c004160 con 0x7fefac108cb0 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.716+0000 7fefa9600700 1 -- 172.21.15.70:0/2373916888 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fef9c004300 con 0x7fefac108cb0 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.716+0000 7fefa9600700 1 -- 172.21.15.70:0/2373916888 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9c0119e0 con 0x7fefac108cb0 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.717+0000 7fefb1600700 1 -- 172.21.15.70:0/2373916888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 msgr2=0x7fefac1090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.717+0000 7fefb1600700 1 --2- 172.21.15.70:0/2373916888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac1090d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0098a0 tx=0x7fef9c009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.717+0000 7fefb1600700 1 -- 172.21.15.70:0/2373916888 shutdown_connections 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.717+0000 7fefb1600700 1 --2- 172.21.15.70:0/2373916888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac1090d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.717+0000 7fefb1600700 1 -- 172.21.15.70:0/2373916888 >> 172.21.15.70:0/2373916888 conn(0x7fefac104270 msgr2=0x7fefac106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.717+0000 7fefb1600700 1 -- 172.21.15.70:0/2373916888 shutdown_connections 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.717+0000 7fefb1600700 1 -- 172.21.15.70:0/2373916888 wait complete. 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.718+0000 7fefb1600700 1 Processor -- start 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.718+0000 7fefb1600700 1 -- start start 2024-05-08T06:30:29.840 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.719+0000 7fefb1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.719+0000 7fefb1600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefac10d090 con 0x7fefac108cb0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.719+0000 7fefaaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.719+0000 7fefaaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac19ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54316/0 (socket says 172.21.15.70:54316) 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.719+0000 7fefaaa00700 1 -- 172.21.15.70:0/1476160451 learned_addr learned my addr 172.21.15.70:0/1476160451 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.719+0000 7fefaaa00700 1 -- 172.21.15.70:0/1476160451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefac19f200 con 0x7fefac108cb0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.720+0000 7fefaaa00700 1 --2- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac19ecc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0119b0 tx=0x7fef9c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.720+0000 7fefa3400700 1 -- 172.21.15.70:0/1476160451 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9c003af0 con 0x7fefac108cb0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.720+0000 7fefa3400700 1 -- 172.21.15.70:0/1476160451 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fef9c01a8a0 con 0x7fefac108cb0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.720+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefac19f490 con 0x7fefac108cb0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.720+0000 7fefa3400700 1 -- 172.21.15.70:0/1476160451 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef9c024830 con 0x7fefac108cb0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.720+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefac1a2180 con 0x7fefac108cb0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.721+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefac064b00 con 0x7fefac108cb0 2024-05-08T06:30:29.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.722+0000 7fefa3400700 1 -- 172.21.15.70:0/1476160451 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fef9c022020 con 0x7fefac108cb0 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.722+0000 7fefa3400700 1 --2- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fef9003e470 0x7fef90040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.722+0000 7fefa3400700 1 -- 172.21.15.70:0/1476160451 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fef9c0534c0 con 0x7fefac108cb0 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.723+0000 7fefaa000700 1 --2- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fef9003e470 0x7fef90040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.723+0000 7fefaa000700 1 --2- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fef9003e470 0x7fef90040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fef98006fd0 tx=0x7fef98006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:28.728+0000 7fefa3400700 1 -- 172.21.15.70:0/1476160451 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fef9c0212c0 con 0x7fefac108cb0 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.019+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fefac1a2350 con 0x7fefac108cb0 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.072+0000 7fefa3400700 1 -- 172.21.15.70:0/1476160451 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fefac1a2350 con 0x7fefac108cb0 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.076+0000 7fefa3400700 1 -- 172.21.15.70:0/1476160451 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fef9c01aa50 con 0x7fefac108cb0 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.077+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fef9003e470 msgr2=0x7fef90040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.077+0000 7fefb1600700 1 --2- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fef9003e470 0x7fef90040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fef98006fd0 tx=0x7fef98006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:29.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.077+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 msgr2=0x7fefac19ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:29.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.077+0000 7fefb1600700 1 --2- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac19ecc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0119b0 tx=0x7fef9c011a90 comp rx=0 tx=0).stop 2024-05-08T06:30:29.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.077+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 shutdown_connections 2024-05-08T06:30:29.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.077+0000 7fefb1600700 1 --2- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7fef9003e470 0x7fef90040930 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:29.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.077+0000 7fefb1600700 1 --2- 172.21.15.70:0/1476160451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefac108cb0 0x7fefac19ecc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:29.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.079+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 >> 172.21.15.70:0/1476160451 conn(0x7fefac104270 msgr2=0x7fefac104cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:29.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.079+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 shutdown_connections 2024-05-08T06:30:29.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:29.079+0000 7fefb1600700 1 -- 172.21.15.70:0/1476160451 wait complete. 2024-05-08T06:30:30.009 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:29.745+0000 7f84def31200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T06:30:30.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:30 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1476160451' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-08T06:30:30.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:30 smithi070 ceph-mon[29591]: mgrmap e5: x(active, since 5s) 2024-05-08T06:30:30.268 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:30.152+0000 7f84def31200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T06:30:30.628 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:30.267+0000 7f84def31200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T06:30:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:31 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2684279046' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.425+0000 7f4ddb200700 1 Processor -- start 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.425+0000 7f4ddb200700 1 -- start start 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.426+0000 7f4ddb200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd410bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.426+0000 7f4ddb200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd407ce80 con 0x7f4dd4109720 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.426+0000 7f4dd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd410bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.426+0000 7f4dd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd410bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54346/0 (socket says 172.21.15.70:54346) 2024-05-08T06:30:31.480 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.426+0000 7f4dd3e00700 1 -- 172.21.15.70:0/1212634411 learned_addr learned my addr 172.21.15.70:0/1212634411 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.426+0000 7f4dd3e00700 1 -- 172.21.15.70:0/1212634411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd410c050 con 0x7f4dd4109720 2024-05-08T06:30:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.427+0000 7f4dd3e00700 1 --2- 172.21.15.70:0/1212634411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd410bb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40098a0 tx=0x7f4dc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42e75e8fbc7aa13 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.427+0000 7f4dd2a00700 1 -- 172.21.15.70:0/1212634411 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4004160 con 0x7f4dd4109720 2024-05-08T06:30:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.427+0000 7f4dd2a00700 1 -- 172.21.15.70:0/1212634411 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4dc4004300 con 0x7f4dd4109720 2024-05-08T06:30:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.427+0000 7f4dd2a00700 1 -- 172.21.15.70:0/1212634411 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc40119e0 con 0x7f4dd4109720 2024-05-08T06:30:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.428+0000 7f4ddb200700 1 -- 172.21.15.70:0/1212634411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 msgr2=0x7f4dd410bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.428+0000 7f4ddb200700 1 --2- 172.21.15.70:0/1212634411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd410bb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40098a0 tx=0x7f4dc4009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.428+0000 7f4ddb200700 1 -- 172.21.15.70:0/1212634411 shutdown_connections 2024-05-08T06:30:31.481 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.428+0000 7f4ddb200700 1 --2- 172.21.15.70:0/1212634411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd410bb10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.428+0000 7f4ddb200700 1 -- 172.21.15.70:0/1212634411 >> 172.21.15.70:0/1212634411 conn(0x7f4dd4103130 msgr2=0x7f4dd4105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.428+0000 7f4ddb200700 1 -- 172.21.15.70:0/1212634411 shutdown_connections 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.428+0000 7f4ddb200700 1 -- 172.21.15.70:0/1212634411 wait complete. 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.429+0000 7f4ddb200700 1 Processor -- start 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.429+0000 7f4ddb200700 1 -- start start 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.429+0000 7f4ddb200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd419ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.429+0000 7f4ddb200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd410cf40 con 0x7f4dd4109720 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.430+0000 7f4dd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd419ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.430+0000 7f4dd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd419ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54350/0 (socket says 172.21.15.70:54350) 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.430+0000 7f4dd3e00700 1 -- 172.21.15.70:0/2684279046 learned_addr learned my addr 172.21.15.70:0/2684279046 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.430+0000 7f4dd3e00700 1 -- 172.21.15.70:0/2684279046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd419f1a0 con 0x7f4dd4109720 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.430+0000 7f4dd3e00700 1 --2- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd419ec60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009130 tx=0x7f4dc4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:31.482 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.431+0000 7f4dd0c00700 1 -- 172.21.15.70:0/2684279046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4003b20 con 0x7f4dd4109720 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.431+0000 7f4dd0c00700 1 -- 172.21.15.70:0/2684279046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4dc401a8a0 con 0x7f4dd4109720 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.431+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd419f490 con 0x7f4dd4109720 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.431+0000 7f4dd0c00700 1 -- 172.21.15.70:0/2684279046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc4024810 con 0x7f4dd4109720 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.431+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd41a2120 con 0x7f4dd4109720 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.432+0000 7f4dd0c00700 1 -- 172.21.15.70:0/2684279046 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f4dc4022020 con 0x7f4dd4109720 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.432+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd4064b00 con 0x7f4dd4109720 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.433+0000 7f4dd0c00700 1 --2- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f4db803e4c0 0x7f4db8040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.433+0000 7f4dd0c00700 1 -- 172.21.15.70:0/2684279046 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4dc4053530 con 0x7f4dd4109720 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.433+0000 7f4dd3400700 1 -- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f4db803e4c0 msgr2=0x7f4db8040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2822740915 2024-05-08T06:30:31.483 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.433+0000 7f4dd3400700 1 --2- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f4db803e4c0 0x7f4db8040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.438+0000 7f4dd0c00700 1 -- 172.21.15.70:0/2684279046 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4dc400b3e0 con 0x7f4dd4109720 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.634+0000 7f4dd3400700 1 -- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f4db803e4c0 msgr2=0x7f4db8040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2822740915 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.634+0000 7f4dd3400700 1 --2- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f4db803e4c0 0x7f4db8040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.731+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f4dd41a28d0 con 0x7f4dd4109720 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.731+0000 7f4dd0c00700 1 -- 172.21.15.70:0/2684279046 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f4dc400f2e0 con 0x7f4dd4109720 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.734+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f4db803e4c0 msgr2=0x7f4db8040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.734+0000 7f4ddb200700 1 --2- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f4db803e4c0 0x7f4db8040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.734+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 msgr2=0x7f4dd419ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.734+0000 7f4ddb200700 1 --2- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd419ec60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009130 tx=0x7f4dc4011a60 comp rx=0 tx=0).stop 2024-05-08T06:30:31.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.734+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 shutdown_connections 2024-05-08T06:30:31.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.734+0000 7f4ddb200700 1 --2- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f4db803e4c0 0x7f4db8040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:31.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.734+0000 7f4ddb200700 1 --2- 172.21.15.70:0/2684279046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4dd4109720 0x7f4dd419ec60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:31.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.734+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 >> 172.21.15.70:0/2684279046 conn(0x7f4dd4103130 msgr2=0x7f4dd4103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:31.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.735+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 shutdown_connections 2024-05-08T06:30:31.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:30.735+0000 7f4ddb200700 1 -- 172.21.15.70:0/2684279046 wait complete. 2024-05-08T06:30:31.485 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-05-08T06:30:31.485 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 5... 2024-05-08T06:30:32.060 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:31.833+0000 7f84def31200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T06:30:32.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:32.067+0000 7f84def31200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T06:30:32.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:32.284+0000 7f84def31200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T06:30:33.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:32.661+0000 7f84def31200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T06:30:33.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:32.784+0000 7f84def31200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T06:30:33.305 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:33.036+0000 7f84def31200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T06:30:33.306 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:33.304+0000 7f84def31200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:30:34.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:34.097+0000 7f84def31200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T06:30:34.879 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:34.381+0000 7f84def31200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T06:30:35.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:34.933+0000 7f84def31200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T06:30:35.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:35.060+0000 7f84def31200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T06:30:35.879 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:35.522+0000 7f84def31200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T06:30:36.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:35.971+0000 7f84def31200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T06:30:36.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:36 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:36.096+0000 7f84def31200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T06:30:36.728 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:36 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:36.421+0000 7f84def31200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T06:30:36.728 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:36 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:36.601+0000 7f84def31200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T06:30:36.729 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:36 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:36.728+0000 7f84def31200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T06:30:37.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:37 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:37.123+0000 7f84def31200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T06:30:37.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:37 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:37.247+0000 7f84def31200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T06:30:38.289 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:38 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:38.003+0000 7f84def31200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T06:30:38.289 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:38 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:30:38.288+0000 7f84def31200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T06:30:38.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: Active manager daemon x restarted 2024-05-08T06:30:38.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: Activating manager daemon x 2024-05-08T06:30:38.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: osdmap e2: 0 total, 0 up, 0 in 2024-05-08T06:30:38.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: mgrmap e6: x(active, starting, since 0.00386834s) 2024-05-08T06:30:38.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:30:38.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T06:30:38.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T06:30:38.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T06:30:38.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T06:30:38.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: Manager daemon x is now available 2024-05-08T06:30:38.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:38.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:38 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:39 smithi070 ceph-mon[29591]: Found migration_current of "None". Setting to last migration. 2024-05-08T06:30:39.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:39 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:30:39.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:39 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:30:39.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:39 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T06:30:39.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:39 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T06:30:39.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:39 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:39.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:39 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:39.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:39 smithi070 ceph-mon[29591]: mgrmap e7: x(active, since 1.00991s) 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.095+0000 7f8859800700 1 Processor -- start 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.095+0000 7f8859800700 1 -- start start 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.096+0000 7f8859800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f8854108ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.096+0000 7f8859800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8854109490 con 0x7f8854108aa0 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.096+0000 7f8853e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f8854108ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:40.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.096+0000 7f8853e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f8854108ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54358/0 (socket says 172.21.15.70:54358) 2024-05-08T06:30:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.096+0000 7f8853e00700 1 -- 172.21.15.70:0/2992370749 learned_addr learned my addr 172.21.15.70:0/2992370749 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.097+0000 7f8853e00700 1 -- 172.21.15.70:0/2992370749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8854109ca0 con 0x7f8854108aa0 2024-05-08T06:30:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.097+0000 7f8853e00700 1 --2- 172.21.15.70:0/2992370749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f8854108ec0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f88440098a0 tx=0x7f8844009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3907a6c7e68f4b9c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.097+0000 7f8852a00700 1 -- 172.21.15.70:0/2992370749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8844004160 con 0x7f8854108aa0 2024-05-08T06:30:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.097+0000 7f8852a00700 1 -- 172.21.15.70:0/2992370749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f8844004300 con 0x7f8854108aa0 2024-05-08T06:30:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.097+0000 7f8852a00700 1 -- 172.21.15.70:0/2992370749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88440119e0 con 0x7f8854108aa0 2024-05-08T06:30:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.098+0000 7f8859800700 1 -- 172.21.15.70:0/2992370749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 msgr2=0x7f8854108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.098+0000 7f8859800700 1 --2- 172.21.15.70:0/2992370749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f8854108ec0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f88440098a0 tx=0x7f8844009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:40.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.098+0000 7f8859800700 1 -- 172.21.15.70:0/2992370749 shutdown_connections 2024-05-08T06:30:40.051 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.098+0000 7f8859800700 1 --2- 172.21.15.70:0/2992370749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f8854108ec0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:40.051 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.098+0000 7f8859800700 1 -- 172.21.15.70:0/2992370749 >> 172.21.15.70:0/2992370749 conn(0x7f8854104040 msgr2=0x7f8854106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:40.051 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.098+0000 7f8859800700 1 -- 172.21.15.70:0/2992370749 shutdown_connections 2024-05-08T06:30:40.051 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.099+0000 7f8859800700 1 -- 172.21.15.70:0/2992370749 wait complete. 2024-05-08T06:30:40.051 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.099+0000 7f8859800700 1 Processor -- start 2024-05-08T06:30:40.051 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.100+0000 7f8859800700 1 -- start start 2024-05-08T06:30:40.051 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.100+0000 7f8859800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f885407eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.100+0000 7f8859800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f885410ced0 con 0x7f8854108aa0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.100+0000 7f8853e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f885407eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.100+0000 7f8853e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f885407eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54366/0 (socket says 172.21.15.70:54366) 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.100+0000 7f8853e00700 1 -- 172.21.15.70:0/1413735601 learned_addr learned my addr 172.21.15.70:0/1413735601 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.101+0000 7f8853e00700 1 -- 172.21.15.70:0/1413735601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885407f0a0 con 0x7f8854108aa0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.101+0000 7f8853e00700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f885407eb60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f88440119b0 tx=0x7f8844011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.101+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8844003af0 con 0x7f8854108aa0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.101+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f884401a8a0 con 0x7f8854108aa0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.101+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8844024830 con 0x7f8854108aa0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.101+0000 7f8859800700 1 -- 172.21.15.70:0/1413735601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885407d290 con 0x7f8854108aa0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.101+0000 7f8859800700 1 -- 172.21.15.70:0/1413735601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885407d7d0 con 0x7f8854108aa0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.103+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f8844022020 con 0x7f8854108aa0 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.103+0000 7f8850c00700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 0x7f8838040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:40.052 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.104+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 --> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8838041090 con 0x7f883803e4c0 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.104+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8844053570 con 0x7f8854108aa0 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.104+0000 7f8853400700 1 -- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 msgr2=0x7f8838040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2822740915 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.104+0000 7f8853400700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 0x7f8838040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.305+0000 7f8853400700 1 -- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 msgr2=0x7f8838040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2822740915 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.305+0000 7f8853400700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 0x7f8838040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.706+0000 7f8853400700 1 -- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 msgr2=0x7f8838040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2822740915 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:32.706+0000 7f8853400700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 0x7f8838040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:33.507+0000 7f8853400700 1 -- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 msgr2=0x7f8838040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2822740915 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:33.507+0000 7f8853400700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 0x7f8838040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:35.109+0000 7f8853400700 1 -- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 msgr2=0x7f8838040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/2822740915 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:35.109+0000 7f8853400700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 0x7f8838040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:38.295+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f884400f2e0 con 0x7f8854108aa0 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:38.295+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 msgr2=0x7f8838040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T06:30:40.053 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:38.295+0000 7f8850c00700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 0x7f8838040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.299+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f8844054d50 con 0x7f8854108aa0 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.299+0000 7f8850c00700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8838041db0 0x7f88380441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.299+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f884401cec0 con 0x7f8838041db0 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.302+0000 7f8853400700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8838041db0 0x7f88380441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.304+0000 7f8853400700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8838041db0 0x7f88380441a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8840003a10 tx=0x7f88400092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.306+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 <== mgr.14120 v2:172.21.15.70:6800/1348548569 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f884401cec0 con 0x7f8838041db0 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.320+0000 7f8859800700 1 -- 172.21.15.70:0/1413735601 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f8854064b00 con 0x7f8838041db0 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.321+0000 7f8850c00700 1 -- 172.21.15.70:0/1413735601 <== mgr.14120 v2:172.21.15.70:6800/1348548569 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f8854064b00 con 0x7f8838041db0 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.321+0000 7f8859800700 1 -- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8838041db0 msgr2=0x7f88380441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.321+0000 7f8859800700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8838041db0 0x7f88380441a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8840003a10 tx=0x7f88400092b0 comp rx=0 tx=0).stop 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.322+0000 7f8859800700 1 -- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 msgr2=0x7f885407eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.322+0000 7f8859800700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f885407eb60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f88440119b0 tx=0x7f8844011a90 comp rx=0 tx=0).stop 2024-05-08T06:30:40.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.322+0000 7f8859800700 1 -- 172.21.15.70:0/1413735601 shutdown_connections 2024-05-08T06:30:40.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.322+0000 7f8859800700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8854108aa0 0x7f885407eb60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:40.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.322+0000 7f8859800700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8838041db0 0x7f88380441a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:40.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.322+0000 7f8859800700 1 --2- 172.21.15.70:0/1413735601 >> [v2:172.21.15.70:6800/2822740915,v1:172.21.15.70:6801/2822740915] conn(0x7f883803e4c0 0x7f8838040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:40.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.322+0000 7f8859800700 1 -- 172.21.15.70:0/1413735601 >> 172.21.15.70:0/1413735601 conn(0x7f8854104040 msgr2=0x7f8854104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:40.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.322+0000 7f8859800700 1 -- 172.21.15.70:0/1413735601 shutdown_connections 2024-05-08T06:30:40.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:39.322+0000 7f8859800700 1 -- 172.21.15.70:0/1413735601 wait complete. 2024-05-08T06:30:40.055 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 5 is available 2024-05-08T06:30:40.055 INFO:teuthology.orchestra.run.smithi070.stdout:Setting orchestrator backend to cephadm... 2024-05-08T06:30:40.600 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:40 smithi070 ceph-mon[29591]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T06:30:40.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:40 smithi070 ceph-mon[29591]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T06:30:40.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:40 smithi070 ceph-mon[29591]: [08/May/2024:06:30:39] ENGINE Bus STARTING 2024-05-08T06:30:40.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:40 smithi070 ceph-mon[29591]: [08/May/2024:06:30:39] ENGINE Serving on http://172.21.15.70:8765 2024-05-08T06:30:40.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:40 smithi070 ceph-mon[29591]: [08/May/2024:06:30:39] ENGINE Serving on https://172.21.15.70:7150 2024-05-08T06:30:40.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:40 smithi070 ceph-mon[29591]: [08/May/2024:06:30:39] ENGINE Bus STARTED 2024-05-08T06:30:40.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:40 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:30:41.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:41 smithi070 ceph-mon[29591]: mgrmap e8: x(active, since 2s) 2024-05-08T06:30:41.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:41 smithi070 ceph-mon[29591]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:30:41.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:41 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:41.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:41 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:30:41.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.648+0000 7faeda800700 1 Processor -- start 2024-05-08T06:30:41.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.648+0000 7faeda800700 1 -- start start 2024-05-08T06:30:41.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.648+0000 7faeda800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed410b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:41.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.648+0000 7faeda800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faed410b810 con 0x7faed410aeb0 2024-05-08T06:30:41.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.649+0000 7faed3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed410b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:41.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.649+0000 7faed3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed410b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37470/0 (socket says 172.21.15.70:37470) 2024-05-08T06:30:41.616 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.649+0000 7faed3400700 1 -- 172.21.15.70:0/2720486157 learned_addr learned my addr 172.21.15.70:0/2720486157 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.649+0000 7faed3400700 1 -- 172.21.15.70:0/2720486157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed410bfc0 con 0x7faed410aeb0 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.650+0000 7faed3400700 1 --2- 172.21.15.70:0/2720486157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed410b2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faec40098a0 tx=0x7faec4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8925b683f4ab85 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.650+0000 7faed2000700 1 -- 172.21.15.70:0/2720486157 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec4004160 con 0x7faed410aeb0 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.650+0000 7faed2000700 1 -- 172.21.15.70:0/2720486157 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7faec4004300 con 0x7faed410aeb0 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.650+0000 7faed2000700 1 -- 172.21.15.70:0/2720486157 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec40119e0 con 0x7faed410aeb0 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.651+0000 7faeda800700 1 -- 172.21.15.70:0/2720486157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 msgr2=0x7faed410b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.651+0000 7faeda800700 1 --2- 172.21.15.70:0/2720486157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed410b2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faec40098a0 tx=0x7faec4009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.651+0000 7faeda800700 1 -- 172.21.15.70:0/2720486157 shutdown_connections 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.651+0000 7faeda800700 1 --2- 172.21.15.70:0/2720486157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed410b2d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.651+0000 7faeda800700 1 -- 172.21.15.70:0/2720486157 >> 172.21.15.70:0/2720486157 conn(0x7faed407e280 msgr2=0x7faed407e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.651+0000 7faeda800700 1 -- 172.21.15.70:0/2720486157 shutdown_connections 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.651+0000 7faeda800700 1 -- 172.21.15.70:0/2720486157 wait complete. 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.652+0000 7faeda800700 1 Processor -- start 2024-05-08T06:30:41.617 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.652+0000 7faeda800700 1 -- start start 2024-05-08T06:30:41.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.652+0000 7faeda800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:41.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.652+0000 7faeda800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faed410f280 con 0x7faed410aeb0 2024-05-08T06:30:41.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.653+0000 7faed3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:41.618 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.653+0000 7faed3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed419ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37474/0 (socket says 172.21.15.70:37474) 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.653+0000 7faed3400700 1 -- 172.21.15.70:0/4123805953 learned_addr learned my addr 172.21.15.70:0/4123805953 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.653+0000 7faed3400700 1 -- 172.21.15.70:0/4123805953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed419f200 con 0x7faed410aeb0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.653+0000 7faed3400700 1 --2- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed419ecc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faec4009130 tx=0x7faec4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.654+0000 7faecbe00700 1 -- 172.21.15.70:0/4123805953 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec4003b20 con 0x7faed410aeb0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.654+0000 7faecbe00700 1 -- 172.21.15.70:0/4123805953 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7faec401a8a0 con 0x7faed410aeb0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.654+0000 7faecbe00700 1 -- 172.21.15.70:0/4123805953 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faec4024810 con 0x7faed410aeb0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.654+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed419f490 con 0x7faed410aeb0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.654+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed41a2180 con 0x7faed410aeb0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.655+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed4064b00 con 0x7faed410aeb0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.655+0000 7faecbe00700 1 -- 172.21.15.70:0/4123805953 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7faec4022020 con 0x7faed410aeb0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.656+0000 7faecbe00700 1 --2- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7faeb803e4c0 0x7faeb8040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.656+0000 7faecbe00700 1 -- 172.21.15.70:0/4123805953 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faec40538c0 con 0x7faed410aeb0 2024-05-08T06:30:41.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.656+0000 7faed2a00700 1 --2- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7faeb803e4c0 0x7faeb8040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.657+0000 7faed2a00700 1 --2- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7faeb803e4c0 0x7faeb8040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faec0006fd0 tx=0x7faec0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.661+0000 7faecbe00700 1 -- 172.21.15.70:0/4123805953 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7faec400f2e0 con 0x7faed410aeb0 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.910+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7faed4108b00 con 0x7faeb803e4c0 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.919+0000 7faecbe00700 1 -- 172.21.15.70:0/4123805953 <== mgr.14120 v2:172.21.15.70:6800/1348548569 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7faed4108b00 con 0x7faeb803e4c0 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.922+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7faeb803e4c0 msgr2=0x7faeb8040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.922+0000 7faeda800700 1 --2- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7faeb803e4c0 0x7faeb8040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faec0006fd0 tx=0x7faec0006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.922+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 msgr2=0x7faed419ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.922+0000 7faeda800700 1 --2- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed419ecc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faec4009130 tx=0x7faec4011a60 comp rx=0 tx=0).stop 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.923+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 shutdown_connections 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.923+0000 7faeda800700 1 --2- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7faeb803e4c0 0x7faeb8040980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.923+0000 7faeda800700 1 --2- 172.21.15.70:0/4123805953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faed410aeb0 0x7faed419ecc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:41.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.923+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 >> 172.21.15.70:0/4123805953 conn(0x7faed407e280 msgr2=0x7faed41083f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:41.623 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.923+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 shutdown_connections 2024-05-08T06:30:41.623 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:40.923+0000 7faeda800700 1 -- 172.21.15.70:0/4123805953 wait complete. 2024-05-08T06:30:43.255 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-08T06:30:43.255 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.255+0000 7feccb200700 1 Processor -- start 2024-05-08T06:30:43.255 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.255+0000 7feccb200700 1 -- start start 2024-05-08T06:30:43.255 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.256+0000 7feccb200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc07d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.256+0000 7feccb200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feccc07d880 con 0x7feccc07ee50 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.256+0000 7fecc9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc07d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.257+0000 7fecc9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc07d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37488/0 (socket says 172.21.15.70:37488) 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.257+0000 7fecc9e00700 1 -- 172.21.15.70:0/747098503 learned_addr learned my addr 172.21.15.70:0/747098503 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.257+0000 7fecc9e00700 1 -- 172.21.15.70:0/747098503 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc07da00 con 0x7feccc07ee50 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.257+0000 7fecc9e00700 1 --2- 172.21.15.70:0/747098503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc07d2b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0098a0 tx=0x7fecbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ade245130cdfa56 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.258+0000 7fecc8a00700 1 -- 172.21.15.70:0/747098503 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecbc004160 con 0x7feccc07ee50 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.258+0000 7fecc8a00700 1 -- 172.21.15.70:0/747098503 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fecbc004300 con 0x7feccc07ee50 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.258+0000 7fecc8a00700 1 -- 172.21.15.70:0/747098503 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecbc0119e0 con 0x7feccc07ee50 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.258+0000 7feccb200700 1 -- 172.21.15.70:0/747098503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 msgr2=0x7feccc07d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.258+0000 7feccb200700 1 --2- 172.21.15.70:0/747098503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc07d2b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0098a0 tx=0x7fecbc009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.258+0000 7feccb200700 1 -- 172.21.15.70:0/747098503 shutdown_connections 2024-05-08T06:30:43.256 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.259+0000 7feccb200700 1 --2- 172.21.15.70:0/747098503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc07d2b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.259+0000 7feccb200700 1 -- 172.21.15.70:0/747098503 >> 172.21.15.70:0/747098503 conn(0x7feccc104040 msgr2=0x7feccc106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.259+0000 7feccb200700 1 -- 172.21.15.70:0/747098503 shutdown_connections 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.259+0000 7feccb200700 1 -- 172.21.15.70:0/747098503 wait complete. 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.260+0000 7feccb200700 1 Processor -- start 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.260+0000 7feccb200700 1 -- start start 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.260+0000 7feccb200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.260+0000 7feccb200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feccc10efd0 con 0x7feccc07ee50 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.261+0000 7fecc9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.261+0000 7fecc9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc19eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37490/0 (socket says 172.21.15.70:37490) 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.261+0000 7fecc9e00700 1 -- 172.21.15.70:0/1201584439 learned_addr learned my addr 172.21.15.70:0/1201584439 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.261+0000 7fecc9e00700 1 -- 172.21.15.70:0/1201584439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feccc19eff0 con 0x7feccc07ee50 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.261+0000 7fecc9e00700 1 --2- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc19eab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0119b0 tx=0x7fecbc011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:43.257 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.261+0000 7fecc2a00700 1 -- 172.21.15.70:0/1201584439 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecbc0039f0 con 0x7feccc07ee50 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.261+0000 7fecc2a00700 1 -- 172.21.15.70:0/1201584439 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fecbc003b90 con 0x7feccc07ee50 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.262+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feccc19f280 con 0x7feccc07ee50 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.262+0000 7fecc2a00700 1 -- 172.21.15.70:0/1201584439 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fecbc01a620 con 0x7feccc07ee50 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.262+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feccc1a1f70 con 0x7feccc07ee50 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.263+0000 7fecc2a00700 1 -- 172.21.15.70:0/1201584439 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fecbc024430 con 0x7feccc07ee50 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.263+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feccc064b00 con 0x7feccc07ee50 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.263+0000 7fecc2a00700 1 --2- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fecb003e470 0x7fecb0040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.263+0000 7fecc2a00700 1 -- 172.21.15.70:0/1201584439 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fecbc053bb0 con 0x7feccc07ee50 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.264+0000 7fecc9400700 1 --2- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fecb003e470 0x7fecb0040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.265+0000 7fecc9400700 1 --2- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fecb003e470 0x7fecb0040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fecb8006fd0 tx=0x7fecb8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.270+0000 7fecc2a00700 1 -- 172.21.15.70:0/1201584439 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fecbc0172b0 con 0x7feccc07ee50 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.507+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7feccc1051f0 con 0x7fecb003e470 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.508+0000 7fecc2a00700 1 -- 172.21.15.70:0/1201584439 <== mgr.14120 v2:172.21.15.70:6800/1348548569 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7feccc1051f0 con 0x7fecb003e470 2024-05-08T06:30:43.258 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fecb003e470 msgr2=0x7fecb0040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 --2- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fecb003e470 0x7fecb0040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fecb8006fd0 tx=0x7fecb8006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 msgr2=0x7feccc19eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 --2- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc19eab0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0119b0 tx=0x7fecbc011a90 comp rx=0 tx=0).stop 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 shutdown_connections 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 --2- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fecb003e470 0x7fecb0040930 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 --2- 172.21.15.70:0/1201584439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feccc07ee50 0x7feccc19eab0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 >> 172.21.15.70:0/1201584439 conn(0x7feccc104040 msgr2=0x7feccc104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 shutdown_connections 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:42.513+0000 7feccb200700 1 -- 172.21.15.70:0/1201584439 wait complete. 2024-05-08T06:30:43.259 INFO:teuthology.orchestra.run.smithi070.stdout:Generating ssh key... 2024-05-08T06:30:43.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:43 smithi070 ceph-mon[29591]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:30:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:44 smithi070 ceph-mon[29591]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:30:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:44 smithi070 ceph-mon[29591]: Generating ssh key... 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: Generating public/private rsa key pair. 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: Your identification has been saved in /tmp/tmpm_5iyg1f/key. 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: Your public key has been saved in /tmp/tmpm_5iyg1f/key.pub. 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: The key fingerprint is: 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: SHA256:YRLynTL/RT0uyf30Fi6/kXTO6+4zAFiuXIsh1L+pYo8 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: The key's randomart image is: 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: +---[RSA 3072]----+ 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: | . . . | 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: | o + o . . | 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: | * = = . o | 2024-05-08T06:30:45.130 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: | B + B + . | 2024-05-08T06:30:45.131 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: | S = X ooo| 2024-05-08T06:30:45.131 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: | = = oo==| 2024-05-08T06:30:45.131 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: | o ..+*| 2024-05-08T06:30:45.131 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: | o.. o+o| 2024-05-08T06:30:45.131 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: | .Eo. +B+| 2024-05-08T06:30:45.131 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:30:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: +----[SHA256]-----+ 2024-05-08T06:30:45.500 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.840+0000 7f63cea00700 1 Processor -- start 2024-05-08T06:30:45.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.840+0000 7f63cea00700 1 -- start start 2024-05-08T06:30:45.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.841+0000 7f63cea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c807d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:45.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.841+0000 7f63cea00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63c807d8a0 con 0x7f63c807ee70 2024-05-08T06:30:45.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.841+0000 7f63cd600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c807d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:45.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.841+0000 7f63cd600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c807d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37492/0 (socket says 172.21.15.70:37492) 2024-05-08T06:30:45.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.841+0000 7f63cd600700 1 -- 172.21.15.70:0/194200991 learned_addr learned my addr 172.21.15.70:0/194200991 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.842+0000 7f63cd600700 1 -- 172.21.15.70:0/194200991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c807da20 con 0x7f63c807ee70 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.842+0000 7f63cd600700 1 --2- 172.21.15.70:0/194200991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c807d2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009e80 tx=0x7f63bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a5cddd90479a6c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.842+0000 7f63c7e00700 1 -- 172.21.15.70:0/194200991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63bc017070 con 0x7f63c807ee70 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.842+0000 7f63c7e00700 1 -- 172.21.15.70:0/194200991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f63bc00b8c0 con 0x7f63c807ee70 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.842+0000 7f63c7e00700 1 -- 172.21.15.70:0/194200991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63bc004420 con 0x7f63c807ee70 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.843+0000 7f63cea00700 1 -- 172.21.15.70:0/194200991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 msgr2=0x7f63c807d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.843+0000 7f63cea00700 1 --2- 172.21.15.70:0/194200991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c807d2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009e80 tx=0x7f63bc00b330 comp rx=0 tx=0).stop 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.843+0000 7f63cea00700 1 -- 172.21.15.70:0/194200991 shutdown_connections 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.843+0000 7f63cea00700 1 --2- 172.21.15.70:0/194200991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c807d2d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.843+0000 7f63cea00700 1 -- 172.21.15.70:0/194200991 >> 172.21.15.70:0/194200991 conn(0x7f63c8104040 msgr2=0x7f63c8106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.843+0000 7f63cea00700 1 -- 172.21.15.70:0/194200991 shutdown_connections 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.843+0000 7f63cea00700 1 -- 172.21.15.70:0/194200991 wait complete. 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.844+0000 7f63cea00700 1 Processor -- start 2024-05-08T06:30:45.506 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.845+0000 7f63cea00700 1 -- start start 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.845+0000 7f63cea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.845+0000 7f63cea00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63c810f010 con 0x7f63c807ee70 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.845+0000 7f63cd600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.845+0000 7f63cd600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37498/0 (socket says 172.21.15.70:37498) 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.845+0000 7f63cd600700 1 -- 172.21.15.70:0/1466453022 learned_addr learned my addr 172.21.15.70:0/1466453022 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.845+0000 7f63cd600700 1 -- 172.21.15.70:0/1466453022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c819f050 con 0x7f63c807ee70 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.846+0000 7f63cd600700 1 --2- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c819eb10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63bc004000 tx=0x7f63bc003ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.846+0000 7f63c6000700 1 -- 172.21.15.70:0/1466453022 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63bc020020 con 0x7f63c807ee70 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.846+0000 7f63c6000700 1 -- 172.21.15.70:0/1466453022 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f63bc0128a0 con 0x7f63c807ee70 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.846+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c819f2e0 con 0x7f63c807ee70 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.846+0000 7f63c6000700 1 -- 172.21.15.70:0/1466453022 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63bc017040 con 0x7f63c807ee70 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.846+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c81a1fd0 con 0x7f63c807ee70 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.847+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c8064b00 con 0x7f63c807ee70 2024-05-08T06:30:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.847+0000 7f63c6000700 1 -- 172.21.15.70:0/1466453022 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f63bc023020 con 0x7f63c807ee70 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.848+0000 7f63c6000700 1 --2- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f63b003e4c0 0x7f63b0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.848+0000 7f63c6000700 1 -- 172.21.15.70:0/1466453022 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f63bc00f050 con 0x7f63c807ee70 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.848+0000 7f63ccc00700 1 --2- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f63b003e4c0 0x7f63b0040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.849+0000 7f63ccc00700 1 --2- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f63b003e4c0 0x7f63b0040980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63b4006fd0 tx=0x7f63b4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:43.853+0000 7f63c6000700 1 -- 172.21.15.70:0/1466453022 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f63bc02a020 con 0x7f63c807ee70 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.078+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f63c8105240 con 0x7f63b003e4c0 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.811+0000 7f63c6000700 1 -- 172.21.15.70:0/1466453022 <== mgr.14120 v2:172.21.15.70:6800/1348548569 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f63c8105240 con 0x7f63b003e4c0 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.814+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f63b003e4c0 msgr2=0x7f63b0040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.814+0000 7f63cea00700 1 --2- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f63b003e4c0 0x7f63b0040980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63b4006fd0 tx=0x7f63b4006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.814+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 msgr2=0x7f63c819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.814+0000 7f63cea00700 1 --2- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c819eb10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f63bc004000 tx=0x7f63bc003ad0 comp rx=0 tx=0).stop 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.814+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 shutdown_connections 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.814+0000 7f63cea00700 1 --2- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f63b003e4c0 0x7f63b0040980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.814+0000 7f63cea00700 1 --2- 172.21.15.70:0/1466453022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63c807ee70 0x7f63c819eb10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:45.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.814+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 >> 172.21.15.70:0/1466453022 conn(0x7f63c8104040 msgr2=0x7f63c8104b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:45.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.815+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 shutdown_connections 2024-05-08T06:30:45.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:44.815+0000 7f63cea00700 1 -- 172.21.15.70:0/1466453022 wait complete. 2024-05-08T06:30:46.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:45 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:46.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:45 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:47.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNo8HUbR7e6qKXeAQuuelH41xbTbWqC9vHKvK24ZkzhSc2JECVzNiYMHKAczazksdAgFqvPY4nt0cHylttrbnGIuwHicD95QTei/6IK7YjyiccxDiq48GfsTqJ6xBuhxnoH2VwmE4F4X6CRcEKGT19nP4tns7f2pIZ4mkBG+PJWoBzBQ7uN6hY6E9LMiwKfW5IGAySFyDR0XKe2SHXl0T1X//WyRsZ32fs8Njzvihh2QZCKr2O5i4jauYMa7xP/x7AGittNQa0lR8/X9H5389RImwLbTpL2cbSnDjOT9qyXmnw6VEfovLAbkNNlRiJKonzw51LNNQuaCSoDJ+Sohf+aKYS3/38KcB39m2j6H+/amoYtyonN5ntRorMFV0zPU7iExRHVbufjQTPtza+XLu9wiP/RQaN6cJ7rVpWnt+PdQCjwMbrAy6pb1cd9ATcU2SFEviLuUQJwoHQpUeDrwqDBT3Tw0sVUetJ/KrtkhGifgmqXphuAZiJv6DcinPniEc= ceph-3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:30:47.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.100+0000 7fed9e400700 1 Processor -- start 2024-05-08T06:30:47.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.101+0000 7fed9e400700 1 -- start start 2024-05-08T06:30:47.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.101+0000 7fed9e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9807d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:47.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.101+0000 7fed9e400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fed9807d7f0 con 0x7fed9807ee00 2024-05-08T06:30:47.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.102+0000 7fed97400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9807d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.102+0000 7fed97400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9807d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37504/0 (socket says 172.21.15.70:37504) 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.102+0000 7fed97400700 1 -- 172.21.15.70:0/2503990075 learned_addr learned my addr 172.21.15.70:0/2503990075 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.102+0000 7fed97400700 1 -- 172.21.15.70:0/2503990075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9807d970 con 0x7fed9807ee00 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.102+0000 7fed97400700 1 --2- 172.21.15.70:0/2503990075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9807d2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fed880098a0 tx=0x7fed88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca7ed5737035e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.103+0000 7fed96a00700 1 -- 172.21.15.70:0/2503990075 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed88004160 con 0x7fed9807ee00 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.103+0000 7fed96a00700 1 -- 172.21.15.70:0/2503990075 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fed88004300 con 0x7fed9807ee00 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.103+0000 7fed96a00700 1 -- 172.21.15.70:0/2503990075 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed880119e0 con 0x7fed9807ee00 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.103+0000 7fed9e400700 1 -- 172.21.15.70:0/2503990075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 msgr2=0x7fed9807d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.103+0000 7fed9e400700 1 --2- 172.21.15.70:0/2503990075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9807d2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fed880098a0 tx=0x7fed88009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.104+0000 7fed9e400700 1 -- 172.21.15.70:0/2503990075 shutdown_connections 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.104+0000 7fed9e400700 1 --2- 172.21.15.70:0/2503990075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9807d2b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.104+0000 7fed9e400700 1 -- 172.21.15.70:0/2503990075 >> 172.21.15.70:0/2503990075 conn(0x7fed98104270 msgr2=0x7fed98106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:47.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.104+0000 7fed9e400700 1 -- 172.21.15.70:0/2503990075 shutdown_connections 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.104+0000 7fed9e400700 1 -- 172.21.15.70:0/2503990075 wait complete. 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.105+0000 7fed9e400700 1 Processor -- start 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.105+0000 7fed9e400700 1 -- start start 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.105+0000 7fed9e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9819ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.105+0000 7fed9e400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fed9810f1e0 con 0x7fed9807ee00 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.105+0000 7fed97400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9819ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.106+0000 7fed97400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9819ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37516/0 (socket says 172.21.15.70:37516) 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.106+0000 7fed97400700 1 -- 172.21.15.70:0/748822910 learned_addr learned my addr 172.21.15.70:0/748822910 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.106+0000 7fed97400700 1 -- 172.21.15.70:0/748822910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9819f1c0 con 0x7fed9807ee00 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.106+0000 7fed97400700 1 --2- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9819ec80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fed88009130 tx=0x7fed88011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.106+0000 7fed94c00700 1 -- 172.21.15.70:0/748822910 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed88003b20 con 0x7fed9807ee00 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.106+0000 7fed94c00700 1 -- 172.21.15.70:0/748822910 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fed8801a8a0 con 0x7fed9807ee00 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.106+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9819f450 con 0x7fed9807ee00 2024-05-08T06:30:47.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.107+0000 7fed94c00700 1 -- 172.21.15.70:0/748822910 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed88024810 con 0x7fed9807ee00 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.107+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed981a2140 con 0x7fed9807ee00 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.108+0000 7fed94c00700 1 -- 172.21.15.70:0/748822910 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fed88022020 con 0x7fed9807ee00 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.108+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed98064b00 con 0x7fed9807ee00 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.108+0000 7fed94c00700 1 --2- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fed7c03e470 0x7fed7c040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.108+0000 7fed94c00700 1 -- 172.21.15.70:0/748822910 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fed88053a70 con 0x7fed9807ee00 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.109+0000 7fed8ea00700 1 --2- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fed7c03e470 0x7fed7c040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.110+0000 7fed8ea00700 1 --2- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fed7c03e470 0x7fed7c040930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed80006fd0 tx=0x7fed80006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.114+0000 7fed94c00700 1 -- 172.21.15.70:0/748822910 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fed8801ad70 con 0x7fed9807ee00 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.346+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fed98105470 con 0x7fed7c03e470 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.347+0000 7fed94c00700 1 -- 172.21.15.70:0/748822910 <== mgr.14120 v2:172.21.15.70:6800/1348548569 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fed98105470 con 0x7fed7c03e470 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.350+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fed7c03e470 msgr2=0x7fed7c040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.350+0000 7fed9e400700 1 --2- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fed7c03e470 0x7fed7c040930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fed80006fd0 tx=0x7fed80006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.350+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 msgr2=0x7fed9819ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.350+0000 7fed9e400700 1 --2- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9819ec80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fed88009130 tx=0x7fed88011a60 comp rx=0 tx=0).stop 2024-05-08T06:30:47.048 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.350+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 shutdown_connections 2024-05-08T06:30:47.049 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.350+0000 7fed9e400700 1 --2- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fed7c03e470 0x7fed7c040930 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:47.049 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.350+0000 7fed9e400700 1 --2- 172.21.15.70:0/748822910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed9807ee00 0x7fed9819ec80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:47.049 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.350+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 >> 172.21.15.70:0/748822910 conn(0x7fed98104270 msgr2=0x7fed98104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:47.049 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.351+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 shutdown_connections 2024-05-08T06:30:47.049 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:46.351+0000 7fed9e400700 1 -- 172.21.15.70:0/748822910 wait complete. 2024-05-08T06:30:47.049 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-08T06:30:47.049 INFO:teuthology.orchestra.run.smithi070.stdout:Adding key to root@localhost authorized_keys... 2024-05-08T06:30:47.049 INFO:teuthology.orchestra.run.smithi070.stdout:Adding host smithi070... 2024-05-08T06:30:47.348 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:47 smithi070 ceph-mon[29591]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:30:48.543 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:48 smithi070 ceph-mon[29591]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:30:49.401 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:49 smithi070 ceph-mon[29591]: Deploying cephadm binary to smithi070 2024-05-08T06:30:54.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Added host 'smithi070' with addr '172.21.15.70' 2024-05-08T06:30:54.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.664+0000 7fef6ba00700 1 Processor -- start 2024-05-08T06:30:54.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.664+0000 7fef6ba00700 1 -- start start 2024-05-08T06:30:54.621 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.665+0000 7fef6ba00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641120b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.665+0000 7fef6ba00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef640834d0 con 0x7fef6410fcc0 2024-05-08T06:30:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.665+0000 7fef69000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641120b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.665+0000 7fef69000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641120b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51582/0 (socket says 172.21.15.70:51582) 2024-05-08T06:30:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.665+0000 7fef69000700 1 -- 172.21.15.70:0/364129942 learned_addr learned my addr 172.21.15.70:0/364129942 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.666+0000 7fef69000700 1 -- 172.21.15.70:0/364129942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef641125f0 con 0x7fef6410fcc0 2024-05-08T06:30:54.622 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.666+0000 7fef69000700 1 --2- 172.21.15.70:0/364129942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641120b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef580098a0 tx=0x7fef58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228c4c2e478a3608 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:54.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.666+0000 7fef63400700 1 -- 172.21.15.70:0/364129942 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef58004160 con 0x7fef6410fcc0 2024-05-08T06:30:54.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.666+0000 7fef63400700 1 -- 172.21.15.70:0/364129942 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fef58004300 con 0x7fef6410fcc0 2024-05-08T06:30:54.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.666+0000 7fef63400700 1 -- 172.21.15.70:0/364129942 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef580119e0 con 0x7fef6410fcc0 2024-05-08T06:30:54.625 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.667+0000 7fef6ba00700 1 -- 172.21.15.70:0/364129942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 msgr2=0x7fef641120b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.667+0000 7fef6ba00700 1 --2- 172.21.15.70:0/364129942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641120b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef580098a0 tx=0x7fef58009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.667+0000 7fef6ba00700 1 -- 172.21.15.70:0/364129942 shutdown_connections 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.667+0000 7fef6ba00700 1 --2- 172.21.15.70:0/364129942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641120b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.667+0000 7fef6ba00700 1 -- 172.21.15.70:0/364129942 >> 172.21.15.70:0/364129942 conn(0x7fef6407e280 msgr2=0x7fef640806c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.667+0000 7fef6ba00700 1 -- 172.21.15.70:0/364129942 shutdown_connections 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.667+0000 7fef6ba00700 1 -- 172.21.15.70:0/364129942 wait complete. 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.668+0000 7fef6ba00700 1 Processor -- start 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.668+0000 7fef6ba00700 1 -- start start 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.669+0000 7fef6ba00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641a30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.669+0000 7fef6ba00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef641135b0 con 0x7fef6410fcc0 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.669+0000 7fef69000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641a30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.669+0000 7fef69000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641a30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51586/0 (socket says 172.21.15.70:51586) 2024-05-08T06:30:54.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.669+0000 7fef69000700 1 -- 172.21.15.70:0/3413888127 learned_addr learned my addr 172.21.15.70:0/3413888127 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.669+0000 7fef69000700 1 -- 172.21.15.70:0/3413888127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef641a35f0 con 0x7fef6410fcc0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.670+0000 7fef69000700 1 --2- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641a30b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef58009130 tx=0x7fef58011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.670+0000 7fef61600700 1 -- 172.21.15.70:0/3413888127 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef58003b20 con 0x7fef6410fcc0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.670+0000 7fef61600700 1 -- 172.21.15.70:0/3413888127 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7fef5801a8a0 con 0x7fef6410fcc0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.670+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef641a3880 con 0x7fef6410fcc0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.670+0000 7fef61600700 1 -- 172.21.15.70:0/3413888127 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef58024810 con 0x7fef6410fcc0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.670+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef641a6570 con 0x7fef6410fcc0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.671+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef64064b00 con 0x7fef6410fcc0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.671+0000 7fef61600700 1 -- 172.21.15.70:0/3413888127 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fef58022020 con 0x7fef6410fcc0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.672+0000 7fef61600700 1 --2- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fef4c03e4c0 0x7fef4c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.672+0000 7fef61600700 1 -- 172.21.15.70:0/3413888127 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fef580538c0 con 0x7fef6410fcc0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.672+0000 7fef63e00700 1 --2- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fef4c03e4c0 0x7fef4c040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:54.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.673+0000 7fef63e00700 1 --2- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fef4c03e4c0 0x7fef4c040980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fef50006fd0 tx=0x7fef50006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.678+0000 7fef61600700 1 -- 172.21.15.70:0/3413888127 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fef5800f2e0 con 0x7fef6410fcc0 2024-05-08T06:30:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:47.918+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}) -- 0x7fef6407f460 con 0x7fef4c03e4c0 2024-05-08T06:30:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.796+0000 7fef61600700 1 -- 172.21.15.70:0/3413888127 <== mgr.14120 v2:172.21.15.70:6800/1348548569 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fef6407f460 con 0x7fef4c03e4c0 2024-05-08T06:30:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.800+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fef4c03e4c0 msgr2=0x7fef4c040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.800+0000 7fef6ba00700 1 --2- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fef4c03e4c0 0x7fef4c040980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fef50006fd0 tx=0x7fef50006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.801+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 msgr2=0x7fef641a30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:54.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.801+0000 7fef6ba00700 1 --2- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641a30b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fef58009130 tx=0x7fef58011a60 comp rx=0 tx=0).stop 2024-05-08T06:30:54.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.801+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 shutdown_connections 2024-05-08T06:30:54.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.801+0000 7fef6ba00700 1 --2- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fef4c03e4c0 0x7fef4c040980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:54.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.801+0000 7fef6ba00700 1 --2- 172.21.15.70:0/3413888127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef6410fcc0 0x7fef641a30b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:54.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.801+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 >> 172.21.15.70:0/3413888127 conn(0x7fef6407e280 msgr2=0x7fef6407ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:54.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.801+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 shutdown_connections 2024-05-08T06:30:54.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:53.801+0000 7fef6ba00700 1 -- 172.21.15.70:0/3413888127 wait complete. 2024-05-08T06:30:54.630 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mon service... 2024-05-08T06:30:54.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:54 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:54.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:54 smithi070 ceph-mon[29591]: Added host smithi070 2024-05-08T06:30:54.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:54 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:30:56.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-08T06:30:56.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.351+0000 7f7a23a00700 1 Processor -- start 2024-05-08T06:30:56.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.351+0000 7f7a23a00700 1 -- start start 2024-05-08T06:30:56.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.351+0000 7f7a23a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c10b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:56.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.351+0000 7f7a23a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c10b810 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.352+0000 7f7a21000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c10b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:56.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.352+0000 7f7a21000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c10b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51588/0 (socket says 172.21.15.70:51588) 2024-05-08T06:30:56.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.352+0000 7f7a21000700 1 -- 172.21.15.70:0/1910076719 learned_addr learned my addr 172.21.15.70:0/1910076719 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:56.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.352+0000 7f7a21000700 1 -- 172.21.15.70:0/1910076719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c10bfc0 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.353+0000 7f7a21000700 1 --2- 172.21.15.70:0/1910076719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c10b2d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a100098a0 tx=0x7f7a10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5502d71886e51461 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:56.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.353+0000 7f7a1b400700 1 -- 172.21.15.70:0/1910076719 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a10004160 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.353+0000 7f7a1b400700 1 -- 172.21.15.70:0/1910076719 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7a10004300 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.353+0000 7f7a1b400700 1 -- 172.21.15.70:0/1910076719 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a100119e0 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.353+0000 7f7a23a00700 1 -- 172.21.15.70:0/1910076719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 msgr2=0x7f7a1c10b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.353+0000 7f7a23a00700 1 --2- 172.21.15.70:0/1910076719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c10b2d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7a100098a0 tx=0x7f7a10009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.354+0000 7f7a23a00700 1 -- 172.21.15.70:0/1910076719 shutdown_connections 2024-05-08T06:30:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.354+0000 7f7a23a00700 1 --2- 172.21.15.70:0/1910076719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c10b2d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.354+0000 7f7a23a00700 1 -- 172.21.15.70:0/1910076719 >> 172.21.15.70:0/1910076719 conn(0x7f7a1c07e280 msgr2=0x7f7a1c07e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:56.423 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.354+0000 7f7a23a00700 1 -- 172.21.15.70:0/1910076719 shutdown_connections 2024-05-08T06:30:56.424 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.354+0000 7f7a23a00700 1 -- 172.21.15.70:0/1910076719 wait complete. 2024-05-08T06:30:56.424 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.355+0000 7f7a23a00700 1 Processor -- start 2024-05-08T06:30:56.424 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.355+0000 7f7a23a00700 1 -- start start 2024-05-08T06:30:56.425 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.355+0000 7f7a23a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:56.425 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.355+0000 7f7a23a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c10f280 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.425 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.355+0000 7f7a21000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:56.425 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.355+0000 7f7a21000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c19ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51592/0 (socket says 172.21.15.70:51592) 2024-05-08T06:30:56.425 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.355+0000 7f7a21000700 1 -- 172.21.15.70:0/212069250 learned_addr learned my addr 172.21.15.70:0/212069250 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:56.426 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.356+0000 7f7a21000700 1 -- 172.21.15.70:0/212069250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c19f200 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.426 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.356+0000 7f7a21000700 1 --2- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c19ecc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a100119b0 tx=0x7f7a10011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:56.426 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.356+0000 7f7a19600700 1 -- 172.21.15.70:0/212069250 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a100039f0 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.426 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.356+0000 7f7a19600700 1 -- 172.21.15.70:0/212069250 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7a10003b90 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.426 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.356+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1c19f490 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.426 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.356+0000 7f7a19600700 1 -- 172.21.15.70:0/212069250 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a1001a620 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.426 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.357+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1c1a2180 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.428 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.357+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a1c064b00 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.428 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.358+0000 7f7a19600700 1 -- 172.21.15.70:0/212069250 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f7a10024a50 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.428 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.358+0000 7f7a19600700 1 --2- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f7a0403e420 0x7f7a040408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:56.428 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.358+0000 7f7a19600700 1 -- 172.21.15.70:0/212069250 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7a10053cc0 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.428 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.359+0000 7f7a1be00700 1 --2- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f7a0403e420 0x7f7a040408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:56.428 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.359+0000 7f7a1be00700 1 --2- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f7a0403e420 0x7f7a040408e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7a08006fd0 tx=0x7f7a08006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:56.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.364+0000 7f7a19600700 1 -- 172.21.15.70:0/212069250 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7a1005a080 con 0x7f7a1c10aeb0 2024-05-08T06:30:56.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.621+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f7a1c108b00 con 0x7f7a0403e420 2024-05-08T06:30:56.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.631+0000 7f7a19600700 1 -- 172.21.15.70:0/212069250 <== mgr.14120 v2:172.21.15.70:6800/1348548569 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f7a1c108b00 con 0x7f7a0403e420 2024-05-08T06:30:56.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.633+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f7a0403e420 msgr2=0x7f7a040408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:56.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.633+0000 7f7a23a00700 1 --2- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f7a0403e420 0x7f7a040408e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7a08006fd0 tx=0x7f7a08006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:56.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.633+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 msgr2=0x7f7a1c19ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:56.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.633+0000 7f7a23a00700 1 --2- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c19ecc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7a100119b0 tx=0x7f7a10011a90 comp rx=0 tx=0).stop 2024-05-08T06:30:56.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.634+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 shutdown_connections 2024-05-08T06:30:56.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.634+0000 7f7a23a00700 1 --2- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f7a0403e420 0x7f7a040408e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:56.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.634+0000 7f7a23a00700 1 --2- 172.21.15.70:0/212069250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10aeb0 0x7f7a1c19ecc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:56.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.634+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 >> 172.21.15.70:0/212069250 conn(0x7f7a1c07e280 msgr2=0x7f7a1c1083f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:56.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.634+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 shutdown_connections 2024-05-08T06:30:56.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:55.634+0000 7f7a23a00700 1 -- 172.21.15.70:0/212069250 wait complete. 2024-05-08T06:30:56.430 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mgr service... 2024-05-08T06:30:56.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:56 smithi070 ceph-mon[29591]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:30:56.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:56 smithi070 ceph-mon[29591]: Saving service mon spec with placement count:5 2024-05-08T06:30:56.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:56 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:58.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:58 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:58.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:58 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:58.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:58 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:30:59.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-08T06:30:59.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.013+0000 7f75b3800700 1 Processor -- start 2024-05-08T06:30:59.054 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.013+0000 7f75b3800700 1 -- start start 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.014+0000 7f75b3800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac07d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.014+0000 7f75b3800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac07d8c0 con 0x7f75ac07ee40 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.014+0000 7f75b0e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac07d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.014+0000 7f75b0e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac07d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46376/0 (socket says 172.21.15.70:46376) 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.014+0000 7f75b0e00700 1 -- 172.21.15.70:0/2427709401 learned_addr learned my addr 172.21.15.70:0/2427709401 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.014+0000 7f75b0e00700 1 -- 172.21.15.70:0/2427709401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac07da40 con 0x7f75ac07ee40 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.015+0000 7f75b0e00700 1 --2- 172.21.15.70:0/2427709401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac07d2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75a00098a0 tx=0x7f75a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb86de4a18f1615 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.015+0000 7f75ab400700 1 -- 172.21.15.70:0/2427709401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a0004160 con 0x7f75ac07ee40 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.015+0000 7f75ab400700 1 -- 172.21.15.70:0/2427709401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75a0004300 con 0x7f75ac07ee40 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.015+0000 7f75ab400700 1 -- 172.21.15.70:0/2427709401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a0011960 con 0x7f75ac07ee40 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.016+0000 7f75b3800700 1 -- 172.21.15.70:0/2427709401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 msgr2=0x7f75ac07d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:59.055 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.016+0000 7f75b3800700 1 --2- 172.21.15.70:0/2427709401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac07d2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75a00098a0 tx=0x7f75a0009bb0 comp rx=0 tx=0).stop 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.016+0000 7f75b3800700 1 -- 172.21.15.70:0/2427709401 shutdown_connections 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.016+0000 7f75b3800700 1 --2- 172.21.15.70:0/2427709401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac07d2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.016+0000 7f75b3800700 1 -- 172.21.15.70:0/2427709401 >> 172.21.15.70:0/2427709401 conn(0x7f75ac104270 msgr2=0x7f75ac106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.016+0000 7f75b3800700 1 -- 172.21.15.70:0/2427709401 shutdown_connections 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.016+0000 7f75b3800700 1 -- 172.21.15.70:0/2427709401 wait complete. 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.017+0000 7f75b3800700 1 Processor -- start 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.018+0000 7f75b3800700 1 -- start start 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.018+0000 7f75b3800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac19ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.018+0000 7f75b3800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac10f1f0 con 0x7f75ac07ee40 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.018+0000 7f75b0e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac19ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.018+0000 7f75b0e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac19ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46390/0 (socket says 172.21.15.70:46390) 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.018+0000 7f75b0e00700 1 -- 172.21.15.70:0/173841954 learned_addr learned my addr 172.21.15.70:0/173841954 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.019+0000 7f75b0e00700 1 -- 172.21.15.70:0/173841954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac19f200 con 0x7f75ac07ee40 2024-05-08T06:30:59.056 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.019+0000 7f75b0e00700 1 --2- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac19ecc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f75a0011670 tx=0x7f75a0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.019+0000 7f75a9600700 1 -- 172.21.15.70:0/173841954 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a0003a60 con 0x7f75ac07ee40 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.020+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac19f490 con 0x7f75ac07ee40 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.020+0000 7f75a9600700 1 -- 172.21.15.70:0/173841954 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75a001b8d0 con 0x7f75ac07ee40 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.020+0000 7f75a9600700 1 -- 172.21.15.70:0/173841954 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75a0023790 con 0x7f75ac07ee40 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.020+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac1a2180 con 0x7f75ac07ee40 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.021+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ac064b00 con 0x7f75ac07ee40 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.021+0000 7f75a9600700 1 -- 172.21.15.70:0/173841954 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f75a001b440 con 0x7f75ac07ee40 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.022+0000 7f75a9600700 1 --2- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f759403e470 0x7f7594040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.022+0000 7f75a9600700 1 -- 172.21.15.70:0/173841954 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f75a0053fe0 con 0x7f75ac07ee40 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.022+0000 7f75abe00700 1 --2- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f759403e470 0x7f7594040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.023+0000 7f75abe00700 1 --2- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f759403e470 0x7f7594040930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7598006fd0 tx=0x7f7598006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.028+0000 7f75a9600700 1 -- 172.21.15.70:0/173841954 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f75a001f030 con 0x7f75ac07ee40 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.276+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f75ac105470 con 0x7f759403e470 2024-05-08T06:30:59.057 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.283+0000 7f75a9600700 1 -- 172.21.15.70:0/173841954 <== mgr.14120 v2:172.21.15.70:6800/1348548569 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f75ac105470 con 0x7f759403e470 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f759403e470 msgr2=0x7f7594040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 --2- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f759403e470 0x7f7594040930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7598006fd0 tx=0x7f7598006e40 comp rx=0 tx=0).stop 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 msgr2=0x7f75ac19ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 --2- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac19ecc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f75a0011670 tx=0x7f75a0011a30 comp rx=0 tx=0).stop 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 shutdown_connections 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 --2- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f759403e470 0x7f7594040930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 --2- 172.21.15.70:0/173841954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75ac07ee40 0x7f75ac19ecc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 >> 172.21.15.70:0/173841954 conn(0x7f75ac104270 msgr2=0x7f75ac104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 shutdown_connections 2024-05-08T06:30:59.058 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:58.286+0000 7f75b3800700 1 -- 172.21.15.70:0/173841954 wait complete. 2024-05-08T06:30:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:59 smithi070 ceph-mon[29591]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:30:59.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:59 smithi070 ceph-mon[29591]: Saving service mgr spec with placement count:2 2024-05-08T06:30:59.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:30:59 smithi070 ceph-mon[29591]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:00.778 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.656+0000 7f8d3de00700 1 Processor -- start 2024-05-08T06:31:00.778 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.656+0000 7f8d3de00700 1 -- start start 2024-05-08T06:31:00.778 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.657+0000 7f8d3de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3807d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.657+0000 7f8d3de00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3807d810 con 0x7f8d3807ee20 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.657+0000 7f8d36a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3807d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.657+0000 7f8d36a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3807d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46406/0 (socket says 172.21.15.70:46406) 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.657+0000 7f8d36a00700 1 -- 172.21.15.70:0/3766174371 learned_addr learned my addr 172.21.15.70:0/3766174371 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.657+0000 7f8d36a00700 1 -- 172.21.15.70:0/3766174371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3807d990 con 0x7f8d3807ee20 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.658+0000 7f8d36a00700 1 --2- 172.21.15.70:0/3766174371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3807d2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8d280098a0 tx=0x7f8d28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd03fc6aed6ab5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.658+0000 7f8d35600700 1 -- 172.21.15.70:0/3766174371 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d28004160 con 0x7f8d3807ee20 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.658+0000 7f8d35600700 1 -- 172.21.15.70:0/3766174371 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d28004300 con 0x7f8d3807ee20 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.658+0000 7f8d35600700 1 -- 172.21.15.70:0/3766174371 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d28011960 con 0x7f8d3807ee20 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.659+0000 7f8d3de00700 1 -- 172.21.15.70:0/3766174371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 msgr2=0x7f8d3807d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:00.780 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.659+0000 7f8d3de00700 1 --2- 172.21.15.70:0/3766174371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3807d2d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8d280098a0 tx=0x7f8d28009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:00.784 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.659+0000 7f8d3de00700 1 -- 172.21.15.70:0/3766174371 shutdown_connections 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.659+0000 7f8d3de00700 1 --2- 172.21.15.70:0/3766174371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3807d2d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.659+0000 7f8d3de00700 1 -- 172.21.15.70:0/3766174371 >> 172.21.15.70:0/3766174371 conn(0x7f8d38104270 msgr2=0x7f8d38106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.659+0000 7f8d3de00700 1 -- 172.21.15.70:0/3766174371 shutdown_connections 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.659+0000 7f8d3de00700 1 -- 172.21.15.70:0/3766174371 wait complete. 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.661+0000 7f8d3de00700 1 Processor -- start 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.661+0000 7f8d3de00700 1 -- start start 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.661+0000 7f8d3de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.661+0000 7f8d3de00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3810f1b0 con 0x7f8d3807ee20 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.661+0000 7f8d36a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.662+0000 7f8d36a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3819ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46410/0 (socket says 172.21.15.70:46410) 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.662+0000 7f8d36a00700 1 -- 172.21.15.70:0/1091994729 learned_addr learned my addr 172.21.15.70:0/1091994729 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.662+0000 7f8d36a00700 1 -- 172.21.15.70:0/1091994729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3819f210 con 0x7f8d3807ee20 2024-05-08T06:31:00.785 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.662+0000 7f8d36a00700 1 --2- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3819ecd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d28003e50 tx=0x7f8d28011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.663+0000 7f8d3ca00700 1 -- 172.21.15.70:0/1091994729 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d28003a60 con 0x7f8d3807ee20 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.663+0000 7f8d3ca00700 1 -- 172.21.15.70:0/1091994729 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d2801b8d0 con 0x7f8d3807ee20 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.663+0000 7f8d3ca00700 1 -- 172.21.15.70:0/1091994729 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d280237d0 con 0x7f8d3807ee20 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.663+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3819f4a0 con 0x7f8d3807ee20 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.663+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d381a2180 con 0x7f8d3807ee20 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.664+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d38064b00 con 0x7f8d3807ee20 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.665+0000 7f8d3ca00700 1 -- 172.21.15.70:0/1091994729 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f8d2801b440 con 0x7f8d3807ee20 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.666+0000 7f8d3ca00700 1 --2- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8d1c03e470 0x7f8d1c040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.666+0000 7f8d3ca00700 1 -- 172.21.15.70:0/1091994729 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8d28054100 con 0x7f8d3807ee20 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.666+0000 7f8d36000700 1 --2- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8d1c03e470 0x7f8d1c040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.667+0000 7f8d36000700 1 --2- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8d1c03e470 0x7f8d1c040930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d24006fd0 tx=0x7f8d24006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:00.786 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.672+0000 7f8d3ca00700 1 -- 172.21.15.70:0/1091994729 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8d28028060 con 0x7f8d3807ee20 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.917+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f8d381a2750 con 0x7f8d3807ee20 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.923+0000 7f8d3ca00700 1 -- 172.21.15.70:0/1091994729 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f8d2801f030 con 0x7f8d3807ee20 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.926+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8d1c03e470 msgr2=0x7f8d1c040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.926+0000 7f8d3de00700 1 --2- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8d1c03e470 0x7f8d1c040930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d24006fd0 tx=0x7f8d24006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.926+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 msgr2=0x7f8d3819ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.926+0000 7f8d3de00700 1 --2- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3819ecd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8d28003e50 tx=0x7f8d28011a30 comp rx=0 tx=0).stop 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.927+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 shutdown_connections 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.927+0000 7f8d3de00700 1 --2- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f8d1c03e470 0x7f8d1c040930 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.927+0000 7f8d3de00700 1 --2- 172.21.15.70:0/1091994729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d3807ee20 0x7f8d3819ecd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.927+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 >> 172.21.15.70:0/1091994729 conn(0x7f8d38104270 msgr2=0x7f8d38104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.927+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 shutdown_connections 2024-05-08T06:31:00.787 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:30:59.927+0000 7f8d3de00700 1 -- 172.21.15.70:0/1091994729 wait complete. 2024-05-08T06:31:01.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:00 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1091994729' entity='client.admin' 2024-05-08T06:31:02.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:01 smithi070 ceph-mon[29591]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:02.214 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:01 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:31:02.749 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.720+0000 7f72aa400700 1 Processor -- start 2024-05-08T06:31:02.749 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.720+0000 7f72aa400700 1 -- start start 2024-05-08T06:31:02.749 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.720+0000 7f72aa400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a407d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:02.749 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.721+0000 7f72aa400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72a407d8c0 con 0x7f72a407ee40 2024-05-08T06:31:02.751 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.721+0000 7f72a3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a407d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.721+0000 7f72a3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a407d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46420/0 (socket says 172.21.15.70:46420) 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.721+0000 7f72a3400700 1 -- 172.21.15.70:0/602357058 learned_addr learned my addr 172.21.15.70:0/602357058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.721+0000 7f72a3400700 1 -- 172.21.15.70:0/602357058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a407da40 con 0x7f72a407ee40 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.722+0000 7f72a3400700 1 --2- 172.21.15.70:0/602357058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a407d2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72940098a0 tx=0x7f7294009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c26b413d174572 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.722+0000 7f72a2000700 1 -- 172.21.15.70:0/602357058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7294004160 con 0x7f72a407ee40 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.722+0000 7f72a2000700 1 -- 172.21.15.70:0/602357058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7294004300 con 0x7f72a407ee40 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.722+0000 7f72a2000700 1 -- 172.21.15.70:0/602357058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7294011960 con 0x7f72a407ee40 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.723+0000 7f72aa400700 1 -- 172.21.15.70:0/602357058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 msgr2=0x7f72a407d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.723+0000 7f72aa400700 1 --2- 172.21.15.70:0/602357058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a407d2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72940098a0 tx=0x7f7294009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.723+0000 7f72aa400700 1 -- 172.21.15.70:0/602357058 shutdown_connections 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.723+0000 7f72aa400700 1 --2- 172.21.15.70:0/602357058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a407d2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.723+0000 7f72aa400700 1 -- 172.21.15.70:0/602357058 >> 172.21.15.70:0/602357058 conn(0x7f72a4104270 msgr2=0x7f72a4106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.723+0000 7f72aa400700 1 -- 172.21.15.70:0/602357058 shutdown_connections 2024-05-08T06:31:02.752 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.723+0000 7f72aa400700 1 -- 172.21.15.70:0/602357058 wait complete. 2024-05-08T06:31:02.753 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.724+0000 7f72aa400700 1 Processor -- start 2024-05-08T06:31:02.753 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.725+0000 7f72aa400700 1 -- start start 2024-05-08T06:31:02.756 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.725+0000 7f72aa400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:02.756 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.725+0000 7f72aa400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72a410f1f0 con 0x7f72a407ee40 2024-05-08T06:31:02.756 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.725+0000 7f72a3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:02.756 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.725+0000 7f72a3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a419ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46428/0 (socket says 172.21.15.70:46428) 2024-05-08T06:31:02.756 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.725+0000 7f72a3400700 1 -- 172.21.15.70:0/2380519361 learned_addr learned my addr 172.21.15.70:0/2380519361 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:02.756 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.726+0000 7f72a3400700 1 -- 172.21.15.70:0/2380519361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a419f200 con 0x7f72a407ee40 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.726+0000 7f72a3400700 1 --2- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a419ecc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7294011670 tx=0x7f7294011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.726+0000 7f729be00700 1 -- 172.21.15.70:0/2380519361 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7294003a60 con 0x7f72a407ee40 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.726+0000 7f729be00700 1 -- 172.21.15.70:0/2380519361 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f729401b8d0 con 0x7f72a407ee40 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.726+0000 7f729be00700 1 -- 172.21.15.70:0/2380519361 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7294023790 con 0x7f72a407ee40 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.726+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a419f490 con 0x7f72a407ee40 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.727+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a41a2180 con 0x7f72a407ee40 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.728+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a4064b00 con 0x7f72a407ee40 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.728+0000 7f729be00700 1 -- 172.21.15.70:0/2380519361 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f729401b440 con 0x7f72a407ee40 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.729+0000 7f729be00700 1 --2- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f728803e4c0 0x7f7288040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.729+0000 7f729be00700 1 -- 172.21.15.70:0/2380519361 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7294053f50 con 0x7f72a407ee40 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.729+0000 7f72a2a00700 1 --2- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f728803e4c0 0x7f7288040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.730+0000 7f72a2a00700 1 --2- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f728803e4c0 0x7f7288040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7290006fd0 tx=0x7f7290006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:02.757 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.735+0000 7f729be00700 1 -- 172.21.15.70:0/2380519361 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f729401f030 con 0x7f72a407ee40 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.969+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f72a41a23f0 con 0x7f72a407ee40 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.972+0000 7f729be00700 1 -- 172.21.15.70:0/2380519361 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f72940538a0 con 0x7f72a407ee40 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.975+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f728803e4c0 msgr2=0x7f7288040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.975+0000 7f72aa400700 1 --2- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f728803e4c0 0x7f7288040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7290006fd0 tx=0x7f7290006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.975+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 msgr2=0x7f72a419ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.975+0000 7f72aa400700 1 --2- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a419ecc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7294011670 tx=0x7f7294011a30 comp rx=0 tx=0).stop 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.976+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 shutdown_connections 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.976+0000 7f72aa400700 1 --2- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f728803e4c0 0x7f7288040980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.976+0000 7f72aa400700 1 --2- 172.21.15.70:0/2380519361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a407ee40 0x7f72a419ecc0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.976+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 >> 172.21.15.70:0/2380519361 conn(0x7f72a4104270 msgr2=0x7f72a4104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.976+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 shutdown_connections 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:01.976+0000 7f72aa400700 1 -- 172.21.15.70:0/2380519361 wait complete. 2024-05-08T06:31:02.758 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling the dashboard module... 2024-05-08T06:31:03.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:02 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2380519361' entity='client.admin' 2024-05-08T06:31:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:03 smithi070 ceph-mon[29591]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:04.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:03 smithi070 ceph-mon[29591]: from='mgr.14120 172.21.15.70:0/1186838587' entity='mgr.x' 2024-05-08T06:31:04.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:03 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1896762566' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-08T06:31:04.879 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:04 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: ignoring --setuser ceph since I am not root 2024-05-08T06:31:04.879 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:04 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: ignoring --setgroup ceph since I am not root 2024-05-08T06:31:05.345 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:04 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:04.966+0000 7f16fc3a9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T06:31:05.345 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:05 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:05.214+0000 7f16fc3a9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:31:05.345 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:05 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:05.345+0000 7f16fc3a9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T06:31:05.865 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.366+0000 7fba1a000700 1 Processor -- start 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.366+0000 7fba1a000700 1 -- start start 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.366+0000 7fba1a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1407d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.366+0000 7fba1a000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba1407d810 con 0x7fba1407ee20 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.367+0000 7fba18c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1407d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.367+0000 7fba18c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1407d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46430/0 (socket says 172.21.15.70:46430) 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.367+0000 7fba18c00700 1 -- 172.21.15.70:0/422419864 learned_addr learned my addr 172.21.15.70:0/422419864 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.368+0000 7fba18c00700 1 -- 172.21.15.70:0/422419864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1407d990 con 0x7fba1407ee20 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.368+0000 7fba18c00700 1 --2- 172.21.15.70:0/422419864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1407d2d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fba080098a0 tx=0x7fba08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a5707396606159 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.368+0000 7fba13400700 1 -- 172.21.15.70:0/422419864 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08004160 con 0x7fba1407ee20 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.368+0000 7fba13400700 1 -- 172.21.15.70:0/422419864 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba08004300 con 0x7fba1407ee20 2024-05-08T06:31:05.866 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.368+0000 7fba13400700 1 -- 172.21.15.70:0/422419864 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08011960 con 0x7fba1407ee20 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.369+0000 7fba1a000700 1 -- 172.21.15.70:0/422419864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 msgr2=0x7fba1407d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.369+0000 7fba1a000700 1 --2- 172.21.15.70:0/422419864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1407d2d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fba080098a0 tx=0x7fba08009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.369+0000 7fba1a000700 1 -- 172.21.15.70:0/422419864 shutdown_connections 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.369+0000 7fba1a000700 1 --2- 172.21.15.70:0/422419864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1407d2d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.369+0000 7fba1a000700 1 -- 172.21.15.70:0/422419864 >> 172.21.15.70:0/422419864 conn(0x7fba141040a0 msgr2=0x7fba141064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.370+0000 7fba1a000700 1 -- 172.21.15.70:0/422419864 shutdown_connections 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.370+0000 7fba1a000700 1 -- 172.21.15.70:0/422419864 wait complete. 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.371+0000 7fba1a000700 1 Processor -- start 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.371+0000 7fba1a000700 1 -- start start 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.372+0000 7fba1a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.372+0000 7fba1a000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba1410f000 con 0x7fba1407ee20 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.372+0000 7fba18c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:05.867 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.372+0000 7fba18c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1419eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46434/0 (socket says 172.21.15.70:46434) 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.372+0000 7fba18c00700 1 -- 172.21.15.70:0/1896762566 learned_addr learned my addr 172.21.15.70:0/1896762566 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.372+0000 7fba18c00700 1 -- 172.21.15.70:0/1896762566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1419f030 con 0x7fba1407ee20 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.373+0000 7fba18c00700 1 --2- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1419eaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba08011670 tx=0x7fba08011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.373+0000 7fba11600700 1 -- 172.21.15.70:0/1896762566 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08003a60 con 0x7fba1407ee20 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.373+0000 7fba11600700 1 -- 172.21.15.70:0/1896762566 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba0801b8d0 con 0x7fba1407ee20 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.373+0000 7fba11600700 1 -- 172.21.15.70:0/1896762566 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba080237d0 con 0x7fba1407ee20 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.373+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1419f2c0 con 0x7fba1407ee20 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.373+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141a1fb0 con 0x7fba1407ee20 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.374+0000 7fba11600700 1 -- 172.21.15.70:0/1896762566 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fba0801b440 con 0x7fba1407ee20 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.375+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba14064b00 con 0x7fba1407ee20 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.375+0000 7fba11600700 1 --2- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fb9fc03e4c0 0x7fb9fc040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.375+0000 7fba11600700 1 -- 172.21.15.70:0/1896762566 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fba08053f50 con 0x7fba1407ee20 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.375+0000 7fba13e00700 1 --2- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fb9fc03e4c0 0x7fb9fc040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:05.868 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.376+0000 7fba13e00700 1 --2- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fb9fc03e4c0 0x7fb9fc040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba00006fd0 tx=0x7fba00006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.385+0000 7fba11600700 1 -- 172.21.15.70:0/1896762566 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fba0801f030 con 0x7fba1407ee20 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:03.705+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fba141a2560 con 0x7fba1407ee20 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.637+0000 7fba11600700 1 -- 172.21.15.70:0/1896762566 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fba0801a3d0 con 0x7fba1407ee20 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.640+0000 7fba11600700 1 -- 172.21.15.70:0/1896762566 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fba0800b3e0 con 0x7fba1407ee20 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.642+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fb9fc03e4c0 msgr2=0x7fb9fc040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.642+0000 7fba1a000700 1 --2- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fb9fc03e4c0 0x7fb9fc040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fba00006fd0 tx=0x7fba00006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.642+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 msgr2=0x7fba1419eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.642+0000 7fba1a000700 1 --2- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1419eaf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fba08011670 tx=0x7fba08011aa0 comp rx=0 tx=0).stop 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.642+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 shutdown_connections 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.642+0000 7fba1a000700 1 --2- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fb9fc03e4c0 0x7fb9fc040980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.642+0000 7fba1a000700 1 --2- 172.21.15.70:0/1896762566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba1407ee20 0x7fba1419eaf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.642+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 >> 172.21.15.70:0/1896762566 conn(0x7fba141040a0 msgr2=0x7fba14104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.643+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 shutdown_connections 2024-05-08T06:31:05.869 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:04.643+0000 7fba1a000700 1 -- 172.21.15.70:0/1896762566 wait complete. 2024-05-08T06:31:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:05 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1896762566' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-08T06:31:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:05 smithi070 ceph-mon[29591]: mgrmap e9: x(active, since 26s) 2024-05-08T06:31:06.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:05 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:05.740+0000 7f16fc3a9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T06:31:06.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:05 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:05.854+0000 7f16fc3a9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T06:31:07.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:07 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4141358755' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T06:31:07.829 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:07 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:07.414+0000 7f16fc3a9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T06:31:07.829 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:07 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:07.642+0000 7f16fc3a9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.801+0000 7fdbde400700 1 Processor -- start 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.801+0000 7fdbde400700 1 -- start start 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.801+0000 7fdbde400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd807d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.801+0000 7fdbde400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd807d810 con 0x7fdbd807ee20 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.802+0000 7fdbd7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd807d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:07.841 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.802+0000 7fdbd7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd807d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46446/0 (socket says 172.21.15.70:46446) 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.802+0000 7fdbd7400700 1 -- 172.21.15.70:0/3713008855 learned_addr learned my addr 172.21.15.70:0/3713008855 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.802+0000 7fdbd7400700 1 -- 172.21.15.70:0/3713008855 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd807d990 con 0x7fdbd807ee20 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.803+0000 7fdbd7400700 1 --2- 172.21.15.70:0/3713008855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd807d2d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80098a0 tx=0x7fdbc8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d46a5497d35450 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.803+0000 7fdbd6000700 1 -- 172.21.15.70:0/3713008855 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8004160 con 0x7fdbd807ee20 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.803+0000 7fdbd6000700 1 -- 172.21.15.70:0/3713008855 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbc8004300 con 0x7fdbd807ee20 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.803+0000 7fdbd6000700 1 -- 172.21.15.70:0/3713008855 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8011960 con 0x7fdbd807ee20 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.804+0000 7fdbde400700 1 -- 172.21.15.70:0/3713008855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 msgr2=0x7fdbd807d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.804+0000 7fdbde400700 1 --2- 172.21.15.70:0/3713008855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd807d2d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80098a0 tx=0x7fdbc8009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.804+0000 7fdbde400700 1 -- 172.21.15.70:0/3713008855 shutdown_connections 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.804+0000 7fdbde400700 1 --2- 172.21.15.70:0/3713008855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd807d2d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.804+0000 7fdbde400700 1 -- 172.21.15.70:0/3713008855 >> 172.21.15.70:0/3713008855 conn(0x7fdbd8104270 msgr2=0x7fdbd8106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.804+0000 7fdbde400700 1 -- 172.21.15.70:0/3713008855 shutdown_connections 2024-05-08T06:31:07.842 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.804+0000 7fdbde400700 1 -- 172.21.15.70:0/3713008855 wait complete. 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.805+0000 7fdbde400700 1 Processor -- start 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.805+0000 7fdbde400700 1 -- start start 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.806+0000 7fdbde400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd819ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.806+0000 7fdbde400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd810f1b0 con 0x7fdbd807ee20 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.806+0000 7fdbd7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd819ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.806+0000 7fdbd7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd819ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46456/0 (socket says 172.21.15.70:46456) 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.806+0000 7fdbd7400700 1 -- 172.21.15.70:0/4141358755 learned_addr learned my addr 172.21.15.70:0/4141358755 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.806+0000 7fdbd7400700 1 -- 172.21.15.70:0/4141358755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd819f1f0 con 0x7fdbd807ee20 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.807+0000 7fdbd7400700 1 --2- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd819ecb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8011670 tx=0x7fdbc8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.807+0000 7fdbcfe00700 1 -- 172.21.15.70:0/4141358755 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc8003a60 con 0x7fdbd807ee20 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.807+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd819f480 con 0x7fdbd807ee20 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.807+0000 7fdbcfe00700 1 -- 172.21.15.70:0/4141358755 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbc801b8d0 con 0x7fdbd807ee20 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.807+0000 7fdbcfe00700 1 -- 172.21.15.70:0/4141358755 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdbc80237d0 con 0x7fdbd807ee20 2024-05-08T06:31:07.843 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.807+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd81a2170 con 0x7fdbd807ee20 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.808+0000 7fdbcfe00700 1 -- 172.21.15.70:0/4141358755 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fdbc8023ad0 con 0x7fdbd807ee20 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.808+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd8064b00 con 0x7fdbd807ee20 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.809+0000 7fdbcfe00700 1 --2- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fdbbc03e4c0 0x7fdbbc040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.809+0000 7fdbcfe00700 1 -- 172.21.15.70:0/4141358755 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdbc8054190 con 0x7fdbd807ee20 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.809+0000 7fdbd6a00700 1 -- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fdbbc03e4c0 msgr2=0x7fdbbc040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1348548569 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.809+0000 7fdbd6a00700 1 --2- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fdbbc03e4c0 0x7fdbbc040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:06.815+0000 7fdbcfe00700 1 -- 172.21.15.70:0/4141358755 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdbc801f030 con 0x7fdbd807ee20 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.010+0000 7fdbd6a00700 1 -- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fdbbc03e4c0 msgr2=0x7fdbbc040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1348548569 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.010+0000 7fdbd6a00700 1 --2- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fdbbc03e4c0 0x7fdbbc040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.104+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fdbd81a2720 con 0x7fdbd807ee20 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.105+0000 7fdbcfe00700 1 -- 172.21.15.70:0/4141358755 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7fdbc800b3e0 con 0x7fdbd807ee20 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.108+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fdbbc03e4c0 msgr2=0x7fdbbc040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T06:31:07.844 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.108+0000 7fdbde400700 1 --2- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fdbbc03e4c0 0x7fdbbc040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.108+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 msgr2=0x7fdbd819ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.108+0000 7fdbde400700 1 --2- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd819ecb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8011670 tx=0x7fdbc8011aa0 comp rx=0 tx=0).stop 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.108+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 shutdown_connections 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.108+0000 7fdbde400700 1 --2- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7fdbbc03e4c0 0x7fdbbc040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.108+0000 7fdbde400700 1 --2- 172.21.15.70:0/4141358755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdbd807ee20 0x7fdbd819ecb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.108+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 >> 172.21.15.70:0/4141358755 conn(0x7fdbd8104270 msgr2=0x7fdbd8104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.109+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 shutdown_connections 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:07.109+0000 7fdbde400700 1 -- 172.21.15.70:0/4141358755 wait complete. 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-05-08T06:31:07.845 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 9... 2024-05-08T06:31:08.128 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:07 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:07.862+0000 7f16fc3a9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T06:31:08.453 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:08 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:08.253+0000 7f16fc3a9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T06:31:08.453 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:08 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:08.379+0000 7f16fc3a9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T06:31:08.878 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:08 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:08.634+0000 7f16fc3a9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T06:31:09.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:08 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:08.887+0000 7f16fc3a9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:31:09.961 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:09 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:09.669+0000 7f16fc3a9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T06:31:10.381 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:09 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:09.962+0000 7f16fc3a9200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T06:31:10.879 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:10 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:10.520+0000 7f16fc3a9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T06:31:10.879 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:10 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:10.647+0000 7f16fc3a9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T06:31:11.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:11 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:11.111+0000 7f16fc3a9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T06:31:11.878 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:11 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:11.562+0000 7f16fc3a9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T06:31:11.879 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:11 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:11.687+0000 7f16fc3a9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T06:31:12.319 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:12 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:12.011+0000 7f16fc3a9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T06:31:12.319 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:12 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:12.190+0000 7f16fc3a9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T06:31:13.128 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:12 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:12.319+0000 7f16fc3a9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T06:31:13.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:12 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:12.719+0000 7f16fc3a9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T06:31:13.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:12 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:12.847+0000 7f16fc3a9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T06:31:13.878 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:13 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:13.610+0000 7f16fc3a9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T06:31:14.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:31:13 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:31:13.899+0000 7f16fc3a9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T06:31:14.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: Active manager daemon x restarted 2024-05-08T06:31:14.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: Activating manager daemon x 2024-05-08T06:31:14.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: osdmap e3: 0 total, 0 up, 0 in 2024-05-08T06:31:14.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: mgrmap e10: x(active, starting, since 0.00990426s) 2024-05-08T06:31:14.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:31:14.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T06:31:14.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T06:31:14.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T06:31:14.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T06:31:14.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:13 smithi070 ceph-mon[29591]: Manager daemon x is now available 2024-05-08T06:31:15.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:31:15.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T06:31:15.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T06:31:15.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:14 smithi070 ceph-mon[29591]: [08/May/2024:06:31:14] ENGINE Bus STARTING 2024-05-08T06:31:15.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:14 smithi070 ceph-mon[29591]: [08/May/2024:06:31:14] ENGINE Serving on http://172.21.15.70:8765 2024-05-08T06:31:15.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:14 smithi070 ceph-mon[29591]: mgrmap e11: x(active, since 1.01016s) 2024-05-08T06:31:16.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:15 smithi070 ceph-mon[29591]: [08/May/2024:06:31:14] ENGINE Serving on https://172.21.15.70:7150 2024-05-08T06:31:16.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:15 smithi070 ceph-mon[29591]: [08/May/2024:06:31:14] ENGINE Bus STARTED 2024-05-08T06:31:16.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:15 smithi070 ceph-mon[29591]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T06:31:16.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:15 smithi070 ceph-mon[29591]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T06:31:16.328 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-05-08T06:31:16.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-08T06:31:16.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T06:31:16.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-05-08T06:31:16.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.454+0000 7f4011600700 1 Processor -- start 2024-05-08T06:31:16.329 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.454+0000 7f4011600700 1 -- start start 2024-05-08T06:31:16.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.455+0000 7f4011600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c10bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:16.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.455+0000 7f4011600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f400c07cdc0 con 0x7f400c1097e0 2024-05-08T06:31:16.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.455+0000 7f400aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c10bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:16.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.455+0000 7f400aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c10bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55382/0 (socket says 172.21.15.70:55382) 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.455+0000 7f400aa00700 1 -- 172.21.15.70:0/178874769 learned_addr learned my addr 172.21.15.70:0/178874769 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.456+0000 7f400aa00700 1 -- 172.21.15.70:0/178874769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400c10c110 con 0x7f400c1097e0 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.456+0000 7f400aa00700 1 --2- 172.21.15.70:0/178874769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c10bbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0098a0 tx=0x7f3ffc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355ff9268a3d72ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.456+0000 7f4009600700 1 -- 172.21.15.70:0/178874769 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc004160 con 0x7f400c1097e0 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.456+0000 7f4009600700 1 -- 172.21.15.70:0/178874769 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ffc004300 con 0x7f400c1097e0 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.456+0000 7f4009600700 1 -- 172.21.15.70:0/178874769 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc011960 con 0x7f400c1097e0 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.457+0000 7f4011600700 1 -- 172.21.15.70:0/178874769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 msgr2=0x7f400c10bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.457+0000 7f4011600700 1 --2- 172.21.15.70:0/178874769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c10bbd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0098a0 tx=0x7f3ffc009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.457+0000 7f4011600700 1 -- 172.21.15.70:0/178874769 shutdown_connections 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.457+0000 7f4011600700 1 --2- 172.21.15.70:0/178874769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c10bbd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.457+0000 7f4011600700 1 -- 172.21.15.70:0/178874769 >> 172.21.15.70:0/178874769 conn(0x7f400c103130 msgr2=0x7f400c105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.457+0000 7f4011600700 1 -- 172.21.15.70:0/178874769 shutdown_connections 2024-05-08T06:31:16.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.457+0000 7f4011600700 1 -- 172.21.15.70:0/178874769 wait complete. 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.458+0000 7f4011600700 1 Processor -- start 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.458+0000 7f4011600700 1 -- start start 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.459+0000 7f4011600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c109060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.459+0000 7f4011600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f400c10cff0 con 0x7f400c1097e0 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.459+0000 7f400aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c109060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.459+0000 7f400aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c109060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55398/0 (socket says 172.21.15.70:55398) 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.459+0000 7f400aa00700 1 -- 172.21.15.70:0/3666188005 learned_addr learned my addr 172.21.15.70:0/3666188005 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.459+0000 7f400aa00700 1 -- 172.21.15.70:0/3666188005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f400c1095a0 con 0x7f400c1097e0 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.460+0000 7f400aa00700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c109060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc011670 tx=0x7f3ffc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.460+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc003a60 con 0x7f400c1097e0 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.460+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ffc01b8d0 con 0x7f400c1097e0 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.460+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc023790 con 0x7f400c1097e0 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.460+0000 7f4011600700 1 -- 172.21.15.70:0/3666188005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f400c107790 con 0x7f400c1097e0 2024-05-08T06:31:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.460+0000 7f4011600700 1 -- 172.21.15.70:0/3666188005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f400c107cd0 con 0x7f400c1097e0 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.461+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f3ffc01b440 con 0x7f400c1097e0 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.462+0000 7f4003400700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 0x7f3ff00409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.462+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 --> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3ff00410f0 con 0x7f3ff003e520 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.462+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3ffc053f30 con 0x7f400c1097e0 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.462+0000 7f400a000700 1 -- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 msgr2=0x7f3ff00409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1348548569 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.462+0000 7f400a000700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 0x7f3ff00409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.663+0000 7f400a000700 1 -- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 msgr2=0x7f3ff00409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1348548569 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:08.663+0000 7f400a000700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 0x7f3ff00409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:09.064+0000 7f400a000700 1 -- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 msgr2=0x7f3ff00409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1348548569 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:09.064+0000 7f400a000700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 0x7f3ff00409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:09.865+0000 7f400a000700 1 -- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 msgr2=0x7f3ff00409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1348548569 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:09.865+0000 7f400a000700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 0x7f3ff00409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T06:31:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:11.466+0000 7f400a000700 1 -- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 msgr2=0x7f3ff00409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1348548569 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:11.466+0000 7f400a000700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 0x7f3ff00409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:13.909+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f3ffc023a40 con 0x7f400c1097e0 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:13.909+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 msgr2=0x7f3ff00409e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:13.909+0000 7f4003400700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 0x7f3ff00409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.911+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f3ffc055bb0 con 0x7f400c1097e0 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.911+0000 7f4003400700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3ff0041fa0 0x7f3ff0044390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.911+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3ffc02de50 con 0x7f3ff0041fa0 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.912+0000 7f400a000700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3ff0041fa0 0x7f3ff0044390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.913+0000 7f400a000700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3ff0041fa0 0x7f3ff0044390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8003a10 tx=0x7f3ff8009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.914+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f3ffc02de50 con 0x7f3ff0041fa0 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.924+0000 7f4011600700 1 -- 172.21.15.70:0/3666188005 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f400c064b00 con 0x7f3ff0041fa0 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4003400700 1 -- 172.21.15.70:0/3666188005 <== mgr.14152 v2:172.21.15.70:6800/3718531938 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f400c064b00 con 0x7f3ff0041fa0 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4011600700 1 -- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3ff0041fa0 msgr2=0x7f3ff0044390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:16.341 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4011600700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3ff0041fa0 0x7f3ff0044390 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8003a10 tx=0x7f3ff8009270 comp rx=0 tx=0).stop 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4011600700 1 -- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 msgr2=0x7f400c109060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4011600700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c109060 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc011670 tx=0x7f3ffc011a30 comp rx=0 tx=0).stop 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4011600700 1 -- 172.21.15.70:0/3666188005 shutdown_connections 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4011600700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3ff0041fa0 0x7f3ff0044390 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4011600700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f400c1097e0 0x7f400c109060 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4011600700 1 --2- 172.21.15.70:0/3666188005 >> [v2:172.21.15.70:6800/1348548569,v1:172.21.15.70:6801/1348548569] conn(0x7f3ff003e520 0x7f3ff00409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.925+0000 7f4011600700 1 -- 172.21.15.70:0/3666188005 >> 172.21.15.70:0/3666188005 conn(0x7f400c103130 msgr2=0x7f400c103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.926+0000 7f4011600700 1 -- 172.21.15.70:0/3666188005 shutdown_connections 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:14.926+0000 7f4011600700 1 -- 172.21.15.70:0/3666188005 wait complete. 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 9 is available 2024-05-08T06:31:16.342 INFO:teuthology.orchestra.run.smithi070.stdout:Generating a dashboard self-signed certificate... 2024-05-08T06:31:17.277 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:16 smithi070 ceph-mon[29591]: mgrmap e12: x(active, since 2s) 2024-05-08T06:31:17.277 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:18.124 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-08T06:31:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.997+0000 7f2f8e400700 1 Processor -- start 2024-05-08T06:31:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.997+0000 7f2f8e400700 1 -- start start 2024-05-08T06:31:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.998+0000 7f2f8e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8807d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.998+0000 7f2f8e400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8807d8a0 con 0x7f2f8807ee70 2024-05-08T06:31:18.125 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.998+0000 7f2f8d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8807d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.998+0000 7f2f8d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8807d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55476/0 (socket says 172.21.15.70:55476) 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.998+0000 7f2f8d000700 1 -- 172.21.15.70:0/101891046 learned_addr learned my addr 172.21.15.70:0/101891046 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.999+0000 7f2f8d000700 1 -- 172.21.15.70:0/101891046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8807da20 con 0x7f2f8807ee70 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.999+0000 7f2f8d000700 1 --2- 172.21.15.70:0/101891046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8807d2d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0098a0 tx=0x7f2f7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b39517a938a52 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.999+0000 7f2f87400700 1 -- 172.21.15.70:0/101891046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f7c004160 con 0x7f2f8807ee70 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:16.999+0000 7f2f87400700 1 -- 172.21.15.70:0/101891046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f7c004300 con 0x7f2f8807ee70 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.000+0000 7f2f87400700 1 -- 172.21.15.70:0/101891046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f7c011960 con 0x7f2f8807ee70 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.000+0000 7f2f8e400700 1 -- 172.21.15.70:0/101891046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 msgr2=0x7f2f8807d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.000+0000 7f2f8e400700 1 --2- 172.21.15.70:0/101891046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8807d2d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0098a0 tx=0x7f2f7c009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.000+0000 7f2f8e400700 1 -- 172.21.15.70:0/101891046 shutdown_connections 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.000+0000 7f2f8e400700 1 --2- 172.21.15.70:0/101891046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8807d2d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:18.126 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.000+0000 7f2f8e400700 1 -- 172.21.15.70:0/101891046 >> 172.21.15.70:0/101891046 conn(0x7f2f88104040 msgr2=0x7f2f88106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.001+0000 7f2f8e400700 1 -- 172.21.15.70:0/101891046 shutdown_connections 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.001+0000 7f2f8e400700 1 -- 172.21.15.70:0/101891046 wait complete. 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.002+0000 7f2f8e400700 1 Processor -- start 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.002+0000 7f2f8e400700 1 -- start start 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.002+0000 7f2f8e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8819eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.002+0000 7f2f8e400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8810f060 con 0x7f2f8807ee70 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.003+0000 7f2f8d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8819eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.003+0000 7f2f8d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8819eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55490/0 (socket says 172.21.15.70:55490) 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.003+0000 7f2f8d000700 1 -- 172.21.15.70:0/2283085311 learned_addr learned my addr 172.21.15.70:0/2283085311 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.003+0000 7f2f8d000700 1 -- 172.21.15.70:0/2283085311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8819eff0 con 0x7f2f8807ee70 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.003+0000 7f2f8d000700 1 --2- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8819eab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c003e50 tx=0x7f2f7c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.004+0000 7f2f85600700 1 -- 172.21.15.70:0/2283085311 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f7c003a60 con 0x7f2f8807ee70 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.004+0000 7f2f85600700 1 -- 172.21.15.70:0/2283085311 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f7c01b8d0 con 0x7f2f8807ee70 2024-05-08T06:31:18.127 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.004+0000 7f2f85600700 1 -- 172.21.15.70:0/2283085311 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f7c0237d0 con 0x7f2f8807ee70 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.004+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8819f280 con 0x7f2f8807ee70 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.004+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f881a1f70 con 0x7f2f8807ee70 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.005+0000 7f2f85600700 1 -- 172.21.15.70:0/2283085311 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f2f7c01b440 con 0x7f2f8807ee70 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.006+0000 7f2f85600700 1 --2- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2f7003e4d0 0x7f2f70040990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.006+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f88064b00 con 0x7f2f8807ee70 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.006+0000 7f2f85600700 1 -- 172.21.15.70:0/2283085311 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2f7c054120 con 0x7f2f8807ee70 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.006+0000 7f2f87e00700 1 --2- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2f7003e4d0 0x7f2f70040990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.007+0000 7f2f87e00700 1 --2- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2f7003e4d0 0x7f2f70040990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2f74006fd0 tx=0x7f2f74006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.012+0000 7f2f85600700 1 -- 172.21.15.70:0/2283085311 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2f7c01f030 con 0x7f2f8807ee70 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.276+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f2f881051d0 con 0x7f2f7003e4d0 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.358+0000 7f2f85600700 1 -- 172.21.15.70:0/2283085311 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f2f881051d0 con 0x7f2f7003e4d0 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2f7003e4d0 msgr2=0x7f2f70040990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 --2- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2f7003e4d0 0x7f2f70040990 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2f74006fd0 tx=0x7f2f74006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 msgr2=0x7f2f8819eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:18.128 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 --2- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8819eab0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c003e50 tx=0x7f2f7c011a30 comp rx=0 tx=0).stop 2024-05-08T06:31:18.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 shutdown_connections 2024-05-08T06:31:18.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 --2- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2f7003e4d0 0x7f2f70040990 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:18.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 --2- 172.21.15.70:0/2283085311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f8807ee70 0x7f2f8819eab0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:18.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 >> 172.21.15.70:0/2283085311 conn(0x7f2f88104040 msgr2=0x7f2f88104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:18.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 shutdown_connections 2024-05-08T06:31:18.129 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:17.361+0000 7f2f8e400700 1 -- 172.21.15.70:0/2283085311 wait complete. 2024-05-08T06:31:18.129 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial admin user... 2024-05-08T06:31:18.565 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:18 smithi070 ceph-mon[29591]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:31:18.566 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:18.566 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:18.566 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:20.498 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:20 smithi070 ceph-mon[29591]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:31:20.498 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:20 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:20.499 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$bLs/ftXE6ix2RFUvLKSGgOjLN6YkJO2x0UvZ4znTDo3nfAixtFVVy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715149879, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-08T06:31:20.500 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.731+0000 7f1801e00700 1 Processor -- start 2024-05-08T06:31:20.500 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.731+0000 7f1801e00700 1 -- start start 2024-05-08T06:31:20.500 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.731+0000 7f1801e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc108f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:20.500 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.731+0000 7f1801e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc1094f0 con 0x7f17fc108b00 2024-05-08T06:31:20.500 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.732+0000 7f1800a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:20.503 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.732+0000 7f1800a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57474/0 (socket says 172.21.15.70:57474) 2024-05-08T06:31:20.503 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.732+0000 7f1800a00700 1 -- 172.21.15.70:0/346523870 learned_addr learned my addr 172.21.15.70:0/346523870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:20.503 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.733+0000 7f1800a00700 1 -- 172.21.15.70:0/346523870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc109cb0 con 0x7f17fc108b00 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.733+0000 7f1800a00700 1 --2- 172.21.15.70:0/346523870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc108f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17f00098a0 tx=0x7f17f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4745711122efb19e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.733+0000 7f17fb400700 1 -- 172.21.15.70:0/346523870 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f0004160 con 0x7f17fc108b00 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.733+0000 7f17fb400700 1 -- 172.21.15.70:0/346523870 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17f0004300 con 0x7f17fc108b00 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.733+0000 7f17fb400700 1 -- 172.21.15.70:0/346523870 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f0011960 con 0x7f17fc108b00 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.734+0000 7f1801e00700 1 -- 172.21.15.70:0/346523870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 msgr2=0x7f17fc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.734+0000 7f1801e00700 1 --2- 172.21.15.70:0/346523870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc108f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f17f00098a0 tx=0x7f17f0009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.734+0000 7f1801e00700 1 -- 172.21.15.70:0/346523870 shutdown_connections 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.734+0000 7f1801e00700 1 --2- 172.21.15.70:0/346523870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc108f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.734+0000 7f1801e00700 1 -- 172.21.15.70:0/346523870 >> 172.21.15.70:0/346523870 conn(0x7f17fc1040a0 msgr2=0x7f17fc1064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.734+0000 7f1801e00700 1 -- 172.21.15.70:0/346523870 shutdown_connections 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.734+0000 7f1801e00700 1 -- 172.21.15.70:0/346523870 wait complete. 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.735+0000 7f1801e00700 1 Processor -- start 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.736+0000 7f1801e00700 1 -- start start 2024-05-08T06:31:20.504 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.736+0000 7f1801e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:20.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.736+0000 7f1801e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f17fc10cee0 con 0x7f17fc108b00 2024-05-08T06:31:20.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.736+0000 7f1800a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:20.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.736+0000 7f1800a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc19eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57490/0 (socket says 172.21.15.70:57490) 2024-05-08T06:31:20.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.736+0000 7f1800a00700 1 -- 172.21.15.70:0/3616393579 learned_addr learned my addr 172.21.15.70:0/3616393579 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:20.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.737+0000 7f1800a00700 1 -- 172.21.15.70:0/3616393579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc19f090 con 0x7f17fc108b00 2024-05-08T06:31:20.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.737+0000 7f1800a00700 1 --2- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc19eb50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17f0011670 tx=0x7f17f0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:20.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.737+0000 7f17f9600700 1 -- 172.21.15.70:0/3616393579 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f0003a60 con 0x7f17fc108b00 2024-05-08T06:31:20.505 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.737+0000 7f17f9600700 1 -- 172.21.15.70:0/3616393579 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17f001b8d0 con 0x7f17fc108b00 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.737+0000 7f17f9600700 1 -- 172.21.15.70:0/3616393579 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f17f0023790 con 0x7f17fc108b00 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.737+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc19f320 con 0x7f17fc108b00 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.737+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17fc1a2010 con 0x7f17fc108b00 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.738+0000 7f17f9600700 1 -- 172.21.15.70:0/3616393579 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f17f001b440 con 0x7f17fc108b00 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.738+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17fc10d060 con 0x7f17fc108b00 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.739+0000 7f17f9600700 1 --2- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f17e403e4c0 0x7f17e4040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.739+0000 7f17f9600700 1 -- 172.21.15.70:0/3616393579 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f17f0054020 con 0x7f17fc108b00 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.739+0000 7f17fbe00700 1 --2- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f17e403e4c0 0x7f17e4040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.740+0000 7f17fbe00700 1 --2- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f17e403e4c0 0x7f17e4040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17e8006fd0 tx=0x7f17e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:18.745+0000 7f17f9600700 1 -- 172.21.15.70:0/3616393579 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f17f001f030 con 0x7f17fc108b00 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.006+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f17fc1a22a0 con 0x7f17e403e4c0 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.246+0000 7f17f9600700 1 -- 172.21.15.70:0/3616393579 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f17fc1a22a0 con 0x7f17e403e4c0 2024-05-08T06:31:20.508 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f17e403e4c0 msgr2=0x7f17e4040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 --2- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f17e403e4c0 0x7f17e4040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17e8006fd0 tx=0x7f17e8006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 msgr2=0x7f17fc19eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 --2- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc19eb50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f17f0011670 tx=0x7f17f0011a30 comp rx=0 tx=0).stop 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 shutdown_connections 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 --2- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f17e403e4c0 0x7f17e4040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 --2- 172.21.15.70:0/3616393579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17fc108b00 0x7f17fc19eb50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 >> 172.21.15.70:0/3616393579 conn(0x7f17fc1040a0 msgr2=0x7f17fc104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 shutdown_connections 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:19.250+0000 7f1801e00700 1 -- 172.21.15.70:0/3616393579 wait complete. 2024-05-08T06:31:20.509 INFO:teuthology.orchestra.run.smithi070.stdout:Fetching dashboard port number... 2024-05-08T06:31:21.509 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:21 smithi070 ceph-mon[29591]: mgrmap e13: x(active, since 6s) 2024-05-08T06:31:22.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4103850208' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-08T06:31:22.557 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 8443 2024-05-08T06:31:22.557 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.591+0000 7f34f1400700 1 Processor -- start 2024-05-08T06:31:22.557 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.591+0000 7f34f1400700 1 -- start start 2024-05-08T06:31:22.558 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.592+0000 7f34f1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec10b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:22.558 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.592+0000 7f34f1400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec10b690 con 0x7f34ec10aca0 2024-05-08T06:31:22.558 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.592+0000 7f34ebe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec10b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:22.558 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.592+0000 7f34ebe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec10b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57504/0 (socket says 172.21.15.70:57504) 2024-05-08T06:31:22.558 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.592+0000 7f34ebe00700 1 -- 172.21.15.70:0/4254881102 learned_addr learned my addr 172.21.15.70:0/4254881102 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:22.558 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.593+0000 7f34ebe00700 1 -- 172.21.15.70:0/4254881102 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec10bea0 con 0x7f34ec10aca0 2024-05-08T06:31:22.559 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.593+0000 7f34ebe00700 1 --2- 172.21.15.70:0/4254881102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec10b0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0098a0 tx=0x7f34dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14394212a55ce73e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:22.559 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.593+0000 7f34eaa00700 1 -- 172.21.15.70:0/4254881102 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc004160 con 0x7f34ec10aca0 2024-05-08T06:31:22.563 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.593+0000 7f34eaa00700 1 -- 172.21.15.70:0/4254881102 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34dc004300 con 0x7f34ec10aca0 2024-05-08T06:31:22.563 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.593+0000 7f34eaa00700 1 -- 172.21.15.70:0/4254881102 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc011960 con 0x7f34ec10aca0 2024-05-08T06:31:22.563 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.594+0000 7f34f1400700 1 -- 172.21.15.70:0/4254881102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 msgr2=0x7f34ec10b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:22.563 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.594+0000 7f34f1400700 1 --2- 172.21.15.70:0/4254881102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec10b0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0098a0 tx=0x7f34dc009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:22.563 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.594+0000 7f34f1400700 1 -- 172.21.15.70:0/4254881102 shutdown_connections 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.594+0000 7f34f1400700 1 --2- 172.21.15.70:0/4254881102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec10b0c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.594+0000 7f34f1400700 1 -- 172.21.15.70:0/4254881102 >> 172.21.15.70:0/4254881102 conn(0x7f34ec07e070 msgr2=0x7f34ec07e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.594+0000 7f34f1400700 1 -- 172.21.15.70:0/4254881102 shutdown_connections 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.594+0000 7f34f1400700 1 -- 172.21.15.70:0/4254881102 wait complete. 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.595+0000 7f34f1400700 1 Processor -- start 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.595+0000 7f34f1400700 1 -- start start 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.596+0000 7f34f1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.596+0000 7f34f1400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34ec10f0d0 con 0x7f34ec10aca0 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.596+0000 7f34ebe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.596+0000 7f34ebe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec19eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57520/0 (socket says 172.21.15.70:57520) 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.596+0000 7f34ebe00700 1 -- 172.21.15.70:0/4103850208 learned_addr learned my addr 172.21.15.70:0/4103850208 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.596+0000 7f34ebe00700 1 -- 172.21.15.70:0/4103850208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34ec19f050 con 0x7f34ec10aca0 2024-05-08T06:31:22.564 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.596+0000 7f34ebe00700 1 --2- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec19eb10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34dc011670 tx=0x7f34dc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.597+0000 7f34e8c00700 1 -- 172.21.15.70:0/4103850208 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc003a60 con 0x7f34ec10aca0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.597+0000 7f34e8c00700 1 -- 172.21.15.70:0/4103850208 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34dc01b8d0 con 0x7f34ec10aca0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.597+0000 7f34e8c00700 1 -- 172.21.15.70:0/4103850208 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34dc023790 con 0x7f34ec10aca0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.597+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34ec19f2e0 con 0x7f34ec10aca0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.597+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34ec1a1fd0 con 0x7f34ec10aca0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.598+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34ec10f250 con 0x7f34ec10aca0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.598+0000 7f34e8c00700 1 -- 172.21.15.70:0/4103850208 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f34dc01b440 con 0x7f34ec10aca0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.599+0000 7f34e8c00700 1 --2- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f34d003e5c0 0x7f34d0040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.599+0000 7f34e8c00700 1 -- 172.21.15.70:0/4103850208 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f34dc054150 con 0x7f34ec10aca0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.599+0000 7f34eb400700 1 --2- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f34d003e5c0 0x7f34d0040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.600+0000 7f34eb400700 1 --2- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f34d003e5c0 0x7f34d0040a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34d8006fd0 tx=0x7f34d8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.604+0000 7f34e8c00700 1 -- 172.21.15.70:0/4103850208 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f34dc01f030 con 0x7f34ec10aca0 2024-05-08T06:31:22.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.836+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f34ec1a21a0 con 0x7f34ec10aca0 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.837+0000 7f34e8c00700 1 -- 172.21.15.70:0/4103850208 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f34dc0202b0 con 0x7f34ec10aca0 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.840+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f34d003e5c0 msgr2=0x7f34d0040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.840+0000 7f34f1400700 1 --2- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f34d003e5c0 0x7f34d0040a80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f34d8006fd0 tx=0x7f34d8006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.840+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 msgr2=0x7f34ec19eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.840+0000 7f34f1400700 1 --2- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec19eb10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f34dc011670 tx=0x7f34dc011a30 comp rx=0 tx=0).stop 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.840+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 shutdown_connections 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.840+0000 7f34f1400700 1 --2- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f34d003e5c0 0x7f34d0040a80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.840+0000 7f34f1400700 1 --2- 172.21.15.70:0/4103850208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34ec10aca0 0x7f34ec19eb10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.840+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 >> 172.21.15.70:0/4103850208 conn(0x7f34ec07e070 msgr2=0x7f34ec108410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:22.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.841+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 shutdown_connections 2024-05-08T06:31:22.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:21.841+0000 7f34f1400700 1 -- 172.21.15.70:0/4103850208 wait complete. 2024-05-08T06:31:22.600 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T06:31:22.600 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-05-08T06:31:22.623 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T06:31:22.623 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-05-08T06:31:22.623 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-05-08T06:31:22.623 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-08T06:31:22.630 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph Dashboard is now available at: 2024-05-08T06:31:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: URL: https://smithi070.front.sepia.ceph.com:8443/ 2024-05-08T06:31:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: User: admin 2024-05-08T06:31:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: Password: vcvclf57ck 2024-05-08T06:31:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:22.631 INFO:teuthology.orchestra.run.smithi070.stdout:Saving cluster configuration to /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config directory 2024-05-08T06:31:22.634 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling autotune for osd_memory_target 2024-05-08T06:31:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.240+0000 7f4488c00700 1 Processor -- start 2024-05-08T06:31:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.240+0000 7f4488c00700 1 -- start start 2024-05-08T06:31:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.240+0000 7f4488c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f4484111cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.240+0000 7f4488c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44841122a0 con 0x7f4484083280 2024-05-08T06:31:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.241+0000 7f4483400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f4484111cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.241+0000 7f4483400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f4484111cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57534/0 (socket says 172.21.15.70:57534) 2024-05-08T06:31:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.241+0000 7f4483400700 1 -- 172.21.15.70:0/1133478496 learned_addr learned my addr 172.21.15.70:0/1133478496 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.241+0000 7f4483400700 1 -- 172.21.15.70:0/1133478496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4484112420 con 0x7f4484083280 2024-05-08T06:31:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.242+0000 7f4483400700 1 --2- 172.21.15.70:0/1133478496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f4484111cd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f44740098a0 tx=0x7f4474009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1a2370b3b1829b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.242+0000 7f4482000700 1 -- 172.21.15.70:0/1133478496 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4474004160 con 0x7f4484083280 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.242+0000 7f4482000700 1 -- 172.21.15.70:0/1133478496 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4474004300 con 0x7f4484083280 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.242+0000 7f4482000700 1 -- 172.21.15.70:0/1133478496 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4474011960 con 0x7f4484083280 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.243+0000 7f4488c00700 1 -- 172.21.15.70:0/1133478496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 msgr2=0x7f4484111cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.243+0000 7f4488c00700 1 --2- 172.21.15.70:0/1133478496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f4484111cd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f44740098a0 tx=0x7f4474009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.243+0000 7f4488c00700 1 -- 172.21.15.70:0/1133478496 shutdown_connections 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.243+0000 7f4488c00700 1 --2- 172.21.15.70:0/1133478496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f4484111cd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.243+0000 7f4488c00700 1 -- 172.21.15.70:0/1133478496 >> 172.21.15.70:0/1133478496 conn(0x7f448407e070 msgr2=0x7f44840804b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.243+0000 7f4488c00700 1 -- 172.21.15.70:0/1133478496 shutdown_connections 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.243+0000 7f4488c00700 1 -- 172.21.15.70:0/1133478496 wait complete. 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.244+0000 7f4488c00700 1 Processor -- start 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.244+0000 7f4488c00700 1 -- start start 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.244+0000 7f4488c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f44841a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:24.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.244+0000 7f4488c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4484113430 con 0x7f4484083280 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.245+0000 7f4483400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f44841a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.245+0000 7f4483400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f44841a2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57542/0 (socket says 172.21.15.70:57542) 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.245+0000 7f4483400700 1 -- 172.21.15.70:0/3516697210 learned_addr learned my addr 172.21.15.70:0/3516697210 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.245+0000 7f4483400700 1 -- 172.21.15.70:0/3516697210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44841a33f0 con 0x7f4484083280 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.245+0000 7f4483400700 1 --2- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f44841a2eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4474011670 tx=0x7f4474011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.246+0000 7f447be00700 1 -- 172.21.15.70:0/3516697210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4474003a60 con 0x7f4484083280 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.246+0000 7f447be00700 1 -- 172.21.15.70:0/3516697210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f447401b8d0 con 0x7f4484083280 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.246+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44841a3680 con 0x7f4484083280 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.246+0000 7f447be00700 1 -- 172.21.15.70:0/3516697210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4474023790 con 0x7f4484083280 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.246+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44841a6370 con 0x7f4484083280 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.247+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4484064b00 con 0x7f4484083280 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.247+0000 7f447be00700 1 -- 172.21.15.70:0/3516697210 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f447401b440 con 0x7f4484083280 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.248+0000 7f447be00700 1 --2- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446803e5c0 0x7f4468040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:24.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.248+0000 7f447be00700 1 -- 172.21.15.70:0/3516697210 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f44740540d0 con 0x7f4484083280 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.248+0000 7f4482a00700 1 --2- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446803e5c0 0x7f4468040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.249+0000 7f4482a00700 1 --2- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446803e5c0 0x7f4468040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4470006fd0 tx=0x7f4470006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.253+0000 7f447be00700 1 -- 172.21.15.70:0/3516697210 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f447401f030 con 0x7f4484083280 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.486+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f44841a6990 con 0x7f4484083280 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.487+0000 7f447be00700 1 -- 172.21.15.70:0/3516697210 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f44740239f0 con 0x7f4484083280 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446803e5c0 msgr2=0x7f4468040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 --2- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446803e5c0 0x7f4468040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4470006fd0 tx=0x7f4470006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 msgr2=0x7f44841a2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 --2- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f44841a2eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4474011670 tx=0x7f4474011a30 comp rx=0 tx=0).stop 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 shutdown_connections 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 --2- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446803e5c0 0x7f4468040a80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 --2- 172.21.15.70:0/3516697210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4484083280 0x7f44841a2eb0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4474011670 tx=0x7f4474011a30 comp rx=0 tx=0).stop 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 >> 172.21.15.70:0/3516697210 conn(0x7f448407e070 msgr2=0x7f448407eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:24.238 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 shutdown_connections 2024-05-08T06:31:24.239 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:23.490+0000 7f4488c00700 1 -- 172.21.15.70:0/3516697210 wait complete. 2024-05-08T06:31:26.015 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.904+0000 7f6d09a00700 1 Processor -- start 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.904+0000 7f6d09a00700 1 -- start start 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.904+0000 7f6d09a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0407d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.905+0000 7f6d09a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0407d8c0 con 0x7f6d0407ee40 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.905+0000 7f6d02a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0407d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.905+0000 7f6d02a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0407d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57546/0 (socket says 172.21.15.70:57546) 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.905+0000 7f6d02a00700 1 -- 172.21.15.70:0/832878554 learned_addr learned my addr 172.21.15.70:0/832878554 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.905+0000 7f6d02a00700 1 -- 172.21.15.70:0/832878554 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0407da40 con 0x7f6d0407ee40 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.906+0000 7f6d02a00700 1 --2- 172.21.15.70:0/832878554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0407d2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40098a0 tx=0x7f6cf4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e18b28d3694075 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.906+0000 7f6d01600700 1 -- 172.21.15.70:0/832878554 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4004160 con 0x7f6d0407ee40 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.906+0000 7f6d01600700 1 -- 172.21.15.70:0/832878554 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cf4004300 con 0x7f6d0407ee40 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.906+0000 7f6d01600700 1 -- 172.21.15.70:0/832878554 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4011960 con 0x7f6d0407ee40 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.907+0000 7f6d09a00700 1 -- 172.21.15.70:0/832878554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 msgr2=0x7f6d0407d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:26.016 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.907+0000 7f6d09a00700 1 --2- 172.21.15.70:0/832878554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0407d2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6cf40098a0 tx=0x7f6cf4009bb0 comp rx=0 tx=0).stop 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.907+0000 7f6d09a00700 1 -- 172.21.15.70:0/832878554 shutdown_connections 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.907+0000 7f6d09a00700 1 --2- 172.21.15.70:0/832878554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0407d2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.907+0000 7f6d09a00700 1 -- 172.21.15.70:0/832878554 >> 172.21.15.70:0/832878554 conn(0x7f6d04104270 msgr2=0x7f6d04106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.907+0000 7f6d09a00700 1 -- 172.21.15.70:0/832878554 shutdown_connections 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.907+0000 7f6d09a00700 1 -- 172.21.15.70:0/832878554 wait complete. 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.908+0000 7f6d09a00700 1 Processor -- start 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.908+0000 7f6d09a00700 1 -- start start 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.908+0000 7f6d09a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0419ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.909+0000 7f6d09a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0410f1f0 con 0x7f6d0407ee40 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.909+0000 7f6d02a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0419ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.909+0000 7f6d02a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0419ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57552/0 (socket says 172.21.15.70:57552) 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.909+0000 7f6d02a00700 1 -- 172.21.15.70:0/1215537752 learned_addr learned my addr 172.21.15.70:0/1215537752 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.909+0000 7f6d02a00700 1 -- 172.21.15.70:0/1215537752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0419f200 con 0x7f6d0407ee40 2024-05-08T06:31:26.017 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.909+0000 7f6d02a00700 1 --2- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0419ecc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4011670 tx=0x7f6cf4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.910+0000 7f6cfb400700 1 -- 172.21.15.70:0/1215537752 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4003a60 con 0x7f6d0407ee40 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.910+0000 7f6cfb400700 1 -- 172.21.15.70:0/1215537752 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cf401b8d0 con 0x7f6d0407ee40 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.910+0000 7f6cfb400700 1 -- 172.21.15.70:0/1215537752 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6cf4023790 con 0x7f6d0407ee40 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.910+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0419f490 con 0x7f6d0407ee40 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.910+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d041a2180 con 0x7f6d0407ee40 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.911+0000 7f6cfb400700 1 -- 172.21.15.70:0/1215537752 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f6cf401b440 con 0x7f6d0407ee40 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.911+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d04064b00 con 0x7f6d0407ee40 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.912+0000 7f6cfb400700 1 --2- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6ce803e5c0 0x7f6ce8040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.912+0000 7f6cfb400700 1 -- 172.21.15.70:0/1215537752 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6cf40540d0 con 0x7f6d0407ee40 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.912+0000 7f6d02000700 1 --2- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6ce803e5c0 0x7f6ce8040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.913+0000 7f6d02000700 1 --2- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6ce803e5c0 0x7f6ce8040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0006fd0 tx=0x7f6cf0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:24.917+0000 7f6cfb400700 1 -- 172.21.15.70:0/1215537752 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6cf401f030 con 0x7f6d0407ee40 2024-05-08T06:31:26.018 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.264+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f6d041a2730 con 0x7f6d0407ee40 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.270+0000 7f6cfb400700 1 -- 172.21.15.70:0/1215537752 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f6cf40239f0 con 0x7f6d0407ee40 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6ce803e5c0 msgr2=0x7f6ce8040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 --2- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6ce803e5c0 0x7f6ce8040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0006fd0 tx=0x7f6cf0006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 msgr2=0x7f6d0419ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 --2- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0419ecc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4011670 tx=0x7f6cf4011a30 comp rx=0 tx=0).stop 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 shutdown_connections 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 --2- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6ce803e5c0 0x7f6ce8040a80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 --2- 172.21.15.70:0/1215537752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d0407ee40 0x7f6d0419ecc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 >> 172.21.15.70:0/1215537752 conn(0x7f6d04104270 msgr2=0x7f6d04104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 shutdown_connections 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-05-08T06:31:25.273+0000 7f6d09a00700 1 -- 172.21.15.70:0/1215537752 wait complete. 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-08T06:31:26.019 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout:Or, if you are only running a single cluster on this host: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: ceph telemetry on 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout:For more information see: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:26.020 INFO:teuthology.orchestra.run.smithi070.stdout:Bootstrap complete. 2024-05-08T06:31:26.097 INFO:tasks.cephadm:Fetching config... 2024-05-08T06:31:26.097 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:31:26.097 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-08T06:31:26.187 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-08T06:31:26.187 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:31:26.187 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-08T06:31:26.268 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-08T06:31:26.268 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:31:26.269 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-08T06:31:26.384 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-08T06:31:26.384 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:31:26.384 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-08T06:31:26.479 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-08T06:31:26.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNo8HUbR7e6qKXeAQuuelH41xbTbWqC9vHKvK24ZkzhSc2JECVzNiYMHKAczazksdAgFqvPY4nt0cHylttrbnGIuwHicD95QTei/6IK7YjyiccxDiq48GfsTqJ6xBuhxnoH2VwmE4F4X6CRcEKGT19nP4tns7f2pIZ4mkBG+PJWoBzBQ7uN6hY6E9LMiwKfW5IGAySFyDR0XKe2SHXl0T1X//WyRsZ32fs8Njzvihh2QZCKr2O5i4jauYMa7xP/x7AGittNQa0lR8/X9H5389RImwLbTpL2cbSnDjOT9qyXmnw6VEfovLAbkNNlRiJKonzw51LNNQuaCSoDJ+Sohf+aKYS3/38KcB39m2j6H+/amoYtyonN5ntRorMFV0zPU7iExRHVbufjQTPtza+XLu9wiP/RQaN6cJ7rVpWnt+PdQCjwMbrAy6pb1cd9ATcU2SFEviLuUQJwoHQpUeDrwqDBT3Tw0sVUetJ/KrtkhGifgmqXphuAZiJv6DcinPniEc= ceph-3cf89df8-0d04-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T06:31:26.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:26 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1215537752' entity='client.admin' 2024-05-08T06:31:26.581 INFO:teuthology.orchestra.run.smithi070.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNo8HUbR7e6qKXeAQuuelH41xbTbWqC9vHKvK24ZkzhSc2JECVzNiYMHKAczazksdAgFqvPY4nt0cHylttrbnGIuwHicD95QTei/6IK7YjyiccxDiq48GfsTqJ6xBuhxnoH2VwmE4F4X6CRcEKGT19nP4tns7f2pIZ4mkBG+PJWoBzBQ7uN6hY6E9LMiwKfW5IGAySFyDR0XKe2SHXl0T1X//WyRsZ32fs8Njzvihh2QZCKr2O5i4jauYMa7xP/x7AGittNQa0lR8/X9H5389RImwLbTpL2cbSnDjOT9qyXmnw6VEfovLAbkNNlRiJKonzw51LNNQuaCSoDJ+Sohf+aKYS3/38KcB39m2j6H+/amoYtyonN5ntRorMFV0zPU7iExRHVbufjQTPtza+XLu9wiP/RQaN6cJ7rVpWnt+PdQCjwMbrAy6pb1cd9ATcU2SFEviLuUQJwoHQpUeDrwqDBT3Tw0sVUetJ/KrtkhGifgmqXphuAZiJv6DcinPniEc= ceph-3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:31:26.612 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNo8HUbR7e6qKXeAQuuelH41xbTbWqC9vHKvK24ZkzhSc2JECVzNiYMHKAczazksdAgFqvPY4nt0cHylttrbnGIuwHicD95QTei/6IK7YjyiccxDiq48GfsTqJ6xBuhxnoH2VwmE4F4X6CRcEKGT19nP4tns7f2pIZ4mkBG+PJWoBzBQ7uN6hY6E9LMiwKfW5IGAySFyDR0XKe2SHXl0T1X//WyRsZ32fs8Njzvihh2QZCKr2O5i4jauYMa7xP/x7AGittNQa0lR8/X9H5389RImwLbTpL2cbSnDjOT9qyXmnw6VEfovLAbkNNlRiJKonzw51LNNQuaCSoDJ+Sohf+aKYS3/38KcB39m2j6H+/amoYtyonN5ntRorMFV0zPU7iExRHVbufjQTPtza+XLu9wiP/RQaN6cJ7rVpWnt+PdQCjwMbrAy6pb1cd9ATcU2SFEviLuUQJwoHQpUeDrwqDBT3Tw0sVUetJ/KrtkhGifgmqXphuAZiJv6DcinPniEc= ceph-3cf89df8-0d04-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T06:31:26.726 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNo8HUbR7e6qKXeAQuuelH41xbTbWqC9vHKvK24ZkzhSc2JECVzNiYMHKAczazksdAgFqvPY4nt0cHylttrbnGIuwHicD95QTei/6IK7YjyiccxDiq48GfsTqJ6xBuhxnoH2VwmE4F4X6CRcEKGT19nP4tns7f2pIZ4mkBG+PJWoBzBQ7uN6hY6E9LMiwKfW5IGAySFyDR0XKe2SHXl0T1X//WyRsZ32fs8Njzvihh2QZCKr2O5i4jauYMa7xP/x7AGittNQa0lR8/X9H5389RImwLbTpL2cbSnDjOT9qyXmnw6VEfovLAbkNNlRiJKonzw51LNNQuaCSoDJ+Sohf+aKYS3/38KcB39m2j6H+/amoYtyonN5ntRorMFV0zPU7iExRHVbufjQTPtza+XLu9wiP/RQaN6cJ7rVpWnt+PdQCjwMbrAy6pb1cd9ATcU2SFEviLuUQJwoHQpUeDrwqDBT3Tw0sVUetJ/KrtkhGifgmqXphuAZiJv6DcinPniEc= ceph-3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:31:26.765 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNo8HUbR7e6qKXeAQuuelH41xbTbWqC9vHKvK24ZkzhSc2JECVzNiYMHKAczazksdAgFqvPY4nt0cHylttrbnGIuwHicD95QTei/6IK7YjyiccxDiq48GfsTqJ6xBuhxnoH2VwmE4F4X6CRcEKGT19nP4tns7f2pIZ4mkBG+PJWoBzBQ7uN6hY6E9LMiwKfW5IGAySFyDR0XKe2SHXl0T1X//WyRsZ32fs8Njzvihh2QZCKr2O5i4jauYMa7xP/x7AGittNQa0lR8/X9H5389RImwLbTpL2cbSnDjOT9qyXmnw6VEfovLAbkNNlRiJKonzw51LNNQuaCSoDJ+Sohf+aKYS3/38KcB39m2j6H+/amoYtyonN5ntRorMFV0zPU7iExRHVbufjQTPtza+XLu9wiP/RQaN6cJ7rVpWnt+PdQCjwMbrAy6pb1cd9ATcU2SFEviLuUQJwoHQpUeDrwqDBT3Tw0sVUetJ/KrtkhGifgmqXphuAZiJv6DcinPniEc= ceph-3cf89df8-0d04-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T06:31:26.883 INFO:teuthology.orchestra.run.smithi194.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNo8HUbR7e6qKXeAQuuelH41xbTbWqC9vHKvK24ZkzhSc2JECVzNiYMHKAczazksdAgFqvPY4nt0cHylttrbnGIuwHicD95QTei/6IK7YjyiccxDiq48GfsTqJ6xBuhxnoH2VwmE4F4X6CRcEKGT19nP4tns7f2pIZ4mkBG+PJWoBzBQ7uN6hY6E9LMiwKfW5IGAySFyDR0XKe2SHXl0T1X//WyRsZ32fs8Njzvihh2QZCKr2O5i4jauYMa7xP/x7AGittNQa0lR8/X9H5389RImwLbTpL2cbSnDjOT9qyXmnw6VEfovLAbkNNlRiJKonzw51LNNQuaCSoDJ+Sohf+aKYS3/38KcB39m2j6H+/amoYtyonN5ntRorMFV0zPU7iExRHVbufjQTPtza+XLu9wiP/RQaN6cJ7rVpWnt+PdQCjwMbrAy6pb1cd9ATcU2SFEviLuUQJwoHQpUeDrwqDBT3Tw0sVUetJ/KrtkhGifgmqXphuAZiJv6DcinPniEc= ceph-3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:31:26.924 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-08T06:31:27.347 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:31:30.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.450+0000 7f8f28e00700 1 -- 172.21.15.70:0/1735912629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 msgr2=0x7f8f24103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.450+0000 7f8f28e00700 1 --2- 172.21.15.70:0/1735912629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 0x7f8f24103170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400b0a0 tx=0x7f8f1400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.450+0000 7f8f28e00700 1 -- 172.21.15.70:0/1735912629 shutdown_connections 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.450+0000 7f8f28e00700 1 --2- 172.21.15.70:0/1735912629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 0x7f8f24103170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.450+0000 7f8f28e00700 1 -- 172.21.15.70:0/1735912629 >> 172.21.15.70:0/1735912629 conn(0x7f8f240fe350 msgr2=0x7f8f24100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.450+0000 7f8f28e00700 1 -- 172.21.15.70:0/1735912629 shutdown_connections 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.450+0000 7f8f28e00700 1 -- 172.21.15.70:0/1735912629 wait complete. 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.451+0000 7f8f28e00700 1 Processor -- start 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.452+0000 7f8f28e00700 1 -- start start 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.452+0000 7f8f28e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 0x7f8f2419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:30.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.452+0000 7f8f28e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f24108b40 con 0x7f8f24102d50 2024-05-08T06:31:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.452+0000 7f8f23400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 0x7f8f2419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.452+0000 7f8f23400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 0x7f8f2419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41872/0 (socket says 172.21.15.70:41872) 2024-05-08T06:31:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.452+0000 7f8f23400700 1 -- 172.21.15.70:0/56508116 learned_addr learned my addr 172.21.15.70:0/56508116 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.453+0000 7f8f23400700 1 -- 172.21.15.70:0/56508116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f2419aa00 con 0x7f8f24102d50 2024-05-08T06:31:30.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.453+0000 7f8f23400700 1 --2- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 0x7f8f2419a4c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009cd0 tx=0x7f8f14007b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.453+0000 7f8f20c00700 1 -- 172.21.15.70:0/56508116 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f14017040 con 0x7f8f24102d50 2024-05-08T06:31:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.454+0000 7f8f20c00700 1 -- 172.21.15.70:0/56508116 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8f14022070 con 0x7f8f24102d50 2024-05-08T06:31:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.454+0000 7f8f20c00700 1 -- 172.21.15.70:0/56508116 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f1401dd50 con 0x7f8f24102d50 2024-05-08T06:31:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.454+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f2419ac90 con 0x7f8f24102d50 2024-05-08T06:31:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.454+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f2419d980 con 0x7f8f24102d50 2024-05-08T06:31:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.455+0000 7f8f20c00700 1 -- 172.21.15.70:0/56508116 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8f1400ba60 con 0x7f8f24102d50 2024-05-08T06:31:30.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.455+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f241092c0 con 0x7f8f24102d50 2024-05-08T06:31:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.456+0000 7f8f20c00700 1 --2- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8f0803e5f0 0x7f8f08040ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:30.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.456+0000 7f8f20c00700 1 -- 172.21.15.70:0/56508116 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8f1400f050 con 0x7f8f24102d50 2024-05-08T06:31:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.456+0000 7f8f1aa00700 1 --2- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8f0803e5f0 0x7f8f08040ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:30.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.457+0000 7f8f1aa00700 1 --2- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8f0803e5f0 0x7f8f08040ab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c006fd0 tx=0x7f8f0c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:30.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.462+0000 7f8f20c00700 1 -- 172.21.15.70:0/56508116 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8f1400bd50 con 0x7f8f24102d50 2024-05-08T06:31:30.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.692+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f8f2402e620 con 0x7f8f24102d50 2024-05-08T06:31:30.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.696+0000 7f8f20c00700 1 -- 172.21.15.70:0/56508116 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f8f1401d610 con 0x7f8f24102d50 2024-05-08T06:31:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.699+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8f0803e5f0 msgr2=0x7f8f08040ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.699+0000 7f8f28e00700 1 --2- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8f0803e5f0 0x7f8f08040ab0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c006fd0 tx=0x7f8f0c006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:30.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.699+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 msgr2=0x7f8f2419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:30.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.699+0000 7f8f28e00700 1 --2- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 0x7f8f2419a4c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009cd0 tx=0x7f8f14007b40 comp rx=0 tx=0).stop 2024-05-08T06:31:30.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.700+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 shutdown_connections 2024-05-08T06:31:30.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.700+0000 7f8f28e00700 1 --2- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8f0803e5f0 0x7f8f08040ab0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:30.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.700+0000 7f8f28e00700 1 --2- 172.21.15.70:0/56508116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f24102d50 0x7f8f2419a4c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:30.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.700+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 >> 172.21.15.70:0/56508116 conn(0x7f8f240fe350 msgr2=0x7f8f24100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:30.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.700+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 shutdown_connections 2024-05-08T06:31:30.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:30.700+0000 7f8f28e00700 1 -- 172.21.15.70:0/56508116 wait complete. 2024-05-08T06:31:31.471 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-08T06:31:31.472 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-08T06:31:32.082 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:31 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/56508116' entity='client.admin' 2024-05-08T06:31:32.258 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:31:33.522 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:33.522 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:33.522 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:31:33.522 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:33.522 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:31:33.522 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:34.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.305+0000 7fb788c00700 1 -- 172.21.15.70:0/1539610145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 msgr2=0x7fb784105570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:34.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.305+0000 7fb788c00700 1 --2- 172.21.15.70:0/1539610145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 0x7fb784105570 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb774009910 tx=0x7fb774009c20 comp rx=0 tx=0).stop 2024-05-08T06:31:34.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.305+0000 7fb788c00700 1 -- 172.21.15.70:0/1539610145 shutdown_connections 2024-05-08T06:31:34.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.305+0000 7fb788c00700 1 --2- 172.21.15.70:0/1539610145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 0x7fb784105570 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:34.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.305+0000 7fb788c00700 1 -- 172.21.15.70:0/1539610145 >> 172.21.15.70:0/1539610145 conn(0x7fb7841006f0 msgr2=0x7fb784102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:34.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.305+0000 7fb788c00700 1 -- 172.21.15.70:0/1539610145 shutdown_connections 2024-05-08T06:31:34.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.306+0000 7fb788c00700 1 -- 172.21.15.70:0/1539610145 wait complete. 2024-05-08T06:31:34.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.307+0000 7fb788c00700 1 Processor -- start 2024-05-08T06:31:34.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.307+0000 7fb788c00700 1 -- start start 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.307+0000 7fb788c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 0x7fb78419a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.307+0000 7fb788c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb78410af40 con 0x7fb784105150 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.307+0000 7fb781e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 0x7fb78419a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.307+0000 7fb781e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 0x7fb78419a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41898/0 (socket says 172.21.15.70:41898) 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.307+0000 7fb781e00700 1 -- 172.21.15.70:0/3007874825 learned_addr learned my addr 172.21.15.70:0/3007874825 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.308+0000 7fb781e00700 1 -- 172.21.15.70:0/3007874825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78419abb0 con 0x7fb784105150 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.308+0000 7fb781e00700 1 --2- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 0x7fb78419a670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb774005120 tx=0x7fb774005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.308+0000 7fb77aa00700 1 -- 172.21.15.70:0/3007874825 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb774027070 con 0x7fb784105150 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.308+0000 7fb77aa00700 1 -- 172.21.15.70:0/3007874825 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb77400f460 con 0x7fb784105150 2024-05-08T06:31:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.308+0000 7fb77aa00700 1 -- 172.21.15.70:0/3007874825 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb774017440 con 0x7fb784105150 2024-05-08T06:31:34.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.308+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78419ae40 con 0x7fb784105150 2024-05-08T06:31:34.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.309+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78419db30 con 0x7fb784105150 2024-05-08T06:31:34.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.310+0000 7fb77aa00700 1 -- 172.21.15.70:0/3007874825 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fb77402a070 con 0x7fb784105150 2024-05-08T06:31:34.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.310+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78410b6c0 con 0x7fb784105150 2024-05-08T06:31:34.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.310+0000 7fb77aa00700 1 --2- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb76803e570 0x7fb768040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:34.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.310+0000 7fb77aa00700 1 -- 172.21.15.70:0/3007874825 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb7740538b0 con 0x7fb784105150 2024-05-08T06:31:34.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.311+0000 7fb77be00700 1 --2- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb76803e570 0x7fb768040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:34.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.311+0000 7fb77be00700 1 --2- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb76803e570 0x7fb768040a30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006fd0 tx=0x7fb76c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:34.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.316+0000 7fb77aa00700 1 -- 172.21.15.70:0/3007874825 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb774013070 con 0x7fb784105150 2024-05-08T06:31:34.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.553+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7fb78402e620 con 0x7fb76803e570 2024-05-08T06:31:34.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.562+0000 7fb77aa00700 1 -- 172.21.15.70:0/3007874825 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb78402e620 con 0x7fb76803e570 2024-05-08T06:31:34.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb76803e570 msgr2=0x7fb768040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:34.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 --2- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb76803e570 0x7fb768040a30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb76c006fd0 tx=0x7fb76c006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:34.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 msgr2=0x7fb78419a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:34.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 --2- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 0x7fb78419a670 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb774005120 tx=0x7fb774005810 comp rx=0 tx=0).stop 2024-05-08T06:31:34.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 shutdown_connections 2024-05-08T06:31:34.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 --2- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb76803e570 0x7fb768040a30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:34.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 --2- 172.21.15.70:0/3007874825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb784105150 0x7fb78419a670 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:34.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 >> 172.21.15.70:0/3007874825 conn(0x7fb7841006f0 msgr2=0x7fb784101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:34.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 shutdown_connections 2024-05-08T06:31:34.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:34.565+0000 7fb788c00700 1 -- 172.21.15.70:0/3007874825 wait complete. 2024-05-08T06:31:35.426 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi172 2024-05-08T06:31:35.426 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:31:35.426 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.conf 2024-05-08T06:31:35.483 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:31:35.483 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:31:35.575 INFO:tasks.cephadm:Adding host smithi172 to orchestrator... 2024-05-08T06:31:35.575 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch host add smithi172 2024-05-08T06:31:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:35 smithi070 ceph-mon[29591]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:35 smithi070 ceph-mon[29591]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:31:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:31:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:31:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:31:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:35 smithi070 ceph-mon[29591]: Updating smithi070:/etc/ceph/ceph.conf 2024-05-08T06:31:35.982 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:31:36.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:36 smithi070 ceph-mon[29591]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:31:37.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:37 smithi070 ceph-mon[29591]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:31:37.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:37 smithi070 ceph-mon[29591]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:37.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:37 smithi070 ceph-mon[29591]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:31:37.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:37.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:37.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.206+0000 7fda35800700 1 -- 172.21.15.70:0/91314031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 msgr2=0x7fda30105710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.206+0000 7fda35800700 1 --2- 172.21.15.70:0/91314031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 0x7fda30105710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fda20009910 tx=0x7fda20009c20 comp rx=0 tx=0).stop 2024-05-08T06:31:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.206+0000 7fda35800700 1 -- 172.21.15.70:0/91314031 shutdown_connections 2024-05-08T06:31:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.206+0000 7fda35800700 1 --2- 172.21.15.70:0/91314031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 0x7fda30105710 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.206+0000 7fda35800700 1 -- 172.21.15.70:0/91314031 >> 172.21.15.70:0/91314031 conn(0x7fda30100bc0 msgr2=0x7fda30102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.206+0000 7fda35800700 1 -- 172.21.15.70:0/91314031 shutdown_connections 2024-05-08T06:31:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.207+0000 7fda35800700 1 -- 172.21.15.70:0/91314031 wait complete. 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.207+0000 7fda35800700 1 Processor -- start 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.208+0000 7fda35800700 1 -- start start 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.208+0000 7fda35800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 0x7fda301a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.208+0000 7fda35800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda3010f460 con 0x7fda30105330 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.208+0000 7fda2ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 0x7fda301a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.208+0000 7fda2ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 0x7fda301a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55608/0 (socket says 172.21.15.70:55608) 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.208+0000 7fda2ea00700 1 -- 172.21.15.70:0/2274350398 learned_addr learned my addr 172.21.15.70:0/2274350398 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.209+0000 7fda2ea00700 1 -- 172.21.15.70:0/2274350398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda301a0be0 con 0x7fda30105330 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.209+0000 7fda2ea00700 1 --2- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 0x7fda301a06a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fda20006010 tx=0x7fda20005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.209+0000 7fda27400700 1 -- 172.21.15.70:0/2274350398 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda20026070 con 0x7fda30105330 2024-05-08T06:31:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.209+0000 7fda27400700 1 -- 172.21.15.70:0/2274350398 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda2000b6f0 con 0x7fda30105330 2024-05-08T06:31:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.209+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda301a0ed0 con 0x7fda30105330 2024-05-08T06:31:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.209+0000 7fda27400700 1 -- 172.21.15.70:0/2274350398 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda20003810 con 0x7fda30105330 2024-05-08T06:31:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.209+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3019a820 con 0x7fda30105330 2024-05-08T06:31:38.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.210+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda30106810 con 0x7fda30105330 2024-05-08T06:31:38.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.211+0000 7fda27400700 1 -- 172.21.15.70:0/2274350398 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fda20029070 con 0x7fda30105330 2024-05-08T06:31:38.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.211+0000 7fda27400700 1 --2- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda1403e510 0x7fda140409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:38.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.211+0000 7fda27400700 1 -- 172.21.15.70:0/2274350398 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fda2001e070 con 0x7fda30105330 2024-05-08T06:31:38.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.212+0000 7fda2e000700 1 --2- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda1403e510 0x7fda140409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:38.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.212+0000 7fda2e000700 1 --2- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda1403e510 0x7fda140409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fda1c006fd0 tx=0x7fda1c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:38.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.217+0000 7fda27400700 1 -- 172.21.15.70:0/2274350398 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fda20013070 con 0x7fda30105330 2024-05-08T06:31:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:38.454+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}) -- 0x7fda3019bd50 con 0x7fda1403e510 2024-05-08T06:31:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:39 smithi070 ceph-mon[29591]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:39 smithi070 ceph-mon[29591]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:31:40.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:40 smithi070 ceph-mon[29591]: Deploying cephadm binary to smithi172 2024-05-08T06:31:41.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:41 smithi070 ceph-mon[29591]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:43 smithi070 ceph-mon[29591]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:44.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.588+0000 7fda27400700 1 -- 172.21.15.70:0/2274350398 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fda3019bd50 con 0x7fda1403e510 2024-05-08T06:31:44.588 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi172' with addr '172.21.15.172' 2024-05-08T06:31:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.592+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda1403e510 msgr2=0x7fda140409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.592+0000 7fda35800700 1 --2- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda1403e510 0x7fda140409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fda1c006fd0 tx=0x7fda1c006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.592+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 msgr2=0x7fda301a06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.592+0000 7fda35800700 1 --2- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 0x7fda301a06a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fda20006010 tx=0x7fda20005710 comp rx=0 tx=0).stop 2024-05-08T06:31:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.592+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 shutdown_connections 2024-05-08T06:31:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.592+0000 7fda35800700 1 --2- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda1403e510 0x7fda140409d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.592+0000 7fda35800700 1 --2- 172.21.15.70:0/2274350398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda30105330 0x7fda301a06a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.592+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 >> 172.21.15.70:0/2274350398 conn(0x7fda30100bc0 msgr2=0x7fda30106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.592+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 shutdown_connections 2024-05-08T06:31:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:44.593+0000 7fda35800700 1 -- 172.21.15.70:0/2274350398 wait complete. 2024-05-08T06:31:45.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T06:31:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:45 smithi070 ceph-mon[29591]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:45 smithi070 ceph-mon[29591]: Added host smithi172 2024-05-08T06:31:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:31:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:45.938 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:31:47.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:47 smithi070 ceph-mon[29591]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:47.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.027+0000 7f2daf400700 1 -- 172.21.15.70:0/4280586573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 msgr2=0x7f2da8105710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.027+0000 7f2daf400700 1 --2- 172.21.15.70:0/4280586573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 0x7f2da8105710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c009910 tx=0x7f2d9c009c20 comp rx=0 tx=0).stop 2024-05-08T06:31:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.027+0000 7f2daf400700 1 -- 172.21.15.70:0/4280586573 shutdown_connections 2024-05-08T06:31:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.027+0000 7f2daf400700 1 --2- 172.21.15.70:0/4280586573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 0x7f2da8105710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.027+0000 7f2daf400700 1 -- 172.21.15.70:0/4280586573 >> 172.21.15.70:0/4280586573 conn(0x7f2da8100bc0 msgr2=0x7f2da8102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.027+0000 7f2daf400700 1 -- 172.21.15.70:0/4280586573 shutdown_connections 2024-05-08T06:31:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.027+0000 7f2daf400700 1 -- 172.21.15.70:0/4280586573 wait complete. 2024-05-08T06:31:48.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.029+0000 7f2daf400700 1 Processor -- start 2024-05-08T06:31:48.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.029+0000 7f2daf400700 1 -- start start 2024-05-08T06:31:48.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.029+0000 7f2daf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 0x7f2da81a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:48.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.029+0000 7f2daf400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2da810f460 con 0x7f2da8105330 2024-05-08T06:31:48.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.029+0000 7f2daca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 0x7f2da81a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:48.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.029+0000 7f2daca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 0x7f2da81a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60164/0 (socket says 172.21.15.70:60164) 2024-05-08T06:31:48.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.029+0000 7f2daca00700 1 -- 172.21.15.70:0/3453442021 learned_addr learned my addr 172.21.15.70:0/3453442021 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:48.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.030+0000 7f2daca00700 1 -- 172.21.15.70:0/3453442021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da81a0be0 con 0x7f2da8105330 2024-05-08T06:31:48.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.030+0000 7f2daca00700 1 --2- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 0x7f2da81a06a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c006010 tx=0x7f2d9c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.030+0000 7f2da5600700 1 -- 172.21.15.70:0/3453442021 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d9c026070 con 0x7f2da8105330 2024-05-08T06:31:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.030+0000 7f2da5600700 1 -- 172.21.15.70:0/3453442021 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d9c00b6f0 con 0x7f2da8105330 2024-05-08T06:31:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.030+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da81a0ed0 con 0x7f2da8105330 2024-05-08T06:31:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.030+0000 7f2da5600700 1 -- 172.21.15.70:0/3453442021 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d9c003810 con 0x7f2da8105330 2024-05-08T06:31:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.030+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da819a820 con 0x7f2da8105330 2024-05-08T06:31:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.031+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da8106810 con 0x7f2da8105330 2024-05-08T06:31:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.032+0000 7f2da5600700 1 -- 172.21.15.70:0/3453442021 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f2d9c029070 con 0x7f2da8105330 2024-05-08T06:31:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.032+0000 7f2da5600700 1 --2- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2d9003e510 0x7f2d900409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.032+0000 7f2da5600700 1 -- 172.21.15.70:0/3453442021 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2d9c01e070 con 0x7f2da8105330 2024-05-08T06:31:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.032+0000 7f2da7e00700 1 --2- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2d9003e510 0x7f2d900409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:48.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.033+0000 7f2da7e00700 1 --2- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2d9003e510 0x7f2d900409d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2d94006fd0 tx=0x7f2d94006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:48.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.038+0000 7f2da5600700 1 -- 172.21.15.70:0/3453442021 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2d9c013070 con 0x7f2da8105330 2024-05-08T06:31:48.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.280+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2da819bd50 con 0x7f2d9003e510 2024-05-08T06:31:48.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.283+0000 7f2da5600700 1 -- 172.21.15.70:0/3453442021 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f2da819bd50 con 0x7f2d9003e510 2024-05-08T06:31:48.283 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:31:48.283 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}] 2024-05-08T06:31:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2d9003e510 msgr2=0x7f2d900409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 --2- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2d9003e510 0x7f2d900409d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2d94006fd0 tx=0x7f2d94006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 msgr2=0x7f2da81a06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 --2- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 0x7f2da81a06a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c006010 tx=0x7f2d9c005710 comp rx=0 tx=0).stop 2024-05-08T06:31:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 shutdown_connections 2024-05-08T06:31:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 --2- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2d9003e510 0x7f2d900409d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 --2- 172.21.15.70:0/3453442021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da8105330 0x7f2da81a06a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:48.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 >> 172.21.15.70:0/3453442021 conn(0x7f2da8100bc0 msgr2=0x7f2da8106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:48.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 shutdown_connections 2024-05-08T06:31:48.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:48.286+0000 7f2daf400700 1 -- 172.21.15.70:0/3453442021 wait complete. 2024-05-08T06:31:48.992 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi194 2024-05-08T06:31:48.993 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:31:48.993 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.conf 2024-05-08T06:31:49.051 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:31:49.051 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:31:49.143 INFO:tasks.cephadm:Adding host smithi194 to orchestrator... 2024-05-08T06:31:49.143 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch host add smithi194 2024-05-08T06:31:49.569 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:31:49.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:49 smithi070 ceph-mon[29591]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:49.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:49 smithi070 ceph-mon[29591]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:31:49.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.430+0000 7fd0d0800700 1 -- 172.21.15.70:0/3506283393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 msgr2=0x7fd0c81034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.430+0000 7fd0d0800700 1 --2- 172.21.15.70:0/3506283393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 0x7fd0c81034f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009910 tx=0x7fd0bc009c20 comp rx=0 tx=0).stop 2024-05-08T06:31:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.431+0000 7fd0d0800700 1 -- 172.21.15.70:0/3506283393 shutdown_connections 2024-05-08T06:31:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.431+0000 7fd0d0800700 1 --2- 172.21.15.70:0/3506283393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 0x7fd0c81034f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.431+0000 7fd0d0800700 1 -- 172.21.15.70:0/3506283393 >> 172.21.15.70:0/3506283393 conn(0x7fd0c80fe9e0 msgr2=0x7fd0c8100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.431+0000 7fd0d0800700 1 -- 172.21.15.70:0/3506283393 shutdown_connections 2024-05-08T06:31:51.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.431+0000 7fd0d0800700 1 -- 172.21.15.70:0/3506283393 wait complete. 2024-05-08T06:31:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.432+0000 7fd0d0800700 1 Processor -- start 2024-05-08T06:31:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.432+0000 7fd0d0800700 1 -- start start 2024-05-08T06:31:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.432+0000 7fd0d0800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 0x7fd0c81a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.432+0000 7fd0d0800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c810d240 con 0x7fd0c8103110 2024-05-08T06:31:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.432+0000 7fd0cde00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 0x7fd0c81a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:51.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.433+0000 7fd0cde00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 0x7fd0c81a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60172/0 (socket says 172.21.15.70:60172) 2024-05-08T06:31:51.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.433+0000 7fd0cde00700 1 -- 172.21.15.70:0/3978080365 learned_addr learned my addr 172.21.15.70:0/3978080365 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:31:51.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.433+0000 7fd0cde00700 1 -- 172.21.15.70:0/3978080365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c81a0bf0 con 0x7fd0c8103110 2024-05-08T06:31:51.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.433+0000 7fd0cde00700 1 --2- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 0x7fd0c81a06b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc005660 tx=0x7fd0bc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:51.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.433+0000 7fd0c2a00700 1 -- 172.21.15.70:0/3978080365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0bc026070 con 0x7fd0c8103110 2024-05-08T06:31:51.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.434+0000 7fd0c2a00700 1 -- 172.21.15.70:0/3978080365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0bc00b6f0 con 0x7fd0c8103110 2024-05-08T06:31:51.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.434+0000 7fd0c2a00700 1 -- 172.21.15.70:0/3978080365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0bc0037b0 con 0x7fd0c8103110 2024-05-08T06:31:51.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.434+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c81a0ee0 con 0x7fd0c8103110 2024-05-08T06:31:51.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.434+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c819a870 con 0x7fd0c8103110 2024-05-08T06:31:51.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.435+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c81045f0 con 0x7fd0c8103110 2024-05-08T06:31:51.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.435+0000 7fd0c2a00700 1 -- 172.21.15.70:0/3978080365 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd0bc029070 con 0x7fd0c8103110 2024-05-08T06:31:51.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.436+0000 7fd0c2a00700 1 --2- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0b003e570 0x7fd0b0040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:31:51.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.436+0000 7fd0c2a00700 1 -- 172.21.15.70:0/3978080365 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fd0bc01e070 con 0x7fd0c8103110 2024-05-08T06:31:51.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.436+0000 7fd0cd400700 1 --2- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0b003e570 0x7fd0b0040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:31:51.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.437+0000 7fd0cd400700 1 --2- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0b003e570 0x7fd0b0040a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8006fd0 tx=0x7fd0b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:31:51.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.441+0000 7fd0c2a00700 1 -- 172.21.15.70:0/3978080365 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd0bc013070 con 0x7fd0c8103110 2024-05-08T06:31:51.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:51.678+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}) -- 0x7fd0c819be10 con 0x7fd0b003e570 2024-05-08T06:31:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:51 smithi070 ceph-mon[29591]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:52.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:52 smithi070 ceph-mon[29591]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:31:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:53 smithi070 ceph-mon[29591]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:31:53.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:31:54.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:54 smithi070 ceph-mon[29591]: Deploying cephadm binary to smithi194 2024-05-08T06:31:54.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:54 smithi070 ceph-mon[29591]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-08T06:31:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:55 smithi070 ceph-mon[29591]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:57.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:57 smithi070 ceph-mon[29591]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:57.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:57 smithi070 ceph-mon[29591]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:31:57.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.920+0000 7fd0c2a00700 1 -- 172.21.15.70:0/3978080365 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd0c819be10 con 0x7fd0b003e570 2024-05-08T06:31:57.921 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi194' with addr '172.21.15.194' 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0b003e570 msgr2=0x7fd0b0040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 --2- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0b003e570 0x7fd0b0040a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8006fd0 tx=0x7fd0b8006e40 comp rx=0 tx=0).stop 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 msgr2=0x7fd0c81a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 --2- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 0x7fd0c81a06b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc005660 tx=0x7fd0bc005740 comp rx=0 tx=0).stop 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 shutdown_connections 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 --2- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0b003e570 0x7fd0b0040a30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 --2- 172.21.15.70:0/3978080365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c8103110 0x7fd0c81a06b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 >> 172.21.15.70:0/3978080365 conn(0x7fd0c80fe9e0 msgr2=0x7fd0c80756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 shutdown_connections 2024-05-08T06:31:57.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:31:57.925+0000 7fd0d0800700 1 -- 172.21.15.70:0/3978080365 wait complete. 2024-05-08T06:31:58.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T06:31:58.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:58 smithi070 ceph-mon[29591]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:31:58.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:58 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:59.187 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:31:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:59 smithi070 ceph-mon[29591]: Added host smithi194 2024-05-08T06:31:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:59 smithi070 ceph-mon[29591]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:31:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:59 smithi070 ceph-mon[29591]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:31:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:31:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:31:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:01.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.242+0000 7f55a9400700 1 -- 172.21.15.70:0/4166386375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 msgr2=0x7f55a4105710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:01.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.242+0000 7f55a9400700 1 --2- 172.21.15.70:0/4166386375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 0x7f55a4105710 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5594009910 tx=0x7f5594009c20 comp rx=0 tx=0).stop 2024-05-08T06:32:01.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.242+0000 7f55a9400700 1 -- 172.21.15.70:0/4166386375 shutdown_connections 2024-05-08T06:32:01.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.242+0000 7f55a9400700 1 --2- 172.21.15.70:0/4166386375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 0x7f55a4105710 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:01.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.242+0000 7f55a9400700 1 -- 172.21.15.70:0/4166386375 >> 172.21.15.70:0/4166386375 conn(0x7f55a4100bc0 msgr2=0x7f55a4102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:01.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.242+0000 7f55a9400700 1 -- 172.21.15.70:0/4166386375 shutdown_connections 2024-05-08T06:32:01.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.242+0000 7f55a9400700 1 -- 172.21.15.70:0/4166386375 wait complete. 2024-05-08T06:32:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.243+0000 7f55a9400700 1 Processor -- start 2024-05-08T06:32:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.243+0000 7f55a9400700 1 -- start start 2024-05-08T06:32:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.243+0000 7f55a9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 0x7f55a41a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.243+0000 7f55a9400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55a410f460 con 0x7f55a4105330 2024-05-08T06:32:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.244+0000 7f55a2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 0x7f55a41a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.244+0000 7f55a2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 0x7f55a41a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41672/0 (socket says 172.21.15.70:41672) 2024-05-08T06:32:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.244+0000 7f55a2800700 1 -- 172.21.15.70:0/2166689756 learned_addr learned my addr 172.21.15.70:0/2166689756 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:32:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.244+0000 7f55a2800700 1 -- 172.21.15.70:0/2166689756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a41a0be0 con 0x7f55a4105330 2024-05-08T06:32:01.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.244+0000 7f55a2800700 1 --2- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 0x7f55a41a06a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5594005690 tx=0x7f5594005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:01.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.245+0000 7f559b400700 1 -- 172.21.15.70:0/2166689756 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5594026070 con 0x7f55a4105330 2024-05-08T06:32:01.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.245+0000 7f559b400700 1 -- 172.21.15.70:0/2166689756 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f559400b6f0 con 0x7f55a4105330 2024-05-08T06:32:01.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.245+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a41a0ed0 con 0x7f55a4105330 2024-05-08T06:32:01.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.245+0000 7f559b400700 1 -- 172.21.15.70:0/2166689756 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5594003810 con 0x7f55a4105330 2024-05-08T06:32:01.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.245+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a419a820 con 0x7f55a4105330 2024-05-08T06:32:01.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.246+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a4106810 con 0x7f55a4105330 2024-05-08T06:32:01.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.246+0000 7f559b400700 1 -- 172.21.15.70:0/2166689756 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5594029070 con 0x7f55a4105330 2024-05-08T06:32:01.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.247+0000 7f559b400700 1 --2- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f558803e5c0 0x7f5588040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:01.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.247+0000 7f559b400700 1 -- 172.21.15.70:0/2166689756 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f559401e070 con 0x7f55a4105330 2024-05-08T06:32:01.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.247+0000 7f55a1e00700 1 --2- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f558803e5c0 0x7f5588040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:01.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.248+0000 7f55a1e00700 1 --2- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f558803e5c0 0x7f5588040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5590006fd0 tx=0x7f5590006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:01.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.252+0000 7f559b400700 1 -- 172.21.15.70:0/2166689756 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5594013070 con 0x7f55a4105330 2024-05-08T06:32:01.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.494+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f55a419bd50 con 0x7f558803e5c0 2024-05-08T06:32:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.496+0000 7f559b400700 1 -- 172.21.15.70:0/2166689756 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f55a419bd50 con 0x7f558803e5c0 2024-05-08T06:32:01.496 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:32:01.496 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.172", "hostname": "smithi172", "labels": [], "status": ""}, {"addr": "172.21.15.194", "hostname": "smithi194", "labels": [], "status": ""}] 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f558803e5c0 msgr2=0x7f5588040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 --2- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f558803e5c0 0x7f5588040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5590006fd0 tx=0x7f5590006e40 comp rx=0 tx=0).stop 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 msgr2=0x7f55a41a06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 --2- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 0x7f55a41a06a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5594005690 tx=0x7f5594005770 comp rx=0 tx=0).stop 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 shutdown_connections 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 --2- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f558803e5c0 0x7f5588040a80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 --2- 172.21.15.70:0/2166689756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55a4105330 0x7f55a41a06a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 >> 172.21.15.70:0/2166689756 conn(0x7f55a4100bc0 msgr2=0x7f55a4106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 shutdown_connections 2024-05-08T06:32:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:01.500+0000 7f55a9400700 1 -- 172.21.15.70:0/2166689756 wait complete. 2024-05-08T06:32:01.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:01 smithi070 ceph-mon[29591]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:01.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:01.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:02.247 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-08T06:32:02.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-08T06:32:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:02 smithi070 ceph-mon[29591]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:32:02.675 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:32:03.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:03 smithi070 ceph-mon[29591]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:03.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:04.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.684+0000 7f5575200700 1 -- 172.21.15.70:0/2157171020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 msgr2=0x7f5570075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.684+0000 7f5575200700 1 --2- 172.21.15.70:0/2157171020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 0x7f5570075c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f556000b0a0 tx=0x7f556000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:32:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.684+0000 7f5575200700 1 -- 172.21.15.70:0/2157171020 shutdown_connections 2024-05-08T06:32:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.684+0000 7f5575200700 1 --2- 172.21.15.70:0/2157171020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 0x7f5570075c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.684+0000 7f5575200700 1 -- 172.21.15.70:0/2157171020 >> 172.21.15.70:0/2157171020 conn(0x7f55700fe800 msgr2=0x7f5570100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.684+0000 7f5575200700 1 -- 172.21.15.70:0/2157171020 shutdown_connections 2024-05-08T06:32:04.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.685+0000 7f5575200700 1 -- 172.21.15.70:0/2157171020 wait complete. 2024-05-08T06:32:04.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.686+0000 7f5575200700 1 Processor -- start 2024-05-08T06:32:04.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.686+0000 7f5575200700 1 -- start start 2024-05-08T06:32:04.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.686+0000 7f5575200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 0x7f55701a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:04.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.686+0000 7f5575200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f557010f2f0 con 0x7f5570075870 2024-05-08T06:32:04.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.686+0000 7f556f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 0x7f55701a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:04.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.686+0000 7f556f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 0x7f55701a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41688/0 (socket says 172.21.15.70:41688) 2024-05-08T06:32:04.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.686+0000 7f556f400700 1 -- 172.21.15.70:0/2856308944 learned_addr learned my addr 172.21.15.70:0/2856308944 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:32:04.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.687+0000 7f556f400700 1 -- 172.21.15.70:0/2856308944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55701a0b80 con 0x7f5570075870 2024-05-08T06:32:04.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.687+0000 7f556f400700 1 --2- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 0x7f55701a0640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5560000f80 tx=0x7f5560009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:04.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.687+0000 7f556cc00700 1 -- 172.21.15.70:0/2856308944 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5560017040 con 0x7f5570075870 2024-05-08T06:32:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.687+0000 7f556cc00700 1 -- 172.21.15.70:0/2856308944 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5560022070 con 0x7f5570075870 2024-05-08T06:32:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.687+0000 7f556cc00700 1 -- 172.21.15.70:0/2856308944 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5560004880 con 0x7f5570075870 2024-05-08T06:32:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.687+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55701a0e10 con 0x7f5570075870 2024-05-08T06:32:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.688+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f557019a710 con 0x7f5570075870 2024-05-08T06:32:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.689+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5570076f20 con 0x7f5570075870 2024-05-08T06:32:04.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.689+0000 7f556cc00700 1 -- 172.21.15.70:0/2856308944 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f55600040d0 con 0x7f5570075870 2024-05-08T06:32:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.689+0000 7f556cc00700 1 --2- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f555403e5b0 0x7f5554040a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.689+0000 7f556cc00700 1 -- 172.21.15.70:0/2856308944 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f556000f050 con 0x7f5570075870 2024-05-08T06:32:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.690+0000 7f5566a00700 1 --2- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f555403e5b0 0x7f5554040a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:04.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.690+0000 7f5566a00700 1 --2- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f555403e5b0 0x7f5554040a70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5558006fd0 tx=0x7f5558006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:04.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.695+0000 7f556cc00700 1 -- 172.21.15.70:0/2856308944 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f556001c9d0 con 0x7f5570075870 2024-05-08T06:32:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:04.933+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5570064b00 con 0x7f5570075870 2024-05-08T06:32:05.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.398+0000 7f556cc00700 1 -- 172.21.15.70:0/2856308944 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f55600102f0 con 0x7f5570075870 2024-05-08T06:32:05.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.402+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f555403e5b0 msgr2=0x7f5554040a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:05.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.402+0000 7f5575200700 1 --2- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f555403e5b0 0x7f5554040a70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5558006fd0 tx=0x7f5558006e40 comp rx=0 tx=0).stop 2024-05-08T06:32:05.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.402+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 msgr2=0x7f55701a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:05.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.402+0000 7f5575200700 1 --2- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 0x7f55701a0640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5560000f80 tx=0x7f5560009790 comp rx=0 tx=0).stop 2024-05-08T06:32:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.403+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 shutdown_connections 2024-05-08T06:32:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.403+0000 7f5575200700 1 --2- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f555403e5b0 0x7f5554040a70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.403+0000 7f5575200700 1 --2- 172.21.15.70:0/2856308944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5570075870 0x7f55701a0640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.403+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 >> 172.21.15.70:0/2856308944 conn(0x7f55700fe800 msgr2=0x7f5570106ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.403+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 shutdown_connections 2024-05-08T06:32:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:05.403+0000 7f5575200700 1 -- 172.21.15.70:0/2856308944 wait complete. 2024-05-08T06:32:05.404 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-05-08T06:32:05.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:05 smithi070 ceph-mon[29591]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:05.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:05 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2856308944' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T06:32:06.159 INFO:tasks.cephadm:Adding mon.a on smithi070 2024-05-08T06:32:06.160 INFO:tasks.cephadm:Adding mon.b on smithi172 2024-05-08T06:32:06.160 INFO:tasks.cephadm:Adding mon.c on smithi194 2024-05-08T06:32:06.160 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi070:172.21.15.70=a;smithi172:172.21.15.172=b;smithi194:172.21.15.194=c' 2024-05-08T06:32:06.568 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-08T06:32:06.682 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-08T06:32:06.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:06 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2856308944' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T06:32:06.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:06 smithi070 ceph-mon[29591]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T06:32:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:07 smithi070 ceph-mon[29591]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:09.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.247+0000 7efe9d000700 1 -- 172.21.15.194:0/3314913046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 msgr2=0x7efe98101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:09.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.247+0000 7efe9d000700 1 --2- 172.21.15.194:0/3314913046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 0x7efe98101bc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efe88009910 tx=0x7efe88009c20 comp rx=0 tx=0).stop 2024-05-08T06:32:09.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.247+0000 7efe9d000700 1 -- 172.21.15.194:0/3314913046 shutdown_connections 2024-05-08T06:32:09.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.247+0000 7efe9d000700 1 --2- 172.21.15.194:0/3314913046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 0x7efe98101bc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:09.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.247+0000 7efe9d000700 1 -- 172.21.15.194:0/3314913046 >> 172.21.15.194:0/3314913046 conn(0x7efe980fd3e0 msgr2=0x7efe980ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:09.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.247+0000 7efe9d000700 1 -- 172.21.15.194:0/3314913046 shutdown_connections 2024-05-08T06:32:09.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.247+0000 7efe9d000700 1 -- 172.21.15.194:0/3314913046 wait complete. 2024-05-08T06:32:09.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.248+0000 7efe9d000700 1 Processor -- start 2024-05-08T06:32:09.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.248+0000 7efe9d000700 1 -- start start 2024-05-08T06:32:09.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.248+0000 7efe9d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 0x7efe9819a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:09.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.248+0000 7efe9d000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efe9810af00 con 0x7efe981017a0 2024-05-08T06:32:09.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.249+0000 7efe95e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 0x7efe9819a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:09.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.249+0000 7efe95e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 0x7efe9819a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.194:36064/0 (socket says 172.21.15.194:36064) 2024-05-08T06:32:09.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.249+0000 7efe95e00700 1 -- 172.21.15.194:0/3420671928 learned_addr learned my addr 172.21.15.194:0/3420671928 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:32:09.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.250+0000 7efe95e00700 1 -- 172.21.15.194:0/3420671928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9819ac20 con 0x7efe981017a0 2024-05-08T06:32:09.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.251+0000 7efe95e00700 1 --2- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 0x7efe9819a6e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe88005b40 tx=0x7efe88005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:09.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.251+0000 7efe8ea00700 1 -- 172.21.15.194:0/3420671928 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe88027070 con 0x7efe981017a0 2024-05-08T06:32:09.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.251+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9819aeb0 con 0x7efe981017a0 2024-05-08T06:32:09.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.251+0000 7efe8ea00700 1 -- 172.21.15.194:0/3420671928 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efe8800bdf0 con 0x7efe981017a0 2024-05-08T06:32:09.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.251+0000 7efe8ea00700 1 -- 172.21.15.194:0/3420671928 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe88022cb0 con 0x7efe981017a0 2024-05-08T06:32:09.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.251+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9819dba0 con 0x7efe981017a0 2024-05-08T06:32:09.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.252+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe9810b680 con 0x7efe981017a0 2024-05-08T06:32:09.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.253+0000 7efe8ea00700 1 -- 172.21.15.194:0/3420671928 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7efe8802a070 con 0x7efe981017a0 2024-05-08T06:32:09.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.254+0000 7efe8ea00700 1 --2- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efe7c03e510 0x7efe7c0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:09.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.254+0000 7efe8ea00700 1 -- 172.21.15.194:0/3420671928 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7efe8801e030 con 0x7efe981017a0 2024-05-08T06:32:09.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.255+0000 7efe95400700 1 --2- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efe7c03e510 0x7efe7c0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:09.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.256+0000 7efe95400700 1 --2- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efe7c03e510 0x7efe7c0409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efe84006fd0 tx=0x7efe84006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:09.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.270+0000 7efe8ea00700 1 -- 172.21.15.194:0/3420671928 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efe88013070 con 0x7efe981017a0 2024-05-08T06:32:09.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.520+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi172:172.21.15.172=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}) -- 0x7efe9802e7a0 con 0x7efe7c03e510 2024-05-08T06:32:09.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.535+0000 7efe8ea00700 1 -- 172.21.15.194:0/3420671928 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7efe9802e7a0 con 0x7efe7c03e510 2024-05-08T06:32:09.534 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mon update... 2024-05-08T06:32:09.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.538+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efe7c03e510 msgr2=0x7efe7c0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:09.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.538+0000 7efe9d000700 1 --2- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efe7c03e510 0x7efe7c0409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7efe84006fd0 tx=0x7efe84006e40 comp rx=0 tx=0).stop 2024-05-08T06:32:09.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.538+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 msgr2=0x7efe9819a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:09.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.538+0000 7efe9d000700 1 --2- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 0x7efe9819a6e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efe88005b40 tx=0x7efe88005810 comp rx=0 tx=0).stop 2024-05-08T06:32:09.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.539+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 shutdown_connections 2024-05-08T06:32:09.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.539+0000 7efe9d000700 1 --2- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efe7c03e510 0x7efe7c0409d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:09.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.539+0000 7efe9d000700 1 --2- 172.21.15.194:0/3420671928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe981017a0 0x7efe9819a6e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:09.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.539+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 >> 172.21.15.194:0/3420671928 conn(0x7efe980fd3e0 msgr2=0x7efe980fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:09.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.539+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 shutdown_connections 2024-05-08T06:32:09.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:09.539+0000 7efe9d000700 1 -- 172.21.15.194:0/3420671928 wait complete. 2024-05-08T06:32:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:09 smithi070 ceph-mon[29591]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:32:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:09.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:09.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:09 smithi070 ceph-mon[29591]: Updating smithi194:/etc/ceph/ceph.conf 2024-05-08T06:32:10.238 DEBUG:teuthology.orchestra.run.smithi172:mon.b> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.b.service 2024-05-08T06:32:10.246 DEBUG:teuthology.orchestra.run.smithi194:mon.c> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.c.service 2024-05-08T06:32:10.250 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T06:32:10.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T06:32:10.708 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:10 smithi070 ceph-mon[29591]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:10 smithi070 ceph-mon[29591]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi172:172.21.15.172=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:10 smithi070 ceph-mon[29591]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi172:172.21.15.172=b;smithi194:172.21.15.194=c;count:3 2024-05-08T06:32:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:10 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:10 smithi070 ceph-mon[29591]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:32:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:11 smithi070 ceph-mon[29591]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:11 smithi070 ceph-mon[29591]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:32:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:12.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.799+0000 7f0c13e00700 1 -- 172.21.15.194:0/2390299162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 msgr2=0x7f0c14103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:12.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.799+0000 7f0c13e00700 1 --2- 172.21.15.194:0/2390299162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 0x7f0c14103330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009910 tx=0x7f0c04009c20 comp rx=0 tx=0).stop 2024-05-08T06:32:12.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.799+0000 7f0c13e00700 1 -- 172.21.15.194:0/2390299162 shutdown_connections 2024-05-08T06:32:12.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.799+0000 7f0c13e00700 1 --2- 172.21.15.194:0/2390299162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 0x7f0c14103330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:12.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.799+0000 7f0c13e00700 1 -- 172.21.15.194:0/2390299162 >> 172.21.15.194:0/2390299162 conn(0x7f0c140fe800 msgr2=0x7f0c14100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:12.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.799+0000 7f0c13e00700 1 -- 172.21.15.194:0/2390299162 shutdown_connections 2024-05-08T06:32:12.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.799+0000 7f0c13e00700 1 -- 172.21.15.194:0/2390299162 wait complete. 2024-05-08T06:32:12.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.800+0000 7f0c13e00700 1 Processor -- start 2024-05-08T06:32:12.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.800+0000 7f0c13e00700 1 -- start start 2024-05-08T06:32:12.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.801+0000 7f0c13e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 0x7f0c140757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:12.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.801+0000 7f0c13e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1410d080 con 0x7f0c14102f50 2024-05-08T06:32:12.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.802+0000 7f0c12a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 0x7f0c140757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:12.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.802+0000 7f0c12a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 0x7f0c140757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.194:36076/0 (socket says 172.21.15.194:36076) 2024-05-08T06:32:12.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.802+0000 7f0c12a00700 1 -- 172.21.15.194:0/2386816602 learned_addr learned my addr 172.21.15.194:0/2386816602 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:32:12.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.802+0000 7f0c12a00700 1 -- 172.21.15.194:0/2386816602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c14077690 con 0x7f0c14102f50 2024-05-08T06:32:12.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.803+0000 7f0c12a00700 1 --2- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 0x7f0c140757a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c04005660 tx=0x7f0c04005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:12.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.803+0000 7f0c0be00700 1 -- 172.21.15.194:0/2386816602 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c04026070 con 0x7f0c14102f50 2024-05-08T06:32:12.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.803+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c14075d40 con 0x7f0c14102f50 2024-05-08T06:32:12.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.803+0000 7f0c0be00700 1 -- 172.21.15.194:0/2386816602 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c0400b750 con 0x7f0c14102f50 2024-05-08T06:32:12.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.803+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c14076200 con 0x7f0c14102f50 2024-05-08T06:32:12.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.803+0000 7f0c0be00700 1 -- 172.21.15.194:0/2386816602 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c04003820 con 0x7f0c14102f50 2024-05-08T06:32:12.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.804+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c14104430 con 0x7f0c14102f50 2024-05-08T06:32:12.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.805+0000 7f0c0be00700 1 -- 172.21.15.194:0/2386816602 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f0c04029070 con 0x7f0c14102f50 2024-05-08T06:32:12.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.806+0000 7f0c0be00700 1 --2- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0bf803e510 0x7f0bf80409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:12.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.806+0000 7f0c0be00700 1 -- 172.21.15.194:0/2386816602 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0c0401e070 con 0x7f0c14102f50 2024-05-08T06:32:12.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.806+0000 7f0c0a000700 1 --2- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0bf803e510 0x7f0bf80409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:12.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.808+0000 7f0c0a000700 1 --2- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0bf803e510 0x7f0bf80409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc006fd0 tx=0x7f0bfc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:12.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:12.823+0000 7f0c0be00700 1 -- 172.21.15.194:0/2386816602 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0c04013070 con 0x7f0c14102f50 2024-05-08T06:32:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:12 smithi070 ceph-mon[29591]: Deploying daemon mon.c on smithi194 2024-05-08T06:32:13.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.152+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0c14076cd0 con 0x7f0c14102f50 2024-05-08T06:32:13.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.154+0000 7f0c0be00700 1 -- 172.21.15.194:0/2386816602 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f0c04034090 con 0x7f0c14102f50 2024-05-08T06:32:13.154 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:32:13.154 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":1,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","modified":"2024-05-08T06:30:00.612071Z","created":"2024-05-08T06:30:00.612071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.156+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0bf803e510 msgr2=0x7f0bf80409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.156+0000 7f0c13e00700 1 --2- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0bf803e510 0x7f0bf80409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc006fd0 tx=0x7f0bfc006e40 comp rx=0 tx=0).stop 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.156+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 msgr2=0x7f0c140757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.156+0000 7f0c13e00700 1 --2- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 0x7f0c140757a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0c04005660 tx=0x7f0c04005740 comp rx=0 tx=0).stop 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.157+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 shutdown_connections 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.157+0000 7f0c13e00700 1 --2- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0bf803e510 0x7f0bf80409d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.157+0000 7f0c13e00700 1 --2- 172.21.15.194:0/2386816602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0c14102f50 0x7f0c140757a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.157+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 >> 172.21.15.194:0/2386816602 conn(0x7f0c140fe800 msgr2=0x7f0c14104920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.157+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 shutdown_connections 2024-05-08T06:32:13.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:13.157+0000 7f0c13e00700 1 -- 172.21.15.194:0/2386816602 wait complete. 2024-05-08T06:32:13.158 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 1 2024-05-08T06:32:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:13 smithi070 ceph-mon[29591]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/2386816602' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:15.100 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T06:32:15.100 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T06:32:15.577 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:32:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:15 smithi070 ceph-mon[29591]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:16 smithi194 systemd[1]: Starting Ceph mon.c for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:32:17.650 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 podman[33655]: 2024-05-08 06:32:17.29707269 +0000 UTC m=+0.094816041 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:32:17.651 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 podman[33655]: 2024-05-08 06:32:17.490026545 +0000 UTC m=+0.287769898 container create b7a8571bfaf570d943aa8d595eefa8ab9601c4ad9adff8d77b709fbba8688ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-c, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2) 2024-05-08T06:32:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:17 smithi070 ceph-mon[29591]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.811+0000 7f5b40600700 1 -- 172.21.15.194:0/3872835465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 msgr2=0x7f5b381045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.811+0000 7f5b40600700 1 --2- 172.21.15.194:0/3872835465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 0x7f5b381045f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009910 tx=0x7f5b2c009c20 comp rx=0 tx=0).stop 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.811+0000 7f5b40600700 1 -- 172.21.15.194:0/3872835465 shutdown_connections 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.811+0000 7f5b40600700 1 --2- 172.21.15.194:0/3872835465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 0x7f5b381045f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.811+0000 7f5b40600700 1 -- 172.21.15.194:0/3872835465 >> 172.21.15.194:0/3872835465 conn(0x7f5b380fd980 msgr2=0x7f5b380ffda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.811+0000 7f5b40600700 1 -- 172.21.15.194:0/3872835465 shutdown_connections 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.811+0000 7f5b40600700 1 -- 172.21.15.194:0/3872835465 wait complete. 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.813+0000 7f5b40600700 1 Processor -- start 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.813+0000 7f5b40600700 1 -- start start 2024-05-08T06:32:17.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.814+0000 7f5b40600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 0x7f5b3819e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.814+0000 7f5b40600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b3810d390 con 0x7f5b38104210 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.814+0000 7f5b3dc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 0x7f5b3819e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.814+0000 7f5b3dc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 0x7f5b3819e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.194:44800/0 (socket says 172.21.15.194:44800) 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.814+0000 7f5b3dc00700 1 -- 172.21.15.194:0/2236866367 learned_addr learned my addr 172.21.15.194:0/2236866367 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.815+0000 7f5b3dc00700 1 -- 172.21.15.194:0/2236866367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3819eb90 con 0x7f5b38104210 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.815+0000 7f5b3dc00700 1 --2- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 0x7f5b3819e650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005060 tx=0x7f5b2c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.816+0000 7f5b36000700 1 -- 172.21.15.194:0/2236866367 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b2c026070 con 0x7f5b38104210 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.816+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b3819ee20 con 0x7f5b38104210 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.816+0000 7f5b36000700 1 -- 172.21.15.194:0/2236866367 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b2c00b750 con 0x7f5b38104210 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.816+0000 7f5b36000700 1 -- 172.21.15.194:0/2236866367 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b2c003850 con 0x7f5b38104210 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.816+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b381987d0 con 0x7f5b38104210 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.818+0000 7f5b36000700 1 -- 172.21.15.194:0/2236866367 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5b2c029070 con 0x7f5b38104210 2024-05-08T06:32:17.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.818+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b3806b640 con 0x7f5b38104210 2024-05-08T06:32:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.819+0000 7f5b36000700 1 --2- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b2003e510 0x7f5b200409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.819+0000 7f5b36000700 1 -- 172.21.15.194:0/2236866367 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5b2c01e070 con 0x7f5b38104210 2024-05-08T06:32:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.820+0000 7f5b3d200700 1 --2- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b2003e510 0x7f5b200409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.821+0000 7f5b3d200700 1 --2- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b2003e510 0x7f5b200409d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5b24006fd0 tx=0x7f5b24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.835+0000 7f5b36000700 1 -- 172.21.15.194:0/2236866367 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5b2c013070 con 0x7f5b38104210 2024-05-08T06:32:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:17.876+0000 7f5b36000700 1 -- 172.21.15.194:0/2236866367 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5b2c02a3b0 con 0x7f5b38104210 2024-05-08T06:32:17.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 podman[33655]: 2024-05-08 06:32:17.745137878 +0000 UTC m=+0.542881300 container init b7a8571bfaf570d943aa8d595eefa8ab9601c4ad9adff8d77b709fbba8688ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-c, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:32:17.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 podman[33655]: 2024-05-08 06:32:17.754558473 +0000 UTC m=+0.552301855 container start b7a8571bfaf570d943aa8d595eefa8ab9601c4ad9adff8d77b709fbba8688ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-c, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-08T06:32:17.937 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev), process ceph-mon, pid 2 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pidfile_write: ignore empty --pid-file 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: load: jerasure load: lrc 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: RocksDB version: 7.9.2 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Git sha 0 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Compile date 2024-05-07 11:18:56 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: DB SUMMARY 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: DB Session ID: GB8VBWOG2MPVL2FERJQ9 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: CURRENT file: CURRENT 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-08T06:32:17.938 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.error_if_exists: 0 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.create_if_missing: 0 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.paranoid_checks: 1 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.env: 0x55cfe4177cc0 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.info_log: 0x55d01a693de0 2024-05-08T06:32:17.939 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.statistics: (nil) 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.use_fsync: 0 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_log_file_size: 0 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.allow_fallocate: 1 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T06:32:17.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.use_direct_reads: 0 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.db_log_dir: 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.wal_dir: 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.write_buffer_manager: 0x55d01a6650e0 2024-05-08T06:32:17.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.unordered_write: 0 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.row_cache: None 2024-05-08T06:32:17.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.wal_filter: None 2024-05-08T06:32:17.943 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T06:32:17.943 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T06:32:17.943 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.two_write_queues: 0 2024-05-08T06:32:17.943 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T06:32:17.943 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.wal_compression: 0 2024-05-08T06:32:17.943 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.atomic_flush: 0 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.log_readahead_size: 0 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_background_jobs: 2 2024-05-08T06:32:17.944 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_background_compactions: -1 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_subcompactions: 1 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_open_files: -1 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T06:32:17.945 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_background_flushes: -1 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Compression algorithms supported: 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: kZSTD supported: 0 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: kXpressCompression supported: 0 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: kZlibCompression supported: 1 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: kSnappyCompression supported: 1 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: kLZ4Compression supported: 1 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: kBZip2Compression supported: 0 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-08T06:32:17.946 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.merge_operator: 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_filter: None 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d01a693fa0) 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks: 1 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout: pin_top_level_index_and_filter: 1 2024-05-08T06:32:17.947 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_type: 0 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_index_type: 0 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_shortening: 1 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: checksum: 4 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: no_block_cache: 0 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache: 0x55d01a6971f0 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_name: BinnedLRUCache 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_options: 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: capacity : 536870912 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_shard_bits : 4 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: strict_capacity_limit : 0 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: high_pri_pool_ratio: 0.000 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_cache_compressed: (nil) 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: persistent_cache: (nil) 2024-05-08T06:32:17.948 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size: 4096 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_size_deviation: 10 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_restart_interval: 16 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: index_block_restart_interval: 1 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: metadata_block_size: 4096 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: partition_filters: 0 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: use_delta_encoding: 1 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: filter_policy: bloomfilter 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: whole_key_filtering: 1 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: verify_compression: 0 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: read_amp_bytes_per_bit: 0 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: format_version: 5 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_index_compression: 1 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: block_align: 0 2024-05-08T06:32:17.949 INFO:journalctl@ceph.mon.c.smithi194.stdout: max_auto_readahead_size: 262144 2024-05-08T06:32:17.950 INFO:journalctl@ceph.mon.c.smithi194.stdout: prepopulate_block_cache: 0 2024-05-08T06:32:17.950 INFO:journalctl@ceph.mon.c.smithi194.stdout: initial_auto_readahead_size: 8192 2024-05-08T06:32:17.950 INFO:journalctl@ceph.mon.c.smithi194.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression: NoCompression 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.num_levels: 7 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 bash[33655]: b7a8571bfaf570d943aa8d595eefa8ab9601c4ad9adff8d77b709fbba8688ade 2024-05-08T06:32:17.951 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T06:32:17.952 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T06:32:17.953 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T06:32:17.954 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.inplace_update_support: 0 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T06:32:17.955 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.bloom_locality: 0 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.max_successive_merges: 0 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.ttl: 2592000 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.enable_blob_files: false 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.min_blob_size: 0 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T06:32:17.956 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9bec7e1d-6ef1-4f94-91bc-1c46923bede7 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715149937807949, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715149937808899, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715149937, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9bec7e1d-6ef1-4f94-91bc-1c46923bede7", "db_session_id": "GB8VBWOG2MPVL2FERJQ9", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715149937809180, "job": 1, "event": "recovery_finished"} 2024-05-08T06:32:17.957 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d01a7b4000 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: DB pointer 0x55d01a7a0000 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** DB Stats ** 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-05-08T06:32:17.958 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** Compaction Stats [default] ** 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-05-08T06:32:17.959 INFO:journalctl@ceph.mon.c.smithi194.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T06:32:17.960 INFO:journalctl@ceph.mon.c.smithi194.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T06:32:17.960 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T06:32:17.960 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T06:32:17.960 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T06:32:17.960 INFO:journalctl@ceph.mon.c.smithi194.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout: Cumulative compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout: Interval compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache BinnedLRUCache@0x55d01a6971f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: using public_addr v2:172.21.15.194:0/0 -> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: starting mon.c rank -1 at public addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] at bind addrs [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(???) e0 preinit fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 systemd[1]: Started Ceph mon.c for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:32:17.961 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).mds e1 new map 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout: e1 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout: legacy client fscid: -1 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout: 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout: No filesystems configured 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-08T06:32:17.962 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Deploying cephadm binary to smithi172 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Added host smithi172 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.963 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:17.964 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Deploying cephadm binary to smithi194 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Added host smithi194 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.965 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2856308944' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2856308944' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Updating smithi194:/etc/ceph/ceph.conf 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi172:172.21.15.172=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi172:172.21.15.172=b;smithi194:172.21.15.194=c;count:3 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:32:17.967 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: Deploying daemon mon.c on smithi194 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/2386816602' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:17.968 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:17 smithi194 ceph-mon[33679]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-08T06:32:18.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:18.185+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5b38064b00 con 0x7f5b38104210 2024-05-08T06:32:22.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.905+0000 7f5b36000700 1 -- 172.21.15.194:0/2236866367 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f5b2c030020 con 0x7f5b38104210 2024-05-08T06:32:22.906 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:32:22.906 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","modified":"2024-05-08T06:32:17.876395Z","created":"2024-05-08T06:30:00.612071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T06:32:22.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.909+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b2003e510 msgr2=0x7f5b200409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:22.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.909+0000 7f5b40600700 1 --2- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b2003e510 0x7f5b200409d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5b24006fd0 tx=0x7f5b24006e40 comp rx=0 tx=0).stop 2024-05-08T06:32:22.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.909+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 msgr2=0x7f5b3819e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:22.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.909+0000 7f5b40600700 1 --2- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 0x7f5b3819e650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005060 tx=0x7f5b2c005710 comp rx=0 tx=0).stop 2024-05-08T06:32:22.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.909+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 shutdown_connections 2024-05-08T06:32:22.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.909+0000 7f5b40600700 1 --2- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b2003e510 0x7f5b200409d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:22.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.909+0000 7f5b40600700 1 --2- 172.21.15.194:0/2236866367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b38104210 0x7f5b3819e650 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:22.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.909+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 >> 172.21.15.194:0/2236866367 conn(0x7f5b380fd980 msgr2=0x7f5b38104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:22.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.910+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 shutdown_connections 2024-05-08T06:32:22.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:22.910+0000 7f5b40600700 1 -- 172.21.15.194:0/2236866367 wait complete. 2024-05-08T06:32:22.912 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2024-05-08T06:32:23.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:32:23.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: mon.a calling monitor election 2024-05-08T06:32:23.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:23.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/2236866367' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:23.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: mon.c calling monitor election 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: monmap epoch 2 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: last_changed 2024-05-08T06:32:17.876395+0000 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: created 2024-05-08T06:30:00.612071+0000 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: min_mon_release 19 (squid) 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: election_strategy: 1 2024-05-08T06:32:23.227 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-05-08T06:32:23.228 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-05-08T06:32:23.228 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: fsmap 2024-05-08T06:32:23.228 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T06:32:23.228 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: mgrmap e13: x(active, since 68s) 2024-05-08T06:32:23.228 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T06:32:23.228 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:23.228 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: mon.a calling monitor election 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/2236866367' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: mon.c calling monitor election 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:23.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: monmap epoch 2 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: last_changed 2024-05-08T06:32:17.876395+0000 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: created 2024-05-08T06:30:00.612071+0000 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: min_mon_release 19 (squid) 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: election_strategy: 1 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: fsmap 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: mgrmap e13: x(active, since 68s) 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:23.288 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:24.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:23 smithi194 ceph-mon[33679]: Deploying daemon mon.b on smithi172 2024-05-08T06:32:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:24.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:24.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:24.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:24.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:23 smithi070 ceph-mon[29591]: Deploying daemon mon.b on smithi172 2024-05-08T06:32:24.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:24.601 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T06:32:24.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T06:32:25.041 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:32:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:24 smithi194 ceph-mon[33679]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:25.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:24 smithi070 ceph-mon[29591]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:26.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.904+0000 7f5f3d200700 1 -- 172.21.15.194:0/2539931869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f38075840 msgr2=0x7f5f38075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:26.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.904+0000 7f5f3d200700 1 --2- 172.21.15.194:0/2539931869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f38075840 0x7f5f38075c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009910 tx=0x7f5f28009c20 comp rx=0 tx=0).stop 2024-05-08T06:32:26.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.904+0000 7f5f3d200700 1 -- 172.21.15.194:0/2539931869 shutdown_connections 2024-05-08T06:32:26.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.904+0000 7f5f3d200700 1 --2- 172.21.15.194:0/2539931869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f38075840 0x7f5f38075c20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:26.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.904+0000 7f5f3d200700 1 -- 172.21.15.194:0/2539931869 >> 172.21.15.194:0/2539931869 conn(0x7f5f380fe950 msgr2=0x7f5f38100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:26.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.904+0000 7f5f3d200700 1 -- 172.21.15.194:0/2539931869 shutdown_connections 2024-05-08T06:32:26.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.904+0000 7f5f3d200700 1 -- 172.21.15.194:0/2539931869 wait complete. 2024-05-08T06:32:26.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.905+0000 7f5f3d200700 1 Processor -- start 2024-05-08T06:32:26.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.905+0000 7f5f3d200700 1 -- start start 2024-05-08T06:32:26.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.906+0000 7f5f3d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f38075840 0x7f5f3819ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:26.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.906+0000 7f5f3d200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 0x7f5f381a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:26.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.906+0000 7f5f3d200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f38113800 con 0x7f5f38075840 2024-05-08T06:32:26.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.906+0000 7f5f3d200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5f38113680 con 0x7f5f3819f4b0 2024-05-08T06:32:26.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f36a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 0x7f5f381a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:26.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f36a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 0x7f5f381a3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40888/0 (socket says 172.21.15.194:40888) 2024-05-08T06:32:26.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f36a00700 1 -- 172.21.15.194:0/3544858596 learned_addr learned my addr 172.21.15.194:0/3544858596 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:32:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f37400700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f38075840 0x7f5f3819ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f36a00700 1 -- 172.21.15.194:0/3544858596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 msgr2=0x7f5f381a3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-08T06:32:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f36a00700 1 -- 172.21.15.194:0/3544858596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 msgr2=0x7f5f381a3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T06:32:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f36a00700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 0x7f5f381a3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T06:32:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f36a00700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 0x7f5f381a3840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T06:32:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f37400700 1 -- 172.21.15.194:0/3544858596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 msgr2=0x7f5f381a3840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T06:32:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.907+0000 7f5f37400700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 0x7f5f381a3840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.908+0000 7f5f37400700 1 -- 172.21.15.194:0/3544858596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3819faf0 con 0x7f5f38075840 2024-05-08T06:32:26.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.908+0000 7f5f37400700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f38075840 0x7f5f3819ef70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009910 tx=0x7f5f28005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:26.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.908+0000 7f5f2fe00700 1 -- 172.21.15.194:0/3544858596 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5f28005dc0 con 0x7f5f38075840 2024-05-08T06:32:26.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.908+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f381a3d80 con 0x7f5f38075840 2024-05-08T06:32:26.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.909+0000 7f5f2fe00700 1 -- 172.21.15.194:0/3544858596 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f2800bdf0 con 0x7f5f38075840 2024-05-08T06:32:26.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.909+0000 7f5f2fe00700 1 -- 172.21.15.194:0/3544858596 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5f28022d30 con 0x7f5f38075840 2024-05-08T06:32:26.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.909+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f381a4280 con 0x7f5f38075840 2024-05-08T06:32:26.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.910+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f38076f80 con 0x7f5f38075840 2024-05-08T06:32:26.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.911+0000 7f5f2fe00700 1 -- 172.21.15.194:0/3544858596 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5f2802a070 con 0x7f5f38075840 2024-05-08T06:32:26.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.911+0000 7f5f2fe00700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f1c03e300 0x7f5f1c0407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:26.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.911+0000 7f5f2fe00700 1 -- 172.21.15.194:0/3544858596 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5f2801e030 con 0x7f5f38075840 2024-05-08T06:32:26.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.912+0000 7f5f36a00700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f1c03e300 0x7f5f1c0407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:26.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.913+0000 7f5f36a00700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f1c03e300 0x7f5f1c0407c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009180 tx=0x7f5f24008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:26.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:26.930+0000 7f5f2fe00700 1 -- 172.21.15.194:0/3544858596 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5f28013070 con 0x7f5f38075840 2024-05-08T06:32:27.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.260+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5f381a4530 con 0x7f5f38075840 2024-05-08T06:32:27.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:26 smithi194 ceph-mon[33679]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:27.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.261+0000 7f5f2fe00700 1 -- 172.21.15.194:0/3544858596 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f5f28031020 con 0x7f5f38075840 2024-05-08T06:32:27.262 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:32:27.262 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":2,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","modified":"2024-05-08T06:32:17.876395Z","created":"2024-05-08T06:30:00.612071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T06:32:27.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f1c03e300 msgr2=0x7f5f1c0407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:27.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f1c03e300 0x7f5f1c0407c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5f24009180 tx=0x7f5f24008040 comp rx=0 tx=0).stop 2024-05-08T06:32:27.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f38075840 msgr2=0x7f5f3819ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:27.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f38075840 0x7f5f3819ef70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009910 tx=0x7f5f28005780 comp rx=0 tx=0).stop 2024-05-08T06:32:27.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 shutdown_connections 2024-05-08T06:32:27.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f1c03e300 0x7f5f1c0407c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:27.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f38075840 0x7f5f3819ef70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:27.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 --2- 172.21.15.194:0/3544858596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3819f4b0 0x7f5f381a3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:27.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 >> 172.21.15.194:0/3544858596 conn(0x7f5f380fe950 msgr2=0x7f5f380fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:27.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 shutdown_connections 2024-05-08T06:32:27.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:27.266+0000 7f5f3d200700 1 -- 172.21.15.194:0/3544858596 wait complete. 2024-05-08T06:32:27.266 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 2 2024-05-08T06:32:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:26 smithi070 ceph-mon[29591]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:27 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/3544858596' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:28.327 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 podman[33357]: 2024-05-08 06:32:28.090113586 +0000 UTC m=+0.159045155 container create 561491463ef692c560f303a9b7fd6571a881aab86f95b554db959f7a36cc6725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-b, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:32:28.328 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 podman[33357]: 2024-05-08 06:32:28.327006922 +0000 UTC m=+0.395938501 container init 561491463ef692c560f303a9b7fd6571a881aab86f95b554db959f7a36cc6725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:32:28.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:27 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/3544858596' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 podman[33357]: 2024-05-08 06:32:28.336861609 +0000 UTC m=+0.405793185 container start 561491463ef692c560f303a9b7fd6571a881aab86f95b554db959f7a36cc6725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev), process ceph-mon, pid 2 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pidfile_write: ignore empty --pid-file 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: load: jerasure load: lrc 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: RocksDB version: 7.9.2 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Git sha 0 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Compile date 2024-05-07 11:18:56 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: DB SUMMARY 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: DB Session ID: VT2X55F2D4ER5QBSK21A 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: CURRENT file: CURRENT 2024-05-08T06:32:28.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.error_if_exists: 0 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.create_if_missing: 0 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.paranoid_checks: 1 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.env: 0x55e925a26cc0 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.info_log: 0x55e95e4d5de0 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T06:32:28.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.statistics: (nil) 2024-05-08T06:32:28.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.use_fsync: 0 2024-05-08T06:32:28.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_log_file_size: 0 2024-05-08T06:32:28.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T06:32:28.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T06:32:28.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T06:32:28.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T06:32:28.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.allow_fallocate: 1 2024-05-08T06:32:28.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T06:32:28.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T06:32:28.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.use_direct_reads: 0 2024-05-08T06:32:28.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T06:32:28.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T06:32:28.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.db_log_dir: 2024-05-08T06:32:28.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.wal_dir: 2024-05-08T06:32:28.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T06:32:28.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.write_buffer_manager: 0x55e95e4a70e0 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T06:32:28.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.unordered_write: 0 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.row_cache: None 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.wal_filter: None 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T06:32:28.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.two_write_queues: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.wal_compression: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.atomic_flush: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.log_readahead_size: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T06:32:28.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_background_jobs: 2 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_background_compactions: -1 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_subcompactions: 1 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_open_files: -1 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T06:32:28.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_background_flushes: -1 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Compression algorithms supported: 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: kZSTD supported: 0 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: kXpressCompression supported: 0 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: kZlibCompression supported: 1 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: kSnappyCompression supported: 1 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: kLZ4Compression supported: 1 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: kBZip2Compression supported: 0 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T06:32:28.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.merge_operator: 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_filter: None 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e95e4d5fa0) 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout: cache_index_and_filter_blocks: 1 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout: pin_top_level_index_and_filter: 1 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout: index_type: 0 2024-05-08T06:32:28.690 INFO:journalctl@ceph.mon.b.smithi172.stdout: data_block_index_type: 0 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: index_shortening: 1 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: checksum: 4 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: no_block_cache: 0 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache: 0x55e95e4d91f0 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache_name: BinnedLRUCache 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache_options: 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: capacity : 536870912 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: num_shard_bits : 4 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: strict_capacity_limit : 0 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: high_pri_pool_ratio: 0.000 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_cache_compressed: (nil) 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: persistent_cache: (nil) 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_size: 4096 2024-05-08T06:32:28.691 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_size_deviation: 10 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_restart_interval: 16 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: index_block_restart_interval: 1 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: metadata_block_size: 4096 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: partition_filters: 0 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: use_delta_encoding: 1 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: filter_policy: bloomfilter 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: whole_key_filtering: 1 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: verify_compression: 0 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: read_amp_bytes_per_bit: 0 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: format_version: 5 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: enable_index_compression: 1 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: block_align: 0 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: max_auto_readahead_size: 262144 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: prepopulate_block_cache: 0 2024-05-08T06:32:28.692 INFO:journalctl@ceph.mon.b.smithi172.stdout: initial_auto_readahead_size: 8192 2024-05-08T06:32:28.693 INFO:journalctl@ceph.mon.b.smithi172.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T06:32:28.693 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T06:32:28.693 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T06:32:28.693 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression: NoCompression 2024-05-08T06:32:28.693 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T06:32:28.693 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T06:32:28.693 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T06:32:28.693 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.num_levels: 7 2024-05-08T06:32:28.693 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T06:32:28.694 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T06:32:28.695 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T06:32:28.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T06:32:28.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.inplace_update_support: 0 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T06:32:28.698 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.bloom_locality: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.max_successive_merges: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.ttl: 2592000 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.enable_blob_files: false 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.min_blob_size: 0 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T06:32:28.699 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d2d98c33-de43-4329-aaec-cc7c9a91a479 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715149948394319, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715149948395524, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715149948, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d2d98c33-de43-4329-aaec-cc7c9a91a479", "db_session_id": "VT2X55F2D4ER5QBSK21A", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715149948395775, "job": 1, "event": "recovery_finished"} 2024-05-08T06:32:28.700 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e95e5f6000 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: DB pointer 0x55e95e5e2000 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** DB Stats ** 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T06:32:28.701 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** Compaction Stats [default] ** 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** Compaction Stats [default] ** 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T06:32:28.702 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: Cumulative compaction: 0.00 GB write, 0.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: Interval compaction: 0.00 GB write, 0.28 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: Block cache BinnedLRUCache@0x55e95e4d91f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T06:32:28.703 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: using public_addr v2:172.21.15.172:0/0 -> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: starting mon.b rank -1 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(???) e0 preinit fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 bash[33357]: 561491463ef692c560f303a9b7fd6571a881aab86f95b554db959f7a36cc6725 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 systemd[1]: Started Ceph mon.b for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).mds e1 new map 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout: e1 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout: legacy client fscid: -1 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout: 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout: No filesystems configured 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-08T06:32:28.704 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Deploying cephadm binary to smithi172 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.705 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Added host smithi172 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi194", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.706 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Deploying cephadm binary to smithi194 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Added host smithi194 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:32:28.707 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2856308944' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2856308944' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.708 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi194", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Updating smithi194:/etc/ceph/ceph.conf 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi172:172.21.15.172=b;smithi194:172.21.15.194=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi172:172.21.15.172=b;smithi194:172.21.15.194=c;count:3 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:32:28.709 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Deploying daemon mon.c on smithi194 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/2386816602' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:32:28.710 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.a calling monitor election 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/2236866367' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.c calling monitor election 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: monmap epoch 2 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:28.711 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: last_changed 2024-05-08T06:32:17.876395+0000 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: created 2024-05-08T06:30:00.612071+0000 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: min_mon_release 19 (squid) 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: election_strategy: 1 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: fsmap 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mgrmap e13: x(active, since 68s) 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:28.712 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: Deploying daemon mon.b on smithi172 2024-05-08T06:32:28.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:28.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:28.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/3544858596' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:28.713 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:28 smithi172 ceph-mon[33377]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-05-08T06:32:29.175 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T06:32:29.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T06:32:29.595 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: mon.a calling monitor election 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: mon.c calling monitor election 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: mon.b calling monitor election 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: monmap epoch 3 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: last_changed 2024-05-08T06:32:28.446677+0000 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: created 2024-05-08T06:30:00.612071+0000 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: min_mon_release 19 (squid) 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: election_strategy: 1 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-05-08T06:32:33.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: 2: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-05-08T06:32:33.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: fsmap 2024-05-08T06:32:33.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T06:32:33.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: mgrmap e13: x(active, since 79s) 2024-05-08T06:32:33.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T06:32:33.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:33.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: mon.a calling monitor election 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: mon.c calling monitor election 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: mon.b calling monitor election 2024-05-08T06:32:33.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: monmap epoch 3 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: last_changed 2024-05-08T06:32:28.446677+0000 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: created 2024-05-08T06:30:00.612071+0000 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: min_mon_release 19 (squid) 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: election_strategy: 1 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: 2: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: fsmap 2024-05-08T06:32:33.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T06:32:33.933 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: mgrmap e13: x(active, since 79s) 2024-05-08T06:32:33.933 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T06:32:33.933 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:33.933 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:32:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: mon.a calling monitor election 2024-05-08T06:32:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: mon.c calling monitor election 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: mon.b calling monitor election 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: monmap epoch 3 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: last_changed 2024-05-08T06:32:28.446677+0000 2024-05-08T06:32:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: created 2024-05-08T06:30:00.612071+0000 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: min_mon_release 19 (squid) 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: election_strategy: 1 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: 1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.c 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: 2: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.b 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: fsmap 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: mgrmap e13: x(active, since 79s) 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:34.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:34.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.711+0000 7fde5fe00700 1 -- 172.21.15.194:0/3608539314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde60105240 msgr2=0x7fde44005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:34.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.711+0000 7fde5fe00700 1 --2- 172.21.15.194:0/3608539314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde60105240 0x7fde44005610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde50005fa0 tx=0x7fde5000ffc0 comp rx=0 tx=0).stop 2024-05-08T06:32:34.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.711+0000 7fde5fe00700 1 -- 172.21.15.194:0/3608539314 shutdown_connections 2024-05-08T06:32:34.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.711+0000 7fde5fe00700 1 --2- 172.21.15.194:0/3608539314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde60105240 0x7fde44005610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:34.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.711+0000 7fde5fe00700 1 -- 172.21.15.194:0/3608539314 >> 172.21.15.194:0/3608539314 conn(0x7fde60100af0 msgr2=0x7fde60102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:34.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.712+0000 7fde5fe00700 1 -- 172.21.15.194:0/3608539314 shutdown_connections 2024-05-08T06:32:34.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.712+0000 7fde5fe00700 1 -- 172.21.15.194:0/3608539314 wait complete. 2024-05-08T06:32:34.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.713+0000 7fde5fe00700 1 Processor -- start 2024-05-08T06:32:34.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.713+0000 7fde5fe00700 1 -- start start 2024-05-08T06:32:34.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde60105240 0x7fde601a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:34.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde601a0c80 0x7fde6019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:34.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6019ae40 0x7fde6019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:34.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010cd80 con 0x7fde6019ae40 2024-05-08T06:32:34.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5fe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010cc00 con 0x7fde60105240 2024-05-08T06:32:34.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5fe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fde6010cf00 con 0x7fde601a0c80 2024-05-08T06:32:34.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6019ae40 0x7fde6019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:34.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6019ae40 0x7fde6019b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.194:39868/0 (socket says 172.21.15.194:39868) 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5f400700 1 -- 172.21.15.194:0/1544420678 learned_addr learned my addr 172.21.15.194:0/1544420678 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5ea00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde60105240 0x7fde601a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5ea00700 1 -- 172.21.15.194:0/1544420678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde60105240 msgr2=0x7fde601a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5ea00700 1 -- 172.21.15.194:0/1544420678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde60105240 msgr2=0x7fde601a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5ea00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde60105240 0x7fde601a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.714+0000 7fde5f400700 1 -- 172.21.15.194:0/1544420678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde601a0c80 msgr2=0x7fde6019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde5ea00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde60105240 0x7fde601a0740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde5f400700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde601a0c80 0x7fde6019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde5f400700 1 -- 172.21.15.194:0/1544420678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde60105240 msgr2=0x7fde601a0740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde5f400700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde60105240 0x7fde601a0740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde5f400700 1 -- 172.21.15.194:0/1544420678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde601a7610 con 0x7fde6019ae40 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde5f400700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6019ae40 0x7fde6019b2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde5800ba50 tx=0x7fde5800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde57400700 1 -- 172.21.15.194:0/1544420678 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde58019070 con 0x7fde6019ae40 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde57400700 1 -- 172.21.15.194:0/1544420678 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde58014440 con 0x7fde6019ae40 2024-05-08T06:32:34.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde601a7840 con 0x7fde6019ae40 2024-05-08T06:32:34.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.715+0000 7fde57400700 1 -- 172.21.15.194:0/1544420678 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde580075b0 con 0x7fde6019ae40 2024-05-08T06:32:34.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.716+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde601a7d80 con 0x7fde6019ae40 2024-05-08T06:32:34.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.717+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde60106720 con 0x7fde6019ae40 2024-05-08T06:32:34.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.717+0000 7fde57400700 1 -- 172.21.15.194:0/1544420678 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fde5801c070 con 0x7fde6019ae40 2024-05-08T06:32:34.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.718+0000 7fde57400700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fde3c03e9a0 0x7fde3c040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:34.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.718+0000 7fde57400700 1 -- 172.21.15.194:0/1544420678 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fde58051f80 con 0x7fde6019ae40 2024-05-08T06:32:34.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.718+0000 7fde5ea00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fde3c03e9a0 0x7fde3c040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:34.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.719+0000 7fde5ea00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fde3c03e9a0 0x7fde3c040e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fde500059d0 tx=0x7fde50005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:34.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:34.730+0000 7fde57400700 1 -- 172.21.15.194:0/1544420678 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fde58022170 con 0x7fde6019ae40 2024-05-08T06:32:34.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:34.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:34.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:34.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:34.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:32:35.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.096+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fde601a8150 con 0x7fde6019ae40 2024-05-08T06:32:35.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.098+0000 7fde57400700 1 -- 172.21.15.194:0/1544420678 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7fde58012c40 con 0x7fde6019ae40 2024-05-08T06:32:35.097 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-05-08T06:32:35.097 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":3,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","modified":"2024-05-08T06:32:28.446677Z","created":"2024-05-08T06:30:00.612071Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:3300","nonce":0},{"type":"v1","addr":"172.21.15.194:6789","nonce":0}]},"addr":"172.21.15.194:6789/0","public_addr":"172.21.15.194:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-08T06:32:35.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fde3c03e9a0 msgr2=0x7fde3c040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:35.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fde3c03e9a0 0x7fde3c040e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fde500059d0 tx=0x7fde50005960 comp rx=0 tx=0).stop 2024-05-08T06:32:35.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6019ae40 msgr2=0x7fde6019b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:35.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6019ae40 0x7fde6019b2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde5800ba50 tx=0x7fde5800be10 comp rx=0 tx=0).stop 2024-05-08T06:32:35.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 shutdown_connections 2024-05-08T06:32:35.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fde3c03e9a0 0x7fde3c040e60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:35.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde6019ae40 0x7fde6019b2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:35.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde60105240 0x7fde601a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:35.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 --2- 172.21.15.194:0/1544420678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde601a0c80 0x7fde6019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:35.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 >> 172.21.15.194:0/1544420678 conn(0x7fde60100af0 msgr2=0x7fde60108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:35.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 shutdown_connections 2024-05-08T06:32:35.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:35.101+0000 7fde5fe00700 1 -- 172.21.15.194:0/1544420678 wait complete. 2024-05-08T06:32:35.102 INFO:teuthology.orchestra.run.smithi194.stderr:dumped monmap epoch 3 2024-05-08T06:32:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:35 smithi070 ceph-mon[29591]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:35 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/1544420678' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:35.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:32:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:32:35.447+0000 7f16c1200700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-08T06:32:35.748 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:35 smithi194 ceph-mon[33679]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:35.748 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:35 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/1544420678' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:35 smithi172 ceph-mon[33377]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:35 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/1544420678' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T06:32:36.396 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-08T06:32:36.396 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-08T06:32:36.802 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:32:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:36 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:36 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:36 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:36 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:36 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:36 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:36 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:36 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:36 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:36 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:36 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:36 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:36 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:36 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:36 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:36 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:36 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:36 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: Updating smithi070:/etc/ceph/ceph.conf 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: Updating smithi194:/etc/ceph/ceph.conf 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: Updating smithi070:/etc/ceph/ceph.conf 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: Updating smithi194:/etc/ceph/ceph.conf 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: Updating smithi070:/etc/ceph/ceph.conf 2024-05-08T06:32:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-08T06:32:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: Updating smithi194:/etc/ceph/ceph.conf 2024-05-08T06:32:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:32:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:39.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T06:32:39.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:39.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T06:32:39.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T06:32:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:39.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.265+0000 7fd0f0a00700 1 -- 172.21.15.70:0/195092749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec0758d0 msgr2=0x7fd0ec075cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:39.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.265+0000 7fd0f0a00700 1 --2- 172.21.15.70:0/195092749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec0758d0 0x7fd0ec075cb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc009910 tx=0x7fd0dc009c20 comp rx=0 tx=0).stop 2024-05-08T06:32:39.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.265+0000 7fd0f0a00700 1 -- 172.21.15.70:0/195092749 shutdown_connections 2024-05-08T06:32:39.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.265+0000 7fd0f0a00700 1 --2- 172.21.15.70:0/195092749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec0758d0 0x7fd0ec075cb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:39.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.265+0000 7fd0f0a00700 1 -- 172.21.15.70:0/195092749 >> 172.21.15.70:0/195092749 conn(0x7fd0ec0fe9e0 msgr2=0x7fd0ec100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:39.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.265+0000 7fd0f0a00700 1 -- 172.21.15.70:0/195092749 shutdown_connections 2024-05-08T06:32:39.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.265+0000 7fd0f0a00700 1 -- 172.21.15.70:0/195092749 wait complete. 2024-05-08T06:32:39.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.267+0000 7fd0f0a00700 1 Processor -- start 2024-05-08T06:32:39.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.267+0000 7fd0f0a00700 1 -- start start 2024-05-08T06:32:39.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.267+0000 7fd0f0a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec0758d0 0x7fd0ec1a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:39.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.267+0000 7fd0f0a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ec1a0f80 0x7fd0ec19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:39.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.267+0000 7fd0f0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec19b0a0 0x7fd0ec19b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:39.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.267+0000 7fd0f0a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec10f4c0 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.267+0000 7fd0f0a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec10f340 con 0x7fd0ec0758d0 2024-05-08T06:32:39.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.267+0000 7fd0f0a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ec10f640 con 0x7fd0ec1a0f80 2024-05-08T06:32:39.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0ea800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec19b0a0 0x7fd0ec19b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:39.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0ea800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec19b0a0 0x7fd0ec19b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35954/0 (socket says 172.21.15.70:35954) 2024-05-08T06:32:39.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0ea800700 1 -- 172.21.15.70:0/1906074781 learned_addr learned my addr 172.21.15.70:0/1906074781 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0e9e00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec0758d0 0x7fd0ec1a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0e9400700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ec1a0f80 0x7fd0ec19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0ea800700 1 -- 172.21.15.70:0/1906074781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ec1a0f80 msgr2=0x7fd0ec19ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0ea800700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ec1a0f80 0x7fd0ec19ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0ea800700 1 -- 172.21.15.70:0/1906074781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec0758d0 msgr2=0x7fd0ec1a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0ea800700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec0758d0 0x7fd0ec1a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0ea800700 1 -- 172.21.15.70:0/1906074781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec1a77f0 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0e9e00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec0758d0 0x7fd0ec1a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.268+0000 7fd0ea800700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec19b0a0 0x7fd0ec19b550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400ba50 tx=0x7fd0e400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:39.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.269+0000 7fd0e2a00700 1 -- 172.21.15.70:0/1906074781 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4019070 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.269+0000 7fd0e2a00700 1 -- 172.21.15.70:0/1906074781 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0e4014440 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.269+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ec1a7a80 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.269+0000 7fd0e2a00700 1 -- 172.21.15.70:0/1906074781 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40075b0 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.269+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ec1a7fc0 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.270+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ec076f80 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.270+0000 7fd0e2a00700 1 -- 172.21.15.70:0/1906074781 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd0e401c070 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.271+0000 7fd0e2a00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0d003e9a0 0x7fd0d0040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.271+0000 7fd0e2a00700 1 -- 172.21.15.70:0/1906074781 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd0e4051f20 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.272+0000 7fd0e9e00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0d003e9a0 0x7fd0d0040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:39.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.272+0000 7fd0e9e00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0d003e9a0 0x7fd0d0040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc006010 tx=0x7fd0dc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:39.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.277+0000 7fd0e2a00700 1 -- 172.21.15.70:0/1906074781 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd0e40145f0 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.523+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd0ec1a82f0 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.523+0000 7fd0e2a00700 1 -- 172.21.15.70:0/1906074781 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7fd0e4053070 con 0x7fd0ec19b0a0 2024-05-08T06:32:39.523 INFO:teuthology.orchestra.run.smithi070.stdout:# minimal ceph.conf for 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:39.523 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-05-08T06:32:39.523 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:32:39.524 INFO:teuthology.orchestra.run.smithi070.stdout: mon_host = [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] 2024-05-08T06:32:39.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.526+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0d003e9a0 msgr2=0x7fd0d0040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:39.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.526+0000 7fd0f0a00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0d003e9a0 0x7fd0d0040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc006010 tx=0x7fd0dc01a040 comp rx=0 tx=0).stop 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.526+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec19b0a0 msgr2=0x7fd0ec19b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.526+0000 7fd0f0a00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec19b0a0 0x7fd0ec19b550 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400ba50 tx=0x7fd0e400be10 comp rx=0 tx=0).stop 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.527+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 shutdown_connections 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.527+0000 7fd0f0a00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd0d003e9a0 0x7fd0d0040e60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.527+0000 7fd0f0a00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0ec19b0a0 0x7fd0ec19b550 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.527+0000 7fd0f0a00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0ec0758d0 0x7fd0ec1a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.527+0000 7fd0f0a00700 1 --2- 172.21.15.70:0/1906074781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ec1a0f80 0x7fd0ec19ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.527+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 >> 172.21.15.70:0/1906074781 conn(0x7fd0ec0fe9e0 msgr2=0x7fd0ec109160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.527+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 shutdown_connections 2024-05-08T06:32:39.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:39.527+0000 7fd0f0a00700 1 -- 172.21.15.70:0/1906074781 wait complete. 2024-05-08T06:32:40.023 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:39 smithi070 ceph-mon[29591]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T06:32:40.023 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:39 smithi070 ceph-mon[29591]: Reconfiguring daemon mon.a on smithi070 2024-05-08T06:32:40.023 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:39 smithi070 ceph-mon[29591]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:40.023 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1906074781' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:39 smithi172 ceph-mon[33377]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T06:32:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:39 smithi172 ceph-mon[33377]: Reconfiguring daemon mon.a on smithi070 2024-05-08T06:32:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:39 smithi172 ceph-mon[33377]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1906074781' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:39 smithi194 ceph-mon[33679]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T06:32:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:39 smithi194 ceph-mon[33679]: Reconfiguring daemon mon.a on smithi070 2024-05-08T06:32:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:39 smithi194 ceph-mon[33679]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1906074781' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:40.930 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-08T06:32:40.930 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:32:40.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T06:32:41.013 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:32:41.013 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:32:41.143 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:32:41.143 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T06:32:41.215 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:32:41.215 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:32:41.324 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:32:41.324 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T06:32:41.406 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:32:41.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:32:41.528 INFO:tasks.cephadm:Adding mgr.x on smithi070 2024-05-08T06:32:41.529 INFO:tasks.cephadm:Adding mgr.y on smithi172 2024-05-08T06:32:41.529 INFO:tasks.cephadm:Adding mgr.z on smithi194 2024-05-08T06:32:41.529 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi070=x;smithi172=y;smithi194=z' 2024-05-08T06:32:41.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:41 smithi194 ceph-mon[33679]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:41.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:41.646 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:41.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:41 smithi194 ceph-mon[33679]: Reconfiguring mon.b (monmap changed)... 2024-05-08T06:32:41.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:41.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T06:32:41.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:41.647 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:41 smithi194 ceph-mon[33679]: Reconfiguring daemon mon.b on smithi172 2024-05-08T06:32:41.806 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:41 smithi172 ceph-mon[33377]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:41.806 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:41.806 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:41.806 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:41 smithi172 ceph-mon[33377]: Reconfiguring mon.b (monmap changed)... 2024-05-08T06:32:41.806 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:41.806 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T06:32:41.806 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:41.806 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:41 smithi172 ceph-mon[33377]: Reconfiguring daemon mon.b on smithi172 2024-05-08T06:32:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:41 smithi070 ceph-mon[29591]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:41 smithi070 ceph-mon[29591]: Reconfiguring mon.b (monmap changed)... 2024-05-08T06:32:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T06:32:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:41 smithi070 ceph-mon[29591]: Reconfiguring daemon mon.b on smithi172 2024-05-08T06:32:41.994 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:32:43.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:43 smithi194 ceph-mon[33679]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:43 smithi194 ceph-mon[33679]: Reconfiguring mon.c (monmap changed)... 2024-05-08T06:32:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T06:32:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:43 smithi194 ceph-mon[33679]: Reconfiguring daemon mon.c on smithi194 2024-05-08T06:32:43.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.784+0000 7f68f7000700 1 -- 172.21.15.194:0/1378009915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f01096b0 msgr2=0x7f68f0109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:43.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.784+0000 7f68f7000700 1 --2- 172.21.15.194:0/1378009915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f01096b0 0x7f68f0109ad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009910 tx=0x7f68e0009c20 comp rx=0 tx=0).stop 2024-05-08T06:32:43.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.784+0000 7f68f7000700 1 -- 172.21.15.194:0/1378009915 shutdown_connections 2024-05-08T06:32:43.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.784+0000 7f68f7000700 1 --2- 172.21.15.194:0/1378009915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f01096b0 0x7f68f0109ad0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:43.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.784+0000 7f68f7000700 1 -- 172.21.15.194:0/1378009915 >> 172.21.15.194:0/1378009915 conn(0x7f68f0078790 msgr2=0x7f68f007abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:43.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.785+0000 7f68f7000700 1 -- 172.21.15.194:0/1378009915 shutdown_connections 2024-05-08T06:32:43.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.785+0000 7f68f7000700 1 -- 172.21.15.194:0/1378009915 wait complete. 2024-05-08T06:32:43.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.786+0000 7f68f7000700 1 Processor -- start 2024-05-08T06:32:43.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.786+0000 7f68f7000700 1 -- start start 2024-05-08T06:32:43.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.786+0000 7f68f7000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68f01096b0 0x7f68f019ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:43.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.786+0000 7f68f7000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f019f1c0 0x7f68f01a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:43.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.786+0000 7f68f7000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68f019f640 0x7f68f01a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:43.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.786+0000 7f68f7000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68f010f440 con 0x7f68f019f1c0 2024-05-08T06:32:43.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.786+0000 7f68f7000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f68f010f2c0 con 0x7f68f01096b0 2024-05-08T06:32:43.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.786+0000 7f68f7000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f68f010f5c0 con 0x7f68f019f640 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68f5000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68f019f640 0x7f68f01a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68f5000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68f019f640 0x7f68f01a67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:52870/0 (socket says 172.21.15.194:52870) 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68f5000700 1 -- 172.21.15.194:0/3172790104 learned_addr learned my addr 172.21.15.194:0/3172790104 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68ef400700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f019f1c0 0x7f68f01a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68efe00700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68f01096b0 0x7f68f019ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68f5000700 1 -- 172.21.15.194:0/3172790104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68f01096b0 msgr2=0x7f68f019ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68f5000700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68f01096b0 0x7f68f019ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68f5000700 1 -- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f019f1c0 msgr2=0x7f68f01a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68f5000700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f019f1c0 0x7f68f01a4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68f5000700 1 -- 172.21.15.194:0/3172790104 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f01a70d0 con 0x7f68f019f640 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68efe00700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68f01096b0 0x7f68f019ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:32:43.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.787+0000 7f68f5000700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68f019f640 0x7f68f01a67d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f68e800ba50 tx=0x7f68e800be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:43.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.788+0000 7f68ecc00700 1 -- 172.21.15.194:0/3172790104 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e8019070 con 0x7f68f019f640 2024-05-08T06:32:43.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.788+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f01a73c0 con 0x7f68f019f640 2024-05-08T06:32:43.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.788+0000 7f68ecc00700 1 -- 172.21.15.194:0/3172790104 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68e8014440 con 0x7f68f019f640 2024-05-08T06:32:43.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.788+0000 7f68ecc00700 1 -- 172.21.15.194:0/3172790104 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e80075b0 con 0x7f68f019f640 2024-05-08T06:32:43.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.788+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f01a7980 con 0x7f68f019f640 2024-05-08T06:32:43.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.789+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f0064b00 con 0x7f68f019f640 2024-05-08T06:32:43.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.789+0000 7f68ecc00700 1 -- 172.21.15.194:0/3172790104 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f68e801c070 con 0x7f68f019f640 2024-05-08T06:32:43.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.790+0000 7f68ecc00700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f68d403e9a0 0x7f68d4040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:43.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.790+0000 7f68ecc00700 1 -- 172.21.15.194:0/3172790104 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f68e8051ef0 con 0x7f68f019f640 2024-05-08T06:32:43.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.791+0000 7f68efe00700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f68d403e9a0 0x7f68d4040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:43.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.792+0000 7f68efe00700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f68d403e9a0 0x7f68d4040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68e0000c00 tx=0x7f68e0005190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:43.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:43.796+0000 7f68ecc00700 1 -- 172.21.15.194:0/3172790104 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f68e8014910 con 0x7f68f019f640 2024-05-08T06:32:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:43 smithi070 ceph-mon[29591]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:43 smithi070 ceph-mon[29591]: Reconfiguring mon.c (monmap changed)... 2024-05-08T06:32:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T06:32:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:43 smithi070 ceph-mon[29591]: Reconfiguring daemon mon.c on smithi194 2024-05-08T06:32:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:43 smithi172 ceph-mon[33377]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:43 smithi172 ceph-mon[33377]: Reconfiguring mon.c (monmap changed)... 2024-05-08T06:32:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T06:32:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T06:32:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:43 smithi172 ceph-mon[33377]: Reconfiguring daemon mon.c on smithi194 2024-05-08T06:32:44.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.031+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi172=y;smithi194=z", "target": ["mon-mgr", ""]}) -- 0x7f68f0063a30 con 0x7f68d403e9a0 2024-05-08T06:32:44.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.045+0000 7f68ecc00700 1 -- 172.21.15.194:0/3172790104 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f68f0063a30 con 0x7f68d403e9a0 2024-05-08T06:32:44.044 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mgr update... 2024-05-08T06:32:44.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f68d403e9a0 msgr2=0x7f68d4040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:44.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f68d403e9a0 0x7f68d4040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f68e0000c00 tx=0x7f68e0005190 comp rx=0 tx=0).stop 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68f019f640 msgr2=0x7f68f01a67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68f019f640 0x7f68f01a67d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f68e800ba50 tx=0x7f68e800be10 comp rx=0 tx=0).stop 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 shutdown_connections 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68f019f640 0x7f68f01a67d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68f01096b0 0x7f68f019ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f68d403e9a0 0x7f68d4040e60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 --2- 172.21.15.194:0/3172790104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68f019f1c0 0x7f68f01a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 >> 172.21.15.194:0/3172790104 conn(0x7f68f0078790 msgr2=0x7f68f0079490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 shutdown_connections 2024-05-08T06:32:44.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:32:44.048+0000 7f68f7000700 1 -- 172.21.15.194:0/3172790104 wait complete. 2024-05-08T06:32:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:45 smithi070 ceph-mon[29591]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:45 smithi070 ceph-mon[29591]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi172=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:45 smithi070 ceph-mon[29591]: Saving service mgr spec with placement smithi070=x;smithi172=y;smithi194=z;count:3 2024-05-08T06:32:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:45 smithi172 ceph-mon[33377]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:45 smithi172 ceph-mon[33377]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi172=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:45 smithi172 ceph-mon[33377]: Saving service mgr spec with placement smithi070=x;smithi172=y;smithi194=z;count:3 2024-05-08T06:32:45.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:45 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:45 smithi194 ceph-mon[33679]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:45.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:45 smithi194 ceph-mon[33679]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi172=y;smithi194=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:45.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:45 smithi194 ceph-mon[33679]: Saving service mgr spec with placement smithi070=x;smithi172=y;smithi194=z;count:3 2024-05-08T06:32:45.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:45 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:45.557 DEBUG:teuthology.orchestra.run.smithi172:mgr.y> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.y.service 2024-05-08T06:32:45.565 DEBUG:teuthology.orchestra.run.smithi194:mgr.z> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.z.service 2024-05-08T06:32:45.570 INFO:tasks.cephadm:Deploying OSDs... 2024-05-08T06:32:45.570 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:32:45.570 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T06:32:45.627 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T06:32:45.627 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-05-08T06:32:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T06:32:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:45.678 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-08T06:32:45.678 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:45.678 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:45.678 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-08 06:31:30.829429886 +0000 2024-05-08T06:32:45.678 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-08 06:24:52.063919715 +0000 2024-05-08T06:32:45.678 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-08 06:24:52.063919715 +0000 2024-05-08T06:32:45.678 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-08 06:24:52.063919715 +0000 2024-05-08T06:32:45.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T06:32:45.756 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-08T06:32:45.756 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-08T06:32:45.756 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000268688 s, 1.9 MB/s 2024-05-08T06:32:45.760 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T06:32:45.812 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-05-08T06:32:45.863 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T06:32:45.863 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:45.863 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-08T06:32:45.863 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:45.864 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:45.864 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-08 06:31:30.876428520 +0000 2024-05-08T06:32:45.864 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-08 06:24:52.610904025 +0000 2024-05-08T06:32:45.864 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-08 06:24:52.610904025 +0000 2024-05-08T06:32:45.864 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-08 06:24:52.610904025 +0000 2024-05-08T06:32:45.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T06:32:45.938 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-08T06:32:45.939 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-08T06:32:45.939 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000291513 s, 1.8 MB/s 2024-05-08T06:32:45.941 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T06:32:45.995 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-05-08T06:32:46.040 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T06:32:46.040 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:46.040 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-08T06:32:46.041 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:46.041 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:46.041 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-08 06:31:30.928427010 +0000 2024-05-08T06:32:46.041 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-08 06:24:53.214886700 +0000 2024-05-08T06:32:46.041 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-08 06:24:53.214886700 +0000 2024-05-08T06:32:46.041 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-08 06:24:53.214886700 +0000 2024-05-08T06:32:46.041 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T06:32:46.164 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-08T06:32:46.164 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-08T06:32:46.164 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000278915 s, 1.8 MB/s 2024-05-08T06:32:46.168 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T06:32:46.223 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-05-08T06:32:46.271 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T06:32:46.273 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:46.273 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-05-08T06:32:46.273 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:46.273 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:46.273 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-08 06:31:30.984425384 +0000 2024-05-08T06:32:46.273 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-08 06:24:53.783870379 +0000 2024-05-08T06:32:46.274 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-08 06:24:53.783870379 +0000 2024-05-08T06:32:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-05-08 06:24:53.783870379 +0000 2024-05-08T06:32:46.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T06:32:46.347 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-05-08T06:32:46.348 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-05-08T06:32:46.348 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000200012 s, 2.6 MB/s 2024-05-08T06:32:46.352 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T06:32:46.406 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2024-05-08T06:32:46.407 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T06:32:46.465 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T06:32:46.465 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2024-05-08T06:32:46.517 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T06:32:46.517 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:46.517 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-05-08T06:32:46.517 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:46.517 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:46.517 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-08 06:32:27.549300971 +0000 2024-05-08T06:32:46.517 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-08 06:24:43.060063685 +0000 2024-05-08T06:32:46.517 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-08 06:24:43.060063685 +0000 2024-05-08T06:32:46.518 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-08 06:24:43.060063685 +0000 2024-05-08T06:32:46.518 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T06:32:46.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:46.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:46.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:46.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:46.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:46.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:46.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T06:32:46.582 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T06:32:46.582 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T06:32:46.582 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:46.582 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:46 smithi172 ceph-mon[33377]: Deploying daemon mgr.z on smithi194 2024-05-08T06:32:46.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-08T06:32:46.589 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-08T06:32:46.589 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000347893 s, 1.5 MB/s 2024-05-08T06:32:46.592 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:46.592 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:46.592 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:46.592 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:46.592 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:46.592 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:46.592 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T06:32:46.592 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T06:32:46.593 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T06:32:46.593 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:46.593 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:46 smithi194 ceph-mon[33679]: Deploying daemon mgr.z on smithi194 2024-05-08T06:32:46.594 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T06:32:46.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:46.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:46.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:46.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:46.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:46.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:46.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T06:32:46.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T06:32:46.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T06:32:46.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:46.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:46 smithi070 ceph-mon[29591]: Deploying daemon mgr.z on smithi194 2024-05-08T06:32:46.650 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2024-05-08T06:32:46.702 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T06:32:46.702 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:46.702 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-08T06:32:46.702 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:46.702 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:46.703 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-08 06:32:27.549300971 +0000 2024-05-08T06:32:46.703 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-08 06:24:43.653049616 +0000 2024-05-08T06:32:46.703 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-08 06:24:43.653049616 +0000 2024-05-08T06:32:46.703 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-08 06:24:43.653049616 +0000 2024-05-08T06:32:46.703 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T06:32:46.782 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-08T06:32:46.783 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-08T06:32:46.783 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000375404 s, 1.4 MB/s 2024-05-08T06:32:46.787 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T06:32:46.843 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2024-05-08T06:32:46.893 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T06:32:46.893 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:46.894 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-08T06:32:46.894 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:46.894 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:46.894 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-08 06:32:27.550300948 +0000 2024-05-08T06:32:46.894 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-08 06:24:44.260035215 +0000 2024-05-08T06:32:46.894 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-08 06:24:44.260035215 +0000 2024-05-08T06:32:46.894 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-08 06:24:44.260035215 +0000 2024-05-08T06:32:46.894 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T06:32:46.971 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-08T06:32:46.971 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-08T06:32:46.971 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000351376 s, 1.5 MB/s 2024-05-08T06:32:46.974 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T06:32:47.029 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2024-05-08T06:32:47.074 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T06:32:47.074 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:47.074 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-05-08T06:32:47.074 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:47.075 INFO:teuthology.orchestra.run.smithi172.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:47.075 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2024-05-08 06:32:27.551300924 +0000 2024-05-08T06:32:47.075 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2024-05-08 06:24:44.840021454 +0000 2024-05-08T06:32:47.075 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2024-05-08 06:24:44.840021454 +0000 2024-05-08T06:32:47.075 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: 2024-05-08 06:24:44.840021454 +0000 2024-05-08T06:32:47.076 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T06:32:47.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2024-05-08T06:32:47.198 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2024-05-08T06:32:47.198 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000360725 s, 1.4 MB/s 2024-05-08T06:32:47.201 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T06:32:47.257 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-05-08T06:32:47.257 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T06:32:47.313 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T06:32:47.313 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-05-08T06:32:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T06:32:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:47.358 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-08T06:32:47.358 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:47.358 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:47.358 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-05-08 06:32:16.785900645 +0000 2024-05-08T06:32:47.358 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-05-08 06:24:43.102993019 +0000 2024-05-08T06:32:47.358 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-05-08 06:24:43.103992999 +0000 2024-05-08T06:32:47.358 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-05-08 06:24:43.102993019 +0000 2024-05-08T06:32:47.359 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T06:32:47.393 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:47 smithi194 ceph-mon[33679]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:47.466 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-05-08T06:32:47.466 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-05-08T06:32:47.466 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000357231 s, 1.4 MB/s 2024-05-08T06:32:47.471 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T06:32:47.519 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-05-08T06:32:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T06:32:47.560 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:47.560 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-08T06:32:47.560 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:47.560 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:47.560 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-05-08 06:32:16.786900625 +0000 2024-05-08T06:32:47.560 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-05-08 06:24:43.692981272 +0000 2024-05-08T06:32:47.561 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-05-08 06:24:43.692981272 +0000 2024-05-08T06:32:47.561 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-05-08 06:24:43.692981272 +0000 2024-05-08T06:32:47.561 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T06:32:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:47 smithi070 ceph-mon[29591]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:47 smithi172 ceph-mon[33377]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:47.775 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-05-08T06:32:47.775 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-05-08T06:32:47.775 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000382615 s, 1.3 MB/s 2024-05-08T06:32:47.778 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T06:32:47.828 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-05-08T06:32:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T06:32:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:47.870 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-08T06:32:47.870 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:47.870 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:47.870 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-05-08 06:32:47.681302496 +0000 2024-05-08T06:32:47.870 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-05-08 06:24:44.315968869 +0000 2024-05-08T06:32:47.870 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-05-08 06:24:44.315968869 +0000 2024-05-08T06:32:47.870 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-05-08 06:24:44.315968869 +0000 2024-05-08T06:32:47.871 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T06:32:48.077 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-05-08T06:32:48.077 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-05-08T06:32:48.077 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000315802 s, 1.6 MB/s 2024-05-08T06:32:48.083 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T06:32:48.129 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-05-08T06:32:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T06:32:48.207 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T06:32:48.208 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-05-08T06:32:48.208 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:32:48.208 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T06:32:48.208 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-05-08 06:32:47.991296494 +0000 2024-05-08T06:32:48.208 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-05-08 06:24:44.871957800 +0000 2024-05-08T06:32:48.208 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-05-08 06:24:44.871957800 +0000 2024-05-08T06:32:48.208 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-05-08 06:24:44.871957800 +0000 2024-05-08T06:32:48.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T06:32:48.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:48 smithi194 systemd[1]: Starting Ceph mgr.z for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:32:48.306 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-05-08T06:32:48.306 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-05-08T06:32:48.306 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000292132 s, 1.8 MB/s 2024-05-08T06:32:48.309 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T06:32:48.389 INFO:tasks.cephadm:Deploying osd.0 on smithi070 with /dev/vg_nvme/lv_4... 2024-05-08T06:32:48.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T06:32:48.643 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:48 smithi194 podman[35532]: 2024-05-08 06:32:48.363791279 +0000 UTC m=+0.032211006 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:32:48.644 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:48 smithi194 podman[35532]: 2024-05-08 06:32:48.47944787 +0000 UTC m=+0.147867633 container create 16d92c7bdac7463f25c4f5beff194c4dd20316efd18fab5b1db96893ef096a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-08T06:32:48.829 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:32:49.030 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:48 smithi194 podman[35532]: 2024-05-08 06:32:48.77453961 +0000 UTC m=+0.442959383 container init 16d92c7bdac7463f25c4f5beff194c4dd20316efd18fab5b1db96893ef096a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-08T06:32:49.030 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:48 smithi194 podman[35532]: 2024-05-08 06:32:48.78678538 +0000 UTC m=+0.455205150 container start 16d92c7bdac7463f25c4f5beff194c4dd20316efd18fab5b1db96893ef096a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-08T06:32:49.030 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:48 smithi194 ceph-mgr[35570]: -- 172.21.15.194:0/70503844 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ca6860c5a0 con 0x55ca685e0c00 2024-05-08T06:32:49.031 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:48 smithi194 bash[35532]: 16d92c7bdac7463f25c4f5beff194c4dd20316efd18fab5b1db96893ef096a99 2024-05-08T06:32:49.031 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:48 smithi194 systemd[1]: Started Ceph mgr.z for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:32:49.290 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:49.030+0000 7f3e8f466200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T06:32:49.290 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:49.290+0000 7f3e8f466200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:32:49.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:49 smithi070 ceph-mon[29591]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:49.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:49.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:49.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T06:32:49.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:49 smithi172 ceph-mon[33377]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:49.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T06:32:49.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T06:32:49.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T06:32:49.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:49.760 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:49.422+0000 7f3e8f466200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T06:32:49.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:49 smithi194 ceph-mon[33679]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:49.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:49.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:49.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:49.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T06:32:49.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T06:32:49.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T06:32:49.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:50.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:49.817+0000 7f3e8f466200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T06:32:50.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:49.930+0000 7f3e8f466200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T06:32:50.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:50 smithi070 ceph-mon[29591]: Deploying daemon mgr.y on smithi172 2024-05-08T06:32:50.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:50 smithi172 ceph-mon[33377]: Deploying daemon mgr.y on smithi172 2024-05-08T06:32:50.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:50 smithi194 ceph-mon[33679]: Deploying daemon mgr.y on smithi172 2024-05-08T06:32:51.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:51 smithi070 ceph-mon[29591]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:51.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:51 smithi172 ceph-mon[33377]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:51.684 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T06:32:51.685 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T06:32:51.685 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2024-05-08T06:32:51.685 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2024-05-08T06:32:51.685 INFO:teuthology.orchestra.run.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0334731 s, 313 MB/s 2024-05-08T06:32:51.685 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2024-05-08T06:32:51.732 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:51 smithi194 ceph-mon[33679]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:51.733 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:51.502+0000 7f3e8f466200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T06:32:52.010 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:51.733+0000 7f3e8f466200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T06:32:52.011 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:51.948+0000 7f3e8f466200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T06:32:52.180 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:51 smithi172 systemd[1]: Starting Ceph mgr.y for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:32:52.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_4 2024-05-08T06:32:52.548 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:52 smithi172 podman[34725]: 2024-05-08 06:32:52.265660546 +0000 UTC m=+0.129583036 container create 1705bf982e23683c78f41ab1c01f6f728e8a6745c6d42bbc38ab4167630f3568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-05-08T06:32:52.548 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:52 smithi172 podman[34725]: 2024-05-08 06:32:52.171870482 +0000 UTC m=+0.035792948 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:32:52.548 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:52 smithi172 podman[34725]: 2024-05-08 06:32:52.486480651 +0000 UTC m=+0.350403162 container init 1705bf982e23683c78f41ab1c01f6f728e8a6745c6d42bbc38ab4167630f3568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-08T06:32:52.548 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:52 smithi172 podman[34725]: 2024-05-08 06:32:52.498619441 +0000 UTC m=+0.362541918 container start 1705bf982e23683c78f41ab1c01f6f728e8a6745c6d42bbc38ab4167630f3568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:32:52.708 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:52.330+0000 7f3e8f466200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T06:32:52.708 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:52.453+0000 7f3e8f466200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T06:32:52.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:52 smithi172 ceph-mgr[34744]: -- 172.21.15.172:0/3569882704 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604bd1865a0 con 0x5604bd15ac00 2024-05-08T06:32:52.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:52 smithi172 bash[34725]: 1705bf982e23683c78f41ab1c01f6f728e8a6745c6d42bbc38ab4167630f3568 2024-05-08T06:32:52.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:52 smithi172 systemd[1]: Started Ceph mgr.y for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:32:52.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:52 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:52.737+0000 7f3c815af200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T06:32:52.941 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:32:52.963 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:52.708+0000 7f3e8f466200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T06:32:53.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:52.963+0000 7f3e8f466200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:32:53.429 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:53.004+0000 7f3c815af200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:32:53.429 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:53.146+0000 7f3c815af200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T06:32:53.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:53.574+0000 7f3c815af200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T06:32:53.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:53.690+0000 7f3c815af200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T06:32:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:53 smithi172 ceph-mon[33377]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:54.010 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:53.803+0000 7f3e8f466200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T06:32:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:53 smithi194 ceph-mon[33679]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:54.074 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:53 smithi070 ceph-mon[29591]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:54.075 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:54.075 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:54.075 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:54.075 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:54.075 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:32:54.510 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:54.120+0000 7f3e8f466200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T06:32:54.827 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:54.685+0000 7f3e8f466200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T06:32:55.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.026+0000 7fd6b1600700 1 -- 172.21.15.70:0/3784677943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 msgr2=0x7fd6ac106310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:55.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.026+0000 7fd6b1600700 1 --2- 172.21.15.70:0/3784677943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 0x7fd6ac106310 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009990 tx=0x7fd69c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:32:55.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.026+0000 7fd6b1600700 1 -- 172.21.15.70:0/3784677943 shutdown_connections 2024-05-08T06:32:55.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.026+0000 7fd6b1600700 1 --2- 172.21.15.70:0/3784677943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6ac109180 0x7fd6ac10b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:55.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.026+0000 7fd6b1600700 1 --2- 172.21.15.70:0/3784677943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 0x7fd6ac106310 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:55.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.026+0000 7fd6b1600700 1 --2- 172.21.15.70:0/3784677943 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ac106850 0x7fd6ac108c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:55.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.026+0000 7fd6b1600700 1 -- 172.21.15.70:0/3784677943 >> 172.21.15.70:0/3784677943 conn(0x7fd6ac0fd8d0 msgr2=0x7fd6ac0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:32:55.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.026+0000 7fd6b1600700 1 -- 172.21.15.70:0/3784677943 shutdown_connections 2024-05-08T06:32:55.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.026+0000 7fd6b1600700 1 -- 172.21.15.70:0/3784677943 wait complete. 2024-05-08T06:32:55.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.027+0000 7fd6b1600700 1 Processor -- start 2024-05-08T06:32:55.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6b1600700 1 -- start start 2024-05-08T06:32:55.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6b1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 0x7fd6ac103880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:55.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6b1600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ac106850 0x7fd6ac101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6b1600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6ac109180 0x7fd6ac102410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6b1600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac10edf0 con 0x7fd6ac103f20 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6b1600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac10ec70 con 0x7fd6ac106850 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6b1600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ac10ef70 con 0x7fd6ac109180 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6abe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 0x7fd6ac103880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6abe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 0x7fd6ac103880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52184/0 (socket says 172.21.15.70:52184) 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6abe00700 1 -- 172.21.15.70:0/2701823559 learned_addr learned my addr 172.21.15.70:0/2701823559 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6ab400700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ac106850 0x7fd6ac101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.028+0000 7fd6b0c00700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6ac109180 0x7fd6ac102410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6abe00700 1 -- 172.21.15.70:0/2701823559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6ac109180 msgr2=0x7fd6ac102410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6abe00700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6ac109180 0x7fd6ac102410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:55.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6abe00700 1 -- 172.21.15.70:0/2701823559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ac106850 msgr2=0x7fd6ac101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6abe00700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ac106850 0x7fd6ac101ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6abe00700 1 -- 172.21.15.70:0/2701823559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ac102cc0 con 0x7fd6ac103f20 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6abe00700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 0x7fd6ac103880 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005910 tx=0x7fd69c00bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6a8c00700 1 -- 172.21.15.70:0/2701823559 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c026070 con 0x7fd6ac103f20 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6a8c00700 1 -- 172.21.15.70:0/2701823559 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd69c003d20 con 0x7fd6ac103f20 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ac1a36c0 con 0x7fd6ac103f20 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.029+0000 7fd6a8c00700 1 -- 172.21.15.70:0/2701823559 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69c021410 con 0x7fd6ac103f20 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.030+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ac1a3b10 con 0x7fd6ac103f20 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.031+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6ac06a190 con 0x7fd6ac103f20 2024-05-08T06:32:55.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.031+0000 7fd6a8c00700 1 -- 172.21.15.70:0/2701823559 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd69c029070 con 0x7fd6ac103f20 2024-05-08T06:32:55.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.031+0000 7fd6a8c00700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd69003e750 0x7fd690040c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:32:55.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.031+0000 7fd6a8c00700 1 -- 172.21.15.70:0/2701823559 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd69c053810 con 0x7fd6ac103f20 2024-05-08T06:32:55.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.031+0000 7fd6ab400700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd69003e750 0x7fd690040c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:32:55.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.032+0000 7fd6ab400700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd69003e750 0x7fd690040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd698007be0 tx=0x7fd6980073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:32:55.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.037+0000 7fd6a8c00700 1 -- 172.21.15.70:0/2701823559 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd69c013070 con 0x7fd6ac103f20 2024-05-08T06:32:55.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:54 smithi070 ceph-mon[29591]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:55.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:54.828+0000 7f3e8f466200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T06:32:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:54 smithi194 ceph-mon[33679]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:55.281+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fd6ac0638e0 con 0x7fd69003e750 2024-05-08T06:32:55.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:55 smithi172 ceph-mon[33377]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:55.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.370 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.371 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:55.679 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:55.369+0000 7f3c815af200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T06:32:55.679 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:55.605+0000 7f3c815af200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T06:32:55.750 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:55 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:55.302+0000 7f3e8f466200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T06:32:55.750 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:55 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:55.750+0000 7f3e8f466200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T06:32:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:56 smithi194 ceph-mon[33679]: from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:32:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:32:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:56.011 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:55 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:55.873+0000 7f3e8f466200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T06:32:56.179 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:55.826+0000 7f3c815af200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T06:32:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:56 smithi172 ceph-mon[33377]: from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:32:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:32:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:56.255 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:55 smithi070 ceph-mon[29591]: from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:32:56.255 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:32:56.255 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:32:56.255 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:56.510 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:56.194+0000 7f3e8f466200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T06:32:56.511 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:56.376+0000 7f3e8f466200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T06:32:56.511 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:56.511+0000 7f3e8f466200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T06:32:56.589 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:56.212+0000 7f3c815af200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T06:32:56.589 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:56.338+0000 7f3c815af200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T06:32:56.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:56.589+0000 7f3c815af200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T06:32:56.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:56.839+0000 7f3c815af200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:32:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:57 smithi194 ceph-mon[33679]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:57 smithi194 ceph-mon[33679]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:57 smithi194 ceph-mon[33679]: Reconfiguring daemon mgr.x on smithi070 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:56.913+0000 7f3e8f466200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T06:32:57.261 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:57 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:57.038+0000 7f3e8f466200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T06:32:57.265 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:57 smithi070 ceph-mon[29591]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:57.265 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:57.265 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:57.265 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:57.265 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:57 smithi070 ceph-mon[29591]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T06:32:57.265 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T06:32:57.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T06:32:57.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:57.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:57 smithi070 ceph-mon[29591]: Reconfiguring daemon mgr.x on smithi070 2024-05-08T06:32:57.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:57 smithi172 ceph-mon[33377]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:57.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:57.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:32:57.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:32:57.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:57 smithi172 ceph-mon[33377]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T06:32:57.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T06:32:57.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T06:32:57.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:32:57.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:57 smithi172 ceph-mon[33377]: Reconfiguring daemon mgr.x on smithi070 2024-05-08T06:32:57.911 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:57 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:57.629+0000 7f3c815af200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T06:32:57.911 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:57 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:57.911+0000 7f3c815af200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T06:32:57.954 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:57 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:57.837+0000 7f3e8f466200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T06:32:58.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:32:58 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:32:58.129+0000 7f3e8f466200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T06:32:58.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:58 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:58.463+0000 7f3c815af200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T06:32:58.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:58 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:58.590+0000 7f3c815af200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T06:32:59.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:32:59.039+0000 7fd6a8c00700 1 -- 172.21.15.70:0/2701823559 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7fd69c009d10 con 0x7fd6ac103f20 2024-05-08T06:32:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:59 smithi194 ceph-mon[33679]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:59 smithi194 ceph-mon[33679]: Standby manager daemon z started 2024-05-08T06:32:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:59 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T06:32:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:59 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:32:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:59 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T06:32:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:32:59 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:32:59.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:59 smithi070 ceph-mon[29591]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:59.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:59 smithi070 ceph-mon[29591]: Standby manager daemon z started 2024-05-08T06:32:59.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:59 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T06:32:59.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:59 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:32:59.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:59 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T06:32:59.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:32:59 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:32:59.429 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:59.076+0000 7f3c815af200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T06:32:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:59 smithi172 ceph-mon[33377]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:32:59.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:59 smithi172 ceph-mon[33377]: Standby manager daemon z started 2024-05-08T06:32:59.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:59 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T06:32:59.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:59 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:32:59.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:59 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T06:32:59.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:32:59 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.194:0/4259709384' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:32:59.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:59.527+0000 7f3c815af200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T06:32:59.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:59.650+0000 7f3c815af200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T06:33:00.280 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:32:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:32:59.970+0000 7f3c815af200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T06:33:00.280 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:33:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:33:00.152+0000 7f3c815af200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T06:33:00.281 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:33:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:33:00.280+0000 7f3c815af200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T06:33:00.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:00 smithi172 ceph-mon[33377]: mgrmap e14: x(active, since 105s), standbys: z 2024-05-08T06:33:00.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T06:33:00.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:00 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/994576058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4faccd2-51f5-4d97-bf21-732ac8e6ff4f"}]: dispatch 2024-05-08T06:33:00.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:00 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/994576058' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4faccd2-51f5-4d97-bf21-732ac8e6ff4f"}]': finished 2024-05-08T06:33:00.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:00 smithi172 ceph-mon[33377]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T06:33:00.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:00.281 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:00 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/547231880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:33:00.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:00 smithi070 ceph-mon[29591]: mgrmap e14: x(active, since 105s), standbys: z 2024-05-08T06:33:00.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T06:33:00.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:00 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/994576058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4faccd2-51f5-4d97-bf21-732ac8e6ff4f"}]: dispatch 2024-05-08T06:33:00.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:00 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/994576058' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4faccd2-51f5-4d97-bf21-732ac8e6ff4f"}]': finished 2024-05-08T06:33:00.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:00 smithi070 ceph-mon[29591]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T06:33:00.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:00.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:00 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/547231880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:33:00.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:00 smithi194 ceph-mon[33679]: mgrmap e14: x(active, since 105s), standbys: z 2024-05-08T06:33:00.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T06:33:00.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:00 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/994576058' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4faccd2-51f5-4d97-bf21-732ac8e6ff4f"}]: dispatch 2024-05-08T06:33:00.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:00 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/994576058' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4faccd2-51f5-4d97-bf21-732ac8e6ff4f"}]': finished 2024-05-08T06:33:00.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:00 smithi194 ceph-mon[33679]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T06:33:00.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:00.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:00 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/547231880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:33:01.139 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:33:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:33:00.682+0000 7f3c815af200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T06:33:01.139 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:33:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:33:00.807+0000 7f3c815af200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T06:33:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:01 smithi172 ceph-mon[33377]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:01 smithi194 ceph-mon[33679]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:01 smithi070 ceph-mon[29591]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:01.850 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:33:01 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:33:01.566+0000 7f3c815af200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T06:33:01.850 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:33:01 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:33:01.850+0000 7f3c815af200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T06:33:02.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:02.170+0000 7fd6a8c00700 1 -- 172.21.15.70:0/2701823559 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fd69c02a3b0 con 0x7fd6ac103f20 2024-05-08T06:33:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:02 smithi172 ceph-mon[33377]: Standby manager daemon y started 2024-05-08T06:33:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:02 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T06:33:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:02 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:33:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:02 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T06:33:02.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:02 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:33:02.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:02 smithi194 ceph-mon[33679]: Standby manager daemon y started 2024-05-08T06:33:02.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:02 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T06:33:02.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:02 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:33:02.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:02 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T06:33:02.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:02 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:33:02.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:02 smithi070 ceph-mon[29591]: Standby manager daemon y started 2024-05-08T06:33:02.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:02 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T06:33:02.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:02 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:33:02.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:02 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T06:33:02.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:02 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.172:0/3719388306' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:33:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:03 smithi172 ceph-mon[33377]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:03 smithi172 ceph-mon[33377]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-05-08T06:33:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T06:33:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:03 smithi194 ceph-mon[33679]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:03.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:03 smithi194 ceph-mon[33679]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-05-08T06:33:03.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T06:33:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:03 smithi070 ceph-mon[29591]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:03.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:03 smithi070 ceph-mon[29591]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-05-08T06:33:03.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T06:33:05.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:05 smithi070 ceph-mon[29591]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:05 smithi172 ceph-mon[33377]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:05 smithi194 ceph-mon[33679]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:06 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:06 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:06.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:06 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:06.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:06 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:06.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:06 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:06.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:06 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:07.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:06 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:07.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:06 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:07.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:06 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:07.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:07 smithi070 ceph-mon[29591]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:07.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:07.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:07.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:07 smithi172 ceph-mon[33377]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:07 smithi194 ceph-mon[33679]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:09 smithi172 ceph-mon[33377]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T06:33:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:09 smithi172 ceph-mon[33377]: Deploying daemon osd.0 on smithi070 2024-05-08T06:33:09.991 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:09 smithi070 ceph-mon[29591]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:09.992 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T06:33:09.992 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:09.992 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:09 smithi070 ceph-mon[29591]: Deploying daemon osd.0 on smithi070 2024-05-08T06:33:10.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:09 smithi194 ceph-mon[33679]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:10.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T06:33:10.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:10.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:09 smithi194 ceph-mon[33679]: Deploying daemon osd.0 on smithi070 2024-05-08T06:33:11.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:11 smithi070 ceph-mon[29591]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:11 smithi172 ceph-mon[33377]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:11 smithi194 ceph-mon[33679]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:13 smithi070 ceph-mon[29591]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:13 smithi172 ceph-mon[33377]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:13 smithi194 ceph-mon[33679]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:15 smithi172 ceph-mon[33377]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:16.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:15 smithi194 ceph-mon[33679]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:16.075 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:15 smithi070 ceph-mon[29591]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:17.929 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:17 smithi070 ceph-mon[29591]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:17.929 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:17.929 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:17.929 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:17 smithi172 ceph-mon[33377]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:17 smithi194 ceph-mon[33679]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:19 smithi172 ceph-mon[33377]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:19 smithi194 ceph-mon[33679]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:20.075 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:19 smithi070 ceph-mon[29591]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:21.771 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:21 smithi070 ceph-mon[29591]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:21.771 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:21 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:21.771 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:21 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:21.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:21 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:21.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:21 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:21.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:21 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:21.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:21 smithi070 ceph-mon[29591]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T06:33:21.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.878+0000 7fd6a8c00700 1 -- 172.21.15.70:0/2701823559 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd6ac0638e0 con 0x7fd69003e750 2024-05-08T06:33:21.879 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 0 on host 'smithi070' 2024-05-08T06:33:21.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd69003e750 msgr2=0x7fd690040c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:33:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd69003e750 0x7fd690040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd698007be0 tx=0x7fd6980073d0 comp rx=0 tx=0).stop 2024-05-08T06:33:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 msgr2=0x7fd6ac103880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:33:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 0x7fd6ac103880 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005910 tx=0x7fd69c00bb20 comp rx=0 tx=0).stop 2024-05-08T06:33:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 shutdown_connections 2024-05-08T06:33:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6ac109180 0x7fd6ac102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd69003e750 0x7fd690040c10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd6ac103f20 0x7fd6ac103880 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:21.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 --2- 172.21.15.70:0/2701823559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd6ac106850 0x7fd6ac101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 >> 172.21.15.70:0/2701823559 conn(0x7fd6ac0fd8d0 msgr2=0x7fd6ac105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:33:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.882+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 shutdown_connections 2024-05-08T06:33:21.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:33:21.883+0000 7fd6b1600700 1 -- 172.21.15.70:0/2701823559 wait complete. 2024-05-08T06:33:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:21 smithi172 ceph-mon[33377]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:21 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:21 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:21 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:21 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:21 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:21 smithi172 ceph-mon[33377]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T06:33:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:21 smithi194 ceph-mon[33679]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:21 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:21 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:21 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:21 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:21 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:21 smithi194 ceph-mon[33679]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T06:33:22.727 DEBUG:teuthology.orchestra.run.smithi070:osd.0> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.0.service 2024-05-08T06:33:22.731 INFO:tasks.cephadm:Deploying osd.1 on smithi172 with /dev/vg_nvme/lv_4... 2024-05-08T06:33:22.731 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T06:33:22.927 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:22 smithi070 ceph-mon[29591]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T06:33:22.927 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:22 smithi070 ceph-mon[29591]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T06:33:22.927 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:22 smithi070 ceph-mon[29591]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:33:22.927 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:22.928 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:22.928 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:22.928 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:22 smithi194 ceph-mon[33679]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T06:33:23.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:22 smithi194 ceph-mon[33679]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T06:33:23.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:22 smithi194 ceph-mon[33679]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:33:23.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:23.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:23.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:23.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:23.164 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:33:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:22 smithi172 ceph-mon[33377]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T06:33:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:22 smithi172 ceph-mon[33377]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T06:33:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:22 smithi172 ceph-mon[33377]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:33:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:23.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:23.629 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:33:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0[43849]: 2024-05-08T06:33:23.400+0000 7fc908400700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T06:33:23.630 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:33:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0[43849]: 2024-05-08T06:33:23.419+0000 7fc8fe200700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T06:33:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:23 smithi172 ceph-mon[33377]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:23.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:23 smithi172 ceph-mon[33377]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:33:23.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:23 smithi172 ceph-mon[33377]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T06:33:23.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:23 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:23.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:23 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:23.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:23 smithi172 ceph-mon[33377]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' 2024-05-08T06:33:24.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:23 smithi194 ceph-mon[33679]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:23 smithi194 ceph-mon[33679]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:33:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:23 smithi194 ceph-mon[33679]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T06:33:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:23 smithi194 ceph-mon[33679]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' 2024-05-08T06:33:24.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:23 smithi070 ceph-mon[29591]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:24.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:23 smithi070 ceph-mon[29591]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:33:24.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:23 smithi070 ceph-mon[29591]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T06:33:24.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:24.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:24.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:23 smithi070 ceph-mon[29591]: from='osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504]' entity='osd.0' 2024-05-08T06:33:24.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:24 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:33:24.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:24 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:33:24.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:24 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:24.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:24 smithi172 ceph-mon[33377]: osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] boot 2024-05-08T06:33:24.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:24 smithi172 ceph-mon[33377]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T06:33:24.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:24 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:24.980 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:24 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:33:24.980 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:24 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:33:24.980 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:24 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:24.981 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:24 smithi070 ceph-mon[29591]: osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] boot 2024-05-08T06:33:24.981 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:24 smithi070 ceph-mon[29591]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T06:33:24.981 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:24 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:24 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:33:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:24 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:33:25.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:24 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:25.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:24 smithi194 ceph-mon[33679]: osd.0 [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] boot 2024-05-08T06:33:25.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:24 smithi194 ceph-mon[33679]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T06:33:25.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:24 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:33:25.850 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T06:33:25.850 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T06:33:25.850 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-08T06:33:25.851 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-08T06:33:25.851 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0357609 s, 293 MB/s 2024-05-08T06:33:25.851 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-08T06:33:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:25 smithi194 ceph-mon[33679]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:26.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:25 smithi070 ceph-mon[29591]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:26.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:25 smithi172 ceph-mon[33377]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T06:33:26.629 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2024-05-08T06:33:26.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:26 smithi172 ceph-mon[33377]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T06:33:26.993 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:26 smithi070 ceph-mon[29591]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T06:33:27.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:26 smithi194 ceph-mon[33679]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T06:33:27.050 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:33:27.979 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:27 smithi172 ceph-mon[33377]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:28.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:27 smithi194 ceph-mon[33679]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:28.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:27 smithi070 ceph-mon[29591]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:29.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.035+0000 7f37c1000700 1 -- 172.21.15.172:0/476209398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc1046c0 msgr2=0x7f37bc104b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:33:29.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.035+0000 7f37c1000700 1 --2- 172.21.15.172:0/476209398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc1046c0 0x7f37bc104b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009990 tx=0x7f37a8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:33:29.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.035+0000 7f37c1000700 1 -- 172.21.15.172:0/476209398 shutdown_connections 2024-05-08T06:33:29.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.035+0000 7f37c1000700 1 --2- 172.21.15.172:0/476209398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc105060 0x7f37bc10b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:29.036 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.035+0000 7f37c1000700 1 --2- 172.21.15.172:0/476209398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc1016e0 0x7f37bc101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:29.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.035+0000 7f37c1000700 1 --2- 172.21.15.172:0/476209398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc1046c0 0x7f37bc104b20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:29.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.035+0000 7f37c1000700 1 -- 172.21.15.172:0/476209398 >> 172.21.15.172:0/476209398 conn(0x7f37bc0fd040 msgr2=0x7f37bc0ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:33:29.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.035+0000 7f37c1000700 1 -- 172.21.15.172:0/476209398 shutdown_connections 2024-05-08T06:33:29.037 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.036+0000 7f37c1000700 1 -- 172.21.15.172:0/476209398 wait complete. 2024-05-08T06:33:29.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.037+0000 7f37c1000700 1 Processor -- start 2024-05-08T06:33:29.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.038+0000 7f37c1000700 1 -- start start 2024-05-08T06:33:29.038 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.038+0000 7f37c1000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc1016e0 0x7f37bc19b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:33:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.038+0000 7f37c1000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc1046c0 0x7f37bc19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:33:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.038+0000 7f37c1000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc105060 0x7f37bc1a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:33:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.038+0000 7f37c1000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc10edb0 con 0x7f37bc1046c0 2024-05-08T06:33:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.038+0000 7f37c1000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc10ec30 con 0x7f37bc105060 2024-05-08T06:33:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.038+0000 7f37c1000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc10ef30 con 0x7f37bc1016e0 2024-05-08T06:33:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bb400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc1016e0 0x7f37bc19b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:33:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc105060 0x7f37bc1a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:33:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37baa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc1046c0 0x7f37bc19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:33:29.039 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bb400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc1016e0 0x7f37bc19b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.172:46212/0 (socket says 172.21.15.172:46212) 2024-05-08T06:33:29.040 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bb400700 1 -- 172.21.15.172:0/2429702509 learned_addr learned my addr 172.21.15.172:0/2429702509 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-08T06:33:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bbe00700 1 -- 172.21.15.172:0/2429702509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc1016e0 msgr2=0x7f37bc19b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:33:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bbe00700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc1016e0 0x7f37bc19b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bbe00700 1 -- 172.21.15.172:0/2429702509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc1046c0 msgr2=0x7f37bc19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:33:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bbe00700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc1046c0 0x7f37bc19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:29.041 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bbe00700 1 -- 172.21.15.172:0/2429702509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc1a32f0 con 0x7f37bc105060 2024-05-08T06:33:29.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.039+0000 7f37bbe00700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc105060 0x7f37bc1a2c50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f37b4007f10 tx=0x7f37b400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:33:29.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.040+0000 7f37b3e00700 1 -- 172.21.15.172:0/2429702509 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b4004db0 con 0x7f37bc105060 2024-05-08T06:33:29.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.040+0000 7f37b3e00700 1 -- 172.21.15.172:0/2429702509 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37b4009e20 con 0x7f37bc105060 2024-05-08T06:33:29.042 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.040+0000 7f37b3e00700 1 -- 172.21.15.172:0/2429702509 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b4015400 con 0x7f37bc105060 2024-05-08T06:33:29.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.040+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37bc1a35e0 con 0x7f37bc105060 2024-05-08T06:33:29.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.040+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37bc1a3ad0 con 0x7f37bc105060 2024-05-08T06:33:29.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.041+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37bc06a190 con 0x7f37bc105060 2024-05-08T06:33:29.043 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.043+0000 7f37b3e00700 1 -- 172.21.15.172:0/2429702509 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f37b400db20 con 0x7f37bc105060 2024-05-08T06:33:29.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.045+0000 7f37b3e00700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2870 0x7f37a00b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:33:29.045 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.045+0000 7f37b3e00700 1 -- 172.21.15.172:0/2429702509 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f37b40e08c0 con 0x7f37bc105060 2024-05-08T06:33:29.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.045+0000 7f37bb400700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2870 0x7f37a00b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:33:29.046 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.046+0000 7f37bb400700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2870 0x7f37a00b4d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00bd70 tx=0x7f37ac00b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:33:29.048 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.048+0000 7f37b3e00700 1 -- 172.21.15.172:0/2429702509 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f37b4010070 con 0x7f37bc105060 2024-05-08T06:33:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi070 2024-05-08T06:33:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:33:29.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 17089M 2024-05-08T06:33:29.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:29.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:29.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi070 2024-05-08T06:33:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:33:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 17089M 2024-05-08T06:33:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.289 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:29.289+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f37bc103bd0 con 0x7f37a00b2870 2024-05-08T06:33:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi070 2024-05-08T06:33:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:33:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 17089M 2024-05-08T06:33:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:29.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:29.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:29.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:30.251 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:29 smithi172 ceph-mon[33377]: from='client.34139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:33:30.251 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:33:30.251 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:33:30.251 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:29 smithi194 ceph-mon[33679]: from='client.34139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:33:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:33:30.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:33:30.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:29 smithi070 ceph-mon[29591]: from='client.34139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:33:30.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:33:30.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:33:30.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:31.243 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:30 smithi172 ceph-mon[33377]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:30 smithi194 ceph-mon[33679]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:30 smithi070 ceph-mon[29591]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:32 smithi194 ceph-mon[33679]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:33.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:32 smithi070 ceph-mon[29591]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:33.379 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:32 smithi172 ceph-mon[33377]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:33 smithi194 ceph-mon[33679]: from='client.? 172.21.15.172:0/2092596997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad6b1754-8896-4721-8647-38c40794418b"}]: dispatch 2024-05-08T06:33:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:33 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad6b1754-8896-4721-8647-38c40794418b"}]: dispatch 2024-05-08T06:33:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:33 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad6b1754-8896-4721-8647-38c40794418b"}]': finished 2024-05-08T06:33:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:33 smithi194 ceph-mon[33679]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T06:33:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:33 smithi194 ceph-mon[33679]: from='client.? 172.21.15.172:0/187320614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:33:34.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:33 smithi070 ceph-mon[29591]: from='client.? 172.21.15.172:0/2092596997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad6b1754-8896-4721-8647-38c40794418b"}]: dispatch 2024-05-08T06:33:34.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:33 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad6b1754-8896-4721-8647-38c40794418b"}]: dispatch 2024-05-08T06:33:34.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:33 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad6b1754-8896-4721-8647-38c40794418b"}]': finished 2024-05-08T06:33:34.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:33 smithi070 ceph-mon[29591]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T06:33:34.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:34.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:33 smithi070 ceph-mon[29591]: from='client.? 172.21.15.172:0/187320614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:33 smithi172 ceph-mon[33377]: from='client.? 172.21.15.172:0/2092596997' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad6b1754-8896-4721-8647-38c40794418b"}]: dispatch 2024-05-08T06:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:33 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad6b1754-8896-4721-8647-38c40794418b"}]: dispatch 2024-05-08T06:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:33 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad6b1754-8896-4721-8647-38c40794418b"}]': finished 2024-05-08T06:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:33 smithi172 ceph-mon[33377]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T06:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:34.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:33 smithi172 ceph-mon[33377]: from='client.? 172.21.15.172:0/187320614' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:33:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:35 smithi070 ceph-mon[29591]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:35 smithi172 ceph-mon[33377]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:35 smithi194 ceph-mon[33679]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:37 smithi070 ceph-mon[29591]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:37.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:37 smithi172 ceph-mon[33377]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:37 smithi194 ceph-mon[33679]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:39.113 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:39 smithi172 ceph-mon[33377]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:39 smithi194 ceph-mon[33679]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:39 smithi070 ceph-mon[29591]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:41.351 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:41 smithi172 ceph-mon[33377]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:41 smithi070 ceph-mon[29591]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:41 smithi194 ceph-mon[33679]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:42.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:42 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T06:33:42.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:42 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:42.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:42 smithi070 ceph-mon[29591]: Deploying daemon osd.1 on smithi172 2024-05-08T06:33:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:42 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T06:33:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:42 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:42 smithi172 ceph-mon[33377]: Deploying daemon osd.1 on smithi172 2024-05-08T06:33:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:42 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T06:33:42.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:42 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:42.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:42 smithi194 ceph-mon[33679]: Deploying daemon osd.1 on smithi172 2024-05-08T06:33:43.234 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:43 smithi172 ceph-mon[33377]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:43 smithi070 ceph-mon[29591]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:43 smithi194 ceph-mon[33679]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:45 smithi070 ceph-mon[29591]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:45.383 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:45 smithi172 ceph-mon[33377]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:45 smithi194 ceph-mon[33679]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:47 smithi070 ceph-mon[29591]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:47 smithi172 ceph-mon[33377]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:47 smithi194 ceph-mon[33679]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:49.294 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:49 smithi172 ceph-mon[33377]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:49 smithi070 ceph-mon[29591]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:49 smithi194 ceph-mon[33679]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:50.754 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:50 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:50.755 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:50 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:50.755 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:50 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:50.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:50 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:50.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:50 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:50.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:50 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:50 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:50 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:51.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:50 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:51.802 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:51 smithi172 ceph-mon[33377]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:51 smithi070 ceph-mon[29591]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:51 smithi194 ceph-mon[33679]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:53 smithi070 ceph-mon[29591]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:53.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:53 smithi070 ceph-mon[29591]: from='osd.1 [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T06:33:53.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:53 smithi070 ceph-mon[29591]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T06:33:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:53 smithi172 ceph-mon[33377]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:53 smithi172 ceph-mon[33377]: from='osd.1 [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T06:33:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:53 smithi172 ceph-mon[33377]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T06:33:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:53 smithi194 ceph-mon[33679]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:33:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:33:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:53 smithi194 ceph-mon[33679]: from='osd.1 [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T06:33:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:53 smithi194 ceph-mon[33679]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T06:33:54.098 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.099+0000 7f37b3e00700 1 -- 172.21.15.172:0/2429702509 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f37bc103bd0 con 0x7f37a00b2870 2024-05-08T06:33:54.099 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 1 on host 'smithi172' 2024-05-08T06:33:54.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2870 msgr2=0x7f37a00b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:33:54.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2870 0x7f37a00b4d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00bd70 tx=0x7f37ac00b4a0 comp rx=0 tx=0).stop 2024-05-08T06:33:54.102 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc105060 msgr2=0x7f37bc1a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:33:54.103 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc105060 0x7f37bc1a2c50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f37b4007f10 tx=0x7f37b400d3b0 comp rx=0 tx=0).stop 2024-05-08T06:33:54.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 shutdown_connections 2024-05-08T06:33:54.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc105060 0x7f37bc1a2c50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:54.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc1016e0 0x7f37bc19b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:54.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2870 0x7f37a00b4d30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:54.104 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 --2- 172.21.15.172:0/2429702509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc1046c0 0x7f37bc19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:33:54.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.103+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 >> 172.21.15.172:0/2429702509 conn(0x7f37bc0fd040 msgr2=0x7f37bc1024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:33:54.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.104+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 shutdown_connections 2024-05-08T06:33:54.105 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:33:54.104+0000 7f37c1000700 1 -- 172.21.15.172:0/2429702509 wait complete. 2024-05-08T06:33:54.987 DEBUG:teuthology.orchestra.run.smithi172:osd.1> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.1.service 2024-05-08T06:33:54.992 INFO:tasks.cephadm:Deploying osd.2 on smithi194 with /dev/vg_nvme/lv_4... 2024-05-08T06:33:54.992 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T06:33:55.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:54 smithi070 ceph-mon[29591]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T06:33:55.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:54 smithi070 ceph-mon[29591]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T06:33:55.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:55.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:54 smithi070 ceph-mon[29591]: from='osd.1 [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:33:55.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:54 smithi070 ceph-mon[29591]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:33:55.058 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:54 smithi070 ceph-mon[29591]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:55.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:55.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:55.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:54 smithi172 ceph-mon[33377]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T06:33:55.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:54 smithi172 ceph-mon[33377]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T06:33:55.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:54 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:55.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:54 smithi172 ceph-mon[33377]: from='osd.1 [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:33:55.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:54 smithi172 ceph-mon[33377]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:33:55.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:54 smithi172 ceph-mon[33377]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:55.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:54 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:55.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:54 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:55.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:54 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:54 smithi194 ceph-mon[33679]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T06:33:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:54 smithi194 ceph-mon[33679]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T06:33:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:54 smithi194 ceph-mon[33679]: from='osd.1 [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:33:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:54 smithi194 ceph-mon[33679]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:33:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:54 smithi194 ceph-mon[33679]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:33:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:33:55.411 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:33:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:55 smithi172 ceph-mon[33377]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:33:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:55 smithi172 ceph-mon[33377]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T06:33:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:55 smithi194 ceph-mon[33679]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:33:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:55 smithi194 ceph-mon[33679]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T06:33:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:55 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:55 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:56.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:55 smithi070 ceph-mon[29591]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:33:56.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:55 smithi070 ceph-mon[29591]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T06:33:56.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:56.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:57.230 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:56 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:33:57.230 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:56 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:33:57.231 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:56 smithi194 ceph-mon[33679]: osd.1 [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] boot 2024-05-08T06:33:57.231 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:56 smithi194 ceph-mon[33679]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T06:33:57.231 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:57.231 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:56 smithi194 ceph-mon[33679]: pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:57.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:56 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:33:57.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:56 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:33:57.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:56 smithi172 ceph-mon[33377]: osd.1 [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] boot 2024-05-08T06:33:57.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:56 smithi172 ceph-mon[33377]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T06:33:57.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:57.273 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:56 smithi172 ceph-mon[33377]: pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:56 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:33:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:56 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:33:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:56 smithi070 ceph-mon[29591]: osd.1 [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] boot 2024-05-08T06:33:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:56 smithi070 ceph-mon[29591]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T06:33:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:56 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:33:57.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:56 smithi070 ceph-mon[29591]: pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T06:33:58.087 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T06:33:58.087 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T06:33:58.087 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-05-08T06:33:58.087 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-05-08T06:33:58.087 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0299778 s, 350 MB/s 2024-05-08T06:33:58.087 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-05-08T06:33:58.087 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:57 smithi194 ceph-mon[33679]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T06:33:58.215 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:57 smithi172 ceph-mon[33377]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T06:33:58.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:57 smithi070 ceph-mon[29591]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T06:33:58.835 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_4 2024-05-08T06:33:59.118 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:33:58 smithi172 ceph-mon[33377]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:33:59.251 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:33:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:33:58 smithi194 ceph-mon[33679]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:33:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:33:58 smithi070 ceph-mon[29591]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:00.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:00 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi172 2024-05-08T06:34:00.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:34:00.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:00 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 17089M 2024-05-08T06:34:00.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:00.402 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:34:00.403 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:00 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi172 2024-05-08T06:34:00.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:34:00.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:00 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 17089M 2024-05-08T06:34:00.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:00.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:34:00.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:00 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi172 2024-05-08T06:34:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:34:00.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:00 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 17089M 2024-05-08T06:34:00.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:00.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:00.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:34:00.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.206+0000 7f012b800700 1 -- 172.21.15.194:0/2905321491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f012410ad50 msgr2=0x7f012410b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:34:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.206+0000 7f012b800700 1 --2- 172.21.15.194:0/2905321491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f012410ad50 0x7f012410b1b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0110009990 tx=0x7f0110009ca0 comp rx=0 tx=0).stop 2024-05-08T06:34:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.206+0000 7f012b800700 1 -- 172.21.15.194:0/2905321491 shutdown_connections 2024-05-08T06:34:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.206+0000 7f012b800700 1 --2- 172.21.15.194:0/2905321491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f012410b6f0 0x7f0124111fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.206+0000 7f012b800700 1 --2- 172.21.15.194:0/2905321491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0124109b50 0x7f0124109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.206+0000 7f012b800700 1 --2- 172.21.15.194:0/2905321491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f012410ad50 0x7f012410b1b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.206+0000 7f012b800700 1 -- 172.21.15.194:0/2905321491 >> 172.21.15.194:0/2905321491 conn(0x7f0124078b20 msgr2=0x7f012407af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:34:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.206+0000 7f012b800700 1 -- 172.21.15.194:0/2905321491 shutdown_connections 2024-05-08T06:34:01.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.206+0000 7f012b800700 1 -- 172.21.15.194:0/2905321491 wait complete. 2024-05-08T06:34:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.207+0000 7f012b800700 1 Processor -- start 2024-05-08T06:34:01.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.207+0000 7f012b800700 1 -- start start 2024-05-08T06:34:01.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.207+0000 7f012b800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0124109b50 0x7f012419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:34:01.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.207+0000 7f012b800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f012410ad50 0x7f01241a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:34:01.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.207+0000 7f012b800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f012410b6f0 0x7f01241a7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.207+0000 7f012b800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01241154f0 con 0x7f012410ad50 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.207+0000 7f012b800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0124115370 con 0x7f012410b6f0 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.207+0000 7f012b800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0124115670 con 0x7f0124109b50 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0128e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0124109b50 0x7f012419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0128e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0124109b50 0x7f012419fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:34140/0 (socket says 172.21.15.194:34140) 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0128e00700 1 -- 172.21.15.194:0/1618295134 learned_addr learned my addr 172.21.15.194:0/1618295134 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0129800700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f012410b6f0 0x7f01241a7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0123e00700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f012410ad50 0x7f01241a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0128e00700 1 -- 172.21.15.194:0/1618295134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f012410b6f0 msgr2=0x7f01241a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0128e00700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f012410b6f0 0x7f01241a7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0128e00700 1 -- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f012410ad50 msgr2=0x7f01241a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0128e00700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f012410ad50 0x7f01241a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.208+0000 7f0128e00700 1 -- 172.21.15.194:0/1618295134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01241a7830 con 0x7f0124109b50 2024-05-08T06:34:01.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.209+0000 7f0128e00700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0124109b50 0x7f012419fc20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f011800c9a0 tx=0x7f011800cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:34:01.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.209+0000 7f0121600700 1 -- 172.21.15.194:0/1618295134 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118004220 con 0x7f0124109b50 2024-05-08T06:34:01.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.209+0000 7f0121600700 1 -- 172.21.15.194:0/1618295134 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0118007cf0 con 0x7f0124109b50 2024-05-08T06:34:01.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.209+0000 7f0121600700 1 -- 172.21.15.194:0/1618295134 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0118003c50 con 0x7f0124109b50 2024-05-08T06:34:01.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.209+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01241a7b20 con 0x7f0124109b50 2024-05-08T06:34:01.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.209+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01241a8010 con 0x7f0124109b50 2024-05-08T06:34:01.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.210+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f012406a190 con 0x7f0124109b50 2024-05-08T06:34:01.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.213+0000 7f0121600700 1 -- 172.21.15.194:0/1618295134 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f01180043c0 con 0x7f0124109b50 2024-05-08T06:34:01.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.214+0000 7f0121600700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f010c0b2870 0x7f010c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:34:01.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.214+0000 7f0121600700 1 -- 172.21.15.194:0/1618295134 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f01180e0a30 con 0x7f0124109b50 2024-05-08T06:34:01.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.215+0000 7f0123e00700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f010c0b2870 0x7f010c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:34:01.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.216+0000 7f0123e00700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f010c0b2870 0x7f010c0b4d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f01100098e0 tx=0x7f0110005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:34:01.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.217+0000 7f0121600700 1 -- 172.21.15.194:0/1618295134 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0118014030 con 0x7f0124109b50 2024-05-08T06:34:01.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:01.459+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f01240638e0 con 0x7f010c0b2870 2024-05-08T06:34:01.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:01 smithi194 ceph-mon[33679]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:01 smithi070 ceph-mon[29591]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:01.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:01 smithi172 ceph-mon[33377]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:02.544 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:02 smithi194 ceph-mon[33679]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:34:02.544 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:34:02.544 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:34:02.544 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:02.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:02 smithi070 ceph-mon[29591]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:34:02.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:34:02.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:34:02.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:02 smithi172 ceph-mon[33377]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:34:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:34:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:34:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:03.429 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:03 smithi194 ceph-mon[33679]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:03.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:03 smithi172 ceph-mon[33377]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:03 smithi070 ceph-mon[29591]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:05 smithi070 ceph-mon[29591]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:05 smithi172 ceph-mon[33377]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:05.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:05 smithi194 ceph-mon[33679]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:06 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/2894538229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b"}]: dispatch 2024-05-08T06:34:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:06 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b"}]: dispatch 2024-05-08T06:34:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:06 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b"}]': finished 2024-05-08T06:34:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:06 smithi070 ceph-mon[29591]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T06:34:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:06 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:06 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/3119104112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:34:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:06 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/2894538229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b"}]: dispatch 2024-05-08T06:34:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:06 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b"}]: dispatch 2024-05-08T06:34:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:06 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b"}]': finished 2024-05-08T06:34:06.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:06 smithi172 ceph-mon[33377]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T06:34:06.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:06 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:06.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:06 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/3119104112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:34:06.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:06 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/2894538229' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b"}]: dispatch 2024-05-08T06:34:06.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:06 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b"}]: dispatch 2024-05-08T06:34:06.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:06 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b"}]': finished 2024-05-08T06:34:06.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:06 smithi194 ceph-mon[33679]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T06:34:06.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:06 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:06.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:06 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/3119104112' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:34:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:07 smithi070 ceph-mon[29591]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:07 smithi172 ceph-mon[33377]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:07 smithi194 ceph-mon[33679]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:09.580 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:09 smithi194 ceph-mon[33679]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:09 smithi070 ceph-mon[29591]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:09 smithi172 ceph-mon[33377]: pgmap v92: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:11.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:11 smithi194 ceph-mon[33679]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:11 smithi070 ceph-mon[29591]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:11 smithi172 ceph-mon[33377]: pgmap v93: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:13.618 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:13 smithi194 ceph-mon[33679]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:13.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:13 smithi070 ceph-mon[29591]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:13.649 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:13 smithi172 ceph-mon[33377]: pgmap v94: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T06:34:14.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T06:34:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T06:34:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:15 smithi070 ceph-mon[29591]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:15.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:15 smithi070 ceph-mon[29591]: Deploying daemon osd.2 on smithi194 2024-05-08T06:34:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:15 smithi172 ceph-mon[33377]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:15 smithi172 ceph-mon[33377]: Deploying daemon osd.2 on smithi194 2024-05-08T06:34:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:15 smithi194 ceph-mon[33679]: pgmap v95: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:15.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:15 smithi194 ceph-mon[33679]: Deploying daemon osd.2 on smithi194 2024-05-08T06:34:17.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:17 smithi194 ceph-mon[33679]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:17 smithi070 ceph-mon[29591]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:17.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:17 smithi172 ceph-mon[33377]: pgmap v96: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:19.589 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:19 smithi194 ceph-mon[33679]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:19 smithi070 ceph-mon[29591]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:19 smithi172 ceph-mon[33377]: pgmap v97: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:21 smithi194 ceph-mon[33679]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:21 smithi070 ceph-mon[29591]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:21.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:21 smithi172 ceph-mon[33377]: pgmap v98: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:23 smithi194 ceph-mon[33679]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:34:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:23 smithi070 ceph-mon[29591]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:34:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:23 smithi172 ceph-mon[33377]: pgmap v99: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:23 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:23 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:23 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:34:25.132 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:25 smithi194 ceph-mon[33679]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:25 smithi070 ceph-mon[29591]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:25 smithi172 ceph-mon[33377]: pgmap v100: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:26.458 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:26.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:26.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:26 smithi194 ceph-mon[33679]: from='osd.2 [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T06:34:26.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:26 smithi194 ceph-mon[33679]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T06:34:26.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.579+0000 7f0121600700 1 -- 172.21.15.194:0/1618295134 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f01240638e0 con 0x7f010c0b2870 2024-05-08T06:34:26.578 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 2 on host 'smithi194' 2024-05-08T06:34:26.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f010c0b2870 msgr2=0x7f010c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:34:26.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f010c0b2870 0x7f010c0b4d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f01100098e0 tx=0x7f0110005c20 comp rx=0 tx=0).stop 2024-05-08T06:34:26.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0124109b50 msgr2=0x7f012419fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:34:26.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0124109b50 0x7f012419fc20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f011800c9a0 tx=0x7f011800cd60 comp rx=0 tx=0).stop 2024-05-08T06:34:26.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 shutdown_connections 2024-05-08T06:34:26.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f012410b6f0 0x7f01241a7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:26.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0124109b50 0x7f012419fc20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:26.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f010c0b2870 0x7f010c0b4d30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:26.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 --2- 172.21.15.194:0/1618295134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f012410ad50 0x7f01241a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:26.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.582+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 >> 172.21.15.194:0/1618295134 conn(0x7f0124078b20 msgr2=0x7f012410e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:34:26.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.583+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 shutdown_connections 2024-05-08T06:34:26.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:34:26.583+0000 7f012b800700 1 -- 172.21.15.194:0/1618295134 wait complete. 2024-05-08T06:34:26.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:26.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:26.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:26 smithi070 ceph-mon[29591]: from='osd.2 [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T06:34:26.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:26 smithi070 ceph-mon[29591]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T06:34:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:26 smithi172 ceph-mon[33377]: from='osd.2 [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T06:34:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:26 smithi172 ceph-mon[33377]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T06:34:27.373 DEBUG:teuthology.orchestra.run.smithi194:osd.2> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.2.service 2024-05-08T06:34:27.379 INFO:tasks.cephadm:Deploying osd.3 on smithi070 with /dev/vg_nvme/lv_3... 2024-05-08T06:34:27.379 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T06:34:27.620 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:27 smithi194 ceph-mon[33679]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:27.620 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:27 smithi194 ceph-mon[33679]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T06:34:27.620 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:27 smithi194 ceph-mon[33679]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T06:34:27.621 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:27 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:27.621 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:27 smithi194 ceph-mon[33679]: from='osd.2 [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:34:27.621 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:27 smithi194 ceph-mon[33679]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:34:27.621 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:27 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:27.621 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:27 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:27 smithi070 ceph-mon[29591]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:27 smithi070 ceph-mon[29591]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T06:34:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:27 smithi070 ceph-mon[29591]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T06:34:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:27 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:27 smithi070 ceph-mon[29591]: from='osd.2 [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:34:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:27 smithi070 ceph-mon[29591]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:34:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:27 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:27 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:27 smithi172 ceph-mon[33377]: pgmap v101: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:27 smithi172 ceph-mon[33377]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T06:34:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:27 smithi172 ceph-mon[33377]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T06:34:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:27 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:27.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:27 smithi172 ceph-mon[33377]: from='osd.2 [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:34:27.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:27 smithi172 ceph-mon[33377]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:34:27.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:27 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:27.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:27 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:34:28.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:28 smithi070 ceph-mon[29591]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:34:28.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:28 smithi070 ceph-mon[29591]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T06:34:28.475 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:28.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:28 smithi172 ceph-mon[33377]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:34:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:28 smithi172 ceph-mon[33377]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T06:34:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:28.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:28.682 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:28 smithi194 ceph-mon[33679]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:34:28.683 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:28 smithi194 ceph-mon[33679]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T06:34:28.683 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:28.683 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:29.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:29 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:34:29.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:29 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:34:29.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:29 smithi070 ceph-mon[29591]: pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:29.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:29 smithi070 ceph-mon[29591]: osd.2 [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] boot 2024-05-08T06:34:29.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:29 smithi070 ceph-mon[29591]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T06:34:29.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:29 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:34:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:29 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:34:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:29 smithi172 ceph-mon[33377]: pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:29.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:29 smithi172 ceph-mon[33377]: osd.2 [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] boot 2024-05-08T06:34:29.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:29 smithi172 ceph-mon[33377]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T06:34:29.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:29 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:34:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:29 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:34:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:29 smithi194 ceph-mon[33679]: pgmap v104: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T06:34:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:29 smithi194 ceph-mon[33679]: osd.2 [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] boot 2024-05-08T06:34:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:29 smithi194 ceph-mon[33679]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T06:34:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:34:30.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:30 smithi070 ceph-mon[29591]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T06:34:30.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:30 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:34:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:30 smithi172 ceph-mon[33377]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T06:34:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:30 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:34:30.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:30 smithi194 ceph-mon[33679]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T06:34:30.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:30 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:34:30.988 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T06:34:30.988 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T06:34:30.988 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2024-05-08T06:34:30.988 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2024-05-08T06:34:30.988 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0349016 s, 300 MB/s 2024-05-08T06:34:30.988 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2024-05-08T06:34:31.583 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:34:31 smithi070 sudo[47880]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T06:34:31.583 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:34:31 smithi070 sudo[47880]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:31.584 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:34:31 smithi070 sudo[47880]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:31.584 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:34:31 smithi070 sudo[47880]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:31.584 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:31 smithi070 ceph-mon[29591]: pgmap v107: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:31.584 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:31 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T06:34:31.584 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:31 smithi070 ceph-mon[29591]: osdmap e20: 3 total, 3 up, 3 in 2024-05-08T06:34:31.584 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:31 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:34:31.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:31 smithi172 ceph-mon[33377]: pgmap v107: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:31.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:31 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T06:34:31.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:31 smithi172 ceph-mon[33377]: osdmap e20: 3 total, 3 up, 3 in 2024-05-08T06:34:31.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:31 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:34:31.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:31 smithi194 ceph-mon[33679]: pgmap v107: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:31.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:31 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T06:34:31.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:31 smithi194 ceph-mon[33679]: osdmap e20: 3 total, 3 up, 3 in 2024-05-08T06:34:31.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:31 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:34:31.846 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:34:31 smithi070 sudo[47884]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T06:34:31.846 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:34:31 smithi070 sudo[47884]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:31.846 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:34:31 smithi070 sudo[47884]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:31.846 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 06:34:31 smithi070 sudo[47884]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:31.910 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_3 2024-05-08T06:34:32.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 sudo[47917]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T06:34:32.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 sudo[47917]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 sudo[47917]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 sudo[47917]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.180 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 06:34:31 smithi172 sudo[41634]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T06:34:32.180 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 06:34:31 smithi172 sudo[41634]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.180 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 06:34:31 smithi172 sudo[41634]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.180 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 06:34:31 smithi172 sudo[41634]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.180 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 06:34:31 smithi172 sudo[41637]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T06:34:32.181 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 06:34:31 smithi172 sudo[41637]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.181 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 06:34:31 smithi172 sudo[41637]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.181 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 06:34:31 smithi172 sudo[41637]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.181 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 06:34:31 smithi194 sudo[42501]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T06:34:32.181 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 06:34:31 smithi194 sudo[42501]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.181 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 06:34:31 smithi194 sudo[42501]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.181 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 06:34:31 smithi194 sudo[42501]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.181 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 06:34:31 smithi194 sudo[42504]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T06:34:32.181 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 06:34:31 smithi194 sudo[42504]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.182 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 06:34:31 smithi194 sudo[42504]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.182 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 06:34:31 smithi194 sudo[42504]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.354 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:34:32.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 sudo[47938]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T06:34:32.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 sudo[47938]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 sudo[47938]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 sudo[47938]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 sudo[42507]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T06:34:32.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 sudo[42507]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 sudo[42507]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 sudo[42507]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 sudo[42510]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 sudo[42510]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 sudo[42510]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 sudo[42510]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: osdmap e21: 3 total, 3 up, 3 in 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:34:32.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:32.515 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:34:32.516 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.684 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 sudo[41670]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T06:34:32.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 sudo[41670]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 sudo[41670]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 sudo[41670]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 sudo[41675]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T06:34:32.685 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 sudo[41675]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T06:34:32.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 sudo[41675]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T06:34:32.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 sudo[41675]: pam_unix(sudo:session): session closed for user root 2024-05-08T06:34:32.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T06:34:32.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: osdmap e21: 3 total, 3 up, 3 in 2024-05-08T06:34:32.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.687 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:34:32.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:32.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:34:32.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T06:34:32.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T06:34:32.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:34:32.689 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:34:32.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:34:32.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:34:32.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T06:34:32.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:34:32.690 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:34:32.691 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T06:34:32.691 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T06:34:32.691 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:34:32.691 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:34:32.691 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:34:32.691 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T06:34:32.692 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:34:32.692 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:32.692 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:34:32.692 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T06:34:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: osdmap e21: 3 total, 3 up, 3 in 2024-05-08T06:34:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.712 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T06:34:32.713 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T06:34:32.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:34:32.715 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:32.715 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:34:32.715 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:33.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:33 smithi194 ceph-mon[33679]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:33.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:33 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi194 2024-05-08T06:34:33.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:33 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 17089M 2024-05-08T06:34:33.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:33 smithi194 ceph-mon[33679]: osdmap e22: 3 total, 3 up, 3 in 2024-05-08T06:34:33.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:33 smithi194 ceph-mon[33679]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-08T06:34:33.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:33 smithi070 ceph-mon[29591]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:33 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi194 2024-05-08T06:34:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:33 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 17089M 2024-05-08T06:34:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:33 smithi070 ceph-mon[29591]: osdmap e22: 3 total, 3 up, 3 in 2024-05-08T06:34:33.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:33 smithi070 ceph-mon[29591]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-08T06:34:33.887 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:33 smithi172 ceph-mon[33377]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:33.887 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:33 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi194 2024-05-08T06:34:33.887 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:33 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 17089M 2024-05-08T06:34:33.887 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:33 smithi172 ceph-mon[33377]: osdmap e22: 3 total, 3 up, 3 in 2024-05-08T06:34:33.887 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:33 smithi172 ceph-mon[33377]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-08T06:34:34.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.791+0000 7fa132800700 1 -- 172.21.15.70:0/4248819454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c1050a0 msgr2=0x7fa12c10b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:34:34.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.791+0000 7fa132800700 1 --2- 172.21.15.70:0/4248819454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c1050a0 0x7fa12c10b950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa12400b0d0 tx=0x7fa12400b3e0 comp rx=0 tx=0).stop 2024-05-08T06:34:34.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.791+0000 7fa132800700 1 -- 172.21.15.70:0/4248819454 shutdown_connections 2024-05-08T06:34:34.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.791+0000 7fa132800700 1 --2- 172.21.15.70:0/4248819454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c1050a0 0x7fa12c10b950 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:34.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.791+0000 7fa132800700 1 --2- 172.21.15.70:0/4248819454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa12c103500 0x7fa12c103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:34.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.791+0000 7fa132800700 1 --2- 172.21.15.70:0/4248819454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c104700 0x7fa12c104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:34.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.791+0000 7fa132800700 1 -- 172.21.15.70:0/4248819454 >> 172.21.15.70:0/4248819454 conn(0x7fa12c0feaa0 msgr2=0x7fa12c100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:34:34.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.791+0000 7fa132800700 1 -- 172.21.15.70:0/4248819454 shutdown_connections 2024-05-08T06:34:34.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.791+0000 7fa132800700 1 -- 172.21.15.70:0/4248819454 wait complete. 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.792+0000 7fa132800700 1 Processor -- start 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.792+0000 7fa132800700 1 -- start start 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa132800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c103500 0x7fa12c19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa132800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa12c104700 0x7fa12c19bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa132800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c1050a0 0x7fa12c1a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa132800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c10ee80 con 0x7fa12c103500 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa132800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c10ed00 con 0x7fa12c104700 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa132800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c10f000 con 0x7fa12c1050a0 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa12b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c103500 0x7fa12c19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:34:34.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa12b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c103500 0x7fa12c19b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48632/0 (socket says 172.21.15.70:48632) 2024-05-08T06:34:34.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa12b400700 1 -- 172.21.15.70:0/3099576071 learned_addr learned my addr 172.21.15.70:0/3099576071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:34:34.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa12be00700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c1050a0 0x7fa12c1a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:34:34.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.793+0000 7fa12aa00700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa12c104700 0x7fa12c19bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:34:34.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa12b400700 1 -- 172.21.15.70:0/3099576071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c1050a0 msgr2=0x7fa12c1a2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:34:34.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa12b400700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c1050a0 0x7fa12c1a2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:34.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa12b400700 1 -- 172.21.15.70:0/3099576071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa12c104700 msgr2=0x7fa12c19bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:34:34.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa12b400700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa12c104700 0x7fa12c19bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:34:34.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa12b400700 1 -- 172.21.15.70:0/3099576071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c1a3310 con 0x7fa12c103500 2024-05-08T06:34:34.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa12be00700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c1050a0 0x7fa12c1a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:34:34.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa12aa00700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa12c104700 0x7fa12c19bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:34:34.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa12b400700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c103500 0x7fa12c19b700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00c9c0 tx=0x7fa11c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:34:34.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa123e00700 1 -- 172.21.15.70:0/3099576071 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c007ac0 con 0x7fa12c103500 2024-05-08T06:34:34.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa123e00700 1 -- 172.21.15.70:0/3099576071 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa11c007c60 con 0x7fa12c103500 2024-05-08T06:34:34.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa123e00700 1 -- 172.21.15.70:0/3099576071 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c018660 con 0x7fa12c103500 2024-05-08T06:34:34.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12c1a3600 con 0x7fa12c103500 2024-05-08T06:34:34.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.794+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa12c1a3b90 con 0x7fa12c103500 2024-05-08T06:34:34.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.796+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12c06a190 con 0x7fa12c103500 2024-05-08T06:34:34.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.798+0000 7fa123e00700 1 -- 172.21.15.70:0/3099576071 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa11c00f450 con 0x7fa12c103500 2024-05-08T06:34:34.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.799+0000 7fa123e00700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1100b2900 0x7fa1100b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:34:34.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.800+0000 7fa123e00700 1 -- 172.21.15.70:0/3099576071 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3237+0+0 (secure 0 0 0) 0x7fa11c0e0ee0 con 0x7fa12c103500 2024-05-08T06:34:34.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.800+0000 7fa12aa00700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1100b2900 0x7fa1100b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:34:34.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.800+0000 7fa12aa00700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1100b2900 0x7fa1100b4dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa118005fd0 tx=0x7fa118005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:34:34.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:34.804+0000 7fa123e00700 1 -- 172.21.15.70:0/3099576071 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa11c014030 con 0x7fa12c103500 2024-05-08T06:34:35.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:34:35.047+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa12c076df0 con 0x7fa1100b2900 2024-05-08T06:34:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:35 smithi194 ceph-mon[33679]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:35.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:35 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:34:35.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:35 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:34:35.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:35 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:35 smithi070 ceph-mon[29591]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:34:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:34:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:35 smithi172 ceph-mon[33377]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:35 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:34:35.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:35 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:34:35.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:35 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:36.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:36 smithi070 ceph-mon[29591]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:34:36.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:36 smithi194 ceph-mon[33679]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:34:36.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:36 smithi172 ceph-mon[33377]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:34:37.758 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:37 smithi070 ceph-mon[29591]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:37 smithi194 ceph-mon[33679]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:37 smithi172 ceph-mon[33377]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:39 smithi194 ceph-mon[33679]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-08T06:34:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/316001367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd9bdf93-9e12-4613-8ff0-62b507edbd29"}]: dispatch 2024-05-08T06:34:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/316001367' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd9bdf93-9e12-4613-8ff0-62b507edbd29"}]': finished 2024-05-08T06:34:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:39 smithi194 ceph-mon[33679]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T06:34:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:34:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:39 smithi070 ceph-mon[29591]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-08T06:34:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/316001367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd9bdf93-9e12-4613-8ff0-62b507edbd29"}]: dispatch 2024-05-08T06:34:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/316001367' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd9bdf93-9e12-4613-8ff0-62b507edbd29"}]': finished 2024-05-08T06:34:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:39 smithi070 ceph-mon[29591]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T06:34:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:34:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:39 smithi172 ceph-mon[33377]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-08T06:34:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/316001367' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bd9bdf93-9e12-4613-8ff0-62b507edbd29"}]: dispatch 2024-05-08T06:34:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/316001367' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bd9bdf93-9e12-4613-8ff0-62b507edbd29"}]': finished 2024-05-08T06:34:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:39 smithi172 ceph-mon[33377]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T06:34:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:34:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:40 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3910377380' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:34:40.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:40 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3910377380' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:34:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:40 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3910377380' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:34:41.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:41 smithi194 ceph-mon[33679]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-05-08T06:34:41.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:41 smithi070 ceph-mon[29591]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-05-08T06:34:41.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:41 smithi172 ceph-mon[33377]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-05-08T06:34:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:43 smithi194 ceph-mon[33679]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 82 KiB/s wr, 6 op/s 2024-05-08T06:34:43.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:43 smithi070 ceph-mon[29591]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 82 KiB/s wr, 6 op/s 2024-05-08T06:34:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:43 smithi172 ceph-mon[33377]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.1 KiB/s rd, 82 KiB/s wr, 6 op/s 2024-05-08T06:34:45.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:45 smithi070 ceph-mon[29591]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T06:34:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:45 smithi194 ceph-mon[33679]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T06:34:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:45 smithi172 ceph-mon[33377]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T06:34:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:47 smithi070 ceph-mon[29591]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T06:34:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:47 smithi194 ceph-mon[33679]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T06:34:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:47 smithi172 ceph-mon[33377]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T06:34:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:48 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T06:34:48.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:48 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:48.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:48 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T06:34:48.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:48 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:48.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:48 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T06:34:48.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:48 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:34:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:49 smithi070 ceph-mon[29591]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:49 smithi070 ceph-mon[29591]: Deploying daemon osd.3 on smithi070 2024-05-08T06:34:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:49 smithi172 ceph-mon[33377]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:49 smithi172 ceph-mon[33377]: Deploying daemon osd.3 on smithi070 2024-05-08T06:34:50.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:49 smithi194 ceph-mon[33679]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:49 smithi194 ceph-mon[33679]: Deploying daemon osd.3 on smithi070 2024-05-08T06:34:51.802 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:51 smithi070 ceph-mon[29591]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:51 smithi172 ceph-mon[33377]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:51 smithi194 ceph-mon[33679]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:53.600 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:53 smithi070 ceph-mon[29591]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:53 smithi172 ceph-mon[33377]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:54.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:53 smithi194 ceph-mon[33679]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:55.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:55 smithi070 ceph-mon[29591]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:55 smithi172 ceph-mon[33377]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:55 smithi194 ceph-mon[33679]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:57 smithi070 ceph-mon[29591]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:34:57.813 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:57 smithi194 ceph-mon[33679]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:57.814 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:57.814 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:57.814 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:34:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:57 smithi172 ceph-mon[33377]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:34:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:34:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:34:59 smithi194 ceph-mon[33679]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:34:59 smithi070 ceph-mon[29591]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:34:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:34:59 smithi172 ceph-mon[33377]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:01.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:01 smithi070 ceph-mon[29591]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:01.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:01.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:01.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:01 smithi070 ceph-mon[29591]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T06:35:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:01 smithi194 ceph-mon[33679]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:01.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:01.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:01.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:01 smithi194 ceph-mon[33679]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T06:35:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:01 smithi172 ceph-mon[33377]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:01.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:01 smithi172 ceph-mon[33377]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T06:35:02.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.351+0000 7fa123e00700 1 -- 172.21.15.70:0/3099576071 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa12c076df0 con 0x7fa1100b2900 2024-05-08T06:35:02.354 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 3 on host 'smithi070' 2024-05-08T06:35:02.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1100b2900 msgr2=0x7fa1100b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:02.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1100b2900 0x7fa1100b4dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa118005fd0 tx=0x7fa118005dc0 comp rx=0 tx=0).stop 2024-05-08T06:35:02.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c103500 msgr2=0x7fa12c19b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:02.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c103500 0x7fa12c19b700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00c9c0 tx=0x7fa11c00cd80 comp rx=0 tx=0).stop 2024-05-08T06:35:02.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 shutdown_connections 2024-05-08T06:35:02.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa12c1050a0 0x7fa12c1a2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:02.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1100b2900 0x7fa1100b4dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:02.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c103500 0x7fa12c19b700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:02.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 --2- 172.21.15.70:0/3099576071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa12c104700 0x7fa12c19bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:02.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.355+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 >> 172.21.15.70:0/3099576071 conn(0x7fa12c0feaa0 msgr2=0x7fa12c0756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:35:02.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.356+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 shutdown_connections 2024-05-08T06:35:02.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:35:02.356+0000 7fa132800700 1 -- 172.21.15.70:0/3099576071 wait complete. 2024-05-08T06:35:02.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T06:35:02.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T06:35:02.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:35:02.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:02.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:02.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:02.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:02.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:35:02.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:02.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:02 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:02.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T06:35:02.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T06:35:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:35:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:35:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:02 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:02 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:03.189 DEBUG:teuthology.orchestra.run.smithi070:osd.3> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.3.service 2024-05-08T06:35:03.193 INFO:tasks.cephadm:Deploying osd.4 on smithi172 with /dev/vg_nvme/lv_3... 2024-05-08T06:35:03.193 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T06:35:03.631 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:35:03.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:03 smithi070 ceph-mon[29591]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:03.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:03 smithi070 ceph-mon[29591]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:35:03.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:03 smithi070 ceph-mon[29591]: osdmap e25: 4 total, 3 up, 4 in 2024-05-08T06:35:03.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:03.806 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:03 smithi172 ceph-mon[33377]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:03 smithi172 ceph-mon[33377]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:35:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:03 smithi172 ceph-mon[33377]: osdmap e25: 4 total, 3 up, 4 in 2024-05-08T06:35:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:04.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:03 smithi194 ceph-mon[33679]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:03 smithi194 ceph-mon[33679]: from='osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:35:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:03 smithi194 ceph-mon[33679]: osdmap e25: 4 total, 3 up, 4 in 2024-05-08T06:35:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:04 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:35:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:04 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:35:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:04 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:04 smithi070 ceph-mon[29591]: osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] boot 2024-05-08T06:35:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:04 smithi070 ceph-mon[29591]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T06:35:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:04 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:04.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:04 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:35:04.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:04 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:35:04.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:04 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:04.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:04 smithi172 ceph-mon[33377]: osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] boot 2024-05-08T06:35:04.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:04 smithi172 ceph-mon[33377]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T06:35:04.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:04 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:05.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:04 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:35:05.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:04 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:35:05.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:04 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:05.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:04 smithi194 ceph-mon[33679]: osd.3 [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] boot 2024-05-08T06:35:05.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:04 smithi194 ceph-mon[33679]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T06:35:05.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:04 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:35:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:05 smithi070 ceph-mon[29591]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:05 smithi070 ceph-mon[29591]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T06:35:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:05 smithi172 ceph-mon[33377]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:05 smithi172 ceph-mon[33377]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T06:35:06.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:05 smithi194 ceph-mon[33679]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-08T06:35:06.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:05 smithi194 ceph-mon[33679]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T06:35:06.453 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T06:35:06.453 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T06:35:06.453 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-08T06:35:06.453 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-08T06:35:06.453 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0357988 s, 293 MB/s 2024-05-08T06:35:06.453 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-08T06:35:06.795 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:06 smithi172 ceph-mon[33377]: osdmap e28: 4 total, 4 up, 4 in 2024-05-08T06:35:06.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:06 smithi070 ceph-mon[29591]: osdmap e28: 4 total, 4 up, 4 in 2024-05-08T06:35:07.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:06 smithi194 ceph-mon[33679]: osdmap e28: 4 total, 4 up, 4 in 2024-05-08T06:35:07.230 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2024-05-08T06:35:07.637 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:35:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:07 smithi070 ceph-mon[29591]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:07.909 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:07 smithi172 ceph-mon[33377]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:08.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:07 smithi194 ceph-mon[33679]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:09.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-05-08T06:35:09.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi070 2024-05-08T06:35:09.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:09.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:09.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 8544M 2024-05-08T06:35:09.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:09.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:09.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-05-08T06:35:09.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi070 2024-05-08T06:35:09.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:09.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:09.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 8544M 2024-05-08T06:35:09.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:09.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:09.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.389 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-05-08T06:35:09.389 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi070 2024-05-08T06:35:09.389 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.389 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.389 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:09.389 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:09.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 8544M 2024-05-08T06:35:09.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:09.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:09.390 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:09.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.684+0000 7f243a400700 1 -- 172.21.15.172:0/1108966549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 msgr2=0x7f2434104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:09.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.684+0000 7f243a400700 1 --2- 172.21.15.172:0/1108966549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 0x7f2434104a90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f24200099c0 tx=0x7f2420009cd0 comp rx=0 tx=0).stop 2024-05-08T06:35:09.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.684+0000 7f243a400700 1 -- 172.21.15.172:0/1108966549 shutdown_connections 2024-05-08T06:35:09.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.684+0000 7f243a400700 1 --2- 172.21.15.172:0/1108966549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2434104fd0 0x7f243410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:09.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.684+0000 7f243a400700 1 --2- 172.21.15.172:0/1108966549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2434103430 0x7f2434103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:09.684 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.684+0000 7f243a400700 1 --2- 172.21.15.172:0/1108966549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 0x7f2434104a90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:09.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.684+0000 7f243a400700 1 -- 172.21.15.172:0/1108966549 >> 172.21.15.172:0/1108966549 conn(0x7f24340fe9d0 msgr2=0x7f2434100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:35:09.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.684+0000 7f243a400700 1 -- 172.21.15.172:0/1108966549 shutdown_connections 2024-05-08T06:35:09.685 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.684+0000 7f243a400700 1 -- 172.21.15.172:0/1108966549 wait complete. 2024-05-08T06:35:09.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.686+0000 7f243a400700 1 Processor -- start 2024-05-08T06:35:09.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.686+0000 7f243a400700 1 -- start start 2024-05-08T06:35:09.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.686+0000 7f243a400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2434103430 0x7f243419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.686+0000 7f243a400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 0x7f243419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.686+0000 7f243a400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2434104fd0 0x7f24341a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.686+0000 7f243a400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f243410eec0 con 0x7f2434103430 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.686+0000 7f243a400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f243410ed40 con 0x7f2434104630 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.686+0000 7f243a400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f243410f040 con 0x7f2434104fd0 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.686+0000 7f2433e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 0x7f243419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2433e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 0x7f243419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:56662/0 (socket says 172.21.15.172:56662) 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2433e00700 1 -- 172.21.15.172:0/9891059 learned_addr learned my addr 172.21.15.172:0/9891059 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2439000700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2434103430 0x7f243419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2439a00700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2434104fd0 0x7f24341a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2433e00700 1 -- 172.21.15.172:0/9891059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2434104fd0 msgr2=0x7f24341a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2433e00700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2434104fd0 0x7f24341a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:09.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2433e00700 1 -- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2434103430 msgr2=0x7f243419b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:09.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2433e00700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2434103430 0x7f243419b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:09.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2433e00700 1 -- 172.21.15.172:0/9891059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24341a33d0 con 0x7f2434104630 2024-05-08T06:35:09.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.687+0000 7f2433e00700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 0x7f243419bcb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f242000b580 tx=0x7f2420005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:35:09.688 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.688+0000 7f2431600700 1 -- 172.21.15.172:0/9891059 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420027070 con 0x7f2434104630 2024-05-08T06:35:09.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.688+0000 7f2431600700 1 -- 172.21.15.172:0/9891059 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2420022470 con 0x7f2434104630 2024-05-08T06:35:09.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.688+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24341a3660 con 0x7f2434104630 2024-05-08T06:35:09.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.688+0000 7f2431600700 1 -- 172.21.15.172:0/9891059 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2420003a50 con 0x7f2434104630 2024-05-08T06:35:09.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.688+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24341a3b10 con 0x7f2434104630 2024-05-08T06:35:09.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.689+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243406a190 con 0x7f2434104630 2024-05-08T06:35:09.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.692+0000 7f2431600700 1 -- 172.21.15.172:0/9891059 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f242002a070 con 0x7f2434104630 2024-05-08T06:35:09.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.693+0000 7f2431600700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f241c0b2900 0x7f241c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:35:09.692 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.693+0000 7f2431600700 1 -- 172.21.15.172:0/9891059 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f24200e26d0 con 0x7f2434104630 2024-05-08T06:35:09.693 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.694+0000 7f2439000700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f241c0b2900 0x7f241c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:35:09.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.695+0000 7f2439000700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f241c0b2900 0x7f241c0b4dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2434104490 tx=0x7f2428009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:35:09.695 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.696+0000 7f2431600700 1 -- 172.21.15.172:0/9891059 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2420031080 con 0x7f2434104630 2024-05-08T06:35:09.934 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:09.935+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f24341a3e30 con 0x7f241c0b2900 2024-05-08T06:35:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:10 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:35:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:10 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:35:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:10 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:10.458 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:10 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:35:10.459 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:10 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:35:10.459 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:10 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:10 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:35:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:10 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:35:10.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:10 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:11 smithi172 ceph-mon[33377]: from='client.34199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:35:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:11 smithi172 ceph-mon[33377]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-08T06:35:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:11 smithi194 ceph-mon[33679]: from='client.34199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:35:11.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:11 smithi194 ceph-mon[33679]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-08T06:35:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:11 smithi070 ceph-mon[29591]: from='client.34199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:35:11.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:11 smithi070 ceph-mon[29591]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-08T06:35:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:13 smithi172 ceph-mon[33377]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T06:35:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:13 smithi194 ceph-mon[33679]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T06:35:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:13 smithi070 ceph-mon[29591]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T06:35:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:14 smithi172 ceph-mon[33377]: from='client.? 172.21.15.172:0/120126487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c49b8a2-2234-4306-b3f2-35426e29e1c2"}]: dispatch 2024-05-08T06:35:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:14 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c49b8a2-2234-4306-b3f2-35426e29e1c2"}]: dispatch 2024-05-08T06:35:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:14 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c49b8a2-2234-4306-b3f2-35426e29e1c2"}]': finished 2024-05-08T06:35:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:14 smithi172 ceph-mon[33377]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T06:35:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:14 smithi194 ceph-mon[33679]: from='client.? 172.21.15.172:0/120126487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c49b8a2-2234-4306-b3f2-35426e29e1c2"}]: dispatch 2024-05-08T06:35:14.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:14 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c49b8a2-2234-4306-b3f2-35426e29e1c2"}]: dispatch 2024-05-08T06:35:14.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:14 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c49b8a2-2234-4306-b3f2-35426e29e1c2"}]': finished 2024-05-08T06:35:14.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:14 smithi194 ceph-mon[33679]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T06:35:14.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:14.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:14 smithi070 ceph-mon[29591]: from='client.? 172.21.15.172:0/120126487' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c49b8a2-2234-4306-b3f2-35426e29e1c2"}]: dispatch 2024-05-08T06:35:14.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:14 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9c49b8a2-2234-4306-b3f2-35426e29e1c2"}]: dispatch 2024-05-08T06:35:14.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:14 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9c49b8a2-2234-4306-b3f2-35426e29e1c2"}]': finished 2024-05-08T06:35:14.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:14 smithi070 ceph-mon[29591]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T06:35:14.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:15 smithi172 ceph-mon[33377]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T06:35:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:15 smithi172 ceph-mon[33377]: from='client.? 172.21.15.172:0/2985825121' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:35:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:15 smithi194 ceph-mon[33679]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T06:35:15.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:15 smithi194 ceph-mon[33679]: from='client.? 172.21.15.172:0/2985825121' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:35:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:15 smithi070 ceph-mon[29591]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T06:35:15.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:15 smithi070 ceph-mon[29591]: from='client.? 172.21.15.172:0/2985825121' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:35:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:17 smithi172 ceph-mon[33377]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:35:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:17 smithi194 ceph-mon[33679]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:35:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:17 smithi070 ceph-mon[29591]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:35:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:19 smithi172 ceph-mon[33377]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:19 smithi194 ceph-mon[33679]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:19 smithi070 ceph-mon[29591]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:21 smithi172 ceph-mon[33377]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:21 smithi194 ceph-mon[33679]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:21 smithi070 ceph-mon[29591]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:23 smithi172 ceph-mon[33377]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:23 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T06:35:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:23 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:23.431 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:23 smithi070 ceph-mon[29591]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:23.431 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T06:35:23.432 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:23.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:23 smithi194 ceph-mon[33679]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:23.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T06:35:23.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:24.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:24 smithi070 ceph-mon[29591]: Deploying daemon osd.4 on smithi172 2024-05-08T06:35:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:24 smithi172 ceph-mon[33377]: Deploying daemon osd.4 on smithi172 2024-05-08T06:35:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:24 smithi194 ceph-mon[33679]: Deploying daemon osd.4 on smithi172 2024-05-08T06:35:25.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:25 smithi070 ceph-mon[29591]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:25.451 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:25 smithi172 ceph-mon[33377]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:25 smithi194 ceph-mon[33679]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:27.331 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:27 smithi172 ceph-mon[33377]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:27 smithi194 ceph-mon[33679]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:27 smithi070 ceph-mon[29591]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:29 smithi194 ceph-mon[33679]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:29.628 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:29 smithi172 ceph-mon[33377]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:29 smithi070 ceph-mon[29591]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:31.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:31 smithi172 ceph-mon[33377]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:31.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:31 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:31.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:31 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:31.974 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:31 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:35:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:31 smithi070 ceph-mon[29591]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:31 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:31 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:31 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:35:32.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:31 smithi194 ceph-mon[33679]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:32.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:31 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:32.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:31 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:32.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:31 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:35:34.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:33 smithi172 ceph-mon[33377]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:34.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:34.034 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:33 smithi070 ceph-mon[29591]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:33 smithi194 ceph-mon[33679]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:35.654 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 4 on host 'smithi172' 2024-05-08T06:35:35.654 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.653+0000 7f2431600700 1 -- 172.21.15.172:0/9891059 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f24341a3e30 con 0x7f241c0b2900 2024-05-08T06:35:35.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f241c0b2900 msgr2=0x7f241c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:35.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f241c0b2900 0x7f241c0b4dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2434104490 tx=0x7f2428009190 comp rx=0 tx=0).stop 2024-05-08T06:35:35.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 msgr2=0x7f243419bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:35.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 0x7f243419bcb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f242000b580 tx=0x7f2420005f10 comp rx=0 tx=0).stop 2024-05-08T06:35:35.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 shutdown_connections 2024-05-08T06:35:35.656 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2434104fd0 0x7f24341a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:35.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f241c0b2900 0x7f241c0b4dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:35.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2434103430 0x7f243419b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:35.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 --2- 172.21.15.172:0/9891059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2434104630 0x7f243419bcb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:35.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 >> 172.21.15.172:0/9891059 conn(0x7f24340fe9d0 msgr2=0x7f2434109e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:35:35.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 shutdown_connections 2024-05-08T06:35:35.657 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:35:35.656+0000 7f243a400700 1 -- 172.21.15.172:0/9891059 wait complete. 2024-05-08T06:35:36.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:35 smithi172 ceph-mon[33377]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:36.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:35 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:36.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:35 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:36.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:35 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:36.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:35 smithi172 ceph-mon[33377]: from='osd.4 [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T06:35:36.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:35 smithi172 ceph-mon[33377]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T06:35:36.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:35 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:36.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:35 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:35:36.078 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:35 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:36.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:35 smithi070 ceph-mon[29591]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:36.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:36.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:36.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:36.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:35 smithi070 ceph-mon[29591]: from='osd.4 [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T06:35:36.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:35 smithi070 ceph-mon[29591]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T06:35:36.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:36.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:35:36.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:35 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:35 smithi194 ceph-mon[33679]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:35 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:35 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:35 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:35 smithi194 ceph-mon[33679]: from='osd.4 [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T06:35:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:35 smithi194 ceph-mon[33679]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T06:35:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:35 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:35 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:35:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:35 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:36.484 DEBUG:teuthology.orchestra.run.smithi172:osd.4> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.4.service 2024-05-08T06:35:36.489 INFO:tasks.cephadm:Deploying osd.5 on smithi194 with /dev/vg_nvme/lv_3... 2024-05-08T06:35:36.489 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T06:35:36.920 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:35:36.987 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:36 smithi172 ceph-mon[33377]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T06:35:36.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:36 smithi172 ceph-mon[33377]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T06:35:36.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:36 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:36.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:36 smithi172 ceph-mon[33377]: from='osd.4 [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:35:36.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:36 smithi172 ceph-mon[33377]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:35:36.988 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:36 smithi172 ceph-mon[33377]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:37.225 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:36 smithi194 ceph-mon[33679]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T06:35:37.225 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:36 smithi194 ceph-mon[33679]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T06:35:37.225 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:36 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:37.225 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:36 smithi194 ceph-mon[33679]: from='osd.4 [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:35:37.225 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:36 smithi194 ceph-mon[33679]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:35:37.226 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:36 smithi194 ceph-mon[33679]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:37.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:36 smithi070 ceph-mon[29591]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T06:35:37.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:36 smithi070 ceph-mon[29591]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T06:35:37.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:36 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:37.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:36 smithi070 ceph-mon[29591]: from='osd.4 [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:35:37.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:36 smithi070 ceph-mon[29591]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:35:37.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:36 smithi070 ceph-mon[29591]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:38.102 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:37 smithi172 ceph-mon[33377]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:35:38.102 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:37 smithi172 ceph-mon[33377]: osdmap e31: 5 total, 4 up, 5 in 2024-05-08T06:35:38.102 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:38.102 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:38.102 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:37 smithi172 ceph-mon[33377]: from='osd.4 ' entity='osd.4' 2024-05-08T06:35:38.103 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 06:35:37 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T06:35:37.744+0000 7fe291400700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T06:35:38.103 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 06:35:37 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T06:35:37.778+0000 7fe287200700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T06:35:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:37 smithi194 ceph-mon[33679]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:35:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:37 smithi194 ceph-mon[33679]: osdmap e31: 5 total, 4 up, 5 in 2024-05-08T06:35:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:37 smithi194 ceph-mon[33679]: from='osd.4 ' entity='osd.4' 2024-05-08T06:35:38.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:37 smithi070 ceph-mon[29591]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:35:38.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:37 smithi070 ceph-mon[29591]: osdmap e31: 5 total, 4 up, 5 in 2024-05-08T06:35:38.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:38.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:38.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:37 smithi070 ceph-mon[29591]: from='osd.4 ' entity='osd.4' 2024-05-08T06:35:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:38 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:35:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:38 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:35:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:38 smithi172 ceph-mon[33377]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:38 smithi172 ceph-mon[33377]: osd.4 [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] boot 2024-05-08T06:35:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:38 smithi172 ceph-mon[33377]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T06:35:39.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:38 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:35:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:38 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:35:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:38 smithi194 ceph-mon[33679]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:38 smithi194 ceph-mon[33679]: osd.4 [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] boot 2024-05-08T06:35:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:38 smithi194 ceph-mon[33679]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T06:35:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:38 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:35:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:38 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:35:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:38 smithi070 ceph-mon[29591]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-08T06:35:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:38 smithi070 ceph-mon[29591]: osd.4 [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] boot 2024-05-08T06:35:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:38 smithi070 ceph-mon[29591]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T06:35:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:35:39.861 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T06:35:39.861 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T06:35:39.861 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-05-08T06:35:39.861 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-05-08T06:35:39.861 INFO:teuthology.orchestra.run.smithi194.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0373778 s, 281 MB/s 2024-05-08T06:35:39.861 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-05-08T06:35:40.674 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_3 2024-05-08T06:35:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:40 smithi172 ceph-mon[33377]: osdmap e33: 5 total, 5 up, 5 in 2024-05-08T06:35:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:40 smithi194 ceph-mon[33679]: osdmap e33: 5 total, 5 up, 5 in 2024-05-08T06:35:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:40 smithi070 ceph-mon[29591]: osdmap e33: 5 total, 5 up, 5 in 2024-05-08T06:35:41.150 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:35:42.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:41 smithi194 ceph-mon[33679]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:42.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:41 smithi070 ceph-mon[29591]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:42.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:42.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:41 smithi172 ceph-mon[33377]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:35:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:35:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:35:43.049 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:42 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi172 2024-05-08T06:35:43.049 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:42 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 8544M 2024-05-08T06:35:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:42 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi172 2024-05-08T06:35:43.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:42 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 8544M 2024-05-08T06:35:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:42 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi172 2024-05-08T06:35:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:42 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 8544M 2024-05-08T06:35:43.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.324+0000 7f0f21e00700 1 -- 172.21.15.194:0/420784458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 msgr2=0x7f0f1c076300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:43.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.324+0000 7f0f21e00700 1 --2- 172.21.15.194:0/420784458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 0x7f0f1c076300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009990 tx=0x7f0f04009ca0 comp rx=0 tx=0).stop 2024-05-08T06:35:43.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.324+0000 7f0f21e00700 1 -- 172.21.15.194:0/420784458 shutdown_connections 2024-05-08T06:35:43.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.324+0000 7f0f21e00700 1 --2- 172.21.15.194:0/420784458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f1c10b400 0x7f0f1c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:43.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.324+0000 7f0f21e00700 1 --2- 172.21.15.194:0/420784458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f1c077450 0x7f0f1c0758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:43.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.324+0000 7f0f21e00700 1 --2- 172.21.15.194:0/420784458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 0x7f0f1c076300 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:43.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.324+0000 7f0f21e00700 1 -- 172.21.15.194:0/420784458 >> 172.21.15.194:0/420784458 conn(0x7f0f1c0feaa0 msgr2=0x7f0f1c100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:35:43.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.324+0000 7f0f21e00700 1 -- 172.21.15.194:0/420784458 shutdown_connections 2024-05-08T06:35:43.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.324+0000 7f0f21e00700 1 -- 172.21.15.194:0/420784458 wait complete. 2024-05-08T06:35:43.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.325+0000 7f0f21e00700 1 Processor -- start 2024-05-08T06:35:43.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.326+0000 7f0f21e00700 1 -- start start 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.326+0000 7f0f21e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 0x7f0f1c19b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.326+0000 7f0f21e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f1c077450 0x7f0f1c19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.326+0000 7f0f21e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f1c10b400 0x7f0f1c1a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.326+0000 7f0f21e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c111030 con 0x7f0f1c077450 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.326+0000 7f0f21e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c110eb0 con 0x7f0f1c10b400 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.326+0000 7f0f21e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1c1111b0 con 0x7f0f1c075e80 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.327+0000 7f0f1aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 0x7f0f1c19b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.327+0000 7f0f1aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 0x7f0f1c19b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49182/0 (socket says 172.21.15.194:49182) 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.327+0000 7f0f1aa00700 1 -- 172.21.15.194:0/346398835 learned_addr learned my addr 172.21.15.194:0/346398835 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:35:43.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.327+0000 7f0f13e00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f1c077450 0x7f0f1c19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:35:43.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.327+0000 7f0f1aa00700 1 -- 172.21.15.194:0/346398835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f1c10b400 msgr2=0x7f0f1c1a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:43.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.327+0000 7f0f1aa00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f1c10b400 0x7f0f1c1a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:43.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.327+0000 7f0f1aa00700 1 -- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f1c077450 msgr2=0x7f0f1c19bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:35:43.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.327+0000 7f0f1aa00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f1c077450 0x7f0f1c19bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:35:43.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.327+0000 7f0f1aa00700 1 -- 172.21.15.194:0/346398835 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c1a33d0 con 0x7f0f1c075e80 2024-05-08T06:35:43.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.328+0000 7f0f1aa00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 0x7f0f1c19b770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00d9b0 tx=0x7f0f0c00dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:35:43.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.328+0000 7f0f20a00700 1 -- 172.21.15.194:0/346398835 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c017070 con 0x7f0f1c075e80 2024-05-08T06:35:43.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.328+0000 7f0f20a00700 1 -- 172.21.15.194:0/346398835 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f0c004830 con 0x7f0f1c075e80 2024-05-08T06:35:43.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.328+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c1a36c0 con 0x7f0f1c075e80 2024-05-08T06:35:43.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.328+0000 7f0f20a00700 1 -- 172.21.15.194:0/346398835 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c0053a0 con 0x7f0f1c075e80 2024-05-08T06:35:43.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.328+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1c1a3bb0 con 0x7f0f1c075e80 2024-05-08T06:35:43.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.329+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f1c06a190 con 0x7f0f1c075e80 2024-05-08T06:35:43.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.332+0000 7f0f20a00700 1 -- 172.21.15.194:0/346398835 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0f0c0049e0 con 0x7f0f1c075e80 2024-05-08T06:35:43.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.334+0000 7f0f20a00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0f000b2880 0x7f0f000b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:35:43.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.334+0000 7f0f20a00700 1 -- 172.21.15.194:0/346398835 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7f0f0c0e15d0 con 0x7f0f1c075e80 2024-05-08T06:35:43.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.335+0000 7f0f13e00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0f000b2880 0x7f0f000b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:35:43.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.336+0000 7f0f13e00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0f000b2880 0x7f0f000b4d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400b5c0 tx=0x7f0f04005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:35:43.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.338+0000 7f0f20a00700 1 -- 172.21.15.194:0/346398835 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0f0c020020 con 0x7f0f1c075e80 2024-05-08T06:35:43.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:35:43.573+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0f1c0638e0 con 0x7f0f000b2880 2024-05-08T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:43 smithi070 ceph-mon[29591]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:35:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:43 smithi172 ceph-mon[33377]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:35:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:35:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:43 smithi194 ceph-mon[33679]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:35:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:35:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:44 smithi070 ceph-mon[29591]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:35:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:44 smithi172 ceph-mon[33377]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:35:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:44 smithi194 ceph-mon[33679]: from='client.24214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:35:46.069 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:45 smithi194 ceph-mon[33679]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:45 smithi070 ceph-mon[29591]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:46.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:45 smithi172 ceph-mon[33377]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:48.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:47 smithi070 ceph-mon[29591]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:47 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/3044699872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acc9c880-48f9-41d7-bb61-6bcd1ecbc66d"}]: dispatch 2024-05-08T06:35:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:47 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acc9c880-48f9-41d7-bb61-6bcd1ecbc66d"}]: dispatch 2024-05-08T06:35:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:47 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acc9c880-48f9-41d7-bb61-6bcd1ecbc66d"}]': finished 2024-05-08T06:35:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:47 smithi070 ceph-mon[29591]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T06:35:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:35:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:47 smithi172 ceph-mon[33377]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:47 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/3044699872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acc9c880-48f9-41d7-bb61-6bcd1ecbc66d"}]: dispatch 2024-05-08T06:35:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:47 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acc9c880-48f9-41d7-bb61-6bcd1ecbc66d"}]: dispatch 2024-05-08T06:35:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:47 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acc9c880-48f9-41d7-bb61-6bcd1ecbc66d"}]': finished 2024-05-08T06:35:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:47 smithi172 ceph-mon[33377]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T06:35:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:35:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:47 smithi194 ceph-mon[33679]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:47 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/3044699872' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acc9c880-48f9-41d7-bb61-6bcd1ecbc66d"}]: dispatch 2024-05-08T06:35:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:47 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "acc9c880-48f9-41d7-bb61-6bcd1ecbc66d"}]: dispatch 2024-05-08T06:35:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:47 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "acc9c880-48f9-41d7-bb61-6bcd1ecbc66d"}]': finished 2024-05-08T06:35:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:47 smithi194 ceph-mon[33679]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T06:35:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:35:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:48 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/484498601' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:35:49.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:48 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/484498601' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:35:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:48 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/484498601' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:35:50.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:49 smithi070 ceph-mon[29591]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:49 smithi172 ceph-mon[33377]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:49 smithi194 ceph-mon[33679]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:51 smithi194 ceph-mon[33679]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:52.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:51 smithi070 ceph-mon[29591]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:51 smithi172 ceph-mon[33377]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:53 smithi070 ceph-mon[29591]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:53 smithi172 ceph-mon[33377]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:53 smithi194 ceph-mon[33679]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:55 smithi194 ceph-mon[33679]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:56.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:55 smithi070 ceph-mon[29591]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:55 smithi172 ceph-mon[33377]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:57.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:56 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T06:35:57.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:56 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T06:35:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T06:35:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:35:57.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:57 smithi194 ceph-mon[33679]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:57.906 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:57 smithi194 ceph-mon[33679]: Deploying daemon osd.5 on smithi194 2024-05-08T06:35:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:57 smithi070 ceph-mon[29591]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:57 smithi070 ceph-mon[29591]: Deploying daemon osd.5 on smithi194 2024-05-08T06:35:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:57 smithi172 ceph-mon[33377]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:35:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:57 smithi172 ceph-mon[33377]: Deploying daemon osd.5 on smithi194 2024-05-08T06:36:00.127 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:35:59 smithi194 ceph-mon[33679]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:00.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:35:59 smithi070 ceph-mon[29591]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:35:59 smithi172 ceph-mon[33377]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:02.113 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:01 smithi194 ceph-mon[33679]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:02.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:01 smithi070 ceph-mon[29591]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:02.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:01 smithi172 ceph-mon[33377]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:04.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:03 smithi070 ceph-mon[29591]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:03 smithi172 ceph-mon[33377]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:04.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:03 smithi194 ceph-mon[33679]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:04 smithi070 ceph-mon[29591]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:05.171 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:04 smithi194 ceph-mon[33679]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:04 smithi172 ceph-mon[33377]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:05 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:05 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:05 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:06.130 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:05 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:06.131 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:05 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:06.131 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:05 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:06.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:05 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:06.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:05 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:06.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:05 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:06 smithi172 ceph-mon[33377]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:07.186 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:06 smithi194 ceph-mon[33679]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:06 smithi070 ceph-mon[29591]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:09 smithi194 ceph-mon[33679]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:09 smithi194 ceph-mon[33679]: from='osd.5 [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T06:36:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:09 smithi194 ceph-mon[33679]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T06:36:09.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.735+0000 7f0f20a00700 1 -- 172.21.15.194:0/346398835 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0f1c0638e0 con 0x7f0f000b2880 2024-05-08T06:36:09.735 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 5 on host 'smithi194' 2024-05-08T06:36:09.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0f000b2880 msgr2=0x7f0f000b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:09.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0f000b2880 0x7f0f000b4d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f0400b5c0 tx=0x7f0f04005fb0 comp rx=0 tx=0).stop 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 msgr2=0x7f0f1c19b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 0x7f0f1c19b770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c00d9b0 tx=0x7f0f0c00dd70 comp rx=0 tx=0).stop 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 shutdown_connections 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0f1c10b400 0x7f0f1c1a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f1c075e80 0x7f0f1c19b770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0f000b2880 0x7f0f000b4d40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 --2- 172.21.15.194:0/346398835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f1c077450 0x7f0f1c19bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 >> 172.21.15.194:0/346398835 conn(0x7f0f1c0feaa0 msgr2=0x7f0f1c107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.739+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 shutdown_connections 2024-05-08T06:36:09.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:36:09.740+0000 7f0f21e00700 1 -- 172.21.15.194:0/346398835 wait complete. 2024-05-08T06:36:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:09 smithi070 ceph-mon[29591]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:09 smithi070 ceph-mon[29591]: from='osd.5 [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T06:36:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:09 smithi070 ceph-mon[29591]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T06:36:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:09 smithi172 ceph-mon[33377]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:09 smithi172 ceph-mon[33377]: from='osd.5 [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T06:36:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:09 smithi172 ceph-mon[33377]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T06:36:10.574 DEBUG:teuthology.orchestra.run.smithi194:osd.5> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.5.service 2024-05-08T06:36:10.578 INFO:tasks.cephadm:Deploying osd.6 on smithi070 with /dev/vg_nvme/lv_2... 2024-05-08T06:36:10.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T06:36:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:10 smithi194 ceph-mon[33679]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T06:36:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:10 smithi194 ceph-mon[33679]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T06:36:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:10 smithi194 ceph-mon[33679]: from='osd.5 [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:36:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:10 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:10 smithi194 ceph-mon[33679]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:36:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:10 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:10 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:10 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:10.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:10 smithi070 ceph-mon[29591]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T06:36:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:10 smithi070 ceph-mon[29591]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T06:36:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:10 smithi070 ceph-mon[29591]: from='osd.5 [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:36:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:10 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:10 smithi070 ceph-mon[29591]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:36:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:10 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:10 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:10 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:10.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:10 smithi172 ceph-mon[33377]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T06:36:10.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:10 smithi172 ceph-mon[33377]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T06:36:10.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:10 smithi172 ceph-mon[33377]: from='osd.5 [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:36:10.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:10 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:10.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:10 smithi172 ceph-mon[33377]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:36:10.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:10 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:10.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:10 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:10.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:10 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:11.016 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:36:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:11 smithi070 ceph-mon[29591]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:11 smithi070 ceph-mon[29591]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:36:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:11 smithi070 ceph-mon[29591]: osdmap e36: 6 total, 5 up, 6 in 2024-05-08T06:36:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:11 smithi070 ceph-mon[29591]: from='osd.5 ' entity='osd.5' 2024-05-08T06:36:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:11 smithi172 ceph-mon[33377]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:11 smithi172 ceph-mon[33377]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:36:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:11 smithi172 ceph-mon[33377]: osdmap e36: 6 total, 5 up, 6 in 2024-05-08T06:36:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:11 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:11 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:11 smithi172 ceph-mon[33377]: from='osd.5 ' entity='osd.5' 2024-05-08T06:36:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:11 smithi194 ceph-mon[33679]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:11 smithi194 ceph-mon[33679]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:36:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:11 smithi194 ceph-mon[33679]: osdmap e36: 6 total, 5 up, 6 in 2024-05-08T06:36:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:11 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:11 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:11 smithi194 ceph-mon[33679]: from='osd.5 ' entity='osd.5' 2024-05-08T06:36:12.011 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 06:36:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T06:36:11.521+0000 7f1e94600700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T06:36:12.012 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 06:36:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T06:36:11.551+0000 7f1e89a00700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T06:36:12.816 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:12 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:36:12.816 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:12 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:36:12.816 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:12 smithi194 ceph-mon[33679]: osdmap e37: 6 total, 5 up, 6 in 2024-05-08T06:36:12.816 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:12 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:12.817 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:12 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:12.841 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:12 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:36:12.841 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:12 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:36:12.841 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:12 smithi070 ceph-mon[29591]: osdmap e37: 6 total, 5 up, 6 in 2024-05-08T06:36:12.841 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:12 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:12.842 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:12 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:12 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:36:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:12 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:36:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:12 smithi172 ceph-mon[33377]: osdmap e37: 6 total, 5 up, 6 in 2024-05-08T06:36:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:12 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:12.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:12 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:13 smithi070 ceph-mon[29591]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:13 smithi070 ceph-mon[29591]: osd.5 [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] boot 2024-05-08T06:36:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:13 smithi070 ceph-mon[29591]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T06:36:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:13 smithi172 ceph-mon[33377]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:13 smithi172 ceph-mon[33377]: osd.5 [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] boot 2024-05-08T06:36:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:13 smithi172 ceph-mon[33377]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T06:36:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:13 smithi194 ceph-mon[33679]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-08T06:36:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:13 smithi194 ceph-mon[33679]: osd.5 [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] boot 2024-05-08T06:36:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:13 smithi194 ceph-mon[33679]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T06:36:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:36:14.071 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T06:36:14.071 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T06:36:14.071 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2024-05-08T06:36:14.071 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2024-05-08T06:36:14.071 INFO:teuthology.orchestra.run.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0306251 s, 342 MB/s 2024-05-08T06:36:14.071 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 2024-05-08T06:36:14.071 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2024-05-08T06:36:14.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:14 smithi194 ceph-mon[33679]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T06:36:14.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:14 smithi070 ceph-mon[29591]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T06:36:14.901 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_2 2024-05-08T06:36:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:14 smithi172 ceph-mon[33377]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T06:36:15.342 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:36:15.844 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: pgmap v179: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:15.844 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: osdmap e40: 6 total, 6 up, 6 in 2024-05-08T06:36:15.844 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:15.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:15.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:15.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:15.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:15.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:15.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:15.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: pgmap v179: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: osdmap e40: 6 total, 6 up, 6 in 2024-05-08T06:36:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: pgmap v179: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: osdmap e40: 6 total, 6 up, 6 in 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:16.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:16 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi194 2024-05-08T06:36:16.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:16 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 8544M 2024-05-08T06:36:16.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:16 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi194 2024-05-08T06:36:16.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:16 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 8544M 2024-05-08T06:36:17.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:16 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi194 2024-05-08T06:36:17.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:16 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 8544M 2024-05-08T06:36:17.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.710+0000 7f0232c00700 1 -- 172.21.15.70:0/853699404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c103510 msgr2=0x7f022c103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:17.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.710+0000 7f0232c00700 1 --2- 172.21.15.70:0/853699404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c103510 0x7f022c103930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f021c0099c0 tx=0x7f021c009cd0 comp rx=0 tx=0).stop 2024-05-08T06:36:17.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.710+0000 7f0232c00700 1 -- 172.21.15.70:0/853699404 shutdown_connections 2024-05-08T06:36:17.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.710+0000 7f0232c00700 1 --2- 172.21.15.70:0/853699404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022c1050b0 0x7f022c10b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.710+0000 7f0232c00700 1 --2- 172.21.15.70:0/853699404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c103510 0x7f022c103930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.710+0000 7f0232c00700 1 --2- 172.21.15.70:0/853699404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f022c104710 0x7f022c104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.710+0000 7f0232c00700 1 -- 172.21.15.70:0/853699404 >> 172.21.15.70:0/853699404 conn(0x7f022c0fea70 msgr2=0x7f022c100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.710+0000 7f0232c00700 1 -- 172.21.15.70:0/853699404 shutdown_connections 2024-05-08T06:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.710+0000 7f0232c00700 1 -- 172.21.15.70:0/853699404 wait complete. 2024-05-08T06:36:17.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:17 smithi070 ceph-mon[29591]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:17.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.712+0000 7f0232c00700 1 Processor -- start 2024-05-08T06:36:17.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.712+0000 7f0232c00700 1 -- start start 2024-05-08T06:36:17.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.712+0000 7f0232c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022c103510 0x7f022c077240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:36:17.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.712+0000 7f0232c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f022c104710 0x7f022c075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:36:17.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.712+0000 7f0232c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c1050b0 0x7f022c075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:36:17.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.712+0000 7f0232c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f022c10eeb0 con 0x7f022c1050b0 2024-05-08T06:36:17.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.712+0000 7f0232c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f022c10ed30 con 0x7f022c103510 2024-05-08T06:36:17.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.712+0000 7f0232c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f022c10f030 con 0x7f022c104710 2024-05-08T06:36:17.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f0230c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c1050b0 0x7f022c075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:36:17.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f0230c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c1050b0 0x7f022c075dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53048/0 (socket says 172.21.15.70:53048) 2024-05-08T06:36:17.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f0230c00700 1 -- 172.21.15.70:0/3663429286 learned_addr learned my addr 172.21.15.70:0/3663429286 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:36:17.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f022be00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022c103510 0x7f022c077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:36:17.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f022b400700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f022c104710 0x7f022c075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:36:17.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f0230c00700 1 -- 172.21.15.70:0/3663429286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f022c104710 msgr2=0x7f022c075890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:17.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f0230c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f022c104710 0x7f022c075890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:17.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f0230c00700 1 -- 172.21.15.70:0/3663429286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022c103510 msgr2=0x7f022c077240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:17.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f0230c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022c103510 0x7f022c077240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.713+0000 7f0230c00700 1 -- 172.21.15.70:0/3663429286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c076680 con 0x7f022c1050b0 2024-05-08T06:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.714+0000 7f0230c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c1050b0 0x7f022c075dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0224007d70 tx=0x7f022400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.714+0000 7f0228c00700 1 -- 172.21.15.70:0/3663429286 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224016020 con 0x7f022c1050b0 2024-05-08T06:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.714+0000 7f0228c00700 1 -- 172.21.15.70:0/3663429286 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f022400ad40 con 0x7f022c1050b0 2024-05-08T06:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.714+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f022c1a3710 con 0x7f022c1050b0 2024-05-08T06:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.714+0000 7f0228c00700 1 -- 172.21.15.70:0/3663429286 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02240115e0 con 0x7f022c1050b0 2024-05-08T06:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.714+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f022c1a3c20 con 0x7f022c1050b0 2024-05-08T06:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.715+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f022c06a190 con 0x7f022c1050b0 2024-05-08T06:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.718+0000 7f0228c00700 1 -- 172.21.15.70:0/3663429286 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0224019020 con 0x7f022c1050b0 2024-05-08T06:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.719+0000 7f0228c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02100b2880 0x7f02100b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.719+0000 7f0228c00700 1 -- 172.21.15.70:0/3663429286 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4533+0+0 (secure 0 0 0) 0x7f02240e1820 con 0x7f022c1050b0 2024-05-08T06:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.720+0000 7f022be00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02100b2880 0x7f02100b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.720+0000 7f022be00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02100b2880 0x7f02100b4d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f021c0098e0 tx=0x7f021c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:36:17.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.724+0000 7f0228c00700 1 -- 172.21.15.70:0/3663429286 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0224020020 con 0x7f022c1050b0 2024-05-08T06:36:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:17 smithi172 ceph-mon[33377]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:17.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:17.967+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f022c0638e0 con 0x7f02100b2880 2024-05-08T06:36:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:17 smithi194 ceph-mon[33679]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:18.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:36:18.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:36:18.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:36:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:36:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:36:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:36:19.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:19 smithi070 ceph-mon[29591]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:36:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:19 smithi070 ceph-mon[29591]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T06:36:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:19 smithi172 ceph-mon[33377]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:36:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:19 smithi172 ceph-mon[33377]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T06:36:20.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:19 smithi194 ceph-mon[33679]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:36:20.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:19 smithi194 ceph-mon[33679]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T06:36:21.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:21 smithi070 ceph-mon[29591]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-08T06:36:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:21 smithi172 ceph-mon[33377]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-08T06:36:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:21 smithi194 ceph-mon[33679]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-05-08T06:36:22.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:22 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1677712637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75960823-8e38-4f10-9bd2-42d4d4196126"}]: dispatch 2024-05-08T06:36:22.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:22 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1677712637' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75960823-8e38-4f10-9bd2-42d4d4196126"}]': finished 2024-05-08T06:36:22.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:22 smithi194 ceph-mon[33679]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T06:36:22.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:22.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:22 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1677712637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75960823-8e38-4f10-9bd2-42d4d4196126"}]: dispatch 2024-05-08T06:36:22.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:22 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1677712637' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75960823-8e38-4f10-9bd2-42d4d4196126"}]': finished 2024-05-08T06:36:22.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:22 smithi172 ceph-mon[33377]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T06:36:22.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1677712637' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75960823-8e38-4f10-9bd2-42d4d4196126"}]: dispatch 2024-05-08T06:36:23.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1677712637' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75960823-8e38-4f10-9bd2-42d4d4196126"}]': finished 2024-05-08T06:36:23.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:22 smithi070 ceph-mon[29591]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T06:36:23.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:23.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:23 smithi172 ceph-mon[33377]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-08T06:36:23.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:23 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3991067473' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:36:24.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:23 smithi194 ceph-mon[33679]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-08T06:36:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:23 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3991067473' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:36:24.030 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:23 smithi070 ceph-mon[29591]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-08T06:36:24.030 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:23 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3991067473' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:36:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:25 smithi172 ceph-mon[33377]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T06:36:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:25 smithi194 ceph-mon[33679]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T06:36:26.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:25 smithi070 ceph-mon[29591]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T06:36:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:27 smithi172 ceph-mon[33377]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:36:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:27 smithi194 ceph-mon[33679]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:36:28.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:27 smithi070 ceph-mon[29591]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:36:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:29 smithi194 ceph-mon[33679]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:29 smithi172 ceph-mon[33377]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:30.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:29 smithi070 ceph-mon[29591]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:31 smithi172 ceph-mon[33377]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:31 smithi194 ceph-mon[33679]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:31 smithi070 ceph-mon[29591]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:32.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T06:36:32.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:32.982 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T06:36:32.982 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T06:36:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:33.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:33 smithi172 ceph-mon[33377]: Deploying daemon osd.6 on smithi070 2024-05-08T06:36:33.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:33 smithi172 ceph-mon[33377]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:34.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:33 smithi194 ceph-mon[33679]: Deploying daemon osd.6 on smithi070 2024-05-08T06:36:34.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:33 smithi194 ceph-mon[33679]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:34.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:33 smithi070 ceph-mon[29591]: Deploying daemon osd.6 on smithi070 2024-05-08T06:36:34.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:33 smithi070 ceph-mon[29591]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:35 smithi172 ceph-mon[33377]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:36.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:35 smithi194 ceph-mon[33679]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:36.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:35 smithi070 ceph-mon[29591]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:38.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:37 smithi194 ceph-mon[33679]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:38.055 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:37 smithi070 ceph-mon[29591]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:37 smithi172 ceph-mon[33377]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:40.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:39 smithi194 ceph-mon[33679]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:39 smithi070 ceph-mon[29591]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:39 smithi172 ceph-mon[33377]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:42.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:41 smithi070 ceph-mon[29591]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:41 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:41 smithi172 ceph-mon[33377]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:41 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:42.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:41 smithi194 ceph-mon[33679]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:41 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:43.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:42 smithi070 ceph-mon[29591]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:42 smithi172 ceph-mon[33377]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:42 smithi194 ceph-mon[33679]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:45 smithi194 ceph-mon[33679]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:45 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:45 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:45 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:45 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:45 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:45 smithi194 ceph-mon[33679]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T06:36:45.817 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:45 smithi070 ceph-mon[29591]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:45.817 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:45.817 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:45.818 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:45.818 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:45.818 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:45.818 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:45 smithi070 ceph-mon[29591]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T06:36:45.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.817+0000 7f0228c00700 1 -- 172.21.15.70:0/3663429286 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f022c0638e0 con 0x7f02100b2880 2024-05-08T06:36:45.818 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 6 on host 'smithi070' 2024-05-08T06:36:45.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02100b2880 msgr2=0x7f02100b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:45.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02100b2880 0x7f02100b4d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f021c0098e0 tx=0x7f021c01a040 comp rx=0 tx=0).stop 2024-05-08T06:36:45.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c1050b0 msgr2=0x7f022c075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:45.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c1050b0 0x7f022c075dd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0224007d70 tx=0x7f022400a340 comp rx=0 tx=0).stop 2024-05-08T06:36:45.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 shutdown_connections 2024-05-08T06:36:45.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02100b2880 0x7f02100b4d40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:45.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f022c1050b0 0x7f022c075dd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:45.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f022c103510 0x7f022c077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:45.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 --2- 172.21.15.70:0/3663429286 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f022c104710 0x7f022c075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:45.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.820+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 >> 172.21.15.70:0/3663429286 conn(0x7f022c0fea70 msgr2=0x7f022c107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:36:45.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.821+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 shutdown_connections 2024-05-08T06:36:45.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:36:45.821+0000 7f0232c00700 1 -- 172.21.15.70:0/3663429286 wait complete. 2024-05-08T06:36:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:45 smithi172 ceph-mon[33377]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:45 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:45 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:45 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:45 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:45 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:45 smithi172 ceph-mon[33377]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T06:36:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:46 smithi194 ceph-mon[33679]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T06:36:46.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:46 smithi194 ceph-mon[33679]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T06:36:46.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:46 smithi194 ceph-mon[33679]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:36:46.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:46.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:46.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:46.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:46 smithi070 ceph-mon[29591]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T06:36:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:46 smithi070 ceph-mon[29591]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T06:36:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:46 smithi070 ceph-mon[29591]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:36:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:46.769 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:46.772 DEBUG:teuthology.orchestra.run.smithi070:osd.6> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.6.service 2024-05-08T06:36:46.778 INFO:tasks.cephadm:Deploying osd.7 on smithi172 with /dev/vg_nvme/lv_2... 2024-05-08T06:36:46.778 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T06:36:46.859 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:46 smithi172 ceph-mon[33377]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T06:36:46.859 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:46 smithi172 ceph-mon[33377]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T06:36:46.860 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:46 smithi172 ceph-mon[33377]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:36:46.860 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:46.860 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:46.860 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:36:46.860 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:47.225 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:36:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:47 smithi070 ceph-mon[29591]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:47 smithi070 ceph-mon[29591]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:36:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:47 smithi070 ceph-mon[29591]: osdmap e43: 7 total, 6 up, 7 in 2024-05-08T06:36:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:47 smithi070 ceph-mon[29591]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' 2024-05-08T06:36:47.630 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 06:36:47 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T06:36:47.359+0000 7f20f1000700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T06:36:47.630 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 06:36:47 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T06:36:47.384+0000 7f20e6e00700 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T06:36:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:47 smithi172 ceph-mon[33377]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:47.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:47 smithi172 ceph-mon[33377]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:36:47.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:47 smithi172 ceph-mon[33377]: osdmap e43: 7 total, 6 up, 7 in 2024-05-08T06:36:47.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:47.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:47.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:47 smithi172 ceph-mon[33377]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' 2024-05-08T06:36:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:47 smithi194 ceph-mon[33679]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:47.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:47 smithi194 ceph-mon[33679]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:36:47.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:47 smithi194 ceph-mon[33679]: osdmap e43: 7 total, 6 up, 7 in 2024-05-08T06:36:47.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:47.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:47.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:47 smithi194 ceph-mon[33679]: from='osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798]' entity='osd.6' 2024-05-08T06:36:48.745 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:48 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:36:48.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:48 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:36:48.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:48 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:48.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:48 smithi070 ceph-mon[29591]: osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] boot 2024-05-08T06:36:48.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:48 smithi070 ceph-mon[29591]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T06:36:48.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:48 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:48.851 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:48 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:36:48.851 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:48 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:36:48.851 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:48 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:48.851 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:48 smithi172 ceph-mon[33377]: osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] boot 2024-05-08T06:36:48.851 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:48 smithi172 ceph-mon[33377]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T06:36:48.851 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:48 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:49.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:48 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:36:49.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:48 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:36:49.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:48 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:49.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:48 smithi194 ceph-mon[33679]: osd.6 [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] boot 2024-05-08T06:36:49.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:48 smithi194 ceph-mon[33679]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T06:36:49.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:48 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:36:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:49 smithi070 ceph-mon[29591]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:49 smithi172 ceph-mon[33377]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:50.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:49 smithi194 ceph-mon[33679]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-08T06:36:50.092 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T06:36:50.092 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T06:36:50.092 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-08T06:36:50.092 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-08T06:36:50.092 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0333092 s, 315 MB/s 2024-05-08T06:36:50.092 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-08T06:36:50.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:50 smithi070 ceph-mon[29591]: osdmap e45: 7 total, 7 up, 7 in 2024-05-08T06:36:50.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:50 smithi172 ceph-mon[33377]: osdmap e45: 7 total, 7 up, 7 in 2024-05-08T06:36:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:50 smithi194 ceph-mon[33679]: osdmap e45: 7 total, 7 up, 7 in 2024-05-08T06:36:51.031 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2024-05-08T06:36:51.472 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:36:51.820 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:51 smithi172 ceph-mon[33377]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:51 smithi070 ceph-mon[29591]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:51 smithi194 ceph-mon[33679]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi070 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 5696M 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:53.152 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:53 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi070 2024-05-08T06:36:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 5696M 2024-05-08T06:36:53.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:53.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:53.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:53 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi070 2024-05-08T06:36:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:53.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:53.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:36:53.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 5696M 2024-05-08T06:36:53.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:53.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:36:53.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:53 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:36:53.686 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.686+0000 7f52b0e00700 1 -- 172.21.15.172:0/2666260732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 msgr2=0x7f52ac10b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:53.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.686+0000 7f52b0e00700 1 --2- 172.21.15.172:0/2666260732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 0x7f52ac10b1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f52980099c0 tx=0x7f5298009cd0 comp rx=0 tx=0).stop 2024-05-08T06:36:53.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.686+0000 7f52b0e00700 1 -- 172.21.15.172:0/2666260732 shutdown_connections 2024-05-08T06:36:53.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.686+0000 7f52b0e00700 1 --2- 172.21.15.172:0/2666260732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ac10b6e0 0x7f52ac111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:53.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.686+0000 7f52b0e00700 1 --2- 172.21.15.172:0/2666260732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac109b40 0x7f52ac109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:53.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.686+0000 7f52b0e00700 1 --2- 172.21.15.172:0/2666260732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 0x7f52ac10b1a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:53.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.686+0000 7f52b0e00700 1 -- 172.21.15.172:0/2666260732 >> 172.21.15.172:0/2666260732 conn(0x7f52ac078b10 msgr2=0x7f52ac07af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:36:53.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.686+0000 7f52b0e00700 1 -- 172.21.15.172:0/2666260732 shutdown_connections 2024-05-08T06:36:53.687 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.686+0000 7f52b0e00700 1 -- 172.21.15.172:0/2666260732 wait complete. 2024-05-08T06:36:53.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.687+0000 7f52b0e00700 1 Processor -- start 2024-05-08T06:36:53.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.687+0000 7f52b0e00700 1 -- start start 2024-05-08T06:36:53.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.687+0000 7f52b0e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ac109b40 0x7f52ac19fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:36:53.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.687+0000 7f52b0e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 0x7f52ac1a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:36:53.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.687+0000 7f52b0e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac10b6e0 0x7f52ac1a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:36:53.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.687+0000 7f52b0e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac1154b0 con 0x7f52ac10b6e0 2024-05-08T06:36:53.689 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52b0e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac115330 con 0x7f52ac10ad40 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52b0e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac115630 con 0x7f52ac109b40 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52a9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 0x7f52ac1a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52a9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 0x7f52ac1a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:35950/0 (socket says 172.21.15.172:35950) 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52a9400700 1 -- 172.21.15.172:0/4038022237 learned_addr learned my addr 172.21.15.172:0/4038022237 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52a9e00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ac109b40 0x7f52ac19fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52aa800700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac10b6e0 0x7f52ac1a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52a9400700 1 -- 172.21.15.172:0/4038022237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ac109b40 msgr2=0x7f52ac19fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52a9400700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ac109b40 0x7f52ac19fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52a9400700 1 -- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac10b6e0 msgr2=0x7f52ac1a70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52a9400700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac10b6e0 0x7f52ac1a70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52a9400700 1 -- 172.21.15.172:0/4038022237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac1a7780 con 0x7f52ac10ad40 2024-05-08T06:36:53.690 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.688+0000 7f52aa800700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac10b6e0 0x7f52ac1a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:36:53.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.689+0000 7f52a9400700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 0x7f52ac1a0060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f529800b580 tx=0x7f5298005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:36:53.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.689+0000 7f52a2a00700 1 -- 172.21.15.172:0/4038022237 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298027070 con 0x7f52ac10ad40 2024-05-08T06:36:53.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.689+0000 7f52a2a00700 1 -- 172.21.15.172:0/4038022237 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f529800fbb0 con 0x7f52ac10ad40 2024-05-08T06:36:53.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.689+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ac1a7a10 con 0x7f52ac10ad40 2024-05-08T06:36:53.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.689+0000 7f52a2a00700 1 -- 172.21.15.172:0/4038022237 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52980037f0 con 0x7f52ac10ad40 2024-05-08T06:36:53.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.689+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ac1a7e60 con 0x7f52ac10ad40 2024-05-08T06:36:53.691 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.690+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ac06a190 con 0x7f52ac10ad40 2024-05-08T06:36:53.694 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.694+0000 7f52a2a00700 1 -- 172.21.15.172:0/4038022237 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f529802a070 con 0x7f52ac10ad40 2024-05-08T06:36:53.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.696+0000 7f52a2a00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f52900b2880 0x7f52900b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:36:53.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.696+0000 7f52a2a00700 1 -- 172.21.15.172:0/4038022237 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 4965+0+0 (secure 0 0 0) 0x7f52980e24e0 con 0x7f52ac10ad40 2024-05-08T06:36:53.696 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.697+0000 7f52a9e00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f52900b2880 0x7f52900b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:36:53.697 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.698+0000 7f52a9e00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f52900b2880 0x7f52900b4d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f529c005fd0 tx=0x7f529c005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:36:53.700 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.700+0000 7f52a2a00700 1 -- 172.21.15.172:0/4038022237 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5298013070 con 0x7f52ac10ad40 2024-05-08T06:36:53.941 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:36:53.941+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f52ac0638e0 con 0x7f52900b2880 2024-05-08T06:36:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:36:54.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:36:54.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:54 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:36:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:54 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:36:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:54 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:36:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:36:54.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:36:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:55 smithi172 ceph-mon[33377]: from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:36:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:55 smithi172 ceph-mon[33377]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:55 smithi070 ceph-mon[29591]: from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:36:55.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:55 smithi070 ceph-mon[29591]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:55 smithi194 ceph-mon[33679]: from='client.34253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:36:55.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:55 smithi194 ceph-mon[33679]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:57 smithi070 ceph-mon[29591]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:57 smithi172 ceph-mon[33377]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:57.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:57 smithi194 ceph-mon[33679]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:58 smithi070 ceph-mon[29591]: from='client.? 172.21.15.172:0/3987632466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fb26034-c4db-4bd4-b999-9d412750b779"}]: dispatch 2024-05-08T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:58 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fb26034-c4db-4bd4-b999-9d412750b779"}]: dispatch 2024-05-08T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:58 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fb26034-c4db-4bd4-b999-9d412750b779"}]': finished 2024-05-08T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:58 smithi070 ceph-mon[29591]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T06:36:58.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:58 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:36:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:58 smithi172 ceph-mon[33377]: from='client.? 172.21.15.172:0/3987632466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fb26034-c4db-4bd4-b999-9d412750b779"}]: dispatch 2024-05-08T06:36:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:58 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fb26034-c4db-4bd4-b999-9d412750b779"}]: dispatch 2024-05-08T06:36:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:58 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fb26034-c4db-4bd4-b999-9d412750b779"}]': finished 2024-05-08T06:36:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:58 smithi172 ceph-mon[33377]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T06:36:58.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:58 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:36:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:58 smithi194 ceph-mon[33679]: from='client.? 172.21.15.172:0/3987632466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fb26034-c4db-4bd4-b999-9d412750b779"}]: dispatch 2024-05-08T06:36:58.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:58 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3fb26034-c4db-4bd4-b999-9d412750b779"}]: dispatch 2024-05-08T06:36:58.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:58 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3fb26034-c4db-4bd4-b999-9d412750b779"}]': finished 2024-05-08T06:36:58.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:58 smithi194 ceph-mon[33679]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T06:36:58.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:58 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:36:59.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:59 smithi070 ceph-mon[29591]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:59.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:36:59 smithi070 ceph-mon[29591]: from='client.? 172.21.15.172:0/4228203647' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:36:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:59 smithi172 ceph-mon[33377]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:36:59 smithi172 ceph-mon[33377]: from='client.? 172.21.15.172:0/4228203647' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:36:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:59 smithi194 ceph-mon[33679]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:36:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:36:59 smithi194 ceph-mon[33679]: from='client.? 172.21.15.172:0/4228203647' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:37:01.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:01 smithi070 ceph-mon[29591]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:01.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:01 smithi172 ceph-mon[33377]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:01 smithi194 ceph-mon[33679]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:03 smithi172 ceph-mon[33377]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:03 smithi194 ceph-mon[33679]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:03 smithi070 ceph-mon[29591]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:05.296 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:05 smithi172 ceph-mon[33377]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:05.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:05 smithi070 ceph-mon[29591]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:05 smithi194 ceph-mon[33679]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:07 smithi172 ceph-mon[33377]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T06:37:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:07 smithi194 ceph-mon[33679]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T06:37:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:07 smithi070 ceph-mon[29591]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:07.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T06:37:07.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:08.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:08 smithi172 ceph-mon[33377]: Deploying daemon osd.7 on smithi172 2024-05-08T06:37:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:08 smithi194 ceph-mon[33679]: Deploying daemon osd.7 on smithi172 2024-05-08T06:37:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:08 smithi070 ceph-mon[29591]: Deploying daemon osd.7 on smithi172 2024-05-08T06:37:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:09 smithi172 ceph-mon[33377]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:09 smithi194 ceph-mon[33679]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:09 smithi070 ceph-mon[29591]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:11 smithi172 ceph-mon[33377]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:11 smithi194 ceph-mon[33679]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:11 smithi070 ceph-mon[29591]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:13 smithi172 ceph-mon[33377]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:13 smithi194 ceph-mon[33679]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:13 smithi070 ceph-mon[29591]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:15 smithi172 ceph-mon[33377]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:15 smithi194 ceph-mon[33679]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:15 smithi070 ceph-mon[29591]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:16.606 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:16.606 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:37:16.606 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:16.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:16.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:37:16.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:37:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:17 smithi172 ceph-mon[33377]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:17 smithi194 ceph-mon[33679]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:17 smithi070 ceph-mon[29591]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:19 smithi172 ceph-mon[33377]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:19 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:19 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:19 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:19.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:19 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:37:19.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:19 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:19.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:19 smithi172 ceph-mon[33377]: from='osd.7 [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T06:37:19.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:19 smithi172 ceph-mon[33377]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T06:37:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:19 smithi194 ceph-mon[33679]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:19 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:19 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:19 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:19 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:37:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:19 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:19 smithi194 ceph-mon[33679]: from='osd.7 [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T06:37:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:19 smithi194 ceph-mon[33679]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T06:37:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:19 smithi070 ceph-mon[29591]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:19 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:19 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:19 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:19 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:37:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:19 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:19 smithi070 ceph-mon[29591]: from='osd.7 [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T06:37:19.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:19 smithi070 ceph-mon[29591]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T06:37:20.411 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.411+0000 7f52a2a00700 1 -- 172.21.15.172:0/4038022237 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f52ac0638e0 con 0x7f52900b2880 2024-05-08T06:37:20.412 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 7 on host 'smithi172' 2024-05-08T06:37:20.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f52900b2880 msgr2=0x7f52900b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:37:20.414 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f52900b2880 0x7f52900b4d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f529c005fd0 tx=0x7f529c005dd0 comp rx=0 tx=0).stop 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 msgr2=0x7f52ac1a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 0x7f52ac1a0060 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f529800b580 tx=0x7f5298005f10 comp rx=0 tx=0).stop 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 shutdown_connections 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f52900b2880 0x7f52900b4d40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac10b6e0 0x7f52ac1a70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52ac109b40 0x7f52ac19fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 --2- 172.21.15.172:0/4038022237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52ac10ad40 0x7f52ac1a0060 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 >> 172.21.15.172:0/4038022237 conn(0x7f52ac078b10 msgr2=0x7f52ac10e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.415+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 shutdown_connections 2024-05-08T06:37:20.415 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:37:20.416+0000 7f52b0e00700 1 -- 172.21.15.172:0/4038022237 wait complete. 2024-05-08T06:37:21.257 DEBUG:teuthology.orchestra.run.smithi172:osd.7> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.7.service 2024-05-08T06:37:21.262 INFO:tasks.cephadm:Deploying osd.8 on smithi194 with /dev/vg_nvme/lv_2... 2024-05-08T06:37:21.262 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T06:37:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:21 smithi172 ceph-mon[33377]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:21 smithi172 ceph-mon[33377]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T06:37:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:21 smithi172 ceph-mon[33377]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T06:37:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:21 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:21 smithi172 ceph-mon[33377]: from='osd.7 [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:37:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:21 smithi172 ceph-mon[33377]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:37:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:21 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:21.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:21 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:21.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:21 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:37:21.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:21 smithi194 ceph-mon[33679]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:21.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:21 smithi194 ceph-mon[33679]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T06:37:21.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:21 smithi194 ceph-mon[33679]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T06:37:21.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:21 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:21.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:21 smithi194 ceph-mon[33679]: from='osd.7 [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:37:21.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:21 smithi194 ceph-mon[33679]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:37:21.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:21 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:21.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:21 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:21.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:21 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:21 smithi070 ceph-mon[29591]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:21 smithi070 ceph-mon[29591]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T06:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:21 smithi070 ceph-mon[29591]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T06:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:21 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:21 smithi070 ceph-mon[29591]: from='osd.7 [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:21 smithi070 ceph-mon[29591]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:21 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:21 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:21 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:37:21.685 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:37:22.324 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:22 smithi172 ceph-mon[33377]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:37:22.325 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:22 smithi172 ceph-mon[33377]: osdmap e48: 8 total, 7 up, 8 in 2024-05-08T06:37:22.325 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:22.325 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:22.325 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:22 smithi172 ceph-mon[33377]: osdmap e49: 8 total, 7 up, 8 in 2024-05-08T06:37:22.325 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:22.325 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:22 smithi172 ceph-mon[33377]: from='osd.7 ' entity='osd.7' 2024-05-08T06:37:22.325 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 06:37:22 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T06:37:22.033+0000 7f9325400700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T06:37:22.325 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 06:37:22 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T06:37:22.056+0000 7f931b200700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T06:37:22.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:22 smithi194 ceph-mon[33679]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:37:22.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:22 smithi194 ceph-mon[33679]: osdmap e48: 8 total, 7 up, 8 in 2024-05-08T06:37:22.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:22.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:22.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:22 smithi194 ceph-mon[33679]: osdmap e49: 8 total, 7 up, 8 in 2024-05-08T06:37:22.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:22.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:22 smithi194 ceph-mon[33679]: from='osd.7 ' entity='osd.7' 2024-05-08T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:22 smithi070 ceph-mon[29591]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:22 smithi070 ceph-mon[29591]: osdmap e48: 8 total, 7 up, 8 in 2024-05-08T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:22 smithi070 ceph-mon[29591]: osdmap e49: 8 total, 7 up, 8 in 2024-05-08T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:22.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:22 smithi070 ceph-mon[29591]: from='osd.7 ' entity='osd.7' 2024-05-08T06:37:23.339 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:23 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:37:23.339 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:23 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:37:23.339 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:23 smithi172 ceph-mon[33377]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:23.339 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:23 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:23.339 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:23 smithi172 ceph-mon[33377]: osd.7 [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] boot 2024-05-08T06:37:23.339 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:23 smithi172 ceph-mon[33377]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T06:37:23.339 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:23 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:23.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:23 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:37:23.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:23 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:37:23.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:23 smithi194 ceph-mon[33679]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:23.405 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:23.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:23 smithi194 ceph-mon[33679]: osd.7 [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] boot 2024-05-08T06:37:23.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:23 smithi194 ceph-mon[33679]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T06:37:23.406 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:23 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:23 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:37:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:23 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:37:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:23 smithi070 ceph-mon[29591]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-05-08T06:37:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:23 smithi070 ceph-mon[29591]: osd.7 [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] boot 2024-05-08T06:37:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:23 smithi070 ceph-mon[29591]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T06:37:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:23 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:37:24.694 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T06:37:24.694 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T06:37:24.694 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-05-08T06:37:24.694 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-05-08T06:37:24.694 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0356376 s, 294 MB/s 2024-05-08T06:37:24.695 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-05-08T06:37:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:24 smithi194 ceph-mon[33679]: osdmap e51: 8 total, 8 up, 8 in 2024-05-08T06:37:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:24 smithi070 ceph-mon[29591]: osdmap e51: 8 total, 8 up, 8 in 2024-05-08T06:37:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:24 smithi172 ceph-mon[33377]: osdmap e51: 8 total, 8 up, 8 in 2024-05-08T06:37:25.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_2 2024-05-08T06:37:26.007 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:37:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:25 smithi194 ceph-mon[33679]: pgmap v226: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:25 smithi194 ceph-mon[33679]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-08T06:37:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:25 smithi194 ceph-mon[33679]: osdmap e52: 8 total, 8 up, 8 in 2024-05-08T06:37:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:25 smithi070 ceph-mon[29591]: pgmap v226: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:25 smithi070 ceph-mon[29591]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-08T06:37:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:25 smithi070 ceph-mon[29591]: osdmap e52: 8 total, 8 up, 8 in 2024-05-08T06:37:26.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:25 smithi172 ceph-mon[33377]: pgmap v226: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:26.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:25 smithi172 ceph-mon[33377]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-08T06:37:26.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:25 smithi172 ceph-mon[33377]: osdmap e52: 8 total, 8 up, 8 in 2024-05-08T06:37:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi172 2024-05-08T06:37:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:37:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:37:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:37:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:37:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.191 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi172 2024-05-08T06:37:27.191 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.191 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.192 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:37:27.192 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:37:27.192 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:37:27.192 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.192 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:27.192 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:37:27.192 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi172 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:37:27.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:28.090 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:27 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 5696M 2024-05-08T06:37:28.090 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:27 smithi194 ceph-mon[33679]: pgmap v228: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:27 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 5696M 2024-05-08T06:37:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:27 smithi172 ceph-mon[33377]: pgmap v228: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:28.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.262+0000 7fbfd7000700 1 -- 172.21.15.194:0/1936661448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 msgr2=0x7fbfd010db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:37:28.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.262+0000 7fbfd7000700 1 --2- 172.21.15.194:0/1936661448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 0x7fbfd010db90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800b0a0 tx=0x7fbfc800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:37:28.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.262+0000 7fbfd7000700 1 -- 172.21.15.194:0/1936661448 shutdown_connections 2024-05-08T06:37:28.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.262+0000 7fbfd7000700 1 --2- 172.21.15.194:0/1936661448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 0x7fbfd010db90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:28.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.262+0000 7fbfd7000700 1 --2- 172.21.15.194:0/1936661448 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd0105740 0x7fbfd0105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:28.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.262+0000 7fbfd7000700 1 --2- 172.21.15.194:0/1936661448 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfd0106940 0x7fbfd0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:28.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.262+0000 7fbfd7000700 1 -- 172.21.15.194:0/1936661448 >> 172.21.15.194:0/1936661448 conn(0x7fbfd0100d00 msgr2=0x7fbfd0103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:37:28.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.262+0000 7fbfd7000700 1 -- 172.21.15.194:0/1936661448 shutdown_connections 2024-05-08T06:37:28.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.262+0000 7fbfd7000700 1 -- 172.21.15.194:0/1936661448 wait complete. 2024-05-08T06:37:28.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.263+0000 7fbfd7000700 1 Processor -- start 2024-05-08T06:37:28.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.263+0000 7fbfd7000700 1 -- start start 2024-05-08T06:37:28.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfd7000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd0105740 0x7fbfd019b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:37:28.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfd7000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfd0106940 0x7fbfd019bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:37:28.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfd7000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 0x7fbfd01a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:37:28.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfd7000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd0111070 con 0x7fbfd0106940 2024-05-08T06:37:28.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfd7000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd0110ef0 con 0x7fbfd0105740 2024-05-08T06:37:28.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfd7000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbfd01111f0 con 0x7fbfd01072e0 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfd5000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 0x7fbfd01a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfd5000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 0x7fbfd01a2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40704/0 (socket says 172.21.15.194:40704) 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfd5000700 1 -- 172.21.15.194:0/2286339416 learned_addr learned my addr 172.21.15.194:0/2286339416 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfcfe00700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd0105740 0x7fbfd019b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.264+0000 7fbfc7400700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfd0106940 0x7fbfd019bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfd5000700 1 -- 172.21.15.194:0/2286339416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd0105740 msgr2=0x7fbfd019b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfd5000700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd0105740 0x7fbfd019b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfd5000700 1 -- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfd0106940 msgr2=0x7fbfd019bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfd5000700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfd0106940 0x7fbfd019bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfd5000700 1 -- 172.21.15.194:0/2286339416 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfd01a32b0 con 0x7fbfd01072e0 2024-05-08T06:37:28.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfd5000700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 0x7fbfd01a2c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8007d10 tx=0x7fbfc8007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:37:28.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfcd600700 1 -- 172.21.15.194:0/2286339416 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8003e10 con 0x7fbfd01072e0 2024-05-08T06:37:28.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfcd600700 1 -- 172.21.15.194:0/2286339416 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbfc8005500 con 0x7fbfd01072e0 2024-05-08T06:37:28.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfd01a3540 con 0x7fbfd01072e0 2024-05-08T06:37:28.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfcd600700 1 -- 172.21.15.194:0/2286339416 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfc801ba90 con 0x7fbfd01072e0 2024-05-08T06:37:28.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.265+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfd01a3990 con 0x7fbfd01072e0 2024-05-08T06:37:28.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.266+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfd006a190 con 0x7fbfd01072e0 2024-05-08T06:37:28.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.269+0000 7fbfcd600700 1 -- 172.21.15.194:0/2286339416 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbfc8005020 con 0x7fbfd01072e0 2024-05-08T06:37:28.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.270+0000 7fbfcd600700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbfb40b2880 0x7fbfb40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:37:28.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.271+0000 7fbfcd600700 1 -- 172.21.15.194:0/2286339416 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5397+0+0 (secure 0 0 0) 0x7fbfc800f020 con 0x7fbfd01072e0 2024-05-08T06:37:28.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.271+0000 7fbfcfe00700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbfb40b2880 0x7fbfb40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:37:28.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.272+0000 7fbfcfe00700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbfb40b2880 0x7fbfb40b4d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0005fd0 tx=0x7fbfc0005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:37:28.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.274+0000 7fbfcd600700 1 -- 172.21.15.194:0/2286339416 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbfc80ab900 con 0x7fbfd01072e0 2024-05-08T06:37:28.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:27 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 5696M 2024-05-08T06:37:28.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:27 smithi070 ceph-mon[29591]: pgmap v228: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:28.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:28.517+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fbfd00638e0 con 0x7fbfb40b2880 2024-05-08T06:37:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:28 smithi172 ceph-mon[33377]: pgmap v229: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:28 smithi172 ceph-mon[33377]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:37:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:37:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:37:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:28 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:29.213 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:28 smithi194 ceph-mon[33679]: pgmap v229: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:29.213 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:28 smithi194 ceph-mon[33679]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:37:29.213 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:37:29.213 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:37:29.213 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:28 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:28 smithi070 ceph-mon[29591]: pgmap v229: 1 pgs: 1 remapped; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:28 smithi070 ceph-mon[29591]: from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:37:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:37:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:37:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:28 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:30 smithi070 ceph-mon[29591]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-08T06:37:30.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:30 smithi070 ceph-mon[29591]: Cluster is now healthy 2024-05-08T06:37:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:30 smithi172 ceph-mon[33377]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-08T06:37:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:30 smithi172 ceph-mon[33377]: Cluster is now healthy 2024-05-08T06:37:30.460 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:30 smithi194 ceph-mon[33679]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-08T06:37:30.460 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:30 smithi194 ceph-mon[33679]: Cluster is now healthy 2024-05-08T06:37:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:31 smithi194 ceph-mon[33679]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-08T06:37:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:31 smithi070 ceph-mon[29591]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-08T06:37:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:31 smithi172 ceph-mon[33377]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-08T06:37:33.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:33 smithi070 ceph-mon[29591]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-05-08T06:37:33.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:33 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/3693999386' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728"}]: dispatch 2024-05-08T06:37:33.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:33 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728"}]: dispatch 2024-05-08T06:37:33.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:33 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728"}]': finished 2024-05-08T06:37:33.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:33 smithi070 ceph-mon[29591]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T06:37:33.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:33 smithi172 ceph-mon[33377]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-05-08T06:37:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:33 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/3693999386' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728"}]: dispatch 2024-05-08T06:37:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:33 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728"}]: dispatch 2024-05-08T06:37:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:33 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728"}]': finished 2024-05-08T06:37:33.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:33 smithi172 ceph-mon[33377]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T06:37:33.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:33 smithi194 ceph-mon[33679]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-05-08T06:37:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:33 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/3693999386' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728"}]: dispatch 2024-05-08T06:37:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:33 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728"}]: dispatch 2024-05-08T06:37:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:33 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728"}]': finished 2024-05-08T06:37:33.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:33 smithi194 ceph-mon[33679]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T06:37:33.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/3296479485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:37:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/3296479485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:37:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/3296479485' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:37:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:35 smithi172 ceph-mon[33377]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-05-08T06:37:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:35 smithi194 ceph-mon[33679]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-05-08T06:37:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:35 smithi070 ceph-mon[29591]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-05-08T06:37:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:37 smithi172 ceph-mon[33377]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T06:37:37.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:37 smithi194 ceph-mon[33679]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T06:37:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:37 smithi070 ceph-mon[29591]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T06:37:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:39 smithi194 ceph-mon[33679]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T06:37:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:39 smithi172 ceph-mon[33377]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T06:37:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:39 smithi070 ceph-mon[29591]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T06:37:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:41 smithi172 ceph-mon[33377]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:41 smithi194 ceph-mon[33679]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:41.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:41 smithi070 ceph-mon[29591]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:42 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T06:37:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:42 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:42 smithi172 ceph-mon[33377]: Deploying daemon osd.8 on smithi194 2024-05-08T06:37:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:42 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T06:37:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:42 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:42 smithi194 ceph-mon[33679]: Deploying daemon osd.8 on smithi194 2024-05-08T06:37:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:42 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T06:37:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:42 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:37:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:42 smithi070 ceph-mon[29591]: Deploying daemon osd.8 on smithi194 2024-05-08T06:37:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:43 smithi172 ceph-mon[33377]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:43 smithi194 ceph-mon[33679]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:43.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:43 smithi070 ceph-mon[29591]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:45 smithi172 ceph-mon[33377]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:45.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:45 smithi194 ceph-mon[33679]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:45.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:45 smithi070 ceph-mon[29591]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:47.372 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:47 smithi194 ceph-mon[33679]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:47 smithi070 ceph-mon[29591]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:47 smithi172 ceph-mon[33377]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:49 smithi194 ceph-mon[33679]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:49.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:49 smithi070 ceph-mon[29591]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:49 smithi172 ceph-mon[33377]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:51 smithi194 ceph-mon[33679]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:51.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:51.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:51.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:37:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:51 smithi070 ceph-mon[29591]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:37:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:51 smithi172 ceph-mon[33377]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:37:53.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:53 smithi194 ceph-mon[33679]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:53 smithi070 ceph-mon[29591]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:53 smithi172 ceph-mon[33377]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:55.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.382+0000 7fbfcd600700 1 -- 172.21.15.194:0/2286339416 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbfd00638e0 con 0x7fbfb40b2880 2024-05-08T06:37:55.381 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 8 on host 'smithi194' 2024-05-08T06:37:55.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbfb40b2880 msgr2=0x7fbfb40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:37:55.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbfb40b2880 0x7fbfb40b4d40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0005fd0 tx=0x7fbfc0005e50 comp rx=0 tx=0).stop 2024-05-08T06:37:55.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 msgr2=0x7fbfd01a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:37:55.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 0x7fbfd01a2c10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8007d10 tx=0x7fbfc8007df0 comp rx=0 tx=0).stop 2024-05-08T06:37:55.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 shutdown_connections 2024-05-08T06:37:55.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfd01072e0 0x7fbfd01a2c10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:55.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbfd0105740 0x7fbfd019b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:55.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbfb40b2880 0x7fbfb40b4d40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:55.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 --2- 172.21.15.194:0/2286339416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbfd0106940 0x7fbfd019bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:37:55.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.386+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 >> 172.21.15.194:0/2286339416 conn(0x7fbfd0100d00 msgr2=0x7fbfd0109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:37:55.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.387+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 shutdown_connections 2024-05-08T06:37:55.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:37:55.387+0000 7fbfd7000700 1 -- 172.21.15.194:0/2286339416 wait complete. 2024-05-08T06:37:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:55 smithi172 ceph-mon[33377]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:55 smithi172 ceph-mon[33377]: from='osd.8 [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T06:37:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:55 smithi172 ceph-mon[33377]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T06:37:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:55 smithi194 ceph-mon[33679]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:55 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:55 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:55 smithi194 ceph-mon[33679]: from='osd.8 [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T06:37:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:55 smithi194 ceph-mon[33679]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T06:37:55.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:55 smithi070 ceph-mon[29591]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:55.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:55.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:55.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:55 smithi070 ceph-mon[29591]: from='osd.8 [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T06:37:55.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:55 smithi070 ceph-mon[29591]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T06:37:56.276 DEBUG:teuthology.orchestra.run.smithi194:osd.8> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.8.service 2024-05-08T06:37:56.280 INFO:tasks.cephadm:Deploying osd.9 on smithi070 with /dev/vg_nvme/lv_1... 2024-05-08T06:37:56.280 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T06:37:56.456 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:56 smithi194 ceph-mon[33679]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T06:37:56.456 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:56 smithi194 ceph-mon[33679]: osdmap e54: 9 total, 8 up, 9 in 2024-05-08T06:37:56.456 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:56.456 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:56 smithi194 ceph-mon[33679]: from='osd.8 [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:37:56.456 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:56 smithi194 ceph-mon[33679]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:37:56.456 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:56.456 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:56 smithi070 ceph-mon[29591]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T06:37:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:56 smithi070 ceph-mon[29591]: osdmap e54: 9 total, 8 up, 9 in 2024-05-08T06:37:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:56 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:56 smithi070 ceph-mon[29591]: from='osd.8 [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:37:56.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:56 smithi070 ceph-mon[29591]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:37:56.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:56 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:56.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:56 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:56.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:56 smithi172 ceph-mon[33377]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T06:37:56.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:56 smithi172 ceph-mon[33377]: osdmap e54: 9 total, 8 up, 9 in 2024-05-08T06:37:56.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:56.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:56 smithi172 ceph-mon[33377]: from='osd.8 [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:37:56.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:56 smithi172 ceph-mon[33377]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:37:56.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:56.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:37:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:37:57.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:57 smithi194 ceph-mon[33679]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:57.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:57 smithi194 ceph-mon[33679]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:37:57.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:57 smithi194 ceph-mon[33679]: osdmap e55: 9 total, 8 up, 9 in 2024-05-08T06:37:57.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:57.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:57.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:57 smithi194 ceph-mon[33679]: osd.8 [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] boot 2024-05-08T06:37:57.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:57 smithi194 ceph-mon[33679]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T06:37:57.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:57 smithi070 ceph-mon[29591]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:57 smithi070 ceph-mon[29591]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:37:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:57 smithi070 ceph-mon[29591]: osdmap e55: 9 total, 8 up, 9 in 2024-05-08T06:37:57.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:57.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:57.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:57 smithi070 ceph-mon[29591]: osd.8 [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] boot 2024-05-08T06:37:57.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:57 smithi070 ceph-mon[29591]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T06:37:57.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:57 smithi172 ceph-mon[33377]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 249 MiB used, 715 GiB / 715 GiB avail 2024-05-08T06:37:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:57 smithi172 ceph-mon[33377]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:37:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:57 smithi172 ceph-mon[33377]: osdmap e55: 9 total, 8 up, 9 in 2024-05-08T06:37:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:57.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:57.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:57 smithi172 ceph-mon[33377]: osd.8 [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] boot 2024-05-08T06:37:57.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:57 smithi172 ceph-mon[33377]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T06:37:57.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:37:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:58 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:37:58.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:58 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:37:58.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:58 smithi194 ceph-mon[33679]: osdmap e57: 9 total, 9 up, 9 in 2024-05-08T06:37:58.528 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:58 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:37:58.528 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:58 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:37:58.528 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:58 smithi070 ceph-mon[29591]: osdmap e57: 9 total, 9 up, 9 in 2024-05-08T06:37:58.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:58 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:37:58.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:58 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:37:58.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:58 smithi172 ceph-mon[33377]: osdmap e57: 9 total, 9 up, 9 in 2024-05-08T06:37:59.796 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T06:37:59.796 INFO:teuthology.orchestra.run.smithi070.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T06:37:59.796 INFO:teuthology.orchestra.run.smithi070.stderr: stderr: 10+0 records in 2024-05-08T06:37:59.796 INFO:teuthology.orchestra.run.smithi070.stderr:10+0 records out 2024-05-08T06:37:59.796 INFO:teuthology.orchestra.run.smithi070.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0363831 s, 288 MB/s 2024-05-08T06:37:59.797 INFO:teuthology.orchestra.run.smithi070.stderr:--> Zapping successful for: 2024-05-08T06:38:00.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:59 smithi194 ceph-mon[33679]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:00.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:37:59 smithi194 ceph-mon[33679]: osdmap e58: 9 total, 9 up, 9 in 2024-05-08T06:38:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:59 smithi070 ceph-mon[29591]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:37:59 smithi070 ceph-mon[29591]: osdmap e58: 9 total, 9 up, 9 in 2024-05-08T06:38:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:59 smithi172 ceph-mon[33377]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:37:59 smithi172 ceph-mon[33377]: osdmap e58: 9 total, 9 up, 9 in 2024-05-08T06:38:00.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_1 2024-05-08T06:38:01.128 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:38:01.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: pgmap v251: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:01.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:38:01.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:01.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:01.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:01 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: pgmap v251: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:02.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:01 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: pgmap v251: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:02.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:01 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:02.828 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:02 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi194 2024-05-08T06:38:02.828 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:02 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 5696M 2024-05-08T06:38:03.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:02 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi194 2024-05-08T06:38:03.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:02 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 5696M 2024-05-08T06:38:03.081 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:02 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi194 2024-05-08T06:38:03.081 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:02 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 5696M 2024-05-08T06:38:03.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.405+0000 7f7477800700 1 -- 172.21.15.70:0/855801361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 msgr2=0x7f7470104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:38:03.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.405+0000 7f7477800700 1 --2- 172.21.15.70:0/855801361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 0x7f7470104b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f745c0099c0 tx=0x7f745c009cd0 comp rx=0 tx=0).stop 2024-05-08T06:38:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.405+0000 7f7477800700 1 -- 172.21.15.70:0/855801361 shutdown_connections 2024-05-08T06:38:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.405+0000 7f7477800700 1 --2- 172.21.15.70:0/855801361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74701050a0 0x7f747010b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.405+0000 7f7477800700 1 --2- 172.21.15.70:0/855801361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7470103500 0x7f7470103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.405+0000 7f7477800700 1 --2- 172.21.15.70:0/855801361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 0x7f7470104b60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.405+0000 7f7477800700 1 -- 172.21.15.70:0/855801361 >> 172.21.15.70:0/855801361 conn(0x7f74700feaa0 msgr2=0x7f7470100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:38:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.405+0000 7f7477800700 1 -- 172.21.15.70:0/855801361 shutdown_connections 2024-05-08T06:38:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.405+0000 7f7477800700 1 -- 172.21.15.70:0/855801361 wait complete. 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.407+0000 7f7477800700 1 Processor -- start 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.407+0000 7f7477800700 1 -- start start 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.407+0000 7f7477800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7470103500 0x7f747019b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.407+0000 7f7477800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 0x7f747019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.407+0000 7f7477800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74701050a0 0x7f74701a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.407+0000 7f7477800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f747010eea0 con 0x7f7470104700 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.407+0000 7f7477800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f747010ed20 con 0x7f74701050a0 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.407+0000 7f7477800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f747010f020 con 0x7f7470103500 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f746fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 0x7f747019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:38:03.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f746fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 0x7f747019bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47200/0 (socket says 172.21.15.70:47200) 2024-05-08T06:38:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f746fe00700 1 -- 172.21.15.70:0/731813683 learned_addr learned my addr 172.21.15.70:0/731813683 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:38:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f7474e00700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7470103500 0x7f747019b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:38:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f746fe00700 1 -- 172.21.15.70:0/731813683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7470103500 msgr2=0x7f747019b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:38:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f746fe00700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7470103500 0x7f747019b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f7475800700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74701050a0 0x7f74701a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:38:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f746fe00700 1 -- 172.21.15.70:0/731813683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74701050a0 msgr2=0x7f74701a2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:38:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f746fe00700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74701050a0 0x7f74701a2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.408+0000 7f746fe00700 1 -- 172.21.15.70:0/731813683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74701a3400 con 0x7f7470104700 2024-05-08T06:38:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.409+0000 7f746fe00700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 0x7f747019bd30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f745c00b580 tx=0x7f745c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:38:03.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.409+0000 7f746d600700 1 -- 172.21.15.70:0/731813683 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c027070 con 0x7f7470104700 2024-05-08T06:38:03.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.409+0000 7f746d600700 1 -- 172.21.15.70:0/731813683 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f745c00bd10 con 0x7f7470104700 2024-05-08T06:38:03.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.409+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74701a3690 con 0x7f7470104700 2024-05-08T06:38:03.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.409+0000 7f746d600700 1 -- 172.21.15.70:0/731813683 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c0037f0 con 0x7f7470104700 2024-05-08T06:38:03.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.409+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74701a3b40 con 0x7f7470104700 2024-05-08T06:38:03.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.410+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f747006a190 con 0x7f7470104700 2024-05-08T06:38:03.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.414+0000 7f746d600700 1 -- 172.21.15.70:0/731813683 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f745c02a070 con 0x7f7470104700 2024-05-08T06:38:03.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.416+0000 7f746d600700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74580b2900 0x7f74580b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:38:03.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.416+0000 7f746d600700 1 -- 172.21.15.70:0/731813683 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5829+0+0 (secure 0 0 0) 0x7f745c0e2fb0 con 0x7f7470104700 2024-05-08T06:38:03.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.416+0000 7f7474e00700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74580b2900 0x7f74580b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:38:03.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.417+0000 7f7474e00700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74580b2900 0x7f74580b4dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7464005950 tx=0x7f74640058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:38:03.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.418+0000 7f746d600700 1 -- 172.21.15.70:0/731813683 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f745c031070 con 0x7f7470104700 2024-05-08T06:38:03.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:03.663+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f74701a3e60 con 0x7f74580b2900 2024-05-08T06:38:04.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:03 smithi194 ceph-mon[33679]: pgmap v252: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:04.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:38:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:38:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:04.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:03 smithi070 ceph-mon[29591]: pgmap v252: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:04.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:38:04.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:38:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:03 smithi172 ceph-mon[33377]: pgmap v252: 1 pgs: 1 peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:38:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:38:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:04.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:04 smithi070 ceph-mon[29591]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:38:05.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:04 smithi194 ceph-mon[33679]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:38:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:04 smithi172 ceph-mon[33377]: from='client.14397 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:38:05.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:05 smithi070 ceph-mon[29591]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-08T06:38:06.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:05 smithi194 ceph-mon[33679]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-08T06:38:06.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:05 smithi172 ceph-mon[33377]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-05-08T06:38:08.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:07 smithi194 ceph-mon[33679]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T06:38:08.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:07 smithi070 ceph-mon[29591]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T06:38:08.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:07 smithi172 ceph-mon[33377]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T06:38:09.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/729315352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d65536ca-d40f-4700-8631-2bddb2d0db04"}]: dispatch 2024-05-08T06:38:09.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/729315352' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d65536ca-d40f-4700-8631-2bddb2d0db04"}]': finished 2024-05-08T06:38:09.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:08 smithi194 ceph-mon[33679]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T06:38:09.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:08 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:09.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/729315352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d65536ca-d40f-4700-8631-2bddb2d0db04"}]: dispatch 2024-05-08T06:38:09.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/729315352' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d65536ca-d40f-4700-8631-2bddb2d0db04"}]': finished 2024-05-08T06:38:09.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:08 smithi070 ceph-mon[29591]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T06:38:09.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:08 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:09.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/729315352' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d65536ca-d40f-4700-8631-2bddb2d0db04"}]: dispatch 2024-05-08T06:38:09.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/729315352' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d65536ca-d40f-4700-8631-2bddb2d0db04"}]': finished 2024-05-08T06:38:09.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:08 smithi172 ceph-mon[33377]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T06:38:09.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:08 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:10.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:09 smithi194 ceph-mon[33679]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-08T06:38:10.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/168950033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:38:10.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:09 smithi070 ceph-mon[29591]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-08T06:38:10.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/168950033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:38:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:09 smithi172 ceph-mon[33377]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-08T06:38:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/168950033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:38:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:11 smithi070 ceph-mon[29591]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:38:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:11 smithi194 ceph-mon[33679]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:38:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:11 smithi172 ceph-mon[33377]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:38:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:13 smithi194 ceph-mon[33679]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:38:14.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:13 smithi070 ceph-mon[29591]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:38:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:13 smithi172 ceph-mon[33377]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:38:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:15 smithi070 ceph-mon[29591]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:15 smithi172 ceph-mon[33377]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:16.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:15 smithi194 ceph-mon[33679]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:17 smithi070 ceph-mon[29591]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:17 smithi172 ceph-mon[33377]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:17 smithi194 ceph-mon[33679]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:19.057 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T06:38:19.057 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:19.057 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:18 smithi070 ceph-mon[29591]: Deploying daemon osd.9 on smithi070 2024-05-08T06:38:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T06:38:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:18 smithi172 ceph-mon[33377]: Deploying daemon osd.9 on smithi070 2024-05-08T06:38:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T06:38:19.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:19.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:18 smithi194 ceph-mon[33679]: Deploying daemon osd.9 on smithi070 2024-05-08T06:38:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:19 smithi070 ceph-mon[29591]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:19 smithi172 ceph-mon[33377]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:19 smithi194 ceph-mon[33679]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:21 smithi070 ceph-mon[29591]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:22.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:21 smithi172 ceph-mon[33377]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:22.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:21 smithi194 ceph-mon[33679]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:24.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:23 smithi070 ceph-mon[29591]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:23 smithi172 ceph-mon[33377]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:24.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:23 smithi194 ceph-mon[33679]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:26.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:25 smithi070 ceph-mon[29591]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:26.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:25 smithi172 ceph-mon[33377]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:26.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:25 smithi194 ceph-mon[33679]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:28.063 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:27 smithi194 ceph-mon[33679]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:28.064 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:27 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:28.064 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:27 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:28.064 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:27 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:38:28.096 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:27 smithi070 ceph-mon[29591]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:28.096 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:27 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:28.096 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:27 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:28.096 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:27 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:38:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:27 smithi172 ceph-mon[33377]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:27 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:27 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:27 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:38:30.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:29 smithi194 ceph-mon[33679]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:30.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:29 smithi070 ceph-mon[29591]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:29 smithi172 ceph-mon[33377]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:31 smithi070 ceph-mon[29591]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:31 smithi070 ceph-mon[29591]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T06:38:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:31 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:31 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:31 smithi172 ceph-mon[33377]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:31 smithi172 ceph-mon[33377]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T06:38:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:31 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:31 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:32.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:31 smithi194 ceph-mon[33679]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:32.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:31 smithi194 ceph-mon[33679]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T06:38:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:31 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:31 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:32.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.372+0000 7f746d600700 1 -- 172.21.15.70:0/731813683 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f74701a3e60 con 0x7f74580b2900 2024-05-08T06:38:32.373 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 9 on host 'smithi070' 2024-05-08T06:38:32.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74580b2900 msgr2=0x7f74580b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:38:32.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74580b2900 0x7f74580b4dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7464005950 tx=0x7f74640058e0 comp rx=0 tx=0).stop 2024-05-08T06:38:32.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 msgr2=0x7f747019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:38:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 0x7f747019bd30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f745c00b580 tx=0x7f745c00f740 comp rx=0 tx=0).stop 2024-05-08T06:38:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 shutdown_connections 2024-05-08T06:38:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f74701050a0 0x7f74701a2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7470103500 0x7f747019b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74580b2900 0x7f74580b4dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 --2- 172.21.15.70:0/731813683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7470104700 0x7f747019bd30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 >> 172.21.15.70:0/731813683 conn(0x7f74700feaa0 msgr2=0x7f74700756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:38:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 shutdown_connections 2024-05-08T06:38:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:38:32.377+0000 7f7477800700 1 -- 172.21.15.70:0/731813683 wait complete. 2024-05-08T06:38:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:32 smithi070 ceph-mon[29591]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T06:38:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:32 smithi070 ceph-mon[29591]: osdmap e60: 10 total, 9 up, 10 in 2024-05-08T06:38:33.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:32 smithi070 ceph-mon[29591]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:38:33.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:33.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:33.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:33.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:32 smithi070 ceph-mon[29591]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:38:33.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:32 smithi070 ceph-mon[29591]: osdmap e61: 10 total, 9 up, 10 in 2024-05-08T06:38:33.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:32 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:32 smithi172 ceph-mon[33377]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T06:38:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:32 smithi172 ceph-mon[33377]: osdmap e60: 10 total, 9 up, 10 in 2024-05-08T06:38:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:32 smithi172 ceph-mon[33377]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:38:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:33.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:33.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:32 smithi172 ceph-mon[33377]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:38:33.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:32 smithi172 ceph-mon[33377]: osdmap e61: 10 total, 9 up, 10 in 2024-05-08T06:38:33.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:32 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:33.260 DEBUG:teuthology.orchestra.run.smithi070:osd.9> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.9.service 2024-05-08T06:38:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:32 smithi194 ceph-mon[33679]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T06:38:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:32 smithi194 ceph-mon[33679]: osdmap e60: 10 total, 9 up, 10 in 2024-05-08T06:38:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:32 smithi194 ceph-mon[33679]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-05-08T06:38:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:32 smithi194 ceph-mon[33679]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-05-08T06:38:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:32 smithi194 ceph-mon[33679]: osdmap e61: 10 total, 9 up, 10 in 2024-05-08T06:38:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:32 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:33.266 INFO:tasks.cephadm:Deploying osd.10 on smithi172 with /dev/vg_nvme/lv_1... 2024-05-08T06:38:33.266 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T06:38:33.714 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:38:33.847 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 06:38:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T06:38:33.546+0000 7f9630a00700 -1 osd.9 0 waiting for initial osdmap 2024-05-08T06:38:33.847 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 06:38:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T06:38:33.573+0000 7f9626800700 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T06:38:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:33 smithi070 ceph-mon[29591]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:33 smithi070 ceph-mon[29591]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' 2024-05-08T06:38:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:34.167 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:33 smithi172 ceph-mon[33377]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:34.167 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:34.167 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:33 smithi172 ceph-mon[33377]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' 2024-05-08T06:38:34.167 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:33 smithi194 ceph-mon[33679]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:33 smithi194 ceph-mon[33679]: from='osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436]' entity='osd.9' 2024-05-08T06:38:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:35.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:34 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:38:35.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:34 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:38:35.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:34 smithi070 ceph-mon[29591]: osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] boot 2024-05-08T06:38:35.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:34 smithi070 ceph-mon[29591]: osdmap e62: 10 total, 10 up, 10 in 2024-05-08T06:38:35.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:35.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:34 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:38:35.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:34 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:38:35.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:34 smithi172 ceph-mon[33377]: osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] boot 2024-05-08T06:38:35.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:34 smithi172 ceph-mon[33377]: osdmap e62: 10 total, 10 up, 10 in 2024-05-08T06:38:35.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:34 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:38:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:34 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:38:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:34 smithi194 ceph-mon[33679]: osd.9 [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] boot 2024-05-08T06:38:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:34 smithi194 ceph-mon[33679]: osdmap e62: 10 total, 10 up, 10 in 2024-05-08T06:38:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:38:36.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:35 smithi070 ceph-mon[29591]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:35 smithi172 ceph-mon[33377]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:36.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:35 smithi194 ceph-mon[33679]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-08T06:38:36.753 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T06:38:36.754 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T06:38:36.754 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2024-05-08T06:38:36.754 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2024-05-08T06:38:36.754 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0356444 s, 294 MB/s 2024-05-08T06:38:36.754 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2024-05-08T06:38:37.112 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:36 smithi172 ceph-mon[33377]: osdmap e63: 10 total, 10 up, 10 in 2024-05-08T06:38:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:36 smithi070 ceph-mon[29591]: osdmap e63: 10 total, 10 up, 10 in 2024-05-08T06:38:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:36 smithi194 ceph-mon[33679]: osdmap e63: 10 total, 10 up, 10 in 2024-05-08T06:38:37.700 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2024-05-08T06:38:38.115 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:38:38.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:37 smithi070 ceph-mon[29591]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:38.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:37 smithi172 ceph-mon[33377]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:37 smithi194 ceph-mon[33679]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:39.842 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:39.842 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi070 2024-05-08T06:38:39.842 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:39.842 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:39.842 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 4272M 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:39.843 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi070 2024-05-08T06:38:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 4272M 2024-05-08T06:38:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:38:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi070 2024-05-08T06:38:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 4272M 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:38:40.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:40.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:38:40.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:38:40.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.338+0000 7fc9f2800700 1 -- 172.21.15.172:0/3547349611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec105740 msgr2=0x7fc9ec105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:38:40.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.338+0000 7fc9f2800700 1 --2- 172.21.15.172:0/3547349611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec105740 0x7fc9ec105b60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0099c0 tx=0x7fc9dc009cd0 comp rx=0 tx=0).stop 2024-05-08T06:38:40.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.338+0000 7fc9f2800700 1 -- 172.21.15.172:0/3547349611 shutdown_connections 2024-05-08T06:38:40.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.338+0000 7fc9f2800700 1 --2- 172.21.15.172:0/3547349611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec1072e0 0x7fc9ec10db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:40.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.338+0000 7fc9f2800700 1 --2- 172.21.15.172:0/3547349611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec105740 0x7fc9ec105b60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:40.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.338+0000 7fc9f2800700 1 --2- 172.21.15.172:0/3547349611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9ec106940 0x7fc9ec106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:40.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.338+0000 7fc9f2800700 1 -- 172.21.15.172:0/3547349611 >> 172.21.15.172:0/3547349611 conn(0x7fc9ec100d00 msgr2=0x7fc9ec103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:38:40.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.339+0000 7fc9f2800700 1 -- 172.21.15.172:0/3547349611 shutdown_connections 2024-05-08T06:38:40.338 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.339+0000 7fc9f2800700 1 -- 172.21.15.172:0/3547349611 wait complete. 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.340+0000 7fc9f2800700 1 Processor -- start 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.340+0000 7fc9f2800700 1 -- start start 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.340+0000 7fc9f2800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9ec105740 0x7fc9ec07b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.340+0000 7fc9f2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec106940 0x7fc9ec07b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.340+0000 7fc9f2800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec1072e0 0x7fc9ec077dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.340+0000 7fc9f2800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec1110b0 con 0x7fc9ec106940 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.340+0000 7fc9f2800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec110f30 con 0x7fc9ec1072e0 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.340+0000 7fc9f2800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc9ec111230 con 0x7fc9ec105740 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9ebe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec1072e0 0x7fc9ec077dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9ebe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec1072e0 0x7fc9ec077dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.172:39660/0 (socket says 172.21.15.172:39660) 2024-05-08T06:38:40.340 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9ebe00700 1 -- 172.21.15.172:0/1579816739 learned_addr learned my addr 172.21.15.172:0/1579816739 (peer_addr_for_me v2:172.21.15.172:0/0) 2024-05-08T06:38:40.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9eb400700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9ec105740 0x7fc9ec07b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:38:40.341 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9eaa00700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec106940 0x7fc9ec07b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9ebe00700 1 -- 172.21.15.172:0/1579816739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9ec105740 msgr2=0x7fc9ec07b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9ebe00700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9ec105740 0x7fc9ec07b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9ebe00700 1 -- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec106940 msgr2=0x7fc9ec07b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9ebe00700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec106940 0x7fc9ec07b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9ebe00700 1 -- 172.21.15.172:0/1579816739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9ec0786a0 con 0x7fc9ec1072e0 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.341+0000 7fc9eaa00700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec106940 0x7fc9ec07b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.342+0000 7fc9ebe00700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec1072e0 0x7fc9ec077dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4007ee0 tx=0x7fc9e400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.342+0000 7fc9e3e00700 1 -- 172.21.15.172:0/1579816739 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400ddd0 con 0x7fc9ec1072e0 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.342+0000 7fc9e3e00700 1 -- 172.21.15.172:0/1579816739 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc9e4004020 con 0x7fc9ec1072e0 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.342+0000 7fc9e3e00700 1 -- 172.21.15.172:0/1579816739 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4015660 con 0x7fc9ec1072e0 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.342+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9ec1a7c20 con 0x7fc9ec1072e0 2024-05-08T06:38:40.342 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.342+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9ec1a8020 con 0x7fc9ec1072e0 2024-05-08T06:38:40.343 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.343+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9ec02e510 con 0x7fc9ec1072e0 2024-05-08T06:38:40.344 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.345+0000 7fc9e3e00700 1 -- 172.21.15.172:0/1579816739 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc9e40041d0 con 0x7fc9ec1072e0 2024-05-08T06:38:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.347+0000 7fc9e3e00700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9d00b2900 0x7fc9d00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:38:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.347+0000 7fc9e3e00700 1 -- 172.21.15.172:0/1579816739 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6261+0+0 (secure 0 0 0) 0x7fc9e40e1420 con 0x7fc9ec1072e0 2024-05-08T06:38:40.346 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.348+0000 7fc9eb400700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9d00b2900 0x7fc9d00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:38:40.347 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.349+0000 7fc9eb400700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9d00b2900 0x7fc9d00b4dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009990 tx=0x7fc9dc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:38:40.351 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.352+0000 7fc9e3e00700 1 -- 172.21.15.172:0/1579816739 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc9e4010070 con 0x7fc9ec1072e0 2024-05-08T06:38:40.598 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:38:40.598+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc9ec0638e0 con 0x7fc9d00b2900 2024-05-08T06:38:40.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:40 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:38:40.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:40 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:38:40.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:40 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:40 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:38:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:40 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:38:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:40 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:40 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:38:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:40 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:38:41.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:40 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:41.878 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:41 smithi172 ceph-mon[33377]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:41.879 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:41 smithi172 ceph-mon[33377]: from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:38:42.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:41 smithi070 ceph-mon[29591]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:41 smithi070 ceph-mon[29591]: from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:38:42.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:41 smithi194 ceph-mon[33679]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:42.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:41 smithi194 ceph-mon[33679]: from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:38:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:43 smithi070 ceph-mon[29591]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:44.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:43 smithi172 ceph-mon[33377]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:43 smithi194 ceph-mon[33679]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:44 smithi070 ceph-mon[29591]: from='client.? 172.21.15.172:0/218627275' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0"}]: dispatch 2024-05-08T06:38:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:44 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0"}]: dispatch 2024-05-08T06:38:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:44 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0"}]': finished 2024-05-08T06:38:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:44 smithi070 ceph-mon[29591]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T06:38:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:44 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:38:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:44 smithi172 ceph-mon[33377]: from='client.? 172.21.15.172:0/218627275' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0"}]: dispatch 2024-05-08T06:38:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:44 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0"}]: dispatch 2024-05-08T06:38:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:44 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0"}]': finished 2024-05-08T06:38:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:44 smithi172 ceph-mon[33377]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T06:38:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:44 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:38:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:44 smithi194 ceph-mon[33679]: from='client.? 172.21.15.172:0/218627275' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0"}]: dispatch 2024-05-08T06:38:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:44 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0"}]: dispatch 2024-05-08T06:38:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:44 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0"}]': finished 2024-05-08T06:38:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:44 smithi194 ceph-mon[33679]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T06:38:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:44 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:38:46.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:45 smithi070 ceph-mon[29591]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:45 smithi070 ceph-mon[29591]: from='client.? 172.21.15.172:0/1291698578' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:38:46.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:45 smithi172 ceph-mon[33377]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:46.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:45 smithi172 ceph-mon[33377]: from='client.? 172.21.15.172:0/1291698578' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:38:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:45 smithi194 ceph-mon[33679]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:45 smithi194 ceph-mon[33679]: from='client.? 172.21.15.172:0/1291698578' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:38:48.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:47 smithi070 ceph-mon[29591]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:47 smithi172 ceph-mon[33377]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:48.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:47 smithi194 ceph-mon[33679]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:49 smithi070 ceph-mon[29591]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:49 smithi172 ceph-mon[33377]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:49 smithi194 ceph-mon[33679]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:52.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:51 smithi070 ceph-mon[29591]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:52.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:51 smithi172 ceph-mon[33377]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:51 smithi194 ceph-mon[33679]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:54.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:53 smithi070 ceph-mon[29591]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:53 smithi172 ceph-mon[33377]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:53 smithi194 ceph-mon[33679]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T06:38:55.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:54 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:55.159 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:54 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T06:38:55.159 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:54 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T06:38:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:54 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:38:56.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:55 smithi070 ceph-mon[29591]: Deploying daemon osd.10 on smithi172 2024-05-08T06:38:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:55 smithi070 ceph-mon[29591]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:55 smithi172 ceph-mon[33377]: Deploying daemon osd.10 on smithi172 2024-05-08T06:38:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:55 smithi172 ceph-mon[33377]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:55 smithi194 ceph-mon[33679]: Deploying daemon osd.10 on smithi172 2024-05-08T06:38:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:55 smithi194 ceph-mon[33679]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:58.100 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:57 smithi172 ceph-mon[33377]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:57 smithi070 ceph-mon[29591]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:38:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:57 smithi194 ceph-mon[33679]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:00.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:38:59 smithi070 ceph-mon[29591]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:00.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:38:59 smithi172 ceph-mon[33377]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:00.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:38:59 smithi194 ceph-mon[33679]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:01 smithi172 ceph-mon[33377]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:02.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:01 smithi070 ceph-mon[29591]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:02.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:01 smithi194 ceph-mon[33679]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:03.779 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:03 smithi172 ceph-mon[33377]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:03.779 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:03.779 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:03.779 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:03 smithi070 ceph-mon[29591]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:04.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:03 smithi194 ceph-mon[33679]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:04.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:05.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:05 smithi172 ceph-mon[33377]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:05.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:05 smithi070 ceph-mon[29591]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:06.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:05 smithi194 ceph-mon[33679]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:07.460 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.459+0000 7fc9e3e00700 1 -- 172.21.15.172:0/1579816739 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc9ec0638e0 con 0x7fc9d00b2900 2024-05-08T06:39:07.460 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 10 on host 'smithi172' 2024-05-08T06:39:07.463 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.463+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9d00b2900 msgr2=0x7fc9d00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.463+0000 7fc9f2800700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9d00b2900 0x7fc9d00b4dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc009990 tx=0x7fc9dc005fb0 comp rx=0 tx=0).stop 2024-05-08T06:39:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.463+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec1072e0 msgr2=0x7fc9ec077dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.463+0000 7fc9f2800700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec1072e0 0x7fc9ec077dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4007ee0 tx=0x7fc9e400d3b0 comp rx=0 tx=0).stop 2024-05-08T06:39:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.464+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 shutdown_connections 2024-05-08T06:39:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.464+0000 7fc9f2800700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9ec1072e0 0x7fc9ec077dd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.464+0000 7fc9f2800700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9ec105740 0x7fc9ec07b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.464+0000 7fc9f2800700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9d00b2900 0x7fc9d00b4dc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.464+0000 7fc9f2800700 1 --2- 172.21.15.172:0/1579816739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9ec106940 0x7fc9ec07b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:07.464 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.464+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 >> 172.21.15.172:0/1579816739 conn(0x7fc9ec100d00 msgr2=0x7fc9ec109d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:07.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.464+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 shutdown_connections 2024-05-08T06:39:07.465 INFO:teuthology.orchestra.run.smithi172.stderr:2024-05-08T06:39:07.464+0000 7fc9f2800700 1 -- 172.21.15.172:0/1579816739 wait complete. 2024-05-08T06:39:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:07 smithi172 ceph-mon[33377]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:07 smithi172 ceph-mon[33377]: from='osd.10 [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T06:39:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:07 smithi172 ceph-mon[33377]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T06:39:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:07 smithi194 ceph-mon[33679]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:07 smithi194 ceph-mon[33679]: from='osd.10 [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T06:39:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:07 smithi194 ceph-mon[33679]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T06:39:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:07 smithi070 ceph-mon[29591]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:07 smithi070 ceph-mon[29591]: from='osd.10 [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T06:39:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:07 smithi070 ceph-mon[29591]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T06:39:08.278 DEBUG:teuthology.orchestra.run.smithi172:osd.10> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.10.service 2024-05-08T06:39:08.283 INFO:tasks.cephadm:Deploying osd.11 on smithi194 with /dev/vg_nvme/lv_1... 2024-05-08T06:39:08.283 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T06:39:08.634 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:08 smithi172 ceph-mon[33377]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T06:39:08.634 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:08 smithi172 ceph-mon[33377]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T06:39:08.634 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:08 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:08.634 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:08 smithi172 ceph-mon[33377]: from='osd.10 [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:39:08.634 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:08 smithi172 ceph-mon[33377]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:39:08.634 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:08 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:08.635 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:08 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:08.717 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:39:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:08 smithi194 ceph-mon[33679]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T06:39:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:08 smithi194 ceph-mon[33679]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T06:39:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:08 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:08 smithi194 ceph-mon[33679]: from='osd.10 [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:39:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:08 smithi194 ceph-mon[33679]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:39:08.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:08 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:08.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:08 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:08.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:08 smithi070 ceph-mon[29591]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T06:39:08.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:08 smithi070 ceph-mon[29591]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T06:39:08.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:08 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:08.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:08 smithi070 ceph-mon[29591]: from='osd.10 [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:39:08.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:08 smithi070 ceph-mon[29591]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2024-05-08T06:39:08.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:08 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:08.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:08 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:09 smithi194 ceph-mon[33679]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:09 smithi194 ceph-mon[33679]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:39:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:09 smithi194 ceph-mon[33679]: osdmap e66: 11 total, 10 up, 11 in 2024-05-08T06:39:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:09 smithi194 ceph-mon[33679]: from='osd.10 ' entity='osd.10' 2024-05-08T06:39:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:09 smithi194 ceph-mon[33679]: osd.10 [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] boot 2024-05-08T06:39:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:09 smithi194 ceph-mon[33679]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T06:39:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:09 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:09 smithi172 ceph-mon[33377]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:09.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:09 smithi172 ceph-mon[33377]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:39:09.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:09 smithi172 ceph-mon[33377]: osdmap e66: 11 total, 10 up, 11 in 2024-05-08T06:39:09.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:09.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:09.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:09 smithi172 ceph-mon[33377]: from='osd.10 ' entity='osd.10' 2024-05-08T06:39:09.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:09 smithi172 ceph-mon[33377]: osd.10 [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] boot 2024-05-08T06:39:09.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:09 smithi172 ceph-mon[33377]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T06:39:09.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:09 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:09.680 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 06:39:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T06:39:09.272+0000 7f9d26400700 -1 osd.10 0 waiting for initial osdmap 2024-05-08T06:39:09.681 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 06:39:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T06:39:09.305+0000 7f9d1c200700 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T06:39:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:09 smithi070 ceph-mon[29591]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 312 MiB used, 894 GiB / 894 GiB avail 2024-05-08T06:39:09.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:09 smithi070 ceph-mon[29591]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2024-05-08T06:39:09.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:09 smithi070 ceph-mon[29591]: osdmap e66: 11 total, 10 up, 11 in 2024-05-08T06:39:09.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:09.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:09.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:09 smithi070 ceph-mon[29591]: from='osd.10 ' entity='osd.10' 2024-05-08T06:39:09.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:09 smithi070 ceph-mon[29591]: osd.10 [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] boot 2024-05-08T06:39:09.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:09 smithi070 ceph-mon[29591]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T06:39:09.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:09 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:39:10.653 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:10 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:39:10.653 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:10 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:39:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:10 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:39:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:10 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:39:10.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:10 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:39:10.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:10 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:39:11.705 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T06:39:11.706 INFO:teuthology.orchestra.run.smithi194.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T06:39:11.706 INFO:teuthology.orchestra.run.smithi194.stderr: stderr: 10+0 records in 2024-05-08T06:39:11.706 INFO:teuthology.orchestra.run.smithi194.stderr:10+0 records out 2024-05-08T06:39:11.706 INFO:teuthology.orchestra.run.smithi194.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0339878 s, 309 MB/s 2024-05-08T06:39:11.706 INFO:teuthology.orchestra.run.smithi194.stderr:--> Zapping successful for: 2024-05-08T06:39:11.746 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:11 smithi194 ceph-mon[33679]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 387 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:11.746 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:11 smithi194 ceph-mon[33679]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T06:39:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:11 smithi070 ceph-mon[29591]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 387 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:11 smithi070 ceph-mon[29591]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T06:39:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:11 smithi172 ceph-mon[33377]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 387 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:11 smithi172 ceph-mon[33377]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T06:39:12.645 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:12 smithi194 ceph-mon[33679]: osdmap e69: 11 total, 11 up, 11 in 2024-05-08T06:39:12.649 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi194:vg_nvme/lv_1 2024-05-08T06:39:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:12 smithi070 ceph-mon[29591]: osdmap e69: 11 total, 11 up, 11 in 2024-05-08T06:39:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:12 smithi172 ceph-mon[33377]: osdmap e69: 11 total, 11 up, 11 in 2024-05-08T06:39:13.077 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:39:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 387 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 387 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 387 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:14.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:14 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi172 2024-05-08T06:39:14.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:14 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 4272M 2024-05-08T06:39:14.659 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:14.660 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:14.660 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:14.660 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:14.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:14 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi172 2024-05-08T06:39:14.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:14 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 4272M 2024-05-08T06:39:14.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:14.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:14.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:14.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:14 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi172 2024-05-08T06:39:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:14 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 4272M 2024-05-08T06:39:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:14.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:14.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:14.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:15.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.537+0000 7fbbe8000700 1 -- 172.21.15.194:0/2520531568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe01072e0 msgr2=0x7fbbe010db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:15.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.537+0000 7fbbe8000700 1 --2- 172.21.15.194:0/2520531568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe01072e0 0x7fbbe010db90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800b0a0 tx=0x7fbbd800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:39:15.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.538+0000 7fbbe8000700 1 -- 172.21.15.194:0/2520531568 shutdown_connections 2024-05-08T06:39:15.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.538+0000 7fbbe8000700 1 --2- 172.21.15.194:0/2520531568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe01072e0 0x7fbbe010db90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:15.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.538+0000 7fbbe8000700 1 --2- 172.21.15.194:0/2520531568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe0105740 0x7fbbe0105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:15.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.538+0000 7fbbe8000700 1 --2- 172.21.15.194:0/2520531568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe0106940 0x7fbbe0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:15.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.538+0000 7fbbe8000700 1 -- 172.21.15.194:0/2520531568 >> 172.21.15.194:0/2520531568 conn(0x7fbbe0100d00 msgr2=0x7fbbe0103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:15.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.538+0000 7fbbe8000700 1 -- 172.21.15.194:0/2520531568 shutdown_connections 2024-05-08T06:39:15.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.538+0000 7fbbe8000700 1 -- 172.21.15.194:0/2520531568 wait complete. 2024-05-08T06:39:15.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.539+0000 7fbbe8000700 1 Processor -- start 2024-05-08T06:39:15.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.539+0000 7fbbe8000700 1 -- start start 2024-05-08T06:39:15.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.539+0000 7fbbe8000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe0105740 0x7fbbe019b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:15.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.539+0000 7fbbe8000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe0106940 0x7fbbe019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:15.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.539+0000 7fbbe8000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe01072e0 0x7fbbe01a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:15.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.539+0000 7fbbe8000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe01110e0 con 0x7fbbe0106940 2024-05-08T06:39:15.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.539+0000 7fbbe8000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe0110f60 con 0x7fbbe01072e0 2024-05-08T06:39:15.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.539+0000 7fbbe8000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe0111260 con 0x7fbbe0105740 2024-05-08T06:39:15.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe5600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe0105740 0x7fbbe019b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe5600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe0105740 0x7fbbe019b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55376/0 (socket says 172.21.15.194:55376) 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe5600700 1 -- 172.21.15.194:0/589648196 learned_addr learned my addr 172.21.15.194:0/589648196 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe4c00700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe0106940 0x7fbbe019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe6000700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe01072e0 0x7fbbe01a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe5600700 1 -- 172.21.15.194:0/589648196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe01072e0 msgr2=0x7fbbe01a2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe5600700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe01072e0 0x7fbbe01a2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe5600700 1 -- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe0106940 msgr2=0x7fbbe019bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe5600700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe0106940 0x7fbbe019bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe5600700 1 -- 172.21.15.194:0/589648196 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe01a33b0 con 0x7fbbe0105740 2024-05-08T06:39:15.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe6000700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe01072e0 0x7fbbe01a2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:39:15.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.540+0000 7fbbe5600700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe0105740 0x7fbbe019b750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400d9b0 tx=0x7fbbd400dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:15.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.541+0000 7fbbde000700 1 -- 172.21.15.194:0/589648196 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4017070 con 0x7fbbe0105740 2024-05-08T06:39:15.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.541+0000 7fbbde000700 1 -- 172.21.15.194:0/589648196 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbd4010460 con 0x7fbbe0105740 2024-05-08T06:39:15.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.541+0000 7fbbde000700 1 -- 172.21.15.194:0/589648196 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd400f620 con 0x7fbbe0105740 2024-05-08T06:39:15.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.541+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe01a36a0 con 0x7fbbe0105740 2024-05-08T06:39:15.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.541+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe01a3be0 con 0x7fbbe0105740 2024-05-08T06:39:15.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.542+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe006a190 con 0x7fbbe0105740 2024-05-08T06:39:15.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.544+0000 7fbbde000700 1 -- 172.21.15.194:0/589648196 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbbd4010610 con 0x7fbbe0105740 2024-05-08T06:39:15.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.546+0000 7fbbde000700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbc80b2900 0x7fbbc80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:15.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.546+0000 7fbbde000700 1 -- 172.21.15.194:0/589648196 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6694+0+0 (secure 0 0 0) 0x7fbbd40e1780 con 0x7fbbe0105740 2024-05-08T06:39:15.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.547+0000 7fbbe4c00700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbc80b2900 0x7fbbc80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:15.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.548+0000 7fbbe4c00700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbc80b2900 0x7fbbc80b4dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0005950 tx=0x7fbbd00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:15.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.551+0000 7fbbde000700 1 -- 172.21.15.194:0/589648196 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbbd40a9a50 con 0x7fbbe0105740 2024-05-08T06:39:15.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:15.795+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fbbe00639a0 con 0x7fbbc80b2900 2024-05-08T06:39:15.794 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:15 smithi194 ceph-mon[33679]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 387 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-05-08T06:39:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:15 smithi070 ceph-mon[29591]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 387 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-05-08T06:39:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:15 smithi172 ceph-mon[33377]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 387 MiB used, 983 GiB / 983 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-05-08T06:39:16.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:16 smithi172 ceph-mon[33377]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:39:16.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:39:16.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:39:16.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:16.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:16 smithi194 ceph-mon[33679]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:39:16.940 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:39:16.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:39:16.941 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:16 smithi070 ceph-mon[29591]: from='client.24322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi194:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:39:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T06:39:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T06:39:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:17.792 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:17 smithi194 ceph-mon[33679]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-05-08T06:39:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:17 smithi172 ceph-mon[33377]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-05-08T06:39:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:17 smithi070 ceph-mon[29591]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-05-08T06:39:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:19 smithi172 ceph-mon[33377]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T06:39:20.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:19 smithi194 ceph-mon[33679]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T06:39:20.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:19 smithi070 ceph-mon[29591]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T06:39:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:20 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/1769820374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "820c95fd-0e17-4077-860c-ed32ad54d045"}]: dispatch 2024-05-08T06:39:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:20 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "820c95fd-0e17-4077-860c-ed32ad54d045"}]: dispatch 2024-05-08T06:39:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:20 smithi172 ceph-mon[33377]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "820c95fd-0e17-4077-860c-ed32ad54d045"}]': finished 2024-05-08T06:39:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:20 smithi172 ceph-mon[33377]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T06:39:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:20 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:21.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:20 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/1769820374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "820c95fd-0e17-4077-860c-ed32ad54d045"}]: dispatch 2024-05-08T06:39:21.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:20 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "820c95fd-0e17-4077-860c-ed32ad54d045"}]: dispatch 2024-05-08T06:39:21.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:20 smithi194 ceph-mon[33679]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "820c95fd-0e17-4077-860c-ed32ad54d045"}]': finished 2024-05-08T06:39:21.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:20 smithi194 ceph-mon[33679]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T06:39:21.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:20 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:20 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/1769820374' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "820c95fd-0e17-4077-860c-ed32ad54d045"}]: dispatch 2024-05-08T06:39:21.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:20 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "820c95fd-0e17-4077-860c-ed32ad54d045"}]: dispatch 2024-05-08T06:39:21.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:20 smithi070 ceph-mon[29591]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "820c95fd-0e17-4077-860c-ed32ad54d045"}]': finished 2024-05-08T06:39:21.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:20 smithi070 ceph-mon[29591]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T06:39:21.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:20 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:21 smithi172 ceph-mon[33377]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-08T06:39:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:21 smithi172 ceph-mon[33377]: from='client.? 172.21.15.194:0/442789377' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:39:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:21 smithi194 ceph-mon[33679]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-08T06:39:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:21 smithi194 ceph-mon[33679]: from='client.? 172.21.15.194:0/442789377' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:39:22.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:21 smithi070 ceph-mon[29591]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-08T06:39:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:21 smithi070 ceph-mon[29591]: from='client.? 172.21.15.194:0/442789377' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T06:39:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:23 smithi194 ceph-mon[33679]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:39:23.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:23 smithi172 ceph-mon[33377]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:39:24.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:23 smithi070 ceph-mon[29591]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T06:39:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:25 smithi172 ceph-mon[33377]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:25.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:25 smithi070 ceph-mon[29591]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:25 smithi194 ceph-mon[33679]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:27.743 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:27 smithi194 ceph-mon[33679]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:27 smithi172 ceph-mon[33377]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:28.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:27 smithi070 ceph-mon[29591]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:29 smithi194 ceph-mon[33679]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T06:39:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:29 smithi172 ceph-mon[33377]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T06:39:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:30.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:29 smithi070 ceph-mon[29591]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:30.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T06:39:30.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:31.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:30 smithi194 ceph-mon[33679]: Deploying daemon osd.11 on smithi194 2024-05-08T06:39:31.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:30 smithi070 ceph-mon[29591]: Deploying daemon osd.11 on smithi194 2024-05-08T06:39:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:30 smithi172 ceph-mon[33377]: Deploying daemon osd.11 on smithi194 2024-05-08T06:39:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:31 smithi194 ceph-mon[33679]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:32.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:31 smithi070 ceph-mon[29591]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:31 smithi172 ceph-mon[33377]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:33.982 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:33 smithi172 ceph-mon[33377]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:33 smithi194 ceph-mon[33679]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:33 smithi070 ceph-mon[29591]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:36.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:35 smithi194 ceph-mon[33679]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:36.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:35 smithi070 ceph-mon[29591]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:35 smithi172 ceph-mon[33377]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:38.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:37 smithi194 ceph-mon[33679]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:38.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:37 smithi070 ceph-mon[29591]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:37 smithi172 ceph-mon[33377]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:39 smithi194 ceph-mon[33679]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:39 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:39 smithi070 ceph-mon[29591]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:39.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:39 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:39 smithi172 ceph-mon[33377]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:39 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:41.319 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:41 smithi194 ceph-mon[33679]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:41 smithi070 ceph-mon[29591]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:41 smithi172 ceph-mon[33377]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:43.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.260+0000 7fbbde000700 1 -- 172.21.15.194:0/589648196 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fbbe00639a0 con 0x7fbbc80b2900 2024-05-08T06:39:43.260 INFO:teuthology.orchestra.run.smithi194.stdout:Created osd(s) 11 on host 'smithi194' 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbc80b2900 msgr2=0x7fbbc80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbc80b2900 0x7fbbc80b4dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0005950 tx=0x7fbbd00058e0 comp rx=0 tx=0).stop 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe0105740 msgr2=0x7fbbe019b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe0105740 0x7fbbe019b750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400d9b0 tx=0x7fbbd400dd70 comp rx=0 tx=0).stop 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 shutdown_connections 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe01072e0 0x7fbbe01a2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe0105740 0x7fbbe019b750 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbc80b2900 0x7fbbc80b4dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 --2- 172.21.15.194:0/589648196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe0106940 0x7fbbe019bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:43.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 >> 172.21.15.194:0/589648196 conn(0x7fbbe0100d00 msgr2=0x7fbbe0109cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:43.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 shutdown_connections 2024-05-08T06:39:43.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:43.265+0000 7fbbe8000700 1 -- 172.21.15.194:0/589648196 wait complete. 2024-05-08T06:39:43.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:43 smithi172 ceph-mon[33377]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:43.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:43.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:43.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:43.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:43.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:43.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:43 smithi172 ceph-mon[33377]: from='osd.11 [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T06:39:43.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:43 smithi172 ceph-mon[33377]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T06:39:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:43 smithi194 ceph-mon[33679]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:43 smithi194 ceph-mon[33679]: from='osd.11 [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T06:39:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:43 smithi194 ceph-mon[33679]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T06:39:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:43 smithi070 ceph-mon[29591]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:43 smithi070 ceph-mon[29591]: from='osd.11 [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T06:39:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:43 smithi070 ceph-mon[29591]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T06:39:44.071 DEBUG:teuthology.orchestra.run.smithi194:osd.11> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.11.service 2024-05-08T06:39:44.077 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-08T06:39:44.077 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-08T06:39:44.349 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 06:39:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T06:39:44.223+0000 7fbc83000700 -1 osd.11 0 waiting for initial osdmap 2024-05-08T06:39:44.349 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 06:39:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T06:39:44.240+0000 7fbc7de00700 -1 osd.11 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T06:39:44.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:44 smithi194 ceph-mon[33679]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T06:39:44.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:44 smithi194 ceph-mon[33679]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T06:39:44.349 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:44 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:44.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:44 smithi194 ceph-mon[33679]: from='osd.11 [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:39:44.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:44 smithi194 ceph-mon[33679]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:39:44.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:44 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:44.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:44 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:44.350 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:44 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:44.516 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:39:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:44 smithi070 ceph-mon[29591]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T06:39:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:44 smithi070 ceph-mon[29591]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T06:39:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:44 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:44 smithi070 ceph-mon[29591]: from='osd.11 [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:39:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:44 smithi070 ceph-mon[29591]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:39:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:44 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:44 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:44.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:44 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:44 smithi172 ceph-mon[33377]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T06:39:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:44 smithi172 ceph-mon[33377]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T06:39:44.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:44 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:44.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:44 smithi172 ceph-mon[33377]: from='osd.11 [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:39:44.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:44 smithi172 ceph-mon[33377]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]: dispatch 2024-05-08T06:39:44.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:44 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:44.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:44 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:44.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:44 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:45 smithi070 ceph-mon[29591]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:45 smithi070 ceph-mon[29591]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:39:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:45 smithi070 ceph-mon[29591]: osdmap e72: 12 total, 11 up, 12 in 2024-05-08T06:39:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:45 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:45.414 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:45 smithi194 ceph-mon[33679]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:45.414 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:45 smithi194 ceph-mon[33679]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:39:45.414 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:45 smithi194 ceph-mon[33679]: osdmap e72: 12 total, 11 up, 12 in 2024-05-08T06:39:45.414 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:45 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:45.414 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:45 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:45 smithi172 ceph-mon[33377]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:45 smithi172 ceph-mon[33377]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi194", "root=default"]}]': finished 2024-05-08T06:39:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:45 smithi172 ceph-mon[33377]: osdmap e72: 12 total, 11 up, 12 in 2024-05-08T06:39:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:45 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:45 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:46 smithi172 ceph-mon[33377]: purged_snaps scrub starts 2024-05-08T06:39:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:46 smithi172 ceph-mon[33377]: purged_snaps scrub ok 2024-05-08T06:39:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:46 smithi172 ceph-mon[33377]: osd.11 [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] boot 2024-05-08T06:39:46.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:46 smithi172 ceph-mon[33377]: osdmap e73: 12 total, 12 up, 12 in 2024-05-08T06:39:46.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:46 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:46.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:46 smithi194 ceph-mon[33679]: purged_snaps scrub starts 2024-05-08T06:39:46.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:46 smithi194 ceph-mon[33679]: purged_snaps scrub ok 2024-05-08T06:39:46.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:46.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:46 smithi194 ceph-mon[33679]: osd.11 [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] boot 2024-05-08T06:39:46.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:46 smithi194 ceph-mon[33679]: osdmap e73: 12 total, 12 up, 12 in 2024-05-08T06:39:46.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:46 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:46.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:46 smithi070 ceph-mon[29591]: purged_snaps scrub starts 2024-05-08T06:39:46.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:46 smithi070 ceph-mon[29591]: purged_snaps scrub ok 2024-05-08T06:39:46.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:46.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:46 smithi070 ceph-mon[29591]: osd.11 [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] boot 2024-05-08T06:39:46.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:46 smithi070 ceph-mon[29591]: osdmap e73: 12 total, 12 up, 12 in 2024-05-08T06:39:46.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:46 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:39:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.888+0000 7f7cd8a00700 1 -- 172.21.15.70:0/1843409816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd4077450 msgr2=0x7f7cd40758b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.888+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/1843409816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd4077450 0x7f7cd40758b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7cc4009990 tx=0x7f7cc4009ca0 comp rx=0 tx=0).stop 2024-05-08T06:39:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.888+0000 7f7cd8a00700 1 -- 172.21.15.70:0/1843409816 shutdown_connections 2024-05-08T06:39:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.888+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/1843409816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cd410b400 0x7f7cd410d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.888+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/1843409816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd4077450 0x7f7cd40758b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:46.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.888+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/1843409816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd4075e80 0x7f7cd4076300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.888+0000 7f7cd8a00700 1 -- 172.21.15.70:0/1843409816 >> 172.21.15.70:0/1843409816 conn(0x7f7cd40feaa0 msgr2=0x7f7cd4100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.888+0000 7f7cd8a00700 1 -- 172.21.15.70:0/1843409816 shutdown_connections 2024-05-08T06:39:46.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.889+0000 7f7cd8a00700 1 -- 172.21.15.70:0/1843409816 wait complete. 2024-05-08T06:39:46.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.889+0000 7f7cd8a00700 1 Processor -- start 2024-05-08T06:39:46.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd8a00700 1 -- start start 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd8a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cd4075e80 0x7f7cd419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd8a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd4077450 0x7f7cd419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd410b400 0x7f7cd41a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd8a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd4111000 con 0x7f7cd410b400 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd8a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd4110e80 con 0x7f7cd4075e80 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd8a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd4111180 con 0x7f7cd4077450 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd410b400 0x7f7cd41a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd410b400 0x7f7cd41a2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48282/0 (socket says 172.21.15.70:48282) 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.890+0000 7f7cd2800700 1 -- 172.21.15.70:0/2530037044 learned_addr learned my addr 172.21.15.70:0/2530037044 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:39:46.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.891+0000 7f7cd1e00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cd4075e80 0x7f7cd419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.891+0000 7f7cd1400700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd4077450 0x7f7cd419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.891+0000 7f7cd2800700 1 -- 172.21.15.70:0/2530037044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd4077450 msgr2=0x7f7cd419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.891+0000 7f7cd2800700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd4077450 0x7f7cd419bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.891+0000 7f7cd2800700 1 -- 172.21.15.70:0/2530037044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cd4075e80 msgr2=0x7f7cd419b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.891+0000 7f7cd2800700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cd4075e80 0x7f7cd419b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.891+0000 7f7cd2800700 1 -- 172.21.15.70:0/2530037044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd41a33f0 con 0x7f7cd410b400 2024-05-08T06:39:46.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.891+0000 7f7cd2800700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd410b400 0x7f7cd41a2d50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc007f10 tx=0x7f7ccc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:46.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.892+0000 7f7ccaa00700 1 -- 172.21.15.70:0/2530037044 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc004bb0 con 0x7f7cd410b400 2024-05-08T06:39:46.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.892+0000 7f7ccaa00700 1 -- 172.21.15.70:0/2530037044 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ccc004d50 con 0x7f7cd410b400 2024-05-08T06:39:46.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.892+0000 7f7ccaa00700 1 -- 172.21.15.70:0/2530037044 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc005970 con 0x7f7cd410b400 2024-05-08T06:39:46.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.892+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd41a36e0 con 0x7f7cd410b400 2024-05-08T06:39:46.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.892+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd41a3bd0 con 0x7f7cd410b400 2024-05-08T06:39:46.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.893+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd406a190 con 0x7f7cd410b400 2024-05-08T06:39:46.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.895+0000 7f7ccaa00700 1 -- 172.21.15.70:0/2530037044 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7ccc01a020 con 0x7f7cd410b400 2024-05-08T06:39:46.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.897+0000 7f7ccaa00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7cb80b2900 0x7f7cb80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:46.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.897+0000 7f7ccaa00700 1 -- 172.21.15.70:0/2530037044 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f7ccc0e14d0 con 0x7f7cd410b400 2024-05-08T06:39:46.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.897+0000 7f7cd1e00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7cb80b2900 0x7f7cb80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:46.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.898+0000 7f7cd1e00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7cb80b2900 0x7f7cb80b4dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400b5c0 tx=0x7f7cc40037c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:46.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:46.901+0000 7f7ccaa00700 1 -- 172.21.15.70:0/2530037044 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7ccc010070 con 0x7f7cd410b400 2024-05-08T06:39:47.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.138+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7cd40640b0 con 0x7f7cd410b400 2024-05-08T06:39:47.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.139+0000 7f7ccaa00700 1 -- 172.21.15.70:0/2530037044 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f7ccc0a95f0 con 0x7f7cd410b400 2024-05-08T06:39:47.137 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:39:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7cb80b2900 msgr2=0x7f7cb80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7cb80b2900 0x7f7cb80b4dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7cc400b5c0 tx=0x7f7cc40037c0 comp rx=0 tx=0).stop 2024-05-08T06:39:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd410b400 msgr2=0x7f7cd41a2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd410b400 0x7f7cd41a2d50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc007f10 tx=0x7f7ccc00d3b0 comp rx=0 tx=0).stop 2024-05-08T06:39:47.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 shutdown_connections 2024-05-08T06:39:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7cb80b2900 0x7f7cb80b4dc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7cd410b400 0x7f7cd41a2d50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7cd4075e80 0x7f7cd419b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 --2- 172.21.15.70:0/2530037044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cd4077450 0x7f7cd419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 >> 172.21.15.70:0/2530037044 conn(0x7f7cd40feaa0 msgr2=0x7f7cd4107350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 shutdown_connections 2024-05-08T06:39:47.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:47.142+0000 7f7cd8a00700 1 -- 172.21.15.70:0/2530037044 wait complete. 2024-05-08T06:39:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:47 smithi194 ceph-mon[33679]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:47 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2530037044' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T06:39:47.524 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:47 smithi070 ceph-mon[29591]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:47.525 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:47 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2530037044' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T06:39:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:47 smithi172 ceph-mon[33377]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-05-08T06:39:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:47 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2530037044' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T06:39:48.052 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1715150385,"num_in_osds":12,"osd_in_since":1715150359,"num_remapped_pgs":0} 2024-05-08T06:39:48.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:39:48.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:48 smithi070 ceph-mon[29591]: osdmap e74: 12 total, 12 up, 12 in 2024-05-08T06:39:48.474 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:39:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:48 smithi194 ceph-mon[33679]: osdmap e74: 12 total, 12 up, 12 in 2024-05-08T06:39:48.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:48 smithi172 ceph-mon[33377]: osdmap e74: 12 total, 12 up, 12 in 2024-05-08T06:39:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: Detected new or changed devices on smithi194 2024-05-08T06:39:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:49.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:49.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:49.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:49.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:49.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 4272M 2024-05-08T06:39:49.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:49.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:49.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:49.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:49 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: Detected new or changed devices on smithi194 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 4272M 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:49 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: Detected new or changed devices on smithi194 2024-05-08T06:39:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:39:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 4272M 2024-05-08T06:39:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:49 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.939+0000 7f118a400700 1 -- 172.21.15.70:0/3820982958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184108850 msgr2=0x7f11841103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.939+0000 7f118a400700 1 --2- 172.21.15.70:0/3820982958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184108850 0x7f11841103d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f117c00b0d0 tx=0x7f117c00b3e0 comp rx=0 tx=0).stop 2024-05-08T06:39:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.939+0000 7f118a400700 1 -- 172.21.15.70:0/3820982958 shutdown_connections 2024-05-08T06:39:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.940+0000 7f118a400700 1 --2- 172.21.15.70:0/3820982958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184108850 0x7f11841103d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.940+0000 7f118a400700 1 --2- 172.21.15.70:0/3820982958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1184103750 0x7f1184103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.940+0000 7f118a400700 1 --2- 172.21.15.70:0/3820982958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1184104100 0x7f1184108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.940+0000 7f118a400700 1 -- 172.21.15.70:0/3820982958 >> 172.21.15.70:0/3820982958 conn(0x7f118407a600 msgr2=0x7f118407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.940+0000 7f118a400700 1 -- 172.21.15.70:0/3820982958 shutdown_connections 2024-05-08T06:39:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.940+0000 7f118a400700 1 -- 172.21.15.70:0/3820982958 wait complete. 2024-05-08T06:39:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.941+0000 7f118a400700 1 Processor -- start 2024-05-08T06:39:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.941+0000 7f118a400700 1 -- start start 2024-05-08T06:39:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.941+0000 7f118a400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184103750 0x7f11840757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.941+0000 7f118a400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1184104100 0x7f1184075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.941+0000 7f118a400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1184108850 0x7f1184076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.941+0000 7f118a400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1184113520 con 0x7f1184103750 2024-05-08T06:39:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.941+0000 7f118a400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f11841133a0 con 0x7f1184108850 2024-05-08T06:39:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.941+0000 7f118a400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f11841136a0 con 0x7f1184104100 2024-05-08T06:39:50.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f1183400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184103750 0x7f11840757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f1183400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184103750 0x7f11840757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46646/0 (socket says 172.21.15.70:46646) 2024-05-08T06:39:50.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f1183400700 1 -- 172.21.15.70:0/1652837786 learned_addr learned my addr 172.21.15.70:0/1652837786 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f1183e00700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1184108850 0x7f1184076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f117aa00700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1184104100 0x7f1184075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f1183400700 1 -- 172.21.15.70:0/1652837786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1184104100 msgr2=0x7f1184075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f1183400700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1184104100 0x7f1184075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f1183400700 1 -- 172.21.15.70:0/1652837786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1184108850 msgr2=0x7f1184076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f1183400700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1184108850 0x7f1184076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.942+0000 7f1183400700 1 -- 172.21.15.70:0/1652837786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11841a7e70 con 0x7f1184103750 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.943+0000 7f1183400700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184103750 0x7f11840757a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f117400d950 tx=0x7f117400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.943+0000 7f1180c00700 1 -- 172.21.15.70:0/1652837786 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1174016070 con 0x7f1184103750 2024-05-08T06:39:50.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.943+0000 7f1180c00700 1 -- 172.21.15.70:0/1652837786 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1174010460 con 0x7f1184103750 2024-05-08T06:39:50.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.943+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11841a8160 con 0x7f1184103750 2024-05-08T06:39:50.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.943+0000 7f1180c00700 1 -- 172.21.15.70:0/1652837786 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117400f620 con 0x7f1184103750 2024-05-08T06:39:50.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.943+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11841a86f0 con 0x7f1184103750 2024-05-08T06:39:50.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.944+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118406a190 con 0x7f1184103750 2024-05-08T06:39:50.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.948+0000 7f1180c00700 1 -- 172.21.15.70:0/1652837786 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1174019070 con 0x7f1184103750 2024-05-08T06:39:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.950+0000 7f1180c00700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f11680b2900 0x7f11680b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.950+0000 7f1180c00700 1 -- 172.21.15.70:0/1652837786 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f11740e19d0 con 0x7f1184103750 2024-05-08T06:39:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.950+0000 7f117aa00700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f11680b2900 0x7f11680b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.951+0000 7f117aa00700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f11680b2900 0x7f11680b4dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f116c005fd0 tx=0x7f116c00af20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:50.952+0000 7f1180c00700 1 -- 172.21.15.70:0/1652837786 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f11740a9af0 con 0x7f1184103750 2024-05-08T06:39:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.192+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f118402e6d0 con 0x7f1184103750 2024-05-08T06:39:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.194+0000 7f1180c00700 1 -- 172.21.15.70:0/1652837786 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+18433 (secure 0 0 0) 0x7f11740a93f0 con 0x7f1184103750 2024-05-08T06:39:51.194 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:39:51.195 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":74,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:39:47.230817+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:39:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f11680b2900 msgr2=0x7f11680b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f11680b2900 0x7f11680b4dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f116c005fd0 tx=0x7f116c00af20 comp rx=0 tx=0).stop 2024-05-08T06:39:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184103750 msgr2=0x7f11840757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184103750 0x7f11840757a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f117400d950 tx=0x7f117400dd10 comp rx=0 tx=0).stop 2024-05-08T06:39:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 shutdown_connections 2024-05-08T06:39:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1184108850 0x7f1184076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f11680b2900 0x7f11680b4dc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1184103750 0x7f11840757a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 --2- 172.21.15.70:0/1652837786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1184104100 0x7f1184075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.197+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 >> 172.21.15.70:0/1652837786 conn(0x7f118407a600 msgr2=0x7f1184101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.198+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 shutdown_connections 2024-05-08T06:39:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:51.198+0000 7f118a400700 1 -- 172.21.15.70:0/1652837786 wait complete. 2024-05-08T06:39:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:51 smithi070 ceph-mon[29591]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:51 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1652837786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:39:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:51 smithi172 ceph-mon[33377]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:51 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1652837786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:39:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:51 smithi194 ceph-mon[33679]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:51 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1652837786' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:39:52.150 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T06:34:30.088563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T06:39:52.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-08T06:39:52.578 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:39:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:53 smithi172 ceph-mon[33377]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:54.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:53 smithi194 ceph-mon[33679]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:54.040 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:53 smithi070 ceph-mon[29591]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:54.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.904+0000 7ff11ee00700 1 -- 172.21.15.70:0/4261819466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff118105f90 msgr2=0x7ff1181124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:54.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.904+0000 7ff11ee00700 1 --2- 172.21.15.70:0/4261819466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff118105f90 0x7ff1181124a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff110009990 tx=0x7ff110009ca0 comp rx=0 tx=0).stop 2024-05-08T06:39:54.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.904+0000 7ff11ee00700 1 -- 172.21.15.70:0/4261819466 shutdown_connections 2024-05-08T06:39:54.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.904+0000 7ff11ee00700 1 --2- 172.21.15.70:0/4261819466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff118105f90 0x7ff1181124a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:54.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.904+0000 7ff11ee00700 1 --2- 172.21.15.70:0/4261819466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11810b660 0x7ff11810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:54.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.904+0000 7ff11ee00700 1 --2- 172.21.15.70:0/4261819466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1181055d0 0x7ff118105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:54.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.904+0000 7ff11ee00700 1 -- 172.21.15.70:0/4261819466 >> 172.21.15.70:0/4261819466 conn(0x7ff1181010c0 msgr2=0x7ff1181034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:54.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.904+0000 7ff11ee00700 1 -- 172.21.15.70:0/4261819466 shutdown_connections 2024-05-08T06:39:54.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.904+0000 7ff11ee00700 1 -- 172.21.15.70:0/4261819466 wait complete. 2024-05-08T06:39:54.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.906+0000 7ff11ee00700 1 Processor -- start 2024-05-08T06:39:54.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.906+0000 7ff11ee00700 1 -- start start 2024-05-08T06:39:54.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.906+0000 7ff11ee00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1181055d0 0x7ff1181a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:54.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.906+0000 7ff11ee00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff118105f90 0x7ff1181a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:54.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.906+0000 7ff11ee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11810b660 0x7ff11819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:54.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.906+0000 7ff11ee00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1181156b0 con 0x7ff1181055d0 2024-05-08T06:39:54.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.906+0000 7ff11ee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff118115530 con 0x7ff11810b660 2024-05-08T06:39:54.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.906+0000 7ff11ee00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff118115830 con 0x7ff118105f90 2024-05-08T06:39:54.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1181055d0 0x7ff1181a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:54.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1181055d0 0x7ff1181a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46666/0 (socket says 172.21.15.70:46666) 2024-05-08T06:39:54.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11da00700 1 -- 172.21.15.70:0/3027768604 learned_addr learned my addr 172.21.15.70:0/3027768604 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11e400700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11810b660 0x7ff11819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11d000700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff118105f90 0x7ff1181a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11da00700 1 -- 172.21.15.70:0/3027768604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff118105f90 msgr2=0x7ff1181a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11da00700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff118105f90 0x7ff1181a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11da00700 1 -- 172.21.15.70:0/3027768604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11810b660 msgr2=0x7ff11819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11da00700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11810b660 0x7ff11819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11da00700 1 -- 172.21.15.70:0/3027768604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11819c070 con 0x7ff1181055d0 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.907+0000 7ff11da00700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1181055d0 0x7ff1181a1700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff10c007f10 tx=0x7ff10c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.908+0000 7ff116000700 1 -- 172.21.15.70:0/3027768604 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c00dc90 con 0x7ff1181055d0 2024-05-08T06:39:54.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.908+0000 7ff116000700 1 -- 172.21.15.70:0/3027768604 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff10c00de30 con 0x7ff1181055d0 2024-05-08T06:39:54.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.908+0000 7ff116000700 1 -- 172.21.15.70:0/3027768604 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff10c0133f0 con 0x7ff1181055d0 2024-05-08T06:39:54.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.908+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11819c360 con 0x7ff1181055d0 2024-05-08T06:39:54.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.908+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1181a85d0 con 0x7ff1181055d0 2024-05-08T06:39:54.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.909+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11806a190 con 0x7ff1181055d0 2024-05-08T06:39:54.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.911+0000 7ff116000700 1 -- 172.21.15.70:0/3027768604 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff10c01a020 con 0x7ff1181055d0 2024-05-08T06:39:54.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.913+0000 7ff116000700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff1000b2900 0x7ff1000b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:54.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.913+0000 7ff116000700 1 -- 172.21.15.70:0/3027768604 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7ff10c0e14f0 con 0x7ff1181055d0 2024-05-08T06:39:54.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.913+0000 7ff11d000700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff1000b2900 0x7ff1000b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:54.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.914+0000 7ff11d000700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff1000b2900 0x7ff1000b4dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff104005950 tx=0x7ff1040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:54.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:54.917+0000 7ff116000700 1 -- 172.21.15.70:0/3027768604 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff10c010070 con 0x7ff1181055d0 2024-05-08T06:39:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.154+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff11802e6d0 con 0x7ff1181055d0 2024-05-08T06:39:55.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.154+0000 7ff116000700 1 -- 172.21.15.70:0/3027768604 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7ff10c0a9610 con 0x7ff1181055d0 2024-05-08T06:39:55.154 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-05-08T06:39:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.157+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff1000b2900 msgr2=0x7ff1000b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.157+0000 7ff11ee00700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff1000b2900 0x7ff1000b4dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff104005950 tx=0x7ff1040058e0 comp rx=0 tx=0).stop 2024-05-08T06:39:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.157+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1181055d0 msgr2=0x7ff1181a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.157+0000 7ff11ee00700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1181055d0 0x7ff1181a1700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff10c007f10 tx=0x7ff10c00d3b0 comp rx=0 tx=0).stop 2024-05-08T06:39:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.158+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 shutdown_connections 2024-05-08T06:39:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.158+0000 7ff11ee00700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff11810b660 0x7ff11819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.158+0000 7ff11ee00700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff1000b2900 0x7ff1000b4dc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.158+0000 7ff11ee00700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff1181055d0 0x7ff1181a1700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.158+0000 7ff11ee00700 1 --2- 172.21.15.70:0/3027768604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff118105f90 0x7ff1181a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.158+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 >> 172.21.15.70:0/3027768604 conn(0x7ff1181010c0 msgr2=0x7ff1181027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.158+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 shutdown_connections 2024-05-08T06:39:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:39:55.158+0000 7ff11ee00700 1 -- 172.21.15.70:0/3027768604 wait complete. 2024-05-08T06:39:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:55 smithi070 ceph-mon[29591]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:55 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3027768604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T06:39:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:55 smithi172 ceph-mon[33377]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:55 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3027768604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T06:39:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:55 smithi194 ceph-mon[33679]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:55 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3027768604' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T06:39:56.118 INFO:tasks.cephadm:Adding mds.a on smithi070 2024-05-08T06:39:56.118 INFO:tasks.cephadm:Adding mds.d on smithi070 2024-05-08T06:39:56.118 INFO:tasks.cephadm:Adding mds.g on smithi070 2024-05-08T06:39:56.118 INFO:tasks.cephadm:Adding mds.j on smithi070 2024-05-08T06:39:56.118 INFO:tasks.cephadm:Adding mds.b on smithi172 2024-05-08T06:39:56.118 INFO:tasks.cephadm:Adding mds.e on smithi172 2024-05-08T06:39:56.119 INFO:tasks.cephadm:Adding mds.h on smithi172 2024-05-08T06:39:56.119 INFO:tasks.cephadm:Adding mds.k on smithi172 2024-05-08T06:39:56.119 INFO:tasks.cephadm:Adding mds.c on smithi194 2024-05-08T06:39:56.119 INFO:tasks.cephadm:Adding mds.f on smithi194 2024-05-08T06:39:56.119 INFO:tasks.cephadm:Adding mds.i on smithi194 2024-05-08T06:39:56.119 INFO:tasks.cephadm:Adding mds.l on smithi194 2024-05-08T06:39:56.119 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l' 2024-05-08T06:39:56.573 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:39:57.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:57 smithi194 ceph-mon[33679]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:57 smithi070 ceph-mon[29591]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:57 smithi172 ceph-mon[33377]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:58.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.652+0000 7f3b33600700 1 -- 172.21.15.194:0/2476604285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 msgr2=0x7f3b2c111f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:58.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.652+0000 7f3b33600700 1 --2- 172.21.15.194:0/2476604285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 0x7f3b2c111f90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400b0a0 tx=0x7f3b2400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.652+0000 7f3b33600700 1 -- 172.21.15.194:0/2476604285 shutdown_connections 2024-05-08T06:39:58.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.652+0000 7f3b33600700 1 --2- 172.21.15.194:0/2476604285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 0x7f3b2c111f90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.652+0000 7f3b33600700 1 --2- 172.21.15.194:0/2476604285 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2c109b40 0x7f3b2c109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.652+0000 7f3b33600700 1 --2- 172.21.15.194:0/2476604285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2c10ad40 0x7f3b2c10b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.652+0000 7f3b33600700 1 -- 172.21.15.194:0/2476604285 >> 172.21.15.194:0/2476604285 conn(0x7f3b2c078b10 msgr2=0x7f3b2c07af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:58.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.652+0000 7f3b33600700 1 -- 172.21.15.194:0/2476604285 shutdown_connections 2024-05-08T06:39:58.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.652+0000 7f3b33600700 1 -- 172.21.15.194:0/2476604285 wait complete. 2024-05-08T06:39:58.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.653+0000 7f3b33600700 1 Processor -- start 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.653+0000 7f3b33600700 1 -- start start 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b33600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2c109b40 0x7f3b2c19fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b33600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2c10ad40 0x7f3b2c19ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b33600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 0x7f3b2c1a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b33600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c115490 con 0x7f3b2c10ad40 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b33600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c115310 con 0x7f3b2c109b40 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b33600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2c115610 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b31600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 0x7f3b2c1a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b31600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 0x7f3b2c1a7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:52148/0 (socket says 172.21.15.194:52148) 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b31600700 1 -- 172.21.15.194:0/2043377205 learned_addr learned my addr 172.21.15.194:0/2043377205 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b30c00700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2c109b40 0x7f3b2c19fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:58.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.654+0000 7f3b2be00700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2c10ad40 0x7f3b2c19ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:58.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b31600700 1 -- 172.21.15.194:0/2043377205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2c109b40 msgr2=0x7f3b2c19fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:58.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b31600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2c109b40 0x7f3b2c19fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b31600700 1 -- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2c10ad40 msgr2=0x7f3b2c19ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:58.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b31600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2c10ad40 0x7f3b2c19ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b31600700 1 -- 172.21.15.194:0/2043377205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2c1a76d0 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b30c00700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2c109b40 0x7f3b2c19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:39:58.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b31600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 0x7f3b2c1a7030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b24007d10 tx=0x7f3b24007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:58.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b29600700 1 -- 172.21.15.194:0/2043377205 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24003e10 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b29600700 1 -- 172.21.15.194:0/2043377205 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b24005500 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2c1a7960 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b29600700 1 -- 172.21.15.194:0/2043377205 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2401ba90 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.655+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b2c1a7db0 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.657+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2c06a190 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.661+0000 7f3b29600700 1 -- 172.21.15.194:0/2043377205 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3b24005020 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.662+0000 7f3b29600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3b140b2880 0x7f3b140b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:39:58.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.662+0000 7f3b29600700 1 -- 172.21.15.194:0/2043377205 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f3b2400f020 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.663+0000 7f3b30c00700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3b140b2880 0x7f3b140b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:39:58.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.664+0000 7f3b30c00700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3b140b2880 0x7f3b140b4d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b20005fd0 tx=0x7f3b20005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:39:58.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.665+0000 7f3b29600700 1 -- 172.21.15.194:0/2043377205 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3b240ab910 con 0x7f3b2c10b6e0 2024-05-08T06:39:58.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.906+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}) -- 0x7f3b2c063ba0 con 0x7f3b140b2880 2024-05-08T06:39:58.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.924+0000 7f3b29600700 1 -- 172.21.15.194:0/2043377205 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3b2c063ba0 con 0x7f3b140b2880 2024-05-08T06:39:58.925 INFO:teuthology.orchestra.run.smithi194.stdout:Scheduled mds.all update... 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3b140b2880 msgr2=0x7f3b140b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3b140b2880 0x7f3b140b4d40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3b20005fd0 tx=0x7f3b20005de0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 msgr2=0x7f3b2c1a7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 0x7f3b2c1a7030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b24007d10 tx=0x7f3b24007df0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 shutdown_connections 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2c10b6e0 0x7f3b2c1a7030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2c109b40 0x7f3b2c19fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3b140b2880 0x7f3b140b4d40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 --2- 172.21.15.194:0/2043377205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2c10ad40 0x7f3b2c19ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.927+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 >> 172.21.15.194:0/2043377205 conn(0x7f3b2c078b10 msgr2=0x7f3b2c10e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.928+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 shutdown_connections 2024-05-08T06:39:58.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-05-08T06:39:58.928+0000 7f3b33600700 1 -- 172.21.15.194:0/2043377205 wait complete. 2024-05-08T06:39:59.742 DEBUG:teuthology.orchestra.run.smithi070:mds.a> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.a.service 2024-05-08T06:39:59.751 DEBUG:teuthology.orchestra.run.smithi070:mds.d> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.d.service 2024-05-08T06:39:59.797 DEBUG:teuthology.orchestra.run.smithi070:mds.g> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.g.service 2024-05-08T06:39:59.843 DEBUG:teuthology.orchestra.run.smithi070:mds.j> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.j.service 2024-05-08T06:39:59.888 DEBUG:teuthology.orchestra.run.smithi172:mds.b> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.b.service 2024-05-08T06:39:59.896 DEBUG:teuthology.orchestra.run.smithi172:mds.e> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.e.service 2024-05-08T06:39:59.943 DEBUG:teuthology.orchestra.run.smithi172:mds.h> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.h.service 2024-05-08T06:39:59.943 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:59.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:39:59.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:59.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:59.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:59.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:59.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:59.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:39:59.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:39:59.944 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:39:59 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:39:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:39:59.966 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:39:59.967 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:39:59 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:59.969 DEBUG:teuthology.orchestra.run.smithi172:mds.k> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.k.service 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:39:59.986 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:39:59 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:00.015 DEBUG:teuthology.orchestra.run.smithi194:mds.c> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.c.service 2024-05-08T06:40:00.023 DEBUG:teuthology.orchestra.run.smithi194:mds.f> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.f.service 2024-05-08T06:40:00.068 DEBUG:teuthology.orchestra.run.smithi194:mds.i> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.i.service 2024-05-08T06:40:00.112 DEBUG:teuthology.orchestra.run.smithi194:mds.l> sudo journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.l.service 2024-05-08T06:40:00.158 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-08T06:40:00.158 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:40:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:00.956 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:00 smithi070 ceph-mon[29591]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-05-08T06:40:00.956 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:00 smithi070 ceph-mon[29591]: Deploying daemon mds.l on smithi194 2024-05-08T06:40:00.957 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T06:40:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:00 smithi194 ceph-mon[33679]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-05-08T06:40:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:00 smithi194 ceph-mon[33679]: Deploying daemon mds.l on smithi194 2024-05-08T06:40:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T06:40:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:00 smithi172 ceph-mon[33377]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-05-08T06:40:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:00 smithi172 ceph-mon[33377]: Deploying daemon mds.l on smithi194 2024-05-08T06:40:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T06:40:02.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:01 smithi194 ceph-mon[33679]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:02.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:01 smithi070 ceph-mon[29591]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:02.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:01 smithi172 ceph-mon[33377]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:02.386 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 06:40:02 smithi194 systemd[1]: Starting Ceph mds.l for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:40:02.693 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 06:40:02 smithi194 podman[64072]: 2024-05-08 06:40:02.293347621 +0000 UTC m=+0.034977937 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:40:02.694 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 06:40:02 smithi194 podman[64072]: 2024-05-08 06:40:02.41544272 +0000 UTC m=+0.157073063 container create d20071ef51b7d8e5051685853d9c2f8f068a2d68d33667a2f7e0c47d532063da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:40:02.694 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 06:40:02 smithi194 podman[64072]: 2024-05-08 06:40:02.694170005 +0000 UTC m=+0.435800355 container init d20071ef51b7d8e5051685853d9c2f8f068a2d68d33667a2f7e0c47d532063da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:40:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.876+0000 7f72a5e00700 1 -- 172.21.15.70:0/3439100052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a010fac0 msgr2=0x7f72a010fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.876+0000 7f72a5e00700 1 --2- 172.21.15.70:0/3439100052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a010fac0 0x7f72a010fea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7290009990 tx=0x7f7290009ca0 comp rx=0 tx=0).stop 2024-05-08T06:40:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.876+0000 7f72a5e00700 1 -- 172.21.15.70:0/3439100052 shutdown_connections 2024-05-08T06:40:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.876+0000 7f72a5e00700 1 --2- 172.21.15.70:0/3439100052 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a010a4d0 0x7f72a0116990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.876+0000 7f72a5e00700 1 --2- 172.21.15.70:0/3439100052 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a010fac0 0x7f72a010fea0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.876+0000 7f72a5e00700 1 --2- 172.21.15.70:0/3439100052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72a0109b10 0x7f72a0109f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.876+0000 7f72a5e00700 1 -- 172.21.15.70:0/3439100052 >> 172.21.15.70:0/3439100052 conn(0x7f72a0076c70 msgr2=0x7f72a0079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.876+0000 7f72a5e00700 1 -- 172.21.15.70:0/3439100052 shutdown_connections 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.876+0000 7f72a5e00700 1 -- 172.21.15.70:0/3439100052 wait complete. 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.877+0000 7f72a5e00700 1 Processor -- start 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f72a5e00700 1 -- start start 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f72a5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a0109b10 0x7f72a01a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f72a5e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72a010a4d0 0x7f72a01a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f72a5e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a010fac0 0x7f72a01a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f72a5e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0119bc0 con 0x7f72a0109b10 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f72a5e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0119a40 con 0x7f72a010fac0 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f72a5e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f72a0119d40 con 0x7f72a010a4d0 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f729ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a0109b10 0x7f72a01a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f729ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a0109b10 0x7f72a01a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37060/0 (socket says 172.21.15.70:37060) 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f729ea00700 1 -- 172.21.15.70:0/684582559 learned_addr learned my addr 172.21.15.70:0/684582559 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.878+0000 7f729e000700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72a010a4d0 0x7f72a01a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f729f400700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a010fac0 0x7f72a01a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f729ea00700 1 -- 172.21.15.70:0/684582559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72a010a4d0 msgr2=0x7f72a01a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f729ea00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72a010a4d0 0x7f72a01a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f729ea00700 1 -- 172.21.15.70:0/684582559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a010fac0 msgr2=0x7f72a01a4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f729ea00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a010fac0 0x7f72a01a4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f729ea00700 1 -- 172.21.15.70:0/684582559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a01a5140 con 0x7f72a0109b10 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f729ea00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a0109b10 0x7f72a01a0130 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7290000c00 tx=0x7f7290005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f72a4a00700 1 -- 172.21.15.70:0/684582559 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290027070 con 0x7f72a0109b10 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f72a4a00700 1 -- 172.21.15.70:0/684582559 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f729000fb80 con 0x7f72a0109b10 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f72a4a00700 1 -- 172.21.15.70:0/684582559 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7290022c30 con 0x7f72a0109b10 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.879+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a01a53d0 con 0x7f72a0109b10 2024-05-08T06:40:02.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.880+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a01accb0 con 0x7f72a0109b10 2024-05-08T06:40:02.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.881+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72a006a190 con 0x7f72a0109b10 2024-05-08T06:40:02.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.883+0000 7f72a4a00700 1 -- 172.21.15.70:0/684582559 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f729002a070 con 0x7f72a0109b10 2024-05-08T06:40:02.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.884+0000 7f72a4a00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f72840b2900 0x7f72840b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:02.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.885+0000 7f72a4a00700 1 -- 172.21.15.70:0/684582559 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f72900e2e60 con 0x7f72a0109b10 2024-05-08T06:40:02.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.885+0000 7f729e000700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f72840b2900 0x7f72840b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:02.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.885+0000 7f729e000700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f72840b2900 0x7f72840b4dc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f728c005950 tx=0x7f728c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:02.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:02.887+0000 7f72a4a00700 1 -- 172.21.15.70:0/684582559 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7290013070 con 0x7f72a0109b10 2024-05-08T06:40:03.011 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 06:40:02 smithi194 podman[64072]: 2024-05-08 06:40:02.704954517 +0000 UTC m=+0.446584830 container start d20071ef51b7d8e5051685853d9c2f8f068a2d68d33667a2f7e0c47d532063da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-08T06:40:03.011 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 06:40:02 smithi194 ceph-mds[64092]: -- 172.21.15.194:0/2930743921 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c666555a40 con 0x55c666529000 2024-05-08T06:40:03.011 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 06:40:02 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l[64088]: starting mds.l at 2024-05-08T06:40:03.011 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 06:40:02 smithi194 bash[64072]: d20071ef51b7d8e5051685853d9c2f8f068a2d68d33667a2f7e0c47d532063da 2024-05-08T06:40:03.011 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 06:40:02 smithi194 systemd[1]: Started Ceph mds.l for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:03.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.174+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72a01a1490 con 0x7f72a0109b10 2024-05-08T06:40:03.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.175+0000 7f72a4a00700 1 -- 172.21.15.70:0/684582559 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f72900ab010 con 0x7f72a0109b10 2024-05-08T06:40:03.174 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:03.174 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-08T06:40:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.177+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f72840b2900 msgr2=0x7f72840b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.177+0000 7f72a5e00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f72840b2900 0x7f72840b4dc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f728c005950 tx=0x7f728c0058e0 comp rx=0 tx=0).stop 2024-05-08T06:40:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.177+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a0109b10 msgr2=0x7f72a01a0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:03.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.177+0000 7f72a5e00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a0109b10 0x7f72a01a0130 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7290000c00 tx=0x7f7290005ef0 comp rx=0 tx=0).stop 2024-05-08T06:40:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.178+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 shutdown_connections 2024-05-08T06:40:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.178+0000 7f72a5e00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72a010fac0 0x7f72a01a4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.178+0000 7f72a5e00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f72840b2900 0x7f72840b4dc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.178+0000 7f72a5e00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72a0109b10 0x7f72a01a0130 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.178+0000 7f72a5e00700 1 --2- 172.21.15.70:0/684582559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72a010a4d0 0x7f72a01a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.178+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 >> 172.21.15.70:0/684582559 conn(0x7f72a0076c70 msgr2=0x7f72a00774e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.178+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 shutdown_connections 2024-05-08T06:40:03.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:03.178+0000 7f72a5e00700 1 -- 172.21.15.70:0/684582559 wait complete. 2024-05-08T06:40:03.179 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 2 2024-05-08T06:40:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.194:6832/2484800274,v1:172.21.15.194:6833/2484800274] up:boot 2024-05-08T06:40:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: fsmap 1 up:standby 2024-05-08T06:40:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T06:40:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:03.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:03.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:03.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:03 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/684582559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:04.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:04.024 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.194:6832/2484800274,v1:172.21.15.194:6833/2484800274] up:boot 2024-05-08T06:40:04.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: fsmap 1 up:standby 2024-05-08T06:40:04.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T06:40:04.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:04.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:04.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:04.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:04.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:04.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:04.025 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:03 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/684582559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.194:6832/2484800274,v1:172.21.15.194:6833/2484800274] up:boot 2024-05-08T06:40:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: fsmap 1 up:standby 2024-05-08T06:40:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T06:40:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:04.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:04.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:03 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/684582559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:04 smithi070 ceph-mon[29591]: Deploying daemon mds.k on smithi172 2024-05-08T06:40:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:04 smithi172 ceph-mon[33377]: Deploying daemon mds.k on smithi172 2024-05-08T06:40:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:04 smithi194 ceph-mon[33679]: Deploying daemon mds.k on smithi172 2024-05-08T06:40:06.041 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:05 smithi172 ceph-mon[33377]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:06.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:40:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:05 smithi070 ceph-mon[29591]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:06.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:05 smithi194 ceph-mon[33679]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:06.407 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 06:40:06 smithi172 systemd[1]: Starting Ceph mds.k for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:40:06.562 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:07.000 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 06:40:06 smithi172 podman[62288]: 2024-05-08 06:40:06.31464182 +0000 UTC m=+0.034379800 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:40:07.001 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 06:40:06 smithi172 podman[62288]: 2024-05-08 06:40:06.428476057 +0000 UTC m=+0.148214062 container create 14898a50e74385fafd16fcaf4b4fd2b19ecec9133ee040753ed75b94b6b9c5b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-08T06:40:07.001 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 06:40:06 smithi172 podman[62288]: 2024-05-08 06:40:06.707439085 +0000 UTC m=+0.427177097 container init 14898a50e74385fafd16fcaf4b4fd2b19ecec9133ee040753ed75b94b6b9c5b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-08T06:40:07.001 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 06:40:06 smithi172 podman[62288]: 2024-05-08 06:40:06.716958441 +0000 UTC m=+0.436696421 container start 14898a50e74385fafd16fcaf4b4fd2b19ecec9133ee040753ed75b94b6b9c5b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:40:07.001 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 06:40:06 smithi172 ceph-mds[62308]: -- 172.21.15.172:0/2809310489 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5585f6655a40 con 0x5585f6628c00 2024-05-08T06:40:07.001 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 06:40:06 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k[62303]: starting mds.k at 2024-05-08T06:40:07.001 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 06:40:06 smithi172 bash[62288]: 14898a50e74385fafd16fcaf4b4fd2b19ecec9133ee040753ed75b94b6b9c5b8 2024-05-08T06:40:07.001 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 06:40:06 smithi172 systemd[1]: Started Ceph mds.k for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:08.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6832/852809993,v1:172.21.15.172:6833/852809993] up:boot 2024-05-08T06:40:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: fsmap 2 up:standby 2024-05-08T06:40:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T06:40:08.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:08.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:08.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:08.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:08.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:08.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:08.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:08.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6832/852809993,v1:172.21.15.172:6833/852809993] up:boot 2024-05-08T06:40:08.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: fsmap 2 up:standby 2024-05-08T06:40:08.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T06:40:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:08.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:08.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6832/852809993,v1:172.21.15.172:6833/852809993] up:boot 2024-05-08T06:40:08.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: fsmap 2 up:standby 2024-05-08T06:40:08.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T06:40:08.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.907+0000 7f1ab1400700 1 -- 172.21.15.70:0/3597479017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06bad0 msgr2=0x7f1aac10fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:08.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.907+0000 7f1ab1400700 1 --2- 172.21.15.70:0/3597479017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06bad0 0x7f1aac10fa10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a94009990 tx=0x7f1a94009ca0 comp rx=0 tx=0).stop 2024-05-08T06:40:08.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.907+0000 7f1ab1400700 1 -- 172.21.15.70:0/3597479017 shutdown_connections 2024-05-08T06:40:08.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.907+0000 7f1ab1400700 1 --2- 172.21.15.70:0/3597479017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac10ff50 0x7f1aac112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:08.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.907+0000 7f1ab1400700 1 --2- 172.21.15.70:0/3597479017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac06b1b0 0x7f1aac06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:08.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.907+0000 7f1ab1400700 1 --2- 172.21.15.70:0/3597479017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06bad0 0x7f1aac10fa10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:08.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.907+0000 7f1ab1400700 1 -- 172.21.15.70:0/3597479017 >> 172.21.15.70:0/3597479017 conn(0x7f1aac079350 msgr2=0x7f1aac079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:08.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.907+0000 7f1ab1400700 1 -- 172.21.15.70:0/3597479017 shutdown_connections 2024-05-08T06:40:08.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.907+0000 7f1ab1400700 1 -- 172.21.15.70:0/3597479017 wait complete. 2024-05-08T06:40:08.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.908+0000 7f1ab1400700 1 Processor -- start 2024-05-08T06:40:08.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.909+0000 7f1ab1400700 1 -- start start 2024-05-08T06:40:08.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.909+0000 7f1ab1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06b1b0 0x7f1aac1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:08.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.909+0000 7f1ab1400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac06bad0 0x7f1aac1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:08.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.909+0000 7f1ab1400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac10ff50 0x7f1aac19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:08.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.909+0000 7f1ab1400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac115790 con 0x7f1aac06b1b0 2024-05-08T06:40:08.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.909+0000 7f1ab1400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac115610 con 0x7f1aac06bad0 2024-05-08T06:40:08.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.909+0000 7f1ab1400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac115910 con 0x7f1aac10ff50 2024-05-08T06:40:08.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aaa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06b1b0 0x7f1aac1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:08.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aaa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06b1b0 0x7f1aac1a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39348/0 (socket says 172.21.15.70:39348) 2024-05-08T06:40:08.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aaa800700 1 -- 172.21.15.70:0/2012266150 learned_addr learned my addr 172.21.15.70:0/2012266150 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:08.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aa3e00700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac06bad0 0x7f1aac1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aaa800700 1 -- 172.21.15.70:0/2012266150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac10ff50 msgr2=0x7f1aac19baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aab200700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac10ff50 0x7f1aac19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aaa800700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac10ff50 0x7f1aac19baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aaa800700 1 -- 172.21.15.70:0/2012266150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac06bad0 msgr2=0x7f1aac1a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aaa800700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac06bad0 0x7f1aac1a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aaa800700 1 -- 172.21.15.70:0/2012266150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac19c250 con 0x7f1aac06b1b0 2024-05-08T06:40:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aa3e00700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac06bad0 0x7f1aac1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:40:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.910+0000 7f1aaa800700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06b1b0 0x7f1aac1a1930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00d950 tx=0x7f1a9c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.911+0000 7f1aa3400700 1 -- 172.21.15.70:0/2012266150 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c016070 con 0x7f1aac06b1b0 2024-05-08T06:40:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.911+0000 7f1aa3400700 1 -- 172.21.15.70:0/2012266150 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a9c010460 con 0x7f1aac06b1b0 2024-05-08T06:40:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.911+0000 7f1aa3400700 1 -- 172.21.15.70:0/2012266150 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00f620 con 0x7f1aac06b1b0 2024-05-08T06:40:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.911+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aac19c540 con 0x7f1aac06b1b0 2024-05-08T06:40:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.911+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aac1a8800 con 0x7f1aac06b1b0 2024-05-08T06:40:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.912+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aac06a190 con 0x7f1aac06b1b0 2024-05-08T06:40:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.917+0000 7f1aa3400700 1 -- 172.21.15.70:0/2012266150 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1a9c019070 con 0x7f1aac06b1b0 2024-05-08T06:40:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.918+0000 7f1aa3400700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1a900b2900 0x7f1a900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.919+0000 7f1aa3400700 1 -- 172.21.15.70:0/2012266150 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f1a9c0e19d0 con 0x7f1aac06b1b0 2024-05-08T06:40:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.919+0000 7f1aa3e00700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1a900b2900 0x7f1a900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.919+0000 7f1aa3400700 1 -- 172.21.15.70:0/2012266150 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1a9c0a9af0 con 0x7f1aac06b1b0 2024-05-08T06:40:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:08.919+0000 7f1aa3e00700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1a900b2900 0x7f1a900b4dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1a94003760 tx=0x7f1a94005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:09.158 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:08 smithi070 ceph-mon[29591]: Deploying daemon mds.j on smithi070 2024-05-08T06:40:09.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:08 smithi172 ceph-mon[33377]: Deploying daemon mds.j on smithi070 2024-05-08T06:40:09.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.218+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1aac02e6d0 con 0x7f1aac06b1b0 2024-05-08T06:40:09.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.218+0000 7f1aa3400700 1 -- 172.21.15.70:0/2012266150 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7f1a9c0a93f0 con 0x7f1aac06b1b0 2024-05-08T06:40:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:09.218 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-08T06:40:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1a900b2900 msgr2=0x7f1a900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1a900b2900 0x7f1a900b4dc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1a94003760 tx=0x7f1a94005fb0 comp rx=0 tx=0).stop 2024-05-08T06:40:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06b1b0 msgr2=0x7f1aac1a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06b1b0 0x7f1aac1a1930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00d950 tx=0x7f1a9c00dd10 comp rx=0 tx=0).stop 2024-05-08T06:40:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 shutdown_connections 2024-05-08T06:40:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aac10ff50 0x7f1aac19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1a900b2900 0x7f1a900b4dc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aac06b1b0 0x7f1aac1a1930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:09.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 --2- 172.21.15.70:0/2012266150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aac06bad0 0x7f1aac1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:09.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.221+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 >> 172.21.15.70:0/2012266150 conn(0x7f1aac079350 msgr2=0x7f1aac1114f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:09.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.222+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 shutdown_connections 2024-05-08T06:40:09.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:09.222+0000 7f1ab1400700 1 -- 172.21.15.70:0/2012266150 wait complete. 2024-05-08T06:40:09.222 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 3 2024-05-08T06:40:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:08 smithi194 ceph-mon[33679]: Deploying daemon mds.j on smithi070 2024-05-08T06:40:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:09 smithi172 ceph-mon[33377]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2012266150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:09 smithi194 ceph-mon[33679]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2012266150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:10.341 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:09 smithi070 ceph-mon[29591]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:10.341 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2012266150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:10 smithi194 ceph-mon[33679]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:11.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:10 smithi070 ceph-mon[29591]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:10 smithi172 ceph-mon[33377]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:11.547 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 06:40:11 smithi070 systemd[1]: Starting Ceph mds.j for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:40:11.879 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 06:40:11 smithi070 podman[69357]: 2024-05-08 06:40:11.452310986 +0000 UTC m=+0.035764282 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:40:11.879 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 06:40:11 smithi070 podman[69357]: 2024-05-08 06:40:11.580988448 +0000 UTC m=+0.164441831 container create c21a1d87e7c2137801ec04ad720bc2a61a792c4937f551314c26a47d397359b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-08T06:40:12.379 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 06:40:11 smithi070 podman[69357]: 2024-05-08 06:40:11.902027465 +0000 UTC m=+0.485480804 container init c21a1d87e7c2137801ec04ad720bc2a61a792c4937f551314c26a47d397359b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-08T06:40:12.379 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 06:40:11 smithi070 podman[69357]: 2024-05-08 06:40:11.912859767 +0000 UTC m=+0.496313107 container start c21a1d87e7c2137801ec04ad720bc2a61a792c4937f551314c26a47d397359b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:40:12.379 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 06:40:11 smithi070 ceph-mds[69376]: -- 172.21.15.70:0/112136277 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561befc67a40 con 0x561befc3a800 2024-05-08T06:40:12.379 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 06:40:11 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j[69372]: starting mds.j at 2024-05-08T06:40:12.379 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 06:40:11 smithi070 bash[69357]: c21a1d87e7c2137801ec04ad720bc2a61a792c4937f551314c26a47d397359b6 2024-05-08T06:40:12.379 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 06:40:12 smithi070 systemd[1]: Started Ceph mds.j for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:13.000 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:40:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.70:6834/2483099434,v1:172.21.15.70:6835/2483099434] up:boot 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: fsmap 3 up:standby 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:13 smithi070 ceph-mon[29591]: Deploying daemon mds.d on smithi070 2024-05-08T06:40:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.70:6834/2483099434,v1:172.21.15.70:6835/2483099434] up:boot 2024-05-08T06:40:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: fsmap 3 up:standby 2024-05-08T06:40:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T06:40:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:13.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:13.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:13.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:13 smithi172 ceph-mon[33377]: Deploying daemon mds.d on smithi070 2024-05-08T06:40:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.70:6834/2483099434,v1:172.21.15.70:6835/2483099434] up:boot 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: fsmap 3 up:standby 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:13 smithi194 ceph-mon[33679]: Deploying daemon mds.d on smithi070 2024-05-08T06:40:14.496 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:15.256 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:15 smithi070 ceph-mon[29591]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:15 smithi172 ceph-mon[33377]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:15 smithi194 ceph-mon[33679]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:15.629 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 06:40:15 smithi070 systemd[1]: Starting Ceph mds.d for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:40:16.379 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 06:40:16 smithi070 podman[69751]: 2024-05-08 06:40:16.098715139 +0000 UTC m=+0.037223584 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:40:16.380 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 06:40:16 smithi070 podman[69751]: 2024-05-08 06:40:16.251374704 +0000 UTC m=+0.189883164 container create b66c6737f9e157e81af9f6ec30222336614ef83ad8f13c997da9f1955bb0ea9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-08T06:40:16.819 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 06:40:16 smithi070 podman[69751]: 2024-05-08 06:40:16.618693031 +0000 UTC m=+0.557201511 container init b66c6737f9e157e81af9f6ec30222336614ef83ad8f13c997da9f1955bb0ea9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:40:16.819 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 06:40:16 smithi070 podman[69751]: 2024-05-08 06:40:16.629473749 +0000 UTC m=+0.567982185 container start b66c6737f9e157e81af9f6ec30222336614ef83ad8f13c997da9f1955bb0ea9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-08T06:40:16.819 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 06:40:16 smithi070 ceph-mds[69789]: -- 172.21.15.70:0/3116527078 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5625d7cb7a40 con 0x5625d7c8ac00 2024-05-08T06:40:16.819 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 06:40:16 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d[69785]: starting mds.d at 2024-05-08T06:40:17.128 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 06:40:16 smithi070 bash[69751]: b66c6737f9e157e81af9f6ec30222336614ef83ad8f13c997da9f1955bb0ea9d 2024-05-08T06:40:17.129 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 06:40:16 smithi070 systemd[1]: Started Ceph mds.d for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.201+0000 7f291d200700 1 -- 172.21.15.70:0/3098714925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 msgr2=0x7f2918075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.201+0000 7f291d200700 1 --2- 172.21.15.70:0/3098714925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 0x7f2918075c20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2908009990 tx=0x7f2908009ca0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.201+0000 7f291d200700 1 -- 172.21.15.70:0/3098714925 shutdown_connections 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.201+0000 7f291d200700 1 --2- 172.21.15.70:0/3098714925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29181143e0 0x7f29181167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.201+0000 7f291d200700 1 --2- 172.21.15.70:0/3098714925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 0x7f2918075c20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.201+0000 7f291d200700 1 --2- 172.21.15.70:0/3098714925 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2918076160 0x7f2918113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.201+0000 7f291d200700 1 -- 172.21.15.70:0/3098714925 >> 172.21.15.70:0/3098714925 conn(0x7f29180fef20 msgr2=0x7f2918101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.202+0000 7f291d200700 1 -- 172.21.15.70:0/3098714925 shutdown_connections 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.202+0000 7f291d200700 1 -- 172.21.15.70:0/3098714925 wait complete. 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.203+0000 7f291d200700 1 Processor -- start 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.203+0000 7f291d200700 1 -- start start 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.203+0000 7f291d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 0x7f291819fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.203+0000 7f291d200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2918076160 0x7f29181a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.203+0000 7f291d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29181143e0 0x7f29181a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.203+0000 7f291d200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2918119a60 con 0x7f2918075840 2024-05-08T06:40:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.203+0000 7f291d200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29181198e0 con 0x7f29181143e0 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.203+0000 7f291d200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2918119be0 con 0x7f2918076160 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 0x7f291819fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 0x7f291819fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53684/0 (socket says 172.21.15.70:53684) 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917400700 1 -- 172.21.15.70:0/839100204 learned_addr learned my addr 172.21.15.70:0/839100204 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917e00700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29181143e0 0x7f29181a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2916a00700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2918076160 0x7f29181a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917400700 1 -- 172.21.15.70:0/839100204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2918076160 msgr2=0x7f29181a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917400700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2918076160 0x7f29181a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917400700 1 -- 172.21.15.70:0/839100204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29181143e0 msgr2=0x7f29181a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917400700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29181143e0 0x7f29181a48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917400700 1 -- 172.21.15.70:0/839100204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29181a5000 con 0x7f2918075840 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.204+0000 7f2917e00700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29181143e0 0x7f29181a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:40:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.205+0000 7f2917400700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 0x7f291819fff0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2908006010 tx=0x7f290800bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.205+0000 7f290fe00700 1 -- 172.21.15.70:0/839100204 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908027070 con 0x7f2918075840 2024-05-08T06:40:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.205+0000 7f290fe00700 1 -- 172.21.15.70:0/839100204 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f290800fb90 con 0x7f2918075840 2024-05-08T06:40:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.205+0000 7f290fe00700 1 -- 172.21.15.70:0/839100204 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080173f0 con 0x7f2918075840 2024-05-08T06:40:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.205+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29181a5290 con 0x7f2918075840 2024-05-08T06:40:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.205+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29181acb70 con 0x7f2918075840 2024-05-08T06:40:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.206+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291806a190 con 0x7f2918075840 2024-05-08T06:40:17.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.209+0000 7f290fe00700 1 -- 172.21.15.70:0/839100204 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f290802a070 con 0x7f2918075840 2024-05-08T06:40:17.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.210+0000 7f290fe00700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f28fc0b2900 0x7f28fc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.210+0000 7f290fe00700 1 -- 172.21.15.70:0/839100204 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f29080e30d0 con 0x7f2918075840 2024-05-08T06:40:17.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.211+0000 7f2916a00700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f28fc0b2900 0x7f28fc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.211+0000 7f2916a00700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f28fc0b2900 0x7f28fc0b4dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f29181071d0 tx=0x7f2904009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:17.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.218+0000 7f290fe00700 1 -- 172.21.15.70:0/839100204 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2908013070 con 0x7f2918075840 2024-05-08T06:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:17 smithi070 ceph-mon[29591]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:17.406 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:17.407 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:17.407 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:17.407 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:17.407 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:17 smithi172 ceph-mon[33377]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:17.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:17.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:17.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.503+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f291802e510 con 0x7f2918075840 2024-05-08T06:40:17.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.504+0000 7f290fe00700 1 -- 172.21.15.70:0/839100204 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3871 (secure 0 0 0) 0x7f29080ab280 con 0x7f2918075840 2024-05-08T06:40:17.503 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:17.503 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f28fc0b2900 msgr2=0x7f28fc0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f28fc0b2900 0x7f28fc0b4dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f29181071d0 tx=0x7f2904009260 comp rx=0 tx=0).stop 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 msgr2=0x7f291819fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 0x7f291819fff0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2908006010 tx=0x7f290800bfa0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 shutdown_connections 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29181143e0 0x7f29181a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f28fc0b2900 0x7f28fc0b4dc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2918075840 0x7f291819fff0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 --2- 172.21.15.70:0/839100204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2918076160 0x7f29181a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:17.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 >> 172.21.15.70:0/839100204 conn(0x7f29180fef20 msgr2=0x7f29180ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:17.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 shutdown_connections 2024-05-08T06:40:17.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:17.507+0000 7f291d200700 1 -- 172.21.15.70:0/839100204 wait complete. 2024-05-08T06:40:17.507 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-05-08T06:40:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:17 smithi194 ceph-mon[33679]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:18.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:18 smithi172 ceph-mon[33377]: Deploying daemon mds.e on smithi172 2024-05-08T06:40:18.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:18 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.70:6836/2593169616,v1:172.21.15.70:6837/2593169616] up:boot 2024-05-08T06:40:18.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:18 smithi172 ceph-mon[33377]: fsmap 4 up:standby 2024-05-08T06:40:18.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T06:40:18.393 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:18 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/839100204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:18 smithi194 ceph-mon[33679]: Deploying daemon mds.e on smithi172 2024-05-08T06:40:18.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:18 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.70:6836/2593169616,v1:172.21.15.70:6837/2593169616] up:boot 2024-05-08T06:40:18.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:18 smithi194 ceph-mon[33679]: fsmap 4 up:standby 2024-05-08T06:40:18.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T06:40:18.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:18 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/839100204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:18.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:18 smithi070 ceph-mon[29591]: Deploying daemon mds.e on smithi172 2024-05-08T06:40:18.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:18 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.70:6836/2593169616,v1:172.21.15.70:6837/2593169616] up:boot 2024-05-08T06:40:18.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:18 smithi070 ceph-mon[29591]: fsmap 4 up:standby 2024-05-08T06:40:18.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T06:40:18.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:18 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/839100204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:19 smithi172 ceph-mon[33377]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:19 smithi194 ceph-mon[33679]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:19 smithi070 ceph-mon[29591]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:20.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:40:20.680 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 06:40:20 smithi172 systemd[1]: Starting Ceph mds.e for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:40:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:20.951 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 06:40:20 smithi172 podman[62603]: 2024-05-08 06:40:20.588077401 +0000 UTC m=+0.036854208 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:40:20.951 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 06:40:20 smithi172 podman[62603]: 2024-05-08 06:40:20.697508915 +0000 UTC m=+0.146285753 container create 6aafeff435d3e8836f60604ab0f377df414e92ea8d75992e1c1b6c78e8954181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:40:20.952 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 06:40:20 smithi172 podman[62603]: 2024-05-08 06:40:20.951429251 +0000 UTC m=+0.400206109 container init 6aafeff435d3e8836f60604ab0f377df414e92ea8d75992e1c1b6c78e8954181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-08T06:40:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:21 smithi172 ceph-mon[33377]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:21.430 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 06:40:20 smithi172 podman[62603]: 2024-05-08 06:40:20.961959184 +0000 UTC m=+0.410736015 container start 6aafeff435d3e8836f60604ab0f377df414e92ea8d75992e1c1b6c78e8954181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-08T06:40:21.430 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 06:40:21 smithi172 ceph-mds[62622]: -- 172.21.15.172:0/3762652969 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a1f4563a40 con 0x55a1f4536800 2024-05-08T06:40:21.430 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 06:40:21 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e[62618]: starting mds.e at 2024-05-08T06:40:21.430 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 06:40:21 smithi172 bash[62603]: 6aafeff435d3e8836f60604ab0f377df414e92ea8d75992e1c1b6c78e8954181 2024-05-08T06:40:21.430 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 06:40:21 smithi172 systemd[1]: Started Ceph mds.e for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:21.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:21 smithi070 ceph-mon[29591]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:21 smithi194 ceph-mon[33679]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] up:boot 2024-05-08T06:40:22.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: fsmap 5 up:standby 2024-05-08T06:40:22.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T06:40:22.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:22.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:22.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:22.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:22.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:22.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:22.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:22 smithi172 ceph-mon[33377]: Deploying daemon mds.f on smithi194 2024-05-08T06:40:22.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] up:boot 2024-05-08T06:40:22.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: fsmap 5 up:standby 2024-05-08T06:40:22.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T06:40:22.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:22.459 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:22.460 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:22.460 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:22.460 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:22.460 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:22.460 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:22 smithi194 ceph-mon[33679]: Deploying daemon mds.f on smithi194 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] up:boot 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: fsmap 5 up:standby 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:22.593 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:22 smithi070 ceph-mon[29591]: Deploying daemon mds.f on smithi194 2024-05-08T06:40:23.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.150+0000 7fd9e8a00700 1 -- 172.21.15.70:0/2113751112 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4003b40 con 0x7fd9e41056c0 2024-05-08T06:40:23.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.150+0000 7fd9ec800700 1 -- 172.21.15.70:0/2113751112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e41056c0 msgr2=0x7fd9e4105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:23.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.150+0000 7fd9ec800700 1 --2- 172.21.15.70:0/2113751112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e41056c0 0x7fd9e4105b40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009990 tx=0x7fd9d4009ca0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.150+0000 7fd9ec800700 1 -- 172.21.15.70:0/2113751112 shutdown_connections 2024-05-08T06:40:23.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.151+0000 7fd9ec800700 1 --2- 172.21.15.70:0/2113751112 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9e4106080 0x7fd9e4112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.151+0000 7fd9ec800700 1 --2- 172.21.15.70:0/2113751112 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9e410b6c0 0x7fd9e410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.151+0000 7fd9ec800700 1 --2- 172.21.15.70:0/2113751112 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e41056c0 0x7fd9e4105b40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.151+0000 7fd9ec800700 1 -- 172.21.15.70:0/2113751112 >> 172.21.15.70:0/2113751112 conn(0x7fd9e41011b0 msgr2=0x7fd9e41035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:23.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.151+0000 7fd9ec800700 1 -- 172.21.15.70:0/2113751112 shutdown_connections 2024-05-08T06:40:23.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.151+0000 7fd9ec800700 1 -- 172.21.15.70:0/2113751112 wait complete. 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.152+0000 7fd9ec800700 1 Processor -- start 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.152+0000 7fd9ec800700 1 -- start start 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.152+0000 7fd9ec800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9e41056c0 0x7fd9e41a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.152+0000 7fd9ec800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e4106080 0x7fd9e41a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.152+0000 7fd9ec800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9e410b6c0 0x7fd9e419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.152+0000 7fd9ec800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e41157b0 con 0x7fd9e4106080 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.152+0000 7fd9ec800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4115630 con 0x7fd9e41056c0 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.152+0000 7fd9ec800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4115930 con 0x7fd9e410b6c0 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.152+0000 7fd9e9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e4106080 0x7fd9e41a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9e9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e4106080 0x7fd9e41a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53706/0 (socket says 172.21.15.70:53706) 2024-05-08T06:40:23.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9e9400700 1 -- 172.21.15.70:0/1479165126 learned_addr learned my addr 172.21.15.70:0/1479165126 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:23.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9ea800700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9e410b6c0 0x7fd9e419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9e9e00700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9e41056c0 0x7fd9e41a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9e9400700 1 -- 172.21.15.70:0/1479165126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9e410b6c0 msgr2=0x7fd9e419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9e9400700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9e410b6c0 0x7fd9e419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9e9400700 1 -- 172.21.15.70:0/1479165126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9e41056c0 msgr2=0x7fd9e41a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9e9400700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9e41056c0 0x7fd9e41a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9e9400700 1 -- 172.21.15.70:0/1479165126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e419c230 con 0x7fd9e4106080 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9ea800700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9e410b6c0 0x7fd9e419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.153+0000 7fd9e9400700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e4106080 0x7fd9e41a1e50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4000c00 tx=0x7fd9d4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.154+0000 7fd9dea00700 1 -- 172.21.15.70:0/1479165126 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4027070 con 0x7fd9e4106080 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.154+0000 7fd9dea00700 1 -- 172.21.15.70:0/1479165126 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9d400fc70 con 0x7fd9e4106080 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.154+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e419c4c0 con 0x7fd9e4106080 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.154+0000 7fd9dea00700 1 -- 172.21.15.70:0/1479165126 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4022d40 con 0x7fd9e4106080 2024-05-08T06:40:23.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.154+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e41a87e0 con 0x7fd9e4106080 2024-05-08T06:40:23.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.155+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e410dc50 con 0x7fd9e4106080 2024-05-08T06:40:23.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.157+0000 7fd9dea00700 1 -- 172.21.15.70:0/1479165126 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd9d402a070 con 0x7fd9e4106080 2024-05-08T06:40:23.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.159+0000 7fd9dea00700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9cc0b2900 0x7fd9cc0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:23.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.159+0000 7fd9dea00700 1 -- 172.21.15.70:0/1479165126 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd9d40e2b40 con 0x7fd9e4106080 2024-05-08T06:40:23.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.159+0000 7fd9e9e00700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9cc0b2900 0x7fd9cc0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:23.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.160+0000 7fd9e9e00700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9cc0b2900 0x7fd9cc0b4dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800bbb0 tx=0x7fd9d800b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:23.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.163+0000 7fd9dea00700 1 -- 172.21.15.70:0/1479165126 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd9d405fdf0 con 0x7fd9e4106080 2024-05-08T06:40:23.407 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:23 smithi194 ceph-mon[33679]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:23.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.448+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9e406a190 con 0x7fd9e4106080 2024-05-08T06:40:23.449 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:23 smithi070 ceph-mon[29591]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:23.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.450+0000 7fd9dea00700 1 -- 172.21.15.70:0/1479165126 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4699 (secure 0 0 0) 0x7fd9d4013070 con 0x7fd9e4106080 2024-05-08T06:40:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:23.450 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34379,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-08T06:40:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.453+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9cc0b2900 msgr2=0x7fd9cc0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.453+0000 7fd9ec800700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9cc0b2900 0x7fd9cc0b4dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800bbb0 tx=0x7fd9d800b590 comp rx=0 tx=0).stop 2024-05-08T06:40:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.453+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e4106080 msgr2=0x7fd9e41a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.453+0000 7fd9ec800700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e4106080 0x7fd9e41a1e50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4000c00 tx=0x7fd9d4009f90 comp rx=0 tx=0).stop 2024-05-08T06:40:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.454+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 shutdown_connections 2024-05-08T06:40:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.454+0000 7fd9ec800700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9e410b6c0 0x7fd9e419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.454+0000 7fd9ec800700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd9e41056c0 0x7fd9e41a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.454+0000 7fd9ec800700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9cc0b2900 0x7fd9cc0b4dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.454+0000 7fd9ec800700 1 --2- 172.21.15.70:0/1479165126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd9e4106080 0x7fd9e41a1e50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.454+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 >> 172.21.15.70:0/1479165126 conn(0x7fd9e41011b0 msgr2=0x7fd9e4101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.454+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 shutdown_connections 2024-05-08T06:40:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:23.454+0000 7fd9ec800700 1 -- 172.21.15.70:0/1479165126 wait complete. 2024-05-08T06:40:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2024-05-08T06:40:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:23 smithi172 ceph-mon[33377]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:24 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1479165126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:24.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:24 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1479165126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:24.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:24 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1479165126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:24.938 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 06:40:24 smithi194 podman[64381]: 2024-05-08 06:40:24.651926296 +0000 UTC m=+0.166080593 container create 00732f4e84384ecc6ef04b2467539808b91be5ec5681c520ff0f17f2542f50b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:40:25.260 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 06:40:24 smithi194 podman[64381]: 2024-05-08 06:40:24.947839968 +0000 UTC m=+0.461994296 container init 00732f4e84384ecc6ef04b2467539808b91be5ec5681c520ff0f17f2542f50b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-08T06:40:25.260 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 06:40:24 smithi194 podman[64381]: 2024-05-08 06:40:24.956594049 +0000 UTC m=+0.470748333 container start 00732f4e84384ecc6ef04b2467539808b91be5ec5681c520ff0f17f2542f50b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-08T06:40:25.260 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 06:40:24 smithi194 ceph-mds[64407]: -- 172.21.15.194:0/1527215845 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d42c0ba40 con 0x561d42bde800 2024-05-08T06:40:25.260 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 06:40:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f[64398]: starting mds.f at 2024-05-08T06:40:25.261 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 06:40:25 smithi194 bash[64381]: 00732f4e84384ecc6ef04b2467539808b91be5ec5681c520ff0f17f2542f50b2 2024-05-08T06:40:25.261 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 06:40:25 smithi194 systemd[1]: Started Ceph mds.f for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:25.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:25 smithi070 ceph-mon[29591]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:25.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:25 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:25.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:25 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:25.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:25 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:25.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:25 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:25.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:25 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:25.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:25 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:25 smithi172 ceph-mon[33377]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:25 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:25 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:25 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:25.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:25 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:25.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:25 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:25.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:25 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:25 smithi194 ceph-mon[33679]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:25 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:25 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:25 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:25 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:25 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:25 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:26.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:40:26.431 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:26 smithi194 ceph-mon[33679]: Deploying daemon mds.c on smithi194 2024-05-08T06:40:26.431 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:26 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.194:6834/2911491669,v1:172.21.15.194:6835/2911491669] up:boot 2024-05-08T06:40:26.431 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:26 smithi194 ceph-mon[33679]: fsmap 6 up:standby 2024-05-08T06:40:26.431 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:26 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T06:40:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:26 smithi070 ceph-mon[29591]: Deploying daemon mds.c on smithi194 2024-05-08T06:40:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:26 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.194:6834/2911491669,v1:172.21.15.194:6835/2911491669] up:boot 2024-05-08T06:40:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:26 smithi070 ceph-mon[29591]: fsmap 6 up:standby 2024-05-08T06:40:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:26 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T06:40:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:26 smithi172 ceph-mon[33377]: Deploying daemon mds.c on smithi194 2024-05-08T06:40:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:26 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.194:6834/2911491669,v1:172.21.15.194:6835/2911491669] up:boot 2024-05-08T06:40:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:26 smithi172 ceph-mon[33377]: fsmap 6 up:standby 2024-05-08T06:40:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:26 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T06:40:26.749 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:27.405 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:27 smithi070 ceph-mon[29591]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:27 smithi194 ceph-mon[33679]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:27 smithi172 ceph-mon[33377]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:28.920 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 06:40:28 smithi194 podman[64691]: 2024-05-08 06:40:28.615151233 +0000 UTC m=+0.180701175 container create 62408756d1333ff881187b535af005d73d02e21cec8be83f647aa022b93a62eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-08T06:40:28.920 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 06:40:28 smithi194 podman[64691]: 2024-05-08 06:40:28.919320147 +0000 UTC m=+0.484870137 container init 62408756d1333ff881187b535af005d73d02e21cec8be83f647aa022b93a62eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:40:29.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.080+0000 7f0e6de00700 1 -- 172.21.15.70:0/371194121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68104100 msgr2=0x7f0e68108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.080+0000 7f0e6de00700 1 --2- 172.21.15.70:0/371194121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68104100 0x7f0e68108120 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e540099c0 tx=0x7f0e54009cd0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.080+0000 7f0e6de00700 1 -- 172.21.15.70:0/371194121 shutdown_connections 2024-05-08T06:40:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.080+0000 7f0e6de00700 1 --2- 172.21.15.70:0/371194121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e68108850 0x7f0e681103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.080+0000 7f0e6de00700 1 --2- 172.21.15.70:0/371194121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e68103750 0x7f0e68103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.080+0000 7f0e6de00700 1 --2- 172.21.15.70:0/371194121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68104100 0x7f0e68108120 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.080+0000 7f0e6de00700 1 -- 172.21.15.70:0/371194121 >> 172.21.15.70:0/371194121 conn(0x7f0e6807a600 msgr2=0x7f0e6807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.081+0000 7f0e6de00700 1 -- 172.21.15.70:0/371194121 shutdown_connections 2024-05-08T06:40:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.081+0000 7f0e6de00700 1 -- 172.21.15.70:0/371194121 wait complete. 2024-05-08T06:40:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e6de00700 1 Processor -- start 2024-05-08T06:40:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e6de00700 1 -- start start 2024-05-08T06:40:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e6de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68103750 0x7f0e681a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e6de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e68104100 0x7f0e681a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e6de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e68108850 0x7f0e6819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e6de00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68113510 con 0x7f0e68103750 2024-05-08T06:40:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e6de00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68113390 con 0x7f0e68108850 2024-05-08T06:40:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e6de00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68113690 con 0x7f0e68104100 2024-05-08T06:40:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e66a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68103750 0x7f0e681a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e66a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68103750 0x7f0e681a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42654/0 (socket says 172.21.15.70:42654) 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.082+0000 7f0e66a00700 1 -- 172.21.15.70:0/1997303999 learned_addr learned my addr 172.21.15.70:0/1997303999 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.083+0000 7f0e66000700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e68104100 0x7f0e681a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.083+0000 7f0e67400700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e68108850 0x7f0e6819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.083+0000 7f0e66a00700 1 -- 172.21.15.70:0/1997303999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e68104100 msgr2=0x7f0e681a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.083+0000 7f0e66a00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e68104100 0x7f0e681a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.083+0000 7f0e66a00700 1 -- 172.21.15.70:0/1997303999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e68108850 msgr2=0x7f0e6819ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.083+0000 7f0e66a00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e68108850 0x7f0e6819ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.083+0000 7f0e66a00700 1 -- 172.21.15.70:0/1997303999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6819c1d0 con 0x7f0e68103750 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.083+0000 7f0e66a00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68103750 0x7f0e681a18b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c9b0 tx=0x7f0e5800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.084+0000 7f0e6ca00700 1 -- 172.21.15.70:0/1997303999 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58007b00 con 0x7f0e68103750 2024-05-08T06:40:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.084+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6819c4c0 con 0x7f0e68103750 2024-05-08T06:40:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.084+0000 7f0e6ca00700 1 -- 172.21.15.70:0/1997303999 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0e58007ca0 con 0x7f0e68103750 2024-05-08T06:40:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.084+0000 7f0e6ca00700 1 -- 172.21.15.70:0/1997303999 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58018660 con 0x7f0e68103750 2024-05-08T06:40:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.084+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e681a8780 con 0x7f0e68103750 2024-05-08T06:40:29.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.085+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6806a190 con 0x7f0e68103750 2024-05-08T06:40:29.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.087+0000 7f0e6ca00700 1 -- 172.21.15.70:0/1997303999 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0e5800f450 con 0x7f0e68103750 2024-05-08T06:40:29.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.089+0000 7f0e6ca00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0e4c0b2880 0x7f0e4c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:29.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.089+0000 7f0e6ca00700 1 -- 172.21.15.70:0/1997303999 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f0e580e21a0 con 0x7f0e68103750 2024-05-08T06:40:29.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.089+0000 7f0e66000700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0e4c0b2880 0x7f0e4c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:29.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.090+0000 7f0e66000700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0e4c0b2880 0x7f0e4c0b4d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0e54000c00 tx=0x7f0e5401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:29.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.092+0000 7f0e6ca00700 1 -- 172.21.15.70:0/1997303999 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0e58014030 con 0x7f0e68103750 2024-05-08T06:40:29.261 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 06:40:28 smithi194 podman[64691]: 2024-05-08 06:40:28.931068565 +0000 UTC m=+0.496618516 container start 62408756d1333ff881187b535af005d73d02e21cec8be83f647aa022b93a62eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.vendor=CentOS) 2024-05-08T06:40:29.261 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 06:40:28 smithi194 ceph-mds[64710]: -- 172.21.15.194:0/3662548402 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a662dba40 con 0x556a662aec00 2024-05-08T06:40:29.261 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 06:40:28 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c[64706]: starting mds.c at 2024-05-08T06:40:29.261 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 06:40:29 smithi194 bash[64691]: 62408756d1333ff881187b535af005d73d02e21cec8be83f647aa022b93a62eb 2024-05-08T06:40:29.261 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 06:40:29 smithi194 systemd[1]: Started Ceph mds.c for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:29 smithi070 ceph-mon[29591]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:29 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:29.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.385+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e6819cfa0 con 0x7f0e68103750 2024-05-08T06:40:29.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.386+0000 7f0e6ca00700 1 -- 172.21.15.70:0/1997303999 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6352 (secure 0 0 0) 0x7f0e580aa350 con 0x7f0e68103750 2024-05-08T06:40:29.385 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:29.386 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24397,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34379,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0e4c0b2880 msgr2=0x7f0e4c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0e4c0b2880 0x7f0e4c0b4d40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0e54000c00 tx=0x7f0e5401a040 comp rx=0 tx=0).stop 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68103750 msgr2=0x7f0e681a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68103750 0x7f0e681a18b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0e5800c9b0 tx=0x7f0e5800cd70 comp rx=0 tx=0).stop 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 shutdown_connections 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0e68108850 0x7f0e6819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0e4c0b2880 0x7f0e4c0b4d40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e68103750 0x7f0e681a18b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 --2- 172.21.15.70:0/1997303999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e68104100 0x7f0e681a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 >> 172.21.15.70:0/1997303999 conn(0x7f0e6807a600 msgr2=0x7f0e681018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 shutdown_connections 2024-05-08T06:40:29.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:29.389+0000 7f0e6de00700 1 -- 172.21.15.70:0/1997303999 wait complete. 2024-05-08T06:40:29.390 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-05-08T06:40:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:29 smithi172 ceph-mon[33377]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:29.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:29.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:29 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:29 smithi194 ceph-mon[33679]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:29 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:30.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:30 smithi194 ceph-mon[33679]: Deploying daemon mds.h on smithi172 2024-05-08T06:40:30.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:30 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.194:6836/346722795,v1:172.21.15.194:6837/346722795] up:boot 2024-05-08T06:40:30.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:30 smithi194 ceph-mon[33679]: fsmap 7 up:standby 2024-05-08T06:40:30.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:30 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T06:40:30.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:30 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1997303999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:30.587 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:30 smithi172 ceph-mon[33377]: Deploying daemon mds.h on smithi172 2024-05-08T06:40:30.587 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:30 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.194:6836/346722795,v1:172.21.15.194:6837/346722795] up:boot 2024-05-08T06:40:30.587 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:30 smithi172 ceph-mon[33377]: fsmap 7 up:standby 2024-05-08T06:40:30.587 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:30 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T06:40:30.587 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:30 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1997303999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:30 smithi070 ceph-mon[29591]: Deploying daemon mds.h on smithi172 2024-05-08T06:40:30.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:30 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.194:6836/346722795,v1:172.21.15.194:6837/346722795] up:boot 2024-05-08T06:40:30.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:30 smithi070 ceph-mon[29591]: fsmap 7 up:standby 2024-05-08T06:40:30.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:30 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T06:40:30.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:30 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1997303999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:31 smithi172 ceph-mon[33377]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:31.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:31 smithi070 ceph-mon[29591]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:31.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:31 smithi194 ceph-mon[33679]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:32.352 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:40:32.679 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 06:40:32 smithi172 systemd[1]: Starting Ceph mds.h for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:40:32.791 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:33.066 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 06:40:32 smithi172 podman[62913]: 2024-05-08 06:40:32.675860231 +0000 UTC m=+0.034522337 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:40:33.066 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 06:40:32 smithi172 podman[62913]: 2024-05-08 06:40:32.795668991 +0000 UTC m=+0.154331135 container create 52df82662be39d32c01223688200b447c8c927070bd473ed6ba0ffb9a04175e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-08T06:40:33.066 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 06:40:33 smithi172 podman[62913]: 2024-05-08 06:40:33.06629527 +0000 UTC m=+0.424957438 container init 52df82662be39d32c01223688200b447c8c927070bd473ed6ba0ffb9a04175e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:40:33.341 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 06:40:33 smithi172 podman[62913]: 2024-05-08 06:40:33.079127771 +0000 UTC m=+0.437789905 container start 52df82662be39d32c01223688200b447c8c927070bd473ed6ba0ffb9a04175e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-08T06:40:33.341 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 06:40:33 smithi172 ceph-mds[62932]: -- 172.21.15.172:0/3163785936 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5571ef98da40 con 0x5571ef961000 2024-05-08T06:40:33.341 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 06:40:33 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h[62928]: starting mds.h at 2024-05-08T06:40:33.341 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 06:40:33 smithi172 bash[62913]: 52df82662be39d32c01223688200b447c8c927070bd473ed6ba0ffb9a04175e2 2024-05-08T06:40:33.341 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 06:40:33 smithi172 systemd[1]: Started Ceph mds.h for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:33.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:33 smithi070 ceph-mon[29591]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:33.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:33.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:33 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:33.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:33 smithi172 ceph-mon[33377]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:33.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:33.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:33 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:33 smithi194 ceph-mon[33679]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:33.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:33 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:34.459 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:34.459 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:34.459 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:34 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] up:boot 2024-05-08T06:40:34.459 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:34 smithi070 ceph-mon[29591]: fsmap 8 up:standby 2024-05-08T06:40:34.459 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T06:40:34.460 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:34.460 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:34 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:34.460 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:34 smithi070 ceph-mon[29591]: Deploying daemon mds.i on smithi194 2024-05-08T06:40:34.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:34.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:34.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:34 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] up:boot 2024-05-08T06:40:34.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:34 smithi194 ceph-mon[33679]: fsmap 8 up:standby 2024-05-08T06:40:34.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T06:40:34.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:34.606 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:34 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:34.607 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:34 smithi194 ceph-mon[33679]: Deploying daemon mds.i on smithi194 2024-05-08T06:40:34.660 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:34.660 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:34.660 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:34 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] up:boot 2024-05-08T06:40:34.660 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:34 smithi172 ceph-mon[33377]: fsmap 8 up:standby 2024-05-08T06:40:34.660 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T06:40:34.660 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:34.660 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:34 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:34.660 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:34 smithi172 ceph-mon[33377]: Deploying daemon mds.i on smithi194 2024-05-08T06:40:35.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.001+0000 7f5ba3400700 1 -- 172.21.15.70:0/922115489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 msgr2=0x7f5b9c112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:35.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.001+0000 7f5ba3400700 1 --2- 172.21.15.70:0/922115489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 0x7f5b9c112560 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009990 tx=0x7f5b94009ca0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.001+0000 7f5ba3400700 1 -- 172.21.15.70:0/922115489 shutdown_connections 2024-05-08T06:40:35.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.001+0000 7f5ba3400700 1 --2- 172.21.15.70:0/922115489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 0x7f5b9c112560 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.001+0000 7f5ba3400700 1 --2- 172.21.15.70:0/922115489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b9c10b690 0x7f5b9c10ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.001+0000 7f5ba3400700 1 --2- 172.21.15.70:0/922115489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9c105690 0x7f5b9c105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.001+0000 7f5ba3400700 1 -- 172.21.15.70:0/922115489 >> 172.21.15.70:0/922115489 conn(0x7f5b9c101180 msgr2=0x7f5b9c1035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:35.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.001+0000 7f5ba3400700 1 -- 172.21.15.70:0/922115489 shutdown_connections 2024-05-08T06:40:35.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.001+0000 7f5ba3400700 1 -- 172.21.15.70:0/922115489 wait complete. 2024-05-08T06:40:35.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.002+0000 7f5ba3400700 1 Processor -- start 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.002+0000 7f5ba3400700 1 -- start start 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5ba3400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b9c105690 0x7f5b9c1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5ba3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 0x7f5b9c1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5ba3400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9c10b690 0x7f5b9c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5ba3400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c1157d0 con 0x7f5b9c106050 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5ba3400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c115650 con 0x7f5b9c10b690 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5ba3400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c115950 con 0x7f5b9c105690 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5b9be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 0x7f5b9c1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5b9be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 0x7f5b9c1a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42666/0 (socket says 172.21.15.70:42666) 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5b9be00700 1 -- 172.21.15.70:0/1359880466 learned_addr learned my addr 172.21.15.70:0/1359880466 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5ba1400700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9c10b690 0x7f5b9c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:35.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.003+0000 7f5ba0a00700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b9c105690 0x7f5b9c1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:35.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5b9be00700 1 -- 172.21.15.70:0/1359880466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b9c105690 msgr2=0x7f5b9c1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:35.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5b9be00700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b9c105690 0x7f5b9c1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5b9be00700 1 -- 172.21.15.70:0/1359880466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9c10b690 msgr2=0x7f5b9c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:35.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5b9be00700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9c10b690 0x7f5b9c19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5b9be00700 1 -- 172.21.15.70:0/1359880466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c19c230 con 0x7f5b9c106050 2024-05-08T06:40:35.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5b9be00700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 0x7f5b9c1a1e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800c920 tx=0x7f5b8800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:35.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5b99600700 1 -- 172.21.15.70:0/1359880466 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88007b00 con 0x7f5b9c106050 2024-05-08T06:40:35.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c19c520 con 0x7f5b9c106050 2024-05-08T06:40:35.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5b99600700 1 -- 172.21.15.70:0/1359880466 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b88004cc0 con 0x7f5b9c106050 2024-05-08T06:40:35.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5b99600700 1 -- 172.21.15.70:0/1359880466 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b880054a0 con 0x7f5b9c106050 2024-05-08T06:40:35.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.004+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9c1a87e0 con 0x7f5b9c106050 2024-05-08T06:40:35.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.006+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9c06a190 con 0x7f5b9c106050 2024-05-08T06:40:35.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.008+0000 7f5b99600700 1 -- 172.21.15.70:0/1359880466 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5b88004750 con 0x7f5b9c106050 2024-05-08T06:40:35.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.010+0000 7f5b99600700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b840b2900 0x7f5b840b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:35.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.011+0000 7f5b99600700 1 -- 172.21.15.70:0/1359880466 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f5b880e1dc0 con 0x7f5b9c106050 2024-05-08T06:40:35.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.011+0000 7f5ba0a00700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b840b2900 0x7f5b840b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:35.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.012+0000 7f5ba0a00700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b840b2900 0x7f5b840b4dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009f20 tx=0x7f5b900094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:35.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.013+0000 7f5b99600700 1 -- 172.21.15.70:0/1359880466 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5b88014030 con 0x7f5b9c106050 2024-05-08T06:40:35.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.292+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b9c02e510 con 0x7f5b9c106050 2024-05-08T06:40:35.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.293+0000 7f5b99600700 1 -- 172.21.15.70:0/1359880466 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7180 (secure 0 0 0) 0x7f5b880a9f60 con 0x7f5b9c106050 2024-05-08T06:40:35.293 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:35.293 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24397,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34379,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34409,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-08T06:40:35.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.296+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b840b2900 msgr2=0x7f5b840b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:35.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.296+0000 7f5ba3400700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b840b2900 0x7f5b840b4dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009f20 tx=0x7f5b900094f0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.296+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 msgr2=0x7f5b9c1a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:35.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.296+0000 7f5ba3400700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 0x7f5b9c1a1e50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5b8800c920 tx=0x7f5b8800cce0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.297+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 shutdown_connections 2024-05-08T06:40:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.297+0000 7f5ba3400700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5b9c10b690 0x7f5b9c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.297+0000 7f5ba3400700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b9c105690 0x7f5b9c1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.297+0000 7f5ba3400700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5b840b2900 0x7f5b840b4dc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.297+0000 7f5ba3400700 1 --2- 172.21.15.70:0/1359880466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b9c106050 0x7f5b9c1a1e50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.297+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 >> 172.21.15.70:0/1359880466 conn(0x7f5b9c101180 msgr2=0x7f5b9c101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.297+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 shutdown_connections 2024-05-08T06:40:35.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:35.297+0000 7f5ba3400700 1 -- 172.21.15.70:0/1359880466 wait complete. 2024-05-08T06:40:35.298 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 9 2024-05-08T06:40:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:35 smithi194 ceph-mon[33679]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:35.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:35 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1359880466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:35 smithi070 ceph-mon[29591]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:35 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1359880466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:35.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:35 smithi172 ceph-mon[33377]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:35.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:35 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1359880466' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:36.741 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 06:40:36 smithi194 systemd[1]: Starting Ceph mds.i for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:40:37.011 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 06:40:36 smithi194 podman[64995]: 2024-05-08 06:40:36.649959647 +0000 UTC m=+0.042447506 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:40:37.011 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 06:40:36 smithi194 podman[64995]: 2024-05-08 06:40:36.753154397 +0000 UTC m=+0.145642296 container create c832faa498d4e47c8a19eef61634fe40eb1c86b30b5b53a41cd76b9c049b7c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-08T06:40:37.362 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 06:40:37 smithi194 podman[64995]: 2024-05-08 06:40:37.042047401 +0000 UTC m=+0.434535329 container init c832faa498d4e47c8a19eef61634fe40eb1c86b30b5b53a41cd76b9c049b7c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-08T06:40:37.362 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 06:40:37 smithi194 podman[64995]: 2024-05-08 06:40:37.05323693 +0000 UTC m=+0.445724784 container start c832faa498d4e47c8a19eef61634fe40eb1c86b30b5b53a41cd76b9c049b7c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-08T06:40:37.362 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 06:40:37 smithi194 ceph-mds[65014]: -- 172.21.15.194:0/3036453126 <== mon.1 v2:172.21.15.194:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55be1376fa40 con 0x55be13743000 2024-05-08T06:40:37.362 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 06:40:37 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i[65010]: starting mds.i at 2024-05-08T06:40:37.362 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 06:40:37 smithi194 bash[64995]: c832faa498d4e47c8a19eef61634fe40eb1c86b30b5b53a41cd76b9c049b7c6e 2024-05-08T06:40:37.362 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 06:40:37 smithi194 systemd[1]: Started Ceph mds.i for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:37 smithi070 ceph-mon[29591]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:37 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:37 smithi172 ceph-mon[33377]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:37.742 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:37.742 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:37.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:37.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:37.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:37.743 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:37 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:37 smithi194 ceph-mon[33679]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:37 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:38.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:40:38.548 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:38 smithi070 ceph-mon[29591]: Deploying daemon mds.g on smithi070 2024-05-08T06:40:38.548 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:38 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.194:6838/622098707,v1:172.21.15.194:6839/622098707] up:boot 2024-05-08T06:40:38.548 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:38 smithi070 ceph-mon[29591]: fsmap 9 up:standby 2024-05-08T06:40:38.548 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:38 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T06:40:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:38 smithi172 ceph-mon[33377]: Deploying daemon mds.g on smithi070 2024-05-08T06:40:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:38 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.194:6838/622098707,v1:172.21.15.194:6839/622098707] up:boot 2024-05-08T06:40:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:38 smithi172 ceph-mon[33377]: fsmap 9 up:standby 2024-05-08T06:40:38.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:38 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T06:40:38.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:38 smithi194 ceph-mon[33679]: Deploying daemon mds.g on smithi070 2024-05-08T06:40:38.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:38 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.194:6838/622098707,v1:172.21.15.194:6839/622098707] up:boot 2024-05-08T06:40:38.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:38 smithi194 ceph-mon[33679]: fsmap 9 up:standby 2024-05-08T06:40:38.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:38 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T06:40:39.547 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:39 smithi070 ceph-mon[29591]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:39.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:39 smithi172 ceph-mon[33377]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:39.711 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:39 smithi194 ceph-mon[33679]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:40.629 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 06:40:40 smithi070 systemd[1]: Starting Ceph mds.g for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:40:41.352 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 06:40:41 smithi070 podman[70690]: 2024-05-08 06:40:41.18534309 +0000 UTC m=+0.052415038 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:40:41.352 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 06:40:41 smithi070 podman[70690]: 2024-05-08 06:40:41.351692268 +0000 UTC m=+0.218764232 container create 47a74fa6473f00d04895ebc7ab20400683f2a8cbbb49f1d6c899af48cb968f0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD) 2024-05-08T06:40:41.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:41 smithi070 ceph-mon[29591]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:41.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:41 smithi172 ceph-mon[33377]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:41.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:41 smithi194 ceph-mon[33679]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:42.075 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 06:40:41 smithi070 podman[70690]: 2024-05-08 06:40:41.858022843 +0000 UTC m=+0.725094770 container init 47a74fa6473f00d04895ebc7ab20400683f2a8cbbb49f1d6c899af48cb968f0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-08T06:40:42.076 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 06:40:41 smithi070 podman[70690]: 2024-05-08 06:40:41.867879407 +0000 UTC m=+0.734951381 container start 47a74fa6473f00d04895ebc7ab20400683f2a8cbbb49f1d6c899af48cb968f0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-08T06:40:42.076 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 06:40:41 smithi070 ceph-mds[70731]: -- 172.21.15.70:0/1405101240 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556686cd3a40 con 0x556686ca7000 2024-05-08T06:40:42.076 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 06:40:41 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g[70722]: starting mds.g at 2024-05-08T06:40:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.130+0000 7f1d7ec00700 1 -- 172.21.15.70:0/57788443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 msgr2=0x7f1d7810fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.130+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/57788443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 0x7f1d7810fa10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009990 tx=0x7f1d64009ca0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.130+0000 7f1d7ec00700 1 -- 172.21.15.70:0/57788443 shutdown_connections 2024-05-08T06:40:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.130+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/57788443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7810ff50 0x7f1d78112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.130+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/57788443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7806b1b0 0x7f1d7806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.130+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/57788443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 0x7f1d7810fa10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.130+0000 7f1d7ec00700 1 -- 172.21.15.70:0/57788443 >> 172.21.15.70:0/57788443 conn(0x7f1d78079350 msgr2=0x7f1d78079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.131+0000 7f1d7ec00700 1 -- 172.21.15.70:0/57788443 shutdown_connections 2024-05-08T06:40:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.131+0000 7f1d7ec00700 1 -- 172.21.15.70:0/57788443 wait complete. 2024-05-08T06:40:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.132+0000 7f1d7ec00700 1 Processor -- start 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.132+0000 7f1d7ec00700 1 -- start start 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d7ec00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7806b1b0 0x7f1d781a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d7ec00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 0x7f1d781a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d7ec00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7810ff50 0x7f1d7819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d7ec00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d78115760 con 0x7f1d7806bad0 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d7ec00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d781155e0 con 0x7f1d7806b1b0 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d7ec00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d781158e0 con 0x7f1d7810ff50 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d77400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 0x7f1d781a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d77400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 0x7f1d781a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47942/0 (socket says 172.21.15.70:47942) 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d77400700 1 -- 172.21.15.70:0/2822089230 learned_addr learned my addr 172.21.15.70:0/2822089230 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d77e00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7806b1b0 0x7f1d781a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.133+0000 7f1d7cc00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7810ff50 0x7f1d7819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d77400700 1 -- 172.21.15.70:0/2822089230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7810ff50 msgr2=0x7f1d7819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d77400700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7810ff50 0x7f1d7819baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d77400700 1 -- 172.21.15.70:0/2822089230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7806b1b0 msgr2=0x7f1d781a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d77400700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7806b1b0 0x7f1d781a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d77400700 1 -- 172.21.15.70:0/2822089230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7819c200 con 0x7f1d7806bad0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d77400700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 0x7f1d781a1e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d64000c00 tx=0x7f1d640036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d74c00700 1 -- 172.21.15.70:0/2822089230 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64027070 con 0x7f1d7806bad0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d74c00700 1 -- 172.21.15.70:0/2822089230 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d6400fc80 con 0x7f1d7806bad0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d74c00700 1 -- 172.21.15.70:0/2822089230 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d64022d60 con 0x7f1d7806bad0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.134+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7819c490 con 0x7f1d7806bad0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.135+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d781a87b0 con 0x7f1d7806bad0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.136+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7806a190 con 0x7f1d7806bad0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.141+0000 7f1d74c00700 1 -- 172.21.15.70:0/2822089230 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1d6402a070 con 0x7f1d7806bad0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.143+0000 7f1d74c00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1d5c0b2900 0x7f1d5c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.143+0000 7f1d74c00700 1 -- 172.21.15.70:0/2822089230 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f1d640e29f0 con 0x7f1d7806bad0 2024-05-08T06:40:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.143+0000 7f1d77e00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1d5c0b2900 0x7f1d5c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.144+0000 7f1d77e00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1d5c0b2900 0x7f1d5c0b4dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d68005ea0 tx=0x7f1d68005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.149+0000 7f1d74c00700 1 -- 172.21.15.70:0/2822089230 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1d640e4e20 con 0x7f1d7806bad0 2024-05-08T06:40:42.378 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 06:40:42 smithi070 bash[70690]: 47a74fa6473f00d04895ebc7ab20400683f2a8cbbb49f1d6c899af48cb968f0d 2024-05-08T06:40:42.378 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 06:40:42 smithi070 systemd[1]: Started Ceph mds.g for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:42.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.449+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d7802e510 con 0x7f1d7806bad0 2024-05-08T06:40:42.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.450+0000 7f1d74c00700 1 -- 172.21.15.70:0/2822089230 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8833 (secure 0 0 0) 0x7f1d64013070 con 0x7f1d7806bad0 2024-05-08T06:40:42.449 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:42.450 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24397,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24409,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34379,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34409,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-08T06:40:42.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.454+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1d5c0b2900 msgr2=0x7f1d5c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:42.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.454+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1d5c0b2900 0x7f1d5c0b4dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1d68005ea0 tx=0x7f1d68005e30 comp rx=0 tx=0).stop 2024-05-08T06:40:42.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.454+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 msgr2=0x7f1d781a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.454+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 0x7f1d781a1e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1d64000c00 tx=0x7f1d640036f0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.455+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 shutdown_connections 2024-05-08T06:40:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.455+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7810ff50 0x7f1d7819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.455+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7806b1b0 0x7f1d781a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.455+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1d5c0b2900 0x7f1d5c0b4dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.455+0000 7f1d7ec00700 1 --2- 172.21.15.70:0/2822089230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7806bad0 0x7f1d781a1e20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.455+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 >> 172.21.15.70:0/2822089230 conn(0x7f1d78079350 msgr2=0x7f1d78111420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.455+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 shutdown_connections 2024-05-08T06:40:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:42.455+0000 7f1d7ec00700 1 -- 172.21.15.70:0/2822089230 wait complete. 2024-05-08T06:40:42.456 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 11 2024-05-08T06:40:43.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:43.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:43.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:43.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:43.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:43.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:43.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:43.453 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: Deploying daemon mds.a on smithi070 2024-05-08T06:40:43.453 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.70:6838/1788340379,v1:172.21.15.70:6839/1788340379] up:boot 2024-05-08T06:40:43.453 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: fsmap 10 up:standby 2024-05-08T06:40:43.453 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T06:40:43.453 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:43 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2822089230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:43.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:43.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:43.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: Deploying daemon mds.a on smithi070 2024-05-08T06:40:43.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.70:6838/1788340379,v1:172.21.15.70:6839/1788340379] up:boot 2024-05-08T06:40:43.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: fsmap 10 up:standby 2024-05-08T06:40:43.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T06:40:43.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:43 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2822089230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: Deploying daemon mds.a on smithi070 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.70:6838/1788340379,v1:172.21.15.70:6839/1788340379] up:boot 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: fsmap 10 up:standby 2024-05-08T06:40:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T06:40:43.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:43 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2822089230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:45.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:40:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:45 smithi194 ceph-mon[33679]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:45.589 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:45 smithi070 ceph-mon[29591]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:45 smithi172 ceph-mon[33377]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:45.879 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 06:40:45 smithi070 systemd[1]: Starting Ceph mds.a for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T06:40:46.325 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 06:40:46 smithi070 podman[71092]: 2024-05-08 06:40:45.911364117 +0000 UTC m=+0.037571512 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:40:46.325 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 06:40:46 smithi070 podman[71092]: 2024-05-08 06:40:46.043954483 +0000 UTC m=+0.170161914 container create 81b92b14b79a557a73c5eb6dbf2128eb7f20db4740949dd9e5fe36995b1398f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=) 2024-05-08T06:40:46.325 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 06:40:46 smithi070 podman[71092]: 2024-05-08 06:40:46.324582709 +0000 UTC m=+0.450790180 container init 81b92b14b79a557a73c5eb6dbf2128eb7f20db4740949dd9e5fe36995b1398f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-08T06:40:46.473 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:46.629 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 06:40:46 smithi070 podman[71092]: 2024-05-08 06:40:46.337232787 +0000 UTC m=+0.463440228 container start 81b92b14b79a557a73c5eb6dbf2128eb7f20db4740949dd9e5fe36995b1398f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD) 2024-05-08T06:40:46.629 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 06:40:46 smithi070 ceph-mds[71131]: -- 172.21.15.70:0/2700767377 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5599b9251a40 con 0x5599b9224800 2024-05-08T06:40:46.629 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 06:40:46 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a[71127]: starting mds.a at 2024-05-08T06:40:46.629 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 06:40:46 smithi070 bash[71092]: 81b92b14b79a557a73c5eb6dbf2128eb7f20db4740949dd9e5fe36995b1398f3 2024-05-08T06:40:46.629 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 06:40:46 smithi070 systemd[1]: Started Ceph mds.a for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:47.815 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: Deploying daemon mds.b on smithi172 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.70:6840/3780132216,v1:172.21.15.70:6841/3780132216] up:boot 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: fsmap 11 up:standby 2024-05-08T06:40:47.816 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:47 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: Deploying daemon mds.b on smithi172 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.70:6840/3780132216,v1:172.21.15.70:6841/3780132216] up:boot 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: fsmap 11 up:standby 2024-05-08T06:40:47.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:47 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T06:40:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T06:40:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T06:40:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: Deploying daemon mds.b on smithi172 2024-05-08T06:40:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.70:6840/3780132216,v1:172.21.15.70:6841/3780132216] up:boot 2024-05-08T06:40:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: fsmap 11 up:standby 2024-05-08T06:40:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:47 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T06:40:48.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.866+0000 7f5f62a00700 1 -- 172.21.15.70:0/1813942338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 msgr2=0x7f5f5c1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:48.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.866+0000 7f5f62a00700 1 --2- 172.21.15.70:0/1813942338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 0x7f5f5c1103d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400b0a0 tx=0x7f5f5400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:40:48.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.866+0000 7f5f62a00700 1 -- 172.21.15.70:0/1813942338 shutdown_connections 2024-05-08T06:40:48.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.866+0000 7f5f62a00700 1 --2- 172.21.15.70:0/1813942338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 0x7f5f5c1103d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:48.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.866+0000 7f5f62a00700 1 --2- 172.21.15.70:0/1813942338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f5c108460 0x7f5f5c108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:48.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.866+0000 7f5f62a00700 1 --2- 172.21.15.70:0/1813942338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f5c103550 0x7f5f5c1039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:48.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.866+0000 7f5f62a00700 1 -- 172.21.15.70:0/1813942338 >> 172.21.15.70:0/1813942338 conn(0x7f5f5c07a600 msgr2=0x7f5f5c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:48.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.866+0000 7f5f62a00700 1 -- 172.21.15.70:0/1813942338 shutdown_connections 2024-05-08T06:40:48.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.866+0000 7f5f62a00700 1 -- 172.21.15.70:0/1813942338 wait complete. 2024-05-08T06:40:48.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.867+0000 7f5f62a00700 1 Processor -- start 2024-05-08T06:40:48.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f62a00700 1 -- start start 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f62a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f5c103550 0x7f5f5c1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f62a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 0x7f5f5c1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f62a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f5c108460 0x7f5f5c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f62a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1135c0 con 0x7f5f5c103ef0 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f62a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c113440 con 0x7f5f5c103550 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f62a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c113740 con 0x7f5f5c108460 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f53400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 0x7f5f5c1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f53400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 0x7f5f5c1a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56208/0 (socket says 172.21.15.70:56208) 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.868+0000 7f5f53400700 1 -- 172.21.15.70:0/984545264 learned_addr learned my addr 172.21.15.70:0/984545264 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:48.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.869+0000 7f5f5be00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f5c103550 0x7f5f5c1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.869+0000 7f5f60a00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f5c108460 0x7f5f5c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.869+0000 7f5f53400700 1 -- 172.21.15.70:0/984545264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f5c108460 msgr2=0x7f5f5c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.869+0000 7f5f53400700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f5c108460 0x7f5f5c19bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.869+0000 7f5f53400700 1 -- 172.21.15.70:0/984545264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f5c103550 msgr2=0x7f5f5c1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.869+0000 7f5f53400700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f5c103550 0x7f5f5c1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.869+0000 7f5f53400700 1 -- 172.21.15.70:0/984545264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c19c230 con 0x7f5f5c103ef0 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.869+0000 7f5f53400700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 0x7f5f5c1a1e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400d980 tx=0x7f5f4400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.870+0000 7f5f59600700 1 -- 172.21.15.70:0/984545264 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f44017070 con 0x7f5f5c103ef0 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.870+0000 7f5f59600700 1 -- 172.21.15.70:0/984545264 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f44004830 con 0x7f5f5c103ef0 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.870+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5c19c4c0 con 0x7f5f5c103ef0 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.870+0000 7f5f59600700 1 -- 172.21.15.70:0/984545264 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f440053a0 con 0x7f5f5c103ef0 2024-05-08T06:40:48.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.870+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5c1a87e0 con 0x7f5f5c103ef0 2024-05-08T06:40:48.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.871+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f5c06a190 con 0x7f5f5c103ef0 2024-05-08T06:40:48.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.873+0000 7f5f59600700 1 -- 172.21.15.70:0/984545264 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5f440049e0 con 0x7f5f5c103ef0 2024-05-08T06:40:48.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.875+0000 7f5f59600700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f400b2980 0x7f5f400b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:48.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.875+0000 7f5f59600700 1 -- 172.21.15.70:0/984545264 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f5f440e2130 con 0x7f5f5c103ef0 2024-05-08T06:40:48.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.875+0000 7f5f5be00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f400b2980 0x7f5f400b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:48.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.876+0000 7f5f5be00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f400b2980 0x7f5f400b4e40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c005950 tx=0x7f5f4c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:48.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:48.877+0000 7f5f59600700 1 -- 172.21.15.70:0/984545264 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5f44020020 con 0x7f5f5c103ef0 2024-05-08T06:40:49.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.157+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f5c1a89b0 con 0x7f5f5c103ef0 2024-05-08T06:40:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.159+0000 7f5f59600700 1 -- 172.21.15.70:0/984545264 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9659 (secure 0 0 0) 0x7f5f440aa2d0 con 0x7f5f5c103ef0 2024-05-08T06:40:49.159 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:49.159 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24397,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24409,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34379,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34409,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-08T06:40:49.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f400b2980 msgr2=0x7f5f400b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:49.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f400b2980 0x7f5f400b4e40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c005950 tx=0x7f5f4c0058e0 comp rx=0 tx=0).stop 2024-05-08T06:40:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 msgr2=0x7f5f5c1a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 0x7f5f5c1a1e50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5f4400d980 tx=0x7f5f4400dd40 comp rx=0 tx=0).stop 2024-05-08T06:40:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 shutdown_connections 2024-05-08T06:40:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f5c108460 0x7f5f5c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f5c103550 0x7f5f5c1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:49.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f400b2980 0x7f5f400b4e40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:49.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 --2- 172.21.15.70:0/984545264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f5c103ef0 0x7f5f5c1a1e50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:49.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 >> 172.21.15.70:0/984545264 conn(0x7f5f5c07a600 msgr2=0x7f5f5c1013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:49.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 shutdown_connections 2024-05-08T06:40:49.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:49.162+0000 7f5f62a00700 1 -- 172.21.15.70:0/984545264 wait complete. 2024-05-08T06:40:49.163 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 12 2024-05-08T06:40:49.841 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:49 smithi070 ceph-mon[29591]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:49.841 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:49 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/984545264' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:49.888 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:49 smithi172 ceph-mon[33377]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:49.888 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:49 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/984545264' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:50.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:49 smithi194 ceph-mon[33679]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:50.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:49 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/984545264' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:50.551 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:40:50 smithi172 podman[63230]: 2024-05-08 06:40:50.280967398 +0000 UTC m=+0.157042664 container create ec1d4a357875c755a5c36d658ab2c75f3aad2601a683a1f9ffadc17de6460231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-08T06:40:50.551 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:40:50 smithi172 podman[63230]: 2024-05-08 06:40:50.551595261 +0000 UTC m=+0.427670510 container init ec1d4a357875c755a5c36d658ab2c75f3aad2601a683a1f9ffadc17de6460231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-08T06:40:50.929 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:40:50 smithi172 podman[63230]: 2024-05-08 06:40:50.560803599 +0000 UTC m=+0.436878814 container start ec1d4a357875c755a5c36d658ab2c75f3aad2601a683a1f9ffadc17de6460231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-08T06:40:50.930 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:40:50 smithi172 ceph-mds[63256]: -- 172.21.15.172:0/2280066422 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d47e5c1a40 con 0x55d47e595000 2024-05-08T06:40:50.930 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:40:50 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b[63250]: starting mds.b at 2024-05-08T06:40:50.930 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:40:50 smithi172 bash[63230]: ec1d4a357875c755a5c36d658ab2c75f3aad2601a683a1f9ffadc17de6460231 2024-05-08T06:40:50.930 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:40:50 smithi172 systemd[1]: Started Ceph mds.b for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T06:40:52.045 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:40:52.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:52.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:40:52.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] up:boot 2024-05-08T06:40:52.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: fsmap 12 up:standby 2024-05-08T06:40:52.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:51 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T06:40:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:40:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] up:boot 2024-05-08T06:40:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: fsmap 12 up:standby 2024-05-08T06:40:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:51 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T06:40:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:40:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] up:boot 2024-05-08T06:40:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: fsmap 12 up:standby 2024-05-08T06:40:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:51 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T06:40:53.303 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:53 smithi070 ceph-mon[29591]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:53 smithi172 ceph-mon[33377]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:53 smithi194 ceph-mon[33679]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:55.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:55 smithi070 ceph-mon[29591]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:55.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:55 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:55 smithi172 ceph-mon[33377]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:55.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:55 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.486+0000 7f5e68200700 1 -- 172.21.15.70:0/1389995974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e6010b690 msgr2=0x7f5e6010ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.486+0000 7f5e68200700 1 --2- 172.21.15.70:0/1389995974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e6010b690 0x7f5e6010ba70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009990 tx=0x7f5e54009ca0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.486+0000 7f5e68200700 1 -- 172.21.15.70:0/1389995974 shutdown_connections 2024-05-08T06:40:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.486+0000 7f5e68200700 1 --2- 172.21.15.70:0/1389995974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e60106050 0x7f5e60112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.486+0000 7f5e68200700 1 --2- 172.21.15.70:0/1389995974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e6010b690 0x7f5e6010ba70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.486+0000 7f5e68200700 1 --2- 172.21.15.70:0/1389995974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e60105690 0x7f5e60105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.486+0000 7f5e68200700 1 -- 172.21.15.70:0/1389995974 >> 172.21.15.70:0/1389995974 conn(0x7f5e60101180 msgr2=0x7f5e601035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.486+0000 7f5e68200700 1 -- 172.21.15.70:0/1389995974 shutdown_connections 2024-05-08T06:40:55.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.486+0000 7f5e68200700 1 -- 172.21.15.70:0/1389995974 wait complete. 2024-05-08T06:40:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.487+0000 7f5e68200700 1 Processor -- start 2024-05-08T06:40:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.488+0000 7f5e68200700 1 -- start start 2024-05-08T06:40:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.488+0000 7f5e68200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e60105690 0x7f5e601a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.488+0000 7f5e68200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e60106050 0x7f5e601a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.488+0000 7f5e68200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e6010b690 0x7f5e6019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.488+0000 7f5e68200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60115790 con 0x7f5e60105690 2024-05-08T06:40:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.488+0000 7f5e68200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60115610 con 0x7f5e60106050 2024-05-08T06:40:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.488+0000 7f5e68200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5e60115910 con 0x7f5e6010b690 2024-05-08T06:40:55.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.488+0000 7f5e65800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e60105690 0x7f5e601a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:55.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.488+0000 7f5e65800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e60105690 0x7f5e601a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56216/0 (socket says 172.21.15.70:56216) 2024-05-08T06:40:55.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e65800700 1 -- 172.21.15.70:0/3880929275 learned_addr learned my addr 172.21.15.70:0/3880929275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:55.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e64e00700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e60106050 0x7f5e601a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e66200700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e6010b690 0x7f5e6019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e65800700 1 -- 172.21.15.70:0/3880929275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e6010b690 msgr2=0x7f5e6019baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e65800700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e6010b690 0x7f5e6019baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e65800700 1 -- 172.21.15.70:0/3880929275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e60106050 msgr2=0x7f5e601a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e65800700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e60106050 0x7f5e601a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e65800700 1 -- 172.21.15.70:0/3880929275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6019c250 con 0x7f5e60105690 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e66200700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e6010b690 0x7f5e6019baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.489+0000 7f5e64e00700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e60106050 0x7f5e601a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.490+0000 7f5e65800700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e60105690 0x7f5e601a1930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e54005910 tx=0x7f5e54009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.490+0000 7f5e5e000700 1 -- 172.21.15.70:0/3880929275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e54027070 con 0x7f5e60105690 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.490+0000 7f5e5e000700 1 -- 172.21.15.70:0/3880929275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e5400fce0 con 0x7f5e60105690 2024-05-08T06:40:55.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.490+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6019c4e0 con 0x7f5e60105690 2024-05-08T06:40:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.490+0000 7f5e5e000700 1 -- 172.21.15.70:0/3880929275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e540173f0 con 0x7f5e60105690 2024-05-08T06:40:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.490+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e601a8800 con 0x7f5e60105690 2024-05-08T06:40:55.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.492+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e6006a190 con 0x7f5e60105690 2024-05-08T06:40:55.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.494+0000 7f5e5e000700 1 -- 172.21.15.70:0/3880929275 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5e5402a070 con 0x7f5e60105690 2024-05-08T06:40:55.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.496+0000 7f5e5e000700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5e480b2880 0x7f5e480b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:55.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.496+0000 7f5e5e000700 1 -- 172.21.15.70:0/3880929275 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f5e540e2eb0 con 0x7f5e60105690 2024-05-08T06:40:55.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.496+0000 7f5e64e00700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5e480b2880 0x7f5e480b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:55.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.497+0000 7f5e64e00700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5e480b2880 0x7f5e480b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5e601038a0 tx=0x7f5e4c005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:55.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.501+0000 7f5e5e000700 1 -- 172.21.15.70:0/3880929275 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5e5405fdf0 con 0x7f5e60105690 2024-05-08T06:40:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:55 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:55 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:55 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:55 smithi194 ceph-mon[33679]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:55.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:55 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:55 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:55.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.789+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e6002e510 con 0x7f5e60105690 2024-05-08T06:40:55.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.790+0000 7f5e5e000700 1 -- 172.21.15.70:0/3880929275 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10485 (secure 0 0 0) 0x7f5e54013070 con 0x7f5e60105690 2024-05-08T06:40:55.788 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:55.788 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24397,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24409,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34379,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34409,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34442,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-08T06:40:55.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5e480b2880 msgr2=0x7f5e480b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:55.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5e480b2880 0x7f5e480b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5e601038a0 tx=0x7f5e4c005f50 comp rx=0 tx=0).stop 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e60105690 msgr2=0x7f5e601a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e60105690 0x7f5e601a1930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5e54005910 tx=0x7f5e54009f90 comp rx=0 tx=0).stop 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 shutdown_connections 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e6010b690 0x7f5e6019baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5e480b2880 0x7f5e480b4d40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5e60105690 0x7f5e601a1930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 --2- 172.21.15.70:0/3880929275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5e60106050 0x7f5e601a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 >> 172.21.15.70:0/3880929275 conn(0x7f5e60101180 msgr2=0x7f5e60101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 shutdown_connections 2024-05-08T06:40:55.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:55.793+0000 7f5e68200700 1 -- 172.21.15.70:0/3880929275 wait complete. 2024-05-08T06:40:55.793 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 13 2024-05-08T06:40:56.671 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-08T06:40:56.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:56 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:56.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:56 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:56.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:56 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3880929275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:56 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:56 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3880929275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:56 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:56 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3880929275' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:40:57.116 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:40:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:57 smithi172 ceph-mon[33377]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:40:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:57 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:40:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:57 smithi194 ceph-mon[33679]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:40:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:57 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:40:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:57 smithi070 ceph-mon[29591]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:40:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:40:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:40:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:57 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:40:59.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.469+0000 7fda0d800700 1 -- 172.21.15.70:0/4021131040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 msgr2=0x7fda08108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:59.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.469+0000 7fda0d800700 1 --2- 172.21.15.70:0/4021131040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 0x7fda08108120 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00099c0 tx=0x7fd9f0009cd0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.469+0000 7fda0d800700 1 -- 172.21.15.70:0/4021131040 shutdown_connections 2024-05-08T06:40:59.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.469+0000 7fda0d800700 1 --2- 172.21.15.70:0/4021131040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda08108850 0x7fda081103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.469+0000 7fda0d800700 1 --2- 172.21.15.70:0/4021131040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda08103750 0x7fda08103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.469+0000 7fda0d800700 1 --2- 172.21.15.70:0/4021131040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 0x7fda08108120 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.469+0000 7fda0d800700 1 -- 172.21.15.70:0/4021131040 >> 172.21.15.70:0/4021131040 conn(0x7fda0807a600 msgr2=0x7fda0807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:59.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.470+0000 7fda0d800700 1 -- 172.21.15.70:0/4021131040 shutdown_connections 2024-05-08T06:40:59.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.470+0000 7fda0d800700 1 -- 172.21.15.70:0/4021131040 wait complete. 2024-05-08T06:40:59.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.471+0000 7fda0d800700 1 Processor -- start 2024-05-08T06:40:59.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.471+0000 7fda0d800700 1 -- start start 2024-05-08T06:40:59.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fda0d800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda08103750 0x7fda0819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:59.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fda0d800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 0x7fda0819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:59.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fda0d800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda08108850 0x7fda081997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:59.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fda0d800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda08113510 con 0x7fda08104100 2024-05-08T06:40:59.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fda0d800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda08113390 con 0x7fda08103750 2024-05-08T06:40:59.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fda0d800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fda08113690 con 0x7fda08108850 2024-05-08T06:40:59.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fd9fe000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 0x7fda0819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fd9fe000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 0x7fda0819fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41114/0 (socket says 172.21.15.70:41114) 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fd9fe000700 1 -- 172.21.15.70:0/3722811546 learned_addr learned my addr 172.21.15.70:0/3722811546 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.472+0000 7fda07400700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda08108850 0x7fda081997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fda06a00700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda08103750 0x7fda0819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fd9fe000700 1 -- 172.21.15.70:0/3722811546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda08108850 msgr2=0x7fda081997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fd9fe000700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda08108850 0x7fda081997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fd9fe000700 1 -- 172.21.15.70:0/3722811546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda08103750 msgr2=0x7fda0819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fd9fe000700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda08103750 0x7fda0819f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fd9fe000700 1 -- 172.21.15.70:0/3722811546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda08199fb0 con 0x7fda08104100 2024-05-08T06:40:59.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fd9fe000700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 0x7fda0819fb90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0005910 tx=0x7fd9f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:59.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fd9ffe00700 1 -- 172.21.15.70:0/3722811546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0026070 con 0x7fda08104100 2024-05-08T06:40:59.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fd9ffe00700 1 -- 172.21.15.70:0/3722811546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd9f000f460 con 0x7fda08104100 2024-05-08T06:40:59.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0819a240 con 0x7fda08104100 2024-05-08T06:40:59.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fd9ffe00700 1 -- 172.21.15.70:0/3722811546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0009e60 con 0x7fda08104100 2024-05-08T06:40:59.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.473+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda081a64b0 con 0x7fda08104100 2024-05-08T06:40:59.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.475+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda08104be0 con 0x7fda08104100 2024-05-08T06:40:59.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.477+0000 7fd9ffe00700 1 -- 172.21.15.70:0/3722811546 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd9f0029070 con 0x7fda08104100 2024-05-08T06:40:59.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.478+0000 7fd9ffe00700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9ec0b2900 0x7fd9ec0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:40:59.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.479+0000 7fd9ffe00700 1 -- 172.21.15.70:0/3722811546 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7fd9f00e2840 con 0x7fda08104100 2024-05-08T06:40:59.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.479+0000 7fda06a00700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9ec0b2900 0x7fd9ec0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:40:59.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.479+0000 7fda06a00700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9ec0b2900 0x7fd9ec0b4dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009bf0 tx=0x7fd9f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:40:59.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.481+0000 7fd9ffe00700 1 -- 172.21.15.70:0/3722811546 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd9f0030080 con 0x7fda08104100 2024-05-08T06:40:59.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.718+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fda0802e510 con 0x7fda08104100 2024-05-08T06:40:59.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:40:59 smithi070 ceph-mon[29591]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:40:59.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.719+0000 7fd9ffe00700 1 -- 172.21.15.70:0/3722811546 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v74) ==== 84+0+65 (secure 0 0 0) 0x7fd9f0013070 con 0x7fda08104100 2024-05-08T06:40:59.719 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:40:59.719 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2024-05-08T06:40:59.719 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T06:40:59.719 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2024-05-08T06:40:59.719 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2024-05-08T06:40:59.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:40:59.719 INFO:teuthology.orchestra.run.smithi070.stdout:] 2024-05-08T06:40:59.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9ec0b2900 msgr2=0x7fd9ec0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:59.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9ec0b2900 0x7fd9ec0b4dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009bf0 tx=0x7fd9f8009260 comp rx=0 tx=0).stop 2024-05-08T06:40:59.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 msgr2=0x7fda0819fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:40:59.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 0x7fda0819fb90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0005910 tx=0x7fd9f00045e0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 shutdown_connections 2024-05-08T06:40:59.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda08108850 0x7fda081997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda08103750 0x7fda0819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd9ec0b2900 0x7fd9ec0b4dc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 --2- 172.21.15.70:0/3722811546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda08104100 0x7fda0819fb90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:40:59.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 >> 172.21.15.70:0/3722811546 conn(0x7fda0807a600 msgr2=0x7fda08101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:40:59.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 shutdown_connections 2024-05-08T06:40:59.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:40:59.723+0000 7fda0d800700 1 -- 172.21.15.70:0/3722811546 wait complete. 2024-05-08T06:40:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:40:59 smithi172 ceph-mon[33377]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:00.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:40:59 smithi194 ceph-mon[33679]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:00.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:00 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3722811546' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T06:41:00.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:00.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:00.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:00.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:00 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:00.950 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:00 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3722811546' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T06:41:00.950 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:00.950 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:00.950 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:00.951 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:00 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:00.953 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T06:41:00.954 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T06:41:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:00 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3722811546' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T06:41:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:00 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:01.411 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:01 smithi070 ceph-mon[29591]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:01 smithi172 ceph-mon[33377]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:02.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:01 smithi194 ceph-mon[33679]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:03.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:03 smithi070 ceph-mon[29591]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:03.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:03.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:03.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:41:03.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:41:03.507 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:03.732 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:03 smithi172 ceph-mon[33377]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:03.733 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:03.733 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:03.733 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:41:03.733 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:41:03.733 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:03 smithi194 ceph-mon[33679]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:03.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:03.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:03.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:41:03.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:41:03.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:41:03.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.792+0000 7f92aea00700 1 -- 172.21.15.70:0/3290467067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 msgr2=0x7f92a8112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:03.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.792+0000 7f92aea00700 1 --2- 172.21.15.70:0/3290467067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 0x7f92a8112080 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b0a0 tx=0x7f92a000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:41:03.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.792+0000 7f92aea00700 1 -- 172.21.15.70:0/3290467067 shutdown_connections 2024-05-08T06:41:03.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.792+0000 7f92aea00700 1 --2- 172.21.15.70:0/3290467067 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 0x7f92a8112080 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:03.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.792+0000 7f92aea00700 1 --2- 172.21.15.70:0/3290467067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a80758d0 0x7f92a8075cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:03.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.792+0000 7f92aea00700 1 --2- 172.21.15.70:0/3290467067 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92a80761f0 0x7f92a810f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:03.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.792+0000 7f92aea00700 1 -- 172.21.15.70:0/3290467067 >> 172.21.15.70:0/3290467067 conn(0x7f92a80fef20 msgr2=0x7f92a8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:03.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.792+0000 7f92aea00700 1 -- 172.21.15.70:0/3290467067 shutdown_connections 2024-05-08T06:41:03.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.792+0000 7f92aea00700 1 -- 172.21.15.70:0/3290467067 wait complete. 2024-05-08T06:41:03.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.793+0000 7f92aea00700 1 Processor -- start 2024-05-08T06:41:03.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92aea00700 1 -- start start 2024-05-08T06:41:03.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92aea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92a80758d0 0x7f92a81a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:03.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92aea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a80761f0 0x7f92a81a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:03.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92aea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 0x7f92a819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92aea00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8115690 con 0x7f92a810fc10 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92aea00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8115510 con 0x7f92a80758d0 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92aea00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8115810 con 0x7f92a80761f0 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92ae000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 0x7f92a819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92ae000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 0x7f92a819b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41124/0 (socket says 172.21.15.70:41124) 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.794+0000 7f92ae000700 1 -- 172.21.15.70:0/2144479650 learned_addr learned my addr 172.21.15.70:0/2144479650 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.795+0000 7f92acc00700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a80761f0 0x7f92a81a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.795+0000 7f92ad600700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92a80758d0 0x7f92a81a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.795+0000 7f92ae000700 1 -- 172.21.15.70:0/2144479650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a80761f0 msgr2=0x7f92a81a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.795+0000 7f92ae000700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a80761f0 0x7f92a81a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.795+0000 7f92ae000700 1 -- 172.21.15.70:0/2144479650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92a80758d0 msgr2=0x7f92a81a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.795+0000 7f92ae000700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92a80758d0 0x7f92a81a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.795+0000 7f92ae000700 1 -- 172.21.15.70:0/2144479650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a819c110 con 0x7f92a810fc10 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.795+0000 7f92ae000700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 0x7f92a819b9b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b070 tx=0x7f92a0004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:03.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.796+0000 7f92a6000700 1 -- 172.21.15.70:0/2144479650 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0021070 con 0x7f92a810fc10 2024-05-08T06:41:03.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.796+0000 7f92a6000700 1 -- 172.21.15.70:0/2144479650 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92a0007c00 con 0x7f92a810fc10 2024-05-08T06:41:03.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.796+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a819c3a0 con 0x7f92a810fc10 2024-05-08T06:41:03.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.796+0000 7f92a6000700 1 -- 172.21.15.70:0/2144479650 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0004860 con 0x7f92a810fc10 2024-05-08T06:41:03.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.796+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a81a86c0 con 0x7f92a810fc10 2024-05-08T06:41:03.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.797+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a8076f80 con 0x7f92a810fc10 2024-05-08T06:41:03.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.799+0000 7f92a6000700 1 -- 172.21.15.70:0/2144479650 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f92a0003fb0 con 0x7f92a810fc10 2024-05-08T06:41:03.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.801+0000 7f92a6000700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92900b2900 0x7f92900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:03.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.801+0000 7f92a6000700 1 -- 172.21.15.70:0/2144479650 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7127+0+0 (secure 0 0 0) 0x7f92a000f020 con 0x7f92a810fc10 2024-05-08T06:41:03.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.801+0000 7f92ad600700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92900b2900 0x7f92900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:03.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.802+0000 7f92ad600700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92900b2900 0x7f92900b4dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f929c005950 tx=0x7f929c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:03.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:03.803+0000 7f92a6000700 1 -- 172.21.15.70:0/2144479650 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f92a002a020 con 0x7f92a810fc10 2024-05-08T06:41:04.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.036+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f92a819cee0 con 0x7f92a810fc10 2024-05-08T06:41:04.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.464+0000 7f92a6000700 1 -- 172.21.15.70:0/2144479650 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v75) ==== 138+0+0 (secure 0 0 0) 0x7f92a00aba00 con 0x7f92a810fc10 2024-05-08T06:41:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92900b2900 msgr2=0x7f92900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92900b2900 0x7f92900b4dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f929c005950 tx=0x7f929c0058e0 comp rx=0 tx=0).stop 2024-05-08T06:41:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 msgr2=0x7f92a819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 0x7f92a819b9b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b070 tx=0x7f92a0004e00 comp rx=0 tx=0).stop 2024-05-08T06:41:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 shutdown_connections 2024-05-08T06:41:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92900b2900 0x7f92900b4dc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a810fc10 0x7f92a819b9b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92a80758d0 0x7f92a81a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:04.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 --2- 172.21.15.70:0/2144479650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a80761f0 0x7f92a81a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:04.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.468+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 >> 172.21.15.70:0/2144479650 conn(0x7f92a80fef20 msgr2=0x7f92a80ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:04.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.469+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 shutdown_connections 2024-05-08T06:41:04.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:04.469+0000 7f92aea00700 1 -- 172.21.15.70:0/2144479650 wait complete. 2024-05-08T06:41:04.470 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2024-05-08T06:41:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:04 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2144479650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T06:41:04.762 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:04 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2144479650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T06:41:04.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:04 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2144479650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T06:41:05.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-08T06:41:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:05 smithi070 ceph-mon[29591]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:05 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2144479650' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T06:41:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:05 smithi070 ceph-mon[29591]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T06:41:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:05 smithi194 ceph-mon[33679]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:05.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:05 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2144479650' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T06:41:05.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:05 smithi194 ceph-mon[33679]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T06:41:05.785 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:05 smithi172 ceph-mon[33377]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:05 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2144479650' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T06:41:05.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:05 smithi172 ceph-mon[33377]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T06:41:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:06 smithi070 ceph-mon[29591]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T06:41:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:06 smithi172 ceph-mon[33377]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T06:41:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:06 smithi194 ceph-mon[33679]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T06:41:07.579 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:07 smithi070 ceph-mon[29591]: pgmap v362: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:07.579 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:07 smithi070 ceph-mon[29591]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T06:41:07.580 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:07 smithi070 ceph-mon[29591]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T06:41:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:07 smithi194 ceph-mon[33679]: pgmap v362: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:07 smithi194 ceph-mon[33679]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T06:41:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:07 smithi194 ceph-mon[33679]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T06:41:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:07 smithi172 ceph-mon[33377]: pgmap v362: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:07 smithi172 ceph-mon[33377]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T06:41:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:07 smithi172 ceph-mon[33377]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T06:41:08.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.220+0000 7f924c200700 1 -- 172.21.15.70:0/274504989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9244075ff0 msgr2=0x7f9244114190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:08.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.220+0000 7f924c200700 1 --2- 172.21.15.70:0/274504989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9244075ff0 0x7f9244114190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9230009990 tx=0x7f9230009ca0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.220+0000 7f924c200700 1 -- 172.21.15.70:0/274504989 shutdown_connections 2024-05-08T06:41:08.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.220+0000 7f924c200700 1 --2- 172.21.15.70:0/274504989 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92441146d0 0x7f9244116ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.220+0000 7f924c200700 1 --2- 172.21.15.70:0/274504989 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92440756d0 0x7f9244075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.220+0000 7f924c200700 1 --2- 172.21.15.70:0/274504989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9244075ff0 0x7f9244114190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.220+0000 7f924c200700 1 -- 172.21.15.70:0/274504989 >> 172.21.15.70:0/274504989 conn(0x7f924407a5f0 msgr2=0x7f924407aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:08.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.220+0000 7f924c200700 1 -- 172.21.15.70:0/274504989 shutdown_connections 2024-05-08T06:41:08.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.220+0000 7f924c200700 1 -- 172.21.15.70:0/274504989 wait complete. 2024-05-08T06:41:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f924c200700 1 Processor -- start 2024-05-08T06:41:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f924c200700 1 -- start start 2024-05-08T06:41:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f924c200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92440756d0 0x7f92441a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f924c200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244075ff0 0x7f92441a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f924c200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92441146d0 0x7f92441a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f924c200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9244119bc0 con 0x7f92440756d0 2024-05-08T06:41:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f924c200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9244119a40 con 0x7f9244075ff0 2024-05-08T06:41:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f924c200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9244119d40 con 0x7f92441146d0 2024-05-08T06:41:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f9249800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92440756d0 0x7f92441a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f9249800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92440756d0 0x7f92441a00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58832/0 (socket says 172.21.15.70:58832) 2024-05-08T06:41:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.222+0000 7f9249800700 1 -- 172.21.15.70:0/2365315444 learned_addr learned my addr 172.21.15.70:0/2365315444 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.223+0000 7f9248e00700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244075ff0 0x7f92441a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.223+0000 7f924a200700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92441146d0 0x7f92441a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.223+0000 7f9249800700 1 -- 172.21.15.70:0/2365315444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92441146d0 msgr2=0x7f92441a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.223+0000 7f9249800700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92441146d0 0x7f92441a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.223+0000 7f9249800700 1 -- 172.21.15.70:0/2365315444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244075ff0 msgr2=0x7f92441a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.223+0000 7f9249800700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244075ff0 0x7f92441a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.223+0000 7f9249800700 1 -- 172.21.15.70:0/2365315444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92441a50e0 con 0x7f92440756d0 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.223+0000 7f924a200700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92441146d0 0x7f92441a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.223+0000 7f9249800700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92440756d0 0x7f92441a00d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f923800d950 tx=0x7f923800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.224+0000 7f9242000700 1 -- 172.21.15.70:0/2365315444 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9238016070 con 0x7f92440756d0 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.224+0000 7f9242000700 1 -- 172.21.15.70:0/2365315444 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9238010460 con 0x7f92440756d0 2024-05-08T06:41:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.224+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92441a53d0 con 0x7f92440756d0 2024-05-08T06:41:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.224+0000 7f9242000700 1 -- 172.21.15.70:0/2365315444 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923800f620 con 0x7f92440756d0 2024-05-08T06:41:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.224+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92441acc50 con 0x7f92440756d0 2024-05-08T06:41:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.225+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9244076df0 con 0x7f92440756d0 2024-05-08T06:41:08.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.228+0000 7f9242000700 1 -- 172.21.15.70:0/2365315444 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9238019070 con 0x7f92440756d0 2024-05-08T06:41:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.229+0000 7f9242000700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f922c0b2880 0x7f922c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:08.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.229+0000 7f9242000700 1 -- 172.21.15.70:0/2365315444 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f92380e1c60 con 0x7f92440756d0 2024-05-08T06:41:08.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.229+0000 7f9248e00700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f922c0b2880 0x7f922c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:08.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.230+0000 7f9248e00700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f922c0b2880 0x7f922c0b4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9230005850 tx=0x7f923001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:08.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.232+0000 7f9242000700 1 -- 172.21.15.70:0/2365315444 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f92380a9c10 con 0x7f92440756d0 2024-05-08T06:41:08.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.466+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f92441ace20 con 0x7f92440756d0 2024-05-08T06:41:08.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.519+0000 7f9242000700 1 -- 172.21.15.70:0/2365315444 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v78) ==== 171+0+0 (secure 0 0 0) 0x7f92380a9510 con 0x7f92440756d0 2024-05-08T06:41:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f922c0b2880 msgr2=0x7f922c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f922c0b2880 0x7f922c0b4d40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9230005850 tx=0x7f923001a040 comp rx=0 tx=0).stop 2024-05-08T06:41:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92440756d0 msgr2=0x7f92441a00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92440756d0 0x7f92441a00d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f923800d950 tx=0x7f923800dd10 comp rx=0 tx=0).stop 2024-05-08T06:41:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 shutdown_connections 2024-05-08T06:41:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92441146d0 0x7f92441a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f922c0b2880 0x7f922c0b4d40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92440756d0 0x7f92441a00d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 --2- 172.21.15.70:0/2365315444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9244075ff0 0x7f92441a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 >> 172.21.15.70:0/2365315444 conn(0x7f924407a5f0 msgr2=0x7f9244113500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 shutdown_connections 2024-05-08T06:41:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:08.524+0000 7f924c200700 1 -- 172.21.15.70:0/2365315444 wait complete. 2024-05-08T06:41:08.525 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2024-05-08T06:41:08.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2365315444' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-08T06:41:08.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2365315444' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-08T06:41:09.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2365315444' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-08T06:41:09.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T06:41:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:09 smithi070 ceph-mon[29591]: pgmap v364: 33 pgs: 5 creating+peering, 8 active+clean, 20 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2365315444' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-08T06:41:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:09 smithi070 ceph-mon[29591]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T06:41:09.907 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:09 smithi172 ceph-mon[33377]: pgmap v364: 33 pgs: 5 creating+peering, 8 active+clean, 20 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2365315444' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-08T06:41:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:09 smithi172 ceph-mon[33377]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T06:41:09.980 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:09 smithi194 ceph-mon[33679]: pgmap v364: 33 pgs: 5 creating+peering, 8 active+clean, 20 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:09.980 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2365315444' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-08T06:41:09.980 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:09 smithi194 ceph-mon[33679]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T06:41:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:10 smithi070 ceph-mon[29591]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T06:41:10.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:10 smithi172 ceph-mon[33377]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T06:41:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:10 smithi194 ceph-mon[33679]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T06:41:11.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:11 smithi070 ceph-mon[29591]: pgmap v367: 97 pgs: 21 creating+peering, 51 active+clean, 25 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:11.787 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:11 smithi070 ceph-mon[29591]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T06:41:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:11 smithi172 ceph-mon[33377]: pgmap v367: 97 pgs: 21 creating+peering, 51 active+clean, 25 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:11 smithi172 ceph-mon[33377]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T06:41:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:11 smithi194 ceph-mon[33679]: pgmap v367: 97 pgs: 21 creating+peering, 51 active+clean, 25 unknown; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:11 smithi194 ceph-mon[33679]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T06:41:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.360+0000 7f1489a00700 1 -- 172.21.15.70:0/2722682534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1484075870 msgr2=0x7f1484075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.360+0000 7f1489a00700 1 --2- 172.21.15.70:0/2722682534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1484075870 0x7f1484075c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1474009990 tx=0x7f1474009ca0 comp rx=0 tx=0).stop 2024-05-08T06:41:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.360+0000 7f1489a00700 1 -- 172.21.15.70:0/2722682534 shutdown_connections 2024-05-08T06:41:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.360+0000 7f1489a00700 1 --2- 172.21.15.70:0/2722682534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f148410fc60 0x7f1484112070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.360+0000 7f1489a00700 1 --2- 172.21.15.70:0/2722682534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1484075870 0x7f1484075c50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.360+0000 7f1489a00700 1 --2- 172.21.15.70:0/2722682534 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1484076190 0x7f148410f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:12.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.360+0000 7f1489a00700 1 -- 172.21.15.70:0/2722682534 >> 172.21.15.70:0/2722682534 conn(0x7f14840feeb0 msgr2=0x7f14841012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:12.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.360+0000 7f1489a00700 1 -- 172.21.15.70:0/2722682534 shutdown_connections 2024-05-08T06:41:12.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.360+0000 7f1489a00700 1 -- 172.21.15.70:0/2722682534 wait complete. 2024-05-08T06:41:12.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.362+0000 7f1489a00700 1 Processor -- start 2024-05-08T06:41:12.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.362+0000 7f1489a00700 1 -- start start 2024-05-08T06:41:12.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1489a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1484075870 0x7f14841a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1489a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1484076190 0x7f14841a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1489a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148410fc60 0x7f148419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1489a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14841156a0 con 0x7f148410fc60 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1489a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1484115520 con 0x7f1484076190 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1489a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1484115820 con 0x7f1484075870 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1489000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148410fc60 0x7f148419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1489000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148410fc60 0x7f148419ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58848/0 (socket says 172.21.15.70:58848) 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1489000700 1 -- 172.21.15.70:0/56266157 learned_addr learned my addr 172.21.15.70:0/56266157 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f1483e00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1484075870 0x7f14841a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:12.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.363+0000 7f147be00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1484076190 0x7f14841a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1489000700 1 -- 172.21.15.70:0/56266157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1484075870 msgr2=0x7f14841a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1489000700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1484075870 0x7f14841a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1489000700 1 -- 172.21.15.70:0/56266157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1484076190 msgr2=0x7f14841a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1489000700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1484076190 0x7f14841a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1489000700 1 -- 172.21.15.70:0/56266157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148419c160 con 0x7f148410fc60 2024-05-08T06:41:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1483e00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1484075870 0x7f14841a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:41:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1489000700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148410fc60 0x7f148419ba00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f147c00ada0 tx=0x7f147c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1481600700 1 -- 172.21.15.70:0/56266157 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c017020 con 0x7f148410fc60 2024-05-08T06:41:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1481600700 1 -- 172.21.15.70:0/56266157 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f147c007e30 con 0x7f148410fc60 2024-05-08T06:41:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1481600700 1 -- 172.21.15.70:0/56266157 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c005390 con 0x7f148410fc60 2024-05-08T06:41:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148419c450 con 0x7f148410fc60 2024-05-08T06:41:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.364+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14841a86c0 con 0x7f148410fc60 2024-05-08T06:41:12.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.366+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f148406a190 con 0x7f148410fc60 2024-05-08T06:41:12.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.368+0000 7f1481600700 1 -- 172.21.15.70:0/56266157 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f147c004ad0 con 0x7f148410fc60 2024-05-08T06:41:12.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.369+0000 7f1481600700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f14680b2900 0x7f14680b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:12.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.370+0000 7f1481600700 1 -- 172.21.15.70:0/56266157 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f147c0e1db0 con 0x7f148410fc60 2024-05-08T06:41:12.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.370+0000 7f1483e00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f14680b2900 0x7f14680b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:12.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.370+0000 7f1483e00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f14680b2900 0x7f14680b4dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1474005850 tx=0x7f147401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:12.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.372+0000 7f1481600700 1 -- 172.21.15.70:0/56266157 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f147c021020 con 0x7f148410fc60 2024-05-08T06:41:12.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:12.657+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f148402e510 con 0x7f148410fc60 2024-05-08T06:41:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:12 smithi070 ceph-mon[29591]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T06:41:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:12 smithi172 ceph-mon[33377]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T06:41:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:12 smithi194 ceph-mon[33679]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T06:41:13.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.581+0000 7f1481600700 1 -- 172.21.15.70:0/56266157 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f147c0a9c70 con 0x7f148410fc60 2024-05-08T06:41:13.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f14680b2900 msgr2=0x7f14680b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:13.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f14680b2900 0x7f14680b4dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1474005850 tx=0x7f147401a040 comp rx=0 tx=0).stop 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148410fc60 msgr2=0x7f148419ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148410fc60 0x7f148419ba00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f147c00ada0 tx=0x7f147c00c330 comp rx=0 tx=0).stop 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 shutdown_connections 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f14680b2900 0x7f14680b4dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f148410fc60 0x7f148419ba00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1484075870 0x7f14841a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 --2- 172.21.15.70:0/56266157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1484076190 0x7f14841a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.585+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 >> 172.21.15.70:0/56266157 conn(0x7f14840feeb0 msgr2=0x7f14840ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.586+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 shutdown_connections 2024-05-08T06:41:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:13.586+0000 7f1489a00700 1 -- 172.21.15.70:0/56266157 wait complete. 2024-05-08T06:41:13.587 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T06:41:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:13 smithi070 ceph-mon[29591]: pgmap v369: 97 pgs: 21 creating+peering, 64 active+clean, 12 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/56266157' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T06:41:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:13 smithi070 ceph-mon[29591]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T06:41:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:13 smithi172 ceph-mon[33377]: pgmap v369: 97 pgs: 21 creating+peering, 64 active+clean, 12 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:13 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/56266157' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T06:41:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:13 smithi172 ceph-mon[33377]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T06:41:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:13 smithi194 ceph-mon[33679]: pgmap v369: 97 pgs: 21 creating+peering, 64 active+clean, 12 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:13 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/56266157' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T06:41:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:13 smithi194 ceph-mon[33679]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T06:41:14.612 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-08T06:41:14.612 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-08T06:41:14.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:14 smithi070 ceph-mon[29591]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T06:41:14.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:14 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/56266157' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T06:41:14.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:14 smithi070 ceph-mon[29591]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T06:41:14.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:14 smithi070 ceph-mon[29591]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T06:41:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:14 smithi172 ceph-mon[33377]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T06:41:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:14 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/56266157' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T06:41:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:14 smithi172 ceph-mon[33377]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T06:41:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:14 smithi172 ceph-mon[33377]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T06:41:15.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:14 smithi194 ceph-mon[33679]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T06:41:15.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:14 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/56266157' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T06:41:15.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:14 smithi194 ceph-mon[33679]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T06:41:15.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:14 smithi194 ceph-mon[33679]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T06:41:15.052 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:15.829 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:15 smithi172 ceph-mon[33377]: pgmap v371: 97 pgs: 8 creating+peering, 89 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-05-08T06:41:15.829 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:15 smithi172 ceph-mon[33377]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-08T06:41:15.829 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:15 smithi172 ceph-mon[33377]: Cluster is now healthy 2024-05-08T06:41:15.829 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:15 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] up:active 2024-05-08T06:41:15.829 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:15 smithi172 ceph-mon[33377]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:41:15.830 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:15 smithi172 ceph-mon[33377]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:41:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:15 smithi070 ceph-mon[29591]: pgmap v371: 97 pgs: 8 creating+peering, 89 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-05-08T06:41:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:15 smithi070 ceph-mon[29591]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-08T06:41:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:15 smithi070 ceph-mon[29591]: Cluster is now healthy 2024-05-08T06:41:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:15 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] up:active 2024-05-08T06:41:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:15 smithi070 ceph-mon[29591]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:41:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:15 smithi070 ceph-mon[29591]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:41:16.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:15 smithi194 ceph-mon[33679]: pgmap v371: 97 pgs: 8 creating+peering, 89 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-05-08T06:41:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:15 smithi194 ceph-mon[33679]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-08T06:41:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:15 smithi194 ceph-mon[33679]: Cluster is now healthy 2024-05-08T06:41:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:15 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] up:active 2024-05-08T06:41:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:15 smithi194 ceph-mon[33679]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:41:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:15 smithi194 ceph-mon[33679]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:41:16.929 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:41:16 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b[63250]: 2024-05-08T06:41:16.592+0000 7fc270a00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T06:41:17.597 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:17 smithi070 ceph-mon[29591]: pgmap v372: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-05-08T06:41:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.646+0000 7f0ca6600700 1 -- 172.21.15.70:0/3357931985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca010a3a0 msgr2=0x7f0ca0116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.646+0000 7f0ca6600700 1 --2- 172.21.15.70:0/3357931985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca010a3a0 0x7f0ca0116840 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800b0a0 tx=0x7f0c9800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:41:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.646+0000 7f0ca6600700 1 -- 172.21.15.70:0/3357931985 shutdown_connections 2024-05-08T06:41:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.646+0000 7f0ca6600700 1 --2- 172.21.15.70:0/3357931985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca010a3a0 0x7f0ca0116840 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.646+0000 7f0ca6600700 1 --2- 172.21.15.70:0/3357931985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca010e8b0 0x7f0ca010ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.646+0000 7f0ca6600700 1 --2- 172.21.15.70:0/3357931985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca01099e0 0x7f0ca0109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.646+0000 7f0ca6600700 1 -- 172.21.15.70:0/3357931985 >> 172.21.15.70:0/3357931985 conn(0x7f0ca0079230 msgr2=0x7f0ca01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.646+0000 7f0ca6600700 1 -- 172.21.15.70:0/3357931985 shutdown_connections 2024-05-08T06:41:17.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.646+0000 7f0ca6600700 1 -- 172.21.15.70:0/3357931985 wait complete. 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.647+0000 7f0ca6600700 1 Processor -- start 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.647+0000 7f0ca6600700 1 -- start start 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca01099e0 0x7f0ca01a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca6600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca010a3a0 0x7f0ca01a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca6600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca010e8b0 0x7f0ca01a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca6600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca0119af0 con 0x7f0ca01099e0 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca6600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca0119970 con 0x7f0ca010e8b0 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca6600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0ca0119c70 con 0x7f0ca010a3a0 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca01099e0 0x7f0ca01a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:17.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca01099e0 0x7f0ca01a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56092/0 (socket says 172.21.15.70:56092) 2024-05-08T06:41:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca5200700 1 -- 172.21.15.70:0/1839229494 learned_addr learned my addr 172.21.15.70:0/1839229494 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0c97e00700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca010a3a0 0x7f0ca01a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca5c00700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca010e8b0 0x7f0ca01a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca5200700 1 -- 172.21.15.70:0/1839229494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca010a3a0 msgr2=0x7f0ca01a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca5200700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca010a3a0 0x7f0ca01a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca5200700 1 -- 172.21.15.70:0/1839229494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca010e8b0 msgr2=0x7f0ca01a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca5200700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca010e8b0 0x7f0ca01a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.648+0000 7f0ca5200700 1 -- 172.21.15.70:0/1839229494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ca01a4fc0 con 0x7f0ca01099e0 2024-05-08T06:41:17.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.649+0000 7f0ca5200700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca01099e0 0x7f0ca01a0000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800b530 tx=0x7f0c8800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:17.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.649+0000 7f0c9e000700 1 -- 172.21.15.70:0/1839229494 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88015020 con 0x7f0ca01099e0 2024-05-08T06:41:17.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.649+0000 7f0c9e000700 1 -- 172.21.15.70:0/1839229494 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0c88011cc0 con 0x7f0ca01099e0 2024-05-08T06:41:17.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.649+0000 7f0c9e000700 1 -- 172.21.15.70:0/1839229494 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c88010d30 con 0x7f0ca01099e0 2024-05-08T06:41:17.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.649+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ca01a5250 con 0x7f0ca01099e0 2024-05-08T06:41:17.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.649+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ca01acb30 con 0x7f0ca01099e0 2024-05-08T06:41:17.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.650+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ca006a190 con 0x7f0ca01099e0 2024-05-08T06:41:17.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.653+0000 7f0c9e000700 1 -- 172.21.15.70:0/1839229494 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0c88018020 con 0x7f0ca01099e0 2024-05-08T06:41:17.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.654+0000 7f0c9e000700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0c840b2880 0x7f0c840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.654+0000 7f0c9e000700 1 -- 172.21.15.70:0/1839229494 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f0c880e1f70 con 0x7f0ca01099e0 2024-05-08T06:41:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.654+0000 7f0c97e00700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0c840b2880 0x7f0c840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:17.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.655+0000 7f0c97e00700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0c840b2880 0x7f0c840b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0c90005fd0 tx=0x7f0c9000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:17.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.657+0000 7f0c9e000700 1 -- 172.21.15.70:0/1839229494 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0c8801f020 con 0x7f0ca01099e0 2024-05-08T06:41:17.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:17.899+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f0ca01a1310 con 0x7f0ca01099e0 2024-05-08T06:41:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:17 smithi172 ceph-mon[33377]: pgmap v372: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-05-08T06:41:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:17 smithi194 ceph-mon[33679]: pgmap v372: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 2 op/s 2024-05-08T06:41:18.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.593+0000 7f0c9e000700 1 -- 172.21.15.70:0/1839229494 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v82) ==== 157+0+0 (secure 0 0 0) 0x7f0c880a9d40 con 0x7f0ca01099e0 2024-05-08T06:41:18.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.598+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0c840b2880 msgr2=0x7f0c840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:18.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.598+0000 7f0ca6600700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0c840b2880 0x7f0c840b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0c90005fd0 tx=0x7f0c9000a560 comp rx=0 tx=0).stop 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.598+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca01099e0 msgr2=0x7f0ca01a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.598+0000 7f0ca6600700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca01099e0 0x7f0ca01a0000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c8800b530 tx=0x7f0c8800b8f0 comp rx=0 tx=0).stop 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.599+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 shutdown_connections 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.599+0000 7f0ca6600700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ca010e8b0 0x7f0ca01a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.599+0000 7f0ca6600700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f0c840b2880 0x7f0c840b4d40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.599+0000 7f0ca6600700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ca01099e0 0x7f0ca01a0000 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.599+0000 7f0ca6600700 1 --2- 172.21.15.70:0/1839229494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ca010a3a0 0x7f0ca01a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.599+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 >> 172.21.15.70:0/1839229494 conn(0x7f0ca0079230 msgr2=0x7f0ca0079890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.599+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 shutdown_connections 2024-05-08T06:41:18.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:18.599+0000 7f0ca6600700 1 -- 172.21.15.70:0/1839229494 wait complete. 2024-05-08T06:41:18.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:18 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1839229494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-08T06:41:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:18 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1839229494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-08T06:41:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:18 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1839229494' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-08T06:41:19.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T06:41:19.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:19 smithi070 ceph-mon[29591]: pgmap v373: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-08T06:41:19.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:19 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1839229494' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-08T06:41:19.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:19 smithi070 ceph-mon[29591]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T06:41:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:19 smithi172 ceph-mon[33377]: pgmap v373: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-08T06:41:19.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:19 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1839229494' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-08T06:41:19.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:19 smithi172 ceph-mon[33377]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T06:41:20.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:19 smithi194 ceph-mon[33679]: pgmap v373: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-05-08T06:41:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:19 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1839229494' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-08T06:41:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:19 smithi194 ceph-mon[33679]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T06:41:20.044 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:21.711 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:21 smithi070 ceph-mon[29591]: pgmap v375: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-08T06:41:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:21 smithi172 ceph-mon[33377]: pgmap v375: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-08T06:41:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:21 smithi194 ceph-mon[33679]: pgmap v375: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.294+0000 7f0565c00700 1 -- 172.21.15.70:0/594874693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010a490 msgr2=0x7f05601169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.294+0000 7f0565c00700 1 --2- 172.21.15.70:0/594874693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010a490 0x7f05601169a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f055800b0a0 tx=0x7f055800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.294+0000 7f0565c00700 1 -- 172.21.15.70:0/594874693 shutdown_connections 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.294+0000 7f0565c00700 1 --2- 172.21.15.70:0/594874693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010a490 0x7f05601169a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.294+0000 7f0565c00700 1 --2- 172.21.15.70:0/594874693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f056010fb60 0x7f056010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.294+0000 7f0565c00700 1 --2- 172.21.15.70:0/594874693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560109ad0 0x7f0560109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.294+0000 7f0565c00700 1 -- 172.21.15.70:0/594874693 >> 172.21.15.70:0/594874693 conn(0x7f0560076c70 msgr2=0x7f05601082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.294+0000 7f0565c00700 1 -- 172.21.15.70:0/594874693 shutdown_connections 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.294+0000 7f0565c00700 1 -- 172.21.15.70:0/594874693 wait complete. 2024-05-08T06:41:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.295+0000 7f0565c00700 1 Processor -- start 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.296+0000 7f0565c00700 1 -- start start 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.296+0000 7f0565c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560109ad0 0x7f056019ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.296+0000 7f0565c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f056010a490 0x7f05601a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.296+0000 7f0565c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010fb60 0x7f05601a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.296+0000 7f0565c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0560119bd0 con 0x7f056010fb60 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.296+0000 7f0565c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0560119a50 con 0x7f056010a490 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.296+0000 7f0565c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0560119d50 con 0x7f0560109ad0 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010fb60 0x7f05601a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010fb60 0x7f05601a47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56110/0 (socket says 172.21.15.70:56110) 2024-05-08T06:41:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055f400700 1 -- 172.21.15.70:0/530572968 learned_addr learned my addr 172.21.15.70:0/530572968 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055ea00700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560109ad0 0x7f056019ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055e000700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f056010a490 0x7f05601a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055f400700 1 -- 172.21.15.70:0/530572968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560109ad0 msgr2=0x7f056019ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055f400700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560109ad0 0x7f056019ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055f400700 1 -- 172.21.15.70:0/530572968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f056010a490 msgr2=0x7f05601a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055f400700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f056010a490 0x7f05601a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.297+0000 7f055f400700 1 -- 172.21.15.70:0/530572968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05601a4f20 con 0x7f056010fb60 2024-05-08T06:41:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.298+0000 7f055f400700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010fb60 0x7f05601a47e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f055800b070 tx=0x7f0558004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.298+0000 7f0557400700 1 -- 172.21.15.70:0/530572968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558021070 con 0x7f056010fb60 2024-05-08T06:41:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.298+0000 7f0557400700 1 -- 172.21.15.70:0/530572968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0558007b80 con 0x7f056010fb60 2024-05-08T06:41:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.298+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05601a51b0 con 0x7f056010fb60 2024-05-08T06:41:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.298+0000 7f0557400700 1 -- 172.21.15.70:0/530572968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0558004640 con 0x7f056010fb60 2024-05-08T06:41:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.298+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05601aca90 con 0x7f056010fb60 2024-05-08T06:41:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.300+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f056010b1d0 con 0x7f056010fb60 2024-05-08T06:41:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.302+0000 7f0557400700 1 -- 172.21.15.70:0/530572968 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0558003a00 con 0x7f056010fb60 2024-05-08T06:41:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.303+0000 7f0557400700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05440b2930 0x7f05440b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.304+0000 7f0557400700 1 -- 172.21.15.70:0/530572968 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8277+0+0 (secure 0 0 0) 0x7f055800f020 con 0x7f056010fb60 2024-05-08T06:41:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.304+0000 7f055ea00700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05440b2930 0x7f05440b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:22.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.304+0000 7f055ea00700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05440b2930 0x7f05440b4df0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0550005950 tx=0x7f055000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:22.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.306+0000 7f0557400700 1 -- 172.21.15.70:0/530572968 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f055802a020 con 0x7f056010fb60 2024-05-08T06:41:22.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:22.540+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f056002e510 con 0x7f056010fb60 2024-05-08T06:41:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/530572968' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T06:41:22.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:22 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/530572968' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T06:41:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:22 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/530572968' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T06:41:23.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.621+0000 7f0557400700 1 -- 172.21.15.70:0/530572968 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v84) ==== 228+0+0 (secure 0 0 0) 0x7f05580ab840 con 0x7f056010fb60 2024-05-08T06:41:23.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.625+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05440b2930 msgr2=0x7f05440b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:23.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.625+0000 7f0565c00700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05440b2930 0x7f05440b4df0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0550005950 tx=0x7f055000b410 comp rx=0 tx=0).stop 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.625+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010fb60 msgr2=0x7f05601a47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.625+0000 7f0565c00700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010fb60 0x7f05601a47e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f055800b070 tx=0x7f0558004d50 comp rx=0 tx=0).stop 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.625+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 shutdown_connections 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.625+0000 7f0565c00700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05440b2930 0x7f05440b4df0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.625+0000 7f0565c00700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f056010fb60 0x7f05601a47e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.625+0000 7f0565c00700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0560109ad0 0x7f056019ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.625+0000 7f0565c00700 1 --2- 172.21.15.70:0/530572968 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f056010a490 0x7f05601a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.626+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 >> 172.21.15.70:0/530572968 conn(0x7f0560076c70 msgr2=0x7f0560077190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.626+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 shutdown_connections 2024-05-08T06:41:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:23.626+0000 7f0565c00700 1 -- 172.21.15.70:0/530572968 wait complete. 2024-05-08T06:41:23.628 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data_ec' created 2024-05-08T06:41:23.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:23 smithi070 ceph-mon[29591]: pgmap v376: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-08T06:41:23.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:23 smithi070 ceph-mon[29591]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T06:41:23.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:23 smithi172 ceph-mon[33377]: pgmap v376: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-08T06:41:23.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:23 smithi172 ceph-mon[33377]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T06:41:24.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:23 smithi194 ceph-mon[33679]: pgmap v376: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 5 op/s 2024-05-08T06:41:24.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:23 smithi194 ceph-mon[33679]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T06:41:24.498 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-08T06:41:24.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:24 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/530572968' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T06:41:24.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:24 smithi070 ceph-mon[29591]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T06:41:24.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:24 smithi070 ceph-mon[29591]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T06:41:24.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:24 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/530572968' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T06:41:24.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:24 smithi172 ceph-mon[33377]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T06:41:24.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:24 smithi172 ceph-mon[33377]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T06:41:24.963 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:24 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/530572968' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T06:41:25.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:24 smithi194 ceph-mon[33679]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T06:41:25.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:24 smithi194 ceph-mon[33679]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T06:41:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:25 smithi172 ceph-mon[33377]: pgmap v379: 129 pgs: 7 creating+peering, 25 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-05-08T06:41:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:25 smithi172 ceph-mon[33377]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T06:41:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:25 smithi194 ceph-mon[33679]: pgmap v379: 129 pgs: 7 creating+peering, 25 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-05-08T06:41:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:25 smithi194 ceph-mon[33679]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T06:41:26.068 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:25 smithi070 ceph-mon[29591]: pgmap v379: 129 pgs: 7 creating+peering, 25 unknown, 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 1 op/s 2024-05-08T06:41:26.068 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:25 smithi070 ceph-mon[29591]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T06:41:26.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:26 smithi070 ceph-mon[29591]: osdmap e86: 12 total, 12 up, 12 in 2024-05-08T06:41:27.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:26 smithi194 ceph-mon[33679]: osdmap e86: 12 total, 12 up, 12 in 2024-05-08T06:41:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:26 smithi172 ceph-mon[33377]: osdmap e86: 12 total, 12 up, 12 in 2024-05-08T06:41:27.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.476+0000 7f47b3c00700 1 -- 172.21.15.70:0/1241795327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac109ad0 msgr2=0x7f47ac109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:27.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.476+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1241795327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac109ad0 0x7f47ac109f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4798009990 tx=0x7f4798009ca0 comp rx=0 tx=0).stop 2024-05-08T06:41:27.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.476+0000 7f47b3c00700 1 -- 172.21.15.70:0/1241795327 shutdown_connections 2024-05-08T06:41:27.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.476+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1241795327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac10a490 0x7f47ac1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.476+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1241795327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac10fb60 0x7f47ac10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.476+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1241795327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac109ad0 0x7f47ac109f50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.476+0000 7f47b3c00700 1 -- 172.21.15.70:0/1241795327 >> 172.21.15.70:0/1241795327 conn(0x7f47ac076c70 msgr2=0x7f47ac1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.476+0000 7f47b3c00700 1 -- 172.21.15.70:0/1241795327 shutdown_connections 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.476+0000 7f47b3c00700 1 -- 172.21.15.70:0/1241795327 wait complete. 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.477+0000 7f47b3c00700 1 Processor -- start 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.477+0000 7f47b3c00700 1 -- start start 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b3c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac109ad0 0x7f47ac1a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b3c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac10a490 0x7f47ac1a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b3c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac10fb60 0x7f47ac1a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b3c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac119b80 con 0x7f47ac10fb60 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b3c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac119a00 con 0x7f47ac10a490 2024-05-08T06:41:27.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b3c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f47ac119d00 con 0x7f47ac109ad0 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac10fb60 0x7f47ac1a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac10fb60 0x7f47ac1a4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33814/0 (socket says 172.21.15.70:33814) 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b1c00700 1 -- 172.21.15.70:0/1769616325 learned_addr learned my addr 172.21.15.70:0/1769616325 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47b1200700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac109ad0 0x7f47ac1a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.478+0000 7f47abe00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac10a490 0x7f47ac1a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47b1c00700 1 -- 172.21.15.70:0/1769616325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac109ad0 msgr2=0x7f47ac1a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47b1c00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac109ad0 0x7f47ac1a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47b1c00700 1 -- 172.21.15.70:0/1769616325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac10a490 msgr2=0x7f47ac1a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47b1c00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac10a490 0x7f47ac1a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47b1c00700 1 -- 172.21.15.70:0/1769616325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ac1a51a0 con 0x7f47ac10fb60 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47b1c00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac10fb60 0x7f47ac1a4a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47a400ada0 tx=0x7f47a400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47a9600700 1 -- 172.21.15.70:0/1769616325 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a4017020 con 0x7f47ac10fb60 2024-05-08T06:41:27.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47a9600700 1 -- 172.21.15.70:0/1769616325 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47a400ce10 con 0x7f47ac10fb60 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ac1a5490 con 0x7f47ac10fb60 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47a9600700 1 -- 172.21.15.70:0/1769616325 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a4005440 con 0x7f47ac10fb60 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.479+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ac1acd10 con 0x7f47ac10fb60 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.481+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ac06a190 con 0x7f47ac10fb60 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.483+0000 7f47a9600700 1 -- 172.21.15.70:0/1769616325 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f47a4004ad0 con 0x7f47ac10fb60 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.484+0000 7f47a9600700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47940b2900 0x7f47940b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.484+0000 7f47a9600700 1 -- 172.21.15.70:0/1769616325 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8770+0+0 (secure 0 0 0) 0x7f47a40e1bd0 con 0x7f47ac10fb60 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.485+0000 7f47b1200700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47940b2900 0x7f47940b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.485+0000 7f47b1200700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47940b2900 0x7f47940b4dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47a0005fd0 tx=0x7f47a0005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:27.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.489+0000 7f47a9600700 1 -- 172.21.15.70:0/1769616325 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f47a4021020 con 0x7f47ac10fb60 2024-05-08T06:41:27.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:27.718+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f47ac02e510 con 0x7f47ac10fb60 2024-05-08T06:41:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:27 smithi070 ceph-mon[29591]: pgmap v382: 129 pgs: 13 creating+peering, 13 unknown, 103 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:28.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:27 smithi194 ceph-mon[33679]: pgmap v382: 129 pgs: 13 creating+peering, 13 unknown, 103 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:27 smithi172 ceph-mon[33377]: pgmap v382: 129 pgs: 13 creating+peering, 13 unknown, 103 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.701+0000 7f47a9600700 1 -- 172.21.15.70:0/1769616325 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v87) ==== 169+0+0 (secure 0 0 0) 0x7f47a40a9700 con 0x7f47ac10fb60 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47940b2900 msgr2=0x7f47940b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47940b2900 0x7f47940b4dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47a0005fd0 tx=0x7f47a0005db0 comp rx=0 tx=0).stop 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac10fb60 msgr2=0x7f47ac1a4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac10fb60 0x7f47ac1a4a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47a400ada0 tx=0x7f47a400c330 comp rx=0 tx=0).stop 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 shutdown_connections 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47940b2900 0x7f47940b4dc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47ac10fb60 0x7f47ac1a4a60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47ac109ad0 0x7f47ac1a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 --2- 172.21.15.70:0/1769616325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f47ac10a490 0x7f47ac1a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.706+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 >> 172.21.15.70:0/1769616325 conn(0x7f47ac076c70 msgr2=0x7f47ac077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.707+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 shutdown_connections 2024-05-08T06:41:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:28.707+0000 7f47b3c00700 1 -- 172.21.15.70:0/1769616325 wait complete. 2024-05-08T06:41:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:set pool 4 allow_ec_overwrites to true 2024-05-08T06:41:28.942 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:28 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1769616325' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-08T06:41:29.119 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:28 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1769616325' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-08T06:41:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:28 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1769616325' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-08T06:41:29.673 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-08T06:41:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:29 smithi070 ceph-mon[29591]: pgmap v383: 129 pgs: 13 creating+peering, 8 unknown, 108 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:29 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1769616325' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-08T06:41:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:29 smithi070 ceph-mon[29591]: osdmap e87: 12 total, 12 up, 12 in 2024-05-08T06:41:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:29 smithi194 ceph-mon[33679]: pgmap v383: 129 pgs: 13 creating+peering, 8 unknown, 108 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:29 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1769616325' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-08T06:41:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:29 smithi194 ceph-mon[33679]: osdmap e87: 12 total, 12 up, 12 in 2024-05-08T06:41:30.125 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:29 smithi172 ceph-mon[33377]: pgmap v383: 129 pgs: 13 creating+peering, 8 unknown, 108 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:29 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1769616325' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-08T06:41:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:29 smithi172 ceph-mon[33377]: osdmap e87: 12 total, 12 up, 12 in 2024-05-08T06:41:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:31 smithi194 ceph-mon[33679]: pgmap v385: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:32.099 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:31 smithi070 ceph-mon[29591]: pgmap v385: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:31 smithi172 ceph-mon[33377]: pgmap v385: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.649+0000 7f448e800700 1 -- 172.21.15.70:0/256253643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f448810fea0 msgr2=0x7f4488112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.649+0000 7f448e800700 1 --2- 172.21.15.70:0/256253643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f448810fea0 0x7f4488112290 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f448000b0a0 tx=0x7f448000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:41:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.649+0000 7f448e800700 1 -- 172.21.15.70:0/256253643 shutdown_connections 2024-05-08T06:41:32.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.649+0000 7f448e800700 1 --2- 172.21.15.70:0/256253643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f448810fea0 0x7f4488112290 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.649+0000 7f448e800700 1 --2- 172.21.15.70:0/256253643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44880756d0 0x7f4488075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.649+0000 7f448e800700 1 --2- 172.21.15.70:0/256253643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4488075ff0 0x7f448810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.649+0000 7f448e800700 1 -- 172.21.15.70:0/256253643 >> 172.21.15.70:0/256253643 conn(0x7f448807a600 msgr2=0x7f448807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.649+0000 7f448e800700 1 -- 172.21.15.70:0/256253643 shutdown_connections 2024-05-08T06:41:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.649+0000 7f448e800700 1 -- 172.21.15.70:0/256253643 wait complete. 2024-05-08T06:41:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.650+0000 7f448e800700 1 Processor -- start 2024-05-08T06:41:32.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.650+0000 7f448e800700 1 -- start start 2024-05-08T06:41:32.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.651+0000 7f448e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44880756d0 0x7f44881a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:32.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.651+0000 7f448e800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4488075ff0 0x7f44881a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:32.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.651+0000 7f448e800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f448810fea0 0x7f448819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:32.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.651+0000 7f448e800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44881156f0 con 0x7f44880756d0 2024-05-08T06:41:32.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.651+0000 7f448e800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4488115570 con 0x7f4488075ff0 2024-05-08T06:41:32.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.651+0000 7f448e800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4488115870 con 0x7f448810fea0 2024-05-08T06:41:32.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.651+0000 7f4487400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44880756d0 0x7f44881a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:32.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.651+0000 7f4487400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44880756d0 0x7f44881a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33836/0 (socket says 172.21.15.70:33836) 2024-05-08T06:41:32.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.651+0000 7f4487400700 1 -- 172.21.15.70:0/1989885843 learned_addr learned my addr 172.21.15.70:0/1989885843 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:32.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f4487e00700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f448810fea0 0x7f448819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f4486a00700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4488075ff0 0x7f44881a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f4487400700 1 -- 172.21.15.70:0/1989885843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f448810fea0 msgr2=0x7f448819ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f4487400700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f448810fea0 0x7f448819ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f4487400700 1 -- 172.21.15.70:0/1989885843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4488075ff0 msgr2=0x7f44881a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f4487400700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4488075ff0 0x7f44881a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f4487400700 1 -- 172.21.15.70:0/1989885843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f448819c1d0 con 0x7f44880756d0 2024-05-08T06:41:32.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f4486a00700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4488075ff0 0x7f44881a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:41:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f4487400700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44880756d0 0x7f44881a18b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f447800d950 tx=0x7f447800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f447fe00700 1 -- 172.21.15.70:0/1989885843 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4478016070 con 0x7f44880756d0 2024-05-08T06:41:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f448819c4c0 con 0x7f44880756d0 2024-05-08T06:41:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f447fe00700 1 -- 172.21.15.70:0/1989885843 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4478010460 con 0x7f44880756d0 2024-05-08T06:41:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.652+0000 7f447fe00700 1 -- 172.21.15.70:0/1989885843 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f447800f620 con 0x7f44880756d0 2024-05-08T06:41:32.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.653+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44881a8780 con 0x7f44880756d0 2024-05-08T06:41:32.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.654+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448806a190 con 0x7f44880756d0 2024-05-08T06:41:32.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.656+0000 7f447fe00700 1 -- 172.21.15.70:0/1989885843 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4478019070 con 0x7f44880756d0 2024-05-08T06:41:32.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.658+0000 7f447fe00700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446c0b2900 0x7f446c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:32.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.658+0000 7f447fe00700 1 -- 172.21.15.70:0/1989885843 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8770+0+0 (secure 0 0 0) 0x7f44780e2380 con 0x7f44880756d0 2024-05-08T06:41:32.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.658+0000 7f4486a00700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446c0b2900 0x7f446c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:32.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.659+0000 7f4486a00700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446c0b2900 0x7f446c0b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44881030a0 tx=0x7f4474009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:32.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.666+0000 7f447fe00700 1 -- 172.21.15.70:0/1989885843 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f44780a9e20 con 0x7f44880756d0 2024-05-08T06:41:32.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:32.958+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f448802e510 con 0x7f44880756d0 2024-05-08T06:41:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.717+0000 7f447fe00700 1 -- 172.21.15.70:0/1989885843 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f44780a9720 con 0x7f44880756d0 2024-05-08T06:41:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.724+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446c0b2900 msgr2=0x7f446c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.724+0000 7f448e800700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446c0b2900 0x7f446c0b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44881030a0 tx=0x7f4474009550 comp rx=0 tx=0).stop 2024-05-08T06:41:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.724+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44880756d0 msgr2=0x7f44881a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.724+0000 7f448e800700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44880756d0 0x7f44881a18b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f447800d950 tx=0x7f447800dd10 comp rx=0 tx=0).stop 2024-05-08T06:41:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.725+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 shutdown_connections 2024-05-08T06:41:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.725+0000 7f448e800700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f448810fea0 0x7f448819ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.725+0000 7f448e800700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f446c0b2900 0x7f446c0b4dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.725+0000 7f448e800700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44880756d0 0x7f44881a18b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.725+0000 7f448e800700 1 --2- 172.21.15.70:0/1989885843 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4488075ff0 0x7f44881a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.725+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 >> 172.21.15.70:0/1989885843 conn(0x7f448807a600 msgr2=0x7f4488100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.725+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 shutdown_connections 2024-05-08T06:41:33.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:33.725+0000 7f448e800700 1 -- 172.21.15.70:0/1989885843 wait complete. 2024-05-08T06:41:33.726 INFO:teuthology.orchestra.run.smithi070.stderr:added data pool 4 to fsmap 2024-05-08T06:41:33.982 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:33 smithi172 ceph-mon[33377]: pgmap v386: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:33.982 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:33 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1989885843' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-08T06:41:34.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:33 smithi194 ceph-mon[33679]: pgmap v386: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:34.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:33 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1989885843' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-08T06:41:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:33 smithi070 ceph-mon[29591]: pgmap v386: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:33 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1989885843' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-08T06:41:34.746 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:41:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1989885843' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-08T06:41:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:34 smithi194 ceph-mon[33679]: osdmap e88: 12 total, 12 up, 12 in 2024-05-08T06:41:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:34 smithi194 ceph-mon[33679]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:41:35.016 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1989885843' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-08T06:41:35.016 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:34 smithi172 ceph-mon[33377]: osdmap e88: 12 total, 12 up, 12 in 2024-05-08T06:41:35.016 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:34 smithi172 ceph-mon[33377]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:41:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1989885843' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-08T06:41:35.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:34 smithi070 ceph-mon[29591]: osdmap e88: 12 total, 12 up, 12 in 2024-05-08T06:41:35.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:34 smithi070 ceph-mon[29591]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:41:35.190 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:35.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:35 smithi070 ceph-mon[29591]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:35 smithi070 ceph-mon[29591]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-08T06:41:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:35 smithi070 ceph-mon[29591]: Cluster is now healthy 2024-05-08T06:41:36.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:35 smithi194 ceph-mon[33679]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:36.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:35 smithi194 ceph-mon[33679]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-08T06:41:36.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:35 smithi194 ceph-mon[33679]: Cluster is now healthy 2024-05-08T06:41:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:35 smithi172 ceph-mon[33377]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:35 smithi172 ceph-mon[33377]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-08T06:41:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:35 smithi172 ceph-mon[33377]: Cluster is now healthy 2024-05-08T06:41:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.614+0000 7fca1fa00700 1 -- 172.21.15.70:0/833585900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca180756d0 msgr2=0x7fca18075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.614+0000 7fca1fa00700 1 --2- 172.21.15.70:0/833585900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca180756d0 0x7fca18075ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca08009990 tx=0x7fca08009ca0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.614+0000 7fca1fa00700 1 -- 172.21.15.70:0/833585900 shutdown_connections 2024-05-08T06:41:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.614+0000 7fca1fa00700 1 --2- 172.21.15.70:0/833585900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca1810ff00 0x7fca181122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.614+0000 7fca1fa00700 1 --2- 172.21.15.70:0/833585900 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca180756d0 0x7fca18075ab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.614+0000 7fca1fa00700 1 --2- 172.21.15.70:0/833585900 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca18075ff0 0x7fca1810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.614+0000 7fca1fa00700 1 -- 172.21.15.70:0/833585900 >> 172.21.15.70:0/833585900 conn(0x7fca1807a600 msgr2=0x7fca1807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.614+0000 7fca1fa00700 1 -- 172.21.15.70:0/833585900 shutdown_connections 2024-05-08T06:41:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.614+0000 7fca1fa00700 1 -- 172.21.15.70:0/833585900 wait complete. 2024-05-08T06:41:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.615+0000 7fca1fa00700 1 Processor -- start 2024-05-08T06:41:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.616+0000 7fca1fa00700 1 -- start start 2024-05-08T06:41:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.616+0000 7fca1fa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca180756d0 0x7fca181a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.616+0000 7fca1fa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca18075ff0 0x7fca181a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.616+0000 7fca1fa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1810ff00 0x7fca1819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.616+0000 7fca1fa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca18115740 con 0x7fca1810ff00 2024-05-08T06:41:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.616+0000 7fca1fa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca181155c0 con 0x7fca180756d0 2024-05-08T06:41:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.616+0000 7fca1fa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fca181158c0 con 0x7fca18075ff0 2024-05-08T06:41:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca1da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1810ff00 0x7fca1819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca1da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1810ff00 0x7fca1819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42276/0 (socket says 172.21.15.70:42276) 2024-05-08T06:41:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca1da00700 1 -- 172.21.15.70:0/3798276111 learned_addr learned my addr 172.21.15.70:0/3798276111 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca1d000700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca180756d0 0x7fca181a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca0fe00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca18075ff0 0x7fca181a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca1da00700 1 -- 172.21.15.70:0/3798276111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca18075ff0 msgr2=0x7fca181a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca1da00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca18075ff0 0x7fca181a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca1da00700 1 -- 172.21.15.70:0/3798276111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca180756d0 msgr2=0x7fca181a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca1da00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca180756d0 0x7fca181a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.617+0000 7fca1da00700 1 -- 172.21.15.70:0/3798276111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1819c120 con 0x7fca1810ff00 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.618+0000 7fca1da00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1810ff00 0x7fca1819b9c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca1000cc30 tx=0x7fca1000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.618+0000 7fca16000700 1 -- 172.21.15.70:0/3798276111 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca10016020 con 0x7fca1810ff00 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.618+0000 7fca16000700 1 -- 172.21.15.70:0/3798276111 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca1000abe0 con 0x7fca1810ff00 2024-05-08T06:41:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.618+0000 7fca16000700 1 -- 172.21.15.70:0/3798276111 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca100115e0 con 0x7fca1810ff00 2024-05-08T06:41:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.618+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1819c410 con 0x7fca1810ff00 2024-05-08T06:41:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.618+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca181a86d0 con 0x7fca1810ff00 2024-05-08T06:41:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.619+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1806a190 con 0x7fca1810ff00 2024-05-08T06:41:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.622+0000 7fca16000700 1 -- 172.21.15.70:0/3798276111 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fca10019020 con 0x7fca1810ff00 2024-05-08T06:41:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.624+0000 7fca16000700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9fc0b2880 0x7fc9fc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.624+0000 7fca16000700 1 -- 172.21.15.70:0/3798276111 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fca100e2380 con 0x7fca1810ff00 2024-05-08T06:41:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.624+0000 7fca1d000700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9fc0b2880 0x7fc9fc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.625+0000 7fca1d000700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9fc0b2880 0x7fc9fc0b4d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca08005850 tx=0x7fca0801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:37.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.629+0000 7fca16000700 1 -- 172.21.15.70:0/3798276111 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fca10020020 con 0x7fca1810ff00 2024-05-08T06:41:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:37 smithi070 ceph-mon[29591]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:37.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.914+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca1802e510 con 0x7fca1810ff00 2024-05-08T06:41:37.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.916+0000 7fca16000700 1 -- 172.21.15.70:0/3798276111 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11803 (secure 0 0 0) 0x7fca100a3e20 con 0x7fca1810ff00 2024-05-08T06:41:37.916 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:41:37.916 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24397,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24409,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34379,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34409,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:41:32.960065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34442,"qdb_cluster":[34442]},"id":1}]} 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9fc0b2880 msgr2=0x7fc9fc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9fc0b2880 0x7fc9fc0b4d40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca08005850 tx=0x7fca0801a040 comp rx=0 tx=0).stop 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1810ff00 msgr2=0x7fca1819b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1810ff00 0x7fca1819b9c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca1000cc30 tx=0x7fca1000a060 comp rx=0 tx=0).stop 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 shutdown_connections 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc9fc0b2880 0x7fc9fc0b4d40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1810ff00 0x7fca1819b9c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca180756d0 0x7fca181a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 --2- 172.21.15.70:0/3798276111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca18075ff0 0x7fca181a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.919+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 >> 172.21.15.70:0/3798276111 conn(0x7fca1807a600 msgr2=0x7fca181006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.920+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 shutdown_connections 2024-05-08T06:41:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:37.920+0000 7fca1fa00700 1 -- 172.21.15.70:0/3798276111 wait complete. 2024-05-08T06:41:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 17 2024-05-08T06:41:38.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:37 smithi194 ceph-mon[33679]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:37 smithi172 ceph-mon[33377]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:38.942 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:41:39.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:38 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3798276111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:41:39.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:38 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3798276111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:41:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:38 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3798276111' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:41:39.390 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:39.790 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:39 smithi070 ceph-mon[29591]: pgmap v390: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:40.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:39 smithi194 ceph-mon[33679]: pgmap v390: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:39 smithi172 ceph-mon[33377]: pgmap v390: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:41.846 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:41 smithi070 ceph-mon[29591]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.877+0000 7f90be600700 1 -- 172.21.15.70:0/3181839058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 msgr2=0x7f90b8075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.877+0000 7f90be600700 1 --2- 172.21.15.70:0/3181839058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 0x7f90b8075c20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009990 tx=0x7f90ac009ca0 comp rx=0 tx=0).stop 2024-05-08T06:41:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.877+0000 7f90be600700 1 -- 172.21.15.70:0/3181839058 shutdown_connections 2024-05-08T06:41:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.877+0000 7f90be600700 1 --2- 172.21.15.70:0/3181839058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b81143d0 0x7f90b81167c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.877+0000 7f90be600700 1 --2- 172.21.15.70:0/3181839058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 0x7f90b8075c20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.877+0000 7f90be600700 1 --2- 172.21.15.70:0/3181839058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b8076160 0x7f90b8113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.877+0000 7f90be600700 1 -- 172.21.15.70:0/3181839058 >> 172.21.15.70:0/3181839058 conn(0x7f90b80feeb0 msgr2=0x7f90b81012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.877+0000 7f90be600700 1 -- 172.21.15.70:0/3181839058 shutdown_connections 2024-05-08T06:41:41.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.877+0000 7f90be600700 1 -- 172.21.15.70:0/3181839058 wait complete. 2024-05-08T06:41:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.878+0000 7f90be600700 1 Processor -- start 2024-05-08T06:41:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.878+0000 7f90be600700 1 -- start start 2024-05-08T06:41:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90be600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 0x7f90b81a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90be600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b8076160 0x7f90b81a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90be600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81143d0 0x7f90b81a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:41.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90be600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f90b8119ab0 con 0x7f90b8075840 2024-05-08T06:41:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90be600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f90b8119930 con 0x7f90b81143d0 2024-05-08T06:41:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90be600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f90b8119c30 con 0x7f90b8076160 2024-05-08T06:41:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90bd200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 0x7f90b81a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90bd200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 0x7f90b81a0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42292/0 (socket says 172.21.15.70:42292) 2024-05-08T06:41:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90bd200700 1 -- 172.21.15.70:0/1340449514 learned_addr learned my addr 172.21.15.70:0/1340449514 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90b7e00700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b8076160 0x7f90b81a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90bd200700 1 -- 172.21.15.70:0/1340449514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b8076160 msgr2=0x7f90b81a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90bd200700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b8076160 0x7f90b81a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:41.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90bd200700 1 -- 172.21.15.70:0/1340449514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81143d0 msgr2=0x7f90b81a48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:41.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90bdc00700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81143d0 0x7f90b81a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:41.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90bd200700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81143d0 0x7f90b81a48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:41.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.879+0000 7f90bd200700 1 -- 172.21.15.70:0/1340449514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b81a5000 con 0x7f90b8075840 2024-05-08T06:41:41.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.880+0000 7f90bd200700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 0x7f90b81a0040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f90ac005910 tx=0x7f90ac009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:41.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.880+0000 7f90b5600700 1 -- 172.21.15.70:0/1340449514 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac027070 con 0x7f90b8075840 2024-05-08T06:41:41.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.880+0000 7f90b5600700 1 -- 172.21.15.70:0/1340449514 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f90ac00fce0 con 0x7f90b8075840 2024-05-08T06:41:41.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.880+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b81a5290 con 0x7f90b8075840 2024-05-08T06:41:41.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.880+0000 7f90b5600700 1 -- 172.21.15.70:0/1340449514 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0173f0 con 0x7f90b8075840 2024-05-08T06:41:41.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.880+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b81acb70 con 0x7f90b8075840 2024-05-08T06:41:41.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.881+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b806a190 con 0x7f90b8075840 2024-05-08T06:41:41.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.884+0000 7f90b5600700 1 -- 172.21.15.70:0/1340449514 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f90ac02a070 con 0x7f90b8075840 2024-05-08T06:41:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.885+0000 7f90b5600700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f90a00b2900 0x7f90a00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.885+0000 7f90b5600700 1 -- 172.21.15.70:0/1340449514 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f90ac0e34a0 con 0x7f90b8075840 2024-05-08T06:41:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.885+0000 7f90b7e00700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f90a00b2900 0x7f90a00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.886+0000 7f90b7e00700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f90a00b2900 0x7f90a00b4dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f90b8101610 tx=0x7f90a4005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:41.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:41.890+0000 7f90b5600700 1 -- 172.21.15.70:0/1340449514 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f90ac013070 con 0x7f90b8075840 2024-05-08T06:41:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.127+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90b802e510 con 0x7f90b8075840 2024-05-08T06:41:42.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.132+0000 7f90b5600700 1 -- 172.21.15.70:0/1340449514 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24105 (secure 0 0 0) 0x7f90ac0aafb0 con 0x7f90b8075840 2024-05-08T06:41:42.133 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:41:42.133 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:41:32.959888+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f90a00b2900 msgr2=0x7f90a00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f90a00b2900 0x7f90a00b4dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f90b8101610 tx=0x7f90a4005cf0 comp rx=0 tx=0).stop 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 msgr2=0x7f90b81a0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 0x7f90b81a0040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f90ac005910 tx=0x7f90ac009f90 comp rx=0 tx=0).stop 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 shutdown_connections 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90b81143d0 0x7f90b81a48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f90a00b2900 0x7f90a00b4dc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f90b8075840 0x7f90b81a0040 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 --2- 172.21.15.70:0/1340449514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90b8076160 0x7f90b81a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 >> 172.21.15.70:0/1340449514 conn(0x7f90b80feeb0 msgr2=0x7f90b81007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.136+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 shutdown_connections 2024-05-08T06:41:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:42.137+0000 7f90be600700 1 -- 172.21.15.70:0/1340449514 wait complete. 2024-05-08T06:41:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:41 smithi172 ceph-mon[33377]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:42.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:41 smithi194 ceph-mon[33679]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:42 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1340449514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:41:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:42 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1340449514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:41:43.200 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:41:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:42 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1340449514' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:41:43.645 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:44.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:43 smithi070 ceph-mon[29591]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:43 smithi172 ceph-mon[33377]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:43 smithi194 ceph-mon[33679]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:45 smithi070 ceph-mon[29591]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:46.058 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:45 smithi172 ceph-mon[33377]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:46.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.098+0000 7f7696e00700 1 -- 172.21.15.70:0/1360298147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690104100 msgr2=0x7f7690108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:46.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.098+0000 7f7696e00700 1 --2- 172.21.15.70:0/1360298147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690104100 0x7f7690108120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f76780099c0 tx=0x7f7678009cd0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.098+0000 7f7696e00700 1 -- 172.21.15.70:0/1360298147 shutdown_connections 2024-05-08T06:41:46.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.098+0000 7f7696e00700 1 --2- 172.21.15.70:0/1360298147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7690108850 0x7f76901103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.098+0000 7f7696e00700 1 --2- 172.21.15.70:0/1360298147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7690103750 0x7f7690103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.098+0000 7f7696e00700 1 --2- 172.21.15.70:0/1360298147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690104100 0x7f7690108120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.098+0000 7f7696e00700 1 -- 172.21.15.70:0/1360298147 >> 172.21.15.70:0/1360298147 conn(0x7f769007a600 msgr2=0x7f769007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:46.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.099+0000 7f7696e00700 1 -- 172.21.15.70:0/1360298147 shutdown_connections 2024-05-08T06:41:46.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.099+0000 7f7696e00700 1 -- 172.21.15.70:0/1360298147 wait complete. 2024-05-08T06:41:46.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.100+0000 7f7696e00700 1 Processor -- start 2024-05-08T06:41:46.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.100+0000 7f7696e00700 1 -- start start 2024-05-08T06:41:46.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.100+0000 7f7696e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690103750 0x7f76901a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:46.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.100+0000 7f7696e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7690104100 0x7f76901a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:46.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.100+0000 7f7696e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7690108850 0x7f769019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:46.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.100+0000 7f7696e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7690113530 con 0x7f7690103750 2024-05-08T06:41:46.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.100+0000 7f7696e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f76901133b0 con 0x7f7690108850 2024-05-08T06:41:46.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.100+0000 7f7696e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f76901136b0 con 0x7f7690104100 2024-05-08T06:41:46.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f768fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690103750 0x7f76901a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:46.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f768fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690103750 0x7f76901a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42312/0 (socket says 172.21.15.70:42312) 2024-05-08T06:41:46.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f768fe00700 1 -- 172.21.15.70:0/2339014394 learned_addr learned my addr 172.21.15.70:0/2339014394 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:46.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f7694e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7690108850 0x7f769019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f7687e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7690104100 0x7f76901a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f768fe00700 1 -- 172.21.15.70:0/2339014394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7690104100 msgr2=0x7f76901a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f768fe00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7690104100 0x7f76901a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f768fe00700 1 -- 172.21.15.70:0/2339014394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7690108850 msgr2=0x7f769019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f768fe00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7690108850 0x7f769019bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.101+0000 7f768fe00700 1 -- 172.21.15.70:0/2339014394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769019c210 con 0x7f7690103750 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.102+0000 7f768fe00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690103750 0x7f76901a18a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f768000d980 tx=0x7f768000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.102+0000 7f768d600700 1 -- 172.21.15.70:0/2339014394 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680017070 con 0x7f7690103750 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.102+0000 7f768d600700 1 -- 172.21.15.70:0/2339014394 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7680004830 con 0x7f7690103750 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.102+0000 7f768d600700 1 -- 172.21.15.70:0/2339014394 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76800053a0 con 0x7f7690103750 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.102+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769019c500 con 0x7f7690103750 2024-05-08T06:41:46.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.102+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76901a8770 con 0x7f7690103750 2024-05-08T06:41:46.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.103+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f769006a190 con 0x7f7690103750 2024-05-08T06:41:46.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.105+0000 7f768d600700 1 -- 172.21.15.70:0/2339014394 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f76800049e0 con 0x7f7690103750 2024-05-08T06:41:46.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.108+0000 7f768d600700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f76740b2900 0x7f76740b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:46.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.108+0000 7f768d600700 1 -- 172.21.15.70:0/2339014394 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f76800e23d0 con 0x7f7690103750 2024-05-08T06:41:46.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.108+0000 7f7687e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f76740b2900 0x7f76740b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:46.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.109+0000 7f7687e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f76740b2900 0x7f76740b4dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7678000c00 tx=0x7f767801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:46.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.112+0000 7f768d600700 1 -- 172.21.15.70:0/2339014394 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7680020020 con 0x7f7690103750 2024-05-08T06:41:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:45 smithi194 ceph-mon[33679]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:46.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.345+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76901a8a30 con 0x7f7690103750 2024-05-08T06:41:46.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.350+0000 7f768d600700 1 -- 172.21.15.70:0/2339014394 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24105 (secure 0 0 0) 0x7f76800a9e50 con 0x7f7690103750 2024-05-08T06:41:46.350 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:41:46.356 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:41:32.959888+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:41:46.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f76740b2900 msgr2=0x7f76740b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:46.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f76740b2900 0x7f76740b4dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7678000c00 tx=0x7f767801a040 comp rx=0 tx=0).stop 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690103750 msgr2=0x7f76901a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690103750 0x7f76901a18a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f768000d980 tx=0x7f768000dd40 comp rx=0 tx=0).stop 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 shutdown_connections 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7690108850 0x7f769019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f76740b2900 0x7f76740b4dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7690103750 0x7f76901a18a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 --2- 172.21.15.70:0/2339014394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7690104100 0x7f76901a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 >> 172.21.15.70:0/2339014394 conn(0x7f769007a600 msgr2=0x7f76901015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 shutdown_connections 2024-05-08T06:41:46.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:46.354+0000 7f7696e00700 1 -- 172.21.15.70:0/2339014394 wait complete. 2024-05-08T06:41:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:46 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2339014394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:41:47.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:46 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2339014394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:41:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:46 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2339014394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:41:47.364 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:41:47.809 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:48.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:47 smithi070 ceph-mon[29591]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:47 smithi172 ceph-mon[33377]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:48.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:47 smithi194 ceph-mon[33679]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:49.938 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:49 smithi070 ceph-mon[29591]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:49 smithi172 ceph-mon[33377]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:50.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.253+0000 7f7471a00700 1 -- 172.21.15.70:0/2042987325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c109ad0 msgr2=0x7f746c109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:50.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.253+0000 7f7471a00700 1 --2- 172.21.15.70:0/2042987325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c109ad0 0x7f746c109f50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7454009990 tx=0x7f7454009ca0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.253+0000 7f7471a00700 1 -- 172.21.15.70:0/2042987325 shutdown_connections 2024-05-08T06:41:50.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.253+0000 7f7471a00700 1 --2- 172.21.15.70:0/2042987325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c10a490 0x7f746c1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.253+0000 7f7471a00700 1 --2- 172.21.15.70:0/2042987325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c10fb60 0x7f746c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.253+0000 7f7471a00700 1 --2- 172.21.15.70:0/2042987325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c109ad0 0x7f746c109f50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.253+0000 7f7471a00700 1 -- 172.21.15.70:0/2042987325 >> 172.21.15.70:0/2042987325 conn(0x7f746c076c70 msgr2=0x7f746c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.253+0000 7f7471a00700 1 -- 172.21.15.70:0/2042987325 shutdown_connections 2024-05-08T06:41:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.253+0000 7f7471a00700 1 -- 172.21.15.70:0/2042987325 wait complete. 2024-05-08T06:41:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.255+0000 7f7471a00700 1 Processor -- start 2024-05-08T06:41:50.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.255+0000 7f7471a00700 1 -- start start 2024-05-08T06:41:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.255+0000 7f7471a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c109ad0 0x7f746c1a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.255+0000 7f7471a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c10a490 0x7f746c1a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:50.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.255+0000 7f7471a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c10fb60 0x7f746c1a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.255+0000 7f7471a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f746c119c10 con 0x7f746c10a490 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.255+0000 7f7471a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f746c119a90 con 0x7f746c10fb60 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.255+0000 7f7471a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f746c119d90 con 0x7f746c109ad0 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.255+0000 7f7463e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c10a490 0x7f746c1a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f7463e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c10a490 0x7f746c1a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38088/0 (socket says 172.21.15.70:38088) 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f7463e00700 1 -- 172.21.15.70:0/1460671348 learned_addr learned my addr 172.21.15.70:0/1460671348 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f746aa00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c109ad0 0x7f746c1a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f746b400700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c10fb60 0x7f746c1a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f7463e00700 1 -- 172.21.15.70:0/1460671348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c109ad0 msgr2=0x7f746c1a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f7463e00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c109ad0 0x7f746c1a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f7463e00700 1 -- 172.21.15.70:0/1460671348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c10fb60 msgr2=0x7f746c1a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f7463e00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c10fb60 0x7f746c1a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f7463e00700 1 -- 172.21.15.70:0/1460671348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746c1a5150 con 0x7f746c10a490 2024-05-08T06:41:50.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.256+0000 7f7463e00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c10a490 0x7f746c1a0680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7454000c00 tx=0x7f74540036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:50.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.257+0000 7f7463400700 1 -- 172.21.15.70:0/1460671348 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454027070 con 0x7f746c10a490 2024-05-08T06:41:50.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.257+0000 7f7463400700 1 -- 172.21.15.70:0/1460671348 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f745400fc80 con 0x7f746c10a490 2024-05-08T06:41:50.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.257+0000 7f7463400700 1 -- 172.21.15.70:0/1460671348 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7454022d60 con 0x7f746c10a490 2024-05-08T06:41:50.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.257+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746c1a53e0 con 0x7f746c10a490 2024-05-08T06:41:50.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.257+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f746c1accc0 con 0x7f746c10a490 2024-05-08T06:41:50.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.258+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f746c06a190 con 0x7f746c10a490 2024-05-08T06:41:50.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.260+0000 7f7463400700 1 -- 172.21.15.70:0/1460671348 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f745402a070 con 0x7f746c10a490 2024-05-08T06:41:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:49 smithi194 ceph-mon[33679]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:50.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.262+0000 7f7463400700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74500b2980 0x7f74500b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:50.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.262+0000 7f7463400700 1 -- 172.21.15.70:0/1460671348 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f74540e3550 con 0x7f746c10a490 2024-05-08T06:41:50.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.262+0000 7f746aa00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74500b2980 0x7f74500b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:50.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.263+0000 7f746aa00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74500b2980 0x7f74500b4e40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f745c005fd0 tx=0x7f745c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:50.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.265+0000 7f7463400700 1 -- 172.21.15.70:0/1460671348 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7454013070 con 0x7f746c10a490 2024-05-08T06:41:50.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.546+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f746c02e510 con 0x7f746c10a490 2024-05-08T06:41:50.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.548+0000 7f7463400700 1 -- 172.21.15.70:0/1460671348 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11803 (secure 0 0 0) 0x7f74540ab060 con 0x7f746c10a490 2024-05-08T06:41:50.548 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:41:50.548 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24397,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24409,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34364,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34379,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34409,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:41:32.960065+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34442},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34442,"qdb_cluster":[34442]},"id":1}]} 2024-05-08T06:41:50.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74500b2980 msgr2=0x7f74500b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:50.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74500b2980 0x7f74500b4e40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f745c005fd0 tx=0x7f745c00a560 comp rx=0 tx=0).stop 2024-05-08T06:41:50.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c10a490 msgr2=0x7f746c1a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:50.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c10a490 0x7f746c1a0680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7454000c00 tx=0x7f74540036f0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 shutdown_connections 2024-05-08T06:41:50.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f746c10fb60 0x7f746c1a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f746c109ad0 0x7f746c1a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f74500b2980 0x7f74500b4e40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 --2- 172.21.15.70:0/1460671348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f746c10a490 0x7f746c1a0680 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:50.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 >> 172.21.15.70:0/1460671348 conn(0x7f746c076c70 msgr2=0x7f746c077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:50.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 shutdown_connections 2024-05-08T06:41:50.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:50.551+0000 7f7471a00700 1 -- 172.21.15.70:0/1460671348 wait complete. 2024-05-08T06:41:50.553 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 17 2024-05-08T06:41:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:50 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1460671348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:41:51.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:50 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1460671348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:41:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:50 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1460671348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:41:51.512 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:41:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:51 smithi070 ceph-mon[29591]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:51.958 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:51 smithi172 ceph-mon[33377]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:51 smithi194 ceph-mon[33679]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:53.960 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:53 smithi070 ceph-mon[29591]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:53 smithi172 ceph-mon[33377]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:53 smithi194 ceph-mon[33679]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:54.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.263+0000 7effb8400700 1 -- 172.21.15.70:0/279608193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb010b6c0 msgr2=0x7effb010baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:54.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.263+0000 7effb8400700 1 --2- 172.21.15.70:0/279608193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb010b6c0 0x7effb010baa0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7effa4009990 tx=0x7effa4009ca0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.263+0000 7effb8400700 1 -- 172.21.15.70:0/279608193 shutdown_connections 2024-05-08T06:41:54.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.263+0000 7effb8400700 1 --2- 172.21.15.70:0/279608193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb0106080 0x7effb0112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.263+0000 7effb8400700 1 --2- 172.21.15.70:0/279608193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb010b6c0 0x7effb010baa0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.263+0000 7effb8400700 1 --2- 172.21.15.70:0/279608193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb01056c0 0x7effb0105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.263+0000 7effb8400700 1 -- 172.21.15.70:0/279608193 >> 172.21.15.70:0/279608193 conn(0x7effb01011b0 msgr2=0x7effb01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.263+0000 7effb8400700 1 -- 172.21.15.70:0/279608193 shutdown_connections 2024-05-08T06:41:54.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.263+0000 7effb8400700 1 -- 172.21.15.70:0/279608193 wait complete. 2024-05-08T06:41:54.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.264+0000 7effb8400700 1 Processor -- start 2024-05-08T06:41:54.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.264+0000 7effb8400700 1 -- start start 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb8400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb01056c0 0x7effb01a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb8400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb0106080 0x7effb01a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb8400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb010b6c0 0x7effb019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb8400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7effb01157c0 con 0x7effb0106080 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb8400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effb0115640 con 0x7effb010b6c0 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb8400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7effb0115940 con 0x7effb01056c0 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb0106080 0x7effb01a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb0106080 0x7effb01a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38102/0 (socket says 172.21.15.70:38102) 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb5000700 1 -- 172.21.15.70:0/2109063937 learned_addr learned my addr 172.21.15.70:0/2109063937 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.265+0000 7effb5a00700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb01056c0 0x7effb01a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effb6400700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb010b6c0 0x7effb019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effb5000700 1 -- 172.21.15.70:0/2109063937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb01056c0 msgr2=0x7effb01a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:54.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effb5000700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb01056c0 0x7effb01a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effb5000700 1 -- 172.21.15.70:0/2109063937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb010b6c0 msgr2=0x7effb019bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effb5000700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb010b6c0 0x7effb019bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effb5000700 1 -- 172.21.15.70:0/2109063937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb019c240 con 0x7effb0106080 2024-05-08T06:41:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effb5000700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb0106080 0x7effb01a1e60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00d950 tx=0x7eff9c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effae000700 1 -- 172.21.15.70:0/2109063937 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c016070 con 0x7effb0106080 2024-05-08T06:41:54.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effae000700 1 -- 172.21.15.70:0/2109063937 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff9c010460 con 0x7effb0106080 2024-05-08T06:41:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb019c530 con 0x7effb0106080 2024-05-08T06:41:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effae000700 1 -- 172.21.15.70:0/2109063937 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00f620 con 0x7effb0106080 2024-05-08T06:41:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.266+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb01a87f0 con 0x7effb0106080 2024-05-08T06:41:54.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.267+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb006a190 con 0x7effb0106080 2024-05-08T06:41:54.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.270+0000 7effae000700 1 -- 172.21.15.70:0/2109063937 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7eff9c019070 con 0x7effb0106080 2024-05-08T06:41:54.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.271+0000 7effae000700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7eff980b2880 0x7eff980b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:54.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.271+0000 7effae000700 1 -- 172.21.15.70:0/2109063937 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7eff9c0e2060 con 0x7effb0106080 2024-05-08T06:41:54.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.271+0000 7effb5a00700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7eff980b2880 0x7eff980b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:54.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.272+0000 7effb5a00700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7eff980b2880 0x7eff980b4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7effa400b5c0 tx=0x7effa401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:54.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.276+0000 7effae000700 1 -- 172.21.15.70:0/2109063937 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7eff9c0a9b40 con 0x7effb0106080 2024-05-08T06:41:54.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.510+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effb002e510 con 0x7effb0106080 2024-05-08T06:41:54.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.512+0000 7effae000700 1 -- 172.21.15.70:0/2109063937 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24105 (secure 0 0 0) 0x7eff9c0a9440 con 0x7effb0106080 2024-05-08T06:41:54.512 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:41:54.512 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":88,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:41:32.959888+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:41:54.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7eff980b2880 msgr2=0x7eff980b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:54.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7eff980b2880 0x7eff980b4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7effa400b5c0 tx=0x7effa401a040 comp rx=0 tx=0).stop 2024-05-08T06:41:54.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb0106080 msgr2=0x7effb01a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:54.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb0106080 0x7effb01a1e60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00d950 tx=0x7eff9c00dd10 comp rx=0 tx=0).stop 2024-05-08T06:41:54.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 shutdown_connections 2024-05-08T06:41:54.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effb010b6c0 0x7effb019bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effb01056c0 0x7effb01a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7eff980b2880 0x7eff980b4d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 --2- 172.21.15.70:0/2109063937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effb0106080 0x7effb01a1e60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:54.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.515+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 >> 172.21.15.70:0/2109063937 conn(0x7effb01011b0 msgr2=0x7effb01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:54.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.516+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 shutdown_connections 2024-05-08T06:41:54.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:54.516+0000 7effb8400700 1 -- 172.21.15.70:0/2109063937 wait complete. 2024-05-08T06:41:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:54 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2109063937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:41:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:54 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2109063937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:41:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:54 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2109063937' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:41:55.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-08T06:41:12.659763+0000', 'modified': '2024-05-08T06:41:32.960065+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34442}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34442': {'gid': 34442, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.172:6839/283788562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 283788562}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 283788562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34442, 'qdb_cluster': [34442]} 2024-05-08T06:41:55.323 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-08T06:41:55.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-08T06:41:55.772 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:56.108 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:55 smithi070 ceph-mon[29591]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:55 smithi172 ceph-mon[33377]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:55 smithi194 ceph-mon[33679]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:58.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:57 smithi070 ceph-mon[29591]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.127+0000 7fee6fe00700 1 -- 172.21.15.70:0/3770466526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 msgr2=0x7fee7010ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.127+0000 7fee6fe00700 1 --2- 172.21.15.70:0/3770466526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 0x7fee7010ec90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee60009990 tx=0x7fee60009ca0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.128+0000 7fee6fe00700 1 -- 172.21.15.70:0/3770466526 shutdown_connections 2024-05-08T06:41:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.128+0000 7fee6fe00700 1 --2- 172.21.15.70:0/3770466526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7010a3a0 0x7fee70116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.128+0000 7fee6fe00700 1 --2- 172.21.15.70:0/3770466526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 0x7fee7010ec90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.128+0000 7fee6fe00700 1 --2- 172.21.15.70:0/3770466526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701099e0 0x7fee70109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.128+0000 7fee6fe00700 1 -- 172.21.15.70:0/3770466526 >> 172.21.15.70:0/3770466526 conn(0x7fee70079230 msgr2=0x7fee701082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.128+0000 7fee6fe00700 1 -- 172.21.15.70:0/3770466526 shutdown_connections 2024-05-08T06:41:58.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.128+0000 7fee6fe00700 1 -- 172.21.15.70:0/3770466526 wait complete. 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.129+0000 7fee6fe00700 1 Processor -- start 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.129+0000 7fee6fe00700 1 -- start start 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701099e0 0x7fee7019ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7010a3a0 0x7fee701a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 0x7fee701a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee70119a80 con 0x7fee7010e8b0 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6fe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee70119900 con 0x7fee701099e0 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6fe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fee70119c00 con 0x7fee7010a3a0 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 0x7fee701a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 0x7fee701a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58520/0 (socket says 172.21.15.70:58520) 2024-05-08T06:41:58.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6f400700 1 -- 172.21.15.70:0/1867747691 learned_addr learned my addr 172.21.15.70:0/1867747691 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:58.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6e000700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7010a3a0 0x7fee701a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6ea00700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701099e0 0x7fee7019ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6f400700 1 -- 172.21.15.70:0/1867747691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7010a3a0 msgr2=0x7fee701a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:58.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6f400700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7010a3a0 0x7fee701a04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6f400700 1 -- 172.21.15.70:0/1867747691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701099e0 msgr2=0x7fee7019ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:58.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.130+0000 7fee6f400700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701099e0 0x7fee7019ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.131+0000 7fee6f400700 1 -- 172.21.15.70:0/1867747691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee701a4f80 con 0x7fee7010e8b0 2024-05-08T06:41:58.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.131+0000 7fee6e000700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7010a3a0 0x7fee701a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:41:58.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.131+0000 7fee6f400700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 0x7fee701a4840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee6800ada0 tx=0x7fee6800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:58.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.131+0000 7fee67400700 1 -- 172.21.15.70:0/1867747691 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68017020 con 0x7fee7010e8b0 2024-05-08T06:41:58.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.131+0000 7fee67400700 1 -- 172.21.15.70:0/1867747691 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee6800ce10 con 0x7fee7010e8b0 2024-05-08T06:41:58.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.131+0000 7fee6fe00700 1 -- 172.21.15.70:0/1867747691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee701a5270 con 0x7fee7010e8b0 2024-05-08T06:41:58.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.131+0000 7fee67400700 1 -- 172.21.15.70:0/1867747691 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68005440 con 0x7fee7010e8b0 2024-05-08T06:41:58.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.131+0000 7fee6fe00700 1 -- 172.21.15.70:0/1867747691 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee701acaf0 con 0x7fee7010e8b0 2024-05-08T06:41:58.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.136+0000 7fee67400700 1 -- 172.21.15.70:0/1867747691 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fee68004ad0 con 0x7fee7010e8b0 2024-05-08T06:41:58.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.137+0000 7fee800f0b80 1 Processor -- start 2024-05-08T06:41:58.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.137+0000 7fee800f0b80 1 -- start start 2024-05-08T06:41:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d3990 0x559aa72d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d42b0 0x559aa72cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee800f0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559aa72209d0 con 0x559aa72ce5b0 2024-05-08T06:41:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee800f0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559aa71be710 con 0x559aa72d42b0 2024-05-08T06:41:58.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee800f0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559aa721c990 con 0x559aa72d3990 2024-05-08T06:41:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee67400700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee540b2900 0x7fee540b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee6e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee6e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58536/0 (socket says 172.21.15.70:58536) 2024-05-08T06:41:58.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee6e000700 1 -- 172.21.15.70:0/2385727623 learned_addr learned my addr 172.21.15.70:0/2385727623 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee67400700 1 -- 172.21.15.70:0/1867747691 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fee680e1b70 con 0x7fee7010e8b0 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee6e000700 1 --2- 172.21.15.70:0/2385727623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d3990 0x559aa72d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee6f400700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee540b2900 0x7fee540b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.138+0000 7fee6ea00700 1 --2- 172.21.15.70:0/2385727623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d42b0 0x559aa72cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee6e000700 1 -- 172.21.15.70:0/2385727623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d3990 msgr2=0x559aa72d3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee6e000700 1 --2- 172.21.15.70:0/2385727623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d3990 0x559aa72d3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee6e000700 1 -- 172.21.15.70:0/2385727623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d42b0 msgr2=0x559aa72cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee6e000700 1 --2- 172.21.15.70:0/2385727623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d42b0 0x559aa72cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee6e000700 1 -- 172.21.15.70:0/2385727623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa716d880 con 0x559aa72ce5b0 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee6e000700 1 --2- 172.21.15.70:0/2385727623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cea30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0139a0 tx=0x7fee5c00b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c866451442f7571 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:58.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee6f400700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee540b2900 0x7fee540b4dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee680a5000 tx=0x7fee68004e10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee5be00700 1 -- 172.21.15.70:0/2385727623 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c004830 con 0x559aa72ce5b0 2024-05-08T06:41:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee5be00700 1 -- 172.21.15.70:0/2385727623 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee5c005020 con 0x559aa72ce5b0 2024-05-08T06:41:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.139+0000 7fee5be00700 1 -- 172.21.15.70:0/2385727623 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c004e60 con 0x559aa72ce5b0 2024-05-08T06:41:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.140+0000 7fee800f0b80 1 -- 172.21.15.70:0/2385727623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 msgr2=0x559aa72cea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.140+0000 7fee800f0b80 1 --2- 172.21.15.70:0/2385727623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cea30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0139a0 tx=0x7fee5c00b550 comp rx=0 tx=0).stop 2024-05-08T06:41:58.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.140+0000 7fee800f0b80 1 -- 172.21.15.70:0/2385727623 shutdown_connections 2024-05-08T06:41:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.140+0000 7fee800f0b80 1 --2- 172.21.15.70:0/2385727623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cea30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.140+0000 7fee800f0b80 1 --2- 172.21.15.70:0/2385727623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d3990 0x559aa72d3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.140+0000 7fee800f0b80 1 --2- 172.21.15.70:0/2385727623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d42b0 0x559aa72cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.140+0000 7fee800f0b80 1 -- 172.21.15.70:0/2385727623 >> 172.21.15.70:0/2385727623 conn(0x559aa71fcb10 msgr2=0x559aa72c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.141+0000 7fee800f0b80 1 -- 172.21.15.70:0/2385727623 shutdown_connections 2024-05-08T06:41:58.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.141+0000 7fee800f0b80 1 -- 172.21.15.70:0/2385727623 wait complete. 2024-05-08T06:41:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.141+0000 7fee800f0b80 1 -- start start 2024-05-08T06:41:58.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.142+0000 7fee800f0b80 1 Processor -- start 2024-05-08T06:41:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.142+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.142+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 0x559aa72d7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.142+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72d7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.142+0000 7fee800f0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559aa72dad60 con 0x559aa72ce5b0 2024-05-08T06:41:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.142+0000 7fee800f0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559aa7186ad0 con 0x559aa72d3990 2024-05-08T06:41:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.142+0000 7fee800f0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559aa72daee0 con 0x559aa72d42b0 2024-05-08T06:41:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.142+0000 7fee800f0b80 10 client.0 _ll_register_callbacks cb 0x559aa71c7c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:41:58.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.143+0000 7fee6e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.143+0000 7fee6ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 0x559aa72d7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.143+0000 7fee6e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72d9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58548/0 (socket says 172.21.15.70:58548) 2024-05-08T06:41:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.143+0000 7fee6e000700 1 -- 172.21.15.70:0/3678368547 learned_addr learned my addr 172.21.15.70:0/3678368547 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.143+0000 7fee6e000700 1 -- 172.21.15.70:0/3678368547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 msgr2=0x559aa72d7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:41:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.143+0000 7fee6e000700 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72d7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.143+0000 7fee6e000700 1 -- 172.21.15.70:0/3678368547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 msgr2=0x559aa72d7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:41:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.143+0000 7fee6e000700 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 0x559aa72d7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.143+0000 7fee6e000700 1 -- 172.21.15.70:0/3678368547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa71e63d0 con 0x559aa72ce5b0 2024-05-08T06:41:58.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.144+0000 7fee6e000700 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72d9ea0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fee5c001eb0 tx=0x7fee5c00b350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e9f649e4ab8418 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.144+0000 7fee58c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:41:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.144+0000 7fee58c00700 1 -- 172.21.15.70:0/3678368547 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0055e0 con 0x559aa72ce5b0 2024-05-08T06:41:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.144+0000 7fee58c00700 1 -- 172.21.15.70:0/3678368547 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fee5c004750 con 0x559aa72ce5b0 2024-05-08T06:41:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.144+0000 7fee800f0b80 1 -- 172.21.15.70:0/3678368547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee5c005020 con 0x559aa72ce5b0 2024-05-08T06:41:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.144+0000 7fee58c00700 1 -- 172.21.15.70:0/3678368547 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fee5c031050 con 0x559aa72ce5b0 2024-05-08T06:41:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.144+0000 7fee800f0b80 10 client.14676 fetch_fsmap learned FSMap version 17 2024-05-08T06:41:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.144+0000 7fee800f0b80 1 -- 172.21.15.70:0/3678368547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x559aa72e54c0 con 0x559aa72ce5b0 2024-05-08T06:41:58.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.144+0000 7fee58c00700 1 -- 172.21.15.70:0/3678368547 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee5c005020 con 0x559aa72ce5b0 2024-05-08T06:41:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.145+0000 7fee58c00700 1 -- 172.21.15.70:0/3678368547 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fee5c010b50 con 0x559aa72ce5b0 2024-05-08T06:41:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.145+0000 7fee800f0b80 10 client.14676 fetch_fsmap finished waiting for FSMap version 17 2024-05-08T06:41:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.145+0000 7fee800f0b80 10 client.14676 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T06:41:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.145+0000 7fee800f0b80 20 client.14676 populate_metadata read hostname 'smithi070' 2024-05-08T06:41:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.145+0000 7fee800f0b80 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559aa72e7600 0x559aa72e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.145+0000 7fee800f0b80 4 client.14676 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:41:58.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.145+0000 7fee800f0b80 1 -- 172.21.15.70:0/3678368547 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559aa729b050 con 0x559aa72e7600 2024-05-08T06:41:58.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.145+0000 7fee6ea00700 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559aa72e7600 0x559aa72e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.147+0000 7fee6ea00700 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559aa72e7600 0x559aa72e8a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59d13da8890a6eef server_cookie=71754d59527ee4ff in_seq=0 out_seq=0 2024-05-08T06:41:58.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.147+0000 7fee58c00700 10 client.14676 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:41:58.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.149+0000 7fee58c00700 1 -- 172.21.15.70:0/3678368547 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559aa729b050 con 0x559aa72e7600 2024-05-08T06:41:58.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.149+0000 7fee58c00700 10 client.14676 handle_command_reply: tid=0 2024-05-08T06:41:58.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.149+0000 7fee800f0b80 1 client.14676 shutdown 2024-05-08T06:41:58.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.149+0000 7fee800f0b80 1 -- 172.21.15.70:0/3678368547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 msgr2=0x559aa72d9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:58.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.149+0000 7fee800f0b80 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72d9ea0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fee5c001eb0 tx=0x7fee5c00b350 comp rx=0 tx=0).stop 2024-05-08T06:41:58.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee800f0b80 1 -- 172.21.15.70:0/3678368547 shutdown_connections 2024-05-08T06:41:58.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee800f0b80 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559aa72e7600 0x559aa72e8a70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee800f0b80 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72d7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee800f0b80 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72d9ea0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee800f0b80 1 --2- 172.21.15.70:0/3678368547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 0x559aa72d7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee800f0b80 1 -- 172.21.15.70:0/3678368547 >> 172.21.15.70:0/3678368547 conn(0x559aa71fcb10 msgr2=0x559aa72c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:58.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee58c00700 0 client.14676 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:41:58.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee800f0b80 1 -- 172.21.15.70:0/3678368547 shutdown_connections 2024-05-08T06:41:58.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee800f0b80 1 -- 172.21.15.70:0/3678368547 wait complete. 2024-05-08T06:41:58.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.150+0000 7fee800f0b80 20 client.14676 trim_cache size 0 max 16384 2024-05-08T06:41:58.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee800f0b80 1 Processor -- start 2024-05-08T06:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee800f0b80 1 -- start start 2024-05-08T06:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72ce5b0 0x559aa72cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72d3990 0x559aa72d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72d19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee800f0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559aa72e6db0 con 0x559aa72d3990 2024-05-08T06:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee800f0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559aa72e7480 con 0x559aa72ce5b0 2024-05-08T06:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee800f0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559aa72e7b50 con 0x559aa72d42b0 2024-05-08T06:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee6ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72d3990 0x559aa72d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.173+0000 7fee6ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72d3990 0x559aa72d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58552/0 (socket says 172.21.15.70:58552) 2024-05-08T06:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.174+0000 7fee6ea00700 1 -- 172.21.15.70:0/2662094347 learned_addr learned my addr 172.21.15.70:0/2662094347 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.174+0000 7fee6ea00700 1 -- 172.21.15.70:0/2662094347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 msgr2=0x559aa72d19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.174+0000 7fee6ea00700 1 --2- 172.21.15.70:0/2662094347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72d19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.174+0000 7fee6ea00700 1 -- 172.21.15.70:0/2662094347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72ce5b0 msgr2=0x559aa72cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.174+0000 7fee6ea00700 1 --2- 172.21.15.70:0/2662094347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72ce5b0 0x559aa72cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.174+0000 7fee6ea00700 1 -- 172.21.15.70:0/2662094347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa72c9850 con 0x559aa72d3990 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.174+0000 7fee6ea00700 1 --2- 172.21.15.70:0/2662094347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72d3990 0x559aa72d14a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee60003760 tx=0x7fee6001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6643fa7258d06c18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.174+0000 7fee5b400700 1 -- 172.21.15.70:0/2662094347 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6000be10 con 0x559aa72d3990 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.175+0000 7fee5b400700 1 -- 172.21.15.70:0/2662094347 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee60005560 con 0x559aa72d3990 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.175+0000 7fee5b400700 1 -- 172.21.15.70:0/2662094347 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee6002c2c0 con 0x559aa72d3990 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.175+0000 7fee800f0b80 1 -- 172.21.15.70:0/2662094347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72d3990 msgr2=0x559aa72d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.175+0000 7fee800f0b80 1 --2- 172.21.15.70:0/2662094347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72d3990 0x559aa72d14a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fee60003760 tx=0x7fee6001a040 comp rx=0 tx=0).stop 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.175+0000 7fee800f0b80 1 -- 172.21.15.70:0/2662094347 shutdown_connections 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.175+0000 7fee800f0b80 1 --2- 172.21.15.70:0/2662094347 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72d19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.175+0000 7fee800f0b80 1 --2- 172.21.15.70:0/2662094347 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72ce5b0 0x559aa72cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.175+0000 7fee800f0b80 1 --2- 172.21.15.70:0/2662094347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72d3990 0x559aa72d14a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.175+0000 7fee800f0b80 1 -- 172.21.15.70:0/2662094347 >> 172.21.15.70:0/2662094347 conn(0x559aa71fcb10 msgr2=0x559aa72d7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.176+0000 7fee800f0b80 1 -- 172.21.15.70:0/2662094347 shutdown_connections 2024-05-08T06:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.176+0000 7fee800f0b80 1 -- 172.21.15.70:0/2662094347 wait complete. 2024-05-08T06:41:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.176+0000 7fee800f0b80 1 -- start start 2024-05-08T06:41:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.176+0000 7fee800f0b80 1 Processor -- start 2024-05-08T06:41:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 0x559aa72cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee800f0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee800f0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559aa72e88f0 con 0x559aa72ce5b0 2024-05-08T06:41:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee800f0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559aa72e8220 con 0x559aa72d3990 2024-05-08T06:41:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee800f0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559aa72e8fc0 con 0x559aa72d42b0 2024-05-08T06:41:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee800f0b80 10 client.0 _ll_register_callbacks cb 0x559aa71c7c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee6e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee6e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58558/0 (socket says 172.21.15.70:58558) 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee6e000700 1 -- 172.21.15.70:0/954409936 learned_addr learned my addr 172.21.15.70:0/954409936 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.177+0000 7fee6ea00700 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 0x559aa72cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee6e000700 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee6e000700 1 -- 172.21.15.70:0/954409936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 msgr2=0x559aa72cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee6e000700 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee6e000700 1 -- 172.21.15.70:0/954409936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 msgr2=0x559aa72cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee6e000700 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 0x559aa72cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee6e000700 1 -- 172.21.15.70:0/954409936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa72effb0 con 0x559aa72ce5b0 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee6e000700 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cd040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0139a0 tx=0x7fee5c013f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76736e414ecb252e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee58c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee58c00700 1 -- 172.21.15.70:0/954409936 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5c005020 con 0x559aa72ce5b0 2024-05-08T06:41:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee58c00700 1 -- 172.21.15.70:0/954409936 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7fee5c0055f0 con 0x559aa72ce5b0 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.178+0000 7fee800f0b80 1 -- 172.21.15.70:0/954409936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee60005560 con 0x559aa72ce5b0 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee58c00700 1 -- 172.21.15.70:0/954409936 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fee5c043050 con 0x559aa72ce5b0 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee800f0b80 10 client.14682 fetch_fsmap learned FSMap version 17 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee800f0b80 1 -- 172.21.15.70:0/954409936 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x559aa7352c80 con 0x559aa72ce5b0 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee58c00700 1 -- 172.21.15.70:0/954409936 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee60005560 con 0x559aa72ce5b0 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee58c00700 1 -- 172.21.15.70:0/954409936 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fee5c010790 con 0x559aa72ce5b0 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee800f0b80 10 client.14682 fetch_fsmap finished waiting for FSMap version 17 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee800f0b80 10 client.14682 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee800f0b80 20 client.14682 populate_metadata read hostname 'smithi070' 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee800f0b80 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559aa7357770 0x559aa7356480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee800f0b80 4 client.14682 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:41:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.179+0000 7fee800f0b80 1 -- 172.21.15.70:0/954409936 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "status"}) -- 0x559aa722e3b0 con 0x559aa7357770 2024-05-08T06:41:58.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:57 smithi172 ceph-mon[33377]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.180+0000 7fee6ea00700 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559aa7357770 0x559aa7356480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:41:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.181+0000 7fee6ea00700 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559aa7357770 0x559aa7356480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a272cddc3489c96a server_cookie=9ee72be73a4c95f5 in_seq=0 out_seq=0 2024-05-08T06:41:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.181+0000 7fee58c00700 10 client.14682 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:41:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee58c00700 1 -- 172.21.15.70:0/954409936 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559aa722e3b0 con 0x559aa7357770 2024-05-08T06:41:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee58c00700 10 client.14682 handle_command_reply: tid=0 2024-05-08T06:41:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 client.14682 shutdown 2024-05-08T06:41:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 -- 172.21.15.70:0/954409936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 msgr2=0x559aa72cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cd040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0139a0 tx=0x7fee5c013f90 comp rx=0 tx=0).stop 2024-05-08T06:41:58.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 -- 172.21.15.70:0/954409936 shutdown_connections 2024-05-08T06:41:58.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559aa7357770 0x559aa7356480 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559aa72d42b0 0x559aa72cdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559aa72ce5b0 0x559aa72cd040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 --2- 172.21.15.70:0/954409936 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559aa72d3990 0x559aa72cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee58c00700 0 client.14682 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:41:58.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 -- 172.21.15.70:0/954409936 >> 172.21.15.70:0/954409936 conn(0x559aa71fcb10 msgr2=0x559aa72d14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:58.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.182+0000 7fee800f0b80 1 -- 172.21.15.70:0/954409936 shutdown_connections 2024-05-08T06:41:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.183+0000 7fee800f0b80 1 -- 172.21.15.70:0/954409936 wait complete. 2024-05-08T06:41:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.183+0000 7fee800f0b80 20 client.14682 trim_cache size 0 max 16384 2024-05-08T06:41:58.186 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:41:58.186 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:41:58.186 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-05-08T06:41:58.187 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34442, 2024-05-08T06:41:58.187 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:41:58.187 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:41:58.187 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:41:58.187 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 44.596786334000001, 2024-05-08T06:41:58.187 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 17, 2024-05-08T06:41:58.187 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 88, 2024-05-08T06:41:58.187 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 87, 2024-05-08T06:41:58.188 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 67.576503979999998 2024-05-08T06:41:58.188 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:41:58.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 -- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee540b2900 msgr2=0x7fee540b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:58.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee540b2900 0x7fee540b4dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee680a5000 tx=0x7fee68004e10 comp rx=0 tx=0).stop 2024-05-08T06:41:58.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 -- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 msgr2=0x7fee701a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:41:58.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 0x7fee701a4840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fee6800ada0 tx=0x7fee6800c330 comp rx=0 tx=0).stop 2024-05-08T06:41:58.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 -- 172.21.15.70:0/1867747691 shutdown_connections 2024-05-08T06:41:58.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee540b2900 0x7fee540b4dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee7010e8b0 0x7fee701a4840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee701099e0 0x7fee7019ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 --2- 172.21.15.70:0/1867747691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee7010a3a0 0x7fee701a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:41:58.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 -- 172.21.15.70:0/1867747691 >> 172.21.15.70:0/1867747691 conn(0x7fee70079230 msgr2=0x7fee70079850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:41:58.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 -- 172.21.15.70:0/1867747691 shutdown_connections 2024-05-08T06:41:58.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:41:58.184+0000 7fee6fe00700 1 -- 172.21.15.70:0/1867747691 wait complete. 2024-05-08T06:41:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:57 smithi194 ceph-mon[33679]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:41:59.039 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T06:41:59.039 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-08T06:41:59.039 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-08T06:41:59.477 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:41:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:41:59 smithi070 ceph-mon[29591]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:41:59 smithi172 ceph-mon[33377]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:00.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:41:59 smithi194 ceph-mon[33679]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.818+0000 7f947a400700 1 -- 172.21.15.70:0/2199667095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94741099e0 msgr2=0x7f9474109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.818+0000 7f947a400700 1 --2- 172.21.15.70:0/2199667095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94741099e0 0x7f9474109e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9460009990 tx=0x7f9460009ca0 comp rx=0 tx=0).stop 2024-05-08T06:42:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.818+0000 7f947a400700 1 -- 172.21.15.70:0/2199667095 shutdown_connections 2024-05-08T06:42:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.818+0000 7f947a400700 1 --2- 172.21.15.70:0/2199667095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f947410a3a0 0x7f9474116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.818+0000 7f947a400700 1 --2- 172.21.15.70:0/2199667095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f947410e8b0 0x7f947410ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.818+0000 7f947a400700 1 --2- 172.21.15.70:0/2199667095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94741099e0 0x7f9474109e60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.818+0000 7f947a400700 1 -- 172.21.15.70:0/2199667095 >> 172.21.15.70:0/2199667095 conn(0x7f9474079230 msgr2=0x7f94741082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:01.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.818+0000 7f947a400700 1 -- 172.21.15.70:0/2199667095 shutdown_connections 2024-05-08T06:42:01.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.818+0000 7f947a400700 1 -- 172.21.15.70:0/2199667095 wait complete. 2024-05-08T06:42:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.819+0000 7f947a400700 1 Processor -- start 2024-05-08T06:42:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.819+0000 7f947a400700 1 -- start start 2024-05-08T06:42:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.820+0000 7f947a400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94741099e0 0x7f94741a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.820+0000 7f947a400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f947410a3a0 0x7f94741a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.820+0000 7f947a400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f947410e8b0 0x7f94741a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:01.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.820+0000 7f947a400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9474119b70 con 0x7f947410a3a0 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.820+0000 7f947a400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f94741199f0 con 0x7f94741099e0 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.820+0000 7f947a400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9474119cf0 con 0x7f947410e8b0 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.820+0000 7f9473e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f947410a3a0 0x7f94741a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.820+0000 7f9473e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f947410a3a0 0x7f94741a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58574/0 (socket says 172.21.15.70:58574) 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.820+0000 7f9473e00700 1 -- 172.21.15.70:0/1562571858 learned_addr learned my addr 172.21.15.70:0/1562571858 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.821+0000 7f9479a00700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f947410e8b0 0x7f94741a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.821+0000 7f9479000700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94741099e0 0x7f94741a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.821+0000 7f9473e00700 1 -- 172.21.15.70:0/1562571858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f947410e8b0 msgr2=0x7f94741a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.821+0000 7f9473e00700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f947410e8b0 0x7f94741a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.821+0000 7f9473e00700 1 -- 172.21.15.70:0/1562571858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94741099e0 msgr2=0x7f94741a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.821+0000 7f9473e00700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94741099e0 0x7f94741a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.821+0000 7f9473e00700 1 -- 172.21.15.70:0/1562571858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94741a5170 con 0x7f947410a3a0 2024-05-08T06:42:01.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.821+0000 7f9479000700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94741099e0 0x7f94741a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:42:01.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.821+0000 7f9473e00700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f947410a3a0 0x7f94741a06a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9460000c00 tx=0x7f94600036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.822+0000 7f9471600700 1 -- 172.21.15.70:0/1562571858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9460027070 con 0x7f947410a3a0 2024-05-08T06:42:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.822+0000 7f9471600700 1 -- 172.21.15.70:0/1562571858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f946000fc80 con 0x7f947410a3a0 2024-05-08T06:42:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.822+0000 7f9471600700 1 -- 172.21.15.70:0/1562571858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9460022d60 con 0x7f947410a3a0 2024-05-08T06:42:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.822+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94741a5400 con 0x7f947410a3a0 2024-05-08T06:42:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.822+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94741acce0 con 0x7f947410a3a0 2024-05-08T06:42:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.823+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f947410b0d0 con 0x7f947410a3a0 2024-05-08T06:42:01.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.825+0000 7f9471600700 1 -- 172.21.15.70:0/1562571858 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f946002a070 con 0x7f947410a3a0 2024-05-08T06:42:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.827+0000 7f9471600700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f945c0b2900 0x7f945c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.827+0000 7f9471600700 1 -- 172.21.15.70:0/1562571858 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7f94600e3580 con 0x7f947410a3a0 2024-05-08T06:42:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.827+0000 7f9479000700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f945c0b2900 0x7f945c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.828+0000 7f9479000700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f945c0b2900 0x7f945c0b4dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94680099d0 tx=0x7f9468008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:01.829+0000 7f9471600700 1 -- 172.21.15.70:0/1562571858 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9460031080 con 0x7f947410a3a0 2024-05-08T06:42:02.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.114+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f947402e510 con 0x7f947410a3a0 2024-05-08T06:42:02.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:01 smithi070 ceph-mon[29591]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:02.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.116+0000 7f9471600700 1 -- 172.21.15.70:0/1562571858 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f9460013070 con 0x7f947410a3a0 2024-05-08T06:42:02.114 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-08T06:42:02.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f945c0b2900 msgr2=0x7f945c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:02.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f945c0b2900 0x7f945c0b4dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f94680099d0 tx=0x7f9468008040 comp rx=0 tx=0).stop 2024-05-08T06:42:02.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f947410a3a0 msgr2=0x7f94741a06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:02.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f947410a3a0 0x7f94741a06a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9460000c00 tx=0x7f94600036f0 comp rx=0 tx=0).stop 2024-05-08T06:42:02.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 shutdown_connections 2024-05-08T06:42:02.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f947410e8b0 0x7f94741a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:02.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94741099e0 0x7f94741a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:02.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f945c0b2900 0x7f945c0b4dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:02.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 --2- 172.21.15.70:0/1562571858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f947410a3a0 0x7f94741a06a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:02.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.119+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 >> 172.21.15.70:0/1562571858 conn(0x7f9474079230 msgr2=0x7f94740799b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:02.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.120+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 shutdown_connections 2024-05-08T06:42:02.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:02.120+0000 7f947a400700 1 -- 172.21.15.70:0/1562571858 wait complete. 2024-05-08T06:42:02.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:01 smithi172 ceph-mon[33377]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:02.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:01 smithi194 ceph-mon[33679]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:03.000 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-08T06:42:03.000 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T06:42:03.001 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-05-08T06:42:03.001 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-08T06:42:03.001 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-08T06:42:03.001 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-08T06:42:03.001 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T06:42:03.001 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T06:42:03.001 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-08T06:42:03.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:03.001 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-05-08T06:42:03.044 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T06:42:03.044 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T06:42:03.044 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T06:42:03.044 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-05-08T06:42:03.044 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-05-08T06:42:03.044 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-05-08T06:42:03.044 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 41807sec preferred_lft 41807sec 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2024-05-08T06:42:03.045 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-05-08T06:42:03.046 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T06:42:03.046 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:42:03.046 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:42:03.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2024-05-08T06:42:03.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2024-05-08T06:42:03.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2024-05-08T06:42:03.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T06:42:03.047 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:42:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:02 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1562571858' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T06:42:03.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:02 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1562571858' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T06:42:03.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:42:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:02 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1562571858' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T06:42:03.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:42:03.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:03.564 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T06:42:03.667 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-05-08T06:42:03.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:03.671 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-05-08T06:42:03.719 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-05-08T06:42:03.720 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T06:42:03.720 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T06:42:03.720 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T06:42:03.720 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T06:42:03.720 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:42:03.720 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:42:03.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T06:42:03.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T06:42:03.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T06:42:03.721 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:42:03.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:42:04.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:03 smithi070 ceph-mon[29591]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:04.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:42:04.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:03 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:03 smithi172 ceph-mon[33377]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:42:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:03 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:03 smithi194 ceph-mon[33679]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:42:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:03 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:04.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:42:04.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:04.431 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-05-08T06:42:04.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:04.471 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-05-08T06:42:04.565 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:42:04.565 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:42:04.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T06:42:04.565 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-08T06:42:04.565 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:42:04.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:42:04.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:42:04.725 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-08T06:42:04.726 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:42:04.726 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:42:04.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-08T06:42:04.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T06:42:04.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-08T06:42:04.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-08T06:42:04.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-08T06:42:04.726 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:42:04.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:42:05.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:42:05.045 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:42:05.045 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:42:05.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-05-08T06:42:05.046 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T06:42:05.046 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:42:05.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:42:05.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:42:05.235 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-08T06:42:05.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T06:42:05.235 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-08T06:42:05.277 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-08T06:42:05.278 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T06:42:05.278 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-08T06:42:05.372 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-05-08T06:42:05.455 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-05-08T06:42:05.504 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-05-08T06:42:05.505 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b4a8edcb24d9d655fcaefcd39e7d7b71b1cfa09ccd8802ce84fc184cf8c06267/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f77284b4a9f567b8b19e1728223ccb67a2c3489f6ca434e74d357aebc3141f2d/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/124a976ca75d339f2de0a8dcec4e1dc965314a07f28358ade40af9b891dc6247/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3da86a999b7ffb4cec02fde65264a099feb7296de5c64829b7e7489ae4677e14/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/26b56bc5a05fc50c1859e33f4a496242c7dd74dd9379acca6f789d32d6893a7c/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4f01bacc3d227e0ec94a1443ac524da60bd1a858c00dfc1e9d68e028ae3a34ba/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/7821f96c5423e566bbc11214870d5933f13d0c8be34c5eb9d6bd098043ec89b9/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/1440d4f30d5ef401fd90ce09c1249261f41ac21d83580186f9f28c725e5fc5db/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5071b48145490d961cbeae05c31e0db9b7afd4633599b44d29b77377739cbda4/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/20c52de6a7f3cad6f8892bd6359f58bc7093216411202a4925921cb4fc288190/merged 2024-05-08T06:42:05.506 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-05-08T06:42:05.507 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T06:42:05.507 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T06:42:05.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:05.508 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-05-08T06:42:05.550 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T06:42:05.550 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-08T06:42:05.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-05-08T06:42:05.664 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T06:42:05.705 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-05-08T06:42:05.705 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-05-08T06:42:05.705 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-05-08T06:42:05.705 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-05-08T06:42:05.705 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-05-08T06:42:05.706 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b4a8edcb24d9d655fcaefcd39e7d7b71b1cfa09ccd8802ce84fc184cf8c06267/merged 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f77284b4a9f567b8b19e1728223ccb67a2c3489f6ca434e74d357aebc3141f2d/merged 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-05-08T06:42:05.707 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/124a976ca75d339f2de0a8dcec4e1dc965314a07f28358ade40af9b891dc6247/merged 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3da86a999b7ffb4cec02fde65264a099feb7296de5c64829b7e7489ae4677e14/merged 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/26b56bc5a05fc50c1859e33f4a496242c7dd74dd9379acca6f789d32d6893a7c/merged 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4f01bacc3d227e0ec94a1443ac524da60bd1a858c00dfc1e9d68e028ae3a34ba/merged 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/7821f96c5423e566bbc11214870d5933f13d0c8be34c5eb9d6bd098043ec89b9/merged 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/1440d4f30d5ef401fd90ce09c1249261f41ac21d83580186f9f28c725e5fc5db/merged 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5071b48145490d961cbeae05c31e0db9b7afd4633599b44d29b77377739cbda4/merged 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/20c52de6a7f3cad6f8892bd6359f58bc7093216411202a4925921cb4fc288190/merged 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T06:42:05.708 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T06:42:05.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:05.709 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-05-08T06:42:05.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:2024-05-08T06:42:05.823+0000 7fe70161b480 -1 init, newargv = 0x5586930262f0 newargc=15 2024-05-08T06:42:05.823 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:ceph-fuse[75402]: starting ceph client 2024-05-08T06:42:05.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:ceph-fuse[75402]: starting fuse 2024-05-08T06:42:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:05 smithi070 ceph-mon[29591]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:06.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:05 smithi172 ceph-mon[33377]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:06.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:05 smithi194 ceph-mon[33679]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:06.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-05-08T06:42:06.982 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T06:42:07.034 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-05-08T06:42:07.034 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-05-08T06:42:07.034 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-05-08T06:42:07.034 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-05-08T06:42:07.035 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b4a8edcb24d9d655fcaefcd39e7d7b71b1cfa09ccd8802ce84fc184cf8c06267/merged 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f77284b4a9f567b8b19e1728223ccb67a2c3489f6ca434e74d357aebc3141f2d/merged 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/124a976ca75d339f2de0a8dcec4e1dc965314a07f28358ade40af9b891dc6247/merged 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3da86a999b7ffb4cec02fde65264a099feb7296de5c64829b7e7489ae4677e14/merged 2024-05-08T06:42:07.036 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/26b56bc5a05fc50c1859e33f4a496242c7dd74dd9379acca6f789d32d6893a7c/merged 2024-05-08T06:42:07.037 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4f01bacc3d227e0ec94a1443ac524da60bd1a858c00dfc1e9d68e028ae3a34ba/merged 2024-05-08T06:42:07.037 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/7821f96c5423e566bbc11214870d5933f13d0c8be34c5eb9d6bd098043ec89b9/merged 2024-05-08T06:42:07.037 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/1440d4f30d5ef401fd90ce09c1249261f41ac21d83580186f9f28c725e5fc5db/merged 2024-05-08T06:42:07.037 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5071b48145490d961cbeae05c31e0db9b7afd4633599b44d29b77377739cbda4/merged 2024-05-08T06:42:07.037 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/20c52de6a7f3cad6f8892bd6359f58bc7093216411202a4925921cb4fc288190/merged 2024-05-08T06:42:07.037 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-05-08T06:42:07.037 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T06:42:07.037 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T06:42:07.037 INFO:teuthology.orchestra.run.smithi070.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-08T06:42:07.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:07.038 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-05-08T06:42:07.087 INFO:teuthology.orchestra.run.smithi070.stdout:114 2024-05-08T06:42:07.088 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> import re 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> import os 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2024-05-08T06:42:07.088 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> return f 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> 2024-05-08T06:42:07.089 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.admin")) 2024-05-08T06:42:07.090 DEBUG:teuthology.orchestra.run.smithi070:> ' 2024-05-08T06:42:07.248 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.admin.75402.asok 2024-05-08T06:42:07.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:42:07.264 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75402.asok 2024-05-08T06:42:07.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:07.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75402.asok status 2024-05-08T06:42:07.486 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:42:07.486 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2024-05-08T06:42:07.486 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "bee299f4ac344e4c45e550d7a80abcadd7bc3d5a", 2024-05-08T06:42:07.486 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T06:42:07.486 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "admin", 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "75402", 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/" 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 14691, 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 14691 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-05-08T06:42:07.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3132362243 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3132362243 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.14691 192.168.0.1:0/3132362243", 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/3132362243", 2024-05-08T06:42:07.488 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 1, 2024-05-08T06:42:07.489 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 17, 2024-05-08T06:42:07.489 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 88, 2024-05-08T06:42:07.489 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2024-05-08T06:42:07.489 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2024-05-08T06:42:07.489 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2024-05-08T06:42:07.489 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:42:07.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:07.502 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2024-05-08T06:42:07.502 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-08T06:42:07.543 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2024-05-08T06:42:07.544 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-08T06:42:07.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:07.544 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-08T06:42:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:07 smithi070 ceph-mon[29591]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:07 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.667 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-08T06:42:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:07 smithi172 ceph-mon[33377]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:07 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:07 smithi194 ceph-mon[33679]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:07 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:07.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T06:42:07.851 INFO:teuthology.orchestra.run.smithi070.stdout:# file: . 2024-05-08T06:42:07.852 INFO:teuthology.orchestra.run.smithi070.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-08T06:42:07.852 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:42:07.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:42:07.861 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:42:07.861 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T06:42:07.900 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-08T06:42:08.372 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:08.737 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:08 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:42:08.738 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:08 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:42:08.738 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:08 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:08 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:42:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:08 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:42:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:08 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:08.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:08 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:42:08.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:08 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:42:08.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:08 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:42:10.115 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:09 smithi070 ceph-mon[29591]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:09 smithi172 ceph-mon[33377]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:09 smithi194 ceph-mon[33679]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:10.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.980+0000 7ff8ab000700 1 -- 172.21.15.70:0/3096967921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a41055d0 msgr2=0x7ff8a4105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:10.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.980+0000 7ff8ab000700 1 --2- 172.21.15.70:0/3096967921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a41055d0 0x7ff8a4105a50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff890009990 tx=0x7ff890009ca0 comp rx=0 tx=0).stop 2024-05-08T06:42:10.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.980+0000 7ff8ab000700 1 -- 172.21.15.70:0/3096967921 shutdown_connections 2024-05-08T06:42:10.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.980+0000 7ff8ab000700 1 --2- 172.21.15.70:0/3096967921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a4105f90 0x7ff8a41124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:10.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.980+0000 7ff8ab000700 1 --2- 172.21.15.70:0/3096967921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a410b660 0x7ff8a410ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:10.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.980+0000 7ff8ab000700 1 --2- 172.21.15.70:0/3096967921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a41055d0 0x7ff8a4105a50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:10.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.980+0000 7ff8ab000700 1 -- 172.21.15.70:0/3096967921 >> 172.21.15.70:0/3096967921 conn(0x7ff8a41010c0 msgr2=0x7ff8a41034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:10.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.980+0000 7ff8ab000700 1 -- 172.21.15.70:0/3096967921 shutdown_connections 2024-05-08T06:42:10.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.980+0000 7ff8ab000700 1 -- 172.21.15.70:0/3096967921 wait complete. 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.981+0000 7ff8ab000700 1 Processor -- start 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.981+0000 7ff8ab000700 1 -- start start 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.982+0000 7ff8ab000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a41055d0 0x7ff8a41a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.982+0000 7ff8ab000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a4105f90 0x7ff8a41a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.982+0000 7ff8ab000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a410b660 0x7ff8a419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.982+0000 7ff8ab000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a41156c0 con 0x7ff8a4105f90 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.982+0000 7ff8ab000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4115540 con 0x7ff8a410b660 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.982+0000 7ff8ab000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4115840 con 0x7ff8a41055d0 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.982+0000 7ff8a9200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a4105f90 0x7ff8a41a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.982+0000 7ff8a9200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a4105f90 0x7ff8a41a1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54868/0 (socket says 172.21.15.70:54868) 2024-05-08T06:42:10.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.982+0000 7ff8a9200700 1 -- 172.21.15.70:0/566241114 learned_addr learned my addr 172.21.15.70:0/566241114 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:10.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.983+0000 7ff8a9c00700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a41055d0 0x7ff8a41a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:10.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.983+0000 7ff8aa600700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a410b660 0x7ff8a419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:10.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.983+0000 7ff8a9200700 1 -- 172.21.15.70:0/566241114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a41055d0 msgr2=0x7ff8a41a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.983+0000 7ff8a9200700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a41055d0 0x7ff8a41a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.983+0000 7ff8a9200700 1 -- 172.21.15.70:0/566241114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a410b660 msgr2=0x7ff8a419b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.983+0000 7ff8a9200700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a410b660 0x7ff8a419b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.983+0000 7ff8a9200700 1 -- 172.21.15.70:0/566241114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a419c0a0 con 0x7ff8a4105f90 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.983+0000 7ff8a9200700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a4105f90 0x7ff8a41a1c70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff8900057f0 tx=0x7ff890009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.984+0000 7ff8a2000700 1 -- 172.21.15.70:0/566241114 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890027070 con 0x7ff8a4105f90 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.984+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a419c330 con 0x7ff8a4105f90 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.984+0000 7ff8a2000700 1 -- 172.21.15.70:0/566241114 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff89000fc80 con 0x7ff8a4105f90 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.984+0000 7ff8a2000700 1 -- 172.21.15.70:0/566241114 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890022c70 con 0x7ff8a4105f90 2024-05-08T06:42:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.984+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a41a8600 con 0x7ff8a4105f90 2024-05-08T06:42:10.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.985+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a406a190 con 0x7ff8a4105f90 2024-05-08T06:42:10.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.989+0000 7ff8a2000700 1 -- 172.21.15.70:0/566241114 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff89002a070 con 0x7ff8a4105f90 2024-05-08T06:42:10.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.990+0000 7ff8a2000700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff88c0b2900 0x7ff88c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:10.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.990+0000 7ff8a2000700 1 -- 172.21.15.70:0/566241114 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8802+0+0 (secure 0 0 0) 0x7ff8900e3670 con 0x7ff8a4105f90 2024-05-08T06:42:10.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.991+0000 7ff8a9c00700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff88c0b2900 0x7ff88c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:10.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.991+0000 7ff8a9c00700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff88c0b2900 0x7ff88c0b4dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff8a410a8e0 tx=0x7ff89800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:10.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:10.993+0000 7ff8a2000700 1 -- 172.21.15.70:0/566241114 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff890031080 con 0x7ff8a4105f90 2024-05-08T06:42:11.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.240+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff8a419ce20 con 0x7ff8a4105f90 2024-05-08T06:42:11.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.241+0000 7ff8a2000700 1 -- 172.21.15.70:0/566241114 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+591 (secure 0 0 0) 0x7ff890013070 con 0x7ff8a4105f90 2024-05-08T06:42:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1348548569 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1348548569 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2786047947 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2185065524 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/2822740915 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3587006025 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3060551286 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:11.241 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/2822740915 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:11.242 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/902378241 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:11.242 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3911583705 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:11.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.244+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff88c0b2900 msgr2=0x7ff88c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:11.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.244+0000 7ff8ab000700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff88c0b2900 0x7ff88c0b4dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff8a410a8e0 tx=0x7ff89800a3b0 comp rx=0 tx=0).stop 2024-05-08T06:42:11.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.244+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a4105f90 msgr2=0x7ff8a41a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:11.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.244+0000 7ff8ab000700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a4105f90 0x7ff8a41a1c70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff8900057f0 tx=0x7ff890009ee0 comp rx=0 tx=0).stop 2024-05-08T06:42:11.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.245+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 shutdown_connections 2024-05-08T06:42:11.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.245+0000 7ff8ab000700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8a410b660 0x7ff8a419b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.245+0000 7ff8ab000700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8a41055d0 0x7ff8a41a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.245+0000 7ff8ab000700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff88c0b2900 0x7ff88c0b4dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.245+0000 7ff8ab000700 1 --2- 172.21.15.70:0/566241114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8a4105f90 0x7ff8a41a1c70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.245+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 >> 172.21.15.70:0/566241114 conn(0x7ff8a41010c0 msgr2=0x7ff8a41026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.245+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 shutdown_connections 2024-05-08T06:42:11.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:11.245+0000 7ff8ab000700 1 -- 172.21.15.70:0/566241114 wait complete. 2024-05-08T06:42:11.246 INFO:teuthology.orchestra.run.smithi070.stderr:listed 10 entries 2024-05-08T06:42:12.074 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:11 smithi070 ceph-mon[29591]: pgmap v406: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-08T06:42:12.074 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:11 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/566241114' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T06:42:12.148 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:42:12.148 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T06:42:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:11 smithi172 ceph-mon[33377]: pgmap v406: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-08T06:42:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:11 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/566241114' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T06:42:12.206 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-08T06:42:12.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:11 smithi194 ceph-mon[33679]: pgmap v406: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-08T06:42:12.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:11 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/566241114' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T06:42:12.653 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:13 smithi070 ceph-mon[29591]: pgmap v407: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-08T06:42:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:13 smithi172 ceph-mon[33377]: pgmap v407: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-08T06:42:14.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:13 smithi194 ceph-mon[33679]: pgmap v407: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-08T06:42:14.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.991+0000 7ff13f400700 1 -- 172.21.15.70:0/2904570481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 msgr2=0x7ff138106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:14.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.991+0000 7ff13f400700 1 --2- 172.21.15.70:0/2904570481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 0x7ff138106370 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff13000b0a0 tx=0x7ff13000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:42:14.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.991+0000 7ff13f400700 1 -- 172.21.15.70:0/2904570481 shutdown_connections 2024-05-08T06:42:14.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.991+0000 7ff13f400700 1 --2- 172.21.15.70:0/2904570481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 0x7ff138106370 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:14.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.991+0000 7ff13f400700 1 --2- 172.21.15.70:0/2904570481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1381083d0 0x7ff13806b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:14.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.991+0000 7ff13f400700 1 --2- 172.21.15.70:0/2904570481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff13806b6f0 0x7ff13806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:14.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.991+0000 7ff13f400700 1 -- 172.21.15.70:0/2904570481 >> 172.21.15.70:0/2904570481 conn(0x7ff138079350 msgr2=0x7ff138079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:14.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.991+0000 7ff13f400700 1 -- 172.21.15.70:0/2904570481 shutdown_connections 2024-05-08T06:42:14.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.991+0000 7ff13f400700 1 -- 172.21.15.70:0/2904570481 wait complete. 2024-05-08T06:42:14.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.992+0000 7ff13f400700 1 Processor -- start 2024-05-08T06:42:14.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.992+0000 7ff13f400700 1 -- start start 2024-05-08T06:42:14.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff13f400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13806b6f0 0x7ff1381a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff13f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 0x7ff1381a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff13f400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1381083d0 0x7ff1381a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff13f400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff138119b10 con 0x7ff138105ee0 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff13f400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff138119990 con 0x7ff1381083d0 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff13f400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff138119c90 con 0x7ff13806b6f0 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff12fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 0x7ff1381a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff12fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 0x7ff1381a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54898/0 (socket says 172.21.15.70:54898) 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff12fe00700 1 -- 172.21.15.70:0/1511040748 learned_addr learned my addr 172.21.15.70:0/1511040748 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff13ca00700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13806b6f0 0x7ff1381a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff13d400700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1381083d0 0x7ff1381a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff12fe00700 1 -- 172.21.15.70:0/1511040748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13806b6f0 msgr2=0x7ff1381a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff12fe00700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13806b6f0 0x7ff1381a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:14.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff12fe00700 1 -- 172.21.15.70:0/1511040748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1381083d0 msgr2=0x7ff1381a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:14.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff12fe00700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1381083d0 0x7ff1381a4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:14.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.993+0000 7ff12fe00700 1 -- 172.21.15.70:0/1511040748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1381a50b0 con 0x7ff138105ee0 2024-05-08T06:42:14.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.994+0000 7ff12fe00700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 0x7ff1381a05e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff12000d950 tx=0x7ff12000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:14.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.994+0000 7ff136000700 1 -- 172.21.15.70:0/1511040748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120016070 con 0x7ff138105ee0 2024-05-08T06:42:14.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.994+0000 7ff136000700 1 -- 172.21.15.70:0/1511040748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff120010460 con 0x7ff138105ee0 2024-05-08T06:42:14.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.994+0000 7ff136000700 1 -- 172.21.15.70:0/1511040748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12000f620 con 0x7ff138105ee0 2024-05-08T06:42:14.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.994+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1381a53a0 con 0x7ff138105ee0 2024-05-08T06:42:14.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.994+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1381acc20 con 0x7ff138105ee0 2024-05-08T06:42:14.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.995+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff13806a190 con 0x7ff138105ee0 2024-05-08T06:42:14.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.998+0000 7ff136000700 1 -- 172.21.15.70:0/1511040748 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff120019070 con 0x7ff138105ee0 2024-05-08T06:42:14.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.999+0000 7ff136000700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff11c0b2900 0x7ff11c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:14.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.999+0000 7ff136000700 1 -- 172.21.15.70:0/1511040748 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff1200e21a0 con 0x7ff138105ee0 2024-05-08T06:42:15.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:14.999+0000 7ff13ca00700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff11c0b2900 0x7ff11c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:15.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.000+0000 7ff13ca00700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff11c0b2900 0x7ff11c0b4dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff128005fd0 tx=0x7ff128005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:15.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.004+0000 7ff136000700 1 -- 172.21.15.70:0/1511040748 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff1200a9b00 con 0x7ff138105ee0 2024-05-08T06:42:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-05-08T06:42:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-05-08T06:42:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]: dispatch 2024-05-08T06:42:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-05-08T06:42:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-05-08T06:42:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-05-08T06:42:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-05-08T06:42:15.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]: dispatch 2024-05-08T06:42:15.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-05-08T06:42:15.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-05-08T06:42:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-05-08T06:42:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-05-08T06:42:15.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]: dispatch 2024-05-08T06:42:15.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-05-08T06:42:15.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-05-08T06:42:15.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-05-08T06:42:15.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-05-08T06:42:15.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]: dispatch 2024-05-08T06:42:15.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-05-08T06:42:15.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-05-08T06:42:15.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.255+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff1381a1400 con 0x7ff138105ee0 2024-05-08T06:42:15.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.256+0000 7ff136000700 1 -- 172.21.15.70:0/1511040748 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+591 (secure 0 0 0) 0x7ff1381a1400 con 0x7ff138105ee0 2024-05-08T06:42:15.256 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1348548569 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:15.256 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1348548569 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:15.256 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2786047947 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:15.256 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2185065524 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:15.256 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/2822740915 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:15.256 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3587006025 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:15.256 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3060551286 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:15.256 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/2822740915 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:15.256 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/902378241 2024-05-09T06:31:13.904560+0000 2024-05-08T06:42:15.257 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3911583705 2024-05-09T06:30:38.292099+0000 2024-05-08T06:42:15.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff11c0b2900 msgr2=0x7ff11c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:15.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff11c0b2900 0x7ff11c0b4dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff128005fd0 tx=0x7ff128005db0 comp rx=0 tx=0).stop 2024-05-08T06:42:15.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 msgr2=0x7ff1381a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:15.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 0x7ff1381a05e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff12000d950 tx=0x7ff12000dd10 comp rx=0 tx=0).stop 2024-05-08T06:42:15.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 shutdown_connections 2024-05-08T06:42:15.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff1381083d0 0x7ff1381a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:15.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13806b6f0 0x7ff1381a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:15.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff11c0b2900 0x7ff11c0b4dc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:15.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 --2- 172.21.15.70:0/1511040748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff138105ee0 0x7ff1381a05e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:15.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.259+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 >> 172.21.15.70:0/1511040748 conn(0x7ff138079350 msgr2=0x7ff138102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:15.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.260+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 shutdown_connections 2024-05-08T06:42:15.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:15.260+0000 7ff13f400700 1 -- 172.21.15.70:0/1511040748 wait complete. 2024-05-08T06:42:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-05-08T06:42:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-05-08T06:42:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]: dispatch 2024-05-08T06:42:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-05-08T06:42:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-05-08T06:42:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-05-08T06:42:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-05-08T06:42:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]: dispatch 2024-05-08T06:42:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-05-08T06:42:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-05-08T06:42:15.261 INFO:teuthology.orchestra.run.smithi070.stderr:listed 10 entries 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: pgmap v408: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]': finished 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]': finished 2024-05-08T06:42:16.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-05-08T06:42:16.093 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-05-08T06:42:16.093 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: osdmap e89: 12 total, 12 up, 12 in 2024-05-08T06:42:16.093 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:15 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1511040748' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T06:42:16.151 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2024-05-08T06:42:16.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:16.152 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-08T06:42:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: pgmap v408: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: osdmap e89: 12 total, 12 up, 12 in 2024-05-08T06:42:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:15 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1511040748' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T06:42:16.239 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi070.stderr:ceph-fuse[75402]: fuse finished with error 0 and tester_r 0 2024-05-08T06:42:16.243 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T06:42:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: pgmap v408: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-08T06:42:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-05-08T06:42:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-05-08T06:42:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 7]}]': finished 2024-05-08T06:42:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-05-08T06:42:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-05-08T06:42:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-05-08T06:42:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-05-08T06:42:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [5, 10]}]': finished 2024-05-08T06:42:16.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-05-08T06:42:16.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-05-08T06:42:16.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: osdmap e89: 12 total, 12 up, 12 in 2024-05-08T06:42:16.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:15 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1511040748' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T06:42:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:16 smithi070 ceph-mon[29591]: osdmap e90: 12 total, 12 up, 12 in 2024-05-08T06:42:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:16 smithi172 ceph-mon[33377]: osdmap e90: 12 total, 12 up, 12 in 2024-05-08T06:42:17.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:16 smithi194 ceph-mon[33679]: osdmap e90: 12 total, 12 up, 12 in 2024-05-08T06:42:18.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:17 smithi070 ceph-mon[29591]: pgmap v411: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-08T06:42:18.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:17 smithi070 ceph-mon[29591]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-08T06:42:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:17 smithi172 ceph-mon[33377]: pgmap v411: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-08T06:42:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:17 smithi172 ceph-mon[33377]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-08T06:42:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:17 smithi194 ceph-mon[33679]: pgmap v411: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-08T06:42:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:17 smithi194 ceph-mon[33679]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-08T06:42:20.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:19 smithi070 ceph-mon[29591]: pgmap v412: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:19 smithi172 ceph-mon[33377]: pgmap v412: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:19 smithi194 ceph-mon[33679]: pgmap v412: 129 pgs: 2 peering, 127 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:20 smithi172 ceph-mon[33377]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-08T06:42:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:20 smithi172 ceph-mon[33377]: Cluster is now healthy 2024-05-08T06:42:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:20 smithi194 ceph-mon[33679]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-08T06:42:21.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:20 smithi194 ceph-mon[33679]: Cluster is now healthy 2024-05-08T06:42:21.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:20 smithi070 ceph-mon[29591]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-08T06:42:21.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:20 smithi070 ceph-mon[29591]: Cluster is now healthy 2024-05-08T06:42:22.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:21 smithi172 ceph-mon[33377]: pgmap v413: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-08T06:42:22.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:21 smithi194 ceph-mon[33679]: pgmap v413: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-08T06:42:22.344 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T06:42:22.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:42:22.345 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-08T06:42:22.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:21 smithi070 ceph-mon[29591]: pgmap v413: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-08T06:42:22.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:42:22.903 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:24.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:23 smithi194 ceph-mon[33679]: pgmap v414: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-08T06:42:24.300 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:23 smithi070 ceph-mon[29591]: pgmap v414: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-08T06:42:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:23 smithi172 ceph-mon[33377]: pgmap v414: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 127 B/s wr, 0 op/s 2024-05-08T06:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.217+0000 7f984e600700 1 -- 172.21.15.70:0/2387932905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848103750 msgr2=0x7f9848103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.217+0000 7f984e600700 1 --2- 172.21.15.70:0/2387932905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848103750 0x7f9848103b30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98380099c0 tx=0x7f9838009cd0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.217+0000 7f984e600700 1 -- 172.21.15.70:0/2387932905 shutdown_connections 2024-05-08T06:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.217+0000 7f984e600700 1 --2- 172.21.15.70:0/2387932905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848108850 0x7f98481103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.217+0000 7f984e600700 1 --2- 172.21.15.70:0/2387932905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848103750 0x7f9848103b30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.217+0000 7f984e600700 1 --2- 172.21.15.70:0/2387932905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848104100 0x7f9848108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.217+0000 7f984e600700 1 -- 172.21.15.70:0/2387932905 >> 172.21.15.70:0/2387932905 conn(0x7f984807a600 msgr2=0x7f984807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.217+0000 7f984e600700 1 -- 172.21.15.70:0/2387932905 shutdown_connections 2024-05-08T06:42:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.217+0000 7f984e600700 1 -- 172.21.15.70:0/2387932905 wait complete. 2024-05-08T06:42:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.219+0000 7f984e600700 1 Processor -- start 2024-05-08T06:42:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.219+0000 7f984e600700 1 -- start start 2024-05-08T06:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.219+0000 7f984e600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848103750 0x7f984819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.219+0000 7f984e600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848104100 0x7f984819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.219+0000 7f984e600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848108850 0x7f9848199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.219+0000 7f984e600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9848113520 con 0x7f9848104100 2024-05-08T06:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.219+0000 7f984e600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f98481133a0 con 0x7f9848103750 2024-05-08T06:42:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.219+0000 7f984e600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f98481136a0 con 0x7f9848108850 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f983ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848104100 0x7f984819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f983ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848104100 0x7f984819fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38334/0 (socket says 172.21.15.70:38334) 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f983ea00700 1 -- 172.21.15.70:0/1184199863 learned_addr learned my addr 172.21.15.70:0/1184199863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f9847e00700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848108850 0x7f9848199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f9847400700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848103750 0x7f984819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f983ea00700 1 -- 172.21.15.70:0/1184199863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848108850 msgr2=0x7f9848199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f983ea00700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848108850 0x7f9848199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f983ea00700 1 -- 172.21.15.70:0/1184199863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848103750 msgr2=0x7f984819f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f983ea00700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848103750 0x7f984819f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.220+0000 7f983ea00700 1 -- 172.21.15.70:0/1184199863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f984819a000 con 0x7f9848104100 2024-05-08T06:42:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.221+0000 7f983ea00700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848104100 0x7f984819fb90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f983000d950 tx=0x7f983000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.221+0000 7f9844c00700 1 -- 172.21.15.70:0/1184199863 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830016070 con 0x7f9848104100 2024-05-08T06:42:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.221+0000 7f9844c00700 1 -- 172.21.15.70:0/1184199863 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9830010460 con 0x7f9848104100 2024-05-08T06:42:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.221+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f984819a2f0 con 0x7f9848104100 2024-05-08T06:42:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.221+0000 7f9844c00700 1 -- 172.21.15.70:0/1184199863 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983000f620 con 0x7f9848104100 2024-05-08T06:42:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.221+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98481a64b0 con 0x7f9848104100 2024-05-08T06:42:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.222+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9848104be0 con 0x7f9848104100 2024-05-08T06:42:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.225+0000 7f9844c00700 1 -- 172.21.15.70:0/1184199863 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9830019070 con 0x7f9848104100 2024-05-08T06:42:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.226+0000 7f9844c00700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f982c0b2900 0x7f982c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.226+0000 7f9844c00700 1 -- 172.21.15.70:0/1184199863 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f98300e2150 con 0x7f9848104100 2024-05-08T06:42:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.226+0000 7f9847400700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f982c0b2900 0x7f982c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.227+0000 7f9847400700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f982c0b2900 0x7f982c0b4dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9838009750 tx=0x7f9838005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.228+0000 7f9844c00700 1 -- 172.21.15.70:0/1184199863 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f98300a9ab0 con 0x7f9848104100 2024-05-08T06:42:25.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.463+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f984802e510 con 0x7f9848104100 2024-05-08T06:42:25.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.466+0000 7f9844c00700 1 -- 172.21.15.70:0/1184199863 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24575 (secure 0 0 0) 0x7f98300a93b0 con 0x7f9848104100 2024-05-08T06:42:25.466 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:42:25.467 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":90,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:42:15.826307+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:42:25.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f982c0b2900 msgr2=0x7f982c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f982c0b2900 0x7f982c0b4dc0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9838009750 tx=0x7f9838005e80 comp rx=0 tx=0).stop 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848104100 msgr2=0x7f984819fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848104100 0x7f984819fb90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f983000d950 tx=0x7f983000dd10 comp rx=0 tx=0).stop 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 shutdown_connections 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848108850 0x7f9848199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848103750 0x7f984819f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f982c0b2900 0x7f982c0b4dc0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 --2- 172.21.15.70:0/1184199863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848104100 0x7f984819fb90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 >> 172.21.15.70:0/1184199863 conn(0x7f984807a600 msgr2=0x7f9848101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 shutdown_connections 2024-05-08T06:42:25.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:25.470+0000 7f984e600700 1 -- 172.21.15.70:0/1184199863 wait complete. 2024-05-08T06:42:26.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:25 smithi070 ceph-mon[29591]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 110 B/s wr, 0 op/s 2024-05-08T06:42:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:25 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1184199863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:42:26.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:25 smithi194 ceph-mon[33679]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 110 B/s wr, 0 op/s 2024-05-08T06:42:26.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:25 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1184199863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:42:26.316 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:42:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:25 smithi172 ceph-mon[33377]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 110 B/s wr, 0 op/s 2024-05-08T06:42:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:25 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1184199863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:42:26.742 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:27 smithi070 ceph-mon[29591]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 99 B/s wr, 0 op/s 2024-05-08T06:42:28.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:27 smithi194 ceph-mon[33679]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 99 B/s wr, 0 op/s 2024-05-08T06:42:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:27 smithi172 ceph-mon[33377]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 99 B/s wr, 0 op/s 2024-05-08T06:42:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.119+0000 7fab94e00700 1 -- 172.21.15.70:0/92506647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 msgr2=0x7fab9010ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.119+0000 7fab94e00700 1 --2- 172.21.15.70:0/92506647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 0x7fab9010ff40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fab80009990 tx=0x7fab80009ca0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.119+0000 7fab94e00700 1 -- 172.21.15.70:0/92506647 shutdown_connections 2024-05-08T06:42:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.119+0000 7fab94e00700 1 --2- 172.21.15.70:0/92506647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab9010a490 0x7fab901169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.119+0000 7fab94e00700 1 --2- 172.21.15.70:0/92506647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 0x7fab9010ff40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.119+0000 7fab94e00700 1 --2- 172.21.15.70:0/92506647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab90109ad0 0x7fab90109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.119+0000 7fab94e00700 1 -- 172.21.15.70:0/92506647 >> 172.21.15.70:0/92506647 conn(0x7fab90076c70 msgr2=0x7fab901082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.119+0000 7fab94e00700 1 -- 172.21.15.70:0/92506647 shutdown_connections 2024-05-08T06:42:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.119+0000 7fab94e00700 1 -- 172.21.15.70:0/92506647 wait complete. 2024-05-08T06:42:29.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.120+0000 7fab94e00700 1 Processor -- start 2024-05-08T06:42:29.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.121+0000 7fab94e00700 1 -- start start 2024-05-08T06:42:29.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.121+0000 7fab94e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab90109ad0 0x7fab901a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:29.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.121+0000 7fab94e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9010a490 0x7fab901a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.121+0000 7fab94e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 0x7fab901a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.121+0000 7fab94e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fab90119bd0 con 0x7fab9010fb60 2024-05-08T06:42:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.121+0000 7fab94e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab90119a50 con 0x7fab9010a490 2024-05-08T06:42:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.121+0000 7fab94e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fab90119d50 con 0x7fab90109ad0 2024-05-08T06:42:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.121+0000 7fab8e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 0x7fab901a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab8e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 0x7fab901a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50592/0 (socket says 172.21.15.70:50592) 2024-05-08T06:42:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab8e800700 1 -- 172.21.15.70:0/4270803849 learned_addr learned my addr 172.21.15.70:0/4270803849 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab8de00700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab90109ad0 0x7fab901a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab85400700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9010a490 0x7fab901a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab8e800700 1 -- 172.21.15.70:0/4270803849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab90109ad0 msgr2=0x7fab901a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab8e800700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab90109ad0 0x7fab901a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab8e800700 1 -- 172.21.15.70:0/4270803849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9010a490 msgr2=0x7fab901a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab8e800700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9010a490 0x7fab901a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab8e800700 1 -- 172.21.15.70:0/4270803849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab901a5060 con 0x7fab9010fb60 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.122+0000 7fab8e800700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 0x7fab901a4920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fab88007ee0 tx=0x7fab8800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.123+0000 7fab87400700 1 -- 172.21.15.70:0/4270803849 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab88004bb0 con 0x7fab9010fb60 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.123+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab901a5350 con 0x7fab9010fb60 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.123+0000 7fab87400700 1 -- 172.21.15.70:0/4270803849 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab88004d50 con 0x7fab9010fb60 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.123+0000 7fab87400700 1 -- 172.21.15.70:0/4270803849 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab880058b0 con 0x7fab9010fb60 2024-05-08T06:42:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.123+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab901acbd0 con 0x7fab9010fb60 2024-05-08T06:42:29.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.124+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab9006a190 con 0x7fab9010fb60 2024-05-08T06:42:29.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.126+0000 7fab87400700 1 -- 172.21.15.70:0/4270803849 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fab8801a020 con 0x7fab9010fb60 2024-05-08T06:42:29.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.129+0000 7fab87400700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab700b2900 0x7fab700b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:29.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.129+0000 7fab87400700 1 -- 172.21.15.70:0/4270803849 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fab880e1d30 con 0x7fab9010fb60 2024-05-08T06:42:29.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.129+0000 7fab8de00700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab700b2900 0x7fab700b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:29.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.130+0000 7fab8de00700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab700b2900 0x7fab700b4dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab80003760 tx=0x7fab80005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:29.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.132+0000 7fab87400700 1 -- 172.21.15.70:0/4270803849 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fab88010070 con 0x7fab9010fb60 2024-05-08T06:42:29.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.363+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab9002e510 con 0x7fab9010fb60 2024-05-08T06:42:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.368+0000 7fab87400700 1 -- 172.21.15.70:0/4270803849 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+24575 (secure 0 0 0) 0x7fab880a9690 con 0x7fab9010fb60 2024-05-08T06:42:29.368 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:42:29.368 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":90,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:42:15.826307+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:42:29.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab700b2900 msgr2=0x7fab700b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:29.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab700b2900 0x7fab700b4dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab80003760 tx=0x7fab80005fd0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 msgr2=0x7fab901a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:29.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 0x7fab901a4920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fab88007ee0 tx=0x7fab8800d3b0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 shutdown_connections 2024-05-08T06:42:29.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab700b2900 0x7fab700b4dc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab9010fb60 0x7fab901a4920 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab90109ad0 0x7fab901a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 --2- 172.21.15.70:0/4270803849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab9010a490 0x7fab901a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:29.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.371+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 >> 172.21.15.70:0/4270803849 conn(0x7fab90076c70 msgr2=0x7fab90077270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:29.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.372+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 shutdown_connections 2024-05-08T06:42:29.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:29.372+0000 7fab94e00700 1 -- 172.21.15.70:0/4270803849 wait complete. 2024-05-08T06:42:30.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:29 smithi070 ceph-mon[29591]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-08T06:42:30.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:29 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4270803849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:42:30.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-08T06:42:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:29 smithi194 ceph-mon[33679]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-08T06:42:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:29 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4270803849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:42:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:29 smithi172 ceph-mon[33377]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-08T06:42:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:29 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4270803849' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:42:30.678 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:31.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:31 smithi070 ceph-mon[29591]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-08T06:42:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:31 smithi194 ceph-mon[33679]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-08T06:42:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:31 smithi172 ceph-mon[33377]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-08T06:42:33.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.027+0000 7ff307e00700 1 -- 172.21.15.70:0/397290024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30810fc60 msgr2=0x7ff308112090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:33.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.027+0000 7ff307e00700 1 --2- 172.21.15.70:0/397290024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30810fc60 0x7ff308112090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff30000b0a0 tx=0x7ff30000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:42:33.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.027+0000 7ff307e00700 1 -- 172.21.15.70:0/397290024 shutdown_connections 2024-05-08T06:42:33.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.027+0000 7ff307e00700 1 --2- 172.21.15.70:0/397290024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30810fc60 0x7ff308112090 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:33.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.027+0000 7ff307e00700 1 --2- 172.21.15.70:0/397290024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff308104380 0x7ff30806ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:33.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.027+0000 7ff307e00700 1 --2- 172.21.15.70:0/397290024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30806bf50 0x7ff30806c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:33.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.027+0000 7ff307e00700 1 -- 172.21.15.70:0/397290024 >> 172.21.15.70:0/397290024 conn(0x7ff3080791e0 msgr2=0x7ff3080795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:33.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.028+0000 7ff307e00700 1 -- 172.21.15.70:0/397290024 shutdown_connections 2024-05-08T06:42:33.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.028+0000 7ff307e00700 1 -- 172.21.15.70:0/397290024 wait complete. 2024-05-08T06:42:33.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.029+0000 7ff307e00700 1 Processor -- start 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.029+0000 7ff307e00700 1 -- start start 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.029+0000 7ff307e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30806bf50 0x7ff3081a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.029+0000 7ff307e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff30810fc60 0x7ff3081a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.029+0000 7ff307e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30819b940 0x7ff30819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.029+0000 7ff307e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff308115680 con 0x7ff30819b940 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.029+0000 7ff307e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff308115500 con 0x7ff30810fc60 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.029+0000 7ff307e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff308115800 con 0x7ff30806bf50 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff307400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30819b940 0x7ff30819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff307400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30819b940 0x7ff30819bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50612/0 (socket says 172.21.15.70:50612) 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff307400700 1 -- 172.21.15.70:0/1646096256 learned_addr learned my addr 172.21.15.70:0/1646096256 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff306a00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30806bf50 0x7ff3081a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff306000700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff30810fc60 0x7ff3081a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:33.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff307400700 1 -- 172.21.15.70:0/1646096256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30806bf50 msgr2=0x7ff3081a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:33.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff307400700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30806bf50 0x7ff3081a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:33.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff307400700 1 -- 172.21.15.70:0/1646096256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff30810fc60 msgr2=0x7ff3081a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:33.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff307400700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff30810fc60 0x7ff3081a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:33.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.030+0000 7ff307400700 1 -- 172.21.15.70:0/1646096256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30819c4c0 con 0x7ff30819b940 2024-05-08T06:42:33.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.031+0000 7ff307400700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30819b940 0x7ff30819bdc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff30000b070 tx=0x7ff300004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:33.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.031+0000 7ff30ca00700 1 -- 172.21.15.70:0/1646096256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300021070 con 0x7ff30819b940 2024-05-08T06:42:33.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.031+0000 7ff30ca00700 1 -- 172.21.15.70:0/1646096256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff300007c00 con 0x7ff30819b940 2024-05-08T06:42:33.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.031+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30819c750 con 0x7ff30819b940 2024-05-08T06:42:33.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.031+0000 7ff30ca00700 1 -- 172.21.15.70:0/1646096256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000046f0 con 0x7ff30819b940 2024-05-08T06:42:33.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.031+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3081a8930 con 0x7ff30819b940 2024-05-08T06:42:33.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.032+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30806a190 con 0x7ff30819b940 2024-05-08T06:42:33.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.034+0000 7ff30ca00700 1 -- 172.21.15.70:0/1646096256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff300003a00 con 0x7ff30819b940 2024-05-08T06:42:33.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.036+0000 7ff30ca00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff2ec0b2900 0x7ff2ec0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:33.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.036+0000 7ff30ca00700 1 -- 172.21.15.70:0/1646096256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7ff30000f020 con 0x7ff30819b940 2024-05-08T06:42:33.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.036+0000 7ff306a00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff2ec0b2900 0x7ff2ec0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:33.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.037+0000 7ff306a00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff2ec0b2900 0x7ff2ec0b4dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8005950 tx=0x7ff2f8005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:33.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.039+0000 7ff30ca00700 1 -- 172.21.15.70:0/1646096256 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff30002a020 con 0x7ff30819b940 2024-05-08T06:42:33.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:33.318+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff308104380 con 0x7ff30819b940 2024-05-08T06:42:33.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:33 smithi070 ceph-mon[29591]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:33 smithi172 ceph-mon[33377]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:33 smithi194 ceph-mon[33679]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:34.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.185+0000 7ff30ca00700 1 -- 172.21.15.70:0/1646096256 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7ff3000ab920 con 0x7ff30819b940 2024-05-08T06:42:34.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.189+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff2ec0b2900 msgr2=0x7ff2ec0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:34.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.189+0000 7ff307e00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff2ec0b2900 0x7ff2ec0b4dc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8005950 tx=0x7ff2f8005ed0 comp rx=0 tx=0).stop 2024-05-08T06:42:34.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.189+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30819b940 msgr2=0x7ff30819bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:34.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.189+0000 7ff307e00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30819b940 0x7ff30819bdc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff30000b070 tx=0x7ff300004e70 comp rx=0 tx=0).stop 2024-05-08T06:42:34.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.190+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 shutdown_connections 2024-05-08T06:42:34.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.190+0000 7ff307e00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff2ec0b2900 0x7ff2ec0b4dc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:34.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.190+0000 7ff307e00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff30819b940 0x7ff30819bdc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:34.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.190+0000 7ff307e00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff30806bf50 0x7ff3081a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:34.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.190+0000 7ff307e00700 1 --2- 172.21.15.70:0/1646096256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff30810fc60 0x7ff3081a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:34.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.190+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 >> 172.21.15.70:0/1646096256 conn(0x7ff3080791e0 msgr2=0x7ff308101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:34.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.190+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 shutdown_connections 2024-05-08T06:42:34.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:34.190+0000 7ff307e00700 1 -- 172.21.15.70:0/1646096256 wait complete. 2024-05-08T06:42:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1646096256' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T06:42:34.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1646096256' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T06:42:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1646096256' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T06:42:35.071 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-05-08T06:42:35.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-05-08T06:42:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:35 smithi070 ceph-mon[29591]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:35.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:35 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1646096256' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T06:42:35.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:35 smithi070 ceph-mon[29591]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:42:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:35 smithi194 ceph-mon[33679]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:35 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1646096256' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T06:42:35.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:35 smithi194 ceph-mon[33679]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:42:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:35.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:35 smithi172 ceph-mon[33377]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:35.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:35 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1646096256' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T06:42:35.683 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:35 smithi172 ceph-mon[33377]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:42:37.365 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:37 smithi070 ceph-mon[29591]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:37 smithi194 ceph-mon[33679]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:37 smithi172 ceph-mon[33377]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:37.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.980+0000 7fd83d200700 1 -- 172.21.15.70:0/844874575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8381099e0 msgr2=0x7fd838109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.980+0000 7fd83d200700 1 --2- 172.21.15.70:0/844874575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8381099e0 0x7fd838109e60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd824009990 tx=0x7fd824009ca0 comp rx=0 tx=0).stop 2024-05-08T06:42:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.980+0000 7fd83d200700 1 -- 172.21.15.70:0/844874575 shutdown_connections 2024-05-08T06:42:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.980+0000 7fd83d200700 1 --2- 172.21.15.70:0/844874575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83810a3a0 0x7fd838116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.980+0000 7fd83d200700 1 --2- 172.21.15.70:0/844874575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83810e8b0 0x7fd83810ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.980+0000 7fd83d200700 1 --2- 172.21.15.70:0/844874575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8381099e0 0x7fd838109e60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.980+0000 7fd83d200700 1 -- 172.21.15.70:0/844874575 >> 172.21.15.70:0/844874575 conn(0x7fd838079230 msgr2=0x7fd8381082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.980+0000 7fd83d200700 1 -- 172.21.15.70:0/844874575 shutdown_connections 2024-05-08T06:42:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.980+0000 7fd83d200700 1 -- 172.21.15.70:0/844874575 wait complete. 2024-05-08T06:42:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.981+0000 7fd83d200700 1 Processor -- start 2024-05-08T06:42:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.981+0000 7fd83d200700 1 -- start start 2024-05-08T06:42:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.981+0000 7fd83d200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8381099e0 0x7fd8381a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.981+0000 7fd83d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83810a3a0 0x7fd8381a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.981+0000 7fd83d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd83810e8b0 0x7fd8381a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.981+0000 7fd83d200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd838119ae0 con 0x7fd83810e8b0 2024-05-08T06:42:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.981+0000 7fd83d200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd838119960 con 0x7fd83810a3a0 2024-05-08T06:42:37.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.981+0000 7fd83d200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd838119c60 con 0x7fd8381099e0 2024-05-08T06:42:37.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd837e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd83810e8b0 0x7fd8381a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:37.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd837e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd83810e8b0 0x7fd8381a48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36820/0 (socket says 172.21.15.70:36820) 2024-05-08T06:42:37.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd837e00700 1 -- 172.21.15.70:0/312691287 learned_addr learned my addr 172.21.15.70:0/312691287 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:37.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd836a00700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83810a3a0 0x7fd8381a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:37.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd837400700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8381099e0 0x7fd8381a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:37.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd837e00700 1 -- 172.21.15.70:0/312691287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8381099e0 msgr2=0x7fd8381a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:37.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd837e00700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8381099e0 0x7fd8381a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:37.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd837e00700 1 -- 172.21.15.70:0/312691287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83810a3a0 msgr2=0x7fd8381a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd837e00700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83810a3a0 0x7fd8381a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd837e00700 1 -- 172.21.15.70:0/312691287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8381a5020 con 0x7fd83810e8b0 2024-05-08T06:42:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.982+0000 7fd836a00700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83810a3a0 0x7fd8381a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:42:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.983+0000 7fd837e00700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd83810e8b0 0x7fd8381a48e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd83000ada0 tx=0x7fd83000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:37.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.983+0000 7fd82fe00700 1 -- 172.21.15.70:0/312691287 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830017020 con 0x7fd83810e8b0 2024-05-08T06:42:37.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.983+0000 7fd82fe00700 1 -- 172.21.15.70:0/312691287 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd83000ce10 con 0x7fd83810e8b0 2024-05-08T06:42:37.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.983+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8381a5310 con 0x7fd83810e8b0 2024-05-08T06:42:37.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.983+0000 7fd82fe00700 1 -- 172.21.15.70:0/312691287 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd830005440 con 0x7fd83810e8b0 2024-05-08T06:42:37.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.983+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8381acb90 con 0x7fd83810e8b0 2024-05-08T06:42:37.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.984+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd83806a190 con 0x7fd83810e8b0 2024-05-08T06:42:37.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.987+0000 7fd82fe00700 1 -- 172.21.15.70:0/312691287 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd830004ad0 con 0x7fd83810e8b0 2024-05-08T06:42:37.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.988+0000 7fd82fe00700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd81c0b2940 0x7fd81c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:37.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.988+0000 7fd82fe00700 1 -- 172.21.15.70:0/312691287 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fd8300e1ae0 con 0x7fd83810e8b0 2024-05-08T06:42:37.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.988+0000 7fd837400700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd81c0b2940 0x7fd81c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:37.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.989+0000 7fd837400700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd81c0b2940 0x7fd81c0b4e00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd828005fd0 tx=0x7fd828005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:37.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:37.993+0000 7fd82fe00700 1 -- 172.21.15.70:0/312691287 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd830021060 con 0x7fd83810e8b0 2024-05-08T06:42:38.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:38.281+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fd8381a1370 con 0x7fd83810e8b0 2024-05-08T06:42:39.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.209+0000 7fd82fe00700 1 -- 172.21.15.70:0/312691287 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fd8300a9530 con 0x7fd83810e8b0 2024-05-08T06:42:39.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd81c0b2940 msgr2=0x7fd81c0b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:39.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd81c0b2940 0x7fd81c0b4e00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd828005fd0 tx=0x7fd828005d90 comp rx=0 tx=0).stop 2024-05-08T06:42:39.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd83810e8b0 msgr2=0x7fd8381a48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:39.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd83810e8b0 0x7fd8381a48e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd83000ada0 tx=0x7fd83000c330 comp rx=0 tx=0).stop 2024-05-08T06:42:39.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 shutdown_connections 2024-05-08T06:42:39.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd81c0b2940 0x7fd81c0b4e00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:39.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd83810e8b0 0x7fd8381a48e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:39.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8381099e0 0x7fd8381a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:39.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 --2- 172.21.15.70:0/312691287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd83810a3a0 0x7fd8381a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:39.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.215+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 >> 172.21.15.70:0/312691287 conn(0x7fd838079230 msgr2=0x7fd8380798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:39.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.216+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 shutdown_connections 2024-05-08T06:42:39.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:39.216+0000 7fd83d200700 1 -- 172.21.15.70:0/312691287 wait complete. 2024-05-08T06:42:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:39 smithi194 ceph-mon[33679]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/312691287' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-08T06:42:39.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:39 smithi070 ceph-mon[29591]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:39.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/312691287' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-08T06:42:39.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:39 smithi172 ceph-mon[33377]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:42:39.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/312691287' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-08T06:42:40.099 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-08T06:42:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:40 smithi070 ceph-mon[29591]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T06:42:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:40 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/312691287' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-08T06:42:40.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:40 smithi070 ceph-mon[29591]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T06:42:40.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:40 smithi070 ceph-mon[29591]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:42:40.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:40 smithi070 ceph-mon[29591]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-08T06:42:40.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:40 smithi070 ceph-mon[29591]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-08T06:42:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:40 smithi194 ceph-mon[33679]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T06:42:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:40 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/312691287' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-08T06:42:40.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:40 smithi194 ceph-mon[33679]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T06:42:40.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:40 smithi194 ceph-mon[33679]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:42:40.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:40 smithi194 ceph-mon[33679]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-08T06:42:40.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:40 smithi194 ceph-mon[33679]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-08T06:42:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:40 smithi172 ceph-mon[33377]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T06:42:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:40 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/312691287' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-08T06:42:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:40 smithi172 ceph-mon[33377]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T06:42:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:40 smithi172 ceph-mon[33377]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T06:42:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:40 smithi172 ceph-mon[33377]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-08T06:42:40.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:40 smithi172 ceph-mon[33377]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-08T06:42:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:41 smithi070 ceph-mon[29591]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-05-08T06:42:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:41 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] up:active 2024-05-08T06:42:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:41 smithi070 ceph-mon[29591]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T06:42:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:41 smithi070 ceph-mon[29591]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T06:42:41.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:41 smithi070 ceph-mon[29591]: Cluster is now healthy 2024-05-08T06:42:41.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:41 smithi070 ceph-mon[29591]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-08T06:42:41.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:41 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-08T06:42:41.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:41 smithi070 ceph-mon[29591]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-08T06:42:41.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:41 smithi194 ceph-mon[33679]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-05-08T06:42:41.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:41 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] up:active 2024-05-08T06:42:41.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:41 smithi194 ceph-mon[33679]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T06:42:41.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:41 smithi194 ceph-mon[33679]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T06:42:41.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:41 smithi194 ceph-mon[33679]: Cluster is now healthy 2024-05-08T06:42:41.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:41 smithi194 ceph-mon[33679]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-08T06:42:41.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:41 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-08T06:42:41.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:41 smithi194 ceph-mon[33679]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-08T06:42:41.601 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-mon[33377]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-05-08T06:42:41.601 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] up:active 2024-05-08T06:42:41.601 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-mon[33377]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T06:42:41.601 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-mon[33377]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T06:42:41.602 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-mon[33377]: Cluster is now healthy 2024-05-08T06:42:41.602 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-mon[33377]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-08T06:42:41.602 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-08T06:42:41.602 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-mon[33377]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-08T06:42:41.929 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b[63250]: 2024-05-08T06:42:41.599+0000 7fc270a00700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-08T06:42:41.929 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 06:42:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b[63250]: 2024-05-08T06:42:41.599+0000 7fc270a00700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-08T06:42:42.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:42 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] up:active 2024-05-08T06:42:42.360 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:42 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-08T06:42:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:42 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] up:active 2024-05-08T06:42:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:42 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-08T06:42:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:42 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] up:active 2024-05-08T06:42:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:42 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-08T06:42:42.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.931+0000 7f6543400700 1 -- 172.21.15.70:0/3071188468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 msgr2=0x7f653c112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:42.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.931+0000 7f6543400700 1 --2- 172.21.15.70:0/3071188468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 0x7f653c112340 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f653400b0a0 tx=0x7f653400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:42:42.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.931+0000 7f6543400700 1 -- 172.21.15.70:0/3071188468 shutdown_connections 2024-05-08T06:42:42.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.931+0000 7f6543400700 1 --2- 172.21.15.70:0/3071188468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 0x7f653c112340 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:42.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.931+0000 7f6543400700 1 --2- 172.21.15.70:0/3071188468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f653c06b1b0 0x7f653c06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:42.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.931+0000 7f6543400700 1 --2- 172.21.15.70:0/3071188468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c06bad0 0x7f653c10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:42.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.931+0000 7f6543400700 1 -- 172.21.15.70:0/3071188468 >> 172.21.15.70:0/3071188468 conn(0x7f653c079350 msgr2=0x7f653c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:42.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.931+0000 7f6543400700 1 -- 172.21.15.70:0/3071188468 shutdown_connections 2024-05-08T06:42:42.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.931+0000 7f6543400700 1 -- 172.21.15.70:0/3071188468 wait complete. 2024-05-08T06:42:42.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.932+0000 7f6543400700 1 Processor -- start 2024-05-08T06:42:42.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6543400700 1 -- start start 2024-05-08T06:42:42.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6543400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f653c06b1b0 0x7f653c1a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:42.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6543400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c06bad0 0x7f653c1a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:42.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6543400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 0x7f653c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:42.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6543400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f653c115770 con 0x7f653c10ff50 2024-05-08T06:42:42.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6543400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1155f0 con 0x7f653c06bad0 2024-05-08T06:42:42.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6543400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f653c1158f0 con 0x7f653c06b1b0 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6541400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 0x7f653c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6541400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 0x7f653c19bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36828/0 (socket says 172.21.15.70:36828) 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.933+0000 7f6541400700 1 -- 172.21.15.70:0/657851517 learned_addr learned my addr 172.21.15.70:0/657851517 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f653be00700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c06bad0 0x7f653c1a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f6540a00700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f653c06b1b0 0x7f653c1a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f6541400700 1 -- 172.21.15.70:0/657851517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f653c06b1b0 msgr2=0x7f653c1a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f6541400700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f653c06b1b0 0x7f653c1a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f6541400700 1 -- 172.21.15.70:0/657851517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c06bad0 msgr2=0x7f653c1a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f6541400700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c06bad0 0x7f653c1a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f6541400700 1 -- 172.21.15.70:0/657851517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c19c230 con 0x7f653c10ff50 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f653be00700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c06bad0 0x7f653c1a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:42:42.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f6541400700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 0x7f653c19bad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f653400b070 tx=0x7f6534004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:42.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f6539600700 1 -- 172.21.15.70:0/657851517 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534021070 con 0x7f653c10ff50 2024-05-08T06:42:42.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.934+0000 7f6539600700 1 -- 172.21.15.70:0/657851517 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6534007c80 con 0x7f653c10ff50 2024-05-08T06:42:42.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.935+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c19c4c0 con 0x7f653c10ff50 2024-05-08T06:42:42.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.935+0000 7f6539600700 1 -- 172.21.15.70:0/657851517 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653401d450 con 0x7f653c10ff50 2024-05-08T06:42:42.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.935+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1a8790 con 0x7f653c10ff50 2024-05-08T06:42:42.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.936+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653c06a190 con 0x7f653c10ff50 2024-05-08T06:42:42.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.938+0000 7f6539600700 1 -- 172.21.15.70:0/657851517 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6534004000 con 0x7f653c10ff50 2024-05-08T06:42:42.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.940+0000 7f6539600700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f65240b2900 0x7f65240b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:42.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.940+0000 7f6539600700 1 -- 172.21.15.70:0/657851517 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f653400f020 con 0x7f653c10ff50 2024-05-08T06:42:42.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.940+0000 7f6540a00700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f65240b2900 0x7f65240b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:42.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.941+0000 7f6540a00700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f65240b2900 0x7f65240b4dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6530005950 tx=0x7f6530005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:42.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:42.943+0000 7f6539600700 1 -- 172.21.15.70:0/657851517 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f653402a020 con 0x7f653c10ff50 2024-05-08T06:42:43.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.225+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f653c19cfb0 con 0x7f653c10ff50 2024-05-08T06:42:43.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.259+0000 7f6539600700 1 -- 172.21.15.70:0/657851517 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f65340aba20 con 0x7f653c10ff50 2024-05-08T06:42:43.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f65240b2900 msgr2=0x7f65240b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:43.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f65240b2900 0x7f65240b4dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6530005950 tx=0x7f6530005eb0 comp rx=0 tx=0).stop 2024-05-08T06:42:43.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 msgr2=0x7f653c19bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:43.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 0x7f653c19bad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f653400b070 tx=0x7f6534004e70 comp rx=0 tx=0).stop 2024-05-08T06:42:43.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 shutdown_connections 2024-05-08T06:42:43.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f65240b2900 0x7f65240b4dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:43.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f653c10ff50 0x7f653c19bad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:43.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f653c06b1b0 0x7f653c1a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:43.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 --2- 172.21.15.70:0/657851517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f653c06bad0 0x7f653c1a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:43.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 >> 172.21.15.70:0/657851517 conn(0x7f653c079350 msgr2=0x7f653c111440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:43.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 shutdown_connections 2024-05-08T06:42:43.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:43.263+0000 7f6543400700 1 -- 172.21.15.70:0/657851517 wait complete. 2024-05-08T06:42:43.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:43 smithi070 ceph-mon[29591]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-05-08T06:42:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:43 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/657851517' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T06:42:43.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:43 smithi172 ceph-mon[33377]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-05-08T06:42:43.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:43 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/657851517' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T06:42:43.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:43 smithi194 ceph-mon[33679]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 1 op/s 2024-05-08T06:42:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:43 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/657851517' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T06:42:44.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-08T06:42:44.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:44 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/657851517' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T06:42:44.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:44 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-08T06:42:44.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:44 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:42:44.594 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:44 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/657851517' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T06:42:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:44 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-08T06:42:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:44 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:42:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:44 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/657851517' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T06:42:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:44 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-08T06:42:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:44 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:42:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:45 smithi070 ceph-mon[29591]: pgmap v425: 129 pgs: 129 active+clean; 583 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-05-08T06:42:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:45 smithi172 ceph-mon[33377]: pgmap v425: 129 pgs: 129 active+clean; 583 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-05-08T06:42:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:45 smithi194 ceph-mon[33679]: pgmap v425: 129 pgs: 129 active+clean; 583 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1.9 KiB/s wr, 6 op/s 2024-05-08T06:42:46.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.949+0000 7f5fab200700 1 -- 172.21.15.70:0/2423342840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac1033d0 msgr2=0x7f5fac103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:46.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.949+0000 7f5fab200700 1 --2- 172.21.15.70:0/2423342840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac1033d0 0x7f5fac103850 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009990 tx=0x7f5f94009ca0 comp rx=0 tx=0).stop 2024-05-08T06:42:46.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.949+0000 7f5fab200700 1 -- 172.21.15.70:0/2423342840 shutdown_connections 2024-05-08T06:42:46.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.949+0000 7f5fab200700 1 --2- 172.21.15.70:0/2423342840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fac103d90 0x7f5fac1102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:46.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.949+0000 7f5fab200700 1 --2- 172.21.15.70:0/2423342840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fac109460 0x7f5fac109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:46.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.949+0000 7f5fab200700 1 --2- 172.21.15.70:0/2423342840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac1033d0 0x7f5fac103850 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:46.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.949+0000 7f5fab200700 1 -- 172.21.15.70:0/2423342840 >> 172.21.15.70:0/2423342840 conn(0x7f5fac0fef20 msgr2=0x7f5fac101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:46.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.949+0000 7f5fab200700 1 -- 172.21.15.70:0/2423342840 shutdown_connections 2024-05-08T06:42:46.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.949+0000 7f5fab200700 1 -- 172.21.15.70:0/2423342840 wait complete. 2024-05-08T06:42:46.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.951+0000 7f5fab200700 1 Processor -- start 2024-05-08T06:42:46.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.951+0000 7f5fab200700 1 -- start start 2024-05-08T06:42:46.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.951+0000 7f5fab200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fac1033d0 0x7f5fac1a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.951+0000 7f5fab200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fac103d90 0x7f5fac1a6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.951+0000 7f5fab200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac109460 0x7f5fac10e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.951+0000 7f5fab200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac113490 con 0x7f5fac109460 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.951+0000 7f5fab200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac113310 con 0x7f5fac103d90 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.951+0000 7f5fab200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5fac113610 con 0x7f5fac1033d0 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5faa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac109460 0x7f5fac10e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5faa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac109460 0x7f5fac10e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36844/0 (socket says 172.21.15.70:36844) 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5faa800700 1 -- 172.21.15.70:0/440874607 learned_addr learned my addr 172.21.15.70:0/440874607 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5fa9e00700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fac1033d0 0x7f5fac1a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5fa1400700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fac103d90 0x7f5fac1a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5faa800700 1 -- 172.21.15.70:0/440874607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fac1033d0 msgr2=0x7f5fac1a5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5faa800700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fac1033d0 0x7f5fac1a5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5faa800700 1 -- 172.21.15.70:0/440874607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fac103d90 msgr2=0x7f5fac1a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:46.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5faa800700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fac103d90 0x7f5fac1a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:46.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5faa800700 1 -- 172.21.15.70:0/440874607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fac10ed60 con 0x7f5fac109460 2024-05-08T06:42:46.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.952+0000 7f5faa800700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac109460 0x7f5fac10e460 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400ada0 tx=0x7f5fa400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:46.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.953+0000 7f5fa3400700 1 -- 172.21.15.70:0/440874607 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4017020 con 0x7f5fac109460 2024-05-08T06:42:46.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.953+0000 7f5fa3400700 1 -- 172.21.15.70:0/440874607 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fa400ce10 con 0x7f5fac109460 2024-05-08T06:42:46.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.953+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fac10eff0 con 0x7f5fac109460 2024-05-08T06:42:46.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.953+0000 7f5fa3400700 1 -- 172.21.15.70:0/440874607 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4005440 con 0x7f5fac109460 2024-05-08T06:42:46.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.953+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fac1acd00 con 0x7f5fac109460 2024-05-08T06:42:46.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.954+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fac104b10 con 0x7f5fac109460 2024-05-08T06:42:46.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.958+0000 7f5fa3400700 1 -- 172.21.15.70:0/440874607 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5fa4004ad0 con 0x7f5fac109460 2024-05-08T06:42:46.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.960+0000 7f5fa3400700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f900b2900 0x7f5f900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:46.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.960+0000 7f5fa3400700 1 -- 172.21.15.70:0/440874607 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f5fa40e22f0 con 0x7f5fac109460 2024-05-08T06:42:46.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.960+0000 7f5fa9e00700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f900b2900 0x7f5f900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:46.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.961+0000 7f5fa9e00700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f900b2900 0x7f5f900b4dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c005fd0 tx=0x7f5f9c005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:46.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:46.962+0000 7f5fa3400700 1 -- 172.21.15.70:0/440874607 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5fa4021020 con 0x7f5fac109460 2024-05-08T06:42:47.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.246+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f5fac06a190 con 0x7f5fac109460 2024-05-08T06:42:47.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.307+0000 7f5fa3400700 1 -- 172.21.15.70:0/440874607 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f5fac06a190 con 0x7f5fac109460 2024-05-08T06:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.312+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f900b2900 msgr2=0x7f5f900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.312+0000 7f5fab200700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f900b2900 0x7f5f900b4dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c005fd0 tx=0x7f5f9c005d90 comp rx=0 tx=0).stop 2024-05-08T06:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.312+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac109460 msgr2=0x7f5fac10e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.312+0000 7f5fab200700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac109460 0x7f5fac10e460 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400ada0 tx=0x7f5fa400c330 comp rx=0 tx=0).stop 2024-05-08T06:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.313+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 shutdown_connections 2024-05-08T06:42:47.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.313+0000 7f5fab200700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5f900b2900 0x7f5f900b4dc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.313+0000 7f5fab200700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5fac109460 0x7f5fac10e460 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.313+0000 7f5fab200700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5fac1033d0 0x7f5fac1a5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.313+0000 7f5fab200700 1 --2- 172.21.15.70:0/440874607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5fac103d90 0x7f5fac1a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.313+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 >> 172.21.15.70:0/440874607 conn(0x7f5fac0fef20 msgr2=0x7f5fac0756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.313+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 shutdown_connections 2024-05-08T06:42:47.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:47.313+0000 7f5fab200700 1 -- 172.21.15.70:0/440874607 wait complete. 2024-05-08T06:42:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:47 smithi070 ceph-mon[29591]: pgmap v426: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-05-08T06:42:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:47 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/440874607' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T06:42:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:47 smithi172 ceph-mon[33377]: pgmap v426: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-05-08T06:42:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:47 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/440874607' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T06:42:47.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:47 smithi194 ceph-mon[33679]: pgmap v426: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-05-08T06:42:47.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:47 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/440874607' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T06:42:48.211 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-05-08T06:42:48.212 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-08T06:42:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:48 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/440874607' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T06:42:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:48 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:42:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:48.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:48 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/440874607' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T06:42:48.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:48 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:42:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:48 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/440874607' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T06:42:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:48 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:42:49.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:49 smithi070 ceph-mon[29591]: pgmap v427: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-08T06:42:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:49 smithi172 ceph-mon[33377]: pgmap v427: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-08T06:42:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:49 smithi194 ceph-mon[33679]: pgmap v427: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-05-08T06:42:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.948+0000 7efd55600700 1 -- 172.21.15.70:0/4202109245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 msgr2=0x7efd5006b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.948+0000 7efd55600700 1 --2- 172.21.15.70:0/4202109245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 0x7efd5006b590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efd40009990 tx=0x7efd40009ca0 comp rx=0 tx=0).stop 2024-05-08T06:42:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.948+0000 7efd55600700 1 -- 172.21.15.70:0/4202109245 shutdown_connections 2024-05-08T06:42:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.948+0000 7efd55600700 1 --2- 172.21.15.70:0/4202109245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5010ff50 0x7efd50112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.948+0000 7efd55600700 1 --2- 172.21.15.70:0/4202109245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 0x7efd5006b590 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.948+0000 7efd55600700 1 --2- 172.21.15.70:0/4202109245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5006bad0 0x7efd5010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.948+0000 7efd55600700 1 -- 172.21.15.70:0/4202109245 >> 172.21.15.70:0/4202109245 conn(0x7efd50079350 msgr2=0x7efd50079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.949+0000 7efd55600700 1 -- 172.21.15.70:0/4202109245 shutdown_connections 2024-05-08T06:42:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.949+0000 7efd55600700 1 -- 172.21.15.70:0/4202109245 wait complete. 2024-05-08T06:42:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.950+0000 7efd55600700 1 Processor -- start 2024-05-08T06:42:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.950+0000 7efd55600700 1 -- start start 2024-05-08T06:42:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd55600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 0x7efd501a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd55600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5006bad0 0x7efd501a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd55600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5010ff50 0x7efd5019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd55600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd50115760 con 0x7efd5006b1b0 2024-05-08T06:42:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd55600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd501155e0 con 0x7efd5006bad0 2024-05-08T06:42:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd55600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efd501158e0 con 0x7efd5010ff50 2024-05-08T06:42:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd4ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 0x7efd501a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd4ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 0x7efd501a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45388/0 (socket says 172.21.15.70:45388) 2024-05-08T06:42:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd4ea00700 1 -- 172.21.15.70:0/3506568043 learned_addr learned my addr 172.21.15.70:0/3506568043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd4f400700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5010ff50 0x7efd5019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:50.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.951+0000 7efd4e000700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5006bad0 0x7efd501a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:50.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd4ea00700 1 -- 172.21.15.70:0/3506568043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5010ff50 msgr2=0x7efd5019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:50.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd4ea00700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5010ff50 0x7efd5019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:50.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd4ea00700 1 -- 172.21.15.70:0/3506568043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5006bad0 msgr2=0x7efd501a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:50.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd4ea00700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5006bad0 0x7efd501a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:50.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd4ea00700 1 -- 172.21.15.70:0/3506568043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5019c400 con 0x7efd5006b1b0 2024-05-08T06:42:50.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd4ea00700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 0x7efd501a1a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd4000b650 tx=0x7efd4000bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd47400700 1 -- 172.21.15.70:0/3506568043 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40027070 con 0x7efd5006b1b0 2024-05-08T06:42:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd47400700 1 -- 172.21.15.70:0/3506568043 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd40022470 con 0x7efd5006b1b0 2024-05-08T06:42:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5019c690 con 0x7efd5006b1b0 2024-05-08T06:42:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.952+0000 7efd47400700 1 -- 172.21.15.70:0/3506568043 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40017650 con 0x7efd5006b1b0 2024-05-08T06:42:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.953+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd501a8800 con 0x7efd5006b1b0 2024-05-08T06:42:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.954+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd501029c0 con 0x7efd5006b1b0 2024-05-08T06:42:50.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.956+0000 7efd47400700 1 -- 172.21.15.70:0/3506568043 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7efd40009d10 con 0x7efd5006b1b0 2024-05-08T06:42:50.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.957+0000 7efd47400700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efd340b2880 0x7efd340b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:50.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.958+0000 7efd47400700 1 -- 172.21.15.70:0/3506568043 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7efd400e35c0 con 0x7efd5006b1b0 2024-05-08T06:42:50.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.958+0000 7efd4e000700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efd340b2880 0x7efd340b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:50.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.959+0000 7efd4e000700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efd340b2880 0x7efd340b4d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efd3c005950 tx=0x7efd3c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:50.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:50.960+0000 7efd47400700 1 -- 172.21.15.70:0/3506568043 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efd40013070 con 0x7efd5006b1b0 2024-05-08T06:42:51.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.222+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7efd500638e0 con 0x7efd340b2880 2024-05-08T06:42:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.287+0000 7efd47400700 1 -- 172.21.15.70:0/3506568043 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efd500638e0 con 0x7efd340b2880 2024-05-08T06:42:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efd340b2880 msgr2=0x7efd340b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efd340b2880 0x7efd340b4d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efd3c005950 tx=0x7efd3c0058e0 comp rx=0 tx=0).stop 2024-05-08T06:42:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 msgr2=0x7efd501a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 0x7efd501a1a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efd4000b650 tx=0x7efd4000bfc0 comp rx=0 tx=0).stop 2024-05-08T06:42:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 shutdown_connections 2024-05-08T06:42:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5010ff50 0x7efd5019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7efd340b2880 0x7efd340b4d40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd5006b1b0 0x7efd501a1a50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:51.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 --2- 172.21.15.70:0/3506568043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd5006bad0 0x7efd501a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:51.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.290+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 >> 172.21.15.70:0/3506568043 conn(0x7efd50079350 msgr2=0x7efd50111520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:51.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.291+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 shutdown_connections 2024-05-08T06:42:51.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:51.291+0000 7efd55600700 1 -- 172.21.15.70:0/3506568043 wait complete. 2024-05-08T06:42:51.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:51 smithi070 ceph-mon[29591]: pgmap v428: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-05-08T06:42:51.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:42:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:42:51.233+0000 7f1650a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:42:51.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:42:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:42:51.234+0000 7f1650a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:42:51.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:42:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:42:51.234+0000 7f1650a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:42:51.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:42:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:42:51.234+0000 7f1650a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:42:51.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:42:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:42:51.234+0000 7f1650a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:42:51.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:51 smithi172 ceph-mon[33377]: pgmap v428: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-05-08T06:42:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:51 smithi194 ceph-mon[33679]: pgmap v428: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-05-08T06:42:52.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-08T06:42:52.574 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:52 smithi070 ceph-mon[29591]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:42:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:52 smithi172 ceph-mon[33377]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:42:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:52 smithi194 ceph-mon[33679]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:42:53.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:53 smithi070 ceph-mon[29591]: pgmap v429: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-05-08T06:42:53.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:53 smithi070 ceph-mon[29591]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-08T06:42:53.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:53 smithi172 ceph-mon[33377]: pgmap v429: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-05-08T06:42:53.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:53 smithi172 ceph-mon[33377]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-08T06:42:53.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:53 smithi194 ceph-mon[33679]: pgmap v429: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 10 op/s 2024-05-08T06:42:53.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:53 smithi194 ceph-mon[33679]: mgrmap e17: x(active, since 11m), standbys: z, y 2024-05-08T06:42:55.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.167+0000 7f5df6c00700 1 -- 172.21.15.70:0/1732678457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006c530 msgr2=0x7f5df0110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:55.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.167+0000 7f5df6c00700 1 --2- 172.21.15.70:0/1732678457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006c530 0x7f5df0110340 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5de800b0a0 tx=0x7f5de800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.168+0000 7f5df6c00700 1 -- 172.21.15.70:0/1732678457 shutdown_connections 2024-05-08T06:42:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.168+0000 7f5df6c00700 1 --2- 172.21.15.70:0/1732678457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006c530 0x7f5df0110340 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.168+0000 7f5df6c00700 1 --2- 172.21.15.70:0/1732678457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5df0109520 0x7f5df0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.168+0000 7f5df6c00700 1 --2- 172.21.15.70:0/1732678457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5df006bb70 0x7f5df006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.168+0000 7f5df6c00700 1 -- 172.21.15.70:0/1732678457 >> 172.21.15.70:0/1732678457 conn(0x7f5df0079350 msgr2=0x7f5df0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.168+0000 7f5df6c00700 1 -- 172.21.15.70:0/1732678457 shutdown_connections 2024-05-08T06:42:55.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.168+0000 7f5df6c00700 1 -- 172.21.15.70:0/1732678457 wait complete. 2024-05-08T06:42:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.169+0000 7f5df6c00700 1 Processor -- start 2024-05-08T06:42:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.169+0000 7f5df6c00700 1 -- start start 2024-05-08T06:42:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.169+0000 7f5df6c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006bb70 0x7f5df01a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.169+0000 7f5df6c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5df006c530 0x7f5df01a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.169+0000 7f5df6c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5df0109520 0x7f5df019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.169+0000 7f5df6c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5df0113500 con 0x7f5df006bb70 2024-05-08T06:42:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.169+0000 7f5df6c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5df0113380 con 0x7f5df0109520 2024-05-08T06:42:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.169+0000 7f5df6c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5df0113680 con 0x7f5df006c530 2024-05-08T06:42:55.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5defe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006bb70 0x7f5df01a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:55.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5defe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006bb70 0x7f5df01a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45418/0 (socket says 172.21.15.70:45418) 2024-05-08T06:42:55.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5defe00700 1 -- 172.21.15.70:0/966838975 learned_addr learned my addr 172.21.15.70:0/966838975 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5def400700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5df006c530 0x7f5df01a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5df4c00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5df0109520 0x7f5df019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5defe00700 1 -- 172.21.15.70:0/966838975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5df006c530 msgr2=0x7f5df01a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5defe00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5df006c530 0x7f5df01a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5defe00700 1 -- 172.21.15.70:0/966838975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5df0109520 msgr2=0x7f5df019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5defe00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5df0109520 0x7f5df019bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.170+0000 7f5defe00700 1 -- 172.21.15.70:0/966838975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df019c210 con 0x7f5df006bb70 2024-05-08T06:42:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.171+0000 7f5defe00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006bb70 0x7f5df01a18a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5de000d950 tx=0x7f5de000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.171+0000 7f5decc00700 1 -- 172.21.15.70:0/966838975 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0016070 con 0x7f5df006bb70 2024-05-08T06:42:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.171+0000 7f5decc00700 1 -- 172.21.15.70:0/966838975 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5de0010460 con 0x7f5df006bb70 2024-05-08T06:42:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.171+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df019c500 con 0x7f5df006bb70 2024-05-08T06:42:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.171+0000 7f5decc00700 1 -- 172.21.15.70:0/966838975 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de000f620 con 0x7f5df006bb70 2024-05-08T06:42:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.171+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df01a8770 con 0x7f5df006bb70 2024-05-08T06:42:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.173+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df0104bf0 con 0x7f5df006bb70 2024-05-08T06:42:55.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.175+0000 7f5decc00700 1 -- 172.21.15.70:0/966838975 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5de0019070 con 0x7f5df006bb70 2024-05-08T06:42:55.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.176+0000 7f5decc00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5dd40b2910 0x7f5dd40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:55.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.176+0000 7f5decc00700 1 -- 172.21.15.70:0/966838975 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f5de00e2320 con 0x7f5df006bb70 2024-05-08T06:42:55.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.177+0000 7f5def400700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5dd40b2910 0x7f5dd40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:55.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.177+0000 7f5def400700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5dd40b2910 0x7f5dd40b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc005950 tx=0x7f5ddc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:55.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.181+0000 7f5decc00700 1 -- 172.21.15.70:0/966838975 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5de00a9b20 con 0x7f5df006bb70 2024-05-08T06:42:55.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.453+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5df01018b0 con 0x7f5dd40b2910 2024-05-08T06:42:55.453 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:55 smithi070 ceph-mon[29591]: pgmap v430: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-08T06:42:55.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.521+0000 7f5decc00700 1 -- 172.21.15.70:0/966838975 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5df01018b0 con 0x7f5dd40b2910 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5dd40b2910 msgr2=0x7f5dd40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5dd40b2910 0x7f5dd40b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc005950 tx=0x7f5ddc0058e0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006bb70 msgr2=0x7f5df01a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006bb70 0x7f5df01a18a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5de000d950 tx=0x7f5de000dd10 comp rx=0 tx=0).stop 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 shutdown_connections 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5df0109520 0x7f5df019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5dd40b2910 0x7f5dd40b4dd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5df006bb70 0x7f5df01a18a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 --2- 172.21.15.70:0/966838975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5df006c530 0x7f5df01a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 >> 172.21.15.70:0/966838975 conn(0x7f5df0079350 msgr2=0x7f5df01011a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:55.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 shutdown_connections 2024-05-08T06:42:55.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:55.524+0000 7f5df6c00700 1 -- 172.21.15.70:0/966838975 wait complete. 2024-05-08T06:42:55.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:55 smithi172 ceph-mon[33377]: pgmap v430: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-08T06:42:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:55 smithi194 ceph-mon[33679]: pgmap v430: 129 pgs: 129 active+clean; 584 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-05-08T06:42:56.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-08T06:42:56.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:56 smithi070 ceph-mon[29591]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:42:56.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:56 smithi172 ceph-mon[33377]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:42:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:56 smithi194 ceph-mon[33679]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:42:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:42:57.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:57 smithi070 ceph-mon[29591]: pgmap v431: 129 pgs: 129 active+clean; 591 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 8 op/s 2024-05-08T06:42:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:57 smithi172 ceph-mon[33377]: pgmap v431: 129 pgs: 129 active+clean; 591 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 8 op/s 2024-05-08T06:42:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:57 smithi194 ceph-mon[33679]: pgmap v431: 129 pgs: 129 active+clean; 591 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1023 B/s wr, 8 op/s 2024-05-08T06:42:59.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.310+0000 7f0530a00700 1 -- 172.21.15.70:0/2709342547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c10b6c0 msgr2=0x7f052c10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:59.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.310+0000 7f0530a00700 1 --2- 172.21.15.70:0/2709342547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c10b6c0 0x7f052c10baa0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f051c009990 tx=0x7f051c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.310+0000 7f0530a00700 1 -- 172.21.15.70:0/2709342547 shutdown_connections 2024-05-08T06:42:59.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.310+0000 7f0530a00700 1 --2- 172.21.15.70:0/2709342547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f052c106080 0x7f052c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.310+0000 7f0530a00700 1 --2- 172.21.15.70:0/2709342547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c10b6c0 0x7f052c10baa0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.310+0000 7f0530a00700 1 --2- 172.21.15.70:0/2709342547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f052c1056c0 0x7f052c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.310+0000 7f0530a00700 1 -- 172.21.15.70:0/2709342547 >> 172.21.15.70:0/2709342547 conn(0x7f052c1011b0 msgr2=0x7f052c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:59.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.310+0000 7f0530a00700 1 -- 172.21.15.70:0/2709342547 shutdown_connections 2024-05-08T06:42:59.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.310+0000 7f0530a00700 1 -- 172.21.15.70:0/2709342547 wait complete. 2024-05-08T06:42:59.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.311+0000 7f0530a00700 1 Processor -- start 2024-05-08T06:42:59.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.311+0000 7f0530a00700 1 -- start start 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0530a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f052c1056c0 0x7f052c1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0530a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c106080 0x7f052c1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0530a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f052c10b6c0 0x7f052c19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0530a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f052c1157b0 con 0x7f052c106080 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0530a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f052c115630 con 0x7f052c1056c0 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0530a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f052c115930 con 0x7f052c10b6c0 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0529400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c106080 0x7f052c1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0529400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c106080 0x7f052c1a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44800/0 (socket says 172.21.15.70:44800) 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0529400700 1 -- 172.21.15.70:0/1923782403 learned_addr learned my addr 172.21.15.70:0/1923782403 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f0529e00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f052c1056c0 0x7f052c1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:59.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.312+0000 7f052a800700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f052c10b6c0 0x7f052c19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:59.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0529400700 1 -- 172.21.15.70:0/1923782403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f052c10b6c0 msgr2=0x7f052c19ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:59.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0529400700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f052c10b6c0 0x7f052c19ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0529400700 1 -- 172.21.15.70:0/1923782403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f052c1056c0 msgr2=0x7f052c1a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:59.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0529400700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f052c1056c0 0x7f052c1a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0529400700 1 -- 172.21.15.70:0/1923782403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052c19c1d0 con 0x7f052c106080 2024-05-08T06:42:59.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0529400700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c106080 0x7f052c1a1df0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f051800d950 tx=0x7f051800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:59.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0522a00700 1 -- 172.21.15.70:0/1923782403 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518016070 con 0x7f052c106080 2024-05-08T06:42:59.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0522a00700 1 -- 172.21.15.70:0/1923782403 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0518010460 con 0x7f052c106080 2024-05-08T06:42:59.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052c19c4c0 con 0x7f052c106080 2024-05-08T06:42:59.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0522a00700 1 -- 172.21.15.70:0/1923782403 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051800f620 con 0x7f052c106080 2024-05-08T06:42:59.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.313+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f052c1a8780 con 0x7f052c106080 2024-05-08T06:42:59.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.315+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f052c06a190 con 0x7f052c106080 2024-05-08T06:42:59.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.317+0000 7f0522a00700 1 -- 172.21.15.70:0/1923782403 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0518019070 con 0x7f052c106080 2024-05-08T06:42:59.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.318+0000 7f0522a00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05100b2910 0x7f05100b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:42:59.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.318+0000 7f0522a00700 1 -- 172.21.15.70:0/1923782403 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f05180e23a0 con 0x7f052c106080 2024-05-08T06:42:59.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.319+0000 7f0529e00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05100b2910 0x7f05100b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:42:59.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.319+0000 7f0529e00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05100b2910 0x7f05100b4dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f051c00b5c0 tx=0x7f051c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:42:59.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.323+0000 7f0522a00700 1 -- 172.21.15.70:0/1923782403 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f05180a9ba0 con 0x7f052c106080 2024-05-08T06:42:59.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.591+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f052c0638e0 con 0x7f05100b2910 2024-05-08T06:42:59.591 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:42:59 smithi070 ceph-mon[29591]: pgmap v432: 129 pgs: 129 active+clean; 591 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-08T06:42:59.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.600+0000 7f0522a00700 1 -- 172.21.15.70:0/1923782403 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f052c0638e0 con 0x7f05100b2910 2024-05-08T06:42:59.600 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_0/ac79004c-96ea-4046-aeeb-a88889cabc24 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05100b2910 msgr2=0x7f05100b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05100b2910 0x7f05100b4dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f051c00b5c0 tx=0x7f051c01a040 comp rx=0 tx=0).stop 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c106080 msgr2=0x7f052c1a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c106080 0x7f052c1a1df0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f051800d950 tx=0x7f051800dd10 comp rx=0 tx=0).stop 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 shutdown_connections 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f052c10b6c0 0x7f052c19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f052c1056c0 0x7f052c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f05100b2910 0x7f05100b4dd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 --2- 172.21.15.70:0/1923782403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f052c106080 0x7f052c1a1df0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.604+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 >> 172.21.15.70:0/1923782403 conn(0x7f052c1011b0 msgr2=0x7f052c1019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.605+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 shutdown_connections 2024-05-08T06:42:59.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:42:59.605+0000 7f0530a00700 1 -- 172.21.15.70:0/1923782403 wait complete. 2024-05-08T06:42:59.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:42:59 smithi172 ceph-mon[33377]: pgmap v432: 129 pgs: 129 active+clean; 591 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-08T06:42:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:42:59 smithi194 ceph-mon[33679]: pgmap v432: 129 pgs: 129 active+clean; 591 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-08T06:43:00.589 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-08T06:43:00.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:00 smithi070 ceph-mon[29591]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:43:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:00 smithi172 ceph-mon[33377]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:43:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:00 smithi194 ceph-mon[33679]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:43:01.035 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:01.433 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:01 smithi070 ceph-mon[29591]: pgmap v433: 129 pgs: 129 active+clean; 609 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-05-08T06:43:01.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:01 smithi172 ceph-mon[33377]: pgmap v433: 129 pgs: 129 active+clean; 609 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-05-08T06:43:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:01 smithi194 ceph-mon[33679]: pgmap v433: 129 pgs: 129 active+clean; 609 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 8 op/s 2024-05-08T06:43:03.524 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:03 smithi070 ceph-mon[29591]: pgmap v434: 129 pgs: 129 active+clean; 609 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-05-08T06:43:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.580+0000 7f92c7400700 1 -- 172.21.15.70:0/1493491686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 msgr2=0x7f92c006bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.580+0000 7f92c7400700 1 --2- 172.21.15.70:0/1493491686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 0x7f92c006bff0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009990 tx=0x7f92ac009ca0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.580+0000 7f92c7400700 1 -- 172.21.15.70:0/1493491686 shutdown_connections 2024-05-08T06:43:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.580+0000 7f92c7400700 1 --2- 172.21.15.70:0/1493491686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92c006c530 0x7f92c0110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.580+0000 7f92c7400700 1 --2- 172.21.15.70:0/1493491686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c0109530 0x7f92c0109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.580+0000 7f92c7400700 1 --2- 172.21.15.70:0/1493491686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 0x7f92c006bff0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.580+0000 7f92c7400700 1 -- 172.21.15.70:0/1493491686 >> 172.21.15.70:0/1493491686 conn(0x7f92c0079350 msgr2=0x7f92c0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.580+0000 7f92c7400700 1 -- 172.21.15.70:0/1493491686 shutdown_connections 2024-05-08T06:43:03.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.580+0000 7f92c7400700 1 -- 172.21.15.70:0/1493491686 wait complete. 2024-05-08T06:43:03.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.582+0000 7f92c7400700 1 Processor -- start 2024-05-08T06:43:03.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.582+0000 7f92c7400700 1 -- start start 2024-05-08T06:43:03.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.582+0000 7f92c7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 0x7f92c01a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:03.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.582+0000 7f92c7400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c006c530 0x7f92c01a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:03.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.582+0000 7f92c7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92c0109530 0x7f92c019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:03.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.582+0000 7f92c7400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f92c0113540 con 0x7f92c006bb70 2024-05-08T06:43:03.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c7400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01133c0 con 0x7f92c0109530 2024-05-08T06:43:03.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c7400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f92c01136c0 con 0x7f92c006c530 2024-05-08T06:43:03.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c4a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 0x7f92c01a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:03.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c4a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 0x7f92c01a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44822/0 (socket says 172.21.15.70:44822) 2024-05-08T06:43:03.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c4a00700 1 -- 172.21.15.70:0/3806982152 learned_addr learned my addr 172.21.15.70:0/3806982152 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:03.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92bfe00700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c006c530 0x7f92c01a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:03.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c5400700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92c0109530 0x7f92c019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:03.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c4a00700 1 -- 172.21.15.70:0/3806982152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c006c530 msgr2=0x7f92c01a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:03.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c4a00700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c006c530 0x7f92c01a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c4a00700 1 -- 172.21.15.70:0/3806982152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92c0109530 msgr2=0x7f92c019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:03.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c4a00700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92c0109530 0x7f92c019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.583+0000 7f92c4a00700 1 -- 172.21.15.70:0/3806982152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c019c200 con 0x7f92c006bb70 2024-05-08T06:43:03.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.584+0000 7f92c4a00700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 0x7f92c01a18e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92b400d950 tx=0x7f92b400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:03.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.584+0000 7f92bd600700 1 -- 172.21.15.70:0/3806982152 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b4016070 con 0x7f92c006bb70 2024-05-08T06:43:03.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.584+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c019c4f0 con 0x7f92c006bb70 2024-05-08T06:43:03.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.584+0000 7f92bd600700 1 -- 172.21.15.70:0/3806982152 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92b4010460 con 0x7f92c006bb70 2024-05-08T06:43:03.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.584+0000 7f92bd600700 1 -- 172.21.15.70:0/3806982152 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b400f620 con 0x7f92c006bb70 2024-05-08T06:43:03.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.584+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c01a87b0 con 0x7f92c006bb70 2024-05-08T06:43:03.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.585+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c0104bf0 con 0x7f92c006bb70 2024-05-08T06:43:03.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.588+0000 7f92bd600700 1 -- 172.21.15.70:0/3806982152 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f92b4019070 con 0x7f92c006bb70 2024-05-08T06:43:03.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.589+0000 7f92bd600700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92a80b2910 0x7f92a80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:03.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.590+0000 7f92bd600700 1 -- 172.21.15.70:0/3806982152 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f92b40e23a0 con 0x7f92c006bb70 2024-05-08T06:43:03.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.590+0000 7f92bfe00700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92a80b2910 0x7f92a80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:03.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.590+0000 7f92bfe00700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92a80b2910 0x7f92a80b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00b5c0 tx=0x7f92ac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:03.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.592+0000 7f92bd600700 1 -- 172.21.15.70:0/3806982152 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f92b40a9ba0 con 0x7f92c006bb70 2024-05-08T06:43:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:03 smithi172 ceph-mon[33377]: pgmap v434: 129 pgs: 129 active+clean; 609 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-05-08T06:43:03.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:03 smithi194 ceph-mon[33679]: pgmap v434: 129 pgs: 129 active+clean; 609 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-05-08T06:43:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.855+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f92c010ed90 con 0x7f92a80b2910 2024-05-08T06:43:03.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.924+0000 7f92bd600700 1 -- 172.21.15.70:0/3806982152 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f92c010ed90 con 0x7f92a80b2910 2024-05-08T06:43:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92a80b2910 msgr2=0x7f92a80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92a80b2910 0x7f92a80b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00b5c0 tx=0x7f92ac01a040 comp rx=0 tx=0).stop 2024-05-08T06:43:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 msgr2=0x7f92c01a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 0x7f92c01a18e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92b400d950 tx=0x7f92b400dd10 comp rx=0 tx=0).stop 2024-05-08T06:43:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 shutdown_connections 2024-05-08T06:43:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f92c0109530 0x7f92c019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f92a80b2910 0x7f92a80b4dd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92c006bb70 0x7f92c01a18e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 --2- 172.21.15.70:0/3806982152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c006c530 0x7f92c01a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 >> 172.21.15.70:0/3806982152 conn(0x7f92c0079350 msgr2=0x7f92c010e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 shutdown_connections 2024-05-08T06:43:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:03.928+0000 7f92c7400700 1 -- 172.21.15.70:0/3806982152 wait complete. 2024-05-08T06:43:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:04 smithi070 ceph-mon[29591]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:43:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:04 smithi172 ceph-mon[33377]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:43:04.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:04 smithi194 ceph-mon[33679]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:43:04.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-08T06:43:05.274 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:05.673 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:05 smithi070 ceph-mon[29591]: pgmap v435: 129 pgs: 129 active+clean; 609 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-05-08T06:43:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:05 smithi172 ceph-mon[33377]: pgmap v435: 129 pgs: 129 active+clean; 609 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-05-08T06:43:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:05 smithi194 ceph-mon[33679]: pgmap v435: 129 pgs: 129 active+clean; 609 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-05-08T06:43:07.505 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:07 smithi070 ceph-mon[29591]: pgmap v436: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-05-08T06:43:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:07 smithi172 ceph-mon[33377]: pgmap v436: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-05-08T06:43:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:07 smithi194 ceph-mon[33679]: pgmap v436: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-05-08T06:43:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.834+0000 7fc065a00700 1 -- 172.21.15.70:0/4169955210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0601056b0 msgr2=0x7fc060105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:07.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.834+0000 7fc065a00700 1 --2- 172.21.15.70:0/4169955210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0601056b0 0x7fc060105b30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009990 tx=0x7fc04c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:43:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.834+0000 7fc065a00700 1 -- 172.21.15.70:0/4169955210 shutdown_connections 2024-05-08T06:43:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.834+0000 7fc065a00700 1 --2- 172.21.15.70:0/4169955210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc060106070 0x7fc060112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.834+0000 7fc065a00700 1 --2- 172.21.15.70:0/4169955210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc06010b6b0 0x7fc06010ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.834+0000 7fc065a00700 1 --2- 172.21.15.70:0/4169955210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0601056b0 0x7fc060105b30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.834+0000 7fc065a00700 1 -- 172.21.15.70:0/4169955210 >> 172.21.15.70:0/4169955210 conn(0x7fc0601011a0 msgr2=0x7fc0601035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.834+0000 7fc065a00700 1 -- 172.21.15.70:0/4169955210 shutdown_connections 2024-05-08T06:43:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.835+0000 7fc065a00700 1 -- 172.21.15.70:0/4169955210 wait complete. 2024-05-08T06:43:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc065a00700 1 Processor -- start 2024-05-08T06:43:07.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc065a00700 1 -- start start 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc065a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0601056b0 0x7fc0601a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc065a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc060106070 0x7fc0601a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc065a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc06010b6b0 0x7fc06019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc065a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0601157f0 con 0x7fc060106070 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc065a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc060115670 con 0x7fc06010b6b0 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc065a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc060115970 con 0x7fc0601056b0 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc05e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc060106070 0x7fc0601a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc05e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc060106070 0x7fc0601a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60244/0 (socket says 172.21.15.70:60244) 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.836+0000 7fc05e000700 1 -- 172.21.15.70:0/1458675915 learned_addr learned my addr 172.21.15.70:0/1458675915 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc05ea00700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0601056b0 0x7fc0601a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc05f400700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc06010b6b0 0x7fc06019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:07.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc05e000700 1 -- 172.21.15.70:0/1458675915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0601056b0 msgr2=0x7fc0601a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc05e000700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0601056b0 0x7fc0601a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc05e000700 1 -- 172.21.15.70:0/1458675915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc06010b6b0 msgr2=0x7fc06019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc05e000700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc06010b6b0 0x7fc06019ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc05e000700 1 -- 172.21.15.70:0/1458675915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06019c1b0 con 0x7fc060106070 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc05e000700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc060106070 0x7fc0601a1dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc04c005910 tx=0x7fc04c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc057400700 1 -- 172.21.15.70:0/1458675915 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c027070 con 0x7fc060106070 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc057400700 1 -- 172.21.15.70:0/1458675915 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc04c00fce0 con 0x7fc060106070 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc057400700 1 -- 172.21.15.70:0/1458675915 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04c0173f0 con 0x7fc060106070 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.837+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06019c440 con 0x7fc060106070 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.838+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0601a8760 con 0x7fc060106070 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.839+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc06006a190 con 0x7fc060106070 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.841+0000 7fc057400700 1 -- 172.21.15.70:0/1458675915 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc04c02a070 con 0x7fc060106070 2024-05-08T06:43:07.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.843+0000 7fc057400700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc0440b2910 0x7fc0440b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.844+0000 7fc057400700 1 -- 172.21.15.70:0/1458675915 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7fc04c0e3800 con 0x7fc060106070 2024-05-08T06:43:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.844+0000 7fc05ea00700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc0440b2910 0x7fc0440b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.844+0000 7fc05ea00700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc0440b2910 0x7fc0440b4dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc06019cb90 tx=0x7fc050005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:07.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:07.848+0000 7fc057400700 1 -- 172.21.15.70:0/1458675915 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc04c05fdf0 con 0x7fc060106070 2024-05-08T06:43:08.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.121+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fc0600638e0 con 0x7fc0440b2910 2024-05-08T06:43:08.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.131+0000 7fc057400700 1 -- 172.21.15.70:0/1458675915 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fc0600638e0 con 0x7fc0440b2910 2024-05-08T06:43:08.129 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_1/03a32193-aed9-4163-833a-63906c3cf433 2024-05-08T06:43:08.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc0440b2910 msgr2=0x7fc0440b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc0440b2910 0x7fc0440b4dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc06019cb90 tx=0x7fc050005cf0 comp rx=0 tx=0).stop 2024-05-08T06:43:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc060106070 msgr2=0x7fc0601a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc060106070 0x7fc0601a1dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc04c005910 tx=0x7fc04c009f90 comp rx=0 tx=0).stop 2024-05-08T06:43:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 shutdown_connections 2024-05-08T06:43:08.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc06010b6b0 0x7fc06019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0601056b0 0x7fc0601a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc0440b2910 0x7fc0440b4dd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 --2- 172.21.15.70:0/1458675915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc060106070 0x7fc0601a1dd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 >> 172.21.15.70:0/1458675915 conn(0x7fc0601011a0 msgr2=0x7fc060101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 shutdown_connections 2024-05-08T06:43:08.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:08.134+0000 7fc065a00700 1 -- 172.21.15.70:0/1458675915 wait complete. 2024-05-08T06:43:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:08 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:43:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:08 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:43:08.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:08 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:43:09.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:43:09.696 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:09 smithi172 ceph-mon[33377]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:43:09.697 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:09 smithi172 ceph-mon[33377]: pgmap v437: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.8 KiB/s wr, 6 op/s 2024-05-08T06:43:09.711 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:09 smithi194 ceph-mon[33679]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:43:09.712 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:09 smithi194 ceph-mon[33679]: pgmap v437: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.8 KiB/s wr, 6 op/s 2024-05-08T06:43:09.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:09 smithi070 ceph-mon[29591]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:43:09.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:09 smithi070 ceph-mon[29591]: pgmap v437: 129 pgs: 129 active+clean; 628 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.8 KiB/s wr, 6 op/s 2024-05-08T06:43:10.180 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:11.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:11 smithi194 ceph-mon[33679]: pgmap v438: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-05-08T06:43:11.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:11 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:11 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:11 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:11 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:11 smithi070 ceph-mon[29591]: pgmap v438: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-05-08T06:43:11.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:11 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:11 smithi172 ceph-mon[33377]: pgmap v438: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 4.7 KiB/s wr, 9 op/s 2024-05-08T06:43:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:11 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:11 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:11 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:11 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:12.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.416+0000 7f1e47e00700 1 -- 172.21.15.70:0/3218754357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40104100 msgr2=0x7f1e40108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:12.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.416+0000 7f1e47e00700 1 --2- 172.21.15.70:0/3218754357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40104100 0x7f1e40108120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0099c0 tx=0x7f1e2c009cd0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.416+0000 7f1e47e00700 1 -- 172.21.15.70:0/3218754357 shutdown_connections 2024-05-08T06:43:12.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.416+0000 7f1e47e00700 1 --2- 172.21.15.70:0/3218754357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e40108850 0x7f1e401103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.416+0000 7f1e47e00700 1 --2- 172.21.15.70:0/3218754357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e40103750 0x7f1e40103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.416+0000 7f1e47e00700 1 --2- 172.21.15.70:0/3218754357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40104100 0x7f1e40108120 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.416+0000 7f1e47e00700 1 -- 172.21.15.70:0/3218754357 >> 172.21.15.70:0/3218754357 conn(0x7f1e4007a600 msgr2=0x7f1e4007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:12.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.416+0000 7f1e47e00700 1 -- 172.21.15.70:0/3218754357 shutdown_connections 2024-05-08T06:43:12.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.417+0000 7f1e47e00700 1 -- 172.21.15.70:0/3218754357 wait complete. 2024-05-08T06:43:12.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.418+0000 7f1e47e00700 1 Processor -- start 2024-05-08T06:43:12.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.418+0000 7f1e47e00700 1 -- start start 2024-05-08T06:43:12.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e47e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e40103750 0x7f1e4019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:12.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e47e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e40104100 0x7f1e4019c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:12.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e47e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40108850 0x7f1e401a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:12.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e47e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40113610 con 0x7f1e40108850 2024-05-08T06:43:12.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e47e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40113490 con 0x7f1e40103750 2024-05-08T06:43:12.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e47e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40113790 con 0x7f1e40104100 2024-05-08T06:43:12.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e45e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40108850 0x7f1e401a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:12.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e45e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40108850 0x7f1e401a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60250/0 (socket says 172.21.15.70:60250) 2024-05-08T06:43:12.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e45e00700 1 -- 172.21.15.70:0/4172151479 learned_addr learned my addr 172.21.15.70:0/4172151479 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:12.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e45400700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e40103750 0x7f1e4019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:12.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.419+0000 7f1e44a00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e40104100 0x7f1e4019c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:12.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e45e00700 1 -- 172.21.15.70:0/4172151479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e40104100 msgr2=0x7f1e4019c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:12.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e45e00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e40104100 0x7f1e4019c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e45e00700 1 -- 172.21.15.70:0/4172151479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e40103750 msgr2=0x7f1e4019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:12.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e45e00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e40103750 0x7f1e4019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e45e00700 1 -- 172.21.15.70:0/4172151479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e401a0d40 con 0x7f1e40108850 2024-05-08T06:43:12.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e44a00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e40104100 0x7f1e4019c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:43:12.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e45400700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e40103750 0x7f1e4019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:43:12.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e45e00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40108850 0x7f1e401a0600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800b550 tx=0x7f1e3800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:12.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e3e000700 1 -- 172.21.15.70:0/4172151479 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38015020 con 0x7f1e40108850 2024-05-08T06:43:12.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e3e000700 1 -- 172.21.15.70:0/4172151479 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e38011cc0 con 0x7f1e40108850 2024-05-08T06:43:12.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.420+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e401a1030 con 0x7f1e40108850 2024-05-08T06:43:12.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.421+0000 7f1e3e000700 1 -- 172.21.15.70:0/4172151479 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38010c70 con 0x7f1e40108850 2024-05-08T06:43:12.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.421+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e401a88b0 con 0x7f1e40108850 2024-05-08T06:43:12.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.422+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4006a190 con 0x7f1e40108850 2024-05-08T06:43:12.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.424+0000 7f1e3e000700 1 -- 172.21.15.70:0/4172151479 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1e38018020 con 0x7f1e40108850 2024-05-08T06:43:12.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.427+0000 7f1e3e000700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1e280b2910 0x7f1e280b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:12.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.427+0000 7f1e3e000700 1 -- 172.21.15.70:0/4172151479 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9092+0+0 (secure 0 0 0) 0x7f1e380e1e20 con 0x7f1e40108850 2024-05-08T06:43:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.427+0000 7f1e45400700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1e280b2910 0x7f1e280b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:12.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.428+0000 7f1e45400700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1e280b2910 0x7f1e280b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009fa0 tx=0x7f1e34009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:12.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.431+0000 7f1e3e000700 1 -- 172.21.15.70:0/4172151479 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1e3801f020 con 0x7f1e40108850 2024-05-08T06:43:12.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.711+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e401a8a80 con 0x7f1e40108850 2024-05-08T06:43:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.714+0000 7f1e3e000700 1 -- 172.21.15.70:0/4172151479 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11876 (secure 0 0 0) 0x7f1e380a9730 con 0x7f1e40108850 2024-05-08T06:43:12.713 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:43:12.713 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:42:47.248168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:43:12.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1e280b2910 msgr2=0x7f1e280b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:12.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1e280b2910 0x7f1e280b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e34009fa0 tx=0x7f1e34009570 comp rx=0 tx=0).stop 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40108850 msgr2=0x7f1e401a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40108850 0x7f1e401a0600 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800b550 tx=0x7f1e3800b910 comp rx=0 tx=0).stop 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 shutdown_connections 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1e280b2910 0x7f1e280b4dd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e40108850 0x7f1e401a0600 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e40103750 0x7f1e4019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 --2- 172.21.15.70:0/4172151479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e40104100 0x7f1e4019c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 >> 172.21.15.70:0/4172151479 conn(0x7f1e4007a600 msgr2=0x7f1e401015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 shutdown_connections 2024-05-08T06:43:12.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:12.717+0000 7f1e47e00700 1 -- 172.21.15.70:0/4172151479 wait complete. 2024-05-08T06:43:12.717 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 26 2024-05-08T06:43:13.751 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:13 smithi070 ceph-mon[29591]: pgmap v439: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-05-08T06:43:13.751 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:13.751 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:13 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:13.751 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4172151479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:43:13.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:43:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:13 smithi194 ceph-mon[33679]: pgmap v439: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-05-08T06:43:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:13 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:13 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4172151479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:43:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:13 smithi172 ceph-mon[33377]: pgmap v439: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-05-08T06:43:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:13 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:13 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4172151479' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:43:14.184 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:14.584 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:43:14.584 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:43:14.584 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:43:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:43:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:43:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:43:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:43:16.010 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:15 smithi070 ceph-mon[29591]: pgmap v440: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-05-08T06:43:16.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-08T06:43:16.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-05-08T06:43:16.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-05-08T06:43:16.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-08T06:43:16.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:15 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-05-08T06:43:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:15 smithi172 ceph-mon[33377]: pgmap v440: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-05-08T06:43:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-08T06:43:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-05-08T06:43:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-05-08T06:43:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-08T06:43:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:15 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-05-08T06:43:16.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:15 smithi194 ceph-mon[33679]: pgmap v440: 129 pgs: 129 active+clean; 637 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 2.8 KiB/s wr, 7 op/s 2024-05-08T06:43:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-08T06:43:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-05-08T06:43:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-05-08T06:43:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-08T06:43:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:15 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]: dispatch 2024-05-08T06:43:16.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.541+0000 7fc65ba00700 1 -- 172.21.15.70:0/3751414726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc65410fea0 msgr2=0x7fc654112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:16.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.541+0000 7fc65ba00700 1 --2- 172.21.15.70:0/3751414726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc65410fea0 0x7fc654112290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00b0a0 tx=0x7fc64c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.542+0000 7fc65ba00700 1 -- 172.21.15.70:0/3751414726 shutdown_connections 2024-05-08T06:43:16.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.542+0000 7fc65ba00700 1 --2- 172.21.15.70:0/3751414726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc65410fea0 0x7fc654112290 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.542+0000 7fc65ba00700 1 --2- 172.21.15.70:0/3751414726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6540756d0 0x7fc654075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.542+0000 7fc65ba00700 1 --2- 172.21.15.70:0/3751414726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc654075ff0 0x7fc65410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.542+0000 7fc65ba00700 1 -- 172.21.15.70:0/3751414726 >> 172.21.15.70:0/3751414726 conn(0x7fc65407a600 msgr2=0x7fc65407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:16.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.542+0000 7fc65ba00700 1 -- 172.21.15.70:0/3751414726 shutdown_connections 2024-05-08T06:43:16.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.542+0000 7fc65ba00700 1 -- 172.21.15.70:0/3751414726 wait complete. 2024-05-08T06:43:16.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.543+0000 7fc65ba00700 1 Processor -- start 2024-05-08T06:43:16.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.543+0000 7fc65ba00700 1 -- start start 2024-05-08T06:43:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.543+0000 7fc65ba00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6540756d0 0x7fc6541a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.543+0000 7fc65ba00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc654075ff0 0x7fc6541a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.543+0000 7fc65ba00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc65410fea0 0x7fc65419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.543+0000 7fc65ba00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc654115740 con 0x7fc654075ff0 2024-05-08T06:43:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.543+0000 7fc65ba00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc6541155c0 con 0x7fc6540756d0 2024-05-08T06:43:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.543+0000 7fc65ba00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc6541158c0 con 0x7fc65410fea0 2024-05-08T06:43:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc64be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc654075ff0 0x7fc6541a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc64be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc654075ff0 0x7fc6541a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60278/0 (socket says 172.21.15.70:60278) 2024-05-08T06:43:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc64be00700 1 -- 172.21.15.70:0/842549021 learned_addr learned my addr 172.21.15.70:0/842549021 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc659000700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6540756d0 0x7fc6541a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc659a00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc65410fea0 0x7fc65419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc64be00700 1 -- 172.21.15.70:0/842549021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc65410fea0 msgr2=0x7fc65419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc64be00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc65410fea0 0x7fc65419ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc64be00700 1 -- 172.21.15.70:0/842549021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6540756d0 msgr2=0x7fc6541a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc64be00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6540756d0 0x7fc6541a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.544+0000 7fc64be00700 1 -- 172.21.15.70:0/842549021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65419c1a0 con 0x7fc654075ff0 2024-05-08T06:43:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.545+0000 7fc64be00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc654075ff0 0x7fc6541a1dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00c970 tx=0x7fc63c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.545+0000 7fc652000700 1 -- 172.21.15.70:0/842549021 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c004220 con 0x7fc654075ff0 2024-05-08T06:43:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.545+0000 7fc652000700 1 -- 172.21.15.70:0/842549021 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc63c007d30 con 0x7fc654075ff0 2024-05-08T06:43:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.545+0000 7fc652000700 1 -- 172.21.15.70:0/842549021 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c003c90 con 0x7fc654075ff0 2024-05-08T06:43:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.545+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65419c430 con 0x7fc654075ff0 2024-05-08T06:43:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.545+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6541a8750 con 0x7fc654075ff0 2024-05-08T06:43:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.546+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc65406a190 con 0x7fc654075ff0 2024-05-08T06:43:16.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.549+0000 7fc652000700 1 -- 172.21.15.70:0/842549021 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc63c0078a0 con 0x7fc654075ff0 2024-05-08T06:43:16.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.550+0000 7fc652000700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc6380b2990 0x7fc6380b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:16.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.550+0000 7fc652000700 1 -- 172.21.15.70:0/842549021 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9237+0+0 (secure 0 0 0) 0x7fc63c0e23c0 con 0x7fc654075ff0 2024-05-08T06:43:16.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.551+0000 7fc659000700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc6380b2990 0x7fc6380b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:16.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.551+0000 7fc659000700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc6380b2990 0x7fc6380b4e50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc644005950 tx=0x7fc644005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:16.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.555+0000 7fc652000700 1 -- 172.21.15.70:0/842549021 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc63c014030 con 0x7fc654075ff0 2024-05-08T06:43:16.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.795+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc65402e510 con 0x7fc654075ff0 2024-05-08T06:43:16.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.800+0000 7fc652000700 1 -- 172.21.15.70:0/842549021 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24865 (secure 0 0 0) 0x7fc63c0a9b30 con 0x7fc654075ff0 2024-05-08T06:43:16.800 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:43:16.800 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":91,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:43:15.838992+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:43:16.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc6380b2990 msgr2=0x7fc6380b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc6380b2990 0x7fc6380b4e50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc644005950 tx=0x7fc644005ed0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc654075ff0 msgr2=0x7fc6541a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc654075ff0 0x7fc6541a1dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00c970 tx=0x7fc63c00cd30 comp rx=0 tx=0).stop 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 shutdown_connections 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc65410fea0 0x7fc65419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6540756d0 0x7fc6541a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc6380b2990 0x7fc6380b4e50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 --2- 172.21.15.70:0/842549021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc654075ff0 0x7fc6541a1dc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 >> 172.21.15.70:0/842549021 conn(0x7fc65407a600 msgr2=0x7fc654100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 shutdown_connections 2024-05-08T06:43:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:16.803+0000 7fc65ba00700 1 -- 172.21.15.70:0/842549021 wait complete. 2024-05-08T06:43:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-08T06:43:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-05-08T06:43:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-05-08T06:43:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-08T06:43:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-05-08T06:43:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:16 smithi070 ceph-mon[29591]: osdmap e91: 12 total, 12 up, 12 in 2024-05-08T06:43:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:16 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/842549021' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:43:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-08T06:43:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-05-08T06:43:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-05-08T06:43:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-08T06:43:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-05-08T06:43:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:16 smithi172 ceph-mon[33377]: osdmap e91: 12 total, 12 up, 12 in 2024-05-08T06:43:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:16 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/842549021' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:43:17.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-08T06:43:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-05-08T06:43:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-05-08T06:43:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-08T06:43:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2d", "id": [3, 9]}]': finished 2024-05-08T06:43:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:16 smithi194 ceph-mon[33679]: osdmap e91: 12 total, 12 up, 12 in 2024-05-08T06:43:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:16 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/842549021' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:43:17.841 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-08T06:43:17.841 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T06:43:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:17 smithi070 ceph-mon[29591]: pgmap v442: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-05-08T06:43:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:17 smithi070 ceph-mon[29591]: osdmap e92: 12 total, 12 up, 12 in 2024-05-08T06:43:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:17 smithi172 ceph-mon[33377]: pgmap v442: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-05-08T06:43:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:17 smithi172 ceph-mon[33377]: osdmap e92: 12 total, 12 up, 12 in 2024-05-08T06:43:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:17 smithi194 ceph-mon[33679]: pgmap v442: 129 pgs: 129 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.8 KiB/s wr, 7 op/s 2024-05-08T06:43:18.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:17 smithi194 ceph-mon[33679]: osdmap e92: 12 total, 12 up, 12 in 2024-05-08T06:43:18.287 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:18.966 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:18 smithi070 ceph-mon[29591]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-08T06:43:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:18 smithi172 ceph-mon[33377]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-08T06:43:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:18 smithi194 ceph-mon[33679]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-08T06:43:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:19 smithi172 ceph-mon[33377]: pgmap v444: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1023 B/s wr, 4 op/s 2024-05-08T06:43:20.234 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:19 smithi070 ceph-mon[29591]: pgmap v444: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1023 B/s wr, 4 op/s 2024-05-08T06:43:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:19 smithi194 ceph-mon[33679]: pgmap v444: 129 pgs: 2 peering, 127 active+clean; 642 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1023 B/s wr, 4 op/s 2024-05-08T06:43:20.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.804+0000 7f6ebde00700 1 -- 172.21.15.70:0/1098516218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8108850 msgr2=0x7f6eb81103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:20.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.804+0000 7f6ebde00700 1 --2- 172.21.15.70:0/1098516218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8108850 0x7f6eb81103d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6eb000b0d0 tx=0x7f6eb000b3e0 comp rx=0 tx=0).stop 2024-05-08T06:43:20.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.804+0000 7f6ebde00700 1 -- 172.21.15.70:0/1098516218 shutdown_connections 2024-05-08T06:43:20.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.804+0000 7f6ebde00700 1 --2- 172.21.15.70:0/1098516218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8108850 0x7f6eb81103d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:20.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.804+0000 7f6ebde00700 1 --2- 172.21.15.70:0/1098516218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb8103750 0x7f6eb8103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:20.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.804+0000 7f6ebde00700 1 --2- 172.21.15.70:0/1098516218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eb8104100 0x7f6eb8108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:20.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.804+0000 7f6ebde00700 1 -- 172.21.15.70:0/1098516218 >> 172.21.15.70:0/1098516218 conn(0x7f6eb807a600 msgr2=0x7f6eb807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:20.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.804+0000 7f6ebde00700 1 -- 172.21.15.70:0/1098516218 shutdown_connections 2024-05-08T06:43:20.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.804+0000 7f6ebde00700 1 -- 172.21.15.70:0/1098516218 wait complete. 2024-05-08T06:43:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.805+0000 7f6ebde00700 1 Processor -- start 2024-05-08T06:43:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6ebde00700 1 -- start start 2024-05-08T06:43:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6ebde00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb8103750 0x7f6eb81a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6ebde00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8104100 0x7f6eb81a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6ebde00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eb8108850 0x7f6eb819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6ebde00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb81134f0 con 0x7f6eb8104100 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6ebde00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8113370 con 0x7f6eb8108850 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6ebde00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8113670 con 0x7f6eb8103750 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6eae000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8104100 0x7f6eb81a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6eae000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8104100 0x7f6eb81a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57276/0 (socket says 172.21.15.70:57276) 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6eae000700 1 -- 172.21.15.70:0/3230415690 learned_addr learned my addr 172.21.15.70:0/3230415690 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.806+0000 7f6eb6a00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb8103750 0x7f6eb81a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6eae000700 1 -- 172.21.15.70:0/3230415690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb8103750 msgr2=0x7f6eb81a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6eb7400700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eb8108850 0x7f6eb819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6eae000700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb8103750 0x7f6eb81a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6eae000700 1 -- 172.21.15.70:0/3230415690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eb8108850 msgr2=0x7f6eb819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6eae000700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eb8108850 0x7f6eb819b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6eae000700 1 -- 172.21.15.70:0/3230415690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb819c120 con 0x7f6eb8104100 2024-05-08T06:43:20.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6eb7400700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eb8108850 0x7f6eb819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:43:20.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6eae000700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8104100 0x7f6eb81a1d40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000e9a0 tx=0x7f6ea000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:20.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6ebca00700 1 -- 172.21.15.70:0/3230415690 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea000cbd0 con 0x7f6eb8104100 2024-05-08T06:43:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6ebca00700 1 -- 172.21.15.70:0/3230415690 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ea000cd70 con 0x7f6eb8104100 2024-05-08T06:43:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb819c410 con 0x7f6eb8104100 2024-05-08T06:43:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.807+0000 7f6ebca00700 1 -- 172.21.15.70:0/3230415690 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0018680 con 0x7f6eb8104100 2024-05-08T06:43:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.808+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb81a86d0 con 0x7f6eb8104100 2024-05-08T06:43:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.809+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb806a190 con 0x7f6eb8104100 2024-05-08T06:43:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.813+0000 7f6ebca00700 1 -- 172.21.15.70:0/3230415690 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6ea0010950 con 0x7f6eb8104100 2024-05-08T06:43:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.814+0000 7f6ebca00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6e9c0b2990 0x7f6e9c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:20.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.814+0000 7f6ebca00700 1 -- 172.21.15.70:0/3230415690 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f6ea00e2cd0 con 0x7f6eb8104100 2024-05-08T06:43:20.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.814+0000 7f6eb6a00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6e9c0b2990 0x7f6e9c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:20.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.815+0000 7f6eb6a00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6e9c0b2990 0x7f6e9c0b4e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6eb819cb00 tx=0x7f6ea8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:20.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:20.817+0000 7f6ebca00700 1 -- 172.21.15.70:0/3230415690 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6ea00aa440 con 0x7f6eb8104100 2024-05-08T06:43:21.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.046+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6eb8101c10 con 0x7f6e9c0b2990 2024-05-08T06:43:21.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.066+0000 7f6ebca00700 1 -- 172.21.15.70:0/3230415690 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340407 (secure 0 0 0) 0x7f6eb8101c10 con 0x7f6e9c0b2990 2024-05-08T06:43:21.073 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:43:21.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6e9c0b2990 msgr2=0x7f6e9c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:21.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6e9c0b2990 0x7f6e9c0b4e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6eb819cb00 tx=0x7f6ea8009260 comp rx=0 tx=0).stop 2024-05-08T06:43:21.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8104100 msgr2=0x7f6eb81a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:21.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8104100 0x7f6eb81a1d40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000e9a0 tx=0x7f6ea000ed60 comp rx=0 tx=0).stop 2024-05-08T06:43:21.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 shutdown_connections 2024-05-08T06:43:21.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6eb8108850 0x7f6eb819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:21.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6eb8103750 0x7f6eb81a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:21.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6e9c0b2990 0x7f6e9c0b4e50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:21.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 --2- 172.21.15.70:0/3230415690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6eb8104100 0x7f6eb81a1d40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:21.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.076+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 >> 172.21.15.70:0/3230415690 conn(0x7f6eb807a600 msgr2=0x7f6eb8101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:21.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.077+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 shutdown_connections 2024-05-08T06:43:21.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:21.077+0000 7f6ebde00700 1 -- 172.21.15.70:0/3230415690 wait complete. 2024-05-08T06:43:21.078 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-08T06:43:22.066 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-05-08T06:43:20.138358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661695,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":325,"num_read_kb":266,"num_write":292,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384480,"kb_used_data":14460,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557344,"statfs":{"total":1151940427776,"available":1151546720256,"internally_reserved":0,"allocated":14807040,"data_stored":8280501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9568,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":38,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003003"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.872366+0000","last_change":"2024-05-08T06:41:09.587375+0000","last_active":"2024-05-08T06:43:15.872366+0000","last_peered":"2024-05-08T06:43:15.872366+0000","last_clean":"2024-05-08T06:43:15.872366+0000","last_became_active":"2024-05-08T06:41:09.585981+0000","last_became_peered":"2024-05-08T06:41:09.585981+0000","last_unstale":"2024-05-08T06:43:15.872366+0000","last_undegraded":"2024-05-08T06:43:15.872366+0000","last_fullsized":"2024-05-08T06:43:15.872366+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:21.366529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874979+0000","last_change":"2024-05-08T06:41:09.573666+0000","last_active":"2024-05-08T06:43:16.874979+0000","last_peered":"2024-05-08T06:43:16.874979+0000","last_clean":"2024-05-08T06:43:16.874979+0000","last_became_active":"2024-05-08T06:41:09.573331+0000","last_became_peered":"2024-05-08T06:41:09.573331+0000","last_unstale":"2024-05-08T06:43:16.874979+0000","last_undegraded":"2024-05-08T06:43:16.874979+0000","last_fullsized":"2024-05-08T06:43:16.874979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:03:14.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874635+0000","last_change":"2024-05-08T06:41:09.582304+0000","last_active":"2024-05-08T06:43:16.874635+0000","last_peered":"2024-05-08T06:43:16.874635+0000","last_clean":"2024-05-08T06:43:16.874635+0000","last_became_active":"2024-05-08T06:41:09.581916+0000","last_became_peered":"2024-05-08T06:41:09.581916+0000","last_unstale":"2024-05-08T06:43:16.874635+0000","last_undegraded":"2024-05-08T06:43:16.874635+0000","last_fullsized":"2024-05-08T06:43:16.874635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:26.221008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866467+0000","last_change":"2024-05-08T06:42:15.863857+0000","last_active":"2024-05-08T06:43:16.866467+0000","last_peered":"2024-05-08T06:43:16.866467+0000","last_clean":"2024-05-08T06:43:16.866467+0000","last_became_active":"2024-05-08T06:42:15.863147+0000","last_became_peered":"2024-05-08T06:42:15.863147+0000","last_unstale":"2024-05-08T06:43:16.866467+0000","last_undegraded":"2024-05-08T06:43:16.866467+0000","last_fullsized":"2024-05-08T06:43:16.866467+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:48:20.951766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873972+0000","last_change":"2024-05-08T06:41:09.582429+0000","last_active":"2024-05-08T06:43:16.873972+0000","last_peered":"2024-05-08T06:43:16.873972+0000","last_clean":"2024-05-08T06:43:16.873972+0000","last_became_active":"2024-05-08T06:41:09.580152+0000","last_became_peered":"2024-05-08T06:41:09.580152+0000","last_unstale":"2024-05-08T06:43:16.873972+0000","last_undegraded":"2024-05-08T06:43:16.873972+0000","last_fullsized":"2024-05-08T06:43:16.873972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:58.992177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.132118+0000","last_change":"2024-05-08T06:41:09.576432+0000","last_active":"2024-05-08T06:43:17.132118+0000","last_peered":"2024-05-08T06:43:17.132118+0000","last_clean":"2024-05-08T06:43:17.132118+0000","last_became_active":"2024-05-08T06:41:09.575723+0000","last_became_peered":"2024-05-08T06:41:09.575723+0000","last_unstale":"2024-05-08T06:43:17.132118+0000","last_undegraded":"2024-05-08T06:43:17.132118+0000","last_fullsized":"2024-05-08T06:43:17.132118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:51.802944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878767+0000","last_change":"2024-05-08T06:42:15.856660+0000","last_active":"2024-05-08T06:43:16.878767+0000","last_peered":"2024-05-08T06:43:16.878767+0000","last_clean":"2024-05-08T06:43:16.878767+0000","last_became_active":"2024-05-08T06:42:15.855585+0000","last_became_peered":"2024-05-08T06:42:15.855585+0000","last_unstale":"2024-05-08T06:43:16.878767+0000","last_undegraded":"2024-05-08T06:43:16.878767+0000","last_fullsized":"2024-05-08T06:43:16.878767+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:43.647357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884369+0000","last_change":"2024-05-08T06:41:09.579941+0000","last_active":"2024-05-08T06:43:16.884369+0000","last_peered":"2024-05-08T06:43:16.884369+0000","last_clean":"2024-05-08T06:43:16.884369+0000","last_became_active":"2024-05-08T06:41:09.578961+0000","last_became_peered":"2024-05-08T06:41:09.578961+0000","last_unstale":"2024-05-08T06:43:16.884369+0000","last_undegraded":"2024-05-08T06:43:16.884369+0000","last_fullsized":"2024-05-08T06:43:16.884369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:28:59.000080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.863171+0000","last_change":"2024-05-08T06:41:09.580544+0000","last_active":"2024-05-08T06:43:15.863171+0000","last_peered":"2024-05-08T06:43:15.863171+0000","last_clean":"2024-05-08T06:43:15.863171+0000","last_became_active":"2024-05-08T06:41:09.579445+0000","last_became_peered":"2024-05-08T06:41:09.579445+0000","last_unstale":"2024-05-08T06:43:15.863171+0000","last_undegraded":"2024-05-08T06:43:15.863171+0000","last_fullsized":"2024-05-08T06:43:15.863171+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:28.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.133865+0000","last_change":"2024-05-08T06:41:09.583133+0000","last_active":"2024-05-08T06:43:17.133865+0000","last_peered":"2024-05-08T06:43:17.133865+0000","last_clean":"2024-05-08T06:43:17.133865+0000","last_became_active":"2024-05-08T06:41:09.582261+0000","last_became_peered":"2024-05-08T06:41:09.582261+0000","last_unstale":"2024-05-08T06:43:17.133865+0000","last_undegraded":"2024-05-08T06:43:17.133865+0000","last_fullsized":"2024-05-08T06:43:17.133865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:26.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879642+0000","last_change":"2024-05-08T06:41:09.575410+0000","last_active":"2024-05-08T06:43:16.879642+0000","last_peered":"2024-05-08T06:43:16.879642+0000","last_clean":"2024-05-08T06:43:16.879642+0000","last_became_active":"2024-05-08T06:41:09.574936+0000","last_became_peered":"2024-05-08T06:41:09.574936+0000","last_unstale":"2024-05-08T06:43:16.879642+0000","last_undegraded":"2024-05-08T06:43:16.879642+0000","last_fullsized":"2024-05-08T06:43:16.879642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:45.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870432+0000","last_change":"2024-05-08T06:41:09.582844+0000","last_active":"2024-05-08T06:43:16.870432+0000","last_peered":"2024-05-08T06:43:16.870432+0000","last_clean":"2024-05-08T06:43:16.870432+0000","last_became_active":"2024-05-08T06:41:09.582497+0000","last_became_peered":"2024-05-08T06:41:09.582497+0000","last_unstale":"2024-05-08T06:43:16.870432+0000","last_undegraded":"2024-05-08T06:43:16.870432+0000","last_fullsized":"2024-05-08T06:43:16.870432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:09:45.168495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956880+0000","last_change":"2024-05-08T06:41:09.565312+0000","last_active":"2024-05-08T06:43:16.956880+0000","last_peered":"2024-05-08T06:43:16.956880+0000","last_clean":"2024-05-08T06:43:16.956880+0000","last_became_active":"2024-05-08T06:41:09.563425+0000","last_became_peered":"2024-05-08T06:41:09.563425+0000","last_unstale":"2024-05-08T06:43:16.956880+0000","last_undegraded":"2024-05-08T06:43:16.956880+0000","last_fullsized":"2024-05-08T06:43:16.956880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:08.706504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874453+0000","last_change":"2024-05-08T06:41:09.579395+0000","last_active":"2024-05-08T06:43:16.874453+0000","last_peered":"2024-05-08T06:43:16.874453+0000","last_clean":"2024-05-08T06:43:16.874453+0000","last_became_active":"2024-05-08T06:41:09.575881+0000","last_became_peered":"2024-05-08T06:41:09.575881+0000","last_unstale":"2024-05-08T06:43:16.874453+0000","last_undegraded":"2024-05-08T06:43:16.874453+0000","last_fullsized":"2024-05-08T06:43:16.874453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:37.109480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874274+0000","last_change":"2024-05-08T06:41:09.589859+0000","last_active":"2024-05-08T06:43:16.874274+0000","last_peered":"2024-05-08T06:43:16.874274+0000","last_clean":"2024-05-08T06:43:16.874274+0000","last_became_active":"2024-05-08T06:41:09.589002+0000","last_became_peered":"2024-05-08T06:41:09.589002+0000","last_unstale":"2024-05-08T06:43:16.874274+0000","last_undegraded":"2024-05-08T06:43:16.874274+0000","last_fullsized":"2024-05-08T06:43:16.874274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:15:39.022268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.860979+0000","last_change":"2024-05-08T06:41:09.566551+0000","last_active":"2024-05-08T06:43:15.860979+0000","last_peered":"2024-05-08T06:43:15.860979+0000","last_clean":"2024-05-08T06:43:15.860979+0000","last_became_active":"2024-05-08T06:41:09.564599+0000","last_became_peered":"2024-05-08T06:41:09.564599+0000","last_unstale":"2024-05-08T06:43:15.860979+0000","last_undegraded":"2024-05-08T06:43:15.860979+0000","last_fullsized":"2024-05-08T06:43:15.860979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:45.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.871950+0000","last_change":"2024-05-08T06:41:09.582643+0000","last_active":"2024-05-08T06:43:15.871950+0000","last_peered":"2024-05-08T06:43:15.871950+0000","last_clean":"2024-05-08T06:43:15.871950+0000","last_became_active":"2024-05-08T06:41:09.582213+0000","last_became_peered":"2024-05-08T06:41:09.582213+0000","last_unstale":"2024-05-08T06:43:15.871950+0000","last_undegraded":"2024-05-08T06:43:15.871950+0000","last_fullsized":"2024-05-08T06:43:15.871950+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:18.471194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866942+0000","last_change":"2024-05-08T06:41:09.581447+0000","last_active":"2024-05-08T06:43:16.866942+0000","last_peered":"2024-05-08T06:43:16.866942+0000","last_clean":"2024-05-08T06:43:16.866942+0000","last_became_active":"2024-05-08T06:41:09.581067+0000","last_became_peered":"2024-05-08T06:41:09.581067+0000","last_unstale":"2024-05-08T06:43:16.866942+0000","last_undegraded":"2024-05-08T06:43:16.866942+0000","last_fullsized":"2024-05-08T06:43:16.866942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:26.967371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.960640+0000","last_change":"2024-05-08T06:43:16.960640+0000","last_active":"2024-05-08T06:43:16.960640+0000","last_peered":"2024-05-08T06:43:16.960640+0000","last_clean":"2024-05-08T06:43:16.960640+0000","last_became_active":"2024-05-08T06:43:16.959541+0000","last_became_peered":"2024-05-08T06:43:16.959541+0000","last_unstale":"2024-05-08T06:43:16.960640+0000","last_undegraded":"2024-05-08T06:43:16.960640+0000","last_fullsized":"2024-05-08T06:43:16.960640+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:42.070321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878061+0000","last_change":"2024-05-08T06:41:24.665142+0000","last_active":"2024-05-08T06:43:16.878061+0000","last_peered":"2024-05-08T06:43:16.878061+0000","last_clean":"2024-05-08T06:43:16.878061+0000","last_became_active":"2024-05-08T06:41:24.664431+0000","last_became_peered":"2024-05-08T06:41:24.664431+0000","last_unstale":"2024-05-08T06:43:16.878061+0000","last_undegraded":"2024-05-08T06:43:16.878061+0000","last_fullsized":"2024-05-08T06:43:16.878061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:11:08.511550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.867152+0000","last_change":"2024-05-08T06:41:05.503245+0000","last_active":"2024-05-08T06:43:16.867152+0000","last_peered":"2024-05-08T06:43:16.867152+0000","last_clean":"2024-05-08T06:43:16.867152+0000","last_became_active":"2024-05-08T06:41:05.502561+0000","last_became_peered":"2024-05-08T06:41:05.502561+0000","last_unstale":"2024-05-08T06:43:16.867152+0000","last_undegraded":"2024-05-08T06:43:16.867152+0000","last_fullsized":"2024-05-08T06:43:16.867152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:06.169830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885196+0000","last_change":"2024-05-08T06:41:09.579703+0000","last_active":"2024-05-08T06:43:16.885196+0000","last_peered":"2024-05-08T06:43:16.885196+0000","last_clean":"2024-05-08T06:43:16.885196+0000","last_became_active":"2024-05-08T06:41:09.579332+0000","last_became_peered":"2024-05-08T06:41:09.579332+0000","last_unstale":"2024-05-08T06:43:16.885196+0000","last_undegraded":"2024-05-08T06:43:16.885196+0000","last_fullsized":"2024-05-08T06:43:16.885196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:08.616722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.869415+0000","last_change":"2024-05-08T06:41:24.666322+0000","last_active":"2024-05-08T06:43:16.869415+0000","last_peered":"2024-05-08T06:43:16.869415+0000","last_clean":"2024-05-08T06:43:16.869415+0000","last_became_active":"2024-05-08T06:41:24.664647+0000","last_became_peered":"2024-05-08T06:41:24.664647+0000","last_unstale":"2024-05-08T06:43:16.869415+0000","last_undegraded":"2024-05-08T06:43:16.869415+0000","last_fullsized":"2024-05-08T06:43:16.869415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:56.967066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885459+0000","last_change":"2024-05-08T06:41:06.149339+0000","last_active":"2024-05-08T06:43:16.885459+0000","last_peered":"2024-05-08T06:43:16.885459+0000","last_clean":"2024-05-08T06:43:16.885459+0000","last_became_active":"2024-05-08T06:41:06.148846+0000","last_became_peered":"2024-05-08T06:41:06.148846+0000","last_unstale":"2024-05-08T06:43:16.885459+0000","last_undegraded":"2024-05-08T06:43:16.885459+0000","last_fullsized":"2024-05-08T06:43:16.885459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:59.291206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874979+0000","last_change":"2024-05-08T06:41:09.581776+0000","last_active":"2024-05-08T06:43:16.874979+0000","last_peered":"2024-05-08T06:43:16.874979+0000","last_clean":"2024-05-08T06:43:16.874979+0000","last_became_active":"2024-05-08T06:41:09.581409+0000","last_became_peered":"2024-05-08T06:41:09.581409+0000","last_unstale":"2024-05-08T06:43:16.874979+0000","last_undegraded":"2024-05-08T06:43:16.874979+0000","last_fullsized":"2024-05-08T06:43:16.874979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:30.323812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870051+0000","last_change":"2024-05-08T06:42:16.255655+0000","last_active":"2024-05-08T06:43:16.870051+0000","last_peered":"2024-05-08T06:43:16.870051+0000","last_clean":"2024-05-08T06:43:16.870051+0000","last_became_active":"2024-05-08T06:42:16.253722+0000","last_became_peered":"2024-05-08T06:42:16.253722+0000","last_unstale":"2024-05-08T06:43:16.870051+0000","last_undegraded":"2024-05-08T06:43:16.870051+0000","last_fullsized":"2024-05-08T06:43:16.870051+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:58.492286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873612+0000","last_change":"2024-05-08T06:41:05.509738+0000","last_active":"2024-05-08T06:43:16.873612+0000","last_peered":"2024-05-08T06:43:16.873612+0000","last_clean":"2024-05-08T06:43:16.873612+0000","last_became_active":"2024-05-08T06:41:05.509198+0000","last_became_peered":"2024-05-08T06:41:05.509198+0000","last_unstale":"2024-05-08T06:43:16.873612+0000","last_undegraded":"2024-05-08T06:43:16.873612+0000","last_fullsized":"2024-05-08T06:43:16.873612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:51.350637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.861616+0000","last_change":"2024-05-08T06:41:09.572288+0000","last_active":"2024-05-08T06:43:15.861616+0000","last_peered":"2024-05-08T06:43:15.861616+0000","last_clean":"2024-05-08T06:43:15.861616+0000","last_became_active":"2024-05-08T06:41:09.571951+0000","last_became_peered":"2024-05-08T06:41:09.571951+0000","last_unstale":"2024-05-08T06:43:15.861616+0000","last_undegraded":"2024-05-08T06:43:15.861616+0000","last_fullsized":"2024-05-08T06:43:15.861616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:45.687494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.869888+0000","last_change":"2024-05-08T06:41:24.663289+0000","last_active":"2024-05-08T06:43:16.869888+0000","last_peered":"2024-05-08T06:43:16.869888+0000","last_clean":"2024-05-08T06:43:16.869888+0000","last_became_active":"2024-05-08T06:41:24.662899+0000","last_became_peered":"2024-05-08T06:41:24.662899+0000","last_unstale":"2024-05-08T06:43:16.869888+0000","last_undegraded":"2024-05-08T06:43:16.869888+0000","last_fullsized":"2024-05-08T06:43:16.869888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:15.024693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.872979+0000","last_change":"2024-05-08T06:41:05.505412+0000","last_active":"2024-05-08T06:43:16.872979+0000","last_peered":"2024-05-08T06:43:16.872979+0000","last_clean":"2024-05-08T06:43:16.872979+0000","last_became_active":"2024-05-08T06:41:05.505023+0000","last_became_peered":"2024-05-08T06:41:05.505023+0000","last_unstale":"2024-05-08T06:43:16.872979+0000","last_undegraded":"2024-05-08T06:43:16.872979+0000","last_fullsized":"2024-05-08T06:43:16.872979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:50.403045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130102+0000","last_change":"2024-05-08T06:41:09.571080+0000","last_active":"2024-05-08T06:43:17.130102+0000","last_peered":"2024-05-08T06:43:17.130102+0000","last_clean":"2024-05-08T06:43:17.130102+0000","last_became_active":"2024-05-08T06:41:09.570755+0000","last_became_peered":"2024-05-08T06:41:09.570755+0000","last_unstale":"2024-05-08T06:43:17.130102+0000","last_undegraded":"2024-05-08T06:43:17.130102+0000","last_fullsized":"2024-05-08T06:43:17.130102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:38:53.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877817+0000","last_change":"2024-05-08T06:41:24.660091+0000","last_active":"2024-05-08T06:43:16.877817+0000","last_peered":"2024-05-08T06:43:16.877817+0000","last_clean":"2024-05-08T06:43:16.877817+0000","last_became_active":"2024-05-08T06:41:24.659512+0000","last_became_peered":"2024-05-08T06:41:24.659512+0000","last_unstale":"2024-05-08T06:43:16.877817+0000","last_undegraded":"2024-05-08T06:43:16.877817+0000","last_fullsized":"2024-05-08T06:43:16.877817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:07:56.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":86,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.385059+0000","last_change":"2024-05-08T06:41:05.500625+0000","last_active":"2024-05-08T06:43:17.385059+0000","last_peered":"2024-05-08T06:43:17.385059+0000","last_clean":"2024-05-08T06:43:17.385059+0000","last_became_active":"2024-05-08T06:41:05.500079+0000","last_became_peered":"2024-05-08T06:41:05.500079+0000","last_unstale":"2024-05-08T06:43:17.385059+0000","last_undegraded":"2024-05-08T06:43:17.385059+0000","last_fullsized":"2024-05-08T06:43:17.385059+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:32.143944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871638+0000","last_change":"2024-05-08T06:41:09.569045+0000","last_active":"2024-05-08T06:43:16.871638+0000","last_peered":"2024-05-08T06:43:16.871638+0000","last_clean":"2024-05-08T06:43:16.871638+0000","last_became_active":"2024-05-08T06:41:09.560040+0000","last_became_peered":"2024-05-08T06:41:09.560040+0000","last_unstale":"2024-05-08T06:43:16.871638+0000","last_undegraded":"2024-05-08T06:43:16.871638+0000","last_fullsized":"2024-05-08T06:43:16.871638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:58:52.284829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876739+0000","last_change":"2024-05-08T06:42:15.856574+0000","last_active":"2024-05-08T06:43:16.876739+0000","last_peered":"2024-05-08T06:43:16.876739+0000","last_clean":"2024-05-08T06:43:16.876739+0000","last_became_active":"2024-05-08T06:42:15.855459+0000","last_became_peered":"2024-05-08T06:42:15.855459+0000","last_unstale":"2024-05-08T06:43:16.876739+0000","last_undegraded":"2024-05-08T06:43:16.876739+0000","last_fullsized":"2024-05-08T06:43:16.876739+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:23:12.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.131775+0000","last_change":"2024-05-08T06:41:05.505685+0000","last_active":"2024-05-08T06:43:17.131775+0000","last_peered":"2024-05-08T06:43:17.131775+0000","last_clean":"2024-05-08T06:43:17.131775+0000","last_became_active":"2024-05-08T06:41:05.505136+0000","last_became_peered":"2024-05-08T06:41:05.505136+0000","last_unstale":"2024-05-08T06:43:17.131775+0000","last_undegraded":"2024-05-08T06:43:17.131775+0000","last_fullsized":"2024-05-08T06:43:17.131775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:59.968405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130572+0000","last_change":"2024-05-08T06:41:09.581340+0000","last_active":"2024-05-08T06:43:17.130572+0000","last_peered":"2024-05-08T06:43:17.130572+0000","last_clean":"2024-05-08T06:43:17.130572+0000","last_became_active":"2024-05-08T06:41:09.580969+0000","last_became_peered":"2024-05-08T06:41:09.580969+0000","last_unstale":"2024-05-08T06:43:17.130572+0000","last_undegraded":"2024-05-08T06:43:17.130572+0000","last_fullsized":"2024-05-08T06:43:17.130572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:14.365972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.871812+0000","last_change":"2024-05-08T06:41:24.675576+0000","last_active":"2024-05-08T06:43:15.871812+0000","last_peered":"2024-05-08T06:43:15.871812+0000","last_clean":"2024-05-08T06:43:15.871812+0000","last_became_active":"2024-05-08T06:41:24.675044+0000","last_became_peered":"2024-05-08T06:41:24.675044+0000","last_unstale":"2024-05-08T06:43:15.871812+0000","last_undegraded":"2024-05-08T06:43:15.871812+0000","last_fullsized":"2024-05-08T06:43:15.871812+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:59.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956156+0000","last_change":"2024-05-08T06:41:05.493094+0000","last_active":"2024-05-08T06:43:16.956156+0000","last_peered":"2024-05-08T06:43:16.956156+0000","last_clean":"2024-05-08T06:43:16.956156+0000","last_became_active":"2024-05-08T06:41:05.491206+0000","last_became_peered":"2024-05-08T06:41:05.491206+0000","last_unstale":"2024-05-08T06:43:16.956156+0000","last_undegraded":"2024-05-08T06:43:16.956156+0000","last_fullsized":"2024-05-08T06:43:16.956156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:03.689282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884482+0000","last_change":"2024-05-08T06:41:09.570646+0000","last_active":"2024-05-08T06:43:16.884482+0000","last_peered":"2024-05-08T06:43:16.884482+0000","last_clean":"2024-05-08T06:43:16.884482+0000","last_became_active":"2024-05-08T06:41:09.569500+0000","last_became_peered":"2024-05-08T06:41:09.569500+0000","last_unstale":"2024-05-08T06:43:16.884482+0000","last_undegraded":"2024-05-08T06:43:16.884482+0000","last_fullsized":"2024-05-08T06:43:16.884482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:25:08.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874957+0000","last_change":"2024-05-08T06:41:24.672021+0000","last_active":"2024-05-08T06:43:16.874957+0000","last_peered":"2024-05-08T06:43:16.874957+0000","last_clean":"2024-05-08T06:43:16.874957+0000","last_became_active":"2024-05-08T06:41:24.671583+0000","last_became_peered":"2024-05-08T06:41:24.671583+0000","last_unstale":"2024-05-08T06:43:16.874957+0000","last_undegraded":"2024-05-08T06:43:16.874957+0000","last_fullsized":"2024-05-08T06:43:16.874957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:33.850855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129307+0000","last_change":"2024-05-08T06:41:05.501501+0000","last_active":"2024-05-08T06:43:17.129307+0000","last_peered":"2024-05-08T06:43:17.129307+0000","last_clean":"2024-05-08T06:43:17.129307+0000","last_became_active":"2024-05-08T06:41:05.501001+0000","last_became_peered":"2024-05-08T06:41:05.501001+0000","last_unstale":"2024-05-08T06:43:17.129307+0000","last_undegraded":"2024-05-08T06:43:17.129307+0000","last_fullsized":"2024-05-08T06:43:17.129307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:15:18.984981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.865869+0000","last_change":"2024-05-08T06:42:15.859096+0000","last_active":"2024-05-08T06:43:16.865869+0000","last_peered":"2024-05-08T06:43:16.865869+0000","last_clean":"2024-05-08T06:43:16.865869+0000","last_became_active":"2024-05-08T06:42:15.858508+0000","last_became_peered":"2024-05-08T06:42:15.858508+0000","last_unstale":"2024-05-08T06:43:16.865869+0000","last_undegraded":"2024-05-08T06:43:16.865869+0000","last_fullsized":"2024-05-08T06:43:16.865869+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:24.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884682+0000","last_change":"2024-05-08T06:41:24.670832+0000","last_active":"2024-05-08T06:43:16.884682+0000","last_peered":"2024-05-08T06:43:16.884682+0000","last_clean":"2024-05-08T06:43:16.884682+0000","last_became_active":"2024-05-08T06:41:24.668155+0000","last_became_peered":"2024-05-08T06:41:24.668155+0000","last_unstale":"2024-05-08T06:43:16.884682+0000","last_undegraded":"2024-05-08T06:43:16.884682+0000","last_fullsized":"2024-05-08T06:43:16.884682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:11.460490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":83,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:18.386652+0000","last_change":"2024-05-08T06:41:05.494999+0000","last_active":"2024-05-08T06:43:18.386652+0000","last_peered":"2024-05-08T06:43:18.386652+0000","last_clean":"2024-05-08T06:43:18.386652+0000","last_became_active":"2024-05-08T06:41:05.494487+0000","last_became_peered":"2024-05-08T06:41:05.494487+0000","last_unstale":"2024-05-08T06:43:18.386652+0000","last_undegraded":"2024-05-08T06:43:18.386652+0000","last_fullsized":"2024-05-08T06:43:18.386652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:59.282625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.863195+0000","last_change":"2024-05-08T06:41:09.570607+0000","last_active":"2024-05-08T06:43:15.863195+0000","last_peered":"2024-05-08T06:43:15.863195+0000","last_clean":"2024-05-08T06:43:15.863195+0000","last_became_active":"2024-05-08T06:41:09.570047+0000","last_became_peered":"2024-05-08T06:41:09.570047+0000","last_unstale":"2024-05-08T06:43:15.863195+0000","last_undegraded":"2024-05-08T06:43:15.863195+0000","last_fullsized":"2024-05-08T06:43:15.863195+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:51.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.865621+0000","last_change":"2024-05-08T06:41:24.677365+0000","last_active":"2024-05-08T06:43:16.865621+0000","last_peered":"2024-05-08T06:43:16.865621+0000","last_clean":"2024-05-08T06:43:16.865621+0000","last_became_active":"2024-05-08T06:41:24.673986+0000","last_became_peered":"2024-05-08T06:41:24.673986+0000","last_unstale":"2024-05-08T06:43:16.865621+0000","last_undegraded":"2024-05-08T06:43:16.865621+0000","last_fullsized":"2024-05-08T06:43:16.865621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:07.013637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879269+0000","last_change":"2024-05-08T06:41:05.499624+0000","last_active":"2024-05-08T06:43:16.879269+0000","last_peered":"2024-05-08T06:43:16.879269+0000","last_clean":"2024-05-08T06:43:16.879269+0000","last_became_active":"2024-05-08T06:41:05.498875+0000","last_became_peered":"2024-05-08T06:41:05.498875+0000","last_unstale":"2024-05-08T06:43:16.879269+0000","last_undegraded":"2024-05-08T06:43:16.879269+0000","last_fullsized":"2024-05-08T06:43:16.879269+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:46:11.270399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.875026+0000","last_change":"2024-05-08T06:42:15.853569+0000","last_active":"2024-05-08T06:43:16.875026+0000","last_peered":"2024-05-08T06:43:16.875026+0000","last_clean":"2024-05-08T06:43:16.875026+0000","last_became_active":"2024-05-08T06:42:15.852223+0000","last_became_peered":"2024-05-08T06:42:15.852223+0000","last_unstale":"2024-05-08T06:43:16.875026+0000","last_undegraded":"2024-05-08T06:43:16.875026+0000","last_fullsized":"2024-05-08T06:43:16.875026+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:56.970134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870395+0000","last_change":"2024-05-08T06:41:24.671807+0000","last_active":"2024-05-08T06:43:16.870395+0000","last_peered":"2024-05-08T06:43:16.870395+0000","last_clean":"2024-05-08T06:43:16.870395+0000","last_became_active":"2024-05-08T06:41:24.670937+0000","last_became_peered":"2024-05-08T06:41:24.670937+0000","last_unstale":"2024-05-08T06:43:16.870395+0000","last_undegraded":"2024-05-08T06:43:16.870395+0000","last_fullsized":"2024-05-08T06:43:16.870395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:52.844916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129712+0000","last_change":"2024-05-08T06:41:06.147901+0000","last_active":"2024-05-08T06:43:17.129712+0000","last_peered":"2024-05-08T06:43:17.129712+0000","last_clean":"2024-05-08T06:43:17.129712+0000","last_became_active":"2024-05-08T06:41:06.146983+0000","last_became_peered":"2024-05-08T06:41:06.146983+0000","last_unstale":"2024-05-08T06:43:17.129712+0000","last_undegraded":"2024-05-08T06:43:17.129712+0000","last_fullsized":"2024-05-08T06:43:17.129712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:54.638290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.862082+0000","last_change":"2024-05-08T06:41:09.586695+0000","last_active":"2024-05-08T06:43:15.862082+0000","last_peered":"2024-05-08T06:43:15.862082+0000","last_clean":"2024-05-08T06:43:15.862082+0000","last_became_active":"2024-05-08T06:41:09.586288+0000","last_became_peered":"2024-05-08T06:41:09.586288+0000","last_unstale":"2024-05-08T06:43:15.862082+0000","last_undegraded":"2024-05-08T06:43:15.862082+0000","last_fullsized":"2024-05-08T06:43:15.862082+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:18.383524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866091+0000","last_change":"2024-05-08T06:41:24.671523+0000","last_active":"2024-05-08T06:43:16.866091+0000","last_peered":"2024-05-08T06:43:16.866091+0000","last_clean":"2024-05-08T06:43:16.866091+0000","last_became_active":"2024-05-08T06:41:24.670307+0000","last_became_peered":"2024-05-08T06:41:24.670307+0000","last_unstale":"2024-05-08T06:43:16.866091+0000","last_undegraded":"2024-05-08T06:43:16.866091+0000","last_fullsized":"2024-05-08T06:43:16.866091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.034208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'34","reported_seq":160,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:19.400610+0000","last_change":"2024-05-08T06:41:05.504643+0000","last_active":"2024-05-08T06:43:19.400610+0000","last_peered":"2024-05-08T06:43:19.400610+0000","last_clean":"2024-05-08T06:43:19.400610+0000","last_became_active":"2024-05-08T06:41:05.504011+0000","last_became_peered":"2024-05-08T06:41:05.504011+0000","last_unstale":"2024-05-08T06:43:19.400610+0000","last_undegraded":"2024-05-08T06:43:19.400610+0000","last_fullsized":"2024-05-08T06:43:19.400610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:47.262643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67092,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":83,"num_read_kb":108,"num_write":35,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.872392+0000","last_change":"2024-05-08T06:41:09.580532+0000","last_active":"2024-05-08T06:43:16.872392+0000","last_peered":"2024-05-08T06:43:16.872392+0000","last_clean":"2024-05-08T06:43:16.872392+0000","last_became_active":"2024-05-08T06:41:09.575396+0000","last_became_peered":"2024-05-08T06:41:09.575396+0000","last_unstale":"2024-05-08T06:43:16.872392+0000","last_undegraded":"2024-05-08T06:43:16.872392+0000","last_fullsized":"2024-05-08T06:43:16.872392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:29.197093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130551+0000","last_change":"2024-05-08T06:41:24.660200+0000","last_active":"2024-05-08T06:43:17.130551+0000","last_peered":"2024-05-08T06:43:17.130551+0000","last_clean":"2024-05-08T06:43:17.130551+0000","last_became_active":"2024-05-08T06:41:24.659674+0000","last_became_peered":"2024-05-08T06:41:24.659674+0000","last_unstale":"2024-05-08T06:43:17.130551+0000","last_undegraded":"2024-05-08T06:43:17.130551+0000","last_fullsized":"2024-05-08T06:43:17.130551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:51.023256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877143+0000","last_change":"2024-05-08T06:41:05.500899+0000","last_active":"2024-05-08T06:43:16.877143+0000","last_peered":"2024-05-08T06:43:16.877143+0000","last_clean":"2024-05-08T06:43:16.877143+0000","last_became_active":"2024-05-08T06:41:05.500437+0000","last_became_peered":"2024-05-08T06:41:05.500437+0000","last_unstale":"2024-05-08T06:43:16.877143+0000","last_undegraded":"2024-05-08T06:43:16.877143+0000","last_fullsized":"2024-05-08T06:43:16.877143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:38.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956054+0000","last_change":"2024-05-08T06:41:09.574273+0000","last_active":"2024-05-08T06:43:16.956054+0000","last_peered":"2024-05-08T06:43:16.956054+0000","last_clean":"2024-05-08T06:43:16.956054+0000","last_became_active":"2024-05-08T06:41:09.573902+0000","last_became_peered":"2024-05-08T06:41:09.573902+0000","last_unstale":"2024-05-08T06:43:16.956054+0000","last_undegraded":"2024-05-08T06:43:16.956054+0000","last_fullsized":"2024-05-08T06:43:16.956054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:39:12.749290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.869420+0000","last_change":"2024-05-08T06:41:24.674360+0000","last_active":"2024-05-08T06:43:15.869420+0000","last_peered":"2024-05-08T06:43:15.869420+0000","last_clean":"2024-05-08T06:43:15.869420+0000","last_became_active":"2024-05-08T06:41:24.673938+0000","last_became_peered":"2024-05-08T06:41:24.673938+0000","last_unstale":"2024-05-08T06:43:15.869420+0000","last_undegraded":"2024-05-08T06:43:15.869420+0000","last_fullsized":"2024-05-08T06:43:15.869420+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:13:36.735220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129755+0000","last_change":"2024-05-08T06:41:05.504335+0000","last_active":"2024-05-08T06:43:17.129755+0000","last_peered":"2024-05-08T06:43:17.129755+0000","last_clean":"2024-05-08T06:43:17.129755+0000","last_became_active":"2024-05-08T06:41:05.503981+0000","last_became_peered":"2024-05-08T06:41:05.503981+0000","last_unstale":"2024-05-08T06:43:17.129755+0000","last_undegraded":"2024-05-08T06:43:17.129755+0000","last_fullsized":"2024-05-08T06:43:17.129755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:45:35.813245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879072+0000","last_change":"2024-05-08T06:41:09.580852+0000","last_active":"2024-05-08T06:43:16.879072+0000","last_peered":"2024-05-08T06:43:16.879072+0000","last_clean":"2024-05-08T06:43:16.879072+0000","last_became_active":"2024-05-08T06:41:09.580375+0000","last_became_peered":"2024-05-08T06:41:09.580375+0000","last_unstale":"2024-05-08T06:43:16.879072+0000","last_undegraded":"2024-05-08T06:43:16.879072+0000","last_fullsized":"2024-05-08T06:43:16.879072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:21:06.695878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866676+0000","last_change":"2024-05-08T06:41:24.678268+0000","last_active":"2024-05-08T06:43:16.866676+0000","last_peered":"2024-05-08T06:43:16.866676+0000","last_clean":"2024-05-08T06:43:16.866676+0000","last_became_active":"2024-05-08T06:41:24.677804+0000","last_became_peered":"2024-05-08T06:41:24.677804+0000","last_unstale":"2024-05-08T06:43:16.866676+0000","last_undegraded":"2024-05-08T06:43:16.866676+0000","last_fullsized":"2024-05-08T06:43:16.866676+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:03.082661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":87,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.390449+0000","last_change":"2024-05-08T06:41:05.498143+0000","last_active":"2024-05-08T06:43:17.390449+0000","last_peered":"2024-05-08T06:43:17.390449+0000","last_clean":"2024-05-08T06:43:17.390449+0000","last_became_active":"2024-05-08T06:41:05.497707+0000","last_became_peered":"2024-05-08T06:41:05.497707+0000","last_unstale":"2024-05-08T06:43:17.390449+0000","last_undegraded":"2024-05-08T06:43:17.390449+0000","last_fullsized":"2024-05-08T06:43:17.390449+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:20.556535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.135955+0000","last_change":"2024-05-08T06:43:17.135955+0000","last_active":"2024-05-08T06:43:17.135955+0000","last_peered":"2024-05-08T06:43:17.135955+0000","last_clean":"2024-05-08T06:43:17.135955+0000","last_became_active":"2024-05-08T06:43:17.134734+0000","last_became_peered":"2024-05-08T06:43:17.134734+0000","last_unstale":"2024-05-08T06:43:17.135955+0000","last_undegraded":"2024-05-08T06:43:17.135955+0000","last_fullsized":"2024-05-08T06:43:17.135955+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:33:53.573382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957630+0000","last_change":"2024-05-08T06:41:24.663938+0000","last_active":"2024-05-08T06:43:16.957630+0000","last_peered":"2024-05-08T06:43:16.957630+0000","last_clean":"2024-05-08T06:43:16.957630+0000","last_became_active":"2024-05-08T06:41:24.661679+0000","last_became_peered":"2024-05-08T06:41:24.661679+0000","last_unstale":"2024-05-08T06:43:16.957630+0000","last_undegraded":"2024-05-08T06:43:16.957630+0000","last_fullsized":"2024-05-08T06:43:16.957630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:21.590681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":59,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871288+0000","last_change":"2024-05-08T06:41:06.151458+0000","last_active":"2024-05-08T06:43:16.871288+0000","last_peered":"2024-05-08T06:43:16.871288+0000","last_clean":"2024-05-08T06:43:16.871288+0000","last_became_active":"2024-05-08T06:41:06.146564+0000","last_became_peered":"2024-05-08T06:41:06.146564+0000","last_unstale":"2024-05-08T06:43:16.871288+0000","last_undegraded":"2024-05-08T06:43:16.871288+0000","last_fullsized":"2024-05-08T06:43:16.871288+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:36.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129351+0000","last_change":"2024-05-08T06:41:09.576666+0000","last_active":"2024-05-08T06:43:17.129351+0000","last_peered":"2024-05-08T06:43:17.129351+0000","last_clean":"2024-05-08T06:43:17.129351+0000","last_became_active":"2024-05-08T06:41:09.576062+0000","last_became_peered":"2024-05-08T06:41:09.576062+0000","last_unstale":"2024-05-08T06:43:17.129351+0000","last_undegraded":"2024-05-08T06:43:17.129351+0000","last_fullsized":"2024-05-08T06:43:17.129351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:21.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130125+0000","last_change":"2024-05-08T06:42:16.255227+0000","last_active":"2024-05-08T06:43:17.130125+0000","last_peered":"2024-05-08T06:43:17.130125+0000","last_clean":"2024-05-08T06:43:17.130125+0000","last_became_active":"2024-05-08T06:42:16.253021+0000","last_became_peered":"2024-05-08T06:42:16.253021+0000","last_unstale":"2024-05-08T06:43:17.130125+0000","last_undegraded":"2024-05-08T06:43:17.130125+0000","last_fullsized":"2024-05-08T06:43:17.130125+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:29:41.833171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873220+0000","last_change":"2024-05-08T06:41:05.506830+0000","last_active":"2024-05-08T06:43:16.873220+0000","last_peered":"2024-05-08T06:43:16.873220+0000","last_clean":"2024-05-08T06:43:16.873220+0000","last_became_active":"2024-05-08T06:41:05.505402+0000","last_became_peered":"2024-05-08T06:41:05.505402+0000","last_unstale":"2024-05-08T06:43:16.873220+0000","last_undegraded":"2024-05-08T06:43:16.873220+0000","last_fullsized":"2024-05-08T06:43:16.873220+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:26.804268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.871446+0000","last_change":"2024-05-08T06:41:09.586937+0000","last_active":"2024-05-08T06:43:15.871446+0000","last_peered":"2024-05-08T06:43:15.871446+0000","last_clean":"2024-05-08T06:43:15.871446+0000","last_became_active":"2024-05-08T06:41:09.586443+0000","last_became_peered":"2024-05-08T06:41:09.586443+0000","last_unstale":"2024-05-08T06:43:15.871446+0000","last_undegraded":"2024-05-08T06:43:15.871446+0000","last_fullsized":"2024-05-08T06:43:15.871446+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:49.004676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871404+0000","last_change":"2024-05-08T06:42:16.042874+0000","last_active":"2024-05-08T06:43:16.871404+0000","last_peered":"2024-05-08T06:43:16.871404+0000","last_clean":"2024-05-08T06:43:16.871404+0000","last_became_active":"2024-05-08T06:42:16.041424+0000","last_became_peered":"2024-05-08T06:42:16.041424+0000","last_unstale":"2024-05-08T06:43:16.871404+0000","last_undegraded":"2024-05-08T06:43:16.871404+0000","last_fullsized":"2024-05-08T06:43:16.871404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:47.162238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866349+0000","last_change":"2024-05-08T06:41:06.146631+0000","last_active":"2024-05-08T06:43:16.866349+0000","last_peered":"2024-05-08T06:43:16.866349+0000","last_clean":"2024-05-08T06:43:16.866349+0000","last_became_active":"2024-05-08T06:41:06.145876+0000","last_became_peered":"2024-05-08T06:41:06.145876+0000","last_unstale":"2024-05-08T06:43:16.866349+0000","last_undegraded":"2024-05-08T06:43:16.866349+0000","last_fullsized":"2024-05-08T06:43:16.866349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:46.283923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.133072+0000","last_change":"2024-05-08T06:41:09.571084+0000","last_active":"2024-05-08T06:43:17.133072+0000","last_peered":"2024-05-08T06:43:17.133072+0000","last_clean":"2024-05-08T06:43:17.133072+0000","last_became_active":"2024-05-08T06:41:09.570685+0000","last_became_peered":"2024-05-08T06:41:09.570685+0000","last_unstale":"2024-05-08T06:43:17.133072+0000","last_undegraded":"2024-05-08T06:43:17.133072+0000","last_fullsized":"2024-05-08T06:43:17.133072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:02:21.748502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956837+0000","last_change":"2024-05-08T06:41:24.667348+0000","last_active":"2024-05-08T06:43:16.956837+0000","last_peered":"2024-05-08T06:43:16.956837+0000","last_clean":"2024-05-08T06:43:16.956837+0000","last_became_active":"2024-05-08T06:41:24.662570+0000","last_became_peered":"2024-05-08T06:41:24.662570+0000","last_unstale":"2024-05-08T06:43:16.956837+0000","last_undegraded":"2024-05-08T06:43:16.956837+0000","last_fullsized":"2024-05-08T06:43:16.956837+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:05.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878557+0000","last_change":"2024-05-08T06:41:05.501884+0000","last_active":"2024-05-08T06:43:16.878557+0000","last_peered":"2024-05-08T06:43:16.878557+0000","last_clean":"2024-05-08T06:43:16.878557+0000","last_became_active":"2024-05-08T06:41:05.498866+0000","last_became_peered":"2024-05-08T06:41:05.498866+0000","last_unstale":"2024-05-08T06:43:16.878557+0000","last_undegraded":"2024-05-08T06:43:16.878557+0000","last_fullsized":"2024-05-08T06:43:16.878557+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:50.560695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.132568+0000","last_change":"2024-05-08T06:41:09.582601+0000","last_active":"2024-05-08T06:43:17.132568+0000","last_peered":"2024-05-08T06:43:17.132568+0000","last_clean":"2024-05-08T06:43:17.132568+0000","last_became_active":"2024-05-08T06:41:09.582205+0000","last_became_peered":"2024-05-08T06:41:09.582205+0000","last_unstale":"2024-05-08T06:43:17.132568+0000","last_undegraded":"2024-05-08T06:43:17.132568+0000","last_fullsized":"2024-05-08T06:43:17.132568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:29.594001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957491+0000","last_change":"2024-05-08T06:41:24.659339+0000","last_active":"2024-05-08T06:43:16.957491+0000","last_peered":"2024-05-08T06:43:16.957491+0000","last_clean":"2024-05-08T06:43:16.957491+0000","last_became_active":"2024-05-08T06:41:24.658879+0000","last_became_peered":"2024-05-08T06:41:24.658879+0000","last_unstale":"2024-05-08T06:43:16.957491+0000","last_undegraded":"2024-05-08T06:43:16.957491+0000","last_fullsized":"2024-05-08T06:43:16.957491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:59.257118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129943+0000","last_change":"2024-05-08T06:42:15.850510+0000","last_active":"2024-05-08T06:43:17.129943+0000","last_peered":"2024-05-08T06:43:17.129943+0000","last_clean":"2024-05-08T06:43:17.129943+0000","last_became_active":"2024-05-08T06:42:15.849158+0000","last_became_peered":"2024-05-08T06:42:15.849158+0000","last_unstale":"2024-05-08T06:43:17.129943+0000","last_undegraded":"2024-05-08T06:43:17.129943+0000","last_fullsized":"2024-05-08T06:43:17.129943+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:14.687642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":85,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.388878+0000","last_change":"2024-05-08T06:41:06.148436+0000","last_active":"2024-05-08T06:43:17.388878+0000","last_peered":"2024-05-08T06:43:17.388878+0000","last_clean":"2024-05-08T06:43:17.388878+0000","last_became_active":"2024-05-08T06:41:06.147690+0000","last_became_peered":"2024-05-08T06:41:06.147690+0000","last_unstale":"2024-05-08T06:43:17.388878+0000","last_undegraded":"2024-05-08T06:43:17.388878+0000","last_fullsized":"2024-05-08T06:43:17.388878+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:49.925872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879134+0000","last_change":"2024-05-08T06:41:24.667958+0000","last_active":"2024-05-08T06:43:16.879134+0000","last_peered":"2024-05-08T06:43:16.879134+0000","last_clean":"2024-05-08T06:43:16.879134+0000","last_became_active":"2024-05-08T06:41:24.666181+0000","last_became_peered":"2024-05-08T06:41:24.666181+0000","last_unstale":"2024-05-08T06:43:16.879134+0000","last_undegraded":"2024-05-08T06:43:16.879134+0000","last_fullsized":"2024-05-08T06:43:16.879134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:08.413670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884755+0000","last_change":"2024-05-08T06:41:09.581353+0000","last_active":"2024-05-08T06:43:16.884755+0000","last_peered":"2024-05-08T06:43:16.884755+0000","last_clean":"2024-05-08T06:43:16.884755+0000","last_became_active":"2024-05-08T06:41:09.580630+0000","last_became_peered":"2024-05-08T06:41:09.580630+0000","last_unstale":"2024-05-08T06:43:16.884755+0000","last_undegraded":"2024-05-08T06:43:16.884755+0000","last_fullsized":"2024-05-08T06:43:16.884755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:07.041564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870064+0000","last_change":"2024-05-08T06:41:05.494128+0000","last_active":"2024-05-08T06:43:16.870064+0000","last_peered":"2024-05-08T06:43:16.870064+0000","last_clean":"2024-05-08T06:43:16.870064+0000","last_became_active":"2024-05-08T06:41:05.493473+0000","last_became_peered":"2024-05-08T06:41:05.493473+0000","last_unstale":"2024-05-08T06:43:16.870064+0000","last_undegraded":"2024-05-08T06:43:16.870064+0000","last_fullsized":"2024-05-08T06:43:16.870064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:01:51.061204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":117,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878084+0000","last_change":"2024-05-08T06:39:12.054195+0000","last_active":"2024-05-08T06:43:16.878084+0000","last_peered":"2024-05-08T06:43:16.878084+0000","last_clean":"2024-05-08T06:43:16.878084+0000","last_became_active":"2024-05-08T06:39:12.045198+0000","last_became_peered":"2024-05-08T06:39:12.045198+0000","last_unstale":"2024-05-08T06:43:16.878084+0000","last_undegraded":"2024-05-08T06:43:16.878084+0000","last_fullsized":"2024-05-08T06:43:16.878084+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_clean_scrub_stamp":"2024-05-08T06:34:30.391671+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:32:48.631167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130363+0000","last_change":"2024-05-08T06:41:24.663009+0000","last_active":"2024-05-08T06:43:17.130363+0000","last_peered":"2024-05-08T06:43:17.130363+0000","last_clean":"2024-05-08T06:43:17.130363+0000","last_became_active":"2024-05-08T06:41:24.662552+0000","last_became_peered":"2024-05-08T06:41:24.662552+0000","last_unstale":"2024-05-08T06:43:17.130363+0000","last_undegraded":"2024-05-08T06:43:17.130363+0000","last_fullsized":"2024-05-08T06:43:17.130363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:57:12.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.955824+0000","last_change":"2024-05-08T06:41:09.576425+0000","last_active":"2024-05-08T06:43:16.955824+0000","last_peered":"2024-05-08T06:43:16.955824+0000","last_clean":"2024-05-08T06:43:16.955824+0000","last_became_active":"2024-05-08T06:41:09.576094+0000","last_became_peered":"2024-05-08T06:41:09.576094+0000","last_unstale":"2024-05-08T06:43:16.955824+0000","last_undegraded":"2024-05-08T06:43:16.955824+0000","last_fullsized":"2024-05-08T06:43:16.955824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:40.682429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878467+0000","last_change":"2024-05-08T06:41:05.505778+0000","last_active":"2024-05-08T06:43:16.878467+0000","last_peered":"2024-05-08T06:43:16.878467+0000","last_clean":"2024-05-08T06:43:16.878467+0000","last_became_active":"2024-05-08T06:41:05.505400+0000","last_became_peered":"2024-05-08T06:41:05.505400+0000","last_unstale":"2024-05-08T06:43:16.878467+0000","last_undegraded":"2024-05-08T06:43:16.878467+0000","last_fullsized":"2024-05-08T06:43:16.878467+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:11:34.887026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.869417+0000","last_change":"2024-05-08T06:41:24.671768+0000","last_active":"2024-05-08T06:43:15.869417+0000","last_peered":"2024-05-08T06:43:15.869417+0000","last_clean":"2024-05-08T06:43:15.869417+0000","last_became_active":"2024-05-08T06:41:24.671250+0000","last_became_peered":"2024-05-08T06:41:24.671250+0000","last_unstale":"2024-05-08T06:43:15.869417+0000","last_undegraded":"2024-05-08T06:43:15.869417+0000","last_fullsized":"2024-05-08T06:43:15.869417+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:56:44.302049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.872721+0000","last_change":"2024-05-08T06:41:06.151820+0000","last_active":"2024-05-08T06:43:16.872721+0000","last_peered":"2024-05-08T06:43:16.872721+0000","last_clean":"2024-05-08T06:43:16.872721+0000","last_became_active":"2024-05-08T06:41:06.149976+0000","last_became_peered":"2024-05-08T06:41:06.149976+0000","last_unstale":"2024-05-08T06:43:16.872721+0000","last_undegraded":"2024-05-08T06:43:16.872721+0000","last_fullsized":"2024-05-08T06:43:16.872721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:35:21.233811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957070+0000","last_change":"2024-05-08T06:41:09.568880+0000","last_active":"2024-05-08T06:43:16.957070+0000","last_peered":"2024-05-08T06:43:16.957070+0000","last_clean":"2024-05-08T06:43:16.957070+0000","last_became_active":"2024-05-08T06:41:09.568507+0000","last_became_peered":"2024-05-08T06:41:09.568507+0000","last_unstale":"2024-05-08T06:43:16.957070+0000","last_undegraded":"2024-05-08T06:43:16.957070+0000","last_fullsized":"2024-05-08T06:43:16.957070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:01.376121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884503+0000","last_change":"2024-05-08T06:41:24.667472+0000","last_active":"2024-05-08T06:43:16.884503+0000","last_peered":"2024-05-08T06:43:16.884503+0000","last_clean":"2024-05-08T06:43:16.884503+0000","last_became_active":"2024-05-08T06:41:24.664164+0000","last_became_peered":"2024-05-08T06:41:24.664164+0000","last_unstale":"2024-05-08T06:43:16.884503+0000","last_undegraded":"2024-05-08T06:43:16.884503+0000","last_fullsized":"2024-05-08T06:43:16.884503+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:34:25.630742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'10","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866879+0000","last_change":"2024-05-08T06:41:05.504287+0000","last_active":"2024-05-08T06:43:16.866879+0000","last_peered":"2024-05-08T06:43:16.866879+0000","last_clean":"2024-05-08T06:43:16.866879+0000","last_became_active":"2024-05-08T06:41:05.503825+0000","last_became_peered":"2024-05-08T06:41:05.503825+0000","last_unstale":"2024-05-08T06:43:16.866879+0000","last_undegraded":"2024-05-08T06:43:16.866879+0000","last_fullsized":"2024-05-08T06:43:16.866879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:50:23.230289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885371+0000","last_change":"2024-05-08T06:41:09.576996+0000","last_active":"2024-05-08T06:43:16.885371+0000","last_peered":"2024-05-08T06:43:16.885371+0000","last_clean":"2024-05-08T06:43:16.885371+0000","last_became_active":"2024-05-08T06:41:09.572034+0000","last_became_peered":"2024-05-08T06:41:09.572034+0000","last_unstale":"2024-05-08T06:43:16.885371+0000","last_undegraded":"2024-05-08T06:43:16.885371+0000","last_fullsized":"2024-05-08T06:43:16.885371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:41.690687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876553+0000","last_change":"2024-05-08T06:41:24.665751+0000","last_active":"2024-05-08T06:43:16.876553+0000","last_peered":"2024-05-08T06:43:16.876553+0000","last_clean":"2024-05-08T06:43:16.876553+0000","last_became_active":"2024-05-08T06:41:24.665306+0000","last_became_peered":"2024-05-08T06:41:24.665306+0000","last_unstale":"2024-05-08T06:43:16.876553+0000","last_undegraded":"2024-05-08T06:43:16.876553+0000","last_fullsized":"2024-05-08T06:43:16.876553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:10.515975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871049+0000","last_change":"2024-05-08T06:41:05.502897+0000","last_active":"2024-05-08T06:43:16.871049+0000","last_peered":"2024-05-08T06:43:16.871049+0000","last_clean":"2024-05-08T06:43:16.871049+0000","last_became_active":"2024-05-08T06:41:05.500636+0000","last_became_peered":"2024-05-08T06:41:05.500636+0000","last_unstale":"2024-05-08T06:43:16.871049+0000","last_undegraded":"2024-05-08T06:43:16.871049+0000","last_fullsized":"2024-05-08T06:43:16.871049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:02.523706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.875133+0000","last_change":"2024-05-08T06:41:09.586824+0000","last_active":"2024-05-08T06:43:16.875133+0000","last_peered":"2024-05-08T06:43:16.875133+0000","last_clean":"2024-05-08T06:43:16.875133+0000","last_became_active":"2024-05-08T06:41:09.585032+0000","last_became_peered":"2024-05-08T06:41:09.585032+0000","last_unstale":"2024-05-08T06:43:16.875133+0000","last_undegraded":"2024-05-08T06:43:16.875133+0000","last_fullsized":"2024-05-08T06:43:16.875133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:00:31.890993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870440+0000","last_change":"2024-05-08T06:41:24.670033+0000","last_active":"2024-05-08T06:43:16.870440+0000","last_peered":"2024-05-08T06:43:16.870440+0000","last_clean":"2024-05-08T06:43:16.870440+0000","last_became_active":"2024-05-08T06:41:24.669477+0000","last_became_peered":"2024-05-08T06:41:24.669477+0000","last_unstale":"2024-05-08T06:43:16.870440+0000","last_undegraded":"2024-05-08T06:43:16.870440+0000","last_fullsized":"2024-05-08T06:43:16.870440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:55.040308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.861339+0000","last_change":"2024-05-08T06:41:06.146847+0000","last_active":"2024-05-08T06:43:15.861339+0000","last_peered":"2024-05-08T06:43:15.861339+0000","last_clean":"2024-05-08T06:43:15.861339+0000","last_became_active":"2024-05-08T06:41:06.146141+0000","last_became_peered":"2024-05-08T06:41:06.146141+0000","last_unstale":"2024-05-08T06:43:15.861339+0000","last_undegraded":"2024-05-08T06:43:15.861339+0000","last_fullsized":"2024-05-08T06:43:15.861339+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:45:30.924860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871461+0000","last_change":"2024-05-08T06:41:09.578067+0000","last_active":"2024-05-08T06:43:16.871461+0000","last_peered":"2024-05-08T06:43:16.871461+0000","last_clean":"2024-05-08T06:43:16.871461+0000","last_became_active":"2024-05-08T06:41:09.577650+0000","last_became_peered":"2024-05-08T06:41:09.577650+0000","last_unstale":"2024-05-08T06:43:16.871461+0000","last_undegraded":"2024-05-08T06:43:16.871461+0000","last_fullsized":"2024-05-08T06:43:16.871461+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:09.285601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.867145+0000","last_change":"2024-05-08T06:41:24.669791+0000","last_active":"2024-05-08T06:43:16.867145+0000","last_peered":"2024-05-08T06:43:16.867145+0000","last_clean":"2024-05-08T06:43:16.867145+0000","last_became_active":"2024-05-08T06:41:24.669363+0000","last_became_peered":"2024-05-08T06:41:24.669363+0000","last_unstale":"2024-05-08T06:43:16.867145+0000","last_undegraded":"2024-05-08T06:43:16.867145+0000","last_fullsized":"2024-05-08T06:43:16.867145+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:08.522339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884734+0000","last_change":"2024-05-08T06:41:05.486456+0000","last_active":"2024-05-08T06:43:16.884734+0000","last_peered":"2024-05-08T06:43:16.884734+0000","last_clean":"2024-05-08T06:43:16.884734+0000","last_became_active":"2024-05-08T06:41:05.485878+0000","last_became_peered":"2024-05-08T06:41:05.485878+0000","last_unstale":"2024-05-08T06:43:16.884734+0000","last_undegraded":"2024-05-08T06:43:16.884734+0000","last_fullsized":"2024-05-08T06:43:16.884734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:11:47.985329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.867258+0000","last_change":"2024-05-08T06:41:09.573940+0000","last_active":"2024-05-08T06:43:15.867258+0000","last_peered":"2024-05-08T06:43:15.867258+0000","last_clean":"2024-05-08T06:43:15.867258+0000","last_became_active":"2024-05-08T06:41:09.573515+0000","last_became_peered":"2024-05-08T06:41:09.573515+0000","last_unstale":"2024-05-08T06:43:15.867258+0000","last_undegraded":"2024-05-08T06:43:15.867258+0000","last_fullsized":"2024-05-08T06:43:15.867258+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:44.803013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871137+0000","last_change":"2024-05-08T06:41:24.663008+0000","last_active":"2024-05-08T06:43:16.871137+0000","last_peered":"2024-05-08T06:43:16.871137+0000","last_clean":"2024-05-08T06:43:16.871137+0000","last_became_active":"2024-05-08T06:41:24.661934+0000","last_became_peered":"2024-05-08T06:41:24.661934+0000","last_unstale":"2024-05-08T06:43:16.871137+0000","last_undegraded":"2024-05-08T06:43:16.871137+0000","last_fullsized":"2024-05-08T06:43:16.871137+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:08.719125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":2,"reported_epoch":91,"state":"peering","last_fresh":"2024-05-08T06:42:41.236562+0000","last_change":"2024-05-08T06:43:16.245465+0000","last_active":"2024-05-08T06:43:16.245465+0000","last_peered":"2024-05-08T06:42:41.236562+0000","last_clean":"2024-05-08T06:42:41.236562+0000","last_became_active":"2024-05-08T06:41:05.507543+0000","last_became_peered":"2024-05-08T06:41:05.507543+0000","last_unstale":"2024-05-08T06:42:41.236562+0000","last_undegraded":"2024-05-08T06:42:41.236562+0000","last_fullsized":"2024-05-08T06:42:41.236562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":1,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884954+0000","last_change":"2024-05-08T06:41:09.573388+0000","last_active":"2024-05-08T06:43:16.884954+0000","last_peered":"2024-05-08T06:43:16.884954+0000","last_clean":"2024-05-08T06:43:16.884954+0000","last_became_active":"2024-05-08T06:41:09.572901+0000","last_became_peered":"2024-05-08T06:41:09.572901+0000","last_unstale":"2024-05-08T06:43:16.884954+0000","last_undegraded":"2024-05-08T06:43:16.884954+0000","last_fullsized":"2024-05-08T06:43:16.884954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:38:45.123194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870163+0000","last_change":"2024-05-08T06:41:24.659817+0000","last_active":"2024-05-08T06:43:16.870163+0000","last_peered":"2024-05-08T06:43:16.870163+0000","last_clean":"2024-05-08T06:43:16.870163+0000","last_became_active":"2024-05-08T06:41:24.659276+0000","last_became_peered":"2024-05-08T06:41:24.659276+0000","last_unstale":"2024-05-08T06:43:16.870163+0000","last_undegraded":"2024-05-08T06:43:16.870163+0000","last_fullsized":"2024-05-08T06:43:16.870163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:01.635454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":2,"reported_epoch":91,"state":"peering","last_fresh":"2024-05-08T06:42:15.855548+0000","last_change":"2024-05-08T06:43:16.245491+0000","last_active":"2024-05-08T06:43:16.245491+0000","last_peered":"2024-05-08T06:42:15.855548+0000","last_clean":"2024-05-08T06:42:15.855548+0000","last_became_active":"2024-05-08T06:41:05.509662+0000","last_became_peered":"2024-05-08T06:41:05.509662+0000","last_unstale":"2024-05-08T06:42:15.855548+0000","last_undegraded":"2024-05-08T06:42:15.855548+0000","last_fullsized":"2024-05-08T06:42:15.855548+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":2,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878711+0000","last_change":"2024-05-08T06:41:09.574238+0000","last_active":"2024-05-08T06:43:16.878711+0000","last_peered":"2024-05-08T06:43:16.878711+0000","last_clean":"2024-05-08T06:43:16.878711+0000","last_became_active":"2024-05-08T06:41:09.570019+0000","last_became_peered":"2024-05-08T06:41:09.570019+0000","last_unstale":"2024-05-08T06:43:16.878711+0000","last_undegraded":"2024-05-08T06:43:16.878711+0000","last_fullsized":"2024-05-08T06:43:16.878711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:56.980400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.861332+0000","last_change":"2024-05-08T06:41:24.659955+0000","last_active":"2024-05-08T06:43:15.861332+0000","last_peered":"2024-05-08T06:43:15.861332+0000","last_clean":"2024-05-08T06:43:15.861332+0000","last_became_active":"2024-05-08T06:41:24.659534+0000","last_became_peered":"2024-05-08T06:41:24.659534+0000","last_unstale":"2024-05-08T06:43:15.861332+0000","last_undegraded":"2024-05-08T06:43:15.861332+0000","last_fullsized":"2024-05-08T06:43:15.861332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:41.893917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.898447+0000","last_change":"2024-05-08T06:43:16.897225+0000","last_active":"2024-05-08T06:43:16.898447+0000","last_peered":"2024-05-08T06:43:16.898447+0000","last_clean":"2024-05-08T06:43:16.898447+0000","last_became_active":"2024-05-08T06:43:16.883954+0000","last_became_peered":"2024-05-08T06:43:16.883954+0000","last_unstale":"2024-05-08T06:43:16.898447+0000","last_undegraded":"2024-05-08T06:43:16.898447+0000","last_fullsized":"2024-05-08T06:43:16.898447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:12.014514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.880189+0000","last_change":"2024-05-08T06:41:09.574159+0000","last_active":"2024-05-08T06:43:16.880189+0000","last_peered":"2024-05-08T06:43:16.880189+0000","last_clean":"2024-05-08T06:43:16.880189+0000","last_became_active":"2024-05-08T06:41:09.573734+0000","last_became_peered":"2024-05-08T06:41:09.573734+0000","last_unstale":"2024-05-08T06:43:16.880189+0000","last_undegraded":"2024-05-08T06:43:16.880189+0000","last_fullsized":"2024-05-08T06:43:16.880189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:22.157071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874580+0000","last_change":"2024-05-08T06:41:24.668545+0000","last_active":"2024-05-08T06:43:16.874580+0000","last_peered":"2024-05-08T06:43:16.874580+0000","last_clean":"2024-05-08T06:43:16.874580+0000","last_became_active":"2024-05-08T06:41:24.668086+0000","last_became_peered":"2024-05-08T06:41:24.668086+0000","last_unstale":"2024-05-08T06:43:16.874580+0000","last_undegraded":"2024-05-08T06:43:16.874580+0000","last_fullsized":"2024-05-08T06:43:16.874580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:08:02.473733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130107+0000","last_change":"2024-05-08T06:41:05.501332+0000","last_active":"2024-05-08T06:43:17.130107+0000","last_peered":"2024-05-08T06:43:17.130107+0000","last_clean":"2024-05-08T06:43:17.130107+0000","last_became_active":"2024-05-08T06:41:05.499174+0000","last_became_peered":"2024-05-08T06:41:05.499174+0000","last_unstale":"2024-05-08T06:43:17.130107+0000","last_undegraded":"2024-05-08T06:43:17.130107+0000","last_fullsized":"2024-05-08T06:43:17.130107+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:49.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879475+0000","last_change":"2024-05-08T06:41:09.572927+0000","last_active":"2024-05-08T06:43:16.879475+0000","last_peered":"2024-05-08T06:43:16.879475+0000","last_clean":"2024-05-08T06:43:16.879475+0000","last_became_active":"2024-05-08T06:41:09.572502+0000","last_became_peered":"2024-05-08T06:41:09.572502+0000","last_unstale":"2024-05-08T06:43:16.879475+0000","last_undegraded":"2024-05-08T06:43:16.879475+0000","last_fullsized":"2024-05-08T06:43:16.879475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:03.838892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.128965+0000","last_change":"2024-05-08T06:41:24.667561+0000","last_active":"2024-05-08T06:43:17.128965+0000","last_peered":"2024-05-08T06:43:17.128965+0000","last_clean":"2024-05-08T06:43:17.128965+0000","last_became_active":"2024-05-08T06:41:24.666904+0000","last_became_peered":"2024-05-08T06:41:24.666904+0000","last_unstale":"2024-05-08T06:43:17.128965+0000","last_undegraded":"2024-05-08T06:43:17.128965+0000","last_fullsized":"2024-05-08T06:43:17.128965+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:15.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957592+0000","last_change":"2024-05-08T06:41:05.497117+0000","last_active":"2024-05-08T06:43:16.957592+0000","last_peered":"2024-05-08T06:43:16.957592+0000","last_clean":"2024-05-08T06:43:16.957592+0000","last_became_active":"2024-05-08T06:41:05.496621+0000","last_became_peered":"2024-05-08T06:41:05.496621+0000","last_unstale":"2024-05-08T06:43:16.957592+0000","last_undegraded":"2024-05-08T06:43:16.957592+0000","last_fullsized":"2024-05-08T06:43:16.957592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:06:32.603973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879952+0000","last_change":"2024-05-08T06:41:09.572489+0000","last_active":"2024-05-08T06:43:16.879952+0000","last_peered":"2024-05-08T06:43:16.879952+0000","last_clean":"2024-05-08T06:43:16.879952+0000","last_became_active":"2024-05-08T06:41:09.572129+0000","last_became_peered":"2024-05-08T06:41:09.572129+0000","last_unstale":"2024-05-08T06:43:16.879952+0000","last_undegraded":"2024-05-08T06:43:16.879952+0000","last_fullsized":"2024-05-08T06:43:16.879952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:18:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.867464+0000","last_change":"2024-05-08T06:41:09.577872+0000","last_active":"2024-05-08T06:43:15.867464+0000","last_peered":"2024-05-08T06:43:15.867464+0000","last_clean":"2024-05-08T06:43:15.867464+0000","last_became_active":"2024-05-08T06:41:09.577490+0000","last_became_peered":"2024-05-08T06:41:09.577490+0000","last_unstale":"2024-05-08T06:43:15.867464+0000","last_undegraded":"2024-05-08T06:43:15.867464+0000","last_fullsized":"2024-05-08T06:43:15.867464+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:12:44.956055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877569+0000","last_change":"2024-05-08T06:42:15.861046+0000","last_active":"2024-05-08T06:43:16.877569+0000","last_peered":"2024-05-08T06:43:16.877569+0000","last_clean":"2024-05-08T06:43:16.877569+0000","last_became_active":"2024-05-08T06:42:15.860267+0000","last_became_peered":"2024-05-08T06:42:15.860267+0000","last_unstale":"2024-05-08T06:43:16.877569+0000","last_undegraded":"2024-05-08T06:43:16.877569+0000","last_fullsized":"2024-05-08T06:43:16.877569+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:15:01.541268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876313+0000","last_change":"2024-05-08T06:41:09.578005+0000","last_active":"2024-05-08T06:43:16.876313+0000","last_peered":"2024-05-08T06:43:16.876313+0000","last_clean":"2024-05-08T06:43:16.876313+0000","last_became_active":"2024-05-08T06:41:09.577571+0000","last_became_peered":"2024-05-08T06:41:09.577571+0000","last_unstale":"2024-05-08T06:43:16.876313+0000","last_undegraded":"2024-05-08T06:43:16.876313+0000","last_fullsized":"2024-05-08T06:43:16.876313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:22.762195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874770+0000","last_change":"2024-05-08T06:41:09.579520+0000","last_active":"2024-05-08T06:43:16.874770+0000","last_peered":"2024-05-08T06:43:16.874770+0000","last_clean":"2024-05-08T06:43:16.874770+0000","last_became_active":"2024-05-08T06:41:09.579085+0000","last_became_peered":"2024-05-08T06:41:09.579085+0000","last_unstale":"2024-05-08T06:43:16.874770+0000","last_undegraded":"2024-05-08T06:43:16.874770+0000","last_fullsized":"2024-05-08T06:43:16.874770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:02:25.199102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957477+0000","last_change":"2024-05-08T06:41:09.588352+0000","last_active":"2024-05-08T06:43:16.957477+0000","last_peered":"2024-05-08T06:43:16.957477+0000","last_clean":"2024-05-08T06:43:16.957477+0000","last_became_active":"2024-05-08T06:41:09.587981+0000","last_became_peered":"2024-05-08T06:41:09.587981+0000","last_unstale":"2024-05-08T06:43:16.957477+0000","last_undegraded":"2024-05-08T06:43:16.957477+0000","last_fullsized":"2024-05-08T06:43:16.957477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:55.275569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.871142+0000","last_change":"2024-05-08T06:41:09.584216+0000","last_active":"2024-05-08T06:43:15.871142+0000","last_peered":"2024-05-08T06:43:15.871142+0000","last_clean":"2024-05-08T06:43:15.871142+0000","last_became_active":"2024-05-08T06:41:09.583789+0000","last_became_peered":"2024-05-08T06:41:09.583789+0000","last_unstale":"2024-05-08T06:43:15.871142+0000","last_undegraded":"2024-05-08T06:43:15.871142+0000","last_fullsized":"2024-05-08T06:43:15.871142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:33:04.153098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879485+0000","last_change":"2024-05-08T06:41:09.573622+0000","last_active":"2024-05-08T06:43:16.879485+0000","last_peered":"2024-05-08T06:43:16.879485+0000","last_clean":"2024-05-08T06:43:16.879485+0000","last_became_active":"2024-05-08T06:41:09.573116+0000","last_became_peered":"2024-05-08T06:41:09.573116+0000","last_unstale":"2024-05-08T06:43:16.879485+0000","last_undegraded":"2024-05-08T06:43:16.879485+0000","last_fullsized":"2024-05-08T06:43:16.879485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:58:03.031899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885441+0000","last_change":"2024-05-08T06:41:09.588787+0000","last_active":"2024-05-08T06:43:16.885441+0000","last_peered":"2024-05-08T06:43:16.885441+0000","last_clean":"2024-05-08T06:43:16.885441+0000","last_became_active":"2024-05-08T06:41:09.588430+0000","last_became_peered":"2024-05-08T06:41:09.588430+0000","last_unstale":"2024-05-08T06:43:16.885441+0000","last_undegraded":"2024-05-08T06:43:16.885441+0000","last_fullsized":"2024-05-08T06:43:16.885441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:36:26.689419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129624+0000","last_change":"2024-05-08T06:41:09.575057+0000","last_active":"2024-05-08T06:43:17.129624+0000","last_peered":"2024-05-08T06:43:17.129624+0000","last_clean":"2024-05-08T06:43:17.129624+0000","last_became_active":"2024-05-08T06:41:09.572522+0000","last_became_peered":"2024-05-08T06:41:09.572522+0000","last_unstale":"2024-05-08T06:43:17.129624+0000","last_undegraded":"2024-05-08T06:43:17.129624+0000","last_fullsized":"2024-05-08T06:43:17.129624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:40:26.702841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884817+0000","last_change":"2024-05-08T06:41:09.578184+0000","last_active":"2024-05-08T06:43:16.884817+0000","last_peered":"2024-05-08T06:43:16.884817+0000","last_clean":"2024-05-08T06:43:16.884817+0000","last_became_active":"2024-05-08T06:41:09.577796+0000","last_became_peered":"2024-05-08T06:41:09.577796+0000","last_unstale":"2024-05-08T06:43:16.884817+0000","last_undegraded":"2024-05-08T06:43:16.884817+0000","last_fullsized":"2024-05-08T06:43:16.884817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:40.822805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.861756+0000","last_change":"2024-05-08T06:41:09.577050+0000","last_active":"2024-05-08T06:43:15.861756+0000","last_peered":"2024-05-08T06:43:15.861756+0000","last_clean":"2024-05-08T06:43:15.861756+0000","last_became_active":"2024-05-08T06:41:09.576449+0000","last_became_peered":"2024-05-08T06:41:09.576449+0000","last_unstale":"2024-05-08T06:43:15.861756+0000","last_undegraded":"2024-05-08T06:43:15.861756+0000","last_fullsized":"2024-05-08T06:43:15.861756+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:04:42.819087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956652+0000","last_change":"2024-05-08T06:41:09.580830+0000","last_active":"2024-05-08T06:43:16.956652+0000","last_peered":"2024-05-08T06:43:16.956652+0000","last_clean":"2024-05-08T06:43:16.956652+0000","last_became_active":"2024-05-08T06:41:09.577457+0000","last_became_peered":"2024-05-08T06:41:09.577457+0000","last_unstale":"2024-05-08T06:43:16.956652+0000","last_undegraded":"2024-05-08T06:43:16.956652+0000","last_fullsized":"2024-05-08T06:43:16.956652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:02.932857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-08T06:43:15.869852+0000","last_change":"2024-05-08T06:41:09.586919+0000","last_active":"2024-05-08T06:43:15.869852+0000","last_peered":"2024-05-08T06:43:15.869852+0000","last_clean":"2024-05-08T06:43:15.869852+0000","last_became_active":"2024-05-08T06:41:09.586560+0000","last_became_peered":"2024-05-08T06:41:09.586560+0000","last_unstale":"2024-05-08T06:43:15.869852+0000","last_undegraded":"2024-05-08T06:43:15.869852+0000","last_fullsized":"2024-05-08T06:43:15.869852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:00.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71093,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":3,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":244,"num_read_kb":197,"num_write":167,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":213279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612652,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1040384,"data_stored":518733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808883,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1753088,"data_stored":1182953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972412,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":532534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168641,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1073152,"data_stored":528358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364873,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32808,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712344,"statfs":{"total":95995035648,"available":95961440256,"internally_reserved":0,"allocated":1667072,"data_stored":1124267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561105,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":523614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1110016,"data_stored":581147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738488,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1077248,"data_stored":525002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411435,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1146880,"data_stored":591384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149797,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":523808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953567,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":529237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757336,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36980,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708172,"statfs":{"total":95995035648,"available":95957168128,"internally_reserved":0,"allocated":1675264,"data_stored":1119464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":67092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T06:43:22.072 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T06:43:22.182 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:21 smithi070 ceph-mon[29591]: pgmap v445: 129 pgs: 2 peering, 127 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s; 72 B/s, 0 objects/s recovering 2024-05-08T06:43:22.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:21 smithi194 ceph-mon[33679]: pgmap v445: 129 pgs: 2 peering, 127 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s; 72 B/s, 0 objects/s recovering 2024-05-08T06:43:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:21 smithi172 ceph-mon[33377]: pgmap v445: 129 pgs: 2 peering, 127 active+clean; 646 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 8 op/s; 72 B/s, 0 objects/s recovering 2024-05-08T06:43:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:22.957 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:22 smithi070 ceph-mon[29591]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:43:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:22 smithi194 ceph-mon[33679]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:43:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:22 smithi172 ceph-mon[33377]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:43:24.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:23 smithi194 ceph-mon[33679]: pgmap v446: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 72 B/s, 0 objects/s recovering 2024-05-08T06:43:24.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:23 smithi194 ceph-mon[33679]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-08T06:43:24.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:23 smithi194 ceph-mon[33679]: Cluster is now healthy 2024-05-08T06:43:24.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:23 smithi070 ceph-mon[29591]: pgmap v446: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 72 B/s, 0 objects/s recovering 2024-05-08T06:43:24.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:23 smithi070 ceph-mon[29591]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-08T06:43:24.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:23 smithi070 ceph-mon[29591]: Cluster is now healthy 2024-05-08T06:43:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:23 smithi172 ceph-mon[33377]: pgmap v446: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 72 B/s, 0 objects/s recovering 2024-05-08T06:43:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:23 smithi172 ceph-mon[33377]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-08T06:43:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:23 smithi172 ceph-mon[33377]: Cluster is now healthy 2024-05-08T06:43:24.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.929+0000 7fd4fbe00700 1 -- 172.21.15.70:0/4284137212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f4075ff0 msgr2=0x7fd4f410f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:24.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.929+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/4284137212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f4075ff0 0x7fd4f410f9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009990 tx=0x7fd4e0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:43:24.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.929+0000 7fd4fbe00700 1 -- 172.21.15.70:0/4284137212 shutdown_connections 2024-05-08T06:43:24.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.929+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/4284137212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4f410ff00 0x7fd4f41122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:24.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.929+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/4284137212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4f40756d0 0x7fd4f4075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:24.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.929+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/4284137212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f4075ff0 0x7fd4f410f9c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:24.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.929+0000 7fd4fbe00700 1 -- 172.21.15.70:0/4284137212 >> 172.21.15.70:0/4284137212 conn(0x7fd4f407a600 msgr2=0x7fd4f407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:24.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.929+0000 7fd4fbe00700 1 -- 172.21.15.70:0/4284137212 shutdown_connections 2024-05-08T06:43:24.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.929+0000 7fd4fbe00700 1 -- 172.21.15.70:0/4284137212 wait complete. 2024-05-08T06:43:24.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.931+0000 7fd4fbe00700 1 Processor -- start 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.931+0000 7fd4fbe00700 1 -- start start 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.931+0000 7fd4fbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4f40756d0 0x7fd4f41a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.931+0000 7fd4fbe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4f4075ff0 0x7fd4f41a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.931+0000 7fd4fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f410ff00 0x7fd4f419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.931+0000 7fd4fbe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f41157b0 con 0x7fd4f410ff00 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.931+0000 7fd4fbe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4115630 con 0x7fd4f40756d0 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.931+0000 7fd4fbe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f4115930 con 0x7fd4f4075ff0 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f410ff00 0x7fd4f419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f410ff00 0x7fd4f419ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57292/0 (socket says 172.21.15.70:57292) 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f9e00700 1 -- 172.21.15.70:0/2291175081 learned_addr learned my addr 172.21.15.70:0/2291175081 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f9400700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4f40756d0 0x7fd4f41a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f8a00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4f4075ff0 0x7fd4f41a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f9e00700 1 -- 172.21.15.70:0/2291175081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4f4075ff0 msgr2=0x7fd4f41a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:24.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f9e00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4f4075ff0 0x7fd4f41a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:24.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f9e00700 1 -- 172.21.15.70:0/2291175081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4f40756d0 msgr2=0x7fd4f41a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:24.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f9e00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4f40756d0 0x7fd4f41a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:24.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f9e00700 1 -- 172.21.15.70:0/2291175081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f419c190 con 0x7fd4f410ff00 2024-05-08T06:43:24.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.932+0000 7fd4f8a00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4f4075ff0 0x7fd4f41a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:43:24.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.933+0000 7fd4f9e00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f410ff00 0x7fd4f419ba30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00c940 tx=0x7fd4ec00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:24.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.933+0000 7fd4f2000700 1 -- 172.21.15.70:0/2291175081 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec004220 con 0x7fd4f410ff00 2024-05-08T06:43:24.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.933+0000 7fd4f2000700 1 -- 172.21.15.70:0/2291175081 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd4ec0043c0 con 0x7fd4f410ff00 2024-05-08T06:43:24.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.933+0000 7fd4f2000700 1 -- 172.21.15.70:0/2291175081 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec003a80 con 0x7fd4f410ff00 2024-05-08T06:43:24.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.933+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f419c480 con 0x7fd4f410ff00 2024-05-08T06:43:24.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.933+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f41a8740 con 0x7fd4f410ff00 2024-05-08T06:43:24.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.934+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f406a190 con 0x7fd4f410ff00 2024-05-08T06:43:24.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.937+0000 7fd4f2000700 1 -- 172.21.15.70:0/2291175081 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd4ec003ca0 con 0x7fd4f410ff00 2024-05-08T06:43:24.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.938+0000 7fd4f2000700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd4dc0b2990 0x7fd4dc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:24.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.938+0000 7fd4f2000700 1 -- 172.21.15.70:0/2291175081 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fd4ec0e1f50 con 0x7fd4f410ff00 2024-05-08T06:43:24.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.938+0000 7fd4f9400700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd4dc0b2990 0x7fd4dc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:24.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.939+0000 7fd4f9400700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd4dc0b2990 0x7fd4dc0b4e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd4f419cb70 tx=0x7fd4e80079e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:24.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:24.943+0000 7fd4f2000700 1 -- 172.21.15.70:0/2291175081 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd4ec014030 con 0x7fd4f410ff00 2024-05-08T06:43:25.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.178+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd4f40638e0 con 0x7fd4dc0b2990 2024-05-08T06:43:25.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.190+0000 7fd4f2000700 1 -- 172.21.15.70:0/2291175081 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340444 (secure 0 0 0) 0x7fd4f40638e0 con 0x7fd4dc0b2990 2024-05-08T06:43:25.195 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:43:25.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd4dc0b2990 msgr2=0x7fd4dc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:25.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd4dc0b2990 0x7fd4dc0b4e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd4f419cb70 tx=0x7fd4e80079e0 comp rx=0 tx=0).stop 2024-05-08T06:43:25.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f410ff00 msgr2=0x7fd4f419ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f410ff00 0x7fd4f419ba30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00c940 tx=0x7fd4ec00cc50 comp rx=0 tx=0).stop 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 shutdown_connections 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd4dc0b2990 0x7fd4dc0b4e50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd4f410ff00 0x7fd4f419ba30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd4f40756d0 0x7fd4f41a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 --2- 172.21.15.70:0/2291175081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4f4075ff0 0x7fd4f41a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.196+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 >> 172.21.15.70:0/2291175081 conn(0x7fd4f407a600 msgr2=0x7fd4f4100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.197+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 shutdown_connections 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:25.197+0000 7fd4fbe00700 1 -- 172.21.15.70:0/2291175081 wait complete. 2024-05-08T06:43:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-08T06:43:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:25 smithi070 ceph-mon[29591]: pgmap v447: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 617 B/s wr, 5 op/s; 70 B/s, 0 objects/s recovering 2024-05-08T06:43:26.224 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":447,"stamp":"2024-05-08T06:43:24.139925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661695,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":340,"num_read_kb":271,"num_write":292,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":237,"ondisk_log_size":237,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384512,"kb_used_data":14492,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557312,"statfs":{"total":1151940427776,"available":1151546687488,"internally_reserved":0,"allocated":14839808,"data_stored":8300577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4265,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":22,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.286404"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.882222+0000","last_change":"2024-05-08T06:41:09.587375+0000","last_active":"2024-05-08T06:43:16.882222+0000","last_peered":"2024-05-08T06:43:16.882222+0000","last_clean":"2024-05-08T06:43:16.882222+0000","last_became_active":"2024-05-08T06:41:09.585981+0000","last_became_peered":"2024-05-08T06:41:09.585981+0000","last_unstale":"2024-05-08T06:43:16.882222+0000","last_undegraded":"2024-05-08T06:43:16.882222+0000","last_fullsized":"2024-05-08T06:43:16.882222+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:21.366529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874979+0000","last_change":"2024-05-08T06:41:09.573666+0000","last_active":"2024-05-08T06:43:16.874979+0000","last_peered":"2024-05-08T06:43:16.874979+0000","last_clean":"2024-05-08T06:43:16.874979+0000","last_became_active":"2024-05-08T06:41:09.573331+0000","last_became_peered":"2024-05-08T06:41:09.573331+0000","last_unstale":"2024-05-08T06:43:16.874979+0000","last_undegraded":"2024-05-08T06:43:16.874979+0000","last_fullsized":"2024-05-08T06:43:16.874979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:03:14.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874635+0000","last_change":"2024-05-08T06:41:09.582304+0000","last_active":"2024-05-08T06:43:16.874635+0000","last_peered":"2024-05-08T06:43:16.874635+0000","last_clean":"2024-05-08T06:43:16.874635+0000","last_became_active":"2024-05-08T06:41:09.581916+0000","last_became_peered":"2024-05-08T06:41:09.581916+0000","last_unstale":"2024-05-08T06:43:16.874635+0000","last_undegraded":"2024-05-08T06:43:16.874635+0000","last_fullsized":"2024-05-08T06:43:16.874635+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:26.221008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866467+0000","last_change":"2024-05-08T06:42:15.863857+0000","last_active":"2024-05-08T06:43:16.866467+0000","last_peered":"2024-05-08T06:43:16.866467+0000","last_clean":"2024-05-08T06:43:16.866467+0000","last_became_active":"2024-05-08T06:42:15.863147+0000","last_became_peered":"2024-05-08T06:42:15.863147+0000","last_unstale":"2024-05-08T06:43:16.866467+0000","last_undegraded":"2024-05-08T06:43:16.866467+0000","last_fullsized":"2024-05-08T06:43:16.866467+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:48:20.951766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873972+0000","last_change":"2024-05-08T06:41:09.582429+0000","last_active":"2024-05-08T06:43:16.873972+0000","last_peered":"2024-05-08T06:43:16.873972+0000","last_clean":"2024-05-08T06:43:16.873972+0000","last_became_active":"2024-05-08T06:41:09.580152+0000","last_became_peered":"2024-05-08T06:41:09.580152+0000","last_unstale":"2024-05-08T06:43:16.873972+0000","last_undegraded":"2024-05-08T06:43:16.873972+0000","last_fullsized":"2024-05-08T06:43:16.873972+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:58.992177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.132118+0000","last_change":"2024-05-08T06:41:09.576432+0000","last_active":"2024-05-08T06:43:17.132118+0000","last_peered":"2024-05-08T06:43:17.132118+0000","last_clean":"2024-05-08T06:43:17.132118+0000","last_became_active":"2024-05-08T06:41:09.575723+0000","last_became_peered":"2024-05-08T06:41:09.575723+0000","last_unstale":"2024-05-08T06:43:17.132118+0000","last_undegraded":"2024-05-08T06:43:17.132118+0000","last_fullsized":"2024-05-08T06:43:17.132118+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:51.802944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878767+0000","last_change":"2024-05-08T06:42:15.856660+0000","last_active":"2024-05-08T06:43:16.878767+0000","last_peered":"2024-05-08T06:43:16.878767+0000","last_clean":"2024-05-08T06:43:16.878767+0000","last_became_active":"2024-05-08T06:42:15.855585+0000","last_became_peered":"2024-05-08T06:42:15.855585+0000","last_unstale":"2024-05-08T06:43:16.878767+0000","last_undegraded":"2024-05-08T06:43:16.878767+0000","last_fullsized":"2024-05-08T06:43:16.878767+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:43.647357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884369+0000","last_change":"2024-05-08T06:41:09.579941+0000","last_active":"2024-05-08T06:43:16.884369+0000","last_peered":"2024-05-08T06:43:16.884369+0000","last_clean":"2024-05-08T06:43:16.884369+0000","last_became_active":"2024-05-08T06:41:09.578961+0000","last_became_peered":"2024-05-08T06:41:09.578961+0000","last_unstale":"2024-05-08T06:43:16.884369+0000","last_undegraded":"2024-05-08T06:43:16.884369+0000","last_fullsized":"2024-05-08T06:43:16.884369+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:28:59.000080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.132445+0000","last_change":"2024-05-08T06:41:09.580544+0000","last_active":"2024-05-08T06:43:17.132445+0000","last_peered":"2024-05-08T06:43:17.132445+0000","last_clean":"2024-05-08T06:43:17.132445+0000","last_became_active":"2024-05-08T06:41:09.579445+0000","last_became_peered":"2024-05-08T06:41:09.579445+0000","last_unstale":"2024-05-08T06:43:17.132445+0000","last_undegraded":"2024-05-08T06:43:17.132445+0000","last_fullsized":"2024-05-08T06:43:17.132445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:28.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.133865+0000","last_change":"2024-05-08T06:41:09.583133+0000","last_active":"2024-05-08T06:43:17.133865+0000","last_peered":"2024-05-08T06:43:17.133865+0000","last_clean":"2024-05-08T06:43:17.133865+0000","last_became_active":"2024-05-08T06:41:09.582261+0000","last_became_peered":"2024-05-08T06:41:09.582261+0000","last_unstale":"2024-05-08T06:43:17.133865+0000","last_undegraded":"2024-05-08T06:43:17.133865+0000","last_fullsized":"2024-05-08T06:43:17.133865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:26.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879642+0000","last_change":"2024-05-08T06:41:09.575410+0000","last_active":"2024-05-08T06:43:16.879642+0000","last_peered":"2024-05-08T06:43:16.879642+0000","last_clean":"2024-05-08T06:43:16.879642+0000","last_became_active":"2024-05-08T06:41:09.574936+0000","last_became_peered":"2024-05-08T06:41:09.574936+0000","last_unstale":"2024-05-08T06:43:16.879642+0000","last_undegraded":"2024-05-08T06:43:16.879642+0000","last_fullsized":"2024-05-08T06:43:16.879642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:45.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870432+0000","last_change":"2024-05-08T06:41:09.582844+0000","last_active":"2024-05-08T06:43:16.870432+0000","last_peered":"2024-05-08T06:43:16.870432+0000","last_clean":"2024-05-08T06:43:16.870432+0000","last_became_active":"2024-05-08T06:41:09.582497+0000","last_became_peered":"2024-05-08T06:41:09.582497+0000","last_unstale":"2024-05-08T06:43:16.870432+0000","last_undegraded":"2024-05-08T06:43:16.870432+0000","last_fullsized":"2024-05-08T06:43:16.870432+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:09:45.168495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956880+0000","last_change":"2024-05-08T06:41:09.565312+0000","last_active":"2024-05-08T06:43:16.956880+0000","last_peered":"2024-05-08T06:43:16.956880+0000","last_clean":"2024-05-08T06:43:16.956880+0000","last_became_active":"2024-05-08T06:41:09.563425+0000","last_became_peered":"2024-05-08T06:41:09.563425+0000","last_unstale":"2024-05-08T06:43:16.956880+0000","last_undegraded":"2024-05-08T06:43:16.956880+0000","last_fullsized":"2024-05-08T06:43:16.956880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:08.706504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874453+0000","last_change":"2024-05-08T06:41:09.579395+0000","last_active":"2024-05-08T06:43:16.874453+0000","last_peered":"2024-05-08T06:43:16.874453+0000","last_clean":"2024-05-08T06:43:16.874453+0000","last_became_active":"2024-05-08T06:41:09.575881+0000","last_became_peered":"2024-05-08T06:41:09.575881+0000","last_unstale":"2024-05-08T06:43:16.874453+0000","last_undegraded":"2024-05-08T06:43:16.874453+0000","last_fullsized":"2024-05-08T06:43:16.874453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:37.109480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874274+0000","last_change":"2024-05-08T06:41:09.589859+0000","last_active":"2024-05-08T06:43:16.874274+0000","last_peered":"2024-05-08T06:43:16.874274+0000","last_clean":"2024-05-08T06:43:16.874274+0000","last_became_active":"2024-05-08T06:41:09.589002+0000","last_became_peered":"2024-05-08T06:41:09.589002+0000","last_unstale":"2024-05-08T06:43:16.874274+0000","last_undegraded":"2024-05-08T06:43:16.874274+0000","last_fullsized":"2024-05-08T06:43:16.874274+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:15:39.022268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130030+0000","last_change":"2024-05-08T06:41:09.566551+0000","last_active":"2024-05-08T06:43:17.130030+0000","last_peered":"2024-05-08T06:43:17.130030+0000","last_clean":"2024-05-08T06:43:17.130030+0000","last_became_active":"2024-05-08T06:41:09.564599+0000","last_became_peered":"2024-05-08T06:41:09.564599+0000","last_unstale":"2024-05-08T06:43:17.130030+0000","last_undegraded":"2024-05-08T06:43:17.130030+0000","last_fullsized":"2024-05-08T06:43:17.130030+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:45.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.881532+0000","last_change":"2024-05-08T06:41:09.582643+0000","last_active":"2024-05-08T06:43:16.881532+0000","last_peered":"2024-05-08T06:43:16.881532+0000","last_clean":"2024-05-08T06:43:16.881532+0000","last_became_active":"2024-05-08T06:41:09.582213+0000","last_became_peered":"2024-05-08T06:41:09.582213+0000","last_unstale":"2024-05-08T06:43:16.881532+0000","last_undegraded":"2024-05-08T06:43:16.881532+0000","last_fullsized":"2024-05-08T06:43:16.881532+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:18.471194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866942+0000","last_change":"2024-05-08T06:41:09.581447+0000","last_active":"2024-05-08T06:43:16.866942+0000","last_peered":"2024-05-08T06:43:16.866942+0000","last_clean":"2024-05-08T06:43:16.866942+0000","last_became_active":"2024-05-08T06:41:09.581067+0000","last_became_peered":"2024-05-08T06:41:09.581067+0000","last_unstale":"2024-05-08T06:43:16.866942+0000","last_undegraded":"2024-05-08T06:43:16.866942+0000","last_fullsized":"2024-05-08T06:43:16.866942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:26.967371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.960640+0000","last_change":"2024-05-08T06:43:16.960640+0000","last_active":"2024-05-08T06:43:16.960640+0000","last_peered":"2024-05-08T06:43:16.960640+0000","last_clean":"2024-05-08T06:43:16.960640+0000","last_became_active":"2024-05-08T06:43:16.959541+0000","last_became_peered":"2024-05-08T06:43:16.959541+0000","last_unstale":"2024-05-08T06:43:16.960640+0000","last_undegraded":"2024-05-08T06:43:16.960640+0000","last_fullsized":"2024-05-08T06:43:16.960640+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:42.070321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878061+0000","last_change":"2024-05-08T06:41:24.665142+0000","last_active":"2024-05-08T06:43:16.878061+0000","last_peered":"2024-05-08T06:43:16.878061+0000","last_clean":"2024-05-08T06:43:16.878061+0000","last_became_active":"2024-05-08T06:41:24.664431+0000","last_became_peered":"2024-05-08T06:41:24.664431+0000","last_unstale":"2024-05-08T06:43:16.878061+0000","last_undegraded":"2024-05-08T06:43:16.878061+0000","last_fullsized":"2024-05-08T06:43:16.878061+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:11:08.511550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.867152+0000","last_change":"2024-05-08T06:41:05.503245+0000","last_active":"2024-05-08T06:43:16.867152+0000","last_peered":"2024-05-08T06:43:16.867152+0000","last_clean":"2024-05-08T06:43:16.867152+0000","last_became_active":"2024-05-08T06:41:05.502561+0000","last_became_peered":"2024-05-08T06:41:05.502561+0000","last_unstale":"2024-05-08T06:43:16.867152+0000","last_undegraded":"2024-05-08T06:43:16.867152+0000","last_fullsized":"2024-05-08T06:43:16.867152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:06.169830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885196+0000","last_change":"2024-05-08T06:41:09.579703+0000","last_active":"2024-05-08T06:43:16.885196+0000","last_peered":"2024-05-08T06:43:16.885196+0000","last_clean":"2024-05-08T06:43:16.885196+0000","last_became_active":"2024-05-08T06:41:09.579332+0000","last_became_peered":"2024-05-08T06:41:09.579332+0000","last_unstale":"2024-05-08T06:43:16.885196+0000","last_undegraded":"2024-05-08T06:43:16.885196+0000","last_fullsized":"2024-05-08T06:43:16.885196+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:08.616722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.869415+0000","last_change":"2024-05-08T06:41:24.666322+0000","last_active":"2024-05-08T06:43:16.869415+0000","last_peered":"2024-05-08T06:43:16.869415+0000","last_clean":"2024-05-08T06:43:16.869415+0000","last_became_active":"2024-05-08T06:41:24.664647+0000","last_became_peered":"2024-05-08T06:41:24.664647+0000","last_unstale":"2024-05-08T06:43:16.869415+0000","last_undegraded":"2024-05-08T06:43:16.869415+0000","last_fullsized":"2024-05-08T06:43:16.869415+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:56.967066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885459+0000","last_change":"2024-05-08T06:41:06.149339+0000","last_active":"2024-05-08T06:43:16.885459+0000","last_peered":"2024-05-08T06:43:16.885459+0000","last_clean":"2024-05-08T06:43:16.885459+0000","last_became_active":"2024-05-08T06:41:06.148846+0000","last_became_peered":"2024-05-08T06:41:06.148846+0000","last_unstale":"2024-05-08T06:43:16.885459+0000","last_undegraded":"2024-05-08T06:43:16.885459+0000","last_fullsized":"2024-05-08T06:43:16.885459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:59.291206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874979+0000","last_change":"2024-05-08T06:41:09.581776+0000","last_active":"2024-05-08T06:43:16.874979+0000","last_peered":"2024-05-08T06:43:16.874979+0000","last_clean":"2024-05-08T06:43:16.874979+0000","last_became_active":"2024-05-08T06:41:09.581409+0000","last_became_peered":"2024-05-08T06:41:09.581409+0000","last_unstale":"2024-05-08T06:43:16.874979+0000","last_undegraded":"2024-05-08T06:43:16.874979+0000","last_fullsized":"2024-05-08T06:43:16.874979+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:30.323812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870051+0000","last_change":"2024-05-08T06:42:16.255655+0000","last_active":"2024-05-08T06:43:16.870051+0000","last_peered":"2024-05-08T06:43:16.870051+0000","last_clean":"2024-05-08T06:43:16.870051+0000","last_became_active":"2024-05-08T06:42:16.253722+0000","last_became_peered":"2024-05-08T06:42:16.253722+0000","last_unstale":"2024-05-08T06:43:16.870051+0000","last_undegraded":"2024-05-08T06:43:16.870051+0000","last_fullsized":"2024-05-08T06:43:16.870051+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:58.492286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873612+0000","last_change":"2024-05-08T06:41:05.509738+0000","last_active":"2024-05-08T06:43:16.873612+0000","last_peered":"2024-05-08T06:43:16.873612+0000","last_clean":"2024-05-08T06:43:16.873612+0000","last_became_active":"2024-05-08T06:41:05.509198+0000","last_became_peered":"2024-05-08T06:41:05.509198+0000","last_unstale":"2024-05-08T06:43:16.873612+0000","last_undegraded":"2024-05-08T06:43:16.873612+0000","last_fullsized":"2024-05-08T06:43:16.873612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:51.350637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130380+0000","last_change":"2024-05-08T06:41:09.572288+0000","last_active":"2024-05-08T06:43:17.130380+0000","last_peered":"2024-05-08T06:43:17.130380+0000","last_clean":"2024-05-08T06:43:17.130380+0000","last_became_active":"2024-05-08T06:41:09.571951+0000","last_became_peered":"2024-05-08T06:41:09.571951+0000","last_unstale":"2024-05-08T06:43:17.130380+0000","last_undegraded":"2024-05-08T06:43:17.130380+0000","last_fullsized":"2024-05-08T06:43:17.130380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:45.687494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.869888+0000","last_change":"2024-05-08T06:41:24.663289+0000","last_active":"2024-05-08T06:43:16.869888+0000","last_peered":"2024-05-08T06:43:16.869888+0000","last_clean":"2024-05-08T06:43:16.869888+0000","last_became_active":"2024-05-08T06:41:24.662899+0000","last_became_peered":"2024-05-08T06:41:24.662899+0000","last_unstale":"2024-05-08T06:43:16.869888+0000","last_undegraded":"2024-05-08T06:43:16.869888+0000","last_fullsized":"2024-05-08T06:43:16.869888+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:15.024693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.872979+0000","last_change":"2024-05-08T06:41:05.505412+0000","last_active":"2024-05-08T06:43:16.872979+0000","last_peered":"2024-05-08T06:43:16.872979+0000","last_clean":"2024-05-08T06:43:16.872979+0000","last_became_active":"2024-05-08T06:41:05.505023+0000","last_became_peered":"2024-05-08T06:41:05.505023+0000","last_unstale":"2024-05-08T06:43:16.872979+0000","last_undegraded":"2024-05-08T06:43:16.872979+0000","last_fullsized":"2024-05-08T06:43:16.872979+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:50.403045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130102+0000","last_change":"2024-05-08T06:41:09.571080+0000","last_active":"2024-05-08T06:43:17.130102+0000","last_peered":"2024-05-08T06:43:17.130102+0000","last_clean":"2024-05-08T06:43:17.130102+0000","last_became_active":"2024-05-08T06:41:09.570755+0000","last_became_peered":"2024-05-08T06:41:09.570755+0000","last_unstale":"2024-05-08T06:43:17.130102+0000","last_undegraded":"2024-05-08T06:43:17.130102+0000","last_fullsized":"2024-05-08T06:43:17.130102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:38:53.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877817+0000","last_change":"2024-05-08T06:41:24.660091+0000","last_active":"2024-05-08T06:43:16.877817+0000","last_peered":"2024-05-08T06:43:16.877817+0000","last_clean":"2024-05-08T06:43:16.877817+0000","last_became_active":"2024-05-08T06:41:24.659512+0000","last_became_peered":"2024-05-08T06:41:24.659512+0000","last_unstale":"2024-05-08T06:43:16.877817+0000","last_undegraded":"2024-05-08T06:43:16.877817+0000","last_fullsized":"2024-05-08T06:43:16.877817+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:07:56.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":91,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:22.399800+0000","last_change":"2024-05-08T06:41:05.500625+0000","last_active":"2024-05-08T06:43:22.399800+0000","last_peered":"2024-05-08T06:43:22.399800+0000","last_clean":"2024-05-08T06:43:22.399800+0000","last_became_active":"2024-05-08T06:41:05.500079+0000","last_became_peered":"2024-05-08T06:41:05.500079+0000","last_unstale":"2024-05-08T06:43:22.399800+0000","last_undegraded":"2024-05-08T06:43:22.399800+0000","last_fullsized":"2024-05-08T06:43:22.399800+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:32.143944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871638+0000","last_change":"2024-05-08T06:41:09.569045+0000","last_active":"2024-05-08T06:43:16.871638+0000","last_peered":"2024-05-08T06:43:16.871638+0000","last_clean":"2024-05-08T06:43:16.871638+0000","last_became_active":"2024-05-08T06:41:09.560040+0000","last_became_peered":"2024-05-08T06:41:09.560040+0000","last_unstale":"2024-05-08T06:43:16.871638+0000","last_undegraded":"2024-05-08T06:43:16.871638+0000","last_fullsized":"2024-05-08T06:43:16.871638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:58:52.284829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876739+0000","last_change":"2024-05-08T06:42:15.856574+0000","last_active":"2024-05-08T06:43:16.876739+0000","last_peered":"2024-05-08T06:43:16.876739+0000","last_clean":"2024-05-08T06:43:16.876739+0000","last_became_active":"2024-05-08T06:42:15.855459+0000","last_became_peered":"2024-05-08T06:42:15.855459+0000","last_unstale":"2024-05-08T06:43:16.876739+0000","last_undegraded":"2024-05-08T06:43:16.876739+0000","last_fullsized":"2024-05-08T06:43:16.876739+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:23:12.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.131775+0000","last_change":"2024-05-08T06:41:05.505685+0000","last_active":"2024-05-08T06:43:17.131775+0000","last_peered":"2024-05-08T06:43:17.131775+0000","last_clean":"2024-05-08T06:43:17.131775+0000","last_became_active":"2024-05-08T06:41:05.505136+0000","last_became_peered":"2024-05-08T06:41:05.505136+0000","last_unstale":"2024-05-08T06:43:17.131775+0000","last_undegraded":"2024-05-08T06:43:17.131775+0000","last_fullsized":"2024-05-08T06:43:17.131775+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:59.968405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130572+0000","last_change":"2024-05-08T06:41:09.581340+0000","last_active":"2024-05-08T06:43:17.130572+0000","last_peered":"2024-05-08T06:43:17.130572+0000","last_clean":"2024-05-08T06:43:17.130572+0000","last_became_active":"2024-05-08T06:41:09.580969+0000","last_became_peered":"2024-05-08T06:41:09.580969+0000","last_unstale":"2024-05-08T06:43:17.130572+0000","last_undegraded":"2024-05-08T06:43:17.130572+0000","last_fullsized":"2024-05-08T06:43:17.130572+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:14.365972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.882767+0000","last_change":"2024-05-08T06:41:24.675576+0000","last_active":"2024-05-08T06:43:16.882767+0000","last_peered":"2024-05-08T06:43:16.882767+0000","last_clean":"2024-05-08T06:43:16.882767+0000","last_became_active":"2024-05-08T06:41:24.675044+0000","last_became_peered":"2024-05-08T06:41:24.675044+0000","last_unstale":"2024-05-08T06:43:16.882767+0000","last_undegraded":"2024-05-08T06:43:16.882767+0000","last_fullsized":"2024-05-08T06:43:16.882767+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:59.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956156+0000","last_change":"2024-05-08T06:41:05.493094+0000","last_active":"2024-05-08T06:43:16.956156+0000","last_peered":"2024-05-08T06:43:16.956156+0000","last_clean":"2024-05-08T06:43:16.956156+0000","last_became_active":"2024-05-08T06:41:05.491206+0000","last_became_peered":"2024-05-08T06:41:05.491206+0000","last_unstale":"2024-05-08T06:43:16.956156+0000","last_undegraded":"2024-05-08T06:43:16.956156+0000","last_fullsized":"2024-05-08T06:43:16.956156+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:03.689282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884482+0000","last_change":"2024-05-08T06:41:09.570646+0000","last_active":"2024-05-08T06:43:16.884482+0000","last_peered":"2024-05-08T06:43:16.884482+0000","last_clean":"2024-05-08T06:43:16.884482+0000","last_became_active":"2024-05-08T06:41:09.569500+0000","last_became_peered":"2024-05-08T06:41:09.569500+0000","last_unstale":"2024-05-08T06:43:16.884482+0000","last_undegraded":"2024-05-08T06:43:16.884482+0000","last_fullsized":"2024-05-08T06:43:16.884482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:25:08.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874957+0000","last_change":"2024-05-08T06:41:24.672021+0000","last_active":"2024-05-08T06:43:16.874957+0000","last_peered":"2024-05-08T06:43:16.874957+0000","last_clean":"2024-05-08T06:43:16.874957+0000","last_became_active":"2024-05-08T06:41:24.671583+0000","last_became_peered":"2024-05-08T06:41:24.671583+0000","last_unstale":"2024-05-08T06:43:16.874957+0000","last_undegraded":"2024-05-08T06:43:16.874957+0000","last_fullsized":"2024-05-08T06:43:16.874957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:33.850855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129307+0000","last_change":"2024-05-08T06:41:05.501501+0000","last_active":"2024-05-08T06:43:17.129307+0000","last_peered":"2024-05-08T06:43:17.129307+0000","last_clean":"2024-05-08T06:43:17.129307+0000","last_became_active":"2024-05-08T06:41:05.501001+0000","last_became_peered":"2024-05-08T06:41:05.501001+0000","last_unstale":"2024-05-08T06:43:17.129307+0000","last_undegraded":"2024-05-08T06:43:17.129307+0000","last_fullsized":"2024-05-08T06:43:17.129307+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:15:18.984981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.865869+0000","last_change":"2024-05-08T06:42:15.859096+0000","last_active":"2024-05-08T06:43:16.865869+0000","last_peered":"2024-05-08T06:43:16.865869+0000","last_clean":"2024-05-08T06:43:16.865869+0000","last_became_active":"2024-05-08T06:42:15.858508+0000","last_became_peered":"2024-05-08T06:42:15.858508+0000","last_unstale":"2024-05-08T06:43:16.865869+0000","last_undegraded":"2024-05-08T06:43:16.865869+0000","last_fullsized":"2024-05-08T06:43:16.865869+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:24.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884682+0000","last_change":"2024-05-08T06:41:24.670832+0000","last_active":"2024-05-08T06:43:16.884682+0000","last_peered":"2024-05-08T06:43:16.884682+0000","last_clean":"2024-05-08T06:43:16.884682+0000","last_became_active":"2024-05-08T06:41:24.668155+0000","last_became_peered":"2024-05-08T06:41:24.668155+0000","last_unstale":"2024-05-08T06:43:16.884682+0000","last_undegraded":"2024-05-08T06:43:16.884682+0000","last_fullsized":"2024-05-08T06:43:16.884682+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:11.460490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":83,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:18.386652+0000","last_change":"2024-05-08T06:41:05.494999+0000","last_active":"2024-05-08T06:43:18.386652+0000","last_peered":"2024-05-08T06:43:18.386652+0000","last_clean":"2024-05-08T06:43:18.386652+0000","last_became_active":"2024-05-08T06:41:05.494487+0000","last_became_peered":"2024-05-08T06:41:05.494487+0000","last_unstale":"2024-05-08T06:43:18.386652+0000","last_undegraded":"2024-05-08T06:43:18.386652+0000","last_fullsized":"2024-05-08T06:43:18.386652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:59.282625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.132276+0000","last_change":"2024-05-08T06:41:09.570607+0000","last_active":"2024-05-08T06:43:17.132276+0000","last_peered":"2024-05-08T06:43:17.132276+0000","last_clean":"2024-05-08T06:43:17.132276+0000","last_became_active":"2024-05-08T06:41:09.570047+0000","last_became_peered":"2024-05-08T06:41:09.570047+0000","last_unstale":"2024-05-08T06:43:17.132276+0000","last_undegraded":"2024-05-08T06:43:17.132276+0000","last_fullsized":"2024-05-08T06:43:17.132276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:51.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.865621+0000","last_change":"2024-05-08T06:41:24.677365+0000","last_active":"2024-05-08T06:43:16.865621+0000","last_peered":"2024-05-08T06:43:16.865621+0000","last_clean":"2024-05-08T06:43:16.865621+0000","last_became_active":"2024-05-08T06:41:24.673986+0000","last_became_peered":"2024-05-08T06:41:24.673986+0000","last_unstale":"2024-05-08T06:43:16.865621+0000","last_undegraded":"2024-05-08T06:43:16.865621+0000","last_fullsized":"2024-05-08T06:43:16.865621+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:07.013637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879269+0000","last_change":"2024-05-08T06:41:05.499624+0000","last_active":"2024-05-08T06:43:16.879269+0000","last_peered":"2024-05-08T06:43:16.879269+0000","last_clean":"2024-05-08T06:43:16.879269+0000","last_became_active":"2024-05-08T06:41:05.498875+0000","last_became_peered":"2024-05-08T06:41:05.498875+0000","last_unstale":"2024-05-08T06:43:16.879269+0000","last_undegraded":"2024-05-08T06:43:16.879269+0000","last_fullsized":"2024-05-08T06:43:16.879269+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:46:11.270399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.875026+0000","last_change":"2024-05-08T06:42:15.853569+0000","last_active":"2024-05-08T06:43:16.875026+0000","last_peered":"2024-05-08T06:43:16.875026+0000","last_clean":"2024-05-08T06:43:16.875026+0000","last_became_active":"2024-05-08T06:42:15.852223+0000","last_became_peered":"2024-05-08T06:42:15.852223+0000","last_unstale":"2024-05-08T06:43:16.875026+0000","last_undegraded":"2024-05-08T06:43:16.875026+0000","last_fullsized":"2024-05-08T06:43:16.875026+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:56.970134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870395+0000","last_change":"2024-05-08T06:41:24.671807+0000","last_active":"2024-05-08T06:43:16.870395+0000","last_peered":"2024-05-08T06:43:16.870395+0000","last_clean":"2024-05-08T06:43:16.870395+0000","last_became_active":"2024-05-08T06:41:24.670937+0000","last_became_peered":"2024-05-08T06:41:24.670937+0000","last_unstale":"2024-05-08T06:43:16.870395+0000","last_undegraded":"2024-05-08T06:43:16.870395+0000","last_fullsized":"2024-05-08T06:43:16.870395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:52.844916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129712+0000","last_change":"2024-05-08T06:41:06.147901+0000","last_active":"2024-05-08T06:43:17.129712+0000","last_peered":"2024-05-08T06:43:17.129712+0000","last_clean":"2024-05-08T06:43:17.129712+0000","last_became_active":"2024-05-08T06:41:06.146983+0000","last_became_peered":"2024-05-08T06:41:06.146983+0000","last_unstale":"2024-05-08T06:43:17.129712+0000","last_undegraded":"2024-05-08T06:43:17.129712+0000","last_fullsized":"2024-05-08T06:43:17.129712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:54.638290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.131159+0000","last_change":"2024-05-08T06:41:09.586695+0000","last_active":"2024-05-08T06:43:17.131159+0000","last_peered":"2024-05-08T06:43:17.131159+0000","last_clean":"2024-05-08T06:43:17.131159+0000","last_became_active":"2024-05-08T06:41:09.586288+0000","last_became_peered":"2024-05-08T06:41:09.586288+0000","last_unstale":"2024-05-08T06:43:17.131159+0000","last_undegraded":"2024-05-08T06:43:17.131159+0000","last_fullsized":"2024-05-08T06:43:17.131159+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:18.383524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866091+0000","last_change":"2024-05-08T06:41:24.671523+0000","last_active":"2024-05-08T06:43:16.866091+0000","last_peered":"2024-05-08T06:43:16.866091+0000","last_clean":"2024-05-08T06:43:16.866091+0000","last_became_active":"2024-05-08T06:41:24.670307+0000","last_became_peered":"2024-05-08T06:41:24.670307+0000","last_unstale":"2024-05-08T06:43:16.866091+0000","last_undegraded":"2024-05-08T06:43:16.866091+0000","last_fullsized":"2024-05-08T06:43:16.866091+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.034208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"90'34","reported_seq":160,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:19.400610+0000","last_change":"2024-05-08T06:41:05.504643+0000","last_active":"2024-05-08T06:43:19.400610+0000","last_peered":"2024-05-08T06:43:19.400610+0000","last_clean":"2024-05-08T06:43:19.400610+0000","last_became_active":"2024-05-08T06:41:05.504011+0000","last_became_peered":"2024-05-08T06:41:05.504011+0000","last_unstale":"2024-05-08T06:43:19.400610+0000","last_undegraded":"2024-05-08T06:43:19.400610+0000","last_fullsized":"2024-05-08T06:43:19.400610+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:47.262643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67092,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":83,"num_read_kb":108,"num_write":35,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.872392+0000","last_change":"2024-05-08T06:41:09.580532+0000","last_active":"2024-05-08T06:43:16.872392+0000","last_peered":"2024-05-08T06:43:16.872392+0000","last_clean":"2024-05-08T06:43:16.872392+0000","last_became_active":"2024-05-08T06:41:09.575396+0000","last_became_peered":"2024-05-08T06:41:09.575396+0000","last_unstale":"2024-05-08T06:43:16.872392+0000","last_undegraded":"2024-05-08T06:43:16.872392+0000","last_fullsized":"2024-05-08T06:43:16.872392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:29.197093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130551+0000","last_change":"2024-05-08T06:41:24.660200+0000","last_active":"2024-05-08T06:43:17.130551+0000","last_peered":"2024-05-08T06:43:17.130551+0000","last_clean":"2024-05-08T06:43:17.130551+0000","last_became_active":"2024-05-08T06:41:24.659674+0000","last_became_peered":"2024-05-08T06:41:24.659674+0000","last_unstale":"2024-05-08T06:43:17.130551+0000","last_undegraded":"2024-05-08T06:43:17.130551+0000","last_fullsized":"2024-05-08T06:43:17.130551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:51.023256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877143+0000","last_change":"2024-05-08T06:41:05.500899+0000","last_active":"2024-05-08T06:43:16.877143+0000","last_peered":"2024-05-08T06:43:16.877143+0000","last_clean":"2024-05-08T06:43:16.877143+0000","last_became_active":"2024-05-08T06:41:05.500437+0000","last_became_peered":"2024-05-08T06:41:05.500437+0000","last_unstale":"2024-05-08T06:43:16.877143+0000","last_undegraded":"2024-05-08T06:43:16.877143+0000","last_fullsized":"2024-05-08T06:43:16.877143+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:38.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956054+0000","last_change":"2024-05-08T06:41:09.574273+0000","last_active":"2024-05-08T06:43:16.956054+0000","last_peered":"2024-05-08T06:43:16.956054+0000","last_clean":"2024-05-08T06:43:16.956054+0000","last_became_active":"2024-05-08T06:41:09.573902+0000","last_became_peered":"2024-05-08T06:41:09.573902+0000","last_unstale":"2024-05-08T06:43:16.956054+0000","last_undegraded":"2024-05-08T06:43:16.956054+0000","last_fullsized":"2024-05-08T06:43:16.956054+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:39:12.749290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.881989+0000","last_change":"2024-05-08T06:41:24.674360+0000","last_active":"2024-05-08T06:43:16.881989+0000","last_peered":"2024-05-08T06:43:16.881989+0000","last_clean":"2024-05-08T06:43:16.881989+0000","last_became_active":"2024-05-08T06:41:24.673938+0000","last_became_peered":"2024-05-08T06:41:24.673938+0000","last_unstale":"2024-05-08T06:43:16.881989+0000","last_undegraded":"2024-05-08T06:43:16.881989+0000","last_fullsized":"2024-05-08T06:43:16.881989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:13:36.735220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129755+0000","last_change":"2024-05-08T06:41:05.504335+0000","last_active":"2024-05-08T06:43:17.129755+0000","last_peered":"2024-05-08T06:43:17.129755+0000","last_clean":"2024-05-08T06:43:17.129755+0000","last_became_active":"2024-05-08T06:41:05.503981+0000","last_became_peered":"2024-05-08T06:41:05.503981+0000","last_unstale":"2024-05-08T06:43:17.129755+0000","last_undegraded":"2024-05-08T06:43:17.129755+0000","last_fullsized":"2024-05-08T06:43:17.129755+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:45:35.813245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879072+0000","last_change":"2024-05-08T06:41:09.580852+0000","last_active":"2024-05-08T06:43:16.879072+0000","last_peered":"2024-05-08T06:43:16.879072+0000","last_clean":"2024-05-08T06:43:16.879072+0000","last_became_active":"2024-05-08T06:41:09.580375+0000","last_became_peered":"2024-05-08T06:41:09.580375+0000","last_unstale":"2024-05-08T06:43:16.879072+0000","last_undegraded":"2024-05-08T06:43:16.879072+0000","last_fullsized":"2024-05-08T06:43:16.879072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:21:06.695878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866676+0000","last_change":"2024-05-08T06:41:24.678268+0000","last_active":"2024-05-08T06:43:16.866676+0000","last_peered":"2024-05-08T06:43:16.866676+0000","last_clean":"2024-05-08T06:43:16.866676+0000","last_became_active":"2024-05-08T06:41:24.677804+0000","last_became_peered":"2024-05-08T06:41:24.677804+0000","last_unstale":"2024-05-08T06:43:16.866676+0000","last_undegraded":"2024-05-08T06:43:16.866676+0000","last_fullsized":"2024-05-08T06:43:16.866676+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:03.082661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":92,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:22.406195+0000","last_change":"2024-05-08T06:41:05.498143+0000","last_active":"2024-05-08T06:43:22.406195+0000","last_peered":"2024-05-08T06:43:22.406195+0000","last_clean":"2024-05-08T06:43:22.406195+0000","last_became_active":"2024-05-08T06:41:05.497707+0000","last_became_peered":"2024-05-08T06:41:05.497707+0000","last_unstale":"2024-05-08T06:43:22.406195+0000","last_undegraded":"2024-05-08T06:43:22.406195+0000","last_fullsized":"2024-05-08T06:43:22.406195+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:20.556535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":45,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.135955+0000","last_change":"2024-05-08T06:43:17.135955+0000","last_active":"2024-05-08T06:43:17.135955+0000","last_peered":"2024-05-08T06:43:17.135955+0000","last_clean":"2024-05-08T06:43:17.135955+0000","last_became_active":"2024-05-08T06:43:17.134734+0000","last_became_peered":"2024-05-08T06:43:17.134734+0000","last_unstale":"2024-05-08T06:43:17.135955+0000","last_undegraded":"2024-05-08T06:43:17.135955+0000","last_fullsized":"2024-05-08T06:43:17.135955+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:33:53.573382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957630+0000","last_change":"2024-05-08T06:41:24.663938+0000","last_active":"2024-05-08T06:43:16.957630+0000","last_peered":"2024-05-08T06:43:16.957630+0000","last_clean":"2024-05-08T06:43:16.957630+0000","last_became_active":"2024-05-08T06:41:24.661679+0000","last_became_peered":"2024-05-08T06:41:24.661679+0000","last_unstale":"2024-05-08T06:43:16.957630+0000","last_undegraded":"2024-05-08T06:43:16.957630+0000","last_fullsized":"2024-05-08T06:43:16.957630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:21.590681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":59,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871288+0000","last_change":"2024-05-08T06:41:06.151458+0000","last_active":"2024-05-08T06:43:16.871288+0000","last_peered":"2024-05-08T06:43:16.871288+0000","last_clean":"2024-05-08T06:43:16.871288+0000","last_became_active":"2024-05-08T06:41:06.146564+0000","last_became_peered":"2024-05-08T06:41:06.146564+0000","last_unstale":"2024-05-08T06:43:16.871288+0000","last_undegraded":"2024-05-08T06:43:16.871288+0000","last_fullsized":"2024-05-08T06:43:16.871288+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:36.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129351+0000","last_change":"2024-05-08T06:41:09.576666+0000","last_active":"2024-05-08T06:43:17.129351+0000","last_peered":"2024-05-08T06:43:17.129351+0000","last_clean":"2024-05-08T06:43:17.129351+0000","last_became_active":"2024-05-08T06:41:09.576062+0000","last_became_peered":"2024-05-08T06:41:09.576062+0000","last_unstale":"2024-05-08T06:43:17.129351+0000","last_undegraded":"2024-05-08T06:43:17.129351+0000","last_fullsized":"2024-05-08T06:43:17.129351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:21.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130125+0000","last_change":"2024-05-08T06:42:16.255227+0000","last_active":"2024-05-08T06:43:17.130125+0000","last_peered":"2024-05-08T06:43:17.130125+0000","last_clean":"2024-05-08T06:43:17.130125+0000","last_became_active":"2024-05-08T06:42:16.253021+0000","last_became_peered":"2024-05-08T06:42:16.253021+0000","last_unstale":"2024-05-08T06:43:17.130125+0000","last_undegraded":"2024-05-08T06:43:17.130125+0000","last_fullsized":"2024-05-08T06:43:17.130125+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:29:41.833171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873376+0000","last_change":"2024-05-08T06:41:05.506830+0000","last_active":"2024-05-08T06:43:16.873376+0000","last_peered":"2024-05-08T06:43:16.873376+0000","last_clean":"2024-05-08T06:43:16.873376+0000","last_became_active":"2024-05-08T06:41:05.505402+0000","last_became_peered":"2024-05-08T06:41:05.505402+0000","last_unstale":"2024-05-08T06:43:16.873376+0000","last_undegraded":"2024-05-08T06:43:16.873376+0000","last_fullsized":"2024-05-08T06:43:16.873376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:26.804268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.881143+0000","last_change":"2024-05-08T06:41:09.586937+0000","last_active":"2024-05-08T06:43:16.881143+0000","last_peered":"2024-05-08T06:43:16.881143+0000","last_clean":"2024-05-08T06:43:16.881143+0000","last_became_active":"2024-05-08T06:41:09.586443+0000","last_became_peered":"2024-05-08T06:41:09.586443+0000","last_unstale":"2024-05-08T06:43:16.881143+0000","last_undegraded":"2024-05-08T06:43:16.881143+0000","last_fullsized":"2024-05-08T06:43:16.881143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:49.004676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":35,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871404+0000","last_change":"2024-05-08T06:42:16.042874+0000","last_active":"2024-05-08T06:43:16.871404+0000","last_peered":"2024-05-08T06:43:16.871404+0000","last_clean":"2024-05-08T06:43:16.871404+0000","last_became_active":"2024-05-08T06:42:16.041424+0000","last_became_peered":"2024-05-08T06:42:16.041424+0000","last_unstale":"2024-05-08T06:43:16.871404+0000","last_undegraded":"2024-05-08T06:43:16.871404+0000","last_fullsized":"2024-05-08T06:43:16.871404+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:47.162238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866349+0000","last_change":"2024-05-08T06:41:06.146631+0000","last_active":"2024-05-08T06:43:16.866349+0000","last_peered":"2024-05-08T06:43:16.866349+0000","last_clean":"2024-05-08T06:43:16.866349+0000","last_became_active":"2024-05-08T06:41:06.145876+0000","last_became_peered":"2024-05-08T06:41:06.145876+0000","last_unstale":"2024-05-08T06:43:16.866349+0000","last_undegraded":"2024-05-08T06:43:16.866349+0000","last_fullsized":"2024-05-08T06:43:16.866349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:46.283923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.133072+0000","last_change":"2024-05-08T06:41:09.571084+0000","last_active":"2024-05-08T06:43:17.133072+0000","last_peered":"2024-05-08T06:43:17.133072+0000","last_clean":"2024-05-08T06:43:17.133072+0000","last_became_active":"2024-05-08T06:41:09.570685+0000","last_became_peered":"2024-05-08T06:41:09.570685+0000","last_unstale":"2024-05-08T06:43:17.133072+0000","last_undegraded":"2024-05-08T06:43:17.133072+0000","last_fullsized":"2024-05-08T06:43:17.133072+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:02:21.748502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956837+0000","last_change":"2024-05-08T06:41:24.667348+0000","last_active":"2024-05-08T06:43:16.956837+0000","last_peered":"2024-05-08T06:43:16.956837+0000","last_clean":"2024-05-08T06:43:16.956837+0000","last_became_active":"2024-05-08T06:41:24.662570+0000","last_became_peered":"2024-05-08T06:41:24.662570+0000","last_unstale":"2024-05-08T06:43:16.956837+0000","last_undegraded":"2024-05-08T06:43:16.956837+0000","last_fullsized":"2024-05-08T06:43:16.956837+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:05.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878557+0000","last_change":"2024-05-08T06:41:05.501884+0000","last_active":"2024-05-08T06:43:16.878557+0000","last_peered":"2024-05-08T06:43:16.878557+0000","last_clean":"2024-05-08T06:43:16.878557+0000","last_became_active":"2024-05-08T06:41:05.498866+0000","last_became_peered":"2024-05-08T06:41:05.498866+0000","last_unstale":"2024-05-08T06:43:16.878557+0000","last_undegraded":"2024-05-08T06:43:16.878557+0000","last_fullsized":"2024-05-08T06:43:16.878557+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:50.560695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.132568+0000","last_change":"2024-05-08T06:41:09.582601+0000","last_active":"2024-05-08T06:43:17.132568+0000","last_peered":"2024-05-08T06:43:17.132568+0000","last_clean":"2024-05-08T06:43:17.132568+0000","last_became_active":"2024-05-08T06:41:09.582205+0000","last_became_peered":"2024-05-08T06:41:09.582205+0000","last_unstale":"2024-05-08T06:43:17.132568+0000","last_undegraded":"2024-05-08T06:43:17.132568+0000","last_fullsized":"2024-05-08T06:43:17.132568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:29.594001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957491+0000","last_change":"2024-05-08T06:41:24.659339+0000","last_active":"2024-05-08T06:43:16.957491+0000","last_peered":"2024-05-08T06:43:16.957491+0000","last_clean":"2024-05-08T06:43:16.957491+0000","last_became_active":"2024-05-08T06:41:24.658879+0000","last_became_peered":"2024-05-08T06:41:24.658879+0000","last_unstale":"2024-05-08T06:43:16.957491+0000","last_undegraded":"2024-05-08T06:43:16.957491+0000","last_fullsized":"2024-05-08T06:43:16.957491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:59.257118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129943+0000","last_change":"2024-05-08T06:42:15.850510+0000","last_active":"2024-05-08T06:43:17.129943+0000","last_peered":"2024-05-08T06:43:17.129943+0000","last_clean":"2024-05-08T06:43:17.129943+0000","last_became_active":"2024-05-08T06:42:15.849158+0000","last_became_peered":"2024-05-08T06:42:15.849158+0000","last_unstale":"2024-05-08T06:43:17.129943+0000","last_undegraded":"2024-05-08T06:43:17.129943+0000","last_fullsized":"2024-05-08T06:43:17.129943+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:14.687642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'4","reported_seq":90,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:22.404699+0000","last_change":"2024-05-08T06:41:06.148436+0000","last_active":"2024-05-08T06:43:22.404699+0000","last_peered":"2024-05-08T06:43:22.404699+0000","last_clean":"2024-05-08T06:43:22.404699+0000","last_became_active":"2024-05-08T06:41:06.147690+0000","last_became_peered":"2024-05-08T06:41:06.147690+0000","last_unstale":"2024-05-08T06:43:22.404699+0000","last_undegraded":"2024-05-08T06:43:22.404699+0000","last_fullsized":"2024-05-08T06:43:22.404699+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:49.925872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879134+0000","last_change":"2024-05-08T06:41:24.667958+0000","last_active":"2024-05-08T06:43:16.879134+0000","last_peered":"2024-05-08T06:43:16.879134+0000","last_clean":"2024-05-08T06:43:16.879134+0000","last_became_active":"2024-05-08T06:41:24.666181+0000","last_became_peered":"2024-05-08T06:41:24.666181+0000","last_unstale":"2024-05-08T06:43:16.879134+0000","last_undegraded":"2024-05-08T06:43:16.879134+0000","last_fullsized":"2024-05-08T06:43:16.879134+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:08.413670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884755+0000","last_change":"2024-05-08T06:41:09.581353+0000","last_active":"2024-05-08T06:43:16.884755+0000","last_peered":"2024-05-08T06:43:16.884755+0000","last_clean":"2024-05-08T06:43:16.884755+0000","last_became_active":"2024-05-08T06:41:09.580630+0000","last_became_peered":"2024-05-08T06:41:09.580630+0000","last_unstale":"2024-05-08T06:43:16.884755+0000","last_undegraded":"2024-05-08T06:43:16.884755+0000","last_fullsized":"2024-05-08T06:43:16.884755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:07.041564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870064+0000","last_change":"2024-05-08T06:41:05.494128+0000","last_active":"2024-05-08T06:43:16.870064+0000","last_peered":"2024-05-08T06:43:16.870064+0000","last_clean":"2024-05-08T06:43:16.870064+0000","last_became_active":"2024-05-08T06:41:05.493473+0000","last_became_peered":"2024-05-08T06:41:05.493473+0000","last_unstale":"2024-05-08T06:43:16.870064+0000","last_undegraded":"2024-05-08T06:43:16.870064+0000","last_fullsized":"2024-05-08T06:43:16.870064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:01:51.061204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":117,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878084+0000","last_change":"2024-05-08T06:39:12.054195+0000","last_active":"2024-05-08T06:43:16.878084+0000","last_peered":"2024-05-08T06:43:16.878084+0000","last_clean":"2024-05-08T06:43:16.878084+0000","last_became_active":"2024-05-08T06:39:12.045198+0000","last_became_peered":"2024-05-08T06:39:12.045198+0000","last_unstale":"2024-05-08T06:43:16.878084+0000","last_undegraded":"2024-05-08T06:43:16.878084+0000","last_fullsized":"2024-05-08T06:43:16.878084+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_clean_scrub_stamp":"2024-05-08T06:34:30.391671+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:32:48.631167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130363+0000","last_change":"2024-05-08T06:41:24.663009+0000","last_active":"2024-05-08T06:43:17.130363+0000","last_peered":"2024-05-08T06:43:17.130363+0000","last_clean":"2024-05-08T06:43:17.130363+0000","last_became_active":"2024-05-08T06:41:24.662552+0000","last_became_peered":"2024-05-08T06:41:24.662552+0000","last_unstale":"2024-05-08T06:43:17.130363+0000","last_undegraded":"2024-05-08T06:43:17.130363+0000","last_fullsized":"2024-05-08T06:43:17.130363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:57:12.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.955824+0000","last_change":"2024-05-08T06:41:09.576425+0000","last_active":"2024-05-08T06:43:16.955824+0000","last_peered":"2024-05-08T06:43:16.955824+0000","last_clean":"2024-05-08T06:43:16.955824+0000","last_became_active":"2024-05-08T06:41:09.576094+0000","last_became_peered":"2024-05-08T06:41:09.576094+0000","last_unstale":"2024-05-08T06:43:16.955824+0000","last_undegraded":"2024-05-08T06:43:16.955824+0000","last_fullsized":"2024-05-08T06:43:16.955824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:40.682429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878467+0000","last_change":"2024-05-08T06:41:05.505778+0000","last_active":"2024-05-08T06:43:16.878467+0000","last_peered":"2024-05-08T06:43:16.878467+0000","last_clean":"2024-05-08T06:43:16.878467+0000","last_became_active":"2024-05-08T06:41:05.505400+0000","last_became_peered":"2024-05-08T06:41:05.505400+0000","last_unstale":"2024-05-08T06:43:16.878467+0000","last_undegraded":"2024-05-08T06:43:16.878467+0000","last_fullsized":"2024-05-08T06:43:16.878467+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:11:34.887026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.881247+0000","last_change":"2024-05-08T06:41:24.671768+0000","last_active":"2024-05-08T06:43:16.881247+0000","last_peered":"2024-05-08T06:43:16.881247+0000","last_clean":"2024-05-08T06:43:16.881247+0000","last_became_active":"2024-05-08T06:41:24.671250+0000","last_became_peered":"2024-05-08T06:41:24.671250+0000","last_unstale":"2024-05-08T06:43:16.881247+0000","last_undegraded":"2024-05-08T06:43:16.881247+0000","last_fullsized":"2024-05-08T06:43:16.881247+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:56:44.302049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.872721+0000","last_change":"2024-05-08T06:41:06.151820+0000","last_active":"2024-05-08T06:43:16.872721+0000","last_peered":"2024-05-08T06:43:16.872721+0000","last_clean":"2024-05-08T06:43:16.872721+0000","last_became_active":"2024-05-08T06:41:06.149976+0000","last_became_peered":"2024-05-08T06:41:06.149976+0000","last_unstale":"2024-05-08T06:43:16.872721+0000","last_undegraded":"2024-05-08T06:43:16.872721+0000","last_fullsized":"2024-05-08T06:43:16.872721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:35:21.233811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957070+0000","last_change":"2024-05-08T06:41:09.568880+0000","last_active":"2024-05-08T06:43:16.957070+0000","last_peered":"2024-05-08T06:43:16.957070+0000","last_clean":"2024-05-08T06:43:16.957070+0000","last_became_active":"2024-05-08T06:41:09.568507+0000","last_became_peered":"2024-05-08T06:41:09.568507+0000","last_unstale":"2024-05-08T06:43:16.957070+0000","last_undegraded":"2024-05-08T06:43:16.957070+0000","last_fullsized":"2024-05-08T06:43:16.957070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:01.376121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884503+0000","last_change":"2024-05-08T06:41:24.667472+0000","last_active":"2024-05-08T06:43:16.884503+0000","last_peered":"2024-05-08T06:43:16.884503+0000","last_clean":"2024-05-08T06:43:16.884503+0000","last_became_active":"2024-05-08T06:41:24.664164+0000","last_became_peered":"2024-05-08T06:41:24.664164+0000","last_unstale":"2024-05-08T06:43:16.884503+0000","last_undegraded":"2024-05-08T06:43:16.884503+0000","last_fullsized":"2024-05-08T06:43:16.884503+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:34:25.630742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'10","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866879+0000","last_change":"2024-05-08T06:41:05.504287+0000","last_active":"2024-05-08T06:43:16.866879+0000","last_peered":"2024-05-08T06:43:16.866879+0000","last_clean":"2024-05-08T06:43:16.866879+0000","last_became_active":"2024-05-08T06:41:05.503825+0000","last_became_peered":"2024-05-08T06:41:05.503825+0000","last_unstale":"2024-05-08T06:43:16.866879+0000","last_undegraded":"2024-05-08T06:43:16.866879+0000","last_fullsized":"2024-05-08T06:43:16.866879+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:50:23.230289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885371+0000","last_change":"2024-05-08T06:41:09.576996+0000","last_active":"2024-05-08T06:43:16.885371+0000","last_peered":"2024-05-08T06:43:16.885371+0000","last_clean":"2024-05-08T06:43:16.885371+0000","last_became_active":"2024-05-08T06:41:09.572034+0000","last_became_peered":"2024-05-08T06:41:09.572034+0000","last_unstale":"2024-05-08T06:43:16.885371+0000","last_undegraded":"2024-05-08T06:43:16.885371+0000","last_fullsized":"2024-05-08T06:43:16.885371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:41.690687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876553+0000","last_change":"2024-05-08T06:41:24.665751+0000","last_active":"2024-05-08T06:43:16.876553+0000","last_peered":"2024-05-08T06:43:16.876553+0000","last_clean":"2024-05-08T06:43:16.876553+0000","last_became_active":"2024-05-08T06:41:24.665306+0000","last_became_peered":"2024-05-08T06:41:24.665306+0000","last_unstale":"2024-05-08T06:43:16.876553+0000","last_undegraded":"2024-05-08T06:43:16.876553+0000","last_fullsized":"2024-05-08T06:43:16.876553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:10.515975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871049+0000","last_change":"2024-05-08T06:41:05.502897+0000","last_active":"2024-05-08T06:43:16.871049+0000","last_peered":"2024-05-08T06:43:16.871049+0000","last_clean":"2024-05-08T06:43:16.871049+0000","last_became_active":"2024-05-08T06:41:05.500636+0000","last_became_peered":"2024-05-08T06:41:05.500636+0000","last_unstale":"2024-05-08T06:43:16.871049+0000","last_undegraded":"2024-05-08T06:43:16.871049+0000","last_fullsized":"2024-05-08T06:43:16.871049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:02.523706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.875133+0000","last_change":"2024-05-08T06:41:09.586824+0000","last_active":"2024-05-08T06:43:16.875133+0000","last_peered":"2024-05-08T06:43:16.875133+0000","last_clean":"2024-05-08T06:43:16.875133+0000","last_became_active":"2024-05-08T06:41:09.585032+0000","last_became_peered":"2024-05-08T06:41:09.585032+0000","last_unstale":"2024-05-08T06:43:16.875133+0000","last_undegraded":"2024-05-08T06:43:16.875133+0000","last_fullsized":"2024-05-08T06:43:16.875133+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:00:31.890993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870440+0000","last_change":"2024-05-08T06:41:24.670033+0000","last_active":"2024-05-08T06:43:16.870440+0000","last_peered":"2024-05-08T06:43:16.870440+0000","last_clean":"2024-05-08T06:43:16.870440+0000","last_became_active":"2024-05-08T06:41:24.669477+0000","last_became_peered":"2024-05-08T06:41:24.669477+0000","last_unstale":"2024-05-08T06:43:16.870440+0000","last_undegraded":"2024-05-08T06:43:16.870440+0000","last_fullsized":"2024-05-08T06:43:16.870440+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:55.040308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130374+0000","last_change":"2024-05-08T06:41:06.146847+0000","last_active":"2024-05-08T06:43:17.130374+0000","last_peered":"2024-05-08T06:43:17.130374+0000","last_clean":"2024-05-08T06:43:17.130374+0000","last_became_active":"2024-05-08T06:41:06.146141+0000","last_became_peered":"2024-05-08T06:41:06.146141+0000","last_unstale":"2024-05-08T06:43:17.130374+0000","last_undegraded":"2024-05-08T06:43:17.130374+0000","last_fullsized":"2024-05-08T06:43:17.130374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:45:30.924860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871631+0000","last_change":"2024-05-08T06:41:09.578067+0000","last_active":"2024-05-08T06:43:16.871631+0000","last_peered":"2024-05-08T06:43:16.871631+0000","last_clean":"2024-05-08T06:43:16.871631+0000","last_became_active":"2024-05-08T06:41:09.577650+0000","last_became_peered":"2024-05-08T06:41:09.577650+0000","last_unstale":"2024-05-08T06:43:16.871631+0000","last_undegraded":"2024-05-08T06:43:16.871631+0000","last_fullsized":"2024-05-08T06:43:16.871631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:09.285601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.867145+0000","last_change":"2024-05-08T06:41:24.669791+0000","last_active":"2024-05-08T06:43:16.867145+0000","last_peered":"2024-05-08T06:43:16.867145+0000","last_clean":"2024-05-08T06:43:16.867145+0000","last_became_active":"2024-05-08T06:41:24.669363+0000","last_became_peered":"2024-05-08T06:41:24.669363+0000","last_unstale":"2024-05-08T06:43:16.867145+0000","last_undegraded":"2024-05-08T06:43:16.867145+0000","last_fullsized":"2024-05-08T06:43:16.867145+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:08.522339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884734+0000","last_change":"2024-05-08T06:41:05.486456+0000","last_active":"2024-05-08T06:43:16.884734+0000","last_peered":"2024-05-08T06:43:16.884734+0000","last_clean":"2024-05-08T06:43:16.884734+0000","last_became_active":"2024-05-08T06:41:05.485878+0000","last_became_peered":"2024-05-08T06:41:05.485878+0000","last_unstale":"2024-05-08T06:43:16.884734+0000","last_undegraded":"2024-05-08T06:43:16.884734+0000","last_fullsized":"2024-05-08T06:43:16.884734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:11:47.985329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879795+0000","last_change":"2024-05-08T06:41:09.573940+0000","last_active":"2024-05-08T06:43:16.879795+0000","last_peered":"2024-05-08T06:43:16.879795+0000","last_clean":"2024-05-08T06:43:16.879795+0000","last_became_active":"2024-05-08T06:41:09.573515+0000","last_became_peered":"2024-05-08T06:41:09.573515+0000","last_unstale":"2024-05-08T06:43:16.879795+0000","last_undegraded":"2024-05-08T06:43:16.879795+0000","last_fullsized":"2024-05-08T06:43:16.879795+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:44.803013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871137+0000","last_change":"2024-05-08T06:41:24.663008+0000","last_active":"2024-05-08T06:43:16.871137+0000","last_peered":"2024-05-08T06:43:16.871137+0000","last_clean":"2024-05-08T06:43:16.871137+0000","last_became_active":"2024-05-08T06:41:24.661934+0000","last_became_peered":"2024-05-08T06:41:24.661934+0000","last_unstale":"2024-05-08T06:43:16.871137+0000","last_undegraded":"2024-05-08T06:43:16.871137+0000","last_fullsized":"2024-05-08T06:43:16.871137+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:08.719125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.894395+0000","last_change":"2024-05-08T06:43:16.894395+0000","last_active":"2024-05-08T06:43:16.894395+0000","last_peered":"2024-05-08T06:43:16.894395+0000","last_clean":"2024-05-08T06:43:16.894395+0000","last_became_active":"2024-05-08T06:43:16.886763+0000","last_became_peered":"2024-05-08T06:43:16.886763+0000","last_unstale":"2024-05-08T06:43:16.894395+0000","last_undegraded":"2024-05-08T06:43:16.894395+0000","last_fullsized":"2024-05-08T06:43:16.894395+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:52.278223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884954+0000","last_change":"2024-05-08T06:41:09.573388+0000","last_active":"2024-05-08T06:43:16.884954+0000","last_peered":"2024-05-08T06:43:16.884954+0000","last_clean":"2024-05-08T06:43:16.884954+0000","last_became_active":"2024-05-08T06:41:09.572901+0000","last_became_peered":"2024-05-08T06:41:09.572901+0000","last_unstale":"2024-05-08T06:43:16.884954+0000","last_undegraded":"2024-05-08T06:43:16.884954+0000","last_fullsized":"2024-05-08T06:43:16.884954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:38:45.123194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870163+0000","last_change":"2024-05-08T06:41:24.659817+0000","last_active":"2024-05-08T06:43:16.870163+0000","last_peered":"2024-05-08T06:43:16.870163+0000","last_clean":"2024-05-08T06:43:16.870163+0000","last_became_active":"2024-05-08T06:41:24.659276+0000","last_became_peered":"2024-05-08T06:41:24.659276+0000","last_unstale":"2024-05-08T06:43:16.870163+0000","last_undegraded":"2024-05-08T06:43:16.870163+0000","last_fullsized":"2024-05-08T06:43:16.870163+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:01.635454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.905524+0000","last_change":"2024-05-08T06:43:16.905524+0000","last_active":"2024-05-08T06:43:16.905524+0000","last_peered":"2024-05-08T06:43:16.905524+0000","last_clean":"2024-05-08T06:43:16.905524+0000","last_became_active":"2024-05-08T06:43:16.888087+0000","last_became_peered":"2024-05-08T06:43:16.888087+0000","last_unstale":"2024-05-08T06:43:16.905524+0000","last_undegraded":"2024-05-08T06:43:16.905524+0000","last_fullsized":"2024-05-08T06:43:16.905524+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:52.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878882+0000","last_change":"2024-05-08T06:41:09.574238+0000","last_active":"2024-05-08T06:43:16.878882+0000","last_peered":"2024-05-08T06:43:16.878882+0000","last_clean":"2024-05-08T06:43:16.878882+0000","last_became_active":"2024-05-08T06:41:09.570019+0000","last_became_peered":"2024-05-08T06:41:09.570019+0000","last_unstale":"2024-05-08T06:43:16.878882+0000","last_undegraded":"2024-05-08T06:43:16.878882+0000","last_fullsized":"2024-05-08T06:43:16.878882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:56.980400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130581+0000","last_change":"2024-05-08T06:41:24.659955+0000","last_active":"2024-05-08T06:43:17.130581+0000","last_peered":"2024-05-08T06:43:17.130581+0000","last_clean":"2024-05-08T06:43:17.130581+0000","last_became_active":"2024-05-08T06:41:24.659534+0000","last_became_peered":"2024-05-08T06:41:24.659534+0000","last_unstale":"2024-05-08T06:43:17.130581+0000","last_undegraded":"2024-05-08T06:43:17.130581+0000","last_fullsized":"2024-05-08T06:43:17.130581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:41.893917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.898447+0000","last_change":"2024-05-08T06:43:16.897225+0000","last_active":"2024-05-08T06:43:16.898447+0000","last_peered":"2024-05-08T06:43:16.898447+0000","last_clean":"2024-05-08T06:43:16.898447+0000","last_became_active":"2024-05-08T06:43:16.883954+0000","last_became_peered":"2024-05-08T06:43:16.883954+0000","last_unstale":"2024-05-08T06:43:16.898447+0000","last_undegraded":"2024-05-08T06:43:16.898447+0000","last_fullsized":"2024-05-08T06:43:16.898447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:12.014514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.880189+0000","last_change":"2024-05-08T06:41:09.574159+0000","last_active":"2024-05-08T06:43:16.880189+0000","last_peered":"2024-05-08T06:43:16.880189+0000","last_clean":"2024-05-08T06:43:16.880189+0000","last_became_active":"2024-05-08T06:41:09.573734+0000","last_became_peered":"2024-05-08T06:41:09.573734+0000","last_unstale":"2024-05-08T06:43:16.880189+0000","last_undegraded":"2024-05-08T06:43:16.880189+0000","last_fullsized":"2024-05-08T06:43:16.880189+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:22.157071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874580+0000","last_change":"2024-05-08T06:41:24.668545+0000","last_active":"2024-05-08T06:43:16.874580+0000","last_peered":"2024-05-08T06:43:16.874580+0000","last_clean":"2024-05-08T06:43:16.874580+0000","last_became_active":"2024-05-08T06:41:24.668086+0000","last_became_peered":"2024-05-08T06:41:24.668086+0000","last_unstale":"2024-05-08T06:43:16.874580+0000","last_undegraded":"2024-05-08T06:43:16.874580+0000","last_fullsized":"2024-05-08T06:43:16.874580+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:08:02.473733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130284+0000","last_change":"2024-05-08T06:41:05.501332+0000","last_active":"2024-05-08T06:43:17.130284+0000","last_peered":"2024-05-08T06:43:17.130284+0000","last_clean":"2024-05-08T06:43:17.130284+0000","last_became_active":"2024-05-08T06:41:05.499174+0000","last_became_peered":"2024-05-08T06:41:05.499174+0000","last_unstale":"2024-05-08T06:43:17.130284+0000","last_undegraded":"2024-05-08T06:43:17.130284+0000","last_fullsized":"2024-05-08T06:43:17.130284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:49.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879475+0000","last_change":"2024-05-08T06:41:09.572927+0000","last_active":"2024-05-08T06:43:16.879475+0000","last_peered":"2024-05-08T06:43:16.879475+0000","last_clean":"2024-05-08T06:43:16.879475+0000","last_became_active":"2024-05-08T06:41:09.572502+0000","last_became_peered":"2024-05-08T06:41:09.572502+0000","last_unstale":"2024-05-08T06:43:16.879475+0000","last_undegraded":"2024-05-08T06:43:16.879475+0000","last_fullsized":"2024-05-08T06:43:16.879475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:03.838892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.128965+0000","last_change":"2024-05-08T06:41:24.667561+0000","last_active":"2024-05-08T06:43:17.128965+0000","last_peered":"2024-05-08T06:43:17.128965+0000","last_clean":"2024-05-08T06:43:17.128965+0000","last_became_active":"2024-05-08T06:41:24.666904+0000","last_became_peered":"2024-05-08T06:41:24.666904+0000","last_unstale":"2024-05-08T06:43:17.128965+0000","last_undegraded":"2024-05-08T06:43:17.128965+0000","last_fullsized":"2024-05-08T06:43:17.128965+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:15.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957758+0000","last_change":"2024-05-08T06:41:05.497117+0000","last_active":"2024-05-08T06:43:16.957758+0000","last_peered":"2024-05-08T06:43:16.957758+0000","last_clean":"2024-05-08T06:43:16.957758+0000","last_became_active":"2024-05-08T06:41:05.496621+0000","last_became_peered":"2024-05-08T06:41:05.496621+0000","last_unstale":"2024-05-08T06:43:16.957758+0000","last_undegraded":"2024-05-08T06:43:16.957758+0000","last_fullsized":"2024-05-08T06:43:16.957758+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:06:32.603973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879952+0000","last_change":"2024-05-08T06:41:09.572489+0000","last_active":"2024-05-08T06:43:16.879952+0000","last_peered":"2024-05-08T06:43:16.879952+0000","last_clean":"2024-05-08T06:43:16.879952+0000","last_became_active":"2024-05-08T06:41:09.572129+0000","last_became_peered":"2024-05-08T06:41:09.572129+0000","last_unstale":"2024-05-08T06:43:16.879952+0000","last_undegraded":"2024-05-08T06:43:16.879952+0000","last_fullsized":"2024-05-08T06:43:16.879952+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:18:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879735+0000","last_change":"2024-05-08T06:41:09.577872+0000","last_active":"2024-05-08T06:43:16.879735+0000","last_peered":"2024-05-08T06:43:16.879735+0000","last_clean":"2024-05-08T06:43:16.879735+0000","last_became_active":"2024-05-08T06:41:09.577490+0000","last_became_peered":"2024-05-08T06:41:09.577490+0000","last_unstale":"2024-05-08T06:43:16.879735+0000","last_undegraded":"2024-05-08T06:43:16.879735+0000","last_fullsized":"2024-05-08T06:43:16.879735+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:12:44.956055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877569+0000","last_change":"2024-05-08T06:42:15.861046+0000","last_active":"2024-05-08T06:43:16.877569+0000","last_peered":"2024-05-08T06:43:16.877569+0000","last_clean":"2024-05-08T06:43:16.877569+0000","last_became_active":"2024-05-08T06:42:15.860267+0000","last_became_peered":"2024-05-08T06:42:15.860267+0000","last_unstale":"2024-05-08T06:43:16.877569+0000","last_undegraded":"2024-05-08T06:43:16.877569+0000","last_fullsized":"2024-05-08T06:43:16.877569+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:15:01.541268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876313+0000","last_change":"2024-05-08T06:41:09.578005+0000","last_active":"2024-05-08T06:43:16.876313+0000","last_peered":"2024-05-08T06:43:16.876313+0000","last_clean":"2024-05-08T06:43:16.876313+0000","last_became_active":"2024-05-08T06:41:09.577571+0000","last_became_peered":"2024-05-08T06:41:09.577571+0000","last_unstale":"2024-05-08T06:43:16.876313+0000","last_undegraded":"2024-05-08T06:43:16.876313+0000","last_fullsized":"2024-05-08T06:43:16.876313+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:22.762195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874770+0000","last_change":"2024-05-08T06:41:09.579520+0000","last_active":"2024-05-08T06:43:16.874770+0000","last_peered":"2024-05-08T06:43:16.874770+0000","last_clean":"2024-05-08T06:43:16.874770+0000","last_became_active":"2024-05-08T06:41:09.579085+0000","last_became_peered":"2024-05-08T06:41:09.579085+0000","last_unstale":"2024-05-08T06:43:16.874770+0000","last_undegraded":"2024-05-08T06:43:16.874770+0000","last_fullsized":"2024-05-08T06:43:16.874770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:02:25.199102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957477+0000","last_change":"2024-05-08T06:41:09.588352+0000","last_active":"2024-05-08T06:43:16.957477+0000","last_peered":"2024-05-08T06:43:16.957477+0000","last_clean":"2024-05-08T06:43:16.957477+0000","last_became_active":"2024-05-08T06:41:09.587981+0000","last_became_peered":"2024-05-08T06:41:09.587981+0000","last_unstale":"2024-05-08T06:43:16.957477+0000","last_undegraded":"2024-05-08T06:43:16.957477+0000","last_fullsized":"2024-05-08T06:43:16.957477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:55.275569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.882517+0000","last_change":"2024-05-08T06:41:09.584216+0000","last_active":"2024-05-08T06:43:16.882517+0000","last_peered":"2024-05-08T06:43:16.882517+0000","last_clean":"2024-05-08T06:43:16.882517+0000","last_became_active":"2024-05-08T06:41:09.583789+0000","last_became_peered":"2024-05-08T06:41:09.583789+0000","last_unstale":"2024-05-08T06:43:16.882517+0000","last_undegraded":"2024-05-08T06:43:16.882517+0000","last_fullsized":"2024-05-08T06:43:16.882517+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:33:04.153098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879485+0000","last_change":"2024-05-08T06:41:09.573622+0000","last_active":"2024-05-08T06:43:16.879485+0000","last_peered":"2024-05-08T06:43:16.879485+0000","last_clean":"2024-05-08T06:43:16.879485+0000","last_became_active":"2024-05-08T06:41:09.573116+0000","last_became_peered":"2024-05-08T06:41:09.573116+0000","last_unstale":"2024-05-08T06:43:16.879485+0000","last_undegraded":"2024-05-08T06:43:16.879485+0000","last_fullsized":"2024-05-08T06:43:16.879485+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:58:03.031899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885441+0000","last_change":"2024-05-08T06:41:09.588787+0000","last_active":"2024-05-08T06:43:16.885441+0000","last_peered":"2024-05-08T06:43:16.885441+0000","last_clean":"2024-05-08T06:43:16.885441+0000","last_became_active":"2024-05-08T06:41:09.588430+0000","last_became_peered":"2024-05-08T06:41:09.588430+0000","last_unstale":"2024-05-08T06:43:16.885441+0000","last_undegraded":"2024-05-08T06:43:16.885441+0000","last_fullsized":"2024-05-08T06:43:16.885441+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:36:26.689419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129624+0000","last_change":"2024-05-08T06:41:09.575057+0000","last_active":"2024-05-08T06:43:17.129624+0000","last_peered":"2024-05-08T06:43:17.129624+0000","last_clean":"2024-05-08T06:43:17.129624+0000","last_became_active":"2024-05-08T06:41:09.572522+0000","last_became_peered":"2024-05-08T06:41:09.572522+0000","last_unstale":"2024-05-08T06:43:17.129624+0000","last_undegraded":"2024-05-08T06:43:17.129624+0000","last_fullsized":"2024-05-08T06:43:17.129624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:40:26.702841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884817+0000","last_change":"2024-05-08T06:41:09.578184+0000","last_active":"2024-05-08T06:43:16.884817+0000","last_peered":"2024-05-08T06:43:16.884817+0000","last_clean":"2024-05-08T06:43:16.884817+0000","last_became_active":"2024-05-08T06:41:09.577796+0000","last_became_peered":"2024-05-08T06:41:09.577796+0000","last_unstale":"2024-05-08T06:43:16.884817+0000","last_undegraded":"2024-05-08T06:43:16.884817+0000","last_fullsized":"2024-05-08T06:43:16.884817+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:40.822805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.131544+0000","last_change":"2024-05-08T06:41:09.577050+0000","last_active":"2024-05-08T06:43:17.131544+0000","last_peered":"2024-05-08T06:43:17.131544+0000","last_clean":"2024-05-08T06:43:17.131544+0000","last_became_active":"2024-05-08T06:41:09.576449+0000","last_became_peered":"2024-05-08T06:41:09.576449+0000","last_unstale":"2024-05-08T06:43:17.131544+0000","last_undegraded":"2024-05-08T06:43:17.131544+0000","last_fullsized":"2024-05-08T06:43:17.131544+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:04:42.819087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956772+0000","last_change":"2024-05-08T06:41:09.580830+0000","last_active":"2024-05-08T06:43:16.956772+0000","last_peered":"2024-05-08T06:43:16.956772+0000","last_clean":"2024-05-08T06:43:16.956772+0000","last_became_active":"2024-05-08T06:41:09.577457+0000","last_became_peered":"2024-05-08T06:41:09.577457+0000","last_unstale":"2024-05-08T06:43:16.956772+0000","last_undegraded":"2024-05-08T06:43:16.956772+0000","last_fullsized":"2024-05-08T06:43:16.956772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:02.932857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":37,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.881289+0000","last_change":"2024-05-08T06:41:09.586919+0000","last_active":"2024-05-08T06:43:16.881289+0000","last_peered":"2024-05-08T06:43:16.881289+0000","last_clean":"2024-05-08T06:43:16.881289+0000","last_became_active":"2024-05-08T06:41:09.586560+0000","last_became_peered":"2024-05-08T06:41:09.586560+0000","last_unstale":"2024-05-08T06:43:16.881289+0000","last_undegraded":"2024-05-08T06:43:16.881289+0000","last_fullsized":"2024-05-08T06:43:16.881289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:00.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71093,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":259,"num_read_kb":202,"num_write":167,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":214417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612653,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":528202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808883,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1753088,"data_stored":1182953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972412,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":532534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168642,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1073152,"data_stored":528358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364874,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32808,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712344,"statfs":{"total":95995035648,"available":95961440256,"internally_reserved":0,"allocated":1667072,"data_stored":1124267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561106,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36372,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708780,"statfs":{"total":95995035648,"available":95957790720,"internally_reserved":0,"allocated":1052672,"data_stored":523614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28120,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717032,"statfs":{"total":95995035648,"available":95966240768,"internally_reserved":0,"allocated":1126400,"data_stored":591754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738488,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1077248,"data_stored":525002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411435,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1146880,"data_stored":591384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149797,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1064960,"data_stored":523808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953568,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1069056,"data_stored":529237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757337,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36980,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708172,"statfs":{"total":95995035648,"available":95957168128,"internally_reserved":0,"allocated":1675264,"data_stored":1119464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":67860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T06:43:26.229 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-08T06:43:26.230 INFO:tasks.cephadm:Setting up client nodes... 2024-05-08T06:43:26.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-08T06:43:26.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:25 smithi194 ceph-mon[33679]: pgmap v447: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 617 B/s wr, 5 op/s; 70 B/s, 0 objects/s recovering 2024-05-08T06:43:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:25 smithi172 ceph-mon[33377]: pgmap v447: 129 pgs: 129 active+clean; 646 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 617 B/s wr, 5 op/s; 70 B/s, 0 objects/s recovering 2024-05-08T06:43:26.691 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:27.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:26 smithi070 ceph-mon[29591]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:43:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:26 smithi194 ceph-mon[33679]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:43:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:26 smithi172 ceph-mon[33377]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:43:28.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:27 smithi070 ceph-mon[29591]: pgmap v448: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 6 op/s; 58 B/s, 0 objects/s recovering 2024-05-08T06:43:28.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:27 smithi194 ceph-mon[33679]: pgmap v448: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 6 op/s; 58 B/s, 0 objects/s recovering 2024-05-08T06:43:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:27 smithi172 ceph-mon[33377]: pgmap v448: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 716 B/s wr, 6 op/s; 58 B/s, 0 objects/s recovering 2024-05-08T06:43:29.039 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:28 smithi070 ceph-mon[29591]: pgmap v449: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 635 B/s wr, 5 op/s; 51 B/s, 0 objects/s recovering 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.115+0000 7ffa8f200700 1 -- 172.21.15.70:0/1727343173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa881079f0 msgr2=0x7ffa88109de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.115+0000 7ffa8f200700 1 --2- 172.21.15.70:0/1727343173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa881079f0 0x7ffa88109de0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ffa8400b0a0 tx=0x7ffa8400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.115+0000 7ffa8f200700 1 -- 172.21.15.70:0/1727343173 shutdown_connections 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.115+0000 7ffa8f200700 1 --2- 172.21.15.70:0/1727343173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa881079f0 0x7ffa88109de0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.115+0000 7ffa8f200700 1 --2- 172.21.15.70:0/1727343173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa8806a4a0 0x7ffa881027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.115+0000 7ffa8f200700 1 --2- 172.21.15.70:0/1727343173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa88102cf0 0x7ffa88103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.115+0000 7ffa8f200700 1 -- 172.21.15.70:0/1727343173 >> 172.21.15.70:0/1727343173 conn(0x7ffa880fcb70 msgr2=0x7ffa880fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.115+0000 7ffa8f200700 1 -- 172.21.15.70:0/1727343173 shutdown_connections 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.115+0000 7ffa8f200700 1 -- 172.21.15.70:0/1727343173 wait complete. 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.117+0000 7ffa8f200700 1 Processor -- start 2024-05-08T06:43:29.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.117+0000 7ffa8f200700 1 -- start start 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.117+0000 7ffa8f200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa8806a4a0 0x7ffa88199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.117+0000 7ffa8f200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa88102cf0 0x7ffa881996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.117+0000 7ffa8f200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa881079f0 0x7ffa881a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.117+0000 7ffa8f200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8810db80 con 0x7ffa88102cf0 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.117+0000 7ffa8f200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8810da00 con 0x7ffa881079f0 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.117+0000 7ffa8f200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa8810dd00 con 0x7ffa8806a4a0 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa88102cf0 0x7ffa881996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa88102cf0 0x7ffa881996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34574/0 (socket says 172.21.15.70:34574) 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8d400700 1 -- 172.21.15.70:0/2716234769 learned_addr learned my addr 172.21.15.70:0/2716234769 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8de00700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa8806a4a0 0x7ffa88199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8e800700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa881079f0 0x7ffa881a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8d400700 1 -- 172.21.15.70:0/2716234769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa8806a4a0 msgr2=0x7ffa88199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:29.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8d400700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa8806a4a0 0x7ffa88199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8d400700 1 -- 172.21.15.70:0/2716234769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa881079f0 msgr2=0x7ffa881a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8d400700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa881079f0 0x7ffa881a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8d400700 1 -- 172.21.15.70:0/2716234769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa881a0dc0 con 0x7ffa88102cf0 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8e800700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa881079f0 0x7ffa881a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.118+0000 7ffa8de00700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa8806a4a0 0x7ffa88199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.119+0000 7ffa8d400700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa88102cf0 0x7ffa881996a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c9e0 tx=0x7ffa7400cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.119+0000 7ffa82a00700 1 -- 172.21.15.70:0/2716234769 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74007ac0 con 0x7ffa88102cf0 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.119+0000 7ffa82a00700 1 -- 172.21.15.70:0/2716234769 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa74007c60 con 0x7ffa88102cf0 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.119+0000 7ffa82a00700 1 -- 172.21.15.70:0/2716234769 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74018660 con 0x7ffa88102cf0 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.119+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa881a10b0 con 0x7ffa88102cf0 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.119+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa881a1640 con 0x7ffa88102cf0 2024-05-08T06:43:29.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.120+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa88064b00 con 0x7ffa88102cf0 2024-05-08T06:43:29.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.123+0000 7ffa82a00700 1 -- 172.21.15.70:0/2716234769 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ffa7400f450 con 0x7ffa88102cf0 2024-05-08T06:43:29.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.124+0000 7ffa82a00700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ffa700b2a30 0x7ffa700b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:29.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.124+0000 7ffa82a00700 1 -- 172.21.15.70:0/2716234769 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7ffa740e2750 con 0x7ffa88102cf0 2024-05-08T06:43:29.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.125+0000 7ffa8de00700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ffa700b2a30 0x7ffa700b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:29.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.125+0000 7ffa8de00700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ffa700b2a30 0x7ffa700b4ef0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffa88102610 tx=0x7ffa7c00a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:29.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.129+0000 7ffa82a00700 1 -- 172.21.15.70:0/2716234769 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffa74014030 con 0x7ffa88102cf0 2024-05-08T06:43:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:28 smithi194 ceph-mon[33679]: pgmap v449: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 635 B/s wr, 5 op/s; 51 B/s, 0 objects/s recovering 2024-05-08T06:43:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:28 smithi172 ceph-mon[33377]: pgmap v449: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 635 B/s wr, 5 op/s; 51 B/s, 0 objects/s recovering 2024-05-08T06:43:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.453+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ffa8802e540 con 0x7ffa88102cf0 2024-05-08T06:43:29.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.457+0000 7ffa82a00700 1 -- 172.21.15.70:0/2716234769 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v34) ==== 170+0+59 (secure 0 0 0) 0x7ffa740a9870 con 0x7ffa88102cf0 2024-05-08T06:43:29.457 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-05-08T06:43:29.457 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQARHztmp94lGxAAVrqq2YKhqZZ/mi7dNvJpNA== 2024-05-08T06:43:29.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ffa700b2a30 msgr2=0x7ffa700b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:29.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ffa700b2a30 0x7ffa700b4ef0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffa88102610 tx=0x7ffa7c00a680 comp rx=0 tx=0).stop 2024-05-08T06:43:29.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa88102cf0 msgr2=0x7ffa881996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:29.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa88102cf0 0x7ffa881996a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400c9e0 tx=0x7ffa7400cda0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 shutdown_connections 2024-05-08T06:43:29.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa881079f0 0x7ffa881a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa8806a4a0 0x7ffa88199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ffa700b2a30 0x7ffa700b4ef0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 --2- 172.21.15.70:0/2716234769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa88102cf0 0x7ffa881996a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:29.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 >> 172.21.15.70:0/2716234769 conn(0x7ffa880fcb70 msgr2=0x7ffa8810c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:29.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 shutdown_connections 2024-05-08T06:43:29.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:29.460+0000 7ffa8f200700 1 -- 172.21.15.70:0/2716234769 wait complete. 2024-05-08T06:43:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:29 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2716234769' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T06:43:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:29 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2716234769' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T06:43:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:29 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2716234769' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T06:43:30.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:29 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2716234769' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T06:43:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:29 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2716234769' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T06:43:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:29 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2716234769' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T06:43:30.469 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:43:30.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-08T06:43:30.469 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T06:43:30.601 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T06:43:30.601 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-08T06:43:30.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-08T06:43:31.083 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:30 smithi194 ceph-mon[33679]: pgmap v450: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-05-08T06:43:31.262 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:30 smithi070 ceph-mon[29591]: pgmap v450: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-05-08T06:43:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:30 smithi172 ceph-mon[33377]: pgmap v450: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 7 op/s; 48 B/s, 0 objects/s recovering 2024-05-08T06:43:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:33 smithi070 ceph-mon[29591]: pgmap v451: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-05-08T06:43:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:33 smithi194 ceph-mon[33679]: pgmap v451: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-05-08T06:43:33.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.579+0000 7f0174e00700 1 -- 172.21.15.70:0/770404163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 msgr2=0x7f0170105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:33.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.579+0000 7f0174e00700 1 --2- 172.21.15.70:0/770404163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 0x7f0170105a40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f015c0099c0 tx=0x7f015c009cd0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.579+0000 7f0174e00700 1 -- 172.21.15.70:0/770404163 shutdown_connections 2024-05-08T06:43:33.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.579+0000 7f0174e00700 1 --2- 172.21.15.70:0/770404163 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0170105f80 0x7f0170112440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.579+0000 7f0174e00700 1 --2- 172.21.15.70:0/770404163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f017010b670 0x7f017010ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.579+0000 7f0174e00700 1 --2- 172.21.15.70:0/770404163 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 0x7f0170105a40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.579+0000 7f0174e00700 1 -- 172.21.15.70:0/770404163 >> 172.21.15.70:0/770404163 conn(0x7f01701010d0 msgr2=0x7f01701034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:33.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.579+0000 7f0174e00700 1 -- 172.21.15.70:0/770404163 shutdown_connections 2024-05-08T06:43:33.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.579+0000 7f0174e00700 1 -- 172.21.15.70:0/770404163 wait complete. 2024-05-08T06:43:33.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.581+0000 7f0174e00700 1 Processor -- start 2024-05-08T06:43:33.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.581+0000 7f0174e00700 1 -- start start 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.581+0000 7f0174e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 0x7f01701a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.581+0000 7f0174e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0170105f80 0x7f01701a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.581+0000 7f0174e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f017010b670 0x7f017019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.581+0000 7f0174e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01701156d0 con 0x7f01701055c0 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.581+0000 7f0174e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0170115550 con 0x7f017010b670 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.581+0000 7f0174e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0170115850 con 0x7f0170105f80 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.582+0000 7f016f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 0x7f01701a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.582+0000 7f016f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 0x7f01701a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34588/0 (socket says 172.21.15.70:34588) 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.582+0000 7f016f400700 1 -- 172.21.15.70:0/580632267 learned_addr learned my addr 172.21.15.70:0/580632267 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.582+0000 7f016f400700 1 -- 172.21.15.70:0/580632267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0170105f80 msgr2=0x7f01701a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:33.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.582+0000 7f016f400700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0170105f80 0x7f01701a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.582+0000 7f016fe00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f017010b670 0x7f017019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.582+0000 7f016f400700 1 -- 172.21.15.70:0/580632267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f017010b670 msgr2=0x7f017019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.582+0000 7f016f400700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f017010b670 0x7f017019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.582+0000 7f016f400700 1 -- 172.21.15.70:0/580632267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017019c130 con 0x7f01701055c0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.583+0000 7f016f400700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 0x7f01701a17c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f016000d950 tx=0x7f016000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.583+0000 7f0167e00700 1 -- 172.21.15.70:0/580632267 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160016070 con 0x7f01701055c0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.583+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f017019c420 con 0x7f01701055c0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.583+0000 7f0167e00700 1 -- 172.21.15.70:0/580632267 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0160010460 con 0x7f01701055c0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.583+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01701a8690 con 0x7f01701055c0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.583+0000 7f0167e00700 1 -- 172.21.15.70:0/580632267 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160020060 con 0x7f01701055c0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.585+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f017006a190 con 0x7f01701055c0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.588+0000 7f0167e00700 1 -- 172.21.15.70:0/580632267 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0160019070 con 0x7f01701055c0 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.590+0000 7f0167e00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f01540b2910 0x7f01540b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:33.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.590+0000 7f0167e00700 1 -- 172.21.15.70:0/580632267 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f01600e26c0 con 0x7f01701055c0 2024-05-08T06:43:33.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.590+0000 7f016ea00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f01540b2910 0x7f01540b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:33.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.591+0000 7f016ea00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f01540b2910 0x7f01540b4dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f015c0098e0 tx=0x7f015c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:33.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.596+0000 7f0167e00700 1 -- 172.21.15.70:0/580632267 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f01600a9e30 con 0x7f01701055c0 2024-05-08T06:43:33.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:33 smithi172 ceph-mon[33377]: pgmap v451: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2024-05-08T06:43:33.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.887+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f017002e510 con 0x7f01701055c0 2024-05-08T06:43:33.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.897+0000 7f0167e00700 1 -- 172.21.15.70:0/580632267 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288645 (secure 0 0 0) 0x7f01600a9730 con 0x7f01701055c0 2024-05-08T06:43:33.905 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:43:33.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.903+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f01540b2910 msgr2=0x7f01540b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:33.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.903+0000 7f0174e00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f01540b2910 0x7f01540b4dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f015c0098e0 tx=0x7f015c000bc0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.903+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 msgr2=0x7f01701a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:33.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.903+0000 7f0174e00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 0x7f01701a17c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f016000d950 tx=0x7f016000dd10 comp rx=0 tx=0).stop 2024-05-08T06:43:33.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.904+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 shutdown_connections 2024-05-08T06:43:33.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.904+0000 7f0174e00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f017010b670 0x7f017019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.904+0000 7f0174e00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f01540b2910 0x7f01540b4dd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.904+0000 7f0174e00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01701055c0 0x7f01701a17c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.904+0000 7f0174e00700 1 --2- 172.21.15.70:0/580632267 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0170105f80 0x7f01701a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:33.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.904+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 >> 172.21.15.70:0/580632267 conn(0x7f01701010d0 msgr2=0x7f01701028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:33.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.904+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 shutdown_connections 2024-05-08T06:43:33.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:33.904+0000 7f0174e00700 1 -- 172.21.15.70:0/580632267 wait complete. 2024-05-08T06:43:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/580632267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T06:43:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/580632267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T06:43:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/580632267' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T06:43:34.870 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":3718531938},{"type":"v1","addr":"172.21.15.70:6801","nonce":3718531938}]},"active_addr":"172.21.15.70:6801/3718531938","active_change":"2024-05-08T06:31:13.904806+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34109,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.70:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":565155292}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2096266006}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2886471860}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":360029842}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2473445382}]}]} 2024-05-08T06:43:34.876 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-08T06:43:34.876 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-08T06:43:34.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:43:35.328 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:35.481 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:35 smithi070 ceph-mon[29591]: pgmap v452: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T06:43:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:35 smithi194 ceph-mon[33679]: pgmap v452: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T06:43:35.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:35 smithi172 ceph-mon[33377]: pgmap v452: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T06:43:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:37 smithi070 ceph-mon[29591]: pgmap v453: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T06:43:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:37 smithi194 ceph-mon[33679]: pgmap v453: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T06:43:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:37 smithi172 ceph-mon[33377]: pgmap v453: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-08T06:43:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.692+0000 7f2e2d400700 1 -- 172.21.15.70:0/2821271370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 msgr2=0x7f2e28112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.692+0000 7f2e2d400700 1 --2- 172.21.15.70:0/2821271370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 0x7f2e28112290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000b0a0 tx=0x7f2e2000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.692+0000 7f2e2d400700 1 -- 172.21.15.70:0/2821271370 shutdown_connections 2024-05-08T06:43:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.692+0000 7f2e2d400700 1 --2- 172.21.15.70:0/2821271370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 0x7f2e28112290 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.692+0000 7f2e2d400700 1 --2- 172.21.15.70:0/2821271370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e280756d0 0x7f2e28075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.692+0000 7f2e2d400700 1 --2- 172.21.15.70:0/2821271370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28075ff0 0x7f2e2810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.692+0000 7f2e2d400700 1 -- 172.21.15.70:0/2821271370 >> 172.21.15.70:0/2821271370 conn(0x7f2e2807a600 msgr2=0x7f2e2807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.692+0000 7f2e2d400700 1 -- 172.21.15.70:0/2821271370 shutdown_connections 2024-05-08T06:43:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.692+0000 7f2e2d400700 1 -- 172.21.15.70:0/2821271370 wait complete. 2024-05-08T06:43:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.693+0000 7f2e2d400700 1 Processor -- start 2024-05-08T06:43:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.694+0000 7f2e2d400700 1 -- start start 2024-05-08T06:43:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.694+0000 7f2e2d400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e280756d0 0x7f2e281a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.694+0000 7f2e2d400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28075ff0 0x7f2e281a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:37.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.694+0000 7f2e2d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 0x7f2e2819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:37.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.694+0000 7f2e2d400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2e28115740 con 0x7f2e2810fea0 2024-05-08T06:43:37.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.694+0000 7f2e2d400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e281155c0 con 0x7f2e28075ff0 2024-05-08T06:43:37.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.694+0000 7f2e2d400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2e281158c0 con 0x7f2e280756d0 2024-05-08T06:43:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.694+0000 7f2e27200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 0x7f2e2819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.694+0000 7f2e27200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 0x7f2e2819b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58374/0 (socket says 172.21.15.70:58374) 2024-05-08T06:43:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.695+0000 7f2e27200700 1 -- 172.21.15.70:0/3186071655 learned_addr learned my addr 172.21.15.70:0/3186071655 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.695+0000 7f2e26800700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e280756d0 0x7f2e281a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.695+0000 7f2e25e00700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28075ff0 0x7f2e281a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.695+0000 7f2e27200700 1 -- 172.21.15.70:0/3186071655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e280756d0 msgr2=0x7f2e281a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.695+0000 7f2e27200700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e280756d0 0x7f2e281a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.695+0000 7f2e27200700 1 -- 172.21.15.70:0/3186071655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28075ff0 msgr2=0x7f2e281a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.695+0000 7f2e27200700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28075ff0 0x7f2e281a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.695+0000 7f2e27200700 1 -- 172.21.15.70:0/3186071655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2819c0a0 con 0x7f2e2810fea0 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.695+0000 7f2e27200700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 0x7f2e2819b940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000b070 tx=0x7f2e20004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.696+0000 7f2e1f400700 1 -- 172.21.15.70:0/3186071655 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e20021070 con 0x7f2e2810fea0 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.696+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2819c330 con 0x7f2e2810fea0 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.696+0000 7f2e1f400700 1 -- 172.21.15.70:0/3186071655 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e20007c80 con 0x7f2e2810fea0 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.696+0000 7f2e1f400700 1 -- 172.21.15.70:0/3186071655 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2001d450 con 0x7f2e2810fea0 2024-05-08T06:43:37.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.696+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e281a8650 con 0x7f2e2810fea0 2024-05-08T06:43:37.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.697+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e2806a190 con 0x7f2e2810fea0 2024-05-08T06:43:37.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.699+0000 7f2e1f400700 1 -- 172.21.15.70:0/3186071655 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2e20004020 con 0x7f2e2810fea0 2024-05-08T06:43:37.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.701+0000 7f2e1f400700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2e0c0b2990 0x7f2e0c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:37.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.701+0000 7f2e1f400700 1 -- 172.21.15.70:0/3186071655 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f2e2000f020 con 0x7f2e2810fea0 2024-05-08T06:43:37.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.701+0000 7f2e26800700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2e0c0b2990 0x7f2e0c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:37.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.702+0000 7f2e26800700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2e0c0b2990 0x7f2e0c0b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2e18005ea0 tx=0x7f2e18005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:37.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.703+0000 7f2e1f400700 1 -- 172.21.15.70:0/3186071655 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2e2002a020 con 0x7f2e2810fea0 2024-05-08T06:43:37.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.936+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e281a8820 con 0x7f2e2810fea0 2024-05-08T06:43:37.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.938+0000 7f2e1f400700 1 -- 172.21.15.70:0/3186071655 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24865 (secure 0 0 0) 0x7f2e200aba70 con 0x7f2e2810fea0 2024-05-08T06:43:37.939 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:43:37.939 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":92,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:43:16.853050+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:43:37.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2e0c0b2990 msgr2=0x7f2e0c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2e0c0b2990 0x7f2e0c0b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2e18005ea0 tx=0x7f2e18005e30 comp rx=0 tx=0).stop 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 msgr2=0x7f2e2819b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 0x7f2e2819b940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e2000b070 tx=0x7f2e20004e70 comp rx=0 tx=0).stop 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 shutdown_connections 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f2e0c0b2990 0x7f2e0c0b4e50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e2810fea0 0x7f2e2819b940 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e280756d0 0x7f2e281a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 --2- 172.21.15.70:0/3186071655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e28075ff0 0x7f2e281a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 >> 172.21.15.70:0/3186071655 conn(0x7f2e2807a600 msgr2=0x7f2e281005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 shutdown_connections 2024-05-08T06:43:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:37.942+0000 7f2e2d400700 1 -- 172.21.15.70:0/3186071655 wait complete. 2024-05-08T06:43:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:38 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3186071655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:43:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:38 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3186071655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:43:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:38 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3186071655' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:43:38.953 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-08T06:43:38.953 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:43:39.421 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:39 smithi194 ceph-mon[33679]: pgmap v454: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:39.577 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:39 smithi070 ceph-mon[29591]: pgmap v454: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:39.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:39 smithi172 ceph-mon[33377]: pgmap v454: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:41 smithi194 ceph-mon[33679]: pgmap v455: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:43:41.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:41 smithi070 ceph-mon[29591]: pgmap v455: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:43:41.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:41 smithi172 ceph-mon[33377]: pgmap v455: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:43:41.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.746+0000 7f9125e00700 1 -- 172.21.15.70:0/471335352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 msgr2=0x7f9120104790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:41.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.746+0000 7f9125e00700 1 --2- 172.21.15.70:0/471335352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 0x7f9120104790 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9110009990 tx=0x7f9110009ca0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.746+0000 7f9125e00700 1 -- 172.21.15.70:0/471335352 shutdown_connections 2024-05-08T06:43:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.746+0000 7f9125e00700 1 --2- 172.21.15.70:0/471335352 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9120102530 0x7f9120112220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.746+0000 7f9125e00700 1 --2- 172.21.15.70:0/471335352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 0x7f9120104790 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.746+0000 7f9125e00700 1 --2- 172.21.15.70:0/471335352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9120101a90 0x7f9120101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.746+0000 7f9125e00700 1 -- 172.21.15.70:0/471335352 >> 172.21.15.70:0/471335352 conn(0x7f9120078a10 msgr2=0x7f91200ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.746+0000 7f9125e00700 1 -- 172.21.15.70:0/471335352 shutdown_connections 2024-05-08T06:43:41.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.747+0000 7f9125e00700 1 -- 172.21.15.70:0/471335352 wait complete. 2024-05-08T06:43:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.748+0000 7f9125e00700 1 Processor -- start 2024-05-08T06:43:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.748+0000 7f9125e00700 1 -- start start 2024-05-08T06:43:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.748+0000 7f9125e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9120101a90 0x7f91201a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.748+0000 7f9125e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9120102530 0x7f91201a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.748+0000 7f9125e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 0x7f912019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.748+0000 7f9125e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9120115700 con 0x7f91201043b0 2024-05-08T06:43:41.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.748+0000 7f9125e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9120115580 con 0x7f9120102530 2024-05-08T06:43:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.748+0000 7f9125e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9120115880 con 0x7f9120101a90 2024-05-08T06:43:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 0x7f912019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 0x7f912019ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58388/0 (socket says 172.21.15.70:58388) 2024-05-08T06:43:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911f400700 1 -- 172.21.15.70:0/3767253424 learned_addr learned my addr 172.21.15.70:0/3767253424 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911e000700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9120102530 0x7f91201a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:41.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911ea00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9120101a90 0x7f91201a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911f400700 1 -- 172.21.15.70:0/3767253424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9120101a90 msgr2=0x7f91201a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911f400700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9120101a90 0x7f91201a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911f400700 1 -- 172.21.15.70:0/3767253424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9120102530 msgr2=0x7f91201a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911f400700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9120102530 0x7f91201a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911f400700 1 -- 172.21.15.70:0/3767253424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f912019c1e0 con 0x7f91201043b0 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911e000700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9120102530 0x7f91201a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.749+0000 7f911ea00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9120101a90 0x7f91201a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.750+0000 7f911f400700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 0x7f912019ba80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9118007d70 tx=0x7f911800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.750+0000 7f9124a00700 1 -- 172.21.15.70:0/3767253424 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9118016020 con 0x7f91201043b0 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.750+0000 7f9124a00700 1 -- 172.21.15.70:0/3767253424 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f911800ad40 con 0x7f91201043b0 2024-05-08T06:43:41.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.750+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f912019c4d0 con 0x7f91201043b0 2024-05-08T06:43:41.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.750+0000 7f9124a00700 1 -- 172.21.15.70:0/3767253424 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91180115e0 con 0x7f91201043b0 2024-05-08T06:43:41.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.750+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91201a8790 con 0x7f91201043b0 2024-05-08T06:43:41.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.751+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f912006a190 con 0x7f91201043b0 2024-05-08T06:43:41.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.754+0000 7f9124a00700 1 -- 172.21.15.70:0/3767253424 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9118019020 con 0x7f91201043b0 2024-05-08T06:43:41.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.755+0000 7f9124a00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f91040b2910 0x7f91040b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:41.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.755+0000 7f9124a00700 1 -- 172.21.15.70:0/3767253424 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f91180e2ac0 con 0x7f91201043b0 2024-05-08T06:43:41.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.755+0000 7f911ea00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f91040b2910 0x7f91040b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:41.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.756+0000 7f911ea00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f91040b2910 0x7f91040b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9110003760 tx=0x7f911001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:41.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.757+0000 7f9124a00700 1 -- 172.21.15.70:0/3767253424 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9118020020 con 0x7f91201043b0 2024-05-08T06:43:41.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.991+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f912019cfb0 con 0x7f91201043b0 2024-05-08T06:43:41.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.993+0000 7f9124a00700 1 -- 172.21.15.70:0/3767253424 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24865 (secure 0 0 0) 0x7f91180aa340 con 0x7f91201043b0 2024-05-08T06:43:41.992 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:43:41.992 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":92,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:43:16.853050+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:43:41.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f91040b2910 msgr2=0x7f91040b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:41.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f91040b2910 0x7f91040b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9110003760 tx=0x7f911001a040 comp rx=0 tx=0).stop 2024-05-08T06:43:41.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 msgr2=0x7f912019ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:41.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 0x7f912019ba80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9118007d70 tx=0x7f911800a340 comp rx=0 tx=0).stop 2024-05-08T06:43:41.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 shutdown_connections 2024-05-08T06:43:41.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f91040b2910 0x7f91040b4dd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91201043b0 0x7f912019ba80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9120101a90 0x7f91201a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 --2- 172.21.15.70:0/3767253424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9120102530 0x7f91201a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:41.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 >> 172.21.15.70:0/3767253424 conn(0x7f9120078a10 msgr2=0x7f91200ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:41.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.996+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 shutdown_connections 2024-05-08T06:43:41.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:41.997+0000 7f9125e00700 1 -- 172.21.15.70:0/3767253424 wait complete. 2024-05-08T06:43:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:42 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3767253424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:43:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:42 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3767253424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:43:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:42 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3767253424' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:43:42.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-08T06:43:42.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-08T06:43:42.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-08T06:43:42.827 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-08T06:43:42.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-08T06:43:42.828 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-08T06:43:42.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-08T06:43:42.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-08T06:43:42.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-08T06:43:42.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-08T06:43:42.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-08T06:43:42.831 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-08T06:43:43.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:43 smithi070 ceph-mon[29591]: pgmap v456: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:43.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:43 smithi172 ceph-mon[33377]: pgmap v456: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:43.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:43 smithi194 ceph-mon[33679]: pgmap v456: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:43.829 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:43.967 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:43.967 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:45.507 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:45 smithi070 ceph-mon[29591]: pgmap v457: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:43:45.541 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:45 smithi172 ceph-mon[33377]: pgmap v457: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:43:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:45 smithi194 ceph-mon[33679]: pgmap v457: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:43:46.080 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:46.081 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:47 smithi070 ceph-mon[29591]: pgmap v458: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:43:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:47 smithi172 ceph-mon[33377]: pgmap v458: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:43:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:47 smithi194 ceph-mon[33679]: pgmap v458: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:43:49.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:49 smithi070 ceph-mon[29591]: pgmap v459: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:49 smithi172 ceph-mon[33377]: pgmap v459: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:49 smithi194 ceph-mon[33679]: pgmap v459: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:50.365 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:51.590 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:51 smithi070 ceph-mon[29591]: pgmap v460: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:43:51.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:51 smithi172 ceph-mon[33377]: pgmap v460: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.131+0000 7f59ebe00700 1 -- 172.21.15.70:0/2095853360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59e41056c0 msgr2=0x7f59e4105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.131+0000 7f59ebe00700 1 --2- 172.21.15.70:0/2095853360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59e41056c0 0x7f59e4105b40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f59d0009990 tx=0x7f59d0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.131+0000 7f59ebe00700 1 -- 172.21.15.70:0/2095853360 shutdown_connections 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.131+0000 7f59ebe00700 1 --2- 172.21.15.70:0/2095853360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e4106080 0x7f59e4112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.131+0000 7f59ebe00700 1 --2- 172.21.15.70:0/2095853360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e410b6c0 0x7f59e410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.131+0000 7f59ebe00700 1 --2- 172.21.15.70:0/2095853360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59e41056c0 0x7f59e4105b40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.131+0000 7f59ebe00700 1 -- 172.21.15.70:0/2095853360 >> 172.21.15.70:0/2095853360 conn(0x7f59e41011d0 msgr2=0x7f59e41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.131+0000 7f59ebe00700 1 -- 172.21.15.70:0/2095853360 shutdown_connections 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.131+0000 7f59ebe00700 1 -- 172.21.15.70:0/2095853360 wait complete. 2024-05-08T06:43:51.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.132+0000 7f59ebe00700 1 Processor -- start 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.132+0000 7f59ebe00700 1 -- start start 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59ebe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e41056c0 0x7f59e41a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59ebe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e4106080 0x7f59e41a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59ebe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59e410b6c0 0x7f59e419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59ebe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59e4115750 con 0x7f59e410b6c0 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59ebe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59e41155d0 con 0x7f59e4106080 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59ebe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f59e41158d0 con 0x7f59e41056c0 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59e9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59e410b6c0 0x7f59e419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59e9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59e410b6c0 0x7f59e419ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54098/0 (socket says 172.21.15.70:54098) 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59e9e00700 1 -- 172.21.15.70:0/3914242140 learned_addr learned my addr 172.21.15.70:0/3914242140 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59e8a00700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e4106080 0x7f59e41a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:51.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.133+0000 7f59e9400700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e41056c0 0x7f59e41a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59e9e00700 1 -- 172.21.15.70:0/3914242140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e41056c0 msgr2=0x7f59e41a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59e9e00700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59e41056c0 0x7f59e41a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59e9e00700 1 -- 172.21.15.70:0/3914242140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e4106080 msgr2=0x7f59e41a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59e9e00700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f59e4106080 0x7f59e41a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59e9e00700 1 -- 172.21.15.70:0/3914242140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e419c170 con 0x7f59e410b6c0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59e9e00700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59e410b6c0 0x7f59e419ba10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f59dc007d70 tx=0x7f59dc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59e2000700 1 -- 172.21.15.70:0/3914242140 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc016020 con 0x7f59e410b6c0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59e2000700 1 -- 172.21.15.70:0/3914242140 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59dc00ad40 con 0x7f59e410b6c0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e419c460 con 0x7f59e410b6c0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59e2000700 1 -- 172.21.15.70:0/3914242140 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0115e0 con 0x7f59e410b6c0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.134+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e41a86d0 con 0x7f59e410b6c0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.135+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59e4063bf0 con 0x7f59e410b6c0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.138+0000 7f59e2000700 1 -- 172.21.15.70:0/3914242140 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f59dc019020 con 0x7f59e410b6c0 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.139+0000 7f59e2000700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f59cc0b2910 0x7f59cc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:51.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.140+0000 7f59e2000700 1 -- 172.21.15.70:0/3914242140 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f59dc0e2cc0 con 0x7f59e410b6c0 2024-05-08T06:43:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.140+0000 7f59e9400700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f59cc0b2910 0x7f59cc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.140+0000 7f59e2000700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] conn(0x7f59cc0bdcf0 0x7f59cc0c0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.140+0000 7f59e2000700 1 -- 172.21.15.70:0/3914242140 --> [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59dc01eeb0 con 0x7f59cc0bdcf0 2024-05-08T06:43:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.140+0000 7f59e2000700 1 -- 172.21.15.70:0/3914242140 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f59dc0e3070 con 0x7f59e410b6c0 2024-05-08T06:43:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.141+0000 7f59e9400700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f59cc0b2910 0x7f59cc0b4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f59d8005fd0 tx=0x7f59d800af00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:51.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.141+0000 7f59e8a00700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] conn(0x7f59cc0bdcf0 0x7f59cc0c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.142+0000 7f59e8a00700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] conn(0x7f59cc0bdcf0 0x7f59cc0c0190 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.144+0000 7f59e2000700 1 -- 172.21.15.70:0/3914242140 <== osd.2 v2:172.21.15.194:6800/818198413 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59dc01eeb0 con 0x7f59cc0bdcf0 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.162+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 --> [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f59e4064070 con 0x7f59cc0bdcf0 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.163+0000 7f59e2000700 1 -- 172.21.15.70:0/3914242140 <== osd.2 v2:172.21.15.194:6800/818198413 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f59e4064070 con 0x7f59cc0bdcf0 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.163+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 >> [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] conn(0x7f59cc0bdcf0 msgr2=0x7f59cc0c0190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59ebe00700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] conn(0x7f59cc0bdcf0 0x7f59cc0c0190 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f59cc0b2910 msgr2=0x7f59cc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59ebe00700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f59cc0b2910 0x7f59cc0b4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f59d8005fd0 tx=0x7f59d800af00 comp rx=0 tx=0).stop 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59e410b6c0 msgr2=0x7f59e419ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59ebe00700 1 --2- 172.21.15.70:0/3914242140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59e410b6c0 0x7f59e419ba10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f59dc007d70 tx=0x7f59dc00a340 comp rx=0 tx=0).stop 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59e9e00700 1 -- 172.21.15.70:0/3914242140 reap_dead start 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 shutdown_connections 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 >> 172.21.15.70:0/3914242140 conn(0x7f59e41011d0 msgr2=0x7f59e41017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:51.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 shutdown_connections 2024-05-08T06:43:51.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:50.164+0000 7f59ebe00700 1 -- 172.21.15.70:0/3914242140 wait complete. 2024-05-08T06:43:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:51 smithi194 ceph-mon[33679]: pgmap v460: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:43:53.577 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:53 smithi070 ceph-mon[29591]: pgmap v461: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:53.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:53 smithi172 ceph-mon[33377]: pgmap v461: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:53.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:53 smithi194 ceph-mon[33679]: pgmap v461: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:43:54.426 INFO:teuthology.orchestra.run.smithi070.stdout:77309411442 2024-05-08T06:43:54.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-08T06:43:55.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:55 smithi070 ceph-mon[29591]: pgmap v462: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:43:55.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:55 smithi172 ceph-mon[33377]: pgmap v462: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:43:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:55 smithi194 ceph-mon[33679]: pgmap v462: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:43:57.559 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:57 smithi070 ceph-mon[29591]: pgmap v463: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-08T06:43:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:57 smithi172 ceph-mon[33377]: pgmap v463: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-08T06:43:57.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:57 smithi194 ceph-mon[33679]: pgmap v463: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-08T06:43:57.937 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:43:58.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.087+0000 7f4ce3200700 1 -- 172.21.15.70:0/4075390885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce410fc60 msgr2=0x7f4ce4112070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.087+0000 7f4ce3200700 1 --2- 172.21.15.70:0/4075390885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce410fc60 0x7f4ce4112070 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00b0a0 tx=0x7f4cdc00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.087+0000 7f4ce3200700 1 -- 172.21.15.70:0/4075390885 shutdown_connections 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.087+0000 7f4ce3200700 1 --2- 172.21.15.70:0/4075390885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce410fc60 0x7f4ce4112070 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.087+0000 7f4ce3200700 1 --2- 172.21.15.70:0/4075390885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ce4075870 0x7f4ce4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.087+0000 7f4ce3200700 1 --2- 172.21.15.70:0/4075390885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ce4076190 0x7f4ce410f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.087+0000 7f4ce3200700 1 -- 172.21.15.70:0/4075390885 >> 172.21.15.70:0/4075390885 conn(0x7f4ce40feef0 msgr2=0x7f4ce4101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.087+0000 7f4ce3200700 1 -- 172.21.15.70:0/4075390885 shutdown_connections 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.087+0000 7f4ce3200700 1 -- 172.21.15.70:0/4075390885 wait complete. 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.088+0000 7f4ce3200700 1 Processor -- start 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.088+0000 7f4ce3200700 1 -- start start 2024-05-08T06:43:58.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce3200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ce4075870 0x7f4ce41a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce3200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce4076190 0x7f4ce41a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce3200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ce410fc60 0x7f4ce419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce3200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4115720 con 0x7f4ce4076190 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce3200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce41155a0 con 0x7f4ce4075870 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce3200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce41158a0 con 0x7f4ce410fc60 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce4076190 0x7f4ce41a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce4076190 0x7f4ce41a1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48174/0 (socket says 172.21.15.70:48174) 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1400700 1 -- 172.21.15.70:0/1377485040 learned_addr learned my addr 172.21.15.70:0/1377485040 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1e00700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ce4075870 0x7f4ce41a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1400700 1 -- 172.21.15.70:0/1377485040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ce410fc60 msgr2=0x7f4ce419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1400700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ce410fc60 0x7f4ce419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1400700 1 -- 172.21.15.70:0/1377485040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ce4075870 msgr2=0x7f4ce41a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1400700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ce4075870 0x7f4ce41a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1400700 1 -- 172.21.15.70:0/1377485040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce419c1a0 con 0x7f4ce4076190 2024-05-08T06:43:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.089+0000 7f4ce1e00700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ce4075870 0x7f4ce41a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:43:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.090+0000 7f4ce1400700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce4076190 0x7f4ce41a1d70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c9b0 tx=0x7f4cd000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.090+0000 7f4cdaa00700 1 -- 172.21.15.70:0/1377485040 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0007b00 con 0x7f4ce4076190 2024-05-08T06:43:58.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.090+0000 7f4cdaa00700 1 -- 172.21.15.70:0/1377485040 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cd0007ca0 con 0x7f4ce4076190 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.090+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce419c490 con 0x7f4ce4076190 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.090+0000 7f4cdaa00700 1 -- 172.21.15.70:0/1377485040 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0018660 con 0x7f4ce4076190 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.090+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce41a8700 con 0x7f4ce4076190 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.091+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ce4063c30 con 0x7f4ce4076190 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.094+0000 7f4cdaa00700 1 -- 172.21.15.70:0/1377485040 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4cd000f450 con 0x7f4ce4076190 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.096+0000 7f4cdaa00700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4cc80b2910 0x7f4cc80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.096+0000 7f4cdaa00700 1 -- 172.21.15.70:0/1377485040 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f4cd00e2cf0 con 0x7f4ce4076190 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.096+0000 7f4ce1e00700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4cc80b2910 0x7f4cc80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.096+0000 7f4cdaa00700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] conn(0x7f4cc80bdcf0 0x7f4cc80c0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.096+0000 7f4cdaa00700 1 -- 172.21.15.70:0/1377485040 --> [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4cd0007e50 con 0x7f4cc80bdcf0 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.096+0000 7f4cdaa00700 1 -- 172.21.15.70:0/1377485040 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f4cd00e30a0 con 0x7f4ce4076190 2024-05-08T06:43:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.096+0000 7f4ce2800700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] conn(0x7f4cc80bdcf0 0x7f4cc80c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.097+0000 7f4ce1e00700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4cc80b2910 0x7f4cc80b4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4006fd0 tx=0x7f4cd4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.097+0000 7f4ce2800700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] conn(0x7f4cc80bdcf0 0x7f4cc80c0190 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.098+0000 7f4cdaa00700 1 -- 172.21.15.70:0/1377485040 <== osd.0 v2:172.21.15.70:6802/698641504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4cd0007e50 con 0x7f4cc80bdcf0 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.115+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 --> [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ce40640b0 con 0x7f4cc80bdcf0 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4cdaa00700 1 -- 172.21.15.70:0/1377485040 <== osd.0 v2:172.21.15.70:6802/698641504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4ce40640b0 con 0x7f4cc80bdcf0 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] conn(0x7f4cc80bdcf0 msgr2=0x7f4cc80c0190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce3200700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] conn(0x7f4cc80bdcf0 0x7f4cc80c0190 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4cc80b2910 msgr2=0x7f4cc80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce3200700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4cc80b2910 0x7f4cc80b4dd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4006fd0 tx=0x7f4cd4008040 comp rx=0 tx=0).stop 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce4076190 msgr2=0x7f4ce41a1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce3200700 1 --2- 172.21.15.70:0/1377485040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce4076190 0x7f4ce41a1d70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4cd000c9b0 tx=0x7f4cd000cd70 comp rx=0 tx=0).stop 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce2800700 1 -- 172.21.15.70:0/1377485040 reap_dead start 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 shutdown_connections 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 >> 172.21.15.70:0/1377485040 conn(0x7f4ce40feef0 msgr2=0x7f4ce40ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.116+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 shutdown_connections 2024-05-08T06:43:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:58.117+0000 7f4ce3200700 1 -- 172.21.15.70:0/1377485040 wait complete. 2024-05-08T06:43:58.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.844+0000 7f6a47e00700 1 -- 172.21.15.70:0/4234144601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a481045f0 msgr2=0x7f6a481049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.845+0000 7f6a47e00700 1 --2- 172.21.15.70:0/4234144601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a481045f0 0x7f6a481049d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009990 tx=0x7f6a38009ca0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.845+0000 7f6a47e00700 1 -- 172.21.15.70:0/4234144601 shutdown_connections 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.845+0000 7f6a47e00700 1 --2- 172.21.15.70:0/4234144601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a4810d9d0 0x7f6a4810fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.845+0000 7f6a47e00700 1 --2- 172.21.15.70:0/4234144601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a481045f0 0x7f6a481049d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.845+0000 7f6a47e00700 1 --2- 172.21.15.70:0/4234144601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a48104f10 0x7f6a4810d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.845+0000 7f6a47e00700 1 -- 172.21.15.70:0/4234144601 >> 172.21.15.70:0/4234144601 conn(0x7f6a480fddc0 msgr2=0x7f6a481001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.845+0000 7f6a47e00700 1 -- 172.21.15.70:0/4234144601 shutdown_connections 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.845+0000 7f6a47e00700 1 -- 172.21.15.70:0/4234144601 wait complete. 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.846+0000 7f6a47e00700 1 Processor -- start 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.846+0000 7f6a47e00700 1 -- start start 2024-05-08T06:43:58.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a47e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a481045f0 0x7f6a481a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a47e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a48104f10 0x7f6a481a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a47e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a4810d9d0 0x7f6a4819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a47e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481134c0 con 0x7f6a481045f0 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a47e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48113340 con 0x7f6a48104f10 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a47e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48113640 con 0x7f6a4810d9d0 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a46a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a481045f0 0x7f6a481a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a46a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a481045f0 0x7f6a481a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54122/0 (socket says 172.21.15.70:54122) 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a46a00700 1 -- 172.21.15.70:0/937471370 learned_addr learned my addr 172.21.15.70:0/937471370 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.847+0000 7f6a47400700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a4810d9d0 0x7f6a4819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.848+0000 7f6a46000700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a48104f10 0x7f6a481a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.848+0000 7f6a46a00700 1 -- 172.21.15.70:0/937471370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a4810d9d0 msgr2=0x7f6a4819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.848+0000 7f6a46a00700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a4810d9d0 0x7f6a4819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.848+0000 7f6a46a00700 1 -- 172.21.15.70:0/937471370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a48104f10 msgr2=0x7f6a481a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.848+0000 7f6a46a00700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a48104f10 0x7f6a481a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.848+0000 7f6a46a00700 1 -- 172.21.15.70:0/937471370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4819c1e0 con 0x7f6a481045f0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.848+0000 7f6a46000700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a48104f10 0x7f6a481a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.848+0000 7f6a46a00700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a481045f0 0x7f6a481a18c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a38005910 tx=0x7f6a380047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.849+0000 7f6a3f400700 1 -- 172.21.15.70:0/937471370 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38027070 con 0x7f6a481045f0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.849+0000 7f6a3f400700 1 -- 172.21.15.70:0/937471370 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a3800fc00 con 0x7f6a481045f0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.849+0000 7f6a3f400700 1 -- 172.21.15.70:0/937471370 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38022d80 con 0x7f6a481045f0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.849+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a4819c470 con 0x7f6a481045f0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.849+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a481a8790 con 0x7f6a481045f0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.850+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a48103d50 con 0x7f6a481045f0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.853+0000 7f6a3f400700 1 -- 172.21.15.70:0/937471370 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6a3802a070 con 0x7f6a481045f0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.854+0000 7f6a3f400700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6a2c0b2990 0x7f6a2c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.854+0000 7f6a3f400700 1 -- 172.21.15.70:0/937471370 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f6a380e36e0 con 0x7f6a481045f0 2024-05-08T06:43:58.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.854+0000 7f6a46000700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6a2c0b2990 0x7f6a2c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:58.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.855+0000 7f6a3f400700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] conn(0x7f6a2c0bdd70 0x7f6a2c0c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:58.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.855+0000 7f6a3f400700 1 -- 172.21.15.70:0/937471370 --> [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a2c0c08e0 con 0x7f6a2c0bdd70 2024-05-08T06:43:58.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.855+0000 7f6a3f400700 1 -- 172.21.15.70:0/937471370 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f6a380ea050 con 0x7f6a481045f0 2024-05-08T06:43:58.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.855+0000 7f6a46000700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6a2c0b2990 0x7f6a2c0b4e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a34005950 tx=0x7f6a340058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:58.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.855+0000 7f6a47400700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] conn(0x7f6a2c0bdd70 0x7f6a2c0c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:58.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.856+0000 7f6a47400700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] conn(0x7f6a2c0bdd70 0x7f6a2c0c0210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:58.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.859+0000 7f6a3f400700 1 -- 172.21.15.70:0/937471370 <== osd.7 v2:172.21.15.172:6816/3099304179 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a2c0c08e0 con 0x7f6a2c0bdd70 2024-05-08T06:43:58.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.876+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 --> [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6a4806ba00 con 0x7f6a2c0bdd70 2024-05-08T06:43:58.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.877+0000 7f6a3f400700 1 -- 172.21.15.70:0/937471370 <== osd.7 v2:172.21.15.172:6816/3099304179 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6a4806ba00 con 0x7f6a2c0bdd70 2024-05-08T06:43:58.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 >> [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] conn(0x7f6a2c0bdd70 msgr2=0x7f6a2c0c0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] conn(0x7f6a2c0bdd70 0x7f6a2c0c0210 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6a2c0b2990 msgr2=0x7f6a2c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f6a2c0b2990 0x7f6a2c0b4e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a34005950 tx=0x7f6a340058e0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a481045f0 msgr2=0x7f6a481a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:58.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 --2- 172.21.15.70:0/937471370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a481045f0 0x7f6a481a18c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a38005910 tx=0x7f6a380047b0 comp rx=0 tx=0).stop 2024-05-08T06:43:58.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47400700 1 -- 172.21.15.70:0/937471370 reap_dead start 2024-05-08T06:43:58.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 shutdown_connections 2024-05-08T06:43:58.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 >> 172.21.15.70:0/937471370 conn(0x7f6a480fddc0 msgr2=0x7f6a481001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:58.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 shutdown_connections 2024-05-08T06:43:58.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:56.878+0000 7f6a47e00700 1 -- 172.21.15.70:0/937471370 wait complete. 2024-05-08T06:43:59.530 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:43:59 smithi070 ceph-mon[29591]: pgmap v464: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-05-08T06:43:59.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:43:59 smithi172 ceph-mon[33377]: pgmap v464: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-05-08T06:43:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:43:59 smithi194 ceph-mon[33679]: pgmap v464: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 4 op/s 2024-05-08T06:43:59.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.923+0000 7f9736a00700 1 -- 172.21.15.70:0/2924697249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730102ca0 msgr2=0x7f9730107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:59.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.923+0000 7f9736a00700 1 --2- 172.21.15.70:0/2924697249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730102ca0 0x7f9730107170 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f971c009990 tx=0x7f971c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:43:59.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.923+0000 7f9736a00700 1 -- 172.21.15.70:0/2924697249 shutdown_connections 2024-05-08T06:43:59.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.923+0000 7f9736a00700 1 --2- 172.21.15.70:0/2924697249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9730107790 0x7f9730107c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:59.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.923+0000 7f9736a00700 1 --2- 172.21.15.70:0/2924697249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9730102380 0x7f9730102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:59.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.923+0000 7f9736a00700 1 --2- 172.21.15.70:0/2924697249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730102ca0 0x7f9730107170 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:59.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.923+0000 7f9736a00700 1 -- 172.21.15.70:0/2924697249 >> 172.21.15.70:0/2924697249 conn(0x7f97300fddc0 msgr2=0x7f97301001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:59.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.923+0000 7f9736a00700 1 -- 172.21.15.70:0/2924697249 shutdown_connections 2024-05-08T06:43:59.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.923+0000 7f9736a00700 1 -- 172.21.15.70:0/2924697249 wait complete. 2024-05-08T06:43:59.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.924+0000 7f9736a00700 1 Processor -- start 2024-05-08T06:43:59.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.924+0000 7f9736a00700 1 -- start start 2024-05-08T06:43:59.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9736a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730102380 0x7f97301a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:59.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9736a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9730102ca0 0x7f97301a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:59.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9736a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9730107790 0x7f97301a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9736a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9730119b90 con 0x7f9730102380 2024-05-08T06:43:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9736a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9730119a10 con 0x7f9730102ca0 2024-05-08T06:43:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9736a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9730119d10 con 0x7f9730107790 2024-05-08T06:43:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9735600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730102380 0x7f97301a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9735600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730102380 0x7f97301a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48192/0 (socket says 172.21.15.70:48192) 2024-05-08T06:43:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9735600700 1 -- 172.21.15.70:0/3382496801 learned_addr learned my addr 172.21.15.70:0/3382496801 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:43:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.925+0000 7f9736000700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9730107790 0x7f97301a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9734c00700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9730102ca0 0x7f97301a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9735600700 1 -- 172.21.15.70:0/3382496801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9730107790 msgr2=0x7f97301a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9735600700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9730107790 0x7f97301a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9735600700 1 -- 172.21.15.70:0/3382496801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9730102ca0 msgr2=0x7f97301a0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9735600700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9730102ca0 0x7f97301a0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9735600700 1 -- 172.21.15.70:0/3382496801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97301a51f0 con 0x7f9730102380 2024-05-08T06:43:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9734c00700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9730102ca0 0x7f97301a0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:43:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9735600700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730102380 0x7f97301a01e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f972400b530 tx=0x7f972400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f972e000700 1 -- 172.21.15.70:0/3382496801 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724015020 con 0x7f9730102380 2024-05-08T06:43:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f972e000700 1 -- 172.21.15.70:0/3382496801 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9724011cc0 con 0x7f9730102380 2024-05-08T06:43:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97301a54e0 con 0x7f9730102380 2024-05-08T06:43:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f972e000700 1 -- 172.21.15.70:0/3382496801 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724010d30 con 0x7f9730102380 2024-05-08T06:43:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.926+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97301acd60 con 0x7f9730102380 2024-05-08T06:43:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.927+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9730106b30 con 0x7f9730102380 2024-05-08T06:43:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.930+0000 7f972e000700 1 -- 172.21.15.70:0/3382496801 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9724018020 con 0x7f9730102380 2024-05-08T06:43:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.931+0000 7f972e000700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f97180b2990 0x7f97180b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.931+0000 7f972e000700 1 -- 172.21.15.70:0/3382496801 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f97240e2530 con 0x7f9730102380 2024-05-08T06:43:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.932+0000 7f9734c00700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f97180b2990 0x7f97180b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.932+0000 7f972e000700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] conn(0x7f97180bdd70 0x7f97180c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:43:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.932+0000 7f972e000700 1 -- 172.21.15.70:0/3382496801 --> [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f972401be50 con 0x7f97180bdd70 2024-05-08T06:43:59.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.932+0000 7f972e000700 1 -- 172.21.15.70:0/3382496801 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f97240e28e0 con 0x7f9730102380 2024-05-08T06:43:59.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.932+0000 7f9734c00700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f97180b2990 0x7f97180b4e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f971c003760 tx=0x7f971c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:59.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.932+0000 7f9736000700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] conn(0x7f97180bdd70 0x7f97180c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:43:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.933+0000 7f9736000700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] conn(0x7f97180bdd70 0x7f97180c0210 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:43:59.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.936+0000 7f972e000700 1 -- 172.21.15.70:0/3382496801 <== osd.11 v2:172.21.15.194:6824/2919544964 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f972401be50 con 0x7f97180bdd70 2024-05-08T06:43:59.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.954+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 --> [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f973006ba60 con 0x7f97180bdd70 2024-05-08T06:43:59.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.955+0000 7f972e000700 1 -- 172.21.15.70:0/3382496801 <== osd.11 v2:172.21.15.194:6824/2919544964 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f973006ba60 con 0x7f97180bdd70 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 >> [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] conn(0x7f97180bdd70 msgr2=0x7f97180c0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] conn(0x7f97180bdd70 0x7f97180c0210 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f97180b2990 msgr2=0x7f97180b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f97180b2990 0x7f97180b4e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f971c003760 tx=0x7f971c005fb0 comp rx=0 tx=0).stop 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730102380 msgr2=0x7f97301a01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 --2- 172.21.15.70:0/3382496801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9730102380 0x7f97301a01e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f972400b530 tx=0x7f972400b8f0 comp rx=0 tx=0).stop 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736000700 1 -- 172.21.15.70:0/3382496801 reap_dead start 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 shutdown_connections 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 >> 172.21.15.70:0/3382496801 conn(0x7f97300fddc0 msgr2=0x7f9730105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:43:59.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 shutdown_connections 2024-05-08T06:43:59.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:43:59.956+0000 7f9736a00700 1 -- 172.21.15.70:0/3382496801 wait complete. 2024-05-08T06:44:00.165 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:01.356 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:01 smithi070 ceph-mon[29591]: pgmap v465: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T06:44:01.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.266+0000 7fb9aee00700 1 -- 172.21.15.70:0/1822004139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9a81055d0 msgr2=0x7fb9a8105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.266+0000 7fb9aee00700 1 --2- 172.21.15.70:0/1822004139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9a81055d0 0x7fb9a8105a50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb9940099c0 tx=0x7fb994009cd0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.266+0000 7fb9aee00700 1 -- 172.21.15.70:0/1822004139 shutdown_connections 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.266+0000 7fb9aee00700 1 --2- 172.21.15.70:0/1822004139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9a8105f90 0x7fb9a8112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.266+0000 7fb9aee00700 1 --2- 172.21.15.70:0/1822004139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a810b680 0x7fb9a810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.266+0000 7fb9aee00700 1 --2- 172.21.15.70:0/1822004139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9a81055d0 0x7fb9a8105a50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.266+0000 7fb9aee00700 1 -- 172.21.15.70:0/1822004139 >> 172.21.15.70:0/1822004139 conn(0x7fb9a81010e0 msgr2=0x7fb9a8103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.266+0000 7fb9aee00700 1 -- 172.21.15.70:0/1822004139 shutdown_connections 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.266+0000 7fb9aee00700 1 -- 172.21.15.70:0/1822004139 wait complete. 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.267+0000 7fb9aee00700 1 Processor -- start 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.267+0000 7fb9aee00700 1 -- start start 2024-05-08T06:44:01.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9aee00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9a81055d0 0x7fb9a81a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9aee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a8105f90 0x7fb9a81a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9aee00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9a810b680 0x7fb9a819b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9aee00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8115690 con 0x7fb9a810b680 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9aee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8115510 con 0x7fb9a8105f90 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9aee00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8115810 con 0x7fb9a81055d0 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9ae400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9a810b680 0x7fb9a819b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9ae400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9a810b680 0x7fb9a819b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48238/0 (socket says 172.21.15.70:48238) 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9ae400700 1 -- 172.21.15.70:0/2053310427 learned_addr learned my addr 172.21.15.70:0/2053310427 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9ada00700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9a81055d0 0x7fb9a81a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.268+0000 7fb9ad000700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a8105f90 0x7fb9a81a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9ae400700 1 -- 172.21.15.70:0/2053310427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9a81055d0 msgr2=0x7fb9a81a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9ae400700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9a81055d0 0x7fb9a81a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9ae400700 1 -- 172.21.15.70:0/2053310427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a8105f90 msgr2=0x7fb9a81a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9ae400700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb9a8105f90 0x7fb9a81a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9ae400700 1 -- 172.21.15.70:0/2053310427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a819c0b0 con 0x7fb9a810b680 2024-05-08T06:44:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9ae400700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9a810b680 0x7fb9a819b950 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0007ee0 tx=0x7fb9a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9a6000700 1 -- 172.21.15.70:0/2053310427 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a000dbd0 con 0x7fb9a810b680 2024-05-08T06:44:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9a6000700 1 -- 172.21.15.70:0/2053310427 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9a000dd70 con 0x7fb9a810b680 2024-05-08T06:44:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a819c3a0 con 0x7fb9a810b680 2024-05-08T06:44:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.269+0000 7fb9a6000700 1 -- 172.21.15.70:0/2053310427 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00058d0 con 0x7fb9a810b680 2024-05-08T06:44:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.270+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a81a8610 con 0x7fb9a810b680 2024-05-08T06:44:01.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.271+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb9a8063c30 con 0x7fb9a810b680 2024-05-08T06:44:01.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.273+0000 7fb9a6000700 1 -- 172.21.15.70:0/2053310427 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb9a001a020 con 0x7fb9a810b680 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.274+0000 7fb9a6000700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb9900b2990 0x7fb9900b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.275+0000 7fb9a6000700 1 -- 172.21.15.70:0/2053310427 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fb9a00e25f0 con 0x7fb9a810b680 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.275+0000 7fb9ada00700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb9900b2990 0x7fb9900b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.275+0000 7fb9a6000700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] conn(0x7fb9900bdd70 0x7fb9900c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.275+0000 7fb9a6000700 1 -- 172.21.15.70:0/2053310427 --> [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9900c08e0 con 0x7fb9900bdd70 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.275+0000 7fb9a6000700 1 -- 172.21.15.70:0/2053310427 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fb9a00e29a0 con 0x7fb9a810b680 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.275+0000 7fb9ada00700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb9900b2990 0x7fb9900b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9a810a7a0 tx=0x7fb99c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.276+0000 7fb9ad000700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] conn(0x7fb9900bdd70 0x7fb9900c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.277+0000 7fb9ad000700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] conn(0x7fb9900bdd70 0x7fb9900c0210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.279+0000 7fb9a6000700 1 -- 172.21.15.70:0/2053310427 <== osd.10 v2:172.21.15.172:6824/1417359106 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb9900c08e0 con 0x7fb9900bdd70 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.297+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 --> [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb9a80640b0 con 0x7fb9900bdd70 2024-05-08T06:44:01.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.298+0000 7fb9a6000700 1 -- 172.21.15.70:0/2053310427 <== osd.10 v2:172.21.15.172:6824/1417359106 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb9a80640b0 con 0x7fb9900bdd70 2024-05-08T06:44:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 >> [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] conn(0x7fb9900bdd70 msgr2=0x7fb9900c0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] conn(0x7fb9900bdd70 0x7fb9900c0210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb9900b2990 msgr2=0x7fb9900b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fb9900b2990 0x7fb9900b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9a810a7a0 tx=0x7fb99c00b410 comp rx=0 tx=0).stop 2024-05-08T06:44:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9a810b680 msgr2=0x7fb9a819b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 --2- 172.21.15.70:0/2053310427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9a810b680 0x7fb9a819b950 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0007ee0 tx=0x7fb9a000d3b0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9ae400700 1 -- 172.21.15.70:0/2053310427 reap_dead start 2024-05-08T06:44:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 shutdown_connections 2024-05-08T06:44:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 >> 172.21.15.70:0/2053310427 conn(0x7fb9a81010e0 msgr2=0x7fb9a81028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 shutdown_connections 2024-05-08T06:44:01.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:01.299+0000 7fb9aee00700 1 -- 172.21.15.70:0/2053310427 wait complete. 2024-05-08T06:44:01.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:01 smithi172 ceph-mon[33377]: pgmap v465: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T06:44:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:01 smithi194 ceph-mon[33679]: pgmap v465: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T06:44:01.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.702+0000 7fc64d600700 1 -- 172.21.15.70:0/1554599460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc64810fea0 msgr2=0x7fc648112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.702+0000 7fc64d600700 1 --2- 172.21.15.70:0/1554599460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc64810fea0 0x7fc648112290 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc64000b0a0 tx=0x7fc64000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.702+0000 7fc64d600700 1 -- 172.21.15.70:0/1554599460 shutdown_connections 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.702+0000 7fc64d600700 1 --2- 172.21.15.70:0/1554599460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc64810fea0 0x7fc648112290 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.702+0000 7fc64d600700 1 --2- 172.21.15.70:0/1554599460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6480756d0 0x7fc648075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.702+0000 7fc64d600700 1 --2- 172.21.15.70:0/1554599460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc648075ff0 0x7fc64810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.702+0000 7fc64d600700 1 -- 172.21.15.70:0/1554599460 >> 172.21.15.70:0/1554599460 conn(0x7fc64807a600 msgr2=0x7fc64807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.702+0000 7fc64d600700 1 -- 172.21.15.70:0/1554599460 shutdown_connections 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.702+0000 7fc64d600700 1 -- 172.21.15.70:0/1554599460 wait complete. 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.703+0000 7fc64d600700 1 Processor -- start 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc64d600700 1 -- start start 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc64d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6480756d0 0x7fc6481a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc64d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc648075ff0 0x7fc6481a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc64d600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64810fea0 0x7fc64819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc64d600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc648115730 con 0x7fc6480756d0 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc64d600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc6481155b0 con 0x7fc648075ff0 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc64d600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc6481158b0 con 0x7fc64810fea0 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc646a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6480756d0 0x7fc6481a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc646a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6480756d0 0x7fc6481a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48210/0 (socket says 172.21.15.70:48210) 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.704+0000 7fc646a00700 1 -- 172.21.15.70:0/2891187361 learned_addr learned my addr 172.21.15.70:0/2891187361 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc646000700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc648075ff0 0x7fc6481a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc647400700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64810fea0 0x7fc64819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc646a00700 1 -- 172.21.15.70:0/2891187361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64810fea0 msgr2=0x7fc64819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc646a00700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64810fea0 0x7fc64819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc646a00700 1 -- 172.21.15.70:0/2891187361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc648075ff0 msgr2=0x7fc6481a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc646a00700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc648075ff0 0x7fc6481a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc646a00700 1 -- 172.21.15.70:0/2891187361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64819c0f0 con 0x7fc6480756d0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc646a00700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6480756d0 0x7fc6481a17d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc63800c9b0 tx=0x7fc63800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc63f400700 1 -- 172.21.15.70:0/2891187361 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638007b00 con 0x7fc6480756d0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc63f400700 1 -- 172.21.15.70:0/2891187361 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc638007ca0 con 0x7fc6480756d0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.705+0000 7fc63f400700 1 -- 172.21.15.70:0/2891187361 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc638018660 con 0x7fc6480756d0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.706+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64819c3e0 con 0x7fc6480756d0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.706+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6481a86a0 con 0x7fc6480756d0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.707+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc648063c30 con 0x7fc6480756d0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.709+0000 7fc63f400700 1 -- 172.21.15.70:0/2891187361 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc63800f450 con 0x7fc6480756d0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.711+0000 7fc63f400700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc62c0b2990 0x7fc62c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.711+0000 7fc63f400700 1 -- 172.21.15.70:0/2891187361 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fc6380e2c10 con 0x7fc6480756d0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.711+0000 7fc646000700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc62c0b2990 0x7fc62c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.711+0000 7fc63f400700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] conn(0x7fc62c0bdd70 0x7fc62c0c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:01.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.711+0000 7fc63f400700 1 -- 172.21.15.70:0/2891187361 --> [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc638007e50 con 0x7fc62c0bdd70 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.711+0000 7fc63f400700 1 -- 172.21.15.70:0/2891187361 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fc6380e3060 con 0x7fc6480756d0 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.712+0000 7fc646000700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc62c0b2990 0x7fc62c0b4e50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc634005fd0 tx=0x7fc634005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.712+0000 7fc647400700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] conn(0x7fc62c0bdd70 0x7fc62c0c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.713+0000 7fc647400700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] conn(0x7fc62c0bdd70 0x7fc62c0c0210 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.716+0000 7fc63f400700 1 -- 172.21.15.70:0/2891187361 <== osd.4 v2:172.21.15.172:6808/3980608525 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc638007e50 con 0x7fc62c0bdd70 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.734+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 --> [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc648064030 con 0x7fc62c0bdd70 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.735+0000 7fc63f400700 1 -- 172.21.15.70:0/2891187361 <== osd.4 v2:172.21.15.172:6808/3980608525 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc648064030 con 0x7fc62c0bdd70 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.735+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 >> [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] conn(0x7fc62c0bdd70 msgr2=0x7fc62c0c0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.735+0000 7fc64d600700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] conn(0x7fc62c0bdd70 0x7fc62c0c0210 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.736+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc62c0b2990 msgr2=0x7fc62c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.736+0000 7fc64d600700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc62c0b2990 0x7fc62c0b4e50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc634005fd0 tx=0x7fc634005db0 comp rx=0 tx=0).stop 2024-05-08T06:44:01.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.736+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6480756d0 msgr2=0x7fc6481a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:01.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.736+0000 7fc64d600700 1 --2- 172.21.15.70:0/2891187361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6480756d0 0x7fc6481a17d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc63800c9b0 tx=0x7fc63800cd70 comp rx=0 tx=0).stop 2024-05-08T06:44:01.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.736+0000 7fc647400700 1 -- 172.21.15.70:0/2891187361 reap_dead start 2024-05-08T06:44:01.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.736+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 shutdown_connections 2024-05-08T06:44:01.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.736+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 >> 172.21.15.70:0/2891187361 conn(0x7fc64807a600 msgr2=0x7fc648100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:01.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.736+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 shutdown_connections 2024-05-08T06:44:01.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:00.736+0000 7fc64d600700 1 -- 172.21.15.70:0/2891187361 wait complete. 2024-05-08T06:44:02.884 INFO:teuthology.orchestra.run.smithi070.stdout:34359738496 2024-05-08T06:44:02.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-08T06:44:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:03 smithi070 ceph-mon[29591]: pgmap v466: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T06:44:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:03 smithi172 ceph-mon[33377]: pgmap v466: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T06:44:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:03 smithi194 ceph-mon[33679]: pgmap v466: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T06:44:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.483+0000 7febf5e00700 1 -- 172.21.15.70:0/2958246873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febf010b6d0 msgr2=0x7febf010bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.483+0000 7febf5e00700 1 --2- 172.21.15.70:0/2958246873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febf010b6d0 0x7febf010bab0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7febe0009990 tx=0x7febe0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.483+0000 7febf5e00700 1 -- 172.21.15.70:0/2958246873 shutdown_connections 2024-05-08T06:44:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.483+0000 7febf5e00700 1 --2- 172.21.15.70:0/2958246873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf0106090 0x7febf01125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.483+0000 7febf5e00700 1 --2- 172.21.15.70:0/2958246873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febf010b6d0 0x7febf010bab0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.483+0000 7febf5e00700 1 --2- 172.21.15.70:0/2958246873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febf01056d0 0x7febf0105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.483+0000 7febf5e00700 1 -- 172.21.15.70:0/2958246873 >> 172.21.15.70:0/2958246873 conn(0x7febf01011a0 msgr2=0x7febf01035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.483+0000 7febf5e00700 1 -- 172.21.15.70:0/2958246873 shutdown_connections 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.483+0000 7febf5e00700 1 -- 172.21.15.70:0/2958246873 wait complete. 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.484+0000 7febf5e00700 1 Processor -- start 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.485+0000 7febf5e00700 1 -- start start 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.485+0000 7febf5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febf01056d0 0x7febf00779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.485+0000 7febf5e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febf0106090 0x7febf0077ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.485+0000 7febf5e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf010b6d0 0x7febf0078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.485+0000 7febf5e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7febf0115760 con 0x7febf01056d0 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.485+0000 7febf5e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7febf01155e0 con 0x7febf010b6d0 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.485+0000 7febf5e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7febf01158e0 con 0x7febf0106090 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febeea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febf01056d0 0x7febf00779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febeea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febf01056d0 0x7febf00779b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48266/0 (socket says 172.21.15.70:48266) 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febeea00700 1 -- 172.21.15.70:0/3351732278 learned_addr learned my addr 172.21.15.70:0/3351732278 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febe7e00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febf0106090 0x7febf0077ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febef400700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf010b6d0 0x7febf0078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febeea00700 1 -- 172.21.15.70:0/3351732278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febf0106090 msgr2=0x7febf0077ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febeea00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febf0106090 0x7febf0077ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febeea00700 1 -- 172.21.15.70:0/3351732278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf010b6d0 msgr2=0x7febf0078430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febeea00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7febf010b6d0 0x7febf0078430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febeea00700 1 -- 172.21.15.70:0/3351732278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf01ac2e0 con 0x7febf01056d0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.486+0000 7febeea00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febf01056d0 0x7febf00779b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7febe000c010 tx=0x7febe00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.487+0000 7febf4a00700 1 -- 172.21.15.70:0/3351732278 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe0027070 con 0x7febf01056d0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.487+0000 7febf4a00700 1 -- 172.21.15.70:0/3351732278 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7febe000fda0 con 0x7febf01056d0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.487+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf01ac570 con 0x7febf01056d0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.487+0000 7febf4a00700 1 -- 172.21.15.70:0/3351732278 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe00173f0 con 0x7febf01056d0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.487+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf01ac9c0 con 0x7febf01056d0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.488+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febf0063c30 con 0x7febf01056d0 2024-05-08T06:44:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.492+0000 7febf4a00700 1 -- 172.21.15.70:0/3351732278 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7febe002a070 con 0x7febf01056d0 2024-05-08T06:44:03.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.493+0000 7febf4a00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7febd40b2940 0x7febd40b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:03.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.494+0000 7febf4a00700 1 -- 172.21.15.70:0/3351732278 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7febe00e3fa0 con 0x7febf01056d0 2024-05-08T06:44:03.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.494+0000 7febe7e00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7febd40b2940 0x7febd40b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:03.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.494+0000 7febf4a00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] conn(0x7febd40bdd20 0x7febd40c01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:03.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.494+0000 7febf4a00700 1 -- 172.21.15.70:0/3351732278 --> [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febd40c0890 con 0x7febd40bdd20 2024-05-08T06:44:03.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.494+0000 7febf4a00700 1 -- 172.21.15.70:0/3351732278 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7febe00e43f0 con 0x7febf01056d0 2024-05-08T06:44:03.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.494+0000 7febef400700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] conn(0x7febd40bdd20 0x7febd40c01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:03.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.495+0000 7febe7e00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7febd40b2940 0x7febd40b4e00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7febd8005fd0 tx=0x7febd800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:03.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.495+0000 7febef400700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] conn(0x7febd40bdd20 0x7febd40c01c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.496+0000 7febf4a00700 1 -- 172.21.15.70:0/3351732278 <== osd.6 v2:172.21.15.70:6818/2584912798 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7febd40c0890 con 0x7febd40bdd20 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.514+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 --> [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7febf00640b0 con 0x7febd40bdd20 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febf4a00700 1 -- 172.21.15.70:0/3351732278 <== osd.6 v2:172.21.15.70:6818/2584912798 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7febf00640b0 con 0x7febd40bdd20 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] conn(0x7febd40bdd20 msgr2=0x7febd40c01c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febf5e00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] conn(0x7febd40bdd20 0x7febd40c01c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7febd40b2940 msgr2=0x7febd40b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febf5e00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7febd40b2940 0x7febd40b4e00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7febd8005fd0 tx=0x7febd800a560 comp rx=0 tx=0).stop 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febf01056d0 msgr2=0x7febf00779b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febf5e00700 1 --2- 172.21.15.70:0/3351732278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7febf01056d0 0x7febf00779b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7febe000c010 tx=0x7febe00047b0 comp rx=0 tx=0).stop 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febef400700 1 -- 172.21.15.70:0/3351732278 reap_dead start 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 shutdown_connections 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.515+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 >> 172.21.15.70:0/3351732278 conn(0x7febf01011a0 msgr2=0x7febf01019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.516+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 shutdown_connections 2024-05-08T06:44:03.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:03.516+0000 7febf5e00700 1 -- 172.21.15.70:0/3351732278 wait complete. 2024-05-08T06:44:05.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:05 smithi070 ceph-mon[29591]: pgmap v467: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-05-08T06:44:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:05 smithi172 ceph-mon[33377]: pgmap v467: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-05-08T06:44:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:05 smithi194 ceph-mon[33679]: pgmap v467: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2024-05-08T06:44:06.115 INFO:teuthology.orchestra.run.smithi070.stdout:137438953576 2024-05-08T06:44:06.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-08T06:44:07.353 INFO:teuthology.orchestra.run.smithi070.stdout:313532612661 2024-05-08T06:44:07.354 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-08T06:44:07.491 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:07 smithi070 ceph-mon[29591]: pgmap v468: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-08T06:44:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:07 smithi172 ceph-mon[33377]: pgmap v468: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-08T06:44:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:07 smithi194 ceph-mon[33679]: pgmap v468: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-05-08T06:44:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.481+0000 7f6126e00700 1 -- 172.21.15.70:0/3438108990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612010fdf0 msgr2=0x7f61201121e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.481+0000 7f6126e00700 1 --2- 172.21.15.70:0/3438108990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612010fdf0 0x7f61201121e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f611800b0a0 tx=0x7f611800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.481+0000 7f6126e00700 1 -- 172.21.15.70:0/3438108990 shutdown_connections 2024-05-08T06:44:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.481+0000 7f6126e00700 1 --2- 172.21.15.70:0/3438108990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f612010fdf0 0x7f61201121e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.481+0000 7f6126e00700 1 --2- 172.21.15.70:0/3438108990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61201043b0 0x7f612006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.481+0000 7f6126e00700 1 --2- 172.21.15.70:0/3438108990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612006c0b0 0x7f612006c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.481+0000 7f6126e00700 1 -- 172.21.15.70:0/3438108990 >> 172.21.15.70:0/3438108990 conn(0x7f6120079350 msgr2=0x7f6120079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.481+0000 7f6126e00700 1 -- 172.21.15.70:0/3438108990 shutdown_connections 2024-05-08T06:44:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.481+0000 7f6126e00700 1 -- 172.21.15.70:0/3438108990 wait complete. 2024-05-08T06:44:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.482+0000 7f6126e00700 1 Processor -- start 2024-05-08T06:44:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.483+0000 7f6126e00700 1 -- start start 2024-05-08T06:44:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.483+0000 7f6126e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612006c0b0 0x7f61201a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.483+0000 7f6126e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61201043b0 0x7f61201a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.483+0000 7f6126e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612010fdf0 0x7f612019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.483+0000 7f6126e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6120115780 con 0x7f61201043b0 2024-05-08T06:44:08.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.483+0000 7f6126e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6120115600 con 0x7f612010fdf0 2024-05-08T06:44:08.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.483+0000 7f6126e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6120115900 con 0x7f612006c0b0 2024-05-08T06:44:08.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.483+0000 7f6117e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61201043b0 0x7f61201a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f6117e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61201043b0 0x7f61201a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53254/0 (socket says 172.21.15.70:53254) 2024-05-08T06:44:08.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f6117e00700 1 -- 172.21.15.70:0/1706976073 learned_addr learned my addr 172.21.15.70:0/1706976073 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:08.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f611fe00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612006c0b0 0x7f61201a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f6124e00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612010fdf0 0x7f612019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f6117e00700 1 -- 172.21.15.70:0/1706976073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612006c0b0 msgr2=0x7f61201a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f6117e00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612006c0b0 0x7f61201a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f6117e00700 1 -- 172.21.15.70:0/1706976073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612010fdf0 msgr2=0x7f612019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f6117e00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f612010fdf0 0x7f612019baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f6117e00700 1 -- 172.21.15.70:0/1706976073 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612019c200 con 0x7f61201043b0 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.484+0000 7f6117e00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61201043b0 0x7f61201a1e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f610800b530 tx=0x7f610800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.485+0000 7f611d600700 1 -- 172.21.15.70:0/1706976073 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108015020 con 0x7f61201043b0 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.485+0000 7f611d600700 1 -- 172.21.15.70:0/1706976073 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6108011cc0 con 0x7f61201043b0 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.485+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612019c490 con 0x7f61201043b0 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.485+0000 7f611d600700 1 -- 172.21.15.70:0/1706976073 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108010dc0 con 0x7f61201043b0 2024-05-08T06:44:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.485+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61201a87b0 con 0x7f61201043b0 2024-05-08T06:44:08.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.486+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61201021d0 con 0x7f61201043b0 2024-05-08T06:44:08.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.488+0000 7f611d600700 1 -- 172.21.15.70:0/1706976073 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6108018020 con 0x7f61201043b0 2024-05-08T06:44:08.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.490+0000 7f611d600700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f61040b2910 0x7f61040b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.490+0000 7f611d600700 1 -- 172.21.15.70:0/1706976073 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f61080e2590 con 0x7f61201043b0 2024-05-08T06:44:08.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.490+0000 7f611fe00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f61040b2910 0x7f61040b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.490+0000 7f611d600700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] conn(0x7f61040bdcf0 0x7f61040c0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.490+0000 7f611d600700 1 -- 172.21.15.70:0/1706976073 --> [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61080044e0 con 0x7f61040bdcf0 2024-05-08T06:44:08.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.490+0000 7f611d600700 1 -- 172.21.15.70:0/1706976073 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f61080e29e0 con 0x7f61201043b0 2024-05-08T06:44:08.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.491+0000 7f611fe00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f61040b2910 0x7f61040b4dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f612019cbe0 tx=0x7f611000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:08.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.491+0000 7f6124e00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] conn(0x7f61040bdcf0 0x7f61040c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.492+0000 7f6124e00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] conn(0x7f61040bdcf0 0x7f61040c0190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:08.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.495+0000 7f611d600700 1 -- 172.21.15.70:0/1706976073 <== osd.1 v2:172.21.15.172:6800/3666956489 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61080044e0 con 0x7f61040bdcf0 2024-05-08T06:44:08.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.513+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 --> [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f612006b420 con 0x7f61040bdcf0 2024-05-08T06:44:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.514+0000 7f611d600700 1 -- 172.21.15.70:0/1706976073 <== osd.1 v2:172.21.15.172:6800/3666956489 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f612006b420 con 0x7f61040bdcf0 2024-05-08T06:44:08.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.514+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 >> [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] conn(0x7f61040bdcf0 msgr2=0x7f61040c0190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.514+0000 7f6126e00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] conn(0x7f61040bdcf0 0x7f61040c0190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.515+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f61040b2910 msgr2=0x7f61040b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.515+0000 7f6126e00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f61040b2910 0x7f61040b4dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f612019cbe0 tx=0x7f611000a380 comp rx=0 tx=0).stop 2024-05-08T06:44:08.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.515+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61201043b0 msgr2=0x7f61201a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.515+0000 7f6126e00700 1 --2- 172.21.15.70:0/1706976073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61201043b0 0x7f61201a1e20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f610800b530 tx=0x7f610800b840 comp rx=0 tx=0).stop 2024-05-08T06:44:08.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.515+0000 7f6124e00700 1 -- 172.21.15.70:0/1706976073 reap_dead start 2024-05-08T06:44:08.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.515+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 shutdown_connections 2024-05-08T06:44:08.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.515+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 >> 172.21.15.70:0/1706976073 conn(0x7f6120079350 msgr2=0x7f6120101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:08.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.515+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 shutdown_connections 2024-05-08T06:44:08.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.515+0000 7f6126e00700 1 -- 172.21.15.70:0/1706976073 wait complete. 2024-05-08T06:44:08.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.328+0000 7f70d2200700 1 -- 172.21.15.70:0/2493690583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70cc06b180 msgr2=0x7f70cc06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.328+0000 7f70d2200700 1 --2- 172.21.15.70:0/2493690583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70cc06b180 0x7f70cc06b600 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009990 tx=0x7f70b8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.328+0000 7f70d2200700 1 -- 172.21.15.70:0/2493690583 shutdown_connections 2024-05-08T06:44:08.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.328+0000 7f70d2200700 1 --2- 172.21.15.70:0/2493690583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70cc06bb40 0x7f70cc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.328+0000 7f70d2200700 1 --2- 172.21.15.70:0/2493690583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70cc109510 0x7f70cc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.328+0000 7f70d2200700 1 --2- 172.21.15.70:0/2493690583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70cc06b180 0x7f70cc06b600 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.328+0000 7f70d2200700 1 -- 172.21.15.70:0/2493690583 >> 172.21.15.70:0/2493690583 conn(0x7f70cc079350 msgr2=0x7f70cc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.329+0000 7f70d2200700 1 -- 172.21.15.70:0/2493690583 shutdown_connections 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.329+0000 7f70d2200700 1 -- 172.21.15.70:0/2493690583 wait complete. 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.330+0000 7f70d2200700 1 Processor -- start 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.330+0000 7f70d2200700 1 -- start start 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.331+0000 7f70d2200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70cc06b180 0x7f70cc19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.331+0000 7f70d2200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70cc06bb40 0x7f70cc19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.331+0000 7f70d2200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70cc109510 0x7f70cc1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.331+0000 7f70d2200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc113540 con 0x7f70cc06b180 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.331+0000 7f70d2200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc1133c0 con 0x7f70cc109510 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.331+0000 7f70d2200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f70cc1136c0 con 0x7f70cc06bb40 2024-05-08T06:44:08.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.331+0000 7f70cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70cc06b180 0x7f70cc19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.331+0000 7f70cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70cc06b180 0x7f70cc19bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53230/0 (socket says 172.21.15.70:53230) 2024-05-08T06:44:08.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.331+0000 7f70cb400700 1 -- 172.21.15.70:0/334189863 learned_addr learned my addr 172.21.15.70:0/334189863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:08.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70caa00700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70cc06bb40 0x7f70cc19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70cbe00700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70cc109510 0x7f70cc1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70cb400700 1 -- 172.21.15.70:0/334189863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70cc06bb40 msgr2=0x7f70cc19c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70cb400700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70cc06bb40 0x7f70cc19c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70cb400700 1 -- 172.21.15.70:0/334189863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70cc109510 msgr2=0x7f70cc1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70cb400700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70cc109510 0x7f70cc1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70cb400700 1 -- 172.21.15.70:0/334189863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70cc1a0d20 con 0x7f70cc06b180 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70cb400700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70cc06b180 0x7f70cc19bd10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00d980 tx=0x7f70bc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70c3e00700 1 -- 172.21.15.70:0/334189863 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc017070 con 0x7f70cc06b180 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70c3e00700 1 -- 172.21.15.70:0/334189863 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70bc004830 con 0x7f70cc06b180 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.332+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70cc1a1010 con 0x7f70cc06b180 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.333+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70cc1a8890 con 0x7f70cc06b180 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.333+0000 7f70c3e00700 1 -- 172.21.15.70:0/334189863 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc0053a0 con 0x7f70cc06b180 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.333+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70ac001030 con 0x7f70cc06b180 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.336+0000 7f70c3e00700 1 -- 172.21.15.70:0/334189863 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f70bc005540 con 0x7f70cc06b180 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.338+0000 7f70c3e00700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f70b00b2910 0x7f70b00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.338+0000 7f70c3e00700 1 -- 172.21.15.70:0/334189863 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f70bc0e2c40 con 0x7f70cc06b180 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.338+0000 7f70caa00700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f70b00b2910 0x7f70b00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.338+0000 7f70c3e00700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] conn(0x7f70b00bdcf0 0x7f70b00c0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.338+0000 7f70c3e00700 1 -- 172.21.15.70:0/334189863 --> [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70bc026e50 con 0x7f70b00bdcf0 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.338+0000 7f70c3e00700 1 -- 172.21.15.70:0/334189863 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f70bc0e2ff0 con 0x7f70cc06b180 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.339+0000 7f70cbe00700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] conn(0x7f70b00bdcf0 0x7f70b00c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.339+0000 7f70caa00700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f70b00b2910 0x7f70b00b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f70b800b5c0 tx=0x7f70b801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.339+0000 7f70cbe00700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] conn(0x7f70b00bdcf0 0x7f70b00c0190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.340+0000 7f70c3e00700 1 -- 172.21.15.70:0/334189863 <== osd.3 v2:172.21.15.70:6810/3483817931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70bc026e50 con 0x7f70b00bdcf0 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.358+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 --> [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f70ac002e60 con 0x7f70b00bdcf0 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.359+0000 7f70c3e00700 1 -- 172.21.15.70:0/334189863 <== osd.3 v2:172.21.15.70:6810/3483817931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f70ac002e60 con 0x7f70b00bdcf0 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.359+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] conn(0x7f70b00bdcf0 msgr2=0x7f70b00c0190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.359+0000 7f70d2200700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] conn(0x7f70b00bdcf0 0x7f70b00c0190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.359+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f70b00b2910 msgr2=0x7f70b00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.359+0000 7f70d2200700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f70b00b2910 0x7f70b00b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f70b800b5c0 tx=0x7f70b801a040 comp rx=0 tx=0).stop 2024-05-08T06:44:08.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.359+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70cc06b180 msgr2=0x7f70cc19bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:08.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.359+0000 7f70d2200700 1 --2- 172.21.15.70:0/334189863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70cc06b180 0x7f70cc19bd10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f70bc00d980 tx=0x7f70bc00dd40 comp rx=0 tx=0).stop 2024-05-08T06:44:08.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.360+0000 7f70cbe00700 1 -- 172.21.15.70:0/334189863 reap_dead start 2024-05-08T06:44:08.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.360+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 shutdown_connections 2024-05-08T06:44:08.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.360+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 >> 172.21.15.70:0/334189863 conn(0x7f70cc079350 msgr2=0x7f70cc10e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:08.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.360+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 shutdown_connections 2024-05-08T06:44:08.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:08.360+0000 7f70d2200700 1 -- 172.21.15.70:0/334189863 wait complete. 2024-05-08T06:44:09.493 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:09 smithi070 ceph-mon[29591]: pgmap v469: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:09 smithi172 ceph-mon[33377]: pgmap v469: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:09.752 INFO:teuthology.orchestra.run.smithi070.stdout:111669149807 2024-05-08T06:44:09.752 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-08T06:44:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:09 smithi194 ceph-mon[33679]: pgmap v469: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:10.772 INFO:teuthology.orchestra.run.smithi070.stdout:214748364881 2024-05-08T06:44:10.772 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-08T06:44:10.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.493+0000 7ff997200700 1 -- 172.21.15.70:0/1575130746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9901099e0 msgr2=0x7ff990109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:10.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.493+0000 7ff997200700 1 --2- 172.21.15.70:0/1575130746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9901099e0 0x7ff990109e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff980009990 tx=0x7ff980009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.493+0000 7ff997200700 1 -- 172.21.15.70:0/1575130746 shutdown_connections 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.493+0000 7ff997200700 1 --2- 172.21.15.70:0/1575130746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff99010a3a0 0x7ff990116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.493+0000 7ff997200700 1 --2- 172.21.15.70:0/1575130746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99010e8b0 0x7ff99010ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.493+0000 7ff997200700 1 --2- 172.21.15.70:0/1575130746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9901099e0 0x7ff990109e60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.493+0000 7ff997200700 1 -- 172.21.15.70:0/1575130746 >> 172.21.15.70:0/1575130746 conn(0x7ff990079230 msgr2=0x7ff9901082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.493+0000 7ff997200700 1 -- 172.21.15.70:0/1575130746 shutdown_connections 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.493+0000 7ff997200700 1 -- 172.21.15.70:0/1575130746 wait complete. 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.495+0000 7ff997200700 1 Processor -- start 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.495+0000 7ff997200700 1 -- start start 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.495+0000 7ff997200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9901099e0 0x7ff99019ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.495+0000 7ff997200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff99010a3a0 0x7ff9901a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff997200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99010e8b0 0x7ff9901a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:10.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff997200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff990119a90 con 0x7ff99010a3a0 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff997200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff990119910 con 0x7ff99010e8b0 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff997200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff990119c10 con 0x7ff9901099e0 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff99010a3a0 0x7ff9901a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff99010a3a0 0x7ff9901a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53282/0 (socket says 172.21.15.70:53282) 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995400700 1 -- 172.21.15.70:0/1114489256 learned_addr learned my addr 172.21.15.70:0/1114489256 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995e00700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9901099e0 0x7ff99019ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995400700 1 -- 172.21.15.70:0/1114489256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9901099e0 msgr2=0x7ff99019ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995400700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9901099e0 0x7ff99019ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995400700 1 -- 172.21.15.70:0/1114489256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99010e8b0 msgr2=0x7ff9901a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995400700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff99010e8b0 0x7ff9901a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995400700 1 -- 172.21.15.70:0/1114489256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9901a4fd0 con 0x7ff99010a3a0 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.496+0000 7ff995e00700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9901099e0 0x7ff99019ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.497+0000 7ff995400700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff99010a3a0 0x7ff9901a0500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff980000c00 tx=0x7ff9800036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:10.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.497+0000 7ff98aa00700 1 -- 172.21.15.70:0/1114489256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980027070 con 0x7ff99010a3a0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.497+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9901a5260 con 0x7ff99010a3a0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.497+0000 7ff98aa00700 1 -- 172.21.15.70:0/1114489256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff98000fc80 con 0x7ff99010a3a0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.497+0000 7ff98aa00700 1 -- 172.21.15.70:0/1114489256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980022d60 con 0x7ff99010a3a0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.497+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9901acb40 con 0x7ff99010a3a0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.498+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff990063bb0 con 0x7ff99010a3a0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.501+0000 7ff98aa00700 1 -- 172.21.15.70:0/1114489256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff98002a070 con 0x7ff99010a3a0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.502+0000 7ff98aa00700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff9780b2910 0x7ff9780b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.502+0000 7ff98aa00700 1 -- 172.21.15.70:0/1114489256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7ff9800e3bb0 con 0x7ff99010a3a0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.503+0000 7ff995e00700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff9780b2910 0x7ff9780b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.503+0000 7ff98aa00700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] conn(0x7ff9780bdbc0 0x7ff9780c0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.503+0000 7ff98aa00700 1 -- 172.21.15.70:0/1114489256 --> [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff980007e80 con 0x7ff9780bdbc0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.503+0000 7ff98aa00700 1 -- 172.21.15.70:0/1114489256 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7ff9800e3f60 con 0x7ff99010a3a0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.503+0000 7ff996800700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] conn(0x7ff9780bdbc0 0x7ff9780c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.504+0000 7ff995e00700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff9780b2910 0x7ff9780b4dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff98400baa0 tx=0x7ff984005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:10.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.504+0000 7ff996800700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] conn(0x7ff9780bdbc0 0x7ff9780c0060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:10.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.505+0000 7ff98aa00700 1 -- 172.21.15.70:0/1114489256 <== osd.9 v2:172.21.15.70:6826/22141436 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff980007e80 con 0x7ff9780bdbc0 2024-05-08T06:44:10.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.523+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 --> [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff990064030 con 0x7ff9780bdbc0 2024-05-08T06:44:10.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.524+0000 7ff98aa00700 1 -- 172.21.15.70:0/1114489256 <== osd.9 v2:172.21.15.70:6826/22141436 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff990064030 con 0x7ff9780bdbc0 2024-05-08T06:44:10.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.524+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] conn(0x7ff9780bdbc0 msgr2=0x7ff9780c0060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:10.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.524+0000 7ff997200700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] conn(0x7ff9780bdbc0 0x7ff9780c0060 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:10.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.525+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff9780b2910 msgr2=0x7ff9780b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:10.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.525+0000 7ff997200700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7ff9780b2910 0x7ff9780b4dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff98400baa0 tx=0x7ff984005db0 comp rx=0 tx=0).stop 2024-05-08T06:44:10.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.525+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff99010a3a0 msgr2=0x7ff9901a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:10.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.525+0000 7ff997200700 1 --2- 172.21.15.70:0/1114489256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff99010a3a0 0x7ff9901a0500 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff980000c00 tx=0x7ff9800036f0 comp rx=0 tx=0).stop 2024-05-08T06:44:10.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.525+0000 7ff996800700 1 -- 172.21.15.70:0/1114489256 reap_dead start 2024-05-08T06:44:10.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.525+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 shutdown_connections 2024-05-08T06:44:10.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.525+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 >> 172.21.15.70:0/1114489256 conn(0x7ff990079230 msgr2=0x7ff9900798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:10.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.525+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 shutdown_connections 2024-05-08T06:44:10.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:09.525+0000 7ff997200700 1 -- 172.21.15.70:0/1114489256 wait complete. 2024-05-08T06:44:11.411 INFO:teuthology.orchestra.run.smithi070.stdout:55834574973 2024-05-08T06:44:11.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-08T06:44:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:11 smithi070 ceph-mon[29591]: pgmap v470: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:44:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:11 smithi172 ceph-mon[33377]: pgmap v470: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:44:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:11 smithi194 ceph-mon[33679]: pgmap v470: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:44:12.113 INFO:teuthology.orchestra.run.smithi070.stdout:188978561114 2024-05-08T06:44:12.114 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-08T06:44:13.426 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:13 smithi070 ceph-mon[29591]: pgmap v471: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:13.428 INFO:teuthology.orchestra.run.smithi070.stdout:287762808892 2024-05-08T06:44:13.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-08T06:44:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:13 smithi172 ceph-mon[33377]: pgmap v471: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.863+0000 7f7bb0000700 1 -- 172.21.15.70:0/702491371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ba8108850 msgr2=0x7f7ba81103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.863+0000 7f7bb0000700 1 --2- 172.21.15.70:0/702491371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ba8108850 0x7f7ba81103d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000b0d0 tx=0x7f7ba000b3e0 comp rx=0 tx=0).stop 2024-05-08T06:44:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.863+0000 7f7bb0000700 1 -- 172.21.15.70:0/702491371 shutdown_connections 2024-05-08T06:44:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.863+0000 7f7bb0000700 1 --2- 172.21.15.70:0/702491371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ba8108850 0x7f7ba81103d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:13.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.863+0000 7f7bb0000700 1 --2- 172.21.15.70:0/702491371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba8103750 0x7f7ba8103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.863+0000 7f7bb0000700 1 --2- 172.21.15.70:0/702491371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ba8104100 0x7f7ba8108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.863+0000 7f7bb0000700 1 -- 172.21.15.70:0/702491371 >> 172.21.15.70:0/702491371 conn(0x7f7ba807a600 msgr2=0x7f7ba807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.863+0000 7f7bb0000700 1 -- 172.21.15.70:0/702491371 shutdown_connections 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.863+0000 7f7bb0000700 1 -- 172.21.15.70:0/702491371 wait complete. 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.864+0000 7f7bb0000700 1 Processor -- start 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.864+0000 7f7bb0000700 1 -- start start 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bb0000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ba8103750 0x7f7ba81a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bb0000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba8104100 0x7f7ba81a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bb0000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ba8108850 0x7f7ba819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bb0000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba81135c0 con 0x7f7ba8103750 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bb0000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba8113440 con 0x7f7ba8104100 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bb0000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba8113740 con 0x7f7ba8108850 2024-05-08T06:44:13.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bad600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ba8103750 0x7f7ba81a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bad600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ba8103750 0x7f7ba81a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53312/0 (socket says 172.21.15.70:53312) 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bad600700 1 -- 172.21.15.70:0/2459322147 learned_addr learned my addr 172.21.15.70:0/2459322147 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bae000700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ba8108850 0x7f7ba819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bacc00700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba8104100 0x7f7ba81a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bad600700 1 -- 172.21.15.70:0/2459322147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ba8108850 msgr2=0x7f7ba819bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bad600700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ba8108850 0x7f7ba819bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.865+0000 7f7bad600700 1 -- 172.21.15.70:0/2459322147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba8104100 msgr2=0x7f7ba81a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.866+0000 7f7bad600700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7ba8104100 0x7f7ba81a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.866+0000 7f7bad600700 1 -- 172.21.15.70:0/2459322147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba819c220 con 0x7f7ba8103750 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.866+0000 7f7bad600700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ba8103750 0x7f7ba81a1900 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800b530 tx=0x7f7b9800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.866+0000 7f7ba6000700 1 -- 172.21.15.70:0/2459322147 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98015020 con 0x7f7ba8103750 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.866+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba819c510 con 0x7f7ba8103750 2024-05-08T06:44:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.866+0000 7f7ba6000700 1 -- 172.21.15.70:0/2459322147 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b98011cc0 con 0x7f7ba8103750 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.866+0000 7f7ba6000700 1 -- 172.21.15.70:0/2459322147 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b98010cd0 con 0x7f7ba8103750 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.866+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba81a87d0 con 0x7f7ba8103750 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.867+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ba8101ef0 con 0x7f7ba8103750 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.870+0000 7f7ba6000700 1 -- 172.21.15.70:0/2459322147 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7b98018020 con 0x7f7ba8103750 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.871+0000 7f7ba6000700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7b8c0b2910 0x7f7b8c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.871+0000 7f7ba6000700 1 -- 172.21.15.70:0/2459322147 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f7b980e2520 con 0x7f7ba8103750 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.872+0000 7f7bacc00700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7b8c0b2910 0x7f7b8c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.872+0000 7f7ba6000700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] conn(0x7f7b8c0bdcf0 0x7f7b8c0c0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.872+0000 7f7ba6000700 1 -- 172.21.15.70:0/2459322147 --> [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b9801be50 con 0x7f7b8c0bdcf0 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.872+0000 7f7ba6000700 1 -- 172.21.15.70:0/2459322147 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f7b980e2970 con 0x7f7ba8103750 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.872+0000 7f7bacc00700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7b8c0b2910 0x7f7b8c0b4dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8110810 tx=0x7f7b94005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.872+0000 7f7bae000700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] conn(0x7f7b8c0bdcf0 0x7f7b8c0c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.873+0000 7f7bae000700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] conn(0x7f7b8c0bdcf0 0x7f7b8c0c0190 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.876+0000 7f7ba6000700 1 -- 172.21.15.70:0/2459322147 <== osd.8 v2:172.21.15.194:6816/1974878207 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b9801be50 con 0x7f7b8c0bdcf0 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.894+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 --> [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ba8104be0 con 0x7f7b8c0bdcf0 2024-05-08T06:44:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.895+0000 7f7ba6000700 1 -- 172.21.15.70:0/2459322147 <== osd.8 v2:172.21.15.194:6816/1974878207 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7ba8104be0 con 0x7f7b8c0bdcf0 2024-05-08T06:44:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.895+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 >> [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] conn(0x7f7b8c0bdcf0 msgr2=0x7f7b8c0c0190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.895+0000 7f7bb0000700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] conn(0x7f7b8c0bdcf0 0x7f7b8c0c0190 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.895+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7b8c0b2910 msgr2=0x7f7b8c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.895+0000 7f7bb0000700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7b8c0b2910 0x7f7b8c0b4dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8110810 tx=0x7f7b94005cf0 comp rx=0 tx=0).stop 2024-05-08T06:44:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.895+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ba8103750 msgr2=0x7f7ba81a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.895+0000 7f7bb0000700 1 --2- 172.21.15.70:0/2459322147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ba8103750 0x7f7ba81a1900 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800b530 tx=0x7f7b9800b8f0 comp rx=0 tx=0).stop 2024-05-08T06:44:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.896+0000 7f7bae000700 1 -- 172.21.15.70:0/2459322147 reap_dead start 2024-05-08T06:44:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.896+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 shutdown_connections 2024-05-08T06:44:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.896+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 >> 172.21.15.70:0/2459322147 conn(0x7f7ba807a600 msgr2=0x7f7ba8101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.896+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 shutdown_connections 2024-05-08T06:44:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:11.896+0000 7f7bb0000700 1 -- 172.21.15.70:0/2459322147 wait complete. 2024-05-08T06:44:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:13 smithi194 ceph-mon[33679]: pgmap v471: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:13.928 INFO:teuthology.orchestra.run.smithi070.stdout:266287972422 2024-05-08T06:44:13.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-08T06:44:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.172+0000 7fbc1e800700 1 -- 172.21.15.70:0/1848119630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc180779d0 msgr2=0x7fbc18077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.172+0000 7fbc1e800700 1 --2- 172.21.15.70:0/1848119630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc180779d0 0x7fbc18077db0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009990 tx=0x7fbc08009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.172+0000 7fbc1e800700 1 -- 172.21.15.70:0/1848119630 shutdown_connections 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.172+0000 7fbc1e800700 1 --2- 172.21.15.70:0/1848119630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc18114380 0x7fbc18116770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.172+0000 7fbc1e800700 1 --2- 172.21.15.70:0/1848119630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc180779d0 0x7fbc18077db0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.172+0000 7fbc1e800700 1 --2- 172.21.15.70:0/1848119630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180782f0 0x7fbc18113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.172+0000 7fbc1e800700 1 -- 172.21.15.70:0/1848119630 >> 172.21.15.70:0/1848119630 conn(0x7fbc181011d0 msgr2=0x7fbc181035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.172+0000 7fbc1e800700 1 -- 172.21.15.70:0/1848119630 shutdown_connections 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.173+0000 7fbc1e800700 1 -- 172.21.15.70:0/1848119630 wait complete. 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.174+0000 7fbc1e800700 1 Processor -- start 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.174+0000 7fbc1e800700 1 -- start start 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc1e800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180779d0 0x7fbc181a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc1e800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc180782f0 0x7fbc181a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc1e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc18114380 0x7fbc181a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc1e800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbc18119bc0 con 0x7fbc18114380 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc1e800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc18119a40 con 0x7fbc180782f0 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc1e800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbc18119d40 con 0x7fbc180779d0 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc17e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc18114380 0x7fbc181a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc17e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc18114380 0x7fbc181a49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53330/0 (socket says 172.21.15.70:53330) 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc17e00700 1 -- 172.21.15.70:0/3912416119 learned_addr learned my addr 172.21.15.70:0/3912416119 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc17400700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180779d0 0x7fbc181a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc17e00700 1 -- 172.21.15.70:0/3912416119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180779d0 msgr2=0x7fbc181a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc17e00700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc180779d0 0x7fbc181a00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc17e00700 1 -- 172.21.15.70:0/3912416119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc180782f0 msgr2=0x7fbc181a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc17e00700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc180782f0 0x7fbc181a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.175+0000 7fbc17e00700 1 -- 172.21.15.70:0/3912416119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc181a50e0 con 0x7fbc18114380 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.176+0000 7fbc17e00700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc18114380 0x7fbc181a49a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc10007ce0 tx=0x7fbc1000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.176+0000 7fbc0fe00700 1 -- 172.21.15.70:0/3912416119 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000ddd0 con 0x7fbc18114380 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.176+0000 7fbc0fe00700 1 -- 172.21.15.70:0/3912416119 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc10004bb0 con 0x7fbc18114380 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.176+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc181a53d0 con 0x7fbc18114380 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.176+0000 7fbc0fe00700 1 -- 172.21.15.70:0/3912416119 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10015400 con 0x7fbc18114380 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.176+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc181acc50 con 0x7fbc18114380 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.177+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbc18063c30 con 0x7fbc18114380 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.180+0000 7fbc0fe00700 1 -- 172.21.15.70:0/3912416119 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fbc10005000 con 0x7fbc18114380 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.181+0000 7fbc0fe00700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbfc0b2910 0x7fbbfc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.182+0000 7fbc0fe00700 1 -- 172.21.15.70:0/3912416119 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fbc100e2d80 con 0x7fbc18114380 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.182+0000 7fbc17400700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbfc0b2910 0x7fbbfc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.182+0000 7fbc0fe00700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] conn(0x7fbbfc0bdcf0 0x7fbbfc0c0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:14.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.182+0000 7fbc0fe00700 1 -- 172.21.15.70:0/3912416119 --> [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbc10021e70 con 0x7fbbfc0bdcf0 2024-05-08T06:44:14.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.182+0000 7fbc0fe00700 1 -- 172.21.15.70:0/3912416119 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7fbc100e3130 con 0x7fbc18114380 2024-05-08T06:44:14.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.182+0000 7fbc17400700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbfc0b2910 0x7fbbfc0b4dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbc08005cd0 tx=0x7fbc08005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:14.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.183+0000 7fbc16a00700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] conn(0x7fbbfc0bdcf0 0x7fbbfc0c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:14.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.184+0000 7fbc16a00700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] conn(0x7fbbfc0bdcf0 0x7fbbfc0c0190 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:14.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.186+0000 7fbc0fe00700 1 -- 172.21.15.70:0/3912416119 <== osd.5 v2:172.21.15.194:6808/250291870 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbc10021e70 con 0x7fbbfc0bdcf0 2024-05-08T06:44:14.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.203+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 --> [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbc180640b0 con 0x7fbbfc0bdcf0 2024-05-08T06:44:14.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.205+0000 7fbc0fe00700 1 -- 172.21.15.70:0/3912416119 <== osd.5 v2:172.21.15.194:6808/250291870 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbc180640b0 con 0x7fbbfc0bdcf0 2024-05-08T06:44:14.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.205+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 >> [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] conn(0x7fbbfc0bdcf0 msgr2=0x7fbbfc0c0190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:14.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.205+0000 7fbc1e800700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] conn(0x7fbbfc0bdcf0 0x7fbbfc0c0190 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:14.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.205+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbfc0b2910 msgr2=0x7fbbfc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:14.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.205+0000 7fbc1e800700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbbfc0b2910 0x7fbbfc0b4dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbc08005cd0 tx=0x7fbc08005c40 comp rx=0 tx=0).stop 2024-05-08T06:44:14.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.205+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc18114380 msgr2=0x7fbc181a49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:14.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.205+0000 7fbc1e800700 1 --2- 172.21.15.70:0/3912416119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc18114380 0x7fbc181a49a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbc10007ce0 tx=0x7fbc1000d3b0 comp rx=0 tx=0).stop 2024-05-08T06:44:14.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.205+0000 7fbc17e00700 1 -- 172.21.15.70:0/3912416119 reap_dead start 2024-05-08T06:44:14.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.206+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 shutdown_connections 2024-05-08T06:44:14.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.206+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 >> 172.21.15.70:0/3912416119 conn(0x7fbc181011d0 msgr2=0x7fbc181035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:14.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.206+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 shutdown_connections 2024-05-08T06:44:14.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:13.206+0000 7fbc1e800700 1 -- 172.21.15.70:0/3912416119 wait complete. 2024-05-08T06:44:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:14 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:44:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:14 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:44:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:14 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:44:15.232 INFO:teuthology.orchestra.run.smithi070.stdout:240518168652 2024-05-08T06:44:15.233 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-08T06:44:15.578 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:15 smithi070 ceph-mon[29591]: pgmap v472: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T06:44:15.638 INFO:teuthology.orchestra.run.smithi070.stdout:163208757347 2024-05-08T06:44:15.639 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-08T06:44:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:15 smithi172 ceph-mon[33377]: pgmap v472: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T06:44:15.704 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:15.705 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:15.705 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:15.721 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:15.721 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:15 smithi194 ceph-mon[33679]: pgmap v472: 129 pgs: 129 active+clean; 647 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T06:44:15.781 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:15.818 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:15.885 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:16.236 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:16.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:16 smithi070 ceph-mon[29591]: mgrmap e18: x(active, since 13m), standbys: z, y 2024-05-08T06:44:16.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:44:16.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:44:16.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:16 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:44:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:16 smithi172 ceph-mon[33377]: mgrmap e18: x(active, since 13m), standbys: z, y 2024-05-08T06:44:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:44:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:44:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:16 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:44:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:16 smithi194 ceph-mon[33679]: mgrmap e18: x(active, since 13m), standbys: z, y 2024-05-08T06:44:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:44:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:44:16.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:16 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:44:17.567 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:17 smithi070 ceph-mon[29591]: pgmap v473: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-08T06:44:17.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:17 smithi172 ceph-mon[33377]: pgmap v473: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-08T06:44:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:17 smithi194 ceph-mon[33679]: pgmap v473: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-08T06:44:18.489 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:18.492 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:19 smithi070 ceph-mon[29591]: pgmap v474: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-08T06:44:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:19 smithi172 ceph-mon[33377]: pgmap v474: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-08T06:44:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:19 smithi194 ceph-mon[33679]: pgmap v474: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-08T06:44:21.610 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:21 smithi070 ceph-mon[29591]: pgmap v475: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-05-08T06:44:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:21 smithi194 ceph-mon[33679]: pgmap v475: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-05-08T06:44:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:21 smithi172 ceph-mon[33377]: pgmap v475: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s 2024-05-08T06:44:23.704 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:23 smithi070 ceph-mon[29591]: pgmap v476: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T06:44:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:23 smithi194 ceph-mon[33679]: pgmap v476: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T06:44:23.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:23 smithi172 ceph-mon[33377]: pgmap v476: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T06:44:25.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.032+0000 7f5006000700 1 -- 172.21.15.70:0/109279099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 msgr2=0x7f5000114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:25.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.032+0000 7f5006000700 1 --2- 172.21.15.70:0/109279099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 0x7f5000114130 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009990 tx=0x7f4fec009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.032+0000 7f5006000700 1 -- 172.21.15.70:0/109279099 shutdown_connections 2024-05-08T06:44:25.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.032+0000 7f5006000700 1 --2- 172.21.15.70:0/109279099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5000114670 0x7f5000116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.032+0000 7f5006000700 1 --2- 172.21.15.70:0/109279099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50000756d0 0x7f5000075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.032+0000 7f5006000700 1 --2- 172.21.15.70:0/109279099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 0x7f5000114130 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.032+0000 7f5006000700 1 -- 172.21.15.70:0/109279099 >> 172.21.15.70:0/109279099 conn(0x7f500007a600 msgr2=0x7f500007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.032+0000 7f5006000700 1 -- 172.21.15.70:0/109279099 shutdown_connections 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.032+0000 7f5006000700 1 -- 172.21.15.70:0/109279099 wait complete. 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.033+0000 7f5006000700 1 Processor -- start 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.033+0000 7f5006000700 1 -- start start 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.034+0000 7f5006000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50000756d0 0x7f50001a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.034+0000 7f5006000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 0x7f50001a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.034+0000 7f5006000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5000114670 0x7f50001a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:25.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.034+0000 7f5006000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5000119b60 con 0x7f5000075ff0 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.034+0000 7f5006000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f50001199e0 con 0x7f50000756d0 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.034+0000 7f5006000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5000119ce0 con 0x7f5000114670 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.034+0000 7f4ffea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 0x7f50001a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.034+0000 7f4ffea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 0x7f50001a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38678/0 (socket says 172.21.15.70:38678) 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.034+0000 7f4ffea00700 1 -- 172.21.15.70:0/2690850084 learned_addr learned my addr 172.21.15.70:0/2690850084 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4fff400700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50000756d0 0x7f50001a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4fffe00700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5000114670 0x7f50001a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4ffea00700 1 -- 172.21.15.70:0/2690850084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5000114670 msgr2=0x7f50001a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4ffea00700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5000114670 0x7f50001a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4ffea00700 1 -- 172.21.15.70:0/2690850084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50000756d0 msgr2=0x7f50001a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4ffea00700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50000756d0 0x7f50001a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4ffea00700 1 -- 172.21.15.70:0/2690850084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50001a5100 con 0x7f5000075ff0 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4ffea00700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 0x7f50001a0630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4fec000c00 tx=0x7f4fec005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:25.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4ff7e00700 1 -- 172.21.15.70:0/2690850084 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec027070 con 0x7f5000075ff0 2024-05-08T06:44:25.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4ff7e00700 1 -- 172.21.15.70:0/2690850084 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fec00fb80 con 0x7f5000075ff0 2024-05-08T06:44:25.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f4ff7e00700 1 -- 172.21.15.70:0/2690850084 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec022c30 con 0x7f5000075ff0 2024-05-08T06:44:25.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.035+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50001a5390 con 0x7f5000075ff0 2024-05-08T06:44:25.512 INFO:teuthology.orchestra.run.smithi070.stdout:77309411448 2024-05-08T06:44:25.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.036+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50001acc70 con 0x7f5000075ff0 2024-05-08T06:44:25.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.037+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500006a190 con 0x7f5000075ff0 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.039+0000 7f4ff7e00700 1 -- 172.21.15.70:0/2690850084 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4fec02a070 con 0x7f5000075ff0 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.040+0000 7f4ff7e00700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4fe40b2900 0x7f4fe40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.040+0000 7f4ff7e00700 1 -- 172.21.15.70:0/2690850084 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f4fec0e3710 con 0x7f5000075ff0 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.041+0000 7f4fff400700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4fe40b2900 0x7f4fe40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.041+0000 7f4fff400700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4fe40b2900 0x7f4fe40b4dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0005950 tx=0x7f4ff00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.043+0000 7f4ff7e00700 1 -- 172.21.15.70:0/2690850084 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4fec031080 con 0x7f5000075ff0 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.279+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f50001ace40 con 0x7f5000075ff0 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.280+0000 7f4ff7e00700 1 -- 172.21.15.70:0/2690850084 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4fec013070 con 0x7f5000075ff0 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4fe40b2900 msgr2=0x7f4fe40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4fe40b2900 0x7f4fe40b4dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0005950 tx=0x7f4ff00058e0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 msgr2=0x7f50001a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:25.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 0x7f50001a0630 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4fec000c00 tx=0x7f4fec005ef0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 shutdown_connections 2024-05-08T06:44:25.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5000114670 0x7f50001a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f50000756d0 0x7f50001a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4fe40b2900 0x7f4fe40b4dc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 --2- 172.21.15.70:0/2690850084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5000075ff0 0x7f50001a0630 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:25.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 >> 172.21.15.70:0/2690850084 conn(0x7f500007a600 msgr2=0x7f5000110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:25.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.284+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 shutdown_connections 2024-05-08T06:44:25.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:25.285+0000 7f5006000700 1 -- 172.21.15.70:0/2690850084 wait complete. 2024-05-08T06:44:25.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:25 smithi070 ceph-mon[29591]: pgmap v477: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-08T06:44:25.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:25 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2690850084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T06:44:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:25 smithi194 ceph-mon[33679]: pgmap v477: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-08T06:44:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:25 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2690850084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T06:44:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:25 smithi172 ceph-mon[33377]: pgmap v477: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-08T06:44:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:25 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2690850084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T06:44:27.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:27 smithi070 ceph-mon[29591]: pgmap v478: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-08T06:44:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:27 smithi194 ceph-mon[33679]: pgmap v478: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-08T06:44:27.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.779+0000 7feebda00700 1 -- 172.21.15.70:0/1399057957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 msgr2=0x7feeb8112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:27.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.779+0000 7feebda00700 1 --2- 172.21.15.70:0/1399057957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 0x7feeb8112590 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feeb000b0a0 tx=0x7feeb000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:44:27.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.779+0000 7feebda00700 1 -- 172.21.15.70:0/1399057957 shutdown_connections 2024-05-08T06:44:27.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.779+0000 7feebda00700 1 --2- 172.21.15.70:0/1399057957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 0x7feeb8112590 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:27.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.779+0000 7feebda00700 1 --2- 172.21.15.70:0/1399057957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb810b6c0 0x7feeb810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:27.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.779+0000 7feebda00700 1 --2- 172.21.15.70:0/1399057957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb81056c0 0x7feeb8105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:27.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.779+0000 7feebda00700 1 -- 172.21.15.70:0/1399057957 >> 172.21.15.70:0/1399057957 conn(0x7feeb81011b0 msgr2=0x7feeb81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:27.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.779+0000 7feebda00700 1 -- 172.21.15.70:0/1399057957 shutdown_connections 2024-05-08T06:44:27.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.779+0000 7feebda00700 1 -- 172.21.15.70:0/1399057957 wait complete. 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.780+0000 7feebda00700 1 Processor -- start 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.780+0000 7feebda00700 1 -- start start 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feebda00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb81056c0 0x7feeb81a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feebda00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 0x7feeb81a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feebda00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb810b6c0 0x7feeb819bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feebda00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feeb81157c0 con 0x7feeb8106080 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feebda00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8115640 con 0x7feeb81056c0 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feebda00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feeb8115940 con 0x7feeb810b6c0 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feeb6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 0x7feeb81a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feeb6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 0x7feeb81a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41800/0 (socket says 172.21.15.70:41800) 2024-05-08T06:44:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feeb6000700 1 -- 172.21.15.70:0/122087461 learned_addr learned my addr 172.21.15.70:0/122087461 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feeb7400700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb810b6c0 0x7feeb819bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feeb6a00700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb81056c0 0x7feeb81a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feeb6000700 1 -- 172.21.15.70:0/122087461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb810b6c0 msgr2=0x7feeb819bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feeb6000700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb810b6c0 0x7feeb819bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.781+0000 7feeb6000700 1 -- 172.21.15.70:0/122087461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb81056c0 msgr2=0x7feeb81a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.782+0000 7feeb6000700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb81056c0 0x7feeb81a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.782+0000 7feeb6000700 1 -- 172.21.15.70:0/122087461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb819c240 con 0x7feeb8106080 2024-05-08T06:44:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.782+0000 7feeb6000700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 0x7feeb81a1e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feea400c920 tx=0x7feea400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.782+0000 7feeaf400700 1 -- 172.21.15.70:0/122087461 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4007b00 con 0x7feeb8106080 2024-05-08T06:44:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.782+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb819c530 con 0x7feeb8106080 2024-05-08T06:44:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.782+0000 7feeaf400700 1 -- 172.21.15.70:0/122087461 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feea4004cc0 con 0x7feeb8106080 2024-05-08T06:44:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.782+0000 7feeaf400700 1 -- 172.21.15.70:0/122087461 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea40054a0 con 0x7feeb8106080 2024-05-08T06:44:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.782+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb81a87a0 con 0x7feeb8106080 2024-05-08T06:44:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.783+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb806a190 con 0x7feeb8106080 2024-05-08T06:44:27.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.787+0000 7feeaf400700 1 -- 172.21.15.70:0/122087461 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7feea4004750 con 0x7feeb8106080 2024-05-08T06:44:27.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.788+0000 7feeaf400700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.789+0000 7feeaf400700 1 -- 172.21.15.70:0/122087461 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7feea40e2200 con 0x7feeb8106080 2024-05-08T06:44:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.789+0000 7feeb6a00700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.789+0000 7feeb6a00700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feea8005fd0 tx=0x7feea8005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:27.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:27.793+0000 7feeaf400700 1 -- 172.21.15.70:0/122087461 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feea4014030 con 0x7feeb8106080 2024-05-08T06:44:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:27 smithi172 ceph-mon[33377]: pgmap v478: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-08T06:44:28.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.034+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7feeb802e510 con 0x7feeb8106080 2024-05-08T06:44:28.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.034+0000 7feeaf400700 1 -- 172.21.15.70:0/122087461 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feea40a9ad0 con 0x7feeb8106080 2024-05-08T06:44:28.034 INFO:teuthology.orchestra.run.smithi070.stdout:55834574976 2024-05-08T06:44:28.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.037+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee9c0b2900 msgr2=0x7fee9c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:28.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.037+0000 7feebda00700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feea8005fd0 tx=0x7feea8005d90 comp rx=0 tx=0).stop 2024-05-08T06:44:28.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.037+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 msgr2=0x7feeb81a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:28.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.037+0000 7feebda00700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 0x7feeb81a1e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feea400c920 tx=0x7feea400cce0 comp rx=0 tx=0).stop 2024-05-08T06:44:28.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.038+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 shutdown_connections 2024-05-08T06:44:28.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.038+0000 7feebda00700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeb810b6c0 0x7feeb819bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:28.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.038+0000 7feebda00700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feeb81056c0 0x7feeb81a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:28.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.038+0000 7feebda00700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fee9c0b2900 0x7fee9c0b4dc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:28.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.038+0000 7feebda00700 1 --2- 172.21.15.70:0/122087461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feeb8106080 0x7feeb81a1e10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:28.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.038+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 >> 172.21.15.70:0/122087461 conn(0x7feeb81011b0 msgr2=0x7feeb81019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:28.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.038+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 shutdown_connections 2024-05-08T06:44:28.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:28.038+0000 7feebda00700 1 -- 172.21.15.70:0/122087461 wait complete. 2024-05-08T06:44:28.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:28 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/122087461' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T06:44:28.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:28 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/122087461' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T06:44:28.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:28 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/122087461' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T06:44:29.238 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411442 got 77309411448 for osd.2 2024-05-08T06:44:29.238 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:29.703 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:29 smithi070 ceph-mon[29591]: pgmap v479: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T06:44:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:29 smithi194 ceph-mon[33679]: pgmap v479: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T06:44:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:29 smithi172 ceph-mon[33377]: pgmap v479: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T06:44:30.503 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574973 got 55834574976 for osd.1 2024-05-08T06:44:30.504 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.871+0000 7f77c5800700 1 -- 172.21.15.70:0/2661007639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c00756d0 msgr2=0x7f77c0075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.871+0000 7f77c5800700 1 --2- 172.21.15.70:0/2661007639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c00756d0 0x7f77c0075ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f77b0009990 tx=0x7f77b0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.871+0000 7f77c5800700 1 -- 172.21.15.70:0/2661007639 shutdown_connections 2024-05-08T06:44:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.871+0000 7f77c5800700 1 --2- 172.21.15.70:0/2661007639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c0114670 0x7f77c0116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.871+0000 7f77c5800700 1 --2- 172.21.15.70:0/2661007639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c00756d0 0x7f77c0075ab0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:30.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.871+0000 7f77c5800700 1 --2- 172.21.15.70:0/2661007639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c0075ff0 0x7f77c0114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.871+0000 7f77c5800700 1 -- 172.21.15.70:0/2661007639 >> 172.21.15.70:0/2661007639 conn(0x7f77c007a650 msgr2=0x7f77c007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.871+0000 7f77c5800700 1 -- 172.21.15.70:0/2661007639 shutdown_connections 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.871+0000 7f77c5800700 1 -- 172.21.15.70:0/2661007639 wait complete. 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.873+0000 7f77c5800700 1 Processor -- start 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.873+0000 7f77c5800700 1 -- start start 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77c5800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c00756d0 0x7f77c01a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77c5800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0075ff0 0x7f77c01a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77c5800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c0114670 0x7f77c01a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77c5800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0119bb0 con 0x7f77c0075ff0 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77c5800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0119a30 con 0x7f77c00756d0 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77c5800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0119d30 con 0x7f77c0114670 2024-05-08T06:44:30.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77be000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0075ff0 0x7f77c01a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77be000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0075ff0 0x7f77c01a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41834/0 (socket says 172.21.15.70:41834) 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77be000700 1 -- 172.21.15.70:0/3976205899 learned_addr learned my addr 172.21.15.70:0/3976205899 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.874+0000 7f77bea00700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c00756d0 0x7f77c01a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77bf400700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c0114670 0x7f77c01a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77be000700 1 -- 172.21.15.70:0/3976205899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c0114670 msgr2=0x7f77c01a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77be000700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c0114670 0x7f77c01a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77be000700 1 -- 172.21.15.70:0/3976205899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c00756d0 msgr2=0x7f77c01a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77be000700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c00756d0 0x7f77c01a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77be000700 1 -- 172.21.15.70:0/3976205899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c01a50d0 con 0x7f77c0075ff0 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77bea00700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c00756d0 0x7f77c01a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77be000700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0075ff0 0x7f77c01a0600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00d980 tx=0x7f77ac00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77b7400700 1 -- 172.21.15.70:0/3976205899 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac016070 con 0x7f77c0075ff0 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77b7400700 1 -- 172.21.15.70:0/3976205899 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77ac004020 con 0x7f77c0075ff0 2024-05-08T06:44:30.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.875+0000 7f77b7400700 1 -- 172.21.15.70:0/3976205899 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac004bb0 con 0x7f77c0075ff0 2024-05-08T06:44:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.876+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c01a53c0 con 0x7f77c0075ff0 2024-05-08T06:44:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.876+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c01acc40 con 0x7f77c0075ff0 2024-05-08T06:44:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.877+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c006a190 con 0x7f77c0075ff0 2024-05-08T06:44:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.883+0000 7f77b7400700 1 -- 172.21.15.70:0/3976205899 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f77ac00bb60 con 0x7f77c0075ff0 2024-05-08T06:44:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.885+0000 7f77b7400700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f77a40b2880 0x7f77a40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.885+0000 7f77b7400700 1 -- 172.21.15.70:0/3976205899 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f77ac0e2a00 con 0x7f77c0075ff0 2024-05-08T06:44:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.886+0000 7f77bea00700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f77a40b2880 0x7f77a40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.886+0000 7f77b7400700 1 -- 172.21.15.70:0/3976205899 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f77ac01f020 con 0x7f77c0075ff0 2024-05-08T06:44:30.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.886+0000 7f77bea00700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f77a40b2880 0x7f77a40b4d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77b000b5c0 tx=0x7f77b001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:31.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.129+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f77c01ace70 con 0x7f77c0075ff0 2024-05-08T06:44:31.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.129+0000 7f77b7400700 1 -- 172.21.15.70:0/3976205899 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f77ac0aa2d0 con 0x7f77c0075ff0 2024-05-08T06:44:31.129 INFO:teuthology.orchestra.run.smithi070.stdout:266287972427 2024-05-08T06:44:31.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.132+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f77a40b2880 msgr2=0x7f77a40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:31.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.132+0000 7f77c5800700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f77a40b2880 0x7f77a40b4d40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f77b000b5c0 tx=0x7f77b001a040 comp rx=0 tx=0).stop 2024-05-08T06:44:31.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.132+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0075ff0 msgr2=0x7f77c01a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:31.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.132+0000 7f77c5800700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0075ff0 0x7f77c01a0600 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00d980 tx=0x7f77ac00dd40 comp rx=0 tx=0).stop 2024-05-08T06:44:31.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.133+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 shutdown_connections 2024-05-08T06:44:31.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.133+0000 7f77c5800700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77c0114670 0x7f77c01a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.133+0000 7f77c5800700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77c00756d0 0x7f77c01a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.133+0000 7f77c5800700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f77a40b2880 0x7f77a40b4d40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.133+0000 7f77c5800700 1 --2- 172.21.15.70:0/3976205899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0075ff0 0x7f77c01a0600 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.133+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 >> 172.21.15.70:0/3976205899 conn(0x7f77c007a650 msgr2=0x7f77c0110170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:31.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.133+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 shutdown_connections 2024-05-08T06:44:31.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.133+0000 7f77c5800700 1 -- 172.21.15.70:0/3976205899 wait complete. 2024-05-08T06:44:31.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:31 smithi194 ceph-mon[33679]: pgmap v480: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T06:44:31.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:31 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3259971540' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T06:44:31.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:31 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3976205899' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T06:44:31.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:31 smithi070 ceph-mon[29591]: pgmap v480: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T06:44:31.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:31 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3259971540' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T06:44:31.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:31 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3976205899' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T06:44:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:31 smithi172 ceph-mon[33377]: pgmap v480: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T06:44:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:31 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3259971540' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T06:44:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:31 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3976205899' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T06:44:31.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.751+0000 7fa163a00700 1 -- 172.21.15.70:0/37905498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c114670 msgr2=0x7fa15c116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:31.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.751+0000 7fa163a00700 1 --2- 172.21.15.70:0/37905498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c114670 0x7fa15c116a60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa15400b0a0 tx=0x7fa15400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.751+0000 7fa163a00700 1 -- 172.21.15.70:0/37905498 shutdown_connections 2024-05-08T06:44:31.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.751+0000 7fa163a00700 1 --2- 172.21.15.70:0/37905498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c114670 0x7fa15c116a60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.751+0000 7fa163a00700 1 --2- 172.21.15.70:0/37905498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa15c0756d0 0x7fa15c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.751+0000 7fa163a00700 1 --2- 172.21.15.70:0/37905498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa15c075ff0 0x7fa15c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.751+0000 7fa163a00700 1 -- 172.21.15.70:0/37905498 >> 172.21.15.70:0/37905498 conn(0x7fa15c07a600 msgr2=0x7fa15c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:31.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.751+0000 7fa163a00700 1 -- 172.21.15.70:0/37905498 shutdown_connections 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.751+0000 7fa163a00700 1 -- 172.21.15.70:0/37905498 wait complete. 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.752+0000 7fa163a00700 1 Processor -- start 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.752+0000 7fa163a00700 1 -- start start 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa163a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c0756d0 0x7fa15c19ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa163a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa15c075ff0 0x7fa15c1a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa163a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa15c114670 0x7fa15c1a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa163a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c119b30 con 0x7fa15c0756d0 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa163a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c1199b0 con 0x7fa15c114670 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa163a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c119cb0 con 0x7fa15c075ff0 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa161000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c0756d0 0x7fa15c19ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa161000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c0756d0 0x7fa15c19ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41810/0 (socket says 172.21.15.70:41810) 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa161000700 1 -- 172.21.15.70:0/3259971540 learned_addr learned my addr 172.21.15.70:0/3259971540 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:31.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa15be00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa15c075ff0 0x7fa15c1a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa161a00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa15c114670 0x7fa15c1a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.753+0000 7fa161000700 1 -- 172.21.15.70:0/3259971540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa15c075ff0 msgr2=0x7fa15c1a04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa161000700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa15c075ff0 0x7fa15c1a04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa161000700 1 -- 172.21.15.70:0/3259971540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa15c114670 msgr2=0x7fa15c1a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa161000700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa15c114670 0x7fa15c1a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa161000700 1 -- 172.21.15.70:0/3259971540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c1a4fb0 con 0x7fa15c0756d0 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa161a00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa15c114670 0x7fa15c1a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa161000700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c0756d0 0x7fa15c19ffa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c9b0 tx=0x7fa15000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa159600700 1 -- 172.21.15.70:0/3259971540 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150007b00 con 0x7fa15c0756d0 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa159600700 1 -- 172.21.15.70:0/3259971540 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa150007ca0 con 0x7fa15c0756d0 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15c1a5240 con 0x7fa15c0756d0 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa159600700 1 -- 172.21.15.70:0/3259971540 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150018660 con 0x7fa15c0756d0 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.754+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15c1acb20 con 0x7fa15c0756d0 2024-05-08T06:44:31.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.756+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15c06a190 con 0x7fa15c0756d0 2024-05-08T06:44:31.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.759+0000 7fa159600700 1 -- 172.21.15.70:0/3259971540 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa15000f450 con 0x7fa15c0756d0 2024-05-08T06:44:31.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.761+0000 7fa159600700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1440b2900 0x7fa1440b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:31.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.761+0000 7fa159600700 1 -- 172.21.15.70:0/3259971540 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fa1500e2640 con 0x7fa15c0756d0 2024-05-08T06:44:31.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.761+0000 7fa15be00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1440b2900 0x7fa1440b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:31.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.762+0000 7fa15be00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1440b2900 0x7fa1440b4dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa148005fd0 tx=0x7fa14800af20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:31.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:30.766+0000 7fa159600700 1 -- 172.21.15.70:0/3259971540 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa150014030 con 0x7fa15c0756d0 2024-05-08T06:44:31.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.015+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa15c1acd50 con 0x7fa15c0756d0 2024-05-08T06:44:31.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.016+0000 7fa159600700 1 -- 172.21.15.70:0/3259971540 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa1500a9f70 con 0x7fa15c0756d0 2024-05-08T06:44:31.939 INFO:teuthology.orchestra.run.smithi070.stdout:188978561120 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.019+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1440b2900 msgr2=0x7fa1440b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.019+0000 7fa163a00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1440b2900 0x7fa1440b4dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa148005fd0 tx=0x7fa14800af20 comp rx=0 tx=0).stop 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.019+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c0756d0 msgr2=0x7fa15c19ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.019+0000 7fa163a00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c0756d0 0x7fa15c19ffa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c9b0 tx=0x7fa15000cd70 comp rx=0 tx=0).stop 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.019+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 shutdown_connections 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.019+0000 7fa163a00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa15c114670 0x7fa15c1a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.019+0000 7fa163a00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa1440b2900 0x7fa1440b4dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.019+0000 7fa163a00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa15c0756d0 0x7fa15c19ffa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.019+0000 7fa163a00700 1 --2- 172.21.15.70:0/3259971540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa15c075ff0 0x7fa15c1a04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.020+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 >> 172.21.15.70:0/3259971540 conn(0x7fa15c07a600 msgr2=0x7fa15c113430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.020+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 shutdown_connections 2024-05-08T06:44:31.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:31.020+0000 7fa163a00700 1 -- 172.21.15.70:0/3259971540 wait complete. 2024-05-08T06:44:32.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.219+0000 7f37bbe00700 1 -- 172.21.15.70:0/879986529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104eb0 msgr2=0x7f37bc10d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:32.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.219+0000 7f37bbe00700 1 --2- 172.21.15.70:0/879986529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104eb0 0x7f37bc10d3a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f37a8009990 tx=0x7f37a8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.219+0000 7f37bbe00700 1 -- 172.21.15.70:0/879986529 shutdown_connections 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.219+0000 7f37bbe00700 1 --2- 172.21.15.70:0/879986529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc10d9c0 0x7f37bc10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.219+0000 7f37bbe00700 1 --2- 172.21.15.70:0/879986529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc104590 0x7f37bc104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.219+0000 7f37bbe00700 1 --2- 172.21.15.70:0/879986529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104eb0 0x7f37bc10d3a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.219+0000 7f37bbe00700 1 -- 172.21.15.70:0/879986529 >> 172.21.15.70:0/879986529 conn(0x7f37bc0fdda0 msgr2=0x7f37bc1001c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.219+0000 7f37bbe00700 1 -- 172.21.15.70:0/879986529 shutdown_connections 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.219+0000 7f37bbe00700 1 -- 172.21.15.70:0/879986529 wait complete. 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.221+0000 7f37bbe00700 1 Processor -- start 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.221+0000 7f37bbe00700 1 -- start start 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104590 0x7f37bc1021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37bbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc104eb0 0x7f37bc102730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37bbe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc10d9c0 0x7f37bc102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:32.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37bbe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc113510 con 0x7f37bc104590 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37bbe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc113390 con 0x7f37bc104eb0 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37bbe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f37bc113690 con 0x7f37bc10d9c0 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37baa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104590 0x7f37bc1021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37baa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104590 0x7f37bc1021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41856/0 (socket says 172.21.15.70:41856) 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37baa00700 1 -- 172.21.15.70:0/2087109412 learned_addr learned my addr 172.21.15.70:0/2087109412 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37bb400700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc10d9c0 0x7f37bc102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37ba000700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc104eb0 0x7f37bc102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37baa00700 1 -- 172.21.15.70:0/2087109412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc10d9c0 msgr2=0x7f37bc102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37baa00700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc10d9c0 0x7f37bc102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37baa00700 1 -- 172.21.15.70:0/2087109412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc104eb0 msgr2=0x7f37bc102730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37baa00700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc104eb0 0x7f37bc102730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37baa00700 1 -- 172.21.15.70:0/2087109412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37bc1a7fd0 con 0x7f37bc104590 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.222+0000 7f37ba000700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc104eb0 0x7f37bc102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:44:32.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.223+0000 7f37baa00700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104590 0x7f37bc1021f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00b530 tx=0x7f37ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.223+0000 7f37b3400700 1 -- 172.21.15.70:0/2087109412 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac015020 con 0x7f37bc104590 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.223+0000 7f37b3400700 1 -- 172.21.15.70:0/2087109412 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37ac011cc0 con 0x7f37bc104590 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.223+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37bc1a82c0 con 0x7f37bc104590 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.223+0000 7f37b3400700 1 -- 172.21.15.70:0/2087109412 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac010d30 con 0x7f37bc104590 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.223+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37bc1a8800 con 0x7f37bc104590 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.225+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37bc06a190 con 0x7f37bc104590 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.227+0000 7f37b3400700 1 -- 172.21.15.70:0/2087109412 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f37ac018020 con 0x7f37bc104590 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.229+0000 7f37b3400700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2880 0x7f37a00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.229+0000 7f37b3400700 1 -- 172.21.15.70:0/2087109412 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f37ac0e1ea0 con 0x7f37bc104590 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.229+0000 7f37ba000700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2880 0x7f37a00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.230+0000 7f37ba000700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2880 0x7f37a00b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f37a8003760 tx=0x7f37a8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:32.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.233+0000 7f37b3400700 1 -- 172.21.15.70:0/2087109412 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f37ac01f020 con 0x7f37bc104590 2024-05-08T06:44:32.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.494+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f37bc103720 con 0x7f37bc104590 2024-05-08T06:44:32.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.495+0000 7f37b3400700 1 -- 172.21.15.70:0/2087109412 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f37ac0a9770 con 0x7f37bc104590 2024-05-08T06:44:32.495 INFO:teuthology.orchestra.run.smithi070.stdout:137438953582 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2880 msgr2=0x7f37a00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2880 0x7f37a00b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f37a8003760 tx=0x7f37a8005fb0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104590 msgr2=0x7f37bc1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104590 0x7f37bc1021f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00b530 tx=0x7f37ac00b8f0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 shutdown_connections 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37bc10d9c0 0x7f37bc102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f37a00b2880 0x7f37a00b4d40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37bc104590 0x7f37bc1021f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 --2- 172.21.15.70:0/2087109412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37bc104eb0 0x7f37bc102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:32.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 >> 172.21.15.70:0/2087109412 conn(0x7f37bc0fdda0 msgr2=0x7f37bc0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:32.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 shutdown_connections 2024-05-08T06:44:32.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:32.498+0000 7f37bbe00700 1 -- 172.21.15.70:0/2087109412 wait complete. 2024-05-08T06:44:33.732 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:33 smithi172 ceph-mon[33377]: pgmap v481: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T06:44:33.732 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:33 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2087109412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T06:44:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:33 smithi194 ceph-mon[33679]: pgmap v481: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T06:44:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:33 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2087109412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T06:44:33.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:33 smithi070 ceph-mon[29591]: pgmap v481: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T06:44:33.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:33 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2087109412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T06:44:34.006 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561114 got 188978561120 for osd.6 2024-05-08T06:44:34.006 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:34.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2743767259' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T06:44:34.814 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2743767259' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T06:44:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2743767259' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T06:44:35.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:35 smithi070 ceph-mon[29591]: pgmap v482: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-05-08T06:44:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.218+0000 7f4c1ca00700 1 -- 172.21.15.70:0/3575685594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c181056c0 msgr2=0x7f4c18105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.218+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/3575685594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c181056c0 0x7f4c18105b40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009990 tx=0x7f4c04009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.219+0000 7f4c1ca00700 1 -- 172.21.15.70:0/3575685594 shutdown_connections 2024-05-08T06:44:35.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.219+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/3575685594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c18106080 0x7f4c18112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.219+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/3575685594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c1810b6c0 0x7f4c1810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.219+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/3575685594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c181056c0 0x7f4c18105b40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.219+0000 7f4c1ca00700 1 -- 172.21.15.70:0/3575685594 >> 172.21.15.70:0/3575685594 conn(0x7f4c181011b0 msgr2=0x7f4c181035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:35.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.219+0000 7f4c1ca00700 1 -- 172.21.15.70:0/3575685594 shutdown_connections 2024-05-08T06:44:35.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.219+0000 7f4c1ca00700 1 -- 172.21.15.70:0/3575685594 wait complete. 2024-05-08T06:44:35.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.220+0000 7f4c1ca00700 1 Processor -- start 2024-05-08T06:44:35.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.220+0000 7f4c1ca00700 1 -- start start 2024-05-08T06:44:35.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.220+0000 7f4c1ca00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c181056c0 0x7f4c1819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:35.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.220+0000 7f4c1ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c18106080 0x7f4c1819c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:35.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.220+0000 7f4c1ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1810b6c0 0x7f4c181a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:35.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.220+0000 7f4c1ca00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c18115800 con 0x7f4c1810b6c0 2024-05-08T06:44:35.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.220+0000 7f4c1ca00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c18115680 con 0x7f4c18106080 2024-05-08T06:44:35.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.220+0000 7f4c1ca00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c18115980 con 0x7f4c181056c0 2024-05-08T06:44:35.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c16800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1810b6c0 0x7f4c181a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:35.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c16800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1810b6c0 0x7f4c181a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41866/0 (socket says 172.21.15.70:41866) 2024-05-08T06:44:35.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c16800700 1 -- 172.21.15.70:0/2743767259 learned_addr learned my addr 172.21.15.70:0/2743767259 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:35.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c15e00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c181056c0 0x7f4c1819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:35.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c15400700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c18106080 0x7f4c1819c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:35.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c16800700 1 -- 172.21.15.70:0/2743767259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c181056c0 msgr2=0x7f4c1819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:35.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c16800700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c181056c0 0x7f4c1819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c16800700 1 -- 172.21.15.70:0/2743767259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c18106080 msgr2=0x7f4c1819c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:35.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c16800700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c18106080 0x7f4c1819c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c16800700 1 -- 172.21.15.70:0/2743767259 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c181a0d40 con 0x7f4c1810b6c0 2024-05-08T06:44:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.221+0000 7f4c15e00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c181056c0 0x7f4c1819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:44:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.222+0000 7f4c16800700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1810b6c0 0x7f4c181a0600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000b970 tx=0x7f4c1000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.222+0000 7f4c0ea00700 1 -- 172.21.15.70:0/2743767259 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10019070 con 0x7f4c1810b6c0 2024-05-08T06:44:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.222+0000 7f4c0ea00700 1 -- 172.21.15.70:0/2743767259 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c1000ce40 con 0x7f4c1810b6c0 2024-05-08T06:44:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.222+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c181a1030 con 0x7f4c1810b6c0 2024-05-08T06:44:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.222+0000 7f4c0ea00700 1 -- 172.21.15.70:0/2743767259 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10007370 con 0x7f4c1810b6c0 2024-05-08T06:44:35.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.222+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c181a88b0 con 0x7f4c1810b6c0 2024-05-08T06:44:35.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.223+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1806a190 con 0x7f4c1810b6c0 2024-05-08T06:44:35.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.226+0000 7f4c0ea00700 1 -- 172.21.15.70:0/2743767259 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4c1001c070 con 0x7f4c1810b6c0 2024-05-08T06:44:35.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.227+0000 7f4c0ea00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4bfc0b2880 0x7f4bfc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:35.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.227+0000 7f4c0ea00700 1 -- 172.21.15.70:0/2743767259 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f4c100e2350 con 0x7f4c1810b6c0 2024-05-08T06:44:35.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.228+0000 7f4c15e00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4bfc0b2880 0x7f4bfc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:35.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.228+0000 7f4c15e00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4bfc0b2880 0x7f4bfc0b4d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4c08005950 tx=0x7f4c08005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:35.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.230+0000 7f4c0ea00700 1 -- 172.21.15.70:0/2743767259 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4c10023070 con 0x7f4c1810b6c0 2024-05-08T06:44:35.536 INFO:teuthology.orchestra.run.smithi070.stdout:111669149812 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.466+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4c1802e510 con 0x7f4c1810b6c0 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.467+0000 7f4c0ea00700 1 -- 172.21.15.70:0/2743767259 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4c100a9cb0 con 0x7f4c1810b6c0 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.470+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4bfc0b2880 msgr2=0x7f4bfc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.470+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4bfc0b2880 0x7f4bfc0b4d40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4c08005950 tx=0x7f4c08005f50 comp rx=0 tx=0).stop 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1810b6c0 msgr2=0x7f4c181a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1810b6c0 0x7f4c181a0600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000b970 tx=0x7f4c1000bd30 comp rx=0 tx=0).stop 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 shutdown_connections 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4bfc0b2880 0x7f4bfc0b4d40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1810b6c0 0x7f4c181a0600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c181056c0 0x7f4c1819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 --2- 172.21.15.70:0/2743767259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c18106080 0x7f4c1819c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 >> 172.21.15.70:0/2743767259 conn(0x7f4c181011b0 msgr2=0x7f4c181018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 shutdown_connections 2024-05-08T06:44:35.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:34.471+0000 7f4c1ca00700 1 -- 172.21.15.70:0/2743767259 wait complete. 2024-05-08T06:44:35.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:35 smithi194 ceph-mon[33679]: pgmap v482: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-05-08T06:44:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:35 smithi172 ceph-mon[33377]: pgmap v482: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-05-08T06:44:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.011+0000 7f2454c00700 1 -- 172.21.15.70:0/2516096675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 msgr2=0x7f2450105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.011+0000 7f2454c00700 1 --2- 172.21.15.70:0/2516096675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 0x7f2450105b60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f243c009990 tx=0x7f243c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.011+0000 7f2454c00700 1 -- 172.21.15.70:0/2516096675 shutdown_connections 2024-05-08T06:44:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.011+0000 7f2454c00700 1 --2- 172.21.15.70:0/2516096675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24501060a0 0x7f24501125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.011+0000 7f2454c00700 1 --2- 172.21.15.70:0/2516096675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f245010b6e0 0x7f245010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.011+0000 7f2454c00700 1 --2- 172.21.15.70:0/2516096675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 0x7f2450105b60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.011+0000 7f2454c00700 1 -- 172.21.15.70:0/2516096675 >> 172.21.15.70:0/2516096675 conn(0x7f24501011d0 msgr2=0x7f24501035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.011+0000 7f2454c00700 1 -- 172.21.15.70:0/2516096675 shutdown_connections 2024-05-08T06:44:37.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.011+0000 7f2454c00700 1 -- 172.21.15.70:0/2516096675 wait complete. 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.013+0000 7f2454c00700 1 Processor -- start 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.013+0000 7f2454c00700 1 -- start start 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.013+0000 7f2454c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 0x7f245019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.013+0000 7f2454c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24501060a0 0x7f245019c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.013+0000 7f2454c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245010b6e0 0x7f24501a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f2454c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2450115820 con 0x7f24501056e0 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f2454c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24501156a0 con 0x7f245010b6e0 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f2454c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f24501159a0 con 0x7f24501060a0 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 0x7f245019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 0x7f245019bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41918/0 (socket says 172.21.15.70:41918) 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244de00700 1 -- 172.21.15.70:0/3120609364 learned_addr learned my addr 172.21.15.70:0/3120609364 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244d400700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24501060a0 0x7f245019c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244e800700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245010b6e0 0x7f24501a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:37.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244de00700 1 -- 172.21.15.70:0/3120609364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24501060a0 msgr2=0x7f245019c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244de00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24501060a0 0x7f245019c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244de00700 1 -- 172.21.15.70:0/3120609364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245010b6e0 msgr2=0x7f24501a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244de00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245010b6e0 0x7f24501a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.014+0000 7f244de00700 1 -- 172.21.15.70:0/3120609364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24501a0d40 con 0x7f24501056e0 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.015+0000 7f244de00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 0x7f245019bd30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f244000d980 tx=0x7f244000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.015+0000 7f2446a00700 1 -- 172.21.15.70:0/3120609364 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2440017070 con 0x7f24501056e0 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.015+0000 7f2446a00700 1 -- 172.21.15.70:0/3120609364 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2440004830 con 0x7f24501056e0 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.015+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24501a1030 con 0x7f24501056e0 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.015+0000 7f2446a00700 1 -- 172.21.15.70:0/3120609364 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24400053a0 con 0x7f24501056e0 2024-05-08T06:44:37.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.015+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24501a88b0 con 0x7f24501056e0 2024-05-08T06:44:37.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.017+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f245010dc70 con 0x7f24501056e0 2024-05-08T06:44:37.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.021+0000 7f2446a00700 1 -- 172.21.15.70:0/3120609364 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f24400049e0 con 0x7f24501056e0 2024-05-08T06:44:37.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.024+0000 7f2446a00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f24340b2900 0x7f24340b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:37.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.025+0000 7f2446a00700 1 -- 172.21.15.70:0/3120609364 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f24400e2930 con 0x7f24501056e0 2024-05-08T06:44:37.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.025+0000 7f244d400700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f24340b2900 0x7f24340b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:37.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.025+0000 7f2446a00700 1 -- 172.21.15.70:0/3120609364 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2440020020 con 0x7f24501056e0 2024-05-08T06:44:37.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.026+0000 7f244d400700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f24340b2900 0x7f24340b4dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f243c00b5c0 tx=0x7f243c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:37.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.277+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f245010d650 con 0x7f24501056e0 2024-05-08T06:44:37.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.277+0000 7f2446a00700 1 -- 172.21.15.70:0/3120609364 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f24400aa280 con 0x7f24501056e0 2024-05-08T06:44:37.277 INFO:teuthology.orchestra.run.smithi070.stdout:313532612668 2024-05-08T06:44:37.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.280+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f24340b2900 msgr2=0x7f24340b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.280+0000 7f2454c00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f24340b2900 0x7f24340b4dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f243c00b5c0 tx=0x7f243c01a040 comp rx=0 tx=0).stop 2024-05-08T06:44:37.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.280+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 msgr2=0x7f245019bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.280+0000 7f2454c00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 0x7f245019bd30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f244000d980 tx=0x7f244000dd40 comp rx=0 tx=0).stop 2024-05-08T06:44:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.281+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 shutdown_connections 2024-05-08T06:44:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.281+0000 7f2454c00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f245010b6e0 0x7f24501a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.281+0000 7f2454c00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f24340b2900 0x7f24340b4dc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.281+0000 7f2454c00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501056e0 0x7f245019bd30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.281+0000 7f2454c00700 1 --2- 172.21.15.70:0/3120609364 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24501060a0 0x7f245019c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.281+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 >> 172.21.15.70:0/3120609364 conn(0x7f24501011d0 msgr2=0x7f2450101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.281+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 shutdown_connections 2024-05-08T06:44:37.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.281+0000 7f2454c00700 1 -- 172.21.15.70:0/3120609364 wait complete. 2024-05-08T06:44:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:37 smithi070 ceph-mon[29591]: pgmap v483: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:44:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:37 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1129138532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T06:44:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:37 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3120609364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T06:44:37.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:37 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3712482647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T06:44:37.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.128+0000 7f1c83e00700 1 -- 172.21.15.70:0/1029541003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c104100 msgr2=0x7f1c7c108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.128+0000 7f1c83e00700 1 --2- 172.21.15.70:0/1029541003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c104100 0x7f1c7c108120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1c680099c0 tx=0x7f1c68009cd0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.129+0000 7f1c83e00700 1 -- 172.21.15.70:0/1029541003 shutdown_connections 2024-05-08T06:44:37.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.129+0000 7f1c83e00700 1 --2- 172.21.15.70:0/1029541003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c7c108850 0x7f1c7c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.129+0000 7f1c83e00700 1 --2- 172.21.15.70:0/1029541003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c7c103750 0x7f1c7c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.129+0000 7f1c83e00700 1 --2- 172.21.15.70:0/1029541003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c104100 0x7f1c7c108120 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.129+0000 7f1c83e00700 1 -- 172.21.15.70:0/1029541003 >> 172.21.15.70:0/1029541003 conn(0x7f1c7c07a600 msgr2=0x7f1c7c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.129+0000 7f1c83e00700 1 -- 172.21.15.70:0/1029541003 shutdown_connections 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.129+0000 7f1c83e00700 1 -- 172.21.15.70:0/1029541003 wait complete. 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.130+0000 7f1c83e00700 1 Processor -- start 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.130+0000 7f1c83e00700 1 -- start start 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c83e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c103750 0x7f1c7c1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c83e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c7c104100 0x7f1c7c1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c83e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c7c108850 0x7f1c7c19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c83e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c113510 con 0x7f1c7c103750 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c83e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c113390 con 0x7f1c7c104100 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c83e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c113690 con 0x7f1c7c108850 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c81400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c103750 0x7f1c7c1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c81400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c103750 0x7f1c7c1a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41928/0 (socket says 172.21.15.70:41928) 2024-05-08T06:44:37.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c81400700 1 -- 172.21.15.70:0/3712482647 learned_addr learned my addr 172.21.15.70:0/3712482647 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c81e00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c7c108850 0x7f1c7c19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.131+0000 7f1c80a00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c7c104100 0x7f1c7c1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.132+0000 7f1c81400700 1 -- 172.21.15.70:0/3712482647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c7c108850 msgr2=0x7f1c7c19ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.132+0000 7f1c81400700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c7c108850 0x7f1c7c19ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.132+0000 7f1c81400700 1 -- 172.21.15.70:0/3712482647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c7c104100 msgr2=0x7f1c7c1a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.132+0000 7f1c81400700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c7c104100 0x7f1c7c1a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.132+0000 7f1c81400700 1 -- 172.21.15.70:0/3712482647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7c19c1d0 con 0x7f1c7c103750 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.132+0000 7f1c81400700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c103750 0x7f1c7c1a18b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000d950 tx=0x7f1c7000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.133+0000 7f1c7a000700 1 -- 172.21.15.70:0/3712482647 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c70016070 con 0x7f1c7c103750 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.133+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7c19c4c0 con 0x7f1c7c103750 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.133+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c7c1a8780 con 0x7f1c7c103750 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.133+0000 7f1c7a000700 1 -- 172.21.15.70:0/3712482647 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c7000fd20 con 0x7f1c7c103750 2024-05-08T06:44:37.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.133+0000 7f1c7a000700 1 -- 172.21.15.70:0/3712482647 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000e3b0 con 0x7f1c7c103750 2024-05-08T06:44:37.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.136+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5c005330 con 0x7f1c7c103750 2024-05-08T06:44:37.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.137+0000 7f1c7a000700 1 -- 172.21.15.70:0/3712482647 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1c70019070 con 0x7f1c7c103750 2024-05-08T06:44:37.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.139+0000 7f1c7a000700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c640b2900 0x7f1c640b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:37.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.139+0000 7f1c7a000700 1 -- 172.21.15.70:0/3712482647 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f1c700e2370 con 0x7f1c7c103750 2024-05-08T06:44:37.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.139+0000 7f1c80a00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c640b2900 0x7f1c640b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:37.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.140+0000 7f1c80a00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c640b2900 0x7f1c640b4dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1c68000c00 tx=0x7f1c68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:37.727 INFO:teuthology.orchestra.run.smithi070.stdout:287762808899 2024-05-08T06:44:37.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.144+0000 7f1c7a000700 1 -- 172.21.15.70:0/3712482647 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1c700a9c40 con 0x7f1c7c103750 2024-05-08T06:44:37.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.384+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f1c5c005620 con 0x7f1c7c103750 2024-05-08T06:44:37.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.385+0000 7f1c7a000700 1 -- 172.21.15.70:0/3712482647 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f1c700a9540 con 0x7f1c7c103750 2024-05-08T06:44:37.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c640b2900 msgr2=0x7f1c640b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c640b2900 0x7f1c640b4dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1c68000c00 tx=0x7f1c68005fb0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c103750 msgr2=0x7f1c7c1a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:37.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c103750 0x7f1c7c1a18b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000d950 tx=0x7f1c7000dc60 comp rx=0 tx=0).stop 2024-05-08T06:44:37.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 shutdown_connections 2024-05-08T06:44:37.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c7c108850 0x7f1c7c19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c640b2900 0x7f1c640b4dc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c7c103750 0x7f1c7c1a18b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 --2- 172.21.15.70:0/3712482647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c7c104100 0x7f1c7c1a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:37.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 >> 172.21.15.70:0/3712482647 conn(0x7f1c7c07a600 msgr2=0x7f1c7c1016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:37.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 shutdown_connections 2024-05-08T06:44:37.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.388+0000 7f1c83e00700 1 -- 172.21.15.70:0/3712482647 wait complete. 2024-05-08T06:44:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:37 smithi194 ceph-mon[33679]: pgmap v483: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:44:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:37 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1129138532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T06:44:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:37 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3120609364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T06:44:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:37 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3712482647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T06:44:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:37 smithi172 ceph-mon[33377]: pgmap v483: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:44:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:37 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1129138532' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T06:44:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:37 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3120609364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T06:44:37.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:37 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3712482647' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T06:44:38.505 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953576 got 137438953582 for osd.4 2024-05-08T06:44:38.505 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.791+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129100726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 msgr2=0x7fc7a0116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.791+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129100726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 0x7fc7a0116a60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc79800b0a0 tx=0x7fc79800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.791+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129100726 shutdown_connections 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.791+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129100726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 0x7fc7a0116a60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.791+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129100726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7a00756d0 0x7fc7a0075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.791+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129100726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7a0075ff0 0x7fc7a0114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.791+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129100726 >> 172.21.15.70:0/1129100726 conn(0x7fc7a007a650 msgr2=0x7fc7a007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.791+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129100726 shutdown_connections 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.791+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129100726 wait complete. 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.792+0000 7fc7a6c00700 1 Processor -- start 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.792+0000 7fc7a6c00700 1 -- start start 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.792+0000 7fc7a6c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7a00756d0 0x7fc7a01a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.792+0000 7fc7a6c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7a0075ff0 0x7fc7a01a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.792+0000 7fc7a6c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 0x7fc7a01a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a6c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0119b60 con 0x7fc7a0114670 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a6c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a01199e0 con 0x7fc7a0075ff0 2024-05-08T06:44:38.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a6c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc7a0119ce0 con 0x7fc7a00756d0 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 0x7fc7a01a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 0x7fc7a01a49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41892/0 (socket says 172.21.15.70:41892) 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a4c00700 1 -- 172.21.15.70:0/1129138532 learned_addr learned my addr 172.21.15.70:0/1129138532 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc79fe00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7a00756d0 0x7fc7a01a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc79f400700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7a0075ff0 0x7fc7a01a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a4c00700 1 -- 172.21.15.70:0/1129138532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7a00756d0 msgr2=0x7fc7a01a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a4c00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7a00756d0 0x7fc7a01a00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a4c00700 1 -- 172.21.15.70:0/1129138532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7a0075ff0 msgr2=0x7fc7a01a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a4c00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7a0075ff0 0x7fc7a01a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.793+0000 7fc7a4c00700 1 -- 172.21.15.70:0/1129138532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a01a50e0 con 0x7fc7a0114670 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.794+0000 7fc7a4c00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 0x7fc7a01a49a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc79800b830 tx=0x7fc798004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.794+0000 7fc79cc00700 1 -- 172.21.15.70:0/1129138532 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc798021070 con 0x7fc7a0114670 2024-05-08T06:44:38.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.794+0000 7fc79cc00700 1 -- 172.21.15.70:0/1129138532 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc798007b80 con 0x7fc7a0114670 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.794+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a01a5370 con 0x7fc7a0114670 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.794+0000 7fc79cc00700 1 -- 172.21.15.70:0/1129138532 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7980052a0 con 0x7fc7a0114670 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.794+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7a01acc50 con 0x7fc7a0114670 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.795+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7a006a190 con 0x7fc7a0114670 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.798+0000 7fc79cc00700 1 -- 172.21.15.70:0/1129138532 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc798024070 con 0x7fc7a0114670 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.799+0000 7fc79cc00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc7840b2880 0x7fc7840b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.800+0000 7fc79cc00700 1 -- 172.21.15.70:0/1129138532 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fc79800f020 con 0x7fc7a0114670 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.800+0000 7fc79fe00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc7840b2880 0x7fc7840b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.801+0000 7fc79fe00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc7840b2880 0x7fc7840b4d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc790005950 tx=0x7fc7900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:36.802+0000 7fc79cc00700 1 -- 172.21.15.70:0/1129138532 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc79802b020 con 0x7fc7a0114670 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.058+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc7a01ace20 con 0x7fc7a0114670 2024-05-08T06:44:38.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.059+0000 7fc79cc00700 1 -- 172.21.15.70:0/1129138532 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7980aba80 con 0x7fc7a0114670 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stdout:34359738504 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.062+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc7840b2880 msgr2=0x7fc7840b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.063+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc7840b2880 0x7fc7840b4d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc790005950 tx=0x7fc7900058e0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.063+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 msgr2=0x7fc7a01a49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.063+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 0x7fc7a01a49a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc79800b830 tx=0x7fc798004d90 comp rx=0 tx=0).stop 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.063+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 shutdown_connections 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.063+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc7840b2880 0x7fc7840b4d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.063+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc7a0114670 0x7fc7a01a49a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.063+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7a00756d0 0x7fc7a01a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.063+0000 7fc7a6c00700 1 --2- 172.21.15.70:0/1129138532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7a0075ff0 0x7fc7a01a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:38.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.063+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 >> 172.21.15.70:0/1129138532 conn(0x7fc7a007a650 msgr2=0x7fc7a0110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:38.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.064+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 shutdown_connections 2024-05-08T06:44:38.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:37.064+0000 7fc7a6c00700 1 -- 172.21.15.70:0/1129138532 wait complete. 2024-05-08T06:44:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:39 smithi070 ceph-mon[29591]: pgmap v484: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:39 smithi194 ceph-mon[33679]: pgmap v484: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:39 smithi172 ceph-mon[33377]: pgmap v484: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:40.099 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149807 got 111669149812 for osd.3 2024-05-08T06:44:40.100 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:40.449 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808892 got 287762808899 for osd.10 2024-05-08T06:44:40.450 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:40.589 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612661 got 313532612668 for osd.11 2024-05-08T06:44:40.589 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:40.831 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972422 got 266287972427 for osd.9 2024-05-08T06:44:40.832 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:40.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.940+0000 7f40f7600700 1 -- 172.21.15.70:0/1263367120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f0109510 msgr2=0x7f40f01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:40.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.940+0000 7f40f7600700 1 --2- 172.21.15.70:0/1263367120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f0109510 0x7f40f01098f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f40e4009990 tx=0x7f40e4009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:40.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.940+0000 7f40f7600700 1 -- 172.21.15.70:0/1263367120 shutdown_connections 2024-05-08T06:44:40.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.940+0000 7f40f7600700 1 --2- 172.21.15.70:0/1263367120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f006c590 0x7f40f0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:40.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.940+0000 7f40f7600700 1 --2- 172.21.15.70:0/1263367120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f0109510 0x7f40f01098f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:40.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.940+0000 7f40f7600700 1 --2- 172.21.15.70:0/1263367120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f006bbd0 0x7f40f006c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:40.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.940+0000 7f40f7600700 1 -- 172.21.15.70:0/1263367120 >> 172.21.15.70:0/1263367120 conn(0x7f40f0079350 msgr2=0x7f40f0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:40.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.940+0000 7f40f7600700 1 -- 172.21.15.70:0/1263367120 shutdown_connections 2024-05-08T06:44:40.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.940+0000 7f40f7600700 1 -- 172.21.15.70:0/1263367120 wait complete. 2024-05-08T06:44:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.941+0000 7f40f7600700 1 Processor -- start 2024-05-08T06:44:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.941+0000 7f40f7600700 1 -- start start 2024-05-08T06:44:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40f7600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f006bbd0 0x7f40f019f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40f7600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f006c590 0x7f40f019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40f7600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0109510 0x7f40f01998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40f7600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0113520 con 0x7f40f006c590 2024-05-08T06:44:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40f7600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01133a0 con 0x7f40f006bbd0 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40f7600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01136a0 con 0x7f40f0109510 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40efe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f006c590 0x7f40f019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40efe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f006c590 0x7f40f019fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51586/0 (socket says 172.21.15.70:51586) 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40efe00700 1 -- 172.21.15.70:0/2677913330 learned_addr learned my addr 172.21.15.70:0/2677913330 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40f4c00700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f006bbd0 0x7f40f019f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.942+0000 7f40f5600700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0109510 0x7f40f01998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40efe00700 1 -- 172.21.15.70:0/2677913330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0109510 msgr2=0x7f40f01998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40efe00700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0109510 0x7f40f01998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40efe00700 1 -- 172.21.15.70:0/2677913330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f006bbd0 msgr2=0x7f40f019f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40efe00700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f006bbd0 0x7f40f019f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40efe00700 1 -- 172.21.15.70:0/2677913330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f019a000 con 0x7f40f006c590 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40efe00700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f006c590 0x7f40f019fc20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00c9b0 tx=0x7f40dc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40ed600700 1 -- 172.21.15.70:0/2677913330 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc007b00 con 0x7f40f006c590 2024-05-08T06:44:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40ed600700 1 -- 172.21.15.70:0/2677913330 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f40dc007ca0 con 0x7f40f006c590 2024-05-08T06:44:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f019a2f0 con 0x7f40f006c590 2024-05-08T06:44:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40ed600700 1 -- 172.21.15.70:0/2677913330 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40dc018660 con 0x7f40f006c590 2024-05-08T06:44:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.943+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f01a65b0 con 0x7f40f006c590 2024-05-08T06:44:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.945+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f010b9f0 con 0x7f40f006c590 2024-05-08T06:44:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.947+0000 7f40ed600700 1 -- 172.21.15.70:0/2677913330 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f40dc00f450 con 0x7f40f006c590 2024-05-08T06:44:40.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.948+0000 7f40ed600700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f40d80b2880 0x7f40d80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:40.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.948+0000 7f40ed600700 1 -- 172.21.15.70:0/2677913330 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f40dc0e2710 con 0x7f40f006c590 2024-05-08T06:44:40.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.949+0000 7f40f4c00700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f40d80b2880 0x7f40d80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:40.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.949+0000 7f40f4c00700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f40d80b2880 0x7f40d80b4d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f40e400b5c0 tx=0x7f40e401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:40.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:40.953+0000 7f40ed600700 1 -- 172.21.15.70:0/2677913330 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f40dc014030 con 0x7f40f006c590 2024-05-08T06:44:41.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.191+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f40f010b3d0 con 0x7f40f006c590 2024-05-08T06:44:41.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.192+0000 7f40ed600700 1 -- 172.21.15.70:0/2677913330 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f40dc0a9fe0 con 0x7f40f006c590 2024-05-08T06:44:41.192 INFO:teuthology.orchestra.run.smithi070.stdout:240518168658 2024-05-08T06:44:41.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.195+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f40d80b2880 msgr2=0x7f40d80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:41.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.195+0000 7f40f7600700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f40d80b2880 0x7f40d80b4d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f40e400b5c0 tx=0x7f40e401a040 comp rx=0 tx=0).stop 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.195+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f006c590 msgr2=0x7f40f019fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.195+0000 7f40f7600700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f006c590 0x7f40f019fc20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00c9b0 tx=0x7f40dc00cd70 comp rx=0 tx=0).stop 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.195+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 shutdown_connections 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.195+0000 7f40f7600700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40f0109510 0x7f40f01998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.195+0000 7f40f7600700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f40f006bbd0 0x7f40f019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.195+0000 7f40f7600700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f40d80b2880 0x7f40d80b4d40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.195+0000 7f40f7600700 1 --2- 172.21.15.70:0/2677913330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40f006c590 0x7f40f019fc20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.196+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 >> 172.21.15.70:0/2677913330 conn(0x7f40f0079350 msgr2=0x7f40f0101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.196+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 shutdown_connections 2024-05-08T06:44:41.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:41.196+0000 7f40f7600700 1 -- 172.21.15.70:0/2677913330 wait complete. 2024-05-08T06:44:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:41 smithi070 ceph-mon[29591]: pgmap v485: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:44:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:41 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2677913330' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T06:44:41.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:41 smithi172 ceph-mon[33377]: pgmap v485: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:44:41.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:41 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2677913330' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T06:44:42.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:41 smithi194 ceph-mon[33679]: pgmap v485: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:44:42.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:41 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2677913330' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T06:44:42.263 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168652 got 240518168658 for osd.8 2024-05-08T06:44:42.263 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.867+0000 7f3223200700 1 -- 172.21.15.70:0/1012398238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c109ad0 msgr2=0x7f321c109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.867+0000 7f3223200700 1 --2- 172.21.15.70:0/1012398238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c109ad0 0x7f321c109f50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3208009990 tx=0x7f3208009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.867+0000 7f3223200700 1 -- 172.21.15.70:0/1012398238 shutdown_connections 2024-05-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.867+0000 7f3223200700 1 --2- 172.21.15.70:0/1012398238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f321c10a490 0x7f321c1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.867+0000 7f3223200700 1 --2- 172.21.15.70:0/1012398238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c10fb60 0x7f321c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.867+0000 7f3223200700 1 --2- 172.21.15.70:0/1012398238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c109ad0 0x7f321c109f50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.867+0000 7f3223200700 1 -- 172.21.15.70:0/1012398238 >> 172.21.15.70:0/1012398238 conn(0x7f321c076c70 msgr2=0x7f321c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.868+0000 7f3223200700 1 -- 172.21.15.70:0/1012398238 shutdown_connections 2024-05-08T06:44:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.868+0000 7f3223200700 1 -- 172.21.15.70:0/1012398238 wait complete. 2024-05-08T06:44:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.869+0000 7f3223200700 1 Processor -- start 2024-05-08T06:44:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.869+0000 7f3223200700 1 -- start start 2024-05-08T06:44:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.869+0000 7f3223200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f321c109ad0 0x7f321c1a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.869+0000 7f3223200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c10a490 0x7f321c1a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.869+0000 7f3223200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c10fb60 0x7f321c1a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.869+0000 7f3223200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f321c119b60 con 0x7f321c10a490 2024-05-08T06:44:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.869+0000 7f3223200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f321c1199e0 con 0x7f321c109ad0 2024-05-08T06:44:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.869+0000 7f3223200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f321c119ce0 con 0x7f321c10fb60 2024-05-08T06:44:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c10a490 0x7f321c1a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c10a490 0x7f321c1a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51606/0 (socket says 172.21.15.70:51606) 2024-05-08T06:44:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321b400700 1 -- 172.21.15.70:0/76552039 learned_addr learned my addr 172.21.15.70:0/76552039 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321be00700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f321c109ad0 0x7f321c1a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f3221200700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c10fb60 0x7f321c1a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321b400700 1 -- 172.21.15.70:0/76552039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c10fb60 msgr2=0x7f321c1a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321b400700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c10fb60 0x7f321c1a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321b400700 1 -- 172.21.15.70:0/76552039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f321c109ad0 msgr2=0x7f321c1a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321b400700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f321c109ad0 0x7f321c1a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321b400700 1 -- 172.21.15.70:0/76552039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c1a5080 con 0x7f321c10a490 2024-05-08T06:44:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f321be00700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f321c109ad0 0x7f321c1a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:44:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.870+0000 7f3221200700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c10fb60 0x7f321c1a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:44:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.871+0000 7f321b400700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c10a490 0x7f321c1a05b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3208006010 tx=0x7f320800bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:42.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.871+0000 7f3218c00700 1 -- 172.21.15.70:0/76552039 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3208027070 con 0x7f321c10a490 2024-05-08T06:44:42.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.871+0000 7f3218c00700 1 -- 172.21.15.70:0/76552039 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f320800fb90 con 0x7f321c10a490 2024-05-08T06:44:42.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.871+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321c1a5310 con 0x7f321c10a490 2024-05-08T06:44:42.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.871+0000 7f3218c00700 1 -- 172.21.15.70:0/76552039 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32080173f0 con 0x7f321c10a490 2024-05-08T06:44:42.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.871+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321c1acbf0 con 0x7f321c10a490 2024-05-08T06:44:42.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.872+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321c06a190 con 0x7f321c10a490 2024-05-08T06:44:42.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.875+0000 7f3218c00700 1 -- 172.21.15.70:0/76552039 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f320802a070 con 0x7f321c10a490 2024-05-08T06:44:42.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.877+0000 7f3218c00700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f32000b2900 0x7f32000b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:42.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.877+0000 7f3218c00700 1 -- 172.21.15.70:0/76552039 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f32080e3920 con 0x7f321c10a490 2024-05-08T06:44:42.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.877+0000 7f321be00700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f32000b2900 0x7f32000b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:42.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.878+0000 7f321be00700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f32000b2900 0x7f32000b4dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f320c009b50 tx=0x7f320c009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:42.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:42.879+0000 7f3218c00700 1 -- 172.21.15.70:0/76552039 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3208013070 con 0x7f321c10a490 2024-05-08T06:44:43.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.116+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f321c02e510 con 0x7f321c10a490 2024-05-08T06:44:43.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.117+0000 7f3218c00700 1 -- 172.21.15.70:0/76552039 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f32080ab280 con 0x7f321c10a490 2024-05-08T06:44:43.116 INFO:teuthology.orchestra.run.smithi070.stdout:214748364890 2024-05-08T06:44:43.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.120+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f32000b2900 msgr2=0x7f32000b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:43.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.120+0000 7f3223200700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f32000b2900 0x7f32000b4dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f320c009b50 tx=0x7f320c009550 comp rx=0 tx=0).stop 2024-05-08T06:44:43.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.120+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c10a490 msgr2=0x7f321c1a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:43.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.120+0000 7f3223200700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c10a490 0x7f321c1a05b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3208006010 tx=0x7f320800bfa0 comp rx=0 tx=0).stop 2024-05-08T06:44:43.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.121+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 shutdown_connections 2024-05-08T06:44:43.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.121+0000 7f3223200700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f321c10fb60 0x7f321c1a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:43.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.121+0000 7f3223200700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f321c109ad0 0x7f321c1a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:43.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.121+0000 7f3223200700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f32000b2900 0x7f32000b4dc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:43.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.121+0000 7f3223200700 1 --2- 172.21.15.70:0/76552039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f321c10a490 0x7f321c1a05b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:43.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.121+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 >> 172.21.15.70:0/76552039 conn(0x7f321c076c70 msgr2=0x7f321c077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:43.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.121+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 shutdown_connections 2024-05-08T06:44:43.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:43.121+0000 7f3223200700 1 -- 172.21.15.70:0/76552039 wait complete. 2024-05-08T06:44:43.274 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:43.309 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738496 got 34359738504 for osd.0 2024-05-08T06:44:43.309 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:43.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:43 smithi070 ceph-mon[29591]: pgmap v486: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:43.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:43 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/76552039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T06:44:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:43 smithi172 ceph-mon[33377]: pgmap v486: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:43 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/76552039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T06:44:44.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:43 smithi194 ceph-mon[33679]: pgmap v486: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:44.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:43 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/76552039' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T06:44:44.950 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364881 got 214748364890 for osd.7 2024-05-08T06:44:44.951 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:45.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:45 smithi070 ceph-mon[29591]: pgmap v487: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:44:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:45 smithi172 ceph-mon[33377]: pgmap v487: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:44:46.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:45 smithi194 ceph-mon[33679]: pgmap v487: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:44:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.447+0000 7f8ef0200700 1 -- 172.21.15.70:0/4170162349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8103750 msgr2=0x7f8ee8103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.447+0000 7f8ef0200700 1 --2- 172.21.15.70:0/4170162349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8103750 0x7f8ee8103b30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8edc00b0d0 tx=0x7f8edc00b3e0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.447+0000 7f8ef0200700 1 -- 172.21.15.70:0/4170162349 shutdown_connections 2024-05-08T06:44:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.447+0000 7f8ef0200700 1 --2- 172.21.15.70:0/4170162349 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee8108850 0x7f8ee81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.447+0000 7f8ef0200700 1 --2- 172.21.15.70:0/4170162349 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8103750 0x7f8ee8103b30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.447+0000 7f8ef0200700 1 --2- 172.21.15.70:0/4170162349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8104100 0x7f8ee8108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.447+0000 7f8ef0200700 1 -- 172.21.15.70:0/4170162349 >> 172.21.15.70:0/4170162349 conn(0x7f8ee807a600 msgr2=0x7f8ee807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.447+0000 7f8ef0200700 1 -- 172.21.15.70:0/4170162349 shutdown_connections 2024-05-08T06:44:46.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.447+0000 7f8ef0200700 1 -- 172.21.15.70:0/4170162349 wait complete. 2024-05-08T06:44:46.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.448+0000 7f8ef0200700 1 Processor -- start 2024-05-08T06:44:46.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.448+0000 7f8ef0200700 1 -- start start 2024-05-08T06:44:46.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.449+0000 7f8ef0200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee8103750 0x7f8ee819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:46.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.449+0000 7f8ef0200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8104100 0x7f8ee819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:46.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.449+0000 7f8ef0200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8108850 0x7f8ee81997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:46.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.449+0000 7f8ef0200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee81134d0 con 0x7f8ee8104100 2024-05-08T06:44:46.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.449+0000 7f8ef0200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8113350 con 0x7f8ee8103750 2024-05-08T06:44:46.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.449+0000 7f8ef0200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8113650 con 0x7f8ee8108850 2024-05-08T06:44:46.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.449+0000 7f8eece00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8104100 0x7f8ee819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:46.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.449+0000 7f8eece00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8104100 0x7f8ee819fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51622/0 (socket says 172.21.15.70:51622) 2024-05-08T06:44:46.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.449+0000 7f8eece00700 1 -- 172.21.15.70:0/2265435551 learned_addr learned my addr 172.21.15.70:0/2265435551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:46.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.450+0000 7f8eee200700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8108850 0x7f8ee81997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:46.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.450+0000 7f8eed800700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee8103750 0x7f8ee819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:46.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.450+0000 7f8eece00700 1 -- 172.21.15.70:0/2265435551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8108850 msgr2=0x7f8ee81997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.450+0000 7f8eece00700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8108850 0x7f8ee81997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.450+0000 7f8eece00700 1 -- 172.21.15.70:0/2265435551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee8103750 msgr2=0x7f8ee819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.450+0000 7f8eece00700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee8103750 0x7f8ee819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.450+0000 7f8eece00700 1 -- 172.21.15.70:0/2265435551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee8199fd0 con 0x7f8ee8104100 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.450+0000 7f8eece00700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8104100 0x7f8ee819fbb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c9b0 tx=0x7f8ed400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.451+0000 7f8ee6000700 1 -- 172.21.15.70:0/2265435551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4007b00 con 0x7f8ee8104100 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.451+0000 7f8ee6000700 1 -- 172.21.15.70:0/2265435551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ed4007ca0 con 0x7f8ee8104100 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.451+0000 7f8ee6000700 1 -- 172.21.15.70:0/2265435551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4018660 con 0x7f8ee8104100 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.451+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee819a2c0 con 0x7f8ee8104100 2024-05-08T06:44:46.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.451+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee81a64d0 con 0x7f8ee8104100 2024-05-08T06:44:46.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.452+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee810ba90 con 0x7f8ee8104100 2024-05-08T06:44:46.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.454+0000 7f8ee6000700 1 -- 172.21.15.70:0/2265435551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8ed400f450 con 0x7f8ee8104100 2024-05-08T06:44:46.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.456+0000 7f8ee6000700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8ed00b2900 0x7f8ed00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:46.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.456+0000 7f8ee6000700 1 -- 172.21.15.70:0/2265435551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f8ed40e28d0 con 0x7f8ee8104100 2024-05-08T06:44:46.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.456+0000 7f8eed800700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8ed00b2900 0x7f8ed00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:46.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.457+0000 7f8eed800700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8ed00b2900 0x7f8ed00b4dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009e60 tx=0x7f8edc00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:46.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.458+0000 7f8ee6000700 1 -- 172.21.15.70:0/2265435551 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8ed4014030 con 0x7f8ee8104100 2024-05-08T06:44:46.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.696+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8ee819ad20 con 0x7f8ee8104100 2024-05-08T06:44:46.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.697+0000 7f8ee6000700 1 -- 172.21.15.70:0/2265435551 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8ed40aa310 con 0x7f8ee8104100 2024-05-08T06:44:46.696 INFO:teuthology.orchestra.run.smithi070.stdout:163208757354 2024-05-08T06:44:46.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8ed00b2900 msgr2=0x7f8ed00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:46.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8ed00b2900 0x7f8ed00b4dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009e60 tx=0x7f8edc00b040 comp rx=0 tx=0).stop 2024-05-08T06:44:46.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8104100 msgr2=0x7f8ee819fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:46.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8104100 0x7f8ee819fbb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c9b0 tx=0x7f8ed400cd70 comp rx=0 tx=0).stop 2024-05-08T06:44:46.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 shutdown_connections 2024-05-08T06:44:46.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8ee8108850 0x7f8ee81997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8ee8103750 0x7f8ee819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f8ed00b2900 0x7f8ed00b4dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 --2- 172.21.15.70:0/2265435551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8ee8104100 0x7f8ee819fbb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:46.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.700+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 >> 172.21.15.70:0/2265435551 conn(0x7f8ee807a600 msgr2=0x7f8ee8101840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:46.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.701+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 shutdown_connections 2024-05-08T06:44:46.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:46.701+0000 7f8ef0200700 1 -- 172.21.15.70:0/2265435551 wait complete. 2024-05-08T06:44:47.703 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757347 got 163208757354 for osd.5 2024-05-08T06:44:47.703 DEBUG:teuthology.parallel:result is None 2024-05-08T06:44:47.703 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-08T06:44:47.703 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T06:44:47.780 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:47 smithi070 ceph-mon[29591]: pgmap v488: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:44:47.780 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:47 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2265435551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T06:44:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:47 smithi172 ceph-mon[33377]: pgmap v488: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:44:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:47 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2265435551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T06:44:48.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:47 smithi194 ceph-mon[33679]: pgmap v488: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:44:48.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:47 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2265435551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T06:44:48.150 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:49 smithi070 ceph-mon[29591]: pgmap v489: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:49 smithi172 ceph-mon[33377]: pgmap v489: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:50.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:49 smithi194 ceph-mon[33679]: pgmap v489: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.618+0000 7fad26c00700 1 -- 172.21.15.70:0/2478659191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20103750 msgr2=0x7fad20103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.618+0000 7fad26c00700 1 --2- 172.21.15.70:0/2478659191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20103750 0x7fad20103b30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fad100099c0 tx=0x7fad10009cd0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.619+0000 7fad26c00700 1 -- 172.21.15.70:0/2478659191 shutdown_connections 2024-05-08T06:44:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.619+0000 7fad26c00700 1 --2- 172.21.15.70:0/2478659191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad20108850 0x7fad201103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.619+0000 7fad26c00700 1 --2- 172.21.15.70:0/2478659191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20103750 0x7fad20103b30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.619+0000 7fad26c00700 1 --2- 172.21.15.70:0/2478659191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad20104100 0x7fad20108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.619+0000 7fad26c00700 1 -- 172.21.15.70:0/2478659191 >> 172.21.15.70:0/2478659191 conn(0x7fad2007a600 msgr2=0x7fad2007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.619+0000 7fad26c00700 1 -- 172.21.15.70:0/2478659191 shutdown_connections 2024-05-08T06:44:50.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.619+0000 7fad26c00700 1 -- 172.21.15.70:0/2478659191 wait complete. 2024-05-08T06:44:50.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.621+0000 7fad26c00700 1 Processor -- start 2024-05-08T06:44:50.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.621+0000 7fad26c00700 1 -- start start 2024-05-08T06:44:50.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.621+0000 7fad26c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad20103750 0x7fad200757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:50.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.621+0000 7fad26c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20104100 0x7fad20075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:50.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.621+0000 7fad26c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad20108850 0x7fad20076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:50.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.621+0000 7fad26c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fad20113520 con 0x7fad20104100 2024-05-08T06:44:50.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.621+0000 7fad26c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fad201133a0 con 0x7fad20103750 2024-05-08T06:44:50.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.621+0000 7fad26c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fad201136a0 con 0x7fad20108850 2024-05-08T06:44:50.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad1f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20104100 0x7fad20075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:50.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad1f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20104100 0x7fad20075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53512/0 (socket says 172.21.15.70:53512) 2024-05-08T06:44:50.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad1f400700 1 -- 172.21.15.70:0/1250679072 learned_addr learned my addr 172.21.15.70:0/1250679072 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:50.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad1fe00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad20103750 0x7fad200757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:50.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad24c00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad20108850 0x7fad20076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:50.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad1f400700 1 -- 172.21.15.70:0/1250679072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad20108850 msgr2=0x7fad20076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:50.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad1f400700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad20108850 0x7fad20076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad1f400700 1 -- 172.21.15.70:0/1250679072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad20103750 msgr2=0x7fad200757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:50.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad1f400700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad20103750 0x7fad200757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.622+0000 7fad1f400700 1 -- 172.21.15.70:0/1250679072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad201a7ef0 con 0x7fad20104100 2024-05-08T06:44:50.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.623+0000 7fad1f400700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20104100 0x7fad20075ce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00d950 tx=0x7fad0c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:50.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.623+0000 7fad1cc00700 1 -- 172.21.15.70:0/1250679072 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c016070 con 0x7fad20104100 2024-05-08T06:44:50.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.623+0000 7fad1cc00700 1 -- 172.21.15.70:0/1250679072 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad0c00fd20 con 0x7fad20104100 2024-05-08T06:44:50.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.623+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad201a81e0 con 0x7fad20104100 2024-05-08T06:44:50.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.623+0000 7fad1cc00700 1 -- 172.21.15.70:0/1250679072 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00e3b0 con 0x7fad20104100 2024-05-08T06:44:50.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.623+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad201a8770 con 0x7fad20104100 2024-05-08T06:44:50.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.625+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad2010ba90 con 0x7fad20104100 2024-05-08T06:44:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.628+0000 7fad1cc00700 1 -- 172.21.15.70:0/1250679072 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fad0c019070 con 0x7fad20104100 2024-05-08T06:44:50.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.629+0000 7fad1cc00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fad040b2900 0x7fad040b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:50.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.629+0000 7fad1cc00700 1 -- 172.21.15.70:0/1250679072 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fad0c0e20c0 con 0x7fad20104100 2024-05-08T06:44:50.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.629+0000 7fad1fe00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fad040b2900 0x7fad040b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:50.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.630+0000 7fad1fe00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fad040b2900 0x7fad040b4dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad10000c00 tx=0x7fad10005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:50.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.634+0000 7fad1cc00700 1 -- 172.21.15.70:0/1250679072 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fad0c0a9990 con 0x7fad20104100 2024-05-08T06:44:50.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.862+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad200638e0 con 0x7fad040b2900 2024-05-08T06:44:50.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.902+0000 7fad1cc00700 1 -- 172.21.15.70:0/1250679072 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340463 (secure 0 0 0) 0x7fad1007b200 con 0x7fad040b2900 2024-05-08T06:44:50.907 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:44:50.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fad040b2900 msgr2=0x7fad040b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:50.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fad040b2900 0x7fad040b4dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fad10000c00 tx=0x7fad10005fb0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20104100 msgr2=0x7fad20075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:50.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20104100 0x7fad20075ce0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fad0c00d950 tx=0x7fad0c00dc60 comp rx=0 tx=0).stop 2024-05-08T06:44:50.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 shutdown_connections 2024-05-08T06:44:50.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad20108850 0x7fad20076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fad20103750 0x7fad200757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fad040b2900 0x7fad040b4dc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 --2- 172.21.15.70:0/1250679072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fad20104100 0x7fad20075ce0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:50.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 >> 172.21.15.70:0/1250679072 conn(0x7fad2007a600 msgr2=0x7fad201017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:50.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.909+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 shutdown_connections 2024-05-08T06:44:50.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:50.910+0000 7fad26c00700 1 -- 172.21.15.70:0/1250679072 wait complete. 2024-05-08T06:44:50.911 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-08T06:44:51.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:51 smithi070 ceph-mon[29591]: pgmap v490: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:44:51.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:51 smithi070 ceph-mon[29591]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:44:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:51 smithi172 ceph-mon[33377]: pgmap v490: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:44:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:51 smithi172 ceph-mon[33377]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:44:51.943 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":490,"stamp":"2024-05-08T06:44:50.181274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663223,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":863,"num_read_kb":537,"num_write":300,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":744,"ondisk_log_size":744,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384444,"kb_used_data":14492,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557380,"statfs":{"total":1151940427776,"available":1151546757120,"internally_reserved":0,"allocated":14839808,"data_stored":8304023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005907"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.113430+0000","last_change":"2024-05-08T06:41:09.587375+0000","last_active":"2024-05-08T06:44:14.113430+0000","last_peered":"2024-05-08T06:44:14.113430+0000","last_clean":"2024-05-08T06:44:14.113430+0000","last_became_active":"2024-05-08T06:41:09.585981+0000","last_became_peered":"2024-05-08T06:41:09.585981+0000","last_unstale":"2024-05-08T06:44:14.113430+0000","last_undegraded":"2024-05-08T06:44:14.113430+0000","last_fullsized":"2024-05-08T06:44:14.113430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:21.366529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.108971+0000","last_change":"2024-05-08T06:41:09.573666+0000","last_active":"2024-05-08T06:44:14.108971+0000","last_peered":"2024-05-08T06:44:14.108971+0000","last_clean":"2024-05-08T06:44:14.108971+0000","last_became_active":"2024-05-08T06:41:09.573331+0000","last_became_peered":"2024-05-08T06:41:09.573331+0000","last_unstale":"2024-05-08T06:44:14.108971+0000","last_undegraded":"2024-05-08T06:44:14.108971+0000","last_fullsized":"2024-05-08T06:44:14.108971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:03:14.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111904+0000","last_change":"2024-05-08T06:41:09.582304+0000","last_active":"2024-05-08T06:44:14.111904+0000","last_peered":"2024-05-08T06:44:14.111904+0000","last_clean":"2024-05-08T06:44:14.111904+0000","last_became_active":"2024-05-08T06:41:09.581916+0000","last_became_peered":"2024-05-08T06:41:09.581916+0000","last_unstale":"2024-05-08T06:44:14.111904+0000","last_undegraded":"2024-05-08T06:44:14.111904+0000","last_fullsized":"2024-05-08T06:44:14.111904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:26.221008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.092759+0000","last_change":"2024-05-08T06:42:15.863857+0000","last_active":"2024-05-08T06:44:14.092759+0000","last_peered":"2024-05-08T06:44:14.092759+0000","last_clean":"2024-05-08T06:44:14.092759+0000","last_became_active":"2024-05-08T06:42:15.863147+0000","last_became_peered":"2024-05-08T06:42:15.863147+0000","last_unstale":"2024-05-08T06:44:14.092759+0000","last_undegraded":"2024-05-08T06:44:14.092759+0000","last_fullsized":"2024-05-08T06:44:14.092759+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:48:20.951766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.069201+0000","last_change":"2024-05-08T06:41:09.582429+0000","last_active":"2024-05-08T06:44:14.069201+0000","last_peered":"2024-05-08T06:44:14.069201+0000","last_clean":"2024-05-08T06:44:14.069201+0000","last_became_active":"2024-05-08T06:41:09.580152+0000","last_became_peered":"2024-05-08T06:41:09.580152+0000","last_unstale":"2024-05-08T06:44:14.069201+0000","last_undegraded":"2024-05-08T06:44:14.069201+0000","last_fullsized":"2024-05-08T06:44:14.069201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:58.992177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.092389+0000","last_change":"2024-05-08T06:41:09.576432+0000","last_active":"2024-05-08T06:44:14.092389+0000","last_peered":"2024-05-08T06:44:14.092389+0000","last_clean":"2024-05-08T06:44:14.092389+0000","last_became_active":"2024-05-08T06:41:09.575723+0000","last_became_peered":"2024-05-08T06:41:09.575723+0000","last_unstale":"2024-05-08T06:44:14.092389+0000","last_undegraded":"2024-05-08T06:44:14.092389+0000","last_fullsized":"2024-05-08T06:44:14.092389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:51.802944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099363+0000","last_change":"2024-05-08T06:42:15.856660+0000","last_active":"2024-05-08T06:44:14.099363+0000","last_peered":"2024-05-08T06:44:14.099363+0000","last_clean":"2024-05-08T06:44:14.099363+0000","last_became_active":"2024-05-08T06:42:15.855585+0000","last_became_peered":"2024-05-08T06:42:15.855585+0000","last_unstale":"2024-05-08T06:44:14.099363+0000","last_undegraded":"2024-05-08T06:44:14.099363+0000","last_fullsized":"2024-05-08T06:44:14.099363+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:43.647357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099769+0000","last_change":"2024-05-08T06:41:09.579941+0000","last_active":"2024-05-08T06:44:14.099769+0000","last_peered":"2024-05-08T06:44:14.099769+0000","last_clean":"2024-05-08T06:44:14.099769+0000","last_became_active":"2024-05-08T06:41:09.578961+0000","last_became_peered":"2024-05-08T06:41:09.578961+0000","last_unstale":"2024-05-08T06:44:14.099769+0000","last_undegraded":"2024-05-08T06:44:14.099769+0000","last_fullsized":"2024-05-08T06:44:14.099769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:28:59.000080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111107+0000","last_change":"2024-05-08T06:41:09.580544+0000","last_active":"2024-05-08T06:44:14.111107+0000","last_peered":"2024-05-08T06:44:14.111107+0000","last_clean":"2024-05-08T06:44:14.111107+0000","last_became_active":"2024-05-08T06:41:09.579445+0000","last_became_peered":"2024-05-08T06:41:09.579445+0000","last_unstale":"2024-05-08T06:44:14.111107+0000","last_undegraded":"2024-05-08T06:44:14.111107+0000","last_fullsized":"2024-05-08T06:44:14.111107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:28.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.108078+0000","last_change":"2024-05-08T06:41:09.583133+0000","last_active":"2024-05-08T06:44:14.108078+0000","last_peered":"2024-05-08T06:44:14.108078+0000","last_clean":"2024-05-08T06:44:14.108078+0000","last_became_active":"2024-05-08T06:41:09.582261+0000","last_became_peered":"2024-05-08T06:41:09.582261+0000","last_unstale":"2024-05-08T06:44:14.108078+0000","last_undegraded":"2024-05-08T06:44:14.108078+0000","last_fullsized":"2024-05-08T06:44:14.108078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:26.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111923+0000","last_change":"2024-05-08T06:41:09.575410+0000","last_active":"2024-05-08T06:44:14.111923+0000","last_peered":"2024-05-08T06:44:14.111923+0000","last_clean":"2024-05-08T06:44:14.111923+0000","last_became_active":"2024-05-08T06:41:09.574936+0000","last_became_peered":"2024-05-08T06:41:09.574936+0000","last_unstale":"2024-05-08T06:44:14.111923+0000","last_undegraded":"2024-05-08T06:44:14.111923+0000","last_fullsized":"2024-05-08T06:44:14.111923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:45.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098695+0000","last_change":"2024-05-08T06:41:09.582844+0000","last_active":"2024-05-08T06:44:14.098695+0000","last_peered":"2024-05-08T06:44:14.098695+0000","last_clean":"2024-05-08T06:44:14.098695+0000","last_became_active":"2024-05-08T06:41:09.582497+0000","last_became_peered":"2024-05-08T06:41:09.582497+0000","last_unstale":"2024-05-08T06:44:14.098695+0000","last_undegraded":"2024-05-08T06:44:14.098695+0000","last_fullsized":"2024-05-08T06:44:14.098695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:09:45.168495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098771+0000","last_change":"2024-05-08T06:41:09.565312+0000","last_active":"2024-05-08T06:44:14.098771+0000","last_peered":"2024-05-08T06:44:14.098771+0000","last_clean":"2024-05-08T06:44:14.098771+0000","last_became_active":"2024-05-08T06:41:09.563425+0000","last_became_peered":"2024-05-08T06:41:09.563425+0000","last_unstale":"2024-05-08T06:44:14.098771+0000","last_undegraded":"2024-05-08T06:44:14.098771+0000","last_fullsized":"2024-05-08T06:44:14.098771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:08.706504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.108838+0000","last_change":"2024-05-08T06:41:09.579395+0000","last_active":"2024-05-08T06:44:14.108838+0000","last_peered":"2024-05-08T06:44:14.108838+0000","last_clean":"2024-05-08T06:44:14.108838+0000","last_became_active":"2024-05-08T06:41:09.575881+0000","last_became_peered":"2024-05-08T06:41:09.575881+0000","last_unstale":"2024-05-08T06:44:14.108838+0000","last_undegraded":"2024-05-08T06:44:14.108838+0000","last_fullsized":"2024-05-08T06:44:14.108838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:37.109480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107143+0000","last_change":"2024-05-08T06:41:09.589859+0000","last_active":"2024-05-08T06:44:14.107143+0000","last_peered":"2024-05-08T06:44:14.107143+0000","last_clean":"2024-05-08T06:44:14.107143+0000","last_became_active":"2024-05-08T06:41:09.589002+0000","last_became_peered":"2024-05-08T06:41:09.589002+0000","last_unstale":"2024-05-08T06:44:14.107143+0000","last_undegraded":"2024-05-08T06:44:14.107143+0000","last_fullsized":"2024-05-08T06:44:14.107143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:15:39.022268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.109106+0000","last_change":"2024-05-08T06:41:09.566551+0000","last_active":"2024-05-08T06:44:14.109106+0000","last_peered":"2024-05-08T06:44:14.109106+0000","last_clean":"2024-05-08T06:44:14.109106+0000","last_became_active":"2024-05-08T06:41:09.564599+0000","last_became_peered":"2024-05-08T06:41:09.564599+0000","last_unstale":"2024-05-08T06:44:14.109106+0000","last_undegraded":"2024-05-08T06:44:14.109106+0000","last_fullsized":"2024-05-08T06:44:14.109106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:45.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.113526+0000","last_change":"2024-05-08T06:41:09.582643+0000","last_active":"2024-05-08T06:44:14.113526+0000","last_peered":"2024-05-08T06:44:14.113526+0000","last_clean":"2024-05-08T06:44:14.113526+0000","last_became_active":"2024-05-08T06:41:09.582213+0000","last_became_peered":"2024-05-08T06:41:09.582213+0000","last_unstale":"2024-05-08T06:44:14.113526+0000","last_undegraded":"2024-05-08T06:44:14.113526+0000","last_fullsized":"2024-05-08T06:44:14.113526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:18.471194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.112588+0000","last_change":"2024-05-08T06:41:09.581447+0000","last_active":"2024-05-08T06:44:14.112588+0000","last_peered":"2024-05-08T06:44:14.112588+0000","last_clean":"2024-05-08T06:44:14.112588+0000","last_became_active":"2024-05-08T06:41:09.581067+0000","last_became_peered":"2024-05-08T06:41:09.581067+0000","last_unstale":"2024-05-08T06:44:14.112588+0000","last_undegraded":"2024-05-08T06:44:14.112588+0000","last_fullsized":"2024-05-08T06:44:14.112588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:26.967371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.093476+0000","last_change":"2024-05-08T06:43:16.960640+0000","last_active":"2024-05-08T06:44:14.093476+0000","last_peered":"2024-05-08T06:44:14.093476+0000","last_clean":"2024-05-08T06:44:14.093476+0000","last_became_active":"2024-05-08T06:43:16.959541+0000","last_became_peered":"2024-05-08T06:43:16.959541+0000","last_unstale":"2024-05-08T06:44:14.093476+0000","last_undegraded":"2024-05-08T06:44:14.093476+0000","last_fullsized":"2024-05-08T06:44:14.093476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:42.070321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878244+0000","last_change":"2024-05-08T06:41:24.665142+0000","last_active":"2024-05-08T06:43:16.878244+0000","last_peered":"2024-05-08T06:43:16.878244+0000","last_clean":"2024-05-08T06:43:16.878244+0000","last_became_active":"2024-05-08T06:41:24.664431+0000","last_became_peered":"2024-05-08T06:41:24.664431+0000","last_unstale":"2024-05-08T06:43:16.878244+0000","last_undegraded":"2024-05-08T06:43:16.878244+0000","last_fullsized":"2024-05-08T06:43:16.878244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:11:08.511550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.867152+0000","last_change":"2024-05-08T06:41:05.503245+0000","last_active":"2024-05-08T06:43:16.867152+0000","last_peered":"2024-05-08T06:43:16.867152+0000","last_clean":"2024-05-08T06:43:16.867152+0000","last_became_active":"2024-05-08T06:41:05.502561+0000","last_became_peered":"2024-05-08T06:41:05.502561+0000","last_unstale":"2024-05-08T06:43:16.867152+0000","last_undegraded":"2024-05-08T06:43:16.867152+0000","last_fullsized":"2024-05-08T06:43:16.867152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:06.169830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.095403+0000","last_change":"2024-05-08T06:41:09.579703+0000","last_active":"2024-05-08T06:44:14.095403+0000","last_peered":"2024-05-08T06:44:14.095403+0000","last_clean":"2024-05-08T06:44:14.095403+0000","last_became_active":"2024-05-08T06:41:09.579332+0000","last_became_peered":"2024-05-08T06:41:09.579332+0000","last_unstale":"2024-05-08T06:44:14.095403+0000","last_undegraded":"2024-05-08T06:44:14.095403+0000","last_fullsized":"2024-05-08T06:44:14.095403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:08.616722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.869569+0000","last_change":"2024-05-08T06:41:24.666322+0000","last_active":"2024-05-08T06:43:16.869569+0000","last_peered":"2024-05-08T06:43:16.869569+0000","last_clean":"2024-05-08T06:43:16.869569+0000","last_became_active":"2024-05-08T06:41:24.664647+0000","last_became_peered":"2024-05-08T06:41:24.664647+0000","last_unstale":"2024-05-08T06:43:16.869569+0000","last_undegraded":"2024-05-08T06:43:16.869569+0000","last_fullsized":"2024-05-08T06:43:16.869569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:56.967066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885459+0000","last_change":"2024-05-08T06:41:06.149339+0000","last_active":"2024-05-08T06:43:16.885459+0000","last_peered":"2024-05-08T06:43:16.885459+0000","last_clean":"2024-05-08T06:43:16.885459+0000","last_became_active":"2024-05-08T06:41:06.148846+0000","last_became_peered":"2024-05-08T06:41:06.148846+0000","last_unstale":"2024-05-08T06:43:16.885459+0000","last_undegraded":"2024-05-08T06:43:16.885459+0000","last_fullsized":"2024-05-08T06:43:16.885459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:59.291206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.112520+0000","last_change":"2024-05-08T06:41:09.581776+0000","last_active":"2024-05-08T06:44:14.112520+0000","last_peered":"2024-05-08T06:44:14.112520+0000","last_clean":"2024-05-08T06:44:14.112520+0000","last_became_active":"2024-05-08T06:41:09.581409+0000","last_became_peered":"2024-05-08T06:41:09.581409+0000","last_unstale":"2024-05-08T06:44:14.112520+0000","last_undegraded":"2024-05-08T06:44:14.112520+0000","last_fullsized":"2024-05-08T06:44:14.112520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:30.323812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870191+0000","last_change":"2024-05-08T06:42:16.255655+0000","last_active":"2024-05-08T06:43:16.870191+0000","last_peered":"2024-05-08T06:43:16.870191+0000","last_clean":"2024-05-08T06:43:16.870191+0000","last_became_active":"2024-05-08T06:42:16.253722+0000","last_became_peered":"2024-05-08T06:42:16.253722+0000","last_unstale":"2024-05-08T06:43:16.870191+0000","last_undegraded":"2024-05-08T06:43:16.870191+0000","last_fullsized":"2024-05-08T06:43:16.870191+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:58.492286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873773+0000","last_change":"2024-05-08T06:41:05.509738+0000","last_active":"2024-05-08T06:43:16.873773+0000","last_peered":"2024-05-08T06:43:16.873773+0000","last_clean":"2024-05-08T06:43:16.873773+0000","last_became_active":"2024-05-08T06:41:05.509198+0000","last_became_peered":"2024-05-08T06:41:05.509198+0000","last_unstale":"2024-05-08T06:43:16.873773+0000","last_undegraded":"2024-05-08T06:43:16.873773+0000","last_fullsized":"2024-05-08T06:43:16.873773+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:51.350637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.110217+0000","last_change":"2024-05-08T06:41:09.572288+0000","last_active":"2024-05-08T06:44:14.110217+0000","last_peered":"2024-05-08T06:44:14.110217+0000","last_clean":"2024-05-08T06:44:14.110217+0000","last_became_active":"2024-05-08T06:41:09.571951+0000","last_became_peered":"2024-05-08T06:41:09.571951+0000","last_unstale":"2024-05-08T06:44:14.110217+0000","last_undegraded":"2024-05-08T06:44:14.110217+0000","last_fullsized":"2024-05-08T06:44:14.110217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:45.687494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870033+0000","last_change":"2024-05-08T06:41:24.663289+0000","last_active":"2024-05-08T06:43:16.870033+0000","last_peered":"2024-05-08T06:43:16.870033+0000","last_clean":"2024-05-08T06:43:16.870033+0000","last_became_active":"2024-05-08T06:41:24.662899+0000","last_became_peered":"2024-05-08T06:41:24.662899+0000","last_unstale":"2024-05-08T06:43:16.870033+0000","last_undegraded":"2024-05-08T06:43:16.870033+0000","last_fullsized":"2024-05-08T06:43:16.870033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:15.024693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873142+0000","last_change":"2024-05-08T06:41:05.505412+0000","last_active":"2024-05-08T06:43:16.873142+0000","last_peered":"2024-05-08T06:43:16.873142+0000","last_clean":"2024-05-08T06:43:16.873142+0000","last_became_active":"2024-05-08T06:41:05.505023+0000","last_became_peered":"2024-05-08T06:41:05.505023+0000","last_unstale":"2024-05-08T06:43:16.873142+0000","last_undegraded":"2024-05-08T06:43:16.873142+0000","last_fullsized":"2024-05-08T06:43:16.873142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:50.403045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111774+0000","last_change":"2024-05-08T06:41:09.571080+0000","last_active":"2024-05-08T06:44:14.111774+0000","last_peered":"2024-05-08T06:44:14.111774+0000","last_clean":"2024-05-08T06:44:14.111774+0000","last_became_active":"2024-05-08T06:41:09.570755+0000","last_became_peered":"2024-05-08T06:41:09.570755+0000","last_unstale":"2024-05-08T06:44:14.111774+0000","last_undegraded":"2024-05-08T06:44:14.111774+0000","last_fullsized":"2024-05-08T06:44:14.111774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:38:53.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877957+0000","last_change":"2024-05-08T06:41:24.660091+0000","last_active":"2024-05-08T06:43:16.877957+0000","last_peered":"2024-05-08T06:43:16.877957+0000","last_clean":"2024-05-08T06:43:16.877957+0000","last_became_active":"2024-05-08T06:41:24.659512+0000","last_became_peered":"2024-05-08T06:41:24.659512+0000","last_unstale":"2024-05-08T06:43:16.877957+0000","last_undegraded":"2024-05-08T06:43:16.877957+0000","last_fullsized":"2024-05-08T06:43:16.877957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:07:56.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":176,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:46.648882+0000","last_change":"2024-05-08T06:41:05.500625+0000","last_active":"2024-05-08T06:44:46.648882+0000","last_peered":"2024-05-08T06:44:46.648882+0000","last_clean":"2024-05-08T06:44:46.648882+0000","last_became_active":"2024-05-08T06:41:05.500079+0000","last_became_peered":"2024-05-08T06:41:05.500079+0000","last_unstale":"2024-05-08T06:44:46.648882+0000","last_undegraded":"2024-05-08T06:44:46.648882+0000","last_fullsized":"2024-05-08T06:44:46.648882+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:32.143944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.093076+0000","last_change":"2024-05-08T06:41:09.569045+0000","last_active":"2024-05-08T06:44:14.093076+0000","last_peered":"2024-05-08T06:44:14.093076+0000","last_clean":"2024-05-08T06:44:14.093076+0000","last_became_active":"2024-05-08T06:41:09.560040+0000","last_became_peered":"2024-05-08T06:41:09.560040+0000","last_unstale":"2024-05-08T06:44:14.093076+0000","last_undegraded":"2024-05-08T06:44:14.093076+0000","last_fullsized":"2024-05-08T06:44:14.093076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:58:52.284829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876938+0000","last_change":"2024-05-08T06:42:15.856574+0000","last_active":"2024-05-08T06:43:16.876938+0000","last_peered":"2024-05-08T06:43:16.876938+0000","last_clean":"2024-05-08T06:43:16.876938+0000","last_became_active":"2024-05-08T06:42:15.855459+0000","last_became_peered":"2024-05-08T06:42:15.855459+0000","last_unstale":"2024-05-08T06:43:16.876938+0000","last_undegraded":"2024-05-08T06:43:16.876938+0000","last_fullsized":"2024-05-08T06:43:16.876938+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:23:12.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.131952+0000","last_change":"2024-05-08T06:41:05.505685+0000","last_active":"2024-05-08T06:43:17.131952+0000","last_peered":"2024-05-08T06:43:17.131952+0000","last_clean":"2024-05-08T06:43:17.131952+0000","last_became_active":"2024-05-08T06:41:05.505136+0000","last_became_peered":"2024-05-08T06:41:05.505136+0000","last_unstale":"2024-05-08T06:43:17.131952+0000","last_undegraded":"2024-05-08T06:43:17.131952+0000","last_fullsized":"2024-05-08T06:43:17.131952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:59.968405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.095889+0000","last_change":"2024-05-08T06:41:09.581340+0000","last_active":"2024-05-08T06:44:14.095889+0000","last_peered":"2024-05-08T06:44:14.095889+0000","last_clean":"2024-05-08T06:44:14.095889+0000","last_became_active":"2024-05-08T06:41:09.580969+0000","last_became_peered":"2024-05-08T06:41:09.580969+0000","last_unstale":"2024-05-08T06:44:14.095889+0000","last_undegraded":"2024-05-08T06:44:14.095889+0000","last_fullsized":"2024-05-08T06:44:14.095889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:14.365972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.883452+0000","last_change":"2024-05-08T06:41:24.675576+0000","last_active":"2024-05-08T06:43:16.883452+0000","last_peered":"2024-05-08T06:43:16.883452+0000","last_clean":"2024-05-08T06:43:16.883452+0000","last_became_active":"2024-05-08T06:41:24.675044+0000","last_became_peered":"2024-05-08T06:41:24.675044+0000","last_unstale":"2024-05-08T06:43:16.883452+0000","last_undegraded":"2024-05-08T06:43:16.883452+0000","last_fullsized":"2024-05-08T06:43:16.883452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:59.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956344+0000","last_change":"2024-05-08T06:41:05.493094+0000","last_active":"2024-05-08T06:43:16.956344+0000","last_peered":"2024-05-08T06:43:16.956344+0000","last_clean":"2024-05-08T06:43:16.956344+0000","last_became_active":"2024-05-08T06:41:05.491206+0000","last_became_peered":"2024-05-08T06:41:05.491206+0000","last_unstale":"2024-05-08T06:43:16.956344+0000","last_undegraded":"2024-05-08T06:43:16.956344+0000","last_fullsized":"2024-05-08T06:43:16.956344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:03.689282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098737+0000","last_change":"2024-05-08T06:41:09.570646+0000","last_active":"2024-05-08T06:44:14.098737+0000","last_peered":"2024-05-08T06:44:14.098737+0000","last_clean":"2024-05-08T06:44:14.098737+0000","last_became_active":"2024-05-08T06:41:09.569500+0000","last_became_peered":"2024-05-08T06:41:09.569500+0000","last_unstale":"2024-05-08T06:44:14.098737+0000","last_undegraded":"2024-05-08T06:44:14.098737+0000","last_fullsized":"2024-05-08T06:44:14.098737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:25:08.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.875010+0000","last_change":"2024-05-08T06:41:24.672021+0000","last_active":"2024-05-08T06:43:16.875010+0000","last_peered":"2024-05-08T06:43:16.875010+0000","last_clean":"2024-05-08T06:43:16.875010+0000","last_became_active":"2024-05-08T06:41:24.671583+0000","last_became_peered":"2024-05-08T06:41:24.671583+0000","last_unstale":"2024-05-08T06:43:16.875010+0000","last_undegraded":"2024-05-08T06:43:16.875010+0000","last_fullsized":"2024-05-08T06:43:16.875010+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:33.850855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129463+0000","last_change":"2024-05-08T06:41:05.501501+0000","last_active":"2024-05-08T06:43:17.129463+0000","last_peered":"2024-05-08T06:43:17.129463+0000","last_clean":"2024-05-08T06:43:17.129463+0000","last_became_active":"2024-05-08T06:41:05.501001+0000","last_became_peered":"2024-05-08T06:41:05.501001+0000","last_unstale":"2024-05-08T06:43:17.129463+0000","last_undegraded":"2024-05-08T06:43:17.129463+0000","last_fullsized":"2024-05-08T06:43:17.129463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:15:18.984981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.105965+0000","last_change":"2024-05-08T06:42:15.859096+0000","last_active":"2024-05-08T06:44:14.105965+0000","last_peered":"2024-05-08T06:44:14.105965+0000","last_clean":"2024-05-08T06:44:14.105965+0000","last_became_active":"2024-05-08T06:42:15.858508+0000","last_became_peered":"2024-05-08T06:42:15.858508+0000","last_unstale":"2024-05-08T06:44:14.105965+0000","last_undegraded":"2024-05-08T06:44:14.105965+0000","last_fullsized":"2024-05-08T06:44:14.105965+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:24.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884745+0000","last_change":"2024-05-08T06:41:24.670832+0000","last_active":"2024-05-08T06:43:16.884745+0000","last_peered":"2024-05-08T06:43:16.884745+0000","last_clean":"2024-05-08T06:43:16.884745+0000","last_became_active":"2024-05-08T06:41:24.668155+0000","last_became_peered":"2024-05-08T06:41:24.668155+0000","last_unstale":"2024-05-08T06:43:16.884745+0000","last_undegraded":"2024-05-08T06:43:16.884745+0000","last_fullsized":"2024-05-08T06:43:16.884745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:11.460490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":173,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:47.650503+0000","last_change":"2024-05-08T06:41:05.494999+0000","last_active":"2024-05-08T06:44:47.650503+0000","last_peered":"2024-05-08T06:44:47.650503+0000","last_clean":"2024-05-08T06:44:47.650503+0000","last_became_active":"2024-05-08T06:41:05.494487+0000","last_became_peered":"2024-05-08T06:41:05.494487+0000","last_unstale":"2024-05-08T06:44:47.650503+0000","last_undegraded":"2024-05-08T06:44:47.650503+0000","last_fullsized":"2024-05-08T06:44:47.650503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:59.282625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":126,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111376+0000","last_change":"2024-05-08T06:41:09.570607+0000","last_active":"2024-05-08T06:44:14.111376+0000","last_peered":"2024-05-08T06:44:14.111376+0000","last_clean":"2024-05-08T06:44:14.111376+0000","last_became_active":"2024-05-08T06:41:09.570047+0000","last_became_peered":"2024-05-08T06:41:09.570047+0000","last_unstale":"2024-05-08T06:44:14.111376+0000","last_undegraded":"2024-05-08T06:44:14.111376+0000","last_fullsized":"2024-05-08T06:44:14.111376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:51.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.865681+0000","last_change":"2024-05-08T06:41:24.677365+0000","last_active":"2024-05-08T06:43:16.865681+0000","last_peered":"2024-05-08T06:43:16.865681+0000","last_clean":"2024-05-08T06:43:16.865681+0000","last_became_active":"2024-05-08T06:41:24.673986+0000","last_became_peered":"2024-05-08T06:41:24.673986+0000","last_unstale":"2024-05-08T06:43:16.865681+0000","last_undegraded":"2024-05-08T06:43:16.865681+0000","last_fullsized":"2024-05-08T06:43:16.865681+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:07.013637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879420+0000","last_change":"2024-05-08T06:41:05.499624+0000","last_active":"2024-05-08T06:43:16.879420+0000","last_peered":"2024-05-08T06:43:16.879420+0000","last_clean":"2024-05-08T06:43:16.879420+0000","last_became_active":"2024-05-08T06:41:05.498875+0000","last_became_peered":"2024-05-08T06:41:05.498875+0000","last_unstale":"2024-05-08T06:43:16.879420+0000","last_undegraded":"2024-05-08T06:43:16.879420+0000","last_fullsized":"2024-05-08T06:43:16.879420+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:46:11.270399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.102915+0000","last_change":"2024-05-08T06:42:15.853569+0000","last_active":"2024-05-08T06:44:14.102915+0000","last_peered":"2024-05-08T06:44:14.102915+0000","last_clean":"2024-05-08T06:44:14.102915+0000","last_became_active":"2024-05-08T06:42:15.852223+0000","last_became_peered":"2024-05-08T06:42:15.852223+0000","last_unstale":"2024-05-08T06:44:14.102915+0000","last_undegraded":"2024-05-08T06:44:14.102915+0000","last_fullsized":"2024-05-08T06:44:14.102915+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:56.970134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870519+0000","last_change":"2024-05-08T06:41:24.671807+0000","last_active":"2024-05-08T06:43:16.870519+0000","last_peered":"2024-05-08T06:43:16.870519+0000","last_clean":"2024-05-08T06:43:16.870519+0000","last_became_active":"2024-05-08T06:41:24.670937+0000","last_became_peered":"2024-05-08T06:41:24.670937+0000","last_unstale":"2024-05-08T06:43:16.870519+0000","last_undegraded":"2024-05-08T06:43:16.870519+0000","last_fullsized":"2024-05-08T06:43:16.870519+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:52.844916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129934+0000","last_change":"2024-05-08T06:41:06.147901+0000","last_active":"2024-05-08T06:43:17.129934+0000","last_peered":"2024-05-08T06:43:17.129934+0000","last_clean":"2024-05-08T06:43:17.129934+0000","last_became_active":"2024-05-08T06:41:06.146983+0000","last_became_peered":"2024-05-08T06:41:06.146983+0000","last_unstale":"2024-05-08T06:43:17.129934+0000","last_undegraded":"2024-05-08T06:43:17.129934+0000","last_fullsized":"2024-05-08T06:43:17.129934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:54.638290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.109897+0000","last_change":"2024-05-08T06:41:09.586695+0000","last_active":"2024-05-08T06:44:14.109897+0000","last_peered":"2024-05-08T06:44:14.109897+0000","last_clean":"2024-05-08T06:44:14.109897+0000","last_became_active":"2024-05-08T06:41:09.586288+0000","last_became_peered":"2024-05-08T06:41:09.586288+0000","last_unstale":"2024-05-08T06:44:14.109897+0000","last_undegraded":"2024-05-08T06:44:14.109897+0000","last_fullsized":"2024-05-08T06:44:14.109897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:18.383524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866132+0000","last_change":"2024-05-08T06:41:24.671523+0000","last_active":"2024-05-08T06:43:16.866132+0000","last_peered":"2024-05-08T06:43:16.866132+0000","last_clean":"2024-05-08T06:43:16.866132+0000","last_became_active":"2024-05-08T06:41:24.670307+0000","last_became_peered":"2024-05-08T06:41:24.670307+0000","last_unstale":"2024-05-08T06:43:16.866132+0000","last_undegraded":"2024-05-08T06:43:16.866132+0000","last_fullsized":"2024-05-08T06:43:16.866132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.034208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'38","reported_seq":345,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:48.653712+0000","last_change":"2024-05-08T06:41:05.504643+0000","last_active":"2024-05-08T06:44:48.653712+0000","last_peered":"2024-05-08T06:44:48.653712+0000","last_clean":"2024-05-08T06:44:48.653712+0000","last_became_active":"2024-05-08T06:41:05.504011+0000","last_became_peered":"2024-05-08T06:41:05.504011+0000","last_unstale":"2024-05-08T06:44:48.653712+0000","last_undegraded":"2024-05-08T06:44:48.653712+0000","last_fullsized":"2024-05-08T06:44:48.653712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:47.262643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68479,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":200,"num_write":39,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098254+0000","last_change":"2024-05-08T06:41:09.580532+0000","last_active":"2024-05-08T06:44:14.098254+0000","last_peered":"2024-05-08T06:44:14.098254+0000","last_clean":"2024-05-08T06:44:14.098254+0000","last_became_active":"2024-05-08T06:41:09.575396+0000","last_became_peered":"2024-05-08T06:41:09.575396+0000","last_unstale":"2024-05-08T06:44:14.098254+0000","last_undegraded":"2024-05-08T06:44:14.098254+0000","last_fullsized":"2024-05-08T06:44:14.098254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:29.197093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130702+0000","last_change":"2024-05-08T06:41:24.660200+0000","last_active":"2024-05-08T06:43:17.130702+0000","last_peered":"2024-05-08T06:43:17.130702+0000","last_clean":"2024-05-08T06:43:17.130702+0000","last_became_active":"2024-05-08T06:41:24.659674+0000","last_became_peered":"2024-05-08T06:41:24.659674+0000","last_unstale":"2024-05-08T06:43:17.130702+0000","last_undegraded":"2024-05-08T06:43:17.130702+0000","last_fullsized":"2024-05-08T06:43:17.130702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:51.023256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877294+0000","last_change":"2024-05-08T06:41:05.500899+0000","last_active":"2024-05-08T06:43:16.877294+0000","last_peered":"2024-05-08T06:43:16.877294+0000","last_clean":"2024-05-08T06:43:16.877294+0000","last_became_active":"2024-05-08T06:41:05.500437+0000","last_became_peered":"2024-05-08T06:41:05.500437+0000","last_unstale":"2024-05-08T06:43:16.877294+0000","last_undegraded":"2024-05-08T06:43:16.877294+0000","last_fullsized":"2024-05-08T06:43:16.877294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:38.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.100478+0000","last_change":"2024-05-08T06:41:09.574273+0000","last_active":"2024-05-08T06:44:14.100478+0000","last_peered":"2024-05-08T06:44:14.100478+0000","last_clean":"2024-05-08T06:44:14.100478+0000","last_became_active":"2024-05-08T06:41:09.573902+0000","last_became_peered":"2024-05-08T06:41:09.573902+0000","last_unstale":"2024-05-08T06:44:14.100478+0000","last_undegraded":"2024-05-08T06:44:14.100478+0000","last_fullsized":"2024-05-08T06:44:14.100478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:39:12.749290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.882395+0000","last_change":"2024-05-08T06:41:24.674360+0000","last_active":"2024-05-08T06:43:16.882395+0000","last_peered":"2024-05-08T06:43:16.882395+0000","last_clean":"2024-05-08T06:43:16.882395+0000","last_became_active":"2024-05-08T06:41:24.673938+0000","last_became_peered":"2024-05-08T06:41:24.673938+0000","last_unstale":"2024-05-08T06:43:16.882395+0000","last_undegraded":"2024-05-08T06:43:16.882395+0000","last_fullsized":"2024-05-08T06:43:16.882395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:13:36.735220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129914+0000","last_change":"2024-05-08T06:41:05.504335+0000","last_active":"2024-05-08T06:43:17.129914+0000","last_peered":"2024-05-08T06:43:17.129914+0000","last_clean":"2024-05-08T06:43:17.129914+0000","last_became_active":"2024-05-08T06:41:05.503981+0000","last_became_peered":"2024-05-08T06:41:05.503981+0000","last_unstale":"2024-05-08T06:43:17.129914+0000","last_undegraded":"2024-05-08T06:43:17.129914+0000","last_fullsized":"2024-05-08T06:43:17.129914+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:45:35.813245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107457+0000","last_change":"2024-05-08T06:41:09.580852+0000","last_active":"2024-05-08T06:44:14.107457+0000","last_peered":"2024-05-08T06:44:14.107457+0000","last_clean":"2024-05-08T06:44:14.107457+0000","last_became_active":"2024-05-08T06:41:09.580375+0000","last_became_peered":"2024-05-08T06:41:09.580375+0000","last_unstale":"2024-05-08T06:44:14.107457+0000","last_undegraded":"2024-05-08T06:44:14.107457+0000","last_fullsized":"2024-05-08T06:44:14.107457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:21:06.695878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866722+0000","last_change":"2024-05-08T06:41:24.678268+0000","last_active":"2024-05-08T06:43:16.866722+0000","last_peered":"2024-05-08T06:43:16.866722+0000","last_clean":"2024-05-08T06:43:16.866722+0000","last_became_active":"2024-05-08T06:41:24.677804+0000","last_became_peered":"2024-05-08T06:41:24.677804+0000","last_unstale":"2024-05-08T06:43:16.866722+0000","last_undegraded":"2024-05-08T06:43:16.866722+0000","last_fullsized":"2024-05-08T06:43:16.866722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:03.082661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'5","reported_seq":180,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:47.667134+0000","last_change":"2024-05-08T06:41:05.498143+0000","last_active":"2024-05-08T06:44:47.667134+0000","last_peered":"2024-05-08T06:44:47.667134+0000","last_clean":"2024-05-08T06:44:47.667134+0000","last_became_active":"2024-05-08T06:41:05.497707+0000","last_became_peered":"2024-05-08T06:41:05.497707+0000","last_unstale":"2024-05-08T06:44:47.667134+0000","last_undegraded":"2024-05-08T06:44:47.667134+0000","last_fullsized":"2024-05-08T06:44:47.667134+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:20.556535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":131,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.106688+0000","last_change":"2024-05-08T06:43:17.135955+0000","last_active":"2024-05-08T06:44:14.106688+0000","last_peered":"2024-05-08T06:44:14.106688+0000","last_clean":"2024-05-08T06:44:14.106688+0000","last_became_active":"2024-05-08T06:43:17.134734+0000","last_became_peered":"2024-05-08T06:43:17.134734+0000","last_unstale":"2024-05-08T06:44:14.106688+0000","last_undegraded":"2024-05-08T06:44:14.106688+0000","last_fullsized":"2024-05-08T06:44:14.106688+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:33:53.573382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957769+0000","last_change":"2024-05-08T06:41:24.663938+0000","last_active":"2024-05-08T06:43:16.957769+0000","last_peered":"2024-05-08T06:43:16.957769+0000","last_clean":"2024-05-08T06:43:16.957769+0000","last_became_active":"2024-05-08T06:41:24.661679+0000","last_became_peered":"2024-05-08T06:41:24.661679+0000","last_unstale":"2024-05-08T06:43:16.957769+0000","last_undegraded":"2024-05-08T06:43:16.957769+0000","last_fullsized":"2024-05-08T06:43:16.957769+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:21.590681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":60,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871464+0000","last_change":"2024-05-08T06:41:06.151458+0000","last_active":"2024-05-08T06:43:16.871464+0000","last_peered":"2024-05-08T06:43:16.871464+0000","last_clean":"2024-05-08T06:43:16.871464+0000","last_became_active":"2024-05-08T06:41:06.146564+0000","last_became_peered":"2024-05-08T06:41:06.146564+0000","last_unstale":"2024-05-08T06:43:16.871464+0000","last_undegraded":"2024-05-08T06:43:16.871464+0000","last_fullsized":"2024-05-08T06:43:16.871464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:36.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.100460+0000","last_change":"2024-05-08T06:41:09.576666+0000","last_active":"2024-05-08T06:44:14.100460+0000","last_peered":"2024-05-08T06:44:14.100460+0000","last_clean":"2024-05-08T06:44:14.100460+0000","last_became_active":"2024-05-08T06:41:09.576062+0000","last_became_peered":"2024-05-08T06:41:09.576062+0000","last_unstale":"2024-05-08T06:44:14.100460+0000","last_undegraded":"2024-05-08T06:44:14.100460+0000","last_fullsized":"2024-05-08T06:44:14.100460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:21.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130273+0000","last_change":"2024-05-08T06:42:16.255227+0000","last_active":"2024-05-08T06:43:17.130273+0000","last_peered":"2024-05-08T06:43:17.130273+0000","last_clean":"2024-05-08T06:43:17.130273+0000","last_became_active":"2024-05-08T06:42:16.253021+0000","last_became_peered":"2024-05-08T06:42:16.253021+0000","last_unstale":"2024-05-08T06:43:17.130273+0000","last_undegraded":"2024-05-08T06:43:17.130273+0000","last_fullsized":"2024-05-08T06:43:17.130273+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:29:41.833171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873376+0000","last_change":"2024-05-08T06:41:05.506830+0000","last_active":"2024-05-08T06:43:16.873376+0000","last_peered":"2024-05-08T06:43:16.873376+0000","last_clean":"2024-05-08T06:43:16.873376+0000","last_became_active":"2024-05-08T06:41:05.505402+0000","last_became_peered":"2024-05-08T06:41:05.505402+0000","last_unstale":"2024-05-08T06:43:16.873376+0000","last_undegraded":"2024-05-08T06:43:16.873376+0000","last_fullsized":"2024-05-08T06:43:16.873376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:26.804268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099027+0000","last_change":"2024-05-08T06:41:09.586937+0000","last_active":"2024-05-08T06:44:14.099027+0000","last_peered":"2024-05-08T06:44:14.099027+0000","last_clean":"2024-05-08T06:44:14.099027+0000","last_became_active":"2024-05-08T06:41:09.586443+0000","last_became_peered":"2024-05-08T06:41:09.586443+0000","last_unstale":"2024-05-08T06:44:14.099027+0000","last_undegraded":"2024-05-08T06:44:14.099027+0000","last_fullsized":"2024-05-08T06:44:14.099027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:49.004676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871564+0000","last_change":"2024-05-08T06:42:16.042874+0000","last_active":"2024-05-08T06:43:16.871564+0000","last_peered":"2024-05-08T06:43:16.871564+0000","last_clean":"2024-05-08T06:43:16.871564+0000","last_became_active":"2024-05-08T06:42:16.041424+0000","last_became_peered":"2024-05-08T06:42:16.041424+0000","last_unstale":"2024-05-08T06:43:16.871564+0000","last_undegraded":"2024-05-08T06:43:16.871564+0000","last_fullsized":"2024-05-08T06:43:16.871564+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:47.162238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866349+0000","last_change":"2024-05-08T06:41:06.146631+0000","last_active":"2024-05-08T06:43:16.866349+0000","last_peered":"2024-05-08T06:43:16.866349+0000","last_clean":"2024-05-08T06:43:16.866349+0000","last_became_active":"2024-05-08T06:41:06.145876+0000","last_became_peered":"2024-05-08T06:41:06.145876+0000","last_unstale":"2024-05-08T06:43:16.866349+0000","last_undegraded":"2024-05-08T06:43:16.866349+0000","last_fullsized":"2024-05-08T06:43:16.866349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:46.283923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.095261+0000","last_change":"2024-05-08T06:41:09.571084+0000","last_active":"2024-05-08T06:44:14.095261+0000","last_peered":"2024-05-08T06:44:14.095261+0000","last_clean":"2024-05-08T06:44:14.095261+0000","last_became_active":"2024-05-08T06:41:09.570685+0000","last_became_peered":"2024-05-08T06:41:09.570685+0000","last_unstale":"2024-05-08T06:44:14.095261+0000","last_undegraded":"2024-05-08T06:44:14.095261+0000","last_fullsized":"2024-05-08T06:44:14.095261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:02:21.748502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956923+0000","last_change":"2024-05-08T06:41:24.667348+0000","last_active":"2024-05-08T06:43:16.956923+0000","last_peered":"2024-05-08T06:43:16.956923+0000","last_clean":"2024-05-08T06:43:16.956923+0000","last_became_active":"2024-05-08T06:41:24.662570+0000","last_became_peered":"2024-05-08T06:41:24.662570+0000","last_unstale":"2024-05-08T06:43:16.956923+0000","last_undegraded":"2024-05-08T06:43:16.956923+0000","last_fullsized":"2024-05-08T06:43:16.956923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:05.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878557+0000","last_change":"2024-05-08T06:41:05.501884+0000","last_active":"2024-05-08T06:43:16.878557+0000","last_peered":"2024-05-08T06:43:16.878557+0000","last_clean":"2024-05-08T06:43:16.878557+0000","last_became_active":"2024-05-08T06:41:05.498866+0000","last_became_peered":"2024-05-08T06:41:05.498866+0000","last_unstale":"2024-05-08T06:43:16.878557+0000","last_undegraded":"2024-05-08T06:43:16.878557+0000","last_fullsized":"2024-05-08T06:43:16.878557+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:50.560695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.108812+0000","last_change":"2024-05-08T06:41:09.582601+0000","last_active":"2024-05-08T06:44:14.108812+0000","last_peered":"2024-05-08T06:44:14.108812+0000","last_clean":"2024-05-08T06:44:14.108812+0000","last_became_active":"2024-05-08T06:41:09.582205+0000","last_became_peered":"2024-05-08T06:41:09.582205+0000","last_unstale":"2024-05-08T06:44:14.108812+0000","last_undegraded":"2024-05-08T06:44:14.108812+0000","last_fullsized":"2024-05-08T06:44:14.108812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:29.594001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957603+0000","last_change":"2024-05-08T06:41:24.659339+0000","last_active":"2024-05-08T06:43:16.957603+0000","last_peered":"2024-05-08T06:43:16.957603+0000","last_clean":"2024-05-08T06:43:16.957603+0000","last_became_active":"2024-05-08T06:41:24.658879+0000","last_became_peered":"2024-05-08T06:41:24.658879+0000","last_unstale":"2024-05-08T06:43:16.957603+0000","last_undegraded":"2024-05-08T06:43:16.957603+0000","last_fullsized":"2024-05-08T06:43:16.957603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:59.257118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.091890+0000","last_change":"2024-05-08T06:42:15.850510+0000","last_active":"2024-05-08T06:44:14.091890+0000","last_peered":"2024-05-08T06:44:14.091890+0000","last_clean":"2024-05-08T06:44:14.091890+0000","last_became_active":"2024-05-08T06:42:15.849158+0000","last_became_peered":"2024-05-08T06:42:15.849158+0000","last_unstale":"2024-05-08T06:44:14.091890+0000","last_undegraded":"2024-05-08T06:44:14.091890+0000","last_fullsized":"2024-05-08T06:44:14.091890+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:14.687642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'5","reported_seq":175,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:46.662739+0000","last_change":"2024-05-08T06:41:06.148436+0000","last_active":"2024-05-08T06:44:46.662739+0000","last_peered":"2024-05-08T06:44:46.662739+0000","last_clean":"2024-05-08T06:44:46.662739+0000","last_became_active":"2024-05-08T06:41:06.147690+0000","last_became_peered":"2024-05-08T06:41:06.147690+0000","last_unstale":"2024-05-08T06:44:46.662739+0000","last_undegraded":"2024-05-08T06:44:46.662739+0000","last_fullsized":"2024-05-08T06:44:46.662739+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:49.925872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879305+0000","last_change":"2024-05-08T06:41:24.667958+0000","last_active":"2024-05-08T06:43:16.879305+0000","last_peered":"2024-05-08T06:43:16.879305+0000","last_clean":"2024-05-08T06:43:16.879305+0000","last_became_active":"2024-05-08T06:41:24.666181+0000","last_became_peered":"2024-05-08T06:41:24.666181+0000","last_unstale":"2024-05-08T06:43:16.879305+0000","last_undegraded":"2024-05-08T06:43:16.879305+0000","last_fullsized":"2024-05-08T06:43:16.879305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:08.413670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.104828+0000","last_change":"2024-05-08T06:41:09.581353+0000","last_active":"2024-05-08T06:44:14.104828+0000","last_peered":"2024-05-08T06:44:14.104828+0000","last_clean":"2024-05-08T06:44:14.104828+0000","last_became_active":"2024-05-08T06:41:09.580630+0000","last_became_peered":"2024-05-08T06:41:09.580630+0000","last_unstale":"2024-05-08T06:44:14.104828+0000","last_undegraded":"2024-05-08T06:44:14.104828+0000","last_fullsized":"2024-05-08T06:44:14.104828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:07.041564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870064+0000","last_change":"2024-05-08T06:41:05.494128+0000","last_active":"2024-05-08T06:43:16.870064+0000","last_peered":"2024-05-08T06:43:16.870064+0000","last_clean":"2024-05-08T06:43:16.870064+0000","last_became_active":"2024-05-08T06:41:05.493473+0000","last_became_peered":"2024-05-08T06:41:05.493473+0000","last_unstale":"2024-05-08T06:43:16.870064+0000","last_undegraded":"2024-05-08T06:43:16.870064+0000","last_fullsized":"2024-05-08T06:43:16.870064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:01:51.061204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":118,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878231+0000","last_change":"2024-05-08T06:39:12.054195+0000","last_active":"2024-05-08T06:43:16.878231+0000","last_peered":"2024-05-08T06:43:16.878231+0000","last_clean":"2024-05-08T06:43:16.878231+0000","last_became_active":"2024-05-08T06:39:12.045198+0000","last_became_peered":"2024-05-08T06:39:12.045198+0000","last_unstale":"2024-05-08T06:43:16.878231+0000","last_undegraded":"2024-05-08T06:43:16.878231+0000","last_fullsized":"2024-05-08T06:43:16.878231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_clean_scrub_stamp":"2024-05-08T06:34:30.391671+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:32:48.631167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130511+0000","last_change":"2024-05-08T06:41:24.663009+0000","last_active":"2024-05-08T06:43:17.130511+0000","last_peered":"2024-05-08T06:43:17.130511+0000","last_clean":"2024-05-08T06:43:17.130511+0000","last_became_active":"2024-05-08T06:41:24.662552+0000","last_became_peered":"2024-05-08T06:41:24.662552+0000","last_unstale":"2024-05-08T06:43:17.130511+0000","last_undegraded":"2024-05-08T06:43:17.130511+0000","last_fullsized":"2024-05-08T06:43:17.130511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:57:12.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.088966+0000","last_change":"2024-05-08T06:41:09.576425+0000","last_active":"2024-05-08T06:44:14.088966+0000","last_peered":"2024-05-08T06:44:14.088966+0000","last_clean":"2024-05-08T06:44:14.088966+0000","last_became_active":"2024-05-08T06:41:09.576094+0000","last_became_peered":"2024-05-08T06:41:09.576094+0000","last_unstale":"2024-05-08T06:44:14.088966+0000","last_undegraded":"2024-05-08T06:44:14.088966+0000","last_fullsized":"2024-05-08T06:44:14.088966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:40.682429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878467+0000","last_change":"2024-05-08T06:41:05.505778+0000","last_active":"2024-05-08T06:43:16.878467+0000","last_peered":"2024-05-08T06:43:16.878467+0000","last_clean":"2024-05-08T06:43:16.878467+0000","last_became_active":"2024-05-08T06:41:05.505400+0000","last_became_peered":"2024-05-08T06:41:05.505400+0000","last_unstale":"2024-05-08T06:43:16.878467+0000","last_undegraded":"2024-05-08T06:43:16.878467+0000","last_fullsized":"2024-05-08T06:43:16.878467+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:11:34.887026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.881396+0000","last_change":"2024-05-08T06:41:24.671768+0000","last_active":"2024-05-08T06:43:16.881396+0000","last_peered":"2024-05-08T06:43:16.881396+0000","last_clean":"2024-05-08T06:43:16.881396+0000","last_became_active":"2024-05-08T06:41:24.671250+0000","last_became_peered":"2024-05-08T06:41:24.671250+0000","last_unstale":"2024-05-08T06:43:16.881396+0000","last_undegraded":"2024-05-08T06:43:16.881396+0000","last_fullsized":"2024-05-08T06:43:16.881396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:56:44.302049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.872721+0000","last_change":"2024-05-08T06:41:06.151820+0000","last_active":"2024-05-08T06:43:16.872721+0000","last_peered":"2024-05-08T06:43:16.872721+0000","last_clean":"2024-05-08T06:43:16.872721+0000","last_became_active":"2024-05-08T06:41:06.149976+0000","last_became_peered":"2024-05-08T06:41:06.149976+0000","last_unstale":"2024-05-08T06:43:16.872721+0000","last_undegraded":"2024-05-08T06:43:16.872721+0000","last_fullsized":"2024-05-08T06:43:16.872721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:35:21.233811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.089354+0000","last_change":"2024-05-08T06:41:09.568880+0000","last_active":"2024-05-08T06:44:14.089354+0000","last_peered":"2024-05-08T06:44:14.089354+0000","last_clean":"2024-05-08T06:44:14.089354+0000","last_became_active":"2024-05-08T06:41:09.568507+0000","last_became_peered":"2024-05-08T06:41:09.568507+0000","last_unstale":"2024-05-08T06:44:14.089354+0000","last_undegraded":"2024-05-08T06:44:14.089354+0000","last_fullsized":"2024-05-08T06:44:14.089354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:01.376121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884628+0000","last_change":"2024-05-08T06:41:24.667472+0000","last_active":"2024-05-08T06:43:16.884628+0000","last_peered":"2024-05-08T06:43:16.884628+0000","last_clean":"2024-05-08T06:43:16.884628+0000","last_became_active":"2024-05-08T06:41:24.664164+0000","last_became_peered":"2024-05-08T06:41:24.664164+0000","last_unstale":"2024-05-08T06:43:16.884628+0000","last_undegraded":"2024-05-08T06:43:16.884628+0000","last_fullsized":"2024-05-08T06:43:16.884628+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:34:25.630742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'11","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866933+0000","last_change":"2024-05-08T06:41:05.504287+0000","last_active":"2024-05-08T06:43:16.866933+0000","last_peered":"2024-05-08T06:43:16.866933+0000","last_clean":"2024-05-08T06:43:16.866933+0000","last_became_active":"2024-05-08T06:41:05.503825+0000","last_became_peered":"2024-05-08T06:41:05.503825+0000","last_unstale":"2024-05-08T06:43:16.866933+0000","last_undegraded":"2024-05-08T06:43:16.866933+0000","last_fullsized":"2024-05-08T06:43:16.866933+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:50:23.230289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.101325+0000","last_change":"2024-05-08T06:41:09.576996+0000","last_active":"2024-05-08T06:44:14.101325+0000","last_peered":"2024-05-08T06:44:14.101325+0000","last_clean":"2024-05-08T06:44:14.101325+0000","last_became_active":"2024-05-08T06:41:09.572034+0000","last_became_peered":"2024-05-08T06:41:09.572034+0000","last_unstale":"2024-05-08T06:44:14.101325+0000","last_undegraded":"2024-05-08T06:44:14.101325+0000","last_fullsized":"2024-05-08T06:44:14.101325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:41.690687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876752+0000","last_change":"2024-05-08T06:41:24.665751+0000","last_active":"2024-05-08T06:43:16.876752+0000","last_peered":"2024-05-08T06:43:16.876752+0000","last_clean":"2024-05-08T06:43:16.876752+0000","last_became_active":"2024-05-08T06:41:24.665306+0000","last_became_peered":"2024-05-08T06:41:24.665306+0000","last_unstale":"2024-05-08T06:43:16.876752+0000","last_undegraded":"2024-05-08T06:43:16.876752+0000","last_fullsized":"2024-05-08T06:43:16.876752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:10.515975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871049+0000","last_change":"2024-05-08T06:41:05.502897+0000","last_active":"2024-05-08T06:43:16.871049+0000","last_peered":"2024-05-08T06:43:16.871049+0000","last_clean":"2024-05-08T06:43:16.871049+0000","last_became_active":"2024-05-08T06:41:05.500636+0000","last_became_peered":"2024-05-08T06:41:05.500636+0000","last_unstale":"2024-05-08T06:43:16.871049+0000","last_undegraded":"2024-05-08T06:43:16.871049+0000","last_fullsized":"2024-05-08T06:43:16.871049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:02.523706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.103291+0000","last_change":"2024-05-08T06:41:09.586824+0000","last_active":"2024-05-08T06:44:14.103291+0000","last_peered":"2024-05-08T06:44:14.103291+0000","last_clean":"2024-05-08T06:44:14.103291+0000","last_became_active":"2024-05-08T06:41:09.585032+0000","last_became_peered":"2024-05-08T06:41:09.585032+0000","last_unstale":"2024-05-08T06:44:14.103291+0000","last_undegraded":"2024-05-08T06:44:14.103291+0000","last_fullsized":"2024-05-08T06:44:14.103291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:00:31.890993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870572+0000","last_change":"2024-05-08T06:41:24.670033+0000","last_active":"2024-05-08T06:43:16.870572+0000","last_peered":"2024-05-08T06:43:16.870572+0000","last_clean":"2024-05-08T06:43:16.870572+0000","last_became_active":"2024-05-08T06:41:24.669477+0000","last_became_peered":"2024-05-08T06:41:24.669477+0000","last_unstale":"2024-05-08T06:43:16.870572+0000","last_undegraded":"2024-05-08T06:43:16.870572+0000","last_fullsized":"2024-05-08T06:43:16.870572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:55.040308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130374+0000","last_change":"2024-05-08T06:41:06.146847+0000","last_active":"2024-05-08T06:43:17.130374+0000","last_peered":"2024-05-08T06:43:17.130374+0000","last_clean":"2024-05-08T06:43:17.130374+0000","last_became_active":"2024-05-08T06:41:06.146141+0000","last_became_peered":"2024-05-08T06:41:06.146141+0000","last_unstale":"2024-05-08T06:43:17.130374+0000","last_undegraded":"2024-05-08T06:43:17.130374+0000","last_fullsized":"2024-05-08T06:43:17.130374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:45:30.924860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.043803+0000","last_change":"2024-05-08T06:41:09.578067+0000","last_active":"2024-05-08T06:44:14.043803+0000","last_peered":"2024-05-08T06:44:14.043803+0000","last_clean":"2024-05-08T06:44:14.043803+0000","last_became_active":"2024-05-08T06:41:09.577650+0000","last_became_peered":"2024-05-08T06:41:09.577650+0000","last_unstale":"2024-05-08T06:44:14.043803+0000","last_undegraded":"2024-05-08T06:44:14.043803+0000","last_fullsized":"2024-05-08T06:44:14.043803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:09.285601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.867221+0000","last_change":"2024-05-08T06:41:24.669791+0000","last_active":"2024-05-08T06:43:16.867221+0000","last_peered":"2024-05-08T06:43:16.867221+0000","last_clean":"2024-05-08T06:43:16.867221+0000","last_became_active":"2024-05-08T06:41:24.669363+0000","last_became_peered":"2024-05-08T06:41:24.669363+0000","last_unstale":"2024-05-08T06:43:16.867221+0000","last_undegraded":"2024-05-08T06:43:16.867221+0000","last_fullsized":"2024-05-08T06:43:16.867221+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:08.522339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884734+0000","last_change":"2024-05-08T06:41:05.486456+0000","last_active":"2024-05-08T06:43:16.884734+0000","last_peered":"2024-05-08T06:43:16.884734+0000","last_clean":"2024-05-08T06:43:16.884734+0000","last_became_active":"2024-05-08T06:41:05.485878+0000","last_became_peered":"2024-05-08T06:41:05.485878+0000","last_unstale":"2024-05-08T06:43:16.884734+0000","last_undegraded":"2024-05-08T06:43:16.884734+0000","last_fullsized":"2024-05-08T06:43:16.884734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:11:47.985329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.102138+0000","last_change":"2024-05-08T06:41:09.573940+0000","last_active":"2024-05-08T06:44:14.102138+0000","last_peered":"2024-05-08T06:44:14.102138+0000","last_clean":"2024-05-08T06:44:14.102138+0000","last_became_active":"2024-05-08T06:41:09.573515+0000","last_became_peered":"2024-05-08T06:41:09.573515+0000","last_unstale":"2024-05-08T06:44:14.102138+0000","last_undegraded":"2024-05-08T06:44:14.102138+0000","last_fullsized":"2024-05-08T06:44:14.102138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:44.803013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871281+0000","last_change":"2024-05-08T06:41:24.663008+0000","last_active":"2024-05-08T06:43:16.871281+0000","last_peered":"2024-05-08T06:43:16.871281+0000","last_clean":"2024-05-08T06:43:16.871281+0000","last_became_active":"2024-05-08T06:41:24.661934+0000","last_became_peered":"2024-05-08T06:41:24.661934+0000","last_unstale":"2024-05-08T06:43:16.871281+0000","last_undegraded":"2024-05-08T06:43:16.871281+0000","last_fullsized":"2024-05-08T06:43:16.871281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:08.719125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.894395+0000","last_change":"2024-05-08T06:43:16.894395+0000","last_active":"2024-05-08T06:43:16.894395+0000","last_peered":"2024-05-08T06:43:16.894395+0000","last_clean":"2024-05-08T06:43:16.894395+0000","last_became_active":"2024-05-08T06:43:16.886763+0000","last_became_peered":"2024-05-08T06:43:16.886763+0000","last_unstale":"2024-05-08T06:43:16.894395+0000","last_undegraded":"2024-05-08T06:43:16.894395+0000","last_fullsized":"2024-05-08T06:43:16.894395+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:52.278223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107892+0000","last_change":"2024-05-08T06:41:09.573388+0000","last_active":"2024-05-08T06:44:14.107892+0000","last_peered":"2024-05-08T06:44:14.107892+0000","last_clean":"2024-05-08T06:44:14.107892+0000","last_became_active":"2024-05-08T06:41:09.572901+0000","last_became_peered":"2024-05-08T06:41:09.572901+0000","last_unstale":"2024-05-08T06:44:14.107892+0000","last_undegraded":"2024-05-08T06:44:14.107892+0000","last_fullsized":"2024-05-08T06:44:14.107892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:38:45.123194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870607+0000","last_change":"2024-05-08T06:41:24.659817+0000","last_active":"2024-05-08T06:43:16.870607+0000","last_peered":"2024-05-08T06:43:16.870607+0000","last_clean":"2024-05-08T06:43:16.870607+0000","last_became_active":"2024-05-08T06:41:24.659276+0000","last_became_peered":"2024-05-08T06:41:24.659276+0000","last_unstale":"2024-05-08T06:43:16.870607+0000","last_undegraded":"2024-05-08T06:43:16.870607+0000","last_fullsized":"2024-05-08T06:43:16.870607+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:01.635454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.905524+0000","last_change":"2024-05-08T06:43:16.905524+0000","last_active":"2024-05-08T06:43:16.905524+0000","last_peered":"2024-05-08T06:43:16.905524+0000","last_clean":"2024-05-08T06:43:16.905524+0000","last_became_active":"2024-05-08T06:43:16.888087+0000","last_became_peered":"2024-05-08T06:43:16.888087+0000","last_unstale":"2024-05-08T06:43:16.905524+0000","last_undegraded":"2024-05-08T06:43:16.905524+0000","last_fullsized":"2024-05-08T06:43:16.905524+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:52.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.112237+0000","last_change":"2024-05-08T06:41:09.574238+0000","last_active":"2024-05-08T06:44:14.112237+0000","last_peered":"2024-05-08T06:44:14.112237+0000","last_clean":"2024-05-08T06:44:14.112237+0000","last_became_active":"2024-05-08T06:41:09.570019+0000","last_became_peered":"2024-05-08T06:41:09.570019+0000","last_unstale":"2024-05-08T06:44:14.112237+0000","last_undegraded":"2024-05-08T06:44:14.112237+0000","last_fullsized":"2024-05-08T06:44:14.112237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:56.980400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130987+0000","last_change":"2024-05-08T06:41:24.659955+0000","last_active":"2024-05-08T06:43:17.130987+0000","last_peered":"2024-05-08T06:43:17.130987+0000","last_clean":"2024-05-08T06:43:17.130987+0000","last_became_active":"2024-05-08T06:41:24.659534+0000","last_became_peered":"2024-05-08T06:41:24.659534+0000","last_unstale":"2024-05-08T06:43:17.130987+0000","last_undegraded":"2024-05-08T06:43:17.130987+0000","last_fullsized":"2024-05-08T06:43:17.130987+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:41.893917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.898447+0000","last_change":"2024-05-08T06:43:16.897225+0000","last_active":"2024-05-08T06:43:16.898447+0000","last_peered":"2024-05-08T06:43:16.898447+0000","last_clean":"2024-05-08T06:43:16.898447+0000","last_became_active":"2024-05-08T06:43:16.883954+0000","last_became_peered":"2024-05-08T06:43:16.883954+0000","last_unstale":"2024-05-08T06:43:16.898447+0000","last_undegraded":"2024-05-08T06:43:16.898447+0000","last_fullsized":"2024-05-08T06:43:16.898447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:12.014514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.112070+0000","last_change":"2024-05-08T06:41:09.574159+0000","last_active":"2024-05-08T06:44:14.112070+0000","last_peered":"2024-05-08T06:44:14.112070+0000","last_clean":"2024-05-08T06:44:14.112070+0000","last_became_active":"2024-05-08T06:41:09.573734+0000","last_became_peered":"2024-05-08T06:41:09.573734+0000","last_unstale":"2024-05-08T06:44:14.112070+0000","last_undegraded":"2024-05-08T06:44:14.112070+0000","last_fullsized":"2024-05-08T06:44:14.112070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:22.157071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874626+0000","last_change":"2024-05-08T06:41:24.668545+0000","last_active":"2024-05-08T06:43:16.874626+0000","last_peered":"2024-05-08T06:43:16.874626+0000","last_clean":"2024-05-08T06:43:16.874626+0000","last_became_active":"2024-05-08T06:41:24.668086+0000","last_became_peered":"2024-05-08T06:41:24.668086+0000","last_unstale":"2024-05-08T06:43:16.874626+0000","last_undegraded":"2024-05-08T06:43:16.874626+0000","last_fullsized":"2024-05-08T06:43:16.874626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:08:02.473733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130284+0000","last_change":"2024-05-08T06:41:05.501332+0000","last_active":"2024-05-08T06:43:17.130284+0000","last_peered":"2024-05-08T06:43:17.130284+0000","last_clean":"2024-05-08T06:43:17.130284+0000","last_became_active":"2024-05-08T06:41:05.499174+0000","last_became_peered":"2024-05-08T06:41:05.499174+0000","last_unstale":"2024-05-08T06:43:17.130284+0000","last_undegraded":"2024-05-08T06:43:17.130284+0000","last_fullsized":"2024-05-08T06:43:17.130284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:49.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099501+0000","last_change":"2024-05-08T06:41:09.572927+0000","last_active":"2024-05-08T06:44:14.099501+0000","last_peered":"2024-05-08T06:44:14.099501+0000","last_clean":"2024-05-08T06:44:14.099501+0000","last_became_active":"2024-05-08T06:41:09.572502+0000","last_became_peered":"2024-05-08T06:41:09.572502+0000","last_unstale":"2024-05-08T06:44:14.099501+0000","last_undegraded":"2024-05-08T06:44:14.099501+0000","last_fullsized":"2024-05-08T06:44:14.099501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:03.838892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129121+0000","last_change":"2024-05-08T06:41:24.667561+0000","last_active":"2024-05-08T06:43:17.129121+0000","last_peered":"2024-05-08T06:43:17.129121+0000","last_clean":"2024-05-08T06:43:17.129121+0000","last_became_active":"2024-05-08T06:41:24.666904+0000","last_became_peered":"2024-05-08T06:41:24.666904+0000","last_unstale":"2024-05-08T06:43:17.129121+0000","last_undegraded":"2024-05-08T06:43:17.129121+0000","last_fullsized":"2024-05-08T06:43:17.129121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:15.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957758+0000","last_change":"2024-05-08T06:41:05.497117+0000","last_active":"2024-05-08T06:43:16.957758+0000","last_peered":"2024-05-08T06:43:16.957758+0000","last_clean":"2024-05-08T06:43:16.957758+0000","last_became_active":"2024-05-08T06:41:05.496621+0000","last_became_peered":"2024-05-08T06:41:05.496621+0000","last_unstale":"2024-05-08T06:43:16.957758+0000","last_undegraded":"2024-05-08T06:43:16.957758+0000","last_fullsized":"2024-05-08T06:43:16.957758+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:06:32.603973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.103601+0000","last_change":"2024-05-08T06:41:09.572489+0000","last_active":"2024-05-08T06:44:14.103601+0000","last_peered":"2024-05-08T06:44:14.103601+0000","last_clean":"2024-05-08T06:44:14.103601+0000","last_became_active":"2024-05-08T06:41:09.572129+0000","last_became_peered":"2024-05-08T06:41:09.572129+0000","last_unstale":"2024-05-08T06:44:14.103601+0000","last_undegraded":"2024-05-08T06:44:14.103601+0000","last_fullsized":"2024-05-08T06:44:14.103601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:18:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099891+0000","last_change":"2024-05-08T06:41:09.577872+0000","last_active":"2024-05-08T06:44:14.099891+0000","last_peered":"2024-05-08T06:44:14.099891+0000","last_clean":"2024-05-08T06:44:14.099891+0000","last_became_active":"2024-05-08T06:41:09.577490+0000","last_became_peered":"2024-05-08T06:41:09.577490+0000","last_unstale":"2024-05-08T06:44:14.099891+0000","last_undegraded":"2024-05-08T06:44:14.099891+0000","last_fullsized":"2024-05-08T06:44:14.099891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:12:44.956055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.096855+0000","last_change":"2024-05-08T06:42:15.861046+0000","last_active":"2024-05-08T06:44:14.096855+0000","last_peered":"2024-05-08T06:44:14.096855+0000","last_clean":"2024-05-08T06:44:14.096855+0000","last_became_active":"2024-05-08T06:42:15.860267+0000","last_became_peered":"2024-05-08T06:42:15.860267+0000","last_unstale":"2024-05-08T06:44:14.096855+0000","last_undegraded":"2024-05-08T06:44:14.096855+0000","last_fullsized":"2024-05-08T06:44:14.096855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:15:01.541268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.092742+0000","last_change":"2024-05-08T06:41:09.578005+0000","last_active":"2024-05-08T06:44:14.092742+0000","last_peered":"2024-05-08T06:44:14.092742+0000","last_clean":"2024-05-08T06:44:14.092742+0000","last_became_active":"2024-05-08T06:41:09.577571+0000","last_became_peered":"2024-05-08T06:41:09.577571+0000","last_unstale":"2024-05-08T06:44:14.092742+0000","last_undegraded":"2024-05-08T06:44:14.092742+0000","last_fullsized":"2024-05-08T06:44:14.092742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:22.762195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.102376+0000","last_change":"2024-05-08T06:41:09.579520+0000","last_active":"2024-05-08T06:44:14.102376+0000","last_peered":"2024-05-08T06:44:14.102376+0000","last_clean":"2024-05-08T06:44:14.102376+0000","last_became_active":"2024-05-08T06:41:09.579085+0000","last_became_peered":"2024-05-08T06:41:09.579085+0000","last_unstale":"2024-05-08T06:44:14.102376+0000","last_undegraded":"2024-05-08T06:44:14.102376+0000","last_fullsized":"2024-05-08T06:44:14.102376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:02:25.199102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107682+0000","last_change":"2024-05-08T06:41:09.588352+0000","last_active":"2024-05-08T06:44:14.107682+0000","last_peered":"2024-05-08T06:44:14.107682+0000","last_clean":"2024-05-08T06:44:14.107682+0000","last_became_active":"2024-05-08T06:41:09.587981+0000","last_became_peered":"2024-05-08T06:41:09.587981+0000","last_unstale":"2024-05-08T06:44:14.107682+0000","last_undegraded":"2024-05-08T06:44:14.107682+0000","last_fullsized":"2024-05-08T06:44:14.107682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:55.275569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098523+0000","last_change":"2024-05-08T06:41:09.584216+0000","last_active":"2024-05-08T06:44:14.098523+0000","last_peered":"2024-05-08T06:44:14.098523+0000","last_clean":"2024-05-08T06:44:14.098523+0000","last_became_active":"2024-05-08T06:41:09.583789+0000","last_became_peered":"2024-05-08T06:41:09.583789+0000","last_unstale":"2024-05-08T06:44:14.098523+0000","last_undegraded":"2024-05-08T06:44:14.098523+0000","last_fullsized":"2024-05-08T06:44:14.098523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:33:04.153098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.100400+0000","last_change":"2024-05-08T06:41:09.573622+0000","last_active":"2024-05-08T06:44:14.100400+0000","last_peered":"2024-05-08T06:44:14.100400+0000","last_clean":"2024-05-08T06:44:14.100400+0000","last_became_active":"2024-05-08T06:41:09.573116+0000","last_became_peered":"2024-05-08T06:41:09.573116+0000","last_unstale":"2024-05-08T06:44:14.100400+0000","last_undegraded":"2024-05-08T06:44:14.100400+0000","last_fullsized":"2024-05-08T06:44:14.100400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:58:03.031899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.081583+0000","last_change":"2024-05-08T06:41:09.588787+0000","last_active":"2024-05-08T06:44:14.081583+0000","last_peered":"2024-05-08T06:44:14.081583+0000","last_clean":"2024-05-08T06:44:14.081583+0000","last_became_active":"2024-05-08T06:41:09.588430+0000","last_became_peered":"2024-05-08T06:41:09.588430+0000","last_unstale":"2024-05-08T06:44:14.081583+0000","last_undegraded":"2024-05-08T06:44:14.081583+0000","last_fullsized":"2024-05-08T06:44:14.081583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:36:26.689419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.095156+0000","last_change":"2024-05-08T06:41:09.575057+0000","last_active":"2024-05-08T06:44:14.095156+0000","last_peered":"2024-05-08T06:44:14.095156+0000","last_clean":"2024-05-08T06:44:14.095156+0000","last_became_active":"2024-05-08T06:41:09.572522+0000","last_became_peered":"2024-05-08T06:41:09.572522+0000","last_unstale":"2024-05-08T06:44:14.095156+0000","last_undegraded":"2024-05-08T06:44:14.095156+0000","last_fullsized":"2024-05-08T06:44:14.095156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:40:26.702841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.096644+0000","last_change":"2024-05-08T06:41:09.578184+0000","last_active":"2024-05-08T06:44:14.096644+0000","last_peered":"2024-05-08T06:44:14.096644+0000","last_clean":"2024-05-08T06:44:14.096644+0000","last_became_active":"2024-05-08T06:41:09.577796+0000","last_became_peered":"2024-05-08T06:41:09.577796+0000","last_unstale":"2024-05-08T06:44:14.096644+0000","last_undegraded":"2024-05-08T06:44:14.096644+0000","last_fullsized":"2024-05-08T06:44:14.096644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:40.822805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111399+0000","last_change":"2024-05-08T06:41:09.577050+0000","last_active":"2024-05-08T06:44:14.111399+0000","last_peered":"2024-05-08T06:44:14.111399+0000","last_clean":"2024-05-08T06:44:14.111399+0000","last_became_active":"2024-05-08T06:41:09.576449+0000","last_became_peered":"2024-05-08T06:41:09.576449+0000","last_unstale":"2024-05-08T06:44:14.111399+0000","last_undegraded":"2024-05-08T06:44:14.111399+0000","last_fullsized":"2024-05-08T06:44:14.111399+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:04:42.819087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107830+0000","last_change":"2024-05-08T06:41:09.580830+0000","last_active":"2024-05-08T06:44:14.107830+0000","last_peered":"2024-05-08T06:44:14.107830+0000","last_clean":"2024-05-08T06:44:14.107830+0000","last_became_active":"2024-05-08T06:41:09.577457+0000","last_became_peered":"2024-05-08T06:41:09.577457+0000","last_unstale":"2024-05-08T06:44:14.107830+0000","last_undegraded":"2024-05-08T06:44:14.107830+0000","last_fullsized":"2024-05-08T06:44:14.107830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:02.932857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.097017+0000","last_change":"2024-05-08T06:41:09.586919+0000","last_active":"2024-05-08T06:44:14.097017+0000","last_peered":"2024-05-08T06:44:14.097017+0000","last_clean":"2024-05-08T06:44:14.097017+0000","last_became_active":"2024-05-08T06:41:09.586560+0000","last_became_peered":"2024-05-08T06:41:09.586560+0000","last_unstale":"2024-05-08T06:44:14.097017+0000","last_undegraded":"2024-05-08T06:44:14.097017+0000","last_fullsized":"2024-05-08T06:44:14.097017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:00.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72621,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":782,"num_read_kb":468,"num_write":175,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":217863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612671,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":528202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808902,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32888,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712264,"statfs":{"total":95995035648,"available":95961358336,"internally_reserved":0,"allocated":1753088,"data_stored":1184481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972431,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1077248,"data_stored":532534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168660,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":528358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364892,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1667072,"data_stored":1124408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561124,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":523614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":592003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738507,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1077248,"data_stored":525002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1146880,"data_stored":592771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149816,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":523808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953586,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":529378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757355,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36972,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708180,"statfs":{"total":95995035648,"available":95957176320,"internally_reserved":0,"allocated":1675264,"data_stored":1119464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T06:44:51.951 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T06:44:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:51 smithi194 ceph-mon[33679]: pgmap v490: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:44:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:51 smithi194 ceph-mon[33679]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:44:52.429 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:53 smithi070 ceph-mon[29591]: pgmap v491: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:53 smithi172 ceph-mon[33377]: pgmap v491: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:54.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:53 smithi194 ceph-mon[33679]: pgmap v491: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.821+0000 7fda4cc00700 1 -- 172.21.15.70:0/3853050131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 msgr2=0x7fda48109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.821+0000 7fda4cc00700 1 --2- 172.21.15.70:0/3853050131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 0x7fda48109840 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fda38009990 tx=0x7fda38009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.821+0000 7fda4cc00700 1 -- 172.21.15.70:0/3853050131 shutdown_connections 2024-05-08T06:44:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.821+0000 7fda4cc00700 1 --2- 172.21.15.70:0/3853050131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda48103d90 0x7fda481102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.821+0000 7fda4cc00700 1 --2- 172.21.15.70:0/3853050131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 0x7fda48109840 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.821+0000 7fda4cc00700 1 --2- 172.21.15.70:0/3853050131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda481033d0 0x7fda48103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.821+0000 7fda4cc00700 1 -- 172.21.15.70:0/3853050131 >> 172.21.15.70:0/3853050131 conn(0x7fda480fef20 msgr2=0x7fda48101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.822+0000 7fda4cc00700 1 -- 172.21.15.70:0/3853050131 shutdown_connections 2024-05-08T06:44:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.822+0000 7fda4cc00700 1 -- 172.21.15.70:0/3853050131 wait complete. 2024-05-08T06:44:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.823+0000 7fda4cc00700 1 Processor -- start 2024-05-08T06:44:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.823+0000 7fda4cc00700 1 -- start start 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.823+0000 7fda4cc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda481033d0 0x7fda481a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.823+0000 7fda4cc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda48103d90 0x7fda481a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.823+0000 7fda4cc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 0x7fda4819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.823+0000 7fda4cc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda48113440 con 0x7fda48109460 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.823+0000 7fda4cc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fda481132c0 con 0x7fda481033d0 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.823+0000 7fda4cc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fda481135c0 con 0x7fda48103d90 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda47e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 0x7fda4819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda47e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 0x7fda4819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53542/0 (socket says 172.21.15.70:53542) 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda47e00700 1 -- 172.21.15.70:0/1386090526 learned_addr learned my addr 172.21.15.70:0/1386090526 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:54.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda47400700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda481033d0 0x7fda481a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda3ea00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda48103d90 0x7fda481a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda47e00700 1 -- 172.21.15.70:0/1386090526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda48103d90 msgr2=0x7fda481a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda47e00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda48103d90 0x7fda481a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda47e00700 1 -- 172.21.15.70:0/1386090526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda481033d0 msgr2=0x7fda481a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda47e00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda481033d0 0x7fda481a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda47e00700 1 -- 172.21.15.70:0/1386090526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda4819c120 con 0x7fda48109460 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.824+0000 7fda3ea00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda48103d90 0x7fda481a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.825+0000 7fda47e00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 0x7fda4819b9c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fda40007ee0 tx=0x7fda4000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.825+0000 7fda44c00700 1 -- 172.21.15.70:0/1386090526 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda4000dbd0 con 0x7fda48109460 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.825+0000 7fda44c00700 1 -- 172.21.15.70:0/1386090526 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fda4000dd70 con 0x7fda48109460 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.825+0000 7fda44c00700 1 -- 172.21.15.70:0/1386090526 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda400058d0 con 0x7fda48109460 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.825+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda4819c410 con 0x7fda48109460 2024-05-08T06:44:54.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.825+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda481a86d0 con 0x7fda48109460 2024-05-08T06:44:54.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.826+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4806a190 con 0x7fda48109460 2024-05-08T06:44:54.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.829+0000 7fda44c00700 1 -- 172.21.15.70:0/1386090526 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fda4001a020 con 0x7fda48109460 2024-05-08T06:44:54.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.830+0000 7fda44c00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda2c0b2900 0x7fda2c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:54.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.830+0000 7fda44c00700 1 -- 172.21.15.70:0/1386090526 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fda400e2460 con 0x7fda48109460 2024-05-08T06:44:54.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.830+0000 7fda47400700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda2c0b2900 0x7fda2c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:54.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.831+0000 7fda47400700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda2c0b2900 0x7fda2c0b4dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda38003760 tx=0x7fda3801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:54.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:54.833+0000 7fda44c00700 1 -- 172.21.15.70:0/1386090526 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fda40010070 con 0x7fda48109460 2024-05-08T06:44:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.061+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda480ffc50 con 0x7fda2c0b2900 2024-05-08T06:44:55.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.090+0000 7fda44c00700 1 -- 172.21.15.70:0/1386090526 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340463 (secure 0 0 0) 0x7fda3807b200 con 0x7fda2c0b2900 2024-05-08T06:44:55.096 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:44:55.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.096+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda2c0b2900 msgr2=0x7fda2c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.096+0000 7fda4cc00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda2c0b2900 0x7fda2c0b4dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda38003760 tx=0x7fda3801a040 comp rx=0 tx=0).stop 2024-05-08T06:44:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.096+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 msgr2=0x7fda4819b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.096+0000 7fda4cc00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 0x7fda4819b9c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fda40007ee0 tx=0x7fda4000d3b0 comp rx=0 tx=0).stop 2024-05-08T06:44:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.097+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 shutdown_connections 2024-05-08T06:44:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.097+0000 7fda4cc00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fda2c0b2900 0x7fda2c0b4dc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.097+0000 7fda4cc00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda48109460 0x7fda4819b9c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.097+0000 7fda4cc00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fda481033d0 0x7fda481a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:55.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.097+0000 7fda4cc00700 1 --2- 172.21.15.70:0/1386090526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda48103d90 0x7fda481a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:55.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.097+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 >> 172.21.15.70:0/1386090526 conn(0x7fda480fef20 msgr2=0x7fda480ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:55.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.097+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 shutdown_connections 2024-05-08T06:44:55.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:55.097+0000 7fda4cc00700 1 -- 172.21.15.70:0/1386090526 wait complete. 2024-05-08T06:44:55.100 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-08T06:44:55.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:55 smithi070 ceph-mon[29591]: pgmap v492: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:44:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:55 smithi172 ceph-mon[33377]: pgmap v492: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:44:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:55 smithi194 ceph-mon[33679]: pgmap v492: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:44:56.122 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":492,"stamp":"2024-05-08T06:44:54.183342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663223,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":878,"num_read_kb":542,"num_write":300,"num_write_kb":2280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":744,"ondisk_log_size":744,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384444,"kb_used_data":14492,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557380,"statfs":{"total":1151940427776,"available":1151546757120,"internally_reserved":0,"allocated":14839808,"data_stored":8304023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005555"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.113430+0000","last_change":"2024-05-08T06:41:09.587375+0000","last_active":"2024-05-08T06:44:14.113430+0000","last_peered":"2024-05-08T06:44:14.113430+0000","last_clean":"2024-05-08T06:44:14.113430+0000","last_became_active":"2024-05-08T06:41:09.585981+0000","last_became_peered":"2024-05-08T06:41:09.585981+0000","last_unstale":"2024-05-08T06:44:14.113430+0000","last_undegraded":"2024-05-08T06:44:14.113430+0000","last_fullsized":"2024-05-08T06:44:14.113430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:21.366529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.108971+0000","last_change":"2024-05-08T06:41:09.573666+0000","last_active":"2024-05-08T06:44:14.108971+0000","last_peered":"2024-05-08T06:44:14.108971+0000","last_clean":"2024-05-08T06:44:14.108971+0000","last_became_active":"2024-05-08T06:41:09.573331+0000","last_became_peered":"2024-05-08T06:41:09.573331+0000","last_unstale":"2024-05-08T06:44:14.108971+0000","last_undegraded":"2024-05-08T06:44:14.108971+0000","last_fullsized":"2024-05-08T06:44:14.108971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:03:14.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111904+0000","last_change":"2024-05-08T06:41:09.582304+0000","last_active":"2024-05-08T06:44:14.111904+0000","last_peered":"2024-05-08T06:44:14.111904+0000","last_clean":"2024-05-08T06:44:14.111904+0000","last_became_active":"2024-05-08T06:41:09.581916+0000","last_became_peered":"2024-05-08T06:41:09.581916+0000","last_unstale":"2024-05-08T06:44:14.111904+0000","last_undegraded":"2024-05-08T06:44:14.111904+0000","last_fullsized":"2024-05-08T06:44:14.111904+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:26.221008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":24,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.092759+0000","last_change":"2024-05-08T06:42:15.863857+0000","last_active":"2024-05-08T06:44:14.092759+0000","last_peered":"2024-05-08T06:44:14.092759+0000","last_clean":"2024-05-08T06:44:14.092759+0000","last_became_active":"2024-05-08T06:42:15.863147+0000","last_became_peered":"2024-05-08T06:42:15.863147+0000","last_unstale":"2024-05-08T06:44:14.092759+0000","last_undegraded":"2024-05-08T06:44:14.092759+0000","last_fullsized":"2024-05-08T06:44:14.092759+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:48:20.951766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.069201+0000","last_change":"2024-05-08T06:41:09.582429+0000","last_active":"2024-05-08T06:44:14.069201+0000","last_peered":"2024-05-08T06:44:14.069201+0000","last_clean":"2024-05-08T06:44:14.069201+0000","last_became_active":"2024-05-08T06:41:09.580152+0000","last_became_peered":"2024-05-08T06:41:09.580152+0000","last_unstale":"2024-05-08T06:44:14.069201+0000","last_undegraded":"2024-05-08T06:44:14.069201+0000","last_fullsized":"2024-05-08T06:44:14.069201+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:58.992177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.092389+0000","last_change":"2024-05-08T06:41:09.576432+0000","last_active":"2024-05-08T06:44:14.092389+0000","last_peered":"2024-05-08T06:44:14.092389+0000","last_clean":"2024-05-08T06:44:14.092389+0000","last_became_active":"2024-05-08T06:41:09.575723+0000","last_became_peered":"2024-05-08T06:41:09.575723+0000","last_unstale":"2024-05-08T06:44:14.092389+0000","last_undegraded":"2024-05-08T06:44:14.092389+0000","last_fullsized":"2024-05-08T06:44:14.092389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:51.802944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099363+0000","last_change":"2024-05-08T06:42:15.856660+0000","last_active":"2024-05-08T06:44:14.099363+0000","last_peered":"2024-05-08T06:44:14.099363+0000","last_clean":"2024-05-08T06:44:14.099363+0000","last_became_active":"2024-05-08T06:42:15.855585+0000","last_became_peered":"2024-05-08T06:42:15.855585+0000","last_unstale":"2024-05-08T06:44:14.099363+0000","last_undegraded":"2024-05-08T06:44:14.099363+0000","last_fullsized":"2024-05-08T06:44:14.099363+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:43.647357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099769+0000","last_change":"2024-05-08T06:41:09.579941+0000","last_active":"2024-05-08T06:44:14.099769+0000","last_peered":"2024-05-08T06:44:14.099769+0000","last_clean":"2024-05-08T06:44:14.099769+0000","last_became_active":"2024-05-08T06:41:09.578961+0000","last_became_peered":"2024-05-08T06:41:09.578961+0000","last_unstale":"2024-05-08T06:44:14.099769+0000","last_undegraded":"2024-05-08T06:44:14.099769+0000","last_fullsized":"2024-05-08T06:44:14.099769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:28:59.000080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111107+0000","last_change":"2024-05-08T06:41:09.580544+0000","last_active":"2024-05-08T06:44:14.111107+0000","last_peered":"2024-05-08T06:44:14.111107+0000","last_clean":"2024-05-08T06:44:14.111107+0000","last_became_active":"2024-05-08T06:41:09.579445+0000","last_became_peered":"2024-05-08T06:41:09.579445+0000","last_unstale":"2024-05-08T06:44:14.111107+0000","last_undegraded":"2024-05-08T06:44:14.111107+0000","last_fullsized":"2024-05-08T06:44:14.111107+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:28.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.108078+0000","last_change":"2024-05-08T06:41:09.583133+0000","last_active":"2024-05-08T06:44:14.108078+0000","last_peered":"2024-05-08T06:44:14.108078+0000","last_clean":"2024-05-08T06:44:14.108078+0000","last_became_active":"2024-05-08T06:41:09.582261+0000","last_became_peered":"2024-05-08T06:41:09.582261+0000","last_unstale":"2024-05-08T06:44:14.108078+0000","last_undegraded":"2024-05-08T06:44:14.108078+0000","last_fullsized":"2024-05-08T06:44:14.108078+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:26.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111923+0000","last_change":"2024-05-08T06:41:09.575410+0000","last_active":"2024-05-08T06:44:14.111923+0000","last_peered":"2024-05-08T06:44:14.111923+0000","last_clean":"2024-05-08T06:44:14.111923+0000","last_became_active":"2024-05-08T06:41:09.574936+0000","last_became_peered":"2024-05-08T06:41:09.574936+0000","last_unstale":"2024-05-08T06:44:14.111923+0000","last_undegraded":"2024-05-08T06:44:14.111923+0000","last_fullsized":"2024-05-08T06:44:14.111923+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:45.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098695+0000","last_change":"2024-05-08T06:41:09.582844+0000","last_active":"2024-05-08T06:44:14.098695+0000","last_peered":"2024-05-08T06:44:14.098695+0000","last_clean":"2024-05-08T06:44:14.098695+0000","last_became_active":"2024-05-08T06:41:09.582497+0000","last_became_peered":"2024-05-08T06:41:09.582497+0000","last_unstale":"2024-05-08T06:44:14.098695+0000","last_undegraded":"2024-05-08T06:44:14.098695+0000","last_fullsized":"2024-05-08T06:44:14.098695+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:09:45.168495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098771+0000","last_change":"2024-05-08T06:41:09.565312+0000","last_active":"2024-05-08T06:44:14.098771+0000","last_peered":"2024-05-08T06:44:14.098771+0000","last_clean":"2024-05-08T06:44:14.098771+0000","last_became_active":"2024-05-08T06:41:09.563425+0000","last_became_peered":"2024-05-08T06:41:09.563425+0000","last_unstale":"2024-05-08T06:44:14.098771+0000","last_undegraded":"2024-05-08T06:44:14.098771+0000","last_fullsized":"2024-05-08T06:44:14.098771+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:08.706504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.108838+0000","last_change":"2024-05-08T06:41:09.579395+0000","last_active":"2024-05-08T06:44:14.108838+0000","last_peered":"2024-05-08T06:44:14.108838+0000","last_clean":"2024-05-08T06:44:14.108838+0000","last_became_active":"2024-05-08T06:41:09.575881+0000","last_became_peered":"2024-05-08T06:41:09.575881+0000","last_unstale":"2024-05-08T06:44:14.108838+0000","last_undegraded":"2024-05-08T06:44:14.108838+0000","last_fullsized":"2024-05-08T06:44:14.108838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:37.109480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107143+0000","last_change":"2024-05-08T06:41:09.589859+0000","last_active":"2024-05-08T06:44:14.107143+0000","last_peered":"2024-05-08T06:44:14.107143+0000","last_clean":"2024-05-08T06:44:14.107143+0000","last_became_active":"2024-05-08T06:41:09.589002+0000","last_became_peered":"2024-05-08T06:41:09.589002+0000","last_unstale":"2024-05-08T06:44:14.107143+0000","last_undegraded":"2024-05-08T06:44:14.107143+0000","last_fullsized":"2024-05-08T06:44:14.107143+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:15:39.022268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.109106+0000","last_change":"2024-05-08T06:41:09.566551+0000","last_active":"2024-05-08T06:44:14.109106+0000","last_peered":"2024-05-08T06:44:14.109106+0000","last_clean":"2024-05-08T06:44:14.109106+0000","last_became_active":"2024-05-08T06:41:09.564599+0000","last_became_peered":"2024-05-08T06:41:09.564599+0000","last_unstale":"2024-05-08T06:44:14.109106+0000","last_undegraded":"2024-05-08T06:44:14.109106+0000","last_fullsized":"2024-05-08T06:44:14.109106+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:45.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.113526+0000","last_change":"2024-05-08T06:41:09.582643+0000","last_active":"2024-05-08T06:44:14.113526+0000","last_peered":"2024-05-08T06:44:14.113526+0000","last_clean":"2024-05-08T06:44:14.113526+0000","last_became_active":"2024-05-08T06:41:09.582213+0000","last_became_peered":"2024-05-08T06:41:09.582213+0000","last_unstale":"2024-05-08T06:44:14.113526+0000","last_undegraded":"2024-05-08T06:44:14.113526+0000","last_fullsized":"2024-05-08T06:44:14.113526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:18.471194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.112588+0000","last_change":"2024-05-08T06:41:09.581447+0000","last_active":"2024-05-08T06:44:14.112588+0000","last_peered":"2024-05-08T06:44:14.112588+0000","last_clean":"2024-05-08T06:44:14.112588+0000","last_became_active":"2024-05-08T06:41:09.581067+0000","last_became_peered":"2024-05-08T06:41:09.581067+0000","last_unstale":"2024-05-08T06:44:14.112588+0000","last_undegraded":"2024-05-08T06:44:14.112588+0000","last_fullsized":"2024-05-08T06:44:14.112588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:26.967371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.093476+0000","last_change":"2024-05-08T06:43:16.960640+0000","last_active":"2024-05-08T06:44:14.093476+0000","last_peered":"2024-05-08T06:44:14.093476+0000","last_clean":"2024-05-08T06:44:14.093476+0000","last_became_active":"2024-05-08T06:43:16.959541+0000","last_became_peered":"2024-05-08T06:43:16.959541+0000","last_unstale":"2024-05-08T06:44:14.093476+0000","last_undegraded":"2024-05-08T06:44:14.093476+0000","last_fullsized":"2024-05-08T06:44:14.093476+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:42.070321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878244+0000","last_change":"2024-05-08T06:41:24.665142+0000","last_active":"2024-05-08T06:43:16.878244+0000","last_peered":"2024-05-08T06:43:16.878244+0000","last_clean":"2024-05-08T06:43:16.878244+0000","last_became_active":"2024-05-08T06:41:24.664431+0000","last_became_peered":"2024-05-08T06:41:24.664431+0000","last_unstale":"2024-05-08T06:43:16.878244+0000","last_undegraded":"2024-05-08T06:43:16.878244+0000","last_fullsized":"2024-05-08T06:43:16.878244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:11:08.511550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.867152+0000","last_change":"2024-05-08T06:41:05.503245+0000","last_active":"2024-05-08T06:43:16.867152+0000","last_peered":"2024-05-08T06:43:16.867152+0000","last_clean":"2024-05-08T06:43:16.867152+0000","last_became_active":"2024-05-08T06:41:05.502561+0000","last_became_peered":"2024-05-08T06:41:05.502561+0000","last_unstale":"2024-05-08T06:43:16.867152+0000","last_undegraded":"2024-05-08T06:43:16.867152+0000","last_fullsized":"2024-05-08T06:43:16.867152+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:06.169830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.095403+0000","last_change":"2024-05-08T06:41:09.579703+0000","last_active":"2024-05-08T06:44:14.095403+0000","last_peered":"2024-05-08T06:44:14.095403+0000","last_clean":"2024-05-08T06:44:14.095403+0000","last_became_active":"2024-05-08T06:41:09.579332+0000","last_became_peered":"2024-05-08T06:41:09.579332+0000","last_unstale":"2024-05-08T06:44:14.095403+0000","last_undegraded":"2024-05-08T06:44:14.095403+0000","last_fullsized":"2024-05-08T06:44:14.095403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:08.616722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.869569+0000","last_change":"2024-05-08T06:41:24.666322+0000","last_active":"2024-05-08T06:43:16.869569+0000","last_peered":"2024-05-08T06:43:16.869569+0000","last_clean":"2024-05-08T06:43:16.869569+0000","last_became_active":"2024-05-08T06:41:24.664647+0000","last_became_peered":"2024-05-08T06:41:24.664647+0000","last_unstale":"2024-05-08T06:43:16.869569+0000","last_undegraded":"2024-05-08T06:43:16.869569+0000","last_fullsized":"2024-05-08T06:43:16.869569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:56.967066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.885459+0000","last_change":"2024-05-08T06:41:06.149339+0000","last_active":"2024-05-08T06:43:16.885459+0000","last_peered":"2024-05-08T06:43:16.885459+0000","last_clean":"2024-05-08T06:43:16.885459+0000","last_became_active":"2024-05-08T06:41:06.148846+0000","last_became_peered":"2024-05-08T06:41:06.148846+0000","last_unstale":"2024-05-08T06:43:16.885459+0000","last_undegraded":"2024-05-08T06:43:16.885459+0000","last_fullsized":"2024-05-08T06:43:16.885459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:59.291206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.112520+0000","last_change":"2024-05-08T06:41:09.581776+0000","last_active":"2024-05-08T06:44:14.112520+0000","last_peered":"2024-05-08T06:44:14.112520+0000","last_clean":"2024-05-08T06:44:14.112520+0000","last_became_active":"2024-05-08T06:41:09.581409+0000","last_became_peered":"2024-05-08T06:41:09.581409+0000","last_unstale":"2024-05-08T06:44:14.112520+0000","last_undegraded":"2024-05-08T06:44:14.112520+0000","last_fullsized":"2024-05-08T06:44:14.112520+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:30.323812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870191+0000","last_change":"2024-05-08T06:42:16.255655+0000","last_active":"2024-05-08T06:43:16.870191+0000","last_peered":"2024-05-08T06:43:16.870191+0000","last_clean":"2024-05-08T06:43:16.870191+0000","last_became_active":"2024-05-08T06:42:16.253722+0000","last_became_peered":"2024-05-08T06:42:16.253722+0000","last_unstale":"2024-05-08T06:43:16.870191+0000","last_undegraded":"2024-05-08T06:43:16.870191+0000","last_fullsized":"2024-05-08T06:43:16.870191+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:58.492286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873773+0000","last_change":"2024-05-08T06:41:05.509738+0000","last_active":"2024-05-08T06:43:16.873773+0000","last_peered":"2024-05-08T06:43:16.873773+0000","last_clean":"2024-05-08T06:43:16.873773+0000","last_became_active":"2024-05-08T06:41:05.509198+0000","last_became_peered":"2024-05-08T06:41:05.509198+0000","last_unstale":"2024-05-08T06:43:16.873773+0000","last_undegraded":"2024-05-08T06:43:16.873773+0000","last_fullsized":"2024-05-08T06:43:16.873773+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:51.350637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.110217+0000","last_change":"2024-05-08T06:41:09.572288+0000","last_active":"2024-05-08T06:44:14.110217+0000","last_peered":"2024-05-08T06:44:14.110217+0000","last_clean":"2024-05-08T06:44:14.110217+0000","last_became_active":"2024-05-08T06:41:09.571951+0000","last_became_peered":"2024-05-08T06:41:09.571951+0000","last_unstale":"2024-05-08T06:44:14.110217+0000","last_undegraded":"2024-05-08T06:44:14.110217+0000","last_fullsized":"2024-05-08T06:44:14.110217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:45.687494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870033+0000","last_change":"2024-05-08T06:41:24.663289+0000","last_active":"2024-05-08T06:43:16.870033+0000","last_peered":"2024-05-08T06:43:16.870033+0000","last_clean":"2024-05-08T06:43:16.870033+0000","last_became_active":"2024-05-08T06:41:24.662899+0000","last_became_peered":"2024-05-08T06:41:24.662899+0000","last_unstale":"2024-05-08T06:43:16.870033+0000","last_undegraded":"2024-05-08T06:43:16.870033+0000","last_fullsized":"2024-05-08T06:43:16.870033+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:15.024693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873142+0000","last_change":"2024-05-08T06:41:05.505412+0000","last_active":"2024-05-08T06:43:16.873142+0000","last_peered":"2024-05-08T06:43:16.873142+0000","last_clean":"2024-05-08T06:43:16.873142+0000","last_became_active":"2024-05-08T06:41:05.505023+0000","last_became_peered":"2024-05-08T06:41:05.505023+0000","last_unstale":"2024-05-08T06:43:16.873142+0000","last_undegraded":"2024-05-08T06:43:16.873142+0000","last_fullsized":"2024-05-08T06:43:16.873142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:50.403045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111774+0000","last_change":"2024-05-08T06:41:09.571080+0000","last_active":"2024-05-08T06:44:14.111774+0000","last_peered":"2024-05-08T06:44:14.111774+0000","last_clean":"2024-05-08T06:44:14.111774+0000","last_became_active":"2024-05-08T06:41:09.570755+0000","last_became_peered":"2024-05-08T06:41:09.570755+0000","last_unstale":"2024-05-08T06:44:14.111774+0000","last_undegraded":"2024-05-08T06:44:14.111774+0000","last_fullsized":"2024-05-08T06:44:14.111774+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:38:53.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877957+0000","last_change":"2024-05-08T06:41:24.660091+0000","last_active":"2024-05-08T06:43:16.877957+0000","last_peered":"2024-05-08T06:43:16.877957+0000","last_clean":"2024-05-08T06:43:16.877957+0000","last_became_active":"2024-05-08T06:41:24.659512+0000","last_became_peered":"2024-05-08T06:41:24.659512+0000","last_unstale":"2024-05-08T06:43:16.877957+0000","last_undegraded":"2024-05-08T06:43:16.877957+0000","last_fullsized":"2024-05-08T06:43:16.877957+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:07:56.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'5","reported_seq":181,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:51.663937+0000","last_change":"2024-05-08T06:41:05.500625+0000","last_active":"2024-05-08T06:44:51.663937+0000","last_peered":"2024-05-08T06:44:51.663937+0000","last_clean":"2024-05-08T06:44:51.663937+0000","last_became_active":"2024-05-08T06:41:05.500079+0000","last_became_peered":"2024-05-08T06:41:05.500079+0000","last_unstale":"2024-05-08T06:44:51.663937+0000","last_undegraded":"2024-05-08T06:44:51.663937+0000","last_fullsized":"2024-05-08T06:44:51.663937+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:32.143944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.093076+0000","last_change":"2024-05-08T06:41:09.569045+0000","last_active":"2024-05-08T06:44:14.093076+0000","last_peered":"2024-05-08T06:44:14.093076+0000","last_clean":"2024-05-08T06:44:14.093076+0000","last_became_active":"2024-05-08T06:41:09.560040+0000","last_became_peered":"2024-05-08T06:41:09.560040+0000","last_unstale":"2024-05-08T06:44:14.093076+0000","last_undegraded":"2024-05-08T06:44:14.093076+0000","last_fullsized":"2024-05-08T06:44:14.093076+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:58:52.284829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876938+0000","last_change":"2024-05-08T06:42:15.856574+0000","last_active":"2024-05-08T06:43:16.876938+0000","last_peered":"2024-05-08T06:43:16.876938+0000","last_clean":"2024-05-08T06:43:16.876938+0000","last_became_active":"2024-05-08T06:42:15.855459+0000","last_became_peered":"2024-05-08T06:42:15.855459+0000","last_unstale":"2024-05-08T06:43:16.876938+0000","last_undegraded":"2024-05-08T06:43:16.876938+0000","last_fullsized":"2024-05-08T06:43:16.876938+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:23:12.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.131952+0000","last_change":"2024-05-08T06:41:05.505685+0000","last_active":"2024-05-08T06:43:17.131952+0000","last_peered":"2024-05-08T06:43:17.131952+0000","last_clean":"2024-05-08T06:43:17.131952+0000","last_became_active":"2024-05-08T06:41:05.505136+0000","last_became_peered":"2024-05-08T06:41:05.505136+0000","last_unstale":"2024-05-08T06:43:17.131952+0000","last_undegraded":"2024-05-08T06:43:17.131952+0000","last_fullsized":"2024-05-08T06:43:17.131952+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:59.968405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.095889+0000","last_change":"2024-05-08T06:41:09.581340+0000","last_active":"2024-05-08T06:44:14.095889+0000","last_peered":"2024-05-08T06:44:14.095889+0000","last_clean":"2024-05-08T06:44:14.095889+0000","last_became_active":"2024-05-08T06:41:09.580969+0000","last_became_peered":"2024-05-08T06:41:09.580969+0000","last_unstale":"2024-05-08T06:44:14.095889+0000","last_undegraded":"2024-05-08T06:44:14.095889+0000","last_fullsized":"2024-05-08T06:44:14.095889+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:14.365972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.883452+0000","last_change":"2024-05-08T06:41:24.675576+0000","last_active":"2024-05-08T06:43:16.883452+0000","last_peered":"2024-05-08T06:43:16.883452+0000","last_clean":"2024-05-08T06:43:16.883452+0000","last_became_active":"2024-05-08T06:41:24.675044+0000","last_became_peered":"2024-05-08T06:41:24.675044+0000","last_unstale":"2024-05-08T06:43:16.883452+0000","last_undegraded":"2024-05-08T06:43:16.883452+0000","last_fullsized":"2024-05-08T06:43:16.883452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:59.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956344+0000","last_change":"2024-05-08T06:41:05.493094+0000","last_active":"2024-05-08T06:43:16.956344+0000","last_peered":"2024-05-08T06:43:16.956344+0000","last_clean":"2024-05-08T06:43:16.956344+0000","last_became_active":"2024-05-08T06:41:05.491206+0000","last_became_peered":"2024-05-08T06:41:05.491206+0000","last_unstale":"2024-05-08T06:43:16.956344+0000","last_undegraded":"2024-05-08T06:43:16.956344+0000","last_fullsized":"2024-05-08T06:43:16.956344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:03.689282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098737+0000","last_change":"2024-05-08T06:41:09.570646+0000","last_active":"2024-05-08T06:44:14.098737+0000","last_peered":"2024-05-08T06:44:14.098737+0000","last_clean":"2024-05-08T06:44:14.098737+0000","last_became_active":"2024-05-08T06:41:09.569500+0000","last_became_peered":"2024-05-08T06:41:09.569500+0000","last_unstale":"2024-05-08T06:44:14.098737+0000","last_undegraded":"2024-05-08T06:44:14.098737+0000","last_fullsized":"2024-05-08T06:44:14.098737+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:25:08.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.875010+0000","last_change":"2024-05-08T06:41:24.672021+0000","last_active":"2024-05-08T06:43:16.875010+0000","last_peered":"2024-05-08T06:43:16.875010+0000","last_clean":"2024-05-08T06:43:16.875010+0000","last_became_active":"2024-05-08T06:41:24.671583+0000","last_became_peered":"2024-05-08T06:41:24.671583+0000","last_unstale":"2024-05-08T06:43:16.875010+0000","last_undegraded":"2024-05-08T06:43:16.875010+0000","last_fullsized":"2024-05-08T06:43:16.875010+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:33.850855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129463+0000","last_change":"2024-05-08T06:41:05.501501+0000","last_active":"2024-05-08T06:43:17.129463+0000","last_peered":"2024-05-08T06:43:17.129463+0000","last_clean":"2024-05-08T06:43:17.129463+0000","last_became_active":"2024-05-08T06:41:05.501001+0000","last_became_peered":"2024-05-08T06:41:05.501001+0000","last_unstale":"2024-05-08T06:43:17.129463+0000","last_undegraded":"2024-05-08T06:43:17.129463+0000","last_fullsized":"2024-05-08T06:43:17.129463+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:15:18.984981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.105965+0000","last_change":"2024-05-08T06:42:15.859096+0000","last_active":"2024-05-08T06:44:14.105965+0000","last_peered":"2024-05-08T06:44:14.105965+0000","last_clean":"2024-05-08T06:44:14.105965+0000","last_became_active":"2024-05-08T06:42:15.858508+0000","last_became_peered":"2024-05-08T06:42:15.858508+0000","last_unstale":"2024-05-08T06:44:14.105965+0000","last_undegraded":"2024-05-08T06:44:14.105965+0000","last_fullsized":"2024-05-08T06:44:14.105965+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:24.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884745+0000","last_change":"2024-05-08T06:41:24.670832+0000","last_active":"2024-05-08T06:43:16.884745+0000","last_peered":"2024-05-08T06:43:16.884745+0000","last_clean":"2024-05-08T06:43:16.884745+0000","last_became_active":"2024-05-08T06:41:24.668155+0000","last_became_peered":"2024-05-08T06:41:24.668155+0000","last_unstale":"2024-05-08T06:43:16.884745+0000","last_undegraded":"2024-05-08T06:43:16.884745+0000","last_fullsized":"2024-05-08T06:43:16.884745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:11.460490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"90'3","reported_seq":173,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:47.650503+0000","last_change":"2024-05-08T06:41:05.494999+0000","last_active":"2024-05-08T06:44:47.650503+0000","last_peered":"2024-05-08T06:44:47.650503+0000","last_clean":"2024-05-08T06:44:47.650503+0000","last_became_active":"2024-05-08T06:41:05.494487+0000","last_became_peered":"2024-05-08T06:41:05.494487+0000","last_unstale":"2024-05-08T06:44:47.650503+0000","last_undegraded":"2024-05-08T06:44:47.650503+0000","last_fullsized":"2024-05-08T06:44:47.650503+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:59.282625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":126,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111376+0000","last_change":"2024-05-08T06:41:09.570607+0000","last_active":"2024-05-08T06:44:14.111376+0000","last_peered":"2024-05-08T06:44:14.111376+0000","last_clean":"2024-05-08T06:44:14.111376+0000","last_became_active":"2024-05-08T06:41:09.570047+0000","last_became_peered":"2024-05-08T06:41:09.570047+0000","last_unstale":"2024-05-08T06:44:14.111376+0000","last_undegraded":"2024-05-08T06:44:14.111376+0000","last_fullsized":"2024-05-08T06:44:14.111376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:51.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.865681+0000","last_change":"2024-05-08T06:41:24.677365+0000","last_active":"2024-05-08T06:43:16.865681+0000","last_peered":"2024-05-08T06:43:16.865681+0000","last_clean":"2024-05-08T06:43:16.865681+0000","last_became_active":"2024-05-08T06:41:24.673986+0000","last_became_peered":"2024-05-08T06:41:24.673986+0000","last_unstale":"2024-05-08T06:43:16.865681+0000","last_undegraded":"2024-05-08T06:43:16.865681+0000","last_fullsized":"2024-05-08T06:43:16.865681+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:07.013637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879420+0000","last_change":"2024-05-08T06:41:05.499624+0000","last_active":"2024-05-08T06:43:16.879420+0000","last_peered":"2024-05-08T06:43:16.879420+0000","last_clean":"2024-05-08T06:43:16.879420+0000","last_became_active":"2024-05-08T06:41:05.498875+0000","last_became_peered":"2024-05-08T06:41:05.498875+0000","last_unstale":"2024-05-08T06:43:16.879420+0000","last_undegraded":"2024-05-08T06:43:16.879420+0000","last_fullsized":"2024-05-08T06:43:16.879420+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:46:11.270399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.102915+0000","last_change":"2024-05-08T06:42:15.853569+0000","last_active":"2024-05-08T06:44:14.102915+0000","last_peered":"2024-05-08T06:44:14.102915+0000","last_clean":"2024-05-08T06:44:14.102915+0000","last_became_active":"2024-05-08T06:42:15.852223+0000","last_became_peered":"2024-05-08T06:42:15.852223+0000","last_unstale":"2024-05-08T06:44:14.102915+0000","last_undegraded":"2024-05-08T06:44:14.102915+0000","last_fullsized":"2024-05-08T06:44:14.102915+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:56.970134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870519+0000","last_change":"2024-05-08T06:41:24.671807+0000","last_active":"2024-05-08T06:43:16.870519+0000","last_peered":"2024-05-08T06:43:16.870519+0000","last_clean":"2024-05-08T06:43:16.870519+0000","last_became_active":"2024-05-08T06:41:24.670937+0000","last_became_peered":"2024-05-08T06:41:24.670937+0000","last_unstale":"2024-05-08T06:43:16.870519+0000","last_undegraded":"2024-05-08T06:43:16.870519+0000","last_fullsized":"2024-05-08T06:43:16.870519+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:52.844916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129934+0000","last_change":"2024-05-08T06:41:06.147901+0000","last_active":"2024-05-08T06:43:17.129934+0000","last_peered":"2024-05-08T06:43:17.129934+0000","last_clean":"2024-05-08T06:43:17.129934+0000","last_became_active":"2024-05-08T06:41:06.146983+0000","last_became_peered":"2024-05-08T06:41:06.146983+0000","last_unstale":"2024-05-08T06:43:17.129934+0000","last_undegraded":"2024-05-08T06:43:17.129934+0000","last_fullsized":"2024-05-08T06:43:17.129934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:54.638290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.109897+0000","last_change":"2024-05-08T06:41:09.586695+0000","last_active":"2024-05-08T06:44:14.109897+0000","last_peered":"2024-05-08T06:44:14.109897+0000","last_clean":"2024-05-08T06:44:14.109897+0000","last_became_active":"2024-05-08T06:41:09.586288+0000","last_became_peered":"2024-05-08T06:41:09.586288+0000","last_unstale":"2024-05-08T06:44:14.109897+0000","last_undegraded":"2024-05-08T06:44:14.109897+0000","last_fullsized":"2024-05-08T06:44:14.109897+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:18.383524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866132+0000","last_change":"2024-05-08T06:41:24.671523+0000","last_active":"2024-05-08T06:43:16.866132+0000","last_peered":"2024-05-08T06:43:16.866132+0000","last_clean":"2024-05-08T06:43:16.866132+0000","last_became_active":"2024-05-08T06:41:24.670307+0000","last_became_peered":"2024-05-08T06:41:24.670307+0000","last_unstale":"2024-05-08T06:43:16.866132+0000","last_undegraded":"2024-05-08T06:43:16.866132+0000","last_fullsized":"2024-05-08T06:43:16.866132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.034208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'38","reported_seq":345,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:48.653712+0000","last_change":"2024-05-08T06:41:05.504643+0000","last_active":"2024-05-08T06:44:48.653712+0000","last_peered":"2024-05-08T06:44:48.653712+0000","last_clean":"2024-05-08T06:44:48.653712+0000","last_became_active":"2024-05-08T06:41:05.504011+0000","last_became_peered":"2024-05-08T06:41:05.504011+0000","last_unstale":"2024-05-08T06:44:48.653712+0000","last_undegraded":"2024-05-08T06:44:48.653712+0000","last_fullsized":"2024-05-08T06:44:48.653712+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:47.262643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68479,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":263,"num_read_kb":200,"num_write":39,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098254+0000","last_change":"2024-05-08T06:41:09.580532+0000","last_active":"2024-05-08T06:44:14.098254+0000","last_peered":"2024-05-08T06:44:14.098254+0000","last_clean":"2024-05-08T06:44:14.098254+0000","last_became_active":"2024-05-08T06:41:09.575396+0000","last_became_peered":"2024-05-08T06:41:09.575396+0000","last_unstale":"2024-05-08T06:44:14.098254+0000","last_undegraded":"2024-05-08T06:44:14.098254+0000","last_fullsized":"2024-05-08T06:44:14.098254+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:29.197093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130702+0000","last_change":"2024-05-08T06:41:24.660200+0000","last_active":"2024-05-08T06:43:17.130702+0000","last_peered":"2024-05-08T06:43:17.130702+0000","last_clean":"2024-05-08T06:43:17.130702+0000","last_became_active":"2024-05-08T06:41:24.659674+0000","last_became_peered":"2024-05-08T06:41:24.659674+0000","last_unstale":"2024-05-08T06:43:17.130702+0000","last_undegraded":"2024-05-08T06:43:17.130702+0000","last_fullsized":"2024-05-08T06:43:17.130702+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:51.023256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.877294+0000","last_change":"2024-05-08T06:41:05.500899+0000","last_active":"2024-05-08T06:43:16.877294+0000","last_peered":"2024-05-08T06:43:16.877294+0000","last_clean":"2024-05-08T06:43:16.877294+0000","last_became_active":"2024-05-08T06:41:05.500437+0000","last_became_peered":"2024-05-08T06:41:05.500437+0000","last_unstale":"2024-05-08T06:43:16.877294+0000","last_undegraded":"2024-05-08T06:43:16.877294+0000","last_fullsized":"2024-05-08T06:43:16.877294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:38.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.100478+0000","last_change":"2024-05-08T06:41:09.574273+0000","last_active":"2024-05-08T06:44:14.100478+0000","last_peered":"2024-05-08T06:44:14.100478+0000","last_clean":"2024-05-08T06:44:14.100478+0000","last_became_active":"2024-05-08T06:41:09.573902+0000","last_became_peered":"2024-05-08T06:41:09.573902+0000","last_unstale":"2024-05-08T06:44:14.100478+0000","last_undegraded":"2024-05-08T06:44:14.100478+0000","last_fullsized":"2024-05-08T06:44:14.100478+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:39:12.749290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.882395+0000","last_change":"2024-05-08T06:41:24.674360+0000","last_active":"2024-05-08T06:43:16.882395+0000","last_peered":"2024-05-08T06:43:16.882395+0000","last_clean":"2024-05-08T06:43:16.882395+0000","last_became_active":"2024-05-08T06:41:24.673938+0000","last_became_peered":"2024-05-08T06:41:24.673938+0000","last_unstale":"2024-05-08T06:43:16.882395+0000","last_undegraded":"2024-05-08T06:43:16.882395+0000","last_fullsized":"2024-05-08T06:43:16.882395+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:13:36.735220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129914+0000","last_change":"2024-05-08T06:41:05.504335+0000","last_active":"2024-05-08T06:43:17.129914+0000","last_peered":"2024-05-08T06:43:17.129914+0000","last_clean":"2024-05-08T06:43:17.129914+0000","last_became_active":"2024-05-08T06:41:05.503981+0000","last_became_peered":"2024-05-08T06:41:05.503981+0000","last_unstale":"2024-05-08T06:43:17.129914+0000","last_undegraded":"2024-05-08T06:43:17.129914+0000","last_fullsized":"2024-05-08T06:43:17.129914+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:45:35.813245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107457+0000","last_change":"2024-05-08T06:41:09.580852+0000","last_active":"2024-05-08T06:44:14.107457+0000","last_peered":"2024-05-08T06:44:14.107457+0000","last_clean":"2024-05-08T06:44:14.107457+0000","last_became_active":"2024-05-08T06:41:09.580375+0000","last_became_peered":"2024-05-08T06:41:09.580375+0000","last_unstale":"2024-05-08T06:44:14.107457+0000","last_undegraded":"2024-05-08T06:44:14.107457+0000","last_fullsized":"2024-05-08T06:44:14.107457+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:21:06.695878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866722+0000","last_change":"2024-05-08T06:41:24.678268+0000","last_active":"2024-05-08T06:43:16.866722+0000","last_peered":"2024-05-08T06:43:16.866722+0000","last_clean":"2024-05-08T06:43:16.866722+0000","last_became_active":"2024-05-08T06:41:24.677804+0000","last_became_peered":"2024-05-08T06:41:24.677804+0000","last_unstale":"2024-05-08T06:43:16.866722+0000","last_undegraded":"2024-05-08T06:43:16.866722+0000","last_fullsized":"2024-05-08T06:43:16.866722+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:03.082661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'5","reported_seq":185,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:52.683048+0000","last_change":"2024-05-08T06:41:05.498143+0000","last_active":"2024-05-08T06:44:52.683048+0000","last_peered":"2024-05-08T06:44:52.683048+0000","last_clean":"2024-05-08T06:44:52.683048+0000","last_became_active":"2024-05-08T06:41:05.497707+0000","last_became_peered":"2024-05-08T06:41:05.497707+0000","last_unstale":"2024-05-08T06:44:52.683048+0000","last_undegraded":"2024-05-08T06:44:52.683048+0000","last_fullsized":"2024-05-08T06:44:52.683048+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:20.556535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.106688+0000","last_change":"2024-05-08T06:43:17.135955+0000","last_active":"2024-05-08T06:44:14.106688+0000","last_peered":"2024-05-08T06:44:14.106688+0000","last_clean":"2024-05-08T06:44:14.106688+0000","last_became_active":"2024-05-08T06:43:17.134734+0000","last_became_peered":"2024-05-08T06:43:17.134734+0000","last_unstale":"2024-05-08T06:44:14.106688+0000","last_undegraded":"2024-05-08T06:44:14.106688+0000","last_fullsized":"2024-05-08T06:44:14.106688+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:33:53.573382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957769+0000","last_change":"2024-05-08T06:41:24.663938+0000","last_active":"2024-05-08T06:43:16.957769+0000","last_peered":"2024-05-08T06:43:16.957769+0000","last_clean":"2024-05-08T06:43:16.957769+0000","last_became_active":"2024-05-08T06:41:24.661679+0000","last_became_peered":"2024-05-08T06:41:24.661679+0000","last_unstale":"2024-05-08T06:43:16.957769+0000","last_undegraded":"2024-05-08T06:43:16.957769+0000","last_fullsized":"2024-05-08T06:43:16.957769+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:21.590681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":60,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871464+0000","last_change":"2024-05-08T06:41:06.151458+0000","last_active":"2024-05-08T06:43:16.871464+0000","last_peered":"2024-05-08T06:43:16.871464+0000","last_clean":"2024-05-08T06:43:16.871464+0000","last_became_active":"2024-05-08T06:41:06.146564+0000","last_became_peered":"2024-05-08T06:41:06.146564+0000","last_unstale":"2024-05-08T06:43:16.871464+0000","last_undegraded":"2024-05-08T06:43:16.871464+0000","last_fullsized":"2024-05-08T06:43:16.871464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:36.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.100460+0000","last_change":"2024-05-08T06:41:09.576666+0000","last_active":"2024-05-08T06:44:14.100460+0000","last_peered":"2024-05-08T06:44:14.100460+0000","last_clean":"2024-05-08T06:44:14.100460+0000","last_became_active":"2024-05-08T06:41:09.576062+0000","last_became_peered":"2024-05-08T06:41:09.576062+0000","last_unstale":"2024-05-08T06:44:14.100460+0000","last_undegraded":"2024-05-08T06:44:14.100460+0000","last_fullsized":"2024-05-08T06:44:14.100460+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:21.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130273+0000","last_change":"2024-05-08T06:42:16.255227+0000","last_active":"2024-05-08T06:43:17.130273+0000","last_peered":"2024-05-08T06:43:17.130273+0000","last_clean":"2024-05-08T06:43:17.130273+0000","last_became_active":"2024-05-08T06:42:16.253021+0000","last_became_peered":"2024-05-08T06:42:16.253021+0000","last_unstale":"2024-05-08T06:43:17.130273+0000","last_undegraded":"2024-05-08T06:43:17.130273+0000","last_fullsized":"2024-05-08T06:43:17.130273+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:29:41.833171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.873376+0000","last_change":"2024-05-08T06:41:05.506830+0000","last_active":"2024-05-08T06:43:16.873376+0000","last_peered":"2024-05-08T06:43:16.873376+0000","last_clean":"2024-05-08T06:43:16.873376+0000","last_became_active":"2024-05-08T06:41:05.505402+0000","last_became_peered":"2024-05-08T06:41:05.505402+0000","last_unstale":"2024-05-08T06:43:16.873376+0000","last_undegraded":"2024-05-08T06:43:16.873376+0000","last_fullsized":"2024-05-08T06:43:16.873376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:26.804268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099027+0000","last_change":"2024-05-08T06:41:09.586937+0000","last_active":"2024-05-08T06:44:14.099027+0000","last_peered":"2024-05-08T06:44:14.099027+0000","last_clean":"2024-05-08T06:44:14.099027+0000","last_became_active":"2024-05-08T06:41:09.586443+0000","last_became_peered":"2024-05-08T06:41:09.586443+0000","last_unstale":"2024-05-08T06:44:14.099027+0000","last_undegraded":"2024-05-08T06:44:14.099027+0000","last_fullsized":"2024-05-08T06:44:14.099027+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:49.004676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871564+0000","last_change":"2024-05-08T06:42:16.042874+0000","last_active":"2024-05-08T06:43:16.871564+0000","last_peered":"2024-05-08T06:43:16.871564+0000","last_clean":"2024-05-08T06:43:16.871564+0000","last_became_active":"2024-05-08T06:42:16.041424+0000","last_became_peered":"2024-05-08T06:42:16.041424+0000","last_unstale":"2024-05-08T06:43:16.871564+0000","last_undegraded":"2024-05-08T06:43:16.871564+0000","last_fullsized":"2024-05-08T06:43:16.871564+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:47.162238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866349+0000","last_change":"2024-05-08T06:41:06.146631+0000","last_active":"2024-05-08T06:43:16.866349+0000","last_peered":"2024-05-08T06:43:16.866349+0000","last_clean":"2024-05-08T06:43:16.866349+0000","last_became_active":"2024-05-08T06:41:06.145876+0000","last_became_peered":"2024-05-08T06:41:06.145876+0000","last_unstale":"2024-05-08T06:43:16.866349+0000","last_undegraded":"2024-05-08T06:43:16.866349+0000","last_fullsized":"2024-05-08T06:43:16.866349+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:46.283923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":42,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.095261+0000","last_change":"2024-05-08T06:41:09.571084+0000","last_active":"2024-05-08T06:44:14.095261+0000","last_peered":"2024-05-08T06:44:14.095261+0000","last_clean":"2024-05-08T06:44:14.095261+0000","last_became_active":"2024-05-08T06:41:09.570685+0000","last_became_peered":"2024-05-08T06:41:09.570685+0000","last_unstale":"2024-05-08T06:44:14.095261+0000","last_undegraded":"2024-05-08T06:44:14.095261+0000","last_fullsized":"2024-05-08T06:44:14.095261+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:02:21.748502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.956923+0000","last_change":"2024-05-08T06:41:24.667348+0000","last_active":"2024-05-08T06:43:16.956923+0000","last_peered":"2024-05-08T06:43:16.956923+0000","last_clean":"2024-05-08T06:43:16.956923+0000","last_became_active":"2024-05-08T06:41:24.662570+0000","last_became_peered":"2024-05-08T06:41:24.662570+0000","last_unstale":"2024-05-08T06:43:16.956923+0000","last_undegraded":"2024-05-08T06:43:16.956923+0000","last_fullsized":"2024-05-08T06:43:16.956923+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:05.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878557+0000","last_change":"2024-05-08T06:41:05.501884+0000","last_active":"2024-05-08T06:43:16.878557+0000","last_peered":"2024-05-08T06:43:16.878557+0000","last_clean":"2024-05-08T06:43:16.878557+0000","last_became_active":"2024-05-08T06:41:05.498866+0000","last_became_peered":"2024-05-08T06:41:05.498866+0000","last_unstale":"2024-05-08T06:43:16.878557+0000","last_undegraded":"2024-05-08T06:43:16.878557+0000","last_fullsized":"2024-05-08T06:43:16.878557+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:50.560695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.108812+0000","last_change":"2024-05-08T06:41:09.582601+0000","last_active":"2024-05-08T06:44:14.108812+0000","last_peered":"2024-05-08T06:44:14.108812+0000","last_clean":"2024-05-08T06:44:14.108812+0000","last_became_active":"2024-05-08T06:41:09.582205+0000","last_became_peered":"2024-05-08T06:41:09.582205+0000","last_unstale":"2024-05-08T06:44:14.108812+0000","last_undegraded":"2024-05-08T06:44:14.108812+0000","last_fullsized":"2024-05-08T06:44:14.108812+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:29.594001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957603+0000","last_change":"2024-05-08T06:41:24.659339+0000","last_active":"2024-05-08T06:43:16.957603+0000","last_peered":"2024-05-08T06:43:16.957603+0000","last_clean":"2024-05-08T06:43:16.957603+0000","last_became_active":"2024-05-08T06:41:24.658879+0000","last_became_peered":"2024-05-08T06:41:24.658879+0000","last_unstale":"2024-05-08T06:43:16.957603+0000","last_undegraded":"2024-05-08T06:43:16.957603+0000","last_fullsized":"2024-05-08T06:43:16.957603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:59.257118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.091890+0000","last_change":"2024-05-08T06:42:15.850510+0000","last_active":"2024-05-08T06:44:14.091890+0000","last_peered":"2024-05-08T06:44:14.091890+0000","last_clean":"2024-05-08T06:44:14.091890+0000","last_became_active":"2024-05-08T06:42:15.849158+0000","last_became_peered":"2024-05-08T06:42:15.849158+0000","last_unstale":"2024-05-08T06:44:14.091890+0000","last_undegraded":"2024-05-08T06:44:14.091890+0000","last_fullsized":"2024-05-08T06:44:14.091890+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:14.687642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'5","reported_seq":180,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:51.678162+0000","last_change":"2024-05-08T06:41:06.148436+0000","last_active":"2024-05-08T06:44:51.678162+0000","last_peered":"2024-05-08T06:44:51.678162+0000","last_clean":"2024-05-08T06:44:51.678162+0000","last_became_active":"2024-05-08T06:41:06.147690+0000","last_became_peered":"2024-05-08T06:41:06.147690+0000","last_unstale":"2024-05-08T06:44:51.678162+0000","last_undegraded":"2024-05-08T06:44:51.678162+0000","last_fullsized":"2024-05-08T06:44:51.678162+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:49.925872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":130,"num_read_kb":130,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.879305+0000","last_change":"2024-05-08T06:41:24.667958+0000","last_active":"2024-05-08T06:43:16.879305+0000","last_peered":"2024-05-08T06:43:16.879305+0000","last_clean":"2024-05-08T06:43:16.879305+0000","last_became_active":"2024-05-08T06:41:24.666181+0000","last_became_peered":"2024-05-08T06:41:24.666181+0000","last_unstale":"2024-05-08T06:43:16.879305+0000","last_undegraded":"2024-05-08T06:43:16.879305+0000","last_fullsized":"2024-05-08T06:43:16.879305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:08.413670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.104828+0000","last_change":"2024-05-08T06:41:09.581353+0000","last_active":"2024-05-08T06:44:14.104828+0000","last_peered":"2024-05-08T06:44:14.104828+0000","last_clean":"2024-05-08T06:44:14.104828+0000","last_became_active":"2024-05-08T06:41:09.580630+0000","last_became_peered":"2024-05-08T06:41:09.580630+0000","last_unstale":"2024-05-08T06:44:14.104828+0000","last_undegraded":"2024-05-08T06:44:14.104828+0000","last_fullsized":"2024-05-08T06:44:14.104828+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:07.041564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870064+0000","last_change":"2024-05-08T06:41:05.494128+0000","last_active":"2024-05-08T06:43:16.870064+0000","last_peered":"2024-05-08T06:43:16.870064+0000","last_clean":"2024-05-08T06:43:16.870064+0000","last_became_active":"2024-05-08T06:41:05.493473+0000","last_became_peered":"2024-05-08T06:41:05.493473+0000","last_unstale":"2024-05-08T06:43:16.870064+0000","last_undegraded":"2024-05-08T06:43:16.870064+0000","last_fullsized":"2024-05-08T06:43:16.870064+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:01:51.061204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":118,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878231+0000","last_change":"2024-05-08T06:39:12.054195+0000","last_active":"2024-05-08T06:43:16.878231+0000","last_peered":"2024-05-08T06:43:16.878231+0000","last_clean":"2024-05-08T06:43:16.878231+0000","last_became_active":"2024-05-08T06:39:12.045198+0000","last_became_peered":"2024-05-08T06:39:12.045198+0000","last_unstale":"2024-05-08T06:43:16.878231+0000","last_undegraded":"2024-05-08T06:43:16.878231+0000","last_fullsized":"2024-05-08T06:43:16.878231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_clean_scrub_stamp":"2024-05-08T06:34:30.391671+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:32:48.631167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130511+0000","last_change":"2024-05-08T06:41:24.663009+0000","last_active":"2024-05-08T06:43:17.130511+0000","last_peered":"2024-05-08T06:43:17.130511+0000","last_clean":"2024-05-08T06:43:17.130511+0000","last_became_active":"2024-05-08T06:41:24.662552+0000","last_became_peered":"2024-05-08T06:41:24.662552+0000","last_unstale":"2024-05-08T06:43:17.130511+0000","last_undegraded":"2024-05-08T06:43:17.130511+0000","last_fullsized":"2024-05-08T06:43:17.130511+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:57:12.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.088966+0000","last_change":"2024-05-08T06:41:09.576425+0000","last_active":"2024-05-08T06:44:14.088966+0000","last_peered":"2024-05-08T06:44:14.088966+0000","last_clean":"2024-05-08T06:44:14.088966+0000","last_became_active":"2024-05-08T06:41:09.576094+0000","last_became_peered":"2024-05-08T06:41:09.576094+0000","last_unstale":"2024-05-08T06:44:14.088966+0000","last_undegraded":"2024-05-08T06:44:14.088966+0000","last_fullsized":"2024-05-08T06:44:14.088966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:40.682429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.878467+0000","last_change":"2024-05-08T06:41:05.505778+0000","last_active":"2024-05-08T06:43:16.878467+0000","last_peered":"2024-05-08T06:43:16.878467+0000","last_clean":"2024-05-08T06:43:16.878467+0000","last_became_active":"2024-05-08T06:41:05.505400+0000","last_became_peered":"2024-05-08T06:41:05.505400+0000","last_unstale":"2024-05-08T06:43:16.878467+0000","last_undegraded":"2024-05-08T06:43:16.878467+0000","last_fullsized":"2024-05-08T06:43:16.878467+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:11:34.887026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.881396+0000","last_change":"2024-05-08T06:41:24.671768+0000","last_active":"2024-05-08T06:43:16.881396+0000","last_peered":"2024-05-08T06:43:16.881396+0000","last_clean":"2024-05-08T06:43:16.881396+0000","last_became_active":"2024-05-08T06:41:24.671250+0000","last_became_peered":"2024-05-08T06:41:24.671250+0000","last_unstale":"2024-05-08T06:43:16.881396+0000","last_undegraded":"2024-05-08T06:43:16.881396+0000","last_fullsized":"2024-05-08T06:43:16.881396+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:56:44.302049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.872721+0000","last_change":"2024-05-08T06:41:06.151820+0000","last_active":"2024-05-08T06:43:16.872721+0000","last_peered":"2024-05-08T06:43:16.872721+0000","last_clean":"2024-05-08T06:43:16.872721+0000","last_became_active":"2024-05-08T06:41:06.149976+0000","last_became_peered":"2024-05-08T06:41:06.149976+0000","last_unstale":"2024-05-08T06:43:16.872721+0000","last_undegraded":"2024-05-08T06:43:16.872721+0000","last_fullsized":"2024-05-08T06:43:16.872721+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:35:21.233811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.089354+0000","last_change":"2024-05-08T06:41:09.568880+0000","last_active":"2024-05-08T06:44:14.089354+0000","last_peered":"2024-05-08T06:44:14.089354+0000","last_clean":"2024-05-08T06:44:14.089354+0000","last_became_active":"2024-05-08T06:41:09.568507+0000","last_became_peered":"2024-05-08T06:41:09.568507+0000","last_unstale":"2024-05-08T06:44:14.089354+0000","last_undegraded":"2024-05-08T06:44:14.089354+0000","last_fullsized":"2024-05-08T06:44:14.089354+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:01.376121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884628+0000","last_change":"2024-05-08T06:41:24.667472+0000","last_active":"2024-05-08T06:43:16.884628+0000","last_peered":"2024-05-08T06:43:16.884628+0000","last_clean":"2024-05-08T06:43:16.884628+0000","last_became_active":"2024-05-08T06:41:24.664164+0000","last_became_peered":"2024-05-08T06:41:24.664164+0000","last_unstale":"2024-05-08T06:43:16.884628+0000","last_undegraded":"2024-05-08T06:43:16.884628+0000","last_fullsized":"2024-05-08T06:43:16.884628+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:34:25.630742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'11","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.866933+0000","last_change":"2024-05-08T06:41:05.504287+0000","last_active":"2024-05-08T06:43:16.866933+0000","last_peered":"2024-05-08T06:43:16.866933+0000","last_clean":"2024-05-08T06:43:16.866933+0000","last_became_active":"2024-05-08T06:41:05.503825+0000","last_became_peered":"2024-05-08T06:41:05.503825+0000","last_unstale":"2024-05-08T06:43:16.866933+0000","last_undegraded":"2024-05-08T06:43:16.866933+0000","last_fullsized":"2024-05-08T06:43:16.866933+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:50:23.230289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.101325+0000","last_change":"2024-05-08T06:41:09.576996+0000","last_active":"2024-05-08T06:44:14.101325+0000","last_peered":"2024-05-08T06:44:14.101325+0000","last_clean":"2024-05-08T06:44:14.101325+0000","last_became_active":"2024-05-08T06:41:09.572034+0000","last_became_peered":"2024-05-08T06:41:09.572034+0000","last_unstale":"2024-05-08T06:44:14.101325+0000","last_undegraded":"2024-05-08T06:44:14.101325+0000","last_fullsized":"2024-05-08T06:44:14.101325+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:41.690687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.876752+0000","last_change":"2024-05-08T06:41:24.665751+0000","last_active":"2024-05-08T06:43:16.876752+0000","last_peered":"2024-05-08T06:43:16.876752+0000","last_clean":"2024-05-08T06:43:16.876752+0000","last_became_active":"2024-05-08T06:41:24.665306+0000","last_became_peered":"2024-05-08T06:41:24.665306+0000","last_unstale":"2024-05-08T06:43:16.876752+0000","last_undegraded":"2024-05-08T06:43:16.876752+0000","last_fullsized":"2024-05-08T06:43:16.876752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:10.515975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871049+0000","last_change":"2024-05-08T06:41:05.502897+0000","last_active":"2024-05-08T06:43:16.871049+0000","last_peered":"2024-05-08T06:43:16.871049+0000","last_clean":"2024-05-08T06:43:16.871049+0000","last_became_active":"2024-05-08T06:41:05.500636+0000","last_became_peered":"2024-05-08T06:41:05.500636+0000","last_unstale":"2024-05-08T06:43:16.871049+0000","last_undegraded":"2024-05-08T06:43:16.871049+0000","last_fullsized":"2024-05-08T06:43:16.871049+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:02.523706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.103291+0000","last_change":"2024-05-08T06:41:09.586824+0000","last_active":"2024-05-08T06:44:14.103291+0000","last_peered":"2024-05-08T06:44:14.103291+0000","last_clean":"2024-05-08T06:44:14.103291+0000","last_became_active":"2024-05-08T06:41:09.585032+0000","last_became_peered":"2024-05-08T06:41:09.585032+0000","last_unstale":"2024-05-08T06:44:14.103291+0000","last_undegraded":"2024-05-08T06:44:14.103291+0000","last_fullsized":"2024-05-08T06:44:14.103291+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:00:31.890993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870572+0000","last_change":"2024-05-08T06:41:24.670033+0000","last_active":"2024-05-08T06:43:16.870572+0000","last_peered":"2024-05-08T06:43:16.870572+0000","last_clean":"2024-05-08T06:43:16.870572+0000","last_became_active":"2024-05-08T06:41:24.669477+0000","last_became_peered":"2024-05-08T06:41:24.669477+0000","last_unstale":"2024-05-08T06:43:16.870572+0000","last_undegraded":"2024-05-08T06:43:16.870572+0000","last_fullsized":"2024-05-08T06:43:16.870572+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:55.040308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130374+0000","last_change":"2024-05-08T06:41:06.146847+0000","last_active":"2024-05-08T06:43:17.130374+0000","last_peered":"2024-05-08T06:43:17.130374+0000","last_clean":"2024-05-08T06:43:17.130374+0000","last_became_active":"2024-05-08T06:41:06.146141+0000","last_became_peered":"2024-05-08T06:41:06.146141+0000","last_unstale":"2024-05-08T06:43:17.130374+0000","last_undegraded":"2024-05-08T06:43:17.130374+0000","last_fullsized":"2024-05-08T06:43:17.130374+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:45:30.924860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.043803+0000","last_change":"2024-05-08T06:41:09.578067+0000","last_active":"2024-05-08T06:44:14.043803+0000","last_peered":"2024-05-08T06:44:14.043803+0000","last_clean":"2024-05-08T06:44:14.043803+0000","last_became_active":"2024-05-08T06:41:09.577650+0000","last_became_peered":"2024-05-08T06:41:09.577650+0000","last_unstale":"2024-05-08T06:44:14.043803+0000","last_undegraded":"2024-05-08T06:44:14.043803+0000","last_fullsized":"2024-05-08T06:44:14.043803+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:09.285601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.867221+0000","last_change":"2024-05-08T06:41:24.669791+0000","last_active":"2024-05-08T06:43:16.867221+0000","last_peered":"2024-05-08T06:43:16.867221+0000","last_clean":"2024-05-08T06:43:16.867221+0000","last_became_active":"2024-05-08T06:41:24.669363+0000","last_became_peered":"2024-05-08T06:41:24.669363+0000","last_unstale":"2024-05-08T06:43:16.867221+0000","last_undegraded":"2024-05-08T06:43:16.867221+0000","last_fullsized":"2024-05-08T06:43:16.867221+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:08.522339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.884734+0000","last_change":"2024-05-08T06:41:05.486456+0000","last_active":"2024-05-08T06:43:16.884734+0000","last_peered":"2024-05-08T06:43:16.884734+0000","last_clean":"2024-05-08T06:43:16.884734+0000","last_became_active":"2024-05-08T06:41:05.485878+0000","last_became_peered":"2024-05-08T06:41:05.485878+0000","last_unstale":"2024-05-08T06:43:16.884734+0000","last_undegraded":"2024-05-08T06:43:16.884734+0000","last_fullsized":"2024-05-08T06:43:16.884734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:11:47.985329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.102138+0000","last_change":"2024-05-08T06:41:09.573940+0000","last_active":"2024-05-08T06:44:14.102138+0000","last_peered":"2024-05-08T06:44:14.102138+0000","last_clean":"2024-05-08T06:44:14.102138+0000","last_became_active":"2024-05-08T06:41:09.573515+0000","last_became_peered":"2024-05-08T06:41:09.573515+0000","last_unstale":"2024-05-08T06:44:14.102138+0000","last_undegraded":"2024-05-08T06:44:14.102138+0000","last_fullsized":"2024-05-08T06:44:14.102138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:44.803013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":30,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.871281+0000","last_change":"2024-05-08T06:41:24.663008+0000","last_active":"2024-05-08T06:43:16.871281+0000","last_peered":"2024-05-08T06:43:16.871281+0000","last_clean":"2024-05-08T06:43:16.871281+0000","last_became_active":"2024-05-08T06:41:24.661934+0000","last_became_peered":"2024-05-08T06:41:24.661934+0000","last_unstale":"2024-05-08T06:43:16.871281+0000","last_undegraded":"2024-05-08T06:43:16.871281+0000","last_fullsized":"2024-05-08T06:43:16.871281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:08.719125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"90'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.894395+0000","last_change":"2024-05-08T06:43:16.894395+0000","last_active":"2024-05-08T06:43:16.894395+0000","last_peered":"2024-05-08T06:43:16.894395+0000","last_clean":"2024-05-08T06:43:16.894395+0000","last_became_active":"2024-05-08T06:43:16.886763+0000","last_became_peered":"2024-05-08T06:43:16.886763+0000","last_unstale":"2024-05-08T06:43:16.894395+0000","last_undegraded":"2024-05-08T06:43:16.894395+0000","last_fullsized":"2024-05-08T06:43:16.894395+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:52.278223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107892+0000","last_change":"2024-05-08T06:41:09.573388+0000","last_active":"2024-05-08T06:44:14.107892+0000","last_peered":"2024-05-08T06:44:14.107892+0000","last_clean":"2024-05-08T06:44:14.107892+0000","last_became_active":"2024-05-08T06:41:09.572901+0000","last_became_peered":"2024-05-08T06:41:09.572901+0000","last_unstale":"2024-05-08T06:44:14.107892+0000","last_undegraded":"2024-05-08T06:44:14.107892+0000","last_fullsized":"2024-05-08T06:44:14.107892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:38:45.123194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.870607+0000","last_change":"2024-05-08T06:41:24.659817+0000","last_active":"2024-05-08T06:43:16.870607+0000","last_peered":"2024-05-08T06:43:16.870607+0000","last_clean":"2024-05-08T06:43:16.870607+0000","last_became_active":"2024-05-08T06:41:24.659276+0000","last_became_peered":"2024-05-08T06:41:24.659276+0000","last_unstale":"2024-05-08T06:43:16.870607+0000","last_undegraded":"2024-05-08T06:43:16.870607+0000","last_fullsized":"2024-05-08T06:43:16.870607+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:01.635454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.905524+0000","last_change":"2024-05-08T06:43:16.905524+0000","last_active":"2024-05-08T06:43:16.905524+0000","last_peered":"2024-05-08T06:43:16.905524+0000","last_clean":"2024-05-08T06:43:16.905524+0000","last_became_active":"2024-05-08T06:43:16.888087+0000","last_became_peered":"2024-05-08T06:43:16.888087+0000","last_unstale":"2024-05-08T06:43:16.905524+0000","last_undegraded":"2024-05-08T06:43:16.905524+0000","last_fullsized":"2024-05-08T06:43:16.905524+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:52.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.112237+0000","last_change":"2024-05-08T06:41:09.574238+0000","last_active":"2024-05-08T06:44:14.112237+0000","last_peered":"2024-05-08T06:44:14.112237+0000","last_clean":"2024-05-08T06:44:14.112237+0000","last_became_active":"2024-05-08T06:41:09.570019+0000","last_became_peered":"2024-05-08T06:41:09.570019+0000","last_unstale":"2024-05-08T06:44:14.112237+0000","last_undegraded":"2024-05-08T06:44:14.112237+0000","last_fullsized":"2024-05-08T06:44:14.112237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:56.980400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130987+0000","last_change":"2024-05-08T06:41:24.659955+0000","last_active":"2024-05-08T06:43:17.130987+0000","last_peered":"2024-05-08T06:43:17.130987+0000","last_clean":"2024-05-08T06:43:17.130987+0000","last_became_active":"2024-05-08T06:41:24.659534+0000","last_became_peered":"2024-05-08T06:41:24.659534+0000","last_unstale":"2024-05-08T06:43:17.130987+0000","last_undegraded":"2024-05-08T06:43:17.130987+0000","last_fullsized":"2024-05-08T06:43:17.130987+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:41.893917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.898447+0000","last_change":"2024-05-08T06:43:16.897225+0000","last_active":"2024-05-08T06:43:16.898447+0000","last_peered":"2024-05-08T06:43:16.898447+0000","last_clean":"2024-05-08T06:43:16.898447+0000","last_became_active":"2024-05-08T06:43:16.883954+0000","last_became_peered":"2024-05-08T06:43:16.883954+0000","last_unstale":"2024-05-08T06:43:16.898447+0000","last_undegraded":"2024-05-08T06:43:16.898447+0000","last_fullsized":"2024-05-08T06:43:16.898447+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:12.014514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.112070+0000","last_change":"2024-05-08T06:41:09.574159+0000","last_active":"2024-05-08T06:44:14.112070+0000","last_peered":"2024-05-08T06:44:14.112070+0000","last_clean":"2024-05-08T06:44:14.112070+0000","last_became_active":"2024-05-08T06:41:09.573734+0000","last_became_peered":"2024-05-08T06:41:09.573734+0000","last_unstale":"2024-05-08T06:44:14.112070+0000","last_undegraded":"2024-05-08T06:44:14.112070+0000","last_fullsized":"2024-05-08T06:44:14.112070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:22.157071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.874626+0000","last_change":"2024-05-08T06:41:24.668545+0000","last_active":"2024-05-08T06:43:16.874626+0000","last_peered":"2024-05-08T06:43:16.874626+0000","last_clean":"2024-05-08T06:43:16.874626+0000","last_became_active":"2024-05-08T06:41:24.668086+0000","last_became_peered":"2024-05-08T06:41:24.668086+0000","last_unstale":"2024-05-08T06:43:16.874626+0000","last_undegraded":"2024-05-08T06:43:16.874626+0000","last_fullsized":"2024-05-08T06:43:16.874626+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:08:02.473733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.130284+0000","last_change":"2024-05-08T06:41:05.501332+0000","last_active":"2024-05-08T06:43:17.130284+0000","last_peered":"2024-05-08T06:43:17.130284+0000","last_clean":"2024-05-08T06:43:17.130284+0000","last_became_active":"2024-05-08T06:41:05.499174+0000","last_became_peered":"2024-05-08T06:41:05.499174+0000","last_unstale":"2024-05-08T06:43:17.130284+0000","last_undegraded":"2024-05-08T06:43:17.130284+0000","last_fullsized":"2024-05-08T06:43:17.130284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:49.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099501+0000","last_change":"2024-05-08T06:41:09.572927+0000","last_active":"2024-05-08T06:44:14.099501+0000","last_peered":"2024-05-08T06:44:14.099501+0000","last_clean":"2024-05-08T06:44:14.099501+0000","last_became_active":"2024-05-08T06:41:09.572502+0000","last_became_peered":"2024-05-08T06:41:09.572502+0000","last_unstale":"2024-05-08T06:44:14.099501+0000","last_undegraded":"2024-05-08T06:44:14.099501+0000","last_fullsized":"2024-05-08T06:44:14.099501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:03.838892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:17.129121+0000","last_change":"2024-05-08T06:41:24.667561+0000","last_active":"2024-05-08T06:43:17.129121+0000","last_peered":"2024-05-08T06:43:17.129121+0000","last_clean":"2024-05-08T06:43:17.129121+0000","last_became_active":"2024-05-08T06:41:24.666904+0000","last_became_peered":"2024-05-08T06:41:24.666904+0000","last_unstale":"2024-05-08T06:43:17.129121+0000","last_undegraded":"2024-05-08T06:43:17.129121+0000","last_fullsized":"2024-05-08T06:43:17.129121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:15.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:43:16.957758+0000","last_change":"2024-05-08T06:41:05.497117+0000","last_active":"2024-05-08T06:43:16.957758+0000","last_peered":"2024-05-08T06:43:16.957758+0000","last_clean":"2024-05-08T06:43:16.957758+0000","last_became_active":"2024-05-08T06:41:05.496621+0000","last_became_peered":"2024-05-08T06:41:05.496621+0000","last_unstale":"2024-05-08T06:43:16.957758+0000","last_undegraded":"2024-05-08T06:43:16.957758+0000","last_fullsized":"2024-05-08T06:43:16.957758+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:06:32.603973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.103601+0000","last_change":"2024-05-08T06:41:09.572489+0000","last_active":"2024-05-08T06:44:14.103601+0000","last_peered":"2024-05-08T06:44:14.103601+0000","last_clean":"2024-05-08T06:44:14.103601+0000","last_became_active":"2024-05-08T06:41:09.572129+0000","last_became_peered":"2024-05-08T06:41:09.572129+0000","last_unstale":"2024-05-08T06:44:14.103601+0000","last_undegraded":"2024-05-08T06:44:14.103601+0000","last_fullsized":"2024-05-08T06:44:14.103601+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:18:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.099891+0000","last_change":"2024-05-08T06:41:09.577872+0000","last_active":"2024-05-08T06:44:14.099891+0000","last_peered":"2024-05-08T06:44:14.099891+0000","last_clean":"2024-05-08T06:44:14.099891+0000","last_became_active":"2024-05-08T06:41:09.577490+0000","last_became_peered":"2024-05-08T06:41:09.577490+0000","last_unstale":"2024-05-08T06:44:14.099891+0000","last_undegraded":"2024-05-08T06:44:14.099891+0000","last_fullsized":"2024-05-08T06:44:14.099891+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:12:44.956055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.096855+0000","last_change":"2024-05-08T06:42:15.861046+0000","last_active":"2024-05-08T06:44:14.096855+0000","last_peered":"2024-05-08T06:44:14.096855+0000","last_clean":"2024-05-08T06:44:14.096855+0000","last_became_active":"2024-05-08T06:42:15.860267+0000","last_became_peered":"2024-05-08T06:42:15.860267+0000","last_unstale":"2024-05-08T06:44:14.096855+0000","last_undegraded":"2024-05-08T06:44:14.096855+0000","last_fullsized":"2024-05-08T06:44:14.096855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:15:01.541268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.092742+0000","last_change":"2024-05-08T06:41:09.578005+0000","last_active":"2024-05-08T06:44:14.092742+0000","last_peered":"2024-05-08T06:44:14.092742+0000","last_clean":"2024-05-08T06:44:14.092742+0000","last_became_active":"2024-05-08T06:41:09.577571+0000","last_became_peered":"2024-05-08T06:41:09.577571+0000","last_unstale":"2024-05-08T06:44:14.092742+0000","last_undegraded":"2024-05-08T06:44:14.092742+0000","last_fullsized":"2024-05-08T06:44:14.092742+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:22.762195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":45,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.102376+0000","last_change":"2024-05-08T06:41:09.579520+0000","last_active":"2024-05-08T06:44:14.102376+0000","last_peered":"2024-05-08T06:44:14.102376+0000","last_clean":"2024-05-08T06:44:14.102376+0000","last_became_active":"2024-05-08T06:41:09.579085+0000","last_became_peered":"2024-05-08T06:41:09.579085+0000","last_unstale":"2024-05-08T06:44:14.102376+0000","last_undegraded":"2024-05-08T06:44:14.102376+0000","last_fullsized":"2024-05-08T06:44:14.102376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:02:25.199102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":43,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107682+0000","last_change":"2024-05-08T06:41:09.588352+0000","last_active":"2024-05-08T06:44:14.107682+0000","last_peered":"2024-05-08T06:44:14.107682+0000","last_clean":"2024-05-08T06:44:14.107682+0000","last_became_active":"2024-05-08T06:41:09.587981+0000","last_became_peered":"2024-05-08T06:41:09.587981+0000","last_unstale":"2024-05-08T06:44:14.107682+0000","last_undegraded":"2024-05-08T06:44:14.107682+0000","last_fullsized":"2024-05-08T06:44:14.107682+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:55.275569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.098523+0000","last_change":"2024-05-08T06:41:09.584216+0000","last_active":"2024-05-08T06:44:14.098523+0000","last_peered":"2024-05-08T06:44:14.098523+0000","last_clean":"2024-05-08T06:44:14.098523+0000","last_became_active":"2024-05-08T06:41:09.583789+0000","last_became_peered":"2024-05-08T06:41:09.583789+0000","last_unstale":"2024-05-08T06:44:14.098523+0000","last_undegraded":"2024-05-08T06:44:14.098523+0000","last_fullsized":"2024-05-08T06:44:14.098523+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:33:04.153098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.100400+0000","last_change":"2024-05-08T06:41:09.573622+0000","last_active":"2024-05-08T06:44:14.100400+0000","last_peered":"2024-05-08T06:44:14.100400+0000","last_clean":"2024-05-08T06:44:14.100400+0000","last_became_active":"2024-05-08T06:41:09.573116+0000","last_became_peered":"2024-05-08T06:41:09.573116+0000","last_unstale":"2024-05-08T06:44:14.100400+0000","last_undegraded":"2024-05-08T06:44:14.100400+0000","last_fullsized":"2024-05-08T06:44:14.100400+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:58:03.031899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":40,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.081583+0000","last_change":"2024-05-08T06:41:09.588787+0000","last_active":"2024-05-08T06:44:14.081583+0000","last_peered":"2024-05-08T06:44:14.081583+0000","last_clean":"2024-05-08T06:44:14.081583+0000","last_became_active":"2024-05-08T06:41:09.588430+0000","last_became_peered":"2024-05-08T06:41:09.588430+0000","last_unstale":"2024-05-08T06:44:14.081583+0000","last_undegraded":"2024-05-08T06:44:14.081583+0000","last_fullsized":"2024-05-08T06:44:14.081583+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:36:26.689419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.095156+0000","last_change":"2024-05-08T06:41:09.575057+0000","last_active":"2024-05-08T06:44:14.095156+0000","last_peered":"2024-05-08T06:44:14.095156+0000","last_clean":"2024-05-08T06:44:14.095156+0000","last_became_active":"2024-05-08T06:41:09.572522+0000","last_became_peered":"2024-05-08T06:41:09.572522+0000","last_unstale":"2024-05-08T06:44:14.095156+0000","last_undegraded":"2024-05-08T06:44:14.095156+0000","last_fullsized":"2024-05-08T06:44:14.095156+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:40:26.702841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.096644+0000","last_change":"2024-05-08T06:41:09.578184+0000","last_active":"2024-05-08T06:44:14.096644+0000","last_peered":"2024-05-08T06:44:14.096644+0000","last_clean":"2024-05-08T06:44:14.096644+0000","last_became_active":"2024-05-08T06:41:09.577796+0000","last_became_peered":"2024-05-08T06:41:09.577796+0000","last_unstale":"2024-05-08T06:44:14.096644+0000","last_undegraded":"2024-05-08T06:44:14.096644+0000","last_fullsized":"2024-05-08T06:44:14.096644+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:40.822805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.111399+0000","last_change":"2024-05-08T06:41:09.577050+0000","last_active":"2024-05-08T06:44:14.111399+0000","last_peered":"2024-05-08T06:44:14.111399+0000","last_clean":"2024-05-08T06:44:14.111399+0000","last_became_active":"2024-05-08T06:41:09.576449+0000","last_became_peered":"2024-05-08T06:41:09.576449+0000","last_unstale":"2024-05-08T06:44:14.111399+0000","last_undegraded":"2024-05-08T06:44:14.111399+0000","last_fullsized":"2024-05-08T06:44:14.111399+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:04:42.819087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.107830+0000","last_change":"2024-05-08T06:41:09.580830+0000","last_active":"2024-05-08T06:44:14.107830+0000","last_peered":"2024-05-08T06:44:14.107830+0000","last_clean":"2024-05-08T06:44:14.107830+0000","last_became_active":"2024-05-08T06:41:09.577457+0000","last_became_peered":"2024-05-08T06:41:09.577457+0000","last_unstale":"2024-05-08T06:44:14.107830+0000","last_undegraded":"2024-05-08T06:44:14.107830+0000","last_fullsized":"2024-05-08T06:44:14.107830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:02.932857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-08T06:44:14.097017+0000","last_change":"2024-05-08T06:41:09.586919+0000","last_active":"2024-05-08T06:44:14.097017+0000","last_peered":"2024-05-08T06:44:14.097017+0000","last_clean":"2024-05-08T06:44:14.097017+0000","last_became_active":"2024-05-08T06:41:09.586560+0000","last_became_peered":"2024-05-08T06:41:09.586560+0000","last_unstale":"2024-05-08T06:44:14.097017+0000","last_undegraded":"2024-05-08T06:44:14.097017+0000","last_fullsized":"2024-05-08T06:44:14.097017+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:00.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":72621,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":797,"num_read_kb":473,"num_write":175,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":217863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612672,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1056768,"data_stored":528202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808902,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32888,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712264,"statfs":{"total":95995035648,"available":95961358336,"internally_reserved":0,"allocated":1753088,"data_stored":1184481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972431,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1077248,"data_stored":532534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168661,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":528358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364893,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1667072,"data_stored":1124408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561125,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1052672,"data_stored":523614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28116,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717036,"statfs":{"total":95995035648,"available":95966244864,"internally_reserved":0,"allocated":1126400,"data_stored":592003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738507,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1077248,"data_stored":525002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1146880,"data_stored":592771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149816,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":523808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953587,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":529378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757356,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36972,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708180,"statfs":{"total":95995035648,"available":95957176320,"internally_reserved":0,"allocated":1675264,"data_stored":1119464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":68479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T06:44:56.127 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-08T06:44:56.127 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T06:44:56.127 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-08T06:44:56.128 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-08T06:44:56.587 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:44:56.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:56 smithi070 ceph-mon[29591]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:44:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:56 smithi172 ceph-mon[33377]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:44:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:56 smithi194 ceph-mon[33679]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:44:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:57 smithi070 ceph-mon[29591]: pgmap v493: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:44:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:57 smithi172 ceph-mon[33377]: pgmap v493: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:44:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:57 smithi194 ceph-mon[33679]: pgmap v493: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.909+0000 7fabb1c00700 1 -- 172.21.15.70:0/4278955206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac109ad0 msgr2=0x7fabac109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.909+0000 7fabb1c00700 1 --2- 172.21.15.70:0/4278955206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac109ad0 0x7fabac109f50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fab94009990 tx=0x7fab94009ca0 comp rx=0 tx=0).stop 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.909+0000 7fabb1c00700 1 -- 172.21.15.70:0/4278955206 shutdown_connections 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.909+0000 7fabb1c00700 1 --2- 172.21.15.70:0/4278955206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabac10a490 0x7fabac1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.909+0000 7fabb1c00700 1 --2- 172.21.15.70:0/4278955206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac10fb60 0x7fabac10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.909+0000 7fabb1c00700 1 --2- 172.21.15.70:0/4278955206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac109ad0 0x7fabac109f50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.909+0000 7fabb1c00700 1 -- 172.21.15.70:0/4278955206 >> 172.21.15.70:0/4278955206 conn(0x7fabac076c70 msgr2=0x7fabac1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.909+0000 7fabb1c00700 1 -- 172.21.15.70:0/4278955206 shutdown_connections 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.909+0000 7fabb1c00700 1 -- 172.21.15.70:0/4278955206 wait complete. 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.910+0000 7fabb1c00700 1 Processor -- start 2024-05-08T06:44:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.911+0000 7fabb1c00700 1 -- start start 2024-05-08T06:44:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.911+0000 7fabb1c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac109ad0 0x7fabac1a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.911+0000 7fabb1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac10a490 0x7fabac1a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.911+0000 7fabb1c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabac10fb60 0x7fabac1a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.911+0000 7fabb1c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fabac119bd0 con 0x7fabac10a490 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.911+0000 7fabb1c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fabac119a50 con 0x7fabac109ad0 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.911+0000 7fabb1c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fabac119d50 con 0x7fabac10fb60 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.911+0000 7faba3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac10a490 0x7fabac1a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.911+0000 7faba3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac10a490 0x7fabac1a05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36356/0 (socket says 172.21.15.70:36356) 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.912+0000 7faba3e00700 1 -- 172.21.15.70:0/2239615416 learned_addr learned my addr 172.21.15.70:0/2239615416 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.912+0000 7fabaaa00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac109ad0 0x7fabac1a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.912+0000 7fabab400700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabac10fb60 0x7fabac1a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.912+0000 7faba3e00700 1 -- 172.21.15.70:0/2239615416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabac10fb60 msgr2=0x7fabac1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.912+0000 7faba3e00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabac10fb60 0x7fabac1a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.912+0000 7faba3e00700 1 -- 172.21.15.70:0/2239615416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac109ad0 msgr2=0x7fabac1a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.912+0000 7faba3e00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac109ad0 0x7fabac1a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.912+0000 7faba3e00700 1 -- 172.21.15.70:0/2239615416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabac1a5070 con 0x7fabac10a490 2024-05-08T06:44:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.912+0000 7faba3e00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac10a490 0x7fabac1a05a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fab94000c00 tx=0x7fab940057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.913+0000 7faba3400700 1 -- 172.21.15.70:0/2239615416 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94027070 con 0x7fabac10a490 2024-05-08T06:44:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.913+0000 7faba3400700 1 -- 172.21.15.70:0/2239615416 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab9400fc00 con 0x7fabac10a490 2024-05-08T06:44:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.913+0000 7faba3400700 1 -- 172.21.15.70:0/2239615416 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94022ca0 con 0x7fabac10a490 2024-05-08T06:44:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.913+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabac1a5300 con 0x7fabac10a490 2024-05-08T06:44:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.913+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabac1acbe0 con 0x7fabac10a490 2024-05-08T06:44:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.914+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabac06a190 con 0x7fabac10a490 2024-05-08T06:44:58.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.916+0000 7faba3400700 1 -- 172.21.15.70:0/2239615416 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fab9402a070 con 0x7fabac10a490 2024-05-08T06:44:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.918+0000 7faba3400700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab900b2900 0x7fab900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:44:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.918+0000 7faba3400700 1 -- 172.21.15.70:0/2239615416 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fab940e36e0 con 0x7fabac10a490 2024-05-08T06:44:58.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.918+0000 7fabaaa00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab900b2900 0x7fab900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:44:58.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.919+0000 7fabaaa00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab900b2900 0x7fab900b4dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00abd0 tx=0x7fab9c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:44:58.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:58.920+0000 7faba3400700 1 -- 172.21.15.70:0/2239615416 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fab94031080 con 0x7fabac10a490 2024-05-08T06:44:59.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.205+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fabac1a13c0 con 0x7fabac10a490 2024-05-08T06:44:59.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.206+0000 7faba3400700 1 -- 172.21.15.70:0/2239615416 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fab94013070 con 0x7fabac10a490 2024-05-08T06:44:59.206 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:44:59.206 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T06:44:59.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab900b2900 msgr2=0x7fab900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:59.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab900b2900 0x7fab900b4dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00abd0 tx=0x7fab9c00a380 comp rx=0 tx=0).stop 2024-05-08T06:44:59.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac10a490 msgr2=0x7fabac1a05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:44:59.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac10a490 0x7fabac1a05a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fab94000c00 tx=0x7fab940057c0 comp rx=0 tx=0).stop 2024-05-08T06:44:59.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 shutdown_connections 2024-05-08T06:44:59.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabac10fb60 0x7fabac1a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:59.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabac109ad0 0x7fabac1a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fab900b2900 0x7fab900b4dc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 --2- 172.21.15.70:0/2239615416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabac10a490 0x7fabac1a05a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:44:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.209+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 >> 172.21.15.70:0/2239615416 conn(0x7fabac076c70 msgr2=0x7fabac077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:44:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.210+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 shutdown_connections 2024-05-08T06:44:59.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:44:59.210+0000 7fabb1c00700 1 -- 172.21.15.70:0/2239615416 wait complete. 2024-05-08T06:44:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:59 smithi070 ceph-mon[29591]: pgmap v494: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:44:59 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2239615416' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T06:44:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:59 smithi172 ceph-mon[33377]: pgmap v494: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:44:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:44:59 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2239615416' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T06:45:00.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:59 smithi194 ceph-mon[33679]: pgmap v494: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:00.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:44:59 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2239615416' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T06:45:00.091 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-08T06:45:00.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:45:00.543 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:01 smithi070 ceph-mon[29591]: pgmap v495: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:01.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:01 smithi172 ceph-mon[33377]: pgmap v495: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:02.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:01 smithi194 ceph-mon[33679]: pgmap v495: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.030+0000 7fa384a00700 1 -- 172.21.15.70:0/3407667981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 msgr2=0x7fa380075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.030+0000 7fa384a00700 1 --2- 172.21.15.70:0/3407667981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 0x7fa380075ab0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa37000b0a0 tx=0x7fa37000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.031+0000 7fa384a00700 1 -- 172.21.15.70:0/3407667981 shutdown_connections 2024-05-08T06:45:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.031+0000 7fa384a00700 1 --2- 172.21.15.70:0/3407667981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa380114670 0x7fa380116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.031+0000 7fa384a00700 1 --2- 172.21.15.70:0/3407667981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 0x7fa380075ab0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.031+0000 7fa384a00700 1 --2- 172.21.15.70:0/3407667981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa380075ff0 0x7fa380114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.031+0000 7fa384a00700 1 -- 172.21.15.70:0/3407667981 >> 172.21.15.70:0/3407667981 conn(0x7fa38007a600 msgr2=0x7fa38007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.031+0000 7fa384a00700 1 -- 172.21.15.70:0/3407667981 shutdown_connections 2024-05-08T06:45:03.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.031+0000 7fa384a00700 1 -- 172.21.15.70:0/3407667981 wait complete. 2024-05-08T06:45:03.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.032+0000 7fa384a00700 1 Processor -- start 2024-05-08T06:45:03.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.032+0000 7fa384a00700 1 -- start start 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.032+0000 7fa384a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 0x7fa3801a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.032+0000 7fa384a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa380075ff0 0x7fa3801a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.032+0000 7fa384a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa380114670 0x7fa3801a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.032+0000 7fa384a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa380119b70 con 0x7fa3800756d0 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.032+0000 7fa384a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3801199f0 con 0x7fa380075ff0 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.032+0000 7fa384a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa380119cf0 con 0x7fa380114670 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 0x7fa3801a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 0x7fa3801a0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36376/0 (socket says 172.21.15.70:36376) 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37de00700 1 -- 172.21.15.70:0/2589849653 learned_addr learned my addr 172.21.15.70:0/2589849653 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37e800700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa380114670 0x7fa3801a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37d400700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa380075ff0 0x7fa3801a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37de00700 1 -- 172.21.15.70:0/2589849653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa380114670 msgr2=0x7fa3801a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:03.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37de00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa380114670 0x7fa3801a4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37de00700 1 -- 172.21.15.70:0/2589849653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa380075ff0 msgr2=0x7fa3801a06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:03.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37de00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa380075ff0 0x7fa3801a06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.033+0000 7fa37de00700 1 -- 172.21.15.70:0/2589849653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3801a5190 con 0x7fa3800756d0 2024-05-08T06:45:03.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.034+0000 7fa37de00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 0x7fa3801a0180 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa37000b070 tx=0x7fa370004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:03.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.034+0000 7fa376a00700 1 -- 172.21.15.70:0/2589849653 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370021070 con 0x7fa3800756d0 2024-05-08T06:45:03.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.034+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3801a5420 con 0x7fa3800756d0 2024-05-08T06:45:03.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.034+0000 7fa376a00700 1 -- 172.21.15.70:0/2589849653 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa370007c80 con 0x7fa3800756d0 2024-05-08T06:45:03.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.034+0000 7fa376a00700 1 -- 172.21.15.70:0/2589849653 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3700047d0 con 0x7fa3800756d0 2024-05-08T06:45:03.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.034+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3801acd00 con 0x7fa3800756d0 2024-05-08T06:45:03.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.035+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38006a190 con 0x7fa3800756d0 2024-05-08T06:45:03.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.037+0000 7fa376a00700 1 -- 172.21.15.70:0/2589849653 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa370003a00 con 0x7fa3800756d0 2024-05-08T06:45:03.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.039+0000 7fa376a00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa3640b2900 0x7fa3640b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:03.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.039+0000 7fa376a00700 1 -- 172.21.15.70:0/2589849653 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fa37000f020 con 0x7fa3800756d0 2024-05-08T06:45:03.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.039+0000 7fa37d400700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa3640b2900 0x7fa3640b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:03.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.040+0000 7fa37d400700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa3640b2900 0x7fa3640b4dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa36c005950 tx=0x7fa36c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:03.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.042+0000 7fa376a00700 1 -- 172.21.15.70:0/2589849653 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa37002a020 con 0x7fa3800756d0 2024-05-08T06:45:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.336+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3801aced0 con 0x7fa3800756d0 2024-05-08T06:45:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.337+0000 7fa376a00700 1 -- 172.21.15.70:0/2589849653 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11876 (secure 0 0 0) 0x7fa3700ab980 con 0x7fa3800756d0 2024-05-08T06:45:03.337 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:45:03.337 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:42:47.248168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:45:03.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa3640b2900 msgr2=0x7fa3640b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:03.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa3640b2900 0x7fa3640b4dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa36c005950 tx=0x7fa36c0058e0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 msgr2=0x7fa3801a0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:03.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 0x7fa3801a0180 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa37000b070 tx=0x7fa370004e00 comp rx=0 tx=0).stop 2024-05-08T06:45:03.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 shutdown_connections 2024-05-08T06:45:03.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa380114670 0x7fa3801a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa3640b2900 0x7fa3640b4dc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3800756d0 0x7fa3801a0180 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 --2- 172.21.15.70:0/2589849653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa380075ff0 0x7fa3801a06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:03.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 >> 172.21.15.70:0/2589849653 conn(0x7fa38007a600 msgr2=0x7fa380111500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:03.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 shutdown_connections 2024-05-08T06:45:03.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:03.340+0000 7fa384a00700 1 -- 172.21.15.70:0/2589849653 wait complete. 2024-05-08T06:45:03.341 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 26 2024-05-08T06:45:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:03 smithi070 ceph-mon[29591]: pgmap v496: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:03 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2589849653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:45:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:03 smithi172 ceph-mon[33377]: pgmap v496: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:03 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2589849653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:45:04.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:03 smithi194 ceph-mon[33679]: pgmap v496: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:04.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:03 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2589849653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:45:04.348 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:45:04.799 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:05.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:05 smithi070 ceph-mon[29591]: pgmap v497: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:05 smithi172 ceph-mon[33377]: pgmap v497: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:06.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:05 smithi194 ceph-mon[33679]: pgmap v497: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.095+0000 7f481b800700 1 -- 172.21.15.70:0/3315235651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4814075ff0 msgr2=0x7f481410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.095+0000 7f481b800700 1 --2- 172.21.15.70:0/3315235651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4814075ff0 0x7f481410f960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009990 tx=0x7f47fc009ca0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.095+0000 7f481b800700 1 -- 172.21.15.70:0/3315235651 shutdown_connections 2024-05-08T06:45:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.095+0000 7f481b800700 1 --2- 172.21.15.70:0/3315235651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f481410fea0 0x7f4814112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.095+0000 7f481b800700 1 --2- 172.21.15.70:0/3315235651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48140756d0 0x7f4814075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.095+0000 7f481b800700 1 --2- 172.21.15.70:0/3315235651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4814075ff0 0x7f481410f960 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.095+0000 7f481b800700 1 -- 172.21.15.70:0/3315235651 >> 172.21.15.70:0/3315235651 conn(0x7f481407a600 msgr2=0x7f481407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.096+0000 7f481b800700 1 -- 172.21.15.70:0/3315235651 shutdown_connections 2024-05-08T06:45:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.096+0000 7f481b800700 1 -- 172.21.15.70:0/3315235651 wait complete. 2024-05-08T06:45:07.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.097+0000 7f481b800700 1 Processor -- start 2024-05-08T06:45:07.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.097+0000 7f481b800700 1 -- start start 2024-05-08T06:45:07.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f481b800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48140756d0 0x7f481419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:07.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f481b800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814075ff0 0x7f481419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:07.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f481b800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f481410fea0 0x7f48141a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:07.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f481b800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48141157c0 con 0x7f48140756d0 2024-05-08T06:45:07.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f481b800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4814115640 con 0x7f4814075ff0 2024-05-08T06:45:07.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f481b800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4814115940 con 0x7f481410fea0 2024-05-08T06:45:07.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f4818e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48140756d0 0x7f481419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:07.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f4818e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48140756d0 0x7f481419bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36392/0 (socket says 172.21.15.70:36392) 2024-05-08T06:45:07.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f4818e00700 1 -- 172.21.15.70:0/1439377777 learned_addr learned my addr 172.21.15.70:0/1439377777 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:07.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f480be00700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814075ff0 0x7f481419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:07.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.098+0000 7f4819800700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f481410fea0 0x7f48141a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f4818e00700 1 -- 172.21.15.70:0/1439377777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f481410fea0 msgr2=0x7f48141a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f4818e00700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f481410fea0 0x7f48141a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f4818e00700 1 -- 172.21.15.70:0/1439377777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814075ff0 msgr2=0x7f481419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f4818e00700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814075ff0 0x7f481419c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f4818e00700 1 -- 172.21.15.70:0/1439377777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48141a0d40 con 0x7f48140756d0 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f4818e00700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48140756d0 0x7f481419bd30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f480400c970 tx=0x7f480400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f4812000700 1 -- 172.21.15.70:0/1439377777 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804007aa0 con 0x7f48140756d0 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f4812000700 1 -- 172.21.15.70:0/1439377777 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4804004cc0 con 0x7f48140756d0 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f4812000700 1 -- 172.21.15.70:0/1439377777 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804005560 con 0x7f48140756d0 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48141a1030 con 0x7f48140756d0 2024-05-08T06:45:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.099+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48141a88b0 con 0x7f48140756d0 2024-05-08T06:45:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.101+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f481406a190 con 0x7f48140756d0 2024-05-08T06:45:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.103+0000 7f4812000700 1 -- 172.21.15.70:0/1439377777 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4804007cd0 con 0x7f48140756d0 2024-05-08T06:45:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.104+0000 7f4812000700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47f80b2900 0x7f47f80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.105+0000 7f4812000700 1 -- 172.21.15.70:0/1439377777 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f48040e2470 con 0x7f48140756d0 2024-05-08T06:45:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.105+0000 7f480be00700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47f80b2900 0x7f47f80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.105+0000 7f480be00700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47f80b2900 0x7f47f80b4dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00b5c0 tx=0x7f47fc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:07.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.109+0000 7f4812000700 1 -- 172.21.15.70:0/1439377777 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f48040a9dd0 con 0x7f48140756d0 2024-05-08T06:45:07.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.392+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f481419d090 con 0x7f48140756d0 2024-05-08T06:45:07.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.393+0000 7f4812000700 1 -- 172.21.15.70:0/1439377777 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11876 (secure 0 0 0) 0x7f4804005700 con 0x7f48140756d0 2024-05-08T06:45:07.393 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:45:07.393 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:42:47.248168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47f80b2900 msgr2=0x7f47f80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47f80b2900 0x7f47f80b4dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00b5c0 tx=0x7f47fc01a040 comp rx=0 tx=0).stop 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48140756d0 msgr2=0x7f481419bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48140756d0 0x7f481419bd30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f480400c970 tx=0x7f480400cd30 comp rx=0 tx=0).stop 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 shutdown_connections 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f481410fea0 0x7f48141a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47f80b2900 0x7f47f80b4dc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48140756d0 0x7f481419bd30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 --2- 172.21.15.70:0/1439377777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4814075ff0 0x7f481419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:07.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.396+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 >> 172.21.15.70:0/1439377777 conn(0x7f481407a600 msgr2=0x7f4814100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:07.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.397+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 shutdown_connections 2024-05-08T06:45:07.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:07.397+0000 7f481b800700 1 -- 172.21.15.70:0/1439377777 wait complete. 2024-05-08T06:45:07.397 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 26 2024-05-08T06:45:07.828 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:07 smithi070 ceph-mon[29591]: pgmap v498: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:07.828 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:07 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1439377777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:45:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:07 smithi172 ceph-mon[33377]: pgmap v498: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:07 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1439377777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:45:08.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:07 smithi194 ceph-mon[33679]: pgmap v498: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:08.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:07 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1439377777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:45:08.387 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:45:08.855 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:09 smithi070 ceph-mon[29591]: pgmap v499: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:09 smithi172 ceph-mon[33377]: pgmap v499: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:10.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:09 smithi194 ceph-mon[33679]: pgmap v499: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:11.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.344+0000 7fdb93e00700 1 -- 172.21.15.70:0/4040532248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb941077e0 msgr2=0x7fdb94107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:11.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.344+0000 7fdb93e00700 1 --2- 172.21.15.70:0/4040532248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb941077e0 0x7fdb94107c90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c00b0a0 tx=0x7fdb8c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.344+0000 7fdb93e00700 1 -- 172.21.15.70:0/4040532248 shutdown_connections 2024-05-08T06:45:11.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.344+0000 7fdb93e00700 1 --2- 172.21.15.70:0/4040532248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb941077e0 0x7fdb94107c90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.344+0000 7fdb93e00700 1 --2- 172.21.15.70:0/4040532248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb941023d0 0x7fdb941027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.344+0000 7fdb93e00700 1 --2- 172.21.15.70:0/4040532248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb94102cf0 0x7fdb941071c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.344+0000 7fdb93e00700 1 -- 172.21.15.70:0/4040532248 >> 172.21.15.70:0/4040532248 conn(0x7fdb940fde30 msgr2=0x7fdb94100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:11.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.344+0000 7fdb93e00700 1 -- 172.21.15.70:0/4040532248 shutdown_connections 2024-05-08T06:45:11.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.344+0000 7fdb93e00700 1 -- 172.21.15.70:0/4040532248 wait complete. 2024-05-08T06:45:11.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.345+0000 7fdb93e00700 1 Processor -- start 2024-05-08T06:45:11.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.345+0000 7fdb93e00700 1 -- start start 2024-05-08T06:45:11.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb93e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb941023d0 0x7fdb9419ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:11.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb93e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb94102cf0 0x7fdb941a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:11.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb93e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb941077e0 0x7fdb941a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:11.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb93e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94119b00 con 0x7fdb94102cf0 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb93e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94119980 con 0x7fdb941023d0 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb93e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdb94119c80 con 0x7fdb941077e0 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb92000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb94102cf0 0x7fdb941a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb92000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb94102cf0 0x7fdb941a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57822/0 (socket says 172.21.15.70:57822) 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb92000700 1 -- 172.21.15.70:0/1241785130 learned_addr learned my addr 172.21.15.70:0/1241785130 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.346+0000 7fdb92a00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb941023d0 0x7fdb9419ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.347+0000 7fdb93400700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb941077e0 0x7fdb941a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.347+0000 7fdb92000700 1 -- 172.21.15.70:0/1241785130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb941077e0 msgr2=0x7fdb941a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.347+0000 7fdb92000700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb941077e0 0x7fdb941a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.347+0000 7fdb92000700 1 -- 172.21.15.70:0/1241785130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb941023d0 msgr2=0x7fdb9419ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.347+0000 7fdb92000700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb941023d0 0x7fdb9419ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.347+0000 7fdb92000700 1 -- 172.21.15.70:0/1241785130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb941a4f80 con 0x7fdb94102cf0 2024-05-08T06:45:11.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.347+0000 7fdb92a00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb941023d0 0x7fdb9419ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:45:11.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.347+0000 7fdb92000700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb94102cf0 0x7fdb941a04b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000c970 tx=0x7fdb8000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:11.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.347+0000 7fdb8b400700 1 -- 172.21.15.70:0/1241785130 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80007b00 con 0x7fdb94102cf0 2024-05-08T06:45:11.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.348+0000 7fdb8b400700 1 -- 172.21.15.70:0/1241785130 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb80007ca0 con 0x7fdb94102cf0 2024-05-08T06:45:11.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.348+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb941a5270 con 0x7fdb94102cf0 2024-05-08T06:45:11.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.348+0000 7fdb8b400700 1 -- 172.21.15.70:0/1241785130 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb80018660 con 0x7fdb94102cf0 2024-05-08T06:45:11.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.348+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb941acaf0 con 0x7fdb94102cf0 2024-05-08T06:45:11.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.349+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb9406a190 con 0x7fdb94102cf0 2024-05-08T06:45:11.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.352+0000 7fdb8b400700 1 -- 172.21.15.70:0/1241785130 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdb8000f450 con 0x7fdb94102cf0 2024-05-08T06:45:11.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.354+0000 7fdb8b400700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdb780b2900 0x7fdb780b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:11.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.354+0000 7fdb8b400700 1 -- 172.21.15.70:0/1241785130 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fdb800e2550 con 0x7fdb94102cf0 2024-05-08T06:45:11.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.354+0000 7fdb92a00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdb780b2900 0x7fdb780b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:11.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.355+0000 7fdb92a00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdb780b2900 0x7fdb780b4dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb84005950 tx=0x7fdb840058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:11.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.359+0000 7fdb8b400700 1 -- 172.21.15.70:0/1241785130 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdb80014030 con 0x7fdb94102cf0 2024-05-08T06:45:11.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.588+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb941acd80 con 0x7fdb94102cf0 2024-05-08T06:45:11.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.591+0000 7fdb8b400700 1 -- 172.21.15.70:0/1241785130 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24865 (secure 0 0 0) 0x7fdb800a9e20 con 0x7fdb94102cf0 2024-05-08T06:45:11.591 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:45:11.591 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":92,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:43:16.853050+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:45:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdb780b2900 msgr2=0x7fdb780b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdb780b2900 0x7fdb780b4dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdb84005950 tx=0x7fdb840058e0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb94102cf0 msgr2=0x7fdb941a04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb94102cf0 0x7fdb941a04b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdb8000c970 tx=0x7fdb8000cd30 comp rx=0 tx=0).stop 2024-05-08T06:45:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 shutdown_connections 2024-05-08T06:45:11.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb941077e0 0x7fdb941a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb941023d0 0x7fdb9419ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdb780b2900 0x7fdb780b4dc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 --2- 172.21.15.70:0/1241785130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb94102cf0 0x7fdb941a04b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.594+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 >> 172.21.15.70:0/1241785130 conn(0x7fdb940fde30 msgr2=0x7fdb94105190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.595+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 shutdown_connections 2024-05-08T06:45:11.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:11.595+0000 7fdb93e00700 1 -- 172.21.15.70:0/1241785130 wait complete. 2024-05-08T06:45:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:11 smithi070 ceph-mon[29591]: pgmap v500: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:11 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1241785130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:45:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:11 smithi172 ceph-mon[33377]: pgmap v500: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:11 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1241785130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:45:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:11 smithi194 ceph-mon[33679]: pgmap v500: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:11 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1241785130' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:45:12.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:45:12.936 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:13 smithi070 ceph-mon[29591]: pgmap v501: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:13 smithi172 ceph-mon[33377]: pgmap v501: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:13 smithi194 ceph-mon[33679]: pgmap v501: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:15.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.417+0000 7f5cc1800700 1 -- 172.21.15.70:0/2602228380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc1056c0 msgr2=0x7f5cbc105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:15.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.417+0000 7f5cc1800700 1 --2- 172.21.15.70:0/2602228380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc1056c0 0x7f5cbc105b40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8009990 tx=0x7f5ca8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.417+0000 7f5cc1800700 1 -- 172.21.15.70:0/2602228380 shutdown_connections 2024-05-08T06:45:15.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.417+0000 7f5cc1800700 1 --2- 172.21.15.70:0/2602228380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cbc106080 0x7f5cbc112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.417+0000 7f5cc1800700 1 --2- 172.21.15.70:0/2602228380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cbc10b6c0 0x7f5cbc10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.417+0000 7f5cc1800700 1 --2- 172.21.15.70:0/2602228380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc1056c0 0x7f5cbc105b40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.417+0000 7f5cc1800700 1 -- 172.21.15.70:0/2602228380 >> 172.21.15.70:0/2602228380 conn(0x7f5cbc1011b0 msgr2=0x7f5cbc1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:15.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.417+0000 7f5cc1800700 1 -- 172.21.15.70:0/2602228380 shutdown_connections 2024-05-08T06:45:15.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.417+0000 7f5cc1800700 1 -- 172.21.15.70:0/2602228380 wait complete. 2024-05-08T06:45:15.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.418+0000 7f5cc1800700 1 Processor -- start 2024-05-08T06:45:15.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cc1800700 1 -- start start 2024-05-08T06:45:15.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cc1800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cbc1056c0 0x7f5cbc1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:15.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cc1800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc106080 0x7f5cbc1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:15.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cc1800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cbc10b6c0 0x7f5cbc19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:15.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cc1800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc115770 con 0x7f5cbc106080 2024-05-08T06:45:15.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cc1800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc1155f0 con 0x7f5cbc10b6c0 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cc1800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc1158f0 con 0x7f5cbc1056c0 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cba000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc106080 0x7f5cbc1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cba000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc106080 0x7f5cbc1a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57830/0 (socket says 172.21.15.70:57830) 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.419+0000 7f5cba000700 1 -- 172.21.15.70:0/1968136234 learned_addr learned my addr 172.21.15.70:0/1968136234 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.420+0000 7f5cbaa00700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cbc1056c0 0x7f5cbc1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.420+0000 7f5cbb400700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cbc10b6c0 0x7f5cbc19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.420+0000 7f5cba000700 1 -- 172.21.15.70:0/1968136234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cbc1056c0 msgr2=0x7f5cbc1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.420+0000 7f5cba000700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cbc1056c0 0x7f5cbc1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.420+0000 7f5cba000700 1 -- 172.21.15.70:0/1968136234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cbc10b6c0 msgr2=0x7f5cbc19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.420+0000 7f5cba000700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cbc10b6c0 0x7f5cbc19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.420+0000 7f5cba000700 1 -- 172.21.15.70:0/1968136234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cbc19c230 con 0x7f5cbc106080 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.420+0000 7f5cba000700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc106080 0x7f5cbc1a1e50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80057c0 tx=0x7f5ca8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.420+0000 7f5cb3400700 1 -- 172.21.15.70:0/1968136234 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8027070 con 0x7f5cbc106080 2024-05-08T06:45:15.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.421+0000 7f5cb3400700 1 -- 172.21.15.70:0/1968136234 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ca800fda0 con 0x7f5cbc106080 2024-05-08T06:45:15.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.421+0000 7f5cb3400700 1 -- 172.21.15.70:0/1968136234 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8022ca0 con 0x7f5cbc106080 2024-05-08T06:45:15.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.421+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cbc19c4c0 con 0x7f5cbc106080 2024-05-08T06:45:15.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.421+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cbc1a87e0 con 0x7f5cbc106080 2024-05-08T06:45:15.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.422+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cbc06a190 con 0x7f5cbc106080 2024-05-08T06:45:15.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.424+0000 7f5cb3400700 1 -- 172.21.15.70:0/1968136234 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5ca802a070 con 0x7f5cbc106080 2024-05-08T06:45:15.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.425+0000 7f5cb3400700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5ca00b2900 0x7f5ca00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:15.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.426+0000 7f5cb3400700 1 -- 172.21.15.70:0/1968136234 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f5ca80e3640 con 0x7f5cbc106080 2024-05-08T06:45:15.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.426+0000 7f5cbaa00700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5ca00b2900 0x7f5ca00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:15.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.426+0000 7f5cbaa00700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5ca00b2900 0x7f5ca00b4dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5cac005fd0 tx=0x7f5cac005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:15.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.428+0000 7f5cb3400700 1 -- 172.21.15.70:0/1968136234 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5ca8031080 con 0x7f5cbc106080 2024-05-08T06:45:15.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.710+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cbc02e510 con 0x7f5cbc106080 2024-05-08T06:45:15.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.711+0000 7f5cb3400700 1 -- 172.21.15.70:0/1968136234 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11876 (secure 0 0 0) 0x7f5ca8013070 con 0x7f5cbc106080 2024-05-08T06:45:15.711 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:45:15.711 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:42:47.248168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:45:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5ca00b2900 msgr2=0x7f5ca00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5ca00b2900 0x7f5ca00b4dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5cac005fd0 tx=0x7f5cac005db0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc106080 msgr2=0x7f5cbc1a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc106080 0x7f5cbc1a1e50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80057c0 tx=0x7f5ca8009f90 comp rx=0 tx=0).stop 2024-05-08T06:45:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 shutdown_connections 2024-05-08T06:45:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5cbc10b6c0 0x7f5cbc19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cbc1056c0 0x7f5cbc1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f5ca00b2900 0x7f5ca00b4dc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 --2- 172.21.15.70:0/1968136234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cbc106080 0x7f5cbc1a1e50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.714+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 >> 172.21.15.70:0/1968136234 conn(0x7f5cbc1011b0 msgr2=0x7f5cbc1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:15.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.715+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 shutdown_connections 2024-05-08T06:45:15.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:15.715+0000 7f5cc1800700 1 -- 172.21.15.70:0/1968136234 wait complete. 2024-05-08T06:45:15.715 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 26 2024-05-08T06:45:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:15 smithi070 ceph-mon[29591]: pgmap v502: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:15 smithi172 ceph-mon[33377]: pgmap v502: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:16.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:15 smithi194 ceph-mon[33679]: pgmap v502: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:16.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T06:41:12.659763+0000', 'modified': '2024-05-08T06:42:47.248168+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34442, 'mds_1': 34409, 'mds_2': 34379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24397': {'gid': 24397, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/346722795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 346722795}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 346722795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24409': {'gid': 24409, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6839/622098707', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 622098707}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 622098707}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34364': {'gid': 34364, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/852809993', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 852809993}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 852809993}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34379': {'gid': 34379, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 36, 'addr': '172.21.15.172:6835/3516901387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3516901387}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3516901387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34409': {'gid': 34409, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.172:6837/2037790761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2037790761}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2037790761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34442': {'gid': 34442, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.172:6839/283788562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 283788562}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 283788562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34442, 'qdb_cluster': [34409, 34379, 34442]} 2024-05-08T06:45:16.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-08T06:45:16.785 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-08T06:45:16.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:16 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1968136234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:45:17.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:16 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1968136234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:45:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:16 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1968136234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:45:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:17 smithi070 ceph-mon[29591]: pgmap v503: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:17 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:45:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:17 smithi172 ceph-mon[33377]: pgmap v503: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:17 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:45:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:17 smithi194 ceph-mon[33679]: pgmap v503: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:17 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:45:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:45:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:45:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:45:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:45:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:45:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:45:19.114 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:45:19.114 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:45:19.115 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:45:19.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.670+0000 7f66f6a00700 1 -- 172.21.15.70:0/1025489157 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e800bab0 con 0x7f66f810b660 2024-05-08T06:45:19.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.671+0000 7f66fd800700 1 -- 172.21.15.70:0/1025489157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f810b660 msgr2=0x7f66f810ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:19.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.671+0000 7f66fd800700 1 --2- 172.21.15.70:0/1025489157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f810b660 0x7f66f810ba40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009990 tx=0x7f66e8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.671+0000 7f66fd800700 1 -- 172.21.15.70:0/1025489157 shutdown_connections 2024-05-08T06:45:19.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.671+0000 7f66fd800700 1 --2- 172.21.15.70:0/1025489157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f8105f90 0x7f66f81124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.671+0000 7f66fd800700 1 --2- 172.21.15.70:0/1025489157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f810b660 0x7f66f810ba40 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.671+0000 7f66fd800700 1 --2- 172.21.15.70:0/1025489157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f81055d0 0x7f66f8105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.671+0000 7f66fd800700 1 -- 172.21.15.70:0/1025489157 >> 172.21.15.70:0/1025489157 conn(0x7f66f81010c0 msgr2=0x7f66f81034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:19.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.671+0000 7f66fd800700 1 -- 172.21.15.70:0/1025489157 shutdown_connections 2024-05-08T06:45:19.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.671+0000 7f66fd800700 1 -- 172.21.15.70:0/1025489157 wait complete. 2024-05-08T06:45:19.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.673+0000 7f66fd800700 1 Processor -- start 2024-05-08T06:45:19.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.674+0000 7f66fd800700 1 -- start start 2024-05-08T06:45:19.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.674+0000 7f66fd800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f81055d0 0x7f66f819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.674+0000 7f66fd800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f8105f90 0x7f66f819c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.674+0000 7f66fd800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f81a0660 0x7f66f81a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.674+0000 7f66fd800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f66f8115680 con 0x7f66f81055d0 2024-05-08T06:45:19.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.674+0000 7f66fd800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66f8115500 con 0x7f66f81a0660 2024-05-08T06:45:19.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.674+0000 7f66fd800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f66f8115800 con 0x7f66f8105f90 2024-05-08T06:45:19.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.674+0000 7f66f7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f81055d0 0x7f66f819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66f7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f81055d0 0x7f66f819bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33942/0 (socket says 172.21.15.70:33942) 2024-05-08T06:45:19.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66f7e00700 1 -- 172.21.15.70:0/2800369155 learned_addr learned my addr 172.21.15.70:0/2800369155 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:19.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66f7400700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f8105f90 0x7f66f819c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66fce00700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f81a0660 0x7f66f81a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66f7e00700 1 -- 172.21.15.70:0/2800369155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f8105f90 msgr2=0x7f66f819c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66f7e00700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f8105f90 0x7f66f819c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66f7e00700 1 -- 172.21.15.70:0/2800369155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f81a0660 msgr2=0x7f66f81a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66f7e00700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f81a0660 0x7f66f81a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66f7e00700 1 -- 172.21.15.70:0/2800369155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f81a1180 con 0x7f66f81055d0 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66fce00700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f81a0660 0x7f66f81a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.675+0000 7f66f7e00700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f81055d0 0x7f66f819bd90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000c00 tx=0x7f66e80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.676+0000 7f66f4c00700 1 -- 172.21.15.70:0/2800369155 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8026070 con 0x7f66f81055d0 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.676+0000 7f66fd800700 1 -- 172.21.15.70:0/2800369155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f81a1410 con 0x7f66f81055d0 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.676+0000 7f66f4c00700 1 -- 172.21.15.70:0/2800369155 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66e8021410 con 0x7f66f81055d0 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.676+0000 7f66f4c00700 1 -- 172.21.15.70:0/2800369155 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8017650 con 0x7f66f81055d0 2024-05-08T06:45:19.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.676+0000 7f66fd800700 1 -- 172.21.15.70:0/2800369155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f81a8b30 con 0x7f66f81055d0 2024-05-08T06:45:19.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.679+0000 7f66f4c00700 1 -- 172.21.15.70:0/2800369155 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f66e8029070 con 0x7f66f81055d0 2024-05-08T06:45:19.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.680+0000 7f6709745b80 1 Processor -- start 2024-05-08T06:45:19.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f6709745b80 1 -- start start 2024-05-08T06:45:19.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f6709745b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 0x55d20a0dbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f6709745b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0dc2b0 0x55d20a0d5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f66f4c00700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66dc0b2880 0x7f66dc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f6709745b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f6709745b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d20a0289d0 con 0x55d20a0d65b0 2024-05-08T06:45:19.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f6709745b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d209fc6710 con 0x55d20a0db990 2024-05-08T06:45:19.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f6709745b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d20a024990 con 0x55d20a0dc2b0 2024-05-08T06:45:19.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f66f4c00700 1 -- 172.21.15.70:0/2800369155 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f66e80e33b0 con 0x7f66f81055d0 2024-05-08T06:45:19.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f66f7e00700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66dc0b2880 0x7f66dc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.681+0000 7f66fce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66f7400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0dc2b0 0x55d20a0d5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66fce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33956/0 (socket says 172.21.15.70:33956) 2024-05-08T06:45:19.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66fce00700 1 -- 172.21.15.70:0/4832279 learned_addr learned my addr 172.21.15.70:0/4832279 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:19.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66fce00700 1 --2- 172.21.15.70:0/4832279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 0x55d20a0dbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66fce00700 1 -- 172.21.15.70:0/4832279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0dc2b0 msgr2=0x55d20a0d5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66fce00700 1 --2- 172.21.15.70:0/4832279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0dc2b0 0x55d20a0d5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66fce00700 1 -- 172.21.15.70:0/4832279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 msgr2=0x55d20a0dbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66fce00700 1 --2- 172.21.15.70:0/4832279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 0x55d20a0dbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66fce00700 1 -- 172.21.15.70:0/4832279 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d209f75880 con 0x55d20a0d65b0 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.682+0000 7f66f7e00700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66dc0b2880 0x7f66dc0b4d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001eb0 tx=0x7f66e8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.683+0000 7f66fce00700 1 --2- 172.21.15.70:0/4832279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d6a30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f66f0011a10 tx=0x7f66f0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e147aaf2cb4ac55 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.683+0000 7f66ed600700 1 -- 172.21.15.70:0/4832279 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0004bb0 con 0x55d20a0d65b0 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.683+0000 7f66ed600700 1 -- 172.21.15.70:0/4832279 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66f0004d50 con 0x55d20a0d65b0 2024-05-08T06:45:19.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.683+0000 7f66ed600700 1 -- 172.21.15.70:0/4832279 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0016d30 con 0x55d20a0d65b0 2024-05-08T06:45:19.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 -- 172.21.15.70:0/4832279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 msgr2=0x55d20a0d6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:19.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 --2- 172.21.15.70:0/4832279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d6a30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f66f0011a10 tx=0x7f66f0009920 comp rx=0 tx=0).stop 2024-05-08T06:45:19.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 -- 172.21.15.70:0/4832279 shutdown_connections 2024-05-08T06:45:19.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 --2- 172.21.15.70:0/4832279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d6a30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 --2- 172.21.15.70:0/4832279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 0x55d20a0dbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 --2- 172.21.15.70:0/4832279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0dc2b0 0x55d20a0d5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 -- 172.21.15.70:0/4832279 >> 172.21.15.70:0/4832279 conn(0x55d20a004b10 msgr2=0x55d20a0d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:19.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 -- 172.21.15.70:0/4832279 shutdown_connections 2024-05-08T06:45:19.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 -- 172.21.15.70:0/4832279 wait complete. 2024-05-08T06:45:19.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.684+0000 7f6709745b80 1 -- start start 2024-05-08T06:45:19.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.685+0000 7f6709745b80 1 Processor -- start 2024-05-08T06:45:19.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.685+0000 7f6709745b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0e1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.685+0000 7f6709745b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 0x55d20a0df240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.685+0000 7f6709745b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0dc2b0 0x55d20a0df780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.685+0000 7f6709745b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d20a0e2d00 con 0x55d20a0d65b0 2024-05-08T06:45:19.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.685+0000 7f6709745b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d209f8ead0 con 0x55d20a0dc2b0 2024-05-08T06:45:19.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.685+0000 7f6709745b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d20a0e2e80 con 0x55d20a0db990 2024-05-08T06:45:19.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.685+0000 7f6709745b80 10 client.0 _ll_register_callbacks cb 0x55d209fcfc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:45:19.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66fce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0e1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66fce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0e1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33972/0 (socket says 172.21.15.70:33972) 2024-05-08T06:45:19.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66fce00700 1 -- 172.21.15.70:0/2163076006 learned_addr learned my addr 172.21.15.70:0/2163076006 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:19.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66f7400700 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 0x55d20a0df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66fce00700 1 -- 172.21.15.70:0/2163076006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 msgr2=0x55d20a0df240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:19.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66fce00700 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 0x55d20a0df240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66fce00700 1 -- 172.21.15.70:0/2163076006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0dc2b0 msgr2=0x55d20a0df780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:19.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66fce00700 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0dc2b0 0x55d20a0df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66fce00700 1 -- 172.21.15.70:0/2163076006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d209fee3d0 con 0x55d20a0d65b0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66f7400700 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 0x55d20a0df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66fce00700 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0e1ea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f66f0004b60 tx=0x7f66f0004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72479405297115e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.686+0000 7f66e2000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.687+0000 7f66e2000700 1 -- 172.21.15.70:0/2163076006 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0027020 con 0x55d20a0d65b0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.687+0000 7f66e2000700 1 -- 172.21.15.70:0/2163076006 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f66f00168f0 con 0x55d20a0d65b0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.687+0000 7f6709745b80 1 -- 172.21.15.70:0/2163076006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66f0004d50 con 0x55d20a0d65b0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.687+0000 7f66e2000700 1 -- 172.21.15.70:0/2163076006 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f66f002f050 con 0x55d20a0d65b0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.687+0000 7f6709745b80 10 client.15021 fetch_fsmap learned FSMap version 26 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.687+0000 7f6709745b80 1 -- 172.21.15.70:0/2163076006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d20a0ed430 con 0x55d20a0d65b0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.687+0000 7f66e2000700 1 -- 172.21.15.70:0/2163076006 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66f0004d50 con 0x55d20a0d65b0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.688+0000 7f66e2000700 1 -- 172.21.15.70:0/2163076006 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f66f0007c10 con 0x55d20a0d65b0 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.688+0000 7f6709745b80 10 client.15021 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:45:19.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.688+0000 7f6709745b80 10 client.15021 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-08T06:45:19.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.688+0000 7f6709745b80 20 client.15021 populate_metadata read hostname 'smithi070' 2024-05-08T06:45:19.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.688+0000 7f6709745b80 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x55d20a0ef6e0 0x55d20a0f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.688+0000 7f6709745b80 4 client.15021 mds_command: new command op to 34379 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:45:19.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.688+0000 7f6709745b80 1 -- 172.21.15.70:0/2163076006 --> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d20a0a3050 con 0x55d20a0ef6e0 2024-05-08T06:45:19.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.689+0000 7f66f7400700 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x55d20a0ef6e0 0x55d20a0f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.690+0000 7f66f7400700 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x55d20a0ef6e0 0x55d20a0f0b50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5168d618adddc6af server_cookie=24b9c19c2bc57410 in_seq=0 out_seq=0 2024-05-08T06:45:19.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.690+0000 7f66e2000700 10 client.15021 ms_handle_connect on v2:172.21.15.172:6834/3516901387 2024-05-08T06:45:19.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f66e2000700 1 -- 172.21.15.70:0/2163076006 <== mds.2 v2:172.21.15.172:6834/3516901387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d20a0a3050 con 0x55d20a0ef6e0 2024-05-08T06:45:19.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f66e2000700 10 client.15021 handle_command_reply: tid=0 2024-05-08T06:45:19.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f6709745b80 1 client.15021 shutdown 2024-05-08T06:45:19.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f6709745b80 1 -- 172.21.15.70:0/2163076006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 msgr2=0x55d20a0e1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:19.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f6709745b80 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0e1ea0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f66f0004b60 tx=0x7f66f0004c40 comp rx=0 tx=0).stop 2024-05-08T06:45:19.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f6709745b80 1 -- 172.21.15.70:0/2163076006 shutdown_connections 2024-05-08T06:45:19.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f6709745b80 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x55d20a0ef6e0 0x55d20a0f0b50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f6709745b80 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0dc2b0 0x55d20a0df780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f6709745b80 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0e1ea0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f6709745b80 1 --2- 172.21.15.70:0/2163076006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 0x55d20a0df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f66e2000700 0 client.15021 ms_handle_reset on v2:172.21.15.172:6834/3516901387 2024-05-08T06:45:19.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.692+0000 7f6709745b80 1 -- 172.21.15.70:0/2163076006 >> 172.21.15.70:0/2163076006 conn(0x55d20a004b10 msgr2=0x55d20a0cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:19.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.693+0000 7f6709745b80 1 -- 172.21.15.70:0/2163076006 shutdown_connections 2024-05-08T06:45:19.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.693+0000 7f6709745b80 1 -- 172.21.15.70:0/2163076006 wait complete. 2024-05-08T06:45:19.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.693+0000 7f6709745b80 20 client.15021 trim_cache size 0 max 16384 2024-05-08T06:45:19.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.715+0000 7f6709745b80 1 Processor -- start 2024-05-08T06:45:19.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.715+0000 7f6709745b80 1 -- start start 2024-05-08T06:45:19.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f6709745b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f6709745b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 0x55d20a0dfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f6709745b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0dc2b0 0x55d20a0df200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f6709745b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d20a0eee90 con 0x55d20a0d65b0 2024-05-08T06:45:19.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f6709745b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d20a0ef560 con 0x55d20a0dc2b0 2024-05-08T06:45:19.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f6709745b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d20a0efc30 con 0x55d20a0db990 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f66fce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f66fce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33982/0 (socket says 172.21.15.70:33982) 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f66fce00700 1 -- 172.21.15.70:0/1506452057 learned_addr learned my addr 172.21.15.70:0/1506452057 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.716+0000 7f66f7400700 1 --2- 172.21.15.70:0/1506452057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 0x55d20a0dfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.717+0000 7f66fce00700 1 -- 172.21.15.70:0/1506452057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 msgr2=0x55d20a0dfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.717+0000 7f66fce00700 1 --2- 172.21.15.70:0/1506452057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 0x55d20a0dfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.717+0000 7f66fce00700 1 -- 172.21.15.70:0/1506452057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0dc2b0 msgr2=0x55d20a0df200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.717+0000 7f66fce00700 1 --2- 172.21.15.70:0/1506452057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0dc2b0 0x55d20a0df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.717+0000 7f66fce00700 1 -- 172.21.15.70:0/1506452057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d20a0e1ae0 con 0x55d20a0d65b0 2024-05-08T06:45:19.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.717+0000 7f66fce00700 1 --2- 172.21.15.70:0/1506452057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d5f90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f66f0000f80 tx=0x7f66f0023670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2ccfec715a817e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:19.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.718+0000 7f66ecc00700 1 -- 172.21.15.70:0/1506452057 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0038070 con 0x55d20a0d65b0 2024-05-08T06:45:19.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.718+0000 7f66ecc00700 1 -- 172.21.15.70:0/1506452057 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66f0023730 con 0x55d20a0d65b0 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.718+0000 7f66ecc00700 1 -- 172.21.15.70:0/1506452057 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0027030 con 0x55d20a0d65b0 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.718+0000 7f6709745b80 1 -- 172.21.15.70:0/1506452057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 msgr2=0x55d20a0d5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.718+0000 7f6709745b80 1 --2- 172.21.15.70:0/1506452057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d5f90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f66f0000f80 tx=0x7f66f0023670 comp rx=0 tx=0).stop 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.718+0000 7f6709745b80 1 -- 172.21.15.70:0/1506452057 shutdown_connections 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.719+0000 7f6709745b80 1 --2- 172.21.15.70:0/1506452057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0dc2b0 0x55d20a0df200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.719+0000 7f6709745b80 1 --2- 172.21.15.70:0/1506452057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0d5f90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.719+0000 7f6709745b80 1 --2- 172.21.15.70:0/1506452057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0db990 0x55d20a0dfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.719+0000 7f6709745b80 1 -- 172.21.15.70:0/1506452057 >> 172.21.15.70:0/1506452057 conn(0x55d20a004b10 msgr2=0x55d20a0ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.719+0000 7f6709745b80 1 -- 172.21.15.70:0/1506452057 shutdown_connections 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.719+0000 7f6709745b80 1 -- 172.21.15.70:0/1506452057 wait complete. 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.719+0000 7f6709745b80 1 -- start start 2024-05-08T06:45:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.719+0000 7f6709745b80 1 Processor -- start 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f6709745b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0f9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f6709745b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 0x55d20a0fa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f6709745b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0dc2b0 0x55d20a0f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f6709745b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d20a0f09d0 con 0x55d20a0d65b0 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f6709745b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d20a0f0300 con 0x55d20a0db990 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f6709745b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d20a0f10a0 con 0x55d20a0dc2b0 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f6709745b80 10 client.0 _ll_register_callbacks cb 0x55d209fcfc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f66fce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0f9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f66fce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0f9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33984/0 (socket says 172.21.15.70:33984) 2024-05-08T06:45:19.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.720+0000 7f66fce00700 1 -- 172.21.15.70:0/3412774616 learned_addr learned my addr 172.21.15.70:0/3412774616 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66f7400700 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 0x55d20a0fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66fce00700 1 -- 172.21.15.70:0/3412774616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0dc2b0 msgr2=0x55d20a0f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66fce00700 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0dc2b0 0x55d20a0f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66fce00700 1 -- 172.21.15.70:0/3412774616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 msgr2=0x55d20a0fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66fce00700 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 0x55d20a0fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66fce00700 1 -- 172.21.15.70:0/3412774616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d20a0f54c0 con 0x55d20a0d65b0 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66fce00700 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0f9fd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f66f0004c80 tx=0x7f66f0023950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d673bbffb6abc477 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66e2000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66e2000700 1 -- 172.21.15.70:0/3412774616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0027070 con 0x55d20a0d65b0 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f66e2000700 1 -- 172.21.15.70:0/3412774616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f66f0023a30 con 0x55d20a0d65b0 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.721+0000 7f6709745b80 1 -- 172.21.15.70:0/3412774616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66f0023730 con 0x55d20a0d65b0 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f66e2000700 1 -- 172.21.15.70:0/3412774616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f66f0045050 con 0x55d20a0d65b0 2024-05-08T06:45:19.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f6709745b80 10 client.15027 fetch_fsmap learned FSMap version 26 2024-05-08T06:45:19.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f6709745b80 1 -- 172.21.15.70:0/3412774616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55d20a15b330 con 0x55d20a0d65b0 2024-05-08T06:45:19.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f66e2000700 1 -- 172.21.15.70:0/3412774616 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66f0023730 con 0x55d20a0d65b0 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f66e2000700 1 -- 172.21.15.70:0/3412774616 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f66f0007590 con 0x55d20a0d65b0 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f6709745b80 10 client.15027 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f6709745b80 10 client.15027 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f6709745b80 20 client.15027 populate_metadata read hostname 'smithi070' 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f6709745b80 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x55d20a15fa20 0x55d20a15e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f6709745b80 4 client.15027 mds_command: new command op to 34379 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.722+0000 7f6709745b80 1 -- 172.21.15.70:0/3412774616 --> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] -- command(tid 0: {"prefix": "status"}) -- 0x55d20a0363b0 con 0x55d20a15fa20 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.723+0000 7f66f7400700 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x55d20a15fa20 0x55d20a15e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.724+0000 7f66f7400700 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x55d20a15fa20 0x55d20a15e730 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d983f88868572090 server_cookie=52859e72bab6017d in_seq=0 out_seq=0 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.724+0000 7f66e2000700 10 client.15027 ms_handle_connect on v2:172.21.15.172:6834/3516901387 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.724+0000 7f66e2000700 1 -- 172.21.15.70:0/3412774616 <== mds.2 v2:172.21.15.172:6834/3516901387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d20a0363b0 con 0x55d20a15fa20 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.724+0000 7f66e2000700 10 client.15027 handle_command_reply: tid=0 2024-05-08T06:45:19.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.724+0000 7f6709745b80 1 client.15027 shutdown 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 -- 172.21.15.70:0/3412774616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 msgr2=0x55d20a0f9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0f9fd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f66f0004c80 tx=0x7f66f0023950 comp rx=0 tx=0).stop 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 -- 172.21.15.70:0/3412774616 shutdown_connections 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x55d20a15fa20 0x55d20a15e730 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d20a0dc2b0 0x55d20a0f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d20a0d65b0 0x55d20a0f9fd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 --2- 172.21.15.70:0/3412774616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d20a0db990 0x55d20a0fa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 -- 172.21.15.70:0/3412774616 >> 172.21.15.70:0/3412774616 conn(0x55d20a004b10 msgr2=0x55d20a0dfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f66e2000700 0 client.15027 ms_handle_reset on v2:172.21.15.172:6834/3516901387 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 -- 172.21.15.70:0/3412774616 shutdown_connections 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 1 -- 172.21.15.70:0/3412774616 wait complete. 2024-05-08T06:45:19.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.725+0000 7f6709745b80 20 client.15027 trim_cache size 0 max 16384 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34379, 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 159.48371167799999, 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 26, 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 92, 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 90, 2024-05-08T06:45:19.727 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 298.70994611600003 2024-05-08T06:45:19.728 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:45:19.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 -- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66dc0b2880 msgr2=0x7f66dc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:19.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66dc0b2880 0x7f66dc0b4d40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001eb0 tx=0x7f66e8009310 comp rx=0 tx=0).stop 2024-05-08T06:45:19.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 -- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f81055d0 msgr2=0x7f66f819bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:19.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f81055d0 0x7f66f819bd90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000c00 tx=0x7f66e80047b0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 -- 172.21.15.70:0/2800369155 shutdown_connections 2024-05-08T06:45:19.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66f81a0660 0x7f66f81a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66dc0b2880 0x7f66dc0b4d40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66f81055d0 0x7f66f819bd90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 --2- 172.21.15.70:0/2800369155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f8105f90 0x7f66f819c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 -- 172.21.15.70:0/2800369155 >> 172.21.15.70:0/2800369155 conn(0x7f66f81010c0 msgr2=0x7f66f8102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 -- 172.21.15.70:0/2800369155 shutdown_connections 2024-05-08T06:45:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:19.726+0000 7f66fd800700 1 -- 172.21.15.70:0/2800369155 wait complete. 2024-05-08T06:45:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:19 smithi172 ceph-mon[33377]: pgmap v504: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:20.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:19 smithi194 ceph-mon[33679]: pgmap v504: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:19 smithi070 ceph-mon[29591]: pgmap v504: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:20.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-08T06:45:21.155 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:21 smithi172 ceph-mon[33377]: pgmap v505: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:21 smithi194 ceph-mon[33679]: pgmap v505: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:22.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:21 smithi070 ceph-mon[29591]: pgmap v505: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.584+0000 7fa07b200700 1 -- 172.21.15.70:0/2376976759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c10e8b0 msgr2=0x7fa07c10ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.584+0000 7fa07b200700 1 --2- 172.21.15.70:0/2376976759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c10e8b0 0x7fa07c10ec90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00b0a0 tx=0x7fa06c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.584+0000 7fa07b200700 1 -- 172.21.15.70:0/2376976759 shutdown_connections 2024-05-08T06:45:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.584+0000 7fa07b200700 1 --2- 172.21.15.70:0/2376976759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa07c10a3a0 0x7fa07c116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.584+0000 7fa07b200700 1 --2- 172.21.15.70:0/2376976759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c10e8b0 0x7fa07c10ec90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.584+0000 7fa07b200700 1 --2- 172.21.15.70:0/2376976759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c1099e0 0x7fa07c109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.584+0000 7fa07b200700 1 -- 172.21.15.70:0/2376976759 >> 172.21.15.70:0/2376976759 conn(0x7fa07c079230 msgr2=0x7fa07c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.584+0000 7fa07b200700 1 -- 172.21.15.70:0/2376976759 shutdown_connections 2024-05-08T06:45:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.584+0000 7fa07b200700 1 -- 172.21.15.70:0/2376976759 wait complete. 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.585+0000 7fa07b200700 1 Processor -- start 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.585+0000 7fa07b200700 1 -- start start 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.585+0000 7fa07b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c1099e0 0x7fa07c1a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.585+0000 7fa07b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10a3a0 0x7fa07c1a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.585+0000 7fa07b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa07c10e8b0 0x7fa07c1a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.585+0000 7fa07b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c119af0 con 0x7fa07c1099e0 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.585+0000 7fa07b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c119970 con 0x7fa07c10a3a0 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.585+0000 7fa07b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c119c70 con 0x7fa07c10e8b0 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa079e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c1099e0 0x7fa07c1a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa079e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c1099e0 0x7fa07c1a0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33998/0 (socket says 172.21.15.70:33998) 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa079e00700 1 -- 172.21.15.70:0/1193981335 learned_addr learned my addr 172.21.15.70:0/1193981335 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa071400700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10a3a0 0x7fa07c1a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa079e00700 1 -- 172.21.15.70:0/1193981335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa07c10e8b0 msgr2=0x7fa07c1a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa07a800700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa07c10e8b0 0x7fa07c1a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa079e00700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa07c10e8b0 0x7fa07c1a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa079e00700 1 -- 172.21.15.70:0/1193981335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10a3a0 msgr2=0x7fa07c1a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa079e00700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10a3a0 0x7fa07c1a0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa079e00700 1 -- 172.21.15.70:0/1193981335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c1a5050 con 0x7fa07c1099e0 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa07a800700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa07c10e8b0 0x7fa07c1a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.586+0000 7fa071400700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10a3a0 0x7fa07c1a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:23.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.587+0000 7fa079e00700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c1099e0 0x7fa07c1a0040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00b070 tx=0x7fa06c004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:23.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.587+0000 7fa073400700 1 -- 172.21.15.70:0/1193981335 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c021070 con 0x7fa07c1099e0 2024-05-08T06:45:23.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.587+0000 7fa073400700 1 -- 172.21.15.70:0/1193981335 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa06c007d00 con 0x7fa07c1099e0 2024-05-08T06:45:23.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.587+0000 7fa073400700 1 -- 172.21.15.70:0/1193981335 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c01d450 con 0x7fa07c1099e0 2024-05-08T06:45:23.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.587+0000 7fa07b200700 1 -- 172.21.15.70:0/1193981335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07c1a52e0 con 0x7fa07c1099e0 2024-05-08T06:45:23.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.587+0000 7fa07b200700 1 -- 172.21.15.70:0/1193981335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07c1acbc0 con 0x7fa07c1099e0 2024-05-08T06:45:23.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.591+0000 7fa073400700 1 -- 172.21.15.70:0/1193981335 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa06c004140 con 0x7fa07c1099e0 2024-05-08T06:45:23.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.592+0000 7fa08bad4b80 1 Processor -- start 2024-05-08T06:45:23.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.592+0000 7fa08bad4b80 1 -- start start 2024-05-08T06:45:23.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.592+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.592+0000 7fa073400700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa0600b2880 0x7fa0600b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.592+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e3670 0x5621fd0dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.592+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 0x5621fd0dde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.592+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621fd02f9d0 con 0x5621fd0e2d50 2024-05-08T06:45:23.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.592+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5621fcfcd710 con 0x5621fd0e3670 2024-05-08T06:45:23.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.592+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5621fd02b990 con 0x5621fd0dda00 2024-05-08T06:45:23.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa073400700 1 -- 172.21.15.70:0/1193981335 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fa06c00f020 con 0x7fa07c1099e0 2024-05-08T06:45:23.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa07a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa07a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34008/0 (socket says 172.21.15.70:34008) 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa07a800700 1 -- 172.21.15.70:0/2049762852 learned_addr learned my addr 172.21.15.70:0/2049762852 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa079e00700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa0600b2880 0x7fa0600b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa071400700 1 --2- 172.21.15.70:0/2049762852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e3670 0x5621fd0dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa07a800700 1 --2- 172.21.15.70:0/2049762852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 0x5621fd0dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa07a800700 1 -- 172.21.15.70:0/2049762852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 msgr2=0x5621fd0dde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa07a800700 1 --2- 172.21.15.70:0/2049762852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 0x5621fd0dde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa07a800700 1 -- 172.21.15.70:0/2049762852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e3670 msgr2=0x5621fd0dd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa07a800700 1 --2- 172.21.15.70:0/2049762852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e3670 0x5621fd0dd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.593+0000 7fa07a800700 1 -- 172.21.15.70:0/2049762852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621fcf7c880 con 0x5621fd0e2d50 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.594+0000 7fa079e00700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa0600b2880 0x7fa0600b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0a82e0 tx=0x7fa06c0099e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.594+0000 7fa07a800700 1 --2- 172.21.15.70:0/2049762852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e3130 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa07400aef0 tx=0x7fa07400a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d4c2c11729cd68 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.594+0000 7fa06b400700 1 -- 172.21.15.70:0/2049762852 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07401b070 con 0x5621fd0e2d50 2024-05-08T06:45:23.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.594+0000 7fa06b400700 1 -- 172.21.15.70:0/2049762852 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa074016430 con 0x5621fd0e2d50 2024-05-08T06:45:23.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.594+0000 7fa06b400700 1 -- 172.21.15.70:0/2049762852 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07400f040 con 0x5621fd0e2d50 2024-05-08T06:45:23.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.595+0000 7fa08bad4b80 1 -- 172.21.15.70:0/2049762852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 msgr2=0x5621fd0e3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:23.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.595+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/2049762852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e3130 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa07400aef0 tx=0x7fa07400a3f0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.595+0000 7fa08bad4b80 1 -- 172.21.15.70:0/2049762852 shutdown_connections 2024-05-08T06:45:23.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.595+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/2049762852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 0x5621fd0dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.595+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/2049762852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e3130 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.595+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/2049762852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e3670 0x5621fd0dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.595+0000 7fa08bad4b80 1 -- 172.21.15.70:0/2049762852 >> 172.21.15.70:0/2049762852 conn(0x5621fd055680 msgr2=0x5621fd0d7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.595+0000 7fa08bad4b80 1 -- 172.21.15.70:0/2049762852 shutdown_connections 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.595+0000 7fa08bad4b80 1 -- 172.21.15.70:0/2049762852 wait complete. 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.596+0000 7fa08bad4b80 1 -- start start 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.596+0000 7fa08bad4b80 1 Processor -- start 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 0x5621fd0e93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e3670 0x5621fd0e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621fd0ea100 con 0x5621fd0e3670 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5621fcf95ad0 con 0x5621fd0e2d50 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5621fd0ea280 con 0x5621fd0dda00 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa08bad4b80 10 client.0 _ll_register_callbacks cb 0x5621fcfd6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa07a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e3670 0x5621fd0e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa07a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e3670 0x5621fd0e6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34012/0 (socket says 172.21.15.70:34012) 2024-05-08T06:45:23.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa07a800700 1 -- 172.21.15.70:0/4074231039 learned_addr learned my addr 172.21.15.70:0/4074231039 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:23.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa07a800700 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 0x5621fd0e93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa071400700 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa07a800700 1 -- 172.21.15.70:0/4074231039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 msgr2=0x5621fd0e93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa07a800700 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 0x5621fd0e93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa07a800700 1 -- 172.21.15.70:0/4074231039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e2d50 msgr2=0x5621fd0e6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa07a800700 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.597+0000 7fa07a800700 1 -- 172.21.15.70:0/4074231039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621fcff53d0 con 0x5621fd0e3670 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.598+0000 7fa07a800700 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e3670 0x5621fd0e6c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa074016b20 tx=0x7fa074016d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b146fef71300db6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.598+0000 7fa05fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.598+0000 7fa05fe00700 1 -- 172.21.15.70:0/4074231039 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07401b040 con 0x5621fd0e3670 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.598+0000 7fa05fe00700 1 -- 172.21.15.70:0/4074231039 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fa07400e8e0 con 0x5621fd0e3670 2024-05-08T06:45:23.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.598+0000 7fa08bad4b80 1 -- 172.21.15.70:0/4074231039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa074016430 con 0x5621fd0e3670 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.598+0000 7fa05fe00700 1 -- 172.21.15.70:0/4074231039 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa074032050 con 0x5621fd0e3670 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.598+0000 7fa08bad4b80 10 client.15039 fetch_fsmap learned FSMap version 26 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.598+0000 7fa08bad4b80 1 -- 172.21.15.70:0/4074231039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5621fd0f4990 con 0x5621fd0e3670 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.599+0000 7fa05fe00700 1 -- 172.21.15.70:0/4074231039 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa074016430 con 0x5621fd0e3670 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.599+0000 7fa05fe00700 1 -- 172.21.15.70:0/4074231039 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa074021070 con 0x5621fd0e3670 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.599+0000 7fa08bad4b80 10 client.15039 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.599+0000 7fa08bad4b80 10 client.15039 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.599+0000 7fa08bad4b80 20 client.15039 populate_metadata read hostname 'smithi070' 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.599+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x5621fd0f6d70 0x5621fd0f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.599+0000 7fa08bad4b80 4 client.15039 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.599+0000 7fa08bad4b80 1 -- 172.21.15.70:0/4074231039 --> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621fd0aa0f0 con 0x5621fd0f6d70 2024-05-08T06:45:23.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.600+0000 7fa071400700 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x5621fd0f6d70 0x5621fd0f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.601+0000 7fa071400700 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x5621fd0f6d70 0x5621fd0f81e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0a6996e30b1ab4 server_cookie=97a4cb1629919f19 in_seq=0 out_seq=0 2024-05-08T06:45:23.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.601+0000 7fa05fe00700 10 client.15039 ms_handle_connect on v2:172.21.15.172:6836/2037790761 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa05fe00700 1 -- 172.21.15.70:0/4074231039 <== mds.1 v2:172.21.15.172:6836/2037790761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5621fd0aa0f0 con 0x5621fd0f6d70 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa05fe00700 10 client.15039 handle_command_reply: tid=0 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa08bad4b80 1 client.15039 shutdown 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa08bad4b80 1 -- 172.21.15.70:0/4074231039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e3670 msgr2=0x5621fd0e6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e3670 0x5621fd0e6c80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa074016b20 tx=0x7fa074016d50 comp rx=0 tx=0).stop 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa08bad4b80 1 -- 172.21.15.70:0/4074231039 shutdown_connections 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x5621fd0f6d70 0x5621fd0f81e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e3670 0x5621fd0e6c80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0dda00 0x5621fd0e93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/4074231039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa05fe00700 0 client.15039 ms_handle_reset on v2:172.21.15.172:6836/2037790761 2024-05-08T06:45:23.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.604+0000 7fa08bad4b80 1 -- 172.21.15.70:0/4074231039 >> 172.21.15.70:0/4074231039 conn(0x5621fd055680 msgr2=0x5621fd0d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:23.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.605+0000 7fa08bad4b80 1 -- 172.21.15.70:0/4074231039 shutdown_connections 2024-05-08T06:45:23.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.605+0000 7fa08bad4b80 1 -- 172.21.15.70:0/4074231039 wait complete. 2024-05-08T06:45:23.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.605+0000 7fa08bad4b80 20 client.15039 trim_cache size 0 max 16384 2024-05-08T06:45:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.627+0000 7fa08bad4b80 1 Processor -- start 2024-05-08T06:45:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.627+0000 7fa08bad4b80 1 -- start start 2024-05-08T06:45:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.628+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 0x5621fd0dd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.628+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.628+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 0x5621fd0d2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.628+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621fd0f6520 con 0x5621fd0e2d50 2024-05-08T06:45:23.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.628+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5621fd0f6bf0 con 0x5621fd0dda00 2024-05-08T06:45:23.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.628+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5621fd0f72c0 con 0x5621fd0e3670 2024-05-08T06:45:23.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.628+0000 7fa071400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.628+0000 7fa071400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34024/0 (socket says 172.21.15.70:34024) 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.628+0000 7fa071400700 1 -- 172.21.15.70:0/1784376013 learned_addr learned my addr 172.21.15.70:0/1784376013 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa07a800700 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 0x5621fd0dd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa07a800700 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 0x5621fd0d2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa071400700 1 -- 172.21.15.70:0/1784376013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 msgr2=0x5621fd0d2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa071400700 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 0x5621fd0d2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa071400700 1 -- 172.21.15.70:0/1784376013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 msgr2=0x5621fd0dd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa071400700 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 0x5621fd0dd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa071400700 1 -- 172.21.15.70:0/1784376013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621fd0e3380 con 0x5621fd0e2d50 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa07a800700 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 0x5621fd0d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa071400700 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6060 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa064005950 tx=0x7fa06400f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ad88eee73d4ff4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa06aa00700 1 -- 172.21.15.70:0/1784376013 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06400fe30 con 0x5621fd0e2d50 2024-05-08T06:45:23.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.629+0000 7fa06aa00700 1 -- 172.21.15.70:0/1784376013 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa064022070 con 0x5621fd0e2d50 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa06aa00700 1 -- 172.21.15.70:0/1784376013 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06401bb20 con 0x5621fd0e2d50 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1784376013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 msgr2=0x5621fd0e6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6060 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa064005950 tx=0x7fa06400f700 comp rx=0 tx=0).stop 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1784376013 shutdown_connections 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 0x5621fd0d2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 0x5621fd0dd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1784376013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd0e6060 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1784376013 >> 172.21.15.70:0/1784376013 conn(0x5621fd055680 msgr2=0x5621fd0e3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1784376013 shutdown_connections 2024-05-08T06:45:23.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.630+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1784376013 wait complete. 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.631+0000 7fa08bad4b80 1 -- start start 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.631+0000 7fa08bad4b80 1 Processor -- start 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.631+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 0x5621fd101660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.631+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa08bad4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 0x5621fd0fc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621fd0f8060 con 0x5621fd0e2d50 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5621fd0f7990 con 0x5621fd0dda00 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa08bad4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5621fd0f8730 con 0x5621fd0e3670 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa08bad4b80 10 client.0 _ll_register_callbacks cb 0x5621fcfd6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:45:23.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa071400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa071400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd101ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34032/0 (socket says 172.21.15.70:34032) 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa071400700 1 -- 172.21.15.70:0/1900558425 learned_addr learned my addr 172.21.15.70:0/1900558425 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa07a800700 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 0x5621fd101660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa07a800700 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 0x5621fd0fc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa071400700 1 -- 172.21.15.70:0/1900558425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 msgr2=0x5621fd0fc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa071400700 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 0x5621fd0fc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa071400700 1 -- 172.21.15.70:0/1900558425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 msgr2=0x5621fd101660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa071400700 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 0x5621fd101660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa071400700 1 -- 172.21.15.70:0/1900558425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621fd0fcb50 con 0x5621fd0e2d50 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.632+0000 7fa07a800700 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 0x5621fd101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.633+0000 7fa071400700 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd101ba0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa064021000 tx=0x7fa06400fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e1906f401f3404 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.633+0000 7fa05fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:45:23.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.633+0000 7fa05fe00700 1 -- 172.21.15.70:0/1900558425 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064004d60 con 0x5621fd0e2d50 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.633+0000 7fa05fe00700 1 -- 172.21.15.70:0/1900558425 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fa06401c470 con 0x5621fd0e2d50 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.633+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1900558425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa064022070 con 0x5621fd0e2d50 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.633+0000 7fa05fe00700 1 -- 172.21.15.70:0/1900558425 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa064038050 con 0x5621fd0e2d50 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.633+0000 7fa08bad4b80 10 client.15045 fetch_fsmap learned FSMap version 26 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.633+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1900558425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5621fd162990 con 0x5621fd0e2d50 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.634+0000 7fa05fe00700 1 -- 172.21.15.70:0/1900558425 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa064022070 con 0x5621fd0e2d50 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.634+0000 7fa05fe00700 1 -- 172.21.15.70:0/1900558425 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fa0640055a0 con 0x5621fd0e2d50 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.634+0000 7fa08bad4b80 10 client.15045 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.634+0000 7fa08bad4b80 10 client.15045 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.634+0000 7fa08bad4b80 20 client.15045 populate_metadata read hostname 'smithi070' 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.634+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x5621fd1671a0 0x5621fd165eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.634+0000 7fa08bad4b80 4 client.15045 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.634+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1900558425 --> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] -- command(tid 0: {"prefix": "status"}) -- 0x5621fd03d3b0 con 0x5621fd1671a0 2024-05-08T06:45:23.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.635+0000 7fa07a800700 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x5621fd1671a0 0x5621fd165eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.635+0000 7fa07a800700 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x5621fd1671a0 0x5621fd165eb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e3df68ddb1416467 server_cookie=6550d3bc25b81883 in_seq=0 out_seq=0 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.635+0000 7fa05fe00700 10 client.15045 ms_handle_connect on v2:172.21.15.172:6836/2037790761 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa05fe00700 1 -- 172.21.15.70:0/1900558425 <== mds.1 v2:172.21.15.172:6836/2037790761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5621fd03d3b0 con 0x5621fd1671a0 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa05fe00700 10 client.15045 handle_command_reply: tid=0 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 client.15045 shutdown 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1900558425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 msgr2=0x5621fd101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd101ba0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa064021000 tx=0x7fa06400fef0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1900558425 shutdown_connections 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x5621fd1671a0 0x5621fd165eb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5621fd0e3670 0x5621fd0fc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5621fd0dda00 0x5621fd101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 --2- 172.21.15.70:0/1900558425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5621fd0e2d50 0x5621fd101ba0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1900558425 >> 172.21.15.70:0/1900558425 conn(0x5621fd055680 msgr2=0x5621fd0e42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:23.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa05fe00700 0 client.15045 ms_handle_reset on v2:172.21.15.172:6836/2037790761 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1900558425 shutdown_connections 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.636+0000 7fa08bad4b80 1 -- 172.21.15.70:0/1900558425 wait complete. 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa08bad4b80 20 client.15045 trim_cache size 0 max 16384 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34409, 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:45:23.638 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:45:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 164.41396297399999, 2024-05-08T06:45:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 26, 2024-05-08T06:45:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 92, 2024-05-08T06:45:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 90, 2024-05-08T06:45:23.639 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 290.50485058300001 2024-05-08T06:45:23.639 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:45:23.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 -- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa0600b2880 msgr2=0x7fa0600b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa0600b2880 0x7fa0600b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0a82e0 tx=0x7fa06c0099e0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 -- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c1099e0 msgr2=0x7fa07c1a0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c1099e0 0x7fa07c1a0040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00b070 tx=0x7fa06c004ed0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 -- 172.21.15.70:0/1193981335 shutdown_connections 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa07c10e8b0 0x7fa07c1a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fa0600b2880 0x7fa0600b4d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa07c1099e0 0x7fa07c1a0040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 --2- 172.21.15.70:0/1193981335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa07c10a3a0 0x7fa07c1a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.637+0000 7fa07b200700 1 -- 172.21.15.70:0/1193981335 >> 172.21.15.70:0/1193981335 conn(0x7fa07c079230 msgr2=0x7fa07c0798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.638+0000 7fa07b200700 1 -- 172.21.15.70:0/1193981335 shutdown_connections 2024-05-08T06:45:23.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:23.638+0000 7fa07b200700 1 -- 172.21.15.70:0/1193981335 wait complete. 2024-05-08T06:45:23.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:23 smithi070 ceph-mon[29591]: pgmap v506: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:23.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:23 smithi172 ceph-mon[33377]: pgmap v506: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:24.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:23 smithi194 ceph-mon[33679]: pgmap v506: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:24.646 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-08T06:45:25.103 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:25.802 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:25 smithi070 ceph-mon[29591]: pgmap v507: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:25 smithi172 ceph-mon[33377]: pgmap v507: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:25 smithi194 ceph-mon[33679]: pgmap v507: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.535+0000 7f7dc6a00700 1 -- 172.21.15.70:0/2438683999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0103620 msgr2=0x7f7dc0103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.535+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/2438683999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0103620 0x7f7dc0103a00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7db40099c0 tx=0x7f7db4009cd0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.535+0000 7f7dc6a00700 1 -- 172.21.15.70:0/2438683999 shutdown_connections 2024-05-08T06:45:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.535+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/2438683999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc0108700 0x7f7dc01102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.535+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/2438683999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0103620 0x7f7dc0103a00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.535+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/2438683999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dc0103fd0 0x7f7dc0108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.535+0000 7f7dc6a00700 1 -- 172.21.15.70:0/2438683999 >> 172.21.15.70:0/2438683999 conn(0x7f7dc00feeb0 msgr2=0x7f7dc01012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.535+0000 7f7dc6a00700 1 -- 172.21.15.70:0/2438683999 shutdown_connections 2024-05-08T06:45:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.535+0000 7f7dc6a00700 1 -- 172.21.15.70:0/2438683999 wait complete. 2024-05-08T06:45:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.537+0000 7f7dc6a00700 1 Processor -- start 2024-05-08T06:45:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.537+0000 7f7dc6a00700 1 -- start start 2024-05-08T06:45:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.538+0000 7f7dc6a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dc0103620 0x7f7dc019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.538+0000 7f7dc6a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc0103fd0 0x7f7dc019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.538+0000 7f7dc6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0108700 0x7f7dc0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.538+0000 7f7dc6a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc0113540 con 0x7f7dc0108700 2024-05-08T06:45:27.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.538+0000 7f7dc6a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01133c0 con 0x7f7dc0103620 2024-05-08T06:45:27.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.538+0000 7f7dc6a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc01136c0 con 0x7f7dc0103fd0 2024-05-08T06:45:27.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.538+0000 7f7dc6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0108700 0x7f7dc0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.538+0000 7f7dc6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0108700 0x7f7dc0199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41226/0 (socket says 172.21.15.70:41226) 2024-05-08T06:45:27.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.538+0000 7f7dc6000700 1 -- 172.21.15.70:0/515855361 learned_addr learned my addr 172.21.15.70:0/515855361 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:27.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.539+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc0103fd0 0x7f7dc019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.539+0000 7f7dc5600700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dc0103620 0x7f7dc019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.539+0000 7f7dc6000700 1 -- 172.21.15.70:0/515855361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc0103fd0 msgr2=0x7f7dc019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:27.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.539+0000 7f7dc6000700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc0103fd0 0x7f7dc019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.539+0000 7f7dc6000700 1 -- 172.21.15.70:0/515855361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dc0103620 msgr2=0x7f7dc019f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:27.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.539+0000 7f7dc6000700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dc0103620 0x7f7dc019f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.539+0000 7f7dc6000700 1 -- 172.21.15.70:0/515855361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc019a080 con 0x7f7dc0108700 2024-05-08T06:45:27.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.539+0000 7f7dc5600700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dc0103620 0x7f7dc019f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:45:27.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.539+0000 7f7dc6000700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0108700 0x7f7dc0199920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7db800b970 tx=0x7f7db800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:27.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.540+0000 7f7dbe000700 1 -- 172.21.15.70:0/515855361 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8019070 con 0x7f7dc0108700 2024-05-08T06:45:27.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.540+0000 7f7dbe000700 1 -- 172.21.15.70:0/515855361 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7db800ce40 con 0x7f7dc0108700 2024-05-08T06:45:27.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.540+0000 7f7dc6a00700 1 -- 172.21.15.70:0/515855361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc019a370 con 0x7f7dc0108700 2024-05-08T06:45:27.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.540+0000 7f7dbe000700 1 -- 172.21.15.70:0/515855361 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8007370 con 0x7f7dc0108700 2024-05-08T06:45:27.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.540+0000 7f7dc6a00700 1 -- 172.21.15.70:0/515855361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc01a65e0 con 0x7f7dc0108700 2024-05-08T06:45:27.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.543+0000 7f7dbe000700 1 -- 172.21.15.70:0/515855361 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7db801c070 con 0x7f7dc0108700 2024-05-08T06:45:27.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.544+0000 7f7dd2947b80 1 Processor -- start 2024-05-08T06:45:27.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.544+0000 7f7dd2947b80 1 -- start start 2024-05-08T06:45:27.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a0fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a102b0 0x558428a09f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a0aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55842895c9d0 con 0x558428a0f990 2024-05-08T06:45:27.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5584288fa710 con 0x558428a0a5b0 2024-05-08T06:45:27.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558428958990 con 0x558428a102b0 2024-05-08T06:45:27.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dbe000700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7da80b2900 0x7f7da80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dc4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a0fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dbe000700 1 -- 172.21.15.70:0/515855361 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f7db80e1c00 con 0x7f7dc0108700 2024-05-08T06:45:27.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dc4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a0fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41230/0 (socket says 172.21.15.70:41230) 2024-05-08T06:45:27.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dc4c00700 1 -- 172.21.15.70:0/1368369973 learned_addr learned my addr 172.21.15.70:0/1368369973 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:27.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dc6000700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7da80b2900 0x7f7da80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dc4c00700 1 -- 172.21.15.70:0/1368369973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a102b0 msgr2=0x558428a09f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:27.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/1368369973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a102b0 0x558428a09f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dc4c00700 1 -- 172.21.15.70:0/1368369973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 msgr2=0x558428a0aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/1368369973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a0aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.545+0000 7f7dc4c00700 1 -- 172.21.15.70:0/1368369973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584288a9880 con 0x558428a0f990 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.546+0000 7f7dc6000700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7da80b2900 0x7f7da80b4dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7db80a8b60 tx=0x7f7db8004be0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.546+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/1368369973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a0fd70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006ea0 tx=0x7f7dac007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfa50a18d9f47b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.546+0000 7f7db2a00700 1 -- 172.21.15.70:0/1368369973 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00fad0 con 0x558428a0f990 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.546+0000 7f7db2a00700 1 -- 172.21.15.70:0/1368369973 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dac010040 con 0x558428a0f990 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.546+0000 7f7db2a00700 1 -- 172.21.15.70:0/1368369973 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac0133d0 con 0x558428a0f990 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.547+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1368369973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 msgr2=0x558428a0fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.547+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1368369973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a0fd70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006ea0 tx=0x7f7dac007cf0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.547+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1368369973 shutdown_connections 2024-05-08T06:45:27.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.547+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1368369973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a0aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.547+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1368369973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a0fd70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.547+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1368369973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a102b0 0x558428a09f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.547+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1368369973 >> 172.21.15.70:0/1368369973 conn(0x558428938b10 msgr2=0x558428a04960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:27.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.547+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1368369973 shutdown_connections 2024-05-08T06:45:27.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.547+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1368369973 wait complete. 2024-05-08T06:45:27.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.548+0000 7f7dd2947b80 1 -- start start 2024-05-08T06:45:27.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.548+0000 7f7dd2947b80 1 Processor -- start 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a15e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a13230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a102b0 0x558428a13770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558428a16d60 con 0x558428a0f990 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5584288c2ad0 con 0x558428a0a5b0 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558428a16ee0 con 0x558428a102b0 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dd2947b80 10 client.0 _ll_register_callbacks cb 0x558428903c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc5600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a13230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc5600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a13230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41236/0 (socket says 172.21.15.70:41236) 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc5600700 1 -- 172.21.15.70:0/1186801055 learned_addr learned my addr 172.21.15.70:0/1186801055 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a102b0 0x558428a13770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a15e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc5600700 1 -- 172.21.15.70:0/1186801055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a102b0 msgr2=0x558428a13770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc5600700 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a102b0 0x558428a13770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc5600700 1 -- 172.21.15.70:0/1186801055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 msgr2=0x558428a15e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc5600700 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a15e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.549+0000 7f7dc5600700 1 -- 172.21.15.70:0/1186801055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584289223d0 con 0x558428a0f990 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.550+0000 7f7dc5600700 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a13230 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7db40099c0 tx=0x7f7db400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2b94ca31c076d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.550+0000 7f7da7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.550+0000 7f7da7400700 1 -- 172.21.15.70:0/1186801055 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4027060 con 0x558428a0f990 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.550+0000 7f7da7400700 1 -- 172.21.15.70:0/1186801055 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f7db40054e0 con 0x558428a0f990 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.550+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1186801055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dac010040 con 0x558428a0f990 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.550+0000 7f7da7400700 1 -- 172.21.15.70:0/1186801055 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7db402e050 con 0x558428a0f990 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.550+0000 7f7dd2947b80 10 client.15057 fetch_fsmap learned FSMap version 26 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.550+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1186801055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558428a21490 con 0x558428a0f990 2024-05-08T06:45:27.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.550+0000 7f7da7400700 1 -- 172.21.15.70:0/1186801055 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dac010040 con 0x558428a0f990 2024-05-08T06:45:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.551+0000 7f7da7400700 1 -- 172.21.15.70:0/1186801055 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7db400f5d0 con 0x558428a0f990 2024-05-08T06:45:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.551+0000 7f7dd2947b80 10 client.15057 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:45:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.551+0000 7f7dd2947b80 10 client.15057 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T06:45:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.551+0000 7f7dd2947b80 20 client.15057 populate_metadata read hostname 'smithi070' 2024-05-08T06:45:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.551+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558428a23ab0 0x558428a24f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.551+0000 7f7dd2947b80 4 client.15057 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:45:27.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.551+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1186801055 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584289d7050 con 0x558428a23ab0 2024-05-08T06:45:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.552+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558428a23ab0 0x558428a24f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.553+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558428a23ab0 0x558428a24f20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3a57784ba00b2f9 server_cookie=3f5ffbf06faefed in_seq=0 out_seq=0 2024-05-08T06:45:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.553+0000 7f7da7400700 10 client.15057 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:45:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7da7400700 1 -- 172.21.15.70:0/1186801055 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5584289d7050 con 0x558428a23ab0 2024-05-08T06:45:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7da7400700 10 client.15057 handle_command_reply: tid=0 2024-05-08T06:45:27.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 client.15057 shutdown 2024-05-08T06:45:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1186801055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 msgr2=0x558428a13230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a13230 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7db40099c0 tx=0x7f7db400bf40 comp rx=0 tx=0).stop 2024-05-08T06:45:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1186801055 shutdown_connections 2024-05-08T06:45:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558428a23ab0 0x558428a24f20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a102b0 0x558428a13770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a15e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/1186801055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a0f990 0x558428a13230 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1186801055 >> 172.21.15.70:0/1186801055 conn(0x558428938b10 msgr2=0x5584289ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:27.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7da7400700 0 client.15057 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:45:27.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1186801055 shutdown_connections 2024-05-08T06:45:27.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 1 -- 172.21.15.70:0/1186801055 wait complete. 2024-05-08T06:45:27.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.555+0000 7f7dd2947b80 20 client.15057 trim_cache size 0 max 16384 2024-05-08T06:45:27.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.578+0000 7f7dd2947b80 1 Processor -- start 2024-05-08T06:45:27.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.578+0000 7f7dd2947b80 1 -- start start 2024-05-08T06:45:27.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.578+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a09f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.578+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 0x558428a11b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.578+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a12080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.578+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558428a23260 con 0x558428a102b0 2024-05-08T06:45:27.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.578+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558428a23930 con 0x558428a0a5b0 2024-05-08T06:45:27.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.578+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558428a24000 con 0x558428a0f990 2024-05-08T06:45:27.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a12080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a12080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41252/0 (socket says 172.21.15.70:41252) 2024-05-08T06:45:27.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 -- 172.21.15.70:0/3842009381 learned_addr learned my addr 172.21.15.70:0/3842009381 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:27.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/3842009381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a09f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc5600700 1 --2- 172.21.15.70:0/3842009381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 0x558428a11b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 -- 172.21.15.70:0/3842009381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 msgr2=0x558428a11b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:27.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/3842009381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 0x558428a11b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 -- 172.21.15.70:0/3842009381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 msgr2=0x558428a09f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:27.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/3842009381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a09f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 -- 172.21.15.70:0/3842009381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558428a15ad0 con 0x558428a102b0 2024-05-08T06:45:27.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.579+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/3842009381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a12080 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac006e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42abe829bd7fa37b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:27.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.580+0000 7f7db2000700 1 -- 172.21.15.70:0/3842009381 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac00f8d0 con 0x558428a102b0 2024-05-08T06:45:27.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.580+0000 7f7db2000700 1 -- 172.21.15.70:0/3842009381 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dac027260 con 0x558428a102b0 2024-05-08T06:45:27.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.580+0000 7f7db2000700 1 -- 172.21.15.70:0/3842009381 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac01e670 con 0x558428a102b0 2024-05-08T06:45:27.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.580+0000 7f7dd2947b80 1 -- 172.21.15.70:0/3842009381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 msgr2=0x558428a12080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:27.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.580+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/3842009381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a12080 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7dac006fd0 tx=0x7f7dac006e30 comp rx=0 tx=0).stop 2024-05-08T06:45:27.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.581+0000 7f7dd2947b80 1 -- 172.21.15.70:0/3842009381 shutdown_connections 2024-05-08T06:45:27.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.581+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/3842009381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a12080 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.581+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/3842009381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a09f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.581+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/3842009381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 0x558428a11b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.581+0000 7f7dd2947b80 1 -- 172.21.15.70:0/3842009381 >> 172.21.15.70:0/3842009381 conn(0x558428938b10 msgr2=0x558428a0d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.581+0000 7f7dd2947b80 1 -- 172.21.15.70:0/3842009381 shutdown_connections 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.581+0000 7f7dd2947b80 1 -- 172.21.15.70:0/3842009381 wait complete. 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.581+0000 7f7dd2947b80 1 -- start start 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.581+0000 7f7dd2947b80 1 Processor -- start 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a09380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 0x558428a098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dd2947b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a09e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558428a24da0 con 0x558428a102b0 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558428a246d0 con 0x558428a0a5b0 2024-05-08T06:45:27.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dd2947b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558428a25470 con 0x558428a0f990 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dd2947b80 10 client.0 _ll_register_callbacks cb 0x558428903c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dc4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a09e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dc4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a09e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41262/0 (socket says 172.21.15.70:41262) 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dc4c00700 1 -- 172.21.15.70:0/147932730 learned_addr learned my addr 172.21.15.70:0/147932730 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a09380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.582+0000 7f7dc5600700 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 0x558428a098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7dc4c00700 1 -- 172.21.15.70:0/147932730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 msgr2=0x558428a098c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 0x558428a098c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7dc4c00700 1 -- 172.21.15.70:0/147932730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 msgr2=0x558428a09380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a09380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7dc4c00700 1 -- 172.21.15.70:0/147932730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558428a2cad0 con 0x558428a102b0 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7dc4c00700 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a09e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7dac007320 tx=0x7f7dac016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba099c3eb1e8c4e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7da7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:45:27.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7da7400700 1 -- 172.21.15.70:0/147932730 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dac037020 con 0x558428a102b0 2024-05-08T06:45:27.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7da7400700 1 -- 172.21.15.70:0/147932730 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f7dac00f8d0 con 0x558428a102b0 2024-05-08T06:45:27.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7dd2947b80 1 -- 172.21.15.70:0/147932730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dac027260 con 0x558428a102b0 2024-05-08T06:45:27.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7da7400700 1 -- 172.21.15.70:0/147932730 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7dac00fad0 con 0x558428a102b0 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7dd2947b80 10 client.15063 fetch_fsmap learned FSMap version 26 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.583+0000 7f7dd2947b80 1 -- 172.21.15.70:0/147932730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x558428a8f3c0 con 0x558428a102b0 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.584+0000 7f7da7400700 1 -- 172.21.15.70:0/147932730 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dac027260 con 0x558428a102b0 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.584+0000 7f7da7400700 1 -- 172.21.15.70:0/147932730 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f7dac01e620 con 0x558428a102b0 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.584+0000 7f7dd2947b80 10 client.15063 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.584+0000 7f7dd2947b80 10 client.15063 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.584+0000 7f7dd2947b80 20 client.15063 populate_metadata read hostname 'smithi070' 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.584+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558428a93a40 0x558428a92750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.584+0000 7f7dd2947b80 4 client.15063 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.584+0000 7f7dd2947b80 1 -- 172.21.15.70:0/147932730 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "status"}) -- 0x55842896a3b0 con 0x558428a93a40 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.585+0000 7f7dc5600700 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558428a93a40 0x558428a92750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.586+0000 7f7dc5600700 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558428a93a40 0x558428a92750 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28276ec149137346 server_cookie=b0817d70c8a1d7e8 in_seq=0 out_seq=0 2024-05-08T06:45:27.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.586+0000 7f7da7400700 10 client.15063 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.586+0000 7f7da7400700 1 -- 172.21.15.70:0/147932730 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55842896a3b0 con 0x558428a93a40 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.586+0000 7f7da7400700 10 client.15063 handle_command_reply: tid=0 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.586+0000 7f7dd2947b80 1 client.15063 shutdown 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.586+0000 7f7dd2947b80 1 -- 172.21.15.70:0/147932730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 msgr2=0x558428a09e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.586+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a09e00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7dac007320 tx=0x7f7dac016040 comp rx=0 tx=0).stop 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dd2947b80 1 -- 172.21.15.70:0/147932730 shutdown_connections 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558428a93a40 0x558428a92750 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558428a102b0 0x558428a09e00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558428a0a5b0 0x558428a09380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dd2947b80 1 --2- 172.21.15.70:0/147932730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558428a0f990 0x558428a098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7da7400700 0 client.15063 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dd2947b80 1 -- 172.21.15.70:0/147932730 >> 172.21.15.70:0/147932730 conn(0x558428938b10 msgr2=0x558428a11ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dd2947b80 1 -- 172.21.15.70:0/147932730 shutdown_connections 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dd2947b80 1 -- 172.21.15.70:0/147932730 wait complete. 2024-05-08T06:45:27.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dd2947b80 20 client.15063 trim_cache size 0 max 16384 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34442, 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 254.00029457700001, 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 26, 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 92, 2024-05-08T06:45:27.588 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 90, 2024-05-08T06:45:27.589 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 276.98001257599998 2024-05-08T06:45:27.589 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:45:27.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dc6a00700 1 -- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7da80b2900 msgr2=0x7f7da80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:27.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7da80b2900 0x7f7da80b4dc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7db80a8b60 tx=0x7f7db8004be0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dc6a00700 1 -- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0108700 msgr2=0x7f7dc0199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:27.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.587+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0108700 0x7f7dc0199920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7db800b970 tx=0x7f7db800bd30 comp rx=0 tx=0).stop 2024-05-08T06:45:27.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.588+0000 7f7dc6a00700 1 -- 172.21.15.70:0/515855361 shutdown_connections 2024-05-08T06:45:27.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.588+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f7da80b2900 0x7f7da80b4dc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.588+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7dc0108700 0x7f7dc0199920 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.588+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7dc0103620 0x7f7dc019f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.588+0000 7f7dc6a00700 1 --2- 172.21.15.70:0/515855361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7dc0103fd0 0x7f7dc019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:27.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.588+0000 7f7dc6a00700 1 -- 172.21.15.70:0/515855361 >> 172.21.15.70:0/515855361 conn(0x7f7dc00feeb0 msgr2=0x7f7dc0100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:27.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.588+0000 7f7dc6a00700 1 -- 172.21.15.70:0/515855361 shutdown_connections 2024-05-08T06:45:27.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:27.588+0000 7f7dc6a00700 1 -- 172.21.15.70:0/515855361 wait complete. 2024-05-08T06:45:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:27 smithi070 ceph-mon[29591]: pgmap v508: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:27 smithi172 ceph-mon[33377]: pgmap v508: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:28.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:27 smithi194 ceph-mon[33679]: pgmap v508: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:28.631 INFO:tasks.cephadm:Setup complete, yielding 2024-05-08T06:45:28.631 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T06:45:28.642 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T06:45:28.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-08T06:45:29.100 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:29 smithi070 ceph-mon[29591]: pgmap v509: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:29 smithi172 ceph-mon[33377]: pgmap v509: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:30.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:29 smithi194 ceph-mon[33679]: pgmap v509: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.528+0000 7fc59da00700 1 -- 172.21.15.70:0/3723069116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981091f0 msgr2=0x7fc59810b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.528+0000 7fc59da00700 1 --2- 172.21.15.70:0/3723069116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981091f0 0x7fc59810b660 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc59000b0a0 tx=0x7fc59000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.528+0000 7fc59da00700 1 -- 172.21.15.70:0/3723069116 shutdown_connections 2024-05-08T06:45:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.528+0000 7fc59da00700 1 --2- 172.21.15.70:0/3723069116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981091f0 0x7fc59810b660 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.528+0000 7fc59da00700 1 --2- 172.21.15.70:0/3723069116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc598103f90 0x7fc598106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.528+0000 7fc59da00700 1 --2- 172.21.15.70:0/3723069116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5981068c0 0x7fc598108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.528+0000 7fc59da00700 1 -- 172.21.15.70:0/3723069116 >> 172.21.15.70:0/3723069116 conn(0x7fc5980fd9a0 msgr2=0x7fc5980ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:31.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.529+0000 7fc59da00700 1 -- 172.21.15.70:0/3723069116 shutdown_connections 2024-05-08T06:45:31.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.529+0000 7fc59da00700 1 -- 172.21.15.70:0/3723069116 wait complete. 2024-05-08T06:45:31.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc59da00700 1 Processor -- start 2024-05-08T06:45:31.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc59da00700 1 -- start start 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc59da00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc598103f90 0x7fc5981038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc59da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981068c0 0x7fc598101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc59da00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5981091f0 0x7fc598102480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc59da00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc59810ee80 con 0x7fc5981068c0 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc59da00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc59810ed00 con 0x7fc5981091f0 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc59da00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc59810f000 con 0x7fc598103f90 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc596000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981068c0 0x7fc598101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc596000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981068c0 0x7fc598101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41280/0 (socket says 172.21.15.70:41280) 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.530+0000 7fc596000700 1 -- 172.21.15.70:0/941342798 learned_addr learned my addr 172.21.15.70:0/941342798 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.531+0000 7fc596a00700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc598103f90 0x7fc5981038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.531+0000 7fc597400700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5981091f0 0x7fc598102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.531+0000 7fc596000700 1 -- 172.21.15.70:0/941342798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc598103f90 msgr2=0x7fc5981038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:31.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.531+0000 7fc596000700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc598103f90 0x7fc5981038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.531+0000 7fc596000700 1 -- 172.21.15.70:0/941342798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5981091f0 msgr2=0x7fc598102480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:31.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.531+0000 7fc596000700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5981091f0 0x7fc598102480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.531+0000 7fc596000700 1 -- 172.21.15.70:0/941342798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc598102d30 con 0x7fc5981068c0 2024-05-08T06:45:31.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.531+0000 7fc597400700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5981091f0 0x7fc598102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:31.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.531+0000 7fc596000700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981068c0 0x7fc598101f40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc58400d980 tx=0x7fc58400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:31.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.532+0000 7fc58f400700 1 -- 172.21.15.70:0/941342798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc584017070 con 0x7fc5981068c0 2024-05-08T06:45:31.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.532+0000 7fc58f400700 1 -- 172.21.15.70:0/941342798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc584004830 con 0x7fc5981068c0 2024-05-08T06:45:31.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.532+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5981a3740 con 0x7fc5981068c0 2024-05-08T06:45:31.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.532+0000 7fc58f400700 1 -- 172.21.15.70:0/941342798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5840053a0 con 0x7fc5981068c0 2024-05-08T06:45:31.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.532+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5981a3c50 con 0x7fc5981068c0 2024-05-08T06:45:31.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.533+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc59806a190 con 0x7fc5981068c0 2024-05-08T06:45:31.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.536+0000 7fc58f400700 1 -- 172.21.15.70:0/941342798 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc5840049e0 con 0x7fc5981068c0 2024-05-08T06:45:31.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.538+0000 7fc58f400700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc57c0b2900 0x7fc57c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:31.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.538+0000 7fc58f400700 1 -- 172.21.15.70:0/941342798 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fc5840e2930 con 0x7fc5981068c0 2024-05-08T06:45:31.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.538+0000 7fc596a00700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc57c0b2900 0x7fc57c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:31.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.539+0000 7fc596a00700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc57c0b2900 0x7fc57c0b4dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc58800bbd0 tx=0x7fc58800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:31.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.540+0000 7fc58f400700 1 -- 172.21.15.70:0/941342798 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc584020020 con 0x7fc5981068c0 2024-05-08T06:45:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.791+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fc5980638e0 con 0x7fc57c0b2900 2024-05-08T06:45:31.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:31 smithi070 ceph-mon[29591]: pgmap v510: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.793+0000 7fc58f400700 1 -- 172.21.15.70:0/941342798 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fc5980638e0 con 0x7fc57c0b2900 2024-05-08T06:45:31.792 INFO:teuthology.orchestra.run.smithi070.stdout:Backend: cephadm 2024-05-08T06:45:31.792 INFO:teuthology.orchestra.run.smithi070.stdout:Available: Yes 2024-05-08T06:45:31.793 INFO:teuthology.orchestra.run.smithi070.stdout:Paused: No 2024-05-08T06:45:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc57c0b2900 msgr2=0x7fc57c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc57c0b2900 0x7fc57c0b4dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc58800bbd0 tx=0x7fc58800b5b0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981068c0 msgr2=0x7fc598101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:31.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981068c0 0x7fc598101f40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc58400d980 tx=0x7fc58400dd40 comp rx=0 tx=0).stop 2024-05-08T06:45:31.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 shutdown_connections 2024-05-08T06:45:31.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5981091f0 0x7fc598102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc598103f90 0x7fc5981038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fc57c0b2900 0x7fc57c0b4dc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 --2- 172.21.15.70:0/941342798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5981068c0 0x7fc598101f40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:31.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.796+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 >> 172.21.15.70:0/941342798 conn(0x7fc5980fd9a0 msgr2=0x7fc598104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:31.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.797+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 shutdown_connections 2024-05-08T06:45:31.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:31.797+0000 7fc59da00700 1 -- 172.21.15.70:0/941342798 wait complete. 2024-05-08T06:45:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:31 smithi194 ceph-mon[33679]: pgmap v510: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:31 smithi172 ceph-mon[33377]: pgmap v510: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:32.715 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-08T06:45:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:32 smithi194 ceph-mon[33679]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:33.081 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:32 smithi172 ceph-mon[33377]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:32 smithi070 ceph-mon[29591]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:33.153 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:34.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:33 smithi194 ceph-mon[33679]: pgmap v511: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:33 smithi070 ceph-mon[29591]: pgmap v511: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:34.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:33 smithi172 ceph-mon[33377]: pgmap v511: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:35.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.595+0000 7f1c8e800700 1 -- 172.21.15.70:0/252086223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 msgr2=0x7f1c88105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:35.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.595+0000 7f1c8e800700 1 --2- 172.21.15.70:0/252086223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 0x7f1c88105a60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c0099c0 tx=0x7f1c7c009cd0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.595+0000 7f1c8e800700 1 -- 172.21.15.70:0/252086223 shutdown_connections 2024-05-08T06:45:35.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.595+0000 7f1c8e800700 1 --2- 172.21.15.70:0/252086223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c881071e0 0x7f1c8810da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.595+0000 7f1c8e800700 1 --2- 172.21.15.70:0/252086223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 0x7f1c88105a60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.595+0000 7f1c8e800700 1 --2- 172.21.15.70:0/252086223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c88106840 0x7f1c88106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.595+0000 7f1c8e800700 1 -- 172.21.15.70:0/252086223 >> 172.21.15.70:0/252086223 conn(0x7f1c88100be0 msgr2=0x7f1c88103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:35.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.595+0000 7f1c8e800700 1 -- 172.21.15.70:0/252086223 shutdown_connections 2024-05-08T06:45:35.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.595+0000 7f1c8e800700 1 -- 172.21.15.70:0/252086223 wait complete. 2024-05-08T06:45:35.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.596+0000 7f1c8e800700 1 Processor -- start 2024-05-08T06:45:35.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8e800700 1 -- start start 2024-05-08T06:45:35.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 0x7f1c8819b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8e800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88106840 0x7f1c8819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8e800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c881071e0 0x7f1c881a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8e800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1c88110fc0 con 0x7f1c88105640 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8e800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1c88110e40 con 0x7f1c881071e0 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8e800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1c88111140 con 0x7f1c88106840 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 0x7f1c8819b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 0x7f1c8819b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41300/0 (socket says 172.21.15.70:41300) 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.597+0000 7f1c8d400700 1 -- 172.21.15.70:0/2662092361 learned_addr learned my addr 172.21.15.70:0/2662092361 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c8ca00700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88106840 0x7f1c8819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c8de00700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c881071e0 0x7f1c881a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c8d400700 1 -- 172.21.15.70:0/2662092361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88106840 msgr2=0x7f1c8819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c8d400700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88106840 0x7f1c8819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c8d400700 1 -- 172.21.15.70:0/2662092361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c881071e0 msgr2=0x7f1c881a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c8d400700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c881071e0 0x7f1c881a2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c8d400700 1 -- 172.21.15.70:0/2662092361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c881a3340 con 0x7f1c88105640 2024-05-08T06:45:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c8de00700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c881071e0 0x7f1c881a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c8d400700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 0x7f1c8819b6e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00b580 tx=0x7f1c7c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c86000700 1 -- 172.21.15.70:0/2662092361 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c027070 con 0x7f1c88105640 2024-05-08T06:45:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c86000700 1 -- 172.21.15.70:0/2662092361 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c7c00bd30 con 0x7f1c88105640 2024-05-08T06:45:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.598+0000 7f1c86000700 1 -- 172.21.15.70:0/2662092361 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0037f0 con 0x7f1c88105640 2024-05-08T06:45:35.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.599+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c881a35d0 con 0x7f1c88105640 2024-05-08T06:45:35.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.599+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c881a39d0 con 0x7f1c88105640 2024-05-08T06:45:35.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.600+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c8806a190 con 0x7f1c88105640 2024-05-08T06:45:35.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.603+0000 7f1c86000700 1 -- 172.21.15.70:0/2662092361 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1c7c02a070 con 0x7f1c88105640 2024-05-08T06:45:35.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.605+0000 7f1c86000700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c700b2900 0x7f1c700b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:35.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.605+0000 7f1c86000700 1 -- 172.21.15.70:0/2662092361 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f1c7c0e37b0 con 0x7f1c88105640 2024-05-08T06:45:35.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.605+0000 7f1c8ca00700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c700b2900 0x7f1c700b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:35.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.606+0000 7f1c8ca00700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c700b2900 0x7f1c700b4dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1c74005950 tx=0x7f1c740058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:35.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.608+0000 7f1c86000700 1 -- 172.21.15.70:0/2662092361 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1c7c031080 con 0x7f1c88105640 2024-05-08T06:45:35.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.850+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1c880638e0 con 0x7f1c700b2900 2024-05-08T06:45:35.850 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:35 smithi070 ceph-mon[29591]: pgmap v512: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:35.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.897+0000 7f1c86000700 1 -- 172.21.15.70:0/2662092361 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f1c880638e0 con 0x7f1c700b2900 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.a smithi070 running (4m) 2m ago 4m 13.0M - 19.0.0-3538-gbee299f4 352576a2df49 81b92b14b79a 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.b smithi172 running (4m) 2m ago 4m 24.6M - 19.0.0-3538-gbee299f4 352576a2df49 ec1d4a357875 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.c smithi194 running (5m) 2m ago 5m 14.7M - 19.0.0-3538-gbee299f4 352576a2df49 62408756d133 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.d smithi070 running (5m) 2m ago 5m 13.0M - 19.0.0-3538-gbee299f4 352576a2df49 b66c6737f9e1 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.e smithi172 running (5m) 2m ago 5m 16.2M - 19.0.0-3538-gbee299f4 352576a2df49 6aafeff435d3 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.f smithi194 running (5m) 2m ago 5m 13.1M - 19.0.0-3538-gbee299f4 352576a2df49 00732f4e8438 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.g smithi070 running (4m) 2m ago 4m 13.0M - 19.0.0-3538-gbee299f4 352576a2df49 47a74fa6473f 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.h smithi172 running (5m) 2m ago 5m 16.0M - 19.0.0-3538-gbee299f4 352576a2df49 52df82662be3 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.i smithi194 running (4m) 2m ago 4m 14.6M - 19.0.0-3538-gbee299f4 352576a2df49 c832faa498d4 2024-05-08T06:45:35.898 INFO:teuthology.orchestra.run.smithi070.stdout:mds.j smithi070 running (5m) 2m ago 5m 13.1M - 19.0.0-3538-gbee299f4 352576a2df49 c21a1d87e7c2 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:mds.k smithi172 running (5m) 2m ago 5m 16.1M - 19.0.0-3538-gbee299f4 352576a2df49 14898a50e743 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:mds.l smithi194 running (5m) 2m ago 5m 13.3M - 19.0.0-3538-gbee299f4 352576a2df49 d20071ef51b7 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.x smithi070 *:9283,8765 running (15m) 2m ago 15m 530M - 19.0.0-3538-gbee299f4 352576a2df49 b3eb8e91a91d 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.y smithi172 *:8443,8765 running (12m) 2m ago 12m 467M - 19.0.0-3538-gbee299f4 352576a2df49 1705bf982e23 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.z smithi194 *:8443,8765 running (12m) 2m ago 12m 467M - 19.0.0-3538-gbee299f4 352576a2df49 16d92c7bdac7 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a smithi070 running (15m) 2m ago 15m 51.9M 2048M 19.0.0-3538-gbee299f4 352576a2df49 65b3c1175be8 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b smithi172 running (13m) 2m ago 13m 40.3M 2048M 19.0.0-3538-gbee299f4 352576a2df49 561491463ef6 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c smithi194 running (13m) 2m ago 13m 40.6M 2048M 19.0.0-3538-gbee299f4 352576a2df49 b7a8571bfaf5 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 smithi070 running (12m) 2m ago 12m 52.5M 4272M 19.0.0-3538-gbee299f4 352576a2df49 65937b9a2c53 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 smithi172 running (11m) 2m ago 11m 45.4M 4272M 19.0.0-3538-gbee299f4 352576a2df49 322768becd85 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 smithi194 running (11m) 2m ago 11m 45.7M 4272M 19.0.0-3538-gbee299f4 352576a2df49 6fd089774f83 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 smithi070 running (10m) 2m ago 10m 44.1M 4272M 19.0.0-3538-gbee299f4 352576a2df49 44356bbb8903 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 smithi172 running (10m) 2m ago 10m 52.6M 4272M 19.0.0-3538-gbee299f4 352576a2df49 a56602009f5c 2024-05-08T06:45:35.899 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 smithi194 running (9m) 2m ago 9m 51.4M 4272M 19.0.0-3538-gbee299f4 352576a2df49 a039aaf2b0ce 2024-05-08T06:45:35.900 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 smithi070 running (8m) 2m ago 8m 48.0M 4272M 19.0.0-3538-gbee299f4 352576a2df49 b9383ac892d4 2024-05-08T06:45:35.900 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 smithi172 running (8m) 2m ago 8m 52.3M 4272M 19.0.0-3538-gbee299f4 352576a2df49 0cbc5c49cc60 2024-05-08T06:45:35.900 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 smithi194 running (7m) 2m ago 7m 42.9M 4272M 19.0.0-3538-gbee299f4 352576a2df49 9d3c72844e9d 2024-05-08T06:45:35.900 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 smithi070 running (7m) 2m ago 7m 49.3M 4272M 19.0.0-3538-gbee299f4 352576a2df49 4f2069fd48c8 2024-05-08T06:45:35.900 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 smithi172 running (6m) 2m ago 6m 51.4M 4272M 19.0.0-3538-gbee299f4 352576a2df49 84dedf7809d5 2024-05-08T06:45:35.900 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 smithi194 running (5m) 2m ago 5m 40.9M 4272M 19.0.0-3538-gbee299f4 352576a2df49 30c94bac5a15 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c700b2900 msgr2=0x7f1c700b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c700b2900 0x7f1c700b4dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1c74005950 tx=0x7f1c740058e0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 msgr2=0x7f1c8819b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 0x7f1c8819b6e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00b580 tx=0x7f1c7c009580 comp rx=0 tx=0).stop 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 shutdown_connections 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1c881071e0 0x7f1c881a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f1c700b2900 0x7f1c700b4dc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1c88105640 0x7f1c8819b6e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 --2- 172.21.15.70:0/2662092361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1c88106840 0x7f1c8819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 >> 172.21.15.70:0/2662092361 conn(0x7f1c88100be0 msgr2=0x7f1c88109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:35.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.901+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 shutdown_connections 2024-05-08T06:45:35.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:35.902+0000 7f1c8e800700 1 -- 172.21.15.70:0/2662092361 wait complete. 2024-05-08T06:45:36.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:35 smithi194 ceph-mon[33679]: pgmap v512: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:35 smithi172 ceph-mon[33377]: pgmap v512: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:36.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-08T06:45:36.965 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:36 smithi070 ceph-mon[29591]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:37.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:36 smithi194 ceph-mon[33679]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:36 smithi172 ceph-mon[33377]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:37.329 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:37.736 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:37 smithi070 ceph-mon[29591]: pgmap v513: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:38.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:37 smithi194 ceph-mon[33679]: pgmap v513: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:37 smithi172 ceph-mon[33377]: pgmap v513: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:39.809 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:39 smithi070 ceph-mon[29591]: pgmap v514: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:39.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.861+0000 7fbbafa00700 1 -- 172.21.15.70:0/1515640889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 msgr2=0x7fbba8106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:39.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.861+0000 7fbbafa00700 1 --2- 172.21.15.70:0/1515640889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 0x7fbba8106380 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c009990 tx=0x7fbb9c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:45:39.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.861+0000 7fbbafa00700 1 -- 172.21.15.70:0/1515640889 shutdown_connections 2024-05-08T06:45:39.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.861+0000 7fbbafa00700 1 --2- 172.21.15.70:0/1515640889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81091f0 0x7fbba810b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:39.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.861+0000 7fbbafa00700 1 --2- 172.21.15.70:0/1515640889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 0x7fbba8106380 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:39.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.861+0000 7fbbafa00700 1 --2- 172.21.15.70:0/1515640889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba81068c0 0x7fbba8108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:39.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.861+0000 7fbbafa00700 1 -- 172.21.15.70:0/1515640889 >> 172.21.15.70:0/1515640889 conn(0x7fbba80fd9a0 msgr2=0x7fbba80ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:39.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.861+0000 7fbbafa00700 1 -- 172.21.15.70:0/1515640889 shutdown_connections 2024-05-08T06:45:39.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.861+0000 7fbbafa00700 1 -- 172.21.15.70:0/1515640889 wait complete. 2024-05-08T06:45:39.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.862+0000 7fbbafa00700 1 Processor -- start 2024-05-08T06:45:39.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbafa00700 1 -- start start 2024-05-08T06:45:39.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbafa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 0x7fbba81038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbafa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba81068c0 0x7fbba8101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbafa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81091f0 0x7fbba8102480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbafa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbba810eec0 con 0x7fbba8103f90 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbafa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbba810ed40 con 0x7fbba81068c0 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbafa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbba810f040 con 0x7fbba81091f0 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbad000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 0x7fbba81038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbad000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 0x7fbba81038f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55600/0 (socket says 172.21.15.70:55600) 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.863+0000 7fbbad000700 1 -- 172.21.15.70:0/4194364234 learned_addr learned my addr 172.21.15.70:0/4194364234 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.864+0000 7fbba7e00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba81068c0 0x7fbba8101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.864+0000 7fbbad000700 1 -- 172.21.15.70:0/4194364234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81091f0 msgr2=0x7fbba8102480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.864+0000 7fbbad000700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81091f0 0x7fbba8102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:39.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.864+0000 7fbbad000700 1 -- 172.21.15.70:0/4194364234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba81068c0 msgr2=0x7fbba8101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:39.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.864+0000 7fbbad000700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba81068c0 0x7fbba8101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:39.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.864+0000 7fbbad000700 1 -- 172.21.15.70:0/4194364234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbba8102d30 con 0x7fbba8103f90 2024-05-08T06:45:39.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.864+0000 7fbba7e00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba81068c0 0x7fbba8101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:39.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.864+0000 7fbbad000700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 0x7fbba81038f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c000c00 tx=0x7fbb9c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:39.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.865+0000 7fbba5600700 1 -- 172.21.15.70:0/4194364234 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c003c10 con 0x7fbba8103f90 2024-05-08T06:45:39.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.865+0000 7fbba5600700 1 -- 172.21.15.70:0/4194364234 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb9c004830 con 0x7fbba8103f90 2024-05-08T06:45:39.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.865+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbba81a3680 con 0x7fbba8103f90 2024-05-08T06:45:39.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.865+0000 7fbba5600700 1 -- 172.21.15.70:0/4194364234 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb9c005350 con 0x7fbba8103f90 2024-05-08T06:45:39.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.865+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbba81a3a70 con 0x7fbba8103f90 2024-05-08T06:45:39.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.866+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbba806a190 con 0x7fbba8103f90 2024-05-08T06:45:39.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.870+0000 7fbba5600700 1 -- 172.21.15.70:0/4194364234 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbb9c0054f0 con 0x7fbba8103f90 2024-05-08T06:45:39.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.871+0000 7fbba5600700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbb900b2880 0x7fbb900b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:39.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.871+0000 7fbba5600700 1 -- 172.21.15.70:0/4194364234 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fbb9c0e3850 con 0x7fbba8103f90 2024-05-08T06:45:39.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.871+0000 7fbba7e00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbb900b2880 0x7fbb900b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:39.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.872+0000 7fbba7e00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbb900b2880 0x7fbb900b4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb94005fd0 tx=0x7fbb94005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:39.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:39.874+0000 7fbba5600700 1 -- 172.21.15.70:0/4194364234 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbb9c013070 con 0x7fbba8103f90 2024-05-08T06:45:40.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:39 smithi194 ceph-mon[33679]: pgmap v514: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:40.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.113+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fbba80638e0 con 0x7fbb900b2880 2024-05-08T06:45:40.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.122+0000 7fbba5600700 1 -- 172.21.15.70:0/4194364234 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fbba80638e0 con 0x7fbb900b2880 2024-05-08T06:45:40.122 INFO:teuthology.orchestra.run.smithi070.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-08T06:45:40.122 INFO:teuthology.orchestra.run.smithi070.stdout:mds.all 12/12 2m ago 5m smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi172=b;smithi172=e;smithi172=h;smithi172=k;smithi194=c;smithi194=f;smithi194=i;smithi194=l;count:12 2024-05-08T06:45:40.122 INFO:teuthology.orchestra.run.smithi070.stdout:mgr 3/3 2m ago 12m smithi070=x;smithi172=y;smithi194=z;count:3 2024-05-08T06:45:40.122 INFO:teuthology.orchestra.run.smithi070.stdout:mon 3/3 2m ago 13m smithi070:172.21.15.70=a;smithi172:172.21.15.172=b;smithi194:172.21.15.194=c;count:3 2024-05-08T06:45:40.123 INFO:teuthology.orchestra.run.smithi070.stdout:osd 12 2m ago - 2024-05-08T06:45:40.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbb900b2880 msgr2=0x7fbb900b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:40.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbb900b2880 0x7fbb900b4d40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbb94005fd0 tx=0x7fbb94005e20 comp rx=0 tx=0).stop 2024-05-08T06:45:40.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 msgr2=0x7fbba81038f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:40.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 0x7fbba81038f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c000c00 tx=0x7fbb9c0047b0 comp rx=0 tx=0).stop 2024-05-08T06:45:40.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 shutdown_connections 2024-05-08T06:45:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbba81091f0 0x7fbba8102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbb900b2880 0x7fbb900b4d40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbba8103f90 0x7fbba81038f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 --2- 172.21.15.70:0/4194364234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbba81068c0 0x7fbba8101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 >> 172.21.15.70:0/4194364234 conn(0x7fbba80fd9a0 msgr2=0x7fbba8105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 shutdown_connections 2024-05-08T06:45:40.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:40.126+0000 7fbbafa00700 1 -- 172.21.15.70:0/4194364234 wait complete. 2024-05-08T06:45:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:39 smithi172 ceph-mon[33377]: pgmap v514: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:41.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-08T06:45:41.540 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:41.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:41 smithi070 ceph-mon[29591]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:41.942 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:41 smithi070 ceph-mon[29591]: pgmap v515: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:42.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:41 smithi194 ceph-mon[33679]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:42.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:41 smithi194 ceph-mon[33679]: pgmap v515: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:41 smithi172 ceph-mon[33377]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:41 smithi172 ceph-mon[33377]: pgmap v515: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:44.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:43 smithi194 ceph-mon[33679]: pgmap v516: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:44.011 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:43 smithi070 ceph-mon[29591]: pgmap v516: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.068+0000 7fd2fbe00700 1 -- 172.21.15.70:0/1962657134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc1067f0 msgr2=0x7fd2fc108be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.068+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/1962657134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc1067f0 0x7fd2fc108be0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009990 tx=0x7fd2e8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.068+0000 7fd2fbe00700 1 -- 172.21.15.70:0/1962657134 shutdown_connections 2024-05-08T06:45:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.068+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/1962657134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc109120 0x7fd2fc10b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.068+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/1962657134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2fc103ec0 0x7fd2fc1062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.068+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/1962657134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc1067f0 0x7fd2fc108be0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.068+0000 7fd2fbe00700 1 -- 172.21.15.70:0/1962657134 >> 172.21.15.70:0/1962657134 conn(0x7fd2fc0fd8d0 msgr2=0x7fd2fc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.068+0000 7fd2fbe00700 1 -- 172.21.15.70:0/1962657134 shutdown_connections 2024-05-08T06:45:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.068+0000 7fd2fbe00700 1 -- 172.21.15.70:0/1962657134 wait complete. 2024-05-08T06:45:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.069+0000 7fd2fbe00700 1 Processor -- start 2024-05-08T06:45:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.069+0000 7fd2fbe00700 1 -- start start 2024-05-08T06:45:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc103ec0 0x7fd2fc19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2fbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2fc1067f0 0x7fd2fc19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2fbe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc109120 0x7fd2fc1a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2fbe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc10edf0 con 0x7fd2fc103ec0 2024-05-08T06:45:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2fbe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc10ec70 con 0x7fd2fc1067f0 2024-05-08T06:45:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2fbe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc10ef70 con 0x7fd2fc109120 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2faa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc103ec0 0x7fd2fc19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2faa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc103ec0 0x7fd2fc19b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55622/0 (socket says 172.21.15.70:55622) 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2faa00700 1 -- 172.21.15.70:0/3255533667 learned_addr learned my addr 172.21.15.70:0/3255533667 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2fa000700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2fc1067f0 0x7fd2fc19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2fb400700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc109120 0x7fd2fc1a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2faa00700 1 -- 172.21.15.70:0/3255533667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc109120 msgr2=0x7fd2fc1a2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2faa00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc109120 0x7fd2fc1a2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2faa00700 1 -- 172.21.15.70:0/3255533667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2fc1067f0 msgr2=0x7fd2fc19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2faa00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2fc1067f0 0x7fd2fc19bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2faa00700 1 -- 172.21.15.70:0/3255533667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2fc1a3350 con 0x7fd2fc103ec0 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.070+0000 7fd2fb400700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc109120 0x7fd2fc1a2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:45:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.071+0000 7fd2faa00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc103ec0 0x7fd2fc19b790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00d980 tx=0x7fd2ec00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.071+0000 7fd300a00700 1 -- 172.21.15.70:0/3255533667 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec016070 con 0x7fd2fc103ec0 2024-05-08T06:45:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.071+0000 7fd300a00700 1 -- 172.21.15.70:0/3255533667 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2ec010460 con 0x7fd2fc103ec0 2024-05-08T06:45:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.071+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2fc1a3640 con 0x7fd2fc103ec0 2024-05-08T06:45:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.071+0000 7fd300a00700 1 -- 172.21.15.70:0/3255533667 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec00f620 con 0x7fd2fc103ec0 2024-05-08T06:45:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.071+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2fc1a3b80 con 0x7fd2fc103ec0 2024-05-08T06:45:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.073+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2fc06a190 con 0x7fd2fc103ec0 2024-05-08T06:45:44.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.075+0000 7fd300a00700 1 -- 172.21.15.70:0/3255533667 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd2ec019070 con 0x7fd2fc103ec0 2024-05-08T06:45:44.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.077+0000 7fd300a00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd2e00b2880 0x7fd2e00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:44.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.078+0000 7fd300a00700 1 -- 172.21.15.70:0/3255533667 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fd2ec0e1c60 con 0x7fd2fc103ec0 2024-05-08T06:45:44.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.078+0000 7fd2fa000700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd2e00b2880 0x7fd2e00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:44.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.078+0000 7fd2fa000700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd2e00b2880 0x7fd2e00b4d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8006010 tx=0x7fd2e80037e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:44.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.082+0000 7fd300a00700 1 -- 172.21.15.70:0/3255533667 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd2ec0a9590 con 0x7fd2fc103ec0 2024-05-08T06:45:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:43 smithi172 ceph-mon[33377]: pgmap v516: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.321+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fd2fc0638e0 con 0x7fd2e00b2880 2024-05-08T06:45:44.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.325+0000 7fd300a00700 1 -- 172.21.15.70:0/3255533667 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fd2fc0638e0 con 0x7fd2e00b2880 2024-05-08T06:45:44.324 INFO:teuthology.orchestra.run.smithi070.stdout:HOST ADDR LABELS STATUS 2024-05-08T06:45:44.325 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 172.21.15.70 2024-05-08T06:45:44.325 INFO:teuthology.orchestra.run.smithi070.stdout:smithi172 172.21.15.172 2024-05-08T06:45:44.325 INFO:teuthology.orchestra.run.smithi070.stdout:smithi194 172.21.15.194 2024-05-08T06:45:44.325 INFO:teuthology.orchestra.run.smithi070.stdout:3 hosts in cluster 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd2e00b2880 msgr2=0x7fd2e00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd2e00b2880 0x7fd2e00b4d40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8006010 tx=0x7fd2e80037e0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc103ec0 msgr2=0x7fd2fc19b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc103ec0 0x7fd2fc19b790 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00d980 tx=0x7fd2ec00dd40 comp rx=0 tx=0).stop 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 shutdown_connections 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc109120 0x7fd2fc1a2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd2e00b2880 0x7fd2e00b4d40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc103ec0 0x7fd2fc19b790 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 --2- 172.21.15.70:0/3255533667 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2fc1067f0 0x7fd2fc19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 >> 172.21.15.70:0/3255533667 conn(0x7fd2fc0fd8d0 msgr2=0x7fd2fc1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:44.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.328+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 shutdown_connections 2024-05-08T06:45:44.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:44.329+0000 7fd2fbe00700 1 -- 172.21.15.70:0/3255533667 wait complete. 2024-05-08T06:45:45.285 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-08T06:45:45.725 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:46.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:45 smithi194 ceph-mon[33679]: pgmap v517: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:46.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:45 smithi194 ceph-mon[33679]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:46.082 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:45 smithi070 ceph-mon[29591]: pgmap v517: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:46.082 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:45 smithi070 ceph-mon[29591]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:46.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:45 smithi172 ceph-mon[33377]: pgmap v517: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:46.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:45 smithi172 ceph-mon[33377]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:47.816 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:47 smithi070 ceph-mon[29591]: pgmap v518: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:48.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:47 smithi194 ceph-mon[33679]: pgmap v518: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:47 smithi172 ceph-mon[33377]: pgmap v518: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:48.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.139+0000 7fdede000700 1 -- 172.21.15.70:0/1590601506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded810fa10 msgr2=0x7fded8111e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:48.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.139+0000 7fdede000700 1 --2- 172.21.15.70:0/1590601506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded810fa10 0x7fded8111e00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fded000b0a0 tx=0x7fded000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.139+0000 7fdede000700 1 -- 172.21.15.70:0/1590601506 shutdown_connections 2024-05-08T06:45:48.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.139+0000 7fdede000700 1 --2- 172.21.15.70:0/1590601506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded810fa10 0x7fded8111e00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.139+0000 7fdede000700 1 --2- 172.21.15.70:0/1590601506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fded80774d0 0x7fded8075930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.139+0000 7fdede000700 1 --2- 172.21.15.70:0/1590601506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fded8075f00 0x7fded8076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.139+0000 7fdede000700 1 -- 172.21.15.70:0/1590601506 >> 172.21.15.70:0/1590601506 conn(0x7fded80fe9d0 msgr2=0x7fded8100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:48.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.140+0000 7fdede000700 1 -- 172.21.15.70:0/1590601506 shutdown_connections 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.140+0000 7fdede000700 1 -- 172.21.15.70:0/1590601506 wait complete. 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.141+0000 7fdede000700 1 Processor -- start 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.141+0000 7fdede000700 1 -- start start 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdede000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fded8075f00 0x7fded819fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdede000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded80774d0 0x7fded819ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdede000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fded810fa10 0x7fded81a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdede000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fded8115390 con 0x7fded80774d0 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdede000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fded8115210 con 0x7fded810fa10 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdede000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fded8115510 con 0x7fded8075f00 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdecfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded80774d0 0x7fded819ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdecfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded80774d0 0x7fded819ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36472/0 (socket says 172.21.15.70:36472) 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdecfe00700 1 -- 172.21.15.70:0/2487256614 learned_addr learned my addr 172.21.15.70:0/2487256614 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdedcc00700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fded8075f00 0x7fded819fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:48.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdedd600700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fded810fa10 0x7fded81a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdecfe00700 1 -- 172.21.15.70:0/2487256614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fded8075f00 msgr2=0x7fded819fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdecfe00700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fded8075f00 0x7fded819fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdecfe00700 1 -- 172.21.15.70:0/2487256614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fded810fa10 msgr2=0x7fded81a6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdecfe00700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fded810fa10 0x7fded81a6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.142+0000 7fdecfe00700 1 -- 172.21.15.70:0/2487256614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded81a7690 con 0x7fded80774d0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.143+0000 7fdedcc00700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fded8075f00 0x7fded819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.143+0000 7fdecfe00700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded80774d0 0x7fded819ffc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdec400d9b0 tx=0x7fdec400dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.143+0000 7fded6000700 1 -- 172.21.15.70:0/2487256614 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4017070 con 0x7fded80774d0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.143+0000 7fded6000700 1 -- 172.21.15.70:0/2487256614 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdec4010460 con 0x7fded80774d0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.143+0000 7fded6000700 1 -- 172.21.15.70:0/2487256614 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec400f620 con 0x7fded80774d0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.143+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded81a7980 con 0x7fded80774d0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.143+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded81a7e70 con 0x7fded80774d0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.144+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded806a190 con 0x7fded80774d0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.147+0000 7fded6000700 1 -- 172.21.15.70:0/2487256614 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdec4010610 con 0x7fded80774d0 2024-05-08T06:45:48.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.148+0000 7fded6000700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdeb40b2900 0x7fdeb40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:48.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.148+0000 7fded6000700 1 -- 172.21.15.70:0/2487256614 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fdec40e21b0 con 0x7fded80774d0 2024-05-08T06:45:48.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.148+0000 7fdedcc00700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdeb40b2900 0x7fdeb40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:48.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.149+0000 7fdedcc00700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdeb40b2900 0x7fdeb40b4dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdebc005950 tx=0x7fdebc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:48.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.153+0000 7fded6000700 1 -- 172.21.15.70:0/2487256614 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdec40a9a80 con 0x7fded80774d0 2024-05-08T06:45:48.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.401+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fded80638e0 con 0x7fdeb40b2900 2024-05-08T06:45:48.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.405+0000 7fded6000700 1 -- 172.21.15.70:0/2487256614 <== mgr.14152 v2:172.21.15.70:6800/3718531938 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fded80638e0 con 0x7fdeb40b2900 2024-05-08T06:45:48.405 INFO:teuthology.orchestra.run.smithi070.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-08T06:45:48.405 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002P480DGN 447G No 7m ago Has a FileSystem, LVM detected 2024-05-08T06:45:48.405 INFO:teuthology.orchestra.run.smithi070.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-05-08T06:45:48.405 INFO:teuthology.orchestra.run.smithi070.stdout:smithi194 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6240002A400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-05-08T06:45:48.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.408+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdeb40b2900 msgr2=0x7fdeb40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:48.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.408+0000 7fdede000700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdeb40b2900 0x7fdeb40b4dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdebc005950 tx=0x7fdebc0058e0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.408+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded80774d0 msgr2=0x7fded819ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:48.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.408+0000 7fdede000700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded80774d0 0x7fded819ffc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdec400d9b0 tx=0x7fdec400dd70 comp rx=0 tx=0).stop 2024-05-08T06:45:48.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.409+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 shutdown_connections 2024-05-08T06:45:48.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.409+0000 7fdede000700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fded810fa10 0x7fded81a6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.409+0000 7fdede000700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fded8075f00 0x7fded819fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.409+0000 7fdede000700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fdeb40b2900 0x7fdeb40b4dc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.409+0000 7fdede000700 1 --2- 172.21.15.70:0/2487256614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fded80774d0 0x7fded819ffc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:48.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.409+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 >> 172.21.15.70:0/2487256614 conn(0x7fded80fe9d0 msgr2=0x7fded8102db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:48.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.409+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 shutdown_connections 2024-05-08T06:45:48.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:48.409+0000 7fdede000700 1 -- 172.21.15.70:0/2487256614 wait complete. 2024-05-08T06:45:49.397 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T06:45:49.407 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T06:45:49.407 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-08T06:45:49.858 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:50.077 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:49 smithi070 ceph-mon[29591]: pgmap v519: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:50.077 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:49 smithi070 ceph-mon[29591]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:49 smithi172 ceph-mon[33377]: pgmap v519: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:49 smithi172 ceph-mon[33377]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:49 smithi194 ceph-mon[33679]: pgmap v519: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:49 smithi194 ceph-mon[33679]: from='client.15093 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:45:52.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:51 smithi070 ceph-mon[29591]: pgmap v520: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:51 smithi172 ceph-mon[33377]: pgmap v520: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:51 smithi194 ceph-mon[33679]: pgmap v520: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:45:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.327+0000 7fbc33e00700 1 -- 172.21.15.70:0/470184562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc340774d0 msgr2=0x7fbc34075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.327+0000 7fbc33e00700 1 --2- 172.21.15.70:0/470184562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc340774d0 0x7fbc34075930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009990 tx=0x7fbc24009ca0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.328+0000 7fbc33e00700 1 -- 172.21.15.70:0/470184562 shutdown_connections 2024-05-08T06:45:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.328+0000 7fbc33e00700 1 --2- 172.21.15.70:0/470184562 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc3410b300 0x7fbc3410d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.328+0000 7fbc33e00700 1 --2- 172.21.15.70:0/470184562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc340774d0 0x7fbc34075930 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.328+0000 7fbc33e00700 1 --2- 172.21.15.70:0/470184562 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc34075f00 0x7fbc34076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.328+0000 7fbc33e00700 1 -- 172.21.15.70:0/470184562 >> 172.21.15.70:0/470184562 conn(0x7fbc340fe9d0 msgr2=0x7fbc34100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.328+0000 7fbc33e00700 1 -- 172.21.15.70:0/470184562 shutdown_connections 2024-05-08T06:45:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.328+0000 7fbc33e00700 1 -- 172.21.15.70:0/470184562 wait complete. 2024-05-08T06:45:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.329+0000 7fbc33e00700 1 Processor -- start 2024-05-08T06:45:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.329+0000 7fbc33e00700 1 -- start start 2024-05-08T06:45:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.329+0000 7fbc33e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc34075f00 0x7fbc34106710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc33e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc340774d0 0x7fbc34106c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc33e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc3410b300 0x7fbc34103290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc33e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34110fa0 con 0x7fbc34075f00 2024-05-08T06:45:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc33e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34110e20 con 0x7fbc3410b300 2024-05-08T06:45:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc33e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbc34111120 con 0x7fbc340774d0 2024-05-08T06:45:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc32a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc34075f00 0x7fbc34106710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc32a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc34075f00 0x7fbc34106710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36498/0 (socket says 172.21.15.70:36498) 2024-05-08T06:45:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc32a00700 1 -- 172.21.15.70:0/666044611 learned_addr learned my addr 172.21.15.70:0/666044611 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc2be00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc340774d0 0x7fbc34106c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.330+0000 7fbc33400700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc3410b300 0x7fbc34103290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:52.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.331+0000 7fbc32a00700 1 -- 172.21.15.70:0/666044611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc340774d0 msgr2=0x7fbc34106c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:52.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.331+0000 7fbc32a00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc340774d0 0x7fbc34106c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.331+0000 7fbc32a00700 1 -- 172.21.15.70:0/666044611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc3410b300 msgr2=0x7fbc34103290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:52.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.331+0000 7fbc32a00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc3410b300 0x7fbc34103290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.331+0000 7fbc32a00700 1 -- 172.21.15.70:0/666044611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc34103b60 con 0x7fbc34075f00 2024-05-08T06:45:52.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.331+0000 7fbc32a00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc34075f00 0x7fbc34106710 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbc24003820 tx=0x7fbc240057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.332+0000 7fbc2b400700 1 -- 172.21.15.70:0/666044611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24026070 con 0x7fbc34075f00 2024-05-08T06:45:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.332+0000 7fbc2b400700 1 -- 172.21.15.70:0/666044611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbc24003f60 con 0x7fbc34075f00 2024-05-08T06:45:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.332+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc34103df0 con 0x7fbc34075f00 2024-05-08T06:45:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.332+0000 7fbc2b400700 1 -- 172.21.15.70:0/666044611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400fc00 con 0x7fbc34075f00 2024-05-08T06:45:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.332+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc341a7d50 con 0x7fbc34075f00 2024-05-08T06:45:52.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.333+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc3406a190 con 0x7fbc34075f00 2024-05-08T06:45:52.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.337+0000 7fbc2b400700 1 -- 172.21.15.70:0/666044611 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbc24029070 con 0x7fbc34075f00 2024-05-08T06:45:52.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.339+0000 7fbc2b400700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbc180b2900 0x7fbc180b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:52.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.339+0000 7fbc2b400700 1 -- 172.21.15.70:0/666044611 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fbc240e3630 con 0x7fbc34075f00 2024-05-08T06:45:52.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.339+0000 7fbc2be00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbc180b2900 0x7fbc180b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:52.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.339+0000 7fbc2b400700 1 -- 172.21.15.70:0/666044611 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbc24030080 con 0x7fbc34075f00 2024-05-08T06:45:52.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.340+0000 7fbc2be00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbc180b2900 0x7fbc180b4dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbc34077200 tx=0x7fbc1c00a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:52.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.619+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fbc3402e510 con 0x7fbc34075f00 2024-05-08T06:45:52.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.620+0000 7fbc2b400700 1 -- 172.21.15.70:0/666044611 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) ==== 76+0+3054 (secure 0 0 0) 0x7fbc24013070 con 0x7fbc34075f00 2024-05-08T06:45:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:e26 2024-05-08T06:45:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T06:45:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T06:45:52.621 INFO:teuthology.orchestra.run.smithi070.stdout:legacy client fscid: 1 2024-05-08T06:45:52.621 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:Filesystem 'cephfs' (1) 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:fs_name cephfs 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 26 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-05-08T06:41:12.659763+0000 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-05-08T06:42:47.248168+0000 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:tableserver 0 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:root 0 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:session_timeout 300 2024-05-08T06:45:52.622 INFO:teuthology.orchestra.run.smithi070.stdout:session_autoclose 300 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:max_file_size 1099511627776 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:max_xattr_size 65536 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:required_client_features {} 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure 0 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure_osd_epoch 0 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:max_mds 3 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:in 0,1,2 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:up {0=34442,1=34409,2=34379} 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:failed 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:damaged 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:stopped 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:data_pools [3,4] 2024-05-08T06:45:52.623 INFO:teuthology.orchestra.run.smithi070.stdout:metadata_pool 2 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:inline_data disabled 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:balancer 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:bal_rank_mask -1 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:standby_count_wanted 0 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:qdb_cluster leader: 34442 members: 34409,34379,34442 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b{0:34442} state up:active seq 7 addr [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.k{0:34364} state up:standby-replay seq 1 addr [v2:172.21.15.172:6832/852809993,v1:172.21.15.172:6833/852809993] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.h{1:34409} state up:active seq 33 addr [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.i{1:24409} state up:standby-replay seq 1 addr [v2:172.21.15.194:6838/622098707,v1:172.21.15.194:6839/622098707] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.e{2:34379} state up:active seq 36 addr [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.624 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c{2:24397} state up:standby-replay seq 1 addr [v2:172.21.15.194:6836/346722795,v1:172.21.15.194:6837/346722795] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:Standby daemons: 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.j{-1:14499} state up:standby seq 1 addr [v2:172.21.15.70:6834/2483099434,v1:172.21.15.70:6835/2483099434] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d{-1:14505} state up:standby seq 1 addr [v2:172.21.15.70:6836/2593169616,v1:172.21.15.70:6837/2593169616] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.g{-1:14556} state up:standby seq 1 addr [v2:172.21.15.70:6838/1788340379,v1:172.21.15.70:6839/1788340379] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a{-1:14568} state up:standby seq 1 addr [v2:172.21.15.70:6840/3780132216,v1:172.21.15.70:6841/3780132216] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.l{-1:24364} state up:standby seq 1 addr [v2:172.21.15.194:6832/2484800274,v1:172.21.15.194:6833/2484800274] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.625 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.f{-1:24391} state up:standby seq 1 addr [v2:172.21.15.194:6834/2911491669,v1:172.21.15.194:6835/2911491669] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T06:45:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbc180b2900 msgr2=0x7fbc180b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:52.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbc180b2900 0x7fbc180b4dc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbc34077200 tx=0x7fbc1c00a3b0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc34075f00 msgr2=0x7fbc34106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc34075f00 0x7fbc34106710 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbc24003820 tx=0x7fbc240057c0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 shutdown_connections 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbc3410b300 0x7fbc34103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fbc180b2900 0x7fbc180b4dc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbc34075f00 0x7fbc34106710 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 --2- 172.21.15.70:0/666044611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc340774d0 0x7fbc34106c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 >> 172.21.15.70:0/666044611 conn(0x7fbc340fe9d0 msgr2=0x7fbc34107200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.625+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 shutdown_connections 2024-05-08T06:45:52.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:52.626+0000 7fbc33e00700 1 -- 172.21.15.70:0/666044611 wait complete. 2024-05-08T06:45:52.628 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 26 2024-05-08T06:45:52.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:52 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/666044611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T06:45:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:52 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/666044611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T06:45:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:52 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/666044611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T06:45:53.646 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-08T06:45:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:53 smithi070 ceph-mon[29591]: pgmap v521: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:54.090 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:53 smithi172 ceph-mon[33377]: pgmap v521: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:53 smithi194 ceph-mon[33679]: pgmap v521: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:45:55.921 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:55 smithi070 ceph-mon[29591]: pgmap v522: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:55 smithi172 ceph-mon[33377]: pgmap v522: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:55 smithi194 ceph-mon[33679]: pgmap v522: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.451+0000 7f6695600700 1 -- 172.21.15.70:0/501574469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690103ff0 msgr2=0x7f66901063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.451+0000 7f6695600700 1 --2- 172.21.15.70:0/501574469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690103ff0 0x7f66901063e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6680009990 tx=0x7f6680009ca0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.451+0000 7f6695600700 1 -- 172.21.15.70:0/501574469 shutdown_connections 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.451+0000 7f6695600700 1 --2- 172.21.15.70:0/501574469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6690109250 0x7f669010b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.451+0000 7f6695600700 1 --2- 172.21.15.70:0/501574469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690103ff0 0x7f66901063e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.451+0000 7f6695600700 1 --2- 172.21.15.70:0/501574469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6690106920 0x7f6690108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.451+0000 7f6695600700 1 -- 172.21.15.70:0/501574469 >> 172.21.15.70:0/501574469 conn(0x7f66900fd9a0 msgr2=0x7f66900ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.451+0000 7f6695600700 1 -- 172.21.15.70:0/501574469 shutdown_connections 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.451+0000 7f6695600700 1 -- 172.21.15.70:0/501574469 wait complete. 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.452+0000 7f6695600700 1 Processor -- start 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.452+0000 7f6695600700 1 -- start start 2024-05-08T06:45:56.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f6695600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6690103ff0 0x7f669019b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f6695600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690106920 0x7f669019bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f6695600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6690109250 0x7f66901a2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f6695600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f669010ee80 con 0x7f6690106920 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f6695600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f669010ed00 con 0x7f6690109250 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f6695600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f669010f000 con 0x7f6690103ff0 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f668e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690106920 0x7f669019bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f668e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690106920 0x7f669019bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36526/0 (socket says 172.21.15.70:36526) 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f668e000700 1 -- 172.21.15.70:0/2384499192 learned_addr learned my addr 172.21.15.70:0/2384499192 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f668ea00700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6690103ff0 0x7f669019b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.453+0000 7f668f400700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6690109250 0x7f66901a2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f668e000700 1 -- 172.21.15.70:0/2384499192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6690103ff0 msgr2=0x7f669019b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f668e000700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6690103ff0 0x7f669019b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f668e000700 1 -- 172.21.15.70:0/2384499192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6690109250 msgr2=0x7f66901a2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f668e000700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6690109250 0x7f66901a2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f668e000700 1 -- 172.21.15.70:0/2384499192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66901a34e0 con 0x7f6690106920 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f668e000700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690106920 0x7f669019bdc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f667c00c950 tx=0x7f667c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f6687400700 1 -- 172.21.15.70:0/2384499192 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c007ac0 con 0x7f6690106920 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f6687400700 1 -- 172.21.15.70:0/2384499192 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f667c004cc0 con 0x7f6690106920 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66901a37d0 con 0x7f6690106920 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.454+0000 7f6687400700 1 -- 172.21.15.70:0/2384499192 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f667c005440 con 0x7f6690106920 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.455+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66901a3d60 con 0x7f6690106920 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.456+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669006a190 con 0x7f6690106920 2024-05-08T06:45:56.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.459+0000 7f6687400700 1 -- 172.21.15.70:0/2384499192 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f667c004750 con 0x7f6690106920 2024-05-08T06:45:56.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.461+0000 7f6687400700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66740b2900 0x7f66740b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:45:56.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.461+0000 7f6687400700 1 -- 172.21.15.70:0/2384499192 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f667c0e2610 con 0x7f6690106920 2024-05-08T06:45:56.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.462+0000 7f668ea00700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66740b2900 0x7f66740b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:45:56.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.462+0000 7f6687400700 1 -- 172.21.15.70:0/2384499192 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f667c014030 con 0x7f6690106920 2024-05-08T06:45:56.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.462+0000 7f668ea00700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66740b2900 0x7f66740b4dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f668000b5c0 tx=0x7f66800037c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:45:56.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.709+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f669002e540 con 0x7f6690106920 2024-05-08T06:45:56.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.710+0000 7f6687400700 1 -- 172.21.15.70:0/2384499192 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v92) ==== 56+0+5723 (secure 0 0 0) 0x7f667c0a9f60 con 0x7f6690106920 2024-05-08T06:45:56.710 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 92 2024-05-08T06:45:56.710 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-05-08T06:30:04.772701+0000 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-05-08T06:43:16.853050+0000 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 27 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client luminous 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release squid 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-08T06:45:56.711 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 88 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 12 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 8 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6802/698641504,v1:172.21.15.70:6803/698641504] [v2:172.21.15.70:6804/698641504,v1:172.21.15.70:6805/698641504] exists,up e4faccd2-51f5-4d97-bf21-732ac8e6ff4f 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6800/3666956489,v1:172.21.15.172:6801/3666956489] [v2:172.21.15.172:6802/3666956489,v1:172.21.15.172:6803/3666956489] exists,up ad6b1754-8896-4721-8647-38c40794418b 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 18 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6800/818198413,v1:172.21.15.194:6801/818198413] [v2:172.21.15.194:6802/818198413,v1:172.21.15.194:6803/818198413] exists,up d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6810/3483817931,v1:172.21.15.70:6811/3483817931] [v2:172.21.15.70:6812/3483817931,v1:172.21.15.70:6813/3483817931] exists,up bd9bdf93-9e12-4613-8ff0-62b507edbd29 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 up in weight 1 up_from 32 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6808/3980608525,v1:172.21.15.172:6809/3980608525] [v2:172.21.15.172:6810/3980608525,v1:172.21.15.172:6811/3980608525] exists,up 9c49b8a2-2234-4306-b3f2-35426e29e1c2 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 up in weight 1 up_from 38 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6808/250291870,v1:172.21.15.194:6809/250291870] [v2:172.21.15.194:6810/250291870,v1:172.21.15.194:6811/250291870] exists,up acc9c880-48f9-41d7-bb61-6bcd1ecbc66d 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 up in weight 1 up_from 44 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6818/2584912798,v1:172.21.15.70:6819/2584912798] [v2:172.21.15.70:6820/2584912798,v1:172.21.15.70:6821/2584912798] exists,up 75960823-8e38-4f10-9bd2-42d4d4196126 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 up in weight 1 up_from 50 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6816/3099304179,v1:172.21.15.172:6817/3099304179] [v2:172.21.15.172:6818/3099304179,v1:172.21.15.172:6819/3099304179] exists,up 3fb26034-c4db-4bd4-b999-9d412750b779 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 up in weight 1 up_from 56 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6816/1974878207,v1:172.21.15.194:6817/1974878207] [v2:172.21.15.194:6818/1974878207,v1:172.21.15.194:6819/1974878207] exists,up bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 up in weight 1 up_from 62 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6826/22141436,v1:172.21.15.70:6827/22141436] [v2:172.21.15.70:6828/22141436,v1:172.21.15.70:6829/22141436] exists,up d65536ca-d40f-4700-8631-2bddb2d0db04 2024-05-08T06:45:56.712 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 up in weight 1 up_from 67 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.172:6824/1417359106,v1:172.21.15.172:6825/1417359106] [v2:172.21.15.172:6826/1417359106,v1:172.21.15.172:6827/1417359106] exists,up 9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 up in weight 1 up_from 73 up_thru 91 down_at 0 last_clean_interval [0,0) [v2:172.21.15.194:6824/2919544964,v1:172.21.15.194:6825/2919544964] [v2:172.21.15.194:6826/2919544964,v1:172.21.15.194:6827/2919544964] exists,up 820c95fd-0e17-4077-860c-ed32ad54d045 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.a [2,11] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.b [8,11] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.c [2,4] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.0 [4,6] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.10 [5,9] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.17 [4,6] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.19 [3,7] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.21 [4,8] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.2d [3,9] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.39 [5,8] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.3c [4,9] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.2 [9,1] 2024-05-08T06:45:56.713 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.9 [5,10] 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.1b [9,8] 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 4.1c [9,8] 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/1348548569 expires 2024-05-09T06:31:13.904560+0000 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/1348548569 expires 2024-05-09T06:31:13.904560+0000 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/2786047947 expires 2024-05-09T06:31:13.904560+0000 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/2185065524 expires 2024-05-09T06:30:38.292099+0000 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/2822740915 expires 2024-05-09T06:30:38.292099+0000 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3587006025 expires 2024-05-09T06:31:13.904560+0000 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3060551286 expires 2024-05-09T06:30:38.292099+0000 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/2822740915 expires 2024-05-09T06:30:38.292099+0000 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/902378241 expires 2024-05-09T06:31:13.904560+0000 2024-05-08T06:45:56.714 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3911583705 expires 2024-05-09T06:30:38.292099+0000 2024-05-08T06:45:56.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66740b2900 msgr2=0x7f66740b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:56.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66740b2900 0x7f66740b4dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f668000b5c0 tx=0x7f66800037c0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690106920 msgr2=0x7f669019bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:45:56.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690106920 0x7f669019bdc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f667c00c950 tx=0x7f667c00cc60 comp rx=0 tx=0).stop 2024-05-08T06:45:56.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 shutdown_connections 2024-05-08T06:45:56.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6690109250 0x7f66901a2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6690103ff0 0x7f669019b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f66740b2900 0x7f66740b4dc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 --2- 172.21.15.70:0/2384499192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6690106920 0x7f669019bdc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:45:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 >> 172.21.15.70:0/2384499192 conn(0x7f66900fd9a0 msgr2=0x7f66901037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:45:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 shutdown_connections 2024-05-08T06:45:56.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:45:56.714+0000 7f6695600700 1 -- 172.21.15.70:0/2384499192 wait complete. 2024-05-08T06:45:57.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:56 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2384499192' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T06:45:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:56 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2384499192' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T06:45:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:56 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2384499192' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T06:45:57.676 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-08T06:45:57.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:45:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:57 smithi070 ceph-mon[29591]: pgmap v523: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:58.134 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:45:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:57 smithi172 ceph-mon[33377]: pgmap v523: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:45:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:57 smithi194 ceph-mon[33679]: pgmap v523: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:46:00.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:45:59 smithi070 ceph-mon[29591]: pgmap v524: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:00.062 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:45:59 smithi194 ceph-mon[33679]: pgmap v524: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:45:59 smithi172 ceph-mon[33377]: pgmap v524: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.558+0000 7fd831800700 1 -- 172.21.15.70:0/3592036305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c1056d0 msgr2=0x7fd82c105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.558+0000 7fd831800700 1 --2- 172.21.15.70:0/3592036305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c1056d0 0x7fd82c105b50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd814009990 tx=0x7fd814009ca0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.558+0000 7fd831800700 1 -- 172.21.15.70:0/3592036305 shutdown_connections 2024-05-08T06:46:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.558+0000 7fd831800700 1 --2- 172.21.15.70:0/3592036305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd82c106090 0x7fd82c1125a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.558+0000 7fd831800700 1 --2- 172.21.15.70:0/3592036305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c10b6d0 0x7fd82c10bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.558+0000 7fd831800700 1 --2- 172.21.15.70:0/3592036305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c1056d0 0x7fd82c105b50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.558+0000 7fd831800700 1 -- 172.21.15.70:0/3592036305 >> 172.21.15.70:0/3592036305 conn(0x7fd82c1011a0 msgr2=0x7fd82c1035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.559+0000 7fd831800700 1 -- 172.21.15.70:0/3592036305 shutdown_connections 2024-05-08T06:46:00.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.559+0000 7fd831800700 1 -- 172.21.15.70:0/3592036305 wait complete. 2024-05-08T06:46:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.560+0000 7fd831800700 1 Processor -- start 2024-05-08T06:46:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.560+0000 7fd831800700 1 -- start start 2024-05-08T06:46:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.560+0000 7fd831800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd82c1056d0 0x7fd82c1a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.560+0000 7fd831800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106090 0x7fd82c1a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.560+0000 7fd831800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c10b6d0 0x7fd82c19bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.560+0000 7fd831800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1157c0 con 0x7fd82c106090 2024-05-08T06:46:00.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.560+0000 7fd831800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c115640 con 0x7fd82c1056d0 2024-05-08T06:46:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.560+0000 7fd831800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c115940 con 0x7fd82c10b6d0 2024-05-08T06:46:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd823e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106090 0x7fd82c1a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd823e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106090 0x7fd82c1a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45694/0 (socket says 172.21.15.70:45694) 2024-05-08T06:46:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd823e00700 1 -- 172.21.15.70:0/2762833039 learned_addr learned my addr 172.21.15.70:0/2762833039 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd82aa00700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd82c1056d0 0x7fd82c1a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:00.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd82b400700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c10b6d0 0x7fd82c19bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd823e00700 1 -- 172.21.15.70:0/2762833039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c10b6d0 msgr2=0x7fd82c19bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd823e00700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c10b6d0 0x7fd82c19bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd823e00700 1 -- 172.21.15.70:0/2762833039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd82c1056d0 msgr2=0x7fd82c1a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd823e00700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd82c1056d0 0x7fd82c1a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.561+0000 7fd823e00700 1 -- 172.21.15.70:0/2762833039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82c19c460 con 0x7fd82c106090 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.562+0000 7fd823e00700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106090 0x7fd82c1a1fa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd814000c00 tx=0x7fd814005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.562+0000 7fd823400700 1 -- 172.21.15.70:0/2762833039 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd814027070 con 0x7fd82c106090 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.562+0000 7fd823400700 1 -- 172.21.15.70:0/2762833039 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd81400fb80 con 0x7fd82c106090 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.562+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82c19c6f0 con 0x7fd82c106090 2024-05-08T06:46:00.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.562+0000 7fd823400700 1 -- 172.21.15.70:0/2762833039 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd814022c30 con 0x7fd82c106090 2024-05-08T06:46:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.562+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82c1a8810 con 0x7fd82c106090 2024-05-08T06:46:00.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.563+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd82c106e10 con 0x7fd82c106090 2024-05-08T06:46:00.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.566+0000 7fd823400700 1 -- 172.21.15.70:0/2762833039 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd81402a070 con 0x7fd82c106090 2024-05-08T06:46:00.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.567+0000 7fd823400700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd8100b2880 0x7fd8100b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:00.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.567+0000 7fd823400700 1 -- 172.21.15.70:0/2762833039 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7fd8140e3750 con 0x7fd82c106090 2024-05-08T06:46:00.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.567+0000 7fd82aa00700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd8100b2880 0x7fd8100b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:00.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.568+0000 7fd82aa00700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd8100b2880 0x7fd8100b4d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd81c005950 tx=0x7fd81c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:00.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.570+0000 7fd823400700 1 -- 172.21.15.70:0/2762833039 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd814031080 con 0x7fd82c106090 2024-05-08T06:46:00.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.846+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd82c02e510 con 0x7fd82c106090 2024-05-08T06:46:00.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.848+0000 7fd823400700 1 -- 172.21.15.70:0/2762833039 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11876 (secure 0 0 0) 0x7fd814013070 con 0x7fd82c106090 2024-05-08T06:46:00.846 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:46:00.847 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:42:47.248168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:46:00.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.850+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd8100b2880 msgr2=0x7fd8100b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:00.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd8100b2880 0x7fd8100b4d40 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd81c005950 tx=0x7fd81c0058e0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106090 msgr2=0x7fd82c1a1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:00.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106090 0x7fd82c1a1fa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd814000c00 tx=0x7fd814005ef0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 shutdown_connections 2024-05-08T06:46:00.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd82c10b6d0 0x7fd82c19bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd82c1056d0 0x7fd82c1a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7fd8100b2880 0x7fd8100b4d40 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 --2- 172.21.15.70:0/2762833039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106090 0x7fd82c1a1fa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:00.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 >> 172.21.15.70:0/2762833039 conn(0x7fd82c1011a0 msgr2=0x7fd82c101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:00.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 shutdown_connections 2024-05-08T06:46:00.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:00.851+0000 7fd831800700 1 -- 172.21.15.70:0/2762833039 wait complete. 2024-05-08T06:46:00.851 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 26 2024-05-08T06:46:01.702 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:46:02.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:01 smithi070 ceph-mon[29591]: pgmap v525: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:02.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:01 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2762833039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:02.151 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:02.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:01 smithi172 ceph-mon[33377]: pgmap v525: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:02.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:01 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2762833039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:02.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:01 smithi194 ceph-mon[33679]: pgmap v525: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:02.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:01 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2762833039' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:04.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:03 smithi070 ceph-mon[29591]: pgmap v526: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:03 smithi172 ceph-mon[33377]: pgmap v526: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:04.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:03 smithi194 ceph-mon[33679]: pgmap v526: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.623+0000 7f7349c00700 1 -- 172.21.15.70:0/3607074932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f734410fea0 msgr2=0x7f7344112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.623+0000 7f7349c00700 1 --2- 172.21.15.70:0/3607074932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f734410fea0 0x7f7344112290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f733c009990 tx=0x7f733c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.623+0000 7f7349c00700 1 -- 172.21.15.70:0/3607074932 shutdown_connections 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.623+0000 7f7349c00700 1 --2- 172.21.15.70:0/3607074932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f734410fea0 0x7f7344112290 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.623+0000 7f7349c00700 1 --2- 172.21.15.70:0/3607074932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73440756d0 0x7f7344075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.623+0000 7f7349c00700 1 --2- 172.21.15.70:0/3607074932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7344075ff0 0x7f734410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.623+0000 7f7349c00700 1 -- 172.21.15.70:0/3607074932 >> 172.21.15.70:0/3607074932 conn(0x7f734407a600 msgr2=0x7f734407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.623+0000 7f7349c00700 1 -- 172.21.15.70:0/3607074932 shutdown_connections 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.624+0000 7f7349c00700 1 -- 172.21.15.70:0/3607074932 wait complete. 2024-05-08T06:46:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.625+0000 7f7349c00700 1 Processor -- start 2024-05-08T06:46:04.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.625+0000 7f7349c00700 1 -- start start 2024-05-08T06:46:04.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.625+0000 7f7349c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73440756d0 0x7f73441a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:04.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.625+0000 7f7349c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7344075ff0 0x7f73441a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:04.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.625+0000 7f7349c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734410fea0 0x7f734419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:04.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.625+0000 7f7349c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7344115740 con 0x7f7344075ff0 2024-05-08T06:46:04.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.625+0000 7f7349c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73441155c0 con 0x7f73440756d0 2024-05-08T06:46:04.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.625+0000 7f7349c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f73441158c0 con 0x7f734410fea0 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f733a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7344075ff0 0x7f73441a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f733a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7344075ff0 0x7f73441a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45712/0 (socket says 172.21.15.70:45712) 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f733a000700 1 -- 172.21.15.70:0/1806909363 learned_addr learned my addr 172.21.15.70:0/1806909363 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f7342a00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73440756d0 0x7f73441a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f733a000700 1 -- 172.21.15.70:0/1806909363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734410fea0 msgr2=0x7f734419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f733a000700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734410fea0 0x7f734419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f733a000700 1 -- 172.21.15.70:0/1806909363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73440756d0 msgr2=0x7f73441a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f733a000700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73440756d0 0x7f73441a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f733a000700 1 -- 172.21.15.70:0/1806909363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734419c120 con 0x7f7344075ff0 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.626+0000 7f733a000700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7344075ff0 0x7f73441a1d40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f732c00c990 tx=0x7f732c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.627+0000 7f733be00700 1 -- 172.21.15.70:0/1806909363 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c007b00 con 0x7f7344075ff0 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.627+0000 7f733be00700 1 -- 172.21.15.70:0/1806909363 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f732c007ca0 con 0x7f7344075ff0 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.627+0000 7f733be00700 1 -- 172.21.15.70:0/1806909363 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f732c018660 con 0x7f7344075ff0 2024-05-08T06:46:04.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.627+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734419c410 con 0x7f7344075ff0 2024-05-08T06:46:04.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.627+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73441a86d0 con 0x7f7344075ff0 2024-05-08T06:46:04.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.628+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734406a190 con 0x7f7344075ff0 2024-05-08T06:46:04.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.630+0000 7f733be00700 1 -- 172.21.15.70:0/1806909363 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f732c00f450 con 0x7f7344075ff0 2024-05-08T06:46:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.632+0000 7f733be00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f73280b2900 0x7f73280b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.633+0000 7f733be00700 1 -- 172.21.15.70:0/1806909363 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f732c0e2590 con 0x7f7344075ff0 2024-05-08T06:46:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.633+0000 7f7342a00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f73280b2900 0x7f73280b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.633+0000 7f7342a00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f73280b2900 0x7f73280b4dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f734419cb00 tx=0x7f7334009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.637+0000 7f733be00700 1 -- 172.21.15.70:0/1806909363 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f732c014030 con 0x7f7344075ff0 2024-05-08T06:46:04.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.927+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73441a8a60 con 0x7f7344075ff0 2024-05-08T06:46:04.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.929+0000 7f733be00700 1 -- 172.21.15.70:0/1806909363 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11876 (secure 0 0 0) 0x7f732c0a9ec0 con 0x7f7344075ff0 2024-05-08T06:46:04.929 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:46:04.929 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:42:47.248168+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:46:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f73280b2900 msgr2=0x7f73280b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f73280b2900 0x7f73280b4dc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f734419cb00 tx=0x7f7334009040 comp rx=0 tx=0).stop 2024-05-08T06:46:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7344075ff0 msgr2=0x7f73441a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7344075ff0 0x7f73441a1d40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f732c00c990 tx=0x7f732c00cd50 comp rx=0 tx=0).stop 2024-05-08T06:46:04.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 shutdown_connections 2024-05-08T06:46:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f734410fea0 0x7f734419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f73440756d0 0x7f73441a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f73280b2900 0x7f73280b4dc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 --2- 172.21.15.70:0/1806909363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7344075ff0 0x7f73441a1d40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.932+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 >> 172.21.15.70:0/1806909363 conn(0x7f734407a600 msgr2=0x7f7344101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.933+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 shutdown_connections 2024-05-08T06:46:04.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:04.933+0000 7f7349c00700 1 -- 172.21.15.70:0/1806909363 wait complete. 2024-05-08T06:46:04.934 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 26 2024-05-08T06:46:05.926 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:46:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:05 smithi070 ceph-mon[29591]: pgmap v527: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:46:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:05 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1806909363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:06.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:05 smithi172 ceph-mon[33377]: pgmap v527: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:46:06.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:05 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1806909363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:06.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:05 smithi194 ceph-mon[33679]: pgmap v527: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:46:06.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:05 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1806909363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:06.374 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:08.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:07 smithi172 ceph-mon[33377]: pgmap v528: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:46:08.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:07 smithi194 ceph-mon[33679]: pgmap v528: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:46:08.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:07 smithi070 ceph-mon[29591]: pgmap v528: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:46:08.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.783+0000 7f9356c00700 1 -- 172.21.15.70:0/331496515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 msgr2=0x7f935010baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:08.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.783+0000 7f9356c00700 1 --2- 172.21.15.70:0/331496515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 0x7f935010baa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9340009990 tx=0x7f9340009ca0 comp rx=0 tx=0).stop 2024-05-08T06:46:08.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.783+0000 7f9356c00700 1 -- 172.21.15.70:0/331496515 shutdown_connections 2024-05-08T06:46:08.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.783+0000 7f9356c00700 1 --2- 172.21.15.70:0/331496515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9350106080 0x7f9350112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:08.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.783+0000 7f9356c00700 1 --2- 172.21.15.70:0/331496515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 0x7f935010baa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:08.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.783+0000 7f9356c00700 1 --2- 172.21.15.70:0/331496515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f93501056c0 0x7f9350105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:08.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.783+0000 7f9356c00700 1 -- 172.21.15.70:0/331496515 >> 172.21.15.70:0/331496515 conn(0x7f93501011b0 msgr2=0x7f93501035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:08.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.784+0000 7f9356c00700 1 -- 172.21.15.70:0/331496515 shutdown_connections 2024-05-08T06:46:08.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.784+0000 7f9356c00700 1 -- 172.21.15.70:0/331496515 wait complete. 2024-05-08T06:46:08.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.785+0000 7f9356c00700 1 Processor -- start 2024-05-08T06:46:08.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.785+0000 7f9356c00700 1 -- start start 2024-05-08T06:46:08.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.785+0000 7f9356c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93501056c0 0x7f93501a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:08.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.785+0000 7f9356c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350106080 0x7f93501a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:08.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.785+0000 7f9356c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 0x7f935019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:08.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.785+0000 7f9356c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93501157c0 con 0x7f935010b6c0 2024-05-08T06:46:08.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.785+0000 7f9356c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9350115640 con 0x7f9350106080 2024-05-08T06:46:08.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.785+0000 7f9356c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9350115940 con 0x7f93501056c0 2024-05-08T06:46:08.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f9354c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 0x7f935019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:08.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f9354c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 0x7f935019bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49492/0 (socket says 172.21.15.70:49492) 2024-05-08T06:46:08.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f9354c00700 1 -- 172.21.15.70:0/2577488210 learned_addr learned my addr 172.21.15.70:0/2577488210 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:08.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f934f400700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350106080 0x7f93501a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f934fe00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93501056c0 0x7f93501a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f9354c00700 1 -- 172.21.15.70:0/2577488210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93501056c0 msgr2=0x7f93501a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f9354c00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93501056c0 0x7f93501a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f9354c00700 1 -- 172.21.15.70:0/2577488210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350106080 msgr2=0x7f93501a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f9354c00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350106080 0x7f93501a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.786+0000 7f9354c00700 1 -- 172.21.15.70:0/2577488210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935019c240 con 0x7f935010b6c0 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.787+0000 7f9354c00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 0x7f935019bae0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9348007ee0 tx=0x7f934800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.787+0000 7f934cc00700 1 -- 172.21.15.70:0/2577488210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348004bb0 con 0x7f935010b6c0 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.787+0000 7f934cc00700 1 -- 172.21.15.70:0/2577488210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9348004d50 con 0x7f935010b6c0 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.787+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935019c530 con 0x7f935010b6c0 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.787+0000 7f934cc00700 1 -- 172.21.15.70:0/2577488210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93480058b0 con 0x7f935010b6c0 2024-05-08T06:46:08.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.787+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93501a87f0 con 0x7f935010b6c0 2024-05-08T06:46:08.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.788+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f935006a190 con 0x7f935010b6c0 2024-05-08T06:46:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.791+0000 7f934cc00700 1 -- 172.21.15.70:0/2577488210 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f934801a020 con 0x7f935010b6c0 2024-05-08T06:46:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.792+0000 7f934cc00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f93340b2900 0x7f93340b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.792+0000 7f934cc00700 1 -- 172.21.15.70:0/2577488210 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f93480e22d0 con 0x7f935010b6c0 2024-05-08T06:46:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.792+0000 7f934fe00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f93340b2900 0x7f93340b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.793+0000 7f934fe00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f93340b2900 0x7f93340b4dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9340006010 tx=0x7f934000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:08.795+0000 7f934cc00700 1 -- 172.21.15.70:0/2577488210 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9348010070 con 0x7f935010b6c0 2024-05-08T06:46:09.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.031+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f935002e510 con 0x7f935010b6c0 2024-05-08T06:46:09.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.033+0000 7f934cc00700 1 -- 172.21.15.70:0/2577488210 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+24865 (secure 0 0 0) 0x7f93480a9ba0 con 0x7f935010b6c0 2024-05-08T06:46:09.033 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:46:09.033 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":92,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:43:16.853050+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:46:09.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f93340b2900 msgr2=0x7f93340b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:09.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f93340b2900 0x7f93340b4dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9340006010 tx=0x7f934000b540 comp rx=0 tx=0).stop 2024-05-08T06:46:09.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 msgr2=0x7f935019bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:09.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 0x7f935019bae0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9348007ee0 tx=0x7f934800d3b0 comp rx=0 tx=0).stop 2024-05-08T06:46:09.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 shutdown_connections 2024-05-08T06:46:09.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f93340b2900 0x7f93340b4dc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:09.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f935010b6c0 0x7f935019bae0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:09.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93501056c0 0x7f93501a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:09.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 --2- 172.21.15.70:0/2577488210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9350106080 0x7f93501a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:09.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.036+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 >> 172.21.15.70:0/2577488210 conn(0x7f93501011b0 msgr2=0x7f93501019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:09.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.037+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 shutdown_connections 2024-05-08T06:46:09.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:09.037+0000 7f9356c00700 1 -- 172.21.15.70:0/2577488210 wait complete. 2024-05-08T06:46:10.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T06:41:12.659763+0000', 'modified': '2024-05-08T06:42:47.248168+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34442, 'mds_1': 34409, 'mds_2': 34379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24397': {'gid': 24397, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/346722795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 346722795}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 346722795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24409': {'gid': 24409, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6839/622098707', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 622098707}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 622098707}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34364': {'gid': 34364, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/852809993', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 852809993}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 852809993}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34379': {'gid': 34379, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 36, 'addr': '172.21.15.172:6835/3516901387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3516901387}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3516901387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34409': {'gid': 34409, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.172:6837/2037790761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2037790761}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2037790761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34442': {'gid': 34442, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.172:6839/283788562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 283788562}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 283788562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34442, 'qdb_cluster': [34409, 34379, 34442]} 2024-05-08T06:46:10.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-08T06:46:10.064 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-08T06:46:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:09 smithi172 ceph-mon[33377]: pgmap v529: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2577488210' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:46:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:09 smithi194 ceph-mon[33679]: pgmap v529: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2577488210' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:46:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:09 smithi070 ceph-mon[29591]: pgmap v529: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2577488210' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:46:10.525 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:12.158 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:11 smithi070 ceph-mon[29591]: pgmap v530: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:11 smithi172 ceph-mon[33377]: pgmap v530: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:12.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:11 smithi194 ceph-mon[33679]: pgmap v530: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:12.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.944+0000 7f4f0a000700 1 -- 172.21.15.70:0/3653706120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04102d50 msgr2=0x7f4f0410f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:12.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.944+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3653706120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04102d50 0x7f4f0410f240 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00b0a0 tx=0x7f4efc00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.944+0000 7f4f0a000700 1 -- 172.21.15.70:0/3653706120 shutdown_connections 2024-05-08T06:46:12.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.944+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3653706120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04102d50 0x7f4f0410f240 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.944+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3653706120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f04108400 0x7f4f041087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.944+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3653706120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f04102390 0x7f4f04102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.944+0000 7f4f0a000700 1 -- 172.21.15.70:0/3653706120 >> 172.21.15.70:0/3653706120 conn(0x7f4f04079310 msgr2=0x7f4f04079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:12.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.944+0000 7f4f0a000700 1 -- 172.21.15.70:0/3653706120 shutdown_connections 2024-05-08T06:46:12.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.944+0000 7f4f0a000700 1 -- 172.21.15.70:0/3653706120 wait complete. 2024-05-08T06:46:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.945+0000 7f4f0a000700 1 Processor -- start 2024-05-08T06:46:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f0a000700 1 -- start start 2024-05-08T06:46:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f0a000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f04102390 0x7f4f0419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f0a000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f04102d50 0x7f4f0419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f0a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04108400 0x7f4f04199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f0a000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f04112440 con 0x7f4f04108400 2024-05-08T06:46:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f0a000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4f041122c0 con 0x7f4f04102390 2024-05-08T06:46:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f0a000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4f041125c0 con 0x7f4f04102d50 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f03e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04108400 0x7f4f04199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f03e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04108400 0x7f4f04199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49500/0 (socket says 172.21.15.70:49500) 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.946+0000 7f4f03e00700 1 -- 172.21.15.70:0/3644078300 learned_addr learned my addr 172.21.15.70:0/3644078300 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.947+0000 7f4f03400700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f04102390 0x7f4f0419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.947+0000 7f4f02a00700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f04102d50 0x7f4f0419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.947+0000 7f4f03e00700 1 -- 172.21.15.70:0/3644078300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f04102d50 msgr2=0x7f4f0419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.947+0000 7f4f03e00700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f04102d50 0x7f4f0419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.947+0000 7f4f03e00700 1 -- 172.21.15.70:0/3644078300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f04102390 msgr2=0x7f4f0419f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.947+0000 7f4f03e00700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f04102390 0x7f4f0419f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.947+0000 7f4f03e00700 1 -- 172.21.15.70:0/3644078300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0419a090 con 0x7f4f04108400 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.947+0000 7f4f03e00700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04108400 0x7f4f04199930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00b070 tx=0x7f4efc004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.948+0000 7f4efbe00700 1 -- 172.21.15.70:0/3644078300 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc021070 con 0x7f4f04108400 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.948+0000 7f4efbe00700 1 -- 172.21.15.70:0/3644078300 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4efc007c00 con 0x7f4f04108400 2024-05-08T06:46:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.948+0000 7f4efbe00700 1 -- 172.21.15.70:0/3644078300 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc004780 con 0x7f4f04108400 2024-05-08T06:46:12.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.948+0000 7f4f0a000700 1 -- 172.21.15.70:0/3644078300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0419a320 con 0x7f4f04108400 2024-05-08T06:46:12.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.948+0000 7f4f0a000700 1 -- 172.21.15.70:0/3644078300 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f041a6640 con 0x7f4f04108400 2024-05-08T06:46:12.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.951+0000 7f4efbe00700 1 -- 172.21.15.70:0/3644078300 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4efc003a00 con 0x7f4f04108400 2024-05-08T06:46:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.952+0000 7f4f148fab80 1 Processor -- start 2024-05-08T06:46:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4f148fab80 1 -- start start 2024-05-08T06:46:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4efbe00700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4ee80b2880 0x7f4ee80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4efbe00700 1 -- 172.21.15.70:0/3644078300 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f4efc00f020 con 0x7f4f04108400 2024-05-08T06:46:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 0x56008f165690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4f02a00700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4ee80b2880 0x7f4ee80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f165cb0 0x56008f166110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4f148fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56008f0b39d0 con 0x56008f165cb0 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4f148fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56008f051710 con 0x56008f16afe0 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.953+0000 7f4f148fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56008f0af990 con 0x56008f16b900 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f03e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f165cb0 0x56008f166110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f03e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f165cb0 0x56008f166110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49510/0 (socket says 172.21.15.70:49510) 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f03e00700 1 -- 172.21.15.70:0/2641811640 learned_addr learned my addr 172.21.15.70:0/2641811640 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f03400700 1 --2- 172.21.15.70:0/2641811640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f02a00700 1 --2- 172.21.15.70:0/2641811640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 0x56008f165690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f02a00700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4ee80b2880 0x7f4ee80b4d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0005950 tx=0x7f4ef0013980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f03400700 1 -- 172.21.15.70:0/2641811640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 msgr2=0x56008f165690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f03400700 1 --2- 172.21.15.70:0/2641811640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 0x56008f165690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f03400700 1 -- 172.21.15.70:0/2641811640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f165cb0 msgr2=0x56008f166110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:12.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f03400700 1 --2- 172.21.15.70:0/2641811640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f165cb0 0x56008f166110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.954+0000 7f4f03400700 1 -- 172.21.15.70:0/2641811640 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008f000880 con 0x56008f16afe0 2024-05-08T06:46:12.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.955+0000 7f4f03400700 1 --2- 172.21.15.70:0/2641811640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16b3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400dbe0 tx=0x7f4ef400def0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3bb372e215d326f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.955+0000 7f4ef8c00700 1 -- 172.21.15.70:0/2641811640 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400fa90 con 0x56008f16afe0 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.955+0000 7f4ef8c00700 1 -- 172.21.15.70:0/2641811640 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ef4017070 con 0x56008f16afe0 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.956+0000 7f4ef8c00700 1 -- 172.21.15.70:0/2641811640 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef40053e0 con 0x56008f16afe0 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.956+0000 7f4f148fab80 1 -- 172.21.15.70:0/2641811640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 msgr2=0x56008f16b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.956+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2641811640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16b3c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400dbe0 tx=0x7f4ef400def0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.956+0000 7f4f148fab80 1 -- 172.21.15.70:0/2641811640 shutdown_connections 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.956+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2641811640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f165cb0 0x56008f166110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.956+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2641811640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16b3c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.956+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2641811640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 0x56008f165690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.956+0000 7f4f148fab80 1 -- 172.21.15.70:0/2641811640 >> 172.21.15.70:0/2641811640 conn(0x56008f0d9680 msgr2=0x56008f15bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.956+0000 7f4f148fab80 1 -- 172.21.15.70:0/2641811640 shutdown_connections 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.957+0000 7f4f148fab80 1 -- 172.21.15.70:0/2641811640 wait complete. 2024-05-08T06:46:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.957+0000 7f4f148fab80 1 -- start start 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.957+0000 7f4f148fab80 1 Processor -- start 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 0x56008f171590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16b900 0x56008f16ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f148fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56008f172360 con 0x56008f16b900 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f148fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56008f019ad0 con 0x56008f16afe0 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f148fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56008f1724e0 con 0x56008f165cb0 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f148fab80 10 client.0 _ll_register_callbacks cb 0x56008f05ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f03e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16b900 0x56008f16ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f03e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16b900 0x56008f16ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49516/0 (socket says 172.21.15.70:49516) 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f03e00700 1 -- 172.21.15.70:0/2381839802 learned_addr learned my addr 172.21.15.70:0/2381839802 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f03400700 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 0x56008f171590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.958+0000 7f4f02a00700 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f03e00700 1 -- 172.21.15.70:0/2381839802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 msgr2=0x56008f171590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f03e00700 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 0x56008f171590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f03e00700 1 -- 172.21.15.70:0/2381839802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 msgr2=0x56008f16e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f03e00700 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f03e00700 1 -- 172.21.15.70:0/2381839802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008f0793d0 con 0x56008f16b900 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f02a00700 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f03e00700 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16b900 0x56008f16ee70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0a80b0 tx=0x7f4efc0aa5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5653ac4bc5999cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4eed600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4eed600700 1 -- 172.21.15.70:0/2381839802 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0ad070 con 0x56008f16b900 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4eed600700 1 -- 172.21.15.70:0/2381839802 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f4efc0ab0a0 con 0x56008f16b900 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f148fab80 1 -- 172.21.15.70:0/2381839802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ef4017070 con 0x56008f16b900 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4eed600700 1 -- 172.21.15.70:0/2381839802 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4efc0ab540 con 0x56008f16b900 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f148fab80 10 client.15135 fetch_fsmap learned FSMap version 26 2024-05-08T06:46:12.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.959+0000 7f4f148fab80 1 -- 172.21.15.70:0/2381839802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56008f17cb80 con 0x56008f16b900 2024-05-08T06:46:12.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.960+0000 7f4eed600700 1 -- 172.21.15.70:0/2381839802 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ef4017070 con 0x56008f16b900 2024-05-08T06:46:12.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.960+0000 7f4eed600700 1 -- 172.21.15.70:0/2381839802 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4efc06cce0 con 0x56008f16b900 2024-05-08T06:46:12.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.960+0000 7f4f148fab80 10 client.15135 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:46:12.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.960+0000 7f4f148fab80 10 client.15135 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-08T06:46:12.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.960+0000 7f4f148fab80 20 client.15135 populate_metadata read hostname 'smithi070' 2024-05-08T06:46:12.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.960+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x56008f17ebf0 0x56008f1806c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.960+0000 7f4f148fab80 4 client.15135 mds_command: new command op to 34379 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:46:12.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.960+0000 7f4f148fab80 1 -- 172.21.15.70:0/2381839802 --> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56008f12e0f0 con 0x56008f17ebf0 2024-05-08T06:46:12.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.961+0000 7f4f03400700 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x56008f17ebf0 0x56008f1806c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.962+0000 7f4f03400700 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x56008f17ebf0 0x56008f1806c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c33cbd84048cace9 server_cookie=1db78e7c84f9459f in_seq=0 out_seq=0 2024-05-08T06:46:12.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.962+0000 7f4eed600700 10 client.15135 ms_handle_connect on v2:172.21.15.172:6834/3516901387 2024-05-08T06:46:12.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.964+0000 7f4eed600700 1 -- 172.21.15.70:0/2381839802 <== mds.2 v2:172.21.15.172:6834/3516901387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56008f12e0f0 con 0x56008f17ebf0 2024-05-08T06:46:12.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.964+0000 7f4eed600700 10 client.15135 handle_command_reply: tid=0 2024-05-08T06:46:12.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 client.15135 shutdown 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 -- 172.21.15.70:0/2381839802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16b900 msgr2=0x56008f16ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16b900 0x56008f16ee70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0a80b0 tx=0x7f4efc0aa5b0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 -- 172.21.15.70:0/2381839802 shutdown_connections 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x56008f17ebf0 0x56008f1806c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16b900 0x56008f16ee70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 0x56008f171590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 --2- 172.21.15.70:0/2381839802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16afe0 0x56008f16e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4eed600700 0 client.15135 ms_handle_reset on v2:172.21.15.172:6834/3516901387 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 -- 172.21.15.70:0/2381839802 >> 172.21.15.70:0/2381839802 conn(0x56008f0d9680 msgr2=0x56008f15b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 -- 172.21.15.70:0/2381839802 shutdown_connections 2024-05-08T06:46:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.965+0000 7f4f148fab80 1 -- 172.21.15.70:0/2381839802 wait complete. 2024-05-08T06:46:12.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.966+0000 7f4f148fab80 20 client.15135 trim_cache size 0 max 16384 2024-05-08T06:46:12.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.989+0000 7f4f148fab80 1 Processor -- start 2024-05-08T06:46:12.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.989+0000 7f4f148fab80 1 -- start start 2024-05-08T06:46:12.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.989+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 0x56008f1806c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.989+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16afe0 0x56008f15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.989+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16b900 0x56008f16e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.989+0000 7f4f148fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56008f17ea70 con 0x56008f16afe0 2024-05-08T06:46:12.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.989+0000 7f4f148fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56008f17f0f0 con 0x56008f16b900 2024-05-08T06:46:12.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.989+0000 7f4f148fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56008f17f7a0 con 0x56008f165cb0 2024-05-08T06:46:12.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f02a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16afe0 0x56008f15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f02a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16afe0 0x56008f15b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49532/0 (socket says 172.21.15.70:49532) 2024-05-08T06:46:12.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f02a00700 1 -- 172.21.15.70:0/3689219910 learned_addr learned my addr 172.21.15.70:0/3689219910 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:12.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f03400700 1 --2- 172.21.15.70:0/3689219910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 0x56008f1806c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f02a00700 1 -- 172.21.15.70:0/3689219910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 msgr2=0x56008f1806c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:12.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f02a00700 1 --2- 172.21.15.70:0/3689219910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 0x56008f1806c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f02a00700 1 -- 172.21.15.70:0/3689219910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16b900 msgr2=0x56008f16e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:12.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f02a00700 1 --2- 172.21.15.70:0/3689219910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16b900 0x56008f16e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f02a00700 1 -- 172.21.15.70:0/3689219910 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56008f181620 con 0x56008f16afe0 2024-05-08T06:46:12.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.990+0000 7f4f03400700 1 --2- 172.21.15.70:0/3689219910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 0x56008f1806c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:46:12.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.991+0000 7f4f02a00700 1 --2- 172.21.15.70:0/3689219910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16afe0 0x56008f15b8c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4ef001f670 tx=0x7f4ef001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1623fabed1ef18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:12.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.991+0000 7f4eefe00700 1 -- 172.21.15.70:0/3689219910 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef002b480 con 0x56008f16afe0 2024-05-08T06:46:12.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.991+0000 7f4eefe00700 1 -- 172.21.15.70:0/3689219910 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ef00208e0 con 0x56008f16afe0 2024-05-08T06:46:12.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.991+0000 7f4eefe00700 1 -- 172.21.15.70:0/3689219910 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0011610 con 0x56008f16afe0 2024-05-08T06:46:12.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.992+0000 7f4f148fab80 1 -- 172.21.15.70:0/3689219910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16afe0 msgr2=0x56008f15b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:12.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.992+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3689219910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16afe0 0x56008f15b8c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4ef001f670 tx=0x7f4ef001c000 comp rx=0 tx=0).stop 2024-05-08T06:46:12.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.992+0000 7f4f148fab80 1 -- 172.21.15.70:0/3689219910 shutdown_connections 2024-05-08T06:46:12.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.992+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3689219910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f16b900 0x56008f16e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.992+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3689219910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f165cb0 0x56008f1806c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.992+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3689219910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f16afe0 0x56008f15b8c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.992+0000 7f4f148fab80 1 -- 172.21.15.70:0/3689219910 >> 172.21.15.70:0/3689219910 conn(0x56008f0d9680 msgr2=0x56008f17ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:12.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.992+0000 7f4f148fab80 1 -- 172.21.15.70:0/3689219910 shutdown_connections 2024-05-08T06:46:12.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.992+0000 7f4f148fab80 1 -- 172.21.15.70:0/3689219910 wait complete. 2024-05-08T06:46:12.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.993+0000 7f4f148fab80 1 -- start start 2024-05-08T06:46:12.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.993+0000 7f4f148fab80 1 Processor -- start 2024-05-08T06:46:12.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.993+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f165cb0 0x56008f15b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.993+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 0x56008f15b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.993+0000 7f4f148fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f15bc70 0x56008f188220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.993+0000 7f4f148fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56008f180540 con 0x56008f15bc70 2024-05-08T06:46:12.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.993+0000 7f4f148fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56008f17fe70 con 0x56008f165cb0 2024-05-08T06:46:12.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.993+0000 7f4f148fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56008f180c10 con 0x56008f16b900 2024-05-08T06:46:12.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.993+0000 7f4f148fab80 10 client.0 _ll_register_callbacks cb 0x56008f05ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:46:12.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f15bc70 0x56008f188220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f15bc70 0x56008f188220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49536/0 (socket says 172.21.15.70:49536) 2024-05-08T06:46:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03e00700 1 -- 172.21.15.70:0/3171974062 learned_addr learned my addr 172.21.15.70:0/3171974062 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03400700 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f165cb0 0x56008f15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f02a00700 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 0x56008f15b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03e00700 1 -- 172.21.15.70:0/3171974062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 msgr2=0x56008f15b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03e00700 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 0x56008f15b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03e00700 1 -- 172.21.15.70:0/3171974062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f165cb0 msgr2=0x56008f15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03e00700 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f165cb0 0x56008f15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03e00700 1 -- 172.21.15.70:0/3171974062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56008f188a60 con 0x56008f15bc70 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f02a00700 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 0x56008f15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4f03e00700 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f15bc70 0x56008f188220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0a73e0 tx=0x7f4efc0a6d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a0a83e2a8907de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.994+0000 7f4eed600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.995+0000 7f4eed600700 1 -- 172.21.15.70:0/3171974062 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0c9060 con 0x56008f15bc70 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.995+0000 7f4f148fab80 1 -- 172.21.15.70:0/3171974062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ef00208e0 con 0x56008f15bc70 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.995+0000 7f4eed600700 1 -- 172.21.15.70:0/3171974062 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f4efc0b39b0 con 0x56008f15bc70 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.995+0000 7f4eed600700 1 -- 172.21.15.70:0/3171974062 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4efc08a050 con 0x56008f15bc70 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.995+0000 7f4f148fab80 10 client.15141 fetch_fsmap learned FSMap version 26 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.995+0000 7f4f148fab80 1 -- 172.21.15.70:0/3171974062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56008f1eb170 con 0x56008f15bc70 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.995+0000 7f4eed600700 1 -- 172.21.15.70:0/3171974062 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ef00208e0 con 0x56008f15bc70 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.995+0000 7f4eed600700 1 -- 172.21.15.70:0/3171974062 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4efc011070 con 0x56008f15bc70 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.995+0000 7f4f148fab80 10 client.15141 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.996+0000 7f4f148fab80 10 client.15141 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-08T06:46:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.996+0000 7f4f148fab80 20 client.15141 populate_metadata read hostname 'smithi070' 2024-05-08T06:46:12.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.996+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x56008f1efb20 0x56008f1ee830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:12.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.996+0000 7f4f148fab80 4 client.15141 mds_command: new command op to 34379 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:46:12.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.996+0000 7f4f148fab80 1 -- 172.21.15.70:0/3171974062 --> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] -- command(tid 0: {"prefix": "status"}) -- 0x56008f0c13b0 con 0x56008f1efb20 2024-05-08T06:46:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.996+0000 7f4f03400700 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x56008f1efb20 0x56008f1ee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.997+0000 7f4f03400700 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x56008f1efb20 0x56008f1ee830 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe496bbc935eb29b server_cookie=16231360d90e9566 in_seq=0 out_seq=0 2024-05-08T06:46:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.997+0000 7f4eed600700 10 client.15141 ms_handle_connect on v2:172.21.15.172:6834/3516901387 2024-05-08T06:46:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4eed600700 1 -- 172.21.15.70:0/3171974062 <== mds.2 v2:172.21.15.172:6834/3516901387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x56008f0c13b0 con 0x56008f1efb20 2024-05-08T06:46:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4eed600700 10 client.15141 handle_command_reply: tid=0 2024-05-08T06:46:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 client.15141 shutdown 2024-05-08T06:46:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 -- 172.21.15.70:0/3171974062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f15bc70 msgr2=0x56008f188220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f15bc70 0x56008f188220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0a73e0 tx=0x7f4efc0a6d20 comp rx=0 tx=0).stop 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 -- 172.21.15.70:0/3171974062 shutdown_connections 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x56008f1efb20 0x56008f1ee830 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56008f15bc70 0x56008f188220 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56008f165cb0 0x56008f15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 --2- 172.21.15.70:0/3171974062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56008f16b900 0x56008f15b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 -- 172.21.15.70:0/3171974062 >> 172.21.15.70:0/3171974062 conn(0x56008f0d9680 msgr2=0x56008f16e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4eed600700 0 client.15141 ms_handle_reset on v2:172.21.15.172:6834/3516901387 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 -- 172.21.15.70:0/3171974062 shutdown_connections 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 1 -- 172.21.15.70:0/3171974062 wait complete. 2024-05-08T06:46:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.998+0000 7f4f148fab80 20 client.15141 trim_cache size 0 max 16384 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34379, 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 212.75713358100001, 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 26, 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 92, 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 90, 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 351.98336553899998 2024-05-08T06:46:13.001 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:46:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 -- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4ee80b2880 msgr2=0x7f4ee80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4ee80b2880 0x7f4ee80b4d40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0005950 tx=0x7f4ef0013980 comp rx=0 tx=0).stop 2024-05-08T06:46:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 -- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04108400 msgr2=0x7f4f04199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04108400 0x7f4f04199930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00b070 tx=0x7f4efc004e00 comp rx=0 tx=0).stop 2024-05-08T06:46:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 -- 172.21.15.70:0/3644078300 shutdown_connections 2024-05-08T06:46:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f4ee80b2880 0x7f4ee80b4d40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:13.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f04108400 0x7f4f04199930 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:13.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f04102390 0x7f4f0419f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:13.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 --2- 172.21.15.70:0/3644078300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f04102d50 0x7f4f0419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:13.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:12.999+0000 7f4f0a000700 1 -- 172.21.15.70:0/3644078300 >> 172.21.15.70:0/3644078300 conn(0x7f4f04079310 msgr2=0x7f4f04101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:13.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:13.000+0000 7f4f0a000700 1 -- 172.21.15.70:0/3644078300 shutdown_connections 2024-05-08T06:46:13.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:13.000+0000 7f4f0a000700 1 -- 172.21.15.70:0/3644078300 wait complete. 2024-05-08T06:46:13.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-08T06:46:14.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:13 smithi070 ceph-mon[29591]: pgmap v531: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:13 smithi172 ceph-mon[33377]: pgmap v531: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:14.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:13 smithi194 ceph-mon[33679]: pgmap v531: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:14.360 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:16.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:15 smithi070 ceph-mon[29591]: pgmap v532: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:46:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:15 smithi172 ceph-mon[33377]: pgmap v532: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:46:16.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:15 smithi194 ceph-mon[33679]: pgmap v532: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:46:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.773+0000 7f3da5e00700 1 -- 172.21.15.70:0/207736305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da01056c0 msgr2=0x7f3da0105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.773+0000 7f3da5e00700 1 --2- 172.21.15.70:0/207736305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da01056c0 0x7f3da0105b40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009990 tx=0x7f3d8c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.774+0000 7f3da5e00700 1 -- 172.21.15.70:0/207736305 shutdown_connections 2024-05-08T06:46:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.774+0000 7f3da5e00700 1 --2- 172.21.15.70:0/207736305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da0106080 0x7f3da0112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.774+0000 7f3da5e00700 1 --2- 172.21.15.70:0/207736305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3da010b6c0 0x7f3da010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.774+0000 7f3da5e00700 1 --2- 172.21.15.70:0/207736305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da01056c0 0x7f3da0105b40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.774+0000 7f3da5e00700 1 -- 172.21.15.70:0/207736305 >> 172.21.15.70:0/207736305 conn(0x7f3da01011b0 msgr2=0x7f3da01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.774+0000 7f3da5e00700 1 -- 172.21.15.70:0/207736305 shutdown_connections 2024-05-08T06:46:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.774+0000 7f3da5e00700 1 -- 172.21.15.70:0/207736305 wait complete. 2024-05-08T06:46:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.775+0000 7f3da5e00700 1 Processor -- start 2024-05-08T06:46:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.775+0000 7f3da5e00700 1 -- start start 2024-05-08T06:46:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.775+0000 7f3da5e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3da01056c0 0x7f3da01a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.775+0000 7f3da5e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da0106080 0x7f3da01a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.775+0000 7f3da5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010b6c0 0x7f3da019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.775+0000 7f3da5e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0115770 con 0x7f3da010b6c0 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.775+0000 7f3da5e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01155f0 con 0x7f3da0106080 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.775+0000 7f3da5e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01158f0 con 0x7f3da01056c0 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010b6c0 0x7f3da019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010b6c0 0x7f3da019bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49552/0 (socket says 172.21.15.70:49552) 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9f400700 1 -- 172.21.15.70:0/3969111362 learned_addr learned my addr 172.21.15.70:0/3969111362 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9e000700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da0106080 0x7f3da01a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3da01056c0 0x7f3da01a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9f400700 1 -- 172.21.15.70:0/3969111362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3da01056c0 msgr2=0x7f3da01a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9f400700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3da01056c0 0x7f3da01a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9f400700 1 -- 172.21.15.70:0/3969111362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da0106080 msgr2=0x7f3da01a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9f400700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da0106080 0x7f3da01a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9f400700 1 -- 172.21.15.70:0/3969111362 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da019c230 con 0x7f3da010b6c0 2024-05-08T06:46:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.776+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3da01056c0 0x7f3da01a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:46:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.777+0000 7f3d9f400700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010b6c0 0x7f3da019bad0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3d98007ee0 tx=0x7f3d9800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.777+0000 7f3da4a00700 1 -- 172.21.15.70:0/3969111362 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9800dbd0 con 0x7f3da010b6c0 2024-05-08T06:46:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.777+0000 7f3da4a00700 1 -- 172.21.15.70:0/3969111362 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d9800dd70 con 0x7f3da010b6c0 2024-05-08T06:46:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.777+0000 7f3da5e00700 1 -- 172.21.15.70:0/3969111362 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da019c520 con 0x7f3da010b6c0 2024-05-08T06:46:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.777+0000 7f3da4a00700 1 -- 172.21.15.70:0/3969111362 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d980058d0 con 0x7f3da010b6c0 2024-05-08T06:46:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.777+0000 7f3da5e00700 1 -- 172.21.15.70:0/3969111362 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da01a87e0 con 0x7f3da010b6c0 2024-05-08T06:46:16.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.781+0000 7f3da4a00700 1 -- 172.21.15.70:0/3969111362 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3d9801a020 con 0x7f3da010b6c0 2024-05-08T06:46:16.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.782+0000 7f3db0822b80 1 Processor -- start 2024-05-08T06:46:16.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.782+0000 7f3db0822b80 1 -- start start 2024-05-08T06:46:16.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.782+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663efb70 0x55da663eff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.782+0000 7f3da4a00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3d840b2900 0x7f3d840b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.782+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 0x55da663ea280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.782+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663ea8a0 0x55da663ead20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.782+0000 7f3db0822b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55da6633c9d0 con 0x55da663efb70 2024-05-08T06:46:16.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.782+0000 7f3db0822b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da662da710 con 0x55da663ea8a0 2024-05-08T06:46:16.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.782+0000 7f3db0822b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55da66338990 con 0x55da663f0490 2024-05-08T06:46:16.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.783+0000 7f3da4a00700 1 -- 172.21.15.70:0/3969111362 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f3d980e1e30 con 0x7f3da010b6c0 2024-05-08T06:46:16.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.783+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3d840b2900 0x7f3d840b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.783+0000 7f3d9e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663efb70 0x55da663eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.783+0000 7f3d9e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663efb70 0x55da663eff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49554/0 (socket says 172.21.15.70:49554) 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.783+0000 7f3d9e000700 1 -- 172.21.15.70:0/2262666806 learned_addr learned my addr 172.21.15.70:0/2262666806 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.783+0000 7f3d9e000700 1 --2- 172.21.15.70:0/2262666806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 0x55da663ea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.783+0000 7f3d9f400700 1 --2- 172.21.15.70:0/2262666806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663ea8a0 0x55da663ead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.783+0000 7f3d9e000700 1 -- 172.21.15.70:0/2262666806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 msgr2=0x55da663ea280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.784+0000 7f3d9e000700 1 --2- 172.21.15.70:0/2262666806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 0x55da663ea280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.784+0000 7f3d9e000700 1 -- 172.21.15.70:0/2262666806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663ea8a0 msgr2=0x55da663ead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.784+0000 7f3d9e000700 1 --2- 172.21.15.70:0/2262666806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663ea8a0 0x55da663ead20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.784+0000 7f3d9e000700 1 -- 172.21.15.70:0/2262666806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da66289880 con 0x55da663efb70 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.784+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3d840b2900 0x7f3d840b4dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009b50 tx=0x7f3d90009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.784+0000 7f3d9e000700 1 --2- 172.21.15.70:0/2262666806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663efb70 0x55da663eff50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c003710 tx=0x7f3d8c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3764e524a494e90 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.784+0000 7f3d94c00700 1 -- 172.21.15.70:0/2262666806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c0050f0 con 0x55da663efb70 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.784+0000 7f3d94c00700 1 -- 172.21.15.70:0/2262666806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d8c01b030 con 0x55da663efb70 2024-05-08T06:46:16.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.784+0000 7f3d94c00700 1 -- 172.21.15.70:0/2262666806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00b7d0 con 0x55da663efb70 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.785+0000 7f3db0822b80 1 -- 172.21.15.70:0/2262666806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663efb70 msgr2=0x55da663eff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.785+0000 7f3db0822b80 1 --2- 172.21.15.70:0/2262666806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663efb70 0x55da663eff50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c003710 tx=0x7f3d8c005c00 comp rx=0 tx=0).stop 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.785+0000 7f3db0822b80 1 -- 172.21.15.70:0/2262666806 shutdown_connections 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.785+0000 7f3db0822b80 1 --2- 172.21.15.70:0/2262666806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663ea8a0 0x55da663ead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.785+0000 7f3db0822b80 1 --2- 172.21.15.70:0/2262666806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663efb70 0x55da663eff50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.785+0000 7f3db0822b80 1 --2- 172.21.15.70:0/2262666806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 0x55da663ea280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.785+0000 7f3db0822b80 1 -- 172.21.15.70:0/2262666806 >> 172.21.15.70:0/2262666806 conn(0x55da66362680 msgr2=0x55da663e4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.785+0000 7f3db0822b80 1 -- 172.21.15.70:0/2262666806 shutdown_connections 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.785+0000 7f3db0822b80 1 -- 172.21.15.70:0/2262666806 wait complete. 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.786+0000 7f3db0822b80 1 -- start start 2024-05-08T06:46:16.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.786+0000 7f3db0822b80 1 Processor -- start 2024-05-08T06:46:16.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663f6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 0x55da663f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 0x55da663f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3db0822b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55da663f6e70 con 0x55da663ea8a0 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3db0822b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da662a2ad0 con 0x55da663f0490 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3db0822b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55da663f6ff0 con 0x55da663efb70 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3db0822b80 10 client.0 _ll_register_callbacks cb 0x55da662e3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3d9ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3d9ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663f6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49560/0 (socket says 172.21.15.70:49560) 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.787+0000 7f3d9ea00700 1 -- 172.21.15.70:0/1456851816 learned_addr learned my addr 172.21.15.70:0/1456851816 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d9e000700 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 0x55da663f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d9f400700 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 0x55da663f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d9ea00700 1 -- 172.21.15.70:0/1456851816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 msgr2=0x55da663f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:16.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 0x55da663f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d9ea00700 1 -- 172.21.15.70:0/1456851816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 msgr2=0x55da663f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 0x55da663f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d9ea00700 1 -- 172.21.15.70:0/1456851816 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da663023d0 con 0x55da663ea8a0 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663f6140 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3d900116f0 tx=0x7f3d90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1051899c70fd2f21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d89600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.788+0000 7f3d89600700 1 -- 172.21.15.70:0/1456851816 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90022020 con 0x55da663ea8a0 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.789+0000 7f3d89600700 1 -- 172.21.15.70:0/1456851816 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f3d9001e640 con 0x55da663ea8a0 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.789+0000 7f3db0822b80 1 -- 172.21.15.70:0/1456851816 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d8c01b030 con 0x55da663ea8a0 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.789+0000 7f3d89600700 1 -- 172.21.15.70:0/1456851816 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3d9002d050 con 0x55da663ea8a0 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.789+0000 7f3db0822b80 10 client.15153 fetch_fsmap learned FSMap version 26 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.789+0000 7f3db0822b80 1 -- 172.21.15.70:0/1456851816 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55da66401760 con 0x55da663ea8a0 2024-05-08T06:46:16.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.789+0000 7f3d89600700 1 -- 172.21.15.70:0/1456851816 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d8c01b030 con 0x55da663ea8a0 2024-05-08T06:46:16.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.789+0000 7f3d89600700 1 -- 172.21.15.70:0/1456851816 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3d9000f040 con 0x55da663ea8a0 2024-05-08T06:46:16.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.790+0000 7f3db0822b80 10 client.15153 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:46:16.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.790+0000 7f3db0822b80 10 client.15153 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T06:46:16.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.790+0000 7f3db0822b80 20 client.15153 populate_metadata read hostname 'smithi070' 2024-05-08T06:46:16.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.790+0000 7f3db0822b80 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x55da66403e00 0x55da66405270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.790+0000 7f3db0822b80 4 client.15153 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:46:16.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.790+0000 7f3db0822b80 1 -- 172.21.15.70:0/1456851816 --> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da663b70f0 con 0x55da66403e00 2024-05-08T06:46:16.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.790+0000 7f3d9e000700 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x55da66403e00 0x55da66405270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.791+0000 7f3d9e000700 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x55da66403e00 0x55da66405270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86e77982f2197eca server_cookie=c982fba2c6a443a9 in_seq=0 out_seq=0 2024-05-08T06:46:16.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.791+0000 7f3d89600700 10 client.15153 ms_handle_connect on v2:172.21.15.172:6836/2037790761 2024-05-08T06:46:16.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.793+0000 7f3d89600700 1 -- 172.21.15.70:0/1456851816 <== mds.1 v2:172.21.15.172:6836/2037790761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55da663b70f0 con 0x55da66403e00 2024-05-08T06:46:16.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.793+0000 7f3d89600700 10 client.15153 handle_command_reply: tid=0 2024-05-08T06:46:16.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.793+0000 7f3db0822b80 1 client.15153 shutdown 2024-05-08T06:46:16.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 -- 172.21.15.70:0/1456851816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 msgr2=0x55da663f6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:16.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663f6140 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3d900116f0 tx=0x7f3d90004750 comp rx=0 tx=0).stop 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 -- 172.21.15.70:0/1456851816 shutdown_connections 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x55da66403e00 0x55da66405270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 0x55da663f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663f6140 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 --2- 172.21.15.70:0/1456851816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 0x55da663f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 -- 172.21.15.70:0/1456851816 >> 172.21.15.70:0/1456851816 conn(0x55da66362680 msgr2=0x55da663e4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3d89600700 0 client.15153 ms_handle_reset on v2:172.21.15.172:6836/2037790761 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 -- 172.21.15.70:0/1456851816 shutdown_connections 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 1 -- 172.21.15.70:0/1456851816 wait complete. 2024-05-08T06:46:16.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.794+0000 7f3db0822b80 20 client.15153 trim_cache size 0 max 16384 2024-05-08T06:46:16.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.816+0000 7f3db0822b80 1 Processor -- start 2024-05-08T06:46:16.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3db0822b80 1 -- start start 2024-05-08T06:46:16.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663ea280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663efb70 0x55da663f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 0x55da663e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3db0822b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55da664035b0 con 0x55da663ea8a0 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3db0822b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da66403c80 con 0x55da663efb70 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3db0822b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55da66404350 con 0x55da663f0490 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3d9ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663ea280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3d9ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663ea280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49562/0 (socket says 172.21.15.70:49562) 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.817+0000 7f3d9ea00700 1 -- 172.21.15.70:0/2664221374 learned_addr learned my addr 172.21.15.70:0/2664221374 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.818+0000 7f3d9e000700 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663efb70 0x55da663f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.818+0000 7f3d9f400700 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 0x55da663e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.818+0000 7f3d9ea00700 1 -- 172.21.15.70:0/2664221374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 msgr2=0x55da663e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.818+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 0x55da663e48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.818+0000 7f3d9ea00700 1 -- 172.21.15.70:0/2664221374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663efb70 msgr2=0x55da663f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:16.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.818+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663efb70 0x55da663f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.818+0000 7f3d9ea00700 1 -- 172.21.15.70:0/2664221374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da663dfa60 con 0x55da663ea8a0 2024-05-08T06:46:16.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.818+0000 7f3d9e000700 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663efb70 0x55da663f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:46:16.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.818+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663ea280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3d90004720 tx=0x7f3d90011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d823ea725b5dcacb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3d8be00700 1 -- 172.21.15.70:0/2664221374 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90022040 con 0x55da663ea8a0 2024-05-08T06:46:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3d8be00700 1 -- 172.21.15.70:0/2664221374 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d90036070 con 0x55da663ea8a0 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3d8be00700 1 -- 172.21.15.70:0/2664221374 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d900047c0 con 0x55da663ea8a0 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3db0822b80 1 -- 172.21.15.70:0/2664221374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 msgr2=0x55da663ea280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3db0822b80 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663ea280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3d90004720 tx=0x7f3d90011f00 comp rx=0 tx=0).stop 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3db0822b80 1 -- 172.21.15.70:0/2664221374 shutdown_connections 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3db0822b80 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663f0490 0x55da663e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3db0822b80 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663ea280 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3db0822b80 1 --2- 172.21.15.70:0/2664221374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663efb70 0x55da663f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3db0822b80 1 -- 172.21.15.70:0/2664221374 >> 172.21.15.70:0/2664221374 conn(0x55da66362680 msgr2=0x55da663f0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.819+0000 7f3db0822b80 1 -- 172.21.15.70:0/2664221374 shutdown_connections 2024-05-08T06:46:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.820+0000 7f3db0822b80 1 -- 172.21.15.70:0/2664221374 wait complete. 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.820+0000 7f3db0822b80 1 -- start start 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.820+0000 7f3db0822b80 1 Processor -- start 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.821+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.821+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 0x55da663e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.821+0000 7f3db0822b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 0x55da663e4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.821+0000 7f3db0822b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55da664050f0 con 0x55da663ea8a0 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.821+0000 7f3db0822b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55da66404a20 con 0x55da663f0490 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.821+0000 7f3db0822b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55da664057c0 con 0x55da663efb70 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.821+0000 7f3db0822b80 10 client.0 _ll_register_callbacks cb 0x55da662e3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9e000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 0x55da663e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9e000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 0x55da663e43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:42454/0 (socket says 172.21.15.70:42454) 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9e000700 1 -- 172.21.15.70:0/180024124 learned_addr learned my addr 172.21.15.70:0/180024124 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9f400700 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 0x55da663e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9ea00700 1 -- 172.21.15.70:0/180024124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 msgr2=0x55da663e43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 0x55da663e43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9ea00700 1 -- 172.21.15.70:0/180024124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 msgr2=0x55da663e4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 0x55da663e4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.822+0000 7f3d9ea00700 1 -- 172.21.15.70:0/180024124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da6640c9a0 con 0x55da663ea8a0 2024-05-08T06:46:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.823+0000 7f3d9ea00700 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663e3e90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3d90010810 tx=0x7f3d90005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d95ec32453e3cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.823+0000 7f3d89600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:46:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.823+0000 7f3d89600700 1 -- 172.21.15.70:0/180024124 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90022040 con 0x55da663ea8a0 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.823+0000 7f3d89600700 1 -- 172.21.15.70:0/180024124 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f3d90010ae0 con 0x55da663ea8a0 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.823+0000 7f3db0822b80 1 -- 172.21.15.70:0/180024124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d90036070 con 0x55da663ea8a0 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.823+0000 7f3d89600700 1 -- 172.21.15.70:0/180024124 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3d90010d20 con 0x55da663ea8a0 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.823+0000 7f3db0822b80 10 client.15159 fetch_fsmap learned FSMap version 26 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.823+0000 7f3db0822b80 1 -- 172.21.15.70:0/180024124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55da6646f4d0 con 0x55da663ea8a0 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.824+0000 7f3d89600700 1 -- 172.21.15.70:0/180024124 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d90036070 con 0x55da663ea8a0 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.824+0000 7f3d89600700 1 -- 172.21.15.70:0/180024124 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3d9001e4d0 con 0x55da663ea8a0 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.824+0000 7f3db0822b80 10 client.15159 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.824+0000 7f3db0822b80 10 client.15159 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.824+0000 7f3db0822b80 20 client.15159 populate_metadata read hostname 'smithi070' 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.824+0000 7f3db0822b80 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x55da66473c70 0x55da66472980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.824+0000 7f3db0822b80 4 client.15159 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.824+0000 7f3db0822b80 1 -- 172.21.15.70:0/180024124 --> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] -- command(tid 0: {"prefix": "status"}) -- 0x55da6634a3b0 con 0x55da66473c70 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.824+0000 7f3d9e000700 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x55da66473c70 0x55da66472980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.825+0000 7f3d9e000700 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x55da66473c70 0x55da66472980 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3cd5b83ff310c433 server_cookie=5e1bc118e7d7035b in_seq=0 out_seq=0 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.825+0000 7f3d89600700 10 client.15159 ms_handle_connect on v2:172.21.15.172:6836/2037790761 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3d89600700 1 -- 172.21.15.70:0/180024124 <== mds.1 v2:172.21.15.172:6836/2037790761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55da6634a3b0 con 0x55da66473c70 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3d89600700 10 client.15159 handle_command_reply: tid=0 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 client.15159 shutdown 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 -- 172.21.15.70:0/180024124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 msgr2=0x55da663e3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663e3e90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3d90010810 tx=0x7f3d90005390 comp rx=0 tx=0).stop 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 -- 172.21.15.70:0/180024124 shutdown_connections 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x55da66473c70 0x55da66472980 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55da663f0490 0x55da663e4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55da663ea8a0 0x55da663e3e90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 --2- 172.21.15.70:0/180024124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55da663efb70 0x55da663e43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3d89600700 0 client.15159 ms_handle_reset on v2:172.21.15.172:6836/2037790761 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 -- 172.21.15.70:0/180024124 >> 172.21.15.70:0/180024124 conn(0x55da66362680 msgr2=0x55da663ee6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 -- 172.21.15.70:0/180024124 shutdown_connections 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.826+0000 7f3db0822b80 1 -- 172.21.15.70:0/180024124 wait complete. 2024-05-08T06:46:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.827+0000 7f3db0822b80 20 client.15159 trim_cache size 0 max 16384 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34409, 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 217.60481322800001, 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 26, 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 92, 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 90, 2024-05-08T06:46:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 343.69570003899997 2024-05-08T06:46:16.830 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:46:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.827+0000 7f3da5e00700 1 -- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3d840b2900 msgr2=0x7f3d840b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.827+0000 7f3da5e00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3d840b2900 0x7f3d840b4dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009b50 tx=0x7f3d90009550 comp rx=0 tx=0).stop 2024-05-08T06:46:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.827+0000 7f3da5e00700 1 -- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010b6c0 msgr2=0x7f3da019bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.827+0000 7f3da5e00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010b6c0 0x7f3da019bad0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3d98007ee0 tx=0x7f3d9800d3b0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.827+0000 7f3da5e00700 1 -- 172.21.15.70:0/3969111362 shutdown_connections 2024-05-08T06:46:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.827+0000 7f3da5e00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f3d840b2900 0x7f3d840b4dc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.827+0000 7f3da5e00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3da010b6c0 0x7f3da019bad0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.827+0000 7f3da5e00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3da01056c0 0x7f3da01a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.828+0000 7f3da5e00700 1 --2- 172.21.15.70:0/3969111362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3da0106080 0x7f3da01a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.828+0000 7f3da5e00700 1 -- 172.21.15.70:0/3969111362 >> 172.21.15.70:0/3969111362 conn(0x7f3da01011b0 msgr2=0x7f3da01018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.828+0000 7f3da5e00700 1 -- 172.21.15.70:0/3969111362 shutdown_connections 2024-05-08T06:46:16.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:16.828+0000 7f3da5e00700 1 -- 172.21.15.70:0/3969111362 wait complete. 2024-05-08T06:46:17.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-08T06:46:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:17 smithi070 ceph-mon[29591]: pgmap v533: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:46:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:17 smithi172 ceph-mon[33377]: pgmap v533: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:46:18.185 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:17 smithi194 ceph-mon[33679]: pgmap v533: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T06:46:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:18 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:46:19.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:18 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:46:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:18 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:46:20.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:19 smithi070 ceph-mon[29591]: pgmap v534: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:20.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:19 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:46:20.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:19 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:46:20.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:19 smithi070 ceph-mon[29591]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:46:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:19 smithi194 ceph-mon[33679]: pgmap v534: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:19 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:46:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:19 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:46:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:19 smithi194 ceph-mon[33679]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:46:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:19 smithi172 ceph-mon[33377]: pgmap v534: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:19 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:46:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:19 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:46:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:19 smithi172 ceph-mon[33377]: from='mgr.14152 172.21.15.70:0/1367609956' entity='mgr.x' 2024-05-08T06:46:20.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.764+0000 7f136d600700 1 -- 172.21.15.70:0/3426681002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1368109ad0 msgr2=0x7f1368109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.764+0000 7f136d600700 1 --2- 172.21.15.70:0/3426681002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1368109ad0 0x7f1368109f50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1350009990 tx=0x7f1350009ca0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.764+0000 7f136d600700 1 -- 172.21.15.70:0/3426681002 shutdown_connections 2024-05-08T06:46:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.764+0000 7f136d600700 1 --2- 172.21.15.70:0/3426681002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f136810a490 0x7f13681169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.764+0000 7f136d600700 1 --2- 172.21.15.70:0/3426681002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f136810fb60 0x7f136810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.764+0000 7f136d600700 1 --2- 172.21.15.70:0/3426681002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1368109ad0 0x7f1368109f50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.765+0000 7f136d600700 1 -- 172.21.15.70:0/3426681002 >> 172.21.15.70:0/3426681002 conn(0x7f1368076c70 msgr2=0x7f13681082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.765+0000 7f136d600700 1 -- 172.21.15.70:0/3426681002 shutdown_connections 2024-05-08T06:46:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.765+0000 7f136d600700 1 -- 172.21.15.70:0/3426681002 wait complete. 2024-05-08T06:46:20.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.766+0000 7f136d600700 1 Processor -- start 2024-05-08T06:46:20.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.766+0000 7f136d600700 1 -- start start 2024-05-08T06:46:20.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f136d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1368109ad0 0x7f13681a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f136d600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f136810a490 0x7f13681a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f136d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f136810fb60 0x7f13681a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f136d600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1368119b80 con 0x7f136810fb60 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f136d600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1368119a00 con 0x7f1368109ad0 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f136d600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1368119d00 con 0x7f136810a490 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f1367400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f136810fb60 0x7f13681a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f1367400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f136810fb60 0x7f13681a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45794/0 (socket says 172.21.15.70:45794) 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f1367400700 1 -- 172.21.15.70:0/2714743075 learned_addr learned my addr 172.21.15.70:0/2714743075 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f135fe00700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f136810a490 0x7f13681a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.767+0000 7f1366a00700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1368109ad0 0x7f13681a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f1367400700 1 -- 172.21.15.70:0/2714743075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f136810a490 msgr2=0x7f13681a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:20.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f1367400700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f136810a490 0x7f13681a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f1367400700 1 -- 172.21.15.70:0/2714743075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1368109ad0 msgr2=0x7f13681a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:20.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f1367400700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1368109ad0 0x7f13681a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f1367400700 1 -- 172.21.15.70:0/2714743075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13681a50a0 con 0x7f136810fb60 2024-05-08T06:46:20.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f1366a00700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1368109ad0 0x7f13681a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:46:20.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f1367400700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f136810fb60 0x7f13681a4960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f136000ada0 tx=0x7f136000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:20.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f135f400700 1 -- 172.21.15.70:0/2714743075 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360017020 con 0x7f136810fb60 2024-05-08T06:46:20.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f135f400700 1 -- 172.21.15.70:0/2714743075 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f136000ce10 con 0x7f136810fb60 2024-05-08T06:46:20.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f136d600700 1 -- 172.21.15.70:0/2714743075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13681a5390 con 0x7f136810fb60 2024-05-08T06:46:20.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.768+0000 7f135f400700 1 -- 172.21.15.70:0/2714743075 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1360005280 con 0x7f136810fb60 2024-05-08T06:46:20.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.769+0000 7f136d600700 1 -- 172.21.15.70:0/2714743075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13681acc10 con 0x7f136810fb60 2024-05-08T06:46:20.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.772+0000 7f135f400700 1 -- 172.21.15.70:0/2714743075 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f136000c980 con 0x7f136810fb60 2024-05-08T06:46:20.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.773+0000 7f1377e99b80 1 Processor -- start 2024-05-08T06:46:20.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.773+0000 7f1377e99b80 1 -- start start 2024-05-08T06:46:20.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bbb70 0x55e94c3bbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bc490 0x55e94c3b6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 0x55e94c3b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1377e99b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e94c3089d0 con 0x55e94c3bc490 2024-05-08T06:46:20.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1377e99b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e94c2a6710 con 0x55e94c3bbb70 2024-05-08T06:46:20.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1377e99b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e94c304990 con 0x55e94c3b68a0 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f135f400700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f134c0b2880 0x7f134c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1366a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bc490 0x55e94c3b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f135f400700 1 -- 172.21.15.70:0/2714743075 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f13600e1d80 con 0x7f136810fb60 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1366a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bc490 0x55e94c3b6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45808/0 (socket says 172.21.15.70:45808) 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1366a00700 1 -- 172.21.15.70:0/4266010133 learned_addr learned my addr 172.21.15.70:0/4266010133 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f1367400700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f134c0b2880 0x7f134c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f135fe00700 1 --2- 172.21.15.70:0/4266010133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bbb70 0x55e94c3bbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.774+0000 7f135fe00700 1 --2- 172.21.15.70:0/4266010133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 0x55e94c3b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.775+0000 7f1366a00700 1 -- 172.21.15.70:0/4266010133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 msgr2=0x55e94c3b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.775+0000 7f1366a00700 1 --2- 172.21.15.70:0/4266010133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 0x55e94c3b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.775+0000 7f1366a00700 1 -- 172.21.15.70:0/4266010133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bbb70 msgr2=0x55e94c3bbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.775+0000 7f1366a00700 1 --2- 172.21.15.70:0/4266010133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bbb70 0x55e94c3bbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.775+0000 7f1366a00700 1 -- 172.21.15.70:0/4266010133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e94c255880 con 0x55e94c3bc490 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.775+0000 7f1367400700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f134c0b2880 0x7f134c0b4d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f13600a8f70 tx=0x7f136000a0a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:20.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.775+0000 7f1366a00700 1 --2- 172.21.15.70:0/4266010133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bc490 0x55e94c3b6280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f135800bd10 tx=0x7f135800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fd87c215c2316c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:20.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.776+0000 7f1357e00700 1 -- 172.21.15.70:0/4266010133 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135800be60 con 0x55e94c3bc490 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.776+0000 7f1357e00700 1 -- 172.21.15.70:0/4266010133 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f135800fda0 con 0x55e94c3bc490 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.776+0000 7f1357e00700 1 -- 172.21.15.70:0/4266010133 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358010650 con 0x55e94c3bc490 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.776+0000 7f1377e99b80 1 -- 172.21.15.70:0/4266010133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bc490 msgr2=0x55e94c3b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.776+0000 7f1377e99b80 1 --2- 172.21.15.70:0/4266010133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bc490 0x55e94c3b6280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f135800bd10 tx=0x7f135800f640 comp rx=0 tx=0).stop 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.777+0000 7f1377e99b80 1 -- 172.21.15.70:0/4266010133 shutdown_connections 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.777+0000 7f1377e99b80 1 --2- 172.21.15.70:0/4266010133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 0x55e94c3b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.777+0000 7f1377e99b80 1 --2- 172.21.15.70:0/4266010133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bbb70 0x55e94c3bbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.777+0000 7f1377e99b80 1 --2- 172.21.15.70:0/4266010133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bc490 0x55e94c3b6280 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.777+0000 7f1377e99b80 1 -- 172.21.15.70:0/4266010133 >> 172.21.15.70:0/4266010133 conn(0x55e94c32e680 msgr2=0x55e94c3b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.777+0000 7f1377e99b80 1 -- 172.21.15.70:0/4266010133 shutdown_connections 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.777+0000 7f1377e99b80 1 -- 172.21.15.70:0/4266010133 wait complete. 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.777+0000 7f1377e99b80 1 -- start start 2024-05-08T06:46:20.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.777+0000 7f1377e99b80 1 Processor -- start 2024-05-08T06:46:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 0x55e94c3c2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3bf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bc490 0x55e94c3bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1377e99b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e94c3c2ed0 con 0x55e94c3bbb70 2024-05-08T06:46:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1377e99b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e94c26ead0 con 0x55e94c3bc490 2024-05-08T06:46:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1377e99b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e94c3c3050 con 0x55e94c3b68a0 2024-05-08T06:46:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1377e99b80 10 client.0 _ll_register_callbacks cb 0x55e94c2afc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:46:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1366a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1366a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3bf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45824/0 (socket says 172.21.15.70:45824) 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.778+0000 7f1366a00700 1 -- 172.21.15.70:0/3792296318 learned_addr learned my addr 172.21.15.70:0/3792296318 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f135fe00700 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 0x55e94c3c2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f135fe00700 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bc490 0x55e94c3bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f1366a00700 1 -- 172.21.15.70:0/3792296318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 msgr2=0x55e94c3c2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f1366a00700 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 0x55e94c3c2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f1366a00700 1 -- 172.21.15.70:0/3792296318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bc490 msgr2=0x55e94c3bfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f1366a00700 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bc490 0x55e94c3bfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f1366a00700 1 -- 172.21.15.70:0/3792296318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e94c2ce3d0 con 0x55e94c3bbb70 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f1366a00700 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3bf500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1358000c00 tx=0x7f1358005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4953e71f21c1f8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f1354c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.779+0000 7f1354c00700 1 -- 172.21.15.70:0/3792296318 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135800be60 con 0x55e94c3bbb70 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.780+0000 7f1354c00700 1 -- 172.21.15.70:0/3792296318 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f1358011440 con 0x55e94c3bbb70 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.780+0000 7f1377e99b80 1 -- 172.21.15.70:0/3792296318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f135800fda0 con 0x55e94c3bbb70 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.780+0000 7f1354c00700 1 -- 172.21.15.70:0/3792296318 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1358032050 con 0x55e94c3bbb70 2024-05-08T06:46:20.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.780+0000 7f1377e99b80 10 client.15171 fetch_fsmap learned FSMap version 26 2024-05-08T06:46:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.780+0000 7f1377e99b80 1 -- 172.21.15.70:0/3792296318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e94c3cd730 con 0x55e94c3bbb70 2024-05-08T06:46:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.780+0000 7f1354c00700 1 -- 172.21.15.70:0/3792296318 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f135800fda0 con 0x55e94c3bbb70 2024-05-08T06:46:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.780+0000 7f1354c00700 1 -- 172.21.15.70:0/3792296318 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f135802d030 con 0x55e94c3bbb70 2024-05-08T06:46:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.780+0000 7f1377e99b80 10 client.15171 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:46:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.781+0000 7f1377e99b80 10 client.15171 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T06:46:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.781+0000 7f1377e99b80 20 client.15171 populate_metadata read hostname 'smithi070' 2024-05-08T06:46:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.781+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e94c3cf980 0x55e94c3d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.781+0000 7f1377e99b80 4 client.15171 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:46:20.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.781+0000 7f1377e99b80 1 -- 172.21.15.70:0/3792296318 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e94c3830f0 con 0x55e94c3cf980 2024-05-08T06:46:20.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.781+0000 7f135fe00700 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e94c3cf980 0x55e94c3d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.782+0000 7f135fe00700 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e94c3cf980 0x55e94c3d0df0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a90b4333a0bd4e2 server_cookie=320f59bed35d64dc in_seq=0 out_seq=0 2024-05-08T06:46:20.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.782+0000 7f1354c00700 10 client.15171 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:46:20.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.784+0000 7f1354c00700 1 -- 172.21.15.70:0/3792296318 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e94c3830f0 con 0x55e94c3cf980 2024-05-08T06:46:20.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.784+0000 7f1354c00700 10 client.15171 handle_command_reply: tid=0 2024-05-08T06:46:20.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.784+0000 7f1377e99b80 1 client.15171 shutdown 2024-05-08T06:46:20.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.784+0000 7f1377e99b80 1 -- 172.21.15.70:0/3792296318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 msgr2=0x55e94c3bf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.784+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3bf500 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1358000c00 tx=0x7f1358005320 comp rx=0 tx=0).stop 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1377e99b80 1 -- 172.21.15.70:0/3792296318 shutdown_connections 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e94c3cf980 0x55e94c3d0df0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bc490 0x55e94c3bfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3b68a0 0x55e94c3c2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3792296318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3bf500 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1377e99b80 1 -- 172.21.15.70:0/3792296318 >> 172.21.15.70:0/3792296318 conn(0x55e94c32e680 msgr2=0x55e94c3b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1354c00700 0 client.15171 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1377e99b80 1 -- 172.21.15.70:0/3792296318 shutdown_connections 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1377e99b80 1 -- 172.21.15.70:0/3792296318 wait complete. 2024-05-08T06:46:20.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.785+0000 7f1377e99b80 20 client.15171 trim_cache size 0 max 16384 2024-05-08T06:46:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.807+0000 7f1377e99b80 1 Processor -- start 2024-05-08T06:46:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.807+0000 7f1377e99b80 1 -- start start 2024-05-08T06:46:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.808+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3b68a0 0x55e94c3b6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.808+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.808+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bc490 0x55e94c3bc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.808+0000 7f1377e99b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e94c3cf130 con 0x55e94c3bbb70 2024-05-08T06:46:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.808+0000 7f1377e99b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e94c3cf800 con 0x55e94c3b68a0 2024-05-08T06:46:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.808+0000 7f1377e99b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e94c3cfed0 con 0x55e94c3bc490 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.808+0000 7f1366a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.808+0000 7f1366a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45838/0 (socket says 172.21.15.70:45838) 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.808+0000 7f1366a00700 1 -- 172.21.15.70:0/4149348441 learned_addr learned my addr 172.21.15.70:0/4149348441 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f135fe00700 1 --2- 172.21.15.70:0/4149348441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bc490 0x55e94c3bc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f135fe00700 1 --2- 172.21.15.70:0/4149348441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3b68a0 0x55e94c3b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f1366a00700 1 -- 172.21.15.70:0/4149348441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bc490 msgr2=0x55e94c3bc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f1366a00700 1 --2- 172.21.15.70:0/4149348441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bc490 0x55e94c3bc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f1366a00700 1 -- 172.21.15.70:0/4149348441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3b68a0 msgr2=0x55e94c3b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f1366a00700 1 --2- 172.21.15.70:0/4149348441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3b68a0 0x55e94c3b6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f1366a00700 1 -- 172.21.15.70:0/4149348441 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e94c3aba60 con 0x55e94c3bbb70 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f1366a00700 1 --2- 172.21.15.70:0/4149348441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3b08c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1358004d80 tx=0x7f1358005440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a473b1d2c10486 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f1357400700 1 -- 172.21.15.70:0/4149348441 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f135803b070 con 0x55e94c3bbb70 2024-05-08T06:46:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f1357400700 1 -- 172.21.15.70:0/4149348441 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f135800be60 con 0x55e94c3bbb70 2024-05-08T06:46:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.809+0000 7f1357400700 1 -- 172.21.15.70:0/4149348441 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1358004030 con 0x55e94c3bbb70 2024-05-08T06:46:20.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.810+0000 7f1377e99b80 1 -- 172.21.15.70:0/4149348441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 msgr2=0x55e94c3b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:20.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.810+0000 7f1377e99b80 1 --2- 172.21.15.70:0/4149348441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3b08c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1358004d80 tx=0x7f1358005440 comp rx=0 tx=0).stop 2024-05-08T06:46:20.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.810+0000 7f1377e99b80 1 -- 172.21.15.70:0/4149348441 shutdown_connections 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.810+0000 7f1377e99b80 1 --2- 172.21.15.70:0/4149348441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bc490 0x55e94c3bc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.810+0000 7f1377e99b80 1 --2- 172.21.15.70:0/4149348441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3b68a0 0x55e94c3b6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.810+0000 7f1377e99b80 1 --2- 172.21.15.70:0/4149348441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3bbb70 0x55e94c3b08c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.810+0000 7f1377e99b80 1 -- 172.21.15.70:0/4149348441 >> 172.21.15.70:0/4149348441 conn(0x55e94c32e680 msgr2=0x55e94c3ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.810+0000 7f1377e99b80 1 -- 172.21.15.70:0/4149348441 shutdown_connections 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.810+0000 7f1377e99b80 1 -- 172.21.15.70:0/4149348441 wait complete. 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.811+0000 7f1377e99b80 1 -- start start 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.811+0000 7f1377e99b80 1 Processor -- start 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.811+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3b68a0 0x55e94c3da880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.811+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bbb70 0x55e94c3afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f1377e99b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bc490 0x55e94c3b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f1377e99b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e94c3d0c70 con 0x55e94c3b68a0 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f1377e99b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e94c3d05a0 con 0x55e94c3bc490 2024-05-08T06:46:20.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f1377e99b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e94c3d1340 con 0x55e94c3bbb70 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f1377e99b80 10 client.0 _ll_register_callbacks cb 0x55e94c2afc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f135fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3b68a0 0x55e94c3da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f135fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3b68a0 0x55e94c3da880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45852/0 (socket says 172.21.15.70:45852) 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f135fe00700 1 -- 172.21.15.70:0/3109095549 learned_addr learned my addr 172.21.15.70:0/3109095549 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f1366a00700 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bbb70 0x55e94c3afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f135fe00700 1 -- 172.21.15.70:0/3109095549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bbb70 msgr2=0x55e94c3afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f135fe00700 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bbb70 0x55e94c3afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f135fe00700 1 -- 172.21.15.70:0/3109095549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bc490 msgr2=0x55e94c3b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f135fe00700 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bc490 0x55e94c3b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.812+0000 7f135fe00700 1 -- 172.21.15.70:0/3109095549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e94c3d8410 con 0x55e94c3b68a0 2024-05-08T06:46:20.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.813+0000 7f135fe00700 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3b68a0 0x55e94c3da880 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1350009750 tx=0x7f1350005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6197d9c96a587b73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.813+0000 7f1354c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.813+0000 7f1354c00700 1 -- 172.21.15.70:0/3109095549 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13500037c0 con 0x55e94c3b68a0 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.813+0000 7f1354c00700 1 -- 172.21.15.70:0/3109095549 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f1350003960 con 0x55e94c3b68a0 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.813+0000 7f1377e99b80 1 -- 172.21.15.70:0/3109095549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f135800be60 con 0x55e94c3b68a0 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.813+0000 7f1354c00700 1 -- 172.21.15.70:0/3109095549 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1350003b60 con 0x55e94c3b68a0 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.813+0000 7f1377e99b80 10 client.15177 fetch_fsmap learned FSMap version 26 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.813+0000 7f1377e99b80 1 -- 172.21.15.70:0/3109095549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e94c43afd0 con 0x55e94c3b68a0 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.814+0000 7f1354c00700 1 -- 172.21.15.70:0/3109095549 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f135800be60 con 0x55e94c3b68a0 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.814+0000 7f1354c00700 1 -- 172.21.15.70:0/3109095549 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f135002c270 con 0x55e94c3b68a0 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.814+0000 7f1377e99b80 10 client.15177 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.814+0000 7f1377e99b80 10 client.15177 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.814+0000 7f1377e99b80 20 client.15177 populate_metadata read hostname 'smithi070' 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.814+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e94c43fba0 0x55e94c43e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:20.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.814+0000 7f1377e99b80 4 client.15177 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:46:20.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.814+0000 7f1377e99b80 1 -- 172.21.15.70:0/3109095549 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "status"}) -- 0x55e94c3163b0 con 0x55e94c43fba0 2024-05-08T06:46:20.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.815+0000 7f1366a00700 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e94c43fba0 0x55e94c43e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:20.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.815+0000 7f1366a00700 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e94c43fba0 0x55e94c43e8b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c53c5774e4353ffa server_cookie=cd636c95bf5146e1 in_seq=0 out_seq=0 2024-05-08T06:46:20.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.815+0000 7f1354c00700 10 client.15177 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.816+0000 7f1354c00700 1 -- 172.21.15.70:0/3109095549 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e94c3163b0 con 0x55e94c43fba0 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.816+0000 7f1354c00700 10 client.15177 handle_command_reply: tid=0 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.816+0000 7f1377e99b80 1 client.15177 shutdown 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.816+0000 7f1377e99b80 1 -- 172.21.15.70:0/3109095549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3b68a0 msgr2=0x55e94c3da880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.816+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3b68a0 0x55e94c3da880 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1350009750 tx=0x7f1350005c40 comp rx=0 tx=0).stop 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1377e99b80 1 -- 172.21.15.70:0/3109095549 shutdown_connections 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e94c43fba0 0x55e94c43e8b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e94c3bc490 0x55e94c3b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1354c00700 0 client.15177 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:46:20.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e94c3b68a0 0x55e94c3da880 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1377e99b80 1 --2- 172.21.15.70:0/3109095549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e94c3bbb70 0x55e94c3afcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1377e99b80 1 -- 172.21.15.70:0/3109095549 >> 172.21.15.70:0/3109095549 conn(0x55e94c32e680 msgr2=0x55e94c3bc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1377e99b80 1 -- 172.21.15.70:0/3109095549 shutdown_connections 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1377e99b80 1 -- 172.21.15.70:0/3109095549 wait complete. 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.817+0000 7f1377e99b80 20 client.15177 trim_cache size 0 max 16384 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34442, 2024-05-08T06:46:20.818 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:46:20.819 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:46:20.819 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:46:20.819 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 307.23110942099999, 2024-05-08T06:46:20.819 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 26, 2024-05-08T06:46:20.819 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 92, 2024-05-08T06:46:20.819 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 90, 2024-05-08T06:46:20.819 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 330.210827333 2024-05-08T06:46:20.819 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:46:20.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 -- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f134c0b2880 msgr2=0x7f134c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f134c0b2880 0x7f134c0b4d40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f13600a8f70 tx=0x7f136000a0a0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 -- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f136810fb60 msgr2=0x7f13681a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f136810fb60 0x7f13681a4960 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f136000ada0 tx=0x7f136000c330 comp rx=0 tx=0).stop 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 -- 172.21.15.70:0/2714743075 shutdown_connections 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f134c0b2880 0x7f134c0b4d40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f136810fb60 0x7f13681a4960 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1368109ad0 0x7f13681a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 --2- 172.21.15.70:0/2714743075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f136810a490 0x7f13681a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 -- 172.21.15.70:0/2714743075 >> 172.21.15.70:0/2714743075 conn(0x7f1368076c70 msgr2=0x7f1368077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 -- 172.21.15.70:0/2714743075 shutdown_connections 2024-05-08T06:46:20.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:20.818+0000 7f136d600700 1 -- 172.21.15.70:0/2714743075 wait complete. 2024-05-08T06:46:21.905 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T06:46:21.915 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T06:46:21.915 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T06:46:21.916 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T06:46:21.916 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-05-08T06:46:21.916 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T06:46:21.917 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T06:46:21.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-05-08T06:46:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.123+0000 7f4783e00640 1 -- 172.21.15.70:0/1619334795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784104420 msgr2=0x7f478410acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.123+0000 7f4783e00640 1 --2- 172.21.15.70:0/1619334795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784104420 0x7f478410acb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f477c009ca0 tx=0x7f477c02a8c0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.123+0000 7f4783e00640 1 -- 172.21.15.70:0/1619334795 shutdown_connections 2024-05-08T06:46:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.124+0000 7f4783e00640 1 --2- 172.21.15.70:0/1619334795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784104420 0x7f478410acb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.124+0000 7f4783e00640 1 --2- 172.21.15.70:0/1619334795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4784103a60 0x7f4784103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.124+0000 7f4783e00640 1 --2- 172.21.15.70:0/1619334795 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4784102870 0x7f4784102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.124+0000 7f4783e00640 1 -- 172.21.15.70:0/1619334795 >> 172.21.15.70:0/1619334795 conn(0x7f47840fdde0 msgr2=0x7f4784100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:22.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.124+0000 7f4783e00640 1 -- 172.21.15.70:0/1619334795 shutdown_connections 2024-05-08T06:46:22.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.124+0000 7f4783e00640 1 -- 172.21.15.70:0/1619334795 wait complete. 2024-05-08T06:46:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.124+0000 7f4783e00640 1 Processor -- start 2024-05-08T06:46:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f4783e00640 1 -- start start 2024-05-08T06:46:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f4783e00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4784102870 0x7f4784076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f4783e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784103a60 0x7f4784074da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f4783e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4784104420 0x7f47840752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f4783e00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f478410e2a0 con 0x7f4784103a60 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f4783e00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f478410e120 con 0x7f4784102870 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f4783e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f478410e420 con 0x7f4784104420 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f477a000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784103a60 0x7f4784074da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f477a000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784103a60 0x7f4784074da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45866/0 (socket says 172.21.15.70:45866) 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.125+0000 7f477a000640 1 -- 172.21.15.70:0/2064912612 learned_addr learned my addr 172.21.15.70:0/2064912612 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f4782a00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4784102870 0x7f4784076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f4783400640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4784104420 0x7f47840752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f477a000640 1 -- 172.21.15.70:0/2064912612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4784104420 msgr2=0x7f47840752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f477a000640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4784104420 0x7f47840752e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f477a000640 1 -- 172.21.15.70:0/2064912612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4784102870 msgr2=0x7f4784076760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f477a000640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4784102870 0x7f4784076760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f477a000640 1 -- 172.21.15.70:0/2064912612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4784075b70 con 0x7f4784103a60 2024-05-08T06:46:22.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f4783400640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4784104420 0x7f47840752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:46:22.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f477a000640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784103a60 0x7f4784074da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d770 tx=0x7f476c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:22.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f477be00640 1 -- 172.21.15.70:0/2064912612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c017070 con 0x7f4784103a60 2024-05-08T06:46:22.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f477be00640 1 -- 172.21.15.70:0/2064912612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f476c0054b0 con 0x7f4784103a60 2024-05-08T06:46:22.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47841a2a00 con 0x7f4784103a60 2024-05-08T06:46:22.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.126+0000 7f477be00640 1 -- 172.21.15.70:0/2064912612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c004c60 con 0x7f4784103a60 2024-05-08T06:46:22.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.127+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47841a2f00 con 0x7f4784103a60 2024-05-08T06:46:22.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.128+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4784109c10 con 0x7f4784103a60 2024-05-08T06:46:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:21 smithi070 ceph-mon[29591]: pgmap v535: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:22.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.130+0000 7f477be00640 1 -- 172.21.15.70:0/2064912612 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f476c004e00 con 0x7f4784103a60 2024-05-08T06:46:22.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.132+0000 7f477be00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47680b27e0 0x7f47680b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:22.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.132+0000 7f477be00640 1 -- 172.21.15.70:0/2064912612 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f476c0e24d0 con 0x7f4784103a60 2024-05-08T06:46:22.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.132+0000 7f4782a00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47680b27e0 0x7f47680b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:22.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.133+0000 7f4782a00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47680b27e0 0x7f47680b4ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f47740058c0 tx=0x7f4774005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:22.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.134+0000 7f477be00640 1 -- 172.21.15.70:0/2064912612 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f476c0a9e00 con 0x7f4784103a60 2024-05-08T06:46:22.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:21 smithi194 ceph-mon[33679]: pgmap v535: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:22.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.393+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f478402dce0 con 0x7f4784103a60 2024-05-08T06:46:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:21 smithi172 ceph-mon[33377]: pgmap v535: 129 pgs: 129 active+clean; 648 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:22.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.960+0000 7f477be00640 1 -- 172.21.15.70:0/2064912612 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f476c0a3e20 con 0x7f4784103a60 2024-05-08T06:46:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47680b27e0 msgr2=0x7f47680b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:22.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47680b27e0 0x7f47680b4ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f47740058c0 tx=0x7f4774005850 comp rx=0 tx=0).stop 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784103a60 msgr2=0x7f4784074da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784103a60 0x7f4784074da0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d770 tx=0x7f476c00dc30 comp rx=0 tx=0).stop 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 shutdown_connections 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4784104420 0x7f47840752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f47680b27e0 0x7f47680b4ca0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4784103a60 0x7f4784074da0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 --2- 172.21.15.70:0/2064912612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4784102870 0x7f4784076760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 >> 172.21.15.70:0/2064912612 conn(0x7f47840fdde0 msgr2=0x7f4784106de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 shutdown_connections 2024-05-08T06:46:22.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:22.964+0000 7f4783e00640 1 -- 172.21.15.70:0/2064912612 wait complete. 2024-05-08T06:46:22.990 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-08T06:46:23.002 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-08T06:46:23.002 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-08T06:46:23.002 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-05-08T06:46:23.002 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T06:46:23.002 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T06:46:23.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:23.003 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-05-08T06:46:23.047 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-08T06:46:23.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:23.048 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-08T06:46:23.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:23.159 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-05-08T06:46:23.216 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2064912612' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-08T06:46:23.216 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: ignoring --setuser ceph since I am not root 2024-05-08T06:46:23.216 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: ignoring --setgroup ceph since I am not root 2024-05-08T06:46:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:22 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2064912612' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-08T06:46:23.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: ignoring --setuser ceph since I am not root 2024-05-08T06:46:23.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: ignoring --setgroup ceph since I am not root 2024-05-08T06:46:23.261 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:23 smithi194 ceph-mgr[35570]: -- 172.21.15.194:0/2622729671 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a366465a0 con 0x563a3661ac00 2024-05-08T06:46:23.261 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-08T06:46:23.262 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-08T06:46:23.277 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:22 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2064912612' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-08T06:46:23.278 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: ignoring --setuser ceph since I am not root 2024-05-08T06:46:23.278 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: ignoring --setgroup ceph since I am not root 2024-05-08T06:46:23.278 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:23 smithi172 ceph-mgr[34744]: -- 172.21.15.172:0/3795510646 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557de60485a0 con 0x557de601d000 2024-05-08T06:46:23.278 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:23.277+0000 7fbc701f6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T06:46:23.543 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:23.288+0000 7f8551536200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T06:46:23.543 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:23.543+0000 7f8551536200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:46:23.567 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:23.314+0000 7fc14a2d1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T06:46:23.675 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:23.833 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:23.567+0000 7fc14a2d1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:46:23.833 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:23.721+0000 7fc14a2d1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T06:46:23.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:23.534+0000 7fbc701f6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:46:23.929 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:23.665+0000 7fbc701f6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T06:46:23.963 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:23.672+0000 7f8551536200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T06:46:24.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:23 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2064912612' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-08T06:46:24.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:23 smithi070 ceph-mon[29591]: mgrmap e19: x(active, since 15m), standbys: z, y 2024-05-08T06:46:24.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:23 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2064912612' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-08T06:46:24.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:23 smithi194 ceph-mon[33679]: mgrmap e19: x(active, since 15m), standbys: z, y 2024-05-08T06:46:24.261 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:24.065+0000 7f8551536200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T06:46:24.261 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:24.180+0000 7f8551536200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T06:46:24.341 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:24 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:24.133+0000 7fc14a2d1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T06:46:24.341 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:24 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:24.249+0000 7fc14a2d1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T06:46:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:23 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2064912612' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-08T06:46:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:23 smithi172 ceph-mon[33377]: mgrmap e19: x(active, since 15m), standbys: z, y 2024-05-08T06:46:24.429 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:24 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:24.063+0000 7fbc701f6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T06:46:24.429 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:24 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:24.176+0000 7fbc701f6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T06:46:25.984 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:25 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:25.814+0000 7fc14a2d1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T06:46:26.010 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:25.705+0000 7f8551536200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T06:46:26.010 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:25.933+0000 7f8551536200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T06:46:26.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.150+0000 7f0368a00700 1 -- 172.21.15.70:0/1905075677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 msgr2=0x7f03641039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:26.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.150+0000 7f0368a00700 1 --2- 172.21.15.70:0/1905075677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 0x7f03641039a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0350009990 tx=0x7f0350009ca0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.151+0000 7f0368a00700 1 -- 172.21.15.70:0/1905075677 shutdown_connections 2024-05-08T06:46:26.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.151+0000 7f0368a00700 1 --2- 172.21.15.70:0/1905075677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0364103ee0 0x7f0364110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.151+0000 7f0368a00700 1 --2- 172.21.15.70:0/1905075677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0364109530 0x7f0364109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.151+0000 7f0368a00700 1 --2- 172.21.15.70:0/1905075677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 0x7f03641039a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.151+0000 7f0368a00700 1 -- 172.21.15.70:0/1905075677 >> 172.21.15.70:0/1905075677 conn(0x7f036407a570 msgr2=0x7f036407a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:26.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.151+0000 7f0368a00700 1 -- 172.21.15.70:0/1905075677 shutdown_connections 2024-05-08T06:46:26.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.151+0000 7f0368a00700 1 -- 172.21.15.70:0/1905075677 wait complete. 2024-05-08T06:46:26.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.152+0000 7f0368a00700 1 Processor -- start 2024-05-08T06:46:26.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.152+0000 7f0368a00700 1 -- start start 2024-05-08T06:46:26.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0368a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 0x7f03640757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:26.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0368a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0364103ee0 0x7f0364075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:26.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0368a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0364109530 0x7f0364076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0368a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0364113570 con 0x7f0364103520 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0368a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03641133f0 con 0x7f0364109530 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0368a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f03641136f0 con 0x7f0364103ee0 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0361e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 0x7f03640757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0361e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 0x7f03640757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45888/0 (socket says 172.21.15.70:45888) 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0361e00700 1 -- 172.21.15.70:0/3084363754 learned_addr learned my addr 172.21.15.70:0/3084363754 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0361400700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0364103ee0 0x7f0364075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0362800700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0364109530 0x7f0364076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0361e00700 1 -- 172.21.15.70:0/3084363754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0364103ee0 msgr2=0x7f0364075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.153+0000 7f0361e00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0364103ee0 0x7f0364075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.154+0000 7f0361e00700 1 -- 172.21.15.70:0/3084363754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0364109530 msgr2=0x7f0364076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.154+0000 7f0361e00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0364109530 0x7f0364076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.154+0000 7f0361e00700 1 -- 172.21.15.70:0/3084363754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03641a7fb0 con 0x7f0364103520 2024-05-08T06:46:26.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.154+0000 7f0361e00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 0x7f03640757a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f035400e9a0 tx=0x7f035400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:26.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.154+0000 7f035aa00700 1 -- 172.21.15.70:0/3084363754 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035400cbd0 con 0x7f0364103520 2024-05-08T06:46:26.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.154+0000 7f035aa00700 1 -- 172.21.15.70:0/3084363754 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f035400cd70 con 0x7f0364103520 2024-05-08T06:46:26.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.154+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03641a82a0 con 0x7f0364103520 2024-05-08T06:46:26.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.154+0000 7f035aa00700 1 -- 172.21.15.70:0/3084363754 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0354018680 con 0x7f0364103520 2024-05-08T06:46:26.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.154+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03641a87e0 con 0x7f0364103520 2024-05-08T06:46:26.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.156+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f036406a190 con 0x7f0364103520 2024-05-08T06:46:26.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.158+0000 7f035aa00700 1 -- 172.21.15.70:0/3084363754 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7f0354010950 con 0x7f0364103520 2024-05-08T06:46:26.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.159+0000 7f035aa00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f03480b28d0 0x7f03480b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:26.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.159+0000 7f0361400700 1 -- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f03480b28d0 msgr2=0x7f03480b4d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3718531938 2024-05-08T06:46:26.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.159+0000 7f035aa00700 1 -- 172.21.15.70:0/3084363754 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f03540e2990 con 0x7f0364103520 2024-05-08T06:46:26.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.159+0000 7f0361400700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f03480b28d0 0x7f03480b4d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T06:46:26.164 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:25 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:25.718+0000 7fbc701f6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T06:46:26.164 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:25 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:25.947+0000 7fbc701f6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T06:46:26.164 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:26 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:26.164+0000 7fbc701f6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T06:46:26.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.165+0000 7f035aa00700 1 -- 172.21.15.70:0/3084363754 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f03540aa260 con 0x7f0364103520 2024-05-08T06:46:26.270 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:26 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:26.046+0000 7fc14a2d1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T06:46:26.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.360+0000 7f0361400700 1 -- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f03480b28d0 msgr2=0x7f03480b4d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3718531938 2024-05-08T06:46:26.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.360+0000 7f0361400700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f03480b28d0 0x7f03480b4d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T06:46:26.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.447+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f036402e6d0 con 0x7f0364103520 2024-05-08T06:46:26.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.448+0000 7f035aa00700 1 -- 172.21.15.70:0/3084363754 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) ==== 53+0+88 (secure 0 0 0) 0x7f03540b22e0 con 0x7f0364103520 2024-05-08T06:46:26.447 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-08T06:46:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.450+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f03480b28d0 msgr2=0x7f03480b4d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T06:46:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.450+0000 7f0368a00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f03480b28d0 0x7f03480b4d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.450+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 msgr2=0x7f03640757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.450+0000 7f0368a00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 0x7f03640757a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f035400e9a0 tx=0x7f035400ed60 comp rx=0 tx=0).stop 2024-05-08T06:46:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.451+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 shutdown_connections 2024-05-08T06:46:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.451+0000 7f0368a00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0364109530 0x7f0364076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.451+0000 7f0368a00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f03480b28d0 0x7f03480b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.451+0000 7f0368a00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0364103520 0x7f03640757a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.451+0000 7f0368a00700 1 --2- 172.21.15.70:0/3084363754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0364103ee0 0x7f0364075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.451+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 >> 172.21.15.70:0/3084363754 conn(0x7f036407a570 msgr2=0x7f0364102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.451+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 shutdown_connections 2024-05-08T06:46:26.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:26.451+0000 7f0368a00700 1 -- 172.21.15.70:0/3084363754 wait complete. 2024-05-08T06:46:26.500 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:26 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:26.150+0000 7f8551536200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T06:46:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:26 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3084363754' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T06:46:26.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:26 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:26.270+0000 7fc14a2d1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T06:46:26.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:26 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3084363754' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T06:46:26.760 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:26 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:26.531+0000 7f8551536200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T06:46:26.761 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:26 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:26.652+0000 7f8551536200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T06:46:26.921 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:26 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3084363754' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T06:46:26.921 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:26 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:26.546+0000 7fbc701f6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T06:46:26.921 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:26 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:26.667+0000 7fbc701f6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T06:46:27.081 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:26 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:26.680+0000 7fc14a2d1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T06:46:27.081 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:26 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:26.814+0000 7fc14a2d1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T06:46:27.159 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:26 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:26.906+0000 7f8551536200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T06:46:27.174 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:26 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:26.921+0000 7fbc701f6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T06:46:27.349 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:27 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:27.081+0000 7fc14a2d1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T06:46:27.421 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T06:46:27.421 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T06:46:27.421 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-05-08T06:46:27.421 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T06:46:27.421 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T06:46:27.421 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T06:46:27.421 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T06:46:27.421 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T06:46:27.421 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T06:46:27.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:27.422 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-05-08T06:46:27.429 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:27 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:27.175+0000 7fbc701f6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T06:46:27.464 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-05-08T06:46:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-05-08T06:46:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T06:46:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-05-08T06:46:27.465 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T06:46:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-05-08T06:46:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T06:46:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 41543sec preferred_lft 41543sec 2024-05-08T06:46:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link 2024-05-08T06:46:27.465 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-05-08T06:46:27.466 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T06:46:27.466 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:46:27.466 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:46:27.466 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2024-05-08T06:46:27.466 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2024-05-08T06:46:27.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2024-05-08T06:46:27.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T06:46:27.467 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:46:27.510 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:27 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:27.160+0000 7f8551536200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:46:27.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:46:27.610 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:27 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:27.349+0000 7fc14a2d1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T06:46:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:46:27.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:27.715 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T06:46:27.775 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-05-08T06:46:27.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:27.778 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-05-08T06:46:27.816 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-05-08T06:46:27.816 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T06:46:27.816 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T06:46:27.816 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T06:46:27.816 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T06:46:27.817 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:46:27.817 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:46:27.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T06:46:27.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T06:46:27.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T06:46:27.818 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:46:27.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:46:28.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:46:28.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:28.051 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-05-08T06:46:28.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:28.092 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-05-08T06:46:28.179 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:46:28.179 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:46:28.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T06:46:28.179 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T06:46:28.179 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:46:28.233 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:27 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:27.946+0000 7f8551536200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T06:46:28.233 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:28 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:28.233+0000 7f8551536200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T06:46:28.255 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:27 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:27.969+0000 7fbc701f6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T06:46:28.255 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:28 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:28.256+0000 7fbc701f6200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T06:46:28.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:46:28.344 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:28 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:28.183+0000 7fc14a2d1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T06:46:28.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:46:28.394 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T06:46:28.394 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:46:28.395 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:46:28.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T06:46:28.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T06:46:28.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T06:46:28.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T06:46:28.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T06:46:28.395 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:46:28.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:46:28.611 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:28 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:28.485+0000 7fc14a2d1200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T06:46:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:46:28.632 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T06:46:28.633 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-05-08T06:46:28.633 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-05-08T06:46:28.633 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T06:46:28.633 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-05-08T06:46:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T06:46:28.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:46:28.819 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-05-08T06:46:28.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T06:46:28.819 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T06:46:28.863 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T06:46:28.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T06:46:28.863 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T06:46:28.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-05-08T06:46:29.025 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T06:46:29.070 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-05-08T06:46:29.070 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-05-08T06:46:29.070 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-05-08T06:46:29.070 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-05-08T06:46:29.070 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-05-08T06:46:29.070 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-05-08T06:46:29.070 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T06:46:29.071 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b4a8edcb24d9d655fcaefcd39e7d7b71b1cfa09ccd8802ce84fc184cf8c06267/merged 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f77284b4a9f567b8b19e1728223ccb67a2c3489f6ca434e74d357aebc3141f2d/merged 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/124a976ca75d339f2de0a8dcec4e1dc965314a07f28358ade40af9b891dc6247/merged 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3da86a999b7ffb4cec02fde65264a099feb7296de5c64829b7e7489ae4677e14/merged 2024-05-08T06:46:29.072 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/26b56bc5a05fc50c1859e33f4a496242c7dd74dd9379acca6f789d32d6893a7c/merged 2024-05-08T06:46:29.073 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4f01bacc3d227e0ec94a1443ac524da60bd1a858c00dfc1e9d68e028ae3a34ba/merged 2024-05-08T06:46:29.073 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/7821f96c5423e566bbc11214870d5933f13d0c8be34c5eb9d6bd098043ec89b9/merged 2024-05-08T06:46:29.073 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/1440d4f30d5ef401fd90ce09c1249261f41ac21d83580186f9f28c725e5fc5db/merged 2024-05-08T06:46:29.073 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5071b48145490d961cbeae05c31e0db9b7afd4633599b44d29b77377739cbda4/merged 2024-05-08T06:46:29.073 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/20c52de6a7f3cad6f8892bd6359f58bc7093216411202a4925921cb4fc288190/merged 2024-05-08T06:46:29.073 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-05-08T06:46:29.073 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T06:46:29.073 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T06:46:29.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:29.074 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-05-08T06:46:29.163 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-08T06:46:29.163 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/ac79004c-96ea-4046-aeeb-a88889cabc24 --client_fs=cephfs) 2024-05-08T06:46:29.179 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:28 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:28.814+0000 7fbc701f6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T06:46:29.179 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:28 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:28.940+0000 7fbc701f6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T06:46:29.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-05-08T06:46:29.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:28 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:28.793+0000 7f8551536200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T06:46:29.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:28 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:28.920+0000 7f8551536200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T06:46:29.263 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:29.087+0000 7fc14a2d1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T06:46:29.263 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:29.221+0000 7fc14a2d1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T06:46:29.277 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T06:46:29.317 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-05-08T06:46:29.317 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-05-08T06:46:29.318 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b4a8edcb24d9d655fcaefcd39e7d7b71b1cfa09ccd8802ce84fc184cf8c06267/merged 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f77284b4a9f567b8b19e1728223ccb67a2c3489f6ca434e74d357aebc3141f2d/merged 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-05-08T06:46:29.319 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/124a976ca75d339f2de0a8dcec4e1dc965314a07f28358ade40af9b891dc6247/merged 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3da86a999b7ffb4cec02fde65264a099feb7296de5c64829b7e7489ae4677e14/merged 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/26b56bc5a05fc50c1859e33f4a496242c7dd74dd9379acca6f789d32d6893a7c/merged 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4f01bacc3d227e0ec94a1443ac524da60bd1a858c00dfc1e9d68e028ae3a34ba/merged 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/7821f96c5423e566bbc11214870d5933f13d0c8be34c5eb9d6bd098043ec89b9/merged 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/1440d4f30d5ef401fd90ce09c1249261f41ac21d83580186f9f28c725e5fc5db/merged 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5071b48145490d961cbeae05c31e0db9b7afd4633599b44d29b77377739cbda4/merged 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/20c52de6a7f3cad6f8892bd6359f58bc7093216411202a4925921cb4fc288190/merged 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T06:46:29.320 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T06:46:29.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:29.321 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-05-08T06:46:29.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:2024-05-08T06:46:29.378+0000 7fc9b0276480 -1 init, newargv = 0x55f0b6d211b0 newargc=15 2024-05-08T06:46:29.378 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[88253]: starting ceph client 2024-05-08T06:46:29.413 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[88253]: starting fuse 2024-05-08T06:46:29.679 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:29 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:29.416+0000 7fbc701f6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T06:46:29.760 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:29 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:29.390+0000 7f8551536200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T06:46:30.128 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:29.709+0000 7fc14a2d1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T06:46:30.179 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:29 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:29.885+0000 7fbc701f6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T06:46:30.179 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:30 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:30.009+0000 7fbc701f6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T06:46:30.260 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:29 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:29.843+0000 7f8551536200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T06:46:30.261 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:29 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:29.965+0000 7f8551536200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T06:46:30.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-05-08T06:46:30.574 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:30.165+0000 7fc14a2d1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T06:46:30.575 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:30.291+0000 7fc14a2d1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T06:46:30.588 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-05-08T06:46:30.604 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:30 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:30.284+0000 7f8551536200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T06:46:30.605 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:30 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:30.472+0000 7f8551536200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-05-08T06:46:30.636 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-05-08T06:46:30.637 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b4a8edcb24d9d655fcaefcd39e7d7b71b1cfa09ccd8802ce84fc184cf8c06267/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f77284b4a9f567b8b19e1728223ccb67a2c3489f6ca434e74d357aebc3141f2d/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/124a976ca75d339f2de0a8dcec4e1dc965314a07f28358ade40af9b891dc6247/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3da86a999b7ffb4cec02fde65264a099feb7296de5c64829b7e7489ae4677e14/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/26b56bc5a05fc50c1859e33f4a496242c7dd74dd9379acca6f789d32d6893a7c/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4f01bacc3d227e0ec94a1443ac524da60bd1a858c00dfc1e9d68e028ae3a34ba/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/7821f96c5423e566bbc11214870d5933f13d0c8be34c5eb9d6bd098043ec89b9/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/1440d4f30d5ef401fd90ce09c1249261f41ac21d83580186f9f28c725e5fc5db/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5071b48145490d961cbeae05c31e0db9b7afd4633599b44d29b77377739cbda4/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/20c52de6a7f3cad6f8892bd6359f58bc7093216411202a4925921cb4fc288190/merged 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-05-08T06:46:30.638 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T06:46:30.639 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T06:46:30.639 INFO:teuthology.orchestra.run.smithi070.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-08T06:46:30.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:30.640 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-05-08T06:46:30.640 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:30 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:30.331+0000 7fbc701f6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T06:46:30.640 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:30 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:30.512+0000 7fbc701f6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T06:46:30.640 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:30 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:30.640+0000 7fbc701f6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T06:46:30.681 INFO:teuthology.orchestra.run.smithi070.stdout:114 2024-05-08T06:46:30.682 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> import re 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> import os 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> 2024-05-08T06:46:30.682 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> return f 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.0")) 2024-05-08T06:46:30.683 DEBUG:teuthology.orchestra.run.smithi070:> ' 2024-05-08T06:46:30.876 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.0.88253.asok 2024-05-08T06:46:30.878 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:30.626+0000 7fc14a2d1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T06:46:30.878 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:30.815+0000 7fc14a2d1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T06:46:30.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T06:46:30.894 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.88253.asok 2024-05-08T06:46:30.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:30.894 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.88253.asok status 2024-05-08T06:46:30.942 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:30 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:30.604+0000 7f8551536200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T06:46:31.107 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:46:31.107 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2024-05-08T06:46:31.107 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "bee299f4ac344e4c45e550d7a80abcadd7bc3d5a", 2024-05-08T06:46:31.107 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "0", 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "88253", 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/volumes/qa/sv_0/ac79004c-96ea-4046-aeeb-a88889cabc24" 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 15210, 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 15210 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-05-08T06:46:31.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 725612237 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 725612237 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.15210 192.168.0.1:0/725612237", 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/725612237", 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 5, 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 26, 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 92, 2024-05-08T06:46:31.109 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2024-05-08T06:46:31.110 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2024-05-08T06:46:31.110 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2024-05-08T06:46:31.110 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:46:31.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:31.122 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2024-05-08T06:46:31.122 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-08T06:46:31.171 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2024-05-08T06:46:31.172 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-08T06:46:31.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:46:31.172 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T06:46:31.232 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:30.947+0000 7fc14a2d1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T06:46:31.250 INFO:teuthology.run_tasks:Running task exec... 2024-05-08T06:46:31.260 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T06:46:31.260 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T06:46:31.260 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-08T06:46:31.261 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:31 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:31.024+0000 7f8551536200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T06:46:31.261 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:31 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:31.151+0000 7f8551536200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T06:46:31.429 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:31 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:31.047+0000 7fbc701f6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T06:46:31.429 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:31 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:31.171+0000 7fbc701f6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T06:46:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.441+0000 7f02bb200640 1 -- 172.21.15.70:0/2434716228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc102840 msgr2=0x7f02bc102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.441+0000 7f02bb200640 1 --2- 172.21.15.70:0/2434716228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc102840 0x7f02bc102c60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009900 tx=0x7f02ac02a3f0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.441+0000 7f02bb200640 1 -- 172.21.15.70:0/2434716228 shutdown_connections 2024-05-08T06:46:31.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.441+0000 7f02bb200640 1 --2- 172.21.15.70:0/2434716228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02bc1043f0 0x7f02bc10ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.441+0000 7f02bb200640 1 --2- 172.21.15.70:0/2434716228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc103a30 0x7f02bc103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.441+0000 7f02bb200640 1 --2- 172.21.15.70:0/2434716228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc102840 0x7f02bc102c60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.441+0000 7f02bb200640 1 -- 172.21.15.70:0/2434716228 >> 172.21.15.70:0/2434716228 conn(0x7f02bc0fddb0 msgr2=0x7f02bc1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:31.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.441+0000 7f02bb200640 1 -- 172.21.15.70:0/2434716228 shutdown_connections 2024-05-08T06:46:31.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.441+0000 7f02bb200640 1 -- 172.21.15.70:0/2434716228 wait complete. 2024-05-08T06:46:31.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.442+0000 7f02bb200640 1 Processor -- start 2024-05-08T06:46:31.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.442+0000 7f02bb200640 1 -- start start 2024-05-08T06:46:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02bb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02bc102840 0x7f02bc1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02bb200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc103a30 0x7f02bc198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02bb200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1043f0 0x7f02bc19fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02bb200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc10e270 con 0x7f02bc103a30 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02bb200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc10e0f0 con 0x7f02bc1043f0 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02bb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f02bc10e3f0 con 0x7f02bc102840 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02b3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc103a30 0x7f02bc198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02b3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc103a30 0x7f02bc198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50912/0 (socket says 172.21.15.70:50912) 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02b3e00640 1 -- 172.21.15.70:0/4056585210 learned_addr learned my addr 172.21.15.70:0/4056585210 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02b9e00640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02bc102840 0x7f02bc1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.443+0000 7f02ba800640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1043f0 0x7f02bc19fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b3e00640 1 -- 172.21.15.70:0/4056585210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02bc102840 msgr2=0x7f02bc1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b3e00640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02bc102840 0x7f02bc1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b3e00640 1 -- 172.21.15.70:0/4056585210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1043f0 msgr2=0x7f02bc19fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b3e00640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1043f0 0x7f02bc19fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b3e00640 1 -- 172.21.15.70:0/4056585210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02bc1a0510 con 0x7f02bc103a30 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b9e00640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02bc102840 0x7f02bc1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b3e00640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc103a30 0x7f02bc198e30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f02a400c920 tx=0x7f02a400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b2a00640 1 -- 172.21.15.70:0/4056585210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4007c70 con 0x7f02bc103a30 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02bc1a0800 con 0x7f02bc103a30 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b2a00640 1 -- 172.21.15.70:0/4056585210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02a4007e10 con 0x7f02bc103a30 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02b2a00640 1 -- 172.21.15.70:0/4056585210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4005260 con 0x7f02bc103a30 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.444+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02bc1a0d50 con 0x7f02bc103a30 2024-05-08T06:46:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.446+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02bc109b60 con 0x7f02bc103a30 2024-05-08T06:46:31.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.448+0000 7f02b2a00640 1 -- 172.21.15.70:0/4056585210 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7f02a4005400 con 0x7f02bc103a30 2024-05-08T06:46:31.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.450+0000 7f02b2a00640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02a00b2830 0x7f02a00b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:31.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.450+0000 7f02b9e00640 1 -- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02a00b2830 msgr2=0x7f02a00b4cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3718531938 2024-05-08T06:46:31.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.450+0000 7f02b2a00640 1 -- 172.21.15.70:0/4056585210 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f02a40e2950 con 0x7f02bc103a30 2024-05-08T06:46:31.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.450+0000 7f02b9e00640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02a00b2830 0x7f02a00b4cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T06:46:31.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.455+0000 7f02b2a00640 1 -- 172.21.15.70:0/4056585210 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f02a4014030 con 0x7f02bc103a30 2024-05-08T06:46:31.495 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:31.367+0000 7fc14a2d1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T06:46:31.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.651+0000 7f02b9e00640 1 -- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02a00b2830 msgr2=0x7f02a00b4cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3718531938 2024-05-08T06:46:31.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.651+0000 7f02b9e00640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02a00b2830 0x7f02a00b4cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T06:46:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.708+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f02bc02db50 con 0x7f02bc103a30 2024-05-08T06:46:31.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.763+0000 7f02b2a00640 1 -- 172.21.15.70:0/4056585210 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7f02a40aa220 con 0x7f02bc103a30 2024-05-08T06:46:31.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02a00b2830 msgr2=0x7f02a00b4cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02a00b2830 0x7f02a00b4cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc103a30 msgr2=0x7f02bc198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc103a30 0x7f02bc198e30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f02a400c920 tx=0x7f02a400cde0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 shutdown_connections 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02bc1043f0 0x7f02bc19fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f02a00b2830 0x7f02a00b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02bc103a30 0x7f02bc198e30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 --2- 172.21.15.70:0/4056585210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02bc102840 0x7f02bc1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 >> 172.21.15.70:0/4056585210 conn(0x7f02bc0fddb0 msgr2=0x7f02bc106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 shutdown_connections 2024-05-08T06:46:31.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.767+0000 7f02bb200640 1 -- 172.21.15.70:0/4056585210 wait complete. 2024-05-08T06:46:31.770 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:31.496+0000 7fc14a2d1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T06:46:31.783 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-08T06:46:31.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.960+0000 7f44b3200640 1 -- 172.21.15.70:0/1511909638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b41043f0 msgr2=0x7f44b410ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.960+0000 7f44b3200640 1 --2- 172.21.15.70:0/1511909638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b41043f0 0x7f44b410ac80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f44ac009ca0 tx=0x7f44ac02a8c0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.960+0000 7f44b3200640 1 -- 172.21.15.70:0/1511909638 shutdown_connections 2024-05-08T06:46:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.960+0000 7f44b3200640 1 --2- 172.21.15.70:0/1511909638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b41043f0 0x7f44b410ac80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.960+0000 7f44b3200640 1 --2- 172.21.15.70:0/1511909638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b4103a30 0x7f44b4103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.960+0000 7f44b3200640 1 --2- 172.21.15.70:0/1511909638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4102840 0x7f44b4102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.960+0000 7f44b3200640 1 -- 172.21.15.70:0/1511909638 >> 172.21.15.70:0/1511909638 conn(0x7f44b40fddb0 msgr2=0x7f44b41001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.960+0000 7f44b3200640 1 -- 172.21.15.70:0/1511909638 shutdown_connections 2024-05-08T06:46:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.960+0000 7f44b3200640 1 -- 172.21.15.70:0/1511909638 wait complete. 2024-05-08T06:46:31.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.961+0000 7f44b3200640 1 Processor -- start 2024-05-08T06:46:31.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.961+0000 7f44b3200640 1 -- start start 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.961+0000 7f44b3200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4102840 0x7f44b4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b4103a30 0x7f44b4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b3200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b41043f0 0x7f44b419fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b3200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44b410e250 con 0x7f44b41043f0 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b3200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f44b410e0d0 con 0x7f44b4102840 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f44b410e3d0 con 0x7f44b4103a30 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b2800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b41043f0 0x7f44b419fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b2800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b41043f0 0x7f44b419fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50920/0 (socket says 172.21.15.70:50920) 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b2800640 1 -- 172.21.15.70:0/3901303951 learned_addr learned my addr 172.21.15.70:0/3901303951 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44abe00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b4103a30 0x7f44b4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b1e00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4102840 0x7f44b4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b2800640 1 -- 172.21.15.70:0/3901303951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b4103a30 msgr2=0x7f44b4198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b2800640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44b4103a30 0x7f44b4198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b2800640 1 -- 172.21.15.70:0/3901303951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4102840 msgr2=0x7f44b4198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:31.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b2800640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f44b4102840 0x7f44b4198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:31.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.962+0000 7f44b2800640 1 -- 172.21.15.70:0/3901303951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b41a0490 con 0x7f44b41043f0 2024-05-08T06:46:31.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.963+0000 7f44b2800640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b41043f0 0x7f44b419fe20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f44ac031040 tx=0x7f44ac003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:31.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.963+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac004040 con 0x7f44b41043f0 2024-05-08T06:46:31.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.963+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44ac004670 con 0x7f44b41043f0 2024-05-08T06:46:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.963+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44b41a0720 con 0x7f44b41043f0 2024-05-08T06:46:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.963+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac030d20 con 0x7f44b41043f0 2024-05-08T06:46:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.963+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44b41a0c70 con 0x7f44b41043f0 2024-05-08T06:46:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.965+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44b4109b60 con 0x7f44b41043f0 2024-05-08T06:46:31.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.966+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7f44ac0305c0 con 0x7f44b41043f0 2024-05-08T06:46:31.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.968+0000 7f44aaa00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f44980b2830 0x7f44980b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:31.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.968+0000 7f44b1e00640 1 -- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f44980b2830 msgr2=0x7f44980b4cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3718531938 2024-05-08T06:46:31.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.968+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9237+0+0 (secure 0 0 0) 0x7f44ac103e30 con 0x7f44b41043f0 2024-05-08T06:46:31.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.968+0000 7f44b1e00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f44980b2830 0x7f44980b4cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T06:46:31.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:31.972+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f44ac0cb760 con 0x7f44b41043f0 2024-05-08T06:46:32.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:31 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4056585210' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T06:46:32.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:32.169+0000 7f44b1e00640 1 -- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f44980b2830 msgr2=0x7f44980b4cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3718531938 2024-05-08T06:46:32.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:32.169+0000 7f44b1e00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f44980b2830 0x7f44980b4cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T06:46:32.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:31 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4056585210' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T06:46:32.179 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:31 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:31.953+0000 7fbc701f6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T06:46:32.208 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:31 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4056585210' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T06:46:32.208 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:31 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:31.923+0000 7f8551536200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T06:46:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:32.219+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 --> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f44b4062e90 con 0x7f44980b2830 2024-05-08T06:46:32.510 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 06:46:32 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z[35566]: 2024-05-08T06:46:32.208+0000 7f8551536200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T06:46:32.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:32.570+0000 7f44b1e00640 1 -- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f44980b2830 msgr2=0x7f44980b4cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3718531938 2024-05-08T06:46:32.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:32.570+0000 7f44b1e00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f44980b2830 0x7f44980b4cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T06:46:32.615 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:32.322+0000 7fc14a2d1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T06:46:32.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:32.643+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 20) ==== 149337+0+0 (secure 0 0 0) 0x7f44ac0c72f0 con 0x7f44b41043f0 2024-05-08T06:46:32.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:32.643+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f44980b2830 msgr2=0x7f44980b4cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T06:46:32.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:32.643+0000 7f44aaa00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3718531938,v1:172.21.15.70:6801/3718531938] conn(0x7f44980b2830 0x7f44980b4cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:32.679 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 06:46:32 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y[34740]: 2024-05-08T06:46:32.240+0000 7fbc701f6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T06:46:32.878 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:32.615+0000 7fc14a2d1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T06:46:32.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4056585210' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T06:46:32.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:46:32.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: Standby manager daemon z restarted 2024-05-08T06:46:32.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: Standby manager daemon z started 2024-05-08T06:46:32.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T06:46:32.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: Standby manager daemon y restarted 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: Standby manager daemon y started 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: Active manager daemon x restarted 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: Activating manager daemon x 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: osdmap e93: 12 total, 12 up, 12 in 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: mgrmap e20: x(active, starting, since 0.0227021s), standbys: y, z 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:46:32.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T06:46:32.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:46:32.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:46:32.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T06:46:32.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T06:46:32.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T06:46:32.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: Manager daemon x is now available 2024-05-08T06:46:32.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:46:32.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4056585210' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: Standby manager daemon z restarted 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: Standby manager daemon z started 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: Standby manager daemon y restarted 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: Standby manager daemon y started 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T06:46:33.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: Active manager daemon x restarted 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: Activating manager daemon x 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: osdmap e93: 12 total, 12 up, 12 in 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: mgrmap e20: x(active, starting, since 0.0227021s), standbys: y, z 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T06:46:33.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T06:46:33.183 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T06:46:33.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T06:46:33.185 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T06:46:33.185 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: Manager daemon x is now available 2024-05-08T06:46:33.185 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:46:33.185 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4056585210' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: Standby manager daemon z restarted 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: Standby manager daemon z started 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.194:0/1090822886' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: Standby manager daemon y restarted 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: Standby manager daemon y started 2024-05-08T06:46:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.? 172.21.15.172:0/1521550385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: Active manager daemon x restarted 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: Activating manager daemon x 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: osdmap e93: 12 total, 12 up, 12 in 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: mgrmap e20: x(active, starting, since 0.0227021s), standbys: y, z 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T06:46:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T06:46:33.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T06:46:33.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T06:46:33.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T06:46:33.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T06:46:33.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: Manager daemon x is now available 2024-05-08T06:46:33.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:46:33.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T06:46:33.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc097200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc097200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.380 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc097200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.380 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc097200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.380 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc097200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.380 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc093600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.380 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc093600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.380 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc093600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.380 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc093600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.380 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.173+0000 7fc093600700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:33.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.658+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 21) ==== 149464+0+0 (secure 0 0 0) 0x7f44ac08a630 con 0x7f44b41043f0 2024-05-08T06:46:33.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.661+0000 7f44aaa00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4498074d60 0x7f4498075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:33.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.661+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f4498042310 con 0x7f4498074d60 2024-05-08T06:46:33.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.670+0000 7f44b1e00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4498074d60 0x7f4498075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:33.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.671+0000 7f44b1e00640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4498074d60 0x7f4498075140 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f44a40058c0 tx=0x7f44a4005850 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.715+0000 7f44aaa00640 1 -- 172.21.15.70:0/3901303951 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f4498042310 con 0x7f4498074d60 2024-05-08T06:46:33.713 INFO:teuthology.orchestra.run.smithi070.stdout:{} 2024-05-08T06:46:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.717+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4498074d60 msgr2=0x7f4498075140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.717+0000 7f44b3200640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4498074d60 0x7f4498075140 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f44a40058c0 tx=0x7f44a4005850 comp rx=0 tx=0).stop 2024-05-08T06:46:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.717+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b41043f0 msgr2=0x7f44b419fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.717+0000 7f44b3200640 1 --2- 172.21.15.70:0/3901303951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f44b41043f0 0x7f44b419fe20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f44ac031040 tx=0x7f44ac003ba0 comp rx=0 tx=0).stop 2024-05-08T06:46:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.718+0000 7f44b2800640 1 -- 172.21.15.70:0/3901303951 reap_dead start 2024-05-08T06:46:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.718+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 shutdown_connections 2024-05-08T06:46:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.718+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 >> 172.21.15.70:0/3901303951 conn(0x7f44b40fddb0 msgr2=0x7f44b4106d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.718+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 shutdown_connections 2024-05-08T06:46:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.718+0000 7f44b3200640 1 -- 172.21.15.70:0/3901303951 wait complete. 2024-05-08T06:46:33.733 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-08T06:46:33.746 INFO:teuthology.run_tasks:Running task exec... 2024-05-08T06:46:33.760 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T06:46:33.760 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T06:46:33.760 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-05-08T06:46:33.865 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:33 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T06:46:33.865 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:33 smithi172 ceph-mon[33377]: [08/May/2024:06:46:32] ENGINE Bus STARTING 2024-05-08T06:46:33.865 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:33 smithi172 ceph-mon[33377]: [08/May/2024:06:46:33] ENGINE Serving on http://172.21.15.70:8765 2024-05-08T06:46:33.866 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:33 smithi172 ceph-mon[33377]: mgrmap e21: x(active, since 1.05054s), standbys: y, z 2024-05-08T06:46:33.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.934+0000 7fef06000640 1 -- 172.21.15.70:0/148048599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00102580 msgr2=0x7fef00102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:33.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.934+0000 7fef06000640 1 --2- 172.21.15.70:0/148048599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00102580 0x7fef00102a00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7feef8009ca0 tx=0x7feef802a8c0 comp rx=0 tx=0).stop 2024-05-08T06:46:33.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.935+0000 7fef06000640 1 -- 172.21.15.70:0/148048599 shutdown_connections 2024-05-08T06:46:33.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.935+0000 7fef06000640 1 --2- 172.21.15.70:0/148048599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00102580 0x7fef00102a00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:33.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.935+0000 7fef06000640 1 --2- 172.21.15.70:0/148048599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef00101be0 0x7fef00102040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:33.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.935+0000 7fef06000640 1 --2- 172.21.15.70:0/148048599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef00101280 0x7fef001016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:33.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.935+0000 7fef06000640 1 -- 172.21.15.70:0/148048599 >> 172.21.15.70:0/148048599 conn(0x7fef000fce80 msgr2=0x7fef000ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:33.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.935+0000 7fef06000640 1 -- 172.21.15.70:0/148048599 shutdown_connections 2024-05-08T06:46:33.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.935+0000 7fef06000640 1 -- 172.21.15.70:0/148048599 wait complete. 2024-05-08T06:46:33.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7fef06000640 1 Processor -- start 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7fef06000640 1 -- start start 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7fef06000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef00101280 0x7fef0019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7fef06000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00101be0 0x7fef0019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7fef06000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef00102580 0x7fef001a21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7fef06000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef00110630 con 0x7fef00101be0 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7fef06000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fef001104b0 con 0x7fef00101280 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7fef06000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fef001107b0 con 0x7fef00102580 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7feefea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00101be0 0x7fef0019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7feefea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00101be0 0x7fef0019b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51094/0 (socket says 172.21.15.70:51094) 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7feefea00640 1 -- 172.21.15.70:0/1223833029 learned_addr learned my addr 172.21.15.70:0/1223833029 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.936+0000 7feeff400640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef00101280 0x7fef0019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:33.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feeffe00640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef00102580 0x7fef001a21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feefea00640 1 -- 172.21.15.70:0/1223833029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef00102580 msgr2=0x7fef001a21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feefea00640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef00102580 0x7fef001a21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feefea00640 1 -- 172.21.15.70:0/1223833029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef00101280 msgr2=0x7fef0019ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feefea00640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef00101280 0x7fef0019ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feefea00640 1 -- 172.21.15.70:0/1223833029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef001a2880 con 0x7fef00101be0 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feefea00640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00101be0 0x7fef0019b1b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7feeec00e9f0 tx=0x7feeec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feef7e00640 1 -- 172.21.15.70:0/1223833029 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec00cd80 con 0x7fef00101be0 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feef7e00640 1 -- 172.21.15.70:0/1223833029 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feeec0054b0 con 0x7fef00101be0 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef001a2b70 con 0x7fef00101be0 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.937+0000 7feef7e00640 1 -- 172.21.15.70:0/1223833029 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeec010430 con 0x7fef00101be0 2024-05-08T06:46:33.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.938+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef001a3070 con 0x7fef00101be0 2024-05-08T06:46:33.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.939+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef0010bfd0 con 0x7fef00101be0 2024-05-08T06:46:33.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.942+0000 7feef7e00640 1 -- 172.21.15.70:0/1223833029 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 149464+0+0 (secure 0 0 0) 0x7feeec0046c0 con 0x7fef00101be0 2024-05-08T06:46:33.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.943+0000 7feef7e00640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feee40b2690 0x7feee40b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:33.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.943+0000 7feef7e00640 1 -- 172.21.15.70:0/1223833029 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7feeec0e2710 con 0x7fef00101be0 2024-05-08T06:46:33.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.943+0000 7feeff400640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feee40b2690 0x7feee40b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:33.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.944+0000 7feeff400640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feee40b2690 0x7feee40b4b50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef0019c140 tx=0x7feef0005f90 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:33.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:33.953+0000 7feef7e00640 1 -- 172.21.15.70:0/1223833029 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feeec0aa1f0 con 0x7fef00101be0 2024-05-08T06:46:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:33 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T06:46:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:33 smithi070 ceph-mon[29591]: [08/May/2024:06:46:32] ENGINE Bus STARTING 2024-05-08T06:46:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:33 smithi070 ceph-mon[29591]: [08/May/2024:06:46:33] ENGINE Serving on http://172.21.15.70:8765 2024-05-08T06:46:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:33 smithi070 ceph-mon[29591]: mgrmap e21: x(active, since 1.05054s), standbys: y, z 2024-05-08T06:46:34.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.690+0000 7fc090e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:34.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.690+0000 7fc090e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:34.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.690+0000 7fc090e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:34.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.690+0000 7fc090e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:34.129 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:46:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:46:33.690+0000 7fc090e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:46:34.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.188+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7fef0002db50 con 0x7fef00101be0 2024-05-08T06:46:34.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.195+0000 7feef7e00640 1 -- 172.21.15.70:0/1223833029 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v30)=0 v30) ==== 129+0+0 (secure 0 0 0) 0x7feeec0b2270 con 0x7fef00101be0 2024-05-08T06:46:34.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feee40b2690 msgr2=0x7feee40b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feee40b2690 0x7feee40b4b50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef0019c140 tx=0x7feef0005f90 comp rx=0 tx=0).stop 2024-05-08T06:46:34.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00101be0 msgr2=0x7fef0019b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00101be0 0x7fef0019b1b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7feeec00e9f0 tx=0x7feeec00edf0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 shutdown_connections 2024-05-08T06:46:34.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feee40b2690 0x7feee40b4b50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef00102580 0x7fef001a21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef00101be0 0x7fef0019b1b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 --2- 172.21.15.70:0/1223833029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fef00101280 0x7fef0019ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 >> 172.21.15.70:0/1223833029 conn(0x7fef000fce80 msgr2=0x7fef000fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:34.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 shutdown_connections 2024-05-08T06:46:34.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.198+0000 7fef06000640 1 -- 172.21.15.70:0/1223833029 wait complete. 2024-05-08T06:46:34.214 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-05-08T06:46:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:33 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T06:46:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:33 smithi194 ceph-mon[33679]: [08/May/2024:06:46:32] ENGINE Bus STARTING 2024-05-08T06:46:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:33 smithi194 ceph-mon[33679]: [08/May/2024:06:46:33] ENGINE Serving on http://172.21.15.70:8765 2024-05-08T06:46:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:33 smithi194 ceph-mon[33679]: mgrmap e21: x(active, since 1.05054s), standbys: y, z 2024-05-08T06:46:34.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.409+0000 7ff344400640 1 -- 172.21.15.70:0/317022854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c103490 msgr2=0x7ff33c105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.409+0000 7ff344400640 1 --2- 172.21.15.70:0/317022854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c103490 0x7ff33c105880 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff330009900 tx=0x7ff33002a3f0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.410+0000 7ff344400640 1 -- 172.21.15.70:0/317022854 shutdown_connections 2024-05-08T06:46:34.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.410+0000 7ff344400640 1 --2- 172.21.15.70:0/317022854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c1086f0 0x7ff33c10ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.410+0000 7ff344400640 1 --2- 172.21.15.70:0/317022854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c105dc0 0x7ff33c1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.410+0000 7ff344400640 1 --2- 172.21.15.70:0/317022854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c103490 0x7ff33c105880 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.410+0000 7ff344400640 1 -- 172.21.15.70:0/317022854 >> 172.21.15.70:0/317022854 conn(0x7ff33c0fcea0 msgr2=0x7ff33c0ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:34.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.410+0000 7ff344400640 1 -- 172.21.15.70:0/317022854 shutdown_connections 2024-05-08T06:46:34.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.410+0000 7ff344400640 1 -- 172.21.15.70:0/317022854 wait complete. 2024-05-08T06:46:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff344400640 1 Processor -- start 2024-05-08T06:46:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff344400640 1 -- start start 2024-05-08T06:46:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff344400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c103490 0x7ff33c19ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:34.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff344400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c105dc0 0x7ff33c19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff344400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c1086f0 0x7ff33c1a2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff344400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c10e440 con 0x7ff33c1086f0 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff344400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c10e2c0 con 0x7ff33c105dc0 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff344400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c10e5c0 con 0x7ff33c103490 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff342400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c1086f0 0x7ff33c1a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff342400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c1086f0 0x7ff33c1a2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51106/0 (socket says 172.21.15.70:51106) 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.411+0000 7ff342400640 1 -- 172.21.15.70:0/2638502216 learned_addr learned my addr 172.21.15.70:0/2638502216 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.412+0000 7ff341a00640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c103490 0x7ff33c19ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.412+0000 7ff341000640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c105dc0 0x7ff33c19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.412+0000 7ff342400640 1 -- 172.21.15.70:0/2638502216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c103490 msgr2=0x7ff33c19ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.412+0000 7ff342400640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c103490 0x7ff33c19ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.412+0000 7ff342400640 1 -- 172.21.15.70:0/2638502216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c105dc0 msgr2=0x7ff33c19b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.412+0000 7ff342400640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c105dc0 0x7ff33c19b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.412+0000 7ff342400640 1 -- 172.21.15.70:0/2638502216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c1a28d0 con 0x7ff33c1086f0 2024-05-08T06:46:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.412+0000 7ff342400640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c1086f0 0x7ff33c1a2230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff33400cce0 tx=0x7ff33400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.413+0000 7ff33a000640 1 -- 172.21.15.70:0/2638502216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33400f450 con 0x7ff33c1086f0 2024-05-08T06:46:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.413+0000 7ff33a000640 1 -- 172.21.15.70:0/2638502216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff33400fa80 con 0x7ff33c1086f0 2024-05-08T06:46:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.413+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c1a2bc0 con 0x7ff33c1086f0 2024-05-08T06:46:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.413+0000 7ff33a000640 1 -- 172.21.15.70:0/2638502216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334018ad0 con 0x7ff33c1086f0 2024-05-08T06:46:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.413+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c1a3090 con 0x7ff33c1086f0 2024-05-08T06:46:34.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.414+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c10a240 con 0x7ff33c1086f0 2024-05-08T06:46:34.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.416+0000 7ff33a000640 1 -- 172.21.15.70:0/2638502216 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 149464+0+0 (secure 0 0 0) 0x7ff33400f5f0 con 0x7ff33c1086f0 2024-05-08T06:46:34.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.417+0000 7ff33a000640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff3240b2690 0x7ff3240b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:34.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.418+0000 7ff33a000640 1 -- 172.21.15.70:0/2638502216 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7ff3340e2a60 con 0x7ff33c1086f0 2024-05-08T06:46:34.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.418+0000 7ff341a00640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff3240b2690 0x7ff3240b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:34.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.418+0000 7ff341a00640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff3240b2690 0x7ff3240b4b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff330005ab0 tx=0x7ff330005a20 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:34.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.422+0000 7ff33a000640 1 -- 172.21.15.70:0/2638502216 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff334014030 con 0x7ff33c1086f0 2024-05-08T06:46:34.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.640+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7ff33c0635b0 con 0x7ff33c1086f0 2024-05-08T06:46:34.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.645+0000 7ff33a000640 1 -- 172.21.15.70:0/2638502216 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v31)=0 v31) ==== 138+0+0 (secure 0 0 0) 0x7ff3340aa540 con 0x7ff33c1086f0 2024-05-08T06:46:34.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff3240b2690 msgr2=0x7ff3240b4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff3240b2690 0x7ff3240b4b50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff330005ab0 tx=0x7ff330005a20 comp rx=0 tx=0).stop 2024-05-08T06:46:34.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c1086f0 msgr2=0x7ff33c1a2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c1086f0 0x7ff33c1a2230 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff33400cce0 tx=0x7ff33400a620 comp rx=0 tx=0).stop 2024-05-08T06:46:34.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 shutdown_connections 2024-05-08T06:46:34.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff3240b2690 0x7ff3240b4b50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff33c1086f0 0x7ff33c1a2230 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff33c105dc0 0x7ff33c19b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 --2- 172.21.15.70:0/2638502216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c103490 0x7ff33c19ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 >> 172.21.15.70:0/2638502216 conn(0x7ff33c0fcea0 msgr2=0x7ff33c102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:34.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 shutdown_connections 2024-05-08T06:46:34.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.649+0000 7ff344400640 1 -- 172.21.15.70:0/2638502216 wait complete. 2024-05-08T06:46:34.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-05-08T06:46:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.865+0000 7fa9dfe00640 1 -- 172.21.15.70:0/2895967579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e01028d0 msgr2=0x7fa9e0102cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.865+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/2895967579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e01028d0 0x7fa9e0102cf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009900 tx=0x7fa9d002a3f0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.865+0000 7fa9dfe00640 1 -- 172.21.15.70:0/2895967579 shutdown_connections 2024-05-08T06:46:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.865+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/2895967579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e0104480 0x7fa9e010ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.865+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/2895967579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9e0103ac0 0x7fa9e0103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.865+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/2895967579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e01028d0 0x7fa9e0102cf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.865+0000 7fa9dfe00640 1 -- 172.21.15.70:0/2895967579 >> 172.21.15.70:0/2895967579 conn(0x7fa9e00fde40 msgr2=0x7fa9e0100280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.865+0000 7fa9dfe00640 1 -- 172.21.15.70:0/2895967579 shutdown_connections 2024-05-08T06:46:34.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.865+0000 7fa9dfe00640 1 -- 172.21.15.70:0/2895967579 wait complete. 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.866+0000 7fa9dfe00640 1 Processor -- start 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.866+0000 7fa9dfe00640 1 -- start start 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dfe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e01028d0 0x7fa9e019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dfe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9e0103ac0 0x7fa9e019b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e0104480 0x7fa9e01a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dfe00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e010e260 con 0x7fa9e01028d0 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dfe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e010e0e0 con 0x7fa9e0103ac0 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dfe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e010e3e0 con 0x7fa9e0104480 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e01028d0 0x7fa9e019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:34.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dea00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e01028d0 0x7fa9e019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51144/0 (socket says 172.21.15.70:51144) 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dea00640 1 -- 172.21.15.70:0/612047437 learned_addr learned my addr 172.21.15.70:0/612047437 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9de000640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9e0103ac0 0x7fa9e019b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9df400640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e0104480 0x7fa9e01a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dea00640 1 -- 172.21.15.70:0/612047437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e0104480 msgr2=0x7fa9e01a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dea00640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e0104480 0x7fa9e01a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dea00640 1 -- 172.21.15.70:0/612047437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9e0103ac0 msgr2=0x7fa9e019b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dea00640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9e0103ac0 0x7fa9e019b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9dea00640 1 -- 172.21.15.70:0/612047437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e01a27c0 con 0x7fa9e01028d0 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.867+0000 7fa9de000640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9e0103ac0 0x7fa9e019b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.868+0000 7fa9dea00640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e01028d0 0x7fa9e019abf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0031460 tx=0x7fa9d0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.868+0000 7fa9d7400640 1 -- 172.21.15.70:0/612047437 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d003f070 con 0x7fa9e01028d0 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.868+0000 7fa9d7400640 1 -- 172.21.15.70:0/612047437 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9d0031ba0 con 0x7fa9e01028d0 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.868+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e01a2a50 con 0x7fa9e01028d0 2024-05-08T06:46:34.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.868+0000 7fa9d7400640 1 -- 172.21.15.70:0/612047437 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0035030 con 0x7fa9e01028d0 2024-05-08T06:46:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.868+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e01a2f40 con 0x7fa9e01028d0 2024-05-08T06:46:34.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.869+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e01a3110 con 0x7fa9e01028d0 2024-05-08T06:46:34.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.872+0000 7fa9d7400640 1 -- 172.21.15.70:0/612047437 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 149464+0+0 (secure 0 0 0) 0x7fa9d0042070 con 0x7fa9e01028d0 2024-05-08T06:46:34.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.874+0000 7fa9d7400640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa9c40b25e0 0x7fa9c40b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.874+0000 7fa9d7400640 1 -- 172.21.15.70:0/612047437 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fa9d0102a10 con 0x7fa9e01028d0 2024-05-08T06:46:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.874+0000 7fa9de000640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa9c40b25e0 0x7fa9c40b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:34.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.875+0000 7fa9de000640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa9c40b25e0 0x7fa9c40b4aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0095f0 tx=0x7fa9cc005f90 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:34.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:34.879+0000 7fa9d7400640 1 -- 172.21.15.70:0/612047437 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa9d00c9ea0 con 0x7fa9e01028d0 2024-05-08T06:46:35.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.114+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fa9e01a32e0 con 0x7fa9e01028d0 2024-05-08T06:46:35.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.120+0000 7fa9d7400640 1 -- 172.21.15.70:0/612047437 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v32)=0 v32) ==== 133+0+0 (secure 0 0 0) 0x7fa9d00ce1a0 con 0x7fa9e01028d0 2024-05-08T06:46:35.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa9c40b25e0 msgr2=0x7fa9c40b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa9c40b25e0 0x7fa9c40b4aa0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0095f0 tx=0x7fa9cc005f90 comp rx=0 tx=0).stop 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e01028d0 msgr2=0x7fa9e019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e01028d0 0x7fa9e019abf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0031460 tx=0x7fa9d0003c10 comp rx=0 tx=0).stop 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 shutdown_connections 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa9c40b25e0 0x7fa9c40b4aa0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9e0104480 0x7fa9e01a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa9e0103ac0 0x7fa9e019b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 --2- 172.21.15.70:0/612047437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9e01028d0 0x7fa9e019abf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 >> 172.21.15.70:0/612047437 conn(0x7fa9e00fde40 msgr2=0x7fa9e01092e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:35.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 shutdown_connections 2024-05-08T06:46:35.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.123+0000 7fa9dfe00640 1 -- 172.21.15.70:0/612047437 wait complete. 2024-05-08T06:46:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:34 smithi070 ceph-mon[29591]: [08/May/2024:06:46:33] ENGINE Serving on https://172.21.15.70:7150 2024-05-08T06:46:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:34 smithi070 ceph-mon[29591]: [08/May/2024:06:46:33] ENGINE Bus STARTED 2024-05-08T06:46:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:34 smithi070 ceph-mon[29591]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:34 smithi070 ceph-mon[29591]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1223833029' entity='client.admin' 2024-05-08T06:46:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2638502216' entity='client.admin' 2024-05-08T06:46:35.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-05-08T06:46:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:34 smithi172 ceph-mon[33377]: [08/May/2024:06:46:33] ENGINE Serving on https://172.21.15.70:7150 2024-05-08T06:46:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:34 smithi172 ceph-mon[33377]: [08/May/2024:06:46:33] ENGINE Bus STARTED 2024-05-08T06:46:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:34 smithi172 ceph-mon[33377]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:34 smithi172 ceph-mon[33377]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1223833029' entity='client.admin' 2024-05-08T06:46:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2638502216' entity='client.admin' 2024-05-08T06:46:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:34 smithi194 ceph-mon[33679]: [08/May/2024:06:46:33] ENGINE Serving on https://172.21.15.70:7150 2024-05-08T06:46:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:34 smithi194 ceph-mon[33679]: [08/May/2024:06:46:33] ENGINE Bus STARTED 2024-05-08T06:46:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:34 smithi194 ceph-mon[33679]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:34 smithi194 ceph-mon[33679]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1223833029' entity='client.admin' 2024-05-08T06:46:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2638502216' entity='client.admin' 2024-05-08T06:46:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.321+0000 7f349b400640 1 -- 172.21.15.70:0/2421431501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494102a10 msgr2=0x7f3494102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.321+0000 7f349b400640 1 --2- 172.21.15.70:0/2421431501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494102a10 0x7f3494102e30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3484009900 tx=0x7f348402a3f0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.321+0000 7f349b400640 1 -- 172.21.15.70:0/2421431501 shutdown_connections 2024-05-08T06:46:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.321+0000 7f349b400640 1 --2- 172.21.15.70:0/2421431501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f34941045c0 0x7f349410ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.321+0000 7f349b400640 1 --2- 172.21.15.70:0/2421431501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3494103c00 0x7f3494104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.321+0000 7f349b400640 1 --2- 172.21.15.70:0/2421431501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494102a10 0x7f3494102e30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.321+0000 7f349b400640 1 -- 172.21.15.70:0/2421431501 >> 172.21.15.70:0/2421431501 conn(0x7f34940fdf80 msgr2=0x7f34941003c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.321+0000 7f349b400640 1 -- 172.21.15.70:0/2421431501 shutdown_connections 2024-05-08T06:46:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.321+0000 7f349b400640 1 -- 172.21.15.70:0/2421431501 wait complete. 2024-05-08T06:46:35.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.322+0000 7f349b400640 1 Processor -- start 2024-05-08T06:46:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.322+0000 7f349b400640 1 -- start start 2024-05-08T06:46:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.322+0000 7f349b400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3494102a10 0x7f3494076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f349b400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494103c00 0x7f3494074da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f349b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34941045c0 0x7f34940752e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f349b400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f349410e3c0 con 0x7f3494102a10 2024-05-08T06:46:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f349b400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f349410e240 con 0x7f3494103c00 2024-05-08T06:46:35.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f349b400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f349410e540 con 0x7f34941045c0 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f3498a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3494102a10 0x7f3494076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f3498a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3494102a10 0x7f3494076760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51162/0 (socket says 172.21.15.70:51162) 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f3498a00640 1 -- 172.21.15.70:0/1997706766 learned_addr learned my addr 172.21.15.70:0/1997706766 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f3499400640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34941045c0 0x7f34940752e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f348be00640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494103c00 0x7f3494074da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f3498a00640 1 -- 172.21.15.70:0/1997706766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34941045c0 msgr2=0x7f34940752e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f3498a00640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34941045c0 0x7f34940752e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f3498a00640 1 -- 172.21.15.70:0/1997706766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494103c00 msgr2=0x7f3494074da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f3498a00640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494103c00 0x7f3494074da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.323+0000 7f3498a00640 1 -- 172.21.15.70:0/1997706766 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3494075b70 con 0x7f3494102a10 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.324+0000 7f3498a00640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3494102a10 0x7f3494076760 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3484005ab0 tx=0x7f34840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:35.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.324+0000 7f3492000640 1 -- 172.21.15.70:0/1997706766 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348403f030 con 0x7f3494102a10 2024-05-08T06:46:35.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.324+0000 7f3492000640 1 -- 172.21.15.70:0/1997706766 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3484032e10 con 0x7f3494102a10 2024-05-08T06:46:35.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.324+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34941a2bc0 con 0x7f3494102a10 2024-05-08T06:46:35.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.324+0000 7f3492000640 1 -- 172.21.15.70:0/1997706766 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484035070 con 0x7f3494102a10 2024-05-08T06:46:35.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.324+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34941a3110 con 0x7f3494102a10 2024-05-08T06:46:35.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.325+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3494109e50 con 0x7f3494102a10 2024-05-08T06:46:35.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.328+0000 7f3492000640 1 -- 172.21.15.70:0/1997706766 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) ==== 149823+0+0 (secure 0 0 0) 0x7f3484042030 con 0x7f3494102a10 2024-05-08T06:46:35.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.329+0000 7f3492000640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f34780b2a90 0x7f34780b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:35.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.329+0000 7f3492000640 1 -- 172.21.15.70:0/1997706766 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f34841033b0 con 0x7f3494102a10 2024-05-08T06:46:35.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.330+0000 7f348be00640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f34780b2a90 0x7f34780b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:35.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.330+0000 7f348be00640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f34780b2a90 0x7f34780b4f50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f34940764d0 tx=0x7f347c005f90 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:35.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.337+0000 7f3492000640 1 -- 172.21.15.70:0/1997706766 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f34840ca7f0 con 0x7f3494102a10 2024-05-08T06:46:35.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.575+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f3494062df0 con 0x7f34780b2a90 2024-05-08T06:46:35.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.663+0000 7f3492000640 1 -- 172.21.15.70:0/1997706766 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f3494062df0 con 0x7f34780b2a90 2024-05-08T06:46:35.662 INFO:teuthology.orchestra.run.smithi070.stdout:Schedule set for path / 2024-05-08T06:46:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.665+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f34780b2a90 msgr2=0x7f34780b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.665+0000 7f349b400640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f34780b2a90 0x7f34780b4f50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f34940764d0 tx=0x7f347c005f90 comp rx=0 tx=0).stop 2024-05-08T06:46:35.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.665+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3494102a10 msgr2=0x7f3494076760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.665+0000 7f349b400640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3494102a10 0x7f3494076760 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3484005ab0 tx=0x7f34840042f0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.666+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 shutdown_connections 2024-05-08T06:46:35.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.666+0000 7f349b400640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f34780b2a90 0x7f34780b4f50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.666+0000 7f349b400640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34941045c0 0x7f34940752e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.666+0000 7f349b400640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3494103c00 0x7f3494074da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.666+0000 7f349b400640 1 --2- 172.21.15.70:0/1997706766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3494102a10 0x7f3494076760 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.666+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 >> 172.21.15.70:0/1997706766 conn(0x7f34940fdf80 msgr2=0x7f3494107020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:35.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.666+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 shutdown_connections 2024-05-08T06:46:35.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.666+0000 7f349b400640 1 -- 172.21.15.70:0/1997706766 wait complete. 2024-05-08T06:46:35.681 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-05-08T06:46:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.868+0000 7f860f200640 1 -- 172.21.15.70:0/3837912091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 msgr2=0x7f861010a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.868+0000 7f860f200640 1 --2- 172.21.15.70:0/3837912091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 0x7f861010a430 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f85fc009900 tx=0x7f85fc02a400 comp rx=0 tx=0).stop 2024-05-08T06:46:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.868+0000 7f860f200640 1 -- 172.21.15.70:0/3837912091 shutdown_connections 2024-05-08T06:46:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.868+0000 7f860f200640 1 --2- 172.21.15.70:0/3837912091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f861010a970 0x7f8610111290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.868+0000 7f860f200640 1 --2- 172.21.15.70:0/3837912091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 0x7f861010a430 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.868+0000 7f860f200640 1 --2- 172.21.15.70:0/3837912091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8610108e60 0x7f8610109280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.868+0000 7f860f200640 1 -- 172.21.15.70:0/3837912091 >> 172.21.15.70:0/3837912091 conn(0x7f8610077e40 msgr2=0x7f861007a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.868+0000 7f860f200640 1 -- 172.21.15.70:0/3837912091 shutdown_connections 2024-05-08T06:46:35.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.868+0000 7f860f200640 1 -- 172.21.15.70:0/3837912091 wait complete. 2024-05-08T06:46:35.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.869+0000 7f860f200640 1 Processor -- start 2024-05-08T06:46:35.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.869+0000 7f860f200640 1 -- start start 2024-05-08T06:46:35.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8610108e60 0x7f861019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860f200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 0x7f861019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860f200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f861010a970 0x7f86101a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860f200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f86101148b0 con 0x7f8610109fb0 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860f200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8610114730 con 0x7f861010a970 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8610114a30 con 0x7f8610108e60 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860d400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 0x7f861019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860d400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 0x7f861019f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51172/0 (socket says 172.21.15.70:51172) 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8610108e60 0x7f861019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860d400640 1 -- 172.21.15.70:0/3789471428 learned_addr learned my addr 172.21.15.70:0/3789471428 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860e800640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f861010a970 0x7f86101a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860d400640 1 -- 172.21.15.70:0/3789471428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8610108e60 msgr2=0x7f861019ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860d400640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8610108e60 0x7f861019ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860d400640 1 -- 172.21.15.70:0/3789471428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f861010a970 msgr2=0x7f86101a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.870+0000 7f860d400640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f861010a970 0x7f86101a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:35.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.871+0000 7f860d400640 1 -- 172.21.15.70:0/3789471428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86101a6b50 con 0x7f8610109fb0 2024-05-08T06:46:35.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.871+0000 7f860e800640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f861010a970 0x7f86101a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:46:35.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.871+0000 7f860d400640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 0x7f861019f4c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f85fc031460 tx=0x7f85fc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:35.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.871+0000 7f8606a00640 1 -- 172.21.15.70:0/3789471428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc03f070 con 0x7f8610109fb0 2024-05-08T06:46:35.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.871+0000 7f8606a00640 1 -- 172.21.15.70:0/3789471428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85fc031ba0 con 0x7f8610109fb0 2024-05-08T06:46:35.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.871+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86101a6de0 con 0x7f8610109fb0 2024-05-08T06:46:35.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.871+0000 7f8606a00640 1 -- 172.21.15.70:0/3789471428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85fc035030 con 0x7f8610109fb0 2024-05-08T06:46:35.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.871+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86101a7210 con 0x7f8610109fb0 2024-05-08T06:46:35.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.873+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8610110170 con 0x7f8610109fb0 2024-05-08T06:46:35.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.875+0000 7f8606a00640 1 -- 172.21.15.70:0/3789471428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) ==== 149823+0+0 (secure 0 0 0) 0x7f85fc042070 con 0x7f8610109fb0 2024-05-08T06:46:35.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.876+0000 7f8606a00640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85f40b29e0 0x7f85f40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:35.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.876+0000 7f8606a00640 1 -- 172.21.15.70:0/3789471428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f85fc1037b0 con 0x7f8610109fb0 2024-05-08T06:46:35.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.876+0000 7f860de00640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85f40b29e0 0x7f85f40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:35.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.877+0000 7f860de00640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85f40b29e0 0x7f85f40b4ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8600009bd0 tx=0x7f8600005f90 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:35.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:35.881+0000 7f8606a00640 1 -- 172.21.15.70:0/3789471428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f85fc0cabf0 con 0x7f8610109fb0 2024-05-08T06:46:36.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.118+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f8610062f50 con 0x7f85f40b29e0 2024-05-08T06:46:36.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:35 smithi070 ceph-mon[29591]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:36.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:35 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/612047437' entity='client.admin' 2024-05-08T06:46:36.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:35 smithi070 ceph-mon[29591]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-05-08T06:46:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:35 smithi172 ceph-mon[33377]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:35 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/612047437' entity='client.admin' 2024-05-08T06:46:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:35 smithi172 ceph-mon[33377]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-05-08T06:46:36.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.258+0000 7f8606a00640 1 -- 172.21.15.70:0/3789471428 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f8610062f50 con 0x7f85f40b29e0 2024-05-08T06:46:36.257 INFO:teuthology.orchestra.run.smithi070.stdout:Retention added to path / 2024-05-08T06:46:36.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:35 smithi194 ceph-mon[33679]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:36.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:35 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/612047437' entity='client.admin' 2024-05-08T06:46:36.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:35 smithi194 ceph-mon[33679]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85f40b29e0 msgr2=0x7f85f40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85f40b29e0 0x7f85f40b4ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8600009bd0 tx=0x7f8600005f90 comp rx=0 tx=0).stop 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 msgr2=0x7f861019f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 0x7f861019f4c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f85fc031460 tx=0x7f85fc003c10 comp rx=0 tx=0).stop 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 shutdown_connections 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85f40b29e0 0x7f85f40b4ea0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f861010a970 0x7f86101a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8610109fb0 0x7f861019f4c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 --2- 172.21.15.70:0/3789471428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8610108e60 0x7f861019ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 >> 172.21.15.70:0/3789471428 conn(0x7f8610077e40 msgr2=0x7f861010d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:36.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 shutdown_connections 2024-05-08T06:46:36.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.262+0000 7f860f200640 1 -- 172.21.15.70:0/3789471428 wait complete. 2024-05-08T06:46:36.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-08T06:46:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.451+0000 7f72d3000640 1 -- 172.21.15.70:0/4002996193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72cc102840 msgr2=0x7f72cc102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.451+0000 7f72d3000640 1 --2- 172.21.15.70:0/4002996193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72cc102840 0x7f72cc102c60 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009900 tx=0x7f72c002a3f0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.451+0000 7f72d3000640 1 -- 172.21.15.70:0/4002996193 shutdown_connections 2024-05-08T06:46:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.451+0000 7f72d3000640 1 --2- 172.21.15.70:0/4002996193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc1043f0 0x7f72cc10ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.451+0000 7f72d3000640 1 --2- 172.21.15.70:0/4002996193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72cc103a30 0x7f72cc103eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.451+0000 7f72d3000640 1 --2- 172.21.15.70:0/4002996193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72cc102840 0x7f72cc102c60 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.451+0000 7f72d3000640 1 -- 172.21.15.70:0/4002996193 >> 172.21.15.70:0/4002996193 conn(0x7f72cc0fddb0 msgr2=0x7f72cc1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.451+0000 7f72d3000640 1 -- 172.21.15.70:0/4002996193 shutdown_connections 2024-05-08T06:46:36.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.451+0000 7f72d3000640 1 -- 172.21.15.70:0/4002996193 wait complete. 2024-05-08T06:46:36.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.452+0000 7f72d3000640 1 Processor -- start 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.452+0000 7f72d3000640 1 -- start start 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d3000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72cc102840 0x7f72cc19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d3000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72cc103a30 0x7f72cc19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d3000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc1043f0 0x7f72cc1a2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d3000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc10e220 con 0x7f72cc103a30 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d3000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc10e0a0 con 0x7f72cc102840 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d3000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f72cc10e3a0 con 0x7f72cc1043f0 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d1200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72cc103a30 0x7f72cc19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc1043f0 0x7f72cc1a2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d1200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72cc103a30 0x7f72cc19b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51204/0 (socket says 172.21.15.70:51204) 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc1043f0 0x7f72cc1a2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:40086/0 (socket says 172.21.15.70:40086) 2024-05-08T06:46:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d1200640 1 -- 172.21.15.70:0/1767758252 learned_addr learned my addr 172.21.15.70:0/1767758252 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d1c00640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72cc102840 0x7f72cc19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d2600640 1 -- 172.21.15.70:0/1767758252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72cc102840 msgr2=0x7f72cc19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d2600640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72cc102840 0x7f72cc19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d2600640 1 -- 172.21.15.70:0/1767758252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72cc103a30 msgr2=0x7f72cc19b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d2600640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72cc103a30 0x7f72cc19b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.453+0000 7f72d2600640 1 -- 172.21.15.70:0/1767758252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72cc1a27b0 con 0x7f72cc1043f0 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.454+0000 7f72d2600640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc1043f0 0x7f72cc1a2140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009fd0 tx=0x7f72c400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.454+0000 7f72ca000640 1 -- 172.21.15.70:0/1767758252 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c400ce20 con 0x7f72cc1043f0 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.454+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72cc1a2aa0 con 0x7f72cc1043f0 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.454+0000 7f72ca000640 1 -- 172.21.15.70:0/1767758252 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72c4005020 con 0x7f72cc1043f0 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.454+0000 7f72ca000640 1 -- 172.21.15.70:0/1767758252 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c4010690 con 0x7f72cc1043f0 2024-05-08T06:46:36.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.454+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72cc1a3040 con 0x7f72cc1043f0 2024-05-08T06:46:36.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.456+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72cc1a3270 con 0x7f72cc1043f0 2024-05-08T06:46:36.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.458+0000 7f72ca000640 1 -- 172.21.15.70:0/1767758252 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 22) ==== 149823+0+0 (secure 0 0 0) 0x7f72c4004a40 con 0x7f72cc1043f0 2024-05-08T06:46:36.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.459+0000 7f72ca000640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72b40b29e0 0x7f72b40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:36.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.459+0000 7f72ca000640 1 -- 172.21.15.70:0/1767758252 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f72c40e32f0 con 0x7f72cc1043f0 2024-05-08T06:46:36.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.459+0000 7f72d1c00640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72b40b29e0 0x7f72b40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:36.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.460+0000 7f72d1c00640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72b40b29e0 0x7f72b40b4ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f72c0006010 tx=0x7f72c00095f0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:36.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.469+0000 7f72ca000640 1 -- 172.21.15.70:0/1767758252 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f72c40aa730 con 0x7f72cc1043f0 2024-05-08T06:46:36.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.707+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f72cc1a3440 con 0x7f72b40b29e0 2024-05-08T06:46:36.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.724+0000 7f72ca000640 1 -- 172.21.15.70:0/1767758252 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f72cc1a3440 con 0x7f72b40b29e0 2024-05-08T06:46:36.722 INFO:teuthology.orchestra.run.smithi070.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-08T00:00:00", "created": "2024-05-08T06:46:35", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-05-08T06:46:36.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.726+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72b40b29e0 msgr2=0x7f72b40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.726+0000 7f72d3000640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72b40b29e0 0x7f72b40b4ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f72c0006010 tx=0x7f72c00095f0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.726+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc1043f0 msgr2=0x7f72cc1a2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.726+0000 7f72d3000640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc1043f0 0x7f72cc1a2140 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009fd0 tx=0x7f72c400ef10 comp rx=0 tx=0).stop 2024-05-08T06:46:36.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.726+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 shutdown_connections 2024-05-08T06:46:36.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.726+0000 7f72d3000640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72b40b29e0 0x7f72b40b4ea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.726+0000 7f72d3000640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72cc1043f0 0x7f72cc1a2140 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.726+0000 7f72d3000640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72cc103a30 0x7f72cc19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.727+0000 7f72d3000640 1 --2- 172.21.15.70:0/1767758252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72cc102840 0x7f72cc19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.727+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 >> 172.21.15.70:0/1767758252 conn(0x7f72cc0fddb0 msgr2=0x7f72cc109200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:36.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.727+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 shutdown_connections 2024-05-08T06:46:36.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.727+0000 7f72d3000640 1 -- 172.21.15.70:0/1767758252 wait complete. 2024-05-08T06:46:36.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-08T06:46:36.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.937+0000 7f88be600640 1 -- 172.21.15.70:0/3104160875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 msgr2=0x7f88b8074e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.937+0000 7f88be600640 1 --2- 172.21.15.70:0/3104160875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 0x7f88b8074e40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009900 tx=0x7f88a802a410 comp rx=0 tx=0).stop 2024-05-08T06:46:36.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.938+0000 7f88be600640 1 -- 172.21.15.70:0/3104160875 shutdown_connections 2024-05-08T06:46:36.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.938+0000 7f88be600640 1 --2- 172.21.15.70:0/3104160875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88b810a8f0 0x7f88b810cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.938+0000 7f88be600640 1 --2- 172.21.15.70:0/3104160875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b8075410 0x7f88b8075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.938+0000 7f88be600640 1 --2- 172.21.15.70:0/3104160875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 0x7f88b8074e40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.938+0000 7f88be600640 1 -- 172.21.15.70:0/3104160875 >> 172.21.15.70:0/3104160875 conn(0x7f88b80fdfa0 msgr2=0x7f88b81003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:36.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.938+0000 7f88be600640 1 -- 172.21.15.70:0/3104160875 shutdown_connections 2024-05-08T06:46:36.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.938+0000 7f88be600640 1 -- 172.21.15.70:0/3104160875 wait complete. 2024-05-08T06:46:36.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.939+0000 7f88be600640 1 Processor -- start 2024-05-08T06:46:36.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88be600640 1 -- start start 2024-05-08T06:46:36.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88be600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88b8075410 0x7f88b819ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88be600640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 0x7f88b819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88be600640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b810a8f0 0x7f88b81a2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88be600640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88b81106a0 con 0x7f88b80769f0 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88be600640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88b8110520 con 0x7f88b810a8f0 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88be600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f88b8110820 con 0x7f88b8075410 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88b6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 0x7f88b819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88b6a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 0x7f88b819b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51230/0 (socket says 172.21.15.70:51230) 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88b6a00640 1 -- 172.21.15.70:0/3424278741 learned_addr learned my addr 172.21.15.70:0/3424278741 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88b7400640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88b8075410 0x7f88b819ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:36.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.940+0000 7f88b7e00640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b810a8f0 0x7f88b81a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:36.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.941+0000 7f88b6a00640 1 -- 172.21.15.70:0/3424278741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88b8075410 msgr2=0x7f88b819ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.941+0000 7f88b6a00640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88b8075410 0x7f88b819ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.941+0000 7f88b6a00640 1 -- 172.21.15.70:0/3424278741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b810a8f0 msgr2=0x7f88b81a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:36.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.941+0000 7f88b6a00640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b810a8f0 0x7f88b81a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.941+0000 7f88b6a00640 1 -- 172.21.15.70:0/3424278741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b81a2970 con 0x7f88b80769f0 2024-05-08T06:46:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.941+0000 7f88b7e00640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b810a8f0 0x7f88b81a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:46:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.941+0000 7f88b7400640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88b8075410 0x7f88b819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:46:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.941+0000 7f88b6a00640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 0x7f88b819b2e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f88a400c890 tx=0x7f88a400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.941+0000 7f88afe00640 1 -- 172.21.15.70:0/3424278741 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4004220 con 0x7f88b80769f0 2024-05-08T06:46:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.942+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b81a2c60 con 0x7f88b80769f0 2024-05-08T06:46:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.942+0000 7f88afe00640 1 -- 172.21.15.70:0/3424278741 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88a4007e40 con 0x7f88b80769f0 2024-05-08T06:46:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.942+0000 7f88afe00640 1 -- 172.21.15.70:0/3424278741 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4004a00 con 0x7f88b80769f0 2024-05-08T06:46:36.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.942+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b81a3230 con 0x7f88b80769f0 2024-05-08T06:46:36.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.943+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88b8109620 con 0x7f88b80769f0 2024-05-08T06:46:36.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.945+0000 7f88afe00640 1 -- 172.21.15.70:0/3424278741 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 149879+0+0 (secure 0 0 0) 0x7f88a40079b0 con 0x7f88b80769f0 2024-05-08T06:46:36.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.947+0000 7f88afe00640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f889c0b2bb0 0x7f889c0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:36.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.947+0000 7f88afe00640 1 -- 172.21.15.70:0/3424278741 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f88a40e2690 con 0x7f88b80769f0 2024-05-08T06:46:36.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.947+0000 7f88b7400640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f889c0b2bb0 0x7f889c0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:36.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.948+0000 7f88b7400640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f889c0b2bb0 0x7f889c0b5070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006010 tx=0x7f88a8031400 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:36.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:36.951+0000 7f88afe00640 1 -- 172.21.15.70:0/3424278741 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f88a4014030 con 0x7f88b80769f0 2024-05-08T06:46:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:36 smithi070 ceph-mon[29591]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:36 smithi172 ceph-mon[33377]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.186+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f88b8062df0 con 0x7f889c0b2bb0 2024-05-08T06:46:37.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.196+0000 7f88afe00640 1 -- 172.21.15.70:0/3424278741 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f88b8062df0 con 0x7f889c0b2bb0 2024-05-08T06:46:37.195 INFO:teuthology.orchestra.run.smithi070.stdout:/ 1m 6m3h 2024-05-08T06:46:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.198+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f889c0b2bb0 msgr2=0x7f889c0b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.198+0000 7f88be600640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f889c0b2bb0 0x7f889c0b5070 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88a8006010 tx=0x7f88a8031400 comp rx=0 tx=0).stop 2024-05-08T06:46:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.198+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 msgr2=0x7f88b819b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.198+0000 7f88be600640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 0x7f88b819b2e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f88a400c890 tx=0x7f88a400cd50 comp rx=0 tx=0).stop 2024-05-08T06:46:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.199+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 shutdown_connections 2024-05-08T06:46:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.199+0000 7f88be600640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f889c0b2bb0 0x7f889c0b5070 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.199+0000 7f88be600640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88b810a8f0 0x7f88b81a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.199+0000 7f88be600640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88b80769f0 0x7f88b819b2e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:37.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.199+0000 7f88be600640 1 --2- 172.21.15.70:0/3424278741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88b8075410 0x7f88b819ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:37.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.199+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 >> 172.21.15.70:0/3424278741 conn(0x7f88b80fdfa0 msgr2=0x7f88b81067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:37.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.199+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 shutdown_connections 2024-05-08T06:46:37.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:37.199+0000 7f88be600640 1 -- 172.21.15.70:0/3424278741 wait complete. 2024-05-08T06:46:37.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-05-08T06:46:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:36 smithi194 ceph-mon[33679]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:37.281 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-08T06:46:37.292 INFO:teuthology.run_tasks:Running task quiescer... 2024-05-08T06:46:37.303 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-08T06:46:37.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T06:46:37.732 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-05-08T06:46:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:46:38.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:46:38.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:38.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:38.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:38.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-05-08T06:46:38.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.193 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:46:38.194 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:46:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='client.15297 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-05-08T06:46:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:46:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:46:38.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:46:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T06:46:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T06:46:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T06:46:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T06:46:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T06:46:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T06:46:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: Updating smithi070:/etc/ceph/ceph.conf 2024-05-08T06:46:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-08T06:46:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:38 smithi070 ceph-mon[29591]: Updating smithi194:/etc/ceph/ceph.conf 2024-05-08T06:46:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T06:46:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T06:46:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T06:46:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T06:46:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T06:46:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T06:46:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: Updating smithi070:/etc/ceph/ceph.conf 2024-05-08T06:46:39.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-08T06:46:39.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:38 smithi172 ceph-mon[33377]: Updating smithi194:/etc/ceph/ceph.conf 2024-05-08T06:46:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: from='client.15309 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T06:46:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T06:46:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T06:46:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T06:46:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T06:46:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T06:46:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T06:46:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: Updating smithi070:/etc/ceph/ceph.conf 2024-05-08T06:46:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: Updating smithi172:/etc/ceph/ceph.conf 2024-05-08T06:46:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:38 smithi194 ceph-mon[33679]: Updating smithi194:/etc/ceph/ceph.conf 2024-05-08T06:46:39.957 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:39 smithi070 ceph-mon[29591]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:46:39.957 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:39 smithi070 ceph-mon[29591]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:39.957 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:39 smithi070 ceph-mon[29591]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:46:39.957 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:39 smithi070 ceph-mon[29591]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:46:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:39 smithi172 ceph-mon[33377]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:46:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:39 smithi172 ceph-mon[33377]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:39 smithi172 ceph-mon[33377]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:46:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:39 smithi172 ceph-mon[33377]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:46:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.236+0000 7f94d9a00700 1 -- 172.21.15.70:0/3903267629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 msgr2=0x7f94d41167d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.236+0000 7f94d9a00700 1 --2- 172.21.15.70:0/3903267629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 0x7f94d41167d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00b0a0 tx=0x7f94cc00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.236+0000 7f94d9a00700 1 -- 172.21.15.70:0/3903267629 shutdown_connections 2024-05-08T06:46:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.236+0000 7f94d9a00700 1 --2- 172.21.15.70:0/3903267629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 0x7f94d41167d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.236+0000 7f94d9a00700 1 --2- 172.21.15.70:0/3903267629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d4075840 0x7f94d4075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.236+0000 7f94d9a00700 1 --2- 172.21.15.70:0/3903267629 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94d4076160 0x7f94d4113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.236+0000 7f94d9a00700 1 -- 172.21.15.70:0/3903267629 >> 172.21.15.70:0/3903267629 conn(0x7f94d40fef20 msgr2=0x7f94d4101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.236+0000 7f94d9a00700 1 -- 172.21.15.70:0/3903267629 shutdown_connections 2024-05-08T06:46:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.236+0000 7f94d9a00700 1 -- 172.21.15.70:0/3903267629 wait complete. 2024-05-08T06:46:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.237+0000 7f94d9a00700 1 Processor -- start 2024-05-08T06:46:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.238+0000 7f94d9a00700 1 -- start start 2024-05-08T06:46:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.238+0000 7f94d9a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94d4075840 0x7f94d41a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.238+0000 7f94d9a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d4076160 0x7f94d41a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:40.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.238+0000 7f94d9a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 0x7f94d41a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:40.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.238+0000 7f94d9a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4119aa0 con 0x7f94d41143e0 2024-05-08T06:46:40.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.238+0000 7f94d9a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4119920 con 0x7f94d4075840 2024-05-08T06:46:40.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.238+0000 7f94d9a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4119c20 con 0x7f94d4076160 2024-05-08T06:46:40.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d9000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 0x7f94d41a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94d4075840 0x7f94d41a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d9000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 0x7f94d41a4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32900/0 (socket says 172.21.15.70:32900) 2024-05-08T06:46:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d9000700 1 -- 172.21.15.70:0/193077236 learned_addr learned my addr 172.21.15.70:0/193077236 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d3400700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d4076160 0x7f94d41a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d9000700 1 -- 172.21.15.70:0/193077236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d4076160 msgr2=0x7f94d41a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d9000700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d4076160 0x7f94d41a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d9000700 1 -- 172.21.15.70:0/193077236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94d4075840 msgr2=0x7f94d41a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d9000700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94d4075840 0x7f94d41a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d9000700 1 -- 172.21.15.70:0/193077236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d41a4fd0 con 0x7f94d41143e0 2024-05-08T06:46:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.239+0000 7f94d9000700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 0x7f94d41a4890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94cc006070 tx=0x7f94cc004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.240+0000 7f94d0c00700 1 -- 172.21.15.70:0/193077236 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc021070 con 0x7f94d41143e0 2024-05-08T06:46:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.240+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d41a5260 con 0x7f94d41143e0 2024-05-08T06:46:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.240+0000 7f94d0c00700 1 -- 172.21.15.70:0/193077236 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94cc007b80 con 0x7f94d41143e0 2024-05-08T06:46:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.240+0000 7f94d0c00700 1 -- 172.21.15.70:0/193077236 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc004680 con 0x7f94d41143e0 2024-05-08T06:46:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.240+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d41acb40 con 0x7f94d41143e0 2024-05-08T06:46:40.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.241+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d406a190 con 0x7f94d41143e0 2024-05-08T06:46:40.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.247+0000 7f94d0c00700 1 -- 172.21.15.70:0/193077236 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 149879+0+0 (secure 0 0 0) 0x7f94cc003a00 con 0x7f94d41143e0 2024-05-08T06:46:40.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.249+0000 7f94d0c00700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94b80b2b90 0x7f94b80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:40.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.249+0000 7f94d0c00700 1 -- 172.21.15.70:0/193077236 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f94cc00f020 con 0x7f94d41143e0 2024-05-08T06:46:40.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.250+0000 7f94d3e00700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94b80b2b90 0x7f94b80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:40.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.250+0000 7f94d0c00700 1 -- 172.21.15.70:0/193077236 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f94cc02a020 con 0x7f94d41143e0 2024-05-08T06:46:40.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.250+0000 7f94d3e00700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94b80b2b90 0x7f94b80b5050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009c60 tx=0x7f94c4009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:39 smithi194 ceph-mon[33679]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:46:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:39 smithi194 ceph-mon[33679]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:46:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:39 smithi194 ceph-mon[33679]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:46:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:39 smithi194 ceph-mon[33679]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T06:46:40.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.503+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94d41a1320 con 0x7f94b80b2b90 2024-05-08T06:46:40.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.516+0000 7f94d0c00700 1 -- 172.21.15.70:0/193077236 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339478 (secure 0 0 0) 0x7f94d41a1320 con 0x7f94b80b2b90 2024-05-08T06:46:40.522 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:46:40.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94b80b2b90 msgr2=0x7f94b80b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94b80b2b90 0x7f94b80b5050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f94c4009c60 tx=0x7f94c4009260 comp rx=0 tx=0).stop 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 msgr2=0x7f94d41a4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 0x7f94d41a4890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f94cc006070 tx=0x7f94cc004c60 comp rx=0 tx=0).stop 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 shutdown_connections 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94b80b2b90 0x7f94b80b5050 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d41143e0 0x7f94d41a4890 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f94d4075840 0x7f94d41a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 --2- 172.21.15.70:0/193077236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94d4076160 0x7f94d41a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 >> 172.21.15.70:0/193077236 conn(0x7f94d40fef20 msgr2=0x7f94d4100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.522+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 shutdown_connections 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:40.523+0000 7f94d9a00700 1 -- 172.21.15.70:0/193077236 wait complete. 2024-05-08T06:46:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-08T06:46:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:40 smithi194 ceph-mon[33679]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:46:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:40 smithi194 ceph-mon[33679]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:46:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:40 smithi194 ceph-mon[33679]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:46:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:40 smithi194 ceph-mon[33679]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:46:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:40 smithi070 ceph-mon[29591]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:46:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:40 smithi070 ceph-mon[29591]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:46:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:40 smithi070 ceph-mon[29591]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:46:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:40 smithi070 ceph-mon[29591]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:46:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:40 smithi172 ceph-mon[33377]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:46:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:40 smithi172 ceph-mon[33377]: Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:46:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:40 smithi172 ceph-mon[33377]: Updating smithi194:/etc/ceph/ceph.client.admin.keyring 2024-05-08T06:46:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:40 smithi172 ceph-mon[33377]: Updating smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:46:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:41.498 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-05-08T06:46:38.663920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1195396,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1584,"num_read_kb":932,"num_write":422,"num_write_kb":3602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":828,"ondisk_log_size":828,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":386388,"kb_used_data":16224,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124555436,"statfs":{"total":1151940427776,"available":1151544766464,"internally_reserved":0,"allocated":16613376,"data_stored":10004147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.970209"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871404+0000","last_change":"2024-05-08T06:41:09.587375+0000","last_active":"2024-05-08T06:46:32.871404+0000","last_peered":"2024-05-08T06:46:32.871404+0000","last_clean":"2024-05-08T06:46:32.871404+0000","last_became_active":"2024-05-08T06:41:09.585981+0000","last_became_peered":"2024-05-08T06:41:09.585981+0000","last_unstale":"2024-05-08T06:46:32.871404+0000","last_undegraded":"2024-05-08T06:46:32.871404+0000","last_fullsized":"2024-05-08T06:46:32.871404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:21.366529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869474+0000","last_change":"2024-05-08T06:41:09.573666+0000","last_active":"2024-05-08T06:46:32.869474+0000","last_peered":"2024-05-08T06:46:32.869474+0000","last_clean":"2024-05-08T06:46:32.869474+0000","last_became_active":"2024-05-08T06:41:09.573331+0000","last_became_peered":"2024-05-08T06:41:09.573331+0000","last_unstale":"2024-05-08T06:46:32.869474+0000","last_undegraded":"2024-05-08T06:46:32.869474+0000","last_fullsized":"2024-05-08T06:46:32.869474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:03:14.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869203+0000","last_change":"2024-05-08T06:41:09.582304+0000","last_active":"2024-05-08T06:46:32.869203+0000","last_peered":"2024-05-08T06:46:32.869203+0000","last_clean":"2024-05-08T06:46:32.869203+0000","last_became_active":"2024-05-08T06:41:09.581916+0000","last_became_peered":"2024-05-08T06:41:09.581916+0000","last_unstale":"2024-05-08T06:46:32.869203+0000","last_undegraded":"2024-05-08T06:46:32.869203+0000","last_fullsized":"2024-05-08T06:46:32.869203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:26.221008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771806+0000","last_change":"2024-05-08T06:42:15.863857+0000","last_active":"2024-05-08T06:46:32.771806+0000","last_peered":"2024-05-08T06:46:32.771806+0000","last_clean":"2024-05-08T06:46:32.771806+0000","last_became_active":"2024-05-08T06:42:15.863147+0000","last_became_peered":"2024-05-08T06:42:15.863147+0000","last_unstale":"2024-05-08T06:46:32.771806+0000","last_undegraded":"2024-05-08T06:46:32.771806+0000","last_fullsized":"2024-05-08T06:46:32.771806+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:48:20.951766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776482+0000","last_change":"2024-05-08T06:41:09.582429+0000","last_active":"2024-05-08T06:46:32.776482+0000","last_peered":"2024-05-08T06:46:32.776482+0000","last_clean":"2024-05-08T06:46:32.776482+0000","last_became_active":"2024-05-08T06:41:09.580152+0000","last_became_peered":"2024-05-08T06:41:09.580152+0000","last_unstale":"2024-05-08T06:46:32.776482+0000","last_undegraded":"2024-05-08T06:46:32.776482+0000","last_fullsized":"2024-05-08T06:46:32.776482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:58.992177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640667+0000","last_change":"2024-05-08T06:41:09.576432+0000","last_active":"2024-05-08T06:46:32.640667+0000","last_peered":"2024-05-08T06:46:32.640667+0000","last_clean":"2024-05-08T06:46:32.640667+0000","last_became_active":"2024-05-08T06:41:09.575723+0000","last_became_peered":"2024-05-08T06:41:09.575723+0000","last_unstale":"2024-05-08T06:46:32.640667+0000","last_undegraded":"2024-05-08T06:46:32.640667+0000","last_fullsized":"2024-05-08T06:46:32.640667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:51.802944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.188531+0000","last_change":"2024-05-08T06:42:15.856660+0000","last_active":"2024-05-08T06:46:33.188531+0000","last_peered":"2024-05-08T06:46:33.188531+0000","last_clean":"2024-05-08T06:46:33.188531+0000","last_became_active":"2024-05-08T06:42:15.855585+0000","last_became_peered":"2024-05-08T06:42:15.855585+0000","last_unstale":"2024-05-08T06:46:33.188531+0000","last_undegraded":"2024-05-08T06:46:33.188531+0000","last_fullsized":"2024-05-08T06:46:33.188531+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:43.647357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774638+0000","last_change":"2024-05-08T06:41:09.579941+0000","last_active":"2024-05-08T06:46:32.774638+0000","last_peered":"2024-05-08T06:46:32.774638+0000","last_clean":"2024-05-08T06:46:32.774638+0000","last_became_active":"2024-05-08T06:41:09.578961+0000","last_became_peered":"2024-05-08T06:41:09.578961+0000","last_unstale":"2024-05-08T06:46:32.774638+0000","last_undegraded":"2024-05-08T06:46:32.774638+0000","last_fullsized":"2024-05-08T06:46:32.774638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:28:59.000080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.874036+0000","last_change":"2024-05-08T06:41:09.580544+0000","last_active":"2024-05-08T06:46:32.874036+0000","last_peered":"2024-05-08T06:46:32.874036+0000","last_clean":"2024-05-08T06:46:32.874036+0000","last_became_active":"2024-05-08T06:41:09.579445+0000","last_became_peered":"2024-05-08T06:41:09.579445+0000","last_unstale":"2024-05-08T06:46:32.874036+0000","last_undegraded":"2024-05-08T06:46:32.874036+0000","last_fullsized":"2024-05-08T06:46:32.874036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:28.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.642138+0000","last_change":"2024-05-08T06:41:09.583133+0000","last_active":"2024-05-08T06:46:32.642138+0000","last_peered":"2024-05-08T06:46:32.642138+0000","last_clean":"2024-05-08T06:46:32.642138+0000","last_became_active":"2024-05-08T06:41:09.582261+0000","last_became_peered":"2024-05-08T06:41:09.582261+0000","last_unstale":"2024-05-08T06:46:32.642138+0000","last_undegraded":"2024-05-08T06:46:32.642138+0000","last_fullsized":"2024-05-08T06:46:32.642138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:26.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.190990+0000","last_change":"2024-05-08T06:41:09.575410+0000","last_active":"2024-05-08T06:46:33.190990+0000","last_peered":"2024-05-08T06:46:33.190990+0000","last_clean":"2024-05-08T06:46:33.190990+0000","last_became_active":"2024-05-08T06:41:09.574936+0000","last_became_peered":"2024-05-08T06:41:09.574936+0000","last_unstale":"2024-05-08T06:46:33.190990+0000","last_undegraded":"2024-05-08T06:46:33.190990+0000","last_fullsized":"2024-05-08T06:46:33.190990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:45.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870900+0000","last_change":"2024-05-08T06:41:09.582844+0000","last_active":"2024-05-08T06:46:32.870900+0000","last_peered":"2024-05-08T06:46:32.870900+0000","last_clean":"2024-05-08T06:46:32.870900+0000","last_became_active":"2024-05-08T06:41:09.582497+0000","last_became_peered":"2024-05-08T06:41:09.582497+0000","last_unstale":"2024-05-08T06:46:32.870900+0000","last_undegraded":"2024-05-08T06:46:32.870900+0000","last_fullsized":"2024-05-08T06:46:32.870900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:09:45.168495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.636089+0000","last_change":"2024-05-08T06:41:09.565312+0000","last_active":"2024-05-08T06:46:32.636089+0000","last_peered":"2024-05-08T06:46:32.636089+0000","last_clean":"2024-05-08T06:46:32.636089+0000","last_became_active":"2024-05-08T06:41:09.563425+0000","last_became_peered":"2024-05-08T06:41:09.563425+0000","last_unstale":"2024-05-08T06:46:32.636089+0000","last_undegraded":"2024-05-08T06:46:32.636089+0000","last_fullsized":"2024-05-08T06:46:32.636089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:08.706504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869147+0000","last_change":"2024-05-08T06:41:09.579395+0000","last_active":"2024-05-08T06:46:32.869147+0000","last_peered":"2024-05-08T06:46:32.869147+0000","last_clean":"2024-05-08T06:46:32.869147+0000","last_became_active":"2024-05-08T06:41:09.575881+0000","last_became_peered":"2024-05-08T06:41:09.575881+0000","last_unstale":"2024-05-08T06:46:32.869147+0000","last_undegraded":"2024-05-08T06:46:32.869147+0000","last_fullsized":"2024-05-08T06:46:32.869147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:37.109480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.868981+0000","last_change":"2024-05-08T06:41:09.589859+0000","last_active":"2024-05-08T06:46:32.868981+0000","last_peered":"2024-05-08T06:46:32.868981+0000","last_clean":"2024-05-08T06:46:32.868981+0000","last_became_active":"2024-05-08T06:41:09.589002+0000","last_became_peered":"2024-05-08T06:41:09.589002+0000","last_unstale":"2024-05-08T06:46:32.868981+0000","last_undegraded":"2024-05-08T06:46:32.868981+0000","last_fullsized":"2024-05-08T06:46:32.868981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:15:39.022268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870359+0000","last_change":"2024-05-08T06:41:09.566551+0000","last_active":"2024-05-08T06:46:32.870359+0000","last_peered":"2024-05-08T06:46:32.870359+0000","last_clean":"2024-05-08T06:46:32.870359+0000","last_became_active":"2024-05-08T06:41:09.564599+0000","last_became_peered":"2024-05-08T06:41:09.564599+0000","last_unstale":"2024-05-08T06:46:32.870359+0000","last_undegraded":"2024-05-08T06:46:32.870359+0000","last_fullsized":"2024-05-08T06:46:32.870359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:45.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871112+0000","last_change":"2024-05-08T06:41:09.582643+0000","last_active":"2024-05-08T06:46:32.871112+0000","last_peered":"2024-05-08T06:46:32.871112+0000","last_clean":"2024-05-08T06:46:32.871112+0000","last_became_active":"2024-05-08T06:41:09.582213+0000","last_became_peered":"2024-05-08T06:41:09.582213+0000","last_unstale":"2024-05-08T06:46:32.871112+0000","last_undegraded":"2024-05-08T06:46:32.871112+0000","last_fullsized":"2024-05-08T06:46:32.871112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:18.471194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.772987+0000","last_change":"2024-05-08T06:41:09.581447+0000","last_active":"2024-05-08T06:46:32.772987+0000","last_peered":"2024-05-08T06:46:32.772987+0000","last_clean":"2024-05-08T06:46:32.772987+0000","last_became_active":"2024-05-08T06:41:09.581067+0000","last_became_peered":"2024-05-08T06:41:09.581067+0000","last_unstale":"2024-05-08T06:46:32.772987+0000","last_undegraded":"2024-05-08T06:46:32.772987+0000","last_fullsized":"2024-05-08T06:46:32.772987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:26.967371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":55,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873978+0000","last_change":"2024-05-08T06:43:16.960640+0000","last_active":"2024-05-08T06:46:32.873978+0000","last_peered":"2024-05-08T06:46:32.873978+0000","last_clean":"2024-05-08T06:46:32.873978+0000","last_became_active":"2024-05-08T06:43:16.959541+0000","last_became_peered":"2024-05-08T06:43:16.959541+0000","last_unstale":"2024-05-08T06:46:32.873978+0000","last_undegraded":"2024-05-08T06:46:32.873978+0000","last_fullsized":"2024-05-08T06:46:32.873978+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:42.070321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873257+0000","last_change":"2024-05-08T06:41:24.665142+0000","last_active":"2024-05-08T06:46:32.873257+0000","last_peered":"2024-05-08T06:46:32.873257+0000","last_clean":"2024-05-08T06:46:32.873257+0000","last_became_active":"2024-05-08T06:41:24.664431+0000","last_became_peered":"2024-05-08T06:41:24.664431+0000","last_unstale":"2024-05-08T06:46:32.873257+0000","last_undegraded":"2024-05-08T06:46:32.873257+0000","last_fullsized":"2024-05-08T06:46:32.873257+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:11:08.511550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":58,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.773306+0000","last_change":"2024-05-08T06:41:05.503245+0000","last_active":"2024-05-08T06:46:32.773306+0000","last_peered":"2024-05-08T06:46:32.773306+0000","last_clean":"2024-05-08T06:46:32.773306+0000","last_became_active":"2024-05-08T06:41:05.502561+0000","last_became_peered":"2024-05-08T06:41:05.502561+0000","last_unstale":"2024-05-08T06:46:32.773306+0000","last_undegraded":"2024-05-08T06:46:32.773306+0000","last_fullsized":"2024-05-08T06:46:32.773306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:06.169830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774783+0000","last_change":"2024-05-08T06:41:09.579703+0000","last_active":"2024-05-08T06:46:32.774783+0000","last_peered":"2024-05-08T06:46:32.774783+0000","last_clean":"2024-05-08T06:46:32.774783+0000","last_became_active":"2024-05-08T06:41:09.579332+0000","last_became_peered":"2024-05-08T06:41:09.579332+0000","last_unstale":"2024-05-08T06:46:32.774783+0000","last_undegraded":"2024-05-08T06:46:32.774783+0000","last_fullsized":"2024-05-08T06:46:32.774783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:08.616722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870324+0000","last_change":"2024-05-08T06:41:24.666322+0000","last_active":"2024-05-08T06:46:32.870324+0000","last_peered":"2024-05-08T06:46:32.870324+0000","last_clean":"2024-05-08T06:46:32.870324+0000","last_became_active":"2024-05-08T06:41:24.664647+0000","last_became_peered":"2024-05-08T06:41:24.664647+0000","last_unstale":"2024-05-08T06:46:32.870324+0000","last_undegraded":"2024-05-08T06:46:32.870324+0000","last_fullsized":"2024-05-08T06:46:32.870324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:56.967066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775674+0000","last_change":"2024-05-08T06:41:06.149339+0000","last_active":"2024-05-08T06:46:32.775674+0000","last_peered":"2024-05-08T06:46:32.775674+0000","last_clean":"2024-05-08T06:46:32.775674+0000","last_became_active":"2024-05-08T06:41:06.148846+0000","last_became_peered":"2024-05-08T06:41:06.148846+0000","last_unstale":"2024-05-08T06:46:32.775674+0000","last_undegraded":"2024-05-08T06:46:32.775674+0000","last_fullsized":"2024-05-08T06:46:32.775674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:59.291206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869475+0000","last_change":"2024-05-08T06:41:09.581776+0000","last_active":"2024-05-08T06:46:32.869475+0000","last_peered":"2024-05-08T06:46:32.869475+0000","last_clean":"2024-05-08T06:46:32.869475+0000","last_became_active":"2024-05-08T06:41:09.581409+0000","last_became_peered":"2024-05-08T06:41:09.581409+0000","last_unstale":"2024-05-08T06:46:32.869475+0000","last_undegraded":"2024-05-08T06:46:32.869475+0000","last_fullsized":"2024-05-08T06:46:32.869475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:30.323812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870936+0000","last_change":"2024-05-08T06:42:16.255655+0000","last_active":"2024-05-08T06:46:32.870936+0000","last_peered":"2024-05-08T06:46:32.870936+0000","last_clean":"2024-05-08T06:46:32.870936+0000","last_became_active":"2024-05-08T06:42:16.253722+0000","last_became_peered":"2024-05-08T06:42:16.253722+0000","last_unstale":"2024-05-08T06:46:32.870936+0000","last_undegraded":"2024-05-08T06:46:32.870936+0000","last_fullsized":"2024-05-08T06:46:32.870936+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:58.492286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777779+0000","last_change":"2024-05-08T06:41:05.509738+0000","last_active":"2024-05-08T06:46:32.777779+0000","last_peered":"2024-05-08T06:46:32.777779+0000","last_clean":"2024-05-08T06:46:32.777779+0000","last_became_active":"2024-05-08T06:41:05.509198+0000","last_became_peered":"2024-05-08T06:41:05.509198+0000","last_unstale":"2024-05-08T06:46:32.777779+0000","last_undegraded":"2024-05-08T06:46:32.777779+0000","last_fullsized":"2024-05-08T06:46:32.777779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:51.350637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873224+0000","last_change":"2024-05-08T06:41:09.572288+0000","last_active":"2024-05-08T06:46:32.873224+0000","last_peered":"2024-05-08T06:46:32.873224+0000","last_clean":"2024-05-08T06:46:32.873224+0000","last_became_active":"2024-05-08T06:41:09.571951+0000","last_became_peered":"2024-05-08T06:41:09.571951+0000","last_unstale":"2024-05-08T06:46:32.873224+0000","last_undegraded":"2024-05-08T06:46:32.873224+0000","last_fullsized":"2024-05-08T06:46:32.873224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:45.687494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870906+0000","last_change":"2024-05-08T06:41:24.663289+0000","last_active":"2024-05-08T06:46:32.870906+0000","last_peered":"2024-05-08T06:46:32.870906+0000","last_clean":"2024-05-08T06:46:32.870906+0000","last_became_active":"2024-05-08T06:41:24.662899+0000","last_became_peered":"2024-05-08T06:41:24.662899+0000","last_unstale":"2024-05-08T06:46:32.870906+0000","last_undegraded":"2024-05-08T06:46:32.870906+0000","last_fullsized":"2024-05-08T06:46:32.870906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:15.024693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777208+0000","last_change":"2024-05-08T06:41:05.505412+0000","last_active":"2024-05-08T06:46:32.777208+0000","last_peered":"2024-05-08T06:46:32.777208+0000","last_clean":"2024-05-08T06:46:32.777208+0000","last_became_active":"2024-05-08T06:41:05.505023+0000","last_became_peered":"2024-05-08T06:41:05.505023+0000","last_unstale":"2024-05-08T06:46:32.777208+0000","last_undegraded":"2024-05-08T06:46:32.777208+0000","last_fullsized":"2024-05-08T06:46:32.777208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:50.403045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":56,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641782+0000","last_change":"2024-05-08T06:41:09.571080+0000","last_active":"2024-05-08T06:46:32.641782+0000","last_peered":"2024-05-08T06:46:32.641782+0000","last_clean":"2024-05-08T06:46:32.641782+0000","last_became_active":"2024-05-08T06:41:09.570755+0000","last_became_peered":"2024-05-08T06:41:09.570755+0000","last_unstale":"2024-05-08T06:46:32.641782+0000","last_undegraded":"2024-05-08T06:46:32.641782+0000","last_fullsized":"2024-05-08T06:46:32.641782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:38:53.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.874496+0000","last_change":"2024-05-08T06:41:24.660091+0000","last_active":"2024-05-08T06:46:32.874496+0000","last_peered":"2024-05-08T06:46:32.874496+0000","last_clean":"2024-05-08T06:46:32.874496+0000","last_became_active":"2024-05-08T06:41:24.659512+0000","last_became_peered":"2024-05-08T06:41:24.659512+0000","last_unstale":"2024-05-08T06:46:32.874496+0000","last_undegraded":"2024-05-08T06:46:32.874496+0000","last_fullsized":"2024-05-08T06:46:32.874496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:07:56.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'8","reported_seq":288,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.186284+0000","last_change":"2024-05-08T06:41:05.500625+0000","last_active":"2024-05-08T06:46:33.186284+0000","last_peered":"2024-05-08T06:46:33.186284+0000","last_clean":"2024-05-08T06:46:33.186284+0000","last_became_active":"2024-05-08T06:41:05.500079+0000","last_became_peered":"2024-05-08T06:41:05.500079+0000","last_unstale":"2024-05-08T06:46:33.186284+0000","last_undegraded":"2024-05-08T06:46:33.186284+0000","last_fullsized":"2024-05-08T06:46:33.186284+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:32.143944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1897,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":3,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776525+0000","last_change":"2024-05-08T06:41:09.569045+0000","last_active":"2024-05-08T06:46:32.776525+0000","last_peered":"2024-05-08T06:46:32.776525+0000","last_clean":"2024-05-08T06:46:32.776525+0000","last_became_active":"2024-05-08T06:41:09.560040+0000","last_became_peered":"2024-05-08T06:41:09.560040+0000","last_unstale":"2024-05-08T06:46:32.776525+0000","last_undegraded":"2024-05-08T06:46:32.776525+0000","last_fullsized":"2024-05-08T06:46:32.776525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:58:52.284829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873342+0000","last_change":"2024-05-08T06:42:15.856574+0000","last_active":"2024-05-08T06:46:32.873342+0000","last_peered":"2024-05-08T06:46:32.873342+0000","last_clean":"2024-05-08T06:46:32.873342+0000","last_became_active":"2024-05-08T06:42:15.855459+0000","last_became_peered":"2024-05-08T06:42:15.855459+0000","last_unstale":"2024-05-08T06:46:32.873342+0000","last_undegraded":"2024-05-08T06:46:32.873342+0000","last_fullsized":"2024-05-08T06:46:32.873342+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:23:12.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640576+0000","last_change":"2024-05-08T06:41:05.505685+0000","last_active":"2024-05-08T06:46:32.640576+0000","last_peered":"2024-05-08T06:46:32.640576+0000","last_clean":"2024-05-08T06:46:32.640576+0000","last_became_active":"2024-05-08T06:41:05.505136+0000","last_became_peered":"2024-05-08T06:41:05.505136+0000","last_unstale":"2024-05-08T06:46:32.640576+0000","last_undegraded":"2024-05-08T06:46:32.640576+0000","last_fullsized":"2024-05-08T06:46:32.640576+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:59.968405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641045+0000","last_change":"2024-05-08T06:41:09.581340+0000","last_active":"2024-05-08T06:46:32.641045+0000","last_peered":"2024-05-08T06:46:32.641045+0000","last_clean":"2024-05-08T06:46:32.641045+0000","last_became_active":"2024-05-08T06:41:09.580969+0000","last_became_peered":"2024-05-08T06:41:09.580969+0000","last_unstale":"2024-05-08T06:46:32.641045+0000","last_undegraded":"2024-05-08T06:46:32.641045+0000","last_fullsized":"2024-05-08T06:46:32.641045+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:14.365972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870893+0000","last_change":"2024-05-08T06:41:24.675576+0000","last_active":"2024-05-08T06:46:32.870893+0000","last_peered":"2024-05-08T06:46:32.870893+0000","last_clean":"2024-05-08T06:46:32.870893+0000","last_became_active":"2024-05-08T06:41:24.675044+0000","last_became_peered":"2024-05-08T06:41:24.675044+0000","last_unstale":"2024-05-08T06:46:32.870893+0000","last_undegraded":"2024-05-08T06:46:32.870893+0000","last_fullsized":"2024-05-08T06:46:32.870893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:59.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.633995+0000","last_change":"2024-05-08T06:41:05.493094+0000","last_active":"2024-05-08T06:46:32.633995+0000","last_peered":"2024-05-08T06:46:32.633995+0000","last_clean":"2024-05-08T06:46:32.633995+0000","last_became_active":"2024-05-08T06:41:05.491206+0000","last_became_peered":"2024-05-08T06:41:05.491206+0000","last_unstale":"2024-05-08T06:46:32.633995+0000","last_undegraded":"2024-05-08T06:46:32.633995+0000","last_fullsized":"2024-05-08T06:46:32.633995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:03.689282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774759+0000","last_change":"2024-05-08T06:41:09.570646+0000","last_active":"2024-05-08T06:46:32.774759+0000","last_peered":"2024-05-08T06:46:32.774759+0000","last_clean":"2024-05-08T06:46:32.774759+0000","last_became_active":"2024-05-08T06:41:09.569500+0000","last_became_peered":"2024-05-08T06:41:09.569500+0000","last_unstale":"2024-05-08T06:46:32.774759+0000","last_undegraded":"2024-05-08T06:46:32.774759+0000","last_fullsized":"2024-05-08T06:46:32.774759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:25:08.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869878+0000","last_change":"2024-05-08T06:41:24.672021+0000","last_active":"2024-05-08T06:46:32.869878+0000","last_peered":"2024-05-08T06:46:32.869878+0000","last_clean":"2024-05-08T06:46:32.869878+0000","last_became_active":"2024-05-08T06:41:24.671583+0000","last_became_peered":"2024-05-08T06:41:24.671583+0000","last_unstale":"2024-05-08T06:46:32.869878+0000","last_undegraded":"2024-05-08T06:46:32.869878+0000","last_fullsized":"2024-05-08T06:46:32.869878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:33.850855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640529+0000","last_change":"2024-05-08T06:41:05.501501+0000","last_active":"2024-05-08T06:46:32.640529+0000","last_peered":"2024-05-08T06:46:32.640529+0000","last_clean":"2024-05-08T06:46:32.640529+0000","last_became_active":"2024-05-08T06:41:05.501001+0000","last_became_peered":"2024-05-08T06:41:05.501001+0000","last_unstale":"2024-05-08T06:46:32.640529+0000","last_undegraded":"2024-05-08T06:46:32.640529+0000","last_fullsized":"2024-05-08T06:46:32.640529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:15:18.984981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":59,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771336+0000","last_change":"2024-05-08T06:42:15.859096+0000","last_active":"2024-05-08T06:46:32.771336+0000","last_peered":"2024-05-08T06:46:32.771336+0000","last_clean":"2024-05-08T06:46:32.771336+0000","last_became_active":"2024-05-08T06:42:15.858508+0000","last_became_peered":"2024-05-08T06:42:15.858508+0000","last_unstale":"2024-05-08T06:46:32.771336+0000","last_undegraded":"2024-05-08T06:46:32.771336+0000","last_fullsized":"2024-05-08T06:46:32.771336+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:24.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774755+0000","last_change":"2024-05-08T06:41:24.670832+0000","last_active":"2024-05-08T06:46:32.774755+0000","last_peered":"2024-05-08T06:46:32.774755+0000","last_clean":"2024-05-08T06:46:32.774755+0000","last_became_active":"2024-05-08T06:41:24.668155+0000","last_became_peered":"2024-05-08T06:41:24.668155+0000","last_unstale":"2024-05-08T06:46:32.774755+0000","last_undegraded":"2024-05-08T06:46:32.774755+0000","last_fullsized":"2024-05-08T06:46:32.774755+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:11.460490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"92'4","reported_seq":281,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.642459+0000","last_change":"2024-05-08T06:41:05.494999+0000","last_active":"2024-05-08T06:46:32.642459+0000","last_peered":"2024-05-08T06:46:32.642459+0000","last_clean":"2024-05-08T06:46:32.642459+0000","last_became_active":"2024-05-08T06:41:05.494487+0000","last_became_peered":"2024-05-08T06:41:05.494487+0000","last_unstale":"2024-05-08T06:46:32.642459+0000","last_undegraded":"2024-05-08T06:46:32.642459+0000","last_fullsized":"2024-05-08T06:46:32.642459+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:59.282625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":230,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873850+0000","last_change":"2024-05-08T06:41:09.570607+0000","last_active":"2024-05-08T06:46:32.873850+0000","last_peered":"2024-05-08T06:46:32.873850+0000","last_clean":"2024-05-08T06:46:32.873850+0000","last_became_active":"2024-05-08T06:41:09.570047+0000","last_became_peered":"2024-05-08T06:41:09.570047+0000","last_unstale":"2024-05-08T06:46:32.873850+0000","last_undegraded":"2024-05-08T06:46:32.873850+0000","last_fullsized":"2024-05-08T06:46:32.873850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:51.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771285+0000","last_change":"2024-05-08T06:41:24.677365+0000","last_active":"2024-05-08T06:46:32.771285+0000","last_peered":"2024-05-08T06:46:32.771285+0000","last_clean":"2024-05-08T06:46:32.771285+0000","last_became_active":"2024-05-08T06:41:24.673986+0000","last_became_peered":"2024-05-08T06:41:24.673986+0000","last_unstale":"2024-05-08T06:46:32.771285+0000","last_undegraded":"2024-05-08T06:46:32.771285+0000","last_fullsized":"2024-05-08T06:46:32.771285+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:07.013637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.191025+0000","last_change":"2024-05-08T06:41:05.499624+0000","last_active":"2024-05-08T06:46:33.191025+0000","last_peered":"2024-05-08T06:46:33.191025+0000","last_clean":"2024-05-08T06:46:33.191025+0000","last_became_active":"2024-05-08T06:41:05.498875+0000","last_became_peered":"2024-05-08T06:41:05.498875+0000","last_unstale":"2024-05-08T06:46:33.191025+0000","last_undegraded":"2024-05-08T06:46:33.191025+0000","last_fullsized":"2024-05-08T06:46:33.191025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:46:11.270399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":56,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869545+0000","last_change":"2024-05-08T06:42:15.853569+0000","last_active":"2024-05-08T06:46:32.869545+0000","last_peered":"2024-05-08T06:46:32.869545+0000","last_clean":"2024-05-08T06:46:32.869545+0000","last_became_active":"2024-05-08T06:42:15.852223+0000","last_became_peered":"2024-05-08T06:42:15.852223+0000","last_unstale":"2024-05-08T06:46:32.869545+0000","last_undegraded":"2024-05-08T06:46:32.869545+0000","last_fullsized":"2024-05-08T06:46:32.869545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:56.970134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871281+0000","last_change":"2024-05-08T06:41:24.671807+0000","last_active":"2024-05-08T06:46:32.871281+0000","last_peered":"2024-05-08T06:46:32.871281+0000","last_clean":"2024-05-08T06:46:32.871281+0000","last_became_active":"2024-05-08T06:41:24.670937+0000","last_became_peered":"2024-05-08T06:41:24.670937+0000","last_unstale":"2024-05-08T06:46:32.871281+0000","last_undegraded":"2024-05-08T06:46:32.871281+0000","last_fullsized":"2024-05-08T06:46:32.871281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:52.844916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640564+0000","last_change":"2024-05-08T06:41:06.147901+0000","last_active":"2024-05-08T06:46:32.640564+0000","last_peered":"2024-05-08T06:46:32.640564+0000","last_clean":"2024-05-08T06:46:32.640564+0000","last_became_active":"2024-05-08T06:41:06.146983+0000","last_became_peered":"2024-05-08T06:41:06.146983+0000","last_unstale":"2024-05-08T06:46:32.640564+0000","last_undegraded":"2024-05-08T06:46:32.640564+0000","last_fullsized":"2024-05-08T06:46:32.640564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:54.638290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873492+0000","last_change":"2024-05-08T06:41:09.586695+0000","last_active":"2024-05-08T06:46:32.873492+0000","last_peered":"2024-05-08T06:46:32.873492+0000","last_clean":"2024-05-08T06:46:32.873492+0000","last_became_active":"2024-05-08T06:41:09.586288+0000","last_became_peered":"2024-05-08T06:41:09.586288+0000","last_unstale":"2024-05-08T06:46:32.873492+0000","last_undegraded":"2024-05-08T06:46:32.873492+0000","last_fullsized":"2024-05-08T06:46:32.873492+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:18.383524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771448+0000","last_change":"2024-05-08T06:41:24.671523+0000","last_active":"2024-05-08T06:46:32.771448+0000","last_peered":"2024-05-08T06:46:32.771448+0000","last_clean":"2024-05-08T06:46:32.771448+0000","last_became_active":"2024-05-08T06:41:24.670307+0000","last_became_peered":"2024-05-08T06:41:24.670307+0000","last_unstale":"2024-05-08T06:46:32.771448+0000","last_undegraded":"2024-05-08T06:46:32.771448+0000","last_fullsized":"2024-05-08T06:46:32.771448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.034208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'42","reported_seq":561,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.200173+0000","last_change":"2024-05-08T06:41:05.504643+0000","last_active":"2024-05-08T06:46:33.200173+0000","last_peered":"2024-05-08T06:46:33.200173+0000","last_clean":"2024-05-08T06:46:33.200173+0000","last_became_active":"2024-05-08T06:41:05.504011+0000","last_became_peered":"2024-05-08T06:41:05.504011+0000","last_unstale":"2024-05-08T06:46:33.200173+0000","last_undegraded":"2024-05-08T06:46:33.200173+0000","last_fullsized":"2024-05-08T06:46:33.200173+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:47.262643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74068,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":472,"num_read_kb":305,"num_write":43,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777257+0000","last_change":"2024-05-08T06:41:09.580532+0000","last_active":"2024-05-08T06:46:32.777257+0000","last_peered":"2024-05-08T06:46:32.777257+0000","last_clean":"2024-05-08T06:46:32.777257+0000","last_became_active":"2024-05-08T06:41:09.575396+0000","last_became_peered":"2024-05-08T06:41:09.575396+0000","last_unstale":"2024-05-08T06:46:32.777257+0000","last_undegraded":"2024-05-08T06:46:32.777257+0000","last_fullsized":"2024-05-08T06:46:32.777257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:29.197093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.642476+0000","last_change":"2024-05-08T06:41:24.660200+0000","last_active":"2024-05-08T06:46:32.642476+0000","last_peered":"2024-05-08T06:46:32.642476+0000","last_clean":"2024-05-08T06:46:32.642476+0000","last_became_active":"2024-05-08T06:41:24.659674+0000","last_became_peered":"2024-05-08T06:41:24.659674+0000","last_unstale":"2024-05-08T06:46:32.642476+0000","last_undegraded":"2024-05-08T06:46:32.642476+0000","last_fullsized":"2024-05-08T06:46:32.642476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:51.023256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":55,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873925+0000","last_change":"2024-05-08T06:41:05.500899+0000","last_active":"2024-05-08T06:46:32.873925+0000","last_peered":"2024-05-08T06:46:32.873925+0000","last_clean":"2024-05-08T06:46:32.873925+0000","last_became_active":"2024-05-08T06:41:05.500437+0000","last_became_peered":"2024-05-08T06:41:05.500437+0000","last_unstale":"2024-05-08T06:46:32.873925+0000","last_undegraded":"2024-05-08T06:46:32.873925+0000","last_fullsized":"2024-05-08T06:46:32.873925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:38.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634212+0000","last_change":"2024-05-08T06:41:09.574273+0000","last_active":"2024-05-08T06:46:32.634212+0000","last_peered":"2024-05-08T06:46:32.634212+0000","last_clean":"2024-05-08T06:46:32.634212+0000","last_became_active":"2024-05-08T06:41:09.573902+0000","last_became_peered":"2024-05-08T06:41:09.573902+0000","last_unstale":"2024-05-08T06:46:32.634212+0000","last_undegraded":"2024-05-08T06:46:32.634212+0000","last_fullsized":"2024-05-08T06:46:32.634212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:39:12.749290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870744+0000","last_change":"2024-05-08T06:41:24.674360+0000","last_active":"2024-05-08T06:46:32.870744+0000","last_peered":"2024-05-08T06:46:32.870744+0000","last_clean":"2024-05-08T06:46:32.870744+0000","last_became_active":"2024-05-08T06:41:24.673938+0000","last_became_peered":"2024-05-08T06:41:24.673938+0000","last_unstale":"2024-05-08T06:46:32.870744+0000","last_undegraded":"2024-05-08T06:46:32.870744+0000","last_fullsized":"2024-05-08T06:46:32.870744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:13:36.735220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641651+0000","last_change":"2024-05-08T06:41:05.504335+0000","last_active":"2024-05-08T06:46:32.641651+0000","last_peered":"2024-05-08T06:46:32.641651+0000","last_clean":"2024-05-08T06:46:32.641651+0000","last_became_active":"2024-05-08T06:41:05.503981+0000","last_became_peered":"2024-05-08T06:41:05.503981+0000","last_unstale":"2024-05-08T06:46:32.641651+0000","last_undegraded":"2024-05-08T06:46:32.641651+0000","last_fullsized":"2024-05-08T06:46:32.641651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:45:35.813245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.189297+0000","last_change":"2024-05-08T06:41:09.580852+0000","last_active":"2024-05-08T06:46:33.189297+0000","last_peered":"2024-05-08T06:46:33.189297+0000","last_clean":"2024-05-08T06:46:33.189297+0000","last_became_active":"2024-05-08T06:41:09.580375+0000","last_became_peered":"2024-05-08T06:41:09.580375+0000","last_unstale":"2024-05-08T06:46:33.189297+0000","last_undegraded":"2024-05-08T06:46:33.189297+0000","last_fullsized":"2024-05-08T06:46:33.189297+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:21:06.695878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.773002+0000","last_change":"2024-05-08T06:41:24.678268+0000","last_active":"2024-05-08T06:46:32.773002+0000","last_peered":"2024-05-08T06:46:32.773002+0000","last_clean":"2024-05-08T06:46:32.773002+0000","last_became_active":"2024-05-08T06:41:24.677804+0000","last_became_peered":"2024-05-08T06:41:24.677804+0000","last_unstale":"2024-05-08T06:46:32.773002+0000","last_undegraded":"2024-05-08T06:46:32.773002+0000","last_fullsized":"2024-05-08T06:46:32.773002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:03.082661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'6","reported_seq":289,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870525+0000","last_change":"2024-05-08T06:41:05.498143+0000","last_active":"2024-05-08T06:46:32.870525+0000","last_peered":"2024-05-08T06:46:32.870525+0000","last_clean":"2024-05-08T06:46:32.870525+0000","last_became_active":"2024-05-08T06:41:05.497707+0000","last_became_peered":"2024-05-08T06:41:05.497707+0000","last_unstale":"2024-05-08T06:46:32.870525+0000","last_undegraded":"2024-05-08T06:46:32.870525+0000","last_fullsized":"2024-05-08T06:46:32.870525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:20.556535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.188009+0000","last_change":"2024-05-08T06:43:17.135955+0000","last_active":"2024-05-08T06:46:33.188009+0000","last_peered":"2024-05-08T06:46:33.188009+0000","last_clean":"2024-05-08T06:46:33.188009+0000","last_became_active":"2024-05-08T06:43:17.134734+0000","last_became_peered":"2024-05-08T06:43:17.134734+0000","last_unstale":"2024-05-08T06:46:33.188009+0000","last_undegraded":"2024-05-08T06:46:33.188009+0000","last_fullsized":"2024-05-08T06:46:33.188009+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:33:53.573382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634950+0000","last_change":"2024-05-08T06:41:24.663938+0000","last_active":"2024-05-08T06:46:32.634950+0000","last_peered":"2024-05-08T06:46:32.634950+0000","last_clean":"2024-05-08T06:46:32.634950+0000","last_became_active":"2024-05-08T06:41:24.661679+0000","last_became_peered":"2024-05-08T06:41:24.661679+0000","last_unstale":"2024-05-08T06:46:32.634950+0000","last_undegraded":"2024-05-08T06:46:32.634950+0000","last_fullsized":"2024-05-08T06:46:32.634950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:21.590681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":63,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775931+0000","last_change":"2024-05-08T06:41:06.151458+0000","last_active":"2024-05-08T06:46:32.775931+0000","last_peered":"2024-05-08T06:46:32.775931+0000","last_clean":"2024-05-08T06:46:32.775931+0000","last_became_active":"2024-05-08T06:41:06.146564+0000","last_became_peered":"2024-05-08T06:41:06.146564+0000","last_unstale":"2024-05-08T06:46:32.775931+0000","last_undegraded":"2024-05-08T06:46:32.775931+0000","last_fullsized":"2024-05-08T06:46:32.775931+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:36.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640550+0000","last_change":"2024-05-08T06:41:09.576666+0000","last_active":"2024-05-08T06:46:32.640550+0000","last_peered":"2024-05-08T06:46:32.640550+0000","last_clean":"2024-05-08T06:46:32.640550+0000","last_became_active":"2024-05-08T06:41:09.576062+0000","last_became_peered":"2024-05-08T06:41:09.576062+0000","last_unstale":"2024-05-08T06:46:32.640550+0000","last_undegraded":"2024-05-08T06:46:32.640550+0000","last_fullsized":"2024-05-08T06:46:32.640550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:21.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640258+0000","last_change":"2024-05-08T06:42:16.255227+0000","last_active":"2024-05-08T06:46:32.640258+0000","last_peered":"2024-05-08T06:46:32.640258+0000","last_clean":"2024-05-08T06:46:32.640258+0000","last_became_active":"2024-05-08T06:42:16.253021+0000","last_became_peered":"2024-05-08T06:42:16.253021+0000","last_unstale":"2024-05-08T06:46:32.640258+0000","last_undegraded":"2024-05-08T06:46:32.640258+0000","last_fullsized":"2024-05-08T06:46:32.640258+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:29:41.833171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777572+0000","last_change":"2024-05-08T06:41:05.506830+0000","last_active":"2024-05-08T06:46:32.777572+0000","last_peered":"2024-05-08T06:46:32.777572+0000","last_clean":"2024-05-08T06:46:32.777572+0000","last_became_active":"2024-05-08T06:41:05.505402+0000","last_became_peered":"2024-05-08T06:41:05.505402+0000","last_unstale":"2024-05-08T06:46:32.777572+0000","last_undegraded":"2024-05-08T06:46:32.777572+0000","last_fullsized":"2024-05-08T06:46:32.777572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:26.804268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870941+0000","last_change":"2024-05-08T06:41:09.586937+0000","last_active":"2024-05-08T06:46:32.870941+0000","last_peered":"2024-05-08T06:46:32.870941+0000","last_clean":"2024-05-08T06:46:32.870941+0000","last_became_active":"2024-05-08T06:41:09.586443+0000","last_became_peered":"2024-05-08T06:41:09.586443+0000","last_unstale":"2024-05-08T06:46:32.870941+0000","last_undegraded":"2024-05-08T06:46:32.870941+0000","last_fullsized":"2024-05-08T06:46:32.870941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:49.004676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776215+0000","last_change":"2024-05-08T06:42:16.042874+0000","last_active":"2024-05-08T06:46:32.776215+0000","last_peered":"2024-05-08T06:46:32.776215+0000","last_clean":"2024-05-08T06:46:32.776215+0000","last_became_active":"2024-05-08T06:42:16.041424+0000","last_became_peered":"2024-05-08T06:42:16.041424+0000","last_unstale":"2024-05-08T06:46:32.776215+0000","last_undegraded":"2024-05-08T06:46:32.776215+0000","last_fullsized":"2024-05-08T06:46:32.776215+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:47.162238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771752+0000","last_change":"2024-05-08T06:41:06.146631+0000","last_active":"2024-05-08T06:46:32.771752+0000","last_peered":"2024-05-08T06:46:32.771752+0000","last_clean":"2024-05-08T06:46:32.771752+0000","last_became_active":"2024-05-08T06:41:06.145876+0000","last_became_peered":"2024-05-08T06:41:06.145876+0000","last_unstale":"2024-05-08T06:46:32.771752+0000","last_undegraded":"2024-05-08T06:46:32.771752+0000","last_fullsized":"2024-05-08T06:46:32.771752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:46.283923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641370+0000","last_change":"2024-05-08T06:41:09.571084+0000","last_active":"2024-05-08T06:46:32.641370+0000","last_peered":"2024-05-08T06:46:32.641370+0000","last_clean":"2024-05-08T06:46:32.641370+0000","last_became_active":"2024-05-08T06:41:09.570685+0000","last_became_peered":"2024-05-08T06:41:09.570685+0000","last_unstale":"2024-05-08T06:46:32.641370+0000","last_undegraded":"2024-05-08T06:46:32.641370+0000","last_fullsized":"2024-05-08T06:46:32.641370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:02:21.748502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634478+0000","last_change":"2024-05-08T06:41:24.667348+0000","last_active":"2024-05-08T06:46:32.634478+0000","last_peered":"2024-05-08T06:46:32.634478+0000","last_clean":"2024-05-08T06:46:32.634478+0000","last_became_active":"2024-05-08T06:41:24.662570+0000","last_became_peered":"2024-05-08T06:41:24.662570+0000","last_unstale":"2024-05-08T06:46:32.634478+0000","last_undegraded":"2024-05-08T06:46:32.634478+0000","last_fullsized":"2024-05-08T06:46:32.634478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:05.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187375+0000","last_change":"2024-05-08T06:41:05.501884+0000","last_active":"2024-05-08T06:46:33.187375+0000","last_peered":"2024-05-08T06:46:33.187375+0000","last_clean":"2024-05-08T06:46:33.187375+0000","last_became_active":"2024-05-08T06:41:05.498866+0000","last_became_peered":"2024-05-08T06:41:05.498866+0000","last_unstale":"2024-05-08T06:46:33.187375+0000","last_undegraded":"2024-05-08T06:46:33.187375+0000","last_fullsized":"2024-05-08T06:46:33.187375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:50.560695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640953+0000","last_change":"2024-05-08T06:41:09.582601+0000","last_active":"2024-05-08T06:46:32.640953+0000","last_peered":"2024-05-08T06:46:32.640953+0000","last_clean":"2024-05-08T06:46:32.640953+0000","last_became_active":"2024-05-08T06:41:09.582205+0000","last_became_peered":"2024-05-08T06:41:09.582205+0000","last_unstale":"2024-05-08T06:46:32.640953+0000","last_undegraded":"2024-05-08T06:46:32.640953+0000","last_fullsized":"2024-05-08T06:46:32.640953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:29.594001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634966+0000","last_change":"2024-05-08T06:41:24.659339+0000","last_active":"2024-05-08T06:46:32.634966+0000","last_peered":"2024-05-08T06:46:32.634966+0000","last_clean":"2024-05-08T06:46:32.634966+0000","last_became_active":"2024-05-08T06:41:24.658879+0000","last_became_peered":"2024-05-08T06:41:24.658879+0000","last_unstale":"2024-05-08T06:46:32.634966+0000","last_undegraded":"2024-05-08T06:46:32.634966+0000","last_fullsized":"2024-05-08T06:46:32.634966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:59.257118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":55,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641550+0000","last_change":"2024-05-08T06:42:15.850510+0000","last_active":"2024-05-08T06:46:32.641550+0000","last_peered":"2024-05-08T06:46:32.641550+0000","last_clean":"2024-05-08T06:46:32.641550+0000","last_became_active":"2024-05-08T06:42:15.849158+0000","last_became_peered":"2024-05-08T06:42:15.849158+0000","last_unstale":"2024-05-08T06:46:32.641550+0000","last_undegraded":"2024-05-08T06:46:32.641550+0000","last_fullsized":"2024-05-08T06:46:32.641550+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:14.687642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":284,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.633916+0000","last_change":"2024-05-08T06:41:06.148436+0000","last_active":"2024-05-08T06:46:32.633916+0000","last_peered":"2024-05-08T06:46:32.633916+0000","last_clean":"2024-05-08T06:46:32.633916+0000","last_became_active":"2024-05-08T06:41:06.147690+0000","last_became_peered":"2024-05-08T06:41:06.147690+0000","last_unstale":"2024-05-08T06:46:32.633916+0000","last_undegraded":"2024-05-08T06:46:32.633916+0000","last_fullsized":"2024-05-08T06:46:32.633916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:49.925872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":230,"num_read_kb":230,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.190534+0000","last_change":"2024-05-08T06:41:24.667958+0000","last_active":"2024-05-08T06:46:33.190534+0000","last_peered":"2024-05-08T06:46:33.190534+0000","last_clean":"2024-05-08T06:46:33.190534+0000","last_became_active":"2024-05-08T06:41:24.666181+0000","last_became_peered":"2024-05-08T06:41:24.666181+0000","last_unstale":"2024-05-08T06:46:33.190534+0000","last_undegraded":"2024-05-08T06:46:33.190534+0000","last_fullsized":"2024-05-08T06:46:33.190534+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:08.413670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775164+0000","last_change":"2024-05-08T06:41:09.581353+0000","last_active":"2024-05-08T06:46:32.775164+0000","last_peered":"2024-05-08T06:46:32.775164+0000","last_clean":"2024-05-08T06:46:32.775164+0000","last_became_active":"2024-05-08T06:41:09.580630+0000","last_became_peered":"2024-05-08T06:41:09.580630+0000","last_unstale":"2024-05-08T06:46:32.775164+0000","last_undegraded":"2024-05-08T06:46:32.775164+0000","last_fullsized":"2024-05-08T06:46:32.775164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:07.041564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870857+0000","last_change":"2024-05-08T06:41:05.494128+0000","last_active":"2024-05-08T06:46:32.870857+0000","last_peered":"2024-05-08T06:46:32.870857+0000","last_clean":"2024-05-08T06:46:32.870857+0000","last_became_active":"2024-05-08T06:41:05.493473+0000","last_became_peered":"2024-05-08T06:41:05.493473+0000","last_unstale":"2024-05-08T06:46:32.870857+0000","last_undegraded":"2024-05-08T06:46:32.870857+0000","last_fullsized":"2024-05-08T06:46:32.870857+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:01:51.061204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":121,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187437+0000","last_change":"2024-05-08T06:39:12.054195+0000","last_active":"2024-05-08T06:46:33.187437+0000","last_peered":"2024-05-08T06:46:33.187437+0000","last_clean":"2024-05-08T06:46:33.187437+0000","last_became_active":"2024-05-08T06:39:12.045198+0000","last_became_peered":"2024-05-08T06:39:12.045198+0000","last_unstale":"2024-05-08T06:46:33.187437+0000","last_undegraded":"2024-05-08T06:46:33.187437+0000","last_fullsized":"2024-05-08T06:46:33.187437+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_clean_scrub_stamp":"2024-05-08T06:34:30.391671+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:32:48.631167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641955+0000","last_change":"2024-05-08T06:41:24.663009+0000","last_active":"2024-05-08T06:46:32.641955+0000","last_peered":"2024-05-08T06:46:32.641955+0000","last_clean":"2024-05-08T06:46:32.641955+0000","last_became_active":"2024-05-08T06:41:24.662552+0000","last_became_peered":"2024-05-08T06:41:24.662552+0000","last_unstale":"2024-05-08T06:46:32.641955+0000","last_undegraded":"2024-05-08T06:46:32.641955+0000","last_fullsized":"2024-05-08T06:46:32.641955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:57:12.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.633883+0000","last_change":"2024-05-08T06:41:09.576425+0000","last_active":"2024-05-08T06:46:32.633883+0000","last_peered":"2024-05-08T06:46:32.633883+0000","last_clean":"2024-05-08T06:46:32.633883+0000","last_became_active":"2024-05-08T06:41:09.576094+0000","last_became_peered":"2024-05-08T06:41:09.576094+0000","last_unstale":"2024-05-08T06:46:32.633883+0000","last_undegraded":"2024-05-08T06:46:32.633883+0000","last_fullsized":"2024-05-08T06:46:32.633883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:40.682429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187874+0000","last_change":"2024-05-08T06:41:05.505778+0000","last_active":"2024-05-08T06:46:33.187874+0000","last_peered":"2024-05-08T06:46:33.187874+0000","last_clean":"2024-05-08T06:46:33.187874+0000","last_became_active":"2024-05-08T06:41:05.505400+0000","last_became_peered":"2024-05-08T06:41:05.505400+0000","last_unstale":"2024-05-08T06:46:33.187874+0000","last_undegraded":"2024-05-08T06:46:33.187874+0000","last_fullsized":"2024-05-08T06:46:33.187874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:11:34.887026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870982+0000","last_change":"2024-05-08T06:41:24.671768+0000","last_active":"2024-05-08T06:46:32.870982+0000","last_peered":"2024-05-08T06:46:32.870982+0000","last_clean":"2024-05-08T06:46:32.870982+0000","last_became_active":"2024-05-08T06:41:24.671250+0000","last_became_peered":"2024-05-08T06:41:24.671250+0000","last_unstale":"2024-05-08T06:46:32.870982+0000","last_undegraded":"2024-05-08T06:46:32.870982+0000","last_fullsized":"2024-05-08T06:46:32.870982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:56:44.302049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777368+0000","last_change":"2024-05-08T06:41:06.151820+0000","last_active":"2024-05-08T06:46:32.777368+0000","last_peered":"2024-05-08T06:46:32.777368+0000","last_clean":"2024-05-08T06:46:32.777368+0000","last_became_active":"2024-05-08T06:41:06.149976+0000","last_became_peered":"2024-05-08T06:41:06.149976+0000","last_unstale":"2024-05-08T06:46:32.777368+0000","last_undegraded":"2024-05-08T06:46:32.777368+0000","last_fullsized":"2024-05-08T06:46:32.777368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:35:21.233811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634637+0000","last_change":"2024-05-08T06:41:09.568880+0000","last_active":"2024-05-08T06:46:32.634637+0000","last_peered":"2024-05-08T06:46:32.634637+0000","last_clean":"2024-05-08T06:46:32.634637+0000","last_became_active":"2024-05-08T06:41:09.568507+0000","last_became_peered":"2024-05-08T06:41:09.568507+0000","last_unstale":"2024-05-08T06:46:32.634637+0000","last_undegraded":"2024-05-08T06:46:32.634637+0000","last_fullsized":"2024-05-08T06:46:32.634637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:01.376121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774636+0000","last_change":"2024-05-08T06:41:24.667472+0000","last_active":"2024-05-08T06:46:32.774636+0000","last_peered":"2024-05-08T06:46:32.774636+0000","last_clean":"2024-05-08T06:46:32.774636+0000","last_became_active":"2024-05-08T06:41:24.664164+0000","last_became_peered":"2024-05-08T06:41:24.664164+0000","last_unstale":"2024-05-08T06:46:32.774636+0000","last_undegraded":"2024-05-08T06:46:32.774636+0000","last_fullsized":"2024-05-08T06:46:32.774636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:34:25.630742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'46","reported_seq":117,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.982777+0000","last_change":"2024-05-08T06:41:05.504287+0000","last_active":"2024-05-08T06:46:32.982777+0000","last_peered":"2024-05-08T06:46:32.982777+0000","last_clean":"2024-05-08T06:46:32.982777+0000","last_became_active":"2024-05-08T06:41:05.503825+0000","last_became_peered":"2024-05-08T06:41:05.503825+0000","last_unstale":"2024-05-08T06:46:32.982777+0000","last_undegraded":"2024-05-08T06:46:32.982777+0000","last_fullsized":"2024-05-08T06:46:32.982777+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:50:23.230289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":83,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775936+0000","last_change":"2024-05-08T06:41:09.576996+0000","last_active":"2024-05-08T06:46:32.775936+0000","last_peered":"2024-05-08T06:46:32.775936+0000","last_clean":"2024-05-08T06:46:32.775936+0000","last_became_active":"2024-05-08T06:41:09.572034+0000","last_became_peered":"2024-05-08T06:41:09.572034+0000","last_unstale":"2024-05-08T06:46:32.775936+0000","last_undegraded":"2024-05-08T06:46:32.775936+0000","last_fullsized":"2024-05-08T06:46:32.775936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:41.690687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872584+0000","last_change":"2024-05-08T06:41:24.665751+0000","last_active":"2024-05-08T06:46:32.872584+0000","last_peered":"2024-05-08T06:46:32.872584+0000","last_clean":"2024-05-08T06:46:32.872584+0000","last_became_active":"2024-05-08T06:41:24.665306+0000","last_became_peered":"2024-05-08T06:41:24.665306+0000","last_unstale":"2024-05-08T06:46:32.872584+0000","last_undegraded":"2024-05-08T06:46:32.872584+0000","last_fullsized":"2024-05-08T06:46:32.872584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:10.515975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871629+0000","last_change":"2024-05-08T06:41:05.502897+0000","last_active":"2024-05-08T06:46:32.871629+0000","last_peered":"2024-05-08T06:46:32.871629+0000","last_clean":"2024-05-08T06:46:32.871629+0000","last_became_active":"2024-05-08T06:41:05.500636+0000","last_became_peered":"2024-05-08T06:41:05.500636+0000","last_unstale":"2024-05-08T06:46:32.871629+0000","last_undegraded":"2024-05-08T06:46:32.871629+0000","last_fullsized":"2024-05-08T06:46:32.871629+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:02.523706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869659+0000","last_change":"2024-05-08T06:41:09.586824+0000","last_active":"2024-05-08T06:46:32.869659+0000","last_peered":"2024-05-08T06:46:32.869659+0000","last_clean":"2024-05-08T06:46:32.869659+0000","last_became_active":"2024-05-08T06:41:09.585032+0000","last_became_peered":"2024-05-08T06:41:09.585032+0000","last_unstale":"2024-05-08T06:46:32.869659+0000","last_undegraded":"2024-05-08T06:46:32.869659+0000","last_fullsized":"2024-05-08T06:46:32.869659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:00:31.890993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870743+0000","last_change":"2024-05-08T06:41:24.670033+0000","last_active":"2024-05-08T06:46:32.870743+0000","last_peered":"2024-05-08T06:46:32.870743+0000","last_clean":"2024-05-08T06:46:32.870743+0000","last_became_active":"2024-05-08T06:41:24.669477+0000","last_became_peered":"2024-05-08T06:41:24.669477+0000","last_unstale":"2024-05-08T06:46:32.870743+0000","last_undegraded":"2024-05-08T06:46:32.870743+0000","last_fullsized":"2024-05-08T06:46:32.870743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:55.040308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871533+0000","last_change":"2024-05-08T06:41:06.146847+0000","last_active":"2024-05-08T06:46:32.871533+0000","last_peered":"2024-05-08T06:46:32.871533+0000","last_clean":"2024-05-08T06:46:32.871533+0000","last_became_active":"2024-05-08T06:41:06.146141+0000","last_became_peered":"2024-05-08T06:41:06.146141+0000","last_unstale":"2024-05-08T06:46:32.871533+0000","last_undegraded":"2024-05-08T06:46:32.871533+0000","last_fullsized":"2024-05-08T06:46:32.871533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:45:30.924860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776443+0000","last_change":"2024-05-08T06:41:09.578067+0000","last_active":"2024-05-08T06:46:32.776443+0000","last_peered":"2024-05-08T06:46:32.776443+0000","last_clean":"2024-05-08T06:46:32.776443+0000","last_became_active":"2024-05-08T06:41:09.577650+0000","last_became_peered":"2024-05-08T06:41:09.577650+0000","last_unstale":"2024-05-08T06:46:32.776443+0000","last_undegraded":"2024-05-08T06:46:32.776443+0000","last_fullsized":"2024-05-08T06:46:32.776443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:09.285601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.773199+0000","last_change":"2024-05-08T06:41:24.669791+0000","last_active":"2024-05-08T06:46:32.773199+0000","last_peered":"2024-05-08T06:46:32.773199+0000","last_clean":"2024-05-08T06:46:32.773199+0000","last_became_active":"2024-05-08T06:41:24.669363+0000","last_became_peered":"2024-05-08T06:41:24.669363+0000","last_unstale":"2024-05-08T06:46:32.773199+0000","last_undegraded":"2024-05-08T06:46:32.773199+0000","last_fullsized":"2024-05-08T06:46:32.773199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:08.522339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774863+0000","last_change":"2024-05-08T06:41:05.486456+0000","last_active":"2024-05-08T06:46:32.774863+0000","last_peered":"2024-05-08T06:46:32.774863+0000","last_clean":"2024-05-08T06:46:32.774863+0000","last_became_active":"2024-05-08T06:41:05.485878+0000","last_became_peered":"2024-05-08T06:41:05.485878+0000","last_unstale":"2024-05-08T06:46:32.774863+0000","last_undegraded":"2024-05-08T06:46:32.774863+0000","last_fullsized":"2024-05-08T06:46:32.774863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:11:47.985329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870546+0000","last_change":"2024-05-08T06:41:09.573940+0000","last_active":"2024-05-08T06:46:32.870546+0000","last_peered":"2024-05-08T06:46:32.870546+0000","last_clean":"2024-05-08T06:46:32.870546+0000","last_became_active":"2024-05-08T06:41:09.573515+0000","last_became_peered":"2024-05-08T06:41:09.573515+0000","last_unstale":"2024-05-08T06:46:32.870546+0000","last_undegraded":"2024-05-08T06:46:32.870546+0000","last_fullsized":"2024-05-08T06:46:32.870546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:44.803013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872131+0000","last_change":"2024-05-08T06:41:24.663008+0000","last_active":"2024-05-08T06:46:32.872131+0000","last_peered":"2024-05-08T06:46:32.872131+0000","last_clean":"2024-05-08T06:46:32.872131+0000","last_became_active":"2024-05-08T06:41:24.661934+0000","last_became_peered":"2024-05-08T06:41:24.661934+0000","last_unstale":"2024-05-08T06:46:32.872131+0000","last_undegraded":"2024-05-08T06:46:32.872131+0000","last_fullsized":"2024-05-08T06:46:32.872131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:08.719125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"92'2","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870546+0000","last_change":"2024-05-08T06:43:16.894395+0000","last_active":"2024-05-08T06:46:32.870546+0000","last_peered":"2024-05-08T06:46:32.870546+0000","last_clean":"2024-05-08T06:46:32.870546+0000","last_became_active":"2024-05-08T06:43:16.886763+0000","last_became_peered":"2024-05-08T06:43:16.886763+0000","last_unstale":"2024-05-08T06:46:32.870546+0000","last_undegraded":"2024-05-08T06:46:32.870546+0000","last_fullsized":"2024-05-08T06:46:32.870546+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:52.278223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775237+0000","last_change":"2024-05-08T06:41:09.573388+0000","last_active":"2024-05-08T06:46:32.775237+0000","last_peered":"2024-05-08T06:46:32.775237+0000","last_clean":"2024-05-08T06:46:32.775237+0000","last_became_active":"2024-05-08T06:41:09.572901+0000","last_became_peered":"2024-05-08T06:41:09.572901+0000","last_unstale":"2024-05-08T06:46:32.775237+0000","last_undegraded":"2024-05-08T06:46:32.775237+0000","last_fullsized":"2024-05-08T06:46:32.775237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:38:45.123194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870992+0000","last_change":"2024-05-08T06:41:24.659817+0000","last_active":"2024-05-08T06:46:32.870992+0000","last_peered":"2024-05-08T06:46:32.870992+0000","last_clean":"2024-05-08T06:46:32.870992+0000","last_became_active":"2024-05-08T06:41:24.659276+0000","last_became_peered":"2024-05-08T06:41:24.659276+0000","last_unstale":"2024-05-08T06:46:32.870992+0000","last_undegraded":"2024-05-08T06:46:32.870992+0000","last_fullsized":"2024-05-08T06:46:32.870992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:01.635454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871054+0000","last_change":"2024-05-08T06:43:16.905524+0000","last_active":"2024-05-08T06:46:32.871054+0000","last_peered":"2024-05-08T06:46:32.871054+0000","last_clean":"2024-05-08T06:46:32.871054+0000","last_became_active":"2024-05-08T06:43:16.888087+0000","last_became_peered":"2024-05-08T06:43:16.888087+0000","last_unstale":"2024-05-08T06:46:32.871054+0000","last_undegraded":"2024-05-08T06:46:32.871054+0000","last_fullsized":"2024-05-08T06:46:32.871054+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:52.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187555+0000","last_change":"2024-05-08T06:41:09.574238+0000","last_active":"2024-05-08T06:46:33.187555+0000","last_peered":"2024-05-08T06:46:33.187555+0000","last_clean":"2024-05-08T06:46:33.187555+0000","last_became_active":"2024-05-08T06:41:09.570019+0000","last_became_peered":"2024-05-08T06:41:09.570019+0000","last_unstale":"2024-05-08T06:46:33.187555+0000","last_undegraded":"2024-05-08T06:46:33.187555+0000","last_fullsized":"2024-05-08T06:46:33.187555+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:56.980400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872332+0000","last_change":"2024-05-08T06:41:24.659955+0000","last_active":"2024-05-08T06:46:32.872332+0000","last_peered":"2024-05-08T06:46:32.872332+0000","last_clean":"2024-05-08T06:46:32.872332+0000","last_became_active":"2024-05-08T06:41:24.659534+0000","last_became_peered":"2024-05-08T06:41:24.659534+0000","last_unstale":"2024-05-08T06:46:32.872332+0000","last_undegraded":"2024-05-08T06:46:32.872332+0000","last_fullsized":"2024-05-08T06:46:32.872332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:41.893917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870716+0000","last_change":"2024-05-08T06:43:16.897225+0000","last_active":"2024-05-08T06:46:32.870716+0000","last_peered":"2024-05-08T06:46:32.870716+0000","last_clean":"2024-05-08T06:46:32.870716+0000","last_became_active":"2024-05-08T06:43:16.883954+0000","last_became_peered":"2024-05-08T06:43:16.883954+0000","last_unstale":"2024-05-08T06:46:32.870716+0000","last_undegraded":"2024-05-08T06:46:32.870716+0000","last_fullsized":"2024-05-08T06:46:32.870716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:12.014514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.191631+0000","last_change":"2024-05-08T06:41:09.574159+0000","last_active":"2024-05-08T06:46:33.191631+0000","last_peered":"2024-05-08T06:46:33.191631+0000","last_clean":"2024-05-08T06:46:33.191631+0000","last_became_active":"2024-05-08T06:41:09.573734+0000","last_became_peered":"2024-05-08T06:41:09.573734+0000","last_unstale":"2024-05-08T06:46:33.191631+0000","last_undegraded":"2024-05-08T06:46:33.191631+0000","last_fullsized":"2024-05-08T06:46:33.191631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:22.157071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.868921+0000","last_change":"2024-05-08T06:41:24.668545+0000","last_active":"2024-05-08T06:46:32.868921+0000","last_peered":"2024-05-08T06:46:32.868921+0000","last_clean":"2024-05-08T06:46:32.868921+0000","last_became_active":"2024-05-08T06:41:24.668086+0000","last_became_peered":"2024-05-08T06:41:24.668086+0000","last_unstale":"2024-05-08T06:46:32.868921+0000","last_undegraded":"2024-05-08T06:46:32.868921+0000","last_fullsized":"2024-05-08T06:46:32.868921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:08:02.473733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"93'39","reported_seq":94,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.979169+0000","last_change":"2024-05-08T06:41:05.501332+0000","last_active":"2024-05-08T06:46:32.979169+0000","last_peered":"2024-05-08T06:46:32.979169+0000","last_clean":"2024-05-08T06:46:32.979169+0000","last_became_active":"2024-05-08T06:41:05.499174+0000","last_became_peered":"2024-05-08T06:41:05.499174+0000","last_unstale":"2024-05-08T06:46:32.979169+0000","last_undegraded":"2024-05-08T06:46:32.979169+0000","last_fullsized":"2024-05-08T06:46:32.979169+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:49.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.190141+0000","last_change":"2024-05-08T06:41:09.572927+0000","last_active":"2024-05-08T06:46:33.190141+0000","last_peered":"2024-05-08T06:46:33.190141+0000","last_clean":"2024-05-08T06:46:33.190141+0000","last_became_active":"2024-05-08T06:41:09.572502+0000","last_became_peered":"2024-05-08T06:41:09.572502+0000","last_unstale":"2024-05-08T06:46:33.190141+0000","last_undegraded":"2024-05-08T06:46:33.190141+0000","last_fullsized":"2024-05-08T06:46:33.190141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:03.838892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.639936+0000","last_change":"2024-05-08T06:41:24.667561+0000","last_active":"2024-05-08T06:46:32.639936+0000","last_peered":"2024-05-08T06:46:32.639936+0000","last_clean":"2024-05-08T06:46:32.639936+0000","last_became_active":"2024-05-08T06:41:24.666904+0000","last_became_peered":"2024-05-08T06:41:24.666904+0000","last_unstale":"2024-05-08T06:46:32.639936+0000","last_undegraded":"2024-05-08T06:46:32.639936+0000","last_fullsized":"2024-05-08T06:46:32.639936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:15.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634924+0000","last_change":"2024-05-08T06:41:05.497117+0000","last_active":"2024-05-08T06:46:32.634924+0000","last_peered":"2024-05-08T06:46:32.634924+0000","last_clean":"2024-05-08T06:46:32.634924+0000","last_became_active":"2024-05-08T06:41:05.496621+0000","last_became_peered":"2024-05-08T06:41:05.496621+0000","last_unstale":"2024-05-08T06:46:32.634924+0000","last_undegraded":"2024-05-08T06:46:32.634924+0000","last_fullsized":"2024-05-08T06:46:32.634924+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:06:32.603973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.191471+0000","last_change":"2024-05-08T06:41:09.572489+0000","last_active":"2024-05-08T06:46:33.191471+0000","last_peered":"2024-05-08T06:46:33.191471+0000","last_clean":"2024-05-08T06:46:33.191471+0000","last_became_active":"2024-05-08T06:41:09.572129+0000","last_became_peered":"2024-05-08T06:41:09.572129+0000","last_unstale":"2024-05-08T06:46:33.191471+0000","last_undegraded":"2024-05-08T06:46:33.191471+0000","last_fullsized":"2024-05-08T06:46:33.191471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:18:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870754+0000","last_change":"2024-05-08T06:41:09.577872+0000","last_active":"2024-05-08T06:46:32.870754+0000","last_peered":"2024-05-08T06:46:32.870754+0000","last_clean":"2024-05-08T06:46:32.870754+0000","last_became_active":"2024-05-08T06:41:09.577490+0000","last_became_peered":"2024-05-08T06:41:09.577490+0000","last_unstale":"2024-05-08T06:46:32.870754+0000","last_undegraded":"2024-05-08T06:46:32.870754+0000","last_fullsized":"2024-05-08T06:46:32.870754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:12:44.956055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872995+0000","last_change":"2024-05-08T06:42:15.861046+0000","last_active":"2024-05-08T06:46:32.872995+0000","last_peered":"2024-05-08T06:46:32.872995+0000","last_clean":"2024-05-08T06:46:32.872995+0000","last_became_active":"2024-05-08T06:42:15.860267+0000","last_became_peered":"2024-05-08T06:42:15.860267+0000","last_unstale":"2024-05-08T06:46:32.872995+0000","last_undegraded":"2024-05-08T06:46:32.872995+0000","last_fullsized":"2024-05-08T06:46:32.872995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:15:01.541268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872703+0000","last_change":"2024-05-08T06:41:09.578005+0000","last_active":"2024-05-08T06:46:32.872703+0000","last_peered":"2024-05-08T06:46:32.872703+0000","last_clean":"2024-05-08T06:46:32.872703+0000","last_became_active":"2024-05-08T06:41:09.577571+0000","last_became_peered":"2024-05-08T06:41:09.577571+0000","last_unstale":"2024-05-08T06:46:32.872703+0000","last_undegraded":"2024-05-08T06:46:32.872703+0000","last_fullsized":"2024-05-08T06:46:32.872703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:22.762195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869224+0000","last_change":"2024-05-08T06:41:09.579520+0000","last_active":"2024-05-08T06:46:32.869224+0000","last_peered":"2024-05-08T06:46:32.869224+0000","last_clean":"2024-05-08T06:46:32.869224+0000","last_became_active":"2024-05-08T06:41:09.579085+0000","last_became_peered":"2024-05-08T06:41:09.579085+0000","last_unstale":"2024-05-08T06:46:32.869224+0000","last_undegraded":"2024-05-08T06:46:32.869224+0000","last_fullsized":"2024-05-08T06:46:32.869224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:02:25.199102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634777+0000","last_change":"2024-05-08T06:41:09.588352+0000","last_active":"2024-05-08T06:46:32.634777+0000","last_peered":"2024-05-08T06:46:32.634777+0000","last_clean":"2024-05-08T06:46:32.634777+0000","last_became_active":"2024-05-08T06:41:09.587981+0000","last_became_peered":"2024-05-08T06:41:09.587981+0000","last_unstale":"2024-05-08T06:46:32.634777+0000","last_undegraded":"2024-05-08T06:46:32.634777+0000","last_fullsized":"2024-05-08T06:46:32.634777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:55.275569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871931+0000","last_change":"2024-05-08T06:41:09.584216+0000","last_active":"2024-05-08T06:46:32.871931+0000","last_peered":"2024-05-08T06:46:32.871931+0000","last_clean":"2024-05-08T06:46:32.871931+0000","last_became_active":"2024-05-08T06:41:09.583789+0000","last_became_peered":"2024-05-08T06:41:09.583789+0000","last_unstale":"2024-05-08T06:46:32.871931+0000","last_undegraded":"2024-05-08T06:46:32.871931+0000","last_fullsized":"2024-05-08T06:46:32.871931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:33:04.153098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873893+0000","last_change":"2024-05-08T06:41:09.573622+0000","last_active":"2024-05-08T06:46:32.873893+0000","last_peered":"2024-05-08T06:46:32.873893+0000","last_clean":"2024-05-08T06:46:32.873893+0000","last_became_active":"2024-05-08T06:41:09.573116+0000","last_became_peered":"2024-05-08T06:41:09.573116+0000","last_unstale":"2024-05-08T06:46:32.873893+0000","last_undegraded":"2024-05-08T06:46:32.873893+0000","last_fullsized":"2024-05-08T06:46:32.873893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:58:03.031899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776142+0000","last_change":"2024-05-08T06:41:09.588787+0000","last_active":"2024-05-08T06:46:32.776142+0000","last_peered":"2024-05-08T06:46:32.776142+0000","last_clean":"2024-05-08T06:46:32.776142+0000","last_became_active":"2024-05-08T06:41:09.588430+0000","last_became_peered":"2024-05-08T06:41:09.588430+0000","last_unstale":"2024-05-08T06:46:32.776142+0000","last_undegraded":"2024-05-08T06:46:32.776142+0000","last_fullsized":"2024-05-08T06:46:32.776142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:36:26.689419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640938+0000","last_change":"2024-05-08T06:41:09.575057+0000","last_active":"2024-05-08T06:46:32.640938+0000","last_peered":"2024-05-08T06:46:32.640938+0000","last_clean":"2024-05-08T06:46:32.640938+0000","last_became_active":"2024-05-08T06:41:09.572522+0000","last_became_peered":"2024-05-08T06:41:09.572522+0000","last_unstale":"2024-05-08T06:46:32.640938+0000","last_undegraded":"2024-05-08T06:46:32.640938+0000","last_fullsized":"2024-05-08T06:46:32.640938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:40:26.702841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774975+0000","last_change":"2024-05-08T06:41:09.578184+0000","last_active":"2024-05-08T06:46:32.774975+0000","last_peered":"2024-05-08T06:46:32.774975+0000","last_clean":"2024-05-08T06:46:32.774975+0000","last_became_active":"2024-05-08T06:41:09.577796+0000","last_became_peered":"2024-05-08T06:41:09.577796+0000","last_unstale":"2024-05-08T06:46:32.774975+0000","last_undegraded":"2024-05-08T06:46:32.774975+0000","last_fullsized":"2024-05-08T06:46:32.774975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:40.822805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872864+0000","last_change":"2024-05-08T06:41:09.577050+0000","last_active":"2024-05-08T06:46:32.872864+0000","last_peered":"2024-05-08T06:46:32.872864+0000","last_clean":"2024-05-08T06:46:32.872864+0000","last_became_active":"2024-05-08T06:41:09.576449+0000","last_became_peered":"2024-05-08T06:41:09.576449+0000","last_unstale":"2024-05-08T06:46:32.872864+0000","last_undegraded":"2024-05-08T06:46:32.872864+0000","last_fullsized":"2024-05-08T06:46:32.872864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:04:42.819087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.635859+0000","last_change":"2024-05-08T06:41:09.580830+0000","last_active":"2024-05-08T06:46:32.635859+0000","last_peered":"2024-05-08T06:46:32.635859+0000","last_clean":"2024-05-08T06:46:32.635859+0000","last_became_active":"2024-05-08T06:41:09.577457+0000","last_became_peered":"2024-05-08T06:41:09.577457+0000","last_unstale":"2024-05-08T06:46:32.635859+0000","last_undegraded":"2024-05-08T06:46:32.635859+0000","last_fullsized":"2024-05-08T06:46:32.635859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:02.932857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871394+0000","last_change":"2024-05-08T06:41:09.586919+0000","last_active":"2024-05-08T06:46:32.871394+0000","last_peered":"2024-05-08T06:46:32.871394+0000","last_clean":"2024-05-08T06:46:32.871394+0000","last_became_active":"2024-05-08T06:41:09.586560+0000","last_became_peered":"2024-05-08T06:41:09.586560+0000","last_unstale":"2024-05-08T06:46:32.871394+0000","last_undegraded":"2024-05-08T06:46:32.871394+0000","last_fullsized":"2024-05-08T06:46:32.871394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:00.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":604794,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1503,"num_read_kb":863,"num_write":297,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2039808,"data_stored":1814382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612691,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1073152,"data_stored":538155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33040,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712112,"statfs":{"total":95995035648,"available":95961202688,"internally_reserved":0,"allocated":1908736,"data_stored":1332116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36792,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708360,"statfs":{"total":95995035648,"available":95957360640,"internally_reserved":0,"allocated":1486848,"data_stored":935703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168680,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28468,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716684,"statfs":{"total":95995035648,"available":95965884416,"internally_reserved":0,"allocated":1482752,"data_stored":931527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364911,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712328,"statfs":{"total":95995035648,"available":95961423872,"internally_reserved":0,"allocated":1683456,"data_stored":1136129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561143,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1069056,"data_stored":533567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575001,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717016,"statfs":{"total":95995035648,"available":95966224384,"internally_reserved":0,"allocated":1142784,"data_stored":602449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738526,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1093632,"data_stored":534955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411473,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28160,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716992,"statfs":{"total":95995035648,"available":95966199808,"internally_reserved":0,"allocated":1167360,"data_stored":609588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149835,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1609728,"data_stored":1058577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953605,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":529871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757374,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37300,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707852,"statfs":{"total":95995035648,"available":95956840448,"internally_reserved":0,"allocated":1826816,"data_stored":1261510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":74068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":76111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":208271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T06:46:41.504 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T06:46:41.976 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 70 op/s 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:46:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:46:42.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:46:42.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:46:42.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 70 op/s 2024-05-08T06:46:42.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:46:42.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:46:42.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:46:42.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: Updating smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: Updating smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: pgmap v7: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 132 KiB/s wr, 70 op/s 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:46:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:46:44.158 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:43 smithi070 ceph-mon[29591]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 103 KiB/s wr, 54 op/s 2024-05-08T06:46:44.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:43 smithi172 ceph-mon[33377]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 103 KiB/s wr, 54 op/s 2024-05-08T06:46:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:43 smithi194 ceph-mon[33679]: pgmap v8: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 103 KiB/s wr, 54 op/s 2024-05-08T06:46:44.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.489+0000 7fa536600700 1 -- 172.21.15.70:0/1537478633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530108850 msgr2=0x7fa5301103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.489+0000 7fa536600700 1 --2- 172.21.15.70:0/1537478633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530108850 0x7fa5301103d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa5280099c0 tx=0x7fa528009cd0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.490+0000 7fa536600700 1 -- 172.21.15.70:0/1537478633 shutdown_connections 2024-05-08T06:46:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.490+0000 7fa536600700 1 --2- 172.21.15.70:0/1537478633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530108850 0x7fa5301103d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.490+0000 7fa536600700 1 --2- 172.21.15.70:0/1537478633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530103750 0x7fa530103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.490+0000 7fa536600700 1 --2- 172.21.15.70:0/1537478633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa530104100 0x7fa530108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.490+0000 7fa536600700 1 -- 172.21.15.70:0/1537478633 >> 172.21.15.70:0/1537478633 conn(0x7fa53007a600 msgr2=0x7fa53007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.490+0000 7fa536600700 1 -- 172.21.15.70:0/1537478633 shutdown_connections 2024-05-08T06:46:44.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.490+0000 7fa536600700 1 -- 172.21.15.70:0/1537478633 wait complete. 2024-05-08T06:46:44.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.491+0000 7fa536600700 1 Processor -- start 2024-05-08T06:46:44.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.491+0000 7fa536600700 1 -- start start 2024-05-08T06:46:44.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.491+0000 7fa536600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa530103750 0x7fa5301a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:44.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.491+0000 7fa536600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530104100 0x7fa5301a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:44.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.491+0000 7fa536600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530108850 0x7fa53019b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:44.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.491+0000 7fa536600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa530113520 con 0x7fa530104100 2024-05-08T06:46:44.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.491+0000 7fa536600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa5301133a0 con 0x7fa530108850 2024-05-08T06:46:44.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.491+0000 7fa536600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa5301136a0 con 0x7fa530103750 2024-05-08T06:46:44.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa526a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530104100 0x7fa5301a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa526a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530104100 0x7fa5301a1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32906/0 (socket says 172.21.15.70:32906) 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa526a00700 1 -- 172.21.15.70:0/2266661148 learned_addr learned my addr 172.21.15.70:0/2266661148 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa52fe00700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530108850 0x7fa53019b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa52f400700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa530103750 0x7fa5301a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa526a00700 1 -- 172.21.15.70:0/2266661148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa530103750 msgr2=0x7fa5301a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa526a00700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa530103750 0x7fa5301a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa526a00700 1 -- 172.21.15.70:0/2266661148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530108850 msgr2=0x7fa53019b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa526a00700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530108850 0x7fa53019b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.492+0000 7fa526a00700 1 -- 172.21.15.70:0/2266661148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53019c140 con 0x7fa530104100 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.493+0000 7fa526a00700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530104100 0x7fa5301a1d60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa51800c920 tx=0x7fa51800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.493+0000 7fa52cc00700 1 -- 172.21.15.70:0/2266661148 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa518007b00 con 0x7fa530104100 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.493+0000 7fa52cc00700 1 -- 172.21.15.70:0/2266661148 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa518004cc0 con 0x7fa530104100 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.493+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53019c430 con 0x7fa530104100 2024-05-08T06:46:44.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.493+0000 7fa52cc00700 1 -- 172.21.15.70:0/2266661148 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5180054f0 con 0x7fa530104100 2024-05-08T06:46:44.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.493+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5301a86f0 con 0x7fa530104100 2024-05-08T06:46:44.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.494+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53006a190 con 0x7fa530104100 2024-05-08T06:46:44.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.497+0000 7fa52cc00700 1 -- 172.21.15.70:0/2266661148 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 149879+0+0 (secure 0 0 0) 0x7fa518007ca0 con 0x7fa530104100 2024-05-08T06:46:44.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.498+0000 7fa52cc00700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5140b2b90 0x7fa5140b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:44.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.498+0000 7fa52cc00700 1 -- 172.21.15.70:0/2266661148 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fa5180e2cb0 con 0x7fa530104100 2024-05-08T06:46:44.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.498+0000 7fa52f400700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5140b2b90 0x7fa5140b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:44.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.499+0000 7fa52f400700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5140b2b90 0x7fa5140b5050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa53019cb20 tx=0x7fa520009040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:44.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.501+0000 7fa52cc00700 1 -- 172.21.15.70:0/2266661148 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa518014030 con 0x7fa530104100 2024-05-08T06:46:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.733+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa5300766e0 con 0x7fa5140b2b90 2024-05-08T06:46:44.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.764+0000 7fa52cc00700 1 -- 172.21.15.70:0/2266661148 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339410 (secure 0 0 0) 0x7fa5300766e0 con 0x7fa5140b2b90 2024-05-08T06:46:44.770 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5140b2b90 msgr2=0x7fa5140b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5140b2b90 0x7fa5140b5050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa53019cb20 tx=0x7fa520009040 comp rx=0 tx=0).stop 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530104100 msgr2=0x7fa5301a1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530104100 0x7fa5301a1d60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa51800c920 tx=0x7fa51800cce0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 shutdown_connections 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5140b2b90 0x7fa5140b5050 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa530108850 0x7fa53019b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa530103750 0x7fa5301a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 --2- 172.21.15.70:0/2266661148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa530104100 0x7fa5301a1d60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.771+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 >> 172.21.15.70:0/2266661148 conn(0x7fa53007a600 msgr2=0x7fa530101870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.772+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 shutdown_connections 2024-05-08T06:46:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:44.772+0000 7fa536600700 1 -- 172.21.15.70:0/2266661148 wait complete. 2024-05-08T06:46:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-08T06:46:45.801 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-05-08T06:46:44.666420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1395330,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1963,"num_read_kb":1382,"num_write":565,"num_write_kb":4522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":918,"ondisk_log_size":918,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387172,"kb_used_data":16832,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124554652,"statfs":{"total":1151940427776,"available":1151543963648,"internally_reserved":0,"allocated":17235968,"data_stored":10619780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":199934,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":450,"num_write":143,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.972709"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871404+0000","last_change":"2024-05-08T06:41:09.587375+0000","last_active":"2024-05-08T06:46:32.871404+0000","last_peered":"2024-05-08T06:46:32.871404+0000","last_clean":"2024-05-08T06:46:32.871404+0000","last_became_active":"2024-05-08T06:41:09.585981+0000","last_became_peered":"2024-05-08T06:41:09.585981+0000","last_unstale":"2024-05-08T06:46:32.871404+0000","last_undegraded":"2024-05-08T06:46:32.871404+0000","last_fullsized":"2024-05-08T06:46:32.871404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:21.366529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869474+0000","last_change":"2024-05-08T06:41:09.573666+0000","last_active":"2024-05-08T06:46:32.869474+0000","last_peered":"2024-05-08T06:46:32.869474+0000","last_clean":"2024-05-08T06:46:32.869474+0000","last_became_active":"2024-05-08T06:41:09.573331+0000","last_became_peered":"2024-05-08T06:41:09.573331+0000","last_unstale":"2024-05-08T06:46:32.869474+0000","last_undegraded":"2024-05-08T06:46:32.869474+0000","last_fullsized":"2024-05-08T06:46:32.869474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:03:14.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869203+0000","last_change":"2024-05-08T06:41:09.582304+0000","last_active":"2024-05-08T06:46:32.869203+0000","last_peered":"2024-05-08T06:46:32.869203+0000","last_clean":"2024-05-08T06:46:32.869203+0000","last_became_active":"2024-05-08T06:41:09.581916+0000","last_became_peered":"2024-05-08T06:41:09.581916+0000","last_unstale":"2024-05-08T06:46:32.869203+0000","last_undegraded":"2024-05-08T06:46:32.869203+0000","last_fullsized":"2024-05-08T06:46:32.869203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:26.221008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771806+0000","last_change":"2024-05-08T06:42:15.863857+0000","last_active":"2024-05-08T06:46:32.771806+0000","last_peered":"2024-05-08T06:46:32.771806+0000","last_clean":"2024-05-08T06:46:32.771806+0000","last_became_active":"2024-05-08T06:42:15.863147+0000","last_became_peered":"2024-05-08T06:42:15.863147+0000","last_unstale":"2024-05-08T06:46:32.771806+0000","last_undegraded":"2024-05-08T06:46:32.771806+0000","last_fullsized":"2024-05-08T06:46:32.771806+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:48:20.951766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776482+0000","last_change":"2024-05-08T06:41:09.582429+0000","last_active":"2024-05-08T06:46:32.776482+0000","last_peered":"2024-05-08T06:46:32.776482+0000","last_clean":"2024-05-08T06:46:32.776482+0000","last_became_active":"2024-05-08T06:41:09.580152+0000","last_became_peered":"2024-05-08T06:41:09.580152+0000","last_unstale":"2024-05-08T06:46:32.776482+0000","last_undegraded":"2024-05-08T06:46:32.776482+0000","last_fullsized":"2024-05-08T06:46:32.776482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:58.992177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640667+0000","last_change":"2024-05-08T06:41:09.576432+0000","last_active":"2024-05-08T06:46:32.640667+0000","last_peered":"2024-05-08T06:46:32.640667+0000","last_clean":"2024-05-08T06:46:32.640667+0000","last_became_active":"2024-05-08T06:41:09.575723+0000","last_became_peered":"2024-05-08T06:41:09.575723+0000","last_unstale":"2024-05-08T06:46:32.640667+0000","last_undegraded":"2024-05-08T06:46:32.640667+0000","last_fullsized":"2024-05-08T06:46:32.640667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:51.802944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.188531+0000","last_change":"2024-05-08T06:42:15.856660+0000","last_active":"2024-05-08T06:46:33.188531+0000","last_peered":"2024-05-08T06:46:33.188531+0000","last_clean":"2024-05-08T06:46:33.188531+0000","last_became_active":"2024-05-08T06:42:15.855585+0000","last_became_peered":"2024-05-08T06:42:15.855585+0000","last_unstale":"2024-05-08T06:46:33.188531+0000","last_undegraded":"2024-05-08T06:46:33.188531+0000","last_fullsized":"2024-05-08T06:46:33.188531+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:43.647357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774638+0000","last_change":"2024-05-08T06:41:09.579941+0000","last_active":"2024-05-08T06:46:32.774638+0000","last_peered":"2024-05-08T06:46:32.774638+0000","last_clean":"2024-05-08T06:46:32.774638+0000","last_became_active":"2024-05-08T06:41:09.578961+0000","last_became_peered":"2024-05-08T06:41:09.578961+0000","last_unstale":"2024-05-08T06:46:32.774638+0000","last_undegraded":"2024-05-08T06:46:32.774638+0000","last_fullsized":"2024-05-08T06:46:32.774638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:28:59.000080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.874036+0000","last_change":"2024-05-08T06:41:09.580544+0000","last_active":"2024-05-08T06:46:32.874036+0000","last_peered":"2024-05-08T06:46:32.874036+0000","last_clean":"2024-05-08T06:46:32.874036+0000","last_became_active":"2024-05-08T06:41:09.579445+0000","last_became_peered":"2024-05-08T06:41:09.579445+0000","last_unstale":"2024-05-08T06:46:32.874036+0000","last_undegraded":"2024-05-08T06:46:32.874036+0000","last_fullsized":"2024-05-08T06:46:32.874036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:28.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.642138+0000","last_change":"2024-05-08T06:41:09.583133+0000","last_active":"2024-05-08T06:46:32.642138+0000","last_peered":"2024-05-08T06:46:32.642138+0000","last_clean":"2024-05-08T06:46:32.642138+0000","last_became_active":"2024-05-08T06:41:09.582261+0000","last_became_peered":"2024-05-08T06:41:09.582261+0000","last_unstale":"2024-05-08T06:46:32.642138+0000","last_undegraded":"2024-05-08T06:46:32.642138+0000","last_fullsized":"2024-05-08T06:46:32.642138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:26.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.190990+0000","last_change":"2024-05-08T06:41:09.575410+0000","last_active":"2024-05-08T06:46:33.190990+0000","last_peered":"2024-05-08T06:46:33.190990+0000","last_clean":"2024-05-08T06:46:33.190990+0000","last_became_active":"2024-05-08T06:41:09.574936+0000","last_became_peered":"2024-05-08T06:41:09.574936+0000","last_unstale":"2024-05-08T06:46:33.190990+0000","last_undegraded":"2024-05-08T06:46:33.190990+0000","last_fullsized":"2024-05-08T06:46:33.190990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:45.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870900+0000","last_change":"2024-05-08T06:41:09.582844+0000","last_active":"2024-05-08T06:46:32.870900+0000","last_peered":"2024-05-08T06:46:32.870900+0000","last_clean":"2024-05-08T06:46:32.870900+0000","last_became_active":"2024-05-08T06:41:09.582497+0000","last_became_peered":"2024-05-08T06:41:09.582497+0000","last_unstale":"2024-05-08T06:46:32.870900+0000","last_undegraded":"2024-05-08T06:46:32.870900+0000","last_fullsized":"2024-05-08T06:46:32.870900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:09:45.168495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.636089+0000","last_change":"2024-05-08T06:41:09.565312+0000","last_active":"2024-05-08T06:46:32.636089+0000","last_peered":"2024-05-08T06:46:32.636089+0000","last_clean":"2024-05-08T06:46:32.636089+0000","last_became_active":"2024-05-08T06:41:09.563425+0000","last_became_peered":"2024-05-08T06:41:09.563425+0000","last_unstale":"2024-05-08T06:46:32.636089+0000","last_undegraded":"2024-05-08T06:46:32.636089+0000","last_fullsized":"2024-05-08T06:46:32.636089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:08.706504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869147+0000","last_change":"2024-05-08T06:41:09.579395+0000","last_active":"2024-05-08T06:46:32.869147+0000","last_peered":"2024-05-08T06:46:32.869147+0000","last_clean":"2024-05-08T06:46:32.869147+0000","last_became_active":"2024-05-08T06:41:09.575881+0000","last_became_peered":"2024-05-08T06:41:09.575881+0000","last_unstale":"2024-05-08T06:46:32.869147+0000","last_undegraded":"2024-05-08T06:46:32.869147+0000","last_fullsized":"2024-05-08T06:46:32.869147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:37.109480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.868981+0000","last_change":"2024-05-08T06:41:09.589859+0000","last_active":"2024-05-08T06:46:32.868981+0000","last_peered":"2024-05-08T06:46:32.868981+0000","last_clean":"2024-05-08T06:46:32.868981+0000","last_became_active":"2024-05-08T06:41:09.589002+0000","last_became_peered":"2024-05-08T06:41:09.589002+0000","last_unstale":"2024-05-08T06:46:32.868981+0000","last_undegraded":"2024-05-08T06:46:32.868981+0000","last_fullsized":"2024-05-08T06:46:32.868981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:15:39.022268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870359+0000","last_change":"2024-05-08T06:41:09.566551+0000","last_active":"2024-05-08T06:46:32.870359+0000","last_peered":"2024-05-08T06:46:32.870359+0000","last_clean":"2024-05-08T06:46:32.870359+0000","last_became_active":"2024-05-08T06:41:09.564599+0000","last_became_peered":"2024-05-08T06:41:09.564599+0000","last_unstale":"2024-05-08T06:46:32.870359+0000","last_undegraded":"2024-05-08T06:46:32.870359+0000","last_fullsized":"2024-05-08T06:46:32.870359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:45.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871112+0000","last_change":"2024-05-08T06:41:09.582643+0000","last_active":"2024-05-08T06:46:32.871112+0000","last_peered":"2024-05-08T06:46:32.871112+0000","last_clean":"2024-05-08T06:46:32.871112+0000","last_became_active":"2024-05-08T06:41:09.582213+0000","last_became_peered":"2024-05-08T06:41:09.582213+0000","last_unstale":"2024-05-08T06:46:32.871112+0000","last_undegraded":"2024-05-08T06:46:32.871112+0000","last_fullsized":"2024-05-08T06:46:32.871112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:18.471194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.772987+0000","last_change":"2024-05-08T06:41:09.581447+0000","last_active":"2024-05-08T06:46:32.772987+0000","last_peered":"2024-05-08T06:46:32.772987+0000","last_clean":"2024-05-08T06:46:32.772987+0000","last_became_active":"2024-05-08T06:41:09.581067+0000","last_became_peered":"2024-05-08T06:41:09.581067+0000","last_unstale":"2024-05-08T06:46:32.772987+0000","last_undegraded":"2024-05-08T06:46:32.772987+0000","last_fullsized":"2024-05-08T06:46:32.772987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:26.967371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":55,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873978+0000","last_change":"2024-05-08T06:43:16.960640+0000","last_active":"2024-05-08T06:46:32.873978+0000","last_peered":"2024-05-08T06:46:32.873978+0000","last_clean":"2024-05-08T06:46:32.873978+0000","last_became_active":"2024-05-08T06:43:16.959541+0000","last_became_peered":"2024-05-08T06:43:16.959541+0000","last_unstale":"2024-05-08T06:46:32.873978+0000","last_undegraded":"2024-05-08T06:46:32.873978+0000","last_fullsized":"2024-05-08T06:46:32.873978+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:42.070321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873257+0000","last_change":"2024-05-08T06:41:24.665142+0000","last_active":"2024-05-08T06:46:32.873257+0000","last_peered":"2024-05-08T06:46:32.873257+0000","last_clean":"2024-05-08T06:46:32.873257+0000","last_became_active":"2024-05-08T06:41:24.664431+0000","last_became_peered":"2024-05-08T06:41:24.664431+0000","last_unstale":"2024-05-08T06:46:32.873257+0000","last_undegraded":"2024-05-08T06:46:32.873257+0000","last_fullsized":"2024-05-08T06:46:32.873257+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:11:08.511550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":58,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.773306+0000","last_change":"2024-05-08T06:41:05.503245+0000","last_active":"2024-05-08T06:46:32.773306+0000","last_peered":"2024-05-08T06:46:32.773306+0000","last_clean":"2024-05-08T06:46:32.773306+0000","last_became_active":"2024-05-08T06:41:05.502561+0000","last_became_peered":"2024-05-08T06:41:05.502561+0000","last_unstale":"2024-05-08T06:46:32.773306+0000","last_undegraded":"2024-05-08T06:46:32.773306+0000","last_fullsized":"2024-05-08T06:46:32.773306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:06.169830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774783+0000","last_change":"2024-05-08T06:41:09.579703+0000","last_active":"2024-05-08T06:46:32.774783+0000","last_peered":"2024-05-08T06:46:32.774783+0000","last_clean":"2024-05-08T06:46:32.774783+0000","last_became_active":"2024-05-08T06:41:09.579332+0000","last_became_peered":"2024-05-08T06:41:09.579332+0000","last_unstale":"2024-05-08T06:46:32.774783+0000","last_undegraded":"2024-05-08T06:46:32.774783+0000","last_fullsized":"2024-05-08T06:46:32.774783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:08.616722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870324+0000","last_change":"2024-05-08T06:41:24.666322+0000","last_active":"2024-05-08T06:46:32.870324+0000","last_peered":"2024-05-08T06:46:32.870324+0000","last_clean":"2024-05-08T06:46:32.870324+0000","last_became_active":"2024-05-08T06:41:24.664647+0000","last_became_peered":"2024-05-08T06:41:24.664647+0000","last_unstale":"2024-05-08T06:46:32.870324+0000","last_undegraded":"2024-05-08T06:46:32.870324+0000","last_fullsized":"2024-05-08T06:46:32.870324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:56.967066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775674+0000","last_change":"2024-05-08T06:41:06.149339+0000","last_active":"2024-05-08T06:46:32.775674+0000","last_peered":"2024-05-08T06:46:32.775674+0000","last_clean":"2024-05-08T06:46:32.775674+0000","last_became_active":"2024-05-08T06:41:06.148846+0000","last_became_peered":"2024-05-08T06:41:06.148846+0000","last_unstale":"2024-05-08T06:46:32.775674+0000","last_undegraded":"2024-05-08T06:46:32.775674+0000","last_fullsized":"2024-05-08T06:46:32.775674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:59.291206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869475+0000","last_change":"2024-05-08T06:41:09.581776+0000","last_active":"2024-05-08T06:46:32.869475+0000","last_peered":"2024-05-08T06:46:32.869475+0000","last_clean":"2024-05-08T06:46:32.869475+0000","last_became_active":"2024-05-08T06:41:09.581409+0000","last_became_peered":"2024-05-08T06:41:09.581409+0000","last_unstale":"2024-05-08T06:46:32.869475+0000","last_undegraded":"2024-05-08T06:46:32.869475+0000","last_fullsized":"2024-05-08T06:46:32.869475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:30.323812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870936+0000","last_change":"2024-05-08T06:42:16.255655+0000","last_active":"2024-05-08T06:46:32.870936+0000","last_peered":"2024-05-08T06:46:32.870936+0000","last_clean":"2024-05-08T06:46:32.870936+0000","last_became_active":"2024-05-08T06:42:16.253722+0000","last_became_peered":"2024-05-08T06:42:16.253722+0000","last_unstale":"2024-05-08T06:46:32.870936+0000","last_undegraded":"2024-05-08T06:46:32.870936+0000","last_fullsized":"2024-05-08T06:46:32.870936+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:58.492286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777779+0000","last_change":"2024-05-08T06:41:05.509738+0000","last_active":"2024-05-08T06:46:32.777779+0000","last_peered":"2024-05-08T06:46:32.777779+0000","last_clean":"2024-05-08T06:46:32.777779+0000","last_became_active":"2024-05-08T06:41:05.509198+0000","last_became_peered":"2024-05-08T06:41:05.509198+0000","last_unstale":"2024-05-08T06:46:32.777779+0000","last_undegraded":"2024-05-08T06:46:32.777779+0000","last_fullsized":"2024-05-08T06:46:32.777779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:51.350637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873224+0000","last_change":"2024-05-08T06:41:09.572288+0000","last_active":"2024-05-08T06:46:32.873224+0000","last_peered":"2024-05-08T06:46:32.873224+0000","last_clean":"2024-05-08T06:46:32.873224+0000","last_became_active":"2024-05-08T06:41:09.571951+0000","last_became_peered":"2024-05-08T06:41:09.571951+0000","last_unstale":"2024-05-08T06:46:32.873224+0000","last_undegraded":"2024-05-08T06:46:32.873224+0000","last_fullsized":"2024-05-08T06:46:32.873224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:45.687494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870906+0000","last_change":"2024-05-08T06:41:24.663289+0000","last_active":"2024-05-08T06:46:32.870906+0000","last_peered":"2024-05-08T06:46:32.870906+0000","last_clean":"2024-05-08T06:46:32.870906+0000","last_became_active":"2024-05-08T06:41:24.662899+0000","last_became_peered":"2024-05-08T06:41:24.662899+0000","last_unstale":"2024-05-08T06:46:32.870906+0000","last_undegraded":"2024-05-08T06:46:32.870906+0000","last_fullsized":"2024-05-08T06:46:32.870906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:15.024693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777208+0000","last_change":"2024-05-08T06:41:05.505412+0000","last_active":"2024-05-08T06:46:32.777208+0000","last_peered":"2024-05-08T06:46:32.777208+0000","last_clean":"2024-05-08T06:46:32.777208+0000","last_became_active":"2024-05-08T06:41:05.505023+0000","last_became_peered":"2024-05-08T06:41:05.505023+0000","last_unstale":"2024-05-08T06:46:32.777208+0000","last_undegraded":"2024-05-08T06:46:32.777208+0000","last_fullsized":"2024-05-08T06:46:32.777208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:50.403045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":56,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641782+0000","last_change":"2024-05-08T06:41:09.571080+0000","last_active":"2024-05-08T06:46:32.641782+0000","last_peered":"2024-05-08T06:46:32.641782+0000","last_clean":"2024-05-08T06:46:32.641782+0000","last_became_active":"2024-05-08T06:41:09.570755+0000","last_became_peered":"2024-05-08T06:41:09.570755+0000","last_unstale":"2024-05-08T06:46:32.641782+0000","last_undegraded":"2024-05-08T06:46:32.641782+0000","last_fullsized":"2024-05-08T06:46:32.641782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:38:53.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.874496+0000","last_change":"2024-05-08T06:41:24.660091+0000","last_active":"2024-05-08T06:46:32.874496+0000","last_peered":"2024-05-08T06:46:32.874496+0000","last_clean":"2024-05-08T06:46:32.874496+0000","last_became_active":"2024-05-08T06:41:24.659512+0000","last_became_peered":"2024-05-08T06:41:24.659512+0000","last_unstale":"2024-05-08T06:46:32.874496+0000","last_undegraded":"2024-05-08T06:46:32.874496+0000","last_fullsized":"2024-05-08T06:46:32.874496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:07:56.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'9","reported_seq":300,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:41.983316+0000","last_change":"2024-05-08T06:41:05.500625+0000","last_active":"2024-05-08T06:46:41.983316+0000","last_peered":"2024-05-08T06:46:41.983316+0000","last_clean":"2024-05-08T06:46:41.983316+0000","last_became_active":"2024-05-08T06:41:05.500079+0000","last_became_peered":"2024-05-08T06:41:05.500079+0000","last_unstale":"2024-05-08T06:46:41.983316+0000","last_undegraded":"2024-05-08T06:46:41.983316+0000","last_fullsized":"2024-05-08T06:46:41.983316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:32.143944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2288,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":244,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776525+0000","last_change":"2024-05-08T06:41:09.569045+0000","last_active":"2024-05-08T06:46:32.776525+0000","last_peered":"2024-05-08T06:46:32.776525+0000","last_clean":"2024-05-08T06:46:32.776525+0000","last_became_active":"2024-05-08T06:41:09.560040+0000","last_became_peered":"2024-05-08T06:41:09.560040+0000","last_unstale":"2024-05-08T06:46:32.776525+0000","last_undegraded":"2024-05-08T06:46:32.776525+0000","last_fullsized":"2024-05-08T06:46:32.776525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:58:52.284829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873342+0000","last_change":"2024-05-08T06:42:15.856574+0000","last_active":"2024-05-08T06:46:32.873342+0000","last_peered":"2024-05-08T06:46:32.873342+0000","last_clean":"2024-05-08T06:46:32.873342+0000","last_became_active":"2024-05-08T06:42:15.855459+0000","last_became_peered":"2024-05-08T06:42:15.855459+0000","last_unstale":"2024-05-08T06:46:32.873342+0000","last_undegraded":"2024-05-08T06:46:32.873342+0000","last_fullsized":"2024-05-08T06:46:32.873342+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:23:12.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640576+0000","last_change":"2024-05-08T06:41:05.505685+0000","last_active":"2024-05-08T06:46:32.640576+0000","last_peered":"2024-05-08T06:46:32.640576+0000","last_clean":"2024-05-08T06:46:32.640576+0000","last_became_active":"2024-05-08T06:41:05.505136+0000","last_became_peered":"2024-05-08T06:41:05.505136+0000","last_unstale":"2024-05-08T06:46:32.640576+0000","last_undegraded":"2024-05-08T06:46:32.640576+0000","last_fullsized":"2024-05-08T06:46:32.640576+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:59.968405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641045+0000","last_change":"2024-05-08T06:41:09.581340+0000","last_active":"2024-05-08T06:46:32.641045+0000","last_peered":"2024-05-08T06:46:32.641045+0000","last_clean":"2024-05-08T06:46:32.641045+0000","last_became_active":"2024-05-08T06:41:09.580969+0000","last_became_peered":"2024-05-08T06:41:09.580969+0000","last_unstale":"2024-05-08T06:46:32.641045+0000","last_undegraded":"2024-05-08T06:46:32.641045+0000","last_fullsized":"2024-05-08T06:46:32.641045+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:14.365972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870893+0000","last_change":"2024-05-08T06:41:24.675576+0000","last_active":"2024-05-08T06:46:32.870893+0000","last_peered":"2024-05-08T06:46:32.870893+0000","last_clean":"2024-05-08T06:46:32.870893+0000","last_became_active":"2024-05-08T06:41:24.675044+0000","last_became_peered":"2024-05-08T06:41:24.675044+0000","last_unstale":"2024-05-08T06:46:32.870893+0000","last_undegraded":"2024-05-08T06:46:32.870893+0000","last_fullsized":"2024-05-08T06:46:32.870893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:59.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.633995+0000","last_change":"2024-05-08T06:41:05.493094+0000","last_active":"2024-05-08T06:46:32.633995+0000","last_peered":"2024-05-08T06:46:32.633995+0000","last_clean":"2024-05-08T06:46:32.633995+0000","last_became_active":"2024-05-08T06:41:05.491206+0000","last_became_peered":"2024-05-08T06:41:05.491206+0000","last_unstale":"2024-05-08T06:46:32.633995+0000","last_undegraded":"2024-05-08T06:46:32.633995+0000","last_fullsized":"2024-05-08T06:46:32.633995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:03.689282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774759+0000","last_change":"2024-05-08T06:41:09.570646+0000","last_active":"2024-05-08T06:46:32.774759+0000","last_peered":"2024-05-08T06:46:32.774759+0000","last_clean":"2024-05-08T06:46:32.774759+0000","last_became_active":"2024-05-08T06:41:09.569500+0000","last_became_peered":"2024-05-08T06:41:09.569500+0000","last_unstale":"2024-05-08T06:46:32.774759+0000","last_undegraded":"2024-05-08T06:46:32.774759+0000","last_fullsized":"2024-05-08T06:46:32.774759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:25:08.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869878+0000","last_change":"2024-05-08T06:41:24.672021+0000","last_active":"2024-05-08T06:46:32.869878+0000","last_peered":"2024-05-08T06:46:32.869878+0000","last_clean":"2024-05-08T06:46:32.869878+0000","last_became_active":"2024-05-08T06:41:24.671583+0000","last_became_peered":"2024-05-08T06:41:24.671583+0000","last_unstale":"2024-05-08T06:46:32.869878+0000","last_undegraded":"2024-05-08T06:46:32.869878+0000","last_fullsized":"2024-05-08T06:46:32.869878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:33.850855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640529+0000","last_change":"2024-05-08T06:41:05.501501+0000","last_active":"2024-05-08T06:46:32.640529+0000","last_peered":"2024-05-08T06:46:32.640529+0000","last_clean":"2024-05-08T06:46:32.640529+0000","last_became_active":"2024-05-08T06:41:05.501001+0000","last_became_peered":"2024-05-08T06:41:05.501001+0000","last_unstale":"2024-05-08T06:46:32.640529+0000","last_undegraded":"2024-05-08T06:46:32.640529+0000","last_fullsized":"2024-05-08T06:46:32.640529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:15:18.984981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":59,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771336+0000","last_change":"2024-05-08T06:42:15.859096+0000","last_active":"2024-05-08T06:46:32.771336+0000","last_peered":"2024-05-08T06:46:32.771336+0000","last_clean":"2024-05-08T06:46:32.771336+0000","last_became_active":"2024-05-08T06:42:15.858508+0000","last_became_peered":"2024-05-08T06:42:15.858508+0000","last_unstale":"2024-05-08T06:46:32.771336+0000","last_undegraded":"2024-05-08T06:46:32.771336+0000","last_fullsized":"2024-05-08T06:46:32.771336+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:24.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774755+0000","last_change":"2024-05-08T06:41:24.670832+0000","last_active":"2024-05-08T06:46:32.774755+0000","last_peered":"2024-05-08T06:46:32.774755+0000","last_clean":"2024-05-08T06:46:32.774755+0000","last_became_active":"2024-05-08T06:41:24.668155+0000","last_became_peered":"2024-05-08T06:41:24.668155+0000","last_unstale":"2024-05-08T06:46:32.774755+0000","last_undegraded":"2024-05-08T06:46:32.774755+0000","last_fullsized":"2024-05-08T06:46:32.774755+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:11.460490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"92'4","reported_seq":291,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:41.982353+0000","last_change":"2024-05-08T06:41:05.494999+0000","last_active":"2024-05-08T06:46:41.982353+0000","last_peered":"2024-05-08T06:46:41.982353+0000","last_clean":"2024-05-08T06:46:41.982353+0000","last_became_active":"2024-05-08T06:41:05.494487+0000","last_became_peered":"2024-05-08T06:41:05.494487+0000","last_unstale":"2024-05-08T06:46:41.982353+0000","last_undegraded":"2024-05-08T06:46:41.982353+0000","last_fullsized":"2024-05-08T06:46:41.982353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:59.282625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873850+0000","last_change":"2024-05-08T06:41:09.570607+0000","last_active":"2024-05-08T06:46:32.873850+0000","last_peered":"2024-05-08T06:46:32.873850+0000","last_clean":"2024-05-08T06:46:32.873850+0000","last_became_active":"2024-05-08T06:41:09.570047+0000","last_became_peered":"2024-05-08T06:41:09.570047+0000","last_unstale":"2024-05-08T06:46:32.873850+0000","last_undegraded":"2024-05-08T06:46:32.873850+0000","last_fullsized":"2024-05-08T06:46:32.873850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:51.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771285+0000","last_change":"2024-05-08T06:41:24.677365+0000","last_active":"2024-05-08T06:46:32.771285+0000","last_peered":"2024-05-08T06:46:32.771285+0000","last_clean":"2024-05-08T06:46:32.771285+0000","last_became_active":"2024-05-08T06:41:24.673986+0000","last_became_peered":"2024-05-08T06:41:24.673986+0000","last_unstale":"2024-05-08T06:46:32.771285+0000","last_undegraded":"2024-05-08T06:46:32.771285+0000","last_fullsized":"2024-05-08T06:46:32.771285+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:07.013637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.191025+0000","last_change":"2024-05-08T06:41:05.499624+0000","last_active":"2024-05-08T06:46:33.191025+0000","last_peered":"2024-05-08T06:46:33.191025+0000","last_clean":"2024-05-08T06:46:33.191025+0000","last_became_active":"2024-05-08T06:41:05.498875+0000","last_became_peered":"2024-05-08T06:41:05.498875+0000","last_unstale":"2024-05-08T06:46:33.191025+0000","last_undegraded":"2024-05-08T06:46:33.191025+0000","last_fullsized":"2024-05-08T06:46:33.191025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:46:11.270399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":56,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869545+0000","last_change":"2024-05-08T06:42:15.853569+0000","last_active":"2024-05-08T06:46:32.869545+0000","last_peered":"2024-05-08T06:46:32.869545+0000","last_clean":"2024-05-08T06:46:32.869545+0000","last_became_active":"2024-05-08T06:42:15.852223+0000","last_became_peered":"2024-05-08T06:42:15.852223+0000","last_unstale":"2024-05-08T06:46:32.869545+0000","last_undegraded":"2024-05-08T06:46:32.869545+0000","last_fullsized":"2024-05-08T06:46:32.869545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:56.970134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871281+0000","last_change":"2024-05-08T06:41:24.671807+0000","last_active":"2024-05-08T06:46:32.871281+0000","last_peered":"2024-05-08T06:46:32.871281+0000","last_clean":"2024-05-08T06:46:32.871281+0000","last_became_active":"2024-05-08T06:41:24.670937+0000","last_became_peered":"2024-05-08T06:41:24.670937+0000","last_unstale":"2024-05-08T06:46:32.871281+0000","last_undegraded":"2024-05-08T06:46:32.871281+0000","last_fullsized":"2024-05-08T06:46:32.871281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:52.844916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640564+0000","last_change":"2024-05-08T06:41:06.147901+0000","last_active":"2024-05-08T06:46:32.640564+0000","last_peered":"2024-05-08T06:46:32.640564+0000","last_clean":"2024-05-08T06:46:32.640564+0000","last_became_active":"2024-05-08T06:41:06.146983+0000","last_became_peered":"2024-05-08T06:41:06.146983+0000","last_unstale":"2024-05-08T06:46:32.640564+0000","last_undegraded":"2024-05-08T06:46:32.640564+0000","last_fullsized":"2024-05-08T06:46:32.640564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:54.638290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873492+0000","last_change":"2024-05-08T06:41:09.586695+0000","last_active":"2024-05-08T06:46:32.873492+0000","last_peered":"2024-05-08T06:46:32.873492+0000","last_clean":"2024-05-08T06:46:32.873492+0000","last_became_active":"2024-05-08T06:41:09.586288+0000","last_became_peered":"2024-05-08T06:41:09.586288+0000","last_unstale":"2024-05-08T06:46:32.873492+0000","last_undegraded":"2024-05-08T06:46:32.873492+0000","last_fullsized":"2024-05-08T06:46:32.873492+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:18.383524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771448+0000","last_change":"2024-05-08T06:41:24.671523+0000","last_active":"2024-05-08T06:46:32.771448+0000","last_peered":"2024-05-08T06:46:32.771448+0000","last_clean":"2024-05-08T06:46:32.771448+0000","last_became_active":"2024-05-08T06:41:24.670307+0000","last_became_peered":"2024-05-08T06:41:24.670307+0000","last_unstale":"2024-05-08T06:46:32.771448+0000","last_undegraded":"2024-05-08T06:46:32.771448+0000","last_fullsized":"2024-05-08T06:46:32.771448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.034208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'44","reported_seq":585,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:42.984383+0000","last_change":"2024-05-08T06:41:05.504643+0000","last_active":"2024-05-08T06:46:42.984383+0000","last_peered":"2024-05-08T06:46:42.984383+0000","last_clean":"2024-05-08T06:46:42.984383+0000","last_became_active":"2024-05-08T06:41:05.504011+0000","last_became_peered":"2024-05-08T06:41:05.504011+0000","last_unstale":"2024-05-08T06:46:42.984383+0000","last_undegraded":"2024-05-08T06:46:42.984383+0000","last_fullsized":"2024-05-08T06:46:42.984383+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:47.262643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76979,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":324,"num_write":45,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777257+0000","last_change":"2024-05-08T06:41:09.580532+0000","last_active":"2024-05-08T06:46:32.777257+0000","last_peered":"2024-05-08T06:46:32.777257+0000","last_clean":"2024-05-08T06:46:32.777257+0000","last_became_active":"2024-05-08T06:41:09.575396+0000","last_became_peered":"2024-05-08T06:41:09.575396+0000","last_unstale":"2024-05-08T06:46:32.777257+0000","last_undegraded":"2024-05-08T06:46:32.777257+0000","last_fullsized":"2024-05-08T06:46:32.777257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:29.197093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.642476+0000","last_change":"2024-05-08T06:41:24.660200+0000","last_active":"2024-05-08T06:46:32.642476+0000","last_peered":"2024-05-08T06:46:32.642476+0000","last_clean":"2024-05-08T06:46:32.642476+0000","last_became_active":"2024-05-08T06:41:24.659674+0000","last_became_peered":"2024-05-08T06:41:24.659674+0000","last_unstale":"2024-05-08T06:46:32.642476+0000","last_undegraded":"2024-05-08T06:46:32.642476+0000","last_fullsized":"2024-05-08T06:46:32.642476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:51.023256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":55,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873925+0000","last_change":"2024-05-08T06:41:05.500899+0000","last_active":"2024-05-08T06:46:32.873925+0000","last_peered":"2024-05-08T06:46:32.873925+0000","last_clean":"2024-05-08T06:46:32.873925+0000","last_became_active":"2024-05-08T06:41:05.500437+0000","last_became_peered":"2024-05-08T06:41:05.500437+0000","last_unstale":"2024-05-08T06:46:32.873925+0000","last_undegraded":"2024-05-08T06:46:32.873925+0000","last_fullsized":"2024-05-08T06:46:32.873925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:38.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634212+0000","last_change":"2024-05-08T06:41:09.574273+0000","last_active":"2024-05-08T06:46:32.634212+0000","last_peered":"2024-05-08T06:46:32.634212+0000","last_clean":"2024-05-08T06:46:32.634212+0000","last_became_active":"2024-05-08T06:41:09.573902+0000","last_became_peered":"2024-05-08T06:41:09.573902+0000","last_unstale":"2024-05-08T06:46:32.634212+0000","last_undegraded":"2024-05-08T06:46:32.634212+0000","last_fullsized":"2024-05-08T06:46:32.634212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:39:12.749290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870744+0000","last_change":"2024-05-08T06:41:24.674360+0000","last_active":"2024-05-08T06:46:32.870744+0000","last_peered":"2024-05-08T06:46:32.870744+0000","last_clean":"2024-05-08T06:46:32.870744+0000","last_became_active":"2024-05-08T06:41:24.673938+0000","last_became_peered":"2024-05-08T06:41:24.673938+0000","last_unstale":"2024-05-08T06:46:32.870744+0000","last_undegraded":"2024-05-08T06:46:32.870744+0000","last_fullsized":"2024-05-08T06:46:32.870744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:13:36.735220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641651+0000","last_change":"2024-05-08T06:41:05.504335+0000","last_active":"2024-05-08T06:46:32.641651+0000","last_peered":"2024-05-08T06:46:32.641651+0000","last_clean":"2024-05-08T06:46:32.641651+0000","last_became_active":"2024-05-08T06:41:05.503981+0000","last_became_peered":"2024-05-08T06:41:05.503981+0000","last_unstale":"2024-05-08T06:46:32.641651+0000","last_undegraded":"2024-05-08T06:46:32.641651+0000","last_fullsized":"2024-05-08T06:46:32.641651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:45:35.813245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.189297+0000","last_change":"2024-05-08T06:41:09.580852+0000","last_active":"2024-05-08T06:46:33.189297+0000","last_peered":"2024-05-08T06:46:33.189297+0000","last_clean":"2024-05-08T06:46:33.189297+0000","last_became_active":"2024-05-08T06:41:09.580375+0000","last_became_peered":"2024-05-08T06:41:09.580375+0000","last_unstale":"2024-05-08T06:46:33.189297+0000","last_undegraded":"2024-05-08T06:46:33.189297+0000","last_fullsized":"2024-05-08T06:46:33.189297+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:21:06.695878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.773002+0000","last_change":"2024-05-08T06:41:24.678268+0000","last_active":"2024-05-08T06:46:32.773002+0000","last_peered":"2024-05-08T06:46:32.773002+0000","last_clean":"2024-05-08T06:46:32.773002+0000","last_became_active":"2024-05-08T06:41:24.677804+0000","last_became_peered":"2024-05-08T06:41:24.677804+0000","last_unstale":"2024-05-08T06:46:32.773002+0000","last_undegraded":"2024-05-08T06:46:32.773002+0000","last_fullsized":"2024-05-08T06:46:32.773002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:03.082661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'6","reported_seq":299,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:42.001916+0000","last_change":"2024-05-08T06:41:05.498143+0000","last_active":"2024-05-08T06:46:42.001916+0000","last_peered":"2024-05-08T06:46:42.001916+0000","last_clean":"2024-05-08T06:46:42.001916+0000","last_became_active":"2024-05-08T06:41:05.497707+0000","last_became_peered":"2024-05-08T06:41:05.497707+0000","last_unstale":"2024-05-08T06:46:42.001916+0000","last_undegraded":"2024-05-08T06:46:42.001916+0000","last_fullsized":"2024-05-08T06:46:42.001916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:20.556535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.188009+0000","last_change":"2024-05-08T06:43:17.135955+0000","last_active":"2024-05-08T06:46:33.188009+0000","last_peered":"2024-05-08T06:46:33.188009+0000","last_clean":"2024-05-08T06:46:33.188009+0000","last_became_active":"2024-05-08T06:43:17.134734+0000","last_became_peered":"2024-05-08T06:43:17.134734+0000","last_unstale":"2024-05-08T06:46:33.188009+0000","last_undegraded":"2024-05-08T06:46:33.188009+0000","last_fullsized":"2024-05-08T06:46:33.188009+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:33:53.573382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634950+0000","last_change":"2024-05-08T06:41:24.663938+0000","last_active":"2024-05-08T06:46:32.634950+0000","last_peered":"2024-05-08T06:46:32.634950+0000","last_clean":"2024-05-08T06:46:32.634950+0000","last_became_active":"2024-05-08T06:41:24.661679+0000","last_became_peered":"2024-05-08T06:41:24.661679+0000","last_unstale":"2024-05-08T06:46:32.634950+0000","last_undegraded":"2024-05-08T06:46:32.634950+0000","last_fullsized":"2024-05-08T06:46:32.634950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:21.590681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":63,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775931+0000","last_change":"2024-05-08T06:41:06.151458+0000","last_active":"2024-05-08T06:46:32.775931+0000","last_peered":"2024-05-08T06:46:32.775931+0000","last_clean":"2024-05-08T06:46:32.775931+0000","last_became_active":"2024-05-08T06:41:06.146564+0000","last_became_peered":"2024-05-08T06:41:06.146564+0000","last_unstale":"2024-05-08T06:46:32.775931+0000","last_undegraded":"2024-05-08T06:46:32.775931+0000","last_fullsized":"2024-05-08T06:46:32.775931+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:36.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640550+0000","last_change":"2024-05-08T06:41:09.576666+0000","last_active":"2024-05-08T06:46:32.640550+0000","last_peered":"2024-05-08T06:46:32.640550+0000","last_clean":"2024-05-08T06:46:32.640550+0000","last_became_active":"2024-05-08T06:41:09.576062+0000","last_became_peered":"2024-05-08T06:41:09.576062+0000","last_unstale":"2024-05-08T06:46:32.640550+0000","last_undegraded":"2024-05-08T06:46:32.640550+0000","last_fullsized":"2024-05-08T06:46:32.640550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:21.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640429+0000","last_change":"2024-05-08T06:42:16.255227+0000","last_active":"2024-05-08T06:46:32.640429+0000","last_peered":"2024-05-08T06:46:32.640429+0000","last_clean":"2024-05-08T06:46:32.640429+0000","last_became_active":"2024-05-08T06:42:16.253021+0000","last_became_peered":"2024-05-08T06:42:16.253021+0000","last_unstale":"2024-05-08T06:46:32.640429+0000","last_undegraded":"2024-05-08T06:46:32.640429+0000","last_fullsized":"2024-05-08T06:46:32.640429+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:29:41.833171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777572+0000","last_change":"2024-05-08T06:41:05.506830+0000","last_active":"2024-05-08T06:46:32.777572+0000","last_peered":"2024-05-08T06:46:32.777572+0000","last_clean":"2024-05-08T06:46:32.777572+0000","last_became_active":"2024-05-08T06:41:05.505402+0000","last_became_peered":"2024-05-08T06:41:05.505402+0000","last_unstale":"2024-05-08T06:46:32.777572+0000","last_undegraded":"2024-05-08T06:46:32.777572+0000","last_fullsized":"2024-05-08T06:46:32.777572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:26.804268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870941+0000","last_change":"2024-05-08T06:41:09.586937+0000","last_active":"2024-05-08T06:46:32.870941+0000","last_peered":"2024-05-08T06:46:32.870941+0000","last_clean":"2024-05-08T06:46:32.870941+0000","last_became_active":"2024-05-08T06:41:09.586443+0000","last_became_peered":"2024-05-08T06:41:09.586443+0000","last_unstale":"2024-05-08T06:46:32.870941+0000","last_undegraded":"2024-05-08T06:46:32.870941+0000","last_fullsized":"2024-05-08T06:46:32.870941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:49.004676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776215+0000","last_change":"2024-05-08T06:42:16.042874+0000","last_active":"2024-05-08T06:46:32.776215+0000","last_peered":"2024-05-08T06:46:32.776215+0000","last_clean":"2024-05-08T06:46:32.776215+0000","last_became_active":"2024-05-08T06:42:16.041424+0000","last_became_peered":"2024-05-08T06:42:16.041424+0000","last_unstale":"2024-05-08T06:46:32.776215+0000","last_undegraded":"2024-05-08T06:46:32.776215+0000","last_fullsized":"2024-05-08T06:46:32.776215+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:47.162238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771752+0000","last_change":"2024-05-08T06:41:06.146631+0000","last_active":"2024-05-08T06:46:32.771752+0000","last_peered":"2024-05-08T06:46:32.771752+0000","last_clean":"2024-05-08T06:46:32.771752+0000","last_became_active":"2024-05-08T06:41:06.145876+0000","last_became_peered":"2024-05-08T06:41:06.145876+0000","last_unstale":"2024-05-08T06:46:32.771752+0000","last_undegraded":"2024-05-08T06:46:32.771752+0000","last_fullsized":"2024-05-08T06:46:32.771752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:46.283923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641370+0000","last_change":"2024-05-08T06:41:09.571084+0000","last_active":"2024-05-08T06:46:32.641370+0000","last_peered":"2024-05-08T06:46:32.641370+0000","last_clean":"2024-05-08T06:46:32.641370+0000","last_became_active":"2024-05-08T06:41:09.570685+0000","last_became_peered":"2024-05-08T06:41:09.570685+0000","last_unstale":"2024-05-08T06:46:32.641370+0000","last_undegraded":"2024-05-08T06:46:32.641370+0000","last_fullsized":"2024-05-08T06:46:32.641370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:02:21.748502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634478+0000","last_change":"2024-05-08T06:41:24.667348+0000","last_active":"2024-05-08T06:46:32.634478+0000","last_peered":"2024-05-08T06:46:32.634478+0000","last_clean":"2024-05-08T06:46:32.634478+0000","last_became_active":"2024-05-08T06:41:24.662570+0000","last_became_peered":"2024-05-08T06:41:24.662570+0000","last_unstale":"2024-05-08T06:46:32.634478+0000","last_undegraded":"2024-05-08T06:46:32.634478+0000","last_fullsized":"2024-05-08T06:46:32.634478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:05.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187375+0000","last_change":"2024-05-08T06:41:05.501884+0000","last_active":"2024-05-08T06:46:33.187375+0000","last_peered":"2024-05-08T06:46:33.187375+0000","last_clean":"2024-05-08T06:46:33.187375+0000","last_became_active":"2024-05-08T06:41:05.498866+0000","last_became_peered":"2024-05-08T06:41:05.498866+0000","last_unstale":"2024-05-08T06:46:33.187375+0000","last_undegraded":"2024-05-08T06:46:33.187375+0000","last_fullsized":"2024-05-08T06:46:33.187375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:50.560695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640953+0000","last_change":"2024-05-08T06:41:09.582601+0000","last_active":"2024-05-08T06:46:32.640953+0000","last_peered":"2024-05-08T06:46:32.640953+0000","last_clean":"2024-05-08T06:46:32.640953+0000","last_became_active":"2024-05-08T06:41:09.582205+0000","last_became_peered":"2024-05-08T06:41:09.582205+0000","last_unstale":"2024-05-08T06:46:32.640953+0000","last_undegraded":"2024-05-08T06:46:32.640953+0000","last_fullsized":"2024-05-08T06:46:32.640953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:29.594001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634966+0000","last_change":"2024-05-08T06:41:24.659339+0000","last_active":"2024-05-08T06:46:32.634966+0000","last_peered":"2024-05-08T06:46:32.634966+0000","last_clean":"2024-05-08T06:46:32.634966+0000","last_became_active":"2024-05-08T06:41:24.658879+0000","last_became_peered":"2024-05-08T06:41:24.658879+0000","last_unstale":"2024-05-08T06:46:32.634966+0000","last_undegraded":"2024-05-08T06:46:32.634966+0000","last_fullsized":"2024-05-08T06:46:32.634966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:59.257118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":55,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641550+0000","last_change":"2024-05-08T06:42:15.850510+0000","last_active":"2024-05-08T06:46:32.641550+0000","last_peered":"2024-05-08T06:46:32.641550+0000","last_clean":"2024-05-08T06:46:32.641550+0000","last_became_active":"2024-05-08T06:42:15.849158+0000","last_became_peered":"2024-05-08T06:42:15.849158+0000","last_unstale":"2024-05-08T06:46:32.641550+0000","last_undegraded":"2024-05-08T06:46:32.641550+0000","last_fullsized":"2024-05-08T06:46:32.641550+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:14.687642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":294,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:42.000333+0000","last_change":"2024-05-08T06:41:06.148436+0000","last_active":"2024-05-08T06:46:42.000333+0000","last_peered":"2024-05-08T06:46:42.000333+0000","last_clean":"2024-05-08T06:46:42.000333+0000","last_became_active":"2024-05-08T06:41:06.147690+0000","last_became_peered":"2024-05-08T06:41:06.147690+0000","last_unstale":"2024-05-08T06:46:42.000333+0000","last_undegraded":"2024-05-08T06:46:42.000333+0000","last_fullsized":"2024-05-08T06:46:42.000333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:49.925872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.190534+0000","last_change":"2024-05-08T06:41:24.667958+0000","last_active":"2024-05-08T06:46:33.190534+0000","last_peered":"2024-05-08T06:46:33.190534+0000","last_clean":"2024-05-08T06:46:33.190534+0000","last_became_active":"2024-05-08T06:41:24.666181+0000","last_became_peered":"2024-05-08T06:41:24.666181+0000","last_unstale":"2024-05-08T06:46:33.190534+0000","last_undegraded":"2024-05-08T06:46:33.190534+0000","last_fullsized":"2024-05-08T06:46:33.190534+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:08.413670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775164+0000","last_change":"2024-05-08T06:41:09.581353+0000","last_active":"2024-05-08T06:46:32.775164+0000","last_peered":"2024-05-08T06:46:32.775164+0000","last_clean":"2024-05-08T06:46:32.775164+0000","last_became_active":"2024-05-08T06:41:09.580630+0000","last_became_peered":"2024-05-08T06:41:09.580630+0000","last_unstale":"2024-05-08T06:46:32.775164+0000","last_undegraded":"2024-05-08T06:46:32.775164+0000","last_fullsized":"2024-05-08T06:46:32.775164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:07.041564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870857+0000","last_change":"2024-05-08T06:41:05.494128+0000","last_active":"2024-05-08T06:46:32.870857+0000","last_peered":"2024-05-08T06:46:32.870857+0000","last_clean":"2024-05-08T06:46:32.870857+0000","last_became_active":"2024-05-08T06:41:05.493473+0000","last_became_peered":"2024-05-08T06:41:05.493473+0000","last_unstale":"2024-05-08T06:46:32.870857+0000","last_undegraded":"2024-05-08T06:46:32.870857+0000","last_fullsized":"2024-05-08T06:46:32.870857+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:01:51.061204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"93'99","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:34.810833+0000","last_change":"2024-05-08T06:39:12.054195+0000","last_active":"2024-05-08T06:46:34.810833+0000","last_peered":"2024-05-08T06:46:34.810833+0000","last_clean":"2024-05-08T06:46:34.810833+0000","last_became_active":"2024-05-08T06:39:12.045198+0000","last_became_peered":"2024-05-08T06:39:12.045198+0000","last_unstale":"2024-05-08T06:46:34.810833+0000","last_undegraded":"2024-05-08T06:46:34.810833+0000","last_fullsized":"2024-05-08T06:46:34.810833+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_clean_scrub_stamp":"2024-05-08T06:34:30.391671+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:32:48.631167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641955+0000","last_change":"2024-05-08T06:41:24.663009+0000","last_active":"2024-05-08T06:46:32.641955+0000","last_peered":"2024-05-08T06:46:32.641955+0000","last_clean":"2024-05-08T06:46:32.641955+0000","last_became_active":"2024-05-08T06:41:24.662552+0000","last_became_peered":"2024-05-08T06:41:24.662552+0000","last_unstale":"2024-05-08T06:46:32.641955+0000","last_undegraded":"2024-05-08T06:46:32.641955+0000","last_fullsized":"2024-05-08T06:46:32.641955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:57:12.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.633883+0000","last_change":"2024-05-08T06:41:09.576425+0000","last_active":"2024-05-08T06:46:32.633883+0000","last_peered":"2024-05-08T06:46:32.633883+0000","last_clean":"2024-05-08T06:46:32.633883+0000","last_became_active":"2024-05-08T06:41:09.576094+0000","last_became_peered":"2024-05-08T06:41:09.576094+0000","last_unstale":"2024-05-08T06:46:32.633883+0000","last_undegraded":"2024-05-08T06:46:32.633883+0000","last_fullsized":"2024-05-08T06:46:32.633883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:40.682429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187874+0000","last_change":"2024-05-08T06:41:05.505778+0000","last_active":"2024-05-08T06:46:33.187874+0000","last_peered":"2024-05-08T06:46:33.187874+0000","last_clean":"2024-05-08T06:46:33.187874+0000","last_became_active":"2024-05-08T06:41:05.505400+0000","last_became_peered":"2024-05-08T06:41:05.505400+0000","last_unstale":"2024-05-08T06:46:33.187874+0000","last_undegraded":"2024-05-08T06:46:33.187874+0000","last_fullsized":"2024-05-08T06:46:33.187874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:11:34.887026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870982+0000","last_change":"2024-05-08T06:41:24.671768+0000","last_active":"2024-05-08T06:46:32.870982+0000","last_peered":"2024-05-08T06:46:32.870982+0000","last_clean":"2024-05-08T06:46:32.870982+0000","last_became_active":"2024-05-08T06:41:24.671250+0000","last_became_peered":"2024-05-08T06:41:24.671250+0000","last_unstale":"2024-05-08T06:46:32.870982+0000","last_undegraded":"2024-05-08T06:46:32.870982+0000","last_fullsized":"2024-05-08T06:46:32.870982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:56:44.302049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777368+0000","last_change":"2024-05-08T06:41:06.151820+0000","last_active":"2024-05-08T06:46:32.777368+0000","last_peered":"2024-05-08T06:46:32.777368+0000","last_clean":"2024-05-08T06:46:32.777368+0000","last_became_active":"2024-05-08T06:41:06.149976+0000","last_became_peered":"2024-05-08T06:41:06.149976+0000","last_unstale":"2024-05-08T06:46:32.777368+0000","last_undegraded":"2024-05-08T06:46:32.777368+0000","last_fullsized":"2024-05-08T06:46:32.777368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:35:21.233811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634637+0000","last_change":"2024-05-08T06:41:09.568880+0000","last_active":"2024-05-08T06:46:32.634637+0000","last_peered":"2024-05-08T06:46:32.634637+0000","last_clean":"2024-05-08T06:46:32.634637+0000","last_became_active":"2024-05-08T06:41:09.568507+0000","last_became_peered":"2024-05-08T06:41:09.568507+0000","last_unstale":"2024-05-08T06:46:32.634637+0000","last_undegraded":"2024-05-08T06:46:32.634637+0000","last_fullsized":"2024-05-08T06:46:32.634637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:01.376121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774636+0000","last_change":"2024-05-08T06:41:24.667472+0000","last_active":"2024-05-08T06:46:32.774636+0000","last_peered":"2024-05-08T06:46:32.774636+0000","last_clean":"2024-05-08T06:46:32.774636+0000","last_became_active":"2024-05-08T06:41:24.664164+0000","last_became_peered":"2024-05-08T06:41:24.664164+0000","last_unstale":"2024-05-08T06:46:32.774636+0000","last_undegraded":"2024-05-08T06:46:32.774636+0000","last_fullsized":"2024-05-08T06:46:32.774636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:34:25.630742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'100","reported_seq":240,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:37.194680+0000","last_change":"2024-05-08T06:41:05.504287+0000","last_active":"2024-05-08T06:46:37.194680+0000","last_peered":"2024-05-08T06:46:37.194680+0000","last_clean":"2024-05-08T06:46:37.194680+0000","last_became_active":"2024-05-08T06:41:05.503825+0000","last_became_peered":"2024-05-08T06:41:05.503825+0000","last_unstale":"2024-05-08T06:46:37.194680+0000","last_undegraded":"2024-05-08T06:46:37.194680+0000","last_fullsized":"2024-05-08T06:46:37.194680+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:50:23.230289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":184,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775936+0000","last_change":"2024-05-08T06:41:09.576996+0000","last_active":"2024-05-08T06:46:32.775936+0000","last_peered":"2024-05-08T06:46:32.775936+0000","last_clean":"2024-05-08T06:46:32.775936+0000","last_became_active":"2024-05-08T06:41:09.572034+0000","last_became_peered":"2024-05-08T06:41:09.572034+0000","last_unstale":"2024-05-08T06:46:32.775936+0000","last_undegraded":"2024-05-08T06:46:32.775936+0000","last_fullsized":"2024-05-08T06:46:32.775936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:41.690687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872584+0000","last_change":"2024-05-08T06:41:24.665751+0000","last_active":"2024-05-08T06:46:32.872584+0000","last_peered":"2024-05-08T06:46:32.872584+0000","last_clean":"2024-05-08T06:46:32.872584+0000","last_became_active":"2024-05-08T06:41:24.665306+0000","last_became_peered":"2024-05-08T06:41:24.665306+0000","last_unstale":"2024-05-08T06:46:32.872584+0000","last_undegraded":"2024-05-08T06:46:32.872584+0000","last_fullsized":"2024-05-08T06:46:32.872584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:10.515975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871629+0000","last_change":"2024-05-08T06:41:05.502897+0000","last_active":"2024-05-08T06:46:32.871629+0000","last_peered":"2024-05-08T06:46:32.871629+0000","last_clean":"2024-05-08T06:46:32.871629+0000","last_became_active":"2024-05-08T06:41:05.500636+0000","last_became_peered":"2024-05-08T06:41:05.500636+0000","last_unstale":"2024-05-08T06:46:32.871629+0000","last_undegraded":"2024-05-08T06:46:32.871629+0000","last_fullsized":"2024-05-08T06:46:32.871629+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:02.523706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869659+0000","last_change":"2024-05-08T06:41:09.586824+0000","last_active":"2024-05-08T06:46:32.869659+0000","last_peered":"2024-05-08T06:46:32.869659+0000","last_clean":"2024-05-08T06:46:32.869659+0000","last_became_active":"2024-05-08T06:41:09.585032+0000","last_became_peered":"2024-05-08T06:41:09.585032+0000","last_unstale":"2024-05-08T06:46:32.869659+0000","last_undegraded":"2024-05-08T06:46:32.869659+0000","last_fullsized":"2024-05-08T06:46:32.869659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:00:31.890993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870743+0000","last_change":"2024-05-08T06:41:24.670033+0000","last_active":"2024-05-08T06:46:32.870743+0000","last_peered":"2024-05-08T06:46:32.870743+0000","last_clean":"2024-05-08T06:46:32.870743+0000","last_became_active":"2024-05-08T06:41:24.669477+0000","last_became_peered":"2024-05-08T06:41:24.669477+0000","last_unstale":"2024-05-08T06:46:32.870743+0000","last_undegraded":"2024-05-08T06:46:32.870743+0000","last_fullsized":"2024-05-08T06:46:32.870743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:55.040308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871533+0000","last_change":"2024-05-08T06:41:06.146847+0000","last_active":"2024-05-08T06:46:32.871533+0000","last_peered":"2024-05-08T06:46:32.871533+0000","last_clean":"2024-05-08T06:46:32.871533+0000","last_became_active":"2024-05-08T06:41:06.146141+0000","last_became_peered":"2024-05-08T06:41:06.146141+0000","last_unstale":"2024-05-08T06:46:32.871533+0000","last_undegraded":"2024-05-08T06:46:32.871533+0000","last_fullsized":"2024-05-08T06:46:32.871533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:45:30.924860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776443+0000","last_change":"2024-05-08T06:41:09.578067+0000","last_active":"2024-05-08T06:46:32.776443+0000","last_peered":"2024-05-08T06:46:32.776443+0000","last_clean":"2024-05-08T06:46:32.776443+0000","last_became_active":"2024-05-08T06:41:09.577650+0000","last_became_peered":"2024-05-08T06:41:09.577650+0000","last_unstale":"2024-05-08T06:46:32.776443+0000","last_undegraded":"2024-05-08T06:46:32.776443+0000","last_fullsized":"2024-05-08T06:46:32.776443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:09.285601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.773199+0000","last_change":"2024-05-08T06:41:24.669791+0000","last_active":"2024-05-08T06:46:32.773199+0000","last_peered":"2024-05-08T06:46:32.773199+0000","last_clean":"2024-05-08T06:46:32.773199+0000","last_became_active":"2024-05-08T06:41:24.669363+0000","last_became_peered":"2024-05-08T06:41:24.669363+0000","last_unstale":"2024-05-08T06:46:32.773199+0000","last_undegraded":"2024-05-08T06:46:32.773199+0000","last_fullsized":"2024-05-08T06:46:32.773199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:08.522339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774863+0000","last_change":"2024-05-08T06:41:05.486456+0000","last_active":"2024-05-08T06:46:32.774863+0000","last_peered":"2024-05-08T06:46:32.774863+0000","last_clean":"2024-05-08T06:46:32.774863+0000","last_became_active":"2024-05-08T06:41:05.485878+0000","last_became_peered":"2024-05-08T06:41:05.485878+0000","last_unstale":"2024-05-08T06:46:32.774863+0000","last_undegraded":"2024-05-08T06:46:32.774863+0000","last_fullsized":"2024-05-08T06:46:32.774863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:11:47.985329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870546+0000","last_change":"2024-05-08T06:41:09.573940+0000","last_active":"2024-05-08T06:46:32.870546+0000","last_peered":"2024-05-08T06:46:32.870546+0000","last_clean":"2024-05-08T06:46:32.870546+0000","last_became_active":"2024-05-08T06:41:09.573515+0000","last_became_peered":"2024-05-08T06:41:09.573515+0000","last_unstale":"2024-05-08T06:46:32.870546+0000","last_undegraded":"2024-05-08T06:46:32.870546+0000","last_fullsized":"2024-05-08T06:46:32.870546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:44.803013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872131+0000","last_change":"2024-05-08T06:41:24.663008+0000","last_active":"2024-05-08T06:46:32.872131+0000","last_peered":"2024-05-08T06:46:32.872131+0000","last_clean":"2024-05-08T06:46:32.872131+0000","last_became_active":"2024-05-08T06:41:24.661934+0000","last_became_peered":"2024-05-08T06:41:24.661934+0000","last_unstale":"2024-05-08T06:46:32.872131+0000","last_undegraded":"2024-05-08T06:46:32.872131+0000","last_fullsized":"2024-05-08T06:46:32.872131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:08.719125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"92'2","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870546+0000","last_change":"2024-05-08T06:43:16.894395+0000","last_active":"2024-05-08T06:46:32.870546+0000","last_peered":"2024-05-08T06:46:32.870546+0000","last_clean":"2024-05-08T06:46:32.870546+0000","last_became_active":"2024-05-08T06:43:16.886763+0000","last_became_peered":"2024-05-08T06:43:16.886763+0000","last_unstale":"2024-05-08T06:46:32.870546+0000","last_undegraded":"2024-05-08T06:46:32.870546+0000","last_fullsized":"2024-05-08T06:46:32.870546+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:52.278223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775237+0000","last_change":"2024-05-08T06:41:09.573388+0000","last_active":"2024-05-08T06:46:32.775237+0000","last_peered":"2024-05-08T06:46:32.775237+0000","last_clean":"2024-05-08T06:46:32.775237+0000","last_became_active":"2024-05-08T06:41:09.572901+0000","last_became_peered":"2024-05-08T06:41:09.572901+0000","last_unstale":"2024-05-08T06:46:32.775237+0000","last_undegraded":"2024-05-08T06:46:32.775237+0000","last_fullsized":"2024-05-08T06:46:32.775237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:38:45.123194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870992+0000","last_change":"2024-05-08T06:41:24.659817+0000","last_active":"2024-05-08T06:46:32.870992+0000","last_peered":"2024-05-08T06:46:32.870992+0000","last_clean":"2024-05-08T06:46:32.870992+0000","last_became_active":"2024-05-08T06:41:24.659276+0000","last_became_peered":"2024-05-08T06:41:24.659276+0000","last_unstale":"2024-05-08T06:46:32.870992+0000","last_undegraded":"2024-05-08T06:46:32.870992+0000","last_fullsized":"2024-05-08T06:46:32.870992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:01.635454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871054+0000","last_change":"2024-05-08T06:43:16.905524+0000","last_active":"2024-05-08T06:46:32.871054+0000","last_peered":"2024-05-08T06:46:32.871054+0000","last_clean":"2024-05-08T06:46:32.871054+0000","last_became_active":"2024-05-08T06:43:16.888087+0000","last_became_peered":"2024-05-08T06:43:16.888087+0000","last_unstale":"2024-05-08T06:46:32.871054+0000","last_undegraded":"2024-05-08T06:46:32.871054+0000","last_fullsized":"2024-05-08T06:46:32.871054+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:52.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187555+0000","last_change":"2024-05-08T06:41:09.574238+0000","last_active":"2024-05-08T06:46:33.187555+0000","last_peered":"2024-05-08T06:46:33.187555+0000","last_clean":"2024-05-08T06:46:33.187555+0000","last_became_active":"2024-05-08T06:41:09.570019+0000","last_became_peered":"2024-05-08T06:41:09.570019+0000","last_unstale":"2024-05-08T06:46:33.187555+0000","last_undegraded":"2024-05-08T06:46:33.187555+0000","last_fullsized":"2024-05-08T06:46:33.187555+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:56.980400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872332+0000","last_change":"2024-05-08T06:41:24.659955+0000","last_active":"2024-05-08T06:46:32.872332+0000","last_peered":"2024-05-08T06:46:32.872332+0000","last_clean":"2024-05-08T06:46:32.872332+0000","last_became_active":"2024-05-08T06:41:24.659534+0000","last_became_peered":"2024-05-08T06:41:24.659534+0000","last_unstale":"2024-05-08T06:46:32.872332+0000","last_undegraded":"2024-05-08T06:46:32.872332+0000","last_fullsized":"2024-05-08T06:46:32.872332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:41.893917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870716+0000","last_change":"2024-05-08T06:43:16.897225+0000","last_active":"2024-05-08T06:46:32.870716+0000","last_peered":"2024-05-08T06:46:32.870716+0000","last_clean":"2024-05-08T06:46:32.870716+0000","last_became_active":"2024-05-08T06:43:16.883954+0000","last_became_peered":"2024-05-08T06:43:16.883954+0000","last_unstale":"2024-05-08T06:46:32.870716+0000","last_undegraded":"2024-05-08T06:46:32.870716+0000","last_fullsized":"2024-05-08T06:46:32.870716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:12.014514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.191631+0000","last_change":"2024-05-08T06:41:09.574159+0000","last_active":"2024-05-08T06:46:33.191631+0000","last_peered":"2024-05-08T06:46:33.191631+0000","last_clean":"2024-05-08T06:46:33.191631+0000","last_became_active":"2024-05-08T06:41:09.573734+0000","last_became_peered":"2024-05-08T06:41:09.573734+0000","last_unstale":"2024-05-08T06:46:33.191631+0000","last_undegraded":"2024-05-08T06:46:33.191631+0000","last_fullsized":"2024-05-08T06:46:33.191631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:22.157071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.868921+0000","last_change":"2024-05-08T06:41:24.668545+0000","last_active":"2024-05-08T06:46:32.868921+0000","last_peered":"2024-05-08T06:46:32.868921+0000","last_clean":"2024-05-08T06:46:32.868921+0000","last_became_active":"2024-05-08T06:41:24.668086+0000","last_became_peered":"2024-05-08T06:41:24.668086+0000","last_unstale":"2024-05-08T06:46:32.868921+0000","last_undegraded":"2024-05-08T06:46:32.868921+0000","last_fullsized":"2024-05-08T06:46:32.868921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:08:02.473733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"93'65","reported_seq":143,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:36.717199+0000","last_change":"2024-05-08T06:41:05.501332+0000","last_active":"2024-05-08T06:46:36.717199+0000","last_peered":"2024-05-08T06:46:36.717199+0000","last_clean":"2024-05-08T06:46:36.717199+0000","last_became_active":"2024-05-08T06:41:05.499174+0000","last_became_peered":"2024-05-08T06:41:05.499174+0000","last_unstale":"2024-05-08T06:46:36.717199+0000","last_undegraded":"2024-05-08T06:46:36.717199+0000","last_fullsized":"2024-05-08T06:46:36.717199+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:49.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.190141+0000","last_change":"2024-05-08T06:41:09.572927+0000","last_active":"2024-05-08T06:46:33.190141+0000","last_peered":"2024-05-08T06:46:33.190141+0000","last_clean":"2024-05-08T06:46:33.190141+0000","last_became_active":"2024-05-08T06:41:09.572502+0000","last_became_peered":"2024-05-08T06:41:09.572502+0000","last_unstale":"2024-05-08T06:46:33.190141+0000","last_undegraded":"2024-05-08T06:46:33.190141+0000","last_fullsized":"2024-05-08T06:46:33.190141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:03.838892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.639936+0000","last_change":"2024-05-08T06:41:24.667561+0000","last_active":"2024-05-08T06:46:32.639936+0000","last_peered":"2024-05-08T06:46:32.639936+0000","last_clean":"2024-05-08T06:46:32.639936+0000","last_became_active":"2024-05-08T06:41:24.666904+0000","last_became_peered":"2024-05-08T06:41:24.666904+0000","last_unstale":"2024-05-08T06:46:32.639936+0000","last_undegraded":"2024-05-08T06:46:32.639936+0000","last_fullsized":"2024-05-08T06:46:32.639936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:15.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634924+0000","last_change":"2024-05-08T06:41:05.497117+0000","last_active":"2024-05-08T06:46:32.634924+0000","last_peered":"2024-05-08T06:46:32.634924+0000","last_clean":"2024-05-08T06:46:32.634924+0000","last_became_active":"2024-05-08T06:41:05.496621+0000","last_became_peered":"2024-05-08T06:41:05.496621+0000","last_unstale":"2024-05-08T06:46:32.634924+0000","last_undegraded":"2024-05-08T06:46:32.634924+0000","last_fullsized":"2024-05-08T06:46:32.634924+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:06:32.603973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.191471+0000","last_change":"2024-05-08T06:41:09.572489+0000","last_active":"2024-05-08T06:46:33.191471+0000","last_peered":"2024-05-08T06:46:33.191471+0000","last_clean":"2024-05-08T06:46:33.191471+0000","last_became_active":"2024-05-08T06:41:09.572129+0000","last_became_peered":"2024-05-08T06:41:09.572129+0000","last_unstale":"2024-05-08T06:46:33.191471+0000","last_undegraded":"2024-05-08T06:46:33.191471+0000","last_fullsized":"2024-05-08T06:46:33.191471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:18:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870754+0000","last_change":"2024-05-08T06:41:09.577872+0000","last_active":"2024-05-08T06:46:32.870754+0000","last_peered":"2024-05-08T06:46:32.870754+0000","last_clean":"2024-05-08T06:46:32.870754+0000","last_became_active":"2024-05-08T06:41:09.577490+0000","last_became_peered":"2024-05-08T06:41:09.577490+0000","last_unstale":"2024-05-08T06:46:32.870754+0000","last_undegraded":"2024-05-08T06:46:32.870754+0000","last_fullsized":"2024-05-08T06:46:32.870754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:12:44.956055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872995+0000","last_change":"2024-05-08T06:42:15.861046+0000","last_active":"2024-05-08T06:46:32.872995+0000","last_peered":"2024-05-08T06:46:32.872995+0000","last_clean":"2024-05-08T06:46:32.872995+0000","last_became_active":"2024-05-08T06:42:15.860267+0000","last_became_peered":"2024-05-08T06:42:15.860267+0000","last_unstale":"2024-05-08T06:46:32.872995+0000","last_undegraded":"2024-05-08T06:46:32.872995+0000","last_fullsized":"2024-05-08T06:46:32.872995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:15:01.541268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872703+0000","last_change":"2024-05-08T06:41:09.578005+0000","last_active":"2024-05-08T06:46:32.872703+0000","last_peered":"2024-05-08T06:46:32.872703+0000","last_clean":"2024-05-08T06:46:32.872703+0000","last_became_active":"2024-05-08T06:41:09.577571+0000","last_became_peered":"2024-05-08T06:41:09.577571+0000","last_unstale":"2024-05-08T06:46:32.872703+0000","last_undegraded":"2024-05-08T06:46:32.872703+0000","last_fullsized":"2024-05-08T06:46:32.872703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:22.762195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869224+0000","last_change":"2024-05-08T06:41:09.579520+0000","last_active":"2024-05-08T06:46:32.869224+0000","last_peered":"2024-05-08T06:46:32.869224+0000","last_clean":"2024-05-08T06:46:32.869224+0000","last_became_active":"2024-05-08T06:41:09.579085+0000","last_became_peered":"2024-05-08T06:41:09.579085+0000","last_unstale":"2024-05-08T06:46:32.869224+0000","last_undegraded":"2024-05-08T06:46:32.869224+0000","last_fullsized":"2024-05-08T06:46:32.869224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:02:25.199102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634777+0000","last_change":"2024-05-08T06:41:09.588352+0000","last_active":"2024-05-08T06:46:32.634777+0000","last_peered":"2024-05-08T06:46:32.634777+0000","last_clean":"2024-05-08T06:46:32.634777+0000","last_became_active":"2024-05-08T06:41:09.587981+0000","last_became_peered":"2024-05-08T06:41:09.587981+0000","last_unstale":"2024-05-08T06:46:32.634777+0000","last_undegraded":"2024-05-08T06:46:32.634777+0000","last_fullsized":"2024-05-08T06:46:32.634777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:55.275569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871931+0000","last_change":"2024-05-08T06:41:09.584216+0000","last_active":"2024-05-08T06:46:32.871931+0000","last_peered":"2024-05-08T06:46:32.871931+0000","last_clean":"2024-05-08T06:46:32.871931+0000","last_became_active":"2024-05-08T06:41:09.583789+0000","last_became_peered":"2024-05-08T06:41:09.583789+0000","last_unstale":"2024-05-08T06:46:32.871931+0000","last_undegraded":"2024-05-08T06:46:32.871931+0000","last_fullsized":"2024-05-08T06:46:32.871931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:33:04.153098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873893+0000","last_change":"2024-05-08T06:41:09.573622+0000","last_active":"2024-05-08T06:46:32.873893+0000","last_peered":"2024-05-08T06:46:32.873893+0000","last_clean":"2024-05-08T06:46:32.873893+0000","last_became_active":"2024-05-08T06:41:09.573116+0000","last_became_peered":"2024-05-08T06:41:09.573116+0000","last_unstale":"2024-05-08T06:46:32.873893+0000","last_undegraded":"2024-05-08T06:46:32.873893+0000","last_fullsized":"2024-05-08T06:46:32.873893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:58:03.031899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776142+0000","last_change":"2024-05-08T06:41:09.588787+0000","last_active":"2024-05-08T06:46:32.776142+0000","last_peered":"2024-05-08T06:46:32.776142+0000","last_clean":"2024-05-08T06:46:32.776142+0000","last_became_active":"2024-05-08T06:41:09.588430+0000","last_became_peered":"2024-05-08T06:41:09.588430+0000","last_unstale":"2024-05-08T06:46:32.776142+0000","last_undegraded":"2024-05-08T06:46:32.776142+0000","last_fullsized":"2024-05-08T06:46:32.776142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:36:26.689419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640938+0000","last_change":"2024-05-08T06:41:09.575057+0000","last_active":"2024-05-08T06:46:32.640938+0000","last_peered":"2024-05-08T06:46:32.640938+0000","last_clean":"2024-05-08T06:46:32.640938+0000","last_became_active":"2024-05-08T06:41:09.572522+0000","last_became_peered":"2024-05-08T06:41:09.572522+0000","last_unstale":"2024-05-08T06:46:32.640938+0000","last_undegraded":"2024-05-08T06:46:32.640938+0000","last_fullsized":"2024-05-08T06:46:32.640938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:40:26.702841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774975+0000","last_change":"2024-05-08T06:41:09.578184+0000","last_active":"2024-05-08T06:46:32.774975+0000","last_peered":"2024-05-08T06:46:32.774975+0000","last_clean":"2024-05-08T06:46:32.774975+0000","last_became_active":"2024-05-08T06:41:09.577796+0000","last_became_peered":"2024-05-08T06:41:09.577796+0000","last_unstale":"2024-05-08T06:46:32.774975+0000","last_undegraded":"2024-05-08T06:46:32.774975+0000","last_fullsized":"2024-05-08T06:46:32.774975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:40.822805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872864+0000","last_change":"2024-05-08T06:41:09.577050+0000","last_active":"2024-05-08T06:46:32.872864+0000","last_peered":"2024-05-08T06:46:32.872864+0000","last_clean":"2024-05-08T06:46:32.872864+0000","last_became_active":"2024-05-08T06:41:09.576449+0000","last_became_peered":"2024-05-08T06:41:09.576449+0000","last_unstale":"2024-05-08T06:46:32.872864+0000","last_undegraded":"2024-05-08T06:46:32.872864+0000","last_fullsized":"2024-05-08T06:46:32.872864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:04:42.819087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.635859+0000","last_change":"2024-05-08T06:41:09.580830+0000","last_active":"2024-05-08T06:46:32.635859+0000","last_peered":"2024-05-08T06:46:32.635859+0000","last_clean":"2024-05-08T06:46:32.635859+0000","last_became_active":"2024-05-08T06:41:09.577457+0000","last_became_peered":"2024-05-08T06:41:09.577457+0000","last_unstale":"2024-05-08T06:46:32.635859+0000","last_undegraded":"2024-05-08T06:46:32.635859+0000","last_fullsized":"2024-05-08T06:46:32.635859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:02.932857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871394+0000","last_change":"2024-05-08T06:41:09.586919+0000","last_active":"2024-05-08T06:46:32.871394+0000","last_peered":"2024-05-08T06:46:32.871394+0000","last_clean":"2024-05-08T06:46:32.871394+0000","last_became_active":"2024-05-08T06:41:09.586560+0000","last_became_peered":"2024-05-08T06:41:09.586560+0000","last_unstale":"2024-05-08T06:46:32.871394+0000","last_undegraded":"2024-05-08T06:46:32.871394+0000","last_fullsized":"2024-05-08T06:46:32.871394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:00.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":804728,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1819,"num_read_kb":1134,"num_write":428,"num_write_kb":2370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":2414184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":317,"ondisk_log_size":317,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612693,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1073152,"data_stored":538155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808923,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33356,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93711796,"statfs":{"total":95995035648,"available":95960879104,"internally_reserved":0,"allocated":2109440,"data_stored":1531659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36788,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708364,"statfs":{"total":95995035648,"available":95957364736,"internally_reserved":0,"allocated":1486848,"data_stored":935703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168682,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28464,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716688,"statfs":{"total":95995035648,"available":95965888512,"internally_reserved":0,"allocated":1482752,"data_stored":931527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364913,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712328,"statfs":{"total":95995035648,"available":95961423872,"internally_reserved":0,"allocated":1683456,"data_stored":1136520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561145,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1069056,"data_stored":533567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1150976,"data_stored":610456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738528,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1093632,"data_stored":534955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1171456,"data_stored":612890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149837,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28900,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716252,"statfs":{"total":95995035648,"available":95965442048,"internally_reserved":0,"allocated":1806336,"data_stored":1255209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953607,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":539824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757376,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37432,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707720,"statfs":{"total":95995035648,"available":95956705280,"internally_reserved":0,"allocated":2023424,"data_stored":1459315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":76979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":79413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":407814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T06:46:45.807 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-08T06:46:45.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T06:46:46.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:45 smithi070 ceph-mon[29591]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-05-08T06:46:46.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:45 smithi070 ceph-mon[29591]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:46:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:45 smithi194 ceph-mon[33679]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-05-08T06:46:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:45 smithi194 ceph-mon[33679]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:46:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:45 smithi172 ceph-mon[33377]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 47 op/s 2024-05-08T06:46:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:45 smithi172 ceph-mon[33377]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:46:48.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:47 smithi194 ceph-mon[33679]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-05-08T06:46:48.356 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:47 smithi070 ceph-mon[29591]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-05-08T06:46:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:47 smithi172 ceph-mon[33377]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-05-08T06:46:48.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.941+0000 7f6d5d200700 1 -- 172.21.15.70:0/1456874668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5806bb70 msgr2=0x7f6d5806bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:48.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.941+0000 7f6d5d200700 1 --2- 172.21.15.70:0/1456874668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5806bb70 0x7f6d5806bff0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009990 tx=0x7f6d44009ca0 comp rx=0 tx=0).stop 2024-05-08T06:46:48.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.942+0000 7f6d5d200700 1 -- 172.21.15.70:0/1456874668 shutdown_connections 2024-05-08T06:46:48.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.942+0000 7f6d5d200700 1 --2- 172.21.15.70:0/1456874668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5806c530 0x7f6d58110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:48.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.942+0000 7f6d5d200700 1 --2- 172.21.15.70:0/1456874668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d58109530 0x7f6d58109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:48.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.942+0000 7f6d5d200700 1 --2- 172.21.15.70:0/1456874668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5806bb70 0x7f6d5806bff0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:48.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.942+0000 7f6d5d200700 1 -- 172.21.15.70:0/1456874668 >> 172.21.15.70:0/1456874668 conn(0x7f6d58079350 msgr2=0x7f6d58079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:48.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.942+0000 7f6d5d200700 1 -- 172.21.15.70:0/1456874668 shutdown_connections 2024-05-08T06:46:48.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.942+0000 7f6d5d200700 1 -- 172.21.15.70:0/1456874668 wait complete. 2024-05-08T06:46:48.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.943+0000 7f6d5d200700 1 Processor -- start 2024-05-08T06:46:48.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.943+0000 7f6d5d200700 1 -- start start 2024-05-08T06:46:48.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.943+0000 7f6d5d200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5806bb70 0x7f6d58102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:48.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.943+0000 7f6d5d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5806c530 0x7f6d58102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:48.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.943+0000 7f6d5d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58109530 0x7f6d581032d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:48.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.943+0000 7f6d5d200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58113510 con 0x7f6d58109530 2024-05-08T06:46:48.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.943+0000 7f6d5d200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58113390 con 0x7f6d5806c530 2024-05-08T06:46:48.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.943+0000 7f6d5d200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58113690 con 0x7f6d5806bb70 2024-05-08T06:46:48.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d56800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58109530 0x7f6d581032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:48.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d56800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58109530 0x7f6d581032d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43934/0 (socket says 172.21.15.70:43934) 2024-05-08T06:46:48.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d56800700 1 -- 172.21.15.70:0/3532838457 learned_addr learned my addr 172.21.15.70:0/3532838457 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:48.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d55400700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5806c530 0x7f6d58102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d55e00700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5806bb70 0x7f6d58102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d56800700 1 -- 172.21.15.70:0/3532838457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5806bb70 msgr2=0x7f6d58102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d56800700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5806bb70 0x7f6d58102850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d56800700 1 -- 172.21.15.70:0/3532838457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5806c530 msgr2=0x7f6d58102d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d56800700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5806c530 0x7f6d58102d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d56800700 1 -- 172.21.15.70:0/3532838457 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d581a7fc0 con 0x7f6d58109530 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.944+0000 7f6d56800700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58109530 0x7f6d581032d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6d50007ee0 tx=0x7f6d5000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.945+0000 7f6d4ea00700 1 -- 172.21.15.70:0/3532838457 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5000dbd0 con 0x7f6d58109530 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.945+0000 7f6d4ea00700 1 -- 172.21.15.70:0/3532838457 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d5000dd70 con 0x7f6d58109530 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.945+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d581a82b0 con 0x7f6d58109530 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.945+0000 7f6d4ea00700 1 -- 172.21.15.70:0/3532838457 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d500058d0 con 0x7f6d58109530 2024-05-08T06:46:48.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.945+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d581a87a0 con 0x7f6d58109530 2024-05-08T06:46:48.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.946+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5810ba10 con 0x7f6d58109530 2024-05-08T06:46:48.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.948+0000 7f6d4ea00700 1 -- 172.21.15.70:0/3532838457 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 149879+0+0 (secure 0 0 0) 0x7f6d5001a020 con 0x7f6d58109530 2024-05-08T06:46:48.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.950+0000 7f6d4ea00700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2b10 0x7f6d3c0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:48.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.950+0000 7f6d4ea00700 1 -- 172.21.15.70:0/3532838457 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f6d500e2780 con 0x7f6d58109530 2024-05-08T06:46:48.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.950+0000 7f6d55e00700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2b10 0x7f6d3c0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:48.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.951+0000 7f6d55e00700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2b10 0x7f6d3c0b4fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d48005fd0 tx=0x7f6d48005ee0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:48.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:48.953+0000 7f6d4ea00700 1 -- 172.21.15.70:0/3532838457 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6d50010070 con 0x7f6d58109530 2024-05-08T06:46:49.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.184+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d580638e0 con 0x7f6d3c0b2b10 2024-05-08T06:46:49.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.198+0000 7f6d4ea00700 1 -- 172.21.15.70:0/3532838457 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339411 (secure 0 0 0) 0x7f6d580638e0 con 0x7f6d3c0b2b10 2024-05-08T06:46:49.204 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:46:49.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2b10 msgr2=0x7f6d3c0b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:49.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2b10 0x7f6d3c0b4fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d48005fd0 tx=0x7f6d48005ee0 comp rx=0 tx=0).stop 2024-05-08T06:46:49.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58109530 msgr2=0x7f6d581032d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:49.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58109530 0x7f6d581032d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6d50007ee0 tx=0x7f6d5000d3b0 comp rx=0 tx=0).stop 2024-05-08T06:46:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 shutdown_connections 2024-05-08T06:46:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2b10 0x7f6d3c0b4fd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58109530 0x7f6d581032d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5806bb70 0x7f6d58102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 --2- 172.21.15.70:0/3532838457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5806c530 0x7f6d58102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.206+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 >> 172.21.15.70:0/3532838457 conn(0x7f6d58079350 msgr2=0x7f6d581016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.207+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 shutdown_connections 2024-05-08T06:46:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:49.207+0000 7f6d5d200700 1 -- 172.21.15.70:0/3532838457 wait complete. 2024-05-08T06:46:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-05-08T06:46:50.185 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-05-08T06:46:48.668257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1395330,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1963,"num_read_kb":1382,"num_write":565,"num_write_kb":4522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":2952422,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":918,"ondisk_log_size":918,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":387172,"kb_used_data":16832,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124554652,"statfs":{"total":1151940427776,"available":1151543963648,"internally_reserved":0,"allocated":17235968,"data_stored":10619780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":378713402},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":199934,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":379,"num_read_kb":450,"num_write":143,"num_write_kb":920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004947"},"pg_stats":[{"pgid":"3.3f","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871404+0000","last_change":"2024-05-08T06:41:09.587375+0000","last_active":"2024-05-08T06:46:32.871404+0000","last_peered":"2024-05-08T06:46:32.871404+0000","last_clean":"2024-05-08T06:46:32.871404+0000","last_became_active":"2024-05-08T06:41:09.585981+0000","last_became_peered":"2024-05-08T06:41:09.585981+0000","last_unstale":"2024-05-08T06:46:32.871404+0000","last_undegraded":"2024-05-08T06:46:32.871404+0000","last_fullsized":"2024-05-08T06:46:32.871404+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:21.366529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"92'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869474+0000","last_change":"2024-05-08T06:41:09.573666+0000","last_active":"2024-05-08T06:46:32.869474+0000","last_peered":"2024-05-08T06:46:32.869474+0000","last_clean":"2024-05-08T06:46:32.869474+0000","last_became_active":"2024-05-08T06:41:09.573331+0000","last_became_peered":"2024-05-08T06:41:09.573331+0000","last_unstale":"2024-05-08T06:46:32.869474+0000","last_undegraded":"2024-05-08T06:46:32.869474+0000","last_fullsized":"2024-05-08T06:46:32.869474+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:03:14.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869203+0000","last_change":"2024-05-08T06:41:09.582304+0000","last_active":"2024-05-08T06:46:32.869203+0000","last_peered":"2024-05-08T06:46:32.869203+0000","last_clean":"2024-05-08T06:46:32.869203+0000","last_became_active":"2024-05-08T06:41:09.581916+0000","last_became_peered":"2024-05-08T06:41:09.581916+0000","last_unstale":"2024-05-08T06:46:32.869203+0000","last_undegraded":"2024-05-08T06:46:32.869203+0000","last_fullsized":"2024-05-08T06:46:32.869203+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:26.221008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"92'8","reported_seq":27,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771806+0000","last_change":"2024-05-08T06:42:15.863857+0000","last_active":"2024-05-08T06:46:32.771806+0000","last_peered":"2024-05-08T06:46:32.771806+0000","last_clean":"2024-05-08T06:46:32.771806+0000","last_became_active":"2024-05-08T06:42:15.863147+0000","last_became_peered":"2024-05-08T06:42:15.863147+0000","last_unstale":"2024-05-08T06:46:32.771806+0000","last_undegraded":"2024-05-08T06:46:32.771806+0000","last_fullsized":"2024-05-08T06:46:32.771806+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:48:20.951766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"92'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776482+0000","last_change":"2024-05-08T06:41:09.582429+0000","last_active":"2024-05-08T06:46:32.776482+0000","last_peered":"2024-05-08T06:46:32.776482+0000","last_clean":"2024-05-08T06:46:32.776482+0000","last_became_active":"2024-05-08T06:41:09.580152+0000","last_became_peered":"2024-05-08T06:41:09.580152+0000","last_unstale":"2024-05-08T06:46:32.776482+0000","last_undegraded":"2024-05-08T06:46:32.776482+0000","last_fullsized":"2024-05-08T06:46:32.776482+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:58.992177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640667+0000","last_change":"2024-05-08T06:41:09.576432+0000","last_active":"2024-05-08T06:46:32.640667+0000","last_peered":"2024-05-08T06:46:32.640667+0000","last_clean":"2024-05-08T06:46:32.640667+0000","last_became_active":"2024-05-08T06:41:09.575723+0000","last_became_peered":"2024-05-08T06:41:09.575723+0000","last_unstale":"2024-05-08T06:46:32.640667+0000","last_undegraded":"2024-05-08T06:46:32.640667+0000","last_fullsized":"2024-05-08T06:46:32.640667+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:53:51.802944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"92'5","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.188531+0000","last_change":"2024-05-08T06:42:15.856660+0000","last_active":"2024-05-08T06:46:33.188531+0000","last_peered":"2024-05-08T06:46:33.188531+0000","last_clean":"2024-05-08T06:46:33.188531+0000","last_became_active":"2024-05-08T06:42:15.855585+0000","last_became_peered":"2024-05-08T06:42:15.855585+0000","last_unstale":"2024-05-08T06:46:33.188531+0000","last_undegraded":"2024-05-08T06:46:33.188531+0000","last_fullsized":"2024-05-08T06:46:33.188531+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:43.647357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"92'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774638+0000","last_change":"2024-05-08T06:41:09.579941+0000","last_active":"2024-05-08T06:46:32.774638+0000","last_peered":"2024-05-08T06:46:32.774638+0000","last_clean":"2024-05-08T06:46:32.774638+0000","last_became_active":"2024-05-08T06:41:09.578961+0000","last_became_peered":"2024-05-08T06:41:09.578961+0000","last_unstale":"2024-05-08T06:46:32.774638+0000","last_undegraded":"2024-05-08T06:46:32.774638+0000","last_fullsized":"2024-05-08T06:46:32.774638+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:28:59.000080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"92'11","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.874036+0000","last_change":"2024-05-08T06:41:09.580544+0000","last_active":"2024-05-08T06:46:32.874036+0000","last_peered":"2024-05-08T06:46:32.874036+0000","last_clean":"2024-05-08T06:46:32.874036+0000","last_became_active":"2024-05-08T06:41:09.579445+0000","last_became_peered":"2024-05-08T06:41:09.579445+0000","last_unstale":"2024-05-08T06:46:32.874036+0000","last_undegraded":"2024-05-08T06:46:32.874036+0000","last_fullsized":"2024-05-08T06:46:32.874036+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:28.677032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"92'16","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.642138+0000","last_change":"2024-05-08T06:41:09.583133+0000","last_active":"2024-05-08T06:46:32.642138+0000","last_peered":"2024-05-08T06:46:32.642138+0000","last_clean":"2024-05-08T06:46:32.642138+0000","last_became_active":"2024-05-08T06:41:09.582261+0000","last_became_peered":"2024-05-08T06:41:09.582261+0000","last_unstale":"2024-05-08T06:46:32.642138+0000","last_undegraded":"2024-05-08T06:46:32.642138+0000","last_fullsized":"2024-05-08T06:46:32.642138+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:26.131966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"92'6","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.190990+0000","last_change":"2024-05-08T06:41:09.575410+0000","last_active":"2024-05-08T06:46:33.190990+0000","last_peered":"2024-05-08T06:46:33.190990+0000","last_clean":"2024-05-08T06:46:33.190990+0000","last_became_active":"2024-05-08T06:41:09.574936+0000","last_became_peered":"2024-05-08T06:41:09.574936+0000","last_unstale":"2024-05-08T06:46:33.190990+0000","last_undegraded":"2024-05-08T06:46:33.190990+0000","last_fullsized":"2024-05-08T06:46:33.190990+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:21:45.889347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"92'7","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870900+0000","last_change":"2024-05-08T06:41:09.582844+0000","last_active":"2024-05-08T06:46:32.870900+0000","last_peered":"2024-05-08T06:46:32.870900+0000","last_clean":"2024-05-08T06:46:32.870900+0000","last_became_active":"2024-05-08T06:41:09.582497+0000","last_became_peered":"2024-05-08T06:41:09.582497+0000","last_unstale":"2024-05-08T06:46:32.870900+0000","last_undegraded":"2024-05-08T06:46:32.870900+0000","last_fullsized":"2024-05-08T06:46:32.870900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:09:45.168495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.636089+0000","last_change":"2024-05-08T06:41:09.565312+0000","last_active":"2024-05-08T06:46:32.636089+0000","last_peered":"2024-05-08T06:46:32.636089+0000","last_clean":"2024-05-08T06:46:32.636089+0000","last_became_active":"2024-05-08T06:41:09.563425+0000","last_became_peered":"2024-05-08T06:41:09.563425+0000","last_unstale":"2024-05-08T06:46:32.636089+0000","last_undegraded":"2024-05-08T06:46:32.636089+0000","last_fullsized":"2024-05-08T06:46:32.636089+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:08.706504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869147+0000","last_change":"2024-05-08T06:41:09.579395+0000","last_active":"2024-05-08T06:46:32.869147+0000","last_peered":"2024-05-08T06:46:32.869147+0000","last_clean":"2024-05-08T06:46:32.869147+0000","last_became_active":"2024-05-08T06:41:09.575881+0000","last_became_peered":"2024-05-08T06:41:09.575881+0000","last_unstale":"2024-05-08T06:46:32.869147+0000","last_undegraded":"2024-05-08T06:46:32.869147+0000","last_fullsized":"2024-05-08T06:46:32.869147+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:50:37.109480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.868981+0000","last_change":"2024-05-08T06:41:09.589859+0000","last_active":"2024-05-08T06:46:32.868981+0000","last_peered":"2024-05-08T06:46:32.868981+0000","last_clean":"2024-05-08T06:46:32.868981+0000","last_became_active":"2024-05-08T06:41:09.589002+0000","last_became_peered":"2024-05-08T06:41:09.589002+0000","last_unstale":"2024-05-08T06:46:32.868981+0000","last_undegraded":"2024-05-08T06:46:32.868981+0000","last_fullsized":"2024-05-08T06:46:32.868981+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:15:39.022268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870359+0000","last_change":"2024-05-08T06:41:09.566551+0000","last_active":"2024-05-08T06:46:32.870359+0000","last_peered":"2024-05-08T06:46:32.870359+0000","last_clean":"2024-05-08T06:46:32.870359+0000","last_became_active":"2024-05-08T06:41:09.564599+0000","last_became_peered":"2024-05-08T06:41:09.564599+0000","last_unstale":"2024-05-08T06:46:32.870359+0000","last_undegraded":"2024-05-08T06:46:32.870359+0000","last_fullsized":"2024-05-08T06:46:32.870359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:45.573336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871112+0000","last_change":"2024-05-08T06:41:09.582643+0000","last_active":"2024-05-08T06:46:32.871112+0000","last_peered":"2024-05-08T06:46:32.871112+0000","last_clean":"2024-05-08T06:46:32.871112+0000","last_became_active":"2024-05-08T06:41:09.582213+0000","last_became_peered":"2024-05-08T06:41:09.582213+0000","last_unstale":"2024-05-08T06:46:32.871112+0000","last_undegraded":"2024-05-08T06:46:32.871112+0000","last_fullsized":"2024-05-08T06:46:32.871112+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:18.471194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.772987+0000","last_change":"2024-05-08T06:41:09.581447+0000","last_active":"2024-05-08T06:46:32.772987+0000","last_peered":"2024-05-08T06:46:32.772987+0000","last_clean":"2024-05-08T06:46:32.772987+0000","last_became_active":"2024-05-08T06:41:09.581067+0000","last_became_peered":"2024-05-08T06:41:09.581067+0000","last_unstale":"2024-05-08T06:46:32.772987+0000","last_undegraded":"2024-05-08T06:46:32.772987+0000","last_fullsized":"2024-05-08T06:46:32.772987+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:26.967371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"92'7","reported_seq":55,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873978+0000","last_change":"2024-05-08T06:43:16.960640+0000","last_active":"2024-05-08T06:46:32.873978+0000","last_peered":"2024-05-08T06:46:32.873978+0000","last_clean":"2024-05-08T06:46:32.873978+0000","last_became_active":"2024-05-08T06:43:16.959541+0000","last_became_peered":"2024-05-08T06:43:16.959541+0000","last_unstale":"2024-05-08T06:46:32.873978+0000","last_undegraded":"2024-05-08T06:46:32.873978+0000","last_fullsized":"2024-05-08T06:46:32.873978+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:18:42.070321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,6],"acting":[2,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873257+0000","last_change":"2024-05-08T06:41:24.665142+0000","last_active":"2024-05-08T06:46:32.873257+0000","last_peered":"2024-05-08T06:46:32.873257+0000","last_clean":"2024-05-08T06:46:32.873257+0000","last_became_active":"2024-05-08T06:41:24.664431+0000","last_became_peered":"2024-05-08T06:41:24.664431+0000","last_unstale":"2024-05-08T06:46:32.873257+0000","last_undegraded":"2024-05-08T06:46:32.873257+0000","last_fullsized":"2024-05-08T06:46:32.873257+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:11:08.511550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"90'9","reported_seq":58,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.773306+0000","last_change":"2024-05-08T06:41:05.503245+0000","last_active":"2024-05-08T06:46:32.773306+0000","last_peered":"2024-05-08T06:46:32.773306+0000","last_clean":"2024-05-08T06:46:32.773306+0000","last_became_active":"2024-05-08T06:41:05.502561+0000","last_became_peered":"2024-05-08T06:41:05.502561+0000","last_unstale":"2024-05-08T06:46:32.773306+0000","last_undegraded":"2024-05-08T06:46:32.773306+0000","last_fullsized":"2024-05-08T06:46:32.773306+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:06.169830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"92'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774783+0000","last_change":"2024-05-08T06:41:09.579703+0000","last_active":"2024-05-08T06:46:32.774783+0000","last_peered":"2024-05-08T06:46:32.774783+0000","last_clean":"2024-05-08T06:46:32.774783+0000","last_became_active":"2024-05-08T06:41:09.579332+0000","last_became_peered":"2024-05-08T06:41:09.579332+0000","last_unstale":"2024-05-08T06:46:32.774783+0000","last_undegraded":"2024-05-08T06:46:32.774783+0000","last_fullsized":"2024-05-08T06:46:32.774783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:08.616722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870324+0000","last_change":"2024-05-08T06:41:24.666322+0000","last_active":"2024-05-08T06:46:32.870324+0000","last_peered":"2024-05-08T06:46:32.870324+0000","last_clean":"2024-05-08T06:46:32.870324+0000","last_became_active":"2024-05-08T06:41:24.664647+0000","last_became_peered":"2024-05-08T06:41:24.664647+0000","last_unstale":"2024-05-08T06:46:32.870324+0000","last_undegraded":"2024-05-08T06:46:32.870324+0000","last_fullsized":"2024-05-08T06:46:32.870324+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:37:56.967066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"90'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775674+0000","last_change":"2024-05-08T06:41:06.149339+0000","last_active":"2024-05-08T06:46:32.775674+0000","last_peered":"2024-05-08T06:46:32.775674+0000","last_clean":"2024-05-08T06:46:32.775674+0000","last_became_active":"2024-05-08T06:41:06.148846+0000","last_became_peered":"2024-05-08T06:41:06.148846+0000","last_unstale":"2024-05-08T06:46:32.775674+0000","last_undegraded":"2024-05-08T06:46:32.775674+0000","last_fullsized":"2024-05-08T06:46:32.775674+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:43:59.291206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869475+0000","last_change":"2024-05-08T06:41:09.581776+0000","last_active":"2024-05-08T06:46:32.869475+0000","last_peered":"2024-05-08T06:46:32.869475+0000","last_clean":"2024-05-08T06:46:32.869475+0000","last_became_active":"2024-05-08T06:41:09.581409+0000","last_became_peered":"2024-05-08T06:41:09.581409+0000","last_unstale":"2024-05-08T06:46:32.869475+0000","last_undegraded":"2024-05-08T06:46:32.869475+0000","last_fullsized":"2024-05-08T06:46:32.869475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:30.323812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870936+0000","last_change":"2024-05-08T06:42:16.255655+0000","last_active":"2024-05-08T06:46:32.870936+0000","last_peered":"2024-05-08T06:46:32.870936+0000","last_clean":"2024-05-08T06:46:32.870936+0000","last_became_active":"2024-05-08T06:42:16.253722+0000","last_became_peered":"2024-05-08T06:42:16.253722+0000","last_unstale":"2024-05-08T06:46:32.870936+0000","last_undegraded":"2024-05-08T06:46:32.870936+0000","last_fullsized":"2024-05-08T06:46:32.870936+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:58.492286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"90'4","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777779+0000","last_change":"2024-05-08T06:41:05.509738+0000","last_active":"2024-05-08T06:46:32.777779+0000","last_peered":"2024-05-08T06:46:32.777779+0000","last_clean":"2024-05-08T06:46:32.777779+0000","last_became_active":"2024-05-08T06:41:05.509198+0000","last_became_peered":"2024-05-08T06:41:05.509198+0000","last_unstale":"2024-05-08T06:46:32.777779+0000","last_undegraded":"2024-05-08T06:46:32.777779+0000","last_fullsized":"2024-05-08T06:46:32.777779+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:24:51.350637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873224+0000","last_change":"2024-05-08T06:41:09.572288+0000","last_active":"2024-05-08T06:46:32.873224+0000","last_peered":"2024-05-08T06:46:32.873224+0000","last_clean":"2024-05-08T06:46:32.873224+0000","last_became_active":"2024-05-08T06:41:09.571951+0000","last_became_peered":"2024-05-08T06:41:09.571951+0000","last_unstale":"2024-05-08T06:46:32.873224+0000","last_undegraded":"2024-05-08T06:46:32.873224+0000","last_fullsized":"2024-05-08T06:46:32.873224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:45.687494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870906+0000","last_change":"2024-05-08T06:41:24.663289+0000","last_active":"2024-05-08T06:46:32.870906+0000","last_peered":"2024-05-08T06:46:32.870906+0000","last_clean":"2024-05-08T06:46:32.870906+0000","last_became_active":"2024-05-08T06:41:24.662899+0000","last_became_peered":"2024-05-08T06:41:24.662899+0000","last_unstale":"2024-05-08T06:46:32.870906+0000","last_undegraded":"2024-05-08T06:46:32.870906+0000","last_fullsized":"2024-05-08T06:46:32.870906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:12:15.024693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777208+0000","last_change":"2024-05-08T06:41:05.505412+0000","last_active":"2024-05-08T06:46:32.777208+0000","last_peered":"2024-05-08T06:46:32.777208+0000","last_clean":"2024-05-08T06:46:32.777208+0000","last_became_active":"2024-05-08T06:41:05.505023+0000","last_became_peered":"2024-05-08T06:41:05.505023+0000","last_unstale":"2024-05-08T06:46:32.777208+0000","last_undegraded":"2024-05-08T06:46:32.777208+0000","last_fullsized":"2024-05-08T06:46:32.777208+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:50.403045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"92'15","reported_seq":56,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641782+0000","last_change":"2024-05-08T06:41:09.571080+0000","last_active":"2024-05-08T06:46:32.641782+0000","last_peered":"2024-05-08T06:46:32.641782+0000","last_clean":"2024-05-08T06:46:32.641782+0000","last_became_active":"2024-05-08T06:41:09.570755+0000","last_became_peered":"2024-05-08T06:41:09.570755+0000","last_unstale":"2024-05-08T06:46:32.641782+0000","last_undegraded":"2024-05-08T06:46:32.641782+0000","last_fullsized":"2024-05-08T06:46:32.641782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:38:53.747109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.874496+0000","last_change":"2024-05-08T06:41:24.660091+0000","last_active":"2024-05-08T06:46:32.874496+0000","last_peered":"2024-05-08T06:46:32.874496+0000","last_clean":"2024-05-08T06:46:32.874496+0000","last_became_active":"2024-05-08T06:41:24.659512+0000","last_became_peered":"2024-05-08T06:41:24.659512+0000","last_unstale":"2024-05-08T06:46:32.874496+0000","last_undegraded":"2024-05-08T06:46:32.874496+0000","last_fullsized":"2024-05-08T06:46:32.874496+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:07:56.007688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"93'9","reported_seq":300,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:41.983316+0000","last_change":"2024-05-08T06:41:05.500625+0000","last_active":"2024-05-08T06:46:41.983316+0000","last_peered":"2024-05-08T06:46:41.983316+0000","last_clean":"2024-05-08T06:46:41.983316+0000","last_became_active":"2024-05-08T06:41:05.500079+0000","last_became_peered":"2024-05-08T06:41:05.500079+0000","last_unstale":"2024-05-08T06:46:41.983316+0000","last_undegraded":"2024-05-08T06:46:41.983316+0000","last_fullsized":"2024-05-08T06:46:41.983316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:28:32.143944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2288,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":244,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776525+0000","last_change":"2024-05-08T06:41:09.569045+0000","last_active":"2024-05-08T06:46:32.776525+0000","last_peered":"2024-05-08T06:46:32.776525+0000","last_clean":"2024-05-08T06:46:32.776525+0000","last_became_active":"2024-05-08T06:41:09.560040+0000","last_became_peered":"2024-05-08T06:41:09.560040+0000","last_unstale":"2024-05-08T06:46:32.776525+0000","last_undegraded":"2024-05-08T06:46:32.776525+0000","last_fullsized":"2024-05-08T06:46:32.776525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:58:52.284829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873342+0000","last_change":"2024-05-08T06:42:15.856574+0000","last_active":"2024-05-08T06:46:32.873342+0000","last_peered":"2024-05-08T06:46:32.873342+0000","last_clean":"2024-05-08T06:46:32.873342+0000","last_became_active":"2024-05-08T06:42:15.855459+0000","last_became_peered":"2024-05-08T06:42:15.855459+0000","last_unstale":"2024-05-08T06:46:32.873342+0000","last_undegraded":"2024-05-08T06:46:32.873342+0000","last_fullsized":"2024-05-08T06:46:32.873342+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:23:12.919403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"90'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640576+0000","last_change":"2024-05-08T06:41:05.505685+0000","last_active":"2024-05-08T06:46:32.640576+0000","last_peered":"2024-05-08T06:46:32.640576+0000","last_clean":"2024-05-08T06:46:32.640576+0000","last_became_active":"2024-05-08T06:41:05.505136+0000","last_became_peered":"2024-05-08T06:41:05.505136+0000","last_unstale":"2024-05-08T06:46:32.640576+0000","last_undegraded":"2024-05-08T06:46:32.640576+0000","last_fullsized":"2024-05-08T06:46:32.640576+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:44:59.968405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641045+0000","last_change":"2024-05-08T06:41:09.581340+0000","last_active":"2024-05-08T06:46:32.641045+0000","last_peered":"2024-05-08T06:46:32.641045+0000","last_clean":"2024-05-08T06:46:32.641045+0000","last_became_active":"2024-05-08T06:41:09.580969+0000","last_became_peered":"2024-05-08T06:41:09.580969+0000","last_unstale":"2024-05-08T06:46:32.641045+0000","last_undegraded":"2024-05-08T06:46:32.641045+0000","last_fullsized":"2024-05-08T06:46:32.641045+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:14.365972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870893+0000","last_change":"2024-05-08T06:41:24.675576+0000","last_active":"2024-05-08T06:46:32.870893+0000","last_peered":"2024-05-08T06:46:32.870893+0000","last_clean":"2024-05-08T06:46:32.870893+0000","last_became_active":"2024-05-08T06:41:24.675044+0000","last_became_peered":"2024-05-08T06:41:24.675044+0000","last_unstale":"2024-05-08T06:46:32.870893+0000","last_undegraded":"2024-05-08T06:46:32.870893+0000","last_fullsized":"2024-05-08T06:46:32.870893+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:16:59.529334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.633995+0000","last_change":"2024-05-08T06:41:05.493094+0000","last_active":"2024-05-08T06:46:32.633995+0000","last_peered":"2024-05-08T06:46:32.633995+0000","last_clean":"2024-05-08T06:46:32.633995+0000","last_became_active":"2024-05-08T06:41:05.491206+0000","last_became_peered":"2024-05-08T06:41:05.491206+0000","last_unstale":"2024-05-08T06:46:32.633995+0000","last_undegraded":"2024-05-08T06:46:32.633995+0000","last_fullsized":"2024-05-08T06:46:32.633995+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:03.689282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774759+0000","last_change":"2024-05-08T06:41:09.570646+0000","last_active":"2024-05-08T06:46:32.774759+0000","last_peered":"2024-05-08T06:46:32.774759+0000","last_clean":"2024-05-08T06:46:32.774759+0000","last_became_active":"2024-05-08T06:41:09.569500+0000","last_became_peered":"2024-05-08T06:41:09.569500+0000","last_unstale":"2024-05-08T06:46:32.774759+0000","last_undegraded":"2024-05-08T06:46:32.774759+0000","last_fullsized":"2024-05-08T06:46:32.774759+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:25:08.453510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869878+0000","last_change":"2024-05-08T06:41:24.672021+0000","last_active":"2024-05-08T06:46:32.869878+0000","last_peered":"2024-05-08T06:46:32.869878+0000","last_clean":"2024-05-08T06:46:32.869878+0000","last_became_active":"2024-05-08T06:41:24.671583+0000","last_became_peered":"2024-05-08T06:41:24.671583+0000","last_unstale":"2024-05-08T06:46:32.869878+0000","last_undegraded":"2024-05-08T06:46:32.869878+0000","last_fullsized":"2024-05-08T06:46:32.869878+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:18:33.850855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"90'1","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640529+0000","last_change":"2024-05-08T06:41:05.501501+0000","last_active":"2024-05-08T06:46:32.640529+0000","last_peered":"2024-05-08T06:46:32.640529+0000","last_clean":"2024-05-08T06:46:32.640529+0000","last_became_active":"2024-05-08T06:41:05.501001+0000","last_became_peered":"2024-05-08T06:41:05.501001+0000","last_unstale":"2024-05-08T06:46:32.640529+0000","last_undegraded":"2024-05-08T06:46:32.640529+0000","last_fullsized":"2024-05-08T06:46:32.640529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:15:18.984981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"92'11","reported_seq":59,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771336+0000","last_change":"2024-05-08T06:42:15.859096+0000","last_active":"2024-05-08T06:46:32.771336+0000","last_peered":"2024-05-08T06:46:32.771336+0000","last_clean":"2024-05-08T06:46:32.771336+0000","last_became_active":"2024-05-08T06:42:15.858508+0000","last_became_peered":"2024-05-08T06:42:15.858508+0000","last_unstale":"2024-05-08T06:46:32.771336+0000","last_undegraded":"2024-05-08T06:46:32.771336+0000","last_fullsized":"2024-05-08T06:46:32.771336+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:24.351596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,10],"acting":[9,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774755+0000","last_change":"2024-05-08T06:41:24.670832+0000","last_active":"2024-05-08T06:46:32.774755+0000","last_peered":"2024-05-08T06:46:32.774755+0000","last_clean":"2024-05-08T06:46:32.774755+0000","last_became_active":"2024-05-08T06:41:24.668155+0000","last_became_peered":"2024-05-08T06:41:24.668155+0000","last_unstale":"2024-05-08T06:46:32.774755+0000","last_undegraded":"2024-05-08T06:46:32.774755+0000","last_fullsized":"2024-05-08T06:46:32.774755+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:46:11.460490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"92'4","reported_seq":291,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:41.982353+0000","last_change":"2024-05-08T06:41:05.494999+0000","last_active":"2024-05-08T06:46:41.982353+0000","last_peered":"2024-05-08T06:46:41.982353+0000","last_clean":"2024-05-08T06:46:41.982353+0000","last_became_active":"2024-05-08T06:41:05.494487+0000","last_became_peered":"2024-05-08T06:41:05.494487+0000","last_unstale":"2024-05-08T06:46:41.982353+0000","last_undegraded":"2024-05-08T06:46:41.982353+0000","last_fullsized":"2024-05-08T06:46:41.982353+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:59.282625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873850+0000","last_change":"2024-05-08T06:41:09.570607+0000","last_active":"2024-05-08T06:46:32.873850+0000","last_peered":"2024-05-08T06:46:32.873850+0000","last_clean":"2024-05-08T06:46:32.873850+0000","last_became_active":"2024-05-08T06:41:09.570047+0000","last_became_peered":"2024-05-08T06:41:09.570047+0000","last_unstale":"2024-05-08T06:46:32.873850+0000","last_undegraded":"2024-05-08T06:46:32.873850+0000","last_fullsized":"2024-05-08T06:46:32.873850+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:51.222830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771285+0000","last_change":"2024-05-08T06:41:24.677365+0000","last_active":"2024-05-08T06:46:32.771285+0000","last_peered":"2024-05-08T06:46:32.771285+0000","last_clean":"2024-05-08T06:46:32.771285+0000","last_became_active":"2024-05-08T06:41:24.673986+0000","last_became_peered":"2024-05-08T06:41:24.673986+0000","last_unstale":"2024-05-08T06:46:32.771285+0000","last_undegraded":"2024-05-08T06:46:32.771285+0000","last_fullsized":"2024-05-08T06:46:32.771285+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:07.013637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.191025+0000","last_change":"2024-05-08T06:41:05.499624+0000","last_active":"2024-05-08T06:46:33.191025+0000","last_peered":"2024-05-08T06:46:33.191025+0000","last_clean":"2024-05-08T06:46:33.191025+0000","last_became_active":"2024-05-08T06:41:05.498875+0000","last_became_peered":"2024-05-08T06:41:05.498875+0000","last_unstale":"2024-05-08T06:46:33.191025+0000","last_undegraded":"2024-05-08T06:46:33.191025+0000","last_fullsized":"2024-05-08T06:46:33.191025+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:46:11.270399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"92'9","reported_seq":56,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869545+0000","last_change":"2024-05-08T06:42:15.853569+0000","last_active":"2024-05-08T06:46:32.869545+0000","last_peered":"2024-05-08T06:46:32.869545+0000","last_clean":"2024-05-08T06:46:32.869545+0000","last_became_active":"2024-05-08T06:42:15.852223+0000","last_became_peered":"2024-05-08T06:42:15.852223+0000","last_unstale":"2024-05-08T06:46:32.869545+0000","last_undegraded":"2024-05-08T06:46:32.869545+0000","last_fullsized":"2024-05-08T06:46:32.869545+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:06:56.970134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871281+0000","last_change":"2024-05-08T06:41:24.671807+0000","last_active":"2024-05-08T06:46:32.871281+0000","last_peered":"2024-05-08T06:46:32.871281+0000","last_clean":"2024-05-08T06:46:32.871281+0000","last_became_active":"2024-05-08T06:41:24.670937+0000","last_became_peered":"2024-05-08T06:41:24.670937+0000","last_unstale":"2024-05-08T06:46:32.871281+0000","last_undegraded":"2024-05-08T06:46:32.871281+0000","last_fullsized":"2024-05-08T06:46:32.871281+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:52.844916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"90'4","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640564+0000","last_change":"2024-05-08T06:41:06.147901+0000","last_active":"2024-05-08T06:46:32.640564+0000","last_peered":"2024-05-08T06:46:32.640564+0000","last_clean":"2024-05-08T06:46:32.640564+0000","last_became_active":"2024-05-08T06:41:06.146983+0000","last_became_peered":"2024-05-08T06:41:06.146983+0000","last_unstale":"2024-05-08T06:46:32.640564+0000","last_undegraded":"2024-05-08T06:46:32.640564+0000","last_fullsized":"2024-05-08T06:46:32.640564+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:54.638290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"92'11","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873492+0000","last_change":"2024-05-08T06:41:09.586695+0000","last_active":"2024-05-08T06:46:32.873492+0000","last_peered":"2024-05-08T06:46:32.873492+0000","last_clean":"2024-05-08T06:46:32.873492+0000","last_became_active":"2024-05-08T06:41:09.586288+0000","last_became_peered":"2024-05-08T06:41:09.586288+0000","last_unstale":"2024-05-08T06:46:32.873492+0000","last_undegraded":"2024-05-08T06:46:32.873492+0000","last_fullsized":"2024-05-08T06:46:32.873492+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:26:18.383524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771448+0000","last_change":"2024-05-08T06:41:24.671523+0000","last_active":"2024-05-08T06:46:32.771448+0000","last_peered":"2024-05-08T06:46:32.771448+0000","last_clean":"2024-05-08T06:46:32.771448+0000","last_became_active":"2024-05-08T06:41:24.670307+0000","last_became_peered":"2024-05-08T06:41:24.670307+0000","last_unstale":"2024-05-08T06:46:32.771448+0000","last_undegraded":"2024-05-08T06:46:32.771448+0000","last_fullsized":"2024-05-08T06:46:32.771448+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.034208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"93'44","reported_seq":585,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:42.984383+0000","last_change":"2024-05-08T06:41:05.504643+0000","last_active":"2024-05-08T06:46:42.984383+0000","last_peered":"2024-05-08T06:46:42.984383+0000","last_clean":"2024-05-08T06:46:42.984383+0000","last_became_active":"2024-05-08T06:41:05.504011+0000","last_became_peered":"2024-05-08T06:41:05.504011+0000","last_unstale":"2024-05-08T06:46:42.984383+0000","last_undegraded":"2024-05-08T06:46:42.984383+0000","last_fullsized":"2024-05-08T06:46:42.984383+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:12:47.262643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76979,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":494,"num_read_kb":324,"num_write":45,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777257+0000","last_change":"2024-05-08T06:41:09.580532+0000","last_active":"2024-05-08T06:46:32.777257+0000","last_peered":"2024-05-08T06:46:32.777257+0000","last_clean":"2024-05-08T06:46:32.777257+0000","last_became_active":"2024-05-08T06:41:09.575396+0000","last_became_peered":"2024-05-08T06:41:09.575396+0000","last_unstale":"2024-05-08T06:46:32.777257+0000","last_undegraded":"2024-05-08T06:46:32.777257+0000","last_fullsized":"2024-05-08T06:46:32.777257+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:29.197093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.642476+0000","last_change":"2024-05-08T06:41:24.660200+0000","last_active":"2024-05-08T06:46:32.642476+0000","last_peered":"2024-05-08T06:46:32.642476+0000","last_clean":"2024-05-08T06:46:32.642476+0000","last_became_active":"2024-05-08T06:41:24.659674+0000","last_became_peered":"2024-05-08T06:41:24.659674+0000","last_unstale":"2024-05-08T06:46:32.642476+0000","last_undegraded":"2024-05-08T06:46:32.642476+0000","last_fullsized":"2024-05-08T06:46:32.642476+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:51.023256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"90'6","reported_seq":55,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873925+0000","last_change":"2024-05-08T06:41:05.500899+0000","last_active":"2024-05-08T06:46:32.873925+0000","last_peered":"2024-05-08T06:46:32.873925+0000","last_clean":"2024-05-08T06:46:32.873925+0000","last_became_active":"2024-05-08T06:41:05.500437+0000","last_became_peered":"2024-05-08T06:41:05.500437+0000","last_unstale":"2024-05-08T06:46:32.873925+0000","last_undegraded":"2024-05-08T06:46:32.873925+0000","last_fullsized":"2024-05-08T06:46:32.873925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:38.222631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634212+0000","last_change":"2024-05-08T06:41:09.574273+0000","last_active":"2024-05-08T06:46:32.634212+0000","last_peered":"2024-05-08T06:46:32.634212+0000","last_clean":"2024-05-08T06:46:32.634212+0000","last_became_active":"2024-05-08T06:41:09.573902+0000","last_became_peered":"2024-05-08T06:41:09.573902+0000","last_unstale":"2024-05-08T06:46:32.634212+0000","last_undegraded":"2024-05-08T06:46:32.634212+0000","last_fullsized":"2024-05-08T06:46:32.634212+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:39:12.749290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870744+0000","last_change":"2024-05-08T06:41:24.674360+0000","last_active":"2024-05-08T06:46:32.870744+0000","last_peered":"2024-05-08T06:46:32.870744+0000","last_clean":"2024-05-08T06:46:32.870744+0000","last_became_active":"2024-05-08T06:41:24.673938+0000","last_became_peered":"2024-05-08T06:41:24.673938+0000","last_unstale":"2024-05-08T06:46:32.870744+0000","last_undegraded":"2024-05-08T06:46:32.870744+0000","last_fullsized":"2024-05-08T06:46:32.870744+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:13:36.735220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"90'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641651+0000","last_change":"2024-05-08T06:41:05.504335+0000","last_active":"2024-05-08T06:46:32.641651+0000","last_peered":"2024-05-08T06:46:32.641651+0000","last_clean":"2024-05-08T06:46:32.641651+0000","last_became_active":"2024-05-08T06:41:05.503981+0000","last_became_peered":"2024-05-08T06:41:05.503981+0000","last_unstale":"2024-05-08T06:46:32.641651+0000","last_undegraded":"2024-05-08T06:46:32.641651+0000","last_fullsized":"2024-05-08T06:46:32.641651+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:45:35.813245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"92'15","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.189297+0000","last_change":"2024-05-08T06:41:09.580852+0000","last_active":"2024-05-08T06:46:33.189297+0000","last_peered":"2024-05-08T06:46:33.189297+0000","last_clean":"2024-05-08T06:46:33.189297+0000","last_became_active":"2024-05-08T06:41:09.580375+0000","last_became_peered":"2024-05-08T06:41:09.580375+0000","last_unstale":"2024-05-08T06:46:33.189297+0000","last_undegraded":"2024-05-08T06:46:33.189297+0000","last_fullsized":"2024-05-08T06:46:33.189297+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:21:06.695878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.773002+0000","last_change":"2024-05-08T06:41:24.678268+0000","last_active":"2024-05-08T06:46:32.773002+0000","last_peered":"2024-05-08T06:46:32.773002+0000","last_clean":"2024-05-08T06:46:32.773002+0000","last_became_active":"2024-05-08T06:41:24.677804+0000","last_became_peered":"2024-05-08T06:41:24.677804+0000","last_unstale":"2024-05-08T06:46:32.773002+0000","last_undegraded":"2024-05-08T06:46:32.773002+0000","last_fullsized":"2024-05-08T06:46:32.773002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:10:03.082661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'6","reported_seq":299,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:42.001916+0000","last_change":"2024-05-08T06:41:05.498143+0000","last_active":"2024-05-08T06:46:42.001916+0000","last_peered":"2024-05-08T06:46:42.001916+0000","last_clean":"2024-05-08T06:46:42.001916+0000","last_became_active":"2024-05-08T06:41:05.497707+0000","last_became_peered":"2024-05-08T06:41:05.497707+0000","last_unstale":"2024-05-08T06:46:42.001916+0000","last_undegraded":"2024-05-08T06:46:42.001916+0000","last_fullsized":"2024-05-08T06:46:42.001916+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:28:20.556535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":246,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"92'6","reported_seq":54,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.188009+0000","last_change":"2024-05-08T06:43:17.135955+0000","last_active":"2024-05-08T06:46:33.188009+0000","last_peered":"2024-05-08T06:46:33.188009+0000","last_clean":"2024-05-08T06:46:33.188009+0000","last_became_active":"2024-05-08T06:43:17.134734+0000","last_became_peered":"2024-05-08T06:43:17.134734+0000","last_unstale":"2024-05-08T06:46:33.188009+0000","last_undegraded":"2024-05-08T06:46:33.188009+0000","last_fullsized":"2024-05-08T06:46:33.188009+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:33:53.573382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634950+0000","last_change":"2024-05-08T06:41:24.663938+0000","last_active":"2024-05-08T06:46:32.634950+0000","last_peered":"2024-05-08T06:46:32.634950+0000","last_clean":"2024-05-08T06:46:32.634950+0000","last_became_active":"2024-05-08T06:41:24.661679+0000","last_became_peered":"2024-05-08T06:41:24.661679+0000","last_unstale":"2024-05-08T06:46:32.634950+0000","last_undegraded":"2024-05-08T06:46:32.634950+0000","last_fullsized":"2024-05-08T06:46:32.634950+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:21.590681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"90'15","reported_seq":63,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775931+0000","last_change":"2024-05-08T06:41:06.151458+0000","last_active":"2024-05-08T06:46:32.775931+0000","last_peered":"2024-05-08T06:46:32.775931+0000","last_clean":"2024-05-08T06:46:32.775931+0000","last_became_active":"2024-05-08T06:41:06.146564+0000","last_became_peered":"2024-05-08T06:41:06.146564+0000","last_unstale":"2024-05-08T06:46:32.775931+0000","last_undegraded":"2024-05-08T06:46:32.775931+0000","last_fullsized":"2024-05-08T06:46:32.775931+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:28:36.704804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640550+0000","last_change":"2024-05-08T06:41:09.576666+0000","last_active":"2024-05-08T06:46:32.640550+0000","last_peered":"2024-05-08T06:46:32.640550+0000","last_clean":"2024-05-08T06:46:32.640550+0000","last_became_active":"2024-05-08T06:41:09.576062+0000","last_became_peered":"2024-05-08T06:41:09.576062+0000","last_unstale":"2024-05-08T06:46:32.640550+0000","last_undegraded":"2024-05-08T06:46:32.640550+0000","last_fullsized":"2024-05-08T06:46:32.640550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:01:21.309488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640429+0000","last_change":"2024-05-08T06:42:16.255227+0000","last_active":"2024-05-08T06:46:32.640429+0000","last_peered":"2024-05-08T06:46:32.640429+0000","last_clean":"2024-05-08T06:46:32.640429+0000","last_became_active":"2024-05-08T06:42:16.253021+0000","last_became_peered":"2024-05-08T06:42:16.253021+0000","last_unstale":"2024-05-08T06:46:32.640429+0000","last_undegraded":"2024-05-08T06:46:32.640429+0000","last_fullsized":"2024-05-08T06:46:32.640429+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:29:41.833171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0,3,1],"acting":[10,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.f","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777572+0000","last_change":"2024-05-08T06:41:05.506830+0000","last_active":"2024-05-08T06:46:32.777572+0000","last_peered":"2024-05-08T06:46:32.777572+0000","last_clean":"2024-05-08T06:46:32.777572+0000","last_became_active":"2024-05-08T06:41:05.505402+0000","last_became_peered":"2024-05-08T06:41:05.505402+0000","last_unstale":"2024-05-08T06:46:32.777572+0000","last_undegraded":"2024-05-08T06:46:32.777572+0000","last_fullsized":"2024-05-08T06:46:32.777572+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:26.804268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"92'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870941+0000","last_change":"2024-05-08T06:41:09.586937+0000","last_active":"2024-05-08T06:46:32.870941+0000","last_peered":"2024-05-08T06:46:32.870941+0000","last_clean":"2024-05-08T06:46:32.870941+0000","last_became_active":"2024-05-08T06:41:09.586443+0000","last_became_peered":"2024-05-08T06:41:09.586443+0000","last_unstale":"2024-05-08T06:46:32.870941+0000","last_undegraded":"2024-05-08T06:46:32.870941+0000","last_fullsized":"2024-05-08T06:46:32.870941+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:49.004676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":39,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776215+0000","last_change":"2024-05-08T06:42:16.042874+0000","last_active":"2024-05-08T06:46:32.776215+0000","last_peered":"2024-05-08T06:46:32.776215+0000","last_clean":"2024-05-08T06:46:32.776215+0000","last_became_active":"2024-05-08T06:42:16.041424+0000","last_became_peered":"2024-05-08T06:42:16.041424+0000","last_unstale":"2024-05-08T06:46:32.776215+0000","last_undegraded":"2024-05-08T06:46:32.776215+0000","last_fullsized":"2024-05-08T06:46:32.776215+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:29:47.162238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.771752+0000","last_change":"2024-05-08T06:41:06.146631+0000","last_active":"2024-05-08T06:46:32.771752+0000","last_peered":"2024-05-08T06:46:32.771752+0000","last_clean":"2024-05-08T06:46:32.771752+0000","last_became_active":"2024-05-08T06:41:06.145876+0000","last_became_peered":"2024-05-08T06:41:06.145876+0000","last_unstale":"2024-05-08T06:46:32.771752+0000","last_undegraded":"2024-05-08T06:46:32.771752+0000","last_fullsized":"2024-05-08T06:46:32.771752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:46.283923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"92'4","reported_seq":45,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641370+0000","last_change":"2024-05-08T06:41:09.571084+0000","last_active":"2024-05-08T06:46:32.641370+0000","last_peered":"2024-05-08T06:46:32.641370+0000","last_clean":"2024-05-08T06:46:32.641370+0000","last_became_active":"2024-05-08T06:41:09.570685+0000","last_became_peered":"2024-05-08T06:41:09.570685+0000","last_unstale":"2024-05-08T06:46:32.641370+0000","last_undegraded":"2024-05-08T06:46:32.641370+0000","last_fullsized":"2024-05-08T06:46:32.641370+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:02:21.748502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634478+0000","last_change":"2024-05-08T06:41:24.667348+0000","last_active":"2024-05-08T06:46:32.634478+0000","last_peered":"2024-05-08T06:46:32.634478+0000","last_clean":"2024-05-08T06:46:32.634478+0000","last_became_active":"2024-05-08T06:41:24.662570+0000","last_became_peered":"2024-05-08T06:41:24.662570+0000","last_unstale":"2024-05-08T06:46:32.634478+0000","last_undegraded":"2024-05-08T06:46:32.634478+0000","last_fullsized":"2024-05-08T06:46:32.634478+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:13:05.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"90'1","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187375+0000","last_change":"2024-05-08T06:41:05.501884+0000","last_active":"2024-05-08T06:46:33.187375+0000","last_peered":"2024-05-08T06:46:33.187375+0000","last_clean":"2024-05-08T06:46:33.187375+0000","last_became_active":"2024-05-08T06:41:05.498866+0000","last_became_peered":"2024-05-08T06:41:05.498866+0000","last_unstale":"2024-05-08T06:46:33.187375+0000","last_undegraded":"2024-05-08T06:46:33.187375+0000","last_fullsized":"2024-05-08T06:46:33.187375+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:50.560695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640953+0000","last_change":"2024-05-08T06:41:09.582601+0000","last_active":"2024-05-08T06:46:32.640953+0000","last_peered":"2024-05-08T06:46:32.640953+0000","last_clean":"2024-05-08T06:46:32.640953+0000","last_became_active":"2024-05-08T06:41:09.582205+0000","last_became_peered":"2024-05-08T06:41:09.582205+0000","last_unstale":"2024-05-08T06:46:32.640953+0000","last_undegraded":"2024-05-08T06:46:32.640953+0000","last_fullsized":"2024-05-08T06:46:32.640953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:43:29.594001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634966+0000","last_change":"2024-05-08T06:41:24.659339+0000","last_active":"2024-05-08T06:46:32.634966+0000","last_peered":"2024-05-08T06:46:32.634966+0000","last_clean":"2024-05-08T06:46:32.634966+0000","last_became_active":"2024-05-08T06:41:24.658879+0000","last_became_peered":"2024-05-08T06:41:24.658879+0000","last_unstale":"2024-05-08T06:46:32.634966+0000","last_undegraded":"2024-05-08T06:46:32.634966+0000","last_fullsized":"2024-05-08T06:46:32.634966+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:59.257118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"92'8","reported_seq":55,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641550+0000","last_change":"2024-05-08T06:42:15.850510+0000","last_active":"2024-05-08T06:46:32.641550+0000","last_peered":"2024-05-08T06:46:32.641550+0000","last_clean":"2024-05-08T06:46:32.641550+0000","last_became_active":"2024-05-08T06:42:15.849158+0000","last_became_peered":"2024-05-08T06:42:15.849158+0000","last_unstale":"2024-05-08T06:46:32.641550+0000","last_undegraded":"2024-05-08T06:46:32.641550+0000","last_fullsized":"2024-05-08T06:46:32.641550+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:14.687642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"92'6","reported_seq":294,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:42.000333+0000","last_change":"2024-05-08T06:41:06.148436+0000","last_active":"2024-05-08T06:46:42.000333+0000","last_peered":"2024-05-08T06:46:42.000333+0000","last_clean":"2024-05-08T06:46:42.000333+0000","last_became_active":"2024-05-08T06:41:06.147690+0000","last_became_peered":"2024-05-08T06:41:06.147690+0000","last_unstale":"2024-05-08T06:46:42.000333+0000","last_undegraded":"2024-05-08T06:46:42.000333+0000","last_fullsized":"2024-05-08T06:46:42.000333+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:49.925872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"90'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.190534+0000","last_change":"2024-05-08T06:41:24.667958+0000","last_active":"2024-05-08T06:46:33.190534+0000","last_peered":"2024-05-08T06:46:33.190534+0000","last_clean":"2024-05-08T06:46:33.190534+0000","last_became_active":"2024-05-08T06:41:24.666181+0000","last_became_peered":"2024-05-08T06:41:24.666181+0000","last_unstale":"2024-05-08T06:46:33.190534+0000","last_undegraded":"2024-05-08T06:46:33.190534+0000","last_fullsized":"2024-05-08T06:46:33.190534+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:52:08.413670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775164+0000","last_change":"2024-05-08T06:41:09.581353+0000","last_active":"2024-05-08T06:46:32.775164+0000","last_peered":"2024-05-08T06:46:32.775164+0000","last_clean":"2024-05-08T06:46:32.775164+0000","last_became_active":"2024-05-08T06:41:09.580630+0000","last_became_peered":"2024-05-08T06:41:09.580630+0000","last_unstale":"2024-05-08T06:46:32.775164+0000","last_undegraded":"2024-05-08T06:46:32.775164+0000","last_fullsized":"2024-05-08T06:46:32.775164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:46:07.041564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"90'3","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870857+0000","last_change":"2024-05-08T06:41:05.494128+0000","last_active":"2024-05-08T06:46:32.870857+0000","last_peered":"2024-05-08T06:46:32.870857+0000","last_clean":"2024-05-08T06:46:32.870857+0000","last_became_active":"2024-05-08T06:41:05.493473+0000","last_became_peered":"2024-05-08T06:41:05.493473+0000","last_unstale":"2024-05-08T06:46:32.870857+0000","last_undegraded":"2024-05-08T06:46:32.870857+0000","last_fullsized":"2024-05-08T06:46:32.870857+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:01:51.061204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"93'99","reported_seq":149,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:34.810833+0000","last_change":"2024-05-08T06:39:12.054195+0000","last_active":"2024-05-08T06:46:34.810833+0000","last_peered":"2024-05-08T06:46:34.810833+0000","last_clean":"2024-05-08T06:46:34.810833+0000","last_became_active":"2024-05-08T06:39:12.045198+0000","last_became_peered":"2024-05-08T06:39:12.045198+0000","last_unstale":"2024-05-08T06:46:34.810833+0000","last_undegraded":"2024-05-08T06:46:34.810833+0000","last_fullsized":"2024-05-08T06:46:34.810833+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:34:30.391671+0000","last_clean_scrub_stamp":"2024-05-08T06:34:30.391671+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:32:48.631167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.641955+0000","last_change":"2024-05-08T06:41:24.663009+0000","last_active":"2024-05-08T06:46:32.641955+0000","last_peered":"2024-05-08T06:46:32.641955+0000","last_clean":"2024-05-08T06:46:32.641955+0000","last_became_active":"2024-05-08T06:41:24.662552+0000","last_became_peered":"2024-05-08T06:41:24.662552+0000","last_unstale":"2024-05-08T06:46:32.641955+0000","last_undegraded":"2024-05-08T06:46:32.641955+0000","last_fullsized":"2024-05-08T06:46:32.641955+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:57:12.768293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"92'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.633883+0000","last_change":"2024-05-08T06:41:09.576425+0000","last_active":"2024-05-08T06:46:32.633883+0000","last_peered":"2024-05-08T06:46:32.633883+0000","last_clean":"2024-05-08T06:46:32.633883+0000","last_became_active":"2024-05-08T06:41:09.576094+0000","last_became_peered":"2024-05-08T06:41:09.576094+0000","last_unstale":"2024-05-08T06:46:32.633883+0000","last_undegraded":"2024-05-08T06:46:32.633883+0000","last_fullsized":"2024-05-08T06:46:32.633883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:16:40.682429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"90'3","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187874+0000","last_change":"2024-05-08T06:41:05.505778+0000","last_active":"2024-05-08T06:46:33.187874+0000","last_peered":"2024-05-08T06:46:33.187874+0000","last_clean":"2024-05-08T06:46:33.187874+0000","last_became_active":"2024-05-08T06:41:05.505400+0000","last_became_peered":"2024-05-08T06:41:05.505400+0000","last_unstale":"2024-05-08T06:46:33.187874+0000","last_undegraded":"2024-05-08T06:46:33.187874+0000","last_fullsized":"2024-05-08T06:46:33.187874+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:11:34.887026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870982+0000","last_change":"2024-05-08T06:41:24.671768+0000","last_active":"2024-05-08T06:46:32.870982+0000","last_peered":"2024-05-08T06:46:32.870982+0000","last_clean":"2024-05-08T06:46:32.870982+0000","last_became_active":"2024-05-08T06:41:24.671250+0000","last_became_peered":"2024-05-08T06:41:24.671250+0000","last_unstale":"2024-05-08T06:46:32.870982+0000","last_undegraded":"2024-05-08T06:46:32.870982+0000","last_fullsized":"2024-05-08T06:46:32.870982+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:56:44.302049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"90'1","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.777368+0000","last_change":"2024-05-08T06:41:06.151820+0000","last_active":"2024-05-08T06:46:32.777368+0000","last_peered":"2024-05-08T06:46:32.777368+0000","last_clean":"2024-05-08T06:46:32.777368+0000","last_became_active":"2024-05-08T06:41:06.149976+0000","last_became_peered":"2024-05-08T06:41:06.149976+0000","last_unstale":"2024-05-08T06:46:32.777368+0000","last_undegraded":"2024-05-08T06:46:32.777368+0000","last_fullsized":"2024-05-08T06:46:32.777368+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:35:21.233811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634637+0000","last_change":"2024-05-08T06:41:09.568880+0000","last_active":"2024-05-08T06:46:32.634637+0000","last_peered":"2024-05-08T06:46:32.634637+0000","last_clean":"2024-05-08T06:46:32.634637+0000","last_became_active":"2024-05-08T06:41:09.568507+0000","last_became_peered":"2024-05-08T06:41:09.568507+0000","last_unstale":"2024-05-08T06:46:32.634637+0000","last_undegraded":"2024-05-08T06:46:32.634637+0000","last_fullsized":"2024-05-08T06:46:32.634637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:01.376121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774636+0000","last_change":"2024-05-08T06:41:24.667472+0000","last_active":"2024-05-08T06:46:32.774636+0000","last_peered":"2024-05-08T06:46:32.774636+0000","last_clean":"2024-05-08T06:46:32.774636+0000","last_became_active":"2024-05-08T06:41:24.664164+0000","last_became_peered":"2024-05-08T06:41:24.664164+0000","last_unstale":"2024-05-08T06:46:32.774636+0000","last_undegraded":"2024-05-08T06:46:32.774636+0000","last_fullsized":"2024-05-08T06:46:32.774636+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:34:25.630742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"93'100","reported_seq":240,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:37.194680+0000","last_change":"2024-05-08T06:41:05.504287+0000","last_active":"2024-05-08T06:46:37.194680+0000","last_peered":"2024-05-08T06:46:37.194680+0000","last_clean":"2024-05-08T06:46:37.194680+0000","last_became_active":"2024-05-08T06:41:05.503825+0000","last_became_peered":"2024-05-08T06:41:05.503825+0000","last_unstale":"2024-05-08T06:46:37.194680+0000","last_undegraded":"2024-05-08T06:46:37.194680+0000","last_fullsized":"2024-05-08T06:46:37.194680+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:50:23.230289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":184,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"92'5","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775936+0000","last_change":"2024-05-08T06:41:09.576996+0000","last_active":"2024-05-08T06:46:32.775936+0000","last_peered":"2024-05-08T06:46:32.775936+0000","last_clean":"2024-05-08T06:46:32.775936+0000","last_became_active":"2024-05-08T06:41:09.572034+0000","last_became_peered":"2024-05-08T06:41:09.572034+0000","last_unstale":"2024-05-08T06:46:32.775936+0000","last_undegraded":"2024-05-08T06:46:32.775936+0000","last_fullsized":"2024-05-08T06:46:32.775936+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:06:41.690687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872584+0000","last_change":"2024-05-08T06:41:24.665751+0000","last_active":"2024-05-08T06:46:32.872584+0000","last_peered":"2024-05-08T06:46:32.872584+0000","last_clean":"2024-05-08T06:46:32.872584+0000","last_became_active":"2024-05-08T06:41:24.665306+0000","last_became_peered":"2024-05-08T06:41:24.665306+0000","last_unstale":"2024-05-08T06:46:32.872584+0000","last_undegraded":"2024-05-08T06:46:32.872584+0000","last_fullsized":"2024-05-08T06:46:32.872584+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:46:10.515975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"90'4","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871629+0000","last_change":"2024-05-08T06:41:05.502897+0000","last_active":"2024-05-08T06:46:32.871629+0000","last_peered":"2024-05-08T06:46:32.871629+0000","last_clean":"2024-05-08T06:46:32.871629+0000","last_became_active":"2024-05-08T06:41:05.500636+0000","last_became_peered":"2024-05-08T06:41:05.500636+0000","last_unstale":"2024-05-08T06:46:32.871629+0000","last_undegraded":"2024-05-08T06:46:32.871629+0000","last_fullsized":"2024-05-08T06:46:32.871629+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:31:02.523706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869659+0000","last_change":"2024-05-08T06:41:09.586824+0000","last_active":"2024-05-08T06:46:32.869659+0000","last_peered":"2024-05-08T06:46:32.869659+0000","last_clean":"2024-05-08T06:46:32.869659+0000","last_became_active":"2024-05-08T06:41:09.585032+0000","last_became_peered":"2024-05-08T06:41:09.585032+0000","last_unstale":"2024-05-08T06:46:32.869659+0000","last_undegraded":"2024-05-08T06:46:32.869659+0000","last_fullsized":"2024-05-08T06:46:32.869659+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:00:31.890993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870743+0000","last_change":"2024-05-08T06:41:24.670033+0000","last_active":"2024-05-08T06:46:32.870743+0000","last_peered":"2024-05-08T06:46:32.870743+0000","last_clean":"2024-05-08T06:46:32.870743+0000","last_became_active":"2024-05-08T06:41:24.669477+0000","last_became_peered":"2024-05-08T06:41:24.669477+0000","last_unstale":"2024-05-08T06:46:32.870743+0000","last_undegraded":"2024-05-08T06:46:32.870743+0000","last_fullsized":"2024-05-08T06:46:32.870743+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:55.040308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"90'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871533+0000","last_change":"2024-05-08T06:41:06.146847+0000","last_active":"2024-05-08T06:46:32.871533+0000","last_peered":"2024-05-08T06:46:32.871533+0000","last_clean":"2024-05-08T06:46:32.871533+0000","last_became_active":"2024-05-08T06:41:06.146141+0000","last_became_peered":"2024-05-08T06:41:06.146141+0000","last_unstale":"2024-05-08T06:46:32.871533+0000","last_undegraded":"2024-05-08T06:46:32.871533+0000","last_fullsized":"2024-05-08T06:46:32.871533+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:45:30.924860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"92'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776443+0000","last_change":"2024-05-08T06:41:09.578067+0000","last_active":"2024-05-08T06:46:32.776443+0000","last_peered":"2024-05-08T06:46:32.776443+0000","last_clean":"2024-05-08T06:46:32.776443+0000","last_became_active":"2024-05-08T06:41:09.577650+0000","last_became_peered":"2024-05-08T06:41:09.577650+0000","last_unstale":"2024-05-08T06:46:32.776443+0000","last_undegraded":"2024-05-08T06:46:32.776443+0000","last_fullsized":"2024-05-08T06:46:32.776443+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:39:09.285601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.773199+0000","last_change":"2024-05-08T06:41:24.669791+0000","last_active":"2024-05-08T06:46:32.773199+0000","last_peered":"2024-05-08T06:46:32.773199+0000","last_clean":"2024-05-08T06:46:32.773199+0000","last_became_active":"2024-05-08T06:41:24.669363+0000","last_became_peered":"2024-05-08T06:41:24.669363+0000","last_unstale":"2024-05-08T06:46:32.773199+0000","last_undegraded":"2024-05-08T06:46:32.773199+0000","last_fullsized":"2024-05-08T06:46:32.773199+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:41:08.522339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"90'3","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774863+0000","last_change":"2024-05-08T06:41:05.486456+0000","last_active":"2024-05-08T06:46:32.774863+0000","last_peered":"2024-05-08T06:46:32.774863+0000","last_clean":"2024-05-08T06:46:32.774863+0000","last_became_active":"2024-05-08T06:41:05.485878+0000","last_became_peered":"2024-05-08T06:41:05.485878+0000","last_unstale":"2024-05-08T06:46:32.774863+0000","last_undegraded":"2024-05-08T06:46:32.774863+0000","last_fullsized":"2024-05-08T06:46:32.774863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:11:47.985329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"92'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870546+0000","last_change":"2024-05-08T06:41:09.573940+0000","last_active":"2024-05-08T06:46:32.870546+0000","last_peered":"2024-05-08T06:46:32.870546+0000","last_clean":"2024-05-08T06:46:32.870546+0000","last_became_active":"2024-05-08T06:41:09.573515+0000","last_became_peered":"2024-05-08T06:41:09.573515+0000","last_unstale":"2024-05-08T06:46:32.870546+0000","last_undegraded":"2024-05-08T06:46:32.870546+0000","last_fullsized":"2024-05-08T06:46:32.870546+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:44.803013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"90'1","reported_seq":33,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872131+0000","last_change":"2024-05-08T06:41:24.663008+0000","last_active":"2024-05-08T06:46:32.872131+0000","last_peered":"2024-05-08T06:46:32.872131+0000","last_clean":"2024-05-08T06:46:32.872131+0000","last_became_active":"2024-05-08T06:41:24.661934+0000","last_became_peered":"2024-05-08T06:41:24.661934+0000","last_unstale":"2024-05-08T06:46:32.872131+0000","last_undegraded":"2024-05-08T06:46:32.872131+0000","last_fullsized":"2024-05-08T06:46:32.872131+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:08.719125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"92'2","reported_seq":19,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870546+0000","last_change":"2024-05-08T06:43:16.894395+0000","last_active":"2024-05-08T06:46:32.870546+0000","last_peered":"2024-05-08T06:46:32.870546+0000","last_clean":"2024-05-08T06:46:32.870546+0000","last_became_active":"2024-05-08T06:43:16.886763+0000","last_became_peered":"2024-05-08T06:43:16.886763+0000","last_unstale":"2024-05-08T06:46:32.870546+0000","last_undegraded":"2024-05-08T06:46:32.870546+0000","last_fullsized":"2024-05-08T06:46:32.870546+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:35:52.278223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.775237+0000","last_change":"2024-05-08T06:41:09.573388+0000","last_active":"2024-05-08T06:46:32.775237+0000","last_peered":"2024-05-08T06:46:32.775237+0000","last_clean":"2024-05-08T06:46:32.775237+0000","last_became_active":"2024-05-08T06:41:09.572901+0000","last_became_peered":"2024-05-08T06:41:09.572901+0000","last_unstale":"2024-05-08T06:46:32.775237+0000","last_undegraded":"2024-05-08T06:46:32.775237+0000","last_fullsized":"2024-05-08T06:46:32.775237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:38:45.123194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870992+0000","last_change":"2024-05-08T06:41:24.659817+0000","last_active":"2024-05-08T06:46:32.870992+0000","last_peered":"2024-05-08T06:46:32.870992+0000","last_clean":"2024-05-08T06:46:32.870992+0000","last_became_active":"2024-05-08T06:41:24.659276+0000","last_became_peered":"2024-05-08T06:41:24.659276+0000","last_unstale":"2024-05-08T06:46:32.870992+0000","last_undegraded":"2024-05-08T06:46:32.870992+0000","last_fullsized":"2024-05-08T06:46:32.870992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:33:01.635454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"90'4","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871054+0000","last_change":"2024-05-08T06:43:16.905524+0000","last_active":"2024-05-08T06:46:32.871054+0000","last_peered":"2024-05-08T06:46:32.871054+0000","last_clean":"2024-05-08T06:46:32.871054+0000","last_became_active":"2024-05-08T06:43:16.888087+0000","last_became_peered":"2024-05-08T06:43:16.888087+0000","last_unstale":"2024-05-08T06:46:32.871054+0000","last_undegraded":"2024-05-08T06:46:32.871054+0000","last_fullsized":"2024-05-08T06:46:32.871054+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:52.981394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"92'5","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.187555+0000","last_change":"2024-05-08T06:41:09.574238+0000","last_active":"2024-05-08T06:46:33.187555+0000","last_peered":"2024-05-08T06:46:33.187555+0000","last_clean":"2024-05-08T06:46:33.187555+0000","last_became_active":"2024-05-08T06:41:09.570019+0000","last_became_peered":"2024-05-08T06:41:09.570019+0000","last_unstale":"2024-05-08T06:46:33.187555+0000","last_undegraded":"2024-05-08T06:46:33.187555+0000","last_fullsized":"2024-05-08T06:46:33.187555+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:56.980400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872332+0000","last_change":"2024-05-08T06:41:24.659955+0000","last_active":"2024-05-08T06:46:32.872332+0000","last_peered":"2024-05-08T06:46:32.872332+0000","last_clean":"2024-05-08T06:46:32.872332+0000","last_became_active":"2024-05-08T06:41:24.659534+0000","last_became_peered":"2024-05-08T06:41:24.659534+0000","last_unstale":"2024-05-08T06:46:32.872332+0000","last_undegraded":"2024-05-08T06:46:32.872332+0000","last_fullsized":"2024-05-08T06:46:32.872332+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:41.893917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"90'3","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870716+0000","last_change":"2024-05-08T06:43:16.897225+0000","last_active":"2024-05-08T06:46:32.870716+0000","last_peered":"2024-05-08T06:46:32.870716+0000","last_clean":"2024-05-08T06:46:32.870716+0000","last_became_active":"2024-05-08T06:43:16.883954+0000","last_became_peered":"2024-05-08T06:43:16.883954+0000","last_unstale":"2024-05-08T06:46:32.870716+0000","last_undegraded":"2024-05-08T06:46:32.870716+0000","last_fullsized":"2024-05-08T06:46:32.870716+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:12.014514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"92'7","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.191631+0000","last_change":"2024-05-08T06:41:09.574159+0000","last_active":"2024-05-08T06:46:33.191631+0000","last_peered":"2024-05-08T06:46:33.191631+0000","last_clean":"2024-05-08T06:46:33.191631+0000","last_became_active":"2024-05-08T06:41:09.573734+0000","last_became_peered":"2024-05-08T06:41:09.573734+0000","last_unstale":"2024-05-08T06:46:33.191631+0000","last_undegraded":"2024-05-08T06:46:33.191631+0000","last_fullsized":"2024-05-08T06:46:33.191631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:22.157071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.868921+0000","last_change":"2024-05-08T06:41:24.668545+0000","last_active":"2024-05-08T06:46:32.868921+0000","last_peered":"2024-05-08T06:46:32.868921+0000","last_clean":"2024-05-08T06:46:32.868921+0000","last_became_active":"2024-05-08T06:41:24.668086+0000","last_became_peered":"2024-05-08T06:41:24.668086+0000","last_unstale":"2024-05-08T06:46:32.868921+0000","last_undegraded":"2024-05-08T06:46:32.868921+0000","last_fullsized":"2024-05-08T06:46:32.868921+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:08:02.473733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"93'65","reported_seq":143,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:36.717199+0000","last_change":"2024-05-08T06:41:05.501332+0000","last_active":"2024-05-08T06:46:36.717199+0000","last_peered":"2024-05-08T06:46:36.717199+0000","last_clean":"2024-05-08T06:46:36.717199+0000","last_became_active":"2024-05-08T06:41:05.499174+0000","last_became_peered":"2024-05-08T06:41:05.499174+0000","last_unstale":"2024-05-08T06:46:36.717199+0000","last_undegraded":"2024-05-08T06:46:36.717199+0000","last_fullsized":"2024-05-08T06:46:36.717199+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:11:49.485485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"92'6","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.190141+0000","last_change":"2024-05-08T06:41:09.572927+0000","last_active":"2024-05-08T06:46:33.190141+0000","last_peered":"2024-05-08T06:46:33.190141+0000","last_clean":"2024-05-08T06:46:33.190141+0000","last_became_active":"2024-05-08T06:41:09.572502+0000","last_became_peered":"2024-05-08T06:41:09.572502+0000","last_unstale":"2024-05-08T06:46:33.190141+0000","last_undegraded":"2024-05-08T06:46:33.190141+0000","last_fullsized":"2024-05-08T06:46:33.190141+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:03.838892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.639936+0000","last_change":"2024-05-08T06:41:24.667561+0000","last_active":"2024-05-08T06:46:32.639936+0000","last_peered":"2024-05-08T06:46:32.639936+0000","last_clean":"2024-05-08T06:46:32.639936+0000","last_became_active":"2024-05-08T06:41:24.666904+0000","last_became_peered":"2024-05-08T06:41:24.666904+0000","last_unstale":"2024-05-08T06:46:32.639936+0000","last_undegraded":"2024-05-08T06:46:32.639936+0000","last_fullsized":"2024-05-08T06:46:32.639936+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:23.616157+0000","last_clean_scrub_stamp":"2024-05-08T06:41:23.616157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:15.720760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634924+0000","last_change":"2024-05-08T06:41:05.497117+0000","last_active":"2024-05-08T06:46:32.634924+0000","last_peered":"2024-05-08T06:46:32.634924+0000","last_clean":"2024-05-08T06:46:32.634924+0000","last_became_active":"2024-05-08T06:41:05.496621+0000","last_became_peered":"2024-05-08T06:41:05.496621+0000","last_unstale":"2024-05-08T06:46:32.634924+0000","last_undegraded":"2024-05-08T06:46:32.634924+0000","last_fullsized":"2024-05-08T06:46:32.634924+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:04.450444+0000","last_clean_scrub_stamp":"2024-05-08T06:41:04.450444+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:06:32.603973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"92'9","reported_seq":51,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:33.191471+0000","last_change":"2024-05-08T06:41:09.572489+0000","last_active":"2024-05-08T06:46:33.191471+0000","last_peered":"2024-05-08T06:46:33.191471+0000","last_clean":"2024-05-08T06:46:33.191471+0000","last_became_active":"2024-05-08T06:41:09.572129+0000","last_became_peered":"2024-05-08T06:41:09.572129+0000","last_unstale":"2024-05-08T06:46:33.191471+0000","last_undegraded":"2024-05-08T06:46:33.191471+0000","last_fullsized":"2024-05-08T06:46:33.191471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:18:55.181892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"92'9","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.870754+0000","last_change":"2024-05-08T06:41:09.577872+0000","last_active":"2024-05-08T06:46:32.870754+0000","last_peered":"2024-05-08T06:46:32.870754+0000","last_clean":"2024-05-08T06:46:32.870754+0000","last_became_active":"2024-05-08T06:41:09.577490+0000","last_became_peered":"2024-05-08T06:41:09.577490+0000","last_unstale":"2024-05-08T06:46:32.870754+0000","last_undegraded":"2024-05-08T06:46:32.870754+0000","last_fullsized":"2024-05-08T06:46:32.870754+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:12:44.956055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"92'12","reported_seq":60,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872995+0000","last_change":"2024-05-08T06:42:15.861046+0000","last_active":"2024-05-08T06:46:32.872995+0000","last_peered":"2024-05-08T06:46:32.872995+0000","last_clean":"2024-05-08T06:46:32.872995+0000","last_became_active":"2024-05-08T06:42:15.860267+0000","last_became_peered":"2024-05-08T06:42:15.860267+0000","last_unstale":"2024-05-08T06:46:32.872995+0000","last_undegraded":"2024-05-08T06:46:32.872995+0000","last_fullsized":"2024-05-08T06:46:32.872995+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:15:01.541268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"92'8","reported_seq":50,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872703+0000","last_change":"2024-05-08T06:41:09.578005+0000","last_active":"2024-05-08T06:46:32.872703+0000","last_peered":"2024-05-08T06:46:32.872703+0000","last_clean":"2024-05-08T06:46:32.872703+0000","last_became_active":"2024-05-08T06:41:09.577571+0000","last_became_peered":"2024-05-08T06:41:09.577571+0000","last_unstale":"2024-05-08T06:46:32.872703+0000","last_undegraded":"2024-05-08T06:46:32.872703+0000","last_fullsized":"2024-05-08T06:46:32.872703+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:22.762195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"92'7","reported_seq":48,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.869224+0000","last_change":"2024-05-08T06:41:09.579520+0000","last_active":"2024-05-08T06:46:32.869224+0000","last_peered":"2024-05-08T06:46:32.869224+0000","last_clean":"2024-05-08T06:46:32.869224+0000","last_became_active":"2024-05-08T06:41:09.579085+0000","last_became_peered":"2024-05-08T06:41:09.579085+0000","last_unstale":"2024-05-08T06:46:32.869224+0000","last_undegraded":"2024-05-08T06:46:32.869224+0000","last_fullsized":"2024-05-08T06:46:32.869224+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:02:25.199102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"92'4","reported_seq":46,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.634777+0000","last_change":"2024-05-08T06:41:09.588352+0000","last_active":"2024-05-08T06:46:32.634777+0000","last_peered":"2024-05-08T06:46:32.634777+0000","last_clean":"2024-05-08T06:46:32.634777+0000","last_became_active":"2024-05-08T06:41:09.587981+0000","last_became_peered":"2024-05-08T06:41:09.587981+0000","last_unstale":"2024-05-08T06:46:32.634777+0000","last_undegraded":"2024-05-08T06:46:32.634777+0000","last_fullsized":"2024-05-08T06:46:32.634777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:55.275569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871931+0000","last_change":"2024-05-08T06:41:09.584216+0000","last_active":"2024-05-08T06:46:32.871931+0000","last_peered":"2024-05-08T06:46:32.871931+0000","last_clean":"2024-05-08T06:46:32.871931+0000","last_became_active":"2024-05-08T06:41:09.583789+0000","last_became_peered":"2024-05-08T06:41:09.583789+0000","last_unstale":"2024-05-08T06:46:32.871931+0000","last_undegraded":"2024-05-08T06:46:32.871931+0000","last_fullsized":"2024-05-08T06:46:32.871931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:33:04.153098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"92'15","reported_seq":57,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.873893+0000","last_change":"2024-05-08T06:41:09.573622+0000","last_active":"2024-05-08T06:46:32.873893+0000","last_peered":"2024-05-08T06:46:32.873893+0000","last_clean":"2024-05-08T06:46:32.873893+0000","last_became_active":"2024-05-08T06:41:09.573116+0000","last_became_peered":"2024-05-08T06:41:09.573116+0000","last_unstale":"2024-05-08T06:46:32.873893+0000","last_undegraded":"2024-05-08T06:46:32.873893+0000","last_fullsized":"2024-05-08T06:46:32.873893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:58:03.031899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"92'2","reported_seq":43,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.776142+0000","last_change":"2024-05-08T06:41:09.588787+0000","last_active":"2024-05-08T06:46:32.776142+0000","last_peered":"2024-05-08T06:46:32.776142+0000","last_clean":"2024-05-08T06:46:32.776142+0000","last_became_active":"2024-05-08T06:41:09.588430+0000","last_became_peered":"2024-05-08T06:41:09.588430+0000","last_unstale":"2024-05-08T06:46:32.776142+0000","last_undegraded":"2024-05-08T06:46:32.776142+0000","last_fullsized":"2024-05-08T06:46:32.776142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:36:26.689419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"92'6","reported_seq":47,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.640938+0000","last_change":"2024-05-08T06:41:09.575057+0000","last_active":"2024-05-08T06:46:32.640938+0000","last_peered":"2024-05-08T06:46:32.640938+0000","last_clean":"2024-05-08T06:46:32.640938+0000","last_became_active":"2024-05-08T06:41:09.572522+0000","last_became_peered":"2024-05-08T06:41:09.572522+0000","last_unstale":"2024-05-08T06:46:32.640938+0000","last_undegraded":"2024-05-08T06:46:32.640938+0000","last_fullsized":"2024-05-08T06:46:32.640938+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:40:26.702841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.774975+0000","last_change":"2024-05-08T06:41:09.578184+0000","last_active":"2024-05-08T06:46:32.774975+0000","last_peered":"2024-05-08T06:46:32.774975+0000","last_clean":"2024-05-08T06:46:32.774975+0000","last_became_active":"2024-05-08T06:41:09.577796+0000","last_became_peered":"2024-05-08T06:41:09.577796+0000","last_unstale":"2024-05-08T06:46:32.774975+0000","last_undegraded":"2024-05-08T06:46:32.774975+0000","last_fullsized":"2024-05-08T06:46:32.774975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:40.822805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"92'10","reported_seq":52,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.872864+0000","last_change":"2024-05-08T06:41:09.577050+0000","last_active":"2024-05-08T06:46:32.872864+0000","last_peered":"2024-05-08T06:46:32.872864+0000","last_clean":"2024-05-08T06:46:32.872864+0000","last_became_active":"2024-05-08T06:41:09.576449+0000","last_became_peered":"2024-05-08T06:41:09.576449+0000","last_unstale":"2024-05-08T06:46:32.872864+0000","last_undegraded":"2024-05-08T06:46:32.872864+0000","last_fullsized":"2024-05-08T06:46:32.872864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:04:42.819087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"92'11","reported_seq":53,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.635859+0000","last_change":"2024-05-08T06:41:09.580830+0000","last_active":"2024-05-08T06:46:32.635859+0000","last_peered":"2024-05-08T06:46:32.635859+0000","last_clean":"2024-05-08T06:46:32.635859+0000","last_became_active":"2024-05-08T06:41:09.577457+0000","last_became_peered":"2024-05-08T06:41:09.577457+0000","last_unstale":"2024-05-08T06:46:32.635859+0000","last_undegraded":"2024-05-08T06:46:32.635859+0000","last_fullsized":"2024-05-08T06:46:32.635859+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:02.932857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"92'8","reported_seq":49,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-05-08T06:46:32.871394+0000","last_change":"2024-05-08T06:41:09.586919+0000","last_active":"2024-05-08T06:46:32.871394+0000","last_peered":"2024-05-08T06:46:32.871394+0000","last_clean":"2024-05-08T06:46:32.871394+0000","last_became_active":"2024-05-08T06:41:09.586560+0000","last_became_peered":"2024-05-08T06:41:09.586560+0000","last_unstale":"2024-05-08T06:46:32.871394+0000","last_undegraded":"2024-05-08T06:46:32.871394+0000","last_fullsized":"2024-05-08T06:46:32.871394+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T06:41:08.503797+0000","last_clean_scrub_stamp":"2024-05-08T06:41:08.503797+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:00.523875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":144,"num_read_kb":248,"num_write":135,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":804728,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1819,"num_read_kb":1134,"num_write":428,"num_write_kb":2370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2641920,"data_stored":2414184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":317,"ondisk_log_size":317,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":73,"seq":313532612693,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1073152,"data_stored":538155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808923,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33356,"kb_used_data":2060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93711796,"statfs":{"total":95995035648,"available":95960879104,"internally_reserved":0,"allocated":2109440,"data_stored":1531659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36788,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708364,"statfs":{"total":95995035648,"available":95957364736,"internally_reserved":0,"allocated":1486848,"data_stored":935703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":36174273},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168682,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28464,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716688,"statfs":{"total":95995035648,"available":95965888512,"internally_reserved":0,"allocated":1482752,"data_stored":931527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364913,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32824,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712328,"statfs":{"total":95995035648,"available":95961423872,"internally_reserved":0,"allocated":1683456,"data_stored":1136520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561145,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36384,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708768,"statfs":{"total":95995035648,"available":95957778432,"internally_reserved":0,"allocated":1069056,"data_stored":533567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28144,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717008,"statfs":{"total":95995035648,"available":95966216192,"internally_reserved":0,"allocated":1150976,"data_stored":610456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738528,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1093632,"data_stored":534955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1171456,"data_stored":612890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149837,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28900,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716252,"statfs":{"total":95995035648,"available":95965442048,"internally_reserved":0,"allocated":1806336,"data_stored":1255209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953607,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":539824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":38,"seq":163208757376,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37432,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93707720,"statfs":{"total":95995035648,"available":95956705280,"internally_reserved":0,"allocated":2023424,"data_stored":1459315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":76979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":79413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":331374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":407814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T06:46:50.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:46:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:49 smithi194 ceph-mon[33679]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-05-08T06:46:50.303 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:49 smithi070 ceph-mon[29591]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-05-08T06:46:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:49 smithi172 ceph-mon[33377]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 43 op/s 2024-05-08T06:46:50.688 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:51.097 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:50 smithi070 ceph-mon[29591]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:46:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:50 smithi194 ceph-mon[33679]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:46:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:50 smithi172 ceph-mon[33377]: from='client.15327 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T06:46:52.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:51 smithi070 ceph-mon[29591]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-05-08T06:46:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:51 smithi194 ceph-mon[33679]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-05-08T06:46:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:51 smithi172 ceph-mon[33377]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 77 KiB/s wr, 45 op/s 2024-05-08T06:46:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.154+0000 7f00edc00700 1 -- 172.21.15.70:0/3706555358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810a3a0 msgr2=0x7f00e8116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.154+0000 7f00edc00700 1 --2- 172.21.15.70:0/3706555358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810a3a0 0x7f00e8116840 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f00e000b0a0 tx=0x7f00e000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.154+0000 7f00edc00700 1 -- 172.21.15.70:0/3706555358 shutdown_connections 2024-05-08T06:46:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.154+0000 7f00edc00700 1 --2- 172.21.15.70:0/3706555358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810a3a0 0x7f00e8116840 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.154+0000 7f00edc00700 1 --2- 172.21.15.70:0/3706555358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00e810e8b0 0x7f00e810ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.154+0000 7f00edc00700 1 --2- 172.21.15.70:0/3706555358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e81099e0 0x7f00e8109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.154+0000 7f00edc00700 1 -- 172.21.15.70:0/3706555358 >> 172.21.15.70:0/3706555358 conn(0x7f00e8079230 msgr2=0x7f00e81082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.154+0000 7f00edc00700 1 -- 172.21.15.70:0/3706555358 shutdown_connections 2024-05-08T06:46:53.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.154+0000 7f00edc00700 1 -- 172.21.15.70:0/3706555358 wait complete. 2024-05-08T06:46:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.155+0000 7f00edc00700 1 Processor -- start 2024-05-08T06:46:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.155+0000 7f00edc00700 1 -- start start 2024-05-08T06:46:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00edc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e81099e0 0x7f00e819ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00edc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00e810a3a0 0x7f00e81a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00edc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00edc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8119a90 con 0x7f00e810e8b0 2024-05-08T06:46:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00edc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8119910 con 0x7f00e81099e0 2024-05-08T06:46:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00edc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8119c10 con 0x7f00e810a3a0 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00ed200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00ed200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43952/0 (socket says 172.21.15.70:43952) 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00ed200700 1 -- 172.21.15.70:0/2108152057 learned_addr learned my addr 172.21.15.70:0/2108152057 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00e7400700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00e810a3a0 0x7f00e81a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.156+0000 7f00e7e00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e81099e0 0x7f00e819ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00ed200700 1 -- 172.21.15.70:0/2108152057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00e810a3a0 msgr2=0x7f00e81a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00ed200700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00e810a3a0 0x7f00e81a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00ed200700 1 -- 172.21.15.70:0/2108152057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e81099e0 msgr2=0x7f00e819ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00ed200700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e81099e0 0x7f00e819ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00ed200700 1 -- 172.21.15.70:0/2108152057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e81a4f40 con 0x7f00e810e8b0 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00e7e00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e81099e0 0x7f00e819ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:46:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00ed200700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f00e000b070 tx=0x7f00e0004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00e4c00700 1 -- 172.21.15.70:0/2108152057 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0021070 con 0x7f00e810e8b0 2024-05-08T06:46:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00e4c00700 1 -- 172.21.15.70:0/2108152057 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f00e0007c00 con 0x7f00e810e8b0 2024-05-08T06:46:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e81a51d0 con 0x7f00e810e8b0 2024-05-08T06:46:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.157+0000 7f00e4c00700 1 -- 172.21.15.70:0/2108152057 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0004860 con 0x7f00e810e8b0 2024-05-08T06:46:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.158+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e81acab0 con 0x7f00e810e8b0 2024-05-08T06:46:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.159+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e806a190 con 0x7f00e810e8b0 2024-05-08T06:46:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.161+0000 7f00e4c00700 1 -- 172.21.15.70:0/2108152057 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 149879+0+0 (secure 0 0 0) 0x7f00e0003fb0 con 0x7f00e810e8b0 2024-05-08T06:46:53.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.164+0000 7f00e4c00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f00cc0b2b10 0x7f00cc0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:53.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.164+0000 7f00e4c00700 1 -- 172.21.15.70:0/2108152057 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f00e000f020 con 0x7f00e810e8b0 2024-05-08T06:46:53.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.164+0000 7f00e7e00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f00cc0b2b10 0x7f00cc0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:53.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.165+0000 7f00e7e00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f00cc0b2b10 0x7f00cc0b4fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009b50 tx=0x7f00d8009550 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:53.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.166+0000 7f00e4c00700 1 -- 172.21.15.70:0/2108152057 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f00e002a020 con 0x7f00e810e8b0 2024-05-08T06:46:53.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.448+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00e802e510 con 0x7f00e810e8b0 2024-05-08T06:46:53.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.450+0000 7f00e4c00700 1 -- 172.21.15.70:0/2108152057 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11876 (secure 0 0 0) 0x7f00e00abb20 con 0x7f00e810e8b0 2024-05-08T06:46:53.450 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:46:53.450 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:46:31.709156+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T06:46:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f00cc0b2b10 msgr2=0x7f00cc0b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f00cc0b2b10 0x7f00cc0b4fd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009b50 tx=0x7f00d8009550 comp rx=0 tx=0).stop 2024-05-08T06:46:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810e8b0 msgr2=0x7f00e81a4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f00e000b070 tx=0x7f00e0004e00 comp rx=0 tx=0).stop 2024-05-08T06:46:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 shutdown_connections 2024-05-08T06:46:53.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f00cc0b2b10 0x7f00cc0b4fd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4800 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f00e81099e0 0x7f00e819ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 --2- 172.21.15.70:0/2108152057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00e810a3a0 0x7f00e81a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.453+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 >> 172.21.15.70:0/2108152057 conn(0x7f00e8079230 msgr2=0x7f00e8079890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.454+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 shutdown_connections 2024-05-08T06:46:53.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:53.454+0000 7f00edc00700 1 -- 172.21.15.70:0/2108152057 wait complete. 2024-05-08T06:46:53.455 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-05-08T06:46:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:53 smithi070 ceph-mon[29591]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:53 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2108152057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:53 smithi194 ceph-mon[33679]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:53 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2108152057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:54.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:46:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:53 smithi172 ceph-mon[33377]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:53 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2108152057' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:54.839 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:46:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:55 smithi194 ceph-mon[33679]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:55 smithi070 ceph-mon[29591]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:55 smithi172 ceph-mon[33377]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:46:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.294+0000 7fe427600700 1 -- 172.21.15.70:0/545886389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe42010fea0 msgr2=0x7fe420112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:57.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.294+0000 7fe427600700 1 --2- 172.21.15.70:0/545886389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe42010fea0 0x7fe420112290 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe418009990 tx=0x7fe418009ca0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.294+0000 7fe427600700 1 -- 172.21.15.70:0/545886389 shutdown_connections 2024-05-08T06:46:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.294+0000 7fe427600700 1 --2- 172.21.15.70:0/545886389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe42010fea0 0x7fe420112290 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.294+0000 7fe427600700 1 --2- 172.21.15.70:0/545886389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe4200756d0 0x7fe420075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.294+0000 7fe427600700 1 --2- 172.21.15.70:0/545886389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe420075ff0 0x7fe42010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.294+0000 7fe427600700 1 -- 172.21.15.70:0/545886389 >> 172.21.15.70:0/545886389 conn(0x7fe42007a600 msgr2=0x7fe42007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.294+0000 7fe427600700 1 -- 172.21.15.70:0/545886389 shutdown_connections 2024-05-08T06:46:57.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.295+0000 7fe427600700 1 -- 172.21.15.70:0/545886389 wait complete. 2024-05-08T06:46:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.295+0000 7fe427600700 1 Processor -- start 2024-05-08T06:46:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe427600700 1 -- start start 2024-05-08T06:46:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe427600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4200756d0 0x7fe4201a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe427600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe420075ff0 0x7fe4201a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:57.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe427600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe42010fea0 0x7fe42019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe427600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe420115750 con 0x7fe4200756d0 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe427600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201155d0 con 0x7fe420075ff0 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe427600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe4201158d0 con 0x7fe42010fea0 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe424c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4200756d0 0x7fe4201a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe424c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4200756d0 0x7fe4201a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39928/0 (socket says 172.21.15.70:39928) 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.296+0000 7fe424c00700 1 -- 172.21.15.70:0/186021310 learned_addr learned my addr 172.21.15.70:0/186021310 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.297+0000 7fe41fe00700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe420075ff0 0x7fe4201a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.297+0000 7fe425600700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe42010fea0 0x7fe42019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.297+0000 7fe424c00700 1 -- 172.21.15.70:0/186021310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe42010fea0 msgr2=0x7fe42019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.297+0000 7fe424c00700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe42010fea0 0x7fe42019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.297+0000 7fe424c00700 1 -- 172.21.15.70:0/186021310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe420075ff0 msgr2=0x7fe4201a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:57.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.297+0000 7fe424c00700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe420075ff0 0x7fe4201a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.297+0000 7fe424c00700 1 -- 172.21.15.70:0/186021310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42019c1b0 con 0x7fe4200756d0 2024-05-08T06:46:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.297+0000 7fe424c00700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4200756d0 0x7fe4201a1890 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe4140060b0 tx=0x7fe414007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.298+0000 7fe41d600700 1 -- 172.21.15.70:0/186021310 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41401a070 con 0x7fe4200756d0 2024-05-08T06:46:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.298+0000 7fe41d600700 1 -- 172.21.15.70:0/186021310 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe41400de20 con 0x7fe4200756d0 2024-05-08T06:46:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.298+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42019c4a0 con 0x7fe4200756d0 2024-05-08T06:46:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.298+0000 7fe41d600700 1 -- 172.21.15.70:0/186021310 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe414014690 con 0x7fe4200756d0 2024-05-08T06:46:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.298+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4201a8760 con 0x7fe4200756d0 2024-05-08T06:46:57.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.299+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42006a190 con 0x7fe4200756d0 2024-05-08T06:46:57.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.301+0000 7fe41d600700 1 -- 172.21.15.70:0/186021310 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 149879+0+0 (secure 0 0 0) 0x7fe41401d070 con 0x7fe4200756d0 2024-05-08T06:46:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.302+0000 7fe41d600700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4080b2b90 0x7fe4080b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:46:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.303+0000 7fe41d600700 1 -- 172.21.15.70:0/186021310 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fe4140e2560 con 0x7fe4200756d0 2024-05-08T06:46:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.303+0000 7fe41fe00700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4080b2b90 0x7fe4080b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:46:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.303+0000 7fe41fe00700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4080b2b90 0x7fe4080b5050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe40c005950 tx=0x7fe40c0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:46:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.307+0000 7fe41d600700 1 -- 172.21.15.70:0/186021310 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe414010070 con 0x7fe4200756d0 2024-05-08T06:46:57.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.572+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe42002e510 con 0x7fe4200756d0 2024-05-08T06:46:57.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.574+0000 7fe41d600700 1 -- 172.21.15.70:0/186021310 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11876 (secure 0 0 0) 0x7fe4140a98c0 con 0x7fe4200756d0 2024-05-08T06:46:57.573 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:46:57.574 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:46:31.709156+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T06:46:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4080b2b90 msgr2=0x7fe4080b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4080b2b90 0x7fe4080b5050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe40c005950 tx=0x7fe40c0058e0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4200756d0 msgr2=0x7fe4201a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:46:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4200756d0 0x7fe4201a1890 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe4140060b0 tx=0x7fe414007f90 comp rx=0 tx=0).stop 2024-05-08T06:46:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 shutdown_connections 2024-05-08T06:46:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4080b2b90 0x7fe4080b5050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe42010fea0 0x7fe42019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe4200756d0 0x7fe4201a1890 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 --2- 172.21.15.70:0/186021310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe420075ff0 0x7fe4201a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:46:57.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.577+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 >> 172.21.15.70:0/186021310 conn(0x7fe42007a600 msgr2=0x7fe4201006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:46:57.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.578+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 shutdown_connections 2024-05-08T06:46:57.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:46:57.578+0000 7fe427600700 1 -- 172.21.15.70:0/186021310 wait complete. 2024-05-08T06:46:57.578 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-05-08T06:46:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:57 smithi194 ceph-mon[33679]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:46:57 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/186021310' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:58.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:57 smithi070 ceph-mon[29591]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:58.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:46:57 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/186021310' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:57 smithi172 ceph-mon[33377]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:46:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:46:57 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/186021310' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:46:58.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:46:59.057 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:47:00.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:00 smithi194 ceph-mon[33679]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:00.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:00 smithi070 ceph-mon[29591]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:00 smithi172 ceph-mon[33377]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:00.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:47:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:47:00.286+0000 7fc06a200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:47:00.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:47:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:47:00.286+0000 7fc06a200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:47:00.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:47:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:47:00.286+0000 7fc06a200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:47:00.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:47:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:47:00.286+0000 7fc06a200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:47:00.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 06:47:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T06:47:00.286+0000 7fc06a200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T06:47:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.566+0000 7f338e200700 1 -- 172.21.15.70:0/3901750526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33881076c0 msgr2=0x7f3388107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.566+0000 7f338e200700 1 --2- 172.21.15.70:0/3901750526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33881076c0 0x7f3388107aa0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f337800b0a0 tx=0x7f337800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.566+0000 7f338e200700 1 -- 172.21.15.70:0/3901750526 shutdown_connections 2024-05-08T06:47:01.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.566+0000 7f338e200700 1 --2- 172.21.15.70:0/3901750526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3388102080 0x7f338810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.566+0000 7f338e200700 1 --2- 172.21.15.70:0/3901750526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33881076c0 0x7f3388107aa0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.566+0000 7f338e200700 1 --2- 172.21.15.70:0/3901750526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33881016c0 0x7f3388101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.566+0000 7f338e200700 1 -- 172.21.15.70:0/3901750526 >> 172.21.15.70:0/3901750526 conn(0x7f33880785a0 msgr2=0x7f33880ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.566+0000 7f338e200700 1 -- 172.21.15.70:0/3901750526 shutdown_connections 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.566+0000 7f338e200700 1 -- 172.21.15.70:0/3901750526 wait complete. 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.567+0000 7f338e200700 1 Processor -- start 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.567+0000 7f338e200700 1 -- start start 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.567+0000 7f338e200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33881016c0 0x7f33881a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.567+0000 7f338e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3388102080 0x7f33881a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.567+0000 7f338e200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33881076c0 0x7f338819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f338e200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3388112490 con 0x7f3388102080 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f338e200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3388112310 con 0x7f33881016c0 2024-05-08T06:47:01.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f338e200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3388112610 con 0x7f33881076c0 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f337ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3388102080 0x7f33881a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f337ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3388102080 0x7f33881a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39972/0 (socket says 172.21.15.70:39972) 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f337ea00700 1 -- 172.21.15.70:0/3616324758 learned_addr learned my addr 172.21.15.70:0/3616324758 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f3387e00700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33881076c0 0x7f338819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f3387400700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33881016c0 0x7f33881a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f337ea00700 1 -- 172.21.15.70:0/3616324758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33881076c0 msgr2=0x7f338819bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f337ea00700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33881076c0 0x7f338819bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f337ea00700 1 -- 172.21.15.70:0/3616324758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33881016c0 msgr2=0x7f33881a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f337ea00700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33881016c0 0x7f33881a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f337ea00700 1 -- 172.21.15.70:0/3616324758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338819c3f0 con 0x7f3388102080 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.568+0000 7f3387400700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33881016c0 0x7f33881a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.569+0000 7f337ea00700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3388102080 0x7f33881a1f80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f337000d950 tx=0x7f337000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.569+0000 7f3384c00700 1 -- 172.21.15.70:0/3616324758 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3370016070 con 0x7f3388102080 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.569+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338819c680 con 0x7f3388102080 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.569+0000 7f3384c00700 1 -- 172.21.15.70:0/3616324758 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3370010460 con 0x7f3388102080 2024-05-08T06:47:01.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.569+0000 7f3384c00700 1 -- 172.21.15.70:0/3616324758 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337000f620 con 0x7f3388102080 2024-05-08T06:47:01.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.569+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33881a89c0 con 0x7f3388102080 2024-05-08T06:47:01.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.570+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3388102e00 con 0x7f3388102080 2024-05-08T06:47:01.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.573+0000 7f3384c00700 1 -- 172.21.15.70:0/3616324758 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 149936+0+0 (secure 0 0 0) 0x7f3370019070 con 0x7f3388102080 2024-05-08T06:47:01.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.574+0000 7f3384c00700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f336c0b2ba0 0x7f336c0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:01.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.574+0000 7f3384c00700 1 -- 172.21.15.70:0/3616324758 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f33700e28b0 con 0x7f3388102080 2024-05-08T06:47:01.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.574+0000 7f3387400700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f336c0b2ba0 0x7f336c0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:01.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.575+0000 7f3387400700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f336c0b2ba0 0x7f336c0b5060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3378009e60 tx=0x7f337800b7f0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:01.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.576+0000 7f3384c00700 1 -- 172.21.15.70:0/3616324758 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f33700a9c80 con 0x7f3388102080 2024-05-08T06:47:01.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.814+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f338819c9d0 con 0x7f3388102080 2024-05-08T06:47:01.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.819+0000 7f3384c00700 1 -- 172.21.15.70:0/3616324758 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+25241 (secure 0 0 0) 0x7f33700a9580 con 0x7f3388102080 2024-05-08T06:47:01.819 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:47:01.819 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":93,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T06:46:32.619363+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/565155292":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6800/3718531938":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6801/3718531938":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2886471860":"2024-05-09T06:46:32.619296+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/2096266006":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/360029842":"2024-05-09T06:46:32.619296+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:47:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f336c0b2ba0 msgr2=0x7f336c0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f336c0b2ba0 0x7f336c0b5060 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3378009e60 tx=0x7f337800b7f0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3388102080 msgr2=0x7f33881a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3388102080 0x7f33881a1f80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f337000d950 tx=0x7f337000dd10 comp rx=0 tx=0).stop 2024-05-08T06:47:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 shutdown_connections 2024-05-08T06:47:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f336c0b2ba0 0x7f336c0b5060 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33881076c0 0x7f338819bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33881016c0 0x7f33881a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 --2- 172.21.15.70:0/3616324758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3388102080 0x7f33881a1f80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:01.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 >> 172.21.15.70:0/3616324758 conn(0x7f33880785a0 msgr2=0x7f33881052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:01.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 shutdown_connections 2024-05-08T06:47:01.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:01.822+0000 7f338e200700 1 -- 172.21.15.70:0/3616324758 wait complete. 2024-05-08T06:47:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:02 smithi070 ceph-mon[29591]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:02 smithi070 ceph-mon[29591]: mgrmap e24: x(active, since 28s), standbys: y, z 2024-05-08T06:47:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:02 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3616324758' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:47:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:02 smithi172 ceph-mon[33377]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:02 smithi172 ceph-mon[33377]: mgrmap e24: x(active, since 28s), standbys: y, z 2024-05-08T06:47:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:02 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3616324758' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:47:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:02 smithi194 ceph-mon[33679]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:02 smithi194 ceph-mon[33679]: mgrmap e24: x(active, since 28s), standbys: y, z 2024-05-08T06:47:02.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:02 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3616324758' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:47:02.845 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-05-08T06:47:03.301 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:47:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:04 smithi070 ceph-mon[29591]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:04 smithi172 ceph-mon[33377]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:04 smithi194 ceph-mon[33679]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:06 smithi172 ceph-mon[33377]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T06:47:06.308 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:06 smithi070 ceph-mon[29591]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T06:47:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:06 smithi194 ceph-mon[33679]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T06:47:06.790 INFO:teuthology.orchestra.run.smithi070.stdout:{"run_dir":"/var/run/ceph"} 2024-05-08T06:47:06.791 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-05-08T06:47:06.791 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 5998 2024-05-08T06:47:06.791 DEBUG:tasks.quiescer:Yielding 2024-05-08T06:47:06.792 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T06:47:06.810 INFO:tasks.workunit:Pulling workunits from ref bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:47:06.811 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T06:47:06.811 INFO:tasks.workunit:timeout=3h 2024-05-08T06:47:06.811 INFO:tasks.workunit:cleanup=True 2024-05-08T06:47:06.811 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T06:47:06.812 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:47:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T06:47:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-08T06:47:06.866 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 72h/114d Inode: 1 Links: 2 2024-05-08T06:47:06.866 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T06:47:06.866 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-08T06:47:06.866 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-05-08 06:42:55.466505569 +0000 2024-05-08T06:47:06.866 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-05-08 06:42:55.466505569 +0000 2024-05-08T06:47:06.866 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-05-08 06:46:31.243546039 +0000 2024-05-08T06:47:06.866 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-05-08T06:47:06.867 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T06:47:06.867 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T06:47:07.002 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T06:47:07.054 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T06:47:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:47:08.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:08 smithi070 ceph-mon[29591]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T06:47:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:08 smithi172 ceph-mon[33377]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T06:47:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:08 smithi194 ceph-mon[33679]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T06:47:09.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.570+0000 7fd309e00700 1 -- 172.21.15.70:0/3940298821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd304075ff0 msgr2=0x7fd304114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:09.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.570+0000 7fd309e00700 1 --2- 172.21.15.70:0/3940298821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd304075ff0 0x7fd304114130 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009990 tx=0x7fd2ec009ca0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.570+0000 7fd309e00700 1 -- 172.21.15.70:0/3940298821 shutdown_connections 2024-05-08T06:47:09.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.570+0000 7fd309e00700 1 --2- 172.21.15.70:0/3940298821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd304114670 0x7fd304116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.570+0000 7fd309e00700 1 --2- 172.21.15.70:0/3940298821 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3040756d0 0x7fd304075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.570+0000 7fd309e00700 1 --2- 172.21.15.70:0/3940298821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd304075ff0 0x7fd304114130 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.570+0000 7fd309e00700 1 -- 172.21.15.70:0/3940298821 >> 172.21.15.70:0/3940298821 conn(0x7fd30407a600 msgr2=0x7fd30407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:09.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.570+0000 7fd309e00700 1 -- 172.21.15.70:0/3940298821 shutdown_connections 2024-05-08T06:47:09.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.570+0000 7fd309e00700 1 -- 172.21.15.70:0/3940298821 wait complete. 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.571+0000 7fd309e00700 1 Processor -- start 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.571+0000 7fd309e00700 1 -- start start 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd309e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3040756d0 0x7fd3041a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd309e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd304075ff0 0x7fd3041a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd309e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd304114670 0x7fd3041a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd309e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd304119b80 con 0x7fd3040756d0 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd309e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd304119a00 con 0x7fd304075ff0 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd309e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd304119d00 con 0x7fd304114670 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd302a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3040756d0 0x7fd3041a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd302a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3040756d0 0x7fd3041a00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37662/0 (socket says 172.21.15.70:37662) 2024-05-08T06:47:09.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd302a00700 1 -- 172.21.15.70:0/304023521 learned_addr learned my addr 172.21.15.70:0/304023521 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:09.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd2fa000700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd304075ff0 0x7fd3041a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:09.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd302a00700 1 -- 172.21.15.70:0/304023521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd304114670 msgr2=0x7fd3041a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:09.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd303400700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd304114670 0x7fd3041a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:09.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd302a00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd304114670 0x7fd3041a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd302a00700 1 -- 172.21.15.70:0/304023521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd304075ff0 msgr2=0x7fd3041a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:09.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd302a00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd304075ff0 0x7fd3041a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd302a00700 1 -- 172.21.15.70:0/304023521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3041a50e0 con 0x7fd3040756d0 2024-05-08T06:47:09.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd2fa000700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd304075ff0 0x7fd3041a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:09.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.572+0000 7fd303400700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd304114670 0x7fd3041a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.573+0000 7fd302a00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3040756d0 0x7fd3041a00d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40060b0 tx=0x7fd2f4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.573+0000 7fd308a00700 1 -- 172.21.15.70:0/304023521 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f401a070 con 0x7fd3040756d0 2024-05-08T06:47:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.573+0000 7fd308a00700 1 -- 172.21.15.70:0/304023521 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2f400de20 con 0x7fd3040756d0 2024-05-08T06:47:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.573+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3041a53d0 con 0x7fd3040756d0 2024-05-08T06:47:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.573+0000 7fd308a00700 1 -- 172.21.15.70:0/304023521 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4014690 con 0x7fd3040756d0 2024-05-08T06:47:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.573+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3041acc50 con 0x7fd3040756d0 2024-05-08T06:47:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.574+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd30406a190 con 0x7fd3040756d0 2024-05-08T06:47:09.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.577+0000 7fd308a00700 1 -- 172.21.15.70:0/304023521 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 149936+0+0 (secure 0 0 0) 0x7fd2f401d070 con 0x7fd3040756d0 2024-05-08T06:47:09.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.578+0000 7fd308a00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2e80b2c20 0x7fd2e80b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:09.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.579+0000 7fd308a00700 1 -- 172.21.15.70:0/304023521 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fd2f40e2ae0 con 0x7fd3040756d0 2024-05-08T06:47:09.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.579+0000 7fd2fa000700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2e80b2c20 0x7fd2e80b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:09.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.579+0000 7fd2fa000700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2e80b2c20 0x7fd2e80b50e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00b5c0 tx=0x7fd2ec005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:09.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.581+0000 7fd308a00700 1 -- 172.21.15.70:0/304023521 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd2f4010070 con 0x7fd3040756d0 2024-05-08T06:47:09.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.866+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3041a1430 con 0x7fd3040756d0 2024-05-08T06:47:09.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.867+0000 7fd308a00700 1 -- 172.21.15.70:0/304023521 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11876 (secure 0 0 0) 0x7fd2f40a9dd0 con 0x7fd3040756d0 2024-05-08T06:47:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:47:09.866 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:46:31.709156+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T06:47:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2e80b2c20 msgr2=0x7fd2e80b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2e80b2c20 0x7fd2e80b50e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00b5c0 tx=0x7fd2ec005fb0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3040756d0 msgr2=0x7fd3041a00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3040756d0 0x7fd3041a00d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40060b0 tx=0x7fd2f4007f90 comp rx=0 tx=0).stop 2024-05-08T06:47:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 shutdown_connections 2024-05-08T06:47:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2e80b2c20 0x7fd2e80b50e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd304114670 0x7fd3041a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3040756d0 0x7fd3041a00d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 --2- 172.21.15.70:0/304023521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd304075ff0 0x7fd3041a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 >> 172.21.15.70:0/304023521 conn(0x7fd30407a600 msgr2=0x7fd304110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 shutdown_connections 2024-05-08T06:47:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:09.871+0000 7fd309e00700 1 -- 172.21.15.70:0/304023521 wait complete. 2024-05-08T06:47:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-05-08T06:47:10.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:10 smithi070 ceph-mon[29591]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T06:47:10.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:10 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/304023521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:47:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:10 smithi172 ceph-mon[33377]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T06:47:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:10 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/304023521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:47:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:10 smithi194 ceph-mon[33679]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T06:47:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:10 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/304023521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:47:10.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T06:41:12.659763+0000', 'modified': '2024-05-08T06:46:31.709156+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34442, 'mds_1': 34409, 'mds_2': 34379}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24397': {'gid': 24397, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6837/346722795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6836', 'nonce': 346722795}, {'type': 'v1', 'addr': '172.21.15.194:6837', 'nonce': 346722795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24409': {'gid': 24409, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.194:6839/622098707', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6838', 'nonce': 622098707}, {'type': 'v1', 'addr': '172.21.15.194:6839', 'nonce': 622098707}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34364': {'gid': 34364, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.172:6833/852809993', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6832', 'nonce': 852809993}, {'type': 'v1', 'addr': '172.21.15.172:6833', 'nonce': 852809993}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34379': {'gid': 34379, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 36, 'addr': '172.21.15.172:6835/3516901387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6834', 'nonce': 3516901387}, {'type': 'v1', 'addr': '172.21.15.172:6835', 'nonce': 3516901387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34409': {'gid': 34409, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.172:6837/2037790761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6836', 'nonce': 2037790761}, {'type': 'v1', 'addr': '172.21.15.172:6837', 'nonce': 2037790761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34442': {'gid': 34442, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.172:6839/283788562', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.172:6838', 'nonce': 283788562}, {'type': 'v1', 'addr': '172.21.15.172:6839', 'nonce': 283788562}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34442, 'qdb_cluster': [34409, 34442, 34379]} 2024-05-08T06:47:10.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-08T06:47:10.818 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-08T06:47:11.274 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:47:12.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:12 smithi070 ceph-mon[29591]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:47:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:12 smithi172 ceph-mon[33377]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:47:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:12 smithi194 ceph-mon[33679]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:47:13.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.726+0000 7fb53ee00700 1 -- 172.21.15.70:0/4232483743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810fb60 msgr2=0x7fb53810ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:13.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.726+0000 7fb53ee00700 1 --2- 172.21.15.70:0/4232483743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810fb60 0x7fb53810ff40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb528009990 tx=0x7fb528009ca0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.726+0000 7fb53ee00700 1 -- 172.21.15.70:0/4232483743 shutdown_connections 2024-05-08T06:47:13.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.726+0000 7fb53ee00700 1 --2- 172.21.15.70:0/4232483743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb53810a490 0x7fb5381169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.726+0000 7fb53ee00700 1 --2- 172.21.15.70:0/4232483743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810fb60 0x7fb53810ff40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.726+0000 7fb53ee00700 1 --2- 172.21.15.70:0/4232483743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb538109ad0 0x7fb538109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.726+0000 7fb53ee00700 1 -- 172.21.15.70:0/4232483743 >> 172.21.15.70:0/4232483743 conn(0x7fb538076c70 msgr2=0x7fb5381082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:13.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.726+0000 7fb53ee00700 1 -- 172.21.15.70:0/4232483743 shutdown_connections 2024-05-08T06:47:13.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.726+0000 7fb53ee00700 1 -- 172.21.15.70:0/4232483743 wait complete. 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.727+0000 7fb53ee00700 1 Processor -- start 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb53ee00700 1 -- start start 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb53ee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb538109ad0 0x7fb5381a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb53ee00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810a490 0x7fb5381a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb53ee00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb53810fb60 0x7fb5381a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb53ee00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb538119b70 con 0x7fb53810a490 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb53ee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb5381199f0 con 0x7fb538109ad0 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb53ee00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb538119cf0 con 0x7fb53810fb60 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb537400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810a490 0x7fb5381a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb537400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810a490 0x7fb5381a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37686/0 (socket says 172.21.15.70:37686) 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb537400700 1 -- 172.21.15.70:0/2678967269 learned_addr learned my addr 172.21.15.70:0/2678967269 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb537e00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb538109ad0 0x7fb5381a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.728+0000 7fb53ce00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb53810fb60 0x7fb5381a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb537400700 1 -- 172.21.15.70:0/2678967269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb53810fb60 msgr2=0x7fb5381a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb537400700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb53810fb60 0x7fb5381a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb537400700 1 -- 172.21.15.70:0/2678967269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb538109ad0 msgr2=0x7fb5381a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb537400700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb538109ad0 0x7fb5381a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb537400700 1 -- 172.21.15.70:0/2678967269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5381a50d0 con 0x7fb53810a490 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb537400700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810a490 0x7fb5381a0600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb52400d950 tx=0x7fb52400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb534c00700 1 -- 172.21.15.70:0/2678967269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524016070 con 0x7fb53810a490 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb534c00700 1 -- 172.21.15.70:0/2678967269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb524010460 con 0x7fb53810a490 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb53ee00700 1 -- 172.21.15.70:0/2678967269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5381a53c0 con 0x7fb53810a490 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb534c00700 1 -- 172.21.15.70:0/2678967269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb52400f620 con 0x7fb53810a490 2024-05-08T06:47:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.729+0000 7fb53ee00700 1 -- 172.21.15.70:0/2678967269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5381acc40 con 0x7fb53810a490 2024-05-08T06:47:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.734+0000 7fb534c00700 1 -- 172.21.15.70:0/2678967269 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 149936+0+0 (secure 0 0 0) 0x7fb524019070 con 0x7fb53810a490 2024-05-08T06:47:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.734+0000 7fb5496dbb80 1 Processor -- start 2024-05-08T06:47:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.734+0000 7fb5496dbb80 1 -- start start 2024-05-08T06:47:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.734+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc35010 0x555f4bc353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.734+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 0x555f4bc39440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.734+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc39de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.734+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555f4bb879d0 con 0x555f4bc39980 2024-05-08T06:47:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.734+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555f4bb25710 con 0x555f4bc35930 2024-05-08T06:47:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.734+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555f4bb83990 con 0x555f4bc35010 2024-05-08T06:47:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.735+0000 7fb537400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc39de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.735+0000 7fb537e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 0x555f4bc39440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.735+0000 7fb537400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc39de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37688/0 (socket says 172.21.15.70:37688) 2024-05-08T06:47:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.735+0000 7fb537400700 1 -- 172.21.15.70:0/3006332926 learned_addr learned my addr 172.21.15.70:0/3006332926 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.735+0000 7fb53ce00700 1 --2- 172.21.15.70:0/3006332926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc35010 0x555f4bc353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.735+0000 7fb537400700 1 -- 172.21.15.70:0/3006332926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc35010 msgr2=0x555f4bc353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.735+0000 7fb537400700 1 --2- 172.21.15.70:0/3006332926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc35010 0x555f4bc353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.736+0000 7fb537400700 1 -- 172.21.15.70:0/3006332926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 msgr2=0x555f4bc39440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:13.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.736+0000 7fb537400700 1 --2- 172.21.15.70:0/3006332926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 0x555f4bc39440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.736+0000 7fb537400700 1 -- 172.21.15.70:0/3006332926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4bad4880 con 0x555f4bc39980 2024-05-08T06:47:13.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.736+0000 7fb537e00700 1 --2- 172.21.15.70:0/3006332926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 0x555f4bc39440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:47:13.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.736+0000 7fb534c00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb51c0b2c20 0x7fb51c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.736+0000 7fb534c00700 1 -- 172.21.15.70:0/2678967269 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fb5240e2820 con 0x7fb53810a490 2024-05-08T06:47:13.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.736+0000 7fb53ce00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb51c0b2c20 0x7fb51c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.736+0000 7fb537400700 1 --2- 172.21.15.70:0/3006332926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc39de0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb5240df900 tx=0x7fb5240e8ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41b2ae656d1d499 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:13.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.737+0000 7fb52d600700 1 -- 172.21.15.70:0/3006332926 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524020070 con 0x555f4bc39980 2024-05-08T06:47:13.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.737+0000 7fb52d600700 1 -- 172.21.15.70:0/3006332926 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5240a9000 con 0x555f4bc39980 2024-05-08T06:47:13.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.737+0000 7fb52d600700 1 -- 172.21.15.70:0/3006332926 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5240a53b0 con 0x555f4bc39980 2024-05-08T06:47:13.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.737+0000 7fb5496dbb80 1 -- 172.21.15.70:0/3006332926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 msgr2=0x555f4bc39de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:13.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.737+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/3006332926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc39de0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb5240df900 tx=0x7fb5240e8ef0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.738+0000 7fb53ce00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb51c0b2c20 0x7fb51c0b50e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5300085e0 tx=0x7fb530007910 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:13.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.738+0000 7fb5496dbb80 1 -- 172.21.15.70:0/3006332926 shutdown_connections 2024-05-08T06:47:13.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.738+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/3006332926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc39de0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.738+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/3006332926 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc35010 0x555f4bc353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.738+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/3006332926 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 0x555f4bc39440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.738+0000 7fb5496dbb80 1 -- 172.21.15.70:0/3006332926 >> 172.21.15.70:0/3006332926 conn(0x555f4bb63b10 msgr2=0x555f4bc2f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:13.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.738+0000 7fb5496dbb80 1 -- 172.21.15.70:0/3006332926 shutdown_connections 2024-05-08T06:47:13.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.738+0000 7fb5496dbb80 1 -- 172.21.15.70:0/3006332926 wait complete. 2024-05-08T06:47:13.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.738+0000 7fb5496dbb80 1 -- start start 2024-05-08T06:47:13.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb5496dbb80 1 Processor -- start 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 0x555f4bc40e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35930 0x555f4bc3e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc39980 0x555f4bc3e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555f4bc41b90 con 0x555f4bc35930 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555f4baedad0 con 0x555f4bc35010 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555f4bc41d10 con 0x555f4bc39980 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb5496dbb80 10 client.0 _ll_register_callbacks cb 0x555f4bb2ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb537400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35930 0x555f4bc3e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb537400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35930 0x555f4bc3e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37690/0 (socket says 172.21.15.70:37690) 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.739+0000 7fb537400700 1 -- 172.21.15.70:0/1282675833 learned_addr learned my addr 172.21.15.70:0/1282675833 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb537e00700 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 0x555f4bc40e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb537400700 1 -- 172.21.15.70:0/1282675833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc39980 msgr2=0x555f4bc3e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb537400700 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc39980 0x555f4bc3e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb537400700 1 -- 172.21.15.70:0/1282675833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 msgr2=0x555f4bc40e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb537400700 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 0x555f4bc40e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb537400700 1 -- 172.21.15.70:0/1282675833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f4bb4d3d0 con 0x555f4bc35930 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb537e00700 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 0x555f4bc40e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb537400700 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35930 0x555f4bc3e200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb5240dfaa0 tx=0x7fb5240a5a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d3b88292a1c8b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb522000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb522000700 1 -- 172.21.15.70:0/1282675833 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524020040 con 0x555f4bc35930 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb522000700 1 -- 172.21.15.70:0/1282675833 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fb5240e2620 con 0x555f4bc35930 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.740+0000 7fb5496dbb80 1 -- 172.21.15.70:0/1282675833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5240a9000 con 0x555f4bc35930 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb522000700 1 -- 172.21.15.70:0/1282675833 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb5240a8c60 con 0x555f4bc35930 2024-05-08T06:47:13.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb5496dbb80 10 client.15369 fetch_fsmap learned FSMap version 27 2024-05-08T06:47:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb5496dbb80 1 -- 172.21.15.70:0/1282675833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555f4bc4c480 con 0x555f4bc35930 2024-05-08T06:47:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb522000700 1 -- 172.21.15.70:0/1282675833 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5240a9000 con 0x555f4bc35930 2024-05-08T06:47:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb522000700 1 -- 172.21.15.70:0/1282675833 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb5240e1070 con 0x555f4bc35930 2024-05-08T06:47:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb5496dbb80 10 client.15369 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:47:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb5496dbb80 10 client.15369 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-08T06:47:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb5496dbb80 20 client.15369 populate_metadata read hostname 'smithi070' 2024-05-08T06:47:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x555f4bc4d7d0 0x555f4bc4f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb5496dbb80 4 client.15369 mds_command: new command op to 34379 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:47:13.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.741+0000 7fb5496dbb80 1 -- 172.21.15.70:0/1282675833 --> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f4bc02050 con 0x555f4bc4d7d0 2024-05-08T06:47:13.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.742+0000 7fb537e00700 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x555f4bc4d7d0 0x555f4bc4f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.743+0000 7fb537e00700 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x555f4bc4d7d0 0x555f4bc4f970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24b5964c88674091 server_cookie=3e3c3c7ad05d2fb1 in_seq=0 out_seq=0 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.743+0000 7fb522000700 10 client.15369 ms_handle_connect on v2:172.21.15.172:6834/3516901387 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb522000700 1 -- 172.21.15.70:0/1282675833 <== mds.2 v2:172.21.15.172:6834/3516901387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555f4bc02050 con 0x555f4bc4d7d0 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb522000700 10 client.15369 handle_command_reply: tid=0 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 client.15369 shutdown 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 -- 172.21.15.70:0/1282675833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35930 msgr2=0x555f4bc3e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35930 0x555f4bc3e200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb5240dfaa0 tx=0x7fb5240a5a40 comp rx=0 tx=0).stop 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 -- 172.21.15.70:0/1282675833 shutdown_connections 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x555f4bc4d7d0 0x555f4bc4f970 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc39980 0x555f4bc3e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 0x555f4bc40e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/1282675833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35930 0x555f4bc3e200 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb522000700 0 client.15369 ms_handle_reset on v2:172.21.15.172:6834/3516901387 2024-05-08T06:47:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 -- 172.21.15.70:0/1282675833 >> 172.21.15.70:0/1282675833 conn(0x555f4bb63b10 msgr2=0x555f4bc2a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 -- 172.21.15.70:0/1282675833 shutdown_connections 2024-05-08T06:47:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 1 -- 172.21.15.70:0/1282675833 wait complete. 2024-05-08T06:47:13.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.745+0000 7fb5496dbb80 20 client.15369 trim_cache size 0 max 16384 2024-05-08T06:47:13.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb5496dbb80 1 Processor -- start 2024-05-08T06:47:13.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb5496dbb80 1 -- start start 2024-05-08T06:47:13.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 0x555f4bc3ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc35930 0x555f4bc3e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc2a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555f4bc4dcb0 con 0x555f4bc39980 2024-05-08T06:47:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555f4bc4e380 con 0x555f4bc35010 2024-05-08T06:47:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555f4bc4ea50 con 0x555f4bc35930 2024-05-08T06:47:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb53ce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc2a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb53ce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc2a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37706/0 (socket says 172.21.15.70:37706) 2024-05-08T06:47:13.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.768+0000 7fb53ce00700 1 -- 172.21.15.70:0/521577497 learned_addr learned my addr 172.21.15.70:0/521577497 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:13.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.769+0000 7fb537e00700 1 --2- 172.21.15.70:0/521577497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 0x555f4bc3ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.769+0000 7fb53ce00700 1 -- 172.21.15.70:0/521577497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc35930 msgr2=0x555f4bc3e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.769+0000 7fb53ce00700 1 --2- 172.21.15.70:0/521577497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc35930 0x555f4bc3e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.769+0000 7fb53ce00700 1 -- 172.21.15.70:0/521577497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 msgr2=0x555f4bc3ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.769+0000 7fb53ce00700 1 --2- 172.21.15.70:0/521577497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 0x555f4bc3ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.769+0000 7fb53ce00700 1 -- 172.21.15.70:0/521577497 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f4bc2c3a0 con 0x555f4bc39980 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.769+0000 7fb53ce00700 1 --2- 172.21.15.70:0/521577497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc2a0e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb530016830 tx=0x7fb53000a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac72cdce1882a5a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.769+0000 7fb52cc00700 1 -- 172.21.15.70:0/521577497 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53001d050 con 0x555f4bc39980 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb52cc00700 1 -- 172.21.15.70:0/521577497 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb530027070 con 0x555f4bc39980 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb52cc00700 1 -- 172.21.15.70:0/521577497 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb530022b50 con 0x555f4bc39980 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb5496dbb80 1 -- 172.21.15.70:0/521577497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 msgr2=0x555f4bc2a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/521577497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc2a0e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb530016830 tx=0x7fb53000a050 comp rx=0 tx=0).stop 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb5496dbb80 1 -- 172.21.15.70:0/521577497 shutdown_connections 2024-05-08T06:47:13.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/521577497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc39980 0x555f4bc2a0e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/521577497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35010 0x555f4bc3ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/521577497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc35930 0x555f4bc3e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb5496dbb80 1 -- 172.21.15.70:0/521577497 >> 172.21.15.70:0/521577497 conn(0x555f4bb63b10 msgr2=0x555f4bc299d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:13.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb5496dbb80 1 -- 172.21.15.70:0/521577497 shutdown_connections 2024-05-08T06:47:13.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.770+0000 7fb5496dbb80 1 -- 172.21.15.70:0/521577497 wait complete. 2024-05-08T06:47:13.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.771+0000 7fb5496dbb80 1 -- start start 2024-05-08T06:47:13.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.771+0000 7fb5496dbb80 1 Processor -- start 2024-05-08T06:47:13.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.771+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35010 0x555f4bc38250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.771+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 0x555f4bc38790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.771+0000 7fb5496dbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc39980 0x555f4bc38d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.771+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555f4bc4f7f0 con 0x555f4bc35010 2024-05-08T06:47:13.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.771+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555f4bc4f120 con 0x555f4bc35930 2024-05-08T06:47:13.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.771+0000 7fb5496dbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555f4bc4fec0 con 0x555f4bc39980 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb5496dbb80 10 client.0 _ll_register_callbacks cb 0x555f4bb2ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb537e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35010 0x555f4bc38250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb537e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35010 0x555f4bc38250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37708/0 (socket says 172.21.15.70:37708) 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb537e00700 1 -- 172.21.15.70:0/2959530631 learned_addr learned my addr 172.21.15.70:0/2959530631 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb537e00700 1 -- 172.21.15.70:0/2959530631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc39980 msgr2=0x555f4bc38d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb537e00700 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc39980 0x555f4bc38d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb537e00700 1 -- 172.21.15.70:0/2959530631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 msgr2=0x555f4bc38790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb537e00700 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 0x555f4bc38790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb537e00700 1 -- 172.21.15.70:0/2959530631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f4bc55700 con 0x555f4bc35010 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb537e00700 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35010 0x555f4bc38250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb528009350 tx=0x7fb528005100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db20546be28f1c7a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.772+0000 7fb522000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.773+0000 7fb522000700 1 -- 172.21.15.70:0/2959530631 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5280056b0 con 0x555f4bc35010 2024-05-08T06:47:13.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.773+0000 7fb522000700 1 -- 172.21.15.70:0/2959530631 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fb5280037c0 con 0x555f4bc35010 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.773+0000 7fb5496dbb80 1 -- 172.21.15.70:0/2959530631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb530027070 con 0x555f4bc35010 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.773+0000 7fb522000700 1 -- 172.21.15.70:0/2959530631 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb52803a050 con 0x555f4bc35010 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.773+0000 7fb5496dbb80 10 client.15375 fetch_fsmap learned FSMap version 27 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.773+0000 7fb5496dbb80 1 -- 172.21.15.70:0/2959530631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555f4bcb9ff0 con 0x555f4bc35010 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.773+0000 7fb522000700 1 -- 172.21.15.70:0/2959530631 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb530027070 con 0x555f4bc35010 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.773+0000 7fb522000700 1 -- 172.21.15.70:0/2959530631 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb52800bc80 con 0x555f4bc35010 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.773+0000 7fb5496dbb80 10 client.15375 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.774+0000 7fb5496dbb80 10 client.15375 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.774+0000 7fb5496dbb80 20 client.15375 populate_metadata read hostname 'smithi070' 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.774+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x555f4bcbecc0 0x555f4bcbd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.774+0000 7fb5496dbb80 4 client.15375 mds_command: new command op to 34379 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:47:13.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.774+0000 7fb5496dbb80 1 -- 172.21.15.70:0/2959530631 --> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] -- command(tid 0: {"prefix": "status"}) -- 0x555f4bb953b0 con 0x555f4bcbecc0 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.774+0000 7fb537400700 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x555f4bcbecc0 0x555f4bcbd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.775+0000 7fb537400700 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x555f4bcbecc0 0x555f4bcbd9d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a57b98c194e7e35e server_cookie=655d109eec69db2e in_seq=0 out_seq=0 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.775+0000 7fb522000700 10 client.15375 ms_handle_connect on v2:172.21.15.172:6834/3516901387 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb522000700 1 -- 172.21.15.70:0/2959530631 <== mds.2 v2:172.21.15.172:6834/3516901387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555f4bb953b0 con 0x555f4bcbecc0 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb522000700 10 client.15375 handle_command_reply: tid=0 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 client.15375 shutdown 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 -- 172.21.15.70:0/2959530631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35010 msgr2=0x555f4bc38250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35010 0x555f4bc38250 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb528009350 tx=0x7fb528005100 comp rx=0 tx=0).stop 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 -- 172.21.15.70:0/2959530631 shutdown_connections 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.172:6834/3516901387,v1:172.21.15.172:6835/3516901387] conn(0x555f4bcbecc0 0x555f4bcbd9d0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555f4bc39980 0x555f4bc38d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555f4bc35010 0x555f4bc38250 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 --2- 172.21.15.70:0/2959530631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555f4bc35930 0x555f4bc38790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 -- 172.21.15.70:0/2959530631 >> 172.21.15.70:0/2959530631 conn(0x555f4bb63b10 msgr2=0x555f4bc3c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb522000700 0 client.15375 ms_handle_reset on v2:172.21.15.172:6834/3516901387 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 -- 172.21.15.70:0/2959530631 shutdown_connections 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 1 -- 172.21.15.70:0/2959530631 wait complete. 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.776+0000 7fb5496dbb80 20 client.15375 trim_cache size 0 max 16384 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-05-08T06:47:13.778 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34379, 2024-05-08T06:47:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:47:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:47:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:47:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 273.53509590099998, 2024-05-08T06:47:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-05-08T06:47:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 93, 2024-05-08T06:47:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 92, 2024-05-08T06:47:13.779 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 412.76132756300001 2024-05-08T06:47:13.779 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:47:13.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 -- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb51c0b2c20 msgr2=0x7fb51c0b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:13.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb51c0b2c20 0x7fb51c0b50e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5300085e0 tx=0x7fb530007910 comp rx=0 tx=0).stop 2024-05-08T06:47:13.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 -- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810a490 msgr2=0x7fb5381a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:13.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810a490 0x7fb5381a0600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb52400d950 tx=0x7fb52400dd10 comp rx=0 tx=0).stop 2024-05-08T06:47:13.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 -- 172.21.15.70:0/2678967269 shutdown_connections 2024-05-08T06:47:13.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb51c0b2c20 0x7fb51c0b50e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb53810fb60 0x7fb5381a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb538109ad0 0x7fb5381a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 --2- 172.21.15.70:0/2678967269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb53810a490 0x7fb5381a0600 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:13.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 -- 172.21.15.70:0/2678967269 >> 172.21.15.70:0/2678967269 conn(0x7fb538076c70 msgr2=0x7fb538077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:13.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 -- 172.21.15.70:0/2678967269 shutdown_connections 2024-05-08T06:47:13.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:13.777+0000 7fb53ee00700 1 -- 172.21.15.70:0/2678967269 wait complete. 2024-05-08T06:47:14.344 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:14 smithi070 ceph-mon[29591]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:47:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:14 smithi172 ceph-mon[33377]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:47:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:14 smithi194 ceph-mon[33679]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:47:14.895 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-08T06:47:15.340 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:47:16.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:16 smithi070 ceph-mon[29591]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:47:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:16 smithi172 ceph-mon[33377]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:47:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:16 smithi194 ceph-mon[33679]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:47:17.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.867+0000 7f690ba00700 1 -- 172.21.15.70:0/1444360054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6904109510 msgr2=0x7f69041098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:17.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.867+0000 7f690ba00700 1 --2- 172.21.15.70:0/1444360054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6904109510 0x7f69041098f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009990 tx=0x7f68f8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.867+0000 7f690ba00700 1 -- 172.21.15.70:0/1444360054 shutdown_connections 2024-05-08T06:47:17.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.867+0000 7f690ba00700 1 --2- 172.21.15.70:0/1444360054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f690406bb40 0x7f6904110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.867+0000 7f690ba00700 1 --2- 172.21.15.70:0/1444360054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6904109510 0x7f69041098f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.867+0000 7f690ba00700 1 --2- 172.21.15.70:0/1444360054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f690406b180 0x7f690406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.867+0000 7f690ba00700 1 -- 172.21.15.70:0/1444360054 >> 172.21.15.70:0/1444360054 conn(0x7f6904079350 msgr2=0x7f6904079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:17.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.867+0000 7f690ba00700 1 -- 172.21.15.70:0/1444360054 shutdown_connections 2024-05-08T06:47:17.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.867+0000 7f690ba00700 1 -- 172.21.15.70:0/1444360054 wait complete. 2024-05-08T06:47:17.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.868+0000 7f690ba00700 1 Processor -- start 2024-05-08T06:47:17.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.868+0000 7f690ba00700 1 -- start start 2024-05-08T06:47:17.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f690ba00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f690406b180 0x7f69041a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f690ba00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690406bb40 0x7f69041a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f690ba00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6904109510 0x7f690419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f690ba00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f69041134d0 con 0x7f690406bb40 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f690ba00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6904113350 con 0x7f690406b180 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f690ba00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6904113650 con 0x7f6904109510 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6903e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690406bb40 0x7f69041a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6903e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690406bb40 0x7f69041a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54418/0 (socket says 172.21.15.70:54418) 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6903e00700 1 -- 172.21.15.70:0/3080938230 learned_addr learned my addr 172.21.15.70:0/3080938230 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6909000700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f690406b180 0x7f69041a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6909a00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6904109510 0x7f690419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6903e00700 1 -- 172.21.15.70:0/3080938230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6904109510 msgr2=0x7f690419baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6903e00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6904109510 0x7f690419baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6903e00700 1 -- 172.21.15.70:0/3080938230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f690406b180 msgr2=0x7f69041a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6903e00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f690406b180 0x7f69041a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.869+0000 7f6903e00700 1 -- 172.21.15.70:0/3080938230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690419c250 con 0x7f690406bb40 2024-05-08T06:47:17.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.870+0000 7f6903e00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690406bb40 0x7f69041a1e20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f68f000d950 tx=0x7f68f000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:17.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.870+0000 7f6901600700 1 -- 172.21.15.70:0/3080938230 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f0016070 con 0x7f690406bb40 2024-05-08T06:47:17.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.870+0000 7f6901600700 1 -- 172.21.15.70:0/3080938230 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68f0010460 con 0x7f690406bb40 2024-05-08T06:47:17.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.870+0000 7f690ba00700 1 -- 172.21.15.70:0/3080938230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690419c540 con 0x7f690406bb40 2024-05-08T06:47:17.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.870+0000 7f6901600700 1 -- 172.21.15.70:0/3080938230 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f000f620 con 0x7f690406bb40 2024-05-08T06:47:17.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.870+0000 7f690ba00700 1 -- 172.21.15.70:0/3080938230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69041a87b0 con 0x7f690406bb40 2024-05-08T06:47:17.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.874+0000 7f6901600700 1 -- 172.21.15.70:0/3080938230 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 149936+0+0 (secure 0 0 0) 0x7f68f0019070 con 0x7f690406bb40 2024-05-08T06:47:17.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.875+0000 7f691635fb80 1 Processor -- start 2024-05-08T06:47:17.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.875+0000 7f691635fb80 1 -- start start 2024-05-08T06:47:17.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.875+0000 7f691635fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.875+0000 7f691635fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 0x560edd3f1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.875+0000 7f691635fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.875+0000 7f691635fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560edd33f9d0 con 0x560edd3ed010 2024-05-08T06:47:17.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.875+0000 7f691635fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560edd2dd710 con 0x560edd3ed930 2024-05-08T06:47:17.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.875+0000 7f691635fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560edd33b990 con 0x560edd3f1980 2024-05-08T06:47:17.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6901600700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68ec0b2ba0 0x7f68ec0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6909a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6909a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3ed3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54422/0 (socket says 172.21.15.70:54422) 2024-05-08T06:47:17.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6909a00700 1 -- 172.21.15.70:0/38982769 learned_addr learned my addr 172.21.15.70:0/38982769 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:17.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6901600700 1 -- 172.21.15.70:0/3080938230 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f68f00e28a0 con 0x7f690406bb40 2024-05-08T06:47:17.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6909000700 1 --2- 172.21.15.70:0/38982769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 0x560edd3f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6909a00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68ec0b2ba0 0x7f68ec0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6903e00700 1 --2- 172.21.15.70:0/38982769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6909a00700 1 -- 172.21.15.70:0/38982769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 msgr2=0x560edd3f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.876+0000 7f6909a00700 1 --2- 172.21.15.70:0/38982769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.877+0000 7f6909a00700 1 -- 172.21.15.70:0/38982769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 msgr2=0x560edd3f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.877+0000 7f6909a00700 1 --2- 172.21.15.70:0/38982769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 0x560edd3f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.877+0000 7f6909a00700 1 -- 172.21.15.70:0/38982769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560edd28c880 con 0x560edd3ed010 2024-05-08T06:47:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.877+0000 7f6909a00700 1 --2- 172.21.15.70:0/38982769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3ed3f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0060b0 tx=0x7f68fc0185e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae32434592f6c276 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.877+0000 7f6909a00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68ec0b2ba0 0x7f68ec0b5060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009fd0 tx=0x7f68fc01c000 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:17.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.877+0000 7f68f6000700 1 -- 172.21.15.70:0/38982769 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc012040 con 0x560edd3ed010 2024-05-08T06:47:17.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.877+0000 7f68f6000700 1 -- 172.21.15.70:0/38982769 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68fc01bbf0 con 0x560edd3ed010 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.877+0000 7f68f6000700 1 -- 172.21.15.70:0/38982769 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68fc01a740 con 0x560edd3ed010 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.878+0000 7f691635fb80 1 -- 172.21.15.70:0/38982769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 msgr2=0x560edd3ed3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.878+0000 7f691635fb80 1 --2- 172.21.15.70:0/38982769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3ed3f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0060b0 tx=0x7f68fc0185e0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.878+0000 7f691635fb80 1 -- 172.21.15.70:0/38982769 shutdown_connections 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.878+0000 7f691635fb80 1 --2- 172.21.15.70:0/38982769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.878+0000 7f691635fb80 1 --2- 172.21.15.70:0/38982769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3ed3f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.878+0000 7f691635fb80 1 --2- 172.21.15.70:0/38982769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 0x560edd3f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.878+0000 7f691635fb80 1 -- 172.21.15.70:0/38982769 >> 172.21.15.70:0/38982769 conn(0x560edd31bb10 msgr2=0x560edd3e7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.878+0000 7f691635fb80 1 -- 172.21.15.70:0/38982769 shutdown_connections 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.878+0000 7f691635fb80 1 -- 172.21.15.70:0/38982769 wait complete. 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.879+0000 7f691635fb80 1 -- start start 2024-05-08T06:47:17.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.879+0000 7f691635fb80 1 Processor -- start 2024-05-08T06:47:17.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f691635fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd3f8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f691635fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd3f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f691635fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f691635fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560edd3f9b30 con 0x560edd3ed930 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f691635fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560edd2a5ad0 con 0x560edd3ed010 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f691635fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560edd3f9cb0 con 0x560edd3f1980 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f691635fb80 10 client.0 _ll_register_callbacks cb 0x560edd2e6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f6903e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd3f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f6903e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd3f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54428/0 (socket says 172.21.15.70:54428) 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f6903e00700 1 -- 172.21.15.70:0/422340508 learned_addr learned my addr 172.21.15.70:0/422340508 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f6909a00700 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f6909000700 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd3f8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.880+0000 7f6903e00700 1 -- 172.21.15.70:0/422340508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 msgr2=0x560edd3f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f6903e00700 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f6903e00700 1 -- 172.21.15.70:0/422340508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 msgr2=0x560edd3f8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f6903e00700 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd3f8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f6903e00700 1 -- 172.21.15.70:0/422340508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560edd3053d0 con 0x560edd3ed930 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f6909000700 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd3f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f6903e00700 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd3f61e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f68f000b2f0 tx=0x7f68f0010890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c78297dd7f82956 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f68eaa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f68eaa00700 1 -- 172.21.15.70:0/422340508 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f00a9570 con 0x560edd3ed930 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f68eaa00700 1 -- 172.21.15.70:0/422340508 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f68f00e2470 con 0x560edd3ed930 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f691635fb80 1 -- 172.21.15.70:0/422340508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68fc01bbf0 con 0x560edd3ed930 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f68eaa00700 1 -- 172.21.15.70:0/422340508 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f68f00ad920 con 0x560edd3ed930 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f691635fb80 10 client.15387 fetch_fsmap learned FSMap version 27 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.881+0000 7f691635fb80 1 -- 172.21.15.70:0/422340508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560edd404410 con 0x560edd3ed930 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.882+0000 7f68eaa00700 1 -- 172.21.15.70:0/422340508 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68fc01bbf0 con 0x560edd3ed930 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.882+0000 7f68eaa00700 1 -- 172.21.15.70:0/422340508 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f68f00a87d0 con 0x560edd3ed930 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.882+0000 7f691635fb80 10 client.15387 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:47:17.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.882+0000 7f691635fb80 10 client.15387 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T06:47:17.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.882+0000 7f691635fb80 20 client.15387 populate_metadata read hostname 'smithi070' 2024-05-08T06:47:17.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.882+0000 7f691635fb80 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x560edd4069d0 0x560edd407e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.882+0000 7f691635fb80 4 client.15387 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:47:17.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.882+0000 7f691635fb80 1 -- 172.21.15.70:0/422340508 --> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560edd3ba050 con 0x560edd4069d0 2024-05-08T06:47:17.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.883+0000 7f6909000700 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x560edd4069d0 0x560edd407e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.884+0000 7f6909000700 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x560edd4069d0 0x560edd407e40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4dd3866a3cee6f11 server_cookie=cdc3ea75bb9f4a04 in_seq=0 out_seq=0 2024-05-08T06:47:17.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.884+0000 7f68eaa00700 10 client.15387 ms_handle_connect on v2:172.21.15.172:6836/2037790761 2024-05-08T06:47:17.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f68eaa00700 1 -- 172.21.15.70:0/422340508 <== mds.1 v2:172.21.15.172:6836/2037790761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560edd3ba050 con 0x560edd4069d0 2024-05-08T06:47:17.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f68eaa00700 10 client.15387 handle_command_reply: tid=0 2024-05-08T06:47:17.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 client.15387 shutdown 2024-05-08T06:47:17.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 -- 172.21.15.70:0/422340508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 msgr2=0x560edd3f61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:17.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd3f61e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f68f000b2f0 tx=0x7f68f0010890 comp rx=0 tx=0).stop 2024-05-08T06:47:17.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 -- 172.21.15.70:0/422340508 shutdown_connections 2024-05-08T06:47:17.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x560edd4069d0 0x560edd407e40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd3f8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 --2- 172.21.15.70:0/422340508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd3f61e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 -- 172.21.15.70:0/422340508 >> 172.21.15.70:0/422340508 conn(0x560edd31bb10 msgr2=0x560edd3e2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:17.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f68eaa00700 0 client.15387 ms_handle_reset on v2:172.21.15.172:6836/2037790761 2024-05-08T06:47:17.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.886+0000 7f691635fb80 1 -- 172.21.15.70:0/422340508 shutdown_connections 2024-05-08T06:47:17.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.887+0000 7f691635fb80 1 -- 172.21.15.70:0/422340508 wait complete. 2024-05-08T06:47:17.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.887+0000 7f691635fb80 20 client.15387 trim_cache size 0 max 16384 2024-05-08T06:47:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.909+0000 7f691635fb80 1 Processor -- start 2024-05-08T06:47:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.909+0000 7f691635fb80 1 -- start start 2024-05-08T06:47:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.909+0000 7f691635fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3e75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.909+0000 7f691635fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 0x560edd3f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.909+0000 7f691635fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.909+0000 7f691635fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560edd406180 con 0x560edd3ed010 2024-05-08T06:47:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.909+0000 7f691635fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560edd406850 con 0x560edd3ed930 2024-05-08T06:47:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.909+0000 7f691635fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560edd406f20 con 0x560edd3f1980 2024-05-08T06:47:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6909000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3e75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6909000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3e75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54444/0 (socket says 172.21.15.70:54444) 2024-05-08T06:47:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6909000700 1 -- 172.21.15.70:0/144527343 learned_addr learned my addr 172.21.15.70:0/144527343 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6909a00700 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6903e00700 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 0x560edd3f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6909000700 1 -- 172.21.15.70:0/144527343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 msgr2=0x560edd3f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6909000700 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6909000700 1 -- 172.21.15.70:0/144527343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 msgr2=0x560edd3f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6909000700 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 0x560edd3f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6909000700 1 -- 172.21.15.70:0/144527343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560edd3e43a0 con 0x560edd3ed010 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.910+0000 7f6903e00700 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 0x560edd3f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.911+0000 7f6909000700 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3e75b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f68f8000c00 tx=0x7f68f801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754b6cb4806f8a3c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.911+0000 7f68f5600700 1 -- 172.21.15.70:0/144527343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f80056a0 con 0x560edd3ed010 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.911+0000 7f68f5600700 1 -- 172.21.15.70:0/144527343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68f8003c50 con 0x560edd3ed010 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.911+0000 7f68f5600700 1 -- 172.21.15.70:0/144527343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f800bb40 con 0x560edd3ed010 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.912+0000 7f691635fb80 1 -- 172.21.15.70:0/144527343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 msgr2=0x560edd3e75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.912+0000 7f691635fb80 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3e75b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f68f8000c00 tx=0x7f68f801a040 comp rx=0 tx=0).stop 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.912+0000 7f691635fb80 1 -- 172.21.15.70:0/144527343 shutdown_connections 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.912+0000 7f691635fb80 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd3f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.912+0000 7f691635fb80 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed010 0x560edd3e75b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.912+0000 7f691635fb80 1 --2- 172.21.15.70:0/144527343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed930 0x560edd3f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.912+0000 7f691635fb80 1 -- 172.21.15.70:0/144527343 >> 172.21.15.70:0/144527343 conn(0x560edd31bb10 msgr2=0x560edd3e1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.912+0000 7f691635fb80 1 -- 172.21.15.70:0/144527343 shutdown_connections 2024-05-08T06:47:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.912+0000 7f691635fb80 1 -- 172.21.15.70:0/144527343 wait complete. 2024-05-08T06:47:17.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.913+0000 7f691635fb80 1 -- start start 2024-05-08T06:47:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.913+0000 7f691635fb80 1 Processor -- start 2024-05-08T06:47:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.913+0000 7f691635fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd4112c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.913+0000 7f691635fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd411800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.913+0000 7f691635fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd40c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.913+0000 7f691635fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560edd407cc0 con 0x560edd3ed930 2024-05-08T06:47:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.913+0000 7f691635fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560edd4075f0 con 0x560edd3ed010 2024-05-08T06:47:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.913+0000 7f691635fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560edd408390 con 0x560edd3f1980 2024-05-08T06:47:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.913+0000 7f691635fb80 10 client.0 _ll_register_callbacks cb 0x560edd2e6c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:47:17.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6903e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd411800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6903e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd411800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54454/0 (socket says 172.21.15.70:54454) 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6903e00700 1 -- 172.21.15.70:0/1708281301 learned_addr learned my addr 172.21.15.70:0/1708281301 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6909000700 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd4112c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6903e00700 1 -- 172.21.15.70:0/1708281301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 msgr2=0x560edd40c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6903e00700 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd40c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6903e00700 1 -- 172.21.15.70:0/1708281301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 msgr2=0x560edd4112c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6903e00700 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd4112c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6903e00700 1 -- 172.21.15.70:0/1708281301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560edd3f2cb0 con 0x560edd3ed930 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6909000700 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd4112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f6903e00700 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd411800 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f68f00dfad0 tx=0x7f68f00a8f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b72936bf0b2508 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.914+0000 7f68eaa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f68eaa00700 1 -- 172.21.15.70:0/1708281301 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f00a9570 con 0x560edd3ed930 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f68eaa00700 1 -- 172.21.15.70:0/1708281301 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f68f00b1f40 con 0x560edd3ed930 2024-05-08T06:47:17.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f691635fb80 1 -- 172.21.15.70:0/1708281301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68f8003c50 con 0x560edd3ed930 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f68eaa00700 1 -- 172.21.15.70:0/1708281301 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f68f00b23d0 con 0x560edd3ed930 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f691635fb80 10 client.15393 fetch_fsmap learned FSMap version 27 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f691635fb80 1 -- 172.21.15.70:0/1708281301 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560edd472720 con 0x560edd3ed930 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f68eaa00700 1 -- 172.21.15.70:0/1708281301 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68f8003c50 con 0x560edd3ed930 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f68eaa00700 1 -- 172.21.15.70:0/1708281301 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f68f00dfcf0 con 0x560edd3ed930 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f691635fb80 10 client.15393 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f691635fb80 10 client.15393 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.915+0000 7f691635fb80 20 client.15393 populate_metadata read hostname 'smithi070' 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.916+0000 7f691635fb80 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x560edd477160 0x560edd475e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.916+0000 7f691635fb80 4 client.15393 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:47:17.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.916+0000 7f691635fb80 1 -- 172.21.15.70:0/1708281301 --> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] -- command(tid 0: {"prefix": "status"}) -- 0x560edd34d3b0 con 0x560edd477160 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.916+0000 7f6909000700 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x560edd477160 0x560edd475e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.917+0000 7f6909000700 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x560edd477160 0x560edd475e70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=896bfcddfb9f0aad server_cookie=b5a7c3a35b9dff49 in_seq=0 out_seq=0 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.917+0000 7f68eaa00700 10 client.15393 ms_handle_connect on v2:172.21.15.172:6836/2037790761 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.917+0000 7f68eaa00700 1 -- 172.21.15.70:0/1708281301 <== mds.1 v2:172.21.15.172:6836/2037790761 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560edd34d3b0 con 0x560edd477160 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.917+0000 7f68eaa00700 10 client.15393 handle_command_reply: tid=0 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 client.15393 shutdown 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 -- 172.21.15.70:0/1708281301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 msgr2=0x560edd411800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd411800 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f68f00dfad0 tx=0x7f68f00a8f70 comp rx=0 tx=0).stop 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 -- 172.21.15.70:0/1708281301 shutdown_connections 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.172:6836/2037790761,v1:172.21.15.172:6837/2037790761] conn(0x560edd477160 0x560edd475e70 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560edd3f1980 0x560edd40c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560edd3ed010 0x560edd4112c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 --2- 172.21.15.70:0/1708281301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560edd3ed930 0x560edd411800 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 -- 172.21.15.70:0/1708281301 >> 172.21.15.70:0/1708281301 conn(0x560edd31bb10 msgr2=0x560edd3e75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:17.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f68eaa00700 0 client.15393 ms_handle_reset on v2:172.21.15.172:6836/2037790761 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 -- 172.21.15.70:0/1708281301 shutdown_connections 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 1 -- 172.21.15.70:0/1708281301 wait complete. 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.918+0000 7f691635fb80 20 client.15393 trim_cache size 0 max 16384 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34409, 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 278.69656728299998, 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-05-08T06:47:17.920 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 93, 2024-05-08T06:47:17.921 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 92, 2024-05-08T06:47:17.921 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 404.787454561 2024-05-08T06:47:17.921 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:47:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 -- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68ec0b2ba0 msgr2=0x7f68ec0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68ec0b2ba0 0x7f68ec0b5060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009fd0 tx=0x7f68fc01c000 comp rx=0 tx=0).stop 2024-05-08T06:47:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 -- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690406bb40 msgr2=0x7f69041a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690406bb40 0x7f69041a1e20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f68f000d950 tx=0x7f68f000dd10 comp rx=0 tx=0).stop 2024-05-08T06:47:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 -- 172.21.15.70:0/3080938230 shutdown_connections 2024-05-08T06:47:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68ec0b2ba0 0x7f68ec0b5060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6904109510 0x7f690419baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f690406b180 0x7f69041a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 --2- 172.21.15.70:0/3080938230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f690406bb40 0x7f69041a1e20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 -- 172.21.15.70:0/3080938230 >> 172.21.15.70:0/3080938230 conn(0x7f6904079350 msgr2=0x7f6904100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 -- 172.21.15.70:0/3080938230 shutdown_connections 2024-05-08T06:47:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:17.919+0000 7f690ba00700 1 -- 172.21.15.70:0/3080938230 wait complete. 2024-05-08T06:47:18.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:18 smithi070 ceph-mon[29591]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T06:47:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:18 smithi172 ceph-mon[33377]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T06:47:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:18 smithi194 ceph-mon[33679]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T06:47:18.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-08T06:47:19.417 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:47:20.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:20 smithi070 ceph-mon[29591]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T06:47:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:20 smithi172 ceph-mon[33377]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T06:47:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:20 smithi194 ceph-mon[33679]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-05-08T06:47:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.909+0000 7f888b000700 1 -- 172.21.15.70:0/3586171362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8884103610 msgr2=0x7f88841039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.909+0000 7f888b000700 1 --2- 172.21.15.70:0/3586171362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8884103610 0x7f88841039f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f88780099c0 tx=0x7f8878009cd0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.909+0000 7f888b000700 1 -- 172.21.15.70:0/3586171362 shutdown_connections 2024-05-08T06:47:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.909+0000 7f888b000700 1 --2- 172.21.15.70:0/3586171362 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88841086f0 0x7f88841102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.909+0000 7f888b000700 1 --2- 172.21.15.70:0/3586171362 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8884103610 0x7f88841039f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.909+0000 7f888b000700 1 --2- 172.21.15.70:0/3586171362 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8884103fc0 0x7f8884108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.909+0000 7f888b000700 1 -- 172.21.15.70:0/3586171362 >> 172.21.15.70:0/3586171362 conn(0x7f88840feec0 msgr2=0x7f88841012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.910+0000 7f888b000700 1 -- 172.21.15.70:0/3586171362 shutdown_connections 2024-05-08T06:47:21.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.910+0000 7f888b000700 1 -- 172.21.15.70:0/3586171362 wait complete. 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.911+0000 7f888b000700 1 Processor -- start 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.911+0000 7f888b000700 1 -- start start 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.911+0000 7f888b000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8884103610 0x7f88840757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.911+0000 7f888b000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8884103fc0 0x7f8884075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.911+0000 7f888b000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88841086f0 0x7f8884076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.911+0000 7f888b000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8884113430 con 0x7f88841086f0 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.911+0000 7f888b000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88841132b0 con 0x7f8884103fc0 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.911+0000 7f888b000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f88841135b0 con 0x7f8884103610 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f888a600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88841086f0 0x7f8884076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f888a600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88841086f0 0x7f8884076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54460/0 (socket says 172.21.15.70:54460) 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f888a600700 1 -- 172.21.15.70:0/1200307303 learned_addr learned my addr 172.21.15.70:0/1200307303 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f8889200700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8884103fc0 0x7f8884075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f8889c00700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8884103610 0x7f88840757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f888a600700 1 -- 172.21.15.70:0/1200307303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8884103610 msgr2=0x7f88840757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f888a600700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8884103610 0x7f88840757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f888a600700 1 -- 172.21.15.70:0/1200307303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8884103fc0 msgr2=0x7f8884075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f888a600700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8884103fc0 0x7f8884075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.912+0000 7f888a600700 1 -- 172.21.15.70:0/1200307303 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88841a7e30 con 0x7f88841086f0 2024-05-08T06:47:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.913+0000 7f888a600700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88841086f0 0x7f8884076220 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f887c007ee0 tx=0x7f887c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.913+0000 7f8882000700 1 -- 172.21.15.70:0/1200307303 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c00dbd0 con 0x7f88841086f0 2024-05-08T06:47:21.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.913+0000 7f8882000700 1 -- 172.21.15.70:0/1200307303 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f887c00dd70 con 0x7f88841086f0 2024-05-08T06:47:21.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.913+0000 7f888b000700 1 -- 172.21.15.70:0/1200307303 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88841a8120 con 0x7f88841086f0 2024-05-08T06:47:21.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.913+0000 7f8882000700 1 -- 172.21.15.70:0/1200307303 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0058d0 con 0x7f88841086f0 2024-05-08T06:47:21.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.913+0000 7f888b000700 1 -- 172.21.15.70:0/1200307303 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88841a8660 con 0x7f88841086f0 2024-05-08T06:47:21.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.917+0000 7f8882000700 1 -- 172.21.15.70:0/1200307303 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 149936+0+0 (secure 0 0 0) 0x7f887c01a020 con 0x7f88841086f0 2024-05-08T06:47:21.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.918+0000 7f8896eb6b80 1 Processor -- start 2024-05-08T06:47:21.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8882000700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f886c0b2c20 0x7f886c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8896eb6b80 1 -- start start 2024-05-08T06:47:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8882000700 1 -- 172.21.15.70:0/1200307303 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f887c0e2450 con 0x7f88841086f0 2024-05-08T06:47:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c684d50 0x55f97c685130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 0x55f97c67f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c67fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8889200700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f886c0b2c20 0x7f886c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f97c5d19d0 con 0x55f97c67fa00 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f97c56f710 con 0x55f97c684d50 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.919+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f97c5cd990 con 0x55f97c685670 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f888a600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c67fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f888a600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c67fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54462/0 (socket says 172.21.15.70:54462) 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f888a600700 1 -- 172.21.15.70:0/951091797 learned_addr learned my addr 172.21.15.70:0/951091797 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f8889c00700 1 --2- 172.21.15.70:0/951091797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c684d50 0x55f97c685130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f8889200700 1 --2- 172.21.15.70:0/951091797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 0x55f97c67f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f888a600700 1 -- 172.21.15.70:0/951091797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 msgr2=0x55f97c67f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f888a600700 1 --2- 172.21.15.70:0/951091797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 0x55f97c67f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f888a600700 1 -- 172.21.15.70:0/951091797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c684d50 msgr2=0x55f97c685130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f888a600700 1 --2- 172.21.15.70:0/951091797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c684d50 0x55f97c685130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f8889200700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f886c0b2c20 0x7f886c0b50e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8874005ea0 tx=0x7f887400e350 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.920+0000 7f888a600700 1 -- 172.21.15.70:0/951091797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f97c51e880 con 0x55f97c67fa00 2024-05-08T06:47:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.921+0000 7f888a600700 1 --2- 172.21.15.70:0/951091797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c67fe80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f887c0a8e20 tx=0x7f887c0a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5569387b89a7b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.921+0000 7f8872a00700 1 -- 172.21.15.70:0/951091797 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0a9820 con 0x55f97c67fa00 2024-05-08T06:47:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.921+0000 7f8872a00700 1 -- 172.21.15.70:0/951091797 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f887c0a9120 con 0x55f97c67fa00 2024-05-08T06:47:21.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.921+0000 7f8872a00700 1 -- 172.21.15.70:0/951091797 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0a9380 con 0x55f97c67fa00 2024-05-08T06:47:21.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 -- 172.21.15.70:0/951091797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 msgr2=0x55f97c67fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:21.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/951091797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c67fe80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f887c0a8e20 tx=0x7f887c0a9000 comp rx=0 tx=0).stop 2024-05-08T06:47:21.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 -- 172.21.15.70:0/951091797 shutdown_connections 2024-05-08T06:47:21.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/951091797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c67fe80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/951091797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c684d50 0x55f97c685130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/951091797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 0x55f97c67f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 -- 172.21.15.70:0/951091797 >> 172.21.15.70:0/951091797 conn(0x55f97c5f7680 msgr2=0x55f97c679c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:21.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 -- 172.21.15.70:0/951091797 shutdown_connections 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 -- 172.21.15.70:0/951091797 wait complete. 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.922+0000 7f8896eb6b80 1 -- start start 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.923+0000 7f8896eb6b80 1 Processor -- start 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.923+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c68b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.923+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 0x55f97c6887c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.923+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c685670 0x55f97c688d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.923+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f97c68c0f0 con 0x55f97c67fa00 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.923+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f97c537ad0 con 0x55f97c685670 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.923+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f97c68c270 con 0x55f97c684d50 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.923+0000 7f8896eb6b80 10 client.0 _ll_register_callbacks cb 0x55f97c578c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:47:21.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f8889c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c68b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f8889c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c68b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54464/0 (socket says 172.21.15.70:54464) 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f8889c00700 1 -- 172.21.15.70:0/1460929727 learned_addr learned my addr 172.21.15.70:0/1460929727 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f888a600700 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c685670 0x55f97c688d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f8889200700 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 0x55f97c6887c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f8889c00700 1 -- 172.21.15.70:0/1460929727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 msgr2=0x55f97c6887c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f8889c00700 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 0x55f97c6887c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f8889c00700 1 -- 172.21.15.70:0/1460929727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c685670 msgr2=0x55f97c688d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f8889c00700 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c685670 0x55f97c688d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.924+0000 7f8889c00700 1 -- 172.21.15.70:0/1460929727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f97c5973d0 con 0x55f97c67fa00 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.925+0000 7f8889c00700 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c68b420 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f88780099c0 tx=0x7f8878005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5119baf61c1d46e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.925+0000 7f8867400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.925+0000 7f8867400700 1 -- 172.21.15.70:0/1460929727 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878005270 con 0x55f97c67fa00 2024-05-08T06:47:21.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.925+0000 7f8867400700 1 -- 172.21.15.70:0/1460929727 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f8878005410 con 0x55f97c67fa00 2024-05-08T06:47:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.925+0000 7f8896eb6b80 1 -- 172.21.15.70:0/1460929727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f887c0a9120 con 0x55f97c67fa00 2024-05-08T06:47:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.925+0000 7f8867400700 1 -- 172.21.15.70:0/1460929727 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8878030050 con 0x55f97c67fa00 2024-05-08T06:47:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.925+0000 7f8896eb6b80 10 client.15405 fetch_fsmap learned FSMap version 27 2024-05-08T06:47:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.925+0000 7f8896eb6b80 1 -- 172.21.15.70:0/1460929727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f97c696a20 con 0x55f97c67fa00 2024-05-08T06:47:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.925+0000 7f8867400700 1 -- 172.21.15.70:0/1460929727 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f887c0a9120 con 0x55f97c67fa00 2024-05-08T06:47:21.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.926+0000 7f8867400700 1 -- 172.21.15.70:0/1460929727 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f887802b030 con 0x55f97c67fa00 2024-05-08T06:47:21.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.926+0000 7f8896eb6b80 10 client.15405 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:47:21.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.926+0000 7f8896eb6b80 10 client.15405 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.926+0000 7f8896eb6b80 20 client.15405 populate_metadata read hostname 'smithi070' 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.926+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f97c699050 0x55f97c69a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.926+0000 7f8896eb6b80 4 client.15405 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.926+0000 7f8896eb6b80 1 -- 172.21.15.70:0/1460929727 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f97c64c0f0 con 0x55f97c699050 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.927+0000 7f8889200700 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f97c699050 0x55f97c69a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.928+0000 7f8889200700 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f97c699050 0x55f97c69a4c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5597c0b6657c76a6 server_cookie=caadf5249abdea70 in_seq=0 out_seq=0 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.928+0000 7f8867400700 10 client.15405 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8867400700 1 -- 172.21.15.70:0/1460929727 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f97c64c0f0 con 0x55f97c699050 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8867400700 10 client.15405 handle_command_reply: tid=0 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 client.15405 shutdown 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 -- 172.21.15.70:0/1460929727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 msgr2=0x55f97c68b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c68b420 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f88780099c0 tx=0x7f8878005940 comp rx=0 tx=0).stop 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 -- 172.21.15.70:0/1460929727 shutdown_connections 2024-05-08T06:47:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f97c699050 0x55f97c69a4c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c685670 0x55f97c688d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c67fa00 0x55f97c68b420 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/1460929727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 0x55f97c6887c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 -- 172.21.15.70:0/1460929727 >> 172.21.15.70:0/1460929727 conn(0x55f97c5f7680 msgr2=0x55f97c674700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8867400700 0 client.15405 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:47:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 -- 172.21.15.70:0/1460929727 shutdown_connections 2024-05-08T06:47:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.930+0000 7f8896eb6b80 1 -- 172.21.15.70:0/1460929727 wait complete. 2024-05-08T06:47:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.931+0000 7f8896eb6b80 20 client.15405 trim_cache size 0 max 16384 2024-05-08T06:47:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.953+0000 7f8896eb6b80 1 Processor -- start 2024-05-08T06:47:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.953+0000 7f8896eb6b80 1 -- start start 2024-05-08T06:47:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 0x55f97c67f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c684d50 0x55f97c674810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 0x55f97c686190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f97c698800 con 0x55f97c684d50 2024-05-08T06:47:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f97c698ed0 con 0x55f97c67fa00 2024-05-08T06:47:21.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f97c6995a0 con 0x55f97c685670 2024-05-08T06:47:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c684d50 0x55f97c674810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c684d50 0x55f97c674810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54476/0 (socket says 172.21.15.70:54476) 2024-05-08T06:47:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889200700 1 -- 172.21.15.70:0/2381136010 learned_addr learned my addr 172.21.15.70:0/2381136010 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889c00700 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 0x55f97c67f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f888a600700 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 0x55f97c686190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889200700 1 -- 172.21.15.70:0/2381136010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 msgr2=0x55f97c686190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889200700 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 0x55f97c686190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889200700 1 -- 172.21.15.70:0/2381136010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 msgr2=0x55f97c67f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889200700 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 0x55f97c67f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889200700 1 -- 172.21.15.70:0/2381136010 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f97c685380 con 0x55f97c684d50 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f8889c00700 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 0x55f97c67f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.954+0000 7f888a600700 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 0x55f97c686190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.955+0000 7f8889200700 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c684d50 0x55f97c674810 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8884109c00 tx=0x7f8874015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbc74b50832bb79 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.955+0000 7f8872000700 1 -- 172.21.15.70:0/2381136010 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874012b50 con 0x55f97c684d50 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.955+0000 7f8872000700 1 -- 172.21.15.70:0/2381136010 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f887402b070 con 0x55f97c684d50 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.955+0000 7f8872000700 1 -- 172.21.15.70:0/2381136010 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874010690 con 0x55f97c684d50 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 -- 172.21.15.70:0/2381136010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c684d50 msgr2=0x55f97c674810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:21.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c684d50 0x55f97c674810 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8884109c00 tx=0x7f8874015000 comp rx=0 tx=0).stop 2024-05-08T06:47:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 -- 172.21.15.70:0/2381136010 shutdown_connections 2024-05-08T06:47:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c685670 0x55f97c686190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 0x55f97c67f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/2381136010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c684d50 0x55f97c674810 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 -- 172.21.15.70:0/2381136010 >> 172.21.15.70:0/2381136010 conn(0x55f97c5f7680 msgr2=0x55f97c685a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 -- 172.21.15.70:0/2381136010 shutdown_connections 2024-05-08T06:47:21.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 -- 172.21.15.70:0/2381136010 wait complete. 2024-05-08T06:47:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.956+0000 7f8896eb6b80 1 -- start start 2024-05-08T06:47:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.957+0000 7f8896eb6b80 1 Processor -- start 2024-05-08T06:47:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.957+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 0x55f97c6a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.957+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 0x55f97c69e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.957+0000 7f8896eb6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c685670 0x55f97c69ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.957+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f97c69a340 con 0x55f97c685670 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.957+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f97c699c70 con 0x55f97c67fa00 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.957+0000 7f8896eb6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f97c69aa10 con 0x55f97c684d50 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.957+0000 7f8896eb6b80 10 client.0 _ll_register_callbacks cb 0x55f97c578c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f888a600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c685670 0x55f97c69ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f888a600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c685670 0x55f97c69ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54484/0 (socket says 172.21.15.70:54484) 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f888a600700 1 -- 172.21.15.70:0/3203173779 learned_addr learned my addr 172.21.15.70:0/3203173779 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f8889c00700 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 0x55f97c6a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f8889200700 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 0x55f97c69e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f888a600700 1 -- 172.21.15.70:0/3203173779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 msgr2=0x55f97c69e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f888a600700 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 0x55f97c69e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f888a600700 1 -- 172.21.15.70:0/3203173779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 msgr2=0x55f97c6a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:21.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f888a600700 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 0x55f97c6a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f888a600700 1 -- 172.21.15.70:0/3203173779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f97c69f370 con 0x55f97c685670 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f8889200700 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 0x55f97c69e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f888a600700 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c685670 0x55f97c69ee30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f887c009510 tx=0x7f887c00df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8433be78b16f0b7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f8867400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.958+0000 7f8867400700 1 -- 172.21.15.70:0/3203173779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c0a9120 con 0x55f97c685670 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8867400700 1 -- 172.21.15.70:0/3203173779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f887c0a9590 con 0x55f97c685670 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8896eb6b80 1 -- 172.21.15.70:0/3203173779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f887402b070 con 0x55f97c685670 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8867400700 1 -- 172.21.15.70:0/3203173779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f887c0ad4d0 con 0x55f97c685670 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8896eb6b80 10 client.15411 fetch_fsmap learned FSMap version 27 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8896eb6b80 1 -- 172.21.15.70:0/3203173779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f97c705090 con 0x55f97c685670 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8867400700 1 -- 172.21.15.70:0/3203173779 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f887402b070 con 0x55f97c685670 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8867400700 1 -- 172.21.15.70:0/3203173779 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f887c0a8380 con 0x55f97c685670 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8896eb6b80 10 client.15411 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:47:21.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8896eb6b80 10 client.15411 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T06:47:21.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8896eb6b80 20 client.15411 populate_metadata read hostname 'smithi070' 2024-05-08T06:47:21.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f97c709850 0x55f97c708560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:21.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8896eb6b80 4 client.15411 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T06:47:21.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.959+0000 7f8896eb6b80 1 -- 172.21.15.70:0/3203173779 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "status"}) -- 0x55f97c5df3b0 con 0x55f97c709850 2024-05-08T06:47:21.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.960+0000 7f8889c00700 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f97c709850 0x55f97c708560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.961+0000 7f8889c00700 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f97c709850 0x55f97c708560 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cfdc8be5f163404 server_cookie=97fc806ea4b85488 in_seq=0 out_seq=0 2024-05-08T06:47:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.961+0000 7f8867400700 10 client.15411 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:47:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8867400700 1 -- 172.21.15.70:0/3203173779 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f97c5df3b0 con 0x55f97c709850 2024-05-08T06:47:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8867400700 10 client.15411 handle_command_reply: tid=0 2024-05-08T06:47:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 client.15411 shutdown 2024-05-08T06:47:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 -- 172.21.15.70:0/3203173779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c685670 msgr2=0x55f97c69ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c685670 0x55f97c69ee30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f887c009510 tx=0x7f887c00df90 comp rx=0 tx=0).stop 2024-05-08T06:47:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 -- 172.21.15.70:0/3203173779 shutdown_connections 2024-05-08T06:47:21.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f97c709850 0x55f97c708560 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f97c685670 0x55f97c69ee30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f97c67fa00 0x55f97c6a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 --2- 172.21.15.70:0/3203173779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f97c684d50 0x55f97c69e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 -- 172.21.15.70:0/3203173779 >> 172.21.15.70:0/3203173779 conn(0x55f97c5f7680 msgr2=0x55f97c686c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8867400700 0 client.15411 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 -- 172.21.15.70:0/3203173779 shutdown_connections 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 1 -- 172.21.15.70:0/3203173779 wait complete. 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.962+0000 7f8896eb6b80 20 client.15411 trim_cache size 0 max 16384 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "3cf89df8-0d04-11ef-bc97-c7b262605968", 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-05-08T06:47:21.964 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 34442, 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 368.37674205299999, 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 27, 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 93, 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 92, 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 391.35646026199998 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:47:21.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 -- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f886c0b2c20 msgr2=0x7f886c0b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f886c0b2c20 0x7f886c0b50e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8874005ea0 tx=0x7f887400e350 comp rx=0 tx=0).stop 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 -- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88841086f0 msgr2=0x7f8884076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88841086f0 0x7f8884076220 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f887c007ee0 tx=0x7f887c00d3b0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 -- 172.21.15.70:0/1200307303 shutdown_connections 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f886c0b2c20 0x7f886c0b50e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88841086f0 0x7f8884076220 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8884103610 0x7f88840757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 --2- 172.21.15.70:0/1200307303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8884103fc0 0x7f8884075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 -- 172.21.15.70:0/1200307303 >> 172.21.15.70:0/1200307303 conn(0x7f88840feec0 msgr2=0x7f8884101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 -- 172.21.15.70:0/1200307303 shutdown_connections 2024-05-08T06:47:21.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:21.963+0000 7f888b000700 1 -- 172.21.15.70:0/1200307303 wait complete. 2024-05-08T06:47:22.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:22 smithi070 ceph-mon[29591]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-05-08T06:47:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:22 smithi172 ceph-mon[33377]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-05-08T06:47:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:22 smithi194 ceph-mon[33679]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-05-08T06:47:22.927 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-05-08T06:47:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:24 smithi070 ceph-mon[29591]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 852 B/s wr, 5 op/s 2024-05-08T06:47:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:24 smithi172 ceph-mon[33377]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 852 B/s wr, 5 op/s 2024-05-08T06:47:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:24 smithi194 ceph-mon[33679]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 852 B/s wr, 5 op/s 2024-05-08T06:47:26.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:26 smithi070 ceph-mon[29591]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 852 B/s wr, 7 op/s 2024-05-08T06:47:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:26 smithi172 ceph-mon[33377]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 852 B/s wr, 7 op/s 2024-05-08T06:47:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:26 smithi194 ceph-mon[33679]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 852 B/s wr, 7 op/s 2024-05-08T06:47:28.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:28 smithi070 ceph-mon[29591]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-05-08T06:47:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:28 smithi172 ceph-mon[33377]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-05-08T06:47:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:28 smithi194 ceph-mon[33679]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-05-08T06:47:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:30 smithi070 ceph-mon[29591]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-05-08T06:47:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:30 smithi172 ceph-mon[33377]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-05-08T06:47:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:30 smithi194 ceph-mon[33679]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 5 op/s 2024-05-08T06:47:32.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:32 smithi070 ceph-mon[29591]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-05-08T06:47:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:32 smithi172 ceph-mon[33377]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-05-08T06:47:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:32 smithi194 ceph-mon[33679]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-05-08T06:47:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:34 smithi070 ceph-mon[29591]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:34 smithi172 ceph-mon[33377]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:34 smithi194 ceph-mon[33679]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:36.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:36 smithi070 ceph-mon[29591]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:36.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:36 smithi172 ceph-mon[33377]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:36 smithi194 ceph-mon[33679]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:37 smithi172 ceph-mon[33377]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:37 smithi194 ceph-mon[33679]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:37 smithi070 ceph-mon[29591]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:37.928 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T06:47:37.928 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.4 2024-05-08T06:47:37.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:47:38.383 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:47:40.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:39 smithi194 ceph-mon[33679]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:40.079 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:39 smithi070 ceph-mon[29591]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:39 smithi172 ceph-mon[33377]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:40.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.983+0000 7f2d9ae00700 1 -- 172.21.15.70:0/3348023287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94076160 msgr2=0x7f2d94113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:40.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.983+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/3348023287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94076160 0x7f2d94113e90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009990 tx=0x7f2d84009ca0 comp rx=0 tx=0).stop 2024-05-08T06:47:40.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.983+0000 7f2d9ae00700 1 -- 172.21.15.70:0/3348023287 shutdown_connections 2024-05-08T06:47:40.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.983+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/3348023287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d941143d0 0x7f2d941167c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:40.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.983+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/3348023287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d94075840 0x7f2d94075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:40.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.983+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/3348023287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94076160 0x7f2d94113e90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:40.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.983+0000 7f2d9ae00700 1 -- 172.21.15.70:0/3348023287 >> 172.21.15.70:0/3348023287 conn(0x7f2d940feeb0 msgr2=0x7f2d941012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:40.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.983+0000 7f2d9ae00700 1 -- 172.21.15.70:0/3348023287 shutdown_connections 2024-05-08T06:47:40.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.983+0000 7f2d9ae00700 1 -- 172.21.15.70:0/3348023287 wait complete. 2024-05-08T06:47:40.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.984+0000 7f2d9ae00700 1 Processor -- start 2024-05-08T06:47:40.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.984+0000 7f2d9ae00700 1 -- start start 2024-05-08T06:47:40.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d9ae00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94075840 0x7f2d9419ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:40.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d9ae00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d94076160 0x7f2d941a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:40.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d9ae00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d941143d0 0x7f2d941a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:40.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d9ae00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d94119a60 con 0x7f2d94075840 2024-05-08T06:47:40.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d9ae00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d941198e0 con 0x7f2d94076160 2024-05-08T06:47:40.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d9ae00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2d94119be0 con 0x7f2d941143d0 2024-05-08T06:47:40.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d99a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94075840 0x7f2d9419ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:40.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d99a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94075840 0x7f2d9419ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49476/0 (socket says 172.21.15.70:49476) 2024-05-08T06:47:40.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d99a00700 1 -- 172.21.15.70:0/1004352157 learned_addr learned my addr 172.21.15.70:0/1004352157 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d99000700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d94076160 0x7f2d941a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.985+0000 7f2d9a400700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d941143d0 0x7f2d941a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d99a00700 1 -- 172.21.15.70:0/1004352157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d941143d0 msgr2=0x7f2d941a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d99a00700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d941143d0 0x7f2d941a48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d99a00700 1 -- 172.21.15.70:0/1004352157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d94076160 msgr2=0x7f2d941a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d99a00700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d94076160 0x7f2d941a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d99a00700 1 -- 172.21.15.70:0/1004352157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d941a4fe0 con 0x7f2d94075840 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d9a400700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d941143d0 0x7f2d941a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d99a00700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94075840 0x7f2d9419ffd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800d950 tx=0x7f2d8800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:40.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d92000700 1 -- 172.21.15.70:0/1004352157 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d88016070 con 0x7f2d94075840 2024-05-08T06:47:40.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d92000700 1 -- 172.21.15.70:0/1004352157 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d88009dd0 con 0x7f2d94075840 2024-05-08T06:47:40.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d92000700 1 -- 172.21.15.70:0/1004352157 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d8800f3c0 con 0x7f2d94075840 2024-05-08T06:47:40.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.986+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d941a52d0 con 0x7f2d94075840 2024-05-08T06:47:40.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.987+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d941acb50 con 0x7f2d94075840 2024-05-08T06:47:40.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.988+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d94076f80 con 0x7f2d94075840 2024-05-08T06:47:40.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.990+0000 7f2d92000700 1 -- 172.21.15.70:0/1004352157 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 149936+0+0 (secure 0 0 0) 0x7f2d88019070 con 0x7f2d94075840 2024-05-08T06:47:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.992+0000 7f2d92000700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d7c0b2ba0 0x7f2d7c0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.992+0000 7f2d92000700 1 -- 172.21.15.70:0/1004352157 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f2d880e28f0 con 0x7f2d94075840 2024-05-08T06:47:40.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.992+0000 7f2d99000700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d7c0b2ba0 0x7f2d7c0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:40.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.993+0000 7f2d99000700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d7c0b2ba0 0x7f2d7c0b5060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400b5c0 tx=0x7f2d84005960 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:40.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:40.997+0000 7f2d92000700 1 -- 172.21.15.70:0/1004352157 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2d880a9cc0 con 0x7f2d94075840 2024-05-08T06:47:41.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.276+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d941a1330 con 0x7f2d94075840 2024-05-08T06:47:41.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.278+0000 7f2d92000700 1 -- 172.21.15.70:0/1004352157 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11876 (secure 0 0 0) 0x7f2d880a95c0 con 0x7f2d94075840 2024-05-08T06:47:41.277 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:47:41.277 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:46:31.709156+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T06:47:41.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.281+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d7c0b2ba0 msgr2=0x7f2d7c0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:41.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.281+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d7c0b2ba0 0x7f2d7c0b5060 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400b5c0 tx=0x7f2d84005960 comp rx=0 tx=0).stop 2024-05-08T06:47:41.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.281+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94075840 msgr2=0x7f2d9419ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:41.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.281+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94075840 0x7f2d9419ffd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2d8800d950 tx=0x7f2d8800dc60 comp rx=0 tx=0).stop 2024-05-08T06:47:41.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.282+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 shutdown_connections 2024-05-08T06:47:41.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.282+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d7c0b2ba0 0x7f2d7c0b5060 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:41.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.282+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d941143d0 0x7f2d941a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:41.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.282+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d94075840 0x7f2d9419ffd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:41.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.282+0000 7f2d9ae00700 1 --2- 172.21.15.70:0/1004352157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d94076160 0x7f2d941a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:41.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.282+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 >> 172.21.15.70:0/1004352157 conn(0x7f2d940feeb0 msgr2=0x7f2d94100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:41.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.282+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 shutdown_connections 2024-05-08T06:47:41.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:41.282+0000 7f2d9ae00700 1 -- 172.21.15.70:0/1004352157 wait complete. 2024-05-08T06:47:41.282 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-05-08T06:47:41.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:41 smithi070 ceph-mon[29591]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:41.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:41 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1004352157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:47:42.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:41 smithi194 ceph-mon[33679]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:42.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:41 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1004352157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:47:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:41 smithi172 ceph-mon[33377]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:41 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1004352157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:47:42.467 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.4 --await-for 42.0' 2024-05-08T06:47:42.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.4 --await-for 42.0 2024-05-08T06:47:42.900 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:47:43.049 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:47:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:47:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:47:43.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:43 smithi070 ceph-mon[29591]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:43.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:47:43.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:47:43.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:47:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:43 smithi172 ceph-mon[33377]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:47:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:47:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:47:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:43 smithi194 ceph-mon[33679]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:47:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:47:44.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:47:45.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.379+0000 7f6466a00700 1 -- 172.21.15.70:0/1166078368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64601037b0 msgr2=0x7f6460103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:45.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.379+0000 7f6466a00700 1 --2- 172.21.15.70:0/1166078368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64601037b0 0x7f6460103b90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f645000b0d0 tx=0x7f645000b3e0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.379+0000 7f6466a00700 1 -- 172.21.15.70:0/1166078368 shutdown_connections 2024-05-08T06:47:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.379+0000 7f6466a00700 1 --2- 172.21.15.70:0/1166078368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6460108880 0x7f6460110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.380+0000 7f6466a00700 1 --2- 172.21.15.70:0/1166078368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64601037b0 0x7f6460103b90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.380+0000 7f6466a00700 1 --2- 172.21.15.70:0/1166078368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6460104160 0x7f6460108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.380+0000 7f6466a00700 1 -- 172.21.15.70:0/1166078368 >> 172.21.15.70:0/1166078368 conn(0x7f646007a580 msgr2=0x7f646007a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.380+0000 7f6466a00700 1 -- 172.21.15.70:0/1166078368 shutdown_connections 2024-05-08T06:47:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.380+0000 7f6466a00700 1 -- 172.21.15.70:0/1166078368 wait complete. 2024-05-08T06:47:45.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.381+0000 7f6466a00700 1 Processor -- start 2024-05-08T06:47:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.381+0000 7f6466a00700 1 -- start start 2024-05-08T06:47:45.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6466a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64601037b0 0x7f64600757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6466a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6460104160 0x7f6460075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6466a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6460108880 0x7f6460076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6466a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6460113550 con 0x7f6460104160 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6466a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64601133d0 con 0x7f64601037b0 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6466a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64601136d0 con 0x7f6460108880 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6457400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6460104160 0x7f6460075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6457400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6460104160 0x7f6460075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49492/0 (socket says 172.21.15.70:49492) 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6457400700 1 -- 172.21.15.70:0/336834150 learned_addr learned my addr 172.21.15.70:0/336834150 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f645fe00700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64601037b0 0x7f64600757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6457400700 1 -- 172.21.15.70:0/336834150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6460108880 msgr2=0x7f6460076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6457400700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6460108880 0x7f6460076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6457400700 1 -- 172.21.15.70:0/336834150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64601037b0 msgr2=0x7f64600757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:45.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6457400700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64601037b0 0x7f64600757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.382+0000 7f6457400700 1 -- 172.21.15.70:0/336834150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64601a7eb0 con 0x7f6460104160 2024-05-08T06:47:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.383+0000 7f6457400700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6460104160 0x7f6460075ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f644800d950 tx=0x7f644800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:45.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.383+0000 7f645d600700 1 -- 172.21.15.70:0/336834150 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448016070 con 0x7f6460104160 2024-05-08T06:47:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.383+0000 7f645d600700 1 -- 172.21.15.70:0/336834150 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6448010460 con 0x7f6460104160 2024-05-08T06:47:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.383+0000 7f6466a00700 1 -- 172.21.15.70:0/336834150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64601a81a0 con 0x7f6460104160 2024-05-08T06:47:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.383+0000 7f645d600700 1 -- 172.21.15.70:0/336834150 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644800f620 con 0x7f6460104160 2024-05-08T06:47:45.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.383+0000 7f6466a00700 1 -- 172.21.15.70:0/336834150 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64601a8730 con 0x7f6460104160 2024-05-08T06:47:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.388+0000 7f645d600700 1 -- 172.21.15.70:0/336834150 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 149936+0+0 (secure 0 0 0) 0x7f6448019070 con 0x7f6460104160 2024-05-08T06:47:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.389+0000 7f647138db80 1 Processor -- start 2024-05-08T06:47:45.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.389+0000 7f647138db80 1 -- start start 2024-05-08T06:47:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f647138db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa151330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f647138db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa14b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f647138db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f647138db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571aa09dbb0 con 0x5571aa14bee0 2024-05-08T06:47:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f647138db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5571aa03b8f0 con 0x5571aa150f50 2024-05-08T06:47:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f647138db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5571aa099b70 con 0x5571aa14b520 2024-05-08T06:47:45.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f645d600700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64440b2cc0 0x7f64440b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f645d600700 1 -- 172.21.15.70:0/336834150 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f64480e2900 con 0x7f6460104160 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f6457400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f6457400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49498/0 (socket says 172.21.15.70:49498) 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f6457400700 1 -- 172.21.15.70:0/988604514 learned_addr learned my addr 172.21.15.70:0/988604514 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f6464a00700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64440b2cc0 0x7f64440b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f645fe00700 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa14b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.390+0000 7f6464a00700 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6457400700 1 -- 172.21.15.70:0/988604514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 msgr2=0x5571aa14b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6457400700 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa14b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6457400700 1 -- 172.21.15.70:0/988604514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 msgr2=0x5571aa151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6457400700 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6457400700 1 -- 172.21.15.70:0/988604514 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571a9feaa60 con 0x5571aa14bee0 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6464a00700 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6457400700 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa157d10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f64480a6760 tx=0x7f64480a8ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc99717d09a7749 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:45.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6464a00700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64440b2cc0 0x7f64440b5180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6458013400 tx=0x7f6458005d30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6455600700 1 -- 172.21.15.70:0/988604514 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64480a9bf0 con 0x5571aa14bee0 2024-05-08T06:47:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6455600700 1 -- 172.21.15.70:0/988604514 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64480a94f0 con 0x5571aa14bee0 2024-05-08T06:47:45.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.391+0000 7f6455600700 1 -- 172.21.15.70:0/988604514 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64480844e0 con 0x5571aa14bee0 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.392+0000 7f647138db80 1 -- 172.21.15.70:0/988604514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 msgr2=0x5571aa157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.392+0000 7f647138db80 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa157d10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f64480a6760 tx=0x7f64480a8ce0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.392+0000 7f647138db80 1 -- 172.21.15.70:0/988604514 shutdown_connections 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.392+0000 7f647138db80 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa157d10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.392+0000 7f647138db80 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.392+0000 7f647138db80 1 --2- 172.21.15.70:0/988604514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa14b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.392+0000 7f647138db80 1 -- 172.21.15.70:0/988604514 >> 172.21.15.70:0/988604514 conn(0x5571aa079cf0 msgr2=0x5571aa145e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.393+0000 7f647138db80 1 -- 172.21.15.70:0/988604514 shutdown_connections 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.393+0000 7f647138db80 1 -- 172.21.15.70:0/988604514 wait complete. 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.393+0000 7f647138db80 1 -- start start 2024-05-08T06:47:45.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.393+0000 7f647138db80 1 Processor -- start 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f647138db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14b520 0x5571aa1578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f647138db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14bee0 0x5571aa154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f647138db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa155220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f647138db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5571aa158310 con 0x5571aa150f50 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f647138db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5571aa003cb0 con 0x5571aa14b520 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f647138db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5571aa158490 con 0x5571aa14bee0 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f647138db80 10 client.0 _ll_register_callbacks cb 0x5571aa044e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f6464a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f6464a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49512/0 (socket says 172.21.15.70:49512) 2024-05-08T06:47:45.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f6464a00700 1 -- 172.21.15.70:0/3893868020 learned_addr learned my addr 172.21.15.70:0/3893868020 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f6457400700 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14bee0 0x5571aa154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.394+0000 7f645fe00700 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14b520 0x5571aa1578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f6464a00700 1 -- 172.21.15.70:0/3893868020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14bee0 msgr2=0x5571aa154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f6464a00700 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14bee0 0x5571aa154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f6464a00700 1 -- 172.21.15.70:0/3893868020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14b520 msgr2=0x5571aa1578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f6464a00700 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14b520 0x5571aa1578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f6464a00700 1 -- 172.21.15.70:0/3893868020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571aa0635b0 con 0x5571aa150f50 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f6464a00700 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa155220 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6458010840 tx=0x7f6458005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2c4f1cc54cd11d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f644e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f644e000700 1 -- 172.21.15.70:0/3893868020 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458021070 con 0x5571aa150f50 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f644e000700 1 -- 172.21.15.70:0/3893868020 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f645800f6f0 con 0x5571aa150f50 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.395+0000 7f647138db80 1 -- 172.21.15.70:0/3893868020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64480a94f0 con 0x5571aa150f50 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f644e000700 1 -- 172.21.15.70:0/3893868020 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f645802d050 con 0x5571aa150f50 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f647138db80 10 client.15429 fetch_fsmap learned FSMap version 27 2024-05-08T06:47:45.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f647138db80 1 -- 172.21.15.70:0/3893868020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5571aa162c00 con 0x5571aa150f50 2024-05-08T06:47:45.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f644e000700 1 -- 172.21.15.70:0/3893868020 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64480a94f0 con 0x5571aa150f50 2024-05-08T06:47:45.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f644e000700 1 -- 172.21.15.70:0/3893868020 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f645801c070 con 0x5571aa150f50 2024-05-08T06:47:45.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f647138db80 10 client.15429 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:47:45.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f647138db80 10 client.15429 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:47:45.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f647138db80 20 client.15429 populate_metadata read hostname 'smithi070' 2024-05-08T06:47:45.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f647138db80 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5571aa165190 0x5571aa167600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f647138db80 4 client.15429 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:47:45.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.396+0000 7f647138db80 1 -- 172.21.15.70:0/3893868020 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571aa118230 con 0x5571aa165190 2024-05-08T06:47:45.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.397+0000 7f645fe00700 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5571aa165190 0x5571aa167600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.398+0000 7f645fe00700 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5571aa165190 0x5571aa167600 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8fce003dfbd9819 server_cookie=b006c79c5a1d8a7d in_seq=0 out_seq=0 2024-05-08T06:47:45.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.398+0000 7f644e000700 10 client.15429 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f644e000700 1 -- 172.21.15.70:0/3893868020 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5571aa118230 con 0x5571aa165190 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f644e000700 10 client.15429 handle_command_reply: tid=0 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 client.15429 shutdown 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 -- 172.21.15.70:0/3893868020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 msgr2=0x5571aa155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa155220 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f6458010840 tx=0x7f6458005950 comp rx=0 tx=0).stop 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 -- 172.21.15.70:0/3893868020 shutdown_connections 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5571aa165190 0x5571aa167600 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa155220 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14b520 0x5571aa1578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 --2- 172.21.15.70:0/3893868020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14bee0 0x5571aa154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 -- 172.21.15.70:0/3893868020 >> 172.21.15.70:0/3893868020 conn(0x5571aa079cf0 msgr2=0x5571aa1408e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f644e000700 0 client.15429 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 -- 172.21.15.70:0/3893868020 shutdown_connections 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.400+0000 7f647138db80 1 -- 172.21.15.70:0/3893868020 wait complete. 2024-05-08T06:47:45.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.401+0000 7f647138db80 20 client.15429 trim_cache size 0 max 16384 2024-05-08T06:47:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.421+0000 7f647138db80 1 Processor -- start 2024-05-08T06:47:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.421+0000 7f647138db80 1 -- start start 2024-05-08T06:47:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f647138db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f647138db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14bee0 0x5571aa16ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f647138db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa16d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f647138db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64601b3f30 con 0x5571aa150f50 2024-05-08T06:47:45.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f647138db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64601b17c0 con 0x5571aa14bee0 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f647138db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64601af610 con 0x5571aa14b520 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f6464a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa16d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f6464a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa16d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49516/0 (socket says 172.21.15.70:49516) 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f6464a00700 1 -- 172.21.15.70:0/3323872682 learned_addr learned my addr 172.21.15.70:0/3323872682 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f645fe00700 1 --2- 172.21.15.70:0/3323872682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f6457400700 1 --2- 172.21.15.70:0/3323872682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14bee0 0x5571aa16ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f6464a00700 1 -- 172.21.15.70:0/3323872682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 msgr2=0x5571aa161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f6464a00700 1 --2- 172.21.15.70:0/3323872682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f6464a00700 1 -- 172.21.15.70:0/3323872682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14bee0 msgr2=0x5571aa16ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f6464a00700 1 --2- 172.21.15.70:0/3323872682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14bee0 0x5571aa16ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.422+0000 7f6464a00700 1 -- 172.21.15.70:0/3323872682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571aa142a10 con 0x5571aa150f50 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.423+0000 7f6464a00700 1 --2- 172.21.15.70:0/3323872682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa16d410 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f645800cea0 tx=0x7f6458004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e05f6217ac08a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.423+0000 7f6454c00700 1 -- 172.21.15.70:0/3323872682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458036070 con 0x5571aa150f50 2024-05-08T06:47:45.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.423+0000 7f6454c00700 1 -- 172.21.15.70:0/3323872682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6458017070 con 0x5571aa150f50 2024-05-08T06:47:45.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.423+0000 7f6454c00700 1 -- 172.21.15.70:0/3323872682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6458021070 con 0x5571aa150f50 2024-05-08T06:47:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.423+0000 7f647138db80 1 -- 172.21.15.70:0/3323872682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 msgr2=0x5571aa16d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.423+0000 7f647138db80 1 --2- 172.21.15.70:0/3323872682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa16d410 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f645800cea0 tx=0x7f6458004690 comp rx=0 tx=0).stop 2024-05-08T06:47:45.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.424+0000 7f647138db80 1 -- 172.21.15.70:0/3323872682 shutdown_connections 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.424+0000 7f647138db80 1 --2- 172.21.15.70:0/3323872682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa150f50 0x5571aa16d410 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.424+0000 7f647138db80 1 --2- 172.21.15.70:0/3323872682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.424+0000 7f647138db80 1 --2- 172.21.15.70:0/3323872682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa14bee0 0x5571aa16ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.424+0000 7f647138db80 1 -- 172.21.15.70:0/3323872682 >> 172.21.15.70:0/3323872682 conn(0x5571aa079cf0 msgr2=0x5571aa14f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.424+0000 7f647138db80 1 -- 172.21.15.70:0/3323872682 shutdown_connections 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.424+0000 7f647138db80 1 -- 172.21.15.70:0/3323872682 wait complete. 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.424+0000 7f647138db80 1 -- start start 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.424+0000 7f647138db80 1 Processor -- start 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f647138db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa15c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f647138db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f647138db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f647138db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64601afc80 con 0x5571aa14bee0 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f647138db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64601b10f0 con 0x5571aa150f50 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f647138db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64601b0350 con 0x5571aa14b520 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f647138db80 10 client.0 _ll_register_callbacks cb 0x5571aa044e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f6457400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f6457400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa15ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49526/0 (socket says 172.21.15.70:49526) 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f6457400700 1 -- 172.21.15.70:0/2507935994 learned_addr learned my addr 172.21.15.70:0/2507935994 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.425+0000 7f645fe00700 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f6464a00700 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f6457400700 1 -- 172.21.15.70:0/2507935994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 msgr2=0x5571aa15c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f6457400700 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa15c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f6457400700 1 -- 172.21.15.70:0/2507935994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 msgr2=0x5571aa15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f6457400700 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa15cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f6457400700 1 -- 172.21.15.70:0/2507935994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571aa1cfcd0 con 0x5571aa14bee0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f6464a00700 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f6457400700 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa15ca60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f64480dfb30 tx=0x7f6448010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3564e58410d585a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f644e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f644e000700 1 -- 172.21.15.70:0/2507935994 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448014030 con 0x5571aa14bee0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f644e000700 1 -- 172.21.15.70:0/2507935994 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f64480a9960 con 0x5571aa14bee0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f647138db80 1 -- 172.21.15.70:0/2507935994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6458017070 con 0x5571aa14bee0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f644e000700 1 -- 172.21.15.70:0/2507935994 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6448020040 con 0x5571aa14bee0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f647138db80 10 client.15435 fetch_fsmap learned FSMap version 27 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.426+0000 7f647138db80 1 -- 172.21.15.70:0/2507935994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5571aa1d0f90 con 0x5571aa14bee0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.427+0000 7f644e000700 1 -- 172.21.15.70:0/2507935994 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6458017070 con 0x5571aa14bee0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.427+0000 7f644e000700 1 -- 172.21.15.70:0/2507935994 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6448084240 con 0x5571aa14bee0 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.427+0000 7f647138db80 10 client.15435 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.427+0000 7f647138db80 10 client.15435 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.427+0000 7f647138db80 20 client.15435 populate_metadata read hostname 'smithi070' 2024-05-08T06:47:45.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.427+0000 7f647138db80 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5571aa1d1230 0x5571aa1d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:47:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.427+0000 7f647138db80 4 client.15435 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.4, "await_for": 42.0}] 2024-05-08T06:47:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.427+0000 7f647138db80 1 -- 172.21.15.70:0/2507935994 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.4, "await_for": 42.0}) -- 0x5571aa0ab590 con 0x5571aa1d1230 2024-05-08T06:47:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.428+0000 7f645fe00700 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5571aa1d1230 0x5571aa1d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:47:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.429+0000 7f645fe00700 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5571aa1d1230 0x5571aa1d3650 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=665e6221e381336e server_cookie=31a59402949ac672 in_seq=0 out_seq=0 2024-05-08T06:47:45.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.429+0000 7f644e000700 10 client.15435 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f644e000700 1 -- 172.21.15.70:0/2507935994 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5571aa0ab590 con 0x5571aa1d1230 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f644e000700 10 client.15435 handle_command_reply: tid=0 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 client.15435 shutdown 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 -- 172.21.15.70:0/2507935994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 msgr2=0x5571aa15ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa15ca60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f64480dfb30 tx=0x7f6448010c10 comp rx=0 tx=0).stop 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 -- 172.21.15.70:0/2507935994 shutdown_connections 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5571aa1d1230 0x5571aa1d3650 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5571aa150f50 0x5571aa15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5571aa14b520 0x5571aa15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 --2- 172.21.15.70:0/2507935994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5571aa14bee0 0x5571aa15ca60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f644e000700 0 client.15435 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:47:45.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 -- 172.21.15.70:0/2507935994 >> 172.21.15.70:0/2507935994 conn(0x5571aa079cf0 msgr2=0x5571aa140050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 -- 172.21.15.70:0/2507935994 shutdown_connections 2024-05-08T06:47:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.454+0000 7f647138db80 1 -- 172.21.15.70:0/2507935994 wait complete. 2024-05-08T06:47:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f647138db80 20 client.15435 trim_cache size 0 max 16384 2024-05-08T06:47:45.455 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:47:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 27, 2024-05-08T06:47:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:47:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 2, 2024-05-08T06:47:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:47:45.455 INFO:teuthology.orchestra.run.smithi070.stdout: "1393c4dd": { 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 2, 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.4, 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:47:45.456 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:47:45.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:47:45.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:47:45.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:47:45.457 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:47:45.457 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:47:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 -- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64440b2cc0 msgr2=0x7f64440b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64440b2cc0 0x7f64440b5180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6458013400 tx=0x7f6458005d30 comp rx=0 tx=0).stop 2024-05-08T06:47:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 -- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6460104160 msgr2=0x7f6460075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:47:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6460104160 0x7f6460075ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f644800d950 tx=0x7f644800dd10 comp rx=0 tx=0).stop 2024-05-08T06:47:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 -- 172.21.15.70:0/336834150 shutdown_connections 2024-05-08T06:47:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64440b2cc0 0x7f64440b5180 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6460108880 0x7f6460076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64601037b0 0x7f64600757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 --2- 172.21.15.70:0/336834150 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6460104160 0x7f6460075ce0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:47:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.455+0000 7f6466a00700 1 -- 172.21.15.70:0/336834150 >> 172.21.15.70:0/336834150 conn(0x7f646007a580 msgr2=0x7f64601099d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:47:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.456+0000 7f6466a00700 1 -- 172.21.15.70:0/336834150 shutdown_connections 2024-05-08T06:47:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:47:45.456+0000 7f6466a00700 1 -- 172.21.15.70:0/336834150 wait complete. 2024-05-08T06:47:46.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:45 smithi070 ceph-mon[29591]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:46.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:45 smithi172 ceph-mon[33377]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:45 smithi194 ceph-mon[33679]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:46.526 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1393c4dd', quiesce took 8.6 seconds. Will release after: 19.4 2024-05-08T06:47:48.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:47 smithi070 ceph-mon[29591]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:47 smithi172 ceph-mon[33377]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:48.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:47 smithi194 ceph-mon[33679]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:47:50.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:49 smithi070 ceph-mon[29591]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:49 smithi172 ceph-mon[33377]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:49 smithi194 ceph-mon[33679]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:47:52.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:51 smithi070 ceph-mon[29591]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:47:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:51 smithi172 ceph-mon[33377]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:47:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:51 smithi194 ceph-mon[33679]: pgmap v42: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:47:54.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:53 smithi070 ceph-mon[29591]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:47:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:53 smithi172 ceph-mon[33377]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:47:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:53 smithi194 ceph-mon[33679]: pgmap v43: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:47:56.057 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:55 smithi070 ceph-mon[29591]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T06:47:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:55 smithi172 ceph-mon[33377]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T06:47:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:55 smithi194 ceph-mon[33679]: pgmap v44: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T06:47:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:57 smithi070 ceph-mon[29591]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:47:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:57 smithi172 ceph-mon[33377]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:47:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:57 smithi194 ceph-mon[33679]: pgmap v45: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:48:00.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:47:59 smithi070 ceph-mon[29591]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T06:48:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:47:59 smithi172 ceph-mon[33377]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T06:48:00.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:47:59 smithi194 ceph-mon[33679]: pgmap v46: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T06:48:02.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:01 smithi070 ceph-mon[29591]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:48:02.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:01 smithi172 ceph-mon[33377]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:48:02.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:01 smithi194 ceph-mon[33679]: pgmap v47: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T06:48:04.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:03 smithi070 ceph-mon[29591]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:03 smithi172 ceph-mon[33377]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:04.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:03 smithi194 ceph-mon[33679]: pgmap v48: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:05.927 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:48:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:05 smithi070 ceph-mon[29591]: pgmap v49: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:48:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:05 smithi070 ceph-mon[29591]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-05-08T06:48:06.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:05 smithi172 ceph-mon[33377]: pgmap v49: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:48:06.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:05 smithi172 ceph-mon[33377]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-05-08T06:48:06.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:05 smithi194 ceph-mon[33679]: pgmap v49: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:48:06.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:05 smithi194 ceph-mon[33679]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-05-08T06:48:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:48:08.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:07 smithi070 ceph-mon[29591]: pgmap v50: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:48:08.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:07 smithi172 ceph-mon[33377]: pgmap v50: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:48:08.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:07 smithi194 ceph-mon[33679]: pgmap v50: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:48:08.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.874+0000 7f1e0c600700 1 -- 172.21.15.70:0/3654692974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 msgr2=0x7f1e04110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:08.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.874+0000 7f1e0c600700 1 --2- 172.21.15.70:0/3654692974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 0x7f1e04110330 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc00b0a0 tx=0x7f1dfc00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:48:08.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.874+0000 7f1e0c600700 1 -- 172.21.15.70:0/3654692974 shutdown_connections 2024-05-08T06:48:08.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.874+0000 7f1e0c600700 1 --2- 172.21.15.70:0/3654692974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 0x7f1e04110330 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:08.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.874+0000 7f1e0c600700 1 --2- 172.21.15.70:0/3654692974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e04109510 0x7f1e041098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:08.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.874+0000 7f1e0c600700 1 --2- 172.21.15.70:0/3654692974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e0406b180 0x7f1e0406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:08.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.874+0000 7f1e0c600700 1 -- 172.21.15.70:0/3654692974 >> 172.21.15.70:0/3654692974 conn(0x7f1e04079350 msgr2=0x7f1e04079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:08.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.874+0000 7f1e0c600700 1 -- 172.21.15.70:0/3654692974 shutdown_connections 2024-05-08T06:48:08.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.874+0000 7f1e0c600700 1 -- 172.21.15.70:0/3654692974 wait complete. 2024-05-08T06:48:08.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.876+0000 7f1e0c600700 1 Processor -- start 2024-05-08T06:48:08.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.876+0000 7f1e0c600700 1 -- start start 2024-05-08T06:48:08.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.876+0000 7f1e0c600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e0406b180 0x7f1e041a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:08.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.876+0000 7f1e0c600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 0x7f1e041a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:08.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.876+0000 7f1e0c600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e04109510 0x7f1e0419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:08.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.876+0000 7f1e0c600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1e041134f0 con 0x7f1e0406bb40 2024-05-08T06:48:08.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.876+0000 7f1e0c600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1e04113370 con 0x7f1e0406b180 2024-05-08T06:48:08.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.876+0000 7f1e0c600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1e04113670 con 0x7f1e04109510 2024-05-08T06:48:08.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e09200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 0x7f1e041a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:08.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e09200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 0x7f1e041a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47872/0 (socket says 172.21.15.70:47872) 2024-05-08T06:48:08.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e09200700 1 -- 172.21.15.70:0/1833858561 learned_addr learned my addr 172.21.15.70:0/1833858561 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:08.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e0a600700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e04109510 0x7f1e0419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e09200700 1 -- 172.21.15.70:0/1833858561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e04109510 msgr2=0x7f1e0419ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e09200700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e04109510 0x7f1e0419ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e09200700 1 -- 172.21.15.70:0/1833858561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e0406b180 msgr2=0x7f1e041a18b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e09200700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e0406b180 0x7f1e041a18b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e09200700 1 -- 172.21.15.70:0/1833858561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0419c1d0 con 0x7f1e0406bb40 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.877+0000 7f1e0a600700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e04109510 0x7f1e0419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.878+0000 7f1e09200700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 0x7f1e041a1df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1df000d980 tx=0x7f1df000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.878+0000 7f1e02000700 1 -- 172.21.15.70:0/1833858561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0017070 con 0x7f1e0406bb40 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.878+0000 7f1e02000700 1 -- 172.21.15.70:0/1833858561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1df0004830 con 0x7f1e0406bb40 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.878+0000 7f1e02000700 1 -- 172.21.15.70:0/1833858561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df00053a0 con 0x7f1e0406bb40 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.878+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0419c460 con 0x7f1e0406bb40 2024-05-08T06:48:08.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.878+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e041a8780 con 0x7f1e0406bb40 2024-05-08T06:48:08.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.879+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0406a190 con 0x7f1e0406bb40 2024-05-08T06:48:08.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.882+0000 7f1e02000700 1 -- 172.21.15.70:0/1833858561 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1df00049e0 con 0x7f1e0406bb40 2024-05-08T06:48:08.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.887+0000 7f1e02000700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dec0b2a70 0x7f1dec0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:08.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.887+0000 7f1e02000700 1 -- 172.21.15.70:0/1833858561 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f1df00e2d70 con 0x7f1e0406bb40 2024-05-08T06:48:08.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.887+0000 7f1e09c00700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dec0b2a70 0x7f1dec0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:08.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.887+0000 7f1e02000700 1 -- 172.21.15.70:0/1833858561 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1df0020020 con 0x7f1e0406bb40 2024-05-08T06:48:08.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:08.888+0000 7f1e09c00700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dec0b2a70 0x7f1dec0b4f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e0419cbb0 tx=0x7f1df800b370 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:09.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.194+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e041a8a50 con 0x7f1e0406bb40 2024-05-08T06:48:09.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.195+0000 7f1e02000700 1 -- 172.21.15.70:0/1833858561 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11876 (secure 0 0 0) 0x7f1df00aa3a0 con 0x7f1e0406bb40 2024-05-08T06:48:09.195 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:48:09.195 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:46:31.709156+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T06:48:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.198+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dec0b2a70 msgr2=0x7f1dec0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.198+0000 7f1e0c600700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dec0b2a70 0x7f1dec0b4f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1e0419cbb0 tx=0x7f1df800b370 comp rx=0 tx=0).stop 2024-05-08T06:48:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.198+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 msgr2=0x7f1e041a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.198+0000 7f1e0c600700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 0x7f1e041a1df0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1df000d980 tx=0x7f1df000dd40 comp rx=0 tx=0).stop 2024-05-08T06:48:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.199+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 shutdown_connections 2024-05-08T06:48:09.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.199+0000 7f1e0c600700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dec0b2a70 0x7f1dec0b4f30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.199+0000 7f1e0c600700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e04109510 0x7f1e0419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.199+0000 7f1e0c600700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e0406b180 0x7f1e041a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.199+0000 7f1e0c600700 1 --2- 172.21.15.70:0/1833858561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e0406bb40 0x7f1e041a1df0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.199+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 >> 172.21.15.70:0/1833858561 conn(0x7f1e04079350 msgr2=0x7f1e0410e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.199+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 shutdown_connections 2024-05-08T06:48:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:09.199+0000 7f1e0c600700 1 -- 172.21.15.70:0/1833858561 wait complete. 2024-05-08T06:48:09.199 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-05-08T06:48:10.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:09 smithi070 ceph-mon[29591]: pgmap v51: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:48:10.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1833858561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:48:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:09 smithi172 ceph-mon[33377]: pgmap v51: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:48:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1833858561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:48:10.197 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 1393c4dd --release --await' 2024-05-08T06:48:10.197 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 1393c4dd --release --await 2024-05-08T06:48:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:09 smithi194 ceph-mon[33679]: pgmap v51: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:48:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1833858561' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:48:10.664 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:48:12.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:11 smithi070 ceph-mon[29591]: pgmap v52: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:48:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:11 smithi172 ceph-mon[33377]: pgmap v52: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:48:12.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:11 smithi194 ceph-mon[33679]: pgmap v52: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:48:13.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.119+0000 7f9098600700 1 -- 172.21.15.70:0/4989277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 msgr2=0x7f909010bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:13.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.119+0000 7f9098600700 1 --2- 172.21.15.70:0/4989277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 0x7f909010bac0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9084009990 tx=0x7f9084009ca0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.119+0000 7f9098600700 1 -- 172.21.15.70:0/4989277 shutdown_connections 2024-05-08T06:48:13.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.119+0000 7f9098600700 1 --2- 172.21.15.70:0/4989277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90901060a0 0x7f90901125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.119+0000 7f9098600700 1 --2- 172.21.15.70:0/4989277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 0x7f909010bac0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.119+0000 7f9098600700 1 --2- 172.21.15.70:0/4989277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90901056e0 0x7f9090105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.119+0000 7f9098600700 1 -- 172.21.15.70:0/4989277 >> 172.21.15.70:0/4989277 conn(0x7f90901011d0 msgr2=0x7f90901035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:13.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.120+0000 7f9098600700 1 -- 172.21.15.70:0/4989277 shutdown_connections 2024-05-08T06:48:13.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.121+0000 7f9098600700 1 -- 172.21.15.70:0/4989277 wait complete. 2024-05-08T06:48:13.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.121+0000 7f9098600700 1 Processor -- start 2024-05-08T06:48:13.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.122+0000 7f9098600700 1 -- start start 2024-05-08T06:48:13.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.122+0000 7f9098600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90901056e0 0x7f90901a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.122+0000 7f9098600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90901060a0 0x7f90901a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.122+0000 7f9098600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 0x7f909019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.122+0000 7f9098600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f90901157e0 con 0x7f909010b6e0 2024-05-08T06:48:13.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.122+0000 7f9098600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9090115660 con 0x7f90901060a0 2024-05-08T06:48:13.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.122+0000 7f9098600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9090115960 con 0x7f90901056e0 2024-05-08T06:48:13.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9096600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 0x7f909019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9095200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90901060a0 0x7f90901a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9095c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90901056e0 0x7f90901a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9096600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 0x7f909019bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47900/0 (socket says 172.21.15.70:47900) 2024-05-08T06:48:13.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9096600700 1 -- 172.21.15.70:0/2169114720 learned_addr learned my addr 172.21.15.70:0/2169114720 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:13.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9096600700 1 -- 172.21.15.70:0/2169114720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90901056e0 msgr2=0x7f90901a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:13.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9096600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90901056e0 0x7f90901a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9096600700 1 -- 172.21.15.70:0/2169114720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90901060a0 msgr2=0x7f90901a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:13.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9096600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90901060a0 0x7f90901a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.123+0000 7f9096600700 1 -- 172.21.15.70:0/2169114720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909019c240 con 0x7f909010b6e0 2024-05-08T06:48:13.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.124+0000 7f9096600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 0x7f909019bae0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f908800ef30 tx=0x7f908800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:13.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.124+0000 7f908e000700 1 -- 172.21.15.70:0/2169114720 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880092e0 con 0x7f909010b6e0 2024-05-08T06:48:13.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.124+0000 7f908e000700 1 -- 172.21.15.70:0/2169114720 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9088004bb0 con 0x7f909010b6e0 2024-05-08T06:48:13.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.124+0000 7f908e000700 1 -- 172.21.15.70:0/2169114720 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088004020 con 0x7f909010b6e0 2024-05-08T06:48:13.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.124+0000 7f9098600700 1 -- 172.21.15.70:0/2169114720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909019c4d0 con 0x7f909010b6e0 2024-05-08T06:48:13.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.124+0000 7f9098600700 1 -- 172.21.15.70:0/2169114720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90901a87f0 con 0x7f909010b6e0 2024-05-08T06:48:13.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.130+0000 7f908e000700 1 -- 172.21.15.70:0/2169114720 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f908801b030 con 0x7f909010b6e0 2024-05-08T06:48:13.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.131+0000 7f90a2fdeb80 1 Processor -- start 2024-05-08T06:48:13.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.131+0000 7f90a2fdeb80 1 -- start start 2024-05-08T06:48:13.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.131+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a11590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.131+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 0x5641d2a0bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.132+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 0x5641d2a17f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.132+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641d295db20 con 0x5641d2a111b0 2024-05-08T06:48:13.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.132+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641d28fb860 con 0x5641d2a0c140 2024-05-08T06:48:13.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.132+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5641d2959ae0 con 0x5641d2a0b780 2024-05-08T06:48:13.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.132+0000 7f9095200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a11590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.132+0000 7f9095200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a11590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47904/0 (socket says 172.21.15.70:47904) 2024-05-08T06:48:13.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.132+0000 7f9095200700 1 -- 172.21.15.70:0/2823881723 learned_addr learned my addr 172.21.15.70:0/2823881723 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:13.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.132+0000 7f9095200700 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 0x5641d2a17f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f908e000700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f90780b2b40 0x7f90780b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f9095c00700 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 0x5641d2a0bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f9095200700 1 -- 172.21.15.70:0/2823881723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 msgr2=0x5641d2a0bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:13.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f9095200700 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 0x5641d2a0bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f9095200700 1 -- 172.21.15.70:0/2823881723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 msgr2=0x5641d2a17f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:13.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f9095200700 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 0x5641d2a17f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f9095200700 1 -- 172.21.15.70:0/2823881723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d28aa9d0 con 0x5641d2a111b0 2024-05-08T06:48:13.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f9095c00700 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 0x5641d2a0bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:48:13.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f9096600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f90780b2b40 0x7f90780b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f9095200700 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a11590 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f907c0136b0 tx=0x7f907c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3e5ab81c746b8c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:13.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.133+0000 7f908e000700 1 -- 172.21.15.70:0/2169114720 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f90880e23b0 con 0x7f909010b6e0 2024-05-08T06:48:13.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.134+0000 7f9082a00700 1 -- 172.21.15.70:0/2823881723 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c004050 con 0x5641d2a111b0 2024-05-08T06:48:13.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.134+0000 7f9096600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f90780b2b40 0x7f90780b5000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9088003fd0 tx=0x7f9088009040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:13.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.134+0000 7f9082a00700 1 -- 172.21.15.70:0/2823881723 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f907c003680 con 0x5641d2a111b0 2024-05-08T06:48:13.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.134+0000 7f9082a00700 1 -- 172.21.15.70:0/2823881723 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c010670 con 0x5641d2a111b0 2024-05-08T06:48:13.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.135+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/2823881723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 msgr2=0x5641d2a11590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:13.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.135+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a11590 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f907c0136b0 tx=0x7f907c0098e0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.136+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/2823881723 shutdown_connections 2024-05-08T06:48:13.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.136+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 0x5641d2a17f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.136+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a11590 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.136+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/2823881723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 0x5641d2a0bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.136+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/2823881723 >> 172.21.15.70:0/2823881723 conn(0x5641d29837d0 msgr2=0x5641d2a06070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:13.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.136+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/2823881723 shutdown_connections 2024-05-08T06:48:13.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.136+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/2823881723 wait complete. 2024-05-08T06:48:13.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.137+0000 7f90a2fdeb80 1 -- start start 2024-05-08T06:48:13.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.137+0000 7f90a2fdeb80 1 Processor -- start 2024-05-08T06:48:13.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.138+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0b780 0x5641d2a17be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.138+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a14fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.138+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a15510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.138+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641d2a18510 con 0x5641d2a111b0 2024-05-08T06:48:13.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.138+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641d28c3c20 con 0x5641d2a0b780 2024-05-08T06:48:13.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.138+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5641d2a18690 con 0x5641d2a0c140 2024-05-08T06:48:13.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.138+0000 7f90a2fdeb80 10 client.0 _ll_register_callbacks cb 0x5641d2904d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:48:13.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.138+0000 7f9095200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a15510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.139+0000 7f9095200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a15510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47920/0 (socket says 172.21.15.70:47920) 2024-05-08T06:48:13.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.139+0000 7f9095200700 1 -- 172.21.15.70:0/1844351991 learned_addr learned my addr 172.21.15.70:0/1844351991 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:13.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.139+0000 7f9095c00700 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a14fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.139+0000 7f9095200700 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0b780 0x5641d2a17be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.140+0000 7f9095200700 1 -- 172.21.15.70:0/1844351991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 msgr2=0x5641d2a14fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:13.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.140+0000 7f9095200700 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a14fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.140+0000 7f9095200700 1 -- 172.21.15.70:0/1844351991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0b780 msgr2=0x5641d2a17be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:13.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.140+0000 7f9095200700 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0b780 0x5641d2a17be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.140+0000 7f9095200700 1 -- 172.21.15.70:0/1844351991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d2923520 con 0x5641d2a111b0 2024-05-08T06:48:13.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.140+0000 7f9095200700 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a15510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f907c003f60 tx=0x7f907c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fee1c31137cd86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:13.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.140+0000 7f9077400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:48:13.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.141+0000 7f9077400700 1 -- 172.21.15.70:0/1844351991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c005300 con 0x5641d2a111b0 2024-05-08T06:48:13.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.141+0000 7f9077400700 1 -- 172.21.15.70:0/1844351991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f907c0054a0 con 0x5641d2a111b0 2024-05-08T06:48:13.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.141+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1844351991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f907c003680 con 0x5641d2a111b0 2024-05-08T06:48:13.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.141+0000 7f9077400700 1 -- 172.21.15.70:0/1844351991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f907c034050 con 0x5641d2a111b0 2024-05-08T06:48:13.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.141+0000 7f90a2fdeb80 10 client.15453 fetch_fsmap learned FSMap version 27 2024-05-08T06:48:13.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.141+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1844351991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5641d2a22ce0 con 0x5641d2a111b0 2024-05-08T06:48:13.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.142+0000 7f9077400700 1 -- 172.21.15.70:0/1844351991 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f907c003680 con 0x5641d2a111b0 2024-05-08T06:48:13.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.142+0000 7f9077400700 1 -- 172.21.15.70:0/1844351991 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f907c01e070 con 0x5641d2a111b0 2024-05-08T06:48:13.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.142+0000 7f90a2fdeb80 10 client.15453 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:48:13.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.142+0000 7f90a2fdeb80 10 client.15453 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:48:13.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.142+0000 7f90a2fdeb80 20 client.15453 populate_metadata read hostname 'smithi070' 2024-05-08T06:48:13.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.142+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641d2a252c0 0x5641d2a276b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.142+0000 7f90a2fdeb80 4 client.15453 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:48:13.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.142+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1844351991 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641d29d8240 con 0x5641d2a252c0 2024-05-08T06:48:13.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.143+0000 7f9095c00700 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641d2a252c0 0x5641d2a276b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.144+0000 7f9077400700 10 client.15453 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:13.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.144+0000 7f9095c00700 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641d2a252c0 0x5641d2a276b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b141397f9d49a05d server_cookie=d9fbe26667ad5537 in_seq=0 out_seq=0 2024-05-08T06:48:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.146+0000 7f9077400700 1 -- 172.21.15.70:0/1844351991 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5641d29d8240 con 0x5641d2a252c0 2024-05-08T06:48:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.146+0000 7f9077400700 10 client.15453 handle_command_reply: tid=0 2024-05-08T06:48:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.146+0000 7f90a2fdeb80 1 client.15453 shutdown 2024-05-08T06:48:13.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1844351991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 msgr2=0x5641d2a15510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:13.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a15510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f907c003f60 tx=0x7f907c009800 comp rx=0 tx=0).stop 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1844351991 shutdown_connections 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641d2a252c0 0x5641d2a276b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a111b0 0x5641d2a15510 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0b780 0x5641d2a17be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1844351991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a14fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f9077400700 0 client.15453 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1844351991 >> 172.21.15.70:0/1844351991 conn(0x5641d29837d0 msgr2=0x5641d2a00b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1844351991 shutdown_connections 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1844351991 wait complete. 2024-05-08T06:48:13.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.147+0000 7f90a2fdeb80 20 client.15453 trim_cache size 0 max 16384 2024-05-08T06:48:13.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.187+0000 7f90a2fdeb80 1 Processor -- start 2024-05-08T06:48:13.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.187+0000 7f90a2fdeb80 1 -- start start 2024-05-08T06:48:13.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.188+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0b780 0x5641d2a21560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.188+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a0ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.188+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a2cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.188+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b4020 con 0x5641d2a12d60 2024-05-08T06:48:13.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.188+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b18b0 con 0x5641d2a0b780 2024-05-08T06:48:13.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.188+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f90901af700 con 0x5641d2a0c140 2024-05-08T06:48:13.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a0ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a0ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:37856/0 (socket says 172.21.15.70:37856) 2024-05-08T06:48:13.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095c00700 1 -- 172.21.15.70:0/1765513983 learned_addr learned my addr 172.21.15.70:0/1765513983 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:13.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095200700 1 --2- 172.21.15.70:0/1765513983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a2cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095c00700 1 -- 172.21.15.70:0/1765513983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0b780 msgr2=0x5641d2a21560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:13.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095c00700 1 --2- 172.21.15.70:0/1765513983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0b780 0x5641d2a21560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095c00700 1 -- 172.21.15.70:0/1765513983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 msgr2=0x5641d2a2cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:13.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095c00700 1 --2- 172.21.15.70:0/1765513983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a2cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095c00700 1 -- 172.21.15.70:0/1765513983 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d2a02c70 con 0x5641d2a0c140 2024-05-08T06:48:13.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.189+0000 7f9095200700 1 --2- 172.21.15.70:0/1765513983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a2cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:48:13.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.190+0000 7f9095c00700 1 --2- 172.21.15.70:0/1765513983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a0ae80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9084009750 tx=0x7f9084005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7d3ac50d460c0b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:13.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.190+0000 7f9082000700 1 -- 172.21.15.70:0/1765513983 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9084005600 con 0x5641d2a0c140 2024-05-08T06:48:13.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.190+0000 7f9082000700 1 -- 172.21.15.70:0/1765513983 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9084003b10 con 0x5641d2a0c140 2024-05-08T06:48:13.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.190+0000 7f9082000700 1 -- 172.21.15.70:0/1765513983 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908400bbd0 con 0x5641d2a0c140 2024-05-08T06:48:13.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.191+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1765513983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 msgr2=0x5641d2a0ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:13.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.191+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1765513983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a0ae80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9084009750 tx=0x7f9084005fb0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.192+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1765513983 shutdown_connections 2024-05-08T06:48:13.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.192+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1765513983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a2cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.192+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1765513983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0b780 0x5641d2a21560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.192+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/1765513983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0c140 0x5641d2a0ae80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.192+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1765513983 >> 172.21.15.70:0/1765513983 conn(0x5641d29837d0 msgr2=0x5641d2a0a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:13.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.192+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1765513983 shutdown_connections 2024-05-08T06:48:13.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.192+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/1765513983 wait complete. 2024-05-08T06:48:13.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.193+0000 7f90a2fdeb80 1 -- start start 2024-05-08T06:48:13.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.193+0000 7f90a2fdeb80 1 Processor -- start 2024-05-08T06:48:13.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.193+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 0x5641d2a1a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 0x5641d2a1adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f90a2fdeb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a1b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f90901afd70 con 0x5641d2a12d60 2024-05-08T06:48:13.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b11e0 con 0x5641d2a0c140 2024-05-08T06:48:13.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f90a2fdeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f90901b0440 con 0x5641d2a0b780 2024-05-08T06:48:13.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f90a2fdeb80 10 client.0 _ll_register_callbacks cb 0x5641d2904d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:48:13.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f9095200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a1b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f9095200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a1b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47944/0 (socket says 172.21.15.70:47944) 2024-05-08T06:48:13.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f9095200700 1 -- 172.21.15.70:0/400558978 learned_addr learned my addr 172.21.15.70:0/400558978 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:13.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f9095200700 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 0x5641d2a1a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.194+0000 7f9095c00700 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 0x5641d2a1adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.195+0000 7f9095200700 1 -- 172.21.15.70:0/400558978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 msgr2=0x5641d2a1a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:13.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.195+0000 7f9095200700 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 0x5641d2a1a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.195+0000 7f9095200700 1 -- 172.21.15.70:0/400558978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 msgr2=0x5641d2a1adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:13.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.195+0000 7f9095200700 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 0x5641d2a1adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.195+0000 7f9095200700 1 -- 172.21.15.70:0/400558978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d2a8fbe0 con 0x5641d2a12d60 2024-05-08T06:48:13.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.195+0000 7f9095200700 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a1b330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f907c01fd50 tx=0x7f907c0098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446c0b8d1125ca8a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:13.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.195+0000 7f9077400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:48:13.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.196+0000 7f9077400700 1 -- 172.21.15.70:0/400558978 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c003680 con 0x5641d2a12d60 2024-05-08T06:48:13.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.196+0000 7f9077400700 1 -- 172.21.15.70:0/400558978 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f907c0131b0 con 0x5641d2a12d60 2024-05-08T06:48:13.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.196+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/400558978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9084003b10 con 0x5641d2a12d60 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.196+0000 7f9077400700 1 -- 172.21.15.70:0/400558978 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f907c0094c0 con 0x5641d2a12d60 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.196+0000 7f90a2fdeb80 10 client.15459 fetch_fsmap learned FSMap version 27 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.196+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/400558978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5641d2a90f00 con 0x5641d2a12d60 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.197+0000 7f9077400700 1 -- 172.21.15.70:0/400558978 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9084003b10 con 0x5641d2a12d60 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.197+0000 7f9077400700 1 -- 172.21.15.70:0/400558978 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f907c01e030 con 0x5641d2a12d60 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.197+0000 7f90a2fdeb80 10 client.15459 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.197+0000 7f90a2fdeb80 10 client.15459 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.197+0000 7f90a2fdeb80 20 client.15459 populate_metadata read hostname 'smithi070' 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.197+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641d2a91580 0x5641d2a939a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.198+0000 7f90a2fdeb80 4 client.15459 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1393c4dd", "release": true, "await": true}] 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.198+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/400558978 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1393c4dd", "release": true, "await": true}) -- 0x5641d296b500 con 0x5641d2a91580 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.199+0000 7f9095c00700 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641d2a91580 0x5641d2a939a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:13.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.200+0000 7f9095c00700 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641d2a91580 0x5641d2a939a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82e69709d5f3d70f server_cookie=92315d668512d4a1 in_seq=0 out_seq=0 2024-05-08T06:48:13.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.200+0000 7f9077400700 10 client.15459 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:13.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.205+0000 7f9077400700 1 -- 172.21.15.70:0/400558978 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5641d296b500 con 0x5641d2a91580 2024-05-08T06:48:13.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.205+0000 7f9077400700 10 client.15459 handle_command_reply: tid=0 2024-05-08T06:48:13.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.205+0000 7f90a2fdeb80 1 client.15459 shutdown 2024-05-08T06:48:13.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/400558978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 msgr2=0x5641d2a1b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:13.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a1b330 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f907c01fd50 tx=0x7f907c0098e0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/400558978 shutdown_connections 2024-05-08T06:48:13.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641d2a91580 0x5641d2a939a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641d2a12d60 0x5641d2a1b330 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641d2a0b780 0x5641d2a1a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 --2- 172.21.15.70:0/400558978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641d2a0c140 0x5641d2a1adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/400558978 >> 172.21.15.70:0/400558978 conn(0x5641d29837d0 msgr2=0x5641d2a125e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f9077400700 0 client.15459 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/400558978 shutdown_connections 2024-05-08T06:48:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 1 -- 172.21.15.70:0/400558978 wait complete. 2024-05-08T06:48:13.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.206+0000 7f90a2fdeb80 20 client.15459 trim_cache size 0 max 16384 2024-05-08T06:48:13.207 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:48:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 27, 2024-05-08T06:48:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:48:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 4, 2024-05-08T06:48:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:48:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "1393c4dd": { 2024-05-08T06:48:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 4, 2024-05-08T06:48:13.207 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.4, 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:13.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:13.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:13.209 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:48:13.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.207+0000 7f9098600700 1 -- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f90780b2b40 msgr2=0x7f90780b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:13.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.207+0000 7f9098600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f90780b2b40 0x7f90780b5000 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9088003fd0 tx=0x7f9088009040 comp rx=0 tx=0).stop 2024-05-08T06:48:13.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.207+0000 7f9098600700 1 -- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 msgr2=0x7f909019bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.207+0000 7f9098600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 0x7f909019bae0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f908800ef30 tx=0x7f908800c3a0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.208+0000 7f9098600700 1 -- 172.21.15.70:0/2169114720 shutdown_connections 2024-05-08T06:48:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.208+0000 7f9098600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f90780b2b40 0x7f90780b5000 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.208+0000 7f9098600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909010b6e0 0x7f909019bae0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.208+0000 7f9098600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90901056e0 0x7f90901a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.208+0000 7f9098600700 1 --2- 172.21.15.70:0/2169114720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f90901060a0 0x7f90901a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.208+0000 7f9098600700 1 -- 172.21.15.70:0/2169114720 >> 172.21.15.70:0/2169114720 conn(0x7f90901011d0 msgr2=0x7f90901019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.208+0000 7f9098600700 1 -- 172.21.15.70:0/2169114720 shutdown_connections 2024-05-08T06:48:13.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:13.208+0000 7f9098600700 1 -- 172.21.15.70:0/2169114720 wait complete. 2024-05-08T06:48:14.016 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:13 smithi070 ceph-mon[29591]: pgmap v53: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:48:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:13 smithi172 ceph-mon[33377]: pgmap v53: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:48:14.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:13 smithi194 ceph-mon[33679]: pgmap v53: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-08T06:48:14.317 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1393c4dd', seconds elapsed: 36.4 2024-05-08T06:48:14.317 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.4 2024-05-08T06:48:14.317 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:48:14.788 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:48:16.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:15 smithi070 ceph-mon[29591]: pgmap v54: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:48:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:15 smithi172 ceph-mon[33377]: pgmap v54: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:48:16.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:15 smithi194 ceph-mon[33679]: pgmap v54: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T06:48:17.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.298+0000 7f599be00700 1 -- 172.21.15.70:0/1494646647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c109460 msgr2=0x7f599c109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:17.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.298+0000 7f599be00700 1 --2- 172.21.15.70:0/1494646647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c109460 0x7f599c109840 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f598c009990 tx=0x7f598c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.298+0000 7f599be00700 1 -- 172.21.15.70:0/1494646647 shutdown_connections 2024-05-08T06:48:17.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.298+0000 7f599be00700 1 --2- 172.21.15.70:0/1494646647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c103d90 0x7f599c1102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.298+0000 7f599be00700 1 --2- 172.21.15.70:0/1494646647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c109460 0x7f599c109840 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.298+0000 7f599be00700 1 --2- 172.21.15.70:0/1494646647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c1033d0 0x7f599c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.298+0000 7f599be00700 1 -- 172.21.15.70:0/1494646647 >> 172.21.15.70:0/1494646647 conn(0x7f599c0fef20 msgr2=0x7f599c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:17.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.299+0000 7f599be00700 1 -- 172.21.15.70:0/1494646647 shutdown_connections 2024-05-08T06:48:17.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.299+0000 7f599be00700 1 -- 172.21.15.70:0/1494646647 wait complete. 2024-05-08T06:48:17.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.300+0000 7f599be00700 1 Processor -- start 2024-05-08T06:48:17.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.301+0000 7f599be00700 1 -- start start 2024-05-08T06:48:17.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.301+0000 7f599be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c1033d0 0x7f599c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:17.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.301+0000 7f599be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c103d90 0x7f599c075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:17.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.301+0000 7f599be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c109460 0x7f599c076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:17.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.301+0000 7f599be00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f599c113490 con 0x7f599c103d90 2024-05-08T06:48:17.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.301+0000 7f599be00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f599c113310 con 0x7f599c1033d0 2024-05-08T06:48:17.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.301+0000 7f599be00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f599c113610 con 0x7f599c109460 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c103d90 0x7f599c075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c103d90 0x7f599c075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34954/0 (socket says 172.21.15.70:34954) 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599a000700 1 -- 172.21.15.70:0/644633835 learned_addr learned my addr 172.21.15.70:0/644633835 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599b400700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c109460 0x7f599c076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599a000700 1 -- 172.21.15.70:0/644633835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c109460 msgr2=0x7f599c076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599a000700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c109460 0x7f599c076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599a000700 1 -- 172.21.15.70:0/644633835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c1033d0 msgr2=0x7f599c0757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599a000700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c1033d0 0x7f599c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599a000700 1 -- 172.21.15.70:0/644633835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c1a7f30 con 0x7f599c103d90 2024-05-08T06:48:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.302+0000 7f599b400700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c109460 0x7f599c076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:48:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.303+0000 7f599a000700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c103d90 0x7f599c075ce0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f598800d980 tx=0x7f598800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.303+0000 7f5993400700 1 -- 172.21.15.70:0/644633835 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5988017070 con 0x7f599c103d90 2024-05-08T06:48:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.303+0000 7f5993400700 1 -- 172.21.15.70:0/644633835 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5988004830 con 0x7f599c103d90 2024-05-08T06:48:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.303+0000 7f5993400700 1 -- 172.21.15.70:0/644633835 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59880053a0 con 0x7f599c103d90 2024-05-08T06:48:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.303+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c1a8220 con 0x7f599c103d90 2024-05-08T06:48:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.304+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c1a8710 con 0x7f599c103d90 2024-05-08T06:48:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.306+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c06a190 con 0x7f599c103d90 2024-05-08T06:48:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.311+0000 7f5993400700 1 -- 172.21.15.70:0/644633835 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f59880049e0 con 0x7f599c103d90 2024-05-08T06:48:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.313+0000 7f5993400700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59800b2a70 0x7f59800b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.314+0000 7f5993400700 1 -- 172.21.15.70:0/644633835 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f59880e2570 con 0x7f599c103d90 2024-05-08T06:48:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.314+0000 7f599aa00700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59800b2a70 0x7f59800b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.315+0000 7f599aa00700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59800b2a70 0x7f59800b4f30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f598c0098e0 tx=0x7f598c005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:17.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.322+0000 7f5993400700 1 -- 172.21.15.70:0/644633835 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5988020020 con 0x7f599c103d90 2024-05-08T06:48:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.634+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f599c02e510 con 0x7f599c103d90 2024-05-08T06:48:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.635+0000 7f5993400700 1 -- 172.21.15.70:0/644633835 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11876 (secure 0 0 0) 0x7f59880a9b20 con 0x7f599c103d90 2024-05-08T06:48:17.634 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:48:17.634 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:46:31.709156+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T06:48:17.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.637+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59800b2a70 msgr2=0x7f59800b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:17.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.637+0000 7f599be00700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59800b2a70 0x7f59800b4f30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f598c0098e0 tx=0x7f598c005fb0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.637+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c103d90 msgr2=0x7f599c075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:17.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.637+0000 7f599be00700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c103d90 0x7f599c075ce0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f598800d980 tx=0x7f598800dd40 comp rx=0 tx=0).stop 2024-05-08T06:48:17.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.638+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 shutdown_connections 2024-05-08T06:48:17.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.638+0000 7f599be00700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59800b2a70 0x7f59800b4f30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.638+0000 7f599be00700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c109460 0x7f599c076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.638+0000 7f599be00700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f599c1033d0 0x7f599c0757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.638+0000 7f599be00700 1 --2- 172.21.15.70:0/644633835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f599c103d90 0x7f599c075ce0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:17.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.638+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 >> 172.21.15.70:0/644633835 conn(0x7f599c0fef20 msgr2=0x7f599c0ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:17.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.638+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 shutdown_connections 2024-05-08T06:48:17.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:17.638+0000 7f599be00700 1 -- 172.21.15.70:0/644633835 wait complete. 2024-05-08T06:48:17.639 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-05-08T06:48:18.067 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:17 smithi070 ceph-mon[29591]: pgmap v55: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:18.067 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:17 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/644633835' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:48:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:17 smithi172 ceph-mon[33377]: pgmap v55: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:17 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/644633835' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:48:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:17 smithi194 ceph-mon[33679]: pgmap v55: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:17 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/644633835' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:48:18.605 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.4 --await-for 42.0' 2024-05-08T06:48:18.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.4 --await-for 42.0 2024-05-08T06:48:19.043 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:48:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:19 smithi172 ceph-mon[33377]: pgmap v56: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:20.257 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:19 smithi070 ceph-mon[29591]: pgmap v56: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:20.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:19 smithi194 ceph-mon[33679]: pgmap v56: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:21.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.414+0000 7faf77200700 1 -- 172.21.15.70:0/1979883928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf70075a40 msgr2=0x7faf70075e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:21.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.414+0000 7faf77200700 1 --2- 172.21.15.70:0/1979883928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf70075a40 0x7faf70075e20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7faf64009990 tx=0x7faf64009ca0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.414+0000 7faf77200700 1 -- 172.21.15.70:0/1979883928 shutdown_connections 2024-05-08T06:48:21.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.414+0000 7faf77200700 1 --2- 172.21.15.70:0/1979883928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf7010fd00 0x7faf701120f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.414+0000 7faf77200700 1 --2- 172.21.15.70:0/1979883928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf70075a40 0x7faf70075e20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.414+0000 7faf77200700 1 --2- 172.21.15.70:0/1979883928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf70076360 0x7faf7010f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.414+0000 7faf77200700 1 -- 172.21.15.70:0/1979883928 >> 172.21.15.70:0/1979883928 conn(0x7faf700fee00 msgr2=0x7faf70101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.415+0000 7faf77200700 1 -- 172.21.15.70:0/1979883928 shutdown_connections 2024-05-08T06:48:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.415+0000 7faf77200700 1 -- 172.21.15.70:0/1979883928 wait complete. 2024-05-08T06:48:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.416+0000 7faf77200700 1 Processor -- start 2024-05-08T06:48:21.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.416+0000 7faf77200700 1 -- start start 2024-05-08T06:48:21.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.417+0000 7faf77200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf70075a40 0x7faf701a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.417+0000 7faf77200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf70076360 0x7faf701a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.417+0000 7faf77200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7010fd00 0x7faf7019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.417+0000 7faf77200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf70115730 con 0x7faf7010fd00 2024-05-08T06:48:21.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.417+0000 7faf77200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf701155b0 con 0x7faf70075a40 2024-05-08T06:48:21.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.417+0000 7faf77200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faf701158b0 con 0x7faf70076360 2024-05-08T06:48:21.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.417+0000 7faf76800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7010fd00 0x7faf7019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.417+0000 7faf76800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7010fd00 0x7faf7019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34984/0 (socket says 172.21.15.70:34984) 2024-05-08T06:48:21.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.417+0000 7faf76800700 1 -- 172.21.15.70:0/3847380249 learned_addr learned my addr 172.21.15.70:0/3847380249 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:21.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.418+0000 7faf75400700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf70076360 0x7faf701a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.418+0000 7faf75e00700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf70075a40 0x7faf701a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.418+0000 7faf76800700 1 -- 172.21.15.70:0/3847380249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf70076360 msgr2=0x7faf701a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.418+0000 7faf76800700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf70076360 0x7faf701a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.418+0000 7faf76800700 1 -- 172.21.15.70:0/3847380249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf70075a40 msgr2=0x7faf701a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.418+0000 7faf76800700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf70075a40 0x7faf701a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.418+0000 7faf76800700 1 -- 172.21.15.70:0/3847380249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf7019c150 con 0x7faf7010fd00 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.419+0000 7faf76800700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7010fd00 0x7faf7019b9f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0094f0 tx=0x7faf6c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.419+0000 7faf6aa00700 1 -- 172.21.15.70:0/3847380249 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00ddd0 con 0x7faf7010fd00 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.419+0000 7faf6aa00700 1 -- 172.21.15.70:0/3847380249 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf6c009e20 con 0x7faf7010fd00 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.419+0000 7faf77200700 1 -- 172.21.15.70:0/3847380249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf7019c440 con 0x7faf7010fd00 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.420+0000 7faf6aa00700 1 -- 172.21.15.70:0/3847380249 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c015400 con 0x7faf7010fd00 2024-05-08T06:48:21.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.420+0000 7faf77200700 1 -- 172.21.15.70:0/3847380249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf701a8700 con 0x7faf7010fd00 2024-05-08T06:48:21.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.424+0000 7faf83226b80 1 Processor -- start 2024-05-08T06:48:21.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.426+0000 7faf6aa00700 1 -- 172.21.15.70:0/3847380249 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7faf6c005020 con 0x7faf7010fd00 2024-05-08T06:48:21.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.426+0000 7faf83226b80 1 -- start start 2024-05-08T06:48:21.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.426+0000 7faf83226b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff14ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.426+0000 7faf83226b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff0f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.426+0000 7faf83226b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff0fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.426+0000 7faf83226b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fe5fe58bb0 con 0x55fe5ff14af0 2024-05-08T06:48:21.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.426+0000 7faf83226b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fe5fdf68f0 con 0x55fe5ff15410 2024-05-08T06:48:21.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.426+0000 7faf83226b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fe5fe54b70 con 0x55fe5ff0f640 2024-05-08T06:48:21.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.427+0000 7faf75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff14ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.427+0000 7faf75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff14ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34988/0 (socket says 172.21.15.70:34988) 2024-05-08T06:48:21.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.427+0000 7faf75400700 1 -- 172.21.15.70:0/4064302805 learned_addr learned my addr 172.21.15.70:0/4064302805 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:21.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.427+0000 7faf75e00700 1 --2- 172.21.15.70:0/4064302805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff0f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.428+0000 7faf75400700 1 -- 172.21.15.70:0/4064302805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 msgr2=0x55fe5ff0fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:21.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.428+0000 7faf75400700 1 --2- 172.21.15.70:0/4064302805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff0fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.428+0000 7faf75400700 1 -- 172.21.15.70:0/4064302805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 msgr2=0x55fe5ff0f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:21.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.428+0000 7faf75400700 1 --2- 172.21.15.70:0/4064302805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff0f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.428+0000 7faf75400700 1 -- 172.21.15.70:0/4064302805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe5fda5a60 con 0x55fe5ff14af0 2024-05-08T06:48:21.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.428+0000 7faf6aa00700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf580b2b20 0x7faf580b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.428+0000 7faf6aa00700 1 -- 172.21.15.70:0/3847380249 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7faf6c0e23a0 con 0x7faf7010fd00 2024-05-08T06:48:21.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.428+0000 7faf75400700 1 --2- 172.21.15.70:0/4064302805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff14ed0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faf6000bdc0 tx=0x7faf600126d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3f5d90d53396cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:21.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.429+0000 7faf75e00700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf580b2b20 0x7faf580b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.429+0000 7faf5f400700 1 -- 172.21.15.70:0/4064302805 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60012c30 con 0x55fe5ff14af0 2024-05-08T06:48:21.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.429+0000 7faf5f400700 1 -- 172.21.15.70:0/4064302805 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf60016070 con 0x55fe5ff14af0 2024-05-08T06:48:21.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.429+0000 7faf5f400700 1 -- 172.21.15.70:0/4064302805 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60005380 con 0x55fe5ff14af0 2024-05-08T06:48:21.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.430+0000 7faf83226b80 1 -- 172.21.15.70:0/4064302805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 msgr2=0x55fe5ff14ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:21.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.430+0000 7faf83226b80 1 --2- 172.21.15.70:0/4064302805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff14ed0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faf6000bdc0 tx=0x7faf600126d0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.430+0000 7faf75e00700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf580b2b20 0x7faf580b4fe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf6400b5c0 tx=0x7faf6401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:21.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.430+0000 7faf83226b80 1 -- 172.21.15.70:0/4064302805 shutdown_connections 2024-05-08T06:48:21.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.430+0000 7faf83226b80 1 --2- 172.21.15.70:0/4064302805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff0fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.430+0000 7faf83226b80 1 --2- 172.21.15.70:0/4064302805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff14ed0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.430+0000 7faf83226b80 1 --2- 172.21.15.70:0/4064302805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff0f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.430+0000 7faf83226b80 1 -- 172.21.15.70:0/4064302805 >> 172.21.15.70:0/4064302805 conn(0x55fe5fe7e860 msgr2=0x55fe5ff01370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:21.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.431+0000 7faf83226b80 1 -- 172.21.15.70:0/4064302805 shutdown_connections 2024-05-08T06:48:21.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.431+0000 7faf83226b80 1 -- 172.21.15.70:0/4064302805 wait complete. 2024-05-08T06:48:21.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.432+0000 7faf83226b80 1 -- start start 2024-05-08T06:48:21.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.432+0000 7faf83226b80 1 Processor -- start 2024-05-08T06:48:21.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf83226b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff1b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf83226b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff18500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf83226b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff18a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf83226b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fe5ff1bf30 con 0x55fe5ff14af0 2024-05-08T06:48:21.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf83226b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fe5fdbecb0 con 0x55fe5ff15410 2024-05-08T06:48:21.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf83226b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fe5ff1c0b0 con 0x55fe5ff0f640 2024-05-08T06:48:21.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf83226b80 10 client.0 _ll_register_callbacks cb 0x55fe5fdffe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:48:21.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff18500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff18500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34990/0 (socket says 172.21.15.70:34990) 2024-05-08T06:48:21.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf75400700 1 -- 172.21.15.70:0/1914970861 learned_addr learned my addr 172.21.15.70:0/1914970861 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:21.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.433+0000 7faf75e00700 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff1b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.434+0000 7faf76800700 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff18a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.434+0000 7faf75400700 1 -- 172.21.15.70:0/1914970861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 msgr2=0x55fe5ff1b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:21.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.434+0000 7faf75400700 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff1b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.434+0000 7faf75400700 1 -- 172.21.15.70:0/1914970861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 msgr2=0x55fe5ff18a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:21.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.434+0000 7faf75400700 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff18a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.434+0000 7faf75400700 1 -- 172.21.15.70:0/1914970861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe5fe1e5b0 con 0x55fe5ff14af0 2024-05-08T06:48:21.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.434+0000 7faf75400700 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff18500 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7faf6000c010 tx=0x7faf6000b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fc63b4c1fe3fc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:21.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.434+0000 7faf53e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:48:21.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.435+0000 7faf53e00700 1 -- 172.21.15.70:0/1914970861 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf60005000 con 0x55fe5ff14af0 2024-05-08T06:48:21.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.435+0000 7faf53e00700 1 -- 172.21.15.70:0/1914970861 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7faf600051a0 con 0x55fe5ff14af0 2024-05-08T06:48:21.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.435+0000 7faf83226b80 1 -- 172.21.15.70:0/1914970861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf60016070 con 0x55fe5ff14af0 2024-05-08T06:48:21.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.435+0000 7faf53e00700 1 -- 172.21.15.70:0/1914970861 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faf600053a0 con 0x55fe5ff14af0 2024-05-08T06:48:21.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.435+0000 7faf83226b80 10 client.15477 fetch_fsmap learned FSMap version 27 2024-05-08T06:48:21.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.435+0000 7faf83226b80 1 -- 172.21.15.70:0/1914970861 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fe5ff26760 con 0x55fe5ff14af0 2024-05-08T06:48:21.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.436+0000 7faf53e00700 1 -- 172.21.15.70:0/1914970861 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf60016070 con 0x55fe5ff14af0 2024-05-08T06:48:21.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.436+0000 7faf53e00700 1 -- 172.21.15.70:0/1914970861 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7faf60023070 con 0x55fe5ff14af0 2024-05-08T06:48:21.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.436+0000 7faf83226b80 10 client.15477 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:48:21.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.436+0000 7faf83226b80 10 client.15477 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:48:21.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.436+0000 7faf83226b80 20 client.15477 populate_metadata read hostname 'smithi070' 2024-05-08T06:48:21.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.436+0000 7faf83226b80 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fe5ff28c30 0x55fe5ff2b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.437+0000 7faf83226b80 4 client.15477 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:48:21.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.437+0000 7faf83226b80 1 -- 172.21.15.70:0/1914970861 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe5fed32d0 con 0x55fe5ff28c30 2024-05-08T06:48:21.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.437+0000 7faf75e00700 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fe5ff28c30 0x55fe5ff2b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.438+0000 7faf75e00700 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fe5ff28c30 0x55fe5ff2b020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72e5acf2bde61558 server_cookie=4bd834e58f920f3c in_seq=0 out_seq=0 2024-05-08T06:48:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.438+0000 7faf53e00700 10 client.15477 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.440+0000 7faf53e00700 1 -- 172.21.15.70:0/1914970861 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fe5fed32d0 con 0x55fe5ff28c30 2024-05-08T06:48:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.440+0000 7faf53e00700 10 client.15477 handle_command_reply: tid=0 2024-05-08T06:48:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.440+0000 7faf83226b80 1 client.15477 shutdown 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.440+0000 7faf83226b80 1 -- 172.21.15.70:0/1914970861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 msgr2=0x55fe5ff18500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.440+0000 7faf83226b80 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff18500 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7faf6000c010 tx=0x7faf6000b9e0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.441+0000 7faf83226b80 1 -- 172.21.15.70:0/1914970861 shutdown_connections 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.441+0000 7faf83226b80 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fe5ff28c30 0x55fe5ff2b020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.441+0000 7faf83226b80 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff18a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.441+0000 7faf83226b80 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff1b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.441+0000 7faf83226b80 1 --2- 172.21.15.70:0/1914970861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff14af0 0x55fe5ff18500 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.441+0000 7faf83226b80 1 -- 172.21.15.70:0/1914970861 >> 172.21.15.70:0/1914970861 conn(0x55fe5fe7e860 msgr2=0x55fe5ff05800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.441+0000 7faf53e00700 0 client.15477 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.441+0000 7faf83226b80 1 -- 172.21.15.70:0/1914970861 shutdown_connections 2024-05-08T06:48:21.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.442+0000 7faf83226b80 1 -- 172.21.15.70:0/1914970861 wait complete. 2024-05-08T06:48:21.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.442+0000 7faf83226b80 20 client.15477 trim_cache size 0 max 16384 2024-05-08T06:48:21.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.462+0000 7faf83226b80 1 Processor -- start 2024-05-08T06:48:21.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.462+0000 7faf83226b80 1 -- start start 2024-05-08T06:48:21.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.463+0000 7faf83226b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff0f640 0x55fe5ff16df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.463+0000 7faf83226b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff15410 0x55fe5ff17330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.463+0000 7faf83226b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.463+0000 7faf83226b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf701afa50 con 0x55fe5ff15410 2024-05-08T06:48:21.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.463+0000 7faf83226b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf701ad2e0 con 0x55fe5ff0f640 2024-05-08T06:48:21.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.463+0000 7faf83226b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faf701ab150 con 0x55fe5ff18bd0 2024-05-08T06:48:21.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.463+0000 7faf75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff15410 0x55fe5ff17330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff0f640 0x55fe5ff16df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff0f640 0x55fe5ff16df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:33118/0 (socket says 172.21.15.70:33118) 2024-05-08T06:48:21.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff15410 0x55fe5ff17330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35000/0 (socket says 172.21.15.70:35000) 2024-05-08T06:48:21.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75e00700 1 -- 172.21.15.70:0/232672657 learned_addr learned my addr 172.21.15.70:0/232672657 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:21.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf76800700 1 --2- 172.21.15.70:0/232672657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75e00700 1 -- 172.21.15.70:0/232672657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff18bd0 msgr2=0x55fe5ff306d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75e00700 1 --2- 172.21.15.70:0/232672657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff306d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75e00700 1 -- 172.21.15.70:0/232672657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff15410 msgr2=0x55fe5ff17330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75e00700 1 --2- 172.21.15.70:0/232672657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff15410 0x55fe5ff17330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75e00700 1 -- 172.21.15.70:0/232672657 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe5fefdcb0 con 0x55fe5ff0f640 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.464+0000 7faf75400700 1 --2- 172.21.15.70:0/232672657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff15410 0x55fe5ff17330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.465+0000 7faf75e00700 1 --2- 172.21.15.70:0/232672657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff0f640 0x55fe5ff16df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf64009750 tx=0x7faf64024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59a193c617546bc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.465+0000 7faf5ea00700 1 -- 172.21.15.70:0/232672657 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6403b070 con 0x55fe5ff0f640 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.465+0000 7faf5ea00700 1 -- 172.21.15.70:0/232672657 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf6400bce0 con 0x55fe5ff0f640 2024-05-08T06:48:21.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.466+0000 7faf5ea00700 1 -- 172.21.15.70:0/232672657 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf64004fe0 con 0x55fe5ff0f640 2024-05-08T06:48:21.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.466+0000 7faf83226b80 1 -- 172.21.15.70:0/232672657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff0f640 msgr2=0x55fe5ff16df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:21.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.466+0000 7faf83226b80 1 --2- 172.21.15.70:0/232672657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff0f640 0x55fe5ff16df0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf64009750 tx=0x7faf64024000 comp rx=0 tx=0).stop 2024-05-08T06:48:21.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.467+0000 7faf83226b80 1 -- 172.21.15.70:0/232672657 shutdown_connections 2024-05-08T06:48:21.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.467+0000 7faf83226b80 1 --2- 172.21.15.70:0/232672657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff306d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.467+0000 7faf83226b80 1 --2- 172.21.15.70:0/232672657 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff0f640 0x55fe5ff16df0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.467+0000 7faf83226b80 1 --2- 172.21.15.70:0/232672657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff15410 0x55fe5ff17330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.467+0000 7faf83226b80 1 -- 172.21.15.70:0/232672657 >> 172.21.15.70:0/232672657 conn(0x55fe5fe7e860 msgr2=0x55fe5ff184c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:21.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.470+0000 7faf83226b80 1 -- 172.21.15.70:0/232672657 shutdown_connections 2024-05-08T06:48:21.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.470+0000 7faf83226b80 1 -- 172.21.15.70:0/232672657 wait complete. 2024-05-08T06:48:21.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.470+0000 7faf83226b80 1 -- start start 2024-05-08T06:48:21.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.470+0000 7faf83226b80 1 Processor -- start 2024-05-08T06:48:21.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.471+0000 7faf83226b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff21960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.471+0000 7faf83226b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff1e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.471+0000 7faf83226b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff1e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.471+0000 7faf83226b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf701ab7a0 con 0x55fe5ff18bd0 2024-05-08T06:48:21.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.471+0000 7faf83226b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf701acc10 con 0x55fe5ff15410 2024-05-08T06:48:21.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.471+0000 7faf83226b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faf701abe70 con 0x55fe5ff0f640 2024-05-08T06:48:21.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.471+0000 7faf83226b80 10 client.0 _ll_register_callbacks cb 0x55fe5fdffe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:48:21.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.472+0000 7faf76800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff1e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.472+0000 7faf76800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff1e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35004/0 (socket says 172.21.15.70:35004) 2024-05-08T06:48:21.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.472+0000 7faf76800700 1 -- 172.21.15.70:0/2486810880 learned_addr learned my addr 172.21.15.70:0/2486810880 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:21.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.472+0000 7faf76800700 1 -- 172.21.15.70:0/2486810880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 msgr2=0x55fe5ff21960 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:48:21.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.472+0000 7faf76800700 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff21960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.472+0000 7faf76800700 1 -- 172.21.15.70:0/2486810880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 msgr2=0x55fe5ff1e340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:48:21.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.472+0000 7faf76800700 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff1e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.472+0000 7faf76800700 1 -- 172.21.15.70:0/2486810880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe5ff1f0a0 con 0x55fe5ff18bd0 2024-05-08T06:48:21.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.473+0000 7faf76800700 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff1e880 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0a9240 tx=0x7faf6c0a9b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa95ffc6115db7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:21.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.473+0000 7faf53e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:48:21.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.473+0000 7faf53e00700 1 -- 172.21.15.70:0/2486810880 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c0a9510 con 0x55fe5ff18bd0 2024-05-08T06:48:21.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.473+0000 7faf53e00700 1 -- 172.21.15.70:0/2486810880 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7faf6c0a96b0 con 0x55fe5ff18bd0 2024-05-08T06:48:21.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.473+0000 7faf83226b80 1 -- 172.21.15.70:0/2486810880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf6400bce0 con 0x55fe5ff18bd0 2024-05-08T06:48:21.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.474+0000 7faf53e00700 1 -- 172.21.15.70:0/2486810880 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faf6c0b1c80 con 0x55fe5ff18bd0 2024-05-08T06:48:21.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.474+0000 7faf83226b80 10 client.15483 fetch_fsmap learned FSMap version 27 2024-05-08T06:48:21.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.474+0000 7faf83226b80 1 -- 172.21.15.70:0/2486810880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fe5ff942b0 con 0x55fe5ff18bd0 2024-05-08T06:48:21.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.474+0000 7faf53e00700 1 -- 172.21.15.70:0/2486810880 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf6400bce0 con 0x55fe5ff18bd0 2024-05-08T06:48:21.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.474+0000 7faf53e00700 1 -- 172.21.15.70:0/2486810880 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7faf6c012070 con 0x55fe5ff18bd0 2024-05-08T06:48:21.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.475+0000 7faf83226b80 10 client.15483 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:48:21.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.475+0000 7faf83226b80 10 client.15483 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:48:21.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.475+0000 7faf83226b80 20 client.15483 populate_metadata read hostname 'smithi070' 2024-05-08T06:48:21.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.475+0000 7faf83226b80 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fe5ff949e0 0x55fe5ff96e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:21.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.475+0000 7faf83226b80 4 client.15483 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.4, "await_for": 42.0}] 2024-05-08T06:48:21.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.475+0000 7faf83226b80 1 -- 172.21.15.70:0/2486810880 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.4, "await_for": 42.0}) -- 0x55fe5fe66590 con 0x55fe5ff949e0 2024-05-08T06:48:21.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.477+0000 7faf75e00700 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fe5ff949e0 0x55fe5ff96e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:21.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.478+0000 7faf53e00700 10 client.15483 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:21.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.478+0000 7faf75e00700 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fe5ff949e0 0x55fe5ff96e20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70f27165b61d73f0 server_cookie=a89bdf6b00651012 in_seq=0 out_seq=0 2024-05-08T06:48:21.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.498+0000 7faf53e00700 1 -- 172.21.15.70:0/2486810880 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55fe5fe66590 con 0x55fe5ff949e0 2024-05-08T06:48:21.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf53e00700 10 client.15483 handle_command_reply: tid=0 2024-05-08T06:48:21.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 client.15483 shutdown 2024-05-08T06:48:21.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 -- 172.21.15.70:0/2486810880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff18bd0 msgr2=0x55fe5ff1e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:21.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff1e880 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0a9240 tx=0x7faf6c0a9b10 comp rx=0 tx=0).stop 2024-05-08T06:48:21.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 -- 172.21.15.70:0/2486810880 shutdown_connections 2024-05-08T06:48:21.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fe5ff949e0 0x55fe5ff96e20 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fe5ff18bd0 0x55fe5ff1e880 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fe5ff0f640 0x55fe5ff21960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf53e00700 0 client.15483 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:21.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 --2- 172.21.15.70:0/2486810880 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fe5ff15410 0x55fe5ff1e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 -- 172.21.15.70:0/2486810880 >> 172.21.15.70:0/2486810880 conn(0x55fe5fe7e860 msgr2=0x55fe5ff157f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:21.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 -- 172.21.15.70:0/2486810880 shutdown_connections 2024-05-08T06:48:21.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.499+0000 7faf83226b80 1 -- 172.21.15.70:0/2486810880 wait complete. 2024-05-08T06:48:21.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.500+0000 7faf83226b80 20 client.15483 trim_cache size 0 max 16384 2024-05-08T06:48:21.500 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:48:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 27, 2024-05-08T06:48:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:48:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 6, 2024-05-08T06:48:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:48:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "b65051e0": { 2024-05-08T06:48:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 6, 2024-05-08T06:48:21.501 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.4, 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:21.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:21.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:21.503 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:48:21.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 -- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf580b2b20 msgr2=0x7faf580b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:21.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf580b2b20 0x7faf580b4fe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf6400b5c0 tx=0x7faf6401a040 comp rx=0 tx=0).stop 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 -- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7010fd00 msgr2=0x7faf7019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7010fd00 0x7faf7019b9f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0094f0 tx=0x7faf6c00d3b0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 -- 172.21.15.70:0/3847380249 shutdown_connections 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf580b2b20 0x7faf580b4fe0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf7010fd00 0x7faf7019b9f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf70075a40 0x7faf701a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 --2- 172.21.15.70:0/3847380249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf70076360 0x7faf701a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 -- 172.21.15.70:0/3847380249 >> 172.21.15.70:0/3847380249 conn(0x7faf700fee00 msgr2=0x7faf700ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 -- 172.21.15.70:0/3847380249 shutdown_connections 2024-05-08T06:48:21.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:21.502+0000 7faf77200700 1 -- 172.21.15.70:0/3847380249 wait complete. 2024-05-08T06:48:22.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:21 smithi172 ceph-mon[33377]: pgmap v57: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:22.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:21 smithi194 ceph-mon[33679]: pgmap v57: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:22.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:21 smithi070 ceph-mon[29591]: pgmap v57: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:22.518 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b65051e0', quiesce took 8.2 seconds. Will release after: 19.4 2024-05-08T06:48:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:23 smithi172 ceph-mon[33377]: pgmap v58: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:24.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:23 smithi194 ceph-mon[33679]: pgmap v58: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:23 smithi070 ceph-mon[29591]: pgmap v58: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:26.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:25 smithi172 ceph-mon[33377]: pgmap v59: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:26.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:25 smithi194 ceph-mon[33679]: pgmap v59: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:26.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:25 smithi070 ceph-mon[29591]: pgmap v59: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:27 smithi172 ceph-mon[33377]: pgmap v60: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:28.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:27 smithi194 ceph-mon[33679]: pgmap v60: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:28.368 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:27 smithi070 ceph-mon[29591]: pgmap v60: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:29 smithi172 ceph-mon[33377]: pgmap v61: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:29 smithi194 ceph-mon[33679]: pgmap v61: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:29 smithi070 ceph-mon[29591]: pgmap v61: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:31 smithi172 ceph-mon[33377]: pgmap v62: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:32.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:31 smithi194 ceph-mon[33679]: pgmap v62: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:32.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:31 smithi070 ceph-mon[29591]: pgmap v62: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:34.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:33 smithi172 ceph-mon[33377]: pgmap v63: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:33 smithi194 ceph-mon[33679]: pgmap v63: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:33 smithi070 ceph-mon[29591]: pgmap v63: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:35 smithi172 ceph-mon[33377]: pgmap v64: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:36.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:35 smithi194 ceph-mon[33679]: pgmap v64: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:36.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:35 smithi070 ceph-mon[29591]: pgmap v64: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:38.247 INFO:tasks.workunit.client.0.smithi070.stderr:Updating files: 60% (7425/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-08T06:48:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:37 smithi194 ceph-mon[33679]: pgmap v65: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:38.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:37 smithi070 ceph-mon[29591]: pgmap v65: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:37 smithi172 ceph-mon[33377]: pgmap v65: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:38.955 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a'. 2024-05-08T06:48:38.955 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:48:38.955 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T06:48:38.955 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T06:48:38.955 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:48:38.956 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at bee299f4ac3 mds: relax divergent backtrace scrub failures for replicated ancestor inodes 2024-05-08T06:48:38.973 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T06:48:39.035 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T06:48:39.042 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T06:48:39.042 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T06:48:39.884 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T06:48:39.991 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T06:48:40.074 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T06:48:40.080 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T06:48:40.080 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T06:48:40.160 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T06:48:40.170 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T06:48:40.170 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T06:48:40.222 INFO:tasks.workunit:Running workunits matching kernel_untar_build.sh on client.0... 2024-05-08T06:48:40.224 INFO:tasks.workunit:Running workunit kernel_untar_build.sh... 2024-05-08T06:48:40.225 DEBUG:teuthology.orchestra.run.smithi070:workunit test kernel_untar_build.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh 2024-05-08T06:48:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:39 smithi194 ceph-mon[33679]: pgmap v66: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:39 smithi070 ceph-mon[29591]: pgmap v66: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:39 smithi172 ceph-mon[33377]: pgmap v66: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:41.919 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:48:42.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:41 smithi194 ceph-mon[33679]: pgmap v67: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:42.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:41 smithi070 ceph-mon[29591]: pgmap v67: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:42.384 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:48:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:41 smithi172 ceph-mon[33377]: pgmap v67: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:43 smithi194 ceph-mon[33679]: pgmap v68: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:48:44.324 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:43 smithi070 ceph-mon[29591]: pgmap v68: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:44.324 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:48:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:43 smithi172 ceph-mon[33377]: pgmap v68: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:48:44.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.922+0000 7f83cfe00700 1 -- 172.21.15.70:0/322465082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d01033d0 msgr2=0x7f83d0103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.923+0000 7f83cfe00700 1 --2- 172.21.15.70:0/322465082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d01033d0 0x7f83d0103850 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009990 tx=0x7f83bc009ca0 comp rx=0 tx=0).stop 2024-05-08T06:48:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.923+0000 7f83cfe00700 1 -- 172.21.15.70:0/322465082 shutdown_connections 2024-05-08T06:48:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.923+0000 7f83cfe00700 1 --2- 172.21.15.70:0/322465082 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d0103d90 0x7f83d01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.923+0000 7f83cfe00700 1 --2- 172.21.15.70:0/322465082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83d0109460 0x7f83d0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.923+0000 7f83cfe00700 1 --2- 172.21.15.70:0/322465082 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d01033d0 0x7f83d0103850 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.923+0000 7f83cfe00700 1 -- 172.21.15.70:0/322465082 >> 172.21.15.70:0/322465082 conn(0x7f83d00fef20 msgr2=0x7f83d0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.923+0000 7f83cfe00700 1 -- 172.21.15.70:0/322465082 shutdown_connections 2024-05-08T06:48:44.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.923+0000 7f83cfe00700 1 -- 172.21.15.70:0/322465082 wait complete. 2024-05-08T06:48:44.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.925+0000 7f83cfe00700 1 Processor -- start 2024-05-08T06:48:44.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.925+0000 7f83cfe00700 1 -- start start 2024-05-08T06:48:44.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.925+0000 7f83cfe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d01033d0 0x7f83d00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:44.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.925+0000 7f83cfe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83d0103d90 0x7f83d0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:44.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.925+0000 7f83cfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d0109460 0x7f83d0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:44.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.926+0000 7f83cfe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83d01134a0 con 0x7f83d0109460 2024-05-08T06:48:44.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.926+0000 7f83cfe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83d0113320 con 0x7f83d01033d0 2024-05-08T06:48:44.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.926+0000 7f83cfe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83d0113620 con 0x7f83d0103d90 2024-05-08T06:48:44.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.926+0000 7f83cf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d0109460 0x7f83d0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:44.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.926+0000 7f83cf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d0109460 0x7f83d0076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33014/0 (socket says 172.21.15.70:33014) 2024-05-08T06:48:44.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.926+0000 7f83cf400700 1 -- 172.21.15.70:0/914081761 learned_addr learned my addr 172.21.15.70:0/914081761 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.926+0000 7f83cea00700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d01033d0 0x7f83d00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.926+0000 7f83ce000700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83d0103d90 0x7f83d0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83cf400700 1 -- 172.21.15.70:0/914081761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83d0103d90 msgr2=0x7f83d0075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83cf400700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83d0103d90 0x7f83d0075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83cf400700 1 -- 172.21.15.70:0/914081761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d01033d0 msgr2=0x7f83d00757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83cf400700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d01033d0 0x7f83d00757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83cf400700 1 -- 172.21.15.70:0/914081761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d01a7ee0 con 0x7f83d0109460 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83ce000700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83d0103d90 0x7f83d0075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83cf400700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d0109460 0x7f83d0076220 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f83c8007d70 tx=0x7f83c800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83c7400700 1 -- 172.21.15.70:0/914081761 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8016020 con 0x7f83d0109460 2024-05-08T06:48:44.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83c7400700 1 -- 172.21.15.70:0/914081761 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83c800ad40 con 0x7f83d0109460 2024-05-08T06:48:44.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83c7400700 1 -- 172.21.15.70:0/914081761 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c80115e0 con 0x7f83d0109460 2024-05-08T06:48:44.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d01a81d0 con 0x7f83d0109460 2024-05-08T06:48:44.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.927+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d01a86c0 con 0x7f83d0109460 2024-05-08T06:48:44.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.929+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d006a190 con 0x7f83d0109460 2024-05-08T06:48:44.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.933+0000 7f83c7400700 1 -- 172.21.15.70:0/914081761 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f83c8019020 con 0x7f83d0109460 2024-05-08T06:48:44.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.934+0000 7f83c7400700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83b40b29f0 0x7f83b40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:44.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.934+0000 7f83c7400700 1 -- 172.21.15.70:0/914081761 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f83c80e2de0 con 0x7f83d0109460 2024-05-08T06:48:44.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.935+0000 7f83cea00700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83b40b29f0 0x7f83b40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:44.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.935+0000 7f83cea00700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83b40b29f0 0x7f83b40b4eb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009a10 tx=0x7f83c0009190 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:44.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:44.937+0000 7f83c7400700 1 -- 172.21.15.70:0/914081761 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f83c8020020 con 0x7f83d0109460 2024-05-08T06:48:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:48:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:48:45.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.226+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83d002e510 con 0x7f83d0109460 2024-05-08T06:48:45.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.227+0000 7f83c7400700 1 -- 172.21.15.70:0/914081761 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11876 (secure 0 0 0) 0x7f83c80aa4a0 con 0x7f83d0109460 2024-05-08T06:48:45.227 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:48:45.227 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:46:31.709156+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T06:48:45.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.230+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83b40b29f0 msgr2=0x7f83b40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:45.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.230+0000 7f83cfe00700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83b40b29f0 0x7f83b40b4eb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009a10 tx=0x7f83c0009190 comp rx=0 tx=0).stop 2024-05-08T06:48:45.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.231+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d0109460 msgr2=0x7f83d0076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:45.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.231+0000 7f83cfe00700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d0109460 0x7f83d0076220 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f83c8007d70 tx=0x7f83c800a340 comp rx=0 tx=0).stop 2024-05-08T06:48:45.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.231+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 shutdown_connections 2024-05-08T06:48:45.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.231+0000 7f83cfe00700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83b40b29f0 0x7f83b40b4eb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:45.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.231+0000 7f83cfe00700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83d0109460 0x7f83d0076220 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:45.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.231+0000 7f83cfe00700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83d01033d0 0x7f83d00757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:45.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.231+0000 7f83cfe00700 1 --2- 172.21.15.70:0/914081761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83d0103d90 0x7f83d0075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:45.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.231+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 >> 172.21.15.70:0/914081761 conn(0x7f83d00fef20 msgr2=0x7f83d00ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:45.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.231+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 shutdown_connections 2024-05-08T06:48:45.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:45.232+0000 7f83cfe00700 1 -- 172.21.15.70:0/914081761 wait complete. 2024-05-08T06:48:45.232 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-05-08T06:48:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:48:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:48:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:48:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:48:46.230 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id b65051e0 --release --await' 2024-05-08T06:48:46.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id b65051e0 --release --await 2024-05-08T06:48:46.260 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:45 smithi070 ceph-mon[29591]: pgmap v69: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:46.260 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:48:46.260 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:45 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/914081761' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:48:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:45 smithi194 ceph-mon[33679]: pgmap v69: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:48:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:45 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/914081761' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:48:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:45 smithi172 ceph-mon[33377]: pgmap v69: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:48:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:45 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/914081761' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:48:46.651 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:48:48.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:47 smithi070 ceph-mon[29591]: pgmap v70: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:48.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:47 smithi194 ceph-mon[33679]: pgmap v70: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:47 smithi172 ceph-mon[33377]: pgmap v70: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:49.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.128+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1073532371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10a490 msgr2=0x7fe0ec1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:49.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.128+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1073532371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10a490 0x7fe0ec1169a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400b0a0 tx=0x7fe0e400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.128+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1073532371 shutdown_connections 2024-05-08T06:48:49.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.128+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1073532371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10a490 0x7fe0ec1169a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.128+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1073532371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0ec10fb60 0x7fe0ec10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.128+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1073532371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0ec109ad0 0x7fe0ec109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.128+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1073532371 >> 172.21.15.70:0/1073532371 conn(0x7fe0ec076c70 msgr2=0x7fe0ec1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.129+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1073532371 shutdown_connections 2024-05-08T06:48:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.129+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1073532371 wait complete. 2024-05-08T06:48:49.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.130+0000 7fe0f1c00700 1 Processor -- start 2024-05-08T06:48:49.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.131+0000 7fe0f1c00700 1 -- start start 2024-05-08T06:48:49.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.131+0000 7fe0f1c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0ec109ad0 0x7fe0ec1a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.131+0000 7fe0f1c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0ec10a490 0x7fe0ec1a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.131+0000 7fe0f1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10fb60 0x7fe0ec1a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.131+0000 7fe0f1c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec119b80 con 0x7fe0ec10fb60 2024-05-08T06:48:49.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.131+0000 7fe0f1c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec119a00 con 0x7fe0ec10a490 2024-05-08T06:48:49.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.131+0000 7fe0f1c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec119d00 con 0x7fe0ec109ad0 2024-05-08T06:48:49.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0eb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10fb60 0x7fe0ec1a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0eb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10fb60 0x7fe0ec1a48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35578/0 (socket says 172.21.15.70:35578) 2024-05-08T06:48:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0eb400700 1 -- 172.21.15.70:0/1805679998 learned_addr learned my addr 172.21.15.70:0/1805679998 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0ea000700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0ec10a490 0x7fe0ec1a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0ec109ad0 0x7fe0ec1a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0eb400700 1 -- 172.21.15.70:0/1805679998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0ec109ad0 msgr2=0x7fe0ec1a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:49.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0eb400700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0ec109ad0 0x7fe0ec1a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0eb400700 1 -- 172.21.15.70:0/1805679998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0ec10a490 msgr2=0x7fe0ec1a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:49.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0eb400700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0ec10a490 0x7fe0ec1a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0eb400700 1 -- 172.21.15.70:0/1805679998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec1a5010 con 0x7fe0ec10fb60 2024-05-08T06:48:49.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.132+0000 7fe0ea000700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0ec10a490 0x7fe0ec1a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:48:49.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.133+0000 7fe0eb400700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10fb60 0x7fe0ec1a48d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400b830 tx=0x7fe0e4004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:49.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.133+0000 7fe0e3400700 1 -- 172.21.15.70:0/1805679998 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4021070 con 0x7fe0ec10fb60 2024-05-08T06:48:49.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.133+0000 7fe0e3400700 1 -- 172.21.15.70:0/1805679998 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0e4007b80 con 0x7fe0ec10fb60 2024-05-08T06:48:49.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.133+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1805679998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ec1a52a0 con 0x7fe0ec10fb60 2024-05-08T06:48:49.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.133+0000 7fe0e3400700 1 -- 172.21.15.70:0/1805679998 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40052a0 con 0x7fe0ec10fb60 2024-05-08T06:48:49.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.133+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1805679998 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0ec1acb80 con 0x7fe0ec10fb60 2024-05-08T06:48:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.139+0000 7fe0e3400700 1 -- 172.21.15.70:0/1805679998 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe0e4024070 con 0x7fe0ec10fb60 2024-05-08T06:48:49.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.140+0000 7fe0fc65bb80 1 Processor -- start 2024-05-08T06:48:49.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.140+0000 7fe0fc65bb80 1 -- start start 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2ea1b0 0x563b6f2ea590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e4780 0x563b6f2e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 0x563b6f2f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563b6f236b20 con 0x563b6f2e4780 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0e3400700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d00b29f0 0x7fe0d00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563b6f1d4860 con 0x563b6f2ea1b0 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563b6f232ae0 con 0x563b6f2e5140 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0e3400700 1 -- 172.21.15.70:0/1805679998 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fe0e400f020 con 0x7fe0ec10fb60 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0eaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e4780 0x563b6f2e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0eb400700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d00b29f0 0x7fe0d00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0eaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e4780 0x563b6f2e4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35584/0 (socket says 172.21.15.70:35584) 2024-05-08T06:48:49.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0eaa00700 1 -- 172.21.15.70:0/1100106623 learned_addr learned my addr 172.21.15.70:0/1100106623 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:49.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.141+0000 7fe0ea000700 1 --2- 172.21.15.70:0/1100106623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2ea1b0 0x563b6f2ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.142+0000 7fe0ea000700 1 --2- 172.21.15.70:0/1100106623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 0x563b6f2f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.142+0000 7fe0eaa00700 1 -- 172.21.15.70:0/1100106623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 msgr2=0x563b6f2f0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:49.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.142+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/1100106623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 0x563b6f2f0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.142+0000 7fe0eaa00700 1 -- 172.21.15.70:0/1100106623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2ea1b0 msgr2=0x563b6f2ea590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:49.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.142+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/1100106623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2ea1b0 0x563b6f2ea590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.142+0000 7fe0eaa00700 1 -- 172.21.15.70:0/1100106623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b6f1839d0 con 0x563b6f2e4780 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.142+0000 7fe0eb400700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d00b29f0 0x7fe0d00b4eb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40aaf60 tx=0x7fe0e4009040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.143+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/1100106623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e4780 0x563b6f2e4c00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00bcf0 tx=0x7fe0dc0103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba7ea914b93551d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.143+0000 7fe0d7e00700 1 -- 172.21.15.70:0/1100106623 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc010bf0 con 0x563b6f2e4780 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.143+0000 7fe0d7e00700 1 -- 172.21.15.70:0/1100106623 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0dc0044c0 con 0x563b6f2e4780 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.143+0000 7fe0d7e00700 1 -- 172.21.15.70:0/1100106623 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc005020 con 0x563b6f2e4780 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.144+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/1100106623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e4780 msgr2=0x563b6f2e4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.144+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/1100106623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e4780 0x563b6f2e4c00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00bcf0 tx=0x7fe0dc0103d0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.144+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/1100106623 shutdown_connections 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.144+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/1100106623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 0x563b6f2f0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.144+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/1100106623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2ea1b0 0x563b6f2ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.144+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/1100106623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e4780 0x563b6f2e4c00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.144+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/1100106623 >> 172.21.15.70:0/1100106623 conn(0x563b6f25c7d0 msgr2=0x563b6f2df070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:49.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.144+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/1100106623 shutdown_connections 2024-05-08T06:48:49.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.144+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/1100106623 wait complete. 2024-05-08T06:48:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.145+0000 7fe0fc65bb80 1 -- start start 2024-05-08T06:48:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.145+0000 7fe0fc65bb80 1 Processor -- start 2024-05-08T06:48:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.145+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.145+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2edf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.145+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 0x563b6f2ee480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.145+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563b6f2f1570 con 0x563b6f2e5140 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.145+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563b6f19cc20 con 0x563b6f2e4780 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.145+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563b6f2f16f0 con 0x563b6f2ea1b0 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.145+0000 7fe0fc65bb80 10 client.0 _ll_register_callbacks cb 0x563b6f1ddd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0eaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0eaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2edf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35594/0 (socket says 172.21.15.70:35594) 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0eaa00700 1 -- 172.21.15.70:0/2009613950 learned_addr learned my addr 172.21.15.70:0/2009613950 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 0x563b6f2ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0eaa00700 1 -- 172.21.15.70:0/2009613950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 msgr2=0x563b6f2ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 0x563b6f2ee480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0eaa00700 1 -- 172.21.15.70:0/2009613950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 msgr2=0x563b6f2f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2f0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0eaa00700 1 -- 172.21.15.70:0/2009613950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b6f1fc520 con 0x563b6f2e5140 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.146+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.147+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2edf40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc010c50 tx=0x7fe0dc010d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf3395394a656b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.147+0000 7fe0d4c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.147+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2009613950 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc0047c0 con 0x563b6f2e5140 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.147+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2009613950 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fe0dc011650 con 0x563b6f2e5140 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.147+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2009613950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0dc0044c0 con 0x563b6f2e5140 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.147+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2009613950 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe0dc011850 con 0x563b6f2e5140 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.147+0000 7fe0fc65bb80 10 client.15501 fetch_fsmap learned FSMap version 27 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.147+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2009613950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563b6f2fbd50 con 0x563b6f2e5140 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.148+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2009613950 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0dc0044c0 con 0x563b6f2e5140 2024-05-08T06:48:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.148+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2009613950 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe0dc026b60 con 0x563b6f2e5140 2024-05-08T06:48:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.148+0000 7fe0fc65bb80 10 client.15501 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:48:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.148+0000 7fe0fc65bb80 10 client.15501 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:48:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.148+0000 7fe0fc65bb80 20 client.15501 populate_metadata read hostname 'smithi070' 2024-05-08T06:48:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.148+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563b6f2fe2d0 0x563b6f3006c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.148+0000 7fe0fc65bb80 4 client.15501 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:48:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.148+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2009613950 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b6f2b1240 con 0x563b6f2fe2d0 2024-05-08T06:48:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.149+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563b6f2fe2d0 0x563b6f3006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.150+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563b6f2fe2d0 0x563b6f3006c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7edc93230b0f7d23 server_cookie=7dfed33051bca701 in_seq=0 out_seq=0 2024-05-08T06:48:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.150+0000 7fe0d4c00700 10 client.15501 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2009613950 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563b6f2b1240 con 0x563b6f2fe2d0 2024-05-08T06:48:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0d4c00700 10 client.15501 handle_command_reply: tid=0 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 client.15501 shutdown 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2009613950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 msgr2=0x563b6f2edf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2edf40 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc010c50 tx=0x7fe0dc010d30 comp rx=0 tx=0).stop 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2009613950 shutdown_connections 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563b6f2fe2d0 0x563b6f3006c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 0x563b6f2ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2009613950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2edf40 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2009613950 >> 172.21.15.70:0/2009613950 conn(0x563b6f25c7d0 msgr2=0x563b6f2d9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0d4c00700 0 client.15501 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2009613950 shutdown_connections 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2009613950 wait complete. 2024-05-08T06:48:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.152+0000 7fe0fc65bb80 20 client.15501 trim_cache size 0 max 16384 2024-05-08T06:48:49.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.173+0000 7fe0fc65bb80 1 Processor -- start 2024-05-08T06:48:49.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.174+0000 7fe0fc65bb80 1 -- start start 2024-05-08T06:48:49.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.174+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2fa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.174+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 0x563b6f2e9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.174+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2ea1b0 0x563b6f2e9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.174+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b82d0 con 0x563b6f2ea1b0 2024-05-08T06:48:49.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.174+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b5b60 con 0x563b6f2e4780 2024-05-08T06:48:49.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.174+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b39b0 con 0x563b6f2e5140 2024-05-08T06:48:49.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0ea000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2ea1b0 0x563b6f2e9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0eaa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 0x563b6f2e9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0ea000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2ea1b0 0x563b6f2e9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35596/0 (socket says 172.21.15.70:35596) 2024-05-08T06:48:49.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0eaa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 0x563b6f2e9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:60776/0 (socket says 172.21.15.70:60776) 2024-05-08T06:48:49.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0ea000700 1 -- 172.21.15.70:0/3529929389 learned_addr learned my addr 172.21.15.70:0/3529929389 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0ea000700 1 --2- 172.21.15.70:0/3529929389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0ea000700 1 -- 172.21.15.70:0/3529929389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 msgr2=0x563b6f2e9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0ea000700 1 --2- 172.21.15.70:0/3529929389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 0x563b6f2e9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0ea000700 1 -- 172.21.15.70:0/3529929389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 msgr2=0x563b6f2fa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0ea000700 1 --2- 172.21.15.70:0/3529929389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2fa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.175+0000 7fe0ea000700 1 -- 172.21.15.70:0/3529929389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b6f2dbc70 con 0x563b6f2ea1b0 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.176+0000 7fe0ea000700 1 --2- 172.21.15.70:0/3529929389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2ea1b0 0x563b6f2e9550 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80217a0 tx=0x7fe0d800c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fdb561972a1ea7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.176+0000 7fe0d7400700 1 -- 172.21.15.70:0/3529929389 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8011950 con 0x563b6f2ea1b0 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.176+0000 7fe0d7400700 1 -- 172.21.15.70:0/3529929389 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0d80145e0 con 0x563b6f2ea1b0 2024-05-08T06:48:49.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.176+0000 7fe0d7400700 1 -- 172.21.15.70:0/3529929389 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8012690 con 0x563b6f2ea1b0 2024-05-08T06:48:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/3529929389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2ea1b0 msgr2=0x563b6f2e9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/3529929389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2ea1b0 0x563b6f2e9550 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80217a0 tx=0x7fe0d800c530 comp rx=0 tx=0).stop 2024-05-08T06:48:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/3529929389 shutdown_connections 2024-05-08T06:48:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/3529929389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2ea1b0 0x563b6f2e9550 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/3529929389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2fa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/3529929389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2e5140 0x563b6f2e9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/3529929389 >> 172.21.15.70:0/3529929389 conn(0x563b6f25c7d0 msgr2=0x563b6f2ec830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/3529929389 shutdown_connections 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/3529929389 wait complete. 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.177+0000 7fe0fc65bb80 1 -- start start 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.178+0000 7fe0fc65bb80 1 Processor -- start 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.178+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2f6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.178+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.178+0000 7fe0fc65bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 0x563b6f2f1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.178+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b4020 con 0x563b6f2e5140 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.178+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b5490 con 0x563b6f2e4780 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.178+0000 7fe0fc65bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec1b46f0 con 0x563b6f2ea1b0 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.178+0000 7fe0fc65bb80 10 client.0 _ll_register_callbacks cb 0x563b6f1ddd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:48:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0eaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0eaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2f6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35600/0 (socket says 172.21.15.70:35600) 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0eaa00700 1 -- 172.21.15.70:0/2172876624 learned_addr learned my addr 172.21.15.70:0/2172876624 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 0x563b6f2f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0eaa00700 1 -- 172.21.15.70:0/2172876624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 msgr2=0x563b6f2f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 0x563b6f2f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0eaa00700 1 -- 172.21.15.70:0/2172876624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 msgr2=0x563b6f2f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0eaa00700 1 -- 172.21.15.70:0/2172876624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b6f2f1e70 con 0x563b6f2e5140 2024-05-08T06:48:49.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 0x563b6f2f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2f6e90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x563b6f2ef4c0 tx=0x7fe0dc01bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f92120abfb754 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.179+0000 7fe0d4c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.180+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2172876624 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc010e50 con 0x563b6f2e5140 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.180+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2172876624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0d80145e0 con 0x563b6f2e5140 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.180+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2172876624 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fe0dc011650 con 0x563b6f2e5140 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.180+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2172876624 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe0dc011c00 con 0x563b6f2e5140 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.180+0000 7fe0fc65bb80 10 client.15507 fetch_fsmap learned FSMap version 27 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.180+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2172876624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563b6f369230 con 0x563b6f2e5140 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.180+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2172876624 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0d80145e0 con 0x563b6f2e5140 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.180+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2172876624 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe0dc003680 con 0x563b6f2e5140 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.181+0000 7fe0fc65bb80 10 client.15507 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.181+0000 7fe0fc65bb80 10 client.15507 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:48:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.181+0000 7fe0fc65bb80 20 client.15507 populate_metadata read hostname 'smithi070' 2024-05-08T06:48:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.181+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563b6f369750 0x563b6f36bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:48:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.181+0000 7fe0fc65bb80 4 client.15507 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b65051e0", "release": true, "await": true}] 2024-05-08T06:48:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.181+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2172876624 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b65051e0", "release": true, "await": true}) -- 0x563b6f2df5d0 con 0x563b6f369750 2024-05-08T06:48:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.181+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563b6f369750 0x563b6f36bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:48:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.182+0000 7fe0ea000700 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563b6f369750 0x563b6f36bb70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a606a0f3624996bb server_cookie=bb90351282da9c6e in_seq=0 out_seq=0 2024-05-08T06:48:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.182+0000 7fe0d4c00700 10 client.15507 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:49.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.193+0000 7fe0d4c00700 1 -- 172.21.15.70:0/2172876624 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x563b6f2df5d0 con 0x563b6f369750 2024-05-08T06:48:49.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.193+0000 7fe0d4c00700 10 client.15507 handle_command_reply: tid=0 2024-05-08T06:48:49.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.193+0000 7fe0fc65bb80 1 client.15507 shutdown 2024-05-08T06:48:49.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2172876624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 msgr2=0x563b6f2f6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:49.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2f6e90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x563b6f2ef4c0 tx=0x7fe0dc01bd60 comp rx=0 tx=0).stop 2024-05-08T06:48:49.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2172876624 shutdown_connections 2024-05-08T06:48:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563b6f369750 0x563b6f36bb70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563b6f2ea1b0 0x563b6f2f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563b6f2e4780 0x563b6f2f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 --2- 172.21.15.70:0/2172876624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b6f2e5140 0x563b6f2f6e90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2172876624 >> 172.21.15.70:0/2172876624 conn(0x563b6f25c7d0 msgr2=0x563b6f2e9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0d4c00700 0 client.15507 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:48:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2172876624 shutdown_connections 2024-05-08T06:48:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 1 -- 172.21.15.70:0/2172876624 wait complete. 2024-05-08T06:48:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.194+0000 7fe0fc65bb80 20 client.15507 trim_cache size 0 max 16384 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 27, 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 8, 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "b65051e0": { 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 8, 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:48:49.194 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.4, 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:48:49.195 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:48:49.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d00b29f0 msgr2=0x7fe0d00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:49.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d00b29f0 0x7fe0d00b4eb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40aaf60 tx=0x7fe0e4009040 comp rx=0 tx=0).stop 2024-05-08T06:48:49.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10fb60 msgr2=0x7fe0ec1a48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:48:49.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10fb60 0x7fe0ec1a48d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400b830 tx=0x7fe0e4004d00 comp rx=0 tx=0).stop 2024-05-08T06:48:49.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1805679998 shutdown_connections 2024-05-08T06:48:49.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d00b29f0 0x7fe0d00b4eb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0ec10fb60 0x7fe0ec1a48d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0ec109ad0 0x7fe0ec1a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 --2- 172.21.15.70:0/1805679998 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0ec10a490 0x7fe0ec1a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:48:49.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1805679998 >> 172.21.15.70:0/1805679998 conn(0x7fe0ec076c70 msgr2=0x7fe0ec077270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:48:49.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1805679998 shutdown_connections 2024-05-08T06:48:49.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:48:49.195+0000 7fe0f1c00700 1 -- 172.21.15.70:0/1805679998 wait complete. 2024-05-08T06:48:49.230 INFO:tasks.workunit.client.0.smithi070.stderr:+ wget -O linux.tar.xz http://download.ceph.com/qa/linux-6.5.11.tar.xz 2024-05-08T06:48:49.432 INFO:tasks.workunit.client.0.smithi070.stderr:--2024-05-08 06:48:49-- http://download.ceph.com/qa/linux-6.5.11.tar.xz 2024-05-08T06:48:49.445 INFO:tasks.workunit.client.0.smithi070.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-05-08T06:48:49.481 INFO:tasks.workunit.client.0.smithi070.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-05-08T06:48:49.517 INFO:tasks.workunit.client.0.smithi070.stderr:HTTP request sent, awaiting response... 200 OK 2024-05-08T06:48:49.518 INFO:tasks.workunit.client.0.smithi070.stderr:Length: 139010916 (133M) [application/octet-stream] 2024-05-08T06:48:49.518 INFO:tasks.workunit.client.0.smithi070.stderr:Saving to: ‘linux.tar.xz’ 2024-05-08T06:48:49.531 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:48:49.590 INFO:tasks.workunit.client.0.smithi070.stderr: 0K .......... .......... .......... .......... .......... 0% 701K 3m14s 2024-05-08T06:48:49.627 INFO:tasks.workunit.client.0.smithi070.stderr: 50K .......... .......... .......... .......... .......... 0% 1.33M 2m26s 2024-05-08T06:48:49.662 INFO:tasks.workunit.client.0.smithi070.stderr: 100K .......... .......... .......... .......... .......... 0% 1.42M 2m9s 2024-05-08T06:48:49.671 INFO:tasks.workunit.client.0.smithi070.stderr: 150K .......... .......... .......... .......... .......... 0% 5.33M 1m43s 2024-05-08T06:48:49.703 INFO:tasks.workunit.client.0.smithi070.stderr: 200K .......... .......... .......... .......... .......... 0% 1.54M 99s 2024-05-08T06:48:49.711 INFO:tasks.workunit.client.0.smithi070.stderr: 250K .......... .......... .......... .......... .......... 0% 5.59M 87s 2024-05-08T06:48:49.720 INFO:tasks.workunit.client.0.smithi070.stderr: 300K .......... .......... .......... .......... .......... 0% 5.57M 78s 2024-05-08T06:48:49.739 INFO:tasks.workunit.client.0.smithi070.stderr: 350K .......... .......... .......... .......... .......... 0% 2.52M 75s 2024-05-08T06:48:49.748 INFO:tasks.workunit.client.0.smithi070.stderr: 400K .......... .......... .......... .......... .......... 0% 5.88M 69s 2024-05-08T06:48:49.757 INFO:tasks.workunit.client.0.smithi070.stderr: 450K .......... .......... .......... .......... .......... 0% 5.21M 64s 2024-05-08T06:48:49.768 INFO:tasks.workunit.client.0.smithi070.stderr: 500K .......... .......... .......... .......... .......... 0% 4.51M 61s 2024-05-08T06:48:49.778 INFO:tasks.workunit.client.0.smithi070.stderr: 550K .......... .......... .......... .......... .......... 0% 5.03M 58s 2024-05-08T06:48:49.787 INFO:tasks.workunit.client.0.smithi070.stderr: 600K .......... .......... .......... .......... .......... 0% 5.28M 56s 2024-05-08T06:48:49.795 INFO:tasks.workunit.client.0.smithi070.stderr: 650K .......... .......... .......... .......... .......... 0% 6.27M 53s 2024-05-08T06:48:49.803 INFO:tasks.workunit.client.0.smithi070.stderr: 700K .......... .......... .......... .......... .......... 0% 6.47M 51s 2024-05-08T06:48:49.810 INFO:tasks.workunit.client.0.smithi070.stderr: 750K .......... .......... .......... .......... .......... 0% 6.09M 49s 2024-05-08T06:48:49.817 INFO:tasks.workunit.client.0.smithi070.stderr: 800K .......... .......... .......... .......... .......... 0% 6.86M 47s 2024-05-08T06:48:49.823 INFO:tasks.workunit.client.0.smithi070.stderr: 850K .......... .......... .......... .......... .......... 0% 7.79M 46s 2024-05-08T06:48:49.830 INFO:tasks.workunit.client.0.smithi070.stderr: 900K .......... .......... .......... .......... .......... 0% 11.2M 44s 2024-05-08T06:48:49.832 INFO:tasks.workunit.client.0.smithi070.stderr: 950K .......... .......... .......... .......... .......... 0% 11.6M 42s 2024-05-08T06:48:49.836 INFO:tasks.workunit.client.0.smithi070.stderr: 1000K .......... .......... .......... .......... .......... 0% 11.0M 41s 2024-05-08T06:48:49.841 INFO:tasks.workunit.client.0.smithi070.stderr: 1050K .......... .......... .......... .......... .......... 0% 10.3M 39s 2024-05-08T06:48:49.849 INFO:tasks.workunit.client.0.smithi070.stderr: 1100K .......... .......... .......... .......... .......... 0% 6.74M 39s 2024-05-08T06:48:49.855 INFO:tasks.workunit.client.0.smithi070.stderr: 1150K .......... .......... .......... .......... .......... 0% 7.13M 38s 2024-05-08T06:48:49.862 INFO:tasks.workunit.client.0.smithi070.stderr: 1200K .......... .......... .......... .......... .......... 0% 7.22M 37s 2024-05-08T06:48:49.869 INFO:tasks.workunit.client.0.smithi070.stderr: 1250K .......... .......... .......... .......... .......... 0% 6.96M 36s 2024-05-08T06:48:49.879 INFO:tasks.workunit.client.0.smithi070.stderr: 1300K .......... .......... .......... .......... .......... 0% 4.90M 36s 2024-05-08T06:48:49.888 INFO:tasks.workunit.client.0.smithi070.stderr: 1350K .......... .......... .......... .......... .......... 1% 5.54M 35s 2024-05-08T06:48:49.897 INFO:tasks.workunit.client.0.smithi070.stderr: 1400K .......... .......... .......... .......... .......... 1% 5.85M 35s 2024-05-08T06:48:49.905 INFO:tasks.workunit.client.0.smithi070.stderr: 1450K .......... .......... .......... .......... .......... 1% 5.63M 35s 2024-05-08T06:48:49.916 INFO:tasks.workunit.client.0.smithi070.stderr: 1500K .......... .......... .......... .......... .......... 1% 4.53M 34s 2024-05-08T06:48:49.925 INFO:tasks.workunit.client.0.smithi070.stderr: 1550K .......... .......... .......... .......... .......... 1% 5.61M 34s 2024-05-08T06:48:49.933 INFO:tasks.workunit.client.0.smithi070.stderr: 1600K .......... .......... .......... .......... .......... 1% 5.95M 34s 2024-05-08T06:48:49.941 INFO:tasks.workunit.client.0.smithi070.stderr: 1650K .......... .......... .......... .......... .......... 1% 5.88M 33s 2024-05-08T06:48:49.952 INFO:tasks.workunit.client.0.smithi070.stderr: 1700K .......... .......... .......... .......... .......... 1% 4.64M 33s 2024-05-08T06:48:49.961 INFO:tasks.workunit.client.0.smithi070.stderr: 1750K .......... .......... .......... .......... .......... 1% 5.65M 33s 2024-05-08T06:48:49.968 INFO:tasks.workunit.client.0.smithi070.stderr: 1800K .......... .......... .......... .......... .......... 1% 6.53M 32s 2024-05-08T06:48:49.976 INFO:tasks.workunit.client.0.smithi070.stderr: 1850K .......... .......... .......... .......... .......... 1% 6.16M 32s 2024-05-08T06:48:49.986 INFO:tasks.workunit.client.0.smithi070.stderr: 1900K .......... .......... .......... .......... .......... 1% 4.89M 32s 2024-05-08T06:48:49.994 INFO:tasks.workunit.client.0.smithi070.stderr: 1950K .......... .......... .......... .......... .......... 1% 5.83M 32s 2024-05-08T06:48:50.004 INFO:tasks.workunit.client.0.smithi070.stderr: 2000K .......... .......... .......... .......... .......... 1% 4.86M 32s 2024-05-08T06:48:50.012 INFO:tasks.workunit.client.0.smithi070.stderr: 2050K .......... .......... .......... .......... .......... 1% 6.24M 31s 2024-05-08T06:48:50.022 INFO:tasks.workunit.client.0.smithi070.stderr: 2100K .......... .......... .......... .......... .......... 1% 5.03M 31s 2024-05-08T06:48:50.030 INFO:tasks.workunit.client.0.smithi070.stderr: 2150K .......... .......... .......... .......... .......... 1% 5.70M 31s 2024-05-08T06:48:50.038 INFO:tasks.workunit.client.0.smithi070.stderr: 2200K .......... .......... .......... .......... .......... 1% 6.10M 31s 2024-05-08T06:48:50.047 INFO:tasks.workunit.client.0.smithi070.stderr: 2250K .......... .......... .......... .......... .......... 1% 5.77M 31s 2024-05-08T06:48:50.057 INFO:tasks.workunit.client.0.smithi070.stderr: 2300K .......... .......... .......... .......... .......... 1% 4.86M 31s 2024-05-08T06:48:50.065 INFO:tasks.workunit.client.0.smithi070.stderr: 2350K .......... .......... .......... .......... .......... 1% 6.09M 30s 2024-05-08T06:48:50.074 INFO:tasks.workunit.client.0.smithi070.stderr: 2400K .......... .......... .......... .......... .......... 1% 5.62M 30s 2024-05-08T06:48:50.084 INFO:tasks.workunit.client.0.smithi070.stderr: 2450K .......... .......... .......... .......... .......... 1% 4.85M 30s 2024-05-08T06:48:50.094 INFO:tasks.workunit.client.0.smithi070.stderr: 2500K .......... .......... .......... .......... .......... 1% 4.77M 30s 2024-05-08T06:48:50.103 INFO:tasks.workunit.client.0.smithi070.stderr: 2550K .......... .......... .......... .......... .......... 1% 5.40M 30s 2024-05-08T06:48:50.112 INFO:tasks.workunit.client.0.smithi070.stderr: 2600K .......... .......... .......... .......... .......... 1% 5.34M 30s 2024-05-08T06:48:50.121 INFO:tasks.workunit.client.0.smithi070.stderr: 2650K .......... .......... .......... .......... .......... 1% 5.52M 30s 2024-05-08T06:48:50.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:49 smithi070 ceph-mon[29591]: pgmap v71: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:50.132 INFO:tasks.workunit.client.0.smithi070.stderr: 2700K .......... .......... .......... .......... .......... 2% 4.36M 30s 2024-05-08T06:48:50.141 INFO:tasks.workunit.client.0.smithi070.stderr: 2750K .......... .......... .......... .......... .......... 2% 5.59M 30s 2024-05-08T06:48:50.148 INFO:tasks.workunit.client.0.smithi070.stderr: 2800K .......... .......... .......... .......... .......... 2% 6.29M 29s 2024-05-08T06:48:50.156 INFO:tasks.workunit.client.0.smithi070.stderr: 2850K .......... .......... .......... .......... .......... 2% 6.22M 29s 2024-05-08T06:48:50.166 INFO:tasks.workunit.client.0.smithi070.stderr: 2900K .......... .......... .......... .......... .......... 2% 5.09M 29s 2024-05-08T06:48:50.176 INFO:tasks.workunit.client.0.smithi070.stderr: 2950K .......... .......... .......... .......... .......... 2% 4.90M 29s 2024-05-08T06:48:50.183 INFO:tasks.workunit.client.0.smithi070.stderr: 3000K .......... .......... .......... .......... .......... 2% 6.97M 29s 2024-05-08T06:48:50.190 INFO:tasks.workunit.client.0.smithi070.stderr: 3050K .......... .......... .......... .......... .......... 2% 6.70M 29s 2024-05-08T06:48:50.198 INFO:tasks.workunit.client.0.smithi070.stderr: 3100K .......... .......... .......... .......... .......... 2% 6.54M 29s 2024-05-08T06:48:50.205 INFO:tasks.workunit.client.0.smithi070.stderr: 3150K .......... .......... .......... .......... .......... 2% 7.01M 28s 2024-05-08T06:48:50.212 INFO:tasks.workunit.client.0.smithi070.stderr: 3200K .......... .......... .......... .......... .......... 2% 6.64M 28s 2024-05-08T06:48:50.219 INFO:tasks.workunit.client.0.smithi070.stderr: 3250K .......... .......... .......... .......... .......... 2% 6.79M 28s 2024-05-08T06:48:50.228 INFO:tasks.workunit.client.0.smithi070.stderr: 3300K .......... .......... .......... .......... .......... 2% 5.54M 28s 2024-05-08T06:48:50.239 INFO:tasks.workunit.client.0.smithi070.stderr: 3350K .......... .......... .......... .......... .......... 2% 6.84M 28s 2024-05-08T06:48:50.240 INFO:tasks.workunit.client.0.smithi070.stderr: 3400K .......... .......... .......... .......... .......... 2% 8.98M 28s 2024-05-08T06:48:50.247 INFO:tasks.workunit.client.0.smithi070.stderr: 3450K .......... .......... .......... .......... .......... 2% 7.29M 28s 2024-05-08T06:48:50.255 INFO:tasks.workunit.client.0.smithi070.stderr: 3500K .......... .......... .......... .......... .......... 2% 5.91M 27s 2024-05-08T06:48:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:50 smithi194 ceph-mon[33679]: pgmap v71: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:50.263 INFO:tasks.workunit.client.0.smithi070.stderr: 3550K .......... .......... .......... .......... .......... 2% 6.25M 27s 2024-05-08T06:48:50.272 INFO:tasks.workunit.client.0.smithi070.stderr: 3600K .......... .......... .......... .......... .......... 2% 6.03M 27s 2024-05-08T06:48:50.279 INFO:tasks.workunit.client.0.smithi070.stderr: 3650K .......... .......... .......... .......... .......... 2% 6.33M 27s 2024-05-08T06:48:50.289 INFO:tasks.workunit.client.0.smithi070.stderr: 3700K .......... .......... .......... .......... .......... 2% 5.16M 27s 2024-05-08T06:48:50.296 INFO:tasks.workunit.client.0.smithi070.stderr: 3750K .......... .......... .......... .......... .......... 2% 7.63M 27s 2024-05-08T06:48:50.305 INFO:tasks.workunit.client.0.smithi070.stderr: 3800K .......... .......... .......... .......... .......... 2% 5.24M 27s 2024-05-08T06:48:50.315 INFO:tasks.workunit.client.0.smithi070.stderr: 3850K .......... .......... .......... .......... .......... 2% 4.96M 27s 2024-05-08T06:48:50.323 INFO:tasks.workunit.client.0.smithi070.stderr: 3900K .......... .......... .......... .......... .......... 2% 5.09M 27s 2024-05-08T06:48:50.329 INFO:tasks.workunit.client.0.smithi070.stderr: 3950K .......... .......... .......... .......... .......... 2% 8.60M 27s 2024-05-08T06:48:50.336 INFO:tasks.workunit.client.0.smithi070.stderr: 4000K .......... .......... .......... .......... .......... 2% 7.40M 27s 2024-05-08T06:48:50.342 INFO:tasks.workunit.client.0.smithi070.stderr: 4050K .......... .......... .......... .......... .......... 3% 7.74M 26s 2024-05-08T06:48:50.349 INFO:tasks.workunit.client.0.smithi070.stderr: 4100K .......... .......... .......... .......... .......... 3% 7.39M 26s 2024-05-08T06:48:50.356 INFO:tasks.workunit.client.0.smithi070.stderr: 4150K .......... .......... .......... .......... .......... 3% 6.79M 26s 2024-05-08T06:48:50.362 INFO:tasks.workunit.client.0.smithi070.stderr: 4200K .......... .......... .......... .......... .......... 3% 8.00M 26s 2024-05-08T06:48:50.370 INFO:tasks.workunit.client.0.smithi070.stderr: 4250K .......... .......... .......... .......... .......... 3% 6.73M 26s 2024-05-08T06:48:50.379 INFO:tasks.workunit.client.0.smithi070.stderr: 4300K .......... .......... .......... .......... .......... 3% 5.46M 26s 2024-05-08T06:48:50.385 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b65051e0', seconds elapsed: 36.1 2024-05-08T06:48:50.386 INFO:tasks.workunit.client.0.smithi070.stderr: 4350K .......... .......... .......... .......... .......... 3% 6.29M 26s 2024-05-08T06:48:50.393 INFO:tasks.workunit.client.0.smithi070.stderr: 4400K .......... .......... .......... .......... .......... 3% 7.14M 26s 2024-05-08T06:48:50.400 INFO:tasks.workunit.client.0.smithi070.stderr: 4450K .......... .......... .......... .......... .......... 3% 6.88M 26s 2024-05-08T06:48:50.408 INFO:tasks.workunit.client.0.smithi070.stderr: 4500K .......... .......... .......... .......... .......... 3% 6.00M 26s 2024-05-08T06:48:50.416 INFO:tasks.workunit.client.0.smithi070.stderr: 4550K .......... .......... .......... .......... .......... 3% 6.22M 26s 2024-05-08T06:48:50.425 INFO:tasks.workunit.client.0.smithi070.stderr: 4600K .......... .......... .......... .......... .......... 3% 5.61M 26s 2024-05-08T06:48:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:50 smithi172 ceph-mon[33377]: pgmap v71: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:48:50.434 INFO:tasks.workunit.client.0.smithi070.stderr: 4650K .......... .......... .......... .......... .......... 3% 5.20M 26s 2024-05-08T06:48:50.444 INFO:tasks.workunit.client.0.smithi070.stderr: 4700K .......... .......... .......... .......... .......... 3% 4.77M 26s 2024-05-08T06:48:50.453 INFO:tasks.workunit.client.0.smithi070.stderr: 4750K .......... .......... .......... .......... .......... 3% 5.82M 25s 2024-05-08T06:48:50.462 INFO:tasks.workunit.client.0.smithi070.stderr: 4800K .......... .......... .......... .......... .......... 3% 5.43M 25s 2024-05-08T06:48:50.470 INFO:tasks.workunit.client.0.smithi070.stderr: 4850K .......... .......... .......... .......... .......... 3% 5.77M 25s 2024-05-08T06:48:50.481 INFO:tasks.workunit.client.0.smithi070.stderr: 4900K .......... .......... .......... .......... .......... 3% 4.80M 25s 2024-05-08T06:48:50.489 INFO:tasks.workunit.client.0.smithi070.stderr: 4950K .......... .......... .......... .......... .......... 3% 6.08M 25s 2024-05-08T06:48:50.496 INFO:tasks.workunit.client.0.smithi070.stderr: 5000K .......... .......... .......... .......... .......... 3% 6.34M 25s 2024-05-08T06:48:50.502 INFO:tasks.workunit.client.0.smithi070.stderr: 5050K .......... .......... .......... .......... .......... 3% 8.03M 25s 2024-05-08T06:48:50.510 INFO:tasks.workunit.client.0.smithi070.stderr: 5100K .......... .......... .......... .......... .......... 3% 6.41M 25s 2024-05-08T06:48:50.517 INFO:tasks.workunit.client.0.smithi070.stderr: 5150K .......... .......... .......... .......... .......... 3% 7.12M 25s 2024-05-08T06:48:50.527 INFO:tasks.workunit.client.0.smithi070.stderr: 5200K .......... .......... .......... .......... .......... 3% 4.69M 25s 2024-05-08T06:48:50.537 INFO:tasks.workunit.client.0.smithi070.stderr: 5250K .......... .......... .......... .......... .......... 3% 4.96M 25s 2024-05-08T06:48:50.549 INFO:tasks.workunit.client.0.smithi070.stderr: 5300K .......... .......... .......... .......... .......... 3% 4.23M 25s 2024-05-08T06:48:50.558 INFO:tasks.workunit.client.0.smithi070.stderr: 5350K .......... .......... .......... .......... .......... 3% 5.30M 25s 2024-05-08T06:48:50.567 INFO:tasks.workunit.client.0.smithi070.stderr: 5400K .......... .......... .......... .......... .......... 4% 5.07M 25s 2024-05-08T06:48:50.576 INFO:tasks.workunit.client.0.smithi070.stderr: 5450K .......... .......... .......... .......... .......... 4% 6.01M 25s 2024-05-08T06:48:50.586 INFO:tasks.workunit.client.0.smithi070.stderr: 5500K .......... .......... .......... .......... .......... 4% 4.91M 25s 2024-05-08T06:48:50.594 INFO:tasks.workunit.client.0.smithi070.stderr: 5550K .......... .......... .......... .......... .......... 4% 5.94M 25s 2024-05-08T06:48:50.601 INFO:tasks.workunit.client.0.smithi070.stderr: 5600K .......... .......... .......... .......... .......... 4% 6.16M 25s 2024-05-08T06:48:50.608 INFO:tasks.workunit.client.0.smithi070.stderr: 5650K .......... .......... .......... .......... .......... 4% 7.23M 25s 2024-05-08T06:48:50.618 INFO:tasks.workunit.client.0.smithi070.stderr: 5700K .......... .......... .......... .......... .......... 4% 5.46M 25s 2024-05-08T06:48:50.626 INFO:tasks.workunit.client.0.smithi070.stderr: 5750K .......... .......... .......... .......... .......... 4% 5.70M 25s 2024-05-08T06:48:50.634 INFO:tasks.workunit.client.0.smithi070.stderr: 5800K .......... .......... .......... .......... .......... 4% 6.20M 25s 2024-05-08T06:48:50.643 INFO:tasks.workunit.client.0.smithi070.stderr: 5850K .......... .......... .......... .......... .......... 4% 5.38M 25s 2024-05-08T06:48:50.654 INFO:tasks.workunit.client.0.smithi070.stderr: 5900K .......... .......... .......... .......... .......... 4% 4.53M 25s 2024-05-08T06:48:50.663 INFO:tasks.workunit.client.0.smithi070.stderr: 5950K .......... .......... .......... .......... .......... 4% 5.14M 25s 2024-05-08T06:48:50.673 INFO:tasks.workunit.client.0.smithi070.stderr: 6000K .......... .......... .......... .......... .......... 4% 5.25M 25s 2024-05-08T06:48:50.681 INFO:tasks.workunit.client.0.smithi070.stderr: 6050K .......... .......... .......... .......... .......... 4% 5.43M 25s 2024-05-08T06:48:50.693 INFO:tasks.workunit.client.0.smithi070.stderr: 6100K .......... .......... .......... .......... .......... 4% 4.42M 25s 2024-05-08T06:48:50.702 INFO:tasks.workunit.client.0.smithi070.stderr: 6150K .......... .......... .......... .......... .......... 4% 5.52M 25s 2024-05-08T06:48:50.710 INFO:tasks.workunit.client.0.smithi070.stderr: 6200K .......... .......... .......... .......... .......... 4% 5.49M 25s 2024-05-08T06:48:50.720 INFO:tasks.workunit.client.0.smithi070.stderr: 6250K .......... .......... .......... .......... .......... 4% 5.31M 25s 2024-05-08T06:48:50.731 INFO:tasks.workunit.client.0.smithi070.stderr: 6300K .......... .......... .......... .......... .......... 4% 4.56M 25s 2024-05-08T06:48:50.740 INFO:tasks.workunit.client.0.smithi070.stderr: 6350K .......... .......... .......... .......... .......... 4% 5.03M 25s 2024-05-08T06:48:50.750 INFO:tasks.workunit.client.0.smithi070.stderr: 6400K .......... .......... .......... .......... .......... 4% 5.22M 25s 2024-05-08T06:48:50.758 INFO:tasks.workunit.client.0.smithi070.stderr: 6450K .......... .......... .......... .......... .......... 4% 5.29M 25s 2024-05-08T06:48:50.769 INFO:tasks.workunit.client.0.smithi070.stderr: 6500K .......... .......... .......... .......... .......... 4% 4.75M 25s 2024-05-08T06:48:50.778 INFO:tasks.workunit.client.0.smithi070.stderr: 6550K .......... .......... .......... .......... .......... 4% 5.29M 25s 2024-05-08T06:48:50.787 INFO:tasks.workunit.client.0.smithi070.stderr: 6600K .......... .......... .......... .......... .......... 4% 5.82M 25s 2024-05-08T06:48:50.797 INFO:tasks.workunit.client.0.smithi070.stderr: 6650K .......... .......... .......... .......... .......... 4% 4.78M 25s 2024-05-08T06:48:50.810 INFO:tasks.workunit.client.0.smithi070.stderr: 6700K .......... .......... .......... .......... .......... 4% 3.81M 25s 2024-05-08T06:48:50.820 INFO:tasks.workunit.client.0.smithi070.stderr: 6750K .......... .......... .......... .......... .......... 5% 4.86M 25s 2024-05-08T06:48:50.831 INFO:tasks.workunit.client.0.smithi070.stderr: 6800K .......... .......... .......... .......... .......... 5% 4.51M 25s 2024-05-08T06:48:50.842 INFO:tasks.workunit.client.0.smithi070.stderr: 6850K .......... .......... .......... .......... .......... 5% 4.46M 25s 2024-05-08T06:48:50.854 INFO:tasks.workunit.client.0.smithi070.stderr: 6900K .......... .......... .......... .......... .......... 5% 3.90M 25s 2024-05-08T06:48:50.865 INFO:tasks.workunit.client.0.smithi070.stderr: 6950K .......... .......... .......... .......... .......... 5% 4.73M 25s 2024-05-08T06:48:50.875 INFO:tasks.workunit.client.0.smithi070.stderr: 7000K .......... .......... .......... .......... .......... 5% 4.55M 25s 2024-05-08T06:48:50.885 INFO:tasks.workunit.client.0.smithi070.stderr: 7050K .......... .......... .......... .......... .......... 5% 4.88M 25s 2024-05-08T06:48:50.897 INFO:tasks.workunit.client.0.smithi070.stderr: 7100K .......... .......... .......... .......... .......... 5% 4.26M 25s 2024-05-08T06:48:50.907 INFO:tasks.workunit.client.0.smithi070.stderr: 7150K .......... .......... .......... .......... .......... 5% 4.92M 25s 2024-05-08T06:48:50.916 INFO:tasks.workunit.client.0.smithi070.stderr: 7200K .......... .......... .......... .......... .......... 5% 5.18M 25s 2024-05-08T06:48:50.926 INFO:tasks.workunit.client.0.smithi070.stderr: 7250K .......... .......... .......... .......... .......... 5% 4.91M 25s 2024-05-08T06:48:50.937 INFO:tasks.workunit.client.0.smithi070.stderr: 7300K .......... .......... .......... .......... .......... 5% 4.42M 25s 2024-05-08T06:48:50.946 INFO:tasks.workunit.client.0.smithi070.stderr: 7350K .......... .......... .......... .......... .......... 5% 5.28M 25s 2024-05-08T06:48:50.956 INFO:tasks.workunit.client.0.smithi070.stderr: 7400K .......... .......... .......... .......... .......... 5% 4.72M 25s 2024-05-08T06:48:50.966 INFO:tasks.workunit.client.0.smithi070.stderr: 7450K .......... .......... .......... .......... .......... 5% 5.50M 25s 2024-05-08T06:48:50.976 INFO:tasks.workunit.client.0.smithi070.stderr: 7500K .......... .......... .......... .......... .......... 5% 4.66M 25s 2024-05-08T06:48:50.985 INFO:tasks.workunit.client.0.smithi070.stderr: 7550K .......... .......... .......... .......... .......... 5% 5.15M 25s 2024-05-08T06:48:50.995 INFO:tasks.workunit.client.0.smithi070.stderr: 7600K .......... .......... .......... .......... .......... 5% 5.18M 25s 2024-05-08T06:48:51.005 INFO:tasks.workunit.client.0.smithi070.stderr: 7650K .......... .......... .......... .......... .......... 5% 4.63M 25s 2024-05-08T06:48:51.017 INFO:tasks.workunit.client.0.smithi070.stderr: 7700K .......... .......... .......... .......... .......... 5% 4.21M 25s 2024-05-08T06:48:51.027 INFO:tasks.workunit.client.0.smithi070.stderr: 7750K .......... .......... .......... .......... .......... 5% 4.95M 25s 2024-05-08T06:48:51.038 INFO:tasks.workunit.client.0.smithi070.stderr: 7800K .......... .......... .......... .......... .......... 5% 4.45M 25s 2024-05-08T06:48:51.047 INFO:tasks.workunit.client.0.smithi070.stderr: 7850K .......... .......... .......... .......... .......... 5% 5.07M 25s 2024-05-08T06:48:51.058 INFO:tasks.workunit.client.0.smithi070.stderr: 7900K .......... .......... .......... .......... .......... 5% 4.36M 25s 2024-05-08T06:48:51.068 INFO:tasks.workunit.client.0.smithi070.stderr: 7950K .......... .......... .......... .......... .......... 5% 5.01M 25s 2024-05-08T06:48:51.078 INFO:tasks.workunit.client.0.smithi070.stderr: 8000K .......... .......... .......... .......... .......... 5% 5.30M 25s 2024-05-08T06:48:51.088 INFO:tasks.workunit.client.0.smithi070.stderr: 8050K .......... .......... .......... .......... .......... 5% 4.85M 25s 2024-05-08T06:48:51.099 INFO:tasks.workunit.client.0.smithi070.stderr: 8100K .......... .......... .......... .......... .......... 6% 4.23M 25s 2024-05-08T06:48:51.109 INFO:tasks.workunit.client.0.smithi070.stderr: 8150K .......... .......... .......... .......... .......... 6% 4.99M 25s 2024-05-08T06:48:51.119 INFO:tasks.workunit.client.0.smithi070.stderr: 8200K .......... .......... .......... .......... .......... 6% 5.06M 25s 2024-05-08T06:48:51.128 INFO:tasks.workunit.client.0.smithi070.stderr: 8250K .......... .......... .......... .......... .......... 6% 4.90M 25s 2024-05-08T06:48:51.138 INFO:tasks.workunit.client.0.smithi070.stderr: 8300K .......... .......... .......... .......... .......... 6% 5.21M 25s 2024-05-08T06:48:51.147 INFO:tasks.workunit.client.0.smithi070.stderr: 8350K .......... .......... .......... .......... .......... 6% 5.48M 25s 2024-05-08T06:48:51.156 INFO:tasks.workunit.client.0.smithi070.stderr: 8400K .......... .......... .......... .......... .......... 6% 5.31M 25s 2024-05-08T06:48:51.165 INFO:tasks.workunit.client.0.smithi070.stderr: 8450K .......... .......... .......... .......... .......... 6% 5.57M 25s 2024-05-08T06:48:51.176 INFO:tasks.workunit.client.0.smithi070.stderr: 8500K .......... .......... .......... .......... .......... 6% 4.38M 25s 2024-05-08T06:48:51.185 INFO:tasks.workunit.client.0.smithi070.stderr: 8550K .......... .......... .......... .......... .......... 6% 5.11M 25s 2024-05-08T06:48:51.192 INFO:tasks.workunit.client.0.smithi070.stderr: 8600K .......... .......... .......... .......... .......... 6% 6.48M 25s 2024-05-08T06:48:51.202 INFO:tasks.workunit.client.0.smithi070.stderr: 8650K .......... .......... .......... .......... .......... 6% 5.51M 25s 2024-05-08T06:48:51.213 INFO:tasks.workunit.client.0.smithi070.stderr: 8700K .......... .......... .......... .......... .......... 6% 4.45M 25s 2024-05-08T06:48:51.221 INFO:tasks.workunit.client.0.smithi070.stderr: 8750K .......... .......... .......... .......... .......... 6% 5.69M 25s 2024-05-08T06:48:51.230 INFO:tasks.workunit.client.0.smithi070.stderr: 8800K .......... .......... .......... .......... .......... 6% 5.50M 25s 2024-05-08T06:48:51.239 INFO:tasks.workunit.client.0.smithi070.stderr: 8850K .......... .......... .......... .......... .......... 6% 5.47M 25s 2024-05-08T06:48:51.251 INFO:tasks.workunit.client.0.smithi070.stderr: 8900K .......... .......... .......... .......... .......... 6% 4.33M 25s 2024-05-08T06:48:51.260 INFO:tasks.workunit.client.0.smithi070.stderr: 8950K .......... .......... .......... .......... .......... 6% 5.13M 25s 2024-05-08T06:48:51.268 INFO:tasks.workunit.client.0.smithi070.stderr: 9000K .......... .......... .......... .......... .......... 6% 5.75M 24s 2024-05-08T06:48:51.277 INFO:tasks.workunit.client.0.smithi070.stderr: 9050K .......... .......... .......... .......... .......... 6% 5.62M 24s 2024-05-08T06:48:51.286 INFO:tasks.workunit.client.0.smithi070.stderr: 9100K .......... .......... .......... .......... .......... 6% 4.96M 24s 2024-05-08T06:48:51.294 INFO:tasks.workunit.client.0.smithi070.stderr: 9150K .......... .......... .......... .......... .......... 6% 6.44M 24s 2024-05-08T06:48:51.302 INFO:tasks.workunit.client.0.smithi070.stderr: 9200K .......... .......... .......... .......... .......... 6% 5.98M 24s 2024-05-08T06:48:51.309 INFO:tasks.workunit.client.0.smithi070.stderr: 9250K .......... .......... .......... .......... .......... 6% 7.27M 24s 2024-05-08T06:48:51.317 INFO:tasks.workunit.client.0.smithi070.stderr: 9300K .......... .......... .......... .......... .......... 6% 6.64M 24s 2024-05-08T06:48:51.325 INFO:tasks.workunit.client.0.smithi070.stderr: 9350K .......... .......... .......... .......... .......... 6% 5.74M 24s 2024-05-08T06:48:51.334 INFO:tasks.workunit.client.0.smithi070.stderr: 9400K .......... .......... .......... .......... .......... 6% 5.41M 24s 2024-05-08T06:48:51.343 INFO:tasks.workunit.client.0.smithi070.stderr: 9450K .......... .......... .......... .......... .......... 6% 5.83M 24s 2024-05-08T06:48:51.353 INFO:tasks.workunit.client.0.smithi070.stderr: 9500K .......... .......... .......... .......... .......... 7% 4.54M 24s 2024-05-08T06:48:51.363 INFO:tasks.workunit.client.0.smithi070.stderr: 9550K .......... .......... .......... .......... .......... 7% 5.11M 24s 2024-05-08T06:48:51.372 INFO:tasks.workunit.client.0.smithi070.stderr: 9600K .......... .......... .......... .......... .......... 7% 5.19M 24s 2024-05-08T06:48:51.381 INFO:tasks.workunit.client.0.smithi070.stderr: 9650K .......... .......... .......... .......... .......... 7% 5.60M 24s 2024-05-08T06:48:51.391 INFO:tasks.workunit.client.0.smithi070.stderr: 9700K .......... .......... .......... .......... .......... 7% 4.80M 24s 2024-05-08T06:48:51.400 INFO:tasks.workunit.client.0.smithi070.stderr: 9750K .......... .......... .......... .......... .......... 7% 5.27M 24s 2024-05-08T06:48:51.410 INFO:tasks.workunit.client.0.smithi070.stderr: 9800K .......... .......... .......... .......... .......... 7% 5.15M 24s 2024-05-08T06:48:51.419 INFO:tasks.workunit.client.0.smithi070.stderr: 9850K .......... .......... .......... .......... .......... 7% 5.32M 24s 2024-05-08T06:48:51.430 INFO:tasks.workunit.client.0.smithi070.stderr: 9900K .......... .......... .......... .......... .......... 7% 4.36M 24s 2024-05-08T06:48:51.439 INFO:tasks.workunit.client.0.smithi070.stderr: 9950K .......... .......... .......... .......... .......... 7% 5.36M 24s 2024-05-08T06:48:51.448 INFO:tasks.workunit.client.0.smithi070.stderr: 10000K .......... .......... .......... .......... .......... 7% 5.42M 24s 2024-05-08T06:48:51.455 INFO:tasks.workunit.client.0.smithi070.stderr: 10050K .......... .......... .......... .......... .......... 7% 7.24M 24s 2024-05-08T06:48:51.465 INFO:tasks.workunit.client.0.smithi070.stderr: 10100K .......... .......... .......... .......... .......... 7% 5.15M 24s 2024-05-08T06:48:51.474 INFO:tasks.workunit.client.0.smithi070.stderr: 10150K .......... .......... .......... .......... .......... 7% 5.35M 24s 2024-05-08T06:48:51.483 INFO:tasks.workunit.client.0.smithi070.stderr: 10200K .......... .......... .......... .......... .......... 7% 5.38M 24s 2024-05-08T06:48:51.492 INFO:tasks.workunit.client.0.smithi070.stderr: 10250K .......... .......... .......... .......... .......... 7% 5.12M 24s 2024-05-08T06:48:51.504 INFO:tasks.workunit.client.0.smithi070.stderr: 10300K .......... .......... .......... .......... .......... 7% 4.41M 24s 2024-05-08T06:48:51.514 INFO:tasks.workunit.client.0.smithi070.stderr: 10350K .......... .......... .......... .......... .......... 7% 4.87M 24s 2024-05-08T06:48:51.524 INFO:tasks.workunit.client.0.smithi070.stderr: 10400K .......... .......... .......... .......... .......... 7% 4.88M 24s 2024-05-08T06:48:51.533 INFO:tasks.workunit.client.0.smithi070.stderr: 10450K .......... .......... .......... .......... .......... 7% 5.05M 24s 2024-05-08T06:48:51.545 INFO:tasks.workunit.client.0.smithi070.stderr: 10500K .......... .......... .......... .......... .......... 7% 4.31M 24s 2024-05-08T06:48:51.555 INFO:tasks.workunit.client.0.smithi070.stderr: 10550K .......... .......... .......... .......... .......... 7% 4.85M 24s 2024-05-08T06:48:51.565 INFO:tasks.workunit.client.0.smithi070.stderr: 10600K .......... .......... .......... .......... .......... 7% 4.77M 24s 2024-05-08T06:48:51.575 INFO:tasks.workunit.client.0.smithi070.stderr: 10650K .......... .......... .......... .......... .......... 7% 4.93M 24s 2024-05-08T06:48:51.586 INFO:tasks.workunit.client.0.smithi070.stderr: 10700K .......... .......... .......... .......... .......... 7% 4.37M 24s 2024-05-08T06:48:51.596 INFO:tasks.workunit.client.0.smithi070.stderr: 10750K .......... .......... .......... .......... .......... 7% 5.16M 24s 2024-05-08T06:48:51.604 INFO:tasks.workunit.client.0.smithi070.stderr: 10800K .......... .......... .......... .......... .......... 7% 5.30M 24s 2024-05-08T06:48:51.613 INFO:tasks.workunit.client.0.smithi070.stderr: 10850K .......... .......... .......... .......... .......... 8% 5.44M 24s 2024-05-08T06:48:51.624 INFO:tasks.workunit.client.0.smithi070.stderr: 10900K .......... .......... .......... .......... .......... 8% 4.54M 24s 2024-05-08T06:48:51.634 INFO:tasks.workunit.client.0.smithi070.stderr: 10950K .......... .......... .......... .......... .......... 8% 5.20M 24s 2024-05-08T06:48:51.643 INFO:tasks.workunit.client.0.smithi070.stderr: 11000K .......... .......... .......... .......... .......... 8% 5.12M 24s 2024-05-08T06:48:51.653 INFO:tasks.workunit.client.0.smithi070.stderr: 11050K .......... .......... .......... .......... .......... 8% 4.81M 24s 2024-05-08T06:48:51.665 INFO:tasks.workunit.client.0.smithi070.stderr: 11100K .......... .......... .......... .......... .......... 8% 4.30M 24s 2024-05-08T06:48:51.674 INFO:tasks.workunit.client.0.smithi070.stderr: 11150K .......... .......... .......... .......... .......... 8% 5.05M 24s 2024-05-08T06:48:51.685 INFO:tasks.workunit.client.0.smithi070.stderr: 11200K .......... .......... .......... .......... .......... 8% 4.86M 24s 2024-05-08T06:48:51.694 INFO:tasks.workunit.client.0.smithi070.stderr: 11250K .......... .......... .......... .......... .......... 8% 4.98M 24s 2024-05-08T06:48:51.705 INFO:tasks.workunit.client.0.smithi070.stderr: 11300K .......... .......... .......... .......... .......... 8% 4.53M 24s 2024-05-08T06:48:51.715 INFO:tasks.workunit.client.0.smithi070.stderr: 11350K .......... .......... .......... .......... .......... 8% 5.10M 24s 2024-05-08T06:48:51.725 INFO:tasks.workunit.client.0.smithi070.stderr: 11400K .......... .......... .......... .......... .......... 8% 4.55M 24s 2024-05-08T06:48:51.735 INFO:tasks.workunit.client.0.smithi070.stderr: 11450K .......... .......... .......... .......... .......... 8% 5.16M 24s 2024-05-08T06:48:51.746 INFO:tasks.workunit.client.0.smithi070.stderr: 11500K .......... .......... .......... .......... .......... 8% 4.30M 24s 2024-05-08T06:48:51.757 INFO:tasks.workunit.client.0.smithi070.stderr: 11550K .......... .......... .......... .......... .......... 8% 4.57M 24s 2024-05-08T06:48:51.767 INFO:tasks.workunit.client.0.smithi070.stderr: 11600K .......... .......... .......... .......... .......... 8% 4.65M 24s 2024-05-08T06:48:51.777 INFO:tasks.workunit.client.0.smithi070.stderr: 11650K .......... .......... .......... .......... .......... 8% 5.01M 24s 2024-05-08T06:48:51.789 INFO:tasks.workunit.client.0.smithi070.stderr: 11700K .......... .......... .......... .......... .......... 8% 4.05M 24s 2024-05-08T06:48:51.799 INFO:tasks.workunit.client.0.smithi070.stderr: 11750K .......... .......... .......... .......... .......... 8% 4.97M 24s 2024-05-08T06:48:51.809 INFO:tasks.workunit.client.0.smithi070.stderr: 11800K .......... .......... .......... .......... .......... 8% 4.79M 24s 2024-05-08T06:48:51.819 INFO:tasks.workunit.client.0.smithi070.stderr: 11850K .......... .......... .......... .......... .......... 8% 4.90M 24s 2024-05-08T06:48:51.831 INFO:tasks.workunit.client.0.smithi070.stderr: 11900K .......... .......... .......... .......... .......... 8% 4.24M 24s 2024-05-08T06:48:51.841 INFO:tasks.workunit.client.0.smithi070.stderr: 11950K .......... .......... .......... .......... .......... 8% 4.87M 24s 2024-05-08T06:48:51.851 INFO:tasks.workunit.client.0.smithi070.stderr: 12000K .......... .......... .......... .......... .......... 8% 4.98M 24s 2024-05-08T06:48:51.861 INFO:tasks.workunit.client.0.smithi070.stderr: 12050K .......... .......... .......... .......... .......... 8% 4.86M 24s 2024-05-08T06:48:51.872 INFO:tasks.workunit.client.0.smithi070.stderr: 12100K .......... .......... .......... .......... .......... 8% 4.23M 24s 2024-05-08T06:48:51.883 INFO:tasks.workunit.client.0.smithi070.stderr: 12150K .......... .......... .......... .......... .......... 8% 4.63M 24s 2024-05-08T06:48:51.894 INFO:tasks.workunit.client.0.smithi070.stderr: 12200K .......... .......... .......... .......... .......... 9% 4.32M 24s 2024-05-08T06:48:51.905 INFO:tasks.workunit.client.0.smithi070.stderr: 12250K .......... .......... .......... .......... .......... 9% 4.85M 24s 2024-05-08T06:48:51.917 INFO:tasks.workunit.client.0.smithi070.stderr: 12300K .......... .......... .......... .......... .......... 9% 3.81M 24s 2024-05-08T06:48:51.925 INFO:tasks.workunit.client.0.smithi070.stderr: 12350K .......... .......... .......... .......... .......... 9% 5.49M 24s 2024-05-08T06:48:51.934 INFO:tasks.workunit.client.0.smithi070.stderr: 12400K .......... .......... .......... .......... .......... 9% 5.44M 24s 2024-05-08T06:48:51.942 INFO:tasks.workunit.client.0.smithi070.stderr: 12450K .......... .......... .......... .......... .......... 9% 6.14M 24s 2024-05-08T06:48:51.953 INFO:tasks.workunit.client.0.smithi070.stderr: 12500K .......... .......... .......... .......... .......... 9% 4.82M 24s 2024-05-08T06:48:51.963 INFO:tasks.workunit.client.0.smithi070.stderr: 12550K .......... .......... .......... .......... .......... 9% 4.89M 24s 2024-05-08T06:48:51.972 INFO:tasks.workunit.client.0.smithi070.stderr: 12600K .......... .......... .......... .......... .......... 9% 5.39M 24s 2024-05-08T06:48:51.981 INFO:tasks.workunit.client.0.smithi070.stderr: 12650K .......... .......... .......... .......... .......... 9% 5.36M 24s 2024-05-08T06:48:51.991 INFO:tasks.workunit.client.0.smithi070.stderr: 12700K .......... .......... .......... .......... .......... 9% 4.75M 24s 2024-05-08T06:48:51.999 INFO:tasks.workunit.client.0.smithi070.stderr: 12750K .......... .......... .......... .......... .......... 9% 6.05M 24s 2024-05-08T06:48:52.009 INFO:tasks.workunit.client.0.smithi070.stderr: 12800K .......... .......... .......... .......... .......... 9% 5.21M 24s 2024-05-08T06:48:52.018 INFO:tasks.workunit.client.0.smithi070.stderr: 12850K .......... .......... .......... .......... .......... 9% 5.28M 24s 2024-05-08T06:48:52.029 INFO:tasks.workunit.client.0.smithi070.stderr: 12900K .......... .......... .......... .......... .......... 9% 4.62M 24s 2024-05-08T06:48:52.038 INFO:tasks.workunit.client.0.smithi070.stderr: 12950K .......... .......... .......... .......... .......... 9% 5.13M 24s 2024-05-08T06:48:52.047 INFO:tasks.workunit.client.0.smithi070.stderr: 13000K .......... .......... .......... .......... .......... 9% 5.33M 24s 2024-05-08T06:48:52.056 INFO:tasks.workunit.client.0.smithi070.stderr: 13050K .......... .......... .......... .......... .......... 9% 5.55M 24s 2024-05-08T06:48:52.066 INFO:tasks.workunit.client.0.smithi070.stderr: 13100K .......... .......... .......... .......... .......... 9% 4.73M 24s 2024-05-08T06:48:52.074 INFO:tasks.workunit.client.0.smithi070.stderr: 13150K .......... .......... .......... .......... .......... 9% 5.90M 24s 2024-05-08T06:48:52.086 INFO:tasks.workunit.client.0.smithi070.stderr: 13200K .......... .......... .......... .......... .......... 9% 5.82M 24s 2024-05-08T06:48:52.092 INFO:tasks.workunit.client.0.smithi070.stderr: 13250K .......... .......... .......... .......... .......... 9% 5.49M 24s 2024-05-08T06:48:52.102 INFO:tasks.workunit.client.0.smithi070.stderr: 13300K .......... .......... .......... .......... .......... 9% 4.86M 24s 2024-05-08T06:48:52.111 INFO:tasks.workunit.client.0.smithi070.stderr: 13350K .......... .......... .......... .......... .......... 9% 5.31M 24s 2024-05-08T06:48:52.120 INFO:tasks.workunit.client.0.smithi070.stderr: 13400K .......... .......... .......... .......... .......... 9% 5.25M 24s 2024-05-08T06:48:52.129 INFO:tasks.workunit.client.0.smithi070.stderr: 13450K .......... .......... .......... .......... .......... 9% 5.39M 24s 2024-05-08T06:48:52.141 INFO:tasks.workunit.client.0.smithi070.stderr: 13500K .......... .......... .......... .......... .......... 9% 4.38M 24s 2024-05-08T06:48:52.151 INFO:tasks.workunit.client.0.smithi070.stderr: 13550K .......... .......... .......... .......... .......... 10% 4.98M 24s 2024-05-08T06:48:52.161 INFO:tasks.workunit.client.0.smithi070.stderr: 13600K .......... .......... .......... .......... .......... 10% 4.75M 24s 2024-05-08T06:48:52.171 INFO:tasks.workunit.client.0.smithi070.stderr: 13650K .......... .......... .......... .......... .......... 10% 5.00M 24s 2024-05-08T06:48:52.182 INFO:tasks.workunit.client.0.smithi070.stderr: 13700K .......... .......... .......... .......... .......... 10% 4.27M 24s 2024-05-08T06:48:52.192 INFO:tasks.workunit.client.0.smithi070.stderr: 13750K .......... .......... .......... .......... .......... 10% 4.86M 24s 2024-05-08T06:48:52.202 INFO:tasks.workunit.client.0.smithi070.stderr: 13800K .......... .......... .......... .......... .......... 10% 4.79M 24s 2024-05-08T06:48:52.213 INFO:tasks.workunit.client.0.smithi070.stderr: 13850K .......... .......... .......... .......... .......... 10% 4.65M 24s 2024-05-08T06:48:52.224 INFO:tasks.workunit.client.0.smithi070.stderr: 13900K .......... .......... .......... .......... .......... 10% 4.21M 24s 2024-05-08T06:48:52.234 INFO:tasks.workunit.client.0.smithi070.stderr: 13950K .......... .......... .......... .......... .......... 10% 5.05M 24s 2024-05-08T06:48:52.243 INFO:tasks.workunit.client.0.smithi070.stderr: 14000K .......... .......... .......... .......... .......... 10% 5.45M 24s 2024-05-08T06:48:52.253 INFO:tasks.workunit.client.0.smithi070.stderr: 14050K .......... .......... .......... .......... .......... 10% 4.88M 24s 2024-05-08T06:48:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:52 smithi194 ceph-mon[33679]: pgmap v72: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:52.264 INFO:tasks.workunit.client.0.smithi070.stderr: 14100K .......... .......... .......... .......... .......... 10% 4.45M 24s 2024-05-08T06:48:52.274 INFO:tasks.workunit.client.0.smithi070.stderr: 14150K .......... .......... .......... .......... .......... 10% 5.08M 24s 2024-05-08T06:48:52.284 INFO:tasks.workunit.client.0.smithi070.stderr: 14200K .......... .......... .......... .......... .......... 10% 4.79M 24s 2024-05-08T06:48:52.294 INFO:tasks.workunit.client.0.smithi070.stderr: 14250K .......... .......... .......... .......... .......... 10% 4.91M 24s 2024-05-08T06:48:52.305 INFO:tasks.workunit.client.0.smithi070.stderr: 14300K .......... .......... .......... .......... .......... 10% 4.11M 24s 2024-05-08T06:48:52.315 INFO:tasks.workunit.client.0.smithi070.stderr: 14350K .......... .......... .......... .......... .......... 10% 5.11M 24s 2024-05-08T06:48:52.324 INFO:tasks.workunit.client.0.smithi070.stderr: 14400K .......... .......... .......... .......... .......... 10% 5.21M 24s 2024-05-08T06:48:52.334 INFO:tasks.workunit.client.0.smithi070.stderr: 14450K .......... .......... .......... .......... .......... 10% 4.93M 24s 2024-05-08T06:48:52.345 INFO:tasks.workunit.client.0.smithi070.stderr: 14500K .......... .......... .......... .......... .......... 10% 4.50M 24s 2024-05-08T06:48:52.354 INFO:tasks.workunit.client.0.smithi070.stderr: 14550K .......... .......... .......... .......... .......... 10% 5.35M 24s 2024-05-08T06:48:52.363 INFO:tasks.workunit.client.0.smithi070.stderr: 14600K .......... .......... .......... .......... .......... 10% 5.56M 24s 2024-05-08T06:48:52.373 INFO:tasks.workunit.client.0.smithi070.stderr: 14650K .......... .......... .......... .......... .......... 10% 5.04M 23s 2024-05-08T06:48:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:52 smithi070 ceph-mon[29591]: pgmap v72: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:52.383 INFO:tasks.workunit.client.0.smithi070.stderr: 14700K .......... .......... .......... .......... .......... 10% 4.59M 23s 2024-05-08T06:48:52.393 INFO:tasks.workunit.client.0.smithi070.stderr: 14750K .......... .......... .......... .......... .......... 10% 5.06M 23s 2024-05-08T06:48:52.402 INFO:tasks.workunit.client.0.smithi070.stderr: 14800K .......... .......... .......... .......... .......... 10% 5.38M 23s 2024-05-08T06:48:52.411 INFO:tasks.workunit.client.0.smithi070.stderr: 14850K .......... .......... .......... .......... .......... 10% 5.25M 23s 2024-05-08T06:48:52.423 INFO:tasks.workunit.client.0.smithi070.stderr: 14900K .......... .......... .......... .......... .......... 11% 4.40M 23s 2024-05-08T06:48:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:52 smithi172 ceph-mon[33377]: pgmap v72: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:52.432 INFO:tasks.workunit.client.0.smithi070.stderr: 14950K .......... .......... .......... .......... .......... 11% 5.06M 23s 2024-05-08T06:48:52.442 INFO:tasks.workunit.client.0.smithi070.stderr: 15000K .......... .......... .......... .......... .......... 11% 4.86M 23s 2024-05-08T06:48:52.451 INFO:tasks.workunit.client.0.smithi070.stderr: 15050K .......... .......... .......... .......... .......... 11% 5.66M 23s 2024-05-08T06:48:52.462 INFO:tasks.workunit.client.0.smithi070.stderr: 15100K .......... .......... .......... .......... .......... 11% 4.53M 23s 2024-05-08T06:48:52.471 INFO:tasks.workunit.client.0.smithi070.stderr: 15150K .......... .......... .......... .......... .......... 11% 5.15M 23s 2024-05-08T06:48:52.481 INFO:tasks.workunit.client.0.smithi070.stderr: 15200K .......... .......... .......... .......... .......... 11% 5.03M 23s 2024-05-08T06:48:52.492 INFO:tasks.workunit.client.0.smithi070.stderr: 15250K .......... .......... .......... .......... .......... 11% 4.45M 23s 2024-05-08T06:48:52.503 INFO:tasks.workunit.client.0.smithi070.stderr: 15300K .......... .......... .......... .......... .......... 11% 4.51M 23s 2024-05-08T06:48:52.512 INFO:tasks.workunit.client.0.smithi070.stderr: 15350K .......... .......... .......... .......... .......... 11% 4.95M 23s 2024-05-08T06:48:52.521 INFO:tasks.workunit.client.0.smithi070.stderr: 15400K .......... .......... .......... .......... .......... 11% 5.35M 23s 2024-05-08T06:48:52.528 INFO:tasks.workunit.client.0.smithi070.stderr: 15450K .......... .......... .......... .......... .......... 11% 7.08M 23s 2024-05-08T06:48:52.537 INFO:tasks.workunit.client.0.smithi070.stderr: 15500K .......... .......... .......... .......... .......... 11% 5.73M 23s 2024-05-08T06:48:52.543 INFO:tasks.workunit.client.0.smithi070.stderr: 15550K .......... .......... .......... .......... .......... 11% 7.40M 23s 2024-05-08T06:48:52.553 INFO:tasks.workunit.client.0.smithi070.stderr: 15600K .......... .......... .......... .......... .......... 11% 5.25M 23s 2024-05-08T06:48:52.563 INFO:tasks.workunit.client.0.smithi070.stderr: 15650K .......... .......... .......... .......... .......... 11% 4.93M 23s 2024-05-08T06:48:52.574 INFO:tasks.workunit.client.0.smithi070.stderr: 15700K .......... .......... .......... .......... .......... 11% 4.30M 23s 2024-05-08T06:48:52.584 INFO:tasks.workunit.client.0.smithi070.stderr: 15750K .......... .......... .......... .......... .......... 11% 5.08M 23s 2024-05-08T06:48:52.593 INFO:tasks.workunit.client.0.smithi070.stderr: 15800K .......... .......... .......... .......... .......... 11% 5.21M 23s 2024-05-08T06:48:52.603 INFO:tasks.workunit.client.0.smithi070.stderr: 15850K .......... .......... .......... .......... .......... 11% 4.99M 23s 2024-05-08T06:48:52.616 INFO:tasks.workunit.client.0.smithi070.stderr: 15900K .......... .......... .......... .......... .......... 11% 4.06M 23s 2024-05-08T06:48:52.625 INFO:tasks.workunit.client.0.smithi070.stderr: 15950K .......... .......... .......... .......... .......... 11% 4.91M 23s 2024-05-08T06:48:52.635 INFO:tasks.workunit.client.0.smithi070.stderr: 16000K .......... .......... .......... .......... .......... 11% 4.84M 23s 2024-05-08T06:48:52.645 INFO:tasks.workunit.client.0.smithi070.stderr: 16050K .......... .......... .......... .......... .......... 11% 5.09M 23s 2024-05-08T06:48:52.656 INFO:tasks.workunit.client.0.smithi070.stderr: 16100K .......... .......... .......... .......... .......... 11% 4.18M 23s 2024-05-08T06:48:52.666 INFO:tasks.workunit.client.0.smithi070.stderr: 16150K .......... .......... .......... .......... .......... 11% 4.92M 23s 2024-05-08T06:48:52.676 INFO:tasks.workunit.client.0.smithi070.stderr: 16200K .......... .......... .......... .......... .......... 11% 5.04M 23s 2024-05-08T06:48:52.687 INFO:tasks.workunit.client.0.smithi070.stderr: 16250K .......... .......... .......... .......... .......... 12% 4.62M 23s 2024-05-08T06:48:52.702 INFO:tasks.workunit.client.0.smithi070.stderr: 16300K .......... .......... .......... .......... .......... 12% 3.07M 23s 2024-05-08T06:48:52.713 INFO:tasks.workunit.client.0.smithi070.stderr: 16350K .......... .......... .......... .......... .......... 12% 4.82M 23s 2024-05-08T06:48:52.721 INFO:tasks.workunit.client.0.smithi070.stderr: 16400K .......... .......... .......... .......... .......... 12% 5.55M 23s 2024-05-08T06:48:52.730 INFO:tasks.workunit.client.0.smithi070.stderr: 16450K .......... .......... .......... .......... .......... 12% 5.37M 23s 2024-05-08T06:48:52.741 INFO:tasks.workunit.client.0.smithi070.stderr: 16500K .......... .......... .......... .......... .......... 12% 4.70M 23s 2024-05-08T06:48:52.749 INFO:tasks.workunit.client.0.smithi070.stderr: 16550K .......... .......... .......... .......... .......... 12% 5.93M 23s 2024-05-08T06:48:52.757 INFO:tasks.workunit.client.0.smithi070.stderr: 16600K .......... .......... .......... .......... .......... 12% 5.79M 23s 2024-05-08T06:48:52.765 INFO:tasks.workunit.client.0.smithi070.stderr: 16650K .......... .......... .......... .......... .......... 12% 5.92M 23s 2024-05-08T06:48:52.775 INFO:tasks.workunit.client.0.smithi070.stderr: 16700K .......... .......... .......... .......... .......... 12% 5.12M 23s 2024-05-08T06:48:52.783 INFO:tasks.workunit.client.0.smithi070.stderr: 16750K .......... .......... .......... .......... .......... 12% 6.02M 23s 2024-05-08T06:48:52.792 INFO:tasks.workunit.client.0.smithi070.stderr: 16800K .......... .......... .......... .......... .......... 12% 5.43M 23s 2024-05-08T06:48:52.800 INFO:tasks.workunit.client.0.smithi070.stderr: 16850K .......... .......... .......... .......... .......... 12% 6.06M 23s 2024-05-08T06:48:52.810 INFO:tasks.workunit.client.0.smithi070.stderr: 16900K .......... .......... .......... .......... .......... 12% 4.86M 23s 2024-05-08T06:48:52.820 INFO:tasks.workunit.client.0.smithi070.stderr: 16950K .......... .......... .......... .......... .......... 12% 5.43M 23s 2024-05-08T06:48:52.828 INFO:tasks.workunit.client.0.smithi070.stderr: 17000K .......... .......... .......... .......... .......... 12% 5.72M 23s 2024-05-08T06:48:52.836 INFO:tasks.workunit.client.0.smithi070.stderr: 17050K .......... .......... .......... .......... .......... 12% 5.78M 23s 2024-05-08T06:48:52.844 INFO:tasks.workunit.client.0.smithi070.stderr: 17100K .......... .......... .......... .......... .......... 12% 6.00M 23s 2024-05-08T06:48:52.853 INFO:tasks.workunit.client.0.smithi070.stderr: 17150K .......... .......... .......... .......... .......... 12% 6.09M 23s 2024-05-08T06:48:52.861 INFO:tasks.workunit.client.0.smithi070.stderr: 17200K .......... .......... .......... .......... .......... 12% 5.49M 23s 2024-05-08T06:48:52.870 INFO:tasks.workunit.client.0.smithi070.stderr: 17250K .......... .......... .......... .......... .......... 12% 5.54M 23s 2024-05-08T06:48:52.879 INFO:tasks.workunit.client.0.smithi070.stderr: 17300K .......... .......... .......... .......... .......... 12% 5.20M 23s 2024-05-08T06:48:52.888 INFO:tasks.workunit.client.0.smithi070.stderr: 17350K .......... .......... .......... .......... .......... 12% 5.76M 23s 2024-05-08T06:48:52.897 INFO:tasks.workunit.client.0.smithi070.stderr: 17400K .......... .......... .......... .......... .......... 12% 5.66M 23s 2024-05-08T06:48:52.906 INFO:tasks.workunit.client.0.smithi070.stderr: 17450K .......... .......... .......... .......... .......... 12% 5.71M 23s 2024-05-08T06:48:52.915 INFO:tasks.workunit.client.0.smithi070.stderr: 17500K .......... .......... .......... .......... .......... 12% 4.86M 23s 2024-05-08T06:48:52.924 INFO:tasks.workunit.client.0.smithi070.stderr: 17550K .......... .......... .......... .......... .......... 12% 5.41M 23s 2024-05-08T06:48:52.934 INFO:tasks.workunit.client.0.smithi070.stderr: 17600K .......... .......... .......... .......... .......... 13% 5.22M 23s 2024-05-08T06:48:52.943 INFO:tasks.workunit.client.0.smithi070.stderr: 17650K .......... .......... .......... .......... .......... 13% 5.30M 23s 2024-05-08T06:48:52.954 INFO:tasks.workunit.client.0.smithi070.stderr: 17700K .......... .......... .......... .......... .......... 13% 4.57M 23s 2024-05-08T06:48:52.963 INFO:tasks.workunit.client.0.smithi070.stderr: 17750K .......... .......... .......... .......... .......... 13% 5.38M 23s 2024-05-08T06:48:52.972 INFO:tasks.workunit.client.0.smithi070.stderr: 17800K .......... .......... .......... .......... .......... 13% 5.04M 23s 2024-05-08T06:48:52.982 INFO:tasks.workunit.client.0.smithi070.stderr: 17850K .......... .......... .......... .......... .......... 13% 5.35M 23s 2024-05-08T06:48:52.992 INFO:tasks.workunit.client.0.smithi070.stderr: 17900K .......... .......... .......... .......... .......... 13% 4.59M 23s 2024-05-08T06:48:53.001 INFO:tasks.workunit.client.0.smithi070.stderr: 17950K .......... .......... .......... .......... .......... 13% 5.44M 23s 2024-05-08T06:48:53.010 INFO:tasks.workunit.client.0.smithi070.stderr: 18000K .......... .......... .......... .......... .......... 13% 5.41M 23s 2024-05-08T06:48:53.019 INFO:tasks.workunit.client.0.smithi070.stderr: 18050K .......... .......... .......... .......... .......... 13% 5.64M 23s 2024-05-08T06:48:53.028 INFO:tasks.workunit.client.0.smithi070.stderr: 18100K .......... .......... .......... .......... .......... 13% 5.09M 23s 2024-05-08T06:48:53.037 INFO:tasks.workunit.client.0.smithi070.stderr: 18150K .......... .......... .......... .......... .......... 13% 5.58M 23s 2024-05-08T06:48:53.046 INFO:tasks.workunit.client.0.smithi070.stderr: 18200K .......... .......... .......... .......... .......... 13% 5.78M 23s 2024-05-08T06:48:53.054 INFO:tasks.workunit.client.0.smithi070.stderr: 18250K .......... .......... .......... .......... .......... 13% 5.46M 23s 2024-05-08T06:48:53.065 INFO:tasks.workunit.client.0.smithi070.stderr: 18300K .......... .......... .......... .......... .......... 13% 4.65M 23s 2024-05-08T06:48:53.073 INFO:tasks.workunit.client.0.smithi070.stderr: 18350K .......... .......... .......... .......... .......... 13% 5.86M 23s 2024-05-08T06:48:53.082 INFO:tasks.workunit.client.0.smithi070.stderr: 18400K .......... .......... .......... .......... .......... 13% 5.83M 23s 2024-05-08T06:48:53.090 INFO:tasks.workunit.client.0.smithi070.stderr: 18450K .......... .......... .......... .......... .......... 13% 5.89M 23s 2024-05-08T06:48:53.100 INFO:tasks.workunit.client.0.smithi070.stderr: 18500K .......... .......... .......... .......... .......... 13% 4.90M 23s 2024-05-08T06:48:53.108 INFO:tasks.workunit.client.0.smithi070.stderr: 18550K .......... .......... .......... .......... .......... 13% 5.73M 23s 2024-05-08T06:48:53.117 INFO:tasks.workunit.client.0.smithi070.stderr: 18600K .......... .......... .......... .......... .......... 13% 5.67M 23s 2024-05-08T06:48:53.126 INFO:tasks.workunit.client.0.smithi070.stderr: 18650K .......... .......... .......... .......... .......... 13% 5.27M 23s 2024-05-08T06:48:53.136 INFO:tasks.workunit.client.0.smithi070.stderr: 18700K .......... .......... .......... .......... .......... 13% 4.85M 23s 2024-05-08T06:48:53.145 INFO:tasks.workunit.client.0.smithi070.stderr: 18750K .......... .......... .......... .......... .......... 13% 5.93M 23s 2024-05-08T06:48:53.154 INFO:tasks.workunit.client.0.smithi070.stderr: 18800K .......... .......... .......... .......... .......... 13% 5.33M 23s 2024-05-08T06:48:53.164 INFO:tasks.workunit.client.0.smithi070.stderr: 18850K .......... .......... .......... .......... .......... 13% 4.97M 23s 2024-05-08T06:48:53.175 INFO:tasks.workunit.client.0.smithi070.stderr: 18900K .......... .......... .......... .......... .......... 13% 4.11M 23s 2024-05-08T06:48:53.186 INFO:tasks.workunit.client.0.smithi070.stderr: 18950K .......... .......... .......... .......... .......... 13% 4.84M 23s 2024-05-08T06:48:53.196 INFO:tasks.workunit.client.0.smithi070.stderr: 19000K .......... .......... .......... .......... .......... 14% 4.84M 23s 2024-05-08T06:48:53.206 INFO:tasks.workunit.client.0.smithi070.stderr: 19050K .......... .......... .......... .......... .......... 14% 5.08M 23s 2024-05-08T06:48:53.218 INFO:tasks.workunit.client.0.smithi070.stderr: 19100K .......... .......... .......... .......... .......... 14% 3.97M 23s 2024-05-08T06:48:53.228 INFO:tasks.workunit.client.0.smithi070.stderr: 19150K .......... .......... .......... .......... .......... 14% 4.69M 23s 2024-05-08T06:48:53.240 INFO:tasks.workunit.client.0.smithi070.stderr: 19200K .......... .......... .......... .......... .......... 14% 4.71M 23s 2024-05-08T06:48:53.249 INFO:tasks.workunit.client.0.smithi070.stderr: 19250K .......... .......... .......... .......... .......... 14% 4.67M 23s 2024-05-08T06:48:53.260 INFO:tasks.workunit.client.0.smithi070.stderr: 19300K .......... .......... .......... .......... .......... 14% 4.40M 23s 2024-05-08T06:48:53.266 INFO:tasks.workunit.client.0.smithi070.stderr: 19350K .......... .......... .......... .......... .......... 14% 7.31M 22s 2024-05-08T06:48:53.274 INFO:tasks.workunit.client.0.smithi070.stderr: 19400K .......... .......... .......... .......... .......... 14% 6.70M 22s 2024-05-08T06:48:53.281 INFO:tasks.workunit.client.0.smithi070.stderr: 19450K .......... .......... .......... .......... .......... 14% 6.50M 22s 2024-05-08T06:48:53.291 INFO:tasks.workunit.client.0.smithi070.stderr: 19500K .......... .......... .......... .......... .......... 14% 5.22M 22s 2024-05-08T06:48:53.298 INFO:tasks.workunit.client.0.smithi070.stderr: 19550K .......... .......... .......... .......... .......... 14% 6.41M 22s 2024-05-08T06:48:53.305 INFO:tasks.workunit.client.0.smithi070.stderr: 19600K .......... .......... .......... .......... .......... 14% 6.98M 22s 2024-05-08T06:48:53.313 INFO:tasks.workunit.client.0.smithi070.stderr: 19650K .......... .......... .......... .......... .......... 14% 6.19M 22s 2024-05-08T06:48:53.322 INFO:tasks.workunit.client.0.smithi070.stderr: 19700K .......... .......... .......... .......... .......... 14% 5.39M 22s 2024-05-08T06:48:53.330 INFO:tasks.workunit.client.0.smithi070.stderr: 19750K .......... .......... .......... .......... .......... 14% 5.90M 22s 2024-05-08T06:48:53.339 INFO:tasks.workunit.client.0.smithi070.stderr: 19800K .......... .......... .......... .......... .......... 14% 5.55M 22s 2024-05-08T06:48:53.349 INFO:tasks.workunit.client.0.smithi070.stderr: 19850K .......... .......... .......... .......... .......... 14% 5.47M 22s 2024-05-08T06:48:53.360 INFO:tasks.workunit.client.0.smithi070.stderr: 19900K .......... .......... .......... .......... .......... 14% 4.03M 22s 2024-05-08T06:48:53.371 INFO:tasks.workunit.client.0.smithi070.stderr: 19950K .......... .......... .......... .......... .......... 14% 4.86M 22s 2024-05-08T06:48:53.381 INFO:tasks.workunit.client.0.smithi070.stderr: 20000K .......... .......... .......... .......... .......... 14% 4.78M 22s 2024-05-08T06:48:53.390 INFO:tasks.workunit.client.0.smithi070.stderr: 20050K .......... .......... .......... .......... .......... 14% 5.69M 22s 2024-05-08T06:48:53.400 INFO:tasks.workunit.client.0.smithi070.stderr: 20100K .......... .......... .......... .......... .......... 14% 4.48M 22s 2024-05-08T06:48:53.410 INFO:tasks.workunit.client.0.smithi070.stderr: 20150K .......... .......... .......... .......... .......... 14% 5.29M 22s 2024-05-08T06:48:53.420 INFO:tasks.workunit.client.0.smithi070.stderr: 20200K .......... .......... .......... .......... .......... 14% 4.90M 22s 2024-05-08T06:48:53.430 INFO:tasks.workunit.client.0.smithi070.stderr: 20250K .......... .......... .......... .......... .......... 14% 4.77M 22s 2024-05-08T06:48:53.440 INFO:tasks.workunit.client.0.smithi070.stderr: 20300K .......... .......... .......... .......... .......... 14% 4.57M 22s 2024-05-08T06:48:53.450 INFO:tasks.workunit.client.0.smithi070.stderr: 20350K .......... .......... .......... .......... .......... 15% 5.06M 22s 2024-05-08T06:48:53.460 INFO:tasks.workunit.client.0.smithi070.stderr: 20400K .......... .......... .......... .......... .......... 15% 4.75M 22s 2024-05-08T06:48:53.471 INFO:tasks.workunit.client.0.smithi070.stderr: 20450K .......... .......... .......... .......... .......... 15% 4.64M 22s 2024-05-08T06:48:53.480 INFO:tasks.workunit.client.0.smithi070.stderr: 20500K .......... .......... .......... .......... .......... 15% 4.98M 22s 2024-05-08T06:48:53.487 INFO:tasks.workunit.client.0.smithi070.stderr: 20550K .......... .......... .......... .......... .......... 15% 6.91M 22s 2024-05-08T06:48:53.496 INFO:tasks.workunit.client.0.smithi070.stderr: 20600K .......... .......... .......... .......... .......... 15% 5.71M 22s 2024-05-08T06:48:53.505 INFO:tasks.workunit.client.0.smithi070.stderr: 20650K .......... .......... .......... .......... .......... 15% 5.38M 22s 2024-05-08T06:48:53.518 INFO:tasks.workunit.client.0.smithi070.stderr: 20700K .......... .......... .......... .......... .......... 15% 3.85M 22s 2024-05-08T06:48:53.526 INFO:tasks.workunit.client.0.smithi070.stderr: 20750K .......... .......... .......... .......... .......... 15% 5.92M 22s 2024-05-08T06:48:53.535 INFO:tasks.workunit.client.0.smithi070.stderr: 20800K .......... .......... .......... .......... .......... 15% 5.44M 22s 2024-05-08T06:48:53.544 INFO:tasks.workunit.client.0.smithi070.stderr: 20850K .......... .......... .......... .......... .......... 15% 5.88M 22s 2024-05-08T06:48:53.553 INFO:tasks.workunit.client.0.smithi070.stderr: 20900K .......... .......... .......... .......... .......... 15% 5.22M 22s 2024-05-08T06:48:53.561 INFO:tasks.workunit.client.0.smithi070.stderr: 20950K .......... .......... .......... .......... .......... 15% 5.95M 22s 2024-05-08T06:48:53.569 INFO:tasks.workunit.client.0.smithi070.stderr: 21000K .......... .......... .......... .......... .......... 15% 5.81M 22s 2024-05-08T06:48:53.577 INFO:tasks.workunit.client.0.smithi070.stderr: 21050K .......... .......... .......... .......... .......... 15% 5.93M 22s 2024-05-08T06:48:53.588 INFO:tasks.workunit.client.0.smithi070.stderr: 21100K .......... .......... .......... .......... .......... 15% 5.03M 22s 2024-05-08T06:48:53.600 INFO:tasks.workunit.client.0.smithi070.stderr: 21150K .......... .......... .......... .......... .......... 15% 4.29M 22s 2024-05-08T06:48:53.610 INFO:tasks.workunit.client.0.smithi070.stderr: 21200K .......... .......... .......... .......... .......... 15% 4.38M 22s 2024-05-08T06:48:53.617 INFO:tasks.workunit.client.0.smithi070.stderr: 21250K .......... .......... .......... .......... .......... 15% 6.42M 22s 2024-05-08T06:48:53.628 INFO:tasks.workunit.client.0.smithi070.stderr: 21300K .......... .......... .......... .......... .......... 15% 4.87M 22s 2024-05-08T06:48:53.636 INFO:tasks.workunit.client.0.smithi070.stderr: 21350K .......... .......... .......... .......... .......... 15% 5.67M 22s 2024-05-08T06:48:53.645 INFO:tasks.workunit.client.0.smithi070.stderr: 21400K .......... .......... .......... .......... .......... 15% 5.39M 22s 2024-05-08T06:48:53.654 INFO:tasks.workunit.client.0.smithi070.stderr: 21450K .......... .......... .......... .......... .......... 15% 5.33M 22s 2024-05-08T06:48:53.667 INFO:tasks.workunit.client.0.smithi070.stderr: 21500K .......... .......... .......... .......... .......... 15% 4.08M 22s 2024-05-08T06:48:53.676 INFO:tasks.workunit.client.0.smithi070.stderr: 21550K .......... .......... .......... .......... .......... 15% 5.10M 22s 2024-05-08T06:48:53.684 INFO:tasks.workunit.client.0.smithi070.stderr: 21600K .......... .......... .......... .......... .......... 15% 6.30M 22s 2024-05-08T06:48:53.693 INFO:tasks.workunit.client.0.smithi070.stderr: 21650K .......... .......... .......... .......... .......... 15% 5.14M 22s 2024-05-08T06:48:53.704 INFO:tasks.workunit.client.0.smithi070.stderr: 21700K .......... .......... .......... .......... .......... 16% 4.55M 22s 2024-05-08T06:48:53.714 INFO:tasks.workunit.client.0.smithi070.stderr: 21750K .......... .......... .......... .......... .......... 16% 5.15M 22s 2024-05-08T06:48:53.727 INFO:tasks.workunit.client.0.smithi070.stderr: 21800K .......... .......... .......... .......... .......... 16% 5.06M 22s 2024-05-08T06:48:53.732 INFO:tasks.workunit.client.0.smithi070.stderr: 21850K .......... .......... .......... .......... .......... 16% 5.47M 22s 2024-05-08T06:48:53.743 INFO:tasks.workunit.client.0.smithi070.stderr: 21900K .......... .......... .......... .......... .......... 16% 4.41M 22s 2024-05-08T06:48:53.753 INFO:tasks.workunit.client.0.smithi070.stderr: 21950K .......... .......... .......... .......... .......... 16% 5.18M 22s 2024-05-08T06:48:53.761 INFO:tasks.workunit.client.0.smithi070.stderr: 22000K .......... .......... .......... .......... .......... 16% 5.60M 22s 2024-05-08T06:48:53.769 INFO:tasks.workunit.client.0.smithi070.stderr: 22050K .......... .......... .......... .......... .......... 16% 6.01M 22s 2024-05-08T06:48:53.779 INFO:tasks.workunit.client.0.smithi070.stderr: 22100K .......... .......... .......... .......... .......... 16% 4.77M 22s 2024-05-08T06:48:53.789 INFO:tasks.workunit.client.0.smithi070.stderr: 22150K .......... .......... .......... .......... .......... 16% 5.31M 22s 2024-05-08T06:48:53.798 INFO:tasks.workunit.client.0.smithi070.stderr: 22200K .......... .......... .......... .......... .......... 16% 5.57M 22s 2024-05-08T06:48:53.806 INFO:tasks.workunit.client.0.smithi070.stderr: 22250K .......... .......... .......... .......... .......... 16% 5.51M 22s 2024-05-08T06:48:53.817 INFO:tasks.workunit.client.0.smithi070.stderr: 22300K .......... .......... .......... .......... .......... 16% 4.50M 22s 2024-05-08T06:48:53.826 INFO:tasks.workunit.client.0.smithi070.stderr: 22350K .......... .......... .......... .......... .......... 16% 5.46M 22s 2024-05-08T06:48:53.835 INFO:tasks.workunit.client.0.smithi070.stderr: 22400K .......... .......... .......... .......... .......... 16% 5.36M 22s 2024-05-08T06:48:53.844 INFO:tasks.workunit.client.0.smithi070.stderr: 22450K .......... .......... .......... .......... .......... 16% 5.47M 22s 2024-05-08T06:48:53.855 INFO:tasks.workunit.client.0.smithi070.stderr: 22500K .......... .......... .......... .......... .......... 16% 4.58M 22s 2024-05-08T06:48:53.864 INFO:tasks.workunit.client.0.smithi070.stderr: 22550K .......... .......... .......... .......... .......... 16% 5.37M 22s 2024-05-08T06:48:53.873 INFO:tasks.workunit.client.0.smithi070.stderr: 22600K .......... .......... .......... .......... .......... 16% 5.37M 22s 2024-05-08T06:48:53.882 INFO:tasks.workunit.client.0.smithi070.stderr: 22650K .......... .......... .......... .......... .......... 16% 5.49M 22s 2024-05-08T06:48:53.894 INFO:tasks.workunit.client.0.smithi070.stderr: 22700K .......... .......... .......... .......... .......... 16% 4.12M 22s 2024-05-08T06:48:53.903 INFO:tasks.workunit.client.0.smithi070.stderr: 22750K .......... .......... .......... .......... .......... 16% 5.35M 22s 2024-05-08T06:48:53.912 INFO:tasks.workunit.client.0.smithi070.stderr: 22800K .......... .......... .......... .......... .......... 16% 5.42M 22s 2024-05-08T06:48:53.921 INFO:tasks.workunit.client.0.smithi070.stderr: 22850K .......... .......... .......... .......... .......... 16% 5.29M 22s 2024-05-08T06:48:53.932 INFO:tasks.workunit.client.0.smithi070.stderr: 22900K .......... .......... .......... .......... .......... 16% 4.67M 22s 2024-05-08T06:48:53.942 INFO:tasks.workunit.client.0.smithi070.stderr: 22950K .......... .......... .......... .......... .......... 16% 4.89M 22s 2024-05-08T06:48:53.953 INFO:tasks.workunit.client.0.smithi070.stderr: 23000K .......... .......... .......... .......... .......... 16% 4.55M 22s 2024-05-08T06:48:53.963 INFO:tasks.workunit.client.0.smithi070.stderr: 23050K .......... .......... .......... .......... .......... 17% 4.61M 22s 2024-05-08T06:48:53.975 INFO:tasks.workunit.client.0.smithi070.stderr: 23100K .......... .......... .......... .......... .......... 17% 4.03M 22s 2024-05-08T06:48:53.985 INFO:tasks.workunit.client.0.smithi070.stderr: 23150K .......... .......... .......... .......... .......... 17% 4.83M 22s 2024-05-08T06:48:53.995 INFO:tasks.workunit.client.0.smithi070.stderr: 23200K .......... .......... .......... .......... .......... 17% 4.93M 22s 2024-05-08T06:48:54.005 INFO:tasks.workunit.client.0.smithi070.stderr: 23250K .......... .......... .......... .......... .......... 17% 4.97M 22s 2024-05-08T06:48:54.017 INFO:tasks.workunit.client.0.smithi070.stderr: 23300K .......... .......... .......... .......... .......... 17% 4.05M 22s 2024-05-08T06:48:54.027 INFO:tasks.workunit.client.0.smithi070.stderr: 23350K .......... .......... .......... .......... .......... 17% 4.75M 22s 2024-05-08T06:48:54.037 INFO:tasks.workunit.client.0.smithi070.stderr: 23400K .......... .......... .......... .......... .......... 17% 5.09M 22s 2024-05-08T06:48:54.047 INFO:tasks.workunit.client.0.smithi070.stderr: 23450K .......... .......... .......... .......... .......... 17% 5.01M 22s 2024-05-08T06:48:54.058 INFO:tasks.workunit.client.0.smithi070.stderr: 23500K .......... .......... .......... .......... .......... 17% 4.18M 22s 2024-05-08T06:48:54.068 INFO:tasks.workunit.client.0.smithi070.stderr: 23550K .......... .......... .......... .......... .......... 17% 4.90M 22s 2024-05-08T06:48:54.078 INFO:tasks.workunit.client.0.smithi070.stderr: 23600K .......... .......... .......... .......... .......... 17% 4.90M 22s 2024-05-08T06:48:54.088 INFO:tasks.workunit.client.0.smithi070.stderr: 23650K .......... .......... .......... .......... .......... 17% 4.89M 22s 2024-05-08T06:48:54.100 INFO:tasks.workunit.client.0.smithi070.stderr: 23700K .......... .......... .......... .......... .......... 17% 4.05M 22s 2024-05-08T06:48:54.111 INFO:tasks.workunit.client.0.smithi070.stderr: 23750K .......... .......... .......... .......... .......... 17% 4.73M 22s 2024-05-08T06:48:54.121 INFO:tasks.workunit.client.0.smithi070.stderr: 23800K .......... .......... .......... .......... .......... 17% 4.76M 22s 2024-05-08T06:48:54.131 INFO:tasks.workunit.client.0.smithi070.stderr: 23850K .......... .......... .......... .......... .......... 17% 4.85M 22s 2024-05-08T06:48:54.144 INFO:tasks.workunit.client.0.smithi070.stderr: 23900K .......... .......... .......... .......... .......... 17% 3.96M 22s 2024-05-08T06:48:54.153 INFO:tasks.workunit.client.0.smithi070.stderr: 23950K .......... .......... .......... .......... .......... 17% 4.96M 22s 2024-05-08T06:48:54.163 INFO:tasks.workunit.client.0.smithi070.stderr: 24000K .......... .......... .......... .......... .......... 17% 4.91M 22s 2024-05-08T06:48:54.172 INFO:tasks.workunit.client.0.smithi070.stderr: 24050K .......... .......... .......... .......... .......... 17% 5.11M 22s 2024-05-08T06:48:54.184 INFO:tasks.workunit.client.0.smithi070.stderr: 24100K .......... .......... .......... .......... .......... 17% 4.27M 22s 2024-05-08T06:48:54.194 INFO:tasks.workunit.client.0.smithi070.stderr: 24150K .......... .......... .......... .......... .......... 17% 4.85M 22s 2024-05-08T06:48:54.204 INFO:tasks.workunit.client.0.smithi070.stderr: 24200K .......... .......... .......... .......... .......... 17% 4.84M 22s 2024-05-08T06:48:54.214 INFO:tasks.workunit.client.0.smithi070.stderr: 24250K .......... .......... .......... .......... .......... 17% 4.91M 22s 2024-05-08T06:48:54.227 INFO:tasks.workunit.client.0.smithi070.stderr: 24300K .......... .......... .......... .......... .......... 17% 3.96M 22s 2024-05-08T06:48:54.237 INFO:tasks.workunit.client.0.smithi070.stderr: 24350K .......... .......... .......... .......... .......... 17% 4.73M 22s 2024-05-08T06:48:54.247 INFO:tasks.workunit.client.0.smithi070.stderr: 24400K .......... .......... .......... .......... .......... 18% 4.66M 22s 2024-05-08T06:48:54.258 INFO:tasks.workunit.client.0.smithi070.stderr: 24450K .......... .......... .......... .......... .......... 18% 4.62M 22s 2024-05-08T06:48:54.270 INFO:tasks.workunit.client.0.smithi070.stderr: 24500K .......... .......... .......... .......... .......... 18% 3.88M 22s 2024-05-08T06:48:54.280 INFO:tasks.workunit.client.0.smithi070.stderr: 24550K .......... .......... .......... .......... .......... 18% 4.83M 22s 2024-05-08T06:48:54.289 INFO:tasks.workunit.client.0.smithi070.stderr: 24600K .......... .......... .......... .......... .......... 18% 5.58M 21s 2024-05-08T06:48:54.297 INFO:tasks.workunit.client.0.smithi070.stderr: 24650K .......... .......... .......... .......... .......... 18% 5.81M 21s 2024-05-08T06:48:54.308 INFO:tasks.workunit.client.0.smithi070.stderr: 24700K .......... .......... .......... .......... .......... 18% 5.04M 21s 2024-05-08T06:48:54.319 INFO:tasks.workunit.client.0.smithi070.stderr: 24750K .......... .......... .......... .......... .......... 18% 4.27M 21s 2024-05-08T06:48:54.330 INFO:tasks.workunit.client.0.smithi070.stderr: 24800K .......... .......... .......... .......... .......... 18% 4.50M 21s 2024-05-08T06:48:54.342 INFO:tasks.workunit.client.0.smithi070.stderr: 24850K .......... .......... .......... .......... .......... 18% 5.47M 21s 2024-05-08T06:48:54.348 INFO:tasks.workunit.client.0.smithi070.stderr: 24900K .......... .......... .......... .......... .......... 18% 4.95M 21s 2024-05-08T06:48:54.357 INFO:tasks.workunit.client.0.smithi070.stderr: 24950K .......... .......... .......... .......... .......... 18% 5.67M 21s 2024-05-08T06:48:54.365 INFO:tasks.workunit.client.0.smithi070.stderr: 25000K .......... .......... .......... .......... .......... 18% 6.06M 21s 2024-05-08T06:48:54.373 INFO:tasks.workunit.client.0.smithi070.stderr: 25050K .......... .......... .......... .......... .......... 18% 5.83M 21s 2024-05-08T06:48:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:54 smithi070 ceph-mon[29591]: pgmap v73: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:54.383 INFO:tasks.workunit.client.0.smithi070.stderr: 25100K .......... .......... .......... .......... .......... 18% 4.82M 21s 2024-05-08T06:48:54.391 INFO:tasks.workunit.client.0.smithi070.stderr: 25150K .......... .......... .......... .......... .......... 18% 6.04M 21s 2024-05-08T06:48:54.400 INFO:tasks.workunit.client.0.smithi070.stderr: 25200K .......... .......... .......... .......... .......... 18% 5.68M 21s 2024-05-08T06:48:54.409 INFO:tasks.workunit.client.0.smithi070.stderr: 25250K .......... .......... .......... .......... .......... 18% 5.70M 21s 2024-05-08T06:48:54.419 INFO:tasks.workunit.client.0.smithi070.stderr: 25300K .......... .......... .......... .......... .......... 18% 4.67M 21s 2024-05-08T06:48:54.428 INFO:tasks.workunit.client.0.smithi070.stderr: 25350K .......... .......... .......... .......... .......... 18% 5.46M 21s 2024-05-08T06:48:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:54 smithi172 ceph-mon[33377]: pgmap v73: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:54.437 INFO:tasks.workunit.client.0.smithi070.stderr: 25400K .......... .......... .......... .......... .......... 18% 5.58M 21s 2024-05-08T06:48:54.445 INFO:tasks.workunit.client.0.smithi070.stderr: 25450K .......... .......... .......... .......... .......... 18% 5.72M 21s 2024-05-08T06:48:54.455 INFO:tasks.workunit.client.0.smithi070.stderr: 25500K .......... .......... .......... .......... .......... 18% 5.16M 21s 2024-05-08T06:48:54.465 INFO:tasks.workunit.client.0.smithi070.stderr: 25550K .......... .......... .......... .......... .......... 18% 5.15M 21s 2024-05-08T06:48:54.475 INFO:tasks.workunit.client.0.smithi070.stderr: 25600K .......... .......... .......... .......... .......... 18% 4.77M 21s 2024-05-08T06:48:54.485 INFO:tasks.workunit.client.0.smithi070.stderr: 25650K .......... .......... .......... .......... .......... 18% 4.84M 21s 2024-05-08T06:48:54.495 INFO:tasks.workunit.client.0.smithi070.stderr: 25700K .......... .......... .......... .......... .......... 18% 4.47M 21s 2024-05-08T06:48:54.505 INFO:tasks.workunit.client.0.smithi070.stderr: 25750K .......... .......... .......... .......... .......... 19% 5.45M 21s 2024-05-08T06:48:54.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:54 smithi194 ceph-mon[33679]: pgmap v73: 129 pgs: 129 active+clean; 1.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:48:54.513 INFO:tasks.workunit.client.0.smithi070.stderr: 25800K .......... .......... .......... .......... .......... 19% 5.74M 21s 2024-05-08T06:48:54.522 INFO:tasks.workunit.client.0.smithi070.stderr: 25850K .......... .......... .......... .......... .......... 19% 5.59M 21s 2024-05-08T06:48:54.532 INFO:tasks.workunit.client.0.smithi070.stderr: 25900K .......... .......... .......... .......... .......... 19% 4.94M 21s 2024-05-08T06:48:54.541 INFO:tasks.workunit.client.0.smithi070.stderr: 25950K .......... .......... .......... .......... .......... 19% 5.40M 21s 2024-05-08T06:48:54.550 INFO:tasks.workunit.client.0.smithi070.stderr: 26000K .......... .......... .......... .......... .......... 19% 5.51M 21s 2024-05-08T06:48:54.558 INFO:tasks.workunit.client.0.smithi070.stderr: 26050K .......... .......... .......... .......... .......... 19% 5.52M 21s 2024-05-08T06:48:54.569 INFO:tasks.workunit.client.0.smithi070.stderr: 26100K .......... .......... .......... .......... .......... 19% 4.66M 21s 2024-05-08T06:48:54.578 INFO:tasks.workunit.client.0.smithi070.stderr: 26150K .......... .......... .......... .......... .......... 19% 5.46M 21s 2024-05-08T06:48:54.587 INFO:tasks.workunit.client.0.smithi070.stderr: 26200K .......... .......... .......... .......... .......... 19% 5.61M 21s 2024-05-08T06:48:54.596 INFO:tasks.workunit.client.0.smithi070.stderr: 26250K .......... .......... .......... .......... .......... 19% 5.13M 21s 2024-05-08T06:48:54.607 INFO:tasks.workunit.client.0.smithi070.stderr: 26300K .......... .......... .......... .......... .......... 19% 4.61M 21s 2024-05-08T06:48:54.616 INFO:tasks.workunit.client.0.smithi070.stderr: 26350K .......... .......... .......... .......... .......... 19% 5.51M 21s 2024-05-08T06:48:54.625 INFO:tasks.workunit.client.0.smithi070.stderr: 26400K .......... .......... .......... .......... .......... 19% 5.16M 21s 2024-05-08T06:48:54.634 INFO:tasks.workunit.client.0.smithi070.stderr: 26450K .......... .......... .......... .......... .......... 19% 5.33M 21s 2024-05-08T06:48:54.646 INFO:tasks.workunit.client.0.smithi070.stderr: 26500K .......... .......... .......... .......... .......... 19% 4.19M 21s 2024-05-08T06:48:54.655 INFO:tasks.workunit.client.0.smithi070.stderr: 26550K .......... .......... .......... .......... .......... 19% 5.15M 21s 2024-05-08T06:48:54.665 INFO:tasks.workunit.client.0.smithi070.stderr: 26600K .......... .......... .......... .......... .......... 19% 5.03M 21s 2024-05-08T06:48:54.674 INFO:tasks.workunit.client.0.smithi070.stderr: 26650K .......... .......... .......... .......... .......... 19% 5.17M 21s 2024-05-08T06:48:54.686 INFO:tasks.workunit.client.0.smithi070.stderr: 26700K .......... .......... .......... .......... .......... 19% 4.32M 21s 2024-05-08T06:48:54.695 INFO:tasks.workunit.client.0.smithi070.stderr: 26750K .......... .......... .......... .......... .......... 19% 5.16M 21s 2024-05-08T06:48:54.705 INFO:tasks.workunit.client.0.smithi070.stderr: 26800K .......... .......... .......... .......... .......... 19% 5.17M 21s 2024-05-08T06:48:54.714 INFO:tasks.workunit.client.0.smithi070.stderr: 26850K .......... .......... .......... .......... .......... 19% 5.33M 21s 2024-05-08T06:48:54.725 INFO:tasks.workunit.client.0.smithi070.stderr: 26900K .......... .......... .......... .......... .......... 19% 4.31M 21s 2024-05-08T06:48:54.735 INFO:tasks.workunit.client.0.smithi070.stderr: 26950K .......... .......... .......... .......... .......... 19% 4.87M 21s 2024-05-08T06:48:54.745 INFO:tasks.workunit.client.0.smithi070.stderr: 27000K .......... .......... .......... .......... .......... 19% 4.79M 21s 2024-05-08T06:48:54.756 INFO:tasks.workunit.client.0.smithi070.stderr: 27050K .......... .......... .......... .......... .......... 19% 4.82M 21s 2024-05-08T06:48:54.767 INFO:tasks.workunit.client.0.smithi070.stderr: 27100K .......... .......... .......... .......... .......... 19% 4.19M 21s 2024-05-08T06:48:54.778 INFO:tasks.workunit.client.0.smithi070.stderr: 27150K .......... .......... .......... .......... .......... 20% 4.65M 21s 2024-05-08T06:48:54.787 INFO:tasks.workunit.client.0.smithi070.stderr: 27200K .......... .......... .......... .......... .......... 20% 5.21M 21s 2024-05-08T06:48:54.797 INFO:tasks.workunit.client.0.smithi070.stderr: 27250K .......... .......... .......... .......... .......... 20% 4.86M 21s 2024-05-08T06:48:54.808 INFO:tasks.workunit.client.0.smithi070.stderr: 27300K .......... .......... .......... .......... .......... 20% 4.48M 21s 2024-05-08T06:48:54.818 INFO:tasks.workunit.client.0.smithi070.stderr: 27350K .......... .......... .......... .......... .......... 20% 4.89M 21s 2024-05-08T06:48:54.827 INFO:tasks.workunit.client.0.smithi070.stderr: 27400K .......... .......... .......... .......... .......... 20% 5.49M 21s 2024-05-08T06:48:54.836 INFO:tasks.workunit.client.0.smithi070.stderr: 27450K .......... .......... .......... .......... .......... 20% 5.52M 21s 2024-05-08T06:48:54.846 INFO:tasks.workunit.client.0.smithi070.stderr: 27500K .......... .......... .......... .......... .......... 20% 4.89M 21s 2024-05-08T06:48:54.854 INFO:tasks.workunit.client.0.smithi070.stderr: 27550K .......... .......... .......... .......... .......... 20% 5.57M 21s 2024-05-08T06:48:54.863 INFO:tasks.workunit.client.0.smithi070.stderr: 27600K .......... .......... .......... .......... .......... 20% 5.44M 21s 2024-05-08T06:48:54.872 INFO:tasks.workunit.client.0.smithi070.stderr: 27650K .......... .......... .......... .......... .......... 20% 5.64M 21s 2024-05-08T06:48:54.883 INFO:tasks.workunit.client.0.smithi070.stderr: 27700K .......... .......... .......... .......... .......... 20% 4.57M 21s 2024-05-08T06:48:54.893 INFO:tasks.workunit.client.0.smithi070.stderr: 27750K .......... .......... .......... .......... .......... 20% 4.72M 21s 2024-05-08T06:48:54.904 INFO:tasks.workunit.client.0.smithi070.stderr: 27800K .......... .......... .......... .......... .......... 20% 4.78M 21s 2024-05-08T06:48:54.914 INFO:tasks.workunit.client.0.smithi070.stderr: 27850K .......... .......... .......... .......... .......... 20% 4.53M 21s 2024-05-08T06:48:54.926 INFO:tasks.workunit.client.0.smithi070.stderr: 27900K .......... .......... .......... .......... .......... 20% 3.98M 21s 2024-05-08T06:48:54.936 INFO:tasks.workunit.client.0.smithi070.stderr: 27950K .......... .......... .......... .......... .......... 20% 5.02M 21s 2024-05-08T06:48:54.946 INFO:tasks.workunit.client.0.smithi070.stderr: 28000K .......... .......... .......... .......... .......... 20% 5.05M 21s 2024-05-08T06:48:54.958 INFO:tasks.workunit.client.0.smithi070.stderr: 28050K .......... .......... .......... .......... .......... 20% 5.23M 21s 2024-05-08T06:48:54.967 INFO:tasks.workunit.client.0.smithi070.stderr: 28100K .......... .......... .......... .......... .......... 20% 4.24M 21s 2024-05-08T06:48:54.976 INFO:tasks.workunit.client.0.smithi070.stderr: 28150K .......... .......... .......... .......... .......... 20% 5.30M 21s 2024-05-08T06:48:54.985 INFO:tasks.workunit.client.0.smithi070.stderr: 28200K .......... .......... .......... .......... .......... 20% 5.32M 21s 2024-05-08T06:48:54.996 INFO:tasks.workunit.client.0.smithi070.stderr: 28250K .......... .......... .......... .......... .......... 20% 4.44M 21s 2024-05-08T06:48:55.007 INFO:tasks.workunit.client.0.smithi070.stderr: 28300K .......... .......... .......... .......... .......... 20% 4.33M 21s 2024-05-08T06:48:55.018 INFO:tasks.workunit.client.0.smithi070.stderr: 28350K .......... .......... .......... .......... .......... 20% 4.65M 21s 2024-05-08T06:48:55.029 INFO:tasks.workunit.client.0.smithi070.stderr: 28400K .......... .......... .......... .......... .......... 20% 4.67M 21s 2024-05-08T06:48:55.038 INFO:tasks.workunit.client.0.smithi070.stderr: 28450K .......... .......... .......... .......... .......... 20% 4.86M 21s 2024-05-08T06:48:55.050 INFO:tasks.workunit.client.0.smithi070.stderr: 28500K .......... .......... .......... .......... .......... 21% 4.38M 21s 2024-05-08T06:48:55.060 INFO:tasks.workunit.client.0.smithi070.stderr: 28550K .......... .......... .......... .......... .......... 21% 4.57M 21s 2024-05-08T06:48:55.071 INFO:tasks.workunit.client.0.smithi070.stderr: 28600K .......... .......... .......... .......... .......... 21% 4.54M 21s 2024-05-08T06:48:55.081 INFO:tasks.workunit.client.0.smithi070.stderr: 28650K .......... .......... .......... .......... .......... 21% 4.90M 21s 2024-05-08T06:48:55.091 INFO:tasks.workunit.client.0.smithi070.stderr: 28700K .......... .......... .......... .......... .......... 21% 4.59M 21s 2024-05-08T06:48:55.100 INFO:tasks.workunit.client.0.smithi070.stderr: 28750K .......... .......... .......... .......... .......... 21% 5.89M 21s 2024-05-08T06:48:55.108 INFO:tasks.workunit.client.0.smithi070.stderr: 28800K .......... .......... .......... .......... .......... 21% 6.00M 21s 2024-05-08T06:48:55.116 INFO:tasks.workunit.client.0.smithi070.stderr: 28850K .......... .......... .......... .......... .......... 21% 5.86M 21s 2024-05-08T06:48:55.127 INFO:tasks.workunit.client.0.smithi070.stderr: 28900K .......... .......... .......... .......... .......... 21% 4.79M 21s 2024-05-08T06:48:55.137 INFO:tasks.workunit.client.0.smithi070.stderr: 28950K .......... .......... .......... .......... .......... 21% 4.71M 21s 2024-05-08T06:48:55.146 INFO:tasks.workunit.client.0.smithi070.stderr: 29000K .......... .......... .......... .......... .......... 21% 4.98M 21s 2024-05-08T06:48:55.154 INFO:tasks.workunit.client.0.smithi070.stderr: 29050K .......... .......... .......... .......... .......... 21% 6.49M 21s 2024-05-08T06:48:55.165 INFO:tasks.workunit.client.0.smithi070.stderr: 29100K .......... .......... .......... .......... .......... 21% 4.43M 21s 2024-05-08T06:48:55.173 INFO:tasks.workunit.client.0.smithi070.stderr: 29150K .......... .......... .......... .......... .......... 21% 5.77M 21s 2024-05-08T06:48:55.182 INFO:tasks.workunit.client.0.smithi070.stderr: 29200K .......... .......... .......... .......... .......... 21% 5.81M 21s 2024-05-08T06:48:55.189 INFO:tasks.workunit.client.0.smithi070.stderr: 29250K .......... .......... .......... .......... .......... 21% 6.41M 21s 2024-05-08T06:48:55.200 INFO:tasks.workunit.client.0.smithi070.stderr: 29300K .......... .......... .......... .......... .......... 21% 4.87M 21s 2024-05-08T06:48:55.208 INFO:tasks.workunit.client.0.smithi070.stderr: 29350K .......... .......... .......... .......... .......... 21% 5.95M 21s 2024-05-08T06:48:55.216 INFO:tasks.workunit.client.0.smithi070.stderr: 29400K .......... .......... .......... .......... .......... 21% 6.17M 21s 2024-05-08T06:48:55.225 INFO:tasks.workunit.client.0.smithi070.stderr: 29450K .......... .......... .......... .......... .......... 21% 5.69M 21s 2024-05-08T06:48:55.235 INFO:tasks.workunit.client.0.smithi070.stderr: 29500K .......... .......... .......... .......... .......... 21% 4.68M 21s 2024-05-08T06:48:55.243 INFO:tasks.workunit.client.0.smithi070.stderr: 29550K .......... .......... .......... .......... .......... 21% 6.00M 21s 2024-05-08T06:48:55.251 INFO:tasks.workunit.client.0.smithi070.stderr: 29600K .......... .......... .......... .......... .......... 21% 5.69M 21s 2024-05-08T06:48:55.260 INFO:tasks.workunit.client.0.smithi070.stderr: 29650K .......... .......... .......... .......... .......... 21% 5.62M 20s 2024-05-08T06:48:55.270 INFO:tasks.workunit.client.0.smithi070.stderr: 29700K .......... .......... .......... .......... .......... 21% 4.90M 20s 2024-05-08T06:48:55.279 INFO:tasks.workunit.client.0.smithi070.stderr: 29750K .......... .......... .......... .......... .......... 21% 5.68M 20s 2024-05-08T06:48:55.288 INFO:tasks.workunit.client.0.smithi070.stderr: 29800K .......... .......... .......... .......... .......... 21% 5.37M 20s 2024-05-08T06:48:55.296 INFO:tasks.workunit.client.0.smithi070.stderr: 29850K .......... .......... .......... .......... .......... 22% 5.88M 20s 2024-05-08T06:48:55.305 INFO:tasks.workunit.client.0.smithi070.stderr: 29900K .......... .......... .......... .......... .......... 22% 5.12M 20s 2024-05-08T06:48:55.314 INFO:tasks.workunit.client.0.smithi070.stderr: 29950K .......... .......... .......... .......... .......... 22% 5.84M 20s 2024-05-08T06:48:55.323 INFO:tasks.workunit.client.0.smithi070.stderr: 30000K .......... .......... .......... .......... .......... 22% 5.36M 20s 2024-05-08T06:48:55.332 INFO:tasks.workunit.client.0.smithi070.stderr: 30050K .......... .......... .......... .......... .......... 22% 5.64M 20s 2024-05-08T06:48:55.342 INFO:tasks.workunit.client.0.smithi070.stderr: 30100K .......... .......... .......... .......... .......... 22% 4.60M 20s 2024-05-08T06:48:55.351 INFO:tasks.workunit.client.0.smithi070.stderr: 30150K .......... .......... .......... .......... .......... 22% 5.49M 20s 2024-05-08T06:48:55.360 INFO:tasks.workunit.client.0.smithi070.stderr: 30200K .......... .......... .......... .......... .......... 22% 5.45M 20s 2024-05-08T06:48:55.369 INFO:tasks.workunit.client.0.smithi070.stderr: 30250K .......... .......... .......... .......... .......... 22% 5.74M 20s 2024-05-08T06:48:55.379 INFO:tasks.workunit.client.0.smithi070.stderr: 30300K .......... .......... .......... .......... .......... 22% 4.85M 20s 2024-05-08T06:48:55.387 INFO:tasks.workunit.client.0.smithi070.stderr: 30350K .......... .......... .......... .......... .......... 22% 5.56M 20s 2024-05-08T06:48:55.396 INFO:tasks.workunit.client.0.smithi070.stderr: 30400K .......... .......... .......... .......... .......... 22% 5.75M 20s 2024-05-08T06:48:55.404 INFO:tasks.workunit.client.0.smithi070.stderr: 30450K .......... .......... .......... .......... .......... 22% 6.12M 20s 2024-05-08T06:48:55.414 INFO:tasks.workunit.client.0.smithi070.stderr: 30500K .......... .......... .......... .......... .......... 22% 5.12M 20s 2024-05-08T06:48:55.422 INFO:tasks.workunit.client.0.smithi070.stderr: 30550K .......... .......... .......... .......... .......... 22% 5.38M 20s 2024-05-08T06:48:55.432 INFO:tasks.workunit.client.0.smithi070.stderr: 30600K .......... .......... .......... .......... .......... 22% 5.11M 20s 2024-05-08T06:48:55.441 INFO:tasks.workunit.client.0.smithi070.stderr: 30650K .......... .......... .......... .......... .......... 22% 5.33M 20s 2024-05-08T06:48:55.452 INFO:tasks.workunit.client.0.smithi070.stderr: 30700K .......... .......... .......... .......... .......... 22% 4.48M 20s 2024-05-08T06:48:55.461 INFO:tasks.workunit.client.0.smithi070.stderr: 30750K .......... .......... .......... .......... .......... 22% 5.44M 20s 2024-05-08T06:48:55.470 INFO:tasks.workunit.client.0.smithi070.stderr: 30800K .......... .......... .......... .......... .......... 22% 5.45M 20s 2024-05-08T06:48:55.480 INFO:tasks.workunit.client.0.smithi070.stderr: 30850K .......... .......... .......... .......... .......... 22% 5.19M 20s 2024-05-08T06:48:55.491 INFO:tasks.workunit.client.0.smithi070.stderr: 30900K .......... .......... .......... .......... .......... 22% 4.41M 20s 2024-05-08T06:48:55.501 INFO:tasks.workunit.client.0.smithi070.stderr: 30950K .......... .......... .......... .......... .......... 22% 4.97M 20s 2024-05-08T06:48:55.510 INFO:tasks.workunit.client.0.smithi070.stderr: 31000K .......... .......... .......... .......... .......... 22% 4.93M 20s 2024-05-08T06:48:55.520 INFO:tasks.workunit.client.0.smithi070.stderr: 31050K .......... .......... .......... .......... .......... 22% 5.13M 20s 2024-05-08T06:48:55.530 INFO:tasks.workunit.client.0.smithi070.stderr: 31100K .......... .......... .......... .......... .......... 22% 4.68M 20s 2024-05-08T06:48:55.540 INFO:tasks.workunit.client.0.smithi070.stderr: 31150K .......... .......... .......... .......... .......... 22% 5.22M 20s 2024-05-08T06:48:55.549 INFO:tasks.workunit.client.0.smithi070.stderr: 31200K .......... .......... .......... .......... .......... 23% 5.14M 20s 2024-05-08T06:48:55.558 INFO:tasks.workunit.client.0.smithi070.stderr: 31250K .......... .......... .......... .......... .......... 23% 5.48M 20s 2024-05-08T06:48:55.568 INFO:tasks.workunit.client.0.smithi070.stderr: 31300K .......... .......... .......... .......... .......... 23% 4.76M 20s 2024-05-08T06:48:55.577 INFO:tasks.workunit.client.0.smithi070.stderr: 31350K .......... .......... .......... .......... .......... 23% 5.46M 20s 2024-05-08T06:48:55.586 INFO:tasks.workunit.client.0.smithi070.stderr: 31400K .......... .......... .......... .......... .......... 23% 5.53M 20s 2024-05-08T06:48:55.596 INFO:tasks.workunit.client.0.smithi070.stderr: 31450K .......... .......... .......... .......... .......... 23% 5.09M 20s 2024-05-08T06:48:55.607 INFO:tasks.workunit.client.0.smithi070.stderr: 31500K .......... .......... .......... .......... .......... 23% 4.50M 20s 2024-05-08T06:48:55.615 INFO:tasks.workunit.client.0.smithi070.stderr: 31550K .......... .......... .......... .......... .......... 23% 5.65M 20s 2024-05-08T06:48:55.625 INFO:tasks.workunit.client.0.smithi070.stderr: 31600K .......... .......... .......... .......... .......... 23% 5.14M 20s 2024-05-08T06:48:55.635 INFO:tasks.workunit.client.0.smithi070.stderr: 31650K .......... .......... .......... .......... .......... 23% 4.84M 20s 2024-05-08T06:48:55.647 INFO:tasks.workunit.client.0.smithi070.stderr: 31700K .......... .......... .......... .......... .......... 23% 3.91M 20s 2024-05-08T06:48:55.655 INFO:tasks.workunit.client.0.smithi070.stderr: 31750K .......... .......... .......... .......... .......... 23% 6.19M 20s 2024-05-08T06:48:55.662 INFO:tasks.workunit.client.0.smithi070.stderr: 31800K .......... .......... .......... .......... .......... 23% 6.41M 20s 2024-05-08T06:48:55.669 INFO:tasks.workunit.client.0.smithi070.stderr: 31850K .......... .......... .......... .......... .......... 23% 7.50M 20s 2024-05-08T06:48:55.676 INFO:tasks.workunit.client.0.smithi070.stderr: 31900K .......... .......... .......... .......... .......... 23% 6.63M 20s 2024-05-08T06:48:55.683 INFO:tasks.workunit.client.0.smithi070.stderr: 31950K .......... .......... .......... .......... .......... 23% 7.64M 20s 2024-05-08T06:48:55.689 INFO:tasks.workunit.client.0.smithi070.stderr: 32000K .......... .......... .......... .......... .......... 23% 7.48M 20s 2024-05-08T06:48:55.695 INFO:tasks.workunit.client.0.smithi070.stderr: 32050K .......... .......... .......... .......... .......... 23% 8.47M 20s 2024-05-08T06:48:55.701 INFO:tasks.workunit.client.0.smithi070.stderr: 32100K .......... .......... .......... .......... .......... 23% 7.71M 20s 2024-05-08T06:48:55.709 INFO:tasks.workunit.client.0.smithi070.stderr: 32150K .......... .......... .......... .......... .......... 23% 6.56M 20s 2024-05-08T06:48:55.718 INFO:tasks.workunit.client.0.smithi070.stderr: 32200K .......... .......... .......... .......... .......... 23% 6.36M 20s 2024-05-08T06:48:55.724 INFO:tasks.workunit.client.0.smithi070.stderr: 32250K .......... .......... .......... .......... .......... 23% 6.32M 20s 2024-05-08T06:48:55.734 INFO:tasks.workunit.client.0.smithi070.stderr: 32300K .......... .......... .......... .......... .......... 23% 5.38M 20s 2024-05-08T06:48:55.741 INFO:tasks.workunit.client.0.smithi070.stderr: 32350K .......... .......... .......... .......... .......... 23% 6.35M 20s 2024-05-08T06:48:55.750 INFO:tasks.workunit.client.0.smithi070.stderr: 32400K .......... .......... .......... .......... .......... 23% 5.56M 20s 2024-05-08T06:48:55.760 INFO:tasks.workunit.client.0.smithi070.stderr: 32450K .......... .......... .......... .......... .......... 23% 4.93M 20s 2024-05-08T06:48:55.772 INFO:tasks.workunit.client.0.smithi070.stderr: 32500K .......... .......... .......... .......... .......... 23% 4.22M 20s 2024-05-08T06:48:55.781 INFO:tasks.workunit.client.0.smithi070.stderr: 32550K .......... .......... .......... .......... .......... 24% 5.04M 20s 2024-05-08T06:48:55.791 INFO:tasks.workunit.client.0.smithi070.stderr: 32600K .......... .......... .......... .......... .......... 24% 5.09M 20s 2024-05-08T06:48:55.800 INFO:tasks.workunit.client.0.smithi070.stderr: 32650K .......... .......... .......... .......... .......... 24% 5.22M 20s 2024-05-08T06:48:55.812 INFO:tasks.workunit.client.0.smithi070.stderr: 32700K .......... .......... .......... .......... .......... 24% 4.18M 20s 2024-05-08T06:48:55.823 INFO:tasks.workunit.client.0.smithi070.stderr: 32750K .......... .......... .......... .......... .......... 24% 4.53M 20s 2024-05-08T06:48:55.832 INFO:tasks.workunit.client.0.smithi070.stderr: 32800K .......... .......... .......... .......... .......... 24% 5.44M 20s 2024-05-08T06:48:55.842 INFO:tasks.workunit.client.0.smithi070.stderr: 32850K .......... .......... .......... .......... .......... 24% 5.31M 20s 2024-05-08T06:48:55.852 INFO:tasks.workunit.client.0.smithi070.stderr: 32900K .......... .......... .......... .......... .......... 24% 4.34M 20s 2024-05-08T06:48:55.861 INFO:tasks.workunit.client.0.smithi070.stderr: 32950K .......... .......... .......... .......... .......... 24% 5.57M 20s 2024-05-08T06:48:55.871 INFO:tasks.workunit.client.0.smithi070.stderr: 33000K .......... .......... .......... .......... .......... 24% 5.40M 20s 2024-05-08T06:48:55.879 INFO:tasks.workunit.client.0.smithi070.stderr: 33050K .......... .......... .......... .......... .......... 24% 5.25M 20s 2024-05-08T06:48:55.891 INFO:tasks.workunit.client.0.smithi070.stderr: 33100K .......... .......... .......... .......... .......... 24% 4.45M 20s 2024-05-08T06:48:55.901 INFO:tasks.workunit.client.0.smithi070.stderr: 33150K .......... .......... .......... .......... .......... 24% 4.70M 20s 2024-05-08T06:48:55.910 INFO:tasks.workunit.client.0.smithi070.stderr: 33200K .......... .......... .......... .......... .......... 24% 5.06M 20s 2024-05-08T06:48:55.919 INFO:tasks.workunit.client.0.smithi070.stderr: 33250K .......... .......... .......... .......... .......... 24% 5.55M 20s 2024-05-08T06:48:55.928 INFO:tasks.workunit.client.0.smithi070.stderr: 33300K .......... .......... .......... .......... .......... 24% 5.22M 20s 2024-05-08T06:48:55.937 INFO:tasks.workunit.client.0.smithi070.stderr: 33350K .......... .......... .......... .......... .......... 24% 5.70M 20s 2024-05-08T06:48:55.941 INFO:tasks.workunit.client.0.smithi070.stderr: 33400K .......... .......... .......... .......... .......... 24% 10.3M 20s 2024-05-08T06:48:55.947 INFO:tasks.workunit.client.0.smithi070.stderr: 33450K .......... .......... .......... .......... .......... 24% 8.87M 20s 2024-05-08T06:48:55.955 INFO:tasks.workunit.client.0.smithi070.stderr: 33500K .......... .......... .......... .......... .......... 24% 6.05M 20s 2024-05-08T06:48:55.962 INFO:tasks.workunit.client.0.smithi070.stderr: 33550K .......... .......... .......... .......... .......... 24% 7.02M 20s 2024-05-08T06:48:55.970 INFO:tasks.workunit.client.0.smithi070.stderr: 33600K .......... .......... .......... .......... .......... 24% 6.38M 20s 2024-05-08T06:48:55.978 INFO:tasks.workunit.client.0.smithi070.stderr: 33650K .......... .......... .......... .......... .......... 24% 6.08M 20s 2024-05-08T06:48:55.987 INFO:tasks.workunit.client.0.smithi070.stderr: 33700K .......... .......... .......... .......... .......... 24% 5.10M 20s 2024-05-08T06:48:55.996 INFO:tasks.workunit.client.0.smithi070.stderr: 33750K .......... .......... .......... .......... .......... 24% 5.36M 20s 2024-05-08T06:48:56.005 INFO:tasks.workunit.client.0.smithi070.stderr: 33800K .......... .......... .......... .......... .......... 24% 5.46M 20s 2024-05-08T06:48:56.015 INFO:tasks.workunit.client.0.smithi070.stderr: 33850K .......... .......... .......... .......... .......... 24% 5.42M 20s 2024-05-08T06:48:56.026 INFO:tasks.workunit.client.0.smithi070.stderr: 33900K .......... .......... .......... .......... .......... 25% 4.43M 20s 2024-05-08T06:48:56.034 INFO:tasks.workunit.client.0.smithi070.stderr: 33950K .......... .......... .......... .......... .......... 25% 5.66M 19s 2024-05-08T06:48:56.043 INFO:tasks.workunit.client.0.smithi070.stderr: 34000K .......... .......... .......... .......... .......... 25% 5.35M 19s 2024-05-08T06:48:56.052 INFO:tasks.workunit.client.0.smithi070.stderr: 34050K .......... .......... .......... .......... .......... 25% 5.45M 19s 2024-05-08T06:48:56.063 INFO:tasks.workunit.client.0.smithi070.stderr: 34100K .......... .......... .......... .......... .......... 25% 4.60M 19s 2024-05-08T06:48:56.072 INFO:tasks.workunit.client.0.smithi070.stderr: 34150K .......... .......... .......... .......... .......... 25% 5.28M 19s 2024-05-08T06:48:56.082 INFO:tasks.workunit.client.0.smithi070.stderr: 34200K .......... .......... .......... .......... .......... 25% 5.21M 19s 2024-05-08T06:48:56.090 INFO:tasks.workunit.client.0.smithi070.stderr: 34250K .......... .......... .......... .......... .......... 25% 5.39M 19s 2024-05-08T06:48:56.101 INFO:tasks.workunit.client.0.smithi070.stderr: 34300K .......... .......... .......... .......... .......... 25% 4.69M 19s 2024-05-08T06:48:56.110 INFO:tasks.workunit.client.0.smithi070.stderr: 34350K .......... .......... .......... .......... .......... 25% 5.25M 19s 2024-05-08T06:48:56.119 INFO:tasks.workunit.client.0.smithi070.stderr: 34400K .......... .......... .......... .......... .......... 25% 5.63M 19s 2024-05-08T06:48:56.128 INFO:tasks.workunit.client.0.smithi070.stderr: 34450K .......... .......... .......... .......... .......... 25% 5.30M 19s 2024-05-08T06:48:56.138 INFO:tasks.workunit.client.0.smithi070.stderr: 34500K .......... .......... .......... .......... .......... 25% 4.82M 19s 2024-05-08T06:48:56.147 INFO:tasks.workunit.client.0.smithi070.stderr: 34550K .......... .......... .......... .......... .......... 25% 5.72M 19s 2024-05-08T06:48:56.156 INFO:tasks.workunit.client.0.smithi070.stderr: 34600K .......... .......... .......... .......... .......... 25% 5.77M 19s 2024-05-08T06:48:56.165 INFO:tasks.workunit.client.0.smithi070.stderr: 34650K .......... .......... .......... .......... .......... 25% 5.27M 19s 2024-05-08T06:48:56.175 INFO:tasks.workunit.client.0.smithi070.stderr: 34700K .......... .......... .......... .......... .......... 25% 4.82M 19s 2024-05-08T06:48:56.186 INFO:tasks.workunit.client.0.smithi070.stderr: 34750K .......... .......... .......... .......... .......... 25% 5.23M 19s 2024-05-08T06:48:56.194 INFO:tasks.workunit.client.0.smithi070.stderr: 34800K .......... .......... .......... .......... .......... 25% 4.92M 19s 2024-05-08T06:48:56.204 INFO:tasks.workunit.client.0.smithi070.stderr: 34850K .......... .......... .......... .......... .......... 25% 5.04M 19s 2024-05-08T06:48:56.215 INFO:tasks.workunit.client.0.smithi070.stderr: 34900K .......... .......... .......... .......... .......... 25% 4.37M 19s 2024-05-08T06:48:56.224 INFO:tasks.workunit.client.0.smithi070.stderr: 34950K .......... .......... .......... .......... .......... 25% 5.20M 19s 2024-05-08T06:48:56.234 INFO:tasks.workunit.client.0.smithi070.stderr: 35000K .......... .......... .......... .......... .......... 25% 5.32M 19s 2024-05-08T06:48:56.242 INFO:tasks.workunit.client.0.smithi070.stderr: 35050K .......... .......... .......... .......... .......... 25% 5.56M 19s 2024-05-08T06:48:56.252 INFO:tasks.workunit.client.0.smithi070.stderr: 35100K .......... .......... .......... .......... .......... 25% 4.91M 19s 2024-05-08T06:48:56.261 INFO:tasks.workunit.client.0.smithi070.stderr: 35150K .......... .......... .......... .......... .......... 25% 5.74M 19s 2024-05-08T06:48:56.270 INFO:tasks.workunit.client.0.smithi070.stderr: 35200K .......... .......... .......... .......... .......... 25% 5.38M 19s 2024-05-08T06:48:56.279 INFO:tasks.workunit.client.0.smithi070.stderr: 35250K .......... .......... .......... .......... .......... 26% 5.25M 19s 2024-05-08T06:48:56.290 INFO:tasks.workunit.client.0.smithi070.stderr: 35300K .......... .......... .......... .......... .......... 26% 4.37M 19s 2024-05-08T06:48:56.299 INFO:tasks.workunit.client.0.smithi070.stderr: 35350K .......... .......... .......... .......... .......... 26% 5.55M 19s 2024-05-08T06:48:56.308 INFO:tasks.workunit.client.0.smithi070.stderr: 35400K .......... .......... .......... .......... .......... 26% 5.34M 19s 2024-05-08T06:48:56.317 INFO:tasks.workunit.client.0.smithi070.stderr: 35450K .......... .......... .......... .......... .......... 26% 5.71M 19s 2024-05-08T06:48:56.327 INFO:tasks.workunit.client.0.smithi070.stderr: 35500K .......... .......... .......... .......... .......... 26% 4.93M 19s 2024-05-08T06:48:56.335 INFO:tasks.workunit.client.0.smithi070.stderr: 35550K .......... .......... .......... .......... .......... 26% 5.85M 19s 2024-05-08T06:48:56.343 INFO:tasks.workunit.client.0.smithi070.stderr: 35600K .......... .......... .......... .......... .......... 26% 5.71M 19s 2024-05-08T06:48:56.353 INFO:tasks.workunit.client.0.smithi070.stderr: 35650K .......... .......... .......... .......... .......... 26% 5.28M 19s 2024-05-08T06:48:56.362 INFO:tasks.workunit.client.0.smithi070.stderr: 35700K .......... .......... .......... .......... .......... 26% 4.93M 19s 2024-05-08T06:48:56.371 INFO:tasks.workunit.client.0.smithi070.stderr: 35750K .......... .......... .......... .......... .......... 26% 6.01M 19s 2024-05-08T06:48:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:56 smithi070 ceph-mon[29591]: pgmap v74: 129 pgs: 129 active+clean; 17 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-05-08T06:48:56.379 INFO:tasks.workunit.client.0.smithi070.stderr: 35800K .......... .......... .......... .......... .......... 26% 5.99M 19s 2024-05-08T06:48:56.386 INFO:tasks.workunit.client.0.smithi070.stderr: 35850K .......... .......... .......... .......... .......... 26% 6.77M 19s 2024-05-08T06:48:56.394 INFO:tasks.workunit.client.0.smithi070.stderr: 35900K .......... .......... .......... .......... .......... 26% 5.61M 19s 2024-05-08T06:48:56.401 INFO:tasks.workunit.client.0.smithi070.stderr: 35950K .......... .......... .......... .......... .......... 26% 6.86M 19s 2024-05-08T06:48:56.408 INFO:tasks.workunit.client.0.smithi070.stderr: 36000K .......... .......... .......... .......... .......... 26% 7.27M 19s 2024-05-08T06:48:56.416 INFO:tasks.workunit.client.0.smithi070.stderr: 36050K .......... .......... .......... .......... .......... 26% 6.88M 19s 2024-05-08T06:48:56.425 INFO:tasks.workunit.client.0.smithi070.stderr: 36100K .......... .......... .......... .......... .......... 26% 5.32M 19s 2024-05-08T06:48:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:56 smithi172 ceph-mon[33377]: pgmap v74: 129 pgs: 129 active+clean; 17 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-05-08T06:48:56.431 INFO:tasks.workunit.client.0.smithi070.stderr: 36150K .......... .......... .......... .......... .......... 26% 7.39M 19s 2024-05-08T06:48:56.436 INFO:tasks.workunit.client.0.smithi070.stderr: 36200K .......... .......... .......... .......... .......... 26% 8.76M 19s 2024-05-08T06:48:56.443 INFO:tasks.workunit.client.0.smithi070.stderr: 36250K .......... .......... .......... .......... .......... 26% 7.81M 19s 2024-05-08T06:48:56.453 INFO:tasks.workunit.client.0.smithi070.stderr: 36300K .......... .......... .......... .......... .......... 26% 4.84M 19s 2024-05-08T06:48:56.459 INFO:tasks.workunit.client.0.smithi070.stderr: 36350K .......... .......... .......... .......... .......... 26% 7.99M 19s 2024-05-08T06:48:56.466 INFO:tasks.workunit.client.0.smithi070.stderr: 36400K .......... .......... .......... .......... .......... 26% 7.32M 19s 2024-05-08T06:48:56.475 INFO:tasks.workunit.client.0.smithi070.stderr: 36450K .......... .......... .......... .......... .......... 26% 5.83M 19s 2024-05-08T06:48:56.485 INFO:tasks.workunit.client.0.smithi070.stderr: 36500K .......... .......... .......... .......... .......... 26% 4.68M 19s 2024-05-08T06:48:56.494 INFO:tasks.workunit.client.0.smithi070.stderr: 36550K .......... .......... .......... .......... .......... 26% 5.54M 19s 2024-05-08T06:48:56.502 INFO:tasks.workunit.client.0.smithi070.stderr: 36600K .......... .......... .......... .......... .......... 26% 5.52M 19s 2024-05-08T06:48:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:56 smithi194 ceph-mon[33679]: pgmap v74: 129 pgs: 129 active+clean; 17 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 1.3 MiB/s wr, 8 op/s 2024-05-08T06:48:56.511 INFO:tasks.workunit.client.0.smithi070.stderr: 36650K .......... .......... .......... .......... .......... 27% 5.72M 19s 2024-05-08T06:48:56.520 INFO:tasks.workunit.client.0.smithi070.stderr: 36700K .......... .......... .......... .......... .......... 27% 5.23M 19s 2024-05-08T06:48:56.528 INFO:tasks.workunit.client.0.smithi070.stderr: 36750K .......... .......... .......... .......... .......... 27% 6.05M 19s 2024-05-08T06:48:56.537 INFO:tasks.workunit.client.0.smithi070.stderr: 36800K .......... .......... .......... .......... .......... 27% 5.95M 19s 2024-05-08T06:48:56.546 INFO:tasks.workunit.client.0.smithi070.stderr: 36850K .......... .......... .......... .......... .......... 27% 5.50M 19s 2024-05-08T06:48:56.554 INFO:tasks.workunit.client.0.smithi070.stderr: 36900K .......... .......... .......... .......... .......... 27% 5.30M 19s 2024-05-08T06:48:56.562 INFO:tasks.workunit.client.0.smithi070.stderr: 36950K .......... .......... .......... .......... .......... 27% 6.43M 19s 2024-05-08T06:48:56.572 INFO:tasks.workunit.client.0.smithi070.stderr: 37000K .......... .......... .......... .......... .......... 27% 6.11M 19s 2024-05-08T06:48:56.579 INFO:tasks.workunit.client.0.smithi070.stderr: 37050K .......... .......... .......... .......... .......... 27% 5.37M 19s 2024-05-08T06:48:56.588 INFO:tasks.workunit.client.0.smithi070.stderr: 37100K .......... .......... .......... .......... .......... 27% 5.83M 19s 2024-05-08T06:48:56.592 INFO:tasks.workunit.client.0.smithi070.stderr: 37150K .......... .......... .......... .......... .......... 27% 9.73M 19s 2024-05-08T06:48:56.596 INFO:tasks.workunit.client.0.smithi070.stderr: 37200K .......... .......... .......... .......... .......... 27% 11.4M 19s 2024-05-08T06:48:56.601 INFO:tasks.workunit.client.0.smithi070.stderr: 37250K .......... .......... .......... .......... .......... 27% 10.3M 19s 2024-05-08T06:48:56.605 INFO:tasks.workunit.client.0.smithi070.stderr: 37300K .......... .......... .......... .......... .......... 27% 11.8M 19s 2024-05-08T06:48:56.611 INFO:tasks.workunit.client.0.smithi070.stderr: 37350K .......... .......... .......... .......... .......... 27% 9.51M 19s 2024-05-08T06:48:56.615 INFO:tasks.workunit.client.0.smithi070.stderr: 37400K .......... .......... .......... .......... .......... 27% 9.48M 19s 2024-05-08T06:48:56.621 INFO:tasks.workunit.client.0.smithi070.stderr: 37450K .......... .......... .......... .......... .......... 27% 8.82M 19s 2024-05-08T06:48:56.628 INFO:tasks.workunit.client.0.smithi070.stderr: 37500K .......... .......... .......... .......... .......... 27% 7.34M 19s 2024-05-08T06:48:56.635 INFO:tasks.workunit.client.0.smithi070.stderr: 37550K .......... .......... .......... .......... .......... 27% 7.06M 19s 2024-05-08T06:48:56.641 INFO:tasks.workunit.client.0.smithi070.stderr: 37600K .......... .......... .......... .......... .......... 27% 7.82M 19s 2024-05-08T06:48:56.648 INFO:tasks.workunit.client.0.smithi070.stderr: 37650K .......... .......... .......... .......... .......... 27% 7.25M 19s 2024-05-08T06:48:56.655 INFO:tasks.workunit.client.0.smithi070.stderr: 37700K .......... .......... .......... .......... .......... 27% 6.80M 19s 2024-05-08T06:48:56.663 INFO:tasks.workunit.client.0.smithi070.stderr: 37750K .......... .......... .......... .......... .......... 27% 6.49M 19s 2024-05-08T06:48:56.670 INFO:tasks.workunit.client.0.smithi070.stderr: 37800K .......... .......... .......... .......... .......... 27% 6.55M 18s 2024-05-08T06:48:56.678 INFO:tasks.workunit.client.0.smithi070.stderr: 37850K .......... .......... .......... .......... .......... 27% 6.06M 18s 2024-05-08T06:48:56.688 INFO:tasks.workunit.client.0.smithi070.stderr: 37900K .......... .......... .......... .......... .......... 27% 5.28M 18s 2024-05-08T06:48:56.696 INFO:tasks.workunit.client.0.smithi070.stderr: 37950K .......... .......... .......... .......... .......... 27% 6.33M 18s 2024-05-08T06:48:56.704 INFO:tasks.workunit.client.0.smithi070.stderr: 38000K .......... .......... .......... .......... .......... 28% 5.67M 18s 2024-05-08T06:48:56.712 INFO:tasks.workunit.client.0.smithi070.stderr: 38050K .......... .......... .......... .......... .......... 28% 6.12M 18s 2024-05-08T06:48:56.720 INFO:tasks.workunit.client.0.smithi070.stderr: 38100K .......... .......... .......... .......... .......... 28% 5.90M 18s 2024-05-08T06:48:56.729 INFO:tasks.workunit.client.0.smithi070.stderr: 38150K .......... .......... .......... .......... .......... 28% 5.98M 18s 2024-05-08T06:48:56.736 INFO:tasks.workunit.client.0.smithi070.stderr: 38200K .......... .......... .......... .......... .......... 28% 6.09M 18s 2024-05-08T06:48:56.744 INFO:tasks.workunit.client.0.smithi070.stderr: 38250K .......... .......... .......... .......... .......... 28% 6.72M 18s 2024-05-08T06:48:56.753 INFO:tasks.workunit.client.0.smithi070.stderr: 38300K .......... .......... .......... .......... .......... 28% 5.58M 18s 2024-05-08T06:48:56.761 INFO:tasks.workunit.client.0.smithi070.stderr: 38350K .......... .......... .......... .......... .......... 28% 5.94M 18s 2024-05-08T06:48:56.769 INFO:tasks.workunit.client.0.smithi070.stderr: 38400K .......... .......... .......... .......... .......... 28% 6.27M 18s 2024-05-08T06:48:56.775 INFO:tasks.workunit.client.0.smithi070.stderr: 38450K .......... .......... .......... .......... .......... 28% 7.11M 18s 2024-05-08T06:48:56.784 INFO:tasks.workunit.client.0.smithi070.stderr: 38500K .......... .......... .......... .......... .......... 28% 5.65M 18s 2024-05-08T06:48:56.791 INFO:tasks.workunit.client.0.smithi070.stderr: 38550K .......... .......... .......... .......... .......... 28% 7.11M 18s 2024-05-08T06:48:56.798 INFO:tasks.workunit.client.0.smithi070.stderr: 38600K .......... .......... .......... .......... .......... 28% 6.97M 18s 2024-05-08T06:48:56.806 INFO:tasks.workunit.client.0.smithi070.stderr: 38650K .......... .......... .......... .......... .......... 28% 6.32M 18s 2024-05-08T06:48:56.814 INFO:tasks.workunit.client.0.smithi070.stderr: 38700K .......... .......... .......... .......... .......... 28% 5.32M 18s 2024-05-08T06:48:56.822 INFO:tasks.workunit.client.0.smithi070.stderr: 38750K .......... .......... .......... .......... .......... 28% 6.83M 18s 2024-05-08T06:48:56.830 INFO:tasks.workunit.client.0.smithi070.stderr: 38800K .......... .......... .......... .......... .......... 28% 6.34M 18s 2024-05-08T06:48:56.837 INFO:tasks.workunit.client.0.smithi070.stderr: 38850K .......... .......... .......... .......... .......... 28% 6.17M 18s 2024-05-08T06:48:56.846 INFO:tasks.workunit.client.0.smithi070.stderr: 38900K .......... .......... .......... .......... .......... 28% 5.67M 18s 2024-05-08T06:48:56.854 INFO:tasks.workunit.client.0.smithi070.stderr: 38950K .......... .......... .......... .......... .......... 28% 6.35M 18s 2024-05-08T06:48:56.861 INFO:tasks.workunit.client.0.smithi070.stderr: 39000K .......... .......... .......... .......... .......... 28% 7.05M 18s 2024-05-08T06:48:56.868 INFO:tasks.workunit.client.0.smithi070.stderr: 39050K .......... .......... .......... .......... .......... 28% 6.44M 18s 2024-05-08T06:48:56.877 INFO:tasks.workunit.client.0.smithi070.stderr: 39100K .......... .......... .......... .......... .......... 28% 5.78M 18s 2024-05-08T06:48:56.884 INFO:tasks.workunit.client.0.smithi070.stderr: 39150K .......... .......... .......... .......... .......... 28% 6.35M 18s 2024-05-08T06:48:56.892 INFO:tasks.workunit.client.0.smithi070.stderr: 39200K .......... .......... .......... .......... .......... 28% 6.81M 18s 2024-05-08T06:48:56.899 INFO:tasks.workunit.client.0.smithi070.stderr: 39250K .......... .......... .......... .......... .......... 28% 6.69M 18s 2024-05-08T06:48:56.908 INFO:tasks.workunit.client.0.smithi070.stderr: 39300K .......... .......... .......... .......... .......... 28% 5.43M 18s 2024-05-08T06:48:56.916 INFO:tasks.workunit.client.0.smithi070.stderr: 39350K .......... .......... .......... .......... .......... 29% 5.98M 18s 2024-05-08T06:48:56.923 INFO:tasks.workunit.client.0.smithi070.stderr: 39400K .......... .......... .......... .......... .......... 29% 6.41M 18s 2024-05-08T06:48:56.930 INFO:tasks.workunit.client.0.smithi070.stderr: 39450K .......... .......... .......... .......... .......... 29% 6.78M 18s 2024-05-08T06:48:56.938 INFO:tasks.workunit.client.0.smithi070.stderr: 39500K .......... .......... .......... .......... .......... 29% 6.63M 18s 2024-05-08T06:48:56.945 INFO:tasks.workunit.client.0.smithi070.stderr: 39550K .......... .......... .......... .......... .......... 29% 6.79M 18s 2024-05-08T06:48:56.952 INFO:tasks.workunit.client.0.smithi070.stderr: 39600K .......... .......... .......... .......... .......... 29% 7.86M 18s 2024-05-08T06:48:56.958 INFO:tasks.workunit.client.0.smithi070.stderr: 39650K .......... .......... .......... .......... .......... 29% 7.23M 18s 2024-05-08T06:48:56.966 INFO:tasks.workunit.client.0.smithi070.stderr: 39700K .......... .......... .......... .......... .......... 29% 6.06M 18s 2024-05-08T06:48:56.974 INFO:tasks.workunit.client.0.smithi070.stderr: 39750K .......... .......... .......... .......... .......... 29% 7.01M 18s 2024-05-08T06:48:56.981 INFO:tasks.workunit.client.0.smithi070.stderr: 39800K .......... .......... .......... .......... .......... 29% 6.44M 18s 2024-05-08T06:48:56.989 INFO:tasks.workunit.client.0.smithi070.stderr: 39850K .......... .......... .......... .......... .......... 29% 6.17M 18s 2024-05-08T06:48:57.002 INFO:tasks.workunit.client.0.smithi070.stderr: 39900K .......... .......... .......... .......... .......... 29% 4.44M 18s 2024-05-08T06:48:57.008 INFO:tasks.workunit.client.0.smithi070.stderr: 39950K .......... .......... .......... .......... .......... 29% 5.70M 18s 2024-05-08T06:48:57.016 INFO:tasks.workunit.client.0.smithi070.stderr: 40000K .......... .......... .......... .......... .......... 29% 6.46M 18s 2024-05-08T06:48:57.025 INFO:tasks.workunit.client.0.smithi070.stderr: 40050K .......... .......... .......... .......... .......... 29% 5.79M 18s 2024-05-08T06:48:57.035 INFO:tasks.workunit.client.0.smithi070.stderr: 40100K .......... .......... .......... .......... .......... 29% 4.63M 18s 2024-05-08T06:48:57.044 INFO:tasks.workunit.client.0.smithi070.stderr: 40150K .......... .......... .......... .......... .......... 29% 5.43M 18s 2024-05-08T06:48:57.054 INFO:tasks.workunit.client.0.smithi070.stderr: 40200K .......... .......... .......... .......... .......... 29% 5.08M 18s 2024-05-08T06:48:57.063 INFO:tasks.workunit.client.0.smithi070.stderr: 40250K .......... .......... .......... .......... .......... 29% 5.61M 18s 2024-05-08T06:48:57.075 INFO:tasks.workunit.client.0.smithi070.stderr: 40300K .......... .......... .......... .......... .......... 29% 4.11M 18s 2024-05-08T06:48:57.083 INFO:tasks.workunit.client.0.smithi070.stderr: 40350K .......... .......... .......... .......... .......... 29% 5.53M 18s 2024-05-08T06:48:57.091 INFO:tasks.workunit.client.0.smithi070.stderr: 40400K .......... .......... .......... .......... .......... 29% 6.67M 18s 2024-05-08T06:48:57.099 INFO:tasks.workunit.client.0.smithi070.stderr: 40450K .......... .......... .......... .......... .......... 29% 6.04M 18s 2024-05-08T06:48:57.109 INFO:tasks.workunit.client.0.smithi070.stderr: 40500K .......... .......... .......... .......... .......... 29% 4.95M 18s 2024-05-08T06:48:57.117 INFO:tasks.workunit.client.0.smithi070.stderr: 40550K .......... .......... .......... .......... .......... 29% 5.48M 18s 2024-05-08T06:48:57.128 INFO:tasks.workunit.client.0.smithi070.stderr: 40600K .......... .......... .......... .......... .......... 29% 5.11M 18s 2024-05-08T06:48:57.133 INFO:tasks.workunit.client.0.smithi070.stderr: 40650K .......... .......... .......... .......... .......... 29% 6.91M 18s 2024-05-08T06:48:57.142 INFO:tasks.workunit.client.0.smithi070.stderr: 40700K .......... .......... .......... .......... .......... 30% 5.90M 18s 2024-05-08T06:48:57.150 INFO:tasks.workunit.client.0.smithi070.stderr: 40750K .......... .......... .......... .......... .......... 30% 6.51M 18s 2024-05-08T06:48:57.157 INFO:tasks.workunit.client.0.smithi070.stderr: 40800K .......... .......... .......... .......... .......... 30% 6.60M 18s 2024-05-08T06:48:57.163 INFO:tasks.workunit.client.0.smithi070.stderr: 40850K .......... .......... .......... .......... .......... 30% 7.63M 18s 2024-05-08T06:48:57.171 INFO:tasks.workunit.client.0.smithi070.stderr: 40900K .......... .......... .......... .......... .......... 30% 6.53M 18s 2024-05-08T06:48:57.178 INFO:tasks.workunit.client.0.smithi070.stderr: 40950K .......... .......... .......... .......... .......... 30% 7.16M 18s 2024-05-08T06:48:57.184 INFO:tasks.workunit.client.0.smithi070.stderr: 41000K .......... .......... .......... .......... .......... 30% 7.48M 18s 2024-05-08T06:48:57.191 INFO:tasks.workunit.client.0.smithi070.stderr: 41050K .......... .......... .......... .......... .......... 30% 6.82M 18s 2024-05-08T06:48:57.200 INFO:tasks.workunit.client.0.smithi070.stderr: 41100K .......... .......... .......... .......... .......... 30% 5.82M 18s 2024-05-08T06:48:57.211 INFO:tasks.workunit.client.0.smithi070.stderr: 41150K .......... .......... .......... .......... .......... 30% 6.66M 18s 2024-05-08T06:48:57.215 INFO:tasks.workunit.client.0.smithi070.stderr: 41200K .......... .......... .......... .......... .......... 30% 6.62M 18s 2024-05-08T06:48:57.224 INFO:tasks.workunit.client.0.smithi070.stderr: 41250K .......... .......... .......... .......... .......... 30% 5.70M 18s 2024-05-08T06:48:57.234 INFO:tasks.workunit.client.0.smithi070.stderr: 41300K .......... .......... .......... .......... .......... 30% 4.93M 18s 2024-05-08T06:48:57.241 INFO:tasks.workunit.client.0.smithi070.stderr: 41350K .......... .......... .......... .......... .......... 30% 6.58M 18s 2024-05-08T06:48:57.246 INFO:tasks.workunit.client.0.smithi070.stderr: 41400K .......... .......... .......... .......... .......... 30% 8.21M 18s 2024-05-08T06:48:57.252 INFO:tasks.workunit.client.0.smithi070.stderr: 41450K .......... .......... .......... .......... .......... 30% 8.50M 18s 2024-05-08T06:48:57.260 INFO:tasks.workunit.client.0.smithi070.stderr: 41500K .......... .......... .......... .......... .......... 30% 6.20M 18s 2024-05-08T06:48:57.267 INFO:tasks.workunit.client.0.smithi070.stderr: 41550K .......... .......... .......... .......... .......... 30% 6.89M 18s 2024-05-08T06:48:57.274 INFO:tasks.workunit.client.0.smithi070.stderr: 41600K .......... .......... .......... .......... .......... 30% 6.73M 18s 2024-05-08T06:48:57.282 INFO:tasks.workunit.client.0.smithi070.stderr: 41650K .......... .......... .......... .......... .......... 30% 6.39M 18s 2024-05-08T06:48:57.290 INFO:tasks.workunit.client.0.smithi070.stderr: 41700K .......... .......... .......... .......... .......... 30% 6.10M 17s 2024-05-08T06:48:57.296 INFO:tasks.workunit.client.0.smithi070.stderr: 41750K .......... .......... .......... .......... .......... 30% 8.15M 17s 2024-05-08T06:48:57.302 INFO:tasks.workunit.client.0.smithi070.stderr: 41800K .......... .......... .......... .......... .......... 30% 7.82M 17s 2024-05-08T06:48:57.310 INFO:tasks.workunit.client.0.smithi070.stderr: 41850K .......... .......... .......... .......... .......... 30% 6.69M 17s 2024-05-08T06:48:57.318 INFO:tasks.workunit.client.0.smithi070.stderr: 41900K .......... .......... .......... .......... .......... 30% 5.77M 17s 2024-05-08T06:48:57.326 INFO:tasks.workunit.client.0.smithi070.stderr: 41950K .......... .......... .......... .......... .......... 30% 6.38M 17s 2024-05-08T06:48:57.334 INFO:tasks.workunit.client.0.smithi070.stderr: 42000K .......... .......... .......... .......... .......... 30% 6.31M 17s 2024-05-08T06:48:57.341 INFO:tasks.workunit.client.0.smithi070.stderr: 42050K .......... .......... .......... .......... .......... 31% 6.51M 17s 2024-05-08T06:48:57.350 INFO:tasks.workunit.client.0.smithi070.stderr: 42100K .......... .......... .......... .......... .......... 31% 5.48M 17s 2024-05-08T06:48:57.358 INFO:tasks.workunit.client.0.smithi070.stderr: 42150K .......... .......... .......... .......... .......... 31% 6.08M 17s 2024-05-08T06:48:57.365 INFO:tasks.workunit.client.0.smithi070.stderr: 42200K .......... .......... .......... .......... .......... 31% 6.42M 17s 2024-05-08T06:48:57.372 INFO:tasks.workunit.client.0.smithi070.stderr: 42250K .......... .......... .......... .......... .......... 31% 7.08M 17s 2024-05-08T06:48:57.381 INFO:tasks.workunit.client.0.smithi070.stderr: 42300K .......... .......... .......... .......... .......... 31% 5.35M 17s 2024-05-08T06:48:57.388 INFO:tasks.workunit.client.0.smithi070.stderr: 42350K .......... .......... .......... .......... .......... 31% 7.58M 17s 2024-05-08T06:48:57.394 INFO:tasks.workunit.client.0.smithi070.stderr: 42400K .......... .......... .......... .......... .......... 31% 7.45M 17s 2024-05-08T06:48:57.401 INFO:tasks.workunit.client.0.smithi070.stderr: 42450K .......... .......... .......... .......... .......... 31% 7.39M 17s 2024-05-08T06:48:57.414 INFO:tasks.workunit.client.0.smithi070.stderr: 42500K .......... .......... .......... .......... .......... 31% 5.11M 17s 2024-05-08T06:48:57.420 INFO:tasks.workunit.client.0.smithi070.stderr: 42550K .......... .......... .......... .......... .......... 31% 5.27M 17s 2024-05-08T06:48:57.429 INFO:tasks.workunit.client.0.smithi070.stderr: 42600K .......... .......... .......... .......... .......... 31% 5.55M 17s 2024-05-08T06:48:57.437 INFO:tasks.workunit.client.0.smithi070.stderr: 42650K .......... .......... .......... .......... .......... 31% 6.14M 17s 2024-05-08T06:48:57.446 INFO:tasks.workunit.client.0.smithi070.stderr: 42700K .......... .......... .......... .......... .......... 31% 4.89M 17s 2024-05-08T06:48:57.454 INFO:tasks.workunit.client.0.smithi070.stderr: 42750K .......... .......... .......... .......... .......... 31% 6.87M 17s 2024-05-08T06:48:57.462 INFO:tasks.workunit.client.0.smithi070.stderr: 42800K .......... .......... .......... .......... .......... 31% 6.25M 17s 2024-05-08T06:48:57.469 INFO:tasks.workunit.client.0.smithi070.stderr: 42850K .......... .......... .......... .......... .......... 31% 6.41M 17s 2024-05-08T06:48:57.478 INFO:tasks.workunit.client.0.smithi070.stderr: 42900K .......... .......... .......... .......... .......... 31% 5.51M 17s 2024-05-08T06:48:57.487 INFO:tasks.workunit.client.0.smithi070.stderr: 42950K .......... .......... .......... .......... .......... 31% 5.82M 17s 2024-05-08T06:48:57.495 INFO:tasks.workunit.client.0.smithi070.stderr: 43000K .......... .......... .......... .......... .......... 31% 5.84M 17s 2024-05-08T06:48:57.501 INFO:tasks.workunit.client.0.smithi070.stderr: 43050K .......... .......... .......... .......... .......... 31% 7.54M 17s 2024-05-08T06:48:57.506 INFO:tasks.workunit.client.0.smithi070.stderr: 43100K .......... .......... .......... .......... .......... 31% 9.74M 17s 2024-05-08T06:48:57.511 INFO:tasks.workunit.client.0.smithi070.stderr: 43150K .......... .......... .......... .......... .......... 31% 9.00M 17s 2024-05-08T06:48:57.517 INFO:tasks.workunit.client.0.smithi070.stderr: 43200K .......... .......... .......... .......... .......... 31% 8.80M 17s 2024-05-08T06:48:57.521 INFO:tasks.workunit.client.0.smithi070.stderr: 43250K .......... .......... .......... .......... .......... 31% 12.9M 17s 2024-05-08T06:48:57.527 INFO:tasks.workunit.client.0.smithi070.stderr: 43300K .......... .......... .......... .......... .......... 31% 7.70M 17s 2024-05-08T06:48:57.533 INFO:tasks.workunit.client.0.smithi070.stderr: 43350K .......... .......... .......... .......... .......... 31% 8.52M 17s 2024-05-08T06:48:57.539 INFO:tasks.workunit.client.0.smithi070.stderr: 43400K .......... .......... .......... .......... .......... 32% 8.38M 17s 2024-05-08T06:48:57.545 INFO:tasks.workunit.client.0.smithi070.stderr: 43450K .......... .......... .......... .......... .......... 32% 8.24M 17s 2024-05-08T06:48:57.550 INFO:tasks.workunit.client.0.smithi070.stderr: 43500K .......... .......... .......... .......... .......... 32% 8.38M 17s 2024-05-08T06:48:57.555 INFO:tasks.workunit.client.0.smithi070.stderr: 43550K .......... .......... .......... .......... .......... 32% 9.74M 17s 2024-05-08T06:48:57.561 INFO:tasks.workunit.client.0.smithi070.stderr: 43600K .......... .......... .......... .......... .......... 32% 8.34M 17s 2024-05-08T06:48:57.567 INFO:tasks.workunit.client.0.smithi070.stderr: 43650K .......... .......... .......... .......... .......... 32% 9.02M 17s 2024-05-08T06:48:57.573 INFO:tasks.workunit.client.0.smithi070.stderr: 43700K .......... .......... .......... .......... .......... 32% 7.94M 17s 2024-05-08T06:48:57.579 INFO:tasks.workunit.client.0.smithi070.stderr: 43750K .......... .......... .......... .......... .......... 32% 8.03M 17s 2024-05-08T06:48:57.587 INFO:tasks.workunit.client.0.smithi070.stderr: 43800K .......... .......... .......... .......... .......... 32% 6.32M 17s 2024-05-08T06:48:57.595 INFO:tasks.workunit.client.0.smithi070.stderr: 43850K .......... .......... .......... .......... .......... 32% 6.15M 17s 2024-05-08T06:48:57.604 INFO:tasks.workunit.client.0.smithi070.stderr: 43900K .......... .......... .......... .......... .......... 32% 5.37M 17s 2024-05-08T06:48:57.612 INFO:tasks.workunit.client.0.smithi070.stderr: 43950K .......... .......... .......... .......... .......... 32% 6.05M 17s 2024-05-08T06:48:57.620 INFO:tasks.workunit.client.0.smithi070.stderr: 44000K .......... .......... .......... .......... .......... 32% 6.01M 17s 2024-05-08T06:48:57.629 INFO:tasks.workunit.client.0.smithi070.stderr: 44050K .......... .......... .......... .......... .......... 32% 5.80M 17s 2024-05-08T06:48:57.639 INFO:tasks.workunit.client.0.smithi070.stderr: 44100K .......... .......... .......... .......... .......... 32% 4.58M 17s 2024-05-08T06:48:57.649 INFO:tasks.workunit.client.0.smithi070.stderr: 44150K .......... .......... .......... .......... .......... 32% 5.38M 17s 2024-05-08T06:48:57.657 INFO:tasks.workunit.client.0.smithi070.stderr: 44200K .......... .......... .......... .......... .......... 32% 5.69M 17s 2024-05-08T06:48:57.666 INFO:tasks.workunit.client.0.smithi070.stderr: 44250K .......... .......... .......... .......... .......... 32% 5.82M 17s 2024-05-08T06:48:57.676 INFO:tasks.workunit.client.0.smithi070.stderr: 44300K .......... .......... .......... .......... .......... 32% 4.47M 17s 2024-05-08T06:48:57.686 INFO:tasks.workunit.client.0.smithi070.stderr: 44350K .......... .......... .......... .......... .......... 32% 5.42M 17s 2024-05-08T06:48:57.695 INFO:tasks.workunit.client.0.smithi070.stderr: 44400K .......... .......... .......... .......... .......... 32% 5.48M 17s 2024-05-08T06:48:57.704 INFO:tasks.workunit.client.0.smithi070.stderr: 44450K .......... .......... .......... .......... .......... 32% 5.20M 17s 2024-05-08T06:48:57.714 INFO:tasks.workunit.client.0.smithi070.stderr: 44500K .......... .......... .......... .......... .......... 32% 4.57M 17s 2024-05-08T06:48:57.724 INFO:tasks.workunit.client.0.smithi070.stderr: 44550K .......... .......... .......... .......... .......... 32% 5.32M 17s 2024-05-08T06:48:57.733 INFO:tasks.workunit.client.0.smithi070.stderr: 44600K .......... .......... .......... .......... .......... 32% 5.33M 17s 2024-05-08T06:48:57.741 INFO:tasks.workunit.client.0.smithi070.stderr: 44650K .......... .......... .......... .......... .......... 32% 5.58M 17s 2024-05-08T06:48:57.752 INFO:tasks.workunit.client.0.smithi070.stderr: 44700K .......... .......... .......... .......... .......... 32% 4.44M 17s 2024-05-08T06:48:57.761 INFO:tasks.workunit.client.0.smithi070.stderr: 44750K .......... .......... .......... .......... .......... 33% 5.47M 17s 2024-05-08T06:48:57.771 INFO:tasks.workunit.client.0.smithi070.stderr: 44800K .......... .......... .......... .......... .......... 33% 4.97M 17s 2024-05-08T06:48:57.781 INFO:tasks.workunit.client.0.smithi070.stderr: 44850K .......... .......... .......... .......... .......... 33% 5.24M 17s 2024-05-08T06:48:57.791 INFO:tasks.workunit.client.0.smithi070.stderr: 44900K .......... .......... .......... .......... .......... 33% 4.58M 17s 2024-05-08T06:48:57.800 INFO:tasks.workunit.client.0.smithi070.stderr: 44950K .......... .......... .......... .......... .......... 33% 5.30M 17s 2024-05-08T06:48:57.810 INFO:tasks.workunit.client.0.smithi070.stderr: 45000K .......... .......... .......... .......... .......... 33% 5.11M 17s 2024-05-08T06:48:57.822 INFO:tasks.workunit.client.0.smithi070.stderr: 45050K .......... .......... .......... .......... .......... 33% 5.53M 17s 2024-05-08T06:48:57.831 INFO:tasks.workunit.client.0.smithi070.stderr: 45100K .......... .......... .......... .......... .......... 33% 4.11M 17s 2024-05-08T06:48:57.838 INFO:tasks.workunit.client.0.smithi070.stderr: 45150K .......... .......... .......... .......... .......... 33% 6.13M 17s 2024-05-08T06:48:57.845 INFO:tasks.workunit.client.0.smithi070.stderr: 45200K .......... .......... .......... .......... .......... 33% 7.02M 17s 2024-05-08T06:48:57.855 INFO:tasks.workunit.client.0.smithi070.stderr: 45250K .......... .......... .......... .......... .......... 33% 5.46M 17s 2024-05-08T06:48:57.863 INFO:tasks.workunit.client.0.smithi070.stderr: 45300K .......... .......... .......... .......... .......... 33% 6.12M 17s 2024-05-08T06:48:57.870 INFO:tasks.workunit.client.0.smithi070.stderr: 45350K .......... .......... .......... .......... .......... 33% 6.26M 17s 2024-05-08T06:48:57.878 INFO:tasks.workunit.client.0.smithi070.stderr: 45400K .......... .......... .......... .......... .......... 33% 5.98M 17s 2024-05-08T06:48:57.884 INFO:tasks.workunit.client.0.smithi070.stderr: 45450K .......... .......... .......... .......... .......... 33% 8.53M 17s 2024-05-08T06:48:57.891 INFO:tasks.workunit.client.0.smithi070.stderr: 45500K .......... .......... .......... .......... .......... 33% 6.75M 17s 2024-05-08T06:48:57.897 INFO:tasks.workunit.client.0.smithi070.stderr: 45550K .......... .......... .......... .......... .......... 33% 8.03M 17s 2024-05-08T06:48:57.903 INFO:tasks.workunit.client.0.smithi070.stderr: 45600K .......... .......... .......... .......... .......... 33% 8.22M 17s 2024-05-08T06:48:57.909 INFO:tasks.workunit.client.0.smithi070.stderr: 45650K .......... .......... .......... .......... .......... 33% 8.01M 17s 2024-05-08T06:48:57.917 INFO:tasks.workunit.client.0.smithi070.stderr: 45700K .......... .......... .......... .......... .......... 33% 6.83M 17s 2024-05-08T06:48:57.924 INFO:tasks.workunit.client.0.smithi070.stderr: 45750K .......... .......... .......... .......... .......... 33% 6.23M 17s 2024-05-08T06:48:57.931 INFO:tasks.workunit.client.0.smithi070.stderr: 45800K .......... .......... .......... .......... .......... 33% 7.24M 16s 2024-05-08T06:48:57.937 INFO:tasks.workunit.client.0.smithi070.stderr: 45850K .......... .......... .......... .......... .......... 33% 7.93M 16s 2024-05-08T06:48:57.944 INFO:tasks.workunit.client.0.smithi070.stderr: 45900K .......... .......... .......... .......... .......... 33% 7.28M 16s 2024-05-08T06:48:57.949 INFO:tasks.workunit.client.0.smithi070.stderr: 45950K .......... .......... .......... .......... .......... 33% 9.33M 16s 2024-05-08T06:48:57.954 INFO:tasks.workunit.client.0.smithi070.stderr: 46000K .......... .......... .......... .......... .......... 33% 8.97M 16s 2024-05-08T06:48:57.960 INFO:tasks.workunit.client.0.smithi070.stderr: 46050K .......... .......... .......... .......... .......... 33% 8.54M 16s 2024-05-08T06:48:57.967 INFO:tasks.workunit.client.0.smithi070.stderr: 46100K .......... .......... .......... .......... .......... 33% 7.33M 16s 2024-05-08T06:48:57.973 INFO:tasks.workunit.client.0.smithi070.stderr: 46150K .......... .......... .......... .......... .......... 34% 8.25M 16s 2024-05-08T06:48:57.979 INFO:tasks.workunit.client.0.smithi070.stderr: 46200K .......... .......... .......... .......... .......... 34% 7.55M 16s 2024-05-08T06:48:57.985 INFO:tasks.workunit.client.0.smithi070.stderr: 46250K .......... .......... .......... .......... .......... 34% 7.88M 16s 2024-05-08T06:48:57.993 INFO:tasks.workunit.client.0.smithi070.stderr: 46300K .......... .......... .......... .......... .......... 34% 6.97M 16s 2024-05-08T06:48:57.999 INFO:tasks.workunit.client.0.smithi070.stderr: 46350K .......... .......... .......... .......... .......... 34% 7.18M 16s 2024-05-08T06:48:58.006 INFO:tasks.workunit.client.0.smithi070.stderr: 46400K .......... .......... .......... .......... .......... 34% 7.15M 16s 2024-05-08T06:48:58.014 INFO:tasks.workunit.client.0.smithi070.stderr: 46450K .......... .......... .......... .......... .......... 34% 6.13M 16s 2024-05-08T06:48:58.024 INFO:tasks.workunit.client.0.smithi070.stderr: 46500K .......... .......... .......... .......... .......... 34% 5.05M 16s 2024-05-08T06:48:58.033 INFO:tasks.workunit.client.0.smithi070.stderr: 46550K .......... .......... .......... .......... .......... 34% 5.65M 16s 2024-05-08T06:48:58.040 INFO:tasks.workunit.client.0.smithi070.stderr: 46600K .......... .......... .......... .......... .......... 34% 6.25M 16s 2024-05-08T06:48:58.047 INFO:tasks.workunit.client.0.smithi070.stderr: 46650K .......... .......... .......... .......... .......... 34% 7.02M 16s 2024-05-08T06:48:58.056 INFO:tasks.workunit.client.0.smithi070.stderr: 46700K .......... .......... .......... .......... .......... 34% 5.72M 16s 2024-05-08T06:48:58.062 INFO:tasks.workunit.client.0.smithi070.stderr: 46750K .......... .......... .......... .......... .......... 34% 7.84M 16s 2024-05-08T06:48:58.070 INFO:tasks.workunit.client.0.smithi070.stderr: 46800K .......... .......... .......... .......... .......... 34% 6.02M 16s 2024-05-08T06:48:58.078 INFO:tasks.workunit.client.0.smithi070.stderr: 46850K .......... .......... .......... .......... .......... 34% 6.14M 16s 2024-05-08T06:48:58.087 INFO:tasks.workunit.client.0.smithi070.stderr: 46900K .......... .......... .......... .......... .......... 34% 5.25M 16s 2024-05-08T06:48:58.095 INFO:tasks.workunit.client.0.smithi070.stderr: 46950K .......... .......... .......... .......... .......... 34% 6.14M 16s 2024-05-08T06:48:58.104 INFO:tasks.workunit.client.0.smithi070.stderr: 47000K .......... .......... .......... .......... .......... 34% 5.62M 16s 2024-05-08T06:48:58.112 INFO:tasks.workunit.client.0.smithi070.stderr: 47050K .......... .......... .......... .......... .......... 34% 6.09M 16s 2024-05-08T06:48:58.122 INFO:tasks.workunit.client.0.smithi070.stderr: 47100K .......... .......... .......... .......... .......... 34% 4.79M 16s 2024-05-08T06:48:58.132 INFO:tasks.workunit.client.0.smithi070.stderr: 47150K .......... .......... .......... .......... .......... 34% 5.28M 16s 2024-05-08T06:48:58.140 INFO:tasks.workunit.client.0.smithi070.stderr: 47200K .......... .......... .......... .......... .......... 34% 5.59M 16s 2024-05-08T06:48:58.148 INFO:tasks.workunit.client.0.smithi070.stderr: 47250K .......... .......... .......... .......... .......... 34% 6.57M 16s 2024-05-08T06:48:58.157 INFO:tasks.workunit.client.0.smithi070.stderr: 47300K .......... .......... .......... .......... .......... 34% 5.25M 16s 2024-05-08T06:48:58.164 INFO:tasks.workunit.client.0.smithi070.stderr: 47350K .......... .......... .......... .......... .......... 34% 6.54M 16s 2024-05-08T06:48:58.170 INFO:tasks.workunit.client.0.smithi070.stderr: 47400K .......... .......... .......... .......... .......... 34% 8.12M 16s 2024-05-08T06:48:58.176 INFO:tasks.workunit.client.0.smithi070.stderr: 47450K .......... .......... .......... .......... .......... 34% 7.88M 16s 2024-05-08T06:48:58.182 INFO:tasks.workunit.client.0.smithi070.stderr: 47500K .......... .......... .......... .......... .......... 35% 7.80M 16s 2024-05-08T06:48:58.189 INFO:tasks.workunit.client.0.smithi070.stderr: 47550K .......... .......... .......... .......... .......... 35% 8.24M 16s 2024-05-08T06:48:58.196 INFO:tasks.workunit.client.0.smithi070.stderr: 47600K .......... .......... .......... .......... .......... 35% 6.69M 16s 2024-05-08T06:48:58.203 INFO:tasks.workunit.client.0.smithi070.stderr: 47650K .......... .......... .......... .......... .......... 35% 7.37M 16s 2024-05-08T06:48:58.211 INFO:tasks.workunit.client.0.smithi070.stderr: 47700K .......... .......... .......... .......... .......... 35% 5.86M 16s 2024-05-08T06:48:58.219 INFO:tasks.workunit.client.0.smithi070.stderr: 47750K .......... .......... .......... .......... .......... 35% 6.30M 16s 2024-05-08T06:48:58.230 INFO:tasks.workunit.client.0.smithi070.stderr: 47800K .......... .......... .......... .......... .......... 35% 5.44M 16s 2024-05-08T06:48:58.237 INFO:tasks.workunit.client.0.smithi070.stderr: 47850K .......... .......... .......... .......... .......... 35% 5.57M 16s 2024-05-08T06:48:58.247 INFO:tasks.workunit.client.0.smithi070.stderr: 47900K .......... .......... .......... .......... .......... 35% 4.97M 16s 2024-05-08T06:48:58.255 INFO:tasks.workunit.client.0.smithi070.stderr: 47950K .......... .......... .......... .......... .......... 35% 5.57M 16s 2024-05-08T06:48:58.264 INFO:tasks.workunit.client.0.smithi070.stderr: 48000K .......... .......... .......... .......... .......... 35% 5.65M 16s 2024-05-08T06:48:58.273 INFO:tasks.workunit.client.0.smithi070.stderr: 48050K .......... .......... .......... .......... .......... 35% 5.53M 16s 2024-05-08T06:48:58.283 INFO:tasks.workunit.client.0.smithi070.stderr: 48100K .......... .......... .......... .......... .......... 35% 4.71M 16s 2024-05-08T06:48:58.292 INFO:tasks.workunit.client.0.smithi070.stderr: 48150K .......... .......... .......... .......... .......... 35% 5.37M 16s 2024-05-08T06:48:58.302 INFO:tasks.workunit.client.0.smithi070.stderr: 48200K .......... .......... .......... .......... .......... 35% 5.19M 16s 2024-05-08T06:48:58.313 INFO:tasks.workunit.client.0.smithi070.stderr: 48250K .......... .......... .......... .......... .......... 35% 4.41M 16s 2024-05-08T06:48:58.326 INFO:tasks.workunit.client.0.smithi070.stderr: 48300K .......... .......... .......... .......... .......... 35% 3.87M 16s 2024-05-08T06:48:58.336 INFO:tasks.workunit.client.0.smithi070.stderr: 48350K .......... .......... .......... .......... .......... 35% 4.52M 16s 2024-05-08T06:48:58.346 INFO:tasks.workunit.client.0.smithi070.stderr: 48400K .......... .......... .......... .......... .......... 35% 4.91M 16s 2024-05-08T06:48:58.357 INFO:tasks.workunit.client.0.smithi070.stderr: 48450K .......... .......... .......... .......... .......... 35% 4.71M 16s 2024-05-08T06:48:58.368 INFO:tasks.workunit.client.0.smithi070.stderr: 48500K .......... .......... .......... .......... .......... 35% 4.41M 16s 2024-05-08T06:48:58.377 INFO:tasks.workunit.client.0.smithi070.stderr: 48550K .......... .......... .......... .......... .......... 35% 5.08M 16s 2024-05-08T06:48:58.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:48:58 smithi070 ceph-mon[29591]: pgmap v75: 129 pgs: 129 active+clean; 17 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-05-08T06:48:58.385 INFO:tasks.workunit.client.0.smithi070.stderr: 48600K .......... .......... .......... .......... .......... 35% 6.15M 16s 2024-05-08T06:48:58.393 INFO:tasks.workunit.client.0.smithi070.stderr: 48650K .......... .......... .......... .......... .......... 35% 6.22M 16s 2024-05-08T06:48:58.404 INFO:tasks.workunit.client.0.smithi070.stderr: 48700K .......... .......... .......... .......... .......... 35% 4.57M 16s 2024-05-08T06:48:58.412 INFO:tasks.workunit.client.0.smithi070.stderr: 48750K .......... .......... .......... .......... .......... 35% 5.65M 16s 2024-05-08T06:48:58.420 INFO:tasks.workunit.client.0.smithi070.stderr: 48800K .......... .......... .......... .......... .......... 35% 6.23M 16s 2024-05-08T06:48:58.428 INFO:tasks.workunit.client.0.smithi070.stderr: 48850K .......... .......... .......... .......... .......... 36% 5.87M 16s 2024-05-08T06:48:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:48:58 smithi172 ceph-mon[33377]: pgmap v75: 129 pgs: 129 active+clean; 17 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-05-08T06:48:58.439 INFO:tasks.workunit.client.0.smithi070.stderr: 48900K .......... .......... .......... .......... .......... 36% 5.45M 16s 2024-05-08T06:48:58.444 INFO:tasks.workunit.client.0.smithi070.stderr: 48950K .......... .......... .......... .......... .......... 36% 6.75M 16s 2024-05-08T06:48:58.453 INFO:tasks.workunit.client.0.smithi070.stderr: 49000K .......... .......... .......... .......... .......... 36% 6.26M 16s 2024-05-08T06:48:58.463 INFO:tasks.workunit.client.0.smithi070.stderr: 49050K .......... .......... .......... .......... .......... 36% 4.85M 16s 2024-05-08T06:48:58.475 INFO:tasks.workunit.client.0.smithi070.stderr: 49100K .......... .......... .......... .......... .......... 36% 4.06M 16s 2024-05-08T06:48:58.486 INFO:tasks.workunit.client.0.smithi070.stderr: 49150K .......... .......... .......... .......... .......... 36% 4.46M 16s 2024-05-08T06:48:58.495 INFO:tasks.workunit.client.0.smithi070.stderr: 49200K .......... .......... .......... .......... .......... 36% 5.22M 16s 2024-05-08T06:48:58.506 INFO:tasks.workunit.client.0.smithi070.stderr: 49250K .......... .......... .......... .......... .......... 36% 4.53M 16s 2024-05-08T06:48:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:48:58 smithi194 ceph-mon[33679]: pgmap v75: 129 pgs: 129 active+clean; 17 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 1.3 MiB/s wr, 6 op/s 2024-05-08T06:48:58.516 INFO:tasks.workunit.client.0.smithi070.stderr: 49300K .......... .......... .......... .......... .......... 36% 4.80M 16s 2024-05-08T06:48:58.524 INFO:tasks.workunit.client.0.smithi070.stderr: 49350K .......... .......... .......... .......... .......... 36% 6.11M 16s 2024-05-08T06:48:58.532 INFO:tasks.workunit.client.0.smithi070.stderr: 49400K .......... .......... .......... .......... .......... 36% 5.77M 16s 2024-05-08T06:48:58.540 INFO:tasks.workunit.client.0.smithi070.stderr: 49450K .......... .......... .......... .......... .......... 36% 6.48M 16s 2024-05-08T06:48:58.550 INFO:tasks.workunit.client.0.smithi070.stderr: 49500K .......... .......... .......... .......... .......... 36% 4.93M 16s 2024-05-08T06:48:58.558 INFO:tasks.workunit.client.0.smithi070.stderr: 49550K .......... .......... .......... .......... .......... 36% 5.58M 16s 2024-05-08T06:48:58.566 INFO:tasks.workunit.client.0.smithi070.stderr: 49600K .......... .......... .......... .......... .......... 36% 6.91M 16s 2024-05-08T06:48:58.574 INFO:tasks.workunit.client.0.smithi070.stderr: 49650K .......... .......... .......... .......... .......... 36% 5.64M 16s 2024-05-08T06:48:58.584 INFO:tasks.workunit.client.0.smithi070.stderr: 49700K .......... .......... .......... .......... .......... 36% 4.83M 16s 2024-05-08T06:48:58.593 INFO:tasks.workunit.client.0.smithi070.stderr: 49750K .......... .......... .......... .......... .......... 36% 5.68M 16s 2024-05-08T06:48:58.601 INFO:tasks.workunit.client.0.smithi070.stderr: 49800K .......... .......... .......... .......... .......... 36% 5.67M 16s 2024-05-08T06:48:58.610 INFO:tasks.workunit.client.0.smithi070.stderr: 49850K .......... .......... .......... .......... .......... 36% 5.59M 16s 2024-05-08T06:48:58.620 INFO:tasks.workunit.client.0.smithi070.stderr: 49900K .......... .......... .......... .......... .......... 36% 5.17M 16s 2024-05-08T06:48:58.629 INFO:tasks.workunit.client.0.smithi070.stderr: 49950K .......... .......... .......... .......... .......... 36% 5.59M 16s 2024-05-08T06:48:58.638 INFO:tasks.workunit.client.0.smithi070.stderr: 50000K .......... .......... .......... .......... .......... 36% 5.28M 16s 2024-05-08T06:48:58.646 INFO:tasks.workunit.client.0.smithi070.stderr: 50050K .......... .......... .......... .......... .......... 36% 6.00M 16s 2024-05-08T06:48:58.655 INFO:tasks.workunit.client.0.smithi070.stderr: 50100K .......... .......... .......... .......... .......... 36% 5.43M 16s 2024-05-08T06:48:58.662 INFO:tasks.workunit.client.0.smithi070.stderr: 50150K .......... .......... .......... .......... .......... 36% 6.34M 16s 2024-05-08T06:48:58.671 INFO:tasks.workunit.client.0.smithi070.stderr: 50200K .......... .......... .......... .......... .......... 37% 5.82M 16s 2024-05-08T06:48:58.679 INFO:tasks.workunit.client.0.smithi070.stderr: 50250K .......... .......... .......... .......... .......... 37% 6.15M 16s 2024-05-08T06:48:58.690 INFO:tasks.workunit.client.0.smithi070.stderr: 50300K .......... .......... .......... .......... .......... 37% 4.43M 16s 2024-05-08T06:48:58.700 INFO:tasks.workunit.client.0.smithi070.stderr: 50350K .......... .......... .......... .......... .......... 37% 4.72M 16s 2024-05-08T06:48:58.710 INFO:tasks.workunit.client.0.smithi070.stderr: 50400K .......... .......... .......... .......... .......... 37% 4.95M 16s 2024-05-08T06:48:58.720 INFO:tasks.workunit.client.0.smithi070.stderr: 50450K .......... .......... .......... .......... .......... 37% 5.01M 16s 2024-05-08T06:48:58.730 INFO:tasks.workunit.client.0.smithi070.stderr: 50500K .......... .......... .......... .......... .......... 37% 4.60M 16s 2024-05-08T06:48:58.739 INFO:tasks.workunit.client.0.smithi070.stderr: 50550K .......... .......... .......... .......... .......... 37% 5.54M 16s 2024-05-08T06:48:58.748 INFO:tasks.workunit.client.0.smithi070.stderr: 50600K .......... .......... .......... .......... .......... 37% 5.32M 16s 2024-05-08T06:48:58.757 INFO:tasks.workunit.client.0.smithi070.stderr: 50650K .......... .......... .......... .......... .......... 37% 5.38M 15s 2024-05-08T06:48:58.768 INFO:tasks.workunit.client.0.smithi070.stderr: 50700K .......... .......... .......... .......... .......... 37% 4.76M 15s 2024-05-08T06:48:58.777 INFO:tasks.workunit.client.0.smithi070.stderr: 50750K .......... .......... .......... .......... .......... 37% 5.36M 15s 2024-05-08T06:48:58.786 INFO:tasks.workunit.client.0.smithi070.stderr: 50800K .......... .......... .......... .......... .......... 37% 5.52M 15s 2024-05-08T06:48:58.795 INFO:tasks.workunit.client.0.smithi070.stderr: 50850K .......... .......... .......... .......... .......... 37% 5.61M 15s 2024-05-08T06:48:58.804 INFO:tasks.workunit.client.0.smithi070.stderr: 50900K .......... .......... .......... .......... .......... 37% 4.89M 15s 2024-05-08T06:48:58.814 INFO:tasks.workunit.client.0.smithi070.stderr: 50950K .......... .......... .......... .......... .......... 37% 5.39M 15s 2024-05-08T06:48:58.822 INFO:tasks.workunit.client.0.smithi070.stderr: 51000K .......... .......... .......... .......... .......... 37% 5.45M 15s 2024-05-08T06:48:58.832 INFO:tasks.workunit.client.0.smithi070.stderr: 51050K .......... .......... .......... .......... .......... 37% 5.42M 15s 2024-05-08T06:48:58.842 INFO:tasks.workunit.client.0.smithi070.stderr: 51100K .......... .......... .......... .......... .......... 37% 4.95M 15s 2024-05-08T06:48:58.851 INFO:tasks.workunit.client.0.smithi070.stderr: 51150K .......... .......... .......... .......... .......... 37% 6.08M 15s 2024-05-08T06:48:58.858 INFO:tasks.workunit.client.0.smithi070.stderr: 51200K .......... .......... .......... .......... .......... 37% 5.60M 15s 2024-05-08T06:48:58.865 INFO:tasks.workunit.client.0.smithi070.stderr: 51250K .......... .......... .......... .......... .......... 37% 6.56M 15s 2024-05-08T06:48:58.875 INFO:tasks.workunit.client.0.smithi070.stderr: 51300K .......... .......... .......... .......... .......... 37% 5.07M 15s 2024-05-08T06:48:58.884 INFO:tasks.workunit.client.0.smithi070.stderr: 51350K .......... .......... .......... .......... .......... 37% 5.76M 15s 2024-05-08T06:48:58.892 INFO:tasks.workunit.client.0.smithi070.stderr: 51400K .......... .......... .......... .......... .......... 37% 5.76M 15s 2024-05-08T06:48:58.901 INFO:tasks.workunit.client.0.smithi070.stderr: 51450K .......... .......... .......... .......... .......... 37% 5.50M 15s 2024-05-08T06:48:58.911 INFO:tasks.workunit.client.0.smithi070.stderr: 51500K .......... .......... .......... .......... .......... 37% 4.74M 15s 2024-05-08T06:48:58.920 INFO:tasks.workunit.client.0.smithi070.stderr: 51550K .......... .......... .......... .......... .......... 38% 5.70M 15s 2024-05-08T06:48:58.928 INFO:tasks.workunit.client.0.smithi070.stderr: 51600K .......... .......... .......... .......... .......... 38% 5.68M 15s 2024-05-08T06:48:58.937 INFO:tasks.workunit.client.0.smithi070.stderr: 51650K .......... .......... .......... .......... .......... 38% 6.06M 15s 2024-05-08T06:48:58.946 INFO:tasks.workunit.client.0.smithi070.stderr: 51700K .......... .......... .......... .......... .......... 38% 5.32M 15s 2024-05-08T06:48:58.954 INFO:tasks.workunit.client.0.smithi070.stderr: 51750K .......... .......... .......... .......... .......... 38% 5.73M 15s 2024-05-08T06:48:58.963 INFO:tasks.workunit.client.0.smithi070.stderr: 51800K .......... .......... .......... .......... .......... 38% 5.82M 15s 2024-05-08T06:48:58.972 INFO:tasks.workunit.client.0.smithi070.stderr: 51850K .......... .......... .......... .......... .......... 38% 5.41M 15s 2024-05-08T06:48:58.984 INFO:tasks.workunit.client.0.smithi070.stderr: 51900K .......... .......... .......... .......... .......... 38% 4.21M 15s 2024-05-08T06:48:58.993 INFO:tasks.workunit.client.0.smithi070.stderr: 51950K .......... .......... .......... .......... .......... 38% 4.99M 15s 2024-05-08T06:48:59.003 INFO:tasks.workunit.client.0.smithi070.stderr: 52000K .......... .......... .......... .......... .......... 38% 5.04M 15s 2024-05-08T06:48:59.012 INFO:tasks.workunit.client.0.smithi070.stderr: 52050K .......... .......... .......... .......... .......... 38% 5.37M 15s 2024-05-08T06:48:59.023 INFO:tasks.workunit.client.0.smithi070.stderr: 52100K .......... .......... .......... .......... .......... 38% 4.51M 15s 2024-05-08T06:48:59.033 INFO:tasks.workunit.client.0.smithi070.stderr: 52150K .......... .......... .......... .......... .......... 38% 4.68M 15s 2024-05-08T06:48:59.043 INFO:tasks.workunit.client.0.smithi070.stderr: 52200K .......... .......... .......... .......... .......... 38% 4.79M 15s 2024-05-08T06:48:59.055 INFO:tasks.workunit.client.0.smithi070.stderr: 52250K .......... .......... .......... .......... .......... 38% 4.96M 15s 2024-05-08T06:48:59.063 INFO:tasks.workunit.client.0.smithi070.stderr: 52300K .......... .......... .......... .......... .......... 38% 4.75M 15s 2024-05-08T06:48:59.070 INFO:tasks.workunit.client.0.smithi070.stderr: 52350K .......... .......... .......... .......... .......... 38% 7.78M 15s 2024-05-08T06:48:59.078 INFO:tasks.workunit.client.0.smithi070.stderr: 52400K .......... .......... .......... .......... .......... 38% 5.72M 15s 2024-05-08T06:48:59.084 INFO:tasks.workunit.client.0.smithi070.stderr: 52450K .......... .......... .......... .......... .......... 38% 7.77M 15s 2024-05-08T06:48:59.092 INFO:tasks.workunit.client.0.smithi070.stderr: 52500K .......... .......... .......... .......... .......... 38% 6.25M 15s 2024-05-08T06:48:59.099 INFO:tasks.workunit.client.0.smithi070.stderr: 52550K .......... .......... .......... .......... .......... 38% 7.31M 15s 2024-05-08T06:48:59.105 INFO:tasks.workunit.client.0.smithi070.stderr: 52600K .......... .......... .......... .......... .......... 38% 7.62M 15s 2024-05-08T06:48:59.111 INFO:tasks.workunit.client.0.smithi070.stderr: 52650K .......... .......... .......... .......... .......... 38% 7.79M 15s 2024-05-08T06:48:59.120 INFO:tasks.workunit.client.0.smithi070.stderr: 52700K .......... .......... .......... .......... .......... 38% 5.66M 15s 2024-05-08T06:48:59.126 INFO:tasks.workunit.client.0.smithi070.stderr: 52750K .......... .......... .......... .......... .......... 38% 8.14M 15s 2024-05-08T06:48:59.132 INFO:tasks.workunit.client.0.smithi070.stderr: 52800K .......... .......... .......... .......... .......... 38% 8.19M 15s 2024-05-08T06:48:59.138 INFO:tasks.workunit.client.0.smithi070.stderr: 52850K .......... .......... .......... .......... .......... 38% 8.23M 15s 2024-05-08T06:48:59.145 INFO:tasks.workunit.client.0.smithi070.stderr: 52900K .......... .......... .......... .......... .......... 39% 6.92M 15s 2024-05-08T06:48:59.151 INFO:tasks.workunit.client.0.smithi070.stderr: 52950K .......... .......... .......... .......... .......... 39% 8.28M 15s 2024-05-08T06:48:59.157 INFO:tasks.workunit.client.0.smithi070.stderr: 53000K .......... .......... .......... .......... .......... 39% 8.28M 15s 2024-05-08T06:48:59.162 INFO:tasks.workunit.client.0.smithi070.stderr: 53050K .......... .......... .......... .......... .......... 39% 8.53M 15s 2024-05-08T06:48:59.169 INFO:tasks.workunit.client.0.smithi070.stderr: 53100K .......... .......... .......... .......... .......... 39% 7.15M 15s 2024-05-08T06:48:59.175 INFO:tasks.workunit.client.0.smithi070.stderr: 53150K .......... .......... .......... .......... .......... 39% 8.63M 15s 2024-05-08T06:48:59.180 INFO:tasks.workunit.client.0.smithi070.stderr: 53200K .......... .......... .......... .......... .......... 39% 8.95M 15s 2024-05-08T06:48:59.189 INFO:tasks.workunit.client.0.smithi070.stderr: 53250K .......... .......... .......... .......... .......... 39% 6.11M 15s 2024-05-08T06:48:59.199 INFO:tasks.workunit.client.0.smithi070.stderr: 53300K .......... .......... .......... .......... .......... 39% 4.61M 15s 2024-05-08T06:48:59.208 INFO:tasks.workunit.client.0.smithi070.stderr: 53350K .......... .......... .......... .......... .......... 39% 5.44M 15s 2024-05-08T06:48:59.217 INFO:tasks.workunit.client.0.smithi070.stderr: 53400K .......... .......... .......... .......... .......... 39% 5.56M 15s 2024-05-08T06:48:59.228 INFO:tasks.workunit.client.0.smithi070.stderr: 53450K .......... .......... .......... .......... .......... 39% 4.87M 15s 2024-05-08T06:48:59.238 INFO:tasks.workunit.client.0.smithi070.stderr: 53500K .......... .......... .......... .......... .......... 39% 4.40M 15s 2024-05-08T06:48:59.246 INFO:tasks.workunit.client.0.smithi070.stderr: 53550K .......... .......... .......... .......... .......... 39% 6.09M 15s 2024-05-08T06:48:59.254 INFO:tasks.workunit.client.0.smithi070.stderr: 53600K .......... .......... .......... .......... .......... 39% 6.01M 15s 2024-05-08T06:48:59.262 INFO:tasks.workunit.client.0.smithi070.stderr: 53650K .......... .......... .......... .......... .......... 39% 6.38M 15s 2024-05-08T06:48:59.271 INFO:tasks.workunit.client.0.smithi070.stderr: 53700K .......... .......... .......... .......... .......... 39% 5.39M 15s 2024-05-08T06:48:59.278 INFO:tasks.workunit.client.0.smithi070.stderr: 53750K .......... .......... .......... .......... .......... 39% 6.48M 15s 2024-05-08T06:48:59.286 INFO:tasks.workunit.client.0.smithi070.stderr: 53800K .......... .......... .......... .......... .......... 39% 6.10M 15s 2024-05-08T06:48:59.295 INFO:tasks.workunit.client.0.smithi070.stderr: 53850K .......... .......... .......... .......... .......... 39% 5.63M 15s 2024-05-08T06:48:59.306 INFO:tasks.workunit.client.0.smithi070.stderr: 53900K .......... .......... .......... .......... .......... 39% 4.62M 15s 2024-05-08T06:48:59.314 INFO:tasks.workunit.client.0.smithi070.stderr: 53950K .......... .......... .......... .......... .......... 39% 5.77M 15s 2024-05-08T06:48:59.323 INFO:tasks.workunit.client.0.smithi070.stderr: 54000K .......... .......... .......... .......... .......... 39% 5.34M 15s 2024-05-08T06:48:59.332 INFO:tasks.workunit.client.0.smithi070.stderr: 54050K .......... .......... .......... .......... .......... 39% 5.70M 15s 2024-05-08T06:48:59.342 INFO:tasks.workunit.client.0.smithi070.stderr: 54100K .......... .......... .......... .......... .......... 39% 4.83M 15s 2024-05-08T06:48:59.351 INFO:tasks.workunit.client.0.smithi070.stderr: 54150K .......... .......... .......... .......... .......... 39% 5.67M 15s 2024-05-08T06:48:59.359 INFO:tasks.workunit.client.0.smithi070.stderr: 54200K .......... .......... .......... .......... .......... 39% 5.84M 15s 2024-05-08T06:48:59.367 INFO:tasks.workunit.client.0.smithi070.stderr: 54250K .......... .......... .......... .......... .......... 39% 5.77M 15s 2024-05-08T06:48:59.378 INFO:tasks.workunit.client.0.smithi070.stderr: 54300K .......... .......... .......... .......... .......... 40% 4.72M 15s 2024-05-08T06:48:59.387 INFO:tasks.workunit.client.0.smithi070.stderr: 54350K .......... .......... .......... .......... .......... 40% 5.12M 15s 2024-05-08T06:48:59.397 INFO:tasks.workunit.client.0.smithi070.stderr: 54400K .......... .......... .......... .......... .......... 40% 5.35M 15s 2024-05-08T06:48:59.406 INFO:tasks.workunit.client.0.smithi070.stderr: 54450K .......... .......... .......... .......... .......... 40% 5.30M 15s 2024-05-08T06:48:59.417 INFO:tasks.workunit.client.0.smithi070.stderr: 54500K .......... .......... .......... .......... .......... 40% 4.40M 15s 2024-05-08T06:48:59.426 INFO:tasks.workunit.client.0.smithi070.stderr: 54550K .......... .......... .......... .......... .......... 40% 5.51M 15s 2024-05-08T06:48:59.435 INFO:tasks.workunit.client.0.smithi070.stderr: 54600K .......... .......... .......... .......... .......... 40% 5.36M 15s 2024-05-08T06:48:59.444 INFO:tasks.workunit.client.0.smithi070.stderr: 54650K .......... .......... .......... .......... .......... 40% 5.61M 15s 2024-05-08T06:48:59.453 INFO:tasks.workunit.client.0.smithi070.stderr: 54700K .......... .......... .......... .......... .......... 40% 4.99M 15s 2024-05-08T06:48:59.462 INFO:tasks.workunit.client.0.smithi070.stderr: 54750K .......... .......... .......... .......... .......... 40% 5.41M 15s 2024-05-08T06:48:59.471 INFO:tasks.workunit.client.0.smithi070.stderr: 54800K .......... .......... .......... .......... .......... 40% 5.56M 15s 2024-05-08T06:48:59.481 INFO:tasks.workunit.client.0.smithi070.stderr: 54850K .......... .......... .......... .......... .......... 40% 5.13M 15s 2024-05-08T06:48:59.492 INFO:tasks.workunit.client.0.smithi070.stderr: 54900K .......... .......... .......... .......... .......... 40% 4.38M 15s 2024-05-08T06:48:59.501 INFO:tasks.workunit.client.0.smithi070.stderr: 54950K .......... .......... .......... .......... .......... 40% 5.19M 15s 2024-05-08T06:48:59.511 INFO:tasks.workunit.client.0.smithi070.stderr: 55000K .......... .......... .......... .......... .......... 40% 5.13M 15s 2024-05-08T06:48:59.520 INFO:tasks.workunit.client.0.smithi070.stderr: 55050K .......... .......... .......... .......... .......... 40% 5.22M 15s 2024-05-08T06:48:59.530 INFO:tasks.workunit.client.0.smithi070.stderr: 55100K .......... .......... .......... .......... .......... 40% 4.63M 15s 2024-05-08T06:48:59.539 INFO:tasks.workunit.client.0.smithi070.stderr: 55150K .......... .......... .......... .......... .......... 40% 5.56M 15s 2024-05-08T06:48:59.548 INFO:tasks.workunit.client.0.smithi070.stderr: 55200K .......... .......... .......... .......... .......... 40% 5.58M 15s 2024-05-08T06:48:59.557 INFO:tasks.workunit.client.0.smithi070.stderr: 55250K .......... .......... .......... .......... .......... 40% 5.47M 15s 2024-05-08T06:48:59.567 INFO:tasks.workunit.client.0.smithi070.stderr: 55300K .......... .......... .......... .......... .......... 40% 4.76M 15s 2024-05-08T06:48:59.578 INFO:tasks.workunit.client.0.smithi070.stderr: 55350K .......... .......... .......... .......... .......... 40% 4.89M 15s 2024-05-08T06:48:59.587 INFO:tasks.workunit.client.0.smithi070.stderr: 55400K .......... .......... .......... .......... .......... 40% 5.01M 15s 2024-05-08T06:48:59.597 INFO:tasks.workunit.client.0.smithi070.stderr: 55450K .......... .......... .......... .......... .......... 40% 5.11M 15s 2024-05-08T06:48:59.608 INFO:tasks.workunit.client.0.smithi070.stderr: 55500K .......... .......... .......... .......... .......... 40% 4.15M 15s 2024-05-08T06:48:59.619 INFO:tasks.workunit.client.0.smithi070.stderr: 55550K .......... .......... .......... .......... .......... 40% 4.84M 15s 2024-05-08T06:48:59.628 INFO:tasks.workunit.client.0.smithi070.stderr: 55600K .......... .......... .......... .......... .......... 40% 5.06M 15s 2024-05-08T06:48:59.639 INFO:tasks.workunit.client.0.smithi070.stderr: 55650K .......... .......... .......... .......... .......... 41% 4.78M 15s 2024-05-08T06:48:59.650 INFO:tasks.workunit.client.0.smithi070.stderr: 55700K .......... .......... .......... .......... .......... 41% 4.26M 15s 2024-05-08T06:48:59.661 INFO:tasks.workunit.client.0.smithi070.stderr: 55750K .......... .......... .......... .......... .......... 41% 4.52M 15s 2024-05-08T06:48:59.671 INFO:tasks.workunit.client.0.smithi070.stderr: 55800K .......... .......... .......... .......... .......... 41% 4.97M 15s 2024-05-08T06:48:59.680 INFO:tasks.workunit.client.0.smithi070.stderr: 55850K .......... .......... .......... .......... .......... 41% 5.23M 15s 2024-05-08T06:48:59.691 INFO:tasks.workunit.client.0.smithi070.stderr: 55900K .......... .......... .......... .......... .......... 41% 4.50M 15s 2024-05-08T06:48:59.701 INFO:tasks.workunit.client.0.smithi070.stderr: 55950K .......... .......... .......... .......... .......... 41% 4.82M 14s 2024-05-08T06:48:59.710 INFO:tasks.workunit.client.0.smithi070.stderr: 56000K .......... .......... .......... .......... .......... 41% 5.15M 14s 2024-05-08T06:48:59.720 INFO:tasks.workunit.client.0.smithi070.stderr: 56050K .......... .......... .......... .......... .......... 41% 5.27M 14s 2024-05-08T06:48:59.731 INFO:tasks.workunit.client.0.smithi070.stderr: 56100K .......... .......... .......... .......... .......... 41% 4.41M 14s 2024-05-08T06:48:59.739 INFO:tasks.workunit.client.0.smithi070.stderr: 56150K .......... .......... .......... .......... .......... 41% 5.41M 14s 2024-05-08T06:48:59.747 INFO:tasks.workunit.client.0.smithi070.stderr: 56200K .......... .......... .......... .......... .......... 41% 6.18M 14s 2024-05-08T06:48:59.755 INFO:tasks.workunit.client.0.smithi070.stderr: 56250K .......... .......... .......... .......... .......... 41% 6.02M 14s 2024-05-08T06:48:59.765 INFO:tasks.workunit.client.0.smithi070.stderr: 56300K .......... .......... .......... .......... .......... 41% 5.32M 14s 2024-05-08T06:48:59.773 INFO:tasks.workunit.client.0.smithi070.stderr: 56350K .......... .......... .......... .......... .......... 41% 5.83M 14s 2024-05-08T06:48:59.782 INFO:tasks.workunit.client.0.smithi070.stderr: 56400K .......... .......... .......... .......... .......... 41% 5.82M 14s 2024-05-08T06:48:59.791 INFO:tasks.workunit.client.0.smithi070.stderr: 56450K .......... .......... .......... .......... .......... 41% 5.41M 14s 2024-05-08T06:48:59.801 INFO:tasks.workunit.client.0.smithi070.stderr: 56500K .......... .......... .......... .......... .......... 41% 4.70M 14s 2024-05-08T06:48:59.810 INFO:tasks.workunit.client.0.smithi070.stderr: 56550K .......... .......... .......... .......... .......... 41% 5.42M 14s 2024-05-08T06:48:59.819 INFO:tasks.workunit.client.0.smithi070.stderr: 56600K .......... .......... .......... .......... .......... 41% 5.34M 14s 2024-05-08T06:48:59.829 INFO:tasks.workunit.client.0.smithi070.stderr: 56650K .......... .......... .......... .......... .......... 41% 5.20M 14s 2024-05-08T06:48:59.840 INFO:tasks.workunit.client.0.smithi070.stderr: 56700K .......... .......... .......... .......... .......... 41% 4.38M 14s 2024-05-08T06:48:59.848 INFO:tasks.workunit.client.0.smithi070.stderr: 56750K .......... .......... .......... .......... .......... 41% 5.97M 14s 2024-05-08T06:48:59.856 INFO:tasks.workunit.client.0.smithi070.stderr: 56800K .......... .......... .......... .......... .......... 41% 5.97M 14s 2024-05-08T06:48:59.865 INFO:tasks.workunit.client.0.smithi070.stderr: 56850K .......... .......... .......... .......... .......... 41% 5.78M 14s 2024-05-08T06:48:59.875 INFO:tasks.workunit.client.0.smithi070.stderr: 56900K .......... .......... .......... .......... .......... 41% 4.45M 14s 2024-05-08T06:48:59.885 INFO:tasks.workunit.client.0.smithi070.stderr: 56950K .......... .......... .......... .......... .......... 41% 5.19M 14s 2024-05-08T06:48:59.894 INFO:tasks.workunit.client.0.smithi070.stderr: 57000K .......... .......... .......... .......... .......... 42% 5.62M 14s 2024-05-08T06:48:59.902 INFO:tasks.workunit.client.0.smithi070.stderr: 57050K .......... .......... .......... .......... .......... 42% 5.50M 14s 2024-05-08T06:48:59.913 INFO:tasks.workunit.client.0.smithi070.stderr: 57100K .......... .......... .......... .......... .......... 42% 4.55M 14s 2024-05-08T06:48:59.922 INFO:tasks.workunit.client.0.smithi070.stderr: 57150K .......... .......... .......... .......... .......... 42% 5.29M 14s 2024-05-08T06:48:59.932 INFO:tasks.workunit.client.0.smithi070.stderr: 57200K .......... .......... .......... .......... .......... 42% 5.20M 14s 2024-05-08T06:48:59.941 INFO:tasks.workunit.client.0.smithi070.stderr: 57250K .......... .......... .......... .......... .......... 42% 5.22M 14s 2024-05-08T06:48:59.952 INFO:tasks.workunit.client.0.smithi070.stderr: 57300K .......... .......... .......... .......... .......... 42% 4.52M 14s 2024-05-08T06:48:59.961 INFO:tasks.workunit.client.0.smithi070.stderr: 57350K .......... .......... .......... .......... .......... 42% 5.71M 14s 2024-05-08T06:48:59.968 INFO:tasks.workunit.client.0.smithi070.stderr: 57400K .......... .......... .......... .......... .......... 42% 6.29M 14s 2024-05-08T06:48:59.976 INFO:tasks.workunit.client.0.smithi070.stderr: 57450K .......... .......... .......... .......... .......... 42% 6.42M 14s 2024-05-08T06:48:59.984 INFO:tasks.workunit.client.0.smithi070.stderr: 57500K .......... .......... .......... .......... .......... 42% 5.64M 14s 2024-05-08T06:48:59.992 INFO:tasks.workunit.client.0.smithi070.stderr: 57550K .......... .......... .......... .......... .......... 42% 6.77M 14s 2024-05-08T06:49:00.002 INFO:tasks.workunit.client.0.smithi070.stderr: 57600K .......... .......... .......... .......... .......... 42% 5.49M 14s 2024-05-08T06:49:00.010 INFO:tasks.workunit.client.0.smithi070.stderr: 57650K .......... .......... .......... .......... .......... 42% 5.58M 14s 2024-05-08T06:49:00.021 INFO:tasks.workunit.client.0.smithi070.stderr: 57700K .......... .......... .......... .......... .......... 42% 4.42M 14s 2024-05-08T06:49:00.030 INFO:tasks.workunit.client.0.smithi070.stderr: 57750K .......... .......... .......... .......... .......... 42% 4.94M 14s 2024-05-08T06:49:00.039 INFO:tasks.workunit.client.0.smithi070.stderr: 57800K .......... .......... .......... .......... .......... 42% 5.68M 14s 2024-05-08T06:49:00.047 INFO:tasks.workunit.client.0.smithi070.stderr: 57850K .......... .......... .......... .......... .......... 42% 6.18M 14s 2024-05-08T06:49:00.057 INFO:tasks.workunit.client.0.smithi070.stderr: 57900K .......... .......... .......... .......... .......... 42% 4.76M 14s 2024-05-08T06:49:00.066 INFO:tasks.workunit.client.0.smithi070.stderr: 57950K .......... .......... .......... .......... .......... 42% 5.57M 14s 2024-05-08T06:49:00.075 INFO:tasks.workunit.client.0.smithi070.stderr: 58000K .......... .......... .......... .......... .......... 42% 5.24M 14s 2024-05-08T06:49:00.084 INFO:tasks.workunit.client.0.smithi070.stderr: 58050K .......... .......... .......... .......... .......... 42% 5.50M 14s 2024-05-08T06:49:00.095 INFO:tasks.workunit.client.0.smithi070.stderr: 58100K .......... .......... .......... .......... .......... 42% 4.61M 14s 2024-05-08T06:49:00.104 INFO:tasks.workunit.client.0.smithi070.stderr: 58150K .......... .......... .......... .......... .......... 42% 5.02M 14s 2024-05-08T06:49:00.114 INFO:tasks.workunit.client.0.smithi070.stderr: 58200K .......... .......... .......... .......... .......... 42% 5.24M 14s 2024-05-08T06:49:00.123 INFO:tasks.workunit.client.0.smithi070.stderr: 58250K .......... .......... .......... .......... .......... 42% 5.30M 14s 2024-05-08T06:49:00.134 INFO:tasks.workunit.client.0.smithi070.stderr: 58300K .......... .......... .......... .......... .......... 42% 4.56M 14s 2024-05-08T06:49:00.143 INFO:tasks.workunit.client.0.smithi070.stderr: 58350K .......... .......... .......... .......... .......... 43% 5.17M 14s 2024-05-08T06:49:00.152 INFO:tasks.workunit.client.0.smithi070.stderr: 58400K .......... .......... .......... .......... .......... 43% 5.22M 14s 2024-05-08T06:49:00.161 INFO:tasks.workunit.client.0.smithi070.stderr: 58450K .......... .......... .......... .......... .......... 43% 6.02M 14s 2024-05-08T06:49:00.169 INFO:tasks.workunit.client.0.smithi070.stderr: 58500K .......... .......... .......... .......... .......... 43% 5.57M 14s 2024-05-08T06:49:00.177 INFO:tasks.workunit.client.0.smithi070.stderr: 58550K .......... .......... .......... .......... .......... 43% 5.94M 14s 2024-05-08T06:49:00.187 INFO:tasks.workunit.client.0.smithi070.stderr: 58600K .......... .......... .......... .......... .......... 43% 5.41M 14s 2024-05-08T06:49:00.195 INFO:tasks.workunit.client.0.smithi070.stderr: 58650K .......... .......... .......... .......... .......... 43% 5.44M 14s 2024-05-08T06:49:00.205 INFO:tasks.workunit.client.0.smithi070.stderr: 58700K .......... .......... .......... .......... .......... 43% 5.00M 14s 2024-05-08T06:49:00.214 INFO:tasks.workunit.client.0.smithi070.stderr: 58750K .......... .......... .......... .......... .......... 43% 5.77M 14s 2024-05-08T06:49:00.222 INFO:tasks.workunit.client.0.smithi070.stderr: 58800K .......... .......... .......... .......... .......... 43% 5.63M 14s 2024-05-08T06:49:00.232 INFO:tasks.workunit.client.0.smithi070.stderr: 58850K .......... .......... .......... .......... .......... 43% 5.30M 14s 2024-05-08T06:49:00.242 INFO:tasks.workunit.client.0.smithi070.stderr: 58900K .......... .......... .......... .......... .......... 43% 4.66M 14s 2024-05-08T06:49:00.251 INFO:tasks.workunit.client.0.smithi070.stderr: 58950K .......... .......... .......... .......... .......... 43% 5.45M 14s 2024-05-08T06:49:00.260 INFO:tasks.workunit.client.0.smithi070.stderr: 59000K .......... .......... .......... .......... .......... 43% 5.50M 14s 2024-05-08T06:49:00.268 INFO:tasks.workunit.client.0.smithi070.stderr: 59050K .......... .......... .......... .......... .......... 43% 5.66M 14s 2024-05-08T06:49:00.282 INFO:tasks.workunit.client.0.smithi070.stderr: 59100K .......... .......... .......... .......... .......... 43% 4.62M 14s 2024-05-08T06:49:00.288 INFO:tasks.workunit.client.0.smithi070.stderr: 59150K .......... .......... .......... .......... .......... 43% 5.47M 14s 2024-05-08T06:49:00.298 INFO:tasks.workunit.client.0.smithi070.stderr: 59200K .......... .......... .......... .......... .......... 43% 5.23M 14s 2024-05-08T06:49:00.307 INFO:tasks.workunit.client.0.smithi070.stderr: 59250K .......... .......... .......... .......... .......... 43% 4.91M 14s 2024-05-08T06:49:00.312 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:00 smithi194 ceph-mon[33679]: pgmap v76: 129 pgs: 129 active+clean; 45 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-05-08T06:49:00.319 INFO:tasks.workunit.client.0.smithi070.stderr: 59300K .......... .......... .......... .......... .......... 43% 4.40M 14s 2024-05-08T06:49:00.328 INFO:tasks.workunit.client.0.smithi070.stderr: 59350K .......... .......... .......... .......... .......... 43% 5.03M 14s 2024-05-08T06:49:00.338 INFO:tasks.workunit.client.0.smithi070.stderr: 59400K .......... .......... .......... .......... .......... 43% 4.99M 14s 2024-05-08T06:49:00.348 INFO:tasks.workunit.client.0.smithi070.stderr: 59450K .......... .......... .......... .......... .......... 43% 4.99M 14s 2024-05-08T06:49:00.359 INFO:tasks.workunit.client.0.smithi070.stderr: 59500K .......... .......... .......... .......... .......... 43% 4.52M 14s 2024-05-08T06:49:00.368 INFO:tasks.workunit.client.0.smithi070.stderr: 59550K .......... .......... .......... .......... .......... 43% 5.11M 14s 2024-05-08T06:49:00.378 INFO:tasks.workunit.client.0.smithi070.stderr: 59600K .......... .......... .......... .......... .......... 43% 5.06M 14s 2024-05-08T06:49:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:00 smithi070 ceph-mon[29591]: pgmap v76: 129 pgs: 129 active+clean; 45 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-05-08T06:49:00.388 INFO:tasks.workunit.client.0.smithi070.stderr: 59650K .......... .......... .......... .......... .......... 43% 4.90M 14s 2024-05-08T06:49:00.399 INFO:tasks.workunit.client.0.smithi070.stderr: 59700K .......... .......... .......... .......... .......... 44% 4.16M 14s 2024-05-08T06:49:00.408 INFO:tasks.workunit.client.0.smithi070.stderr: 59750K .......... .......... .......... .......... .......... 44% 5.40M 14s 2024-05-08T06:49:00.418 INFO:tasks.workunit.client.0.smithi070.stderr: 59800K .......... .......... .......... .......... .......... 44% 4.98M 14s 2024-05-08T06:49:00.428 INFO:tasks.workunit.client.0.smithi070.stderr: 59850K .......... .......... .......... .......... .......... 44% 5.15M 14s 2024-05-08T06:49:00.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:00 smithi172 ceph-mon[33377]: pgmap v76: 129 pgs: 129 active+clean; 45 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 3.7 MiB/s wr, 10 op/s 2024-05-08T06:49:00.439 INFO:tasks.workunit.client.0.smithi070.stderr: 59900K .......... .......... .......... .......... .......... 44% 4.58M 14s 2024-05-08T06:49:00.447 INFO:tasks.workunit.client.0.smithi070.stderr: 59950K .......... .......... .......... .......... .......... 44% 5.49M 14s 2024-05-08T06:49:00.455 INFO:tasks.workunit.client.0.smithi070.stderr: 60000K .......... .......... .......... .......... .......... 44% 6.08M 14s 2024-05-08T06:49:00.464 INFO:tasks.workunit.client.0.smithi070.stderr: 60050K .......... .......... .......... .......... .......... 44% 5.88M 14s 2024-05-08T06:49:00.473 INFO:tasks.workunit.client.0.smithi070.stderr: 60100K .......... .......... .......... .......... .......... 44% 5.15M 14s 2024-05-08T06:49:00.481 INFO:tasks.workunit.client.0.smithi070.stderr: 60150K .......... .......... .......... .......... .......... 44% 6.11M 14s 2024-05-08T06:49:00.490 INFO:tasks.workunit.client.0.smithi070.stderr: 60200K .......... .......... .......... .......... .......... 44% 5.38M 14s 2024-05-08T06:49:00.499 INFO:tasks.workunit.client.0.smithi070.stderr: 60250K .......... .......... .......... .......... .......... 44% 5.63M 14s 2024-05-08T06:49:00.509 INFO:tasks.workunit.client.0.smithi070.stderr: 60300K .......... .......... .......... .......... .......... 44% 5.01M 14s 2024-05-08T06:49:00.517 INFO:tasks.workunit.client.0.smithi070.stderr: 60350K .......... .......... .......... .......... .......... 44% 5.76M 14s 2024-05-08T06:49:00.525 INFO:tasks.workunit.client.0.smithi070.stderr: 60400K .......... .......... .......... .......... .......... 44% 5.87M 14s 2024-05-08T06:49:00.534 INFO:tasks.workunit.client.0.smithi070.stderr: 60450K .......... .......... .......... .......... .......... 44% 5.71M 14s 2024-05-08T06:49:00.544 INFO:tasks.workunit.client.0.smithi070.stderr: 60500K .......... .......... .......... .......... .......... 44% 4.92M 14s 2024-05-08T06:49:00.554 INFO:tasks.workunit.client.0.smithi070.stderr: 60550K .......... .......... .......... .......... .......... 44% 5.04M 14s 2024-05-08T06:49:00.564 INFO:tasks.workunit.client.0.smithi070.stderr: 60600K .......... .......... .......... .......... .......... 44% 4.92M 14s 2024-05-08T06:49:00.572 INFO:tasks.workunit.client.0.smithi070.stderr: 60650K .......... .......... .......... .......... .......... 44% 5.56M 14s 2024-05-08T06:49:00.582 INFO:tasks.workunit.client.0.smithi070.stderr: 60700K .......... .......... .......... .......... .......... 44% 4.89M 14s 2024-05-08T06:49:00.591 INFO:tasks.workunit.client.0.smithi070.stderr: 60750K .......... .......... .......... .......... .......... 44% 5.75M 14s 2024-05-08T06:49:00.600 INFO:tasks.workunit.client.0.smithi070.stderr: 60800K .......... .......... .......... .......... .......... 44% 5.44M 14s 2024-05-08T06:49:00.609 INFO:tasks.workunit.client.0.smithi070.stderr: 60850K .......... .......... .......... .......... .......... 44% 5.52M 14s 2024-05-08T06:49:00.620 INFO:tasks.workunit.client.0.smithi070.stderr: 60900K .......... .......... .......... .......... .......... 44% 4.55M 14s 2024-05-08T06:49:00.630 INFO:tasks.workunit.client.0.smithi070.stderr: 60950K .......... .......... .......... .......... .......... 44% 4.72M 14s 2024-05-08T06:49:00.640 INFO:tasks.workunit.client.0.smithi070.stderr: 61000K .......... .......... .......... .......... .......... 44% 4.75M 14s 2024-05-08T06:49:00.650 INFO:tasks.workunit.client.0.smithi070.stderr: 61050K .......... .......... .......... .......... .......... 45% 5.10M 14s 2024-05-08T06:49:00.661 INFO:tasks.workunit.client.0.smithi070.stderr: 61100K .......... .......... .......... .......... .......... 45% 4.29M 14s 2024-05-08T06:49:00.673 INFO:tasks.workunit.client.0.smithi070.stderr: 61150K .......... .......... .......... .......... .......... 45% 4.27M 14s 2024-05-08T06:49:00.683 INFO:tasks.workunit.client.0.smithi070.stderr: 61200K .......... .......... .......... .......... .......... 45% 4.89M 14s 2024-05-08T06:49:00.777 INFO:tasks.workunit.client.0.smithi070.stderr: 61250K .......... .......... .......... .......... .......... 45% 529K 14s 2024-05-08T06:49:00.786 INFO:tasks.workunit.client.0.smithi070.stderr: 61300K .......... .......... .......... .......... .......... 45% 5.30M 14s 2024-05-08T06:49:00.794 INFO:tasks.workunit.client.0.smithi070.stderr: 61350K .......... .......... .......... .......... .......... 45% 6.00M 14s 2024-05-08T06:49:00.801 INFO:tasks.workunit.client.0.smithi070.stderr: 61400K .......... .......... .......... .......... .......... 45% 7.17M 14s 2024-05-08T06:49:00.809 INFO:tasks.workunit.client.0.smithi070.stderr: 61450K .......... .......... .......... .......... .......... 45% 6.00M 14s 2024-05-08T06:49:00.819 INFO:tasks.workunit.client.0.smithi070.stderr: 61500K .......... .......... .......... .......... .......... 45% 4.91M 14s 2024-05-08T06:49:00.825 INFO:tasks.workunit.client.0.smithi070.stderr: 61550K .......... .......... .......... .......... .......... 45% 7.90M 14s 2024-05-08T06:49:00.832 INFO:tasks.workunit.client.0.smithi070.stderr: 61600K .......... .......... .......... .......... .......... 45% 6.54M 14s 2024-05-08T06:49:00.840 INFO:tasks.workunit.client.0.smithi070.stderr: 61650K .......... .......... .......... .......... .......... 45% 6.39M 14s 2024-05-08T06:49:00.849 INFO:tasks.workunit.client.0.smithi070.stderr: 61700K .......... .......... .......... .......... .......... 45% 5.56M 14s 2024-05-08T06:49:00.857 INFO:tasks.workunit.client.0.smithi070.stderr: 61750K .......... .......... .......... .......... .......... 45% 6.41M 14s 2024-05-08T06:49:00.863 INFO:tasks.workunit.client.0.smithi070.stderr: 61800K .......... .......... .......... .......... .......... 45% 7.29M 14s 2024-05-08T06:49:00.871 INFO:tasks.workunit.client.0.smithi070.stderr: 61850K .......... .......... .......... .......... .......... 45% 6.14M 14s 2024-05-08T06:49:00.879 INFO:tasks.workunit.client.0.smithi070.stderr: 61900K .......... .......... .......... .......... .......... 45% 6.28M 14s 2024-05-08T06:49:00.885 INFO:tasks.workunit.client.0.smithi070.stderr: 61950K .......... .......... .......... .......... .......... 45% 7.77M 14s 2024-05-08T06:49:00.890 INFO:tasks.workunit.client.0.smithi070.stderr: 62000K .......... .......... .......... .......... .......... 45% 9.45M 14s 2024-05-08T06:49:00.894 INFO:tasks.workunit.client.0.smithi070.stderr: 62050K .......... .......... .......... .......... .......... 45% 11.2M 13s 2024-05-08T06:49:00.902 INFO:tasks.workunit.client.0.smithi070.stderr: 62100K .......... .......... .......... .......... .......... 45% 8.54M 13s 2024-05-08T06:49:00.907 INFO:tasks.workunit.client.0.smithi070.stderr: 62150K .......... .......... .......... .......... .......... 45% 7.79M 13s 2024-05-08T06:49:00.914 INFO:tasks.workunit.client.0.smithi070.stderr: 62200K .......... .......... .......... .......... .......... 45% 6.84M 13s 2024-05-08T06:49:00.922 INFO:tasks.workunit.client.0.smithi070.stderr: 62250K .......... .......... .......... .......... .......... 45% 6.59M 13s 2024-05-08T06:49:00.931 INFO:tasks.workunit.client.0.smithi070.stderr: 62300K .......... .......... .......... .......... .......... 45% 5.14M 13s 2024-05-08T06:49:00.938 INFO:tasks.workunit.client.0.smithi070.stderr: 62350K .......... .......... .......... .......... .......... 45% 6.41M 13s 2024-05-08T06:49:00.944 INFO:tasks.workunit.client.0.smithi070.stderr: 62400K .......... .......... .......... .......... .......... 46% 7.68M 13s 2024-05-08T06:49:00.951 INFO:tasks.workunit.client.0.smithi070.stderr: 62450K .......... .......... .......... .......... .......... 46% 7.72M 13s 2024-05-08T06:49:00.958 INFO:tasks.workunit.client.0.smithi070.stderr: 62500K .......... .......... .......... .......... .......... 46% 7.14M 13s 2024-05-08T06:49:00.964 INFO:tasks.workunit.client.0.smithi070.stderr: 62550K .......... .......... .......... .......... .......... 46% 8.18M 13s 2024-05-08T06:49:00.971 INFO:tasks.workunit.client.0.smithi070.stderr: 62600K .......... .......... .......... .......... .......... 46% 6.79M 13s 2024-05-08T06:49:00.980 INFO:tasks.workunit.client.0.smithi070.stderr: 62650K .......... .......... .......... .......... .......... 46% 6.07M 13s 2024-05-08T06:49:00.990 INFO:tasks.workunit.client.0.smithi070.stderr: 62700K .......... .......... .......... .......... .......... 46% 4.76M 13s 2024-05-08T06:49:00.999 INFO:tasks.workunit.client.0.smithi070.stderr: 62750K .......... .......... .......... .......... .......... 46% 5.69M 13s 2024-05-08T06:49:01.008 INFO:tasks.workunit.client.0.smithi070.stderr: 62800K .......... .......... .......... .......... .......... 46% 5.17M 13s 2024-05-08T06:49:01.016 INFO:tasks.workunit.client.0.smithi070.stderr: 62850K .......... .......... .......... .......... .......... 46% 5.75M 13s 2024-05-08T06:49:01.027 INFO:tasks.workunit.client.0.smithi070.stderr: 62900K .......... .......... .......... .......... .......... 46% 4.61M 13s 2024-05-08T06:49:01.038 INFO:tasks.workunit.client.0.smithi070.stderr: 62950K .......... .......... .......... .......... .......... 46% 4.69M 13s 2024-05-08T06:49:01.047 INFO:tasks.workunit.client.0.smithi070.stderr: 63000K .......... .......... .......... .......... .......... 46% 5.18M 13s 2024-05-08T06:49:01.055 INFO:tasks.workunit.client.0.smithi070.stderr: 63050K .......... .......... .......... .......... .......... 46% 5.64M 13s 2024-05-08T06:49:01.065 INFO:tasks.workunit.client.0.smithi070.stderr: 63100K .......... .......... .......... .......... .......... 46% 4.76M 13s 2024-05-08T06:49:01.075 INFO:tasks.workunit.client.0.smithi070.stderr: 63150K .......... .......... .......... .......... .......... 46% 5.01M 13s 2024-05-08T06:49:01.084 INFO:tasks.workunit.client.0.smithi070.stderr: 63200K .......... .......... .......... .......... .......... 46% 5.62M 13s 2024-05-08T06:49:01.093 INFO:tasks.workunit.client.0.smithi070.stderr: 63250K .......... .......... .......... .......... .......... 46% 5.27M 13s 2024-05-08T06:49:01.106 INFO:tasks.workunit.client.0.smithi070.stderr: 63300K .......... .......... .......... .......... .......... 46% 4.76M 13s 2024-05-08T06:49:01.113 INFO:tasks.workunit.client.0.smithi070.stderr: 63350K .......... .......... .......... .......... .......... 46% 5.13M 13s 2024-05-08T06:49:01.121 INFO:tasks.workunit.client.0.smithi070.stderr: 63400K .......... .......... .......... .......... .......... 46% 6.21M 13s 2024-05-08T06:49:01.130 INFO:tasks.workunit.client.0.smithi070.stderr: 63450K .......... .......... .......... .......... .......... 46% 5.40M 13s 2024-05-08T06:49:01.142 INFO:tasks.workunit.client.0.smithi070.stderr: 63500K .......... .......... .......... .......... .......... 46% 4.16M 13s 2024-05-08T06:49:01.151 INFO:tasks.workunit.client.0.smithi070.stderr: 63550K .......... .......... .......... .......... .......... 46% 5.04M 13s 2024-05-08T06:49:01.158 INFO:tasks.workunit.client.0.smithi070.stderr: 63600K .......... .......... .......... .......... .......... 46% 6.92M 13s 2024-05-08T06:49:01.167 INFO:tasks.workunit.client.0.smithi070.stderr: 63650K .......... .......... .......... .......... .......... 46% 6.09M 13s 2024-05-08T06:49:01.177 INFO:tasks.workunit.client.0.smithi070.stderr: 63700K .......... .......... .......... .......... .......... 46% 4.61M 13s 2024-05-08T06:49:01.186 INFO:tasks.workunit.client.0.smithi070.stderr: 63750K .......... .......... .......... .......... .......... 46% 5.20M 13s 2024-05-08T06:49:01.193 INFO:tasks.workunit.client.0.smithi070.stderr: 63800K .......... .......... .......... .......... .......... 47% 7.05M 13s 2024-05-08T06:49:01.200 INFO:tasks.workunit.client.0.smithi070.stderr: 63850K .......... .......... .......... .......... .......... 47% 7.13M 13s 2024-05-08T06:49:01.208 INFO:tasks.workunit.client.0.smithi070.stderr: 63900K .......... .......... .......... .......... .......... 47% 6.04M 13s 2024-05-08T06:49:01.215 INFO:tasks.workunit.client.0.smithi070.stderr: 63950K .......... .......... .......... .......... .......... 47% 7.18M 13s 2024-05-08T06:49:01.221 INFO:tasks.workunit.client.0.smithi070.stderr: 64000K .......... .......... .......... .......... .......... 47% 7.68M 13s 2024-05-08T06:49:01.228 INFO:tasks.workunit.client.0.smithi070.stderr: 64050K .......... .......... .......... .......... .......... 47% 7.28M 13s 2024-05-08T06:49:01.236 INFO:tasks.workunit.client.0.smithi070.stderr: 64100K .......... .......... .......... .......... .......... 47% 6.15M 13s 2024-05-08T06:49:01.242 INFO:tasks.workunit.client.0.smithi070.stderr: 64150K .......... .......... .......... .......... .......... 47% 7.62M 13s 2024-05-08T06:49:01.251 INFO:tasks.workunit.client.0.smithi070.stderr: 64200K .......... .......... .......... .......... .......... 47% 6.09M 13s 2024-05-08T06:49:01.261 INFO:tasks.workunit.client.0.smithi070.stderr: 64250K .......... .......... .......... .......... .......... 47% 4.87M 13s 2024-05-08T06:49:01.271 INFO:tasks.workunit.client.0.smithi070.stderr: 64300K .......... .......... .......... .......... .......... 47% 4.67M 13s 2024-05-08T06:49:01.280 INFO:tasks.workunit.client.0.smithi070.stderr: 64350K .......... .......... .......... .......... .......... 47% 5.40M 13s 2024-05-08T06:49:01.289 INFO:tasks.workunit.client.0.smithi070.stderr: 64400K .......... .......... .......... .......... .......... 47% 5.54M 13s 2024-05-08T06:49:01.297 INFO:tasks.workunit.client.0.smithi070.stderr: 64450K .......... .......... .......... .......... .......... 47% 5.55M 13s 2024-05-08T06:49:01.306 INFO:tasks.workunit.client.0.smithi070.stderr: 64500K .......... .......... .......... .......... .......... 47% 5.67M 13s 2024-05-08T06:49:01.314 INFO:tasks.workunit.client.0.smithi070.stderr: 64550K .......... .......... .......... .......... .......... 47% 6.39M 13s 2024-05-08T06:49:01.323 INFO:tasks.workunit.client.0.smithi070.stderr: 64600K .......... .......... .......... .......... .......... 47% 5.42M 13s 2024-05-08T06:49:01.332 INFO:tasks.workunit.client.0.smithi070.stderr: 64650K .......... .......... .......... .......... .......... 47% 5.36M 13s 2024-05-08T06:49:01.343 INFO:tasks.workunit.client.0.smithi070.stderr: 64700K .......... .......... .......... .......... .......... 47% 4.66M 13s 2024-05-08T06:49:01.353 INFO:tasks.workunit.client.0.smithi070.stderr: 64750K .......... .......... .......... .......... .......... 47% 4.94M 13s 2024-05-08T06:49:01.362 INFO:tasks.workunit.client.0.smithi070.stderr: 64800K .......... .......... .......... .......... .......... 47% 4.98M 13s 2024-05-08T06:49:01.372 INFO:tasks.workunit.client.0.smithi070.stderr: 64850K .......... .......... .......... .......... .......... 47% 5.14M 13s 2024-05-08T06:49:01.383 INFO:tasks.workunit.client.0.smithi070.stderr: 64900K .......... .......... .......... .......... .......... 47% 4.51M 13s 2024-05-08T06:49:01.392 INFO:tasks.workunit.client.0.smithi070.stderr: 64950K .......... .......... .......... .......... .......... 47% 5.27M 13s 2024-05-08T06:49:01.403 INFO:tasks.workunit.client.0.smithi070.stderr: 65000K .......... .......... .......... .......... .......... 47% 4.51M 13s 2024-05-08T06:49:01.413 INFO:tasks.workunit.client.0.smithi070.stderr: 65050K .......... .......... .......... .......... .......... 47% 4.78M 13s 2024-05-08T06:49:01.425 INFO:tasks.workunit.client.0.smithi070.stderr: 65100K .......... .......... .......... .......... .......... 47% 4.26M 13s 2024-05-08T06:49:01.434 INFO:tasks.workunit.client.0.smithi070.stderr: 65150K .......... .......... .......... .......... .......... 48% 4.88M 13s 2024-05-08T06:49:01.444 INFO:tasks.workunit.client.0.smithi070.stderr: 65200K .......... .......... .......... .......... .......... 48% 5.00M 13s 2024-05-08T06:49:01.455 INFO:tasks.workunit.client.0.smithi070.stderr: 65250K .......... .......... .......... .......... .......... 48% 4.59M 13s 2024-05-08T06:49:01.467 INFO:tasks.workunit.client.0.smithi070.stderr: 65300K .......... .......... .......... .......... .......... 48% 3.95M 13s 2024-05-08T06:49:01.477 INFO:tasks.workunit.client.0.smithi070.stderr: 65350K .......... .......... .......... .......... .......... 48% 4.79M 13s 2024-05-08T06:49:01.488 INFO:tasks.workunit.client.0.smithi070.stderr: 65400K .......... .......... .......... .......... .......... 48% 4.58M 13s 2024-05-08T06:49:01.499 INFO:tasks.workunit.client.0.smithi070.stderr: 65450K .......... .......... .......... .......... .......... 48% 4.74M 13s 2024-05-08T06:49:01.509 INFO:tasks.workunit.client.0.smithi070.stderr: 65500K .......... .......... .......... .......... .......... 48% 4.29M 13s 2024-05-08T06:49:01.518 INFO:tasks.workunit.client.0.smithi070.stderr: 65550K .......... .......... .......... .......... .......... 48% 6.22M 13s 2024-05-08T06:49:01.527 INFO:tasks.workunit.client.0.smithi070.stderr: 65600K .......... .......... .......... .......... .......... 48% 5.17M 13s 2024-05-08T06:49:01.536 INFO:tasks.workunit.client.0.smithi070.stderr: 65650K .......... .......... .......... .......... .......... 48% 5.30M 13s 2024-05-08T06:49:01.546 INFO:tasks.workunit.client.0.smithi070.stderr: 65700K .......... .......... .......... .......... .......... 48% 5.06M 13s 2024-05-08T06:49:01.553 INFO:tasks.workunit.client.0.smithi070.stderr: 65750K .......... .......... .......... .......... .......... 48% 6.73M 13s 2024-05-08T06:49:01.559 INFO:tasks.workunit.client.0.smithi070.stderr: 65800K .......... .......... .......... .......... .......... 48% 7.25M 13s 2024-05-08T06:49:01.567 INFO:tasks.workunit.client.0.smithi070.stderr: 65850K .......... .......... .......... .......... .......... 48% 6.47M 13s 2024-05-08T06:49:01.577 INFO:tasks.workunit.client.0.smithi070.stderr: 65900K .......... .......... .......... .......... .......... 48% 4.92M 13s 2024-05-08T06:49:01.586 INFO:tasks.workunit.client.0.smithi070.stderr: 65950K .......... .......... .......... .......... .......... 48% 5.38M 13s 2024-05-08T06:49:01.597 INFO:tasks.workunit.client.0.smithi070.stderr: 66000K .......... .......... .......... .......... .......... 48% 4.98M 13s 2024-05-08T06:49:01.609 INFO:tasks.workunit.client.0.smithi070.stderr: 66050K .......... .......... .......... .......... .......... 48% 3.86M 13s 2024-05-08T06:49:01.619 INFO:tasks.workunit.client.0.smithi070.stderr: 66100K .......... .......... .......... .......... .......... 48% 4.61M 13s 2024-05-08T06:49:01.628 INFO:tasks.workunit.client.0.smithi070.stderr: 66150K .......... .......... .......... .......... .......... 48% 5.36M 13s 2024-05-08T06:49:01.637 INFO:tasks.workunit.client.0.smithi070.stderr: 66200K .......... .......... .......... .......... .......... 48% 5.36M 13s 2024-05-08T06:49:01.646 INFO:tasks.workunit.client.0.smithi070.stderr: 66250K .......... .......... .......... .......... .......... 48% 5.55M 13s 2024-05-08T06:49:01.657 INFO:tasks.workunit.client.0.smithi070.stderr: 66300K .......... .......... .......... .......... .......... 48% 4.45M 13s 2024-05-08T06:49:01.667 INFO:tasks.workunit.client.0.smithi070.stderr: 66350K .......... .......... .......... .......... .......... 48% 5.33M 13s 2024-05-08T06:49:01.676 INFO:tasks.workunit.client.0.smithi070.stderr: 66400K .......... .......... .......... .......... .......... 48% 5.25M 13s 2024-05-08T06:49:01.685 INFO:tasks.workunit.client.0.smithi070.stderr: 66450K .......... .......... .......... .......... .......... 48% 5.34M 13s 2024-05-08T06:49:01.695 INFO:tasks.workunit.client.0.smithi070.stderr: 66500K .......... .......... .......... .......... .......... 49% 4.61M 13s 2024-05-08T06:49:01.705 INFO:tasks.workunit.client.0.smithi070.stderr: 66550K .......... .......... .......... .......... .......... 49% 5.66M 13s 2024-05-08T06:49:01.713 INFO:tasks.workunit.client.0.smithi070.stderr: 66600K .......... .......... .......... .......... .......... 49% 5.79M 13s 2024-05-08T06:49:01.722 INFO:tasks.workunit.client.0.smithi070.stderr: 66650K .......... .......... .......... .......... .......... 49% 5.53M 13s 2024-05-08T06:49:01.732 INFO:tasks.workunit.client.0.smithi070.stderr: 66700K .......... .......... .......... .......... .......... 49% 4.72M 13s 2024-05-08T06:49:01.741 INFO:tasks.workunit.client.0.smithi070.stderr: 66750K .......... .......... .......... .......... .......... 49% 5.10M 13s 2024-05-08T06:49:01.750 INFO:tasks.workunit.client.0.smithi070.stderr: 66800K .......... .......... .......... .......... .......... 49% 5.81M 13s 2024-05-08T06:49:01.759 INFO:tasks.workunit.client.0.smithi070.stderr: 66850K .......... .......... .......... .......... .......... 49% 5.19M 13s 2024-05-08T06:49:01.770 INFO:tasks.workunit.client.0.smithi070.stderr: 66900K .......... .......... .......... .......... .......... 49% 4.64M 13s 2024-05-08T06:49:01.778 INFO:tasks.workunit.client.0.smithi070.stderr: 66950K .......... .......... .......... .......... .......... 49% 5.53M 13s 2024-05-08T06:49:01.787 INFO:tasks.workunit.client.0.smithi070.stderr: 67000K .......... .......... .......... .......... .......... 49% 5.38M 13s 2024-05-08T06:49:01.796 INFO:tasks.workunit.client.0.smithi070.stderr: 67050K .......... .......... .......... .......... .......... 49% 5.62M 13s 2024-05-08T06:49:01.806 INFO:tasks.workunit.client.0.smithi070.stderr: 67100K .......... .......... .......... .......... .......... 49% 4.80M 13s 2024-05-08T06:49:01.815 INFO:tasks.workunit.client.0.smithi070.stderr: 67150K .......... .......... .......... .......... .......... 49% 5.77M 13s 2024-05-08T06:49:01.823 INFO:tasks.workunit.client.0.smithi070.stderr: 67200K .......... .......... .......... .......... .......... 49% 5.93M 13s 2024-05-08T06:49:01.832 INFO:tasks.workunit.client.0.smithi070.stderr: 67250K .......... .......... .......... .......... .......... 49% 5.42M 13s 2024-05-08T06:49:01.843 INFO:tasks.workunit.client.0.smithi070.stderr: 67300K .......... .......... .......... .......... .......... 49% 4.64M 13s 2024-05-08T06:49:01.852 INFO:tasks.workunit.client.0.smithi070.stderr: 67350K .......... .......... .......... .......... .......... 49% 5.53M 13s 2024-05-08T06:49:01.861 INFO:tasks.workunit.client.0.smithi070.stderr: 67400K .......... .......... .......... .......... .......... 49% 5.06M 12s 2024-05-08T06:49:01.871 INFO:tasks.workunit.client.0.smithi070.stderr: 67450K .......... .......... .......... .......... .......... 49% 5.04M 12s 2024-05-08T06:49:01.882 INFO:tasks.workunit.client.0.smithi070.stderr: 67500K .......... .......... .......... .......... .......... 49% 4.32M 12s 2024-05-08T06:49:01.892 INFO:tasks.workunit.client.0.smithi070.stderr: 67550K .......... .......... .......... .......... .......... 49% 4.83M 12s 2024-05-08T06:49:01.901 INFO:tasks.workunit.client.0.smithi070.stderr: 67600K .......... .......... .......... .......... .......... 49% 5.24M 12s 2024-05-08T06:49:01.910 INFO:tasks.workunit.client.0.smithi070.stderr: 67650K .......... .......... .......... .......... .......... 49% 5.84M 12s 2024-05-08T06:49:01.922 INFO:tasks.workunit.client.0.smithi070.stderr: 67700K .......... .......... .......... .......... .......... 49% 4.24M 12s 2024-05-08T06:49:01.932 INFO:tasks.workunit.client.0.smithi070.stderr: 67750K .......... .......... .......... .......... .......... 49% 4.72M 12s 2024-05-08T06:49:01.943 INFO:tasks.workunit.client.0.smithi070.stderr: 67800K .......... .......... .......... .......... .......... 49% 4.50M 12s 2024-05-08T06:49:01.952 INFO:tasks.workunit.client.0.smithi070.stderr: 67850K .......... .......... .......... .......... .......... 50% 5.52M 12s 2024-05-08T06:49:01.963 INFO:tasks.workunit.client.0.smithi070.stderr: 67900K .......... .......... .......... .......... .......... 50% 4.34M 12s 2024-05-08T06:49:01.972 INFO:tasks.workunit.client.0.smithi070.stderr: 67950K .......... .......... .......... .......... .......... 50% 5.20M 12s 2024-05-08T06:49:01.982 INFO:tasks.workunit.client.0.smithi070.stderr: 68000K .......... .......... .......... .......... .......... 50% 5.02M 12s 2024-05-08T06:49:01.992 INFO:tasks.workunit.client.0.smithi070.stderr: 68050K .......... .......... .......... .......... .......... 50% 4.80M 12s 2024-05-08T06:49:02.004 INFO:tasks.workunit.client.0.smithi070.stderr: 68100K .......... .......... .......... .......... .......... 50% 4.11M 12s 2024-05-08T06:49:02.013 INFO:tasks.workunit.client.0.smithi070.stderr: 68150K .......... .......... .......... .......... .......... 50% 5.02M 12s 2024-05-08T06:49:02.022 INFO:tasks.workunit.client.0.smithi070.stderr: 68200K .......... .......... .......... .......... .......... 50% 5.71M 12s 2024-05-08T06:49:02.033 INFO:tasks.workunit.client.0.smithi070.stderr: 68250K .......... .......... .......... .......... .......... 50% 4.40M 12s 2024-05-08T06:49:02.044 INFO:tasks.workunit.client.0.smithi070.stderr: 68300K .......... .......... .......... .......... .......... 50% 4.42M 12s 2024-05-08T06:49:02.053 INFO:tasks.workunit.client.0.smithi070.stderr: 68350K .......... .......... .......... .......... .......... 50% 5.29M 12s 2024-05-08T06:49:02.064 INFO:tasks.workunit.client.0.smithi070.stderr: 68400K .......... .......... .......... .......... .......... 50% 4.78M 12s 2024-05-08T06:49:02.073 INFO:tasks.workunit.client.0.smithi070.stderr: 68450K .......... .......... .......... .......... .......... 50% 5.18M 12s 2024-05-08T06:49:02.085 INFO:tasks.workunit.client.0.smithi070.stderr: 68500K .......... .......... .......... .......... .......... 50% 4.19M 12s 2024-05-08T06:49:02.095 INFO:tasks.workunit.client.0.smithi070.stderr: 68550K .......... .......... .......... .......... .......... 50% 5.04M 12s 2024-05-08T06:49:02.104 INFO:tasks.workunit.client.0.smithi070.stderr: 68600K .......... .......... .......... .......... .......... 50% 5.03M 12s 2024-05-08T06:49:02.114 INFO:tasks.workunit.client.0.smithi070.stderr: 68650K .......... .......... .......... .......... .......... 50% 4.91M 12s 2024-05-08T06:49:02.125 INFO:tasks.workunit.client.0.smithi070.stderr: 68700K .......... .......... .......... .......... .......... 50% 4.46M 12s 2024-05-08T06:49:02.134 INFO:tasks.workunit.client.0.smithi070.stderr: 68750K .......... .......... .......... .......... .......... 50% 5.69M 12s 2024-05-08T06:49:02.143 INFO:tasks.workunit.client.0.smithi070.stderr: 68800K .......... .......... .......... .......... .......... 50% 5.49M 12s 2024-05-08T06:49:02.152 INFO:tasks.workunit.client.0.smithi070.stderr: 68850K .......... .......... .......... .......... .......... 50% 4.96M 12s 2024-05-08T06:49:02.164 INFO:tasks.workunit.client.0.smithi070.stderr: 68900K .......... .......... .......... .......... .......... 50% 4.30M 12s 2024-05-08T06:49:02.173 INFO:tasks.workunit.client.0.smithi070.stderr: 68950K .......... .......... .......... .......... .......... 50% 5.06M 12s 2024-05-08T06:49:02.181 INFO:tasks.workunit.client.0.smithi070.stderr: 69000K .......... .......... .......... .......... .......... 50% 6.01M 12s 2024-05-08T06:49:02.190 INFO:tasks.workunit.client.0.smithi070.stderr: 69050K .......... .......... .......... .......... .......... 50% 5.52M 12s 2024-05-08T06:49:02.200 INFO:tasks.workunit.client.0.smithi070.stderr: 69100K .......... .......... .......... .......... .......... 50% 4.96M 12s 2024-05-08T06:49:02.209 INFO:tasks.workunit.client.0.smithi070.stderr: 69150K .......... .......... .......... .......... .......... 50% 5.43M 12s 2024-05-08T06:49:02.218 INFO:tasks.workunit.client.0.smithi070.stderr: 69200K .......... .......... .......... .......... .......... 51% 5.72M 12s 2024-05-08T06:49:02.227 INFO:tasks.workunit.client.0.smithi070.stderr: 69250K .......... .......... .......... .......... .......... 51% 5.49M 12s 2024-05-08T06:49:02.237 INFO:tasks.workunit.client.0.smithi070.stderr: 69300K .......... .......... .......... .......... .......... 51% 4.78M 12s 2024-05-08T06:49:02.245 INFO:tasks.workunit.client.0.smithi070.stderr: 69350K .......... .......... .......... .......... .......... 51% 5.70M 12s 2024-05-08T06:49:02.255 INFO:tasks.workunit.client.0.smithi070.stderr: 69400K .......... .......... .......... .......... .......... 51% 5.12M 12s 2024-05-08T06:49:02.266 INFO:tasks.workunit.client.0.smithi070.stderr: 69450K .......... .......... .......... .......... .......... 51% 4.66M 12s 2024-05-08T06:49:02.279 INFO:tasks.workunit.client.0.smithi070.stderr: 69500K .......... .......... .......... .......... .......... 51% 3.64M 12s 2024-05-08T06:49:02.289 INFO:tasks.workunit.client.0.smithi070.stderr: 69550K .......... .......... .......... .......... .......... 51% 4.96M 12s 2024-05-08T06:49:02.299 INFO:tasks.workunit.client.0.smithi070.stderr: 69600K .......... .......... .......... .......... .......... 51% 5.03M 12s 2024-05-08T06:49:02.307 INFO:tasks.workunit.client.0.smithi070.stderr: 69650K .......... .......... .......... .......... .......... 51% 5.66M 12s 2024-05-08T06:49:02.319 INFO:tasks.workunit.client.0.smithi070.stderr: 69700K .......... .......... .......... .......... .......... 51% 3.97M 12s 2024-05-08T06:49:02.327 INFO:tasks.workunit.client.0.smithi070.stderr: 69750K .......... .......... .......... .......... .......... 51% 6.12M 12s 2024-05-08T06:49:02.335 INFO:tasks.workunit.client.0.smithi070.stderr: 69800K .......... .......... .......... .......... .......... 51% 6.43M 12s 2024-05-08T06:49:02.344 INFO:tasks.workunit.client.0.smithi070.stderr: 69850K .......... .......... .......... .......... .......... 51% 5.45M 12s 2024-05-08T06:49:02.354 INFO:tasks.workunit.client.0.smithi070.stderr: 69900K .......... .......... .......... .......... .......... 51% 4.94M 12s 2024-05-08T06:49:02.364 INFO:tasks.workunit.client.0.smithi070.stderr: 69950K .......... .......... .......... .......... .......... 51% 4.75M 12s 2024-05-08T06:49:02.372 INFO:tasks.workunit.client.0.smithi070.stderr: 70000K .......... .......... .......... .......... .......... 51% 6.37M 12s 2024-05-08T06:49:02.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:02 smithi070 ceph-mon[29591]: pgmap v77: 129 pgs: 129 active+clean; 45 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.7 MiB/s wr, 7 op/s 2024-05-08T06:49:02.380 INFO:tasks.workunit.client.0.smithi070.stderr: 70050K .......... .......... .......... .......... .......... 51% 5.95M 12s 2024-05-08T06:49:02.390 INFO:tasks.workunit.client.0.smithi070.stderr: 70100K .......... .......... .......... .......... .......... 51% 4.92M 12s 2024-05-08T06:49:02.398 INFO:tasks.workunit.client.0.smithi070.stderr: 70150K .......... .......... .......... .......... .......... 51% 5.73M 12s 2024-05-08T06:49:02.407 INFO:tasks.workunit.client.0.smithi070.stderr: 70200K .......... .......... .......... .......... .......... 51% 5.41M 12s 2024-05-08T06:49:02.415 INFO:tasks.workunit.client.0.smithi070.stderr: 70250K .......... .......... .......... .......... .......... 51% 6.27M 12s 2024-05-08T06:49:02.425 INFO:tasks.workunit.client.0.smithi070.stderr: 70300K .......... .......... .......... .......... .......... 51% 5.00M 12s 2024-05-08T06:49:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:02 smithi172 ceph-mon[33377]: pgmap v77: 129 pgs: 129 active+clean; 45 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.7 MiB/s wr, 7 op/s 2024-05-08T06:49:02.432 INFO:tasks.workunit.client.0.smithi070.stderr: 70350K .......... .......... .......... .......... .......... 51% 6.88M 12s 2024-05-08T06:49:02.439 INFO:tasks.workunit.client.0.smithi070.stderr: 70400K .......... .......... .......... .......... .......... 51% 6.73M 12s 2024-05-08T06:49:02.446 INFO:tasks.workunit.client.0.smithi070.stderr: 70450K .......... .......... .......... .......... .......... 51% 6.86M 12s 2024-05-08T06:49:02.454 INFO:tasks.workunit.client.0.smithi070.stderr: 70500K .......... .......... .......... .......... .......... 51% 5.82M 12s 2024-05-08T06:49:02.461 INFO:tasks.workunit.client.0.smithi070.stderr: 70550K .......... .......... .......... .......... .......... 52% 7.04M 12s 2024-05-08T06:49:02.469 INFO:tasks.workunit.client.0.smithi070.stderr: 70600K .......... .......... .......... .......... .......... 52% 6.86M 12s 2024-05-08T06:49:02.476 INFO:tasks.workunit.client.0.smithi070.stderr: 70650K .......... .......... .......... .......... .......... 52% 6.39M 12s 2024-05-08T06:49:02.485 INFO:tasks.workunit.client.0.smithi070.stderr: 70700K .......... .......... .......... .......... .......... 52% 5.49M 12s 2024-05-08T06:49:02.493 INFO:tasks.workunit.client.0.smithi070.stderr: 70750K .......... .......... .......... .......... .......... 52% 6.12M 12s 2024-05-08T06:49:02.502 INFO:tasks.workunit.client.0.smithi070.stderr: 70800K .......... .......... .......... .......... .......... 52% 5.87M 12s 2024-05-08T06:49:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:02 smithi194 ceph-mon[33679]: pgmap v77: 129 pgs: 129 active+clean; 45 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.7 MiB/s wr, 7 op/s 2024-05-08T06:49:02.511 INFO:tasks.workunit.client.0.smithi070.stderr: 70850K .......... .......... .......... .......... .......... 52% 5.22M 12s 2024-05-08T06:49:02.521 INFO:tasks.workunit.client.0.smithi070.stderr: 70900K .......... .......... .......... .......... .......... 52% 4.93M 12s 2024-05-08T06:49:02.529 INFO:tasks.workunit.client.0.smithi070.stderr: 70950K .......... .......... .......... .......... .......... 52% 5.64M 12s 2024-05-08T06:49:02.538 INFO:tasks.workunit.client.0.smithi070.stderr: 71000K .......... .......... .......... .......... .......... 52% 5.82M 12s 2024-05-08T06:49:02.546 INFO:tasks.workunit.client.0.smithi070.stderr: 71050K .......... .......... .......... .......... .......... 52% 5.64M 12s 2024-05-08T06:49:02.558 INFO:tasks.workunit.client.0.smithi070.stderr: 71100K .......... .......... .......... .......... .......... 52% 4.54M 12s 2024-05-08T06:49:02.566 INFO:tasks.workunit.client.0.smithi070.stderr: 71150K .......... .......... .......... .......... .......... 52% 5.31M 12s 2024-05-08T06:49:02.576 INFO:tasks.workunit.client.0.smithi070.stderr: 71200K .......... .......... .......... .......... .......... 52% 5.38M 12s 2024-05-08T06:49:02.585 INFO:tasks.workunit.client.0.smithi070.stderr: 71250K .......... .......... .......... .......... .......... 52% 5.13M 12s 2024-05-08T06:49:02.596 INFO:tasks.workunit.client.0.smithi070.stderr: 71300K .......... .......... .......... .......... .......... 52% 4.57M 12s 2024-05-08T06:49:02.605 INFO:tasks.workunit.client.0.smithi070.stderr: 71350K .......... .......... .......... .......... .......... 52% 5.14M 12s 2024-05-08T06:49:02.615 INFO:tasks.workunit.client.0.smithi070.stderr: 71400K .......... .......... .......... .......... .......... 52% 4.95M 12s 2024-05-08T06:49:02.625 INFO:tasks.workunit.client.0.smithi070.stderr: 71450K .......... .......... .......... .......... .......... 52% 5.35M 12s 2024-05-08T06:49:02.635 INFO:tasks.workunit.client.0.smithi070.stderr: 71500K .......... .......... .......... .......... .......... 52% 4.53M 12s 2024-05-08T06:49:02.644 INFO:tasks.workunit.client.0.smithi070.stderr: 71550K .......... .......... .......... .......... .......... 52% 5.27M 12s 2024-05-08T06:49:02.654 INFO:tasks.workunit.client.0.smithi070.stderr: 71600K .......... .......... .......... .......... .......... 52% 5.23M 12s 2024-05-08T06:49:02.663 INFO:tasks.workunit.client.0.smithi070.stderr: 71650K .......... .......... .......... .......... .......... 52% 5.11M 12s 2024-05-08T06:49:02.674 INFO:tasks.workunit.client.0.smithi070.stderr: 71700K .......... .......... .......... .......... .......... 52% 4.77M 12s 2024-05-08T06:49:02.683 INFO:tasks.workunit.client.0.smithi070.stderr: 71750K .......... .......... .......... .......... .......... 52% 5.49M 12s 2024-05-08T06:49:02.691 INFO:tasks.workunit.client.0.smithi070.stderr: 71800K .......... .......... .......... .......... .......... 52% 5.54M 12s 2024-05-08T06:49:02.700 INFO:tasks.workunit.client.0.smithi070.stderr: 71850K .......... .......... .......... .......... .......... 52% 5.69M 12s 2024-05-08T06:49:02.711 INFO:tasks.workunit.client.0.smithi070.stderr: 71900K .......... .......... .......... .......... .......... 53% 4.42M 12s 2024-05-08T06:49:02.721 INFO:tasks.workunit.client.0.smithi070.stderr: 71950K .......... .......... .......... .......... .......... 53% 5.10M 12s 2024-05-08T06:49:02.731 INFO:tasks.workunit.client.0.smithi070.stderr: 72000K .......... .......... .......... .......... .......... 53% 4.48M 12s 2024-05-08T06:49:02.741 INFO:tasks.workunit.client.0.smithi070.stderr: 72050K .......... .......... .......... .......... .......... 53% 5.10M 12s 2024-05-08T06:49:02.752 INFO:tasks.workunit.client.0.smithi070.stderr: 72100K .......... .......... .......... .......... .......... 53% 4.38M 12s 2024-05-08T06:49:02.762 INFO:tasks.workunit.client.0.smithi070.stderr: 72150K .......... .......... .......... .......... .......... 53% 5.24M 12s 2024-05-08T06:49:02.770 INFO:tasks.workunit.client.0.smithi070.stderr: 72200K .......... .......... .......... .......... .......... 53% 5.34M 12s 2024-05-08T06:49:02.779 INFO:tasks.workunit.client.0.smithi070.stderr: 72250K .......... .......... .......... .......... .......... 53% 5.61M 12s 2024-05-08T06:49:02.790 INFO:tasks.workunit.client.0.smithi070.stderr: 72300K .......... .......... .......... .......... .......... 53% 4.42M 12s 2024-05-08T06:49:02.800 INFO:tasks.workunit.client.0.smithi070.stderr: 72350K .......... .......... .......... .......... .......... 53% 5.09M 12s 2024-05-08T06:49:02.810 INFO:tasks.workunit.client.0.smithi070.stderr: 72400K .......... .......... .......... .......... .......... 53% 5.02M 12s 2024-05-08T06:49:02.818 INFO:tasks.workunit.client.0.smithi070.stderr: 72450K .......... .......... .......... .......... .......... 53% 5.42M 12s 2024-05-08T06:49:02.829 INFO:tasks.workunit.client.0.smithi070.stderr: 72500K .......... .......... .......... .......... .......... 53% 4.60M 12s 2024-05-08T06:49:02.838 INFO:tasks.workunit.client.0.smithi070.stderr: 72550K .......... .......... .......... .......... .......... 53% 5.44M 12s 2024-05-08T06:49:02.847 INFO:tasks.workunit.client.0.smithi070.stderr: 72600K .......... .......... .......... .......... .......... 53% 5.31M 12s 2024-05-08T06:49:02.856 INFO:tasks.workunit.client.0.smithi070.stderr: 72650K .......... .......... .......... .......... .......... 53% 5.55M 12s 2024-05-08T06:49:02.867 INFO:tasks.workunit.client.0.smithi070.stderr: 72700K .......... .......... .......... .......... .......... 53% 4.63M 12s 2024-05-08T06:49:02.874 INFO:tasks.workunit.client.0.smithi070.stderr: 72750K .......... .......... .......... .......... .......... 53% 6.19M 12s 2024-05-08T06:49:02.883 INFO:tasks.workunit.client.0.smithi070.stderr: 72800K .......... .......... .......... .......... .......... 53% 5.63M 12s 2024-05-08T06:49:02.894 INFO:tasks.workunit.client.0.smithi070.stderr: 72850K .......... .......... .......... .......... .......... 53% 4.85M 12s 2024-05-08T06:49:02.905 INFO:tasks.workunit.client.0.smithi070.stderr: 72900K .......... .......... .......... .......... .......... 53% 4.14M 12s 2024-05-08T06:49:02.915 INFO:tasks.workunit.client.0.smithi070.stderr: 72950K .......... .......... .......... .......... .......... 53% 4.88M 12s 2024-05-08T06:49:02.925 INFO:tasks.workunit.client.0.smithi070.stderr: 73000K .......... .......... .......... .......... .......... 53% 4.89M 12s 2024-05-08T06:49:02.935 INFO:tasks.workunit.client.0.smithi070.stderr: 73050K .......... .......... .......... .......... .......... 53% 4.94M 11s 2024-05-08T06:49:02.946 INFO:tasks.workunit.client.0.smithi070.stderr: 73100K .......... .......... .......... .......... .......... 53% 4.38M 11s 2024-05-08T06:49:02.956 INFO:tasks.workunit.client.0.smithi070.stderr: 73150K .......... .......... .......... .......... .......... 53% 5.23M 11s 2024-05-08T06:49:02.965 INFO:tasks.workunit.client.0.smithi070.stderr: 73200K .......... .......... .......... .......... .......... 53% 5.11M 11s 2024-05-08T06:49:02.975 INFO:tasks.workunit.client.0.smithi070.stderr: 73250K .......... .......... .......... .......... .......... 53% 5.10M 11s 2024-05-08T06:49:02.985 INFO:tasks.workunit.client.0.smithi070.stderr: 73300K .......... .......... .......... .......... .......... 54% 4.66M 11s 2024-05-08T06:49:02.994 INFO:tasks.workunit.client.0.smithi070.stderr: 73350K .......... .......... .......... .......... .......... 54% 5.60M 11s 2024-05-08T06:49:03.003 INFO:tasks.workunit.client.0.smithi070.stderr: 73400K .......... .......... .......... .......... .......... 54% 5.59M 11s 2024-05-08T06:49:03.012 INFO:tasks.workunit.client.0.smithi070.stderr: 73450K .......... .......... .......... .......... .......... 54% 5.21M 11s 2024-05-08T06:49:03.023 INFO:tasks.workunit.client.0.smithi070.stderr: 73500K .......... .......... .......... .......... .......... 54% 4.69M 11s 2024-05-08T06:49:03.033 INFO:tasks.workunit.client.0.smithi070.stderr: 73550K .......... .......... .......... .......... .......... 54% 4.82M 11s 2024-05-08T06:49:03.043 INFO:tasks.workunit.client.0.smithi070.stderr: 73600K .......... .......... .......... .......... .......... 54% 4.64M 11s 2024-05-08T06:49:03.053 INFO:tasks.workunit.client.0.smithi070.stderr: 73650K .......... .......... .......... .......... .......... 54% 4.75M 11s 2024-05-08T06:49:03.064 INFO:tasks.workunit.client.0.smithi070.stderr: 73700K .......... .......... .......... .......... .......... 54% 4.42M 11s 2024-05-08T06:49:03.071 INFO:tasks.workunit.client.0.smithi070.stderr: 73750K .......... .......... .......... .......... .......... 54% 6.72M 11s 2024-05-08T06:49:03.079 INFO:tasks.workunit.client.0.smithi070.stderr: 73800K .......... .......... .......... .......... .......... 54% 6.20M 11s 2024-05-08T06:49:03.088 INFO:tasks.workunit.client.0.smithi070.stderr: 73850K .......... .......... .......... .......... .......... 54% 5.98M 11s 2024-05-08T06:49:03.098 INFO:tasks.workunit.client.0.smithi070.stderr: 73900K .......... .......... .......... .......... .......... 54% 4.79M 11s 2024-05-08T06:49:03.107 INFO:tasks.workunit.client.0.smithi070.stderr: 73950K .......... .......... .......... .......... .......... 54% 5.31M 11s 2024-05-08T06:49:03.115 INFO:tasks.workunit.client.0.smithi070.stderr: 74000K .......... .......... .......... .......... .......... 54% 5.80M 11s 2024-05-08T06:49:03.124 INFO:tasks.workunit.client.0.smithi070.stderr: 74050K .......... .......... .......... .......... .......... 54% 5.84M 11s 2024-05-08T06:49:03.133 INFO:tasks.workunit.client.0.smithi070.stderr: 74100K .......... .......... .......... .......... .......... 54% 5.09M 11s 2024-05-08T06:49:03.142 INFO:tasks.workunit.client.0.smithi070.stderr: 74150K .......... .......... .......... .......... .......... 54% 5.58M 11s 2024-05-08T06:49:03.150 INFO:tasks.workunit.client.0.smithi070.stderr: 74200K .......... .......... .......... .......... .......... 54% 6.27M 11s 2024-05-08T06:49:03.159 INFO:tasks.workunit.client.0.smithi070.stderr: 74250K .......... .......... .......... .......... .......... 54% 5.42M 11s 2024-05-08T06:49:03.169 INFO:tasks.workunit.client.0.smithi070.stderr: 74300K .......... .......... .......... .......... .......... 54% 4.61M 11s 2024-05-08T06:49:03.178 INFO:tasks.workunit.client.0.smithi070.stderr: 74350K .......... .......... .......... .......... .......... 54% 6.08M 11s 2024-05-08T06:49:03.186 INFO:tasks.workunit.client.0.smithi070.stderr: 74400K .......... .......... .......... .......... .......... 54% 5.59M 11s 2024-05-08T06:49:03.195 INFO:tasks.workunit.client.0.smithi070.stderr: 74450K .......... .......... .......... .......... .......... 54% 5.88M 11s 2024-05-08T06:49:03.204 INFO:tasks.workunit.client.0.smithi070.stderr: 74500K .......... .......... .......... .......... .......... 54% 5.28M 11s 2024-05-08T06:49:03.209 INFO:tasks.workunit.client.0.smithi070.stderr: 74550K .......... .......... .......... .......... .......... 54% 7.98M 11s 2024-05-08T06:49:03.215 INFO:tasks.workunit.client.0.smithi070.stderr: 74600K .......... .......... .......... .......... .......... 54% 8.22M 11s 2024-05-08T06:49:03.221 INFO:tasks.workunit.client.0.smithi070.stderr: 74650K .......... .......... .......... .......... .......... 55% 8.07M 11s 2024-05-08T06:49:03.229 INFO:tasks.workunit.client.0.smithi070.stderr: 74700K .......... .......... .......... .......... .......... 55% 7.04M 11s 2024-05-08T06:49:03.236 INFO:tasks.workunit.client.0.smithi070.stderr: 74750K .......... .......... .......... .......... .......... 55% 6.88M 11s 2024-05-08T06:49:03.245 INFO:tasks.workunit.client.0.smithi070.stderr: 74800K .......... .......... .......... .......... .......... 55% 5.14M 11s 2024-05-08T06:49:03.255 INFO:tasks.workunit.client.0.smithi070.stderr: 74850K .......... .......... .......... .......... .......... 55% 5.39M 11s 2024-05-08T06:49:03.265 INFO:tasks.workunit.client.0.smithi070.stderr: 74900K .......... .......... .......... .......... .......... 55% 4.52M 11s 2024-05-08T06:49:03.275 INFO:tasks.workunit.client.0.smithi070.stderr: 74950K .......... .......... .......... .......... .......... 55% 5.21M 11s 2024-05-08T06:49:03.283 INFO:tasks.workunit.client.0.smithi070.stderr: 75000K .......... .......... .......... .......... .......... 55% 5.77M 11s 2024-05-08T06:49:03.293 INFO:tasks.workunit.client.0.smithi070.stderr: 75050K .......... .......... .......... .......... .......... 55% 5.28M 11s 2024-05-08T06:49:03.303 INFO:tasks.workunit.client.0.smithi070.stderr: 75100K .......... .......... .......... .......... .......... 55% 4.52M 11s 2024-05-08T06:49:03.313 INFO:tasks.workunit.client.0.smithi070.stderr: 75150K .......... .......... .......... .......... .......... 55% 5.28M 11s 2024-05-08T06:49:03.321 INFO:tasks.workunit.client.0.smithi070.stderr: 75200K .......... .......... .......... .......... .......... 55% 5.64M 11s 2024-05-08T06:49:03.331 INFO:tasks.workunit.client.0.smithi070.stderr: 75250K .......... .......... .......... .......... .......... 55% 5.14M 11s 2024-05-08T06:49:03.341 INFO:tasks.workunit.client.0.smithi070.stderr: 75300K .......... .......... .......... .......... .......... 55% 4.63M 11s 2024-05-08T06:49:03.351 INFO:tasks.workunit.client.0.smithi070.stderr: 75350K .......... .......... .......... .......... .......... 55% 5.17M 11s 2024-05-08T06:49:03.359 INFO:tasks.workunit.client.0.smithi070.stderr: 75400K .......... .......... .......... .......... .......... 55% 5.53M 11s 2024-05-08T06:49:03.368 INFO:tasks.workunit.client.0.smithi070.stderr: 75450K .......... .......... .......... .......... .......... 55% 5.34M 11s 2024-05-08T06:49:03.379 INFO:tasks.workunit.client.0.smithi070.stderr: 75500K .......... .......... .......... .......... .......... 55% 4.93M 11s 2024-05-08T06:49:03.388 INFO:tasks.workunit.client.0.smithi070.stderr: 75550K .......... .......... .......... .......... .......... 55% 5.13M 11s 2024-05-08T06:49:03.398 INFO:tasks.workunit.client.0.smithi070.stderr: 75600K .......... .......... .......... .......... .......... 55% 5.16M 11s 2024-05-08T06:49:03.407 INFO:tasks.workunit.client.0.smithi070.stderr: 75650K .......... .......... .......... .......... .......... 55% 5.34M 11s 2024-05-08T06:49:03.417 INFO:tasks.workunit.client.0.smithi070.stderr: 75700K .......... .......... .......... .......... .......... 55% 4.78M 11s 2024-05-08T06:49:03.426 INFO:tasks.workunit.client.0.smithi070.stderr: 75750K .......... .......... .......... .......... .......... 55% 5.15M 11s 2024-05-08T06:49:03.435 INFO:tasks.workunit.client.0.smithi070.stderr: 75800K .......... .......... .......... .......... .......... 55% 5.65M 11s 2024-05-08T06:49:03.444 INFO:tasks.workunit.client.0.smithi070.stderr: 75850K .......... .......... .......... .......... .......... 55% 5.43M 11s 2024-05-08T06:49:03.454 INFO:tasks.workunit.client.0.smithi070.stderr: 75900K .......... .......... .......... .......... .......... 55% 4.78M 11s 2024-05-08T06:49:03.463 INFO:tasks.workunit.client.0.smithi070.stderr: 75950K .......... .......... .......... .......... .......... 55% 5.55M 11s 2024-05-08T06:49:03.472 INFO:tasks.workunit.client.0.smithi070.stderr: 76000K .......... .......... .......... .......... .......... 56% 5.35M 11s 2024-05-08T06:49:03.481 INFO:tasks.workunit.client.0.smithi070.stderr: 76050K .......... .......... .......... .......... .......... 56% 5.50M 11s 2024-05-08T06:49:03.492 INFO:tasks.workunit.client.0.smithi070.stderr: 76100K .......... .......... .......... .......... .......... 56% 4.60M 11s 2024-05-08T06:49:03.500 INFO:tasks.workunit.client.0.smithi070.stderr: 76150K .......... .......... .......... .......... .......... 56% 5.50M 11s 2024-05-08T06:49:03.509 INFO:tasks.workunit.client.0.smithi070.stderr: 76200K .......... .......... .......... .......... .......... 56% 5.58M 11s 2024-05-08T06:49:03.518 INFO:tasks.workunit.client.0.smithi070.stderr: 76250K .......... .......... .......... .......... .......... 56% 5.55M 11s 2024-05-08T06:49:03.528 INFO:tasks.workunit.client.0.smithi070.stderr: 76300K .......... .......... .......... .......... .......... 56% 4.82M 11s 2024-05-08T06:49:03.536 INFO:tasks.workunit.client.0.smithi070.stderr: 76350K .......... .......... .......... .......... .......... 56% 6.09M 11s 2024-05-08T06:49:03.545 INFO:tasks.workunit.client.0.smithi070.stderr: 76400K .......... .......... .......... .......... .......... 56% 5.19M 11s 2024-05-08T06:49:03.554 INFO:tasks.workunit.client.0.smithi070.stderr: 76450K .......... .......... .......... .......... .......... 56% 5.54M 11s 2024-05-08T06:49:03.565 INFO:tasks.workunit.client.0.smithi070.stderr: 76500K .......... .......... .......... .......... .......... 56% 4.51M 11s 2024-05-08T06:49:03.574 INFO:tasks.workunit.client.0.smithi070.stderr: 76550K .......... .......... .......... .......... .......... 56% 5.33M 11s 2024-05-08T06:49:03.583 INFO:tasks.workunit.client.0.smithi070.stderr: 76600K .......... .......... .......... .......... .......... 56% 5.47M 11s 2024-05-08T06:49:03.592 INFO:tasks.workunit.client.0.smithi070.stderr: 76650K .......... .......... .......... .......... .......... 56% 5.53M 11s 2024-05-08T06:49:03.604 INFO:tasks.workunit.client.0.smithi070.stderr: 76700K .......... .......... .......... .......... .......... 56% 4.24M 11s 2024-05-08T06:49:03.614 INFO:tasks.workunit.client.0.smithi070.stderr: 76750K .......... .......... .......... .......... .......... 56% 4.76M 11s 2024-05-08T06:49:03.623 INFO:tasks.workunit.client.0.smithi070.stderr: 76800K .......... .......... .......... .......... .......... 56% 5.08M 11s 2024-05-08T06:49:03.633 INFO:tasks.workunit.client.0.smithi070.stderr: 76850K .......... .......... .......... .......... .......... 56% 5.26M 11s 2024-05-08T06:49:03.645 INFO:tasks.workunit.client.0.smithi070.stderr: 76900K .......... .......... .......... .......... .......... 56% 4.13M 11s 2024-05-08T06:49:03.654 INFO:tasks.workunit.client.0.smithi070.stderr: 76950K .......... .......... .......... .......... .......... 56% 5.40M 11s 2024-05-08T06:49:03.663 INFO:tasks.workunit.client.0.smithi070.stderr: 77000K .......... .......... .......... .......... .......... 56% 5.14M 11s 2024-05-08T06:49:03.673 INFO:tasks.workunit.client.0.smithi070.stderr: 77050K .......... .......... .......... .......... .......... 56% 4.95M 11s 2024-05-08T06:49:03.684 INFO:tasks.workunit.client.0.smithi070.stderr: 77100K .......... .......... .......... .......... .......... 56% 4.32M 11s 2024-05-08T06:49:03.695 INFO:tasks.workunit.client.0.smithi070.stderr: 77150K .......... .......... .......... .......... .......... 56% 4.68M 11s 2024-05-08T06:49:03.707 INFO:tasks.workunit.client.0.smithi070.stderr: 77200K .......... .......... .......... .......... .......... 56% 4.16M 11s 2024-05-08T06:49:03.716 INFO:tasks.workunit.client.0.smithi070.stderr: 77250K .......... .......... .......... .......... .......... 56% 4.96M 11s 2024-05-08T06:49:03.727 INFO:tasks.workunit.client.0.smithi070.stderr: 77300K .......... .......... .......... .......... .......... 56% 4.58M 11s 2024-05-08T06:49:03.736 INFO:tasks.workunit.client.0.smithi070.stderr: 77350K .......... .......... .......... .......... .......... 57% 5.38M 11s 2024-05-08T06:49:03.746 INFO:tasks.workunit.client.0.smithi070.stderr: 77400K .......... .......... .......... .......... .......... 57% 4.90M 11s 2024-05-08T06:49:03.757 INFO:tasks.workunit.client.0.smithi070.stderr: 77450K .......... .......... .......... .......... .......... 57% 4.67M 11s 2024-05-08T06:49:03.769 INFO:tasks.workunit.client.0.smithi070.stderr: 77500K .......... .......... .......... .......... .......... 57% 3.97M 11s 2024-05-08T06:49:03.778 INFO:tasks.workunit.client.0.smithi070.stderr: 77550K .......... .......... .......... .......... .......... 57% 5.21M 11s 2024-05-08T06:49:03.788 INFO:tasks.workunit.client.0.smithi070.stderr: 77600K .......... .......... .......... .......... .......... 57% 5.24M 11s 2024-05-08T06:49:03.799 INFO:tasks.workunit.client.0.smithi070.stderr: 77650K .......... .......... .......... .......... .......... 57% 4.37M 11s 2024-05-08T06:49:03.811 INFO:tasks.workunit.client.0.smithi070.stderr: 77700K .......... .......... .......... .......... .......... 57% 3.84M 11s 2024-05-08T06:49:03.821 INFO:tasks.workunit.client.0.smithi070.stderr: 77750K .......... .......... .......... .......... .......... 57% 5.27M 11s 2024-05-08T06:49:03.829 INFO:tasks.workunit.client.0.smithi070.stderr: 77800K .......... .......... .......... .......... .......... 57% 5.94M 11s 2024-05-08T06:49:03.836 INFO:tasks.workunit.client.0.smithi070.stderr: 77850K .......... .......... .......... .......... .......... 57% 7.01M 11s 2024-05-08T06:49:03.845 INFO:tasks.workunit.client.0.smithi070.stderr: 77900K .......... .......... .......... .......... .......... 57% 5.11M 11s 2024-05-08T06:49:03.852 INFO:tasks.workunit.client.0.smithi070.stderr: 77950K .......... .......... .......... .......... .......... 57% 7.00M 11s 2024-05-08T06:49:03.861 INFO:tasks.workunit.client.0.smithi070.stderr: 78000K .......... .......... .......... .......... .......... 57% 5.73M 11s 2024-05-08T06:49:03.869 INFO:tasks.workunit.client.0.smithi070.stderr: 78050K .......... .......... .......... .......... .......... 57% 5.65M 11s 2024-05-08T06:49:03.880 INFO:tasks.workunit.client.0.smithi070.stderr: 78100K .......... .......... .......... .......... .......... 57% 4.59M 11s 2024-05-08T06:49:03.889 INFO:tasks.workunit.client.0.smithi070.stderr: 78150K .......... .......... .......... .......... .......... 57% 5.57M 11s 2024-05-08T06:49:03.897 INFO:tasks.workunit.client.0.smithi070.stderr: 78200K .......... .......... .......... .......... .......... 57% 5.67M 11s 2024-05-08T06:49:03.906 INFO:tasks.workunit.client.0.smithi070.stderr: 78250K .......... .......... .......... .......... .......... 57% 6.01M 11s 2024-05-08T06:49:03.915 INFO:tasks.workunit.client.0.smithi070.stderr: 78300K .......... .......... .......... .......... .......... 57% 5.00M 11s 2024-05-08T06:49:03.923 INFO:tasks.workunit.client.0.smithi070.stderr: 78350K .......... .......... .......... .......... .......... 57% 6.20M 11s 2024-05-08T06:49:03.932 INFO:tasks.workunit.client.0.smithi070.stderr: 78400K .......... .......... .......... .......... .......... 57% 5.79M 11s 2024-05-08T06:49:03.940 INFO:tasks.workunit.client.0.smithi070.stderr: 78450K .......... .......... .......... .......... .......... 57% 5.60M 11s 2024-05-08T06:49:03.952 INFO:tasks.workunit.client.0.smithi070.stderr: 78500K .......... .......... .......... .......... .......... 57% 4.56M 11s 2024-05-08T06:49:03.960 INFO:tasks.workunit.client.0.smithi070.stderr: 78550K .......... .......... .......... .......... .......... 57% 5.30M 11s 2024-05-08T06:49:03.969 INFO:tasks.workunit.client.0.smithi070.stderr: 78600K .......... .......... .......... .......... .......... 57% 5.80M 10s 2024-05-08T06:49:03.977 INFO:tasks.workunit.client.0.smithi070.stderr: 78650K .......... .......... .......... .......... .......... 57% 5.61M 10s 2024-05-08T06:49:03.987 INFO:tasks.workunit.client.0.smithi070.stderr: 78700K .......... .......... .......... .......... .......... 58% 5.07M 10s 2024-05-08T06:49:03.994 INFO:tasks.workunit.client.0.smithi070.stderr: 78750K .......... .......... .......... .......... .......... 58% 6.47M 10s 2024-05-08T06:49:04.002 INFO:tasks.workunit.client.0.smithi070.stderr: 78800K .......... .......... .......... .......... .......... 58% 6.68M 10s 2024-05-08T06:49:04.010 INFO:tasks.workunit.client.0.smithi070.stderr: 78850K .......... .......... .......... .......... .......... 58% 6.18M 10s 2024-05-08T06:49:04.019 INFO:tasks.workunit.client.0.smithi070.stderr: 78900K .......... .......... .......... .......... .......... 58% 5.24M 10s 2024-05-08T06:49:04.027 INFO:tasks.workunit.client.0.smithi070.stderr: 78950K .......... .......... .......... .......... .......... 58% 6.74M 10s 2024-05-08T06:49:04.036 INFO:tasks.workunit.client.0.smithi070.stderr: 79000K .......... .......... .......... .......... .......... 58% 5.37M 10s 2024-05-08T06:49:04.045 INFO:tasks.workunit.client.0.smithi070.stderr: 79050K .......... .......... .......... .......... .......... 58% 5.18M 10s 2024-05-08T06:49:04.056 INFO:tasks.workunit.client.0.smithi070.stderr: 79100K .......... .......... .......... .......... .......... 58% 4.41M 10s 2024-05-08T06:49:04.064 INFO:tasks.workunit.client.0.smithi070.stderr: 79150K .......... .......... .......... .......... .......... 58% 5.92M 10s 2024-05-08T06:49:04.073 INFO:tasks.workunit.client.0.smithi070.stderr: 79200K .......... .......... .......... .......... .......... 58% 5.76M 10s 2024-05-08T06:49:04.082 INFO:tasks.workunit.client.0.smithi070.stderr: 79250K .......... .......... .......... .......... .......... 58% 5.48M 10s 2024-05-08T06:49:04.092 INFO:tasks.workunit.client.0.smithi070.stderr: 79300K .......... .......... .......... .......... .......... 58% 4.77M 10s 2024-05-08T06:49:04.101 INFO:tasks.workunit.client.0.smithi070.stderr: 79350K .......... .......... .......... .......... .......... 58% 5.19M 10s 2024-05-08T06:49:04.111 INFO:tasks.workunit.client.0.smithi070.stderr: 79400K .......... .......... .......... .......... .......... 58% 5.18M 10s 2024-05-08T06:49:04.120 INFO:tasks.workunit.client.0.smithi070.stderr: 79450K .......... .......... .......... .......... .......... 58% 5.00M 10s 2024-05-08T06:49:04.131 INFO:tasks.workunit.client.0.smithi070.stderr: 79500K .......... .......... .......... .......... .......... 58% 4.46M 10s 2024-05-08T06:49:04.141 INFO:tasks.workunit.client.0.smithi070.stderr: 79550K .......... .......... .......... .......... .......... 58% 5.35M 10s 2024-05-08T06:49:04.150 INFO:tasks.workunit.client.0.smithi070.stderr: 79600K .......... .......... .......... .......... .......... 58% 5.28M 10s 2024-05-08T06:49:04.159 INFO:tasks.workunit.client.0.smithi070.stderr: 79650K .......... .......... .......... .......... .......... 58% 5.36M 10s 2024-05-08T06:49:04.170 INFO:tasks.workunit.client.0.smithi070.stderr: 79700K .......... .......... .......... .......... .......... 58% 4.57M 10s 2024-05-08T06:49:04.179 INFO:tasks.workunit.client.0.smithi070.stderr: 79750K .......... .......... .......... .......... .......... 58% 5.15M 10s 2024-05-08T06:49:04.190 INFO:tasks.workunit.client.0.smithi070.stderr: 79800K .......... .......... .......... .......... .......... 58% 4.78M 10s 2024-05-08T06:49:04.199 INFO:tasks.workunit.client.0.smithi070.stderr: 79850K .......... .......... .......... .......... .......... 58% 4.97M 10s 2024-05-08T06:49:04.210 INFO:tasks.workunit.client.0.smithi070.stderr: 79900K .......... .......... .......... .......... .......... 58% 4.44M 10s 2024-05-08T06:49:04.219 INFO:tasks.workunit.client.0.smithi070.stderr: 79950K .......... .......... .......... .......... .......... 58% 5.32M 10s 2024-05-08T06:49:04.229 INFO:tasks.workunit.client.0.smithi070.stderr: 80000K .......... .......... .......... .......... .......... 58% 5.09M 10s 2024-05-08T06:49:04.238 INFO:tasks.workunit.client.0.smithi070.stderr: 80050K .......... .......... .......... .......... .......... 59% 5.38M 10s 2024-05-08T06:49:04.249 INFO:tasks.workunit.client.0.smithi070.stderr: 80100K .......... .......... .......... .......... .......... 59% 4.40M 10s 2024-05-08T06:49:04.259 INFO:tasks.workunit.client.0.smithi070.stderr: 80150K .......... .......... .......... .......... .......... 59% 5.13M 10s 2024-05-08T06:49:04.268 INFO:tasks.workunit.client.0.smithi070.stderr: 80200K .......... .......... .......... .......... .......... 59% 5.15M 10s 2024-05-08T06:49:04.278 INFO:tasks.workunit.client.0.smithi070.stderr: 80250K .......... .......... .......... .......... .......... 59% 4.91M 10s 2024-05-08T06:49:04.290 INFO:tasks.workunit.client.0.smithi070.stderr: 80300K .......... .......... .......... .......... .......... 59% 4.04M 10s 2024-05-08T06:49:04.301 INFO:tasks.workunit.client.0.smithi070.stderr: 80350K .......... .......... .......... .......... .......... 59% 4.71M 10s 2024-05-08T06:49:04.311 INFO:tasks.workunit.client.0.smithi070.stderr: 80400K .......... .......... .......... .......... .......... 59% 4.83M 10s 2024-05-08T06:49:04.320 INFO:tasks.workunit.client.0.smithi070.stderr: 80450K .......... .......... .......... .......... .......... 59% 5.08M 10s 2024-05-08T06:49:04.331 INFO:tasks.workunit.client.0.smithi070.stderr: 80500K .......... .......... .......... .......... .......... 59% 4.40M 10s 2024-05-08T06:49:04.341 INFO:tasks.workunit.client.0.smithi070.stderr: 80550K .......... .......... .......... .......... .......... 59% 5.05M 10s 2024-05-08T06:49:04.350 INFO:tasks.workunit.client.0.smithi070.stderr: 80600K .......... .......... .......... .......... .......... 59% 5.54M 10s 2024-05-08T06:49:04.360 INFO:tasks.workunit.client.0.smithi070.stderr: 80650K .......... .......... .......... .......... .......... 59% 4.76M 10s 2024-05-08T06:49:04.372 INFO:tasks.workunit.client.0.smithi070.stderr: 80700K .......... .......... .......... .......... .......... 59% 4.14M 10s 2024-05-08T06:49:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:04 smithi070 ceph-mon[29591]: pgmap v78: 129 pgs: 129 active+clean; 45 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.7 MiB/s wr, 7 op/s 2024-05-08T06:49:04.382 INFO:tasks.workunit.client.0.smithi070.stderr: 80750K .......... .......... .......... .......... .......... 59% 4.88M 10s 2024-05-08T06:49:04.391 INFO:tasks.workunit.client.0.smithi070.stderr: 80800K .......... .......... .......... .......... .......... 59% 5.05M 10s 2024-05-08T06:49:04.401 INFO:tasks.workunit.client.0.smithi070.stderr: 80850K .......... .......... .......... .......... .......... 59% 5.10M 10s 2024-05-08T06:49:04.413 INFO:tasks.workunit.client.0.smithi070.stderr: 80900K .......... .......... .......... .......... .......... 59% 4.07M 10s 2024-05-08T06:49:04.424 INFO:tasks.workunit.client.0.smithi070.stderr: 80950K .......... .......... .......... .......... .......... 59% 4.78M 10s 2024-05-08T06:49:04.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:04 smithi172 ceph-mon[33377]: pgmap v78: 129 pgs: 129 active+clean; 45 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.7 MiB/s wr, 7 op/s 2024-05-08T06:49:04.432 INFO:tasks.workunit.client.0.smithi070.stderr: 81000K .......... .......... .......... .......... .......... 59% 5.27M 10s 2024-05-08T06:49:04.441 INFO:tasks.workunit.client.0.smithi070.stderr: 81050K .......... .......... .......... .......... .......... 59% 5.65M 10s 2024-05-08T06:49:04.452 INFO:tasks.workunit.client.0.smithi070.stderr: 81100K .......... .......... .......... .......... .......... 59% 4.51M 10s 2024-05-08T06:49:04.461 INFO:tasks.workunit.client.0.smithi070.stderr: 81150K .......... .......... .......... .......... .......... 59% 5.22M 10s 2024-05-08T06:49:04.470 INFO:tasks.workunit.client.0.smithi070.stderr: 81200K .......... .......... .......... .......... .......... 59% 5.43M 10s 2024-05-08T06:49:04.480 INFO:tasks.workunit.client.0.smithi070.stderr: 81250K .......... .......... .......... .......... .......... 59% 5.16M 10s 2024-05-08T06:49:04.491 INFO:tasks.workunit.client.0.smithi070.stderr: 81300K .......... .......... .......... .......... .......... 59% 4.51M 10s 2024-05-08T06:49:04.500 INFO:tasks.workunit.client.0.smithi070.stderr: 81350K .......... .......... .......... .......... .......... 59% 5.18M 10s 2024-05-08T06:49:04.509 INFO:tasks.workunit.client.0.smithi070.stderr: 81400K .......... .......... .......... .......... .......... 59% 5.34M 10s 2024-05-08T06:49:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:04 smithi194 ceph-mon[33679]: pgmap v78: 129 pgs: 129 active+clean; 45 MiB data, 460 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 3.7 MiB/s wr, 7 op/s 2024-05-08T06:49:04.519 INFO:tasks.workunit.client.0.smithi070.stderr: 81450K .......... .......... .......... .......... .......... 60% 5.00M 10s 2024-05-08T06:49:04.530 INFO:tasks.workunit.client.0.smithi070.stderr: 81500K .......... .......... .......... .......... .......... 60% 4.35M 10s 2024-05-08T06:49:04.540 INFO:tasks.workunit.client.0.smithi070.stderr: 81550K .......... .......... .......... .......... .......... 60% 4.91M 10s 2024-05-08T06:49:04.550 INFO:tasks.workunit.client.0.smithi070.stderr: 81600K .......... .......... .......... .......... .......... 60% 5.00M 10s 2024-05-08T06:49:04.558 INFO:tasks.workunit.client.0.smithi070.stderr: 81650K .......... .......... .......... .......... .......... 60% 5.73M 10s 2024-05-08T06:49:04.567 INFO:tasks.workunit.client.0.smithi070.stderr: 81700K .......... .......... .......... .......... .......... 60% 5.57M 10s 2024-05-08T06:49:04.574 INFO:tasks.workunit.client.0.smithi070.stderr: 81750K .......... .......... .......... .......... .......... 60% 6.65M 10s 2024-05-08T06:49:04.581 INFO:tasks.workunit.client.0.smithi070.stderr: 81800K .......... .......... .......... .......... .......... 60% 6.85M 10s 2024-05-08T06:49:04.589 INFO:tasks.workunit.client.0.smithi070.stderr: 81850K .......... .......... .......... .......... .......... 60% 6.76M 10s 2024-05-08T06:49:04.596 INFO:tasks.workunit.client.0.smithi070.stderr: 81900K .......... .......... .......... .......... .......... 60% 6.20M 10s 2024-05-08T06:49:04.602 INFO:tasks.workunit.client.0.smithi070.stderr: 81950K .......... .......... .......... .......... .......... 60% 9.44M 10s 2024-05-08T06:49:04.607 INFO:tasks.workunit.client.0.smithi070.stderr: 82000K .......... .......... .......... .......... .......... 60% 8.89M 10s 2024-05-08T06:49:04.612 INFO:tasks.workunit.client.0.smithi070.stderr: 82050K .......... .......... .......... .......... .......... 60% 9.06M 10s 2024-05-08T06:49:04.621 INFO:tasks.workunit.client.0.smithi070.stderr: 82100K .......... .......... .......... .......... .......... 60% 5.92M 10s 2024-05-08T06:49:04.628 INFO:tasks.workunit.client.0.smithi070.stderr: 82150K .......... .......... .......... .......... .......... 60% 6.75M 10s 2024-05-08T06:49:04.639 INFO:tasks.workunit.client.0.smithi070.stderr: 82200K .......... .......... .......... .......... .......... 60% 4.57M 10s 2024-05-08T06:49:04.647 INFO:tasks.workunit.client.0.smithi070.stderr: 82250K .......... .......... .......... .......... .......... 60% 5.93M 10s 2024-05-08T06:49:04.654 INFO:tasks.workunit.client.0.smithi070.stderr: 82300K .......... .......... .......... .......... .......... 60% 6.81M 10s 2024-05-08T06:49:04.661 INFO:tasks.workunit.client.0.smithi070.stderr: 82350K .......... .......... .......... .......... .......... 60% 6.66M 10s 2024-05-08T06:49:04.669 INFO:tasks.workunit.client.0.smithi070.stderr: 82400K .......... .......... .......... .......... .......... 60% 6.13M 10s 2024-05-08T06:49:04.677 INFO:tasks.workunit.client.0.smithi070.stderr: 82450K .......... .......... .......... .......... .......... 60% 6.09M 10s 2024-05-08T06:49:04.687 INFO:tasks.workunit.client.0.smithi070.stderr: 82500K .......... .......... .......... .......... .......... 60% 5.12M 10s 2024-05-08T06:49:04.696 INFO:tasks.workunit.client.0.smithi070.stderr: 82550K .......... .......... .......... .......... .......... 60% 5.95M 10s 2024-05-08T06:49:04.705 INFO:tasks.workunit.client.0.smithi070.stderr: 82600K .......... .......... .......... .......... .......... 60% 5.28M 10s 2024-05-08T06:49:04.714 INFO:tasks.workunit.client.0.smithi070.stderr: 82650K .......... .......... .......... .......... .......... 60% 5.36M 10s 2024-05-08T06:49:04.726 INFO:tasks.workunit.client.0.smithi070.stderr: 82700K .......... .......... .......... .......... .......... 60% 4.23M 10s 2024-05-08T06:49:04.734 INFO:tasks.workunit.client.0.smithi070.stderr: 82750K .......... .......... .......... .......... .......... 60% 5.43M 10s 2024-05-08T06:49:04.742 INFO:tasks.workunit.client.0.smithi070.stderr: 82800K .......... .......... .......... .......... .......... 61% 5.78M 10s 2024-05-08T06:49:04.748 INFO:tasks.workunit.client.0.smithi070.stderr: 82850K .......... .......... .......... .......... .......... 61% 8.55M 10s 2024-05-08T06:49:04.755 INFO:tasks.workunit.client.0.smithi070.stderr: 82900K .......... .......... .......... .......... .......... 61% 6.68M 10s 2024-05-08T06:49:04.761 INFO:tasks.workunit.client.0.smithi070.stderr: 82950K .......... .......... .......... .......... .......... 61% 8.13M 10s 2024-05-08T06:49:04.767 INFO:tasks.workunit.client.0.smithi070.stderr: 83000K .......... .......... .......... .......... .......... 61% 8.88M 10s 2024-05-08T06:49:04.772 INFO:tasks.workunit.client.0.smithi070.stderr: 83050K .......... .......... .......... .......... .......... 61% 8.75M 10s 2024-05-08T06:49:04.779 INFO:tasks.workunit.client.0.smithi070.stderr: 83100K .......... .......... .......... .......... .......... 61% 7.08M 10s 2024-05-08T06:49:04.785 INFO:tasks.workunit.client.0.smithi070.stderr: 83150K .......... .......... .......... .......... .......... 61% 8.57M 10s 2024-05-08T06:49:04.790 INFO:tasks.workunit.client.0.smithi070.stderr: 83200K .......... .......... .......... .......... .......... 61% 8.62M 10s 2024-05-08T06:49:04.796 INFO:tasks.workunit.client.0.smithi070.stderr: 83250K .......... .......... .......... .......... .......... 61% 8.60M 10s 2024-05-08T06:49:04.803 INFO:tasks.workunit.client.0.smithi070.stderr: 83300K .......... .......... .......... .......... .......... 61% 7.60M 10s 2024-05-08T06:49:04.809 INFO:tasks.workunit.client.0.smithi070.stderr: 83350K .......... .......... .......... .......... .......... 61% 7.71M 10s 2024-05-08T06:49:04.818 INFO:tasks.workunit.client.0.smithi070.stderr: 83400K .......... .......... .......... .......... .......... 61% 5.64M 10s 2024-05-08T06:49:04.828 INFO:tasks.workunit.client.0.smithi070.stderr: 83450K .......... .......... .......... .......... .......... 61% 5.51M 10s 2024-05-08T06:49:04.839 INFO:tasks.workunit.client.0.smithi070.stderr: 83500K .......... .......... .......... .......... .......... 61% 4.27M 10s 2024-05-08T06:49:04.848 INFO:tasks.workunit.client.0.smithi070.stderr: 83550K .......... .......... .......... .......... .......... 61% 5.17M 10s 2024-05-08T06:49:04.857 INFO:tasks.workunit.client.0.smithi070.stderr: 83600K .......... .......... .......... .......... .......... 61% 5.15M 10s 2024-05-08T06:49:04.865 INFO:tasks.workunit.client.0.smithi070.stderr: 83650K .......... .......... .......... .......... .......... 61% 6.03M 10s 2024-05-08T06:49:04.873 INFO:tasks.workunit.client.0.smithi070.stderr: 83700K .......... .......... .......... .......... .......... 61% 6.17M 10s 2024-05-08T06:49:04.883 INFO:tasks.workunit.client.0.smithi070.stderr: 83750K .......... .......... .......... .......... .......... 61% 5.16M 10s 2024-05-08T06:49:04.892 INFO:tasks.workunit.client.0.smithi070.stderr: 83800K .......... .......... .......... .......... .......... 61% 5.42M 10s 2024-05-08T06:49:04.901 INFO:tasks.workunit.client.0.smithi070.stderr: 83850K .......... .......... .......... .......... .......... 61% 5.36M 10s 2024-05-08T06:49:04.913 INFO:tasks.workunit.client.0.smithi070.stderr: 83900K .......... .......... .......... .......... .......... 61% 4.35M 9s 2024-05-08T06:49:04.922 INFO:tasks.workunit.client.0.smithi070.stderr: 83950K .......... .......... .......... .......... .......... 61% 4.93M 9s 2024-05-08T06:49:04.931 INFO:tasks.workunit.client.0.smithi070.stderr: 84000K .......... .......... .......... .......... .......... 61% 5.47M 9s 2024-05-08T06:49:04.941 INFO:tasks.workunit.client.0.smithi070.stderr: 84050K .......... .......... .......... .......... .......... 61% 5.08M 9s 2024-05-08T06:49:04.951 INFO:tasks.workunit.client.0.smithi070.stderr: 84100K .......... .......... .......... .......... .......... 61% 4.64M 9s 2024-05-08T06:49:04.960 INFO:tasks.workunit.client.0.smithi070.stderr: 84150K .......... .......... .......... .......... .......... 62% 5.51M 9s 2024-05-08T06:49:04.969 INFO:tasks.workunit.client.0.smithi070.stderr: 84200K .......... .......... .......... .......... .......... 62% 5.40M 9s 2024-05-08T06:49:04.978 INFO:tasks.workunit.client.0.smithi070.stderr: 84250K .......... .......... .......... .......... .......... 62% 5.47M 9s 2024-05-08T06:49:04.989 INFO:tasks.workunit.client.0.smithi070.stderr: 84300K .......... .......... .......... .......... .......... 62% 4.72M 9s 2024-05-08T06:49:04.998 INFO:tasks.workunit.client.0.smithi070.stderr: 84350K .......... .......... .......... .......... .......... 62% 5.26M 9s 2024-05-08T06:49:05.007 INFO:tasks.workunit.client.0.smithi070.stderr: 84400K .......... .......... .......... .......... .......... 62% 5.38M 9s 2024-05-08T06:49:05.017 INFO:tasks.workunit.client.0.smithi070.stderr: 84450K .......... .......... .......... .......... .......... 62% 4.89M 9s 2024-05-08T06:49:05.029 INFO:tasks.workunit.client.0.smithi070.stderr: 84500K .......... .......... .......... .......... .......... 62% 4.18M 9s 2024-05-08T06:49:05.039 INFO:tasks.workunit.client.0.smithi070.stderr: 84550K .......... .......... .......... .......... .......... 62% 4.90M 9s 2024-05-08T06:49:05.048 INFO:tasks.workunit.client.0.smithi070.stderr: 84600K .......... .......... .......... .......... .......... 62% 5.04M 9s 2024-05-08T06:49:05.057 INFO:tasks.workunit.client.0.smithi070.stderr: 84650K .......... .......... .......... .......... .......... 62% 5.59M 9s 2024-05-08T06:49:05.066 INFO:tasks.workunit.client.0.smithi070.stderr: 84700K .......... .......... .......... .......... .......... 62% 5.09M 9s 2024-05-08T06:49:05.074 INFO:tasks.workunit.client.0.smithi070.stderr: 84750K .......... .......... .......... .......... .......... 62% 6.18M 9s 2024-05-08T06:49:05.083 INFO:tasks.workunit.client.0.smithi070.stderr: 84800K .......... .......... .......... .......... .......... 62% 5.71M 9s 2024-05-08T06:49:05.091 INFO:tasks.workunit.client.0.smithi070.stderr: 84850K .......... .......... .......... .......... .......... 62% 5.96M 9s 2024-05-08T06:49:05.101 INFO:tasks.workunit.client.0.smithi070.stderr: 84900K .......... .......... .......... .......... .......... 62% 4.98M 9s 2024-05-08T06:49:05.109 INFO:tasks.workunit.client.0.smithi070.stderr: 84950K .......... .......... .......... .......... .......... 62% 6.12M 9s 2024-05-08T06:49:05.119 INFO:tasks.workunit.client.0.smithi070.stderr: 85000K .......... .......... .......... .......... .......... 62% 4.90M 9s 2024-05-08T06:49:05.129 INFO:tasks.workunit.client.0.smithi070.stderr: 85050K .......... .......... .......... .......... .......... 62% 4.71M 9s 2024-05-08T06:49:05.141 INFO:tasks.workunit.client.0.smithi070.stderr: 85100K .......... .......... .......... .......... .......... 62% 4.33M 9s 2024-05-08T06:49:05.150 INFO:tasks.workunit.client.0.smithi070.stderr: 85150K .......... .......... .......... .......... .......... 62% 5.07M 9s 2024-05-08T06:49:05.159 INFO:tasks.workunit.client.0.smithi070.stderr: 85200K .......... .......... .......... .......... .......... 62% 5.31M 9s 2024-05-08T06:49:05.169 INFO:tasks.workunit.client.0.smithi070.stderr: 85250K .......... .......... .......... .......... .......... 62% 4.99M 9s 2024-05-08T06:49:05.181 INFO:tasks.workunit.client.0.smithi070.stderr: 85300K .......... .......... .......... .......... .......... 62% 4.34M 9s 2024-05-08T06:49:05.190 INFO:tasks.workunit.client.0.smithi070.stderr: 85350K .......... .......... .......... .......... .......... 62% 4.98M 9s 2024-05-08T06:49:05.199 INFO:tasks.workunit.client.0.smithi070.stderr: 85400K .......... .......... .......... .......... .......... 62% 5.33M 9s 2024-05-08T06:49:05.208 INFO:tasks.workunit.client.0.smithi070.stderr: 85450K .......... .......... .......... .......... .......... 62% 5.25M 9s 2024-05-08T06:49:05.219 INFO:tasks.workunit.client.0.smithi070.stderr: 85500K .......... .......... .......... .......... .......... 63% 4.65M 9s 2024-05-08T06:49:05.229 INFO:tasks.workunit.client.0.smithi070.stderr: 85550K .......... .......... .......... .......... .......... 63% 5.03M 9s 2024-05-08T06:49:05.238 INFO:tasks.workunit.client.0.smithi070.stderr: 85600K .......... .......... .......... .......... .......... 63% 5.27M 9s 2024-05-08T06:49:05.247 INFO:tasks.workunit.client.0.smithi070.stderr: 85650K .......... .......... .......... .......... .......... 63% 5.27M 9s 2024-05-08T06:49:05.259 INFO:tasks.workunit.client.0.smithi070.stderr: 85700K .......... .......... .......... .......... .......... 63% 4.28M 9s 2024-05-08T06:49:05.268 INFO:tasks.workunit.client.0.smithi070.stderr: 85750K .......... .......... .......... .......... .......... 63% 5.16M 9s 2024-05-08T06:49:05.278 INFO:tasks.workunit.client.0.smithi070.stderr: 85800K .......... .......... .......... .......... .......... 63% 5.08M 9s 2024-05-08T06:49:05.288 INFO:tasks.workunit.client.0.smithi070.stderr: 85850K .......... .......... .......... .......... .......... 63% 4.96M 9s 2024-05-08T06:49:05.298 INFO:tasks.workunit.client.0.smithi070.stderr: 85900K .......... .......... .......... .......... .......... 63% 4.52M 9s 2024-05-08T06:49:05.308 INFO:tasks.workunit.client.0.smithi070.stderr: 85950K .......... .......... .......... .......... .......... 63% 5.29M 9s 2024-05-08T06:49:05.317 INFO:tasks.workunit.client.0.smithi070.stderr: 86000K .......... .......... .......... .......... .......... 63% 5.29M 9s 2024-05-08T06:49:05.326 INFO:tasks.workunit.client.0.smithi070.stderr: 86050K .......... .......... .......... .......... .......... 63% 5.42M 9s 2024-05-08T06:49:05.336 INFO:tasks.workunit.client.0.smithi070.stderr: 86100K .......... .......... .......... .......... .......... 63% 4.77M 9s 2024-05-08T06:49:05.345 INFO:tasks.workunit.client.0.smithi070.stderr: 86150K .......... .......... .......... .......... .......... 63% 5.51M 9s 2024-05-08T06:49:05.355 INFO:tasks.workunit.client.0.smithi070.stderr: 86200K .......... .......... .......... .......... .......... 63% 5.07M 9s 2024-05-08T06:49:05.364 INFO:tasks.workunit.client.0.smithi070.stderr: 86250K .......... .......... .......... .......... .......... 63% 5.12M 9s 2024-05-08T06:49:05.375 INFO:tasks.workunit.client.0.smithi070.stderr: 86300K .......... .......... .......... .......... .......... 63% 4.59M 9s 2024-05-08T06:49:05.383 INFO:tasks.workunit.client.0.smithi070.stderr: 86350K .......... .......... .......... .......... .......... 63% 5.95M 9s 2024-05-08T06:49:05.392 INFO:tasks.workunit.client.0.smithi070.stderr: 86400K .......... .......... .......... .......... .......... 63% 5.53M 9s 2024-05-08T06:49:05.401 INFO:tasks.workunit.client.0.smithi070.stderr: 86450K .......... .......... .......... .......... .......... 63% 5.37M 9s 2024-05-08T06:49:05.411 INFO:tasks.workunit.client.0.smithi070.stderr: 86500K .......... .......... .......... .......... .......... 63% 4.76M 9s 2024-05-08T06:49:05.421 INFO:tasks.workunit.client.0.smithi070.stderr: 86550K .......... .......... .......... .......... .......... 63% 5.12M 9s 2024-05-08T06:49:05.429 INFO:tasks.workunit.client.0.smithi070.stderr: 86600K .......... .......... .......... .......... .......... 63% 5.52M 9s 2024-05-08T06:49:05.438 INFO:tasks.workunit.client.0.smithi070.stderr: 86650K .......... .......... .......... .......... .......... 63% 5.99M 9s 2024-05-08T06:49:05.447 INFO:tasks.workunit.client.0.smithi070.stderr: 86700K .......... .......... .......... .......... .......... 63% 5.04M 9s 2024-05-08T06:49:05.456 INFO:tasks.workunit.client.0.smithi070.stderr: 86750K .......... .......... .......... .......... .......... 63% 5.82M 9s 2024-05-08T06:49:05.465 INFO:tasks.workunit.client.0.smithi070.stderr: 86800K .......... .......... .......... .......... .......... 63% 5.53M 9s 2024-05-08T06:49:05.473 INFO:tasks.workunit.client.0.smithi070.stderr: 86850K .......... .......... .......... .......... .......... 64% 5.71M 9s 2024-05-08T06:49:05.483 INFO:tasks.workunit.client.0.smithi070.stderr: 86900K .......... .......... .......... .......... .......... 64% 5.08M 9s 2024-05-08T06:49:05.491 INFO:tasks.workunit.client.0.smithi070.stderr: 86950K .......... .......... .......... .......... .......... 64% 5.92M 9s 2024-05-08T06:49:05.500 INFO:tasks.workunit.client.0.smithi070.stderr: 87000K .......... .......... .......... .......... .......... 64% 5.45M 9s 2024-05-08T06:49:05.508 INFO:tasks.workunit.client.0.smithi070.stderr: 87050K .......... .......... .......... .......... .......... 64% 5.67M 9s 2024-05-08T06:49:05.519 INFO:tasks.workunit.client.0.smithi070.stderr: 87100K .......... .......... .......... .......... .......... 64% 4.68M 9s 2024-05-08T06:49:05.529 INFO:tasks.workunit.client.0.smithi070.stderr: 87150K .......... .......... .......... .......... .......... 64% 5.08M 9s 2024-05-08T06:49:05.537 INFO:tasks.workunit.client.0.smithi070.stderr: 87200K .......... .......... .......... .......... .......... 64% 5.97M 9s 2024-05-08T06:49:05.545 INFO:tasks.workunit.client.0.smithi070.stderr: 87250K .......... .......... .......... .......... .......... 64% 5.69M 9s 2024-05-08T06:49:05.556 INFO:tasks.workunit.client.0.smithi070.stderr: 87300K .......... .......... .......... .......... .......... 64% 4.55M 9s 2024-05-08T06:49:05.565 INFO:tasks.workunit.client.0.smithi070.stderr: 87350K .......... .......... .......... .......... .......... 64% 5.80M 9s 2024-05-08T06:49:05.574 INFO:tasks.workunit.client.0.smithi070.stderr: 87400K .......... .......... .......... .......... .......... 64% 5.38M 9s 2024-05-08T06:49:05.582 INFO:tasks.workunit.client.0.smithi070.stderr: 87450K .......... .......... .......... .......... .......... 64% 5.64M 9s 2024-05-08T06:49:05.593 INFO:tasks.workunit.client.0.smithi070.stderr: 87500K .......... .......... .......... .......... .......... 64% 4.61M 9s 2024-05-08T06:49:05.602 INFO:tasks.workunit.client.0.smithi070.stderr: 87550K .......... .......... .......... .......... .......... 64% 5.52M 9s 2024-05-08T06:49:05.611 INFO:tasks.workunit.client.0.smithi070.stderr: 87600K .......... .......... .......... .......... .......... 64% 5.51M 9s 2024-05-08T06:49:05.619 INFO:tasks.workunit.client.0.smithi070.stderr: 87650K .......... .......... .......... .......... .......... 64% 5.45M 9s 2024-05-08T06:49:05.629 INFO:tasks.workunit.client.0.smithi070.stderr: 87700K .......... .......... .......... .......... .......... 64% 5.47M 9s 2024-05-08T06:49:05.638 INFO:tasks.workunit.client.0.smithi070.stderr: 87750K .......... .......... .......... .......... .......... 64% 5.13M 9s 2024-05-08T06:49:05.646 INFO:tasks.workunit.client.0.smithi070.stderr: 87800K .......... .......... .......... .......... .......... 64% 5.89M 9s 2024-05-08T06:49:05.655 INFO:tasks.workunit.client.0.smithi070.stderr: 87850K .......... .......... .......... .......... .......... 64% 5.88M 9s 2024-05-08T06:49:05.664 INFO:tasks.workunit.client.0.smithi070.stderr: 87900K .......... .......... .......... .......... .......... 64% 5.18M 9s 2024-05-08T06:49:05.672 INFO:tasks.workunit.client.0.smithi070.stderr: 87950K .......... .......... .......... .......... .......... 64% 5.94M 9s 2024-05-08T06:49:05.680 INFO:tasks.workunit.client.0.smithi070.stderr: 88000K .......... .......... .......... .......... .......... 64% 5.88M 9s 2024-05-08T06:49:05.689 INFO:tasks.workunit.client.0.smithi070.stderr: 88050K .......... .......... .......... .......... .......... 64% 5.80M 9s 2024-05-08T06:49:05.699 INFO:tasks.workunit.client.0.smithi070.stderr: 88100K .......... .......... .......... .......... .......... 64% 4.81M 9s 2024-05-08T06:49:05.708 INFO:tasks.workunit.client.0.smithi070.stderr: 88150K .......... .......... .......... .......... .......... 64% 5.85M 9s 2024-05-08T06:49:05.716 INFO:tasks.workunit.client.0.smithi070.stderr: 88200K .......... .......... .......... .......... .......... 65% 5.74M 9s 2024-05-08T06:49:05.725 INFO:tasks.workunit.client.0.smithi070.stderr: 88250K .......... .......... .......... .......... .......... 65% 5.61M 9s 2024-05-08T06:49:05.735 INFO:tasks.workunit.client.0.smithi070.stderr: 88300K .......... .......... .......... .......... .......... 65% 4.61M 9s 2024-05-08T06:49:05.745 INFO:tasks.workunit.client.0.smithi070.stderr: 88350K .......... .......... .......... .......... .......... 65% 4.90M 9s 2024-05-08T06:49:05.754 INFO:tasks.workunit.client.0.smithi070.stderr: 88400K .......... .......... .......... .......... .......... 65% 5.25M 9s 2024-05-08T06:49:05.764 INFO:tasks.workunit.client.0.smithi070.stderr: 88450K .......... .......... .......... .......... .......... 65% 5.41M 9s 2024-05-08T06:49:05.774 INFO:tasks.workunit.client.0.smithi070.stderr: 88500K .......... .......... .......... .......... .......... 65% 4.55M 9s 2024-05-08T06:49:05.783 INFO:tasks.workunit.client.0.smithi070.stderr: 88550K .......... .......... .......... .......... .......... 65% 5.38M 9s 2024-05-08T06:49:05.792 INFO:tasks.workunit.client.0.smithi070.stderr: 88600K .......... .......... .......... .......... .......... 65% 5.72M 9s 2024-05-08T06:49:05.801 INFO:tasks.workunit.client.0.smithi070.stderr: 88650K .......... .......... .......... .......... .......... 65% 5.58M 9s 2024-05-08T06:49:05.811 INFO:tasks.workunit.client.0.smithi070.stderr: 88700K .......... .......... .......... .......... .......... 65% 4.77M 9s 2024-05-08T06:49:05.819 INFO:tasks.workunit.client.0.smithi070.stderr: 88750K .......... .......... .......... .......... .......... 65% 5.70M 9s 2024-05-08T06:49:05.828 INFO:tasks.workunit.client.0.smithi070.stderr: 88800K .......... .......... .......... .......... .......... 65% 5.85M 9s 2024-05-08T06:49:05.837 INFO:tasks.workunit.client.0.smithi070.stderr: 88850K .......... .......... .......... .......... .......... 65% 5.38M 9s 2024-05-08T06:49:05.847 INFO:tasks.workunit.client.0.smithi070.stderr: 88900K .......... .......... .......... .......... .......... 65% 4.60M 9s 2024-05-08T06:49:05.855 INFO:tasks.workunit.client.0.smithi070.stderr: 88950K .......... .......... .......... .......... .......... 65% 6.08M 9s 2024-05-08T06:49:05.863 INFO:tasks.workunit.client.0.smithi070.stderr: 89000K .......... .......... .......... .......... .......... 65% 6.01M 9s 2024-05-08T06:49:05.871 INFO:tasks.workunit.client.0.smithi070.stderr: 89050K .......... .......... .......... .......... .......... 65% 6.24M 9s 2024-05-08T06:49:05.881 INFO:tasks.workunit.client.0.smithi070.stderr: 89100K .......... .......... .......... .......... .......... 65% 5.07M 9s 2024-05-08T06:49:05.891 INFO:tasks.workunit.client.0.smithi070.stderr: 89150K .......... .......... .......... .......... .......... 65% 5.09M 9s 2024-05-08T06:49:05.902 INFO:tasks.workunit.client.0.smithi070.stderr: 89200K .......... .......... .......... .......... .......... 65% 4.54M 9s 2024-05-08T06:49:05.912 INFO:tasks.workunit.client.0.smithi070.stderr: 89250K .......... .......... .......... .......... .......... 65% 4.59M 9s 2024-05-08T06:49:05.924 INFO:tasks.workunit.client.0.smithi070.stderr: 89300K .......... .......... .......... .......... .......... 65% 4.04M 9s 2024-05-08T06:49:05.935 INFO:tasks.workunit.client.0.smithi070.stderr: 89350K .......... .......... .......... .......... .......... 65% 4.47M 9s 2024-05-08T06:49:05.946 INFO:tasks.workunit.client.0.smithi070.stderr: 89400K .......... .......... .......... .......... .......... 65% 4.54M 9s 2024-05-08T06:49:05.956 INFO:tasks.workunit.client.0.smithi070.stderr: 89450K .......... .......... .......... .......... .......... 65% 4.80M 8s 2024-05-08T06:49:05.967 INFO:tasks.workunit.client.0.smithi070.stderr: 89500K .......... .......... .......... .......... .......... 65% 4.43M 8s 2024-05-08T06:49:05.977 INFO:tasks.workunit.client.0.smithi070.stderr: 89550K .......... .......... .......... .......... .......... 66% 5.09M 8s 2024-05-08T06:49:05.986 INFO:tasks.workunit.client.0.smithi070.stderr: 89600K .......... .......... .......... .......... .......... 66% 5.14M 8s 2024-05-08T06:49:05.996 INFO:tasks.workunit.client.0.smithi070.stderr: 89650K .......... .......... .......... .......... .......... 66% 5.01M 8s 2024-05-08T06:49:06.008 INFO:tasks.workunit.client.0.smithi070.stderr: 89700K .......... .......... .......... .......... .......... 66% 4.28M 8s 2024-05-08T06:49:06.017 INFO:tasks.workunit.client.0.smithi070.stderr: 89750K .......... .......... .......... .......... .......... 66% 4.90M 8s 2024-05-08T06:49:06.027 INFO:tasks.workunit.client.0.smithi070.stderr: 89800K .......... .......... .......... .......... .......... 66% 5.25M 8s 2024-05-08T06:49:06.037 INFO:tasks.workunit.client.0.smithi070.stderr: 89850K .......... .......... .......... .......... .......... 66% 4.59M 8s 2024-05-08T06:49:06.048 INFO:tasks.workunit.client.0.smithi070.stderr: 89900K .......... .......... .......... .......... .......... 66% 4.53M 8s 2024-05-08T06:49:06.057 INFO:tasks.workunit.client.0.smithi070.stderr: 89950K .......... .......... .......... .......... .......... 66% 5.19M 8s 2024-05-08T06:49:06.066 INFO:tasks.workunit.client.0.smithi070.stderr: 90000K .......... .......... .......... .......... .......... 66% 5.32M 8s 2024-05-08T06:49:06.076 INFO:tasks.workunit.client.0.smithi070.stderr: 90050K .......... .......... .......... .......... .......... 66% 5.32M 8s 2024-05-08T06:49:06.086 INFO:tasks.workunit.client.0.smithi070.stderr: 90100K .......... .......... .......... .......... .......... 66% 4.50M 8s 2024-05-08T06:49:06.095 INFO:tasks.workunit.client.0.smithi070.stderr: 90150K .......... .......... .......... .......... .......... 66% 5.55M 8s 2024-05-08T06:49:06.105 INFO:tasks.workunit.client.0.smithi070.stderr: 90200K .......... .......... .......... .......... .......... 66% 5.27M 8s 2024-05-08T06:49:06.114 INFO:tasks.workunit.client.0.smithi070.stderr: 90250K .......... .......... .......... .......... .......... 66% 5.31M 8s 2024-05-08T06:49:06.124 INFO:tasks.workunit.client.0.smithi070.stderr: 90300K .......... .......... .......... .......... .......... 66% 4.87M 8s 2024-05-08T06:49:06.134 INFO:tasks.workunit.client.0.smithi070.stderr: 90350K .......... .......... .......... .......... .......... 66% 4.77M 8s 2024-05-08T06:49:06.141 INFO:tasks.workunit.client.0.smithi070.stderr: 90400K .......... .......... .......... .......... .......... 66% 6.38M 8s 2024-05-08T06:49:06.148 INFO:tasks.workunit.client.0.smithi070.stderr: 90450K .......... .......... .......... .......... .......... 66% 7.26M 8s 2024-05-08T06:49:06.158 INFO:tasks.workunit.client.0.smithi070.stderr: 90500K .......... .......... .......... .......... .......... 66% 5.15M 8s 2024-05-08T06:49:06.164 INFO:tasks.workunit.client.0.smithi070.stderr: 90550K .......... .......... .......... .......... .......... 66% 7.55M 8s 2024-05-08T06:49:06.168 INFO:tasks.workunit.client.0.smithi070.stderr: 90600K .......... .......... .......... .......... .......... 66% 10.4M 8s 2024-05-08T06:49:06.177 INFO:tasks.workunit.client.0.smithi070.stderr: 90650K .......... .......... .......... .......... .......... 66% 5.88M 8s 2024-05-08T06:49:06.186 INFO:tasks.workunit.client.0.smithi070.stderr: 90700K .......... .......... .......... .......... .......... 66% 5.67M 8s 2024-05-08T06:49:06.193 INFO:tasks.workunit.client.0.smithi070.stderr: 90750K .......... .......... .......... .......... .......... 66% 6.62M 8s 2024-05-08T06:49:06.202 INFO:tasks.workunit.client.0.smithi070.stderr: 90800K .......... .......... .......... .......... .......... 66% 5.46M 8s 2024-05-08T06:49:06.210 INFO:tasks.workunit.client.0.smithi070.stderr: 90850K .......... .......... .......... .......... .......... 66% 6.05M 8s 2024-05-08T06:49:06.219 INFO:tasks.workunit.client.0.smithi070.stderr: 90900K .......... .......... .......... .......... .......... 66% 5.46M 8s 2024-05-08T06:49:06.227 INFO:tasks.workunit.client.0.smithi070.stderr: 90950K .......... .......... .......... .......... .......... 67% 6.64M 8s 2024-05-08T06:49:06.234 INFO:tasks.workunit.client.0.smithi070.stderr: 91000K .......... .......... .......... .......... .......... 67% 6.53M 8s 2024-05-08T06:49:06.241 INFO:tasks.workunit.client.0.smithi070.stderr: 91050K .......... .......... .......... .......... .......... 67% 6.63M 8s 2024-05-08T06:49:06.250 INFO:tasks.workunit.client.0.smithi070.stderr: 91100K .......... .......... .......... .......... .......... 67% 5.58M 8s 2024-05-08T06:49:06.258 INFO:tasks.workunit.client.0.smithi070.stderr: 91150K .......... .......... .......... .......... .......... 67% 6.23M 8s 2024-05-08T06:49:06.266 INFO:tasks.workunit.client.0.smithi070.stderr: 91200K .......... .......... .......... .......... .......... 67% 6.36M 8s 2024-05-08T06:49:06.274 INFO:tasks.workunit.client.0.smithi070.stderr: 91250K .......... .......... .......... .......... .......... 67% 6.12M 8s 2024-05-08T06:49:06.283 INFO:tasks.workunit.client.0.smithi070.stderr: 91300K .......... .......... .......... .......... .......... 67% 5.22M 8s 2024-05-08T06:49:06.291 INFO:tasks.workunit.client.0.smithi070.stderr: 91350K .......... .......... .......... .......... .......... 67% 5.87M 8s 2024-05-08T06:49:06.300 INFO:tasks.workunit.client.0.smithi070.stderr: 91400K .......... .......... .......... .......... .......... 67% 5.91M 8s 2024-05-08T06:49:06.308 INFO:tasks.workunit.client.0.smithi070.stderr: 91450K .......... .......... .......... .......... .......... 67% 6.12M 8s 2024-05-08T06:49:06.318 INFO:tasks.workunit.client.0.smithi070.stderr: 91500K .......... .......... .......... .......... .......... 67% 4.88M 8s 2024-05-08T06:49:06.326 INFO:tasks.workunit.client.0.smithi070.stderr: 91550K .......... .......... .......... .......... .......... 67% 5.75M 8s 2024-05-08T06:49:06.335 INFO:tasks.workunit.client.0.smithi070.stderr: 91600K .......... .......... .......... .......... .......... 67% 5.88M 8s 2024-05-08T06:49:06.343 INFO:tasks.workunit.client.0.smithi070.stderr: 91650K .......... .......... .......... .......... .......... 67% 5.73M 8s 2024-05-08T06:49:06.352 INFO:tasks.workunit.client.0.smithi070.stderr: 91700K .......... .......... .......... .......... .......... 67% 5.05M 8s 2024-05-08T06:49:06.360 INFO:tasks.workunit.client.0.smithi070.stderr: 91750K .......... .......... .......... .......... .......... 67% 6.24M 8s 2024-05-08T06:49:06.368 INFO:tasks.workunit.client.0.smithi070.stderr: 91800K .......... .......... .......... .......... .......... 67% 6.15M 8s 2024-05-08T06:49:06.376 INFO:tasks.workunit.client.0.smithi070.stderr: 91850K .......... .......... .......... .......... .......... 67% 6.37M 8s 2024-05-08T06:49:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:06 smithi070 ceph-mon[29591]: pgmap v79: 129 pgs: 129 active+clean; 69 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 25 op/s 2024-05-08T06:49:06.386 INFO:tasks.workunit.client.0.smithi070.stderr: 91900K .......... .......... .......... .......... .......... 67% 4.79M 8s 2024-05-08T06:49:06.395 INFO:tasks.workunit.client.0.smithi070.stderr: 91950K .......... .......... .......... .......... .......... 67% 5.60M 8s 2024-05-08T06:49:06.404 INFO:tasks.workunit.client.0.smithi070.stderr: 92000K .......... .......... .......... .......... .......... 67% 5.39M 8s 2024-05-08T06:49:06.414 INFO:tasks.workunit.client.0.smithi070.stderr: 92050K .......... .......... .......... .......... .......... 67% 5.20M 8s 2024-05-08T06:49:06.425 INFO:tasks.workunit.client.0.smithi070.stderr: 92100K .......... .......... .......... .......... .......... 67% 4.41M 8s 2024-05-08T06:49:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:06 smithi172 ceph-mon[33377]: pgmap v79: 129 pgs: 129 active+clean; 69 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 25 op/s 2024-05-08T06:49:06.434 INFO:tasks.workunit.client.0.smithi070.stderr: 92150K .......... .......... .......... .......... .......... 67% 5.04M 8s 2024-05-08T06:49:06.443 INFO:tasks.workunit.client.0.smithi070.stderr: 92200K .......... .......... .......... .......... .......... 67% 5.44M 8s 2024-05-08T06:49:06.452 INFO:tasks.workunit.client.0.smithi070.stderr: 92250K .......... .......... .......... .......... .......... 67% 5.59M 8s 2024-05-08T06:49:06.462 INFO:tasks.workunit.client.0.smithi070.stderr: 92300K .......... .......... .......... .......... .......... 68% 4.62M 8s 2024-05-08T06:49:06.472 INFO:tasks.workunit.client.0.smithi070.stderr: 92350K .......... .......... .......... .......... .......... 68% 5.11M 8s 2024-05-08T06:49:06.482 INFO:tasks.workunit.client.0.smithi070.stderr: 92400K .......... .......... .......... .......... .......... 68% 5.17M 8s 2024-05-08T06:49:06.492 INFO:tasks.workunit.client.0.smithi070.stderr: 92450K .......... .......... .......... .......... .......... 68% 4.80M 8s 2024-05-08T06:49:06.503 INFO:tasks.workunit.client.0.smithi070.stderr: 92500K .......... .......... .......... .......... .......... 68% 4.27M 8s 2024-05-08T06:49:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:06 smithi194 ceph-mon[33679]: pgmap v79: 129 pgs: 129 active+clean; 69 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 25 op/s 2024-05-08T06:49:06.512 INFO:tasks.workunit.client.0.smithi070.stderr: 92550K .......... .......... .......... .......... .......... 68% 5.55M 8s 2024-05-08T06:49:06.521 INFO:tasks.workunit.client.0.smithi070.stderr: 92600K .......... .......... .......... .......... .......... 68% 5.72M 8s 2024-05-08T06:49:06.531 INFO:tasks.workunit.client.0.smithi070.stderr: 92650K .......... .......... .......... .......... .......... 68% 4.69M 8s 2024-05-08T06:49:06.543 INFO:tasks.workunit.client.0.smithi070.stderr: 92700K .......... .......... .......... .......... .......... 68% 3.98M 8s 2024-05-08T06:49:06.554 INFO:tasks.workunit.client.0.smithi070.stderr: 92750K .......... .......... .......... .......... .......... 68% 4.69M 8s 2024-05-08T06:49:06.564 INFO:tasks.workunit.client.0.smithi070.stderr: 92800K .......... .......... .......... .......... .......... 68% 4.80M 8s 2024-05-08T06:49:06.574 INFO:tasks.workunit.client.0.smithi070.stderr: 92850K .......... .......... .......... .......... .......... 68% 5.10M 8s 2024-05-08T06:49:06.585 INFO:tasks.workunit.client.0.smithi070.stderr: 92900K .......... .......... .......... .......... .......... 68% 4.32M 8s 2024-05-08T06:49:06.595 INFO:tasks.workunit.client.0.smithi070.stderr: 92950K .......... .......... .......... .......... .......... 68% 4.96M 8s 2024-05-08T06:49:06.604 INFO:tasks.workunit.client.0.smithi070.stderr: 93000K .......... .......... .......... .......... .......... 68% 5.01M 8s 2024-05-08T06:49:06.614 INFO:tasks.workunit.client.0.smithi070.stderr: 93050K .......... .......... .......... .......... .......... 68% 4.97M 8s 2024-05-08T06:49:06.626 INFO:tasks.workunit.client.0.smithi070.stderr: 93100K .......... .......... .......... .......... .......... 68% 4.03M 8s 2024-05-08T06:49:06.636 INFO:tasks.workunit.client.0.smithi070.stderr: 93150K .......... .......... .......... .......... .......... 68% 4.80M 8s 2024-05-08T06:49:06.646 INFO:tasks.workunit.client.0.smithi070.stderr: 93200K .......... .......... .......... .......... .......... 68% 4.98M 8s 2024-05-08T06:49:06.657 INFO:tasks.workunit.client.0.smithi070.stderr: 93250K .......... .......... .......... .......... .......... 68% 4.41M 8s 2024-05-08T06:49:06.671 INFO:tasks.workunit.client.0.smithi070.stderr: 93300K .......... .......... .......... .......... .......... 68% 3.70M 8s 2024-05-08T06:49:06.681 INFO:tasks.workunit.client.0.smithi070.stderr: 93350K .......... .......... .......... .......... .......... 68% 4.72M 8s 2024-05-08T06:49:06.691 INFO:tasks.workunit.client.0.smithi070.stderr: 93400K .......... .......... .......... .......... .......... 68% 4.58M 8s 2024-05-08T06:49:06.702 INFO:tasks.workunit.client.0.smithi070.stderr: 93450K .......... .......... .......... .......... .......... 68% 4.80M 8s 2024-05-08T06:49:06.712 INFO:tasks.workunit.client.0.smithi070.stderr: 93500K .......... .......... .......... .......... .......... 68% 4.85M 8s 2024-05-08T06:49:06.719 INFO:tasks.workunit.client.0.smithi070.stderr: 93550K .......... .......... .......... .......... .......... 68% 6.24M 8s 2024-05-08T06:49:06.725 INFO:tasks.workunit.client.0.smithi070.stderr: 93600K .......... .......... .......... .......... .......... 68% 9.23M 8s 2024-05-08T06:49:06.734 INFO:tasks.workunit.client.0.smithi070.stderr: 93650K .......... .......... .......... .......... .......... 69% 5.32M 8s 2024-05-08T06:49:06.746 INFO:tasks.workunit.client.0.smithi070.stderr: 93700K .......... .......... .......... .......... .......... 69% 4.05M 8s 2024-05-08T06:49:06.756 INFO:tasks.workunit.client.0.smithi070.stderr: 93750K .......... .......... .......... .......... .......... 69% 5.04M 8s 2024-05-08T06:49:06.766 INFO:tasks.workunit.client.0.smithi070.stderr: 93800K .......... .......... .......... .......... .......... 69% 4.97M 8s 2024-05-08T06:49:06.777 INFO:tasks.workunit.client.0.smithi070.stderr: 93850K .......... .......... .......... .......... .......... 69% 4.25M 8s 2024-05-08T06:49:06.787 INFO:tasks.workunit.client.0.smithi070.stderr: 93900K .......... .......... .......... .......... .......... 69% 4.88M 8s 2024-05-08T06:49:06.796 INFO:tasks.workunit.client.0.smithi070.stderr: 93950K .......... .......... .......... .......... .......... 69% 5.20M 8s 2024-05-08T06:49:06.806 INFO:tasks.workunit.client.0.smithi070.stderr: 94000K .......... .......... .......... .......... .......... 69% 5.25M 8s 2024-05-08T06:49:06.814 INFO:tasks.workunit.client.0.smithi070.stderr: 94050K .......... .......... .......... .......... .......... 69% 5.75M 8s 2024-05-08T06:49:06.825 INFO:tasks.workunit.client.0.smithi070.stderr: 94100K .......... .......... .......... .......... .......... 69% 4.39M 8s 2024-05-08T06:49:06.835 INFO:tasks.workunit.client.0.smithi070.stderr: 94150K .......... .......... .......... .......... .......... 69% 5.03M 8s 2024-05-08T06:49:06.845 INFO:tasks.workunit.client.0.smithi070.stderr: 94200K .......... .......... .......... .......... .......... 69% 4.95M 8s 2024-05-08T06:49:06.853 INFO:tasks.workunit.client.0.smithi070.stderr: 94250K .......... .......... .......... .......... .......... 69% 5.84M 8s 2024-05-08T06:49:06.859 INFO:tasks.workunit.client.0.smithi070.stderr: 94300K .......... .......... .......... .......... .......... 69% 7.65M 8s 2024-05-08T06:49:06.865 INFO:tasks.workunit.client.0.smithi070.stderr: 94350K .......... .......... .......... .......... .......... 69% 8.54M 8s 2024-05-08T06:49:06.874 INFO:tasks.workunit.client.0.smithi070.stderr: 94400K .......... .......... .......... .......... .......... 69% 5.92M 8s 2024-05-08T06:49:06.883 INFO:tasks.workunit.client.0.smithi070.stderr: 94450K .......... .......... .......... .......... .......... 69% 5.33M 8s 2024-05-08T06:49:06.892 INFO:tasks.workunit.client.0.smithi070.stderr: 94500K .......... .......... .......... .......... .......... 69% 5.08M 8s 2024-05-08T06:49:06.901 INFO:tasks.workunit.client.0.smithi070.stderr: 94550K .......... .......... .......... .......... .......... 69% 5.86M 8s 2024-05-08T06:49:06.906 INFO:tasks.workunit.client.0.smithi070.stderr: 94600K .......... .......... .......... .......... .......... 69% 7.85M 8s 2024-05-08T06:49:06.914 INFO:tasks.workunit.client.0.smithi070.stderr: 94650K .......... .......... .......... .......... .......... 69% 7.59M 8s 2024-05-08T06:49:06.921 INFO:tasks.workunit.client.0.smithi070.stderr: 94700K .......... .......... .......... .......... .......... 69% 6.10M 8s 2024-05-08T06:49:06.925 INFO:tasks.workunit.client.0.smithi070.stderr: 94750K .......... .......... .......... .......... .......... 69% 10.1M 8s 2024-05-08T06:49:06.930 INFO:tasks.workunit.client.0.smithi070.stderr: 94800K .......... .......... .......... .......... .......... 69% 10.3M 8s 2024-05-08T06:49:06.935 INFO:tasks.workunit.client.0.smithi070.stderr: 94850K .......... .......... .......... .......... .......... 69% 10.2M 7s 2024-05-08T06:49:06.941 INFO:tasks.workunit.client.0.smithi070.stderr: 94900K .......... .......... .......... .......... .......... 69% 8.61M 7s 2024-05-08T06:49:06.945 INFO:tasks.workunit.client.0.smithi070.stderr: 94950K .......... .......... .......... .......... .......... 69% 10.3M 7s 2024-05-08T06:49:06.950 INFO:tasks.workunit.client.0.smithi070.stderr: 95000K .......... .......... .......... .......... .......... 70% 10.2M 7s 2024-05-08T06:49:06.955 INFO:tasks.workunit.client.0.smithi070.stderr: 95050K .......... .......... .......... .......... .......... 70% 10.5M 7s 2024-05-08T06:49:06.962 INFO:tasks.workunit.client.0.smithi070.stderr: 95100K .......... .......... .......... .......... .......... 70% 7.24M 7s 2024-05-08T06:49:06.970 INFO:tasks.workunit.client.0.smithi070.stderr: 95150K .......... .......... .......... .......... .......... 70% 6.25M 7s 2024-05-08T06:49:06.978 INFO:tasks.workunit.client.0.smithi070.stderr: 95200K .......... .......... .......... .......... .......... 70% 6.20M 7s 2024-05-08T06:49:06.987 INFO:tasks.workunit.client.0.smithi070.stderr: 95250K .......... .......... .......... .......... .......... 70% 5.22M 7s 2024-05-08T06:49:06.998 INFO:tasks.workunit.client.0.smithi070.stderr: 95300K .......... .......... .......... .......... .......... 70% 4.55M 7s 2024-05-08T06:49:07.005 INFO:tasks.workunit.client.0.smithi070.stderr: 95350K .......... .......... .......... .......... .......... 70% 6.65M 7s 2024-05-08T06:49:07.013 INFO:tasks.workunit.client.0.smithi070.stderr: 95400K .......... .......... .......... .......... .......... 70% 6.11M 7s 2024-05-08T06:49:07.023 INFO:tasks.workunit.client.0.smithi070.stderr: 95450K .......... .......... .......... .......... .......... 70% 5.31M 7s 2024-05-08T06:49:07.034 INFO:tasks.workunit.client.0.smithi070.stderr: 95500K .......... .......... .......... .......... .......... 70% 4.19M 7s 2024-05-08T06:49:07.044 INFO:tasks.workunit.client.0.smithi070.stderr: 95550K .......... .......... .......... .......... .......... 70% 5.12M 7s 2024-05-08T06:49:07.054 INFO:tasks.workunit.client.0.smithi070.stderr: 95600K .......... .......... .......... .......... .......... 70% 4.96M 7s 2024-05-08T06:49:07.063 INFO:tasks.workunit.client.0.smithi070.stderr: 95650K .......... .......... .......... .......... .......... 70% 5.43M 7s 2024-05-08T06:49:07.072 INFO:tasks.workunit.client.0.smithi070.stderr: 95700K .......... .......... .......... .......... .......... 70% 4.98M 7s 2024-05-08T06:49:07.081 INFO:tasks.workunit.client.0.smithi070.stderr: 95750K .......... .......... .......... .......... .......... 70% 5.75M 7s 2024-05-08T06:49:07.090 INFO:tasks.workunit.client.0.smithi070.stderr: 95800K .......... .......... .......... .......... .......... 70% 5.59M 7s 2024-05-08T06:49:07.099 INFO:tasks.workunit.client.0.smithi070.stderr: 95850K .......... .......... .......... .......... .......... 70% 5.26M 7s 2024-05-08T06:49:07.110 INFO:tasks.workunit.client.0.smithi070.stderr: 95900K .......... .......... .......... .......... .......... 70% 4.62M 7s 2024-05-08T06:49:07.118 INFO:tasks.workunit.client.0.smithi070.stderr: 95950K .......... .......... .......... .......... .......... 70% 5.64M 7s 2024-05-08T06:49:07.127 INFO:tasks.workunit.client.0.smithi070.stderr: 96000K .......... .......... .......... .......... .......... 70% 5.54M 7s 2024-05-08T06:49:07.137 INFO:tasks.workunit.client.0.smithi070.stderr: 96050K .......... .......... .......... .......... .......... 70% 5.29M 7s 2024-05-08T06:49:07.148 INFO:tasks.workunit.client.0.smithi070.stderr: 96100K .......... .......... .......... .......... .......... 70% 4.32M 7s 2024-05-08T06:49:07.157 INFO:tasks.workunit.client.0.smithi070.stderr: 96150K .......... .......... .......... .......... .......... 70% 4.90M 7s 2024-05-08T06:49:07.167 INFO:tasks.workunit.client.0.smithi070.stderr: 96200K .......... .......... .......... .......... .......... 70% 5.24M 7s 2024-05-08T06:49:07.176 INFO:tasks.workunit.client.0.smithi070.stderr: 96250K .......... .......... .......... .......... .......... 70% 5.58M 7s 2024-05-08T06:49:07.186 INFO:tasks.workunit.client.0.smithi070.stderr: 96300K .......... .......... .......... .......... .......... 70% 4.46M 7s 2024-05-08T06:49:07.196 INFO:tasks.workunit.client.0.smithi070.stderr: 96350K .......... .......... .......... .......... .......... 71% 5.36M 7s 2024-05-08T06:49:07.205 INFO:tasks.workunit.client.0.smithi070.stderr: 96400K .......... .......... .......... .......... .......... 71% 5.07M 7s 2024-05-08T06:49:07.214 INFO:tasks.workunit.client.0.smithi070.stderr: 96450K .......... .......... .......... .......... .......... 71% 5.60M 7s 2024-05-08T06:49:07.225 INFO:tasks.workunit.client.0.smithi070.stderr: 96500K .......... .......... .......... .......... .......... 71% 4.55M 7s 2024-05-08T06:49:07.234 INFO:tasks.workunit.client.0.smithi070.stderr: 96550K .......... .......... .......... .......... .......... 71% 5.08M 7s 2024-05-08T06:49:07.244 INFO:tasks.workunit.client.0.smithi070.stderr: 96600K .......... .......... .......... .......... .......... 71% 4.97M 7s 2024-05-08T06:49:07.253 INFO:tasks.workunit.client.0.smithi070.stderr: 96650K .......... .......... .......... .......... .......... 71% 5.30M 7s 2024-05-08T06:49:07.264 INFO:tasks.workunit.client.0.smithi070.stderr: 96700K .......... .......... .......... .......... .......... 71% 4.68M 7s 2024-05-08T06:49:07.273 INFO:tasks.workunit.client.0.smithi070.stderr: 96750K .......... .......... .......... .......... .......... 71% 5.56M 7s 2024-05-08T06:49:07.282 INFO:tasks.workunit.client.0.smithi070.stderr: 96800K .......... .......... .......... .......... .......... 71% 5.03M 7s 2024-05-08T06:49:07.292 INFO:tasks.workunit.client.0.smithi070.stderr: 96850K .......... .......... .......... .......... .......... 71% 4.93M 7s 2024-05-08T06:49:07.303 INFO:tasks.workunit.client.0.smithi070.stderr: 96900K .......... .......... .......... .......... .......... 71% 4.38M 7s 2024-05-08T06:49:07.312 INFO:tasks.workunit.client.0.smithi070.stderr: 96950K .......... .......... .......... .......... .......... 71% 5.75M 7s 2024-05-08T06:49:07.321 INFO:tasks.workunit.client.0.smithi070.stderr: 97000K .......... .......... .......... .......... .......... 71% 5.12M 7s 2024-05-08T06:49:07.331 INFO:tasks.workunit.client.0.smithi070.stderr: 97050K .......... .......... .......... .......... .......... 71% 4.92M 7s 2024-05-08T06:49:07.343 INFO:tasks.workunit.client.0.smithi070.stderr: 97100K .......... .......... .......... .......... .......... 71% 4.21M 7s 2024-05-08T06:49:07.351 INFO:tasks.workunit.client.0.smithi070.stderr: 97150K .......... .......... .......... .......... .......... 71% 5.76M 7s 2024-05-08T06:49:07.360 INFO:tasks.workunit.client.0.smithi070.stderr: 97200K .......... .......... .......... .......... .......... 71% 5.91M 7s 2024-05-08T06:49:07.370 INFO:tasks.workunit.client.0.smithi070.stderr: 97250K .......... .......... .......... .......... .......... 71% 4.90M 7s 2024-05-08T06:49:07.381 INFO:tasks.workunit.client.0.smithi070.stderr: 97300K .......... .......... .......... .......... .......... 71% 4.24M 7s 2024-05-08T06:49:07.391 INFO:tasks.workunit.client.0.smithi070.stderr: 97350K .......... .......... .......... .......... .......... 71% 4.88M 7s 2024-05-08T06:49:07.401 INFO:tasks.workunit.client.0.smithi070.stderr: 97400K .......... .......... .......... .......... .......... 71% 4.78M 7s 2024-05-08T06:49:07.411 INFO:tasks.workunit.client.0.smithi070.stderr: 97450K .......... .......... .......... .......... .......... 71% 4.92M 7s 2024-05-08T06:49:07.424 INFO:tasks.workunit.client.0.smithi070.stderr: 97500K .......... .......... .......... .......... .......... 71% 4.02M 7s 2024-05-08T06:49:07.433 INFO:tasks.workunit.client.0.smithi070.stderr: 97550K .......... .......... .......... .......... .......... 71% 5.02M 7s 2024-05-08T06:49:07.444 INFO:tasks.workunit.client.0.smithi070.stderr: 97600K .......... .......... .......... .......... .......... 71% 4.76M 7s 2024-05-08T06:49:07.454 INFO:tasks.workunit.client.0.smithi070.stderr: 97650K .......... .......... .......... .......... .......... 71% 4.76M 7s 2024-05-08T06:49:07.465 INFO:tasks.workunit.client.0.smithi070.stderr: 97700K .......... .......... .......... .......... .......... 72% 4.48M 7s 2024-05-08T06:49:07.474 INFO:tasks.workunit.client.0.smithi070.stderr: 97750K .......... .......... .......... .......... .......... 72% 5.31M 7s 2024-05-08T06:49:07.482 INFO:tasks.workunit.client.0.smithi070.stderr: 97800K .......... .......... .......... .......... .......... 72% 5.68M 7s 2024-05-08T06:49:07.492 INFO:tasks.workunit.client.0.smithi070.stderr: 97850K .......... .......... .......... .......... .......... 72% 5.02M 7s 2024-05-08T06:49:07.504 INFO:tasks.workunit.client.0.smithi070.stderr: 97900K .......... .......... .......... .......... .......... 72% 4.23M 7s 2024-05-08T06:49:07.514 INFO:tasks.workunit.client.0.smithi070.stderr: 97950K .......... .......... .......... .......... .......... 72% 4.85M 7s 2024-05-08T06:49:07.524 INFO:tasks.workunit.client.0.smithi070.stderr: 98000K .......... .......... .......... .......... .......... 72% 5.01M 7s 2024-05-08T06:49:07.533 INFO:tasks.workunit.client.0.smithi070.stderr: 98050K .......... .......... .......... .......... .......... 72% 5.03M 7s 2024-05-08T06:49:07.545 INFO:tasks.workunit.client.0.smithi070.stderr: 98100K .......... .......... .......... .......... .......... 72% 4.20M 7s 2024-05-08T06:49:07.556 INFO:tasks.workunit.client.0.smithi070.stderr: 98150K .......... .......... .......... .......... .......... 72% 4.60M 7s 2024-05-08T06:49:07.567 INFO:tasks.workunit.client.0.smithi070.stderr: 98200K .......... .......... .......... .......... .......... 72% 4.48M 7s 2024-05-08T06:49:07.577 INFO:tasks.workunit.client.0.smithi070.stderr: 98250K .......... .......... .......... .......... .......... 72% 4.58M 7s 2024-05-08T06:49:07.588 INFO:tasks.workunit.client.0.smithi070.stderr: 98300K .......... .......... .......... .......... .......... 72% 4.55M 7s 2024-05-08T06:49:07.597 INFO:tasks.workunit.client.0.smithi070.stderr: 98350K .......... .......... .......... .......... .......... 72% 5.39M 7s 2024-05-08T06:49:07.606 INFO:tasks.workunit.client.0.smithi070.stderr: 98400K .......... .......... .......... .......... .......... 72% 5.52M 7s 2024-05-08T06:49:07.613 INFO:tasks.workunit.client.0.smithi070.stderr: 98450K .......... .......... .......... .......... .......... 72% 6.15M 7s 2024-05-08T06:49:07.624 INFO:tasks.workunit.client.0.smithi070.stderr: 98500K .......... .......... .......... .......... .......... 72% 4.74M 7s 2024-05-08T06:49:07.633 INFO:tasks.workunit.client.0.smithi070.stderr: 98550K .......... .......... .......... .......... .......... 72% 5.36M 7s 2024-05-08T06:49:07.641 INFO:tasks.workunit.client.0.smithi070.stderr: 98600K .......... .......... .......... .......... .......... 72% 5.53M 7s 2024-05-08T06:49:07.649 INFO:tasks.workunit.client.0.smithi070.stderr: 98650K .......... .......... .......... .......... .......... 72% 6.69M 7s 2024-05-08T06:49:07.656 INFO:tasks.workunit.client.0.smithi070.stderr: 98700K .......... .......... .......... .......... .......... 72% 6.00M 7s 2024-05-08T06:49:07.662 INFO:tasks.workunit.client.0.smithi070.stderr: 98750K .......... .......... .......... .......... .......... 72% 9.70M 7s 2024-05-08T06:49:07.666 INFO:tasks.workunit.client.0.smithi070.stderr: 98800K .......... .......... .......... .......... .......... 72% 10.5M 7s 2024-05-08T06:49:07.674 INFO:tasks.workunit.client.0.smithi070.stderr: 98850K .......... .......... .......... .......... .......... 72% 7.00M 7s 2024-05-08T06:49:07.683 INFO:tasks.workunit.client.0.smithi070.stderr: 98900K .......... .......... .......... .......... .......... 72% 5.53M 7s 2024-05-08T06:49:07.691 INFO:tasks.workunit.client.0.smithi070.stderr: 98950K .......... .......... .......... .......... .......... 72% 5.47M 7s 2024-05-08T06:49:07.700 INFO:tasks.workunit.client.0.smithi070.stderr: 99000K .......... .......... .......... .......... .......... 72% 5.96M 7s 2024-05-08T06:49:07.709 INFO:tasks.workunit.client.0.smithi070.stderr: 99050K .......... .......... .......... .......... .......... 73% 5.49M 7s 2024-05-08T06:49:07.718 INFO:tasks.workunit.client.0.smithi070.stderr: 99100K .......... .......... .......... .......... .......... 73% 5.07M 7s 2024-05-08T06:49:07.727 INFO:tasks.workunit.client.0.smithi070.stderr: 99150K .......... .......... .......... .......... .......... 73% 5.65M 7s 2024-05-08T06:49:07.734 INFO:tasks.workunit.client.0.smithi070.stderr: 99200K .......... .......... .......... .......... .......... 73% 7.11M 7s 2024-05-08T06:49:07.743 INFO:tasks.workunit.client.0.smithi070.stderr: 99250K .......... .......... .......... .......... .......... 73% 5.54M 7s 2024-05-08T06:49:07.753 INFO:tasks.workunit.client.0.smithi070.stderr: 99300K .......... .......... .......... .......... .......... 73% 4.76M 7s 2024-05-08T06:49:07.761 INFO:tasks.workunit.client.0.smithi070.stderr: 99350K .......... .......... .......... .......... .......... 73% 6.14M 7s 2024-05-08T06:49:07.770 INFO:tasks.workunit.client.0.smithi070.stderr: 99400K .......... .......... .......... .......... .......... 73% 5.47M 7s 2024-05-08T06:49:07.778 INFO:tasks.workunit.client.0.smithi070.stderr: 99450K .......... .......... .......... .......... .......... 73% 6.05M 7s 2024-05-08T06:49:07.789 INFO:tasks.workunit.client.0.smithi070.stderr: 99500K .......... .......... .......... .......... .......... 73% 4.53M 7s 2024-05-08T06:49:07.797 INFO:tasks.workunit.client.0.smithi070.stderr: 99550K .......... .......... .......... .......... .......... 73% 5.46M 7s 2024-05-08T06:49:07.807 INFO:tasks.workunit.client.0.smithi070.stderr: 99600K .......... .......... .......... .......... .......... 73% 5.32M 7s 2024-05-08T06:49:07.815 INFO:tasks.workunit.client.0.smithi070.stderr: 99650K .......... .......... .......... .......... .......... 73% 5.77M 7s 2024-05-08T06:49:07.825 INFO:tasks.workunit.client.0.smithi070.stderr: 99700K .......... .......... .......... .......... .......... 73% 4.96M 7s 2024-05-08T06:49:07.834 INFO:tasks.workunit.client.0.smithi070.stderr: 99750K .......... .......... .......... .......... .......... 73% 5.55M 7s 2024-05-08T06:49:07.843 INFO:tasks.workunit.client.0.smithi070.stderr: 99800K .......... .......... .......... .......... .......... 73% 5.25M 7s 2024-05-08T06:49:07.853 INFO:tasks.workunit.client.0.smithi070.stderr: 99850K .......... .......... .......... .......... .......... 73% 5.26M 7s 2024-05-08T06:49:07.863 INFO:tasks.workunit.client.0.smithi070.stderr: 99900K .......... .......... .......... .......... .......... 73% 4.54M 7s 2024-05-08T06:49:07.872 INFO:tasks.workunit.client.0.smithi070.stderr: 99950K .......... .......... .......... .......... .......... 73% 5.37M 7s 2024-05-08T06:49:07.881 INFO:tasks.workunit.client.0.smithi070.stderr:100000K .......... .......... .......... .......... .......... 73% 5.25M 7s 2024-05-08T06:49:07.890 INFO:tasks.workunit.client.0.smithi070.stderr:100050K .......... .......... .......... .......... .......... 73% 5.46M 7s 2024-05-08T06:49:07.901 INFO:tasks.workunit.client.0.smithi070.stderr:100100K .......... .......... .......... .......... .......... 73% 4.65M 7s 2024-05-08T06:49:07.910 INFO:tasks.workunit.client.0.smithi070.stderr:100150K .......... .......... .......... .......... .......... 73% 5.46M 7s 2024-05-08T06:49:07.919 INFO:tasks.workunit.client.0.smithi070.stderr:100200K .......... .......... .......... .......... .......... 73% 5.23M 7s 2024-05-08T06:49:07.929 INFO:tasks.workunit.client.0.smithi070.stderr:100250K .......... .......... .......... .......... .......... 73% 5.29M 7s 2024-05-08T06:49:07.940 INFO:tasks.workunit.client.0.smithi070.stderr:100300K .......... .......... .......... .......... .......... 73% 4.33M 6s 2024-05-08T06:49:07.949 INFO:tasks.workunit.client.0.smithi070.stderr:100350K .......... .......... .......... .......... .......... 73% 5.30M 6s 2024-05-08T06:49:07.959 INFO:tasks.workunit.client.0.smithi070.stderr:100400K .......... .......... .......... .......... .......... 73% 5.13M 6s 2024-05-08T06:49:07.968 INFO:tasks.workunit.client.0.smithi070.stderr:100450K .......... .......... .......... .......... .......... 74% 5.41M 6s 2024-05-08T06:49:07.978 INFO:tasks.workunit.client.0.smithi070.stderr:100500K .......... .......... .......... .......... .......... 74% 4.47M 6s 2024-05-08T06:49:07.989 INFO:tasks.workunit.client.0.smithi070.stderr:100550K .......... .......... .......... .......... .......... 74% 4.96M 6s 2024-05-08T06:49:07.998 INFO:tasks.workunit.client.0.smithi070.stderr:100600K .......... .......... .......... .......... .......... 74% 5.03M 6s 2024-05-08T06:49:08.008 INFO:tasks.workunit.client.0.smithi070.stderr:100650K .......... .......... .......... .......... .......... 74% 5.02M 6s 2024-05-08T06:49:08.018 INFO:tasks.workunit.client.0.smithi070.stderr:100700K .......... .......... .......... .......... .......... 74% 4.57M 6s 2024-05-08T06:49:08.028 INFO:tasks.workunit.client.0.smithi070.stderr:100750K .......... .......... .......... .......... .......... 74% 5.27M 6s 2024-05-08T06:49:08.037 INFO:tasks.workunit.client.0.smithi070.stderr:100800K .......... .......... .......... .......... .......... 74% 5.39M 6s 2024-05-08T06:49:08.047 INFO:tasks.workunit.client.0.smithi070.stderr:100850K .......... .......... .......... .......... .......... 74% 4.77M 6s 2024-05-08T06:49:08.059 INFO:tasks.workunit.client.0.smithi070.stderr:100900K .......... .......... .......... .......... .......... 74% 4.21M 6s 2024-05-08T06:49:08.070 INFO:tasks.workunit.client.0.smithi070.stderr:100950K .......... .......... .......... .......... .......... 74% 4.63M 6s 2024-05-08T06:49:08.080 INFO:tasks.workunit.client.0.smithi070.stderr:101000K .......... .......... .......... .......... .......... 74% 4.39M 6s 2024-05-08T06:49:08.090 INFO:tasks.workunit.client.0.smithi070.stderr:101050K .......... .......... .......... .......... .......... 74% 5.17M 6s 2024-05-08T06:49:08.101 INFO:tasks.workunit.client.0.smithi070.stderr:101100K .......... .......... .......... .......... .......... 74% 4.48M 6s 2024-05-08T06:49:08.109 INFO:tasks.workunit.client.0.smithi070.stderr:101150K .......... .......... .......... .......... .......... 74% 5.72M 6s 2024-05-08T06:49:08.119 INFO:tasks.workunit.client.0.smithi070.stderr:101200K .......... .......... .......... .......... .......... 74% 4.98M 6s 2024-05-08T06:49:08.129 INFO:tasks.workunit.client.0.smithi070.stderr:101250K .......... .......... .......... .......... .......... 74% 5.04M 6s 2024-05-08T06:49:08.139 INFO:tasks.workunit.client.0.smithi070.stderr:101300K .......... .......... .......... .......... .......... 74% 4.88M 6s 2024-05-08T06:49:08.149 INFO:tasks.workunit.client.0.smithi070.stderr:101350K .......... .......... .......... .......... .......... 74% 4.85M 6s 2024-05-08T06:49:08.158 INFO:tasks.workunit.client.0.smithi070.stderr:101400K .......... .......... .......... .......... .......... 74% 5.09M 6s 2024-05-08T06:49:08.168 INFO:tasks.workunit.client.0.smithi070.stderr:101450K .......... .......... .......... .......... .......... 74% 5.14M 6s 2024-05-08T06:49:08.179 INFO:tasks.workunit.client.0.smithi070.stderr:101500K .......... .......... .......... .......... .......... 74% 4.31M 6s 2024-05-08T06:49:08.189 INFO:tasks.workunit.client.0.smithi070.stderr:101550K .......... .......... .......... .......... .......... 74% 4.91M 6s 2024-05-08T06:49:08.199 INFO:tasks.workunit.client.0.smithi070.stderr:101600K .......... .......... .......... .......... .......... 74% 5.38M 6s 2024-05-08T06:49:08.208 INFO:tasks.workunit.client.0.smithi070.stderr:101650K .......... .......... .......... .......... .......... 74% 4.94M 6s 2024-05-08T06:49:08.219 INFO:tasks.workunit.client.0.smithi070.stderr:101700K .......... .......... .......... .......... .......... 74% 4.36M 6s 2024-05-08T06:49:08.229 INFO:tasks.workunit.client.0.smithi070.stderr:101750K .......... .......... .......... .......... .......... 74% 5.09M 6s 2024-05-08T06:49:08.238 INFO:tasks.workunit.client.0.smithi070.stderr:101800K .......... .......... .......... .......... .......... 75% 5.17M 6s 2024-05-08T06:49:08.247 INFO:tasks.workunit.client.0.smithi070.stderr:101850K .......... .......... .......... .......... .......... 75% 5.40M 6s 2024-05-08T06:49:08.258 INFO:tasks.workunit.client.0.smithi070.stderr:101900K .......... .......... .......... .......... .......... 75% 4.47M 6s 2024-05-08T06:49:08.268 INFO:tasks.workunit.client.0.smithi070.stderr:101950K .......... .......... .......... .......... .......... 75% 5.03M 6s 2024-05-08T06:49:08.278 INFO:tasks.workunit.client.0.smithi070.stderr:102000K .......... .......... .......... .......... .......... 75% 4.96M 6s 2024-05-08T06:49:08.288 INFO:tasks.workunit.client.0.smithi070.stderr:102050K .......... .......... .......... .......... .......... 75% 4.90M 6s 2024-05-08T06:49:08.301 INFO:tasks.workunit.client.0.smithi070.stderr:102100K .......... .......... .......... .......... .......... 75% 3.75M 6s 2024-05-08T06:49:08.311 INFO:tasks.workunit.client.0.smithi070.stderr:102150K .......... .......... .......... .......... .......... 75% 4.98M 6s 2024-05-08T06:49:08.319 INFO:tasks.workunit.client.0.smithi070.stderr:102200K .......... .......... .......... .......... .......... 75% 5.41M 6s 2024-05-08T06:49:08.328 INFO:tasks.workunit.client.0.smithi070.stderr:102250K .......... .......... .......... .......... .......... 75% 6.19M 6s 2024-05-08T06:49:08.337 INFO:tasks.workunit.client.0.smithi070.stderr:102300K .......... .......... .......... .......... .......... 75% 4.97M 6s 2024-05-08T06:49:08.346 INFO:tasks.workunit.client.0.smithi070.stderr:102350K .......... .......... .......... .......... .......... 75% 5.35M 6s 2024-05-08T06:49:08.356 INFO:tasks.workunit.client.0.smithi070.stderr:102400K .......... .......... .......... .......... .......... 75% 5.25M 6s 2024-05-08T06:49:08.364 INFO:tasks.workunit.client.0.smithi070.stderr:102450K .......... .......... .......... .......... .......... 75% 5.98M 6s 2024-05-08T06:49:08.372 INFO:tasks.workunit.client.0.smithi070.stderr:102500K .......... .......... .......... .......... .......... 75% 6.08M 6s 2024-05-08T06:49:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:08 smithi070 ceph-mon[29591]: pgmap v80: 129 pgs: 129 active+clean; 69 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.4 MiB/s wr, 21 op/s 2024-05-08T06:49:08.379 INFO:tasks.workunit.client.0.smithi070.stderr:102550K .......... .......... .......... .......... .......... 75% 7.62M 6s 2024-05-08T06:49:08.391 INFO:tasks.workunit.client.0.smithi070.stderr:102600K .......... .......... .......... .......... .......... 75% 3.96M 6s 2024-05-08T06:49:08.400 INFO:tasks.workunit.client.0.smithi070.stderr:102650K .......... .......... .......... .......... .......... 75% 4.95M 6s 2024-05-08T06:49:08.408 INFO:tasks.workunit.client.0.smithi070.stderr:102700K .......... .......... .......... .......... .......... 75% 5.88M 6s 2024-05-08T06:49:08.416 INFO:tasks.workunit.client.0.smithi070.stderr:102750K .......... .......... .......... .......... .......... 75% 6.89M 6s 2024-05-08T06:49:08.425 INFO:tasks.workunit.client.0.smithi070.stderr:102800K .......... .......... .......... .......... .......... 75% 5.62M 6s 2024-05-08T06:49:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:08 smithi172 ceph-mon[33377]: pgmap v80: 129 pgs: 129 active+clean; 69 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.4 MiB/s wr, 21 op/s 2024-05-08T06:49:08.433 INFO:tasks.workunit.client.0.smithi070.stderr:102850K .......... .......... .......... .......... .......... 75% 5.58M 6s 2024-05-08T06:49:08.444 INFO:tasks.workunit.client.0.smithi070.stderr:102900K .......... .......... .......... .......... .......... 75% 4.60M 6s 2024-05-08T06:49:08.453 INFO:tasks.workunit.client.0.smithi070.stderr:102950K .......... .......... .......... .......... .......... 75% 5.48M 6s 2024-05-08T06:49:08.462 INFO:tasks.workunit.client.0.smithi070.stderr:103000K .......... .......... .......... .......... .......... 75% 5.04M 6s 2024-05-08T06:49:08.471 INFO:tasks.workunit.client.0.smithi070.stderr:103050K .......... .......... .......... .......... .......... 75% 5.73M 6s 2024-05-08T06:49:08.481 INFO:tasks.workunit.client.0.smithi070.stderr:103100K .......... .......... .......... .......... .......... 75% 5.14M 6s 2024-05-08T06:49:08.489 INFO:tasks.workunit.client.0.smithi070.stderr:103150K .......... .......... .......... .......... .......... 76% 5.85M 6s 2024-05-08T06:49:08.498 INFO:tasks.workunit.client.0.smithi070.stderr:103200K .......... .......... .......... .......... .......... 76% 5.48M 6s 2024-05-08T06:49:08.506 INFO:tasks.workunit.client.0.smithi070.stderr:103250K .......... .......... .......... .......... .......... 76% 6.04M 6s 2024-05-08T06:49:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:08 smithi194 ceph-mon[33679]: pgmap v80: 129 pgs: 129 active+clean; 69 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.4 MiB/s wr, 21 op/s 2024-05-08T06:49:08.515 INFO:tasks.workunit.client.0.smithi070.stderr:103300K .......... .......... .......... .......... .......... 76% 5.19M 6s 2024-05-08T06:49:08.524 INFO:tasks.workunit.client.0.smithi070.stderr:103350K .......... .......... .......... .......... .......... 76% 5.70M 6s 2024-05-08T06:49:08.533 INFO:tasks.workunit.client.0.smithi070.stderr:103400K .......... .......... .......... .......... .......... 76% 5.45M 6s 2024-05-08T06:49:08.543 INFO:tasks.workunit.client.0.smithi070.stderr:103450K .......... .......... .......... .......... .......... 76% 5.11M 6s 2024-05-08T06:49:08.553 INFO:tasks.workunit.client.0.smithi070.stderr:103500K .......... .......... .......... .......... .......... 76% 4.82M 6s 2024-05-08T06:49:08.561 INFO:tasks.workunit.client.0.smithi070.stderr:103550K .......... .......... .......... .......... .......... 76% 5.45M 6s 2024-05-08T06:49:08.570 INFO:tasks.workunit.client.0.smithi070.stderr:103600K .......... .......... .......... .......... .......... 76% 5.65M 6s 2024-05-08T06:49:08.579 INFO:tasks.workunit.client.0.smithi070.stderr:103650K .......... .......... .......... .......... .......... 76% 5.47M 6s 2024-05-08T06:49:08.590 INFO:tasks.workunit.client.0.smithi070.stderr:103700K .......... .......... .......... .......... .......... 76% 4.67M 6s 2024-05-08T06:49:08.599 INFO:tasks.workunit.client.0.smithi070.stderr:103750K .......... .......... .......... .......... .......... 76% 5.29M 6s 2024-05-08T06:49:08.608 INFO:tasks.workunit.client.0.smithi070.stderr:103800K .......... .......... .......... .......... .......... 76% 5.39M 6s 2024-05-08T06:49:08.616 INFO:tasks.workunit.client.0.smithi070.stderr:103850K .......... .......... .......... .......... .......... 76% 5.71M 6s 2024-05-08T06:49:08.627 INFO:tasks.workunit.client.0.smithi070.stderr:103900K .......... .......... .......... .......... .......... 76% 4.70M 6s 2024-05-08T06:49:08.636 INFO:tasks.workunit.client.0.smithi070.stderr:103950K .......... .......... .......... .......... .......... 76% 5.33M 6s 2024-05-08T06:49:08.645 INFO:tasks.workunit.client.0.smithi070.stderr:104000K .......... .......... .......... .......... .......... 76% 5.11M 6s 2024-05-08T06:49:08.655 INFO:tasks.workunit.client.0.smithi070.stderr:104050K .......... .......... .......... .......... .......... 76% 5.27M 6s 2024-05-08T06:49:08.664 INFO:tasks.workunit.client.0.smithi070.stderr:104100K .......... .......... .......... .......... .......... 76% 5.08M 6s 2024-05-08T06:49:08.672 INFO:tasks.workunit.client.0.smithi070.stderr:104150K .......... .......... .......... .......... .......... 76% 5.98M 6s 2024-05-08T06:49:08.681 INFO:tasks.workunit.client.0.smithi070.stderr:104200K .......... .......... .......... .......... .......... 76% 5.88M 6s 2024-05-08T06:49:08.694 INFO:tasks.workunit.client.0.smithi070.stderr:104250K .......... .......... .......... .......... .......... 76% 4.02M 6s 2024-05-08T06:49:08.708 INFO:tasks.workunit.client.0.smithi070.stderr:104300K .......... .......... .......... .......... .......... 76% 3.29M 6s 2024-05-08T06:49:08.717 INFO:tasks.workunit.client.0.smithi070.stderr:104350K .......... .......... .......... .......... .......... 76% 5.87M 6s 2024-05-08T06:49:08.727 INFO:tasks.workunit.client.0.smithi070.stderr:104400K .......... .......... .......... .......... .......... 76% 4.97M 6s 2024-05-08T06:49:08.736 INFO:tasks.workunit.client.0.smithi070.stderr:104450K .......... .......... .......... .......... .......... 76% 4.87M 6s 2024-05-08T06:49:08.747 INFO:tasks.workunit.client.0.smithi070.stderr:104500K .......... .......... .......... .......... .......... 77% 4.48M 6s 2024-05-08T06:49:08.756 INFO:tasks.workunit.client.0.smithi070.stderr:104550K .......... .......... .......... .......... .......... 77% 5.49M 6s 2024-05-08T06:49:08.765 INFO:tasks.workunit.client.0.smithi070.stderr:104600K .......... .......... .......... .......... .......... 77% 5.55M 6s 2024-05-08T06:49:08.774 INFO:tasks.workunit.client.0.smithi070.stderr:104650K .......... .......... .......... .......... .......... 77% 5.07M 6s 2024-05-08T06:49:08.786 INFO:tasks.workunit.client.0.smithi070.stderr:104700K .......... .......... .......... .......... .......... 77% 4.32M 6s 2024-05-08T06:49:08.796 INFO:tasks.workunit.client.0.smithi070.stderr:104750K .......... .......... .......... .......... .......... 77% 4.76M 6s 2024-05-08T06:49:08.806 INFO:tasks.workunit.client.0.smithi070.stderr:104800K .......... .......... .......... .......... .......... 77% 4.93M 6s 2024-05-08T06:49:08.815 INFO:tasks.workunit.client.0.smithi070.stderr:104850K .......... .......... .......... .......... .......... 77% 5.09M 6s 2024-05-08T06:49:08.827 INFO:tasks.workunit.client.0.smithi070.stderr:104900K .......... .......... .......... .......... .......... 77% 4.09M 6s 2024-05-08T06:49:08.838 INFO:tasks.workunit.client.0.smithi070.stderr:104950K .......... .......... .......... .......... .......... 77% 4.69M 6s 2024-05-08T06:49:08.848 INFO:tasks.workunit.client.0.smithi070.stderr:105000K .......... .......... .......... .......... .......... 77% 4.86M 6s 2024-05-08T06:49:08.858 INFO:tasks.workunit.client.0.smithi070.stderr:105050K .......... .......... .......... .......... .......... 77% 4.93M 6s 2024-05-08T06:49:08.869 INFO:tasks.workunit.client.0.smithi070.stderr:105100K .......... .......... .......... .......... .......... 77% 4.29M 6s 2024-05-08T06:49:08.879 INFO:tasks.workunit.client.0.smithi070.stderr:105150K .......... .......... .......... .......... .......... 77% 4.84M 6s 2024-05-08T06:49:08.890 INFO:tasks.workunit.client.0.smithi070.stderr:105200K .......... .......... .......... .......... .......... 77% 4.67M 6s 2024-05-08T06:49:08.900 INFO:tasks.workunit.client.0.smithi070.stderr:105250K .......... .......... .......... .......... .......... 77% 4.55M 6s 2024-05-08T06:49:08.912 INFO:tasks.workunit.client.0.smithi070.stderr:105300K .......... .......... .......... .......... .......... 77% 4.31M 6s 2024-05-08T06:49:08.922 INFO:tasks.workunit.client.0.smithi070.stderr:105350K .......... .......... .......... .......... .......... 77% 4.60M 6s 2024-05-08T06:49:08.932 INFO:tasks.workunit.client.0.smithi070.stderr:105400K .......... .......... .......... .......... .......... 77% 4.92M 6s 2024-05-08T06:49:08.941 INFO:tasks.workunit.client.0.smithi070.stderr:105450K .......... .......... .......... .......... .......... 77% 5.22M 6s 2024-05-08T06:49:08.953 INFO:tasks.workunit.client.0.smithi070.stderr:105500K .......... .......... .......... .......... .......... 77% 4.32M 6s 2024-05-08T06:49:08.962 INFO:tasks.workunit.client.0.smithi070.stderr:105550K .......... .......... .......... .......... .......... 77% 5.27M 6s 2024-05-08T06:49:08.972 INFO:tasks.workunit.client.0.smithi070.stderr:105600K .......... .......... .......... .......... .......... 77% 5.04M 6s 2024-05-08T06:49:08.981 INFO:tasks.workunit.client.0.smithi070.stderr:105650K .......... .......... .......... .......... .......... 77% 5.23M 6s 2024-05-08T06:49:08.994 INFO:tasks.workunit.client.0.smithi070.stderr:105700K .......... .......... .......... .......... .......... 77% 4.03M 6s 2024-05-08T06:49:09.005 INFO:tasks.workunit.client.0.smithi070.stderr:105750K .......... .......... .......... .......... .......... 77% 4.45M 6s 2024-05-08T06:49:09.014 INFO:tasks.workunit.client.0.smithi070.stderr:105800K .......... .......... .......... .......... .......... 77% 4.75M 6s 2024-05-08T06:49:09.024 INFO:tasks.workunit.client.0.smithi070.stderr:105850K .......... .......... .......... .......... .......... 78% 5.42M 5s 2024-05-08T06:49:09.034 INFO:tasks.workunit.client.0.smithi070.stderr:105900K .......... .......... .......... .......... .......... 78% 4.68M 5s 2024-05-08T06:49:09.043 INFO:tasks.workunit.client.0.smithi070.stderr:105950K .......... .......... .......... .......... .......... 78% 5.39M 5s 2024-05-08T06:49:09.052 INFO:tasks.workunit.client.0.smithi070.stderr:106000K .......... .......... .......... .......... .......... 78% 5.45M 5s 2024-05-08T06:49:09.061 INFO:tasks.workunit.client.0.smithi070.stderr:106050K .......... .......... .......... .......... .......... 78% 5.31M 5s 2024-05-08T06:49:09.073 INFO:tasks.workunit.client.0.smithi070.stderr:106100K .......... .......... .......... .......... .......... 78% 4.25M 5s 2024-05-08T06:49:09.082 INFO:tasks.workunit.client.0.smithi070.stderr:106150K .......... .......... .......... .......... .......... 78% 4.95M 5s 2024-05-08T06:49:09.093 INFO:tasks.workunit.client.0.smithi070.stderr:106200K .......... .......... .......... .......... .......... 78% 5.25M 5s 2024-05-08T06:49:09.102 INFO:tasks.workunit.client.0.smithi070.stderr:106250K .......... .......... .......... .......... .......... 78% 5.03M 5s 2024-05-08T06:49:09.113 INFO:tasks.workunit.client.0.smithi070.stderr:106300K .......... .......... .......... .......... .......... 78% 4.34M 5s 2024-05-08T06:49:09.122 INFO:tasks.workunit.client.0.smithi070.stderr:106350K .......... .......... .......... .......... .......... 78% 5.04M 5s 2024-05-08T06:49:09.132 INFO:tasks.workunit.client.0.smithi070.stderr:106400K .......... .......... .......... .......... .......... 78% 5.20M 5s 2024-05-08T06:49:09.142 INFO:tasks.workunit.client.0.smithi070.stderr:106450K .......... .......... .......... .......... .......... 78% 5.03M 5s 2024-05-08T06:49:09.151 INFO:tasks.workunit.client.0.smithi070.stderr:106500K .......... .......... .......... .......... .......... 78% 5.14M 5s 2024-05-08T06:49:09.160 INFO:tasks.workunit.client.0.smithi070.stderr:106550K .......... .......... .......... .......... .......... 78% 5.84M 5s 2024-05-08T06:49:09.168 INFO:tasks.workunit.client.0.smithi070.stderr:106600K .......... .......... .......... .......... .......... 78% 5.60M 5s 2024-05-08T06:49:09.177 INFO:tasks.workunit.client.0.smithi070.stderr:106650K .......... .......... .......... .......... .......... 78% 5.52M 5s 2024-05-08T06:49:09.191 INFO:tasks.workunit.client.0.smithi070.stderr:106700K .......... .......... .......... .......... .......... 78% 3.52M 5s 2024-05-08T06:49:09.199 INFO:tasks.workunit.client.0.smithi070.stderr:106750K .......... .......... .......... .......... .......... 78% 5.88M 5s 2024-05-08T06:49:09.207 INFO:tasks.workunit.client.0.smithi070.stderr:106800K .......... .......... .......... .......... .......... 78% 5.73M 5s 2024-05-08T06:49:09.214 INFO:tasks.workunit.client.0.smithi070.stderr:106850K .......... .......... .......... .......... .......... 78% 7.18M 5s 2024-05-08T06:49:09.223 INFO:tasks.workunit.client.0.smithi070.stderr:106900K .......... .......... .......... .......... .......... 78% 5.29M 5s 2024-05-08T06:49:09.231 INFO:tasks.workunit.client.0.smithi070.stderr:106950K .......... .......... .......... .......... .......... 78% 6.43M 5s 2024-05-08T06:49:09.239 INFO:tasks.workunit.client.0.smithi070.stderr:107000K .......... .......... .......... .......... .......... 78% 6.21M 5s 2024-05-08T06:49:09.247 INFO:tasks.workunit.client.0.smithi070.stderr:107050K .......... .......... .......... .......... .......... 78% 6.32M 5s 2024-05-08T06:49:09.256 INFO:tasks.workunit.client.0.smithi070.stderr:107100K .......... .......... .......... .......... .......... 78% 4.94M 5s 2024-05-08T06:49:09.263 INFO:tasks.workunit.client.0.smithi070.stderr:107150K .......... .......... .......... .......... .......... 78% 7.43M 5s 2024-05-08T06:49:09.272 INFO:tasks.workunit.client.0.smithi070.stderr:107200K .......... .......... .......... .......... .......... 79% 6.12M 5s 2024-05-08T06:49:09.279 INFO:tasks.workunit.client.0.smithi070.stderr:107250K .......... .......... .......... .......... .......... 79% 6.10M 5s 2024-05-08T06:49:09.289 INFO:tasks.workunit.client.0.smithi070.stderr:107300K .......... .......... .......... .......... .......... 79% 4.96M 5s 2024-05-08T06:49:09.297 INFO:tasks.workunit.client.0.smithi070.stderr:107350K .......... .......... .......... .......... .......... 79% 6.11M 5s 2024-05-08T06:49:09.306 INFO:tasks.workunit.client.0.smithi070.stderr:107400K .......... .......... .......... .......... .......... 79% 5.87M 5s 2024-05-08T06:49:09.314 INFO:tasks.workunit.client.0.smithi070.stderr:107450K .......... .......... .......... .......... .......... 79% 5.99M 5s 2024-05-08T06:49:09.324 INFO:tasks.workunit.client.0.smithi070.stderr:107500K .......... .......... .......... .......... .......... 79% 4.85M 5s 2024-05-08T06:49:09.332 INFO:tasks.workunit.client.0.smithi070.stderr:107550K .......... .......... .......... .......... .......... 79% 5.73M 5s 2024-05-08T06:49:09.340 INFO:tasks.workunit.client.0.smithi070.stderr:107600K .......... .......... .......... .......... .......... 79% 6.46M 5s 2024-05-08T06:49:09.347 INFO:tasks.workunit.client.0.smithi070.stderr:107650K .......... .......... .......... .......... .......... 79% 6.20M 5s 2024-05-08T06:49:09.356 INFO:tasks.workunit.client.0.smithi070.stderr:107700K .......... .......... .......... .......... .......... 79% 5.79M 5s 2024-05-08T06:49:09.363 INFO:tasks.workunit.client.0.smithi070.stderr:107750K .......... .......... .......... .......... .......... 79% 6.76M 5s 2024-05-08T06:49:09.372 INFO:tasks.workunit.client.0.smithi070.stderr:107800K .......... .......... .......... .......... .......... 79% 5.80M 5s 2024-05-08T06:49:09.382 INFO:tasks.workunit.client.0.smithi070.stderr:107850K .......... .......... .......... .......... .......... 79% 4.98M 5s 2024-05-08T06:49:09.393 INFO:tasks.workunit.client.0.smithi070.stderr:107900K .......... .......... .......... .......... .......... 79% 4.25M 5s 2024-05-08T06:49:09.402 INFO:tasks.workunit.client.0.smithi070.stderr:107950K .......... .......... .......... .......... .......... 79% 5.14M 5s 2024-05-08T06:49:09.411 INFO:tasks.workunit.client.0.smithi070.stderr:108000K .......... .......... .......... .......... .......... 79% 5.73M 5s 2024-05-08T06:49:09.419 INFO:tasks.workunit.client.0.smithi070.stderr:108050K .......... .......... .......... .......... .......... 79% 6.06M 5s 2024-05-08T06:49:09.430 INFO:tasks.workunit.client.0.smithi070.stderr:108100K .......... .......... .......... .......... .......... 79% 4.64M 5s 2024-05-08T06:49:09.439 INFO:tasks.workunit.client.0.smithi070.stderr:108150K .......... .......... .......... .......... .......... 79% 5.24M 5s 2024-05-08T06:49:09.448 INFO:tasks.workunit.client.0.smithi070.stderr:108200K .......... .......... .......... .......... .......... 79% 5.45M 5s 2024-05-08T06:49:09.457 INFO:tasks.workunit.client.0.smithi070.stderr:108250K .......... .......... .......... .......... .......... 79% 5.58M 5s 2024-05-08T06:49:09.467 INFO:tasks.workunit.client.0.smithi070.stderr:108300K .......... .......... .......... .......... .......... 79% 4.93M 5s 2024-05-08T06:49:09.476 INFO:tasks.workunit.client.0.smithi070.stderr:108350K .......... .......... .......... .......... .......... 79% 5.35M 5s 2024-05-08T06:49:09.484 INFO:tasks.workunit.client.0.smithi070.stderr:108400K .......... .......... .......... .......... .......... 79% 5.61M 5s 2024-05-08T06:49:09.493 INFO:tasks.workunit.client.0.smithi070.stderr:108450K .......... .......... .......... .......... .......... 79% 5.52M 5s 2024-05-08T06:49:09.504 INFO:tasks.workunit.client.0.smithi070.stderr:108500K .......... .......... .......... .......... .......... 79% 4.60M 5s 2024-05-08T06:49:09.513 INFO:tasks.workunit.client.0.smithi070.stderr:108550K .......... .......... .......... .......... .......... 79% 5.40M 5s 2024-05-08T06:49:09.522 INFO:tasks.workunit.client.0.smithi070.stderr:108600K .......... .......... .......... .......... .......... 80% 5.44M 5s 2024-05-08T06:49:09.531 INFO:tasks.workunit.client.0.smithi070.stderr:108650K .......... .......... .......... .......... .......... 80% 5.42M 5s 2024-05-08T06:49:09.542 INFO:tasks.workunit.client.0.smithi070.stderr:108700K .......... .......... .......... .......... .......... 80% 4.63M 5s 2024-05-08T06:49:09.551 INFO:tasks.workunit.client.0.smithi070.stderr:108750K .......... .......... .......... .......... .......... 80% 5.41M 5s 2024-05-08T06:49:09.559 INFO:tasks.workunit.client.0.smithi070.stderr:108800K .......... .......... .......... .......... .......... 80% 5.44M 5s 2024-05-08T06:49:09.568 INFO:tasks.workunit.client.0.smithi070.stderr:108850K .......... .......... .......... .......... .......... 80% 5.62M 5s 2024-05-08T06:49:09.579 INFO:tasks.workunit.client.0.smithi070.stderr:108900K .......... .......... .......... .......... .......... 80% 4.69M 5s 2024-05-08T06:49:09.588 INFO:tasks.workunit.client.0.smithi070.stderr:108950K .......... .......... .......... .......... .......... 80% 5.29M 5s 2024-05-08T06:49:09.601 INFO:tasks.workunit.client.0.smithi070.stderr:109000K .......... .......... .......... .......... .......... 80% 4.52M 5s 2024-05-08T06:49:09.612 INFO:tasks.workunit.client.0.smithi070.stderr:109050K .......... .......... .......... .......... .......... 80% 3.59M 5s 2024-05-08T06:49:09.622 INFO:tasks.workunit.client.0.smithi070.stderr:109100K .......... .......... .......... .......... .......... 80% 5.20M 5s 2024-05-08T06:49:09.629 INFO:tasks.workunit.client.0.smithi070.stderr:109150K .......... .......... .......... .......... .......... 80% 6.34M 5s 2024-05-08T06:49:09.637 INFO:tasks.workunit.client.0.smithi070.stderr:109200K .......... .......... .......... .......... .......... 80% 6.23M 5s 2024-05-08T06:49:09.647 INFO:tasks.workunit.client.0.smithi070.stderr:109250K .......... .......... .......... .......... .......... 80% 5.20M 5s 2024-05-08T06:49:09.659 INFO:tasks.workunit.client.0.smithi070.stderr:109300K .......... .......... .......... .......... .......... 80% 4.00M 5s 2024-05-08T06:49:09.669 INFO:tasks.workunit.client.0.smithi070.stderr:109350K .......... .......... .......... .......... .......... 80% 4.91M 5s 2024-05-08T06:49:09.678 INFO:tasks.workunit.client.0.smithi070.stderr:109400K .......... .......... .......... .......... .......... 80% 5.30M 5s 2024-05-08T06:49:09.688 INFO:tasks.workunit.client.0.smithi070.stderr:109450K .......... .......... .......... .......... .......... 80% 4.71M 5s 2024-05-08T06:49:09.699 INFO:tasks.workunit.client.0.smithi070.stderr:109500K .......... .......... .......... .......... .......... 80% 4.43M 5s 2024-05-08T06:49:09.709 INFO:tasks.workunit.client.0.smithi070.stderr:109550K .......... .......... .......... .......... .......... 80% 5.03M 5s 2024-05-08T06:49:09.719 INFO:tasks.workunit.client.0.smithi070.stderr:109600K .......... .......... .......... .......... .......... 80% 5.22M 5s 2024-05-08T06:49:09.728 INFO:tasks.workunit.client.0.smithi070.stderr:109650K .......... .......... .......... .......... .......... 80% 4.96M 5s 2024-05-08T06:49:09.740 INFO:tasks.workunit.client.0.smithi070.stderr:109700K .......... .......... .......... .......... .......... 80% 4.23M 5s 2024-05-08T06:49:09.750 INFO:tasks.workunit.client.0.smithi070.stderr:109750K .......... .......... .......... .......... .......... 80% 4.89M 5s 2024-05-08T06:49:09.760 INFO:tasks.workunit.client.0.smithi070.stderr:109800K .......... .......... .......... .......... .......... 80% 4.98M 5s 2024-05-08T06:49:09.769 INFO:tasks.workunit.client.0.smithi070.stderr:109850K .......... .......... .......... .......... .......... 80% 5.06M 5s 2024-05-08T06:49:09.781 INFO:tasks.workunit.client.0.smithi070.stderr:109900K .......... .......... .......... .......... .......... 80% 4.34M 5s 2024-05-08T06:49:09.790 INFO:tasks.workunit.client.0.smithi070.stderr:109950K .......... .......... .......... .......... .......... 81% 5.02M 5s 2024-05-08T06:49:09.800 INFO:tasks.workunit.client.0.smithi070.stderr:110000K .......... .......... .......... .......... .......... 81% 4.83M 5s 2024-05-08T06:49:09.810 INFO:tasks.workunit.client.0.smithi070.stderr:110050K .......... .......... .......... .......... .......... 81% 5.03M 5s 2024-05-08T06:49:09.820 INFO:tasks.workunit.client.0.smithi070.stderr:110100K .......... .......... .......... .......... .......... 81% 4.69M 5s 2024-05-08T06:49:09.829 INFO:tasks.workunit.client.0.smithi070.stderr:110150K .......... .......... .......... .......... .......... 81% 5.57M 5s 2024-05-08T06:49:09.838 INFO:tasks.workunit.client.0.smithi070.stderr:110200K .......... .......... .......... .......... .......... 81% 5.62M 5s 2024-05-08T06:49:09.847 INFO:tasks.workunit.client.0.smithi070.stderr:110250K .......... .......... .......... .......... .......... 81% 5.36M 5s 2024-05-08T06:49:09.858 INFO:tasks.workunit.client.0.smithi070.stderr:110300K .......... .......... .......... .......... .......... 81% 4.63M 5s 2024-05-08T06:49:09.867 INFO:tasks.workunit.client.0.smithi070.stderr:110350K .......... .......... .......... .......... .......... 81% 5.24M 5s 2024-05-08T06:49:09.876 INFO:tasks.workunit.client.0.smithi070.stderr:110400K .......... .......... .......... .......... .......... 81% 5.27M 5s 2024-05-08T06:49:09.885 INFO:tasks.workunit.client.0.smithi070.stderr:110450K .......... .......... .......... .......... .......... 81% 5.37M 5s 2024-05-08T06:49:09.896 INFO:tasks.workunit.client.0.smithi070.stderr:110500K .......... .......... .......... .......... .......... 81% 4.70M 5s 2024-05-08T06:49:09.906 INFO:tasks.workunit.client.0.smithi070.stderr:110550K .......... .......... .......... .......... .......... 81% 4.76M 5s 2024-05-08T06:49:09.915 INFO:tasks.workunit.client.0.smithi070.stderr:110600K .......... .......... .......... .......... .......... 81% 5.32M 5s 2024-05-08T06:49:09.924 INFO:tasks.workunit.client.0.smithi070.stderr:110650K .......... .......... .......... .......... .......... 81% 5.46M 5s 2024-05-08T06:49:09.936 INFO:tasks.workunit.client.0.smithi070.stderr:110700K .......... .......... .......... .......... .......... 81% 4.00M 5s 2024-05-08T06:49:09.944 INFO:tasks.workunit.client.0.smithi070.stderr:110750K .......... .......... .......... .......... .......... 81% 5.79M 5s 2024-05-08T06:49:09.950 INFO:tasks.workunit.client.0.smithi070.stderr:110800K .......... .......... .......... .......... .......... 81% 8.38M 5s 2024-05-08T06:49:09.956 INFO:tasks.workunit.client.0.smithi070.stderr:110850K .......... .......... .......... .......... .......... 81% 7.76M 5s 2024-05-08T06:49:09.964 INFO:tasks.workunit.client.0.smithi070.stderr:110900K .......... .......... .......... .......... .......... 81% 6.30M 5s 2024-05-08T06:49:09.973 INFO:tasks.workunit.client.0.smithi070.stderr:110950K .......... .......... .......... .......... .......... 81% 5.82M 5s 2024-05-08T06:49:09.982 INFO:tasks.workunit.client.0.smithi070.stderr:111000K .......... .......... .......... .......... .......... 81% 5.36M 5s 2024-05-08T06:49:09.991 INFO:tasks.workunit.client.0.smithi070.stderr:111050K .......... .......... .......... .......... .......... 81% 5.31M 5s 2024-05-08T06:49:10.002 INFO:tasks.workunit.client.0.smithi070.stderr:111100K .......... .......... .......... .......... .......... 81% 4.60M 5s 2024-05-08T06:49:10.011 INFO:tasks.workunit.client.0.smithi070.stderr:111150K .......... .......... .......... .......... .......... 81% 5.26M 5s 2024-05-08T06:49:10.020 INFO:tasks.workunit.client.0.smithi070.stderr:111200K .......... .......... .......... .......... .......... 81% 5.40M 5s 2024-05-08T06:49:10.029 INFO:tasks.workunit.client.0.smithi070.stderr:111250K .......... .......... .......... .......... .......... 81% 5.20M 5s 2024-05-08T06:49:10.040 INFO:tasks.workunit.client.0.smithi070.stderr:111300K .......... .......... .......... .......... .......... 82% 4.57M 4s 2024-05-08T06:49:10.049 INFO:tasks.workunit.client.0.smithi070.stderr:111350K .......... .......... .......... .......... .......... 82% 5.21M 4s 2024-05-08T06:49:10.059 INFO:tasks.workunit.client.0.smithi070.stderr:111400K .......... .......... .......... .......... .......... 82% 5.33M 4s 2024-05-08T06:49:10.068 INFO:tasks.workunit.client.0.smithi070.stderr:111450K .......... .......... .......... .......... .......... 82% 5.26M 4s 2024-05-08T06:49:10.079 INFO:tasks.workunit.client.0.smithi070.stderr:111500K .......... .......... .......... .......... .......... 82% 4.59M 4s 2024-05-08T06:49:10.087 INFO:tasks.workunit.client.0.smithi070.stderr:111550K .......... .......... .......... .......... .......... 82% 6.14M 4s 2024-05-08T06:49:10.095 INFO:tasks.workunit.client.0.smithi070.stderr:111600K .......... .......... .......... .......... .......... 82% 5.44M 4s 2024-05-08T06:49:10.104 INFO:tasks.workunit.client.0.smithi070.stderr:111650K .......... .......... .......... .......... .......... 82% 5.82M 4s 2024-05-08T06:49:10.115 INFO:tasks.workunit.client.0.smithi070.stderr:111700K .......... .......... .......... .......... .......... 82% 4.62M 4s 2024-05-08T06:49:10.125 INFO:tasks.workunit.client.0.smithi070.stderr:111750K .......... .......... .......... .......... .......... 82% 4.85M 4s 2024-05-08T06:49:10.134 INFO:tasks.workunit.client.0.smithi070.stderr:111800K .......... .......... .......... .......... .......... 82% 5.00M 4s 2024-05-08T06:49:10.144 INFO:tasks.workunit.client.0.smithi070.stderr:111850K .......... .......... .......... .......... .......... 82% 5.18M 4s 2024-05-08T06:49:10.154 INFO:tasks.workunit.client.0.smithi070.stderr:111900K .......... .......... .......... .......... .......... 82% 4.68M 4s 2024-05-08T06:49:10.164 INFO:tasks.workunit.client.0.smithi070.stderr:111950K .......... .......... .......... .......... .......... 82% 5.06M 4s 2024-05-08T06:49:10.172 INFO:tasks.workunit.client.0.smithi070.stderr:112000K .......... .......... .......... .......... .......... 82% 6.09M 4s 2024-05-08T06:49:10.180 INFO:tasks.workunit.client.0.smithi070.stderr:112050K .......... .......... .......... .......... .......... 82% 5.66M 4s 2024-05-08T06:49:10.192 INFO:tasks.workunit.client.0.smithi070.stderr:112100K .......... .......... .......... .......... .......... 82% 4.40M 4s 2024-05-08T06:49:10.201 INFO:tasks.workunit.client.0.smithi070.stderr:112150K .......... .......... .......... .......... .......... 82% 5.34M 4s 2024-05-08T06:49:10.209 INFO:tasks.workunit.client.0.smithi070.stderr:112200K .......... .......... .......... .......... .......... 82% 5.75M 4s 2024-05-08T06:49:10.217 INFO:tasks.workunit.client.0.smithi070.stderr:112250K .......... .......... .......... .......... .......... 82% 6.07M 4s 2024-05-08T06:49:10.228 INFO:tasks.workunit.client.0.smithi070.stderr:112300K .......... .......... .......... .......... .......... 82% 4.63M 4s 2024-05-08T06:49:10.237 INFO:tasks.workunit.client.0.smithi070.stderr:112350K .......... .......... .......... .......... .......... 82% 5.60M 4s 2024-05-08T06:49:10.246 INFO:tasks.workunit.client.0.smithi070.stderr:112400K .......... .......... .......... .......... .......... 82% 5.52M 4s 2024-05-08T06:49:10.255 INFO:tasks.workunit.client.0.smithi070.stderr:112450K .......... .......... .......... .......... .......... 82% 5.23M 4s 2024-05-08T06:49:10.265 INFO:tasks.workunit.client.0.smithi070.stderr:112500K .......... .......... .......... .......... .......... 82% 4.53M 4s 2024-05-08T06:49:10.275 INFO:tasks.workunit.client.0.smithi070.stderr:112550K .......... .......... .......... .......... .......... 82% 5.16M 4s 2024-05-08T06:49:10.285 INFO:tasks.workunit.client.0.smithi070.stderr:112600K .......... .......... .......... .......... .......... 82% 4.70M 4s 2024-05-08T06:49:10.296 INFO:tasks.workunit.client.0.smithi070.stderr:112650K .......... .......... .......... .......... .......... 83% 4.65M 4s 2024-05-08T06:49:10.307 INFO:tasks.workunit.client.0.smithi070.stderr:112700K .......... .......... .......... .......... .......... 83% 4.40M 4s 2024-05-08T06:49:10.316 INFO:tasks.workunit.client.0.smithi070.stderr:112750K .......... .......... .......... .......... .......... 83% 5.43M 4s 2024-05-08T06:49:10.326 INFO:tasks.workunit.client.0.smithi070.stderr:112800K .......... .......... .......... .......... .......... 83% 4.78M 4s 2024-05-08T06:49:10.335 INFO:tasks.workunit.client.0.smithi070.stderr:112850K .......... .......... .......... .......... .......... 83% 5.51M 4s 2024-05-08T06:49:10.347 INFO:tasks.workunit.client.0.smithi070.stderr:112900K .......... .......... .......... .......... .......... 83% 4.29M 4s 2024-05-08T06:49:10.356 INFO:tasks.workunit.client.0.smithi070.stderr:112950K .......... .......... .......... .......... .......... 83% 5.30M 4s 2024-05-08T06:49:10.365 INFO:tasks.workunit.client.0.smithi070.stderr:113000K .......... .......... .......... .......... .......... 83% 5.43M 4s 2024-05-08T06:49:10.374 INFO:tasks.workunit.client.0.smithi070.stderr:113050K .......... .......... .......... .......... .......... 83% 5.39M 4s 2024-05-08T06:49:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:10 smithi070 ceph-mon[29591]: pgmap v81: 129 pgs: 129 active+clean; 97 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 25 op/s 2024-05-08T06:49:10.385 INFO:tasks.workunit.client.0.smithi070.stderr:113100K .......... .......... .......... .......... .......... 83% 4.41M 4s 2024-05-08T06:49:10.396 INFO:tasks.workunit.client.0.smithi070.stderr:113150K .......... .......... .......... .......... .......... 83% 4.61M 4s 2024-05-08T06:49:10.406 INFO:tasks.workunit.client.0.smithi070.stderr:113200K .......... .......... .......... .......... .......... 83% 4.63M 4s 2024-05-08T06:49:10.416 INFO:tasks.workunit.client.0.smithi070.stderr:113250K .......... .......... .......... .......... .......... 83% 5.20M 4s 2024-05-08T06:49:10.427 INFO:tasks.workunit.client.0.smithi070.stderr:113300K .......... .......... .......... .......... .......... 83% 4.18M 4s 2024-05-08T06:49:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:10 smithi172 ceph-mon[33377]: pgmap v81: 129 pgs: 129 active+clean; 97 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 25 op/s 2024-05-08T06:49:10.436 INFO:tasks.workunit.client.0.smithi070.stderr:113350K .......... .......... .......... .......... .......... 83% 5.30M 4s 2024-05-08T06:49:10.445 INFO:tasks.workunit.client.0.smithi070.stderr:113400K .......... .......... .......... .......... .......... 83% 5.48M 4s 2024-05-08T06:49:10.454 INFO:tasks.workunit.client.0.smithi070.stderr:113450K .......... .......... .......... .......... .......... 83% 5.17M 4s 2024-05-08T06:49:10.465 INFO:tasks.workunit.client.0.smithi070.stderr:113500K .......... .......... .......... .......... .......... 83% 4.61M 4s 2024-05-08T06:49:10.475 INFO:tasks.workunit.client.0.smithi070.stderr:113550K .......... .......... .......... .......... .......... 83% 5.07M 4s 2024-05-08T06:49:10.485 INFO:tasks.workunit.client.0.smithi070.stderr:113600K .......... .......... .......... .......... .......... 83% 5.04M 4s 2024-05-08T06:49:10.494 INFO:tasks.workunit.client.0.smithi070.stderr:113650K .......... .......... .......... .......... .......... 83% 5.32M 4s 2024-05-08T06:49:10.504 INFO:tasks.workunit.client.0.smithi070.stderr:113700K .......... .......... .......... .......... .......... 83% 4.52M 4s 2024-05-08T06:49:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:10 smithi194 ceph-mon[33679]: pgmap v81: 129 pgs: 129 active+clean; 97 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 25 op/s 2024-05-08T06:49:10.514 INFO:tasks.workunit.client.0.smithi070.stderr:113750K .......... .......... .......... .......... .......... 83% 5.26M 4s 2024-05-08T06:49:10.522 INFO:tasks.workunit.client.0.smithi070.stderr:113800K .......... .......... .......... .......... .......... 83% 5.74M 4s 2024-05-08T06:49:10.532 INFO:tasks.workunit.client.0.smithi070.stderr:113850K .......... .......... .......... .......... .......... 83% 5.33M 4s 2024-05-08T06:49:10.543 INFO:tasks.workunit.client.0.smithi070.stderr:113900K .......... .......... .......... .......... .......... 83% 4.34M 4s 2024-05-08T06:49:10.552 INFO:tasks.workunit.client.0.smithi070.stderr:113950K .......... .......... .......... .......... .......... 83% 5.09M 4s 2024-05-08T06:49:10.561 INFO:tasks.workunit.client.0.smithi070.stderr:114000K .......... .......... .......... .......... .......... 84% 5.41M 4s 2024-05-08T06:49:10.570 INFO:tasks.workunit.client.0.smithi070.stderr:114050K .......... .......... .......... .......... .......... 84% 5.57M 4s 2024-05-08T06:49:10.581 INFO:tasks.workunit.client.0.smithi070.stderr:114100K .......... .......... .......... .......... .......... 84% 4.57M 4s 2024-05-08T06:49:10.591 INFO:tasks.workunit.client.0.smithi070.stderr:114150K .......... .......... .......... .......... .......... 84% 4.98M 4s 2024-05-08T06:49:10.600 INFO:tasks.workunit.client.0.smithi070.stderr:114200K .......... .......... .......... .......... .......... 84% 5.32M 4s 2024-05-08T06:49:10.607 INFO:tasks.workunit.client.0.smithi070.stderr:114250K .......... .......... .......... .......... .......... 84% 6.16M 4s 2024-05-08T06:49:10.615 INFO:tasks.workunit.client.0.smithi070.stderr:114300K .......... .......... .......... .......... .......... 84% 5.93M 4s 2024-05-08T06:49:10.623 INFO:tasks.workunit.client.0.smithi070.stderr:114350K .......... .......... .......... .......... .......... 84% 6.68M 4s 2024-05-08T06:49:10.630 INFO:tasks.workunit.client.0.smithi070.stderr:114400K .......... .......... .......... .......... .......... 84% 6.87M 4s 2024-05-08T06:49:10.637 INFO:tasks.workunit.client.0.smithi070.stderr:114450K .......... .......... .......... .......... .......... 84% 6.70M 4s 2024-05-08T06:49:10.646 INFO:tasks.workunit.client.0.smithi070.stderr:114500K .......... .......... .......... .......... .......... 84% 5.76M 4s 2024-05-08T06:49:10.652 INFO:tasks.workunit.client.0.smithi070.stderr:114550K .......... .......... .......... .......... .......... 84% 7.08M 4s 2024-05-08T06:49:10.659 INFO:tasks.workunit.client.0.smithi070.stderr:114600K .......... .......... .......... .......... .......... 84% 7.15M 4s 2024-05-08T06:49:10.668 INFO:tasks.workunit.client.0.smithi070.stderr:114650K .......... .......... .......... .......... .......... 84% 5.72M 4s 2024-05-08T06:49:10.679 INFO:tasks.workunit.client.0.smithi070.stderr:114700K .......... .......... .......... .......... .......... 84% 4.64M 4s 2024-05-08T06:49:10.688 INFO:tasks.workunit.client.0.smithi070.stderr:114750K .......... .......... .......... .......... .......... 84% 5.34M 4s 2024-05-08T06:49:10.697 INFO:tasks.workunit.client.0.smithi070.stderr:114800K .......... .......... .......... .......... .......... 84% 5.43M 4s 2024-05-08T06:49:10.706 INFO:tasks.workunit.client.0.smithi070.stderr:114850K .......... .......... .......... .......... .......... 84% 5.48M 4s 2024-05-08T06:49:10.718 INFO:tasks.workunit.client.0.smithi070.stderr:114900K .......... .......... .......... .......... .......... 84% 4.24M 4s 2024-05-08T06:49:10.727 INFO:tasks.workunit.client.0.smithi070.stderr:114950K .......... .......... .......... .......... .......... 84% 5.14M 4s 2024-05-08T06:49:10.736 INFO:tasks.workunit.client.0.smithi070.stderr:115000K .......... .......... .......... .......... .......... 84% 5.14M 4s 2024-05-08T06:49:10.744 INFO:tasks.workunit.client.0.smithi070.stderr:115050K .......... .......... .......... .......... .......... 84% 5.90M 4s 2024-05-08T06:49:10.754 INFO:tasks.workunit.client.0.smithi070.stderr:115100K .......... .......... .......... .......... .......... 84% 4.97M 4s 2024-05-08T06:49:10.763 INFO:tasks.workunit.client.0.smithi070.stderr:115150K .......... .......... .......... .......... .......... 84% 5.70M 4s 2024-05-08T06:49:10.773 INFO:tasks.workunit.client.0.smithi070.stderr:115200K .......... .......... .......... .......... .......... 84% 5.02M 4s 2024-05-08T06:49:10.781 INFO:tasks.workunit.client.0.smithi070.stderr:115250K .......... .......... .......... .......... .......... 84% 5.69M 4s 2024-05-08T06:49:10.790 INFO:tasks.workunit.client.0.smithi070.stderr:115300K .......... .......... .......... .......... .......... 84% 5.26M 4s 2024-05-08T06:49:10.799 INFO:tasks.workunit.client.0.smithi070.stderr:115350K .......... .......... .......... .......... .......... 85% 5.69M 4s 2024-05-08T06:49:10.807 INFO:tasks.workunit.client.0.smithi070.stderr:115400K .......... .......... .......... .......... .......... 85% 6.16M 4s 2024-05-08T06:49:10.816 INFO:tasks.workunit.client.0.smithi070.stderr:115450K .......... .......... .......... .......... .......... 85% 6.18M 4s 2024-05-08T06:49:10.825 INFO:tasks.workunit.client.0.smithi070.stderr:115500K .......... .......... .......... .......... .......... 85% 4.68M 4s 2024-05-08T06:49:10.833 INFO:tasks.workunit.client.0.smithi070.stderr:115550K .......... .......... .......... .......... .......... 85% 7.41M 4s 2024-05-08T06:49:10.841 INFO:tasks.workunit.client.0.smithi070.stderr:115600K .......... .......... .......... .......... .......... 85% 5.52M 4s 2024-05-08T06:49:10.849 INFO:tasks.workunit.client.0.smithi070.stderr:115650K .......... .......... .......... .......... .......... 85% 5.58M 4s 2024-05-08T06:49:10.859 INFO:tasks.workunit.client.0.smithi070.stderr:115700K .......... .......... .......... .......... .......... 85% 5.05M 4s 2024-05-08T06:49:10.868 INFO:tasks.workunit.client.0.smithi070.stderr:115750K .......... .......... .......... .......... .......... 85% 5.78M 4s 2024-05-08T06:49:10.877 INFO:tasks.workunit.client.0.smithi070.stderr:115800K .......... .......... .......... .......... .......... 85% 5.05M 4s 2024-05-08T06:49:10.887 INFO:tasks.workunit.client.0.smithi070.stderr:115850K .......... .......... .......... .......... .......... 85% 5.28M 4s 2024-05-08T06:49:10.898 INFO:tasks.workunit.client.0.smithi070.stderr:115900K .......... .......... .......... .......... .......... 85% 4.33M 4s 2024-05-08T06:49:10.908 INFO:tasks.workunit.client.0.smithi070.stderr:115950K .......... .......... .......... .......... .......... 85% 5.10M 4s 2024-05-08T06:49:10.916 INFO:tasks.workunit.client.0.smithi070.stderr:116000K .......... .......... .......... .......... .......... 85% 5.49M 4s 2024-05-08T06:49:10.925 INFO:tasks.workunit.client.0.smithi070.stderr:116050K .......... .......... .......... .......... .......... 85% 5.43M 4s 2024-05-08T06:49:10.938 INFO:tasks.workunit.client.0.smithi070.stderr:116100K .......... .......... .......... .......... .......... 85% 4.63M 4s 2024-05-08T06:49:10.944 INFO:tasks.workunit.client.0.smithi070.stderr:116150K .......... .......... .......... .......... .......... 85% 5.86M 4s 2024-05-08T06:49:10.953 INFO:tasks.workunit.client.0.smithi070.stderr:116200K .......... .......... .......... .......... .......... 85% 5.38M 4s 2024-05-08T06:49:10.963 INFO:tasks.workunit.client.0.smithi070.stderr:116250K .......... .......... .......... .......... .......... 85% 5.27M 4s 2024-05-08T06:49:10.973 INFO:tasks.workunit.client.0.smithi070.stderr:116300K .......... .......... .......... .......... .......... 85% 4.61M 4s 2024-05-08T06:49:10.983 INFO:tasks.workunit.client.0.smithi070.stderr:116350K .......... .......... .......... .......... .......... 85% 5.19M 4s 2024-05-08T06:49:10.991 INFO:tasks.workunit.client.0.smithi070.stderr:116400K .......... .......... .......... .......... .......... 85% 5.57M 4s 2024-05-08T06:49:11.000 INFO:tasks.workunit.client.0.smithi070.stderr:116450K .......... .......... .......... .......... .......... 85% 5.46M 4s 2024-05-08T06:49:11.011 INFO:tasks.workunit.client.0.smithi070.stderr:116500K .......... .......... .......... .......... .......... 85% 4.64M 4s 2024-05-08T06:49:11.020 INFO:tasks.workunit.client.0.smithi070.stderr:116550K .......... .......... .......... .......... .......... 85% 5.32M 4s 2024-05-08T06:49:11.029 INFO:tasks.workunit.client.0.smithi070.stderr:116600K .......... .......... .......... .......... .......... 85% 5.46M 4s 2024-05-08T06:49:11.036 INFO:tasks.workunit.client.0.smithi070.stderr:116650K .......... .......... .......... .......... .......... 85% 6.42M 4s 2024-05-08T06:49:11.044 INFO:tasks.workunit.client.0.smithi070.stderr:116700K .......... .......... .......... .......... .......... 86% 6.01M 4s 2024-05-08T06:49:11.051 INFO:tasks.workunit.client.0.smithi070.stderr:116750K .......... .......... .......... .......... .......... 86% 6.99M 3s 2024-05-08T06:49:11.058 INFO:tasks.workunit.client.0.smithi070.stderr:116800K .......... .......... .......... .......... .......... 86% 7.25M 3s 2024-05-08T06:49:11.065 INFO:tasks.workunit.client.0.smithi070.stderr:116850K .......... .......... .......... .......... .......... 86% 6.93M 3s 2024-05-08T06:49:11.073 INFO:tasks.workunit.client.0.smithi070.stderr:116900K .......... .......... .......... .......... .......... 86% 5.90M 3s 2024-05-08T06:49:11.083 INFO:tasks.workunit.client.0.smithi070.stderr:116950K .......... .......... .......... .......... .......... 86% 5.56M 3s 2024-05-08T06:49:11.092 INFO:tasks.workunit.client.0.smithi070.stderr:117000K .......... .......... .......... .......... .......... 86% 4.96M 3s 2024-05-08T06:49:11.102 INFO:tasks.workunit.client.0.smithi070.stderr:117050K .......... .......... .......... .......... .......... 86% 5.25M 3s 2024-05-08T06:49:11.113 INFO:tasks.workunit.client.0.smithi070.stderr:117100K .......... .......... .......... .......... .......... 86% 4.24M 3s 2024-05-08T06:49:11.122 INFO:tasks.workunit.client.0.smithi070.stderr:117150K .......... .......... .......... .......... .......... 86% 5.54M 3s 2024-05-08T06:49:11.131 INFO:tasks.workunit.client.0.smithi070.stderr:117200K .......... .......... .......... .......... .......... 86% 5.31M 3s 2024-05-08T06:49:11.141 INFO:tasks.workunit.client.0.smithi070.stderr:117250K .......... .......... .......... .......... .......... 86% 5.73M 3s 2024-05-08T06:49:11.150 INFO:tasks.workunit.client.0.smithi070.stderr:117300K .......... .......... .......... .......... .......... 86% 4.67M 3s 2024-05-08T06:49:11.158 INFO:tasks.workunit.client.0.smithi070.stderr:117350K .......... .......... .......... .......... .......... 86% 5.72M 3s 2024-05-08T06:49:11.166 INFO:tasks.workunit.client.0.smithi070.stderr:117400K .......... .......... .......... .......... .......... 86% 6.18M 3s 2024-05-08T06:49:11.174 INFO:tasks.workunit.client.0.smithi070.stderr:117450K .......... .......... .......... .......... .......... 86% 6.28M 3s 2024-05-08T06:49:11.183 INFO:tasks.workunit.client.0.smithi070.stderr:117500K .......... .......... .......... .......... .......... 86% 5.49M 3s 2024-05-08T06:49:11.190 INFO:tasks.workunit.client.0.smithi070.stderr:117550K .......... .......... .......... .......... .......... 86% 7.09M 3s 2024-05-08T06:49:11.197 INFO:tasks.workunit.client.0.smithi070.stderr:117600K .......... .......... .......... .......... .......... 86% 7.13M 3s 2024-05-08T06:49:11.203 INFO:tasks.workunit.client.0.smithi070.stderr:117650K .......... .......... .......... .......... .......... 86% 7.14M 3s 2024-05-08T06:49:11.210 INFO:tasks.workunit.client.0.smithi070.stderr:117700K .......... .......... .......... .......... .......... 86% 6.66M 3s 2024-05-08T06:49:11.217 INFO:tasks.workunit.client.0.smithi070.stderr:117750K .......... .......... .......... .......... .......... 86% 8.02M 3s 2024-05-08T06:49:11.224 INFO:tasks.workunit.client.0.smithi070.stderr:117800K .......... .......... .......... .......... .......... 86% 7.03M 3s 2024-05-08T06:49:11.231 INFO:tasks.workunit.client.0.smithi070.stderr:117850K .......... .......... .......... .......... .......... 86% 6.89M 3s 2024-05-08T06:49:11.239 INFO:tasks.workunit.client.0.smithi070.stderr:117900K .......... .......... .......... .......... .......... 86% 6.05M 3s 2024-05-08T06:49:11.246 INFO:tasks.workunit.client.0.smithi070.stderr:117950K .......... .......... .......... .......... .......... 86% 7.06M 3s 2024-05-08T06:49:11.253 INFO:tasks.workunit.client.0.smithi070.stderr:118000K .......... .......... .......... .......... .......... 86% 6.79M 3s 2024-05-08T06:49:11.260 INFO:tasks.workunit.client.0.smithi070.stderr:118050K .......... .......... .......... .......... .......... 86% 7.25M 3s 2024-05-08T06:49:11.268 INFO:tasks.workunit.client.0.smithi070.stderr:118100K .......... .......... .......... .......... .......... 87% 6.17M 3s 2024-05-08T06:49:11.274 INFO:tasks.workunit.client.0.smithi070.stderr:118150K .......... .......... .......... .......... .......... 87% 7.45M 3s 2024-05-08T06:49:11.281 INFO:tasks.workunit.client.0.smithi070.stderr:118200K .......... .......... .......... .......... .......... 87% 7.62M 3s 2024-05-08T06:49:11.288 INFO:tasks.workunit.client.0.smithi070.stderr:118250K .......... .......... .......... .......... .......... 87% 7.25M 3s 2024-05-08T06:49:11.295 INFO:tasks.workunit.client.0.smithi070.stderr:118300K .......... .......... .......... .......... .......... 87% 6.19M 3s 2024-05-08T06:49:11.302 INFO:tasks.workunit.client.0.smithi070.stderr:118350K .......... .......... .......... .......... .......... 87% 7.40M 3s 2024-05-08T06:49:11.309 INFO:tasks.workunit.client.0.smithi070.stderr:118400K .......... .......... .......... .......... .......... 87% 7.08M 3s 2024-05-08T06:49:11.316 INFO:tasks.workunit.client.0.smithi070.stderr:118450K .......... .......... .......... .......... .......... 87% 6.94M 3s 2024-05-08T06:49:11.324 INFO:tasks.workunit.client.0.smithi070.stderr:118500K .......... .......... .......... .......... .......... 87% 6.22M 3s 2024-05-08T06:49:11.330 INFO:tasks.workunit.client.0.smithi070.stderr:118550K .......... .......... .......... .......... .......... 87% 7.64M 3s 2024-05-08T06:49:11.337 INFO:tasks.workunit.client.0.smithi070.stderr:118600K .......... .......... .......... .......... .......... 87% 7.31M 3s 2024-05-08T06:49:11.345 INFO:tasks.workunit.client.0.smithi070.stderr:118650K .......... .......... .......... .......... .......... 87% 7.43M 3s 2024-05-08T06:49:11.351 INFO:tasks.workunit.client.0.smithi070.stderr:118700K .......... .......... .......... .......... .......... 87% 6.21M 3s 2024-05-08T06:49:11.359 INFO:tasks.workunit.client.0.smithi070.stderr:118750K .......... .......... .......... .......... .......... 87% 6.43M 3s 2024-05-08T06:49:11.367 INFO:tasks.workunit.client.0.smithi070.stderr:118800K .......... .......... .......... .......... .......... 87% 6.87M 3s 2024-05-08T06:49:11.376 INFO:tasks.workunit.client.0.smithi070.stderr:118850K .......... .......... .......... .......... .......... 87% 5.04M 3s 2024-05-08T06:49:11.385 INFO:tasks.workunit.client.0.smithi070.stderr:118900K .......... .......... .......... .......... .......... 87% 5.08M 3s 2024-05-08T06:49:11.394 INFO:tasks.workunit.client.0.smithi070.stderr:118950K .......... .......... .......... .......... .......... 87% 5.82M 3s 2024-05-08T06:49:11.402 INFO:tasks.workunit.client.0.smithi070.stderr:119000K .......... .......... .......... .......... .......... 87% 5.75M 3s 2024-05-08T06:49:11.409 INFO:tasks.workunit.client.0.smithi070.stderr:119050K .......... .......... .......... .......... .......... 87% 7.37M 3s 2024-05-08T06:49:11.417 INFO:tasks.workunit.client.0.smithi070.stderr:119100K .......... .......... .......... .......... .......... 87% 6.20M 3s 2024-05-08T06:49:11.424 INFO:tasks.workunit.client.0.smithi070.stderr:119150K .......... .......... .......... .......... .......... 87% 6.94M 3s 2024-05-08T06:49:11.432 INFO:tasks.workunit.client.0.smithi070.stderr:119200K .......... .......... .......... .......... .......... 87% 6.29M 3s 2024-05-08T06:49:11.440 INFO:tasks.workunit.client.0.smithi070.stderr:119250K .......... .......... .......... .......... .......... 87% 6.02M 3s 2024-05-08T06:49:11.450 INFO:tasks.workunit.client.0.smithi070.stderr:119300K .......... .......... .......... .......... .......... 87% 5.16M 3s 2024-05-08T06:49:11.458 INFO:tasks.workunit.client.0.smithi070.stderr:119350K .......... .......... .......... .......... .......... 87% 5.66M 3s 2024-05-08T06:49:11.466 INFO:tasks.workunit.client.0.smithi070.stderr:119400K .......... .......... .......... .......... .......... 87% 5.69M 3s 2024-05-08T06:49:11.474 INFO:tasks.workunit.client.0.smithi070.stderr:119450K .......... .......... .......... .......... .......... 88% 6.72M 3s 2024-05-08T06:49:11.484 INFO:tasks.workunit.client.0.smithi070.stderr:119500K .......... .......... .......... .......... .......... 88% 4.80M 3s 2024-05-08T06:49:11.493 INFO:tasks.workunit.client.0.smithi070.stderr:119550K .......... .......... .......... .......... .......... 88% 5.49M 3s 2024-05-08T06:49:11.502 INFO:tasks.workunit.client.0.smithi070.stderr:119600K .......... .......... .......... .......... .......... 88% 5.44M 3s 2024-05-08T06:49:11.510 INFO:tasks.workunit.client.0.smithi070.stderr:119650K .......... .......... .......... .......... .......... 88% 5.67M 3s 2024-05-08T06:49:11.520 INFO:tasks.workunit.client.0.smithi070.stderr:119700K .......... .......... .......... .......... .......... 88% 5.16M 3s 2024-05-08T06:49:11.528 INFO:tasks.workunit.client.0.smithi070.stderr:119750K .......... .......... .......... .......... .......... 88% 5.83M 3s 2024-05-08T06:49:11.537 INFO:tasks.workunit.client.0.smithi070.stderr:119800K .......... .......... .......... .......... .......... 88% 5.68M 3s 2024-05-08T06:49:11.545 INFO:tasks.workunit.client.0.smithi070.stderr:119850K .......... .......... .......... .......... .......... 88% 5.78M 3s 2024-05-08T06:49:11.556 INFO:tasks.workunit.client.0.smithi070.stderr:119900K .......... .......... .......... .......... .......... 88% 4.51M 3s 2024-05-08T06:49:11.566 INFO:tasks.workunit.client.0.smithi070.stderr:119950K .......... .......... .......... .......... .......... 88% 5.54M 3s 2024-05-08T06:49:11.574 INFO:tasks.workunit.client.0.smithi070.stderr:120000K .......... .......... .......... .......... .......... 88% 5.44M 3s 2024-05-08T06:49:11.583 INFO:tasks.workunit.client.0.smithi070.stderr:120050K .......... .......... .......... .......... .......... 88% 5.56M 3s 2024-05-08T06:49:11.593 INFO:tasks.workunit.client.0.smithi070.stderr:120100K .......... .......... .......... .......... .......... 88% 4.71M 3s 2024-05-08T06:49:11.603 INFO:tasks.workunit.client.0.smithi070.stderr:120150K .......... .......... .......... .......... .......... 88% 5.00M 3s 2024-05-08T06:49:11.613 INFO:tasks.workunit.client.0.smithi070.stderr:120200K .......... .......... .......... .......... .......... 88% 4.86M 3s 2024-05-08T06:49:11.623 INFO:tasks.workunit.client.0.smithi070.stderr:120250K .......... .......... .......... .......... .......... 88% 5.02M 3s 2024-05-08T06:49:11.634 INFO:tasks.workunit.client.0.smithi070.stderr:120300K .......... .......... .......... .......... .......... 88% 4.34M 3s 2024-05-08T06:49:11.644 INFO:tasks.workunit.client.0.smithi070.stderr:120350K .......... .......... .......... .......... .......... 88% 4.91M 3s 2024-05-08T06:49:11.653 INFO:tasks.workunit.client.0.smithi070.stderr:120400K .......... .......... .......... .......... .......... 88% 5.34M 3s 2024-05-08T06:49:11.662 INFO:tasks.workunit.client.0.smithi070.stderr:120450K .......... .......... .......... .......... .......... 88% 5.49M 3s 2024-05-08T06:49:11.671 INFO:tasks.workunit.client.0.smithi070.stderr:120500K .......... .......... .......... .......... .......... 88% 5.04M 3s 2024-05-08T06:49:11.679 INFO:tasks.workunit.client.0.smithi070.stderr:120550K .......... .......... .......... .......... .......... 88% 6.35M 3s 2024-05-08T06:49:11.688 INFO:tasks.workunit.client.0.smithi070.stderr:120600K .......... .......... .......... .......... .......... 88% 5.52M 3s 2024-05-08T06:49:11.698 INFO:tasks.workunit.client.0.smithi070.stderr:120650K .......... .......... .......... .......... .......... 88% 5.14M 3s 2024-05-08T06:49:11.708 INFO:tasks.workunit.client.0.smithi070.stderr:120700K .......... .......... .......... .......... .......... 88% 4.52M 3s 2024-05-08T06:49:11.718 INFO:tasks.workunit.client.0.smithi070.stderr:120750K .......... .......... .......... .......... .......... 88% 5.31M 3s 2024-05-08T06:49:11.727 INFO:tasks.workunit.client.0.smithi070.stderr:120800K .......... .......... .......... .......... .......... 89% 5.34M 3s 2024-05-08T06:49:11.736 INFO:tasks.workunit.client.0.smithi070.stderr:120850K .......... .......... .......... .......... .......... 89% 5.47M 3s 2024-05-08T06:49:11.747 INFO:tasks.workunit.client.0.smithi070.stderr:120900K .......... .......... .......... .......... .......... 89% 4.45M 3s 2024-05-08T06:49:11.756 INFO:tasks.workunit.client.0.smithi070.stderr:120950K .......... .......... .......... .......... .......... 89% 5.39M 3s 2024-05-08T06:49:11.764 INFO:tasks.workunit.client.0.smithi070.stderr:121000K .......... .......... .......... .......... .......... 89% 5.43M 3s 2024-05-08T06:49:11.773 INFO:tasks.workunit.client.0.smithi070.stderr:121050K .......... .......... .......... .......... .......... 89% 5.66M 3s 2024-05-08T06:49:11.784 INFO:tasks.workunit.client.0.smithi070.stderr:121100K .......... .......... .......... .......... .......... 89% 4.76M 3s 2024-05-08T06:49:11.792 INFO:tasks.workunit.client.0.smithi070.stderr:121150K .......... .......... .......... .......... .......... 89% 5.70M 3s 2024-05-08T06:49:11.801 INFO:tasks.workunit.client.0.smithi070.stderr:121200K .......... .......... .......... .......... .......... 89% 5.42M 3s 2024-05-08T06:49:11.810 INFO:tasks.workunit.client.0.smithi070.stderr:121250K .......... .......... .......... .......... .......... 89% 5.76M 3s 2024-05-08T06:49:11.820 INFO:tasks.workunit.client.0.smithi070.stderr:121300K .......... .......... .......... .......... .......... 89% 4.63M 3s 2024-05-08T06:49:11.829 INFO:tasks.workunit.client.0.smithi070.stderr:121350K .......... .......... .......... .......... .......... 89% 5.75M 3s 2024-05-08T06:49:11.838 INFO:tasks.workunit.client.0.smithi070.stderr:121400K .......... .......... .......... .......... .......... 89% 5.44M 3s 2024-05-08T06:49:11.847 INFO:tasks.workunit.client.0.smithi070.stderr:121450K .......... .......... .......... .......... .......... 89% 5.02M 3s 2024-05-08T06:49:11.859 INFO:tasks.workunit.client.0.smithi070.stderr:121500K .......... .......... .......... .......... .......... 89% 4.35M 3s 2024-05-08T06:49:11.868 INFO:tasks.workunit.client.0.smithi070.stderr:121550K .......... .......... .......... .......... .......... 89% 4.97M 3s 2024-05-08T06:49:11.879 INFO:tasks.workunit.client.0.smithi070.stderr:121600K .......... .......... .......... .......... .......... 89% 4.85M 3s 2024-05-08T06:49:11.888 INFO:tasks.workunit.client.0.smithi070.stderr:121650K .......... .......... .......... .......... .......... 89% 4.89M 3s 2024-05-08T06:49:11.901 INFO:tasks.workunit.client.0.smithi070.stderr:121700K .......... .......... .......... .......... .......... 89% 3.98M 3s 2024-05-08T06:49:11.912 INFO:tasks.workunit.client.0.smithi070.stderr:121750K .......... .......... .......... .......... .......... 89% 4.50M 3s 2024-05-08T06:49:11.921 INFO:tasks.workunit.client.0.smithi070.stderr:121800K .......... .......... .......... .......... .......... 89% 5.11M 3s 2024-05-08T06:49:11.931 INFO:tasks.workunit.client.0.smithi070.stderr:121850K .......... .......... .......... .......... .......... 89% 4.90M 3s 2024-05-08T06:49:11.943 INFO:tasks.workunit.client.0.smithi070.stderr:121900K .......... .......... .......... .......... .......... 89% 4.12M 3s 2024-05-08T06:49:11.955 INFO:tasks.workunit.client.0.smithi070.stderr:121950K .......... .......... .......... .......... .......... 89% 4.39M 3s 2024-05-08T06:49:11.965 INFO:tasks.workunit.client.0.smithi070.stderr:122000K .......... .......... .......... .......... .......... 89% 4.55M 3s 2024-05-08T06:49:11.976 INFO:tasks.workunit.client.0.smithi070.stderr:122050K .......... .......... .......... .......... .......... 89% 4.58M 3s 2024-05-08T06:49:11.988 INFO:tasks.workunit.client.0.smithi070.stderr:122100K .......... .......... .......... .......... .......... 89% 3.99M 3s 2024-05-08T06:49:11.998 INFO:tasks.workunit.client.0.smithi070.stderr:122150K .......... .......... .......... .......... .......... 90% 4.86M 2s 2024-05-08T06:49:12.008 INFO:tasks.workunit.client.0.smithi070.stderr:122200K .......... .......... .......... .......... .......... 90% 4.69M 2s 2024-05-08T06:49:12.018 INFO:tasks.workunit.client.0.smithi070.stderr:122250K .......... .......... .......... .......... .......... 90% 4.96M 2s 2024-05-08T06:49:12.030 INFO:tasks.workunit.client.0.smithi070.stderr:122300K .......... .......... .......... .......... .......... 90% 4.17M 2s 2024-05-08T06:49:12.041 INFO:tasks.workunit.client.0.smithi070.stderr:122350K .......... .......... .......... .......... .......... 90% 4.44M 2s 2024-05-08T06:49:12.052 INFO:tasks.workunit.client.0.smithi070.stderr:122400K .......... .......... .......... .......... .......... 90% 4.62M 2s 2024-05-08T06:49:12.062 INFO:tasks.workunit.client.0.smithi070.stderr:122450K .......... .......... .......... .......... .......... 90% 4.68M 2s 2024-05-08T06:49:12.075 INFO:tasks.workunit.client.0.smithi070.stderr:122500K .......... .......... .......... .......... .......... 90% 3.87M 2s 2024-05-08T06:49:12.085 INFO:tasks.workunit.client.0.smithi070.stderr:122550K .......... .......... .......... .......... .......... 90% 4.71M 2s 2024-05-08T06:49:12.095 INFO:tasks.workunit.client.0.smithi070.stderr:122600K .......... .......... .......... .......... .......... 90% 5.16M 2s 2024-05-08T06:49:12.104 INFO:tasks.workunit.client.0.smithi070.stderr:122650K .......... .......... .......... .......... .......... 90% 4.92M 2s 2024-05-08T06:49:12.115 INFO:tasks.workunit.client.0.smithi070.stderr:122700K .......... .......... .......... .......... .......... 90% 4.50M 2s 2024-05-08T06:49:12.124 INFO:tasks.workunit.client.0.smithi070.stderr:122750K .......... .......... .......... .......... .......... 90% 5.22M 2s 2024-05-08T06:49:12.134 INFO:tasks.workunit.client.0.smithi070.stderr:122800K .......... .......... .......... .......... .......... 90% 5.20M 2s 2024-05-08T06:49:12.143 INFO:tasks.workunit.client.0.smithi070.stderr:122850K .......... .......... .......... .......... .......... 90% 5.22M 2s 2024-05-08T06:49:12.153 INFO:tasks.workunit.client.0.smithi070.stderr:122900K .......... .......... .......... .......... .......... 90% 4.67M 2s 2024-05-08T06:49:12.162 INFO:tasks.workunit.client.0.smithi070.stderr:122950K .......... .......... .......... .......... .......... 90% 5.86M 2s 2024-05-08T06:49:12.171 INFO:tasks.workunit.client.0.smithi070.stderr:123000K .......... .......... .......... .......... .......... 90% 5.26M 2s 2024-05-08T06:49:12.180 INFO:tasks.workunit.client.0.smithi070.stderr:123050K .......... .......... .......... .......... .......... 90% 5.28M 2s 2024-05-08T06:49:12.190 INFO:tasks.workunit.client.0.smithi070.stderr:123100K .......... .......... .......... .......... .......... 90% 5.02M 2s 2024-05-08T06:49:12.199 INFO:tasks.workunit.client.0.smithi070.stderr:123150K .......... .......... .......... .......... .......... 90% 5.61M 2s 2024-05-08T06:49:12.208 INFO:tasks.workunit.client.0.smithi070.stderr:123200K .......... .......... .......... .......... .......... 90% 5.28M 2s 2024-05-08T06:49:12.216 INFO:tasks.workunit.client.0.smithi070.stderr:123250K .......... .......... .......... .......... .......... 90% 5.94M 2s 2024-05-08T06:49:12.226 INFO:tasks.workunit.client.0.smithi070.stderr:123300K .......... .......... .......... .......... .......... 90% 5.23M 2s 2024-05-08T06:49:12.234 INFO:tasks.workunit.client.0.smithi070.stderr:123350K .......... .......... .......... .......... .......... 90% 5.74M 2s 2024-05-08T06:49:12.243 INFO:tasks.workunit.client.0.smithi070.stderr:123400K .......... .......... .......... .......... .......... 90% 5.85M 2s 2024-05-08T06:49:12.252 INFO:tasks.workunit.client.0.smithi070.stderr:123450K .......... .......... .......... .......... .......... 90% 5.24M 2s 2024-05-08T06:49:12.263 INFO:tasks.workunit.client.0.smithi070.stderr:123500K .......... .......... .......... .......... .......... 91% 4.55M 2s 2024-05-08T06:49:12.272 INFO:tasks.workunit.client.0.smithi070.stderr:123550K .......... .......... .......... .......... .......... 91% 5.47M 2s 2024-05-08T06:49:12.281 INFO:tasks.workunit.client.0.smithi070.stderr:123600K .......... .......... .......... .......... .......... 91% 5.08M 2s 2024-05-08T06:49:12.291 INFO:tasks.workunit.client.0.smithi070.stderr:123650K .......... .......... .......... .......... .......... 91% 5.15M 2s 2024-05-08T06:49:12.302 INFO:tasks.workunit.client.0.smithi070.stderr:123700K .......... .......... .......... .......... .......... 91% 4.21M 2s 2024-05-08T06:49:12.311 INFO:tasks.workunit.client.0.smithi070.stderr:123750K .......... .......... .......... .......... .......... 91% 5.74M 2s 2024-05-08T06:49:12.320 INFO:tasks.workunit.client.0.smithi070.stderr:123800K .......... .......... .......... .......... .......... 91% 5.12M 2s 2024-05-08T06:49:12.329 INFO:tasks.workunit.client.0.smithi070.stderr:123850K .......... .......... .......... .......... .......... 91% 5.36M 2s 2024-05-08T06:49:12.339 INFO:tasks.workunit.client.0.smithi070.stderr:123900K .......... .......... .......... .......... .......... 91% 5.21M 2s 2024-05-08T06:49:12.346 INFO:tasks.workunit.client.0.smithi070.stderr:123950K .......... .......... .......... .......... .......... 91% 6.41M 2s 2024-05-08T06:49:12.351 INFO:tasks.workunit.client.0.smithi070.stderr:124000K .......... .......... .......... .......... .......... 91% 8.80M 2s 2024-05-08T06:49:12.357 INFO:tasks.workunit.client.0.smithi070.stderr:124050K .......... .......... .......... .......... .......... 91% 9.04M 2s 2024-05-08T06:49:12.363 INFO:tasks.workunit.client.0.smithi070.stderr:124100K .......... .......... .......... .......... .......... 91% 7.85M 2s 2024-05-08T06:49:12.368 INFO:tasks.workunit.client.0.smithi070.stderr:124150K .......... .......... .......... .......... .......... 91% 9.86M 2s 2024-05-08T06:49:12.373 INFO:tasks.workunit.client.0.smithi070.stderr:124200K .......... .......... .......... .......... .......... 91% 9.30M 2s 2024-05-08T06:49:12.378 INFO:tasks.workunit.client.0.smithi070.stderr:124250K .......... .......... .......... .......... .......... 91% 9.77M 2s 2024-05-08T06:49:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:12 smithi070 ceph-mon[29591]: pgmap v82: 129 pgs: 129 active+clean; 97 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.4 MiB/s wr, 21 op/s 2024-05-08T06:49:12.385 INFO:tasks.workunit.client.0.smithi070.stderr:124300K .......... .......... .......... .......... .......... 91% 7.33M 2s 2024-05-08T06:49:12.390 INFO:tasks.workunit.client.0.smithi070.stderr:124350K .......... .......... .......... .......... .......... 91% 9.14M 2s 2024-05-08T06:49:12.396 INFO:tasks.workunit.client.0.smithi070.stderr:124400K .......... .......... .......... .......... .......... 91% 8.74M 2s 2024-05-08T06:49:12.401 INFO:tasks.workunit.client.0.smithi070.stderr:124450K .......... .......... .......... .......... .......... 91% 8.72M 2s 2024-05-08T06:49:12.408 INFO:tasks.workunit.client.0.smithi070.stderr:124500K .......... .......... .......... .......... .......... 91% 7.77M 2s 2024-05-08T06:49:12.413 INFO:tasks.workunit.client.0.smithi070.stderr:124550K .......... .......... .......... .......... .......... 91% 8.53M 2s 2024-05-08T06:49:12.419 INFO:tasks.workunit.client.0.smithi070.stderr:124600K .......... .......... .......... .......... .......... 91% 8.59M 2s 2024-05-08T06:49:12.425 INFO:tasks.workunit.client.0.smithi070.stderr:124650K .......... .......... .......... .......... .......... 91% 8.70M 2s 2024-05-08T06:49:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:12 smithi172 ceph-mon[33377]: pgmap v82: 129 pgs: 129 active+clean; 97 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.4 MiB/s wr, 21 op/s 2024-05-08T06:49:12.432 INFO:tasks.workunit.client.0.smithi070.stderr:124700K .......... .......... .......... .......... .......... 91% 6.82M 2s 2024-05-08T06:49:12.438 INFO:tasks.workunit.client.0.smithi070.stderr:124750K .......... .......... .......... .......... .......... 91% 8.26M 2s 2024-05-08T06:49:12.445 INFO:tasks.workunit.client.0.smithi070.stderr:124800K .......... .......... .......... .......... .......... 91% 6.95M 2s 2024-05-08T06:49:12.452 INFO:tasks.workunit.client.0.smithi070.stderr:124850K .......... .......... .......... .......... .......... 92% 6.78M 2s 2024-05-08T06:49:12.461 INFO:tasks.workunit.client.0.smithi070.stderr:124900K .......... .......... .......... .......... .......... 92% 5.65M 2s 2024-05-08T06:49:12.467 INFO:tasks.workunit.client.0.smithi070.stderr:124950K .......... .......... .......... .......... .......... 92% 7.11M 2s 2024-05-08T06:49:12.473 INFO:tasks.workunit.client.0.smithi070.stderr:125000K .......... .......... .......... .......... .......... 92% 8.40M 2s 2024-05-08T06:49:12.479 INFO:tasks.workunit.client.0.smithi070.stderr:125050K .......... .......... .......... .......... .......... 92% 8.18M 2s 2024-05-08T06:49:12.487 INFO:tasks.workunit.client.0.smithi070.stderr:125100K .......... .......... .......... .......... .......... 92% 6.62M 2s 2024-05-08T06:49:12.493 INFO:tasks.workunit.client.0.smithi070.stderr:125150K .......... .......... .......... .......... .......... 92% 7.43M 2s 2024-05-08T06:49:12.500 INFO:tasks.workunit.client.0.smithi070.stderr:125200K .......... .......... .......... .......... .......... 92% 7.40M 2s 2024-05-08T06:49:12.507 INFO:tasks.workunit.client.0.smithi070.stderr:125250K .......... .......... .......... .......... .......... 92% 7.18M 2s 2024-05-08T06:49:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:12 smithi194 ceph-mon[33679]: pgmap v82: 129 pgs: 129 active+clean; 97 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.4 MiB/s wr, 21 op/s 2024-05-08T06:49:12.515 INFO:tasks.workunit.client.0.smithi070.stderr:125300K .......... .......... .......... .......... .......... 92% 6.38M 2s 2024-05-08T06:49:12.523 INFO:tasks.workunit.client.0.smithi070.stderr:125350K .......... .......... .......... .......... .......... 92% 6.10M 2s 2024-05-08T06:49:12.530 INFO:tasks.workunit.client.0.smithi070.stderr:125400K .......... .......... .......... .......... .......... 92% 6.53M 2s 2024-05-08T06:49:12.539 INFO:tasks.workunit.client.0.smithi070.stderr:125450K .......... .......... .......... .......... .......... 92% 5.62M 2s 2024-05-08T06:49:12.549 INFO:tasks.workunit.client.0.smithi070.stderr:125500K .......... .......... .......... .......... .......... 92% 4.88M 2s 2024-05-08T06:49:12.557 INFO:tasks.workunit.client.0.smithi070.stderr:125550K .......... .......... .......... .......... .......... 92% 6.16M 2s 2024-05-08T06:49:12.566 INFO:tasks.workunit.client.0.smithi070.stderr:125600K .......... .......... .......... .......... .......... 92% 5.63M 2s 2024-05-08T06:49:12.579 INFO:tasks.workunit.client.0.smithi070.stderr:125650K .......... .......... .......... .......... .......... 92% 5.39M 2s 2024-05-08T06:49:12.586 INFO:tasks.workunit.client.0.smithi070.stderr:125700K .......... .......... .......... .......... .......... 92% 4.37M 2s 2024-05-08T06:49:12.595 INFO:tasks.workunit.client.0.smithi070.stderr:125750K .......... .......... .......... .......... .......... 92% 5.09M 2s 2024-05-08T06:49:12.603 INFO:tasks.workunit.client.0.smithi070.stderr:125800K .......... .......... .......... .......... .......... 92% 6.19M 2s 2024-05-08T06:49:12.611 INFO:tasks.workunit.client.0.smithi070.stderr:125850K .......... .......... .......... .......... .......... 92% 6.04M 2s 2024-05-08T06:49:12.620 INFO:tasks.workunit.client.0.smithi070.stderr:125900K .......... .......... .......... .......... .......... 92% 5.77M 2s 2024-05-08T06:49:12.628 INFO:tasks.workunit.client.0.smithi070.stderr:125950K .......... .......... .......... .......... .......... 92% 6.06M 2s 2024-05-08T06:49:12.637 INFO:tasks.workunit.client.0.smithi070.stderr:126000K .......... .......... .......... .......... .......... 92% 5.43M 2s 2024-05-08T06:49:12.645 INFO:tasks.workunit.client.0.smithi070.stderr:126050K .......... .......... .......... .......... .......... 92% 6.37M 2s 2024-05-08T06:49:12.654 INFO:tasks.workunit.client.0.smithi070.stderr:126100K .......... .......... .......... .......... .......... 92% 5.28M 2s 2024-05-08T06:49:12.662 INFO:tasks.workunit.client.0.smithi070.stderr:126150K .......... .......... .......... .......... .......... 92% 5.74M 2s 2024-05-08T06:49:12.671 INFO:tasks.workunit.client.0.smithi070.stderr:126200K .......... .......... .......... .......... .......... 92% 5.64M 2s 2024-05-08T06:49:12.681 INFO:tasks.workunit.client.0.smithi070.stderr:126250K .......... .......... .......... .......... .......... 93% 5.04M 2s 2024-05-08T06:49:12.690 INFO:tasks.workunit.client.0.smithi070.stderr:126300K .......... .......... .......... .......... .......... 93% 5.07M 2s 2024-05-08T06:49:12.698 INFO:tasks.workunit.client.0.smithi070.stderr:126350K .......... .......... .......... .......... .......... 93% 5.76M 2s 2024-05-08T06:49:12.707 INFO:tasks.workunit.client.0.smithi070.stderr:126400K .......... .......... .......... .......... .......... 93% 5.57M 2s 2024-05-08T06:49:12.716 INFO:tasks.workunit.client.0.smithi070.stderr:126450K .......... .......... .......... .......... .......... 93% 5.41M 2s 2024-05-08T06:49:12.724 INFO:tasks.workunit.client.0.smithi070.stderr:126500K .......... .......... .......... .......... .......... 93% 6.20M 2s 2024-05-08T06:49:12.731 INFO:tasks.workunit.client.0.smithi070.stderr:126550K .......... .......... .......... .......... .......... 93% 6.91M 2s 2024-05-08T06:49:12.738 INFO:tasks.workunit.client.0.smithi070.stderr:126600K .......... .......... .......... .......... .......... 93% 7.52M 2s 2024-05-08T06:49:12.746 INFO:tasks.workunit.client.0.smithi070.stderr:126650K .......... .......... .......... .......... .......... 93% 6.21M 2s 2024-05-08T06:49:12.754 INFO:tasks.workunit.client.0.smithi070.stderr:126700K .......... .......... .......... .......... .......... 93% 5.62M 2s 2024-05-08T06:49:12.762 INFO:tasks.workunit.client.0.smithi070.stderr:126750K .......... .......... .......... .......... .......... 93% 6.02M 2s 2024-05-08T06:49:12.771 INFO:tasks.workunit.client.0.smithi070.stderr:126800K .......... .......... .......... .......... .......... 93% 6.08M 2s 2024-05-08T06:49:12.778 INFO:tasks.workunit.client.0.smithi070.stderr:126850K .......... .......... .......... .......... .......... 93% 6.23M 2s 2024-05-08T06:49:12.786 INFO:tasks.workunit.client.0.smithi070.stderr:126900K .......... .......... .......... .......... .......... 93% 5.89M 2s 2024-05-08T06:49:12.796 INFO:tasks.workunit.client.0.smithi070.stderr:126950K .......... .......... .......... .......... .......... 93% 5.77M 2s 2024-05-08T06:49:12.803 INFO:tasks.workunit.client.0.smithi070.stderr:127000K .......... .......... .......... .......... .......... 93% 6.29M 2s 2024-05-08T06:49:12.809 INFO:tasks.workunit.client.0.smithi070.stderr:127050K .......... .......... .......... .......... .......... 93% 7.81M 2s 2024-05-08T06:49:12.815 INFO:tasks.workunit.client.0.smithi070.stderr:127100K .......... .......... .......... .......... .......... 93% 7.91M 2s 2024-05-08T06:49:12.818 INFO:tasks.workunit.client.0.smithi070.stderr:127150K .......... .......... .......... .......... .......... 93% 12.1M 2s 2024-05-08T06:49:12.823 INFO:tasks.workunit.client.0.smithi070.stderr:127200K .......... .......... .......... .......... .......... 93% 11.9M 2s 2024-05-08T06:49:12.827 INFO:tasks.workunit.client.0.smithi070.stderr:127250K .......... .......... .......... .......... .......... 93% 11.4M 2s 2024-05-08T06:49:12.832 INFO:tasks.workunit.client.0.smithi070.stderr:127300K .......... .......... .......... .......... .......... 93% 9.99M 2s 2024-05-08T06:49:12.838 INFO:tasks.workunit.client.0.smithi070.stderr:127350K .......... .......... .......... .......... .......... 93% 8.30M 2s 2024-05-08T06:49:12.845 INFO:tasks.workunit.client.0.smithi070.stderr:127400K .......... .......... .......... .......... .......... 93% 6.60M 2s 2024-05-08T06:49:12.849 INFO:tasks.workunit.client.0.smithi070.stderr:127450K .......... .......... .......... .......... .......... 93% 12.1M 2s 2024-05-08T06:49:12.855 INFO:tasks.workunit.client.0.smithi070.stderr:127500K .......... .......... .......... .......... .......... 93% 8.26M 2s 2024-05-08T06:49:12.860 INFO:tasks.workunit.client.0.smithi070.stderr:127550K .......... .......... .......... .......... .......... 93% 9.33M 1s 2024-05-08T06:49:12.867 INFO:tasks.workunit.client.0.smithi070.stderr:127600K .......... .......... .......... .......... .......... 94% 7.64M 1s 2024-05-08T06:49:12.874 INFO:tasks.workunit.client.0.smithi070.stderr:127650K .......... .......... .......... .......... .......... 94% 6.99M 1s 2024-05-08T06:49:12.883 INFO:tasks.workunit.client.0.smithi070.stderr:127700K .......... .......... .......... .......... .......... 94% 5.57M 1s 2024-05-08T06:49:12.890 INFO:tasks.workunit.client.0.smithi070.stderr:127750K .......... .......... .......... .......... .......... 94% 6.71M 1s 2024-05-08T06:49:12.898 INFO:tasks.workunit.client.0.smithi070.stderr:127800K .......... .......... .......... .......... .......... 94% 6.13M 1s 2024-05-08T06:49:12.906 INFO:tasks.workunit.client.0.smithi070.stderr:127850K .......... .......... .......... .......... .......... 94% 6.11M 1s 2024-05-08T06:49:12.916 INFO:tasks.workunit.client.0.smithi070.stderr:127900K .......... .......... .......... .......... .......... 94% 5.10M 1s 2024-05-08T06:49:12.924 INFO:tasks.workunit.client.0.smithi070.stderr:127950K .......... .......... .......... .......... .......... 94% 6.22M 1s 2024-05-08T06:49:12.932 INFO:tasks.workunit.client.0.smithi070.stderr:128000K .......... .......... .......... .......... .......... 94% 5.82M 1s 2024-05-08T06:49:12.941 INFO:tasks.workunit.client.0.smithi070.stderr:128050K .......... .......... .......... .......... .......... 94% 5.80M 1s 2024-05-08T06:49:12.953 INFO:tasks.workunit.client.0.smithi070.stderr:128100K .......... .......... .......... .......... .......... 94% 4.09M 1s 2024-05-08T06:49:12.963 INFO:tasks.workunit.client.0.smithi070.stderr:128150K .......... .......... .......... .......... .......... 94% 4.79M 1s 2024-05-08T06:49:12.972 INFO:tasks.workunit.client.0.smithi070.stderr:128200K .......... .......... .......... .......... .......... 94% 5.28M 1s 2024-05-08T06:49:12.980 INFO:tasks.workunit.client.0.smithi070.stderr:128250K .......... .......... .......... .......... .......... 94% 6.00M 1s 2024-05-08T06:49:12.991 INFO:tasks.workunit.client.0.smithi070.stderr:128300K .......... .......... .......... .......... .......... 94% 4.38M 1s 2024-05-08T06:49:13.000 INFO:tasks.workunit.client.0.smithi070.stderr:128350K .......... .......... .......... .......... .......... 94% 5.59M 1s 2024-05-08T06:49:13.009 INFO:tasks.workunit.client.0.smithi070.stderr:128400K .......... .......... .......... .......... .......... 94% 5.44M 1s 2024-05-08T06:49:13.019 INFO:tasks.workunit.client.0.smithi070.stderr:128450K .......... .......... .......... .......... .......... 94% 5.19M 1s 2024-05-08T06:49:13.029 INFO:tasks.workunit.client.0.smithi070.stderr:128500K .......... .......... .......... .......... .......... 94% 4.66M 1s 2024-05-08T06:49:13.039 INFO:tasks.workunit.client.0.smithi070.stderr:128550K .......... .......... .......... .......... .......... 94% 4.93M 1s 2024-05-08T06:49:13.047 INFO:tasks.workunit.client.0.smithi070.stderr:128600K .......... .......... .......... .......... .......... 94% 5.76M 1s 2024-05-08T06:49:13.053 INFO:tasks.workunit.client.0.smithi070.stderr:128650K .......... .......... .......... .......... .......... 94% 7.66M 1s 2024-05-08T06:49:13.061 INFO:tasks.workunit.client.0.smithi070.stderr:128700K .......... .......... .......... .......... .......... 94% 6.32M 1s 2024-05-08T06:49:13.069 INFO:tasks.workunit.client.0.smithi070.stderr:128750K .......... .......... .......... .......... .......... 94% 6.19M 1s 2024-05-08T06:49:13.077 INFO:tasks.workunit.client.0.smithi070.stderr:128800K .......... .......... .......... .......... .......... 94% 6.04M 1s 2024-05-08T06:49:13.087 INFO:tasks.workunit.client.0.smithi070.stderr:128850K .......... .......... .......... .......... .......... 94% 5.42M 1s 2024-05-08T06:49:13.098 INFO:tasks.workunit.client.0.smithi070.stderr:128900K .......... .......... .......... .......... .......... 94% 4.37M 1s 2024-05-08T06:49:13.107 INFO:tasks.workunit.client.0.smithi070.stderr:128950K .......... .......... .......... .......... .......... 95% 5.23M 1s 2024-05-08T06:49:13.116 INFO:tasks.workunit.client.0.smithi070.stderr:129000K .......... .......... .......... .......... .......... 95% 5.67M 1s 2024-05-08T06:49:13.125 INFO:tasks.workunit.client.0.smithi070.stderr:129050K .......... .......... .......... .......... .......... 95% 5.09M 1s 2024-05-08T06:49:13.136 INFO:tasks.workunit.client.0.smithi070.stderr:129100K .......... .......... .......... .......... .......... 95% 4.50M 1s 2024-05-08T06:49:13.145 INFO:tasks.workunit.client.0.smithi070.stderr:129150K .......... .......... .......... .......... .......... 95% 5.34M 1s 2024-05-08T06:49:13.154 INFO:tasks.workunit.client.0.smithi070.stderr:129200K .......... .......... .......... .......... .......... 95% 5.35M 1s 2024-05-08T06:49:13.164 INFO:tasks.workunit.client.0.smithi070.stderr:129250K .......... .......... .......... .......... .......... 95% 5.13M 1s 2024-05-08T06:49:13.175 INFO:tasks.workunit.client.0.smithi070.stderr:129300K .......... .......... .......... .......... .......... 95% 4.50M 1s 2024-05-08T06:49:13.185 INFO:tasks.workunit.client.0.smithi070.stderr:129350K .......... .......... .......... .......... .......... 95% 4.70M 1s 2024-05-08T06:49:13.195 INFO:tasks.workunit.client.0.smithi070.stderr:129400K .......... .......... .......... .......... .......... 95% 4.97M 1s 2024-05-08T06:49:13.205 INFO:tasks.workunit.client.0.smithi070.stderr:129450K .......... .......... .......... .......... .......... 95% 4.95M 1s 2024-05-08T06:49:13.216 INFO:tasks.workunit.client.0.smithi070.stderr:129500K .......... .......... .......... .......... .......... 95% 4.24M 1s 2024-05-08T06:49:13.226 INFO:tasks.workunit.client.0.smithi070.stderr:129550K .......... .......... .......... .......... .......... 95% 5.09M 1s 2024-05-08T06:49:13.236 INFO:tasks.workunit.client.0.smithi070.stderr:129600K .......... .......... .......... .......... .......... 95% 4.85M 1s 2024-05-08T06:49:13.246 INFO:tasks.workunit.client.0.smithi070.stderr:129650K .......... .......... .......... .......... .......... 95% 4.74M 1s 2024-05-08T06:49:13.257 INFO:tasks.workunit.client.0.smithi070.stderr:129700K .......... .......... .......... .......... .......... 95% 4.40M 1s 2024-05-08T06:49:13.267 INFO:tasks.workunit.client.0.smithi070.stderr:129750K .......... .......... .......... .......... .......... 95% 5.15M 1s 2024-05-08T06:49:13.277 INFO:tasks.workunit.client.0.smithi070.stderr:129800K .......... .......... .......... .......... .......... 95% 5.04M 1s 2024-05-08T06:49:13.286 INFO:tasks.workunit.client.0.smithi070.stderr:129850K .......... .......... .......... .......... .......... 95% 5.25M 1s 2024-05-08T06:49:13.296 INFO:tasks.workunit.client.0.smithi070.stderr:129900K .......... .......... .......... .......... .......... 95% 4.56M 1s 2024-05-08T06:49:13.307 INFO:tasks.workunit.client.0.smithi070.stderr:129950K .......... .......... .......... .......... .......... 95% 4.87M 1s 2024-05-08T06:49:13.317 INFO:tasks.workunit.client.0.smithi070.stderr:130000K .......... .......... .......... .......... .......... 95% 4.79M 1s 2024-05-08T06:49:13.326 INFO:tasks.workunit.client.0.smithi070.stderr:130050K .......... .......... .......... .......... .......... 95% 4.98M 1s 2024-05-08T06:49:13.338 INFO:tasks.workunit.client.0.smithi070.stderr:130100K .......... .......... .......... .......... .......... 95% 4.54M 1s 2024-05-08T06:49:13.347 INFO:tasks.workunit.client.0.smithi070.stderr:130150K .......... .......... .......... .......... .......... 95% 5.14M 1s 2024-05-08T06:49:13.357 INFO:tasks.workunit.client.0.smithi070.stderr:130200K .......... .......... .......... .......... .......... 95% 4.84M 1s 2024-05-08T06:49:13.367 INFO:tasks.workunit.client.0.smithi070.stderr:130250K .......... .......... .......... .......... .......... 95% 4.73M 1s 2024-05-08T06:49:13.379 INFO:tasks.workunit.client.0.smithi070.stderr:130300K .......... .......... .......... .......... .......... 96% 4.32M 1s 2024-05-08T06:49:13.388 INFO:tasks.workunit.client.0.smithi070.stderr:130350K .......... .......... .......... .......... .......... 96% 5.16M 1s 2024-05-08T06:49:13.398 INFO:tasks.workunit.client.0.smithi070.stderr:130400K .......... .......... .......... .......... .......... 96% 4.94M 1s 2024-05-08T06:49:13.408 INFO:tasks.workunit.client.0.smithi070.stderr:130450K .......... .......... .......... .......... .......... 96% 4.71M 1s 2024-05-08T06:49:13.421 INFO:tasks.workunit.client.0.smithi070.stderr:130500K .......... .......... .......... .......... .......... 96% 3.97M 1s 2024-05-08T06:49:13.430 INFO:tasks.workunit.client.0.smithi070.stderr:130550K .......... .......... .......... .......... .......... 96% 4.90M 1s 2024-05-08T06:49:13.441 INFO:tasks.workunit.client.0.smithi070.stderr:130600K .......... .......... .......... .......... .......... 96% 4.68M 1s 2024-05-08T06:49:13.452 INFO:tasks.workunit.client.0.smithi070.stderr:130650K .......... .......... .......... .......... .......... 96% 4.62M 1s 2024-05-08T06:49:13.463 INFO:tasks.workunit.client.0.smithi070.stderr:130700K .......... .......... .......... .......... .......... 96% 4.25M 1s 2024-05-08T06:49:13.474 INFO:tasks.workunit.client.0.smithi070.stderr:130750K .......... .......... .......... .......... .......... 96% 4.45M 1s 2024-05-08T06:49:13.484 INFO:tasks.workunit.client.0.smithi070.stderr:130800K .......... .......... .......... .......... .......... 96% 5.09M 1s 2024-05-08T06:49:13.495 INFO:tasks.workunit.client.0.smithi070.stderr:130850K .......... .......... .......... .......... .......... 96% 4.62M 1s 2024-05-08T06:49:13.508 INFO:tasks.workunit.client.0.smithi070.stderr:130900K .......... .......... .......... .......... .......... 96% 3.67M 1s 2024-05-08T06:49:13.519 INFO:tasks.workunit.client.0.smithi070.stderr:130950K .......... .......... .......... .......... .......... 96% 4.41M 1s 2024-05-08T06:49:13.529 INFO:tasks.workunit.client.0.smithi070.stderr:131000K .......... .......... .......... .......... .......... 96% 4.62M 1s 2024-05-08T06:49:13.539 INFO:tasks.workunit.client.0.smithi070.stderr:131050K .......... .......... .......... .......... .......... 96% 4.97M 1s 2024-05-08T06:49:13.550 INFO:tasks.workunit.client.0.smithi070.stderr:131100K .......... .......... .......... .......... .......... 96% 4.25M 1s 2024-05-08T06:49:13.559 INFO:tasks.workunit.client.0.smithi070.stderr:131150K .......... .......... .......... .......... .......... 96% 5.73M 1s 2024-05-08T06:49:13.566 INFO:tasks.workunit.client.0.smithi070.stderr:131200K .......... .......... .......... .......... .......... 96% 6.36M 1s 2024-05-08T06:49:13.575 INFO:tasks.workunit.client.0.smithi070.stderr:131250K .......... .......... .......... .......... .......... 96% 5.94M 1s 2024-05-08T06:49:13.583 INFO:tasks.workunit.client.0.smithi070.stderr:131300K .......... .......... .......... .......... .......... 96% 5.42M 1s 2024-05-08T06:49:13.592 INFO:tasks.workunit.client.0.smithi070.stderr:131350K .......... .......... .......... .......... .......... 96% 5.55M 1s 2024-05-08T06:49:13.602 INFO:tasks.workunit.client.0.smithi070.stderr:131400K .......... .......... .......... .......... .......... 96% 5.26M 1s 2024-05-08T06:49:13.610 INFO:tasks.workunit.client.0.smithi070.stderr:131450K .......... .......... .......... .......... .......... 96% 5.69M 1s 2024-05-08T06:49:13.621 INFO:tasks.workunit.client.0.smithi070.stderr:131500K .......... .......... .......... .......... .......... 96% 4.62M 1s 2024-05-08T06:49:13.630 INFO:tasks.workunit.client.0.smithi070.stderr:131550K .......... .......... .......... .......... .......... 96% 5.32M 1s 2024-05-08T06:49:13.640 INFO:tasks.workunit.client.0.smithi070.stderr:131600K .......... .......... .......... .......... .......... 96% 5.23M 1s 2024-05-08T06:49:13.648 INFO:tasks.workunit.client.0.smithi070.stderr:131650K .......... .......... .......... .......... .......... 97% 6.02M 1s 2024-05-08T06:49:13.657 INFO:tasks.workunit.client.0.smithi070.stderr:131700K .......... .......... .......... .......... .......... 97% 4.97M 1s 2024-05-08T06:49:13.667 INFO:tasks.workunit.client.0.smithi070.stderr:131750K .......... .......... .......... .......... .......... 97% 4.99M 1s 2024-05-08T06:49:13.676 INFO:tasks.workunit.client.0.smithi070.stderr:131800K .......... .......... .......... .......... .......... 97% 5.52M 1s 2024-05-08T06:49:13.685 INFO:tasks.workunit.client.0.smithi070.stderr:131850K .......... .......... .......... .......... .......... 97% 5.49M 1s 2024-05-08T06:49:13.696 INFO:tasks.workunit.client.0.smithi070.stderr:131900K .......... .......... .......... .......... .......... 97% 4.28M 1s 2024-05-08T06:49:13.706 INFO:tasks.workunit.client.0.smithi070.stderr:131950K .......... .......... .......... .......... .......... 97% 5.36M 1s 2024-05-08T06:49:13.714 INFO:tasks.workunit.client.0.smithi070.stderr:132000K .......... .......... .......... .......... .......... 97% 5.32M 1s 2024-05-08T06:49:13.725 INFO:tasks.workunit.client.0.smithi070.stderr:132050K .......... .......... .......... .......... .......... 97% 4.94M 1s 2024-05-08T06:49:13.737 INFO:tasks.workunit.client.0.smithi070.stderr:132100K .......... .......... .......... .......... .......... 97% 4.06M 1s 2024-05-08T06:49:13.745 INFO:tasks.workunit.client.0.smithi070.stderr:132150K .......... .......... .......... .......... .......... 97% 5.68M 1s 2024-05-08T06:49:13.753 INFO:tasks.workunit.client.0.smithi070.stderr:132200K .......... .......... .......... .......... .......... 97% 5.94M 1s 2024-05-08T06:49:13.762 INFO:tasks.workunit.client.0.smithi070.stderr:132250K .......... .......... .......... .......... .......... 97% 5.77M 1s 2024-05-08T06:49:13.771 INFO:tasks.workunit.client.0.smithi070.stderr:132300K .......... .......... .......... .......... .......... 97% 5.23M 1s 2024-05-08T06:49:13.779 INFO:tasks.workunit.client.0.smithi070.stderr:132350K .......... .......... .......... .......... .......... 97% 6.17M 1s 2024-05-08T06:49:13.786 INFO:tasks.workunit.client.0.smithi070.stderr:132400K .......... .......... .......... .......... .......... 97% 6.39M 1s 2024-05-08T06:49:13.794 INFO:tasks.workunit.client.0.smithi070.stderr:132450K .......... .......... .......... .......... .......... 97% 6.45M 1s 2024-05-08T06:49:13.803 INFO:tasks.workunit.client.0.smithi070.stderr:132500K .......... .......... .......... .......... .......... 97% 5.40M 1s 2024-05-08T06:49:13.811 INFO:tasks.workunit.client.0.smithi070.stderr:132550K .......... .......... .......... .......... .......... 97% 5.99M 1s 2024-05-08T06:49:13.820 INFO:tasks.workunit.client.0.smithi070.stderr:132600K .......... .......... .......... .......... .......... 97% 5.36M 1s 2024-05-08T06:49:13.828 INFO:tasks.workunit.client.0.smithi070.stderr:132650K .......... .......... .......... .......... .......... 97% 6.41M 1s 2024-05-08T06:49:13.837 INFO:tasks.workunit.client.0.smithi070.stderr:132700K .......... .......... .......... .......... .......... 97% 5.50M 1s 2024-05-08T06:49:13.845 INFO:tasks.workunit.client.0.smithi070.stderr:132750K .......... .......... .......... .......... .......... 97% 6.13M 1s 2024-05-08T06:49:13.852 INFO:tasks.workunit.client.0.smithi070.stderr:132800K .......... .......... .......... .......... .......... 97% 6.37M 1s 2024-05-08T06:49:13.861 INFO:tasks.workunit.client.0.smithi070.stderr:132850K .......... .......... .......... .......... .......... 97% 5.84M 1s 2024-05-08T06:49:13.871 INFO:tasks.workunit.client.0.smithi070.stderr:132900K .......... .......... .......... .......... .......... 97% 4.72M 1s 2024-05-08T06:49:13.881 INFO:tasks.workunit.client.0.smithi070.stderr:132950K .......... .......... .......... .......... .......... 97% 5.07M 1s 2024-05-08T06:49:13.890 INFO:tasks.workunit.client.0.smithi070.stderr:133000K .......... .......... .......... .......... .......... 98% 5.31M 0s 2024-05-08T06:49:13.900 INFO:tasks.workunit.client.0.smithi070.stderr:133050K .......... .......... .......... .......... .......... 98% 4.91M 0s 2024-05-08T06:49:13.912 INFO:tasks.workunit.client.0.smithi070.stderr:133100K .......... .......... .......... .......... .......... 98% 4.29M 0s 2024-05-08T06:49:13.922 INFO:tasks.workunit.client.0.smithi070.stderr:133150K .......... .......... .......... .......... .......... 98% 4.88M 0s 2024-05-08T06:49:13.932 INFO:tasks.workunit.client.0.smithi070.stderr:133200K .......... .......... .......... .......... .......... 98% 4.85M 0s 2024-05-08T06:49:13.941 INFO:tasks.workunit.client.0.smithi070.stderr:133250K .......... .......... .......... .......... .......... 98% 5.17M 0s 2024-05-08T06:49:13.952 INFO:tasks.workunit.client.0.smithi070.stderr:133300K .......... .......... .......... .......... .......... 98% 4.44M 0s 2024-05-08T06:49:13.963 INFO:tasks.workunit.client.0.smithi070.stderr:133350K .......... .......... .......... .......... .......... 98% 4.70M 0s 2024-05-08T06:49:13.972 INFO:tasks.workunit.client.0.smithi070.stderr:133400K .......... .......... .......... .......... .......... 98% 5.08M 0s 2024-05-08T06:49:13.982 INFO:tasks.workunit.client.0.smithi070.stderr:133450K .......... .......... .......... .......... .......... 98% 4.73M 0s 2024-05-08T06:49:13.994 INFO:tasks.workunit.client.0.smithi070.stderr:133500K .......... .......... .......... .......... .......... 98% 4.28M 0s 2024-05-08T06:49:14.006 INFO:tasks.workunit.client.0.smithi070.stderr:133550K .......... .......... .......... .......... .......... 98% 4.88M 0s 2024-05-08T06:49:14.014 INFO:tasks.workunit.client.0.smithi070.stderr:133600K .......... .......... .......... .......... .......... 98% 4.93M 0s 2024-05-08T06:49:14.024 INFO:tasks.workunit.client.0.smithi070.stderr:133650K .......... .......... .......... .......... .......... 98% 4.89M 0s 2024-05-08T06:49:14.036 INFO:tasks.workunit.client.0.smithi070.stderr:133700K .......... .......... .......... .......... .......... 98% 4.11M 0s 2024-05-08T06:49:14.045 INFO:tasks.workunit.client.0.smithi070.stderr:133750K .......... .......... .......... .......... .......... 98% 5.15M 0s 2024-05-08T06:49:14.056 INFO:tasks.workunit.client.0.smithi070.stderr:133800K .......... .......... .......... .......... .......... 98% 4.72M 0s 2024-05-08T06:49:14.066 INFO:tasks.workunit.client.0.smithi070.stderr:133850K .......... .......... .......... .......... .......... 98% 4.80M 0s 2024-05-08T06:49:14.078 INFO:tasks.workunit.client.0.smithi070.stderr:133900K .......... .......... .......... .......... .......... 98% 4.11M 0s 2024-05-08T06:49:14.088 INFO:tasks.workunit.client.0.smithi070.stderr:133950K .......... .......... .......... .......... .......... 98% 4.89M 0s 2024-05-08T06:49:14.097 INFO:tasks.workunit.client.0.smithi070.stderr:134000K .......... .......... .......... .......... .......... 98% 4.87M 0s 2024-05-08T06:49:14.105 INFO:tasks.workunit.client.0.smithi070.stderr:134050K .......... .......... .......... .......... .......... 98% 6.28M 0s 2024-05-08T06:49:14.115 INFO:tasks.workunit.client.0.smithi070.stderr:134100K .......... .......... .......... .......... .......... 98% 5.11M 0s 2024-05-08T06:49:14.123 INFO:tasks.workunit.client.0.smithi070.stderr:134150K .......... .......... .......... .......... .......... 98% 6.09M 0s 2024-05-08T06:49:14.131 INFO:tasks.workunit.client.0.smithi070.stderr:134200K .......... .......... .......... .......... .......... 98% 5.90M 0s 2024-05-08T06:49:14.139 INFO:tasks.workunit.client.0.smithi070.stderr:134250K .......... .......... .......... .......... .......... 98% 6.13M 0s 2024-05-08T06:49:14.148 INFO:tasks.workunit.client.0.smithi070.stderr:134300K .......... .......... .......... .......... .......... 98% 5.29M 0s 2024-05-08T06:49:14.156 INFO:tasks.workunit.client.0.smithi070.stderr:134350K .......... .......... .......... .......... .......... 99% 6.10M 0s 2024-05-08T06:49:14.164 INFO:tasks.workunit.client.0.smithi070.stderr:134400K .......... .......... .......... .......... .......... 99% 6.07M 0s 2024-05-08T06:49:14.175 INFO:tasks.workunit.client.0.smithi070.stderr:134450K .......... .......... .......... .......... .......... 99% 4.70M 0s 2024-05-08T06:49:14.186 INFO:tasks.workunit.client.0.smithi070.stderr:134500K .......... .......... .......... .......... .......... 99% 4.39M 0s 2024-05-08T06:49:14.195 INFO:tasks.workunit.client.0.smithi070.stderr:134550K .......... .......... .......... .......... .......... 99% 5.24M 0s 2024-05-08T06:49:14.206 INFO:tasks.workunit.client.0.smithi070.stderr:134600K .......... .......... .......... .......... .......... 99% 4.68M 0s 2024-05-08T06:49:14.216 INFO:tasks.workunit.client.0.smithi070.stderr:134650K .......... .......... .......... .......... .......... 99% 4.62M 0s 2024-05-08T06:49:14.228 INFO:tasks.workunit.client.0.smithi070.stderr:134700K .......... .......... .......... .......... .......... 99% 4.07M 0s 2024-05-08T06:49:14.238 INFO:tasks.workunit.client.0.smithi070.stderr:134750K .......... .......... .......... .......... .......... 99% 4.76M 0s 2024-05-08T06:49:14.248 INFO:tasks.workunit.client.0.smithi070.stderr:134800K .......... .......... .......... .......... .......... 99% 5.27M 0s 2024-05-08T06:49:14.257 INFO:tasks.workunit.client.0.smithi070.stderr:134850K .......... .......... .......... .......... .......... 99% 5.24M 0s 2024-05-08T06:49:14.268 INFO:tasks.workunit.client.0.smithi070.stderr:134900K .......... .......... .......... .......... .......... 99% 4.43M 0s 2024-05-08T06:49:14.279 INFO:tasks.workunit.client.0.smithi070.stderr:134950K .......... .......... .......... .......... .......... 99% 4.53M 0s 2024-05-08T06:49:14.289 INFO:tasks.workunit.client.0.smithi070.stderr:135000K .......... .......... .......... .......... .......... 99% 4.72M 0s 2024-05-08T06:49:14.299 INFO:tasks.workunit.client.0.smithi070.stderr:135050K .......... .......... .......... .......... .......... 99% 5.13M 0s 2024-05-08T06:49:14.311 INFO:tasks.workunit.client.0.smithi070.stderr:135100K .......... .......... .......... .......... .......... 99% 3.97M 0s 2024-05-08T06:49:14.321 INFO:tasks.workunit.client.0.smithi070.stderr:135150K .......... .......... .......... .......... .......... 99% 4.70M 0s 2024-05-08T06:49:14.330 INFO:tasks.workunit.client.0.smithi070.stderr:135200K .......... .......... .......... .......... .......... 99% 5.57M 0s 2024-05-08T06:49:14.339 INFO:tasks.workunit.client.0.smithi070.stderr:135250K .......... .......... .......... .......... .......... 99% 5.86M 0s 2024-05-08T06:49:14.350 INFO:tasks.workunit.client.0.smithi070.stderr:135300K .......... .......... .......... .......... .......... 99% 4.60M 0s 2024-05-08T06:49:14.360 INFO:tasks.workunit.client.0.smithi070.stderr:135350K .......... .......... .......... .......... .......... 99% 4.54M 0s 2024-05-08T06:49:14.368 INFO:tasks.workunit.client.0.smithi070.stderr:135400K .......... .......... .......... .......... .......... 99% 5.87M 0s 2024-05-08T06:49:14.376 INFO:tasks.workunit.client.0.smithi070.stderr:135450K .......... .......... .......... .......... .......... 99% 6.35M 0s 2024-05-08T06:49:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:14 smithi070 ceph-mon[29591]: pgmap v83: 129 pgs: 129 active+clean; 97 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.4 MiB/s wr, 21 op/s 2024-05-08T06:49:14.384 INFO:tasks.workunit.client.0.smithi070.stderr:135500K .......... .......... .......... .......... .......... 99% 5.70M 0s 2024-05-08T06:49:14.391 INFO:tasks.workunit.client.0.smithi070.stderr:135550K .......... .......... .......... .......... .......... 99% 6.87M 0s 2024-05-08T06:49:14.399 INFO:tasks.workunit.client.0.smithi070.stderr:135600K .......... .......... .......... .......... .......... 99% 6.93M 0s 2024-05-08T06:49:14.405 INFO:tasks.workunit.client.0.smithi070.stderr:135650K .......... .......... .......... .......... .......... 99% 6.72M 0s 2024-05-08T06:49:14.415 INFO:tasks.workunit.client.0.smithi070.stderr:135700K .......... .......... .......... .......... .......... 99% 5.30M 0s 2024-05-08T06:49:14.415 INFO:tasks.workunit.client.0.smithi070.stderr:135750K .. 100% 5.30T=25s 2024-05-08T06:49:14.416 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:49:14.417 INFO:tasks.workunit.client.0.smithi070.stderr:2024-05-08 06:49:14 (5.33 MB/s) - ‘linux.tar.xz’ saved [139010916/139010916] 2024-05-08T06:49:14.418 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-05-08T06:49:14.421 INFO:tasks.workunit.client.0.smithi070.stderr:+ mkdir t 2024-05-08T06:49:14.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:14 smithi172 ceph-mon[33377]: pgmap v83: 129 pgs: 129 active+clean; 97 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.4 MiB/s wr, 21 op/s 2024-05-08T06:49:14.436 INFO:tasks.workunit.client.0.smithi070.stderr:+ cd t 2024-05-08T06:49:14.443 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xJf ../linux.tar.xz 2024-05-08T06:49:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:14 smithi194 ceph-mon[33679]: pgmap v83: 129 pgs: 129 active+clean; 97 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.4 MiB/s wr, 21 op/s 2024-05-08T06:49:16.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:16 smithi070 ceph-mon[29591]: pgmap v84: 129 pgs: 129 active+clean; 125 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 24 op/s 2024-05-08T06:49:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:16 smithi172 ceph-mon[33377]: pgmap v84: 129 pgs: 129 active+clean; 125 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 24 op/s 2024-05-08T06:49:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:16 smithi194 ceph-mon[33679]: pgmap v84: 129 pgs: 129 active+clean; 125 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.7 MiB/s wr, 24 op/s 2024-05-08T06:49:18.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:18 smithi070 ceph-mon[29591]: pgmap v85: 129 pgs: 129 active+clean; 125 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 6 op/s 2024-05-08T06:49:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:18 smithi172 ceph-mon[33377]: pgmap v85: 129 pgs: 129 active+clean; 125 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 6 op/s 2024-05-08T06:49:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:18 smithi194 ceph-mon[33679]: pgmap v85: 129 pgs: 129 active+clean; 125 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 MiB/s wr, 6 op/s 2024-05-08T06:49:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:20 smithi070 ceph-mon[29591]: pgmap v86: 129 pgs: 129 active+clean; 136 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.5 MiB/s wr, 41 op/s 2024-05-08T06:49:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:20 smithi172 ceph-mon[33377]: pgmap v86: 129 pgs: 129 active+clean; 136 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.5 MiB/s wr, 41 op/s 2024-05-08T06:49:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:20 smithi194 ceph-mon[33679]: pgmap v86: 129 pgs: 129 active+clean; 136 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.5 MiB/s wr, 41 op/s 2024-05-08T06:49:22.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:22 smithi070 ceph-mon[29591]: pgmap v87: 129 pgs: 129 active+clean; 136 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.2 MiB/s wr, 38 op/s 2024-05-08T06:49:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:22 smithi172 ceph-mon[33377]: pgmap v87: 129 pgs: 129 active+clean; 136 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.2 MiB/s wr, 38 op/s 2024-05-08T06:49:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:22 smithi194 ceph-mon[33679]: pgmap v87: 129 pgs: 129 active+clean; 136 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.2 MiB/s wr, 38 op/s 2024-05-08T06:49:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:24 smithi070 ceph-mon[29591]: pgmap v88: 129 pgs: 129 active+clean; 136 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.2 MiB/s wr, 38 op/s 2024-05-08T06:49:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:24 smithi172 ceph-mon[33377]: pgmap v88: 129 pgs: 129 active+clean; 136 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.2 MiB/s wr, 38 op/s 2024-05-08T06:49:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:24 smithi194 ceph-mon[33679]: pgmap v88: 129 pgs: 129 active+clean; 136 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.2 MiB/s wr, 38 op/s 2024-05-08T06:49:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:26 smithi172 ceph-mon[33377]: pgmap v89: 129 pgs: 129 active+clean; 139 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 3.5 MiB/s wr, 76 op/s 2024-05-08T06:49:26.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:26 smithi194 ceph-mon[33679]: pgmap v89: 129 pgs: 129 active+clean; 139 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 3.5 MiB/s wr, 76 op/s 2024-05-08T06:49:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:26 smithi070 ceph-mon[29591]: pgmap v89: 129 pgs: 129 active+clean; 139 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 3.5 MiB/s wr, 76 op/s 2024-05-08T06:49:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:28 smithi172 ceph-mon[33377]: pgmap v90: 129 pgs: 129 active+clean; 139 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T06:49:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:28 smithi194 ceph-mon[33679]: pgmap v90: 129 pgs: 129 active+clean; 139 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T06:49:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:28 smithi070 ceph-mon[29591]: pgmap v90: 129 pgs: 129 active+clean; 139 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T06:49:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:29 smithi194 ceph-mon[33679]: pgmap v91: 129 pgs: 129 active+clean; 145 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 1.7 MiB/s wr, 109 op/s 2024-05-08T06:49:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:29 smithi070 ceph-mon[29591]: pgmap v91: 129 pgs: 129 active+clean; 145 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 1.7 MiB/s wr, 109 op/s 2024-05-08T06:49:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:29 smithi172 ceph-mon[33377]: pgmap v91: 129 pgs: 129 active+clean; 145 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 1.7 MiB/s wr, 109 op/s 2024-05-08T06:49:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:31 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:49:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:31 smithi194 ceph-mon[33679]: pgmap v92: 129 pgs: 129 active+clean; 145 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 825 KiB/s wr, 74 op/s 2024-05-08T06:49:32.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:31 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:49:32.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:31 smithi070 ceph-mon[29591]: pgmap v92: 129 pgs: 129 active+clean; 145 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 825 KiB/s wr, 74 op/s 2024-05-08T06:49:32.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:31 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T06:49:32.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:31 smithi172 ceph-mon[33377]: pgmap v92: 129 pgs: 129 active+clean; 145 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 825 KiB/s wr, 74 op/s 2024-05-08T06:49:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:33 smithi070 ceph-mon[29591]: pgmap v93: 129 pgs: 129 active+clean; 145 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 825 KiB/s wr, 74 op/s 2024-05-08T06:49:34.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:33 smithi172 ceph-mon[33377]: pgmap v93: 129 pgs: 129 active+clean; 145 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 825 KiB/s wr, 74 op/s 2024-05-08T06:49:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:33 smithi194 ceph-mon[33679]: pgmap v93: 129 pgs: 129 active+clean; 145 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 825 KiB/s wr, 74 op/s 2024-05-08T06:49:36.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:35 smithi070 ceph-mon[29591]: pgmap v94: 129 pgs: 129 active+clean; 148 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.1 MiB/s wr, 113 op/s 2024-05-08T06:49:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:35 smithi172 ceph-mon[33377]: pgmap v94: 129 pgs: 129 active+clean; 148 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.1 MiB/s wr, 113 op/s 2024-05-08T06:49:36.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:35 smithi194 ceph-mon[33679]: pgmap v94: 129 pgs: 129 active+clean; 148 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.1 MiB/s wr, 113 op/s 2024-05-08T06:49:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:37 smithi194 ceph-mon[33679]: pgmap v95: 129 pgs: 129 active+clean; 148 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 824 KiB/s wr, 75 op/s 2024-05-08T06:49:38.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:37 smithi070 ceph-mon[29591]: pgmap v95: 129 pgs: 129 active+clean; 148 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 824 KiB/s wr, 75 op/s 2024-05-08T06:49:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:37 smithi172 ceph-mon[33377]: pgmap v95: 129 pgs: 129 active+clean; 148 MiB data, 741 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 824 KiB/s wr, 75 op/s 2024-05-08T06:49:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:39 smithi194 ceph-mon[33679]: pgmap v96: 129 pgs: 129 active+clean; 151 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.0 MiB/s wr, 113 op/s 2024-05-08T06:49:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:39 smithi070 ceph-mon[29591]: pgmap v96: 129 pgs: 129 active+clean; 151 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.0 MiB/s wr, 113 op/s 2024-05-08T06:49:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:39 smithi172 ceph-mon[33377]: pgmap v96: 129 pgs: 129 active+clean; 151 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.0 MiB/s wr, 113 op/s 2024-05-08T06:49:42.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:41 smithi194 ceph-mon[33679]: pgmap v97: 129 pgs: 129 active+clean; 151 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 545 KiB/s wr, 77 op/s 2024-05-08T06:49:42.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:41 smithi070 ceph-mon[29591]: pgmap v97: 129 pgs: 129 active+clean; 151 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 545 KiB/s wr, 77 op/s 2024-05-08T06:49:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:41 smithi172 ceph-mon[33377]: pgmap v97: 129 pgs: 129 active+clean; 151 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 545 KiB/s wr, 77 op/s 2024-05-08T06:49:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:44 smithi194 ceph-mon[33679]: pgmap v98: 129 pgs: 129 active+clean; 151 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 545 KiB/s wr, 77 op/s 2024-05-08T06:49:44.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:44 smithi070 ceph-mon[29591]: pgmap v98: 129 pgs: 129 active+clean; 151 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 545 KiB/s wr, 77 op/s 2024-05-08T06:49:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:44 smithi172 ceph-mon[33377]: pgmap v98: 129 pgs: 129 active+clean; 151 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 545 KiB/s wr, 77 op/s 2024-05-08T06:49:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:46 smithi070 ceph-mon[29591]: pgmap v99: 129 pgs: 129 active+clean; 153 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 782 KiB/s wr, 105 op/s 2024-05-08T06:49:46.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:49:46.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:46 smithi172 ceph-mon[33377]: pgmap v99: 129 pgs: 129 active+clean; 153 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 782 KiB/s wr, 105 op/s 2024-05-08T06:49:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:49:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:46 smithi194 ceph-mon[33679]: pgmap v99: 129 pgs: 129 active+clean; 153 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 782 KiB/s wr, 105 op/s 2024-05-08T06:49:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:49:47.383 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:49:47.383 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:49:47.383 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:49:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:49:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:49:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:49:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:49:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:49:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:49:48.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:48 smithi070 ceph-mon[29591]: pgmap v100: 129 pgs: 129 active+clean; 153 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 461 KiB/s wr, 65 op/s 2024-05-08T06:49:48.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:48 smithi172 ceph-mon[33377]: pgmap v100: 129 pgs: 129 active+clean; 153 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 461 KiB/s wr, 65 op/s 2024-05-08T06:49:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:48 smithi194 ceph-mon[33679]: pgmap v100: 129 pgs: 129 active+clean; 153 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 461 KiB/s wr, 65 op/s 2024-05-08T06:49:50.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:50 smithi070 ceph-mon[29591]: pgmap v101: 129 pgs: 129 active+clean; 156 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 708 KiB/s wr, 109 op/s 2024-05-08T06:49:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:50 smithi172 ceph-mon[33377]: pgmap v101: 129 pgs: 129 active+clean; 156 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 708 KiB/s wr, 109 op/s 2024-05-08T06:49:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:50 smithi194 ceph-mon[33679]: pgmap v101: 129 pgs: 129 active+clean; 156 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 708 KiB/s wr, 109 op/s 2024-05-08T06:49:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:52 smithi070 ceph-mon[29591]: pgmap v102: 129 pgs: 129 active+clean; 156 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 483 KiB/s wr, 71 op/s 2024-05-08T06:49:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:52 smithi172 ceph-mon[33377]: pgmap v102: 129 pgs: 129 active+clean; 156 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 483 KiB/s wr, 71 op/s 2024-05-08T06:49:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:52 smithi194 ceph-mon[33679]: pgmap v102: 129 pgs: 129 active+clean; 156 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 483 KiB/s wr, 71 op/s 2024-05-08T06:49:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:54 smithi070 ceph-mon[29591]: pgmap v103: 129 pgs: 129 active+clean; 156 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 484 KiB/s wr, 71 op/s 2024-05-08T06:49:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:54 smithi172 ceph-mon[33377]: pgmap v103: 129 pgs: 129 active+clean; 156 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 484 KiB/s wr, 71 op/s 2024-05-08T06:49:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:54 smithi194 ceph-mon[33679]: pgmap v103: 129 pgs: 129 active+clean; 156 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 484 KiB/s wr, 71 op/s 2024-05-08T06:49:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:56 smithi070 ceph-mon[29591]: pgmap v104: 129 pgs: 129 active+clean; 158 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 667 KiB/s wr, 107 op/s 2024-05-08T06:49:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:56 smithi172 ceph-mon[33377]: pgmap v104: 129 pgs: 129 active+clean; 158 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 667 KiB/s wr, 107 op/s 2024-05-08T06:49:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:56 smithi194 ceph-mon[33679]: pgmap v104: 129 pgs: 129 active+clean; 158 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 667 KiB/s wr, 107 op/s 2024-05-08T06:49:58.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:49:58 smithi070 ceph-mon[29591]: pgmap v105: 129 pgs: 129 active+clean; 158 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 430 KiB/s wr, 79 op/s 2024-05-08T06:49:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:49:58 smithi172 ceph-mon[33377]: pgmap v105: 129 pgs: 129 active+clean; 158 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 430 KiB/s wr, 79 op/s 2024-05-08T06:49:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:49:58 smithi194 ceph-mon[33679]: pgmap v105: 129 pgs: 129 active+clean; 158 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 430 KiB/s wr, 79 op/s 2024-05-08T06:50:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:00 smithi070 ceph-mon[29591]: pgmap v106: 129 pgs: 129 active+clean; 160 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 692 KiB/s wr, 117 op/s 2024-05-08T06:50:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T06:50:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:00 smithi172 ceph-mon[33377]: pgmap v106: 129 pgs: 129 active+clean; 160 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 692 KiB/s wr, 117 op/s 2024-05-08T06:50:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T06:50:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:00 smithi194 ceph-mon[33679]: pgmap v106: 129 pgs: 129 active+clean; 160 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 692 KiB/s wr, 117 op/s 2024-05-08T06:50:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T06:50:02.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:02 smithi070 ceph-mon[29591]: pgmap v107: 129 pgs: 129 active+clean; 160 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 446 KiB/s wr, 73 op/s 2024-05-08T06:50:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:02 smithi172 ceph-mon[33377]: pgmap v107: 129 pgs: 129 active+clean; 160 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 446 KiB/s wr, 73 op/s 2024-05-08T06:50:02.443 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T06:50:02.443 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-05-08T06:50:02.444 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:50:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:02 smithi194 ceph-mon[33679]: pgmap v107: 129 pgs: 129 active+clean; 160 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 446 KiB/s wr, 73 op/s 2024-05-08T06:50:02.941 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:50:04.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:04 smithi070 ceph-mon[29591]: pgmap v108: 129 pgs: 129 active+clean; 160 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 446 KiB/s wr, 73 op/s 2024-05-08T06:50:04.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:04 smithi172 ceph-mon[33377]: pgmap v108: 129 pgs: 129 active+clean; 160 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 446 KiB/s wr, 73 op/s 2024-05-08T06:50:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:04 smithi194 ceph-mon[33679]: pgmap v108: 129 pgs: 129 active+clean; 160 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 446 KiB/s wr, 73 op/s 2024-05-08T06:50:05.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.715+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1803031798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94102530 msgr2=0x7fdc94112220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:05.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.715+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1803031798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94102530 0x7fdc94112220 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00b0a0 tx=0x7fdc8c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:50:05.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.716+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1803031798 shutdown_connections 2024-05-08T06:50:05.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.716+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1803031798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94102530 0x7fdc94112220 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:05.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.716+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1803031798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc941043b0 0x7fdc94104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:05.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.716+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1803031798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc94101a90 0x7fdc94101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:05.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.716+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1803031798 >> 172.21.15.70:0/1803031798 conn(0x7fdc94078a10 msgr2=0x7fdc940ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:05.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.716+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1803031798 shutdown_connections 2024-05-08T06:50:05.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.716+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1803031798 wait complete. 2024-05-08T06:50:05.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.717+0000 7fdc9ac00700 1 Processor -- start 2024-05-08T06:50:05.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.717+0000 7fdc9ac00700 1 -- start start 2024-05-08T06:50:05.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.717+0000 7fdc9ac00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94101a90 0x7fdc941a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.717+0000 7fdc9ac00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc94102530 0x7fdc941a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.717+0000 7fdc9ac00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc941043b0 0x7fdc9419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.717+0000 7fdc9ac00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc94115750 con 0x7fdc94101a90 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.717+0000 7fdc9ac00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdc941155d0 con 0x7fdc941043b0 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.717+0000 7fdc9ac00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdc941158d0 con 0x7fdc94102530 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94101a90 0x7fdc941a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94101a90 0x7fdc941a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45504/0 (socket says 172.21.15.70:45504) 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93e00700 1 -- 172.21.15.70:0/1978308898 learned_addr learned my addr 172.21.15.70:0/1978308898 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93400700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc94102530 0x7fdc941a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc98c00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc941043b0 0x7fdc9419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:05.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93e00700 1 -- 172.21.15.70:0/1978308898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc94102530 msgr2=0x7fdc941a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93e00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc94102530 0x7fdc941a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93e00700 1 -- 172.21.15.70:0/1978308898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc941043b0 msgr2=0x7fdc9419bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93e00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc941043b0 0x7fdc9419bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93e00700 1 -- 172.21.15.70:0/1978308898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9419c210 con 0x7fdc94101a90 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc98c00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc941043b0 0x7fdc9419bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.718+0000 7fdc93400700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc94102530 0x7fdc941a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.719+0000 7fdc93e00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94101a90 0x7fdc941a18f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400d950 tx=0x7fdc8400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.719+0000 7fdc90c00700 1 -- 172.21.15.70:0/1978308898 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84016070 con 0x7fdc94101a90 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.719+0000 7fdc90c00700 1 -- 172.21.15.70:0/1978308898 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc84010460 con 0x7fdc94101a90 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.719+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9419c4a0 con 0x7fdc94101a90 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.719+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc941a87c0 con 0x7fdc94101a90 2024-05-08T06:50:05.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.719+0000 7fdc90c00700 1 -- 172.21.15.70:0/1978308898 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400f620 con 0x7fdc94101a90 2024-05-08T06:50:05.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.721+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc74005330 con 0x7fdc94101a90 2024-05-08T06:50:05.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.724+0000 7fdc90c00700 1 -- 172.21.15.70:0/1978308898 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fdc84019070 con 0x7fdc94101a90 2024-05-08T06:50:05.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.726+0000 7fdc90c00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc780b2a70 0x7fdc780b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:05.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.726+0000 7fdc90c00700 1 -- 172.21.15.70:0/1978308898 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fdc840e27d0 con 0x7fdc94101a90 2024-05-08T06:50:05.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.726+0000 7fdc93400700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc780b2a70 0x7fdc780b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:05.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.727+0000 7fdc93400700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc780b2a70 0x7fdc780b4f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc80005950 tx=0x7fdc800058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:05.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:05.735+0000 7fdc90c00700 1 -- 172.21.15.70:0/1978308898 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdc840a9d80 con 0x7fdc94101a90 2024-05-08T06:50:06.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.084+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc740058f0 con 0x7fdc94101a90 2024-05-08T06:50:06.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.088+0000 7fdc90c00700 1 -- 172.21.15.70:0/1978308898 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fdc840a9680 con 0x7fdc94101a90 2024-05-08T06:50:06.088 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:50:06.088 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:50:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc780b2a70 msgr2=0x7fdc780b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc780b2a70 0x7fdc780b4f30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdc80005950 tx=0x7fdc800058e0 comp rx=0 tx=0).stop 2024-05-08T06:50:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94101a90 msgr2=0x7fdc941a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94101a90 0x7fdc941a18f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400d950 tx=0x7fdc8400dd10 comp rx=0 tx=0).stop 2024-05-08T06:50:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 shutdown_connections 2024-05-08T06:50:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc780b2a70 0x7fdc780b4f30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc941043b0 0x7fdc9419bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc94101a90 0x7fdc941a18f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 --2- 172.21.15.70:0/1978308898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc94102530 0x7fdc941a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 >> 172.21.15.70:0/1978308898 conn(0x7fdc94078a10 msgr2=0x7fdc940ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 shutdown_connections 2024-05-08T06:50:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:06.092+0000 7fdc9ac00700 1 -- 172.21.15.70:0/1978308898 wait complete. 2024-05-08T06:50:06.093 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:50:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:06 smithi070 ceph-mon[29591]: pgmap v109: 129 pgs: 129 active+clean; 164 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 781 KiB/s wr, 126 op/s 2024-05-08T06:50:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:06 smithi172 ceph-mon[33377]: pgmap v109: 129 pgs: 129 active+clean; 164 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 781 KiB/s wr, 126 op/s 2024-05-08T06:50:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:06 smithi194 ceph-mon[33679]: pgmap v109: 129 pgs: 129 active+clean; 164 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 781 KiB/s wr, 126 op/s 2024-05-08T06:50:07.091 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 81.05 --await-for 42.0' 2024-05-08T06:50:07.091 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 81.05 --await-for 42.0 2024-05-08T06:50:07.158 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:07 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1978308898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:50:07.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:07 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1978308898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:50:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:07 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1978308898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:50:07.551 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:50:08.311 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:08 smithi070 ceph-mon[29591]: pgmap v110: 129 pgs: 129 active+clean; 164 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 598 KiB/s wr, 90 op/s 2024-05-08T06:50:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:08 smithi172 ceph-mon[33377]: pgmap v110: 129 pgs: 129 active+clean; 164 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 598 KiB/s wr, 90 op/s 2024-05-08T06:50:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:08 smithi194 ceph-mon[33679]: pgmap v110: 129 pgs: 129 active+clean; 164 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 598 KiB/s wr, 90 op/s 2024-05-08T06:50:10.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.257+0000 7f3b23e00700 1 -- 172.21.15.70:0/3268387916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240760e0 msgr2=0x7f3b2410f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:10.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.257+0000 7f3b23e00700 1 --2- 172.21.15.70:0/3268387916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240760e0 0x7f3b2410f660 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3b10009990 tx=0x7f3b10009ca0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.257+0000 7f3b23e00700 1 -- 172.21.15.70:0/3268387916 shutdown_connections 2024-05-08T06:50:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.257+0000 7f3b23e00700 1 --2- 172.21.15.70:0/3268387916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2410fba0 0x7f3b24111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.257+0000 7f3b23e00700 1 --2- 172.21.15.70:0/3268387916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b240757c0 0x7f3b24075ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.257+0000 7f3b23e00700 1 --2- 172.21.15.70:0/3268387916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240760e0 0x7f3b2410f660 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.257+0000 7f3b23e00700 1 -- 172.21.15.70:0/3268387916 >> 172.21.15.70:0/3268387916 conn(0x7f3b240fee50 msgr2=0x7f3b24101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.257+0000 7f3b23e00700 1 -- 172.21.15.70:0/3268387916 shutdown_connections 2024-05-08T06:50:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.257+0000 7f3b23e00700 1 -- 172.21.15.70:0/3268387916 wait complete. 2024-05-08T06:50:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.258+0000 7f3b23e00700 1 Processor -- start 2024-05-08T06:50:10.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.258+0000 7f3b23e00700 1 -- start start 2024-05-08T06:50:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.258+0000 7f3b23e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240757c0 0x7f3b241a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.258+0000 7f3b23e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b240760e0 0x7f3b241a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.258+0000 7f3b23e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2410fba0 0x7f3b2419b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.258+0000 7f3b23e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b241155b0 con 0x7f3b240757c0 2024-05-08T06:50:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b23e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b24115430 con 0x7f3b240760e0 2024-05-08T06:50:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b23e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3b24115730 con 0x7f3b2410fba0 2024-05-08T06:50:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240757c0 0x7f3b241a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240757c0 0x7f3b241a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60434/0 (socket says 172.21.15.70:60434) 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22a00700 1 -- 172.21.15.70:0/2277872905 learned_addr learned my addr 172.21.15.70:0/2277872905 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b23400700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2410fba0 0x7f3b2419b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22000700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b240760e0 0x7f3b241a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22a00700 1 -- 172.21.15.70:0/2277872905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2410fba0 msgr2=0x7f3b2419b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22a00700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2410fba0 0x7f3b2419b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22a00700 1 -- 172.21.15.70:0/2277872905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b240760e0 msgr2=0x7f3b241a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22a00700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b240760e0 0x7f3b241a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22a00700 1 -- 172.21.15.70:0/2277872905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2419c0b0 con 0x7f3b240757c0 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.259+0000 7f3b22000700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b240760e0 0x7f3b241a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.260+0000 7f3b22a00700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240757c0 0x7f3b241a1740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400c970 tx=0x7f3b1400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.260+0000 7f3b1b400700 1 -- 172.21.15.70:0/2277872905 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14007aa0 con 0x7f3b240757c0 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.260+0000 7f3b1b400700 1 -- 172.21.15.70:0/2277872905 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b14004cc0 con 0x7f3b240757c0 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.260+0000 7f3b23e00700 1 -- 172.21.15.70:0/2277872905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2419c3a0 con 0x7f3b240757c0 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.260+0000 7f3b1b400700 1 -- 172.21.15.70:0/2277872905 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14005500 con 0x7f3b240757c0 2024-05-08T06:50:10.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.260+0000 7f3b23e00700 1 -- 172.21.15.70:0/2277872905 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b241a8610 con 0x7f3b240757c0 2024-05-08T06:50:10.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.264+0000 7f3b1b400700 1 -- 172.21.15.70:0/2277872905 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3b14007c40 con 0x7f3b240757c0 2024-05-08T06:50:10.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b34563b80 1 Processor -- start 2024-05-08T06:50:10.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b34563b80 1 -- start start 2024-05-08T06:50:10.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b1b400700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b080b2b20 0x7f3b080b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b1b400700 1 -- 172.21.15.70:0/2277872905 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f3b140e2820 con 0x7f3b240757c0 2024-05-08T06:50:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a3910 0x562e0419d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e0419dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b34563b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e040efbb0 con 0x562e041a2ff0 2024-05-08T06:50:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b23400700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b080b2b20 0x7f3b080b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b34563b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e0408d8f0 con 0x562e0419db40 2024-05-08T06:50:10.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.265+0000 7f3b34563b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562e040ebb70 con 0x562e041a3910 2024-05-08T06:50:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b22a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b22a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041a33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60446/0 (socket says 172.21.15.70:60446) 2024-05-08T06:50:10.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b22a00700 1 -- 172.21.15.70:0/4149539836 learned_addr learned my addr 172.21.15.70:0/4149539836 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b22000700 1 --2- 172.21.15.70:0/4149539836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a3910 0x562e0419d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b23400700 1 --2- 172.21.15.70:0/4149539836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e0419dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b22a00700 1 -- 172.21.15.70:0/4149539836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a3910 msgr2=0x562e0419d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b22a00700 1 --2- 172.21.15.70:0/4149539836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a3910 0x562e0419d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b22a00700 1 -- 172.21.15.70:0/4149539836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 msgr2=0x562e0419dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b22a00700 1 --2- 172.21.15.70:0/4149539836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e0419dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.266+0000 7f3b22a00700 1 -- 172.21.15.70:0/4149539836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e0403ca60 con 0x562e041a2ff0 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.267+0000 7f3b23400700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b080b2b20 0x7f3b080b4fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c006130 tx=0x7f3b1c0088c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.267+0000 7f3b22a00700 1 --2- 172.21.15.70:0/4149539836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041a33d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3b140a57e0 tx=0x7f3b140a8f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d426c61d2abd6c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.267+0000 7f3b0fe00700 1 -- 172.21.15.70:0/4149539836 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14015540 con 0x562e041a2ff0 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.267+0000 7f3b0fe00700 1 -- 172.21.15.70:0/4149539836 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b140a9760 con 0x562e041a2ff0 2024-05-08T06:50:10.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.267+0000 7f3b0fe00700 1 -- 172.21.15.70:0/4149539836 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b140a99c0 con 0x562e041a2ff0 2024-05-08T06:50:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.268+0000 7f3b34563b80 1 -- 172.21.15.70:0/4149539836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 msgr2=0x562e041a33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.268+0000 7f3b34563b80 1 --2- 172.21.15.70:0/4149539836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041a33d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3b140a57e0 tx=0x7f3b140a8f50 comp rx=0 tx=0).stop 2024-05-08T06:50:10.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.268+0000 7f3b34563b80 1 -- 172.21.15.70:0/4149539836 shutdown_connections 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.268+0000 7f3b34563b80 1 --2- 172.21.15.70:0/4149539836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e0419dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.268+0000 7f3b34563b80 1 --2- 172.21.15.70:0/4149539836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041a33d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.268+0000 7f3b34563b80 1 --2- 172.21.15.70:0/4149539836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a3910 0x562e0419d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.268+0000 7f3b34563b80 1 -- 172.21.15.70:0/4149539836 >> 172.21.15.70:0/4149539836 conn(0x562e040cbcf0 msgr2=0x562e04198080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.268+0000 7f3b34563b80 1 -- 172.21.15.70:0/4149539836 shutdown_connections 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.268+0000 7f3b34563b80 1 -- 172.21.15.70:0/4149539836 wait complete. 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.269+0000 7f3b34563b80 1 -- start start 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.269+0000 7f3b34563b80 1 Processor -- start 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.269+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e041a95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.269+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 0x562e041a6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.269+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041a6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.269+0000 7f3b34563b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e041aa430 con 0x562e041a3910 2024-05-08T06:50:10.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.269+0000 7f3b34563b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e04055cb0 con 0x562e0419db40 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.269+0000 7f3b34563b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562e041aa5b0 con 0x562e041a2ff0 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b34563b80 10 client.0 _ll_register_callbacks cb 0x562e04096e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b23400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041a6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b23400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041a6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60456/0 (socket says 172.21.15.70:60456) 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b23400700 1 -- 172.21.15.70:0/3596265182 learned_addr learned my addr 172.21.15.70:0/3596265182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b22a00700 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e041a95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b22000700 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 0x562e041a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b23400700 1 -- 172.21.15.70:0/3596265182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 msgr2=0x562e041a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b23400700 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 0x562e041a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b23400700 1 -- 172.21.15.70:0/3596265182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 msgr2=0x562e041a95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b23400700 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e041a95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.270+0000 7f3b23400700 1 -- 172.21.15.70:0/3596265182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e040b55b0 con 0x562e041a3910 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.271+0000 7f3b23400700 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041a6e90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c019c00 tx=0x7f3b1c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60be00eeb167fbeb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.271+0000 7f3b0cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.271+0000 7f3b0cc00700 1 -- 172.21.15.70:0/3596265182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c004bb0 con 0x562e041a3910 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.271+0000 7f3b0cc00700 1 -- 172.21.15.70:0/3596265182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f3b1c013070 con 0x562e041a3910 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.271+0000 7f3b34563b80 1 -- 172.21.15.70:0/3596265182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b140a9760 con 0x562e041a3910 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.271+0000 7f3b0cc00700 1 -- 172.21.15.70:0/3596265182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b1c02d050 con 0x562e041a3910 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.271+0000 7f3b34563b80 10 client.15525 fetch_fsmap learned FSMap version 28 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.271+0000 7f3b34563b80 1 -- 172.21.15.70:0/3596265182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e041b4c30 con 0x562e041a3910 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.271+0000 7f3b0cc00700 1 -- 172.21.15.70:0/3596265182 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b140a9760 con 0x562e041a3910 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.272+0000 7f3b0cc00700 1 -- 172.21.15.70:0/3596265182 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3b1c004190 con 0x562e041a3910 2024-05-08T06:50:10.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.272+0000 7f3b34563b80 10 client.15525 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:50:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.272+0000 7f3b34563b80 10 client.15525 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:50:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.272+0000 7f3b34563b80 20 client.15525 populate_metadata read hostname 'smithi070' 2024-05-08T06:50:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.272+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e041b72c0 0x562e041b96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.272+0000 7f3b34563b80 4 client.15525 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:50:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.272+0000 7f3b34563b80 1 -- 172.21.15.70:0/3596265182 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e0416a230 con 0x562e041b72c0 2024-05-08T06:50:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.273+0000 7f3b22a00700 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e041b72c0 0x562e041b96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.274+0000 7f3b22a00700 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e041b72c0 0x562e041b96b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=556d190b855b7e0c server_cookie=91b6eb53394e21a6 in_seq=0 out_seq=0 2024-05-08T06:50:10.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.274+0000 7f3b0cc00700 10 client.15525 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:10.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.277+0000 7f3b0cc00700 1 -- 172.21.15.70:0/3596265182 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562e0416a230 con 0x562e041b72c0 2024-05-08T06:50:10.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.277+0000 7f3b0cc00700 10 client.15525 handle_command_reply: tid=0 2024-05-08T06:50:10.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.277+0000 7f3b34563b80 1 client.15525 shutdown 2024-05-08T06:50:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.277+0000 7f3b34563b80 1 -- 172.21.15.70:0/3596265182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 msgr2=0x562e041a6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.277+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041a6e90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c019c00 tx=0x7f3b1c004b40 comp rx=0 tx=0).stop 2024-05-08T06:50:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b34563b80 1 -- 172.21.15.70:0/3596265182 shutdown_connections 2024-05-08T06:50:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e041b72c0 0x562e041b96b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041a6e90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e041a95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3596265182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 0x562e041a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b34563b80 1 -- 172.21.15.70:0/3596265182 >> 172.21.15.70:0/3596265182 conn(0x562e040cbcf0 msgr2=0x562e0419c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:10.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b0cc00700 0 client.15525 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:10.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b34563b80 1 -- 172.21.15.70:0/3596265182 shutdown_connections 2024-05-08T06:50:10.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b34563b80 1 -- 172.21.15.70:0/3596265182 wait complete. 2024-05-08T06:50:10.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.278+0000 7f3b34563b80 20 client.15525 trim_cache size 0 max 16384 2024-05-08T06:50:10.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b34563b80 1 Processor -- start 2024-05-08T06:50:10.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b34563b80 1 -- start start 2024-05-08T06:50:10.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e041b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 0x562e041a6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041befc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b34563b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b241b3e20 con 0x562e041a3910 2024-05-08T06:50:10.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b34563b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b241b16b0 con 0x562e0419db40 2024-05-08T06:50:10.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b34563b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3b241af500 con 0x562e041a2ff0 2024-05-08T06:50:10.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b23400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b23400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041befc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60458/0 (socket says 172.21.15.70:60458) 2024-05-08T06:50:10.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.300+0000 7f3b23400700 1 -- 172.21.15.70:0/3219179418 learned_addr learned my addr 172.21.15.70:0/3219179418 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:10.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.301+0000 7f3b22a00700 1 --2- 172.21.15.70:0/3219179418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e041b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.301+0000 7f3b22000700 1 --2- 172.21.15.70:0/3219179418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 0x562e041a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.301+0000 7f3b23400700 1 -- 172.21.15.70:0/3219179418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 msgr2=0x562e041a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:10.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.301+0000 7f3b23400700 1 --2- 172.21.15.70:0/3219179418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 0x562e041a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.301+0000 7f3b23400700 1 -- 172.21.15.70:0/3219179418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 msgr2=0x562e041b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:10.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.301+0000 7f3b23400700 1 --2- 172.21.15.70:0/3219179418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e041b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.301+0000 7f3b23400700 1 -- 172.21.15.70:0/3219179418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e041949b0 con 0x562e041a3910 2024-05-08T06:50:10.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.301+0000 7f3b23400700 1 --2- 172.21.15.70:0/3219179418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041befc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c004630 tx=0x7f3b1c017720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5812b4bd07e65692 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:10.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.302+0000 7f3b0f400700 1 -- 172.21.15.70:0/3219179418 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c035070 con 0x562e041a3910 2024-05-08T06:50:10.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.302+0000 7f3b0f400700 1 -- 172.21.15.70:0/3219179418 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b1c0078e0 con 0x562e041a3910 2024-05-08T06:50:10.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.302+0000 7f3b0f400700 1 -- 172.21.15.70:0/3219179418 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c003fd0 con 0x562e041a3910 2024-05-08T06:50:10.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.302+0000 7f3b34563b80 1 -- 172.21.15.70:0/3219179418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 msgr2=0x562e041befc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.302+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3219179418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041befc0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c004630 tx=0x7f3b1c017720 comp rx=0 tx=0).stop 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.303+0000 7f3b34563b80 1 -- 172.21.15.70:0/3219179418 shutdown_connections 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.303+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3219179418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a3910 0x562e041befc0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.303+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3219179418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0419db40 0x562e041b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.303+0000 7f3b34563b80 1 --2- 172.21.15.70:0/3219179418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e041a2ff0 0x562e041a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.303+0000 7f3b34563b80 1 -- 172.21.15.70:0/3219179418 >> 172.21.15.70:0/3219179418 conn(0x562e040cbcf0 msgr2=0x562e0419ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.303+0000 7f3b34563b80 1 -- 172.21.15.70:0/3219179418 shutdown_connections 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.303+0000 7f3b34563b80 1 -- 172.21.15.70:0/3219179418 wait complete. 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.303+0000 7f3b34563b80 1 -- start start 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.303+0000 7f3b34563b80 1 Processor -- start 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0419db40 0x562e041af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b34563b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e041a3910 0x562e041ac810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b34563b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b241afb70 con 0x562e041a2ff0 2024-05-08T06:50:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b34563b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b241b0fe0 con 0x562e041a3910 2024-05-08T06:50:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b34563b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3b241b0240 con 0x562e0419db40 2024-05-08T06:50:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b34563b80 10 client.0 _ll_register_callbacks cb 0x562e04096e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:50:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b22000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b22000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60464/0 (socket says 172.21.15.70:60464) 2024-05-08T06:50:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b22000700 1 -- 172.21.15.70:0/685236822 learned_addr learned my addr 172.21.15.70:0/685236822 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.304+0000 7f3b22a00700 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0419db40 0x562e041af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b23400700 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e041a3910 0x562e041ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b22000700 1 -- 172.21.15.70:0/685236822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0419db40 msgr2=0x562e041af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b22000700 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0419db40 0x562e041af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b22000700 1 -- 172.21.15.70:0/685236822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e041a3910 msgr2=0x562e041ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b22000700 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e041a3910 0x562e041ac810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b22000700 1 -- 172.21.15.70:0/685236822 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e041acda0 con 0x562e041a2ff0 2024-05-08T06:50:10.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b22a00700 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0419db40 0x562e041af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:50:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b23400700 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e041a3910 0x562e041ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:50:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b22000700 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041afd80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3b10003760 tx=0x7f3b100095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83d701752218988 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b0cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:50:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b0cc00700 1 -- 172.21.15.70:0/685236822 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b100039d0 con 0x562e041a2ff0 2024-05-08T06:50:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.305+0000 7f3b0cc00700 1 -- 172.21.15.70:0/685236822 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f3b10003b70 con 0x562e041a2ff0 2024-05-08T06:50:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.306+0000 7f3b34563b80 1 -- 172.21.15.70:0/685236822 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b1c0078e0 con 0x562e041a2ff0 2024-05-08T06:50:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.306+0000 7f3b0cc00700 1 -- 172.21.15.70:0/685236822 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3b10032050 con 0x562e041a2ff0 2024-05-08T06:50:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.306+0000 7f3b34563b80 10 client.15531 fetch_fsmap learned FSMap version 28 2024-05-08T06:50:10.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.306+0000 7f3b34563b80 1 -- 172.21.15.70:0/685236822 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e04222410 con 0x562e041a2ff0 2024-05-08T06:50:10.307 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:10 smithi070 ceph-mon[29591]: pgmap v111: 129 pgs: 129 active+clean; 167 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 932 KiB/s wr, 136 op/s 2024-05-08T06:50:10.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.309+0000 7f3b0cc00700 1 -- 172.21.15.70:0/685236822 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b1c0078e0 con 0x562e041a2ff0 2024-05-08T06:50:10.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.309+0000 7f3b0cc00700 1 -- 172.21.15.70:0/685236822 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3b1000f610 con 0x562e041a2ff0 2024-05-08T06:50:10.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.309+0000 7f3b34563b80 10 client.15531 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:50:10.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.309+0000 7f3b34563b80 10 client.15531 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:50:10.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.309+0000 7f3b34563b80 20 client.15531 populate_metadata read hostname 'smithi070' 2024-05-08T06:50:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.309+0000 7f3b34563b80 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e04222cc0 0x562e042250e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.309+0000 7f3b34563b80 4 client.15531 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.05, "await_for": 42.0}] 2024-05-08T06:50:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.309+0000 7f3b34563b80 1 -- 172.21.15.70:0/685236822 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.05, "await_for": 42.0}) -- 0x562e040fd590 con 0x562e04222cc0 2024-05-08T06:50:10.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.310+0000 7f3b22a00700 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e04222cc0 0x562e042250e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:10.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.311+0000 7f3b22a00700 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e04222cc0 0x562e042250e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d6802e3598cf8bb server_cookie=b3773984e2e874b9 in_seq=0 out_seq=0 2024-05-08T06:50:10.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:10.311+0000 7f3b0cc00700 10 client.15531 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:10 smithi172 ceph-mon[33377]: pgmap v111: 129 pgs: 129 active+clean; 167 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 932 KiB/s wr, 136 op/s 2024-05-08T06:50:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:10 smithi194 ceph-mon[33679]: pgmap v111: 129 pgs: 129 active+clean; 167 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 932 KiB/s wr, 136 op/s 2024-05-08T06:50:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:12 smithi070 ceph-mon[29591]: pgmap v112: 129 pgs: 129 active+clean; 167 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 670 KiB/s wr, 99 op/s 2024-05-08T06:50:12.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:12 smithi172 ceph-mon[33377]: pgmap v112: 129 pgs: 129 active+clean; 167 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 670 KiB/s wr, 99 op/s 2024-05-08T06:50:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:12 smithi194 ceph-mon[33679]: pgmap v112: 129 pgs: 129 active+clean; 167 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 670 KiB/s wr, 99 op/s 2024-05-08T06:50:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:14 smithi070 ceph-mon[29591]: pgmap v113: 129 pgs: 129 active+clean; 167 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 670 KiB/s wr, 99 op/s 2024-05-08T06:50:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:14 smithi172 ceph-mon[33377]: pgmap v113: 129 pgs: 129 active+clean; 167 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 670 KiB/s wr, 99 op/s 2024-05-08T06:50:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:14 smithi194 ceph-mon[33679]: pgmap v113: 129 pgs: 129 active+clean; 167 MiB data, 818 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 670 KiB/s wr, 99 op/s 2024-05-08T06:50:14.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.593+0000 7f3b0cc00700 1 -- 172.21.15.70:0/685236822 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562e040fd590 con 0x562e04222cc0 2024-05-08T06:50:14.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.593+0000 7f3b0cc00700 10 client.15531 handle_command_reply: tid=0 2024-05-08T06:50:14.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.593+0000 7f3b34563b80 1 client.15531 shutdown 2024-05-08T06:50:14.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.593+0000 7f3b34563b80 1 -- 172.21.15.70:0/685236822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 msgr2=0x562e041afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:14.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.593+0000 7f3b34563b80 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041afd80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3b10003760 tx=0x7f3b100095c0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.594+0000 7f3b34563b80 1 -- 172.21.15.70:0/685236822 shutdown_connections 2024-05-08T06:50:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.594+0000 7f3b34563b80 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e04222cc0 0x562e042250e0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.594+0000 7f3b34563b80 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e041a3910 0x562e041ac810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.594+0000 7f3b34563b80 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0419db40 0x562e041af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.594+0000 7f3b34563b80 1 --2- 172.21.15.70:0/685236822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e041a2ff0 0x562e041afd80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.594+0000 7f3b0cc00700 0 client.15531 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.594+0000 7f3b34563b80 1 -- 172.21.15.70:0/685236822 >> 172.21.15.70:0/685236822 conn(0x562e040cbcf0 msgr2=0x562e041a3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:14.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.594+0000 7f3b34563b80 1 -- 172.21.15.70:0/685236822 shutdown_connections 2024-05-08T06:50:14.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.594+0000 7f3b34563b80 1 -- 172.21.15.70:0/685236822 wait complete. 2024-05-08T06:50:14.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.595+0000 7f3b34563b80 20 client.15531 trim_cache size 0 max 16384 2024-05-08T06:50:14.595 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:50:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:50:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:50:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 10, 2024-05-08T06:50:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:50:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "4375a11a": { 2024-05-08T06:50:14.595 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 10, 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 81.0, 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:14.596 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:14.597 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:14.597 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 -- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b080b2b20 msgr2=0x7f3b080b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b080b2b20 0x7f3b080b4fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c006130 tx=0x7f3b1c0088c0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 -- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240757c0 msgr2=0x7f3b241a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240757c0 0x7f3b241a1740 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400c970 tx=0x7f3b1400cd30 comp rx=0 tx=0).stop 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 -- 172.21.15.70:0/2277872905 shutdown_connections 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b080b2b20 0x7f3b080b4fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2410fba0 0x7f3b2419b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b240757c0 0x7f3b241a1740 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 --2- 172.21.15.70:0/2277872905 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b240760e0 0x7f3b241a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 -- 172.21.15.70:0/2277872905 >> 172.21.15.70:0/2277872905 conn(0x7f3b240fee50 msgr2=0x7f3b240ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:14.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.596+0000 7f3b23e00700 1 -- 172.21.15.70:0/2277872905 shutdown_connections 2024-05-08T06:50:14.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:14.597+0000 7f3b23e00700 1 -- 172.21.15.70:0/2277872905 wait complete. 2024-05-08T06:50:15.635 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4375a11a', quiesce took 13.2 seconds. Will release after: 21.05 2024-05-08T06:50:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:16 smithi070 ceph-mon[29591]: pgmap v114: 129 pgs: 129 active+clean; 169 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 864 KiB/s wr, 134 op/s 2024-05-08T06:50:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:16 smithi172 ceph-mon[33377]: pgmap v114: 129 pgs: 129 active+clean; 169 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 864 KiB/s wr, 134 op/s 2024-05-08T06:50:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:16 smithi194 ceph-mon[33679]: pgmap v114: 129 pgs: 129 active+clean; 169 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 864 KiB/s wr, 134 op/s 2024-05-08T06:50:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:18 smithi172 ceph-mon[33377]: pgmap v115: 129 pgs: 129 active+clean; 169 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 528 KiB/s wr, 81 op/s 2024-05-08T06:50:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:18 smithi194 ceph-mon[33679]: pgmap v115: 129 pgs: 129 active+clean; 169 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 528 KiB/s wr, 81 op/s 2024-05-08T06:50:18.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:18 smithi070 ceph-mon[29591]: pgmap v115: 129 pgs: 129 active+clean; 169 MiB data, 832 MiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 528 KiB/s wr, 81 op/s 2024-05-08T06:50:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:20 smithi172 ceph-mon[33377]: pgmap v116: 129 pgs: 129 active+clean; 169 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 577 KiB/s wr, 108 op/s 2024-05-08T06:50:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:20 smithi194 ceph-mon[33679]: pgmap v116: 129 pgs: 129 active+clean; 169 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 577 KiB/s wr, 108 op/s 2024-05-08T06:50:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:20 smithi070 ceph-mon[29591]: pgmap v116: 129 pgs: 129 active+clean; 169 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 577 KiB/s wr, 108 op/s 2024-05-08T06:50:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:22 smithi172 ceph-mon[33377]: pgmap v117: 129 pgs: 129 active+clean; 169 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 243 KiB/s wr, 62 op/s 2024-05-08T06:50:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:22 smithi194 ceph-mon[33679]: pgmap v117: 129 pgs: 129 active+clean; 169 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 243 KiB/s wr, 62 op/s 2024-05-08T06:50:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:22 smithi070 ceph-mon[29591]: pgmap v117: 129 pgs: 129 active+clean; 169 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 243 KiB/s wr, 62 op/s 2024-05-08T06:50:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:24 smithi172 ceph-mon[33377]: pgmap v118: 129 pgs: 129 active+clean; 169 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 243 KiB/s wr, 62 op/s 2024-05-08T06:50:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:24 smithi194 ceph-mon[33679]: pgmap v118: 129 pgs: 129 active+clean; 169 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 243 KiB/s wr, 62 op/s 2024-05-08T06:50:24.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:24 smithi070 ceph-mon[29591]: pgmap v118: 129 pgs: 129 active+clean; 169 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 243 KiB/s wr, 62 op/s 2024-05-08T06:50:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:25 smithi194 ceph-mon[33679]: pgmap v119: 129 pgs: 129 active+clean; 170 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 245 KiB/s wr, 65 op/s 2024-05-08T06:50:25.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:25 smithi070 ceph-mon[29591]: pgmap v119: 129 pgs: 129 active+clean; 170 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 245 KiB/s wr, 65 op/s 2024-05-08T06:50:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:25 smithi172 ceph-mon[33377]: pgmap v119: 129 pgs: 129 active+clean; 170 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 245 KiB/s wr, 65 op/s 2024-05-08T06:50:28.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:27 smithi070 ceph-mon[29591]: pgmap v120: 129 pgs: 129 active+clean; 170 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-05-08T06:50:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:27 smithi172 ceph-mon[33377]: pgmap v120: 129 pgs: 129 active+clean; 170 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-05-08T06:50:28.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:27 smithi194 ceph-mon[33679]: pgmap v120: 129 pgs: 129 active+clean; 170 MiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-05-08T06:50:30.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:29 smithi070 ceph-mon[29591]: pgmap v121: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-05-08T06:50:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:29 smithi172 ceph-mon[33377]: pgmap v121: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-05-08T06:50:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:29 smithi194 ceph-mon[33679]: pgmap v121: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 54 KiB/s wr, 32 op/s 2024-05-08T06:50:32.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:31 smithi070 ceph-mon[29591]: pgmap v122: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-05-08T06:50:32.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:31 smithi172 ceph-mon[33377]: pgmap v122: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-05-08T06:50:32.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:31 smithi194 ceph-mon[33679]: pgmap v122: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-05-08T06:50:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:33 smithi070 ceph-mon[29591]: pgmap v123: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-05-08T06:50:34.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:33 smithi172 ceph-mon[33377]: pgmap v123: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-05-08T06:50:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:33 smithi194 ceph-mon[33679]: pgmap v123: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.2 KiB/s wr, 5 op/s 2024-05-08T06:50:36.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:35 smithi070 ceph-mon[29591]: pgmap v124: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2024-05-08T06:50:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:35 smithi172 ceph-mon[33377]: pgmap v124: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2024-05-08T06:50:36.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:35 smithi194 ceph-mon[33679]: pgmap v124: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.0 KiB/s wr, 8 op/s 2024-05-08T06:50:36.686 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:50:37.144 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:50:38.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:37 smithi070 ceph-mon[29591]: pgmap v125: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:50:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:37 smithi172 ceph-mon[33377]: pgmap v125: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:50:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:37 smithi194 ceph-mon[33679]: pgmap v125: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:50:39.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.741+0000 7f87a5200700 1 -- 172.21.15.70:0/2674180451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 msgr2=0x7f87a01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:39.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.741+0000 7f87a5200700 1 --2- 172.21.15.70:0/2674180451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 0x7f87a01103d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f879800b0a0 tx=0x7f879800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:50:39.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.741+0000 7f87a5200700 1 -- 172.21.15.70:0/2674180451 shutdown_connections 2024-05-08T06:50:39.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.742+0000 7f87a5200700 1 --2- 172.21.15.70:0/2674180451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 0x7f87a01103d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:39.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.742+0000 7f87a5200700 1 --2- 172.21.15.70:0/2674180451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87a0108460 0x7f87a0108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:39.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.742+0000 7f87a5200700 1 --2- 172.21.15.70:0/2674180451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87a0103550 0x7f87a01039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:39.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.742+0000 7f87a5200700 1 -- 172.21.15.70:0/2674180451 >> 172.21.15.70:0/2674180451 conn(0x7f87a007a600 msgr2=0x7f87a007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:39.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.742+0000 7f87a5200700 1 -- 172.21.15.70:0/2674180451 shutdown_connections 2024-05-08T06:50:39.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.742+0000 7f87a5200700 1 -- 172.21.15.70:0/2674180451 wait complete. 2024-05-08T06:50:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.743+0000 7f87a5200700 1 Processor -- start 2024-05-08T06:50:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.743+0000 7f87a5200700 1 -- start start 2024-05-08T06:50:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f87a5200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87a0103550 0x7f87a01a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f87a5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 0x7f87a01a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f87a5200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87a0108460 0x7f87a019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f87a5200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87a01135e0 con 0x7f87a0103ef0 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f87a5200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87a0113460 con 0x7f87a0103550 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f87a5200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f87a0113760 con 0x7f87a0108460 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f8797e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 0x7f87a01a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f8797e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 0x7f87a01a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40798/0 (socket says 172.21.15.70:40798) 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f8797e00700 1 -- 172.21.15.70:0/2187637945 learned_addr learned my addr 172.21.15.70:0/2187637945 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f879e800700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87a0108460 0x7f87a019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f879de00700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87a0103550 0x7f87a01a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f8797e00700 1 -- 172.21.15.70:0/2187637945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87a0108460 msgr2=0x7f87a019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f8797e00700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87a0108460 0x7f87a019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f8797e00700 1 -- 172.21.15.70:0/2187637945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87a0103550 msgr2=0x7f87a01a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f8797e00700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87a0103550 0x7f87a01a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.744+0000 7f8797e00700 1 -- 172.21.15.70:0/2187637945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a019c200 con 0x7f87a0103ef0 2024-05-08T06:50:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.745+0000 7f879e800700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87a0108460 0x7f87a019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:50:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.745+0000 7f8797e00700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 0x7f87a01a1e20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f878800d950 tx=0x7f878800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.745+0000 7f8796a00700 1 -- 172.21.15.70:0/2187637945 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8788016070 con 0x7f87a0103ef0 2024-05-08T06:50:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.745+0000 7f8796a00700 1 -- 172.21.15.70:0/2187637945 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8788010460 con 0x7f87a0103ef0 2024-05-08T06:50:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.745+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87a019c4f0 con 0x7f87a0103ef0 2024-05-08T06:50:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.745+0000 7f8796a00700 1 -- 172.21.15.70:0/2187637945 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878800f620 con 0x7f87a0103ef0 2024-05-08T06:50:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.745+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87a01a87b0 con 0x7f87a0103ef0 2024-05-08T06:50:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.747+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87a006a190 con 0x7f87a0103ef0 2024-05-08T06:50:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.749+0000 7f8796a00700 1 -- 172.21.15.70:0/2187637945 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8788019070 con 0x7f87a0103ef0 2024-05-08T06:50:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.751+0000 7f8796a00700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87840b29f0 0x7f87840b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.751+0000 7f8796a00700 1 -- 172.21.15.70:0/2187637945 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f87880e2690 con 0x7f87a0103ef0 2024-05-08T06:50:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.751+0000 7f879de00700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87840b29f0 0x7f87840b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.752+0000 7f879de00700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87840b29f0 0x7f87840b4eb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87a019cbe0 tx=0x7f879000b5b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:39.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:39.756+0000 7f8796a00700 1 -- 172.21.15.70:0/2187637945 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f87880a9c40 con 0x7f87a0103ef0 2024-05-08T06:50:40.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.058+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87a01a89e0 con 0x7f87a0103ef0 2024-05-08T06:50:40.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:39 smithi070 ceph-mon[29591]: pgmap v126: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-05-08T06:50:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.060+0000 7f8796a00700 1 -- 172.21.15.70:0/2187637945 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f87880a9540 con 0x7f87a0103ef0 2024-05-08T06:50:40.060 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:50:40.060 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:50:40.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.063+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87840b29f0 msgr2=0x7f87840b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:40.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.063+0000 7f87a5200700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87840b29f0 0x7f87840b4eb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87a019cbe0 tx=0x7f879000b5b0 comp rx=0 tx=0).stop 2024-05-08T06:50:40.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.063+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 msgr2=0x7f87a01a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:40.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.063+0000 7f87a5200700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 0x7f87a01a1e20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f878800d950 tx=0x7f878800dd10 comp rx=0 tx=0).stop 2024-05-08T06:50:40.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.064+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 shutdown_connections 2024-05-08T06:50:40.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.064+0000 7f87a5200700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87840b29f0 0x7f87840b4eb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:40.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.064+0000 7f87a5200700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87a0108460 0x7f87a019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:40.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.064+0000 7f87a5200700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87a0103550 0x7f87a01a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:40.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.064+0000 7f87a5200700 1 --2- 172.21.15.70:0/2187637945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87a0103ef0 0x7f87a01a1e20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:40.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.064+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 >> 172.21.15.70:0/2187637945 conn(0x7f87a007a600 msgr2=0x7f87a01013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:40.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.064+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 shutdown_connections 2024-05-08T06:50:40.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:40.064+0000 7f87a5200700 1 -- 172.21.15.70:0/2187637945 wait complete. 2024-05-08T06:50:40.065 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:50:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:39 smithi172 ceph-mon[33377]: pgmap v126: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-05-08T06:50:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:39 smithi194 ceph-mon[33679]: pgmap v126: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-05-08T06:50:41.065 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 4375a11a --release --await' 2024-05-08T06:50:41.065 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 4375a11a --release --await 2024-05-08T06:50:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:40 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2187637945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:50:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:40 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2187637945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:50:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:40 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2187637945' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:50:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:50:42.080 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:41 smithi070 ceph-mon[29591]: pgmap v127: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:50:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:41 smithi172 ceph-mon[33377]: pgmap v127: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:50:42.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:41 smithi194 ceph-mon[33679]: pgmap v127: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:50:44.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.023+0000 7f8433400700 1 -- 172.21.15.70:0/487908134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 msgr2=0x7f842c10f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:44.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.023+0000 7f8433400700 1 --2- 172.21.15.70:0/487908134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 0x7f842c10f9c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8418009990 tx=0x7f8418009ca0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.023+0000 7f8433400700 1 -- 172.21.15.70:0/487908134 shutdown_connections 2024-05-08T06:50:44.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.023+0000 7f8433400700 1 --2- 172.21.15.70:0/487908134 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f842c10ff00 0x7f842c1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.023+0000 7f8433400700 1 --2- 172.21.15.70:0/487908134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f842c0756d0 0x7f842c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.023+0000 7f8433400700 1 --2- 172.21.15.70:0/487908134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 0x7f842c10f9c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.023+0000 7f8433400700 1 -- 172.21.15.70:0/487908134 >> 172.21.15.70:0/487908134 conn(0x7f842c07a5f0 msgr2=0x7f842c07aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:44.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.023+0000 7f8433400700 1 -- 172.21.15.70:0/487908134 shutdown_connections 2024-05-08T06:50:44.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.023+0000 7f8433400700 1 -- 172.21.15.70:0/487908134 wait complete. 2024-05-08T06:50:44.024 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:43 smithi070 ceph-mon[29591]: pgmap v128: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:50:44.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.024+0000 7f8433400700 1 Processor -- start 2024-05-08T06:50:44.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8433400700 1 -- start start 2024-05-08T06:50:44.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8433400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f842c0756d0 0x7f842c19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8433400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 0x7f842c19c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8433400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f842c10ff00 0x7f842c1a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8433400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f842c115840 con 0x7f842c075ff0 2024-05-08T06:50:44.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8433400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1156c0 con 0x7f842c0756d0 2024-05-08T06:50:44.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8433400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1159c0 con 0x7f842c10ff00 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8423e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 0x7f842c19c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8423e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 0x7f842c19c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40816/0 (socket says 172.21.15.70:40816) 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.025+0000 7f8423e00700 1 -- 172.21.15.70:0/2178881658 learned_addr learned my addr 172.21.15.70:0/2178881658 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.026+0000 7f8430a00700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f842c0756d0 0x7f842c19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.026+0000 7f8431400700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f842c10ff00 0x7f842c1a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.026+0000 7f8423e00700 1 -- 172.21.15.70:0/2178881658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f842c10ff00 msgr2=0x7f842c1a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.026+0000 7f8423e00700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f842c10ff00 0x7f842c1a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.026+0000 7f8423e00700 1 -- 172.21.15.70:0/2178881658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f842c0756d0 msgr2=0x7f842c19bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.026+0000 7f8423e00700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f842c0756d0 0x7f842c19bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.026+0000 7f8423e00700 1 -- 172.21.15.70:0/2178881658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842c1a0da0 con 0x7f842c075ff0 2024-05-08T06:50:44.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.026+0000 7f8423e00700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 0x7f842c19c2d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8418005910 tx=0x7f8418009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:44.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.027+0000 7f842a000700 1 -- 172.21.15.70:0/2178881658 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418027070 con 0x7f842c075ff0 2024-05-08T06:50:44.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.027+0000 7f842a000700 1 -- 172.21.15.70:0/2178881658 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f841800fce0 con 0x7f842c075ff0 2024-05-08T06:50:44.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.027+0000 7f8433400700 1 -- 172.21.15.70:0/2178881658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842c1a1030 con 0x7f842c075ff0 2024-05-08T06:50:44.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.027+0000 7f842a000700 1 -- 172.21.15.70:0/2178881658 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180173f0 con 0x7f842c075ff0 2024-05-08T06:50:44.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.027+0000 7f8433400700 1 -- 172.21.15.70:0/2178881658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842c1a8910 con 0x7f842c075ff0 2024-05-08T06:50:44.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.030+0000 7f842a000700 1 -- 172.21.15.70:0/2178881658 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f841802a070 con 0x7f842c075ff0 2024-05-08T06:50:44.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f843dd50b80 1 Processor -- start 2024-05-08T06:50:44.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f843dd50b80 1 -- start start 2024-05-08T06:50:44.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 0x55dd04e052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04dff910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f842a000700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f84080b2a70 0x7f84080b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dffe50 0x55dd04e0bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f843dd50b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dd04d51b20 con 0x55dd04dff490 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f843dd50b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dd04cef860 con 0x55dd04dffe50 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f843dd50b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dd04d4dae0 con 0x55dd04e04ec0 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.032+0000 7f8423e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04dff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f842a000700 1 -- 172.21.15.70:0/2178881658 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f84180e3a60 con 0x7f842c075ff0 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8430a00700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f84080b2a70 0x7f84080b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8423e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04dff910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40830/0 (socket says 172.21.15.70:40830) 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8423e00700 1 -- 172.21.15.70:0/1276914664 learned_addr learned my addr 172.21.15.70:0/1276914664 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:44.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8431400700 1 --2- 172.21.15.70:0/1276914664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 0x55dd04e052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8431400700 1 --2- 172.21.15.70:0/1276914664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dffe50 0x55dd04e0bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8423e00700 1 -- 172.21.15.70:0/1276914664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 msgr2=0x55dd04e052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8423e00700 1 --2- 172.21.15.70:0/1276914664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 0x55dd04e052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8423e00700 1 -- 172.21.15.70:0/1276914664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dffe50 msgr2=0x55dd04e0bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8423e00700 1 --2- 172.21.15.70:0/1276914664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dffe50 0x55dd04e0bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8423e00700 1 -- 172.21.15.70:0/1276914664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd04c9e9d0 con 0x55dd04dff490 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.033+0000 7f8423e00700 1 --2- 172.21.15.70:0/1276914664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04dff910 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f84180e0cf0 tx=0x7f8418009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d932ae07b7bf871 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.034+0000 7f8430a00700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f84080b2a70 0x7f84080b4f30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8410005950 tx=0x7f8410005eb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.034+0000 7f8422000700 1 -- 172.21.15.70:0/1276914664 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180aa4b0 con 0x55dd04dff490 2024-05-08T06:50:44.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.034+0000 7f8422000700 1 -- 172.21.15.70:0/1276914664 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84180ab0a0 con 0x55dd04dff490 2024-05-08T06:50:44.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.034+0000 7f8422000700 1 -- 172.21.15.70:0/1276914664 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180b3770 con 0x55dd04dff490 2024-05-08T06:50:44.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 -- 172.21.15.70:0/1276914664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 msgr2=0x55dd04dff910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:44.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 --2- 172.21.15.70:0/1276914664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04dff910 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f84180e0cf0 tx=0x7f8418009310 comp rx=0 tx=0).stop 2024-05-08T06:50:44.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 -- 172.21.15.70:0/1276914664 shutdown_connections 2024-05-08T06:50:44.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 --2- 172.21.15.70:0/1276914664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dffe50 0x55dd04e0bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 --2- 172.21.15.70:0/1276914664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 0x55dd04e052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 --2- 172.21.15.70:0/1276914664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04dff910 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 -- 172.21.15.70:0/1276914664 >> 172.21.15.70:0/1276914664 conn(0x55dd04d2dc60 msgr2=0x55dd04df9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:44.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 -- 172.21.15.70:0/1276914664 shutdown_connections 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 -- 172.21.15.70:0/1276914664 wait complete. 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.035+0000 7f843dd50b80 1 -- start start 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.036+0000 7f843dd50b80 1 Processor -- start 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.036+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dff490 0x55dd04e0b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.036+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e08c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.036+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 0x55dd04e091c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.036+0000 7f843dd50b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dd04d51b20 con 0x55dd04dffe50 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.036+0000 7f843dd50b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dd04cb7c20 con 0x55dd04dff490 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.036+0000 7f843dd50b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dd04e059d0 con 0x55dd04e04ec0 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.036+0000 7f843dd50b80 10 client.0 _ll_register_callbacks cb 0x55dd04cf8d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8423e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e08c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8423e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e08c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40840/0 (socket says 172.21.15.70:40840) 2024-05-08T06:50:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8423e00700 1 -- 172.21.15.70:0/3856073295 learned_addr learned my addr 172.21.15.70:0/3856073295 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8430a00700 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dff490 0x55dd04e0b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8431400700 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 0x55dd04e091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8423e00700 1 -- 172.21.15.70:0/3856073295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 msgr2=0x55dd04e091c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8423e00700 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 0x55dd04e091c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8423e00700 1 -- 172.21.15.70:0/3856073295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dff490 msgr2=0x55dd04e0b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8423e00700 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dff490 0x55dd04e0b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8423e00700 1 -- 172.21.15.70:0/3856073295 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd04d17520 con 0x55dd04dffe50 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8431400700 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 0x55dd04e091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f8423e00700 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e08c80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f84180ab250 tx=0x7f84180a6990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377ea3c6d86ae8bf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.037+0000 7f841ee00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.038+0000 7f841ee00700 1 -- 172.21.15.70:0/3856073295 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180c4060 con 0x55dd04dffe50 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.038+0000 7f841ee00700 1 -- 172.21.15.70:0/3856073295 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f84180aac00 con 0x55dd04dffe50 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.038+0000 7f843dd50b80 1 -- 172.21.15.70:0/3856073295 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84180ab0a0 con 0x55dd04dffe50 2024-05-08T06:50:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.038+0000 7f841ee00700 1 -- 172.21.15.70:0/3856073295 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f84180e1210 con 0x55dd04dffe50 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.038+0000 7f843dd50b80 10 client.15549 fetch_fsmap learned FSMap version 28 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.038+0000 7f843dd50b80 1 -- 172.21.15.70:0/3856073295 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd04e16690 con 0x55dd04dffe50 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.038+0000 7f841ee00700 1 -- 172.21.15.70:0/3856073295 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84180ab0a0 con 0x55dd04dffe50 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.039+0000 7f841ee00700 1 -- 172.21.15.70:0/3856073295 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f84180cbbc0 con 0x55dd04dffe50 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.039+0000 7f843dd50b80 10 client.15549 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.039+0000 7f843dd50b80 10 client.15549 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.039+0000 7f843dd50b80 20 client.15549 populate_metadata read hostname 'smithi070' 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.039+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dd04e18bb0 0x55dd04e1afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.039+0000 7f843dd50b80 4 client.15549 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:50:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.039+0000 7f843dd50b80 1 -- 172.21.15.70:0/3856073295 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd04dcc1a0 con 0x55dd04e18bb0 2024-05-08T06:50:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.039+0000 7f8430a00700 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dd04e18bb0 0x55dd04e1afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.040+0000 7f841ee00700 10 client.15549 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.040+0000 7f8430a00700 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dd04e18bb0 0x55dd04e1afc0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b25e6b4c6035edc4 server_cookie=6382320f6341d3a6 in_seq=0 out_seq=0 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.042+0000 7f841ee00700 1 -- 172.21.15.70:0/3856073295 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dd04dcc1a0 con 0x55dd04e18bb0 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f841ee00700 10 client.15549 handle_command_reply: tid=0 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 client.15549 shutdown 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 -- 172.21.15.70:0/3856073295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 msgr2=0x55dd04e08c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e08c80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f84180ab250 tx=0x7f84180a6990 comp rx=0 tx=0).stop 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 -- 172.21.15.70:0/3856073295 shutdown_connections 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dd04e18bb0 0x55dd04e1afc0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04e04ec0 0x55dd04e091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04dff490 0x55dd04e0b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3856073295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e08c80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 -- 172.21.15.70:0/3856073295 >> 172.21.15.70:0/3856073295 conn(0x55dd04d2dc60 msgr2=0x55dd04df4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f841ee00700 0 client.15549 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:44.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 -- 172.21.15.70:0/3856073295 shutdown_connections 2024-05-08T06:50:44.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 1 -- 172.21.15.70:0/3856073295 wait complete. 2024-05-08T06:50:44.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.043+0000 7f843dd50b80 20 client.15549 trim_cache size 0 max 16384 2024-05-08T06:50:44.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.065+0000 7f843dd50b80 1 Processor -- start 2024-05-08T06:50:44.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.065+0000 7f843dd50b80 1 -- start start 2024-05-08T06:50:44.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.065+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dff490 0x55dd04e092b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.065+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e046e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.065+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 0x55dd04e14da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.065+0000 7f843dd50b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1b3f40 con 0x55dd04dffe50 2024-05-08T06:50:44.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.065+0000 7f843dd50b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1b17d0 con 0x55dd04e04ec0 2024-05-08T06:50:44.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.065+0000 7f843dd50b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1af620 con 0x55dd04dff490 2024-05-08T06:50:44.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8423e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e046e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8423e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e046e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40850/0 (socket says 172.21.15.70:40850) 2024-05-08T06:50:44.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8423e00700 1 -- 172.21.15.70:0/3073684407 learned_addr learned my addr 172.21.15.70:0/3073684407 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8430a00700 1 --2- 172.21.15.70:0/3073684407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dff490 0x55dd04e092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8423e00700 1 -- 172.21.15.70:0/3073684407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dff490 msgr2=0x55dd04e092b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8423e00700 1 --2- 172.21.15.70:0/3073684407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dff490 0x55dd04e092b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8423e00700 1 -- 172.21.15.70:0/3073684407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 msgr2=0x55dd04e14da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8423e00700 1 --2- 172.21.15.70:0/3073684407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 0x55dd04e14da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8423e00700 1 -- 172.21.15.70:0/3073684407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd04df6980 con 0x55dd04dffe50 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.066+0000 7f8430a00700 1 --2- 172.21.15.70:0/3073684407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dff490 0x55dd04e092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.067+0000 7f8423e00700 1 --2- 172.21.15.70:0/3073684407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e046e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8418009750 tx=0x7f84180e0e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353ef0dc99732f27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.067+0000 7f8421600700 1 -- 172.21.15.70:0/3073684407 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180c4070 con 0x55dd04dffe50 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.067+0000 7f8421600700 1 -- 172.21.15.70:0/3073684407 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84180ab0a0 con 0x55dd04dffe50 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.067+0000 7f8421600700 1 -- 172.21.15.70:0/3073684407 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84180cbbc0 con 0x55dd04dffe50 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 -- 172.21.15.70:0/3073684407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 msgr2=0x55dd04e046e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3073684407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e046e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8418009750 tx=0x7f84180e0e60 comp rx=0 tx=0).stop 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 -- 172.21.15.70:0/3073684407 shutdown_connections 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3073684407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 0x55dd04e14da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3073684407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dff490 0x55dd04e092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 --2- 172.21.15.70:0/3073684407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dffe50 0x55dd04e046e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 -- 172.21.15.70:0/3073684407 >> 172.21.15.70:0/3073684407 conn(0x55dd04d2dc60 msgr2=0x55dd04dfe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 -- 172.21.15.70:0/3073684407 shutdown_connections 2024-05-08T06:50:44.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 -- 172.21.15.70:0/3073684407 wait complete. 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.068+0000 7f843dd50b80 1 -- start start 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f843dd50b80 1 Processor -- start 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04e11130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dffe50 0x55dd04e11670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f843dd50b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 0x55dd04e0c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f843dd50b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1afc90 con 0x55dd04dff490 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f843dd50b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1b1100 con 0x55dd04e04ec0 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f843dd50b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f842c1b0360 con 0x55dd04dffe50 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f843dd50b80 10 client.0 _ll_register_callbacks cb 0x55dd04cf8d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:50:44.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f8430a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04e11130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f8430a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04e11130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40862/0 (socket says 172.21.15.70:40862) 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.069+0000 7f8430a00700 1 -- 172.21.15.70:0/736597223 learned_addr learned my addr 172.21.15.70:0/736597223 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f8423e00700 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dffe50 0x55dd04e11670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f8431400700 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 0x55dd04e0c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f8430a00700 1 -- 172.21.15.70:0/736597223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dffe50 msgr2=0x55dd04e11670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f8430a00700 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dffe50 0x55dd04e11670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f8430a00700 1 -- 172.21.15.70:0/736597223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 msgr2=0x55dd04e0c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f8430a00700 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 0x55dd04e0c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f8430a00700 1 -- 172.21.15.70:0/736597223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd04e0c6d0 con 0x55dd04dff490 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f8431400700 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 0x55dd04e0c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f8430a00700 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04e11130 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f841000a480 tx=0x7f84100047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1798a4ddf15ac5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f841ee00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:50:44.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.070+0000 7f841ee00700 1 -- 172.21.15.70:0/736597223 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8410020d70 con 0x55dd04dff490 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f841ee00700 1 -- 172.21.15.70:0/736597223 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f84100251d0 con 0x55dd04dff490 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f843dd50b80 1 -- 172.21.15.70:0/736597223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84180ab0a0 con 0x55dd04dff490 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f841ee00700 1 -- 172.21.15.70:0/736597223 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8410004830 con 0x55dd04dff490 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f843dd50b80 10 client.15555 fetch_fsmap learned FSMap version 28 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f843dd50b80 1 -- 172.21.15.70:0/736597223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dd04e83d10 con 0x55dd04dff490 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f841ee00700 1 -- 172.21.15.70:0/736597223 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84180ab0a0 con 0x55dd04dff490 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f841ee00700 1 -- 172.21.15.70:0/736597223 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f8410025ce0 con 0x55dd04dff490 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f843dd50b80 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f843dd50b80 10 client.15555 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f843dd50b80 20 client.15555 populate_metadata read hostname 'smithi070' 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.071+0000 7f843dd50b80 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dd04e84480 0x55dd04e868a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.072+0000 7f843dd50b80 4 client.15555 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4375a11a", "release": true, "await": true}] 2024-05-08T06:50:44.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.072+0000 7f843dd50b80 1 -- 172.21.15.70:0/736597223 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4375a11a", "release": true, "await": true}) -- 0x55dd04d5f500 con 0x55dd04e84480 2024-05-08T06:50:44.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.072+0000 7f8423e00700 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dd04e84480 0x55dd04e868a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:44.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.073+0000 7f8423e00700 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dd04e84480 0x55dd04e868a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92c11a463c460df5 server_cookie=f8b322df0ea402b3 in_seq=0 out_seq=0 2024-05-08T06:50:44.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.073+0000 7f841ee00700 10 client.15555 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:43 smithi172 ceph-mon[33377]: pgmap v128: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:50:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:43 smithi194 ceph-mon[33679]: pgmap v128: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.383+0000 7f841ee00700 1 -- 172.21.15.70:0/736597223 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55dd04d5f500 con 0x55dd04e84480 2024-05-08T06:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.383+0000 7f841ee00700 10 client.15555 handle_command_reply: tid=0 2024-05-08T06:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.383+0000 7f843dd50b80 1 client.15555 shutdown 2024-05-08T06:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.384+0000 7f843dd50b80 1 -- 172.21.15.70:0/736597223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 msgr2=0x55dd04e11130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:44.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.384+0000 7f843dd50b80 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04e11130 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f841000a480 tx=0x7f84100047c0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.384+0000 7f843dd50b80 1 -- 172.21.15.70:0/736597223 shutdown_connections 2024-05-08T06:50:44.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.384+0000 7f843dd50b80 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dd04e84480 0x55dd04e868a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.384+0000 7f843dd50b80 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dd04e04ec0 0x55dd04e0c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.384+0000 7f843dd50b80 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd04dff490 0x55dd04e11130 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.384+0000 7f843dd50b80 1 --2- 172.21.15.70:0/736597223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dd04dffe50 0x55dd04e11670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.384+0000 7f843dd50b80 1 -- 172.21.15.70:0/736597223 >> 172.21.15.70:0/736597223 conn(0x55dd04d2dc60 msgr2=0x55dd04df3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:44.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.384+0000 7f841ee00700 0 client.15555 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:44.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.385+0000 7f843dd50b80 1 -- 172.21.15.70:0/736597223 shutdown_connections 2024-05-08T06:50:44.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.385+0000 7f843dd50b80 1 -- 172.21.15.70:0/736597223 wait complete. 2024-05-08T06:50:44.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.386+0000 7f843dd50b80 20 client.15555 trim_cache size 0 max 16384 2024-05-08T06:50:44.386 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:50:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:50:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:50:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 12, 2024-05-08T06:50:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:50:44.386 INFO:teuthology.orchestra.run.smithi070.stdout: "4375a11a": { 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 12, 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 81.0, 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:50:44.387 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:50:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:50:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:50:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:50:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:44.388 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:44.388 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:50:44.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.387+0000 7f8433400700 1 -- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f84080b2a70 msgr2=0x7f84080b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:44.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.387+0000 7f8433400700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f84080b2a70 0x7f84080b4f30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8410005950 tx=0x7f8410005eb0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.387+0000 7f8433400700 1 -- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 msgr2=0x7f842c19c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:44.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.387+0000 7f8433400700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 0x7f842c19c2d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8418005910 tx=0x7f8418009f90 comp rx=0 tx=0).stop 2024-05-08T06:50:44.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.388+0000 7f8433400700 1 -- 172.21.15.70:0/2178881658 shutdown_connections 2024-05-08T06:50:44.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.388+0000 7f8433400700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f84080b2a70 0x7f84080b4f30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.388+0000 7f8433400700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f842c10ff00 0x7f842c1a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.388+0000 7f8433400700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f842c0756d0 0x7f842c19bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.388+0000 7f8433400700 1 --2- 172.21.15.70:0/2178881658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f842c075ff0 0x7f842c19c2d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.388+0000 7f8433400700 1 -- 172.21.15.70:0/2178881658 >> 172.21.15.70:0/2178881658 conn(0x7f842c07a5f0 msgr2=0x7f842c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.388+0000 7f8433400700 1 -- 172.21.15.70:0/2178881658 shutdown_connections 2024-05-08T06:50:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:44.388+0000 7f8433400700 1 -- 172.21.15.70:0/2178881658 wait complete. 2024-05-08T06:50:45.482 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4375a11a', seconds elapsed: 43.0 2024-05-08T06:50:45.483 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-05-08T06:50:45.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:50:45.983 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:50:46.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:45 smithi172 ceph-mon[33377]: pgmap v129: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-05-08T06:50:46.181 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:45 smithi070 ceph-mon[29591]: pgmap v129: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-05-08T06:50:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:45 smithi194 ceph-mon[33679]: pgmap v129: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 8 op/s 2024-05-08T06:50:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:47 smithi172 ceph-mon[33377]: pgmap v130: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-05-08T06:50:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:50:48.237 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:47 smithi070 ceph-mon[29591]: pgmap v130: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-05-08T06:50:48.237 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:50:48.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:47 smithi194 ceph-mon[33679]: pgmap v130: 129 pgs: 129 active+clean; 170 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-05-08T06:50:48.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:50:48.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.422+0000 7feb24600700 1 -- 172.21.15.70:0/1237950406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb1c06b180 msgr2=0x7feb1c06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:48.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.422+0000 7feb24600700 1 --2- 172.21.15.70:0/1237950406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb1c06b180 0x7feb1c06b600 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7feb08009990 tx=0x7feb08009ca0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.422+0000 7feb24600700 1 -- 172.21.15.70:0/1237950406 shutdown_connections 2024-05-08T06:50:48.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.422+0000 7feb24600700 1 --2- 172.21.15.70:0/1237950406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb1c06bb40 0x7feb1c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.422+0000 7feb24600700 1 --2- 172.21.15.70:0/1237950406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb1c109510 0x7feb1c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.422+0000 7feb24600700 1 --2- 172.21.15.70:0/1237950406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb1c06b180 0x7feb1c06b600 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.422+0000 7feb24600700 1 -- 172.21.15.70:0/1237950406 >> 172.21.15.70:0/1237950406 conn(0x7feb1c079350 msgr2=0x7feb1c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:48.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.422+0000 7feb24600700 1 -- 172.21.15.70:0/1237950406 shutdown_connections 2024-05-08T06:50:48.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.423+0000 7feb24600700 1 -- 172.21.15.70:0/1237950406 wait complete. 2024-05-08T06:50:48.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.424+0000 7feb24600700 1 Processor -- start 2024-05-08T06:50:48.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.424+0000 7feb24600700 1 -- start start 2024-05-08T06:50:48.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.425+0000 7feb24600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb1c06b180 0x7feb1c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:48.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.425+0000 7feb24600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb1c06bb40 0x7feb1c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:48.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.425+0000 7feb24600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb1c109510 0x7feb1c197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:48.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.425+0000 7feb24600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb1c1113d0 con 0x7feb1c06bb40 2024-05-08T06:50:48.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.425+0000 7feb24600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb1c111250 con 0x7feb1c06b180 2024-05-08T06:50:48.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.425+0000 7feb24600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feb1c111550 con 0x7feb1c109510 2024-05-08T06:50:48.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.425+0000 7feb21c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb1c06b180 0x7feb1c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:48.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.425+0000 7feb21c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb1c06b180 0x7feb1c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:50664/0 (socket says 172.21.15.70:50664) 2024-05-08T06:50:48.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.425+0000 7feb21c00700 1 -- 172.21.15.70:0/162014016 learned_addr learned my addr 172.21.15.70:0/162014016 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:48.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.426+0000 7feb21200700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb1c06bb40 0x7feb1c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:48.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.426+0000 7feb22600700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb1c109510 0x7feb1c197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:48.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.426+0000 7feb21c00700 1 -- 172.21.15.70:0/162014016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb1c109510 msgr2=0x7feb1c197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:48.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.426+0000 7feb21c00700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb1c109510 0x7feb1c197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.426+0000 7feb21c00700 1 -- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb1c06bb40 msgr2=0x7feb1c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:48.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.426+0000 7feb21c00700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb1c06bb40 0x7feb1c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.426+0000 7feb21c00700 1 -- 172.21.15.70:0/162014016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1c198010 con 0x7feb1c06b180 2024-05-08T06:50:48.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.427+0000 7feb21c00700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb1c06b180 0x7feb1c19d660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feb1000e9a0 tx=0x7feb1000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:48.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.427+0000 7feb1a000700 1 -- 172.21.15.70:0/162014016 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1000cbd0 con 0x7feb1c06b180 2024-05-08T06:50:48.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.427+0000 7feb1a000700 1 -- 172.21.15.70:0/162014016 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb1000cd70 con 0x7feb1c06b180 2024-05-08T06:50:48.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.427+0000 7feb1a000700 1 -- 172.21.15.70:0/162014016 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb10018680 con 0x7feb1c06b180 2024-05-08T06:50:48.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.428+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1c198300 con 0x7feb1c06b180 2024-05-08T06:50:48.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.428+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb1c1a45e0 con 0x7feb1c06b180 2024-05-08T06:50:48.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.430+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feafc005330 con 0x7feb1c06b180 2024-05-08T06:50:48.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.433+0000 7feb1a000700 1 -- 172.21.15.70:0/162014016 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7feb10018820 con 0x7feb1c06b180 2024-05-08T06:50:48.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.435+0000 7feb1a000700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb040b6e00 0x7feb040b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:48.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.435+0000 7feb1a000700 1 -- 172.21.15.70:0/162014016 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7feb100e2db0 con 0x7feb1c06b180 2024-05-08T06:50:48.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.435+0000 7feb21200700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb040b6e00 0x7feb040b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:48.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.436+0000 7feb21200700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb040b6e00 0x7feb040b92c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb1c198f80 tx=0x7feb08005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:48.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.455+0000 7feb1a000700 1 -- 172.21.15.70:0/162014016 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feb100aa470 con 0x7feb1c06b180 2024-05-08T06:50:48.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.820+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feafc005620 con 0x7feb1c06b180 2024-05-08T06:50:48.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.822+0000 7feb1a000700 1 -- 172.21.15.70:0/162014016 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7feb100a9d70 con 0x7feb1c06b180 2024-05-08T06:50:48.822 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:50:48.822 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:50:48.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb040b6e00 msgr2=0x7feb040b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:48.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb040b6e00 0x7feb040b92c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7feb1c198f80 tx=0x7feb08005fb0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb1c06b180 msgr2=0x7feb1c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:48.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb1c06b180 0x7feb1c19d660 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7feb1000e9a0 tx=0x7feb1000ecb0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 shutdown_connections 2024-05-08T06:50:48.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb040b6e00 0x7feb040b92c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb1c109510 0x7feb1c197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb1c06b180 0x7feb1c19d660 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 --2- 172.21.15.70:0/162014016 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb1c06bb40 0x7feb1c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:48.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.825+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 >> 172.21.15.70:0/162014016 conn(0x7feb1c079350 msgr2=0x7feb1c101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:48.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.826+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 shutdown_connections 2024-05-08T06:50:48.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:48.826+0000 7feb24600700 1 -- 172.21.15.70:0/162014016 wait complete. 2024-05-08T06:50:48.827 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:50:49.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:50:49.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:50:49.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:50:49.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:48 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/162014016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:50:49.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:50:49.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:50:49.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:50:49.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:48 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/162014016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:50:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:50:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:50:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:50:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:48 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/162014016' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:50:49.989 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 81.05 --await-for 42.0' 2024-05-08T06:50:49.990 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 81.05 --await-for 42.0 2024-05-08T06:50:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:49 smithi172 ceph-mon[33377]: pgmap v131: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 206 KiB/s wr, 53 op/s 2024-05-08T06:50:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:49 smithi194 ceph-mon[33679]: pgmap v131: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 206 KiB/s wr, 53 op/s 2024-05-08T06:50:50.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:49 smithi070 ceph-mon[29591]: pgmap v131: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 206 KiB/s wr, 53 op/s 2024-05-08T06:50:50.423 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:50:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:51 smithi172 ceph-mon[33377]: pgmap v132: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 203 KiB/s wr, 50 op/s 2024-05-08T06:50:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:51 smithi194 ceph-mon[33679]: pgmap v132: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 203 KiB/s wr, 50 op/s 2024-05-08T06:50:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:51 smithi070 ceph-mon[29591]: pgmap v132: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 203 KiB/s wr, 50 op/s 2024-05-08T06:50:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.139+0000 7f5511e00700 1 -- 172.21.15.70:0/2925069763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 msgr2=0x7f550c06c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.139+0000 7f5511e00700 1 --2- 172.21.15.70:0/2925069763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 0x7f550c06c090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f54f80099c0 tx=0x7f54f8009cd0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.140+0000 7f5511e00700 1 -- 172.21.15.70:0/2925069763 shutdown_connections 2024-05-08T06:50:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.140+0000 7f5511e00700 1 --2- 172.21.15.70:0/2925069763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c06c5d0 0x7f550c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.140+0000 7f5511e00700 1 --2- 172.21.15.70:0/2925069763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c109570 0x7f550c109950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.140+0000 7f5511e00700 1 --2- 172.21.15.70:0/2925069763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 0x7f550c06c090 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.140+0000 7f5511e00700 1 -- 172.21.15.70:0/2925069763 >> 172.21.15.70:0/2925069763 conn(0x7f550c0793c0 msgr2=0x7f550c0797d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:53.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.140+0000 7f5511e00700 1 -- 172.21.15.70:0/2925069763 shutdown_connections 2024-05-08T06:50:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.140+0000 7f5511e00700 1 -- 172.21.15.70:0/2925069763 wait complete. 2024-05-08T06:50:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.141+0000 7f5511e00700 1 Processor -- start 2024-05-08T06:50:53.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.141+0000 7f5511e00700 1 -- start start 2024-05-08T06:50:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.141+0000 7f5511e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 0x7f550c102450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.141+0000 7f5511e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c06c5d0 0x7f550c102990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.141+0000 7f5511e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c109570 0x7f550c102ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.141+0000 7f5511e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f550c113580 con 0x7f550c06bc10 2024-05-08T06:50:53.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.141+0000 7f5511e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f550c113400 con 0x7f550c109570 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.141+0000 7f5511e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f550c113700 con 0x7f550c06c5d0 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 0x7f550c102450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 0x7f550c102450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60068/0 (socket says 172.21.15.70:60068) 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550aa00700 1 -- 172.21.15.70:0/586428069 learned_addr learned my addr 172.21.15.70:0/586428069 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550a000700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c06c5d0 0x7f550c102990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550b400700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c109570 0x7f550c102ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550aa00700 1 -- 172.21.15.70:0/586428069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c06c5d0 msgr2=0x7f550c102990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550aa00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c06c5d0 0x7f550c102990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550aa00700 1 -- 172.21.15.70:0/586428069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c109570 msgr2=0x7f550c102ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550aa00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c109570 0x7f550c102ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550aa00700 1 -- 172.21.15.70:0/586428069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c1a7e80 con 0x7f550c06bc10 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.142+0000 7f550b400700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c109570 0x7f550c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.143+0000 7f550aa00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 0x7f550c102450 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f54fc007e20 tx=0x7f54fc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:53.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.143+0000 7f5510a00700 1 -- 172.21.15.70:0/586428069 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc016020 con 0x7f550c06bc10 2024-05-08T06:50:53.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.143+0000 7f5510a00700 1 -- 172.21.15.70:0/586428069 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54fc00ae00 con 0x7f550c06bc10 2024-05-08T06:50:53.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.143+0000 7f5510a00700 1 -- 172.21.15.70:0/586428069 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc011670 con 0x7f550c06bc10 2024-05-08T06:50:53.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.143+0000 7f5511e00700 1 -- 172.21.15.70:0/586428069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c1a8170 con 0x7f550c06bc10 2024-05-08T06:50:53.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.143+0000 7f5511e00700 1 -- 172.21.15.70:0/586428069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c1a8680 con 0x7f550c06bc10 2024-05-08T06:50:53.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.146+0000 7f5510a00700 1 -- 172.21.15.70:0/586428069 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f54fc019020 con 0x7f550c06bc10 2024-05-08T06:50:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.148+0000 7f551c84db80 1 Processor -- start 2024-05-08T06:50:53.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.148+0000 7f551c84db80 1 -- start start 2024-05-08T06:50:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.149+0000 7f551c84db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f5f50 0x5588e77f6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.149+0000 7f5510a00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54f00b2aa0 0x7f54f00b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.149+0000 7f551c84db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0520 0x5588e77f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.149+0000 7f551c84db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e77fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.149+0000 7f551c84db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5588e7742bb0 con 0x5588e77f0520 2024-05-08T06:50:53.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.149+0000 7f551c84db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5588e76e08f0 con 0x5588e77f0ee0 2024-05-08T06:50:53.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.149+0000 7f551c84db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5588e773eb70 con 0x5588e77f5f50 2024-05-08T06:50:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.149+0000 7f5510a00700 1 -- 172.21.15.70:0/586428069 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f54fc0e26c0 con 0x7f550c06bc10 2024-05-08T06:50:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.149+0000 7f550aa00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54f00b2aa0 0x7f54f00b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0520 0x5588e77f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0520 0x5588e77f09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60084/0 (socket says 172.21.15.70:60084) 2024-05-08T06:50:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550a000700 1 -- 172.21.15.70:0/1985390065 learned_addr learned my addr 172.21.15.70:0/1985390065 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:53.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550b400700 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f5f50 0x5588e77f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550b400700 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e77fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550a000700 1 -- 172.21.15.70:0/1985390065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f5f50 msgr2=0x5588e77f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550a000700 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f5f50 0x5588e77f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550a000700 1 -- 172.21.15.70:0/1985390065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 msgr2=0x5588e77fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550a000700 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e77fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550a000700 1 -- 172.21.15.70:0/1985390065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588e768fa60 con 0x5588e77f0520 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.150+0000 7f550b400700 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e77fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.151+0000 7f550aa00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54f00b2aa0 0x7f54f00b4f60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54fc007df0 tx=0x7f54fc007c50 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.151+0000 7f550a000700 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0520 0x5588e77f09a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f54f80058e0 tx=0x7f54f8005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f3bece551938b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.151+0000 7f5500c00700 1 -- 172.21.15.70:0/1985390065 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8027070 con 0x5588e77f0520 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.151+0000 7f5500c00700 1 -- 172.21.15.70:0/1985390065 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54f800bc20 con 0x5588e77f0520 2024-05-08T06:50:53.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.151+0000 7f5500c00700 1 -- 172.21.15.70:0/1985390065 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f80039b0 con 0x5588e77f0520 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.152+0000 7f551c84db80 1 -- 172.21.15.70:0/1985390065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0520 msgr2=0x5588e77f09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.152+0000 7f551c84db80 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0520 0x5588e77f09a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f54f80058e0 tx=0x7f54f8005c80 comp rx=0 tx=0).stop 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.152+0000 7f551c84db80 1 -- 172.21.15.70:0/1985390065 shutdown_connections 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.152+0000 7f551c84db80 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e77fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.152+0000 7f551c84db80 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f5f50 0x5588e77f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.152+0000 7f551c84db80 1 --2- 172.21.15.70:0/1985390065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0520 0x5588e77f09a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.152+0000 7f551c84db80 1 -- 172.21.15.70:0/1985390065 >> 172.21.15.70:0/1985390065 conn(0x5588e771ecf0 msgr2=0x5588e77eae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.152+0000 7f551c84db80 1 -- 172.21.15.70:0/1985390065 shutdown_connections 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.152+0000 7f551c84db80 1 -- 172.21.15.70:0/1985390065 wait complete. 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.153+0000 7f551c84db80 1 -- start start 2024-05-08T06:50:53.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.153+0000 7f551c84db80 1 Processor -- start 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.153+0000 7f551c84db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e77fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.153+0000 7f551c84db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0ee0 0x5588e77f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.153+0000 7f551c84db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f5f50 0x5588e77fa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.153+0000 7f551c84db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5588e77fd2b0 con 0x5588e77f0ee0 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.153+0000 7f551c84db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5588e76a8cb0 con 0x5588e77f5f50 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.153+0000 7f551c84db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5588e77fd430 con 0x5588e77f0520 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f551c84db80 10 client.0 _ll_register_callbacks cb 0x5588e76e9e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0ee0 0x5588e77f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0ee0 0x5588e77f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60098/0 (socket says 172.21.15.70:60098) 2024-05-08T06:50:53.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550a000700 1 -- 172.21.15.70:0/266521022 learned_addr learned my addr 172.21.15.70:0/266521022 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550b400700 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e77fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550b400700 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f5f50 0x5588e77fa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550a000700 1 -- 172.21.15.70:0/266521022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 msgr2=0x5588e77fc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:53.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550a000700 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e77fc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550a000700 1 -- 172.21.15.70:0/266521022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f5f50 msgr2=0x5588e77fa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550a000700 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f5f50 0x5588e77fa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550a000700 1 -- 172.21.15.70:0/266521022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588e77085b0 con 0x5588e77f0ee0 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.154+0000 7f550b400700 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f5f50 0x5588e77fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.155+0000 7f550a000700 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0ee0 0x5588e77f9c60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009990 tx=0x7f54f800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436a889d80b561c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.155+0000 7f54f5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.155+0000 7f54f5600700 1 -- 172.21.15.70:0/266521022 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f8031060 con 0x5588e77f0ee0 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.155+0000 7f551c84db80 1 -- 172.21.15.70:0/266521022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54f800bc20 con 0x5588e77f0ee0 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.155+0000 7f54f5600700 1 -- 172.21.15.70:0/266521022 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f54f8003680 con 0x5588e77f0ee0 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.155+0000 7f54f5600700 1 -- 172.21.15.70:0/266521022 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f54f8038050 con 0x5588e77f0ee0 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.155+0000 7f551c84db80 10 client.15573 fetch_fsmap learned FSMap version 28 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.155+0000 7f551c84db80 1 -- 172.21.15.70:0/266521022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5588e7807a80 con 0x5588e77f0ee0 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.156+0000 7f54f5600700 1 -- 172.21.15.70:0/266521022 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54f800bc20 con 0x5588e77f0ee0 2024-05-08T06:50:53.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.156+0000 7f54f5600700 1 -- 172.21.15.70:0/266521022 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f54f8022690 con 0x5588e77f0ee0 2024-05-08T06:50:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.156+0000 7f551c84db80 10 client.15573 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:50:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.156+0000 7f551c84db80 10 client.15573 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:50:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.156+0000 7f551c84db80 20 client.15573 populate_metadata read hostname 'smithi070' 2024-05-08T06:50:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.156+0000 7f551c84db80 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588e7809f50 0x5588e780c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.156+0000 7f551c84db80 4 client.15573 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:50:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.156+0000 7f551c84db80 1 -- 172.21.15.70:0/266521022 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588e77bd230 con 0x5588e7809f50 2024-05-08T06:50:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.157+0000 7f550b400700 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588e7809f50 0x5588e780c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.158+0000 7f550b400700 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588e7809f50 0x5588e780c340 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=325b01261fe57def server_cookie=88cd3cf09187142 in_seq=0 out_seq=0 2024-05-08T06:50:53.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.158+0000 7f54f5600700 10 client.15573 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.160+0000 7f54f5600700 1 -- 172.21.15.70:0/266521022 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5588e77bd230 con 0x5588e7809f50 2024-05-08T06:50:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.160+0000 7f54f5600700 10 client.15573 handle_command_reply: tid=0 2024-05-08T06:50:53.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.160+0000 7f551c84db80 1 client.15573 shutdown 2024-05-08T06:50:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 -- 172.21.15.70:0/266521022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0ee0 msgr2=0x5588e77f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0ee0 0x5588e77f9c60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f54f8009990 tx=0x7f54f800b790 comp rx=0 tx=0).stop 2024-05-08T06:50:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 -- 172.21.15.70:0/266521022 shutdown_connections 2024-05-08T06:50:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588e7809f50 0x5588e780c340 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f5f50 0x5588e77fa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e77fc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 --2- 172.21.15.70:0/266521022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f0ee0 0x5588e77f9c60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 -- 172.21.15.70:0/266521022 >> 172.21.15.70:0/266521022 conn(0x5588e771ecf0 msgr2=0x5588e77e58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f54f5600700 0 client.15573 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 -- 172.21.15.70:0/266521022 shutdown_connections 2024-05-08T06:50:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 1 -- 172.21.15.70:0/266521022 wait complete. 2024-05-08T06:50:53.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.161+0000 7f551c84db80 20 client.15573 trim_cache size 0 max 16384 2024-05-08T06:50:53.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.183+0000 7f551c84db80 1 Processor -- start 2024-05-08T06:50:53.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.183+0000 7f551c84db80 1 -- start start 2024-05-08T06:50:53.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.183+0000 7f551c84db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e77fb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.183+0000 7f551c84db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e77fb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.183+0000 7f551c84db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e77fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.183+0000 7f551c84db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1b3e10 con 0x5588e77f5f50 2024-05-08T06:50:53.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.183+0000 7f551c84db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1b16a0 con 0x5588e77f0ee0 2024-05-08T06:50:53.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.183+0000 7f551c84db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1af4f0 con 0x5588e77f0520 2024-05-08T06:50:53.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e77fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e77fbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60106/0 (socket says 172.21.15.70:60106) 2024-05-08T06:50:53.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550b400700 1 -- 172.21.15.70:0/357400576 learned_addr learned my addr 172.21.15.70:0/357400576 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550b400700 1 --2- 172.21.15.70:0/357400576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e77fb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550a000700 1 --2- 172.21.15.70:0/357400576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e77fb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550b400700 1 -- 172.21.15.70:0/357400576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 msgr2=0x5588e77fb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550b400700 1 --2- 172.21.15.70:0/357400576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e77fb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550b400700 1 -- 172.21.15.70:0/357400576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 msgr2=0x5588e77fb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550b400700 1 --2- 172.21.15.70:0/357400576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e77fb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.184+0000 7f550b400700 1 -- 172.21.15.70:0/357400576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588e77e7a10 con 0x5588e77f5f50 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.185+0000 7f550b400700 1 --2- 172.21.15.70:0/357400576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e77fbd90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5504005d90 tx=0x7f5504005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c04b70b23094139 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.185+0000 7f54f7e00700 1 -- 172.21.15.70:0/357400576 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504022030 con 0x5588e77f5f50 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.185+0000 7f54f7e00700 1 -- 172.21.15.70:0/357400576 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5504013e40 con 0x5588e77f5f50 2024-05-08T06:50:53.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.185+0000 7f54f7e00700 1 -- 172.21.15.70:0/357400576 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504026b70 con 0x5588e77f5f50 2024-05-08T06:50:53.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 -- 172.21.15.70:0/357400576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 msgr2=0x5588e77fbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 --2- 172.21.15.70:0/357400576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e77fbd90 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5504005d90 tx=0x7f5504005d20 comp rx=0 tx=0).stop 2024-05-08T06:50:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 -- 172.21.15.70:0/357400576 shutdown_connections 2024-05-08T06:50:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 --2- 172.21.15.70:0/357400576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e77fbd90 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 --2- 172.21.15.70:0/357400576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e77fb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 --2- 172.21.15.70:0/357400576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e77fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 -- 172.21.15.70:0/357400576 >> 172.21.15.70:0/357400576 conn(0x5588e771ecf0 msgr2=0x5588e77efda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 -- 172.21.15.70:0/357400576 shutdown_connections 2024-05-08T06:50:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 -- 172.21.15.70:0/357400576 wait complete. 2024-05-08T06:50:53.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.186+0000 7f551c84db80 1 -- start start 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.187+0000 7f551c84db80 1 Processor -- start 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.187+0000 7f551c84db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e780f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.187+0000 7f551c84db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e780f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.187+0000 7f551c84db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e780b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.187+0000 7f551c84db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1afb60 con 0x5588e77f5f50 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.187+0000 7f551c84db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1b0fd0 con 0x5588e77f0ee0 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.187+0000 7f551c84db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1b0230 con 0x5588e77f0520 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.187+0000 7f551c84db80 10 client.0 _ll_register_callbacks cb 0x5588e76e9e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.187+0000 7f550b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e780b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e780b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60112/0 (socket says 172.21.15.70:60112) 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550b400700 1 -- 172.21.15.70:0/1723776431 learned_addr learned my addr 172.21.15.70:0/1723776431 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550a000700 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e780f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550b400700 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e780f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550b400700 1 -- 172.21.15.70:0/1723776431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 msgr2=0x5588e780f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550b400700 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e780f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550b400700 1 -- 172.21.15.70:0/1723776431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 msgr2=0x5588e780f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:50:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550b400700 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e780f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550b400700 1 -- 172.21.15.70:0/1723776431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588e780bf30 con 0x5588e77f5f50 2024-05-08T06:50:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f550b400700 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e780b6f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5504005950 tx=0x7f5504026950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70846d424a70675 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:50:53.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.188+0000 7f54f5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:50:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.189+0000 7f54f5600700 1 -- 172.21.15.70:0/1723776431 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5504022040 con 0x5588e77f5f50 2024-05-08T06:50:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.189+0000 7f54f5600700 1 -- 172.21.15.70:0/1723776431 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f550401c8d0 con 0x5588e77f5f50 2024-05-08T06:50:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.189+0000 7f551c84db80 1 -- 172.21.15.70:0/1723776431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588e7750590 con 0x5588e77f5f50 2024-05-08T06:50:53.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.189+0000 7f54f5600700 1 -- 172.21.15.70:0/1723776431 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f550403b050 con 0x5588e77f5f50 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.189+0000 7f551c84db80 10 client.15579 fetch_fsmap learned FSMap version 28 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.189+0000 7f551c84db80 1 -- 172.21.15.70:0/1723776431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5588e787d930 con 0x5588e77f5f50 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.190+0000 7f54f5600700 1 -- 172.21.15.70:0/1723776431 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5588e7750590 con 0x5588e77f5f50 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.190+0000 7f54f5600700 1 -- 172.21.15.70:0/1723776431 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f550400f040 con 0x5588e77f5f50 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.190+0000 7f551c84db80 10 client.15579 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.190+0000 7f551c84db80 10 client.15579 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.190+0000 7f551c84db80 20 client.15579 populate_metadata read hostname 'smithi070' 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.190+0000 7f551c84db80 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588e787def0 0x5588e7880310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.190+0000 7f551c84db80 4 client.15579 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.05, "await_for": 42.0}] 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.190+0000 7f551c84db80 1 -- 172.21.15.70:0/1723776431 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.05, "await_for": 42.0}) -- 0x5588e774a630 con 0x5588e787def0 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.190+0000 7f550a000700 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588e787def0 0x5588e7880310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.191+0000 7f550a000700 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588e787def0 0x5588e7880310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181279b769a06fe3 server_cookie=3032868ec976c713 in_seq=0 out_seq=0 2024-05-08T06:50:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:53.191+0000 7f54f5600700 10 client.15579 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:53 smithi172 ceph-mon[33377]: pgmap v133: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 203 KiB/s wr, 50 op/s 2024-05-08T06:50:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:53 smithi194 ceph-mon[33679]: pgmap v133: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 203 KiB/s wr, 50 op/s 2024-05-08T06:50:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:53 smithi070 ceph-mon[29591]: pgmap v133: 129 pgs: 129 active+clean; 172 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 203 KiB/s wr, 50 op/s 2024-05-08T06:50:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:55 smithi172 ceph-mon[33377]: pgmap v134: 129 pgs: 129 active+clean; 173 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 386 KiB/s wr, 79 op/s 2024-05-08T06:50:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:55 smithi194 ceph-mon[33679]: pgmap v134: 129 pgs: 129 active+clean; 173 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 386 KiB/s wr, 79 op/s 2024-05-08T06:50:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:55 smithi070 ceph-mon[29591]: pgmap v134: 129 pgs: 129 active+clean; 173 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 386 KiB/s wr, 79 op/s 2024-05-08T06:50:58.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:57 smithi070 ceph-mon[29591]: pgmap v135: 129 pgs: 129 active+clean; 173 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 386 KiB/s wr, 76 op/s 2024-05-08T06:50:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:57 smithi194 ceph-mon[33679]: pgmap v135: 129 pgs: 129 active+clean; 173 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 386 KiB/s wr, 76 op/s 2024-05-08T06:50:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:57 smithi172 ceph-mon[33377]: pgmap v135: 129 pgs: 129 active+clean; 173 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 386 KiB/s wr, 76 op/s 2024-05-08T06:50:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.641+0000 7f54f5600700 1 -- 172.21.15.70:0/1723776431 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5588e774a630 con 0x5588e787def0 2024-05-08T06:50:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.641+0000 7f54f5600700 10 client.15579 handle_command_reply: tid=0 2024-05-08T06:50:58.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.641+0000 7f551c84db80 1 client.15579 shutdown 2024-05-08T06:50:58.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.641+0000 7f551c84db80 1 -- 172.21.15.70:0/1723776431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 msgr2=0x5588e780b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:58.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.641+0000 7f551c84db80 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e780b6f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5504005950 tx=0x7f5504026950 comp rx=0 tx=0).stop 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.642+0000 7f551c84db80 1 -- 172.21.15.70:0/1723776431 shutdown_connections 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.642+0000 7f551c84db80 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588e787def0 0x5588e7880310 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.642+0000 7f551c84db80 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588e77f5f50 0x5588e780b6f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.642+0000 7f551c84db80 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588e77f0520 0x5588e780f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.642+0000 7f54f5600700 0 client.15579 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.642+0000 7f551c84db80 1 --2- 172.21.15.70:0/1723776431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588e77f0ee0 0x5588e780f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.642+0000 7f551c84db80 1 -- 172.21.15.70:0/1723776431 >> 172.21.15.70:0/1723776431 conn(0x5588e771ecf0 msgr2=0x5588e77e5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.642+0000 7f551c84db80 1 -- 172.21.15.70:0/1723776431 shutdown_connections 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.642+0000 7f551c84db80 1 -- 172.21.15.70:0/1723776431 wait complete. 2024-05-08T06:50:58.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.643+0000 7f551c84db80 20 client.15579 trim_cache size 0 max 16384 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 14, 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "303d7276": { 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 14, 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:50:58.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 81.0, 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:50:58.644 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:50:58.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.644+0000 7f5511e00700 1 -- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54f00b2aa0 msgr2=0x7f54f00b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.644+0000 7f5511e00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54f00b2aa0 0x7f54f00b4f60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54fc007df0 tx=0x7f54fc007c50 comp rx=0 tx=0).stop 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.644+0000 7f5511e00700 1 -- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 msgr2=0x7f550c102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.644+0000 7f5511e00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 0x7f550c102450 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f54fc007e20 tx=0x7f54fc00a340 comp rx=0 tx=0).stop 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.644+0000 7f5511e00700 1 -- 172.21.15.70:0/586428069 shutdown_connections 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.644+0000 7f5511e00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54f00b2aa0 0x7f54f00b4f60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.645+0000 7f5511e00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f550c109570 0x7f550c102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.645+0000 7f5511e00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f550c06bc10 0x7f550c102450 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.645+0000 7f5511e00700 1 --2- 172.21.15.70:0/586428069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f550c06c5d0 0x7f550c102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.645+0000 7f5511e00700 1 -- 172.21.15.70:0/586428069 >> 172.21.15.70:0/586428069 conn(0x7f550c0793c0 msgr2=0x7f550c100e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.645+0000 7f5511e00700 1 -- 172.21.15.70:0/586428069 shutdown_connections 2024-05-08T06:50:58.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:50:58.645+0000 7f5511e00700 1 -- 172.21.15.70:0/586428069 wait complete. 2024-05-08T06:50:59.631 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '303d7276', quiesce took 14.1 seconds. Will release after: 21.05 2024-05-08T06:51:00.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:50:59 smithi070 ceph-mon[29591]: pgmap v136: 129 pgs: 129 active+clean; 175 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 539 KiB/s wr, 95 op/s 2024-05-08T06:51:00.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:50:59 smithi194 ceph-mon[33679]: pgmap v136: 129 pgs: 129 active+clean; 175 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 539 KiB/s wr, 95 op/s 2024-05-08T06:51:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:50:59 smithi172 ceph-mon[33377]: pgmap v136: 129 pgs: 129 active+clean; 175 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 539 KiB/s wr, 95 op/s 2024-05-08T06:51:02.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:01 smithi194 ceph-mon[33679]: pgmap v137: 129 pgs: 129 active+clean; 175 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 336 KiB/s wr, 47 op/s 2024-05-08T06:51:02.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:01 smithi070 ceph-mon[29591]: pgmap v137: 129 pgs: 129 active+clean; 175 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 336 KiB/s wr, 47 op/s 2024-05-08T06:51:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:01 smithi172 ceph-mon[33377]: pgmap v137: 129 pgs: 129 active+clean; 175 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 336 KiB/s wr, 47 op/s 2024-05-08T06:51:04.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:03 smithi194 ceph-mon[33679]: pgmap v138: 129 pgs: 129 active+clean; 175 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 336 KiB/s wr, 47 op/s 2024-05-08T06:51:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:03 smithi070 ceph-mon[29591]: pgmap v138: 129 pgs: 129 active+clean; 175 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 336 KiB/s wr, 47 op/s 2024-05-08T06:51:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:03 smithi172 ceph-mon[33377]: pgmap v138: 129 pgs: 129 active+clean; 175 MiB data, 853 MiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 336 KiB/s wr, 47 op/s 2024-05-08T06:51:06.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:05 smithi194 ceph-mon[33679]: pgmap v139: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 362 KiB/s wr, 65 op/s 2024-05-08T06:51:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:05 smithi070 ceph-mon[29591]: pgmap v139: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 362 KiB/s wr, 65 op/s 2024-05-08T06:51:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:05 smithi172 ceph-mon[33377]: pgmap v139: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 362 KiB/s wr, 65 op/s 2024-05-08T06:51:08.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:07 smithi194 ceph-mon[33679]: pgmap v140: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 178 KiB/s wr, 36 op/s 2024-05-08T06:51:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:07 smithi070 ceph-mon[29591]: pgmap v140: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 178 KiB/s wr, 36 op/s 2024-05-08T06:51:08.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:07 smithi172 ceph-mon[33377]: pgmap v140: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 178 KiB/s wr, 36 op/s 2024-05-08T06:51:10.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:09 smithi172 ceph-mon[33377]: pgmap v141: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 181 KiB/s wr, 40 op/s 2024-05-08T06:51:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:09 smithi194 ceph-mon[33679]: pgmap v141: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 181 KiB/s wr, 40 op/s 2024-05-08T06:51:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:09 smithi070 ceph-mon[29591]: pgmap v141: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 181 KiB/s wr, 40 op/s 2024-05-08T06:51:12.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:11 smithi194 ceph-mon[33679]: pgmap v142: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-05-08T06:51:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:11 smithi070 ceph-mon[29591]: pgmap v142: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-05-08T06:51:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:11 smithi172 ceph-mon[33377]: pgmap v142: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-05-08T06:51:14.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:13 smithi194 ceph-mon[33679]: pgmap v143: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-05-08T06:51:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:13 smithi070 ceph-mon[29591]: pgmap v143: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-05-08T06:51:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:13 smithi172 ceph-mon[33377]: pgmap v143: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 28 KiB/s wr, 21 op/s 2024-05-08T06:51:16.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:15 smithi194 ceph-mon[33679]: pgmap v144: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 31 KiB/s wr, 24 op/s 2024-05-08T06:51:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:15 smithi070 ceph-mon[29591]: pgmap v144: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 31 KiB/s wr, 24 op/s 2024-05-08T06:51:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:15 smithi172 ceph-mon[33377]: pgmap v144: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 31 KiB/s wr, 24 op/s 2024-05-08T06:51:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:17 smithi194 ceph-mon[33679]: pgmap v145: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-05-08T06:51:18.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:17 smithi070 ceph-mon[29591]: pgmap v145: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-05-08T06:51:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:17 smithi172 ceph-mon[33377]: pgmap v145: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.8 KiB/s wr, 5 op/s 2024-05-08T06:51:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:20 smithi194 ceph-mon[33679]: pgmap v146: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2024-05-08T06:51:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:20 smithi070 ceph-mon[29591]: pgmap v146: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2024-05-08T06:51:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:20 smithi172 ceph-mon[33377]: pgmap v146: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 KiB/s wr, 8 op/s 2024-05-08T06:51:20.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:51:21.140 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:51:22.260 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:22 smithi070 ceph-mon[29591]: pgmap v147: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T06:51:22.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:22 smithi194 ceph-mon[33679]: pgmap v147: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T06:51:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:22 smithi172 ceph-mon[33377]: pgmap v147: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T06:51:23.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.714+0000 7fe04e000700 1 -- 172.21.15.70:0/1276848299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048108850 msgr2=0x7fe0481103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:23.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.714+0000 7fe04e000700 1 --2- 172.21.15.70:0/1276848299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048108850 0x7fe0481103d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe04000b0d0 tx=0x7fe04000b3e0 comp rx=0 tx=0).stop 2024-05-08T06:51:23.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.714+0000 7fe04e000700 1 -- 172.21.15.70:0/1276848299 shutdown_connections 2024-05-08T06:51:23.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.714+0000 7fe04e000700 1 --2- 172.21.15.70:0/1276848299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048108850 0x7fe0481103d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.714+0000 7fe04e000700 1 --2- 172.21.15.70:0/1276848299 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe048103750 0x7fe048103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.714+0000 7fe04e000700 1 --2- 172.21.15.70:0/1276848299 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe048104100 0x7fe048108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.714+0000 7fe04e000700 1 -- 172.21.15.70:0/1276848299 >> 172.21.15.70:0/1276848299 conn(0x7fe04807a600 msgr2=0x7fe04807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:51:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.715+0000 7fe04e000700 1 -- 172.21.15.70:0/1276848299 shutdown_connections 2024-05-08T06:51:23.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.715+0000 7fe04e000700 1 -- 172.21.15.70:0/1276848299 wait complete. 2024-05-08T06:51:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.715+0000 7fe04e000700 1 Processor -- start 2024-05-08T06:51:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.716+0000 7fe04e000700 1 -- start start 2024-05-08T06:51:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.716+0000 7fe04e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe048103750 0x7fe04819f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.716+0000 7fe04e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048104100 0x7fe04819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.716+0000 7fe04e000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe048108850 0x7fe0481997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:23.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.716+0000 7fe04e000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe048113520 con 0x7fe048104100 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.716+0000 7fe04e000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481133a0 con 0x7fe048103750 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.716+0000 7fe04e000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0481136a0 con 0x7fe048108850 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe046a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048104100 0x7fe04819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe046a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048104100 0x7fe04819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60242/0 (socket says 172.21.15.70:60242) 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe046a00700 1 -- 172.21.15.70:0/200272517 learned_addr learned my addr 172.21.15.70:0/200272517 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe047400700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe048103750 0x7fe04819f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe047e00700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe048108850 0x7fe0481997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe046a00700 1 -- 172.21.15.70:0/200272517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe048108850 msgr2=0x7fe0481997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe046a00700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe048108850 0x7fe0481997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe046a00700 1 -- 172.21.15.70:0/200272517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe048103750 msgr2=0x7fe04819f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe046a00700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe048103750 0x7fe04819f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:23.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe046a00700 1 -- 172.21.15.70:0/200272517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe04819a080 con 0x7fe048104100 2024-05-08T06:51:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.717+0000 7fe046a00700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048104100 0x7fe04819fbc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c9b0 tx=0x7fe03400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:51:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.718+0000 7fe03fe00700 1 -- 172.21.15.70:0/200272517 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034007b00 con 0x7fe048104100 2024-05-08T06:51:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.718+0000 7fe03fe00700 1 -- 172.21.15.70:0/200272517 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe034007ca0 con 0x7fe048104100 2024-05-08T06:51:23.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.718+0000 7fe03fe00700 1 -- 172.21.15.70:0/200272517 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034018660 con 0x7fe048104100 2024-05-08T06:51:23.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.718+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe04819a370 con 0x7fe048104100 2024-05-08T06:51:23.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.718+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0480758a0 con 0x7fe048104100 2024-05-08T06:51:23.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.719+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe048104be0 con 0x7fe048104100 2024-05-08T06:51:23.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.722+0000 7fe03fe00700 1 -- 172.21.15.70:0/200272517 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe03400f450 con 0x7fe048104100 2024-05-08T06:51:23.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.725+0000 7fe03fe00700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe02c0b29f0 0x7fe02c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:23.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.725+0000 7fe03fe00700 1 -- 172.21.15.70:0/200272517 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fe0340e2de0 con 0x7fe048104100 2024-05-08T06:51:23.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.725+0000 7fe047400700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe02c0b29f0 0x7fe02c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.726+0000 7fe03fe00700 1 -- 172.21.15.70:0/200272517 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe034014030 con 0x7fe048104100 2024-05-08T06:51:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:23.726+0000 7fe047400700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe02c0b29f0 0x7fe02c0b4eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe038005fd0 tx=0x7fe03800a560 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:51:24.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.011+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe04819a5a0 con 0x7fe048104100 2024-05-08T06:51:24.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.019+0000 7fe03fe00700 1 -- 172.21.15.70:0/200272517 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fe0340aa420 con 0x7fe048104100 2024-05-08T06:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:51:24.020 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe02c0b29f0 msgr2=0x7fe02c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe02c0b29f0 0x7fe02c0b4eb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe038005fd0 tx=0x7fe03800a560 comp rx=0 tx=0).stop 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048104100 msgr2=0x7fe04819fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048104100 0x7fe04819fbc0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c9b0 tx=0x7fe03400cd70 comp rx=0 tx=0).stop 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 shutdown_connections 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe02c0b29f0 0x7fe02c0b4eb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe048108850 0x7fe0481997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe048103750 0x7fe04819f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 --2- 172.21.15.70:0/200272517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe048104100 0x7fe04819fbc0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 >> 172.21.15.70:0/200272517 conn(0x7fe04807a600 msgr2=0x7fe048101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:51:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 shutdown_connections 2024-05-08T06:51:24.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:24.023+0000 7fe04e000700 1 -- 172.21.15.70:0/200272517 wait complete. 2024-05-08T06:51:24.024 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:51:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:24 smithi070 ceph-mon[29591]: pgmap v148: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T06:51:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:24 smithi172 ceph-mon[33377]: pgmap v148: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T06:51:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:24 smithi194 ceph-mon[33679]: pgmap v148: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T06:51:25.003 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 303d7276 --release --await' 2024-05-08T06:51:25.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 303d7276 --release --await 2024-05-08T06:51:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:25 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/200272517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:51:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:25 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/200272517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:51:25.446 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:51:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:25 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/200272517' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:51:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:26 smithi070 ceph-mon[29591]: pgmap v149: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-05-08T06:51:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:26 smithi172 ceph-mon[33377]: pgmap v149: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-05-08T06:51:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:26 smithi194 ceph-mon[33679]: pgmap v149: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-05-08T06:51:27.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.903+0000 7f5895200700 1 -- 172.21.15.70:0/1854081738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890103620 msgr2=0x7f5890103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.903+0000 7f5895200700 1 --2- 172.21.15.70:0/1854081738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890103620 0x7f5890103a00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f58800099c0 tx=0x7f5880009cd0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.903+0000 7f5895200700 1 -- 172.21.15.70:0/1854081738 shutdown_connections 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.903+0000 7f5895200700 1 --2- 172.21.15.70:0/1854081738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5890108700 0x7f58901102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.903+0000 7f5895200700 1 --2- 172.21.15.70:0/1854081738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890103620 0x7f5890103a00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.903+0000 7f5895200700 1 --2- 172.21.15.70:0/1854081738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5890103fd0 0x7f5890108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.903+0000 7f5895200700 1 -- 172.21.15.70:0/1854081738 >> 172.21.15.70:0/1854081738 conn(0x7f58900feeb0 msgr2=0x7f58901012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.903+0000 7f5895200700 1 -- 172.21.15.70:0/1854081738 shutdown_connections 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.903+0000 7f5895200700 1 -- 172.21.15.70:0/1854081738 wait complete. 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.904+0000 7f5895200700 1 Processor -- start 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.904+0000 7f5895200700 1 -- start start 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f5895200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5890103620 0x7f58901a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f5895200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5890103fd0 0x7f58901a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f5895200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890108700 0x7f589019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f5895200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58901134c0 con 0x7f5890108700 2024-05-08T06:51:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f5895200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5890113340 con 0x7f5890103620 2024-05-08T06:51:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f5895200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5890113640 con 0x7f5890103fd0 2024-05-08T06:51:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f588fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890108700 0x7f589019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f588fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890108700 0x7f589019ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47784/0 (socket says 172.21.15.70:47784) 2024-05-08T06:51:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f588fe00700 1 -- 172.21.15.70:0/514087348 learned_addr learned my addr 172.21.15.70:0/514087348 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:51:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f588f400700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5890103620 0x7f58901a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.905+0000 7f5886a00700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5890103fd0 0x7f58901a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588fe00700 1 -- 172.21.15.70:0/514087348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5890103fd0 msgr2=0x7f58901a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588fe00700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5890103fd0 0x7f58901a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588fe00700 1 -- 172.21.15.70:0/514087348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5890103620 msgr2=0x7f58901a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588fe00700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5890103620 0x7f58901a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588fe00700 1 -- 172.21.15.70:0/514087348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589019c1a0 con 0x7f5890108700 2024-05-08T06:51:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f5886a00700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5890103fd0 0x7f58901a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:51:27.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588f400700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5890103620 0x7f58901a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:51:27.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588fe00700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890108700 0x7f589019ba40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f588800ef30 tx=0x7f588800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:51:27.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588cc00700 1 -- 172.21.15.70:0/514087348 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58880092e0 con 0x7f5890108700 2024-05-08T06:51:27.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588cc00700 1 -- 172.21.15.70:0/514087348 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5888004bb0 con 0x7f5890108700 2024-05-08T06:51:27.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f5895200700 1 -- 172.21.15.70:0/514087348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589019c430 con 0x7f5890108700 2024-05-08T06:51:27.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.906+0000 7f588cc00700 1 -- 172.21.15.70:0/514087348 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888004080 con 0x7f5890108700 2024-05-08T06:51:27.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.907+0000 7f5895200700 1 -- 172.21.15.70:0/514087348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58901a8750 con 0x7f5890108700 2024-05-08T06:51:27.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.910+0000 7f588cc00700 1 -- 172.21.15.70:0/514087348 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f588801b030 con 0x7f5890108700 2024-05-08T06:51:27.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.911+0000 7f58a1217b80 1 Processor -- start 2024-05-08T06:51:27.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.911+0000 7f58a1217b80 1 -- start start 2024-05-08T06:51:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.911+0000 7f588cc00700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58740b2a70 0x7f58740b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 0x558d1b5b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5b5880 0x558d1b5af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f588cc00700 1 -- 172.21.15.70:0/514087348 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f58880e2560 con 0x7f5890108700 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5afab0 0x558d1b5aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f58a1217b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558d1b501b20 con 0x558d1b5b5880 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f58a1217b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558d1b49f860 con 0x558d1b5afab0 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f58a1217b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558d1b4fdae0 con 0x558d1b5b4f60 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f5886a00700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58740b2a70 0x7f58740b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f5886a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5b5880 0x558d1b5af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f5886a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5b5880 0x558d1b5af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47790/0 (socket says 172.21.15.70:47790) 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f5886a00700 1 -- 172.21.15.70:0/1129742845 learned_addr learned my addr 172.21.15.70:0/1129742845 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f588f400700 1 --2- 172.21.15.70:0/1129742845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 0x558d1b5b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.912+0000 7f588fe00700 1 --2- 172.21.15.70:0/1129742845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5afab0 0x558d1b5aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.913+0000 7f5886a00700 1 -- 172.21.15.70:0/1129742845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 msgr2=0x558d1b5b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:51:27.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.913+0000 7f5886a00700 1 --2- 172.21.15.70:0/1129742845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 0x558d1b5b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.913+0000 7f5886a00700 1 -- 172.21.15.70:0/1129742845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5afab0 msgr2=0x558d1b5aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.913+0000 7f5886a00700 1 --2- 172.21.15.70:0/1129742845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5afab0 0x558d1b5aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.913+0000 7f5886a00700 1 -- 172.21.15.70:0/1129742845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1b44e9d0 con 0x558d1b5b5880 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.913+0000 7f5886a00700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58740b2a70 0x7f58740b4f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5878009730 tx=0x7f5878009c00 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.913+0000 7f5886a00700 1 --2- 172.21.15.70:0/1129742845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5b5880 0x558d1b5af490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f58780106b0 tx=0x7f587801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210c4b30d80832b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.914+0000 7f5884c00700 1 -- 172.21.15.70:0/1129742845 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878024070 con 0x558d1b5b5880 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.914+0000 7f5884c00700 1 -- 172.21.15.70:0/1129742845 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5878010e30 con 0x558d1b5b5880 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.914+0000 7f5884c00700 1 -- 172.21.15.70:0/1129742845 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f587801e610 con 0x558d1b5b5880 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.914+0000 7f58a1217b80 1 -- 172.21.15.70:0/1129742845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5b5880 msgr2=0x558d1b5af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:27.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.914+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1129742845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5b5880 0x558d1b5af490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f58780106b0 tx=0x7f587801c000 comp rx=0 tx=0).stop 2024-05-08T06:51:27.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.915+0000 7f58a1217b80 1 -- 172.21.15.70:0/1129742845 shutdown_connections 2024-05-08T06:51:27.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.915+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1129742845 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5afab0 0x558d1b5aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.915+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1129742845 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 0x558d1b5b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.915+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1129742845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5b5880 0x558d1b5af490 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.915+0000 7f58a1217b80 1 -- 172.21.15.70:0/1129742845 >> 172.21.15.70:0/1129742845 conn(0x558d1b4ddc60 msgr2=0x558d1b5a9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:51:27.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.915+0000 7f58a1217b80 1 -- 172.21.15.70:0/1129742845 shutdown_connections 2024-05-08T06:51:27.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.915+0000 7f58a1217b80 1 -- 172.21.15.70:0/1129742845 wait complete. 2024-05-08T06:51:27.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.915+0000 7f58a1217b80 1 -- start start 2024-05-08T06:51:27.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.916+0000 7f58a1217b80 1 Processor -- start 2024-05-08T06:51:27.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.916+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5bb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.916+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 0x558d1b5b8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.916+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b5b8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.916+0000 7f58a1217b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558d1b5bc340 con 0x558d1b5afab0 2024-05-08T06:51:27.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.916+0000 7f58a1217b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558d1b467c20 con 0x558d1b5b4f60 2024-05-08T06:51:27.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.916+0000 7f58a1217b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558d1b5bc4c0 con 0x558d1b5b5880 2024-05-08T06:51:27.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.916+0000 7f58a1217b80 10 client.0 _ll_register_callbacks cb 0x558d1b4a8d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:51:27.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5bb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5bb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47794/0 (socket says 172.21.15.70:47794) 2024-05-08T06:51:27.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588f400700 1 -- 172.21.15.70:0/3557037973 learned_addr learned my addr 172.21.15.70:0/3557037973 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:51:27.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f5886a00700 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 0x558d1b5b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588fe00700 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b5b8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588f400700 1 -- 172.21.15.70:0/3557037973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 msgr2=0x558d1b5b8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:51:27.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588f400700 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b5b8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588f400700 1 -- 172.21.15.70:0/3557037973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 msgr2=0x558d1b5b8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:51:27.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588f400700 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 0x558d1b5b8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588f400700 1 -- 172.21.15.70:0/3557037973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d1b4c7520 con 0x558d1b5afab0 2024-05-08T06:51:27.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f588fe00700 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b5b8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:51:27.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.917+0000 7f5886a00700 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 0x558d1b5b8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:51:27.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.918+0000 7f588f400700 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5bb590 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f58800098e0 tx=0x7f58800057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc40838c0e2083c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:51:27.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.918+0000 7f587d600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:51:27.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.918+0000 7f587d600700 1 -- 172.21.15.70:0/3557037973 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880003bd0 con 0x558d1b5afab0 2024-05-08T06:51:27.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.918+0000 7f58a1217b80 1 -- 172.21.15.70:0/3557037973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5878010e30 con 0x558d1b5afab0 2024-05-08T06:51:27.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.918+0000 7f587d600700 1 -- 172.21.15.70:0/3557037973 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f5880003d70 con 0x558d1b5afab0 2024-05-08T06:51:27.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.918+0000 7f587d600700 1 -- 172.21.15.70:0/3557037973 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5880032050 con 0x558d1b5afab0 2024-05-08T06:51:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.918+0000 7f58a1217b80 10 client.15597 fetch_fsmap learned FSMap version 28 2024-05-08T06:51:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.918+0000 7f58a1217b80 1 -- 172.21.15.70:0/3557037973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d1b5c6bc0 con 0x558d1b5afab0 2024-05-08T06:51:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.918+0000 7f587d600700 1 -- 172.21.15.70:0/3557037973 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5878010e30 con 0x558d1b5afab0 2024-05-08T06:51:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.919+0000 7f587d600700 1 -- 172.21.15.70:0/3557037973 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f5880024600 con 0x558d1b5afab0 2024-05-08T06:51:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.919+0000 7f58a1217b80 10 client.15597 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:51:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.919+0000 7f58a1217b80 10 client.15597 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:51:27.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.919+0000 7f58a1217b80 20 client.15597 populate_metadata read hostname 'smithi070' 2024-05-08T06:51:27.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.919+0000 7f58a1217b80 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558d1b5c9250 0x558d1b5cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.919+0000 7f58a1217b80 4 client.15597 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:51:27.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.919+0000 7f58a1217b80 1 -- 172.21.15.70:0/3557037973 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d1b57c1a0 con 0x558d1b5c9250 2024-05-08T06:51:27.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.920+0000 7f5886a00700 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558d1b5c9250 0x558d1b5cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.920+0000 7f5886a00700 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558d1b5c9250 0x558d1b5cb6c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af4c2389a234633f server_cookie=6297de4b36a8500e in_seq=0 out_seq=0 2024-05-08T06:51:27.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.920+0000 7f587d600700 10 client.15597 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:51:27.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.922+0000 7f587d600700 1 -- 172.21.15.70:0/3557037973 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558d1b57c1a0 con 0x558d1b5c9250 2024-05-08T06:51:27.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.922+0000 7f587d600700 10 client.15597 handle_command_reply: tid=0 2024-05-08T06:51:27.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 client.15597 shutdown 2024-05-08T06:51:27.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 -- 172.21.15.70:0/3557037973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 msgr2=0x558d1b5bb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:27.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5bb590 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f58800098e0 tx=0x7f58800057c0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 -- 172.21.15.70:0/3557037973 shutdown_connections 2024-05-08T06:51:27.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558d1b5c9250 0x558d1b5cb6c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b5b8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5bb590 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 --2- 172.21.15.70:0/3557037973 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 0x558d1b5b8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 -- 172.21.15.70:0/3557037973 >> 172.21.15.70:0/3557037973 conn(0x558d1b4ddc60 msgr2=0x558d1b5ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:51:27.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f587d600700 0 client.15597 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:51:27.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 -- 172.21.15.70:0/3557037973 shutdown_connections 2024-05-08T06:51:27.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 1 -- 172.21.15.70:0/3557037973 wait complete. 2024-05-08T06:51:27.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.923+0000 7f58a1217b80 20 client.15597 trim_cache size 0 max 16384 2024-05-08T06:51:27.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.945+0000 7f58a1217b80 1 Processor -- start 2024-05-08T06:51:27.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.945+0000 7f58a1217b80 1 -- start start 2024-05-08T06:51:27.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.945+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.945+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 0x558d1b5cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.945+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b5880 0x558d1b5b7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.945+0000 7f58a1217b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58901b3d90 con 0x558d1b5afab0 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.945+0000 7f58a1217b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58901b1620 con 0x558d1b5b5880 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.945+0000 7f58a1217b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f58901af470 con 0x558d1b5b4f60 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f588f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f588f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47802/0 (socket says 172.21.15.70:47802) 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f588f400700 1 -- 172.21.15.70:0/295112058 learned_addr learned my addr 172.21.15.70:0/295112058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f588fe00700 1 --2- 172.21.15.70:0/295112058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b5880 0x558d1b5b7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f5886a00700 1 --2- 172.21.15.70:0/295112058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 0x558d1b5cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f588f400700 1 -- 172.21.15.70:0/295112058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 msgr2=0x558d1b5cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:51:27.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f588f400700 1 --2- 172.21.15.70:0/295112058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 0x558d1b5cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f588f400700 1 -- 172.21.15.70:0/295112058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b5880 msgr2=0x558d1b5b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:51:27.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f588f400700 1 --2- 172.21.15.70:0/295112058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b5880 0x558d1b5b7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.946+0000 7f588f400700 1 -- 172.21.15.70:0/295112058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1b5b6ec0 con 0x558d1b5afab0 2024-05-08T06:51:27.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.947+0000 7f588f400700 1 --2- 172.21.15.70:0/295112058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c5430 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5880005f50 tx=0x7f5880005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d691688c6eb0b9c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.947+0000 7f587fe00700 1 -- 172.21.15.70:0/295112058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588003a020 con 0x558d1b5afab0 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.947+0000 7f587fe00700 1 -- 172.21.15.70:0/295112058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5880029070 con 0x558d1b5afab0 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.947+0000 7f587fe00700 1 -- 172.21.15.70:0/295112058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588000b730 con 0x558d1b5afab0 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 -- 172.21.15.70:0/295112058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 msgr2=0x558d1b5c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 --2- 172.21.15.70:0/295112058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c5430 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5880005f50 tx=0x7f5880005c00 comp rx=0 tx=0).stop 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 -- 172.21.15.70:0/295112058 shutdown_connections 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 --2- 172.21.15.70:0/295112058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b5880 0x558d1b5b7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 --2- 172.21.15.70:0/295112058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c5430 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 --2- 172.21.15.70:0/295112058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b4f60 0x558d1b5cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 -- 172.21.15.70:0/295112058 >> 172.21.15.70:0/295112058 conn(0x558d1b4ddc60 msgr2=0x558d1b5b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:51:27.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 -- 172.21.15.70:0/295112058 shutdown_connections 2024-05-08T06:51:27.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 -- 172.21.15.70:0/295112058 wait complete. 2024-05-08T06:51:27.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.948+0000 7f58a1217b80 1 -- start start 2024-05-08T06:51:27.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f58a1217b80 1 Processor -- start 2024-05-08T06:51:27.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 0x558d1b62ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f58a1217b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b62f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f58a1217b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58901afae0 con 0x558d1b5afab0 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f58a1217b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58901b0f50 con 0x558d1b5b4f60 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f58a1217b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f58901b01b0 con 0x558d1b5b5880 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f58a1217b80 10 client.0 _ll_register_callbacks cb 0x558d1b4a8d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f588f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f588f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47814/0 (socket says 172.21.15.70:47814) 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.949+0000 7f588f400700 1 -- 172.21.15.70:0/1864620186 learned_addr learned my addr 172.21.15.70:0/1864620186 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f588fe00700 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b62f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f5886a00700 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 0x558d1b62ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f588f400700 1 -- 172.21.15.70:0/1864620186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 msgr2=0x558d1b62f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:51:27.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f588f400700 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b62f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f588f400700 1 -- 172.21.15.70:0/1864620186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 msgr2=0x558d1b62ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:51:27.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f588f400700 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 0x558d1b62ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:27.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f588f400700 1 -- 172.21.15.70:0/1864620186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d1b62f7a0 con 0x558d1b5afab0 2024-05-08T06:51:27.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f588fe00700 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b62f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:51:27.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f588f400700 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c1b10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5880024a20 tx=0x7f58800096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99a1554df7764bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:51:27.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f587d600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:51:27.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.950+0000 7f587d600700 1 -- 172.21.15.70:0/1864620186 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5880046060 con 0x558d1b5afab0 2024-05-08T06:51:27.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f587d600700 1 -- 172.21.15.70:0/1864620186 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7f58800039d0 con 0x558d1b5afab0 2024-05-08T06:51:27.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f58a1217b80 1 -- 172.21.15.70:0/1864620186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5880029070 con 0x558d1b5afab0 2024-05-08T06:51:27.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f587d600700 1 -- 172.21.15.70:0/1864620186 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f588004d050 con 0x558d1b5afab0 2024-05-08T06:51:27.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f58a1217b80 10 client.15603 fetch_fsmap learned FSMap version 28 2024-05-08T06:51:27.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f58a1217b80 1 -- 172.21.15.70:0/1864620186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d1b5c07b0 con 0x558d1b5afab0 2024-05-08T06:51:27.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f587d600700 1 -- 172.21.15.70:0/1864620186 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5880029070 con 0x558d1b5afab0 2024-05-08T06:51:27.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f587d600700 1 -- 172.21.15.70:0/1864620186 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f58800414f0 con 0x558d1b5afab0 2024-05-08T06:51:27.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f58a1217b80 10 client.15603 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:51:27.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f58a1217b80 10 client.15603 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:51:27.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f58a1217b80 20 client.15603 populate_metadata read hostname 'smithi070' 2024-05-08T06:51:27.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558d1b5c0e90 0x558d1b6403b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:51:27.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f58a1217b80 4 client.15603 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "303d7276", "release": true, "await": true}] 2024-05-08T06:51:27.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.951+0000 7f58a1217b80 1 -- 172.21.15.70:0/1864620186 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "303d7276", "release": true, "await": true}) -- 0x558d1b50f500 con 0x558d1b5c0e90 2024-05-08T06:51:27.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.952+0000 7f5886a00700 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558d1b5c0e90 0x558d1b6403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:51:27.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.953+0000 7f5886a00700 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558d1b5c0e90 0x558d1b6403b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe085b27351366a1 server_cookie=dffd62a868be3474 in_seq=0 out_seq=0 2024-05-08T06:51:27.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:27.953+0000 7f587d600700 10 client.15603 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:51:28.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:28 smithi070 ceph-mon[29591]: pgmap v150: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-05-08T06:51:28.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.315+0000 7f587d600700 1 -- 172.21.15.70:0/1864620186 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x558d1b50f500 con 0x558d1b5c0e90 2024-05-08T06:51:28.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.315+0000 7f587d600700 10 client.15603 handle_command_reply: tid=0 2024-05-08T06:51:28.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.315+0000 7f58a1217b80 1 client.15603 shutdown 2024-05-08T06:51:28.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.315+0000 7f58a1217b80 1 -- 172.21.15.70:0/1864620186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 msgr2=0x558d1b5c1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:28.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.315+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c1b10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5880024a20 tx=0x7f58800096f0 comp rx=0 tx=0).stop 2024-05-08T06:51:28.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.315+0000 7f58a1217b80 1 -- 172.21.15.70:0/1864620186 shutdown_connections 2024-05-08T06:51:28.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.315+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558d1b5c0e90 0x558d1b6403b0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:28.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.316+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558d1b5b5880 0x558d1b62f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:28.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.316+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558d1b5afab0 0x558d1b5c1b10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:28.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.316+0000 7f58a1217b80 1 --2- 172.21.15.70:0/1864620186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558d1b5b4f60 0x558d1b62ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:28.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.316+0000 7f58a1217b80 1 -- 172.21.15.70:0/1864620186 >> 172.21.15.70:0/1864620186 conn(0x558d1b4ddc60 msgr2=0x558d1b5b71e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:51:28.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.316+0000 7f587d600700 0 client.15603 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:51:28.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.316+0000 7f58a1217b80 1 -- 172.21.15.70:0/1864620186 shutdown_connections 2024-05-08T06:51:28.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.316+0000 7f58a1217b80 1 -- 172.21.15.70:0/1864620186 wait complete. 2024-05-08T06:51:28.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.317+0000 7f58a1217b80 20 client.15603 trim_cache size 0 max 16384 2024-05-08T06:51:28.319 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:51:28.319 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:51:28.319 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:51:28.320 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 16, 2024-05-08T06:51:28.320 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:51:28.320 INFO:teuthology.orchestra.run.smithi070.stdout: "303d7276": { 2024-05-08T06:51:28.320 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 16, 2024-05-08T06:51:28.320 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:51:28.320 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:51:28.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:51:28.321 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:51:28.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:51:28.321 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:51:28.321 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 81.0, 2024-05-08T06:51:28.321 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:51:28.321 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:51:28.321 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:51:28.322 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:51:28.322 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:51:28.322 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:51:28.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:51:28.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:51:28.322 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:51:28.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:51:28.323 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:51:28.323 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:51:28.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.318+0000 7f5895200700 1 -- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58740b2a70 msgr2=0x7f58740b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:28.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.318+0000 7f5895200700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58740b2a70 0x7f58740b4f30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5878009730 tx=0x7f5878009c00 comp rx=0 tx=0).stop 2024-05-08T06:51:28.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.318+0000 7f5895200700 1 -- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890108700 msgr2=0x7f589019ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:51:28.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.318+0000 7f5895200700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890108700 0x7f589019ba40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f588800ef30 tx=0x7f588800c450 comp rx=0 tx=0).stop 2024-05-08T06:51:28.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.319+0000 7f5895200700 1 -- 172.21.15.70:0/514087348 shutdown_connections 2024-05-08T06:51:28.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.319+0000 7f5895200700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58740b2a70 0x7f58740b4f30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:28.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.319+0000 7f5895200700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5890108700 0x7f589019ba40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:28.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.319+0000 7f5895200700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5890103620 0x7f58901a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:28.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.319+0000 7f5895200700 1 --2- 172.21.15.70:0/514087348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5890103fd0 0x7f58901a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:51:28.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.319+0000 7f5895200700 1 -- 172.21.15.70:0/514087348 >> 172.21.15.70:0/514087348 conn(0x7f58900feeb0 msgr2=0x7f58901011f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:51:28.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.319+0000 7f5895200700 1 -- 172.21.15.70:0/514087348 shutdown_connections 2024-05-08T06:51:28.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:51:28.320+0000 7f5895200700 1 -- 172.21.15.70:0/514087348 wait complete. 2024-05-08T06:51:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:28 smithi172 ceph-mon[33377]: pgmap v150: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-05-08T06:51:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:28 smithi194 ceph-mon[33679]: pgmap v150: 129 pgs: 129 active+clean; 175 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-05-08T06:51:29.246 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '303d7276', seconds elapsed: 43.8 2024-05-08T06:51:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:30 smithi070 ceph-mon[29591]: pgmap v151: 129 pgs: 129 active+clean; 176 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 KiB/s wr, 12 op/s 2024-05-08T06:51:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:30 smithi172 ceph-mon[33377]: pgmap v151: 129 pgs: 129 active+clean; 176 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 KiB/s wr, 12 op/s 2024-05-08T06:51:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:30 smithi194 ceph-mon[33679]: pgmap v151: 129 pgs: 129 active+clean; 176 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 28 KiB/s wr, 12 op/s 2024-05-08T06:51:32.312 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:32 smithi194 ceph-mon[33679]: pgmap v152: 129 pgs: 129 active+clean; 176 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-08T06:51:32.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:32 smithi070 ceph-mon[29591]: pgmap v152: 129 pgs: 129 active+clean; 176 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-08T06:51:32.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:32 smithi172 ceph-mon[33377]: pgmap v152: 129 pgs: 129 active+clean; 176 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-08T06:51:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:34 smithi070 ceph-mon[29591]: pgmap v153: 129 pgs: 129 active+clean; 176 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-08T06:51:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:34 smithi172 ceph-mon[33377]: pgmap v153: 129 pgs: 129 active+clean; 176 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-08T06:51:34.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:34 smithi194 ceph-mon[33679]: pgmap v153: 129 pgs: 129 active+clean; 176 MiB data, 854 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-08T06:51:36.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:36 smithi070 ceph-mon[29591]: pgmap v154: 129 pgs: 129 active+clean; 177 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 209 KiB/s wr, 48 op/s 2024-05-08T06:51:36.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:36 smithi172 ceph-mon[33377]: pgmap v154: 129 pgs: 129 active+clean; 177 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 209 KiB/s wr, 48 op/s 2024-05-08T06:51:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:36 smithi194 ceph-mon[33679]: pgmap v154: 129 pgs: 129 active+clean; 177 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 209 KiB/s wr, 48 op/s 2024-05-08T06:51:38.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:38 smithi070 ceph-mon[29591]: pgmap v155: 129 pgs: 129 active+clean; 177 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 209 KiB/s wr, 46 op/s 2024-05-08T06:51:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:38 smithi172 ceph-mon[33377]: pgmap v155: 129 pgs: 129 active+clean; 177 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 209 KiB/s wr, 46 op/s 2024-05-08T06:51:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:38 smithi194 ceph-mon[33679]: pgmap v155: 129 pgs: 129 active+clean; 177 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 209 KiB/s wr, 46 op/s 2024-05-08T06:51:40.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:40 smithi070 ceph-mon[29591]: pgmap v156: 129 pgs: 129 active+clean; 180 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 451 KiB/s wr, 84 op/s 2024-05-08T06:51:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:40 smithi172 ceph-mon[33377]: pgmap v156: 129 pgs: 129 active+clean; 180 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 451 KiB/s wr, 84 op/s 2024-05-08T06:51:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:40 smithi194 ceph-mon[33679]: pgmap v156: 129 pgs: 129 active+clean; 180 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 451 KiB/s wr, 84 op/s 2024-05-08T06:51:42.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:42 smithi070 ceph-mon[29591]: pgmap v157: 129 pgs: 129 active+clean; 180 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 425 KiB/s wr, 77 op/s 2024-05-08T06:51:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:42 smithi172 ceph-mon[33377]: pgmap v157: 129 pgs: 129 active+clean; 180 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 425 KiB/s wr, 77 op/s 2024-05-08T06:51:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:42 smithi194 ceph-mon[33679]: pgmap v157: 129 pgs: 129 active+clean; 180 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 425 KiB/s wr, 77 op/s 2024-05-08T06:51:44.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:44 smithi070 ceph-mon[29591]: pgmap v158: 129 pgs: 129 active+clean; 180 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 425 KiB/s wr, 77 op/s 2024-05-08T06:51:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:44 smithi172 ceph-mon[33377]: pgmap v158: 129 pgs: 129 active+clean; 180 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 425 KiB/s wr, 77 op/s 2024-05-08T06:51:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:44 smithi194 ceph-mon[33679]: pgmap v158: 129 pgs: 129 active+clean; 180 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 425 KiB/s wr, 77 op/s 2024-05-08T06:51:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:46 smithi070 ceph-mon[29591]: pgmap v159: 129 pgs: 129 active+clean; 182 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 599 KiB/s wr, 114 op/s 2024-05-08T06:51:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:46 smithi172 ceph-mon[33377]: pgmap v159: 129 pgs: 129 active+clean; 182 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 599 KiB/s wr, 114 op/s 2024-05-08T06:51:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:46 smithi194 ceph-mon[33679]: pgmap v159: 129 pgs: 129 active+clean; 182 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 599 KiB/s wr, 114 op/s 2024-05-08T06:51:48.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:48 smithi070 ceph-mon[29591]: pgmap v160: 129 pgs: 129 active+clean; 182 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 416 KiB/s wr, 75 op/s 2024-05-08T06:51:48.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:48 smithi172 ceph-mon[33377]: pgmap v160: 129 pgs: 129 active+clean; 182 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 416 KiB/s wr, 75 op/s 2024-05-08T06:51:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:48 smithi194 ceph-mon[33679]: pgmap v160: 129 pgs: 129 active+clean; 182 MiB data, 891 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 416 KiB/s wr, 75 op/s 2024-05-08T06:51:49.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:51:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:51:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:51:50.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:50 smithi070 ceph-mon[29591]: pgmap v161: 129 pgs: 129 active+clean; 184 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 636 KiB/s wr, 111 op/s 2024-05-08T06:51:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:50 smithi172 ceph-mon[33377]: pgmap v161: 129 pgs: 129 active+clean; 184 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 636 KiB/s wr, 111 op/s 2024-05-08T06:51:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:50 smithi194 ceph-mon[33679]: pgmap v161: 129 pgs: 129 active+clean; 184 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 636 KiB/s wr, 111 op/s 2024-05-08T06:51:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:51:51.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:51:51.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:51:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:51:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:51:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:51:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:51:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:51:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:51:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:52 smithi070 ceph-mon[29591]: pgmap v162: 129 pgs: 129 active+clean; 184 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 394 KiB/s wr, 73 op/s 2024-05-08T06:51:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:52 smithi172 ceph-mon[33377]: pgmap v162: 129 pgs: 129 active+clean; 184 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 394 KiB/s wr, 73 op/s 2024-05-08T06:51:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:52 smithi194 ceph-mon[33679]: pgmap v162: 129 pgs: 129 active+clean; 184 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 394 KiB/s wr, 73 op/s 2024-05-08T06:51:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:54 smithi172 ceph-mon[33377]: pgmap v163: 129 pgs: 129 active+clean; 184 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 394 KiB/s wr, 73 op/s 2024-05-08T06:51:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:54 smithi194 ceph-mon[33679]: pgmap v163: 129 pgs: 129 active+clean; 184 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 394 KiB/s wr, 73 op/s 2024-05-08T06:51:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:54 smithi070 ceph-mon[29591]: pgmap v163: 129 pgs: 129 active+clean; 184 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 394 KiB/s wr, 73 op/s 2024-05-08T06:51:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:56 smithi172 ceph-mon[33377]: pgmap v164: 129 pgs: 129 active+clean; 187 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 654 KiB/s wr, 107 op/s 2024-05-08T06:51:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:56 smithi194 ceph-mon[33679]: pgmap v164: 129 pgs: 129 active+clean; 187 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 654 KiB/s wr, 107 op/s 2024-05-08T06:51:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:56 smithi070 ceph-mon[29591]: pgmap v164: 129 pgs: 129 active+clean; 187 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 654 KiB/s wr, 107 op/s 2024-05-08T06:51:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:51:58 smithi172 ceph-mon[33377]: pgmap v165: 129 pgs: 129 active+clean; 187 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 480 KiB/s wr, 70 op/s 2024-05-08T06:51:58.431 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:51:58 smithi070 ceph-mon[29591]: pgmap v165: 129 pgs: 129 active+clean; 187 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 480 KiB/s wr, 70 op/s 2024-05-08T06:51:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:51:58 smithi194 ceph-mon[33679]: pgmap v165: 129 pgs: 129 active+clean; 187 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 480 KiB/s wr, 70 op/s 2024-05-08T06:52:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:00 smithi172 ceph-mon[33377]: pgmap v166: 129 pgs: 129 active+clean; 192 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 974 KiB/s wr, 107 op/s 2024-05-08T06:52:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:00 smithi194 ceph-mon[33679]: pgmap v166: 129 pgs: 129 active+clean; 192 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 974 KiB/s wr, 107 op/s 2024-05-08T06:52:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:00 smithi070 ceph-mon[29591]: pgmap v166: 129 pgs: 129 active+clean; 192 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 974 KiB/s wr, 107 op/s 2024-05-08T06:52:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:02 smithi172 ceph-mon[33377]: pgmap v167: 129 pgs: 129 active+clean; 192 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 754 KiB/s wr, 70 op/s 2024-05-08T06:52:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:02 smithi194 ceph-mon[33679]: pgmap v167: 129 pgs: 129 active+clean; 192 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 754 KiB/s wr, 70 op/s 2024-05-08T06:52:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:02 smithi070 ceph-mon[29591]: pgmap v167: 129 pgs: 129 active+clean; 192 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 754 KiB/s wr, 70 op/s 2024-05-08T06:52:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:04 smithi172 ceph-mon[33377]: pgmap v168: 129 pgs: 129 active+clean; 192 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 754 KiB/s wr, 70 op/s 2024-05-08T06:52:04.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:04 smithi194 ceph-mon[33679]: pgmap v168: 129 pgs: 129 active+clean; 192 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 754 KiB/s wr, 70 op/s 2024-05-08T06:52:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:04 smithi070 ceph-mon[29591]: pgmap v168: 129 pgs: 129 active+clean; 192 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 754 KiB/s wr, 70 op/s 2024-05-08T06:52:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:06 smithi172 ceph-mon[33377]: pgmap v169: 129 pgs: 129 active+clean; 197 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-05-08T06:52:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:06 smithi194 ceph-mon[33679]: pgmap v169: 129 pgs: 129 active+clean; 197 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-05-08T06:52:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:06 smithi070 ceph-mon[29591]: pgmap v169: 129 pgs: 129 active+clean; 197 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-05-08T06:52:08.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:08 smithi070 ceph-mon[29591]: pgmap v170: 129 pgs: 129 active+clean; 197 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 975 KiB/s wr, 90 op/s 2024-05-08T06:52:08.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:08 smithi172 ceph-mon[33377]: pgmap v170: 129 pgs: 129 active+clean; 197 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 975 KiB/s wr, 90 op/s 2024-05-08T06:52:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:08 smithi194 ceph-mon[33679]: pgmap v170: 129 pgs: 129 active+clean; 197 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 496 KiB/s rd, 975 KiB/s wr, 90 op/s 2024-05-08T06:52:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:10 smithi070 ceph-mon[29591]: pgmap v171: 129 pgs: 129 active+clean; 202 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 1.4 MiB/s wr, 131 op/s 2024-05-08T06:52:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:10 smithi172 ceph-mon[33377]: pgmap v171: 129 pgs: 129 active+clean; 202 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 1.4 MiB/s wr, 131 op/s 2024-05-08T06:52:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:10 smithi194 ceph-mon[33679]: pgmap v171: 129 pgs: 129 active+clean; 202 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 1.4 MiB/s wr, 131 op/s 2024-05-08T06:52:12.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:12 smithi070 ceph-mon[29591]: pgmap v172: 129 pgs: 129 active+clean; 202 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 928 KiB/s wr, 94 op/s 2024-05-08T06:52:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:12 smithi172 ceph-mon[33377]: pgmap v172: 129 pgs: 129 active+clean; 202 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 928 KiB/s wr, 94 op/s 2024-05-08T06:52:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:12 smithi194 ceph-mon[33679]: pgmap v172: 129 pgs: 129 active+clean; 202 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 928 KiB/s wr, 94 op/s 2024-05-08T06:52:14.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:14 smithi070 ceph-mon[29591]: pgmap v173: 129 pgs: 129 active+clean; 202 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 928 KiB/s wr, 94 op/s 2024-05-08T06:52:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:14 smithi172 ceph-mon[33377]: pgmap v173: 129 pgs: 129 active+clean; 202 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 928 KiB/s wr, 94 op/s 2024-05-08T06:52:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:14 smithi194 ceph-mon[33679]: pgmap v173: 129 pgs: 129 active+clean; 202 MiB data, 945 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 928 KiB/s wr, 94 op/s 2024-05-08T06:52:16.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:16 smithi070 ceph-mon[29591]: pgmap v174: 129 pgs: 129 active+clean; 207 MiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-05-08T06:52:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:16 smithi172 ceph-mon[33377]: pgmap v174: 129 pgs: 129 active+clean; 207 MiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-05-08T06:52:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:16 smithi194 ceph-mon[33679]: pgmap v174: 129 pgs: 129 active+clean; 207 MiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 1.3 MiB/s wr, 131 op/s 2024-05-08T06:52:18.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:18 smithi070 ceph-mon[29591]: pgmap v175: 129 pgs: 129 active+clean; 207 MiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 901 KiB/s wr, 78 op/s 2024-05-08T06:52:18.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:18 smithi172 ceph-mon[33377]: pgmap v175: 129 pgs: 129 active+clean; 207 MiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 901 KiB/s wr, 78 op/s 2024-05-08T06:52:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:18 smithi194 ceph-mon[33679]: pgmap v175: 129 pgs: 129 active+clean; 207 MiB data, 950 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 901 KiB/s wr, 78 op/s 2024-05-08T06:52:20.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:20 smithi070 ceph-mon[29591]: pgmap v176: 129 pgs: 129 active+clean; 212 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 1.4 MiB/s wr, 115 op/s 2024-05-08T06:52:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:20 smithi172 ceph-mon[33377]: pgmap v176: 129 pgs: 129 active+clean; 212 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 1.4 MiB/s wr, 115 op/s 2024-05-08T06:52:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:20 smithi194 ceph-mon[33679]: pgmap v176: 129 pgs: 129 active+clean; 212 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 1.4 MiB/s wr, 115 op/s 2024-05-08T06:52:22.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:22 smithi070 ceph-mon[29591]: pgmap v177: 129 pgs: 129 active+clean; 212 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 936 KiB/s wr, 73 op/s 2024-05-08T06:52:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:22 smithi172 ceph-mon[33377]: pgmap v177: 129 pgs: 129 active+clean; 212 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 936 KiB/s wr, 73 op/s 2024-05-08T06:52:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:22 smithi194 ceph-mon[33679]: pgmap v177: 129 pgs: 129 active+clean; 212 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 936 KiB/s wr, 73 op/s 2024-05-08T06:52:24.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:24 smithi070 ceph-mon[29591]: pgmap v178: 129 pgs: 129 active+clean; 212 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 936 KiB/s wr, 73 op/s 2024-05-08T06:52:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:24 smithi172 ceph-mon[33377]: pgmap v178: 129 pgs: 129 active+clean; 212 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 936 KiB/s wr, 73 op/s 2024-05-08T06:52:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:24 smithi194 ceph-mon[33679]: pgmap v178: 129 pgs: 129 active+clean; 212 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 936 KiB/s wr, 73 op/s 2024-05-08T06:52:26.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:26 smithi070 ceph-mon[29591]: pgmap v179: 129 pgs: 129 active+clean; 216 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.2 MiB/s wr, 108 op/s 2024-05-08T06:52:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:26 smithi172 ceph-mon[33377]: pgmap v179: 129 pgs: 129 active+clean; 216 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.2 MiB/s wr, 108 op/s 2024-05-08T06:52:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:26 smithi194 ceph-mon[33679]: pgmap v179: 129 pgs: 129 active+clean; 216 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 1.2 MiB/s wr, 108 op/s 2024-05-08T06:52:28.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:28 smithi070 ceph-mon[29591]: pgmap v180: 129 pgs: 129 active+clean; 216 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 804 KiB/s wr, 71 op/s 2024-05-08T06:52:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:28 smithi172 ceph-mon[33377]: pgmap v180: 129 pgs: 129 active+clean; 216 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 804 KiB/s wr, 71 op/s 2024-05-08T06:52:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:28 smithi194 ceph-mon[33679]: pgmap v180: 129 pgs: 129 active+clean; 216 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 804 KiB/s wr, 71 op/s 2024-05-08T06:52:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:30 smithi070 ceph-mon[29591]: pgmap v181: 129 pgs: 129 active+clean; 221 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2024-05-08T06:52:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:30 smithi172 ceph-mon[33377]: pgmap v181: 129 pgs: 129 active+clean; 221 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2024-05-08T06:52:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:30 smithi194 ceph-mon[33679]: pgmap v181: 129 pgs: 129 active+clean; 221 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 1.2 MiB/s wr, 111 op/s 2024-05-08T06:52:32.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:32 smithi070 ceph-mon[29591]: pgmap v182: 129 pgs: 129 active+clean; 221 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 764 KiB/s wr, 74 op/s 2024-05-08T06:52:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:32 smithi172 ceph-mon[33377]: pgmap v182: 129 pgs: 129 active+clean; 221 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 764 KiB/s wr, 74 op/s 2024-05-08T06:52:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:32 smithi194 ceph-mon[33679]: pgmap v182: 129 pgs: 129 active+clean; 221 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 764 KiB/s wr, 74 op/s 2024-05-08T06:52:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:34 smithi172 ceph-mon[33377]: pgmap v183: 129 pgs: 129 active+clean; 221 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 764 KiB/s wr, 74 op/s 2024-05-08T06:52:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:34 smithi194 ceph-mon[33679]: pgmap v183: 129 pgs: 129 active+clean; 221 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 764 KiB/s wr, 74 op/s 2024-05-08T06:52:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:34 smithi070 ceph-mon[29591]: pgmap v183: 129 pgs: 129 active+clean; 221 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 764 KiB/s wr, 74 op/s 2024-05-08T06:52:36.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:36 smithi172 ceph-mon[33377]: pgmap v184: 129 pgs: 129 active+clean; 225 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-05-08T06:52:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:36 smithi194 ceph-mon[33679]: pgmap v184: 129 pgs: 129 active+clean; 225 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-05-08T06:52:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:36 smithi070 ceph-mon[29591]: pgmap v184: 129 pgs: 129 active+clean; 225 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.1 MiB/s wr, 112 op/s 2024-05-08T06:52:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:38 smithi172 ceph-mon[33377]: pgmap v185: 129 pgs: 129 active+clean; 225 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 828 KiB/s wr, 77 op/s 2024-05-08T06:52:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:38 smithi194 ceph-mon[33679]: pgmap v185: 129 pgs: 129 active+clean; 225 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 828 KiB/s wr, 77 op/s 2024-05-08T06:52:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:38 smithi070 ceph-mon[29591]: pgmap v185: 129 pgs: 129 active+clean; 225 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 828 KiB/s wr, 77 op/s 2024-05-08T06:52:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:40 smithi172 ceph-mon[33377]: pgmap v186: 129 pgs: 129 active+clean; 228 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 1.1 MiB/s wr, 115 op/s 2024-05-08T06:52:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:40 smithi194 ceph-mon[33679]: pgmap v186: 129 pgs: 129 active+clean; 228 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 1.1 MiB/s wr, 115 op/s 2024-05-08T06:52:40.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:40 smithi070 ceph-mon[29591]: pgmap v186: 129 pgs: 129 active+clean; 228 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 1.1 MiB/s wr, 115 op/s 2024-05-08T06:52:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:42 smithi172 ceph-mon[33377]: pgmap v187: 129 pgs: 129 active+clean; 228 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 704 KiB/s wr, 75 op/s 2024-05-08T06:52:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:42 smithi194 ceph-mon[33679]: pgmap v187: 129 pgs: 129 active+clean; 228 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 704 KiB/s wr, 75 op/s 2024-05-08T06:52:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:42 smithi070 ceph-mon[29591]: pgmap v187: 129 pgs: 129 active+clean; 228 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 704 KiB/s wr, 75 op/s 2024-05-08T06:52:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:44 smithi172 ceph-mon[33377]: pgmap v188: 129 pgs: 129 active+clean; 228 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 704 KiB/s wr, 75 op/s 2024-05-08T06:52:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:44 smithi194 ceph-mon[33679]: pgmap v188: 129 pgs: 129 active+clean; 228 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 704 KiB/s wr, 75 op/s 2024-05-08T06:52:44.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:44 smithi070 ceph-mon[29591]: pgmap v188: 129 pgs: 129 active+clean; 228 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 704 KiB/s wr, 75 op/s 2024-05-08T06:52:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:46 smithi172 ceph-mon[33377]: pgmap v189: 129 pgs: 129 active+clean; 232 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.0 MiB/s wr, 108 op/s 2024-05-08T06:52:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:46 smithi194 ceph-mon[33679]: pgmap v189: 129 pgs: 129 active+clean; 232 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.0 MiB/s wr, 108 op/s 2024-05-08T06:52:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:46 smithi070 ceph-mon[29591]: pgmap v189: 129 pgs: 129 active+clean; 232 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.0 MiB/s wr, 108 op/s 2024-05-08T06:52:47.432 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T06:52:47.433 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.7 2024-05-08T06:52:47.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:52:47.930 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:52:48.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:48 smithi070 ceph-mon[29591]: pgmap v190: 129 pgs: 129 active+clean; 232 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 643 KiB/s wr, 70 op/s 2024-05-08T06:52:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:48 smithi194 ceph-mon[33679]: pgmap v190: 129 pgs: 129 active+clean; 232 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 643 KiB/s wr, 70 op/s 2024-05-08T06:52:48.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:48 smithi172 ceph-mon[33377]: pgmap v190: 129 pgs: 129 active+clean; 232 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 643 KiB/s wr, 70 op/s 2024-05-08T06:52:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:49 smithi070 ceph-mon[29591]: pgmap v191: 129 pgs: 129 active+clean; 234 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 870 KiB/s wr, 109 op/s 2024-05-08T06:52:49.898 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:49 smithi172 ceph-mon[33377]: pgmap v191: 129 pgs: 129 active+clean; 234 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 870 KiB/s wr, 109 op/s 2024-05-08T06:52:49.898 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:49 smithi194 ceph-mon[33679]: pgmap v191: 129 pgs: 129 active+clean; 234 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 870 KiB/s wr, 109 op/s 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.374+0000 7fd3ab000700 1 -- 172.21.15.70:0/1130387167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a4075ff0 msgr2=0x7fd3a410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.374+0000 7fd3ab000700 1 --2- 172.21.15.70:0/1130387167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a4075ff0 0x7fd3a410f960 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fd390009990 tx=0x7fd390009ca0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.374+0000 7fd3ab000700 1 -- 172.21.15.70:0/1130387167 shutdown_connections 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.374+0000 7fd3ab000700 1 --2- 172.21.15.70:0/1130387167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a410fea0 0x7fd3a4112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.374+0000 7fd3ab000700 1 --2- 172.21.15.70:0/1130387167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a40756d0 0x7fd3a4075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.374+0000 7fd3ab000700 1 --2- 172.21.15.70:0/1130387167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a4075ff0 0x7fd3a410f960 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.374+0000 7fd3ab000700 1 -- 172.21.15.70:0/1130387167 >> 172.21.15.70:0/1130387167 conn(0x7fd3a407a600 msgr2=0x7fd3a407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.374+0000 7fd3ab000700 1 -- 172.21.15.70:0/1130387167 shutdown_connections 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.374+0000 7fd3ab000700 1 -- 172.21.15.70:0/1130387167 wait complete. 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.375+0000 7fd3ab000700 1 Processor -- start 2024-05-08T06:52:50.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.375+0000 7fd3ab000700 1 -- start start 2024-05-08T06:52:50.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.376+0000 7fd3ab000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a40756d0 0x7fd3a419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:50.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.376+0000 7fd3ab000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a4075ff0 0x7fd3a419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:50.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.376+0000 7fd3ab000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a410fea0 0x7fd3a41a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:50.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.376+0000 7fd3ab000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a4115760 con 0x7fd3a40756d0 2024-05-08T06:52:50.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.376+0000 7fd3ab000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a41155e0 con 0x7fd3a4075ff0 2024-05-08T06:52:50.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.376+0000 7fd3ab000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a41158e0 con 0x7fd3a410fea0 2024-05-08T06:52:50.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.376+0000 7fd3a3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a40756d0 0x7fd3a419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:50.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.376+0000 7fd3a3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a40756d0 0x7fd3a419bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59342/0 (socket says 172.21.15.70:59342) 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.376+0000 7fd3a3e00700 1 -- 172.21.15.70:0/2179599668 learned_addr learned my addr 172.21.15.70:0/2179599668 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.377+0000 7fd3a3400700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a4075ff0 0x7fd3a419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.377+0000 7fd3a9000700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a410fea0 0x7fd3a41a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.377+0000 7fd3a3e00700 1 -- 172.21.15.70:0/2179599668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a410fea0 msgr2=0x7fd3a41a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.377+0000 7fd3a3e00700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a410fea0 0x7fd3a41a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.377+0000 7fd3a3e00700 1 -- 172.21.15.70:0/2179599668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a4075ff0 msgr2=0x7fd3a419c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.377+0000 7fd3a3e00700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a4075ff0 0x7fd3a419c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.377+0000 7fd3a3e00700 1 -- 172.21.15.70:0/2179599668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a41a0d90 con 0x7fd3a40756d0 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.377+0000 7fd3a9000700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a410fea0 0x7fd3a41a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.377+0000 7fd3a3e00700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a40756d0 0x7fd3a419bd80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd39400ada0 tx=0x7fd39400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.378+0000 7fd3a0c00700 1 -- 172.21.15.70:0/2179599668 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd394017020 con 0x7fd3a40756d0 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.378+0000 7fd3a0c00700 1 -- 172.21.15.70:0/2179599668 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd39400ce10 con 0x7fd3a40756d0 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.378+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a41a1080 con 0x7fd3a40756d0 2024-05-08T06:52:50.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.378+0000 7fd3a0c00700 1 -- 172.21.15.70:0/2179599668 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3940054e0 con 0x7fd3a40756d0 2024-05-08T06:52:50.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.378+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a41a8900 con 0x7fd3a40756d0 2024-05-08T06:52:50.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.379+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a406a190 con 0x7fd3a40756d0 2024-05-08T06:52:50.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.381+0000 7fd3a0c00700 1 -- 172.21.15.70:0/2179599668 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd394004c40 con 0x7fd3a40756d0 2024-05-08T06:52:50.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.383+0000 7fd3a0c00700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3880b29f0 0x7fd3880b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:50.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.383+0000 7fd3a0c00700 1 -- 172.21.15.70:0/2179599668 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fd3940e2880 con 0x7fd3a40756d0 2024-05-08T06:52:50.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.383+0000 7fd3a3400700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3880b29f0 0x7fd3880b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:50.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.384+0000 7fd3a3400700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3880b29f0 0x7fd3880b4eb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd39000b5c0 tx=0x7fd39001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:52:50.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.390+0000 7fd3a0c00700 1 -- 172.21.15.70:0/2179599668 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd394021020 con 0x7fd3a40756d0 2024-05-08T06:52:50.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.681+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3a419d0e0 con 0x7fd3a40756d0 2024-05-08T06:52:50.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.682+0000 7fd3a0c00700 1 -- 172.21.15.70:0/2179599668 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fd3940a9ec0 con 0x7fd3a40756d0 2024-05-08T06:52:50.681 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:52:50.681 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.685+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3880b29f0 msgr2=0x7fd3880b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.685+0000 7fd3ab000700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3880b29f0 0x7fd3880b4eb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd39000b5c0 tx=0x7fd39001a040 comp rx=0 tx=0).stop 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.685+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a40756d0 msgr2=0x7fd3a419bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.685+0000 7fd3ab000700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a40756d0 0x7fd3a419bd80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd39400ada0 tx=0x7fd39400c330 comp rx=0 tx=0).stop 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.685+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 shutdown_connections 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.685+0000 7fd3ab000700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3880b29f0 0x7fd3880b4eb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.685+0000 7fd3ab000700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3a410fea0 0x7fd3a41a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.685+0000 7fd3ab000700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd3a40756d0 0x7fd3a419bd80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.685+0000 7fd3ab000700 1 --2- 172.21.15.70:0/2179599668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd3a4075ff0 0x7fd3a419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:50.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.686+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 >> 172.21.15.70:0/2179599668 conn(0x7fd3a407a600 msgr2=0x7fd3a4101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:52:50.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.686+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 shutdown_connections 2024-05-08T06:52:50.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:50.686+0000 7fd3ab000700 1 -- 172.21.15.70:0/2179599668 wait complete. 2024-05-08T06:52:50.685 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:52:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:50 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2179599668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:52:51.114 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:50 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2179599668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:52:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:50 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2179599668' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:52:51.657 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 85.7 --await-for 42.0' 2024-05-08T06:52:51.658 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 85.7 --await-for 42.0 2024-05-08T06:52:51.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:51 smithi070 ceph-mon[29591]: pgmap v192: 129 pgs: 129 active+clean; 234 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 552 KiB/s wr, 71 op/s 2024-05-08T06:52:51.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:52:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:51 smithi194 ceph-mon[33679]: pgmap v192: 129 pgs: 129 active+clean; 234 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 552 KiB/s wr, 71 op/s 2024-05-08T06:52:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:52:52.157 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:52:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:51 smithi172 ceph-mon[33377]: pgmap v192: 129 pgs: 129 active+clean; 234 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 552 KiB/s wr, 71 op/s 2024-05-08T06:52:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:52:53.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:53 smithi070 ceph-mon[29591]: pgmap v193: 129 pgs: 129 active+clean; 234 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 552 KiB/s wr, 71 op/s 2024-05-08T06:52:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:52:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:52:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:53 smithi172 ceph-mon[33377]: pgmap v193: 129 pgs: 129 active+clean; 234 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 552 KiB/s wr, 71 op/s 2024-05-08T06:52:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:52:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:52:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:53 smithi194 ceph-mon[33679]: pgmap v193: 129 pgs: 129 active+clean; 234 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 552 KiB/s wr, 71 op/s 2024-05-08T06:52:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:52:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:52:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:52:54.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.715+0000 7fd2f8400700 1 -- 172.21.15.70:0/343452169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f00756d0 msgr2=0x7fd2f0075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:54.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.715+0000 7fd2f8400700 1 --2- 172.21.15.70:0/343452169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f00756d0 0x7fd2f0075ab0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400b0a0 tx=0x7fd2e400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.715+0000 7fd2f8400700 1 -- 172.21.15.70:0/343452169 shutdown_connections 2024-05-08T06:52:54.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.715+0000 7fd2f8400700 1 --2- 172.21.15.70:0/343452169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f010fed0 0x7fd2f01122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.715+0000 7fd2f8400700 1 --2- 172.21.15.70:0/343452169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f00756d0 0x7fd2f0075ab0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.715+0000 7fd2f8400700 1 --2- 172.21.15.70:0/343452169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f0075ff0 0x7fd2f010f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.715+0000 7fd2f8400700 1 -- 172.21.15.70:0/343452169 >> 172.21.15.70:0/343452169 conn(0x7fd2f007a650 msgr2=0x7fd2f007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:52:54.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.715+0000 7fd2f8400700 1 -- 172.21.15.70:0/343452169 shutdown_connections 2024-05-08T06:52:54.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.715+0000 7fd2f8400700 1 -- 172.21.15.70:0/343452169 wait complete. 2024-05-08T06:52:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.716+0000 7fd2f8400700 1 Processor -- start 2024-05-08T06:52:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.717+0000 7fd2f8400700 1 -- start start 2024-05-08T06:52:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.717+0000 7fd2f8400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f00756d0 0x7fd2f01a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.717+0000 7fd2f8400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f0075ff0 0x7fd2f01a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.717+0000 7fd2f8400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f010fed0 0x7fd2f019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.717+0000 7fd2f8400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0115780 con 0x7fd2f0075ff0 2024-05-08T06:52:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.717+0000 7fd2f8400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0115600 con 0x7fd2f010fed0 2024-05-08T06:52:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.717+0000 7fd2f8400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0115900 con 0x7fd2f00756d0 2024-05-08T06:52:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f0075ff0 0x7fd2f01a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f0075ff0 0x7fd2f01a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59356/0 (socket says 172.21.15.70:59356) 2024-05-08T06:52:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5000700 1 -- 172.21.15.70:0/33028530 learned_addr learned my addr 172.21.15.70:0/33028530 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:52:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f00756d0 0x7fd2f01a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f6400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f010fed0 0x7fd2f019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5000700 1 -- 172.21.15.70:0/33028530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f00756d0 msgr2=0x7fd2f01a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5000700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f00756d0 0x7fd2f01a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5000700 1 -- 172.21.15.70:0/33028530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f010fed0 msgr2=0x7fd2f019bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5000700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f010fed0 0x7fd2f019bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5000700 1 -- 172.21.15.70:0/33028530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f019c220 con 0x7fd2f0075ff0 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f00756d0 0x7fd2f01a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.718+0000 7fd2f6400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f010fed0 0x7fd2f019bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.719+0000 7fd2f5000700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f0075ff0 0x7fd2f01a1df0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00d950 tx=0x7fd2dc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.719+0000 7fd2ee000700 1 -- 172.21.15.70:0/33028530 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc016070 con 0x7fd2f0075ff0 2024-05-08T06:52:54.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.719+0000 7fd2ee000700 1 -- 172.21.15.70:0/33028530 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2dc010460 con 0x7fd2f0075ff0 2024-05-08T06:52:54.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.719+0000 7fd2ee000700 1 -- 172.21.15.70:0/33028530 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc00f620 con 0x7fd2f0075ff0 2024-05-08T06:52:54.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.719+0000 7fd2f8400700 1 -- 172.21.15.70:0/33028530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f019c510 con 0x7fd2f0075ff0 2024-05-08T06:52:54.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.719+0000 7fd2f8400700 1 -- 172.21.15.70:0/33028530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f01a8780 con 0x7fd2f0075ff0 2024-05-08T06:52:54.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.723+0000 7fd2ee000700 1 -- 172.21.15.70:0/33028530 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd2dc019070 con 0x7fd2f0075ff0 2024-05-08T06:52:54.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.724+0000 7fd302d37b80 1 Processor -- start 2024-05-08T06:52:54.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.725+0000 7fd302d37b80 1 -- start start 2024-05-08T06:52:54.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.725+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55888465c240 0x55888465c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.725+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 0x558884656c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.725+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x558884663000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.725+0000 7fd302d37b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5588845a8bb0 con 0x5588846571d0 2024-05-08T06:52:54.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.725+0000 7fd302d37b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5588845468f0 con 0x558884656810 2024-05-08T06:52:54.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.725+0000 7fd302d37b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5588845a4b70 con 0x55888465c240 2024-05-08T06:52:54.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.725+0000 7fd2ee000700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2d80b2b20 0x7fd2d80b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x558884663000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2ee000700 1 -- 172.21.15.70:0/33028530 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fd2dc0e2580 con 0x7fd2f0075ff0 2024-05-08T06:52:54.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x558884663000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59358/0 (socket says 172.21.15.70:59358) 2024-05-08T06:52:54.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5000700 1 -- 172.21.15.70:0/3169481612 learned_addr learned my addr 172.21.15.70:0/3169481612 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:52:54.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f6400700 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55888465c240 0x55888465c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f6400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2d80b2b20 0x7fd2d80b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 0x558884656c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5000700 1 -- 172.21.15.70:0/3169481612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55888465c240 msgr2=0x55888465c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5000700 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55888465c240 0x55888465c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5000700 1 -- 172.21.15.70:0/3169481612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 msgr2=0x558884656c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5000700 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 0x558884656c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5000700 1 -- 172.21.15.70:0/3169481612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588844f5a60 con 0x5588846571d0 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 0x558884656c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.726+0000 7fd2f6400700 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55888465c240 0x55888465c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.727+0000 7fd2f5000700 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x558884663000 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0dff00 tx=0x7fd2dc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76b4853eb08ad9d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.727+0000 7fd2e2a00700 1 -- 172.21.15.70:0/3169481612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc020070 con 0x5588846571d0 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.727+0000 7fd2f6400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2d80b2b20 0x7fd2d80b4fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80059d0 tx=0x7fd2e8005f90 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.727+0000 7fd2e2a00700 1 -- 172.21.15.70:0/3169481612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2dc0a9b90 con 0x5588846571d0 2024-05-08T06:52:54.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.727+0000 7fd2e2a00700 1 -- 172.21.15.70:0/3169481612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0db1c0 con 0x5588846571d0 2024-05-08T06:52:54.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.728+0000 7fd302d37b80 1 -- 172.21.15.70:0/3169481612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 msgr2=0x558884663000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:54.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.728+0000 7fd302d37b80 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x558884663000 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0dff00 tx=0x7fd2dc000bc0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.728+0000 7fd302d37b80 1 -- 172.21.15.70:0/3169481612 shutdown_connections 2024-05-08T06:52:54.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.728+0000 7fd302d37b80 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x558884663000 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.728+0000 7fd302d37b80 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55888465c240 0x55888465c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.728+0000 7fd302d37b80 1 --2- 172.21.15.70:0/3169481612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 0x558884656c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.728+0000 7fd302d37b80 1 -- 172.21.15.70:0/3169481612 >> 172.21.15.70:0/3169481612 conn(0x5588845ce860 msgr2=0x558884651100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:52:54.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.728+0000 7fd302d37b80 1 -- 172.21.15.70:0/3169481612 shutdown_connections 2024-05-08T06:52:54.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.728+0000 7fd302d37b80 1 -- 172.21.15.70:0/3169481612 wait complete. 2024-05-08T06:52:54.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.729+0000 7fd302d37b80 1 -- start start 2024-05-08T06:52:54.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.729+0000 7fd302d37b80 1 Processor -- start 2024-05-08T06:52:54.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 0x558884662b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x55888465ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888465c240 0x5588846604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd302d37b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558884663600 con 0x5588846571d0 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd302d37b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55888450ecb0 con 0x55888465c240 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd302d37b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558884663780 con 0x558884656810 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd302d37b80 10 client.0 _ll_register_callbacks cb 0x55888454fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd2f5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x55888465ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd2f5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x55888465ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59374/0 (socket says 172.21.15.70:59374) 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd2f5000700 1 -- 172.21.15.70:0/772401187 learned_addr learned my addr 172.21.15.70:0/772401187 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 0x558884662b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.730+0000 7fd2f6400700 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888465c240 0x5588846604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.731+0000 7fd2f5000700 1 -- 172.21.15.70:0/772401187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 msgr2=0x558884662b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.731+0000 7fd2f5000700 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 0x558884662b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.731+0000 7fd2f5000700 1 -- 172.21.15.70:0/772401187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888465c240 msgr2=0x5588846604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:52:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.731+0000 7fd2f5000700 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888465c240 0x5588846604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.731+0000 7fd2f5000700 1 -- 172.21.15.70:0/772401187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55888456e5b0 con 0x5588846571d0 2024-05-08T06:52:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.731+0000 7fd2f6400700 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888465c240 0x5588846604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:52:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.731+0000 7fd2f5000700 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x55888465ffa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc005950 tx=0x7fd2dc010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a4bf15076ab4a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:52:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.731+0000 7fd2d7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:52:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.731+0000 7fd2d7400700 1 -- 172.21.15.70:0/772401187 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc020070 con 0x5588846571d0 2024-05-08T06:52:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.732+0000 7fd2d7400700 1 -- 172.21.15.70:0/772401187 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fd2dc0a9900 con 0x5588846571d0 2024-05-08T06:52:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.732+0000 7fd302d37b80 1 -- 172.21.15.70:0/772401187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2dc0a9b90 con 0x5588846571d0 2024-05-08T06:52:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.732+0000 7fd2d7400700 1 -- 172.21.15.70:0/772401187 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2dc0a9490 con 0x5588846571d0 2024-05-08T06:52:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.732+0000 7fd302d37b80 10 client.15621 fetch_fsmap learned FSMap version 28 2024-05-08T06:52:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.732+0000 7fd302d37b80 1 -- 172.21.15.70:0/772401187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55888466dd70 con 0x5588846571d0 2024-05-08T06:52:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.732+0000 7fd2d7400700 1 -- 172.21.15.70:0/772401187 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2dc0a9b90 con 0x5588846571d0 2024-05-08T06:52:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.733+0000 7fd2d7400700 1 -- 172.21.15.70:0/772401187 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd2dc0b0bc0 con 0x5588846571d0 2024-05-08T06:52:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.733+0000 7fd302d37b80 10 client.15621 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:52:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.733+0000 7fd302d37b80 10 client.15621 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:52:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.733+0000 7fd302d37b80 20 client.15621 populate_metadata read hostname 'smithi070' 2024-05-08T06:52:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.733+0000 7fd302d37b80 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558884670240 0x558884672630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.733+0000 7fd302d37b80 4 client.15621 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:52:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.733+0000 7fd302d37b80 1 -- 172.21.15.70:0/772401187 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588846232d0 con 0x558884670240 2024-05-08T06:52:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.734+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558884670240 0x558884672630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.735+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558884670240 0x558884672630 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b754c6f5e0542e5a server_cookie=90c13f233b2d8924 in_seq=0 out_seq=0 2024-05-08T06:52:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.735+0000 7fd2d7400700 10 client.15621 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:52:54.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd2d7400700 1 -- 172.21.15.70:0/772401187 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5588846232d0 con 0x558884670240 2024-05-08T06:52:54.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd2d7400700 10 client.15621 handle_command_reply: tid=0 2024-05-08T06:52:54.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 client.15621 shutdown 2024-05-08T06:52:54.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 -- 172.21.15.70:0/772401187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 msgr2=0x55888465ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:54.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x55888465ffa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc005950 tx=0x7fd2dc010b60 comp rx=0 tx=0).stop 2024-05-08T06:52:54.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 -- 172.21.15.70:0/772401187 shutdown_connections 2024-05-08T06:52:54.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558884670240 0x558884672630 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55888465c240 0x5588846604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 0x558884662b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 --2- 172.21.15.70:0/772401187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5588846571d0 0x55888465ffa0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 -- 172.21.15.70:0/772401187 >> 172.21.15.70:0/772401187 conn(0x5588845ce860 msgr2=0x55888464bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:52:54.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd2d7400700 0 client.15621 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:52:54.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.740+0000 7fd302d37b80 1 -- 172.21.15.70:0/772401187 shutdown_connections 2024-05-08T06:52:54.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.741+0000 7fd302d37b80 1 -- 172.21.15.70:0/772401187 wait complete. 2024-05-08T06:52:54.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.741+0000 7fd302d37b80 20 client.15621 trim_cache size 0 max 16384 2024-05-08T06:52:54.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.765+0000 7fd302d37b80 1 Processor -- start 2024-05-08T06:52:54.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.765+0000 7fd302d37b80 1 -- start start 2024-05-08T06:52:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.765+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 0x55888466c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.765+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588846571d0 0x558884655f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.765+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x558884677bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.765+0000 7fd302d37b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f01b3f20 con 0x55888465c240 2024-05-08T06:52:54.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.765+0000 7fd302d37b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f01b17b0 con 0x5588846571d0 2024-05-08T06:52:54.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.765+0000 7fd302d37b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f01af600 con 0x558884656810 2024-05-08T06:52:54.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.766+0000 7fd2f6400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x558884677bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.766+0000 7fd2f6400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x558884677bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59390/0 (socket says 172.21.15.70:59390) 2024-05-08T06:52:54.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.766+0000 7fd2f6400700 1 -- 172.21.15.70:0/2552255547 learned_addr learned my addr 172.21.15.70:0/2552255547 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:52:54.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.766+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/2552255547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 0x55888466c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.766+0000 7fd2f5000700 1 --2- 172.21.15.70:0/2552255547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588846571d0 0x558884655f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.767+0000 7fd2f6400700 1 -- 172.21.15.70:0/2552255547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 msgr2=0x55888466c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:52:54.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.767+0000 7fd2f6400700 1 --2- 172.21.15.70:0/2552255547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 0x55888466c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.767+0000 7fd2f6400700 1 -- 172.21.15.70:0/2552255547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588846571d0 msgr2=0x558884655f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:52:54.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.767+0000 7fd2f6400700 1 --2- 172.21.15.70:0/2552255547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588846571d0 0x558884655f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.767+0000 7fd2f6400700 1 -- 172.21.15.70:0/2552255547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55888464dd00 con 0x55888465c240 2024-05-08T06:52:54.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.767+0000 7fd2f6400700 1 --2- 172.21.15.70:0/2552255547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x558884677bd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd2e801d7b0 tx=0x7fd2e80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587448e092e953b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:52:54.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.767+0000 7fd2e2000700 1 -- 172.21.15.70:0/2552255547 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e801de70 con 0x55888465c240 2024-05-08T06:52:54.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.768+0000 7fd2e2000700 1 -- 172.21.15.70:0/2552255547 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2e8016070 con 0x55888465c240 2024-05-08T06:52:54.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.768+0000 7fd2e2000700 1 -- 172.21.15.70:0/2552255547 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e801e420 con 0x55888465c240 2024-05-08T06:52:54.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 -- 172.21.15.70:0/2552255547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 msgr2=0x558884677bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:52:54.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2552255547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x558884677bd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd2e801d7b0 tx=0x7fd2e80047c0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 -- 172.21.15.70:0/2552255547 shutdown_connections 2024-05-08T06:52:54.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2552255547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x558884677bd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2552255547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558884656810 0x55888466c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2552255547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5588846571d0 0x558884655f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 -- 172.21.15.70:0/2552255547 >> 172.21.15.70:0/2552255547 conn(0x5588845ce860 msgr2=0x558884655800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:52:54.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 -- 172.21.15.70:0/2552255547 shutdown_connections 2024-05-08T06:52:54.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 -- 172.21.15.70:0/2552255547 wait complete. 2024-05-08T06:52:54.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.769+0000 7fd302d37b80 1 -- start start 2024-05-08T06:52:54.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.770+0000 7fd302d37b80 1 Processor -- start 2024-05-08T06:52:54.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.770+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 0x558884668cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.770+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588846571d0 0x558884667070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.770+0000 7fd302d37b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x5588846675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.770+0000 7fd302d37b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f01afc70 con 0x55888465c240 2024-05-08T06:52:54.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.770+0000 7fd302d37b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f01b10e0 con 0x558884656810 2024-05-08T06:52:54.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.770+0000 7fd302d37b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f01b0340 con 0x5588846571d0 2024-05-08T06:52:54.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.771+0000 7fd302d37b80 10 client.0 _ll_register_callbacks cb 0x55888454fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:52:54.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.771+0000 7fd2f6400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x5588846675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.771+0000 7fd2f6400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x5588846675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59402/0 (socket says 172.21.15.70:59402) 2024-05-08T06:52:54.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.771+0000 7fd2f6400700 1 -- 172.21.15.70:0/2918306906 learned_addr learned my addr 172.21.15.70:0/2918306906 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:52:54.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.771+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 0x558884668cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.771+0000 7fd2f5000700 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588846571d0 0x558884667070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.771+0000 7fd2f6400700 1 -- 172.21.15.70:0/2918306906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588846571d0 msgr2=0x558884667070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.771+0000 7fd2f6400700 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588846571d0 0x558884667070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.772+0000 7fd2f6400700 1 -- 172.21.15.70:0/2918306906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 msgr2=0x558884668cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.772+0000 7fd2f6400700 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 0x558884668cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.772+0000 7fd2f6400700 1 -- 172.21.15.70:0/2918306906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558884667b40 con 0x55888465c240 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.772+0000 7fd2f6400700 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x5588846675b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8005950 tx=0x7fd2e800df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3964e9d83ad62041 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.772+0000 7fd2d7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.772+0000 7fd2d7400700 1 -- 172.21.15.70:0/2918306906 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8004a30 con 0x55888465c240 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.772+0000 7fd2d7400700 1 -- 172.21.15.70:0/2918306906 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9495+0+0 (secure 0 0 0) 0x7fd2e8004bd0 con 0x55888465c240 2024-05-08T06:52:54.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.772+0000 7fd302d37b80 1 -- 172.21.15.70:0/2918306906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2e8016070 con 0x55888465c240 2024-05-08T06:52:54.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.773+0000 7fd2d7400700 1 -- 172.21.15.70:0/2918306906 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd2e803a050 con 0x55888465c240 2024-05-08T06:52:54.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.773+0000 7fd302d37b80 10 client.15627 fetch_fsmap learned FSMap version 28 2024-05-08T06:52:54.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.773+0000 7fd302d37b80 1 -- 172.21.15.70:0/2918306906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5588846db540 con 0x55888465c240 2024-05-08T06:52:54.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.773+0000 7fd2d7400700 1 -- 172.21.15.70:0/2918306906 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd2e8016070 con 0x55888465c240 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.773+0000 7fd2d7400700 1 -- 172.21.15.70:0/2918306906 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd2e80051b0 con 0x55888465c240 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.773+0000 7fd302d37b80 10 client.15627 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.773+0000 7fd302d37b80 10 client.15627 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.773+0000 7fd302d37b80 20 client.15627 populate_metadata read hostname 'smithi070' 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.774+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588846dbc60 0x5588846de080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.774+0000 7fd302d37b80 4 client.15627 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.7, "await_for": 42.0}] 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.774+0000 7fd302d37b80 1 -- 172.21.15.70:0/2918306906 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.7, "await_for": 42.0}) -- 0x5588845b6590 con 0x5588846dbc60 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.774+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588846dbc60 0x5588846de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.775+0000 7fd2d7400700 10 client.15627 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:52:54.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:52:54.775+0000 7fd2f5a00700 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588846dbc60 0x5588846de080 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=638f3dbe940202ef server_cookie=4c228cbf3003c0e7 in_seq=0 out_seq=0 2024-05-08T06:52:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:55 smithi172 ceph-mon[33377]: pgmap v194: 129 pgs: 129 active+clean; 238 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 944 KiB/s wr, 109 op/s 2024-05-08T06:52:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:55 smithi194 ceph-mon[33679]: pgmap v194: 129 pgs: 129 active+clean; 238 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 944 KiB/s wr, 109 op/s 2024-05-08T06:52:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:55 smithi070 ceph-mon[29591]: pgmap v194: 129 pgs: 129 active+clean; 238 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 944 KiB/s wr, 109 op/s 2024-05-08T06:52:58.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:57 smithi172 ceph-mon[33377]: pgmap v195: 129 pgs: 129 active+clean; 238 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 620 KiB/s wr, 76 op/s 2024-05-08T06:52:58.182 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:57 smithi070 ceph-mon[29591]: pgmap v195: 129 pgs: 129 active+clean; 238 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 620 KiB/s wr, 76 op/s 2024-05-08T06:52:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:57 smithi194 ceph-mon[33679]: pgmap v195: 129 pgs: 129 active+clean; 238 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 620 KiB/s wr, 76 op/s 2024-05-08T06:53:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:52:59 smithi172 ceph-mon[33377]: pgmap v196: 129 pgs: 129 active+clean; 241 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 888 KiB/s wr, 90 op/s 2024-05-08T06:53:00.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:52:59 smithi194 ceph-mon[33679]: pgmap v196: 129 pgs: 129 active+clean; 241 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 888 KiB/s wr, 90 op/s 2024-05-08T06:53:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:52:59 smithi070 ceph-mon[29591]: pgmap v196: 129 pgs: 129 active+clean; 241 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 888 KiB/s wr, 90 op/s 2024-05-08T06:53:01.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.394+0000 7fd2d7400700 1 -- 172.21.15.70:0/2918306906 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5588845b6590 con 0x5588846dbc60 2024-05-08T06:53:01.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.394+0000 7fd2d7400700 10 client.15627 handle_command_reply: tid=0 2024-05-08T06:53:01.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.394+0000 7fd302d37b80 1 client.15627 shutdown 2024-05-08T06:53:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.395+0000 7fd302d37b80 1 -- 172.21.15.70:0/2918306906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 msgr2=0x5588846675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.395+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x5588846675b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8005950 tx=0x7fd2e800df30 comp rx=0 tx=0).stop 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.395+0000 7fd302d37b80 1 -- 172.21.15.70:0/2918306906 shutdown_connections 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.395+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5588846dbc60 0x5588846de080 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.395+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55888465c240 0x5588846675b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.395+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558884656810 0x558884668cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.395+0000 7fd302d37b80 1 --2- 172.21.15.70:0/2918306906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5588846571d0 0x558884667070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.395+0000 7fd302d37b80 1 -- 172.21.15.70:0/2918306906 >> 172.21.15.70:0/2918306906 conn(0x5588845ce860 msgr2=0x558884656090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.395+0000 7fd2d7400700 0 client.15627 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.396+0000 7fd302d37b80 1 -- 172.21.15.70:0/2918306906 shutdown_connections 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.396+0000 7fd302d37b80 1 -- 172.21.15.70:0/2918306906 wait complete. 2024-05-08T06:53:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.396+0000 7fd302d37b80 20 client.15627 trim_cache size 0 max 16384 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 18, 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "d37936f9": { 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 18, 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:53:01.397 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.7, 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:01.398 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:01.399 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:53:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 -- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2d80b2b20 msgr2=0x7fd2d80b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2d80b2b20 0x7fd2d80b4fe0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2e80059d0 tx=0x7fd2e8005f90 comp rx=0 tx=0).stop 2024-05-08T06:53:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 -- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f0075ff0 msgr2=0x7fd2f01a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f0075ff0 0x7fd2f01a1df0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00d950 tx=0x7fd2dc00dd10 comp rx=0 tx=0).stop 2024-05-08T06:53:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 -- 172.21.15.70:0/33028530 shutdown_connections 2024-05-08T06:53:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2d80b2b20 0x7fd2d80b4fe0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd2f010fed0 0x7fd2f019bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f00756d0 0x7fd2f01a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 --2- 172.21.15.70:0/33028530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2f0075ff0 0x7fd2f01a1df0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 -- 172.21.15.70:0/33028530 >> 172.21.15.70:0/33028530 conn(0x7fd2f007a650 msgr2=0x7fd2f0100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 -- 172.21.15.70:0/33028530 shutdown_connections 2024-05-08T06:53:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:01.398+0000 7fd2f8400700 1 -- 172.21.15.70:0/33028530 wait complete. 2024-05-08T06:53:02.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:01 smithi194 ceph-mon[33679]: pgmap v197: 129 pgs: 129 active+clean; 241 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 661 KiB/s wr, 52 op/s 2024-05-08T06:53:02.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:01 smithi070 ceph-mon[29591]: pgmap v197: 129 pgs: 129 active+clean; 241 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 661 KiB/s wr, 52 op/s 2024-05-08T06:53:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:01 smithi172 ceph-mon[33377]: pgmap v197: 129 pgs: 129 active+clean; 241 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 661 KiB/s wr, 52 op/s 2024-05-08T06:53:02.979 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd37936f9', quiesce took 15.5 seconds. Will release after: 25.7 2024-05-08T06:53:04.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:03 smithi194 ceph-mon[33679]: pgmap v198: 129 pgs: 129 active+clean; 241 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 661 KiB/s wr, 52 op/s 2024-05-08T06:53:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:03 smithi070 ceph-mon[29591]: pgmap v198: 129 pgs: 129 active+clean; 241 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 661 KiB/s wr, 52 op/s 2024-05-08T06:53:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:03 smithi172 ceph-mon[33377]: pgmap v198: 129 pgs: 129 active+clean; 241 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 661 KiB/s wr, 52 op/s 2024-05-08T06:53:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:05 smithi194 ceph-mon[33679]: pgmap v199: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 814 KiB/s wr, 86 op/s 2024-05-08T06:53:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:05 smithi070 ceph-mon[29591]: pgmap v199: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 814 KiB/s wr, 86 op/s 2024-05-08T06:53:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:05 smithi172 ceph-mon[33377]: pgmap v199: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 814 KiB/s wr, 86 op/s 2024-05-08T06:53:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:06 smithi194 ceph-mon[33679]: osdmap e94: 12 total, 12 up, 12 in 2024-05-08T06:53:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:06 smithi070 ceph-mon[29591]: osdmap e94: 12 total, 12 up, 12 in 2024-05-08T06:53:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:06 smithi172 ceph-mon[33377]: osdmap e94: 12 total, 12 up, 12 in 2024-05-08T06:53:08.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:07 smithi194 ceph-mon[33679]: pgmap v201: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 506 KiB/s wr, 58 op/s 2024-05-08T06:53:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:07 smithi070 ceph-mon[29591]: pgmap v201: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 506 KiB/s wr, 58 op/s 2024-05-08T06:53:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:07 smithi172 ceph-mon[33377]: pgmap v201: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 506 KiB/s wr, 58 op/s 2024-05-08T06:53:10.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:09 smithi172 ceph-mon[33377]: pgmap v202: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 189 KiB/s wr, 45 op/s 2024-05-08T06:53:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:09 smithi194 ceph-mon[33679]: pgmap v202: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 189 KiB/s wr, 45 op/s 2024-05-08T06:53:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:09 smithi070 ceph-mon[29591]: pgmap v202: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 189 KiB/s wr, 45 op/s 2024-05-08T06:53:12.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:11 smithi194 ceph-mon[33679]: pgmap v203: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 189 KiB/s wr, 45 op/s 2024-05-08T06:53:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:11 smithi070 ceph-mon[29591]: pgmap v203: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 189 KiB/s wr, 45 op/s 2024-05-08T06:53:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:11 smithi172 ceph-mon[33377]: pgmap v203: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 189 KiB/s wr, 45 op/s 2024-05-08T06:53:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:13 smithi070 ceph-mon[29591]: osdmap e95: 12 total, 12 up, 12 in 2024-05-08T06:53:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:13 smithi172 ceph-mon[33377]: osdmap e95: 12 total, 12 up, 12 in 2024-05-08T06:53:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:13 smithi194 ceph-mon[33679]: osdmap e95: 12 total, 12 up, 12 in 2024-05-08T06:53:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:14 smithi070 ceph-mon[29591]: pgmap v205: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-05-08T06:53:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:14 smithi172 ceph-mon[33377]: pgmap v205: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-05-08T06:53:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:14 smithi194 ceph-mon[33679]: pgmap v205: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2024-05-08T06:53:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:16 smithi070 ceph-mon[29591]: pgmap v206: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-08T06:53:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:16 smithi172 ceph-mon[33377]: pgmap v206: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-08T06:53:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:16 smithi194 ceph-mon[33679]: pgmap v206: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-08T06:53:18.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:18 smithi070 ceph-mon[29591]: pgmap v207: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-05-08T06:53:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:18 smithi172 ceph-mon[33377]: pgmap v207: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-05-08T06:53:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:18 smithi194 ceph-mon[33679]: pgmap v207: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-05-08T06:53:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:20 smithi070 ceph-mon[29591]: pgmap v208: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2024-05-08T06:53:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:20 smithi172 ceph-mon[33377]: pgmap v208: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2024-05-08T06:53:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:20 smithi194 ceph-mon[33679]: pgmap v208: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2024-05-08T06:53:22.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:22 smithi070 ceph-mon[29591]: pgmap v209: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2024-05-08T06:53:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:22 smithi172 ceph-mon[33377]: pgmap v209: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2024-05-08T06:53:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:22 smithi194 ceph-mon[33679]: pgmap v209: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 8 op/s 2024-05-08T06:53:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:24 smithi070 ceph-mon[29591]: pgmap v210: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2024-05-08T06:53:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:24 smithi172 ceph-mon[33377]: pgmap v210: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2024-05-08T06:53:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:24 smithi194 ceph-mon[33679]: pgmap v210: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2024-05-08T06:53:26.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:26 smithi070 ceph-mon[29591]: pgmap v211: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-08T06:53:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:26 smithi172 ceph-mon[33377]: pgmap v211: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-08T06:53:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:26 smithi194 ceph-mon[33679]: pgmap v211: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 10 op/s 2024-05-08T06:53:28.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:28 smithi070 ceph-mon[29591]: pgmap v212: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 6 op/s 2024-05-08T06:53:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:28 smithi172 ceph-mon[33377]: pgmap v212: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 6 op/s 2024-05-08T06:53:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:28 smithi194 ceph-mon[33679]: pgmap v212: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 7.1 KiB/s wr, 6 op/s 2024-05-08T06:53:28.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:53:29.128 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:53:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:30 smithi172 ceph-mon[33377]: pgmap v213: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 9 op/s 2024-05-08T06:53:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:30 smithi194 ceph-mon[33679]: pgmap v213: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 9 op/s 2024-05-08T06:53:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:30 smithi070 ceph-mon[29591]: pgmap v213: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 9 op/s 2024-05-08T06:53:31.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.663+0000 7fc3f1c00700 1 -- 172.21.15.70:0/1773135659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06b1b0 msgr2=0x7fc3ec06b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:31.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.663+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/1773135659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06b1b0 0x7fc3ec06b590 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc009990 tx=0x7fc3dc009ca0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.663+0000 7fc3f1c00700 1 -- 172.21.15.70:0/1773135659 shutdown_connections 2024-05-08T06:53:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.663+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/1773135659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec10ff50 0x7fc3ec112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.663+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/1773135659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06b1b0 0x7fc3ec06b590 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.663+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/1773135659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3ec06bad0 0x7fc3ec10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.663+0000 7fc3f1c00700 1 -- 172.21.15.70:0/1773135659 >> 172.21.15.70:0/1773135659 conn(0x7fc3ec079350 msgr2=0x7fc3ec079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.664+0000 7fc3f1c00700 1 -- 172.21.15.70:0/1773135659 shutdown_connections 2024-05-08T06:53:31.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.664+0000 7fc3f1c00700 1 -- 172.21.15.70:0/1773135659 wait complete. 2024-05-08T06:53:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.665+0000 7fc3f1c00700 1 Processor -- start 2024-05-08T06:53:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.665+0000 7fc3f1c00700 1 -- start start 2024-05-08T06:53:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.665+0000 7fc3f1c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec06b1b0 0x7fc3ec1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.665+0000 7fc3f1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06bad0 0x7fc3ec1a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.665+0000 7fc3f1c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3ec10ff50 0x7fc3ec19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.665+0000 7fc3f1c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec115780 con 0x7fc3ec06bad0 2024-05-08T06:53:31.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.665+0000 7fc3f1c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec115600 con 0x7fc3ec06b1b0 2024-05-08T06:53:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.665+0000 7fc3f1c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec115900 con 0x7fc3ec10ff50 2024-05-08T06:53:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3ea000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06bad0 0x7fc3ec1a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3ea000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06bad0 0x7fc3ec1a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41368/0 (socket says 172.21.15.70:41368) 2024-05-08T06:53:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3ea000700 1 -- 172.21.15.70:0/3012891478 learned_addr learned my addr 172.21.15.70:0/3012891478 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3eaa00700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec06b1b0 0x7fc3ec1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3eb400700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3ec10ff50 0x7fc3ec19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3ea000700 1 -- 172.21.15.70:0/3012891478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3ec10ff50 msgr2=0x7fc3ec19bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:31.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3ea000700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3ec10ff50 0x7fc3ec19bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3ea000700 1 -- 172.21.15.70:0/3012891478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec06b1b0 msgr2=0x7fc3ec1a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3ea000700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec06b1b0 0x7fc3ec1a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.666+0000 7fc3ea000700 1 -- 172.21.15.70:0/3012891478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec19c220 con 0x7fc3ec06bad0 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.667+0000 7fc3ea000700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06bad0 0x7fc3ec1a1e40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800b530 tx=0x7fc3d800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.667+0000 7fc3e3400700 1 -- 172.21.15.70:0/3012891478 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8015020 con 0x7fc3ec06bad0 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.667+0000 7fc3e3400700 1 -- 172.21.15.70:0/3012891478 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3d8011cc0 con 0x7fc3ec06bad0 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.667+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec19c510 con 0x7fc3ec06bad0 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.667+0000 7fc3e3400700 1 -- 172.21.15.70:0/3012891478 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8010d30 con 0x7fc3ec06bad0 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.667+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ec1a87d0 con 0x7fc3ec06bad0 2024-05-08T06:53:31.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.668+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3ec06a190 con 0x7fc3ec06bad0 2024-05-08T06:53:31.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.671+0000 7fc3e3400700 1 -- 172.21.15.70:0/3012891478 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc3d8018020 con 0x7fc3ec06bad0 2024-05-08T06:53:31.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.673+0000 7fc3e3400700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3d00b2a70 0x7fc3d00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:31.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.673+0000 7fc3e3400700 1 -- 172.21.15.70:0/3012891478 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9583+0+0 (secure 0 0 0) 0x7fc3d80e27c0 con 0x7fc3ec06bad0 2024-05-08T06:53:31.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.673+0000 7fc3eaa00700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3d00b2a70 0x7fc3d00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:31.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.673+0000 7fc3eaa00700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3d00b2a70 0x7fc3d00b4f30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc006010 tx=0x7fc3dc01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:31.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.675+0000 7fc3e3400700 1 -- 172.21.15.70:0/3012891478 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc3d801f020 con 0x7fc3ec06bad0 2024-05-08T06:53:31.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.958+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3ec02e510 con 0x7fc3ec06bad0 2024-05-08T06:53:31.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.960+0000 7fc3e3400700 1 -- 172.21.15.70:0/3012891478 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fc3d80a9e30 con 0x7fc3ec06bad0 2024-05-08T06:53:31.960 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:53:31.960 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:53:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3d00b2a70 msgr2=0x7fc3d00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3d00b2a70 0x7fc3d00b4f30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc006010 tx=0x7fc3dc01a040 comp rx=0 tx=0).stop 2024-05-08T06:53:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06bad0 msgr2=0x7fc3ec1a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06bad0 0x7fc3ec1a1e40 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800b530 tx=0x7fc3d800b8f0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 shutdown_connections 2024-05-08T06:53:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3d00b2a70 0x7fc3d00b4f30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3ec10ff50 0x7fc3ec19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3ec06b1b0 0x7fc3ec1a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 --2- 172.21.15.70:0/3012891478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3ec06bad0 0x7fc3ec1a1e40 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:31.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.963+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 >> 172.21.15.70:0/3012891478 conn(0x7fc3ec079350 msgr2=0x7fc3ec111400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:31.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.964+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 shutdown_connections 2024-05-08T06:53:31.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:31.964+0000 7fc3f1c00700 1 -- 172.21.15.70:0/3012891478 wait complete. 2024-05-08T06:53:31.964 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:53:32.357 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:32 smithi070 ceph-mon[29591]: pgmap v214: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T06:53:32.357 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:32 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3012891478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:53:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:32 smithi172 ceph-mon[33377]: pgmap v214: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T06:53:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:32 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3012891478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:53:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:32 smithi194 ceph-mon[33679]: pgmap v214: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T06:53:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:32 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3012891478' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:53:32.847 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id d37936f9 --release --await' 2024-05-08T06:53:32.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id d37936f9 --release --await 2024-05-08T06:53:33.285 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:53:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:34 smithi070 ceph-mon[29591]: pgmap v215: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T06:53:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:34 smithi172 ceph-mon[33377]: pgmap v215: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T06:53:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:34 smithi194 ceph-mon[33679]: pgmap v215: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T06:53:35.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.643+0000 7fa1e1e00700 1 -- 172.21.15.70:0/1939587995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104630 msgr2=0x7fa1dc104a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:35.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.643+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/1939587995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104630 0x7fa1dc104a10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009990 tx=0x7fa1d0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.643+0000 7fa1e1e00700 1 -- 172.21.15.70:0/1939587995 shutdown_connections 2024-05-08T06:53:35.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.643+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/1939587995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc10da10 0x7fa1dc10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.643+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/1939587995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104630 0x7fa1dc104a10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.643+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/1939587995 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1dc104f50 0x7fa1dc10d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.643+0000 7fa1e1e00700 1 -- 172.21.15.70:0/1939587995 >> 172.21.15.70:0/1939587995 conn(0x7fa1dc0fddc0 msgr2=0x7fa1dc1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:35.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.643+0000 7fa1e1e00700 1 -- 172.21.15.70:0/1939587995 shutdown_connections 2024-05-08T06:53:35.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.643+0000 7fa1e1e00700 1 -- 172.21.15.70:0/1939587995 wait complete. 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.644+0000 7fa1e1e00700 1 Processor -- start 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.644+0000 7fa1e1e00700 1 -- start start 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1e1e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1dc104630 0x7fa1dc103e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1e1e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104f50 0x7fa1dc102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1e1e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc10da10 0x7fa1dc1028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1e1e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc1134d0 con 0x7fa1dc104f50 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1e1e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc113350 con 0x7fa1dc104630 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1e1e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc113650 con 0x7fa1dc10da10 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1dbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104f50 0x7fa1dc102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1dbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104f50 0x7fa1dc102290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41374/0 (socket says 172.21.15.70:41374) 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1dbe00700 1 -- 172.21.15.70:0/2259724179 learned_addr learned my addr 172.21.15.70:0/2259724179 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:35.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1dc104630 0x7fa1dc103e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.645+0000 7fa1e1400700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc10da10 0x7fa1dc1028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1dbe00700 1 -- 172.21.15.70:0/2259724179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc10da10 msgr2=0x7fa1dc1028f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:35.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc10da10 0x7fa1dc1028f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1dbe00700 1 -- 172.21.15.70:0/2259724179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1dc104630 msgr2=0x7fa1dc103e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:35.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1dc104630 0x7fa1dc103e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1dbe00700 1 -- 172.21.15.70:0/2259724179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1dc1ac480 con 0x7fa1dc104f50 2024-05-08T06:53:35.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104f50 0x7fa1dc102290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800d980 tx=0x7fa1c800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1d9600700 1 -- 172.21.15.70:0/2259724179 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8017070 con 0x7fa1dc104f50 2024-05-08T06:53:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1d9600700 1 -- 172.21.15.70:0/2259724179 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c8010460 con 0x7fa1dc104f50 2024-05-08T06:53:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1e1e00700 1 -- 172.21.15.70:0/2259724179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1dc1ac710 con 0x7fa1dc104f50 2024-05-08T06:53:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.646+0000 7fa1d9600700 1 -- 172.21.15.70:0/2259724179 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c800de60 con 0x7fa1dc104f50 2024-05-08T06:53:35.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.647+0000 7fa1e1e00700 1 -- 172.21.15.70:0/2259724179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1dc1acc20 con 0x7fa1dc104f50 2024-05-08T06:53:35.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.651+0000 7fa1d9600700 1 -- 172.21.15.70:0/2259724179 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa1c8010610 con 0x7fa1dc104f50 2024-05-08T06:53:35.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.651+0000 7fa1ede51b80 1 Processor -- start 2024-05-08T06:53:35.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.651+0000 7fa1ede51b80 1 -- start start 2024-05-08T06:53:35.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 0x55b283dbc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dbcda0 0x55b283dbd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b283d0eb20 con 0x55b283dc2250 2024-05-08T06:53:35.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b283cac860 con 0x55b283dbcda0 2024-05-08T06:53:35.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b283d0aae0 con 0x55b283dc2b70 2024-05-08T06:53:35.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1e1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1e1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41384/0 (socket says 172.21.15.70:41384) 2024-05-08T06:53:35.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1e1400700 1 -- 172.21.15.70:0/3128249787 learned_addr learned my addr 172.21.15.70:0/3128249787 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/3128249787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 0x55b283dbc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.652+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/3128249787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dbcda0 0x55b283dbd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1e1400700 1 -- 172.21.15.70:0/3128249787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 msgr2=0x55b283dbc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1e1400700 1 --2- 172.21.15.70:0/3128249787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 0x55b283dbc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1e1400700 1 -- 172.21.15.70:0/3128249787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dbcda0 msgr2=0x55b283dbd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1e1400700 1 --2- 172.21.15.70:0/3128249787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dbcda0 0x55b283dbd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1e1400700 1 -- 172.21.15.70:0/3128249787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b283c5b9d0 con 0x55b283dc2250 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1d9600700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1c40b29f0 0x7fa1c40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1e1400700 1 --2- 172.21.15.70:0/3128249787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc2630 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009d20 tx=0x7fa1d40077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55239d45d5ff0a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1d9600700 1 -- 172.21.15.70:0/2259724179 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9583+0+0 (secure 0 0 0) 0x7fa1c80e25a0 con 0x7fa1dc104f50 2024-05-08T06:53:35.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1c40b29f0 0x7fa1c40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.653+0000 7fa1ce000700 1 -- 172.21.15.70:0/3128249787 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4004bb0 con 0x55b283dc2250 2024-05-08T06:53:35.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1ce000700 1 -- 172.21.15.70:0/3128249787 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1d4004d50 con 0x55b283dc2250 2024-05-08T06:53:35.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1ce000700 1 -- 172.21.15.70:0/3128249787 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4014670 con 0x55b283dc2250 2024-05-08T06:53:35.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1ede51b80 1 -- 172.21.15.70:0/3128249787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 msgr2=0x55b283dc2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:35.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1c40b29f0 0x7fa1c40b4eb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0003760 tx=0x7fa1d001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:35.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/3128249787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc2630 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009d20 tx=0x7fa1d40077e0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1ede51b80 1 -- 172.21.15.70:0/3128249787 shutdown_connections 2024-05-08T06:53:35.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/3128249787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dbcda0 0x55b283dbd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/3128249787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc2630 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/3128249787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 0x55b283dbc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.654+0000 7fa1ede51b80 1 -- 172.21.15.70:0/3128249787 >> 172.21.15.70:0/3128249787 conn(0x55b283d347d0 msgr2=0x55b283db72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.655+0000 7fa1ede51b80 1 -- 172.21.15.70:0/3128249787 shutdown_connections 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.655+0000 7fa1ede51b80 1 -- 172.21.15.70:0/3128249787 wait complete. 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.655+0000 7fa1ede51b80 1 -- start start 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.655+0000 7fa1ede51b80 1 Processor -- start 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dbcda0 0x55b283dc88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 0x55b283dc5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 0x55b283dc6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b283dc9690 con 0x55b283dbcda0 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b283c74c20 con 0x55b283dc2250 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b283dc9810 con 0x55b283dc2b70 2024-05-08T06:53:35.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1ede51b80 10 client.0 _ll_register_callbacks cb 0x55b283cb5d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:53:35.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1e0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dbcda0 0x55b283dc88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1e0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dbcda0 0x55b283dc88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41390/0 (socket says 172.21.15.70:41390) 2024-05-08T06:53:35.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.656+0000 7fa1e0a00700 1 -- 172.21.15.70:0/264127413 learned_addr learned my addr 172.21.15.70:0/264127413 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.657+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 0x55b283dc5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.657+0000 7fa1e1400700 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 0x55b283dc6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.657+0000 7fa1e0a00700 1 -- 172.21.15.70:0/264127413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 msgr2=0x55b283dc6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.657+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 0x55b283dc6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.657+0000 7fa1e0a00700 1 -- 172.21.15.70:0/264127413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 msgr2=0x55b283dc5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.657+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 0x55b283dc5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.657+0000 7fa1e0a00700 1 -- 172.21.15.70:0/264127413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b283cd4520 con 0x55b283dbcda0 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.657+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dbcda0 0x55b283dc88e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009990 tx=0x7fa1d0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67474acbd5e37381 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.657+0000 7fa1c2a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.658+0000 7fa1c2a00700 1 -- 172.21.15.70:0/264127413 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0034060 con 0x55b283dbcda0 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.658+0000 7fa1c2a00700 1 -- 172.21.15.70:0/264127413 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9583+0+0 (secure 0 0 0) 0x7fa1d0003bd0 con 0x55b283dbcda0 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.658+0000 7fa1ede51b80 1 -- 172.21.15.70:0/264127413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1d4004d50 con 0x55b283dbcda0 2024-05-08T06:53:35.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.658+0000 7fa1c2a00700 1 -- 172.21.15.70:0/264127413 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa1d003b050 con 0x55b283dbcda0 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.658+0000 7fa1ede51b80 10 client.15645 fetch_fsmap learned FSMap version 28 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.658+0000 7fa1ede51b80 1 -- 172.21.15.70:0/264127413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b283dd3f80 con 0x55b283dbcda0 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.658+0000 7fa1c2a00700 1 -- 172.21.15.70:0/264127413 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1d4004d50 con 0x55b283dbcda0 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.659+0000 7fa1c2a00700 1 -- 172.21.15.70:0/264127413 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa1d0024410 con 0x55b283dbcda0 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.659+0000 7fa1ede51b80 10 client.15645 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.659+0000 7fa1ede51b80 10 client.15645 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.659+0000 7fa1ede51b80 20 client.15645 populate_metadata read hostname 'smithi070' 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.659+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b283dd6610 0x55b283dd8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.659+0000 7fa1ede51b80 4 client.15645 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.659+0000 7fa1ede51b80 1 -- 172.21.15.70:0/264127413 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b283d89240 con 0x55b283dd6610 2024-05-08T06:53:35.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.659+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b283dd6610 0x55b283dd8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.660+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b283dd6610 0x55b283dd8a60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bedb7a117b0d29d server_cookie=3759255d9de46199 in_seq=0 out_seq=0 2024-05-08T06:53:35.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.660+0000 7fa1c2a00700 10 client.15645 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:53:35.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.662+0000 7fa1c2a00700 1 -- 172.21.15.70:0/264127413 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b283d89240 con 0x55b283dd6610 2024-05-08T06:53:35.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.662+0000 7fa1c2a00700 10 client.15645 handle_command_reply: tid=0 2024-05-08T06:53:35.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.662+0000 7fa1ede51b80 1 client.15645 shutdown 2024-05-08T06:53:35.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 -- 172.21.15.70:0/264127413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dbcda0 msgr2=0x55b283dc88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dbcda0 0x55b283dc88e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0009990 tx=0x7fa1d0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 -- 172.21.15.70:0/264127413 shutdown_connections 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b283dd6610 0x55b283dd8a60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dc2b70 0x55b283dc6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dbcda0 0x55b283dc88e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1c2a00700 0 client.15645 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/264127413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 0x55b283dc5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 -- 172.21.15.70:0/264127413 >> 172.21.15.70:0/264127413 conn(0x55b283d347d0 msgr2=0x55b283dbb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 -- 172.21.15.70:0/264127413 shutdown_connections 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 1 -- 172.21.15.70:0/264127413 wait complete. 2024-05-08T06:53:35.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.663+0000 7fa1ede51b80 20 client.15645 trim_cache size 0 max 16384 2024-05-08T06:53:35.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.685+0000 7fa1ede51b80 1 Processor -- start 2024-05-08T06:53:35.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.685+0000 7fa1ede51b80 1 -- start start 2024-05-08T06:53:35.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.685+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 0x55b283dc6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.685+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.685+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2b70 0x55b283dd2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.685+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc1b8440 con 0x55b283dc2250 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.685+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc1b5cd0 con 0x55b283dc2b70 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.685+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc1b3b40 con 0x55b283dbcda0 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1dbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1dbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41392/0 (socket says 172.21.15.70:41392) 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1dbe00700 1 -- 172.21.15.70:0/1050538186 learned_addr learned my addr 172.21.15.70:0/1050538186 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1e1400700 1 --2- 172.21.15.70:0/1050538186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2b70 0x55b283dd2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/1050538186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 0x55b283dc6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1dbe00700 1 -- 172.21.15.70:0/1050538186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 msgr2=0x55b283dc6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/1050538186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 0x55b283dc6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1dbe00700 1 -- 172.21.15.70:0/1050538186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2b70 msgr2=0x55b283dd2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/1050538186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2b70 0x55b283dd2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1dbe00700 1 -- 172.21.15.70:0/1050538186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b283dd2c60 con 0x55b283dc2250 2024-05-08T06:53:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.686+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/1050538186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc03e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8005cf0 tx=0x7fa1c80e28a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3432476751135342 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.687+0000 7fa1cd600700 1 -- 172.21.15.70:0/1050538186 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8020040 con 0x55b283dc2250 2024-05-08T06:53:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.687+0000 7fa1cd600700 1 -- 172.21.15.70:0/1050538186 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c80ad810 con 0x55b283dc2250 2024-05-08T06:53:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.687+0000 7fa1cd600700 1 -- 172.21.15.70:0/1050538186 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80b1e30 con 0x55b283dc2250 2024-05-08T06:53:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.687+0000 7fa1ede51b80 1 -- 172.21.15.70:0/1050538186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 msgr2=0x55b283dc03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.687+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/1050538186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc03e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8005cf0 tx=0x7fa1c80e28a0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.688+0000 7fa1ede51b80 1 -- 172.21.15.70:0/1050538186 shutdown_connections 2024-05-08T06:53:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.688+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/1050538186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2b70 0x55b283dd2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.688+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/1050538186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 0x55b283dc6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.688+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/1050538186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2250 0x55b283dc03e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.688+0000 7fa1ede51b80 1 -- 172.21.15.70:0/1050538186 >> 172.21.15.70:0/1050538186 conn(0x55b283d347d0 msgr2=0x55b283dbfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.688+0000 7fa1ede51b80 1 -- 172.21.15.70:0/1050538186 shutdown_connections 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.688+0000 7fa1ede51b80 1 -- 172.21.15.70:0/1050538186 wait complete. 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.688+0000 7fa1ede51b80 1 -- start start 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1ede51b80 1 Processor -- start 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 0x55b283dcba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 0x55b283dcbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1ede51b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2b70 0x55b283dcc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc1b4190 con 0x55b283dc2b70 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc1b5600 con 0x55b283dc2250 2024-05-08T06:53:35.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1ede51b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1dc1b4860 con 0x55b283dbcda0 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1ede51b80 10 client.0 _ll_register_callbacks cb 0x55b283cb5d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1e1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2b70 0x55b283dcc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1e1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2b70 0x55b283dcc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41402/0 (socket says 172.21.15.70:41402) 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.689+0000 7fa1e1400700 1 -- 172.21.15.70:0/2146420865 learned_addr learned my addr 172.21.15.70:0/2146420865 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.690+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 0x55b283dcba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.690+0000 7fa1dbe00700 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 0x55b283dcbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.690+0000 7fa1e1400700 1 -- 172.21.15.70:0/2146420865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 msgr2=0x55b283dcba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.690+0000 7fa1e1400700 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 0x55b283dcba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.690+0000 7fa1e1400700 1 -- 172.21.15.70:0/2146420865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 msgr2=0x55b283dcbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.690+0000 7fa1e1400700 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 0x55b283dcbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:35.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.690+0000 7fa1e1400700 1 -- 172.21.15.70:0/2146420865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b283e40f30 con 0x55b283dc2b70 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.690+0000 7fa1e1400700 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2b70 0x55b283dcc4f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009fa0 tx=0x7fa1d401dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cfad62a9c2d327 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.690+0000 7fa1c2a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.691+0000 7fa1c2a00700 1 -- 172.21.15.70:0/2146420865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d4004ca0 con 0x55b283dc2b70 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.691+0000 7fa1c2a00700 1 -- 172.21.15.70:0/2146420865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9583+0+0 (secure 0 0 0) 0x7fa1d4005050 con 0x55b283dc2b70 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.691+0000 7fa1ede51b80 1 -- 172.21.15.70:0/2146420865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1c80ad810 con 0x55b283dc2b70 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.691+0000 7fa1c2a00700 1 -- 172.21.15.70:0/2146420865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa1d402c050 con 0x55b283dc2b70 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.691+0000 7fa1ede51b80 10 client.15651 fetch_fsmap learned FSMap version 28 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.691+0000 7fa1ede51b80 1 -- 172.21.15.70:0/2146420865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b283e421f0 con 0x55b283dc2b70 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.691+0000 7fa1c2a00700 1 -- 172.21.15.70:0/2146420865 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c80ad810 con 0x55b283dc2b70 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.691+0000 7fa1c2a00700 1 -- 172.21.15.70:0/2146420865 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa1d4024070 con 0x55b283dc2b70 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.692+0000 7fa1ede51b80 10 client.15651 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:53:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.692+0000 7fa1ede51b80 10 client.15651 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:53:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.692+0000 7fa1ede51b80 20 client.15651 populate_metadata read hostname 'smithi070' 2024-05-08T06:53:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.692+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b283e42510 0x55b283e44900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.692+0000 7fa1ede51b80 4 client.15651 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d37936f9", "release": true, "await": true}] 2024-05-08T06:53:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.692+0000 7fa1ede51b80 1 -- 172.21.15.70:0/2146420865 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d37936f9", "release": true, "await": true}) -- 0x55b283d1c500 con 0x55b283e42510 2024-05-08T06:53:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.692+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b283e42510 0x55b283e44900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.693+0000 7fa1e0a00700 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b283e42510 0x55b283e44900 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78fc7c192c7eb038 server_cookie=f38ee2ca055eb85b in_seq=0 out_seq=0 2024-05-08T06:53:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:35.693+0000 7fa1c2a00700 10 client.15651 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:53:36.410 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:36 smithi070 ceph-mon[29591]: pgmap v216: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.9 KiB/s wr, 8 op/s 2024-05-08T06:53:36.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.410+0000 7fa1c2a00700 1 -- 172.21.15.70:0/2146420865 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55b283d1c500 con 0x55b283e42510 2024-05-08T06:53:36.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.410+0000 7fa1c2a00700 10 client.15651 handle_command_reply: tid=0 2024-05-08T06:53:36.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.410+0000 7fa1ede51b80 1 client.15651 shutdown 2024-05-08T06:53:36.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.411+0000 7fa1ede51b80 1 -- 172.21.15.70:0/2146420865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2b70 msgr2=0x55b283dcc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:36.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.411+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2b70 0x55b283dcc4f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4009fa0 tx=0x7fa1d401dbf0 comp rx=0 tx=0).stop 2024-05-08T06:53:36.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.411+0000 7fa1ede51b80 1 -- 172.21.15.70:0/2146420865 shutdown_connections 2024-05-08T06:53:36.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.411+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b283e42510 0x55b283e44900 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:36.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.411+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b283dc2b70 0x55b283dcc4f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.411+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b283dbcda0 0x55b283dcba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.411+0000 7fa1ede51b80 1 --2- 172.21.15.70:0/2146420865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b283dc2250 0x55b283dcbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.411+0000 7fa1ede51b80 1 -- 172.21.15.70:0/2146420865 >> 172.21.15.70:0/2146420865 conn(0x55b283d347d0 msgr2=0x55b283dc0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.411+0000 7fa1c2a00700 0 client.15651 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:53:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.412+0000 7fa1ede51b80 1 -- 172.21.15.70:0/2146420865 shutdown_connections 2024-05-08T06:53:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.412+0000 7fa1ede51b80 1 -- 172.21.15.70:0/2146420865 wait complete. 2024-05-08T06:53:36.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.412+0000 7fa1ede51b80 20 client.15651 trim_cache size 0 max 16384 2024-05-08T06:53:36.413 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:53:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:53:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:53:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 20, 2024-05-08T06:53:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:53:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "d37936f9": { 2024-05-08T06:53:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 20, 2024-05-08T06:53:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:53:36.414 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:53:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:53:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:53:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:53:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:53:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.7, 2024-05-08T06:53:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:53:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:53:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:53:36.415 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:53:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:53:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:53:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:36.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:36.416 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:53:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 -- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1c40b29f0 msgr2=0x7fa1c40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1c40b29f0 0x7fa1c40b4eb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0003760 tx=0x7fa1d001a040 comp rx=0 tx=0).stop 2024-05-08T06:53:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 -- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104f50 msgr2=0x7fa1dc102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:36.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104f50 0x7fa1dc102290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800d980 tx=0x7fa1c800dd40 comp rx=0 tx=0).stop 2024-05-08T06:53:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 -- 172.21.15.70:0/2259724179 shutdown_connections 2024-05-08T06:53:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1c40b29f0 0x7fa1c40b4eb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1dc10da10 0x7fa1dc1028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1dc104630 0x7fa1dc103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 --2- 172.21.15.70:0/2259724179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1dc104f50 0x7fa1dc102290 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.413+0000 7fa1e1e00700 1 -- 172.21.15.70:0/2259724179 >> 172.21.15.70:0/2259724179 conn(0x7fa1dc0fddc0 msgr2=0x7fa1dc0fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.414+0000 7fa1e1e00700 1 -- 172.21.15.70:0/2259724179 shutdown_connections 2024-05-08T06:53:36.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:36.414+0000 7fa1e1e00700 1 -- 172.21.15.70:0/2259724179 wait complete. 2024-05-08T06:53:36.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:36 smithi172 ceph-mon[33377]: pgmap v216: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.9 KiB/s wr, 8 op/s 2024-05-08T06:53:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:36 smithi194 ceph-mon[33679]: pgmap v216: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.9 KiB/s wr, 8 op/s 2024-05-08T06:53:37.343 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd37936f9', seconds elapsed: 49.9 2024-05-08T06:53:37.343 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.7 2024-05-08T06:53:37.343 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:53:37.819 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:53:38.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:38 smithi070 ceph-mon[29591]: pgmap v217: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 5 op/s 2024-05-08T06:53:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:38 smithi172 ceph-mon[33377]: pgmap v217: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 5 op/s 2024-05-08T06:53:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:38 smithi194 ceph-mon[33679]: pgmap v217: 129 pgs: 129 active+clean; 243 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.4 KiB/s wr, 5 op/s 2024-05-08T06:53:40.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:40 smithi070 ceph-mon[29591]: pgmap v218: 129 pgs: 129 active+clean; 244 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 120 KiB/s wr, 26 op/s 2024-05-08T06:53:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.356+0000 7fa696400700 1 -- 172.21.15.70:0/586146528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901056e0 msgr2=0x7fa690105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.356+0000 7fa696400700 1 --2- 172.21.15.70:0/586146528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901056e0 0x7fa690105b60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009990 tx=0x7fa67c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.357+0000 7fa696400700 1 -- 172.21.15.70:0/586146528 shutdown_connections 2024-05-08T06:53:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.357+0000 7fa696400700 1 --2- 172.21.15.70:0/586146528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6901060a0 0x7fa6901125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.357+0000 7fa696400700 1 --2- 172.21.15.70:0/586146528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69010b6e0 0x7fa69010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.357+0000 7fa696400700 1 --2- 172.21.15.70:0/586146528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901056e0 0x7fa690105b60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.357+0000 7fa696400700 1 -- 172.21.15.70:0/586146528 >> 172.21.15.70:0/586146528 conn(0x7fa6901011d0 msgr2=0x7fa6901035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:40.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.357+0000 7fa696400700 1 -- 172.21.15.70:0/586146528 shutdown_connections 2024-05-08T06:53:40.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.357+0000 7fa696400700 1 -- 172.21.15.70:0/586146528 wait complete. 2024-05-08T06:53:40.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.358+0000 7fa696400700 1 Processor -- start 2024-05-08T06:53:40.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.358+0000 7fa696400700 1 -- start start 2024-05-08T06:53:40.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.358+0000 7fa696400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6901056e0 0x7fa6901a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:40.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.358+0000 7fa696400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901060a0 0x7fa6901a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:40.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.358+0000 7fa696400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69010b6e0 0x7fa69019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.358+0000 7fa696400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6901157e0 con 0x7fa6901060a0 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.358+0000 7fa696400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa690115660 con 0x7fa69010b6e0 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.358+0000 7fa696400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa690115960 con 0x7fa6901056e0 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901060a0 0x7fa6901a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901060a0 0x7fa6901a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34394/0 (socket says 172.21.15.70:34394) 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68ea00700 1 -- 172.21.15.70:0/3407813556 learned_addr learned my addr 172.21.15.70:0/3407813556 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68fe00700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69010b6e0 0x7fa69019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68f400700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6901056e0 0x7fa6901a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68ea00700 1 -- 172.21.15.70:0/3407813556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6901056e0 msgr2=0x7fa6901a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68ea00700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6901056e0 0x7fa6901a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68ea00700 1 -- 172.21.15.70:0/3407813556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69010b6e0 msgr2=0x7fa69019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68ea00700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69010b6e0 0x7fa69019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.359+0000 7fa68ea00700 1 -- 172.21.15.70:0/3407813556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69019c400 con 0x7fa6901060a0 2024-05-08T06:53:40.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.360+0000 7fa68ea00700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901060a0 0x7fa6901a1f90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa67c005910 tx=0x7fa67c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:40.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.360+0000 7fa687e00700 1 -- 172.21.15.70:0/3407813556 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c027070 con 0x7fa6901060a0 2024-05-08T06:53:40.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.360+0000 7fa687e00700 1 -- 172.21.15.70:0/3407813556 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa67c00fc00 con 0x7fa6901060a0 2024-05-08T06:53:40.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.360+0000 7fa687e00700 1 -- 172.21.15.70:0/3407813556 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c022d40 con 0x7fa6901060a0 2024-05-08T06:53:40.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.360+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69019c690 con 0x7fa6901060a0 2024-05-08T06:53:40.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.360+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6901a8800 con 0x7fa6901060a0 2024-05-08T06:53:40.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.362+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa690106e20 con 0x7fa6901060a0 2024-05-08T06:53:40.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.364+0000 7fa687e00700 1 -- 172.21.15.70:0/3407813556 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa67c02a070 con 0x7fa6901060a0 2024-05-08T06:53:40.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.367+0000 7fa687e00700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6740b2a70 0x7fa6740b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:40.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.368+0000 7fa687e00700 1 -- 172.21.15.70:0/3407813556 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9583+0+0 (secure 0 0 0) 0x7fa67c0e3750 con 0x7fa6901060a0 2024-05-08T06:53:40.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.368+0000 7fa68f400700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6740b2a70 0x7fa6740b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:40.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.368+0000 7fa68f400700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6740b2a70 0x7fa6740b4f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa680005fd0 tx=0x7fa680005db0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:40.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.372+0000 7fa687e00700 1 -- 172.21.15.70:0/3407813556 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa67c05fdf0 con 0x7fa6901060a0 2024-05-08T06:53:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:40 smithi172 ceph-mon[33377]: pgmap v218: 129 pgs: 129 active+clean; 244 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 120 KiB/s wr, 26 op/s 2024-05-08T06:53:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:40 smithi194 ceph-mon[33679]: pgmap v218: 129 pgs: 129 active+clean; 244 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 120 KiB/s wr, 26 op/s 2024-05-08T06:53:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.721+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa69002e510 con 0x7fa6901060a0 2024-05-08T06:53:40.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.722+0000 7fa687e00700 1 -- 172.21.15.70:0/3407813556 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fa67c013070 con 0x7fa6901060a0 2024-05-08T06:53:40.722 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:53:40.722 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:53:40.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.725+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6740b2a70 msgr2=0x7fa6740b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:40.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6740b2a70 0x7fa6740b4f30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa680005fd0 tx=0x7fa680005db0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901060a0 msgr2=0x7fa6901a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:40.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901060a0 0x7fa6901a1f90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa67c005910 tx=0x7fa67c0047b0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 shutdown_connections 2024-05-08T06:53:40.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6740b2a70 0x7fa6740b4f30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa69010b6e0 0x7fa69019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6901056e0 0x7fa6901a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 --2- 172.21.15.70:0/3407813556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6901060a0 0x7fa6901a1f90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:40.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 >> 172.21.15.70:0/3407813556 conn(0x7fa6901011d0 msgr2=0x7fa6901018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:40.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 shutdown_connections 2024-05-08T06:53:40.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:40.726+0000 7fa696400700 1 -- 172.21.15.70:0/3407813556 wait complete. 2024-05-08T06:53:40.726 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:53:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:41 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3407813556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:53:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:41 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3407813556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:53:41.575 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:41 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3407813556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:53:41.649 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 85.7 --await-for 42.0' 2024-05-08T06:53:41.649 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 85.7 --await-for 42.0 2024-05-08T06:53:42.132 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:53:42.466 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:42 smithi070 ceph-mon[29591]: pgmap v219: 129 pgs: 129 active+clean; 244 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 117 KiB/s wr, 23 op/s 2024-05-08T06:53:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:42 smithi194 ceph-mon[33679]: pgmap v219: 129 pgs: 129 active+clean; 244 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 117 KiB/s wr, 23 op/s 2024-05-08T06:53:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:42 smithi172 ceph-mon[33377]: pgmap v219: 129 pgs: 129 active+clean; 244 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 117 KiB/s wr, 23 op/s 2024-05-08T06:53:44.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:44 smithi070 ceph-mon[29591]: pgmap v220: 129 pgs: 129 active+clean; 244 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 117 KiB/s wr, 23 op/s 2024-05-08T06:53:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:44 smithi194 ceph-mon[33679]: pgmap v220: 129 pgs: 129 active+clean; 244 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 117 KiB/s wr, 23 op/s 2024-05-08T06:53:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:44 smithi172 ceph-mon[33377]: pgmap v220: 129 pgs: 129 active+clean; 244 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 117 KiB/s wr, 23 op/s 2024-05-08T06:53:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.718+0000 7efd48a00700 1 -- 172.21.15.70:0/898355590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd44108880 msgr2=0x7efd44110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.718+0000 7efd48a00700 1 --2- 172.21.15.70:0/898355590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd44108880 0x7efd44110400 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00b0d0 tx=0x7efd3c00b3e0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.718+0000 7efd48a00700 1 -- 172.21.15.70:0/898355590 shutdown_connections 2024-05-08T06:53:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.718+0000 7efd48a00700 1 --2- 172.21.15.70:0/898355590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd44108880 0x7efd44110400 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.718+0000 7efd48a00700 1 --2- 172.21.15.70:0/898355590 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd441037b0 0x7efd44103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.718+0000 7efd48a00700 1 --2- 172.21.15.70:0/898355590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd44104160 0x7efd44108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.718+0000 7efd48a00700 1 -- 172.21.15.70:0/898355590 >> 172.21.15.70:0/898355590 conn(0x7efd4407a580 msgr2=0x7efd4407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:44.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.719+0000 7efd48a00700 1 -- 172.21.15.70:0/898355590 shutdown_connections 2024-05-08T06:53:44.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.719+0000 7efd48a00700 1 -- 172.21.15.70:0/898355590 wait complete. 2024-05-08T06:53:44.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.720+0000 7efd48a00700 1 Processor -- start 2024-05-08T06:53:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.720+0000 7efd48a00700 1 -- start start 2024-05-08T06:53:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.720+0000 7efd48a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd441037b0 0x7efd441a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.720+0000 7efd48a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd44104160 0x7efd441a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.720+0000 7efd48a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd44108880 0x7efd4419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.720+0000 7efd48a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd44115770 con 0x7efd441037b0 2024-05-08T06:53:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.720+0000 7efd48a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd441155f0 con 0x7efd44104160 2024-05-08T06:53:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.720+0000 7efd48a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efd441158f0 con 0x7efd44108880 2024-05-08T06:53:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.721+0000 7efd41e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd441037b0 0x7efd441a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.721+0000 7efd41400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd44104160 0x7efd441a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.721+0000 7efd41400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd44104160 0x7efd441a1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:41190/0 (socket says 172.21.15.70:41190) 2024-05-08T06:53:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.721+0000 7efd41400700 1 -- 172.21.15.70:0/1060915427 learned_addr learned my addr 172.21.15.70:0/1060915427 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.721+0000 7efd42800700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd44108880 0x7efd4419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.722+0000 7efd41e00700 1 -- 172.21.15.70:0/1060915427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd44108880 msgr2=0x7efd4419b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.722+0000 7efd41e00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd44108880 0x7efd4419b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.722+0000 7efd41e00700 1 -- 172.21.15.70:0/1060915427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd44104160 msgr2=0x7efd441a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.722+0000 7efd41e00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd44104160 0x7efd441a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.722+0000 7efd41e00700 1 -- 172.21.15.70:0/1060915427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4419c010 con 0x7efd441037b0 2024-05-08T06:53:44.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.722+0000 7efd41e00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd441037b0 0x7efd441a16f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efd3400c970 tx=0x7efd3400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:44.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.723+0000 7efd3aa00700 1 -- 172.21.15.70:0/1060915427 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34004a30 con 0x7efd441037b0 2024-05-08T06:53:44.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.723+0000 7efd3aa00700 1 -- 172.21.15.70:0/1060915427 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd340054b0 con 0x7efd441037b0 2024-05-08T06:53:44.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.723+0000 7efd48a00700 1 -- 172.21.15.70:0/1060915427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4419c300 con 0x7efd441037b0 2024-05-08T06:53:44.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.723+0000 7efd3aa00700 1 -- 172.21.15.70:0/1060915427 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3400eae0 con 0x7efd441037b0 2024-05-08T06:53:44.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.723+0000 7efd48a00700 1 -- 172.21.15.70:0/1060915427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd441a85c0 con 0x7efd441037b0 2024-05-08T06:53:44.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.727+0000 7efd3aa00700 1 -- 172.21.15.70:0/1060915427 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7efd34004bd0 con 0x7efd441037b0 2024-05-08T06:53:44.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.728+0000 7efd533fdb80 1 Processor -- start 2024-05-08T06:53:44.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.728+0000 7efd533fdb80 1 -- start start 2024-05-08T06:53:44.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.729+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 0x55f7154ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.729+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.729+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.729+0000 7efd533fdb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f71541abb0 con 0x55f7154c8520 2024-05-08T06:53:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.729+0000 7efd533fdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f7153b88f0 con 0x55f7154c8ee0 2024-05-08T06:53:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.729+0000 7efd533fdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f715416b70 con 0x55f7154cdf50 2024-05-08T06:53:44.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.729+0000 7efd3aa00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efd280b2b20 0x7efd280b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:41198/0 (socket says 172.21.15.70:41198) 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41400700 1 -- 172.21.15.70:0/2290599177 learned_addr learned my addr 172.21.15.70:0/2290599177 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd42800700 1 --2- 172.21.15.70:0/2290599177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 0x55f7154ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd3aa00700 1 -- 172.21.15.70:0/1060915427 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9583+0+0 (secure 0 0 0) 0x7efd340e27f0 con 0x7efd441037b0 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd42800700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efd280b2b20 0x7efd280b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41e00700 1 -- 172.21.15.70:0/2290599177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 msgr2=0x55f7154ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41e00700 1 --2- 172.21.15.70:0/2290599177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 0x55f7154ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41e00700 1 -- 172.21.15.70:0/2290599177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 msgr2=0x55f7154d4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:44.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41e00700 1 --2- 172.21.15.70:0/2290599177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41e00700 1 -- 172.21.15.70:0/2290599177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f715367a60 con 0x55f7154c8520 2024-05-08T06:53:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.730+0000 7efd41400700 1 --2- 172.21.15.70:0/2290599177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:53:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.731+0000 7efd42800700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efd280b2b20 0x7efd280b4fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009610 tx=0x7efd3c009db0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.731+0000 7efd41e00700 1 --2- 172.21.15.70:0/2290599177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154c89a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd340dfac0 tx=0x7efd3409ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c4f497aa1a8e06 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.731+0000 7efd2f400700 1 -- 172.21.15.70:0/2290599177 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3401d070 con 0x55f7154c8520 2024-05-08T06:53:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.732+0000 7efd2f400700 1 -- 172.21.15.70:0/2290599177 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd340a9d50 con 0x55f7154c8520 2024-05-08T06:53:44.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.732+0000 7efd2f400700 1 -- 172.21.15.70:0/2290599177 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34091040 con 0x55f7154c8520 2024-05-08T06:53:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.733+0000 7efd533fdb80 1 -- 172.21.15.70:0/2290599177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 msgr2=0x55f7154c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.733+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2290599177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154c89a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd340dfac0 tx=0x7efd3409ded0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.733+0000 7efd533fdb80 1 -- 172.21.15.70:0/2290599177 shutdown_connections 2024-05-08T06:53:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.733+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2290599177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.733+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2290599177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 0x55f7154ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.733+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2290599177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154c89a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.733+0000 7efd533fdb80 1 -- 172.21.15.70:0/2290599177 >> 172.21.15.70:0/2290599177 conn(0x55f7153f6cf0 msgr2=0x55f7154c2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.733+0000 7efd533fdb80 1 -- 172.21.15.70:0/2290599177 shutdown_connections 2024-05-08T06:53:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.733+0000 7efd533fdb80 1 -- 172.21.15.70:0/2290599177 wait complete. 2024-05-08T06:53:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.734+0000 7efd533fdb80 1 -- start start 2024-05-08T06:53:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.734+0000 7efd533fdb80 1 Processor -- start 2024-05-08T06:53:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154d4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 0x55f7154d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd533fdb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f7154d5310 con 0x55f7154c8520 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd533fdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f715380cb0 con 0x55f7154c8ee0 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd533fdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f7154d5490 con 0x55f7154cdf50 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd533fdb80 10 client.0 _ll_register_callbacks cb 0x55f7153c1e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd41e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154d4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd41e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154d4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34422/0 (socket says 172.21.15.70:34422) 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd41e00700 1 -- 172.21.15.70:0/1290014318 learned_addr learned my addr 172.21.15.70:0/1290014318 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd41400700 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.735+0000 7efd42800700 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 0x55f7154d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd41e00700 1 -- 172.21.15.70:0/1290014318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 msgr2=0x55f7154d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd41e00700 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 0x55f7154d2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd41e00700 1 -- 172.21.15.70:0/1290014318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 msgr2=0x55f7154d1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd41e00700 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd41e00700 1 -- 172.21.15.70:0/1290014318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7153e05b0 con 0x55f7154c8520 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd41e00700 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154d4940 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efd34000c00 tx=0x7efd34091330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f753ad5d4ff4840 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd23e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd23e00700 1 -- 172.21.15.70:0/1290014318 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd340c2020 con 0x55f7154c8520 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd23e00700 1 -- 172.21.15.70:0/1290014318 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9583+0+0 (secure 0 0 0) 0x7efd3400ec80 con 0x55f7154c8520 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.736+0000 7efd533fdb80 1 -- 172.21.15.70:0/1290014318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd340a9d50 con 0x55f7154c8520 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.737+0000 7efd23e00700 1 -- 172.21.15.70:0/1290014318 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd3401d040 con 0x55f7154c8520 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.737+0000 7efd533fdb80 10 client.15669 fetch_fsmap learned FSMap version 28 2024-05-08T06:53:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.737+0000 7efd533fdb80 1 -- 172.21.15.70:0/1290014318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7154dfb30 con 0x55f7154c8520 2024-05-08T06:53:44.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.737+0000 7efd23e00700 1 -- 172.21.15.70:0/1290014318 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd340a9d50 con 0x55f7154c8520 2024-05-08T06:53:44.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.737+0000 7efd23e00700 1 -- 172.21.15.70:0/1290014318 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7efd340e2c70 con 0x55f7154c8520 2024-05-08T06:53:44.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.737+0000 7efd533fdb80 10 client.15669 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:53:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.738+0000 7efd533fdb80 10 client.15669 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:53:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.738+0000 7efd533fdb80 20 client.15669 populate_metadata read hostname 'smithi070' 2024-05-08T06:53:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.738+0000 7efd533fdb80 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f7154e2000 0x55f7154e43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.738+0000 7efd533fdb80 4 client.15669 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:53:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.738+0000 7efd533fdb80 1 -- 172.21.15.70:0/1290014318 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f715495230 con 0x55f7154e2000 2024-05-08T06:53:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.738+0000 7efd41400700 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f7154e2000 0x55f7154e43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.739+0000 7efd41400700 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f7154e2000 0x55f7154e43f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=808ee993cad84e8c server_cookie=9eded528f380075b in_seq=0 out_seq=0 2024-05-08T06:53:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.739+0000 7efd23e00700 10 client.15669 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:53:44.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.741+0000 7efd23e00700 1 -- 172.21.15.70:0/1290014318 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f715495230 con 0x55f7154e2000 2024-05-08T06:53:44.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.741+0000 7efd23e00700 10 client.15669 handle_command_reply: tid=0 2024-05-08T06:53:44.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.741+0000 7efd533fdb80 1 client.15669 shutdown 2024-05-08T06:53:44.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 -- 172.21.15.70:0/1290014318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 msgr2=0x55f7154d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:44.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154d4940 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7efd34000c00 tx=0x7efd34091330 comp rx=0 tx=0).stop 2024-05-08T06:53:44.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 -- 172.21.15.70:0/1290014318 shutdown_connections 2024-05-08T06:53:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f7154e2000 0x55f7154e43f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154cdf50 0x55f7154d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8520 0x55f7154d4940 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 --2- 172.21.15.70:0/1290014318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8ee0 0x55f7154d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd23e00700 0 client.15669 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:53:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 -- 172.21.15.70:0/1290014318 >> 172.21.15.70:0/1290014318 conn(0x55f7153f6cf0 msgr2=0x55f7154bd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 -- 172.21.15.70:0/1290014318 shutdown_connections 2024-05-08T06:53:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 1 -- 172.21.15.70:0/1290014318 wait complete. 2024-05-08T06:53:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.742+0000 7efd533fdb80 20 client.15669 trim_cache size 0 max 16384 2024-05-08T06:53:44.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.767+0000 7efd533fdb80 1 Processor -- start 2024-05-08T06:53:44.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.767+0000 7efd533fdb80 1 -- start start 2024-05-08T06:53:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.767+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8520 0x55f7154d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.767+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8ee0 0x55f7154bd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.767+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154cdf50 0x55f7154ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.767+0000 7efd533fdb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd441b3fa0 con 0x55f7154cdf50 2024-05-08T06:53:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.767+0000 7efd533fdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd441b1830 con 0x55f7154c8520 2024-05-08T06:53:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.767+0000 7efd533fdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efd441af6a0 con 0x55f7154c8ee0 2024-05-08T06:53:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd42800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154cdf50 0x55f7154ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd42800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154cdf50 0x55f7154ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34434/0 (socket says 172.21.15.70:34434) 2024-05-08T06:53:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd42800700 1 -- 172.21.15.70:0/3887206416 learned_addr learned my addr 172.21.15.70:0/3887206416 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd41e00700 1 --2- 172.21.15.70:0/3887206416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8520 0x55f7154d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd41400700 1 --2- 172.21.15.70:0/3887206416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8ee0 0x55f7154bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd42800700 1 -- 172.21.15.70:0/3887206416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8ee0 msgr2=0x55f7154bd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd42800700 1 --2- 172.21.15.70:0/3887206416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8ee0 0x55f7154bd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd42800700 1 -- 172.21.15.70:0/3887206416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8520 msgr2=0x55f7154d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd42800700 1 --2- 172.21.15.70:0/3887206416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8520 0x55f7154d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.768+0000 7efd42800700 1 -- 172.21.15.70:0/3887206416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7154d5140 con 0x55f7154cdf50 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.769+0000 7efd42800700 1 --2- 172.21.15.70:0/3887206416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154cdf50 0x55f7154ca9d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efd3c015000 tx=0x7efd3c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfb1dd1d6dadc1f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.769+0000 7efd2ea00700 1 -- 172.21.15.70:0/3887206416 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c02c450 con 0x55f7154cdf50 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.769+0000 7efd2ea00700 1 -- 172.21.15.70:0/3887206416 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd3c02ca80 con 0x55f7154cdf50 2024-05-08T06:53:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.769+0000 7efd2ea00700 1 -- 172.21.15.70:0/3887206416 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c01f7b0 con 0x55f7154cdf50 2024-05-08T06:53:44.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.770+0000 7efd533fdb80 1 -- 172.21.15.70:0/3887206416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154cdf50 msgr2=0x55f7154ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:44.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.770+0000 7efd533fdb80 1 --2- 172.21.15.70:0/3887206416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154cdf50 0x55f7154ca9d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7efd3c015000 tx=0x7efd3c013000 comp rx=0 tx=0).stop 2024-05-08T06:53:44.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.770+0000 7efd533fdb80 1 -- 172.21.15.70:0/3887206416 shutdown_connections 2024-05-08T06:53:44.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.770+0000 7efd533fdb80 1 --2- 172.21.15.70:0/3887206416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154cdf50 0x55f7154ca9d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.770+0000 7efd533fdb80 1 --2- 172.21.15.70:0/3887206416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154c8520 0x55f7154d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.770+0000 7efd533fdb80 1 --2- 172.21.15.70:0/3887206416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8ee0 0x55f7154bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.770+0000 7efd533fdb80 1 -- 172.21.15.70:0/3887206416 >> 172.21.15.70:0/3887206416 conn(0x55f7153f6cf0 msgr2=0x55f7154bd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.771+0000 7efd533fdb80 1 -- 172.21.15.70:0/3887206416 shutdown_connections 2024-05-08T06:53:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.771+0000 7efd533fdb80 1 -- 172.21.15.70:0/3887206416 wait complete. 2024-05-08T06:53:44.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.772+0000 7efd533fdb80 1 -- start start 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.772+0000 7efd533fdb80 1 Processor -- start 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.772+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8520 0x55f7154e4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.772+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8ee0 0x55f7154e4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.772+0000 7efd533fdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154cdf50 0x55f7154e4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.772+0000 7efd533fdb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efd441afcf0 con 0x55f7154c8ee0 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.772+0000 7efd533fdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efd441b1160 con 0x55f7154cdf50 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.772+0000 7efd533fdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efd441b03c0 con 0x55f7154c8520 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.772+0000 7efd533fdb80 10 client.0 _ll_register_callbacks cb 0x55f7153c1e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd41400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8ee0 0x55f7154e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd41400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8ee0 0x55f7154e4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34438/0 (socket says 172.21.15.70:34438) 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd41400700 1 -- 172.21.15.70:0/2910780495 learned_addr learned my addr 172.21.15.70:0/2910780495 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd42800700 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154cdf50 0x55f7154e4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd41e00700 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8520 0x55f7154e4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd41400700 1 -- 172.21.15.70:0/2910780495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8520 msgr2=0x55f7154e4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd41400700 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8520 0x55f7154e4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd41400700 1 -- 172.21.15.70:0/2910780495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154cdf50 msgr2=0x55f7154e4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:53:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd41400700 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154cdf50 0x55f7154e4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd41400700 1 -- 172.21.15.70:0/2910780495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7154c5000 con 0x55f7154c8ee0 2024-05-08T06:53:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.773+0000 7efd42800700 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154cdf50 0x55f7154e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:53:44.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.774+0000 7efd41400700 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8ee0 0x55f7154e4780 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55f7154d5530 tx=0x7efd3000ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c41397ecb475cd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:53:44.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.774+0000 7efd23e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:53:44.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.774+0000 7efd23e00700 1 -- 172.21.15.70:0/2910780495 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd30004a30 con 0x55f7154c8ee0 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.774+0000 7efd23e00700 1 -- 172.21.15.70:0/2910780495 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9583+0+0 (secure 0 0 0) 0x7efd30004bd0 con 0x55f7154c8ee0 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.774+0000 7efd533fdb80 1 -- 172.21.15.70:0/2910780495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd3c02ca80 con 0x55f7154c8ee0 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd23e00700 1 -- 172.21.15.70:0/2910780495 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7efd30004dd0 con 0x55f7154c8ee0 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd533fdb80 10 client.15675 fetch_fsmap learned FSMap version 28 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd533fdb80 1 -- 172.21.15.70:0/2910780495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f7154bfa10 con 0x55f7154c8ee0 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd23e00700 1 -- 172.21.15.70:0/2910780495 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd3c02ca80 con 0x55f7154c8ee0 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd23e00700 1 -- 172.21.15.70:0/2910780495 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7efd300054a0 con 0x55f7154c8ee0 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd533fdb80 10 client.15675 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd533fdb80 10 client.15675 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:53:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd533fdb80 20 client.15675 populate_metadata read hostname 'smithi070' 2024-05-08T06:53:44.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f71554df90 0x55f7155503b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:53:44.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd533fdb80 4 client.15675 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.7, "await_for": 42.0}] 2024-05-08T06:53:44.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.775+0000 7efd533fdb80 1 -- 172.21.15.70:0/2910780495 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.7, "await_for": 42.0}) -- 0x55f715428590 con 0x55f71554df90 2024-05-08T06:53:44.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.776+0000 7efd41e00700 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f71554df90 0x55f7155503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:53:44.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.777+0000 7efd41e00700 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f71554df90 0x55f7155503b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=478d7f48970a3473 server_cookie=acf731b2fde5b55a in_seq=0 out_seq=0 2024-05-08T06:53:44.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:44.777+0000 7efd23e00700 10 client.15675 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:53:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:46 smithi194 ceph-mon[33679]: pgmap v221: 129 pgs: 129 active+clean; 247 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 382 KiB/s wr, 53 op/s 2024-05-08T06:53:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:46 smithi070 ceph-mon[29591]: pgmap v221: 129 pgs: 129 active+clean; 247 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 382 KiB/s wr, 53 op/s 2024-05-08T06:53:46.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:46 smithi172 ceph-mon[33377]: pgmap v221: 129 pgs: 129 active+clean; 247 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 382 KiB/s wr, 53 op/s 2024-05-08T06:53:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:47 smithi194 ceph-mon[33679]: pgmap v222: 129 pgs: 129 active+clean; 247 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 380 KiB/s wr, 50 op/s 2024-05-08T06:53:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:47 smithi070 ceph-mon[29591]: pgmap v222: 129 pgs: 129 active+clean; 247 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 380 KiB/s wr, 50 op/s 2024-05-08T06:53:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:47 smithi172 ceph-mon[33377]: pgmap v222: 129 pgs: 129 active+clean; 247 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 380 KiB/s wr, 50 op/s 2024-05-08T06:53:49.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.197+0000 7efd23e00700 1 -- 172.21.15.70:0/2910780495 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55f715428590 con 0x55f71554df90 2024-05-08T06:53:49.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.197+0000 7efd23e00700 10 client.15675 handle_command_reply: tid=0 2024-05-08T06:53:49.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.197+0000 7efd533fdb80 1 client.15675 shutdown 2024-05-08T06:53:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 -- 172.21.15.70:0/2910780495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8ee0 msgr2=0x55f7154e4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8ee0 0x55f7154e4780 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55f7154d5530 tx=0x7efd3000ade0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 -- 172.21.15.70:0/2910780495 shutdown_connections 2024-05-08T06:53:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f71554df90 0x55f7155503b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f7154cdf50 0x55f7154e4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f7154c8520 0x55f7154e4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 --2- 172.21.15.70:0/2910780495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f7154c8ee0 0x55f7154e4780 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 -- 172.21.15.70:0/2910780495 >> 172.21.15.70:0/2910780495 conn(0x55f7153f6cf0 msgr2=0x55f7154bd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd23e00700 0 client.15675 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:53:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 -- 172.21.15.70:0/2910780495 shutdown_connections 2024-05-08T06:53:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 1 -- 172.21.15.70:0/2910780495 wait complete. 2024-05-08T06:53:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.198+0000 7efd533fdb80 20 client.15675 trim_cache size 0 max 16384 2024-05-08T06:53:49.199 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:53:49.199 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:53:49.199 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:53:49.199 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 22, 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "16cfbc9b": { 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 22, 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.7, 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:53:49.200 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:53:49.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:53:49.201 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:53:49.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:49.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:49.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:49.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:49.201 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:53:49.201 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:53:49.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.199+0000 7efd48a00700 1 -- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efd280b2b20 msgr2=0x7efd280b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.199+0000 7efd48a00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efd280b2b20 0x7efd280b4fe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009610 tx=0x7efd3c009db0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.199+0000 7efd48a00700 1 -- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd441037b0 msgr2=0x7efd441a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.199+0000 7efd48a00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd441037b0 0x7efd441a16f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efd3400c970 tx=0x7efd3400cc80 comp rx=0 tx=0).stop 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.200+0000 7efd48a00700 1 -- 172.21.15.70:0/1060915427 shutdown_connections 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.200+0000 7efd48a00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efd280b2b20 0x7efd280b4fe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.200+0000 7efd48a00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd44108880 0x7efd4419b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.200+0000 7efd48a00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efd441037b0 0x7efd441a16f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.200+0000 7efd48a00700 1 --2- 172.21.15.70:0/1060915427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efd44104160 0x7efd441a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.200+0000 7efd48a00700 1 -- 172.21.15.70:0/1060915427 >> 172.21.15.70:0/1060915427 conn(0x7efd4407a580 msgr2=0x7efd441014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.200+0000 7efd48a00700 1 -- 172.21.15.70:0/1060915427 shutdown_connections 2024-05-08T06:53:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:53:49.200+0000 7efd48a00700 1 -- 172.21.15.70:0/1060915427 wait complete. 2024-05-08T06:53:50.178 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:49 smithi070 ceph-mon[29591]: pgmap v223: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 601 KiB/s wr, 65 op/s 2024-05-08T06:53:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:49 smithi172 ceph-mon[33377]: pgmap v223: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 601 KiB/s wr, 65 op/s 2024-05-08T06:53:50.243 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '16cfbc9b', quiesce took 12.9 seconds. Will release after: 25.7 2024-05-08T06:53:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:49 smithi194 ceph-mon[33679]: pgmap v223: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 601 KiB/s wr, 65 op/s 2024-05-08T06:53:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:51 smithi194 ceph-mon[33679]: pgmap v224: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 487 KiB/s wr, 45 op/s 2024-05-08T06:53:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:51 smithi070 ceph-mon[29591]: pgmap v224: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 487 KiB/s wr, 45 op/s 2024-05-08T06:53:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:51 smithi172 ceph-mon[33377]: pgmap v224: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 487 KiB/s wr, 45 op/s 2024-05-08T06:53:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:53 smithi194 ceph-mon[33679]: pgmap v225: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 487 KiB/s wr, 45 op/s 2024-05-08T06:53:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:53:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:53 smithi070 ceph-mon[29591]: pgmap v225: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 487 KiB/s wr, 45 op/s 2024-05-08T06:53:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:53:54.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:53 smithi172 ceph-mon[33377]: pgmap v225: 129 pgs: 129 active+clean; 249 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 487 KiB/s wr, 45 op/s 2024-05-08T06:53:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:53:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:55 smithi194 ceph-mon[33679]: pgmap v226: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 511 KiB/s wr, 56 op/s 2024-05-08T06:53:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:53:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:53:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:53:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:55 smithi070 ceph-mon[29591]: pgmap v226: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 511 KiB/s wr, 56 op/s 2024-05-08T06:53:56.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:53:56.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:53:56.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:53:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:55 smithi172 ceph-mon[33377]: pgmap v226: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 511 KiB/s wr, 56 op/s 2024-05-08T06:53:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:53:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:53:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:53:58.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:57 smithi070 ceph-mon[29591]: pgmap v227: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 246 KiB/s wr, 26 op/s 2024-05-08T06:53:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:57 smithi194 ceph-mon[33679]: pgmap v227: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 246 KiB/s wr, 26 op/s 2024-05-08T06:53:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:57 smithi172 ceph-mon[33377]: pgmap v227: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 246 KiB/s wr, 26 op/s 2024-05-08T06:54:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:53:59 smithi070 ceph-mon[29591]: pgmap v228: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 251 KiB/s wr, 29 op/s 2024-05-08T06:54:00.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:53:59 smithi194 ceph-mon[33679]: pgmap v228: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 251 KiB/s wr, 29 op/s 2024-05-08T06:54:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:53:59 smithi172 ceph-mon[33377]: pgmap v228: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 251 KiB/s wr, 29 op/s 2024-05-08T06:54:02.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:01 smithi194 ceph-mon[33679]: pgmap v229: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-05-08T06:54:02.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:01 smithi070 ceph-mon[29591]: pgmap v229: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-05-08T06:54:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:01 smithi172 ceph-mon[33377]: pgmap v229: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-05-08T06:54:04.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:03 smithi194 ceph-mon[33679]: pgmap v230: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-05-08T06:54:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:03 smithi070 ceph-mon[29591]: pgmap v230: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-05-08T06:54:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:03 smithi172 ceph-mon[33377]: pgmap v230: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-05-08T06:54:06.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:05 smithi194 ceph-mon[33679]: pgmap v231: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 74 KiB/s wr, 35 op/s 2024-05-08T06:54:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:05 smithi070 ceph-mon[29591]: pgmap v231: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 74 KiB/s wr, 35 op/s 2024-05-08T06:54:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:05 smithi172 ceph-mon[33377]: pgmap v231: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 74 KiB/s wr, 35 op/s 2024-05-08T06:54:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:08 smithi070 ceph-mon[29591]: pgmap v232: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-05-08T06:54:08.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:08 smithi070 ceph-mon[29591]: osdmap e96: 12 total, 12 up, 12 in 2024-05-08T06:54:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:08 smithi172 ceph-mon[33377]: pgmap v232: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-05-08T06:54:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:08 smithi172 ceph-mon[33377]: osdmap e96: 12 total, 12 up, 12 in 2024-05-08T06:54:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:08 smithi194 ceph-mon[33679]: pgmap v232: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 50 KiB/s wr, 23 op/s 2024-05-08T06:54:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:08 smithi194 ceph-mon[33679]: osdmap e96: 12 total, 12 up, 12 in 2024-05-08T06:54:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:10 smithi070 ceph-mon[29591]: pgmap v234: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-05-08T06:54:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:10 smithi172 ceph-mon[33377]: pgmap v234: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-05-08T06:54:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:10 smithi194 ceph-mon[33679]: pgmap v234: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-05-08T06:54:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:12 smithi070 ceph-mon[29591]: pgmap v235: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-05-08T06:54:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:12 smithi172 ceph-mon[33377]: pgmap v235: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-05-08T06:54:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:12 smithi194 ceph-mon[33679]: pgmap v235: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 27 op/s 2024-05-08T06:54:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:13 smithi070 ceph-mon[29591]: osdmap e97: 12 total, 12 up, 12 in 2024-05-08T06:54:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:13 smithi172 ceph-mon[33377]: osdmap e97: 12 total, 12 up, 12 in 2024-05-08T06:54:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:13 smithi194 ceph-mon[33679]: osdmap e97: 12 total, 12 up, 12 in 2024-05-08T06:54:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:14 smithi070 ceph-mon[29591]: pgmap v237: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.1 KiB/s wr, 4 op/s 2024-05-08T06:54:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:14 smithi172 ceph-mon[33377]: pgmap v237: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.1 KiB/s wr, 4 op/s 2024-05-08T06:54:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:14 smithi194 ceph-mon[33679]: pgmap v237: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5.1 KiB/s wr, 4 op/s 2024-05-08T06:54:15.945 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:54:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:16 smithi070 ceph-mon[29591]: pgmap v238: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-05-08T06:54:16.406 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:54:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:16 smithi172 ceph-mon[33377]: pgmap v238: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-05-08T06:54:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:16 smithi194 ceph-mon[33679]: pgmap v238: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-05-08T06:54:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:18 smithi172 ceph-mon[33377]: pgmap v239: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-05-08T06:54:18.451 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:18 smithi070 ceph-mon[29591]: pgmap v239: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-05-08T06:54:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:18 smithi194 ceph-mon[33679]: pgmap v239: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-05-08T06:54:18.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.779+0000 7f2299e00700 1 -- 172.21.15.70:0/2733675046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 msgr2=0x7f2294112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:18.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.779+0000 7f2299e00700 1 --2- 172.21.15.70:0/2733675046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 0x7f2294112290 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f228c00b0a0 tx=0x7f228c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:54:18.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.780+0000 7f2299e00700 1 -- 172.21.15.70:0/2733675046 shutdown_connections 2024-05-08T06:54:18.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.780+0000 7f2299e00700 1 --2- 172.21.15.70:0/2733675046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 0x7f2294112290 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:18.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.780+0000 7f2299e00700 1 --2- 172.21.15.70:0/2733675046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22940756d0 0x7f2294075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:18.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.780+0000 7f2299e00700 1 --2- 172.21.15.70:0/2733675046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2294075ff0 0x7f229410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:18.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.780+0000 7f2299e00700 1 -- 172.21.15.70:0/2733675046 >> 172.21.15.70:0/2733675046 conn(0x7f229407a600 msgr2=0x7f229407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:54:18.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.780+0000 7f2299e00700 1 -- 172.21.15.70:0/2733675046 shutdown_connections 2024-05-08T06:54:18.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.780+0000 7f2299e00700 1 -- 172.21.15.70:0/2733675046 wait complete. 2024-05-08T06:54:18.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.781+0000 7f2299e00700 1 Processor -- start 2024-05-08T06:54:18.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2299e00700 1 -- start start 2024-05-08T06:54:18.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2299e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22940756d0 0x7f22941a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2299e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294075ff0 0x7f22941a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2299e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 0x7f229419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2299e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2294115730 con 0x7f229410fea0 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2299e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22941155b0 con 0x7f2294075ff0 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2299e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22941158b0 con 0x7f22940756d0 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2293400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 0x7f229419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2293400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 0x7f229419b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33200/0 (socket says 172.21.15.70:33200) 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.782+0000 7f2293400700 1 -- 172.21.15.70:0/2522155426 learned_addr learned my addr 172.21.15.70:0/2522155426 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.783+0000 7f2292000700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294075ff0 0x7f22941a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.783+0000 7f2292a00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22940756d0 0x7f22941a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.783+0000 7f2293400700 1 -- 172.21.15.70:0/2522155426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22940756d0 msgr2=0x7f22941a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:18.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.783+0000 7f2293400700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22940756d0 0x7f22941a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:18.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.783+0000 7f2293400700 1 -- 172.21.15.70:0/2522155426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294075ff0 msgr2=0x7f22941a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:18.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.783+0000 7f2293400700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294075ff0 0x7f22941a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:18.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.783+0000 7f2293400700 1 -- 172.21.15.70:0/2522155426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f229419c110 con 0x7f229410fea0 2024-05-08T06:54:18.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.783+0000 7f2293400700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 0x7f229419b9b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f228c0062a0 tx=0x7f228c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:54:18.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.784+0000 7f2298a00700 1 -- 172.21.15.70:0/2522155426 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c021070 con 0x7f229410fea0 2024-05-08T06:54:18.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.784+0000 7f2298a00700 1 -- 172.21.15.70:0/2522155426 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f228c007c80 con 0x7f229410fea0 2024-05-08T06:54:18.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.784+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f229419c3a0 con 0x7f229410fea0 2024-05-08T06:54:18.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.784+0000 7f2298a00700 1 -- 172.21.15.70:0/2522155426 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228c0052a0 con 0x7f229410fea0 2024-05-08T06:54:18.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.784+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22941a86c0 con 0x7f229410fea0 2024-05-08T06:54:18.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.785+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2294076dc0 con 0x7f229410fea0 2024-05-08T06:54:18.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.788+0000 7f2298a00700 1 -- 172.21.15.70:0/2522155426 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f228c024070 con 0x7f229410fea0 2024-05-08T06:54:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.789+0000 7f2298a00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22780b29f0 0x7f22780b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.789+0000 7f2298a00700 1 -- 172.21.15.70:0/2522155426 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9583+0+0 (secure 0 0 0) 0x7f228c0e3d60 con 0x7f229410fea0 2024-05-08T06:54:18.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.789+0000 7f2292a00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22780b29f0 0x7f22780b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:18.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.790+0000 7f2292a00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22780b29f0 0x7f22780b4eb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2284005950 tx=0x7f2284005ed0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:54:18.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:18.794+0000 7f2298a00700 1 -- 172.21.15.70:0/2522155426 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f228c0ab350 con 0x7f229410fea0 2024-05-08T06:54:19.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.077+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f229402e510 con 0x7f229410fea0 2024-05-08T06:54:19.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.079+0000 7f2298a00700 1 -- 172.21.15.70:0/2522155426 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f228c0aac50 con 0x7f229410fea0 2024-05-08T06:54:19.078 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:54:19.078 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:54:19.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22780b29f0 msgr2=0x7f22780b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:19.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22780b29f0 0x7f22780b4eb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2284005950 tx=0x7f2284005ed0 comp rx=0 tx=0).stop 2024-05-08T06:54:19.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 msgr2=0x7f229419b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 0x7f229419b9b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f228c0062a0 tx=0x7f228c004e20 comp rx=0 tx=0).stop 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 shutdown_connections 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22780b29f0 0x7f22780b4eb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f229410fea0 0x7f229419b9b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22940756d0 0x7f22941a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 --2- 172.21.15.70:0/2522155426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2294075ff0 0x7f22941a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 >> 172.21.15.70:0/2522155426 conn(0x7f229407a600 msgr2=0x7f2294100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 shutdown_connections 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:19.082+0000 7f2299e00700 1 -- 172.21.15.70:0/2522155426 wait complete. 2024-05-08T06:54:19.082 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:54:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:19 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2522155426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:54:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:19 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2522155426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:54:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:19 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2522155426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:54:19.972 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 16cfbc9b --release --await' 2024-05-08T06:54:19.973 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 16cfbc9b --release --await 2024-05-08T06:54:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:20 smithi070 ceph-mon[29591]: pgmap v240: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-05-08T06:54:20.425 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:54:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:20 smithi172 ceph-mon[33377]: pgmap v240: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-05-08T06:54:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:20 smithi194 ceph-mon[33679]: pgmap v240: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-05-08T06:54:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:22 smithi172 ceph-mon[33377]: pgmap v241: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-05-08T06:54:22.472 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:22 smithi070 ceph-mon[29591]: pgmap v241: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-05-08T06:54:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:22 smithi194 ceph-mon[33679]: pgmap v241: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.4 KiB/s wr, 6 op/s 2024-05-08T06:54:22.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.820+0000 7fbe28800700 1 -- 172.21.15.70:0/2587115327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 msgr2=0x7fbe20112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:22.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.820+0000 7fbe28800700 1 --2- 172.21.15.70:0/2587115327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 0x7fbe20112590 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b0a0 tx=0x7fbe1c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.820+0000 7fbe28800700 1 -- 172.21.15.70:0/2587115327 shutdown_connections 2024-05-08T06:54:22.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.820+0000 7fbe28800700 1 --2- 172.21.15.70:0/2587115327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 0x7fbe20112590 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.820+0000 7fbe28800700 1 --2- 172.21.15.70:0/2587115327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe2010b6c0 0x7fbe2010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.820+0000 7fbe28800700 1 --2- 172.21.15.70:0/2587115327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe201056c0 0x7fbe20105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.820+0000 7fbe28800700 1 -- 172.21.15.70:0/2587115327 >> 172.21.15.70:0/2587115327 conn(0x7fbe201011b0 msgr2=0x7fbe201035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:54:22.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.820+0000 7fbe28800700 1 -- 172.21.15.70:0/2587115327 shutdown_connections 2024-05-08T06:54:22.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.820+0000 7fbe28800700 1 -- 172.21.15.70:0/2587115327 wait complete. 2024-05-08T06:54:22.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.821+0000 7fbe28800700 1 Processor -- start 2024-05-08T06:54:22.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe28800700 1 -- start start 2024-05-08T06:54:22.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe28800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe201056c0 0x7fbe201a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe28800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 0x7fbe201a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe28800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2010b6c0 0x7fbe2019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe28800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201157b0 con 0x7fbe20106080 2024-05-08T06:54:22.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe28800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20115630 con 0x7fbe2010b6c0 2024-05-08T06:54:22.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe28800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbe20115930 con 0x7fbe201056c0 2024-05-08T06:54:22.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe25400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 0x7fbe201a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe25400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 0x7fbe201a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33214/0 (socket says 172.21.15.70:33214) 2024-05-08T06:54:22.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.822+0000 7fbe25400700 1 -- 172.21.15.70:0/3655732507 learned_addr learned my addr 172.21.15.70:0/3655732507 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:54:22.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.823+0000 7fbe25e00700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe201056c0 0x7fbe201a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.823+0000 7fbe26800700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2010b6c0 0x7fbe2019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.823+0000 7fbe25400700 1 -- 172.21.15.70:0/3655732507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe201056c0 msgr2=0x7fbe201a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:22.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.823+0000 7fbe25400700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe201056c0 0x7fbe201a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.823+0000 7fbe25400700 1 -- 172.21.15.70:0/3655732507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2010b6c0 msgr2=0x7fbe2019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:22.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.823+0000 7fbe25400700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2010b6c0 0x7fbe2019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.823+0000 7fbe25400700 1 -- 172.21.15.70:0/3655732507 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2019c190 con 0x7fbe20106080 2024-05-08T06:54:22.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.823+0000 7fbe25400700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 0x7fbe201a1db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000d950 tx=0x7fbe1000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:54:22.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.824+0000 7fbe1aa00700 1 -- 172.21.15.70:0/3655732507 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10016070 con 0x7fbe20106080 2024-05-08T06:54:22.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.824+0000 7fbe28800700 1 -- 172.21.15.70:0/3655732507 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2019c480 con 0x7fbe20106080 2024-05-08T06:54:22.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.824+0000 7fbe1aa00700 1 -- 172.21.15.70:0/3655732507 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe10010460 con 0x7fbe20106080 2024-05-08T06:54:22.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.824+0000 7fbe28800700 1 -- 172.21.15.70:0/3655732507 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe201a8740 con 0x7fbe20106080 2024-05-08T06:54:22.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.824+0000 7fbe1aa00700 1 -- 172.21.15.70:0/3655732507 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe10020060 con 0x7fbe20106080 2024-05-08T06:54:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.828+0000 7fbe1aa00700 1 -- 172.21.15.70:0/3655732507 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbe10019070 con 0x7fbe20106080 2024-05-08T06:54:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.829+0000 7fbe330e0b80 1 Processor -- start 2024-05-08T06:54:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.829+0000 7fbe330e0b80 1 -- start start 2024-05-08T06:54:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.829+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1be1b0 0x55d19a1be590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.829+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b8780 0x55d19a1b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.829+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.829+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d19a10ab20 con 0x55d19a1b9140 2024-05-08T06:54:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.829+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d19a0a8860 con 0x55d19a1b8780 2024-05-08T06:54:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.829+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d19a106ae0 con 0x55d19a1be1b0 2024-05-08T06:54:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe25400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe1aa00700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbe080b29f0 0x7fbe080b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe25400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33216/0 (socket says 172.21.15.70:33216) 2024-05-08T06:54:22.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe25400700 1 -- 172.21.15.70:0/79667124 learned_addr learned my addr 172.21.15.70:0/79667124 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:54:22.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe25e00700 1 --2- 172.21.15.70:0/79667124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b8780 0x55d19a1b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe26800700 1 --2- 172.21.15.70:0/79667124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1be1b0 0x55d19a1be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe26800700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbe080b29f0 0x7fbe080b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe1aa00700 1 -- 172.21.15.70:0/3655732507 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9583+0+0 (secure 0 0 0) 0x7fbe100e2a10 con 0x7fbe20106080 2024-05-08T06:54:22.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe25400700 1 -- 172.21.15.70:0/79667124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1be1b0 msgr2=0x55d19a1be590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:54:22.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe25400700 1 --2- 172.21.15.70:0/79667124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1be1b0 0x55d19a1be590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.830+0000 7fbe25400700 1 -- 172.21.15.70:0/79667124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b8780 msgr2=0x55d19a1b8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:54:22.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.831+0000 7fbe25400700 1 --2- 172.21.15.70:0/79667124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b8780 0x55d19a1b8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.831+0000 7fbe25400700 1 -- 172.21.15.70:0/79667124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19a0579d0 con 0x55d19a1b9140 2024-05-08T06:54:22.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.831+0000 7fbe25400700 1 --2- 172.21.15.70:0/79667124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c4f70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbe100dfd40 tx=0x7fbe10005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0980a00392c343 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:54:22.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.831+0000 7fbe26800700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbe080b29f0 0x7fbe080b4eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b830 tx=0x7fbe1c0099e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:54:22.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.831+0000 7fbe0f400700 1 -- 172.21.15.70:0/79667124 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe100c5030 con 0x55d19a1b9140 2024-05-08T06:54:22.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.831+0000 7fbe0f400700 1 -- 172.21.15.70:0/79667124 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe100a9380 con 0x55d19a1b9140 2024-05-08T06:54:22.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.831+0000 7fbe0f400700 1 -- 172.21.15.70:0/79667124 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe100b26d0 con 0x55d19a1b9140 2024-05-08T06:54:22.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.832+0000 7fbe330e0b80 1 -- 172.21.15.70:0/79667124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 msgr2=0x55d19a1c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:22.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.832+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/79667124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c4f70 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbe100dfd40 tx=0x7fbe10005910 comp rx=0 tx=0).stop 2024-05-08T06:54:22.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.832+0000 7fbe330e0b80 1 -- 172.21.15.70:0/79667124 shutdown_connections 2024-05-08T06:54:22.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.832+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/79667124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c4f70 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.832+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/79667124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1be1b0 0x55d19a1be590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.832+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/79667124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b8780 0x55d19a1b8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.832+0000 7fbe330e0b80 1 -- 172.21.15.70:0/79667124 >> 172.21.15.70:0/79667124 conn(0x55d19a1307d0 msgr2=0x55d19a1b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:54:22.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.832+0000 7fbe330e0b80 1 -- 172.21.15.70:0/79667124 shutdown_connections 2024-05-08T06:54:22.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.832+0000 7fbe330e0b80 1 -- 172.21.15.70:0/79667124 wait complete. 2024-05-08T06:54:22.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.833+0000 7fbe330e0b80 1 -- start start 2024-05-08T06:54:22.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.833+0000 7fbe330e0b80 1 Processor -- start 2024-05-08T06:54:22.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 0x55d19a1c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b9140 0x55d19a1c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1be1b0 0x55d19a1c2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d19a1c5510 con 0x55d19a1be1b0 2024-05-08T06:54:22.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d19a070c20 con 0x55d19a1b9140 2024-05-08T06:54:22.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d19a1c5690 con 0x55d19a1b8780 2024-05-08T06:54:22.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe330e0b80 10 client.0 _ll_register_callbacks cb 0x55d19a0b1d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:54:22.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe26800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1be1b0 0x55d19a1c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe26800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1be1b0 0x55d19a1c2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33220/0 (socket says 172.21.15.70:33220) 2024-05-08T06:54:22.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe26800700 1 -- 172.21.15.70:0/230449480 learned_addr learned my addr 172.21.15.70:0/230449480 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:54:22.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe25e00700 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 0x55d19a1c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe25400700 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b9140 0x55d19a1c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe26800700 1 -- 172.21.15.70:0/230449480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 msgr2=0x55d19a1c4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:54:22.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe26800700 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 0x55d19a1c4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe26800700 1 -- 172.21.15.70:0/230449480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b9140 msgr2=0x55d19a1c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:54:22.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe26800700 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b9140 0x55d19a1c1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.834+0000 7fbe26800700 1 -- 172.21.15.70:0/230449480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19a0d0520 con 0x55d19a1be1b0 2024-05-08T06:54:22.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.835+0000 7fbe26800700 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1be1b0 0x55d19a1c2430 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c007c10 tx=0x7fbe1c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e253b9764437985 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:54:22.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.835+0000 7fbe03e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:54:22.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.835+0000 7fbe03e00700 1 -- 172.21.15.70:0/230449480 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c032060 con 0x55d19a1be1b0 2024-05-08T06:54:22.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.835+0000 7fbe03e00700 1 -- 172.21.15.70:0/230449480 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9583+0+0 (secure 0 0 0) 0x7fbe1c01f650 con 0x55d19a1be1b0 2024-05-08T06:54:22.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.835+0000 7fbe330e0b80 1 -- 172.21.15.70:0/230449480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe100a9380 con 0x55d19a1be1b0 2024-05-08T06:54:22.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.835+0000 7fbe03e00700 1 -- 172.21.15.70:0/230449480 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe1c039050 con 0x55d19a1be1b0 2024-05-08T06:54:22.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.835+0000 7fbe330e0b80 10 client.15693 fetch_fsmap learned FSMap version 28 2024-05-08T06:54:22.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.835+0000 7fbe330e0b80 1 -- 172.21.15.70:0/230449480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d19a1cfd30 con 0x55d19a1be1b0 2024-05-08T06:54:22.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.836+0000 7fbe03e00700 1 -- 172.21.15.70:0/230449480 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe100a9380 con 0x55d19a1be1b0 2024-05-08T06:54:22.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.836+0000 7fbe03e00700 1 -- 172.21.15.70:0/230449480 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbe1c011070 con 0x55d19a1be1b0 2024-05-08T06:54:22.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.836+0000 7fbe330e0b80 10 client.15693 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:54:22.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.836+0000 7fbe330e0b80 10 client.15693 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:54:22.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.836+0000 7fbe330e0b80 20 client.15693 populate_metadata read hostname 'smithi070' 2024-05-08T06:54:22.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.836+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d19a1d23c0 0x55d19a1d47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.836+0000 7fbe330e0b80 4 client.15693 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:54:22.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.836+0000 7fbe330e0b80 1 -- 172.21.15.70:0/230449480 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d19a185240 con 0x55d19a1d23c0 2024-05-08T06:54:22.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.837+0000 7fbe25e00700 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d19a1d23c0 0x55d19a1d47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.838+0000 7fbe25e00700 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d19a1d23c0 0x55d19a1d47d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59314ecc8394ceb3 server_cookie=df72b05cc76a0793 in_seq=0 out_seq=0 2024-05-08T06:54:22.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.838+0000 7fbe03e00700 10 client.15693 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:54:22.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe03e00700 1 -- 172.21.15.70:0/230449480 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d19a185240 con 0x55d19a1d23c0 2024-05-08T06:54:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe03e00700 10 client.15693 handle_command_reply: tid=0 2024-05-08T06:54:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 client.15693 shutdown 2024-05-08T06:54:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 -- 172.21.15.70:0/230449480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1be1b0 msgr2=0x55d19a1c2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1be1b0 0x55d19a1c2430 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c007c10 tx=0x7fbe1c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 -- 172.21.15.70:0/230449480 shutdown_connections 2024-05-08T06:54:22.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d19a1d23c0 0x55d19a1d47d0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1be1b0 0x55d19a1c2430 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 0x55d19a1c4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe03e00700 0 client.15693 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:54:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/230449480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1b9140 0x55d19a1c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 -- 172.21.15.70:0/230449480 >> 172.21.15.70:0/230449480 conn(0x55d19a1307d0 msgr2=0x55d19a1adb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:54:22.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.840+0000 7fbe330e0b80 1 -- 172.21.15.70:0/230449480 shutdown_connections 2024-05-08T06:54:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.841+0000 7fbe330e0b80 1 -- 172.21.15.70:0/230449480 wait complete. 2024-05-08T06:54:22.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.841+0000 7fbe330e0b80 20 client.15693 trim_cache size 0 max 16384 2024-05-08T06:54:22.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.862+0000 7fbe330e0b80 1 Processor -- start 2024-05-08T06:54:22.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.862+0000 7fbe330e0b80 1 -- start start 2024-05-08T06:54:22.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.863+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b8780 0x55d19a1ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.863+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b9140 0x55d19a1c2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.863+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 0x55d19a1da0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.863+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201b4040 con 0x55d19a1b8780 2024-05-08T06:54:22.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.863+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201b18d0 con 0x55d19a1be1b0 2024-05-08T06:54:22.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.863+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201af740 con 0x55d19a1b9140 2024-05-08T06:54:22.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.863+0000 7fbe25e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b8780 0x55d19a1ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.863+0000 7fbe25e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b8780 0x55d19a1ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33222/0 (socket says 172.21.15.70:33222) 2024-05-08T06:54:22.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.863+0000 7fbe25e00700 1 -- 172.21.15.70:0/2306112312 learned_addr learned my addr 172.21.15.70:0/2306112312 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:54:22.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.864+0000 7fbe25400700 1 --2- 172.21.15.70:0/2306112312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b9140 0x55d19a1c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.864+0000 7fbe26800700 1 --2- 172.21.15.70:0/2306112312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 0x55d19a1da0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.864+0000 7fbe25e00700 1 -- 172.21.15.70:0/2306112312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b9140 msgr2=0x55d19a1c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:54:22.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.864+0000 7fbe25e00700 1 --2- 172.21.15.70:0/2306112312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b9140 0x55d19a1c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.864+0000 7fbe25e00700 1 -- 172.21.15.70:0/2306112312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 msgr2=0x55d19a1da0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:54:22.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.864+0000 7fbe25e00700 1 --2- 172.21.15.70:0/2306112312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 0x55d19a1da0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.864+0000 7fbe25e00700 1 -- 172.21.15.70:0/2306112312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d19a1b8f20 con 0x55d19a1b8780 2024-05-08T06:54:22.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.864+0000 7fbe25e00700 1 --2- 172.21.15.70:0/2306112312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b8780 0x55d19a1ce5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55d19a1d5040 tx=0x7fbe140137f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f6ad82ca188806 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:54:22.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.864+0000 7fbe0ea00700 1 -- 172.21.15.70:0/2306112312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe140130d0 con 0x55d19a1b8780 2024-05-08T06:54:22.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.865+0000 7fbe0ea00700 1 -- 172.21.15.70:0/2306112312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe14013270 con 0x55d19a1b8780 2024-05-08T06:54:22.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.865+0000 7fbe0ea00700 1 -- 172.21.15.70:0/2306112312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe140038e0 con 0x55d19a1b8780 2024-05-08T06:54:22.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.865+0000 7fbe330e0b80 1 -- 172.21.15.70:0/2306112312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b8780 msgr2=0x55d19a1ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.865+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/2306112312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b8780 0x55d19a1ce5d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55d19a1d5040 tx=0x7fbe140137f0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.865+0000 7fbe330e0b80 1 -- 172.21.15.70:0/2306112312 shutdown_connections 2024-05-08T06:54:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.865+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/2306112312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 0x55d19a1da0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.865+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/2306112312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b8780 0x55d19a1ce5d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.865+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/2306112312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b9140 0x55d19a1c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.865+0000 7fbe330e0b80 1 -- 172.21.15.70:0/2306112312 >> 172.21.15.70:0/2306112312 conn(0x55d19a1307d0 msgr2=0x55d19a1b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:54:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.866+0000 7fbe330e0b80 1 -- 172.21.15.70:0/2306112312 shutdown_connections 2024-05-08T06:54:22.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.866+0000 7fbe330e0b80 1 -- 172.21.15.70:0/2306112312 wait complete. 2024-05-08T06:54:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.866+0000 7fbe330e0b80 1 -- start start 2024-05-08T06:54:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.866+0000 7fbe330e0b80 1 Processor -- start 2024-05-08T06:54:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 0x55d19a1c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe330e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 0x55d19a245470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201afd90 con 0x55d19a1b9140 2024-05-08T06:54:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201b1200 con 0x55d19a1be1b0 2024-05-08T06:54:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe330e0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbe201b0460 con 0x55d19a1b8780 2024-05-08T06:54:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe330e0b80 10 client.0 _ll_register_callbacks cb 0x55d19a0b1d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:54:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe25400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe25400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33232/0 (socket says 172.21.15.70:33232) 2024-05-08T06:54:22.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe25400700 1 -- 172.21.15.70:0/1363484401 learned_addr learned my addr 172.21.15.70:0/1363484401 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:54:22.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe25e00700 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 0x55d19a1c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe26800700 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 0x55d19a245470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.867+0000 7fbe25400700 1 -- 172.21.15.70:0/1363484401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 msgr2=0x55d19a1c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:54:22.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe25400700 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 0x55d19a1c7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe25400700 1 -- 172.21.15.70:0/1363484401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 msgr2=0x55d19a245470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:54:22.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe25400700 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 0x55d19a245470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:22.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe25400700 1 -- 172.21.15.70:0/1363484401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d19a2459e0 con 0x55d19a1b9140 2024-05-08T06:54:22.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe25e00700 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 0x55d19a1c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:54:22.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe26800700 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 0x55d19a245470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:54:22.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe25400700 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c8180 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbe100a9800 tx=0x7fbe10009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4bf76c8393d194 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:54:22.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe03e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:54:22.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe03e00700 1 -- 172.21.15.70:0/1363484401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe100a9380 con 0x55d19a1b9140 2024-05-08T06:54:22.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe03e00700 1 -- 172.21.15.70:0/1363484401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9583+0+0 (secure 0 0 0) 0x7fbe100dff60 con 0x55d19a1b9140 2024-05-08T06:54:22.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe330e0b80 1 -- 172.21.15.70:0/1363484401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe14013270 con 0x55d19a1b9140 2024-05-08T06:54:22.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe03e00700 1 -- 172.21.15.70:0/1363484401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbe100a9f70 con 0x55d19a1b9140 2024-05-08T06:54:22.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe330e0b80 10 client.15699 fetch_fsmap learned FSMap version 28 2024-05-08T06:54:22.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.868+0000 7fbe330e0b80 1 -- 172.21.15.70:0/1363484401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d19a246d20 con 0x55d19a1b9140 2024-05-08T06:54:22.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.869+0000 7fbe03e00700 1 -- 172.21.15.70:0/1363484401 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe14013270 con 0x55d19a1b9140 2024-05-08T06:54:22.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.869+0000 7fbe03e00700 1 -- 172.21.15.70:0/1363484401 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbe100a9ad0 con 0x55d19a1b9140 2024-05-08T06:54:22.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.869+0000 7fbe330e0b80 10 client.15699 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:54:22.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.869+0000 7fbe330e0b80 10 client.15699 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:54:22.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.869+0000 7fbe330e0b80 20 client.15699 populate_metadata read hostname 'smithi070' 2024-05-08T06:54:22.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.869+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d19a246f40 0x55d19a249330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:54:22.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.869+0000 7fbe330e0b80 4 client.15699 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "16cfbc9b", "release": true, "await": true}] 2024-05-08T06:54:22.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.869+0000 7fbe330e0b80 1 -- 172.21.15.70:0/1363484401 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "16cfbc9b", "release": true, "await": true}) -- 0x55d19a1b35d0 con 0x55d19a246f40 2024-05-08T06:54:22.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.870+0000 7fbe25e00700 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d19a246f40 0x55d19a249330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:54:22.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.871+0000 7fbe25e00700 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d19a246f40 0x55d19a249330 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa85058fdc4f07ba server_cookie=359e03105b3f0e91 in_seq=0 out_seq=0 2024-05-08T06:54:22.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:22.871+0000 7fbe03e00700 10 client.15699 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:54:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.596+0000 7fbe03e00700 1 -- 172.21.15.70:0/1363484401 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55d19a1b35d0 con 0x55d19a246f40 2024-05-08T06:54:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.596+0000 7fbe03e00700 10 client.15699 handle_command_reply: tid=0 2024-05-08T06:54:23.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.596+0000 7fbe330e0b80 1 client.15699 shutdown 2024-05-08T06:54:23.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.597+0000 7fbe330e0b80 1 -- 172.21.15.70:0/1363484401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 msgr2=0x55d19a1c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:23.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.597+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c8180 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fbe100a9800 tx=0x7fbe10009650 comp rx=0 tx=0).stop 2024-05-08T06:54:23.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.598+0000 7fbe330e0b80 1 -- 172.21.15.70:0/1363484401 shutdown_connections 2024-05-08T06:54:23.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.598+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d19a246f40 0x55d19a249330 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:23.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.598+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d19a1be1b0 0x55d19a245470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:23.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.598+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d19a1b8780 0x55d19a1c7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:23.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.598+0000 7fbe330e0b80 1 --2- 172.21.15.70:0/1363484401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d19a1b9140 0x55d19a1c8180 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:23.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.598+0000 7fbe330e0b80 1 -- 172.21.15.70:0/1363484401 >> 172.21.15.70:0/1363484401 conn(0x55d19a1307d0 msgr2=0x55d19a1ad2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:54:23.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.598+0000 7fbe03e00700 0 client.15699 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:54:23.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.598+0000 7fbe330e0b80 1 -- 172.21.15.70:0/1363484401 shutdown_connections 2024-05-08T06:54:23.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.598+0000 7fbe330e0b80 1 -- 172.21.15.70:0/1363484401 wait complete. 2024-05-08T06:54:23.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.599+0000 7fbe330e0b80 20 client.15699 trim_cache size 0 max 16384 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 24, 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "16cfbc9b": { 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 24, 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:54:23.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.7, 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:54:23.600 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:54:23.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 -- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbe080b29f0 msgr2=0x7fbe080b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:23.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbe080b29f0 0x7fbe080b4eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00b830 tx=0x7fbe1c0099e0 comp rx=0 tx=0).stop 2024-05-08T06:54:23.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 -- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 msgr2=0x7fbe201a1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:54:23.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 0x7fbe201a1db0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000d950 tx=0x7fbe1000dd10 comp rx=0 tx=0).stop 2024-05-08T06:54:23.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 -- 172.21.15.70:0/3655732507 shutdown_connections 2024-05-08T06:54:23.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbe080b29f0 0x7fbe080b4eb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:23.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbe2010b6c0 0x7fbe2019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:23.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe201056c0 0x7fbe201a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:23.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 --2- 172.21.15.70:0/3655732507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe20106080 0x7fbe201a1db0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:54:23.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.600+0000 7fbe28800700 1 -- 172.21.15.70:0/3655732507 >> 172.21.15.70:0/3655732507 conn(0x7fbe201011b0 msgr2=0x7fbe20101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:54:23.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.601+0000 7fbe28800700 1 -- 172.21.15.70:0/3655732507 shutdown_connections 2024-05-08T06:54:23.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:54:23.601+0000 7fbe28800700 1 -- 172.21.15.70:0/3655732507 wait complete. 2024-05-08T06:54:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:24 smithi070 ceph-mon[29591]: pgmap v242: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:54:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:24 smithi172 ceph-mon[33377]: pgmap v242: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:54:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:24 smithi194 ceph-mon[33679]: pgmap v242: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T06:54:24.813 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '16cfbc9b', seconds elapsed: 47.5 2024-05-08T06:54:26.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:26 smithi172 ceph-mon[33377]: pgmap v243: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-05-08T06:54:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:26 smithi194 ceph-mon[33679]: pgmap v243: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-05-08T06:54:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:26 smithi070 ceph-mon[29591]: pgmap v243: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 KiB/s wr, 9 op/s 2024-05-08T06:54:28.432 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:28 smithi070 ceph-mon[29591]: pgmap v244: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T06:54:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:28 smithi194 ceph-mon[33679]: pgmap v244: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T06:54:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:28 smithi172 ceph-mon[33377]: pgmap v244: 129 pgs: 129 active+clean; 250 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T06:54:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:30 smithi194 ceph-mon[33679]: pgmap v245: 129 pgs: 129 active+clean; 254 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 349 KiB/s wr, 42 op/s 2024-05-08T06:54:30.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:30 smithi070 ceph-mon[29591]: pgmap v245: 129 pgs: 129 active+clean; 254 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 349 KiB/s wr, 42 op/s 2024-05-08T06:54:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:30 smithi172 ceph-mon[33377]: pgmap v245: 129 pgs: 129 active+clean; 254 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 349 KiB/s wr, 42 op/s 2024-05-08T06:54:32.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:32 smithi194 ceph-mon[33679]: pgmap v246: 129 pgs: 129 active+clean; 254 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 346 KiB/s wr, 40 op/s 2024-05-08T06:54:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:32 smithi070 ceph-mon[29591]: pgmap v246: 129 pgs: 129 active+clean; 254 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 346 KiB/s wr, 40 op/s 2024-05-08T06:54:32.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:32 smithi172 ceph-mon[33377]: pgmap v246: 129 pgs: 129 active+clean; 254 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 346 KiB/s wr, 40 op/s 2024-05-08T06:54:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:34 smithi194 ceph-mon[33679]: pgmap v247: 129 pgs: 129 active+clean; 254 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 346 KiB/s wr, 40 op/s 2024-05-08T06:54:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:34 smithi070 ceph-mon[29591]: pgmap v247: 129 pgs: 129 active+clean; 254 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 346 KiB/s wr, 40 op/s 2024-05-08T06:54:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:34 smithi172 ceph-mon[33377]: pgmap v247: 129 pgs: 129 active+clean; 254 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 346 KiB/s wr, 40 op/s 2024-05-08T06:54:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:36 smithi194 ceph-mon[33679]: pgmap v248: 129 pgs: 129 active+clean; 258 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 760 KiB/s wr, 77 op/s 2024-05-08T06:54:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:36 smithi070 ceph-mon[29591]: pgmap v248: 129 pgs: 129 active+clean; 258 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 760 KiB/s wr, 77 op/s 2024-05-08T06:54:36.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:36 smithi172 ceph-mon[33377]: pgmap v248: 129 pgs: 129 active+clean; 258 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 760 KiB/s wr, 77 op/s 2024-05-08T06:54:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:37 smithi194 ceph-mon[33679]: pgmap v249: 129 pgs: 129 active+clean; 258 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 752 KiB/s wr, 74 op/s 2024-05-08T06:54:37.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:37 smithi070 ceph-mon[29591]: pgmap v249: 129 pgs: 129 active+clean; 258 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 752 KiB/s wr, 74 op/s 2024-05-08T06:54:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:37 smithi172 ceph-mon[33377]: pgmap v249: 129 pgs: 129 active+clean; 258 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 752 KiB/s wr, 74 op/s 2024-05-08T06:54:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:39 smithi194 ceph-mon[33679]: pgmap v250: 129 pgs: 129 active+clean; 262 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.1 MiB/s wr, 113 op/s 2024-05-08T06:54:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:39 smithi070 ceph-mon[29591]: pgmap v250: 129 pgs: 129 active+clean; 262 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.1 MiB/s wr, 113 op/s 2024-05-08T06:54:40.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:39 smithi172 ceph-mon[33377]: pgmap v250: 129 pgs: 129 active+clean; 262 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.1 MiB/s wr, 113 op/s 2024-05-08T06:54:42.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:41 smithi194 ceph-mon[33679]: pgmap v251: 129 pgs: 129 active+clean; 262 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 760 KiB/s wr, 76 op/s 2024-05-08T06:54:42.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:41 smithi070 ceph-mon[29591]: pgmap v251: 129 pgs: 129 active+clean; 262 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 760 KiB/s wr, 76 op/s 2024-05-08T06:54:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:41 smithi172 ceph-mon[33377]: pgmap v251: 129 pgs: 129 active+clean; 262 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 760 KiB/s wr, 76 op/s 2024-05-08T06:54:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:43 smithi194 ceph-mon[33679]: pgmap v252: 129 pgs: 129 active+clean; 262 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 760 KiB/s wr, 76 op/s 2024-05-08T06:54:44.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:43 smithi070 ceph-mon[29591]: pgmap v252: 129 pgs: 129 active+clean; 262 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 760 KiB/s wr, 76 op/s 2024-05-08T06:54:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:43 smithi172 ceph-mon[33377]: pgmap v252: 129 pgs: 129 active+clean; 262 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 760 KiB/s wr, 76 op/s 2024-05-08T06:54:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:45 smithi194 ceph-mon[33679]: pgmap v253: 129 pgs: 129 active+clean; 263 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 934 KiB/s wr, 101 op/s 2024-05-08T06:54:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:45 smithi070 ceph-mon[29591]: pgmap v253: 129 pgs: 129 active+clean; 263 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 934 KiB/s wr, 101 op/s 2024-05-08T06:54:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:45 smithi172 ceph-mon[33377]: pgmap v253: 129 pgs: 129 active+clean; 263 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 934 KiB/s wr, 101 op/s 2024-05-08T06:54:48.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:47 smithi194 ceph-mon[33679]: pgmap v254: 129 pgs: 129 active+clean; 263 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 520 KiB/s wr, 63 op/s 2024-05-08T06:54:48.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:47 smithi070 ceph-mon[29591]: pgmap v254: 129 pgs: 129 active+clean; 263 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 520 KiB/s wr, 63 op/s 2024-05-08T06:54:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:47 smithi172 ceph-mon[33377]: pgmap v254: 129 pgs: 129 active+clean; 263 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 520 KiB/s wr, 63 op/s 2024-05-08T06:54:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:49 smithi194 ceph-mon[33679]: pgmap v255: 129 pgs: 129 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 828 KiB/s wr, 103 op/s 2024-05-08T06:54:50.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:49 smithi070 ceph-mon[29591]: pgmap v255: 129 pgs: 129 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 828 KiB/s wr, 103 op/s 2024-05-08T06:54:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:49 smithi172 ceph-mon[33377]: pgmap v255: 129 pgs: 129 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 828 KiB/s wr, 103 op/s 2024-05-08T06:54:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:51 smithi194 ceph-mon[33679]: pgmap v256: 129 pgs: 129 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 482 KiB/s wr, 64 op/s 2024-05-08T06:54:52.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:51 smithi070 ceph-mon[29591]: pgmap v256: 129 pgs: 129 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 482 KiB/s wr, 64 op/s 2024-05-08T06:54:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:51 smithi172 ceph-mon[33377]: pgmap v256: 129 pgs: 129 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 482 KiB/s wr, 64 op/s 2024-05-08T06:54:54.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:54 smithi194 ceph-mon[33679]: pgmap v257: 129 pgs: 129 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 482 KiB/s wr, 64 op/s 2024-05-08T06:54:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:54 smithi070 ceph-mon[29591]: pgmap v257: 129 pgs: 129 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 482 KiB/s wr, 64 op/s 2024-05-08T06:54:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:54 smithi172 ceph-mon[33377]: pgmap v257: 129 pgs: 129 active+clean; 267 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 482 KiB/s wr, 64 op/s 2024-05-08T06:54:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:56 smithi194 ceph-mon[33679]: pgmap v258: 129 pgs: 129 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 816 KiB/s wr, 103 op/s 2024-05-08T06:54:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:54:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:56 smithi070 ceph-mon[29591]: pgmap v258: 129 pgs: 129 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 816 KiB/s wr, 103 op/s 2024-05-08T06:54:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:54:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:56 smithi172 ceph-mon[33377]: pgmap v258: 129 pgs: 129 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 816 KiB/s wr, 103 op/s 2024-05-08T06:54:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:54:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:54:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:54:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:54:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:54:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:54:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:54:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:54:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:54:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:54:58.280 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:54:58 smithi070 ceph-mon[29591]: pgmap v259: 129 pgs: 129 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 642 KiB/s wr, 78 op/s 2024-05-08T06:54:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:54:58 smithi172 ceph-mon[33377]: pgmap v259: 129 pgs: 129 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 642 KiB/s wr, 78 op/s 2024-05-08T06:54:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:54:58 smithi194 ceph-mon[33679]: pgmap v259: 129 pgs: 129 active+clean; 270 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 642 KiB/s wr, 78 op/s 2024-05-08T06:55:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:00 smithi070 ceph-mon[29591]: pgmap v260: 129 pgs: 129 active+clean; 275 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2024-05-08T06:55:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:00 smithi172 ceph-mon[33377]: pgmap v260: 129 pgs: 129 active+clean; 275 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2024-05-08T06:55:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:00 smithi194 ceph-mon[33679]: pgmap v260: 129 pgs: 129 active+clean; 275 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.0 MiB/s wr, 123 op/s 2024-05-08T06:55:02.312 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:02 smithi194 ceph-mon[33679]: pgmap v261: 129 pgs: 129 active+clean; 275 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 732 KiB/s wr, 84 op/s 2024-05-08T06:55:02.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:02 smithi070 ceph-mon[29591]: pgmap v261: 129 pgs: 129 active+clean; 275 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 732 KiB/s wr, 84 op/s 2024-05-08T06:55:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:02 smithi172 ceph-mon[33377]: pgmap v261: 129 pgs: 129 active+clean; 275 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 732 KiB/s wr, 84 op/s 2024-05-08T06:55:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:04 smithi070 ceph-mon[29591]: pgmap v262: 129 pgs: 129 active+clean; 275 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 732 KiB/s wr, 84 op/s 2024-05-08T06:55:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:04 smithi172 ceph-mon[33377]: pgmap v262: 129 pgs: 129 active+clean; 275 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 732 KiB/s wr, 84 op/s 2024-05-08T06:55:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:04 smithi194 ceph-mon[33679]: pgmap v262: 129 pgs: 129 active+clean; 275 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 732 KiB/s wr, 84 op/s 2024-05-08T06:55:06.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:06 smithi070 ceph-mon[29591]: pgmap v263: 129 pgs: 129 active+clean; 280 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-05-08T06:55:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:06 smithi172 ceph-mon[33377]: pgmap v263: 129 pgs: 129 active+clean; 280 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-05-08T06:55:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:06 smithi194 ceph-mon[33679]: pgmap v263: 129 pgs: 129 active+clean; 280 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-05-08T06:55:08.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:08 smithi070 ceph-mon[29591]: pgmap v264: 129 pgs: 129 active+clean; 280 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 899 KiB/s wr, 94 op/s 2024-05-08T06:55:08.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:08 smithi070 ceph-mon[29591]: osdmap e98: 12 total, 12 up, 12 in 2024-05-08T06:55:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:08 smithi172 ceph-mon[33377]: pgmap v264: 129 pgs: 129 active+clean; 280 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 899 KiB/s wr, 94 op/s 2024-05-08T06:55:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:08 smithi172 ceph-mon[33377]: osdmap e98: 12 total, 12 up, 12 in 2024-05-08T06:55:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:08 smithi194 ceph-mon[33679]: pgmap v264: 129 pgs: 129 active+clean; 280 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 899 KiB/s wr, 94 op/s 2024-05-08T06:55:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:08 smithi194 ceph-mon[33679]: osdmap e98: 12 total, 12 up, 12 in 2024-05-08T06:55:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:10 smithi070 ceph-mon[29591]: pgmap v266: 129 pgs: 129 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-05-08T06:55:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:10 smithi172 ceph-mon[33377]: pgmap v266: 129 pgs: 129 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-05-08T06:55:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:10 smithi194 ceph-mon[33679]: pgmap v266: 129 pgs: 129 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-05-08T06:55:12.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:12 smithi070 ceph-mon[29591]: pgmap v267: 129 pgs: 129 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-05-08T06:55:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:12 smithi172 ceph-mon[33377]: pgmap v267: 129 pgs: 129 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-05-08T06:55:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:12 smithi194 ceph-mon[33679]: pgmap v267: 129 pgs: 129 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 1.0 MiB/s wr, 106 op/s 2024-05-08T06:55:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:13 smithi070 ceph-mon[29591]: osdmap e99: 12 total, 12 up, 12 in 2024-05-08T06:55:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:13 smithi172 ceph-mon[33377]: osdmap e99: 12 total, 12 up, 12 in 2024-05-08T06:55:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:13 smithi194 ceph-mon[33679]: osdmap e99: 12 total, 12 up, 12 in 2024-05-08T06:55:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:14 smithi172 ceph-mon[33377]: pgmap v269: 129 pgs: 129 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 590 KiB/s wr, 58 op/s 2024-05-08T06:55:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:14 smithi194 ceph-mon[33679]: pgmap v269: 129 pgs: 129 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 590 KiB/s wr, 58 op/s 2024-05-08T06:55:14.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:14 smithi070 ceph-mon[29591]: pgmap v269: 129 pgs: 129 active+clean; 284 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 590 KiB/s wr, 58 op/s 2024-05-08T06:55:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:16 smithi172 ceph-mon[33377]: pgmap v270: 129 pgs: 129 active+clean; 287 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1014 KiB/s wr, 115 op/s 2024-05-08T06:55:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:16 smithi194 ceph-mon[33679]: pgmap v270: 129 pgs: 129 active+clean; 287 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1014 KiB/s wr, 115 op/s 2024-05-08T06:55:16.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:16 smithi070 ceph-mon[29591]: pgmap v270: 129 pgs: 129 active+clean; 287 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1014 KiB/s wr, 115 op/s 2024-05-08T06:55:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:18 smithi172 ceph-mon[33377]: pgmap v271: 129 pgs: 129 active+clean; 287 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 823 KiB/s wr, 93 op/s 2024-05-08T06:55:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:18 smithi194 ceph-mon[33679]: pgmap v271: 129 pgs: 129 active+clean; 287 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 823 KiB/s wr, 93 op/s 2024-05-08T06:55:18.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:18 smithi070 ceph-mon[29591]: pgmap v271: 129 pgs: 129 active+clean; 287 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 823 KiB/s wr, 93 op/s 2024-05-08T06:55:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:20 smithi172 ceph-mon[33377]: pgmap v272: 129 pgs: 129 active+clean; 292 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 896 KiB/s wr, 90 op/s 2024-05-08T06:55:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:20 smithi194 ceph-mon[33679]: pgmap v272: 129 pgs: 129 active+clean; 292 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 896 KiB/s wr, 90 op/s 2024-05-08T06:55:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:20 smithi070 ceph-mon[29591]: pgmap v272: 129 pgs: 129 active+clean; 292 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 896 KiB/s wr, 90 op/s 2024-05-08T06:55:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:22 smithi172 ceph-mon[33377]: pgmap v273: 129 pgs: 129 active+clean; 292 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 896 KiB/s wr, 90 op/s 2024-05-08T06:55:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:22 smithi194 ceph-mon[33679]: pgmap v273: 129 pgs: 129 active+clean; 292 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 896 KiB/s wr, 90 op/s 2024-05-08T06:55:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:22 smithi070 ceph-mon[29591]: pgmap v273: 129 pgs: 129 active+clean; 292 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 896 KiB/s wr, 90 op/s 2024-05-08T06:55:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:24 smithi172 ceph-mon[33377]: pgmap v274: 129 pgs: 129 active+clean; 292 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 830 KiB/s wr, 83 op/s 2024-05-08T06:55:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:24 smithi194 ceph-mon[33679]: pgmap v274: 129 pgs: 129 active+clean; 292 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 830 KiB/s wr, 83 op/s 2024-05-08T06:55:24.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:24 smithi070 ceph-mon[29591]: pgmap v274: 129 pgs: 129 active+clean; 292 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 830 KiB/s wr, 83 op/s 2024-05-08T06:55:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:26 smithi194 ceph-mon[33679]: pgmap v275: 129 pgs: 129 active+clean; 297 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-05-08T06:55:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:26 smithi070 ceph-mon[29591]: pgmap v275: 129 pgs: 129 active+clean; 297 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-05-08T06:55:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:26 smithi172 ceph-mon[33377]: pgmap v275: 129 pgs: 129 active+clean; 297 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-05-08T06:55:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:28 smithi194 ceph-mon[33679]: pgmap v276: 129 pgs: 129 active+clean; 297 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 901 KiB/s wr, 75 op/s 2024-05-08T06:55:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:28 smithi070 ceph-mon[29591]: pgmap v276: 129 pgs: 129 active+clean; 297 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 901 KiB/s wr, 75 op/s 2024-05-08T06:55:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:28 smithi172 ceph-mon[33377]: pgmap v276: 129 pgs: 129 active+clean; 297 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 901 KiB/s wr, 75 op/s 2024-05-08T06:55:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:30 smithi194 ceph-mon[33679]: pgmap v277: 129 pgs: 129 active+clean; 299 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-05-08T06:55:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:30 smithi070 ceph-mon[29591]: pgmap v277: 129 pgs: 129 active+clean; 299 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-05-08T06:55:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:30 smithi172 ceph-mon[33377]: pgmap v277: 129 pgs: 129 active+clean; 299 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2024-05-08T06:55:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:32 smithi194 ceph-mon[33679]: pgmap v278: 129 pgs: 129 active+clean; 299 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 660 KiB/s wr, 58 op/s 2024-05-08T06:55:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:32 smithi070 ceph-mon[29591]: pgmap v278: 129 pgs: 129 active+clean; 299 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 660 KiB/s wr, 58 op/s 2024-05-08T06:55:32.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:32 smithi172 ceph-mon[33377]: pgmap v278: 129 pgs: 129 active+clean; 299 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 660 KiB/s wr, 58 op/s 2024-05-08T06:55:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:34 smithi194 ceph-mon[33679]: pgmap v279: 129 pgs: 129 active+clean; 299 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 660 KiB/s wr, 58 op/s 2024-05-08T06:55:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:34 smithi070 ceph-mon[29591]: pgmap v279: 129 pgs: 129 active+clean; 299 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 660 KiB/s wr, 58 op/s 2024-05-08T06:55:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:34 smithi172 ceph-mon[33377]: pgmap v279: 129 pgs: 129 active+clean; 299 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 660 KiB/s wr, 58 op/s 2024-05-08T06:55:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:36 smithi194 ceph-mon[33679]: pgmap v280: 129 pgs: 129 active+clean; 303 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 997 KiB/s wr, 101 op/s 2024-05-08T06:55:36.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:36 smithi070 ceph-mon[29591]: pgmap v280: 129 pgs: 129 active+clean; 303 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 997 KiB/s wr, 101 op/s 2024-05-08T06:55:36.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:36 smithi172 ceph-mon[33377]: pgmap v280: 129 pgs: 129 active+clean; 303 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 997 KiB/s wr, 101 op/s 2024-05-08T06:55:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:37 smithi070 ceph-mon[29591]: pgmap v281: 129 pgs: 129 active+clean; 303 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 560 KiB/s wr, 63 op/s 2024-05-08T06:55:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:37 smithi172 ceph-mon[33377]: pgmap v281: 129 pgs: 129 active+clean; 303 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 560 KiB/s wr, 63 op/s 2024-05-08T06:55:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:37 smithi194 ceph-mon[33679]: pgmap v281: 129 pgs: 129 active+clean; 303 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 560 KiB/s wr, 63 op/s 2024-05-08T06:55:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:39 smithi194 ceph-mon[33679]: pgmap v282: 129 pgs: 129 active+clean; 306 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 888 KiB/s wr, 103 op/s 2024-05-08T06:55:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:39 smithi070 ceph-mon[29591]: pgmap v282: 129 pgs: 129 active+clean; 306 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 888 KiB/s wr, 103 op/s 2024-05-08T06:55:40.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:39 smithi172 ceph-mon[33377]: pgmap v282: 129 pgs: 129 active+clean; 306 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 888 KiB/s wr, 103 op/s 2024-05-08T06:55:42.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:42 smithi194 ceph-mon[33679]: pgmap v283: 129 pgs: 129 active+clean; 306 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 666 KiB/s wr, 82 op/s 2024-05-08T06:55:42.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:41 smithi070 ceph-mon[29591]: pgmap v283: 129 pgs: 129 active+clean; 306 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 666 KiB/s wr, 82 op/s 2024-05-08T06:55:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:42 smithi172 ceph-mon[33377]: pgmap v283: 129 pgs: 129 active+clean; 306 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 666 KiB/s wr, 82 op/s 2024-05-08T06:55:44.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:44 smithi194 ceph-mon[33679]: pgmap v284: 129 pgs: 129 active+clean; 306 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 666 KiB/s wr, 82 op/s 2024-05-08T06:55:44.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:44 smithi070 ceph-mon[29591]: pgmap v284: 129 pgs: 129 active+clean; 306 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 666 KiB/s wr, 82 op/s 2024-05-08T06:55:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:44 smithi172 ceph-mon[33377]: pgmap v284: 129 pgs: 129 active+clean; 306 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 666 KiB/s wr, 82 op/s 2024-05-08T06:55:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:46 smithi070 ceph-mon[29591]: pgmap v285: 129 pgs: 129 active+clean; 310 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1006 KiB/s wr, 123 op/s 2024-05-08T06:55:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:46 smithi172 ceph-mon[33377]: pgmap v285: 129 pgs: 129 active+clean; 310 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1006 KiB/s wr, 123 op/s 2024-05-08T06:55:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:46 smithi194 ceph-mon[33679]: pgmap v285: 129 pgs: 129 active+clean; 310 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1006 KiB/s wr, 123 op/s 2024-05-08T06:55:48.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:48 smithi070 ceph-mon[29591]: pgmap v286: 129 pgs: 129 active+clean; 310 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 668 KiB/s wr, 80 op/s 2024-05-08T06:55:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:48 smithi172 ceph-mon[33377]: pgmap v286: 129 pgs: 129 active+clean; 310 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 668 KiB/s wr, 80 op/s 2024-05-08T06:55:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:48 smithi194 ceph-mon[33679]: pgmap v286: 129 pgs: 129 active+clean; 310 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 668 KiB/s wr, 80 op/s 2024-05-08T06:55:50.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:50 smithi070 ceph-mon[29591]: pgmap v287: 129 pgs: 129 active+clean; 314 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-05-08T06:55:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:50 smithi172 ceph-mon[33377]: pgmap v287: 129 pgs: 129 active+clean; 314 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-05-08T06:55:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:50 smithi194 ceph-mon[33679]: pgmap v287: 129 pgs: 129 active+clean; 314 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-05-08T06:55:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:52 smithi070 ceph-mon[29591]: pgmap v288: 129 pgs: 129 active+clean; 314 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 703 KiB/s wr, 86 op/s 2024-05-08T06:55:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:52 smithi172 ceph-mon[33377]: pgmap v288: 129 pgs: 129 active+clean; 314 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 703 KiB/s wr, 86 op/s 2024-05-08T06:55:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:52 smithi194 ceph-mon[33679]: pgmap v288: 129 pgs: 129 active+clean; 314 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 703 KiB/s wr, 86 op/s 2024-05-08T06:55:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:54 smithi070 ceph-mon[29591]: pgmap v289: 129 pgs: 129 active+clean; 314 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 703 KiB/s wr, 86 op/s 2024-05-08T06:55:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:54 smithi172 ceph-mon[33377]: pgmap v289: 129 pgs: 129 active+clean; 314 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 703 KiB/s wr, 86 op/s 2024-05-08T06:55:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:54 smithi194 ceph-mon[33679]: pgmap v289: 129 pgs: 129 active+clean; 314 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 703 KiB/s wr, 86 op/s 2024-05-08T06:55:56.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:56 smithi070 ceph-mon[29591]: pgmap v290: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-05-08T06:55:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:56 smithi172 ceph-mon[33377]: pgmap v290: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-05-08T06:55:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:56 smithi194 ceph-mon[33679]: pgmap v290: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.2 MiB/s wr, 131 op/s 2024-05-08T06:55:58.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:58 smithi070 ceph-mon[29591]: pgmap v291: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 874 KiB/s wr, 91 op/s 2024-05-08T06:55:58.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:55:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:58 smithi172 ceph-mon[33377]: pgmap v291: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 874 KiB/s wr, 91 op/s 2024-05-08T06:55:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:55:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:58 smithi194 ceph-mon[33679]: pgmap v291: 129 pgs: 129 active+clean; 319 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 874 KiB/s wr, 91 op/s 2024-05-08T06:55:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:55:59.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:55:59.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:55:59.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:55:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:55:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:55:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:55:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:55:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:55:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:55:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:55:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:55:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:56:00.271 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T06:56:00.271 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T06:56:00.272 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:56:00.355 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:00 smithi070 ceph-mon[29591]: pgmap v292: 129 pgs: 129 active+clean; 323 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-05-08T06:56:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:00 smithi172 ceph-mon[33377]: pgmap v292: 129 pgs: 129 active+clean; 323 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-05-08T06:56:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:00 smithi194 ceph-mon[33679]: pgmap v292: 129 pgs: 129 active+clean; 323 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 1.2 MiB/s wr, 135 op/s 2024-05-08T06:56:00.762 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:56:02.317 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:02 smithi194 ceph-mon[33679]: pgmap v293: 129 pgs: 129 active+clean; 323 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 863 KiB/s wr, 89 op/s 2024-05-08T06:56:02.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:02 smithi070 ceph-mon[29591]: pgmap v293: 129 pgs: 129 active+clean; 323 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 863 KiB/s wr, 89 op/s 2024-05-08T06:56:02.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:02 smithi172 ceph-mon[33377]: pgmap v293: 129 pgs: 129 active+clean; 323 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 863 KiB/s wr, 89 op/s 2024-05-08T06:56:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.390+0000 7f3118600700 1 -- 172.21.15.70:0/323282732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31100756d0 msgr2=0x7f3110075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.390+0000 7f3118600700 1 --2- 172.21.15.70:0/323282732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31100756d0 0x7f3110075ab0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3104009990 tx=0x7f3104009ca0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.390+0000 7f3118600700 1 -- 172.21.15.70:0/323282732 shutdown_connections 2024-05-08T06:56:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.390+0000 7f3118600700 1 --2- 172.21.15.70:0/323282732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f311010ff00 0x7f31101122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.390+0000 7f3118600700 1 --2- 172.21.15.70:0/323282732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31100756d0 0x7f3110075ab0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.390+0000 7f3118600700 1 --2- 172.21.15.70:0/323282732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3110075ff0 0x7f311010f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.390+0000 7f3118600700 1 -- 172.21.15.70:0/323282732 >> 172.21.15.70:0/323282732 conn(0x7f311007a600 msgr2=0x7f311007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:03.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.391+0000 7f3118600700 1 -- 172.21.15.70:0/323282732 shutdown_connections 2024-05-08T06:56:03.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.391+0000 7f3118600700 1 -- 172.21.15.70:0/323282732 wait complete. 2024-05-08T06:56:03.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.392+0000 7f3118600700 1 Processor -- start 2024-05-08T06:56:03.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.392+0000 7f3118600700 1 -- start start 2024-05-08T06:56:03.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.393+0000 7f3118600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31100756d0 0x7f311019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:03.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.393+0000 7f3118600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3110075ff0 0x7f311019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:03.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.393+0000 7f3118600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f311010ff00 0x7f31101a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:03.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.393+0000 7f3118600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3110115890 con 0x7f3110075ff0 2024-05-08T06:56:03.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.393+0000 7f3118600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3110115710 con 0x7f31100756d0 2024-05-08T06:56:03.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.393+0000 7f3118600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3110115a10 con 0x7f311010ff00 2024-05-08T06:56:03.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.393+0000 7f3115200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3110075ff0 0x7f311019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:03.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.393+0000 7f3115200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3110075ff0 0x7f311019c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36482/0 (socket says 172.21.15.70:36482) 2024-05-08T06:56:03.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.393+0000 7f3115200700 1 -- 172.21.15.70:0/2876164896 learned_addr learned my addr 172.21.15.70:0/2876164896 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:03.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.394+0000 7f3115c00700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31100756d0 0x7f311019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:03.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.394+0000 7f3116600700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f311010ff00 0x7f31101a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:03.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.394+0000 7f3115200700 1 -- 172.21.15.70:0/2876164896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f311010ff00 msgr2=0x7f31101a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:03.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.394+0000 7f3115200700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f311010ff00 0x7f31101a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.394+0000 7f3115200700 1 -- 172.21.15.70:0/2876164896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31100756d0 msgr2=0x7f311019be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:03.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.394+0000 7f3115200700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31100756d0 0x7f311019be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.394+0000 7f3115200700 1 -- 172.21.15.70:0/2876164896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31101a0dc0 con 0x7f3110075ff0 2024-05-08T06:56:03.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.395+0000 7f3115200700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3110075ff0 0x7f311019c340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00b530 tx=0x7f30fc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:03.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.396+0000 7f310e000700 1 -- 172.21.15.70:0/2876164896 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc015020 con 0x7f3110075ff0 2024-05-08T06:56:03.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.396+0000 7f310e000700 1 -- 172.21.15.70:0/2876164896 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30fc011cc0 con 0x7f3110075ff0 2024-05-08T06:56:03.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.396+0000 7f310e000700 1 -- 172.21.15.70:0/2876164896 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc010c80 con 0x7f3110075ff0 2024-05-08T06:56:03.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.397+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31101a10b0 con 0x7f3110075ff0 2024-05-08T06:56:03.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.397+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31101a8930 con 0x7f3110075ff0 2024-05-08T06:56:03.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.399+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311006a190 con 0x7f3110075ff0 2024-05-08T06:56:03.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.401+0000 7f310e000700 1 -- 172.21.15.70:0/2876164896 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f30fc018020 con 0x7f3110075ff0 2024-05-08T06:56:03.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.403+0000 7f310e000700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30f80b2a70 0x7f30f80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:03.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.403+0000 7f310e000700 1 -- 172.21.15.70:0/2876164896 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 9583+0+0 (secure 0 0 0) 0x7f30fc0e1fc0 con 0x7f3110075ff0 2024-05-08T06:56:03.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.403+0000 7f3115c00700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30f80b2a70 0x7f30f80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:03.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.405+0000 7f3115c00700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30f80b2a70 0x7f30f80b4f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3104003760 tx=0x7f310400b540 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:03.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.409+0000 7f310e000700 1 -- 172.21.15.70:0/2876164896 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f30fc01f020 con 0x7f3110075ff0 2024-05-08T06:56:03.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.770+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f311002e510 con 0x7f3110075ff0 2024-05-08T06:56:03.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.772+0000 7f310e000700 1 -- 172.21.15.70:0/2876164896 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f30fc0a9630 con 0x7f3110075ff0 2024-05-08T06:56:03.771 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:56:03.771 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:56:03.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30f80b2a70 msgr2=0x7f30f80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:03.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30f80b2a70 0x7f30f80b4f30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3104003760 tx=0x7f310400b540 comp rx=0 tx=0).stop 2024-05-08T06:56:03.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3110075ff0 msgr2=0x7f311019c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:03.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3110075ff0 0x7f311019c340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f30fc00b530 tx=0x7f30fc00b840 comp rx=0 tx=0).stop 2024-05-08T06:56:03.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 shutdown_connections 2024-05-08T06:56:03.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30f80b2a70 0x7f30f80b4f30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f311010ff00 0x7f31101a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31100756d0 0x7f311019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 --2- 172.21.15.70:0/2876164896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3110075ff0 0x7f311019c340 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:03.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.776+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 >> 172.21.15.70:0/2876164896 conn(0x7f311007a600 msgr2=0x7f3110100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:03.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.777+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 shutdown_connections 2024-05-08T06:56:03.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:03.777+0000 7f3118600700 1 -- 172.21.15.70:0/2876164896 wait complete. 2024-05-08T06:56:03.777 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:56:04.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:04 smithi070 ceph-mon[29591]: pgmap v294: 129 pgs: 129 active+clean; 323 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 863 KiB/s wr, 89 op/s 2024-05-08T06:56:04.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:04 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2876164896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:56:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:04 smithi172 ceph-mon[33377]: pgmap v294: 129 pgs: 129 active+clean; 323 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 863 KiB/s wr, 89 op/s 2024-05-08T06:56:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:04 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2876164896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:56:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:04 smithi194 ceph-mon[33679]: pgmap v294: 129 pgs: 129 active+clean; 323 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 863 KiB/s wr, 89 op/s 2024-05-08T06:56:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:04 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2876164896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:56:04.623 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T06:56:04.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T06:56:05.093 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:56:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:06 smithi070 ceph-mon[29591]: pgmap v295: 129 pgs: 129 active+clean; 327 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-05-08T06:56:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:06 smithi172 ceph-mon[33377]: pgmap v295: 129 pgs: 129 active+clean; 327 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-05-08T06:56:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:06 smithi194 ceph-mon[33679]: pgmap v295: 129 pgs: 129 active+clean; 327 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2024-05-08T06:56:07.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.491+0000 7fbed8600700 1 -- 172.21.15.70:0/1881308333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 msgr2=0x7fbed01103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.491+0000 7fbed8600700 1 --2- 172.21.15.70:0/1881308333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 0x7fbed01103b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fbec800b0d0 tx=0x7fbec800b3e0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.491+0000 7fbed8600700 1 -- 172.21.15.70:0/1881308333 shutdown_connections 2024-05-08T06:56:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.491+0000 7fbed8600700 1 --2- 172.21.15.70:0/1881308333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 0x7fbed01103b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.491+0000 7fbed8600700 1 --2- 172.21.15.70:0/1881308333 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbed01037b0 0x7fbed0103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.491+0000 7fbed8600700 1 --2- 172.21.15.70:0/1881308333 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed0104160 0x7fbed01080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.491+0000 7fbed8600700 1 -- 172.21.15.70:0/1881308333 >> 172.21.15.70:0/1881308333 conn(0x7fbed007a570 msgr2=0x7fbed007a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.492+0000 7fbed8600700 1 -- 172.21.15.70:0/1881308333 shutdown_connections 2024-05-08T06:56:07.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.492+0000 7fbed8600700 1 -- 172.21.15.70:0/1881308333 wait complete. 2024-05-08T06:56:07.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.493+0000 7fbed8600700 1 Processor -- start 2024-05-08T06:56:07.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.493+0000 7fbed8600700 1 -- start start 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.493+0000 7fbed8600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed01037b0 0x7fbed0199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed8600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbed0104160 0x7fbed0199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed8600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 0x7fbed019e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed8600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01135a0 con 0x7fbed01087a0 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed8600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0113420 con 0x7fbed01037b0 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed8600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0113720 con 0x7fbed0104160 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 0x7fbed019e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed5c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed01037b0 0x7fbed0199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 0x7fbed019e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60186/0 (socket says 172.21.15.70:60186) 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed6600700 1 -- 172.21.15.70:0/3946752609 learned_addr learned my addr 172.21.15.70:0/3946752609 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.494+0000 7fbed5200700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbed0104160 0x7fbed0199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.495+0000 7fbed5c00700 1 -- 172.21.15.70:0/3946752609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbed0104160 msgr2=0x7fbed0199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.495+0000 7fbed5c00700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbed0104160 0x7fbed0199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.495+0000 7fbed5c00700 1 -- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 msgr2=0x7fbed019e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.495+0000 7fbed5c00700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 0x7fbed019e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.495+0000 7fbed5c00700 1 -- 172.21.15.70:0/3946752609 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed019ea70 con 0x7fbed01037b0 2024-05-08T06:56:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.495+0000 7fbed6600700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 0x7fbed019e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:56:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.496+0000 7fbed5c00700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed01037b0 0x7fbed0199a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbec400d750 tx=0x7fbec400da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:07.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.496+0000 7fbece000700 1 -- 172.21.15.70:0/3946752609 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4016070 con 0x7fbed01037b0 2024-05-08T06:56:07.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.496+0000 7fbed8600700 1 -- 172.21.15.70:0/3946752609 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed019ed60 con 0x7fbed01037b0 2024-05-08T06:56:07.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.496+0000 7fbece000700 1 -- 172.21.15.70:0/3946752609 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbec4005020 con 0x7fbed01037b0 2024-05-08T06:56:07.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.496+0000 7fbece000700 1 -- 172.21.15.70:0/3946752609 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec401f060 con 0x7fbed01037b0 2024-05-08T06:56:07.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.496+0000 7fbed8600700 1 -- 172.21.15.70:0/3946752609 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed01a6620 con 0x7fbed01037b0 2024-05-08T06:56:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.502+0000 7fbee3012b80 1 Processor -- start 2024-05-08T06:56:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.502+0000 7fbece000700 1 -- 172.21.15.70:0/3946752609 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbec40054d0 con 0x7fbed01037b0 2024-05-08T06:56:07.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.502+0000 7fbee3012b80 1 -- start start 2024-05-08T06:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.502+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c06ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.502+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c07430 0x562e24c0aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.502+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c0b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.502+0000 7fbee3012b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e24b54bb0 con 0x562e24c0b420 2024-05-08T06:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.502+0000 7fbee3012b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e24af28f0 con 0x562e24c07430 2024-05-08T06:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.502+0000 7fbee3012b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562e24b50b70 con 0x562e24c06b10 2024-05-08T06:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c0b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c0b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60198/0 (socket says 172.21.15.70:60198) 2024-05-08T06:56:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed5200700 1 -- 172.21.15.70:0/1706256626 learned_addr learned my addr 172.21.15.70:0/1706256626 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed5c00700 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c07430 0x562e24c0aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed6600700 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c06ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed5200700 1 -- 172.21.15.70:0/1706256626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 msgr2=0x562e24c06ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:07.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed5200700 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c06ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed5200700 1 -- 172.21.15.70:0/1706256626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c07430 msgr2=0x562e24c0aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:07.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed5200700 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c07430 0x562e24c0aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed5200700 1 -- 172.21.15.70:0/1706256626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e24aa1a60 con 0x562e24c0b420 2024-05-08T06:56:07.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.503+0000 7fbed6600700 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c06ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:56:07.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.504+0000 7fbed5200700 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c0b860 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00ac20 tx=0x7fbebc00af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f4a7d56aa0f1f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.504+0000 7fbece000700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbeb80b2aa0 0x7fbeb80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.504+0000 7fbec2a00700 1 -- 172.21.15.70:0/1706256626 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00fe30 con 0x562e24c0b420 2024-05-08T06:56:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.504+0000 7fbece000700 1 -- 172.21.15.70:0/3946752609 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9671+0+0 (secure 0 0 0) 0x7fbec40e2450 con 0x7fbed01037b0 2024-05-08T06:56:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.504+0000 7fbec2a00700 1 -- 172.21.15.70:0/1706256626 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbebc0044c0 con 0x562e24c0b420 2024-05-08T06:56:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.504+0000 7fbec2a00700 1 -- 172.21.15.70:0/1706256626 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc018430 con 0x562e24c0b420 2024-05-08T06:56:07.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.504+0000 7fbed6600700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbeb80b2aa0 0x7fbeb80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.505+0000 7fbee3012b80 1 -- 172.21.15.70:0/1706256626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 msgr2=0x562e24c0b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.505+0000 7fbed6600700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbeb80b2aa0 0x7fbeb80b4f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009fd0 tx=0x7fbec800b040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.505+0000 7fbee3012b80 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c0b860 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00ac20 tx=0x7fbebc00af30 comp rx=0 tx=0).stop 2024-05-08T06:56:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.505+0000 7fbee3012b80 1 -- 172.21.15.70:0/1706256626 shutdown_connections 2024-05-08T06:56:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.505+0000 7fbee3012b80 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c0b860 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.505+0000 7fbee3012b80 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c06ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.505+0000 7fbee3012b80 1 --2- 172.21.15.70:0/1706256626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c07430 0x562e24c0aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.505+0000 7fbee3012b80 1 -- 172.21.15.70:0/1706256626 >> 172.21.15.70:0/1706256626 conn(0x562e24b30cf0 msgr2=0x562e24bfce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:07.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.506+0000 7fbee3012b80 1 -- 172.21.15.70:0/1706256626 shutdown_connections 2024-05-08T06:56:07.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.506+0000 7fbee3012b80 1 -- 172.21.15.70:0/1706256626 wait complete. 2024-05-08T06:56:07.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.506+0000 7fbee3012b80 1 -- start start 2024-05-08T06:56:07.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.507+0000 7fbee3012b80 1 Processor -- start 2024-05-08T06:56:07.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.507+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c06b10 0x562e24c05ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.507+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c07430 0x562e24c06220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.507+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24bff520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.507+0000 7fbee3012b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e24c13650 con 0x562e24c0b420 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.507+0000 7fbee3012b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e24abacb0 con 0x562e24c06b10 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.507+0000 7fbee3012b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562e24c137d0 con 0x562e24c07430 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.507+0000 7fbee3012b80 10 client.0 _ll_register_callbacks cb 0x562e24afbe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24bff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24bff520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60200/0 (socket says 172.21.15.70:60200) 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed6600700 1 -- 172.21.15.70:0/2892452287 learned_addr learned my addr 172.21.15.70:0/2892452287 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed5200700 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c07430 0x562e24c06220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed5c00700 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c06b10 0x562e24c05ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed6600700 1 -- 172.21.15.70:0/2892452287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c07430 msgr2=0x562e24c06220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed6600700 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c07430 0x562e24c06220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed6600700 1 -- 172.21.15.70:0/2892452287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c06b10 msgr2=0x562e24c05ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed6600700 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c06b10 0x562e24c05ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed6600700 1 -- 172.21.15.70:0/2892452287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e24b1a5b0 con 0x562e24c0b420 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.508+0000 7fbed5200700 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c07430 0x562e24c06220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.509+0000 7fbed6600700 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24bff520 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007c20 tx=0x7fbec80099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84ca8f1e09f65c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.509+0000 7fbeb7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.509+0000 7fbeb7400700 1 -- 172.21.15.70:0/2892452287 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec801dcc0 con 0x562e24c0b420 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.509+0000 7fbeb7400700 1 -- 172.21.15.70:0/2892452287 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9671+0+0 (secure 0 0 0) 0x7fbec802a450 con 0x562e24c0b420 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.509+0000 7fbee3012b80 1 -- 172.21.15.70:0/2892452287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbebc0044c0 con 0x562e24c0b420 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.509+0000 7fbeb7400700 1 -- 172.21.15.70:0/2892452287 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbec8039050 con 0x562e24c0b420 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.509+0000 7fbee3012b80 10 client.15717 fetch_fsmap learned FSMap version 28 2024-05-08T06:56:07.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.509+0000 7fbee3012b80 1 -- 172.21.15.70:0/2892452287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e24c22360 con 0x562e24c0b420 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.510+0000 7fbeb7400700 1 -- 172.21.15.70:0/2892452287 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbebc0044c0 con 0x562e24c0b420 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.510+0000 7fbeb7400700 1 -- 172.21.15.70:0/2892452287 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbec8011070 con 0x562e24c0b420 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.510+0000 7fbee3012b80 10 client.15717 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.510+0000 7fbee3012b80 10 client.15717 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.510+0000 7fbee3012b80 20 client.15717 populate_metadata read hostname 'smithi070' 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.510+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e24c24a40 0x562e24c26e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.510+0000 7fbee3012b80 4 client.15717 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.510+0000 7fbee3012b80 1 -- 172.21.15.70:0/2892452287 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e24bcf230 con 0x562e24c24a40 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.511+0000 7fbed5c00700 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e24c24a40 0x562e24c26e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.512+0000 7fbed5c00700 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e24c24a40 0x562e24c26e90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5284cc654efc6115 server_cookie=c7595659d7061f57 in_seq=0 out_seq=0 2024-05-08T06:56:07.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.512+0000 7fbeb7400700 10 client.15717 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:56:07.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbeb7400700 1 -- 172.21.15.70:0/2892452287 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562e24bcf230 con 0x562e24c24a40 2024-05-08T06:56:07.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbeb7400700 10 client.15717 handle_command_reply: tid=0 2024-05-08T06:56:07.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 client.15717 shutdown 2024-05-08T06:56:07.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 -- 172.21.15.70:0/2892452287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 msgr2=0x562e24bff520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24bff520 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007c20 tx=0x7fbec80099e0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 -- 172.21.15.70:0/2892452287 shutdown_connections 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e24c24a40 0x562e24c26e90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24bff520 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c06b10 0x562e24c05ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2892452287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c07430 0x562e24c06220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 -- 172.21.15.70:0/2892452287 >> 172.21.15.70:0/2892452287 conn(0x562e24b30cf0 msgr2=0x562e24c0b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbeb7400700 0 client.15717 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.515+0000 7fbee3012b80 1 -- 172.21.15.70:0/2892452287 shutdown_connections 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.516+0000 7fbee3012b80 1 -- 172.21.15.70:0/2892452287 wait complete. 2024-05-08T06:56:07.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.516+0000 7fbee3012b80 20 client.15717 trim_cache size 0 max 16384 2024-05-08T06:56:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.542+0000 7fbee3012b80 1 Processor -- start 2024-05-08T06:56:07.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.542+0000 7fbee3012b80 1 -- start start 2024-05-08T06:56:07.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.542+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c04fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.542+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c07430 0x562e24c2c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.542+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c0b420 0x562e24c2cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.542+0000 7fbee3012b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01afc30 con 0x562e24c07430 2024-05-08T06:56:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.542+0000 7fbee3012b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01ad4c0 con 0x562e24c0b420 2024-05-08T06:56:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.542+0000 7fbee3012b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01ab330 con 0x562e24c06b10 2024-05-08T06:56:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.543+0000 7fbed5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c07430 0x562e24c2c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.543+0000 7fbed5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c07430 0x562e24c2c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60210/0 (socket says 172.21.15.70:60210) 2024-05-08T06:56:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.543+0000 7fbed5200700 1 -- 172.21.15.70:0/2068367058 learned_addr learned my addr 172.21.15.70:0/2068367058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:07.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.543+0000 7fbed6600700 1 --2- 172.21.15.70:0/2068367058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c0b420 0x562e24c2cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.544+0000 7fbed5c00700 1 --2- 172.21.15.70:0/2068367058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c04fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.544+0000 7fbed5200700 1 -- 172.21.15.70:0/2068367058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 msgr2=0x562e24c04fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:07.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.544+0000 7fbed5200700 1 --2- 172.21.15.70:0/2068367058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c04fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.544+0000 7fbed5200700 1 -- 172.21.15.70:0/2068367058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c0b420 msgr2=0x562e24c2cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:07.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.544+0000 7fbed5200700 1 --2- 172.21.15.70:0/2068367058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c0b420 0x562e24c2cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.544+0000 7fbed5200700 1 -- 172.21.15.70:0/2068367058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e24bf9a10 con 0x562e24c07430 2024-05-08T06:56:07.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.545+0000 7fbed5200700 1 --2- 172.21.15.70:0/2068367058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c07430 0x562e24c2c760 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x562e24bff170 tx=0x7fbebc005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98b0052035b7d56 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:07.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.545+0000 7fbec2000700 1 -- 172.21.15.70:0/2068367058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc026070 con 0x562e24c07430 2024-05-08T06:56:07.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.545+0000 7fbec2000700 1 -- 172.21.15.70:0/2068367058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbebc003b10 con 0x562e24c07430 2024-05-08T06:56:07.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.545+0000 7fbec2000700 1 -- 172.21.15.70:0/2068367058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc005750 con 0x562e24c07430 2024-05-08T06:56:07.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.546+0000 7fbee3012b80 1 -- 172.21.15.70:0/2068367058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c07430 msgr2=0x562e24c2c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:07.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.546+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2068367058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c07430 0x562e24c2c760 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x562e24bff170 tx=0x7fbebc005f30 comp rx=0 tx=0).stop 2024-05-08T06:56:07.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.546+0000 7fbee3012b80 1 -- 172.21.15.70:0/2068367058 shutdown_connections 2024-05-08T06:56:07.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.546+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2068367058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c0b420 0x562e24c2cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.546+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2068367058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c04fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.546+0000 7fbee3012b80 1 --2- 172.21.15.70:0/2068367058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c07430 0x562e24c2c760 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.546+0000 7fbee3012b80 1 -- 172.21.15.70:0/2068367058 >> 172.21.15.70:0/2068367058 conn(0x562e24b30cf0 msgr2=0x562e24c048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:07.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.546+0000 7fbee3012b80 1 -- 172.21.15.70:0/2068367058 shutdown_connections 2024-05-08T06:56:07.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.547+0000 7fbee3012b80 1 -- 172.21.15.70:0/2068367058 wait complete. 2024-05-08T06:56:07.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.547+0000 7fbee3012b80 1 -- start start 2024-05-08T06:56:07.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.547+0000 7fbee3012b80 1 Processor -- start 2024-05-08T06:56:07.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c21ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c07430 0x562e24c1e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbee3012b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c1e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbee3012b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01ab980 con 0x562e24c0b420 2024-05-08T06:56:07.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbee3012b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01acdf0 con 0x562e24c07430 2024-05-08T06:56:07.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbee3012b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01ac050 con 0x562e24c06b10 2024-05-08T06:56:07.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbee3012b80 10 client.0 _ll_register_callbacks cb 0x562e24afbe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:56:07.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbed6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c1e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbed6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c1e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60222/0 (socket says 172.21.15.70:60222) 2024-05-08T06:56:07.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.548+0000 7fbed6600700 1 -- 172.21.15.70:0/3697171762 learned_addr learned my addr 172.21.15.70:0/3697171762 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:07.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.549+0000 7fbed5c00700 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c21ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.549+0000 7fbed6600700 1 -- 172.21.15.70:0/3697171762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 msgr2=0x562e24c21ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:07.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.549+0000 7fbed6600700 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c21ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.549+0000 7fbed6600700 1 -- 172.21.15.70:0/3697171762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c07430 msgr2=0x562e24c1e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:07.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.549+0000 7fbed6600700 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c07430 0x562e24c1e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:07.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.549+0000 7fbed6600700 1 -- 172.21.15.70:0/3697171762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e24c1f100 con 0x562e24c0b420 2024-05-08T06:56:07.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.549+0000 7fbed5c00700 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c21ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:56:07.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.549+0000 7fbed6600700 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c1e890 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fbec800b010 tx=0x7fbec801d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6eaa38e31889fa2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:07.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.549+0000 7fbeb7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:56:07.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.550+0000 7fbeb7400700 1 -- 172.21.15.70:0/3697171762 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec801de10 con 0x562e24c0b420 2024-05-08T06:56:07.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.550+0000 7fbee3012b80 1 -- 172.21.15.70:0/3697171762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbebc003b10 con 0x562e24c0b420 2024-05-08T06:56:07.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.550+0000 7fbeb7400700 1 -- 172.21.15.70:0/3697171762 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9671+0+0 (secure 0 0 0) 0x7fbec8003a00 con 0x562e24c0b420 2024-05-08T06:56:07.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.550+0000 7fbeb7400700 1 -- 172.21.15.70:0/3697171762 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbec804b050 con 0x562e24c0b420 2024-05-08T06:56:07.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.550+0000 7fbee3012b80 10 client.15723 fetch_fsmap learned FSMap version 28 2024-05-08T06:56:07.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.550+0000 7fbee3012b80 1 -- 172.21.15.70:0/3697171762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562e24c903e0 con 0x562e24c0b420 2024-05-08T06:56:07.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.550+0000 7fbeb7400700 1 -- 172.21.15.70:0/3697171762 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbebc003b10 con 0x562e24c0b420 2024-05-08T06:56:07.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.551+0000 7fbeb7400700 1 -- 172.21.15.70:0/3697171762 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbec8011040 con 0x562e24c0b420 2024-05-08T06:56:07.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.551+0000 7fbee3012b80 10 client.15723 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:56:07.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.551+0000 7fbee3012b80 10 client.15723 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:56:07.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.551+0000 7fbee3012b80 20 client.15723 populate_metadata read hostname 'smithi070' 2024-05-08T06:56:07.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.551+0000 7fbee3012b80 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e24c90ac0 0x562e24c92f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:07.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.551+0000 7fbee3012b80 4 client.15723 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T06:56:07.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.551+0000 7fbee3012b80 1 -- 172.21.15.70:0/3697171762 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x562e24b62590 con 0x562e24c90ac0 2024-05-08T06:56:07.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.552+0000 7fbed5c00700 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e24c90ac0 0x562e24c92f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:07.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.553+0000 7fbed5c00700 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e24c90ac0 0x562e24c92f20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d83d504d61d44d33 server_cookie=84f043c9e02608a6 in_seq=0 out_seq=0 2024-05-08T06:56:07.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:07.554+0000 7fbeb7400700 10 client.15723 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:56:08.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:08 smithi070 ceph-mon[29591]: pgmap v296: 129 pgs: 129 active+clean; 327 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 782 KiB/s wr, 100 op/s 2024-05-08T06:56:08.382 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:08 smithi070 ceph-mon[29591]: osdmap e100: 12 total, 12 up, 12 in 2024-05-08T06:56:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:08 smithi172 ceph-mon[33377]: pgmap v296: 129 pgs: 129 active+clean; 327 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 782 KiB/s wr, 100 op/s 2024-05-08T06:56:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:08 smithi172 ceph-mon[33377]: osdmap e100: 12 total, 12 up, 12 in 2024-05-08T06:56:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:08 smithi194 ceph-mon[33679]: pgmap v296: 129 pgs: 129 active+clean; 327 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 782 KiB/s wr, 100 op/s 2024-05-08T06:56:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:08 smithi194 ceph-mon[33679]: osdmap e100: 12 total, 12 up, 12 in 2024-05-08T06:56:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:10 smithi070 ceph-mon[29591]: pgmap v298: 129 pgs: 129 active+clean; 332 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1016 KiB/s wr, 112 op/s 2024-05-08T06:56:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:10 smithi172 ceph-mon[33377]: pgmap v298: 129 pgs: 129 active+clean; 332 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1016 KiB/s wr, 112 op/s 2024-05-08T06:56:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:10 smithi194 ceph-mon[33679]: pgmap v298: 129 pgs: 129 active+clean; 332 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1016 KiB/s wr, 112 op/s 2024-05-08T06:56:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:12 smithi070 ceph-mon[29591]: pgmap v299: 129 pgs: 129 active+clean; 332 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1016 KiB/s wr, 112 op/s 2024-05-08T06:56:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:12 smithi172 ceph-mon[33377]: pgmap v299: 129 pgs: 129 active+clean; 332 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1016 KiB/s wr, 112 op/s 2024-05-08T06:56:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:12 smithi194 ceph-mon[33679]: pgmap v299: 129 pgs: 129 active+clean; 332 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 1016 KiB/s wr, 112 op/s 2024-05-08T06:56:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:13 smithi172 ceph-mon[33377]: osdmap e101: 12 total, 12 up, 12 in 2024-05-08T06:56:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:13 smithi194 ceph-mon[33679]: osdmap e101: 12 total, 12 up, 12 in 2024-05-08T06:56:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:13 smithi070 ceph-mon[29591]: osdmap e101: 12 total, 12 up, 12 in 2024-05-08T06:56:14.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:14 smithi172 ceph-mon[33377]: pgmap v301: 129 pgs: 129 active+clean; 332 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 626 KiB/s wr, 56 op/s 2024-05-08T06:56:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:14 smithi194 ceph-mon[33679]: pgmap v301: 129 pgs: 129 active+clean; 332 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 626 KiB/s wr, 56 op/s 2024-05-08T06:56:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:14 smithi070 ceph-mon[29591]: pgmap v301: 129 pgs: 129 active+clean; 332 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 626 KiB/s wr, 56 op/s 2024-05-08T06:56:15.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.540+0000 7fbeb7400700 1 -- 172.21.15.70:0/3697171762 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562e24b62590 con 0x562e24c90ac0 2024-05-08T06:56:15.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.540+0000 7fbeb7400700 10 client.15723 handle_command_reply: tid=0 2024-05-08T06:56:15.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.540+0000 7fbee3012b80 1 client.15723 shutdown 2024-05-08T06:56:15.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.541+0000 7fbee3012b80 1 -- 172.21.15.70:0/3697171762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 msgr2=0x562e24c1e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:15.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.541+0000 7fbee3012b80 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c1e890 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fbec800b010 tx=0x7fbec801d840 comp rx=0 tx=0).stop 2024-05-08T06:56:15.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.541+0000 7fbee3012b80 1 -- 172.21.15.70:0/3697171762 shutdown_connections 2024-05-08T06:56:15.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.541+0000 7fbee3012b80 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e24c90ac0 0x562e24c92f20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:15.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.541+0000 7fbee3012b80 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e24c0b420 0x562e24c1e890 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:15.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.541+0000 7fbee3012b80 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e24c06b10 0x562e24c21ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:15.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.541+0000 7fbee3012b80 1 --2- 172.21.15.70:0/3697171762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e24c07430 0x562e24c1e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:15.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.541+0000 7fbeb7400700 0 client.15723 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:56:15.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.541+0000 7fbee3012b80 1 -- 172.21.15.70:0/3697171762 >> 172.21.15.70:0/3697171762 conn(0x562e24b30cf0 msgr2=0x562e24c05070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:15.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.542+0000 7fbee3012b80 1 -- 172.21.15.70:0/3697171762 shutdown_connections 2024-05-08T06:56:15.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.542+0000 7fbee3012b80 1 -- 172.21.15.70:0/3697171762 wait complete. 2024-05-08T06:56:15.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.542+0000 7fbee3012b80 20 client.15723 trim_cache size 0 max 16384 2024-05-08T06:56:15.542 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:56:15.542 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 26, 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "fba7fe7a": { 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 26, 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:56:15.543 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:15.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:15.545 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:56:15.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 -- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbeb80b2aa0 msgr2=0x7fbeb80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:15.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbeb80b2aa0 0x7fbeb80b4f60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbec8009fd0 tx=0x7fbec800b040 comp rx=0 tx=0).stop 2024-05-08T06:56:15.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 -- 172.21.15.70:0/3946752609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed01037b0 msgr2=0x7fbed0199a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:15.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed01037b0 0x7fbed0199a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbec400d750 tx=0x7fbec400da60 comp rx=0 tx=0).stop 2024-05-08T06:56:15.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 -- 172.21.15.70:0/3946752609 shutdown_connections 2024-05-08T06:56:15.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbeb80b2aa0 0x7fbeb80b4f60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:15.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbed01087a0 0x7fbed019e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:15.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbed01037b0 0x7fbed0199a70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:15.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 --2- 172.21.15.70:0/3946752609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbed0104160 0x7fbed0199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:15.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.543+0000 7fbed8600700 1 -- 172.21.15.70:0/3946752609 >> 172.21.15.70:0/3946752609 conn(0x7fbed007a570 msgr2=0x7fbed0101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:15.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.544+0000 7fbed8600700 1 -- 172.21.15.70:0/3946752609 shutdown_connections 2024-05-08T06:56:15.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:15.544+0000 7fbed8600700 1 -- 172.21.15.70:0/3946752609 wait complete. 2024-05-08T06:56:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:16 smithi070 ceph-mon[29591]: pgmap v302: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 744 KiB/s wr, 75 op/s 2024-05-08T06:56:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:16 smithi172 ceph-mon[33377]: pgmap v302: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 744 KiB/s wr, 75 op/s 2024-05-08T06:56:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:16 smithi194 ceph-mon[33679]: pgmap v302: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 744 KiB/s wr, 75 op/s 2024-05-08T06:56:16.653 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fba7fe7a', quiesce took 16.4 seconds. Will release after: 30.0 2024-05-08T06:56:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:18 smithi172 ceph-mon[33377]: pgmap v303: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 605 KiB/s wr, 61 op/s 2024-05-08T06:56:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:18 smithi194 ceph-mon[33679]: pgmap v303: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 605 KiB/s wr, 61 op/s 2024-05-08T06:56:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:18 smithi070 ceph-mon[29591]: pgmap v303: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 605 KiB/s wr, 61 op/s 2024-05-08T06:56:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:20 smithi194 ceph-mon[33679]: pgmap v304: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 156 KiB/s wr, 42 op/s 2024-05-08T06:56:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:20 smithi070 ceph-mon[29591]: pgmap v304: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 156 KiB/s wr, 42 op/s 2024-05-08T06:56:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:20 smithi172 ceph-mon[33377]: pgmap v304: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 156 KiB/s wr, 42 op/s 2024-05-08T06:56:22.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:22 smithi194 ceph-mon[33679]: pgmap v305: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 156 KiB/s wr, 42 op/s 2024-05-08T06:56:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:22 smithi070 ceph-mon[29591]: pgmap v305: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 156 KiB/s wr, 42 op/s 2024-05-08T06:56:22.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:22 smithi172 ceph-mon[33377]: pgmap v305: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 156 KiB/s wr, 42 op/s 2024-05-08T06:56:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:24 smithi194 ceph-mon[33679]: pgmap v306: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 144 KiB/s wr, 39 op/s 2024-05-08T06:56:24.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:24 smithi070 ceph-mon[29591]: pgmap v306: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 144 KiB/s wr, 39 op/s 2024-05-08T06:56:24.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:24 smithi172 ceph-mon[33377]: pgmap v306: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 144 KiB/s wr, 39 op/s 2024-05-08T06:56:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:26 smithi194 ceph-mon[33679]: pgmap v307: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 135 KiB/s wr, 38 op/s 2024-05-08T06:56:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:26 smithi070 ceph-mon[29591]: pgmap v307: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 135 KiB/s wr, 38 op/s 2024-05-08T06:56:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:26 smithi172 ceph-mon[33377]: pgmap v307: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 135 KiB/s wr, 38 op/s 2024-05-08T06:56:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:28 smithi194 ceph-mon[33679]: pgmap v308: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 56 KiB/s wr, 25 op/s 2024-05-08T06:56:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:28 smithi070 ceph-mon[29591]: pgmap v308: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 56 KiB/s wr, 25 op/s 2024-05-08T06:56:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:28 smithi172 ceph-mon[33377]: pgmap v308: 129 pgs: 129 active+clean; 333 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 56 KiB/s wr, 25 op/s 2024-05-08T06:56:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:30 smithi194 ceph-mon[33679]: pgmap v309: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-05-08T06:56:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:30 smithi070 ceph-mon[29591]: pgmap v309: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-05-08T06:56:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:30 smithi172 ceph-mon[33377]: pgmap v309: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-05-08T06:56:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:32 smithi194 ceph-mon[33679]: pgmap v310: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.6 KiB/s wr, 6 op/s 2024-05-08T06:56:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:32 smithi070 ceph-mon[29591]: pgmap v310: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.6 KiB/s wr, 6 op/s 2024-05-08T06:56:32.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:32 smithi172 ceph-mon[33377]: pgmap v310: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.6 KiB/s wr, 6 op/s 2024-05-08T06:56:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:34 smithi194 ceph-mon[33679]: pgmap v311: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.6 KiB/s wr, 6 op/s 2024-05-08T06:56:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:34 smithi070 ceph-mon[29591]: pgmap v311: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.6 KiB/s wr, 6 op/s 2024-05-08T06:56:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:34 smithi172 ceph-mon[33377]: pgmap v311: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.6 KiB/s wr, 6 op/s 2024-05-08T06:56:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:35 smithi070 ceph-mon[29591]: pgmap v312: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-05-08T06:56:35.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:35 smithi172 ceph-mon[33377]: pgmap v312: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-05-08T06:56:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:35 smithi194 ceph-mon[33679]: pgmap v312: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 14 KiB/s wr, 9 op/s 2024-05-08T06:56:38.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:38 smithi070 ceph-mon[29591]: pgmap v313: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 5 op/s 2024-05-08T06:56:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:38 smithi172 ceph-mon[33377]: pgmap v313: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 5 op/s 2024-05-08T06:56:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:38 smithi194 ceph-mon[33679]: pgmap v313: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 5 op/s 2024-05-08T06:56:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:40 smithi070 ceph-mon[29591]: pgmap v314: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T06:56:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:40 smithi172 ceph-mon[33377]: pgmap v314: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T06:56:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:40 smithi194 ceph-mon[33679]: pgmap v314: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T06:56:42.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:42 smithi070 ceph-mon[29591]: pgmap v315: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2024-05-08T06:56:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:42 smithi172 ceph-mon[33377]: pgmap v315: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2024-05-08T06:56:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:42 smithi194 ceph-mon[33679]: pgmap v315: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2024-05-08T06:56:44.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:44 smithi070 ceph-mon[29591]: pgmap v316: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2024-05-08T06:56:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:44 smithi172 ceph-mon[33377]: pgmap v316: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2024-05-08T06:56:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:44 smithi194 ceph-mon[33679]: pgmap v316: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 KiB/s wr, 5 op/s 2024-05-08T06:56:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:46 smithi070 ceph-mon[29591]: pgmap v317: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T06:56:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:46 smithi172 ceph-mon[33377]: pgmap v317: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T06:56:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:46 smithi194 ceph-mon[33679]: pgmap v317: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T06:56:46.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:56:47.120 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:56:48.310 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:48 smithi070 ceph-mon[29591]: pgmap v318: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-05-08T06:56:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:48 smithi172 ceph-mon[33377]: pgmap v318: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-05-08T06:56:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:48 smithi194 ceph-mon[33679]: pgmap v318: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-05-08T06:56:49.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.522+0000 7f1403a00700 1 -- 172.21.15.70:0/2189683688 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc0756d0 msgr2=0x7f13fc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.522+0000 7f1403a00700 1 --2- 172.21.15.70:0/2189683688 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc0756d0 0x7f13fc075ab0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009990 tx=0x7f13f0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.522+0000 7f1403a00700 1 -- 172.21.15.70:0/2189683688 shutdown_connections 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.522+0000 7f1403a00700 1 --2- 172.21.15.70:0/2189683688 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13fc10fea0 0x7f13fc112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.522+0000 7f1403a00700 1 --2- 172.21.15.70:0/2189683688 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc0756d0 0x7f13fc075ab0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.522+0000 7f1403a00700 1 --2- 172.21.15.70:0/2189683688 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13fc075ff0 0x7f13fc10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.522+0000 7f1403a00700 1 -- 172.21.15.70:0/2189683688 >> 172.21.15.70:0/2189683688 conn(0x7f13fc07a600 msgr2=0x7f13fc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.522+0000 7f1403a00700 1 -- 172.21.15.70:0/2189683688 shutdown_connections 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.522+0000 7f1403a00700 1 -- 172.21.15.70:0/2189683688 wait complete. 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.523+0000 7f1403a00700 1 Processor -- start 2024-05-08T06:56:49.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.523+0000 7f1403a00700 1 -- start start 2024-05-08T06:56:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f1403a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13fc0756d0 0x7f13fc1a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f1403a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc075ff0 0x7f13fc1a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f1403a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13fc10fea0 0x7f13fc19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f1403a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc115700 con 0x7f13fc075ff0 2024-05-08T06:56:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f1403a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc115580 con 0x7f13fc0756d0 2024-05-08T06:56:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f1403a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc115880 con 0x7f13fc10fea0 2024-05-08T06:56:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f13fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc075ff0 0x7f13fc1a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:49.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f13fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc075ff0 0x7f13fc1a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54790/0 (socket says 172.21.15.70:54790) 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f13fbe00700 1 -- 172.21.15.70:0/3115596942 learned_addr learned my addr 172.21.15.70:0/3115596942 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f1401000700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13fc0756d0 0x7f13fc1a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.524+0000 7f1401a00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13fc10fea0 0x7f13fc19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.525+0000 7f13fbe00700 1 -- 172.21.15.70:0/3115596942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13fc10fea0 msgr2=0x7f13fc19bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.525+0000 7f13fbe00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13fc10fea0 0x7f13fc19bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.525+0000 7f13fbe00700 1 -- 172.21.15.70:0/3115596942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13fc0756d0 msgr2=0x7f13fc1a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.525+0000 7f13fbe00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13fc0756d0 0x7f13fc1a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.525+0000 7f13fbe00700 1 -- 172.21.15.70:0/3115596942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc19c240 con 0x7f13fc075ff0 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.525+0000 7f13fbe00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc075ff0 0x7f13fc1a1e60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c970 tx=0x7f13e800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.525+0000 7f13f9600700 1 -- 172.21.15.70:0/3115596942 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8004220 con 0x7f13fc075ff0 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.525+0000 7f13f9600700 1 -- 172.21.15.70:0/3115596942 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e8007d30 con 0x7f13fc075ff0 2024-05-08T06:56:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.525+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc19c530 con 0x7f13fc075ff0 2024-05-08T06:56:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.526+0000 7f13f9600700 1 -- 172.21.15.70:0/3115596942 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8003c90 con 0x7f13fc075ff0 2024-05-08T06:56:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.526+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc1a87f0 con 0x7f13fc075ff0 2024-05-08T06:56:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.527+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc06a190 con 0x7f13fc075ff0 2024-05-08T06:56:49.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.529+0000 7f13f9600700 1 -- 172.21.15.70:0/3115596942 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f13e80078a0 con 0x7f13fc075ff0 2024-05-08T06:56:49.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.531+0000 7f13f9600700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:49.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.531+0000 7f13f9600700 1 -- 172.21.15.70:0/3115596942 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9583+0+0 (secure 0 0 0) 0x7f13e80e26b0 con 0x7f13fc075ff0 2024-05-08T06:56:49.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.531+0000 7f1401000700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:49.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.532+0000 7f1401000700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13f000b5c0 tx=0x7f13f001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:49.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.536+0000 7f13f9600700 1 -- 172.21.15.70:0/3115596942 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f13e8014030 con 0x7f13fc075ff0 2024-05-08T06:56:49.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.816+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13fc02e510 con 0x7f13fc075ff0 2024-05-08T06:56:49.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.818+0000 7f13f9600700 1 -- 172.21.15.70:0/3115596942 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f13e80a9c10 con 0x7f13fc075ff0 2024-05-08T06:56:49.817 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:56:49.817 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:56:49.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 msgr2=0x7f13e40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:49.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13f000b5c0 tx=0x7f13f001a040 comp rx=0 tx=0).stop 2024-05-08T06:56:49.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc075ff0 msgr2=0x7f13fc1a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:49.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc075ff0 0x7f13fc1a1e60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c970 tx=0x7f13e800cd30 comp rx=0 tx=0).stop 2024-05-08T06:56:49.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 shutdown_connections 2024-05-08T06:56:49.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13fc10fea0 0x7f13fc19bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13fc0756d0 0x7f13fc1a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 --2- 172.21.15.70:0/3115596942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13fc075ff0 0x7f13fc1a1e60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:49.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 >> 172.21.15.70:0/3115596942 conn(0x7f13fc07a600 msgr2=0x7f13fc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:49.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 shutdown_connections 2024-05-08T06:56:49.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:49.821+0000 7f1403a00700 1 -- 172.21.15.70:0/3115596942 wait complete. 2024-05-08T06:56:49.823 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:56:50.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:50 smithi070 ceph-mon[29591]: pgmap v319: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-05-08T06:56:50.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:50 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3115596942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:56:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:50 smithi172 ceph-mon[33377]: pgmap v319: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-05-08T06:56:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:50 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3115596942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:56:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:50 smithi194 ceph-mon[33679]: pgmap v319: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-05-08T06:56:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:50 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3115596942' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:56:50.707 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id fba7fe7a --release --await' 2024-05-08T06:56:50.707 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id fba7fe7a --release --await 2024-05-08T06:56:51.167 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:56:52.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:52 smithi070 ceph-mon[29591]: pgmap v320: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T06:56:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:52 smithi172 ceph-mon[33377]: pgmap v320: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T06:56:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:52 smithi194 ceph-mon[33679]: pgmap v320: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T06:56:53.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.642+0000 7f31bd200700 1 -- 172.21.15.70:0/3660666192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 msgr2=0x7f31b81039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:53.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.642+0000 7f31bd200700 1 --2- 172.21.15.70:0/3660666192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 0x7f31b81039f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f31a80099c0 tx=0x7f31a8009cd0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.642+0000 7f31bd200700 1 -- 172.21.15.70:0/3660666192 shutdown_connections 2024-05-08T06:56:53.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.642+0000 7f31bd200700 1 --2- 172.21.15.70:0/3660666192 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b81086f0 0x7f31b81102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.642+0000 7f31bd200700 1 --2- 172.21.15.70:0/3660666192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 0x7f31b81039f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.642+0000 7f31bd200700 1 --2- 172.21.15.70:0/3660666192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b8103fc0 0x7f31b8108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.642+0000 7f31bd200700 1 -- 172.21.15.70:0/3660666192 >> 172.21.15.70:0/3660666192 conn(0x7f31b80feec0 msgr2=0x7f31b81012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:53.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.642+0000 7f31bd200700 1 -- 172.21.15.70:0/3660666192 shutdown_connections 2024-05-08T06:56:53.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.642+0000 7f31bd200700 1 -- 172.21.15.70:0/3660666192 wait complete. 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.643+0000 7f31bd200700 1 Processor -- start 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.643+0000 7f31bd200700 1 -- start start 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31bd200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 0x7f31b81a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31bd200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b8103fc0 0x7f31b81a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31bd200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b81086f0 0x7f31b819ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31bd200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81134a0 con 0x7f31b8103610 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31bd200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8113320 con 0x7f31b8103fc0 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31bd200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31b8113620 con 0x7f31b81086f0 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31b7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 0x7f31b81a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31b7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 0x7f31b81a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54806/0 (socket says 172.21.15.70:54806) 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31b7400700 1 -- 172.21.15.70:0/880001849 learned_addr learned my addr 172.21.15.70:0/880001849 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:53.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31b7e00700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b81086f0 0x7f31b819ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31aea00700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b8103fc0 0x7f31b81a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.644+0000 7f31b7400700 1 -- 172.21.15.70:0/880001849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b81086f0 msgr2=0x7f31b819ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:53.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31b7400700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b81086f0 0x7f31b819ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31b7400700 1 -- 172.21.15.70:0/880001849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b8103fc0 msgr2=0x7f31b81a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:53.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31b7400700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b8103fc0 0x7f31b81a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31b7400700 1 -- 172.21.15.70:0/880001849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b819c1c0 con 0x7f31b8103610 2024-05-08T06:56:53.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31aea00700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b8103fc0 0x7f31b81a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:56:53.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31b7400700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 0x7f31b81a18a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f31a800b580 tx=0x7f31a800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:53.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31b4c00700 1 -- 172.21.15.70:0/880001849 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a8027070 con 0x7f31b8103610 2024-05-08T06:56:53.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31bd200700 1 -- 172.21.15.70:0/880001849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b819c450 con 0x7f31b8103610 2024-05-08T06:56:53.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31b4c00700 1 -- 172.21.15.70:0/880001849 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31a800fdd0 con 0x7f31b8103610 2024-05-08T06:56:53.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31bd200700 1 -- 172.21.15.70:0/880001849 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b81a8770 con 0x7f31b8103610 2024-05-08T06:56:53.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.645+0000 7f31b4c00700 1 -- 172.21.15.70:0/880001849 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a80173f0 con 0x7f31b8103610 2024-05-08T06:56:53.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.650+0000 7f31b4c00700 1 -- 172.21.15.70:0/880001849 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f31a802a070 con 0x7f31b8103610 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.651+0000 7f31c90fcb80 1 Processor -- start 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.651+0000 7f31c90fcb80 1 -- start start 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834c99630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c93780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 0x560834c94200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560834be5b20 con 0x560834c99b70 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560834b83860 con 0x560834c93da0 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560834be1ae0 con 0x560834c99250 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31b4c00700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f319c0b29f0 0x7f319c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31b7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c93780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31b7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c93780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54810/0 (socket says 172.21.15.70:54810) 2024-05-08T06:56:53.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.652+0000 7f31b7400700 1 -- 172.21.15.70:0/86140972 learned_addr learned my addr 172.21.15.70:0/86140972 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:53.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31aea00700 1 --2- 172.21.15.70:0/86140972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 0x560834c94200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31b7e00700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f319c0b29f0 0x7f319c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31b4c00700 1 -- 172.21.15.70:0/880001849 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9583+0+0 (secure 0 0 0) 0x7f31a80e37a0 con 0x7f31b8103610 2024-05-08T06:56:53.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31b7e00700 1 --2- 172.21.15.70:0/86140972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834c99630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31b7400700 1 -- 172.21.15.70:0/86140972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 msgr2=0x560834c99630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31b7400700 1 --2- 172.21.15.70:0/86140972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834c99630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31b7400700 1 -- 172.21.15.70:0/86140972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 msgr2=0x560834c94200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31b7400700 1 --2- 172.21.15.70:0/86140972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 0x560834c94200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31b7400700 1 -- 172.21.15.70:0/86140972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560834b329d0 con 0x560834c99b70 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.653+0000 7f31b7e00700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f319c0b29f0 0x7f319c0b4eb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009710 tx=0x7f31b0009bd0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.654+0000 7f31b7400700 1 --2- 172.21.15.70:0/86140972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c93780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f31a80e09e0 tx=0x7f31a8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f3c9b162ae7b01 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.654+0000 7f31acc00700 1 -- 172.21.15.70:0/86140972 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a80aa1a0 con 0x560834c99b70 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.654+0000 7f31acc00700 1 -- 172.21.15.70:0/86140972 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31a80aad90 con 0x560834c99b70 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.654+0000 7f31acc00700 1 -- 172.21.15.70:0/86140972 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a80e0cf0 con 0x560834c99b70 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.655+0000 7f31c90fcb80 1 -- 172.21.15.70:0/86140972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 msgr2=0x560834c93780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.655+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/86140972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c93780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f31a80e09e0 tx=0x7f31a8009cd0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.655+0000 7f31c90fcb80 1 -- 172.21.15.70:0/86140972 shutdown_connections 2024-05-08T06:56:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.655+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/86140972 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 0x560834c94200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.655+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/86140972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834c99630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.655+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/86140972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c93780 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.655+0000 7f31c90fcb80 1 -- 172.21.15.70:0/86140972 >> 172.21.15.70:0/86140972 conn(0x560834c0b7d0 msgr2=0x560834c8e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:53.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.655+0000 7f31c90fcb80 1 -- 172.21.15.70:0/86140972 shutdown_connections 2024-05-08T06:56:53.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.655+0000 7f31c90fcb80 1 -- 172.21.15.70:0/86140972 wait complete. 2024-05-08T06:56:53.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.656+0000 7f31c90fcb80 1 -- start start 2024-05-08T06:56:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.656+0000 7f31c90fcb80 1 Processor -- start 2024-05-08T06:56:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.656+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c93da0 0x560834c9f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.656+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834c9cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.656+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99b70 0x560834c9d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.656+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560834be5b20 con 0x560834c93da0 2024-05-08T06:56:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.656+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560834b4bc20 con 0x560834c99b70 2024-05-08T06:56:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.656+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560834ca0450 con 0x560834c99250 2024-05-08T06:56:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31c90fcb80 10 client.0 _ll_register_callbacks cb 0x560834b8cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:56:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c93da0 0x560834c9f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c93da0 0x560834c9f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54822/0 (socket says 172.21.15.70:54822) 2024-05-08T06:56:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7400700 1 -- 172.21.15.70:0/2414258517 learned_addr learned my addr 172.21.15.70:0/2414258517 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7400700 1 -- 172.21.15.70:0/2414258517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 msgr2=0x560834c9cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7400700 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834c9cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7400700 1 -- 172.21.15.70:0/2414258517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99b70 msgr2=0x560834c9d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7e00700 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99b70 0x560834c9d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7400700 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99b70 0x560834c9d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7400700 1 -- 172.21.15.70:0/2414258517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560834bab520 con 0x560834c93da0 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.657+0000 7f31b7e00700 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99b70 0x560834c9d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.658+0000 7f31b7400700 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c93da0 0x560834c9f870 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f31a80aaf40 tx=0x7f31a80e0fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf69b5d1ec9bd63c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.658+0000 7f31a5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.658+0000 7f31a5600700 1 -- 172.21.15.70:0/2414258517 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a80aa1a0 con 0x560834c93da0 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.658+0000 7f31a5600700 1 -- 172.21.15.70:0/2414258517 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9583+0+0 (secure 0 0 0) 0x7f31a80aab00 con 0x560834c93da0 2024-05-08T06:56:53.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.658+0000 7f31c90fcb80 1 -- 172.21.15.70:0/2414258517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31a80aad90 con 0x560834c93da0 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.658+0000 7f31a5600700 1 -- 172.21.15.70:0/2414258517 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31a80aa690 con 0x560834c93da0 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.658+0000 7f31c90fcb80 10 client.15741 fetch_fsmap learned FSMap version 28 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.658+0000 7f31c90fcb80 1 -- 172.21.15.70:0/2414258517 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560834caab00 con 0x560834c93da0 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.658+0000 7f31a5600700 1 -- 172.21.15.70:0/2414258517 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31a80aad90 con 0x560834c93da0 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.659+0000 7f31a5600700 1 -- 172.21.15.70:0/2414258517 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f31a80b3060 con 0x560834c93da0 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.659+0000 7f31c90fcb80 10 client.15741 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.659+0000 7f31c90fcb80 10 client.15741 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.659+0000 7f31c90fcb80 20 client.15741 populate_metadata read hostname 'smithi070' 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.659+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560834cace00 0x560834caf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.659+0000 7f31c90fcb80 4 client.15741 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.659+0000 7f31c90fcb80 1 -- 172.21.15.70:0/2414258517 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560834c60240 con 0x560834cace00 2024-05-08T06:56:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.659+0000 7f31aea00700 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560834cace00 0x560834caf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.660+0000 7f31aea00700 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560834cace00 0x560834caf1f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd087e833d350e2 server_cookie=99352a9ffe309af2 in_seq=0 out_seq=0 2024-05-08T06:56:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.660+0000 7f31a5600700 10 client.15741 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:56:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.662+0000 7f31a5600700 1 -- 172.21.15.70:0/2414258517 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560834c60240 con 0x560834cace00 2024-05-08T06:56:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.662+0000 7f31a5600700 10 client.15741 handle_command_reply: tid=0 2024-05-08T06:56:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 client.15741 shutdown 2024-05-08T06:56:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 -- 172.21.15.70:0/2414258517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c93da0 msgr2=0x560834c9f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:53.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c93da0 0x560834c9f870 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f31a80aaf40 tx=0x7f31a80e0fd0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 -- 172.21.15.70:0/2414258517 shutdown_connections 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560834cace00 0x560834caf1f0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99b70 0x560834c9d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c93da0 0x560834c9f870 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/2414258517 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834c9cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 -- 172.21.15.70:0/2414258517 >> 172.21.15.70:0/2414258517 conn(0x560834c0b7d0 msgr2=0x560834c92770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31a5600700 0 client.15741 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 -- 172.21.15.70:0/2414258517 shutdown_connections 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 1 -- 172.21.15.70:0/2414258517 wait complete. 2024-05-08T06:56:53.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.663+0000 7f31c90fcb80 20 client.15741 trim_cache size 0 max 16384 2024-05-08T06:56:53.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.685+0000 7f31c90fcb80 1 Processor -- start 2024-05-08T06:56:53.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.685+0000 7f31c90fcb80 1 -- start start 2024-05-08T06:56:53.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.685+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c93da0 0x560834ca9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99250 0x560834c9b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c9bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81b3ea0 con 0x560834c99b70 2024-05-08T06:56:53.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81b1730 con 0x560834c99250 2024-05-08T06:56:53.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81af5a0 con 0x560834c93da0 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31b7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c9bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31b7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c9bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54826/0 (socket says 172.21.15.70:54826) 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31b7e00700 1 -- 172.21.15.70:0/94134693 learned_addr learned my addr 172.21.15.70:0/94134693 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31aea00700 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99250 0x560834c9b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.686+0000 7f31b7400700 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c93da0 0x560834ca9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.687+0000 7f31b7e00700 1 -- 172.21.15.70:0/94134693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c93da0 msgr2=0x560834ca9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.687+0000 7f31b7e00700 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c93da0 0x560834ca9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.687+0000 7f31b7e00700 1 -- 172.21.15.70:0/94134693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99250 msgr2=0x560834c9b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.687+0000 7f31b7e00700 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99250 0x560834c9b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.687+0000 7f31b7e00700 1 -- 172.21.15.70:0/94134693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560834c8ac20 con 0x560834c99b70 2024-05-08T06:56:53.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.687+0000 7f31aea00700 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99250 0x560834c9b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:56:53.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.687+0000 7f31b7e00700 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c9bab0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f31b0019590 tx=0x7f31b0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab54b59fdf839a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:53.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.687+0000 7f31a7e00700 1 -- 172.21.15.70:0/94134693 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0024460 con 0x560834c99b70 2024-05-08T06:56:53.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31a7e00700 1 -- 172.21.15.70:0/94134693 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31b0029070 con 0x560834c99b70 2024-05-08T06:56:53.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31a7e00700 1 -- 172.21.15.70:0/94134693 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0016840 con 0x560834c99b70 2024-05-08T06:56:53.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31c90fcb80 1 -- 172.21.15.70:0/94134693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 msgr2=0x560834c9bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:53.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c9bab0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f31b0019590 tx=0x7f31b0007f90 comp rx=0 tx=0).stop 2024-05-08T06:56:53.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31c90fcb80 1 -- 172.21.15.70:0/94134693 shutdown_connections 2024-05-08T06:56:53.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834c9bab0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c93da0 0x560834ca9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/94134693 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c99250 0x560834c9b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31c90fcb80 1 -- 172.21.15.70:0/94134693 >> 172.21.15.70:0/94134693 conn(0x560834c0b7d0 msgr2=0x560834c8e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.688+0000 7f31c90fcb80 1 -- 172.21.15.70:0/94134693 shutdown_connections 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.689+0000 7f31c90fcb80 1 -- 172.21.15.70:0/94134693 wait complete. 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.689+0000 7f31c90fcb80 1 -- start start 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.689+0000 7f31c90fcb80 1 Processor -- start 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 0x560834ca26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834ca2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31c90fcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834d17570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81afbf0 con 0x560834c99b70 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81b1060 con 0x560834c93da0 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31c90fcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31b81b02c0 con 0x560834c99250 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31c90fcb80 10 client.0 _ll_register_callbacks cb 0x560834b8cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31b7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834d17570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31b7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834d17570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54840/0 (socket says 172.21.15.70:54840) 2024-05-08T06:56:53.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31b7e00700 1 -- 172.21.15.70:0/3130191191 learned_addr learned my addr 172.21.15.70:0/3130191191 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:53.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31aea00700 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834ca2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.690+0000 7f31b7400700 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 0x560834ca26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31b7e00700 1 -- 172.21.15.70:0/3130191191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 msgr2=0x560834ca2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:53.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31b7e00700 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834ca2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31b7e00700 1 -- 172.21.15.70:0/3130191191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 msgr2=0x560834ca26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31b7e00700 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 0x560834ca26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31b7e00700 1 -- 172.21.15.70:0/3130191191 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560834d17ab0 con 0x560834c99b70 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31b7e00700 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834d17570 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f31b00095b0 tx=0x7f31b00247c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9770a5766b67ed0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31a5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31a5600700 1 -- 172.21.15.70:0/3130191191 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0037410 con 0x560834c99b70 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31a5600700 1 -- 172.21.15.70:0/3130191191 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9583+0+0 (secure 0 0 0) 0x7f31b00375b0 con 0x560834c99b70 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.691+0000 7f31c90fcb80 1 -- 172.21.15.70:0/3130191191 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31b0029070 con 0x560834c99b70 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31a5600700 1 -- 172.21.15.70:0/3130191191 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f31b0040050 con 0x560834c99b70 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31c90fcb80 10 client.15747 fetch_fsmap learned FSMap version 28 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31c90fcb80 1 -- 172.21.15.70:0/3130191191 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560834d18c30 con 0x560834c99b70 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31a5600700 1 -- 172.21.15.70:0/3130191191 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31b0029070 con 0x560834c99b70 2024-05-08T06:56:53.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31a5600700 1 -- 172.21.15.70:0/3130191191 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f31b0016860 con 0x560834c99b70 2024-05-08T06:56:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31c90fcb80 10 client.15747 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:56:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31c90fcb80 10 client.15747 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:56:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31c90fcb80 20 client.15747 populate_metadata read hostname 'smithi070' 2024-05-08T06:56:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560834d192e0 0x560834d1b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31c90fcb80 4 client.15747 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fba7fe7a", "release": true, "await": true}] 2024-05-08T06:56:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.692+0000 7f31c90fcb80 1 -- 172.21.15.70:0/3130191191 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fba7fe7a", "release": true, "await": true}) -- 0x560834bf3500 con 0x560834d192e0 2024-05-08T06:56:53.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.693+0000 7f31b7400700 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560834d192e0 0x560834d1b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:53.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.694+0000 7f31b7400700 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560834d192e0 0x560834d1b700 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9362de5fb26188d4 server_cookie=7765c82b18dba025 in_seq=0 out_seq=0 2024-05-08T06:56:53.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:53.694+0000 7f31a5600700 10 client.15747 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:56:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:54 smithi070 ceph-mon[29591]: pgmap v321: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T06:56:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:54 smithi172 ceph-mon[33377]: pgmap v321: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T06:56:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:54 smithi194 ceph-mon[33679]: pgmap v321: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T06:56:54.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.802+0000 7f31a5600700 1 -- 172.21.15.70:0/3130191191 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x560834bf3500 con 0x560834d192e0 2024-05-08T06:56:54.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.802+0000 7f31a5600700 10 client.15747 handle_command_reply: tid=0 2024-05-08T06:56:54.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.802+0000 7f31c90fcb80 1 client.15747 shutdown 2024-05-08T06:56:54.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.803+0000 7f31c90fcb80 1 -- 172.21.15.70:0/3130191191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 msgr2=0x560834d17570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:54.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.803+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834d17570 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f31b00095b0 tx=0x7f31b00247c0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.804+0000 7f31c90fcb80 1 -- 172.21.15.70:0/3130191191 shutdown_connections 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.804+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560834d192e0 0x560834d1b700 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.804+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560834c99b70 0x560834d17570 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.804+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560834c93da0 0x560834ca26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.804+0000 7f31c90fcb80 1 --2- 172.21.15.70:0/3130191191 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560834c99250 0x560834ca2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.804+0000 7f31c90fcb80 1 -- 172.21.15.70:0/3130191191 >> 172.21.15.70:0/3130191191 conn(0x560834c0b7d0 msgr2=0x560834c9b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.804+0000 7f31a5600700 0 client.15747 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.804+0000 7f31c90fcb80 1 -- 172.21.15.70:0/3130191191 shutdown_connections 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.804+0000 7f31c90fcb80 1 -- 172.21.15.70:0/3130191191 wait complete. 2024-05-08T06:56:54.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.805+0000 7f31c90fcb80 20 client.15747 trim_cache size 0 max 16384 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 28, 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "fba7fe7a": { 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 28, 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:56:54.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:56:54.805 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:56:54.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.806+0000 7f31bd200700 1 -- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f319c0b29f0 msgr2=0x7f319c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:54.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.806+0000 7f31bd200700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f319c0b29f0 0x7f319c0b4eb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009710 tx=0x7f31b0009bd0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.806+0000 7f31bd200700 1 -- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 msgr2=0x7f31b81a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:54.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.806+0000 7f31bd200700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 0x7f31b81a18a0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f31a800b580 tx=0x7f31a800f510 comp rx=0 tx=0).stop 2024-05-08T06:56:54.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.807+0000 7f31bd200700 1 -- 172.21.15.70:0/880001849 shutdown_connections 2024-05-08T06:56:54.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.807+0000 7f31bd200700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f319c0b29f0 0x7f319c0b4eb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.807+0000 7f31bd200700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b81086f0 0x7f31b819ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.807+0000 7f31bd200700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b8103610 0x7f31b81a18a0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.807+0000 7f31bd200700 1 --2- 172.21.15.70:0/880001849 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b8103fc0 0x7f31b81a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:54.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.807+0000 7f31bd200700 1 -- 172.21.15.70:0/880001849 >> 172.21.15.70:0/880001849 conn(0x7f31b80feec0 msgr2=0x7f31b8100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:54.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.807+0000 7f31bd200700 1 -- 172.21.15.70:0/880001849 shutdown_connections 2024-05-08T06:56:54.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:54.808+0000 7f31bd200700 1 -- 172.21.15.70:0/880001849 wait complete. 2024-05-08T06:56:55.774 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fba7fe7a', seconds elapsed: 55.5 2024-05-08T06:56:55.774 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T06:56:55.774 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:56:56.264 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:56:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:56 smithi070 ceph-mon[29591]: pgmap v322: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2024-05-08T06:56:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:56 smithi172 ceph-mon[33377]: pgmap v322: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2024-05-08T06:56:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:56 smithi194 ceph-mon[33679]: pgmap v322: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 8 op/s 2024-05-08T06:56:58.355 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:58 smithi070 ceph-mon[29591]: pgmap v323: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-05-08T06:56:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:58 smithi172 ceph-mon[33377]: pgmap v323: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-05-08T06:56:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:58 smithi194 ceph-mon[33679]: pgmap v323: 129 pgs: 129 active+clean; 334 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-05-08T06:56:58.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.673+0000 7fe89b200700 1 -- 172.21.15.70:0/4152859606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe89410fea0 msgr2=0x7fe894112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.673+0000 7fe89b200700 1 --2- 172.21.15.70:0/4152859606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe89410fea0 0x7fe894112290 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00b0a0 tx=0x7fe88c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:56:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.673+0000 7fe89b200700 1 -- 172.21.15.70:0/4152859606 shutdown_connections 2024-05-08T06:56:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.673+0000 7fe89b200700 1 --2- 172.21.15.70:0/4152859606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe89410fea0 0x7fe894112290 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.673+0000 7fe89b200700 1 --2- 172.21.15.70:0/4152859606 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8940756d0 0x7fe894075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.673+0000 7fe89b200700 1 --2- 172.21.15.70:0/4152859606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe894075ff0 0x7fe89410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.673+0000 7fe89b200700 1 -- 172.21.15.70:0/4152859606 >> 172.21.15.70:0/4152859606 conn(0x7fe89407a600 msgr2=0x7fe89407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.674+0000 7fe89b200700 1 -- 172.21.15.70:0/4152859606 shutdown_connections 2024-05-08T06:56:58.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.674+0000 7fe89b200700 1 -- 172.21.15.70:0/4152859606 wait complete. 2024-05-08T06:56:58.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.675+0000 7fe89b200700 1 Processor -- start 2024-05-08T06:56:58.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.675+0000 7fe89b200700 1 -- start start 2024-05-08T06:56:58.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.676+0000 7fe89b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8940756d0 0x7fe8941a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:58.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.676+0000 7fe89b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe894075ff0 0x7fe8941a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:58.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.676+0000 7fe89b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe89410fea0 0x7fe89419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:58.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.676+0000 7fe89b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8941156e0 con 0x7fe894075ff0 2024-05-08T06:56:58.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.676+0000 7fe89b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe894115560 con 0x7fe8940756d0 2024-05-08T06:56:58.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.676+0000 7fe89b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe894115860 con 0x7fe89410fea0 2024-05-08T06:56:58.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.676+0000 7fe88be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe894075ff0 0x7fe8941a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:58.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe88be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe894075ff0 0x7fe8941a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53776/0 (socket says 172.21.15.70:53776) 2024-05-08T06:56:58.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe88be00700 1 -- 172.21.15.70:0/2911027426 learned_addr learned my addr 172.21.15.70:0/2911027426 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:56:58.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe893e00700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8940756d0 0x7fe8941a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:58.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe899200700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe89410fea0 0x7fe89419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:58.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe88be00700 1 -- 172.21.15.70:0/2911027426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe89410fea0 msgr2=0x7fe89419ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:58.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe88be00700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe89410fea0 0x7fe89419ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:58.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe88be00700 1 -- 172.21.15.70:0/2911027426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8940756d0 msgr2=0x7fe8941a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:58.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe88be00700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8940756d0 0x7fe8941a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:58.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe88be00700 1 -- 172.21.15.70:0/2911027426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe89419c180 con 0x7fe894075ff0 2024-05-08T06:56:58.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.677+0000 7fe893e00700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8940756d0 0x7fe8941a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:56:58.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.678+0000 7fe88be00700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe894075ff0 0x7fe8941a1da0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00d980 tx=0x7fe87c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:58.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.678+0000 7fe891600700 1 -- 172.21.15.70:0/2911027426 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c017030 con 0x7fe894075ff0 2024-05-08T06:56:58.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.678+0000 7fe891600700 1 -- 172.21.15.70:0/2911027426 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe87c0044b0 con 0x7fe894075ff0 2024-05-08T06:56:58.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.678+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe89419c410 con 0x7fe894075ff0 2024-05-08T06:56:58.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.678+0000 7fe891600700 1 -- 172.21.15.70:0/2911027426 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0038e0 con 0x7fe894075ff0 2024-05-08T06:56:58.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.678+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8941a8730 con 0x7fe894075ff0 2024-05-08T06:56:58.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.680+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe89406a190 con 0x7fe894075ff0 2024-05-08T06:56:58.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.684+0000 7fe891600700 1 -- 172.21.15.70:0/2911027426 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe87c01a070 con 0x7fe894075ff0 2024-05-08T06:56:58.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.686+0000 7fe891600700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8780b2a70 0x7fe8780b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:56:58.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.686+0000 7fe891600700 1 -- 172.21.15.70:0/2911027426 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9583+0+0 (secure 0 0 0) 0x7fe87c0e26c0 con 0x7fe894075ff0 2024-05-08T06:56:58.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.686+0000 7fe893e00700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8780b2a70 0x7fe8780b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:56:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.687+0000 7fe893e00700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8780b2a70 0x7fe8780b4f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe884005fd0 tx=0x7fe884005f00 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:56:58.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:58.689+0000 7fe891600700 1 -- 172.21.15.70:0/2911027426 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe87c0a9d00 con 0x7fe894075ff0 2024-05-08T06:56:59.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.041+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe89402e510 con 0x7fe894075ff0 2024-05-08T06:56:59.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.043+0000 7fe891600700 1 -- 172.21.15.70:0/2911027426 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fe87c0a9600 con 0x7fe894075ff0 2024-05-08T06:56:59.042 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:56:59.042 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:56:59.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.046+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8780b2a70 msgr2=0x7fe8780b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.046+0000 7fe89b200700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8780b2a70 0x7fe8780b4f30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe884005fd0 tx=0x7fe884005f00 comp rx=0 tx=0).stop 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.046+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe894075ff0 msgr2=0x7fe8941a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.046+0000 7fe89b200700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe894075ff0 0x7fe8941a1da0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00d980 tx=0x7fe87c00dc90 comp rx=0 tx=0).stop 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.047+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 shutdown_connections 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.047+0000 7fe89b200700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8780b2a70 0x7fe8780b4f30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.047+0000 7fe89b200700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe89410fea0 0x7fe89419ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.047+0000 7fe89b200700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8940756d0 0x7fe8941a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.047+0000 7fe89b200700 1 --2- 172.21.15.70:0/2911027426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe894075ff0 0x7fe8941a1da0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.047+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 >> 172.21.15.70:0/2911027426 conn(0x7fe89407a600 msgr2=0x7fe894100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.047+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 shutdown_connections 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:56:59.047+0000 7fe89b200700 1 -- 172.21.15.70:0/2911027426 wait complete. 2024-05-08T06:56:59.047 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:56:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:59 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2911027426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:56:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:56:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:56:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:59 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2911027426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:56:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:56:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:56:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:59 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2911027426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:56:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:56:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:57:00.259 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T06:57:00.259 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T06:57:00.463 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:00 smithi194 ceph-mon[33679]: pgmap v324: 129 pgs: 129 active+clean; 337 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 287 KiB/s wr, 44 op/s 2024-05-08T06:57:00.582 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:00 smithi172 ceph-mon[33377]: pgmap v324: 129 pgs: 129 active+clean; 337 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 287 KiB/s wr, 44 op/s 2024-05-08T06:57:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:00 smithi070 ceph-mon[29591]: pgmap v324: 129 pgs: 129 active+clean; 337 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 287 KiB/s wr, 44 op/s 2024-05-08T06:57:01.415 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:57:02.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:02 smithi070 ceph-mon[29591]: pgmap v325: 129 pgs: 129 active+clean; 337 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 285 KiB/s wr, 42 op/s 2024-05-08T06:57:02.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:02 smithi194 ceph-mon[33679]: pgmap v325: 129 pgs: 129 active+clean; 337 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 285 KiB/s wr, 42 op/s 2024-05-08T06:57:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:02 smithi172 ceph-mon[33377]: pgmap v325: 129 pgs: 129 active+clean; 337 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 285 KiB/s wr, 42 op/s 2024-05-08T06:57:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:03.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:03.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.926+0000 7f9b89400700 1 -- 172.21.15.70:0/1775302583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84103550 msgr2=0x7f9b841039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.926+0000 7f9b89400700 1 --2- 172.21.15.70:0/1775302583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84103550 0x7f9b841039b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009990 tx=0x7f9b70009ca0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.926+0000 7f9b89400700 1 -- 172.21.15.70:0/1775302583 shutdown_connections 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.926+0000 7f9b89400700 1 --2- 172.21.15.70:0/1775302583 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84103ef0 0x7f9b841103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.926+0000 7f9b89400700 1 --2- 172.21.15.70:0/1775302583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84108460 0x7f9b84108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.926+0000 7f9b89400700 1 --2- 172.21.15.70:0/1775302583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84103550 0x7f9b841039b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.926+0000 7f9b89400700 1 -- 172.21.15.70:0/1775302583 >> 172.21.15.70:0/1775302583 conn(0x7f9b8407a600 msgr2=0x7f9b8407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.926+0000 7f9b89400700 1 -- 172.21.15.70:0/1775302583 shutdown_connections 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.926+0000 7f9b89400700 1 -- 172.21.15.70:0/1775302583 wait complete. 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.927+0000 7f9b89400700 1 Processor -- start 2024-05-08T06:57:03.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b89400700 1 -- start start 2024-05-08T06:57:03.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b89400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103550 0x7f9b8419f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b89400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84103ef0 0x7f9b8419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b89400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84108460 0x7f9b84199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b89400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b84113630 con 0x7f9b84108460 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b89400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841134b0 con 0x7f9b84103ef0 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b89400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841137b0 con 0x7f9b84103550 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b83200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84108460 0x7f9b84199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b83200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84108460 0x7f9b84199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53786/0 (socket says 172.21.15.70:53786) 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.928+0000 7f9b83200700 1 -- 172.21.15.70:0/4124657074 learned_addr learned my addr 172.21.15.70:0/4124657074 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.929+0000 7f9b81e00700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84103ef0 0x7f9b8419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.929+0000 7f9b82800700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103550 0x7f9b8419f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.929+0000 7f9b83200700 1 -- 172.21.15.70:0/4124657074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103550 msgr2=0x7f9b8419f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.929+0000 7f9b83200700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103550 0x7f9b8419f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.929+0000 7f9b83200700 1 -- 172.21.15.70:0/4124657074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84103ef0 msgr2=0x7f9b8419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.929+0000 7f9b83200700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84103ef0 0x7f9b8419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.929+0000 7f9b83200700 1 -- 172.21.15.70:0/4124657074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8419a090 con 0x7f9b84108460 2024-05-08T06:57:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.929+0000 7f9b81e00700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84103ef0 0x7f9b8419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:57:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.929+0000 7f9b83200700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84108460 0x7f9b84199930 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00ab50 tx=0x7f9b7c00af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.930+0000 7f9b7b400700 1 -- 172.21.15.70:0/4124657074 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c017020 con 0x7f9b84108460 2024-05-08T06:57:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.930+0000 7f9b89400700 1 -- 172.21.15.70:0/4124657074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b8419a380 con 0x7f9b84108460 2024-05-08T06:57:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.930+0000 7f9b7b400700 1 -- 172.21.15.70:0/4124657074 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b7c004bb0 con 0x7f9b84108460 2024-05-08T06:57:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.930+0000 7f9b7b400700 1 -- 172.21.15.70:0/4124657074 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c005280 con 0x7f9b84108460 2024-05-08T06:57:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.930+0000 7f9b89400700 1 -- 172.21.15.70:0/4124657074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b841a65f0 con 0x7f9b84108460 2024-05-08T06:57:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.934+0000 7f9b7b400700 1 -- 172.21.15.70:0/4124657074 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9b7c00c6d0 con 0x7f9b84108460 2024-05-08T06:57:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.935+0000 7f9b7b400700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b680b2aa0 0x7f9b680b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.935+0000 7f9b7b400700 1 -- 172.21.15.70:0/4124657074 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9583+0+0 (secure 0 0 0) 0x7f9b7c0e2170 con 0x7f9b84108460 2024-05-08T06:57:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.935+0000 7f9b82800700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b680b2aa0 0x7f9b680b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.936+0000 7f9b82800700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b680b2aa0 0x7f9b680b4f60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b74006fd0 tx=0x7f9b74008040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.937+0000 7f9b93c9cb80 1 Processor -- start 2024-05-08T06:57:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.937+0000 7f9b93c9cb80 1 -- start start 2024-05-08T06:57:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.937+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38f20 0x561184a32c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561184980bb0 con 0x561184a33240 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56118491e8f0 con 0x561184a38600 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56118497cb70 con 0x561184a38f20 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b83200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b83200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a336a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53790/0 (socket says 172.21.15.70:53790) 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b83200700 1 -- 172.21.15.70:0/2826169703 learned_addr learned my addr 172.21.15.70:0/2826169703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b82800700 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b81e00700 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38f20 0x561184a32c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b83200700 1 -- 172.21.15.70:0/2826169703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38f20 msgr2=0x561184a32c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.938+0000 7f9b83200700 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38f20 0x561184a32c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.939+0000 7f9b83200700 1 -- 172.21.15.70:0/2826169703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 msgr2=0x561184a389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.939+0000 7f9b83200700 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a389e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.939+0000 7f9b83200700 1 -- 172.21.15.70:0/2826169703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611848cda60 con 0x561184a33240 2024-05-08T06:57:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.939+0000 7f9b82800700 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:57:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.939+0000 7f9b83200700 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a336a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00a0a0 tx=0x7f9b7c0a8c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922a11f5c75fca1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.939+0000 7f9b6fe00700 1 -- 172.21.15.70:0/2826169703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c0b1e30 con 0x561184a33240 2024-05-08T06:57:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.939+0000 7f9b6fe00700 1 -- 172.21.15.70:0/2826169703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b7c0ad0c0 con 0x561184a33240 2024-05-08T06:57:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.939+0000 7f9b6fe00700 1 -- 172.21.15.70:0/2826169703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c0a9520 con 0x561184a33240 2024-05-08T06:57:03.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.941+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2826169703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 msgr2=0x561184a336a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:03.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.941+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a336a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00a0a0 tx=0x7f9b7c0a8c70 comp rx=0 tx=0).stop 2024-05-08T06:57:03.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.941+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2826169703 shutdown_connections 2024-05-08T06:57:03.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.941+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a336a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.941+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.941+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/2826169703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38f20 0x561184a32c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.941+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2826169703 >> 172.21.15.70:0/2826169703 conn(0x5611849a6860 msgr2=0x561184a29100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:03.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.941+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2826169703 shutdown_connections 2024-05-08T06:57:03.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.941+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2826169703 wait complete. 2024-05-08T06:57:03.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.942+0000 7f9b93c9cb80 1 -- start start 2024-05-08T06:57:03.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.942+0000 7f9b93c9cb80 1 Processor -- start 2024-05-08T06:57:03.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.942+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a3ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.942+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38600 0x561184a3bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.942+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38f20 0x561184a3c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.942+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561184a3f9e0 con 0x561184a33240 2024-05-08T06:57:03.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.942+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5611848e6cb0 con 0x561184a38f20 2024-05-08T06:57:03.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.942+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561184a3fb60 con 0x561184a38600 2024-05-08T06:57:03.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.942+0000 7f9b93c9cb80 10 client.0 _ll_register_callbacks cb 0x561184927e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:57:03.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.943+0000 7f9b82800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a3ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.943+0000 7f9b82800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a3ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53792/0 (socket says 172.21.15.70:53792) 2024-05-08T06:57:03.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.943+0000 7f9b82800700 1 -- 172.21.15.70:0/3653938751 learned_addr learned my addr 172.21.15.70:0/3653938751 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:03.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.943+0000 7f9b81e00700 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38600 0x561184a3bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.943+0000 7f9b83200700 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38f20 0x561184a3c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.944+0000 7f9b82800700 1 -- 172.21.15.70:0/3653938751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38600 msgr2=0x561184a3bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.944+0000 7f9b82800700 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38600 0x561184a3bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.944+0000 7f9b82800700 1 -- 172.21.15.70:0/3653938751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38f20 msgr2=0x561184a3c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.944+0000 7f9b82800700 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38f20 0x561184a3c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.944+0000 7f9b82800700 1 -- 172.21.15.70:0/3653938751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611849465b0 con 0x561184a33240 2024-05-08T06:57:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.944+0000 7f9b82800700 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a3ec50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400dd40 tx=0x7f9b74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ce5015009e8f26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.944+0000 7f9b6cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:57:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.945+0000 7f9b6cc00700 1 -- 172.21.15.70:0/3653938751 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74014ba0 con 0x561184a33240 2024-05-08T06:57:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.945+0000 7f9b6cc00700 1 -- 172.21.15.70:0/3653938751 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9583+0+0 (secure 0 0 0) 0x7f9b7400f040 con 0x561184a33240 2024-05-08T06:57:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.945+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/3653938751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b7c0ad0c0 con 0x561184a33240 2024-05-08T06:57:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.945+0000 7f9b6cc00700 1 -- 172.21.15.70:0/3653938751 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b74014d40 con 0x561184a33240 2024-05-08T06:57:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.945+0000 7f9b93c9cb80 10 client.15765 fetch_fsmap learned FSMap version 28 2024-05-08T06:57:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.945+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/3653938751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561184a4a3c0 con 0x561184a33240 2024-05-08T06:57:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.945+0000 7f9b6cc00700 1 -- 172.21.15.70:0/3653938751 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b7c0ad0c0 con 0x561184a33240 2024-05-08T06:57:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.946+0000 7f9b6cc00700 1 -- 172.21.15.70:0/3653938751 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9b74013070 con 0x561184a33240 2024-05-08T06:57:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.946+0000 7f9b93c9cb80 10 client.15765 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:57:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.946+0000 7f9b93c9cb80 10 client.15765 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:57:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.946+0000 7f9b93c9cb80 20 client.15765 populate_metadata read hostname 'smithi070' 2024-05-08T06:57:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.946+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561184a4ca50 0x561184a4ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.946+0000 7f9b93c9cb80 4 client.15765 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:57:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.946+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/3653938751 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611849fb2d0 con 0x561184a4ca50 2024-05-08T06:57:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.947+0000 7f9b81e00700 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561184a4ca50 0x561184a4ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.948+0000 7f9b81e00700 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561184a4ca50 0x561184a4ee80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=705e8745da8da7be server_cookie=ca1a2010c9f91610 in_seq=0 out_seq=0 2024-05-08T06:57:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.948+0000 7f9b6cc00700 10 client.15765 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:57:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b6cc00700 1 -- 172.21.15.70:0/3653938751 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5611849fb2d0 con 0x561184a4ca50 2024-05-08T06:57:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b6cc00700 10 client.15765 handle_command_reply: tid=0 2024-05-08T06:57:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b93c9cb80 1 client.15765 shutdown 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/3653938751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 msgr2=0x561184a3ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a3ec50 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400dd40 tx=0x7f9b74004750 comp rx=0 tx=0).stop 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/3653938751 shutdown_connections 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561184a4ca50 0x561184a4ee80 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38f20 0x561184a3c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a33240 0x561184a3ec50 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/3653938751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a38600 0x561184a3bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b6cc00700 0 client.15765 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.951+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/3653938751 >> 172.21.15.70:0/3653938751 conn(0x5611849a6860 msgr2=0x561184a23bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.952+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/3653938751 shutdown_connections 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.952+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/3653938751 wait complete. 2024-05-08T06:57:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.952+0000 7f9b93c9cb80 20 client.15765 trim_cache size 0 max 16384 2024-05-08T06:57:03.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.974+0000 7f9b93c9cb80 1 Processor -- start 2024-05-08T06:57:03.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.974+0000 7f9b93c9cb80 1 -- start start 2024-05-08T06:57:03.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.974+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a48a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.974+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a38f20 0x561184a39a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.974+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 0x561184a54750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.974+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841afd00 con 0x561184a38f20 2024-05-08T06:57:03.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.974+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841ad590 con 0x561184a38600 2024-05-08T06:57:03.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.974+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841ab400 con 0x561184a3ad40 2024-05-08T06:57:03.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.974+0000 7f9b81e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a38f20 0x561184a39a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b81e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a38f20 0x561184a39a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53800/0 (socket says 172.21.15.70:53800) 2024-05-08T06:57:03.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b81e00700 1 -- 172.21.15.70:0/2545690922 learned_addr learned my addr 172.21.15.70:0/2545690922 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:03.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b82800700 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a48a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b83200700 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 0x561184a54750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b81e00700 1 -- 172.21.15.70:0/2545690922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 msgr2=0x561184a54750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:03.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b81e00700 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 0x561184a54750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b81e00700 1 -- 172.21.15.70:0/2545690922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 msgr2=0x561184a48a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:03.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b81e00700 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a48a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b81e00700 1 -- 172.21.15.70:0/2545690922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561184a3cf30 con 0x561184a38f20 2024-05-08T06:57:03.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.975+0000 7f9b82800700 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a48a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:57:03.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.976+0000 7f9b81e00700 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a38f20 0x561184a39a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9b70006010 tx=0x7f9b70005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5b1fb94993d84e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:03.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.976+0000 7f9b6f400700 1 -- 172.21.15.70:0/2545690922 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7002e070 con 0x561184a38f20 2024-05-08T06:57:03.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.976+0000 7f9b6f400700 1 -- 172.21.15.70:0/2545690922 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b700055e0 con 0x561184a38f20 2024-05-08T06:57:03.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.976+0000 7f9b6f400700 1 -- 172.21.15.70:0/2545690922 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7000bce0 con 0x561184a38f20 2024-05-08T06:57:03.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.977+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2545690922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a38f20 msgr2=0x561184a39a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:03.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.977+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a38f20 0x561184a39a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9b70006010 tx=0x7f9b70005e80 comp rx=0 tx=0).stop 2024-05-08T06:57:03.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.977+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2545690922 shutdown_connections 2024-05-08T06:57:03.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.977+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 0x561184a54750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.977+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a48a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.977+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/2545690922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184a38f20 0x561184a39a10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.977+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2545690922 >> 172.21.15.70:0/2545690922 conn(0x5611849a6860 msgr2=0x561184a2e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:03.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.977+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2545690922 shutdown_connections 2024-05-08T06:57:03.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.977+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/2545690922 wait complete. 2024-05-08T06:57:03.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.978+0000 7f9b93c9cb80 1 -- start start 2024-05-08T06:57:03.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.978+0000 7f9b93c9cb80 1 Processor -- start 2024-05-08T06:57:03.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.978+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a423a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.978+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 0x561184a428e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.978+0000 7f9b93c9cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184ab12e0 0x561184ab1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.978+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841aba50 con 0x561184ab12e0 2024-05-08T06:57:03.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.978+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841acec0 con 0x561184a38600 2024-05-08T06:57:03.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.978+0000 7f9b93c9cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9b841ac120 con 0x561184a3ad40 2024-05-08T06:57:03.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.978+0000 7f9b93c9cb80 10 client.0 _ll_register_callbacks cb 0x561184927e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:57:03.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b83200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184ab12e0 0x561184ab1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b83200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184ab12e0 0x561184ab1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53812/0 (socket says 172.21.15.70:53812) 2024-05-08T06:57:03.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b83200700 1 -- 172.21.15.70:0/128774368 learned_addr learned my addr 172.21.15.70:0/128774368 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b82800700 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b81e00700 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 0x561184a428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b83200700 1 -- 172.21.15.70:0/128774368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 msgr2=0x561184a428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b83200700 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 0x561184a428e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b83200700 1 -- 172.21.15.70:0/128774368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 msgr2=0x561184a423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b83200700 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b83200700 1 -- 172.21.15.70:0/128774368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561184ab1da0 con 0x561184ab12e0 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b83200700 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184ab12e0 0x561184ab1760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0a8d60 tx=0x7f9b7c007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f739aab7790b0f45 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b6cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b6cc00700 1 -- 172.21.15.70:0/128774368 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b7c0b1e30 con 0x561184ab12e0 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b6cc00700 1 -- 172.21.15.70:0/128774368 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 9583+0+0 (secure 0 0 0) 0x7f9b7c0a92c0 con 0x561184ab12e0 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.979+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/128774368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b700055e0 con 0x561184ab12e0 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b6cc00700 1 -- 172.21.15.70:0/128774368 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b7c0a94c0 con 0x561184ab12e0 2024-05-08T06:57:03.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b93c9cb80 10 client.15771 fetch_fsmap learned FSMap version 28 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/128774368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561184ab90e0 con 0x561184ab12e0 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b6cc00700 1 -- 172.21.15.70:0/128774368 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b700055e0 con 0x561184ab12e0 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b6cc00700 1 -- 172.21.15.70:0/128774368 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9b7c012070 con 0x561184ab12e0 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b93c9cb80 10 client.15771 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b93c9cb80 10 client.15771 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b93c9cb80 20 client.15771 populate_metadata read hostname 'smithi070' 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561184ab9410 0x561184abb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b93c9cb80 4 client.15771 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.980+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/128774368 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x56118498e590 con 0x561184ab9410 2024-05-08T06:57:03.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.981+0000 7f9b82800700 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561184ab9410 0x561184abb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.982+0000 7f9b82800700 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561184ab9410 0x561184abb830 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5fba6b4010fa79a server_cookie=f5c7be86c23ff645 in_seq=0 out_seq=0 2024-05-08T06:57:03.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:03.982+0000 7f9b6cc00700 10 client.15771 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:57:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:04 smithi194 ceph-mon[33679]: pgmap v326: 129 pgs: 129 active+clean; 337 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 285 KiB/s wr, 42 op/s 2024-05-08T06:57:04.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:04 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T06:57:04.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:04 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T06:57:04.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:04.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:04 smithi070 ceph-mon[29591]: pgmap v326: 129 pgs: 129 active+clean; 337 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 285 KiB/s wr, 42 op/s 2024-05-08T06:57:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:04 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T06:57:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:04 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T06:57:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:04 smithi172 ceph-mon[33377]: pgmap v326: 129 pgs: 129 active+clean; 337 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 285 KiB/s wr, 42 op/s 2024-05-08T06:57:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:04 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T06:57:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:04 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T06:57:04.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:04.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:04.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:05 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T06:57:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:05 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T06:57:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:05 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T06:57:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:05 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T06:57:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:05 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T06:57:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:05 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T06:57:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:06 smithi194 ceph-mon[33679]: pgmap v327: 129 pgs: 129 active+clean; 343 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 895 KiB/s wr, 115 op/s 2024-05-08T06:57:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:57:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:57:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:06 smithi070 ceph-mon[29591]: pgmap v327: 129 pgs: 129 active+clean; 343 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 895 KiB/s wr, 115 op/s 2024-05-08T06:57:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:57:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:57:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:06 smithi172 ceph-mon[33377]: pgmap v327: 129 pgs: 129 active+clean; 343 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 895 KiB/s wr, 115 op/s 2024-05-08T06:57:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:57:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:57:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:57:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:57:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:07 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T06:57:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:07 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T06:57:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:07 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T06:57:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:07 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T06:57:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:07 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T06:57:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:07 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T06:57:08.481 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:08 smithi070 ceph-mon[29591]: pgmap v328: 129 pgs: 129 active+clean; 343 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 895 KiB/s wr, 112 op/s 2024-05-08T06:57:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:08 smithi194 ceph-mon[33679]: pgmap v328: 129 pgs: 129 active+clean; 343 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 895 KiB/s wr, 112 op/s 2024-05-08T06:57:08.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:08 smithi172 ceph-mon[33377]: pgmap v328: 129 pgs: 129 active+clean; 343 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 895 KiB/s wr, 112 op/s 2024-05-08T06:57:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:09 smithi194 ceph-mon[33679]: osdmap e102: 12 total, 12 up, 12 in 2024-05-08T06:57:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:09 smithi194 ceph-mon[33679]: pgmap v330: 129 pgs: 9 active+clean+snaptrim_wait, 120 active+clean; 344 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 847 KiB/s wr, 114 op/s 2024-05-08T06:57:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:09 smithi070 ceph-mon[29591]: osdmap e102: 12 total, 12 up, 12 in 2024-05-08T06:57:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:09 smithi070 ceph-mon[29591]: pgmap v330: 129 pgs: 9 active+clean+snaptrim_wait, 120 active+clean; 344 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 847 KiB/s wr, 114 op/s 2024-05-08T06:57:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:09 smithi172 ceph-mon[33377]: osdmap e102: 12 total, 12 up, 12 in 2024-05-08T06:57:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:09 smithi172 ceph-mon[33377]: pgmap v330: 129 pgs: 9 active+clean+snaptrim_wait, 120 active+clean; 344 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 847 KiB/s wr, 114 op/s 2024-05-08T06:57:10.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.693+0000 7f9b6cc00700 1 -- 172.21.15.70:0/128774368 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56118498e590 con 0x561184ab9410 2024-05-08T06:57:10.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.693+0000 7f9b6cc00700 10 client.15771 handle_command_reply: tid=0 2024-05-08T06:57:10.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.693+0000 7f9b93c9cb80 1 client.15771 shutdown 2024-05-08T06:57:10.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.693+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/128774368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184ab12e0 msgr2=0x561184ab1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:10.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.693+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184ab12e0 0x561184ab1760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0a8d60 tx=0x7f9b7c007950 comp rx=0 tx=0).stop 2024-05-08T06:57:10.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.693+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/128774368 shutdown_connections 2024-05-08T06:57:10.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.694+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561184ab9410 0x561184abb830 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:10.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.694+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561184ab12e0 0x561184ab1760 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:10.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.694+0000 7f9b6cc00700 0 client.15771 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:57:10.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.694+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561184a38600 0x561184a423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:10.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.694+0000 7f9b93c9cb80 1 --2- 172.21.15.70:0/128774368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561184a3ad40 0x561184a428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:10.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.694+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/128774368 >> 172.21.15.70:0/128774368 conn(0x5611849a6860 msgr2=0x561184a2e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:10.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.694+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/128774368 shutdown_connections 2024-05-08T06:57:10.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.694+0000 7f9b93c9cb80 1 -- 172.21.15.70:0/128774368 wait complete. 2024-05-08T06:57:10.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.694+0000 7f9b93c9cb80 20 client.15771 trim_cache size 0 max 16384 2024-05-08T06:57:10.694 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 30, 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "6db2d631": { 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 30, 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T06:57:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:10.696 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:57:10.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 -- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b680b2aa0 msgr2=0x7f9b680b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:10.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b680b2aa0 0x7f9b680b4f60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9b74006fd0 tx=0x7f9b74008040 comp rx=0 tx=0).stop 2024-05-08T06:57:10.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 -- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84108460 msgr2=0x7f9b84199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:10.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84108460 0x7f9b84199930 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c00ab50 tx=0x7f9b7c00af10 comp rx=0 tx=0).stop 2024-05-08T06:57:10.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 -- 172.21.15.70:0/4124657074 shutdown_connections 2024-05-08T06:57:10.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b680b2aa0 0x7f9b680b4f60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:10.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b84108460 0x7f9b84199930 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:10.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b84103550 0x7f9b8419f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:10.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 --2- 172.21.15.70:0/4124657074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b84103ef0 0x7f9b8419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:10.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 -- 172.21.15.70:0/4124657074 >> 172.21.15.70:0/4124657074 conn(0x7f9b8407a600 msgr2=0x7f9b84101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:10.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.696+0000 7f9b89400700 1 -- 172.21.15.70:0/4124657074 shutdown_connections 2024-05-08T06:57:10.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:10.697+0000 7f9b89400700 1 -- 172.21.15.70:0/4124657074 wait complete. 2024-05-08T06:57:11.521 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6db2d631', quiesce took 15.7 seconds. Will release after: 30.0 2024-05-08T06:57:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:12 smithi070 ceph-mon[29591]: pgmap v331: 129 pgs: 9 active+clean+snaptrim_wait, 120 active+clean; 344 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 847 KiB/s wr, 114 op/s 2024-05-08T06:57:12.382 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:12 smithi172 ceph-mon[33377]: pgmap v331: 129 pgs: 9 active+clean+snaptrim_wait, 120 active+clean; 344 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 847 KiB/s wr, 114 op/s 2024-05-08T06:57:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:12 smithi194 ceph-mon[33679]: pgmap v331: 129 pgs: 9 active+clean+snaptrim_wait, 120 active+clean; 344 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 847 KiB/s wr, 114 op/s 2024-05-08T06:57:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:14 smithi194 ceph-mon[33679]: pgmap v332: 129 pgs: 9 active+clean+snaptrim_wait, 120 active+clean; 344 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 847 KiB/s wr, 114 op/s 2024-05-08T06:57:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:14 smithi070 ceph-mon[29591]: pgmap v332: 129 pgs: 9 active+clean+snaptrim_wait, 120 active+clean; 344 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 847 KiB/s wr, 114 op/s 2024-05-08T06:57:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:14 smithi172 ceph-mon[33377]: pgmap v332: 129 pgs: 9 active+clean+snaptrim_wait, 120 active+clean; 344 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 847 KiB/s wr, 114 op/s 2024-05-08T06:57:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:16 smithi194 ceph-mon[33679]: pgmap v333: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 290 KiB/s wr, 89 op/s 2024-05-08T06:57:16.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:16 smithi070 ceph-mon[29591]: pgmap v333: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 290 KiB/s wr, 89 op/s 2024-05-08T06:57:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:16 smithi172 ceph-mon[33377]: pgmap v333: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 290 KiB/s wr, 89 op/s 2024-05-08T06:57:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:18 smithi194 ceph-mon[33679]: pgmap v334: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 290 KiB/s wr, 89 op/s 2024-05-08T06:57:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:18 smithi194 ceph-mon[33679]: osdmap e103: 12 total, 12 up, 12 in 2024-05-08T06:57:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:18 smithi070 ceph-mon[29591]: pgmap v334: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 290 KiB/s wr, 89 op/s 2024-05-08T06:57:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:18 smithi070 ceph-mon[29591]: osdmap e103: 12 total, 12 up, 12 in 2024-05-08T06:57:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:18 smithi172 ceph-mon[33377]: pgmap v334: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 290 KiB/s wr, 89 op/s 2024-05-08T06:57:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:18 smithi172 ceph-mon[33377]: osdmap e103: 12 total, 12 up, 12 in 2024-05-08T06:57:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:20 smithi194 ceph-mon[33679]: pgmap v336: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 185 KiB/s wr, 67 op/s 2024-05-08T06:57:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:20 smithi070 ceph-mon[29591]: pgmap v336: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 185 KiB/s wr, 67 op/s 2024-05-08T06:57:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:20 smithi172 ceph-mon[33377]: pgmap v336: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 185 KiB/s wr, 67 op/s 2024-05-08T06:57:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:22 smithi194 ceph-mon[33679]: pgmap v337: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 185 KiB/s wr, 67 op/s 2024-05-08T06:57:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:22 smithi070 ceph-mon[29591]: pgmap v337: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 185 KiB/s wr, 67 op/s 2024-05-08T06:57:22.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:22 smithi172 ceph-mon[33377]: pgmap v337: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 185 KiB/s wr, 67 op/s 2024-05-08T06:57:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:24 smithi194 ceph-mon[33679]: pgmap v338: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 185 KiB/s wr, 67 op/s 2024-05-08T06:57:24.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:24 smithi070 ceph-mon[29591]: pgmap v338: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 185 KiB/s wr, 67 op/s 2024-05-08T06:57:24.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:24 smithi172 ceph-mon[33377]: pgmap v338: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 185 KiB/s wr, 67 op/s 2024-05-08T06:57:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:26 smithi194 ceph-mon[33679]: pgmap v339: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-05-08T06:57:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:26 smithi070 ceph-mon[29591]: pgmap v339: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-05-08T06:57:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:26 smithi172 ceph-mon[33377]: pgmap v339: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-05-08T06:57:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:28 smithi194 ceph-mon[33679]: pgmap v340: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-05-08T06:57:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:28 smithi070 ceph-mon[29591]: pgmap v340: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-05-08T06:57:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:28 smithi172 ceph-mon[33377]: pgmap v340: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-05-08T06:57:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:30 smithi070 ceph-mon[29591]: pgmap v341: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-05-08T06:57:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:30 smithi194 ceph-mon[33679]: pgmap v341: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-05-08T06:57:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:30 smithi172 ceph-mon[33377]: pgmap v341: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-05-08T06:57:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:32 smithi194 ceph-mon[33679]: pgmap v342: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2024-05-08T06:57:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:32 smithi070 ceph-mon[29591]: pgmap v342: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2024-05-08T06:57:32.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:32 smithi172 ceph-mon[33377]: pgmap v342: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2024-05-08T06:57:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:34 smithi194 ceph-mon[33679]: pgmap v343: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2024-05-08T06:57:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:34 smithi070 ceph-mon[29591]: pgmap v343: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2024-05-08T06:57:34.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:34 smithi172 ceph-mon[33377]: pgmap v343: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.7 KiB/s wr, 5 op/s 2024-05-08T06:57:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:35 smithi070 ceph-mon[29591]: pgmap v344: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-05-08T06:57:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:35 smithi172 ceph-mon[33377]: pgmap v344: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-05-08T06:57:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:35 smithi194 ceph-mon[33679]: pgmap v344: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-05-08T06:57:38.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:38 smithi070 ceph-mon[29591]: pgmap v345: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-05-08T06:57:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:38 smithi172 ceph-mon[33377]: pgmap v345: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-05-08T06:57:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:38 smithi194 ceph-mon[33679]: pgmap v345: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-05-08T06:57:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:40 smithi070 ceph-mon[29591]: pgmap v346: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-05-08T06:57:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:40 smithi172 ceph-mon[33377]: pgmap v346: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-05-08T06:57:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:40 smithi194 ceph-mon[33679]: pgmap v346: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-05-08T06:57:41.522 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:57:41.983 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:57:42.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:42 smithi070 ceph-mon[29591]: pgmap v347: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:57:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:42 smithi172 ceph-mon[33377]: pgmap v347: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:57:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:42 smithi194 ceph-mon[33679]: pgmap v347: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:57:44.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:44 smithi070 ceph-mon[29591]: pgmap v348: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:57:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:44 smithi172 ceph-mon[33377]: pgmap v348: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:57:44.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.471+0000 7f4d3a800700 1 -- 172.21.15.70:0/3818060367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 msgr2=0x7f4d3410ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:44.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.471+0000 7f4d3a800700 1 --2- 172.21.15.70:0/3818060367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 0x7f4d3410ff40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4d24009990 tx=0x7f4d24009ca0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.472+0000 7f4d3a800700 1 -- 172.21.15.70:0/3818060367 shutdown_connections 2024-05-08T06:57:44.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.472+0000 7f4d3a800700 1 --2- 172.21.15.70:0/3818060367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d3410a490 0x7f4d341169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.472+0000 7f4d3a800700 1 --2- 172.21.15.70:0/3818060367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 0x7f4d3410ff40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.472+0000 7f4d3a800700 1 --2- 172.21.15.70:0/3818060367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d34109ad0 0x7f4d34109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.472+0000 7f4d3a800700 1 -- 172.21.15.70:0/3818060367 >> 172.21.15.70:0/3818060367 conn(0x7f4d34076c70 msgr2=0x7f4d341082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:44.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.472+0000 7f4d3a800700 1 -- 172.21.15.70:0/3818060367 shutdown_connections 2024-05-08T06:57:44.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.472+0000 7f4d3a800700 1 -- 172.21.15.70:0/3818060367 wait complete. 2024-05-08T06:57:44.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.473+0000 7f4d3a800700 1 Processor -- start 2024-05-08T06:57:44.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.473+0000 7f4d3a800700 1 -- start start 2024-05-08T06:57:44.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d3a800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d34109ad0 0x7f4d341a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d3a800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3410a490 0x7f4d341a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d3a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 0x7f4d341a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d3a800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34119b80 con 0x7f4d3410fb60 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d3a800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34119a00 con 0x7f4d3410a490 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d3a800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34119d00 con 0x7f4d34109ad0 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d33e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 0x7f4d341a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d33e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 0x7f4d341a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44500/0 (socket says 172.21.15.70:44500) 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d33e00700 1 -- 172.21.15.70:0/549565046 learned_addr learned my addr 172.21.15.70:0/549565046 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d33400700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d34109ad0 0x7f4d341a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.474+0000 7f4d32a00700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3410a490 0x7f4d341a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d33e00700 1 -- 172.21.15.70:0/549565046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d34109ad0 msgr2=0x7f4d341a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:44.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d33e00700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d34109ad0 0x7f4d341a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d33e00700 1 -- 172.21.15.70:0/549565046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3410a490 msgr2=0x7f4d341a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:44.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d33e00700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3410a490 0x7f4d341a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d33e00700 1 -- 172.21.15.70:0/549565046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d341a5060 con 0x7f4d3410fb60 2024-05-08T06:57:44.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d32a00700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3410a490 0x7f4d341a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:57:44.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d33e00700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 0x7f4d341a4920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c007ee0 tx=0x7f4d2c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:44.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d2be00700 1 -- 172.21.15.70:0/549565046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00dbd0 con 0x7f4d3410fb60 2024-05-08T06:57:44.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d341a5350 con 0x7f4d3410fb60 2024-05-08T06:57:44.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d2be00700 1 -- 172.21.15.70:0/549565046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4d2c00dd70 con 0x7f4d3410fb60 2024-05-08T06:57:44.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d2be00700 1 -- 172.21.15.70:0/549565046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c0058d0 con 0x7f4d3410fb60 2024-05-08T06:57:44.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.475+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d341acbd0 con 0x7f4d3410fb60 2024-05-08T06:57:44.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.477+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d3406a190 con 0x7f4d3410fb60 2024-05-08T06:57:44.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.479+0000 7f4d2be00700 1 -- 172.21.15.70:0/549565046 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4d2c01a020 con 0x7f4d3410fb60 2024-05-08T06:57:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.481+0000 7f4d2be00700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4d180b2a70 0x7f4d180b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.481+0000 7f4d2be00700 1 -- 172.21.15.70:0/549565046 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9583+0+0 (secure 0 0 0) 0x7f4d2c0e28a0 con 0x7f4d3410fb60 2024-05-08T06:57:44.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.481+0000 7f4d33400700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4d180b2a70 0x7f4d180b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:44.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.482+0000 7f4d33400700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4d180b2a70 0x7f4d180b4f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400b5c0 tx=0x7f4d2401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:44.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.483+0000 7f4d2be00700 1 -- 172.21.15.70:0/549565046 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4d2c010070 con 0x7f4d3410fb60 2024-05-08T06:57:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:44 smithi194 ceph-mon[33679]: pgmap v348: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:57:44.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.765+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d3402e510 con 0x7f4d3410fb60 2024-05-08T06:57:44.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.767+0000 7f4d2be00700 1 -- 172.21.15.70:0/549565046 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f4d2c0a3e20 con 0x7f4d3410fb60 2024-05-08T06:57:44.769 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:57:44.770 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:57:44.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.770+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4d180b2a70 msgr2=0x7f4d180b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:44.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.770+0000 7f4d3a800700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4d180b2a70 0x7f4d180b4f30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400b5c0 tx=0x7f4d2401a040 comp rx=0 tx=0).stop 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.770+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 msgr2=0x7f4d341a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.770+0000 7f4d3a800700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 0x7f4d341a4920 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c007ee0 tx=0x7f4d2c00d3b0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.771+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 shutdown_connections 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.771+0000 7f4d3a800700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4d180b2a70 0x7f4d180b4f30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.771+0000 7f4d3a800700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4d3410fb60 0x7f4d341a4920 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.771+0000 7f4d3a800700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d34109ad0 0x7f4d341a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.771+0000 7f4d3a800700 1 --2- 172.21.15.70:0/549565046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4d3410a490 0x7f4d341a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.771+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 >> 172.21.15.70:0/549565046 conn(0x7f4d34076c70 msgr2=0x7f4d34077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.771+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 shutdown_connections 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:44.771+0000 7f4d3a800700 1 -- 172.21.15.70:0/549565046 wait complete. 2024-05-08T06:57:44.771 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:57:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:45 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/549565046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:57:45.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:45 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/549565046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:57:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:45 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/549565046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:57:45.667 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 6db2d631 --release --await' 2024-05-08T06:57:45.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 6db2d631 --release --await 2024-05-08T06:57:46.113 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:57:46.334 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:46 smithi070 ceph-mon[29591]: pgmap v349: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:57:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:46 smithi172 ceph-mon[33377]: pgmap v349: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:57:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:46 smithi194 ceph-mon[33679]: pgmap v349: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:57:48.217 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:48 smithi070 ceph-mon[29591]: pgmap v350: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:57:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:48 smithi172 ceph-mon[33377]: pgmap v350: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:57:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:48 smithi194 ceph-mon[33679]: pgmap v350: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T06:57:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.584+0000 7f7c97a00700 1 -- 172.21.15.70:0/2092573029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c901095d0 msgr2=0x7f7c901099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.584+0000 7f7c97a00700 1 --2- 172.21.15.70:0/2092573029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c901095d0 0x7f7c901099b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7c780099c0 tx=0x7f7c78009cd0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.584+0000 7f7c97a00700 1 -- 172.21.15.70:0/2092573029 shutdown_connections 2024-05-08T06:57:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.584+0000 7f7c97a00700 1 --2- 172.21.15.70:0/2092573029 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c90103f10 0x7f7c901103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.584+0000 7f7c97a00700 1 --2- 172.21.15.70:0/2092573029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c901095d0 0x7f7c901099b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.584+0000 7f7c97a00700 1 --2- 172.21.15.70:0/2092573029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c90103550 0x7f7c901039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.584+0000 7f7c97a00700 1 -- 172.21.15.70:0/2092573029 >> 172.21.15.70:0/2092573029 conn(0x7f7c9007a5f0 msgr2=0x7f7c9007aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.585+0000 7f7c97a00700 1 -- 172.21.15.70:0/2092573029 shutdown_connections 2024-05-08T06:57:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.585+0000 7f7c97a00700 1 -- 172.21.15.70:0/2092573029 wait complete. 2024-05-08T06:57:48.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.586+0000 7f7c97a00700 1 Processor -- start 2024-05-08T06:57:48.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.586+0000 7f7c97a00700 1 -- start start 2024-05-08T06:57:48.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.586+0000 7f7c97a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c90103550 0x7f7c901a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.586+0000 7f7c97a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c90103f10 0x7f7c901a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.586+0000 7f7c97a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c901095d0 0x7f7c9019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.586+0000 7f7c97a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901135d0 con 0x7f7c90103f10 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.586+0000 7f7c97a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c90113450 con 0x7f7c901095d0 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.586+0000 7f7c97a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7c90113750 con 0x7f7c90103550 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c87e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c90103f10 0x7f7c901a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c87e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c90103f10 0x7f7c901a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33588/0 (socket says 172.21.15.70:33588) 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c87e00700 1 -- 172.21.15.70:0/3135544689 learned_addr learned my addr 172.21.15.70:0/3135544689 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c95000700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c90103550 0x7f7c901a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c95a00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c901095d0 0x7f7c9019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c87e00700 1 -- 172.21.15.70:0/3135544689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c90103550 msgr2=0x7f7c901a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c87e00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c90103550 0x7f7c901a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c87e00700 1 -- 172.21.15.70:0/3135544689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c901095d0 msgr2=0x7f7c9019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:48.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c87e00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c901095d0 0x7f7c9019ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.587+0000 7f7c87e00700 1 -- 172.21.15.70:0/3135544689 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9019c1c0 con 0x7f7c90103f10 2024-05-08T06:57:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.588+0000 7f7c87e00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c90103f10 0x7f7c901a1de0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000d980 tx=0x7f7c8000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.588+0000 7f7c8e000700 1 -- 172.21.15.70:0/3135544689 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80017070 con 0x7f7c90103f10 2024-05-08T06:57:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.588+0000 7f7c8e000700 1 -- 172.21.15.70:0/3135544689 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c80004830 con 0x7f7c90103f10 2024-05-08T06:57:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.588+0000 7f7c8e000700 1 -- 172.21.15.70:0/3135544689 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c800053a0 con 0x7f7c90103f10 2024-05-08T06:57:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.588+0000 7f7c97a00700 1 -- 172.21.15.70:0/3135544689 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9019c4b0 con 0x7f7c90103f10 2024-05-08T06:57:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.588+0000 7f7c97a00700 1 -- 172.21.15.70:0/3135544689 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c901a8770 con 0x7f7c90103f10 2024-05-08T06:57:48.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.593+0000 7f7c8e000700 1 -- 172.21.15.70:0/3135544689 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7c800049e0 con 0x7f7c90103f10 2024-05-08T06:57:48.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.594+0000 7f7ca23afb80 1 Processor -- start 2024-05-08T06:57:48.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.594+0000 7f7ca23afb80 1 -- start start 2024-05-08T06:57:48.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.594+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.594+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519490 0x561c39519910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c39525c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561c3946bb20 con 0x561c3951eec0 2024-05-08T06:57:48.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561c39409860 con 0x561c39519490 2024-05-08T06:57:48.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561c39467ae0 con 0x561c39519e50 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7c95a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7c95a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33594/0 (socket says 172.21.15.70:33594) 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7c95a00700 1 -- 172.21.15.70:0/2242143722 learned_addr learned my addr 172.21.15.70:0/2242143722 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7c8e000700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7c700b2a70 0x7f7c700b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7c8e000700 1 -- 172.21.15.70:0/3135544689 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 9583+0+0 (secure 0 0 0) 0x7f7c800e29c0 con 0x7f7c90103f10 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7c95000700 1 --2- 172.21.15.70:0/2242143722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519490 0x561c39519910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7c87e00700 1 --2- 172.21.15.70:0/2242143722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c39525c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.595+0000 7f7c95a00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7c700b2a70 0x7f7c700b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c95a00700 1 -- 172.21.15.70:0/2242143722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 msgr2=0x561c39525c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:48.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c95a00700 1 --2- 172.21.15.70:0/2242143722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c39525c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c95a00700 1 -- 172.21.15.70:0/2242143722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519490 msgr2=0x561c39519910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:48.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c95a00700 1 --2- 172.21.15.70:0/2242143722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519490 0x561c39519910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c95a00700 1 -- 172.21.15.70:0/2242143722 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c393b89d0 con 0x561c3951eec0 2024-05-08T06:57:48.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c95a00700 1 --2- 172.21.15.70:0/2242143722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951f2a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7c88011a50 tx=0x7f7c88011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3dace7234ee17a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:48.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c95a00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7c700b2a70 0x7f7c700b4f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800b000 tx=0x7f7c8801a000 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:48.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c86000700 1 -- 172.21.15.70:0/2242143722 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88010040 con 0x561c3951eec0 2024-05-08T06:57:48.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c86000700 1 -- 172.21.15.70:0/2242143722 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c88017ca0 con 0x561c3951eec0 2024-05-08T06:57:48.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.596+0000 7f7c86000700 1 -- 172.21.15.70:0/2242143722 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8801fa40 con 0x561c3951eec0 2024-05-08T06:57:48.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.597+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2242143722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 msgr2=0x561c3951f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:48.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.597+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2242143722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951f2a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7c88011a50 tx=0x7f7c88011d60 comp rx=0 tx=0).stop 2024-05-08T06:57:48.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.597+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2242143722 shutdown_connections 2024-05-08T06:57:48.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.597+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2242143722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c39525c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.597+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2242143722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951f2a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.597+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2242143722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519490 0x561c39519910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.597+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2242143722 >> 172.21.15.70:0/2242143722 conn(0x561c39447c60 msgr2=0x561c39513d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:48.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.597+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2242143722 shutdown_connections 2024-05-08T06:57:48.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.598+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2242143722 wait complete. 2024-05-08T06:57:48.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.598+0000 7f7ca23afb80 1 -- start start 2024-05-08T06:57:48.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.598+0000 7f7ca23afb80 1 Processor -- start 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c39525920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c39522cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 0x561c39523200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561c395261c0 con 0x561c39519490 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561c393d1c20 con 0x561c3951eec0 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561c39526340 con 0x561c39519e50 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7ca23afb80 10 client.0 _ll_register_callbacks cb 0x561c39412d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7c95000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c39525920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7c95000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c39525920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33598/0 (socket says 172.21.15.70:33598) 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7c95000700 1 -- 172.21.15.70:0/4060690793 learned_addr learned my addr 172.21.15.70:0/4060690793 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7c95a00700 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 0x561c39523200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.599+0000 7f7c87e00700 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c39522cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7c95000700 1 -- 172.21.15.70:0/4060690793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 msgr2=0x561c39522cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7c95000700 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c39522cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7c95000700 1 -- 172.21.15.70:0/4060690793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 msgr2=0x561c39523200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7c95000700 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 0x561c39523200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7c95000700 1 -- 172.21.15.70:0/4060690793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c39431520 con 0x561c39519490 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7c95000700 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c39525920 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7c780058e0 tx=0x7f7c78005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a84c30bfa30d881 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7c7ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7c7ea00700 1 -- 172.21.15.70:0/4060690793 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800bba0 con 0x561c39519490 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7c7ea00700 1 -- 172.21.15.70:0/4060690793 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9583+0+0 (secure 0 0 0) 0x7f7c7800bd40 con 0x561c39519490 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.600+0000 7f7ca23afb80 1 -- 172.21.15.70:0/4060690793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c88017ca0 con 0x561c39519490 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7c7ea00700 1 -- 172.21.15.70:0/4060690793 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c7802f050 con 0x561c39519490 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7ca23afb80 10 client.15789 fetch_fsmap learned FSMap version 28 2024-05-08T06:57:48.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7ca23afb80 1 -- 172.21.15.70:0/4060690793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c39530a80 con 0x561c39519490 2024-05-08T06:57:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7c7ea00700 1 -- 172.21.15.70:0/4060690793 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c88017ca0 con 0x561c39519490 2024-05-08T06:57:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7c7ea00700 1 -- 172.21.15.70:0/4060690793 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f7c7802a030 con 0x561c39519490 2024-05-08T06:57:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7ca23afb80 10 client.15789 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:57:48.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7ca23afb80 10 client.15789 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:57:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7ca23afb80 20 client.15789 populate_metadata read hostname 'smithi070' 2024-05-08T06:57:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c39533110 0x561c39535540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7ca23afb80 4 client.15789 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:57:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.601+0000 7f7ca23afb80 1 -- 172.21.15.70:0/4060690793 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c394e61a0 con 0x561c39533110 2024-05-08T06:57:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.602+0000 7f7c87e00700 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c39533110 0x561c39535540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.603+0000 7f7c87e00700 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c39533110 0x561c39535540 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a44f56bf9855c796 server_cookie=6a7ce977b3955884 in_seq=0 out_seq=0 2024-05-08T06:57:48.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.603+0000 7f7c7ea00700 10 client.15789 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:57:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.605+0000 7f7c7ea00700 1 -- 172.21.15.70:0/4060690793 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561c394e61a0 con 0x561c39533110 2024-05-08T06:57:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.605+0000 7f7c7ea00700 10 client.15789 handle_command_reply: tid=0 2024-05-08T06:57:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.605+0000 7f7ca23afb80 1 client.15789 shutdown 2024-05-08T06:57:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.605+0000 7f7ca23afb80 1 -- 172.21.15.70:0/4060690793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 msgr2=0x561c39525920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.605+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c39525920 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7c780058e0 tx=0x7f7c78005750 comp rx=0 tx=0).stop 2024-05-08T06:57:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7ca23afb80 1 -- 172.21.15.70:0/4060690793 shutdown_connections 2024-05-08T06:57:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c39533110 0x561c39535540 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 0x561c39523200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c39525920 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/4060690793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c39522cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7ca23afb80 1 -- 172.21.15.70:0/4060690793 >> 172.21.15.70:0/4060690793 conn(0x561c39447c60 msgr2=0x561c3950e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7c7ea00700 0 client.15789 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:57:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7ca23afb80 1 -- 172.21.15.70:0/4060690793 shutdown_connections 2024-05-08T06:57:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7ca23afb80 1 -- 172.21.15.70:0/4060690793 wait complete. 2024-05-08T06:57:48.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.606+0000 7f7ca23afb80 20 client.15789 trim_cache size 0 max 16384 2024-05-08T06:57:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.628+0000 7f7ca23afb80 1 Processor -- start 2024-05-08T06:57:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.628+0000 7f7ca23afb80 1 -- start start 2024-05-08T06:57:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.628+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519490 0x561c3952f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.628+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519e50 0x561c3951c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.628+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.628+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901b3ef0 con 0x561c3951eec0 2024-05-08T06:57:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.628+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901b1780 con 0x561c39519e50 2024-05-08T06:57:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.628+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901af5f0 con 0x561c39519490 2024-05-08T06:57:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c95a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c95a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33602/0 (socket says 172.21.15.70:33602) 2024-05-08T06:57:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c95a00700 1 -- 172.21.15.70:0/3241632588 learned_addr learned my addr 172.21.15.70:0/3241632588 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c87e00700 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519e50 0x561c3951c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c95000700 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519490 0x561c3952f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c95a00700 1 -- 172.21.15.70:0/3241632588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519490 msgr2=0x561c3952f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c95a00700 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519490 0x561c3952f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c95a00700 1 -- 172.21.15.70:0/3241632588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519e50 msgr2=0x561c3951c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c95a00700 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519e50 0x561c3951c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.629+0000 7f7c95a00700 1 -- 172.21.15.70:0/3241632588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c39525560 con 0x561c3951eec0 2024-05-08T06:57:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.630+0000 7f7c87e00700 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519e50 0x561c3951c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:57:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.630+0000 7f7c95a00700 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951ce80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7c88012010 tx=0x7f7c88007630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c48f461624a060 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.630+0000 7f7c85600700 1 -- 172.21.15.70:0/3241632588 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88004c50 con 0x561c3951eec0 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.630+0000 7f7c85600700 1 -- 172.21.15.70:0/3241632588 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c8802d070 con 0x561c3951eec0 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.630+0000 7f7c85600700 1 -- 172.21.15.70:0/3241632588 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8801f4a0 con 0x561c3951eec0 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.631+0000 7f7ca23afb80 1 -- 172.21.15.70:0/3241632588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 msgr2=0x561c3951ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.631+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951ce80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7c88012010 tx=0x7f7c88007630 comp rx=0 tx=0).stop 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.631+0000 7f7ca23afb80 1 -- 172.21.15.70:0/3241632588 shutdown_connections 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.631+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c3951eec0 0x561c3951ce80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.631+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519490 0x561c3952f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.631+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/3241632588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c39519e50 0x561c3951c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.631+0000 7f7ca23afb80 1 -- 172.21.15.70:0/3241632588 >> 172.21.15.70:0/3241632588 conn(0x561c39447c60 msgr2=0x561c39518d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.631+0000 7f7ca23afb80 1 -- 172.21.15.70:0/3241632588 shutdown_connections 2024-05-08T06:57:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.631+0000 7f7ca23afb80 1 -- 172.21.15.70:0/3241632588 wait complete. 2024-05-08T06:57:48.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.632+0000 7f7ca23afb80 1 -- start start 2024-05-08T06:57:48.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.632+0000 7f7ca23afb80 1 Processor -- start 2024-05-08T06:57:48.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.632+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c3952b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.632+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c3952bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.632+0000 7f7ca23afb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 0x561c395285d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.632+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901afc40 con 0x561c39519490 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.632+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901b10b0 con 0x561c3951eec0 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.632+0000 7f7ca23afb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7c901b0310 con 0x561c39519e50 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7ca23afb80 10 client.0 _ll_register_callbacks cb 0x561c39412d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c95000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c3952b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c95000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c3952b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33614/0 (socket says 172.21.15.70:33614) 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c95000700 1 -- 172.21.15.70:0/2252316983 learned_addr learned my addr 172.21.15.70:0/2252316983 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c87e00700 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c3952bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c95a00700 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 0x561c395285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c95000700 1 -- 172.21.15.70:0/2252316983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 msgr2=0x561c3952bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c95000700 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c3952bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c95000700 1 -- 172.21.15.70:0/2252316983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 msgr2=0x561c395285d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c95000700 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 0x561c395285d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.633+0000 7f7c95000700 1 -- 172.21.15.70:0/2252316983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c39528d20 con 0x561c39519490 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.634+0000 7f7c95000700 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c3952b600 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7c780058e0 tx=0x7f7c78005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb190406828897b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.634+0000 7f7c7ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:57:48.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.634+0000 7f7c7ea00700 1 -- 172.21.15.70:0/2252316983 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800f980 con 0x561c39519490 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.634+0000 7f7c7ea00700 1 -- 172.21.15.70:0/2252316983 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 9583+0+0 (secure 0 0 0) 0x7f7c7800fb20 con 0x561c39519490 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.634+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2252316983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c8802d070 con 0x561c39519490 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.634+0000 7f7c7ea00700 1 -- 172.21.15.70:0/2252316983 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c78042050 con 0x561c39519490 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.634+0000 7f7ca23afb80 10 client.15795 fetch_fsmap learned FSMap version 28 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.634+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2252316983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561c395a6ca0 con 0x561c39519490 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.635+0000 7f7c7ea00700 1 -- 172.21.15.70:0/2252316983 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c8802d070 con 0x561c39519490 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.635+0000 7f7c7ea00700 1 -- 172.21.15.70:0/2252316983 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f7c7802a070 con 0x561c39519490 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.635+0000 7f7ca23afb80 10 client.15795 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.635+0000 7f7ca23afb80 10 client.15795 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.635+0000 7f7ca23afb80 20 client.15795 populate_metadata read hostname 'smithi070' 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.635+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c395a7430 0x561c395a9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.635+0000 7f7ca23afb80 4 client.15795 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6db2d631", "release": true, "await": true}] 2024-05-08T06:57:48.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.635+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2252316983 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6db2d631", "release": true, "await": true}) -- 0x561c39479500 con 0x561c395a7430 2024-05-08T06:57:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.636+0000 7f7c87e00700 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c395a7430 0x561c395a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:57:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.637+0000 7f7c87e00700 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c395a7430 0x561c395a9850 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=884547cad7c5b75b server_cookie=e76c5de15961058e in_seq=0 out_seq=0 2024-05-08T06:57:48.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:48.637+0000 7f7c7ea00700 10 client.15795 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:57:49.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.788+0000 7f7c7ea00700 1 -- 172.21.15.70:0/2252316983 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x561c39479500 con 0x561c395a7430 2024-05-08T06:57:49.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.788+0000 7f7c7ea00700 10 client.15795 handle_command_reply: tid=0 2024-05-08T06:57:49.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.788+0000 7f7ca23afb80 1 client.15795 shutdown 2024-05-08T06:57:49.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.788+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2252316983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 msgr2=0x561c3952b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:49.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.788+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c3952b600 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7c780058e0 tx=0x7f7c78005cb0 comp rx=0 tx=0).stop 2024-05-08T06:57:49.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.789+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2252316983 shutdown_connections 2024-05-08T06:57:49.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.789+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c395a7430 0x561c395a9850 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:49.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.789+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c3951eec0 0x561c395285d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:49.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.789+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c39519490 0x561c3952b600 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:49.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.789+0000 7f7ca23afb80 1 --2- 172.21.15.70:0/2252316983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c39519e50 0x561c3952bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:49.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.789+0000 7f7c7ea00700 0 client.15795 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:57:49.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.789+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2252316983 >> 172.21.15.70:0/2252316983 conn(0x561c39447c60 msgr2=0x561c3950dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:49.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.790+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2252316983 shutdown_connections 2024-05-08T06:57:49.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.790+0000 7f7ca23afb80 1 -- 172.21.15.70:0/2252316983 wait complete. 2024-05-08T06:57:49.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.790+0000 7f7ca23afb80 20 client.15795 trim_cache size 0 max 16384 2024-05-08T06:57:49.790 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T06:57:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T06:57:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T06:57:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 32, 2024-05-08T06:57:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T06:57:49.790 INFO:teuthology.orchestra.run.smithi070.stdout: "6db2d631": { 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 32, 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T06:57:49.791 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T06:57:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T06:57:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:49.792 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T06:57:49.792 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 -- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7c700b2a70 msgr2=0x7f7c700b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7c700b2a70 0x7f7c700b4f30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800b000 tx=0x7f7c8801a000 comp rx=0 tx=0).stop 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 -- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c90103f10 msgr2=0x7f7c901a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c90103f10 0x7f7c901a1de0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000d980 tx=0x7f7c8000dd40 comp rx=0 tx=0).stop 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 -- 172.21.15.70:0/3135544689 shutdown_connections 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7c700b2a70 0x7f7c700b4f30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7c901095d0 0x7f7c9019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c90103550 0x7f7c901a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 --2- 172.21.15.70:0/3135544689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7c90103f10 0x7f7c901a1de0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 -- 172.21.15.70:0/3135544689 >> 172.21.15.70:0/3135544689 conn(0x7f7c9007a5f0 msgr2=0x7f7c9010e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 -- 172.21.15.70:0/3135544689 shutdown_connections 2024-05-08T06:57:49.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:57:49.792+0000 7f7c97a00700 1 -- 172.21.15.70:0/3135544689 wait complete. 2024-05-08T06:57:50.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:50 smithi070 ceph-mon[29591]: pgmap v351: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:57:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:50 smithi172 ceph-mon[33377]: pgmap v351: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:57:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:50 smithi194 ceph-mon[33679]: pgmap v351: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T06:57:50.879 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6db2d631', seconds elapsed: 55.1 2024-05-08T06:57:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:52 smithi070 ceph-mon[29591]: pgmap v352: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T06:57:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:52 smithi172 ceph-mon[33377]: pgmap v352: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T06:57:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:52 smithi194 ceph-mon[33679]: pgmap v352: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T06:57:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:54 smithi070 ceph-mon[29591]: pgmap v353: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T06:57:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:54 smithi172 ceph-mon[33377]: pgmap v353: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T06:57:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:54 smithi194 ceph-mon[33679]: pgmap v353: 129 pgs: 129 active+clean; 346 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T06:57:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:56 smithi070 ceph-mon[29591]: pgmap v354: 129 pgs: 129 active+clean; 349 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 271 KiB/s wr, 41 op/s 2024-05-08T06:57:56.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:56 smithi172 ceph-mon[33377]: pgmap v354: 129 pgs: 129 active+clean; 349 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 271 KiB/s wr, 41 op/s 2024-05-08T06:57:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:56 smithi194 ceph-mon[33679]: pgmap v354: 129 pgs: 129 active+clean; 349 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 271 KiB/s wr, 41 op/s 2024-05-08T06:57:58.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:57:58 smithi070 ceph-mon[29591]: pgmap v355: 129 pgs: 129 active+clean; 349 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 271 KiB/s wr, 39 op/s 2024-05-08T06:57:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:57:58 smithi172 ceph-mon[33377]: pgmap v355: 129 pgs: 129 active+clean; 349 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 271 KiB/s wr, 39 op/s 2024-05-08T06:57:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:57:58 smithi194 ceph-mon[33679]: pgmap v355: 129 pgs: 129 active+clean; 349 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 271 KiB/s wr, 39 op/s 2024-05-08T06:58:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:00 smithi070 ceph-mon[29591]: pgmap v356: 129 pgs: 129 active+clean; 352 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 570 KiB/s wr, 79 op/s 2024-05-08T06:58:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:00 smithi172 ceph-mon[33377]: pgmap v356: 129 pgs: 129 active+clean; 352 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 570 KiB/s wr, 79 op/s 2024-05-08T06:58:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:00 smithi194 ceph-mon[33679]: pgmap v356: 129 pgs: 129 active+clean; 352 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 570 KiB/s wr, 79 op/s 2024-05-08T06:58:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:02 smithi172 ceph-mon[33377]: pgmap v357: 129 pgs: 129 active+clean; 352 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 570 KiB/s wr, 77 op/s 2024-05-08T06:58:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:02 smithi194 ceph-mon[33679]: pgmap v357: 129 pgs: 129 active+clean; 352 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 570 KiB/s wr, 77 op/s 2024-05-08T06:58:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:02 smithi070 ceph-mon[29591]: pgmap v357: 129 pgs: 129 active+clean; 352 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 570 KiB/s wr, 77 op/s 2024-05-08T06:58:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:04 smithi172 ceph-mon[33377]: pgmap v358: 129 pgs: 129 active+clean; 352 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 570 KiB/s wr, 77 op/s 2024-05-08T06:58:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:04 smithi194 ceph-mon[33679]: pgmap v358: 129 pgs: 129 active+clean; 352 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 570 KiB/s wr, 77 op/s 2024-05-08T06:58:04.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:04 smithi070 ceph-mon[29591]: pgmap v358: 129 pgs: 129 active+clean; 352 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 570 KiB/s wr, 77 op/s 2024-05-08T06:58:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:06 smithi172 ceph-mon[33377]: pgmap v359: 129 pgs: 129 active+clean; 356 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1002 KiB/s wr, 132 op/s 2024-05-08T06:58:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:58:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:06 smithi194 ceph-mon[33679]: pgmap v359: 129 pgs: 129 active+clean; 356 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1002 KiB/s wr, 132 op/s 2024-05-08T06:58:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:58:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:06 smithi070 ceph-mon[29591]: pgmap v359: 129 pgs: 129 active+clean; 356 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1002 KiB/s wr, 132 op/s 2024-05-08T06:58:06.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:58:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:58:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:58:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:58:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:58:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:58:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:58:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:58:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:58:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:58:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:08 smithi194 ceph-mon[33679]: pgmap v360: 129 pgs: 129 active+clean; 356 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 731 KiB/s wr, 95 op/s 2024-05-08T06:58:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:08 smithi070 ceph-mon[29591]: pgmap v360: 129 pgs: 129 active+clean; 356 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 731 KiB/s wr, 95 op/s 2024-05-08T06:58:08.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:08 smithi172 ceph-mon[33377]: pgmap v360: 129 pgs: 129 active+clean; 356 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 731 KiB/s wr, 95 op/s 2024-05-08T06:58:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:09 smithi194 ceph-mon[33679]: osdmap e104: 12 total, 12 up, 12 in 2024-05-08T06:58:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:09 smithi070 ceph-mon[29591]: osdmap e104: 12 total, 12 up, 12 in 2024-05-08T06:58:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:09 smithi172 ceph-mon[33377]: osdmap e104: 12 total, 12 up, 12 in 2024-05-08T06:58:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:10 smithi194 ceph-mon[33679]: pgmap v362: 129 pgs: 129 active+clean; 361 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.1 MiB/s wr, 130 op/s 2024-05-08T06:58:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:10 smithi070 ceph-mon[29591]: pgmap v362: 129 pgs: 129 active+clean; 361 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.1 MiB/s wr, 130 op/s 2024-05-08T06:58:10.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:10 smithi172 ceph-mon[33377]: pgmap v362: 129 pgs: 129 active+clean; 361 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.1 MiB/s wr, 130 op/s 2024-05-08T06:58:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:12 smithi194 ceph-mon[33679]: pgmap v363: 129 pgs: 129 active+clean; 361 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.1 MiB/s wr, 130 op/s 2024-05-08T06:58:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:12 smithi194 ceph-mon[33679]: osdmap e105: 12 total, 12 up, 12 in 2024-05-08T06:58:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:12 smithi070 ceph-mon[29591]: pgmap v363: 129 pgs: 129 active+clean; 361 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.1 MiB/s wr, 130 op/s 2024-05-08T06:58:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:12 smithi070 ceph-mon[29591]: osdmap e105: 12 total, 12 up, 12 in 2024-05-08T06:58:12.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:12 smithi172 ceph-mon[33377]: pgmap v363: 129 pgs: 129 active+clean; 361 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 1.1 MiB/s wr, 130 op/s 2024-05-08T06:58:12.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:12 smithi172 ceph-mon[33377]: osdmap e105: 12 total, 12 up, 12 in 2024-05-08T06:58:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:14 smithi194 ceph-mon[33679]: pgmap v365: 129 pgs: 129 active+clean; 361 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 734 KiB/s wr, 80 op/s 2024-05-08T06:58:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:14 smithi070 ceph-mon[29591]: pgmap v365: 129 pgs: 129 active+clean; 361 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 734 KiB/s wr, 80 op/s 2024-05-08T06:58:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:14 smithi172 ceph-mon[33377]: pgmap v365: 129 pgs: 129 active+clean; 361 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 734 KiB/s wr, 80 op/s 2024-05-08T06:58:15.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:15 smithi070 ceph-mon[29591]: pgmap v366: 129 pgs: 129 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.4 MiB/s wr, 143 op/s 2024-05-08T06:58:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:15 smithi172 ceph-mon[33377]: pgmap v366: 129 pgs: 129 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.4 MiB/s wr, 143 op/s 2024-05-08T06:58:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:15 smithi194 ceph-mon[33679]: pgmap v366: 129 pgs: 129 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 1.4 MiB/s wr, 143 op/s 2024-05-08T06:58:18.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:18 smithi070 ceph-mon[29591]: pgmap v367: 129 pgs: 129 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-05-08T06:58:18.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:18 smithi172 ceph-mon[33377]: pgmap v367: 129 pgs: 129 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-05-08T06:58:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:18 smithi194 ceph-mon[33679]: pgmap v367: 129 pgs: 129 active+clean; 367 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-05-08T06:58:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:20 smithi070 ceph-mon[29591]: pgmap v368: 129 pgs: 129 active+clean; 371 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.0 MiB/s wr, 99 op/s 2024-05-08T06:58:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:20 smithi172 ceph-mon[33377]: pgmap v368: 129 pgs: 129 active+clean; 371 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.0 MiB/s wr, 99 op/s 2024-05-08T06:58:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:20 smithi194 ceph-mon[33679]: pgmap v368: 129 pgs: 129 active+clean; 371 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.0 MiB/s wr, 99 op/s 2024-05-08T06:58:22.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:22 smithi070 ceph-mon[29591]: pgmap v369: 129 pgs: 129 active+clean; 371 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.0 MiB/s wr, 99 op/s 2024-05-08T06:58:22.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:22 smithi172 ceph-mon[33377]: pgmap v369: 129 pgs: 129 active+clean; 371 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.0 MiB/s wr, 99 op/s 2024-05-08T06:58:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:22 smithi194 ceph-mon[33679]: pgmap v369: 129 pgs: 129 active+clean; 371 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 1.0 MiB/s wr, 99 op/s 2024-05-08T06:58:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:24 smithi070 ceph-mon[29591]: pgmap v370: 129 pgs: 129 active+clean; 371 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 976 KiB/s wr, 92 op/s 2024-05-08T06:58:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:24 smithi172 ceph-mon[33377]: pgmap v370: 129 pgs: 129 active+clean; 371 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 976 KiB/s wr, 92 op/s 2024-05-08T06:58:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:24 smithi194 ceph-mon[33679]: pgmap v370: 129 pgs: 129 active+clean; 371 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 976 KiB/s wr, 92 op/s 2024-05-08T06:58:26.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:26 smithi070 ceph-mon[29591]: pgmap v371: 129 pgs: 129 active+clean; 375 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-05-08T06:58:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:26 smithi172 ceph-mon[33377]: pgmap v371: 129 pgs: 129 active+clean; 375 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-05-08T06:58:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:26 smithi194 ceph-mon[33679]: pgmap v371: 129 pgs: 129 active+clean; 375 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-05-08T06:58:28.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:28 smithi070 ceph-mon[29591]: pgmap v372: 129 pgs: 129 active+clean; 375 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 738 KiB/s wr, 79 op/s 2024-05-08T06:58:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:28 smithi172 ceph-mon[33377]: pgmap v372: 129 pgs: 129 active+clean; 375 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 738 KiB/s wr, 79 op/s 2024-05-08T06:58:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:28 smithi194 ceph-mon[33679]: pgmap v372: 129 pgs: 129 active+clean; 375 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 738 KiB/s wr, 79 op/s 2024-05-08T06:58:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:30 smithi070 ceph-mon[29591]: pgmap v373: 129 pgs: 129 active+clean; 378 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2024-05-08T06:58:30.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:30 smithi172 ceph-mon[33377]: pgmap v373: 129 pgs: 129 active+clean; 378 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2024-05-08T06:58:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:30 smithi194 ceph-mon[33679]: pgmap v373: 129 pgs: 129 active+clean; 378 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2024-05-08T06:58:32.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:32 smithi070 ceph-mon[29591]: pgmap v374: 129 pgs: 129 active+clean; 378 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 713 KiB/s wr, 83 op/s 2024-05-08T06:58:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:32 smithi172 ceph-mon[33377]: pgmap v374: 129 pgs: 129 active+clean; 378 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 713 KiB/s wr, 83 op/s 2024-05-08T06:58:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:32 smithi194 ceph-mon[33679]: pgmap v374: 129 pgs: 129 active+clean; 378 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 713 KiB/s wr, 83 op/s 2024-05-08T06:58:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:34 smithi070 ceph-mon[29591]: pgmap v375: 129 pgs: 129 active+clean; 378 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 713 KiB/s wr, 83 op/s 2024-05-08T06:58:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:34 smithi172 ceph-mon[33377]: pgmap v375: 129 pgs: 129 active+clean; 378 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 713 KiB/s wr, 83 op/s 2024-05-08T06:58:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:34 smithi194 ceph-mon[33679]: pgmap v375: 129 pgs: 129 active+clean; 378 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 713 KiB/s wr, 83 op/s 2024-05-08T06:58:36.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:36 smithi172 ceph-mon[33377]: pgmap v376: 129 pgs: 129 active+clean; 383 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.1 MiB/s wr, 125 op/s 2024-05-08T06:58:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:36 smithi194 ceph-mon[33679]: pgmap v376: 129 pgs: 129 active+clean; 383 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.1 MiB/s wr, 125 op/s 2024-05-08T06:58:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:36 smithi070 ceph-mon[29591]: pgmap v376: 129 pgs: 129 active+clean; 383 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.1 MiB/s wr, 125 op/s 2024-05-08T06:58:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:38 smithi172 ceph-mon[33377]: pgmap v377: 129 pgs: 129 active+clean; 383 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 742 KiB/s wr, 86 op/s 2024-05-08T06:58:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:38 smithi194 ceph-mon[33679]: pgmap v377: 129 pgs: 129 active+clean; 383 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 742 KiB/s wr, 86 op/s 2024-05-08T06:58:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:38 smithi070 ceph-mon[29591]: pgmap v377: 129 pgs: 129 active+clean; 383 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 742 KiB/s wr, 86 op/s 2024-05-08T06:58:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:40 smithi172 ceph-mon[33377]: pgmap v378: 129 pgs: 129 active+clean; 385 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 1009 KiB/s wr, 126 op/s 2024-05-08T06:58:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:40 smithi194 ceph-mon[33679]: pgmap v378: 129 pgs: 129 active+clean; 385 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 1009 KiB/s wr, 126 op/s 2024-05-08T06:58:40.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:40 smithi070 ceph-mon[29591]: pgmap v378: 129 pgs: 129 active+clean; 385 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 1009 KiB/s wr, 126 op/s 2024-05-08T06:58:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:42 smithi172 ceph-mon[33377]: pgmap v379: 129 pgs: 129 active+clean; 385 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 641 KiB/s wr, 81 op/s 2024-05-08T06:58:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:42 smithi194 ceph-mon[33679]: pgmap v379: 129 pgs: 129 active+clean; 385 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 641 KiB/s wr, 81 op/s 2024-05-08T06:58:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:42 smithi070 ceph-mon[29591]: pgmap v379: 129 pgs: 129 active+clean; 385 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 641 KiB/s wr, 81 op/s 2024-05-08T06:58:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:44 smithi172 ceph-mon[33377]: pgmap v380: 129 pgs: 129 active+clean; 385 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 641 KiB/s wr, 81 op/s 2024-05-08T06:58:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:44 smithi194 ceph-mon[33679]: pgmap v380: 129 pgs: 129 active+clean; 385 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 641 KiB/s wr, 81 op/s 2024-05-08T06:58:44.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:44 smithi070 ceph-mon[29591]: pgmap v380: 129 pgs: 129 active+clean; 385 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 641 KiB/s wr, 81 op/s 2024-05-08T06:58:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:46 smithi172 ceph-mon[33377]: pgmap v381: 129 pgs: 129 active+clean; 389 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 993 KiB/s wr, 126 op/s 2024-05-08T06:58:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:46 smithi194 ceph-mon[33679]: pgmap v381: 129 pgs: 129 active+clean; 389 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 993 KiB/s wr, 126 op/s 2024-05-08T06:58:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:46 smithi070 ceph-mon[29591]: pgmap v381: 129 pgs: 129 active+clean; 389 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 993 KiB/s wr, 126 op/s 2024-05-08T06:58:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:48 smithi172 ceph-mon[33377]: pgmap v382: 129 pgs: 129 active+clean; 389 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 618 KiB/s wr, 83 op/s 2024-05-08T06:58:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:48 smithi194 ceph-mon[33679]: pgmap v382: 129 pgs: 129 active+clean; 389 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 618 KiB/s wr, 83 op/s 2024-05-08T06:58:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:48 smithi070 ceph-mon[29591]: pgmap v382: 129 pgs: 129 active+clean; 389 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 618 KiB/s wr, 83 op/s 2024-05-08T06:58:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:50 smithi194 ceph-mon[33679]: pgmap v383: 129 pgs: 129 active+clean; 393 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 1015 KiB/s wr, 131 op/s 2024-05-08T06:58:50.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:50 smithi070 ceph-mon[29591]: pgmap v383: 129 pgs: 129 active+clean; 393 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 1015 KiB/s wr, 131 op/s 2024-05-08T06:58:50.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:50 smithi172 ceph-mon[33377]: pgmap v383: 129 pgs: 129 active+clean; 393 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 1015 KiB/s wr, 131 op/s 2024-05-08T06:58:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:52 smithi194 ceph-mon[33679]: pgmap v384: 129 pgs: 129 active+clean; 393 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 747 KiB/s wr, 91 op/s 2024-05-08T06:58:52.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:52 smithi070 ceph-mon[29591]: pgmap v384: 129 pgs: 129 active+clean; 393 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 747 KiB/s wr, 91 op/s 2024-05-08T06:58:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:52 smithi172 ceph-mon[33377]: pgmap v384: 129 pgs: 129 active+clean; 393 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 747 KiB/s wr, 91 op/s 2024-05-08T06:58:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:54 smithi194 ceph-mon[33679]: pgmap v385: 129 pgs: 129 active+clean; 393 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 748 KiB/s wr, 91 op/s 2024-05-08T06:58:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:54 smithi070 ceph-mon[29591]: pgmap v385: 129 pgs: 129 active+clean; 393 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 748 KiB/s wr, 91 op/s 2024-05-08T06:58:54.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:54 smithi172 ceph-mon[33377]: pgmap v385: 129 pgs: 129 active+clean; 393 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 748 KiB/s wr, 91 op/s 2024-05-08T06:58:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:56 smithi194 ceph-mon[33679]: pgmap v386: 129 pgs: 129 active+clean; 397 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.0 MiB/s wr, 135 op/s 2024-05-08T06:58:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:56 smithi070 ceph-mon[29591]: pgmap v386: 129 pgs: 129 active+clean; 397 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.0 MiB/s wr, 135 op/s 2024-05-08T06:58:56.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:56 smithi172 ceph-mon[33377]: pgmap v386: 129 pgs: 129 active+clean; 397 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.0 MiB/s wr, 135 op/s 2024-05-08T06:58:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:58:58 smithi194 ceph-mon[33679]: pgmap v387: 129 pgs: 129 active+clean; 397 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 722 KiB/s wr, 90 op/s 2024-05-08T06:58:58.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:58:58 smithi070 ceph-mon[29591]: pgmap v387: 129 pgs: 129 active+clean; 397 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 722 KiB/s wr, 90 op/s 2024-05-08T06:58:58.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:58:58 smithi172 ceph-mon[33377]: pgmap v387: 129 pgs: 129 active+clean; 397 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 722 KiB/s wr, 90 op/s 2024-05-08T06:59:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:00 smithi194 ceph-mon[33679]: pgmap v388: 129 pgs: 129 active+clean; 402 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-05-08T06:59:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:00 smithi070 ceph-mon[29591]: pgmap v388: 129 pgs: 129 active+clean; 402 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-05-08T06:59:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:00 smithi172 ceph-mon[33377]: pgmap v388: 129 pgs: 129 active+clean; 402 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 1.2 MiB/s wr, 134 op/s 2024-05-08T06:59:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:02 smithi194 ceph-mon[33679]: pgmap v389: 129 pgs: 129 active+clean; 402 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 796 KiB/s wr, 87 op/s 2024-05-08T06:59:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:02 smithi070 ceph-mon[29591]: pgmap v389: 129 pgs: 129 active+clean; 402 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 796 KiB/s wr, 87 op/s 2024-05-08T06:59:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:02 smithi172 ceph-mon[33377]: pgmap v389: 129 pgs: 129 active+clean; 402 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 796 KiB/s wr, 87 op/s 2024-05-08T06:59:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:04 smithi194 ceph-mon[33679]: pgmap v390: 129 pgs: 129 active+clean; 402 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 796 KiB/s wr, 87 op/s 2024-05-08T06:59:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:04 smithi070 ceph-mon[29591]: pgmap v390: 129 pgs: 129 active+clean; 402 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 796 KiB/s wr, 87 op/s 2024-05-08T06:59:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:04 smithi172 ceph-mon[33377]: pgmap v390: 129 pgs: 129 active+clean; 402 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 796 KiB/s wr, 87 op/s 2024-05-08T06:59:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:06 smithi194 ceph-mon[33679]: pgmap v391: 129 pgs: 129 active+clean; 406 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.2 MiB/s wr, 139 op/s 2024-05-08T06:59:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:06 smithi070 ceph-mon[29591]: pgmap v391: 129 pgs: 129 active+clean; 406 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.2 MiB/s wr, 139 op/s 2024-05-08T06:59:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:06 smithi172 ceph-mon[33377]: pgmap v391: 129 pgs: 129 active+clean; 406 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.2 MiB/s wr, 139 op/s 2024-05-08T06:59:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:08 smithi194 ceph-mon[33679]: pgmap v392: 129 pgs: 129 active+clean; 406 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 875 KiB/s wr, 96 op/s 2024-05-08T06:59:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:59:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:08 smithi070 ceph-mon[29591]: pgmap v392: 129 pgs: 129 active+clean; 406 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 875 KiB/s wr, 96 op/s 2024-05-08T06:59:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:59:08.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:08 smithi172 ceph-mon[33377]: pgmap v392: 129 pgs: 129 active+clean; 406 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 875 KiB/s wr, 96 op/s 2024-05-08T06:59:08.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:59:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:09 smithi194 ceph-mon[33679]: osdmap e106: 12 total, 12 up, 12 in 2024-05-08T06:59:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:59:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:59:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:59:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:09 smithi070 ceph-mon[29591]: osdmap e106: 12 total, 12 up, 12 in 2024-05-08T06:59:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:59:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:59:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:59:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:09 smithi172 ceph-mon[33377]: osdmap e106: 12 total, 12 up, 12 in 2024-05-08T06:59:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:59:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:59:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T06:59:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:10 smithi194 ceph-mon[33679]: pgmap v394: 129 pgs: 129 active+clean; 414 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2024-05-08T06:59:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:10 smithi070 ceph-mon[29591]: pgmap v394: 129 pgs: 129 active+clean; 414 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2024-05-08T06:59:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:10 smithi172 ceph-mon[33377]: pgmap v394: 129 pgs: 129 active+clean; 414 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2024-05-08T06:59:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:12 smithi070 ceph-mon[29591]: pgmap v395: 129 pgs: 129 active+clean; 414 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2024-05-08T06:59:12.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:12 smithi070 ceph-mon[29591]: osdmap e107: 12 total, 12 up, 12 in 2024-05-08T06:59:12.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:12 smithi172 ceph-mon[33377]: pgmap v395: 129 pgs: 129 active+clean; 414 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2024-05-08T06:59:12.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:12 smithi172 ceph-mon[33377]: osdmap e107: 12 total, 12 up, 12 in 2024-05-08T06:59:12.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:12 smithi194 ceph-mon[33679]: pgmap v395: 129 pgs: 129 active+clean; 414 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 1.3 MiB/s wr, 126 op/s 2024-05-08T06:59:12.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:12 smithi194 ceph-mon[33679]: osdmap e107: 12 total, 12 up, 12 in 2024-05-08T06:59:13.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:13 smithi070 ceph-mon[29591]: pgmap v397: 129 pgs: 129 active+clean; 414 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 1.0 MiB/s wr, 80 op/s 2024-05-08T06:59:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:13 smithi172 ceph-mon[33377]: pgmap v397: 129 pgs: 129 active+clean; 414 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 1.0 MiB/s wr, 80 op/s 2024-05-08T06:59:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:13 smithi194 ceph-mon[33679]: pgmap v397: 129 pgs: 129 active+clean; 414 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 1.0 MiB/s wr, 80 op/s 2024-05-08T06:59:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:16 smithi070 ceph-mon[29591]: pgmap v398: 129 pgs: 129 active+clean; 418 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 1.6 MiB/s wr, 146 op/s 2024-05-08T06:59:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:16 smithi172 ceph-mon[33377]: pgmap v398: 129 pgs: 129 active+clean; 418 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 1.6 MiB/s wr, 146 op/s 2024-05-08T06:59:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:16 smithi194 ceph-mon[33679]: pgmap v398: 129 pgs: 129 active+clean; 418 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 1.6 MiB/s wr, 146 op/s 2024-05-08T06:59:18.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:18 smithi070 ceph-mon[29591]: pgmap v399: 129 pgs: 129 active+clean; 418 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-05-08T06:59:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:18 smithi172 ceph-mon[33377]: pgmap v399: 129 pgs: 129 active+clean; 418 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-05-08T06:59:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:18 smithi194 ceph-mon[33679]: pgmap v399: 129 pgs: 129 active+clean; 418 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 1.4 MiB/s wr, 133 op/s 2024-05-08T06:59:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:20 smithi070 ceph-mon[29591]: pgmap v400: 129 pgs: 129 active+clean; 424 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-05-08T06:59:20.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:20 smithi172 ceph-mon[33377]: pgmap v400: 129 pgs: 129 active+clean; 424 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-05-08T06:59:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:20 smithi194 ceph-mon[33679]: pgmap v400: 129 pgs: 129 active+clean; 424 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-05-08T06:59:22.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:22 smithi070 ceph-mon[29591]: pgmap v401: 129 pgs: 129 active+clean; 424 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-05-08T06:59:22.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:22 smithi172 ceph-mon[33377]: pgmap v401: 129 pgs: 129 active+clean; 424 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-05-08T06:59:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:22 smithi194 ceph-mon[33679]: pgmap v401: 129 pgs: 129 active+clean; 424 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.0 MiB/s wr, 107 op/s 2024-05-08T06:59:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:24 smithi070 ceph-mon[29591]: pgmap v402: 129 pgs: 129 active+clean; 424 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 996 KiB/s wr, 99 op/s 2024-05-08T06:59:24.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:24 smithi172 ceph-mon[33377]: pgmap v402: 129 pgs: 129 active+clean; 424 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 996 KiB/s wr, 99 op/s 2024-05-08T06:59:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:24 smithi194 ceph-mon[33679]: pgmap v402: 129 pgs: 129 active+clean; 424 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 996 KiB/s wr, 99 op/s 2024-05-08T06:59:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:26 smithi172 ceph-mon[33377]: pgmap v403: 129 pgs: 129 active+clean; 435 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 1.8 MiB/s wr, 134 op/s 2024-05-08T06:59:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:26 smithi194 ceph-mon[33679]: pgmap v403: 129 pgs: 129 active+clean; 435 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 1.8 MiB/s wr, 134 op/s 2024-05-08T06:59:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:26 smithi070 ceph-mon[29591]: pgmap v403: 129 pgs: 129 active+clean; 435 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 1.8 MiB/s wr, 134 op/s 2024-05-08T06:59:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:28 smithi172 ceph-mon[33377]: pgmap v404: 129 pgs: 129 active+clean; 435 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.5 MiB/s wr, 90 op/s 2024-05-08T06:59:28.431 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:28 smithi070 ceph-mon[29591]: pgmap v404: 129 pgs: 129 active+clean; 435 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.5 MiB/s wr, 90 op/s 2024-05-08T06:59:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:28 smithi194 ceph-mon[33679]: pgmap v404: 129 pgs: 129 active+clean; 435 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.5 MiB/s wr, 90 op/s 2024-05-08T06:59:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:30 smithi172 ceph-mon[33377]: pgmap v405: 129 pgs: 129 active+clean; 443 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 2.2 MiB/s wr, 131 op/s 2024-05-08T06:59:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:30 smithi194 ceph-mon[33679]: pgmap v405: 129 pgs: 129 active+clean; 443 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 2.2 MiB/s wr, 131 op/s 2024-05-08T06:59:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:30 smithi070 ceph-mon[29591]: pgmap v405: 129 pgs: 129 active+clean; 443 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 2.2 MiB/s wr, 131 op/s 2024-05-08T06:59:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:32 smithi172 ceph-mon[33377]: pgmap v406: 129 pgs: 129 active+clean; 443 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-05-08T06:59:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:32 smithi194 ceph-mon[33679]: pgmap v406: 129 pgs: 129 active+clean; 443 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-05-08T06:59:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:32 smithi070 ceph-mon[29591]: pgmap v406: 129 pgs: 129 active+clean; 443 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-05-08T06:59:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:34 smithi172 ceph-mon[33377]: pgmap v407: 129 pgs: 129 active+clean; 443 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-05-08T06:59:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:34 smithi194 ceph-mon[33679]: pgmap v407: 129 pgs: 129 active+clean; 443 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-05-08T06:59:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:34 smithi070 ceph-mon[29591]: pgmap v407: 129 pgs: 129 active+clean; 443 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 1.6 MiB/s wr, 85 op/s 2024-05-08T06:59:36.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:36 smithi172 ceph-mon[33377]: pgmap v408: 129 pgs: 129 active+clean; 447 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 2.0 MiB/s wr, 117 op/s 2024-05-08T06:59:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:36 smithi194 ceph-mon[33679]: pgmap v408: 129 pgs: 129 active+clean; 447 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 2.0 MiB/s wr, 117 op/s 2024-05-08T06:59:36.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:36 smithi070 ceph-mon[29591]: pgmap v408: 129 pgs: 129 active+clean; 447 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 2.0 MiB/s wr, 117 op/s 2024-05-08T06:59:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:38 smithi172 ceph-mon[33377]: pgmap v409: 129 pgs: 129 active+clean; 447 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-05-08T06:59:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:38 smithi194 ceph-mon[33679]: pgmap v409: 129 pgs: 129 active+clean; 447 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-05-08T06:59:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:38 smithi070 ceph-mon[29591]: pgmap v409: 129 pgs: 129 active+clean; 447 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 1.1 MiB/s wr, 72 op/s 2024-05-08T06:59:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:40 smithi194 ceph-mon[33679]: pgmap v410: 129 pgs: 129 active+clean; 455 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 1.8 MiB/s wr, 120 op/s 2024-05-08T06:59:40.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:40 smithi070 ceph-mon[29591]: pgmap v410: 129 pgs: 129 active+clean; 455 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 1.8 MiB/s wr, 120 op/s 2024-05-08T06:59:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:40 smithi172 ceph-mon[33377]: pgmap v410: 129 pgs: 129 active+clean; 455 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 1.8 MiB/s wr, 120 op/s 2024-05-08T06:59:42.309 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T06:59:42.310 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-05-08T06:59:42.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:59:42.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:42 smithi172 ceph-mon[33377]: pgmap v411: 129 pgs: 129 active+clean; 455 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.0 MiB/s wr, 79 op/s 2024-05-08T06:59:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:42 smithi194 ceph-mon[33679]: pgmap v411: 129 pgs: 129 active+clean; 455 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.0 MiB/s wr, 79 op/s 2024-05-08T06:59:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:42 smithi070 ceph-mon[29591]: pgmap v411: 129 pgs: 129 active+clean; 455 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.0 MiB/s wr, 79 op/s 2024-05-08T06:59:42.792 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:59:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:44 smithi194 ceph-mon[33679]: pgmap v412: 129 pgs: 129 active+clean; 455 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.0 MiB/s wr, 79 op/s 2024-05-08T06:59:44.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:44 smithi070 ceph-mon[29591]: pgmap v412: 129 pgs: 129 active+clean; 455 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.0 MiB/s wr, 79 op/s 2024-05-08T06:59:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:44 smithi172 ceph-mon[33377]: pgmap v412: 129 pgs: 129 active+clean; 455 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 1.0 MiB/s wr, 79 op/s 2024-05-08T06:59:46.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.971+0000 7fd73e000700 1 -- 172.21.15.70:0/618974692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73806bad0 msgr2=0x7fd73810fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.971+0000 7fd73e000700 1 --2- 172.21.15.70:0/618974692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73806bad0 0x7fd73810fa10 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd724009990 tx=0x7fd724009ca0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.971+0000 7fd73e000700 1 -- 172.21.15.70:0/618974692 shutdown_connections 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.971+0000 7fd73e000700 1 --2- 172.21.15.70:0/618974692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73810ff50 0x7fd738112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.971+0000 7fd73e000700 1 --2- 172.21.15.70:0/618974692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73806b1b0 0x7fd73806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.971+0000 7fd73e000700 1 --2- 172.21.15.70:0/618974692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73806bad0 0x7fd73810fa10 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.971+0000 7fd73e000700 1 -- 172.21.15.70:0/618974692 >> 172.21.15.70:0/618974692 conn(0x7fd738079350 msgr2=0x7fd738079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.971+0000 7fd73e000700 1 -- 172.21.15.70:0/618974692 shutdown_connections 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.971+0000 7fd73e000700 1 -- 172.21.15.70:0/618974692 wait complete. 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.973+0000 7fd73e000700 1 Processor -- start 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.973+0000 7fd73e000700 1 -- start start 2024-05-08T06:59:46.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.973+0000 7fd73e000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73806b1b0 0x7fd7381a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.973+0000 7fd73e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73806bad0 0x7fd7381a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.973+0000 7fd73e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73810ff50 0x7fd73819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.973+0000 7fd73e000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd7381157f0 con 0x7fd73810ff50 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.973+0000 7fd73e000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd738115670 con 0x7fd73806bad0 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.973+0000 7fd73e000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd738115970 con 0x7fd73806b1b0 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd737e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73810ff50 0x7fd73819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd737e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73810ff50 0x7fd73819bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43622/0 (socket says 172.21.15.70:43622) 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd737e00700 1 -- 172.21.15.70:0/1672424957 learned_addr learned my addr 172.21.15.70:0/1672424957 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd737400700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73806b1b0 0x7fd7381a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd736a00700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73806bad0 0x7fd7381a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd737e00700 1 -- 172.21.15.70:0/1672424957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73806b1b0 msgr2=0x7fd7381a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd737e00700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73806b1b0 0x7fd7381a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd737e00700 1 -- 172.21.15.70:0/1672424957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73806bad0 msgr2=0x7fd7381a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd737e00700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73806bad0 0x7fd7381a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.974+0000 7fd737e00700 1 -- 172.21.15.70:0/1672424957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73819c410 con 0x7fd73810ff50 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.975+0000 7fd737e00700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73810ff50 0x7fd73819bb30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd73000b9e0 tx=0x7fd73000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.975+0000 7fd72fe00700 1 -- 172.21.15.70:0/1672424957 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730019070 con 0x7fd73810ff50 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.975+0000 7fd72fe00700 1 -- 172.21.15.70:0/1672424957 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd73000ce40 con 0x7fd73810ff50 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.975+0000 7fd72fe00700 1 -- 172.21.15.70:0/1672424957 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730012340 con 0x7fd73810ff50 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.975+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73819c700 con 0x7fd73810ff50 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.975+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7381a89e0 con 0x7fd73810ff50 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.977+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7381029c0 con 0x7fd73810ff50 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.979+0000 7fd72fe00700 1 -- 172.21.15.70:0/1672424957 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd73001c070 con 0x7fd73810ff50 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.982+0000 7fd72fe00700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd71c0b29f0 0x7fd71c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.982+0000 7fd72fe00700 1 -- 172.21.15.70:0/1672424957 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9583+0+0 (secure 0 0 0) 0x7fd7300e1f10 con 0x7fd73810ff50 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.982+0000 7fd737400700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd71c0b29f0 0x7fd71c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:46.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.983+0000 7fd737400700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd71c0b29f0 0x7fd71c0b4eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd728005950 tx=0x7fd7280058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:59:46.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:45.987+0000 7fd72fe00700 1 -- 172.21.15.70:0/1672424957 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd730051df0 con 0x7fd73810ff50 2024-05-08T06:59:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:46 smithi070 ceph-mon[29591]: pgmap v413: 129 pgs: 129 active+clean; 463 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 1.7 MiB/s wr, 131 op/s 2024-05-08T06:59:46.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.415+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd73802e510 con 0x7fd73810ff50 2024-05-08T06:59:46.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.417+0000 7fd72fe00700 1 -- 172.21.15.70:0/1672424957 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fd7300a9580 con 0x7fd73810ff50 2024-05-08T06:59:46.416 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T06:59:46.416 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T06:59:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd71c0b29f0 msgr2=0x7fd71c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd71c0b29f0 0x7fd71c0b4eb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd728005950 tx=0x7fd7280058e0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73810ff50 msgr2=0x7fd73819bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:46.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73810ff50 0x7fd73819bb30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd73000b9e0 tx=0x7fd73000bda0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 shutdown_connections 2024-05-08T06:59:46.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd71c0b29f0 0x7fd71c0b4eb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd73810ff50 0x7fd73819bb30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73806b1b0 0x7fd7381a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 --2- 172.21.15.70:0/1672424957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd73806bad0 0x7fd7381a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:46.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 >> 172.21.15.70:0/1672424957 conn(0x7fd738079350 msgr2=0x7fd738111460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:59:46.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 shutdown_connections 2024-05-08T06:59:46.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:46.421+0000 7fd73e000700 1 -- 172.21.15.70:0/1672424957 wait complete. 2024-05-08T06:59:46.421 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T06:59:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:46 smithi194 ceph-mon[33679]: pgmap v413: 129 pgs: 129 active+clean; 463 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 1.7 MiB/s wr, 131 op/s 2024-05-08T06:59:46.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:46 smithi172 ceph-mon[33377]: pgmap v413: 129 pgs: 129 active+clean; 463 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 1.7 MiB/s wr, 131 op/s 2024-05-08T06:59:47.326 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 80.35 --await-for 42.0' 2024-05-08T06:59:47.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 80.35 --await-for 42.0 2024-05-08T06:59:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:47 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1672424957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:59:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:47 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1672424957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:59:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:47 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1672424957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:59:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:59:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:48 smithi194 ceph-mon[33679]: pgmap v414: 129 pgs: 129 active+clean; 463 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-05-08T06:59:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:48 smithi070 ceph-mon[29591]: pgmap v414: 129 pgs: 129 active+clean; 463 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-05-08T06:59:48.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:48 smithi172 ceph-mon[33377]: pgmap v414: 129 pgs: 129 active+clean; 463 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 1.3 MiB/s wr, 100 op/s 2024-05-08T06:59:50.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.470+0000 7f53a3200700 1 -- 172.21.15.70:0/3259669814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 msgr2=0x7f53a410f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:50.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.470+0000 7f53a3200700 1 --2- 172.21.15.70:0/3259669814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 0x7f53a410f1d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f539c0099c0 tx=0x7f539c009cd0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.470+0000 7f53a3200700 1 -- 172.21.15.70:0/3259669814 shutdown_connections 2024-05-08T06:59:50.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.470+0000 7f53a3200700 1 --2- 172.21.15.70:0/3259669814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 0x7f53a410f1d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.470+0000 7f53a3200700 1 --2- 172.21.15.70:0/3259669814 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a4102540 0x7f53a4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.470+0000 7f53a3200700 1 --2- 172.21.15.70:0/3259669814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53a4103e30 0x7f53a41042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.470+0000 7f53a3200700 1 -- 172.21.15.70:0/3259669814 >> 172.21.15.70:0/3259669814 conn(0x7f53a40fdcf0 msgr2=0x7f53a4100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:59:50.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.470+0000 7f53a3200700 1 -- 172.21.15.70:0/3259669814 shutdown_connections 2024-05-08T06:59:50.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.470+0000 7f53a3200700 1 -- 172.21.15.70:0/3259669814 wait complete. 2024-05-08T06:59:50.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.472+0000 7f53a3200700 1 Processor -- start 2024-05-08T06:59:50.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.472+0000 7f53a3200700 1 -- start start 2024-05-08T06:59:50.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.472+0000 7f53a3200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a4102540 0x7f53a41a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.472+0000 7f53a3200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53a4103e30 0x7f53a41a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.472+0000 7f53a3200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 0x7f53a419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.472+0000 7f53a3200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4112350 con 0x7f53a41047f0 2024-05-08T06:59:50.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.472+0000 7f53a3200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41121d0 con 0x7f53a4102540 2024-05-08T06:59:50.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.472+0000 7f53a3200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41124d0 con 0x7f53a4103e30 2024-05-08T06:59:50.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.473+0000 7f53a2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 0x7f53a419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.473+0000 7f53a2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 0x7f53a419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38888/0 (socket says 172.21.15.70:38888) 2024-05-08T06:59:50.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.473+0000 7f53a2800700 1 -- 172.21.15.70:0/3223031110 learned_addr learned my addr 172.21.15.70:0/3223031110 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:59:50.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.473+0000 7f53a1e00700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a4102540 0x7f53a41a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.473+0000 7f5399400700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53a4103e30 0x7f53a41a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.474+0000 7f53a2800700 1 -- 172.21.15.70:0/3223031110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53a4103e30 msgr2=0x7f53a41a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:50.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.474+0000 7f53a2800700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53a4103e30 0x7f53a41a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.474+0000 7f53a2800700 1 -- 172.21.15.70:0/3223031110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a4102540 msgr2=0x7f53a41a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:50.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.474+0000 7f53a2800700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a4102540 0x7f53a41a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.474+0000 7f53a2800700 1 -- 172.21.15.70:0/3223031110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a419bff0 con 0x7f53a41047f0 2024-05-08T06:59:50.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.474+0000 7f53a2800700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 0x7f53a419b810 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f539c005f50 tx=0x7f539c004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:59:50.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.475+0000 7f539b400700 1 -- 172.21.15.70:0/3223031110 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c004830 con 0x7f53a41047f0 2024-05-08T06:59:50.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.475+0000 7f539b400700 1 -- 172.21.15.70:0/3223031110 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f539c005020 con 0x7f53a41047f0 2024-05-08T06:59:50.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.475+0000 7f539b400700 1 -- 172.21.15.70:0/3223031110 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c003cc0 con 0x7f53a41047f0 2024-05-08T06:59:50.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.475+0000 7f53a3200700 1 -- 172.21.15.70:0/3223031110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a419c280 con 0x7f53a41047f0 2024-05-08T06:59:50.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.475+0000 7f53a3200700 1 -- 172.21.15.70:0/3223031110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a41a84f0 con 0x7f53a41047f0 2024-05-08T06:59:50.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.481+0000 7f539b400700 1 -- 172.21.15.70:0/3223031110 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f539c0054d0 con 0x7f53a41047f0 2024-05-08T06:59:50.480 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:50 smithi070 ceph-mon[29591]: pgmap v415: 129 pgs: 129 active+clean; 470 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 2.0 MiB/s wr, 158 op/s 2024-05-08T06:59:50.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.483+0000 7f53b3875b80 1 Processor -- start 2024-05-08T06:59:50.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.483+0000 7f53b3875b80 1 -- start start 2024-05-08T06:59:50.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.483+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62f800 0x56271f62fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.483+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f629d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.484+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f62a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.484+0000 7f53b3875b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56271f573bb0 con 0x56271f62a350 2024-05-08T06:59:50.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.484+0000 7f53b3875b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56271f5118f0 con 0x56271f630120 2024-05-08T06:59:50.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.484+0000 7f53b3875b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56271f56fb70 con 0x56271f62f800 2024-05-08T06:59:50.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.484+0000 7f53a1e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f629d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.484+0000 7f53a1e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f629d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:40622/0 (socket says 172.21.15.70:40622) 2024-05-08T06:59:50.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.484+0000 7f53a1e00700 1 -- 172.21.15.70:0/2828876906 learned_addr learned my addr 172.21.15.70:0/2828876906 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:59:50.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.485+0000 7f539b400700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53880b2b20 0x7f53880b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.485+0000 7f5399400700 1 --2- 172.21.15.70:0/2828876906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f62a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.485+0000 7f53a1e00700 1 -- 172.21.15.70:0/2828876906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62f800 msgr2=0x56271f62fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:59:50.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.485+0000 7f53a1e00700 1 --2- 172.21.15.70:0/2828876906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62f800 0x56271f62fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.485+0000 7f53a1e00700 1 -- 172.21.15.70:0/2828876906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 msgr2=0x56271f62a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:59:50.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.485+0000 7f53a1e00700 1 --2- 172.21.15.70:0/2828876906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f62a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.485+0000 7f53a1e00700 1 -- 172.21.15.70:0/2828876906 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271f4c0a60 con 0x56271f630120 2024-05-08T06:59:50.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.485+0000 7f53a2800700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53880b2b20 0x7f53880b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.486+0000 7f539b400700 1 -- 172.21.15.70:0/3223031110 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 9583+0+0 (secure 0 0 0) 0x7f539c0e3730 con 0x7f53a41047f0 2024-05-08T06:59:50.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.486+0000 7f5399400700 1 --2- 172.21.15.70:0/2828876906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f62a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:59:50.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.486+0000 7f53a1e00700 1 --2- 172.21.15.70:0/2828876906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f629d30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5394009990 tx=0x7f5394009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c634b0efc1c90f87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:59:50.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.486+0000 7f5393400700 1 -- 172.21.15.70:0/2828876906 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394007500 con 0x56271f630120 2024-05-08T06:59:50.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.487+0000 7f5393400700 1 -- 172.21.15.70:0/2828876906 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f539401a070 con 0x56271f630120 2024-05-08T06:59:50.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.487+0000 7f5393400700 1 -- 172.21.15.70:0/2828876906 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53940157c0 con 0x56271f630120 2024-05-08T06:59:50.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 -- 172.21.15.70:0/2828876906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 msgr2=0x56271f629d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:50.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53a2800700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53880b2b20 0x7f53880b4fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f539c0a66a0 tx=0x7f539c009310 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:59:50.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 --2- 172.21.15.70:0/2828876906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f629d30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5394009990 tx=0x7f5394009ca0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 -- 172.21.15.70:0/2828876906 shutdown_connections 2024-05-08T06:59:50.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 --2- 172.21.15.70:0/2828876906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f62a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 --2- 172.21.15.70:0/2828876906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62f800 0x56271f62fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 --2- 172.21.15.70:0/2828876906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f629d30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 -- 172.21.15.70:0/2828876906 >> 172.21.15.70:0/2828876906 conn(0x56271f54fcf0 msgr2=0x56271f61c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:59:50.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 -- 172.21.15.70:0/2828876906 shutdown_connections 2024-05-08T06:59:50.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 -- 172.21.15.70:0/2828876906 wait complete. 2024-05-08T06:59:50.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.488+0000 7f53b3875b80 1 -- start start 2024-05-08T06:59:50.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.489+0000 7f53b3875b80 1 Processor -- start 2024-05-08T06:59:50.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.489+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f635e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.489+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f633200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.489+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f633740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.489+0000 7f53b3875b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56271f636c40 con 0x56271f62f800 2024-05-08T06:59:50.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.489+0000 7f53b3875b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56271f4d9cb0 con 0x56271f630120 2024-05-08T06:59:50.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.489+0000 7f53b3875b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56271f636dc0 con 0x56271f62a350 2024-05-08T06:59:50.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.489+0000 7f53b3875b80 10 client.0 _ll_register_callbacks cb 0x56271f51ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:59:50.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.490+0000 7f5399400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f635e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.490+0000 7f5399400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f635e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:45050/0 (socket says 172.21.15.70:45050) 2024-05-08T06:59:50.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.490+0000 7f5399400700 1 -- 172.21.15.70:0/1592150301 learned_addr learned my addr 172.21.15.70:0/1592150301 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:59:50.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.490+0000 7f5399400700 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f633740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.490+0000 7f53a1e00700 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f633200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.491+0000 7f5399400700 1 -- 172.21.15.70:0/1592150301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 msgr2=0x56271f633740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:59:50.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.491+0000 7f5399400700 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f633740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.491+0000 7f5399400700 1 -- 172.21.15.70:0/1592150301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 msgr2=0x56271f633200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:59:50.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.491+0000 7f5399400700 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f633200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.491+0000 7f5399400700 1 -- 172.21.15.70:0/1592150301 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56271f5395b0 con 0x56271f62a350 2024-05-08T06:59:50.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.492+0000 7f5399400700 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f635e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f538c005850 tx=0x7f538c00b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15946ea8b188cfa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:59:50.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.492+0000 7f5387e00700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T06:59:50.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.492+0000 7f5387e00700 1 -- 172.21.15.70:0/1592150301 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c011900 con 0x56271f62a350 2024-05-08T06:59:50.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.492+0000 7f53b3875b80 1 -- 172.21.15.70:0/1592150301 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f539401a070 con 0x56271f62a350 2024-05-08T06:59:50.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.492+0000 7f5387e00700 1 -- 172.21.15.70:0/1592150301 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9583+0+0 (secure 0 0 0) 0x7f538c011aa0 con 0x56271f62a350 2024-05-08T06:59:50.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.493+0000 7f5387e00700 1 -- 172.21.15.70:0/1592150301 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f538c011ca0 con 0x56271f62a350 2024-05-08T06:59:50.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.493+0000 7f53b3875b80 10 client.25258 fetch_fsmap learned FSMap version 28 2024-05-08T06:59:50.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.493+0000 7f53b3875b80 1 -- 172.21.15.70:0/1592150301 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56271f6414a0 con 0x56271f62a350 2024-05-08T06:59:50.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.493+0000 7f5387e00700 1 -- 172.21.15.70:0/1592150301 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f539401a070 con 0x56271f62a350 2024-05-08T06:59:50.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.494+0000 7f5387e00700 1 -- 172.21.15.70:0/1592150301 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f538c01f3c0 con 0x56271f62a350 2024-05-08T06:59:50.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.494+0000 7f53b3875b80 10 client.25258 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:59:50.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.494+0000 7f53b3875b80 10 client.25258 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:59:50.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.494+0000 7f53b3875b80 20 client.25258 populate_metadata read hostname 'smithi070' 2024-05-08T06:59:50.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.494+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56271f643a30 0x56271f645e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.494+0000 7f53b3875b80 4 client.25258 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:59:50.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.494+0000 7f53b3875b80 1 -- 172.21.15.70:0/1592150301 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56271f5ee230 con 0x56271f643a30 2024-05-08T06:59:50.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.494+0000 7f53a1e00700 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56271f643a30 0x56271f645e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.495+0000 7f53a1e00700 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56271f643a30 0x56271f645e20 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fb97f9437ea1ca server_cookie=f89552394441023e in_seq=0 out_seq=0 2024-05-08T06:59:50.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.495+0000 7f5387e00700 10 client.25258 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:59:50.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f5387e00700 1 -- 172.21.15.70:0/1592150301 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56271f5ee230 con 0x56271f643a30 2024-05-08T06:59:50.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f5387e00700 10 client.25258 handle_command_reply: tid=0 2024-05-08T06:59:50.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f53b3875b80 1 client.25258 shutdown 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f53b3875b80 1 -- 172.21.15.70:0/1592150301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 msgr2=0x56271f635e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f635e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f538c005850 tx=0x7f538c00b7a0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f53b3875b80 1 -- 172.21.15.70:0/1592150301 shutdown_connections 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56271f643a30 0x56271f645e20 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f633740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f635e60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1592150301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f633200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f5387e00700 0 client.25258 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.498+0000 7f53b3875b80 1 -- 172.21.15.70:0/1592150301 >> 172.21.15.70:0/1592150301 conn(0x56271f54fcf0 msgr2=0x56271f628d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.499+0000 7f53b3875b80 1 -- 172.21.15.70:0/1592150301 shutdown_connections 2024-05-08T06:59:50.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.499+0000 7f53b3875b80 1 -- 172.21.15.70:0/1592150301 wait complete. 2024-05-08T06:59:50.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.499+0000 7f53b3875b80 20 client.25258 trim_cache size 0 max 16384 2024-05-08T06:59:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:50 smithi194 ceph-mon[33679]: pgmap v415: 129 pgs: 129 active+clean; 470 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 2.0 MiB/s wr, 158 op/s 2024-05-08T06:59:50.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.526+0000 7f53b3875b80 1 Processor -- start 2024-05-08T06:59:50.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f53b3875b80 1 -- start start 2024-05-08T06:59:50.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f629d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f62f800 0x56271f62d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f630120 0x56271f64b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f53b3875b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41af8d0 con 0x56271f62a350 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f53b3875b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41ad160 con 0x56271f62f800 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f53b3875b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41aafd0 con 0x56271f630120 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f5399400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f629d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f5399400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f629d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38918/0 (socket says 172.21.15.70:38918) 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.527+0000 7f5399400700 1 -- 172.21.15.70:0/4087108429 learned_addr learned my addr 172.21.15.70:0/4087108429 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.528+0000 7f5399400700 1 -- 172.21.15.70:0/4087108429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f630120 msgr2=0x56271f64b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.528+0000 7f5399400700 1 --2- 172.21.15.70:0/4087108429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f630120 0x56271f64b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.528+0000 7f5399400700 1 -- 172.21.15.70:0/4087108429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f62f800 msgr2=0x56271f62d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:59:50.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.528+0000 7f5399400700 1 --2- 172.21.15.70:0/4087108429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f62f800 0x56271f62d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.528+0000 7f5399400700 1 -- 172.21.15.70:0/4087108429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56271f6412b0 con 0x56271f62a350 2024-05-08T06:59:50.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.528+0000 7f5399400700 1 --2- 172.21.15.70:0/4087108429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f629d20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f538c00b770 tx=0x7f538c005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e56b75b84fe44e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:59:50.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.528+0000 7f5392a00700 1 -- 172.21.15.70:0/4087108429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c00bcc0 con 0x56271f62a350 2024-05-08T06:59:50.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.528+0000 7f5392a00700 1 -- 172.21.15.70:0/4087108429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f538c02e020 con 0x56271f62a350 2024-05-08T06:59:50.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.529+0000 7f5392a00700 1 -- 172.21.15.70:0/4087108429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c01f580 con 0x56271f62a350 2024-05-08T06:59:50.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.529+0000 7f53b3875b80 1 -- 172.21.15.70:0/4087108429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 msgr2=0x56271f629d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:59:50.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.529+0000 7f53b3875b80 1 --2- 172.21.15.70:0/4087108429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f629d20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f538c00b770 tx=0x7f538c005950 comp rx=0 tx=0).stop 2024-05-08T06:59:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.530+0000 7f53b3875b80 1 -- 172.21.15.70:0/4087108429 shutdown_connections 2024-05-08T06:59:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.530+0000 7f53b3875b80 1 --2- 172.21.15.70:0/4087108429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f630120 0x56271f64b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.530+0000 7f53b3875b80 1 --2- 172.21.15.70:0/4087108429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62a350 0x56271f629d20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.530+0000 7f53b3875b80 1 --2- 172.21.15.70:0/4087108429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f62f800 0x56271f62d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.530+0000 7f53b3875b80 1 -- 172.21.15.70:0/4087108429 >> 172.21.15.70:0/4087108429 conn(0x56271f54fcf0 msgr2=0x56271f62d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:59:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.530+0000 7f53b3875b80 1 -- 172.21.15.70:0/4087108429 shutdown_connections 2024-05-08T06:59:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.530+0000 7f53b3875b80 1 -- 172.21.15.70:0/4087108429 wait complete. 2024-05-08T06:59:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.531+0000 7f53b3875b80 1 -- start start 2024-05-08T06:59:50.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.531+0000 7f53b3875b80 1 Processor -- start 2024-05-08T06:59:50.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f639240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f639780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53b3875b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f6ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53b3875b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41ab620 con 0x56271f62f800 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53b3875b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41aca90 con 0x56271f630120 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53b3875b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53a41abcf0 con 0x56271f62a350 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53b3875b80 10 client.0 _ll_register_callbacks cb 0x56271f51ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53a1e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f639780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53a1e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f639780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38920/0 (socket says 172.21.15.70:38920) 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f53a1e00700 1 -- 172.21.15.70:0/1636611411 learned_addr learned my addr 172.21.15.70:0/1636611411 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f5399400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f639240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.532+0000 7f5399400700 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f6ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.533+0000 7f53a1e00700 1 -- 172.21.15.70:0/1636611411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 msgr2=0x56271f639240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:59:50.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.533+0000 7f53a1e00700 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f639240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.533+0000 7f53a1e00700 1 -- 172.21.15.70:0/1636611411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 msgr2=0x56271f6ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:59:50.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.533+0000 7f53a1e00700 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f6ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:59:50.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.533+0000 7f53a1e00700 1 -- 172.21.15.70:0/1636611411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56271f6ae7f0 con 0x56271f62f800 2024-05-08T06:59:50.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.533+0000 7f5399400700 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f6ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:59:50.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.533+0000 7f53a1e00700 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f639780 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5394000f80 tx=0x7f53940094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de597d1810e66f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:59:50.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.533+0000 7f5387e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T06:59:50.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.534+0000 7f5387e00700 1 -- 172.21.15.70:0/1636611411 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539402e060 con 0x56271f62f800 2024-05-08T06:59:50.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.534+0000 7f53b3875b80 1 -- 172.21.15.70:0/1636611411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f538c02e020 con 0x56271f62f800 2024-05-08T06:59:50.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.534+0000 7f5387e00700 1 -- 172.21.15.70:0/1636611411 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(107..107 src has 1..107) ==== 9583+0+0 (secure 0 0 0) 0x7f5394028330 con 0x56271f62f800 2024-05-08T06:59:50.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.534+0000 7f5387e00700 1 -- 172.21.15.70:0/1636611411 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5394028530 con 0x56271f62f800 2024-05-08T06:59:50.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.534+0000 7f53b3875b80 10 client.15816 fetch_fsmap learned FSMap version 28 2024-05-08T06:59:50.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.534+0000 7f53b3875b80 1 -- 172.21.15.70:0/1636611411 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56271f6afa00 con 0x56271f62f800 2024-05-08T06:59:50.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.535+0000 7f5387e00700 1 -- 172.21.15.70:0/1636611411 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f538c02e020 con 0x56271f62f800 2024-05-08T06:59:50.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.535+0000 7f5387e00700 1 -- 172.21.15.70:0/1636611411 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f5394007a20 con 0x56271f62f800 2024-05-08T06:59:50.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.535+0000 7f53b3875b80 10 client.15816 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T06:59:50.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.535+0000 7f53b3875b80 10 client.15816 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T06:59:50.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.535+0000 7f53b3875b80 20 client.15816 populate_metadata read hostname 'smithi070' 2024-05-08T06:59:50.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.535+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56271f6aff00 0x56271f6b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:59:50.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.535+0000 7f53b3875b80 4 client.15816 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.35, "await_for": 42.0}] 2024-05-08T06:59:50.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.535+0000 7f53b3875b80 1 -- 172.21.15.70:0/1636611411 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.35, "await_for": 42.0}) -- 0x56271f581590 con 0x56271f6aff00 2024-05-08T06:59:50.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.536+0000 7f5399400700 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56271f6aff00 0x56271f6b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:59:50.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.536+0000 7f5399400700 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56271f6aff00 0x56271f6b2320 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc87f347b0cd4b74 server_cookie=f0b2be3a0b0673cc in_seq=0 out_seq=0 2024-05-08T06:59:50.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T06:59:50.536+0000 7f5387e00700 10 client.15816 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T06:59:50.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:50 smithi172 ceph-mon[33377]: pgmap v415: 129 pgs: 129 active+clean; 470 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 2.0 MiB/s wr, 158 op/s 2024-05-08T06:59:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:52 smithi194 ceph-mon[33679]: pgmap v416: 129 pgs: 129 active+clean; 470 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-08T06:59:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:52 smithi070 ceph-mon[29591]: pgmap v416: 129 pgs: 129 active+clean; 470 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-08T06:59:52.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:52 smithi172 ceph-mon[33377]: pgmap v416: 129 pgs: 129 active+clean; 470 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-08T06:59:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:54 smithi194 ceph-mon[33679]: pgmap v417: 129 pgs: 129 active+clean; 470 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-08T06:59:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:54 smithi070 ceph-mon[29591]: pgmap v417: 129 pgs: 129 active+clean; 470 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-08T06:59:54.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:54 smithi172 ceph-mon[33377]: pgmap v417: 129 pgs: 129 active+clean; 470 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.3 MiB/s wr, 110 op/s 2024-05-08T06:59:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:56 smithi194 ceph-mon[33679]: pgmap v418: 129 pgs: 129 active+clean; 472 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-05-08T06:59:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:56 smithi070 ceph-mon[29591]: pgmap v418: 129 pgs: 129 active+clean; 472 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-05-08T06:59:56.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:56 smithi172 ceph-mon[33377]: pgmap v418: 129 pgs: 129 active+clean; 472 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 1.5 MiB/s wr, 131 op/s 2024-05-08T06:59:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 06:59:58 smithi194 ceph-mon[33679]: pgmap v419: 129 pgs: 129 active+clean; 472 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 850 KiB/s wr, 79 op/s 2024-05-08T06:59:58.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 06:59:58 smithi070 ceph-mon[29591]: pgmap v419: 129 pgs: 129 active+clean; 472 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 850 KiB/s wr, 79 op/s 2024-05-08T06:59:58.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 06:59:58 smithi172 ceph-mon[33377]: pgmap v419: 129 pgs: 129 active+clean; 472 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 850 KiB/s wr, 79 op/s 2024-05-08T07:00:00.340 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:00 smithi070 ceph-mon[29591]: pgmap v420: 129 pgs: 129 active+clean; 473 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 958 KiB/s wr, 100 op/s 2024-05-08T07:00:00.341 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T07:00:00.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:00 smithi172 ceph-mon[33377]: pgmap v420: 129 pgs: 129 active+clean; 473 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 958 KiB/s wr, 100 op/s 2024-05-08T07:00:00.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T07:00:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:00 smithi194 ceph-mon[33679]: pgmap v420: 129 pgs: 129 active+clean; 473 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 958 KiB/s wr, 100 op/s 2024-05-08T07:00:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T07:00:00.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f5387e00700 1 -- 172.21.15.70:0/1636611411 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56271f581590 con 0x56271f6aff00 2024-05-08T07:00:00.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f5387e00700 10 client.15816 handle_command_reply: tid=0 2024-05-08T07:00:00.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f53b3875b80 1 client.15816 shutdown 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f53b3875b80 1 -- 172.21.15.70:0/1636611411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 msgr2=0x56271f639780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f639780 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f5394000f80 tx=0x7f53940094f0 comp rx=0 tx=0).stop 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f53b3875b80 1 -- 172.21.15.70:0/1636611411 shutdown_connections 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56271f6aff00 0x56271f6b2320 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56271f630120 0x56271f6ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56271f62a350 0x56271f639240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f53b3875b80 1 --2- 172.21.15.70:0/1636611411 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56271f62f800 0x56271f639780 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.898+0000 7f53b3875b80 1 -- 172.21.15.70:0/1636611411 >> 172.21.15.70:0/1636611411 conn(0x56271f54fcf0 msgr2=0x56271f6305c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.899+0000 7f5387e00700 0 client.15816 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.899+0000 7f53b3875b80 1 -- 172.21.15.70:0/1636611411 shutdown_connections 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.899+0000 7f53b3875b80 1 -- 172.21.15.70:0/1636611411 wait complete. 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.899+0000 7f53b3875b80 20 client.15816 trim_cache size 0 max 16384 2024-05-08T07:00:00.900 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 34, 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "71acb9de": { 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 34, 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.3, 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:00:00.901 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:00.902 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 -- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53880b2b20 msgr2=0x7f53880b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53880b2b20 0x7f53880b4fe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f539c0a66a0 tx=0x7f539c009310 comp rx=0 tx=0).stop 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 -- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 msgr2=0x7f53a419b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 0x7f53a419b810 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f539c005f50 tx=0x7f539c004790 comp rx=0 tx=0).stop 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 -- 172.21.15.70:0/3223031110 shutdown_connections 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53880b2b20 0x7f53880b4fe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53a41047f0 0x7f53a419b810 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53a4102540 0x7f53a41a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 --2- 172.21.15.70:0/3223031110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53a4103e30 0x7f53a41a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.900+0000 7f53a3200700 1 -- 172.21.15.70:0/3223031110 >> 172.21.15.70:0/3223031110 conn(0x7f53a40fdcf0 msgr2=0x7f53a406b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.901+0000 7f53a3200700 1 -- 172.21.15.70:0/3223031110 shutdown_connections 2024-05-08T07:00:00.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:00.901+0000 7f53a3200700 1 -- 172.21.15.70:0/3223031110 wait complete. 2024-05-08T07:00:01.879 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '71acb9de', quiesce took 19.6 seconds. Will release after: 20.35 2024-05-08T07:00:02.563 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:02 smithi194 ceph-mon[33679]: pgmap v421: 129 pgs: 129 active+clean; 473 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 290 KiB/s wr, 42 op/s 2024-05-08T07:00:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:02 smithi070 ceph-mon[29591]: pgmap v421: 129 pgs: 129 active+clean; 473 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 290 KiB/s wr, 42 op/s 2024-05-08T07:00:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:02 smithi172 ceph-mon[33377]: pgmap v421: 129 pgs: 129 active+clean; 473 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 290 KiB/s wr, 42 op/s 2024-05-08T07:00:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:04 smithi070 ceph-mon[29591]: pgmap v422: 129 pgs: 129 active+clean; 473 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 290 KiB/s wr, 42 op/s 2024-05-08T07:00:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:04 smithi172 ceph-mon[33377]: pgmap v422: 129 pgs: 129 active+clean; 473 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 290 KiB/s wr, 42 op/s 2024-05-08T07:00:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:04 smithi194 ceph-mon[33679]: pgmap v422: 129 pgs: 129 active+clean; 473 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 290 KiB/s wr, 42 op/s 2024-05-08T07:00:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:05 smithi070 ceph-mon[29591]: pgmap v423: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 349 KiB/s wr, 64 op/s 2024-05-08T07:00:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:05 smithi172 ceph-mon[33377]: pgmap v423: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 349 KiB/s wr, 64 op/s 2024-05-08T07:00:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:05 smithi194 ceph-mon[33679]: pgmap v423: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 349 KiB/s wr, 64 op/s 2024-05-08T07:00:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:08 smithi070 ceph-mon[29591]: pgmap v424: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 167 KiB/s wr, 43 op/s 2024-05-08T07:00:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:08 smithi172 ceph-mon[33377]: pgmap v424: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 167 KiB/s wr, 43 op/s 2024-05-08T07:00:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:08 smithi194 ceph-mon[33679]: pgmap v424: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 167 KiB/s wr, 43 op/s 2024-05-08T07:00:09.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:09 smithi172 ceph-mon[33377]: osdmap e108: 12 total, 12 up, 12 in 2024-05-08T07:00:09.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:09 smithi194 ceph-mon[33679]: osdmap e108: 12 total, 12 up, 12 in 2024-05-08T07:00:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:09 smithi070 ceph-mon[29591]: osdmap e108: 12 total, 12 up, 12 in 2024-05-08T07:00:10.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:10 smithi172 ceph-mon[33377]: pgmap v426: 129 pgs: 3 active+clean+snaptrim_wait, 125 active+clean, 1 active+clean+snaptrim; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-05-08T07:00:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:00:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:10 smithi194 ceph-mon[33679]: pgmap v426: 129 pgs: 3 active+clean+snaptrim_wait, 125 active+clean, 1 active+clean+snaptrim; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-05-08T07:00:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:00:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:10 smithi070 ceph-mon[29591]: pgmap v426: 129 pgs: 3 active+clean+snaptrim_wait, 125 active+clean, 1 active+clean+snaptrim; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-05-08T07:00:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:00:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:00:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:00:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:00:11.431 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:00:11.432 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:00:11.432 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:00:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:00:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:00:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:00:12.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:12 smithi172 ceph-mon[33377]: pgmap v427: 129 pgs: 3 active+clean+snaptrim_wait, 125 active+clean, 1 active+clean+snaptrim; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-05-08T07:00:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:12 smithi194 ceph-mon[33679]: pgmap v427: 129 pgs: 3 active+clean+snaptrim_wait, 125 active+clean, 1 active+clean+snaptrim; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-05-08T07:00:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:12 smithi070 ceph-mon[29591]: pgmap v427: 129 pgs: 3 active+clean+snaptrim_wait, 125 active+clean, 1 active+clean+snaptrim; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-05-08T07:00:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:14 smithi172 ceph-mon[33377]: pgmap v428: 129 pgs: 3 active+clean+snaptrim_wait, 125 active+clean, 1 active+clean+snaptrim; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-05-08T07:00:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:14 smithi194 ceph-mon[33679]: pgmap v428: 129 pgs: 3 active+clean+snaptrim_wait, 125 active+clean, 1 active+clean+snaptrim; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-05-08T07:00:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:14 smithi070 ceph-mon[29591]: pgmap v428: 129 pgs: 3 active+clean+snaptrim_wait, 125 active+clean, 1 active+clean+snaptrim; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 84 KiB/s wr, 31 op/s 2024-05-08T07:00:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:16 smithi172 ceph-mon[33377]: pgmap v429: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:00:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:16 smithi194 ceph-mon[33679]: pgmap v429: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:00:16.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:16 smithi070 ceph-mon[29591]: pgmap v429: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:00:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:18 smithi070 ceph-mon[29591]: pgmap v430: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:00:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:18 smithi070 ceph-mon[29591]: osdmap e109: 12 total, 12 up, 12 in 2024-05-08T07:00:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:18 smithi172 ceph-mon[33377]: pgmap v430: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:00:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:18 smithi172 ceph-mon[33377]: osdmap e109: 12 total, 12 up, 12 in 2024-05-08T07:00:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:18 smithi194 ceph-mon[33679]: pgmap v430: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:00:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:18 smithi194 ceph-mon[33679]: osdmap e109: 12 total, 12 up, 12 in 2024-05-08T07:00:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:19 smithi070 ceph-mon[29591]: pgmap v432: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:00:19.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:19 smithi172 ceph-mon[33377]: pgmap v432: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:00:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:19 smithi194 ceph-mon[33679]: pgmap v432: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:00:22.230 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:00:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:22 smithi172 ceph-mon[33377]: pgmap v433: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:00:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:22 smithi194 ceph-mon[33679]: pgmap v433: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:00:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:22 smithi070 ceph-mon[29591]: pgmap v433: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:00:22.668 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:00:24.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:24 smithi070 ceph-mon[29591]: pgmap v434: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:00:24.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:24 smithi172 ceph-mon[33377]: pgmap v434: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:00:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:24 smithi194 ceph-mon[33679]: pgmap v434: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.262+0000 7ff0fcc00700 1 -- 172.21.15.70:0/1658507672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f81055d0 msgr2=0x7ff0f8105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.262+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/1658507672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f81055d0 0x7ff0f8105a50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4009990 tx=0x7ff0e4009ca0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.262+0000 7ff0fcc00700 1 -- 172.21.15.70:0/1658507672 shutdown_connections 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.262+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/1658507672 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0f8105f90 0x7ff0f81124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.262+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/1658507672 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f810b660 0x7ff0f810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.262+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/1658507672 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f81055d0 0x7ff0f8105a50 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.262+0000 7ff0fcc00700 1 -- 172.21.15.70:0/1658507672 >> 172.21.15.70:0/1658507672 conn(0x7ff0f81010c0 msgr2=0x7ff0f81034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.263+0000 7ff0fcc00700 1 -- 172.21.15.70:0/1658507672 shutdown_connections 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.263+0000 7ff0fcc00700 1 -- 172.21.15.70:0/1658507672 wait complete. 2024-05-08T07:00:25.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.264+0000 7ff0fcc00700 1 Processor -- start 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.264+0000 7ff0fcc00700 1 -- start start 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.264+0000 7ff0fcc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f81055d0 0x7ff0f81a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.264+0000 7ff0fcc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0f8105f90 0x7ff0f81a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.264+0000 7ff0fcc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f810b660 0x7ff0f819b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.264+0000 7ff0fcc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f81156b0 con 0x7ff0f810b660 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.264+0000 7ff0fcc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f8115530 con 0x7ff0f81055d0 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.264+0000 7ff0fcc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f8115830 con 0x7ff0f8105f90 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f810b660 0x7ff0f819b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f810b660 0x7ff0f819b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50534/0 (socket says 172.21.15.70:50534) 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f7e00700 1 -- 172.21.15.70:0/3411725582 learned_addr learned my addr 172.21.15.70:0/3411725582 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f7400700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f81055d0 0x7ff0f81a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:25.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f6a00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0f8105f90 0x7ff0f81a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f7e00700 1 -- 172.21.15.70:0/3411725582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0f8105f90 msgr2=0x7ff0f81a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f7e00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0f8105f90 0x7ff0f81a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f7e00700 1 -- 172.21.15.70:0/3411725582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f81055d0 msgr2=0x7ff0f81a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f7e00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f81055d0 0x7ff0f81a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.265+0000 7ff0f7e00700 1 -- 172.21.15.70:0/3411725582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f819c0d0 con 0x7ff0f810b660 2024-05-08T07:00:25.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.266+0000 7ff0f7e00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f810b660 0x7ff0f819b970 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0007ee0 tx=0x7ff0f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:25.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.266+0000 7ff0efe00700 1 -- 172.21.15.70:0/3411725582 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000dbd0 con 0x7ff0f810b660 2024-05-08T07:00:25.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.266+0000 7ff0efe00700 1 -- 172.21.15.70:0/3411725582 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0f000dd70 con 0x7ff0f810b660 2024-05-08T07:00:25.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.266+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f819c3c0 con 0x7ff0f810b660 2024-05-08T07:00:25.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.266+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f81a8680 con 0x7ff0f810b660 2024-05-08T07:00:25.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.266+0000 7ff0efe00700 1 -- 172.21.15.70:0/3411725582 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f00058f0 con 0x7ff0f810b660 2024-05-08T07:00:25.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.267+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f806a190 con 0x7ff0f810b660 2024-05-08T07:00:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.270+0000 7ff0efe00700 1 -- 172.21.15.70:0/3411725582 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff0f001a020 con 0x7ff0f810b660 2024-05-08T07:00:25.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.271+0000 7ff0efe00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0dc0b29f0 0x7ff0dc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.272+0000 7ff0efe00700 1 -- 172.21.15.70:0/3411725582 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9583+0+0 (secure 0 0 0) 0x7ff0f00e29b0 con 0x7ff0f810b660 2024-05-08T07:00:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.272+0000 7ff0f7400700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0dc0b29f0 0x7ff0dc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.272+0000 7ff0f7400700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0dc0b29f0 0x7ff0dc0b4eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8005950 tx=0x7ff0e80058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.276+0000 7ff0efe00700 1 -- 172.21.15.70:0/3411725582 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff0f0010070 con 0x7ff0f810b660 2024-05-08T07:00:25.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.561+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0f802e510 con 0x7ff0f810b660 2024-05-08T07:00:25.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.562+0000 7ff0efe00700 1 -- 172.21.15.70:0/3411725582 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7ff0f00a9f10 con 0x7ff0f810b660 2024-05-08T07:00:25.561 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:00:25.562 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:00:25.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0dc0b29f0 msgr2=0x7ff0dc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0dc0b29f0 0x7ff0dc0b4eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8005950 tx=0x7ff0e80058e0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f810b660 msgr2=0x7ff0f819b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f810b660 0x7ff0f819b970 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0007ee0 tx=0x7ff0f000d3b0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 shutdown_connections 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0dc0b29f0 0x7ff0dc0b4eb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0f810b660 0x7ff0f819b970 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff0f81055d0 0x7ff0f81a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 --2- 172.21.15.70:0/3411725582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff0f8105f90 0x7ff0f81a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.565+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 >> 172.21.15.70:0/3411725582 conn(0x7ff0f81010c0 msgr2=0x7ff0f8102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.566+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 shutdown_connections 2024-05-08T07:00:25.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:25.566+0000 7ff0fcc00700 1 -- 172.21.15.70:0/3411725582 wait complete. 2024-05-08T07:00:25.566 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:00:26.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:26 smithi070 ceph-mon[29591]: pgmap v435: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-05-08T07:00:26.416 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:26 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3411725582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:00:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:26 smithi172 ceph-mon[33377]: pgmap v435: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-05-08T07:00:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:26 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3411725582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:00:26.467 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 71acb9de --release --await' 2024-05-08T07:00:26.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 71acb9de --release --await 2024-05-08T07:00:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:26 smithi194 ceph-mon[33679]: pgmap v435: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-05-08T07:00:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:26 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3411725582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:00:26.911 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:00:28.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:28 smithi070 ceph-mon[29591]: pgmap v436: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-05-08T07:00:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:28 smithi172 ceph-mon[33377]: pgmap v436: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-05-08T07:00:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:28 smithi194 ceph-mon[33679]: pgmap v436: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.8 KiB/s wr, 6 op/s 2024-05-08T07:00:29.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.318+0000 7fafd3e00700 1 -- 172.21.15.70:0/2260889865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc10b6c0 msgr2=0x7fafcc10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:29.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.318+0000 7fafd3e00700 1 --2- 172.21.15.70:0/2260889865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc10b6c0 0x7fafcc10baa0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009990 tx=0x7fafc0009ca0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.318+0000 7fafd3e00700 1 -- 172.21.15.70:0/2260889865 shutdown_connections 2024-05-08T07:00:29.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.318+0000 7fafd3e00700 1 --2- 172.21.15.70:0/2260889865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafcc106080 0x7fafcc112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.318+0000 7fafd3e00700 1 --2- 172.21.15.70:0/2260889865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc10b6c0 0x7fafcc10baa0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.318+0000 7fafd3e00700 1 --2- 172.21.15.70:0/2260889865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc1056c0 0x7fafcc105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.318+0000 7fafd3e00700 1 -- 172.21.15.70:0/2260889865 >> 172.21.15.70:0/2260889865 conn(0x7fafcc1011b0 msgr2=0x7fafcc1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:29.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.318+0000 7fafd3e00700 1 -- 172.21.15.70:0/2260889865 shutdown_connections 2024-05-08T07:00:29.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.318+0000 7fafd3e00700 1 -- 172.21.15.70:0/2260889865 wait complete. 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.319+0000 7fafd3e00700 1 Processor -- start 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.319+0000 7fafd3e00700 1 -- start start 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc1056c0 0x7fafcc1a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafcc106080 0x7fafcc1a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd3e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc10b6c0 0x7fafcc19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd3e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc115750 con 0x7fafcc1056c0 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd3e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc1155d0 con 0x7fafcc106080 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd3e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc1158d0 con 0x7fafcc10b6c0 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc1056c0 0x7fafcc1a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc1056c0 0x7fafcc1a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41424/0 (socket says 172.21.15.70:41424) 2024-05-08T07:00:29.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd1400700 1 -- 172.21.15.70:0/1340017365 learned_addr learned my addr 172.21.15.70:0/1340017365 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:29.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd1e00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc10b6c0 0x7fafcc19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.320+0000 7fafd0a00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafcc106080 0x7fafcc1a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafd1400700 1 -- 172.21.15.70:0/1340017365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc10b6c0 msgr2=0x7fafcc19b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:29.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafd1400700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc10b6c0 0x7fafcc19b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafd1400700 1 -- 172.21.15.70:0/1340017365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafcc106080 msgr2=0x7fafcc1a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:29.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafd1400700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafcc106080 0x7fafcc1a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafd1400700 1 -- 172.21.15.70:0/1340017365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafcc19c0f0 con 0x7fafcc1056c0 2024-05-08T07:00:29.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafd0a00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafcc106080 0x7fafcc1a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:00:29.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafd1400700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc1056c0 0x7fafcc1a17d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fafc0000c00 tx=0x7fafc00047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:29.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafca000700 1 -- 172.21.15.70:0/1340017365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0027070 con 0x7fafcc1056c0 2024-05-08T07:00:29.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafca000700 1 -- 172.21.15.70:0/1340017365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafc000fdb0 con 0x7fafcc1056c0 2024-05-08T07:00:29.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafd3e00700 1 -- 172.21.15.70:0/1340017365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafcc19c380 con 0x7fafcc1056c0 2024-05-08T07:00:29.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.321+0000 7fafca000700 1 -- 172.21.15.70:0/1340017365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc00173f0 con 0x7fafcc1056c0 2024-05-08T07:00:29.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.322+0000 7fafd3e00700 1 -- 172.21.15.70:0/1340017365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafcc1a86a0 con 0x7fafcc1056c0 2024-05-08T07:00:29.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.325+0000 7fafca000700 1 -- 172.21.15.70:0/1340017365 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fafc002a070 con 0x7fafcc1056c0 2024-05-08T07:00:29.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.326+0000 7fafde812b80 1 Processor -- start 2024-05-08T07:00:29.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafde812b80 1 -- start start 2024-05-08T07:00:29.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafca000700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fafb40b2a70 0x7fafb40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafde812b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd7f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafde812b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd79c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafde812b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 0x55a02dd85f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafde812b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a02dccbb20 con 0x55a02dd79780 2024-05-08T07:00:29.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafde812b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a02dc69860 con 0x55a02dd7a140 2024-05-08T07:00:29.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafde812b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a02dcc7ae0 con 0x55a02dd7f1b0 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafca000700 1 -- 172.21.15.70:0/1340017365 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9583+0+0 (secure 0 0 0) 0x7fafc00e3b00 con 0x7fafcc1056c0 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafd1e00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fafb40b2a70 0x7fafb40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafd0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd79c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.327+0000 7fafd0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd79c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41440/0 (socket says 172.21.15.70:41440) 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd0a00700 1 -- 172.21.15.70:0/3966601604 learned_addr learned my addr 172.21.15.70:0/3966601604 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd1400700 1 --2- 172.21.15.70:0/3966601604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd7f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd1e00700 1 --2- 172.21.15.70:0/3966601604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 0x55a02dd85f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd0a00700 1 -- 172.21.15.70:0/3966601604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 msgr2=0x55a02dd7f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd0a00700 1 --2- 172.21.15.70:0/3966601604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd7f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd0a00700 1 -- 172.21.15.70:0/3966601604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 msgr2=0x55a02dd85f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd0a00700 1 --2- 172.21.15.70:0/3966601604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 0x55a02dd85f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd0a00700 1 -- 172.21.15.70:0/3966601604 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a02dc189d0 con 0x55a02dd79780 2024-05-08T07:00:29.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd1e00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fafb40b2a70 0x7fafb40b4f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fafc40126c0 tx=0x7fafc4012a80 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.328+0000 7fafd0a00700 1 --2- 172.21.15.70:0/3966601604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd79c00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fafb800bc80 tx=0x7fafb800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e2bae7d9322af2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.329+0000 7fafbea00700 1 -- 172.21.15.70:0/3966601604 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb800dd00 con 0x55a02dd79780 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.329+0000 7fafbea00700 1 -- 172.21.15.70:0/3966601604 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafb80178b0 con 0x55a02dd79780 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.329+0000 7fafbea00700 1 -- 172.21.15.70:0/3966601604 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb800f890 con 0x55a02dd79780 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 -- 172.21.15.70:0/3966601604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 msgr2=0x55a02dd79c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 --2- 172.21.15.70:0/3966601604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd79c00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fafb800bc80 tx=0x7fafb800bf90 comp rx=0 tx=0).stop 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 -- 172.21.15.70:0/3966601604 shutdown_connections 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 --2- 172.21.15.70:0/3966601604 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 0x55a02dd85f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 --2- 172.21.15.70:0/3966601604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd7f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 --2- 172.21.15.70:0/3966601604 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd79c00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 -- 172.21.15.70:0/3966601604 >> 172.21.15.70:0/3966601604 conn(0x55a02dcf17d0 msgr2=0x55a02dd74070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:29.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 -- 172.21.15.70:0/3966601604 shutdown_connections 2024-05-08T07:00:29.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 -- 172.21.15.70:0/3966601604 wait complete. 2024-05-08T07:00:29.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.330+0000 7fafde812b80 1 -- start start 2024-05-08T07:00:29.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.331+0000 7fafde812b80 1 Processor -- start 2024-05-08T07:00:29.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.331+0000 7fafde812b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd85b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.331+0000 7fafde812b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 0x55a02dd82f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.331+0000 7fafde812b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd83440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.331+0000 7fafde812b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a02dd86570 con 0x55a02dd79780 2024-05-08T07:00:29.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.331+0000 7fafde812b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a02dc31c20 con 0x55a02dd7a140 2024-05-08T07:00:29.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.331+0000 7fafde812b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a02dd866f0 con 0x55a02dd7f1b0 2024-05-08T07:00:29.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.331+0000 7fafde812b80 10 client.0 _ll_register_callbacks cb 0x55a02dc72d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.331+0000 7fafd1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd85b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafd1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd85b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41448/0 (socket says 172.21.15.70:41448) 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafd1400700 1 -- 172.21.15.70:0/2072134951 learned_addr learned my addr 172.21.15.70:0/2072134951 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafd0a00700 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 0x55a02dd82f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafd1400700 1 -- 172.21.15.70:0/2072134951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 msgr2=0x55a02dd83440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafd1400700 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd83440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafd1400700 1 -- 172.21.15.70:0/2072134951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 msgr2=0x55a02dd82f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafd1400700 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 0x55a02dd82f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafd1400700 1 -- 172.21.15.70:0/2072134951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a02dc91520 con 0x55a02dd79780 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafd1400700 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd85b60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fafc00098e0 tx=0x7fafc0022970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249187cd0a8fd111 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafb3400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.332+0000 7fafb3400700 1 -- 172.21.15.70:0/2072134951 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc00cd2c0 con 0x55a02dd79780 2024-05-08T07:00:29.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.333+0000 7fafb3400700 1 -- 172.21.15.70:0/2072134951 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9583+0+0 (secure 0 0 0) 0x7fafc008a4f0 con 0x55a02dd79780 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.333+0000 7fafde812b80 1 -- 172.21.15.70:0/2072134951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb80178b0 con 0x55a02dd79780 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.333+0000 7fafb3400700 1 -- 172.21.15.70:0/2072134951 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafc00c4050 con 0x55a02dd79780 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.333+0000 7fafde812b80 10 client.15834 fetch_fsmap learned FSMap version 28 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.333+0000 7fafde812b80 1 -- 172.21.15.70:0/2072134951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a02dd90d70 con 0x55a02dd79780 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.333+0000 7fafb3400700 1 -- 172.21.15.70:0/2072134951 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafb80178b0 con 0x55a02dd79780 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.333+0000 7fafb3400700 1 -- 172.21.15.70:0/2072134951 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fafc00aac50 con 0x55a02dd79780 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.333+0000 7fafde812b80 10 client.15834 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.333+0000 7fafde812b80 10 client.15834 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.334+0000 7fafde812b80 20 client.15834 populate_metadata read hostname 'smithi070' 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.334+0000 7fafde812b80 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a02dd93410 0x55a02dd958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.334+0000 7fafde812b80 4 client.15834 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.334+0000 7fafde812b80 1 -- 172.21.15.70:0/2072134951 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a02dd46240 con 0x55a02dd93410 2024-05-08T07:00:29.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.334+0000 7fafd0a00700 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a02dd93410 0x55a02dd958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.335+0000 7fafd0a00700 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a02dd93410 0x55a02dd958b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3cfa60c5c017ccf server_cookie=c927f34c170f96cb in_seq=0 out_seq=0 2024-05-08T07:00:29.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.335+0000 7fafb3400700 10 client.15834 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:00:29.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.337+0000 7fafb3400700 1 -- 172.21.15.70:0/2072134951 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a02dd46240 con 0x55a02dd93410 2024-05-08T07:00:29.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.337+0000 7fafb3400700 10 client.15834 handle_command_reply: tid=0 2024-05-08T07:00:29.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 client.15834 shutdown 2024-05-08T07:00:29.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 -- 172.21.15.70:0/2072134951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 msgr2=0x55a02dd85b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd85b60 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fafc00098e0 tx=0x7fafc0022970 comp rx=0 tx=0).stop 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 -- 172.21.15.70:0/2072134951 shutdown_connections 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a02dd93410 0x55a02dd958b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd83440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd85b60 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 --2- 172.21.15.70:0/2072134951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7a140 0x55a02dd82f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 -- 172.21.15.70:0/2072134951 >> 172.21.15.70:0/2072134951 conn(0x55a02dcf17d0 msgr2=0x55a02dd6eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafb3400700 0 client.15834 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 -- 172.21.15.70:0/2072134951 shutdown_connections 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 1 -- 172.21.15.70:0/2072134951 wait complete. 2024-05-08T07:00:29.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.338+0000 7fafde812b80 20 client.15834 trim_cache size 0 max 16384 2024-05-08T07:00:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafde812b80 1 Processor -- start 2024-05-08T07:00:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafde812b80 1 -- start start 2024-05-08T07:00:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafde812b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd79780 0x55a02dd8f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafde812b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd7a140 0x55a02dd6e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafde812b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd9b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafde812b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc1b3e30 con 0x55a02dd7a140 2024-05-08T07:00:29.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafde812b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc1b16c0 con 0x55a02dd79780 2024-05-08T07:00:29.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafde812b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc1af530 con 0x55a02dd7f1b0 2024-05-08T07:00:29.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafd0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd7a140 0x55a02dd6e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafd0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd7a140 0x55a02dd6e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41458/0 (socket says 172.21.15.70:41458) 2024-05-08T07:00:29.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.360+0000 7fafd0a00700 1 -- 172.21.15.70:0/4183007288 learned_addr learned my addr 172.21.15.70:0/4183007288 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafd1400700 1 --2- 172.21.15.70:0/4183007288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd79780 0x55a02dd8f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafd0a00700 1 -- 172.21.15.70:0/4183007288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 msgr2=0x55a02dd9b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafd0a00700 1 --2- 172.21.15.70:0/4183007288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd9b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafd0a00700 1 -- 172.21.15.70:0/4183007288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd79780 msgr2=0x55a02dd8f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafd0a00700 1 --2- 172.21.15.70:0/4183007288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd79780 0x55a02dd8f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafd0a00700 1 -- 172.21.15.70:0/4183007288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a02dd70c70 con 0x55a02dd7a140 2024-05-08T07:00:29.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafd0a00700 1 --2- 172.21.15.70:0/4183007288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd7a140 0x55a02dd6e9c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fafb800bc80 tx=0x7fafb800bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ea2003c211116e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafbe000700 1 -- 172.21.15.70:0/4183007288 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb800dd00 con 0x55a02dd7a140 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafbe000700 1 -- 172.21.15.70:0/4183007288 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafb8025070 con 0x55a02dd7a140 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.361+0000 7fafbe000700 1 -- 172.21.15.70:0/4183007288 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8004a60 con 0x55a02dd7a140 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.362+0000 7fafde812b80 1 -- 172.21.15.70:0/4183007288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd7a140 msgr2=0x55a02dd6e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.362+0000 7fafde812b80 1 --2- 172.21.15.70:0/4183007288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd7a140 0x55a02dd6e9c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fafb800bc80 tx=0x7fafb800bc00 comp rx=0 tx=0).stop 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.362+0000 7fafde812b80 1 -- 172.21.15.70:0/4183007288 shutdown_connections 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.362+0000 7fafde812b80 1 --2- 172.21.15.70:0/4183007288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7f1b0 0x55a02dd9b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.362+0000 7fafde812b80 1 --2- 172.21.15.70:0/4183007288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd79780 0x55a02dd8f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.362+0000 7fafde812b80 1 --2- 172.21.15.70:0/4183007288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd7a140 0x55a02dd6e9c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.362+0000 7fafde812b80 1 -- 172.21.15.70:0/4183007288 >> 172.21.15.70:0/4183007288 conn(0x55a02dcf17d0 msgr2=0x55a02dd6e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.362+0000 7fafde812b80 1 -- 172.21.15.70:0/4183007288 shutdown_connections 2024-05-08T07:00:29.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.362+0000 7fafde812b80 1 -- 172.21.15.70:0/4183007288 wait complete. 2024-05-08T07:00:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.363+0000 7fafde812b80 1 -- start start 2024-05-08T07:00:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.363+0000 7fafde812b80 1 Processor -- start 2024-05-08T07:00:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.363+0000 7fafde812b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd86900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.363+0000 7fafde812b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7a140 0x55a02dd86e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.363+0000 7fafde812b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7f1b0 0x55a02dd87380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafde812b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc1afb80 con 0x55a02dd79780 2024-05-08T07:00:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafde812b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc1b0ff0 con 0x55a02dd7f1b0 2024-05-08T07:00:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafde812b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fafcc1b0250 con 0x55a02dd7a140 2024-05-08T07:00:29.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafde812b80 10 client.0 _ll_register_callbacks cb 0x55a02dc72d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd86900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd86900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41460/0 (socket says 172.21.15.70:41460) 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd1400700 1 -- 172.21.15.70:0/3325527829 learned_addr learned my addr 172.21.15.70:0/3325527829 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd0a00700 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7a140 0x55a02dd86e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd1400700 1 -- 172.21.15.70:0/3325527829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7a140 msgr2=0x55a02dd86e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd1e00700 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7f1b0 0x55a02dd87380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd1400700 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7a140 0x55a02dd86e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd1400700 1 -- 172.21.15.70:0/3325527829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7f1b0 msgr2=0x55a02dd87380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd1400700 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7f1b0 0x55a02dd87380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.364+0000 7fafd1400700 1 -- 172.21.15.70:0/3325527829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a02ddfde40 con 0x55a02dd79780 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.365+0000 7fafd1400700 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd86900 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fafc00aa980 tx=0x7fafc00852c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2d4ff2a9054582 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.365+0000 7fafb3400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.365+0000 7fafb3400700 1 -- 172.21.15.70:0/3325527829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0090060 con 0x55a02dd79780 2024-05-08T07:00:29.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.365+0000 7fafb3400700 1 -- 172.21.15.70:0/3325527829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9583+0+0 (secure 0 0 0) 0x7fafc00a6fe0 con 0x55a02dd79780 2024-05-08T07:00:29.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.365+0000 7fafde812b80 1 -- 172.21.15.70:0/3325527829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb8025070 con 0x55a02dd79780 2024-05-08T07:00:29.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.365+0000 7fafb3400700 1 -- 172.21.15.70:0/3325527829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fafc00aa500 con 0x55a02dd79780 2024-05-08T07:00:29.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.365+0000 7fafde812b80 10 client.15840 fetch_fsmap learned FSMap version 28 2024-05-08T07:00:29.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.365+0000 7fafde812b80 1 -- 172.21.15.70:0/3325527829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a02ddff190 con 0x55a02dd79780 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.365+0000 7fafb3400700 1 -- 172.21.15.70:0/3325527829 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafb8025070 con 0x55a02dd79780 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.366+0000 7fafb3400700 1 -- 172.21.15.70:0/3325527829 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fafc00a9c50 con 0x55a02dd79780 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.366+0000 7fafde812b80 10 client.15840 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.366+0000 7fafde812b80 10 client.15840 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.366+0000 7fafde812b80 20 client.15840 populate_metadata read hostname 'smithi070' 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.366+0000 7fafde812b80 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a02ddff710 0x55a02de01b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.366+0000 7fafde812b80 4 client.15840 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "71acb9de", "release": true, "await": true}] 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.366+0000 7fafde812b80 1 -- 172.21.15.70:0/3325527829 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "71acb9de", "release": true, "await": true}) -- 0x55a02dcd9500 con 0x55a02ddff710 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.366+0000 7fafd0a00700 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a02ddff710 0x55a02de01b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:29.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.367+0000 7fafd0a00700 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a02ddff710 0x55a02de01b30 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbfc1d83d9fde22c server_cookie=b6e4d10ef521e421 in_seq=0 out_seq=0 2024-05-08T07:00:29.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:29.367+0000 7fafb3400700 10 client.15840 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:00:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:30 smithi070 ceph-mon[29591]: pgmap v437: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T07:00:30.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:30 smithi172 ceph-mon[33377]: pgmap v437: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T07:00:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:30 smithi194 ceph-mon[33679]: pgmap v437: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T07:00:30.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.973+0000 7fafb3400700 1 -- 172.21.15.70:0/3325527829 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55a02dcd9500 con 0x55a02ddff710 2024-05-08T07:00:30.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.974+0000 7fafb3400700 10 client.15840 handle_command_reply: tid=0 2024-05-08T07:00:30.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.974+0000 7fafde812b80 1 client.15840 shutdown 2024-05-08T07:00:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.974+0000 7fafde812b80 1 -- 172.21.15.70:0/3325527829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 msgr2=0x55a02dd86900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.974+0000 7fafde812b80 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd86900 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fafc00aa980 tx=0x7fafc00852c0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.975+0000 7fafde812b80 1 -- 172.21.15.70:0/3325527829 shutdown_connections 2024-05-08T07:00:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.975+0000 7fafde812b80 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a02ddff710 0x55a02de01b30 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.975+0000 7fafde812b80 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a02dd7f1b0 0x55a02dd87380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.975+0000 7fafde812b80 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a02dd79780 0x55a02dd86900 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.975+0000 7fafde812b80 1 --2- 172.21.15.70:0/3325527829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a02dd7a140 0x55a02dd86e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.975+0000 7fafde812b80 1 -- 172.21.15.70:0/3325527829 >> 172.21.15.70:0/3325527829 conn(0x55a02dcf17d0 msgr2=0x55a02dd6eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.975+0000 7fafb3400700 0 client.15840 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:00:30.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.975+0000 7fafde812b80 1 -- 172.21.15.70:0/3325527829 shutdown_connections 2024-05-08T07:00:30.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.976+0000 7fafde812b80 1 -- 172.21.15.70:0/3325527829 wait complete. 2024-05-08T07:00:30.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.976+0000 7fafde812b80 20 client.15840 trim_cache size 0 max 16384 2024-05-08T07:00:30.976 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:00:30.976 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:00:30.976 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 36, 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "71acb9de": { 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 36, 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:00:30.977 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.3, 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:30.978 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:00:30.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 -- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fafb40b2a70 msgr2=0x7fafb40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:30.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fafb40b2a70 0x7fafb40b4f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fafc40126c0 tx=0x7fafc4012a80 comp rx=0 tx=0).stop 2024-05-08T07:00:30.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 -- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc1056c0 msgr2=0x7fafcc1a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:30.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc1056c0 0x7fafcc1a17d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fafc0000c00 tx=0x7fafc00047b0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 -- 172.21.15.70:0/1340017365 shutdown_connections 2024-05-08T07:00:30.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fafb40b2a70 0x7fafb40b4f30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafcc10b6c0 0x7fafcc19b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafcc1056c0 0x7fafcc1a17d0 secure :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fafc0000c00 tx=0x7fafc00047b0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 --2- 172.21.15.70:0/1340017365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafcc106080 0x7fafcc1a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:30.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.978+0000 7fafd3e00700 1 -- 172.21.15.70:0/1340017365 >> 172.21.15.70:0/1340017365 conn(0x7fafcc1011b0 msgr2=0x7fafcc1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:30.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.979+0000 7fafd3e00700 1 -- 172.21.15.70:0/1340017365 shutdown_connections 2024-05-08T07:00:30.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:30.979+0000 7fafd3e00700 1 -- 172.21.15.70:0/1340017365 wait complete. 2024-05-08T07:00:31.934 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '71acb9de', seconds elapsed: 49.6 2024-05-08T07:00:31.934 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-05-08T07:00:31.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:00:32.416 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:00:32.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:32 smithi172 ceph-mon[33377]: pgmap v438: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-05-08T07:00:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:32 smithi194 ceph-mon[33679]: pgmap v438: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-05-08T07:00:32.569 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:32 smithi070 ceph-mon[29591]: pgmap v438: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-05-08T07:00:34.364 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:34 smithi070 ceph-mon[29591]: pgmap v439: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-05-08T07:00:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:34 smithi194 ceph-mon[33679]: pgmap v439: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-05-08T07:00:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:34 smithi172 ceph-mon[33377]: pgmap v439: 129 pgs: 129 active+clean; 474 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-05-08T07:00:34.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.948+0000 7fc2b6a00700 1 -- 172.21.15.70:0/1666255774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104eb0 msgr2=0x7fc2b010d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:34.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.948+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/1666255774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104eb0 0x7fc2b010d3a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009990 tx=0x7fc29c009ca0 comp rx=0 tx=0).stop 2024-05-08T07:00:34.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.948+0000 7fc2b6a00700 1 -- 172.21.15.70:0/1666255774 shutdown_connections 2024-05-08T07:00:34.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.948+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/1666255774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b010d9c0 0x7fc2b010fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:34.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.948+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/1666255774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b0104590 0x7fc2b0104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:34.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.948+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/1666255774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104eb0 0x7fc2b010d3a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.948+0000 7fc2b6a00700 1 -- 172.21.15.70:0/1666255774 >> 172.21.15.70:0/1666255774 conn(0x7fc2b00fddc0 msgr2=0x7fc2b01001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.949+0000 7fc2b6a00700 1 -- 172.21.15.70:0/1666255774 shutdown_connections 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.949+0000 7fc2b6a00700 1 -- 172.21.15.70:0/1666255774 wait complete. 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.950+0000 7fc2b6a00700 1 Processor -- start 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.950+0000 7fc2b6a00700 1 -- start start 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.950+0000 7fc2b6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104590 0x7fc2b01a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.950+0000 7fc2b6a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b0104eb0 0x7fc2b01a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.950+0000 7fc2b6a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b010d9c0 0x7fc2b019bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.950+0000 7fc2b6a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b0102730 con 0x7fc2b0104590 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.950+0000 7fc2b6a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b01025b0 con 0x7fc2b010d9c0 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.950+0000 7fc2b6a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b01028b0 con 0x7fc2b0104eb0 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b5600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104590 0x7fc2b01a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b5600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104590 0x7fc2b01a18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41472/0 (socket says 172.21.15.70:41472) 2024-05-08T07:00:34.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b5600700 1 -- 172.21.15.70:0/447499969 learned_addr learned my addr 172.21.15.70:0/447499969 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b6000700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b010d9c0 0x7fc2b019bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b4c00700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b0104eb0 0x7fc2b01a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b5600700 1 -- 172.21.15.70:0/447499969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b0104eb0 msgr2=0x7fc2b01a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b5600700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b0104eb0 0x7fc2b01a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b5600700 1 -- 172.21.15.70:0/447499969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b010d9c0 msgr2=0x7fc2b019bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b5600700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b010d9c0 0x7fc2b019bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b5600700 1 -- 172.21.15.70:0/447499969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b019c880 con 0x7fc2b0104590 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.951+0000 7fc2b6000700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b010d9c0 0x7fc2b019bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.952+0000 7fc2b5600700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104590 0x7fc2b01a18d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400c9b0 tx=0x7fc2a400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.952+0000 7fc2ae000700 1 -- 172.21.15.70:0/447499969 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4007b00 con 0x7fc2b0104590 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.952+0000 7fc2ae000700 1 -- 172.21.15.70:0/447499969 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2a4007ca0 con 0x7fc2b0104590 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.952+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b019cb70 con 0x7fc2b0104590 2024-05-08T07:00:34.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.952+0000 7fc2ae000700 1 -- 172.21.15.70:0/447499969 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4018660 con 0x7fc2b0104590 2024-05-08T07:00:34.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.952+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b01a8850 con 0x7fc2b0104590 2024-05-08T07:00:34.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.954+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b006a190 con 0x7fc2b0104590 2024-05-08T07:00:34.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.957+0000 7fc2ae000700 1 -- 172.21.15.70:0/447499969 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc2a400f450 con 0x7fc2b0104590 2024-05-08T07:00:34.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.958+0000 7fc2ae000700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2980b29f0 0x7fc2980b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:34.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.959+0000 7fc2ae000700 1 -- 172.21.15.70:0/447499969 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9583+0+0 (secure 0 0 0) 0x7fc2a40e2e30 con 0x7fc2b0104590 2024-05-08T07:00:34.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.959+0000 7fc2b4c00700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2980b29f0 0x7fc2980b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:34.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.960+0000 7fc2b4c00700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2980b29f0 0x7fc2980b4eb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc2b010d2d0 tx=0x7fc29c01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:34.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:34.962+0000 7fc2ae000700 1 -- 172.21.15.70:0/447499969 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc2a4014030 con 0x7fc2b0104590 2024-05-08T07:00:35.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.312+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2b019cfa0 con 0x7fc2b0104590 2024-05-08T07:00:35.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.315+0000 7fc2ae000700 1 -- 172.21.15.70:0/447499969 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fc2a40aa420 con 0x7fc2b0104590 2024-05-08T07:00:35.314 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:00:35.314 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:00:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2980b29f0 msgr2=0x7fc2980b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:35.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2980b29f0 0x7fc2980b4eb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc2b010d2d0 tx=0x7fc29c01a040 comp rx=0 tx=0).stop 2024-05-08T07:00:35.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104590 msgr2=0x7fc2b01a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:35.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104590 0x7fc2b01a18d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400c9b0 tx=0x7fc2a400cd70 comp rx=0 tx=0).stop 2024-05-08T07:00:35.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 shutdown_connections 2024-05-08T07:00:35.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2980b29f0 0x7fc2980b4eb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:35.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc2b010d9c0 0x7fc2b019bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:35.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2b0104590 0x7fc2b01a18d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:35.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 --2- 172.21.15.70:0/447499969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2b0104eb0 0x7fc2b01a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:35.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.318+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 >> 172.21.15.70:0/447499969 conn(0x7fc2b00fddc0 msgr2=0x7fc2b010e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:35.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.319+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 shutdown_connections 2024-05-08T07:00:35.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:35.319+0000 7fc2b6a00700 1 -- 172.21.15.70:0/447499969 wait complete. 2024-05-08T07:00:35.320 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:00:36.274 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 80.35 --await-for 42.0' 2024-05-08T07:00:36.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 80.35 --await-for 42.0 2024-05-08T07:00:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:36 smithi194 ceph-mon[33679]: pgmap v440: 129 pgs: 129 active+clean; 481 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 619 KiB/s wr, 34 op/s 2024-05-08T07:00:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:36 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/447499969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:00:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:36 smithi070 ceph-mon[29591]: pgmap v440: 129 pgs: 129 active+clean; 481 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 619 KiB/s wr, 34 op/s 2024-05-08T07:00:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:36 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/447499969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:00:36.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:36 smithi172 ceph-mon[33377]: pgmap v440: 129 pgs: 129 active+clean; 481 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 619 KiB/s wr, 34 op/s 2024-05-08T07:00:36.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:36 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/447499969' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:00:36.739 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:00:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:38 smithi194 ceph-mon[33679]: pgmap v441: 129 pgs: 129 active+clean; 481 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 619 KiB/s wr, 31 op/s 2024-05-08T07:00:38.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:38 smithi070 ceph-mon[29591]: pgmap v441: 129 pgs: 129 active+clean; 481 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 619 KiB/s wr, 31 op/s 2024-05-08T07:00:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:38 smithi172 ceph-mon[33377]: pgmap v441: 129 pgs: 129 active+clean; 481 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 619 KiB/s wr, 31 op/s 2024-05-08T07:00:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.271+0000 7f07ddc00700 1 -- 172.21.15.70:0/3770790465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806bc10 msgr2=0x7f07d806bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.271+0000 7f07ddc00700 1 --2- 172.21.15.70:0/3770790465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806bc10 0x7f07d806bff0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009990 tx=0x7f07c8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.271+0000 7f07ddc00700 1 -- 172.21.15.70:0/3770790465 shutdown_connections 2024-05-08T07:00:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.271+0000 7f07ddc00700 1 --2- 172.21.15.70:0/3770790465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07d810ff30 0x7f07d8112320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.271+0000 7f07ddc00700 1 --2- 172.21.15.70:0/3770790465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806bc10 0x7f07d806bff0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.271+0000 7f07ddc00700 1 --2- 172.21.15.70:0/3770790465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07d806c530 0x7f07d810f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.271+0000 7f07ddc00700 1 -- 172.21.15.70:0/3770790465 >> 172.21.15.70:0/3770790465 conn(0x7f07d80793c0 msgr2=0x7f07d80797d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.271+0000 7f07ddc00700 1 -- 172.21.15.70:0/3770790465 shutdown_connections 2024-05-08T07:00:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.271+0000 7f07ddc00700 1 -- 172.21.15.70:0/3770790465 wait complete. 2024-05-08T07:00:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.272+0000 7f07ddc00700 1 Processor -- start 2024-05-08T07:00:39.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.272+0000 7f07ddc00700 1 -- start start 2024-05-08T07:00:39.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.273+0000 7f07ddc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07d806bc10 0x7f07d81a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.273+0000 7f07ddc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806c530 0x7f07d81a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.273+0000 7f07ddc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07d810ff30 0x7f07d819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.273+0000 7f07ddc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07d81157a0 con 0x7f07d806c530 2024-05-08T07:00:39.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.273+0000 7f07ddc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07d8115620 con 0x7f07d810ff30 2024-05-08T07:00:39.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.273+0000 7f07ddc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f07d8115920 con 0x7f07d806bc10 2024-05-08T07:00:39.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.273+0000 7f07d6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806c530 0x7f07d81a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.274+0000 7f07d6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806c530 0x7f07d81a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52670/0 (socket says 172.21.15.70:52670) 2024-05-08T07:00:39.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.274+0000 7f07d6000700 1 -- 172.21.15.70:0/802993901 learned_addr learned my addr 172.21.15.70:0/802993901 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:39.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.274+0000 7f07d7400700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07d810ff30 0x7f07d819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.274+0000 7f07d6a00700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07d806bc10 0x7f07d81a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.274+0000 7f07d6000700 1 -- 172.21.15.70:0/802993901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07d806bc10 msgr2=0x7f07d81a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.274+0000 7f07d6000700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07d806bc10 0x7f07d81a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.274+0000 7f07d6000700 1 -- 172.21.15.70:0/802993901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07d810ff30 msgr2=0x7f07d819bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.274+0000 7f07d6000700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07d810ff30 0x7f07d819bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.274+0000 7f07d6000700 1 -- 172.21.15.70:0/802993901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d819c220 con 0x7f07d806c530 2024-05-08T07:00:39.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.275+0000 7f07d6000700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806c530 0x7f07d81a1e40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f07c400d950 tx=0x7f07c400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:39.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.275+0000 7f07cf400700 1 -- 172.21.15.70:0/802993901 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4016070 con 0x7f07d806c530 2024-05-08T07:00:39.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.275+0000 7f07cf400700 1 -- 172.21.15.70:0/802993901 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07c400fd20 con 0x7f07d806c530 2024-05-08T07:00:39.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.275+0000 7f07cf400700 1 -- 172.21.15.70:0/802993901 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c400e3b0 con 0x7f07d806c530 2024-05-08T07:00:39.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.275+0000 7f07ddc00700 1 -- 172.21.15.70:0/802993901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07d819c510 con 0x7f07d806c530 2024-05-08T07:00:39.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.275+0000 7f07ddc00700 1 -- 172.21.15.70:0/802993901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07d81a87d0 con 0x7f07d806c530 2024-05-08T07:00:39.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.281+0000 7f07cf400700 1 -- 172.21.15.70:0/802993901 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f07c4019070 con 0x7f07d806c530 2024-05-08T07:00:39.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.281+0000 7f07e8504b80 1 Processor -- start 2024-05-08T07:00:39.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.282+0000 7f07e8504b80 1 -- start start 2024-05-08T07:00:39.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.282+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0b2f50 0x562aec0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.282+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 0x562aec0ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.282+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 0x562aec0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.282+0000 7f07e8504b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562aebfffbb0 con 0x562aec0b2f50 2024-05-08T07:00:39.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.282+0000 7f07e8504b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562aebf9d8f0 con 0x562aec0adee0 2024-05-08T07:00:39.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.282+0000 7f07e8504b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562aebffbb70 con 0x562aec0ad520 2024-05-08T07:00:39.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0b2f50 0x562aec0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0b2f50 0x562aec0b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52682/0 (socket says 172.21.15.70:52682) 2024-05-08T07:00:39.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d7400700 1 -- 172.21.15.70:0/3800158915 learned_addr learned my addr 172.21.15.70:0/3800158915 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:39.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d6000700 1 --2- 172.21.15.70:0/3800158915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 0x562aec0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d6a00700 1 --2- 172.21.15.70:0/3800158915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 0x562aec0ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d7400700 1 -- 172.21.15.70:0/3800158915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 msgr2=0x562aec0ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:39.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d7400700 1 --2- 172.21.15.70:0/3800158915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 0x562aec0ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d7400700 1 -- 172.21.15.70:0/3800158915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 msgr2=0x562aec0b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:39.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d7400700 1 --2- 172.21.15.70:0/3800158915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 0x562aec0b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.283+0000 7f07d7400700 1 -- 172.21.15.70:0/3800158915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aebf4ca60 con 0x562aec0b2f50 2024-05-08T07:00:39.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.284+0000 7f07cf400700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f07bc0b2b20 0x7f07bc0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.284+0000 7f07cf400700 1 -- 172.21.15.70:0/802993901 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9583+0+0 (secure 0 0 0) 0x7f07c40e24a0 con 0x7f07d806c530 2024-05-08T07:00:39.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.284+0000 7f07d7400700 1 --2- 172.21.15.70:0/3800158915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0b2f50 0x562aec0b3330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f07d0003f40 tx=0x7f07d0009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18387ccb68308fd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:39.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.284+0000 7f07d6a00700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f07bc0b2b20 0x7f07bc0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.285+0000 7f07c3e00700 1 -- 172.21.15.70:0/3800158915 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0004bb0 con 0x562aec0b2f50 2024-05-08T07:00:39.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.285+0000 7f07c3e00700 1 -- 172.21.15.70:0/3800158915 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07d0004d50 con 0x562aec0b2f50 2024-05-08T07:00:39.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07e8504b80 1 -- 172.21.15.70:0/3800158915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0b2f50 msgr2=0x562aec0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:39.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07d6a00700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f07bc0b2b20 0x7f07bc0b4fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f07d819cc00 tx=0x7f07c800b540 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:39.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3800158915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0b2f50 0x562aec0b3330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f07d0003f40 tx=0x7f07d0009ba0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.285+0000 7f07c3e00700 1 -- 172.21.15.70:0/3800158915 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d0007d30 con 0x562aec0b2f50 2024-05-08T07:00:39.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07e8504b80 1 -- 172.21.15.70:0/3800158915 shutdown_connections 2024-05-08T07:00:39.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3800158915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 0x562aec0b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3800158915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0b2f50 0x562aec0b3330 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3800158915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 0x562aec0ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07e8504b80 1 -- 172.21.15.70:0/3800158915 >> 172.21.15.70:0/3800158915 conn(0x562aebfdbcf0 msgr2=0x562aec0a7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07e8504b80 1 -- 172.21.15.70:0/3800158915 shutdown_connections 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.286+0000 7f07e8504b80 1 -- 172.21.15.70:0/3800158915 wait complete. 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.287+0000 7f07e8504b80 1 -- start start 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.287+0000 7f07e8504b80 1 Processor -- start 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0b9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 0x562aec0b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0b2f50 0x562aec0b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07e8504b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562aec0ba310 con 0x562aec0ad520 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07e8504b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562aebf65cb0 con 0x562aec0adee0 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07e8504b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562aec0ba490 con 0x562aec0b2f50 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07e8504b80 10 client.0 _ll_register_callbacks cb 0x562aebfa6e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07d6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0b9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07d6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0b9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52688/0 (socket says 172.21.15.70:52688) 2024-05-08T07:00:39.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07d6a00700 1 -- 172.21.15.70:0/153900782 learned_addr learned my addr 172.21.15.70:0/153900782 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:39.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.288+0000 7f07d6000700 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 0x562aec0b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07d7400700 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0b2f50 0x562aec0b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07d6a00700 1 -- 172.21.15.70:0/153900782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0b2f50 msgr2=0x562aec0b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:39.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07d6a00700 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0b2f50 0x562aec0b71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07d6a00700 1 -- 172.21.15.70:0/153900782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 msgr2=0x562aec0b6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:39.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07d6a00700 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 0x562aec0b6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07d6a00700 1 -- 172.21.15.70:0/153900782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aebfc55b0 con 0x562aec0ad520 2024-05-08T07:00:39.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07d6a00700 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0b9900 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009990 tx=0x7f07c8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8582098e263b12 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:39.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07c0c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:00:39.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07c0c00700 1 -- 172.21.15.70:0/153900782 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c8034060 con 0x562aec0ad520 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07c0c00700 1 -- 172.21.15.70:0/153900782 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9583+0+0 (secure 0 0 0) 0x7f07c800b7d0 con 0x562aec0ad520 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.289+0000 7f07e8504b80 1 -- 172.21.15.70:0/153900782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07d0004d50 con 0x562aec0ad520 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.290+0000 7f07c0c00700 1 -- 172.21.15.70:0/153900782 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f07c800b9d0 con 0x562aec0ad520 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.290+0000 7f07e8504b80 10 client.15858 fetch_fsmap learned FSMap version 28 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.290+0000 7f07e8504b80 1 -- 172.21.15.70:0/153900782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562aec0cd370 con 0x562aec0ad520 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.291+0000 7f07c0c00700 1 -- 172.21.15.70:0/153900782 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07d0004d50 con 0x562aec0ad520 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.291+0000 7f07c0c00700 1 -- 172.21.15.70:0/153900782 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f07c800fb90 con 0x562aec0ad520 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.291+0000 7f07e8504b80 10 client.15858 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.291+0000 7f07e8504b80 10 client.15858 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.291+0000 7f07e8504b80 20 client.15858 populate_metadata read hostname 'smithi070' 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.291+0000 7f07e8504b80 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562aec0cfa00 0x562aec0d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.291+0000 7f07e8504b80 4 client.15858 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:00:39.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.291+0000 7f07e8504b80 1 -- 172.21.15.70:0/153900782 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aec07a230 con 0x562aec0cfa00 2024-05-08T07:00:39.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.292+0000 7f07d6000700 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562aec0cfa00 0x562aec0d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.293+0000 7f07c0c00700 10 client.15858 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:00:39.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.293+0000 7f07d6000700 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562aec0cfa00 0x562aec0d1e70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8761541d702fbf70 server_cookie=63350c03d27cf184 in_seq=0 out_seq=0 2024-05-08T07:00:39.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.295+0000 7f07c0c00700 1 -- 172.21.15.70:0/153900782 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562aec07a230 con 0x562aec0cfa00 2024-05-08T07:00:39.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.295+0000 7f07c0c00700 10 client.15858 handle_command_reply: tid=0 2024-05-08T07:00:39.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 client.15858 shutdown 2024-05-08T07:00:39.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 -- 172.21.15.70:0/153900782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 msgr2=0x562aec0b9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:39.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0b9900 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f07c8009990 tx=0x7f07c8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 -- 172.21.15.70:0/153900782 shutdown_connections 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562aec0cfa00 0x562aec0d1e70 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0b2f50 0x562aec0b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0b9900 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 --2- 172.21.15.70:0/153900782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0adee0 0x562aec0b6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07c0c00700 0 client.15858 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 -- 172.21.15.70:0/153900782 >> 172.21.15.70:0/153900782 conn(0x562aebfdbcf0 msgr2=0x562aec0a28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 -- 172.21.15.70:0/153900782 shutdown_connections 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 1 -- 172.21.15.70:0/153900782 wait complete. 2024-05-08T07:00:39.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.296+0000 7f07e8504b80 20 client.15858 trim_cache size 0 max 16384 2024-05-08T07:00:39.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.325+0000 7f07e8504b80 1 Processor -- start 2024-05-08T07:00:39.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.325+0000 7f07e8504b80 1 -- start start 2024-05-08T07:00:39.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.325+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.325+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0adee0 0x562aec0a2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.325+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 0x562aec0a2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.325+0000 7f07e8504b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07d81afcb0 con 0x562aec0ad520 2024-05-08T07:00:39.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.325+0000 7f07e8504b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07d81ad540 con 0x562aec0b2f50 2024-05-08T07:00:39.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.325+0000 7f07e8504b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f07d81ab3b0 con 0x562aec0adee0 2024-05-08T07:00:39.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52702/0 (socket says 172.21.15.70:52702) 2024-05-08T07:00:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d6a00700 1 -- 172.21.15.70:0/3034661439 learned_addr learned my addr 172.21.15.70:0/3034661439 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d6000700 1 --2- 172.21.15.70:0/3034661439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0adee0 0x562aec0a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d7400700 1 --2- 172.21.15.70:0/3034661439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 0x562aec0a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d6a00700 1 -- 172.21.15.70:0/3034661439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0adee0 msgr2=0x562aec0a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:39.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d6a00700 1 --2- 172.21.15.70:0/3034661439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0adee0 0x562aec0a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d6a00700 1 -- 172.21.15.70:0/3034661439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 msgr2=0x562aec0a2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:39.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d6a00700 1 --2- 172.21.15.70:0/3034661439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 0x562aec0a2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.326+0000 7f07d6a00700 1 -- 172.21.15.70:0/3034661439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aec0b2920 con 0x562aec0ad520 2024-05-08T07:00:39.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.327+0000 7f07d6a00700 1 --2- 172.21.15.70:0/3034661439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0cbc80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f07c8003760 tx=0x7f07c8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5da69cbd549c74a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:39.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.327+0000 7f07c3400700 1 -- 172.21.15.70:0/3034661439 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c8034070 con 0x562aec0ad520 2024-05-08T07:00:39.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.327+0000 7f07c3400700 1 -- 172.21.15.70:0/3034661439 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07c800b7d0 con 0x562aec0ad520 2024-05-08T07:00:39.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.327+0000 7f07c3400700 1 -- 172.21.15.70:0/3034661439 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c800f6c0 con 0x562aec0ad520 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.328+0000 7f07e8504b80 1 -- 172.21.15.70:0/3034661439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 msgr2=0x562aec0cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.328+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3034661439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0cbc80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f07c8003760 tx=0x7f07c8009f90 comp rx=0 tx=0).stop 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.328+0000 7f07e8504b80 1 -- 172.21.15.70:0/3034661439 shutdown_connections 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.328+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3034661439 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 0x562aec0a2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.328+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3034661439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0ad520 0x562aec0cbc80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.328+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3034661439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0adee0 0x562aec0a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.328+0000 7f07e8504b80 1 -- 172.21.15.70:0/3034661439 >> 172.21.15.70:0/3034661439 conn(0x562aebfdbcf0 msgr2=0x562aec0b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.328+0000 7f07e8504b80 1 -- 172.21.15.70:0/3034661439 shutdown_connections 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.329+0000 7f07e8504b80 1 -- 172.21.15.70:0/3034661439 wait complete. 2024-05-08T07:00:39.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.329+0000 7f07e8504b80 1 -- start start 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.329+0000 7f07e8504b80 1 Processor -- start 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 0x562aec0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0adee0 0x562aec0c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07e8504b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 0x562aec0c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07e8504b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f07d81aba00 con 0x562aec0adee0 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07e8504b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07d81ace70 con 0x562aec0b2f50 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07e8504b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f07d81ac0d0 con 0x562aec0ad520 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07e8504b80 10 client.0 _ll_register_callbacks cb 0x562aebfa6e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07d6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0adee0 0x562aec0c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07d6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0adee0 0x562aec0c4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52708/0 (socket says 172.21.15.70:52708) 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.330+0000 7f07d6000700 1 -- 172.21.15.70:0/3892067045 learned_addr learned my addr 172.21.15.70:0/3892067045 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07d6a00700 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 0x562aec0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07d7400700 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 0x562aec0c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07d6000700 1 -- 172.21.15.70:0/3892067045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 msgr2=0x562aec0c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07d6000700 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 0x562aec0c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07d6000700 1 -- 172.21.15.70:0/3892067045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 msgr2=0x562aec0c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:00:39.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07d6000700 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 0x562aec0c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:39.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07d6000700 1 -- 172.21.15.70:0/3892067045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aec13a340 con 0x562aec0adee0 2024-05-08T07:00:39.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07d7400700 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 0x562aec0c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:00:39.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07d6000700 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0adee0 0x562aec0c4fd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f07c40dfdd0 tx=0x7f07c40a8ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b844c75f75ea4a4f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:00:39.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.331+0000 7f07c0c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:00:39.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.332+0000 7f07c0c00700 1 -- 172.21.15.70:0/3892067045 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4020040 con 0x562aec0adee0 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.332+0000 7f07c0c00700 1 -- 172.21.15.70:0/3892067045 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9583+0+0 (secure 0 0 0) 0x7f07c40a55f0 con 0x562aec0adee0 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.332+0000 7f07e8504b80 1 -- 172.21.15.70:0/3892067045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07c800b7d0 con 0x562aec0adee0 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.332+0000 7f07c0c00700 1 -- 172.21.15.70:0/3892067045 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f07c40a9a60 con 0x562aec0adee0 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07e8504b80 10 client.15864 fetch_fsmap learned FSMap version 28 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07e8504b80 1 -- 172.21.15.70:0/3892067045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562aec13b510 con 0x562aec0adee0 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07c0c00700 1 -- 172.21.15.70:0/3892067045 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07c800b7d0 con 0x562aec0adee0 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07c0c00700 1 -- 172.21.15.70:0/3892067045 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f07c40e2150 con 0x562aec0adee0 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07e8504b80 10 client.15864 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07e8504b80 10 client.15864 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07e8504b80 20 client.15864 populate_metadata read hostname 'smithi070' 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562aec13bc30 0x562aec13e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07e8504b80 4 client.15864 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.35, "await_for": 42.0}] 2024-05-08T07:00:39.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.333+0000 7f07e8504b80 1 -- 172.21.15.70:0/3892067045 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.35, "await_for": 42.0}) -- 0x562aec00d590 con 0x562aec13bc30 2024-05-08T07:00:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.334+0000 7f07d6a00700 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562aec13bc30 0x562aec13e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:00:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.336+0000 7f07d6a00700 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562aec13bc30 0x562aec13e050 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab7d04420b53be2c server_cookie=9f4b5de49cd7c223 in_seq=0 out_seq=0 2024-05-08T07:00:39.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:39.336+0000 7f07c0c00700 10 client.15864 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:00:40.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:40 smithi070 ceph-mon[29591]: pgmap v442: 129 pgs: 129 active+clean; 486 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2024-05-08T07:00:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:40 smithi194 ceph-mon[33679]: pgmap v442: 129 pgs: 129 active+clean; 486 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2024-05-08T07:00:40.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:40 smithi172 ceph-mon[33377]: pgmap v442: 129 pgs: 129 active+clean; 486 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.1 MiB/s wr, 68 op/s 2024-05-08T07:00:42.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:42 smithi172 ceph-mon[33377]: pgmap v443: 129 pgs: 129 active+clean; 486 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-05-08T07:00:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:42 smithi194 ceph-mon[33679]: pgmap v443: 129 pgs: 129 active+clean; 486 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-05-08T07:00:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:42 smithi070 ceph-mon[29591]: pgmap v443: 129 pgs: 129 active+clean; 486 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-05-08T07:00:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:44 smithi194 ceph-mon[33679]: pgmap v444: 129 pgs: 129 active+clean; 486 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-05-08T07:00:44.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:44 smithi070 ceph-mon[29591]: pgmap v444: 129 pgs: 129 active+clean; 486 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-05-08T07:00:44.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:44 smithi172 ceph-mon[33377]: pgmap v444: 129 pgs: 129 active+clean; 486 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 1.1 MiB/s wr, 65 op/s 2024-05-08T07:00:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:46 smithi194 ceph-mon[33679]: pgmap v445: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-05-08T07:00:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:46 smithi070 ceph-mon[29591]: pgmap v445: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-05-08T07:00:46.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:46 smithi172 ceph-mon[33377]: pgmap v445: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 1.2 MiB/s wr, 76 op/s 2024-05-08T07:00:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07c0c00700 1 -- 172.21.15.70:0/3892067045 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562aec00d590 con 0x562aec13bc30 2024-05-08T07:00:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07c0c00700 10 client.15864 handle_command_reply: tid=0 2024-05-08T07:00:48.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07e8504b80 1 client.15864 shutdown 2024-05-08T07:00:48.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07e8504b80 1 -- 172.21.15.70:0/3892067045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0adee0 msgr2=0x562aec0c4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:48.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0adee0 0x562aec0c4fd0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f07c40dfdd0 tx=0x7f07c40a8ad0 comp rx=0 tx=0).stop 2024-05-08T07:00:48.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07e8504b80 1 -- 172.21.15.70:0/3892067045 shutdown_connections 2024-05-08T07:00:48.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562aec13bc30 0x562aec13e050 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562aec0b2f50 0x562aec0c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562aec0ad520 0x562aec0c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07e8504b80 1 --2- 172.21.15.70:0/3892067045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562aec0adee0 0x562aec0c4fd0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07e8504b80 1 -- 172.21.15.70:0/3892067045 >> 172.21.15.70:0/3892067045 conn(0x562aebfdbcf0 msgr2=0x562aec0ac510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.027+0000 7f07c0c00700 0 client.15864 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:00:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.028+0000 7f07e8504b80 1 -- 172.21.15.70:0/3892067045 shutdown_connections 2024-05-08T07:00:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.028+0000 7f07e8504b80 1 -- 172.21.15.70:0/3892067045 wait complete. 2024-05-08T07:00:48.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.028+0000 7f07e8504b80 20 client.15864 trim_cache size 0 max 16384 2024-05-08T07:00:48.029 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:00:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:00:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:00:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 38, 2024-05-08T07:00:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:00:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "a7270084": { 2024-05-08T07:00:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 38, 2024-05-08T07:00:48.029 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.3, 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:48.030 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:48.031 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:00:48.031 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:00:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 -- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f07bc0b2b20 msgr2=0x7f07bc0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f07bc0b2b20 0x7f07bc0b4fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f07d819cc00 tx=0x7f07c800b540 comp rx=0 tx=0).stop 2024-05-08T07:00:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 -- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806c530 msgr2=0x7f07d81a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:00:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806c530 0x7f07d81a1e40 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f07c400d950 tx=0x7f07c400dc60 comp rx=0 tx=0).stop 2024-05-08T07:00:48.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 -- 172.21.15.70:0/802993901 shutdown_connections 2024-05-08T07:00:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f07bc0b2b20 0x7f07bc0b4fe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f07d810ff30 0x7f07d819bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07d806bc10 0x7f07d81a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 --2- 172.21.15.70:0/802993901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f07d806c530 0x7f07d81a1e40 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:00:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 -- 172.21.15.70:0/802993901 >> 172.21.15.70:0/802993901 conn(0x7f07d80793c0 msgr2=0x7f07d81114a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:00:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 -- 172.21.15.70:0/802993901 shutdown_connections 2024-05-08T07:00:48.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:00:48.030+0000 7f07ddc00700 1 -- 172.21.15.70:0/802993901 wait complete. 2024-05-08T07:00:48.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:48 smithi070 ceph-mon[29591]: pgmap v446: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 609 KiB/s wr, 47 op/s 2024-05-08T07:00:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:48 smithi194 ceph-mon[33679]: pgmap v446: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 609 KiB/s wr, 47 op/s 2024-05-08T07:00:48.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:48 smithi172 ceph-mon[33377]: pgmap v446: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 609 KiB/s wr, 47 op/s 2024-05-08T07:00:49.404 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a7270084', quiesce took 17.5 seconds. Will release after: 20.35 2024-05-08T07:00:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:50 smithi194 ceph-mon[33679]: pgmap v447: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 668 KiB/s wr, 54 op/s 2024-05-08T07:00:50.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:50 smithi070 ceph-mon[29591]: pgmap v447: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 668 KiB/s wr, 54 op/s 2024-05-08T07:00:50.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:50 smithi172 ceph-mon[33377]: pgmap v447: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 668 KiB/s wr, 54 op/s 2024-05-08T07:00:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:52 smithi194 ceph-mon[33679]: pgmap v448: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 205 KiB/s wr, 17 op/s 2024-05-08T07:00:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:52 smithi070 ceph-mon[29591]: pgmap v448: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 205 KiB/s wr, 17 op/s 2024-05-08T07:00:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:52 smithi172 ceph-mon[33377]: pgmap v448: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 205 KiB/s wr, 17 op/s 2024-05-08T07:00:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:54 smithi194 ceph-mon[33679]: pgmap v449: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 205 KiB/s wr, 17 op/s 2024-05-08T07:00:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:54 smithi070 ceph-mon[29591]: pgmap v449: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 205 KiB/s wr, 17 op/s 2024-05-08T07:00:54.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:54 smithi172 ceph-mon[33377]: pgmap v449: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 205 KiB/s wr, 17 op/s 2024-05-08T07:00:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:56 smithi194 ceph-mon[33679]: pgmap v450: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 208 KiB/s wr, 20 op/s 2024-05-08T07:00:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:56 smithi070 ceph-mon[29591]: pgmap v450: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 208 KiB/s wr, 20 op/s 2024-05-08T07:00:56.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:56 smithi172 ceph-mon[33377]: pgmap v450: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 208 KiB/s wr, 20 op/s 2024-05-08T07:00:58.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:00:58 smithi070 ceph-mon[29591]: pgmap v451: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-05-08T07:00:58.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:00:58 smithi172 ceph-mon[33377]: pgmap v451: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-05-08T07:00:58.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:00:58 smithi194 ceph-mon[33679]: pgmap v451: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 62 KiB/s wr, 9 op/s 2024-05-08T07:01:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:00 smithi070 ceph-mon[29591]: pgmap v452: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 12 op/s 2024-05-08T07:01:00.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:00 smithi172 ceph-mon[33377]: pgmap v452: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 12 op/s 2024-05-08T07:01:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:00 smithi194 ceph-mon[33679]: pgmap v452: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 68 KiB/s wr, 12 op/s 2024-05-08T07:01:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:02 smithi070 ceph-mon[29591]: pgmap v453: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 6 op/s 2024-05-08T07:01:02.827 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:02 smithi194 ceph-mon[33679]: pgmap v453: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 6 op/s 2024-05-08T07:01:02.827 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:02 smithi172 ceph-mon[33377]: pgmap v453: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 6 op/s 2024-05-08T07:01:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:04 smithi070 ceph-mon[29591]: pgmap v454: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 6 op/s 2024-05-08T07:01:04.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:04 smithi172 ceph-mon[33377]: pgmap v454: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 6 op/s 2024-05-08T07:01:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:04 smithi194 ceph-mon[33679]: pgmap v454: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.0 KiB/s wr, 6 op/s 2024-05-08T07:01:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:06 smithi070 ceph-mon[29591]: pgmap v455: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 26 op/s 2024-05-08T07:01:06.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:06 smithi172 ceph-mon[33377]: pgmap v455: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 26 op/s 2024-05-08T07:01:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:06 smithi194 ceph-mon[33679]: pgmap v455: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 26 op/s 2024-05-08T07:01:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:07 smithi070 ceph-mon[29591]: pgmap v456: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 52 KiB/s wr, 22 op/s 2024-05-08T07:01:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:07 smithi172 ceph-mon[33377]: pgmap v456: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 52 KiB/s wr, 22 op/s 2024-05-08T07:01:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:07 smithi194 ceph-mon[33679]: pgmap v456: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 52 KiB/s wr, 22 op/s 2024-05-08T07:01:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:09 smithi070 ceph-mon[29591]: osdmap e110: 12 total, 12 up, 12 in 2024-05-08T07:01:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:09 smithi070 ceph-mon[29591]: pgmap v458: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 63 KiB/s wr, 27 op/s 2024-05-08T07:01:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:09 smithi172 ceph-mon[33377]: osdmap e110: 12 total, 12 up, 12 in 2024-05-08T07:01:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:09 smithi172 ceph-mon[33377]: pgmap v458: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 63 KiB/s wr, 27 op/s 2024-05-08T07:01:09.755 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:01:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:09 smithi194 ceph-mon[33679]: osdmap e110: 12 total, 12 up, 12 in 2024-05-08T07:01:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:09 smithi194 ceph-mon[33679]: pgmap v458: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 63 KiB/s wr, 27 op/s 2024-05-08T07:01:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:01:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:01:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:01:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:01:12.306 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:12 smithi070 ceph-mon[29591]: pgmap v459: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 63 KiB/s wr, 27 op/s 2024-05-08T07:01:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:12 smithi194 ceph-mon[33679]: pgmap v459: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 63 KiB/s wr, 27 op/s 2024-05-08T07:01:12.580 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:12 smithi172 ceph-mon[33377]: pgmap v459: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 63 KiB/s wr, 27 op/s 2024-05-08T07:01:12.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.623+0000 7f68eba00700 1 -- 172.21.15.70:0/3511135520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e4109510 msgr2=0x7f68e41098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:12.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.623+0000 7f68eba00700 1 --2- 172.21.15.70:0/3511135520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e4109510 0x7f68e41098f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f68d8009990 tx=0x7f68d8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.623+0000 7f68eba00700 1 -- 172.21.15.70:0/3511135520 shutdown_connections 2024-05-08T07:01:12.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.623+0000 7f68eba00700 1 --2- 172.21.15.70:0/3511135520 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68e406bb40 0x7f68e4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.623+0000 7f68eba00700 1 --2- 172.21.15.70:0/3511135520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e4109510 0x7f68e41098f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.623+0000 7f68eba00700 1 --2- 172.21.15.70:0/3511135520 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68e406b180 0x7f68e406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.623+0000 7f68eba00700 1 -- 172.21.15.70:0/3511135520 >> 172.21.15.70:0/3511135520 conn(0x7f68e4079350 msgr2=0x7f68e4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:01:12.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.623+0000 7f68eba00700 1 -- 172.21.15.70:0/3511135520 shutdown_connections 2024-05-08T07:01:12.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.623+0000 7f68eba00700 1 -- 172.21.15.70:0/3511135520 wait complete. 2024-05-08T07:01:12.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.624+0000 7f68eba00700 1 Processor -- start 2024-05-08T07:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.624+0000 7f68eba00700 1 -- start start 2024-05-08T07:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68eba00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e406b180 0x7f68e4102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68eba00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68e406bb40 0x7f68e41029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68eba00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68e4109510 0x7f68e4102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68eba00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68e4113520 con 0x7f68e406b180 2024-05-08T07:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68eba00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f68e41133a0 con 0x7f68e4109510 2024-05-08T07:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68eba00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f68e41136a0 con 0x7f68e406bb40 2024-05-08T07:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68e9000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e406b180 0x7f68e4102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:12.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68e9000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e406b180 0x7f68e4102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43142/0 (socket says 172.21.15.70:43142) 2024-05-08T07:01:12.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68e9000700 1 -- 172.21.15.70:0/1177609151 learned_addr learned my addr 172.21.15.70:0/1177609151 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:01:12.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68e9a00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68e4109510 0x7f68e4102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:12.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.625+0000 7f68e3e00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68e406bb40 0x7f68e41029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:12.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.626+0000 7f68e9000700 1 -- 172.21.15.70:0/1177609151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68e406bb40 msgr2=0x7f68e41029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:12.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.626+0000 7f68e9000700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68e406bb40 0x7f68e41029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.626+0000 7f68e9000700 1 -- 172.21.15.70:0/1177609151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68e4109510 msgr2=0x7f68e4102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:12.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.626+0000 7f68e9000700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68e4109510 0x7f68e4102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.626+0000 7f68e9000700 1 -- 172.21.15.70:0/1177609151 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e41a8010 con 0x7f68e406b180 2024-05-08T07:01:12.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.626+0000 7f68e9000700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e406b180 0x7f68e4102470 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f68d8000c00 tx=0x7f68d80057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:01:12.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.626+0000 7f68e1600700 1 -- 172.21.15.70:0/1177609151 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8027070 con 0x7f68e406b180 2024-05-08T07:01:12.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.626+0000 7f68e1600700 1 -- 172.21.15.70:0/1177609151 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68d800fb00 con 0x7f68e406b180 2024-05-08T07:01:12.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.626+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e41a82a0 con 0x7f68e406b180 2024-05-08T07:01:12.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.627+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e41a86f0 con 0x7f68e406b180 2024-05-08T07:01:12.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.627+0000 7f68e1600700 1 -- 172.21.15.70:0/1177609151 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8022b70 con 0x7f68e406b180 2024-05-08T07:01:12.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.628+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e410b9f0 con 0x7f68e406b180 2024-05-08T07:01:12.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.630+0000 7f68e1600700 1 -- 172.21.15.70:0/1177609151 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f68d802a070 con 0x7f68e406b180 2024-05-08T07:01:12.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.631+0000 7f68e1600700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68cc0b28d0 0x7f68cc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:12.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.632+0000 7f68e1600700 1 -- 172.21.15.70:0/1177609151 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9583+0+0 (secure 0 0 0) 0x7f68d80e38f0 con 0x7f68e406b180 2024-05-08T07:01:12.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.632+0000 7f68e3e00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68cc0b28d0 0x7f68cc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:12.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.633+0000 7f68e3e00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68cc0b28d0 0x7f68cc0b4d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005950 tx=0x7f68d00058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:01:12.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.637+0000 7f68e1600700 1 -- 172.21.15.70:0/1177609151 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f68d8013070 con 0x7f68e406b180 2024-05-08T07:01:12.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.924+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68e4103950 con 0x7f68e406b180 2024-05-08T07:01:12.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.926+0000 7f68e1600700 1 -- 172.21.15.70:0/1177609151 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f68d80aaee0 con 0x7f68e406b180 2024-05-08T07:01:12.925 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:01:12.925 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:01:12.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68cc0b28d0 msgr2=0x7f68cc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:12.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68cc0b28d0 0x7f68cc0b4d90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f68d0005950 tx=0x7f68d00058e0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e406b180 msgr2=0x7f68e4102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e406b180 0x7f68e4102470 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f68d8000c00 tx=0x7f68d80057a0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 shutdown_connections 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68cc0b28d0 0x7f68cc0b4d90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68e4109510 0x7f68e4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e406b180 0x7f68e4102470 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 --2- 172.21.15.70:0/1177609151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68e406bb40 0x7f68e41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 >> 172.21.15.70:0/1177609151 conn(0x7f68e4079350 msgr2=0x7f68e41012f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 shutdown_connections 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:12.929+0000 7f68eba00700 1 -- 172.21.15.70:0/1177609151 wait complete. 2024-05-08T07:01:12.929 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:01:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:13 smithi070 ceph-mon[29591]: osdmap e111: 12 total, 12 up, 12 in 2024-05-08T07:01:13.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:01:13.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:01:13.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:01:13.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1177609151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:01:13.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:13 smithi070 ceph-mon[29591]: pgmap v461: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 4 op/s 2024-05-08T07:01:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:13 smithi172 ceph-mon[33377]: osdmap e111: 12 total, 12 up, 12 in 2024-05-08T07:01:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:01:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:01:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:01:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:13 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1177609151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:01:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:13 smithi172 ceph-mon[33377]: pgmap v461: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 4 op/s 2024-05-08T07:01:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:13 smithi194 ceph-mon[33679]: osdmap e111: 12 total, 12 up, 12 in 2024-05-08T07:01:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:01:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:01:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:01:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:13 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1177609151' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:01:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:13 smithi194 ceph-mon[33679]: pgmap v461: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 4 op/s 2024-05-08T07:01:13.836 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id a7270084 --release --await' 2024-05-08T07:01:13.836 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id a7270084 --release --await 2024-05-08T07:01:14.264 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:01:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:16 smithi172 ceph-mon[33377]: pgmap v462: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 8 op/s 2024-05-08T07:01:16.508 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:16 smithi070 ceph-mon[29591]: pgmap v462: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 8 op/s 2024-05-08T07:01:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:16 smithi194 ceph-mon[33679]: pgmap v462: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 8 op/s 2024-05-08T07:01:16.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.688+0000 7f4c2aa00700 1 -- 172.21.15.70:0/462214828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103f10 msgr2=0x7f4c241103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:16.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.688+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/462214828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103f10 0x7f4c241103a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00b0d0 tx=0x7f4c1c00b3e0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.689+0000 7f4c2aa00700 1 -- 172.21.15.70:0/462214828 shutdown_connections 2024-05-08T07:01:16.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.689+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/462214828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103f10 0x7f4c241103a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.689+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/462214828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c241095d0 0x7f4c241099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.689+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/462214828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c24103550 0x7f4c241039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.689+0000 7f4c2aa00700 1 -- 172.21.15.70:0/462214828 >> 172.21.15.70:0/462214828 conn(0x7f4c2407a5f0 msgr2=0x7f4c2407aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:01:16.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.689+0000 7f4c2aa00700 1 -- 172.21.15.70:0/462214828 shutdown_connections 2024-05-08T07:01:16.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.689+0000 7f4c2aa00700 1 -- 172.21.15.70:0/462214828 wait complete. 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.690+0000 7f4c2aa00700 1 Processor -- start 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.690+0000 7f4c2aa00700 1 -- start start 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.690+0000 7f4c2aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103550 0x7f4c241a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.690+0000 7f4c2aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c24103f10 0x7f4c241a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.690+0000 7f4c2aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c241095d0 0x7f4c2419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.690+0000 7f4c2aa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c24113580 con 0x7f4c24103550 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.690+0000 7f4c2aa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c24113400 con 0x7f4c24103f10 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.690+0000 7f4c2aa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c24113700 con 0x7f4c241095d0 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c23e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103550 0x7f4c241a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c23e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103550 0x7f4c241a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43160/0 (socket says 172.21.15.70:43160) 2024-05-08T07:01:16.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c23e00700 1 -- 172.21.15.70:0/502111677 learned_addr learned my addr 172.21.15.70:0/502111677 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c1be00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c24103f10 0x7f4c241a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c23e00700 1 -- 172.21.15.70:0/502111677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c241095d0 msgr2=0x7f4c2419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c28a00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c241095d0 0x7f4c2419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c23e00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c241095d0 0x7f4c2419ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c23e00700 1 -- 172.21.15.70:0/502111677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c24103f10 msgr2=0x7f4c241a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c23e00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c24103f10 0x7f4c241a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c23e00700 1 -- 172.21.15.70:0/502111677 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2419c1a0 con 0x7f4c24103550 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.691+0000 7f4c1be00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c24103f10 0x7f4c241a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.692+0000 7f4c23e00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103550 0x7f4c241a1880 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400c970 tx=0x7f4c1400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.692+0000 7f4c21600700 1 -- 172.21.15.70:0/502111677 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14007aa0 con 0x7f4c24103550 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.692+0000 7f4c21600700 1 -- 172.21.15.70:0/502111677 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c14004cc0 con 0x7f4c24103550 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.692+0000 7f4c21600700 1 -- 172.21.15.70:0/502111677 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14005500 con 0x7f4c24103550 2024-05-08T07:01:16.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.692+0000 7f4c2aa00700 1 -- 172.21.15.70:0/502111677 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2419c490 con 0x7f4c24103550 2024-05-08T07:01:16.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.692+0000 7f4c2aa00700 1 -- 172.21.15.70:0/502111677 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c241a8750 con 0x7f4c24103550 2024-05-08T07:01:16.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.696+0000 7f4c21600700 1 -- 172.21.15.70:0/502111677 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4c14007c40 con 0x7f4c24103550 2024-05-08T07:01:16.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.697+0000 7f4c353c2b80 1 Processor -- start 2024-05-08T07:01:16.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.697+0000 7f4c353c2b80 1 -- start start 2024-05-08T07:01:16.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.697+0000 7f4c21600700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c080b2a70 0x7f4c080b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.697+0000 7f4c21600700 1 -- 172.21.15.70:0/502111677 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 9583+0+0 (secure 0 0 0) 0x7f4c140e2870 con 0x7f4c24103550 2024-05-08T07:01:16.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.697+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b355590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b34fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b35bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c28a00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c080b2a70 0x7f4c080b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55917b2a1b20 con 0x55917b3551b0 2024-05-08T07:01:16.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55917b23f860 con 0x55917b34f780 2024-05-08T07:01:16.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55917b29dae0 con 0x55917b350140 2024-05-08T07:01:16.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c23e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b355590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c23e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b355590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43164/0 (socket says 172.21.15.70:43164) 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c23e00700 1 -- 172.21.15.70:0/812085169 learned_addr learned my addr 172.21.15.70:0/812085169 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c1be00700 1 --2- 172.21.15.70:0/812085169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b34fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.698+0000 7f4c28a00700 1 --2- 172.21.15.70:0/812085169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b35bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c23e00700 1 -- 172.21.15.70:0/812085169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 msgr2=0x55917b35bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c23e00700 1 --2- 172.21.15.70:0/812085169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b35bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c23e00700 1 -- 172.21.15.70:0/812085169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 msgr2=0x55917b34fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c23e00700 1 --2- 172.21.15.70:0/812085169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b34fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c23e00700 1 -- 172.21.15.70:0/812085169 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55917b1ee9d0 con 0x55917b3551b0 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c28a00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c080b2a70 0x7f4c080b4f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fd0 tx=0x7f4c1c005ac0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:01:16.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c23e00700 1 --2- 172.21.15.70:0/812085169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b355590 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4c140a9460 tx=0x7f4c140a9270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6652c8d2f0b3b732 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:01:16.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c19600700 1 -- 172.21.15.70:0/812085169 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c14015540 con 0x55917b3551b0 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c19600700 1 -- 172.21.15.70:0/812085169 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c140a9760 con 0x55917b3551b0 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.699+0000 7f4c19600700 1 -- 172.21.15.70:0/812085169 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c140a99c0 con 0x55917b3551b0 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.700+0000 7f4c353c2b80 1 -- 172.21.15.70:0/812085169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 msgr2=0x55917b355590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.700+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/812085169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b355590 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4c140a9460 tx=0x7f4c140a9270 comp rx=0 tx=0).stop 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.700+0000 7f4c353c2b80 1 -- 172.21.15.70:0/812085169 shutdown_connections 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.700+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/812085169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b35bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.700+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/812085169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b355590 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.700+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/812085169 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b34fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.700+0000 7f4c353c2b80 1 -- 172.21.15.70:0/812085169 >> 172.21.15.70:0/812085169 conn(0x55917b2c77d0 msgr2=0x55917b34a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.700+0000 7f4c353c2b80 1 -- 172.21.15.70:0/812085169 shutdown_connections 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.700+0000 7f4c353c2b80 1 -- 172.21.15.70:0/812085169 wait complete. 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.701+0000 7f4c353c2b80 1 -- start start 2024-05-08T07:01:16.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.701+0000 7f4c353c2b80 1 Processor -- start 2024-05-08T07:01:16.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b35bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b358f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b359480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55917b35c570 con 0x55917b3551b0 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55917b207c20 con 0x55917b34f780 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55917b35c6f0 con 0x55917b350140 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c353c2b80 10 client.0 _ll_register_callbacks cb 0x55917b248d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c28a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b359480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c28a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b359480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43168/0 (socket says 172.21.15.70:43168) 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c28a00700 1 -- 172.21.15.70:0/1558405431 learned_addr learned my addr 172.21.15.70:0/1558405431 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c1be00700 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b358f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.702+0000 7f4c23e00700 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b35bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c28a00700 1 -- 172.21.15.70:0/1558405431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 msgr2=0x55917b358f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:01:16.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c28a00700 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b358f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c28a00700 1 -- 172.21.15.70:0/1558405431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 msgr2=0x55917b35bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c28a00700 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b35bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c28a00700 1 -- 172.21.15.70:0/1558405431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55917b267520 con 0x55917b3551b0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c28a00700 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b359480 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0052c0 tx=0x7f4c1c00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5250e7a231ec35dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c12000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c12000700 1 -- 172.21.15.70:0/1558405431 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c024070 con 0x55917b3551b0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c12000700 1 -- 172.21.15.70:0/1558405431 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9583+0+0 (secure 0 0 0) 0x7f4c1c0078b0 con 0x55917b3551b0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.703+0000 7f4c353c2b80 1 -- 172.21.15.70:0/1558405431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c140a9760 con 0x55917b3551b0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.704+0000 7f4c12000700 1 -- 172.21.15.70:0/1558405431 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4c1c007ab0 con 0x55917b3551b0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.704+0000 7f4c353c2b80 10 client.15882 fetch_fsmap learned FSMap version 28 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.704+0000 7f4c353c2b80 1 -- 172.21.15.70:0/1558405431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55917b366d90 con 0x55917b3551b0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.704+0000 7f4c12000700 1 -- 172.21.15.70:0/1558405431 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c140a9760 con 0x55917b3551b0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.704+0000 7f4c12000700 1 -- 172.21.15.70:0/1558405431 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4c1c011070 con 0x55917b3551b0 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.705+0000 7f4c353c2b80 10 client.15882 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:01:16.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.705+0000 7f4c353c2b80 10 client.15882 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:01:16.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.705+0000 7f4c353c2b80 20 client.15882 populate_metadata read hostname 'smithi070' 2024-05-08T07:01:16.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.705+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55917b369470 0x55917b36b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.705+0000 7f4c353c2b80 4 client.15882 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:01:16.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.705+0000 7f4c353c2b80 1 -- 172.21.15.70:0/1558405431 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55917b31c240 con 0x55917b369470 2024-05-08T07:01:16.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.705+0000 7f4c23e00700 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55917b369470 0x55917b36b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.706+0000 7f4c23e00700 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55917b369470 0x55917b36b8a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890b1a1dcb94fd24 server_cookie=f38b6b57be3edb64 in_seq=0 out_seq=0 2024-05-08T07:01:16.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.706+0000 7f4c12000700 10 client.15882 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:01:16.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.708+0000 7f4c12000700 1 -- 172.21.15.70:0/1558405431 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55917b31c240 con 0x55917b369470 2024-05-08T07:01:16.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.708+0000 7f4c12000700 10 client.15882 handle_command_reply: tid=0 2024-05-08T07:01:16.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.708+0000 7f4c353c2b80 1 client.15882 shutdown 2024-05-08T07:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 -- 172.21.15.70:0/1558405431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 msgr2=0x55917b359480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b359480 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0052c0 tx=0x7f4c1c00b3e0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 -- 172.21.15.70:0/1558405431 shutdown_connections 2024-05-08T07:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55917b369470 0x55917b36b8a0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b359480 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b35bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/1558405431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b358f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 -- 172.21.15.70:0/1558405431 >> 172.21.15.70:0/1558405431 conn(0x55917b2c77d0 msgr2=0x55917b344b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c12000700 0 client.15882 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 -- 172.21.15.70:0/1558405431 shutdown_connections 2024-05-08T07:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 1 -- 172.21.15.70:0/1558405431 wait complete. 2024-05-08T07:01:16.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.709+0000 7f4c353c2b80 20 client.15882 trim_cache size 0 max 16384 2024-05-08T07:01:16.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.732+0000 7f4c353c2b80 1 Processor -- start 2024-05-08T07:01:16.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.732+0000 7f4c353c2b80 1 -- start start 2024-05-08T07:01:16.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b34f780 0x55917b3655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b350140 0x55917b358840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b3551b0 0x55917b371170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241b3fb0 con 0x55917b350140 2024-05-08T07:01:16.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241b1840 con 0x55917b3551b0 2024-05-08T07:01:16.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241af6b0 con 0x55917b34f780 2024-05-08T07:01:16.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c1be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b350140 0x55917b358840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c1be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b350140 0x55917b358840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43176/0 (socket says 172.21.15.70:43176) 2024-05-08T07:01:16.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c1be00700 1 -- 172.21.15.70:0/2101045251 learned_addr learned my addr 172.21.15.70:0/2101045251 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:01:16.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c1be00700 1 -- 172.21.15.70:0/2101045251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b34f780 msgr2=0x55917b3655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:01:16.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c1be00700 1 --2- 172.21.15.70:0/2101045251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b34f780 0x55917b3655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c1be00700 1 -- 172.21.15.70:0/2101045251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b3551b0 msgr2=0x55917b371170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:01:16.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c1be00700 1 --2- 172.21.15.70:0/2101045251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b3551b0 0x55917b371170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.733+0000 7f4c1be00700 1 -- 172.21.15.70:0/2101045251 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55917b354df0 con 0x55917b350140 2024-05-08T07:01:16.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.734+0000 7f4c1be00700 1 --2- 172.21.15.70:0/2101045251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b350140 0x55917b358840 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00fbf0 tx=0x7f4c0c00ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d59e7e75dc3bbe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:01:16.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.734+0000 7f4c18c00700 1 -- 172.21.15.70:0/2101045251 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c011e30 con 0x55917b350140 2024-05-08T07:01:16.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.734+0000 7f4c18c00700 1 -- 172.21.15.70:0/2101045251 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c0c019880 con 0x55917b350140 2024-05-08T07:01:16.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.734+0000 7f4c18c00700 1 -- 172.21.15.70:0/2101045251 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00e870 con 0x55917b350140 2024-05-08T07:01:16.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.735+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2101045251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b350140 msgr2=0x55917b358840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:16.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.735+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2101045251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b350140 0x55917b358840 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00fbf0 tx=0x7f4c0c00ff00 comp rx=0 tx=0).stop 2024-05-08T07:01:16.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.735+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2101045251 shutdown_connections 2024-05-08T07:01:16.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.735+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2101045251 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b3551b0 0x55917b371170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.735+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2101045251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b34f780 0x55917b3655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.735+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2101045251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b350140 0x55917b358840 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.735+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2101045251 >> 172.21.15.70:0/2101045251 conn(0x55917b2c77d0 msgr2=0x55917b3534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:01:16.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.735+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2101045251 shutdown_connections 2024-05-08T07:01:16.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.735+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2101045251 wait complete. 2024-05-08T07:01:16.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.736+0000 7f4c353c2b80 1 -- start start 2024-05-08T07:01:16.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.736+0000 7f4c353c2b80 1 Processor -- start 2024-05-08T07:01:16.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b35ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b35f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c353c2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b3d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241afd00 con 0x55917b3551b0 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241b1170 con 0x55917b34f780 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c353c2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c241b03d0 con 0x55917b350140 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c353c2b80 10 client.0 _ll_register_callbacks cb 0x55917b248d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c28a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b3d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c28a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b3d3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43180/0 (socket says 172.21.15.70:43180) 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c28a00700 1 -- 172.21.15.70:0/2780062605 learned_addr learned my addr 172.21.15.70:0/2780062605 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c23e00700 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b35ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.737+0000 7f4c1be00700 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b35f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c28a00700 1 -- 172.21.15.70:0/2780062605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 msgr2=0x55917b35f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c28a00700 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b35f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c28a00700 1 -- 172.21.15.70:0/2780062605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 msgr2=0x55917b35ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c28a00700 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b35ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c28a00700 1 -- 172.21.15.70:0/2780062605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55917b3d4270 con 0x55917b3551b0 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c1be00700 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b35f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c28a00700 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b3d3d30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c005a90 tx=0x7f4c1c02bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f4ee185aa51bc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c12000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c12000700 1 -- 172.21.15.70:0/2780062605 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c021070 con 0x55917b3551b0 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.738+0000 7f4c12000700 1 -- 172.21.15.70:0/2780062605 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(111..111 src has 1..111) ==== 9583+0+0 (secure 0 0 0) 0x7f4c1c0078b0 con 0x55917b3551b0 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.739+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2780062605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c0c019880 con 0x55917b3551b0 2024-05-08T07:01:16.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.739+0000 7f4c12000700 1 -- 172.21.15.70:0/2780062605 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4c1c02a470 con 0x55917b3551b0 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.739+0000 7f4c353c2b80 10 client.15888 fetch_fsmap learned FSMap version 28 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.739+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2780062605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55917b3d5580 con 0x55917b3551b0 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.739+0000 7f4c12000700 1 -- 172.21.15.70:0/2780062605 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c0c019880 con 0x55917b3551b0 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.739+0000 7f4c12000700 1 -- 172.21.15.70:0/2780062605 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f4c1c011040 con 0x55917b3551b0 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.740+0000 7f4c353c2b80 10 client.15888 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.740+0000 7f4c353c2b80 10 client.15888 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.740+0000 7f4c353c2b80 20 client.15888 populate_metadata read hostname 'smithi070' 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.740+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55917b3d5c80 0x55917b3d8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.740+0000 7f4c353c2b80 4 client.15888 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a7270084", "release": true, "await": true}] 2024-05-08T07:01:16.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.740+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2780062605 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a7270084", "release": true, "await": true}) -- 0x55917b2af500 con 0x55917b3d5c80 2024-05-08T07:01:16.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.740+0000 7f4c23e00700 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55917b3d5c80 0x55917b3d8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:01:16.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.741+0000 7f4c23e00700 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55917b3d5c80 0x55917b3d8070 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=151b4c80920a35f2 server_cookie=652d5ef976b8d0a6 in_seq=0 out_seq=0 2024-05-08T07:01:16.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:16.741+0000 7f4c12000700 10 client.15888 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:01:18.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.340+0000 7f4c12000700 1 -- 172.21.15.70:0/2780062605 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55917b2af500 con 0x55917b3d5c80 2024-05-08T07:01:18.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.340+0000 7f4c12000700 10 client.15888 handle_command_reply: tid=0 2024-05-08T07:01:18.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.340+0000 7f4c353c2b80 1 client.15888 shutdown 2024-05-08T07:01:18.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.341+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2780062605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 msgr2=0x55917b3d3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:18.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.341+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b3d3d30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c005a90 tx=0x7f4c1c02bf40 comp rx=0 tx=0).stop 2024-05-08T07:01:18.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.341+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2780062605 shutdown_connections 2024-05-08T07:01:18.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.341+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55917b3d5c80 0x55917b3d8070 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:18.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.342+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55917b3551b0 0x55917b3d3d30 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:18.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.342+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55917b34f780 0x55917b35ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:18.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.342+0000 7f4c353c2b80 1 --2- 172.21.15.70:0/2780062605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55917b350140 0x55917b35f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:18.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.342+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2780062605 >> 172.21.15.70:0/2780062605 conn(0x55917b2c77d0 msgr2=0x55917b3442b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:01:18.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.342+0000 7f4c12000700 0 client.15888 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:01:18.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.342+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2780062605 shutdown_connections 2024-05-08T07:01:18.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.343+0000 7f4c353c2b80 1 -- 172.21.15.70:0/2780062605 wait complete. 2024-05-08T07:01:18.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.343+0000 7f4c353c2b80 20 client.15888 trim_cache size 0 max 16384 2024-05-08T07:01:18.344 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:01:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:01:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:01:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 40, 2024-05-08T07:01:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:01:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "a7270084": { 2024-05-08T07:01:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 40, 2024-05-08T07:01:18.344 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.3, 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:01:18.345 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:01:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:01:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:01:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:01:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:01:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:01:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:01:18.346 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:01:18.347 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:01:18.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 -- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c080b2a70 msgr2=0x7f4c080b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:18.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c080b2a70 0x7f4c080b4f30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fd0 tx=0x7f4c1c005ac0 comp rx=0 tx=0).stop 2024-05-08T07:01:18.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 -- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103550 msgr2=0x7f4c241a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:01:18.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103550 0x7f4c241a1880 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400c970 tx=0x7f4c1400cd30 comp rx=0 tx=0).stop 2024-05-08T07:01:18.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 -- 172.21.15.70:0/502111677 shutdown_connections 2024-05-08T07:01:18.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c080b2a70 0x7f4c080b4f30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:18.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c241095d0 0x7f4c2419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c24103550 0x7f4c241a1880 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 --2- 172.21.15.70:0/502111677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c24103f10 0x7f4c241a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:01:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.345+0000 7f4c2aa00700 1 -- 172.21.15.70:0/502111677 >> 172.21.15.70:0/502111677 conn(0x7f4c2407a5f0 msgr2=0x7f4c2410e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:01:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.346+0000 7f4c2aa00700 1 -- 172.21.15.70:0/502111677 shutdown_connections 2024-05-08T07:01:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:01:18.346+0000 7f4c2aa00700 1 -- 172.21.15.70:0/502111677 wait complete. 2024-05-08T07:01:18.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:18 smithi172 ceph-mon[33377]: pgmap v463: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 7 op/s 2024-05-08T07:01:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:18 smithi194 ceph-mon[33679]: pgmap v463: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 7 op/s 2024-05-08T07:01:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:18 smithi070 ceph-mon[29591]: pgmap v463: 129 pgs: 129 active+clean; 488 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 KiB/s wr, 7 op/s 2024-05-08T07:01:19.502 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a7270084', seconds elapsed: 47.6 2024-05-08T07:01:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:20 smithi172 ceph-mon[33377]: pgmap v464: 129 pgs: 129 active+clean; 489 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 61 KiB/s wr, 12 op/s 2024-05-08T07:01:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:20 smithi194 ceph-mon[33679]: pgmap v464: 129 pgs: 129 active+clean; 489 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 61 KiB/s wr, 12 op/s 2024-05-08T07:01:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:20 smithi070 ceph-mon[29591]: pgmap v464: 129 pgs: 129 active+clean; 489 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 61 KiB/s wr, 12 op/s 2024-05-08T07:01:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:22 smithi194 ceph-mon[33679]: pgmap v465: 129 pgs: 129 active+clean; 489 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 61 KiB/s wr, 12 op/s 2024-05-08T07:01:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:22 smithi070 ceph-mon[29591]: pgmap v465: 129 pgs: 129 active+clean; 489 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 61 KiB/s wr, 12 op/s 2024-05-08T07:01:22.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:22 smithi172 ceph-mon[33377]: pgmap v465: 129 pgs: 129 active+clean; 489 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 61 KiB/s wr, 12 op/s 2024-05-08T07:01:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:24 smithi070 ceph-mon[29591]: pgmap v466: 129 pgs: 129 active+clean; 489 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 57 KiB/s wr, 11 op/s 2024-05-08T07:01:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:24 smithi194 ceph-mon[33679]: pgmap v466: 129 pgs: 129 active+clean; 489 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 57 KiB/s wr, 11 op/s 2024-05-08T07:01:24.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:24 smithi172 ceph-mon[33377]: pgmap v466: 129 pgs: 129 active+clean; 489 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 57 KiB/s wr, 11 op/s 2024-05-08T07:01:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:26 smithi194 ceph-mon[33679]: pgmap v467: 129 pgs: 129 active+clean; 495 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 566 KiB/s wr, 55 op/s 2024-05-08T07:01:26.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:26 smithi070 ceph-mon[29591]: pgmap v467: 129 pgs: 129 active+clean; 495 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 566 KiB/s wr, 55 op/s 2024-05-08T07:01:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:26 smithi172 ceph-mon[33377]: pgmap v467: 129 pgs: 129 active+clean; 495 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 566 KiB/s wr, 55 op/s 2024-05-08T07:01:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:28 smithi194 ceph-mon[33679]: pgmap v468: 129 pgs: 129 active+clean; 495 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 565 KiB/s wr, 53 op/s 2024-05-08T07:01:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:28 smithi070 ceph-mon[29591]: pgmap v468: 129 pgs: 129 active+clean; 495 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 565 KiB/s wr, 53 op/s 2024-05-08T07:01:28.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:28 smithi172 ceph-mon[33377]: pgmap v468: 129 pgs: 129 active+clean; 495 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 565 KiB/s wr, 53 op/s 2024-05-08T07:01:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:30 smithi194 ceph-mon[33679]: pgmap v469: 129 pgs: 129 active+clean; 501 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2024-05-08T07:01:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:30 smithi070 ceph-mon[29591]: pgmap v469: 129 pgs: 129 active+clean; 501 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2024-05-08T07:01:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:30 smithi172 ceph-mon[33377]: pgmap v469: 129 pgs: 129 active+clean; 501 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.1 MiB/s wr, 97 op/s 2024-05-08T07:01:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:32 smithi194 ceph-mon[33679]: pgmap v470: 129 pgs: 129 active+clean; 501 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.1 MiB/s wr, 89 op/s 2024-05-08T07:01:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:32 smithi070 ceph-mon[29591]: pgmap v470: 129 pgs: 129 active+clean; 501 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.1 MiB/s wr, 89 op/s 2024-05-08T07:01:32.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:32 smithi172 ceph-mon[33377]: pgmap v470: 129 pgs: 129 active+clean; 501 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.1 MiB/s wr, 89 op/s 2024-05-08T07:01:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:34 smithi194 ceph-mon[33679]: pgmap v471: 129 pgs: 129 active+clean; 501 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.1 MiB/s wr, 89 op/s 2024-05-08T07:01:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:34 smithi070 ceph-mon[29591]: pgmap v471: 129 pgs: 129 active+clean; 501 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.1 MiB/s wr, 89 op/s 2024-05-08T07:01:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:34 smithi172 ceph-mon[33377]: pgmap v471: 129 pgs: 129 active+clean; 501 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 1.1 MiB/s wr, 89 op/s 2024-05-08T07:01:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:36 smithi194 ceph-mon[33679]: pgmap v472: 129 pgs: 129 active+clean; 507 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 1.6 MiB/s wr, 131 op/s 2024-05-08T07:01:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:36 smithi070 ceph-mon[29591]: pgmap v472: 129 pgs: 129 active+clean; 507 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 1.6 MiB/s wr, 131 op/s 2024-05-08T07:01:36.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:36 smithi172 ceph-mon[33377]: pgmap v472: 129 pgs: 129 active+clean; 507 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 1.6 MiB/s wr, 131 op/s 2024-05-08T07:01:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:38 smithi194 ceph-mon[33679]: pgmap v473: 129 pgs: 129 active+clean; 507 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 1.1 MiB/s wr, 85 op/s 2024-05-08T07:01:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:38 smithi070 ceph-mon[29591]: pgmap v473: 129 pgs: 129 active+clean; 507 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 1.1 MiB/s wr, 85 op/s 2024-05-08T07:01:38.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:38 smithi172 ceph-mon[33377]: pgmap v473: 129 pgs: 129 active+clean; 507 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 1.1 MiB/s wr, 85 op/s 2024-05-08T07:01:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:40 smithi194 ceph-mon[33679]: pgmap v474: 129 pgs: 129 active+clean; 515 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.7 MiB/s wr, 131 op/s 2024-05-08T07:01:40.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:40 smithi070 ceph-mon[29591]: pgmap v474: 129 pgs: 129 active+clean; 515 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.7 MiB/s wr, 131 op/s 2024-05-08T07:01:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:40 smithi172 ceph-mon[33377]: pgmap v474: 129 pgs: 129 active+clean; 515 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 1.7 MiB/s wr, 131 op/s 2024-05-08T07:01:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:42 smithi194 ceph-mon[33679]: pgmap v475: 129 pgs: 129 active+clean; 515 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 1.2 MiB/s wr, 87 op/s 2024-05-08T07:01:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:42 smithi070 ceph-mon[29591]: pgmap v475: 129 pgs: 129 active+clean; 515 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 1.2 MiB/s wr, 87 op/s 2024-05-08T07:01:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:42 smithi172 ceph-mon[33377]: pgmap v475: 129 pgs: 129 active+clean; 515 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 1.2 MiB/s wr, 87 op/s 2024-05-08T07:01:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:44 smithi194 ceph-mon[33679]: pgmap v476: 129 pgs: 129 active+clean; 515 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 1.2 MiB/s wr, 87 op/s 2024-05-08T07:01:44.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:44 smithi070 ceph-mon[29591]: pgmap v476: 129 pgs: 129 active+clean; 515 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 1.2 MiB/s wr, 87 op/s 2024-05-08T07:01:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:44 smithi172 ceph-mon[33377]: pgmap v476: 129 pgs: 129 active+clean; 515 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 1.2 MiB/s wr, 87 op/s 2024-05-08T07:01:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:46 smithi070 ceph-mon[29591]: pgmap v477: 129 pgs: 129 active+clean; 520 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.7 MiB/s wr, 132 op/s 2024-05-08T07:01:46.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:46 smithi172 ceph-mon[33377]: pgmap v477: 129 pgs: 129 active+clean; 520 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.7 MiB/s wr, 132 op/s 2024-05-08T07:01:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:46 smithi194 ceph-mon[33679]: pgmap v477: 129 pgs: 129 active+clean; 520 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.7 MiB/s wr, 132 op/s 2024-05-08T07:01:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:48 smithi070 ceph-mon[29591]: pgmap v478: 129 pgs: 129 active+clean; 520 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.1 MiB/s wr, 90 op/s 2024-05-08T07:01:48.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:48 smithi172 ceph-mon[33377]: pgmap v478: 129 pgs: 129 active+clean; 520 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.1 MiB/s wr, 90 op/s 2024-05-08T07:01:48.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:48 smithi194 ceph-mon[33679]: pgmap v478: 129 pgs: 129 active+clean; 520 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 1.1 MiB/s wr, 90 op/s 2024-05-08T07:01:50.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:50 smithi070 ceph-mon[29591]: pgmap v479: 129 pgs: 129 active+clean; 526 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 1.6 MiB/s wr, 129 op/s 2024-05-08T07:01:50.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:50 smithi172 ceph-mon[33377]: pgmap v479: 129 pgs: 129 active+clean; 526 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 1.6 MiB/s wr, 129 op/s 2024-05-08T07:01:50.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:50 smithi194 ceph-mon[33679]: pgmap v479: 129 pgs: 129 active+clean; 526 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 1.6 MiB/s wr, 129 op/s 2024-05-08T07:01:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:52 smithi070 ceph-mon[29591]: pgmap v480: 129 pgs: 129 active+clean; 526 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 987 KiB/s wr, 83 op/s 2024-05-08T07:01:52.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:52 smithi172 ceph-mon[33377]: pgmap v480: 129 pgs: 129 active+clean; 526 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 987 KiB/s wr, 83 op/s 2024-05-08T07:01:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:52 smithi194 ceph-mon[33679]: pgmap v480: 129 pgs: 129 active+clean; 526 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 987 KiB/s wr, 83 op/s 2024-05-08T07:01:54.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:54 smithi070 ceph-mon[29591]: pgmap v481: 129 pgs: 129 active+clean; 526 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 988 KiB/s wr, 83 op/s 2024-05-08T07:01:54.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:54 smithi172 ceph-mon[33377]: pgmap v481: 129 pgs: 129 active+clean; 526 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 988 KiB/s wr, 83 op/s 2024-05-08T07:01:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:54 smithi194 ceph-mon[33679]: pgmap v481: 129 pgs: 129 active+clean; 526 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 988 KiB/s wr, 83 op/s 2024-05-08T07:01:55.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:55 smithi070 ceph-mon[29591]: pgmap v482: 129 pgs: 129 active+clean; 534 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.7 MiB/s wr, 122 op/s 2024-05-08T07:01:55.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:55 smithi172 ceph-mon[33377]: pgmap v482: 129 pgs: 129 active+clean; 534 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.7 MiB/s wr, 122 op/s 2024-05-08T07:01:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:55 smithi194 ceph-mon[33679]: pgmap v482: 129 pgs: 129 active+clean; 534 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 1.7 MiB/s wr, 122 op/s 2024-05-08T07:01:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:01:58 smithi194 ceph-mon[33679]: pgmap v483: 129 pgs: 129 active+clean; 534 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-05-08T07:01:58.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:01:58 smithi070 ceph-mon[29591]: pgmap v483: 129 pgs: 129 active+clean; 534 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-05-08T07:01:58.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:01:58 smithi172 ceph-mon[33377]: pgmap v483: 129 pgs: 129 active+clean; 534 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.2 MiB/s wr, 77 op/s 2024-05-08T07:02:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:00 smithi194 ceph-mon[33679]: pgmap v484: 129 pgs: 129 active+clean; 540 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 1.7 MiB/s wr, 112 op/s 2024-05-08T07:02:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:00 smithi070 ceph-mon[29591]: pgmap v484: 129 pgs: 129 active+clean; 540 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 1.7 MiB/s wr, 112 op/s 2024-05-08T07:02:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:00 smithi172 ceph-mon[33377]: pgmap v484: 129 pgs: 129 active+clean; 540 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 1.7 MiB/s wr, 112 op/s 2024-05-08T07:02:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:02 smithi194 ceph-mon[33679]: pgmap v485: 129 pgs: 129 active+clean; 540 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T07:02:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:02 smithi070 ceph-mon[29591]: pgmap v485: 129 pgs: 129 active+clean; 540 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T07:02:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:02 smithi172 ceph-mon[33377]: pgmap v485: 129 pgs: 129 active+clean; 540 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T07:02:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:04 smithi194 ceph-mon[33679]: pgmap v486: 129 pgs: 129 active+clean; 540 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T07:02:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:04 smithi070 ceph-mon[29591]: pgmap v486: 129 pgs: 129 active+clean; 540 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T07:02:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:04 smithi172 ceph-mon[33377]: pgmap v486: 129 pgs: 129 active+clean; 540 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T07:02:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:06 smithi194 ceph-mon[33679]: pgmap v487: 129 pgs: 129 active+clean; 546 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.8 MiB/s wr, 119 op/s 2024-05-08T07:02:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:06 smithi070 ceph-mon[29591]: pgmap v487: 129 pgs: 129 active+clean; 546 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.8 MiB/s wr, 119 op/s 2024-05-08T07:02:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:06 smithi172 ceph-mon[33377]: pgmap v487: 129 pgs: 129 active+clean; 546 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.8 MiB/s wr, 119 op/s 2024-05-08T07:02:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:08 smithi194 ceph-mon[33679]: pgmap v488: 129 pgs: 129 active+clean; 546 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.1 MiB/s wr, 81 op/s 2024-05-08T07:02:08.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:08 smithi070 ceph-mon[29591]: pgmap v488: 129 pgs: 129 active+clean; 546 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.1 MiB/s wr, 81 op/s 2024-05-08T07:02:08.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:08 smithi172 ceph-mon[33377]: pgmap v488: 129 pgs: 129 active+clean; 546 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.1 MiB/s wr, 81 op/s 2024-05-08T07:02:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:10 smithi194 ceph-mon[33679]: pgmap v489: 129 pgs: 129 active+clean; 552 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-05-08T07:02:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:10 smithi194 ceph-mon[33679]: osdmap e112: 12 total, 12 up, 12 in 2024-05-08T07:02:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:10 smithi070 ceph-mon[29591]: pgmap v489: 129 pgs: 129 active+clean; 552 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-05-08T07:02:10.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:10 smithi070 ceph-mon[29591]: osdmap e112: 12 total, 12 up, 12 in 2024-05-08T07:02:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:10 smithi172 ceph-mon[33377]: pgmap v489: 129 pgs: 129 active+clean; 552 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-05-08T07:02:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:10 smithi172 ceph-mon[33377]: osdmap e112: 12 total, 12 up, 12 in 2024-05-08T07:02:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:12 smithi194 ceph-mon[33679]: pgmap v491: 129 pgs: 129 active+clean; 552 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.3 MiB/s wr, 92 op/s 2024-05-08T07:02:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:12 smithi070 ceph-mon[29591]: pgmap v491: 129 pgs: 129 active+clean; 552 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.3 MiB/s wr, 92 op/s 2024-05-08T07:02:12.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:12 smithi172 ceph-mon[33377]: pgmap v491: 129 pgs: 129 active+clean; 552 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.3 MiB/s wr, 92 op/s 2024-05-08T07:02:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:02:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:02:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:02:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:14 smithi070 ceph-mon[29591]: pgmap v492: 129 pgs: 129 active+clean; 552 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.3 MiB/s wr, 92 op/s 2024-05-08T07:02:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:14 smithi172 ceph-mon[33377]: pgmap v492: 129 pgs: 129 active+clean; 552 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.3 MiB/s wr, 92 op/s 2024-05-08T07:02:14.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:14 smithi194 ceph-mon[33679]: pgmap v492: 129 pgs: 129 active+clean; 552 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.3 MiB/s wr, 92 op/s 2024-05-08T07:02:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:02:15.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:02:15.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:02:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:02:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:02:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:02:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:02:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:02:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:02:16.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:16 smithi070 ceph-mon[29591]: pgmap v493: 129 pgs: 129 active+clean; 567 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-05-08T07:02:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:16 smithi172 ceph-mon[33377]: pgmap v493: 129 pgs: 129 active+clean; 567 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-05-08T07:02:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:16 smithi194 ceph-mon[33679]: pgmap v493: 129 pgs: 129 active+clean; 567 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-05-08T07:02:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:18 smithi070 ceph-mon[29591]: pgmap v494: 129 pgs: 129 active+clean; 567 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-05-08T07:02:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:18 smithi070 ceph-mon[29591]: osdmap e113: 12 total, 12 up, 12 in 2024-05-08T07:02:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:18 smithi172 ceph-mon[33377]: pgmap v494: 129 pgs: 129 active+clean; 567 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-05-08T07:02:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:18 smithi172 ceph-mon[33377]: osdmap e113: 12 total, 12 up, 12 in 2024-05-08T07:02:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:18 smithi194 ceph-mon[33679]: pgmap v494: 129 pgs: 129 active+clean; 567 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 2.2 MiB/s wr, 78 op/s 2024-05-08T07:02:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:18 smithi194 ceph-mon[33679]: osdmap e113: 12 total, 12 up, 12 in 2024-05-08T07:02:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:20 smithi070 ceph-mon[29591]: pgmap v496: 129 pgs: 129 active+clean; 605 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 5.4 MiB/s wr, 60 op/s 2024-05-08T07:02:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:20 smithi172 ceph-mon[33377]: pgmap v496: 129 pgs: 129 active+clean; 605 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 5.4 MiB/s wr, 60 op/s 2024-05-08T07:02:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:20 smithi194 ceph-mon[33679]: pgmap v496: 129 pgs: 129 active+clean; 605 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 5.4 MiB/s wr, 60 op/s 2024-05-08T07:02:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:22 smithi070 ceph-mon[29591]: pgmap v497: 129 pgs: 129 active+clean; 605 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 5.3 MiB/s wr, 59 op/s 2024-05-08T07:02:22.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:22 smithi172 ceph-mon[33377]: pgmap v497: 129 pgs: 129 active+clean; 605 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 5.3 MiB/s wr, 59 op/s 2024-05-08T07:02:22.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:22 smithi194 ceph-mon[33679]: pgmap v497: 129 pgs: 129 active+clean; 605 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 5.3 MiB/s wr, 59 op/s 2024-05-08T07:02:24.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:24 smithi070 ceph-mon[29591]: pgmap v498: 129 pgs: 129 active+clean; 605 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 5.3 MiB/s wr, 59 op/s 2024-05-08T07:02:24.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:24 smithi172 ceph-mon[33377]: pgmap v498: 129 pgs: 129 active+clean; 605 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 5.3 MiB/s wr, 59 op/s 2024-05-08T07:02:24.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:24 smithi194 ceph-mon[33679]: pgmap v498: 129 pgs: 129 active+clean; 605 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 5.3 MiB/s wr, 59 op/s 2024-05-08T07:02:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:26 smithi070 ceph-mon[29591]: pgmap v499: 129 pgs: 129 active+clean; 641 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 7.4 MiB/s wr, 33 op/s 2024-05-08T07:02:26.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:26 smithi172 ceph-mon[33377]: pgmap v499: 129 pgs: 129 active+clean; 641 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 7.4 MiB/s wr, 33 op/s 2024-05-08T07:02:26.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:26 smithi194 ceph-mon[33679]: pgmap v499: 129 pgs: 129 active+clean; 641 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 7.4 MiB/s wr, 33 op/s 2024-05-08T07:02:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:27 smithi070 ceph-mon[29591]: pgmap v500: 129 pgs: 129 active+clean; 641 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 7.4 MiB/s wr, 33 op/s 2024-05-08T07:02:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:27 smithi172 ceph-mon[33377]: pgmap v500: 129 pgs: 129 active+clean; 641 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 7.4 MiB/s wr, 33 op/s 2024-05-08T07:02:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:27 smithi194 ceph-mon[33679]: pgmap v500: 129 pgs: 129 active+clean; 641 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 7.4 MiB/s wr, 33 op/s 2024-05-08T07:02:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:30 smithi194 ceph-mon[33679]: pgmap v501: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 9.1 MiB/s wr, 41 op/s 2024-05-08T07:02:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:30 smithi070 ceph-mon[29591]: pgmap v501: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 9.1 MiB/s wr, 41 op/s 2024-05-08T07:02:30.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:30 smithi172 ceph-mon[33377]: pgmap v501: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 9.1 MiB/s wr, 41 op/s 2024-05-08T07:02:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:32 smithi194 ceph-mon[33679]: pgmap v502: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 5.8 MiB/s wr, 24 op/s 2024-05-08T07:02:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:32 smithi070 ceph-mon[29591]: pgmap v502: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 5.8 MiB/s wr, 24 op/s 2024-05-08T07:02:32.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:32 smithi172 ceph-mon[33377]: pgmap v502: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 5.8 MiB/s wr, 24 op/s 2024-05-08T07:02:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:34 smithi194 ceph-mon[33679]: pgmap v503: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 5.8 MiB/s wr, 24 op/s 2024-05-08T07:02:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:34 smithi070 ceph-mon[29591]: pgmap v503: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 5.8 MiB/s wr, 24 op/s 2024-05-08T07:02:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:34 smithi172 ceph-mon[33377]: pgmap v503: 129 pgs: 129 active+clean; 674 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 5.8 MiB/s wr, 24 op/s 2024-05-08T07:02:35.088 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T07:02:35.088 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-05-08T07:02:35.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:02:35.575 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:02:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:36 smithi194 ceph-mon[33679]: pgmap v504: 129 pgs: 129 active+clean; 710 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 8.7 MiB/s wr, 36 op/s 2024-05-08T07:02:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:36 smithi070 ceph-mon[29591]: pgmap v504: 129 pgs: 129 active+clean; 710 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 8.7 MiB/s wr, 36 op/s 2024-05-08T07:02:36.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:36 smithi172 ceph-mon[33377]: pgmap v504: 129 pgs: 129 active+clean; 710 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 8.7 MiB/s wr, 36 op/s 2024-05-08T07:02:38.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.139+0000 7fdc64600700 1 -- 172.21.15.70:0/593587215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c109520 msgr2=0x7fdc5c109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:38.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.139+0000 7fdc64600700 1 --2- 172.21.15.70:0/593587215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c109520 0x7fdc5c109900 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009990 tx=0x7fdc50009ca0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.139+0000 7fdc64600700 1 -- 172.21.15.70:0/593587215 shutdown_connections 2024-05-08T07:02:38.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.139+0000 7fdc64600700 1 --2- 172.21.15.70:0/593587215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06c530 0x7fdc5c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.139+0000 7fdc64600700 1 --2- 172.21.15.70:0/593587215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c109520 0x7fdc5c109900 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.139+0000 7fdc64600700 1 --2- 172.21.15.70:0/593587215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc5c06bb70 0x7fdc5c06bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.139+0000 7fdc64600700 1 -- 172.21.15.70:0/593587215 >> 172.21.15.70:0/593587215 conn(0x7fdc5c079350 msgr2=0x7fdc5c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:02:38.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.139+0000 7fdc64600700 1 -- 172.21.15.70:0/593587215 shutdown_connections 2024-05-08T07:02:38.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.139+0000 7fdc64600700 1 -- 172.21.15.70:0/593587215 wait complete. 2024-05-08T07:02:38.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.141+0000 7fdc64600700 1 Processor -- start 2024-05-08T07:02:38.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.141+0000 7fdc64600700 1 -- start start 2024-05-08T07:02:38.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.141+0000 7fdc64600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06bb70 0x7fdc5c102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:38.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.141+0000 7fdc64600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c06c530 0x7fdc5c102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:38.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.141+0000 7fdc64600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc5c109520 0x7fdc5c1032d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:38.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.141+0000 7fdc64600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c1135b0 con 0x7fdc5c06c530 2024-05-08T07:02:38.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.141+0000 7fdc64600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c113430 con 0x7fdc5c109520 2024-05-08T07:02:38.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.141+0000 7fdc64600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5c113730 con 0x7fdc5c06bb70 2024-05-08T07:02:38.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc61200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c06c530 0x7fdc5c102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:38.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc61200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c06c530 0x7fdc5c102d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47218/0 (socket says 172.21.15.70:47218) 2024-05-08T07:02:38.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc61200700 1 -- 172.21.15.70:0/183227897 learned_addr learned my addr 172.21.15.70:0/183227897 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:02:38.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc61c00700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06bb70 0x7fdc5c102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc62600700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc5c109520 0x7fdc5c1032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc61200700 1 -- 172.21.15.70:0/183227897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06bb70 msgr2=0x7fdc5c102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc61200700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06bb70 0x7fdc5c102850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc61200700 1 -- 172.21.15.70:0/183227897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc5c109520 msgr2=0x7fdc5c1032d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc61200700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc5c109520 0x7fdc5c1032d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.142+0000 7fdc61200700 1 -- 172.21.15.70:0/183227897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc5c1a8030 con 0x7fdc5c06c530 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.143+0000 7fdc61200700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c06c530 0x7fdc5c102d90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c9b0 tx=0x7fdc4800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.143+0000 7fdc5a000700 1 -- 172.21.15.70:0/183227897 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48007b00 con 0x7fdc5c06c530 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.143+0000 7fdc5a000700 1 -- 172.21.15.70:0/183227897 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc48007ca0 con 0x7fdc5c06c530 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.143+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc5c1a8320 con 0x7fdc5c06c530 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.143+0000 7fdc5a000700 1 -- 172.21.15.70:0/183227897 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48018660 con 0x7fdc5c06c530 2024-05-08T07:02:38.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.143+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5c1a8860 con 0x7fdc5c06c530 2024-05-08T07:02:38.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.145+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc5c104bf0 con 0x7fdc5c06c530 2024-05-08T07:02:38.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.149+0000 7fdc5a000700 1 -- 172.21.15.70:0/183227897 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fdc4800f450 con 0x7fdc5c06c530 2024-05-08T07:02:38.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.150+0000 7fdc5a000700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc440b29f0 0x7fdc440b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:38.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.151+0000 7fdc5a000700 1 -- 172.21.15.70:0/183227897 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9583+0+0 (secure 0 0 0) 0x7fdc480e2c20 con 0x7fdc5c06c530 2024-05-08T07:02:38.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.151+0000 7fdc61c00700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc440b29f0 0x7fdc440b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:38.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.152+0000 7fdc61c00700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc440b29f0 0x7fdc440b4eb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b5c0 tx=0x7fdc50005fd0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:02:38.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.154+0000 7fdc5a000700 1 -- 172.21.15.70:0/183227897 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdc48014030 con 0x7fdc5c06c530 2024-05-08T07:02:38.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:38 smithi070 ceph-mon[29591]: pgmap v505: 129 pgs: 129 active+clean; 710 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 5.7 MiB/s wr, 24 op/s 2024-05-08T07:02:38.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.465+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc5c02e510 con 0x7fdc5c06c530 2024-05-08T07:02:38.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.467+0000 7fdc5a000700 1 -- 172.21.15.70:0/183227897 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fdc480b2090 con 0x7fdc5c06c530 2024-05-08T07:02:38.467 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:02:38.467 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:02:38.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc440b29f0 msgr2=0x7fdc440b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:38.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc440b29f0 0x7fdc440b4eb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b5c0 tx=0x7fdc50005fd0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c06c530 msgr2=0x7fdc5c102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c06c530 0x7fdc5c102d90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c9b0 tx=0x7fdc4800ccc0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 shutdown_connections 2024-05-08T07:02:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdc440b29f0 0x7fdc440b4eb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdc5c109520 0x7fdc5c1032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc5c06bb70 0x7fdc5c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 --2- 172.21.15.70:0/183227897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc5c06c530 0x7fdc5c102d90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.470+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 >> 172.21.15.70:0/183227897 conn(0x7fdc5c079350 msgr2=0x7fdc5c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:02:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.471+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 shutdown_connections 2024-05-08T07:02:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:38.471+0000 7fdc64600700 1 -- 172.21.15.70:0/183227897 wait complete. 2024-05-08T07:02:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:02:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:38 smithi194 ceph-mon[33679]: pgmap v505: 129 pgs: 129 active+clean; 710 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 5.7 MiB/s wr, 24 op/s 2024-05-08T07:02:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:38 smithi172 ceph-mon[33377]: pgmap v505: 129 pgs: 129 active+clean; 710 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 5.7 MiB/s wr, 24 op/s 2024-05-08T07:02:39.360 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.25 --await-for 42.0' 2024-05-08T07:02:39.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.25 --await-for 42.0 2024-05-08T07:02:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/183227897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:02:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/183227897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:02:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/183227897' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:02:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:02:40.352 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:40 smithi070 ceph-mon[29591]: pgmap v506: 129 pgs: 129 active+clean; 764 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 10 MiB/s wr, 38 op/s 2024-05-08T07:02:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:40 smithi194 ceph-mon[33679]: pgmap v506: 129 pgs: 129 active+clean; 764 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 10 MiB/s wr, 38 op/s 2024-05-08T07:02:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:40 smithi172 ceph-mon[33377]: pgmap v506: 129 pgs: 129 active+clean; 764 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 10 MiB/s wr, 38 op/s 2024-05-08T07:02:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.207+0000 7f181d000700 1 -- 172.21.15.70:0/4004538581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818106160 msgr2=0x7f18181070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.207+0000 7f181d000700 1 --2- 172.21.15.70:0/4004538581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818106160 0x7f18181070e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1800009990 tx=0x7f1800009ca0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.207+0000 7f181d000700 1 -- 172.21.15.70:0/4004538581 shutdown_connections 2024-05-08T07:02:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.207+0000 7f181d000700 1 --2- 172.21.15.70:0/4004538581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1818107810 0x7f18181124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.207+0000 7f181d000700 1 --2- 172.21.15.70:0/4004538581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1818105840 0x7f1818105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.207+0000 7f181d000700 1 --2- 172.21.15.70:0/4004538581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818106160 0x7f18181070e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.207+0000 7f181d000700 1 -- 172.21.15.70:0/4004538581 >> 172.21.15.70:0/4004538581 conn(0x7f1818100fb0 msgr2=0x7f18181033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:02:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.207+0000 7f181d000700 1 -- 172.21.15.70:0/4004538581 shutdown_connections 2024-05-08T07:02:42.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.207+0000 7f181d000700 1 -- 172.21.15.70:0/4004538581 wait complete. 2024-05-08T07:02:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.208+0000 7f181d000700 1 Processor -- start 2024-05-08T07:02:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.208+0000 7f181d000700 1 -- start start 2024-05-08T07:02:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.209+0000 7f181d000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1818105840 0x7f18181a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.209+0000 7f181d000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1818106160 0x7f18181a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.209+0000 7f181d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818107810 0x7f181819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.209+0000 7f181d000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18181156a0 con 0x7f1818107810 2024-05-08T07:02:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.209+0000 7f181d000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1818115520 con 0x7f1818105840 2024-05-08T07:02:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.209+0000 7f181d000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1818115820 con 0x7f1818106160 2024-05-08T07:02:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.209+0000 7f1817e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818107810 0x7f181819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.209+0000 7f1817e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818107810 0x7f181819ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47242/0 (socket says 172.21.15.70:47242) 2024-05-08T07:02:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.209+0000 7f1817e00700 1 -- 172.21.15.70:0/2975429748 learned_addr learned my addr 172.21.15.70:0/2975429748 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:02:42.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1817400700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1818105840 0x7f18181a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1816a00700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1818106160 0x7f18181a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1817e00700 1 -- 172.21.15.70:0/2975429748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1818106160 msgr2=0x7f18181a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1817e00700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1818106160 0x7f18181a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1817e00700 1 -- 172.21.15.70:0/2975429748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1818105840 msgr2=0x7f18181a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:42.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1817e00700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1818105840 0x7f18181a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1817e00700 1 -- 172.21.15.70:0/2975429748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181819c160 con 0x7f1818107810 2024-05-08T07:02:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1816a00700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1818106160 0x7f18181a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:02:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1817400700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1818105840 0x7f18181a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:02:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.210+0000 7f1817e00700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818107810 0x7f181819ba00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f181000ef30 tx=0x7f181000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:02:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.211+0000 7f180fe00700 1 -- 172.21.15.70:0/2975429748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18100092e0 con 0x7f1818107810 2024-05-08T07:02:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.211+0000 7f180fe00700 1 -- 172.21.15.70:0/2975429748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1810004bb0 con 0x7f1818107810 2024-05-08T07:02:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.211+0000 7f180fe00700 1 -- 172.21.15.70:0/2975429748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810004080 con 0x7f1818107810 2024-05-08T07:02:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.211+0000 7f181d000700 1 -- 172.21.15.70:0/2975429748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181819c3f0 con 0x7f1818107810 2024-05-08T07:02:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.211+0000 7f181d000700 1 -- 172.21.15.70:0/2975429748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18181a8710 con 0x7f1818107810 2024-05-08T07:02:42.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.216+0000 7f180fe00700 1 -- 172.21.15.70:0/2975429748 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f181001b030 con 0x7f1818107810 2024-05-08T07:02:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.218+0000 7f1828eccb80 1 Processor -- start 2024-05-08T07:02:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.218+0000 7f1828eccb80 1 -- start start 2024-05-08T07:02:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x5594737da810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737dae30 0x5594737db290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f1828eccb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55947372cbb0 con 0x5594737e02e0 2024-05-08T07:02:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f1828eccb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5594736ca8f0 con 0x5594737dae30 2024-05-08T07:02:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f1828eccb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559473728b70 con 0x5594737e0c00 2024-05-08T07:02:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f180fe00700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f17fc0b2b20 0x7f17fc0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f1816a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f180fe00700 1 -- 172.21.15.70:0/2975429748 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9583+0+0 (secure 0 0 0) 0x7f18100e24f0 con 0x7f1818107810 2024-05-08T07:02:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.219+0000 7f1816a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737e06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47248/0 (socket says 172.21.15.70:47248) 2024-05-08T07:02:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1816a00700 1 -- 172.21.15.70:0/5634701 learned_addr learned my addr 172.21.15.70:0/5634701 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:02:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1817400700 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x5594737da810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1816a00700 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737dae30 0x5594737db290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1817e00700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f17fc0b2b20 0x7f17fc0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1817400700 1 -- 172.21.15.70:0/5634701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737dae30 msgr2=0x5594737db290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:02:42.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1817400700 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737dae30 0x5594737db290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1817400700 1 -- 172.21.15.70:0/5634701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 msgr2=0x5594737e06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:02:42.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1817400700 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737e06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1817400700 1 -- 172.21.15.70:0/5634701 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559473679a60 con 0x5594737e0c00 2024-05-08T07:02:42.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.220+0000 7f1816a00700 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737e06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:02:42.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.221+0000 7f1817400700 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x5594737da810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1808009c90 tx=0x7f18080113e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d47738fc70c3f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:02:42.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.221+0000 7f1817e00700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f17fc0b2b20 0x7f17fc0b4fe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18100df970 tx=0x7f1810009040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:02:42.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.221+0000 7f180cc00700 1 -- 172.21.15.70:0/5634701 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808011c00 con 0x5594737e0c00 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.222+0000 7f180cc00700 1 -- 172.21.15.70:0/5634701 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1808011da0 con 0x5594737e0c00 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.222+0000 7f180cc00700 1 -- 172.21.15.70:0/5634701 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180800f6a0 con 0x5594737e0c00 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.222+0000 7f1828eccb80 1 -- 172.21.15.70:0/5634701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 msgr2=0x5594737da810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.222+0000 7f1828eccb80 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x5594737da810 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1808009c90 tx=0x7f18080113e0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.223+0000 7f1828eccb80 1 -- 172.21.15.70:0/5634701 shutdown_connections 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.223+0000 7f1828eccb80 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737dae30 0x5594737db290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.223+0000 7f1828eccb80 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737e06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.223+0000 7f1828eccb80 1 --2- 172.21.15.70:0/5634701 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x5594737da810 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.223+0000 7f1828eccb80 1 -- 172.21.15.70:0/5634701 >> 172.21.15.70:0/5634701 conn(0x559473752860 msgr2=0x5594737d5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:02:42.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.223+0000 7f1828eccb80 1 -- 172.21.15.70:0/5634701 shutdown_connections 2024-05-08T07:02:42.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.223+0000 7f1828eccb80 1 -- 172.21.15.70:0/5634701 wait complete. 2024-05-08T07:02:42.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.224+0000 7f1828eccb80 1 -- start start 2024-05-08T07:02:42.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.224+0000 7f1828eccb80 1 Processor -- start 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.224+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737dae30 0x5594737e6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.224+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737e02e0 0x5594737e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.224+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x5594737e4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.224+0000 7f1828eccb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5594737e7720 con 0x5594737dae30 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.224+0000 7f1828eccb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559473692cb0 con 0x5594737e02e0 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.224+0000 7f1828eccb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5594737e78a0 con 0x5594737e0c00 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.224+0000 7f1828eccb80 10 client.0 _ll_register_callbacks cb 0x5594736d3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1816a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737dae30 0x5594737e6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1816a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737dae30 0x5594737e6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47254/0 (socket says 172.21.15.70:47254) 2024-05-08T07:02:42.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1816a00700 1 -- 172.21.15.70:0/1043898605 learned_addr learned my addr 172.21.15.70:0/1043898605 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:02:42.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1817400700 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737e02e0 0x5594737e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1816a00700 1 -- 172.21.15.70:0/1043898605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 msgr2=0x5594737e4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:02:42.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1816a00700 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x5594737e4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1816a00700 1 -- 172.21.15.70:0/1043898605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737e02e0 msgr2=0x5594737e3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1816a00700 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737e02e0 0x5594737e3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1816a00700 1 -- 172.21.15.70:0/1043898605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594736f25b0 con 0x5594737dae30 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.225+0000 7f1817400700 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737e02e0 0x5594737e3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.226+0000 7f1816a00700 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737dae30 0x5594737e6930 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1800005ca0 tx=0x7f1800005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c394741d0057c07d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.226+0000 7f1805600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.226+0000 7f1805600700 1 -- 172.21.15.70:0/1043898605 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800003d70 con 0x5594737dae30 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.226+0000 7f1805600700 1 -- 172.21.15.70:0/1043898605 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9583+0+0 (secure 0 0 0) 0x7f180000b6b0 con 0x5594737dae30 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.226+0000 7f1828eccb80 1 -- 172.21.15.70:0/1043898605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1808011da0 con 0x5594737dae30 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.226+0000 7f1805600700 1 -- 172.21.15.70:0/1043898605 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1800030050 con 0x5594737dae30 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.226+0000 7f1828eccb80 10 client.15906 fetch_fsmap learned FSMap version 28 2024-05-08T07:02:42.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.227+0000 7f1828eccb80 1 -- 172.21.15.70:0/1043898605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5594737fa770 con 0x5594737dae30 2024-05-08T07:02:42.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.227+0000 7f1805600700 1 -- 172.21.15.70:0/1043898605 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1808011da0 con 0x5594737dae30 2024-05-08T07:02:42.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.227+0000 7f1805600700 1 -- 172.21.15.70:0/1043898605 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f180000f820 con 0x5594737dae30 2024-05-08T07:02:42.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.227+0000 7f1828eccb80 10 client.15906 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:02:42.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.227+0000 7f1828eccb80 10 client.15906 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:02:42.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.227+0000 7f1828eccb80 20 client.15906 populate_metadata read hostname 'smithi070' 2024-05-08T07:02:42.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.227+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5594737fcd50 0x5594737ff180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.227+0000 7f1828eccb80 4 client.15906 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:02:42.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.227+0000 7f1828eccb80 1 -- 172.21.15.70:0/1043898605 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594737a72d0 con 0x5594737fcd50 2024-05-08T07:02:42.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.228+0000 7f1817400700 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5594737fcd50 0x5594737ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.229+0000 7f1817400700 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5594737fcd50 0x5594737ff180 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b889a578477948d0 server_cookie=e413c6d30c792e14 in_seq=0 out_seq=0 2024-05-08T07:02:42.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.229+0000 7f1805600700 10 client.15906 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:02:42.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.231+0000 7f1805600700 1 -- 172.21.15.70:0/1043898605 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5594737a72d0 con 0x5594737fcd50 2024-05-08T07:02:42.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.231+0000 7f1805600700 10 client.15906 handle_command_reply: tid=0 2024-05-08T07:02:42.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.231+0000 7f1828eccb80 1 client.15906 shutdown 2024-05-08T07:02:42.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 -- 172.21.15.70:0/1043898605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737dae30 msgr2=0x5594737e6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:42.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737dae30 0x5594737e6930 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1800005ca0 tx=0x7f1800005790 comp rx=0 tx=0).stop 2024-05-08T07:02:42.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 -- 172.21.15.70:0/1043898605 shutdown_connections 2024-05-08T07:02:42.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5594737fcd50 0x5594737ff180 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x5594737e4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737dae30 0x5594737e6930 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1043898605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737e02e0 0x5594737e3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 -- 172.21.15.70:0/1043898605 >> 172.21.15.70:0/1043898605 conn(0x559473752860 msgr2=0x5594737d9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:02:42.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1805600700 0 client.15906 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:02:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 -- 172.21.15.70:0/1043898605 shutdown_connections 2024-05-08T07:02:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 1 -- 172.21.15.70:0/1043898605 wait complete. 2024-05-08T07:02:42.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.232+0000 7f1828eccb80 20 client.15906 trim_cache size 0 max 16384 2024-05-08T07:02:42.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.262+0000 7f1828eccb80 1 Processor -- start 2024-05-08T07:02:42.262 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:42 smithi070 ceph-mon[29591]: pgmap v507: 129 pgs: 129 active+clean; 764 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.5 MiB/s wr, 26 op/s 2024-05-08T07:02:42.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.262+0000 7f1828eccb80 1 -- start start 2024-05-08T07:02:42.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.263+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737f9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.263+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x559473804a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.263+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737da960 0x559473804f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.263+0000 7f1828eccb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18181afb60 con 0x5594737e02e0 2024-05-08T07:02:42.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.263+0000 7f1828eccb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f18181ad3f0 con 0x5594737da960 2024-05-08T07:02:42.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.263+0000 7f1828eccb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f18181ab280 con 0x5594737e0c00 2024-05-08T07:02:42.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.263+0000 7f1816a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.263+0000 7f1816a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737f9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47256/0 (socket says 172.21.15.70:47256) 2024-05-08T07:02:42.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.263+0000 7f1816a00700 1 -- 172.21.15.70:0/3179850920 learned_addr learned my addr 172.21.15.70:0/3179850920 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:02:42.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.264+0000 7f1817400700 1 --2- 172.21.15.70:0/3179850920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x559473804a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.264+0000 7f1816a00700 1 -- 172.21.15.70:0/3179850920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 msgr2=0x559473804a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:02:42.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.264+0000 7f1816a00700 1 --2- 172.21.15.70:0/3179850920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x559473804a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.264+0000 7f1816a00700 1 -- 172.21.15.70:0/3179850920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737da960 msgr2=0x559473804f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:02:42.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.264+0000 7f1816a00700 1 --2- 172.21.15.70:0/3179850920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737da960 0x559473804f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.264+0000 7f1816a00700 1 -- 172.21.15.70:0/3179850920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594737d5670 con 0x5594737e02e0 2024-05-08T07:02:42.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.264+0000 7f1816a00700 1 --2- 172.21.15.70:0/3179850920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737f9040 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1800011040 tx=0x7f1800005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927ea133251a138d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:02:42.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.265+0000 7f1807e00700 1 -- 172.21.15.70:0/3179850920 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800039070 con 0x5594737e02e0 2024-05-08T07:02:42.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.265+0000 7f1807e00700 1 -- 172.21.15.70:0/3179850920 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f180001c070 con 0x5594737e02e0 2024-05-08T07:02:42.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.265+0000 7f1807e00700 1 -- 172.21.15.70:0/3179850920 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180000f960 con 0x5594737e02e0 2024-05-08T07:02:42.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.266+0000 7f1828eccb80 1 -- 172.21.15.70:0/3179850920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 msgr2=0x5594737f9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:42.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.266+0000 7f1828eccb80 1 --2- 172.21.15.70:0/3179850920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737f9040 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1800011040 tx=0x7f1800005800 comp rx=0 tx=0).stop 2024-05-08T07:02:42.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.266+0000 7f1828eccb80 1 -- 172.21.15.70:0/3179850920 shutdown_connections 2024-05-08T07:02:42.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.266+0000 7f1828eccb80 1 --2- 172.21.15.70:0/3179850920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737da960 0x559473804f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.266+0000 7f1828eccb80 1 --2- 172.21.15.70:0/3179850920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e02e0 0x5594737f9040 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.266+0000 7f1828eccb80 1 --2- 172.21.15.70:0/3179850920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e0c00 0x559473804a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.266+0000 7f1828eccb80 1 -- 172.21.15.70:0/3179850920 >> 172.21.15.70:0/3179850920 conn(0x559473752860 msgr2=0x5594737da250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:02:42.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.266+0000 7f1828eccb80 1 -- 172.21.15.70:0/3179850920 shutdown_connections 2024-05-08T07:02:42.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.267+0000 7f1828eccb80 1 -- 172.21.15.70:0/3179850920 wait complete. 2024-05-08T07:02:42.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.267+0000 7f1828eccb80 1 -- start start 2024-05-08T07:02:42.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.267+0000 7f1828eccb80 1 Processor -- start 2024-05-08T07:02:42.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e02e0 0x5594737f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e0c00 0x5594737f2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1828eccb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737f2fb0 0x559473867610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1828eccb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18181ab8d0 con 0x5594737e0c00 2024-05-08T07:02:42.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1828eccb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f18181acd20 con 0x5594737f2fb0 2024-05-08T07:02:42.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1828eccb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f18181abf80 con 0x5594737e02e0 2024-05-08T07:02:42.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1828eccb80 10 client.0 _ll_register_callbacks cb 0x5594736d3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:02:42.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1817400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e0c00 0x5594737f2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1817400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e0c00 0x5594737f2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47272/0 (socket says 172.21.15.70:47272) 2024-05-08T07:02:42.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.268+0000 7f1817400700 1 -- 172.21.15.70:0/1346717682 learned_addr learned my addr 172.21.15.70:0/1346717682 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:02:42.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.269+0000 7f1816a00700 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e02e0 0x5594737f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.269+0000 7f1816a00700 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737f2fb0 0x559473867610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.269+0000 7f1817400700 1 -- 172.21.15.70:0/1346717682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e02e0 msgr2=0x5594737f23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:02:42.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.269+0000 7f1817400700 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e02e0 0x5594737f23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.269+0000 7f1817400700 1 -- 172.21.15.70:0/1346717682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737f2fb0 msgr2=0x559473867610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:02:42.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.269+0000 7f1817400700 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737f2fb0 0x559473867610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:42.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.269+0000 7f1817400700 1 -- 172.21.15.70:0/1346717682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559473867e50 con 0x5594737e0c00 2024-05-08T07:02:42.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.269+0000 7f1817400700 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e0c00 0x5594737f2910 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f18080092a0 tx=0x7f1808011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a535f9946301d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:02:42.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.269+0000 7f1805600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:02:42.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.270+0000 7f1805600700 1 -- 172.21.15.70:0/1346717682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808005250 con 0x5594737e0c00 2024-05-08T07:02:42.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.270+0000 7f1805600700 1 -- 172.21.15.70:0/1346717682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9583+0+0 (secure 0 0 0) 0x7f18080053f0 con 0x5594737e0c00 2024-05-08T07:02:42.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.270+0000 7f1828eccb80 1 -- 172.21.15.70:0/1346717682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f180001c070 con 0x5594737e0c00 2024-05-08T07:02:42.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.271+0000 7f1805600700 1 -- 172.21.15.70:0/1346717682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18080055f0 con 0x5594737e0c00 2024-05-08T07:02:42.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.271+0000 7f1828eccb80 10 client.15912 fetch_fsmap learned FSMap version 28 2024-05-08T07:02:42.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.271+0000 7f1828eccb80 1 -- 172.21.15.70:0/1346717682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559473869130 con 0x5594737e0c00 2024-05-08T07:02:42.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.271+0000 7f1805600700 1 -- 172.21.15.70:0/1346717682 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f180001c070 con 0x5594737e0c00 2024-05-08T07:02:42.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.271+0000 7f1805600700 1 -- 172.21.15.70:0/1346717682 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f1808004b60 con 0x5594737e0c00 2024-05-08T07:02:42.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.272+0000 7f1828eccb80 10 client.15912 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:02:42.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.272+0000 7f1828eccb80 10 client.15912 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:02:42.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.272+0000 7f1828eccb80 20 client.15912 populate_metadata read hostname 'smithi070' 2024-05-08T07:02:42.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.272+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5594738695d0 0x55947386b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:02:42.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.272+0000 7f1828eccb80 4 client.15912 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.25, "await_for": 42.0}] 2024-05-08T07:02:42.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.272+0000 7f1828eccb80 1 -- 172.21.15.70:0/1346717682 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.25, "await_for": 42.0}) -- 0x55947373a590 con 0x5594738695d0 2024-05-08T07:02:42.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.273+0000 7f1816a00700 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5594738695d0 0x55947386b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:02:42.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.274+0000 7f1816a00700 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5594738695d0 0x55947386b9f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e4df4f626e45a16 server_cookie=5f76a0e8cca326df in_seq=0 out_seq=0 2024-05-08T07:02:42.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:42.274+0000 7f1805600700 10 client.15912 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:02:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:42 smithi194 ceph-mon[33679]: pgmap v507: 129 pgs: 129 active+clean; 764 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.5 MiB/s wr, 26 op/s 2024-05-08T07:02:42.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:42 smithi172 ceph-mon[33377]: pgmap v507: 129 pgs: 129 active+clean; 764 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.5 MiB/s wr, 26 op/s 2024-05-08T07:02:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:44 smithi194 ceph-mon[33679]: pgmap v508: 129 pgs: 129 active+clean; 764 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.5 MiB/s wr, 26 op/s 2024-05-08T07:02:44.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:44 smithi070 ceph-mon[29591]: pgmap v508: 129 pgs: 129 active+clean; 764 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.5 MiB/s wr, 26 op/s 2024-05-08T07:02:44.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:44 smithi172 ceph-mon[33377]: pgmap v508: 129 pgs: 129 active+clean; 764 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 7.5 MiB/s wr, 26 op/s 2024-05-08T07:02:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:46 smithi070 ceph-mon[29591]: pgmap v509: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 11 MiB/s wr, 43 op/s 2024-05-08T07:02:46.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:46 smithi172 ceph-mon[33377]: pgmap v509: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 11 MiB/s wr, 43 op/s 2024-05-08T07:02:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:46 smithi194 ceph-mon[33679]: pgmap v509: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 11 MiB/s wr, 43 op/s 2024-05-08T07:02:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:48 smithi070 ceph-mon[29591]: pgmap v510: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 8.3 MiB/s wr, 31 op/s 2024-05-08T07:02:48.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:48 smithi172 ceph-mon[33377]: pgmap v510: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 8.3 MiB/s wr, 31 op/s 2024-05-08T07:02:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:48 smithi194 ceph-mon[33679]: pgmap v510: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 8.3 MiB/s wr, 31 op/s 2024-05-08T07:02:50.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:50 smithi070 ceph-mon[29591]: pgmap v511: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 8.3 MiB/s wr, 35 op/s 2024-05-08T07:02:50.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:50 smithi172 ceph-mon[33377]: pgmap v511: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 8.3 MiB/s wr, 35 op/s 2024-05-08T07:02:50.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:50 smithi194 ceph-mon[33679]: pgmap v511: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 8.3 MiB/s wr, 35 op/s 2024-05-08T07:02:51.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.395+0000 7f1805600700 1 -- 172.21.15.70:0/1346717682 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55947373a590 con 0x5594738695d0 2024-05-08T07:02:51.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.395+0000 7f1805600700 10 client.15912 handle_command_reply: tid=0 2024-05-08T07:02:51.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.395+0000 7f1828eccb80 1 client.15912 shutdown 2024-05-08T07:02:51.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.396+0000 7f1828eccb80 1 -- 172.21.15.70:0/1346717682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e0c00 msgr2=0x5594737f2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:51.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.396+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e0c00 0x5594737f2910 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f18080092a0 tx=0x7f1808011e50 comp rx=0 tx=0).stop 2024-05-08T07:02:51.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.396+0000 7f1828eccb80 1 -- 172.21.15.70:0/1346717682 shutdown_connections 2024-05-08T07:02:51.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.396+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5594738695d0 0x55947386b9f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:51.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.396+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5594737f2fb0 0x559473867610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:51.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.396+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5594737e02e0 0x5594737f23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:51.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.396+0000 7f1828eccb80 1 --2- 172.21.15.70:0/1346717682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5594737e0c00 0x5594737f2910 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:51.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.396+0000 7f1828eccb80 1 -- 172.21.15.70:0/1346717682 >> 172.21.15.70:0/1346717682 conn(0x559473752860 msgr2=0x5594737ddd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:02:51.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.396+0000 7f1805600700 0 client.15912 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:02:51.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.397+0000 7f1828eccb80 1 -- 172.21.15.70:0/1346717682 shutdown_connections 2024-05-08T07:02:51.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.397+0000 7f1828eccb80 1 -- 172.21.15.70:0/1346717682 wait complete. 2024-05-08T07:02:51.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.397+0000 7f1828eccb80 20 client.15912 trim_cache size 0 max 16384 2024-05-08T07:02:51.398 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:02:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:02:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:02:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 42, 2024-05-08T07:02:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:02:51.398 INFO:teuthology.orchestra.run.smithi070.stdout: "87ec7e2": { 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 42, 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.2, 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:02:51.399 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.398+0000 7f181d000700 1 -- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f17fc0b2b20 msgr2=0x7f17fc0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.398+0000 7f181d000700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f17fc0b2b20 0x7f17fc0b4fe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18100df970 tx=0x7f1810009040 comp rx=0 tx=0).stop 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.398+0000 7f181d000700 1 -- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818107810 msgr2=0x7f181819ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.398+0000 7f181d000700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818107810 0x7f181819ba00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f181000ef30 tx=0x7f181000c450 comp rx=0 tx=0).stop 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.399+0000 7f181d000700 1 -- 172.21.15.70:0/2975429748 shutdown_connections 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.399+0000 7f181d000700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f17fc0b2b20 0x7f17fc0b4fe0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:51.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.399+0000 7f181d000700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1818107810 0x7f181819ba00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:51.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.399+0000 7f181d000700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1818105840 0x7f18181a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:51.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.399+0000 7f181d000700 1 --2- 172.21.15.70:0/2975429748 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1818106160 0x7f18181a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:02:51.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.399+0000 7f181d000700 1 -- 172.21.15.70:0/2975429748 >> 172.21.15.70:0/2975429748 conn(0x7f1818100fb0 msgr2=0x7f18181028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:02:51.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.399+0000 7f181d000700 1 -- 172.21.15.70:0/2975429748 shutdown_connections 2024-05-08T07:02:51.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:02:51.399+0000 7f181d000700 1 -- 172.21.15.70:0/2975429748 wait complete. 2024-05-08T07:02:52.434 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '87ec7e2', quiesce took 17.3 seconds. Will release after: 19.25 2024-05-08T07:02:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:52 smithi070 ceph-mon[29591]: pgmap v512: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.8 MiB/s wr, 21 op/s 2024-05-08T07:02:52.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:52 smithi172 ceph-mon[33377]: pgmap v512: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.8 MiB/s wr, 21 op/s 2024-05-08T07:02:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:52 smithi194 ceph-mon[33679]: pgmap v512: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.8 MiB/s wr, 21 op/s 2024-05-08T07:02:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:54 smithi070 ceph-mon[29591]: pgmap v513: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.8 MiB/s wr, 21 op/s 2024-05-08T07:02:54.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:54 smithi172 ceph-mon[33377]: pgmap v513: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.8 MiB/s wr, 21 op/s 2024-05-08T07:02:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:54 smithi194 ceph-mon[33679]: pgmap v513: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 3.8 MiB/s wr, 21 op/s 2024-05-08T07:02:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:56 smithi070 ceph-mon[29591]: pgmap v514: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 3.8 MiB/s wr, 25 op/s 2024-05-08T07:02:56.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:56 smithi172 ceph-mon[33377]: pgmap v514: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 3.8 MiB/s wr, 25 op/s 2024-05-08T07:02:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:56 smithi194 ceph-mon[33679]: pgmap v514: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 3.8 MiB/s wr, 25 op/s 2024-05-08T07:02:58.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:02:58 smithi070 ceph-mon[29591]: pgmap v515: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 34 KiB/s wr, 8 op/s 2024-05-08T07:02:58.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:02:58 smithi172 ceph-mon[33377]: pgmap v515: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 34 KiB/s wr, 8 op/s 2024-05-08T07:02:58.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:02:58 smithi194 ceph-mon[33679]: pgmap v515: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 34 KiB/s wr, 8 op/s 2024-05-08T07:03:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:00 smithi070 ceph-mon[29591]: pgmap v516: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-05-08T07:03:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:00 smithi172 ceph-mon[33377]: pgmap v516: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-05-08T07:03:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:00 smithi194 ceph-mon[33679]: pgmap v516: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 11 op/s 2024-05-08T07:03:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:01 smithi070 ceph-mon[29591]: pgmap v517: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 KiB/s wr, 6 op/s 2024-05-08T07:03:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:01 smithi172 ceph-mon[33377]: pgmap v517: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 KiB/s wr, 6 op/s 2024-05-08T07:03:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:01 smithi194 ceph-mon[33679]: pgmap v517: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 KiB/s wr, 6 op/s 2024-05-08T07:03:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:04 smithi194 ceph-mon[33679]: pgmap v518: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 KiB/s wr, 6 op/s 2024-05-08T07:03:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:04 smithi070 ceph-mon[29591]: pgmap v518: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 KiB/s wr, 6 op/s 2024-05-08T07:03:04.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:04 smithi172 ceph-mon[33377]: pgmap v518: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 32 KiB/s wr, 6 op/s 2024-05-08T07:03:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:06 smithi194 ceph-mon[33679]: pgmap v519: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 27 op/s 2024-05-08T07:03:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:06 smithi070 ceph-mon[29591]: pgmap v519: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 27 op/s 2024-05-08T07:03:06.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:06 smithi172 ceph-mon[33377]: pgmap v519: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 KiB/s wr, 27 op/s 2024-05-08T07:03:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:08 smithi194 ceph-mon[33679]: pgmap v520: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:03:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:08 smithi070 ceph-mon[29591]: pgmap v520: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:03:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:08 smithi172 ceph-mon[33377]: pgmap v520: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:03:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:10 smithi194 ceph-mon[33679]: pgmap v521: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-05-08T07:03:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:10 smithi194 ceph-mon[33679]: osdmap e114: 12 total, 12 up, 12 in 2024-05-08T07:03:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:10 smithi070 ceph-mon[29591]: pgmap v521: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-05-08T07:03:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:10 smithi070 ceph-mon[29591]: osdmap e114: 12 total, 12 up, 12 in 2024-05-08T07:03:10.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:10 smithi172 ceph-mon[33377]: pgmap v521: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-05-08T07:03:10.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:10 smithi172 ceph-mon[33377]: osdmap e114: 12 total, 12 up, 12 in 2024-05-08T07:03:11.685 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:03:12.138 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:03:12.507 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:12 smithi070 ceph-mon[29591]: pgmap v523: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-05-08T07:03:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:12 smithi194 ceph-mon[33679]: pgmap v523: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-05-08T07:03:12.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:12 smithi172 ceph-mon[33377]: pgmap v523: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-05-08T07:03:14.499 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:14 smithi070 ceph-mon[29591]: pgmap v524: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-05-08T07:03:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.541+0000 7f8635e00700 1 -- 172.21.15.70:0/863243423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 msgr2=0x7f8630112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.541+0000 7f8635e00700 1 --2- 172.21.15.70:0/863243423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 0x7f8630112290 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f862800b0a0 tx=0x7f862800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.541+0000 7f8635e00700 1 -- 172.21.15.70:0/863243423 shutdown_connections 2024-05-08T07:03:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.541+0000 7f8635e00700 1 --2- 172.21.15.70:0/863243423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 0x7f8630112290 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.541+0000 7f8635e00700 1 --2- 172.21.15.70:0/863243423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f86300756d0 0x7f8630075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.541+0000 7f8635e00700 1 --2- 172.21.15.70:0/863243423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8630075ff0 0x7f863010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.541+0000 7f8635e00700 1 -- 172.21.15.70:0/863243423 >> 172.21.15.70:0/863243423 conn(0x7f863007a600 msgr2=0x7f863007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.541+0000 7f8635e00700 1 -- 172.21.15.70:0/863243423 shutdown_connections 2024-05-08T07:03:14.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.542+0000 7f8635e00700 1 -- 172.21.15.70:0/863243423 wait complete. 2024-05-08T07:03:14.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.542+0000 7f8635e00700 1 Processor -- start 2024-05-08T07:03:14.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.543+0000 7f8635e00700 1 -- start start 2024-05-08T07:03:14.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.543+0000 7f8635e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86300756d0 0x7f86301a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:14.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.543+0000 7f8635e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8630075ff0 0x7f86301a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:14.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.543+0000 7f8635e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 0x7f863019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:14.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.543+0000 7f8635e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8630115750 con 0x7f863010fea0 2024-05-08T07:03:14.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.543+0000 7f8635e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f86301155d0 con 0x7f8630075ff0 2024-05-08T07:03:14.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.543+0000 7f8635e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f86301158d0 con 0x7f86300756d0 2024-05-08T07:03:14.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.543+0000 7f862f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 0x7f863019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:14.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 0x7f863019ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56928/0 (socket says 172.21.15.70:56928) 2024-05-08T07:03:14.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862f400700 1 -- 172.21.15.70:0/408416709 learned_addr learned my addr 172.21.15.70:0/408416709 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:14.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862e000700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8630075ff0 0x7f86301a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:14.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862ea00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86300756d0 0x7f86301a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:14.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862f400700 1 -- 172.21.15.70:0/408416709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86300756d0 msgr2=0x7f86301a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:14.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862f400700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86300756d0 0x7f86301a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862f400700 1 -- 172.21.15.70:0/408416709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8630075ff0 msgr2=0x7f86301a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:14.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862f400700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8630075ff0 0x7f86301a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862f400700 1 -- 172.21.15.70:0/408416709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863019c1b0 con 0x7f863010fea0 2024-05-08T07:03:14.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.544+0000 7f862f400700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 0x7f863019ba50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8628006070 tx=0x7f8628004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:14.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.545+0000 7f8634a00700 1 -- 172.21.15.70:0/408416709 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8628021070 con 0x7f863010fea0 2024-05-08T07:03:14.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.545+0000 7f8634a00700 1 -- 172.21.15.70:0/408416709 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8628007c00 con 0x7f863010fea0 2024-05-08T07:03:14.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.545+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863019c440 con 0x7f863010fea0 2024-05-08T07:03:14.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.545+0000 7f8634a00700 1 -- 172.21.15.70:0/408416709 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8628004760 con 0x7f863010fea0 2024-05-08T07:03:14.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.545+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86301a8760 con 0x7f863010fea0 2024-05-08T07:03:14.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.547+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863006a190 con 0x7f863010fea0 2024-05-08T07:03:14.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.548+0000 7f8634a00700 1 -- 172.21.15.70:0/408416709 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8628003a00 con 0x7f863010fea0 2024-05-08T07:03:14.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.550+0000 7f8634a00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f86140b2a70 0x7f86140b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:14.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.550+0000 7f8634a00700 1 -- 172.21.15.70:0/408416709 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9671+0+0 (secure 0 0 0) 0x7f862800f020 con 0x7f863010fea0 2024-05-08T07:03:14.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.550+0000 7f862ea00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f86140b2a70 0x7f86140b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:14.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.551+0000 7f862ea00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f86140b2a70 0x7f86140b4f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8620005950 tx=0x7f86200058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:14.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.555+0000 7f8634a00700 1 -- 172.21.15.70:0/408416709 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f862802a020 con 0x7f863010fea0 2024-05-08T07:03:14.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:14 smithi172 ceph-mon[33377]: pgmap v524: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-05-08T07:03:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:14 smithi194 ceph-mon[33679]: pgmap v524: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 62 KiB/s wr, 27 op/s 2024-05-08T07:03:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.844+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f863019cf80 con 0x7f863010fea0 2024-05-08T07:03:14.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.845+0000 7f8634a00700 1 -- 172.21.15.70:0/408416709 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f86280ab590 con 0x7f863010fea0 2024-05-08T07:03:14.845 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:03:14.845 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f86140b2a70 msgr2=0x7f86140b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f86140b2a70 0x7f86140b4f30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8620005950 tx=0x7f86200058e0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 msgr2=0x7f863019ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 0x7f863019ba50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8628006070 tx=0x7f8628004e00 comp rx=0 tx=0).stop 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 shutdown_connections 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f86140b2a70 0x7f86140b4f30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f863010fea0 0x7f863019ba50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86300756d0 0x7f86301a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 --2- 172.21.15.70:0/408416709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8630075ff0 0x7f86301a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:14.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.849+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 >> 172.21.15.70:0/408416709 conn(0x7f863007a600 msgr2=0x7f86301006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:14.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.850+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 shutdown_connections 2024-05-08T07:03:14.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:14.850+0000 7f8635e00700 1 -- 172.21.15.70:0/408416709 wait complete. 2024-05-08T07:03:14.851 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:03:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:03:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:15 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/408416709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:03:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:03:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:15 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/408416709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:03:15.749 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 87ec7e2 --release --await' 2024-05-08T07:03:15.749 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 87ec7e2 --release --await 2024-05-08T07:03:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:03:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:15 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/408416709' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:03:16.154 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:03:16.538 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:16 smithi070 ceph-mon[29591]: pgmap v525: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:16.538 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.539 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.539 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.539 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.539 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.539 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:16 smithi172 ceph-mon[33377]: pgmap v525: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:16 smithi194 ceph-mon[33679]: pgmap v525: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:03:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:03:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:03:17.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:03:17.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:03:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:03:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:03:18.351 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:18 smithi070 ceph-mon[29591]: pgmap v526: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:18.351 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:18 smithi070 ceph-mon[29591]: osdmap e115: 12 total, 12 up, 12 in 2024-05-08T07:03:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:18 smithi172 ceph-mon[33377]: pgmap v526: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:18 smithi172 ceph-mon[33377]: osdmap e115: 12 total, 12 up, 12 in 2024-05-08T07:03:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.704+0000 7f3ae1400700 1 -- 172.21.15.70:0/3283773813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 msgr2=0x7f3adc10f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.704+0000 7f3ae1400700 1 --2- 172.21.15.70:0/3283773813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 0x7f3adc10f710 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009990 tx=0x7f3ac8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.704+0000 7f3ae1400700 1 -- 172.21.15.70:0/3283773813 shutdown_connections 2024-05-08T07:03:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.704+0000 7f3ae1400700 1 --2- 172.21.15.70:0/3283773813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc10fc50 0x7f3adc112060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.704+0000 7f3ae1400700 1 --2- 172.21.15.70:0/3283773813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3adc075870 0x7f3adc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.704+0000 7f3ae1400700 1 --2- 172.21.15.70:0/3283773813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 0x7f3adc10f710 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.704+0000 7f3ae1400700 1 -- 172.21.15.70:0/3283773813 >> 172.21.15.70:0/3283773813 conn(0x7f3adc0feec0 msgr2=0x7f3adc1012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.704+0000 7f3ae1400700 1 -- 172.21.15.70:0/3283773813 shutdown_connections 2024-05-08T07:03:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.704+0000 7f3ae1400700 1 -- 172.21.15.70:0/3283773813 wait complete. 2024-05-08T07:03:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.705+0000 7f3ae1400700 1 Processor -- start 2024-05-08T07:03:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.705+0000 7f3ae1400700 1 -- start start 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3ae1400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3adc075870 0x7f3adc1a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3ae1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 0x7f3adc1a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3ae1400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc10fc50 0x7f3adc19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3ae1400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc1156c0 con 0x7f3adc076190 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3ae1400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc115540 con 0x7f3adc075870 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3ae1400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc115840 con 0x7f3adc10fc50 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3adb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 0x7f3adc1a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3adb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 0x7f3adc1a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52504/0 (socket says 172.21.15.70:52504) 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3adb400700 1 -- 172.21.15.70:0/4171777363 learned_addr learned my addr 172.21.15.70:0/4171777363 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3adbe00700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3adc075870 0x7f3adc1a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.706+0000 7f3ae0a00700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc10fc50 0x7f3adc19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.707+0000 7f3adb400700 1 -- 172.21.15.70:0/4171777363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc10fc50 msgr2=0x7f3adc19bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:18.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.707+0000 7f3adb400700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc10fc50 0x7f3adc19bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.707+0000 7f3adb400700 1 -- 172.21.15.70:0/4171777363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3adc075870 msgr2=0x7f3adc1a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:18.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.707+0000 7f3adb400700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3adc075870 0x7f3adc1a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.707+0000 7f3adb400700 1 -- 172.21.15.70:0/4171777363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3adc19c240 con 0x7f3adc076190 2024-05-08T07:03:18.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.707+0000 7f3adbe00700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3adc075870 0x7f3adc1a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:03:18.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.707+0000 7f3adb400700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 0x7f3adc1a1e60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000c00 tx=0x7f3ac8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:18.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.707+0000 7f3ad8c00700 1 -- 172.21.15.70:0/4171777363 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8027070 con 0x7f3adc076190 2024-05-08T07:03:18.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.708+0000 7f3ae1400700 1 -- 172.21.15.70:0/4171777363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3adc19c4d0 con 0x7f3adc076190 2024-05-08T07:03:18.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.708+0000 7f3ad8c00700 1 -- 172.21.15.70:0/4171777363 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ac800fb80 con 0x7f3adc076190 2024-05-08T07:03:18.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.708+0000 7f3ad8c00700 1 -- 172.21.15.70:0/4171777363 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8022c30 con 0x7f3adc076190 2024-05-08T07:03:18.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.708+0000 7f3ae1400700 1 -- 172.21.15.70:0/4171777363 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3adc1a87f0 con 0x7f3adc076190 2024-05-08T07:03:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.712+0000 7f3ad8c00700 1 -- 172.21.15.70:0/4171777363 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3ac802a070 con 0x7f3adc076190 2024-05-08T07:03:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.712+0000 7f3aed2bcb80 1 Processor -- start 2024-05-08T07:03:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.713+0000 7f3aed2bcb80 1 -- start start 2024-05-08T07:03:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.713+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0250 0x556af89a0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.713+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0b70 0x556af899a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.713+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af899b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.713+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556af88ecb20 con 0x556af899ada0 2024-05-08T07:03:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.713+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556af888a860 con 0x556af89a0b70 2024-05-08T07:03:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.713+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556af88e8ae0 con 0x556af89a0250 2024-05-08T07:03:18.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3adb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af899b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3adb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af899b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52508/0 (socket says 172.21.15.70:52508) 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3adb400700 1 -- 172.21.15.70:0/4221650129 learned_addr learned my addr 172.21.15.70:0/4221650129 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3ae0a00700 1 --2- 172.21.15.70:0/4221650129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0250 0x556af89a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3adbe00700 1 --2- 172.21.15.70:0/4221650129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0b70 0x556af899a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3ad8c00700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ac00b29f0 0x7f3ac00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3adb400700 1 -- 172.21.15.70:0/4221650129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0250 msgr2=0x556af89a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3adb400700 1 --2- 172.21.15.70:0/4221650129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0250 0x556af89a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3adb400700 1 -- 172.21.15.70:0/4221650129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0b70 msgr2=0x556af899a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3adb400700 1 --2- 172.21.15.70:0/4221650129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0b70 0x556af899a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.714+0000 7f3adb400700 1 -- 172.21.15.70:0/4221650129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af88399d0 con 0x556af899ada0 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.715+0000 7f3ae0a00700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ac00b29f0 0x7f3ac00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.715+0000 7f3ad8c00700 1 -- 172.21.15.70:0/4171777363 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7f3ac80e3770 con 0x7f3adc076190 2024-05-08T07:03:18.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.715+0000 7f3adb400700 1 --2- 172.21.15.70:0/4221650129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af899b200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80e0980 tx=0x7f3ac809eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e002cd5fafeaf405 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:18.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.715+0000 7f3ad1600700 1 -- 172.21.15.70:0/4221650129 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80aa430 con 0x556af899ada0 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.715+0000 7f3ae0a00700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ac00b29f0 0x7f3ac00b4eb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3adc06cb00 tx=0x7f3ad4004ad0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.715+0000 7f3ad1600700 1 -- 172.21.15.70:0/4221650129 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ac802c9b0 con 0x556af899ada0 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.715+0000 7f3ad1600700 1 -- 172.21.15.70:0/4221650129 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac802c440 con 0x556af899ada0 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.716+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/4221650129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 msgr2=0x556af899b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.716+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/4221650129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af899b200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80e0980 tx=0x7f3ac809eee0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.716+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/4221650129 shutdown_connections 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.716+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/4221650129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af899b200 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.716+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/4221650129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0250 0x556af89a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.716+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/4221650129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0b70 0x556af899a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.716+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/4221650129 >> 172.21.15.70:0/4221650129 conn(0x556af89127d0 msgr2=0x556af89952e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.716+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/4221650129 shutdown_connections 2024-05-08T07:03:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.716+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/4221650129 wait complete. 2024-05-08T07:03:18.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.717+0000 7f3aed2bcb80 1 -- start start 2024-05-08T07:03:18.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.717+0000 7f3aed2bcb80 1 Processor -- start 2024-05-08T07:03:18.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af899ada0 0x556af89a67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0b70 0x556af89a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556af88ecb20 con 0x556af89a0b70 2024-05-08T07:03:18.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556af8852c20 con 0x556af89a0250 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556af89a7450 con 0x556af899ada0 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3aed2bcb80 10 client.0 _ll_register_callbacks cb 0x556af8893d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3ae0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0b70 0x556af89a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3ae0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0b70 0x556af89a40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52520/0 (socket says 172.21.15.70:52520) 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3ae0a00700 1 -- 172.21.15.70:0/2198555144 learned_addr learned my addr 172.21.15.70:0/2198555144 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3adbe00700 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af899ada0 0x556af89a67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.718+0000 7f3adb400700 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3ae0a00700 1 -- 172.21.15.70:0/2198555144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af899ada0 msgr2=0x556af89a67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3ae0a00700 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af899ada0 0x556af89a67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3ae0a00700 1 -- 172.21.15.70:0/2198555144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 msgr2=0x556af89a3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3ae0a00700 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3ae0a00700 1 -- 172.21.15.70:0/2198555144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af88b2520 con 0x556af89a0b70 2024-05-08T07:03:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3adb400700 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:03:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3ae0a00700 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0b70 0x556af89a40a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4017c40 tx=0x7f3ad4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d708660774a6c1ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3ac6000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:03:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3ac6000700 1 -- 172.21.15.70:0/2198555144 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad401d070 con 0x556af89a0b70 2024-05-08T07:03:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3ac6000700 1 -- 172.21.15.70:0/2198555144 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7f3ad4016c80 con 0x556af89a0b70 2024-05-08T07:03:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.719+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/2198555144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ac802c9b0 con 0x556af89a0b70 2024-05-08T07:03:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.720+0000 7f3ac6000700 1 -- 172.21.15.70:0/2198555144 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3ad402f050 con 0x556af89a0b70 2024-05-08T07:03:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.720+0000 7f3aed2bcb80 10 client.15930 fetch_fsmap learned FSMap version 28 2024-05-08T07:03:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.720+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/2198555144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556af89b1a90 con 0x556af89a0b70 2024-05-08T07:03:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.720+0000 7f3ac6000700 1 -- 172.21.15.70:0/2198555144 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ac802c9b0 con 0x556af89a0b70 2024-05-08T07:03:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.720+0000 7f3ac6000700 1 -- 172.21.15.70:0/2198555144 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3ad402a030 con 0x556af89a0b70 2024-05-08T07:03:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.720+0000 7f3aed2bcb80 10 client.15930 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:03:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.720+0000 7f3aed2bcb80 10 client.15930 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:03:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.720+0000 7f3aed2bcb80 20 client.15930 populate_metadata read hostname 'smithi070' 2024-05-08T07:03:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.720+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556af89b4170 0x556af89b6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.721+0000 7f3aed2bcb80 4 client.15930 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:03:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.721+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/2198555144 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556af8967240 con 0x556af89b4170 2024-05-08T07:03:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.721+0000 7f3adbe00700 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556af89b4170 0x556af89b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.722+0000 7f3adbe00700 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556af89b4170 0x556af89b6560 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=484281406b5eaedd server_cookie=fcb406692b562fb in_seq=0 out_seq=0 2024-05-08T07:03:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.722+0000 7f3ac6000700 10 client.15930 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:03:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.724+0000 7f3ac6000700 1 -- 172.21.15.70:0/2198555144 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556af8967240 con 0x556af89b4170 2024-05-08T07:03:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.724+0000 7f3ac6000700 10 client.15930 handle_command_reply: tid=0 2024-05-08T07:03:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.724+0000 7f3aed2bcb80 1 client.15930 shutdown 2024-05-08T07:03:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.724+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/2198555144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0b70 msgr2=0x556af89a40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.724+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0b70 0x556af89a40a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4017c40 tx=0x7f3ad4009040 comp rx=0 tx=0).stop 2024-05-08T07:03:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.724+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/2198555144 shutdown_connections 2024-05-08T07:03:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.724+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556af89b4170 0x556af89b6560 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.724+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0b70 0x556af89a40a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.724+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af899ada0 0x556af89a67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.725+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/2198555144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.725+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/2198555144 >> 172.21.15.70:0/2198555144 conn(0x556af89127d0 msgr2=0x556af8999770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.725+0000 7f3ac6000700 0 client.15930 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:03:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.725+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/2198555144 shutdown_connections 2024-05-08T07:03:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.725+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/2198555144 wait complete. 2024-05-08T07:03:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.725+0000 7f3aed2bcb80 20 client.15930 trim_cache size 0 max 16384 2024-05-08T07:03:18.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.746+0000 7f3aed2bcb80 1 Processor -- start 2024-05-08T07:03:18.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.746+0000 7f3aed2bcb80 1 -- start start 2024-05-08T07:03:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af899ada0 0x556af89b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0250 0x556af89a2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 0x556af89a2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc1b3fa0 con 0x556af89a0250 2024-05-08T07:03:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc1b1830 con 0x556af899ada0 2024-05-08T07:03:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc1af6a0 con 0x556af89a0b70 2024-05-08T07:03:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3adb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0250 0x556af89a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3adb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0250 0x556af89a2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52530/0 (socket says 172.21.15.70:52530) 2024-05-08T07:03:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3adb400700 1 -- 172.21.15.70:0/3605306601 learned_addr learned my addr 172.21.15.70:0/3605306601 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3adbe00700 1 --2- 172.21.15.70:0/3605306601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af899ada0 0x556af89b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.747+0000 7f3ae0a00700 1 --2- 172.21.15.70:0/3605306601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 0x556af89a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.748+0000 7f3adb400700 1 -- 172.21.15.70:0/3605306601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 msgr2=0x556af89a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.748+0000 7f3adb400700 1 --2- 172.21.15.70:0/3605306601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 0x556af89a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.748+0000 7f3adb400700 1 -- 172.21.15.70:0/3605306601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af899ada0 msgr2=0x556af89b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.748+0000 7f3adb400700 1 --2- 172.21.15.70:0/3605306601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af899ada0 0x556af89b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.748+0000 7f3adb400700 1 -- 172.21.15.70:0/3605306601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556af89a3930 con 0x556af89a0250 2024-05-08T07:03:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.748+0000 7f3adb400700 1 --2- 172.21.15.70:0/3605306601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0250 0x556af89a2450 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80a78d0 tx=0x7f3ac8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28314d5ad900a83 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:18.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.748+0000 7f3ad0c00700 1 -- 172.21.15.70:0/3605306601 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac802c610 con 0x556af89a0250 2024-05-08T07:03:18.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.748+0000 7f3ad0c00700 1 -- 172.21.15.70:0/3605306601 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ac802c440 con 0x556af89a0250 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.748+0000 7f3ad0c00700 1 -- 172.21.15.70:0/3605306601 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac802c7e0 con 0x556af89a0250 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3605306601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0250 msgr2=0x556af89a2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3605306601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0250 0x556af89a2450 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80a78d0 tx=0x7f3ac8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3605306601 shutdown_connections 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3605306601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 0x556af89a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3605306601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af899ada0 0x556af89b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3605306601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af89a0250 0x556af89a2450 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3605306601 >> 172.21.15.70:0/3605306601 conn(0x556af89127d0 msgr2=0x556af89a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3605306601 shutdown_connections 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3605306601 wait complete. 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.749+0000 7f3aed2bcb80 1 -- start start 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3aed2bcb80 1 Processor -- start 2024-05-08T07:03:18.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af89a96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3aed2bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 0x556af89aa130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc1afcf0 con 0x556af899ada0 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc1b1160 con 0x556af89a0250 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3aed2bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc1b03c0 con 0x556af89a0b70 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3aed2bcb80 10 client.0 _ll_register_callbacks cb 0x556af8893d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3adbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af89a96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3adbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af89a96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52536/0 (socket says 172.21.15.70:52536) 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.750+0000 7f3adbe00700 1 -- 172.21.15.70:0/3802763938 learned_addr learned my addr 172.21.15.70:0/3802763938 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3adb400700 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3adbe00700 1 -- 172.21.15.70:0/3802763938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 msgr2=0x556af89aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3ae0a00700 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 0x556af89aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3adbe00700 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 0x556af89aa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3adbe00700 1 -- 172.21.15.70:0/3802763938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 msgr2=0x556af89a9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3adbe00700 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3adbe00700 1 -- 172.21.15.70:0/3802763938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556af8a1eaf0 con 0x556af899ada0 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3adb400700 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3adbe00700 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af89a96b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3acc004520 tx=0x7f3acc00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336907d99b614967 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3ac6000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.751+0000 7f3ac6000700 1 -- 172.21.15.70:0/3802763938 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3acc01d5b0 con 0x556af899ada0 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3ac6000700 1 -- 172.21.15.70:0/3802763938 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7f3acc01d750 con 0x556af899ada0 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3802763938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ac802c440 con 0x556af899ada0 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3ac6000700 1 -- 172.21.15.70:0/3802763938 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3acc02d050 con 0x556af899ada0 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3aed2bcb80 10 client.15936 fetch_fsmap learned FSMap version 28 2024-05-08T07:03:18.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3802763938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556af8a1fea0 con 0x556af899ada0 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3ac6000700 1 -- 172.21.15.70:0/3802763938 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ac802c440 con 0x556af899ada0 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3ac6000700 1 -- 172.21.15.70:0/3802763938 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3acc011b60 con 0x556af899ada0 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3aed2bcb80 10 client.15936 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3aed2bcb80 10 client.15936 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3aed2bcb80 20 client.15936 populate_metadata read hostname 'smithi070' 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.752+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556af8a205f0 0x556af8a22a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.753+0000 7f3aed2bcb80 4 client.15936 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "87ec7e2", "release": true, "await": true}] 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.753+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3802763938 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "87ec7e2", "release": true, "await": true}) -- 0x556af88fa500 con 0x556af8a205f0 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.753+0000 7f3adb400700 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556af8a205f0 0x556af8a22a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.754+0000 7f3adb400700 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556af8a205f0 0x556af8a22a10 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a17bc6730456e913 server_cookie=e81ee57ee86213f2 in_seq=0 out_seq=0 2024-05-08T07:03:18.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:18.754+0000 7f3ac6000700 10 client.15936 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:03:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:18 smithi194 ceph-mon[33679]: pgmap v526: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:18 smithi194 ceph-mon[33679]: osdmap e115: 12 total, 12 up, 12 in 2024-05-08T07:03:20.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.560+0000 7f3ac6000700 1 -- 172.21.15.70:0/3802763938 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556af88fa500 con 0x556af8a205f0 2024-05-08T07:03:20.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.560+0000 7f3ac6000700 10 client.15936 handle_command_reply: tid=0 2024-05-08T07:03:20.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.560+0000 7f3aed2bcb80 1 client.15936 shutdown 2024-05-08T07:03:20.562 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:20 smithi070 ceph-mon[29591]: pgmap v528: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 6 op/s 2024-05-08T07:03:20.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.561+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3802763938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 msgr2=0x556af89a96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:20.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.561+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af89a96b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3acc004520 tx=0x7f3acc00bf60 comp rx=0 tx=0).stop 2024-05-08T07:03:20.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.562+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3802763938 shutdown_connections 2024-05-08T07:03:20.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.562+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556af8a205f0 0x556af8a22a10 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.562+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556af89a0b70 0x556af89aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.562+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556af899ada0 0x556af89a96b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.562+0000 7f3aed2bcb80 1 --2- 172.21.15.70:0/3802763938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556af89a0250 0x556af89a9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.562+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3802763938 >> 172.21.15.70:0/3802763938 conn(0x556af89127d0 msgr2=0x556af89a3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.562+0000 7f3ac6000700 0 client.15936 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.562+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3802763938 shutdown_connections 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.563+0000 7f3aed2bcb80 1 -- 172.21.15.70:0/3802763938 wait complete. 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.563+0000 7f3aed2bcb80 20 client.15936 trim_cache size 0 max 16384 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:03:20.564 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 44, 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "87ec7e2": { 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 44, 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.2, 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:03:20.565 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:03:20.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:20.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:20.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:20.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:20.566 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:20.566 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:03:20.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 -- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ac00b29f0 msgr2=0x7f3ac00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ac00b29f0 0x7f3ac00b4eb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3adc06cb00 tx=0x7f3ad4004ad0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 -- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 msgr2=0x7f3adc1a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 0x7f3adc1a1e60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8000c00 tx=0x7f3ac8005ef0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 -- 172.21.15.70:0/4171777363 shutdown_connections 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ac00b29f0 0x7f3ac00b4eb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc10fc50 0x7f3adc19bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3adc075870 0x7f3adc1a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 --2- 172.21.15.70:0/4171777363 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3adc076190 0x7f3adc1a1e60 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.564+0000 7f3ae1400700 1 -- 172.21.15.70:0/4171777363 >> 172.21.15.70:0/4171777363 conn(0x7f3adc0feec0 msgr2=0x7f3adc0ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.565+0000 7f3ae1400700 1 -- 172.21.15.70:0/4171777363 shutdown_connections 2024-05-08T07:03:20.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:20.565+0000 7f3ae1400700 1 -- 172.21.15.70:0/4171777363 wait complete. 2024-05-08T07:03:20.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:20 smithi172 ceph-mon[33377]: pgmap v528: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 6 op/s 2024-05-08T07:03:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:20 smithi194 ceph-mon[33679]: pgmap v528: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 6 op/s 2024-05-08T07:03:21.590 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '87ec7e2', seconds elapsed: 46.5 2024-05-08T07:03:21.590 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-05-08T07:03:21.590 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:03:22.089 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:03:22.523 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:22 smithi070 ceph-mon[29591]: pgmap v529: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:22.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:22 smithi172 ceph-mon[33377]: pgmap v529: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:22.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:22 smithi194 ceph-mon[33679]: pgmap v529: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:24.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:24 smithi070 ceph-mon[29591]: pgmap v530: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.593+0000 7fed1c400700 1 -- 172.21.15.70:0/2810624648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 msgr2=0x7fed141103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:24.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.593+0000 7fed1c400700 1 --2- 172.21.15.70:0/2810624648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 0x7fed141103d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fed0c00b0a0 tx=0x7fed0c00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.594+0000 7fed1c400700 1 -- 172.21.15.70:0/2810624648 shutdown_connections 2024-05-08T07:03:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.594+0000 7fed1c400700 1 --2- 172.21.15.70:0/2810624648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 0x7fed141103d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.594+0000 7fed1c400700 1 --2- 172.21.15.70:0/2810624648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed14108460 0x7fed14108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.594+0000 7fed1c400700 1 --2- 172.21.15.70:0/2810624648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14103550 0x7fed141039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.594+0000 7fed1c400700 1 -- 172.21.15.70:0/2810624648 >> 172.21.15.70:0/2810624648 conn(0x7fed1407a600 msgr2=0x7fed1407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.594+0000 7fed1c400700 1 -- 172.21.15.70:0/2810624648 shutdown_connections 2024-05-08T07:03:24.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.594+0000 7fed1c400700 1 -- 172.21.15.70:0/2810624648 wait complete. 2024-05-08T07:03:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.595+0000 7fed1c400700 1 Processor -- start 2024-05-08T07:03:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.595+0000 7fed1c400700 1 -- start start 2024-05-08T07:03:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed1c400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed14103550 0x7fed140757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:24.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed1c400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 0x7fed14075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed1c400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14108460 0x7fed14076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed1c400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fed141135a0 con 0x7fed14103ef0 2024-05-08T07:03:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed1c400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed14113420 con 0x7fed14108460 2024-05-08T07:03:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed1c400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fed14113720 con 0x7fed14103550 2024-05-08T07:03:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed19000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 0x7fed14075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed19000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 0x7fed14075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52554/0 (socket says 172.21.15.70:52554) 2024-05-08T07:03:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed19000700 1 -- 172.21.15.70:0/879788217 learned_addr learned my addr 172.21.15.70:0/879788217 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed19a00700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed14103550 0x7fed140757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:24.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.596+0000 7fed1a400700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14108460 0x7fed14076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.597+0000 7fed19000700 1 -- 172.21.15.70:0/879788217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed14103550 msgr2=0x7fed140757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.597+0000 7fed19000700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed14103550 0x7fed140757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.597+0000 7fed19000700 1 -- 172.21.15.70:0/879788217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14108460 msgr2=0x7fed14076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.597+0000 7fed19000700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14108460 0x7fed14076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.597+0000 7fed19000700 1 -- 172.21.15.70:0/879788217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed141a7fc0 con 0x7fed14103ef0 2024-05-08T07:03:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.597+0000 7fed1a400700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14108460 0x7fed14076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:03:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.597+0000 7fed19000700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 0x7fed14075ce0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fed0000d950 tx=0x7fed0000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:24.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.598+0000 7fed12000700 1 -- 172.21.15.70:0/879788217 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00016070 con 0x7fed14103ef0 2024-05-08T07:03:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.598+0000 7fed12000700 1 -- 172.21.15.70:0/879788217 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed00009dd0 con 0x7fed14103ef0 2024-05-08T07:03:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.598+0000 7fed12000700 1 -- 172.21.15.70:0/879788217 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0000f3c0 con 0x7fed14103ef0 2024-05-08T07:03:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.598+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed141a82b0 con 0x7fed14103ef0 2024-05-08T07:03:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.598+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed141a87a0 con 0x7fed14103ef0 2024-05-08T07:03:24.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.599+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed1410ba70 con 0x7fed14103ef0 2024-05-08T07:03:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.603+0000 7fed12000700 1 -- 172.21.15.70:0/879788217 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fed00019070 con 0x7fed14103ef0 2024-05-08T07:03:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.605+0000 7fed12000700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecfc0b2a70 0x7fecfc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.605+0000 7fed12000700 1 -- 172.21.15.70:0/879788217 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7fed000e2660 con 0x7fed14103ef0 2024-05-08T07:03:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.605+0000 7fed19a00700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecfc0b2a70 0x7fecfc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.606+0000 7fed19a00700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecfc0b2a70 0x7fecfc0b4f30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fed14104730 tx=0x7fed0800b410 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.608+0000 7fed12000700 1 -- 172.21.15.70:0/879788217 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fed000a9bc0 con 0x7fed14103ef0 2024-05-08T07:03:24.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:24 smithi172 ceph-mon[33377]: pgmap v530: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:24.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:24 smithi194 ceph-mon[33679]: pgmap v530: 129 pgs: 129 active+clean; 810 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:03:24.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.968+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed1410b450 con 0x7fed14103ef0 2024-05-08T07:03:24.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.969+0000 7fed12000700 1 -- 172.21.15.70:0/879788217 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fed000a94c0 con 0x7fed14103ef0 2024-05-08T07:03:24.969 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:03:24.969 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:03:24.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecfc0b2a70 msgr2=0x7fecfc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:24.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecfc0b2a70 0x7fecfc0b4f30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fed14104730 tx=0x7fed0800b410 comp rx=0 tx=0).stop 2024-05-08T07:03:24.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 msgr2=0x7fed14075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:24.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 0x7fed14075ce0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fed0000d950 tx=0x7fed0000dc60 comp rx=0 tx=0).stop 2024-05-08T07:03:24.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 shutdown_connections 2024-05-08T07:03:24.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecfc0b2a70 0x7fecfc0b4f30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed14108460 0x7fed14076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed14103550 0x7fed140757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 --2- 172.21.15.70:0/879788217 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed14103ef0 0x7fed14075ce0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:24.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 >> 172.21.15.70:0/879788217 conn(0x7fed1407a600 msgr2=0x7fed14101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:24.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 shutdown_connections 2024-05-08T07:03:24.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:24.973+0000 7fed1c400700 1 -- 172.21.15.70:0/879788217 wait complete. 2024-05-08T07:03:24.974 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:03:25.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:25 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/879788217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:03:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:25 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/879788217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:03:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:25 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/879788217' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:03:25.913 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.25 --await-for 42.0' 2024-05-08T07:03:25.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.25 --await-for 42.0 2024-05-08T07:03:26.392 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:03:26.595 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:26 smithi070 ceph-mon[29591]: pgmap v531: 129 pgs: 129 active+clean; 831 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 16 op/s 2024-05-08T07:03:26.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:26 smithi172 ceph-mon[33377]: pgmap v531: 129 pgs: 129 active+clean; 831 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 16 op/s 2024-05-08T07:03:26.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:26 smithi194 ceph-mon[33679]: pgmap v531: 129 pgs: 129 active+clean; 831 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 16 op/s 2024-05-08T07:03:28.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:28 smithi070 ceph-mon[29591]: pgmap v532: 129 pgs: 129 active+clean; 831 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 16 op/s 2024-05-08T07:03:28.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:28 smithi172 ceph-mon[33377]: pgmap v532: 129 pgs: 129 active+clean; 831 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 16 op/s 2024-05-08T07:03:28.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:28 smithi194 ceph-mon[33679]: pgmap v532: 129 pgs: 129 active+clean; 831 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 16 op/s 2024-05-08T07:03:28.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.971+0000 7fbb1b200700 1 -- 172.21.15.70:0/3850122782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 msgr2=0x7fbb141169c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:28.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.971+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3850122782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 0x7fbb141169c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00b0a0 tx=0x7fbb0c00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.972+0000 7fbb1b200700 1 -- 172.21.15.70:0/3850122782 shutdown_connections 2024-05-08T07:03:28.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.972+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3850122782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 0x7fbb141169c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.972+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3850122782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb1410fb80 0x7fbb1410ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.972+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3850122782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb14109af0 0x7fbb14109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.972+0000 7fbb1b200700 1 -- 172.21.15.70:0/3850122782 >> 172.21.15.70:0/3850122782 conn(0x7fbb14076cb0 msgr2=0x7fbb141082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:28.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.972+0000 7fbb1b200700 1 -- 172.21.15.70:0/3850122782 shutdown_connections 2024-05-08T07:03:28.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.972+0000 7fbb1b200700 1 -- 172.21.15.70:0/3850122782 wait complete. 2024-05-08T07:03:28.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.973+0000 7fbb1b200700 1 Processor -- start 2024-05-08T07:03:28.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.974+0000 7fbb1b200700 1 -- start start 2024-05-08T07:03:28.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.974+0000 7fbb1b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb14109af0 0x7fbb1419ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.974+0000 7fbb1b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 0x7fbb141a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.974+0000 7fbb1b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb1410fb80 0x7fbb141a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.974+0000 7fbb1b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb14119bf0 con 0x7fbb1410a4b0 2024-05-08T07:03:28.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.974+0000 7fbb1b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb14119a70 con 0x7fbb14109af0 2024-05-08T07:03:28.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.974+0000 7fbb1b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbb14119d70 con 0x7fbb1410fb80 2024-05-08T07:03:28.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.974+0000 7fbb13400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 0x7fbb141a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb13400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 0x7fbb141a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38392/0 (socket says 172.21.15.70:38392) 2024-05-08T07:03:28.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb13400700 1 -- 172.21.15.70:0/3735589991 learned_addr learned my addr 172.21.15.70:0/3735589991 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:28.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb14109af0 0x7fbb1419ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb19200700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb1410fb80 0x7fbb141a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb13400700 1 -- 172.21.15.70:0/3735589991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb1410fb80 msgr2=0x7fbb141a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:28.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb13400700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb1410fb80 0x7fbb141a4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb13400700 1 -- 172.21.15.70:0/3735589991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb14109af0 msgr2=0x7fbb1419ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb13400700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb14109af0 0x7fbb1419ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb13400700 1 -- 172.21.15.70:0/3735589991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb141a4fd0 con 0x7fbb1410a4b0 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb19200700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb1410fb80 0x7fbb141a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.975+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb14109af0 0x7fbb1419ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.976+0000 7fbb13400700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 0x7fbb141a0500 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000c970 tx=0x7fbb0000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.976+0000 7fbb10c00700 1 -- 172.21.15.70:0/3735589991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00007aa0 con 0x7fbb1410a4b0 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.976+0000 7fbb10c00700 1 -- 172.21.15.70:0/3735589991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb00004cc0 con 0x7fbb1410a4b0 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.976+0000 7fbb10c00700 1 -- 172.21.15.70:0/3735589991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00005500 con 0x7fbb1410a4b0 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.976+0000 7fbb1b200700 1 -- 172.21.15.70:0/3735589991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb141a52c0 con 0x7fbb1410a4b0 2024-05-08T07:03:28.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.976+0000 7fbb1b200700 1 -- 172.21.15.70:0/3735589991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb141acb40 con 0x7fbb1410a4b0 2024-05-08T07:03:28.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.981+0000 7fbb25b7fb80 1 Processor -- start 2024-05-08T07:03:28.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb25b7fb80 1 -- start start 2024-05-08T07:03:28.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb10c00700 1 -- 172.21.15.70:0/3735589991 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbb00007c40 con 0x7fbb1410a4b0 2024-05-08T07:03:28.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75cf50 0x55fd3f75d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757520 0x55fd3f7579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 0x55fd3f763d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd3f6a9bb0 con 0x55fd3f75cf50 2024-05-08T07:03:28.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fd3f6478f0 con 0x55fd3f757ee0 2024-05-08T07:03:28.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fd3f6a5b70 con 0x55fd3f757520 2024-05-08T07:03:28.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb19200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75cf50 0x55fd3f75d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb19200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75cf50 0x55fd3f75d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38406/0 (socket says 172.21.15.70:38406) 2024-05-08T07:03:28.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.982+0000 7fbb19200700 1 -- 172.21.15.70:0/1940282179 learned_addr learned my addr 172.21.15.70:0/1940282179 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:28.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.983+0000 7fbb13e00700 1 --2- 172.21.15.70:0/1940282179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757520 0x55fd3f7579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.983+0000 7fbb13400700 1 --2- 172.21.15.70:0/1940282179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 0x55fd3f763d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.983+0000 7fbb19200700 1 -- 172.21.15.70:0/1940282179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757520 msgr2=0x55fd3f7579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:28.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.983+0000 7fbb19200700 1 --2- 172.21.15.70:0/1940282179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757520 0x55fd3f7579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.983+0000 7fbb19200700 1 -- 172.21.15.70:0/1940282179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 msgr2=0x55fd3f763d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:28.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.983+0000 7fbb19200700 1 --2- 172.21.15.70:0/1940282179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 0x55fd3f763d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.983+0000 7fbb19200700 1 -- 172.21.15.70:0/1940282179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd3f5f6a60 con 0x55fd3f75cf50 2024-05-08T07:03:28.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.984+0000 7fbb19200700 1 --2- 172.21.15.70:0/1940282179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75cf50 0x55fd3f75d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0092e0 tx=0x7fbb0c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b888ac6d47c506b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:28.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.984+0000 7fbb10c00700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbaf80b2aa0 0x7fbaf80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.984+0000 7fbb09600700 1 -- 172.21.15.70:0/1940282179 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c004a50 con 0x55fd3f75cf50 2024-05-08T07:03:28.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.984+0000 7fbb09600700 1 -- 172.21.15.70:0/1940282179 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb0c004bf0 con 0x55fd3f75cf50 2024-05-08T07:03:28.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.984+0000 7fbb09600700 1 -- 172.21.15.70:0/1940282179 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c01c840 con 0x55fd3f75cf50 2024-05-08T07:03:28.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.984+0000 7fbb10c00700 1 -- 172.21.15.70:0/3735589991 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7fbb000e28f0 con 0x7fbb1410a4b0 2024-05-08T07:03:28.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.984+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbaf80b2aa0 0x7fbaf80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.985+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/1940282179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75cf50 msgr2=0x55fd3f75d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.985+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/1940282179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75cf50 0x55fd3f75d330 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0092e0 tx=0x7fbb0c009310 comp rx=0 tx=0).stop 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.985+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbaf80b2aa0 0x7fbaf80b4f60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400ddf0 tx=0x7fbb0400d540 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.985+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/1940282179 shutdown_connections 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.985+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/1940282179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 0x55fd3f763d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.985+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/1940282179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75cf50 0x55fd3f75d330 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.985+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/1940282179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757520 0x55fd3f7579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.985+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/1940282179 >> 172.21.15.70:0/1940282179 conn(0x55fd3f685cf0 msgr2=0x55fd3f751e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.985+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/1940282179 shutdown_connections 2024-05-08T07:03:28.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.986+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/1940282179 wait complete. 2024-05-08T07:03:28.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.986+0000 7fbb25b7fb80 1 -- start start 2024-05-08T07:03:28.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.986+0000 7fbb25b7fb80 1 Processor -- start 2024-05-08T07:03:28.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.987+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757520 0x55fd3f763970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.987+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 0x55fd3f760d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.987+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 0x55fd3f761250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.987+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd3f7642b0 con 0x55fd3f757520 2024-05-08T07:03:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.987+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fd3f60fcb0 con 0x55fd3f757ee0 2024-05-08T07:03:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.987+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fd3f764430 con 0x55fd3f75cf50 2024-05-08T07:03:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.987+0000 7fbb25b7fb80 10 client.0 _ll_register_callbacks cb 0x55fd3f650e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:03:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.987+0000 7fbb13e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757520 0x55fd3f763970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb13e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757520 0x55fd3f763970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38410/0 (socket says 172.21.15.70:38410) 2024-05-08T07:03:28.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb13e00700 1 -- 172.21.15.70:0/3127859145 learned_addr learned my addr 172.21.15.70:0/3127859145 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb13400700 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 0x55fd3f760d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb19200700 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 0x55fd3f761250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb13e00700 1 -- 172.21.15.70:0/3127859145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 msgr2=0x55fd3f761250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 0x55fd3f761250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb13e00700 1 -- 172.21.15.70:0/3127859145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 msgr2=0x55fd3f760d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 0x55fd3f760d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb13e00700 1 -- 172.21.15.70:0/3127859145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd3f66f5b0 con 0x55fd3f757520 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757520 0x55fd3f763970 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400d850 tx=0x7fbb04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b7ba3b3769a42c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.988+0000 7fbafe000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.989+0000 7fbafe000700 1 -- 172.21.15.70:0/3127859145 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0402a060 con 0x55fd3f757520 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.989+0000 7fbafe000700 1 -- 172.21.15.70:0/3127859145 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7fbb0401da20 con 0x55fd3f757520 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.989+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3127859145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb0c004bf0 con 0x55fd3f757520 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.989+0000 7fbafe000700 1 -- 172.21.15.70:0/3127859145 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb0401dc20 con 0x55fd3f757520 2024-05-08T07:03:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.989+0000 7fbb25b7fb80 10 client.15954 fetch_fsmap learned FSMap version 28 2024-05-08T07:03:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.989+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3127859145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd3f76eb70 con 0x55fd3f757520 2024-05-08T07:03:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.990+0000 7fbafe000700 1 -- 172.21.15.70:0/3127859145 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb0c004bf0 con 0x55fd3f757520 2024-05-08T07:03:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.990+0000 7fbafe000700 1 -- 172.21.15.70:0/3127859145 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbb04019040 con 0x55fd3f757520 2024-05-08T07:03:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.990+0000 7fbb25b7fb80 10 client.15954 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:03:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.990+0000 7fbb25b7fb80 10 client.15954 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:03:28.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.990+0000 7fbb25b7fb80 20 client.15954 populate_metadata read hostname 'smithi070' 2024-05-08T07:03:28.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.990+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd3f771150 0x55fd3f7735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:28.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.990+0000 7fbb25b7fb80 4 client.15954 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:03:28.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.990+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3127859145 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd3f724230 con 0x55fd3f771150 2024-05-08T07:03:28.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.991+0000 7fbb13400700 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd3f771150 0x55fd3f7735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:28.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.992+0000 7fbb13400700 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd3f771150 0x55fd3f7735c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a79503bbb1febfc9 server_cookie=3581551325ec0aac in_seq=0 out_seq=0 2024-05-08T07:03:28.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.992+0000 7fbafe000700 10 client.15954 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:03:28.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbafe000700 1 -- 172.21.15.70:0/3127859145 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fd3f724230 con 0x55fd3f771150 2024-05-08T07:03:28.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbafe000700 10 client.15954 handle_command_reply: tid=0 2024-05-08T07:03:28.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbb25b7fb80 1 client.15954 shutdown 2024-05-08T07:03:28.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3127859145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757520 msgr2=0x55fd3f763970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:28.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757520 0x55fd3f763970 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400d850 tx=0x7fbb04004750 comp rx=0 tx=0).stop 2024-05-08T07:03:28.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3127859145 shutdown_connections 2024-05-08T07:03:28.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd3f771150 0x55fd3f7735c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 0x55fd3f761250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757520 0x55fd3f763970 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3127859145 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f757ee0 0x55fd3f760d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:28.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3127859145 >> 172.21.15.70:0/3127859145 conn(0x55fd3f685cf0 msgr2=0x55fd3f74c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:28.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.994+0000 7fbafe000700 0 client.15954 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:03:28.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.995+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3127859145 shutdown_connections 2024-05-08T07:03:28.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.995+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3127859145 wait complete. 2024-05-08T07:03:28.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:28.995+0000 7fbb25b7fb80 20 client.15954 trim_cache size 0 max 16384 2024-05-08T07:03:29.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.019+0000 7fbb25b7fb80 1 Processor -- start 2024-05-08T07:03:29.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.019+0000 7fbb25b7fb80 1 -- start start 2024-05-08T07:03:29.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757ee0 0x55fd3f756b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:29.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75cf50 0x55fd3f76d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:29.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75fe00 0x55fd3f778ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:29.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb141b8340 con 0x55fd3f75fe00 2024-05-08T07:03:29.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb141b5bd0 con 0x55fd3f75cf50 2024-05-08T07:03:29.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbb141b3a40 con 0x55fd3f757ee0 2024-05-08T07:03:29.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb19200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75fe00 0x55fd3f778ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:29.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb19200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75fe00 0x55fd3f778ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38416/0 (socket says 172.21.15.70:38416) 2024-05-08T07:03:29.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb19200700 1 -- 172.21.15.70:0/2085512190 learned_addr learned my addr 172.21.15.70:0/2085512190 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:29.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb13e00700 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757ee0 0x55fd3f756b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:29.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.020+0000 7fbb13400700 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75cf50 0x55fd3f76d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.021+0000 7fbb19200700 1 -- 172.21.15.70:0/2085512190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757ee0 msgr2=0x55fd3f756b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.021+0000 7fbb19200700 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757ee0 0x55fd3f756b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.021+0000 7fbb19200700 1 -- 172.21.15.70:0/2085512190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75cf50 msgr2=0x55fd3f76d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.021+0000 7fbb19200700 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75cf50 0x55fd3f76d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.021+0000 7fbb19200700 1 -- 172.21.15.70:0/2085512190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd3f74ea10 con 0x55fd3f75fe00 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.021+0000 7fbb13400700 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75cf50 0x55fd3f76d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.021+0000 7fbb19200700 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75fe00 0x55fd3f778ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009e50 tx=0x7fbb0c0060a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a813718c88e2241 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.022+0000 7fbb08c00700 1 -- 172.21.15.70:0/2085512190 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c004c50 con 0x55fd3f75fe00 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.022+0000 7fbb08c00700 1 -- 172.21.15.70:0/2085512190 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb0c02b070 con 0x55fd3f75fe00 2024-05-08T07:03:29.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.022+0000 7fbb08c00700 1 -- 172.21.15.70:0/2085512190 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c01c6a0 con 0x55fd3f75fe00 2024-05-08T07:03:29.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/2085512190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75fe00 msgr2=0x55fd3f778ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:29.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75fe00 0x55fd3f778ed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009e50 tx=0x7fbb0c0060a0 comp rx=0 tx=0).stop 2024-05-08T07:03:29.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/2085512190 shutdown_connections 2024-05-08T07:03:29.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f75fe00 0x55fd3f778ed0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:29.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f757ee0 0x55fd3f756b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:29.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/2085512190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75cf50 0x55fd3f76d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:29.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/2085512190 >> 172.21.15.70:0/2085512190 conn(0x55fd3f685cf0 msgr2=0x55fd3f74c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:29.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/2085512190 shutdown_connections 2024-05-08T07:03:29.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/2085512190 wait complete. 2024-05-08T07:03:29.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.023+0000 7fbb25b7fb80 1 -- start start 2024-05-08T07:03:29.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.024+0000 7fbb25b7fb80 1 Processor -- start 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.024+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757ee0 0x55fd3f766c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.024+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 0x55fd3f7671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.024+0000 7fbb25b7fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75fe00 0x55fd3f7dba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.024+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb141b4090 con 0x55fd3f757ee0 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.024+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb141b5500 con 0x55fd3f75fe00 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.024+0000 7fbb25b7fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbb141b4760 con 0x55fd3f75cf50 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.024+0000 7fbb25b7fb80 10 client.0 _ll_register_callbacks cb 0x55fd3f650e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb13e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757ee0 0x55fd3f766c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb13e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757ee0 0x55fd3f766c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38430/0 (socket says 172.21.15.70:38430) 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb13e00700 1 -- 172.21.15.70:0/3673412796 learned_addr learned my addr 172.21.15.70:0/3673412796 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:03:29.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb13400700 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 0x55fd3f7671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:29.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb13e00700 1 -- 172.21.15.70:0/3673412796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 msgr2=0x55fd3f7671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:29.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 0x55fd3f7671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:29.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb13e00700 1 -- 172.21.15.70:0/3673412796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75fe00 msgr2=0x55fd3f7dba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:03:29.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb19200700 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75fe00 0x55fd3f7dba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75fe00 0x55fd3f7dba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb13e00700 1 -- 172.21.15.70:0/3673412796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd3f7dc130 con 0x55fd3f757ee0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.025+0000 7fbb19200700 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75fe00 0x55fd3f7dba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.026+0000 7fbb13e00700 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757ee0 0x55fd3f766c70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55fd3f7605c0 tx=0x7fbb040047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86076e488c01fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.026+0000 7fbafe000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.026+0000 7fbafe000700 1 -- 172.21.15.70:0/3673412796 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04034080 con 0x55fd3f757ee0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.026+0000 7fbafe000700 1 -- 172.21.15.70:0/3673412796 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7fbb0401a580 con 0x55fd3f757ee0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.026+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3673412796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb0c02b070 con 0x55fd3f757ee0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.026+0000 7fbafe000700 1 -- 172.21.15.70:0/3673412796 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbb04042050 con 0x55fd3f757ee0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.026+0000 7fbb25b7fb80 10 client.15960 fetch_fsmap learned FSMap version 28 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.026+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3673412796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd3f7dd3f0 con 0x55fd3f757ee0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.027+0000 7fbafe000700 1 -- 172.21.15.70:0/3673412796 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb0c02b070 con 0x55fd3f757ee0 2024-05-08T07:03:29.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.027+0000 7fbafe000700 1 -- 172.21.15.70:0/3673412796 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbb04019040 con 0x55fd3f757ee0 2024-05-08T07:03:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.027+0000 7fbb25b7fb80 10 client.15960 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:03:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.027+0000 7fbb25b7fb80 10 client.15960 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:03:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.027+0000 7fbb25b7fb80 20 client.15960 populate_metadata read hostname 'smithi070' 2024-05-08T07:03:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.027+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd3f7ddc00 0x55fd3f7dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:03:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.027+0000 7fbb25b7fb80 4 client.15960 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.25, "await_for": 42.0}] 2024-05-08T07:03:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.027+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3673412796 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.25, "await_for": 42.0}) -- 0x55fd3f6b7590 con 0x55fd3f7ddc00 2024-05-08T07:03:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.028+0000 7fbb13400700 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd3f7ddc00 0x55fd3f7dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:03:29.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.029+0000 7fbb13400700 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd3f7ddc00 0x55fd3f7dfff0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e498d07c46ef191 server_cookie=798454e7d7b507f4 in_seq=0 out_seq=0 2024-05-08T07:03:29.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:29.029+0000 7fbafe000700 10 client.15960 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:03:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:29 smithi070 ceph-mon[29591]: pgmap v533: 129 pgs: 129 active+clean; 887 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 6.5 MiB/s wr, 29 op/s 2024-05-08T07:03:29.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:29 smithi172 ceph-mon[33377]: pgmap v533: 129 pgs: 129 active+clean; 887 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 6.5 MiB/s wr, 29 op/s 2024-05-08T07:03:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:29 smithi194 ceph-mon[33679]: pgmap v533: 129 pgs: 129 active+clean; 887 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 6.5 MiB/s wr, 29 op/s 2024-05-08T07:03:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:32 smithi194 ceph-mon[33679]: pgmap v534: 129 pgs: 129 active+clean; 887 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 6.4 MiB/s wr, 26 op/s 2024-05-08T07:03:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:32 smithi070 ceph-mon[29591]: pgmap v534: 129 pgs: 129 active+clean; 887 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 6.4 MiB/s wr, 26 op/s 2024-05-08T07:03:32.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:32 smithi172 ceph-mon[33377]: pgmap v534: 129 pgs: 129 active+clean; 887 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 6.4 MiB/s wr, 26 op/s 2024-05-08T07:03:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:34 smithi070 ceph-mon[29591]: pgmap v535: 129 pgs: 129 active+clean; 887 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 6.4 MiB/s wr, 26 op/s 2024-05-08T07:03:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:34 smithi194 ceph-mon[33679]: pgmap v535: 129 pgs: 129 active+clean; 887 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 6.4 MiB/s wr, 26 op/s 2024-05-08T07:03:34.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:34 smithi172 ceph-mon[33377]: pgmap v535: 129 pgs: 129 active+clean; 887 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 6.4 MiB/s wr, 26 op/s 2024-05-08T07:03:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:36 smithi194 ceph-mon[33679]: pgmap v536: 129 pgs: 129 active+clean; 907 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 8.1 MiB/s wr, 32 op/s 2024-05-08T07:03:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:36 smithi070 ceph-mon[29591]: pgmap v536: 129 pgs: 129 active+clean; 907 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 8.1 MiB/s wr, 32 op/s 2024-05-08T07:03:36.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:36 smithi172 ceph-mon[33377]: pgmap v536: 129 pgs: 129 active+clean; 907 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 8.1 MiB/s wr, 32 op/s 2024-05-08T07:03:37.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.862+0000 7fbafe000700 1 -- 172.21.15.70:0/3673412796 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55fd3f6b7590 con 0x55fd3f7ddc00 2024-05-08T07:03:37.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.862+0000 7fbafe000700 10 client.15960 handle_command_reply: tid=0 2024-05-08T07:03:37.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.862+0000 7fbb25b7fb80 1 client.15960 shutdown 2024-05-08T07:03:37.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3673412796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757ee0 msgr2=0x55fd3f766c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757ee0 0x55fd3f766c70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55fd3f7605c0 tx=0x7fbb040047c0 comp rx=0 tx=0).stop 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3673412796 shutdown_connections 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd3f7ddc00 0x55fd3f7dfff0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd3f75fe00 0x55fd3f7dba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd3f757ee0 0x55fd3f766c70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 --2- 172.21.15.70:0/3673412796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd3f75cf50 0x55fd3f7671b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3673412796 >> 172.21.15.70:0/3673412796 conn(0x55fd3f685cf0 msgr2=0x55fd3f74c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbafe000700 0 client.15960 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3673412796 shutdown_connections 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 1 -- 172.21.15.70:0/3673412796 wait complete. 2024-05-08T07:03:37.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.863+0000 7fbb25b7fb80 20 client.15960 trim_cache size 0 max 16384 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 46, 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "59e72ef8": { 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 46, 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:03:37.865 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.2, 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:37.866 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:03:37.867 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:03:37.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.864+0000 7fbb1b200700 1 -- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbaf80b2aa0 msgr2=0x7fbaf80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:37.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.864+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbaf80b2aa0 0x7fbaf80b4f60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbb0400ddf0 tx=0x7fbb0400d540 comp rx=0 tx=0).stop 2024-05-08T07:03:37.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.864+0000 7fbb1b200700 1 -- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 msgr2=0x7fbb141a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:03:37.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.864+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 0x7fbb141a0500 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000c970 tx=0x7fbb0000cd30 comp rx=0 tx=0).stop 2024-05-08T07:03:37.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.865+0000 7fbb1b200700 1 -- 172.21.15.70:0/3735589991 shutdown_connections 2024-05-08T07:03:37.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.865+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbaf80b2aa0 0x7fbaf80b4f60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:37.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.865+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb1410fb80 0x7fbb141a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:37.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.865+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb14109af0 0x7fbb1419ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:37.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.865+0000 7fbb1b200700 1 --2- 172.21.15.70:0/3735589991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb1410a4b0 0x7fbb141a0500 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:03:37.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.865+0000 7fbb1b200700 1 -- 172.21.15.70:0/3735589991 >> 172.21.15.70:0/3735589991 conn(0x7fbb14076cb0 msgr2=0x7fbb140771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:03:37.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.865+0000 7fbb1b200700 1 -- 172.21.15.70:0/3735589991 shutdown_connections 2024-05-08T07:03:37.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:03:37.865+0000 7fbb1b200700 1 -- 172.21.15.70:0/3735589991 wait complete. 2024-05-08T07:03:38.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:38 smithi194 ceph-mon[33679]: pgmap v537: 129 pgs: 129 active+clean; 907 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 6.3 MiB/s wr, 21 op/s 2024-05-08T07:03:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:38 smithi070 ceph-mon[29591]: pgmap v537: 129 pgs: 129 active+clean; 907 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 6.3 MiB/s wr, 21 op/s 2024-05-08T07:03:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:38 smithi172 ceph-mon[33377]: pgmap v537: 129 pgs: 129 active+clean; 907 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 6.3 MiB/s wr, 21 op/s 2024-05-08T07:03:38.841 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '59e72ef8', quiesce took 17.3 seconds. Will release after: 19.25 2024-05-08T07:03:40.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:40 smithi070 ceph-mon[29591]: pgmap v538: 129 pgs: 129 active+clean; 916 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 7.0 MiB/s wr, 28 op/s 2024-05-08T07:03:40.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:40 smithi172 ceph-mon[33377]: pgmap v538: 129 pgs: 129 active+clean; 916 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 7.0 MiB/s wr, 28 op/s 2024-05-08T07:03:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:40 smithi194 ceph-mon[33679]: pgmap v538: 129 pgs: 129 active+clean; 916 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 7.0 MiB/s wr, 28 op/s 2024-05-08T07:03:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:42 smithi070 ceph-mon[29591]: pgmap v539: 129 pgs: 129 active+clean; 916 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-05-08T07:03:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:42 smithi172 ceph-mon[33377]: pgmap v539: 129 pgs: 129 active+clean; 916 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-05-08T07:03:42.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:42 smithi194 ceph-mon[33679]: pgmap v539: 129 pgs: 129 active+clean; 916 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-05-08T07:03:44.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:44 smithi070 ceph-mon[29591]: pgmap v540: 129 pgs: 129 active+clean; 916 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-05-08T07:03:44.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:44 smithi172 ceph-mon[33377]: pgmap v540: 129 pgs: 129 active+clean; 916 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-05-08T07:03:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:44 smithi194 ceph-mon[33679]: pgmap v540: 129 pgs: 129 active+clean; 916 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.4 MiB/s wr, 12 op/s 2024-05-08T07:03:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:46 smithi070 ceph-mon[29591]: pgmap v541: 129 pgs: 129 active+clean; 923 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 3.0 MiB/s wr, 15 op/s 2024-05-08T07:03:46.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:46 smithi172 ceph-mon[33377]: pgmap v541: 129 pgs: 129 active+clean; 923 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 3.0 MiB/s wr, 15 op/s 2024-05-08T07:03:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:46 smithi194 ceph-mon[33679]: pgmap v541: 129 pgs: 129 active+clean; 923 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 3.0 MiB/s wr, 15 op/s 2024-05-08T07:03:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:48 smithi070 ceph-mon[29591]: pgmap v542: 129 pgs: 129 active+clean; 923 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-05-08T07:03:48.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:48 smithi172 ceph-mon[33377]: pgmap v542: 129 pgs: 129 active+clean; 923 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-05-08T07:03:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:48 smithi194 ceph-mon[33679]: pgmap v542: 129 pgs: 129 active+clean; 923 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1.3 MiB/s wr, 10 op/s 2024-05-08T07:03:50.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:50 smithi070 ceph-mon[29591]: pgmap v543: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-05-08T07:03:50.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:50 smithi172 ceph-mon[33377]: pgmap v543: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-05-08T07:03:50.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:50 smithi194 ceph-mon[33679]: pgmap v543: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 1.3 MiB/s wr, 12 op/s 2024-05-08T07:03:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:52 smithi070 ceph-mon[29591]: pgmap v544: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 674 KiB/s wr, 5 op/s 2024-05-08T07:03:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:52 smithi172 ceph-mon[33377]: pgmap v544: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 674 KiB/s wr, 5 op/s 2024-05-08T07:03:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:52 smithi194 ceph-mon[33679]: pgmap v544: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 674 KiB/s wr, 5 op/s 2024-05-08T07:03:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:54 smithi070 ceph-mon[29591]: pgmap v545: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 674 KiB/s wr, 5 op/s 2024-05-08T07:03:54.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:54 smithi172 ceph-mon[33377]: pgmap v545: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 674 KiB/s wr, 5 op/s 2024-05-08T07:03:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:54 smithi194 ceph-mon[33679]: pgmap v545: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 674 KiB/s wr, 5 op/s 2024-05-08T07:03:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:56 smithi070 ceph-mon[29591]: pgmap v546: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 674 KiB/s wr, 8 op/s 2024-05-08T07:03:56.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:56 smithi172 ceph-mon[33377]: pgmap v546: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 674 KiB/s wr, 8 op/s 2024-05-08T07:03:56.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:56 smithi194 ceph-mon[33679]: pgmap v546: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 674 KiB/s wr, 8 op/s 2024-05-08T07:03:58.093 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:03:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:03:58.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:03:58 smithi070 ceph-mon[29591]: pgmap v547: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-05-08T07:03:58.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:03:58 smithi172 ceph-mon[33377]: pgmap v547: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-05-08T07:03:58.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:03:58 smithi194 ceph-mon[33679]: pgmap v547: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 KiB/s wr, 5 op/s 2024-05-08T07:04:00.526 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:00 smithi070 ceph-mon[29591]: pgmap v548: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 KiB/s wr, 7 op/s 2024-05-08T07:04:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:00 smithi172 ceph-mon[33377]: pgmap v548: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 KiB/s wr, 7 op/s 2024-05-08T07:04:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:00 smithi194 ceph-mon[33679]: pgmap v548: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 KiB/s wr, 7 op/s 2024-05-08T07:04:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.096+0000 7f6037e00700 1 -- 172.21.15.70:0/3836426743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603810e8b0 msgr2=0x7f603810ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.096+0000 7f6037e00700 1 --2- 172.21.15.70:0/3836426743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603810e8b0 0x7f603810ec90 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6028009990 tx=0x7f6028009ca0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.096+0000 7f6037e00700 1 -- 172.21.15.70:0/3836426743 shutdown_connections 2024-05-08T07:04:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.096+0000 7f6037e00700 1 --2- 172.21.15.70:0/3836426743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603810a3a0 0x7f6038116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.096+0000 7f6037e00700 1 --2- 172.21.15.70:0/3836426743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f603810e8b0 0x7f603810ec90 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.096+0000 7f6037e00700 1 --2- 172.21.15.70:0/3836426743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60381099e0 0x7f6038109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.096+0000 7f6037e00700 1 -- 172.21.15.70:0/3836426743 >> 172.21.15.70:0/3836426743 conn(0x7f6038079230 msgr2=0x7f60381082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:04:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.096+0000 7f6037e00700 1 -- 172.21.15.70:0/3836426743 shutdown_connections 2024-05-08T07:04:01.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.096+0000 7f6037e00700 1 -- 172.21.15.70:0/3836426743 wait complete. 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.097+0000 7f6037e00700 1 Processor -- start 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.098+0000 7f6037e00700 1 -- start start 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.098+0000 7f6037e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60381099e0 0x7f603819ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.098+0000 7f6037e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603810a3a0 0x7f60381a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.098+0000 7f6037e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603810e8b0 0x7f60381a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.098+0000 7f6037e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6038119a80 con 0x7f60381099e0 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.098+0000 7f6037e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6038119900 con 0x7f603810a3a0 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.098+0000 7f6037e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6038119c00 con 0x7f603810e8b0 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.098+0000 7f6036a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60381099e0 0x7f603819ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.098+0000 7f6036a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60381099e0 0x7f603819ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37678/0 (socket says 172.21.15.70:37678) 2024-05-08T07:04:01.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.099+0000 7f6036a00700 1 -- 172.21.15.70:0/4199062768 learned_addr learned my addr 172.21.15.70:0/4199062768 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.099+0000 7f6036000700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603810a3a0 0x7f60381a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.099+0000 7f6037400700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603810e8b0 0x7f60381a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.099+0000 7f6036a00700 1 -- 172.21.15.70:0/4199062768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603810e8b0 msgr2=0x7f60381a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.099+0000 7f6036a00700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603810e8b0 0x7f60381a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.099+0000 7f6036a00700 1 -- 172.21.15.70:0/4199062768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603810a3a0 msgr2=0x7f60381a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.099+0000 7f6036a00700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603810a3a0 0x7f60381a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.099+0000 7f6036a00700 1 -- 172.21.15.70:0/4199062768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60381a4fc0 con 0x7f60381099e0 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.100+0000 7f6036a00700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60381099e0 0x7f603819ffb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6028000c00 tx=0x7f60280036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.100+0000 7f602f400700 1 -- 172.21.15.70:0/4199062768 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028027070 con 0x7f60381099e0 2024-05-08T07:04:01.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.100+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60381a5250 con 0x7f60381099e0 2024-05-08T07:04:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.100+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60381acb30 con 0x7f60381099e0 2024-05-08T07:04:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.100+0000 7f602f400700 1 -- 172.21.15.70:0/4199062768 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f602800fc80 con 0x7f60381099e0 2024-05-08T07:04:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.100+0000 7f602f400700 1 -- 172.21.15.70:0/4199062768 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6028022d60 con 0x7f60381099e0 2024-05-08T07:04:01.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.101+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6018005330 con 0x7f60381099e0 2024-05-08T07:04:01.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.104+0000 7f602f400700 1 -- 172.21.15.70:0/4199062768 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f602802a070 con 0x7f60381099e0 2024-05-08T07:04:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.105+0000 7f602f400700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f601c0b2a70 0x7f601c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.105+0000 7f602f400700 1 -- 172.21.15.70:0/4199062768 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7f60280e3950 con 0x7f60381099e0 2024-05-08T07:04:01.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.106+0000 7f6036000700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f601c0b2a70 0x7f601c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:01.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.106+0000 7f6036000700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f601c0b2a70 0x7f601c0b4f30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6024005ea0 tx=0x7f6024005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:04:01.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.108+0000 7f602f400700 1 -- 172.21.15.70:0/4199062768 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6028013070 con 0x7f60381099e0 2024-05-08T07:04:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:01 smithi070 ceph-mon[29591]: pgmap v549: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5 op/s 2024-05-08T07:04:01.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.391+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6018005620 con 0x7f60381099e0 2024-05-08T07:04:01.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.393+0000 7f602f400700 1 -- 172.21.15.70:0/4199062768 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f60280aaf40 con 0x7f60381099e0 2024-05-08T07:04:01.392 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:04:01.392 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:04:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f601c0b2a70 msgr2=0x7f601c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f601c0b2a70 0x7f601c0b4f30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6024005ea0 tx=0x7f6024005e30 comp rx=0 tx=0).stop 2024-05-08T07:04:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60381099e0 msgr2=0x7f603819ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60381099e0 0x7f603819ffb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6028000c00 tx=0x7f60280036f0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 shutdown_connections 2024-05-08T07:04:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f601c0b2a70 0x7f601c0b4f30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603810e8b0 0x7f60381a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60381099e0 0x7f603819ffb0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 --2- 172.21.15.70:0/4199062768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f603810a3a0 0x7f60381a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 >> 172.21.15.70:0/4199062768 conn(0x7f6038079230 msgr2=0x7f60380798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:04:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 shutdown_connections 2024-05-08T07:04:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:01.396+0000 7f6037e00700 1 -- 172.21.15.70:0/4199062768 wait complete. 2024-05-08T07:04:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:04:01.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:01 smithi172 ceph-mon[33377]: pgmap v549: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5 op/s 2024-05-08T07:04:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:01 smithi194 ceph-mon[33679]: pgmap v549: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5 op/s 2024-05-08T07:04:02.322 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 59e72ef8 --release --await' 2024-05-08T07:04:02.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 59e72ef8 --release --await 2024-05-08T07:04:02.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:02 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4199062768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:04:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:02 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4199062768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:04:02.740 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:04:02.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:02 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4199062768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:04:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:03 smithi070 ceph-mon[29591]: pgmap v550: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5 op/s 2024-05-08T07:04:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:03 smithi172 ceph-mon[33377]: pgmap v550: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5 op/s 2024-05-08T07:04:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:03 smithi194 ceph-mon[33679]: pgmap v550: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5 op/s 2024-05-08T07:04:05.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.283+0000 7fa3a6a00700 1 -- 172.21.15.70:0/880697854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 msgr2=0x7fa3a01169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:05.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.283+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/880697854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 0x7fa3a01169a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa39800b0a0 tx=0x7fa39800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.283+0000 7fa3a6a00700 1 -- 172.21.15.70:0/880697854 shutdown_connections 2024-05-08T07:04:05.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.283+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/880697854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 0x7fa3a01169a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.283+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/880697854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3a010fb60 0x7fa3a010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.283+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/880697854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3a0109ad0 0x7fa3a0109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.283+0000 7fa3a6a00700 1 -- 172.21.15.70:0/880697854 >> 172.21.15.70:0/880697854 conn(0x7fa3a0076c70 msgr2=0x7fa3a01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:04:05.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.283+0000 7fa3a6a00700 1 -- 172.21.15.70:0/880697854 shutdown_connections 2024-05-08T07:04:05.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.283+0000 7fa3a6a00700 1 -- 172.21.15.70:0/880697854 wait complete. 2024-05-08T07:04:05.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.284+0000 7fa3a6a00700 1 Processor -- start 2024-05-08T07:04:05.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa3a6a00700 1 -- start start 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa3a6a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3a0109ad0 0x7fa3a01a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa3a6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 0x7fa3a01a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa3a6a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3a010fb60 0x7fa3a01a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa3a6a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0119b80 con 0x7fa3a010a490 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa3a6a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0119a00 con 0x7fa3a0109ad0 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa3a6a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0119d00 con 0x7fa3a010fb60 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa39f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 0x7fa3a01a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa39f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 0x7fa3a01a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37708/0 (socket says 172.21.15.70:37708) 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.285+0000 7fa39f400700 1 -- 172.21.15.70:0/942545781 learned_addr learned my addr 172.21.15.70:0/942545781 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:04:05.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa39fe00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3a0109ad0 0x7fa3a01a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa3a4a00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3a010fb60 0x7fa3a01a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa39f400700 1 -- 172.21.15.70:0/942545781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3a010fb60 msgr2=0x7fa3a01a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa39f400700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3a010fb60 0x7fa3a01a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa39f400700 1 -- 172.21.15.70:0/942545781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3a0109ad0 msgr2=0x7fa3a01a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa39f400700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3a0109ad0 0x7fa3a01a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa39f400700 1 -- 172.21.15.70:0/942545781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a01a5030 con 0x7fa3a010a490 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa39f400700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 0x7fa3a01a05b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00d980 tx=0x7fa38c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa39cc00700 1 -- 172.21.15.70:0/942545781 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c017070 con 0x7fa3a010a490 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa39cc00700 1 -- 172.21.15.70:0/942545781 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa38c004830 con 0x7fa3a010a490 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.286+0000 7fa3a6a00700 1 -- 172.21.15.70:0/942545781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a01a5320 con 0x7fa3a010a490 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.287+0000 7fa39cc00700 1 -- 172.21.15.70:0/942545781 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0053a0 con 0x7fa3a010a490 2024-05-08T07:04:05.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.287+0000 7fa3a6a00700 1 -- 172.21.15.70:0/942545781 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a01acba0 con 0x7fa3a010a490 2024-05-08T07:04:05.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.291+0000 7fa39cc00700 1 -- 172.21.15.70:0/942545781 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa38c0049e0 con 0x7fa3a010a490 2024-05-08T07:04:05.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.291+0000 7fa3b129cb80 1 Processor -- start 2024-05-08T07:04:05.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.291+0000 7fa3b129cb80 1 -- start start 2024-05-08T07:04:05.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf5ec0 0x5648bacf62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0490 0x5648bacf0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacfcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5648bac42b20 con 0x5648bacf0e50 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5648babe0860 con 0x5648bacf5ec0 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5648bac3eae0 con 0x5648bacf0490 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa39f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacfcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa39f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacfcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37720/0 (socket says 172.21.15.70:37720) 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa39f400700 1 -- 172.21.15.70:0/1462444734 learned_addr learned my addr 172.21.15.70:0/1462444734 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.292+0000 7fa39fe00700 1 --2- 172.21.15.70:0/1462444734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0490 0x5648bacf0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa3a4a00700 1 --2- 172.21.15.70:0/1462444734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf5ec0 0x5648bacf62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa39cc00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa3840b2a70 0x7fa3840b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa39f400700 1 -- 172.21.15.70:0/1462444734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0490 msgr2=0x5648bacf0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:04:05.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa39f400700 1 --2- 172.21.15.70:0/1462444734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0490 0x5648bacf0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa39f400700 1 -- 172.21.15.70:0/1462444734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf5ec0 msgr2=0x5648bacf62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:04:05.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa39f400700 1 --2- 172.21.15.70:0/1462444734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf5ec0 0x5648bacf62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa3a4a00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa3840b2a70 0x7fa3840b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa39f400700 1 -- 172.21.15.70:0/1462444734 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648bab8f9d0 con 0x5648bacf0e50 2024-05-08T07:04:05.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa39cc00700 1 -- 172.21.15.70:0/942545781 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7fa38c0e29c0 con 0x7fa3a010a490 2024-05-08T07:04:05.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.293+0000 7fa39f400700 1 --2- 172.21.15.70:0/1462444734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacfcc80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0dfc00 tx=0x7fa38c00de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97dd9ade4c8b7f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:04:05.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.294+0000 7fa395600700 1 -- 172.21.15.70:0/1462444734 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0a8f90 con 0x5648bacf0e50 2024-05-08T07:04:05.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.294+0000 7fa395600700 1 -- 172.21.15.70:0/1462444734 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa38c0a9330 con 0x5648bacf0e50 2024-05-08T07:04:05.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.294+0000 7fa395600700 1 -- 172.21.15.70:0/1462444734 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0b2680 con 0x5648bacf0e50 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1462444734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 msgr2=0x5648bacfcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3a4a00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa3840b2a70 0x7fa3840b4f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa398009fd0 tx=0x7fa39800b3b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1462444734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacfcc80 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0dfc00 tx=0x7fa38c00de60 comp rx=0 tx=0).stop 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1462444734 shutdown_connections 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1462444734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacfcc80 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1462444734 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf5ec0 0x5648bacf62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1462444734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0490 0x5648bacf0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1462444734 >> 172.21.15.70:0/1462444734 conn(0x5648bac1ec60 msgr2=0x5648bacead80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1462444734 shutdown_connections 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1462444734 wait complete. 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.295+0000 7fa3b129cb80 1 -- start start 2024-05-08T07:04:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.296+0000 7fa3b129cb80 1 Processor -- start 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.296+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 0x5648bacfc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.296+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacf9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.296+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf5ec0 0x5648bacfa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.296+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5648bacfd220 con 0x5648bacf0e50 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.296+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5648baba8c20 con 0x5648bacf0490 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.296+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5648bacfd3a0 con 0x5648bacf5ec0 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.296+0000 7fa3b129cb80 10 client.0 _ll_register_callbacks cb 0x5648babe9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacf9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacf9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37726/0 (socket says 172.21.15.70:37726) 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39f400700 1 -- 172.21.15.70:0/1869269515 learned_addr learned my addr 172.21.15.70:0/1869269515 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39fe00700 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 0x5648bacfc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39f400700 1 -- 172.21.15.70:0/1869269515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf5ec0 msgr2=0x5648bacfa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39f400700 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf5ec0 0x5648bacfa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39f400700 1 -- 172.21.15.70:0/1869269515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 msgr2=0x5648bacfc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39f400700 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 0x5648bacfc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39f400700 1 -- 172.21.15.70:0/1869269515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648bac08520 con 0x5648bacf0e50 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39fe00700 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 0x5648bacfc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa39f400700 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacf9bc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0a58a0 tx=0x7fa38c0adbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8509f7d48eb5b4ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.297+0000 7fa38a000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.298+0000 7fa38a000700 1 -- 172.21.15.70:0/1869269515 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0a9c80 con 0x5648bacf0e50 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.298+0000 7fa38a000700 1 -- 172.21.15.70:0/1869269515 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7fa38c0b21f0 con 0x5648bacf0e50 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.298+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1869269515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa38c0a9330 con 0x5648bacf0e50 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.298+0000 7fa38a000700 1 -- 172.21.15.70:0/1869269515 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa38c0b2680 con 0x5648bacf0e50 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.298+0000 7fa3b129cb80 10 client.15978 fetch_fsmap learned FSMap version 28 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.298+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1869269515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648bad079c0 con 0x5648bacf0e50 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.298+0000 7fa38a000700 1 -- 172.21.15.70:0/1869269515 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa38c0a9330 con 0x5648bacf0e50 2024-05-08T07:04:05.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.298+0000 7fa38a000700 1 -- 172.21.15.70:0/1869269515 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa38c0aace0 con 0x5648bacf0e50 2024-05-08T07:04:05.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.299+0000 7fa3b129cb80 10 client.15978 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:04:05.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.299+0000 7fa3b129cb80 10 client.15978 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:04:05.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.299+0000 7fa3b129cb80 20 client.15978 populate_metadata read hostname 'smithi070' 2024-05-08T07:04:05.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.299+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5648bad09e90 0x5648bad0c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.299+0000 7fa3b129cb80 4 client.15978 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:04:05.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.299+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1869269515 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648bacbd1a0 con 0x5648bad09e90 2024-05-08T07:04:05.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.299+0000 7fa39fe00700 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5648bad09e90 0x5648bad0c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.300+0000 7fa39fe00700 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5648bad09e90 0x5648bad0c280 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce7c1b7b31f346d8 server_cookie=69aca7bce5bfe846 in_seq=0 out_seq=0 2024-05-08T07:04:05.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.300+0000 7fa38a000700 10 client.15978 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:04:05.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.302+0000 7fa38a000700 1 -- 172.21.15.70:0/1869269515 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5648bacbd1a0 con 0x5648bad09e90 2024-05-08T07:04:05.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.302+0000 7fa38a000700 10 client.15978 handle_command_reply: tid=0 2024-05-08T07:04:05.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 client.15978 shutdown 2024-05-08T07:04:05.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1869269515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 msgr2=0x5648bacf9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:05.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacf9bc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0a58a0 tx=0x7fa38c0adbd0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1869269515 shutdown_connections 2024-05-08T07:04:05.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5648bad09e90 0x5648bad0c280 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf5ec0 0x5648bacfa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 0x5648bacfc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1869269515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0e50 0x5648bacf9bc0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa38a000700 0 client.15978 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:04:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1869269515 >> 172.21.15.70:0/1869269515 conn(0x5648bac1ec60 msgr2=0x5648bace5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:04:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1869269515 shutdown_connections 2024-05-08T07:04:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1869269515 wait complete. 2024-05-08T07:04:05.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.303+0000 7fa3b129cb80 20 client.15978 trim_cache size 0 max 16384 2024-05-08T07:04:05.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.325+0000 7fa3b129cb80 1 Processor -- start 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.325+0000 7fa3b129cb80 1 -- start start 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.325+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bac1ec60 0x5648bace56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.325+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 0x5648bad0f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.325+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0e50 0x5648bad0f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.325+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a01b8490 con 0x5648bac1ec60 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.325+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a01b5d20 con 0x5648bacf0490 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.325+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a01b3b90 con 0x5648bacf0e50 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bac1ec60 0x5648bace56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bac1ec60 0x5648bace56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37734/0 (socket says 172.21.15.70:37734) 2024-05-08T07:04:05.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39fe00700 1 -- 172.21.15.70:0/3901652809 learned_addr learned my addr 172.21.15.70:0/3901652809 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa3a4a00700 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0e50 0x5648bad0f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39f400700 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 0x5648bad0f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39fe00700 1 -- 172.21.15.70:0/3901652809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0e50 msgr2=0x5648bad0f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39fe00700 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0e50 0x5648bad0f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39fe00700 1 -- 172.21.15.70:0/3901652809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 msgr2=0x5648bad0f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39fe00700 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 0x5648bad0f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39fe00700 1 -- 172.21.15.70:0/3901652809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648bace7980 con 0x5648bac1ec60 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa3a4a00700 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0e50 0x5648bad0f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.326+0000 7fa39fe00700 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bac1ec60 0x5648bace56d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa390000c00 tx=0x7fa39000d500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1296b0c2fc033616 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.327+0000 7fa394c00700 1 -- 172.21.15.70:0/3901652809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390003cc0 con 0x5648bac1ec60 2024-05-08T07:04:05.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.327+0000 7fa394c00700 1 -- 172.21.15.70:0/3901652809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa39000de60 con 0x5648bac1ec60 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.327+0000 7fa394c00700 1 -- 172.21.15.70:0/3901652809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390004bf0 con 0x5648bac1ec60 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 -- 172.21.15.70:0/3901652809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bac1ec60 msgr2=0x5648bace56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bac1ec60 0x5648bace56d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa390000c00 tx=0x7fa39000d500 comp rx=0 tx=0).stop 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 -- 172.21.15.70:0/3901652809 shutdown_connections 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bacf0e50 0x5648bad0f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bac1ec60 0x5648bace56d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/3901652809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0490 0x5648bad0f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 -- 172.21.15.70:0/3901652809 >> 172.21.15.70:0/3901652809 conn(0x5648bacf4470 msgr2=0x5648bace4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 -- 172.21.15.70:0/3901652809 shutdown_connections 2024-05-08T07:04:05.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 -- 172.21.15.70:0/3901652809 wait complete. 2024-05-08T07:04:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.328+0000 7fa3b129cb80 1 -- start start 2024-05-08T07:04:05.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.329+0000 7fa3b129cb80 1 Processor -- start 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.329+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bac1ec60 0x5648bad6e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.329+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0490 0x5648bad6e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.329+0000 7fa3b129cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0e50 0x5648bad685e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.329+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a01b41e0 con 0x5648bacf0490 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.329+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a01b5650 con 0x5648bacf0e50 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.329+0000 7fa3b129cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a01b48b0 con 0x5648bac1ec60 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.329+0000 7fa3b129cb80 10 client.0 _ll_register_callbacks cb 0x5648babe9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.329+0000 7fa39f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0490 0x5648bad6e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa39f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0490 0x5648bad6e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37750/0 (socket says 172.21.15.70:37750) 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa39f400700 1 -- 172.21.15.70:0/1606137990 learned_addr learned my addr 172.21.15.70:0/1606137990 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa39fe00700 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bac1ec60 0x5648bad6e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa3a4a00700 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0e50 0x5648bad685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa39f400700 1 -- 172.21.15.70:0/1606137990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bac1ec60 msgr2=0x5648bad6e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:04:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa39f400700 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bac1ec60 0x5648bad6e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa39f400700 1 -- 172.21.15.70:0/1606137990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0e50 msgr2=0x5648bad685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa39f400700 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0e50 0x5648bad685e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa39f400700 1 -- 172.21.15.70:0/1606137990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648bad68ce0 con 0x5648bacf0490 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa3a4a00700 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0e50 0x5648bad685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa39f400700 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0490 0x5648bad6e6b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0b2840 tx=0x7fa38c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3908ded28696de26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa38a000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.330+0000 7fa38a000700 1 -- 172.21.15.70:0/1606137990 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0a8f90 con 0x5648bacf0490 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa38a000700 1 -- 172.21.15.70:0/1606137990 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9583+0+0 (secure 0 0 0) 0x7fa38c00e350 con 0x5648bacf0490 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1606137990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa39000de60 con 0x5648bacf0490 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa38a000700 1 -- 172.21.15.70:0/1606137990 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa38c0a56e0 con 0x5648bacf0490 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa3b129cb80 10 client.15984 fetch_fsmap learned FSMap version 28 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1606137990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5648bad75950 con 0x5648bacf0490 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa38a000700 1 -- 172.21.15.70:0/1606137990 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa39000de60 con 0x5648bacf0490 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa38a000700 1 -- 172.21.15.70:0/1606137990 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fa38c0b21f0 con 0x5648bacf0490 2024-05-08T07:04:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa3b129cb80 10 client.15984 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:04:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa3b129cb80 10 client.15984 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:04:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa3b129cb80 20 client.15984 populate_metadata read hostname 'smithi070' 2024-05-08T07:04:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5648bacf5ec0 0x5648bad77e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:04:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa3b129cb80 4 client.15984 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "59e72ef8", "release": true, "await": true}] 2024-05-08T07:04:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.331+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1606137990 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "59e72ef8", "release": true, "await": true}) -- 0x5648bac50500 con 0x5648bacf5ec0 2024-05-08T07:04:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.332+0000 7fa39fe00700 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5648bacf5ec0 0x5648bad77e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:04:05.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.333+0000 7fa38a000700 10 client.15984 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:04:05.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:05.333+0000 7fa39fe00700 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5648bacf5ec0 0x5648bad77e30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba4b60cf6c56f6c3 server_cookie=5dcc7cabc0e97488 in_seq=0 out_seq=0 2024-05-08T07:04:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:06 smithi194 ceph-mon[33679]: pgmap v551: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:04:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:06 smithi070 ceph-mon[29591]: pgmap v551: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:04:06.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:06 smithi172 ceph-mon[33377]: pgmap v551: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:04:07.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.160+0000 7fa38a000700 1 -- 172.21.15.70:0/1606137990 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5648bac50500 con 0x5648bacf5ec0 2024-05-08T07:04:07.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.160+0000 7fa38a000700 10 client.15984 handle_command_reply: tid=0 2024-05-08T07:04:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.160+0000 7fa3b129cb80 1 client.15984 shutdown 2024-05-08T07:04:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.160+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1606137990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0490 msgr2=0x5648bad6e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.160+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0490 0x5648bad6e6b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0b2840 tx=0x7fa38c005bb0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.161+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1606137990 shutdown_connections 2024-05-08T07:04:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.161+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5648bacf5ec0 0x5648bad77e30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.161+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5648bacf0e50 0x5648bad685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.161+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5648bac1ec60 0x5648bad6e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.161+0000 7fa3b129cb80 1 --2- 172.21.15.70:0/1606137990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648bacf0490 0x5648bad6e6b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.161+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1606137990 >> 172.21.15.70:0/1606137990 conn(0x5648bacf4470 msgr2=0x5648bace5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:04:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.161+0000 7fa38a000700 0 client.15984 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:04:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.161+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1606137990 shutdown_connections 2024-05-08T07:04:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.161+0000 7fa3b129cb80 1 -- 172.21.15.70:0/1606137990 wait complete. 2024-05-08T07:04:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.162+0000 7fa3b129cb80 20 client.15984 trim_cache size 0 max 16384 2024-05-08T07:04:07.162 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:04:07.162 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:04:07.162 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:04:07.162 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 48, 2024-05-08T07:04:07.162 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:04:07.162 INFO:teuthology.orchestra.run.smithi070.stdout: "59e72ef8": { 2024-05-08T07:04:07.162 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 48, 2024-05-08T07:04:07.162 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:04:07.162 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.2, 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:04:07.163 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:04:07.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:04:07.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:04:07.164 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:04:07.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 -- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa3840b2a70 msgr2=0x7fa3840b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:07.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa3840b2a70 0x7fa3840b4f30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa398009fd0 tx=0x7fa39800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 -- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 msgr2=0x7fa3a01a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:04:07.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 0x7fa3a01a05b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00d980 tx=0x7fa38c00dd40 comp rx=0 tx=0).stop 2024-05-08T07:04:07.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 -- 172.21.15.70:0/942545781 shutdown_connections 2024-05-08T07:04:07.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa3840b2a70 0x7fa3840b4f30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3a010fb60 0x7fa3a01a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa3a0109ad0 0x7fa3a01a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 --2- 172.21.15.70:0/942545781 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa3a010a490 0x7fa3a01a05b0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:04:07.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.163+0000 7fa3a6a00700 1 -- 172.21.15.70:0/942545781 >> 172.21.15.70:0/942545781 conn(0x7fa3a0076c70 msgr2=0x7fa3a00772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:04:07.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.164+0000 7fa3a6a00700 1 -- 172.21.15.70:0/942545781 shutdown_connections 2024-05-08T07:04:07.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:04:07.164+0000 7fa3a6a00700 1 -- 172.21.15.70:0/942545781 wait complete. 2024-05-08T07:04:08.109 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '59e72ef8', seconds elapsed: 46.5 2024-05-08T07:04:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:08 smithi070 ceph-mon[29591]: pgmap v552: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:04:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:08 smithi172 ceph-mon[33377]: pgmap v552: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:04:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:08 smithi194 ceph-mon[33679]: pgmap v552: 129 pgs: 129 active+clean; 924 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:04:10.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:10 smithi070 ceph-mon[29591]: pgmap v553: 129 pgs: 129 active+clean; 933 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 887 KiB/s wr, 30 op/s 2024-05-08T07:04:10.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:10 smithi070 ceph-mon[29591]: osdmap e116: 12 total, 12 up, 12 in 2024-05-08T07:04:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:10 smithi172 ceph-mon[33377]: pgmap v553: 129 pgs: 129 active+clean; 933 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 887 KiB/s wr, 30 op/s 2024-05-08T07:04:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:10 smithi172 ceph-mon[33377]: osdmap e116: 12 total, 12 up, 12 in 2024-05-08T07:04:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:10 smithi194 ceph-mon[33679]: pgmap v553: 129 pgs: 129 active+clean; 933 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 887 KiB/s wr, 30 op/s 2024-05-08T07:04:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:10 smithi194 ceph-mon[33679]: osdmap e116: 12 total, 12 up, 12 in 2024-05-08T07:04:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:12 smithi070 ceph-mon[29591]: pgmap v555: 129 pgs: 129 active+clean; 933 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.0 MiB/s wr, 33 op/s 2024-05-08T07:04:12.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:12 smithi172 ceph-mon[33377]: pgmap v555: 129 pgs: 129 active+clean; 933 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.0 MiB/s wr, 33 op/s 2024-05-08T07:04:12.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:12 smithi194 ceph-mon[33679]: pgmap v555: 129 pgs: 129 active+clean; 933 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.0 MiB/s wr, 33 op/s 2024-05-08T07:04:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:14 smithi070 ceph-mon[29591]: pgmap v556: 129 pgs: 129 active+clean; 933 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.0 MiB/s wr, 33 op/s 2024-05-08T07:04:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:14 smithi172 ceph-mon[33377]: pgmap v556: 129 pgs: 129 active+clean; 933 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.0 MiB/s wr, 33 op/s 2024-05-08T07:04:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:14 smithi194 ceph-mon[33679]: pgmap v556: 129 pgs: 129 active+clean; 933 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 1.0 MiB/s wr, 33 op/s 2024-05-08T07:04:16.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:16 smithi070 ceph-mon[29591]: pgmap v557: 129 pgs: 129 active+clean; 951 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-05-08T07:04:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:16 smithi172 ceph-mon[33377]: pgmap v557: 129 pgs: 129 active+clean; 951 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-05-08T07:04:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:16 smithi194 ceph-mon[33679]: pgmap v557: 129 pgs: 129 active+clean; 951 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-05-08T07:04:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:18 smithi070 ceph-mon[29591]: pgmap v558: 129 pgs: 129 active+clean; 951 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-05-08T07:04:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:18 smithi070 ceph-mon[29591]: osdmap e117: 12 total, 12 up, 12 in 2024-05-08T07:04:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:04:18.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:18 smithi172 ceph-mon[33377]: pgmap v558: 129 pgs: 129 active+clean; 951 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-05-08T07:04:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:18 smithi172 ceph-mon[33377]: osdmap e117: 12 total, 12 up, 12 in 2024-05-08T07:04:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:04:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:18 smithi194 ceph-mon[33679]: pgmap v558: 129 pgs: 129 active+clean; 951 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 2.8 MiB/s wr, 37 op/s 2024-05-08T07:04:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:18 smithi194 ceph-mon[33679]: osdmap e117: 12 total, 12 up, 12 in 2024-05-08T07:04:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:04:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:04:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:04:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:04:19.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:04:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:04:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:04:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:04:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:04:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:04:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:20 smithi070 ceph-mon[29591]: pgmap v560: 129 pgs: 129 active+clean; 961 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 2.8 MiB/s wr, 76 op/s 2024-05-08T07:04:20.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:20 smithi172 ceph-mon[33377]: pgmap v560: 129 pgs: 129 active+clean; 961 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 2.8 MiB/s wr, 76 op/s 2024-05-08T07:04:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:20 smithi194 ceph-mon[33679]: pgmap v560: 129 pgs: 129 active+clean; 961 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 2.8 MiB/s wr, 76 op/s 2024-05-08T07:04:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:22 smithi070 ceph-mon[29591]: pgmap v561: 129 pgs: 129 active+clean; 961 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 2.8 MiB/s wr, 75 op/s 2024-05-08T07:04:22.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:22 smithi172 ceph-mon[33377]: pgmap v561: 129 pgs: 129 active+clean; 961 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 2.8 MiB/s wr, 75 op/s 2024-05-08T07:04:22.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:22 smithi194 ceph-mon[33679]: pgmap v561: 129 pgs: 129 active+clean; 961 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 2.8 MiB/s wr, 75 op/s 2024-05-08T07:04:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:23 smithi070 ceph-mon[29591]: pgmap v562: 129 pgs: 129 active+clean; 961 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 2.8 MiB/s wr, 75 op/s 2024-05-08T07:04:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:23 smithi172 ceph-mon[33377]: pgmap v562: 129 pgs: 129 active+clean; 961 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 2.8 MiB/s wr, 75 op/s 2024-05-08T07:04:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:23 smithi194 ceph-mon[33679]: pgmap v562: 129 pgs: 129 active+clean; 961 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 2.8 MiB/s wr, 75 op/s 2024-05-08T07:04:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:26 smithi070 ceph-mon[29591]: pgmap v563: 129 pgs: 129 active+clean; 969 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-05-08T07:04:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:26 smithi172 ceph-mon[33377]: pgmap v563: 129 pgs: 129 active+clean; 969 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-05-08T07:04:26.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:26 smithi194 ceph-mon[33679]: pgmap v563: 129 pgs: 129 active+clean; 969 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-05-08T07:04:28.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:28 smithi070 ceph-mon[29591]: pgmap v564: 129 pgs: 129 active+clean; 969 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-05-08T07:04:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:28 smithi172 ceph-mon[33377]: pgmap v564: 129 pgs: 129 active+clean; 969 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-05-08T07:04:28.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:28 smithi194 ceph-mon[33679]: pgmap v564: 129 pgs: 129 active+clean; 969 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-05-08T07:04:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:30 smithi070 ceph-mon[29591]: pgmap v565: 129 pgs: 129 active+clean; 975 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 2.1 MiB/s wr, 127 op/s 2024-05-08T07:04:30.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:30 smithi172 ceph-mon[33377]: pgmap v565: 129 pgs: 129 active+clean; 975 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 2.1 MiB/s wr, 127 op/s 2024-05-08T07:04:30.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:30 smithi194 ceph-mon[33679]: pgmap v565: 129 pgs: 129 active+clean; 975 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 2.1 MiB/s wr, 127 op/s 2024-05-08T07:04:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:32 smithi070 ceph-mon[29591]: pgmap v566: 129 pgs: 129 active+clean; 975 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-05-08T07:04:32.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:32 smithi172 ceph-mon[33377]: pgmap v566: 129 pgs: 129 active+clean; 975 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-05-08T07:04:32.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:32 smithi194 ceph-mon[33679]: pgmap v566: 129 pgs: 129 active+clean; 975 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-05-08T07:04:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:34 smithi070 ceph-mon[29591]: pgmap v567: 129 pgs: 129 active+clean; 975 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-05-08T07:04:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:34 smithi172 ceph-mon[33377]: pgmap v567: 129 pgs: 129 active+clean; 975 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-05-08T07:04:34.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:34 smithi194 ceph-mon[33679]: pgmap v567: 129 pgs: 129 active+clean; 975 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 85 op/s 2024-05-08T07:04:36.562 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:36 smithi194 ceph-mon[33679]: pgmap v568: 129 pgs: 129 active+clean; 979 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.6 MiB/s wr, 116 op/s 2024-05-08T07:04:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:36 smithi070 ceph-mon[29591]: pgmap v568: 129 pgs: 129 active+clean; 979 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.6 MiB/s wr, 116 op/s 2024-05-08T07:04:36.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:36 smithi172 ceph-mon[33377]: pgmap v568: 129 pgs: 129 active+clean; 979 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 1.6 MiB/s wr, 116 op/s 2024-05-08T07:04:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:38 smithi070 ceph-mon[29591]: pgmap v569: 129 pgs: 129 active+clean; 979 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 979 KiB/s wr, 72 op/s 2024-05-08T07:04:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:38 smithi172 ceph-mon[33377]: pgmap v569: 129 pgs: 129 active+clean; 979 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 979 KiB/s wr, 72 op/s 2024-05-08T07:04:38.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:38 smithi194 ceph-mon[33679]: pgmap v569: 129 pgs: 129 active+clean; 979 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 979 KiB/s wr, 72 op/s 2024-05-08T07:04:40.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:40 smithi070 ceph-mon[29591]: pgmap v570: 129 pgs: 129 active+clean; 985 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2024-05-08T07:04:40.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:40 smithi172 ceph-mon[33377]: pgmap v570: 129 pgs: 129 active+clean; 985 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2024-05-08T07:04:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:40 smithi194 ceph-mon[33679]: pgmap v570: 129 pgs: 129 active+clean; 985 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 1.4 MiB/s wr, 114 op/s 2024-05-08T07:04:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:42 smithi070 ceph-mon[29591]: pgmap v571: 129 pgs: 129 active+clean; 985 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 836 KiB/s wr, 71 op/s 2024-05-08T07:04:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:42 smithi172 ceph-mon[33377]: pgmap v571: 129 pgs: 129 active+clean; 985 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 836 KiB/s wr, 71 op/s 2024-05-08T07:04:42.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:42 smithi194 ceph-mon[33679]: pgmap v571: 129 pgs: 129 active+clean; 985 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 836 KiB/s wr, 71 op/s 2024-05-08T07:04:44.599 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:44 smithi070 ceph-mon[29591]: pgmap v572: 129 pgs: 129 active+clean; 985 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 836 KiB/s wr, 71 op/s 2024-05-08T07:04:44.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:44 smithi172 ceph-mon[33377]: pgmap v572: 129 pgs: 129 active+clean; 985 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 836 KiB/s wr, 71 op/s 2024-05-08T07:04:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:44 smithi194 ceph-mon[33679]: pgmap v572: 129 pgs: 129 active+clean; 985 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 836 KiB/s wr, 71 op/s 2024-05-08T07:04:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:46 smithi070 ceph-mon[29591]: pgmap v573: 129 pgs: 129 active+clean; 991 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-05-08T07:04:46.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:46 smithi172 ceph-mon[33377]: pgmap v573: 129 pgs: 129 active+clean; 991 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-05-08T07:04:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:46 smithi194 ceph-mon[33679]: pgmap v573: 129 pgs: 129 active+clean; 991 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-05-08T07:04:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:47 smithi070 ceph-mon[29591]: pgmap v574: 129 pgs: 129 active+clean; 991 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.0 MiB/s wr, 82 op/s 2024-05-08T07:04:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:47 smithi172 ceph-mon[33377]: pgmap v574: 129 pgs: 129 active+clean; 991 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.0 MiB/s wr, 82 op/s 2024-05-08T07:04:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:47 smithi194 ceph-mon[33679]: pgmap v574: 129 pgs: 129 active+clean; 991 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 1.0 MiB/s wr, 82 op/s 2024-05-08T07:04:50.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:50 smithi070 ceph-mon[29591]: pgmap v575: 129 pgs: 129 active+clean; 994 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2024-05-08T07:04:50.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:50 smithi172 ceph-mon[33377]: pgmap v575: 129 pgs: 129 active+clean; 994 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2024-05-08T07:04:50.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:50 smithi194 ceph-mon[33679]: pgmap v575: 129 pgs: 129 active+clean; 994 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 1.3 MiB/s wr, 118 op/s 2024-05-08T07:04:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:52 smithi070 ceph-mon[29591]: pgmap v576: 129 pgs: 129 active+clean; 994 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 884 KiB/s wr, 76 op/s 2024-05-08T07:04:52.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:52 smithi172 ceph-mon[33377]: pgmap v576: 129 pgs: 129 active+clean; 994 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 884 KiB/s wr, 76 op/s 2024-05-08T07:04:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:52 smithi194 ceph-mon[33679]: pgmap v576: 129 pgs: 129 active+clean; 994 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 884 KiB/s wr, 76 op/s 2024-05-08T07:04:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:54 smithi070 ceph-mon[29591]: pgmap v577: 129 pgs: 129 active+clean; 994 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 884 KiB/s wr, 76 op/s 2024-05-08T07:04:54.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:54 smithi172 ceph-mon[33377]: pgmap v577: 129 pgs: 129 active+clean; 994 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 884 KiB/s wr, 76 op/s 2024-05-08T07:04:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:54 smithi194 ceph-mon[33679]: pgmap v577: 129 pgs: 129 active+clean; 994 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 884 KiB/s wr, 76 op/s 2024-05-08T07:04:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:56 smithi070 ceph-mon[29591]: pgmap v578: 129 pgs: 129 active+clean; 999 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-05-08T07:04:56.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:56 smithi172 ceph-mon[33377]: pgmap v578: 129 pgs: 129 active+clean; 999 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-05-08T07:04:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:56 smithi194 ceph-mon[33679]: pgmap v578: 129 pgs: 129 active+clean; 999 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 1.2 MiB/s wr, 113 op/s 2024-05-08T07:04:58.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:04:58 smithi070 ceph-mon[29591]: pgmap v579: 129 pgs: 129 active+clean; 999 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 704 KiB/s wr, 72 op/s 2024-05-08T07:04:58.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:04:58 smithi172 ceph-mon[33377]: pgmap v579: 129 pgs: 129 active+clean; 999 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 704 KiB/s wr, 72 op/s 2024-05-08T07:04:58.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:04:58 smithi194 ceph-mon[33679]: pgmap v579: 129 pgs: 129 active+clean; 999 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 704 KiB/s wr, 72 op/s 2024-05-08T07:05:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:00 smithi070 ceph-mon[29591]: pgmap v580: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 962 KiB/s wr, 105 op/s 2024-05-08T07:05:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:00 smithi172 ceph-mon[33377]: pgmap v580: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 962 KiB/s wr, 105 op/s 2024-05-08T07:05:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:00 smithi194 ceph-mon[33679]: pgmap v580: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 962 KiB/s wr, 105 op/s 2024-05-08T07:05:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:02 smithi070 ceph-mon[29591]: pgmap v581: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 637 KiB/s wr, 69 op/s 2024-05-08T07:05:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:02 smithi172 ceph-mon[33377]: pgmap v581: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 637 KiB/s wr, 69 op/s 2024-05-08T07:05:02.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:02 smithi194 ceph-mon[33679]: pgmap v581: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 637 KiB/s wr, 69 op/s 2024-05-08T07:05:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:03 smithi172 ceph-mon[33377]: pgmap v582: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 638 KiB/s wr, 69 op/s 2024-05-08T07:05:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:03 smithi194 ceph-mon[33679]: pgmap v582: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 638 KiB/s wr, 69 op/s 2024-05-08T07:05:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:03 smithi070 ceph-mon[29591]: pgmap v582: 129 pgs: 129 active+clean; 1001 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 638 KiB/s wr, 69 op/s 2024-05-08T07:05:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:06 smithi070 ceph-mon[29591]: pgmap v583: 129 pgs: 129 active+clean; 1006 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 1.0 MiB/s wr, 115 op/s 2024-05-08T07:05:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:06 smithi172 ceph-mon[33377]: pgmap v583: 129 pgs: 129 active+clean; 1006 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 1.0 MiB/s wr, 115 op/s 2024-05-08T07:05:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:06 smithi194 ceph-mon[33679]: pgmap v583: 129 pgs: 129 active+clean; 1006 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 1.0 MiB/s wr, 115 op/s 2024-05-08T07:05:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:08 smithi070 ceph-mon[29591]: pgmap v584: 129 pgs: 129 active+clean; 1006 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 646 KiB/s wr, 79 op/s 2024-05-08T07:05:08.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:08 smithi172 ceph-mon[33377]: pgmap v584: 129 pgs: 129 active+clean; 1006 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 646 KiB/s wr, 79 op/s 2024-05-08T07:05:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:08 smithi194 ceph-mon[33679]: pgmap v584: 129 pgs: 129 active+clean; 1006 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 646 KiB/s wr, 79 op/s 2024-05-08T07:05:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:10 smithi070 ceph-mon[29591]: pgmap v585: 129 pgs: 129 active+clean; 1015 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 1.4 MiB/s wr, 123 op/s 2024-05-08T07:05:10.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:10 smithi172 ceph-mon[33377]: pgmap v585: 129 pgs: 129 active+clean; 1015 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 1.4 MiB/s wr, 123 op/s 2024-05-08T07:05:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:10 smithi194 ceph-mon[33679]: pgmap v585: 129 pgs: 129 active+clean; 1015 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 1.4 MiB/s wr, 123 op/s 2024-05-08T07:05:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:12 smithi070 ceph-mon[29591]: pgmap v586: 129 pgs: 129 active+clean; 1015 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.2 MiB/s wr, 90 op/s 2024-05-08T07:05:12.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:12 smithi172 ceph-mon[33377]: pgmap v586: 129 pgs: 129 active+clean; 1015 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.2 MiB/s wr, 90 op/s 2024-05-08T07:05:12.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:12 smithi194 ceph-mon[33679]: pgmap v586: 129 pgs: 129 active+clean; 1015 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.2 MiB/s wr, 90 op/s 2024-05-08T07:05:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:14 smithi070 ceph-mon[29591]: pgmap v587: 129 pgs: 129 active+clean; 1015 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.2 MiB/s wr, 90 op/s 2024-05-08T07:05:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:14 smithi172 ceph-mon[33377]: pgmap v587: 129 pgs: 129 active+clean; 1015 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.2 MiB/s wr, 90 op/s 2024-05-08T07:05:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:14 smithi194 ceph-mon[33679]: pgmap v587: 129 pgs: 129 active+clean; 1015 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 1.2 MiB/s wr, 90 op/s 2024-05-08T07:05:16.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:16 smithi070 ceph-mon[29591]: pgmap v588: 129 pgs: 129 active+clean; 1021 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.7 MiB/s wr, 133 op/s 2024-05-08T07:05:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:16 smithi172 ceph-mon[33377]: pgmap v588: 129 pgs: 129 active+clean; 1021 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.7 MiB/s wr, 133 op/s 2024-05-08T07:05:16.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:16 smithi194 ceph-mon[33679]: pgmap v588: 129 pgs: 129 active+clean; 1021 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.7 MiB/s wr, 133 op/s 2024-05-08T07:05:18.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:18 smithi070 ceph-mon[29591]: pgmap v589: 129 pgs: 129 active+clean; 1021 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-05-08T07:05:18.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:18 smithi172 ceph-mon[33377]: pgmap v589: 129 pgs: 129 active+clean; 1021 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-05-08T07:05:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:18 smithi194 ceph-mon[33679]: pgmap v589: 129 pgs: 129 active+clean; 1021 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-05-08T07:05:19.611 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.5 2024-05-08T07:05:19.611 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:05:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:05:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:20 smithi070 ceph-mon[29591]: pgmap v590: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 1.8 MiB/s wr, 127 op/s 2024-05-08T07:05:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:05:20.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:20 smithi172 ceph-mon[33377]: pgmap v590: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 1.8 MiB/s wr, 127 op/s 2024-05-08T07:05:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:05:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:20 smithi194 ceph-mon[33679]: pgmap v590: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 1.8 MiB/s wr, 127 op/s 2024-05-08T07:05:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:05:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:05:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:05:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:05:21.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:05:21.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:05:21.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:05:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:05:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:05:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:05:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:22 smithi070 ceph-mon[29591]: pgmap v591: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1013 KiB/s wr, 83 op/s 2024-05-08T07:05:22.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.675+0000 7fd696000700 1 -- 172.21.15.70:0/3239431303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd690104100 msgr2=0x7fd690108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:22.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.675+0000 7fd696000700 1 --2- 172.21.15.70:0/3239431303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd690104100 0x7fd690108120 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0099c0 tx=0x7fd67c009cd0 comp rx=0 tx=0).stop 2024-05-08T07:05:22.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.676+0000 7fd696000700 1 -- 172.21.15.70:0/3239431303 shutdown_connections 2024-05-08T07:05:22.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.676+0000 7fd696000700 1 --2- 172.21.15.70:0/3239431303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd690108850 0x7fd6901103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:22.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.676+0000 7fd696000700 1 --2- 172.21.15.70:0/3239431303 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd690103750 0x7fd690103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:22.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.676+0000 7fd696000700 1 --2- 172.21.15.70:0/3239431303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd690104100 0x7fd690108120 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:22.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.676+0000 7fd696000700 1 -- 172.21.15.70:0/3239431303 >> 172.21.15.70:0/3239431303 conn(0x7fd69007a600 msgr2=0x7fd69007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:05:22.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.676+0000 7fd696000700 1 -- 172.21.15.70:0/3239431303 shutdown_connections 2024-05-08T07:05:22.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.676+0000 7fd696000700 1 -- 172.21.15.70:0/3239431303 wait complete. 2024-05-08T07:05:22.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.678+0000 7fd696000700 1 Processor -- start 2024-05-08T07:05:22.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.678+0000 7fd696000700 1 -- start start 2024-05-08T07:05:22.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd696000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd690103750 0x7fd6901178a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:22.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd696000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd690104100 0x7fd690117de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:22.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd696000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd690108850 0x7fd690112a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:22.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd696000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd690076c50 con 0x7fd690103750 2024-05-08T07:05:22.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd696000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd690076ad0 con 0x7fd690104100 2024-05-08T07:05:22.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd696000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd690076dd0 con 0x7fd690108850 2024-05-08T07:05:22.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd68f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd690103750 0x7fd6901178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:22.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd68f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd690103750 0x7fd6901178a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33520/0 (socket says 172.21.15.70:33520) 2024-05-08T07:05:22.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd68f400700 1 -- 172.21.15.70:0/306562006 learned_addr learned my addr 172.21.15.70:0/306562006 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:05:22.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.679+0000 7fd68ea00700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd690104100 0x7fd690117de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:22.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.680+0000 7fd68fe00700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd690108850 0x7fd690112a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:22.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:22 smithi172 ceph-mon[33377]: pgmap v591: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1013 KiB/s wr, 83 op/s 2024-05-08T07:05:22.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.681+0000 7fd68fe00700 1 -- 172.21.15.70:0/306562006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd690104100 msgr2=0x7fd690117de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:22.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.681+0000 7fd68fe00700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd690104100 0x7fd690117de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:22.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.681+0000 7fd68fe00700 1 -- 172.21.15.70:0/306562006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd690103750 msgr2=0x7fd6901178a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:22.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.681+0000 7fd68fe00700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd690103750 0x7fd6901178a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:22.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.681+0000 7fd68fe00700 1 -- 172.21.15.70:0/306562006 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd690113360 con 0x7fd690108850 2024-05-08T07:05:22.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.681+0000 7fd68fe00700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd690108850 0x7fd690112a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd688007f10 tx=0x7fd68800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:05:22.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.682+0000 7fd687e00700 1 -- 172.21.15.70:0/306562006 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688004db0 con 0x7fd690108850 2024-05-08T07:05:22.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.682+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd690113650 con 0x7fd690108850 2024-05-08T07:05:22.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.682+0000 7fd687e00700 1 -- 172.21.15.70:0/306562006 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd688009e20 con 0x7fd690108850 2024-05-08T07:05:22.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.682+0000 7fd687e00700 1 -- 172.21.15.70:0/306562006 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6880059a0 con 0x7fd690108850 2024-05-08T07:05:22.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.683+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69011d790 con 0x7fd690108850 2024-05-08T07:05:22.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.684+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd690104be0 con 0x7fd690108850 2024-05-08T07:05:22.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.688+0000 7fd687e00700 1 -- 172.21.15.70:0/306562006 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd688005140 con 0x7fd690108850 2024-05-08T07:05:22.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.690+0000 7fd687e00700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd6740b2aa0 0x7fd6740b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:22.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.690+0000 7fd687e00700 1 -- 172.21.15.70:0/306562006 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9583+0+0 (secure 0 0 0) 0x7fd6880e2a00 con 0x7fd690108850 2024-05-08T07:05:22.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.691+0000 7fd68f400700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd6740b2aa0 0x7fd6740b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:22.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.692+0000 7fd68f400700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd6740b2aa0 0x7fd6740b4f60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd680005950 tx=0x7fd68000a400 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:05:22.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:22.705+0000 7fd687e00700 1 -- 172.21.15.70:0/306562006 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd688010070 con 0x7fd690108850 2024-05-08T07:05:22.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:22 smithi194 ceph-mon[33679]: pgmap v591: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1013 KiB/s wr, 83 op/s 2024-05-08T07:05:23.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.075+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd69006a190 con 0x7fd690108850 2024-05-08T07:05:23.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.077+0000 7fd687e00700 1 -- 172.21.15.70:0/306562006 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7fd69006a190 con 0x7fd690108850 2024-05-08T07:05:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:05:23.078 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:05:23.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.082+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd6740b2aa0 msgr2=0x7fd6740b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:23.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.082+0000 7fd696000700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd6740b2aa0 0x7fd6740b4f60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd680005950 tx=0x7fd68000a400 comp rx=0 tx=0).stop 2024-05-08T07:05:23.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.082+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd690108850 msgr2=0x7fd690112a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:23.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.082+0000 7fd696000700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd690108850 0x7fd690112a60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd688007f10 tx=0x7fd68800d3b0 comp rx=0 tx=0).stop 2024-05-08T07:05:23.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.083+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 shutdown_connections 2024-05-08T07:05:23.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.083+0000 7fd696000700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd6740b2aa0 0x7fd6740b4f60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:23.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.083+0000 7fd696000700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd690108850 0x7fd690112a60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:23.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.083+0000 7fd696000700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd690103750 0x7fd6901178a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:23.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.083+0000 7fd696000700 1 --2- 172.21.15.70:0/306562006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd690104100 0x7fd690117de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:23.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.083+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 >> 172.21.15.70:0/306562006 conn(0x7fd69007a600 msgr2=0x7fd690101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:05:23.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.083+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 shutdown_connections 2024-05-08T07:05:23.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:23.083+0000 7fd696000700 1 -- 172.21.15.70:0/306562006 wait complete. 2024-05-08T07:05:23.083 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:05:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:23 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/306562006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:05:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:23 smithi070 ceph-mon[29591]: pgmap v592: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1013 KiB/s wr, 83 op/s 2024-05-08T07:05:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:23 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/306562006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:05:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:23 smithi172 ceph-mon[33377]: pgmap v592: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1013 KiB/s wr, 83 op/s 2024-05-08T07:05:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:23 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/306562006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:05:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:23 smithi194 ceph-mon[33679]: pgmap v592: 129 pgs: 129 active+clean; 1.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 1013 KiB/s wr, 83 op/s 2024-05-08T07:05:24.083 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 77.5 --await-for 42.0' 2024-05-08T07:05:24.084 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 77.5 --await-for 42.0 2024-05-08T07:05:24.549 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:05:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:26 smithi070 ceph-mon[29591]: pgmap v593: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-05-08T07:05:26.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:26 smithi172 ceph-mon[33377]: pgmap v593: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-05-08T07:05:26.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:26 smithi194 ceph-mon[33679]: pgmap v593: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 1.8 MiB/s wr, 139 op/s 2024-05-08T07:05:27.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.510+0000 7efffc200700 1 -- 172.21.15.70:0/1452611475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff4075ff0 msgr2=0x7efff410f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:27.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.510+0000 7efffc200700 1 --2- 172.21.15.70:0/1452611475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff4075ff0 0x7efff410f9c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7effe4009990 tx=0x7effe4009ca0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.510+0000 7efffc200700 1 -- 172.21.15.70:0/1452611475 shutdown_connections 2024-05-08T07:05:27.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.510+0000 7efffc200700 1 --2- 172.21.15.70:0/1452611475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff410ff00 0x7efff41122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.510+0000 7efffc200700 1 --2- 172.21.15.70:0/1452611475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efff40756d0 0x7efff4075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.510+0000 7efffc200700 1 --2- 172.21.15.70:0/1452611475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff4075ff0 0x7efff410f9c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.510+0000 7efffc200700 1 -- 172.21.15.70:0/1452611475 >> 172.21.15.70:0/1452611475 conn(0x7efff407a570 msgr2=0x7efff407a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:05:27.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.510+0000 7efffc200700 1 -- 172.21.15.70:0/1452611475 shutdown_connections 2024-05-08T07:05:27.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.510+0000 7efffc200700 1 -- 172.21.15.70:0/1452611475 wait complete. 2024-05-08T07:05:27.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.512+0000 7efffc200700 1 Processor -- start 2024-05-08T07:05:27.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.512+0000 7efffc200700 1 -- start start 2024-05-08T07:05:27.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efffc200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff40756d0 0x7efff410f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efffc200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efff4075ff0 0x7efff410c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efffc200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff410ff00 0x7efff410cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efffc200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efff4115780 con 0x7efff410ff00 2024-05-08T07:05:27.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efffc200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efff4115600 con 0x7efff40756d0 2024-05-08T07:05:27.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efffc200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efff4115900 con 0x7efff4075ff0 2024-05-08T07:05:27.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efffa200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff410ff00 0x7efff410cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efffa200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff410ff00 0x7efff410cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49698/0 (socket says 172.21.15.70:49698) 2024-05-08T07:05:27.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efffa200700 1 -- 172.21.15.70:0/2271920716 learned_addr learned my addr 172.21.15.70:0/2271920716 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:05:27.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.513+0000 7efff8e00700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efff4075ff0 0x7efff410c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.514+0000 7efff9800700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff40756d0 0x7efff410f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.514+0000 7efffa200700 1 -- 172.21.15.70:0/2271920716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efff4075ff0 msgr2=0x7efff410c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:27.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.514+0000 7efffa200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efff4075ff0 0x7efff410c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.514+0000 7efffa200700 1 -- 172.21.15.70:0/2271920716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff40756d0 msgr2=0x7efff410f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:27.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.514+0000 7efffa200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff40756d0 0x7efff410f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.514+0000 7efffa200700 1 -- 172.21.15.70:0/2271920716 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff41ac4c0 con 0x7efff410ff00 2024-05-08T07:05:27.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.514+0000 7efffa200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff410ff00 0x7efff410cea0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7effec00ada0 tx=0x7effec00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:05:27.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.515+0000 7efff2000700 1 -- 172.21.15.70:0/2271920716 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec017020 con 0x7efff410ff00 2024-05-08T07:05:27.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.515+0000 7efff2000700 1 -- 172.21.15.70:0/2271920716 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effec00ce10 con 0x7efff410ff00 2024-05-08T07:05:27.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.515+0000 7efff2000700 1 -- 172.21.15.70:0/2271920716 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec005380 con 0x7efff410ff00 2024-05-08T07:05:27.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.515+0000 7efffc200700 1 -- 172.21.15.70:0/2271920716 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff41ac690 con 0x7efff410ff00 2024-05-08T07:05:27.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.515+0000 7efffc200700 1 -- 172.21.15.70:0/2271920716 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff41acb20 con 0x7efff410ff00 2024-05-08T07:05:27.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.520+0000 7efff2000700 1 -- 172.21.15.70:0/2271920716 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7effec00c980 con 0x7efff410ff00 2024-05-08T07:05:27.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.522+0000 7f0006ba7b80 1 Processor -- start 2024-05-08T07:05:27.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.522+0000 7f0006ba7b80 1 -- start start 2024-05-08T07:05:27.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.522+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 0x559ab9e4a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.522+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e449a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.522+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e50d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.522+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559ab9d96bb0 con 0x559ab9e44520 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.522+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559ab9d348f0 con 0x559ab9e49f50 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.522+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559ab9d92b70 con 0x559ab9e44ee0 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.523+0000 7efff2000700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effdc0b2ba0 0x7effdc0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.523+0000 7efff9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.523+0000 7efff9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49708/0 (socket says 172.21.15.70:49708) 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.523+0000 7efff9800700 1 -- 172.21.15.70:0/3227447489 learned_addr learned my addr 172.21.15.70:0/3227447489 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.523+0000 7efff8e00700 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 0x559ab9e4a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.523+0000 7efff2000700 1 -- 172.21.15.70:0/2271920716 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9583+0+0 (secure 0 0 0) 0x7effec0e20a0 con 0x7efff410ff00 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.523+0000 7efff8e00700 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e50d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.524+0000 7efff9800700 1 -- 172.21.15.70:0/3227447489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 msgr2=0x559ab9e50d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.524+0000 7efff9800700 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e50d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.524+0000 7efff9800700 1 -- 172.21.15.70:0/3227447489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 msgr2=0x559ab9e4a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.524+0000 7efff9800700 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 0x559ab9e4a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.524+0000 7efff9800700 1 -- 172.21.15.70:0/3227447489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ab9ce3a60 con 0x559ab9e44520 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.524+0000 7efff8e00700 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 0x559ab9e4a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.524+0000 7efffa200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effdc0b2ba0 0x7effdc0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.525+0000 7efff9800700 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e449a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7effe800bd30 tx=0x7effe800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbe364dbac7b5c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.525+0000 7efffa200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effdc0b2ba0 0x7effdc0b5060 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7effec004fd0 tx=0x7effec00a360 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.525+0000 7effe2a00700 1 -- 172.21.15.70:0/3227447489 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe8015070 con 0x559ab9e44520 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.525+0000 7effe2a00700 1 -- 172.21.15.70:0/3227447489 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effe800fd40 con 0x559ab9e44520 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.525+0000 7effe2a00700 1 -- 172.21.15.70:0/3227447489 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe8005580 con 0x559ab9e44520 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.526+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3227447489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 msgr2=0x559ab9e449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.526+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e449a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7effe800bd30 tx=0x7effe800f640 comp rx=0 tx=0).stop 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.526+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3227447489 shutdown_connections 2024-05-08T07:05:27.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.526+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e50d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.526+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 0x559ab9e4a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.526+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/3227447489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e449a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.527+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3227447489 >> 172.21.15.70:0/3227447489 conn(0x559ab9d72cf0 msgr2=0x559ab9e3ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.527+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3227447489 shutdown_connections 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.527+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3227447489 wait complete. 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.527+0000 7f0006ba7b80 1 -- start start 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.528+0000 7f0006ba7b80 1 Processor -- start 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.528+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44520 0x559ab9e50910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.528+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44ee0 0x559ab9e4dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.528+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e4e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.528+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559ab9e51310 con 0x559ab9e49f50 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.528+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559ab9cfccb0 con 0x559ab9e44ee0 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.528+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559ab9e51490 con 0x559ab9e44520 2024-05-08T07:05:27.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.528+0000 7f0006ba7b80 10 client.0 _ll_register_callbacks cb 0x559ab9d3de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:05:27.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.529+0000 7efff8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e4e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.529+0000 7efff8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e4e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49718/0 (socket says 172.21.15.70:49718) 2024-05-08T07:05:27.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.529+0000 7efff8e00700 1 -- 172.21.15.70:0/19479187 learned_addr learned my addr 172.21.15.70:0/19479187 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:05:27.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.529+0000 7efff9800700 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44ee0 0x559ab9e4dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.529+0000 7efff8e00700 1 -- 172.21.15.70:0/19479187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44520 msgr2=0x559ab9e50910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T07:05:27.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.529+0000 7efff8e00700 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44520 0x559ab9e50910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.529+0000 7efff8e00700 1 -- 172.21.15.70:0/19479187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44ee0 msgr2=0x559ab9e4dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:05:27.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.529+0000 7efff8e00700 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44ee0 0x559ab9e4dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.529+0000 7efff8e00700 1 -- 172.21.15.70:0/19479187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ab9d5c5b0 con 0x559ab9e49f50 2024-05-08T07:05:27.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.530+0000 7efff8e00700 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e4e240 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7effe4005b00 tx=0x7effe400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc44ee8e523cf5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:05:27.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.530+0000 7effd7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:05:27.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.530+0000 7effd7400700 1 -- 172.21.15.70:0/19479187 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe402a060 con 0x559ab9e49f50 2024-05-08T07:05:27.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.530+0000 7effd7400700 1 -- 172.21.15.70:0/19479187 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9583+0+0 (secure 0 0 0) 0x7effe4005190 con 0x559ab9e49f50 2024-05-08T07:05:27.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.530+0000 7f0006ba7b80 1 -- 172.21.15.70:0/19479187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe800fd40 con 0x559ab9e49f50 2024-05-08T07:05:27.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.530+0000 7effd7400700 1 -- 172.21.15.70:0/19479187 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7effe4031050 con 0x559ab9e49f50 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.530+0000 7f0006ba7b80 10 client.16002 fetch_fsmap learned FSMap version 28 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.530+0000 7f0006ba7b80 1 -- 172.21.15.70:0/19479187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ab9e5ba80 con 0x559ab9e49f50 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.531+0000 7effd7400700 1 -- 172.21.15.70:0/19479187 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effe800fd40 con 0x559ab9e49f50 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.531+0000 7effd7400700 1 -- 172.21.15.70:0/19479187 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7effe400f4e0 con 0x559ab9e49f50 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.531+0000 7f0006ba7b80 10 client.16002 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.531+0000 7f0006ba7b80 10 client.16002 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.531+0000 7f0006ba7b80 20 client.16002 populate_metadata read hostname 'smithi070' 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.531+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559ab9e5e0c0 0x559ab9e604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.531+0000 7f0006ba7b80 4 client.16002 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.531+0000 7f0006ba7b80 1 -- 172.21.15.70:0/19479187 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ab9e11230 con 0x559ab9e5e0c0 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.532+0000 7efff9800700 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559ab9e5e0c0 0x559ab9e604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.533+0000 7efff9800700 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559ab9e5e0c0 0x559ab9e604d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de38a605b958842b server_cookie=d5c8e04b96daa28 in_seq=0 out_seq=0 2024-05-08T07:05:27.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.533+0000 7effd7400700 10 client.16002 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:05:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7effd7400700 1 -- 172.21.15.70:0/19479187 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559ab9e11230 con 0x559ab9e5e0c0 2024-05-08T07:05:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7effd7400700 10 client.16002 handle_command_reply: tid=0 2024-05-08T07:05:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 client.16002 shutdown 2024-05-08T07:05:27.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 -- 172.21.15.70:0/19479187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 msgr2=0x559ab9e4e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e4e240 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7effe4005b00 tx=0x7effe400be70 comp rx=0 tx=0).stop 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 -- 172.21.15.70:0/19479187 shutdown_connections 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559ab9e5e0c0 0x559ab9e604d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e4e240 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44520 0x559ab9e50910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/19479187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44ee0 0x559ab9e4dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7effd7400700 0 client.16002 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 -- 172.21.15.70:0/19479187 >> 172.21.15.70:0/19479187 conn(0x559ab9d72cf0 msgr2=0x559ab9e398e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.536+0000 7f0006ba7b80 1 -- 172.21.15.70:0/19479187 shutdown_connections 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.537+0000 7f0006ba7b80 1 -- 172.21.15.70:0/19479187 wait complete. 2024-05-08T07:05:27.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.537+0000 7f0006ba7b80 20 client.16002 trim_cache size 0 max 16384 2024-05-08T07:05:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.562+0000 7f0006ba7b80 1 Processor -- start 2024-05-08T07:05:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.562+0000 7f0006ba7b80 1 -- start start 2024-05-08T07:05:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.563+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e5aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.563+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e4cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.563+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 0x559ab9e5a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.563+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b8560 con 0x559ab9e44520 2024-05-08T07:05:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.563+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b5df0 con 0x559ab9e49f50 2024-05-08T07:05:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.563+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b3c60 con 0x559ab9e44ee0 2024-05-08T07:05:27.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.563+0000 7efff8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e5aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.563+0000 7efff8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e5aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49722/0 (socket says 172.21.15.70:49722) 2024-05-08T07:05:27.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.563+0000 7efff8e00700 1 -- 172.21.15.70:0/3845623085 learned_addr learned my addr 172.21.15.70:0/3845623085 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:05:27.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.564+0000 7efff9800700 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e4cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.564+0000 7efff8e00700 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 0x559ab9e5a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.564+0000 7efff8e00700 1 -- 172.21.15.70:0/3845623085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 msgr2=0x559ab9e4cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:05:27.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.564+0000 7efff8e00700 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e4cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.564+0000 7efff8e00700 1 -- 172.21.15.70:0/3845623085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 msgr2=0x559ab9e5a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:05:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.564+0000 7efff8e00700 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 0x559ab9e5a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.564+0000 7efff8e00700 1 -- 172.21.15.70:0/3845623085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ab9e3f9c0 con 0x559ab9e44520 2024-05-08T07:05:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.564+0000 7efff9800700 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e4cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:05:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.564+0000 7efff8e00700 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e5aaa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7effe4009f60 tx=0x7effe4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803627c0c6035b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:05:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.565+0000 7effe2000700 1 -- 172.21.15.70:0/3845623085 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe403b070 con 0x559ab9e44520 2024-05-08T07:05:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.565+0000 7effe2000700 1 -- 172.21.15.70:0/3845623085 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effe4005620 con 0x559ab9e44520 2024-05-08T07:05:27.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.565+0000 7effe2000700 1 -- 172.21.15.70:0/3845623085 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe403b070 con 0x559ab9e44520 2024-05-08T07:05:27.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.566+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3845623085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 msgr2=0x559ab9e5aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:27.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.566+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e5aaa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7effe4009f60 tx=0x7effe4001e70 comp rx=0 tx=0).stop 2024-05-08T07:05:27.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.567+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3845623085 shutdown_connections 2024-05-08T07:05:27.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.567+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e49f50 0x559ab9e5a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.567+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e44520 0x559ab9e5aaa0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.567+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/3845623085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e4cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.567+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3845623085 >> 172.21.15.70:0/3845623085 conn(0x559ab9d72cf0 msgr2=0x559ab9e43510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:05:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.567+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3845623085 shutdown_connections 2024-05-08T07:05:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.567+0000 7f0006ba7b80 1 -- 172.21.15.70:0/3845623085 wait complete. 2024-05-08T07:05:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.568+0000 7f0006ba7b80 1 -- start start 2024-05-08T07:05:27.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.568+0000 7f0006ba7b80 1 Processor -- start 2024-05-08T07:05:27.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44520 0x559ab9e65a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e65f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7f0006ba7b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e54e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b42b0 con 0x559ab9e49f50 2024-05-08T07:05:27.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b5720 con 0x559ab9e44520 2024-05-08T07:05:27.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7f0006ba7b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efff41b4980 con 0x559ab9e44ee0 2024-05-08T07:05:27.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7f0006ba7b80 10 client.0 _ll_register_callbacks cb 0x559ab9d3de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:05:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7efff8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e54e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7efff8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e54e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49732/0 (socket says 172.21.15.70:49732) 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.570+0000 7efff8e00700 1 -- 172.21.15.70:0/2713289775 learned_addr learned my addr 172.21.15.70:0/2713289775 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.571+0000 7efff9800700 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e65f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.571+0000 7efff8e00700 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44520 0x559ab9e65a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.571+0000 7efff8e00700 1 -- 172.21.15.70:0/2713289775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 msgr2=0x559ab9e65f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.571+0000 7efff8e00700 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e65f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.571+0000 7efff8e00700 1 -- 172.21.15.70:0/2713289775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44520 msgr2=0x559ab9e65a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.571+0000 7efff8e00700 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44520 0x559ab9e65a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.571+0000 7efff8e00700 1 -- 172.21.15.70:0/2713289775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ab9e553b0 con 0x559ab9e49f50 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.571+0000 7efff8e00700 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e54e70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7effe4006010 tx=0x7effe400fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32f21a3a9d9ccdf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.571+0000 7effd7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.572+0000 7effd7400700 1 -- 172.21.15.70:0/2713289775 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe403b030 con 0x559ab9e49f50 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.572+0000 7effd7400700 1 -- 172.21.15.70:0/2713289775 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9583+0+0 (secure 0 0 0) 0x7effe4005190 con 0x559ab9e49f50 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.572+0000 7f0006ba7b80 1 -- 172.21.15.70:0/2713289775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe4005620 con 0x559ab9e49f50 2024-05-08T07:05:27.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.572+0000 7effd7400700 1 -- 172.21.15.70:0/2713289775 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7effe402a040 con 0x559ab9e49f50 2024-05-08T07:05:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.572+0000 7f0006ba7b80 10 client.16008 fetch_fsmap learned FSMap version 28 2024-05-08T07:05:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.572+0000 7f0006ba7b80 1 -- 172.21.15.70:0/2713289775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559ab9ec9140 con 0x559ab9e49f50 2024-05-08T07:05:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.573+0000 7effd7400700 1 -- 172.21.15.70:0/2713289775 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effe4005620 con 0x559ab9e49f50 2024-05-08T07:05:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.573+0000 7effd7400700 1 -- 172.21.15.70:0/2713289775 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7effe40257d0 con 0x559ab9e49f50 2024-05-08T07:05:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.573+0000 7f0006ba7b80 10 client.16008 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:05:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.573+0000 7f0006ba7b80 10 client.16008 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:05:27.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.573+0000 7f0006ba7b80 20 client.16008 populate_metadata read hostname 'smithi070' 2024-05-08T07:05:27.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.573+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559ab9ec96a0 0x559ab9ecbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:05:27.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.573+0000 7f0006ba7b80 4 client.16008 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 77.5, "await_for": 42.0}] 2024-05-08T07:05:27.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.573+0000 7f0006ba7b80 1 -- 172.21.15.70:0/2713289775 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 77.5, "await_for": 42.0}) -- 0x559ab9da4590 con 0x559ab9ec96a0 2024-05-08T07:05:27.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.574+0000 7efff9800700 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559ab9ec96a0 0x559ab9ecbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:05:27.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.575+0000 7effd7400700 10 client.16008 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:05:27.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:27.575+0000 7efff9800700 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559ab9ec96a0 0x559ab9ecbac0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2291616562dd7cf3 server_cookie=728b551b68d56a30 in_seq=0 out_seq=0 2024-05-08T07:05:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:28 smithi070 ceph-mon[29591]: pgmap v594: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 1.2 MiB/s wr, 95 op/s 2024-05-08T07:05:28.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:28 smithi172 ceph-mon[33377]: pgmap v594: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 1.2 MiB/s wr, 95 op/s 2024-05-08T07:05:28.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:28 smithi194 ceph-mon[33679]: pgmap v594: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 1.2 MiB/s wr, 95 op/s 2024-05-08T07:05:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:30 smithi070 ceph-mon[29591]: pgmap v595: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-05-08T07:05:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:30 smithi172 ceph-mon[33377]: pgmap v595: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-05-08T07:05:30.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:30 smithi194 ceph-mon[33679]: pgmap v595: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 517 KiB/s rd, 1.6 MiB/s wr, 137 op/s 2024-05-08T07:05:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:32 smithi070 ceph-mon[29591]: pgmap v596: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.2 MiB/s wr, 98 op/s 2024-05-08T07:05:32.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:32 smithi172 ceph-mon[33377]: pgmap v596: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.2 MiB/s wr, 98 op/s 2024-05-08T07:05:32.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:32 smithi194 ceph-mon[33679]: pgmap v596: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.2 MiB/s wr, 98 op/s 2024-05-08T07:05:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:34 smithi070 ceph-mon[29591]: pgmap v597: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.2 MiB/s wr, 98 op/s 2024-05-08T07:05:34.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:34 smithi172 ceph-mon[33377]: pgmap v597: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.2 MiB/s wr, 98 op/s 2024-05-08T07:05:34.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:34 smithi194 ceph-mon[33679]: pgmap v597: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 1.2 MiB/s wr, 98 op/s 2024-05-08T07:05:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:36 smithi070 ceph-mon[29591]: pgmap v598: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.4 MiB/s wr, 103 op/s 2024-05-08T07:05:36.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:36 smithi172 ceph-mon[33377]: pgmap v598: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.4 MiB/s wr, 103 op/s 2024-05-08T07:05:36.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:36 smithi194 ceph-mon[33679]: pgmap v598: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.4 MiB/s wr, 103 op/s 2024-05-08T07:05:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:38 smithi070 ceph-mon[29591]: pgmap v599: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 594 KiB/s wr, 47 op/s 2024-05-08T07:05:38.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:38 smithi172 ceph-mon[33377]: pgmap v599: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 594 KiB/s wr, 47 op/s 2024-05-08T07:05:38.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:38 smithi194 ceph-mon[33679]: pgmap v599: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 594 KiB/s wr, 47 op/s 2024-05-08T07:05:40.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.018+0000 7effd7400700 1 -- 172.21.15.70:0/2713289775 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x559ab9da4590 con 0x559ab9ec96a0 2024-05-08T07:05:40.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.018+0000 7effd7400700 10 client.16008 handle_command_reply: tid=0 2024-05-08T07:05:40.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.018+0000 7f0006ba7b80 1 client.16008 shutdown 2024-05-08T07:05:40.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.019+0000 7f0006ba7b80 1 -- 172.21.15.70:0/2713289775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 msgr2=0x559ab9e54e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:40.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.019+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e54e70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7effe4006010 tx=0x7effe400fe80 comp rx=0 tx=0).stop 2024-05-08T07:05:40.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.019+0000 7f0006ba7b80 1 -- 172.21.15.70:0/2713289775 shutdown_connections 2024-05-08T07:05:40.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.019+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559ab9ec96a0 0x559ab9ecbac0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:40.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.019+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559ab9e49f50 0x559ab9e54e70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:40.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.019+0000 7effd7400700 0 client.16008 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:05:40.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.019+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559ab9e44520 0x559ab9e65a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:40.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.019+0000 7f0006ba7b80 1 --2- 172.21.15.70:0/2713289775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559ab9e44ee0 0x559ab9e65f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:40.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.019+0000 7f0006ba7b80 1 -- 172.21.15.70:0/2713289775 >> 172.21.15.70:0/2713289775 conn(0x559ab9d72cf0 msgr2=0x559ab9e43da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:05:40.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.020+0000 7f0006ba7b80 1 -- 172.21.15.70:0/2713289775 shutdown_connections 2024-05-08T07:05:40.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.020+0000 7f0006ba7b80 1 -- 172.21.15.70:0/2713289775 wait complete. 2024-05-08T07:05:40.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.020+0000 7f0006ba7b80 20 client.16008 trim_cache size 0 max 16384 2024-05-08T07:05:40.020 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:05:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:05:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:05:40.020 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 50, 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "1d10fa33": { 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 50, 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 77.5, 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:05:40.021 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:05:40.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 -- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effdc0b2ba0 msgr2=0x7effdc0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effdc0b2ba0 0x7effdc0b5060 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7effec004fd0 tx=0x7effec00a360 comp rx=0 tx=0).stop 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 -- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff410ff00 msgr2=0x7efff410cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff410ff00 0x7efff410cea0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7effec00ada0 tx=0x7effec00c330 comp rx=0 tx=0).stop 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 -- 172.21.15.70:0/2271920716 shutdown_connections 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effdc0b2ba0 0x7effdc0b5060 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efff410ff00 0x7efff410cea0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efff40756d0 0x7efff410f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 --2- 172.21.15.70:0/2271920716 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efff4075ff0 0x7efff410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 -- 172.21.15.70:0/2271920716 >> 172.21.15.70:0/2271920716 conn(0x7efff407a570 msgr2=0x7efff4100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 -- 172.21.15.70:0/2271920716 shutdown_connections 2024-05-08T07:05:40.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:05:40.021+0000 7efffc200700 1 -- 172.21.15.70:0/2271920716 wait complete. 2024-05-08T07:05:40.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:40 smithi070 ceph-mon[29591]: pgmap v600: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 717 KiB/s wr, 53 op/s 2024-05-08T07:05:40.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:40 smithi172 ceph-mon[33377]: pgmap v600: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 717 KiB/s wr, 53 op/s 2024-05-08T07:05:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:40 smithi194 ceph-mon[33679]: pgmap v600: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 717 KiB/s wr, 53 op/s 2024-05-08T07:05:41.177 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1d10fa33', quiesce took 21.6 seconds. Will release after: 17.5 2024-05-08T07:05:41.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:41 smithi172 ceph-mon[33377]: pgmap v601: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 299 KiB/s wr, 11 op/s 2024-05-08T07:05:41.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:41 smithi194 ceph-mon[33679]: pgmap v601: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 299 KiB/s wr, 11 op/s 2024-05-08T07:05:41.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:41 smithi070 ceph-mon[29591]: pgmap v601: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 299 KiB/s wr, 11 op/s 2024-05-08T07:05:44.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:44 smithi070 ceph-mon[29591]: pgmap v602: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 299 KiB/s wr, 11 op/s 2024-05-08T07:05:44.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:44 smithi172 ceph-mon[33377]: pgmap v602: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 299 KiB/s wr, 11 op/s 2024-05-08T07:05:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:44 smithi194 ceph-mon[33679]: pgmap v602: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 299 KiB/s wr, 11 op/s 2024-05-08T07:05:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:46 smithi070 ceph-mon[29591]: pgmap v603: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 307 KiB/s wr, 14 op/s 2024-05-08T07:05:46.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:46 smithi172 ceph-mon[33377]: pgmap v603: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 307 KiB/s wr, 14 op/s 2024-05-08T07:05:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:46 smithi194 ceph-mon[33679]: pgmap v603: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 307 KiB/s wr, 14 op/s 2024-05-08T07:05:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:48 smithi070 ceph-mon[29591]: pgmap v604: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-08T07:05:48.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:48 smithi172 ceph-mon[33377]: pgmap v604: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-08T07:05:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:48 smithi194 ceph-mon[33679]: pgmap v604: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-08T07:05:50.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:50 smithi070 ceph-mon[29591]: pgmap v605: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 139 KiB/s wr, 12 op/s 2024-05-08T07:05:50.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:50 smithi172 ceph-mon[33377]: pgmap v605: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 139 KiB/s wr, 12 op/s 2024-05-08T07:05:50.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:50 smithi194 ceph-mon[33679]: pgmap v605: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 139 KiB/s wr, 12 op/s 2024-05-08T07:05:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:52 smithi070 ceph-mon[29591]: pgmap v606: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T07:05:52.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:52 smithi172 ceph-mon[33377]: pgmap v606: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T07:05:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:52 smithi194 ceph-mon[33679]: pgmap v606: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T07:05:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:54 smithi070 ceph-mon[29591]: pgmap v607: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T07:05:54.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:54 smithi172 ceph-mon[33377]: pgmap v607: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T07:05:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:54 smithi194 ceph-mon[33679]: pgmap v607: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T07:05:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:56 smithi070 ceph-mon[29591]: pgmap v608: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-05-08T07:05:56.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:56 smithi172 ceph-mon[33377]: pgmap v608: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-05-08T07:05:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:56 smithi194 ceph-mon[33679]: pgmap v608: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-05-08T07:05:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:05:57 smithi172 ceph-mon[33377]: pgmap v609: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 6 op/s 2024-05-08T07:05:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:05:57 smithi194 ceph-mon[33679]: pgmap v609: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 6 op/s 2024-05-08T07:05:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:05:57 smithi070 ceph-mon[29591]: pgmap v609: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 6 op/s 2024-05-08T07:05:58.678 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:05:59.123 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:06:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:00 smithi070 ceph-mon[29591]: pgmap v610: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-05-08T07:06:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:00 smithi172 ceph-mon[33377]: pgmap v610: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-05-08T07:06:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:00 smithi194 ceph-mon[33679]: pgmap v610: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 8 op/s 2024-05-08T07:06:01.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.761+0000 7f6580400700 1 -- 172.21.15.70:0/175246209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f657810fea0 msgr2=0x7f6578112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:01.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.761+0000 7f6580400700 1 --2- 172.21.15.70:0/175246209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f657810fea0 0x7f6578112290 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f657000b0a0 tx=0x7f657000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:06:01.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.761+0000 7f6580400700 1 -- 172.21.15.70:0/175246209 shutdown_connections 2024-05-08T07:06:01.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.761+0000 7f6580400700 1 --2- 172.21.15.70:0/175246209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f657810fea0 0x7f6578112290 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:01.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.761+0000 7f6580400700 1 --2- 172.21.15.70:0/175246209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65780756d0 0x7f6578075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:01.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.761+0000 7f6580400700 1 --2- 172.21.15.70:0/175246209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6578075ff0 0x7f657810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:01.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.761+0000 7f6580400700 1 -- 172.21.15.70:0/175246209 >> 172.21.15.70:0/175246209 conn(0x7f657807a600 msgr2=0x7f657807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:01.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.761+0000 7f6580400700 1 -- 172.21.15.70:0/175246209 shutdown_connections 2024-05-08T07:06:01.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.761+0000 7f6580400700 1 -- 172.21.15.70:0/175246209 wait complete. 2024-05-08T07:06:01.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.762+0000 7f6580400700 1 Processor -- start 2024-05-08T07:06:01.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f6580400700 1 -- start start 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f6580400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65780756d0 0x7f65781a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f6580400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6578075ff0 0x7f65781a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f6580400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657810fea0 0x7f657819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f6580400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6578115740 con 0x7f65780756d0 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f6580400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65781155c0 con 0x7f657810fea0 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f6580400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65781158c0 con 0x7f6578075ff0 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f657da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65780756d0 0x7f65781a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f657da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65780756d0 0x7f65781a1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39110/0 (socket says 172.21.15.70:39110) 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.763+0000 7f657da00700 1 -- 172.21.15.70:0/890035840 learned_addr learned my addr 172.21.15.70:0/890035840 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.764+0000 7f657d000700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6578075ff0 0x7f65781a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:01.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.764+0000 7f657e400700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657810fea0 0x7f657819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:01.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.764+0000 7f657da00700 1 -- 172.21.15.70:0/890035840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6578075ff0 msgr2=0x7f65781a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:01.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.764+0000 7f657da00700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6578075ff0 0x7f65781a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:01.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.764+0000 7f657da00700 1 -- 172.21.15.70:0/890035840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657810fea0 msgr2=0x7f657819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:01.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.764+0000 7f657da00700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657810fea0 0x7f657819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:01.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.764+0000 7f657da00700 1 -- 172.21.15.70:0/890035840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657819c140 con 0x7f65780756d0 2024-05-08T07:06:01.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.764+0000 7f657da00700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65780756d0 0x7f65781a1820 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f656c00c9b0 tx=0x7f656c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:01.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.765+0000 7f6576000700 1 -- 172.21.15.70:0/890035840 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c007b00 con 0x7f65780756d0 2024-05-08T07:06:01.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.765+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657819c430 con 0x7f65780756d0 2024-05-08T07:06:01.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.765+0000 7f6576000700 1 -- 172.21.15.70:0/890035840 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f656c007ca0 con 0x7f65780756d0 2024-05-08T07:06:01.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.765+0000 7f6576000700 1 -- 172.21.15.70:0/890035840 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c018660 con 0x7f65780756d0 2024-05-08T07:06:01.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.765+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65781a86f0 con 0x7f65780756d0 2024-05-08T07:06:01.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.766+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f657806a190 con 0x7f65780756d0 2024-05-08T07:06:01.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.770+0000 7f6576000700 1 -- 172.21.15.70:0/890035840 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f656c00f450 con 0x7f65780756d0 2024-05-08T07:06:01.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.772+0000 7f6576000700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65600b2a70 0x7f65600b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:01.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.772+0000 7f6576000700 1 -- 172.21.15.70:0/890035840 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9583+0+0 (secure 0 0 0) 0x7f656c0e2d70 con 0x7f65780756d0 2024-05-08T07:06:01.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.772+0000 7f657d000700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65600b2a70 0x7f65600b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:01.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.773+0000 7f657d000700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65600b2a70 0x7f65600b4f30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6564005fd0 tx=0x7f6564005dd0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:01.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:01.773+0000 7f6576000700 1 -- 172.21.15.70:0/890035840 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f656c014030 con 0x7f65780756d0 2024-05-08T07:06:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.056+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f657802e510 con 0x7f65780756d0 2024-05-08T07:06:02.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.057+0000 7f6576000700 1 -- 172.21.15.70:0/890035840 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f656c0aa3e0 con 0x7f65780756d0 2024-05-08T07:06:02.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:06:02.056 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:06:02.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65600b2a70 msgr2=0x7f65600b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:02.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65600b2a70 0x7f65600b4f30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6564005fd0 tx=0x7f6564005dd0 comp rx=0 tx=0).stop 2024-05-08T07:06:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65780756d0 msgr2=0x7f65781a1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65780756d0 0x7f65781a1820 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f656c00c9b0 tx=0x7f656c00cd70 comp rx=0 tx=0).stop 2024-05-08T07:06:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 shutdown_connections 2024-05-08T07:06:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65600b2a70 0x7f65600b4f30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f657810fea0 0x7f657819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65780756d0 0x7f65781a1820 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 --2- 172.21.15.70:0/890035840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6578075ff0 0x7f65781a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 >> 172.21.15.70:0/890035840 conn(0x7f657807a600 msgr2=0x7f6578100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.061+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 shutdown_connections 2024-05-08T07:06:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:02.062+0000 7f6580400700 1 -- 172.21.15.70:0/890035840 wait complete. 2024-05-08T07:06:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:06:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:02 smithi070 ceph-mon[29591]: pgmap v611: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:06:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:02 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/890035840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:06:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:02 smithi172 ceph-mon[33377]: pgmap v611: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:06:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:02 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/890035840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:06:02.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:02 smithi194 ceph-mon[33679]: pgmap v611: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:06:02.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:02 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/890035840' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:06:02.977 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 1d10fa33 --release --await' 2024-05-08T07:06:02.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 1d10fa33 --release --await 2024-05-08T07:06:03.420 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:06:04.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:04 smithi070 ceph-mon[29591]: pgmap v612: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:06:04.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:04 smithi172 ceph-mon[33377]: pgmap v612: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:06:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:04 smithi194 ceph-mon[33679]: pgmap v612: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:06:05.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.823+0000 7fec6f000700 1 -- 172.21.15.70:0/3911471004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6810ff50 msgr2=0x7fec68112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.823+0000 7fec6f000700 1 --2- 172.21.15.70:0/3911471004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6810ff50 0x7fec68112340 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fec6000b0a0 tx=0x7fec6000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.823+0000 7fec6f000700 1 -- 172.21.15.70:0/3911471004 shutdown_connections 2024-05-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.823+0000 7fec6f000700 1 --2- 172.21.15.70:0/3911471004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6810ff50 0x7fec68112340 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.823+0000 7fec6f000700 1 --2- 172.21.15.70:0/3911471004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec6806b1b0 0x7fec6806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.823+0000 7fec6f000700 1 --2- 172.21.15.70:0/3911471004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6806bad0 0x7fec6810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.823+0000 7fec6f000700 1 -- 172.21.15.70:0/3911471004 >> 172.21.15.70:0/3911471004 conn(0x7fec68079350 msgr2=0x7fec68079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.823+0000 7fec6f000700 1 -- 172.21.15.70:0/3911471004 shutdown_connections 2024-05-08T07:06:05.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.823+0000 7fec6f000700 1 -- 172.21.15.70:0/3911471004 wait complete. 2024-05-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.824+0000 7fec6f000700 1 Processor -- start 2024-05-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.824+0000 7fec6f000700 1 -- start start 2024-05-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec6f000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec6806b1b0 0x7fec681a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec6f000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6806bad0 0x7fec681a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec6f000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6810ff50 0x7fec6819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec6f000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec68115720 con 0x7fec6806bad0 2024-05-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec6f000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec681155a0 con 0x7fec6810ff50 2024-05-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec6f000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fec681158a0 con 0x7fec6806b1b0 2024-05-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec5f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6806bad0 0x7fec681a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec5f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6806bad0 0x7fec681a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39132/0 (socket says 172.21.15.70:39132) 2024-05-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec5f400700 1 -- 172.21.15.70:0/3603256116 learned_addr learned my addr 172.21.15.70:0/3603256116 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.825+0000 7fec67e00700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec6806b1b0 0x7fec681a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec6d000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6810ff50 0x7fec6819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec5f400700 1 -- 172.21.15.70:0/3603256116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec6806b1b0 msgr2=0x7fec681a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec5f400700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec6806b1b0 0x7fec681a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec5f400700 1 -- 172.21.15.70:0/3603256116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6810ff50 msgr2=0x7fec6819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec5f400700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6810ff50 0x7fec6819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec5f400700 1 -- 172.21.15.70:0/3603256116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6819c1e0 con 0x7fec6806bad0 2024-05-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec6d000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6810ff50 0x7fec6819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec5f400700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6806bad0 0x7fec681a1e00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d950 tx=0x7fec5000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec65600700 1 -- 172.21.15.70:0/3603256116 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec50016070 con 0x7fec6806bad0 2024-05-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec65600700 1 -- 172.21.15.70:0/3603256116 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec50010460 con 0x7fec6806bad0 2024-05-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.826+0000 7fec65600700 1 -- 172.21.15.70:0/3603256116 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5000f620 con 0x7fec6806bad0 2024-05-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.827+0000 7fec6f000700 1 -- 172.21.15.70:0/3603256116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6819c470 con 0x7fec6806bad0 2024-05-08T07:06:05.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.827+0000 7fec6f000700 1 -- 172.21.15.70:0/3603256116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec681a8790 con 0x7fec6806bad0 2024-05-08T07:06:05.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.830+0000 7fec65600700 1 -- 172.21.15.70:0/3603256116 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fec50019070 con 0x7fec6806bad0 2024-05-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.831+0000 7fec79a1ab80 1 Processor -- start 2024-05-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.831+0000 7fec79a1ab80 1 -- start start 2024-05-08T07:06:05.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec65600700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec4c0b29f0 0x7fec4c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec65600700 1 -- 172.21.15.70:0/3603256116 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9583+0+0 (secure 0 0 0) 0x7fec500e2660 con 0x7fec6806bad0 2024-05-08T07:06:05.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e08910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e08e50 0x561d08e14c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561d08d5ab20 con 0x561d08e0dec0 2024-05-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561d08cf8860 con 0x561d08e08490 2024-05-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561d08d56ae0 con 0x561d08e08e50 2024-05-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec6d000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec4c0b29f0 0x7fec4c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec67e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec67e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39148/0 (socket says 172.21.15.70:39148) 2024-05-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.832+0000 7fec67e00700 1 -- 172.21.15.70:0/4009851356 learned_addr learned my addr 172.21.15.70:0/4009851356 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:05.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.833+0000 7fec5f400700 1 --2- 172.21.15.70:0/4009851356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e08910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.833+0000 7fec67e00700 1 -- 172.21.15.70:0/4009851356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e08e50 msgr2=0x561d08e14c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T07:06:05.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.833+0000 7fec67e00700 1 --2- 172.21.15.70:0/4009851356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e08e50 0x561d08e14c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.833+0000 7fec67e00700 1 -- 172.21.15.70:0/4009851356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 msgr2=0x561d08e08910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.833+0000 7fec67e00700 1 --2- 172.21.15.70:0/4009851356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e08910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.833+0000 7fec67e00700 1 -- 172.21.15.70:0/4009851356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d08ca79d0 con 0x561d08e0dec0 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.833+0000 7fec6d000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec4c0b29f0 0x7fec4c0b4eb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec6000b070 tx=0x7fec6000b7b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.833+0000 7fec67e00700 1 --2- 172.21.15.70:0/4009851356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0e2a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fec5800bd00 tx=0x7fec5800f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61854a9ee5b85997 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.833+0000 7fec5d600700 1 -- 172.21.15.70:0/4009851356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58015070 con 0x561d08e0dec0 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.834+0000 7fec5d600700 1 -- 172.21.15.70:0/4009851356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec5800be50 con 0x561d08e0dec0 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.834+0000 7fec5d600700 1 -- 172.21.15.70:0/4009851356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec580116a0 con 0x561d08e0dec0 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.834+0000 7fec79a1ab80 1 -- 172.21.15.70:0/4009851356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 msgr2=0x561d08e0e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:05.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.834+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/4009851356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0e2a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fec5800bd00 tx=0x7fec5800f640 comp rx=0 tx=0).stop 2024-05-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.835+0000 7fec79a1ab80 1 -- 172.21.15.70:0/4009851356 shutdown_connections 2024-05-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.835+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/4009851356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e08e50 0x561d08e14c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.835+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/4009851356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0e2a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.835+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/4009851356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e08910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.835+0000 7fec79a1ab80 1 -- 172.21.15.70:0/4009851356 >> 172.21.15.70:0/4009851356 conn(0x561d08d36c60 msgr2=0x561d08e02d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.835+0000 7fec79a1ab80 1 -- 172.21.15.70:0/4009851356 shutdown_connections 2024-05-08T07:06:05.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.835+0000 7fec79a1ab80 1 -- 172.21.15.70:0/4009851356 wait complete. 2024-05-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.835+0000 7fec79a1ab80 1 -- start start 2024-05-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.836+0000 7fec79a1ab80 1 Processor -- start 2024-05-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.836+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08490 0x561d08e14930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.836+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08e50 0x561d08e11cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.836+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 0x561d08e12210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.836+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561d08e15280 con 0x561d08e08490 2024-05-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.836+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561d08cc0c20 con 0x561d08e08e50 2024-05-08T07:06:05.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.836+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561d08e15400 con 0x561d08e0dec0 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.836+0000 7fec79a1ab80 10 client.0 _ll_register_callbacks cb 0x561d08d01d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.836+0000 7fec67e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08490 0x561d08e14930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec67e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08490 0x561d08e14930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39160/0 (socket says 172.21.15.70:39160) 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec67e00700 1 -- 172.21.15.70:0/1631504121 learned_addr learned my addr 172.21.15.70:0/1631504121 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec6d000700 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 0x561d08e12210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec67e00700 1 -- 172.21.15.70:0/1631504121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 msgr2=0x561d08e12210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec67e00700 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 0x561d08e12210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec5f400700 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08e50 0x561d08e11cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec67e00700 1 -- 172.21.15.70:0/1631504121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08e50 msgr2=0x561d08e11cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec67e00700 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08e50 0x561d08e11cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec67e00700 1 -- 172.21.15.70:0/1631504121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d08d20520 con 0x561d08e08490 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec67e00700 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08490 0x561d08e14930 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fec5800fe90 tx=0x7fec5800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cfc90763f05e9f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:05.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.837+0000 7fec56000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.838+0000 7fec56000700 1 -- 172.21.15.70:0/1631504121 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec58028060 con 0x561d08e08490 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.838+0000 7fec56000700 1 -- 172.21.15.70:0/1631504121 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9583+0+0 (secure 0 0 0) 0x7fec5801a860 con 0x561d08e08490 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.838+0000 7fec79a1ab80 1 -- 172.21.15.70:0/1631504121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec5800be50 con 0x561d08e08490 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.838+0000 7fec56000700 1 -- 172.21.15.70:0/1631504121 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec5802f050 con 0x561d08e08490 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.838+0000 7fec79a1ab80 10 client.16026 fetch_fsmap learned FSMap version 28 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.838+0000 7fec79a1ab80 1 -- 172.21.15.70:0/1631504121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561d08e1fb30 con 0x561d08e08490 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.838+0000 7fec56000700 1 -- 172.21.15.70:0/1631504121 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec5800be50 con 0x561d08e08490 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.838+0000 7fec56000700 1 -- 172.21.15.70:0/1631504121 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fec580049e0 con 0x561d08e08490 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.839+0000 7fec79a1ab80 10 client.16026 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.839+0000 7fec79a1ab80 10 client.16026 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.839+0000 7fec79a1ab80 20 client.16026 populate_metadata read hostname 'smithi070' 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.839+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561d08e22110 0x561d08e24500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.839+0000 7fec79a1ab80 4 client.16026 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:06:05.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.839+0000 7fec79a1ab80 1 -- 172.21.15.70:0/1631504121 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d08dd51a0 con 0x561d08e22110 2024-05-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.839+0000 7fec5f400700 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561d08e22110 0x561d08e24500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.840+0000 7fec5f400700 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561d08e22110 0x561d08e24500 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1041aa0c4d2d84e server_cookie=45e2e01f4c498b6 in_seq=0 out_seq=0 2024-05-08T07:06:05.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.840+0000 7fec56000700 10 client.16026 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.842+0000 7fec56000700 1 -- 172.21.15.70:0/1631504121 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561d08dd51a0 con 0x561d08e22110 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.842+0000 7fec56000700 10 client.16026 handle_command_reply: tid=0 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.842+0000 7fec79a1ab80 1 client.16026 shutdown 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 -- 172.21.15.70:0/1631504121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08490 msgr2=0x561d08e14930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08490 0x561d08e14930 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fec5800fe90 tx=0x7fec5800ff70 comp rx=0 tx=0).stop 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 -- 172.21.15.70:0/1631504121 shutdown_connections 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561d08e22110 0x561d08e24500 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 0x561d08e12210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08490 0x561d08e14930 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/1631504121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08e50 0x561d08e11cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 -- 172.21.15.70:0/1631504121 >> 172.21.15.70:0/1631504121 conn(0x561d08d36c60 msgr2=0x561d08dfd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec56000700 0 client.16026 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 -- 172.21.15.70:0/1631504121 shutdown_connections 2024-05-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 1 -- 172.21.15.70:0/1631504121 wait complete. 2024-05-08T07:06:05.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.843+0000 7fec79a1ab80 20 client.16026 trim_cache size 0 max 16384 2024-05-08T07:06:05.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec79a1ab80 1 Processor -- start 2024-05-08T07:06:05.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec79a1ab80 1 -- start start 2024-05-08T07:06:05.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e10c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e08e50 0x561d08e0d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec681b4070 con 0x561d08e0dec0 2024-05-08T07:06:05.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec681b1900 con 0x561d08e08490 2024-05-08T07:06:05.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fec681af770 con 0x561d08e08e50 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec6d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec6d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39168/0 (socket says 172.21.15.70:39168) 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.865+0000 7fec6d000700 1 -- 172.21.15.70:0/94633357 learned_addr learned my addr 172.21.15.70:0/94633357 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.866+0000 7fec67e00700 1 --2- 172.21.15.70:0/94633357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e10c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.866+0000 7fec5f400700 1 --2- 172.21.15.70:0/94633357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e08e50 0x561d08e0d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.866+0000 7fec6d000700 1 -- 172.21.15.70:0/94633357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e08e50 msgr2=0x561d08e0d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.866+0000 7fec6d000700 1 --2- 172.21.15.70:0/94633357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e08e50 0x561d08e0d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.866+0000 7fec6d000700 1 -- 172.21.15.70:0/94633357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 msgr2=0x561d08e10c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.866+0000 7fec6d000700 1 --2- 172.21.15.70:0/94633357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e10c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.866+0000 7fec6d000700 1 -- 172.21.15.70:0/94633357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d08e03950 con 0x561d08e0dec0 2024-05-08T07:06:05.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.867+0000 7fec6d000700 1 --2- 172.21.15.70:0/94633357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0b940 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fec60015000 tx=0x7fec6001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b824ee6620ae2735 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:05.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.867+0000 7fec5cc00700 1 -- 172.21.15.70:0/94633357 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6002c030 con 0x561d08e0dec0 2024-05-08T07:06:05.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.867+0000 7fec5cc00700 1 -- 172.21.15.70:0/94633357 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec60022040 con 0x561d08e0dec0 2024-05-08T07:06:05.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.867+0000 7fec5cc00700 1 -- 172.21.15.70:0/94633357 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6001b7a0 con 0x561d08e0dec0 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 -- 172.21.15.70:0/94633357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 msgr2=0x561d08e0b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/94633357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0b940 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fec60015000 tx=0x7fec6001b000 comp rx=0 tx=0).stop 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 -- 172.21.15.70:0/94633357 shutdown_connections 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/94633357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e0dec0 0x561d08e0b940 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/94633357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e10c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/94633357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e08e50 0x561d08e0d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 -- 172.21.15.70:0/94633357 >> 172.21.15.70:0/94633357 conn(0x561d08d36c60 msgr2=0x561d08e07d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 -- 172.21.15.70:0/94633357 shutdown_connections 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 -- 172.21.15.70:0/94633357 wait complete. 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 -- start start 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.868+0000 7fec79a1ab80 1 Processor -- start 2024-05-08T07:06:05.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e25060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08e50 0x561d08e255a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec79a1ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 0x561d08e8b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec681afdc0 con 0x561d08e08e50 2024-05-08T07:06:05.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec681b1230 con 0x561d08e08490 2024-05-08T07:06:05.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec79a1ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fec681b0490 con 0x561d08e0dec0 2024-05-08T07:06:05.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec79a1ab80 10 client.0 _ll_register_callbacks cb 0x561d08d01d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec5f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08e50 0x561d08e255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec5f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08e50 0x561d08e255a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39176/0 (socket says 172.21.15.70:39176) 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.869+0000 7fec5f400700 1 -- 172.21.15.70:0/823588788 learned_addr learned my addr 172.21.15.70:0/823588788 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec6d000700 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 0x561d08e8b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec67e00700 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e25060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec5f400700 1 -- 172.21.15.70:0/823588788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 msgr2=0x561d08e8b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec5f400700 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 0x561d08e8b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec5f400700 1 -- 172.21.15.70:0/823588788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 msgr2=0x561d08e25060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec5f400700 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e25060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec5f400700 1 -- 172.21.15.70:0/823588788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d08e0e610 con 0x561d08e08e50 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec5f400700 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08e50 0x561d08e255a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fec5000b2f0 tx=0x7fec500a9290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5553d5a492244 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec56000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec56000700 1 -- 172.21.15.70:0/823588788 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec500c2070 con 0x561d08e08e50 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec56000700 1 -- 172.21.15.70:0/823588788 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9583+0+0 (secure 0 0 0) 0x7fec500a3be0 con 0x561d08e08e50 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.870+0000 7fec79a1ab80 1 -- 172.21.15.70:0/823588788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec60022040 con 0x561d08e08e50 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec56000700 1 -- 172.21.15.70:0/823588788 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fec50020040 con 0x561d08e08e50 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec79a1ab80 10 client.16032 fetch_fsmap learned FSMap version 28 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec79a1ab80 1 -- 172.21.15.70:0/823588788 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x561d08e15380 con 0x561d08e08e50 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec56000700 1 -- 172.21.15.70:0/823588788 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec60022040 con 0x561d08e08e50 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec56000700 1 -- 172.21.15.70:0/823588788 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fec500ca300 con 0x561d08e08e50 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec79a1ab80 10 client.16032 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec79a1ab80 10 client.16032 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec79a1ab80 20 client.16032 populate_metadata read hostname 'smithi070' 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561d08e8d120 0x561d08e8f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:05.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec79a1ab80 4 client.16032 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1d10fa33", "release": true, "await": true}] 2024-05-08T07:06:05.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.871+0000 7fec79a1ab80 1 -- 172.21.15.70:0/823588788 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1d10fa33", "release": true, "await": true}) -- 0x561d08d68500 con 0x561d08e8d120 2024-05-08T07:06:05.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.872+0000 7fec67e00700 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561d08e8d120 0x561d08e8f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:05.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.873+0000 7fec67e00700 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561d08e8d120 0x561d08e8f540 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f962e50031c94597 server_cookie=51d51529b16db508 in_seq=0 out_seq=0 2024-05-08T07:06:05.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:05.873+0000 7fec56000700 10 client.16032 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:06:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:06 smithi070 ceph-mon[29591]: pgmap v613: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 52 KiB/s wr, 24 op/s 2024-05-08T07:06:06.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:06 smithi172 ceph-mon[33377]: pgmap v613: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 52 KiB/s wr, 24 op/s 2024-05-08T07:06:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:06 smithi194 ceph-mon[33679]: pgmap v613: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 52 KiB/s wr, 24 op/s 2024-05-08T07:06:07.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.992+0000 7fec56000700 1 -- 172.21.15.70:0/823588788 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x561d08d68500 con 0x561d08e8d120 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.992+0000 7fec56000700 10 client.16032 handle_command_reply: tid=0 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.993+0000 7fec79a1ab80 1 client.16032 shutdown 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.994+0000 7fec79a1ab80 1 -- 172.21.15.70:0/823588788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08e50 msgr2=0x561d08e255a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.994+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08e50 0x561d08e255a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fec5000b2f0 tx=0x7fec500a9290 comp rx=0 tx=0).stop 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.994+0000 7fec79a1ab80 1 -- 172.21.15.70:0/823588788 shutdown_connections 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.994+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561d08e8d120 0x561d08e8f540 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.994+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561d08e0dec0 0x561d08e8b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.994+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561d08e08490 0x561d08e25060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.994+0000 7fec79a1ab80 1 --2- 172.21.15.70:0/823588788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561d08e08e50 0x561d08e255a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:07.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.994+0000 7fec79a1ab80 1 -- 172.21.15.70:0/823588788 >> 172.21.15.70:0/823588788 conn(0x561d08d36c60 msgr2=0x561d08dfd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:07.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.995+0000 7fec56000700 0 client.16032 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:06:07.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.995+0000 7fec79a1ab80 1 -- 172.21.15.70:0/823588788 shutdown_connections 2024-05-08T07:06:07.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.996+0000 7fec79a1ab80 1 -- 172.21.15.70:0/823588788 wait complete. 2024-05-08T07:06:07.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.996+0000 7fec79a1ab80 20 client.16032 trim_cache size 0 max 16384 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 52, 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "1d10fa33": { 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 52, 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:06:07.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 77.5, 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:06:07.998 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:06:07.999 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.998+0000 7fec6f000700 1 -- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec4c0b29f0 msgr2=0x7fec4c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.998+0000 7fec6f000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec4c0b29f0 0x7fec4c0b4eb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec6000b070 tx=0x7fec6000b7b0 comp rx=0 tx=0).stop 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.998+0000 7fec6f000700 1 -- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6806bad0 msgr2=0x7fec681a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.998+0000 7fec6f000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6806bad0 0x7fec681a1e00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fec5000d950 tx=0x7fec5000dd10 comp rx=0 tx=0).stop 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.999+0000 7fec6f000700 1 -- 172.21.15.70:0/3603256116 shutdown_connections 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.999+0000 7fec6f000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec4c0b29f0 0x7fec4c0b4eb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.999+0000 7fec6f000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec6810ff50 0x7fec6819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.999+0000 7fec6f000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec6806b1b0 0x7fec681a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.999+0000 7fec6f000700 1 --2- 172.21.15.70:0/3603256116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec6806bad0 0x7fec681a1e00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:07.999+0000 7fec6f000700 1 -- 172.21.15.70:0/3603256116 >> 172.21.15.70:0/3603256116 conn(0x7fec68079350 msgr2=0x7fec68111500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:08.000+0000 7fec6f000700 1 -- 172.21.15.70:0/3603256116 shutdown_connections 2024-05-08T07:06:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:08.000+0000 7fec6f000700 1 -- 172.21.15.70:0/3603256116 wait complete. 2024-05-08T07:06:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:08 smithi070 ceph-mon[29591]: pgmap v614: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:06:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:08 smithi172 ceph-mon[33377]: pgmap v614: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:06:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:08 smithi194 ceph-mon[33679]: pgmap v614: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:06:08.928 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1d10fa33', seconds elapsed: 49.3 2024-05-08T07:06:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:10 smithi070 ceph-mon[29591]: pgmap v615: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 143 KiB/s wr, 32 op/s 2024-05-08T07:06:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:10 smithi172 ceph-mon[33377]: pgmap v615: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 143 KiB/s wr, 32 op/s 2024-05-08T07:06:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:10 smithi194 ceph-mon[33679]: pgmap v615: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 143 KiB/s wr, 32 op/s 2024-05-08T07:06:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:11 smithi070 ceph-mon[29591]: osdmap e118: 12 total, 12 up, 12 in 2024-05-08T07:06:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:11 smithi070 ceph-mon[29591]: pgmap v617: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 171 KiB/s wr, 36 op/s 2024-05-08T07:06:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:11 smithi172 ceph-mon[33377]: osdmap e118: 12 total, 12 up, 12 in 2024-05-08T07:06:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:11 smithi172 ceph-mon[33377]: pgmap v617: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 171 KiB/s wr, 36 op/s 2024-05-08T07:06:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:11 smithi194 ceph-mon[33679]: osdmap e118: 12 total, 12 up, 12 in 2024-05-08T07:06:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:11 smithi194 ceph-mon[33679]: pgmap v617: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 171 KiB/s wr, 36 op/s 2024-05-08T07:06:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:14 smithi070 ceph-mon[29591]: pgmap v618: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 171 KiB/s wr, 36 op/s 2024-05-08T07:06:14.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:14 smithi172 ceph-mon[33377]: pgmap v618: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 171 KiB/s wr, 36 op/s 2024-05-08T07:06:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:14 smithi194 ceph-mon[33679]: pgmap v618: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 171 KiB/s wr, 36 op/s 2024-05-08T07:06:16.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:16 smithi070 ceph-mon[29591]: pgmap v619: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 832 KiB/s wr, 71 op/s 2024-05-08T07:06:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:16 smithi172 ceph-mon[33377]: pgmap v619: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 832 KiB/s wr, 71 op/s 2024-05-08T07:06:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:16 smithi194 ceph-mon[33679]: pgmap v619: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 832 KiB/s wr, 71 op/s 2024-05-08T07:06:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:18 smithi070 ceph-mon[29591]: pgmap v620: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 832 KiB/s wr, 71 op/s 2024-05-08T07:06:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:18 smithi070 ceph-mon[29591]: osdmap e119: 12 total, 12 up, 12 in 2024-05-08T07:06:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:18 smithi172 ceph-mon[33377]: pgmap v620: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 832 KiB/s wr, 71 op/s 2024-05-08T07:06:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:18 smithi172 ceph-mon[33377]: osdmap e119: 12 total, 12 up, 12 in 2024-05-08T07:06:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:18 smithi194 ceph-mon[33679]: pgmap v620: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 832 KiB/s wr, 71 op/s 2024-05-08T07:06:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:18 smithi194 ceph-mon[33679]: osdmap e119: 12 total, 12 up, 12 in 2024-05-08T07:06:20.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:20 smithi070 ceph-mon[29591]: pgmap v622: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-05-08T07:06:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:20 smithi172 ceph-mon[33377]: pgmap v622: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-05-08T07:06:20.763 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:20 smithi194 ceph-mon[33679]: pgmap v622: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.5 MiB/s wr, 128 op/s 2024-05-08T07:06:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:22 smithi070 ceph-mon[29591]: pgmap v623: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-05-08T07:06:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:22 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:06:22.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:22 smithi172 ceph-mon[33377]: pgmap v623: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-05-08T07:06:22.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:22 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:06:22.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:22 smithi194 ceph-mon[33679]: pgmap v623: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-05-08T07:06:22.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:22 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:06:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:06:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:06:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:06:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:06:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:06:23.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:06:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:06:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:06:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:06:24.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:24 smithi070 ceph-mon[29591]: pgmap v624: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-05-08T07:06:24.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:24 smithi172 ceph-mon[33377]: pgmap v624: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-05-08T07:06:24.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:24 smithi194 ceph-mon[33679]: pgmap v624: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 1.3 MiB/s wr, 114 op/s 2024-05-08T07:06:25.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:25 smithi070 ceph-mon[29591]: pgmap v625: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-05-08T07:06:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:25 smithi172 ceph-mon[33377]: pgmap v625: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-05-08T07:06:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:25 smithi194 ceph-mon[33679]: pgmap v625: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-05-08T07:06:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:28 smithi070 ceph-mon[29591]: pgmap v626: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-05-08T07:06:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:28 smithi172 ceph-mon[33377]: pgmap v626: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-05-08T07:06:28.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:28 smithi194 ceph-mon[33679]: pgmap v626: 129 pgs: 129 active+clean; 1.0 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.8 MiB/s wr, 115 op/s 2024-05-08T07:06:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:30 smithi070 ceph-mon[29591]: pgmap v627: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 1.9 MiB/s wr, 141 op/s 2024-05-08T07:06:30.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:30 smithi172 ceph-mon[33377]: pgmap v627: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 1.9 MiB/s wr, 141 op/s 2024-05-08T07:06:30.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:30 smithi194 ceph-mon[33679]: pgmap v627: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 1.9 MiB/s wr, 141 op/s 2024-05-08T07:06:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:32 smithi070 ceph-mon[29591]: pgmap v628: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2024-05-08T07:06:32.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:32 smithi172 ceph-mon[33377]: pgmap v628: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2024-05-08T07:06:32.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:32 smithi194 ceph-mon[33679]: pgmap v628: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2024-05-08T07:06:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:34 smithi070 ceph-mon[29591]: pgmap v629: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2024-05-08T07:06:34.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:34 smithi172 ceph-mon[33377]: pgmap v629: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2024-05-08T07:06:34.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:34 smithi194 ceph-mon[33679]: pgmap v629: 129 pgs: 129 active+clean; 1.0 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.4 MiB/s wr, 93 op/s 2024-05-08T07:06:36.590 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:36 smithi194 ceph-mon[33679]: pgmap v630: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.9 MiB/s wr, 138 op/s 2024-05-08T07:06:36.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:36 smithi070 ceph-mon[29591]: pgmap v630: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.9 MiB/s wr, 138 op/s 2024-05-08T07:06:36.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:36 smithi172 ceph-mon[33377]: pgmap v630: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.9 MiB/s wr, 138 op/s 2024-05-08T07:06:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:37 smithi070 ceph-mon[29591]: pgmap v631: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 1023 KiB/s wr, 87 op/s 2024-05-08T07:06:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:37 smithi172 ceph-mon[33377]: pgmap v631: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 1023 KiB/s wr, 87 op/s 2024-05-08T07:06:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:37 smithi194 ceph-mon[33679]: pgmap v631: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 1023 KiB/s wr, 87 op/s 2024-05-08T07:06:40.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:40 smithi070 ceph-mon[29591]: pgmap v632: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2024-05-08T07:06:40.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:40 smithi172 ceph-mon[33377]: pgmap v632: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2024-05-08T07:06:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:40 smithi194 ceph-mon[33679]: pgmap v632: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.7 MiB/s wr, 137 op/s 2024-05-08T07:06:41.429 INFO:tasks.quiescer.fs.[cephfs]:Total duration (49.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T07:06:41.430 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.9 2024-05-08T07:06:41.430 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:06:41.915 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:06:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:42 smithi070 ceph-mon[29591]: pgmap v633: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-05-08T07:06:42.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:42 smithi172 ceph-mon[33377]: pgmap v633: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-05-08T07:06:42.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:42 smithi194 ceph-mon[33679]: pgmap v633: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-05-08T07:06:44.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:44 smithi070 ceph-mon[29591]: pgmap v634: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-05-08T07:06:44.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.431+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3552720202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 msgr2=0x7f8e28102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:44.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.431+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3552720202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 0x7f8e28102820 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009990 tx=0x7f8e10009ca0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.431+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3552720202 shutdown_connections 2024-05-08T07:06:44.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.431+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3552720202 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28102d60 0x7f8e2810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.431+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3552720202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e28108410 0x7f8e281087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.431+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3552720202 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 0x7f8e28102820 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.431+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3552720202 >> 172.21.15.70:0/3552720202 conn(0x7f8e28079350 msgr2=0x7f8e28079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:44.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.431+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3552720202 shutdown_connections 2024-05-08T07:06:44.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.431+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3552720202 wait complete. 2024-05-08T07:06:44.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.433+0000 7f8e2ee00700 1 Processor -- start 2024-05-08T07:06:44.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.433+0000 7f8e2ee00700 1 -- start start 2024-05-08T07:06:44.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.433+0000 7f8e2ee00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 0x7f8e281a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:44.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.433+0000 7f8e2ee00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e28102d60 0x7f8e281a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:44.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.433+0000 7f8e2ee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28108410 0x7f8e2819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:44.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.433+0000 7f8e2ee00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e28113560 con 0x7f8e281023a0 2024-05-08T07:06:44.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.433+0000 7f8e2ee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281133e0 con 0x7f8e28108410 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.433+0000 7f8e2ee00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8e281136e0 con 0x7f8e28102d60 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e27e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 0x7f8e281a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e27e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 0x7f8e281a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42404/0 (socket says 172.21.15.70:42404) 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e27e00700 1 -- 172.21.15.70:0/3509412546 learned_addr learned my addr 172.21.15.70:0/3509412546 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e1f400700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e28102d60 0x7f8e281a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e27e00700 1 -- 172.21.15.70:0/3509412546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e28102d60 msgr2=0x7f8e281a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e27e00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e28102d60 0x7f8e281a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e2ce00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28108410 0x7f8e2819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e27e00700 1 -- 172.21.15.70:0/3509412546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28108410 msgr2=0x7f8e2819bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e27e00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28108410 0x7f8e2819bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.434+0000 7f8e27e00700 1 -- 172.21.15.70:0/3509412546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2819c260 con 0x7f8e281023a0 2024-05-08T07:06:44.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.435+0000 7f8e27e00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 0x7f8e281a1940 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8e180060b0 tx=0x7f8e18007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:44.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.435+0000 7f8e25600700 1 -- 172.21.15.70:0/3509412546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1801a070 con 0x7f8e281023a0 2024-05-08T07:06:44.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.435+0000 7f8e25600700 1 -- 172.21.15.70:0/3509412546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e1800de20 con 0x7f8e281023a0 2024-05-08T07:06:44.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.435+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2819c550 con 0x7f8e281023a0 2024-05-08T07:06:44.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.435+0000 7f8e25600700 1 -- 172.21.15.70:0/3509412546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18014690 con 0x7f8e281023a0 2024-05-08T07:06:44.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.435+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e281a8810 con 0x7f8e281023a0 2024-05-08T07:06:44.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.437+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e2806a190 con 0x7f8e281023a0 2024-05-08T07:06:44.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.439+0000 7f8e25600700 1 -- 172.21.15.70:0/3509412546 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8e1801d070 con 0x7f8e281023a0 2024-05-08T07:06:44.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.441+0000 7f8e25600700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e0c0b2a70 0x7f8e0c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:44.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.442+0000 7f8e25600700 1 -- 172.21.15.70:0/3509412546 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7f8e180e2290 con 0x7f8e281023a0 2024-05-08T07:06:44.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.442+0000 7f8e1f400700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e0c0b2a70 0x7f8e0c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:44.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.443+0000 7f8e1f400700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e0c0b2a70 0x7f8e0c0b4f30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b5c0 tx=0x7f8e1001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:44.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.446+0000 7f8e25600700 1 -- 172.21.15.70:0/3509412546 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8e18010070 con 0x7f8e281023a0 2024-05-08T07:06:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:44 smithi172 ceph-mon[33377]: pgmap v634: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-05-08T07:06:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:44 smithi194 ceph-mon[33679]: pgmap v634: 129 pgs: 129 active+clean; 1.1 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 1.2 MiB/s wr, 94 op/s 2024-05-08T07:06:44.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.816+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e2802e510 con 0x7f8e281023a0 2024-05-08T07:06:44.817 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:06:44.818 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:06:44.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.817+0000 7f8e25600700 1 -- 172.21.15.70:0/3509412546 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f8e180a97f0 con 0x7f8e281023a0 2024-05-08T07:06:44.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.821+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e0c0b2a70 msgr2=0x7f8e0c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:44.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.821+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e0c0b2a70 0x7f8e0c0b4f30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000b5c0 tx=0x7f8e1001a040 comp rx=0 tx=0).stop 2024-05-08T07:06:44.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.821+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 msgr2=0x7f8e281a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:44.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.821+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 0x7f8e281a1940 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8e180060b0 tx=0x7f8e18007f90 comp rx=0 tx=0).stop 2024-05-08T07:06:44.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.822+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 shutdown_connections 2024-05-08T07:06:44.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.822+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e0c0b2a70 0x7f8e0c0b4f30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.822+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e28108410 0x7f8e2819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.822+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e281023a0 0x7f8e281a1940 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.822+0000 7f8e2ee00700 1 --2- 172.21.15.70:0/3509412546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e28102d60 0x7f8e281a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:44.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.822+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 >> 172.21.15.70:0/3509412546 conn(0x7f8e28079350 msgr2=0x7f8e2810d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:44.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.822+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 shutdown_connections 2024-05-08T07:06:44.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:44.822+0000 7f8e2ee00700 1 -- 172.21.15.70:0/3509412546 wait complete. 2024-05-08T07:06:44.823 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:06:45.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:45 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3509412546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:06:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:45 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3509412546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:06:45.753 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 84.9 --await-for 42.0' 2024-05-08T07:06:45.754 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 84.9 --await-for 42.0 2024-05-08T07:06:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:45 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3509412546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:06:46.241 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:06:46.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:46 smithi070 ceph-mon[29591]: pgmap v635: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.9 MiB/s wr, 147 op/s 2024-05-08T07:06:46.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:46 smithi172 ceph-mon[33377]: pgmap v635: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.9 MiB/s wr, 147 op/s 2024-05-08T07:06:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:46 smithi194 ceph-mon[33679]: pgmap v635: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.9 MiB/s wr, 147 op/s 2024-05-08T07:06:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:47 smithi070 ceph-mon[29591]: pgmap v636: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.3 MiB/s wr, 102 op/s 2024-05-08T07:06:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:47 smithi172 ceph-mon[33377]: pgmap v636: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.3 MiB/s wr, 102 op/s 2024-05-08T07:06:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:47 smithi194 ceph-mon[33679]: pgmap v636: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.3 MiB/s wr, 102 op/s 2024-05-08T07:06:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.136+0000 7fb8a3e00700 1 -- 172.21.15.70:0/616707869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c10b6e0 msgr2=0x7fb89c10bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.136+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/616707869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c10b6e0 0x7fb89c10bac0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb890009990 tx=0x7fb890009ca0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.136+0000 7fb8a3e00700 1 -- 172.21.15.70:0/616707869 shutdown_connections 2024-05-08T07:06:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.136+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/616707869 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb89c1060a0 0x7fb89c1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.136+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/616707869 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c10b6e0 0x7fb89c10bac0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.136+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/616707869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c1056e0 0x7fb89c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.137+0000 7fb8a3e00700 1 -- 172.21.15.70:0/616707869 >> 172.21.15.70:0/616707869 conn(0x7fb89c1011b0 msgr2=0x7fb89c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.137+0000 7fb8a3e00700 1 -- 172.21.15.70:0/616707869 shutdown_connections 2024-05-08T07:06:49.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.137+0000 7fb8a3e00700 1 -- 172.21.15.70:0/616707869 wait complete. 2024-05-08T07:06:49.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.138+0000 7fb8a3e00700 1 Processor -- start 2024-05-08T07:06:49.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.138+0000 7fb8a3e00700 1 -- start start 2024-05-08T07:06:49.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.139+0000 7fb8a3e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c1056e0 0x7fb89c1a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.139+0000 7fb8a3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c1060a0 0x7fb89c1a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.139+0000 7fb8a3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb89c10b6e0 0x7fb89c19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.139+0000 7fb8a3e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1157d0 con 0x7fb89c1060a0 2024-05-08T07:06:49.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.139+0000 7fb8a3e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c115650 con 0x7fb89c10b6e0 2024-05-08T07:06:49.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.139+0000 7fb8a3e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c115950 con 0x7fb89c1056e0 2024-05-08T07:06:49.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.139+0000 7fb8a0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c1060a0 0x7fb89c1a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.140+0000 7fb8a0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c1060a0 0x7fb89c1a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60980/0 (socket says 172.21.15.70:60980) 2024-05-08T07:06:49.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.140+0000 7fb8a0a00700 1 -- 172.21.15.70:0/2855731454 learned_addr learned my addr 172.21.15.70:0/2855731454 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.140+0000 7fb8a1400700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c1056e0 0x7fb89c1a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.140+0000 7fb8a1e00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb89c10b6e0 0x7fb89c19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.140+0000 7fb8a0a00700 1 -- 172.21.15.70:0/2855731454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c1056e0 msgr2=0x7fb89c1a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.140+0000 7fb8a0a00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c1056e0 0x7fb89c1a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.140+0000 7fb8a0a00700 1 -- 172.21.15.70:0/2855731454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb89c10b6e0 msgr2=0x7fb89c19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.140+0000 7fb8a0a00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb89c10b6e0 0x7fb89c19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.140+0000 7fb8a0a00700 1 -- 172.21.15.70:0/2855731454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89c19c210 con 0x7fb89c1060a0 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.141+0000 7fb8a0a00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c1060a0 0x7fb89c1a1de0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb88800c920 tx=0x7fb88800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.141+0000 7fb89a000700 1 -- 172.21.15.70:0/2855731454 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888007b00 con 0x7fb89c1060a0 2024-05-08T07:06:49.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.141+0000 7fb89a000700 1 -- 172.21.15.70:0/2855731454 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb888004cc0 con 0x7fb89c1060a0 2024-05-08T07:06:49.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.141+0000 7fb8a3e00700 1 -- 172.21.15.70:0/2855731454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89c19c500 con 0x7fb89c1060a0 2024-05-08T07:06:49.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.141+0000 7fb89a000700 1 -- 172.21.15.70:0/2855731454 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb888005440 con 0x7fb89c1060a0 2024-05-08T07:06:49.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.141+0000 7fb8a3e00700 1 -- 172.21.15.70:0/2855731454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb89c1a8770 con 0x7fb89c1060a0 2024-05-08T07:06:49.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.146+0000 7fb89a000700 1 -- 172.21.15.70:0/2855731454 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb888004750 con 0x7fb89c1060a0 2024-05-08T07:06:49.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.147+0000 7fb8ae77cb80 1 Processor -- start 2024-05-08T07:06:49.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.148+0000 7fb8ae77cb80 1 -- start start 2024-05-08T07:06:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.148+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c917800240 0x55c917800620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.148+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c9177fac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.148+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9177fb1d0 0x55c917807000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.148+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c91774cbb0 con 0x55c9177fa810 2024-05-08T07:06:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.148+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c9176ea8f0 con 0x55c9177fb1d0 2024-05-08T07:06:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.148+0000 7fb89a000700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8840b2b20 0x7fb8840b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.148+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c917748b70 con 0x55c917800240 2024-05-08T07:06:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.148+0000 7fb89a000700 1 -- 172.21.15.70:0/2855731454 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7fb8880e25d0 con 0x7fb89c1060a0 2024-05-08T07:06:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c9177fac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c9177fac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60994/0 (socket says 172.21.15.70:60994) 2024-05-08T07:06:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1400700 1 -- 172.21.15.70:0/824020004 learned_addr learned my addr 172.21.15.70:0/824020004 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1e00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8840b2b20 0x7fb8840b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1e00700 1 --2- 172.21.15.70:0/824020004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c917800240 0x55c917800620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1400700 1 -- 172.21.15.70:0/824020004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c917800240 msgr2=0x55c917800620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1400700 1 --2- 172.21.15.70:0/824020004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c917800240 0x55c917800620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1400700 1 -- 172.21.15.70:0/824020004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9177fb1d0 msgr2=0x55c917807000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1400700 1 --2- 172.21.15.70:0/824020004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9177fb1d0 0x55c917807000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.149+0000 7fb8a1400700 1 -- 172.21.15.70:0/824020004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c917699a60 con 0x55c9177fa810 2024-05-08T07:06:49.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.150+0000 7fb8a1e00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8840b2b20 0x7fb8840b4fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb894009fd0 tx=0x7fb894009540 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.150+0000 7fb8a1400700 1 --2- 172.21.15.70:0/824020004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c9177fac90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb890003760 tx=0x7fb890009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be92af862678ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.150+0000 7fb88ea00700 1 -- 172.21.15.70:0/824020004 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89000ba90 con 0x55c9177fa810 2024-05-08T07:06:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.150+0000 7fb88ea00700 1 -- 172.21.15.70:0/824020004 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb890027070 con 0x55c9177fa810 2024-05-08T07:06:49.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.150+0000 7fb88ea00700 1 -- 172.21.15.70:0/824020004 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89000fdc0 con 0x55c9177fa810 2024-05-08T07:06:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.151+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/824020004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 msgr2=0x55c9177fac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.151+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/824020004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c9177fac90 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb890003760 tx=0x7fb890009f80 comp rx=0 tx=0).stop 2024-05-08T07:06:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.151+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/824020004 shutdown_connections 2024-05-08T07:06:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.151+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/824020004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9177fb1d0 0x55c917807000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.151+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/824020004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c917800240 0x55c917800620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.151+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/824020004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c9177fac90 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.152+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/824020004 >> 172.21.15.70:0/824020004 conn(0x55c917772860 msgr2=0x55c9177f5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.152+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/824020004 shutdown_connections 2024-05-08T07:06:49.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.152+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/824020004 wait complete. 2024-05-08T07:06:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.153+0000 7fb8ae77cb80 1 -- start start 2024-05-08T07:06:49.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.153+0000 7fb8ae77cb80 1 Processor -- start 2024-05-08T07:06:49.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.153+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917806b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.153+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 0x55c917803fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.153+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 0x55c9178044e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.153+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c9178075a0 con 0x55c9177fa810 2024-05-08T07:06:49.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.153+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c9176b2cb0 con 0x55c917800240 2024-05-08T07:06:49.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.153+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c917807720 con 0x55c9177fb1d0 2024-05-08T07:06:49.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8ae77cb80 10 client.0 _ll_register_callbacks cb 0x55c9176f3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:06:49.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8a1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917806b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8a1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917806b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32778/0 (socket says 172.21.15.70:32778) 2024-05-08T07:06:49.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8a1400700 1 -- 172.21.15.70:0/2231446101 learned_addr learned my addr 172.21.15.70:0/2231446101 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:49.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8a0a00700 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 0x55c917803fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8a1400700 1 -- 172.21.15.70:0/2231446101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 msgr2=0x55c917803fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:49.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8a1400700 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 0x55c917803fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8a1400700 1 -- 172.21.15.70:0/2231446101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 msgr2=0x55c9178044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:49.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8a1400700 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 0x55c9178044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.154+0000 7fb8a1400700 1 -- 172.21.15.70:0/2231446101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9177125b0 con 0x55c9177fa810 2024-05-08T07:06:49.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.155+0000 7fb8a1400700 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917806b90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb89000bf10 tx=0x7fb8900036e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64e4179fe23c794 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:49.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.155+0000 7fb883400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.155+0000 7fb883400700 1 -- 172.21.15.70:0/2231446101 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890031070 con 0x55c9177fa810 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.156+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/2231446101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb890027070 con 0x55c9177fa810 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.156+0000 7fb883400700 1 -- 172.21.15.70:0/2231446101 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7fb89000fa30 con 0x55c9177fa810 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.156+0000 7fb883400700 1 -- 172.21.15.70:0/2231446101 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb89000fc30 con 0x55c9177fa810 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.156+0000 7fb8ae77cb80 10 client.16050 fetch_fsmap learned FSMap version 28 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.156+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/2231446101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c917811da0 con 0x55c9177fa810 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.157+0000 7fb883400700 1 -- 172.21.15.70:0/2231446101 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb890027070 con 0x55c9177fa810 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.157+0000 7fb883400700 1 -- 172.21.15.70:0/2231446101 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb8900173f0 con 0x55c9177fa810 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.157+0000 7fb8ae77cb80 10 client.16050 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.157+0000 7fb8ae77cb80 10 client.16050 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.157+0000 7fb8ae77cb80 20 client.16050 populate_metadata read hostname 'smithi070' 2024-05-08T07:06:49.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.157+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c917814270 0x55c917816660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.157+0000 7fb8ae77cb80 4 client.16050 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:06:49.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.157+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/2231446101 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9177c72d0 con 0x55c917814270 2024-05-08T07:06:49.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.158+0000 7fb8a0a00700 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c917814270 0x55c917816660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.159+0000 7fb8a0a00700 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c917814270 0x55c917816660 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9d8af49ba58a747 server_cookie=37c5e8e46562fc0f in_seq=0 out_seq=0 2024-05-08T07:06:49.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.159+0000 7fb883400700 10 client.16050 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:06:49.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.162+0000 7fb883400700 1 -- 172.21.15.70:0/2231446101 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c9177c72d0 con 0x55c917814270 2024-05-08T07:06:49.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.162+0000 7fb883400700 10 client.16050 handle_command_reply: tid=0 2024-05-08T07:06:49.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb8ae77cb80 1 client.16050 shutdown 2024-05-08T07:06:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/2231446101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 msgr2=0x55c917806b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917806b90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb89000bf10 tx=0x7fb8900036e0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/2231446101 shutdown_connections 2024-05-08T07:06:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c917814270 0x55c917816660 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 0x55c9178044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917806b90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/2231446101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 0x55c917803fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/2231446101 >> 172.21.15.70:0/2231446101 conn(0x55c917772860 msgr2=0x55c9177efbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:49.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.163+0000 7fb883400700 0 client.16050 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:06:49.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.164+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/2231446101 shutdown_connections 2024-05-08T07:06:49.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.164+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/2231446101 wait complete. 2024-05-08T07:06:49.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.164+0000 7fb8ae77cb80 20 client.16050 trim_cache size 0 max 16384 2024-05-08T07:06:49.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.191+0000 7fb8ae77cb80 1 Processor -- start 2024-05-08T07:06:49.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.191+0000 7fb8ae77cb80 1 -- start start 2024-05-08T07:06:49.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fa810 0x55c9177fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9177fb1d0 0x55c9177fd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c917800240 0x55c917819680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1b4020 con 0x55c917800240 2024-05-08T07:06:49.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1b18b0 con 0x55c9177fb1d0 2024-05-08T07:06:49.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1af720 con 0x55c9177fa810 2024-05-08T07:06:49.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8a1e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c917800240 0x55c917819680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8a0a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9177fb1d0 0x55c9177fd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8a1e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c917800240 0x55c917819680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32790/0 (socket says 172.21.15.70:32790) 2024-05-08T07:06:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8a1e00700 1 -- 172.21.15.70:0/3282388277 learned_addr learned my addr 172.21.15.70:0/3282388277 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.192+0000 7fb8a1400700 1 --2- 172.21.15.70:0/3282388277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fa810 0x55c9177fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.193+0000 7fb8a1e00700 1 -- 172.21.15.70:0/3282388277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fa810 msgr2=0x55c9177fccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.193+0000 7fb8a1e00700 1 --2- 172.21.15.70:0/3282388277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fa810 0x55c9177fccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.193+0000 7fb8a1e00700 1 -- 172.21.15.70:0/3282388277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9177fb1d0 msgr2=0x55c9177fd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:49.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.193+0000 7fb8a1e00700 1 --2- 172.21.15.70:0/3282388277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9177fb1d0 0x55c9177fd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.193+0000 7fb8a1e00700 1 -- 172.21.15.70:0/3282388277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9177f1d00 con 0x55c917800240 2024-05-08T07:06:49.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.193+0000 7fb8a1e00700 1 --2- 172.21.15.70:0/3282388277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c917800240 0x55c917819680 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb89400a450 tx=0x7fb894004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f08e5d4262e9ed3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.194+0000 7fb88e000700 1 -- 172.21.15.70:0/3282388277 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894029070 con 0x55c917800240 2024-05-08T07:06:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.194+0000 7fb88e000700 1 -- 172.21.15.70:0/3282388277 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb894019cf0 con 0x55c917800240 2024-05-08T07:06:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.194+0000 7fb88e000700 1 -- 172.21.15.70:0/3282388277 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894013040 con 0x55c917800240 2024-05-08T07:06:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.195+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/3282388277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c917800240 msgr2=0x55c917819680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:06:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.195+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/3282388277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c917800240 0x55c917819680 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb89400a450 tx=0x7fb894004be0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.195+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/3282388277 shutdown_connections 2024-05-08T07:06:49.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.195+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/3282388277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c917800240 0x55c917819680 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.195+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/3282388277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fa810 0x55c9177fccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.195+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/3282388277 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9177fb1d0 0x55c9177fd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.195+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/3282388277 >> 172.21.15.70:0/3282388277 conn(0x55c917772860 msgr2=0x55c9177efbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.195+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/3282388277 shutdown_connections 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.195+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/3282388277 wait complete. 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.196+0000 7fb8ae77cb80 1 -- start start 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.196+0000 7fb8ae77cb80 1 Processor -- start 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917877b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 0x55c917878040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8ae77cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 0x55c917818a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1afd70 con 0x55c9177fa810 2024-05-08T07:06:49.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1b11e0 con 0x55c917800240 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8ae77cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb89c1b0440 con 0x55c9177fb1d0 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8ae77cb80 10 client.0 _ll_register_callbacks cb 0x55c9176f3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8a1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917877b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8a1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917877b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32800/0 (socket says 172.21.15.70:32800) 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8a1400700 1 -- 172.21.15.70:0/1169350178 learned_addr learned my addr 172.21.15.70:0/1169350178 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8a1e00700 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 0x55c917818a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8a0a00700 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 0x55c917878040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8a1400700 1 -- 172.21.15.70:0/1169350178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 msgr2=0x55c917878040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8a1400700 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 0x55c917878040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8a1400700 1 -- 172.21.15.70:0/1169350178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 msgr2=0x55c917818a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.197+0000 7fb8a1400700 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 0x55c917818a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.198+0000 7fb8a1400700 1 -- 172.21.15.70:0/1169350178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9177fa640 con 0x55c9177fa810 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.198+0000 7fb8a1e00700 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 0x55c917818a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:06:49.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.198+0000 7fb8a1400700 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917877b00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb890009990 tx=0x7fb8900058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869e6196f5bad047 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:06:49.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.198+0000 7fb883400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:06:49.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.198+0000 7fb883400700 1 -- 172.21.15.70:0/1169350178 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb890031040 con 0x55c9177fa810 2024-05-08T07:06:49.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.198+0000 7fb883400700 1 -- 172.21.15.70:0/1169350178 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9583+0+0 (secure 0 0 0) 0x7fb89000fa30 con 0x55c9177fa810 2024-05-08T07:06:49.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.198+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/1169350178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb894019cf0 con 0x55c9177fa810 2024-05-08T07:06:49.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb883400700 1 -- 172.21.15.70:0/1169350178 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb890036440 con 0x55c9177fa810 2024-05-08T07:06:49.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb8ae77cb80 10 client.16056 fetch_fsmap learned FSMap version 28 2024-05-08T07:06:49.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/1169350178 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c917880100 con 0x55c9177fa810 2024-05-08T07:06:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb883400700 1 -- 172.21.15.70:0/1169350178 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb894019cf0 con 0x55c9177fa810 2024-05-08T07:06:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb883400700 1 -- 172.21.15.70:0/1169350178 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb8900415c0 con 0x55c9177fa810 2024-05-08T07:06:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb8ae77cb80 10 client.16056 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:06:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb8ae77cb80 10 client.16056 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:06:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb8ae77cb80 20 client.16056 populate_metadata read hostname 'smithi070' 2024-05-08T07:06:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9178808a0 0x55c917882ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:06:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb8ae77cb80 4 client.16056 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.9, "await_for": 42.0}] 2024-05-08T07:06:49.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.199+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/1169350178 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.9, "await_for": 42.0}) -- 0x55c91775a590 con 0x55c9178808a0 2024-05-08T07:06:49.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.200+0000 7fb8a0a00700 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9178808a0 0x55c917882ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:06:49.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.201+0000 7fb8a0a00700 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9178808a0 0x55c917882ce0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c66f595656fe318 server_cookie=f56f93720ab7c2d8 in_seq=0 out_seq=0 2024-05-08T07:06:49.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:06:49.201+0000 7fb883400700 10 client.16056 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:06:50.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:50 smithi070 ceph-mon[29591]: pgmap v637: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 2.2 MiB/s wr, 154 op/s 2024-05-08T07:06:50.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:50 smithi172 ceph-mon[33377]: pgmap v637: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 2.2 MiB/s wr, 154 op/s 2024-05-08T07:06:50.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:50 smithi194 ceph-mon[33679]: pgmap v637: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 2.2 MiB/s wr, 154 op/s 2024-05-08T07:06:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:52 smithi070 ceph-mon[29591]: pgmap v638: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-05-08T07:06:52.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:52 smithi172 ceph-mon[33377]: pgmap v638: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-05-08T07:06:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:52 smithi194 ceph-mon[33679]: pgmap v638: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-05-08T07:06:54.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:54 smithi070 ceph-mon[29591]: pgmap v639: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-05-08T07:06:54.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:54 smithi172 ceph-mon[33377]: pgmap v639: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-05-08T07:06:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:54 smithi194 ceph-mon[33679]: pgmap v639: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-05-08T07:06:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:56 smithi070 ceph-mon[29591]: pgmap v640: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1.6 MiB/s wr, 115 op/s 2024-05-08T07:06:56.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:56 smithi172 ceph-mon[33377]: pgmap v640: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1.6 MiB/s wr, 115 op/s 2024-05-08T07:06:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:56 smithi194 ceph-mon[33679]: pgmap v640: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 1.6 MiB/s wr, 115 op/s 2024-05-08T07:06:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:06:57 smithi070 ceph-mon[29591]: pgmap v641: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1013 KiB/s wr, 62 op/s 2024-05-08T07:06:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:06:57 smithi172 ceph-mon[33377]: pgmap v641: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1013 KiB/s wr, 62 op/s 2024-05-08T07:06:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:06:57 smithi194 ceph-mon[33679]: pgmap v641: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 1013 KiB/s wr, 62 op/s 2024-05-08T07:07:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:00 smithi070 ceph-mon[29591]: pgmap v642: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.0 MiB/s wr, 66 op/s 2024-05-08T07:07:00.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:00 smithi172 ceph-mon[33377]: pgmap v642: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.0 MiB/s wr, 66 op/s 2024-05-08T07:07:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:00 smithi194 ceph-mon[33679]: pgmap v642: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.0 MiB/s wr, 66 op/s 2024-05-08T07:07:01.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.361+0000 7fb883400700 1 -- 172.21.15.70:0/1169350178 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55c91775a590 con 0x55c9178808a0 2024-05-08T07:07:01.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.361+0000 7fb883400700 10 client.16056 handle_command_reply: tid=0 2024-05-08T07:07:01.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.361+0000 7fb8ae77cb80 1 client.16056 shutdown 2024-05-08T07:07:01.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/1169350178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 msgr2=0x55c917877b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917877b00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb890009990 tx=0x7fb8900058e0 comp rx=0 tx=0).stop 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/1169350178 shutdown_connections 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9178808a0 0x55c917882ce0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c917800240 0x55c917818a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9177fa810 0x55c917877b00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 --2- 172.21.15.70:0/1169350178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9177fb1d0 0x55c917878040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb883400700 0 client.16056 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/1169350178 >> 172.21.15.70:0/1169350178 conn(0x55c917772860 msgr2=0x55c9178054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/1169350178 shutdown_connections 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.362+0000 7fb8ae77cb80 1 -- 172.21.15.70:0/1169350178 wait complete. 2024-05-08T07:07:01.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.363+0000 7fb8ae77cb80 20 client.16056 trim_cache size 0 max 16384 2024-05-08T07:07:01.364 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:07:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:07:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:07:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 54, 2024-05-08T07:07:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:07:01.364 INFO:teuthology.orchestra.run.smithi070.stdout: "6fa7c843": { 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 54, 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.9, 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:07:01.365 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:07:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:07:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:07:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:07:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:01.366 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:01.366 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:07:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 -- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8840b2b20 msgr2=0x7fb8840b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8840b2b20 0x7fb8840b4fe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb894009fd0 tx=0x7fb894009540 comp rx=0 tx=0).stop 2024-05-08T07:07:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 -- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c1060a0 msgr2=0x7fb89c1a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c1060a0 0x7fb89c1a1de0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb88800c920 tx=0x7fb88800cc30 comp rx=0 tx=0).stop 2024-05-08T07:07:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 -- 172.21.15.70:0/2855731454 shutdown_connections 2024-05-08T07:07:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8840b2b20 0x7fb8840b4fe0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb89c10b6e0 0x7fb89c19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89c1056e0 0x7fb89c1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:01.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 --2- 172.21.15.70:0/2855731454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb89c1060a0 0x7fb89c1a1de0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:01.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 -- 172.21.15.70:0/2855731454 >> 172.21.15.70:0/2855731454 conn(0x7fb89c1011b0 msgr2=0x7fb89c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:01.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 -- 172.21.15.70:0/2855731454 shutdown_connections 2024-05-08T07:07:01.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:01.364+0000 7fb8a3e00700 1 -- 172.21.15.70:0/2855731454 wait complete. 2024-05-08T07:07:02.217 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6fa7c843', quiesce took 20.8 seconds. Will release after: 24.9 2024-05-08T07:07:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:02 smithi070 ceph-mon[29591]: pgmap v643: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 149 KiB/s wr, 14 op/s 2024-05-08T07:07:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:02 smithi172 ceph-mon[33377]: pgmap v643: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 149 KiB/s wr, 14 op/s 2024-05-08T07:07:02.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:02 smithi194 ceph-mon[33679]: pgmap v643: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 149 KiB/s wr, 14 op/s 2024-05-08T07:07:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:04 smithi070 ceph-mon[29591]: pgmap v644: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 149 KiB/s wr, 14 op/s 2024-05-08T07:07:04.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:04 smithi172 ceph-mon[33377]: pgmap v644: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 149 KiB/s wr, 14 op/s 2024-05-08T07:07:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:04 smithi194 ceph-mon[33679]: pgmap v644: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 149 KiB/s wr, 14 op/s 2024-05-08T07:07:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:05 smithi172 ceph-mon[33377]: pgmap v645: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 262 KiB/s wr, 35 op/s 2024-05-08T07:07:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:05 smithi194 ceph-mon[33679]: pgmap v645: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 262 KiB/s wr, 35 op/s 2024-05-08T07:07:05.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:05 smithi070 ceph-mon[29591]: pgmap v645: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 262 KiB/s wr, 35 op/s 2024-05-08T07:07:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:08 smithi070 ceph-mon[29591]: pgmap v646: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 153 KiB/s wr, 25 op/s 2024-05-08T07:07:08.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:08 smithi172 ceph-mon[33377]: pgmap v646: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 153 KiB/s wr, 25 op/s 2024-05-08T07:07:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:08 smithi194 ceph-mon[33679]: pgmap v646: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 153 KiB/s wr, 25 op/s 2024-05-08T07:07:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:10 smithi070 ceph-mon[29591]: pgmap v647: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 153 KiB/s wr, 27 op/s 2024-05-08T07:07:10.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:10 smithi172 ceph-mon[33377]: pgmap v647: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 153 KiB/s wr, 27 op/s 2024-05-08T07:07:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:10 smithi194 ceph-mon[33679]: pgmap v647: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 153 KiB/s wr, 27 op/s 2024-05-08T07:07:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:11 smithi070 ceph-mon[29591]: osdmap e120: 12 total, 12 up, 12 in 2024-05-08T07:07:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:11 smithi070 ceph-mon[29591]: pgmap v649: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 135 KiB/s wr, 28 op/s 2024-05-08T07:07:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:11 smithi172 ceph-mon[33377]: osdmap e120: 12 total, 12 up, 12 in 2024-05-08T07:07:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:11 smithi172 ceph-mon[33377]: pgmap v649: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 135 KiB/s wr, 28 op/s 2024-05-08T07:07:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:11 smithi194 ceph-mon[33679]: osdmap e120: 12 total, 12 up, 12 in 2024-05-08T07:07:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:11 smithi194 ceph-mon[33679]: pgmap v649: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 135 KiB/s wr, 28 op/s 2024-05-08T07:07:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:14 smithi070 ceph-mon[29591]: pgmap v650: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 135 KiB/s wr, 28 op/s 2024-05-08T07:07:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:14 smithi172 ceph-mon[33377]: pgmap v650: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 135 KiB/s wr, 28 op/s 2024-05-08T07:07:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:14 smithi194 ceph-mon[33679]: pgmap v650: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 135 KiB/s wr, 28 op/s 2024-05-08T07:07:16.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:16 smithi070 ceph-mon[29591]: pgmap v651: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:16 smithi172 ceph-mon[33377]: pgmap v651: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:16 smithi194 ceph-mon[33679]: pgmap v651: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:18 smithi070 ceph-mon[29591]: pgmap v652: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:18 smithi070 ceph-mon[29591]: osdmap e121: 12 total, 12 up, 12 in 2024-05-08T07:07:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:18 smithi172 ceph-mon[33377]: pgmap v652: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:18 smithi172 ceph-mon[33377]: osdmap e121: 12 total, 12 up, 12 in 2024-05-08T07:07:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:18 smithi194 ceph-mon[33679]: pgmap v652: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:18 smithi194 ceph-mon[33679]: osdmap e121: 12 total, 12 up, 12 in 2024-05-08T07:07:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:19 smithi070 ceph-mon[29591]: pgmap v654: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-05-08T07:07:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:19 smithi172 ceph-mon[33377]: pgmap v654: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-05-08T07:07:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:19 smithi194 ceph-mon[33679]: pgmap v654: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-05-08T07:07:22.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:22 smithi070 ceph-mon[29591]: pgmap v655: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:22.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:22 smithi172 ceph-mon[33377]: pgmap v655: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:22.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:22 smithi194 ceph-mon[33679]: pgmap v655: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:07:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:07:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:07:24.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:24 smithi070 ceph-mon[29591]: pgmap v656: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:24.664 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:24 smithi172 ceph-mon[33377]: pgmap v656: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:24.721 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:24 smithi194 ceph-mon[33679]: pgmap v656: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:07:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:25 smithi172 ceph-mon[33377]: pgmap v657: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:07:25.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:25 smithi194 ceph-mon[33679]: pgmap v657: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:07:25.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:25 smithi070 ceph-mon[29591]: pgmap v657: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:07:27.119 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:07:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.554 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:07:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:28.273 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: pgmap v658: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:07:28.273 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.273 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.273 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.273 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:07:28.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: pgmap v658: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:07:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:07:28.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:07:28.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:28.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: pgmap v658: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:07:28.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:07:28.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:07:28.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:07:28.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:07:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:29 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:07:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:29 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:07:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:29 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:07:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:29 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:07:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:29 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:07:29.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:29 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:07:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:29 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:07:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:29 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:07:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:29 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:07:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:29 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:07:29.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:29 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:07:29.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:29 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:07:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:29 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:07:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:29 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:07:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:29 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:07:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:29 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:07:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:29 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:07:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:29 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:07:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.300+0000 7f09c6e00700 1 -- 172.21.15.70:0/2854197719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103550 msgr2=0x7f09c01039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.300+0000 7f09c6e00700 1 --2- 172.21.15.70:0/2854197719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103550 0x7f09c01039b0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009990 tx=0x7f09ac009ca0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.301+0000 7f09c6e00700 1 -- 172.21.15.70:0/2854197719 shutdown_connections 2024-05-08T07:07:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.301+0000 7f09c6e00700 1 --2- 172.21.15.70:0/2854197719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09c0103ef0 0x7f09c01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.301+0000 7f09c6e00700 1 --2- 172.21.15.70:0/2854197719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09c0108460 0x7f09c0108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.301+0000 7f09c6e00700 1 --2- 172.21.15.70:0/2854197719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103550 0x7f09c01039b0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.301+0000 7f09c6e00700 1 -- 172.21.15.70:0/2854197719 >> 172.21.15.70:0/2854197719 conn(0x7f09c007a600 msgr2=0x7f09c007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.301+0000 7f09c6e00700 1 -- 172.21.15.70:0/2854197719 shutdown_connections 2024-05-08T07:07:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.301+0000 7f09c6e00700 1 -- 172.21.15.70:0/2854197719 wait complete. 2024-05-08T07:07:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.302+0000 7f09c6e00700 1 Processor -- start 2024-05-08T07:07:30.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.302+0000 7f09c6e00700 1 -- start start 2024-05-08T07:07:30.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09c6e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09c0103550 0x7f09c01a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09c6e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103ef0 0x7f09c01a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09c6e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09c0108460 0x7f09c019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09c6e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09c0113540 con 0x7f09c0103ef0 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09c6e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09c01133c0 con 0x7f09c0103550 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09c6e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f09c01136c0 con 0x7f09c0108460 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09bf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103ef0 0x7f09c01a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09bf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103ef0 0x7f09c01a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60060/0 (socket says 172.21.15.70:60060) 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09bf400700 1 -- 172.21.15.70:0/1587514574 learned_addr learned my addr 172.21.15.70:0/1587514574 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.303+0000 7f09bfe00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09c0103550 0x7f09c01a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09c4e00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09c0108460 0x7f09c019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bf400700 1 -- 172.21.15.70:0/1587514574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09c0108460 msgr2=0x7f09c019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bf400700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09c0108460 0x7f09c019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bf400700 1 -- 172.21.15.70:0/1587514574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09c0103550 msgr2=0x7f09c01a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bf400700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09c0103550 0x7f09c01a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bf400700 1 -- 172.21.15.70:0/1587514574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09c019c400 con 0x7f09c0103ef0 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09c4e00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09c0108460 0x7f09c019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bfe00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09c0103550 0x7f09c01a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bf400700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103ef0 0x7f09c01a1f90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0057c0 tx=0x7f09ac009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bcc00700 1 -- 172.21.15.70:0/1587514574 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac027070 con 0x7f09c0103ef0 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09c019c690 con 0x7f09c0103ef0 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bcc00700 1 -- 172.21.15.70:0/1587514574 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09ac00fda0 con 0x7f09c0103ef0 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.304+0000 7f09bcc00700 1 -- 172.21.15.70:0/1587514574 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09ac022ca0 con 0x7f09c0103ef0 2024-05-08T07:07:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.305+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09c01a89d0 con 0x7f09c0103ef0 2024-05-08T07:07:30.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.306+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09c0104c10 con 0x7f09c0103ef0 2024-05-08T07:07:30.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.308+0000 7f09bcc00700 1 -- 172.21.15.70:0/1587514574 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f09ac02a070 con 0x7f09c0103ef0 2024-05-08T07:07:30.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.310+0000 7f09bcc00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09a40b2a70 0x7f09a40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:30.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.311+0000 7f09bcc00700 1 -- 172.21.15.70:0/1587514574 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7f09ac0e3aa0 con 0x7f09c0103ef0 2024-05-08T07:07:30.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.311+0000 7f09bfe00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09a40b2a70 0x7f09a40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:30.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.312+0000 7f09bfe00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09a40b2a70 0x7f09a40b4f30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09c0104730 tx=0x7f09b000b5f0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:30.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.313+0000 7f09bcc00700 1 -- 172.21.15.70:0/1587514574 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f09ac031080 con 0x7f09c0103ef0 2024-05-08T07:07:30.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:30 smithi070 ceph-mon[29591]: pgmap v659: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 KiB/s wr, 8 op/s 2024-05-08T07:07:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:30 smithi194 ceph-mon[33679]: pgmap v659: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 KiB/s wr, 8 op/s 2024-05-08T07:07:30.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.596+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09c01a8ba0 con 0x7f09c0103ef0 2024-05-08T07:07:30.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.598+0000 7f09bcc00700 1 -- 172.21.15.70:0/1587514574 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7f09ac013070 con 0x7f09c0103ef0 2024-05-08T07:07:30.598 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:07:30.598 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:07:30.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09a40b2a70 msgr2=0x7f09a40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:30.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09a40b2a70 0x7f09a40b4f30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f09c0104730 tx=0x7f09b000b5f0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103ef0 msgr2=0x7f09c01a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:30.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103ef0 0x7f09c01a1f90 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0057c0 tx=0x7f09ac009f90 comp rx=0 tx=0).stop 2024-05-08T07:07:30.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 shutdown_connections 2024-05-08T07:07:30.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09a40b2a70 0x7f09a40b4f30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09c0108460 0x7f09c019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09c0103550 0x7f09c01a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 --2- 172.21.15.70:0/1587514574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09c0103ef0 0x7f09c01a1f90 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:30.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 >> 172.21.15.70:0/1587514574 conn(0x7f09c007a600 msgr2=0x7f09c01013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:30.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 shutdown_connections 2024-05-08T07:07:30.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:30.602+0000 7f09c6e00700 1 -- 172.21.15.70:0/1587514574 wait complete. 2024-05-08T07:07:30.603 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:07:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:30 smithi172 ceph-mon[33377]: pgmap v659: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.5 KiB/s wr, 8 op/s 2024-05-08T07:07:31.408 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 6fa7c843 --release --await' 2024-05-08T07:07:31.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 6fa7c843 --release --await 2024-05-08T07:07:31.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:31 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1587514574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:07:31.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:31 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1587514574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:07:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:31 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1587514574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:07:31.811 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:07:32.216 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:32 smithi070 ceph-mon[29591]: pgmap v660: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2024-05-08T07:07:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:32 smithi194 ceph-mon[33679]: pgmap v660: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2024-05-08T07:07:32.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:32 smithi172 ceph-mon[33377]: pgmap v660: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2024-05-08T07:07:34.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.233+0000 7fe6b5000700 1 -- 172.21.15.70:0/164257800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0106050 msgr2=0x7fe6b0112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:34.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.233+0000 7fe6b5000700 1 --2- 172.21.15.70:0/164257800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0106050 0x7fe6b0112560 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800b0a0 tx=0x7fe6a800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.233+0000 7fe6b5000700 1 -- 172.21.15.70:0/164257800 shutdown_connections 2024-05-08T07:07:34.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.233+0000 7fe6b5000700 1 --2- 172.21.15.70:0/164257800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0106050 0x7fe6b0112560 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.233+0000 7fe6b5000700 1 --2- 172.21.15.70:0/164257800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b010b690 0x7fe6b010ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.233+0000 7fe6b5000700 1 --2- 172.21.15.70:0/164257800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b0105690 0x7fe6b0105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.233+0000 7fe6b5000700 1 -- 172.21.15.70:0/164257800 >> 172.21.15.70:0/164257800 conn(0x7fe6b0101180 msgr2=0x7fe6b01035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:34.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.233+0000 7fe6b5000700 1 -- 172.21.15.70:0/164257800 shutdown_connections 2024-05-08T07:07:34.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.233+0000 7fe6b5000700 1 -- 172.21.15.70:0/164257800 wait complete. 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.234+0000 7fe6b5000700 1 Processor -- start 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6b5000700 1 -- start start 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6b5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0105690 0x7fe6b01a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6b5000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b0106050 0x7fe6b01a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6b5000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b010b690 0x7fe6b019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6b5000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b01157d0 con 0x7fe6b0105690 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6b5000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0115650 con 0x7fe6b010b690 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6b5000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b0115950 con 0x7fe6b0106050 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6ade00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0105690 0x7fe6b01a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6ade00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0105690 0x7fe6b01a1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60070/0 (socket says 172.21.15.70:60070) 2024-05-08T07:07:34.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.235+0000 7fe6ade00700 1 -- 172.21.15.70:0/769691212 learned_addr learned my addr 172.21.15.70:0/769691212 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:34.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6ad400700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b0106050 0x7fe6b01a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6ae800700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b010b690 0x7fe6b019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6ade00700 1 -- 172.21.15.70:0/769691212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b0106050 msgr2=0x7fe6b01a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:34.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6ade00700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b0106050 0x7fe6b01a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6ade00700 1 -- 172.21.15.70:0/769691212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b010b690 msgr2=0x7fe6b019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:34.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6ade00700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b010b690 0x7fe6b019ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6ade00700 1 -- 172.21.15.70:0/769691212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b019c190 con 0x7fe6b0105690 2024-05-08T07:07:34.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6ade00700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0105690 0x7fe6b01a1870 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000c970 tx=0x7fe6a000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:34.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6a6a00700 1 -- 172.21.15.70:0/769691212 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0007aa0 con 0x7fe6b0105690 2024-05-08T07:07:34.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6a6a00700 1 -- 172.21.15.70:0/769691212 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a0004cc0 con 0x7fe6b0105690 2024-05-08T07:07:34.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.236+0000 7fe6b5000700 1 -- 172.21.15.70:0/769691212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b019c420 con 0x7fe6b0105690 2024-05-08T07:07:34.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.237+0000 7fe6a6a00700 1 -- 172.21.15.70:0/769691212 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0005500 con 0x7fe6b0105690 2024-05-08T07:07:34.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.237+0000 7fe6b5000700 1 -- 172.21.15.70:0/769691212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b01a8740 con 0x7fe6b0105690 2024-05-08T07:07:34.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.240+0000 7fe6a6a00700 1 -- 172.21.15.70:0/769691212 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe6a0007c40 con 0x7fe6b0105690 2024-05-08T07:07:34.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.241+0000 7fe6bf9f1b80 1 Processor -- start 2024-05-08T07:07:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6bf9f1b80 1 -- start start 2024-05-08T07:07:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6a6a00700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6940b2a70 0x7fe6940b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e826631b0 0x557e82663590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265d780 0x557e8265dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265e140 0x557e82669f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557e825afb20 con 0x557e8265e140 2024-05-08T07:07:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557e8254d860 con 0x557e8265d780 2024-05-08T07:07:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557e825abae0 con 0x557e826631b0 2024-05-08T07:07:34.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6a6a00700 1 -- 172.21.15.70:0/769691212 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7fe6a00e2800 con 0x7fe6b0105690 2024-05-08T07:07:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.242+0000 7fe6ae800700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6940b2a70 0x7fe6940b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265e140 0x557e82669f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265e140 0x557e82669f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60080/0 (socket says 172.21.15.70:60080) 2024-05-08T07:07:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 -- 172.21.15.70:0/327690441 learned_addr learned my addr 172.21.15.70:0/327690441 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ade00700 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e826631b0 0x557e82663590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ad400700 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265d780 0x557e8265dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 -- 172.21.15.70:0/327690441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e826631b0 msgr2=0x557e82663590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:34.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e826631b0 0x557e82663590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 -- 172.21.15.70:0/327690441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265d780 msgr2=0x557e8265dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265d780 0x557e8265dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 -- 172.21.15.70:0/327690441 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e824fc9d0 con 0x557e8265e140 2024-05-08T07:07:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ad400700 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265d780 0x557e8265dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:07:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6940b2a70 0x7fe6940b4f30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800b830 tx=0x7fe6a8009c80 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.243+0000 7fe6ae800700 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265e140 0x557e82669f70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8015000 tx=0x7fe6a80095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc4fb909baf7159 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.244+0000 7fe69b400700 1 -- 172.21.15.70:0/327690441 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80077f0 con 0x557e8265e140 2024-05-08T07:07:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.244+0000 7fe69b400700 1 -- 172.21.15.70:0/327690441 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a801f440 con 0x557e8265e140 2024-05-08T07:07:34.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.244+0000 7fe69b400700 1 -- 172.21.15.70:0/327690441 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a801c6a0 con 0x557e8265e140 2024-05-08T07:07:34.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.245+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/327690441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265e140 msgr2=0x557e82669f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:34.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.245+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265e140 0x557e82669f70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8015000 tx=0x7fe6a80095d0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.245+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/327690441 shutdown_connections 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.245+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265e140 0x557e82669f70 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.245+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e826631b0 0x557e82663590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.245+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/327690441 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265d780 0x557e8265dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.245+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/327690441 >> 172.21.15.70:0/327690441 conn(0x557e825d57d0 msgr2=0x557e82658070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.245+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/327690441 shutdown_connections 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.245+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/327690441 wait complete. 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.246+0000 7fe6bf9f1b80 1 -- start start 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.246+0000 7fe6bf9f1b80 1 Processor -- start 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.246+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e82669c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.246+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 0x557e82666fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.246+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 0x557e826674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.246+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557e8266a510 con 0x557e8265d780 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.246+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557e82515c20 con 0x557e826631b0 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.246+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557e8266a690 con 0x557e8265e140 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.246+0000 7fe6bf9f1b80 10 client.0 _ll_register_callbacks cb 0x557e82556d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ade00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e82669c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ade00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e82669c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60096/0 (socket says 172.21.15.70:60096) 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ade00700 1 -- 172.21.15.70:0/252341826 learned_addr learned my addr 172.21.15.70:0/252341826 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ae800700 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 0x557e826674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ade00700 1 -- 172.21.15.70:0/252341826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 msgr2=0x557e82666fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ad400700 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 0x557e82666fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ade00700 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 0x557e82666fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ade00700 1 -- 172.21.15.70:0/252341826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 msgr2=0x557e826674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:34.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ade00700 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 0x557e826674f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ade00700 1 -- 172.21.15.70:0/252341826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e82575520 con 0x557e8265d780 2024-05-08T07:07:34.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ae800700 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 0x557e826674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:07:34.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe6ade00700 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e82669c10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00a9680 tx=0x7fe6a00e0030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed59a4c37b62e15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:34.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.247+0000 7fe68fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:07:34.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.248+0000 7fe68fe00700 1 -- 172.21.15.70:0/252341826 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00a9df0 con 0x557e8265d780 2024-05-08T07:07:34.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.248+0000 7fe68fe00700 1 -- 172.21.15.70:0/252341826 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7fe6a00a9b60 con 0x557e8265d780 2024-05-08T07:07:34.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.248+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/252341826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a801f440 con 0x557e8265d780 2024-05-08T07:07:34.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.248+0000 7fe68fe00700 1 -- 172.21.15.70:0/252341826 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6a00a96f0 con 0x557e8265d780 2024-05-08T07:07:34.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.248+0000 7fe6bf9f1b80 10 client.16074 fetch_fsmap learned FSMap version 28 2024-05-08T07:07:34.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.248+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/252341826 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557e82674d70 con 0x557e8265d780 2024-05-08T07:07:34.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.248+0000 7fe68fe00700 1 -- 172.21.15.70:0/252341826 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a801f440 con 0x557e8265d780 2024-05-08T07:07:34.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.249+0000 7fe68fe00700 1 -- 172.21.15.70:0/252341826 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fe6a00e2320 con 0x557e8265d780 2024-05-08T07:07:34.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.249+0000 7fe6bf9f1b80 10 client.16074 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:07:34.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.249+0000 7fe6bf9f1b80 10 client.16074 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:07:34.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.249+0000 7fe6bf9f1b80 20 client.16074 populate_metadata read hostname 'smithi070' 2024-05-08T07:07:34.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.249+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557e82677300 0x557e82679750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.249+0000 7fe6bf9f1b80 4 client.16074 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:07:34.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.249+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/252341826 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e8262a240 con 0x557e82677300 2024-05-08T07:07:34.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.249+0000 7fe6ad400700 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557e82677300 0x557e82679750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.250+0000 7fe6ad400700 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557e82677300 0x557e82679750 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac418cdcd60a8cc4 server_cookie=1fb56a1bffbd6245 in_seq=0 out_seq=0 2024-05-08T07:07:34.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.250+0000 7fe68fe00700 10 client.16074 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:07:34.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.252+0000 7fe68fe00700 1 -- 172.21.15.70:0/252341826 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557e8262a240 con 0x557e82677300 2024-05-08T07:07:34.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.252+0000 7fe68fe00700 10 client.16074 handle_command_reply: tid=0 2024-05-08T07:07:34.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.252+0000 7fe6bf9f1b80 1 client.16074 shutdown 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/252341826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 msgr2=0x557e82669c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e82669c10 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00a9680 tx=0x7fe6a00e0030 comp rx=0 tx=0).stop 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/252341826 shutdown_connections 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557e82677300 0x557e82679750 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 0x557e826674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e82669c10 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/252341826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 0x557e82666fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/252341826 >> 172.21.15.70:0/252341826 conn(0x557e825d57d0 msgr2=0x557e82652b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe68fe00700 0 client.16074 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/252341826 shutdown_connections 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/252341826 wait complete. 2024-05-08T07:07:34.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.253+0000 7fe6bf9f1b80 20 client.16074 trim_cache size 0 max 16384 2024-05-08T07:07:34.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6bf9f1b80 1 Processor -- start 2024-05-08T07:07:34.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6bf9f1b80 1 -- start start 2024-05-08T07:07:34.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265d780 0x557e82673560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265e140 0x557e82661340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e826631b0 0x557e8267f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b01b4030 con 0x557e826631b0 2024-05-08T07:07:34.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b01b18c0 con 0x557e8265e140 2024-05-08T07:07:34.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b01af730 con 0x557e8265d780 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6ae800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e826631b0 0x557e8267f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6ae800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e826631b0 0x557e8267f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60098/0 (socket says 172.21.15.70:60098) 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.275+0000 7fe6ae800700 1 -- 172.21.15.70:0/4257188101 learned_addr learned my addr 172.21.15.70:0/4257188101 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.276+0000 7fe6ad400700 1 --2- 172.21.15.70:0/4257188101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265e140 0x557e82661340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.276+0000 7fe6ae800700 1 -- 172.21.15.70:0/4257188101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265d780 msgr2=0x557e82673560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.276+0000 7fe6ae800700 1 --2- 172.21.15.70:0/4257188101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265d780 0x557e82673560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.276+0000 7fe6ae800700 1 -- 172.21.15.70:0/4257188101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265e140 msgr2=0x557e82661340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.276+0000 7fe6ae800700 1 --2- 172.21.15.70:0/4257188101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265e140 0x557e82661340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.276+0000 7fe6ae800700 1 -- 172.21.15.70:0/4257188101 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e82654c70 con 0x557e826631b0 2024-05-08T07:07:34.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.276+0000 7fe6ad400700 1 --2- 172.21.15.70:0/4257188101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265e140 0x557e82661340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:07:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.276+0000 7fe6ae800700 1 --2- 172.21.15.70:0/4257188101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e826631b0 0x557e8267f020 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8007a30 tx=0x7fe6a8007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522637444d55622a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.276+0000 7fe69aa00700 1 -- 172.21.15.70:0/4257188101 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8007d30 con 0x557e826631b0 2024-05-08T07:07:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.277+0000 7fe69aa00700 1 -- 172.21.15.70:0/4257188101 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a8033900 con 0x557e826631b0 2024-05-08T07:07:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.277+0000 7fe69aa00700 1 -- 172.21.15.70:0/4257188101 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a801f440 con 0x557e826631b0 2024-05-08T07:07:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.277+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/4257188101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e826631b0 msgr2=0x557e8267f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:34.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.277+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/4257188101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e826631b0 0x557e8267f020 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8007a30 tx=0x7fe6a8007a60 comp rx=0 tx=0).stop 2024-05-08T07:07:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.277+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/4257188101 shutdown_connections 2024-05-08T07:07:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.277+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/4257188101 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e826631b0 0x557e8267f020 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.277+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/4257188101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265d780 0x557e82673560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.277+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/4257188101 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e8265e140 0x557e82661340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.277+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/4257188101 >> 172.21.15.70:0/4257188101 conn(0x557e825d57d0 msgr2=0x557e82660c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.278+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/4257188101 shutdown_connections 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.278+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/4257188101 wait complete. 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.278+0000 7fe6bf9f1b80 1 -- start start 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.278+0000 7fe6bf9f1b80 1 Processor -- start 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e8266c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 0x557e8266cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6bf9f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 0x557e8266d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b01afd80 con 0x557e8265d780 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b01b11f0 con 0x557e826631b0 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6bf9f1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b01b0450 con 0x557e8265e140 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6bf9f1b80 10 client.0 _ll_register_callbacks cb 0x557e82556d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ade00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e8266c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ade00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e8266c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60102/0 (socket says 172.21.15.70:60102) 2024-05-08T07:07:34.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ade00700 1 -- 172.21.15.70:0/1457165094 learned_addr learned my addr 172.21.15.70:0/1457165094 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ad400700 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 0x557e8266cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ae800700 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 0x557e8266d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ade00700 1 -- 172.21.15.70:0/1457165094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 msgr2=0x557e8266cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ade00700 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 0x557e8266cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ade00700 1 -- 172.21.15.70:0/1457165094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 msgr2=0x557e8266d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ade00700 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 0x557e8266d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:34.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.279+0000 7fe6ade00700 1 -- 172.21.15.70:0/1457165094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e826e1d10 con 0x557e8265d780 2024-05-08T07:07:34.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.280+0000 7fe6ade00700 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e8266c8b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00a5c90 tx=0x7fe6a000a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbfa5935f241f32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:34.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.280+0000 7fe68fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:07:34.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.280+0000 7fe68fe00700 1 -- 172.21.15.70:0/1457165094 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00b24c0 con 0x557e8265d780 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.280+0000 7fe68fe00700 1 -- 172.21.15.70:0/1457165094 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7fe6a00910d0 con 0x557e8265d780 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.280+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/1457165094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a8033900 con 0x557e8265d780 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.280+0000 7fe68fe00700 1 -- 172.21.15.70:0/1457165094 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe6a00c8050 con 0x557e8265d780 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.280+0000 7fe6bf9f1b80 10 client.16080 fetch_fsmap learned FSMap version 28 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.280+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/1457165094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557e826e2f60 con 0x557e8265d780 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.281+0000 7fe68fe00700 1 -- 172.21.15.70:0/1457165094 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a8033900 con 0x557e8265d780 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.281+0000 7fe68fe00700 1 -- 172.21.15.70:0/1457165094 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fe6a00beb40 con 0x557e8265d780 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.281+0000 7fe6bf9f1b80 10 client.16080 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.281+0000 7fe6bf9f1b80 10 client.16080 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.281+0000 7fe6bf9f1b80 20 client.16080 populate_metadata read hostname 'smithi070' 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.281+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557e826e3560 0x557e826e5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.281+0000 7fe6bf9f1b80 4 client.16080 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6fa7c843", "release": true, "await": true}] 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.281+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/1457165094 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6fa7c843", "release": true, "await": true}) -- 0x557e825bd500 con 0x557e826e3560 2024-05-08T07:07:34.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.282+0000 7fe6ad400700 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557e826e3560 0x557e826e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.283+0000 7fe68fe00700 10 client.16080 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:07:34.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:34.283+0000 7fe6ad400700 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557e826e3560 0x557e826e5980 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e536eeaf5e0848d6 server_cookie=a0f9b8795197f049 in_seq=0 out_seq=0 2024-05-08T07:07:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:34 smithi070 ceph-mon[29591]: pgmap v661: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2024-05-08T07:07:34.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:34 smithi172 ceph-mon[33377]: pgmap v661: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2024-05-08T07:07:34.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:34 smithi194 ceph-mon[33679]: pgmap v661: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 5 op/s 2024-05-08T07:07:36.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.506+0000 7fe68fe00700 1 -- 172.21.15.70:0/1457165094 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x557e825bd500 con 0x557e826e3560 2024-05-08T07:07:36.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.506+0000 7fe68fe00700 10 client.16080 handle_command_reply: tid=0 2024-05-08T07:07:36.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.506+0000 7fe6bf9f1b80 1 client.16080 shutdown 2024-05-08T07:07:36.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/1457165094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 msgr2=0x557e8266c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:36.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e8266c8b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe6a00a5c90 tx=0x7fe6a000a550 comp rx=0 tx=0).stop 2024-05-08T07:07:36.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/1457165094 shutdown_connections 2024-05-08T07:07:36.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557e826e3560 0x557e826e5980 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:36.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557e826631b0 0x557e8266d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:36.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557e8265d780 0x557e8266c8b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:36.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe6bf9f1b80 1 --2- 172.21.15.70:0/1457165094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557e8265e140 0x557e8266cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:36.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/1457165094 >> 172.21.15.70:0/1457165094 conn(0x557e825d57d0 msgr2=0x557e826614c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:36.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe68fe00700 0 client.16080 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:07:36.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.507+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/1457165094 shutdown_connections 2024-05-08T07:07:36.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.508+0000 7fe6bf9f1b80 1 -- 172.21.15.70:0/1457165094 wait complete. 2024-05-08T07:07:36.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.508+0000 7fe6bf9f1b80 20 client.16080 trim_cache size 0 max 16384 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 28, 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 56, 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "6fa7c843": { 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 56, 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:07:36.508 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.9, 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:36.509 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:07:36.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.509+0000 7fe6b5000700 1 -- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6940b2a70 msgr2=0x7fe6940b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:36.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.509+0000 7fe6b5000700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6940b2a70 0x7fe6940b4f30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800b830 tx=0x7fe6a8009c80 comp rx=0 tx=0).stop 2024-05-08T07:07:36.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.509+0000 7fe6b5000700 1 -- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0105690 msgr2=0x7fe6b01a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:36.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.509+0000 7fe6b5000700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0105690 0x7fe6b01a1870 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000c970 tx=0x7fe6a000cd30 comp rx=0 tx=0).stop 2024-05-08T07:07:36.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.509+0000 7fe6b5000700 1 -- 172.21.15.70:0/769691212 shutdown_connections 2024-05-08T07:07:36.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.509+0000 7fe6b5000700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6940b2a70 0x7fe6940b4f30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:36.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.509+0000 7fe6b5000700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b010b690 0x7fe6b019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:36.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.510+0000 7fe6b5000700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b0105690 0x7fe6b01a1870 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:36.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.510+0000 7fe6b5000700 1 --2- 172.21.15.70:0/769691212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b0106050 0x7fe6b01a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:36.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.510+0000 7fe6b5000700 1 -- 172.21.15.70:0/769691212 >> 172.21.15.70:0/769691212 conn(0x7fe6b0101180 msgr2=0x7fe6b01017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:36.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.510+0000 7fe6b5000700 1 -- 172.21.15.70:0/769691212 shutdown_connections 2024-05-08T07:07:36.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:36.510+0000 7fe6b5000700 1 -- 172.21.15.70:0/769691212 wait complete. 2024-05-08T07:07:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:36 smithi070 ceph-mon[29591]: pgmap v662: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T07:07:36.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:36 smithi172 ceph-mon[33377]: pgmap v662: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T07:07:36.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:36 smithi194 ceph-mon[33679]: pgmap v662: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T07:07:37.552 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6fa7c843', seconds elapsed: 56.1 2024-05-08T07:07:37.553 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.9 2024-05-08T07:07:37.553 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:07:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:37 smithi070 ceph-mon[29591]: pgmap v663: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-05-08T07:07:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:37 smithi172 ceph-mon[33377]: pgmap v663: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-05-08T07:07:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:37 smithi194 ceph-mon[33679]: pgmap v663: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-05-08T07:07:38.006 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:07:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.525+0000 7feb65a00700 1 -- 172.21.15.70:0/871765873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 msgr2=0x7feb601169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.525+0000 7feb65a00700 1 --2- 172.21.15.70:0/871765873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 0x7feb601169a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7feb5800b0a0 tx=0x7feb5800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.525+0000 7feb65a00700 1 -- 172.21.15.70:0/871765873 shutdown_connections 2024-05-08T07:07:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.525+0000 7feb65a00700 1 --2- 172.21.15.70:0/871765873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 0x7feb601169a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.525+0000 7feb65a00700 1 --2- 172.21.15.70:0/871765873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb6010fb60 0x7feb6010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.525+0000 7feb65a00700 1 --2- 172.21.15.70:0/871765873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60109ad0 0x7feb60109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.525+0000 7feb65a00700 1 -- 172.21.15.70:0/871765873 >> 172.21.15.70:0/871765873 conn(0x7feb60076c70 msgr2=0x7feb601082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:40.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.525+0000 7feb65a00700 1 -- 172.21.15.70:0/871765873 shutdown_connections 2024-05-08T07:07:40.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.525+0000 7feb65a00700 1 -- 172.21.15.70:0/871765873 wait complete. 2024-05-08T07:07:40.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.526+0000 7feb65a00700 1 Processor -- start 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.526+0000 7feb65a00700 1 -- start start 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb65a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60109ad0 0x7feb601a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb65a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 0x7feb601a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb65a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb6010fb60 0x7feb601a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb65a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb60119b80 con 0x7feb6010a490 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb65a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb60119a00 con 0x7feb6010fb60 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb65a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feb60119d00 con 0x7feb60109ad0 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 0x7feb601a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 0x7feb601a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58338/0 (socket says 172.21.15.70:58338) 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5e000700 1 -- 172.21.15.70:0/1746263889 learned_addr learned my addr 172.21.15.70:0/1746263889 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:40.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5ea00700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60109ad0 0x7feb601a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5f400700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb6010fb60 0x7feb601a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5e000700 1 -- 172.21.15.70:0/1746263889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60109ad0 msgr2=0x7feb601a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5e000700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60109ad0 0x7feb601a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5e000700 1 -- 172.21.15.70:0/1746263889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb6010fb60 msgr2=0x7feb601a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5e000700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb6010fb60 0x7feb601a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.527+0000 7feb5e000700 1 -- 172.21.15.70:0/1746263889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb601a5030 con 0x7feb6010a490 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.528+0000 7feb5e000700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 0x7feb601a05b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00d980 tx=0x7feb4c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.528+0000 7feb57400700 1 -- 172.21.15.70:0/1746263889 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c017070 con 0x7feb6010a490 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.528+0000 7feb57400700 1 -- 172.21.15.70:0/1746263889 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb4c004830 con 0x7feb6010a490 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.528+0000 7feb57400700 1 -- 172.21.15.70:0/1746263889 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0053a0 con 0x7feb6010a490 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.528+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb601a5320 con 0x7feb6010a490 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.528+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb601acba0 con 0x7feb6010a490 2024-05-08T07:07:40.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.529+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb6006a190 con 0x7feb6010a490 2024-05-08T07:07:40.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.535+0000 7feb57400700 1 -- 172.21.15.70:0/1746263889 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7feb4c0049e0 con 0x7feb6010a490 2024-05-08T07:07:40.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.536+0000 7feb57400700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb440b2a70 0x7feb440b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:40.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.536+0000 7feb57400700 1 -- 172.21.15.70:0/1746263889 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7feb4c0e2d60 con 0x7feb6010a490 2024-05-08T07:07:40.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.537+0000 7feb5ea00700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb440b2a70 0x7feb440b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:40.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.537+0000 7feb5ea00700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb440b2a70 0x7feb440b4f30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feb50005950 tx=0x7feb500058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:40.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.538+0000 7feb57400700 1 -- 172.21.15.70:0/1746263889 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feb4c020020 con 0x7feb6010a490 2024-05-08T07:07:40.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:40 smithi070 ceph-mon[29591]: pgmap v664: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 257 KiB/s wr, 14 op/s 2024-05-08T07:07:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:40 smithi172 ceph-mon[33377]: pgmap v664: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 257 KiB/s wr, 14 op/s 2024-05-08T07:07:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:40 smithi194 ceph-mon[33679]: pgmap v664: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 257 KiB/s wr, 14 op/s 2024-05-08T07:07:40.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.823+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb6002e510 con 0x7feb6010a490 2024-05-08T07:07:40.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.826+0000 7feb57400700 1 -- 172.21.15.70:0/1746263889 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11879 (secure 0 0 0) 0x7feb4c0aa3a0 con 0x7feb6010a490 2024-05-08T07:07:40.825 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:07:40.825 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T06:49:30.638320+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:07:40.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb440b2a70 msgr2=0x7feb440b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:40.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb440b2a70 0x7feb440b4f30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feb50005950 tx=0x7feb500058e0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 msgr2=0x7feb601a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 0x7feb601a05b0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00d980 tx=0x7feb4c00dd40 comp rx=0 tx=0).stop 2024-05-08T07:07:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 shutdown_connections 2024-05-08T07:07:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb440b2a70 0x7feb440b4f30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb6010fb60 0x7feb601a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60109ad0 0x7feb601a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 --2- 172.21.15.70:0/1746263889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb6010a490 0x7feb601a05b0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 >> 172.21.15.70:0/1746263889 conn(0x7feb60076c70 msgr2=0x7feb600772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.829+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 shutdown_connections 2024-05-08T07:07:40.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:40.830+0000 7feb65a00700 1 -- 172.21.15.70:0/1746263889 wait complete. 2024-05-08T07:07:40.830 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-05-08T07:07:41.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:41 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1746263889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:07:41.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:41 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1746263889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:07:41.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:41 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1746263889' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:07:41.923 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 84.9 --await-for 42.0' 2024-05-08T07:07:41.923 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 84.9 --await-for 42.0 2024-05-08T07:07:42.425 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:07:42.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:42 smithi194 ceph-mon[33679]: pgmap v665: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 257 KiB/s wr, 12 op/s 2024-05-08T07:07:42.576 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:42 smithi070 ceph-mon[29591]: pgmap v665: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 257 KiB/s wr, 12 op/s 2024-05-08T07:07:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:42 smithi172 ceph-mon[33377]: pgmap v665: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 257 KiB/s wr, 12 op/s 2024-05-08T07:07:43.590 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:43 smithi070 ceph-mon[29591]: pgmap v666: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 257 KiB/s wr, 12 op/s 2024-05-08T07:07:43.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:43 smithi172 ceph-mon[33377]: pgmap v666: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 257 KiB/s wr, 12 op/s 2024-05-08T07:07:43.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:43 smithi194 ceph-mon[33679]: pgmap v666: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 257 KiB/s wr, 12 op/s 2024-05-08T07:07:44.587 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:44 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:07:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:44 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:07:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:44 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:07:44.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.947+0000 7ffa5de00700 1 -- 172.21.15.70:0/2298023136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 msgr2=0x7ffa58108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:44.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.947+0000 7ffa5de00700 1 --2- 172.21.15.70:0/2298023136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 0x7ffa58108130 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ffa400099c0 tx=0x7ffa40009cd0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.948+0000 7ffa5de00700 1 -- 172.21.15.70:0/2298023136 shutdown_connections 2024-05-08T07:07:44.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.948+0000 7ffa5de00700 1 --2- 172.21.15.70:0/2298023136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa58108860 0x7ffa581103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.948+0000 7ffa5de00700 1 --2- 172.21.15.70:0/2298023136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa5806b3e0 0x7ffa5806b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.948+0000 7ffa5de00700 1 --2- 172.21.15.70:0/2298023136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 0x7ffa58108130 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.948+0000 7ffa5de00700 1 -- 172.21.15.70:0/2298023136 >> 172.21.15.70:0/2298023136 conn(0x7ffa58079340 msgr2=0x7ffa58079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:44.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.948+0000 7ffa5de00700 1 -- 172.21.15.70:0/2298023136 shutdown_connections 2024-05-08T07:07:44.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.948+0000 7ffa5de00700 1 -- 172.21.15.70:0/2298023136 wait complete. 2024-05-08T07:07:44.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.949+0000 7ffa5de00700 1 Processor -- start 2024-05-08T07:07:44.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.949+0000 7ffa5de00700 1 -- start start 2024-05-08T07:07:44.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa5de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa5806b3e0 0x7ffa581a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa5de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 0x7ffa581a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa5de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa58108860 0x7ffa5819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa5de00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa58113540 con 0x7ffa5806bd90 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa5de00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa581133c0 con 0x7ffa5806b3e0 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa5de00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa581136c0 con 0x7ffa58108860 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa4e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 0x7ffa581a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa4e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 0x7ffa581a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58350/0 (socket says 172.21.15.70:58350) 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa4e000700 1 -- 172.21.15.70:0/46507616 learned_addr learned my addr 172.21.15.70:0/46507616 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa56a00700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa5806b3e0 0x7ffa581a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.950+0000 7ffa57400700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa58108860 0x7ffa5819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.951+0000 7ffa4e000700 1 -- 172.21.15.70:0/46507616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa58108860 msgr2=0x7ffa5819b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.951+0000 7ffa4e000700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa58108860 0x7ffa5819b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.951+0000 7ffa4e000700 1 -- 172.21.15.70:0/46507616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa5806b3e0 msgr2=0x7ffa581a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.951+0000 7ffa4e000700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa5806b3e0 0x7ffa581a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.951+0000 7ffa4e000700 1 -- 172.21.15.70:0/46507616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa5819c070 con 0x7ffa5806bd90 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.951+0000 7ffa4e000700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 0x7ffa581a1c90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000b580 tx=0x7ffa4000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.952+0000 7ffa5ca00700 1 -- 172.21.15.70:0/46507616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40026070 con 0x7ffa5806bd90 2024-05-08T07:07:44.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.952+0000 7ffa5ca00700 1 -- 172.21.15.70:0/46507616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa40005030 con 0x7ffa5806bd90 2024-05-08T07:07:44.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.952+0000 7ffa5de00700 1 -- 172.21.15.70:0/46507616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5819c300 con 0x7ffa5806bd90 2024-05-08T07:07:44.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.952+0000 7ffa5ca00700 1 -- 172.21.15.70:0/46507616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40004b00 con 0x7ffa5806bd90 2024-05-08T07:07:44.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.952+0000 7ffa5de00700 1 -- 172.21.15.70:0/46507616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa581a8620 con 0x7ffa5806bd90 2024-05-08T07:07:44.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.956+0000 7ffa5ca00700 1 -- 172.21.15.70:0/46507616 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ffa40029070 con 0x7ffa5806bd90 2024-05-08T07:07:44.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.957+0000 7ffa6878bb80 1 Processor -- start 2024-05-08T07:07:44.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa6878bb80 1 -- start start 2024-05-08T07:07:44.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa5ca00700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa3c0b2aa0 0x7ffa3c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb67330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 0x55afbfb619a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 0x55afbfb6dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55afbfab3bb0 con 0x55afbfb66f50 2024-05-08T07:07:44.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55afbfa518f0 con 0x55afbfb61ee0 2024-05-08T07:07:44.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55afbfaafb70 con 0x55afbfb61520 2024-05-08T07:07:44.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa5ca00700 1 -- 172.21.15.70:0/46507616 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7ffa400e3570 con 0x7ffa5806bd90 2024-05-08T07:07:44.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa56a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb67330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa57400700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa3c0b2aa0 0x7ffa3c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa56a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb67330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58354/0 (socket says 172.21.15.70:58354) 2024-05-08T07:07:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.958+0000 7ffa56a00700 1 -- 172.21.15.70:0/3672643275 learned_addr learned my addr 172.21.15.70:0/3672643275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.959+0000 7ffa57400700 1 --2- 172.21.15.70:0/3672643275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 0x55afbfb6dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.959+0000 7ffa56a00700 1 -- 172.21.15.70:0/3672643275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 msgr2=0x55afbfb619a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.959+0000 7ffa56a00700 1 --2- 172.21.15.70:0/3672643275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 0x55afbfb619a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.959+0000 7ffa56a00700 1 -- 172.21.15.70:0/3672643275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 msgr2=0x55afbfb6dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.959+0000 7ffa56a00700 1 --2- 172.21.15.70:0/3672643275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 0x55afbfb6dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.959+0000 7ffa56a00700 1 -- 172.21.15.70:0/3672643275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbfa00a60 con 0x55afbfb66f50 2024-05-08T07:07:44.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.959+0000 7ffa57400700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa3c0b2aa0 0x7ffa3c0b4f60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa50013460 tx=0x7ffa50013820 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:44.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.959+0000 7ffa56a00700 1 --2- 172.21.15.70:0/3672643275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb67330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800e1e0 tx=0x7ffa4800e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c3f1230d0b576b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:44.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.960+0000 7ffa4cc00700 1 -- 172.21.15.70:0/3672643275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4800ed70 con 0x55afbfb66f50 2024-05-08T07:07:44.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.960+0000 7ffa4cc00700 1 -- 172.21.15.70:0/3672643275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa48018070 con 0x55afbfb66f50 2024-05-08T07:07:44.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.960+0000 7ffa4cc00700 1 -- 172.21.15.70:0/3672643275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa480125e0 con 0x55afbfb66f50 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3672643275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 msgr2=0x55afbfb67330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3672643275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb67330 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800e1e0 tx=0x7ffa4800e4f0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3672643275 shutdown_connections 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3672643275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 0x55afbfb6dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3672643275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb67330 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3672643275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 0x55afbfb619a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3672643275 >> 172.21.15.70:0/3672643275 conn(0x55afbfa8fcf0 msgr2=0x55afbfb5be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3672643275 shutdown_connections 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3672643275 wait complete. 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.961+0000 7ffa6878bb80 1 -- start start 2024-05-08T07:07:44.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.962+0000 7ffa6878bb80 1 Processor -- start 2024-05-08T07:07:44.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.962+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61520 0x55afbfb6d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.962+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61ee0 0x55afbfb6ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.962+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb66f50 0x55afbfb6b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.962+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55afbfb6e310 con 0x55afbfb61ee0 2024-05-08T07:07:44.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.962+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55afbfa19cb0 con 0x55afbfb61520 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.962+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55afbfb6e490 con 0x55afbfb66f50 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.962+0000 7ffa6878bb80 10 client.0 _ll_register_callbacks cb 0x55afbfa5ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa4e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61ee0 0x55afbfb6ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa4e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61ee0 0x55afbfb6ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58360/0 (socket says 172.21.15.70:58360) 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa4e000700 1 -- 172.21.15.70:0/3821913563 learned_addr learned my addr 172.21.15.70:0/3821913563 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa56a00700 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61520 0x55afbfb6d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa57400700 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb66f50 0x55afbfb6b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa4e000700 1 -- 172.21.15.70:0/3821913563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb66f50 msgr2=0x55afbfb6b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa4e000700 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb66f50 0x55afbfb6b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa4e000700 1 -- 172.21.15.70:0/3821913563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61520 msgr2=0x55afbfb6d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa4e000700 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61520 0x55afbfb6d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.963+0000 7ffa4e000700 1 -- 172.21.15.70:0/3821913563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afbfa795b0 con 0x55afbfb61ee0 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.964+0000 7ffa4e000700 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61ee0 0x55afbfb6ad80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ffa400a64e0 tx=0x7ffa40004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e9b4773aead8a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:44.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.964+0000 7ffa45600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:07:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.964+0000 7ffa45600700 1 -- 172.21.15.70:0/3821913563 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa400aa460 con 0x55afbfb61ee0 2024-05-08T07:07:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.964+0000 7ffa45600700 1 -- 172.21.15.70:0/3821913563 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7ffa400e31b0 con 0x55afbfb61ee0 2024-05-08T07:07:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.964+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3821913563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa48018070 con 0x55afbfb61ee0 2024-05-08T07:07:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.964+0000 7ffa45600700 1 -- 172.21.15.70:0/3821913563 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffa400ae810 con 0x55afbfb61ee0 2024-05-08T07:07:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.964+0000 7ffa6878bb80 10 client.16098 fetch_fsmap learned FSMap version 29 2024-05-08T07:07:44.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.964+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3821913563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55afbfb78be0 con 0x55afbfb61ee0 2024-05-08T07:07:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.965+0000 7ffa45600700 1 -- 172.21.15.70:0/3821913563 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa48018070 con 0x55afbfb61ee0 2024-05-08T07:07:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.965+0000 7ffa45600700 1 -- 172.21.15.70:0/3821913563 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7ffa400b2da0 con 0x55afbfb61ee0 2024-05-08T07:07:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.965+0000 7ffa6878bb80 10 client.16098 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T07:07:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.965+0000 7ffa6878bb80 10 client.16098 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:07:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.965+0000 7ffa6878bb80 20 client.16098 populate_metadata read hostname 'smithi070' 2024-05-08T07:07:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.965+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55afbfb7b150 0x55afbfb7d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.965+0000 7ffa6878bb80 4 client.16098 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:07:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.965+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3821913563 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55afbfb2e230 con 0x55afbfb7b150 2024-05-08T07:07:44.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.966+0000 7ffa56a00700 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55afbfb7b150 0x55afbfb7d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:44.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.968+0000 7ffa56a00700 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55afbfb7b150 0x55afbfb7d570 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b683beefacccc9c8 server_cookie=db613ad72b3aba50 in_seq=0 out_seq=0 2024-05-08T07:07:44.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.968+0000 7ffa45600700 10 client.16098 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:07:44.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.970+0000 7ffa45600700 1 -- 172.21.15.70:0/3821913563 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55afbfb2e230 con 0x55afbfb7b150 2024-05-08T07:07:44.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.970+0000 7ffa45600700 10 client.16098 handle_command_reply: tid=0 2024-05-08T07:07:44.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.970+0000 7ffa6878bb80 1 client.16098 shutdown 2024-05-08T07:07:44.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.970+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3821913563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61ee0 msgr2=0x55afbfb6ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:44.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.970+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61ee0 0x55afbfb6ad80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ffa400a64e0 tx=0x7ffa40004cc0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.971+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3821913563 shutdown_connections 2024-05-08T07:07:44.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.971+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55afbfb7b150 0x55afbfb7d570 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.971+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb66f50 0x55afbfb6b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.971+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61520 0x55afbfb6d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.971+0000 7ffa45600700 0 client.16098 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:07:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.971+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3821913563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61ee0 0x55afbfb6ad80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.971+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3821913563 >> 172.21.15.70:0/3821913563 conn(0x55afbfa8fcf0 msgr2=0x55afbfb568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.971+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3821913563 shutdown_connections 2024-05-08T07:07:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.972+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3821913563 wait complete. 2024-05-08T07:07:44.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.972+0000 7ffa6878bb80 20 client.16098 trim_cache size 0 max 16384 2024-05-08T07:07:44.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.999+0000 7ffa6878bb80 1 Processor -- start 2024-05-08T07:07:44.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.999+0000 7ffa6878bb80 1 -- start start 2024-05-08T07:07:44.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:44.999+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61520 0x55afbfb77360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.000+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61ee0 0x55afbfb60c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.000+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb66f50 0x55afbfb82e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:44.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.000+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa581b3d60 con 0x55afbfb61520 2024-05-08T07:07:44.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.000+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa581b15c0 con 0x55afbfb66f50 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.000+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa581af430 con 0x55afbfb61ee0 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.000+0000 7ffa56a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61520 0x55afbfb77360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.000+0000 7ffa56a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61520 0x55afbfb77360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58368/0 (socket says 172.21.15.70:58368) 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.000+0000 7ffa56a00700 1 -- 172.21.15.70:0/1896110310 learned_addr learned my addr 172.21.15.70:0/1896110310 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.000+0000 7ffa4e000700 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61ee0 0x55afbfb60c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.001+0000 7ffa57400700 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb66f50 0x55afbfb82e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.001+0000 7ffa56a00700 1 -- 172.21.15.70:0/1896110310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61ee0 msgr2=0x55afbfb60c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.001+0000 7ffa56a00700 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61ee0 0x55afbfb60c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.001+0000 7ffa56a00700 1 -- 172.21.15.70:0/1896110310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb66f50 msgr2=0x55afbfb82e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.001+0000 7ffa56a00700 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb66f50 0x55afbfb82e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.001+0000 7ffa56a00700 1 -- 172.21.15.70:0/1896110310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55afbfb54450 con 0x55afbfb61520 2024-05-08T07:07:45.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.001+0000 7ffa57400700 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb66f50 0x55afbfb82e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:07:45.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.001+0000 7ffa56a00700 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61520 0x55afbfb77360 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009010 tx=0x7ffa48006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99378e8337fee538 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:45.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.001+0000 7ffa47e00700 1 -- 172.21.15.70:0/1896110310 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48007b50 con 0x55afbfb61520 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.002+0000 7ffa47e00700 1 -- 172.21.15.70:0/1896110310 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa48018070 con 0x55afbfb61520 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.002+0000 7ffa47e00700 1 -- 172.21.15.70:0/1896110310 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48026930 con 0x55afbfb61520 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 -- 172.21.15.70:0/1896110310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61520 msgr2=0x55afbfb77360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61520 0x55afbfb77360 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009010 tx=0x7ffa48006000 comp rx=0 tx=0).stop 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 -- 172.21.15.70:0/1896110310 shutdown_connections 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb66f50 0x55afbfb82e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb61520 0x55afbfb77360 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/1896110310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61ee0 0x55afbfb60c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 -- 172.21.15.70:0/1896110310 >> 172.21.15.70:0/1896110310 conn(0x55afbfa8fcf0 msgr2=0x55afbfb60510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 -- 172.21.15.70:0/1896110310 shutdown_connections 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 -- 172.21.15.70:0/1896110310 wait complete. 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.003+0000 7ffa6878bb80 1 -- start start 2024-05-08T07:07:45.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.004+0000 7ffa6878bb80 1 Processor -- start 2024-05-08T07:07:45.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.004+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 0x55afbfb706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.004+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 0x55afbfb70bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.004+0000 7ffa6878bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb71130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.004+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa581afa80 con 0x55afbfb66f50 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.004+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa581b0ef0 con 0x55afbfb61ee0 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.004+0000 7ffa6878bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa581b0150 con 0x55afbfb61520 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.004+0000 7ffa6878bb80 10 client.0 _ll_register_callbacks cb 0x55afbfa5ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.005+0000 7ffa4e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 0x55afbfb70bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.005+0000 7ffa56a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 0x55afbfb706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.005+0000 7ffa56a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 0x55afbfb706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:54666/0 (socket says 172.21.15.70:54666) 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.005+0000 7ffa57400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb71130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:45.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.005+0000 7ffa56a00700 1 -- 172.21.15.70:0/3088206836 learned_addr learned my addr 172.21.15.70:0/3088206836 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:07:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa57400700 1 -- 172.21.15.70:0/3088206836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 msgr2=0x55afbfb706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa57400700 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 0x55afbfb706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa57400700 1 -- 172.21.15.70:0/3088206836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 msgr2=0x55afbfb70bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:07:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa57400700 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 0x55afbfb70bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:45.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa57400700 1 -- 172.21.15.70:0/3088206836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55afbfbe5a30 con 0x55afbfb66f50 2024-05-08T07:07:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa57400700 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb71130 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ffa50020b60 tx=0x7ffa500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a3571bcccc41fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:07:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa45600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:07:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa45600700 1 -- 172.21.15.70:0/3088206836 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50004220 con 0x55afbfb66f50 2024-05-08T07:07:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa45600700 1 -- 172.21.15.70:0/3088206836 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 9583+0+0 (secure 0 0 0) 0x7ffa500043c0 con 0x55afbfb66f50 2024-05-08T07:07:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.006+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3088206836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa48018070 con 0x55afbfb66f50 2024-05-08T07:07:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.007+0000 7ffa45600700 1 -- 172.21.15.70:0/3088206836 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ffa50032050 con 0x55afbfb66f50 2024-05-08T07:07:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.007+0000 7ffa6878bb80 10 client.16104 fetch_fsmap learned FSMap version 29 2024-05-08T07:07:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.007+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3088206836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55afbfbe6c60 con 0x55afbfb66f50 2024-05-08T07:07:45.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.007+0000 7ffa45600700 1 -- 172.21.15.70:0/3088206836 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa48018070 con 0x55afbfb66f50 2024-05-08T07:07:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.008+0000 7ffa45600700 1 -- 172.21.15.70:0/3088206836 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8358+0+0 (secure 0 0 0) 0x7ffa50027030 con 0x55afbfb66f50 2024-05-08T07:07:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.008+0000 7ffa6878bb80 10 client.16104 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T07:07:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.008+0000 7ffa6878bb80 10 client.16104 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:07:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.008+0000 7ffa6878bb80 20 client.16104 populate_metadata read hostname 'smithi070' 2024-05-08T07:07:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.008+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55afbfbe7410 0x55afbfbe9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:07:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.008+0000 7ffa6878bb80 4 client.16104 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.9, "await_for": 42.0}] 2024-05-08T07:07:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.008+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3088206836 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.9, "await_for": 42.0}) -- 0x55afbfac1590 con 0x55afbfbe7410 2024-05-08T07:07:45.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.009+0000 7ffa56a00700 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55afbfbe7410 0x55afbfbe9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:07:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.010+0000 7ffa56a00700 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55afbfbe7410 0x55afbfbe9830 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79e8a60cca3a6c0d server_cookie=f25a44483f0ca130 in_seq=0 out_seq=0 2024-05-08T07:07:45.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:45.010+0000 7ffa45600700 10 client.16104 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:07:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:45 smithi172 ceph-mon[33377]: pgmap v667: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 623 KiB/s wr, 33 op/s 2024-05-08T07:07:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:45 smithi194 ceph-mon[33679]: pgmap v667: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 623 KiB/s wr, 33 op/s 2024-05-08T07:07:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:45 smithi070 ceph-mon[29591]: pgmap v667: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 623 KiB/s wr, 33 op/s 2024-05-08T07:07:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:48 smithi070 ceph-mon[29591]: pgmap v668: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 616 KiB/s wr, 31 op/s 2024-05-08T07:07:48.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:48 smithi172 ceph-mon[33377]: pgmap v668: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 616 KiB/s wr, 31 op/s 2024-05-08T07:07:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:48 smithi194 ceph-mon[33679]: pgmap v668: 129 pgs: 129 active+clean; 1.1 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 616 KiB/s wr, 31 op/s 2024-05-08T07:07:49.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:49 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:07:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:49 smithi172 ceph-mon[33377]: pgmap v669: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 811 KiB/s wr, 69 op/s 2024-05-08T07:07:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:49 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:07:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:49 smithi194 ceph-mon[33679]: pgmap v669: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 811 KiB/s wr, 69 op/s 2024-05-08T07:07:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:49 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:07:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:49 smithi070 ceph-mon[29591]: pgmap v669: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 811 KiB/s wr, 69 op/s 2024-05-08T07:07:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:52 smithi070 ceph-mon[29591]: pgmap v670: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 561 KiB/s wr, 59 op/s 2024-05-08T07:07:52.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:52 smithi172 ceph-mon[33377]: pgmap v670: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 561 KiB/s wr, 59 op/s 2024-05-08T07:07:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:52 smithi194 ceph-mon[33679]: pgmap v670: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 561 KiB/s wr, 59 op/s 2024-05-08T07:07:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:53 smithi194 ceph-mon[33679]: pgmap v671: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 561 KiB/s wr, 59 op/s 2024-05-08T07:07:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:53 smithi172 ceph-mon[33377]: pgmap v671: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 561 KiB/s wr, 59 op/s 2024-05-08T07:07:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:53 smithi070 ceph-mon[29591]: pgmap v671: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 561 KiB/s wr, 59 op/s 2024-05-08T07:07:55.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:55 smithi172 ceph-mon[33377]: pgmap v672: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 578 KiB/s wr, 63 op/s 2024-05-08T07:07:55.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.709+0000 7ffa45600700 1 -- 172.21.15.70:0/3088206836 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55afbfac1590 con 0x55afbfbe7410 2024-05-08T07:07:55.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.709+0000 7ffa45600700 10 client.16104 handle_command_reply: tid=0 2024-05-08T07:07:55.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.709+0000 7ffa6878bb80 1 client.16104 shutdown 2024-05-08T07:07:55.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:55 smithi070 ceph-mon[29591]: pgmap v672: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 578 KiB/s wr, 63 op/s 2024-05-08T07:07:55.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.710+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3088206836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 msgr2=0x55afbfb71130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:55.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.710+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb71130 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ffa50020b60 tx=0x7ffa500047c0 comp rx=0 tx=0).stop 2024-05-08T07:07:55.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.710+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3088206836 shutdown_connections 2024-05-08T07:07:55.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.710+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55afbfbe7410 0x55afbfbe9830 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:55.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.710+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55afbfb66f50 0x55afbfb71130 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:55.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.710+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55afbfb61520 0x55afbfb706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:55.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.710+0000 7ffa6878bb80 1 --2- 172.21.15.70:0/3088206836 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55afbfb61ee0 0x55afbfb70bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:55.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.710+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3088206836 >> 172.21.15.70:0/3088206836 conn(0x55afbfa8fcf0 msgr2=0x55afbfb568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:55.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.710+0000 7ffa45600700 0 client.16104 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:07:55.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.711+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3088206836 shutdown_connections 2024-05-08T07:07:55.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.711+0000 7ffa6878bb80 1 -- 172.21.15.70:0/3088206836 wait complete. 2024-05-08T07:07:55.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.711+0000 7ffa6878bb80 20 client.16104 trim_cache size 0 max 16384 2024-05-08T07:07:55.714 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:07:55.715 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 30, 2024-05-08T07:07:55.715 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:07:55.715 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 58, 2024-05-08T07:07:55.715 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:07:55.715 INFO:teuthology.orchestra.run.smithi070.stdout: "65cae4de": { 2024-05-08T07:07:55.715 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 58, 2024-05-08T07:07:55.715 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:07:55.716 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:07:55.716 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:07:55.716 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:07:55.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:07:55.716 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:07:55.716 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.9, 2024-05-08T07:07:55.716 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:07:55.717 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:07:55.717 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:07:55.717 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:07:55.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:07:55.717 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:07:55.717 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:55.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:55.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:55.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:55.718 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:07:55.719 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:07:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.712+0000 7ffa5de00700 1 -- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa3c0b2aa0 msgr2=0x7ffa3c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.712+0000 7ffa5de00700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa3c0b2aa0 0x7ffa3c0b4f60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa50013460 tx=0x7ffa50013820 comp rx=0 tx=0).stop 2024-05-08T07:07:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.712+0000 7ffa5de00700 1 -- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 msgr2=0x7ffa581a1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:07:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.712+0000 7ffa5de00700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 0x7ffa581a1c90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ffa4000b580 tx=0x7ffa4000f690 comp rx=0 tx=0).stop 2024-05-08T07:07:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.713+0000 7ffa5de00700 1 -- 172.21.15.70:0/46507616 shutdown_connections 2024-05-08T07:07:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.713+0000 7ffa5de00700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa3c0b2aa0 0x7ffa3c0b4f60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.713+0000 7ffa5de00700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa58108860 0x7ffa5819b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.713+0000 7ffa5de00700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa5806b3e0 0x7ffa581a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.713+0000 7ffa5de00700 1 --2- 172.21.15.70:0/46507616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa5806bd90 0x7ffa581a1c90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:07:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.713+0000 7ffa5de00700 1 -- 172.21.15.70:0/46507616 >> 172.21.15.70:0/46507616 conn(0x7ffa58079340 msgr2=0x7ffa5810e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:07:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.713+0000 7ffa5de00700 1 -- 172.21.15.70:0/46507616 shutdown_connections 2024-05-08T07:07:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:07:55.713+0000 7ffa5de00700 1 -- 172.21.15.70:0/46507616 wait complete. 2024-05-08T07:07:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:55 smithi194 ceph-mon[33679]: pgmap v672: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 578 KiB/s wr, 63 op/s 2024-05-08T07:07:56.833 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '65cae4de', quiesce took 19.3 seconds. Will release after: 24.9 2024-05-08T07:07:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:57 smithi172 ceph-mon[33377]: pgmap v673: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 212 KiB/s wr, 41 op/s 2024-05-08T07:07:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:57 smithi194 ceph-mon[33679]: pgmap v673: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 212 KiB/s wr, 41 op/s 2024-05-08T07:07:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:57 smithi070 ceph-mon[29591]: pgmap v673: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 212 KiB/s wr, 41 op/s 2024-05-08T07:07:59.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:07:59 smithi172 ceph-mon[33377]: pgmap v674: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 220 KiB/s wr, 44 op/s 2024-05-08T07:07:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:07:59 smithi194 ceph-mon[33679]: pgmap v674: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 220 KiB/s wr, 44 op/s 2024-05-08T07:07:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:07:59 smithi070 ceph-mon[29591]: pgmap v674: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 220 KiB/s wr, 44 op/s 2024-05-08T07:08:01.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:01 smithi172 ceph-mon[33377]: pgmap v675: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:08:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:01 smithi194 ceph-mon[33679]: pgmap v675: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:08:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:01 smithi070 ceph-mon[29591]: pgmap v675: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:08:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:03 smithi172 ceph-mon[33377]: pgmap v676: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:08:03.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:03 smithi070 ceph-mon[29591]: pgmap v676: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:08:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:03 smithi194 ceph-mon[33679]: pgmap v676: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:08:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:05 smithi172 ceph-mon[33377]: pgmap v677: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 70 KiB/s wr, 26 op/s 2024-05-08T07:08:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:05 smithi194 ceph-mon[33679]: pgmap v677: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 70 KiB/s wr, 26 op/s 2024-05-08T07:08:05.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:05 smithi070 ceph-mon[29591]: pgmap v677: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 70 KiB/s wr, 26 op/s 2024-05-08T07:08:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:07 smithi172 ceph-mon[33377]: pgmap v678: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-05-08T07:08:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:07 smithi172 ceph-mon[33377]: osdmap e122: 12 total, 12 up, 12 in 2024-05-08T07:08:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:07 smithi194 ceph-mon[33679]: pgmap v678: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-05-08T07:08:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:07 smithi194 ceph-mon[33679]: osdmap e122: 12 total, 12 up, 12 in 2024-05-08T07:08:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:07 smithi070 ceph-mon[29591]: pgmap v678: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 53 KiB/s wr, 23 op/s 2024-05-08T07:08:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:07 smithi070 ceph-mon[29591]: osdmap e122: 12 total, 12 up, 12 in 2024-05-08T07:08:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:09 smithi172 ceph-mon[33377]: pgmap v680: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T07:08:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:09 smithi194 ceph-mon[33679]: pgmap v680: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T07:08:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:09 smithi070 ceph-mon[29591]: pgmap v680: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T07:08:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:11 smithi172 ceph-mon[33377]: pgmap v681: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T07:08:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:11 smithi194 ceph-mon[33679]: pgmap v681: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T07:08:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:11 smithi070 ceph-mon[29591]: pgmap v681: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T07:08:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:13 smithi194 ceph-mon[33679]: osdmap e123: 12 total, 12 up, 12 in 2024-05-08T07:08:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:13 smithi194 ceph-mon[33679]: pgmap v683: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T07:08:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:13 smithi070 ceph-mon[29591]: osdmap e123: 12 total, 12 up, 12 in 2024-05-08T07:08:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:13 smithi070 ceph-mon[29591]: pgmap v683: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T07:08:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:13 smithi172 ceph-mon[33377]: osdmap e123: 12 total, 12 up, 12 in 2024-05-08T07:08:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:13 smithi172 ceph-mon[33377]: pgmap v683: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T07:08:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:15 smithi172 ceph-mon[33377]: pgmap v684: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s 2024-05-08T07:08:15.741 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:15 smithi070 ceph-mon[29591]: pgmap v684: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s 2024-05-08T07:08:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:15 smithi194 ceph-mon[33679]: pgmap v684: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s 2024-05-08T07:08:17.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:17 smithi172 ceph-mon[33377]: pgmap v685: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 309 B/s wr, 6 op/s 2024-05-08T07:08:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:17 smithi194 ceph-mon[33679]: pgmap v685: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 309 B/s wr, 6 op/s 2024-05-08T07:08:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:17 smithi070 ceph-mon[29591]: pgmap v685: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 309 B/s wr, 6 op/s 2024-05-08T07:08:19.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:19 smithi172 ceph-mon[33377]: pgmap v686: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-05-08T07:08:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:19 smithi194 ceph-mon[33679]: pgmap v686: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-05-08T07:08:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:19 smithi070 ceph-mon[29591]: pgmap v686: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-05-08T07:08:21.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:21 smithi172 ceph-mon[33377]: pgmap v687: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-05-08T07:08:21.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:08:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:21 smithi194 ceph-mon[33679]: pgmap v687: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-05-08T07:08:21.814 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:21 smithi070 ceph-mon[29591]: pgmap v687: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 5 op/s 2024-05-08T07:08:22.192 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:08:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:23 smithi070 ceph-mon[29591]: pgmap v688: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-05-08T07:08:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:23 smithi172 ceph-mon[33377]: pgmap v688: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-05-08T07:08:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:23 smithi194 ceph-mon[33679]: pgmap v688: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2024-05-08T07:08:24.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.713+0000 7f3b2dc00700 1 -- 172.21.15.70:0/317798046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2806c360 msgr2=0x7f3b2810fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:24.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.713+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/317798046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2806c360 0x7f3b2810fa00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009990 tx=0x7f3b14009ca0 comp rx=0 tx=0).stop 2024-05-08T07:08:24.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.713+0000 7f3b2dc00700 1 -- 172.21.15.70:0/317798046 shutdown_connections 2024-05-08T07:08:24.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.713+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/317798046 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2810ff40 0x7f3b28112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:24.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.713+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/317798046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2806ba40 0x7f3b2806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:24.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.713+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/317798046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2806c360 0x7f3b2810fa00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:24.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.713+0000 7f3b2dc00700 1 -- 172.21.15.70:0/317798046 >> 172.21.15.70:0/317798046 conn(0x7f3b28079310 msgr2=0x7f3b28079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:08:24.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.713+0000 7f3b2dc00700 1 -- 172.21.15.70:0/317798046 shutdown_connections 2024-05-08T07:08:24.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.713+0000 7f3b2dc00700 1 -- 172.21.15.70:0/317798046 wait complete. 2024-05-08T07:08:24.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.714+0000 7f3b2dc00700 1 Processor -- start 2024-05-08T07:08:24.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.714+0000 7f3b2dc00700 1 -- start start 2024-05-08T07:08:24.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.715+0000 7f3b2dc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2806ba40 0x7f3b281a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.715+0000 7f3b2dc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2806c360 0x7f3b281a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.715+0000 7f3b2dc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2810ff40 0x7f3b2819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.715+0000 7f3b2dc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b28115720 con 0x7f3b2810ff40 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.715+0000 7f3b2dc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b281155a0 con 0x7f3b2806c360 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.715+0000 7f3b2dc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3b281158a0 con 0x7f3b2806ba40 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.715+0000 7f3b27400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2810ff40 0x7f3b2819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b27400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2810ff40 0x7f3b2819baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42956/0 (socket says 172.21.15.70:42956) 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b27400700 1 -- 172.21.15.70:0/2400699464 learned_addr learned my addr 172.21.15.70:0/2400699464 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b26000700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2806c360 0x7f3b281a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:24.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b26a00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2806ba40 0x7f3b281a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:24.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b27400700 1 -- 172.21.15.70:0/2400699464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2806ba40 msgr2=0x7f3b281a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:24.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b27400700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2806ba40 0x7f3b281a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:24.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b27400700 1 -- 172.21.15.70:0/2400699464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2806c360 msgr2=0x7f3b281a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b27400700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2806c360 0x7f3b281a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b27400700 1 -- 172.21.15.70:0/2400699464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b2819c200 con 0x7f3b2810ff40 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b26a00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2806ba40 0x7f3b281a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b26000700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2806c360 0x7f3b281a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.716+0000 7f3b27400700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2810ff40 0x7f3b2819baa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3b20007d40 tx=0x7f3b2000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.717+0000 7f3b1f400700 1 -- 172.21.15.70:0/2400699464 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b20016020 con 0x7f3b2810ff40 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.717+0000 7f3b1f400700 1 -- 172.21.15.70:0/2400699464 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b2000ad40 con 0x7f3b2810ff40 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.717+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b2819c4f0 con 0x7f3b2810ff40 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.717+0000 7f3b1f400700 1 -- 172.21.15.70:0/2400699464 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b200115e0 con 0x7f3b2810ff40 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.717+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b281a87b0 con 0x7f3b2810ff40 2024-05-08T07:08:24.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.718+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b2806a190 con 0x7f3b2810ff40 2024-05-08T07:08:24.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.722+0000 7f3b1f400700 1 -- 172.21.15.70:0/2400699464 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3b20019020 con 0x7f3b2810ff40 2024-05-08T07:08:24.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.724+0000 7f3b1f400700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b0c0b2a70 0x7f3b0c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:24.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.724+0000 7f3b1f400700 1 -- 172.21.15.70:0/2400699464 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 9583+0+0 (secure 0 0 0) 0x7f3b200e2d00 con 0x7f3b2810ff40 2024-05-08T07:08:24.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.724+0000 7f3b26a00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b0c0b2a70 0x7f3b0c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:24.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.725+0000 7f3b26a00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b0c0b2a70 0x7f3b0c0b4f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b2819cbe0 tx=0x7f3b1800b2c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:08:24.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:24.726+0000 7f3b1f400700 1 -- 172.21.15.70:0/2400699464 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3b20020020 con 0x7f3b2810ff40 2024-05-08T07:08:25.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.008+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b2819cfd0 con 0x7f3b2810ff40 2024-05-08T07:08:25.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.010+0000 7f3b1f400700 1 -- 172.21.15.70:0/2400699464 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11882 (secure 0 0 0) 0x7f3b200aa370 con 0x7f3b2810ff40 2024-05-08T07:08:25.009 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:08:25.009 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:07:48.266486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:08:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b0c0b2a70 msgr2=0x7f3b0c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b0c0b2a70 0x7f3b0c0b4f30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3b2819cbe0 tx=0x7f3b1800b2c0 comp rx=0 tx=0).stop 2024-05-08T07:08:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2810ff40 msgr2=0x7f3b2819baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2810ff40 0x7f3b2819baa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f3b20007d40 tx=0x7f3b2000a340 comp rx=0 tx=0).stop 2024-05-08T07:08:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 shutdown_connections 2024-05-08T07:08:25.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b0c0b2a70 0x7f3b0c0b4f30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b2810ff40 0x7f3b2819baa0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b2806ba40 0x7f3b281a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 --2- 172.21.15.70:0/2400699464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b2806c360 0x7f3b281a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 >> 172.21.15.70:0/2400699464 conn(0x7f3b28079310 msgr2=0x7f3b28111410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:08:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 shutdown_connections 2024-05-08T07:08:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:25.013+0000 7f3b2dc00700 1 -- 172.21.15.70:0/2400699464 wait complete. 2024-05-08T07:08:25.015 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 30 2024-05-08T07:08:25.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:25 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2400699464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:08:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:25 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2400699464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:08:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:25 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2400699464' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:08:26.252 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 65cae4de --release --await' 2024-05-08T07:08:26.253 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 65cae4de --release --await 2024-05-08T07:08:26.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:26 smithi070 ceph-mon[29591]: pgmap v689: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T07:08:26.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:26 smithi172 ceph-mon[33377]: pgmap v689: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T07:08:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:26 smithi194 ceph-mon[33679]: pgmap v689: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T07:08:26.711 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:08:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:27 smithi172 ceph-mon[33377]: pgmap v690: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:08:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:27 smithi194 ceph-mon[33679]: pgmap v690: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:08:27.850 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:27 smithi070 ceph-mon[29591]: pgmap v690: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:08:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:08:28.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:08:28.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:08:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.257+0000 7f3095e00700 1 -- 172.21.15.70:0/101729840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 msgr2=0x7f30901103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.257+0000 7f3095e00700 1 --2- 172.21.15.70:0/101729840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 0x7f30901103a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f308800b0d0 tx=0x7f308800b3e0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.257+0000 7f3095e00700 1 -- 172.21.15.70:0/101729840 shutdown_connections 2024-05-08T07:08:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.257+0000 7f3095e00700 1 --2- 172.21.15.70:0/101729840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 0x7f30901103a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.257+0000 7f3095e00700 1 --2- 172.21.15.70:0/101729840 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30901095d0 0x7f30901099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.257+0000 7f3095e00700 1 --2- 172.21.15.70:0/101729840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3090103550 0x7f30901039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.257+0000 7f3095e00700 1 -- 172.21.15.70:0/101729840 >> 172.21.15.70:0/101729840 conn(0x7f309007a5f0 msgr2=0x7f309007aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:08:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.257+0000 7f3095e00700 1 -- 172.21.15.70:0/101729840 shutdown_connections 2024-05-08T07:08:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.257+0000 7f3095e00700 1 -- 172.21.15.70:0/101729840 wait complete. 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.259+0000 7f3095e00700 1 Processor -- start 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.259+0000 7f3095e00700 1 -- start start 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f3095e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090103550 0x7f30901a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f3095e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 0x7f30901a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f3095e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30901095d0 0x7f309019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f3095e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30901135d0 con 0x7f3090103f10 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f3095e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3090113450 con 0x7f3090103550 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f3095e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3090113750 con 0x7f30901095d0 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f308e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 0x7f30901a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f308e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 0x7f30901a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35456/0 (socket says 172.21.15.70:35456) 2024-05-08T07:08:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f308e000700 1 -- 172.21.15.70:0/1663105529 learned_addr learned my addr 172.21.15.70:0/1663105529 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:08:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f308ea00700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090103550 0x7f30901a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f308f400700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30901095d0 0x7f309019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f308e000700 1 -- 172.21.15.70:0/1663105529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30901095d0 msgr2=0x7f309019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.260+0000 7f308e000700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30901095d0 0x7f309019bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.261+0000 7f308e000700 1 -- 172.21.15.70:0/1663105529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090103550 msgr2=0x7f30901a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.261+0000 7f308e000700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090103550 0x7f30901a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.261+0000 7f308e000700 1 -- 172.21.15.70:0/1663105529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309019c230 con 0x7f3090103f10 2024-05-08T07:08:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.261+0000 7f308e000700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 0x7f30901a1e50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f307c00d980 tx=0x7f307c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:08:29.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.261+0000 7f3094a00700 1 -- 172.21.15.70:0/1663105529 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c017070 con 0x7f3090103f10 2024-05-08T07:08:29.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.261+0000 7f3094a00700 1 -- 172.21.15.70:0/1663105529 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f307c004830 con 0x7f3090103f10 2024-05-08T07:08:29.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.261+0000 7f3095e00700 1 -- 172.21.15.70:0/1663105529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309019c520 con 0x7f3090103f10 2024-05-08T07:08:29.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.261+0000 7f3094a00700 1 -- 172.21.15.70:0/1663105529 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c0053a0 con 0x7f3090103f10 2024-05-08T07:08:29.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.262+0000 7f3095e00700 1 -- 172.21.15.70:0/1663105529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30901a87e0 con 0x7f3090103f10 2024-05-08T07:08:29.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.265+0000 7f3094a00700 1 -- 172.21.15.70:0/1663105529 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f307c005540 con 0x7f3090103f10 2024-05-08T07:08:29.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.266+0000 7f30a0712b80 1 Processor -- start 2024-05-08T07:08:29.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.267+0000 7f30a0712b80 1 -- start start 2024-05-08T07:08:29.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.267+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f923ec0 0x56181f9242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.267+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 0x56181f91e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.267+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f91ee50 0x56181f92ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.267+0000 7f30a0712b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56181f870b20 con 0x56181f91ee50 2024-05-08T07:08:29.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.267+0000 7f30a0712b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56181f80e860 con 0x56181f923ec0 2024-05-08T07:08:29.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.267+0000 7f30a0712b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56181f86cae0 con 0x56181f91e490 2024-05-08T07:08:29.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.267+0000 7f3094a00700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30740b2a70 0x7f30740b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.267+0000 7f3094a00700 1 -- 172.21.15.70:0/1663105529 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 9583+0+0 (secure 0 0 0) 0x7f307c0e29d0 con 0x7f3090103f10 2024-05-08T07:08:29.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f91ee50 0x56181f92ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 0x56181f91e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f91ee50 0x56181f92ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35472/0 (socket says 172.21.15.70:35472) 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308f400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f923ec0 0x56181f9242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308e000700 1 -- 172.21.15.70:0/1167991638 learned_addr learned my addr 172.21.15.70:0/1167991638 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308f400700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30740b2a70 0x7f30740b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308e000700 1 -- 172.21.15.70:0/1167991638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 msgr2=0x56181f91e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308e000700 1 --2- 172.21.15.70:0/1167991638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 0x56181f91e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308e000700 1 -- 172.21.15.70:0/1167991638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f923ec0 msgr2=0x56181f9242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308e000700 1 --2- 172.21.15.70:0/1167991638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f923ec0 0x56181f9242a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.268+0000 7f308e000700 1 -- 172.21.15.70:0/1167991638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56181f7bd9d0 con 0x56181f91ee50 2024-05-08T07:08:29.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.269+0000 7f308e000700 1 --2- 172.21.15.70:0/1167991638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f91ee50 0x56181f92ac80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f307c0dfd00 tx=0x7f307c0a94a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f7e6801c9f2e98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:08:29.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.269+0000 7f308f400700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30740b2a70 0x7f30740b4f30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3088009e60 tx=0x7f308800b040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:08:29.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.269+0000 7f3084c00700 1 -- 172.21.15.70:0/1167991638 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c0b2690 con 0x56181f91ee50 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.269+0000 7f3084c00700 1 -- 172.21.15.70:0/1167991638 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f307c0a5ba0 con 0x56181f91ee50 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.269+0000 7f3084c00700 1 -- 172.21.15.70:0/1167991638 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c0e0120 con 0x56181f91ee50 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.270+0000 7f30a0712b80 1 -- 172.21.15.70:0/1167991638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f91ee50 msgr2=0x56181f92ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.270+0000 7f30a0712b80 1 --2- 172.21.15.70:0/1167991638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f91ee50 0x56181f92ac80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f307c0dfd00 tx=0x7f307c0a94a0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.270+0000 7f30a0712b80 1 -- 172.21.15.70:0/1167991638 shutdown_connections 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.270+0000 7f30a0712b80 1 --2- 172.21.15.70:0/1167991638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f91ee50 0x56181f92ac80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.270+0000 7f30a0712b80 1 --2- 172.21.15.70:0/1167991638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f923ec0 0x56181f9242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.270+0000 7f30a0712b80 1 --2- 172.21.15.70:0/1167991638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 0x56181f91e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.270+0000 7f30a0712b80 1 -- 172.21.15.70:0/1167991638 >> 172.21.15.70:0/1167991638 conn(0x56181f84cc60 msgr2=0x56181f918d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.270+0000 7f30a0712b80 1 -- 172.21.15.70:0/1167991638 shutdown_connections 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.270+0000 7f30a0712b80 1 -- 172.21.15.70:0/1167991638 wait complete. 2024-05-08T07:08:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.271+0000 7f30a0712b80 1 -- start start 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.271+0000 7f30a0712b80 1 Processor -- start 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 0x56181f92a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91ee50 0x56181f927c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f30a0712b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56181f92b220 con 0x56181f923ec0 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f30a0712b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56181f7d6c20 con 0x56181f91ee50 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f30a0712b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56181f92b3a0 con 0x56181f91e490 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f30a0712b80 10 client.0 _ll_register_callbacks cb 0x56181f817d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f308f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f308f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9281b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35486/0 (socket says 172.21.15.70:35486) 2024-05-08T07:08:29.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f308f400700 1 -- 172.21.15.70:0/898641768 learned_addr learned my addr 172.21.15.70:0/898641768 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f308ea00700 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 0x56181f92a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.272+0000 7f308e000700 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91ee50 0x56181f927c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f308f400700 1 -- 172.21.15.70:0/898641768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 msgr2=0x56181f92a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f308f400700 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 0x56181f92a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f308f400700 1 -- 172.21.15.70:0/898641768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91ee50 msgr2=0x56181f927c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f308f400700 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91ee50 0x56181f927c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f308f400700 1 -- 172.21.15.70:0/898641768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56181f836520 con 0x56181f923ec0 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f308e000700 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91ee50 0x56181f927c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f308f400700 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9281b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3088006130 tx=0x7f30880099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9167abea17ca55 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:08:29.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f3079600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:08:29.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f3079600700 1 -- 172.21.15.70:0/898641768 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30880209c0 con 0x56181f923ec0 2024-05-08T07:08:29.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f3079600700 1 -- 172.21.15.70:0/898641768 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 9583+0+0 (secure 0 0 0) 0x7f3088020b60 con 0x56181f923ec0 2024-05-08T07:08:29.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.273+0000 7f30a0712b80 1 -- 172.21.15.70:0/898641768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f307c0a5ba0 con 0x56181f923ec0 2024-05-08T07:08:29.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.274+0000 7f3079600700 1 -- 172.21.15.70:0/898641768 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3088020da0 con 0x56181f923ec0 2024-05-08T07:08:29.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.274+0000 7f30a0712b80 10 client.16122 fetch_fsmap learned FSMap version 30 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.274+0000 7f30a0712b80 1 -- 172.21.15.70:0/898641768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56181f935ac0 con 0x56181f923ec0 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.274+0000 7f3079600700 1 -- 172.21.15.70:0/898641768 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f307c0a5ba0 con 0x56181f923ec0 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.274+0000 7f3079600700 1 -- 172.21.15.70:0/898641768 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3088011070 con 0x56181f923ec0 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.274+0000 7f30a0712b80 10 client.16122 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.274+0000 7f30a0712b80 10 client.16122 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.274+0000 7f30a0712b80 20 client.16122 populate_metadata read hostname 'smithi070' 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.274+0000 7f30a0712b80 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56181f938150 0x56181f93a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.275+0000 7f30a0712b80 4 client.16122 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.275+0000 7f30a0712b80 1 -- 172.21.15.70:0/898641768 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56181f8eb1a0 con 0x56181f938150 2024-05-08T07:08:29.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.275+0000 7f308ea00700 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56181f938150 0x56181f93a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.276+0000 7f308ea00700 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56181f938150 0x56181f93a560 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb46474bb8cf9f52 server_cookie=a4b687e2844ee51e in_seq=0 out_seq=0 2024-05-08T07:08:29.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.276+0000 7f3079600700 10 client.16122 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:08:29.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.278+0000 7f3079600700 1 -- 172.21.15.70:0/898641768 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56181f8eb1a0 con 0x56181f938150 2024-05-08T07:08:29.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.278+0000 7f3079600700 10 client.16122 handle_command_reply: tid=0 2024-05-08T07:08:29.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.278+0000 7f30a0712b80 1 client.16122 shutdown 2024-05-08T07:08:29.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.278+0000 7f30a0712b80 1 -- 172.21.15.70:0/898641768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 msgr2=0x56181f9281b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:29.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.278+0000 7f30a0712b80 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9281b0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3088006130 tx=0x7f30880099e0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f30a0712b80 1 -- 172.21.15.70:0/898641768 shutdown_connections 2024-05-08T07:08:29.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f30a0712b80 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56181f938150 0x56181f93a560 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f30a0712b80 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9281b0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f30a0712b80 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91e490 0x56181f92a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f30a0712b80 1 --2- 172.21.15.70:0/898641768 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91ee50 0x56181f927c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f30a0712b80 1 -- 172.21.15.70:0/898641768 >> 172.21.15.70:0/898641768 conn(0x56181f84cc60 msgr2=0x56181f913850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:08:29.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f3079600700 0 client.16122 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:08:29.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f30a0712b80 1 -- 172.21.15.70:0/898641768 shutdown_connections 2024-05-08T07:08:29.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f30a0712b80 1 -- 172.21.15.70:0/898641768 wait complete. 2024-05-08T07:08:29.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.279+0000 7f30a0712b80 20 client.16122 trim_cache size 0 max 16384 2024-05-08T07:08:29.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.301+0000 7f30a0712b80 1 Processor -- start 2024-05-08T07:08:29.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.301+0000 7f30a0712b80 1 -- start start 2024-05-08T07:08:29.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.301+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 0x56181f934270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.301+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 0x56181f93fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.301+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f940370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.301+0000 7f30a0712b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30901b4020 con 0x56181f923ec0 2024-05-08T07:08:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.301+0000 7f30a0712b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30901b1850 con 0x56181f91e490 2024-05-08T07:08:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.301+0000 7f30a0712b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f30901af6c0 con 0x56181f91ee50 2024-05-08T07:08:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f940370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f940370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35494/0 (socket says 172.21.15.70:35494) 2024-05-08T07:08:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308f400700 1 -- 172.21.15.70:0/1207413626 learned_addr learned my addr 172.21.15.70:0/1207413626 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:08:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308e000700 1 --2- 172.21.15.70:0/1207413626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 0x56181f93fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308ea00700 1 --2- 172.21.15.70:0/1207413626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 0x56181f934270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308f400700 1 -- 172.21.15.70:0/1207413626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 msgr2=0x56181f93fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:08:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308f400700 1 --2- 172.21.15.70:0/1207413626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 0x56181f93fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308f400700 1 -- 172.21.15.70:0/1207413626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 msgr2=0x56181f934270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:08:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308f400700 1 --2- 172.21.15.70:0/1207413626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 0x56181f934270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.302+0000 7f308f400700 1 -- 172.21.15.70:0/1207413626 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56181f915980 con 0x56181f923ec0 2024-05-08T07:08:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.303+0000 7f308f400700 1 --2- 172.21.15.70:0/1207413626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f940370 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f308800b0d0 tx=0x7f308800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55d2d205b0a183e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:08:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.303+0000 7f307be00700 1 -- 172.21.15.70:0/1207413626 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088009440 con 0x56181f923ec0 2024-05-08T07:08:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.303+0000 7f307be00700 1 -- 172.21.15.70:0/1207413626 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3088032070 con 0x56181f923ec0 2024-05-08T07:08:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.303+0000 7f307be00700 1 -- 172.21.15.70:0/1207413626 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f308802d480 con 0x56181f923ec0 2024-05-08T07:08:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.304+0000 7f30a0712b80 1 -- 172.21.15.70:0/1207413626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 msgr2=0x56181f940370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.304+0000 7f30a0712b80 1 --2- 172.21.15.70:0/1207413626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f940370 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f308800b0d0 tx=0x7f308800b880 comp rx=0 tx=0).stop 2024-05-08T07:08:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.304+0000 7f30a0712b80 1 -- 172.21.15.70:0/1207413626 shutdown_connections 2024-05-08T07:08:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.304+0000 7f30a0712b80 1 --2- 172.21.15.70:0/1207413626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f940370 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.304+0000 7f30a0712b80 1 --2- 172.21.15.70:0/1207413626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 0x56181f934270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.304+0000 7f30a0712b80 1 --2- 172.21.15.70:0/1207413626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 0x56181f93fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.304+0000 7f30a0712b80 1 -- 172.21.15.70:0/1207413626 >> 172.21.15.70:0/1207413626 conn(0x56181f84cc60 msgr2=0x56181f91dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:08:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.304+0000 7f30a0712b80 1 -- 172.21.15.70:0/1207413626 shutdown_connections 2024-05-08T07:08:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.304+0000 7f30a0712b80 1 -- 172.21.15.70:0/1207413626 wait complete. 2024-05-08T07:08:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.305+0000 7f30a0712b80 1 -- start start 2024-05-08T07:08:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.305+0000 7f30a0712b80 1 Processor -- start 2024-05-08T07:08:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.306+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 0x56181f92e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.306+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 0x56181f92ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.306+0000 7f30a0712b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.306+0000 7f30a0712b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30901afd10 con 0x56181f923ec0 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.306+0000 7f30a0712b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f30901b1180 con 0x56181f91e490 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.306+0000 7f30a0712b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f30901b03e0 con 0x56181f91ee50 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.306+0000 7f30a0712b80 10 client.0 _ll_register_callbacks cb 0x56181f817d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35500/0 (socket says 172.21.15.70:35500) 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308f400700 1 -- 172.21.15.70:0/779045695 learned_addr learned my addr 172.21.15.70:0/779045695 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308e000700 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 0x56181f92ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308ea00700 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 0x56181f92e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308f400700 1 -- 172.21.15.70:0/779045695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 msgr2=0x56181f92ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:08:29.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308f400700 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 0x56181f92ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308f400700 1 -- 172.21.15.70:0/779045695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 msgr2=0x56181f92e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308f400700 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 0x56181f92e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.307+0000 7f308f400700 1 -- 172.21.15.70:0/779045695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56181f92abd0 con 0x56181f923ec0 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.308+0000 7f308f400700 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9a19f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3088009c50 tx=0x7f308801fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d603398184001a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.308+0000 7f3079600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.308+0000 7f3079600700 1 -- 172.21.15.70:0/779045695 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3088005d80 con 0x56181f923ec0 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.308+0000 7f3079600700 1 -- 172.21.15.70:0/779045695 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 9583+0+0 (secure 0 0 0) 0x7f308801fb20 con 0x56181f923ec0 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.308+0000 7f30a0712b80 1 -- 172.21.15.70:0/779045695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3088032070 con 0x56181f923ec0 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.308+0000 7f3079600700 1 -- 172.21.15.70:0/779045695 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3088057050 con 0x56181f923ec0 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.308+0000 7f30a0712b80 10 client.16128 fetch_fsmap learned FSMap version 30 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.308+0000 7f30a0712b80 1 -- 172.21.15.70:0/779045695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56181f9a30d0 con 0x56181f923ec0 2024-05-08T07:08:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.309+0000 7f3079600700 1 -- 172.21.15.70:0/779045695 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3088032070 con 0x56181f923ec0 2024-05-08T07:08:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.309+0000 7f3079600700 1 -- 172.21.15.70:0/779045695 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3088011040 con 0x56181f923ec0 2024-05-08T07:08:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.309+0000 7f30a0712b80 10 client.16128 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T07:08:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.309+0000 7f30a0712b80 10 client.16128 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:08:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.309+0000 7f30a0712b80 20 client.16128 populate_metadata read hostname 'smithi070' 2024-05-08T07:08:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.309+0000 7f30a0712b80 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56181f9a3540 0x56181f9a5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:08:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.309+0000 7f30a0712b80 4 client.16128 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "65cae4de", "release": true, "await": true}] 2024-05-08T07:08:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.309+0000 7f30a0712b80 1 -- 172.21.15.70:0/779045695 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "65cae4de", "release": true, "await": true}) -- 0x56181f87e500 con 0x56181f9a3540 2024-05-08T07:08:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.310+0000 7f308ea00700 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56181f9a3540 0x56181f9a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:08:29.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.311+0000 7f3079600700 10 client.16128 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:08:29.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:29.311+0000 7f308ea00700 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56181f9a3540 0x56181f9a5960 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce078633e7dccadb server_cookie=1442d1b28c9f4b88 in_seq=0 out_seq=0 2024-05-08T07:08:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:29 smithi194 ceph-mon[33679]: pgmap v691: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T07:08:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:08:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:08:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:08:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:29 smithi070 ceph-mon[29591]: pgmap v691: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T07:08:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:08:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:08:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:08:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:29 smithi172 ceph-mon[33377]: pgmap v691: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T07:08:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:08:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:08:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:08:31.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.564+0000 7f3079600700 1 -- 172.21.15.70:0/779045695 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56181f87e500 con 0x56181f9a3540 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.564+0000 7f3079600700 10 client.16128 handle_command_reply: tid=0 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.564+0000 7f30a0712b80 1 client.16128 shutdown 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.564+0000 7f30a0712b80 1 -- 172.21.15.70:0/779045695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 msgr2=0x56181f9a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.564+0000 7f30a0712b80 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9a19f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3088009c50 tx=0x7f308801fa80 comp rx=0 tx=0).stop 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f30a0712b80 1 -- 172.21.15.70:0/779045695 shutdown_connections 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f30a0712b80 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56181f9a3540 0x56181f9a5960 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f30a0712b80 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56181f923ec0 0x56181f9a19f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f30a0712b80 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56181f91e490 0x56181f92e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f30a0712b80 1 --2- 172.21.15.70:0/779045695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56181f91ee50 0x56181f92ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f30a0712b80 1 -- 172.21.15.70:0/779045695 >> 172.21.15.70:0/779045695 conn(0x56181f84cc60 msgr2=0x56181f912fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f3079600700 0 client.16128 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:08:31.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f30a0712b80 1 -- 172.21.15.70:0/779045695 shutdown_connections 2024-05-08T07:08:31.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f30a0712b80 1 -- 172.21.15.70:0/779045695 wait complete. 2024-05-08T07:08:31.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.565+0000 7f30a0712b80 20 client.16128 trim_cache size 0 max 16384 2024-05-08T07:08:31.566 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:08:31.566 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 30, 2024-05-08T07:08:31.566 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:08:31.566 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 60, 2024-05-08T07:08:31.566 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:08:31.566 INFO:teuthology.orchestra.run.smithi070.stdout: "65cae4de": { 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 60, 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.9, 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:08:31.567 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:08:31.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:08:31.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:08:31.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:08:31.568 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:08:31.568 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:08:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.567+0000 7f3095e00700 1 -- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30740b2a70 msgr2=0x7f30740b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.567+0000 7f3095e00700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30740b2a70 0x7f30740b4f30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3088009e60 tx=0x7f308800b040 comp rx=0 tx=0).stop 2024-05-08T07:08:31.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.567+0000 7f3095e00700 1 -- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 msgr2=0x7f30901a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:08:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.567+0000 7f3095e00700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 0x7f30901a1e50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f307c00d980 tx=0x7f307c00dd40 comp rx=0 tx=0).stop 2024-05-08T07:08:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.568+0000 7f3095e00700 1 -- 172.21.15.70:0/1663105529 shutdown_connections 2024-05-08T07:08:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.568+0000 7f3095e00700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30740b2a70 0x7f30740b4f30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.568+0000 7f3095e00700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30901095d0 0x7f309019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.568+0000 7f3095e00700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3090103550 0x7f30901a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.568+0000 7f3095e00700 1 --2- 172.21.15.70:0/1663105529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3090103f10 0x7f30901a1e50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:08:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.568+0000 7f3095e00700 1 -- 172.21.15.70:0/1663105529 >> 172.21.15.70:0/1663105529 conn(0x7f309007a5f0 msgr2=0x7f309010e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:08:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.568+0000 7f3095e00700 1 -- 172.21.15.70:0/1663105529 shutdown_connections 2024-05-08T07:08:31.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:08:31.568+0000 7f3095e00700 1 -- 172.21.15.70:0/1663105529 wait complete. 2024-05-08T07:08:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:31 smithi172 ceph-mon[33377]: pgmap v692: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:08:31.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:31 smithi194 ceph-mon[33679]: pgmap v692: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:08:31.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:31 smithi070 ceph-mon[29591]: pgmap v692: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:08:32.639 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '65cae4de', seconds elapsed: 55.1 2024-05-08T07:08:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:33 smithi194 ceph-mon[33679]: pgmap v693: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:08:33.781 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:33 smithi070 ceph-mon[29591]: pgmap v693: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:08:33.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:33 smithi172 ceph-mon[33377]: pgmap v693: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:08:35.567 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:35 smithi070 ceph-mon[29591]: pgmap v694: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 216 KiB/s wr, 26 op/s 2024-05-08T07:08:35.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:35 smithi172 ceph-mon[33377]: pgmap v694: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 216 KiB/s wr, 26 op/s 2024-05-08T07:08:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:35 smithi194 ceph-mon[33679]: pgmap v694: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 216 KiB/s wr, 26 op/s 2024-05-08T07:08:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:37 smithi194 ceph-mon[33679]: pgmap v695: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 216 KiB/s wr, 24 op/s 2024-05-08T07:08:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:37 smithi070 ceph-mon[29591]: pgmap v695: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 216 KiB/s wr, 24 op/s 2024-05-08T07:08:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:37 smithi172 ceph-mon[33377]: pgmap v695: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 216 KiB/s wr, 24 op/s 2024-05-08T07:08:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:39 smithi194 ceph-mon[33679]: pgmap v696: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 682 KiB/s wr, 64 op/s 2024-05-08T07:08:39.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:39 smithi070 ceph-mon[29591]: pgmap v696: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 682 KiB/s wr, 64 op/s 2024-05-08T07:08:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:39 smithi172 ceph-mon[33377]: pgmap v696: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 682 KiB/s wr, 64 op/s 2024-05-08T07:08:41.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:41 smithi194 ceph-mon[33679]: pgmap v697: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 682 KiB/s wr, 61 op/s 2024-05-08T07:08:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:41 smithi070 ceph-mon[29591]: pgmap v697: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 682 KiB/s wr, 61 op/s 2024-05-08T07:08:41.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:41 smithi172 ceph-mon[33377]: pgmap v697: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 682 KiB/s wr, 61 op/s 2024-05-08T07:08:43.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:43 smithi194 ceph-mon[33679]: pgmap v698: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 682 KiB/s wr, 61 op/s 2024-05-08T07:08:43.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:43 smithi070 ceph-mon[29591]: pgmap v698: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 682 KiB/s wr, 61 op/s 2024-05-08T07:08:43.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:43 smithi172 ceph-mon[33377]: pgmap v698: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 682 KiB/s wr, 61 op/s 2024-05-08T07:08:45.732 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:45 smithi172 ceph-mon[33377]: pgmap v699: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 1.1 MiB/s wr, 99 op/s 2024-05-08T07:08:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:45 smithi194 ceph-mon[33679]: pgmap v699: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 1.1 MiB/s wr, 99 op/s 2024-05-08T07:08:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:45 smithi070 ceph-mon[29591]: pgmap v699: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 1.1 MiB/s wr, 99 op/s 2024-05-08T07:08:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:47 smithi194 ceph-mon[33679]: pgmap v700: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 955 KiB/s wr, 77 op/s 2024-05-08T07:08:47.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:47 smithi070 ceph-mon[29591]: pgmap v700: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 955 KiB/s wr, 77 op/s 2024-05-08T07:08:47.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:47 smithi172 ceph-mon[33377]: pgmap v700: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 955 KiB/s wr, 77 op/s 2024-05-08T07:08:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:49 smithi194 ceph-mon[33679]: pgmap v701: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.4 MiB/s wr, 116 op/s 2024-05-08T07:08:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:49 smithi070 ceph-mon[29591]: pgmap v701: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.4 MiB/s wr, 116 op/s 2024-05-08T07:08:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:49 smithi172 ceph-mon[33377]: pgmap v701: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 1.4 MiB/s wr, 116 op/s 2024-05-08T07:08:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:51 smithi194 ceph-mon[33679]: pgmap v702: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 936 KiB/s wr, 76 op/s 2024-05-08T07:08:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:51 smithi070 ceph-mon[29591]: pgmap v702: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 936 KiB/s wr, 76 op/s 2024-05-08T07:08:51.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:51 smithi172 ceph-mon[33377]: pgmap v702: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 936 KiB/s wr, 76 op/s 2024-05-08T07:08:53.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:53 smithi194 ceph-mon[33679]: pgmap v703: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 936 KiB/s wr, 76 op/s 2024-05-08T07:08:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:53 smithi070 ceph-mon[29591]: pgmap v703: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 936 KiB/s wr, 76 op/s 2024-05-08T07:08:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:53 smithi172 ceph-mon[33377]: pgmap v703: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 936 KiB/s wr, 76 op/s 2024-05-08T07:08:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:55 smithi194 ceph-mon[33679]: pgmap v704: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.3 MiB/s wr, 116 op/s 2024-05-08T07:08:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:55 smithi070 ceph-mon[29591]: pgmap v704: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.3 MiB/s wr, 116 op/s 2024-05-08T07:08:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:55 smithi172 ceph-mon[33377]: pgmap v704: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.3 MiB/s wr, 116 op/s 2024-05-08T07:08:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:57 smithi194 ceph-mon[33679]: pgmap v705: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 814 KiB/s wr, 78 op/s 2024-05-08T07:08:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:57 smithi070 ceph-mon[29591]: pgmap v705: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 814 KiB/s wr, 78 op/s 2024-05-08T07:08:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:57 smithi172 ceph-mon[33377]: pgmap v705: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 814 KiB/s wr, 78 op/s 2024-05-08T07:08:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:08:59 smithi194 ceph-mon[33679]: pgmap v706: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 1.4 MiB/s wr, 122 op/s 2024-05-08T07:08:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:08:59 smithi070 ceph-mon[29591]: pgmap v706: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 1.4 MiB/s wr, 122 op/s 2024-05-08T07:08:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:08:59 smithi172 ceph-mon[33377]: pgmap v706: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 1.4 MiB/s wr, 122 op/s 2024-05-08T07:09:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:01 smithi194 ceph-mon[33679]: pgmap v707: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 1014 KiB/s wr, 83 op/s 2024-05-08T07:09:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:01 smithi070 ceph-mon[29591]: pgmap v707: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 1014 KiB/s wr, 83 op/s 2024-05-08T07:09:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:01 smithi172 ceph-mon[33377]: pgmap v707: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 1014 KiB/s wr, 83 op/s 2024-05-08T07:09:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:03 smithi194 ceph-mon[33679]: pgmap v708: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 1014 KiB/s wr, 83 op/s 2024-05-08T07:09:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:03 smithi070 ceph-mon[29591]: pgmap v708: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 1014 KiB/s wr, 83 op/s 2024-05-08T07:09:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:03 smithi172 ceph-mon[33377]: pgmap v708: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 1014 KiB/s wr, 83 op/s 2024-05-08T07:09:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:05 smithi194 ceph-mon[33679]: pgmap v709: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2024-05-08T07:09:05.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:05 smithi070 ceph-mon[29591]: pgmap v709: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2024-05-08T07:09:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:05 smithi172 ceph-mon[33377]: pgmap v709: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 1.7 MiB/s wr, 141 op/s 2024-05-08T07:09:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:08 smithi070 ceph-mon[29591]: pgmap v710: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 1.4 MiB/s wr, 101 op/s 2024-05-08T07:09:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:08 smithi070 ceph-mon[29591]: osdmap e124: 12 total, 12 up, 12 in 2024-05-08T07:09:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:08 smithi172 ceph-mon[33377]: pgmap v710: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 1.4 MiB/s wr, 101 op/s 2024-05-08T07:09:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:08 smithi172 ceph-mon[33377]: osdmap e124: 12 total, 12 up, 12 in 2024-05-08T07:09:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:08 smithi194 ceph-mon[33679]: pgmap v710: 129 pgs: 129 active+clean; 1.1 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 1.4 MiB/s wr, 101 op/s 2024-05-08T07:09:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:08 smithi194 ceph-mon[33679]: osdmap e124: 12 total, 12 up, 12 in 2024-05-08T07:09:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:10 smithi070 ceph-mon[29591]: pgmap v712: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 1.6 MiB/s wr, 134 op/s 2024-05-08T07:09:10.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:10 smithi172 ceph-mon[33377]: pgmap v712: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 1.6 MiB/s wr, 134 op/s 2024-05-08T07:09:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:10 smithi194 ceph-mon[33679]: pgmap v712: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 1.6 MiB/s wr, 134 op/s 2024-05-08T07:09:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:12 smithi070 ceph-mon[29591]: pgmap v713: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 1.6 MiB/s wr, 134 op/s 2024-05-08T07:09:12.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:12 smithi172 ceph-mon[33377]: pgmap v713: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 1.6 MiB/s wr, 134 op/s 2024-05-08T07:09:12.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:12 smithi194 ceph-mon[33679]: pgmap v713: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 1.6 MiB/s wr, 134 op/s 2024-05-08T07:09:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:13 smithi070 ceph-mon[29591]: osdmap e125: 12 total, 12 up, 12 in 2024-05-08T07:09:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:13 smithi070 ceph-mon[29591]: pgmap v715: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 949 KiB/s wr, 80 op/s 2024-05-08T07:09:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:13 smithi172 ceph-mon[33377]: osdmap e125: 12 total, 12 up, 12 in 2024-05-08T07:09:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:13 smithi172 ceph-mon[33377]: pgmap v715: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 949 KiB/s wr, 80 op/s 2024-05-08T07:09:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:13 smithi194 ceph-mon[33679]: osdmap e125: 12 total, 12 up, 12 in 2024-05-08T07:09:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:13 smithi194 ceph-mon[33679]: pgmap v715: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 949 KiB/s wr, 80 op/s 2024-05-08T07:09:15.731 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:15 smithi172 ceph-mon[33377]: pgmap v716: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 2.0 MiB/s wr, 156 op/s 2024-05-08T07:09:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:15 smithi194 ceph-mon[33679]: pgmap v716: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 2.0 MiB/s wr, 156 op/s 2024-05-08T07:09:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:15 smithi070 ceph-mon[29591]: pgmap v716: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 2.0 MiB/s wr, 156 op/s 2024-05-08T07:09:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:17 smithi194 ceph-mon[33679]: pgmap v717: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.6 MiB/s wr, 125 op/s 2024-05-08T07:09:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:17 smithi070 ceph-mon[29591]: pgmap v717: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.6 MiB/s wr, 125 op/s 2024-05-08T07:09:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:17 smithi172 ceph-mon[33377]: pgmap v717: 129 pgs: 129 active+clean; 1.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 1.6 MiB/s wr, 125 op/s 2024-05-08T07:09:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:19 smithi194 ceph-mon[33679]: pgmap v718: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-05-08T07:09:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:19 smithi070 ceph-mon[29591]: pgmap v718: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-05-08T07:09:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:19 smithi172 ceph-mon[33377]: pgmap v718: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-05-08T07:09:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:21 smithi194 ceph-mon[33679]: pgmap v719: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-05-08T07:09:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:21 smithi070 ceph-mon[29591]: pgmap v719: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-05-08T07:09:21.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:21 smithi172 ceph-mon[33377]: pgmap v719: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 1.6 MiB/s wr, 114 op/s 2024-05-08T07:09:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:23 smithi194 ceph-mon[33679]: pgmap v720: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-05-08T07:09:23.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:23 smithi070 ceph-mon[29591]: pgmap v720: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-05-08T07:09:23.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:23 smithi172 ceph-mon[33377]: pgmap v720: 129 pgs: 129 active+clean; 1.1 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-05-08T07:09:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:25 smithi194 ceph-mon[33679]: pgmap v721: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-05-08T07:09:25.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:25 smithi070 ceph-mon[29591]: pgmap v721: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-05-08T07:09:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:25 smithi172 ceph-mon[33377]: pgmap v721: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 1.9 MiB/s wr, 135 op/s 2024-05-08T07:09:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:27 smithi194 ceph-mon[33679]: pgmap v722: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 1.2 MiB/s wr, 85 op/s 2024-05-08T07:09:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:27 smithi070 ceph-mon[29591]: pgmap v722: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 1.2 MiB/s wr, 85 op/s 2024-05-08T07:09:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:27 smithi172 ceph-mon[33377]: pgmap v722: 129 pgs: 129 active+clean; 1.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 1.2 MiB/s wr, 85 op/s 2024-05-08T07:09:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:29 smithi194 ceph-mon[33679]: pgmap v723: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 2.2 MiB/s wr, 129 op/s 2024-05-08T07:09:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:29 smithi070 ceph-mon[29591]: pgmap v723: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 2.2 MiB/s wr, 129 op/s 2024-05-08T07:09:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:29 smithi172 ceph-mon[33377]: pgmap v723: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 2.2 MiB/s wr, 129 op/s 2024-05-08T07:09:30.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:09:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:09:30.933 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:09:31.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:31 smithi194 ceph-mon[33679]: pgmap v724: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2024-05-08T07:09:31.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:31 smithi070 ceph-mon[29591]: pgmap v724: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2024-05-08T07:09:31.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:31 smithi172 ceph-mon[33377]: pgmap v724: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2024-05-08T07:09:33.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:33 smithi070 ceph-mon[29591]: pgmap v725: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2024-05-08T07:09:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:33 smithi194 ceph-mon[33679]: pgmap v725: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2024-05-08T07:09:33.915 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:33 smithi172 ceph-mon[33377]: pgmap v725: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 1.5 MiB/s wr, 84 op/s 2024-05-08T07:09:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:35 smithi194 ceph-mon[33679]: pgmap v726: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 2.5 MiB/s wr, 144 op/s 2024-05-08T07:09:35.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:35 smithi070 ceph-mon[29591]: pgmap v726: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 2.5 MiB/s wr, 144 op/s 2024-05-08T07:09:35.889 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:35 smithi172 ceph-mon[33377]: pgmap v726: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 2.5 MiB/s wr, 144 op/s 2024-05-08T07:09:38.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:38.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:38.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:38 smithi070 ceph-mon[29591]: pgmap v727: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.9 MiB/s wr, 103 op/s 2024-05-08T07:09:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:38 smithi172 ceph-mon[33377]: pgmap v727: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.9 MiB/s wr, 103 op/s 2024-05-08T07:09:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:38 smithi194 ceph-mon[33679]: pgmap v727: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 1.9 MiB/s wr, 103 op/s 2024-05-08T07:09:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:39 smithi194 ceph-mon[33679]: pgmap v728: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 2.8 MiB/s wr, 158 op/s 2024-05-08T07:09:39.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:39 smithi070 ceph-mon[29591]: pgmap v728: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 2.8 MiB/s wr, 158 op/s 2024-05-08T07:09:39.893 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:39 smithi172 ceph-mon[33377]: pgmap v728: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 2.8 MiB/s wr, 158 op/s 2024-05-08T07:09:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:09:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:09:41.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:09:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:09:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:09:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:09:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:09:42.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:42 smithi070 ceph-mon[29591]: pgmap v729: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.9 MiB/s wr, 114 op/s 2024-05-08T07:09:42.413 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:42 smithi194 ceph-mon[33679]: pgmap v729: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.9 MiB/s wr, 114 op/s 2024-05-08T07:09:42.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:42 smithi172 ceph-mon[33377]: pgmap v729: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.9 MiB/s wr, 114 op/s 2024-05-08T07:09:43.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:43 smithi194 ceph-mon[33679]: pgmap v730: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.9 MiB/s wr, 114 op/s 2024-05-08T07:09:43.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:43 smithi070 ceph-mon[29591]: pgmap v730: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.9 MiB/s wr, 114 op/s 2024-05-08T07:09:43.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:43 smithi172 ceph-mon[33377]: pgmap v730: 129 pgs: 129 active+clean; 1.2 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 1.9 MiB/s wr, 114 op/s 2024-05-08T07:09:45.731 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:45 smithi172 ceph-mon[33377]: pgmap v731: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 2.8 MiB/s wr, 159 op/s 2024-05-08T07:09:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:45 smithi194 ceph-mon[33679]: pgmap v731: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 2.8 MiB/s wr, 159 op/s 2024-05-08T07:09:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:45 smithi070 ceph-mon[29591]: pgmap v731: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 2.8 MiB/s wr, 159 op/s 2024-05-08T07:09:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:47 smithi194 ceph-mon[33679]: pgmap v732: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 1.9 MiB/s wr, 100 op/s 2024-05-08T07:09:47.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:47 smithi070 ceph-mon[29591]: pgmap v732: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 1.9 MiB/s wr, 100 op/s 2024-05-08T07:09:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:47 smithi172 ceph-mon[33377]: pgmap v732: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 1.9 MiB/s wr, 100 op/s 2024-05-08T07:09:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:49 smithi194 ceph-mon[33679]: pgmap v733: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 2.3 MiB/s wr, 135 op/s 2024-05-08T07:09:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:49 smithi070 ceph-mon[29591]: pgmap v733: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 2.3 MiB/s wr, 135 op/s 2024-05-08T07:09:49.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:49 smithi172 ceph-mon[33377]: pgmap v733: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 2.3 MiB/s wr, 135 op/s 2024-05-08T07:09:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:51 smithi194 ceph-mon[33679]: pgmap v734: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-05-08T07:09:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:51 smithi070 ceph-mon[29591]: pgmap v734: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-05-08T07:09:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:51 smithi172 ceph-mon[33377]: pgmap v734: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-05-08T07:09:53.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:53 smithi194 ceph-mon[33679]: pgmap v735: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-05-08T07:09:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:53 smithi070 ceph-mon[29591]: pgmap v735: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-05-08T07:09:53.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:53 smithi172 ceph-mon[33377]: pgmap v735: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 1.3 MiB/s wr, 81 op/s 2024-05-08T07:09:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:55 smithi194 ceph-mon[33679]: pgmap v736: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 2.0 MiB/s wr, 122 op/s 2024-05-08T07:09:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:55 smithi070 ceph-mon[29591]: pgmap v736: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 2.0 MiB/s wr, 122 op/s 2024-05-08T07:09:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:55 smithi172 ceph-mon[33377]: pgmap v736: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 2.0 MiB/s wr, 122 op/s 2024-05-08T07:09:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:57 smithi194 ceph-mon[33679]: pgmap v737: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2024-05-08T07:09:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:57 smithi070 ceph-mon[29591]: pgmap v737: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2024-05-08T07:09:57.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:57 smithi172 ceph-mon[33377]: pgmap v737: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 1.1 MiB/s wr, 77 op/s 2024-05-08T07:09:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:09:59 smithi194 ceph-mon[33679]: pgmap v738: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.8 MiB/s wr, 119 op/s 2024-05-08T07:09:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:09:59 smithi070 ceph-mon[29591]: pgmap v738: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.8 MiB/s wr, 119 op/s 2024-05-08T07:09:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:09:59 smithi172 ceph-mon[33377]: pgmap v738: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.8 MiB/s wr, 119 op/s 2024-05-08T07:10:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T07:10:00.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T07:10:00.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T07:10:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:01 smithi194 ceph-mon[33679]: pgmap v739: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-05-08T07:10:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:01 smithi070 ceph-mon[29591]: pgmap v739: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-05-08T07:10:01.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:01 smithi172 ceph-mon[33377]: pgmap v739: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-05-08T07:10:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:03 smithi194 ceph-mon[33679]: pgmap v740: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-05-08T07:10:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:03 smithi070 ceph-mon[29591]: pgmap v740: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-05-08T07:10:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:03 smithi172 ceph-mon[33377]: pgmap v740: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 1.4 MiB/s wr, 83 op/s 2024-05-08T07:10:05.126 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10.6 2024-05-08T07:10:05.126 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:10:05.652 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:10:05.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:05 smithi194 ceph-mon[33679]: pgmap v741: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 2.2 MiB/s wr, 134 op/s 2024-05-08T07:10:05.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:05 smithi070 ceph-mon[29591]: pgmap v741: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 2.2 MiB/s wr, 134 op/s 2024-05-08T07:10:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:05 smithi172 ceph-mon[33377]: pgmap v741: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 2.2 MiB/s wr, 134 op/s 2024-05-08T07:10:08.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.224+0000 7fbbef000700 1 -- 172.21.15.70:0/2176159625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe80756d0 msgr2=0x7fbbe8075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.224+0000 7fbbef000700 1 --2- 172.21.15.70:0/2176159625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe80756d0 0x7fbbe8075ab0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800b0a0 tx=0x7fbbd800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.224+0000 7fbbef000700 1 -- 172.21.15.70:0/2176159625 shutdown_connections 2024-05-08T07:10:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.224+0000 7fbbef000700 1 --2- 172.21.15.70:0/2176159625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe810fea0 0x7fbbe8112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.224+0000 7fbbef000700 1 --2- 172.21.15.70:0/2176159625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe80756d0 0x7fbbe8075ab0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.224+0000 7fbbef000700 1 --2- 172.21.15.70:0/2176159625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe8075ff0 0x7fbbe810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.224+0000 7fbbef000700 1 -- 172.21.15.70:0/2176159625 >> 172.21.15.70:0/2176159625 conn(0x7fbbe807a600 msgr2=0x7fbbe807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.225+0000 7fbbef000700 1 -- 172.21.15.70:0/2176159625 shutdown_connections 2024-05-08T07:10:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.225+0000 7fbbef000700 1 -- 172.21.15.70:0/2176159625 wait complete. 2024-05-08T07:10:08.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.226+0000 7fbbef000700 1 Processor -- start 2024-05-08T07:10:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.226+0000 7fbbef000700 1 -- start start 2024-05-08T07:10:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.226+0000 7fbbef000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe80756d0 0x7fbbe81a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbef000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe8075ff0 0x7fbbe81a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbef000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe810fea0 0x7fbbe819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbef000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe8115700 con 0x7fbbe810fea0 2024-05-08T07:10:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbef000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe8115580 con 0x7fbbe80756d0 2024-05-08T07:10:08.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbef000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe8115880 con 0x7fbbe8075ff0 2024-05-08T07:10:08.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbe7e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe80756d0 0x7fbbe81a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbe7400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe8075ff0 0x7fbbe81a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbe7400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe8075ff0 0x7fbbe81a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:53856/0 (socket says 172.21.15.70:53856) 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbe7e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe80756d0 0x7fbbe81a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:44984/0 (socket says 172.21.15.70:44984) 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbe7400700 1 -- 172.21.15.70:0/181971410 learned_addr learned my addr 172.21.15.70:0/181971410 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.227+0000 7fbbed000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe810fea0 0x7fbbe819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.228+0000 7fbbed000700 1 -- 172.21.15.70:0/181971410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe8075ff0 msgr2=0x7fbbe81a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.228+0000 7fbbed000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe8075ff0 0x7fbbe81a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.228+0000 7fbbed000700 1 -- 172.21.15.70:0/181971410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe80756d0 msgr2=0x7fbbe81a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.228+0000 7fbbed000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe80756d0 0x7fbbe81a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.228+0000 7fbbed000700 1 -- 172.21.15.70:0/181971410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe819c220 con 0x7fbbe810fea0 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.228+0000 7fbbe7e00700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe80756d0 0x7fbbe81a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:10:08.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.229+0000 7fbbed000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe810fea0 0x7fbbe819bac0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806bd30 tx=0x7fbbe000da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:08.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.229+0000 7fbbe4c00700 1 -- 172.21.15.70:0/181971410 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0016070 con 0x7fbbe810fea0 2024-05-08T07:10:08.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.229+0000 7fbbe4c00700 1 -- 172.21.15.70:0/181971410 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbe000f690 con 0x7fbbe810fea0 2024-05-08T07:10:08.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.229+0000 7fbbe4c00700 1 -- 172.21.15.70:0/181971410 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00038e0 con 0x7fbbe810fea0 2024-05-08T07:10:08.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.229+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe819c4b0 con 0x7fbbe810fea0 2024-05-08T07:10:08.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.229+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe81a87d0 con 0x7fbbe810fea0 2024-05-08T07:10:08.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.231+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe806a190 con 0x7fbbe810fea0 2024-05-08T07:10:08.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.233+0000 7fbbe4c00700 1 -- 172.21.15.70:0/181971410 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbbe0004220 con 0x7fbbe810fea0 2024-05-08T07:10:08.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.235+0000 7fbbe4c00700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbbcc0b29f0 0x7fbbcc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:08.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.235+0000 7fbbe4c00700 1 -- 172.21.15.70:0/181971410 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9671+0+0 (secure 0 0 0) 0x7fbbe00e2860 con 0x7fbbe810fea0 2024-05-08T07:10:08.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.236+0000 7fbbe7e00700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbbcc0b29f0 0x7fbbcc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:08.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.237+0000 7fbbe7e00700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbbcc0b29f0 0x7fbbcc0b4eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009fd0 tx=0x7fbbd800b7b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:08.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.239+0000 7fbbe4c00700 1 -- 172.21.15.70:0/181971410 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbbe00a9d60 con 0x7fbbe810fea0 2024-05-08T07:10:08.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.598+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbe802e510 con 0x7fbbe810fea0 2024-05-08T07:10:08.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.600+0000 7fbbe4c00700 1 -- 172.21.15.70:0/181971410 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11882 (secure 0 0 0) 0x7fbbe00a9660 con 0x7fbbe810fea0 2024-05-08T07:10:08.599 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:10:08.600 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:07:48.266486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:10:08.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbbcc0b29f0 msgr2=0x7fbbcc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:08.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbbcc0b29f0 0x7fbbcc0b4eb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009fd0 tx=0x7fbbd800b7b0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe810fea0 msgr2=0x7fbbe819bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:08.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe810fea0 0x7fbbe819bac0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fbbe806bd30 tx=0x7fbbe000da00 comp rx=0 tx=0).stop 2024-05-08T07:10:08.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 shutdown_connections 2024-05-08T07:10:08.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbbcc0b29f0 0x7fbbcc0b4eb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbbe810fea0 0x7fbbe819bac0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbbe80756d0 0x7fbbe81a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 --2- 172.21.15.70:0/181971410 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbe8075ff0 0x7fbbe81a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:08.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.603+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 >> 172.21.15.70:0/181971410 conn(0x7fbbe807a600 msgr2=0x7fbbe8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:08.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.604+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 shutdown_connections 2024-05-08T07:10:08.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:08.604+0000 7fbbef000700 1 -- 172.21.15.70:0/181971410 wait complete. 2024-05-08T07:10:08.605 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 30 2024-05-08T07:10:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:08 smithi070 ceph-mon[29591]: pgmap v743: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.8 MiB/s wr, 110 op/s 2024-05-08T07:10:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:08 smithi070 ceph-mon[29591]: osdmap e126: 12 total, 12 up, 12 in 2024-05-08T07:10:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:08 smithi172 ceph-mon[33377]: pgmap v743: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.8 MiB/s wr, 110 op/s 2024-05-08T07:10:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:08 smithi172 ceph-mon[33377]: osdmap e126: 12 total, 12 up, 12 in 2024-05-08T07:10:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:08 smithi194 ceph-mon[33679]: pgmap v743: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 1.8 MiB/s wr, 110 op/s 2024-05-08T07:10:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:08 smithi194 ceph-mon[33679]: osdmap e126: 12 total, 12 up, 12 in 2024-05-08T07:10:09.470 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 70.6 --await-for 42.0' 2024-05-08T07:10:09.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 70.6 --await-for 42.0 2024-05-08T07:10:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/181971410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:10:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/181971410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:10:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/181971410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:10:09.959 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:10:10.656 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:10 smithi172 ceph-mon[33377]: pgmap v744: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.9 MiB/s wr, 292 op/s 2024-05-08T07:10:10.688 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:10 smithi070 ceph-mon[29591]: pgmap v744: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.9 MiB/s wr, 292 op/s 2024-05-08T07:10:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:10 smithi194 ceph-mon[33679]: pgmap v744: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.9 MiB/s wr, 292 op/s 2024-05-08T07:10:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:11 smithi194 ceph-mon[33679]: pgmap v745: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.9 MiB/s wr, 292 op/s 2024-05-08T07:10:11.822 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:11 smithi070 ceph-mon[29591]: pgmap v745: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.9 MiB/s wr, 292 op/s 2024-05-08T07:10:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:11 smithi172 ceph-mon[33377]: pgmap v745: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 1.9 MiB/s wr, 292 op/s 2024-05-08T07:10:12.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.421+0000 7fc345400700 1 -- 172.21.15.70:0/1686296778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34010ff40 msgr2=0x7fc340112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.421+0000 7fc345400700 1 --2- 172.21.15.70:0/1686296778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34010ff40 0x7fc340112330 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc33800b0a0 tx=0x7fc33800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.421+0000 7fc345400700 1 -- 172.21.15.70:0/1686296778 shutdown_connections 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.421+0000 7fc345400700 1 --2- 172.21.15.70:0/1686296778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34010ff40 0x7fc340112330 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.421+0000 7fc345400700 1 --2- 172.21.15.70:0/1686296778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34006ba50 0x7fc34006be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.421+0000 7fc345400700 1 --2- 172.21.15.70:0/1686296778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34006c370 0x7fc34010fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.421+0000 7fc345400700 1 -- 172.21.15.70:0/1686296778 >> 172.21.15.70:0/1686296778 conn(0x7fc3400793e0 msgr2=0x7fc3400797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.422+0000 7fc345400700 1 -- 172.21.15.70:0/1686296778 shutdown_connections 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.422+0000 7fc345400700 1 -- 172.21.15.70:0/1686296778 wait complete. 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.423+0000 7fc345400700 1 Processor -- start 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.423+0000 7fc345400700 1 -- start start 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc345400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34006ba50 0x7fc3401a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc345400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34006c370 0x7fc3401a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc345400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34010ff40 0x7fc34019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc345400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc340115700 con 0x7fc34006c370 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc345400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc340115580 con 0x7fc34006ba50 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc345400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc340115880 con 0x7fc34010ff40 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc337e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34006c370 0x7fc3401a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc337e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34006c370 0x7fc3401a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43268/0 (socket says 172.21.15.70:43268) 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc337e00700 1 -- 172.21.15.70:0/1505564714 learned_addr learned my addr 172.21.15.70:0/1505564714 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.424+0000 7fc33e800700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34006ba50 0x7fc3401a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.425+0000 7fc33f200700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34010ff40 0x7fc34019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.425+0000 7fc337e00700 1 -- 172.21.15.70:0/1505564714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34010ff40 msgr2=0x7fc34019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.425+0000 7fc337e00700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34010ff40 0x7fc34019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.425+0000 7fc337e00700 1 -- 172.21.15.70:0/1505564714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34006ba50 msgr2=0x7fc3401a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.425+0000 7fc337e00700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34006ba50 0x7fc3401a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.425+0000 7fc337e00700 1 -- 172.21.15.70:0/1505564714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34019c080 con 0x7fc34006c370 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.425+0000 7fc337e00700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34006c370 0x7fc3401a1ca0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc32800d950 tx=0x7fc32800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.426+0000 7fc337400700 1 -- 172.21.15.70:0/1505564714 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328016070 con 0x7fc34006c370 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.426+0000 7fc337400700 1 -- 172.21.15.70:0/1505564714 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc32800fd20 con 0x7fc34006c370 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.426+0000 7fc337400700 1 -- 172.21.15.70:0/1505564714 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32800e3b0 con 0x7fc34006c370 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.426+0000 7fc345400700 1 -- 172.21.15.70:0/1505564714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc34019c310 con 0x7fc34006c370 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.426+0000 7fc345400700 1 -- 172.21.15.70:0/1505564714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3401a8630 con 0x7fc34006c370 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.432+0000 7fc337400700 1 -- 172.21.15.70:0/1505564714 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc328019070 con 0x7fc34006c370 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.433+0000 7fc34fd67b80 1 Processor -- start 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.433+0000 7fc34fd67b80 1 -- start start 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.433+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3af6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.433+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3af0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.433+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 0x557ba3afd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.433+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557ba3a42bb0 con 0x557ba3af0810 2024-05-08T07:10:12.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.433+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ba39e08f0 con 0x557ba3af6240 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.433+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557ba3a3eb70 con 0x557ba3af11d0 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.434+0000 7fc33e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3af0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.434+0000 7fc33e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3af0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43272/0 (socket says 172.21.15.70:43272) 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.434+0000 7fc33e800700 1 -- 172.21.15.70:0/3069517519 learned_addr learned my addr 172.21.15.70:0/3069517519 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.434+0000 7fc33f200700 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3af6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.434+0000 7fc337e00700 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 0x557ba3afd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.434+0000 7fc337400700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3240b2b20 0x7fc3240b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.434+0000 7fc337400700 1 -- 172.21.15.70:0/1505564714 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 9671+0+0 (secure 0 0 0) 0x7fc3280e24b0 con 0x7fc34006c370 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.434+0000 7fc33e800700 1 -- 172.21.15.70:0/3069517519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 msgr2=0x557ba3afd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.434+0000 7fc33e800700 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 0x557ba3afd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.435+0000 7fc33e800700 1 -- 172.21.15.70:0/3069517519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 msgr2=0x557ba3af6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.435+0000 7fc33e800700 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3af6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.435+0000 7fc33e800700 1 -- 172.21.15.70:0/3069517519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ba398fa60 con 0x557ba3af0810 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.435+0000 7fc33f200700 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3af6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.435+0000 7fc33f200700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3240b2b20 0x7fc3240b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.435+0000 7fc33e800700 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3af0c90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc33000acf0 tx=0x7fc33000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57008be66dc0c3f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.435+0000 7fc32fe00700 1 -- 172.21.15.70:0/3069517519 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33000fdf0 con 0x557ba3af0810 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.436+0000 7fc33f200700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3240b2b20 0x7fc3240b4fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc338009fd0 tx=0x7fc3380099e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.436+0000 7fc32fe00700 1 -- 172.21.15.70:0/3069517519 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3300044c0 con 0x557ba3af0810 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.436+0000 7fc32fe00700 1 -- 172.21.15.70:0/3069517519 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330018430 con 0x557ba3af0810 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.437+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3069517519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 msgr2=0x557ba3af0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.437+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3af0c90 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc33000acf0 tx=0x7fc33000f3c0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.437+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3069517519 shutdown_connections 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.437+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 0x557ba3afd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.437+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3af6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.437+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3069517519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3af0c90 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.437+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3069517519 >> 172.21.15.70:0/3069517519 conn(0x557ba3a68860 msgr2=0x557ba3aeb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.437+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3069517519 shutdown_connections 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.437+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3069517519 wait complete. 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.438+0000 7fc34fd67b80 1 -- start start 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.438+0000 7fc34fd67b80 1 Processor -- start 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.438+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 0x557ba3afcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.438+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af11d0 0x557ba3af9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.438+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af6240 0x557ba3afa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.438+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557ba3afd600 con 0x557ba3af6240 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.438+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ba39a8cb0 con 0x557ba3af11d0 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.438+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557ba3afd780 con 0x557ba3af0810 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc34fd67b80 10 client.0 _ll_register_callbacks cb 0x557ba39e9e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc33f200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af6240 0x557ba3afa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc33f200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af6240 0x557ba3afa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43278/0 (socket says 172.21.15.70:43278) 2024-05-08T07:10:12.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc33f200700 1 -- 172.21.15.70:0/749084206 learned_addr learned my addr 172.21.15.70:0/749084206 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc337e00700 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af11d0 0x557ba3af9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc33e800700 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 0x557ba3afcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc33f200700 1 -- 172.21.15.70:0/749084206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 msgr2=0x557ba3afcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc33f200700 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 0x557ba3afcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc33f200700 1 -- 172.21.15.70:0/749084206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af11d0 msgr2=0x557ba3af9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc33f200700 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af11d0 0x557ba3af9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.439+0000 7fc33f200700 1 -- 172.21.15.70:0/749084206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ba3a085b0 con 0x557ba3af6240 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.440+0000 7fc33f200700 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af6240 0x557ba3afa4b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc338007740 tx=0x7fc33800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe16ec0b2d84026 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.440+0000 7fc32cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.440+0000 7fc32cc00700 1 -- 172.21.15.70:0/749084206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33802c020 con 0x557ba3af6240 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.440+0000 7fc32cc00700 1 -- 172.21.15.70:0/749084206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9671+0+0 (secure 0 0 0) 0x7fc338005250 con 0x557ba3af6240 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.440+0000 7fc34fd67b80 1 -- 172.21.15.70:0/749084206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3300044c0 con 0x557ba3af6240 2024-05-08T07:10:12.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.441+0000 7fc32cc00700 1 -- 172.21.15.70:0/749084206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc338037050 con 0x557ba3af6240 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.441+0000 7fc34fd67b80 10 client.16146 fetch_fsmap learned FSMap version 30 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.441+0000 7fc34fd67b80 1 -- 172.21.15.70:0/749084206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557ba3b07e30 con 0x557ba3af6240 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.441+0000 7fc32cc00700 1 -- 172.21.15.70:0/749084206 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3300044c0 con 0x557ba3af6240 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.442+0000 7fc32cc00700 1 -- 172.21.15.70:0/749084206 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc338011070 con 0x557ba3af6240 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.442+0000 7fc34fd67b80 10 client.16146 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.442+0000 7fc34fd67b80 10 client.16146 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.442+0000 7fc34fd67b80 20 client.16146 populate_metadata read hostname 'smithi070' 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.442+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ba3b0a470 0x557ba3b0c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.442+0000 7fc34fd67b80 4 client.16146 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.442+0000 7fc34fd67b80 1 -- 172.21.15.70:0/749084206 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ba3abd2d0 con 0x557ba3b0a470 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.442+0000 7fc33e800700 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ba3b0a470 0x557ba3b0c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.443+0000 7fc33e800700 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ba3b0a470 0x557ba3b0c8c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52678f44d0411412 server_cookie=47e3cfeb5b40ab44 in_seq=0 out_seq=0 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.443+0000 7fc32cc00700 10 client.16146 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc32cc00700 1 -- 172.21.15.70:0/749084206 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557ba3abd2d0 con 0x557ba3b0a470 2024-05-08T07:10:12.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc32cc00700 10 client.16146 handle_command_reply: tid=0 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 client.16146 shutdown 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 -- 172.21.15.70:0/749084206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af6240 msgr2=0x557ba3afa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af6240 0x557ba3afa4b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc338007740 tx=0x7fc33800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 -- 172.21.15.70:0/749084206 shutdown_connections 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ba3b0a470 0x557ba3b0c8c0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af6240 0x557ba3afa4b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 0x557ba3afcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/749084206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af11d0 0x557ba3af9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc32cc00700 0 client.16146 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 -- 172.21.15.70:0/749084206 >> 172.21.15.70:0/749084206 conn(0x557ba3a68860 msgr2=0x557ba3ae5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 -- 172.21.15.70:0/749084206 shutdown_connections 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.450+0000 7fc34fd67b80 1 -- 172.21.15.70:0/749084206 wait complete. 2024-05-08T07:10:12.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.451+0000 7fc34fd67b80 20 client.16146 trim_cache size 0 max 16384 2024-05-08T07:10:12.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.478+0000 7fc34fd67b80 1 Processor -- start 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.478+0000 7fc34fd67b80 1 -- start start 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3afa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 0x557ba3b06650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3af2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401b4150 con 0x557ba3af0810 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401b1980 con 0x557ba3af6240 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401af7f0 con 0x557ba3af11d0 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc33e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3afa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc33e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3afa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43286/0 (socket says 172.21.15.70:43286) 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc33e800700 1 -- 172.21.15.70:0/2823146428 learned_addr learned my addr 172.21.15.70:0/2823146428 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc337e00700 1 --2- 172.21.15.70:0/2823146428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 0x557ba3b06650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc33f200700 1 --2- 172.21.15.70:0/2823146428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3af2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc33e800700 1 -- 172.21.15.70:0/2823146428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 msgr2=0x557ba3b06650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.479+0000 7fc33e800700 1 --2- 172.21.15.70:0/2823146428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 0x557ba3b06650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.480+0000 7fc33e800700 1 -- 172.21.15.70:0/2823146428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 msgr2=0x557ba3af2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.480+0000 7fc33e800700 1 --2- 172.21.15.70:0/2823146428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3af2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.480+0000 7fc33e800700 1 -- 172.21.15.70:0/2823146428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ba3b0cf40 con 0x557ba3af0810 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.480+0000 7fc33e800700 1 --2- 172.21.15.70:0/2823146428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3afa500 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc33000a920 tx=0x7fc330005eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429f76815bbd8f39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.480+0000 7fc32f400700 1 -- 172.21.15.70:0/2823146428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33002f070 con 0x557ba3af0810 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.480+0000 7fc32f400700 1 -- 172.21.15.70:0/2823146428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc33000fd30 con 0x557ba3af0810 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.480+0000 7fc32f400700 1 -- 172.21.15.70:0/2823146428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc330005720 con 0x557ba3af0810 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.481+0000 7fc34fd67b80 1 -- 172.21.15.70:0/2823146428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 msgr2=0x557ba3afa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.481+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/2823146428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3afa500 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc33000a920 tx=0x7fc330005eb0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.481+0000 7fc34fd67b80 1 -- 172.21.15.70:0/2823146428 shutdown_connections 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.481+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/2823146428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3af2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.481+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/2823146428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af0810 0x557ba3afa500 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.481+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/2823146428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af11d0 0x557ba3b06650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.481+0000 7fc34fd67b80 1 -- 172.21.15.70:0/2823146428 >> 172.21.15.70:0/2823146428 conn(0x557ba3a68860 msgr2=0x557ba3ae5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.481+0000 7fc34fd67b80 1 -- 172.21.15.70:0/2823146428 shutdown_connections 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.481+0000 7fc34fd67b80 1 -- 172.21.15.70:0/2823146428 wait complete. 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.482+0000 7fc34fd67b80 1 -- start start 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.482+0000 7fc34fd67b80 1 Processor -- start 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 0x557ba3b02f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af11d0 0x557ba3afe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc34fd67b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3afe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401afe40 con 0x557ba3af11d0 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401b12b0 con 0x557ba3af6240 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc34fd67b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3401b0510 con 0x557ba3af0810 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc34fd67b80 10 client.0 _ll_register_callbacks cb 0x557ba39e9e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc337e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af11d0 0x557ba3afe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc337e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af11d0 0x557ba3afe2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43290/0 (socket says 172.21.15.70:43290) 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc337e00700 1 -- 172.21.15.70:0/3863463188 learned_addr learned my addr 172.21.15.70:0/3863463188 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc33e800700 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 0x557ba3b02f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.483+0000 7fc33f200700 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3afe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.484+0000 7fc337e00700 1 -- 172.21.15.70:0/3863463188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 msgr2=0x557ba3b02f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.484+0000 7fc337e00700 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 0x557ba3b02f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.484+0000 7fc337e00700 1 -- 172.21.15.70:0/3863463188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 msgr2=0x557ba3afe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.484+0000 7fc337e00700 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3afe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.484+0000 7fc337e00700 1 -- 172.21.15.70:0/3863463188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ba3ae7d00 con 0x557ba3af11d0 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.484+0000 7fc337e00700 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af11d0 0x557ba3afe2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc3280dfd80 tx=0x7fc3280108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d58100a6bac5f10 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.484+0000 7fc32cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.484+0000 7fc32cc00700 1 -- 172.21.15.70:0/3863463188 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc328020040 con 0x557ba3af11d0 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.485+0000 7fc32cc00700 1 -- 172.21.15.70:0/3863463188 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(126..126 src has 1..126) ==== 9671+0+0 (secure 0 0 0) 0x7fc3280a9770 con 0x557ba3af11d0 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.485+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3863463188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ba3a50590 con 0x557ba3af11d0 2024-05-08T07:10:12.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.485+0000 7fc32cc00700 1 -- 172.21.15.70:0/3863463188 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc3280a9a10 con 0x557ba3af11d0 2024-05-08T07:10:12.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.485+0000 7fc34fd67b80 10 client.16152 fetch_fsmap learned FSMap version 30 2024-05-08T07:10:12.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.485+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3863463188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557ba3b76c80 con 0x557ba3af11d0 2024-05-08T07:10:12.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.485+0000 7fc32cc00700 1 -- 172.21.15.70:0/3863463188 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x557ba3a50590 con 0x557ba3af11d0 2024-05-08T07:10:12.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.485+0000 7fc32cc00700 1 -- 172.21.15.70:0/3863463188 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc3280b1ce0 con 0x557ba3af11d0 2024-05-08T07:10:12.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.486+0000 7fc34fd67b80 10 client.16152 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T07:10:12.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.486+0000 7fc34fd67b80 10 client.16152 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:10:12.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.486+0000 7fc34fd67b80 20 client.16152 populate_metadata read hostname 'smithi070' 2024-05-08T07:10:12.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.486+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ba3b773c0 0x557ba3b797e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:12.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.486+0000 7fc34fd67b80 4 client.16152 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.6, "await_for": 42.0}] 2024-05-08T07:10:12.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.486+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3863463188 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.6, "await_for": 42.0}) -- 0x557ba3a4a630 con 0x557ba3b773c0 2024-05-08T07:10:12.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.486+0000 7fc33e800700 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ba3b773c0 0x557ba3b797e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:12.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.487+0000 7fc33e800700 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ba3b773c0 0x557ba3b797e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c12897979b51aeea server_cookie=41fbf41400bc1410 in_seq=0 out_seq=0 2024-05-08T07:10:12.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:12.487+0000 7fc32cc00700 10 client.16152 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:10:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:13 smithi070 ceph-mon[29591]: osdmap e127: 12 total, 12 up, 12 in 2024-05-08T07:10:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:13 smithi070 ceph-mon[29591]: pgmap v747: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 1.2 MiB/s wr, 289 op/s 2024-05-08T07:10:13.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:13 smithi172 ceph-mon[33377]: osdmap e127: 12 total, 12 up, 12 in 2024-05-08T07:10:13.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:13 smithi172 ceph-mon[33377]: pgmap v747: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 1.2 MiB/s wr, 289 op/s 2024-05-08T07:10:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:13 smithi194 ceph-mon[33679]: osdmap e127: 12 total, 12 up, 12 in 2024-05-08T07:10:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:13 smithi194 ceph-mon[33679]: pgmap v747: 129 pgs: 129 active+clean; 1.2 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 1.2 MiB/s wr, 289 op/s 2024-05-08T07:10:15.732 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:15 smithi172 ceph-mon[33377]: pgmap v748: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 2.1 MiB/s wr, 414 op/s 2024-05-08T07:10:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:15 smithi194 ceph-mon[33679]: pgmap v748: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 2.1 MiB/s wr, 414 op/s 2024-05-08T07:10:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:15 smithi070 ceph-mon[29591]: pgmap v748: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 2.1 MiB/s wr, 414 op/s 2024-05-08T07:10:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:17 smithi194 ceph-mon[33679]: pgmap v749: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.7 MiB/s wr, 332 op/s 2024-05-08T07:10:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:17 smithi070 ceph-mon[29591]: pgmap v749: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.7 MiB/s wr, 332 op/s 2024-05-08T07:10:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:17 smithi172 ceph-mon[33377]: pgmap v749: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.7 MiB/s wr, 332 op/s 2024-05-08T07:10:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:19 smithi194 ceph-mon[33679]: pgmap v750: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 761 KiB/s wr, 106 op/s 2024-05-08T07:10:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:19 smithi070 ceph-mon[29591]: pgmap v750: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 761 KiB/s wr, 106 op/s 2024-05-08T07:10:19.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:19 smithi172 ceph-mon[33377]: pgmap v750: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 761 KiB/s wr, 106 op/s 2024-05-08T07:10:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:21 smithi194 ceph-mon[33679]: pgmap v751: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 761 KiB/s wr, 106 op/s 2024-05-08T07:10:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:21 smithi070 ceph-mon[29591]: pgmap v751: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 761 KiB/s wr, 106 op/s 2024-05-08T07:10:21.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:21 smithi172 ceph-mon[33377]: pgmap v751: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 761 KiB/s wr, 106 op/s 2024-05-08T07:10:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:23 smithi194 ceph-mon[33679]: pgmap v752: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 701 KiB/s wr, 98 op/s 2024-05-08T07:10:23.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:23 smithi070 ceph-mon[29591]: pgmap v752: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 701 KiB/s wr, 98 op/s 2024-05-08T07:10:23.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:23 smithi172 ceph-mon[33377]: pgmap v752: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 701 KiB/s wr, 98 op/s 2024-05-08T07:10:25.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:25 smithi194 ceph-mon[33679]: pgmap v753: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 672 KiB/s wr, 94 op/s 2024-05-08T07:10:25.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:25 smithi070 ceph-mon[29591]: pgmap v753: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 672 KiB/s wr, 94 op/s 2024-05-08T07:10:25.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:25 smithi172 ceph-mon[33377]: pgmap v753: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 672 KiB/s wr, 94 op/s 2024-05-08T07:10:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc32cc00700 1 -- 172.21.15.70:0/3863463188 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x557ba3a4a630 con 0x557ba3b773c0 2024-05-08T07:10:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc32cc00700 10 client.16152 handle_command_reply: tid=0 2024-05-08T07:10:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc34fd67b80 1 client.16152 shutdown 2024-05-08T07:10:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3863463188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af11d0 msgr2=0x557ba3afe2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af11d0 0x557ba3afe2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fc3280dfd80 tx=0x7fc3280108d0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3863463188 shutdown_connections 2024-05-08T07:10:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ba3b773c0 0x557ba3b797e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ba3af6240 0x557ba3afe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ba3af0810 0x557ba3b02f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc32cc00700 0 client.16152 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:10:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc34fd67b80 1 --2- 172.21.15.70:0/3863463188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ba3af11d0 0x557ba3afe2f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.085+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3863463188 >> 172.21.15.70:0/3863463188 conn(0x557ba3a68860 msgr2=0x557ba3af3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.086+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3863463188 shutdown_connections 2024-05-08T07:10:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.086+0000 7fc34fd67b80 1 -- 172.21.15.70:0/3863463188 wait complete. 2024-05-08T07:10:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.086+0000 7fc34fd67b80 20 client.16152 trim_cache size 0 max 16384 2024-05-08T07:10:27.086 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 30, 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 62, 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "f0530d39": { 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 62, 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:10:27.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.6, 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:27.088 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:10:27.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.087+0000 7fc345400700 1 -- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3240b2b20 msgr2=0x7fc3240b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:27.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.087+0000 7fc345400700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3240b2b20 0x7fc3240b4fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc338009fd0 tx=0x7fc3380099e0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.087+0000 7fc345400700 1 -- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34006c370 msgr2=0x7fc3401a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:27.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.087+0000 7fc345400700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34006c370 0x7fc3401a1ca0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc32800d950 tx=0x7fc32800dc60 comp rx=0 tx=0).stop 2024-05-08T07:10:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.088+0000 7fc345400700 1 -- 172.21.15.70:0/1505564714 shutdown_connections 2024-05-08T07:10:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.088+0000 7fc345400700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3240b2b20 0x7fc3240b4fe0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.088+0000 7fc345400700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc34010ff40 0x7fc34019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.088+0000 7fc345400700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc34006ba50 0x7fc3401a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.088+0000 7fc345400700 1 --2- 172.21.15.70:0/1505564714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc34006c370 0x7fc3401a1ca0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.088+0000 7fc345400700 1 -- 172.21.15.70:0/1505564714 >> 172.21.15.70:0/1505564714 conn(0x7fc3400793e0 msgr2=0x7fc3401112b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.088+0000 7fc345400700 1 -- 172.21.15.70:0/1505564714 shutdown_connections 2024-05-08T07:10:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:27.088+0000 7fc345400700 1 -- 172.21.15.70:0/1505564714 wait complete. 2024-05-08T07:10:27.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:27 smithi194 ceph-mon[33679]: pgmap v754: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-05-08T07:10:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:27 smithi070 ceph-mon[29591]: pgmap v754: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-05-08T07:10:27.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:27 smithi172 ceph-mon[33377]: pgmap v754: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 64 KiB/s wr, 10 op/s 2024-05-08T07:10:27.995 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f0530d39', quiesce took 22.9 seconds. Will release after: 10.6 2024-05-08T07:10:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:29 smithi194 ceph-mon[33679]: pgmap v755: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 141 KiB/s wr, 147 op/s 2024-05-08T07:10:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:29 smithi070 ceph-mon[29591]: pgmap v755: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 141 KiB/s wr, 147 op/s 2024-05-08T07:10:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:29 smithi172 ceph-mon[33377]: pgmap v755: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 141 KiB/s wr, 147 op/s 2024-05-08T07:10:31.771 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:31 smithi194 ceph-mon[33679]: pgmap v756: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 115 KiB/s wr, 142 op/s 2024-05-08T07:10:31.997 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:31 smithi172 ceph-mon[33377]: pgmap v756: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 115 KiB/s wr, 142 op/s 2024-05-08T07:10:31.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:31 smithi070 ceph-mon[29591]: pgmap v756: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 115 KiB/s wr, 142 op/s 2024-05-08T07:10:33.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:33 smithi070 ceph-mon[29591]: pgmap v757: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 115 KiB/s wr, 142 op/s 2024-05-08T07:10:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:33 smithi194 ceph-mon[33679]: pgmap v757: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 115 KiB/s wr, 142 op/s 2024-05-08T07:10:33.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:33 smithi172 ceph-mon[33377]: pgmap v757: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 115 KiB/s wr, 142 op/s 2024-05-08T07:10:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:35 smithi070 ceph-mon[29591]: pgmap v758: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 119 KiB/s wr, 145 op/s 2024-05-08T07:10:35.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:35 smithi194 ceph-mon[33679]: pgmap v758: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 119 KiB/s wr, 145 op/s 2024-05-08T07:10:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:35 smithi172 ceph-mon[33377]: pgmap v758: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 119 KiB/s wr, 145 op/s 2024-05-08T07:10:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:37 smithi194 ceph-mon[33679]: pgmap v759: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 82 KiB/s wr, 139 op/s 2024-05-08T07:10:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:37 smithi070 ceph-mon[29591]: pgmap v759: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 82 KiB/s wr, 139 op/s 2024-05-08T07:10:37.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:37 smithi172 ceph-mon[33377]: pgmap v759: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 82 KiB/s wr, 139 op/s 2024-05-08T07:10:38.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:10:39.057 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:10:40.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:40 smithi194 ceph-mon[33679]: pgmap v760: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 86 KiB/s wr, 142 op/s 2024-05-08T07:10:40.854 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:40 smithi070 ceph-mon[29591]: pgmap v760: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 86 KiB/s wr, 142 op/s 2024-05-08T07:10:40.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:40 smithi172 ceph-mon[33377]: pgmap v760: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 86 KiB/s wr, 142 op/s 2024-05-08T07:10:41.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.355+0000 7fa1b2800700 1 -- 172.21.15.70:0/4054505594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06bb40 msgr2=0x7fa1ac110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.355+0000 7fa1b2800700 1 --2- 172.21.15.70:0/4054505594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06bb40 0x7fa1ac110330 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa1a400b0a0 tx=0x7fa1a400b3b0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.355+0000 7fa1b2800700 1 -- 172.21.15.70:0/4054505594 shutdown_connections 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.355+0000 7fa1b2800700 1 --2- 172.21.15.70:0/4054505594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06bb40 0x7fa1ac110330 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.355+0000 7fa1b2800700 1 --2- 172.21.15.70:0/4054505594 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1ac109510 0x7fa1ac1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.355+0000 7fa1b2800700 1 --2- 172.21.15.70:0/4054505594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06b180 0x7fa1ac06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.355+0000 7fa1b2800700 1 -- 172.21.15.70:0/4054505594 >> 172.21.15.70:0/4054505594 conn(0x7fa1ac079350 msgr2=0x7fa1ac079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.355+0000 7fa1b2800700 1 -- 172.21.15.70:0/4054505594 shutdown_connections 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.355+0000 7fa1b2800700 1 -- 172.21.15.70:0/4054505594 wait complete. 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.356+0000 7fa1b2800700 1 Processor -- start 2024-05-08T07:10:41.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.356+0000 7fa1b2800700 1 -- start start 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1b2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06b180 0x7fa1ac1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1b2800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06bb40 0x7fa1ac1a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1b2800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1ac109510 0x7fa1ac19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1b2800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac113540 con 0x7fa1ac06b180 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1b2800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac1133c0 con 0x7fa1ac109510 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1b2800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac1136c0 con 0x7fa1ac06bb40 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1ab400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06b180 0x7fa1ac1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1ab400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06b180 0x7fa1ac1a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37436/0 (socket says 172.21.15.70:37436) 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1ab400700 1 -- 172.21.15.70:0/1413464132 learned_addr learned my addr 172.21.15.70:0/1413464132 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:41.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.357+0000 7fa1aaa00700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06bb40 0x7fa1ac1a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1abe00700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1ac109510 0x7fa1ac19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1ab400700 1 -- 172.21.15.70:0/1413464132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06bb40 msgr2=0x7fa1ac1a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1ab400700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06bb40 0x7fa1ac1a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1ab400700 1 -- 172.21.15.70:0/1413464132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1ac109510 msgr2=0x7fa1ac19bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1ab400700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1ac109510 0x7fa1ac19bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1ab400700 1 -- 172.21.15.70:0/1413464132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac19c220 con 0x7fa1ac06b180 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1ab400700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06b180 0x7fa1ac1a1900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00d950 tx=0x7fa19c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1a3e00700 1 -- 172.21.15.70:0/1413464132 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c016070 con 0x7fa1ac06b180 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ac19c510 con 0x7fa1ac06b180 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.358+0000 7fa1a3e00700 1 -- 172.21.15.70:0/1413464132 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa19c010460 con 0x7fa1ac06b180 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.359+0000 7fa1a3e00700 1 -- 172.21.15.70:0/1413464132 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00f620 con 0x7fa1ac06b180 2024-05-08T07:10:41.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.359+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ac1a87d0 con 0x7fa1ac06b180 2024-05-08T07:10:41.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.360+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1ac06a190 con 0x7fa1ac06b180 2024-05-08T07:10:41.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.362+0000 7fa1a3e00700 1 -- 172.21.15.70:0/1413464132 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa19c019070 con 0x7fa1ac06b180 2024-05-08T07:10:41.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.364+0000 7fa1a3e00700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1900b2a70 0x7fa1900b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:41.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.364+0000 7fa1a3e00700 1 -- 172.21.15.70:0/1413464132 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9583+0+0 (secure 0 0 0) 0x7fa19c0e25b0 con 0x7fa1ac06b180 2024-05-08T07:10:41.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.364+0000 7fa1aaa00700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1900b2a70 0x7fa1900b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:41.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.365+0000 7fa1aaa00700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1900b2a70 0x7fa1900b4f30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa198005950 tx=0x7fa1980058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:41.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.369+0000 7fa1a3e00700 1 -- 172.21.15.70:0/1413464132 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa19c0a9b10 con 0x7fa1ac06b180 2024-05-08T07:10:41.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:10:41.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.666+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1ac19cff0 con 0x7fa1ac06b180 2024-05-08T07:10:41.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.667+0000 7fa1a3e00700 1 -- 172.21.15.70:0/1413464132 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11882 (secure 0 0 0) 0x7fa19c0a9410 con 0x7fa1ac06b180 2024-05-08T07:10:41.667 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:10:41.667 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:07:48.266486+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:10:41.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1900b2a70 msgr2=0x7fa1900b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:41.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1900b2a70 0x7fa1900b4f30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa198005950 tx=0x7fa1980058e0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06b180 msgr2=0x7fa1ac1a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:41.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06b180 0x7fa1ac1a1900 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00d950 tx=0x7fa19c00dd10 comp rx=0 tx=0).stop 2024-05-08T07:10:41.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 shutdown_connections 2024-05-08T07:10:41.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa1900b2a70 0x7fa1900b4f30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1ac109510 0x7fa1ac19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1ac06b180 0x7fa1ac1a1900 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 --2- 172.21.15.70:0/1413464132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac06bb40 0x7fa1ac1a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:41.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.670+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 >> 172.21.15.70:0/1413464132 conn(0x7fa1ac079350 msgr2=0x7fa1ac10e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:41.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.671+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 shutdown_connections 2024-05-08T07:10:41.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:41.671+0000 7fa1b2800700 1 -- 172.21.15.70:0/1413464132 wait complete. 2024-05-08T07:10:41.671 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 30 2024-05-08T07:10:41.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:10:41.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:10:42.451 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id f0530d39 --release --await' 2024-05-08T07:10:42.451 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id f0530d39 --release --await 2024-05-08T07:10:42.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:42 smithi194 ceph-mon[33679]: pgmap v761: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:10:42.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:42 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1413464132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:10:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:42 smithi070 ceph-mon[29591]: pgmap v761: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:10:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:42 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1413464132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:10:42.897 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:10:42.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:42 smithi172 ceph-mon[33377]: pgmap v761: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:10:42.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:42 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1413464132' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:10:44.611 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:44 smithi070 ceph-mon[29591]: pgmap v762: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:10:44.638 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:44 smithi194 ceph-mon[33679]: pgmap v762: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:10:44.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:44 smithi172 ceph-mon[33377]: pgmap v762: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:10:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.144+0000 7f822b200700 1 -- 172.21.15.70:0/701279228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 msgr2=0x7f822410ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.144+0000 7f822b200700 1 --2- 172.21.15.70:0/701279228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 0x7f822410ff40 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8214009990 tx=0x7f8214009ca0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.144+0000 7f822b200700 1 -- 172.21.15.70:0/701279228 shutdown_connections 2024-05-08T07:10:45.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.144+0000 7f822b200700 1 --2- 172.21.15.70:0/701279228 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f822410a490 0x7f82241169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.144+0000 7f822b200700 1 --2- 172.21.15.70:0/701279228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 0x7f822410ff40 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.144+0000 7f822b200700 1 --2- 172.21.15.70:0/701279228 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8224109ad0 0x7f8224109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.144+0000 7f822b200700 1 -- 172.21.15.70:0/701279228 >> 172.21.15.70:0/701279228 conn(0x7f8224076c70 msgr2=0x7f82241082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.144+0000 7f822b200700 1 -- 172.21.15.70:0/701279228 shutdown_connections 2024-05-08T07:10:45.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.144+0000 7f822b200700 1 -- 172.21.15.70:0/701279228 wait complete. 2024-05-08T07:10:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.145+0000 7f822b200700 1 Processor -- start 2024-05-08T07:10:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.145+0000 7f822b200700 1 -- start start 2024-05-08T07:10:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f822b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8224109ad0 0x7f82241a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f822b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f822410a490 0x7f82241a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f822b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 0x7f82241a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f822b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8224119b80 con 0x7f822410fb60 2024-05-08T07:10:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f822b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8224119a00 con 0x7f8224109ad0 2024-05-08T07:10:45.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f822b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8224119d00 con 0x7f822410a490 2024-05-08T07:10:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f8229200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 0x7f82241a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f8229200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 0x7f82241a4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37440/0 (socket says 172.21.15.70:37440) 2024-05-08T07:10:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f8229200700 1 -- 172.21.15.70:0/4091446050 learned_addr learned my addr 172.21.15.70:0/4091446050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f8223400700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f822410a490 0x7f82241a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.146+0000 7f8223e00700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8224109ad0 0x7f82241a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.147+0000 7f8229200700 1 -- 172.21.15.70:0/4091446050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f822410a490 msgr2=0x7f82241a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:45.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.147+0000 7f8229200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f822410a490 0x7f82241a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.147+0000 7f8229200700 1 -- 172.21.15.70:0/4091446050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8224109ad0 msgr2=0x7f82241a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.147+0000 7f8229200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8224109ad0 0x7f82241a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.147+0000 7f8229200700 1 -- 172.21.15.70:0/4091446050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82241a5050 con 0x7f822410fb60 2024-05-08T07:10:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.147+0000 7f8229200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 0x7f82241a4910 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f821c00ef30 tx=0x7f821c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.148+0000 7f8220c00700 1 -- 172.21.15.70:0/4091446050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c0092e0 con 0x7f822410fb60 2024-05-08T07:10:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.148+0000 7f822b200700 1 -- 172.21.15.70:0/4091446050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82241a52e0 con 0x7f822410fb60 2024-05-08T07:10:45.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.148+0000 7f8220c00700 1 -- 172.21.15.70:0/4091446050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f821c004bb0 con 0x7f822410fb60 2024-05-08T07:10:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.148+0000 7f8220c00700 1 -- 172.21.15.70:0/4091446050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c004020 con 0x7f822410fb60 2024-05-08T07:10:45.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.148+0000 7f822b200700 1 -- 172.21.15.70:0/4091446050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82241acbc0 con 0x7f822410fb60 2024-05-08T07:10:45.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.152+0000 7f8220c00700 1 -- 172.21.15.70:0/4091446050 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f821c01b030 con 0x7f822410fb60 2024-05-08T07:10:45.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.153+0000 7f8235bbab80 1 Processor -- start 2024-05-08T07:10:45.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8235bbab80 1 -- start start 2024-05-08T07:10:45.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 0x55c253d66590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 0x55c253d60c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8235bbab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c253cb2b20 con 0x55c253d61140 2024-05-08T07:10:45.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8235bbab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c253c50860 con 0x55c253d60780 2024-05-08T07:10:45.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8235bbab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c253caeae0 con 0x55c253d661b0 2024-05-08T07:10:45.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8220c00700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82080b29f0 0x7f82080b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8220c00700 1 -- 172.21.15.70:0/4091446050 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 9583+0+0 (secure 0 0 0) 0x7f821c0e24a0 con 0x7f822410fb60 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.154+0000 7f8229200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82080b29f0 0x7f82080b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37452/0 (socket says 172.21.15.70:37452) 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223400700 1 -- 172.21.15.70:0/2142701654 learned_addr learned my addr 172.21.15.70:0/2142701654 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223e00700 1 --2- 172.21.15.70:0/2142701654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 0x55c253d60c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223400700 1 --2- 172.21.15.70:0/2142701654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 0x55c253d66590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223400700 1 -- 172.21.15.70:0/2142701654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 msgr2=0x55c253d66590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223400700 1 --2- 172.21.15.70:0/2142701654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 0x55c253d66590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223400700 1 -- 172.21.15.70:0/2142701654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 msgr2=0x55c253d60c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223400700 1 --2- 172.21.15.70:0/2142701654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 0x55c253d60c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.155+0000 7f8223400700 1 -- 172.21.15.70:0/2142701654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c253bff9d0 con 0x55c253d61140 2024-05-08T07:10:45.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.156+0000 7f8223400700 1 --2- 172.21.15.70:0/2142701654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6cf70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8210012840 tx=0x7f821000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b35aac6341f671 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:45.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.156+0000 7f8229200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82080b29f0 0x7f82080b4eb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f821c000f80 tx=0x7f821c009040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:45.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.156+0000 7f8219600700 1 -- 172.21.15.70:0/2142701654 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210012e60 con 0x55c253d61140 2024-05-08T07:10:45.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.156+0000 7f8219600700 1 -- 172.21.15.70:0/2142701654 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82100044c0 con 0x55c253d61140 2024-05-08T07:10:45.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.156+0000 7f8219600700 1 -- 172.21.15.70:0/2142701654 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210005240 con 0x55c253d61140 2024-05-08T07:10:45.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 -- 172.21.15.70:0/2142701654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 msgr2=0x55c253d6cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:45.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2142701654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6cf70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8210012840 tx=0x7f821000b860 comp rx=0 tx=0).stop 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 -- 172.21.15.70:0/2142701654 shutdown_connections 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2142701654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6cf70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2142701654 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 0x55c253d66590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2142701654 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 0x55c253d60c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 -- 172.21.15.70:0/2142701654 >> 172.21.15.70:0/2142701654 conn(0x55c253cd87d0 msgr2=0x55c253d5b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 -- 172.21.15.70:0/2142701654 shutdown_connections 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 -- 172.21.15.70:0/2142701654 wait complete. 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.157+0000 7f8235bbab80 1 -- start start 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.158+0000 7f8235bbab80 1 Processor -- start 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.158+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 0x55c253d6cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.158+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d69f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.158+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 0x55c253d6a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.158+0000 7f8235bbab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c253d6d510 con 0x55c253d61140 2024-05-08T07:10:45.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.158+0000 7f8235bbab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c253c18c20 con 0x55c253d60780 2024-05-08T07:10:45.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.158+0000 7f8235bbab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c253d6d690 con 0x55c253d661b0 2024-05-08T07:10:45.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.158+0000 7f8235bbab80 10 client.0 _ll_register_callbacks cb 0x55c253c59d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:10:45.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.158+0000 7f8223e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d69f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d69f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37464/0 (socket says 172.21.15.70:37464) 2024-05-08T07:10:45.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223e00700 1 -- 172.21.15.70:0/2849371637 learned_addr learned my addr 172.21.15.70:0/2849371637 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:45.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223400700 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 0x55c253d6a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223400700 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 0x55c253d6cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223e00700 1 -- 172.21.15.70:0/2849371637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 msgr2=0x55c253d6a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223e00700 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 0x55c253d6a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223e00700 1 -- 172.21.15.70:0/2849371637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 msgr2=0x55c253d6cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223e00700 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 0x55c253d6cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223e00700 1 -- 172.21.15.70:0/2849371637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c253c78520 con 0x55c253d61140 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223400700 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 0x55c253d6cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f8223e00700 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d69f60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8214015000 tx=0x7f82140095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d03f022e706b920 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.159+0000 7f820e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.160+0000 7f820e000700 1 -- 172.21.15.70:0/2849371637 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214029060 con 0x55c253d61140 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.160+0000 7f820e000700 1 -- 172.21.15.70:0/2849371637 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 9583+0+0 (secure 0 0 0) 0x7f821400b6b0 con 0x55c253d61140 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.160+0000 7f8235bbab80 1 -- 172.21.15.70:0/2849371637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82100044c0 con 0x55c253d61140 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.160+0000 7f820e000700 1 -- 172.21.15.70:0/2849371637 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8214030050 con 0x55c253d61140 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.160+0000 7f8235bbab80 10 client.16170 fetch_fsmap learned FSMap version 30 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.160+0000 7f8235bbab80 1 -- 172.21.15.70:0/2849371637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c253d77d10 con 0x55c253d61140 2024-05-08T07:10:45.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.160+0000 7f820e000700 1 -- 172.21.15.70:0/2849371637 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82100044c0 con 0x55c253d61140 2024-05-08T07:10:45.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.160+0000 7f820e000700 1 -- 172.21.15.70:0/2849371637 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f821400f7d0 con 0x55c253d61140 2024-05-08T07:10:45.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.161+0000 7f8235bbab80 10 client.16170 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T07:10:45.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.161+0000 7f8235bbab80 10 client.16170 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:10:45.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.161+0000 7f8235bbab80 20 client.16170 populate_metadata read hostname 'smithi070' 2024-05-08T07:10:45.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.161+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c253d7a350 0x55c253d7c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.161+0000 7f8235bbab80 4 client.16170 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:10:45.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.161+0000 7f8235bbab80 1 -- 172.21.15.70:0/2849371637 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c253d2d240 con 0x55c253d7a350 2024-05-08T07:10:45.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.161+0000 7f8223400700 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c253d7a350 0x55c253d7c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.162+0000 7f820e000700 10 client.16170 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:10:45.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.162+0000 7f8223400700 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c253d7a350 0x55c253d7c740 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4ba8d54f442c444 server_cookie=e42655011097d173 in_seq=0 out_seq=0 2024-05-08T07:10:45.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.164+0000 7f820e000700 1 -- 172.21.15.70:0/2849371637 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c253d2d240 con 0x55c253d7a350 2024-05-08T07:10:45.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.164+0000 7f820e000700 10 client.16170 handle_command_reply: tid=0 2024-05-08T07:10:45.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 client.16170 shutdown 2024-05-08T07:10:45.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 -- 172.21.15.70:0/2849371637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 msgr2=0x55c253d69f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:45.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d69f60 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8214015000 tx=0x7f82140095c0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 -- 172.21.15.70:0/2849371637 shutdown_connections 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c253d7a350 0x55c253d7c740 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d661b0 0x55c253d6a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d60780 0x55c253d6cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f820e000700 0 client.16170 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 --2- 172.21.15.70:0/2849371637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d69f60 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 -- 172.21.15.70:0/2849371637 >> 172.21.15.70:0/2849371637 conn(0x55c253cd87d0 msgr2=0x55c253d55b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 -- 172.21.15.70:0/2849371637 shutdown_connections 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 1 -- 172.21.15.70:0/2849371637 wait complete. 2024-05-08T07:10:45.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.165+0000 7f8235bbab80 20 client.16170 trim_cache size 0 max 16384 2024-05-08T07:10:45.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8235bbab80 1 Processor -- start 2024-05-08T07:10:45.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8235bbab80 1 -- start start 2024-05-08T07:10:45.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 0x55c253d765a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d61140 0x55c253d64340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d661b0 0x55c253d82030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8235bbab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b84b0 con 0x55c253d661b0 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8235bbab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b5ce0 con 0x55c253d61140 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8235bbab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b3b50 con 0x55c253d60780 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d661b0 0x55c253d82030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d661b0 0x55c253d82030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37480/0 (socket says 172.21.15.70:37480) 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.187+0000 7f8223400700 1 -- 172.21.15.70:0/633813334 learned_addr learned my addr 172.21.15.70:0/633813334 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.188+0000 7f8223400700 1 --2- 172.21.15.70:0/633813334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 0x55c253d765a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.188+0000 7f8223e00700 1 --2- 172.21.15.70:0/633813334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d61140 0x55c253d64340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.188+0000 7f8223400700 1 -- 172.21.15.70:0/633813334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 msgr2=0x55c253d765a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.188+0000 7f8223400700 1 --2- 172.21.15.70:0/633813334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 0x55c253d765a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.188+0000 7f8223400700 1 -- 172.21.15.70:0/633813334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d61140 msgr2=0x55c253d64340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.188+0000 7f8223400700 1 --2- 172.21.15.70:0/633813334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d61140 0x55c253d64340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.188+0000 7f8223400700 1 -- 172.21.15.70:0/633813334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c253d7cda0 con 0x55c253d661b0 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.188+0000 7f8223400700 1 --2- 172.21.15.70:0/633813334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d661b0 0x55c253d82030 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8210013e40 tx=0x7f8210004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cd4593adf1402f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8218c00700 1 -- 172.21.15.70:0/633813334 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210004850 con 0x55c253d661b0 2024-05-08T07:10:45.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8218c00700 1 -- 172.21.15.70:0/633813334 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82100049f0 con 0x55c253d661b0 2024-05-08T07:10:45.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8218c00700 1 -- 172.21.15.70:0/633813334 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8210029240 con 0x55c253d661b0 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8235bbab80 1 -- 172.21.15.70:0/633813334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d661b0 msgr2=0x55c253d82030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8235bbab80 1 --2- 172.21.15.70:0/633813334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d661b0 0x55c253d82030 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8210013e40 tx=0x7f8210004670 comp rx=0 tx=0).stop 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8235bbab80 1 -- 172.21.15.70:0/633813334 shutdown_connections 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8235bbab80 1 --2- 172.21.15.70:0/633813334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d661b0 0x55c253d82030 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8235bbab80 1 --2- 172.21.15.70:0/633813334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 0x55c253d765a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8235bbab80 1 --2- 172.21.15.70:0/633813334 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d61140 0x55c253d64340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.189+0000 7f8235bbab80 1 -- 172.21.15.70:0/633813334 >> 172.21.15.70:0/633813334 conn(0x55c253cd87d0 msgr2=0x55c253d63c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.190+0000 7f8235bbab80 1 -- 172.21.15.70:0/633813334 shutdown_connections 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.190+0000 7f8235bbab80 1 -- 172.21.15.70:0/633813334 wait complete. 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.190+0000 7f8235bbab80 1 -- start start 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.190+0000 7f8235bbab80 1 Processor -- start 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 0x55c253d6f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8235bbab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d661b0 0x55c253de4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8235bbab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b41a0 con 0x55c253d61140 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8235bbab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b5610 con 0x55c253d661b0 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8235bbab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f82241b4870 con 0x55c253d60780 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8235bbab80 10 client.0 _ll_register_callbacks cb 0x55c253c59d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8223e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8223e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37486/0 (socket says 172.21.15.70:37486) 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8223e00700 1 -- 172.21.15.70:0/3288732017 learned_addr learned my addr 172.21.15.70:0/3288732017 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8223400700 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 0x55c253d6f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8223e00700 1 -- 172.21.15.70:0/3288732017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 msgr2=0x55c253d6f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8223400700 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d661b0 0x55c253de4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8223e00700 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 0x55c253d6f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.191+0000 7f8223e00700 1 -- 172.21.15.70:0/3288732017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d661b0 msgr2=0x55c253de4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.192+0000 7f8223e00700 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d661b0 0x55c253de4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.192+0000 7f8223e00700 1 -- 172.21.15.70:0/3288732017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c253d57c70 con 0x55c253d61140 2024-05-08T07:10:45.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.192+0000 7f8223400700 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d661b0 0x55c253de4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:10:45.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.192+0000 7f8223e00700 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6fe30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f821400b650 tx=0x7f8214005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cef69b6004e270 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:10:45.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.192+0000 7f820e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:10:45.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.192+0000 7f820e000700 1 -- 172.21.15.70:0/3288732017 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214029040 con 0x55c253d61140 2024-05-08T07:10:45.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.192+0000 7f8235bbab80 1 -- 172.21.15.70:0/3288732017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82100049f0 con 0x55c253d61140 2024-05-08T07:10:45.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.192+0000 7f820e000700 1 -- 172.21.15.70:0/3288732017 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(127..127 src has 1..127) ==== 9583+0+0 (secure 0 0 0) 0x7f821400f870 con 0x55c253d61140 2024-05-08T07:10:45.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.192+0000 7f820e000700 1 -- 172.21.15.70:0/3288732017 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8214043050 con 0x55c253d61140 2024-05-08T07:10:45.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f8235bbab80 10 client.16176 fetch_fsmap learned FSMap version 30 2024-05-08T07:10:45.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f8235bbab80 1 -- 172.21.15.70:0/3288732017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c253de6130 con 0x55c253d61140 2024-05-08T07:10:45.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f820e000700 1 -- 172.21.15.70:0/3288732017 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82100049f0 con 0x55c253d61140 2024-05-08T07:10:45.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f820e000700 1 -- 172.21.15.70:0/3288732017 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8214003ce0 con 0x55c253d61140 2024-05-08T07:10:45.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f8235bbab80 10 client.16176 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T07:10:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f8235bbab80 10 client.16176 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:10:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f8235bbab80 20 client.16176 populate_metadata read hostname 'smithi070' 2024-05-08T07:10:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f8235bbab80 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c253de6800 0x55c253de8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:10:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f8235bbab80 4 client.16176 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f0530d39", "release": true, "await": true}] 2024-05-08T07:10:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.193+0000 7f8235bbab80 1 -- 172.21.15.70:0/3288732017 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f0530d39", "release": true, "await": true}) -- 0x55c253cc0500 con 0x55c253de6800 2024-05-08T07:10:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.194+0000 7f8223400700 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c253de6800 0x55c253de8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:10:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.195+0000 7f8223400700 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c253de6800 0x55c253de8c20 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5b604368ac7d26c server_cookie=49a8132a4c655a4a in_seq=0 out_seq=0 2024-05-08T07:10:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:45.195+0000 7f820e000700 10 client.16176 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:10:46.674 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:46 smithi194 ceph-mon[33679]: pgmap v763: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-05-08T07:10:46.731 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:46 smithi172 ceph-mon[33377]: pgmap v763: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-05-08T07:10:46.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:46 smithi070 ceph-mon[29591]: pgmap v763: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-05-08T07:10:47.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.795+0000 7f820e000700 1 -- 172.21.15.70:0/3288732017 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55c253cc0500 con 0x55c253de6800 2024-05-08T07:10:47.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.795+0000 7f820e000700 10 client.16176 handle_command_reply: tid=0 2024-05-08T07:10:47.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.795+0000 7f8235bbab80 1 client.16176 shutdown 2024-05-08T07:10:47.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.796+0000 7f8235bbab80 1 -- 172.21.15.70:0/3288732017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 msgr2=0x55c253d6fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.796+0000 7f8235bbab80 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6fe30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f821400b650 tx=0x7f8214005a20 comp rx=0 tx=0).stop 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.796+0000 7f8235bbab80 1 -- 172.21.15.70:0/3288732017 shutdown_connections 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.796+0000 7f8235bbab80 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c253de6800 0x55c253de8c20 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.796+0000 7f8235bbab80 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c253d661b0 0x55c253de4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.796+0000 7f8235bbab80 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c253d60780 0x55c253d6f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.796+0000 7f8235bbab80 1 --2- 172.21.15.70:0/3288732017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c253d61140 0x55c253d6fe30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.796+0000 7f820e000700 0 client.16176 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.796+0000 7f8235bbab80 1 -- 172.21.15.70:0/3288732017 >> 172.21.15.70:0/3288732017 conn(0x55c253cd87d0 msgr2=0x55c253d5f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.797+0000 7f8235bbab80 1 -- 172.21.15.70:0/3288732017 shutdown_connections 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.797+0000 7f8235bbab80 1 -- 172.21.15.70:0/3288732017 wait complete. 2024-05-08T07:10:47.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.797+0000 7f8235bbab80 20 client.16176 trim_cache size 0 max 16384 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 30, 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 64, 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout: "f0530d39": { 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 64, 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:10:47.798 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.6, 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:47.799 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:10:47.800 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:10:47.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.798+0000 7f822b200700 1 -- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82080b29f0 msgr2=0x7f82080b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:47.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.798+0000 7f822b200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82080b29f0 0x7f82080b4eb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f821c000f80 tx=0x7f821c009040 comp rx=0 tx=0).stop 2024-05-08T07:10:47.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.798+0000 7f822b200700 1 -- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 msgr2=0x7f82241a4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:10:47.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.798+0000 7f822b200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 0x7f82241a4910 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f821c00ef30 tx=0x7f821c00c3a0 comp rx=0 tx=0).stop 2024-05-08T07:10:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.799+0000 7f822b200700 1 -- 172.21.15.70:0/4091446050 shutdown_connections 2024-05-08T07:10:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.799+0000 7f822b200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82080b29f0 0x7f82080b4eb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.799+0000 7f822b200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f822410fb60 0x7f82241a4910 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.799+0000 7f822b200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8224109ad0 0x7f82241a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.799+0000 7f822b200700 1 --2- 172.21.15.70:0/4091446050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f822410a490 0x7f82241a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:10:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.799+0000 7f822b200700 1 -- 172.21.15.70:0/4091446050 >> 172.21.15.70:0/4091446050 conn(0x7f8224076c70 msgr2=0x7f82240772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:10:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.799+0000 7f822b200700 1 -- 172.21.15.70:0/4091446050 shutdown_connections 2024-05-08T07:10:47.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:10:47.799+0000 7f822b200700 1 -- 172.21.15.70:0/4091446050 wait complete. 2024-05-08T07:10:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:10:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:10:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:10:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:10:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:10:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:10:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:10:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:10:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:10:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:10:48.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:10:48.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:10:48.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:10:48.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:10:48.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:10:48.693 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f0530d39', seconds elapsed: 43.6 2024-05-08T07:10:49.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:49 smithi172 ceph-mon[33377]: pgmap v764: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 5 op/s 2024-05-08T07:10:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:49 smithi194 ceph-mon[33679]: pgmap v764: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 5 op/s 2024-05-08T07:10:49.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:49 smithi070 ceph-mon[29591]: pgmap v764: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 5 op/s 2024-05-08T07:10:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:51 smithi194 ceph-mon[33679]: pgmap v765: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 149 KiB/s wr, 20 op/s 2024-05-08T07:10:51.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:51 smithi070 ceph-mon[29591]: pgmap v765: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 149 KiB/s wr, 20 op/s 2024-05-08T07:10:51.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:51 smithi172 ceph-mon[33377]: pgmap v765: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 149 KiB/s wr, 20 op/s 2024-05-08T07:10:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:53 smithi194 ceph-mon[33679]: pgmap v766: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 145 KiB/s wr, 17 op/s 2024-05-08T07:10:53.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:53 smithi070 ceph-mon[29591]: pgmap v766: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 145 KiB/s wr, 17 op/s 2024-05-08T07:10:53.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:53 smithi172 ceph-mon[33377]: pgmap v766: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 145 KiB/s wr, 17 op/s 2024-05-08T07:10:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:55 smithi194 ceph-mon[33679]: pgmap v767: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 145 KiB/s wr, 17 op/s 2024-05-08T07:10:55.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:55 smithi070 ceph-mon[29591]: pgmap v767: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 145 KiB/s wr, 17 op/s 2024-05-08T07:10:55.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:55 smithi172 ceph-mon[33377]: pgmap v767: 129 pgs: 129 active+clean; 1.2 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 145 KiB/s wr, 17 op/s 2024-05-08T07:10:57.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:57 smithi194 ceph-mon[33679]: pgmap v768: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2024-05-08T07:10:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:57 smithi070 ceph-mon[29591]: pgmap v768: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2024-05-08T07:10:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:57 smithi172 ceph-mon[33377]: pgmap v768: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 1.0 MiB/s wr, 60 op/s 2024-05-08T07:10:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:10:59 smithi194 ceph-mon[33679]: pgmap v769: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-05-08T07:10:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:10:59 smithi070 ceph-mon[29591]: pgmap v769: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-05-08T07:10:59.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:10:59 smithi172 ceph-mon[33377]: pgmap v769: 129 pgs: 129 active+clean; 1.3 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 1.0 MiB/s wr, 57 op/s 2024-05-08T07:11:01.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:01 smithi194 ceph-mon[33679]: pgmap v770: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 1.7 MiB/s wr, 224 op/s 2024-05-08T07:11:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:01 smithi070 ceph-mon[29591]: pgmap v770: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 1.7 MiB/s wr, 224 op/s 2024-05-08T07:11:01.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:01 smithi172 ceph-mon[33377]: pgmap v770: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 1.7 MiB/s wr, 224 op/s 2024-05-08T07:11:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:03 smithi194 ceph-mon[33679]: pgmap v771: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-05-08T07:11:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:03 smithi070 ceph-mon[29591]: pgmap v771: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-05-08T07:11:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:03 smithi172 ceph-mon[33377]: pgmap v771: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-05-08T07:11:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:05 smithi194 ceph-mon[33679]: pgmap v772: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-05-08T07:11:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:05 smithi070 ceph-mon[29591]: pgmap v772: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-05-08T07:11:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:05 smithi172 ceph-mon[33377]: pgmap v772: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 1.5 MiB/s wr, 208 op/s 2024-05-08T07:11:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:07 smithi194 ceph-mon[33679]: pgmap v773: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 2.3 MiB/s wr, 262 op/s 2024-05-08T07:11:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:07 smithi070 ceph-mon[29591]: pgmap v773: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 2.3 MiB/s wr, 262 op/s 2024-05-08T07:11:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:07 smithi172 ceph-mon[33377]: pgmap v773: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 2.3 MiB/s wr, 262 op/s 2024-05-08T07:11:08.379 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.6 2024-05-08T07:11:08.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:11:08.871 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:11:09.355 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:09 smithi070 ceph-mon[29591]: pgmap v774: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 1.4 MiB/s wr, 220 op/s 2024-05-08T07:11:09.355 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:09 smithi070 ceph-mon[29591]: osdmap e128: 12 total, 12 up, 12 in 2024-05-08T07:11:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:09 smithi172 ceph-mon[33377]: pgmap v774: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 1.4 MiB/s wr, 220 op/s 2024-05-08T07:11:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:09 smithi172 ceph-mon[33377]: osdmap e128: 12 total, 12 up, 12 in 2024-05-08T07:11:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:09 smithi194 ceph-mon[33679]: pgmap v774: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 1.4 MiB/s wr, 220 op/s 2024-05-08T07:11:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:09 smithi194 ceph-mon[33679]: osdmap e128: 12 total, 12 up, 12 in 2024-05-08T07:11:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:10 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:11:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:10 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:11:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:10 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:11:11.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:11 smithi070 ceph-mon[29591]: pgmap v776: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 1.8 MiB/s wr, 244 op/s 2024-05-08T07:11:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:11 smithi172 ceph-mon[33377]: pgmap v776: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 1.8 MiB/s wr, 244 op/s 2024-05-08T07:11:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:11 smithi194 ceph-mon[33679]: pgmap v776: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 1.8 MiB/s wr, 244 op/s 2024-05-08T07:11:12.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.018+0000 7fe79b200700 1 -- 172.21.15.70:0/2235509706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c1055d0 msgr2=0x7fe79c105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:12.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.018+0000 7fe79b200700 1 --2- 172.21.15.70:0/2235509706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c1055d0 0x7fe79c105a50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe7880099c0 tx=0x7fe788009cd0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.018+0000 7fe79b200700 1 -- 172.21.15.70:0/2235509706 shutdown_connections 2024-05-08T07:11:12.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.018+0000 7fe79b200700 1 --2- 172.21.15.70:0/2235509706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe79c105f90 0x7fe79c112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.018+0000 7fe79b200700 1 --2- 172.21.15.70:0/2235509706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c10b680 0x7fe79c10ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.018+0000 7fe79b200700 1 --2- 172.21.15.70:0/2235509706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c1055d0 0x7fe79c105a50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.018+0000 7fe79b200700 1 -- 172.21.15.70:0/2235509706 >> 172.21.15.70:0/2235509706 conn(0x7fe79c101080 msgr2=0x7fe79c1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:11:12.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.019+0000 7fe79b200700 1 -- 172.21.15.70:0/2235509706 shutdown_connections 2024-05-08T07:11:12.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.019+0000 7fe79b200700 1 -- 172.21.15.70:0/2235509706 wait complete. 2024-05-08T07:11:12.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.020+0000 7fe79b200700 1 Processor -- start 2024-05-08T07:11:12.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.020+0000 7fe79b200700 1 -- start start 2024-05-08T07:11:12.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe79b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c1055d0 0x7fe79c1a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:12.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe79b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c105f90 0x7fe79c1a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe79b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe79c10b680 0x7fe79c19b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe79b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c1156a0 con 0x7fe79c105f90 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe79b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c115520 con 0x7fe79c1055d0 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe79b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe79c115820 con 0x7fe79c10b680 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe799400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c105f90 0x7fe79c1a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe799400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c105f90 0x7fe79c1a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36918/0 (socket says 172.21.15.70:36918) 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe799400700 1 -- 172.21.15.70:0/1082125797 learned_addr learned my addr 172.21.15.70:0/1082125797 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.021+0000 7fe799e00700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c1055d0 0x7fe79c1a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.022+0000 7fe79a800700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe79c10b680 0x7fe79c19b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.022+0000 7fe799400700 1 -- 172.21.15.70:0/1082125797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe79c10b680 msgr2=0x7fe79c19b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.022+0000 7fe799400700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe79c10b680 0x7fe79c19b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.022+0000 7fe799400700 1 -- 172.21.15.70:0/1082125797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c1055d0 msgr2=0x7fe79c1a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.022+0000 7fe799400700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c1055d0 0x7fe79c1a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.022+0000 7fe799400700 1 -- 172.21.15.70:0/1082125797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c19c0e0 con 0x7fe79c105f90 2024-05-08T07:11:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.022+0000 7fe799400700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c105f90 0x7fe79c1a1cb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe7880098e0 tx=0x7fe7880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:11:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.023+0000 7fe792a00700 1 -- 172.21.15.70:0/1082125797 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788026070 con 0x7fe79c105f90 2024-05-08T07:11:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.023+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79c19c370 con 0x7fe79c105f90 2024-05-08T07:11:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.023+0000 7fe792a00700 1 -- 172.21.15.70:0/1082125797 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe788003d50 con 0x7fe79c105f90 2024-05-08T07:11:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.023+0000 7fe792a00700 1 -- 172.21.15.70:0/1082125797 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78800fb80 con 0x7fe79c105f90 2024-05-08T07:11:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.023+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe79c1a8640 con 0x7fe79c105f90 2024-05-08T07:11:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.024+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe79c06a190 con 0x7fe79c105f90 2024-05-08T07:11:12.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.027+0000 7fe792a00700 1 -- 172.21.15.70:0/1082125797 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe788029070 con 0x7fe79c105f90 2024-05-08T07:11:12.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.029+0000 7fe792a00700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7800b2a70 0x7fe7800b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.029+0000 7fe792a00700 1 -- 172.21.15.70:0/1082125797 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 9671+0+0 (secure 0 0 0) 0x7fe7880e32e0 con 0x7fe79c105f90 2024-05-08T07:11:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.030+0000 7fe799e00700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7800b2a70 0x7fe7800b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:12.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.030+0000 7fe799e00700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7800b2a70 0x7fe7800b4f30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe79c10a730 tx=0x7fe78c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:11:12.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.035+0000 7fe792a00700 1 -- 172.21.15.70:0/1082125797 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe788013070 con 0x7fe79c105f90 2024-05-08T07:11:12.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.366+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe79c19ce60 con 0x7fe79c105f90 2024-05-08T07:11:12.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.368+0000 7fe792a00700 1 -- 172.21.15.70:0/1082125797 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11880 (secure 0 0 0) 0x7fe7880aa870 con 0x7fe79c105f90 2024-05-08T07:11:12.367 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:11:12.367 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:11:08.279060+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T07:11:12.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7800b2a70 msgr2=0x7fe7800b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:12.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7800b2a70 0x7fe7800b4f30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe79c10a730 tx=0x7fe78c009260 comp rx=0 tx=0).stop 2024-05-08T07:11:12.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c105f90 msgr2=0x7fe79c1a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:12.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c105f90 0x7fe79c1a1cb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fe7880098e0 tx=0x7fe7880045e0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 shutdown_connections 2024-05-08T07:11:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7800b2a70 0x7fe7800b4f30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe79c10b680 0x7fe79c19b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe79c1055d0 0x7fe79c1a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 --2- 172.21.15.70:0/1082125797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe79c105f90 0x7fe79c1a1cb0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 >> 172.21.15.70:0/1082125797 conn(0x7fe79c101080 msgr2=0x7fe79c1028b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:11:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 shutdown_connections 2024-05-08T07:11:12.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:12.372+0000 7fe79b200700 1 -- 172.21.15.70:0/1082125797 wait complete. 2024-05-08T07:11:12.372 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 31 2024-05-08T07:11:13.330 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 87.6 --await-for 42.0' 2024-05-08T07:11:13.330 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 87.6 --await-for 42.0 2024-05-08T07:11:13.562 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:13 smithi194 ceph-mon[33679]: pgmap v777: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 1.8 MiB/s wr, 244 op/s 2024-05-08T07:11:13.562 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:13 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1082125797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:11:13.562 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:13 smithi194 ceph-mon[33679]: osdmap e129: 12 total, 12 up, 12 in 2024-05-08T07:11:13.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:13 smithi070 ceph-mon[29591]: pgmap v777: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 1.8 MiB/s wr, 244 op/s 2024-05-08T07:11:13.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1082125797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:11:13.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:13 smithi070 ceph-mon[29591]: osdmap e129: 12 total, 12 up, 12 in 2024-05-08T07:11:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:13 smithi172 ceph-mon[33377]: pgmap v777: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 1.8 MiB/s wr, 244 op/s 2024-05-08T07:11:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:13 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1082125797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:11:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:13 smithi172 ceph-mon[33377]: osdmap e129: 12 total, 12 up, 12 in 2024-05-08T07:11:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:11:15.543 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:15 smithi070 ceph-mon[29591]: pgmap v779: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.1 MiB/s wr, 225 op/s 2024-05-08T07:11:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:15 smithi172 ceph-mon[33377]: pgmap v779: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.1 MiB/s wr, 225 op/s 2024-05-08T07:11:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:15 smithi194 ceph-mon[33679]: pgmap v779: 129 pgs: 129 active+clean; 1.3 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 1.1 MiB/s wr, 225 op/s 2024-05-08T07:11:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.255+0000 7f22dcc00700 1 -- 172.21.15.70:0/3487494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8105900 msgr2=0x7f22d81102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.255+0000 7f22dcc00700 1 --2- 172.21.15.70:0/3487494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8105900 0x7f22d81102e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f22d00099c0 tx=0x7f22d0009cd0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.255+0000 7f22dcc00700 1 -- 172.21.15.70:0/3487494 shutdown_connections 2024-05-08T07:11:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.255+0000 7f22dcc00700 1 --2- 172.21.15.70:0/3487494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8105900 0x7f22d81102e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.255+0000 7f22dcc00700 1 --2- 172.21.15.70:0/3487494 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d8103650 0x7f22d8103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.255+0000 7f22dcc00700 1 --2- 172.21.15.70:0/3487494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d8104f40 0x7f22d81053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.255+0000 7f22dcc00700 1 -- 172.21.15.70:0/3487494 >> 172.21.15.70:0/3487494 conn(0x7f22d80fee00 msgr2=0x7f22d8101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:11:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.255+0000 7f22dcc00700 1 -- 172.21.15.70:0/3487494 shutdown_connections 2024-05-08T07:11:16.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.255+0000 7f22dcc00700 1 -- 172.21.15.70:0/3487494 wait complete. 2024-05-08T07:11:16.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.256+0000 7f22dcc00700 1 Processor -- start 2024-05-08T07:11:16.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.257+0000 7f22dcc00700 1 -- start start 2024-05-08T07:11:16.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.257+0000 7f22dcc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8103650 0x7f22d81a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.257+0000 7f22dcc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d8104f40 0x7f22d81a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.257+0000 7f22dcc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d8105900 0x7f22d819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.257+0000 7f22dcc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81134e0 con 0x7f22d8103650 2024-05-08T07:11:16.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.257+0000 7f22dcc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22d8113360 con 0x7f22d8105900 2024-05-08T07:11:16.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.257+0000 7f22dcc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22d8113660 con 0x7f22d8104f40 2024-05-08T07:11:16.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8103650 0x7f22d81a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8103650 0x7f22d81a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36932/0 (socket says 172.21.15.70:36932) 2024-05-08T07:11:16.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22d7400700 1 -- 172.21.15.70:0/1012474167 learned_addr learned my addr 172.21.15.70:0/1012474167 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:11:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22cea00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d8104f40 0x7f22d81a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22d7e00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d8105900 0x7f22d819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22d7400700 1 -- 172.21.15.70:0/1012474167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d8104f40 msgr2=0x7f22d81a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22d7400700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d8104f40 0x7f22d81a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22d7400700 1 -- 172.21.15.70:0/1012474167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d8105900 msgr2=0x7f22d819b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22d7400700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d8105900 0x7f22d819b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.258+0000 7f22d7400700 1 -- 172.21.15.70:0/1012474167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d819c090 con 0x7f22d8103650 2024-05-08T07:11:16.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.259+0000 7f22d7400700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8103650 0x7f22d81a1720 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f22c80060b0 tx=0x7f22c8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:11:16.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.259+0000 7f22d4c00700 1 -- 172.21.15.70:0/1012474167 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c801a070 con 0x7f22d8103650 2024-05-08T07:11:16.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.259+0000 7f22d4c00700 1 -- 172.21.15.70:0/1012474167 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22c800de20 con 0x7f22d8103650 2024-05-08T07:11:16.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.259+0000 7f22dcc00700 1 -- 172.21.15.70:0/1012474167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d819c380 con 0x7f22d8103650 2024-05-08T07:11:16.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.259+0000 7f22d4c00700 1 -- 172.21.15.70:0/1012474167 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8014690 con 0x7f22d8103650 2024-05-08T07:11:16.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.259+0000 7f22dcc00700 1 -- 172.21.15.70:0/1012474167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d81a85f0 con 0x7f22d8103650 2024-05-08T07:11:16.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.264+0000 7f22d4c00700 1 -- 172.21.15.70:0/1012474167 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f22c801d070 con 0x7f22d8103650 2024-05-08T07:11:16.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.265+0000 7f22e8c2bb80 1 Processor -- start 2024-05-08T07:11:16.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.266+0000 7f22e8c2bb80 1 -- start start 2024-05-08T07:11:16.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.266+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd3eff0 0x557fcfd3f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.266+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3f910 0x557fcfd39520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.266+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd39b40 0x557fcfd39fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.266+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557fcfc8bbb0 con 0x557fcfd39b40 2024-05-08T07:11:16.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.266+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557fcfc298f0 con 0x557fcfd3eff0 2024-05-08T07:11:16.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.266+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557fcfc87b70 con 0x557fcfd3f910 2024-05-08T07:11:16.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.266+0000 7f22d4c00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22bc0b2b20 0x7f22bc0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22cea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd39b40 0x557fcfd39fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22cea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd39b40 0x557fcfd39fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36942/0 (socket says 172.21.15.70:36942) 2024-05-08T07:11:16.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22cea00700 1 -- 172.21.15.70:0/2048622789 learned_addr learned my addr 172.21.15.70:0/2048622789 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:11:16.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22d4c00700 1 -- 172.21.15.70:0/1012474167 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 9583+0+0 (secure 0 0 0) 0x7f22c80e2310 con 0x7f22d8103650 2024-05-08T07:11:16.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22d7e00700 1 --2- 172.21.15.70:0/2048622789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd3eff0 0x557fcfd3f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22d7e00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22bc0b2b20 0x7f22bc0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22d7400700 1 --2- 172.21.15.70:0/2048622789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3f910 0x557fcfd39520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22cea00700 1 -- 172.21.15.70:0/2048622789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3f910 msgr2=0x557fcfd39520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:11:16.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22cea00700 1 --2- 172.21.15.70:0/2048622789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3f910 0x557fcfd39520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22cea00700 1 -- 172.21.15.70:0/2048622789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd3eff0 msgr2=0x557fcfd3f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:11:16.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22cea00700 1 --2- 172.21.15.70:0/2048622789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd3eff0 0x557fcfd3f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.267+0000 7f22cea00700 1 -- 172.21.15.70:0/2048622789 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcfbd8a60 con 0x557fcfd39b40 2024-05-08T07:11:16.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.268+0000 7f22cea00700 1 --2- 172.21.15.70:0/2048622789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd39b40 0x557fcfd39fa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f22c000bd00 tx=0x7f22c000f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ed92af68bfa128 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:11:16.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.268+0000 7f22ccc00700 1 -- 172.21.15.70:0/2048622789 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c0015070 con 0x557fcfd39b40 2024-05-08T07:11:16.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.268+0000 7f22ccc00700 1 -- 172.21.15.70:0/2048622789 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22c000be50 con 0x557fcfd39b40 2024-05-08T07:11:16.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.268+0000 7f22ccc00700 1 -- 172.21.15.70:0/2048622789 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c00054f0 con 0x557fcfd39b40 2024-05-08T07:11:16.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.269+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/2048622789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd39b40 msgr2=0x557fcfd39fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:16.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.269+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/2048622789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd39b40 0x557fcfd39fa0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f22c000bd00 tx=0x7f22c000f640 comp rx=0 tx=0).stop 2024-05-08T07:11:16.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.269+0000 7f22d7e00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22bc0b2b20 0x7f22bc0b4fe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009f50 tx=0x7f22d0009310 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:11:16.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.270+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/2048622789 shutdown_connections 2024-05-08T07:11:16.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.270+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/2048622789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd39b40 0x557fcfd39fa0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.270+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/2048622789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd3eff0 0x557fcfd3f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.270+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/2048622789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3f910 0x557fcfd39520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.270+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/2048622789 >> 172.21.15.70:0/2048622789 conn(0x557fcfc67cf0 msgr2=0x557fcfd34080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:11:16.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.270+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/2048622789 shutdown_connections 2024-05-08T07:11:16.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.270+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/2048622789 wait complete. 2024-05-08T07:11:16.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.271+0000 7f22e8c2bb80 1 -- start start 2024-05-08T07:11:16.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.271+0000 7f22e8c2bb80 1 Processor -- start 2024-05-08T07:11:16.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.271+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd455a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd42990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd42ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557fcfd46430 con 0x557fcfd3f910 2024-05-08T07:11:16.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557fcfbf1cb0 con 0x557fcfd39b40 2024-05-08T07:11:16.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557fcfd465b0 con 0x557fcfd3eff0 2024-05-08T07:11:16.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22e8c2bb80 10 client.0 _ll_register_callbacks cb 0x557fcfc32e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:11:16.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22cea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd42990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd42ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22d7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22cea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd42990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:56390/0 (socket says 172.21.15.70:56390) 2024-05-08T07:11:16.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd42ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36952/0 (socket says 172.21.15.70:36952) 2024-05-08T07:11:16.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.272+0000 7f22cea00700 1 -- 172.21.15.70:0/1285354500 learned_addr learned my addr 172.21.15.70:0/1285354500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:11:16.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.273+0000 7f22d7e00700 1 -- 172.21.15.70:0/1285354500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 msgr2=0x557fcfd42990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:11:16.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.273+0000 7f22d7e00700 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd42990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.273+0000 7f22d7e00700 1 -- 172.21.15.70:0/1285354500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 msgr2=0x557fcfd455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:11:16.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.273+0000 7f22d7e00700 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.273+0000 7f22d7e00700 1 -- 172.21.15.70:0/1285354500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fcfc515b0 con 0x557fcfd3f910 2024-05-08T07:11:16.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.273+0000 7f22d7e00700 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd42ed0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b580 tx=0x7f22d0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0c89f19c37c7e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:11:16.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.273+0000 7f22c5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:11:16.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.274+0000 7f22c5600700 1 -- 172.21.15.70:0/1285354500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0021040 con 0x557fcfd3f910 2024-05-08T07:11:16.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.274+0000 7f22c5600700 1 -- 172.21.15.70:0/1285354500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 9583+0+0 (secure 0 0 0) 0x7f22d0003ce0 con 0x557fcfd3f910 2024-05-08T07:11:16.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.274+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1285354500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22c000be50 con 0x557fcfd3f910 2024-05-08T07:11:16.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.274+0000 7f22c5600700 1 -- 172.21.15.70:0/1285354500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f22d003a050 con 0x557fcfd3f910 2024-05-08T07:11:16.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.274+0000 7f22e8c2bb80 10 client.16194 fetch_fsmap learned FSMap version 31 2024-05-08T07:11:16.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.274+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1285354500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557fcfd50c00 con 0x557fcfd3f910 2024-05-08T07:11:16.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.275+0000 7f22c5600700 1 -- 172.21.15.70:0/1285354500 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22c000be50 con 0x557fcfd3f910 2024-05-08T07:11:16.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.275+0000 7f22c5600700 1 -- 172.21.15.70:0/1285354500 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f22d0027420 con 0x557fcfd3f910 2024-05-08T07:11:16.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.275+0000 7f22e8c2bb80 10 client.16194 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T07:11:16.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.275+0000 7f22e8c2bb80 10 client.16194 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:11:16.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.276+0000 7f22e8c2bb80 20 client.16194 populate_metadata read hostname 'smithi070' 2024-05-08T07:11:16.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.276+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fcfd53230 0x557fcfd55690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.276+0000 7f22e8c2bb80 4 client.16194 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:11:16.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.276+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1285354500 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fcfd06230 con 0x557fcfd53230 2024-05-08T07:11:16.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.276+0000 7f22d7400700 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fcfd53230 0x557fcfd55690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.277+0000 7f22d7400700 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fcfd53230 0x557fcfd55690 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab8658d5d44decfe server_cookie=8fb81673beb5f6d9 in_seq=0 out_seq=0 2024-05-08T07:11:16.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.277+0000 7f22c5600700 10 client.16194 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:11:16.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22c5600700 1 -- 172.21.15.70:0/1285354500 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557fcfd06230 con 0x557fcfd53230 2024-05-08T07:11:16.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22c5600700 10 client.16194 handle_command_reply: tid=0 2024-05-08T07:11:16.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22e8c2bb80 1 client.16194 shutdown 2024-05-08T07:11:16.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1285354500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 msgr2=0x557fcfd42ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:16.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd42ed0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b580 tx=0x7f22d0009cd0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1285354500 shutdown_connections 2024-05-08T07:11:16.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fcfd53230 0x557fcfd55690 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd42ed0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.281+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1285354500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd42990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.282+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1285354500 >> 172.21.15.70:0/1285354500 conn(0x557fcfc67cf0 msgr2=0x557fcfd33f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:11:16.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.282+0000 7f22c5600700 0 client.16194 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:11:16.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.283+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1285354500 shutdown_connections 2024-05-08T07:11:16.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.283+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1285354500 wait complete. 2024-05-08T07:11:16.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.283+0000 7f22e8c2bb80 20 client.16194 trim_cache size 0 max 16384 2024-05-08T07:11:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.311+0000 7f22e8c2bb80 1 Processor -- start 2024-05-08T07:11:16.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.311+0000 7f22e8c2bb80 1 -- start start 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.312+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd4f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.312+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd39520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.312+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd5af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.312+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81b3dd0 con 0x557fcfd3f910 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.312+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81b1630 con 0x557fcfd39b40 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.312+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81af4a0 con 0x557fcfd3eff0 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.312+0000 7f22d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd5af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.312+0000 7f22d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd5af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36954/0 (socket says 172.21.15.70:36954) 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.312+0000 7f22d7e00700 1 -- 172.21.15.70:0/1183870404 learned_addr learned my addr 172.21.15.70:0/1183870404 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:11:16.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.313+0000 7f22cea00700 1 --2- 172.21.15.70:0/1183870404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd39520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.313+0000 7f22d7e00700 1 -- 172.21.15.70:0/1183870404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 msgr2=0x557fcfd39520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:11:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.313+0000 7f22d7e00700 1 --2- 172.21.15.70:0/1183870404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd39520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.313+0000 7f22d7e00700 1 -- 172.21.15.70:0/1183870404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 msgr2=0x557fcfd4f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:11:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.313+0000 7f22d7e00700 1 --2- 172.21.15.70:0/1183870404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd4f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.313+0000 7f22d7e00700 1 -- 172.21.15.70:0/1183870404 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fcfd309b0 con 0x557fcfd3f910 2024-05-08T07:11:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.314+0000 7f22d7e00700 1 --2- 172.21.15.70:0/1183870404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd5af60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f22d0005850 tx=0x7f22d00096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d68e442ed220d40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:11:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.314+0000 7f22c7e00700 1 -- 172.21.15.70:0/1183870404 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0027a50 con 0x557fcfd3f910 2024-05-08T07:11:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.314+0000 7f22c7e00700 1 -- 172.21.15.70:0/1183870404 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22d001c070 con 0x557fcfd3f910 2024-05-08T07:11:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.314+0000 7f22c7e00700 1 -- 172.21.15.70:0/1183870404 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d000f460 con 0x557fcfd3f910 2024-05-08T07:11:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.315+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1183870404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 msgr2=0x557fcfd5af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.315+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1183870404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd5af60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f22d0005850 tx=0x7f22d00096f0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.315+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1183870404 shutdown_connections 2024-05-08T07:11:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.315+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1183870404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd5af60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.315+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1183870404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd4f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.315+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/1183870404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd39520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.315+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1183870404 >> 172.21.15.70:0/1183870404 conn(0x557fcfc67cf0 msgr2=0x557fcfd41280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:11:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.315+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1183870404 shutdown_connections 2024-05-08T07:11:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.315+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/1183870404 wait complete. 2024-05-08T07:11:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.316+0000 7f22e8c2bb80 1 -- start start 2024-05-08T07:11:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.316+0000 7f22e8c2bb80 1 Processor -- start 2024-05-08T07:11:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.317+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd4be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.317+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd48810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.317+0000 7f22e8c2bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd48d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.317+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81afaf0 con 0x557fcfd3f910 2024-05-08T07:11:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.317+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81b0f60 con 0x557fcfd39b40 2024-05-08T07:11:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.317+0000 7f22e8c2bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22d81b01c0 con 0x557fcfd3eff0 2024-05-08T07:11:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.317+0000 7f22e8c2bb80 10 client.0 _ll_register_callbacks cb 0x557fcfc32e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:11:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.317+0000 7f22d7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd4be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.318+0000 7f22d7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd4be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:52990/0 (socket says 172.21.15.70:52990) 2024-05-08T07:11:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.318+0000 7f22d7400700 1 -- 172.21.15.70:0/4143081157 learned_addr learned my addr 172.21.15.70:0/4143081157 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:11:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.318+0000 7f22d7e00700 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd48d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.318+0000 7f22cea00700 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd48810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.318+0000 7f22d7e00700 1 -- 172.21.15.70:0/4143081157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 msgr2=0x557fcfd48810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:11:16.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.318+0000 7f22d7e00700 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd48810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.318+0000 7f22d7e00700 1 -- 172.21.15.70:0/4143081157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 msgr2=0x557fcfd4be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:11:16.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.318+0000 7f22d7e00700 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd4be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:16.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.319+0000 7f22d7e00700 1 -- 172.21.15.70:0/4143081157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fcfd495c0 con 0x557fcfd3f910 2024-05-08T07:11:16.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.319+0000 7f22d7e00700 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd48d50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f22d0018fd0 tx=0x7f22d00276d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6c2e7dc9114ecc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:11:16.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.319+0000 7f22c5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:11:16.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.319+0000 7f22c5600700 1 -- 172.21.15.70:0/4143081157 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0027c50 con 0x557fcfd3f910 2024-05-08T07:11:16.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.319+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/4143081157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22d001c070 con 0x557fcfd3f910 2024-05-08T07:11:16.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.319+0000 7f22c5600700 1 -- 172.21.15.70:0/4143081157 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 9583+0+0 (secure 0 0 0) 0x7f22d0027df0 con 0x557fcfd3f910 2024-05-08T07:11:16.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.320+0000 7f22c5600700 1 -- 172.21.15.70:0/4143081157 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f22d004a990 con 0x557fcfd3f910 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.320+0000 7f22e8c2bb80 10 client.16200 fetch_fsmap learned FSMap version 31 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.320+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/4143081157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557fcfdc7390 con 0x557fcfd3f910 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.320+0000 7f22c5600700 1 -- 172.21.15.70:0/4143081157 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22d001c070 con 0x557fcfd3f910 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.320+0000 7f22c5600700 1 -- 172.21.15.70:0/4143081157 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 31) ==== 8358+0+0 (secure 0 0 0) 0x7f22d003f6f0 con 0x557fcfd3f910 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.320+0000 7f22e8c2bb80 10 client.16200 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.320+0000 7f22e8c2bb80 10 client.16200 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.321+0000 7f22e8c2bb80 20 client.16200 populate_metadata read hostname 'smithi070' 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.321+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fcfdc7a60 0x557fcfdc9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.321+0000 7f22e8c2bb80 4 client.16200 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.6, "await_for": 42.0}] 2024-05-08T07:11:16.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.321+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/4143081157 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.6, "await_for": 42.0}) -- 0x557fcfc99590 con 0x557fcfdc7a60 2024-05-08T07:11:16.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.321+0000 7f22d7400700 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fcfdc7a60 0x557fcfdc9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:11:16.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.322+0000 7f22d7400700 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fcfdc7a60 0x557fcfdc9e80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb49a13150c8c0b4 server_cookie=1dcc4afb276cbf6b in_seq=0 out_seq=0 2024-05-08T07:11:16.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:16.322+0000 7f22c5600700 10 client.16200 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:11:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:17 smithi070 ceph-mon[29591]: pgmap v780: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 2.2 MiB/s wr, 504 op/s 2024-05-08T07:11:17.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:17 smithi172 ceph-mon[33377]: pgmap v780: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 2.2 MiB/s wr, 504 op/s 2024-05-08T07:11:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:17 smithi194 ceph-mon[33679]: pgmap v780: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 2.2 MiB/s wr, 504 op/s 2024-05-08T07:11:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:19 smithi070 ceph-mon[29591]: pgmap v781: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 2.0 MiB/s wr, 440 op/s 2024-05-08T07:11:19.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:19 smithi172 ceph-mon[33377]: pgmap v781: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 2.0 MiB/s wr, 440 op/s 2024-05-08T07:11:19.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:19 smithi194 ceph-mon[33679]: pgmap v781: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 2.0 MiB/s wr, 440 op/s 2024-05-08T07:11:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:21 smithi070 ceph-mon[29591]: pgmap v782: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.6 MiB/s wr, 396 op/s 2024-05-08T07:11:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:21 smithi172 ceph-mon[33377]: pgmap v782: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.6 MiB/s wr, 396 op/s 2024-05-08T07:11:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:21 smithi194 ceph-mon[33679]: pgmap v782: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.6 MiB/s wr, 396 op/s 2024-05-08T07:11:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:23 smithi070 ceph-mon[29591]: pgmap v783: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.6 MiB/s wr, 396 op/s 2024-05-08T07:11:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:23 smithi172 ceph-mon[33377]: pgmap v783: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.6 MiB/s wr, 396 op/s 2024-05-08T07:11:23.763 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:23 smithi194 ceph-mon[33679]: pgmap v783: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 1.6 MiB/s wr, 396 op/s 2024-05-08T07:11:25.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:25 smithi070 ceph-mon[29591]: pgmap v784: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.5 MiB/s wr, 365 op/s 2024-05-08T07:11:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:25 smithi172 ceph-mon[33377]: pgmap v784: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.5 MiB/s wr, 365 op/s 2024-05-08T07:11:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:25 smithi194 ceph-mon[33679]: pgmap v784: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 367 KiB/s rd, 1.5 MiB/s wr, 365 op/s 2024-05-08T07:11:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:27 smithi070 ceph-mon[29591]: pgmap v785: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-05-08T07:11:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:27 smithi172 ceph-mon[33377]: pgmap v785: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-05-08T07:11:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:27 smithi194 ceph-mon[33679]: pgmap v785: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 359 KiB/s rd, 1.4 MiB/s wr, 334 op/s 2024-05-08T07:11:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:29 smithi070 ceph-mon[29591]: pgmap v786: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 648 KiB/s wr, 148 op/s 2024-05-08T07:11:29.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:29 smithi172 ceph-mon[33377]: pgmap v786: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 648 KiB/s wr, 148 op/s 2024-05-08T07:11:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:29 smithi194 ceph-mon[33679]: pgmap v786: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 648 KiB/s wr, 148 op/s 2024-05-08T07:11:31.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.142+0000 7f22c5600700 1 -- 172.21.15.70:0/4143081157 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x557fcfc99590 con 0x557fcfdc7a60 2024-05-08T07:11:31.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.142+0000 7f22c5600700 10 client.16200 handle_command_reply: tid=0 2024-05-08T07:11:31.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.142+0000 7f22e8c2bb80 1 client.16200 shutdown 2024-05-08T07:11:31.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.142+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/4143081157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 msgr2=0x557fcfd48d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:31.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.142+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd48d50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f22d0018fd0 tx=0x7f22d00276d0 comp rx=0 tx=0).stop 2024-05-08T07:11:31.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.143+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/4143081157 shutdown_connections 2024-05-08T07:11:31.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.143+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fcfdc7a60 0x557fcfdc9e80 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:31.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.143+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fcfd3f910 0x557fcfd48d50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:31.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.143+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fcfd39b40 0x557fcfd4be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:31.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.143+0000 7f22c5600700 0 client.16200 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:11:31.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.143+0000 7f22e8c2bb80 1 --2- 172.21.15.70:0/4143081157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fcfd3eff0 0x557fcfd48810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:31.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.143+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/4143081157 >> 172.21.15.70:0/4143081157 conn(0x557fcfc67cf0 msgr2=0x557fcfd3fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:11:31.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.143+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/4143081157 shutdown_connections 2024-05-08T07:11:31.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.143+0000 7f22e8c2bb80 1 -- 172.21.15.70:0/4143081157 wait complete. 2024-05-08T07:11:31.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.144+0000 7f22e8c2bb80 20 client.16200 trim_cache size 0 max 16384 2024-05-08T07:11:31.144 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:11:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 31, 2024-05-08T07:11:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:11:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 66, 2024-05-08T07:11:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:11:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "f6c38de1": { 2024-05-08T07:11:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 66, 2024-05-08T07:11:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:11:31.144 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.6, 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:11:31.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:11:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:11:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:11:31.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:11:31.146 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:11:31.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.145+0000 7f22dcc00700 1 -- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22bc0b2b20 msgr2=0x7f22bc0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:31.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.145+0000 7f22dcc00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22bc0b2b20 0x7f22bc0b4fe0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009f50 tx=0x7f22d0009310 comp rx=0 tx=0).stop 2024-05-08T07:11:31.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.145+0000 7f22dcc00700 1 -- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8103650 msgr2=0x7f22d81a1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:11:31.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.145+0000 7f22dcc00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8103650 0x7f22d81a1720 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f22c80060b0 tx=0x7f22c8007f90 comp rx=0 tx=0).stop 2024-05-08T07:11:31.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.146+0000 7f22dcc00700 1 -- 172.21.15.70:0/1012474167 shutdown_connections 2024-05-08T07:11:31.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.146+0000 7f22dcc00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22bc0b2b20 0x7f22bc0b4fe0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:31.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.146+0000 7f22dcc00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22d8105900 0x7f22d819b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:31.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.146+0000 7f22dcc00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22d8103650 0x7f22d81a1720 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:31.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.146+0000 7f22dcc00700 1 --2- 172.21.15.70:0/1012474167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d8104f40 0x7f22d81a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:11:31.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.146+0000 7f22dcc00700 1 -- 172.21.15.70:0/1012474167 >> 172.21.15.70:0/1012474167 conn(0x7f22d80fee00 msgr2=0x7f22d80ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:11:31.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.146+0000 7f22dcc00700 1 -- 172.21.15.70:0/1012474167 shutdown_connections 2024-05-08T07:11:31.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:11:31.146+0000 7f22dcc00700 1 -- 172.21.15.70:0/1012474167 wait complete. 2024-05-08T07:11:31.548 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:31 smithi070 ceph-mon[29591]: pgmap v787: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 706 KiB/s wr, 153 op/s 2024-05-08T07:11:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:31 smithi172 ceph-mon[33377]: pgmap v787: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 706 KiB/s wr, 153 op/s 2024-05-08T07:11:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:31 smithi194 ceph-mon[33679]: pgmap v787: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 706 KiB/s wr, 153 op/s 2024-05-08T07:11:31.985 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f6c38de1', quiesce took 23.6 seconds. Will release after: 27.6 2024-05-08T07:11:33.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:33 smithi070 ceph-mon[29591]: pgmap v788: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T07:11:33.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:33 smithi172 ceph-mon[33377]: pgmap v788: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T07:11:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:33 smithi194 ceph-mon[33679]: pgmap v788: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T07:11:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:34 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:11:34.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:34 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:11:34.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:34 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:11:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:35 smithi070 ceph-mon[29591]: pgmap v789: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T07:11:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:35 smithi172 ceph-mon[33377]: pgmap v789: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T07:11:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:35 smithi194 ceph-mon[33679]: pgmap v789: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T07:11:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:37 smithi172 ceph-mon[33377]: pgmap v790: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 162 KiB/s wr, 124 op/s 2024-05-08T07:11:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:37 smithi194 ceph-mon[33679]: pgmap v790: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 162 KiB/s wr, 124 op/s 2024-05-08T07:11:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:37 smithi070 ceph-mon[29591]: pgmap v790: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 162 KiB/s wr, 124 op/s 2024-05-08T07:11:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:39 smithi172 ceph-mon[33377]: pgmap v791: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 137 KiB/s wr, 120 op/s 2024-05-08T07:11:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:39 smithi194 ceph-mon[33679]: pgmap v791: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 137 KiB/s wr, 120 op/s 2024-05-08T07:11:39.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:39 smithi070 ceph-mon[29591]: pgmap v791: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 137 KiB/s wr, 120 op/s 2024-05-08T07:11:40.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:40 smithi172 ceph-mon[33377]: pgmap v792: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 142 KiB/s wr, 123 op/s 2024-05-08T07:11:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:40 smithi194 ceph-mon[33679]: pgmap v792: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 142 KiB/s wr, 123 op/s 2024-05-08T07:11:40.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:40 smithi070 ceph-mon[29591]: pgmap v792: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 142 KiB/s wr, 123 op/s 2024-05-08T07:11:42.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:42 smithi194 ceph-mon[33679]: pgmap v793: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 84 KiB/s wr, 119 op/s 2024-05-08T07:11:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:42 smithi070 ceph-mon[29591]: pgmap v793: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 84 KiB/s wr, 119 op/s 2024-05-08T07:11:42.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:42 smithi172 ceph-mon[33377]: pgmap v793: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 84 KiB/s wr, 119 op/s 2024-05-08T07:11:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:44 smithi194 ceph-mon[33679]: pgmap v794: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 84 KiB/s wr, 119 op/s 2024-05-08T07:11:44.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:44 smithi070 ceph-mon[29591]: pgmap v794: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 84 KiB/s wr, 119 op/s 2024-05-08T07:11:44.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:44 smithi172 ceph-mon[33377]: pgmap v794: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 84 KiB/s wr, 119 op/s 2024-05-08T07:11:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:46 smithi194 ceph-mon[33679]: pgmap v795: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 88 KiB/s wr, 121 op/s 2024-05-08T07:11:46.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:46 smithi070 ceph-mon[29591]: pgmap v795: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 88 KiB/s wr, 121 op/s 2024-05-08T07:11:46.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:46 smithi172 ceph-mon[33377]: pgmap v795: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 88 KiB/s wr, 121 op/s 2024-05-08T07:11:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:48 smithi194 ceph-mon[33679]: pgmap v796: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2024-05-08T07:11:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:11:48.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:48 smithi070 ceph-mon[29591]: pgmap v796: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2024-05-08T07:11:48.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:11:48.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:48 smithi172 ceph-mon[33377]: pgmap v796: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 KiB/s wr, 5 op/s 2024-05-08T07:11:48.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:11:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:11:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:11:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:11:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:11:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:11:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:11:49.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:11:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:11:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:11:51.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:50 smithi194 ceph-mon[33679]: pgmap v797: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T07:11:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:50 smithi070 ceph-mon[29591]: pgmap v797: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T07:11:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:50 smithi172 ceph-mon[33377]: pgmap v797: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T07:11:53.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:53 smithi194 ceph-mon[33679]: pgmap v798: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:11:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:52 smithi070 ceph-mon[29591]: pgmap v798: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:11:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:53 smithi172 ceph-mon[33377]: pgmap v798: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:11:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:55 smithi194 ceph-mon[33679]: pgmap v799: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:11:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:55 smithi070 ceph-mon[29591]: pgmap v799: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:11:55.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:55 smithi172 ceph-mon[33377]: pgmap v799: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 KiB/s wr, 5 op/s 2024-05-08T07:11:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:57 smithi070 ceph-mon[29591]: pgmap v800: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2024-05-08T07:11:57.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:57 smithi172 ceph-mon[33377]: pgmap v800: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2024-05-08T07:11:57.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:57 smithi194 ceph-mon[33679]: pgmap v800: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.5 KiB/s wr, 7 op/s 2024-05-08T07:11:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:11:59 smithi070 ceph-mon[29591]: pgmap v801: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-05-08T07:11:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:11:59 smithi172 ceph-mon[33377]: pgmap v801: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-05-08T07:11:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:11:59 smithi194 ceph-mon[33679]: pgmap v801: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 5 op/s 2024-05-08T07:11:59.588 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:12:00.041 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:12:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:01 smithi070 ceph-mon[29591]: pgmap v802: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-05-08T07:12:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:01 smithi172 ceph-mon[33377]: pgmap v802: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-05-08T07:12:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:01 smithi194 ceph-mon[33679]: pgmap v802: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.1 KiB/s wr, 7 op/s 2024-05-08T07:12:02.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.394+0000 7f4cc0200700 1 -- 172.21.15.70:0/2386246007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 msgr2=0x7f4cb8110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:02.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.394+0000 7f4cc0200700 1 --2- 172.21.15.70:0/2386246007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 0x7f4cb8110330 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000b0a0 tx=0x7f4cb000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.394+0000 7f4cc0200700 1 -- 172.21.15.70:0/2386246007 shutdown_connections 2024-05-08T07:12:02.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.394+0000 7f4cc0200700 1 --2- 172.21.15.70:0/2386246007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 0x7f4cb8110330 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.394+0000 7f4cc0200700 1 --2- 172.21.15.70:0/2386246007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb8109510 0x7f4cb81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.394+0000 7f4cc0200700 1 --2- 172.21.15.70:0/2386246007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb806b180 0x7f4cb806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.394+0000 7f4cc0200700 1 -- 172.21.15.70:0/2386246007 >> 172.21.15.70:0/2386246007 conn(0x7f4cb8079350 msgr2=0x7f4cb8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:12:02.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.394+0000 7f4cc0200700 1 -- 172.21.15.70:0/2386246007 shutdown_connections 2024-05-08T07:12:02.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.395+0000 7f4cc0200700 1 -- 172.21.15.70:0/2386246007 wait complete. 2024-05-08T07:12:02.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.396+0000 7f4cc0200700 1 Processor -- start 2024-05-08T07:12:02.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.396+0000 7f4cc0200700 1 -- start start 2024-05-08T07:12:02.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.396+0000 7f4cc0200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb806b180 0x7f4cb8102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:02.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.396+0000 7f4cc0200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 0x7f4cb81029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.396+0000 7f4cc0200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb8109510 0x7f4cb8102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cc0200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81134f0 con 0x7f4cb806bb40 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cc0200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8113370 con 0x7f4cb806b180 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cc0200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8113670 con 0x7f4cb8109510 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 0x7f4cb81029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 0x7f4cb81029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58004/0 (socket says 172.21.15.70:58004) 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbce00700 1 -- 172.21.15.70:0/3482717428 learned_addr learned my addr 172.21.15.70:0/3482717428 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbd800700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb806b180 0x7f4cb8102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbe200700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb8109510 0x7f4cb8102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbce00700 1 -- 172.21.15.70:0/3482717428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb8109510 msgr2=0x7f4cb8102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbce00700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb8109510 0x7f4cb8102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbce00700 1 -- 172.21.15.70:0/3482717428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb806b180 msgr2=0x7f4cb8102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbce00700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb806b180 0x7f4cb8102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbce00700 1 -- 172.21.15.70:0/3482717428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb81a7ec0 con 0x7f4cb806bb40 2024-05-08T07:12:02.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.397+0000 7f4cbd800700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb806b180 0x7f4cb8102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:12:02.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.398+0000 7f4cbce00700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 0x7f4cb81029b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400d980 tx=0x7f4ca400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:12:02.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.398+0000 7f4cb6000700 1 -- 172.21.15.70:0/3482717428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4017070 con 0x7f4cb806bb40 2024-05-08T07:12:02.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.398+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb81a8150 con 0x7f4cb806bb40 2024-05-08T07:12:02.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.398+0000 7f4cb6000700 1 -- 172.21.15.70:0/3482717428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ca4004830 con 0x7f4cb806bb40 2024-05-08T07:12:02.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.398+0000 7f4cb6000700 1 -- 172.21.15.70:0/3482717428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca40053a0 con 0x7f4cb806bb40 2024-05-08T07:12:02.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.398+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb81a8690 con 0x7f4cb806bb40 2024-05-08T07:12:02.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.399+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c98005330 con 0x7f4cb806bb40 2024-05-08T07:12:02.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.401+0000 7f4cb6000700 1 -- 172.21.15.70:0/3482717428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4ca4005540 con 0x7f4cb806bb40 2024-05-08T07:12:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.403+0000 7f4cb6000700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca00b2a70 0x7f4ca00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.403+0000 7f4cb6000700 1 -- 172.21.15.70:0/3482717428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 9583+0+0 (secure 0 0 0) 0x7f4ca40e28b0 con 0x7f4cb806bb40 2024-05-08T07:12:02.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.403+0000 7f4cbd800700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca00b2a70 0x7f4ca00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:02.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.404+0000 7f4cbd800700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca00b2a70 0x7f4ca00b4f30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00baa0 tx=0x7f4cac005db0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:12:02.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.408+0000 7f4cb6000700 1 -- 172.21.15.70:0/3482717428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4ca4020020 con 0x7f4cb806bb40 2024-05-08T07:12:02.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.697+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c980058f0 con 0x7f4cb806bb40 2024-05-08T07:12:02.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.698+0000 7f4cb6000700 1 -- 172.21.15.70:0/3482717428 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11879 (secure 0 0 0) 0x7f4ca40a9e10 con 0x7f4cb806bb40 2024-05-08T07:12:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:12:02.697 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:11:33.281480+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:12:02.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca00b2a70 msgr2=0x7f4ca00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:02.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca00b2a70 0x7f4ca00b4f30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00baa0 tx=0x7f4cac005db0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 msgr2=0x7f4cb81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:02.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 0x7f4cb81029b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400d980 tx=0x7f4ca400dd40 comp rx=0 tx=0).stop 2024-05-08T07:12:02.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 shutdown_connections 2024-05-08T07:12:02.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca00b2a70 0x7f4ca00b4f30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb8109510 0x7f4cb8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cb806b180 0x7f4cb8102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 --2- 172.21.15.70:0/3482717428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb806bb40 0x7f4cb81029b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:02.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 >> 172.21.15.70:0/3482717428 conn(0x7f4cb8079350 msgr2=0x7f4cb81010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:12:02.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 shutdown_connections 2024-05-08T07:12:02.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:02.701+0000 7f4cc0200700 1 -- 172.21.15.70:0/3482717428 wait complete. 2024-05-08T07:12:02.702 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 32 2024-05-08T07:12:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:03 smithi070 ceph-mon[29591]: pgmap v803: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5 op/s 2024-05-08T07:12:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:03 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3482717428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:12:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:03 smithi172 ceph-mon[33377]: pgmap v803: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5 op/s 2024-05-08T07:12:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:03 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3482717428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:12:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:03 smithi194 ceph-mon[33679]: pgmap v803: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5 op/s 2024-05-08T07:12:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:03 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3482717428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:12:03.538 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id f6c38de1 --release --await' 2024-05-08T07:12:03.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id f6c38de1 --release --await 2024-05-08T07:12:03.965 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:12:05.357 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:05 smithi070 ceph-mon[29591]: pgmap v804: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5 op/s 2024-05-08T07:12:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:05 smithi172 ceph-mon[33377]: pgmap v804: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5 op/s 2024-05-08T07:12:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:05 smithi194 ceph-mon[33679]: pgmap v804: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 5 op/s 2024-05-08T07:12:06.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.215+0000 7ff627600700 1 -- 172.21.15.70:0/707877408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006c360 msgr2=0x7ff62010fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:06.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.215+0000 7ff627600700 1 --2- 172.21.15.70:0/707877408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006c360 0x7ff62010fa00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff610009990 tx=0x7ff610009ca0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.215+0000 7ff627600700 1 -- 172.21.15.70:0/707877408 shutdown_connections 2024-05-08T07:12:06.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.215+0000 7ff627600700 1 --2- 172.21.15.70:0/707877408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62010ff40 0x7ff620112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.215+0000 7ff627600700 1 --2- 172.21.15.70:0/707877408 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff62006ba40 0x7ff62006be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.215+0000 7ff627600700 1 --2- 172.21.15.70:0/707877408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006c360 0x7ff62010fa00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.215+0000 7ff627600700 1 -- 172.21.15.70:0/707877408 >> 172.21.15.70:0/707877408 conn(0x7ff620079310 msgr2=0x7ff620079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:12:06.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.215+0000 7ff627600700 1 -- 172.21.15.70:0/707877408 shutdown_connections 2024-05-08T07:12:06.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.215+0000 7ff627600700 1 -- 172.21.15.70:0/707877408 wait complete. 2024-05-08T07:12:06.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.216+0000 7ff627600700 1 Processor -- start 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.216+0000 7ff627600700 1 -- start start 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff627600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006ba40 0x7ff6201a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff627600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62006c360 0x7ff6201a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff627600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff62010ff40 0x7ff62019ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff627600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff620115770 con 0x7ff62006ba40 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff627600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201155f0 con 0x7ff62010ff40 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff627600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201158f0 con 0x7ff62006c360 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff624c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006ba40 0x7ff6201a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff624c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006ba40 0x7ff6201a18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58020/0 (socket says 172.21.15.70:58020) 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff624c00700 1 -- 172.21.15.70:0/934615695 learned_addr learned my addr 172.21.15.70:0/934615695 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff617e00700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62006c360 0x7ff6201a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.217+0000 7ff625600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff62010ff40 0x7ff62019ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff624c00700 1 -- 172.21.15.70:0/934615695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62006c360 msgr2=0x7ff6201a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff624c00700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62006c360 0x7ff6201a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff624c00700 1 -- 172.21.15.70:0/934615695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff62010ff40 msgr2=0x7ff62019ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff624c00700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff62010ff40 0x7ff62019ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff624c00700 1 -- 172.21.15.70:0/934615695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62019c1f0 con 0x7ff62006ba40 2024-05-08T07:12:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff625600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff62010ff40 0x7ff62019ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:12:06.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff624c00700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006ba40 0x7ff6201a18d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff60800c9b0 tx=0x7ff60800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:12:06.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff61e000700 1 -- 172.21.15.70:0/934615695 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff608007b00 con 0x7ff62006ba40 2024-05-08T07:12:06.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff61e000700 1 -- 172.21.15.70:0/934615695 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff608007ca0 con 0x7ff62006ba40 2024-05-08T07:12:06.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff61e000700 1 -- 172.21.15.70:0/934615695 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff608018660 con 0x7ff62006ba40 2024-05-08T07:12:06.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.218+0000 7ff627600700 1 -- 172.21.15.70:0/934615695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62019c4e0 con 0x7ff62006ba40 2024-05-08T07:12:06.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.219+0000 7ff627600700 1 -- 172.21.15.70:0/934615695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6201a87a0 con 0x7ff62006ba40 2024-05-08T07:12:06.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.222+0000 7ff61e000700 1 -- 172.21.15.70:0/934615695 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff60800f450 con 0x7ff62006ba40 2024-05-08T07:12:06.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.223+0000 7ff632055b80 1 Processor -- start 2024-05-08T07:12:06.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.223+0000 7ff632055b80 1 -- start start 2024-05-08T07:12:06.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.223+0000 7ff61e000700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff6000b2a70 0x7ff6000b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff61e000700 1 -- 172.21.15.70:0/934615695 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 9583+0+0 (secure 0 0 0) 0x7ff6080e2ae0 con 0x7ff62006ba40 2024-05-08T07:12:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff632055b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e67311b0 0x55c9e6731590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff632055b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e672bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff625600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff6000b2a70 0x7ff6000b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff632055b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 0x55c9e6737f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff632055b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c9e667db20 con 0x55c9e67311b0 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff632055b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c9e661b860 con 0x55c9e672c140 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff632055b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c9e6679ae0 con 0x55c9e672b780 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff624c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e67311b0 0x55c9e6731590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff624c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e67311b0 0x55c9e6731590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58026/0 (socket says 172.21.15.70:58026) 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff624c00700 1 -- 172.21.15.70:0/1028121004 learned_addr learned my addr 172.21.15.70:0/1028121004 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.224+0000 7ff617e00700 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e672bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff624c00700 1 -- 172.21.15.70:0/1028121004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 msgr2=0x55c9e672bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff624c00700 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e672bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff624c00700 1 -- 172.21.15.70:0/1028121004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 msgr2=0x55c9e6737f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff625600700 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 0x55c9e6737f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff624c00700 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 0x55c9e6737f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff624c00700 1 -- 172.21.15.70:0/1028121004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9e65ca9d0 con 0x55c9e67311b0 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff617e00700 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e672bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff625600700 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 0x55c9e6737f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:12:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff625600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff6000b2a70 0x7ff6000b4f30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff62006af40 tx=0x7ff6180078b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:12:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff624c00700 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e67311b0 0x55c9e6731590 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff6080a98d0 tx=0x7ff6080a91c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31a2230e5105e31 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:12:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.225+0000 7ff616000700 1 -- 172.21.15.70:0/1028121004 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60808fe60 con 0x55c9e67311b0 2024-05-08T07:12:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.226+0000 7ff616000700 1 -- 172.21.15.70:0/1028121004 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6080adcf0 con 0x55c9e67311b0 2024-05-08T07:12:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.226+0000 7ff616000700 1 -- 172.21.15.70:0/1028121004 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6080cc0d0 con 0x55c9e67311b0 2024-05-08T07:12:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.226+0000 7ff632055b80 1 -- 172.21.15.70:0/1028121004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e67311b0 msgr2=0x55c9e6731590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.226+0000 7ff632055b80 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e67311b0 0x55c9e6731590 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff6080a98d0 tx=0x7ff6080a91c0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.227+0000 7ff632055b80 1 -- 172.21.15.70:0/1028121004 shutdown_connections 2024-05-08T07:12:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.227+0000 7ff632055b80 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 0x55c9e6737f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.227+0000 7ff632055b80 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e67311b0 0x55c9e6731590 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.227+0000 7ff632055b80 1 --2- 172.21.15.70:0/1028121004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e672bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.227+0000 7ff632055b80 1 -- 172.21.15.70:0/1028121004 >> 172.21.15.70:0/1028121004 conn(0x55c9e66a37d0 msgr2=0x55c9e6726070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.227+0000 7ff632055b80 1 -- 172.21.15.70:0/1028121004 shutdown_connections 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.227+0000 7ff632055b80 1 -- 172.21.15.70:0/1028121004 wait complete. 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.227+0000 7ff632055b80 1 -- start start 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.228+0000 7ff632055b80 1 Processor -- start 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.228+0000 7ff632055b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672b780 0x55c9e6737c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.228+0000 7ff632055b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 0x55c9e6734fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.228+0000 7ff632055b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e67311b0 0x55c9e6735520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.228+0000 7ff632055b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c9e6738570 con 0x55c9e672b780 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.228+0000 7ff632055b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c9e65e3c20 con 0x55c9e672c140 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.228+0000 7ff632055b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c9e67386f0 con 0x55c9e67311b0 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.228+0000 7ff632055b80 10 client.0 _ll_register_callbacks cb 0x55c9e6624d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.228+0000 7ff624c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672b780 0x55c9e6737c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff624c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672b780 0x55c9e6737c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58028/0 (socket says 172.21.15.70:58028) 2024-05-08T07:12:06.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff624c00700 1 -- 172.21.15.70:0/2086689257 learned_addr learned my addr 172.21.15.70:0/2086689257 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:12:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff625600700 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e67311b0 0x55c9e6735520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff617e00700 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 0x55c9e6734fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff624c00700 1 -- 172.21.15.70:0/2086689257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e67311b0 msgr2=0x55c9e6735520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:12:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff624c00700 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e67311b0 0x55c9e6735520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff624c00700 1 -- 172.21.15.70:0/2086689257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 msgr2=0x55c9e6734fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff624c00700 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 0x55c9e6734fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff624c00700 1 -- 172.21.15.70:0/2086689257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9e6643520 con 0x55c9e672b780 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff625600700 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e67311b0 0x55c9e6735520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff624c00700 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672b780 0x55c9e6737c40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff60800afd0 tx=0x7ff60800fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbf23ca3e926e2e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff60ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.229+0000 7ff60ea00700 1 -- 172.21.15.70:0/2086689257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60808fe60 con 0x55c9e672b780 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff60ea00700 1 -- 172.21.15.70:0/2086689257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 9583+0+0 (secure 0 0 0) 0x7ff6080a9da0 con 0x55c9e672b780 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff632055b80 1 -- 172.21.15.70:0/2086689257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6080adcf0 con 0x55c9e672b780 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff60ea00700 1 -- 172.21.15.70:0/2086689257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff6080b2310 con 0x55c9e672b780 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff632055b80 10 client.16218 fetch_fsmap learned FSMap version 32 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff632055b80 1 -- 172.21.15.70:0/2086689257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c9e6742db0 con 0x55c9e672b780 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff60ea00700 1 -- 172.21.15.70:0/2086689257 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6080adcf0 con 0x55c9e672b780 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff60ea00700 1 -- 172.21.15.70:0/2086689257 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7ff6080a53d0 con 0x55c9e672b780 2024-05-08T07:12:06.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff632055b80 10 client.16218 fetch_fsmap finished waiting for FSMap version 32 2024-05-08T07:12:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff632055b80 10 client.16218 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:12:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.230+0000 7ff632055b80 20 client.16218 populate_metadata read hostname 'smithi070' 2024-05-08T07:12:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.231+0000 7ff632055b80 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9e6745280 0x55c9e6747670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.231+0000 7ff632055b80 4 client.16218 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:12:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.231+0000 7ff632055b80 1 -- 172.21.15.70:0/2086689257 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9e66f8240 con 0x55c9e6745280 2024-05-08T07:12:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.231+0000 7ff617e00700 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9e6745280 0x55c9e6747670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.232+0000 7ff617e00700 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9e6745280 0x55c9e6747670 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=794a58581ab45618 server_cookie=3534da27ecea4170 in_seq=0 out_seq=0 2024-05-08T07:12:06.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.232+0000 7ff60ea00700 10 client.16218 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:12:06.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.234+0000 7ff60ea00700 1 -- 172.21.15.70:0/2086689257 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c9e66f8240 con 0x55c9e6745280 2024-05-08T07:12:06.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.234+0000 7ff60ea00700 10 client.16218 handle_command_reply: tid=0 2024-05-08T07:12:06.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.234+0000 7ff632055b80 1 client.16218 shutdown 2024-05-08T07:12:06.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 -- 172.21.15.70:0/2086689257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672b780 msgr2=0x55c9e6737c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:06.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672b780 0x55c9e6737c40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff60800afd0 tx=0x7ff60800fba0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 -- 172.21.15.70:0/2086689257 shutdown_connections 2024-05-08T07:12:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9e6745280 0x55c9e6747670 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e67311b0 0x55c9e6735520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff60ea00700 0 client.16218 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:12:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672b780 0x55c9e6737c40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 --2- 172.21.15.70:0/2086689257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e672c140 0x55c9e6734fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 -- 172.21.15.70:0/2086689257 >> 172.21.15.70:0/2086689257 conn(0x55c9e66a37d0 msgr2=0x55c9e6720b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:12:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 -- 172.21.15.70:0/2086689257 shutdown_connections 2024-05-08T07:12:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 1 -- 172.21.15.70:0/2086689257 wait complete. 2024-05-08T07:12:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.235+0000 7ff632055b80 20 client.16218 trim_cache size 0 max 16384 2024-05-08T07:12:06.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.257+0000 7ff632055b80 1 Processor -- start 2024-05-08T07:12:06.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.257+0000 7ff632055b80 1 -- start start 2024-05-08T07:12:06.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff632055b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e67209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff632055b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e674a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff632055b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 0x55c9e674abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff632055b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b40c0 con 0x55c9e672c140 2024-05-08T07:12:06.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff632055b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b1950 con 0x55c9e67311b0 2024-05-08T07:12:06.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff632055b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201af7c0 con 0x55c9e672b780 2024-05-08T07:12:06.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff617e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e674a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff617e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e674a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58036/0 (socket says 172.21.15.70:58036) 2024-05-08T07:12:06.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff617e00700 1 -- 172.21.15.70:0/1582621216 learned_addr learned my addr 172.21.15.70:0/1582621216 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:12:06.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff625600700 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 0x55c9e674abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff624c00700 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e67209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff617e00700 1 -- 172.21.15.70:0/1582621216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 msgr2=0x55c9e67209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:12:06.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff617e00700 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e67209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff617e00700 1 -- 172.21.15.70:0/1582621216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 msgr2=0x55c9e674abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:12:06.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.258+0000 7ff617e00700 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 0x55c9e674abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.259+0000 7ff617e00700 1 -- 172.21.15.70:0/1582621216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9e6726c40 con 0x55c9e672c140 2024-05-08T07:12:06.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.259+0000 7ff624c00700 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e67209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:12:06.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.259+0000 7ff617e00700 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e674a690 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff610000c00 tx=0x7ff61001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ffd9cd546c9843 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:12:06.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.259+0000 7ff615600700 1 -- 172.21.15.70:0/1582621216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6100054f0 con 0x55c9e672c140 2024-05-08T07:12:06.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.259+0000 7ff615600700 1 -- 172.21.15.70:0/1582621216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff610005690 con 0x55c9e672c140 2024-05-08T07:12:06.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.259+0000 7ff615600700 1 -- 172.21.15.70:0/1582621216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61000be40 con 0x55c9e672c140 2024-05-08T07:12:06.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.260+0000 7ff632055b80 1 -- 172.21.15.70:0/1582621216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 msgr2=0x55c9e674a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:06.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.260+0000 7ff632055b80 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e674a690 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff610000c00 tx=0x7ff61001a040 comp rx=0 tx=0).stop 2024-05-08T07:12:06.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.260+0000 7ff632055b80 1 -- 172.21.15.70:0/1582621216 shutdown_connections 2024-05-08T07:12:06.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.260+0000 7ff632055b80 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 0x55c9e674abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.260+0000 7ff632055b80 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e67209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.260+0000 7ff632055b80 1 --2- 172.21.15.70:0/1582621216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e674a690 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.260+0000 7ff632055b80 1 -- 172.21.15.70:0/1582621216 >> 172.21.15.70:0/1582621216 conn(0x55c9e66a37d0 msgr2=0x55c9e67202b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:12:06.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.260+0000 7ff632055b80 1 -- 172.21.15.70:0/1582621216 shutdown_connections 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.260+0000 7ff632055b80 1 -- 172.21.15.70:0/1582621216 wait complete. 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.261+0000 7ff632055b80 1 -- start start 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.261+0000 7ff632055b80 1 Processor -- start 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.261+0000 7ff632055b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e674abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.261+0000 7ff632055b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e6748fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.261+0000 7ff632055b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 0x55c9e6749500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.261+0000 7ff632055b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201afe10 con 0x55c9e672c140 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.261+0000 7ff632055b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b1280 con 0x55c9e67311b0 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.261+0000 7ff632055b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff6201b04e0 con 0x55c9e672b780 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.261+0000 7ff632055b80 10 client.0 _ll_register_callbacks cb 0x55c9e6624d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff617e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e6748fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff617e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e6748fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58050/0 (socket says 172.21.15.70:58050) 2024-05-08T07:12:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff617e00700 1 -- 172.21.15.70:0/1697662225 learned_addr learned my addr 172.21.15.70:0/1697662225 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:12:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff624c00700 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e674abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff625600700 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 0x55c9e6749500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff617e00700 1 -- 172.21.15.70:0/1697662225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 msgr2=0x55c9e674abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:12:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff617e00700 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e674abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff617e00700 1 -- 172.21.15.70:0/1697662225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 msgr2=0x55c9e6749500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:12:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff617e00700 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 0x55c9e6749500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff617e00700 1 -- 172.21.15.70:0/1697662225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9e6722c70 con 0x55c9e672c140 2024-05-08T07:12:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.262+0000 7ff624c00700 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e674abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:12:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.263+0000 7ff617e00700 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e6748fc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff61002b040 tx=0x7ff610005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2196e53cececdebd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.263+0000 7ff60ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.263+0000 7ff60ea00700 1 -- 172.21.15.70:0/1697662225 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61000bcd0 con 0x55c9e672c140 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.263+0000 7ff632055b80 1 -- 172.21.15.70:0/1697662225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff610005690 con 0x55c9e672c140 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.263+0000 7ff60ea00700 1 -- 172.21.15.70:0/1697662225 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 9583+0+0 (secure 0 0 0) 0x7ff6100037c0 con 0x55c9e672c140 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.263+0000 7ff60ea00700 1 -- 172.21.15.70:0/1697662225 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff61000be70 con 0x55c9e672c140 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.263+0000 7ff632055b80 10 client.16224 fetch_fsmap learned FSMap version 32 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.263+0000 7ff632055b80 1 -- 172.21.15.70:0/1697662225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c9e67b0590 con 0x55c9e672c140 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.263+0000 7ff60ea00700 1 -- 172.21.15.70:0/1697662225 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff610005690 con 0x55c9e672c140 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.264+0000 7ff60ea00700 1 -- 172.21.15.70:0/1697662225 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7ff61000f660 con 0x55c9e672c140 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.264+0000 7ff632055b80 10 client.16224 fetch_fsmap finished waiting for FSMap version 32 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.264+0000 7ff632055b80 10 client.16224 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.264+0000 7ff632055b80 20 client.16224 populate_metadata read hostname 'smithi070' 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.264+0000 7ff632055b80 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9e67b0c90 0x55c9e67b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:12:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.264+0000 7ff632055b80 4 client.16224 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f6c38de1", "release": true, "await": true}] 2024-05-08T07:12:06.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.264+0000 7ff632055b80 1 -- 172.21.15.70:0/1697662225 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f6c38de1", "release": true, "await": true}) -- 0x55c9e668b500 con 0x55c9e67b0c90 2024-05-08T07:12:06.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.264+0000 7ff624c00700 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9e67b0c90 0x55c9e67b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:12:06.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.265+0000 7ff60ea00700 10 client.16224 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:12:06.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:06.265+0000 7ff624c00700 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9e67b0c90 0x55c9e67b30b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f36da549794a2f94 server_cookie=17e375c84d05ff9d in_seq=0 out_seq=0 2024-05-08T07:12:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:07 smithi070 ceph-mon[29591]: pgmap v805: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:12:07.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:07 smithi172 ceph-mon[33377]: pgmap v805: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:12:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:07 smithi194 ceph-mon[33679]: pgmap v805: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:12:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.045+0000 7ff60ea00700 1 -- 172.21.15.70:0/1697662225 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55c9e668b500 con 0x55c9e67b0c90 2024-05-08T07:12:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.045+0000 7ff60ea00700 10 client.16224 handle_command_reply: tid=0 2024-05-08T07:12:09.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.045+0000 7ff632055b80 1 client.16224 shutdown 2024-05-08T07:12:09.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.046+0000 7ff632055b80 1 -- 172.21.15.70:0/1697662225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 msgr2=0x55c9e6748fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:09.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.046+0000 7ff632055b80 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e6748fc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff61002b040 tx=0x7ff610005920 comp rx=0 tx=0).stop 2024-05-08T07:12:09.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.046+0000 7ff632055b80 1 -- 172.21.15.70:0/1697662225 shutdown_connections 2024-05-08T07:12:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.046+0000 7ff632055b80 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9e67b0c90 0x55c9e67b30b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.046+0000 7ff632055b80 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c9e67311b0 0x55c9e6749500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.046+0000 7ff632055b80 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c9e672b780 0x55c9e674abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.046+0000 7ff632055b80 1 --2- 172.21.15.70:0/1697662225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c9e672c140 0x55c9e6748fc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.046+0000 7ff632055b80 1 -- 172.21.15.70:0/1697662225 >> 172.21.15.70:0/1697662225 conn(0x55c9e66a37d0 msgr2=0x55c9e6720b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:12:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.046+0000 7ff60ea00700 0 client.16224 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:12:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.047+0000 7ff632055b80 1 -- 172.21.15.70:0/1697662225 shutdown_connections 2024-05-08T07:12:09.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.047+0000 7ff632055b80 1 -- 172.21.15.70:0/1697662225 wait complete. 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.047+0000 7ff632055b80 20 client.16224 trim_cache size 0 max 16384 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 32, 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 68, 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "f6c38de1": { 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 68, 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:12:09.047 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.6, 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:12:09.048 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:12:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:12:09.049 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:12:09.049 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:12:09.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.048+0000 7ff627600700 1 -- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff6000b2a70 msgr2=0x7ff6000b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:09.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.048+0000 7ff627600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff6000b2a70 0x7ff6000b4f30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff62006af40 tx=0x7ff6180078b0 comp rx=0 tx=0).stop 2024-05-08T07:12:09.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 -- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006ba40 msgr2=0x7ff6201a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:12:09.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006ba40 0x7ff6201a18d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7ff60800c9b0 tx=0x7ff60800cd70 comp rx=0 tx=0).stop 2024-05-08T07:12:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 -- 172.21.15.70:0/934615695 shutdown_connections 2024-05-08T07:12:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff6000b2a70 0x7ff6000b4f30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff62010ff40 0x7ff62019ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff62006ba40 0x7ff6201a18d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 --2- 172.21.15.70:0/934615695 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff62006c360 0x7ff6201a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:12:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 -- 172.21.15.70:0/934615695 >> 172.21.15.70:0/934615695 conn(0x7ff620079310 msgr2=0x7ff6201113f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:12:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 -- 172.21.15.70:0/934615695 shutdown_connections 2024-05-08T07:12:09.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:12:09.049+0000 7ff627600700 1 -- 172.21.15.70:0/934615695 wait complete. 2024-05-08T07:12:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:09 smithi070 ceph-mon[29591]: pgmap v806: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:12:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:09 smithi172 ceph-mon[33377]: pgmap v806: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:12:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:09 smithi194 ceph-mon[33679]: pgmap v806: 129 pgs: 129 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:12:09.863 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f6c38de1', seconds elapsed: 61.5 2024-05-08T07:12:10.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:10 smithi070 ceph-mon[29591]: osdmap e130: 12 total, 12 up, 12 in 2024-05-08T07:12:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:10 smithi172 ceph-mon[33377]: osdmap e130: 12 total, 12 up, 12 in 2024-05-08T07:12:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:10 smithi194 ceph-mon[33679]: osdmap e130: 12 total, 12 up, 12 in 2024-05-08T07:12:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:11 smithi070 ceph-mon[29591]: pgmap v808: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-05-08T07:12:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:11 smithi172 ceph-mon[33377]: pgmap v808: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-05-08T07:12:11.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:11 smithi194 ceph-mon[33679]: pgmap v808: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-05-08T07:12:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:13 smithi070 ceph-mon[29591]: pgmap v809: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-05-08T07:12:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:13 smithi172 ceph-mon[33377]: pgmap v809: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-05-08T07:12:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:13 smithi194 ceph-mon[33679]: pgmap v809: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-05-08T07:12:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:15 smithi070 ceph-mon[29591]: pgmap v810: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-05-08T07:12:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:15 smithi172 ceph-mon[33377]: pgmap v810: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-05-08T07:12:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:15 smithi194 ceph-mon[33679]: pgmap v810: 129 pgs: 7 active+clean+snaptrim_wait, 122 active+clean; 1.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 27 op/s 2024-05-08T07:12:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:17 smithi070 ceph-mon[29591]: pgmap v811: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 969 KiB/s wr, 50 op/s 2024-05-08T07:12:17.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:17 smithi172 ceph-mon[33377]: pgmap v811: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 969 KiB/s wr, 50 op/s 2024-05-08T07:12:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:17 smithi194 ceph-mon[33679]: pgmap v811: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 969 KiB/s wr, 50 op/s 2024-05-08T07:12:18.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:18 smithi070 ceph-mon[29591]: pgmap v812: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 969 KiB/s wr, 50 op/s 2024-05-08T07:12:18.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:18 smithi070 ceph-mon[29591]: osdmap e131: 12 total, 12 up, 12 in 2024-05-08T07:12:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:18 smithi172 ceph-mon[33377]: pgmap v812: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 969 KiB/s wr, 50 op/s 2024-05-08T07:12:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:18 smithi172 ceph-mon[33377]: osdmap e131: 12 total, 12 up, 12 in 2024-05-08T07:12:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:18 smithi194 ceph-mon[33679]: pgmap v812: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 969 KiB/s wr, 50 op/s 2024-05-08T07:12:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:18 smithi194 ceph-mon[33679]: osdmap e131: 12 total, 12 up, 12 in 2024-05-08T07:12:20.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:20 smithi070 ceph-mon[29591]: pgmap v814: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-05-08T07:12:20.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:20 smithi172 ceph-mon[33377]: pgmap v814: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-05-08T07:12:21.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:20 smithi194 ceph-mon[33679]: pgmap v814: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-05-08T07:12:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:22 smithi070 ceph-mon[29591]: pgmap v815: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-05-08T07:12:22.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:22 smithi172 ceph-mon[33377]: pgmap v815: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-05-08T07:12:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:22 smithi194 ceph-mon[33679]: pgmap v815: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-05-08T07:12:24.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:24 smithi070 ceph-mon[29591]: pgmap v816: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-05-08T07:12:24.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:24 smithi172 ceph-mon[33377]: pgmap v816: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-05-08T07:12:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:24 smithi194 ceph-mon[33679]: pgmap v816: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.5 MiB/s wr, 99 op/s 2024-05-08T07:12:26.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:26 smithi070 ceph-mon[29591]: pgmap v817: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.4 MiB/s wr, 347 op/s 2024-05-08T07:12:26.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:26 smithi172 ceph-mon[33377]: pgmap v817: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.4 MiB/s wr, 347 op/s 2024-05-08T07:12:27.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:26 smithi194 ceph-mon[33679]: pgmap v817: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.4 MiB/s wr, 347 op/s 2024-05-08T07:12:28.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:28 smithi070 ceph-mon[29591]: pgmap v818: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.4 MiB/s wr, 347 op/s 2024-05-08T07:12:28.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:28 smithi172 ceph-mon[33377]: pgmap v818: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.4 MiB/s wr, 347 op/s 2024-05-08T07:12:29.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:28 smithi194 ceph-mon[33679]: pgmap v818: 129 pgs: 129 active+clean; 1.3 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 1.4 MiB/s wr, 347 op/s 2024-05-08T07:12:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:30 smithi070 ceph-mon[29591]: pgmap v819: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.8 MiB/s wr, 338 op/s 2024-05-08T07:12:30.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:30 smithi172 ceph-mon[33377]: pgmap v819: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.8 MiB/s wr, 338 op/s 2024-05-08T07:12:31.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:30 smithi194 ceph-mon[33679]: pgmap v819: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 1.8 MiB/s wr, 338 op/s 2024-05-08T07:12:32.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:32 smithi172 ceph-mon[33377]: pgmap v820: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.4 MiB/s wr, 291 op/s 2024-05-08T07:12:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:32 smithi194 ceph-mon[33679]: pgmap v820: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.4 MiB/s wr, 291 op/s 2024-05-08T07:12:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:32 smithi070 ceph-mon[29591]: pgmap v820: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.4 MiB/s wr, 291 op/s 2024-05-08T07:12:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:34 smithi172 ceph-mon[33377]: pgmap v821: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.4 MiB/s wr, 291 op/s 2024-05-08T07:12:34.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:34 smithi070 ceph-mon[29591]: pgmap v821: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.4 MiB/s wr, 291 op/s 2024-05-08T07:12:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:34 smithi194 ceph-mon[33679]: pgmap v821: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.4 MiB/s wr, 291 op/s 2024-05-08T07:12:36.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:36 smithi172 ceph-mon[33377]: pgmap v822: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 2.4 MiB/s wr, 380 op/s 2024-05-08T07:12:37.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:36 smithi194 ceph-mon[33679]: pgmap v822: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 2.4 MiB/s wr, 380 op/s 2024-05-08T07:12:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:36 smithi070 ceph-mon[29591]: pgmap v822: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 2.4 MiB/s wr, 380 op/s 2024-05-08T07:12:38.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:38 smithi172 ceph-mon[33377]: pgmap v823: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.6 MiB/s wr, 135 op/s 2024-05-08T07:12:39.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:38 smithi194 ceph-mon[33679]: pgmap v823: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.6 MiB/s wr, 135 op/s 2024-05-08T07:12:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:38 smithi070 ceph-mon[29591]: pgmap v823: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.6 MiB/s wr, 135 op/s 2024-05-08T07:12:40.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:40 smithi172 ceph-mon[33377]: pgmap v824: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 2.3 MiB/s wr, 428 op/s 2024-05-08T07:12:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:40 smithi194 ceph-mon[33679]: pgmap v824: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 2.3 MiB/s wr, 428 op/s 2024-05-08T07:12:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:40 smithi070 ceph-mon[29591]: pgmap v824: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 2.3 MiB/s wr, 428 op/s 2024-05-08T07:12:42.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:42 smithi172 ceph-mon[33377]: pgmap v825: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.7 MiB/s wr, 383 op/s 2024-05-08T07:12:43.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:42 smithi194 ceph-mon[33679]: pgmap v825: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.7 MiB/s wr, 383 op/s 2024-05-08T07:12:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:42 smithi070 ceph-mon[29591]: pgmap v825: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.7 MiB/s wr, 383 op/s 2024-05-08T07:12:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:44 smithi172 ceph-mon[33377]: pgmap v826: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.7 MiB/s wr, 383 op/s 2024-05-08T07:12:45.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:44 smithi194 ceph-mon[33679]: pgmap v826: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.7 MiB/s wr, 383 op/s 2024-05-08T07:12:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:44 smithi070 ceph-mon[29591]: pgmap v826: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.7 MiB/s wr, 383 op/s 2024-05-08T07:12:46.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:46 smithi172 ceph-mon[33377]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 2.3 MiB/s wr, 537 op/s 2024-05-08T07:12:47.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:46 smithi194 ceph-mon[33679]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 2.3 MiB/s wr, 537 op/s 2024-05-08T07:12:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:46 smithi070 ceph-mon[29591]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 2.3 MiB/s wr, 537 op/s 2024-05-08T07:12:48.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:48 smithi172 ceph-mon[33377]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.3 MiB/s wr, 448 op/s 2024-05-08T07:12:49.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:48 smithi194 ceph-mon[33679]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.3 MiB/s wr, 448 op/s 2024-05-08T07:12:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:48 smithi070 ceph-mon[29591]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.3 MiB/s wr, 448 op/s 2024-05-08T07:12:50.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:12:50.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:12:50.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:12:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:50 smithi194 ceph-mon[33679]: pgmap v829: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.8 MiB/s wr, 615 op/s 2024-05-08T07:12:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:50 smithi070 ceph-mon[29591]: pgmap v829: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.8 MiB/s wr, 615 op/s 2024-05-08T07:12:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:50 smithi172 ceph-mon[33377]: pgmap v829: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 1.8 MiB/s wr, 615 op/s 2024-05-08T07:12:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:12:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:12:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:12:52.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:12:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:12:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:12:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:12:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:12:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:12:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:52 smithi070 ceph-mon[29591]: pgmap v830: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-05-08T07:12:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:52 smithi172 ceph-mon[33377]: pgmap v830: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-05-08T07:12:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:52 smithi194 ceph-mon[33679]: pgmap v830: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-05-08T07:12:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:54 smithi070 ceph-mon[29591]: pgmap v831: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-05-08T07:12:55.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:54 smithi172 ceph-mon[33377]: pgmap v831: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-05-08T07:12:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:54 smithi194 ceph-mon[33679]: pgmap v831: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 379 KiB/s rd, 1.2 MiB/s wr, 321 op/s 2024-05-08T07:12:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:56 smithi070 ceph-mon[29591]: pgmap v832: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 1.8 MiB/s wr, 398 op/s 2024-05-08T07:12:57.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:56 smithi172 ceph-mon[33377]: pgmap v832: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 1.8 MiB/s wr, 398 op/s 2024-05-08T07:12:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:56 smithi194 ceph-mon[33679]: pgmap v832: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 1.8 MiB/s wr, 398 op/s 2024-05-08T07:12:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:58 smithi070 ceph-mon[29591]: pgmap v833: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-05-08T07:12:59.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:58 smithi172 ceph-mon[33377]: pgmap v833: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-05-08T07:12:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:58 smithi194 ceph-mon[33679]: pgmap v833: 129 pgs: 129 active+clean; 1.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.2 MiB/s wr, 243 op/s 2024-05-08T07:13:00.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:12:59 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:13:00.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:12:59 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:13:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:12:59 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:13:01.121 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.7 2024-05-08T07:13:01.122 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:13:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:00 smithi172 ceph-mon[33377]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 2.0 MiB/s wr, 414 op/s 2024-05-08T07:13:01.205 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:00 smithi070 ceph-mon[29591]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 2.0 MiB/s wr, 414 op/s 2024-05-08T07:13:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:00 smithi194 ceph-mon[33679]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 2.0 MiB/s wr, 414 op/s 2024-05-08T07:13:01.618 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:13:03.109 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:02 smithi070 ceph-mon[29591]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-05-08T07:13:03.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:02 smithi172 ceph-mon[33377]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-05-08T07:13:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:02 smithi194 ceph-mon[33679]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-05-08T07:13:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.212+0000 7fed18800700 1 -- 172.21.15.70:0/2554575750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10108400 msgr2=0x7fed101087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.212+0000 7fed18800700 1 --2- 172.21.15.70:0/2554575750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10108400 0x7fed101087e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fed04009990 tx=0x7fed04009ca0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.212+0000 7fed18800700 1 -- 172.21.15.70:0/2554575750 shutdown_connections 2024-05-08T07:13:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.212+0000 7fed18800700 1 --2- 172.21.15.70:0/2554575750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed10102d50 0x7fed1010f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.212+0000 7fed18800700 1 --2- 172.21.15.70:0/2554575750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10108400 0x7fed101087e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.212+0000 7fed18800700 1 --2- 172.21.15.70:0/2554575750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed10102390 0x7fed10102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.212+0000 7fed18800700 1 -- 172.21.15.70:0/2554575750 >> 172.21.15.70:0/2554575750 conn(0x7fed10079310 msgr2=0x7fed10079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.212+0000 7fed18800700 1 -- 172.21.15.70:0/2554575750 shutdown_connections 2024-05-08T07:13:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.212+0000 7fed18800700 1 -- 172.21.15.70:0/2554575750 wait complete. 2024-05-08T07:13:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.213+0000 7fed18800700 1 Processor -- start 2024-05-08T07:13:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.213+0000 7fed18800700 1 -- start start 2024-05-08T07:13:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed18800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10102390 0x7fed101a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed18800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed10102d50 0x7fed101a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed18800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed10108400 0x7fed1019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed18800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fed10112450 con 0x7fed10102390 2024-05-08T07:13:04.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed18800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fed101122d0 con 0x7fed10102d50 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed18800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fed101125d0 con 0x7fed10108400 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed15e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10102390 0x7fed101a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed15e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10102390 0x7fed101a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43090/0 (socket says 172.21.15.70:43090) 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed15e00700 1 -- 172.21.15.70:0/1631975642 learned_addr learned my addr 172.21.15.70:0/1631975642 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.214+0000 7fed15400700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed10102d50 0x7fed101a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.215+0000 7fed16800700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed10108400 0x7fed1019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.215+0000 7fed15e00700 1 -- 172.21.15.70:0/1631975642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed10108400 msgr2=0x7fed1019bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.215+0000 7fed15e00700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed10108400 0x7fed1019bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.215+0000 7fed15e00700 1 -- 172.21.15.70:0/1631975642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed10102d50 msgr2=0x7fed101a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.215+0000 7fed15e00700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed10102d50 0x7fed101a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.215+0000 7fed15e00700 1 -- 172.21.15.70:0/1631975642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1019c450 con 0x7fed10102390 2024-05-08T07:13:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.215+0000 7fed15e00700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10102390 0x7fed101a1a50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fed04000c00 tx=0x7fed04005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.215+0000 7fed0aa00700 1 -- 172.21.15.70:0/1631975642 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed04027070 con 0x7fed10102390 2024-05-08T07:13:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.216+0000 7fed0aa00700 1 -- 172.21.15.70:0/1631975642 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed0400fb80 con 0x7fed10102390 2024-05-08T07:13:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.216+0000 7fed0aa00700 1 -- 172.21.15.70:0/1631975642 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed04022c30 con 0x7fed10102390 2024-05-08T07:13:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.216+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1019c6e0 con 0x7fed10102390 2024-05-08T07:13:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.216+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed101a8800 con 0x7fed10102390 2024-05-08T07:13:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.217+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed10103ab0 con 0x7fed10102390 2024-05-08T07:13:04.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.220+0000 7fed0aa00700 1 -- 172.21.15.70:0/1631975642 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fed0402a070 con 0x7fed10102390 2024-05-08T07:13:04.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.221+0000 7fed0aa00700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecf80b2a70 0x7fecf80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:04.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.221+0000 7fed0aa00700 1 -- 172.21.15.70:0/1631975642 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 9583+0+0 (secure 0 0 0) 0x7fed040e3b50 con 0x7fed10102390 2024-05-08T07:13:04.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.222+0000 7fed15400700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecf80b2a70 0x7fecf80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:04.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.222+0000 7fed15400700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecf80b2a70 0x7fecf80b4f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed00005950 tx=0x7fed000058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:04.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.224+0000 7fed0aa00700 1 -- 172.21.15.70:0/1631975642 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fed04031080 con 0x7fed10102390 2024-05-08T07:13:04.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.614+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed101a89d0 con 0x7fed10102390 2024-05-08T07:13:04.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.616+0000 7fed0aa00700 1 -- 172.21.15.70:0/1631975642 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11880 (secure 0 0 0) 0x7fed04013070 con 0x7fed10102390 2024-05-08T07:13:04.616 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:13:04.616 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:12:58.286160+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.619+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecf80b2a70 msgr2=0x7fecf80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.619+0000 7fed18800700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecf80b2a70 0x7fecf80b4f30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fed00005950 tx=0x7fed000058e0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.619+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10102390 msgr2=0x7fed101a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.619+0000 7fed18800700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10102390 0x7fed101a1a50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fed04000c00 tx=0x7fed04005ef0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.620+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 shutdown_connections 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.620+0000 7fed18800700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fecf80b2a70 0x7fecf80b4f30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.620+0000 7fed18800700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fed10108400 0x7fed1019bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.620+0000 7fed18800700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed10102390 0x7fed101a1a50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.620+0000 7fed18800700 1 --2- 172.21.15.70:0/1631975642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fed10102d50 0x7fed101a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.620+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 >> 172.21.15.70:0/1631975642 conn(0x7fed10079310 msgr2=0x7fed1006bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.620+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 shutdown_connections 2024-05-08T07:13:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:04.620+0000 7fed18800700 1 -- 172.21.15.70:0/1631975642 wait complete. 2024-05-08T07:13:04.620 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 33 2024-05-08T07:13:05.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:04 smithi172 ceph-mon[33377]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-05-08T07:13:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:04 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1631975642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:13:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:04 smithi194 ceph-mon[33679]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-05-08T07:13:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:04 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1631975642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:13:05.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:04 smithi070 ceph-mon[29591]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-05-08T07:13:05.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:04 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1631975642' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:13:05.433 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 89.7 --await-for 42.0' 2024-05-08T07:13:05.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 89.7 --await-for 42.0 2024-05-08T07:13:06.012 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:13:06.195 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:05 smithi070 ceph-mon[29591]: osdmap e132: 12 total, 12 up, 12 in 2024-05-08T07:13:06.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:05 smithi194 ceph-mon[33679]: osdmap e132: 12 total, 12 up, 12 in 2024-05-08T07:13:06.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:05 smithi172 ceph-mon[33377]: osdmap e132: 12 total, 12 up, 12 in 2024-05-08T07:13:07.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:06 smithi070 ceph-mon[29591]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 2.2 MiB/s wr, 403 op/s 2024-05-08T07:13:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:06 smithi194 ceph-mon[33679]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 2.2 MiB/s wr, 403 op/s 2024-05-08T07:13:07.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:06 smithi172 ceph-mon[33377]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 2.2 MiB/s wr, 403 op/s 2024-05-08T07:13:08.959 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:08 smithi070 ceph-mon[29591]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 2.2 MiB/s wr, 403 op/s 2024-05-08T07:13:09.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.059+0000 7fe865c00700 1 -- 172.21.15.70:0/4003192437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe860108860 msgr2=0x7fe8601103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:09.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.059+0000 7fe865c00700 1 --2- 172.21.15.70:0/4003192437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe860108860 0x7fe8601103e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe85000b0d0 tx=0x7fe85000b3e0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.060+0000 7fe865c00700 1 -- 172.21.15.70:0/4003192437 shutdown_connections 2024-05-08T07:13:09.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.060+0000 7fe865c00700 1 --2- 172.21.15.70:0/4003192437 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe860108860 0x7fe8601103e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.060+0000 7fe865c00700 1 --2- 172.21.15.70:0/4003192437 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe86006b3e0 0x7fe86006b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.060+0000 7fe865c00700 1 --2- 172.21.15.70:0/4003192437 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe86006bd90 0x7fe860108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.060+0000 7fe865c00700 1 -- 172.21.15.70:0/4003192437 >> 172.21.15.70:0/4003192437 conn(0x7fe860079340 msgr2=0x7fe860079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.060+0000 7fe865c00700 1 -- 172.21.15.70:0/4003192437 shutdown_connections 2024-05-08T07:13:09.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.060+0000 7fe865c00700 1 -- 172.21.15.70:0/4003192437 wait complete. 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.061+0000 7fe865c00700 1 Processor -- start 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.061+0000 7fe865c00700 1 -- start start 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.061+0000 7fe865c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe86006b3e0 0x7fe8601976c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.061+0000 7fe865c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe86006bd90 0x7fe860197c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.061+0000 7fe865c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860108860 0x7fe86019bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe865c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8601113b0 con 0x7fe86006b3e0 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe865c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe860111230 con 0x7fe860108860 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe865c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe860111530 con 0x7fe86006bd90 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe85ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe86006b3e0 0x7fe8601976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe85ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe86006b3e0 0x7fe8601976c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49400/0 (socket says 172.21.15.70:49400) 2024-05-08T07:13:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe85ea00700 1 -- 172.21.15.70:0/1839205311 learned_addr learned my addr 172.21.15.70:0/1839205311 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:13:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe85e000700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe86006bd90 0x7fe860197c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe85f400700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860108860 0x7fe86019bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe85ea00700 1 -- 172.21.15.70:0/1839205311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe86006bd90 msgr2=0x7fe860197c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe85ea00700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe86006bd90 0x7fe860197c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe85ea00700 1 -- 172.21.15.70:0/1839205311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860108860 msgr2=0x7fe86019bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.062+0000 7fe85ea00700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860108860 0x7fe86019bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.063+0000 7fe85ea00700 1 -- 172.21.15.70:0/1839205311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86019c680 con 0x7fe86006b3e0 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.063+0000 7fe85e000700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe86006bd90 0x7fe860197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.063+0000 7fe85ea00700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe86006b3e0 0x7fe8601976c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c920 tx=0x7fe85800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.063+0000 7fe857400700 1 -- 172.21.15.70:0/1839205311 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858007b00 con 0x7fe86006b3e0 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.063+0000 7fe857400700 1 -- 172.21.15.70:0/1839205311 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe858004cc0 con 0x7fe86006b3e0 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.063+0000 7fe865c00700 1 -- 172.21.15.70:0/1839205311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86019c970 con 0x7fe86006b3e0 2024-05-08T07:13:09.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.063+0000 7fe857400700 1 -- 172.21.15.70:0/1839205311 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580054f0 con 0x7fe86006b3e0 2024-05-08T07:13:09.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.064+0000 7fe865c00700 1 -- 172.21.15.70:0/1839205311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8601a41f0 con 0x7fe86006b3e0 2024-05-08T07:13:09.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.068+0000 7fe857400700 1 -- 172.21.15.70:0/1839205311 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe858007ca0 con 0x7fe86006b3e0 2024-05-08T07:13:09.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.070+0000 7fe87059fb80 1 Processor -- start 2024-05-08T07:13:09.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.070+0000 7fe87059fb80 1 -- start start 2024-05-08T07:13:09.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 0x558cb3e74330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e6e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6eee0 0x558cb3e7ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe87059fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558cb3dc0bb0 con 0x558cb3e6e520 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe87059fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558cb3d5e8f0 con 0x558cb3e6eee0 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe87059fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558cb3dbcb70 con 0x558cb3e73f50 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe857400700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8440b6f30 0x7fe8440b93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe85ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e6e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe85ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e6e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49404/0 (socket says 172.21.15.70:49404) 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe857400700 1 -- 172.21.15.70:0/1839205311 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 9671+0+0 (secure 0 0 0) 0x7fe8580e26f0 con 0x7fe86006b3e0 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe85ea00700 1 -- 172.21.15.70:0/2769945728 learned_addr learned my addr 172.21.15.70:0/2769945728 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.071+0000 7fe85f400700 1 --2- 172.21.15.70:0/2769945728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 0x558cb3e74330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe85f400700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8440b6f30 0x7fe8440b93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe85e000700 1 --2- 172.21.15.70:0/2769945728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6eee0 0x558cb3e7ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe85ea00700 1 -- 172.21.15.70:0/2769945728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 msgr2=0x558cb3e74330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:13:09.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe85ea00700 1 --2- 172.21.15.70:0/2769945728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 0x558cb3e74330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe85ea00700 1 -- 172.21.15.70:0/2769945728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6eee0 msgr2=0x558cb3e7ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:13:09.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe85ea00700 1 --2- 172.21.15.70:0/2769945728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6eee0 0x558cb3e7ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe85ea00700 1 -- 172.21.15.70:0/2769945728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cb3d0da60 con 0x558cb3e6e520 2024-05-08T07:13:09.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe85ea00700 1 --2- 172.21.15.70:0/2769945728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e6e9a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe85800cfd0 tx=0x7fe85801b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472eb27c78d69d1a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:09.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe84fe00700 1 -- 172.21.15.70:0/2769945728 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580a9000 con 0x558cb3e6e520 2024-05-08T07:13:09.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe84fe00700 1 -- 172.21.15.70:0/2769945728 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8580a9bf0 con 0x558cb3e6e520 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.072+0000 7fe84fe00700 1 -- 172.21.15.70:0/2769945728 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8580dfde0 con 0x558cb3e6e520 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.073+0000 7fe87059fb80 1 -- 172.21.15.70:0/2769945728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 msgr2=0x558cb3e6e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.073+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2769945728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e6e9a0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe85800cfd0 tx=0x7fe85801b880 comp rx=0 tx=0).stop 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.073+0000 7fe85f400700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8440b6f30 0x7fe8440b93f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe850005bd0 tx=0x7fe85000b040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.073+0000 7fe87059fb80 1 -- 172.21.15.70:0/2769945728 shutdown_connections 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.073+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2769945728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6eee0 0x558cb3e7ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.073+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2769945728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 0x558cb3e74330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.073+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2769945728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e6e9a0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.073+0000 7fe87059fb80 1 -- 172.21.15.70:0/2769945728 >> 172.21.15.70:0/2769945728 conn(0x558cb3d9ccf0 msgr2=0x558cb3e68e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.073+0000 7fe87059fb80 1 -- 172.21.15.70:0/2769945728 shutdown_connections 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.074+0000 7fe87059fb80 1 -- 172.21.15.70:0/2769945728 wait complete. 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.074+0000 7fe87059fb80 1 -- start start 2024-05-08T07:13:09.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.074+0000 7fe87059fb80 1 Processor -- start 2024-05-08T07:13:09.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e7a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6eee0 0x558cb3e77d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e78250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe87059fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558cb3e7b310 con 0x558cb3e6e520 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe87059fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558cb3d26cb0 con 0x558cb3e73f50 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe87059fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558cb3e7b490 con 0x558cb3e6eee0 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe87059fb80 10 client.0 _ll_register_callbacks cb 0x558cb3d67e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe85ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e7a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe85ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e7a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49414/0 (socket says 172.21.15.70:49414) 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.075+0000 7fe85ea00700 1 -- 172.21.15.70:0/2154025171 learned_addr learned my addr 172.21.15.70:0/2154025171 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe85e000700 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6eee0 0x558cb3e77d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe85f400700 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e78250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe85ea00700 1 -- 172.21.15.70:0/2154025171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6eee0 msgr2=0x558cb3e77d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:13:09.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe85ea00700 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6eee0 0x558cb3e77d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe85ea00700 1 -- 172.21.15.70:0/2154025171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 msgr2=0x558cb3e78250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe85ea00700 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e78250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe85ea00700 1 -- 172.21.15.70:0/2154025171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cb3d865b0 con 0x558cb3e6e520 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe85f400700 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e78250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe85ea00700 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e7a970 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe8580a91f0 tx=0x7fe8580a9980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df16cb03267ceed6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe84cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.076+0000 7fe84cc00700 1 -- 172.21.15.70:0/2154025171 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85808f070 con 0x558cb3e6e520 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.077+0000 7fe84cc00700 1 -- 172.21.15.70:0/2154025171 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 9671+0+0 (secure 0 0 0) 0x7fe8580b20d0 con 0x558cb3e6e520 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.077+0000 7fe87059fb80 1 -- 172.21.15.70:0/2154025171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8580a9bf0 con 0x558cb3e6e520 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.077+0000 7fe84cc00700 1 -- 172.21.15.70:0/2154025171 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe8580a9000 con 0x558cb3e6e520 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.077+0000 7fe87059fb80 10 client.16242 fetch_fsmap learned FSMap version 33 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.077+0000 7fe87059fb80 1 -- 172.21.15.70:0/2154025171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558cb3e7b310 con 0x558cb3e6e520 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.077+0000 7fe84cc00700 1 -- 172.21.15.70:0/2154025171 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8580a9bf0 con 0x558cb3e6e520 2024-05-08T07:13:09.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.077+0000 7fe84cc00700 1 -- 172.21.15.70:0/2154025171 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8358+0+0 (secure 0 0 0) 0x7fe8580a87e0 con 0x558cb3e6e520 2024-05-08T07:13:09.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.077+0000 7fe87059fb80 10 client.16242 fetch_fsmap finished waiting for FSMap version 33 2024-05-08T07:13:09.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.077+0000 7fe87059fb80 10 client.16242 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:13:09.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.078+0000 7fe87059fb80 20 client.16242 populate_metadata read hostname 'smithi070' 2024-05-08T07:13:09.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.078+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558cb3e87e70 0x558cb3e8a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.078+0000 7fe87059fb80 4 client.16242 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:13:09.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.078+0000 7fe87059fb80 1 -- 172.21.15.70:0/2154025171 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558cb3e3b230 con 0x558cb3e87e70 2024-05-08T07:13:09.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.078+0000 7fe85e000700 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558cb3e87e70 0x558cb3e8a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.079+0000 7fe84cc00700 10 client.16242 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:13:09.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.079+0000 7fe85e000700 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558cb3e87e70 0x558cb3e8a260 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a661de44ad0a0528 server_cookie=77adc329031a27db in_seq=0 out_seq=0 2024-05-08T07:13:09.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe84cc00700 1 -- 172.21.15.70:0/2154025171 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558cb3e3b230 con 0x558cb3e87e70 2024-05-08T07:13:09.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe84cc00700 10 client.16242 handle_command_reply: tid=0 2024-05-08T07:13:09.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe87059fb80 1 client.16242 shutdown 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe87059fb80 1 -- 172.21.15.70:0/2154025171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 msgr2=0x558cb3e7a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e7a970 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fe8580a91f0 tx=0x7fe8580a9980 comp rx=0 tx=0).stop 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe87059fb80 1 -- 172.21.15.70:0/2154025171 shutdown_connections 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558cb3e87e70 0x558cb3e8a260 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e78250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6e520 0x558cb3e7a970 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe87059fb80 1 --2- 172.21.15.70:0/2154025171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6eee0 0x558cb3e77d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe84cc00700 0 client.16242 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.089+0000 7fe87059fb80 1 -- 172.21.15.70:0/2154025171 >> 172.21.15.70:0/2154025171 conn(0x558cb3d9ccf0 msgr2=0x558cb3e638e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.090+0000 7fe87059fb80 1 -- 172.21.15.70:0/2154025171 shutdown_connections 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.090+0000 7fe87059fb80 1 -- 172.21.15.70:0/2154025171 wait complete. 2024-05-08T07:13:09.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.090+0000 7fe87059fb80 20 client.16242 trim_cache size 0 max 16384 2024-05-08T07:13:09.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.112+0000 7fe87059fb80 1 Processor -- start 2024-05-08T07:13:09.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.112+0000 7fe87059fb80 1 -- start start 2024-05-08T07:13:09.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.112+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6e520 0x558cb3e84360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.112+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e79a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.112+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 0x558cb3e79f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.112+0000 7fe87059fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8601afd50 con 0x558cb3e6eee0 2024-05-08T07:13:09.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.112+0000 7fe87059fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8601ad5b0 con 0x558cb3e6e520 2024-05-08T07:13:09.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.112+0000 7fe87059fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe8601ab420 con 0x558cb3e73f50 2024-05-08T07:13:09.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.112+0000 7fe85e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e79a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e79a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49416/0 (socket says 172.21.15.70:49416) 2024-05-08T07:13:09.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85e000700 1 -- 172.21.15.70:0/177920263 learned_addr learned my addr 172.21.15.70:0/177920263 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:13:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85f400700 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 0x558cb3e79f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85ea00700 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6e520 0x558cb3e84360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85e000700 1 -- 172.21.15.70:0/177920263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 msgr2=0x558cb3e79f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:13:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85e000700 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 0x558cb3e79f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85e000700 1 -- 172.21.15.70:0/177920263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6e520 msgr2=0x558cb3e84360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:13:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85e000700 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6e520 0x558cb3e84360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85e000700 1 -- 172.21.15.70:0/177920263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cb3e65a10 con 0x558cb3e6eee0 2024-05-08T07:13:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85ea00700 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6e520 0x558cb3e84360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:13:09.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.113+0000 7fe85e000700 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e79a20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe848005fd0 tx=0x7fe848004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485f2d709fc504da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:09.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.114+0000 7fe84f400700 1 -- 172.21.15.70:0/177920263 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848021070 con 0x558cb3e6eee0 2024-05-08T07:13:09.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.114+0000 7fe84f400700 1 -- 172.21.15.70:0/177920263 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8480044e0 con 0x558cb3e6eee0 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.114+0000 7fe84f400700 1 -- 172.21.15.70:0/177920263 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8480038e0 con 0x558cb3e6eee0 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.114+0000 7fe87059fb80 1 -- 172.21.15.70:0/177920263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 msgr2=0x558cb3e79a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.114+0000 7fe87059fb80 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e79a20 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fe848005fd0 tx=0x7fe848004750 comp rx=0 tx=0).stop 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.115+0000 7fe87059fb80 1 -- 172.21.15.70:0/177920263 shutdown_connections 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.115+0000 7fe87059fb80 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e73f50 0x558cb3e79f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.115+0000 7fe87059fb80 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e6e520 0x558cb3e84360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.115+0000 7fe87059fb80 1 --2- 172.21.15.70:0/177920263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e79a20 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.115+0000 7fe87059fb80 1 -- 172.21.15.70:0/177920263 >> 172.21.15.70:0/177920263 conn(0x558cb3d9ccf0 msgr2=0x558cb3e79310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.115+0000 7fe87059fb80 1 -- 172.21.15.70:0/177920263 shutdown_connections 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.115+0000 7fe87059fb80 1 -- 172.21.15.70:0/177920263 wait complete. 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.115+0000 7fe87059fb80 1 -- start start 2024-05-08T07:13:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.115+0000 7fe87059fb80 1 Processor -- start 2024-05-08T07:13:09.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6e520 0x558cb3e80700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e80c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe87059fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e7bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe87059fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8601aba70 con 0x558cb3e6eee0 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe87059fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8601acee0 con 0x558cb3e73f50 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe87059fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe8601ac140 con 0x558cb3e6e520 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe87059fb80 10 client.0 _ll_register_callbacks cb 0x558cb3e69470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe85e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e80c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe85e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e80c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49430/0 (socket says 172.21.15.70:49430) 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.116+0000 7fe85e000700 1 -- 172.21.15.70:0/1721322312 learned_addr learned my addr 172.21.15.70:0/1721322312 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe85ea00700 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6e520 0x558cb3e80700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe85f400700 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e7bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe85e000700 1 -- 172.21.15.70:0/1721322312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6e520 msgr2=0x558cb3e80700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe85e000700 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6e520 0x558cb3e80700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe85e000700 1 -- 172.21.15.70:0/1721322312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 msgr2=0x558cb3e7bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe85e000700 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e7bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe85e000700 1 -- 172.21.15.70:0/1721322312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cb3e7c530 con 0x558cb3e6eee0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe85f400700 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e7bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe85e000700 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e80c40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe84801f040 tx=0x7fe84801bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d96b48aebf51a3f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe84cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe84cc00700 1 -- 172.21.15.70:0/1721322312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe848021070 con 0x558cb3e6eee0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe84cc00700 1 -- 172.21.15.70:0/1721322312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(132..132 src has 1..132) ==== 9671+0+0 (secure 0 0 0) 0x7fe84801b5c0 con 0x558cb3e6eee0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.117+0000 7fe87059fb80 1 -- 172.21.15.70:0/1721322312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8480044e0 con 0x558cb3e6eee0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.118+0000 7fe84cc00700 1 -- 172.21.15.70:0/1721322312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fe848035050 con 0x558cb3e6eee0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.118+0000 7fe87059fb80 10 client.16248 fetch_fsmap learned FSMap version 33 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.118+0000 7fe87059fb80 1 -- 172.21.15.70:0/1721322312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558cb3ef3fb0 con 0x558cb3e6eee0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.118+0000 7fe84cc00700 1 -- 172.21.15.70:0/1721322312 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8480044e0 con 0x558cb3e6eee0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.118+0000 7fe84cc00700 1 -- 172.21.15.70:0/1721322312 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8358+0+0 (secure 0 0 0) 0x7fe848003680 con 0x558cb3e6eee0 2024-05-08T07:13:09.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.118+0000 7fe87059fb80 10 client.16248 fetch_fsmap finished waiting for FSMap version 33 2024-05-08T07:13:09.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.118+0000 7fe87059fb80 10 client.16248 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:13:09.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.118+0000 7fe87059fb80 20 client.16248 populate_metadata read hostname 'smithi070' 2024-05-08T07:13:09.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.118+0000 7fe87059fb80 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558cb3ef4710 0x558cb3ef6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:09.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.119+0000 7fe87059fb80 4 client.16248 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.7, "await_for": 42.0}] 2024-05-08T07:13:09.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.119+0000 7fe87059fb80 1 -- 172.21.15.70:0/1721322312 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.7, "await_for": 42.0}) -- 0x558cb3dce590 con 0x558cb3ef4710 2024-05-08T07:13:09.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.119+0000 7fe85ea00700 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558cb3ef4710 0x558cb3ef6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:09.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.120+0000 7fe85ea00700 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558cb3ef4710 0x558cb3ef6b30 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6660884ffdaa0862 server_cookie=65d7805c36fbdf4d in_seq=0 out_seq=0 2024-05-08T07:13:09.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:09.120+0000 7fe84cc00700 10 client.16248 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:13:09.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:08 smithi194 ceph-mon[33679]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 2.2 MiB/s wr, 403 op/s 2024-05-08T07:13:09.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:08 smithi172 ceph-mon[33377]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 2.2 MiB/s wr, 403 op/s 2024-05-08T07:13:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:10 smithi194 ceph-mon[33679]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 2.8 MiB/s wr, 325 op/s 2024-05-08T07:13:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:10 smithi070 ceph-mon[29591]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 2.8 MiB/s wr, 325 op/s 2024-05-08T07:13:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:10 smithi172 ceph-mon[33377]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 2.8 MiB/s wr, 325 op/s 2024-05-08T07:13:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:12 smithi194 ceph-mon[33679]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 2.8 MiB/s wr, 325 op/s 2024-05-08T07:13:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:12 smithi194 ceph-mon[33679]: osdmap e133: 12 total, 12 up, 12 in 2024-05-08T07:13:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:12 smithi070 ceph-mon[29591]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 2.8 MiB/s wr, 325 op/s 2024-05-08T07:13:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:12 smithi070 ceph-mon[29591]: osdmap e133: 12 total, 12 up, 12 in 2024-05-08T07:13:13.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:12 smithi172 ceph-mon[33377]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 2.8 MiB/s wr, 325 op/s 2024-05-08T07:13:13.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:12 smithi172 ceph-mon[33377]: osdmap e133: 12 total, 12 up, 12 in 2024-05-08T07:13:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:14 smithi194 ceph-mon[33679]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2024-05-08T07:13:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:14 smithi070 ceph-mon[29591]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2024-05-08T07:13:15.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:14 smithi172 ceph-mon[33377]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.8 MiB/s wr, 149 op/s 2024-05-08T07:13:17.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:16 smithi194 ceph-mon[33679]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-05-08T07:13:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:16 smithi070 ceph-mon[29591]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-05-08T07:13:17.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:16 smithi172 ceph-mon[33377]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-05-08T07:13:19.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:18 smithi172 ceph-mon[33377]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-05-08T07:13:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:18 smithi194 ceph-mon[33679]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-05-08T07:13:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:18 smithi070 ceph-mon[29591]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.7 MiB/s wr, 143 op/s 2024-05-08T07:13:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:20 smithi194 ceph-mon[33679]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 168 KiB/s wr, 21 op/s 2024-05-08T07:13:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:20 smithi070 ceph-mon[29591]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 168 KiB/s wr, 21 op/s 2024-05-08T07:13:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:20 smithi172 ceph-mon[33377]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 168 KiB/s wr, 21 op/s 2024-05-08T07:13:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:22 smithi194 ceph-mon[33679]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 168 KiB/s wr, 21 op/s 2024-05-08T07:13:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:22 smithi070 ceph-mon[29591]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 168 KiB/s wr, 21 op/s 2024-05-08T07:13:23.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:22 smithi172 ceph-mon[33377]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 168 KiB/s wr, 21 op/s 2024-05-08T07:13:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:24 smithi194 ceph-mon[33679]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 155 KiB/s wr, 19 op/s 2024-05-08T07:13:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.271+0000 7fe84cc00700 1 -- 172.21.15.70:0/1721322312 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x558cb3dce590 con 0x558cb3ef4710 2024-05-08T07:13:25.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.271+0000 7fe84cc00700 10 client.16248 handle_command_reply: tid=0 2024-05-08T07:13:25.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.271+0000 7fe87059fb80 1 client.16248 shutdown 2024-05-08T07:13:25.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:24 smithi070 ceph-mon[29591]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 155 KiB/s wr, 19 op/s 2024-05-08T07:13:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.272+0000 7fe87059fb80 1 -- 172.21.15.70:0/1721322312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 msgr2=0x558cb3e80c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.272+0000 7fe87059fb80 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e80c40 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe84801f040 tx=0x7fe84801bc00 comp rx=0 tx=0).stop 2024-05-08T07:13:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.272+0000 7fe87059fb80 1 -- 172.21.15.70:0/1721322312 shutdown_connections 2024-05-08T07:13:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.272+0000 7fe87059fb80 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558cb3ef4710 0x558cb3ef6b30 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.273+0000 7fe87059fb80 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558cb3e73f50 0x558cb3e7bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.273+0000 7fe84cc00700 0 client.16248 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:13:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.273+0000 7fe87059fb80 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558cb3e6e520 0x558cb3e80700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.273+0000 7fe87059fb80 1 --2- 172.21.15.70:0/1721322312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558cb3e6eee0 0x558cb3e80c40 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.273+0000 7fe87059fb80 1 -- 172.21.15.70:0/1721322312 >> 172.21.15.70:0/1721322312 conn(0x558cb3d9ccf0 msgr2=0x558cb3e79b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.273+0000 7fe87059fb80 1 -- 172.21.15.70:0/1721322312 shutdown_connections 2024-05-08T07:13:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.273+0000 7fe87059fb80 1 -- 172.21.15.70:0/1721322312 wait complete. 2024-05-08T07:13:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.274+0000 7fe87059fb80 20 client.16248 trim_cache size 0 max 16384 2024-05-08T07:13:25.272 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 33, 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 70, 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "c76a4554": { 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 70, 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 89.7, 2024-05-08T07:13:25.273 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:13:25.274 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:13:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 -- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8440b6f30 msgr2=0x7fe8440b93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8440b6f30 0x7fe8440b93f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe850005bd0 tx=0x7fe85000b040 comp rx=0 tx=0).stop 2024-05-08T07:13:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 -- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe86006b3e0 msgr2=0x7fe8601976c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe86006b3e0 0x7fe8601976c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c920 tx=0x7fe85800cce0 comp rx=0 tx=0).stop 2024-05-08T07:13:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 -- 172.21.15.70:0/1839205311 shutdown_connections 2024-05-08T07:13:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe8440b6f30 0x7fe8440b93f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe860108860 0x7fe86019bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe86006b3e0 0x7fe8601976c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 --2- 172.21.15.70:0/1839205311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe86006bd90 0x7fe860197c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.275+0000 7fe865c00700 1 -- 172.21.15.70:0/1839205311 >> 172.21.15.70:0/1839205311 conn(0x7fe860079340 msgr2=0x7fe860100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.276+0000 7fe865c00700 1 -- 172.21.15.70:0/1839205311 shutdown_connections 2024-05-08T07:13:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:25.276+0000 7fe865c00700 1 -- 172.21.15.70:0/1839205311 wait complete. 2024-05-08T07:13:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:24 smithi172 ceph-mon[33377]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 155 KiB/s wr, 19 op/s 2024-05-08T07:13:26.363 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c76a4554', quiesce took 25.2 seconds. Will release after: 29.7 2024-05-08T07:13:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:27 smithi194 ceph-mon[33679]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 239 KiB/s wr, 55 op/s 2024-05-08T07:13:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:27 smithi070 ceph-mon[29591]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 239 KiB/s wr, 55 op/s 2024-05-08T07:13:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:27 smithi172 ceph-mon[33377]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 239 KiB/s wr, 55 op/s 2024-05-08T07:13:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:29 smithi194 ceph-mon[33679]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 108 KiB/s wr, 42 op/s 2024-05-08T07:13:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:29 smithi070 ceph-mon[29591]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 108 KiB/s wr, 42 op/s 2024-05-08T07:13:29.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:29 smithi172 ceph-mon[33377]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 108 KiB/s wr, 42 op/s 2024-05-08T07:13:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:31 smithi070 ceph-mon[29591]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 137 KiB/s wr, 122 op/s 2024-05-08T07:13:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:31 smithi172 ceph-mon[33377]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 137 KiB/s wr, 122 op/s 2024-05-08T07:13:31.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:31 smithi194 ceph-mon[33679]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 137 KiB/s wr, 122 op/s 2024-05-08T07:13:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:33 smithi070 ceph-mon[29591]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 128 KiB/s wr, 118 op/s 2024-05-08T07:13:33.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:33 smithi172 ceph-mon[33377]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 128 KiB/s wr, 118 op/s 2024-05-08T07:13:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:33 smithi194 ceph-mon[33679]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 128 KiB/s wr, 118 op/s 2024-05-08T07:13:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:35 smithi070 ceph-mon[29591]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 128 KiB/s wr, 118 op/s 2024-05-08T07:13:35.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:35 smithi172 ceph-mon[33377]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 128 KiB/s wr, 118 op/s 2024-05-08T07:13:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:35 smithi194 ceph-mon[33679]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 128 KiB/s wr, 118 op/s 2024-05-08T07:13:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:37 smithi070 ceph-mon[29591]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 136 KiB/s wr, 121 op/s 2024-05-08T07:13:37.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:37 smithi172 ceph-mon[33377]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 136 KiB/s wr, 121 op/s 2024-05-08T07:13:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:37 smithi194 ceph-mon[33679]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 136 KiB/s wr, 121 op/s 2024-05-08T07:13:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:39 smithi070 ceph-mon[29591]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 KiB/s wr, 83 op/s 2024-05-08T07:13:39.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:39 smithi172 ceph-mon[33377]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 KiB/s wr, 83 op/s 2024-05-08T07:13:39.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:39 smithi194 ceph-mon[33679]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 KiB/s wr, 83 op/s 2024-05-08T07:13:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:41 smithi070 ceph-mon[29591]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 42 KiB/s wr, 86 op/s 2024-05-08T07:13:41.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:41 smithi172 ceph-mon[33377]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 42 KiB/s wr, 86 op/s 2024-05-08T07:13:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:41 smithi194 ceph-mon[33679]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 42 KiB/s wr, 86 op/s 2024-05-08T07:13:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:43 smithi070 ceph-mon[29591]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-05-08T07:13:43.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:43 smithi172 ceph-mon[33377]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-05-08T07:13:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:43 smithi194 ceph-mon[33679]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-05-08T07:13:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:45 smithi070 ceph-mon[29591]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-05-08T07:13:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:45 smithi172 ceph-mon[33377]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-05-08T07:13:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:45 smithi194 ceph-mon[33679]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-05-08T07:13:47.313 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:47 smithi194 ceph-mon[33679]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2024-05-08T07:13:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:47 smithi070 ceph-mon[29591]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2024-05-08T07:13:47.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:47 smithi172 ceph-mon[33377]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 8 op/s 2024-05-08T07:13:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:49 smithi070 ceph-mon[29591]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:13:49.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:49 smithi172 ceph-mon[33377]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:13:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:49 smithi194 ceph-mon[33679]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:13:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:51 smithi070 ceph-mon[29591]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-08T07:13:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:51 smithi172 ceph-mon[33377]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-08T07:13:51.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:51 smithi194 ceph-mon[33679]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-08T07:13:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:13:52.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:13:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:13:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:53 smithi070 ceph-mon[29591]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T07:13:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.437 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:53 smithi172 ceph-mon[33377]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T07:13:53.437 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.437 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.437 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.437 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.437 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.437 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:53 smithi194 ceph-mon[33679]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T07:13:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:53.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:13:54.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:13:54.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:54.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:13:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:13:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:13:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:13:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:13:55.135 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:55 smithi172 ceph-mon[33377]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T07:13:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:55 smithi070 ceph-mon[29591]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T07:13:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:55 smithi194 ceph-mon[33679]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T07:13:56.065 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:13:56.515 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:13:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:57 smithi070 ceph-mon[29591]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2024-05-08T07:13:57.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:57 smithi172 ceph-mon[33377]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2024-05-08T07:13:57.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:57 smithi194 ceph-mon[33679]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2024-05-08T07:13:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.884+0000 7f9e04a00700 1 -- 172.21.15.70:0/3549369903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00104100 msgr2=0x7f9e00108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.884+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3549369903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00104100 0x7f9e00108120 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f9de80099c0 tx=0x7f9de8009cd0 comp rx=0 tx=0).stop 2024-05-08T07:13:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.884+0000 7f9e04a00700 1 -- 172.21.15.70:0/3549369903 shutdown_connections 2024-05-08T07:13:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.884+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3549369903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e00108850 0x7f9e001103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.884+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3549369903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e00103750 0x7f9e00103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.884+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3549369903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00104100 0x7f9e00108120 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.884+0000 7f9e04a00700 1 -- 172.21.15.70:0/3549369903 >> 172.21.15.70:0/3549369903 conn(0x7f9e0007a600 msgr2=0x7f9e0007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:58.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.884+0000 7f9e04a00700 1 -- 172.21.15.70:0/3549369903 shutdown_connections 2024-05-08T07:13:58.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.884+0000 7f9e04a00700 1 -- 172.21.15.70:0/3549369903 wait complete. 2024-05-08T07:13:58.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.885+0000 7f9e04a00700 1 Processor -- start 2024-05-08T07:13:58.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9e04a00700 1 -- start start 2024-05-08T07:13:58.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9e04a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e00103750 0x7f9e001a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:58.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9e04a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e00104100 0x7f9e001a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:58.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9e04a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00108850 0x7f9e0019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9e04a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e00113530 con 0x7f9e00108850 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9e04a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001133b0 con 0x7f9e00104100 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9e04a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9e001136b0 con 0x7f9e00103750 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9dfe800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00108850 0x7f9e0019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9dfe800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00108850 0x7f9e0019bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36758/0 (socket says 172.21.15.70:36758) 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.886+0000 7f9dfe800700 1 -- 172.21.15.70:0/3890357763 learned_addr learned my addr 172.21.15.70:0/3890357763 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9df5400700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e00104100 0x7f9e001a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9dfde00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e00103750 0x7f9e001a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9dfe800700 1 -- 172.21.15.70:0/3890357763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e00103750 msgr2=0x7f9e001a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9dfe800700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e00103750 0x7f9e001a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9dfe800700 1 -- 172.21.15.70:0/3890357763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e00104100 msgr2=0x7f9e001a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9dfe800700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e00104100 0x7f9e001a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9dfe800700 1 -- 172.21.15.70:0/3890357763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0019c230 con 0x7f9e00108850 2024-05-08T07:13:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9dfde00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e00103750 0x7f9e001a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:13:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9dfe800700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00108850 0x7f9e0019bad0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9df800ada0 tx=0x7f9df800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.887+0000 7f9df7400700 1 -- 172.21.15.70:0/3890357763 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8017020 con 0x7f9e00108850 2024-05-08T07:13:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.888+0000 7f9df7400700 1 -- 172.21.15.70:0/3890357763 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9df800ce10 con 0x7f9e00108850 2024-05-08T07:13:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.888+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0019c520 con 0x7f9e00108850 2024-05-08T07:13:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.888+0000 7f9df7400700 1 -- 172.21.15.70:0/3890357763 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8005440 con 0x7f9e00108850 2024-05-08T07:13:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.888+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e001a87e0 con 0x7f9e00108850 2024-05-08T07:13:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.889+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0006a190 con 0x7f9e00108850 2024-05-08T07:13:58.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.891+0000 7f9df7400700 1 -- 172.21.15.70:0/3890357763 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9df8004ad0 con 0x7f9e00108850 2024-05-08T07:13:58.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.892+0000 7f9df7400700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9de40b29f0 0x7f9de40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:13:58.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.893+0000 7f9df7400700 1 -- 172.21.15.70:0/3890357763 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9583+0+0 (secure 0 0 0) 0x7f9df80e2270 con 0x7f9e00108850 2024-05-08T07:13:58.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.893+0000 7f9dfde00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9de40b29f0 0x7f9de40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:13:58.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.894+0000 7f9dfde00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9de40b29f0 0x7f9de40b4eb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9df0005fd0 tx=0x7f9df0005dc0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:13:58.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:58.897+0000 7f9df7400700 1 -- 172.21.15.70:0/3890357763 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9df8021020 con 0x7f9e00108850 2024-05-08T07:13:59.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.182+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e001a89b0 con 0x7f9e00108850 2024-05-08T07:13:59.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.183+0000 7f9df7400700 1 -- 172.21.15.70:0/3890357763 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11880 (secure 0 0 0) 0x7f9df80a9860 con 0x7f9e00108850 2024-05-08T07:13:59.181 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:13:59.182 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:12:58.286160+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T07:13:59.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9de40b29f0 msgr2=0x7f9de40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:59.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9de40b29f0 0x7f9de40b4eb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9df0005fd0 tx=0x7f9df0005dc0 comp rx=0 tx=0).stop 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00108850 msgr2=0x7f9e0019bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00108850 0x7f9e0019bad0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9df800ada0 tx=0x7f9df800c330 comp rx=0 tx=0).stop 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 shutdown_connections 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9de40b29f0 0x7f9de40b4eb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e00108850 0x7f9e0019bad0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e00103750 0x7f9e001a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 --2- 172.21.15.70:0/3890357763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9e00104100 0x7f9e001a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.186+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 >> 172.21.15.70:0/3890357763 conn(0x7f9e0007a600 msgr2=0x7f9e00101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.187+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 shutdown_connections 2024-05-08T07:13:59.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:13:59.187+0000 7f9e04a00700 1 -- 172.21.15.70:0/3890357763 wait complete. 2024-05-08T07:13:59.186 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 33 2024-05-08T07:13:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:13:59 smithi070 ceph-mon[29591]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.9 KiB/s wr, 5 op/s 2024-05-08T07:13:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:13:59 smithi172 ceph-mon[33377]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.9 KiB/s wr, 5 op/s 2024-05-08T07:13:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:13:59 smithi194 ceph-mon[33679]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.9 KiB/s wr, 5 op/s 2024-05-08T07:14:00.017 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id c76a4554 --release --await' 2024-05-08T07:14:00.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id c76a4554 --release --await 2024-05-08T07:14:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:00 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3890357763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:14:00.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:00 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3890357763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:14:00.473 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:14:00.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:00 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3890357763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:14:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:01 smithi070 ceph-mon[29591]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-05-08T07:14:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:01 smithi172 ceph-mon[33377]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-05-08T07:14:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:01 smithi194 ceph-mon[33679]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 KiB/s wr, 7 op/s 2024-05-08T07:14:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.760+0000 7fb6cbe00700 1 -- 172.21.15.70:0/1142238841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0779d0 msgr2=0x7fb6cc077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:14:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.760+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/1142238841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0779d0 0x7fb6cc077db0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc009990 tx=0x7fb6bc009ca0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.760+0000 7fb6cbe00700 1 -- 172.21.15.70:0/1142238841 shutdown_connections 2024-05-08T07:14:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.760+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/1142238841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6cc114250 0x7fb6cc116640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.760+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/1142238841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0779d0 0x7fb6cc077db0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.760+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/1142238841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc0782f0 0x7fb6cc113d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.760+0000 7fb6cbe00700 1 -- 172.21.15.70:0/1142238841 >> 172.21.15.70:0/1142238841 conn(0x7fb6cc1010e0 msgr2=0x7fb6cc103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:14:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.760+0000 7fb6cbe00700 1 -- 172.21.15.70:0/1142238841 shutdown_connections 2024-05-08T07:14:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.760+0000 7fb6cbe00700 1 -- 172.21.15.70:0/1142238841 wait complete. 2024-05-08T07:14:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.761+0000 7fb6cbe00700 1 Processor -- start 2024-05-08T07:14:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.761+0000 7fb6cbe00700 1 -- start start 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6cbe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6cc0779d0 0x7fb6cc1a0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6cbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0782f0 0x7fb6cc1a05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6cbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc114250 0x7fb6cc1a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6cbe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc119ac0 con 0x7fb6cc0782f0 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6cbe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc119940 con 0x7fb6cc114250 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6cbe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc119c40 con 0x7fb6cc0779d0 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6ca000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0782f0 0x7fb6cc1a05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6ca000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0782f0 0x7fb6cc1a05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36774/0 (socket says 172.21.15.70:36774) 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6ca000700 1 -- 172.21.15.70:0/4174395538 learned_addr learned my addr 172.21.15.70:0/4174395538 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.762+0000 7fb6caa00700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6cc0779d0 0x7fb6cc1a0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6cb400700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc114250 0x7fb6cc1a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6ca000700 1 -- 172.21.15.70:0/4174395538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6cc0779d0 msgr2=0x7fb6cc1a0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6ca000700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6cc0779d0 0x7fb6cc1a0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6ca000700 1 -- 172.21.15.70:0/4174395538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc114250 msgr2=0x7fb6cc1a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6ca000700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc114250 0x7fb6cc1a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6ca000700 1 -- 172.21.15.70:0/4174395538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc1a5080 con 0x7fb6cc0782f0 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6caa00700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6cc0779d0 0x7fb6cc1a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6ca000700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0782f0 0x7fb6cc1a05b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c920 tx=0x7fb6b800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6d0a00700 1 -- 172.21.15.70:0/4174395538 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8007b00 con 0x7fb6cc0782f0 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6d0a00700 1 -- 172.21.15.70:0/4174395538 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6b8004cc0 con 0x7fb6cc0782f0 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.763+0000 7fb6cbe00700 1 -- 172.21.15.70:0/4174395538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc1a5370 con 0x7fb6cc0782f0 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.764+0000 7fb6cbe00700 1 -- 172.21.15.70:0/4174395538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc1acbf0 con 0x7fb6cc0782f0 2024-05-08T07:14:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.764+0000 7fb6d0a00700 1 -- 172.21.15.70:0/4174395538 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80054f0 con 0x7fb6cc0782f0 2024-05-08T07:14:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.767+0000 7fb6d0a00700 1 -- 172.21.15.70:0/4174395538 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb6b8007ca0 con 0x7fb6cc0782f0 2024-05-08T07:14:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.768+0000 7fb6dc706b80 1 Processor -- start 2024-05-08T07:14:02.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6dc706b80 1 -- start start 2024-05-08T07:14:02.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6d0a00700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb6b00b2a70 0x7fb6b00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fa7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6d0a00700 1 -- 172.21.15.70:0/4174395538 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 9583+0+0 (secure 0 0 0) 0x7fb6b80e2690 con 0x7fb6cc0782f0 2024-05-08T07:14:02.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37fa1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fa1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560a37ef3b20 con 0x560a37fa1ab0 2024-05-08T07:14:02.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560a37e91860 con 0x560a37fa6f60 2024-05-08T07:14:02.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560a37eefae0 con 0x560a37fa7880 2024-05-08T07:14:02.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.769+0000 7fb6cb400700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb6b00b2a70 0x7fb6b00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fa1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6caa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fa7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fa1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36778/0 (socket says 172.21.15.70:36778) 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6cb400700 1 -- 172.21.15.70:0/2798052088 learned_addr learned my addr 172.21.15.70:0/2798052088 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6ca000700 1 --2- 172.21.15.70:0/2798052088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37fa1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6cb400700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb6b00b2a70 0x7fb6b00b4f30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40088f0 tx=0x7fb6c4008cb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6cb400700 1 -- 172.21.15.70:0/2798052088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 msgr2=0x560a37fa1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6cb400700 1 --2- 172.21.15.70:0/2798052088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37fa1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6cb400700 1 -- 172.21.15.70:0/2798052088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 msgr2=0x560a37fa7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6cb400700 1 --2- 172.21.15.70:0/2798052088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fa7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.770+0000 7fb6cb400700 1 -- 172.21.15.70:0/2798052088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a37e409d0 con 0x560a37fa1ab0 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.771+0000 7fb6cb400700 1 --2- 172.21.15.70:0/2798052088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fa1f10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40154e0 tx=0x7fb6c401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51817d28d2a50e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:14:02.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.771+0000 7fb6c0c00700 1 -- 172.21.15.70:0/2798052088 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4013040 con 0x560a37fa1ab0 2024-05-08T07:14:02.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.771+0000 7fb6c0c00700 1 -- 172.21.15.70:0/2798052088 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6c401f070 con 0x560a37fa1ab0 2024-05-08T07:14:02.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.771+0000 7fb6c0c00700 1 -- 172.21.15.70:0/2798052088 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4023460 con 0x560a37fa1ab0 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.772+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2798052088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 msgr2=0x560a37fa1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.772+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2798052088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fa1f10 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40154e0 tx=0x7fb6c401c000 comp rx=0 tx=0).stop 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.772+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2798052088 shutdown_connections 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.772+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2798052088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fa1f10 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.772+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2798052088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fa7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.772+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2798052088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37fa1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.772+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2798052088 >> 172.21.15.70:0/2798052088 conn(0x560a37ecfc60 msgr2=0x560a37f9bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.772+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2798052088 shutdown_connections 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.772+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2798052088 wait complete. 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.773+0000 7fb6dc706b80 1 -- start start 2024-05-08T07:14:02.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.773+0000 7fb6dc706b80 1 Processor -- start 2024-05-08T07:14:02.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.773+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa1ab0 0x560a37fad520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.773+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa6f60 0x560a37faa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.773+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37faae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.773+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560a37fae2e0 con 0x560a37fa6f60 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.773+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560a37e59c20 con 0x560a37fa1ab0 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.773+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560a37fae460 con 0x560a37fa7880 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6dc706b80 10 client.0 _ll_register_callbacks cb 0x560a37e9ad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6ca000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa6f60 0x560a37faa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6ca000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa6f60 0x560a37faa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36786/0 (socket says 172.21.15.70:36786) 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6ca000700 1 -- 172.21.15.70:0/2443075392 learned_addr learned my addr 172.21.15.70:0/2443075392 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6caa00700 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa1ab0 0x560a37fad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6cb400700 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37faae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6ca000700 1 -- 172.21.15.70:0/2443075392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 msgr2=0x560a37faae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6ca000700 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37faae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6ca000700 1 -- 172.21.15.70:0/2443075392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa1ab0 msgr2=0x560a37fad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:14:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6ca000700 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa1ab0 0x560a37fad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.774+0000 7fb6ca000700 1 -- 172.21.15.70:0/2443075392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a37eb9520 con 0x560a37fa6f60 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.775+0000 7fb6ca000700 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa6f60 0x560a37faa8c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80a5570 tx=0x7fb6b80a59e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edefcdf07db75f38 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.775+0000 7fb6b5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.775+0000 7fb6b5600700 1 -- 172.21.15.70:0/2443075392 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b801d040 con 0x560a37fa6f60 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.775+0000 7fb6b5600700 1 -- 172.21.15.70:0/2443075392 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 9583+0+0 (secure 0 0 0) 0x7fb6b80b20d0 con 0x560a37fa6f60 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.775+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2443075392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6c401f070 con 0x560a37fa6f60 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.775+0000 7fb6b5600700 1 -- 172.21.15.70:0/2443075392 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb6b80a9000 con 0x560a37fa6f60 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.775+0000 7fb6dc706b80 10 client.16266 fetch_fsmap learned FSMap version 33 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.775+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2443075392 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560a37fb8ae0 con 0x560a37fa6f60 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.775+0000 7fb6b5600700 1 -- 172.21.15.70:0/2443075392 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6c401f070 con 0x560a37fa6f60 2024-05-08T07:14:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.776+0000 7fb6b5600700 1 -- 172.21.15.70:0/2443075392 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8358+0+0 (secure 0 0 0) 0x7fb6b80e2130 con 0x560a37fa6f60 2024-05-08T07:14:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.776+0000 7fb6dc706b80 10 client.16266 fetch_fsmap finished waiting for FSMap version 33 2024-05-08T07:14:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.776+0000 7fb6dc706b80 10 client.16266 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:14:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.776+0000 7fb6dc706b80 20 client.16266 populate_metadata read hostname 'smithi070' 2024-05-08T07:14:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.776+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560a37fbb120 0x560a37fbd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.776+0000 7fb6dc706b80 4 client.16266 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:14:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.776+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2443075392 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a37f6e1a0 con 0x560a37fbb120 2024-05-08T07:14:02.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.776+0000 7fb6caa00700 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560a37fbb120 0x560a37fbd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.777+0000 7fb6caa00700 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560a37fbb120 0x560a37fbd510 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4112808d4722991a server_cookie=e68b4828ea339578 in_seq=0 out_seq=0 2024-05-08T07:14:02.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.777+0000 7fb6b5600700 10 client.16266 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:14:02.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.779+0000 7fb6b5600700 1 -- 172.21.15.70:0/2443075392 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560a37f6e1a0 con 0x560a37fbb120 2024-05-08T07:14:02.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.779+0000 7fb6b5600700 10 client.16266 handle_command_reply: tid=0 2024-05-08T07:14:02.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.779+0000 7fb6dc706b80 1 client.16266 shutdown 2024-05-08T07:14:02.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2443075392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa6f60 msgr2=0x560a37faa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:14:02.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa6f60 0x560a37faa8c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80a5570 tx=0x7fb6b80a59e0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2443075392 shutdown_connections 2024-05-08T07:14:02.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560a37fbb120 0x560a37fbd510 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37faae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa1ab0 0x560a37fad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2443075392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa6f60 0x560a37faa8c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6b5600700 0 client.16266 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:14:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2443075392 >> 172.21.15.70:0/2443075392 conn(0x560a37ecfc60 msgr2=0x560a37fa0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:14:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2443075392 shutdown_connections 2024-05-08T07:14:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2443075392 wait complete. 2024-05-08T07:14:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.780+0000 7fb6dc706b80 20 client.16266 trim_cache size 0 max 16384 2024-05-08T07:14:02.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.801+0000 7fb6dc706b80 1 Processor -- start 2024-05-08T07:14:02.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6dc706b80 1 -- start start 2024-05-08T07:14:02.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fb7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fa49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37fa4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc1b8300 con 0x560a37fa1ab0 2024-05-08T07:14:02.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc1b5b60 con 0x560a37fa6f60 2024-05-08T07:14:02.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc1b39d0 con 0x560a37fa7880 2024-05-08T07:14:02.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6caa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fb7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6caa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fb7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36794/0 (socket says 172.21.15.70:36794) 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.802+0000 7fb6caa00700 1 -- 172.21.15.70:0/2593529875 learned_addr learned my addr 172.21.15.70:0/2593529875 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6ca000700 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fa49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6cb400700 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37fa4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6caa00700 1 -- 172.21.15.70:0/2593529875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 msgr2=0x560a37fa4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6caa00700 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37fa4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6caa00700 1 -- 172.21.15.70:0/2593529875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 msgr2=0x560a37fa49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6caa00700 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fa49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6caa00700 1 -- 172.21.15.70:0/2593529875 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a37faa690 con 0x560a37fa1ab0 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6ca000700 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fa49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6cb400700 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37fa4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6caa00700 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fb7370 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0098e0 tx=0x7fb6bc01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf8736fa2e41e28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6b7e00700 1 -- 172.21.15.70:0/2593529875 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0039c0 con 0x560a37fa1ab0 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6b7e00700 1 -- 172.21.15.70:0/2593529875 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6bc00b7d0 con 0x560a37fa1ab0 2024-05-08T07:14:02.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.803+0000 7fb6b7e00700 1 -- 172.21.15.70:0/2593529875 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc029430 con 0x560a37fa1ab0 2024-05-08T07:14:02.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.804+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2593529875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 msgr2=0x560a37fb7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:14:02.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.804+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fb7370 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0098e0 tx=0x7fb6bc01a040 comp rx=0 tx=0).stop 2024-05-08T07:14:02.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.804+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2593529875 shutdown_connections 2024-05-08T07:14:02.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.804+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa7880 0x560a37fa4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.804+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa1ab0 0x560a37fb7370 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.804+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/2593529875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fa49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.804+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2593529875 >> 172.21.15.70:0/2593529875 conn(0x560a37ecfc60 msgr2=0x560a37fa0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:14:02.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.804+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2593529875 shutdown_connections 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.804+0000 7fb6dc706b80 1 -- 172.21.15.70:0/2593529875 wait complete. 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.805+0000 7fb6dc706b80 1 -- start start 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.805+0000 7fb6dc706b80 1 Processor -- start 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.805+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa1ab0 0x560a37fb06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.805+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fb0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.805+0000 7fb6dc706b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa7880 0x560a380259c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.805+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc1b4020 con 0x560a37fa7880 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.805+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc1b5490 con 0x560a37fa6f60 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.805+0000 7fb6dc706b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc1b46f0 con 0x560a37fa1ab0 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6dc706b80 10 client.0 _ll_register_callbacks cb 0x560a37e9ad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa7880 0x560a380259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa7880 0x560a380259c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36800/0 (socket says 172.21.15.70:36800) 2024-05-08T07:14:02.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6cb400700 1 -- 172.21.15.70:0/3291194785 learned_addr learned my addr 172.21.15.70:0/3291194785 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6ca000700 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fb0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6caa00700 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa1ab0 0x560a37fb06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6cb400700 1 -- 172.21.15.70:0/3291194785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa1ab0 msgr2=0x560a37fb06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6cb400700 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa1ab0 0x560a37fb06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6cb400700 1 -- 172.21.15.70:0/3291194785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 msgr2=0x560a37fb0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6cb400700 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fb0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6cb400700 1 -- 172.21.15.70:0/3291194785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a38025f00 con 0x560a37fa7880 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.806+0000 7fb6ca000700 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fb0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.807+0000 7fb6cb400700 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa7880 0x560a380259c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4024000 tx=0x7fb6c4007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84c65143dd23432 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.807+0000 7fb6b5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.807+0000 7fb6b5600700 1 -- 172.21.15.70:0/3291194785 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4023460 con 0x560a37fa7880 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.807+0000 7fb6dc706b80 1 -- 172.21.15.70:0/3291194785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6bc00b7d0 con 0x560a37fa7880 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.807+0000 7fb6b5600700 1 -- 172.21.15.70:0/3291194785 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(133..133 src has 1..133) ==== 9583+0+0 (secure 0 0 0) 0x7fb6c4023600 con 0x560a37fa7880 2024-05-08T07:14:02.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.807+0000 7fb6b5600700 1 -- 172.21.15.70:0/3291194785 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb6c403e050 con 0x560a37fa7880 2024-05-08T07:14:02.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.807+0000 7fb6dc706b80 10 client.16272 fetch_fsmap learned FSMap version 33 2024-05-08T07:14:02.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.807+0000 7fb6dc706b80 1 -- 172.21.15.70:0/3291194785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560a38027050 con 0x560a37fa7880 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.807+0000 7fb6b5600700 1 -- 172.21.15.70:0/3291194785 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb6bc00b7d0 con 0x560a37fa7880 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.808+0000 7fb6b5600700 1 -- 172.21.15.70:0/3291194785 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8358+0+0 (secure 0 0 0) 0x7fb6c402d910 con 0x560a37fa7880 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.808+0000 7fb6dc706b80 10 client.16272 fetch_fsmap finished waiting for FSMap version 33 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.808+0000 7fb6dc706b80 10 client.16272 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.808+0000 7fb6dc706b80 20 client.16272 populate_metadata read hostname 'smithi070' 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.808+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560a380275b0 0x560a380299d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.808+0000 7fb6dc706b80 4 client.16272 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c76a4554", "release": true, "await": true}] 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.808+0000 7fb6dc706b80 1 -- 172.21.15.70:0/3291194785 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c76a4554", "release": true, "await": true}) -- 0x560a37f01500 con 0x560a380275b0 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.808+0000 7fb6caa00700 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560a380275b0 0x560a380299d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.809+0000 7fb6caa00700 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560a380275b0 0x560a380299d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e38fced95e6e9148 server_cookie=490def4b3f7bde36 in_seq=0 out_seq=0 2024-05-08T07:14:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:02.809+0000 7fb6b5600700 10 client.16272 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:14:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:03 smithi172 ceph-mon[33377]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:14:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:03 smithi194 ceph-mon[33679]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:14:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:03 smithi070 ceph-mon[29591]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:14:05.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:05 smithi172 ceph-mon[33377]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:14:05.431 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:05 smithi070 ceph-mon[29591]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:14:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:05 smithi194 ceph-mon[33679]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:14:05.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.542+0000 7fb6b5600700 1 -- 172.21.15.70:0/3291194785 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x560a37f01500 con 0x560a380275b0 2024-05-08T07:14:05.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.542+0000 7fb6b5600700 10 client.16272 handle_command_reply: tid=0 2024-05-08T07:14:05.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.542+0000 7fb6dc706b80 1 client.16272 shutdown 2024-05-08T07:14:05.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.543+0000 7fb6dc706b80 1 -- 172.21.15.70:0/3291194785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa7880 msgr2=0x560a380259c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:14:05.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.543+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa7880 0x560a380259c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4024000 tx=0x7fb6c4007cd0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.543+0000 7fb6dc706b80 1 -- 172.21.15.70:0/3291194785 shutdown_connections 2024-05-08T07:14:05.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.543+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560a380275b0 0x560a380299d0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.543+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560a37fa7880 0x560a380259c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.543+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560a37fa1ab0 0x560a37fb06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.543+0000 7fb6dc706b80 1 --2- 172.21.15.70:0/3291194785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560a37fa6f60 0x560a37fb0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.543+0000 7fb6dc706b80 1 -- 172.21.15.70:0/3291194785 >> 172.21.15.70:0/3291194785 conn(0x560a37ecfc60 msgr2=0x560a37fa0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:14:05.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.543+0000 7fb6b5600700 0 client.16272 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:14:05.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.544+0000 7fb6dc706b80 1 -- 172.21.15.70:0/3291194785 shutdown_connections 2024-05-08T07:14:05.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.544+0000 7fb6dc706b80 1 -- 172.21.15.70:0/3291194785 wait complete. 2024-05-08T07:14:05.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.544+0000 7fb6dc706b80 20 client.16272 trim_cache size 0 max 16384 2024-05-08T07:14:05.544 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 33, 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 72, 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "c76a4554": { 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 72, 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:14:05.545 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 89.7, 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:14:05.546 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:14:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:14:05.547 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:14:05.547 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 -- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb6b00b2a70 msgr2=0x7fb6b00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb6b00b2a70 0x7fb6b00b4f30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40088f0 tx=0x7fb6c4008cb0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 -- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0782f0 msgr2=0x7fb6cc1a05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0782f0 0x7fb6cc1a05b0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c920 tx=0x7fb6b800cce0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 -- 172.21.15.70:0/4174395538 shutdown_connections 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb6b00b2a70 0x7fb6b00b4f30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb6cc114250 0x7fb6cc1a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6cc0779d0 0x7fb6cc1a0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 --2- 172.21.15.70:0/4174395538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb6cc0782f0 0x7fb6cc1a05b0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.545+0000 7fb6cbe00700 1 -- 172.21.15.70:0/4174395538 >> 172.21.15.70:0/4174395538 conn(0x7fb6cc1010e0 msgr2=0x7fb6cc1034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.546+0000 7fb6cbe00700 1 -- 172.21.15.70:0/4174395538 shutdown_connections 2024-05-08T07:14:05.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:14:05.546+0000 7fb6cbe00700 1 -- 172.21.15.70:0/4174395538 wait complete. 2024-05-08T07:14:06.466 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c76a4554', seconds elapsed: 65.3 2024-05-08T07:14:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:07 smithi172 ceph-mon[33377]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:14:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:07 smithi194 ceph-mon[33679]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:14:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:07 smithi070 ceph-mon[29591]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:14:09.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:09 smithi172 ceph-mon[33377]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:14:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:09 smithi194 ceph-mon[33679]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:14:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:09 smithi070 ceph-mon[29591]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:14:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:11 smithi172 ceph-mon[33377]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 368 KiB/s wr, 193 op/s 2024-05-08T07:14:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:11 smithi194 ceph-mon[33679]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 368 KiB/s wr, 193 op/s 2024-05-08T07:14:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:11 smithi070 ceph-mon[29591]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 368 KiB/s wr, 193 op/s 2024-05-08T07:14:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:12 smithi194 ceph-mon[33679]: osdmap e134: 12 total, 12 up, 12 in 2024-05-08T07:14:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:12 smithi070 ceph-mon[29591]: osdmap e134: 12 total, 12 up, 12 in 2024-05-08T07:14:12.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:12 smithi172 ceph-mon[33377]: osdmap e134: 12 total, 12 up, 12 in 2024-05-08T07:14:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:13 smithi194 ceph-mon[33679]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 441 KiB/s wr, 228 op/s 2024-05-08T07:14:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:13 smithi070 ceph-mon[29591]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 441 KiB/s wr, 228 op/s 2024-05-08T07:14:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:13 smithi172 ceph-mon[33377]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 441 KiB/s wr, 228 op/s 2024-05-08T07:14:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:15 smithi194 ceph-mon[33679]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 441 KiB/s wr, 228 op/s 2024-05-08T07:14:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:15 smithi070 ceph-mon[29591]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 441 KiB/s wr, 228 op/s 2024-05-08T07:14:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:15 smithi172 ceph-mon[33377]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 441 KiB/s wr, 228 op/s 2024-05-08T07:14:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:17 smithi194 ceph-mon[33679]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 1003 KiB/s wr, 261 op/s 2024-05-08T07:14:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:17 smithi070 ceph-mon[29591]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 1003 KiB/s wr, 261 op/s 2024-05-08T07:14:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:17 smithi172 ceph-mon[33377]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 1003 KiB/s wr, 261 op/s 2024-05-08T07:14:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:18 smithi172 ceph-mon[33377]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 1003 KiB/s wr, 261 op/s 2024-05-08T07:14:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:18 smithi172 ceph-mon[33377]: osdmap e135: 12 total, 12 up, 12 in 2024-05-08T07:14:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:18 smithi194 ceph-mon[33679]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 1003 KiB/s wr, 261 op/s 2024-05-08T07:14:19.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:18 smithi194 ceph-mon[33679]: osdmap e135: 12 total, 12 up, 12 in 2024-05-08T07:14:19.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:18 smithi070 ceph-mon[29591]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 1003 KiB/s wr, 261 op/s 2024-05-08T07:14:19.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:18 smithi070 ceph-mon[29591]: osdmap e135: 12 total, 12 up, 12 in 2024-05-08T07:14:20.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:20 smithi172 ceph-mon[33377]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.4 MiB/s wr, 312 op/s 2024-05-08T07:14:21.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:20 smithi194 ceph-mon[33679]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.4 MiB/s wr, 312 op/s 2024-05-08T07:14:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:20 smithi070 ceph-mon[29591]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 1.4 MiB/s wr, 312 op/s 2024-05-08T07:14:22.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:22 smithi172 ceph-mon[33377]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-05-08T07:14:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:22 smithi194 ceph-mon[33679]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-05-08T07:14:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:22 smithi070 ceph-mon[29591]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-05-08T07:14:24.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:24 smithi172 ceph-mon[33377]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-05-08T07:14:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:24 smithi194 ceph-mon[33679]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-05-08T07:14:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:24 smithi070 ceph-mon[29591]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.1 MiB/s wr, 260 op/s 2024-05-08T07:14:26.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:26 smithi172 ceph-mon[33377]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 830 KiB/s wr, 337 op/s 2024-05-08T07:14:27.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:26 smithi194 ceph-mon[33679]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 830 KiB/s wr, 337 op/s 2024-05-08T07:14:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:26 smithi070 ceph-mon[29591]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 830 KiB/s wr, 337 op/s 2024-05-08T07:14:29.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:28 smithi194 ceph-mon[33679]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 830 KiB/s wr, 337 op/s 2024-05-08T07:14:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:28 smithi070 ceph-mon[29591]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 830 KiB/s wr, 337 op/s 2024-05-08T07:14:29.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:28 smithi172 ceph-mon[33377]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 830 KiB/s wr, 337 op/s 2024-05-08T07:14:31.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:30 smithi194 ceph-mon[33679]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.2 MiB/s wr, 457 op/s 2024-05-08T07:14:31.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:30 smithi070 ceph-mon[29591]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.2 MiB/s wr, 457 op/s 2024-05-08T07:14:31.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:30 smithi172 ceph-mon[33377]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.2 MiB/s wr, 457 op/s 2024-05-08T07:14:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:32 smithi194 ceph-mon[33679]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 761 KiB/s wr, 281 op/s 2024-05-08T07:14:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:32 smithi070 ceph-mon[29591]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 761 KiB/s wr, 281 op/s 2024-05-08T07:14:33.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:32 smithi172 ceph-mon[33377]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 761 KiB/s wr, 281 op/s 2024-05-08T07:14:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:34 smithi194 ceph-mon[33679]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 761 KiB/s wr, 281 op/s 2024-05-08T07:14:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:34 smithi070 ceph-mon[29591]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 761 KiB/s wr, 281 op/s 2024-05-08T07:14:35.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:34 smithi172 ceph-mon[33377]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 761 KiB/s wr, 281 op/s 2024-05-08T07:14:37.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:36 smithi194 ceph-mon[33679]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 1.4 MiB/s wr, 425 op/s 2024-05-08T07:14:37.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:36 smithi070 ceph-mon[29591]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 1.4 MiB/s wr, 425 op/s 2024-05-08T07:14:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:36 smithi172 ceph-mon[33377]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 1.4 MiB/s wr, 425 op/s 2024-05-08T07:14:39.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:38 smithi194 ceph-mon[33679]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.2 MiB/s wr, 314 op/s 2024-05-08T07:14:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:38 smithi070 ceph-mon[29591]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.2 MiB/s wr, 314 op/s 2024-05-08T07:14:39.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:38 smithi172 ceph-mon[33377]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 1.2 MiB/s wr, 314 op/s 2024-05-08T07:14:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:40 smithi194 ceph-mon[33679]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 1.8 MiB/s wr, 493 op/s 2024-05-08T07:14:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:40 smithi070 ceph-mon[29591]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 1.8 MiB/s wr, 493 op/s 2024-05-08T07:14:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:40 smithi172 ceph-mon[33377]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 1.8 MiB/s wr, 493 op/s 2024-05-08T07:14:43.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:42 smithi194 ceph-mon[33679]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-05-08T07:14:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:42 smithi070 ceph-mon[29591]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-05-08T07:14:43.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:42 smithi172 ceph-mon[33377]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-05-08T07:14:45.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:44 smithi194 ceph-mon[33679]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-05-08T07:14:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:44 smithi070 ceph-mon[29591]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-05-08T07:14:45.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:44 smithi172 ceph-mon[33377]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-05-08T07:14:47.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:46 smithi194 ceph-mon[33679]: pgmap v891: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.9 MiB/s wr, 435 op/s 2024-05-08T07:14:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:46 smithi070 ceph-mon[29591]: pgmap v891: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.9 MiB/s wr, 435 op/s 2024-05-08T07:14:47.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:46 smithi172 ceph-mon[33377]: pgmap v891: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.9 MiB/s wr, 435 op/s 2024-05-08T07:14:49.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:48 smithi194 ceph-mon[33679]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.2 MiB/s wr, 292 op/s 2024-05-08T07:14:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:48 smithi070 ceph-mon[29591]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.2 MiB/s wr, 292 op/s 2024-05-08T07:14:49.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:48 smithi172 ceph-mon[33377]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.2 MiB/s wr, 292 op/s 2024-05-08T07:14:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:50 smithi194 ceph-mon[33679]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 2.0 MiB/s wr, 439 op/s 2024-05-08T07:14:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:50 smithi070 ceph-mon[29591]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 2.0 MiB/s wr, 439 op/s 2024-05-08T07:14:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:50 smithi172 ceph-mon[33377]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 2.0 MiB/s wr, 439 op/s 2024-05-08T07:14:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:52 smithi070 ceph-mon[29591]: pgmap v894: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 1.4 MiB/s wr, 260 op/s 2024-05-08T07:14:53.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:52 smithi172 ceph-mon[33377]: pgmap v894: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 1.4 MiB/s wr, 260 op/s 2024-05-08T07:14:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:52 smithi194 ceph-mon[33679]: pgmap v894: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 1.4 MiB/s wr, 260 op/s 2024-05-08T07:14:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:54 smithi070 ceph-mon[29591]: pgmap v895: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 1.4 MiB/s wr, 260 op/s 2024-05-08T07:14:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:14:55.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:54 smithi172 ceph-mon[33377]: pgmap v895: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 1.4 MiB/s wr, 260 op/s 2024-05-08T07:14:55.686 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:14:55.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:54 smithi194 ceph-mon[33679]: pgmap v895: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 1.4 MiB/s wr, 260 op/s 2024-05-08T07:14:55.687 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:14:56.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:14:56.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:14:56.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:14:56.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:14:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:14:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:14:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:14:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:14:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:14:57.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:57 smithi070 ceph-mon[29591]: pgmap v896: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 2.2 MiB/s wr, 432 op/s 2024-05-08T07:14:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:57 smithi172 ceph-mon[33377]: pgmap v896: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 2.2 MiB/s wr, 432 op/s 2024-05-08T07:14:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:57 smithi194 ceph-mon[33679]: pgmap v896: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 2.2 MiB/s wr, 432 op/s 2024-05-08T07:14:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:14:59 smithi070 ceph-mon[29591]: pgmap v897: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 1.6 MiB/s wr, 319 op/s 2024-05-08T07:14:59.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:14:59 smithi172 ceph-mon[33377]: pgmap v897: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 1.6 MiB/s wr, 319 op/s 2024-05-08T07:14:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:14:59 smithi194 ceph-mon[33679]: pgmap v897: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 1.6 MiB/s wr, 319 op/s 2024-05-08T07:15:01.625 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 15.0 2024-05-08T07:15:01.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:15:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:01 smithi070 ceph-mon[29591]: pgmap v898: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 2.3 MiB/s wr, 418 op/s 2024-05-08T07:15:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:01 smithi172 ceph-mon[33377]: pgmap v898: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 2.3 MiB/s wr, 418 op/s 2024-05-08T07:15:01.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:01 smithi194 ceph-mon[33679]: pgmap v898: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 2.3 MiB/s wr, 418 op/s 2024-05-08T07:15:02.084 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:15:03.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:03 smithi070 ceph-mon[29591]: pgmap v899: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.6 MiB/s wr, 271 op/s 2024-05-08T07:15:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:03 smithi172 ceph-mon[33377]: pgmap v899: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.6 MiB/s wr, 271 op/s 2024-05-08T07:15:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:03 smithi194 ceph-mon[33679]: pgmap v899: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.6 MiB/s wr, 271 op/s 2024-05-08T07:15:04.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.499+0000 7f72bf200700 1 -- 172.21.15.70:0/1839876884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c0105f90 msgr2=0x7f72c0112450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:04.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.499+0000 7f72bf200700 1 --2- 172.21.15.70:0/1839876884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c0105f90 0x7f72c0112450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009fc0 tx=0x7f72b800b330 comp rx=0 tx=0).stop 2024-05-08T07:15:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.501+0000 7f72bf200700 1 -- 172.21.15.70:0/1839876884 shutdown_connections 2024-05-08T07:15:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.502+0000 7f72bf200700 1 --2- 172.21.15.70:0/1839876884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c0105f90 0x7f72c0112450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.502+0000 7f72bf200700 1 --2- 172.21.15.70:0/1839876884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c010b680 0x7f72c010ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.502+0000 7f72bf200700 1 --2- 172.21.15.70:0/1839876884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c01055d0 0x7f72c0105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.502+0000 7f72bf200700 1 -- 172.21.15.70:0/1839876884 >> 172.21.15.70:0/1839876884 conn(0x7f72c0101080 msgr2=0x7f72c01034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:04.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.502+0000 7f72bf200700 1 -- 172.21.15.70:0/1839876884 shutdown_connections 2024-05-08T07:15:04.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.502+0000 7f72bf200700 1 -- 172.21.15.70:0/1839876884 wait complete. 2024-05-08T07:15:04.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.507+0000 7f72bf200700 1 Processor -- start 2024-05-08T07:15:04.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.509+0000 7f72bf200700 1 -- start start 2024-05-08T07:15:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.512+0000 7f72bf200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c01055d0 0x7f72c01a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.512+0000 7f72bf200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0105f90 0x7f72c01a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.512+0000 7f72bf200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c010b680 0x7f72c019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.513+0000 7f72bf200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01156e0 con 0x7f72c0105f90 2024-05-08T07:15:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.513+0000 7f72bf200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0115560 con 0x7f72c01055d0 2024-05-08T07:15:04.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.513+0000 7f72bf200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0115860 con 0x7f72c010b680 2024-05-08T07:15:04.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.514+0000 7f72bd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0105f90 0x7f72c01a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:04.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.514+0000 7f72bd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0105f90 0x7f72c01a1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57066/0 (socket says 172.21.15.70:57066) 2024-05-08T07:15:04.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.514+0000 7f72bd400700 1 -- 172.21.15.70:0/907000957 learned_addr learned my addr 172.21.15.70:0/907000957 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:04.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.514+0000 7f72bde00700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c01055d0 0x7f72c01a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:04.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.514+0000 7f72be800700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c010b680 0x7f72c019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:04.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.515+0000 7f72bde00700 1 -- 172.21.15.70:0/907000957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c010b680 msgr2=0x7f72c019b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:04.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.515+0000 7f72bde00700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c010b680 0x7f72c019b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.515+0000 7f72bde00700 1 -- 172.21.15.70:0/907000957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0105f90 msgr2=0x7f72c01a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:04.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.515+0000 7f72bde00700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0105f90 0x7f72c01a1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.515+0000 7f72bde00700 1 -- 172.21.15.70:0/907000957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c019c020 con 0x7f72c01055d0 2024-05-08T07:15:04.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.516+0000 7f72bde00700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c01055d0 0x7f72c01a1700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72b000e9c0 tx=0x7f72b000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:04.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.517+0000 7f72b6a00700 1 -- 172.21.15.70:0/907000957 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b000c9c0 con 0x7f72c01055d0 2024-05-08T07:15:04.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.517+0000 7f72b6a00700 1 -- 172.21.15.70:0/907000957 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72b0010430 con 0x7f72c01055d0 2024-05-08T07:15:04.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.517+0000 7f72b6a00700 1 -- 172.21.15.70:0/907000957 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0018680 con 0x7f72c01055d0 2024-05-08T07:15:04.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.517+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c019c310 con 0x7f72c01055d0 2024-05-08T07:15:04.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.517+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c01a85d0 con 0x7f72c01055d0 2024-05-08T07:15:04.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.522+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c006a190 con 0x7f72c01055d0 2024-05-08T07:15:04.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.531+0000 7f72b6a00700 1 -- 172.21.15.70:0/907000957 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f72b00105e0 con 0x7f72c01055d0 2024-05-08T07:15:04.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.534+0000 7f72b6a00700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2b80 0x7f72a40b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:04.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.535+0000 7f72b6a00700 1 -- 172.21.15.70:0/907000957 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 9583+0+0 (secure 0 0 0) 0x7f72b00e2c70 con 0x7f72c01055d0 2024-05-08T07:15:04.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.537+0000 7f72bd400700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2b80 0x7f72a40b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:04.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.542+0000 7f72bd400700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2b80 0x7f72a40b5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f72ac005fd0 tx=0x7f72ac005e70 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:04.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.549+0000 7f72b6a00700 1 -- 172.21.15.70:0/907000957 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f72b00aa2b0 con 0x7f72c01055d0 2024-05-08T07:15:04.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.960+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72c019cdf0 con 0x7f72c01055d0 2024-05-08T07:15:04.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.962+0000 7f72b6a00700 1 -- 172.21.15.70:0/907000957 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11880 (secure 0 0 0) 0x7f72b00a9bb0 con 0x7f72c01055d0 2024-05-08T07:15:04.961 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:15:04.961 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:12:58.286160+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T07:15:04.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2b80 msgr2=0x7f72a40b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:04.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2b80 0x7f72a40b5040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f72ac005fd0 tx=0x7f72ac005e70 comp rx=0 tx=0).stop 2024-05-08T07:15:04.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c01055d0 msgr2=0x7f72c01a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:04.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c01055d0 0x7f72c01a1700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72b000e9c0 tx=0x7f72b000ecd0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 shutdown_connections 2024-05-08T07:15:04.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2b80 0x7f72a40b5040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c010b680 0x7f72c019b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c01055d0 0x7f72c01a1700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 --2- 172.21.15.70:0/907000957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0105f90 0x7f72c01a1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:04.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 >> 172.21.15.70:0/907000957 conn(0x7f72c0101080 msgr2=0x7f72c0102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:04.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 shutdown_connections 2024-05-08T07:15:04.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:04.965+0000 7f72bf200700 1 -- 172.21.15.70:0/907000957 wait complete. 2024-05-08T07:15:04.965 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 33 2024-05-08T07:15:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:05 smithi070 ceph-mon[29591]: pgmap v900: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.6 MiB/s wr, 271 op/s 2024-05-08T07:15:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:05 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/907000957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:15:05.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:05 smithi172 ceph-mon[33377]: pgmap v900: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.6 MiB/s wr, 271 op/s 2024-05-08T07:15:05.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:05 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/907000957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:15:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:05 smithi194 ceph-mon[33679]: pgmap v900: 129 pgs: 129 active+clean; 1.4 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 1.6 MiB/s wr, 271 op/s 2024-05-08T07:15:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:05 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/907000957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:15:05.788 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 75.0 --await-for 42.0' 2024-05-08T07:15:05.789 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 75.0 --await-for 42.0 2024-05-08T07:15:06.271 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:15:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:07 smithi070 ceph-mon[29591]: pgmap v901: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 2.4 MiB/s wr, 483 op/s 2024-05-08T07:15:07.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:07 smithi070 ceph-mon[29591]: osdmap e136: 12 total, 12 up, 12 in 2024-05-08T07:15:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:07 smithi172 ceph-mon[33377]: pgmap v901: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 2.4 MiB/s wr, 483 op/s 2024-05-08T07:15:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:07 smithi172 ceph-mon[33377]: osdmap e136: 12 total, 12 up, 12 in 2024-05-08T07:15:07.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:07 smithi194 ceph-mon[33679]: pgmap v901: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 2.4 MiB/s wr, 483 op/s 2024-05-08T07:15:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:07 smithi194 ceph-mon[33679]: osdmap e136: 12 total, 12 up, 12 in 2024-05-08T07:15:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.678+0000 7f4e1a400700 1 -- 172.21.15.70:0/2230920188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e14104160 msgr2=0x7f4e141080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.678+0000 7f4e1a400700 1 --2- 172.21.15.70:0/2230920188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e14104160 0x7f4e141080c0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0099c0 tx=0x7f4dfc009cd0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.678+0000 7f4e1a400700 1 -- 172.21.15.70:0/2230920188 shutdown_connections 2024-05-08T07:15:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.678+0000 7f4e1a400700 1 --2- 172.21.15.70:0/2230920188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e141087a0 0x7f4e141103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.678+0000 7f4e1a400700 1 --2- 172.21.15.70:0/2230920188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e141037b0 0x7f4e14103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.678+0000 7f4e1a400700 1 --2- 172.21.15.70:0/2230920188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e14104160 0x7f4e141080c0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.678+0000 7f4e1a400700 1 -- 172.21.15.70:0/2230920188 >> 172.21.15.70:0/2230920188 conn(0x7f4e1407a570 msgr2=0x7f4e1407a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.678+0000 7f4e1a400700 1 -- 172.21.15.70:0/2230920188 shutdown_connections 2024-05-08T07:15:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.679+0000 7f4e1a400700 1 -- 172.21.15.70:0/2230920188 wait complete. 2024-05-08T07:15:08.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.679+0000 7f4e1a400700 1 Processor -- start 2024-05-08T07:15:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e1a400700 1 -- start start 2024-05-08T07:15:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e1a400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e141037b0 0x7f4e140757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e1a400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e14104160 0x7f4e14075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e1a400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e141087a0 0x7f4e14076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e1a400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14113580 con 0x7f4e141037b0 2024-05-08T07:15:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e1a400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14113400 con 0x7f4e141087a0 2024-05-08T07:15:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e1a400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14113700 con 0x7f4e14104160 2024-05-08T07:15:08.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e13400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e141037b0 0x7f4e140757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e13400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e141037b0 0x7f4e140757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44782/0 (socket says 172.21.15.70:44782) 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.680+0000 7f4e13400700 1 -- 172.21.15.70:0/334807400 learned_addr learned my addr 172.21.15.70:0/334807400 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.681+0000 7f4e0aa00700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e14104160 0x7f4e14075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.681+0000 7f4e13e00700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e141087a0 0x7f4e14076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.681+0000 7f4e13400700 1 -- 172.21.15.70:0/334807400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e14104160 msgr2=0x7f4e14075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.681+0000 7f4e13400700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e14104160 0x7f4e14075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.681+0000 7f4e13400700 1 -- 172.21.15.70:0/334807400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e141087a0 msgr2=0x7f4e14076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.681+0000 7f4e13400700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e141087a0 0x7f4e14076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.681+0000 7f4e13400700 1 -- 172.21.15.70:0/334807400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e141a7f30 con 0x7f4e141037b0 2024-05-08T07:15:08.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.681+0000 7f4e13400700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e141037b0 0x7f4e140757a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c9b0 tx=0x7f4e0400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.682+0000 7f4e10c00700 1 -- 172.21.15.70:0/334807400 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04007b00 con 0x7f4e141037b0 2024-05-08T07:15:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.682+0000 7f4e10c00700 1 -- 172.21.15.70:0/334807400 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e04007ca0 con 0x7f4e141037b0 2024-05-08T07:15:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.682+0000 7f4e1a400700 1 -- 172.21.15.70:0/334807400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e141a8220 con 0x7f4e141037b0 2024-05-08T07:15:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.682+0000 7f4e10c00700 1 -- 172.21.15.70:0/334807400 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04018660 con 0x7f4e141037b0 2024-05-08T07:15:08.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.682+0000 7f4e1a400700 1 -- 172.21.15.70:0/334807400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e141a8730 con 0x7f4e141037b0 2024-05-08T07:15:08.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.686+0000 7f4e10c00700 1 -- 172.21.15.70:0/334807400 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4e040188c0 con 0x7f4e141037b0 2024-05-08T07:15:08.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.687+0000 7f4e24e4ab80 1 Processor -- start 2024-05-08T07:15:08.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.687+0000 7f4e10c00700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4df80b2aa0 0x7f4df80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.687+0000 7f4e24e4ab80 1 -- start start 2024-05-08T07:15:08.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e10c00700 1 -- 172.21.15.70:0/334807400 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 9671+0+0 (secure 0 0 0) 0x7f4e040e2ac0 con 0x7f4e141037b0 2024-05-08T07:15:08.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e13e00700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4df80b2aa0 0x7f4df80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 0x564fa11bf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 0x564fa11b9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11c6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564fa110bbb0 con 0x564fa11ba1d0 2024-05-08T07:15:08.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564fa10a98f0 con 0x564fa11b9810 2024-05-08T07:15:08.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564fa1107b70 con 0x564fa11bf240 2024-05-08T07:15:08.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e13e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e13e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11c6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44788/0 (socket says 172.21.15.70:44788) 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e13e00700 1 -- 172.21.15.70:0/4197023328 learned_addr learned my addr 172.21.15.70:0/4197023328 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.688+0000 7f4e13400700 1 --2- 172.21.15.70:0/4197023328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 0x564fa11bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.689+0000 7f4e0aa00700 1 --2- 172.21.15.70:0/4197023328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 0x564fa11b9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.689+0000 7f4e13e00700 1 -- 172.21.15.70:0/4197023328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 msgr2=0x564fa11bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.689+0000 7f4e13e00700 1 --2- 172.21.15.70:0/4197023328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 0x564fa11bf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.689+0000 7f4e13e00700 1 -- 172.21.15.70:0/4197023328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 msgr2=0x564fa11b9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.689+0000 7f4e13e00700 1 --2- 172.21.15.70:0/4197023328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 0x564fa11b9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.689+0000 7f4e13e00700 1 -- 172.21.15.70:0/4197023328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa1058a60 con 0x564fa11ba1d0 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.689+0000 7f4e13e00700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4df80b2aa0 0x7f4df80b4f60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c830 tx=0x7f4e0c00c910 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:08.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.689+0000 7f4e13e00700 1 --2- 172.21.15.70:0/4197023328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11c6000 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00cd10 tx=0x7f4e0c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c35f5d07c62f138f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:08.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.690+0000 7f4e08c00700 1 -- 172.21.15.70:0/4197023328 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c024610 con 0x564fa11ba1d0 2024-05-08T07:15:08.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.690+0000 7f4e08c00700 1 -- 172.21.15.70:0/4197023328 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e0c020070 con 0x564fa11ba1d0 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.690+0000 7f4e08c00700 1 -- 172.21.15.70:0/4197023328 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c01a9a0 con 0x564fa11ba1d0 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.690+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/4197023328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 msgr2=0x564fa11c6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.691+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/4197023328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11c6000 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00cd10 tx=0x7f4e0c01d000 comp rx=0 tx=0).stop 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.691+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/4197023328 shutdown_connections 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.691+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/4197023328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11c6000 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.691+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/4197023328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 0x564fa11bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.691+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/4197023328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 0x564fa11b9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.691+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/4197023328 >> 172.21.15.70:0/4197023328 conn(0x564fa1131860 msgr2=0x564fa11b4100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.691+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/4197023328 shutdown_connections 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.691+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/4197023328 wait complete. 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.691+0000 7f4e24e4ab80 1 -- start start 2024-05-08T07:15:08.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.692+0000 7f4e24e4ab80 1 Processor -- start 2024-05-08T07:15:08.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.692+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.692+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11ba1d0 0x564fa11c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.692+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11bf240 0x564fa11c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.692+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564fa11c65a0 con 0x564fa11bf240 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.692+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564fa1071cb0 con 0x564fa11ba1d0 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.692+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564fa11c6720 con 0x564fa11b9810 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.692+0000 7f4e24e4ab80 10 client.0 _ll_register_callbacks cb 0x564fa10b2e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11bf240 0x564fa11c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11bf240 0x564fa11c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44802/0 (socket says 172.21.15.70:44802) 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13e00700 1 -- 172.21.15.70:0/2080198783 learned_addr learned my addr 172.21.15.70:0/2080198783 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e0aa00700 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11ba1d0 0x564fa11c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13400700 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13e00700 1 -- 172.21.15.70:0/2080198783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 msgr2=0x564fa11c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13e00700 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13e00700 1 -- 172.21.15.70:0/2080198783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11ba1d0 msgr2=0x564fa11c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13e00700 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11ba1d0 0x564fa11c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13e00700 1 -- 172.21.15.70:0/2080198783 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fa10d15b0 con 0x564fa11bf240 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13400700 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e13e00700 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11bf240 0x564fa11c34f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c004c20 tx=0x7f4e0c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecfa9808bc72545 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.693+0000 7f4e01600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.694+0000 7f4e01600700 1 -- 172.21.15.70:0/2080198783 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00c460 con 0x564fa11bf240 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.694+0000 7f4e01600700 1 -- 172.21.15.70:0/2080198783 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9671+0+0 (secure 0 0 0) 0x7f4e0c024410 con 0x564fa11bf240 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.694+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2080198783 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e0c020070 con 0x564fa11bf240 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.694+0000 7f4e01600700 1 -- 172.21.15.70:0/2080198783 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4e0c03b050 con 0x564fa11bf240 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.694+0000 7f4e24e4ab80 10 client.16287 fetch_fsmap learned FSMap version 33 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.694+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2080198783 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564fa11d0e00 con 0x564fa11bf240 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.694+0000 7f4e01600700 1 -- 172.21.15.70:0/2080198783 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e0c020070 con 0x564fa11bf240 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.695+0000 7f4e01600700 1 -- 172.21.15.70:0/2080198783 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8358+0+0 (secure 0 0 0) 0x7f4e0c00b410 con 0x564fa11bf240 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.695+0000 7f4e24e4ab80 10 client.16287 fetch_fsmap finished waiting for FSMap version 33 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.695+0000 7f4e24e4ab80 10 client.16287 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:15:08.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.695+0000 7f4e24e4ab80 20 client.16287 populate_metadata read hostname 'smithi070' 2024-05-08T07:15:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.695+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fa11d3380 0x564fa11d5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.695+0000 7f4e24e4ab80 4 client.16287 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:15:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.695+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2080198783 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fa11862d0 con 0x564fa11d3380 2024-05-08T07:15:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.696+0000 7f4e13400700 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fa11d3380 0x564fa11d5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.697+0000 7f4e13400700 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fa11d3380 0x564fa11d5770 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14541b29ea36aea5 server_cookie=70d5dc4e8d8f962d in_seq=0 out_seq=0 2024-05-08T07:15:08.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.697+0000 7f4e01600700 10 client.16287 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:15:08.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e01600700 1 -- 172.21.15.70:0/2080198783 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564fa11862d0 con 0x564fa11d3380 2024-05-08T07:15:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e01600700 10 client.16287 handle_command_reply: tid=0 2024-05-08T07:15:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 client.16287 shutdown 2024-05-08T07:15:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2080198783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11bf240 msgr2=0x564fa11c34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11bf240 0x564fa11c34f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c004c20 tx=0x7f4e0c01ad70 comp rx=0 tx=0).stop 2024-05-08T07:15:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2080198783 shutdown_connections 2024-05-08T07:15:08.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fa11d3380 0x564fa11d5770 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11bf240 0x564fa11c34f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2080198783 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11ba1d0 0x564fa11c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2080198783 >> 172.21.15.70:0/2080198783 conn(0x564fa1131860 msgr2=0x564fa11aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e01600700 0 client.16287 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:15:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2080198783 shutdown_connections 2024-05-08T07:15:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2080198783 wait complete. 2024-05-08T07:15:08.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.699+0000 7f4e24e4ab80 20 client.16287 trim_cache size 0 max 16384 2024-05-08T07:15:08.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.721+0000 7f4e24e4ab80 1 Processor -- start 2024-05-08T07:15:08.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.721+0000 7f4e24e4ab80 1 -- start start 2024-05-08T07:15:08.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11bd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11bf240 0x564fa11ae340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0011950 con 0x564fa11ba1d0 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4df000f1b0 con 0x564fa11bf240 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4df000d020 con 0x564fa11b9810 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e0aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11bd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e0aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11bd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44804/0 (socket says 172.21.15.70:44804) 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e0aa00700 1 -- 172.21.15.70:0/2463636976 learned_addr learned my addr 172.21.15.70:0/2463636976 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e13400700 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.722+0000 7f4e13e00700 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11bf240 0x564fa11ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.723+0000 7f4e0aa00700 1 -- 172.21.15.70:0/2463636976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 msgr2=0x564fa11cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.723+0000 7f4e0aa00700 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.723+0000 7f4e0aa00700 1 -- 172.21.15.70:0/2463636976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11bf240 msgr2=0x564fa11ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.723+0000 7f4e0aa00700 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11bf240 0x564fa11ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.723+0000 7f4e0aa00700 1 -- 172.21.15.70:0/2463636976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fa11c1520 con 0x564fa11ba1d0 2024-05-08T07:15:08.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.723+0000 7f4e13400700 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.723+0000 7f4e0aa00700 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11bd3d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc000c00 tx=0x7f4dfc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3db877df407f26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.723+0000 7f4e03e00700 1 -- 172.21.15.70:0/2463636976 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc027020 con 0x564fa11ba1d0 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.724+0000 7f4e03e00700 1 -- 172.21.15.70:0/2463636976 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dfc00bc20 con 0x564fa11ba1d0 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.724+0000 7f4e03e00700 1 -- 172.21.15.70:0/2463636976 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc003a00 con 0x564fa11ba1d0 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.724+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2463636976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 msgr2=0x564fa11bd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.724+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11bd3d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc000c00 tx=0x7f4dfc0095c0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.724+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2463636976 shutdown_connections 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.724+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11bf240 0x564fa11ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.724+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11b9810 0x564fa11cf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.724+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/2463636976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11bd3d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.724+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2463636976 >> 172.21.15.70:0/2463636976 conn(0x564fa1131860 msgr2=0x564fa11bccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.725+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2463636976 shutdown_connections 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.725+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/2463636976 wait complete. 2024-05-08T07:15:08.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.725+0000 7f4e24e4ab80 1 -- start start 2024-05-08T07:15:08.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.725+0000 7f4e24e4ab80 1 Processor -- start 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 0x564fa11cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e24e4ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 0x564fa11c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4df000d670 con 0x564fa11ba1d0 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4df000eae0 con 0x564fa11b9810 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e24e4ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4df000dd40 con 0x564fa11bf240 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e24e4ab80 10 client.0 _ll_register_callbacks cb 0x564fa10b2e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e0aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e0aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44818/0 (socket says 172.21.15.70:44818) 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e0aa00700 1 -- 172.21.15.70:0/1059540996 learned_addr learned my addr 172.21.15.70:0/1059540996 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e13e00700 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 0x564fa11c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.726+0000 7f4e13400700 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 0x564fa11cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e0aa00700 1 -- 172.21.15.70:0/1059540996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 msgr2=0x564fa11c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e0aa00700 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 0x564fa11c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e0aa00700 1 -- 172.21.15.70:0/1059540996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 msgr2=0x564fa11cbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:08.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e0aa00700 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 0x564fa11cbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:08.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e0aa00700 1 -- 172.21.15.70:0/1059540996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fa11c93d0 con 0x564fa11ba1d0 2024-05-08T07:15:08.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e0aa00700 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11cc130 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0098e0 tx=0x7f4dfc0050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25d26d099cda419 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:08.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e01600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:15:08.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e01600700 1 -- 172.21.15.70:0/1059540996 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc027030 con 0x564fa11ba1d0 2024-05-08T07:15:08.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e01600700 1 -- 172.21.15.70:0/1059540996 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(136..136 src has 1..136) ==== 9671+0+0 (secure 0 0 0) 0x7f4dfc003680 con 0x564fa11ba1d0 2024-05-08T07:15:08.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.727+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/1059540996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dfc00bc20 con 0x564fa11ba1d0 2024-05-08T07:15:08.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e01600700 1 -- 172.21.15.70:0/1059540996 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4dfc03d050 con 0x564fa11ba1d0 2024-05-08T07:15:08.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e24e4ab80 10 client.16293 fetch_fsmap learned FSMap version 33 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/1059540996 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564fa1246e60 con 0x564fa11ba1d0 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e01600700 1 -- 172.21.15.70:0/1059540996 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4dfc00bc20 con 0x564fa11ba1d0 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e01600700 1 -- 172.21.15.70:0/1059540996 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8358+0+0 (secure 0 0 0) 0x7f4dfc00f920 con 0x564fa11ba1d0 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e24e4ab80 10 client.16293 fetch_fsmap finished waiting for FSMap version 33 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e24e4ab80 10 client.16293 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e24e4ab80 20 client.16293 populate_metadata read hostname 'smithi070' 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fa12474e0 0x564fa1249900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e24e4ab80 4 client.16293 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.0, "await_for": 42.0}] 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.728+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/1059540996 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.0, "await_for": 42.0}) -- 0x564fa1119590 con 0x564fa12474e0 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.729+0000 7f4e13400700 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fa12474e0 0x564fa1249900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.730+0000 7f4e13400700 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fa12474e0 0x564fa1249900 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68495515abbe4bee server_cookie=98b638cb63bef583 in_seq=0 out_seq=0 2024-05-08T07:15:08.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:08.730+0000 7f4e01600700 10 client.16293 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:15:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:09 smithi172 ceph-mon[33377]: pgmap v903: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 1.8 MiB/s wr, 373 op/s 2024-05-08T07:15:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:09 smithi194 ceph-mon[33679]: pgmap v903: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 1.8 MiB/s wr, 373 op/s 2024-05-08T07:15:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:09 smithi070 ceph-mon[29591]: pgmap v903: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 1.8 MiB/s wr, 373 op/s 2024-05-08T07:15:10.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:10 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:15:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:10 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:15:10.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:10 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:15:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:11 smithi172 ceph-mon[33377]: pgmap v904: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.6 MiB/s wr, 437 op/s 2024-05-08T07:15:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:11 smithi194 ceph-mon[33679]: pgmap v904: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.6 MiB/s wr, 437 op/s 2024-05-08T07:15:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:11 smithi070 ceph-mon[29591]: pgmap v904: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.6 MiB/s wr, 437 op/s 2024-05-08T07:15:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:13 smithi172 ceph-mon[33377]: pgmap v905: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.6 MiB/s wr, 437 op/s 2024-05-08T07:15:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:13 smithi172 ceph-mon[33377]: osdmap e137: 12 total, 12 up, 12 in 2024-05-08T07:15:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:13 smithi194 ceph-mon[33679]: pgmap v905: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.6 MiB/s wr, 437 op/s 2024-05-08T07:15:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:13 smithi194 ceph-mon[33679]: osdmap e137: 12 total, 12 up, 12 in 2024-05-08T07:15:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:13 smithi070 ceph-mon[29591]: pgmap v905: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.6 MiB/s wr, 437 op/s 2024-05-08T07:15:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:13 smithi070 ceph-mon[29591]: osdmap e137: 12 total, 12 up, 12 in 2024-05-08T07:15:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:15 smithi194 ceph-mon[33679]: pgmap v907: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 912 KiB/s wr, 228 op/s 2024-05-08T07:15:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:15 smithi070 ceph-mon[29591]: pgmap v907: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 912 KiB/s wr, 228 op/s 2024-05-08T07:15:15.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:15 smithi172 ceph-mon[33377]: pgmap v907: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 912 KiB/s wr, 228 op/s 2024-05-08T07:15:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:17 smithi194 ceph-mon[33679]: pgmap v908: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 998 KiB/s wr, 207 op/s 2024-05-08T07:15:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:17 smithi070 ceph-mon[29591]: pgmap v908: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 998 KiB/s wr, 207 op/s 2024-05-08T07:15:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:17 smithi172 ceph-mon[33377]: pgmap v908: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 998 KiB/s wr, 207 op/s 2024-05-08T07:15:19.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:19 smithi194 ceph-mon[33679]: pgmap v909: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 914 KiB/s wr, 190 op/s 2024-05-08T07:15:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:19 smithi070 ceph-mon[29591]: pgmap v909: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 914 KiB/s wr, 190 op/s 2024-05-08T07:15:19.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:19 smithi172 ceph-mon[33377]: pgmap v909: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 914 KiB/s wr, 190 op/s 2024-05-08T07:15:21.731 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:21 smithi172 ceph-mon[33377]: pgmap v910: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 313 KiB/s wr, 152 op/s 2024-05-08T07:15:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:21 smithi194 ceph-mon[33679]: pgmap v910: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 313 KiB/s wr, 152 op/s 2024-05-08T07:15:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:21 smithi070 ceph-mon[29591]: pgmap v910: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 313 KiB/s wr, 152 op/s 2024-05-08T07:15:23.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:23 smithi194 ceph-mon[33679]: pgmap v911: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 313 KiB/s wr, 152 op/s 2024-05-08T07:15:23.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:23 smithi070 ceph-mon[29591]: pgmap v911: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 313 KiB/s wr, 152 op/s 2024-05-08T07:15:23.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:23 smithi172 ceph-mon[33377]: pgmap v911: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 313 KiB/s wr, 152 op/s 2024-05-08T07:15:24.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:24 smithi194 ceph-mon[33679]: pgmap v912: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 288 KiB/s wr, 140 op/s 2024-05-08T07:15:24.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:24 smithi070 ceph-mon[29591]: pgmap v912: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 288 KiB/s wr, 140 op/s 2024-05-08T07:15:24.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:24 smithi172 ceph-mon[33377]: pgmap v912: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 288 KiB/s wr, 140 op/s 2024-05-08T07:15:25.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.589+0000 7f4e01600700 1 -- 172.21.15.70:0/1059540996 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x564fa1119590 con 0x564fa12474e0 2024-05-08T07:15:25.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.589+0000 7f4e01600700 10 client.16293 handle_command_reply: tid=0 2024-05-08T07:15:25.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.589+0000 7f4e24e4ab80 1 client.16293 shutdown 2024-05-08T07:15:25.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.590+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/1059540996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 msgr2=0x564fa11cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:25.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.590+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11cc130 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0098e0 tx=0x7f4dfc0050f0 comp rx=0 tx=0).stop 2024-05-08T07:15:25.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.590+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/1059540996 shutdown_connections 2024-05-08T07:15:25.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.590+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fa12474e0 0x564fa1249900 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:25.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.590+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fa11bf240 0x564fa11c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:25.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.590+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fa11b9810 0x564fa11cbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:25.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.590+0000 7f4e24e4ab80 1 --2- 172.21.15.70:0/1059540996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fa11ba1d0 0x564fa11cc130 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:25.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.590+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/1059540996 >> 172.21.15.70:0/1059540996 conn(0x564fa1131860 msgr2=0x564fa11bd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:25.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.590+0000 7f4e01600700 0 client.16293 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:15:25.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.591+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/1059540996 shutdown_connections 2024-05-08T07:15:25.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.591+0000 7f4e24e4ab80 1 -- 172.21.15.70:0/1059540996 wait complete. 2024-05-08T07:15:25.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.591+0000 7f4e24e4ab80 20 client.16293 trim_cache size 0 max 16384 2024-05-08T07:15:25.591 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:15:25.591 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 34, 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 74, 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "9aa0e4da": { 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 74, 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:15:25.592 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 75.0, 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:25.593 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:15:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 -- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4df80b2aa0 msgr2=0x7f4df80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4df80b2aa0 0x7f4df80b4f60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c830 tx=0x7f4e0c00c910 comp rx=0 tx=0).stop 2024-05-08T07:15:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 -- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e141037b0 msgr2=0x7f4e140757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e141037b0 0x7f4e140757a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c9b0 tx=0x7f4e0400cd70 comp rx=0 tx=0).stop 2024-05-08T07:15:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 -- 172.21.15.70:0/334807400 shutdown_connections 2024-05-08T07:15:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4df80b2aa0 0x7f4df80b4f60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4e141087a0 0x7f4e14076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:25.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e141037b0 0x7f4e140757a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:25.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 --2- 172.21.15.70:0/334807400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e14104160 0x7f4e14075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:25.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.592+0000 7f4e1a400700 1 -- 172.21.15.70:0/334807400 >> 172.21.15.70:0/334807400 conn(0x7f4e1407a570 msgr2=0x7f4e14102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:25.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.593+0000 7f4e1a400700 1 -- 172.21.15.70:0/334807400 shutdown_connections 2024-05-08T07:15:25.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:25.593+0000 7f4e1a400700 1 -- 172.21.15.70:0/334807400 wait complete. 2024-05-08T07:15:26.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:26 smithi070 ceph-mon[29591]: pgmap v913: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 296 KiB/s wr, 138 op/s 2024-05-08T07:15:26.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:26 smithi172 ceph-mon[33377]: pgmap v913: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 296 KiB/s wr, 138 op/s 2024-05-08T07:15:27.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:26 smithi194 ceph-mon[33679]: pgmap v913: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 296 KiB/s wr, 138 op/s 2024-05-08T07:15:27.425 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9aa0e4da', quiesce took 25.8 seconds. Will release after: 15.0 2024-05-08T07:15:28.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:28 smithi070 ceph-mon[29591]: pgmap v914: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 142 KiB/s wr, 132 op/s 2024-05-08T07:15:28.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:28 smithi172 ceph-mon[33377]: pgmap v914: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 142 KiB/s wr, 132 op/s 2024-05-08T07:15:29.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:28 smithi194 ceph-mon[33679]: pgmap v914: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 142 KiB/s wr, 132 op/s 2024-05-08T07:15:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:30 smithi070 ceph-mon[29591]: pgmap v915: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 150 KiB/s wr, 135 op/s 2024-05-08T07:15:30.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:30 smithi172 ceph-mon[33377]: pgmap v915: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 150 KiB/s wr, 135 op/s 2024-05-08T07:15:31.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:30 smithi194 ceph-mon[33679]: pgmap v915: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 150 KiB/s wr, 135 op/s 2024-05-08T07:15:32.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:32 smithi070 ceph-mon[29591]: pgmap v916: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-05-08T07:15:32.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:32 smithi172 ceph-mon[33377]: pgmap v916: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-05-08T07:15:33.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:32 smithi194 ceph-mon[33679]: pgmap v916: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-05-08T07:15:34.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:34 smithi070 ceph-mon[29591]: pgmap v917: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-05-08T07:15:34.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:34 smithi172 ceph-mon[33377]: pgmap v917: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-05-08T07:15:35.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:34 smithi194 ceph-mon[33679]: pgmap v917: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-05-08T07:15:36.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:36 smithi172 ceph-mon[33377]: pgmap v918: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-08T07:15:37.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:36 smithi194 ceph-mon[33679]: pgmap v918: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-08T07:15:37.057 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:36 smithi070 ceph-mon[29591]: pgmap v918: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-08T07:15:38.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:38 smithi172 ceph-mon[33377]: pgmap v919: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-05-08T07:15:39.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:38 smithi194 ceph-mon[33679]: pgmap v919: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-05-08T07:15:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:38 smithi070 ceph-mon[29591]: pgmap v919: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-05-08T07:15:40.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:40 smithi172 ceph-mon[33377]: pgmap v920: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-08T07:15:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:40 smithi194 ceph-mon[33679]: pgmap v920: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-08T07:15:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:40 smithi070 ceph-mon[29591]: pgmap v920: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-08T07:15:42.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:15:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:42 smithi070 ceph-mon[29591]: pgmap v921: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T07:15:42.892 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:15:42.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:42 smithi172 ceph-mon[33377]: pgmap v921: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T07:15:43.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:42 smithi194 ceph-mon[33679]: pgmap v921: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T07:15:44.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:44 smithi172 ceph-mon[33377]: pgmap v922: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T07:15:44.936 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:44 smithi070 ceph-mon[29591]: pgmap v922: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T07:15:45.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:44 smithi194 ceph-mon[33679]: pgmap v922: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T07:15:45.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.305+0000 7f8e6da00700 1 -- 172.21.15.70:0/680014406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68075ff0 msgr2=0x7f8e6810f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:45.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.305+0000 7f8e6da00700 1 --2- 172.21.15.70:0/680014406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68075ff0 0x7f8e6810f960 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009990 tx=0x7f8e50009ca0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.305+0000 7f8e6da00700 1 -- 172.21.15.70:0/680014406 shutdown_connections 2024-05-08T07:15:45.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.305+0000 7f8e6da00700 1 --2- 172.21.15.70:0/680014406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e6810fea0 0x7f8e68112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.305+0000 7f8e6da00700 1 --2- 172.21.15.70:0/680014406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e680756d0 0x7f8e68075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.305+0000 7f8e6da00700 1 --2- 172.21.15.70:0/680014406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68075ff0 0x7f8e6810f960 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.305+0000 7f8e6da00700 1 -- 172.21.15.70:0/680014406 >> 172.21.15.70:0/680014406 conn(0x7f8e6807a600 msgr2=0x7f8e6807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:45.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.305+0000 7f8e6da00700 1 -- 172.21.15.70:0/680014406 shutdown_connections 2024-05-08T07:15:45.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.305+0000 7f8e6da00700 1 -- 172.21.15.70:0/680014406 wait complete. 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.306+0000 7f8e6da00700 1 Processor -- start 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.306+0000 7f8e6da00700 1 -- start start 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e6da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e680756d0 0x7f8e681a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e6da00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68075ff0 0x7f8e681a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e6da00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e6810fea0 0x7f8e6819bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e6da00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68115780 con 0x7f8e680756d0 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e6da00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68115600 con 0x7f8e68075ff0 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e6da00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68115900 con 0x7f8e6810fea0 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e66a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e680756d0 0x7f8e681a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:45.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e66a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e680756d0 0x7f8e681a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56172/0 (socket says 172.21.15.70:56172) 2024-05-08T07:15:45.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e66a00700 1 -- 172.21.15.70:0/1641578646 learned_addr learned my addr 172.21.15.70:0/1641578646 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e66a00700 1 -- 172.21.15.70:0/1641578646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e6810fea0 msgr2=0x7f8e6819bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e66a00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e6810fea0 0x7f8e6819bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e5e000700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68075ff0 0x7f8e681a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e66a00700 1 -- 172.21.15.70:0/1641578646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68075ff0 msgr2=0x7f8e681a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e66a00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68075ff0 0x7f8e681a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.307+0000 7f8e66a00700 1 -- 172.21.15.70:0/1641578646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6819c2a0 con 0x7f8e680756d0 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.308+0000 7f8e66a00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e680756d0 0x7f8e681a1930 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800c920 tx=0x7f8e5800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.308+0000 7f8e5fe00700 1 -- 172.21.15.70:0/1641578646 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58007b00 con 0x7f8e680756d0 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.308+0000 7f8e5fe00700 1 -- 172.21.15.70:0/1641578646 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e58004cc0 con 0x7f8e680756d0 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.308+0000 7f8e5fe00700 1 -- 172.21.15.70:0/1641578646 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580054f0 con 0x7f8e680756d0 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.308+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6819c590 con 0x7f8e680756d0 2024-05-08T07:15:45.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.308+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e681a8800 con 0x7f8e680756d0 2024-05-08T07:15:45.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.310+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6806a190 con 0x7f8e680756d0 2024-05-08T07:15:45.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.312+0000 7f8e5fe00700 1 -- 172.21.15.70:0/1641578646 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8e58007ca0 con 0x7f8e680756d0 2024-05-08T07:15:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.313+0000 7f8e5fe00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e4c0b2a70 0x7f8e4c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:45.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.314+0000 7f8e5fe00700 1 -- 172.21.15.70:0/1641578646 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 9583+0+0 (secure 0 0 0) 0x7f8e580e2a50 con 0x7f8e680756d0 2024-05-08T07:15:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.314+0000 7f8e5e000700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e4c0b2a70 0x7f8e4c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:45.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.315+0000 7f8e5e000700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e4c0b2a70 0x7f8e4c0b4f30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8e50006010 tx=0x7f8e50005ea0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:45.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.316+0000 7f8e5fe00700 1 -- 172.21.15.70:0/1641578646 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8e58014030 con 0x7f8e680756d0 2024-05-08T07:15:45.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.595+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e6802e5b0 con 0x7f8e680756d0 2024-05-08T07:15:45.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.596+0000 7f8e5fe00700 1 -- 172.21.15.70:0/1641578646 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11882 (secure 0 0 0) 0x7f8e580aa030 con 0x7f8e680756d0 2024-05-08T07:15:45.594 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:15:45.595 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:15:08.402253+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:15:45.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e4c0b2a70 msgr2=0x7f8e4c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e4c0b2a70 0x7f8e4c0b4f30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8e50006010 tx=0x7f8e50005ea0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e680756d0 msgr2=0x7f8e681a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e680756d0 0x7f8e681a1930 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800c920 tx=0x7f8e5800cce0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 shutdown_connections 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e4c0b2a70 0x7f8e4c0b4f30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e6810fea0 0x7f8e6819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e680756d0 0x7f8e681a1930 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 --2- 172.21.15.70:0/1641578646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68075ff0 0x7f8e681a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.599+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 >> 172.21.15.70:0/1641578646 conn(0x7f8e6807a600 msgr2=0x7f8e68100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.600+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 shutdown_connections 2024-05-08T07:15:45.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:45.600+0000 7f8e6da00700 1 -- 172.21.15.70:0/1641578646 wait complete. 2024-05-08T07:15:45.599 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-05-08T07:15:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:45 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1641578646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:15:45.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:45 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1641578646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:15:46.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:45 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1641578646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:15:46.426 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 9aa0e4da --release --await' 2024-05-08T07:15:46.426 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 9aa0e4da --release --await 2024-05-08T07:15:46.898 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:15:46.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:46 smithi172 ceph-mon[33377]: pgmap v923: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-08T07:15:47.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:46 smithi194 ceph-mon[33679]: pgmap v923: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-08T07:15:47.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:46 smithi070 ceph-mon[29591]: pgmap v923: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-08T07:15:48.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:48 smithi172 ceph-mon[33377]: pgmap v924: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-05-08T07:15:49.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:48 smithi194 ceph-mon[33679]: pgmap v924: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-05-08T07:15:49.027 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:48 smithi070 ceph-mon[29591]: pgmap v924: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.0 KiB/s wr, 6 op/s 2024-05-08T07:15:49.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.208+0000 7f1d16600700 1 -- 172.21.15.70:0/3186466934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 msgr2=0x7f1d10075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.208+0000 7f1d16600700 1 --2- 172.21.15.70:0/3186466934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 0x7f1d10075ab0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009990 tx=0x7f1d00009ca0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.208+0000 7f1d16600700 1 -- 172.21.15.70:0/3186466934 shutdown_connections 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.208+0000 7f1d16600700 1 --2- 172.21.15.70:0/3186466934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d1010ff00 0x7f1d101122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.208+0000 7f1d16600700 1 --2- 172.21.15.70:0/3186466934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 0x7f1d10075ab0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.208+0000 7f1d16600700 1 --2- 172.21.15.70:0/3186466934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d10075ff0 0x7f1d1010f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.208+0000 7f1d16600700 1 -- 172.21.15.70:0/3186466934 >> 172.21.15.70:0/3186466934 conn(0x7f1d1007a600 msgr2=0x7f1d1007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.208+0000 7f1d16600700 1 -- 172.21.15.70:0/3186466934 shutdown_connections 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.208+0000 7f1d16600700 1 -- 172.21.15.70:0/3186466934 wait complete. 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.209+0000 7f1d16600700 1 Processor -- start 2024-05-08T07:15:49.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.209+0000 7f1d16600700 1 -- start start 2024-05-08T07:15:49.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.209+0000 7f1d16600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 0x7f1d101a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.209+0000 7f1d16600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d10075ff0 0x7f1d101a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d16600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1010ff00 0x7f1d1019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d16600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10115790 con 0x7f1d100756d0 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d16600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10115610 con 0x7f1d10075ff0 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d16600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10115910 con 0x7f1d1010ff00 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 0x7f1d101a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 0x7f1d101a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45504/0 (socket says 172.21.15.70:45504) 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0f400700 1 -- 172.21.15.70:0/2727877722 learned_addr learned my addr 172.21.15.70:0/2727877722 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0ea00700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d10075ff0 0x7f1d101a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1010ff00 0x7f1d1019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0f400700 1 -- 172.21.15.70:0/2727877722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1010ff00 msgr2=0x7f1d1019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0f400700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1010ff00 0x7f1d1019bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0f400700 1 -- 172.21.15.70:0/2727877722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d10075ff0 msgr2=0x7f1d101a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0f400700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d10075ff0 0x7f1d101a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.210+0000 7f1d0f400700 1 -- 172.21.15.70:0/2727877722 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1019c230 con 0x7f1d100756d0 2024-05-08T07:15:49.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.211+0000 7f1d0f400700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 0x7f1d101a18c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1d000057c0 tx=0x7f1d00009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:49.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.211+0000 7f1d07e00700 1 -- 172.21.15.70:0/2727877722 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00027070 con 0x7f1d100756d0 2024-05-08T07:15:49.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.211+0000 7f1d07e00700 1 -- 172.21.15.70:0/2727877722 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d0000fda0 con 0x7f1d100756d0 2024-05-08T07:15:49.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.211+0000 7f1d16600700 1 -- 172.21.15.70:0/2727877722 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1019c4c0 con 0x7f1d100756d0 2024-05-08T07:15:49.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.211+0000 7f1d07e00700 1 -- 172.21.15.70:0/2727877722 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00022ca0 con 0x7f1d100756d0 2024-05-08T07:15:49.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.211+0000 7f1d16600700 1 -- 172.21.15.70:0/2727877722 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d101a8790 con 0x7f1d100756d0 2024-05-08T07:15:49.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.215+0000 7f1d07e00700 1 -- 172.21.15.70:0/2727877722 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1d0002a070 con 0x7f1d100756d0 2024-05-08T07:15:49.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.216+0000 7f1d20f49b80 1 Processor -- start 2024-05-08T07:15:49.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.216+0000 7f1d20f49b80 1 -- start start 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.216+0000 7f1d07e00700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1cf40b29f0 0x7f1cf40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.216+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341deb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 0x562341de5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562341d37b20 con 0x562341de5e50 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562341cd5860 con 0x562341de5490 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562341d33ae0 con 0x562341deaec0 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d07e00700 1 -- 172.21.15.70:0/2727877722 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 9583+0+0 (secure 0 0 0) 0x7f1d000e36e0 con 0x7f1d100756d0 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1cf40b29f0 0x7f1cf40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d0fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d0fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45512/0 (socket says 172.21.15.70:45512) 2024-05-08T07:15:49.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d0fe00700 1 -- 172.21.15.70:0/22098892 learned_addr learned my addr 172.21.15.70:0/22098892 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:49.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d0f400700 1 --2- 172.21.15.70:0/22098892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341deb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.217+0000 7f1d0ea00700 1 --2- 172.21.15.70:0/22098892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 0x562341de5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d0fe00700 1 -- 172.21.15.70:0/22098892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 msgr2=0x562341deb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:49.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/22098892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341deb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d0fe00700 1 -- 172.21.15.70:0/22098892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 msgr2=0x562341de5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/22098892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 0x562341de5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d0fe00700 1 -- 172.21.15.70:0/22098892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562341c849d0 con 0x562341de5e50 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1cf40b29f0 0x7f1cf40b4eb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1d08007b40 tx=0x7f1d08009ca0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/22098892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df1c80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009070 tx=0x7f1d08009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f92dce3279575d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d04c00700 1 -- 172.21.15.70:0/22098892 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08004bb0 con 0x562341de5e50 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d04c00700 1 -- 172.21.15.70:0/22098892 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d0801e070 con 0x562341de5e50 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.218+0000 7f1d04c00700 1 -- 172.21.15.70:0/22098892 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d08004420 con 0x562341de5e50 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.219+0000 7f1d20f49b80 1 -- 172.21.15.70:0/22098892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 msgr2=0x562341df1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.219+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/22098892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df1c80 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1d08009070 tx=0x7f1d08009f90 comp rx=0 tx=0).stop 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.219+0000 7f1d20f49b80 1 -- 172.21.15.70:0/22098892 shutdown_connections 2024-05-08T07:15:49.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.219+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/22098892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df1c80 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.219+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/22098892 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341deb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.219+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/22098892 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 0x562341de5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.219+0000 7f1d20f49b80 1 -- 172.21.15.70:0/22098892 >> 172.21.15.70:0/22098892 conn(0x562341d13c60 msgr2=0x562341ddfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:49.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.219+0000 7f1d20f49b80 1 -- 172.21.15.70:0/22098892 shutdown_connections 2024-05-08T07:15:49.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.220+0000 7f1d20f49b80 1 -- 172.21.15.70:0/22098892 wait complete. 2024-05-08T07:15:49.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.220+0000 7f1d20f49b80 1 -- start start 2024-05-08T07:15:49.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.220+0000 7f1d20f49b80 1 Processor -- start 2024-05-08T07:15:49.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341df1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 0x562341deec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341def1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562341df2220 con 0x562341de5490 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562341c9dc20 con 0x562341de5e50 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562341df23a0 con 0x562341deaec0 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d20f49b80 10 client.0 _ll_register_callbacks cb 0x562341cded70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d0f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341df1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d0f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341df1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45516/0 (socket says 172.21.15.70:45516) 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d0f400700 1 -- 172.21.15.70:0/2538258167 learned_addr learned my addr 172.21.15.70:0/2538258167 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d0ea00700 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 0x562341deec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.221+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341def1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1d0f400700 1 -- 172.21.15.70:0/2538258167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 msgr2=0x562341def1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:49.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1d0f400700 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341def1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1d0f400700 1 -- 172.21.15.70:0/2538258167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 msgr2=0x562341deec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1d0f400700 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 0x562341deec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1d0f400700 1 -- 172.21.15.70:0/2538258167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562341cfd520 con 0x562341de5490 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341def1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1d0f400700 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341df1870 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1d000a7840 tx=0x7f1d000a9df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e711cdc8e78844c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1cf9600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1cf9600700 1 -- 172.21.15.70:0/2538258167 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000aacd0 con 0x562341de5490 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1cf9600700 1 -- 172.21.15.70:0/2538258167 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 9583+0+0 (secure 0 0 0) 0x7f1d00075190 con 0x562341de5490 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.222+0000 7f1d20f49b80 1 -- 172.21.15.70:0/2538258167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d0801e070 con 0x562341de5490 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1cf9600700 1 -- 172.21.15.70:0/2538258167 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1d000aa5d0 con 0x562341de5490 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1d20f49b80 10 client.16311 fetch_fsmap learned FSMap version 34 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1d20f49b80 1 -- 172.21.15.70:0/2538258167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562341dfca90 con 0x562341de5490 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1cf9600700 1 -- 172.21.15.70:0/2538258167 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d0801e070 con 0x562341de5490 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1cf9600700 1 -- 172.21.15.70:0/2538258167 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f1d00072020 con 0x562341de5490 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1d20f49b80 10 client.16311 fetch_fsmap finished waiting for FSMap version 34 2024-05-08T07:15:49.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1d20f49b80 10 client.16311 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:15:49.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1d20f49b80 20 client.16311 populate_metadata read hostname 'smithi070' 2024-05-08T07:15:49.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562341dff160 0x562341e015c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1d20f49b80 4 client.16311 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:15:49.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.223+0000 7f1d20f49b80 1 -- 172.21.15.70:0/2538258167 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562341db21a0 con 0x562341dff160 2024-05-08T07:15:49.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.224+0000 7f1d0ea00700 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562341dff160 0x562341e015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.225+0000 7f1d0ea00700 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562341dff160 0x562341e015c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=131b87739c459723 server_cookie=4ffe08cd9df10c8d in_seq=0 out_seq=0 2024-05-08T07:15:49.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.225+0000 7f1cf9600700 10 client.16311 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:15:49.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1cf9600700 1 -- 172.21.15.70:0/2538258167 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562341db21a0 con 0x562341dff160 2024-05-08T07:15:49.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1cf9600700 10 client.16311 handle_command_reply: tid=0 2024-05-08T07:15:49.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1d20f49b80 1 client.16311 shutdown 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1d20f49b80 1 -- 172.21.15.70:0/2538258167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 msgr2=0x562341df1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341df1870 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1d000a7840 tx=0x7f1d000a9df0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1d20f49b80 1 -- 172.21.15.70:0/2538258167 shutdown_connections 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562341dff160 0x562341e015c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341def1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341df1870 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/2538258167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 0x562341deec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1d20f49b80 1 -- 172.21.15.70:0/2538258167 >> 172.21.15.70:0/2538258167 conn(0x562341d13c60 msgr2=0x562341dda850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.227+0000 7f1cf9600700 0 client.16311 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.228+0000 7f1d20f49b80 1 -- 172.21.15.70:0/2538258167 shutdown_connections 2024-05-08T07:15:49.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.228+0000 7f1d20f49b80 1 -- 172.21.15.70:0/2538258167 wait complete. 2024-05-08T07:15:49.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.228+0000 7f1d20f49b80 20 client.16311 trim_cache size 0 max 16384 2024-05-08T07:15:49.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.249+0000 7f1d20f49b80 1 Processor -- start 2024-05-08T07:15:49.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.249+0000 7f1d20f49b80 1 -- start start 2024-05-08T07:15:49.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341def1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 0x562341dfb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341dda6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d101b40a0 con 0x562341de5490 2024-05-08T07:15:49.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d101b18d0 con 0x562341de5e50 2024-05-08T07:15:49.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d101af740 con 0x562341deaec0 2024-05-08T07:15:49.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d0f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341def1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d0f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341def1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45528/0 (socket says 172.21.15.70:45528) 2024-05-08T07:15:49.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d0f400700 1 -- 172.21.15.70:0/1195241142 learned_addr learned my addr 172.21.15.70:0/1195241142 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.250+0000 7f1d0ea00700 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 0x562341dfb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341dda6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1d0f400700 1 -- 172.21.15.70:0/1195241142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 msgr2=0x562341dda6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1d0f400700 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341dda6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1d0f400700 1 -- 172.21.15.70:0/1195241142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 msgr2=0x562341dfb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1d0f400700 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 0x562341dfb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1d0f400700 1 -- 172.21.15.70:0/1195241142 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562341ddc980 con 0x562341de5490 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341dda6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1d0f400700 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341def1f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009550 tx=0x7f1d00005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d4d54d10af76fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1cfbe00700 1 -- 172.21.15.70:0/1195241142 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000b33a0 con 0x562341de5490 2024-05-08T07:15:49.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1cfbe00700 1 -- 172.21.15.70:0/1195241142 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d000ae980 con 0x562341de5490 2024-05-08T07:15:49.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.251+0000 7f1cfbe00700 1 -- 172.21.15.70:0/1195241142 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d000aaa90 con 0x562341de5490 2024-05-08T07:15:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.252+0000 7f1d20f49b80 1 -- 172.21.15.70:0/1195241142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 msgr2=0x562341def1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.252+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341def1f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009550 tx=0x7f1d00005a00 comp rx=0 tx=0).stop 2024-05-08T07:15:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.252+0000 7f1d20f49b80 1 -- 172.21.15.70:0/1195241142 shutdown_connections 2024-05-08T07:15:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.252+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341dda6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.252+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5490 0x562341def1f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.252+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/1195241142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5e50 0x562341dfb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.252+0000 7f1d20f49b80 1 -- 172.21.15.70:0/1195241142 >> 172.21.15.70:0/1195241142 conn(0x562341d13c60 msgr2=0x562341dd9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.252+0000 7f1d20f49b80 1 -- 172.21.15.70:0/1195241142 shutdown_connections 2024-05-08T07:15:49.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.252+0000 7f1d20f49b80 1 -- 172.21.15.70:0/1195241142 wait complete. 2024-05-08T07:15:49.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.253+0000 7f1d20f49b80 1 -- start start 2024-05-08T07:15:49.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.253+0000 7f1d20f49b80 1 Processor -- start 2024-05-08T07:15:49.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 0x562341df77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d20f49b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341df4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d101afd90 con 0x562341de5e50 2024-05-08T07:15:49.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d101b1200 con 0x562341de5490 2024-05-08T07:15:49.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d20f49b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d101b0460 con 0x562341deaec0 2024-05-08T07:15:49.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d20f49b80 10 client.0 _ll_register_callbacks cb 0x562341cded70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:15:49.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45540/0 (socket says 172.21.15.70:45540) 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0ea00700 1 -- 172.21.15.70:0/3485784620 learned_addr learned my addr 172.21.15.70:0/3485784620 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0f400700 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 0x562341df77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341df4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0ea00700 1 -- 172.21.15.70:0/3485784620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 msgr2=0x562341df4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0ea00700 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341df4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0ea00700 1 -- 172.21.15.70:0/3485784620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 msgr2=0x562341df77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0ea00700 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 0x562341df77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0ea00700 1 -- 172.21.15.70:0/3485784620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562341df5600 con 0x562341de5e50 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.254+0000 7f1d0fe00700 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341df4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.255+0000 7f1d0ea00700 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df7d10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc005fd0 tx=0x7f1cfc010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd028d759127400 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.255+0000 7f1cf9600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:15:49.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.255+0000 7f1cf9600700 1 -- 172.21.15.70:0/3485784620 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc01c940 con 0x562341de5e50 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.255+0000 7f1cf9600700 1 -- 172.21.15.70:0/3485784620 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(137..137 src has 1..137) ==== 9583+0+0 (secure 0 0 0) 0x7f1cfc004020 con 0x562341de5e50 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.255+0000 7f1d20f49b80 1 -- 172.21.15.70:0/3485784620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d000ae980 con 0x562341de5e50 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.255+0000 7f1cf9600700 1 -- 172.21.15.70:0/3485784620 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1cfc02b050 con 0x562341de5e50 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.255+0000 7f1d20f49b80 10 client.16317 fetch_fsmap learned FSMap version 34 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.255+0000 7f1d20f49b80 1 -- 172.21.15.70:0/3485784620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562341e6b770 con 0x562341de5e50 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.256+0000 7f1cf9600700 1 -- 172.21.15.70:0/3485784620 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d000ae980 con 0x562341de5e50 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.256+0000 7f1cf9600700 1 -- 172.21.15.70:0/3485784620 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f1cfc005020 con 0x562341de5e50 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.256+0000 7f1d20f49b80 10 client.16317 fetch_fsmap finished waiting for FSMap version 34 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.256+0000 7f1d20f49b80 10 client.16317 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.256+0000 7f1d20f49b80 20 client.16317 populate_metadata read hostname 'smithi070' 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.256+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562341e6bf10 0x562341e6e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.256+0000 7f1d20f49b80 4 client.16317 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9aa0e4da", "release": true, "await": true}] 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.256+0000 7f1d20f49b80 1 -- 172.21.15.70:0/3485784620 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9aa0e4da", "release": true, "await": true}) -- 0x562341d45500 con 0x562341e6bf10 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.257+0000 7f1d0f400700 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562341e6bf10 0x562341e6e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:15:49.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.258+0000 7f1cf9600700 10 client.16317 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:15:49.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:49.258+0000 7f1d0f400700 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562341e6bf10 0x562341e6e300 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78e6a41ff8a99582 server_cookie=efa25473d6278d79 in_seq=0 out_seq=0 2024-05-08T07:15:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:50 smithi194 ceph-mon[33679]: pgmap v925: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 18 KiB/s wr, 128 op/s 2024-05-08T07:15:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:50 smithi070 ceph-mon[29591]: pgmap v925: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 18 KiB/s wr, 128 op/s 2024-05-08T07:15:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:50 smithi172 ceph-mon[33377]: pgmap v925: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 18 KiB/s wr, 128 op/s 2024-05-08T07:15:52.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.391+0000 7f1cf9600700 1 -- 172.21.15.70:0/3485784620 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562341d45500 con 0x562341e6bf10 2024-05-08T07:15:52.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.391+0000 7f1cf9600700 10 client.16317 handle_command_reply: tid=0 2024-05-08T07:15:52.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.391+0000 7f1d20f49b80 1 client.16317 shutdown 2024-05-08T07:15:52.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.392+0000 7f1d20f49b80 1 -- 172.21.15.70:0/3485784620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 msgr2=0x562341df7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:52.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.392+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df7d10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc005fd0 tx=0x7f1cfc010b30 comp rx=0 tx=0).stop 2024-05-08T07:15:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.392+0000 7f1d20f49b80 1 -- 172.21.15.70:0/3485784620 shutdown_connections 2024-05-08T07:15:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.392+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562341e6bf10 0x562341e6e300 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.392+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562341deaec0 0x562341df4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.392+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562341de5490 0x562341df77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.392+0000 7f1d20f49b80 1 --2- 172.21.15.70:0/3485784620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562341de5e50 0x562341df7d10 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:52.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.392+0000 7f1d20f49b80 1 -- 172.21.15.70:0/3485784620 >> 172.21.15.70:0/3485784620 conn(0x562341d13c60 msgr2=0x562341dda850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.392+0000 7f1cf9600700 0 client.16317 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:15:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.393+0000 7f1d20f49b80 1 -- 172.21.15.70:0/3485784620 shutdown_connections 2024-05-08T07:15:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.393+0000 7f1d20f49b80 1 -- 172.21.15.70:0/3485784620 wait complete. 2024-05-08T07:15:52.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.393+0000 7f1d20f49b80 20 client.16317 trim_cache size 0 max 16384 2024-05-08T07:15:52.393 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:15:52.393 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 34, 2024-05-08T07:15:52.393 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:15:52.393 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 76, 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "9aa0e4da": { 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 76, 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 75.0, 2024-05-08T07:15:52.394 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:15:52.395 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:15:52.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 -- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1cf40b29f0 msgr2=0x7f1cf40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:52.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1cf40b29f0 0x7f1cf40b4eb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1d08007b40 tx=0x7f1d08009ca0 comp rx=0 tx=0).stop 2024-05-08T07:15:52.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 -- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 msgr2=0x7f1d101a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:15:52.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 0x7f1d101a18c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f1d000057c0 tx=0x7f1d00009f90 comp rx=0 tx=0).stop 2024-05-08T07:15:52.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 -- 172.21.15.70:0/2727877722 shutdown_connections 2024-05-08T07:15:52.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1cf40b29f0 0x7f1cf40b4eb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:52.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1010ff00 0x7f1d1019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:52.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d100756d0 0x7f1d101a18c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:52.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 --2- 172.21.15.70:0/2727877722 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d10075ff0 0x7f1d101a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:15:52.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.395+0000 7f1d16600700 1 -- 172.21.15.70:0/2727877722 >> 172.21.15.70:0/2727877722 conn(0x7f1d1007a600 msgr2=0x7f1d10100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:15:52.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.396+0000 7f1d16600700 1 -- 172.21.15.70:0/2727877722 shutdown_connections 2024-05-08T07:15:52.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:15:52.396+0000 7f1d16600700 1 -- 172.21.15.70:0/2727877722 wait complete. 2024-05-08T07:15:52.981 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:52 smithi172 ceph-mon[33377]: pgmap v926: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 125 op/s 2024-05-08T07:15:53.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:52 smithi194 ceph-mon[33679]: pgmap v926: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 125 op/s 2024-05-08T07:15:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:52 smithi070 ceph-mon[29591]: pgmap v926: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 125 op/s 2024-05-08T07:15:53.258 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9aa0e4da', seconds elapsed: 51.6 2024-05-08T07:15:55.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:54 smithi194 ceph-mon[33679]: pgmap v927: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 125 op/s 2024-05-08T07:15:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:54 smithi070 ceph-mon[29591]: pgmap v927: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 125 op/s 2024-05-08T07:15:55.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:54 smithi172 ceph-mon[33377]: pgmap v927: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 125 op/s 2024-05-08T07:15:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:56 smithi194 ceph-mon[33679]: pgmap v928: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 201 KiB/s wr, 145 op/s 2024-05-08T07:15:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:15:57.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:56 smithi070 ceph-mon[29591]: pgmap v928: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 201 KiB/s wr, 145 op/s 2024-05-08T07:15:57.139 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:15:57.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:56 smithi172 ceph-mon[33377]: pgmap v928: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 201 KiB/s wr, 145 op/s 2024-05-08T07:15:57.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:15:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:15:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:15:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:15:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:15:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:15:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:15:58.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:15:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:15:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:15:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:15:59 smithi194 ceph-mon[33679]: pgmap v929: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 201 KiB/s wr, 142 op/s 2024-05-08T07:15:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:15:59 smithi070 ceph-mon[29591]: pgmap v929: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 201 KiB/s wr, 142 op/s 2024-05-08T07:15:59.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:15:59 smithi172 ceph-mon[33377]: pgmap v929: 129 pgs: 129 active+clean; 1.4 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 201 KiB/s wr, 142 op/s 2024-05-08T07:16:01.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:01 smithi194 ceph-mon[33679]: pgmap v930: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.1 MiB/s wr, 207 op/s 2024-05-08T07:16:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:01 smithi070 ceph-mon[29591]: pgmap v930: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.1 MiB/s wr, 207 op/s 2024-05-08T07:16:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:01 smithi172 ceph-mon[33377]: pgmap v930: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.1 MiB/s wr, 207 op/s 2024-05-08T07:16:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:03 smithi194 ceph-mon[33679]: pgmap v931: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 1.1 MiB/s wr, 84 op/s 2024-05-08T07:16:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:03 smithi070 ceph-mon[29591]: pgmap v931: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 1.1 MiB/s wr, 84 op/s 2024-05-08T07:16:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:03 smithi172 ceph-mon[33377]: pgmap v931: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 1.1 MiB/s wr, 84 op/s 2024-05-08T07:16:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:04 smithi194 ceph-mon[33679]: osdmap e138: 12 total, 12 up, 12 in 2024-05-08T07:16:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:04 smithi070 ceph-mon[29591]: osdmap e138: 12 total, 12 up, 12 in 2024-05-08T07:16:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:04 smithi172 ceph-mon[33377]: osdmap e138: 12 total, 12 up, 12 in 2024-05-08T07:16:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:05 smithi194 ceph-mon[33679]: pgmap v933: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-05-08T07:16:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:05 smithi070 ceph-mon[29591]: pgmap v933: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-05-08T07:16:05.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:05 smithi172 ceph-mon[33377]: pgmap v933: 129 pgs: 129 active+clean; 1.4 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-05-08T07:16:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:07 smithi194 ceph-mon[33679]: pgmap v934: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-08T07:16:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:07 smithi070 ceph-mon[29591]: pgmap v934: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-08T07:16:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:07 smithi172 ceph-mon[33377]: pgmap v934: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-08T07:16:08.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:08 smithi070 ceph-mon[29591]: pgmap v935: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-08T07:16:08.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:08 smithi070 ceph-mon[29591]: osdmap e139: 12 total, 12 up, 12 in 2024-05-08T07:16:09.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:08 smithi194 ceph-mon[33679]: pgmap v935: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-08T07:16:09.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:08 smithi194 ceph-mon[33679]: osdmap e139: 12 total, 12 up, 12 in 2024-05-08T07:16:09.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:08 smithi172 ceph-mon[33377]: pgmap v935: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 2.1 MiB/s wr, 340 op/s 2024-05-08T07:16:09.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:08 smithi172 ceph-mon[33377]: osdmap e139: 12 total, 12 up, 12 in 2024-05-08T07:16:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:10 smithi194 ceph-mon[33679]: pgmap v937: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 2.6 MiB/s wr, 505 op/s 2024-05-08T07:16:11.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:10 smithi070 ceph-mon[29591]: pgmap v937: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 2.6 MiB/s wr, 505 op/s 2024-05-08T07:16:11.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:10 smithi172 ceph-mon[33377]: pgmap v937: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 933 KiB/s rd, 2.6 MiB/s wr, 505 op/s 2024-05-08T07:16:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:12 smithi194 ceph-mon[33679]: pgmap v938: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 2.5 MiB/s wr, 484 op/s 2024-05-08T07:16:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:12 smithi070 ceph-mon[29591]: pgmap v938: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 2.5 MiB/s wr, 484 op/s 2024-05-08T07:16:13.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:12 smithi172 ceph-mon[33377]: pgmap v938: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 2.5 MiB/s wr, 484 op/s 2024-05-08T07:16:15.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:14 smithi194 ceph-mon[33679]: pgmap v939: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 2.0 MiB/s wr, 404 op/s 2024-05-08T07:16:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:14 smithi070 ceph-mon[29591]: pgmap v939: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 2.0 MiB/s wr, 404 op/s 2024-05-08T07:16:15.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:14 smithi172 ceph-mon[33377]: pgmap v939: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 2.0 MiB/s wr, 404 op/s 2024-05-08T07:16:17.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:16 smithi194 ceph-mon[33679]: pgmap v940: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 2.1 MiB/s wr, 349 op/s 2024-05-08T07:16:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:16 smithi070 ceph-mon[29591]: pgmap v940: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 2.1 MiB/s wr, 349 op/s 2024-05-08T07:16:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:16 smithi172 ceph-mon[33377]: pgmap v940: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 2.1 MiB/s wr, 349 op/s 2024-05-08T07:16:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:18 smithi194 ceph-mon[33679]: pgmap v941: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 2.1 MiB/s wr, 349 op/s 2024-05-08T07:16:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:18 smithi070 ceph-mon[29591]: pgmap v941: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 2.1 MiB/s wr, 349 op/s 2024-05-08T07:16:19.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:18 smithi172 ceph-mon[33377]: pgmap v941: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 2.1 MiB/s wr, 349 op/s 2024-05-08T07:16:20.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:20 smithi070 ceph-mon[29591]: pgmap v942: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 2.5 MiB/s wr, 450 op/s 2024-05-08T07:16:21.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:20 smithi194 ceph-mon[33679]: pgmap v942: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 2.5 MiB/s wr, 450 op/s 2024-05-08T07:16:21.115 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.2 2024-05-08T07:16:21.116 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:16:21.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:20 smithi172 ceph-mon[33377]: pgmap v942: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 2.5 MiB/s wr, 450 op/s 2024-05-08T07:16:21.608 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:16:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:22 smithi070 ceph-mon[29591]: pgmap v943: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.6 MiB/s wr, 327 op/s 2024-05-08T07:16:23.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:22 smithi172 ceph-mon[33377]: pgmap v943: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.6 MiB/s wr, 327 op/s 2024-05-08T07:16:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:22 smithi194 ceph-mon[33679]: pgmap v943: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.6 MiB/s wr, 327 op/s 2024-05-08T07:16:24.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.194+0000 7f78d8e00700 1 -- 172.21.15.70:0/3515055248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4104100 msgr2=0x7f78d4108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:24.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.194+0000 7f78d8e00700 1 --2- 172.21.15.70:0/3515055248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4104100 0x7f78d4108120 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f78c00099c0 tx=0x7f78c0009cd0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.195+0000 7f78d8e00700 1 -- 172.21.15.70:0/3515055248 shutdown_connections 2024-05-08T07:16:24.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.195+0000 7f78d8e00700 1 --2- 172.21.15.70:0/3515055248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4108850 0x7f78d41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.195+0000 7f78d8e00700 1 --2- 172.21.15.70:0/3515055248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d4103750 0x7f78d4103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.195+0000 7f78d8e00700 1 --2- 172.21.15.70:0/3515055248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4104100 0x7f78d4108120 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.195+0000 7f78d8e00700 1 -- 172.21.15.70:0/3515055248 >> 172.21.15.70:0/3515055248 conn(0x7f78d407a600 msgr2=0x7f78d407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.195+0000 7f78d8e00700 1 -- 172.21.15.70:0/3515055248 shutdown_connections 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.195+0000 7f78d8e00700 1 -- 172.21.15.70:0/3515055248 wait complete. 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.196+0000 7f78d8e00700 1 Processor -- start 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d8e00700 1 -- start start 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d8e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4103750 0x7f78d41a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d8e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d4104100 0x7f78d41a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4108850 0x7f78d419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d8e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78d4113530 con 0x7f78d4108850 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d8e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78d41133b0 con 0x7f78d4103750 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d8e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78d41136b0 con 0x7f78d4104100 2024-05-08T07:16:24.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4108850 0x7f78d419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4108850 0x7f78d419bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36564/0 (socket says 172.21.15.70:36564) 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.197+0000 7f78d2800700 1 -- 172.21.15.70:0/233425614 learned_addr learned my addr 172.21.15.70:0/233425614 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.198+0000 7f78d1400700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d4104100 0x7f78d41a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.198+0000 7f78d2800700 1 -- 172.21.15.70:0/233425614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d4104100 msgr2=0x7f78d41a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.198+0000 7f78d2800700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d4104100 0x7f78d41a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.198+0000 7f78d1e00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4103750 0x7f78d41a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.198+0000 7f78d2800700 1 -- 172.21.15.70:0/233425614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4103750 msgr2=0x7f78d41a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.198+0000 7f78d2800700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4103750 0x7f78d41a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.198+0000 7f78d2800700 1 -- 172.21.15.70:0/233425614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d419c210 con 0x7f78d4108850 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.198+0000 7f78d2800700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4108850 0x7f78d419bab0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f78cc007ee0 tx=0x7f78cc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.199+0000 7f78caa00700 1 -- 172.21.15.70:0/233425614 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc00dbd0 con 0x7f78d4108850 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.199+0000 7f78caa00700 1 -- 172.21.15.70:0/233425614 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78cc00dd70 con 0x7f78d4108850 2024-05-08T07:16:24.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.199+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d419c500 con 0x7f78d4108850 2024-05-08T07:16:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.199+0000 7f78caa00700 1 -- 172.21.15.70:0/233425614 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0058d0 con 0x7f78d4108850 2024-05-08T07:16:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.199+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d41a87c0 con 0x7f78d4108850 2024-05-08T07:16:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.200+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d406a190 con 0x7f78d4108850 2024-05-08T07:16:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.204+0000 7f78caa00700 1 -- 172.21.15.70:0/233425614 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f78cc01a020 con 0x7f78d4108850 2024-05-08T07:16:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.206+0000 7f78caa00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b80b29f0 0x7f78b80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.206+0000 7f78caa00700 1 -- 172.21.15.70:0/233425614 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 9583+0+0 (secure 0 0 0) 0x7f78cc0e2930 con 0x7f78d4108850 2024-05-08T07:16:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.206+0000 7f78d1e00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b80b29f0 0x7f78b80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.207+0000 7f78d1e00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b80b29f0 0x7f78b80b4eb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f78c4005950 tx=0x7f78c40058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:16:24.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.209+0000 7f78caa00700 1 -- 172.21.15.70:0/233425614 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f78cc010070 con 0x7f78d4108850 2024-05-08T07:16:24.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.559+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78d41a8990 con 0x7f78d4108850 2024-05-08T07:16:24.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.561+0000 7f78caa00700 1 -- 172.21.15.70:0/233425614 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11882 (secure 0 0 0) 0x7f78cc0a9e90 con 0x7f78d4108850 2024-05-08T07:16:24.561 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:16:24.562 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:15:08.402253+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:16:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b80b29f0 msgr2=0x7f78b80b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b80b29f0 0x7f78b80b4eb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f78c4005950 tx=0x7f78c40058e0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4108850 msgr2=0x7f78d419bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4108850 0x7f78d419bab0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f78cc007ee0 tx=0x7f78cc00d3b0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 shutdown_connections 2024-05-08T07:16:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b80b29f0 0x7f78b80b4eb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4108850 0x7f78d419bab0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4103750 0x7f78d41a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 --2- 172.21.15.70:0/233425614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d4104100 0x7f78d41a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:24.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 >> 172.21.15.70:0/233425614 conn(0x7f78d407a600 msgr2=0x7f78d4101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:16:24.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 shutdown_connections 2024-05-08T07:16:24.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:24.566+0000 7f78d8e00700 1 -- 172.21.15.70:0/233425614 wait complete. 2024-05-08T07:16:24.567 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-05-08T07:16:24.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:24 smithi070 ceph-mon[29591]: pgmap v944: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.6 MiB/s wr, 327 op/s 2024-05-08T07:16:24.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:24 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/233425614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:16:25.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:24 smithi172 ceph-mon[33377]: pgmap v944: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.6 MiB/s wr, 327 op/s 2024-05-08T07:16:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:24 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/233425614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:16:25.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:24 smithi194 ceph-mon[33679]: pgmap v944: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 1.6 MiB/s wr, 327 op/s 2024-05-08T07:16:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:24 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/233425614' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:16:25.453 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.2 --await-for 42.0' 2024-05-08T07:16:25.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.2 --await-for 42.0 2024-05-08T07:16:26.099 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:16:26.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:26 smithi070 ceph-mon[29591]: pgmap v945: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 2.3 MiB/s wr, 489 op/s 2024-05-08T07:16:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:26 smithi172 ceph-mon[33377]: pgmap v945: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 2.3 MiB/s wr, 489 op/s 2024-05-08T07:16:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:26 smithi194 ceph-mon[33679]: pgmap v945: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 2.3 MiB/s wr, 489 op/s 2024-05-08T07:16:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.867+0000 7f536f400700 1 -- 172.21.15.70:0/2451725245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536806b3e0 msgr2=0x7f536806b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.867+0000 7f536f400700 1 --2- 172.21.15.70:0/2451725245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536806b3e0 0x7f536806b7c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f535c0099c0 tx=0x7f535c009cd0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.867+0000 7f536f400700 1 -- 172.21.15.70:0/2451725245 shutdown_connections 2024-05-08T07:16:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.867+0000 7f536f400700 1 --2- 172.21.15.70:0/2451725245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5368108860 0x7f53681103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.867+0000 7f536f400700 1 --2- 172.21.15.70:0/2451725245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f536806b3e0 0x7f536806b7c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.867+0000 7f536f400700 1 --2- 172.21.15.70:0/2451725245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f536806bd90 0x7f5368108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.867+0000 7f536f400700 1 -- 172.21.15.70:0/2451725245 >> 172.21.15.70:0/2451725245 conn(0x7f5368079340 msgr2=0x7f5368079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:16:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.867+0000 7f536f400700 1 -- 172.21.15.70:0/2451725245 shutdown_connections 2024-05-08T07:16:28.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.867+0000 7f536f400700 1 -- 172.21.15.70:0/2451725245 wait complete. 2024-05-08T07:16:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.868+0000 7f536f400700 1 Processor -- start 2024-05-08T07:16:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.869+0000 7f536f400700 1 -- start start 2024-05-08T07:16:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.869+0000 7f536f400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536806bd90 0x7f536819be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.869+0000 7f536f400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5368108860 0x7f536819c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.869+0000 7f536f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53681a06f0 0x7f53681a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.869+0000 7f536f400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5368113550 con 0x7f53681a06f0 2024-05-08T07:16:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.869+0000 7f536f400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53681133d0 con 0x7f536806bd90 2024-05-08T07:16:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.869+0000 7f536f400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53681136d0 con 0x7f5368108860 2024-05-08T07:16:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.869+0000 7f536d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53681a06f0 0x7f53681a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.870+0000 7f536ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536806bd90 0x7f536819be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.870+0000 7f536d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53681a06f0 0x7f53681a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35102/0 (socket says 172.21.15.70:35102) 2024-05-08T07:16:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.870+0000 7f536d400700 1 -- 172.21.15.70:0/2990767242 learned_addr learned my addr 172.21.15.70:0/2990767242 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:16:28.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.870+0000 7f5367e00700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5368108860 0x7f536819c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.870+0000 7f536d400700 1 -- 172.21.15.70:0/2990767242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5368108860 msgr2=0x7f536819c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:28.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.870+0000 7f536d400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5368108860 0x7f536819c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.870+0000 7f536d400700 1 -- 172.21.15.70:0/2990767242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536806bd90 msgr2=0x7f536819be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:28.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.870+0000 7f536d400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536806bd90 0x7f536819be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.870+0000 7f536d400700 1 -- 172.21.15.70:0/2990767242 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53681a1210 con 0x7f53681a06f0 2024-05-08T07:16:28.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.871+0000 7f536d400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53681a06f0 0x7f53681a0b70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5360007ee0 tx=0x7f536000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:16:28.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.871+0000 7f5365600700 1 -- 172.21.15.70:0/2990767242 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536000dd20 con 0x7f53681a06f0 2024-05-08T07:16:28.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.871+0000 7f5365600700 1 -- 172.21.15.70:0/2990767242 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5360004020 con 0x7f53681a06f0 2024-05-08T07:16:28.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.871+0000 7f536f400700 1 -- 172.21.15.70:0/2990767242 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53681a1500 con 0x7f53681a06f0 2024-05-08T07:16:28.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.871+0000 7f5365600700 1 -- 172.21.15.70:0/2990767242 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360015660 con 0x7f53681a06f0 2024-05-08T07:16:28.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.871+0000 7f536f400700 1 -- 172.21.15.70:0/2990767242 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53681a8ce0 con 0x7f53681a06f0 2024-05-08T07:16:28.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.876+0000 7f5365600700 1 -- 172.21.15.70:0/2990767242 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f53600041d0 con 0x7f53681a06f0 2024-05-08T07:16:28.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.877+0000 7f5379e43b80 1 Processor -- start 2024-05-08T07:16:28.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.878+0000 7f5379e43b80 1 -- start start 2024-05-08T07:16:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.878+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb97f50 0x55bdcdb98330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.878+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdb929a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.878+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.878+0000 7f5379e43b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bdcdae4bb0 con 0x55bdcdb92ee0 2024-05-08T07:16:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.878+0000 7f5379e43b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bdcda828f0 con 0x55bdcdb92520 2024-05-08T07:16:28.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.878+0000 7f5379e43b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bdcdae0b70 con 0x55bdcdb97f50 2024-05-08T07:16:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.878+0000 7f5365600700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53500b2aa0 0x7f53500b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f536ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdb929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f536ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdb929a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:50400/0 (socket says 172.21.15.70:50400) 2024-05-08T07:16:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f536ca00700 1 -- 172.21.15.70:0/3353337579 learned_addr learned my addr 172.21.15.70:0/3353337579 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:16:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f5365600700 1 -- 172.21.15.70:0/2990767242 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 9583+0+0 (secure 0 0 0) 0x7f53600e2440 con 0x7f53681a06f0 2024-05-08T07:16:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f536d400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53500b2aa0 0x7f53500b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f5367e00700 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb97f50 0x55bdcdb98330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f5367e00700 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f536ca00700 1 -- 172.21.15.70:0/3353337579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb97f50 msgr2=0x55bdcdb98330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:16:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f536ca00700 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb97f50 0x55bdcdb98330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f536ca00700 1 -- 172.21.15.70:0/3353337579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 msgr2=0x55bdcdb9ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:16:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f536ca00700 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f536ca00700 1 -- 172.21.15.70:0/3353337579 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdcda31a60 con 0x55bdcdb92520 2024-05-08T07:16:28.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.879+0000 7f5367e00700 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:16:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.880+0000 7f536ca00700 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdb929a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f535c0058e0 tx=0x7f535c005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c307378f118794e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:16:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.880+0000 7f536d400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53500b2aa0 0x7f53500b4f60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5360004a20 tx=0x7f5360004830 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:16:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.880+0000 7f535a000700 1 -- 172.21.15.70:0/3353337579 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c027070 con 0x55bdcdb92520 2024-05-08T07:16:28.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.880+0000 7f535a000700 1 -- 172.21.15.70:0/3353337579 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f535c00b790 con 0x55bdcdb92520 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.880+0000 7f535a000700 1 -- 172.21.15.70:0/3353337579 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c0038a0 con 0x55bdcdb92520 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.881+0000 7f5379e43b80 1 -- 172.21.15.70:0/3353337579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 msgr2=0x55bdcdb929a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.881+0000 7f5379e43b80 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdb929a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f535c0058e0 tx=0x7f535c005c70 comp rx=0 tx=0).stop 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.881+0000 7f5379e43b80 1 -- 172.21.15.70:0/3353337579 shutdown_connections 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.881+0000 7f5379e43b80 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.881+0000 7f5379e43b80 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb97f50 0x55bdcdb98330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.881+0000 7f5379e43b80 1 --2- 172.21.15.70:0/3353337579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdb929a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.881+0000 7f5379e43b80 1 -- 172.21.15.70:0/3353337579 >> 172.21.15.70:0/3353337579 conn(0x55bdcdac0cf0 msgr2=0x55bdcdb8ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.882+0000 7f5379e43b80 1 -- 172.21.15.70:0/3353337579 shutdown_connections 2024-05-08T07:16:28.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.882+0000 7f5379e43b80 1 -- 172.21.15.70:0/3353337579 wait complete. 2024-05-08T07:16:28.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.882+0000 7f5379e43b80 1 -- start start 2024-05-08T07:16:28.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.882+0000 7f5379e43b80 1 Processor -- start 2024-05-08T07:16:28.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 0x55bdcdb9e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5379e43b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bdcdb9f250 con 0x55bdcdb97f50 2024-05-08T07:16:28.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5379e43b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bdcda4acb0 con 0x55bdcdb92ee0 2024-05-08T07:16:28.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5379e43b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bdcdb9f3d0 con 0x55bdcdb92520 2024-05-08T07:16:28.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5379e43b80 10 client.0 _ll_register_callbacks cb 0x55bdcda8be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:16:28.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5367e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5367e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35110/0 (socket says 172.21.15.70:35110) 2024-05-08T07:16:28.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5367e00700 1 -- 172.21.15.70:0/1603245548 learned_addr learned my addr 172.21.15.70:0/1603245548 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:16:28.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f5367e00700 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 0x55bdcdb9e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.883+0000 7f536ca00700 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.884+0000 7f5367e00700 1 -- 172.21.15.70:0/1603245548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 msgr2=0x55bdcdb9e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:16:28.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.884+0000 7f5367e00700 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 0x55bdcdb9e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.884+0000 7f5367e00700 1 -- 172.21.15.70:0/1603245548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92ee0 msgr2=0x55bdcdb9bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:16:28.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.884+0000 7f5367e00700 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.884+0000 7f5367e00700 1 -- 172.21.15.70:0/1603245548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdcdaaa5b0 con 0x55bdcdb97f50 2024-05-08T07:16:28.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.884+0000 7f536ca00700 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:16:28.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.884+0000 7f5367e00700 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9c1c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5354012a40 tx=0x7f53540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e062e91b7c9913 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:16:28.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.884+0000 7f534ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:16:28.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.885+0000 7f534ea00700 1 -- 172.21.15.70:0/1603245548 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53540108f0 con 0x55bdcdb97f50 2024-05-08T07:16:28.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.885+0000 7f5379e43b80 1 -- 172.21.15.70:0/1603245548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f535c00b790 con 0x55bdcdb97f50 2024-05-08T07:16:28.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.885+0000 7f534ea00700 1 -- 172.21.15.70:0/1603245548 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(139..139 src has 1..139) ==== 9583+0+0 (secure 0 0 0) 0x7f5354010a90 con 0x55bdcdb97f50 2024-05-08T07:16:28.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.885+0000 7f534ea00700 1 -- 172.21.15.70:0/1603245548 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5354010c90 con 0x55bdcdb97f50 2024-05-08T07:16:28.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.885+0000 7f5379e43b80 10 client.16332 fetch_fsmap learned FSMap version 34 2024-05-08T07:16:28.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.885+0000 7f5379e43b80 1 -- 172.21.15.70:0/1603245548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bdcdba9a30 con 0x55bdcdb97f50 2024-05-08T07:16:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.886+0000 7f534ea00700 1 -- 172.21.15.70:0/1603245548 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f535c00b790 con 0x55bdcdb97f50 2024-05-08T07:16:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.886+0000 7f534ea00700 1 -- 172.21.15.70:0/1603245548 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f5354005100 con 0x55bdcdb97f50 2024-05-08T07:16:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.886+0000 7f5379e43b80 10 client.16332 fetch_fsmap finished waiting for FSMap version 34 2024-05-08T07:16:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.886+0000 7f5379e43b80 10 client.16332 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:16:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.887+0000 7f5379e43b80 20 client.16332 populate_metadata read hostname 'smithi070' 2024-05-08T07:16:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.887+0000 7f5379e43b80 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdcdbabfc0 0x55bdcdbae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.887+0000 7f5379e43b80 4 client.16332 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:16:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.887+0000 7f5379e43b80 1 -- 172.21.15.70:0/1603245548 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdcdb5f230 con 0x55bdcdbabfc0 2024-05-08T07:16:28.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.887+0000 7f536ca00700 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdcdbabfc0 0x55bdcdbae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.888+0000 7f536ca00700 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdcdbabfc0 0x55bdcdbae3d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=389ed1d023471526 server_cookie=abbe90c1292b5825 in_seq=0 out_seq=0 2024-05-08T07:16:28.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.888+0000 7f534ea00700 10 client.16332 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:16:28.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f534ea00700 1 -- 172.21.15.70:0/1603245548 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bdcdb5f230 con 0x55bdcdbabfc0 2024-05-08T07:16:28.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f534ea00700 10 client.16332 handle_command_reply: tid=0 2024-05-08T07:16:28.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f5379e43b80 1 client.16332 shutdown 2024-05-08T07:16:28.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f5379e43b80 1 -- 172.21.15.70:0/1603245548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 msgr2=0x55bdcdb9c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:28.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f5379e43b80 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9c1c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5354012a40 tx=0x7f53540047c0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f5379e43b80 1 -- 172.21.15.70:0/1603245548 shutdown_connections 2024-05-08T07:16:28.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f5379e43b80 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdcdbabfc0 0x55bdcdbae3d0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f5379e43b80 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9c1c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f534ea00700 0 client.16332 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:16:28.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f5379e43b80 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 0x55bdcdb9e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f5379e43b80 1 --2- 172.21.15.70:0/1603245548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.892+0000 7f5379e43b80 1 -- 172.21.15.70:0/1603245548 >> 172.21.15.70:0/1603245548 conn(0x55bdcdac0cf0 msgr2=0x55bdcdb878e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:16:28.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.893+0000 7f5379e43b80 1 -- 172.21.15.70:0/1603245548 shutdown_connections 2024-05-08T07:16:28.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.893+0000 7f5379e43b80 1 -- 172.21.15.70:0/1603245548 wait complete. 2024-05-08T07:16:28.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.893+0000 7f5379e43b80 20 client.16332 trim_cache size 0 max 16384 2024-05-08T07:16:28.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.920+0000 7f5379e43b80 1 Processor -- start 2024-05-08T07:16:28.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.920+0000 7f5379e43b80 1 -- start start 2024-05-08T07:16:28.919 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:28 smithi070 ceph-mon[29591]: pgmap v946: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.4 MiB/s wr, 316 op/s 2024-05-08T07:16:28.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.920+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdba82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.920+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.920+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.920+0000 7f5379e43b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53681b4700 con 0x55bdcdb97f50 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.920+0000 7f5379e43b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53681b1f30 con 0x55bdcdb92520 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.920+0000 7f5379e43b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53681afda0 con 0x55bdcdb92ee0 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.921+0000 7f5367e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.921+0000 7f5367e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35126/0 (socket says 172.21.15.70:35126) 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.921+0000 7f5367e00700 1 -- 172.21.15.70:0/2884246563 learned_addr learned my addr 172.21.15.70:0/2884246563 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.921+0000 7f5367e00700 1 --2- 172.21.15.70:0/2884246563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdba82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.921+0000 7f5367e00700 1 -- 172.21.15.70:0/2884246563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92ee0 msgr2=0x55bdcdb9abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.921+0000 7f5367e00700 1 --2- 172.21.15.70:0/2884246563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.921+0000 7f5367e00700 1 -- 172.21.15.70:0/2884246563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 msgr2=0x55bdcdba82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.921+0000 7f5367e00700 1 --2- 172.21.15.70:0/2884246563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdba82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.921+0000 7f5367e00700 1 -- 172.21.15.70:0/2884246563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdcdb854e0 con 0x55bdcdb97f50 2024-05-08T07:16:28.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.922+0000 7f5367e00700 1 --2- 172.21.15.70:0/2884246563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9da40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5354000c00 tx=0x7f535400b3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e7e62a4dd203d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:16:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.922+0000 7f5359600700 1 -- 172.21.15.70:0/2884246563 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535400bcd0 con 0x55bdcdb97f50 2024-05-08T07:16:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.922+0000 7f5359600700 1 -- 172.21.15.70:0/2884246563 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53540044c0 con 0x55bdcdb97f50 2024-05-08T07:16:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.922+0000 7f5359600700 1 -- 172.21.15.70:0/2884246563 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354003680 con 0x55bdcdb97f50 2024-05-08T07:16:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.923+0000 7f5379e43b80 1 -- 172.21.15.70:0/2884246563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 msgr2=0x55bdcdb9da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:28.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.923+0000 7f5379e43b80 1 --2- 172.21.15.70:0/2884246563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9da40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5354000c00 tx=0x7f535400b3c0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.924+0000 7f5379e43b80 1 -- 172.21.15.70:0/2884246563 shutdown_connections 2024-05-08T07:16:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.924+0000 7f5379e43b80 1 --2- 172.21.15.70:0/2884246563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9da40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.924+0000 7f5379e43b80 1 --2- 172.21.15.70:0/2884246563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb92520 0x55bdcdba82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.924+0000 7f5379e43b80 1 --2- 172.21.15.70:0/2884246563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92ee0 0x55bdcdb9abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.924+0000 7f5379e43b80 1 -- 172.21.15.70:0/2884246563 >> 172.21.15.70:0/2884246563 conn(0x55bdcdac0cf0 msgr2=0x55bdcdb9d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:16:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.924+0000 7f5379e43b80 1 -- 172.21.15.70:0/2884246563 shutdown_connections 2024-05-08T07:16:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.924+0000 7f5379e43b80 1 -- 172.21.15.70:0/2884246563 wait complete. 2024-05-08T07:16:28.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.924+0000 7f5379e43b80 1 -- start start 2024-05-08T07:16:28.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.925+0000 7f5379e43b80 1 Processor -- start 2024-05-08T07:16:28.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.925+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 0x55bdcdba4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.925+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdba4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.925+0000 7f5379e43b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.925+0000 7f5379e43b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53681b03f0 con 0x55bdcdb92ee0 2024-05-08T07:16:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.925+0000 7f5379e43b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53681b1860 con 0x55bdcdb97f50 2024-05-08T07:16:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.925+0000 7f5379e43b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53681b0ac0 con 0x55bdcdb92520 2024-05-08T07:16:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.925+0000 7f5379e43b80 10 client.0 _ll_register_callbacks cb 0x55bdcda8be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:16:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.926+0000 7f536ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdba4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.926+0000 7f5367e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.926+0000 7f536ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdba4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35128/0 (socket says 172.21.15.70:35128) 2024-05-08T07:16:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.926+0000 7f536ca00700 1 -- 172.21.15.70:0/507439537 learned_addr learned my addr 172.21.15.70:0/507439537 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:16:28.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.926+0000 7f5367e00700 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 0x55bdcdba4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.927+0000 7f536ca00700 1 -- 172.21.15.70:0/507439537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 msgr2=0x55bdcdba4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:16:28.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.927+0000 7f536ca00700 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 0x55bdcdba4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.927+0000 7f536ca00700 1 -- 172.21.15.70:0/507439537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb97f50 msgr2=0x55bdcdb9f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:16:28.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.927+0000 7f536ca00700 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:28.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.927+0000 7f536ca00700 1 -- 172.21.15.70:0/507439537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdcdb9fe20 con 0x55bdcdb92ee0 2024-05-08T07:16:28.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.927+0000 7f536ca00700 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdba4b70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f535c009fd0 tx=0x7f535c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacc10df6ba20be7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:16:28.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.927+0000 7f534ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:16:28.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.928+0000 7f534ea00700 1 -- 172.21.15.70:0/507439537 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c027040 con 0x55bdcdb92ee0 2024-05-08T07:16:28.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.928+0000 7f5379e43b80 1 -- 172.21.15.70:0/507439537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53540044c0 con 0x55bdcdb92ee0 2024-05-08T07:16:28.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.928+0000 7f534ea00700 1 -- 172.21.15.70:0/507439537 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(139..139 src has 1..139) ==== 9583+0+0 (secure 0 0 0) 0x7f535c00b790 con 0x55bdcdb92ee0 2024-05-08T07:16:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.928+0000 7f534ea00700 1 -- 172.21.15.70:0/507439537 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f535c005690 con 0x55bdcdb92ee0 2024-05-08T07:16:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.928+0000 7f5379e43b80 10 client.16338 fetch_fsmap learned FSMap version 34 2024-05-08T07:16:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.928+0000 7f5379e43b80 1 -- 172.21.15.70:0/507439537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55bdcdc1fb20 con 0x55bdcdb92ee0 2024-05-08T07:16:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.928+0000 7f534ea00700 1 -- 172.21.15.70:0/507439537 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53540044c0 con 0x55bdcdb92ee0 2024-05-08T07:16:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.929+0000 7f534ea00700 1 -- 172.21.15.70:0/507439537 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f535c021030 con 0x55bdcdb92ee0 2024-05-08T07:16:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.929+0000 7f5379e43b80 10 client.16338 fetch_fsmap finished waiting for FSMap version 34 2024-05-08T07:16:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.929+0000 7f5379e43b80 10 client.16338 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:16:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.929+0000 7f5379e43b80 20 client.16338 populate_metadata read hostname 'smithi070' 2024-05-08T07:16:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.929+0000 7f5379e43b80 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdcdc1fe50 0x55bdcdc22240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:16:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.929+0000 7f5379e43b80 4 client.16338 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.2, "await_for": 42.0}] 2024-05-08T07:16:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.929+0000 7f5379e43b80 1 -- 172.21.15.70:0/507439537 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.2, "await_for": 42.0}) -- 0x55bdcdaf2590 con 0x55bdcdc1fe50 2024-05-08T07:16:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.929+0000 7f5367e00700 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdcdc1fe50 0x55bdcdc22240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:16:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.930+0000 7f5367e00700 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdcdc1fe50 0x55bdcdc22240 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98f4eb578b3c363b server_cookie=3c6571ee5ea0bbb1 in_seq=0 out_seq=0 2024-05-08T07:16:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:28.930+0000 7f534ea00700 10 client.16338 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:16:29.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:28 smithi172 ceph-mon[33377]: pgmap v946: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.4 MiB/s wr, 316 op/s 2024-05-08T07:16:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:28 smithi194 ceph-mon[33679]: pgmap v946: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 1.4 MiB/s wr, 316 op/s 2024-05-08T07:16:31.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:30 smithi070 ceph-mon[29591]: pgmap v947: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 1.9 MiB/s wr, 500 op/s 2024-05-08T07:16:31.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:30 smithi172 ceph-mon[33377]: pgmap v947: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 1.9 MiB/s wr, 500 op/s 2024-05-08T07:16:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:30 smithi194 ceph-mon[33679]: pgmap v947: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 1.9 MiB/s wr, 500 op/s 2024-05-08T07:16:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:32 smithi070 ceph-mon[29591]: pgmap v948: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.1 MiB/s wr, 346 op/s 2024-05-08T07:16:33.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:32 smithi172 ceph-mon[33377]: pgmap v948: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.1 MiB/s wr, 346 op/s 2024-05-08T07:16:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:32 smithi194 ceph-mon[33679]: pgmap v948: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.1 MiB/s wr, 346 op/s 2024-05-08T07:16:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:34 smithi070 ceph-mon[29591]: pgmap v949: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.1 MiB/s wr, 346 op/s 2024-05-08T07:16:35.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:34 smithi172 ceph-mon[33377]: pgmap v949: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.1 MiB/s wr, 346 op/s 2024-05-08T07:16:35.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:34 smithi194 ceph-mon[33679]: pgmap v949: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 1.1 MiB/s wr, 346 op/s 2024-05-08T07:16:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:36 smithi070 ceph-mon[29591]: pgmap v950: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.1 MiB/s wr, 350 op/s 2024-05-08T07:16:37.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:36 smithi172 ceph-mon[33377]: pgmap v950: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.1 MiB/s wr, 350 op/s 2024-05-08T07:16:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:36 smithi194 ceph-mon[33679]: pgmap v950: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 1.1 MiB/s wr, 350 op/s 2024-05-08T07:16:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:38 smithi070 ceph-mon[29591]: pgmap v951: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 506 KiB/s wr, 188 op/s 2024-05-08T07:16:39.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:38 smithi172 ceph-mon[33377]: pgmap v951: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 506 KiB/s wr, 188 op/s 2024-05-08T07:16:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:38 smithi194 ceph-mon[33679]: pgmap v951: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 506 KiB/s wr, 188 op/s 2024-05-08T07:16:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:40 smithi070 ceph-mon[29591]: pgmap v952: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 540 KiB/s wr, 246 op/s 2024-05-08T07:16:41.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:40 smithi172 ceph-mon[33377]: pgmap v952: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 540 KiB/s wr, 246 op/s 2024-05-08T07:16:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:40 smithi194 ceph-mon[33679]: pgmap v952: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 540 KiB/s wr, 246 op/s 2024-05-08T07:16:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:42 smithi070 ceph-mon[29591]: pgmap v953: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 38 KiB/s wr, 62 op/s 2024-05-08T07:16:43.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:42 smithi172 ceph-mon[33377]: pgmap v953: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 38 KiB/s wr, 62 op/s 2024-05-08T07:16:43.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:42 smithi194 ceph-mon[33679]: pgmap v953: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 38 KiB/s wr, 62 op/s 2024-05-08T07:16:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:44 smithi070 ceph-mon[29591]: pgmap v954: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 38 KiB/s wr, 62 op/s 2024-05-08T07:16:45.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:44 smithi172 ceph-mon[33377]: pgmap v954: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 38 KiB/s wr, 62 op/s 2024-05-08T07:16:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:44 smithi194 ceph-mon[33679]: pgmap v954: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 38 KiB/s wr, 62 op/s 2024-05-08T07:16:46.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.298+0000 7f534ea00700 1 -- 172.21.15.70:0/507439537 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55bdcdaf2590 con 0x55bdcdc1fe50 2024-05-08T07:16:46.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.298+0000 7f534ea00700 10 client.16338 handle_command_reply: tid=0 2024-05-08T07:16:46.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.298+0000 7f5379e43b80 1 client.16338 shutdown 2024-05-08T07:16:46.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 -- 172.21.15.70:0/507439537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 msgr2=0x55bdcdba4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:46.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdba4b70 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f535c009fd0 tx=0x7f535c009810 comp rx=0 tx=0).stop 2024-05-08T07:16:46.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 -- 172.21.15.70:0/507439537 shutdown_connections 2024-05-08T07:16:46.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdcdc1fe50 0x55bdcdc22240 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdcdb97f50 0x55bdcdb9f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdcdb92520 0x55bdcdba4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 --2- 172.21.15.70:0/507439537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdcdb92ee0 0x55bdcdba4b70 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f534ea00700 0 client.16338 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:16:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 -- 172.21.15.70:0/507439537 >> 172.21.15.70:0/507439537 conn(0x55bdcdac0cf0 msgr2=0x55bdcdb91da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:16:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 -- 172.21.15.70:0/507439537 shutdown_connections 2024-05-08T07:16:46.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.299+0000 7f5379e43b80 1 -- 172.21.15.70:0/507439537 wait complete. 2024-05-08T07:16:46.300 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 34, 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 78, 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "b4cad037": { 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 78, 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.2, 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:16:46.301 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:16:46.302 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:16:46.302 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:16:46.302 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:16:46.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:16:46.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:16:46.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:16:46.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:16:46.302 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:16:46.302 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.300+0000 7f5379e43b80 20 client.16338 trim_cache size 0 max 16384 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 -- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53500b2aa0 msgr2=0x7f53500b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53500b2aa0 0x7f53500b4f60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5360004a20 tx=0x7f5360004830 comp rx=0 tx=0).stop 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 -- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53681a06f0 msgr2=0x7f53681a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53681a06f0 0x7f53681a0b70 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5360007ee0 tx=0x7f536000d3b0 comp rx=0 tx=0).stop 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 -- 172.21.15.70:0/2990767242 shutdown_connections 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53500b2aa0 0x7f53500b4f60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f53681a06f0 0x7f53681a0b70 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f536806bd90 0x7f536819be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:46.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 --2- 172.21.15.70:0/2990767242 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5368108860 0x7f536819c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:16:46.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 -- 172.21.15.70:0/2990767242 >> 172.21.15.70:0/2990767242 conn(0x7f5368079340 msgr2=0x7f536810e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:16:46.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 -- 172.21.15.70:0/2990767242 shutdown_connections 2024-05-08T07:16:46.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:16:46.301+0000 7f536f400700 1 -- 172.21.15.70:0/2990767242 wait complete. 2024-05-08T07:16:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:46 smithi070 ceph-mon[29591]: pgmap v955: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 79 KiB/s wr, 82 op/s 2024-05-08T07:16:47.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:46 smithi172 ceph-mon[33377]: pgmap v955: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 79 KiB/s wr, 82 op/s 2024-05-08T07:16:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:46 smithi194 ceph-mon[33679]: pgmap v955: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 79 KiB/s wr, 82 op/s 2024-05-08T07:16:47.405 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b4cad037', quiesce took 26.3 seconds. Will release after: 19.2 2024-05-08T07:16:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:48 smithi070 ceph-mon[29591]: pgmap v956: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 75 KiB/s wr, 78 op/s 2024-05-08T07:16:49.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:48 smithi172 ceph-mon[33377]: pgmap v956: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 75 KiB/s wr, 78 op/s 2024-05-08T07:16:49.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:48 smithi194 ceph-mon[33679]: pgmap v956: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 75 KiB/s wr, 78 op/s 2024-05-08T07:16:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:50 smithi070 ceph-mon[29591]: pgmap v957: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 185 KiB/s wr, 125 op/s 2024-05-08T07:16:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:50 smithi172 ceph-mon[33377]: pgmap v957: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 185 KiB/s wr, 125 op/s 2024-05-08T07:16:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:50 smithi194 ceph-mon[33679]: pgmap v957: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 185 KiB/s wr, 125 op/s 2024-05-08T07:16:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:52 smithi070 ceph-mon[29591]: pgmap v958: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 151 KiB/s wr, 67 op/s 2024-05-08T07:16:53.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:52 smithi172 ceph-mon[33377]: pgmap v958: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 151 KiB/s wr, 67 op/s 2024-05-08T07:16:53.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:52 smithi194 ceph-mon[33679]: pgmap v958: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 151 KiB/s wr, 67 op/s 2024-05-08T07:16:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:54 smithi070 ceph-mon[29591]: pgmap v959: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 151 KiB/s wr, 67 op/s 2024-05-08T07:16:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:54 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:16:55.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:54 smithi172 ceph-mon[33377]: pgmap v959: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 151 KiB/s wr, 67 op/s 2024-05-08T07:16:55.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:54 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:16:55.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:54 smithi194 ceph-mon[33679]: pgmap v959: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 151 KiB/s wr, 67 op/s 2024-05-08T07:16:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:54 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:16:57.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:56 smithi172 ceph-mon[33377]: pgmap v960: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 161 KiB/s wr, 70 op/s 2024-05-08T07:16:57.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:56 smithi194 ceph-mon[33679]: pgmap v960: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 161 KiB/s wr, 70 op/s 2024-05-08T07:16:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:56 smithi070 ceph-mon[29591]: pgmap v960: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 161 KiB/s wr, 70 op/s 2024-05-08T07:16:58.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:16:58.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:16:58.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:16:59.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:16:58 smithi172 ceph-mon[33377]: pgmap v961: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 120 KiB/s wr, 49 op/s 2024-05-08T07:16:59.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:16:58 smithi194 ceph-mon[33679]: pgmap v961: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 120 KiB/s wr, 49 op/s 2024-05-08T07:16:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:16:58 smithi070 ceph-mon[29591]: pgmap v961: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 120 KiB/s wr, 49 op/s 2024-05-08T07:17:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: pgmap v962: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 125 KiB/s wr, 52 op/s 2024-05-08T07:17:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:17:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:17:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: pgmap v962: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 125 KiB/s wr, 52 op/s 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:17:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: pgmap v962: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 125 KiB/s wr, 52 op/s 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:17:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:17:03.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:02 smithi194 ceph-mon[33679]: pgmap v963: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 5 op/s 2024-05-08T07:17:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:02 smithi070 ceph-mon[29591]: pgmap v963: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 5 op/s 2024-05-08T07:17:03.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:02 smithi172 ceph-mon[33377]: pgmap v963: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 5 op/s 2024-05-08T07:17:05.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:04 smithi194 ceph-mon[33679]: pgmap v964: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 5 op/s 2024-05-08T07:17:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:04 smithi070 ceph-mon[29591]: pgmap v964: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 5 op/s 2024-05-08T07:17:05.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:04 smithi172 ceph-mon[33377]: pgmap v964: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 5 op/s 2024-05-08T07:17:06.606 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:17:07.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:06 smithi194 ceph-mon[33679]: pgmap v965: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 66 KiB/s wr, 25 op/s 2024-05-08T07:17:07.054 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:17:07.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:06 smithi070 ceph-mon[29591]: pgmap v965: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 66 KiB/s wr, 25 op/s 2024-05-08T07:17:07.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:06 smithi172 ceph-mon[33377]: pgmap v965: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 66 KiB/s wr, 25 op/s 2024-05-08T07:17:09.068 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:08 smithi070 ceph-mon[29591]: pgmap v966: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-05-08T07:17:09.068 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:08 smithi070 ceph-mon[29591]: osdmap e140: 12 total, 12 up, 12 in 2024-05-08T07:17:09.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:08 smithi172 ceph-mon[33377]: pgmap v966: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-05-08T07:17:09.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:08 smithi172 ceph-mon[33377]: osdmap e140: 12 total, 12 up, 12 in 2024-05-08T07:17:09.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:08 smithi194 ceph-mon[33679]: pgmap v966: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-05-08T07:17:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:08 smithi194 ceph-mon[33679]: osdmap e140: 12 total, 12 up, 12 in 2024-05-08T07:17:09.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.399+0000 7f9b33c00700 1 -- 172.21.15.70:0/2265289787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10fb60 msgr2=0x7f9b2c10ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.399+0000 7f9b33c00700 1 --2- 172.21.15.70:0/2265289787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10fb60 0x7f9b2c10ff40 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009990 tx=0x7f9b20009ca0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.399+0000 7f9b33c00700 1 -- 172.21.15.70:0/2265289787 shutdown_connections 2024-05-08T07:17:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.399+0000 7f9b33c00700 1 --2- 172.21.15.70:0/2265289787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2c10a490 0x7f9b2c1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.399+0000 7f9b33c00700 1 --2- 172.21.15.70:0/2265289787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10fb60 0x7f9b2c10ff40 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.399+0000 7f9b33c00700 1 --2- 172.21.15.70:0/2265289787 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2c109ad0 0x7f9b2c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.399+0000 7f9b33c00700 1 -- 172.21.15.70:0/2265289787 >> 172.21.15.70:0/2265289787 conn(0x7f9b2c076c70 msgr2=0x7f9b2c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.399+0000 7f9b33c00700 1 -- 172.21.15.70:0/2265289787 shutdown_connections 2024-05-08T07:17:09.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.399+0000 7f9b33c00700 1 -- 172.21.15.70:0/2265289787 wait complete. 2024-05-08T07:17:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.400+0000 7f9b33c00700 1 Processor -- start 2024-05-08T07:17:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.400+0000 7f9b33c00700 1 -- start start 2024-05-08T07:17:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b33c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2c109ad0 0x7f9b2c1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b33c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10a490 0x7f9b2c1a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b33c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2c10fb60 0x7f9b2c1a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b33c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c119c20 con 0x7f9b2c10a490 2024-05-08T07:17:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b33c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c119aa0 con 0x7f9b2c109ad0 2024-05-08T07:17:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b33c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9b2c119da0 con 0x7f9b2c10fb60 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b2be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10a490 0x7f9b2c1a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b2be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10a490 0x7f9b2c1a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40916/0 (socket says 172.21.15.70:40916) 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b2be00700 1 -- 172.21.15.70:0/3994410956 learned_addr learned my addr 172.21.15.70:0/3994410956 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b31200700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2c109ad0 0x7f9b2c1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.401+0000 7f9b31c00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2c10fb60 0x7f9b2c1a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b2be00700 1 -- 172.21.15.70:0/3994410956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2c10fb60 msgr2=0x7f9b2c1a4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b2be00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2c10fb60 0x7f9b2c1a4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b2be00700 1 -- 172.21.15.70:0/3994410956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2c109ad0 msgr2=0x7f9b2c1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b2be00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2c109ad0 0x7f9b2c1a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b2be00700 1 -- 172.21.15.70:0/3994410956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c1a5280 con 0x7f9b2c10a490 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b31c00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2c10fb60 0x7f9b2c1a4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:17:09.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b2be00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10a490 0x7f9b2c1a07b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800b530 tx=0x7f9b1800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:09.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b29600700 1 -- 172.21.15.70:0/3994410956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18015020 con 0x7f9b2c10a490 2024-05-08T07:17:09.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b29600700 1 -- 172.21.15.70:0/3994410956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b18011cc0 con 0x7f9b2c10a490 2024-05-08T07:17:09.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2c1a5570 con 0x7f9b2c10a490 2024-05-08T07:17:09.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b29600700 1 -- 172.21.15.70:0/3994410956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b18010d30 con 0x7f9b2c10a490 2024-05-08T07:17:09.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.402+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b2c1acdf0 con 0x7f9b2c10a490 2024-05-08T07:17:09.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.404+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2c06a190 con 0x7f9b2c10a490 2024-05-08T07:17:09.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.408+0000 7f9b29600700 1 -- 172.21.15.70:0/3994410956 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9b18018020 con 0x7f9b2c10a490 2024-05-08T07:17:09.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.409+0000 7f9b29600700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b140b2a70 0x7f9b140b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:09.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.409+0000 7f9b29600700 1 -- 172.21.15.70:0/3994410956 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 9671+0+0 (secure 0 0 0) 0x7f9b180e2780 con 0x7f9b2c10a490 2024-05-08T07:17:09.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.409+0000 7f9b31200700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b140b2a70 0x7f9b140b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:09.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.410+0000 7f9b31200700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b140b2a70 0x7f9b140b4f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000b5c0 tx=0x7f9b2001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:09.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.412+0000 7f9b29600700 1 -- 172.21.15.70:0/3994410956 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9b1801f020 con 0x7f9b2c10a490 2024-05-08T07:17:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.701+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b2c02e510 con 0x7f9b2c10a490 2024-05-08T07:17:09.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.702+0000 7f9b29600700 1 -- 172.21.15.70:0/3994410956 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11879 (secure 0 0 0) 0x7f9b180a9d90 con 0x7f9b2c10a490 2024-05-08T07:17:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:17:09.701 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:17:08.396412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:17:09.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b140b2a70 msgr2=0x7f9b140b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b140b2a70 0x7f9b140b4f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000b5c0 tx=0x7f9b2001a040 comp rx=0 tx=0).stop 2024-05-08T07:17:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10a490 msgr2=0x7f9b2c1a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10a490 0x7f9b2c1a07b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9b1800b530 tx=0x7f9b1800b8f0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 shutdown_connections 2024-05-08T07:17:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b140b2a70 0x7f9b140b4f30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2c10fb60 0x7f9b2c1a4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b2c109ad0 0x7f9b2c1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 --2- 172.21.15.70:0/3994410956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2c10a490 0x7f9b2c1a07b0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 >> 172.21.15.70:0/3994410956 conn(0x7f9b2c076c70 msgr2=0x7f9b2c0773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:09.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 shutdown_connections 2024-05-08T07:17:09.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:09.706+0000 7f9b33c00700 1 -- 172.21.15.70:0/3994410956 wait complete. 2024-05-08T07:17:09.706 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 36 2024-05-08T07:17:10.080 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:09 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:17:10.081 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3994410956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:17:10.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:09 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:17:10.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3994410956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:17:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:09 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:17:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3994410956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:17:10.553 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id b4cad037 --release --await' 2024-05-08T07:17:10.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id b4cad037 --release --await 2024-05-08T07:17:10.984 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:17:11.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:10 smithi070 ceph-mon[29591]: pgmap v968: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 61 KiB/s wr, 26 op/s 2024-05-08T07:17:11.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:10 smithi172 ceph-mon[33377]: pgmap v968: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 61 KiB/s wr, 26 op/s 2024-05-08T07:17:11.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:10 smithi194 ceph-mon[33679]: pgmap v968: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 61 KiB/s wr, 26 op/s 2024-05-08T07:17:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:12 smithi070 ceph-mon[29591]: pgmap v969: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 61 KiB/s wr, 26 op/s 2024-05-08T07:17:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:12 smithi070 ceph-mon[29591]: osdmap e141: 12 total, 12 up, 12 in 2024-05-08T07:17:13.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:12 smithi172 ceph-mon[33377]: pgmap v969: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 61 KiB/s wr, 26 op/s 2024-05-08T07:17:13.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:12 smithi172 ceph-mon[33377]: osdmap e141: 12 total, 12 up, 12 in 2024-05-08T07:17:13.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:12 smithi194 ceph-mon[33679]: pgmap v969: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 61 KiB/s wr, 26 op/s 2024-05-08T07:17:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:12 smithi194 ceph-mon[33679]: osdmap e141: 12 total, 12 up, 12 in 2024-05-08T07:17:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.261+0000 7fa465600700 1 -- 172.21.15.70:0/3096796620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103610 msgr2=0x7fa4601039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.261+0000 7fa465600700 1 --2- 172.21.15.70:0/3096796620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103610 0x7fa4601039f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fa4500099c0 tx=0x7fa450009cd0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.261+0000 7fa465600700 1 -- 172.21.15.70:0/3096796620 shutdown_connections 2024-05-08T07:17:13.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.261+0000 7fa465600700 1 --2- 172.21.15.70:0/3096796620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4601086f0 0x7fa4601102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.261+0000 7fa465600700 1 --2- 172.21.15.70:0/3096796620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103610 0x7fa4601039f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.261+0000 7fa465600700 1 --2- 172.21.15.70:0/3096796620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa460103fc0 0x7fa460108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.261+0000 7fa465600700 1 -- 172.21.15.70:0/3096796620 >> 172.21.15.70:0/3096796620 conn(0x7fa4600fee80 msgr2=0x7fa4601012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:13.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.261+0000 7fa465600700 1 -- 172.21.15.70:0/3096796620 shutdown_connections 2024-05-08T07:17:13.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.261+0000 7fa465600700 1 -- 172.21.15.70:0/3096796620 wait complete. 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.262+0000 7fa465600700 1 Processor -- start 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.262+0000 7fa465600700 1 -- start start 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa465600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa460103610 0x7fa46019f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa465600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103fc0 0x7fa46019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa465600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4601086f0 0x7fa460199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa465600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa460113480 con 0x7fa460103fc0 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa465600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa460113300 con 0x7fa460103610 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa465600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa460113600 con 0x7fa4601086f0 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa45f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103fc0 0x7fa46019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa45f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103fc0 0x7fa46019fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40942/0 (socket says 172.21.15.70:40942) 2024-05-08T07:17:13.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa45f400700 1 -- 172.21.15.70:0/1156103468 learned_addr learned my addr 172.21.15.70:0/1156103468 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa464c00700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4601086f0 0x7fa460199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.263+0000 7fa45fe00700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa460103610 0x7fa46019f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa45f400700 1 -- 172.21.15.70:0/1156103468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4601086f0 msgr2=0x7fa460199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa45f400700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4601086f0 0x7fa460199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa45f400700 1 -- 172.21.15.70:0/1156103468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa460103610 msgr2=0x7fa46019f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa45f400700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa460103610 0x7fa46019f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa45f400700 1 -- 172.21.15.70:0/1156103468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa46019a000 con 0x7fa460103fc0 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa45f400700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103fc0 0x7fa46019fb40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00c9e0 tx=0x7fa44c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa45cc00700 1 -- 172.21.15.70:0/1156103468 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c007aa0 con 0x7fa460103fc0 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa45cc00700 1 -- 172.21.15.70:0/1156103468 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa44c007c40 con 0x7fa460103fc0 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa45cc00700 1 -- 172.21.15.70:0/1156103468 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44c018660 con 0x7fa460103fc0 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.264+0000 7fa465600700 1 -- 172.21.15.70:0/1156103468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46019a2f0 con 0x7fa460103fc0 2024-05-08T07:17:13.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.265+0000 7fa465600700 1 -- 172.21.15.70:0/1156103468 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4601a6580 con 0x7fa460103fc0 2024-05-08T07:17:13.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.271+0000 7fa47167cb80 1 Processor -- start 2024-05-08T07:17:13.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.271+0000 7fa45cc00700 1 -- 172.21.15.70:0/1156103468 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa44c018800 con 0x7fa460103fc0 2024-05-08T07:17:13.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.271+0000 7fa47167cb80 1 -- start start 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.271+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.271+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3efb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.271+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3f0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.271+0000 7fa47167cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f1fd33db20 con 0x55f1fd3f5660 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.271+0000 7fa47167cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f1fd2db860 con 0x55f1fd3f01b0 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.271+0000 7fa47167cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f1fd339ae0 con 0x55f1fd3f5f80 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa464c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa464c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40950/0 (socket says 172.21.15.70:40950) 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa464c00700 1 -- 172.21.15.70:0/4100045779 learned_addr learned my addr 172.21.15.70:0/4100045779 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa45f400700 1 --2- 172.21.15.70:0/4100045779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa45fe00700 1 --2- 172.21.15.70:0/4100045779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3efb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa464c00700 1 -- 172.21.15.70:0/4100045779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5f80 msgr2=0x55f1fd3efb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:17:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa464c00700 1 --2- 172.21.15.70:0/4100045779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3efb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa464c00700 1 -- 172.21.15.70:0/4100045779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 msgr2=0x55f1fd3f0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:17:13.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa464c00700 1 --2- 172.21.15.70:0/4100045779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3f0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.272+0000 7fa464c00700 1 -- 172.21.15.70:0/4100045779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fd28a9d0 con 0x55f1fd3f5660 2024-05-08T07:17:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.273+0000 7fa45cc00700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4440b29f0 0x7fa4440b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.273+0000 7fa464c00700 1 --2- 172.21.15.70:0/4100045779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f5a40 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa458007f70 tx=0x7fa45800e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ad6af22ddc7eda server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.273+0000 7fa45cc00700 1 -- 172.21.15.70:0/1156103468 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 9583+0+0 (secure 0 0 0) 0x7fa44c0e29c0 con 0x7fa460103fc0 2024-05-08T07:17:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.273+0000 7fa45fe00700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4440b29f0 0x7fa4440b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.273+0000 7fa455600700 1 -- 172.21.15.70:0/4100045779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45800ed20 con 0x55f1fd3f5660 2024-05-08T07:17:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.273+0000 7fa455600700 1 -- 172.21.15.70:0/4100045779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa458004bb0 con 0x55f1fd3f5660 2024-05-08T07:17:13.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.273+0000 7fa455600700 1 -- 172.21.15.70:0/4100045779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458014d10 con 0x55f1fd3f5660 2024-05-08T07:17:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa47167cb80 1 -- 172.21.15.70:0/4100045779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5660 msgr2=0x55f1fd3f5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa47167cb80 1 --2- 172.21.15.70:0/4100045779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f5a40 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa458007f70 tx=0x7fa45800e440 comp rx=0 tx=0).stop 2024-05-08T07:17:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa45fe00700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4440b29f0 0x7fa4440b4eb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa450000c00 tx=0x7fa45001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa47167cb80 1 -- 172.21.15.70:0/4100045779 shutdown_connections 2024-05-08T07:17:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa47167cb80 1 --2- 172.21.15.70:0/4100045779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3f0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa47167cb80 1 --2- 172.21.15.70:0/4100045779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f5a40 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa47167cb80 1 --2- 172.21.15.70:0/4100045779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3efb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa47167cb80 1 -- 172.21.15.70:0/4100045779 >> 172.21.15.70:0/4100045779 conn(0x55f1fd3637d0 msgr2=0x55f1fd3e62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa47167cb80 1 -- 172.21.15.70:0/4100045779 shutdown_connections 2024-05-08T07:17:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.274+0000 7fa47167cb80 1 -- 172.21.15.70:0/4100045779 wait complete. 2024-05-08T07:17:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.275+0000 7fa47167cb80 1 -- start start 2024-05-08T07:17:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.275+0000 7fa47167cb80 1 Processor -- start 2024-05-08T07:17:13.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3fbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3f95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa47167cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f1fd3fcaa0 con 0x55f1fd3f01b0 2024-05-08T07:17:13.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa47167cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f1fd2a3c20 con 0x55f1fd3f5f80 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa47167cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f1fd3fcc20 con 0x55f1fd3f5660 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa47167cb80 10 client.0 _ll_register_callbacks cb 0x55f1fd2e4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa45fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3fbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa45fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3fbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40962/0 (socket says 172.21.15.70:40962) 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa45fe00700 1 -- 172.21.15.70:0/1120129982 learned_addr learned my addr 172.21.15.70:0/1120129982 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.276+0000 7fa464c00700 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3f95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.277+0000 7fa45f400700 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.277+0000 7fa45fe00700 1 -- 172.21.15.70:0/1120129982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 msgr2=0x55f1fd3f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.277+0000 7fa45fe00700 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.277+0000 7fa45fe00700 1 -- 172.21.15.70:0/1120129982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 msgr2=0x55f1fd3f95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.277+0000 7fa45fe00700 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3f95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.277+0000 7fa45fe00700 1 -- 172.21.15.70:0/1120129982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1fd303520 con 0x55f1fd3f01b0 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.277+0000 7fa45fe00700 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3fbc60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa450015000 tx=0x7fa450009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354faa92ad51417a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:13.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.277+0000 7fa44a000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.278+0000 7fa44a000700 1 -- 172.21.15.70:0/1120129982 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450034060 con 0x55f1fd3f01b0 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.278+0000 7fa44a000700 1 -- 172.21.15.70:0/1120129982 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 9583+0+0 (secure 0 0 0) 0x7fa450003c20 con 0x55f1fd3f01b0 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.278+0000 7fa47167cb80 1 -- 172.21.15.70:0/1120129982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa458004bb0 con 0x55f1fd3f01b0 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa44a000700 1 -- 172.21.15.70:0/1120129982 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa450003e20 con 0x55f1fd3f01b0 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa47167cb80 10 client.16356 fetch_fsmap learned FSMap version 36 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa47167cb80 1 -- 172.21.15.70:0/1120129982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f1fd407340 con 0x55f1fd3f01b0 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa44a000700 1 -- 172.21.15.70:0/1120129982 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa458004bb0 con 0x55f1fd3f01b0 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa44a000700 1 -- 172.21.15.70:0/1120129982 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fa450024410 con 0x55f1fd3f01b0 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa47167cb80 10 client.16356 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa47167cb80 10 client.16356 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa47167cb80 20 client.16356 populate_metadata read hostname 'smithi070' 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa47167cb80 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f1fd409980 0x55f1fd40be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa47167cb80 4 client.16356 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:17:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.279+0000 7fa47167cb80 1 -- 172.21.15.70:0/1120129982 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1fd3b8240 con 0x55f1fd409980 2024-05-08T07:17:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.280+0000 7fa45f400700 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f1fd409980 0x55f1fd40be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.281+0000 7fa45f400700 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f1fd409980 0x55f1fd40be00 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46c1ef513186ef97 server_cookie=4a61be0c8482a802 in_seq=0 out_seq=0 2024-05-08T07:17:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.281+0000 7fa44a000700 10 client.16356 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:17:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa44a000700 1 -- 172.21.15.70:0/1120129982 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f1fd3b8240 con 0x55f1fd409980 2024-05-08T07:17:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa44a000700 10 client.16356 handle_command_reply: tid=0 2024-05-08T07:17:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa47167cb80 1 client.16356 shutdown 2024-05-08T07:17:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa47167cb80 1 -- 172.21.15.70:0/1120129982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 msgr2=0x55f1fd3fbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:13.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa47167cb80 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3fbc60 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa450015000 tx=0x7fa450009cd0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa47167cb80 1 -- 172.21.15.70:0/1120129982 shutdown_connections 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa47167cb80 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f1fd409980 0x55f1fd40be00 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa47167cb80 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3f95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa47167cb80 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3fbc60 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa47167cb80 1 --2- 172.21.15.70:0/1120129982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa44a000700 0 client.16356 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.283+0000 7fa47167cb80 1 -- 172.21.15.70:0/1120129982 >> 172.21.15.70:0/1120129982 conn(0x55f1fd3637d0 msgr2=0x55f1fd3eeb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.284+0000 7fa47167cb80 1 -- 172.21.15.70:0/1120129982 shutdown_connections 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.284+0000 7fa47167cb80 1 -- 172.21.15.70:0/1120129982 wait complete. 2024-05-08T07:17:13.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.284+0000 7fa47167cb80 20 client.16356 trim_cache size 0 max 16384 2024-05-08T07:17:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.305+0000 7fa47167cb80 1 Processor -- start 2024-05-08T07:17:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.305+0000 7fa47167cb80 1 -- start start 2024-05-08T07:17:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.306+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3f7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.306+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.306+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5f80 0x55f1fd411720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.306+0000 7fa47167cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601afa20 con 0x55f1fd3f5f80 2024-05-08T07:17:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.306+0000 7fa47167cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601ad2b0 con 0x55f1fd3f01b0 2024-05-08T07:17:13.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.306+0000 7fa47167cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601ab120 con 0x55f1fd3f5660 2024-05-08T07:17:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.306+0000 7fa464c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5f80 0x55f1fd411720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.306+0000 7fa464c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5f80 0x55f1fd411720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40972/0 (socket says 172.21.15.70:40972) 2024-05-08T07:17:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.306+0000 7fa464c00700 1 -- 172.21.15.70:0/844763274 learned_addr learned my addr 172.21.15.70:0/844763274 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:17:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa45f400700 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa45fe00700 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa464c00700 1 -- 172.21.15.70:0/844763274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 msgr2=0x55f1fd3f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa464c00700 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa464c00700 1 -- 172.21.15.70:0/844763274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 msgr2=0x55f1fd3f7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa464c00700 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3f7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa464c00700 1 -- 172.21.15.70:0/844763274 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1fd406630 con 0x55f1fd3f5f80 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa45fe00700 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3f7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa45f400700 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa464c00700 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5f80 0x55f1fd411720 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa458007a10 tx=0x7fa458007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59ee53daf3f735a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.307+0000 7fa454c00700 1 -- 172.21.15.70:0/844763274 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45800ed20 con 0x55f1fd3f5f80 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa454c00700 1 -- 172.21.15.70:0/844763274 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa458005070 con 0x55f1fd3f5f80 2024-05-08T07:17:13.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa454c00700 1 -- 172.21.15.70:0/844763274 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa458014480 con 0x55f1fd3f5f80 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa47167cb80 1 -- 172.21.15.70:0/844763274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5f80 msgr2=0x55f1fd411720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa47167cb80 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5f80 0x55f1fd411720 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa458007a10 tx=0x7fa458007bf0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa47167cb80 1 -- 172.21.15.70:0/844763274 shutdown_connections 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa47167cb80 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f5f80 0x55f1fd411720 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa47167cb80 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3f7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa47167cb80 1 --2- 172.21.15.70:0/844763274 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa47167cb80 1 -- 172.21.15.70:0/844763274 >> 172.21.15.70:0/844763274 conn(0x55f1fd3637d0 msgr2=0x55f1fd3f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa47167cb80 1 -- 172.21.15.70:0/844763274 shutdown_connections 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.308+0000 7fa47167cb80 1 -- 172.21.15.70:0/844763274 wait complete. 2024-05-08T07:17:13.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.309+0000 7fa47167cb80 1 -- start start 2024-05-08T07:17:13.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.309+0000 7fa47167cb80 1 Processor -- start 2024-05-08T07:17:13.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3ff3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa47167cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3ff930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa47167cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601ab770 con 0x55f1fd3f01b0 2024-05-08T07:17:13.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa47167cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601acbe0 con 0x55f1fd3f5f80 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa47167cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa4601abe40 con 0x55f1fd3f5660 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa47167cb80 10 client.0 _ll_register_callbacks cb 0x55f1fd2e4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa45fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa45fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3feeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40978/0 (socket says 172.21.15.70:40978) 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa45fe00700 1 -- 172.21.15.70:0/2686129736 learned_addr learned my addr 172.21.15.70:0/2686129736 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa45f400700 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3ff3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa464c00700 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa45fe00700 1 -- 172.21.15.70:0/2686129736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 msgr2=0x55f1fd3ff3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa45fe00700 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3ff3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.310+0000 7fa45fe00700 1 -- 172.21.15.70:0/2686129736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 msgr2=0x55f1fd3ff930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa45fe00700 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3ff930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa45fe00700 1 -- 172.21.15.70:0/2686129736 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1fd4742e0 con 0x55f1fd3f01b0 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa464c00700 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:17:13.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa45fe00700 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3feeb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55f1fd3fa5a0 tx=0x7fa4500052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a393c813e9d3cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa44a000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa44a000700 1 -- 172.21.15.70:0/2686129736 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450034040 con 0x55f1fd3f01b0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa47167cb80 1 -- 172.21.15.70:0/2686129736 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa458005070 con 0x55f1fd3f01b0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa44a000700 1 -- 172.21.15.70:0/2686129736 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 9583+0+0 (secure 0 0 0) 0x7fa45002c040 con 0x55f1fd3f01b0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa44a000700 1 -- 172.21.15.70:0/2686129736 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa450046050 con 0x55f1fd3f01b0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa47167cb80 10 client.16362 fetch_fsmap learned FSMap version 36 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.311+0000 7fa47167cb80 1 -- 172.21.15.70:0/2686129736 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f1fd475580 con 0x55f1fd3f01b0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.312+0000 7fa44a000700 1 -- 172.21.15.70:0/2686129736 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa458005070 con 0x55f1fd3f01b0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.312+0000 7fa44a000700 1 -- 172.21.15.70:0/2686129736 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fa450030470 con 0x55f1fd3f01b0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.312+0000 7fa47167cb80 10 client.16362 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.312+0000 7fa47167cb80 10 client.16362 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.312+0000 7fa47167cb80 20 client.16362 populate_metadata read hostname 'smithi070' 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.312+0000 7fa47167cb80 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f1fd475cc0 0x55f1fd478100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.312+0000 7fa47167cb80 4 client.16362 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b4cad037", "release": true, "await": true}] 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.312+0000 7fa47167cb80 1 -- 172.21.15.70:0/2686129736 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b4cad037", "release": true, "await": true}) -- 0x55f1fd34b500 con 0x55f1fd475cc0 2024-05-08T07:17:13.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.313+0000 7fa45f400700 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f1fd475cc0 0x55f1fd478100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:13.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.313+0000 7fa45f400700 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f1fd475cc0 0x55f1fd478100 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70fb9da6ea69c369 server_cookie=46e631e0ca119bb7 in_seq=0 out_seq=0 2024-05-08T07:17:13.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:13.313+0000 7fa44a000700 10 client.16362 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:17:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:14 smithi070 ceph-mon[29591]: pgmap v971: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-05-08T07:17:15.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:14 smithi172 ceph-mon[33377]: pgmap v971: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-05-08T07:17:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:14 smithi194 ceph-mon[33679]: pgmap v971: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-05-08T07:17:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa44a000700 1 -- 172.21.15.70:0/2686129736 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55f1fd34b500 con 0x55f1fd475cc0 2024-05-08T07:17:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa44a000700 10 client.16362 handle_command_reply: tid=0 2024-05-08T07:17:16.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa47167cb80 1 client.16362 shutdown 2024-05-08T07:17:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa47167cb80 1 -- 172.21.15.70:0/2686129736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 msgr2=0x55f1fd3feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa47167cb80 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3feeb0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x55f1fd3fa5a0 tx=0x7fa4500052a0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa47167cb80 1 -- 172.21.15.70:0/2686129736 shutdown_connections 2024-05-08T07:17:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa47167cb80 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f1fd475cc0 0x55f1fd478100 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa47167cb80 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f1fd3f5f80 0x55f1fd3ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa47167cb80 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f1fd3f01b0 0x55f1fd3feeb0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa47167cb80 1 --2- 172.21.15.70:0/2686129736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f1fd3f5660 0x55f1fd3ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa47167cb80 1 -- 172.21.15.70:0/2686129736 >> 172.21.15.70:0/2686129736 conn(0x55f1fd3637d0 msgr2=0x55f1fd3f30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.547+0000 7fa44a000700 0 client.16362 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.548+0000 7fa47167cb80 1 -- 172.21.15.70:0/2686129736 shutdown_connections 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.548+0000 7fa47167cb80 1 -- 172.21.15.70:0/2686129736 wait complete. 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.548+0000 7fa47167cb80 20 client.16362 trim_cache size 0 max 16384 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 36, 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 80, 2024-05-08T07:17:16.548 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "b4cad037": { 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 80, 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.2, 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:17:16.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:17:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:17:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:17:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:17:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:17:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:17:16.550 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:17:16.550 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.549+0000 7fa465600700 1 -- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4440b29f0 msgr2=0x7fa4440b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.549+0000 7fa465600700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4440b29f0 0x7fa4440b4eb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa450000c00 tx=0x7fa45001a040 comp rx=0 tx=0).stop 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.549+0000 7fa465600700 1 -- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103fc0 msgr2=0x7fa46019fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.549+0000 7fa465600700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103fc0 0x7fa46019fb40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa44c00c9e0 tx=0x7fa44c00cda0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.550+0000 7fa465600700 1 -- 172.21.15.70:0/1156103468 shutdown_connections 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.550+0000 7fa465600700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4440b29f0 0x7fa4440b4eb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.550+0000 7fa465600700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa4601086f0 0x7fa460199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.550+0000 7fa465600700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa460103610 0x7fa46019f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.550+0000 7fa465600700 1 --2- 172.21.15.70:0/1156103468 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa460103fc0 0x7fa46019fb40 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.550+0000 7fa465600700 1 -- 172.21.15.70:0/1156103468 >> 172.21.15.70:0/1156103468 conn(0x7fa4600fee80 msgr2=0x7fa460101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.550+0000 7fa465600700 1 -- 172.21.15.70:0/1156103468 shutdown_connections 2024-05-08T07:17:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:16.550+0000 7fa465600700 1 -- 172.21.15.70:0/1156103468 wait complete. 2024-05-08T07:17:16.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:16 smithi070 ceph-mon[29591]: pgmap v972: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-05-08T07:17:17.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:16 smithi172 ceph-mon[33377]: pgmap v972: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-05-08T07:17:17.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:16 smithi194 ceph-mon[33679]: pgmap v972: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-05-08T07:17:17.569 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b4cad037', seconds elapsed: 56.5 2024-05-08T07:17:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:18 smithi070 ceph-mon[29591]: pgmap v973: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:17:19.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:18 smithi172 ceph-mon[33377]: pgmap v973: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:17:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:18 smithi194 ceph-mon[33679]: pgmap v973: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.9 KiB/s wr, 6 op/s 2024-05-08T07:17:21.063 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:20 smithi194 ceph-mon[33679]: pgmap v974: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 135 KiB/s wr, 16 op/s 2024-05-08T07:17:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:20 smithi070 ceph-mon[29591]: pgmap v974: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 135 KiB/s wr, 16 op/s 2024-05-08T07:17:21.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:20 smithi172 ceph-mon[33377]: pgmap v974: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 135 KiB/s wr, 16 op/s 2024-05-08T07:17:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:22 smithi070 ceph-mon[29591]: pgmap v975: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 135 KiB/s wr, 16 op/s 2024-05-08T07:17:23.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:22 smithi172 ceph-mon[33377]: pgmap v975: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 135 KiB/s wr, 16 op/s 2024-05-08T07:17:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:22 smithi194 ceph-mon[33679]: pgmap v975: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 135 KiB/s wr, 16 op/s 2024-05-08T07:17:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:24 smithi070 ceph-mon[29591]: pgmap v976: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 124 KiB/s wr, 15 op/s 2024-05-08T07:17:25.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:24 smithi172 ceph-mon[33377]: pgmap v976: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 124 KiB/s wr, 15 op/s 2024-05-08T07:17:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:24 smithi194 ceph-mon[33679]: pgmap v976: 129 pgs: 129 active+clean; 1.5 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 124 KiB/s wr, 15 op/s 2024-05-08T07:17:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:26 smithi070 ceph-mon[29591]: pgmap v977: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 295 KiB/s wr, 50 op/s 2024-05-08T07:17:27.184 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:26 smithi172 ceph-mon[33377]: pgmap v977: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 295 KiB/s wr, 50 op/s 2024-05-08T07:17:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:26 smithi194 ceph-mon[33679]: pgmap v977: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 295 KiB/s wr, 50 op/s 2024-05-08T07:17:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:28 smithi070 ceph-mon[29591]: pgmap v978: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 289 KiB/s wr, 47 op/s 2024-05-08T07:17:29.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:28 smithi172 ceph-mon[33377]: pgmap v978: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 289 KiB/s wr, 47 op/s 2024-05-08T07:17:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:28 smithi194 ceph-mon[33679]: pgmap v978: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 289 KiB/s wr, 47 op/s 2024-05-08T07:17:31.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:30 smithi070 ceph-mon[29591]: pgmap v979: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 557 KiB/s wr, 268 op/s 2024-05-08T07:17:31.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:30 smithi172 ceph-mon[33377]: pgmap v979: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 557 KiB/s wr, 268 op/s 2024-05-08T07:17:31.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:30 smithi194 ceph-mon[33679]: pgmap v979: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 557 KiB/s wr, 268 op/s 2024-05-08T07:17:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:32 smithi070 ceph-mon[29591]: pgmap v980: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 450 KiB/s wr, 257 op/s 2024-05-08T07:17:33.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:32 smithi172 ceph-mon[33377]: pgmap v980: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 450 KiB/s wr, 257 op/s 2024-05-08T07:17:33.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:32 smithi194 ceph-mon[33679]: pgmap v980: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 450 KiB/s wr, 257 op/s 2024-05-08T07:17:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:34 smithi070 ceph-mon[29591]: pgmap v981: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 450 KiB/s wr, 257 op/s 2024-05-08T07:17:35.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:34 smithi172 ceph-mon[33377]: pgmap v981: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 450 KiB/s wr, 257 op/s 2024-05-08T07:17:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:34 smithi194 ceph-mon[33679]: pgmap v981: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 450 KiB/s wr, 257 op/s 2024-05-08T07:17:37.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:36 smithi172 ceph-mon[33377]: pgmap v982: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 845 KiB/s wr, 344 op/s 2024-05-08T07:17:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:36 smithi194 ceph-mon[33679]: pgmap v982: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 845 KiB/s wr, 344 op/s 2024-05-08T07:17:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:36 smithi070 ceph-mon[29591]: pgmap v982: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 845 KiB/s wr, 344 op/s 2024-05-08T07:17:39.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:38 smithi172 ceph-mon[33377]: pgmap v983: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 663 KiB/s wr, 307 op/s 2024-05-08T07:17:39.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:38 smithi070 ceph-mon[29591]: pgmap v983: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 663 KiB/s wr, 307 op/s 2024-05-08T07:17:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:38 smithi194 ceph-mon[33679]: pgmap v983: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 663 KiB/s wr, 307 op/s 2024-05-08T07:17:41.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:40 smithi172 ceph-mon[33377]: pgmap v984: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 1.2 MiB/s wr, 566 op/s 2024-05-08T07:17:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:40 smithi194 ceph-mon[33679]: pgmap v984: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 1.2 MiB/s wr, 566 op/s 2024-05-08T07:17:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:40 smithi070 ceph-mon[29591]: pgmap v984: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 1.2 MiB/s wr, 566 op/s 2024-05-08T07:17:43.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:42 smithi172 ceph-mon[33377]: pgmap v985: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 944 KiB/s wr, 346 op/s 2024-05-08T07:17:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:42 smithi194 ceph-mon[33679]: pgmap v985: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 944 KiB/s wr, 346 op/s 2024-05-08T07:17:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:42 smithi070 ceph-mon[29591]: pgmap v985: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 944 KiB/s wr, 346 op/s 2024-05-08T07:17:45.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:44 smithi172 ceph-mon[33377]: pgmap v986: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 944 KiB/s wr, 346 op/s 2024-05-08T07:17:45.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:44 smithi194 ceph-mon[33679]: pgmap v986: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 944 KiB/s wr, 346 op/s 2024-05-08T07:17:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:44 smithi070 ceph-mon[29591]: pgmap v986: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 944 KiB/s wr, 346 op/s 2024-05-08T07:17:47.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:46 smithi172 ceph-mon[33377]: pgmap v987: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 1.4 MiB/s wr, 454 op/s 2024-05-08T07:17:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:46 smithi194 ceph-mon[33679]: pgmap v987: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 1.4 MiB/s wr, 454 op/s 2024-05-08T07:17:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:46 smithi070 ceph-mon[29591]: pgmap v987: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 1.4 MiB/s wr, 454 op/s 2024-05-08T07:17:49.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:48 smithi172 ceph-mon[33377]: pgmap v988: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 1.0 MiB/s wr, 367 op/s 2024-05-08T07:17:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:48 smithi194 ceph-mon[33679]: pgmap v988: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 1.0 MiB/s wr, 367 op/s 2024-05-08T07:17:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:48 smithi070 ceph-mon[29591]: pgmap v988: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 1.0 MiB/s wr, 367 op/s 2024-05-08T07:17:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:50 smithi194 ceph-mon[33679]: pgmap v989: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 1.5 MiB/s wr, 474 op/s 2024-05-08T07:17:51.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:50 smithi070 ceph-mon[29591]: pgmap v989: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 1.5 MiB/s wr, 474 op/s 2024-05-08T07:17:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:50 smithi172 ceph-mon[33377]: pgmap v989: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 1.5 MiB/s wr, 474 op/s 2024-05-08T07:17:53.226 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.9 2024-05-08T07:17:53.227 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:17:53.230 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:52 smithi172 ceph-mon[33377]: pgmap v990: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 993 KiB/s wr, 214 op/s 2024-05-08T07:17:53.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:52 smithi194 ceph-mon[33679]: pgmap v990: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 993 KiB/s wr, 214 op/s 2024-05-08T07:17:53.291 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:52 smithi070 ceph-mon[29591]: pgmap v990: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 993 KiB/s wr, 214 op/s 2024-05-08T07:17:53.715 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:17:55.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:54 smithi070 ceph-mon[29591]: pgmap v991: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 993 KiB/s wr, 214 op/s 2024-05-08T07:17:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:54 smithi194 ceph-mon[33679]: pgmap v991: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 993 KiB/s wr, 214 op/s 2024-05-08T07:17:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:54 smithi172 ceph-mon[33377]: pgmap v991: 129 pgs: 129 active+clean; 1.5 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 993 KiB/s wr, 214 op/s 2024-05-08T07:17:56.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.236+0000 7fc4e9a00700 1 -- 172.21.15.70:0/2088674625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 msgr2=0x7fc4e4103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.236+0000 7fc4e9a00700 1 --2- 172.21.15.70:0/2088674625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 0x7fc4e4103b30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40099c0 tx=0x7fc4d4009cd0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.236+0000 7fc4e9a00700 1 -- 172.21.15.70:0/2088674625 shutdown_connections 2024-05-08T07:17:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.236+0000 7fc4e9a00700 1 --2- 172.21.15.70:0/2088674625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e4108850 0x7fc4e41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.236+0000 7fc4e9a00700 1 --2- 172.21.15.70:0/2088674625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 0x7fc4e4103b30 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.236+0000 7fc4e9a00700 1 --2- 172.21.15.70:0/2088674625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e4104100 0x7fc4e4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.236+0000 7fc4e9a00700 1 -- 172.21.15.70:0/2088674625 >> 172.21.15.70:0/2088674625 conn(0x7fc4e407a600 msgr2=0x7fc4e407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.236+0000 7fc4e9a00700 1 -- 172.21.15.70:0/2088674625 shutdown_connections 2024-05-08T07:17:56.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.237+0000 7fc4e9a00700 1 -- 172.21.15.70:0/2088674625 wait complete. 2024-05-08T07:17:56.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.238+0000 7fc4e9a00700 1 Processor -- start 2024-05-08T07:17:56.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.238+0000 7fc4e9a00700 1 -- start start 2024-05-08T07:17:56.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.238+0000 7fc4e9a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 0x7fc4e410a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:56.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.238+0000 7fc4e9a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e4104100 0x7fc4e410a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:56.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.238+0000 7fc4e9a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e4108850 0x7fc4e410ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:56.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.238+0000 7fc4e9a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e4113540 con 0x7fc4e4103750 2024-05-08T07:17:56.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.238+0000 7fc4e9a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41133c0 con 0x7fc4e4104100 2024-05-08T07:17:56.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.238+0000 7fc4e9a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e41136c0 con 0x7fc4e4108850 2024-05-08T07:17:56.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.239+0000 7fc4e2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 0x7fc4e410a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:56.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.239+0000 7fc4e2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 0x7fc4e410a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59574/0 (socket says 172.21.15.70:59574) 2024-05-08T07:17:56.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.239+0000 7fc4e2a00700 1 -- 172.21.15.70:0/3065880772 learned_addr learned my addr 172.21.15.70:0/3065880772 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:17:56.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.239+0000 7fc4e2000700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e4104100 0x7fc4e410a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:56.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.239+0000 7fc4e3400700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e4108850 0x7fc4e410ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:56.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.240+0000 7fc4e2a00700 1 -- 172.21.15.70:0/3065880772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e4108850 msgr2=0x7fc4e410ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:56.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.240+0000 7fc4e2a00700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e4108850 0x7fc4e410ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.240+0000 7fc4e2a00700 1 -- 172.21.15.70:0/3065880772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e4104100 msgr2=0x7fc4e410a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.240+0000 7fc4e2a00700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e4104100 0x7fc4e410a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.240+0000 7fc4e2a00700 1 -- 172.21.15.70:0/3065880772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e41ac2c0 con 0x7fc4e4103750 2024-05-08T07:17:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.240+0000 7fc4e3400700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e4108850 0x7fc4e410ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:17:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.241+0000 7fc4e2a00700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 0x7fc4e410a3e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4000c00 tx=0x7fc4d400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:56.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.241+0000 7fc4db400700 1 -- 172.21.15.70:0/3065880772 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4027070 con 0x7fc4e4103750 2024-05-08T07:17:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.241+0000 7fc4db400700 1 -- 172.21.15.70:0/3065880772 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4d400fda0 con 0x7fc4e4103750 2024-05-08T07:17:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.241+0000 7fc4e9a00700 1 -- 172.21.15.70:0/3065880772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e41ac550 con 0x7fc4e4103750 2024-05-08T07:17:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.242+0000 7fc4db400700 1 -- 172.21.15.70:0/3065880772 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40173f0 con 0x7fc4e4103750 2024-05-08T07:17:56.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.242+0000 7fc4e9a00700 1 -- 172.21.15.70:0/3065880772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e41aca00 con 0x7fc4e4103750 2024-05-08T07:17:56.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.243+0000 7fc4d8c00700 1 -- 172.21.15.70:0/3065880772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e4104be0 con 0x7fc4e4103750 2024-05-08T07:17:56.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.247+0000 7fc4db400700 1 -- 172.21.15.70:0/3065880772 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc4d402a070 con 0x7fc4e4103750 2024-05-08T07:17:56.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.249+0000 7fc4db400700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:17:56.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.249+0000 7fc4db400700 1 -- 172.21.15.70:0/3065880772 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 9583+0+0 (secure 0 0 0) 0x7fc4d40e36f0 con 0x7fc4e4103750 2024-05-08T07:17:56.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.249+0000 7fc4e2000700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:17:56.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.250+0000 7fc4e2000700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4e410bba0 tx=0x7fc4d000a380 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:17:56.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.251+0000 7fc4db400700 1 -- 172.21.15.70:0/3065880772 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc4d4030020 con 0x7fc4e4103750 2024-05-08T07:17:56.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.631+0000 7fc4d8c00700 1 -- 172.21.15.70:0/3065880772 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4e406a190 con 0x7fc4e4103750 2024-05-08T07:17:56.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.633+0000 7fc4db400700 1 -- 172.21.15.70:0/3065880772 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11879 (secure 0 0 0) 0x7fc4d4013070 con 0x7fc4e4103750 2024-05-08T07:17:56.632 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:17:56.632 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:17:08.396412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:17:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 -- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 msgr2=0x7fc4c80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc4e410bba0 tx=0x7fc4d000a380 comp rx=0 tx=0).stop 2024-05-08T07:17:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 -- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 msgr2=0x7fc4e410a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:17:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 0x7fc4e410a3e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4000c00 tx=0x7fc4d400f460 comp rx=0 tx=0).stop 2024-05-08T07:17:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 -- 172.21.15.70:0/3065880772 shutdown_connections 2024-05-08T07:17:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e4108850 0x7fc4e410ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e4103750 0x7fc4e410a3e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 --2- 172.21.15.70:0/3065880772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e4104100 0x7fc4e410a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:17:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.636+0000 7fc4d8c00700 1 -- 172.21.15.70:0/3065880772 >> 172.21.15.70:0/3065880772 conn(0x7fc4e407a600 msgr2=0x7fc4e4101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:17:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.637+0000 7fc4d8c00700 1 -- 172.21.15.70:0/3065880772 shutdown_connections 2024-05-08T07:17:56.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:17:56.637+0000 7fc4d8c00700 1 -- 172.21.15.70:0/3065880772 wait complete. 2024-05-08T07:17:56.637 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 36 2024-05-08T07:17:57.186 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:56 smithi070 ceph-mon[29591]: pgmap v992: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 1.3 MiB/s wr, 353 op/s 2024-05-08T07:17:57.187 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:56 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3065880772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:17:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:56 smithi194 ceph-mon[33679]: pgmap v992: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 1.3 MiB/s wr, 353 op/s 2024-05-08T07:17:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:56 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3065880772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:17:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:56 smithi172 ceph-mon[33377]: pgmap v992: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 1.3 MiB/s wr, 353 op/s 2024-05-08T07:17:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:56 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3065880772' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:17:57.512 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 86.9 --await-for 42.0' 2024-05-08T07:17:57.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 86.9 --await-for 42.0 2024-05-08T07:17:57.998 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:17:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:17:58 smithi194 ceph-mon[33679]: pgmap v993: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 872 KiB/s wr, 244 op/s 2024-05-08T07:17:59.326 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:17:58 smithi070 ceph-mon[29591]: pgmap v993: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 872 KiB/s wr, 244 op/s 2024-05-08T07:17:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:17:58 smithi172 ceph-mon[33377]: pgmap v993: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 872 KiB/s wr, 244 op/s 2024-05-08T07:18:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.597+0000 7f2f3c600700 1 -- 172.21.15.70:0/777028766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f341037b0 msgr2=0x7f2f34103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.597+0000 7f2f3c600700 1 --2- 172.21.15.70:0/777028766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f341037b0 0x7f2f34103b90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2f280099c0 tx=0x7f2f28009cd0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.597+0000 7f2f3c600700 1 -- 172.21.15.70:0/777028766 shutdown_connections 2024-05-08T07:18:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.597+0000 7f2f3c600700 1 --2- 172.21.15.70:0/777028766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f34108880 0x7f2f34110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.597+0000 7f2f3c600700 1 --2- 172.21.15.70:0/777028766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f341037b0 0x7f2f34103b90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.597+0000 7f2f3c600700 1 --2- 172.21.15.70:0/777028766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f34104160 0x7f2f34108150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.597+0000 7f2f3c600700 1 -- 172.21.15.70:0/777028766 >> 172.21.15.70:0/777028766 conn(0x7f2f3407a580 msgr2=0x7f2f3407a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.597+0000 7f2f3c600700 1 -- 172.21.15.70:0/777028766 shutdown_connections 2024-05-08T07:18:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.597+0000 7f2f3c600700 1 -- 172.21.15.70:0/777028766 wait complete. 2024-05-08T07:18:00.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.599+0000 7f2f3c600700 1 Processor -- start 2024-05-08T07:18:00.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.599+0000 7f2f3c600700 1 -- start start 2024-05-08T07:18:00.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.599+0000 7f2f3c600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f341037b0 0x7f2f341a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.599+0000 7f2f3c600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f34104160 0x7f2f341a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.600+0000 7f2f3c600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34108880 0x7f2f3419ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.600+0000 7f2f3c600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f34113590 con 0x7f2f34108880 2024-05-08T07:18:00.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.600+0000 7f2f3c600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f34113410 con 0x7f2f341037b0 2024-05-08T07:18:00.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.600+0000 7f2f3c600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2f34113710 con 0x7f2f34104160 2024-05-08T07:18:00.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.600+0000 7f2f3a600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34108880 0x7f2f3419ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.600+0000 7f2f3a600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34108880 0x7f2f3419ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40402/0 (socket says 172.21.15.70:40402) 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.600+0000 7f2f3a600700 1 -- 172.21.15.70:0/79545226 learned_addr learned my addr 172.21.15.70:0/79545226 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.600+0000 7f2f39c00700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f341037b0 0x7f2f341a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.600+0000 7f2f39200700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f34104160 0x7f2f341a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f3a600700 1 -- 172.21.15.70:0/79545226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f34104160 msgr2=0x7f2f341a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f3a600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f34104160 0x7f2f341a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f3a600700 1 -- 172.21.15.70:0/79545226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f341037b0 msgr2=0x7f2f341a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f3a600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f341037b0 0x7f2f341a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f3a600700 1 -- 172.21.15.70:0/79545226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3419c180 con 0x7f2f34108880 2024-05-08T07:18:00.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f3a600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34108880 0x7f2f3419ba20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c007ee0 tx=0x7f2f2c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f32000700 1 -- 172.21.15.70:0/79545226 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c004bb0 con 0x7f2f34108880 2024-05-08T07:18:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f32000700 1 -- 172.21.15.70:0/79545226 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f2c004d50 con 0x7f2f34108880 2024-05-08T07:18:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f3c600700 1 -- 172.21.15.70:0/79545226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f3419c470 con 0x7f2f34108880 2024-05-08T07:18:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.601+0000 7f2f3c600700 1 -- 172.21.15.70:0/79545226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f341a86e0 con 0x7f2f34108880 2024-05-08T07:18:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.602+0000 7f2f32000700 1 -- 172.21.15.70:0/79545226 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c0058b0 con 0x7f2f34108880 2024-05-08T07:18:00.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.606+0000 7f2f32000700 1 -- 172.21.15.70:0/79545226 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2f2c01a020 con 0x7f2f34108880 2024-05-08T07:18:00.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.607+0000 7f2f46f6fb80 1 Processor -- start 2024-05-08T07:18:00.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.608+0000 7f2f46f6fb80 1 -- start start 2024-05-08T07:18:00.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.608+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 0x561a32678620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.608+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32672810 0x561a32672c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.608+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.608+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a325c4bb0 con 0x561a326731d0 2024-05-08T07:18:00.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.608+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a325628f0 con 0x561a32678240 2024-05-08T07:18:00.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.608+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561a325c0b70 con 0x561a32672810 2024-05-08T07:18:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.609+0000 7f2f39c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32672810 0x561a32672c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.609+0000 7f2f39c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32672810 0x561a32672c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:50536/0 (socket says 172.21.15.70:50536) 2024-05-08T07:18:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.609+0000 7f2f39c00700 1 -- 172.21.15.70:0/1747348863 learned_addr learned my addr 172.21.15.70:0/1747348863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.609+0000 7f2f32000700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b2aa0 0x7f2f1c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.609+0000 7f2f39200700 1 --2- 172.21.15.70:0/1747348863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 0x561a32678620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.609+0000 7f2f32000700 1 -- 172.21.15.70:0/79545226 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 9583+0+0 (secure 0 0 0) 0x7f2f2c0e2110 con 0x7f2f34108880 2024-05-08T07:18:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.609+0000 7f2f39200700 1 --2- 172.21.15.70:0/1747348863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.610+0000 7f2f39c00700 1 -- 172.21.15.70:0/1747348863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 msgr2=0x561a32678620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.610+0000 7f2f39c00700 1 --2- 172.21.15.70:0/1747348863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 0x561a32678620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.610+0000 7f2f39c00700 1 -- 172.21.15.70:0/1747348863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 msgr2=0x561a3267f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.610+0000 7f2f39c00700 1 --2- 172.21.15.70:0/1747348863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.610+0000 7f2f39c00700 1 -- 172.21.15.70:0/1747348863 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a32511a60 con 0x561a32672810 2024-05-08T07:18:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.610+0000 7f2f3a600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b2aa0 0x7f2f1c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.611+0000 7f2f39c00700 1 --2- 172.21.15.70:0/1747348863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32672810 0x561a32672c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f280058e0 tx=0x7f2f280050f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=def15125ee4b5c28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.612+0000 7f2f3a600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b2aa0 0x7f2f1c0b4f60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0a8f60 tx=0x7f2f2c00b040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:00.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.612+0000 7f2f26a00700 1 -- 172.21.15.70:0/1747348863 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28027070 con 0x561a32672810 2024-05-08T07:18:00.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.612+0000 7f2f26a00700 1 -- 172.21.15.70:0/1747348863 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f2800bc20 con 0x561a32672810 2024-05-08T07:18:00.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.612+0000 7f2f26a00700 1 -- 172.21.15.70:0/1747348863 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f280038e0 con 0x561a32672810 2024-05-08T07:18:00.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.613+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1747348863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32672810 msgr2=0x561a32672c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:00.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.613+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/1747348863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32672810 0x561a32672c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f280058e0 tx=0x7f2f280050f0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.614+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1747348863 shutdown_connections 2024-05-08T07:18:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.614+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/1747348863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.614+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/1747348863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 0x561a32678620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.614+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/1747348863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32672810 0x561a32672c90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.614+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1747348863 >> 172.21.15.70:0/1747348863 conn(0x561a325ea860 msgr2=0x561a3266d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.614+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1747348863 shutdown_connections 2024-05-08T07:18:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.614+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1747348863 wait complete. 2024-05-08T07:18:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.615+0000 7f2f46f6fb80 1 -- start start 2024-05-08T07:18:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.615+0000 7f2f46f6fb80 1 Processor -- start 2024-05-08T07:18:00.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.616+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.616+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.616+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32678240 0x561a3267c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.616+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a3267f5a0 con 0x561a326731d0 2024-05-08T07:18:00.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.616+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a3252acb0 con 0x561a32672810 2024-05-08T07:18:00.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.616+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561a3267f720 con 0x561a32678240 2024-05-08T07:18:00.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.616+0000 7f2f46f6fb80 10 client.0 _ll_register_callbacks cb 0x561a3256be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:18:00.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.616+0000 7f2f39c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40412/0 (socket says 172.21.15.70:40412) 2024-05-08T07:18:00.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39c00700 1 -- 172.21.15.70:0/2368737457 learned_addr learned my addr 172.21.15.70:0/2368737457 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39200700 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39200700 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32678240 0x561a3267c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39c00700 1 -- 172.21.15.70:0/2368737457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32678240 msgr2=0x561a3267c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39c00700 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32678240 0x561a3267c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39c00700 1 -- 172.21.15.70:0/2368737457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 msgr2=0x561a3267ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39c00700 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39c00700 1 -- 172.21.15.70:0/2368737457 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a3258a5b0 con 0x561a326731d0 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.617+0000 7f2f39200700 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.618+0000 7f2f39c00700 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267bfb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009d10 tx=0x7f2f2800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54191b54283f3f24 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:00.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.618+0000 7f2f1b400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:18:00.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.618+0000 7f2f1b400700 1 -- 172.21.15.70:0/2368737457 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2802f020 con 0x561a326731d0 2024-05-08T07:18:00.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.618+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/2368737457 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f2800bc20 con 0x561a326731d0 2024-05-08T07:18:00.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.618+0000 7f2f1b400700 1 -- 172.21.15.70:0/2368737457 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 9583+0+0 (secure 0 0 0) 0x7f2f28003680 con 0x561a326731d0 2024-05-08T07:18:00.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.619+0000 7f2f1b400700 1 -- 172.21.15.70:0/2368737457 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2f2803a050 con 0x561a326731d0 2024-05-08T07:18:00.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.619+0000 7f2f46f6fb80 10 client.16380 fetch_fsmap learned FSMap version 36 2024-05-08T07:18:00.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.619+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/2368737457 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561a32689da0 con 0x561a326731d0 2024-05-08T07:18:00.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.620+0000 7f2f1b400700 1 -- 172.21.15.70:0/2368737457 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f2800bc20 con 0x561a326731d0 2024-05-08T07:18:00.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.620+0000 7f2f1b400700 1 -- 172.21.15.70:0/2368737457 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f2f2802a030 con 0x561a326731d0 2024-05-08T07:18:00.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.620+0000 7f2f46f6fb80 10 client.16380 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:18:00.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.620+0000 7f2f46f6fb80 10 client.16380 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:18:00.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.620+0000 7f2f46f6fb80 20 client.16380 populate_metadata read hostname 'smithi070' 2024-05-08T07:18:00.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.620+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a3268c270 0x561a3268e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.620+0000 7f2f46f6fb80 4 client.16380 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:18:00.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.620+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/2368737457 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a3263f2d0 con 0x561a3268c270 2024-05-08T07:18:00.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.621+0000 7f2f39200700 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a3268c270 0x561a3268e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.622+0000 7f2f1b400700 10 client.16380 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:18:00.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.622+0000 7f2f39200700 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a3268c270 0x561a3268e660 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ab2a19780548f83 server_cookie=1120594101066302 in_seq=0 out_seq=0 2024-05-08T07:18:00.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.627+0000 7f2f1b400700 1 -- 172.21.15.70:0/2368737457 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561a3263f2d0 con 0x561a3268c270 2024-05-08T07:18:00.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.627+0000 7f2f1b400700 10 client.16380 handle_command_reply: tid=0 2024-05-08T07:18:00.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.628+0000 7f2f46f6fb80 1 client.16380 shutdown 2024-05-08T07:18:00.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.628+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/2368737457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 msgr2=0x561a3267bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:00.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.628+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267bfb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2f28009d10 tx=0x7f2f2800bdd0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/2368737457 shutdown_connections 2024-05-08T07:18:00.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a3268c270 0x561a3268e660 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a32678240 0x561a3267c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/2368737457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a326731d0 0x561a3267bfb0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/2368737457 >> 172.21.15.70:0/2368737457 conn(0x561a325ea860 msgr2=0x561a32667bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:00.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f1b400700 0 client.16380 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:18:00.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/2368737457 shutdown_connections 2024-05-08T07:18:00.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/2368737457 wait complete. 2024-05-08T07:18:00.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.629+0000 7f2f46f6fb80 20 client.16380 trim_cache size 0 max 16384 2024-05-08T07:18:00.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.663+0000 7f2f46f6fb80 1 Processor -- start 2024-05-08T07:18:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.663+0000 7f2f46f6fb80 1 -- start start 2024-05-08T07:18:00.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.663+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.663+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3267b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.664+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32678240 0x561a3267dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.664+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f341afb60 con 0x561a32678240 2024-05-08T07:18:00.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.664+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f341ad3f0 con 0x561a32672810 2024-05-08T07:18:00.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.664+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2f341ab260 con 0x561a326731d0 2024-05-08T07:18:00.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.664+0000 7f2f39200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32678240 0x561a3267dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.664+0000 7f2f39200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32678240 0x561a3267dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40424/0 (socket says 172.21.15.70:40424) 2024-05-08T07:18:00.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.664+0000 7f2f39200700 1 -- 172.21.15.70:0/1795028854 learned_addr learned my addr 172.21.15.70:0/1795028854 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:00.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.664+0000 7f2f39c00700 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3267b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.664+0000 7f2f39200700 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.665+0000 7f2f39c00700 1 -- 172.21.15.70:0/1795028854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 msgr2=0x561a3267c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:00.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.665+0000 7f2f39c00700 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.665+0000 7f2f39c00700 1 -- 172.21.15.70:0/1795028854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32678240 msgr2=0x561a3267dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:00.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.665+0000 7f2f39c00700 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32678240 0x561a3267dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.665+0000 7f2f39c00700 1 -- 172.21.15.70:0/1795028854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a32669d00 con 0x561a326731d0 2024-05-08T07:18:00.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.665+0000 7f2f39200700 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:18:00.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.665+0000 7f2f39c00700 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3267b130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f280058e0 tx=0x7f2f28001e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f352960f18acd90f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:00.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.666+0000 7f2f26000700 1 -- 172.21.15.70:0/1795028854 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2802f070 con 0x561a326731d0 2024-05-08T07:18:00.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.666+0000 7f2f26000700 1 -- 172.21.15.70:0/1795028854 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f2800f460 con 0x561a326731d0 2024-05-08T07:18:00.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.666+0000 7f2f26000700 1 -- 172.21.15.70:0/1795028854 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28027040 con 0x561a326731d0 2024-05-08T07:18:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.667+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1795028854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 msgr2=0x561a3267b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.667+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3267b130 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f280058e0 tx=0x7f2f28001e50 comp rx=0 tx=0).stop 2024-05-08T07:18:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.667+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1795028854 shutdown_connections 2024-05-08T07:18:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.667+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32678240 0x561a3267dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.667+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32672810 0x561a3267c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.667+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/1795028854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3267b130 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.667+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1795028854 >> 172.21.15.70:0/1795028854 conn(0x561a325ea860 msgr2=0x561a3267d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.668+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1795028854 shutdown_connections 2024-05-08T07:18:00.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.668+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/1795028854 wait complete. 2024-05-08T07:18:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.668+0000 7f2f46f6fb80 1 -- start start 2024-05-08T07:18:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.669+0000 7f2f46f6fb80 1 Processor -- start 2024-05-08T07:18:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.669+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32672810 0x561a3268d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.669+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3268dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.669+0000 7f2f46f6fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 0x561a326f5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.669+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f341ab8b0 con 0x561a32672810 2024-05-08T07:18:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.669+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f341acd20 con 0x561a32678240 2024-05-08T07:18:00.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.669+0000 7f2f46f6fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2f341abf80 con 0x561a326731d0 2024-05-08T07:18:00.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.669+0000 7f2f46f6fb80 10 client.0 _ll_register_callbacks cb 0x561a3256be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:18:00.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.670+0000 7f2f39200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32672810 0x561a3268d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.670+0000 7f2f39200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32672810 0x561a3268d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40432/0 (socket says 172.21.15.70:40432) 2024-05-08T07:18:00.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.670+0000 7f2f39200700 1 -- 172.21.15.70:0/42945466 learned_addr learned my addr 172.21.15.70:0/42945466 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:00.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.670+0000 7f2f39c00700 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3268dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.670+0000 7f2f39200700 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 0x561a326f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.671+0000 7f2f39c00700 1 -- 172.21.15.70:0/42945466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 msgr2=0x561a326f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.671+0000 7f2f39c00700 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 0x561a326f5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.671+0000 7f2f39c00700 1 -- 172.21.15.70:0/42945466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32672810 msgr2=0x561a3268d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.671+0000 7f2f39c00700 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32672810 0x561a3268d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.671+0000 7f2f39c00700 1 -- 172.21.15.70:0/42945466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a326f5dc0 con 0x561a326731d0 2024-05-08T07:18:00.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.671+0000 7f2f39200700 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32672810 0x561a3268d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:18:00.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.672+0000 7f2f39c00700 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3268dbe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800b580 tx=0x7f2f2800b6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2414cd9b933aa9c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:00.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.672+0000 7f2f1b400700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T07:18:00.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.672+0000 7f2f1b400700 1 -- 172.21.15.70:0/42945466 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28027070 con 0x561a326731d0 2024-05-08T07:18:00.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.672+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/42945466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f2800f460 con 0x561a326731d0 2024-05-08T07:18:00.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.673+0000 7f2f1b400700 1 -- 172.21.15.70:0/42945466 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(141..141 src has 1..141) ==== 9583+0+0 (secure 0 0 0) 0x7f2f2800bad0 con 0x561a326731d0 2024-05-08T07:18:00.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.673+0000 7f2f1b400700 1 -- 172.21.15.70:0/42945466 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2f2804c050 con 0x561a326731d0 2024-05-08T07:18:00.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.673+0000 7f2f46f6fb80 10 client.25654 fetch_fsmap learned FSMap version 36 2024-05-08T07:18:00.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.673+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/42945466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561a326f7080 con 0x561a326731d0 2024-05-08T07:18:00.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.674+0000 7f2f1b400700 1 -- 172.21.15.70:0/42945466 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f2800f460 con 0x561a326731d0 2024-05-08T07:18:00.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.674+0000 7f2f1b400700 1 -- 172.21.15.70:0/42945466 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f2f2802a040 con 0x561a326731d0 2024-05-08T07:18:00.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.674+0000 7f2f46f6fb80 10 client.25654 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:18:00.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.674+0000 7f2f46f6fb80 10 client.25654 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:18:00.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.674+0000 7f2f46f6fb80 20 client.25654 populate_metadata read hostname 'smithi070' 2024-05-08T07:18:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.675+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a326f7830 0x561a326f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.675+0000 7f2f46f6fb80 4 client.25654 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.9, "await_for": 42.0}] 2024-05-08T07:18:00.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.675+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/42945466 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.9, "await_for": 42.0}) -- 0x561a325d2590 con 0x561a326f7830 2024-05-08T07:18:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.675+0000 7f2f39200700 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a326f7830 0x561a326f9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.676+0000 7f2f39200700 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a326f7830 0x561a326f9c50 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb59a8bb2945d821 server_cookie=eb2700cf6eb42dd3 in_seq=0 out_seq=0 2024-05-08T07:18:00.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:00.676+0000 7f2f1b400700 10 client.25654 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:18:01.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:00 smithi194 ceph-mon[33679]: pgmap v994: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.3 MiB/s wr, 380 op/s 2024-05-08T07:18:01.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:18:01.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:00 smithi070 ceph-mon[29591]: pgmap v994: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.3 MiB/s wr, 380 op/s 2024-05-08T07:18:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:18:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:00 smithi172 ceph-mon[33377]: pgmap v994: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 546 KiB/s rd, 1.3 MiB/s wr, 380 op/s 2024-05-08T07:18:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:18:03.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:02 smithi194 ceph-mon[33679]: pgmap v995: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 870 KiB/s wr, 274 op/s 2024-05-08T07:18:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:02 smithi070 ceph-mon[29591]: pgmap v995: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 870 KiB/s wr, 274 op/s 2024-05-08T07:18:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:02 smithi172 ceph-mon[33377]: pgmap v995: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 870 KiB/s wr, 274 op/s 2024-05-08T07:18:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: pgmap v996: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 870 KiB/s wr, 274 op/s 2024-05-08T07:18:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:18:05.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:18:05.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:18:05.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:05 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:18:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: pgmap v996: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 870 KiB/s wr, 274 op/s 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:18:05.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:05 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:18:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: pgmap v996: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 870 KiB/s wr, 274 op/s 2024-05-08T07:18:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:18:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:18:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:18:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:05 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:18:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:06.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:06.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:06.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:06.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:07 smithi194 ceph-mon[33679]: pgmap v997: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-05-08T07:18:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:18:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:18:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:07 smithi070 ceph-mon[29591]: pgmap v997: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-05-08T07:18:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:18:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:18:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:07 smithi172 ceph-mon[33377]: pgmap v997: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-05-08T07:18:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:18:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:18:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:18:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:18:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:08 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:18:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:08 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:18:08.775 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:08 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:18:08.775 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:08 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:18:08.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:08 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:18:08.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:08 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:18:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:09 smithi194 ceph-mon[33679]: pgmap v998: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 749 KiB/s wr, 159 op/s 2024-05-08T07:18:09.848 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:09 smithi070 ceph-mon[29591]: pgmap v998: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 749 KiB/s wr, 159 op/s 2024-05-08T07:18:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:09 smithi172 ceph-mon[33377]: pgmap v998: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 749 KiB/s wr, 159 op/s 2024-05-08T07:18:10.782 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:10 smithi070 ceph-mon[29591]: pgmap v999: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 778 KiB/s wr, 164 op/s 2024-05-08T07:18:10.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:10 smithi172 ceph-mon[33377]: pgmap v999: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 778 KiB/s wr, 164 op/s 2024-05-08T07:18:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:10 smithi194 ceph-mon[33679]: pgmap v999: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 778 KiB/s wr, 164 op/s 2024-05-08T07:18:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:12 smithi194 ceph-mon[33679]: pgmap v1000: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 269 KiB/s wr, 28 op/s 2024-05-08T07:18:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:12 smithi070 ceph-mon[29591]: pgmap v1000: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 269 KiB/s wr, 28 op/s 2024-05-08T07:18:13.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:12 smithi172 ceph-mon[33377]: pgmap v1000: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 269 KiB/s wr, 28 op/s 2024-05-08T07:18:15.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:14 smithi194 ceph-mon[33679]: pgmap v1001: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 269 KiB/s wr, 28 op/s 2024-05-08T07:18:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:14 smithi070 ceph-mon[29591]: pgmap v1001: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 269 KiB/s wr, 28 op/s 2024-05-08T07:18:15.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:14 smithi172 ceph-mon[33377]: pgmap v1001: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 269 KiB/s wr, 28 op/s 2024-05-08T07:18:17.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:16 smithi194 ceph-mon[33679]: pgmap v1002: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 330 KiB/s wr, 100 op/s 2024-05-08T07:18:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:16 smithi070 ceph-mon[29591]: pgmap v1002: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 330 KiB/s wr, 100 op/s 2024-05-08T07:18:17.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:16 smithi172 ceph-mon[33377]: pgmap v1002: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 330 KiB/s wr, 100 op/s 2024-05-08T07:18:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:18 smithi194 ceph-mon[33679]: pgmap v1003: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 90 KiB/s wr, 76 op/s 2024-05-08T07:18:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:18 smithi070 ceph-mon[29591]: pgmap v1003: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 90 KiB/s wr, 76 op/s 2024-05-08T07:18:19.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:18 smithi172 ceph-mon[33377]: pgmap v1003: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 90 KiB/s wr, 76 op/s 2024-05-08T07:18:19.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f1b400700 1 -- 172.21.15.70:0/42945466 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x561a325d2590 con 0x561a326f7830 2024-05-08T07:18:19.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f1b400700 10 client.25654 handle_command_reply: tid=0 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 client.25654 shutdown 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/42945466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 msgr2=0x561a3268dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3268dbe0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800b580 tx=0x7f2f2800b6a0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/42945466 shutdown_connections 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a326f7830 0x561a326f9c50 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a32678240 0x561a326f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a32672810 0x561a3268d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 --2- 172.21.15.70:0/42945466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a326731d0 0x561a3268dbe0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/42945466 >> 172.21.15.70:0/42945466 conn(0x561a325ea860 msgr2=0x561a32671800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f1b400700 0 client.25654 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:18:19.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.807+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/42945466 shutdown_connections 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 36, 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 82, 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "7004b46c": { 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 82, 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:18:19.809 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.9, 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:19.810 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:18:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.808+0000 7f2f46f6fb80 1 -- 172.21.15.70:0/42945466 wait complete. 2024-05-08T07:18:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.808+0000 7f2f46f6fb80 20 client.25654 trim_cache size 0 max 16384 2024-05-08T07:18:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.809+0000 7f2f3c600700 1 -- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b2aa0 msgr2=0x7f2f1c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.809+0000 7f2f3c600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b2aa0 0x7f2f1c0b4f60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0a8f60 tx=0x7f2f2c00b040 comp rx=0 tx=0).stop 2024-05-08T07:18:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 -- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34108880 msgr2=0x7f2f3419ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34108880 0x7f2f3419ba20 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c007ee0 tx=0x7f2f2c00d3b0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 -- 172.21.15.70:0/79545226 shutdown_connections 2024-05-08T07:18:19.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b2aa0 0x7f2f1c0b4f60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34108880 0x7f2f3419ba20 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f341037b0 0x7f2f341a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 --2- 172.21.15.70:0/79545226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f34104160 0x7f2f341a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:19.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 -- 172.21.15.70:0/79545226 >> 172.21.15.70:0/79545226 conn(0x7f2f3407a580 msgr2=0x7f2f34102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:19.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 -- 172.21.15.70:0/79545226 shutdown_connections 2024-05-08T07:18:19.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:19.810+0000 7f2f3c600700 1 -- 172.21.15.70:0/79545226 wait complete. 2024-05-08T07:18:20.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:19 smithi194 ceph-mon[33679]: osdmap e142: 12 total, 12 up, 12 in 2024-05-08T07:18:20.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:19 smithi070 ceph-mon[29591]: osdmap e142: 12 total, 12 up, 12 in 2024-05-08T07:18:20.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:19 smithi172 ceph-mon[33377]: osdmap e142: 12 total, 12 up, 12 in 2024-05-08T07:18:20.725 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7004b46c', quiesce took 27.5 seconds. Will release after: 26.9 2024-05-08T07:18:21.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:20 smithi194 ceph-mon[33679]: pgmap v1005: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 388 KiB/s wr, 158 op/s 2024-05-08T07:18:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:20 smithi070 ceph-mon[29591]: pgmap v1005: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 388 KiB/s wr, 158 op/s 2024-05-08T07:18:21.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:20 smithi172 ceph-mon[33377]: pgmap v1005: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 388 KiB/s wr, 158 op/s 2024-05-08T07:18:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:22 smithi194 ceph-mon[33679]: pgmap v1006: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 388 KiB/s wr, 158 op/s 2024-05-08T07:18:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:22 smithi070 ceph-mon[29591]: pgmap v1006: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 388 KiB/s wr, 158 op/s 2024-05-08T07:18:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:22 smithi172 ceph-mon[33377]: pgmap v1006: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 388 KiB/s wr, 158 op/s 2024-05-08T07:18:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:24 smithi194 ceph-mon[33679]: pgmap v1007: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 388 KiB/s wr, 158 op/s 2024-05-08T07:18:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:24 smithi070 ceph-mon[29591]: pgmap v1007: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 388 KiB/s wr, 158 op/s 2024-05-08T07:18:25.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:24 smithi172 ceph-mon[33377]: pgmap v1007: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 388 KiB/s wr, 158 op/s 2024-05-08T07:18:27.009 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:26 smithi172 ceph-mon[33377]: pgmap v1008: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 335 KiB/s wr, 79 op/s 2024-05-08T07:18:27.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:26 smithi194 ceph-mon[33679]: pgmap v1008: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 335 KiB/s wr, 79 op/s 2024-05-08T07:18:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:26 smithi070 ceph-mon[29591]: pgmap v1008: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 335 KiB/s wr, 79 op/s 2024-05-08T07:18:29.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:28 smithi194 ceph-mon[33679]: pgmap v1009: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 335 KiB/s wr, 79 op/s 2024-05-08T07:18:29.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:28 smithi194 ceph-mon[33679]: osdmap e143: 12 total, 12 up, 12 in 2024-05-08T07:18:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:28 smithi070 ceph-mon[29591]: pgmap v1009: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 335 KiB/s wr, 79 op/s 2024-05-08T07:18:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:28 smithi070 ceph-mon[29591]: osdmap e143: 12 total, 12 up, 12 in 2024-05-08T07:18:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:28 smithi172 ceph-mon[33377]: pgmap v1009: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 335 KiB/s wr, 79 op/s 2024-05-08T07:18:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:28 smithi172 ceph-mon[33377]: osdmap e143: 12 total, 12 up, 12 in 2024-05-08T07:18:31.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:30 smithi194 ceph-mon[33679]: pgmap v1011: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T07:18:31.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:30 smithi070 ceph-mon[29591]: pgmap v1011: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T07:18:31.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:30 smithi172 ceph-mon[33377]: pgmap v1011: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T07:18:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:32 smithi070 ceph-mon[29591]: pgmap v1012: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T07:18:33.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:32 smithi172 ceph-mon[33377]: pgmap v1012: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T07:18:33.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:32 smithi194 ceph-mon[33679]: pgmap v1012: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T07:18:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:34 smithi070 ceph-mon[29591]: pgmap v1013: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T07:18:35.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:34 smithi172 ceph-mon[33377]: pgmap v1013: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T07:18:35.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:34 smithi194 ceph-mon[33679]: pgmap v1013: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T07:18:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:36 smithi070 ceph-mon[29591]: pgmap v1014: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T07:18:37.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:36 smithi172 ceph-mon[33377]: pgmap v1014: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T07:18:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:36 smithi194 ceph-mon[33679]: pgmap v1014: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T07:18:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:38 smithi070 ceph-mon[29591]: pgmap v1015: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T07:18:39.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:38 smithi172 ceph-mon[33377]: pgmap v1015: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T07:18:39.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:38 smithi194 ceph-mon[33679]: pgmap v1015: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T07:18:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:40 smithi070 ceph-mon[29591]: pgmap v1016: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.6 KiB/s wr, 9 op/s 2024-05-08T07:18:41.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:40 smithi172 ceph-mon[33377]: pgmap v1016: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.6 KiB/s wr, 9 op/s 2024-05-08T07:18:41.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:40 smithi194 ceph-mon[33679]: pgmap v1016: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.6 KiB/s wr, 9 op/s 2024-05-08T07:18:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:42 smithi070 ceph-mon[29591]: pgmap v1017: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-05-08T07:18:43.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:42 smithi172 ceph-mon[33377]: pgmap v1017: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-05-08T07:18:43.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:42 smithi194 ceph-mon[33679]: pgmap v1017: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-05-08T07:18:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:44 smithi070 ceph-mon[29591]: pgmap v1018: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-05-08T07:18:45.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:44 smithi172 ceph-mon[33377]: pgmap v1018: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-05-08T07:18:45.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:44 smithi194 ceph-mon[33679]: pgmap v1018: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-05-08T07:18:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:46 smithi070 ceph-mon[29591]: pgmap v1019: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-05-08T07:18:47.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:46 smithi172 ceph-mon[33377]: pgmap v1019: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-05-08T07:18:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:46 smithi194 ceph-mon[33679]: pgmap v1019: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 KiB/s wr, 8 op/s 2024-05-08T07:18:47.626 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:18:48.082 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:18:49.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:48 smithi070 ceph-mon[29591]: pgmap v1020: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:18:49.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:48 smithi172 ceph-mon[33377]: pgmap v1020: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:18:49.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:48 smithi194 ceph-mon[33679]: pgmap v1020: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:18:50.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.397+0000 7f720a800700 1 -- 172.21.15.70:0/494767312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f720406ba10 msgr2=0x7f720406be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:50.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.397+0000 7f720a800700 1 --2- 172.21.15.70:0/494767312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f720406ba10 0x7f720406be90 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009990 tx=0x7f71f0009ca0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.397+0000 7f720a800700 1 -- 172.21.15.70:0/494767312 shutdown_connections 2024-05-08T07:18:50.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.397+0000 7f720a800700 1 --2- 172.21.15.70:0/494767312 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720406c3d0 0x7f7204110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.397+0000 7f720a800700 1 --2- 172.21.15.70:0/494767312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7204109500 0x7f72041098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.397+0000 7f720a800700 1 --2- 172.21.15.70:0/494767312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f720406ba10 0x7f720406be90 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.397+0000 7f720a800700 1 -- 172.21.15.70:0/494767312 >> 172.21.15.70:0/494767312 conn(0x7f7204079310 msgr2=0x7f7204079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.397+0000 7f720a800700 1 -- 172.21.15.70:0/494767312 shutdown_connections 2024-05-08T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.397+0000 7f720a800700 1 -- 172.21.15.70:0/494767312 wait complete. 2024-05-08T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.398+0000 7f720a800700 1 Processor -- start 2024-05-08T07:18:50.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.398+0000 7f720a800700 1 -- start start 2024-05-08T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.399+0000 7f720a800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720406ba10 0x7f72041a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.399+0000 7f720a800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f720406c3d0 0x7f72041a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.399+0000 7f720a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7204109500 0x7f720419bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:50.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.399+0000 7f720a800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7204113510 con 0x7f7204109500 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.399+0000 7f720a800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7204113390 con 0x7f720406ba10 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.399+0000 7f720a800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7204113690 con 0x7f720406c3d0 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.399+0000 7f7203e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7204109500 0x7f720419bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.399+0000 7f7203e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7204109500 0x7f720419bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34146/0 (socket says 172.21.15.70:34146) 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.399+0000 7f7203e00700 1 -- 172.21.15.70:0/3091786353 learned_addr learned my addr 172.21.15.70:0/3091786353 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f7202a00700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f720406c3d0 0x7f72041a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f7203400700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720406ba10 0x7f72041a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f7203e00700 1 -- 172.21.15.70:0/3091786353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f720406c3d0 msgr2=0x7f72041a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f7203e00700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f720406c3d0 0x7f72041a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f7203e00700 1 -- 172.21.15.70:0/3091786353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720406ba10 msgr2=0x7f72041a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f7203e00700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720406ba10 0x7f72041a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f7203e00700 1 -- 172.21.15.70:0/3091786353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720419c3f0 con 0x7f7204109500 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f7203400700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720406ba10 0x7f72041a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:18:50.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f7203e00700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7204109500 0x7f720419bb10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f71fc007d70 tx=0x7f71fc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:50.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.400+0000 7f71fbe00700 1 -- 172.21.15.70:0/3091786353 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc016020 con 0x7f7204109500 2024-05-08T07:18:50.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.401+0000 7f71fbe00700 1 -- 172.21.15.70:0/3091786353 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f71fc00ad40 con 0x7f7204109500 2024-05-08T07:18:50.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.401+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720419c6e0 con 0x7f7204109500 2024-05-08T07:18:50.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.401+0000 7f71fbe00700 1 -- 172.21.15.70:0/3091786353 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71fc0115e0 con 0x7f7204109500 2024-05-08T07:18:50.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.401+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72041a89c0 con 0x7f7204109500 2024-05-08T07:18:50.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.402+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7204104bc0 con 0x7f7204109500 2024-05-08T07:18:50.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.406+0000 7f71fbe00700 1 -- 172.21.15.70:0/3091786353 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f71fc019020 con 0x7f7204109500 2024-05-08T07:18:50.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.407+0000 7f71fbe00700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f71e80b2a70 0x7f71e80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:50.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.408+0000 7f71fbe00700 1 -- 172.21.15.70:0/3091786353 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 9583+0+0 (secure 0 0 0) 0x7f71fc0e2db0 con 0x7f7204109500 2024-05-08T07:18:50.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.408+0000 7f7203400700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f71e80b2a70 0x7f71e80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:50.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.409+0000 7f7203400700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f71e80b2a70 0x7f71e80b4f30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71f4005e10 tx=0x7f71f4005d60 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:50.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.410+0000 7f71fbe00700 1 -- 172.21.15.70:0/3091786353 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f71fc020020 con 0x7f7204109500 2024-05-08T07:18:50.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.692+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72041a8b90 con 0x7f7204109500 2024-05-08T07:18:50.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.693+0000 7f71fbe00700 1 -- 172.21.15.70:0/3091786353 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11879 (secure 0 0 0) 0x7f71fc0aa420 con 0x7f7204109500 2024-05-08T07:18:50.692 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:18:50.692 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:17:08.396412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:18:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f71e80b2a70 msgr2=0x7f71e80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f71e80b2a70 0x7f71e80b4f30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71f4005e10 tx=0x7f71f4005d60 comp rx=0 tx=0).stop 2024-05-08T07:18:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7204109500 msgr2=0x7f720419bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7204109500 0x7f720419bb10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f71fc007d70 tx=0x7f71fc00a340 comp rx=0 tx=0).stop 2024-05-08T07:18:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 shutdown_connections 2024-05-08T07:18:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f71e80b2a70 0x7f71e80b4f30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7204109500 0x7f720419bb10 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f720406ba10 0x7f72041a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 --2- 172.21.15.70:0/3091786353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f720406c3d0 0x7f72041a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.697+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 >> 172.21.15.70:0/3091786353 conn(0x7f7204079310 msgr2=0x7f720410e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.698+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 shutdown_connections 2024-05-08T07:18:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:50.698+0000 7f720a800700 1 -- 172.21.15.70:0/3091786353 wait complete. 2024-05-08T07:18:50.698 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 36 2024-05-08T07:18:51.086 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:50 smithi070 ceph-mon[29591]: pgmap v1021: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-05-08T07:18:51.087 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:50 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3091786353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:18:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:50 smithi172 ceph-mon[33377]: pgmap v1021: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-05-08T07:18:51.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:50 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3091786353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:18:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:50 smithi194 ceph-mon[33679]: pgmap v1021: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.2 KiB/s wr, 7 op/s 2024-05-08T07:18:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:50 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3091786353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:18:51.500 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 7004b46c --release --await' 2024-05-08T07:18:51.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 7004b46c --release --await 2024-05-08T07:18:51.928 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:18:53.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:52 smithi070 ceph-mon[29591]: pgmap v1022: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:18:53.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:52 smithi172 ceph-mon[33377]: pgmap v1022: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:18:53.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:52 smithi194 ceph-mon[33679]: pgmap v1022: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:18:54.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.207+0000 7fc3a5000700 1 -- 172.21.15.70:0/839900655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 msgr2=0x7fc3a0112580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:54.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.207+0000 7fc3a5000700 1 --2- 172.21.15.70:0/839900655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 0x7fc3a0112580 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc39800b0a0 tx=0x7fc39800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.207+0000 7fc3a5000700 1 -- 172.21.15.70:0/839900655 shutdown_connections 2024-05-08T07:18:54.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.207+0000 7fc3a5000700 1 --2- 172.21.15.70:0/839900655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 0x7fc3a0112580 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.207+0000 7fc3a5000700 1 --2- 172.21.15.70:0/839900655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a010b6b0 0x7fc3a010ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.207+0000 7fc3a5000700 1 --2- 172.21.15.70:0/839900655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a01056b0 0x7fc3a0105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.207+0000 7fc3a5000700 1 -- 172.21.15.70:0/839900655 >> 172.21.15.70:0/839900655 conn(0x7fc3a01011a0 msgr2=0x7fc3a01035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:54.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.207+0000 7fc3a5000700 1 -- 172.21.15.70:0/839900655 shutdown_connections 2024-05-08T07:18:54.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.207+0000 7fc3a5000700 1 -- 172.21.15.70:0/839900655 wait complete. 2024-05-08T07:18:54.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.209+0000 7fc3a5000700 1 Processor -- start 2024-05-08T07:18:54.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.209+0000 7fc3a5000700 1 -- start start 2024-05-08T07:18:54.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.209+0000 7fc3a5000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a01056b0 0x7fc3a019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.209+0000 7fc3a5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 0x7fc3a019c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.209+0000 7fc3a5000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a010b6b0 0x7fc3a01a04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.209+0000 7fc3a5000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0115740 con 0x7fc3a0106070 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.209+0000 7fc3a5000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01155c0 con 0x7fc3a010b6b0 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.209+0000 7fc3a5000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01158c0 con 0x7fc3a01056b0 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.209+0000 7fc39d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 0x7fc3a019c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 0x7fc3a019c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34162/0 (socket says 172.21.15.70:34162) 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39d400700 1 -- 172.21.15.70:0/3153403664 learned_addr learned my addr 172.21.15.70:0/3153403664 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39de00700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a01056b0 0x7fc3a019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39e800700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a010b6b0 0x7fc3a01a04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39d400700 1 -- 172.21.15.70:0/3153403664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a01056b0 msgr2=0x7fc3a019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:54.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39d400700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a01056b0 0x7fc3a019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39d400700 1 -- 172.21.15.70:0/3153403664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a010b6b0 msgr2=0x7fc3a01a04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:54.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39d400700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a010b6b0 0x7fc3a01a04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39d400700 1 -- 172.21.15.70:0/3153403664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a01a0bf0 con 0x7fc3a0106070 2024-05-08T07:18:54.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39e800700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a010b6b0 0x7fc3a01a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:18:54.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.210+0000 7fc39d400700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 0x7fc3a019c130 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00d950 tx=0x7fc38c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:54.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.211+0000 7fc396a00700 1 -- 172.21.15.70:0/3153403664 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c016070 con 0x7fc3a0106070 2024-05-08T07:18:54.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.211+0000 7fc396a00700 1 -- 172.21.15.70:0/3153403664 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc38c010460 con 0x7fc3a0106070 2024-05-08T07:18:54.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.211+0000 7fc3a5000700 1 -- 172.21.15.70:0/3153403664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a01a0ee0 con 0x7fc3a0106070 2024-05-08T07:18:54.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.211+0000 7fc396a00700 1 -- 172.21.15.70:0/3153403664 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c00f620 con 0x7fc3a0106070 2024-05-08T07:18:54.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.211+0000 7fc3a5000700 1 -- 172.21.15.70:0/3153403664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a01a87a0 con 0x7fc3a0106070 2024-05-08T07:18:54.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.215+0000 7fc396a00700 1 -- 172.21.15.70:0/3153403664 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc38c019070 con 0x7fc3a0106070 2024-05-08T07:18:54.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.216+0000 7fc3af9bcb80 1 Processor -- start 2024-05-08T07:18:54.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.216+0000 7fc3af9bcb80 1 -- start start 2024-05-08T07:18:54.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.216+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 0x55990bf01590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.216+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990befbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.216+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befc140 0x55990bf07f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.216+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55990be4db20 con 0x55990befb780 2024-05-08T07:18:54.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.216+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55990bdeb860 con 0x55990befc140 2024-05-08T07:18:54.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.216+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55990be49ae0 con 0x55990bf011b0 2024-05-08T07:18:54.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990befbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990befbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34164/0 (socket says 172.21.15.70:34164) 2024-05-08T07:18:54.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39de00700 1 -- 172.21.15.70:0/4010413952 learned_addr learned my addr 172.21.15.70:0/4010413952 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:54.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39e800700 1 --2- 172.21.15.70:0/4010413952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 0x55990bf01590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39d400700 1 --2- 172.21.15.70:0/4010413952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befc140 0x55990bf07f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc396a00700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3840b2a70 0x7fc3840b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39de00700 1 -- 172.21.15.70:0/4010413952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 msgr2=0x55990bf01590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:54.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39de00700 1 --2- 172.21.15.70:0/4010413952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 0x55990bf01590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39de00700 1 -- 172.21.15.70:0/4010413952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befc140 msgr2=0x55990bf07f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:54.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39de00700 1 --2- 172.21.15.70:0/4010413952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befc140 0x55990bf07f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc39de00700 1 -- 172.21.15.70:0/4010413952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990bd9a9d0 con 0x55990befb780 2024-05-08T07:18:54.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.217+0000 7fc396a00700 1 -- 172.21.15.70:0/3153403664 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 9583+0+0 (secure 0 0 0) 0x7fc38c0e25d0 con 0x7fc3a0106070 2024-05-08T07:18:54.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.218+0000 7fc39de00700 1 --2- 172.21.15.70:0/4010413952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990befbc00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc390008bd0 tx=0x7fc390008ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2099b65294bb9016 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:54.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.218+0000 7fc39e800700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3840b2a70 0x7fc3840b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.218+0000 7fc38b400700 1 -- 172.21.15.70:0/4010413952 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390014070 con 0x55990befb780 2024-05-08T07:18:54.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.218+0000 7fc38b400700 1 -- 172.21.15.70:0/4010413952 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc39000ed10 con 0x55990befb780 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.218+0000 7fc38b400700 1 -- 172.21.15.70:0/4010413952 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3900056c0 con 0x55990befb780 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/4010413952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 msgr2=0x55990befbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc39e800700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3840b2a70 0x7fc3840b4f30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc398006130 tx=0x7fc3980099e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/4010413952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990befbc00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc390008bd0 tx=0x7fc390008ee0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/4010413952 shutdown_connections 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/4010413952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befc140 0x55990bf07f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/4010413952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 0x55990bf01590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/4010413952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990befbc00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/4010413952 >> 172.21.15.70:0/4010413952 conn(0x55990be737d0 msgr2=0x55990bef6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/4010413952 shutdown_connections 2024-05-08T07:18:54.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.219+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/4010413952 wait complete. 2024-05-08T07:18:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.220+0000 7fc3af9bcb80 1 -- start start 2024-05-08T07:18:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.220+0000 7fc3af9bcb80 1 Processor -- start 2024-05-08T07:18:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befb780 0x55990bf07ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf04f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 0x55990bf05480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55990bf08570 con 0x55990befc140 2024-05-08T07:18:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55990bdb3c20 con 0x55990befb780 2024-05-08T07:18:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55990bf086f0 con 0x55990bf011b0 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc3af9bcb80 10 client.0 _ll_register_callbacks cb 0x55990bdf4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf04f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf04f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34166/0 (socket says 172.21.15.70:34166) 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39d400700 1 -- 172.21.15.70:0/2248800355 learned_addr learned my addr 172.21.15.70:0/2248800355 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39de00700 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befb780 0x55990bf07ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39e800700 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 0x55990bf05480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39d400700 1 -- 172.21.15.70:0/2248800355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 msgr2=0x55990bf05480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39d400700 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 0x55990bf05480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39d400700 1 -- 172.21.15.70:0/2248800355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befb780 msgr2=0x55990bf07ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39d400700 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befb780 0x55990bf07ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.221+0000 7fc39d400700 1 -- 172.21.15.70:0/2248800355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990be13520 con 0x55990befc140 2024-05-08T07:18:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc39de00700 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befb780 0x55990bf07ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc39e800700 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 0x55990bf05480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc39d400700 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf04f40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00b2f0 tx=0x7fc38c0a9390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431ae3f0a86b4073 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc37fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc37fe00700 1 -- 172.21.15.70:0/2248800355 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c020050 con 0x55990befc140 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc37fe00700 1 -- 172.21.15.70:0/2248800355 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 9583+0+0 (secure 0 0 0) 0x7fc38c0a96f0 con 0x55990befc140 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/2248800355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc39000ed10 con 0x55990befc140 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc37fe00700 1 -- 172.21.15.70:0/2248800355 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc38c0a9b90 con 0x55990befc140 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc3af9bcb80 10 client.16404 fetch_fsmap learned FSMap version 36 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.222+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/2248800355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55990bf12e40 con 0x55990befc140 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.223+0000 7fc37fe00700 1 -- 172.21.15.70:0/2248800355 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc39000ed10 con 0x55990befc140 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.223+0000 7fc37fe00700 1 -- 172.21.15.70:0/2248800355 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fc38c0b1e60 con 0x55990befc140 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.223+0000 7fc3af9bcb80 10 client.16404 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.223+0000 7fc3af9bcb80 10 client.16404 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.223+0000 7fc3af9bcb80 20 client.16404 populate_metadata read hostname 'smithi070' 2024-05-08T07:18:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.223+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990bf15480 0x55990bf178a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.223+0000 7fc3af9bcb80 4 client.16404 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:18:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.223+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/2248800355 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55990bec8240 con 0x55990bf15480 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.224+0000 7fc39de00700 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990bf15480 0x55990bf178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.225+0000 7fc39de00700 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990bf15480 0x55990bf178a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e71e3747c509505f server_cookie=729080790f84cbbc in_seq=0 out_seq=0 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.225+0000 7fc37fe00700 10 client.16404 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.226+0000 7fc37fe00700 1 -- 172.21.15.70:0/2248800355 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55990bec8240 con 0x55990bf15480 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.226+0000 7fc37fe00700 10 client.16404 handle_command_reply: tid=0 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 client.16404 shutdown 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/2248800355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 msgr2=0x55990bf04f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf04f40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00b2f0 tx=0x7fc38c0a9390 comp rx=0 tx=0).stop 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/2248800355 shutdown_connections 2024-05-08T07:18:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990bf15480 0x55990bf178a0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990bf011b0 0x55990bf05480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990befb780 0x55990bf07ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc37fe00700 0 client.16404 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:18:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/2248800355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf04f40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/2248800355 >> 172.21.15.70:0/2248800355 conn(0x55990be737d0 msgr2=0x55990bef0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/2248800355 shutdown_connections 2024-05-08T07:18:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/2248800355 wait complete. 2024-05-08T07:18:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.227+0000 7fc3af9bcb80 20 client.16404 trim_cache size 0 max 16384 2024-05-08T07:18:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.249+0000 7fc3af9bcb80 1 Processor -- start 2024-05-08T07:18:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.249+0000 7fc3af9bcb80 1 -- start start 2024-05-08T07:18:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.249+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990bf115c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.249+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befc140 0x55990bef09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.249+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 0x55990befdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.249+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01b4010 con 0x55990befb780 2024-05-08T07:18:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.249+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01b18a0 con 0x55990bf011b0 2024-05-08T07:18:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.249+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01af710 con 0x55990befc140 2024-05-08T07:18:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990bf115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39d400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befc140 0x55990bef09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990bf115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34174/0 (socket says 172.21.15.70:34174) 2024-05-08T07:18:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39d400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befc140 0x55990bef09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:37880/0 (socket says 172.21.15.70:37880) 2024-05-08T07:18:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39e800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 0x55990befdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39de00700 1 -- 172.21.15.70:0/506863868 learned_addr learned my addr 172.21.15.70:0/506863868 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39de00700 1 -- 172.21.15.70:0/506863868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befc140 msgr2=0x55990bef09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:54.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39de00700 1 --2- 172.21.15.70:0/506863868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befc140 0x55990bef09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39de00700 1 -- 172.21.15.70:0/506863868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 msgr2=0x55990befdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:54.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39de00700 1 --2- 172.21.15.70:0/506863868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 0x55990befdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39de00700 1 -- 172.21.15.70:0/506863868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990bf083a0 con 0x55990befb780 2024-05-08T07:18:54.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.250+0000 7fc39de00700 1 --2- 172.21.15.70:0/506863868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990bf115c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc39000f010 tx=0x7fc390008270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b36ea1b97e4972 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.251+0000 7fc38aa00700 1 -- 172.21.15.70:0/506863868 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390014040 con 0x55990befb780 2024-05-08T07:18:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.251+0000 7fc38aa00700 1 -- 172.21.15.70:0/506863868 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc390005070 con 0x55990befb780 2024-05-08T07:18:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.251+0000 7fc38aa00700 1 -- 172.21.15.70:0/506863868 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390003e50 con 0x55990befb780 2024-05-08T07:18:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.251+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/506863868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 msgr2=0x55990bf115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.251+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/506863868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990bf115c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc39000f010 tx=0x7fc390008270 comp rx=0 tx=0).stop 2024-05-08T07:18:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.251+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/506863868 shutdown_connections 2024-05-08T07:18:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.252+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/506863868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 0x55990befdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.252+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/506863868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befb780 0x55990bf115c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.252+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/506863868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befc140 0x55990bef09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.252+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/506863868 >> 172.21.15.70:0/506863868 conn(0x55990be737d0 msgr2=0x55990bef02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.252+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/506863868 shutdown_connections 2024-05-08T07:18:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.252+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/506863868 wait complete. 2024-05-08T07:18:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.252+0000 7fc3af9bcb80 1 -- start start 2024-05-08T07:18:54.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.252+0000 7fc3af9bcb80 1 Processor -- start 2024-05-08T07:18:54.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befb780 0x55990bf08900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf08e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc3af9bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 0x55990bf09380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01afd60 con 0x55990befc140 2024-05-08T07:18:54.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01b11d0 con 0x55990bf011b0 2024-05-08T07:18:54.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc3af9bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01b0430 con 0x55990befb780 2024-05-08T07:18:54.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc3af9bcb80 10 client.0 _ll_register_callbacks cb 0x55990bdf4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:18:54.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc39d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf08e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc39d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf08e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34186/0 (socket says 172.21.15.70:34186) 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc39d400700 1 -- 172.21.15.70:0/1848515834 learned_addr learned my addr 172.21.15.70:0/1848515834 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.253+0000 7fc39de00700 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befb780 0x55990bf08900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc39e800700 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 0x55990bf09380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc39d400700 1 -- 172.21.15.70:0/1848515834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befb780 msgr2=0x55990bf08900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc39d400700 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befb780 0x55990bf08900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc39d400700 1 -- 172.21.15.70:0/1848515834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 msgr2=0x55990bf09380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc39d400700 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 0x55990bf09380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc39d400700 1 -- 172.21.15.70:0/1848515834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990bef2c70 con 0x55990befc140 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc39de00700 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befb780 0x55990bf08900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc39d400700 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf08e40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005950 tx=0x7fc38c0b23a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6277d8a3cd2a0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc37fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc37fe00700 1 -- 172.21.15.70:0/1848515834 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc38c020070 con 0x55990befc140 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc37fe00700 1 -- 172.21.15.70:0/1848515834 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(143..143 src has 1..143) ==== 9583+0+0 (secure 0 0 0) 0x7fc38c009b40 con 0x55990befc140 2024-05-08T07:18:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/1848515834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc390005070 con 0x55990befc140 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc37fe00700 1 -- 172.21.15.70:0/1848515834 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc38c014020 con 0x55990befc140 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc3af9bcb80 10 client.16410 fetch_fsmap learned FSMap version 36 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.254+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/1848515834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55990bf89830 con 0x55990befc140 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.255+0000 7fc37fe00700 1 -- 172.21.15.70:0/1848515834 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc390005070 con 0x55990befc140 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.255+0000 7fc37fe00700 1 -- 172.21.15.70:0/1848515834 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fc38c083b50 con 0x55990befc140 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.255+0000 7fc3af9bcb80 10 client.16410 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.255+0000 7fc3af9bcb80 10 client.16410 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.255+0000 7fc3af9bcb80 20 client.16410 populate_metadata read hostname 'smithi070' 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.255+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990bf89fa0 0x55990bf8c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.255+0000 7fc3af9bcb80 4 client.16410 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7004b46c", "release": true, "await": true}] 2024-05-08T07:18:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.255+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/1848515834 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7004b46c", "release": true, "await": true}) -- 0x55990bef65d0 con 0x55990bf89fa0 2024-05-08T07:18:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.256+0000 7fc39de00700 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990bf89fa0 0x55990bf8c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:18:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.257+0000 7fc39de00700 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990bf89fa0 0x55990bf8c3c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4106eb99d690f02b server_cookie=31a928576a8b2608 in_seq=0 out_seq=0 2024-05-08T07:18:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:54.257+0000 7fc37fe00700 10 client.16410 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:18:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:54 smithi070 ceph-mon[29591]: pgmap v1023: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:18:55.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:54 smithi172 ceph-mon[33377]: pgmap v1023: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:18:55.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:54 smithi194 ceph-mon[33679]: pgmap v1023: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.2 KiB/s wr, 5 op/s 2024-05-08T07:18:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:56 smithi070 ceph-mon[29591]: pgmap v1024: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-05-08T07:18:57.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:56 smithi172 ceph-mon[33377]: pgmap v1024: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-05-08T07:18:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:56 smithi194 ceph-mon[33679]: pgmap v1024: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-05-08T07:18:57.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.528+0000 7fc37fe00700 1 -- 172.21.15.70:0/1848515834 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55990bef65d0 con 0x55990bf89fa0 2024-05-08T07:18:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.528+0000 7fc37fe00700 10 client.16410 handle_command_reply: tid=0 2024-05-08T07:18:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.528+0000 7fc3af9bcb80 1 client.16410 shutdown 2024-05-08T07:18:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.529+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/1848515834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 msgr2=0x55990bf08e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.529+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf08e40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005950 tx=0x7fc38c0b23a0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.529+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/1848515834 shutdown_connections 2024-05-08T07:18:57.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.529+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990bf89fa0 0x55990bf8c3c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.529+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990bf011b0 0x55990bf09380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.529+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990befb780 0x55990bf08900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.529+0000 7fc3af9bcb80 1 --2- 172.21.15.70:0/1848515834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990befc140 0x55990bf08e40 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.529+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/1848515834 >> 172.21.15.70:0/1848515834 conn(0x55990be737d0 msgr2=0x55990bef0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.529+0000 7fc37fe00700 0 client.16410 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:18:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.530+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/1848515834 shutdown_connections 2024-05-08T07:18:57.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.530+0000 7fc3af9bcb80 1 -- 172.21.15.70:0/1848515834 wait complete. 2024-05-08T07:18:57.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.530+0000 7fc3af9bcb80 20 client.16410 trim_cache size 0 max 16384 2024-05-08T07:18:57.530 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:18:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 36, 2024-05-08T07:18:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:18:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 84, 2024-05-08T07:18:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:18:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "7004b46c": { 2024-05-08T07:18:57.530 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 84, 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.9, 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:57.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:57.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:18:57.532 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:18:57.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 -- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3840b2a70 msgr2=0x7fc3840b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3840b2a70 0x7fc3840b4f30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc398006130 tx=0x7fc3980099e0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 -- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 msgr2=0x7fc3a019c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 0x7fc3a019c130 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00d950 tx=0x7fc38c00dd10 comp rx=0 tx=0).stop 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 -- 172.21.15.70:0/3153403664 shutdown_connections 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3840b2a70 0x7fc3840b4f30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3a010b6b0 0x7fc3a01a04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3a01056b0 0x7fc3a019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 --2- 172.21.15.70:0/3153403664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3a0106070 0x7fc3a019c130 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 -- 172.21.15.70:0/3153403664 >> 172.21.15.70:0/3153403664 conn(0x7fc3a01011a0 msgr2=0x7fc3a01016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 -- 172.21.15.70:0/3153403664 shutdown_connections 2024-05-08T07:18:57.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:18:57.532+0000 7fc3a5000700 1 -- 172.21.15.70:0/3153403664 wait complete. 2024-05-08T07:18:58.522 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7004b46c', seconds elapsed: 65.3 2024-05-08T07:18:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:18:58 smithi070 ceph-mon[29591]: pgmap v1025: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T07:18:59.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:18:58 smithi172 ceph-mon[33377]: pgmap v1025: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T07:18:59.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:18:58 smithi194 ceph-mon[33679]: pgmap v1025: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T07:19:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:00 smithi070 ceph-mon[29591]: pgmap v1026: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 135 KiB/s wr, 21 op/s 2024-05-08T07:19:01.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:00 smithi172 ceph-mon[33377]: pgmap v1026: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 135 KiB/s wr, 21 op/s 2024-05-08T07:19:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:00 smithi194 ceph-mon[33679]: pgmap v1026: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 135 KiB/s wr, 21 op/s 2024-05-08T07:19:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:02 smithi070 ceph-mon[29591]: pgmap v1027: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 135 KiB/s wr, 18 op/s 2024-05-08T07:19:03.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:02 smithi172 ceph-mon[33377]: pgmap v1027: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 135 KiB/s wr, 18 op/s 2024-05-08T07:19:03.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:02 smithi194 ceph-mon[33679]: pgmap v1027: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 135 KiB/s wr, 18 op/s 2024-05-08T07:19:05.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:04 smithi172 ceph-mon[33377]: pgmap v1028: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 135 KiB/s wr, 18 op/s 2024-05-08T07:19:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:04 smithi172 ceph-mon[33377]: osdmap e144: 12 total, 12 up, 12 in 2024-05-08T07:19:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:04 smithi194 ceph-mon[33679]: pgmap v1028: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 135 KiB/s wr, 18 op/s 2024-05-08T07:19:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:04 smithi194 ceph-mon[33679]: osdmap e144: 12 total, 12 up, 12 in 2024-05-08T07:19:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:04 smithi070 ceph-mon[29591]: pgmap v1028: 129 pgs: 129 active+clean; 1.5 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 135 KiB/s wr, 18 op/s 2024-05-08T07:19:05.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:04 smithi070 ceph-mon[29591]: osdmap e144: 12 total, 12 up, 12 in 2024-05-08T07:19:07.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:06 smithi172 ceph-mon[33377]: pgmap v1030: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 793 KiB/s wr, 299 op/s 2024-05-08T07:19:07.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:06 smithi194 ceph-mon[33679]: pgmap v1030: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 793 KiB/s wr, 299 op/s 2024-05-08T07:19:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:06 smithi070 ceph-mon[29591]: pgmap v1030: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 793 KiB/s wr, 299 op/s 2024-05-08T07:19:08.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:19:08.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:19:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:19:09.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:08 smithi172 ceph-mon[33377]: pgmap v1031: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 793 KiB/s wr, 299 op/s 2024-05-08T07:19:09.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:08 smithi194 ceph-mon[33679]: pgmap v1031: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 793 KiB/s wr, 299 op/s 2024-05-08T07:19:09.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:08 smithi070 ceph-mon[29591]: pgmap v1031: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 793 KiB/s wr, 299 op/s 2024-05-08T07:19:10.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:19:10.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:19:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:19:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:19:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:19:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:19:10.280 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:19:10.280 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:19:10.280 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:19:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:11 smithi070 ceph-mon[29591]: pgmap v1032: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 1.1 MiB/s wr, 347 op/s 2024-05-08T07:19:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:11 smithi194 ceph-mon[33679]: pgmap v1032: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 1.1 MiB/s wr, 347 op/s 2024-05-08T07:19:11.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:11 smithi172 ceph-mon[33377]: pgmap v1032: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 1.1 MiB/s wr, 347 op/s 2024-05-08T07:19:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:13 smithi070 ceph-mon[29591]: pgmap v1033: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 1.1 MiB/s wr, 347 op/s 2024-05-08T07:19:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:13 smithi070 ceph-mon[29591]: osdmap e145: 12 total, 12 up, 12 in 2024-05-08T07:19:13.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:13 smithi194 ceph-mon[33679]: pgmap v1033: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 1.1 MiB/s wr, 347 op/s 2024-05-08T07:19:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:13 smithi194 ceph-mon[33679]: osdmap e145: 12 total, 12 up, 12 in 2024-05-08T07:19:13.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:13 smithi172 ceph-mon[33377]: pgmap v1033: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 1.1 MiB/s wr, 347 op/s 2024-05-08T07:19:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:13 smithi172 ceph-mon[33377]: osdmap e145: 12 total, 12 up, 12 in 2024-05-08T07:19:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:15 smithi194 ceph-mon[33679]: pgmap v1035: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 710 KiB/s wr, 201 op/s 2024-05-08T07:19:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:15 smithi070 ceph-mon[29591]: pgmap v1035: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 710 KiB/s wr, 201 op/s 2024-05-08T07:19:15.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:15 smithi172 ceph-mon[33377]: pgmap v1035: 129 pgs: 129 active+clean; 1.5 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 710 KiB/s wr, 201 op/s 2024-05-08T07:19:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:17 smithi194 ceph-mon[33679]: pgmap v1036: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-05-08T07:19:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:17 smithi070 ceph-mon[29591]: pgmap v1036: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-05-08T07:19:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:17 smithi172 ceph-mon[33377]: pgmap v1036: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-05-08T07:19:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:19 smithi194 ceph-mon[33679]: pgmap v1037: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-05-08T07:19:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:19 smithi070 ceph-mon[29591]: pgmap v1037: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-05-08T07:19:19.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:19 smithi172 ceph-mon[33377]: pgmap v1037: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 1.2 MiB/s wr, 382 op/s 2024-05-08T07:19:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:21 smithi070 ceph-mon[29591]: pgmap v1038: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.1 MiB/s wr, 375 op/s 2024-05-08T07:19:21.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:21 smithi172 ceph-mon[33377]: pgmap v1038: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.1 MiB/s wr, 375 op/s 2024-05-08T07:19:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:21 smithi194 ceph-mon[33679]: pgmap v1038: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.1 MiB/s wr, 375 op/s 2024-05-08T07:19:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:22 smithi070 ceph-mon[29591]: pgmap v1039: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.1 MiB/s wr, 375 op/s 2024-05-08T07:19:22.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:22 smithi172 ceph-mon[33377]: pgmap v1039: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.1 MiB/s wr, 375 op/s 2024-05-08T07:19:23.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:22 smithi194 ceph-mon[33679]: pgmap v1039: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 1.1 MiB/s wr, 375 op/s 2024-05-08T07:19:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:24 smithi194 ceph-mon[33679]: pgmap v1040: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1007 KiB/s wr, 344 op/s 2024-05-08T07:19:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:24 smithi070 ceph-mon[29591]: pgmap v1040: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1007 KiB/s wr, 344 op/s 2024-05-08T07:19:25.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:24 smithi172 ceph-mon[33377]: pgmap v1040: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1007 KiB/s wr, 344 op/s 2024-05-08T07:19:27.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:26 smithi194 ceph-mon[33679]: pgmap v1041: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 1.3 MiB/s wr, 425 op/s 2024-05-08T07:19:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:26 smithi070 ceph-mon[29591]: pgmap v1041: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 1.3 MiB/s wr, 425 op/s 2024-05-08T07:19:27.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:26 smithi172 ceph-mon[33377]: pgmap v1041: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 1.3 MiB/s wr, 425 op/s 2024-05-08T07:19:29.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:28 smithi194 ceph-mon[33679]: pgmap v1042: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 785 KiB/s wr, 162 op/s 2024-05-08T07:19:29.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:28 smithi070 ceph-mon[29591]: pgmap v1042: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 785 KiB/s wr, 162 op/s 2024-05-08T07:19:29.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:28 smithi172 ceph-mon[33377]: pgmap v1042: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 785 KiB/s wr, 162 op/s 2024-05-08T07:19:31.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:30 smithi194 ceph-mon[33679]: pgmap v1043: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.5 MiB/s wr, 268 op/s 2024-05-08T07:19:31.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:30 smithi070 ceph-mon[29591]: pgmap v1043: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.5 MiB/s wr, 268 op/s 2024-05-08T07:19:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:30 smithi172 ceph-mon[33377]: pgmap v1043: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 1.5 MiB/s wr, 268 op/s 2024-05-08T07:19:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:32 smithi194 ceph-mon[33679]: pgmap v1044: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.2 MiB/s wr, 218 op/s 2024-05-08T07:19:33.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:32 smithi070 ceph-mon[29591]: pgmap v1044: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.2 MiB/s wr, 218 op/s 2024-05-08T07:19:33.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:32 smithi172 ceph-mon[33377]: pgmap v1044: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.2 MiB/s wr, 218 op/s 2024-05-08T07:19:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:34 smithi070 ceph-mon[29591]: pgmap v1045: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.2 MiB/s wr, 218 op/s 2024-05-08T07:19:35.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:34 smithi172 ceph-mon[33377]: pgmap v1045: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.2 MiB/s wr, 218 op/s 2024-05-08T07:19:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:34 smithi194 ceph-mon[33679]: pgmap v1045: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 1.2 MiB/s wr, 218 op/s 2024-05-08T07:19:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:36 smithi070 ceph-mon[29591]: pgmap v1046: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 2.1 MiB/s wr, 435 op/s 2024-05-08T07:19:37.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:36 smithi172 ceph-mon[33377]: pgmap v1046: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 2.1 MiB/s wr, 435 op/s 2024-05-08T07:19:37.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:36 smithi194 ceph-mon[33679]: pgmap v1046: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 2.1 MiB/s wr, 435 op/s 2024-05-08T07:19:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:38 smithi070 ceph-mon[29591]: pgmap v1047: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.7 MiB/s wr, 323 op/s 2024-05-08T07:19:39.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:38 smithi172 ceph-mon[33377]: pgmap v1047: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.7 MiB/s wr, 323 op/s 2024-05-08T07:19:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:38 smithi194 ceph-mon[33679]: pgmap v1047: 129 pgs: 129 active+clean; 1.5 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.7 MiB/s wr, 323 op/s 2024-05-08T07:19:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:40 smithi070 ceph-mon[29591]: pgmap v1048: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 2.3 MiB/s wr, 503 op/s 2024-05-08T07:19:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:40 smithi172 ceph-mon[33377]: pgmap v1048: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 2.3 MiB/s wr, 503 op/s 2024-05-08T07:19:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:40 smithi194 ceph-mon[33679]: pgmap v1048: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 2.3 MiB/s wr, 503 op/s 2024-05-08T07:19:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:42 smithi070 ceph-mon[29591]: pgmap v1049: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 397 op/s 2024-05-08T07:19:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:42 smithi172 ceph-mon[33377]: pgmap v1049: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 397 op/s 2024-05-08T07:19:43.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:42 smithi194 ceph-mon[33679]: pgmap v1049: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 397 op/s 2024-05-08T07:19:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:44 smithi070 ceph-mon[29591]: pgmap v1050: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 397 op/s 2024-05-08T07:19:45.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:44 smithi172 ceph-mon[33377]: pgmap v1050: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 397 op/s 2024-05-08T07:19:45.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:44 smithi194 ceph-mon[33679]: pgmap v1050: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 1.5 MiB/s wr, 397 op/s 2024-05-08T07:19:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:46 smithi070 ceph-mon[29591]: pgmap v1051: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.4 MiB/s wr, 537 op/s 2024-05-08T07:19:47.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:46 smithi172 ceph-mon[33377]: pgmap v1051: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.4 MiB/s wr, 537 op/s 2024-05-08T07:19:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:46 smithi194 ceph-mon[33679]: pgmap v1051: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.4 MiB/s wr, 537 op/s 2024-05-08T07:19:48.480 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.4 2024-05-08T07:19:48.481 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:19:48.964 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:19:49.115 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:48 smithi070 ceph-mon[29591]: pgmap v1052: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-05-08T07:19:49.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:48 smithi172 ceph-mon[33377]: pgmap v1052: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-05-08T07:19:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:48 smithi194 ceph-mon[33679]: pgmap v1052: 129 pgs: 129 active+clean; 1.5 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 1.5 MiB/s wr, 319 op/s 2024-05-08T07:19:51.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:50 smithi070 ceph-mon[29591]: pgmap v1053: 129 pgs: 129 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 2.2 MiB/s wr, 488 op/s 2024-05-08T07:19:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:50 smithi172 ceph-mon[33377]: pgmap v1053: 129 pgs: 129 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 2.2 MiB/s wr, 488 op/s 2024-05-08T07:19:51.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:50 smithi194 ceph-mon[33679]: pgmap v1053: 129 pgs: 129 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 2.2 MiB/s wr, 488 op/s 2024-05-08T07:19:51.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.443+0000 7fb863400700 1 -- 172.21.15.70:0/1617654683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c103750 msgr2=0x7fb85c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:51.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.443+0000 7fb863400700 1 --2- 172.21.15.70:0/1617654683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c103750 0x7fb85c103b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb848009990 tx=0x7fb848009ca0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.444+0000 7fb863400700 1 -- 172.21.15.70:0/1617654683 shutdown_connections 2024-05-08T07:19:51.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.444+0000 7fb863400700 1 --2- 172.21.15.70:0/1617654683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb85c108850 0x7fb85c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.444+0000 7fb863400700 1 --2- 172.21.15.70:0/1617654683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c103750 0x7fb85c103b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.444+0000 7fb863400700 1 --2- 172.21.15.70:0/1617654683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c104100 0x7fb85c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.444+0000 7fb863400700 1 -- 172.21.15.70:0/1617654683 >> 172.21.15.70:0/1617654683 conn(0x7fb85c07a600 msgr2=0x7fb85c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:19:51.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.445+0000 7fb863400700 1 -- 172.21.15.70:0/1617654683 shutdown_connections 2024-05-08T07:19:51.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.445+0000 7fb863400700 1 -- 172.21.15.70:0/1617654683 wait complete. 2024-05-08T07:19:51.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.448+0000 7fb863400700 1 Processor -- start 2024-05-08T07:19:51.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.448+0000 7fb863400700 1 -- start start 2024-05-08T07:19:51.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.449+0000 7fb863400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c103750 0x7fb85c1168d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:51.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.449+0000 7fb863400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb85c104100 0x7fb85c112a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:51.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.449+0000 7fb863400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c108850 0x7fb85c113130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:51.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.449+0000 7fb863400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c076230 con 0x7fb85c104100 2024-05-08T07:19:51.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.449+0000 7fb863400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c0760b0 con 0x7fb85c103750 2024-05-08T07:19:51.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.449+0000 7fb863400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c0763b0 con 0x7fb85c108850 2024-05-08T07:19:51.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.450+0000 7fb860a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c103750 0x7fb85c1168d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:51.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.450+0000 7fb860a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c103750 0x7fb85c1168d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:45210/0 (socket says 172.21.15.70:45210) 2024-05-08T07:19:51.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.450+0000 7fb860a00700 1 -- 172.21.15.70:0/3907126767 learned_addr learned my addr 172.21.15.70:0/3907126767 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:19:51.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.450+0000 7fb861400700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c108850 0x7fb85c113130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:51.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.450+0000 7fb85be00700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb85c104100 0x7fb85c112a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:51.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.451+0000 7fb860a00700 1 -- 172.21.15.70:0/3907126767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c108850 msgr2=0x7fb85c113130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:51.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.451+0000 7fb860a00700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c108850 0x7fb85c113130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.451+0000 7fb860a00700 1 -- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb85c104100 msgr2=0x7fb85c112a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:51.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.451+0000 7fb860a00700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb85c104100 0x7fb85c112a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.451+0000 7fb860a00700 1 -- 172.21.15.70:0/3907126767 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c1ac390 con 0x7fb85c103750 2024-05-08T07:19:51.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.451+0000 7fb860a00700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c103750 0x7fb85c1168d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb84800b650 tx=0x7fb848003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:19:51.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.454+0000 7fb859600700 1 -- 172.21.15.70:0/3907126767 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480056d0 con 0x7fb85c103750 2024-05-08T07:19:51.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.454+0000 7fb859600700 1 -- 172.21.15.70:0/3907126767 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb84800bca0 con 0x7fb85c103750 2024-05-08T07:19:51.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.454+0000 7fb859600700 1 -- 172.21.15.70:0/3907126767 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848017650 con 0x7fb85c103750 2024-05-08T07:19:51.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.454+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85c1ac620 con 0x7fb85c103750 2024-05-08T07:19:51.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.454+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85c1aca20 con 0x7fb85c103750 2024-05-08T07:19:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.456+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85c104be0 con 0x7fb85c103750 2024-05-08T07:19:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.460+0000 7fb859600700 1 -- 172.21.15.70:0/3907126767 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb848009d10 con 0x7fb85c103750 2024-05-08T07:19:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.464+0000 7fb859600700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8400b2c50 0x7fb8400b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:51.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.464+0000 7fb859600700 1 -- 172.21.15.70:0/3907126767 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 9583+0+0 (secure 0 0 0) 0x7fb8480e4210 con 0x7fb85c103750 2024-05-08T07:19:51.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.464+0000 7fb85be00700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8400b2c50 0x7fb8400b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:51.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.465+0000 7fb85be00700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8400b2c50 0x7fb8400b5110 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb85c114130 tx=0x7fb84c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:19:51.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.467+0000 7fb859600700 1 -- 172.21.15.70:0/3907126767 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb848013070 con 0x7fb85c103750 2024-05-08T07:19:51.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.828+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb85c06a190 con 0x7fb85c103750 2024-05-08T07:19:51.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.830+0000 7fb859600700 1 -- 172.21.15.70:0/3907126767 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11879 (secure 0 0 0) 0x7fb8480ab800 con 0x7fb85c103750 2024-05-08T07:19:51.830 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:19:51.830 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:17:08.396412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8400b2c50 msgr2=0x7fb8400b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8400b2c50 0x7fb8400b5110 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb85c114130 tx=0x7fb84c009260 comp rx=0 tx=0).stop 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c103750 msgr2=0x7fb85c1168d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c103750 0x7fb85c1168d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb84800b650 tx=0x7fb848003cd0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 shutdown_connections 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8400b2c50 0x7fb8400b5110 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb85c108850 0x7fb85c113130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb85c103750 0x7fb85c1168d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 --2- 172.21.15.70:0/3907126767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb85c104100 0x7fb85c112a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.834+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 >> 172.21.15.70:0/3907126767 conn(0x7fb85c07a600 msgr2=0x7fb85c100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:19:51.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.835+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 shutdown_connections 2024-05-08T07:19:51.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:51.835+0000 7fb863400700 1 -- 172.21.15.70:0/3907126767 wait complete. 2024-05-08T07:19:51.835 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 36 2024-05-08T07:19:52.682 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 89.4 --await-for 42.0' 2024-05-08T07:19:52.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 89.4 --await-for 42.0 2024-05-08T07:19:52.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:52 smithi070 ceph-mon[29591]: pgmap v1054: 129 pgs: 129 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-05-08T07:19:52.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:52 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3907126767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:19:53.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:52 smithi172 ceph-mon[33377]: pgmap v1054: 129 pgs: 129 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-05-08T07:19:53.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:52 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3907126767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:19:53.192 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:19:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:52 smithi194 ceph-mon[33679]: pgmap v1054: 129 pgs: 129 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-05-08T07:19:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:52 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3907126767' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:19:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:54 smithi070 ceph-mon[29591]: pgmap v1055: 129 pgs: 129 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-05-08T07:19:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:54 smithi172 ceph-mon[33377]: pgmap v1055: 129 pgs: 129 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-05-08T07:19:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:54 smithi194 ceph-mon[33679]: pgmap v1055: 129 pgs: 129 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 1.6 MiB/s wr, 308 op/s 2024-05-08T07:19:55.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.660+0000 7f1ddfe00700 1 -- 172.21.15.70:0/1539522963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de01093e0 msgr2=0x7f1de01097c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:55.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.660+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/1539522963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de01093e0 0x7f1de01097c0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000b0a0 tx=0x7f1dd000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.660+0000 7f1ddfe00700 1 -- 172.21.15.70:0/1539522963 shutdown_connections 2024-05-08T07:19:55.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.660+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/1539522963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1de006c3d0 0x7f1de0110220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.660+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/1539522963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de01093e0 0x7f1de01097c0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.660+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/1539522963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1de006ba10 0x7f1de006be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.660+0000 7f1ddfe00700 1 -- 172.21.15.70:0/1539522963 >> 172.21.15.70:0/1539522963 conn(0x7f1de007a140 msgr2=0x7f1de007a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:19:55.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.661+0000 7f1ddfe00700 1 -- 172.21.15.70:0/1539522963 shutdown_connections 2024-05-08T07:19:55.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.661+0000 7f1ddfe00700 1 -- 172.21.15.70:0/1539522963 wait complete. 2024-05-08T07:19:55.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.662+0000 7f1ddfe00700 1 Processor -- start 2024-05-08T07:19:55.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.662+0000 7f1ddfe00700 1 -- start start 2024-05-08T07:19:55.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1ddfe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1de006ba10 0x7f1de019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1ddfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de006c3d0 0x7f1de019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1ddfe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1de01093e0 0x7f1de0199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1ddfe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1de0113430 con 0x7f1de006c3d0 2024-05-08T07:19:55.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1ddfe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01132b0 con 0x7f1de01093e0 2024-05-08T07:19:55.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1ddfe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01135b0 con 0x7f1de006ba10 2024-05-08T07:19:55.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1dd6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de006c3d0 0x7f1de019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1dd6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de006c3d0 0x7f1de019f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53932/0 (socket says 172.21.15.70:53932) 2024-05-08T07:19:55.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1dd6000700 1 -- 172.21.15.70:0/2089623081 learned_addr learned my addr 172.21.15.70:0/2089623081 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:19:55.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.663+0000 7f1ddea00700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1de006ba10 0x7f1de019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.664+0000 7f1ddf400700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1de01093e0 0x7f1de0199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.664+0000 7f1dd6000700 1 -- 172.21.15.70:0/2089623081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1de006ba10 msgr2=0x7f1de019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:55.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.664+0000 7f1dd6000700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1de006ba10 0x7f1de019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.664+0000 7f1dd6000700 1 -- 172.21.15.70:0/2089623081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1de01093e0 msgr2=0x7f1de0199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:55.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.664+0000 7f1dd6000700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1de01093e0 0x7f1de0199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.664+0000 7f1dd6000700 1 -- 172.21.15.70:0/2089623081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1de0199db0 con 0x7f1de006c3d0 2024-05-08T07:19:55.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.664+0000 7f1dd6000700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de006c3d0 0x7f1de019f980 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800c9b0 tx=0x7f1dc800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:19:55.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.665+0000 7f1dd7e00700 1 -- 172.21.15.70:0/2089623081 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc801e070 con 0x7f1de006c3d0 2024-05-08T07:19:55.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.665+0000 7f1dd7e00700 1 -- 172.21.15.70:0/2089623081 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dc80076f0 con 0x7f1de006c3d0 2024-05-08T07:19:55.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.665+0000 7f1ddfe00700 1 -- 172.21.15.70:0/2089623081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de019a040 con 0x7f1de006c3d0 2024-05-08T07:19:55.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.665+0000 7f1dd7e00700 1 -- 172.21.15.70:0/2089623081 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80196a0 con 0x7f1de006c3d0 2024-05-08T07:19:55.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.665+0000 7f1ddfe00700 1 -- 172.21.15.70:0/2089623081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de01025a0 con 0x7f1de006c3d0 2024-05-08T07:19:55.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.671+0000 7f1dd7e00700 1 -- 172.21.15.70:0/2089623081 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1dc8011b60 con 0x7f1de006c3d0 2024-05-08T07:19:55.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.672+0000 7f1df0571b80 1 Processor -- start 2024-05-08T07:19:55.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.672+0000 7f1df0571b80 1 -- start start 2024-05-08T07:19:55.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.673+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e7c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.673+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7c910 0x560eb3e76520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.673+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 0x560eb3e76fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.673+0000 7f1df0571b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560eb3dc8bb0 con 0x560eb3e76b40 2024-05-08T07:19:55.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.673+0000 7f1df0571b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560eb3d668f0 con 0x560eb3e7bff0 2024-05-08T07:19:55.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.673+0000 7f1df0571b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560eb3dc4b70 con 0x560eb3e7c910 2024-05-08T07:19:55.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.673+0000 7f1ddf400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e7c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1ddf400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e7c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:45242/0 (socket says 172.21.15.70:45242) 2024-05-08T07:19:55.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1ddf400700 1 -- 172.21.15.70:0/3351595000 learned_addr learned my addr 172.21.15.70:0/3351595000 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:19:55.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1ddea00700 1 --2- 172.21.15.70:0/3351595000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7c910 0x560eb3e76520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1dd7e00700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dc40b2aa0 0x7f1dc40b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1ddf400700 1 -- 172.21.15.70:0/3351595000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7c910 msgr2=0x560eb3e76520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:19:55.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1ddf400700 1 --2- 172.21.15.70:0/3351595000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7c910 0x560eb3e76520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1dd7e00700 1 -- 172.21.15.70:0/2089623081 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 9583+0+0 (secure 0 0 0) 0x7f1dc80e64c0 con 0x7f1de006c3d0 2024-05-08T07:19:55.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1ddf400700 1 -- 172.21.15.70:0/3351595000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 msgr2=0x560eb3e76fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:19:55.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1ddf400700 1 --2- 172.21.15.70:0/3351595000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 0x560eb3e76fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.674+0000 7f1ddf400700 1 -- 172.21.15.70:0/3351595000 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb3d15a60 con 0x560eb3e7bff0 2024-05-08T07:19:55.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.675+0000 7f1ddf400700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dc40b2aa0 0x7f1dc40b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.675+0000 7f1ddf400700 1 --2- 172.21.15.70:0/3351595000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e7c3d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80078d0 tx=0x7f1dd8007be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5a361be7c427a41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:19:55.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.675+0000 7f1ddf400700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dc40b2aa0 0x7f1dc40b4f60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1dd801c000 tx=0x7f1dd801d000 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:19:55.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.675+0000 7f1dcfe00700 1 -- 172.21.15.70:0/3351595000 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8014910 con 0x560eb3e7bff0 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.675+0000 7f1dcfe00700 1 -- 172.21.15.70:0/3351595000 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dd800d910 con 0x560eb3e7bff0 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.675+0000 7f1dcfe00700 1 -- 172.21.15.70:0/3351595000 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd801e960 con 0x560eb3e7bff0 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.676+0000 7f1df0571b80 1 -- 172.21.15.70:0/3351595000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 msgr2=0x560eb3e7c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.676+0000 7f1df0571b80 1 --2- 172.21.15.70:0/3351595000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e7c3d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80078d0 tx=0x7f1dd8007be0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.677+0000 7f1df0571b80 1 -- 172.21.15.70:0/3351595000 shutdown_connections 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.677+0000 7f1df0571b80 1 --2- 172.21.15.70:0/3351595000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 0x560eb3e76fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.677+0000 7f1df0571b80 1 --2- 172.21.15.70:0/3351595000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e7c3d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.677+0000 7f1df0571b80 1 --2- 172.21.15.70:0/3351595000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7c910 0x560eb3e76520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.677+0000 7f1df0571b80 1 -- 172.21.15.70:0/3351595000 >> 172.21.15.70:0/3351595000 conn(0x560eb3da4cf0 msgr2=0x560eb3e71080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.677+0000 7f1df0571b80 1 -- 172.21.15.70:0/3351595000 shutdown_connections 2024-05-08T07:19:55.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.677+0000 7f1df0571b80 1 -- 172.21.15.70:0/3351595000 wait complete. 2024-05-08T07:19:55.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.677+0000 7f1df0571b80 1 -- start start 2024-05-08T07:19:55.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.678+0000 7f1df0571b80 1 Processor -- start 2024-05-08T07:19:55.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.678+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 0x560eb3e82680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.678+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7bff0 0x560eb3e7fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.678+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e7ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.678+0000 7f1df0571b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560eb3e83430 con 0x560eb3e7bff0 2024-05-08T07:19:55.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.678+0000 7f1df0571b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560eb3d2ecb0 con 0x560eb3e7c910 2024-05-08T07:19:55.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.678+0000 7f1df0571b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560eb3e835b0 con 0x560eb3e76b40 2024-05-08T07:19:55.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.679+0000 7f1df0571b80 10 client.0 _ll_register_callbacks cb 0x560eb3d6fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:19:55.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.679+0000 7f1dd6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7bff0 0x560eb3e7fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.679+0000 7f1ddf400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e7ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.679+0000 7f1ddf400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e7ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:45246/0 (socket says 172.21.15.70:45246) 2024-05-08T07:19:55.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.679+0000 7f1ddf400700 1 -- 172.21.15.70:0/1139463095 learned_addr learned my addr 172.21.15.70:0/1139463095 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:19:55.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.679+0000 7f1ddea00700 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 0x560eb3e82680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.680+0000 7f1dd6000700 1 -- 172.21.15.70:0/1139463095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 msgr2=0x560eb3e82680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:19:55.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.680+0000 7f1dd6000700 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 0x560eb3e82680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.680+0000 7f1dd6000700 1 -- 172.21.15.70:0/1139463095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 msgr2=0x560eb3e7ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:19:55.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.680+0000 7f1dd6000700 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e7ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.680+0000 7f1dd6000700 1 -- 172.21.15.70:0/1139463095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb3d8e5b0 con 0x560eb3e7bff0 2024-05-08T07:19:55.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.680+0000 7f1ddea00700 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 0x560eb3e82680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:19:55.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.680+0000 7f1ddf400700 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e7ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:19:55.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.680+0000 7f1dd6000700 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7bff0 0x560eb3e7fa20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80e3900 tx=0x7f1dc8007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318b4ffd9c348de5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:19:55.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.680+0000 7f1dccc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.681+0000 7f1dccc00700 1 -- 172.21.15.70:0/1139463095 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80b1840 con 0x560eb3e7bff0 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.681+0000 7f1dccc00700 1 -- 172.21.15.70:0/1139463095 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(145..145 src has 1..145) ==== 9583+0+0 (secure 0 0 0) 0x7f1dc80ad900 con 0x560eb3e7bff0 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.681+0000 7f1df0571b80 1 -- 172.21.15.70:0/1139463095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd800d910 con 0x560eb3e7bff0 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.681+0000 7f1dccc00700 1 -- 172.21.15.70:0/1139463095 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1dc80b62f0 con 0x560eb3e7bff0 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.681+0000 7f1df0571b80 10 client.16422 fetch_fsmap learned FSMap version 36 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.681+0000 7f1df0571b80 1 -- 172.21.15.70:0/1139463095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560eb3e8ddb0 con 0x560eb3e7bff0 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.682+0000 7f1dccc00700 1 -- 172.21.15.70:0/1139463095 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dd800d910 con 0x560eb3e7bff0 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.682+0000 7f1dccc00700 1 -- 172.21.15.70:0/1139463095 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f1dc80a7bb0 con 0x560eb3e7bff0 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.682+0000 7f1df0571b80 10 client.16422 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.682+0000 7f1df0571b80 10 client.16422 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.682+0000 7f1df0571b80 20 client.16422 populate_metadata read hostname 'smithi070' 2024-05-08T07:19:55.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.682+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560eb3e90440 0x560eb3e92830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.682+0000 7f1df0571b80 4 client.16422 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:19:55.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.682+0000 7f1df0571b80 1 -- 172.21.15.70:0/1139463095 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560eb3e43230 con 0x560eb3e90440 2024-05-08T07:19:55.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.683+0000 7f1ddea00700 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560eb3e90440 0x560eb3e92830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.684+0000 7f1ddea00700 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560eb3e90440 0x560eb3e92830 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5817d8ca2ad5aaff server_cookie=ac484a294adb28c2 in_seq=0 out_seq=0 2024-05-08T07:19:55.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.684+0000 7f1dccc00700 10 client.16422 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:19:55.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.685+0000 7f1dccc00700 1 -- 172.21.15.70:0/1139463095 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560eb3e43230 con 0x560eb3e90440 2024-05-08T07:19:55.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.685+0000 7f1dccc00700 10 client.16422 handle_command_reply: tid=0 2024-05-08T07:19:55.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.685+0000 7f1df0571b80 1 client.16422 shutdown 2024-05-08T07:19:55.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.685+0000 7f1df0571b80 1 -- 172.21.15.70:0/1139463095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7bff0 msgr2=0x560eb3e7fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:55.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.685+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7bff0 0x560eb3e7fa20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1dc80e3900 tx=0x7f1dc8007dd0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1df0571b80 1 -- 172.21.15.70:0/1139463095 shutdown_connections 2024-05-08T07:19:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560eb3e90440 0x560eb3e92830 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e7ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 0x560eb3e82680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1139463095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7bff0 0x560eb3e7fa20 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1df0571b80 1 -- 172.21.15.70:0/1139463095 >> 172.21.15.70:0/1139463095 conn(0x560eb3da4cf0 msgr2=0x560eb3e75510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:19:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1dccc00700 0 client.16422 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:19:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1df0571b80 1 -- 172.21.15.70:0/1139463095 shutdown_connections 2024-05-08T07:19:55.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1df0571b80 1 -- 172.21.15.70:0/1139463095 wait complete. 2024-05-08T07:19:55.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.686+0000 7f1df0571b80 20 client.16422 trim_cache size 0 max 16384 2024-05-08T07:19:55.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.715+0000 7f1df0571b80 1 Processor -- start 2024-05-08T07:19:55.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.715+0000 7f1df0571b80 1 -- start start 2024-05-08T07:19:55.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 0x560eb3e980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e98610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7c910 0x560eb3e88890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1df0571b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01af9e0 con 0x560eb3e7c910 2024-05-08T07:19:55.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1df0571b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01ad270 con 0x560eb3e7bff0 2024-05-08T07:19:55.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1df0571b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01ab0e0 con 0x560eb3e76b40 2024-05-08T07:19:55.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1ddf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7c910 0x560eb3e88890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1ddf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7c910 0x560eb3e88890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53960/0 (socket says 172.21.15.70:53960) 2024-05-08T07:19:55.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1ddf400700 1 -- 172.21.15.70:0/1487658398 learned_addr learned my addr 172.21.15.70:0/1487658398 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:19:55.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.716+0000 7f1dd6000700 1 --2- 172.21.15.70:0/1487658398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e98610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.717+0000 7f1ddea00700 1 --2- 172.21.15.70:0/1487658398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 0x560eb3e980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.717+0000 7f1ddf400700 1 -- 172.21.15.70:0/1487658398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 msgr2=0x560eb3e980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:19:55.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.717+0000 7f1ddf400700 1 --2- 172.21.15.70:0/1487658398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 0x560eb3e980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.717+0000 7f1ddf400700 1 -- 172.21.15.70:0/1487658398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 msgr2=0x560eb3e98610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:19:55.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.717+0000 7f1ddf400700 1 --2- 172.21.15.70:0/1487658398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e98610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.717+0000 7f1ddf400700 1 -- 172.21.15.70:0/1487658398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eb3e6d9b0 con 0x560eb3e7c910 2024-05-08T07:19:55.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.717+0000 7f1ddf400700 1 --2- 172.21.15.70:0/1487658398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7c910 0x560eb3e88890 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8014aa0 tx=0x7f1dd8004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3f861d3600ac57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:19:55.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.718+0000 7f1dcf400700 1 -- 172.21.15.70:0/1487658398 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd802d020 con 0x560eb3e7c910 2024-05-08T07:19:55.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.718+0000 7f1dcf400700 1 -- 172.21.15.70:0/1487658398 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dd800d910 con 0x560eb3e7c910 2024-05-08T07:19:55.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.718+0000 7f1dcf400700 1 -- 172.21.15.70:0/1487658398 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd801ecc0 con 0x560eb3e7c910 2024-05-08T07:19:55.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.719+0000 7f1df0571b80 1 -- 172.21.15.70:0/1487658398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7c910 msgr2=0x560eb3e88890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:19:55.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.719+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1487658398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7c910 0x560eb3e88890 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f1dd8014aa0 tx=0x7f1dd8004860 comp rx=0 tx=0).stop 2024-05-08T07:19:55.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.719+0000 7f1df0571b80 1 -- 172.21.15.70:0/1487658398 shutdown_connections 2024-05-08T07:19:55.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.719+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1487658398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e7c910 0x560eb3e88890 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.719+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1487658398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e76b40 0x560eb3e980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.719+0000 7f1df0571b80 1 --2- 172.21.15.70:0/1487658398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7bff0 0x560eb3e98610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.719+0000 7f1df0571b80 1 -- 172.21.15.70:0/1487658398 >> 172.21.15.70:0/1487658398 conn(0x560eb3da4cf0 msgr2=0x560eb3e70ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:19:55.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.720+0000 7f1df0571b80 1 -- 172.21.15.70:0/1487658398 shutdown_connections 2024-05-08T07:19:55.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.720+0000 7f1df0571b80 1 -- 172.21.15.70:0/1487658398 wait complete. 2024-05-08T07:19:55.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.720+0000 7f1df0571b80 1 -- start start 2024-05-08T07:19:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.720+0000 7f1df0571b80 1 Processor -- start 2024-05-08T07:19:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 0x560eb3e85870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7bff0 0x560eb3e85db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1df0571b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e862f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1df0571b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01ab730 con 0x560eb3e76b40 2024-05-08T07:19:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1df0571b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01acba0 con 0x560eb3e7c910 2024-05-08T07:19:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1df0571b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1de01abe00 con 0x560eb3e7bff0 2024-05-08T07:19:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1df0571b80 10 client.0 _ll_register_callbacks cb 0x560eb3e7a690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:19:55.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1ddea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 0x560eb3e85870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1ddea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 0x560eb3e85870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53966/0 (socket says 172.21.15.70:53966) 2024-05-08T07:19:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1ddea00700 1 -- 172.21.15.70:0/2282463609 learned_addr learned my addr 172.21.15.70:0/2282463609 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:19:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.721+0000 7f1ddf400700 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.722+0000 7f1dd6000700 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7bff0 0x560eb3e85db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.722+0000 7f1ddea00700 1 -- 172.21.15.70:0/2282463609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7bff0 msgr2=0x560eb3e85db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:19:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.722+0000 7f1ddea00700 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7bff0 0x560eb3e85db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.722+0000 7f1ddea00700 1 -- 172.21.15.70:0/2282463609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 msgr2=0x560eb3e862f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:19:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.722+0000 7f1ddea00700 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e862f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:19:55.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.722+0000 7f1ddea00700 1 -- 172.21.15.70:0/2282463609 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eb3efad10 con 0x560eb3e76b40 2024-05-08T07:19:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.723+0000 7f1ddea00700 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 0x560eb3e85870 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000d010 tx=0x7f1dd0003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275473e015b5ca64 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:19:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.723+0000 7f1dccc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:19:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.723+0000 7f1dccc00700 1 -- 172.21.15.70:0/2282463609 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00076f0 con 0x560eb3e76b40 2024-05-08T07:19:55.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.723+0000 7f1dccc00700 1 -- 172.21.15.70:0/2282463609 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(145..145 src has 1..145) ==== 9583+0+0 (secure 0 0 0) 0x7f1dd0007890 con 0x560eb3e76b40 2024-05-08T07:19:55.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.723+0000 7f1df0571b80 1 -- 172.21.15.70:0/2282463609 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dd800d910 con 0x560eb3e76b40 2024-05-08T07:19:55.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.724+0000 7f1dccc00700 1 -- 172.21.15.70:0/2282463609 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1dd0007a90 con 0x560eb3e76b40 2024-05-08T07:19:55.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.724+0000 7f1df0571b80 10 client.16428 fetch_fsmap learned FSMap version 36 2024-05-08T07:19:55.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.724+0000 7f1df0571b80 1 -- 172.21.15.70:0/2282463609 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560eb3efbfb0 con 0x560eb3e76b40 2024-05-08T07:19:55.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.725+0000 7f1dccc00700 1 -- 172.21.15.70:0/2282463609 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1dd800d910 con 0x560eb3e76b40 2024-05-08T07:19:55.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.725+0000 7f1dccc00700 1 -- 172.21.15.70:0/2282463609 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f1dd0011070 con 0x560eb3e76b40 2024-05-08T07:19:55.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.725+0000 7f1df0571b80 10 client.16428 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:19:55.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.725+0000 7f1df0571b80 10 client.16428 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:19:55.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.725+0000 7f1df0571b80 20 client.16428 populate_metadata read hostname 'smithi070' 2024-05-08T07:19:55.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.725+0000 7f1df0571b80 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560eb3efc6c0 0x560eb3efeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:19:55.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.725+0000 7f1df0571b80 4 client.16428 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.4, "await_for": 42.0}] 2024-05-08T07:19:55.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.725+0000 7f1df0571b80 1 -- 172.21.15.70:0/2282463609 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.4, "await_for": 42.0}) -- 0x560eb3dd6590 con 0x560eb3efc6c0 2024-05-08T07:19:55.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.726+0000 7f1dd6000700 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560eb3efc6c0 0x560eb3efeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:19:55.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.727+0000 7f1dccc00700 10 client.16428 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:19:55.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:19:55.727+0000 7f1dd6000700 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560eb3efc6c0 0x560eb3efeae0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c558895b5a4e48 server_cookie=ac2227e83c4dfed1 in_seq=0 out_seq=0 2024-05-08T07:19:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:56 smithi070 ceph-mon[29591]: pgmap v1056: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 2.6 MiB/s wr, 440 op/s 2024-05-08T07:19:57.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:56 smithi172 ceph-mon[33377]: pgmap v1056: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 2.6 MiB/s wr, 440 op/s 2024-05-08T07:19:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:56 smithi194 ceph-mon[33679]: pgmap v1056: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 2.6 MiB/s wr, 440 op/s 2024-05-08T07:19:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:19:58 smithi070 ceph-mon[29591]: pgmap v1057: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-05-08T07:19:59.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:19:58 smithi172 ceph-mon[33377]: pgmap v1057: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-05-08T07:19:59.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:19:58 smithi194 ceph-mon[33679]: pgmap v1057: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 1.7 MiB/s wr, 300 op/s 2024-05-08T07:20:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:00 smithi070 ceph-mon[29591]: pgmap v1058: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-05-08T07:20:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T07:20:01.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:00 smithi172 ceph-mon[33377]: pgmap v1058: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-05-08T07:20:01.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T07:20:01.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:00 smithi194 ceph-mon[33679]: pgmap v1058: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 2.0 MiB/s wr, 325 op/s 2024-05-08T07:20:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T07:20:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:02 smithi070 ceph-mon[29591]: pgmap v1059: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-05-08T07:20:03.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:02 smithi172 ceph-mon[33377]: pgmap v1059: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-05-08T07:20:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:02 smithi194 ceph-mon[33679]: pgmap v1059: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-05-08T07:20:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:04 smithi070 ceph-mon[29591]: pgmap v1060: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-05-08T07:20:05.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:04 smithi172 ceph-mon[33377]: pgmap v1060: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-05-08T07:20:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:04 smithi194 ceph-mon[33679]: pgmap v1060: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 1.3 MiB/s wr, 157 op/s 2024-05-08T07:20:07.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:06 smithi070 ceph-mon[29591]: pgmap v1061: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 1.3 MiB/s wr, 162 op/s 2024-05-08T07:20:07.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:06 smithi172 ceph-mon[33377]: pgmap v1061: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 1.3 MiB/s wr, 162 op/s 2024-05-08T07:20:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:06 smithi194 ceph-mon[33679]: pgmap v1061: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 1.3 MiB/s wr, 162 op/s 2024-05-08T07:20:09.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:08 smithi070 ceph-mon[29591]: pgmap v1062: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 287 KiB/s wr, 30 op/s 2024-05-08T07:20:09.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:08 smithi172 ceph-mon[33377]: pgmap v1062: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 287 KiB/s wr, 30 op/s 2024-05-08T07:20:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:08 smithi194 ceph-mon[33679]: pgmap v1062: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 287 KiB/s wr, 30 op/s 2024-05-08T07:20:11.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:10 smithi070 ceph-mon[29591]: pgmap v1063: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 309 KiB/s wr, 47 op/s 2024-05-08T07:20:11.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:20:11.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:10 smithi172 ceph-mon[33377]: pgmap v1063: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 309 KiB/s wr, 47 op/s 2024-05-08T07:20:11.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:20:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:10 smithi194 ceph-mon[33679]: pgmap v1063: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 309 KiB/s wr, 47 op/s 2024-05-08T07:20:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:20:13.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:12 smithi172 ceph-mon[33377]: pgmap v1064: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-05-08T07:20:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:12 smithi194 ceph-mon[33679]: pgmap v1064: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-05-08T07:20:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:12 smithi070 ceph-mon[29591]: pgmap v1064: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-05-08T07:20:15.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:14 smithi172 ceph-mon[33377]: pgmap v1065: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-05-08T07:20:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:14 smithi172 ceph-mon[33377]: osdmap e146: 12 total, 12 up, 12 in 2024-05-08T07:20:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:14 smithi194 ceph-mon[33679]: pgmap v1065: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-05-08T07:20:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:14 smithi194 ceph-mon[33679]: osdmap e146: 12 total, 12 up, 12 in 2024-05-08T07:20:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:14 smithi070 ceph-mon[29591]: pgmap v1065: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-05-08T07:20:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:14 smithi070 ceph-mon[29591]: osdmap e146: 12 total, 12 up, 12 in 2024-05-08T07:20:16.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1dccc00700 1 -- 172.21.15.70:0/2282463609 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560eb3dd6590 con 0x560eb3efc6c0 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1dccc00700 10 client.16428 handle_command_reply: tid=0 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1df0571b80 1 client.16428 shutdown 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1df0571b80 1 -- 172.21.15.70:0/2282463609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 msgr2=0x560eb3e85870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1df0571b80 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 0x560eb3e85870 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000d010 tx=0x7f1dd0003db0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1df0571b80 1 -- 172.21.15.70:0/2282463609 shutdown_connections 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1df0571b80 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560eb3efc6c0 0x560eb3efeae0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1df0571b80 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560eb3e7c910 0x560eb3e862f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1df0571b80 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560eb3e76b40 0x560eb3e85870 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1df0571b80 1 --2- 172.21.15.70:0/2282463609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560eb3e7bff0 0x560eb3e85db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1df0571b80 1 -- 172.21.15.70:0/2282463609 >> 172.21.15.70:0/2282463609 conn(0x560eb3da4cf0 msgr2=0x560eb3e7e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.107+0000 7f1dccc00700 0 client.16428 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.108+0000 7f1df0571b80 1 -- 172.21.15.70:0/2282463609 shutdown_connections 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.108+0000 7f1df0571b80 1 -- 172.21.15.70:0/2282463609 wait complete. 2024-05-08T07:20:16.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.108+0000 7f1df0571b80 20 client.16428 trim_cache size 0 max 16384 2024-05-08T07:20:16.109 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:20:16.109 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 36, 2024-05-08T07:20:16.109 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:20:16.109 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 86, 2024-05-08T07:20:16.109 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:20:16.109 INFO:teuthology.orchestra.run.smithi070.stdout: "24670a6": { 2024-05-08T07:20:16.109 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 86, 2024-05-08T07:20:16.109 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 89.4, 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:20:16.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:16.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:16.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:16.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:16.111 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:16.111 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:20:16.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 -- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dc40b2aa0 msgr2=0x7f1dc40b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dc40b2aa0 0x7f1dc40b4f60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1dd801c000 tx=0x7f1dd801d000 comp rx=0 tx=0).stop 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 -- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de006c3d0 msgr2=0x7f1de019f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de006c3d0 0x7f1de019f980 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800c9b0 tx=0x7f1dc800ccc0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 -- 172.21.15.70:0/2089623081 shutdown_connections 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1dc40b2aa0 0x7f1dc40b4f60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1de01093e0 0x7f1de0199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1de006ba10 0x7f1de019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 --2- 172.21.15.70:0/2089623081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1de006c3d0 0x7f1de019f980 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 -- 172.21.15.70:0/2089623081 >> 172.21.15.70:0/2089623081 conn(0x7f1de007a140 msgr2=0x7f1de0101110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.110+0000 7f1ddfe00700 1 -- 172.21.15.70:0/2089623081 shutdown_connections 2024-05-08T07:20:16.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:16.111+0000 7f1ddfe00700 1 -- 172.21.15.70:0/2089623081 wait complete. 2024-05-08T07:20:17.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:16 smithi172 ceph-mon[33377]: pgmap v1067: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 283 KiB/s wr, 226 op/s 2024-05-08T07:20:17.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:16 smithi070 ceph-mon[29591]: pgmap v1067: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 283 KiB/s wr, 226 op/s 2024-05-08T07:20:17.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:16 smithi194 ceph-mon[33679]: pgmap v1067: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 283 KiB/s wr, 226 op/s 2024-05-08T07:20:17.309 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '24670a6', quiesce took 28.8 seconds. Will release after: 29.4 2024-05-08T07:20:19.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:18 smithi172 ceph-mon[33377]: pgmap v1068: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 283 KiB/s wr, 226 op/s 2024-05-08T07:20:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:18 smithi194 ceph-mon[33679]: pgmap v1068: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 283 KiB/s wr, 226 op/s 2024-05-08T07:20:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:18 smithi070 ceph-mon[29591]: pgmap v1068: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 283 KiB/s wr, 226 op/s 2024-05-08T07:20:20.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:20:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:20:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:20:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:20:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:20:20.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:20:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:20:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:20:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:20:21.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:20 smithi172 ceph-mon[33377]: pgmap v1069: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 486 KiB/s wr, 340 op/s 2024-05-08T07:20:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:20 smithi194 ceph-mon[33679]: pgmap v1069: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 486 KiB/s wr, 340 op/s 2024-05-08T07:20:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:20 smithi070 ceph-mon[29591]: pgmap v1069: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 486 KiB/s wr, 340 op/s 2024-05-08T07:20:23.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:22 smithi172 ceph-mon[33377]: pgmap v1070: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 486 KiB/s wr, 340 op/s 2024-05-08T07:20:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:22 smithi172 ceph-mon[33377]: osdmap e147: 12 total, 12 up, 12 in 2024-05-08T07:20:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:22 smithi194 ceph-mon[33679]: pgmap v1070: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 486 KiB/s wr, 340 op/s 2024-05-08T07:20:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:22 smithi194 ceph-mon[33679]: osdmap e147: 12 total, 12 up, 12 in 2024-05-08T07:20:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:22 smithi070 ceph-mon[29591]: pgmap v1070: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 486 KiB/s wr, 340 op/s 2024-05-08T07:20:23.537 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:22 smithi070 ceph-mon[29591]: osdmap e147: 12 total, 12 up, 12 in 2024-05-08T07:20:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:24 smithi194 ceph-mon[33679]: pgmap v1072: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 270 KiB/s wr, 247 op/s 2024-05-08T07:20:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:24 smithi070 ceph-mon[29591]: pgmap v1072: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 270 KiB/s wr, 247 op/s 2024-05-08T07:20:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:24 smithi172 ceph-mon[33377]: pgmap v1072: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 270 KiB/s wr, 247 op/s 2024-05-08T07:20:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:26 smithi194 ceph-mon[33679]: pgmap v1073: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 240 KiB/s wr, 137 op/s 2024-05-08T07:20:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:26 smithi070 ceph-mon[29591]: pgmap v1073: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 240 KiB/s wr, 137 op/s 2024-05-08T07:20:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:26 smithi172 ceph-mon[33377]: pgmap v1073: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 240 KiB/s wr, 137 op/s 2024-05-08T07:20:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:28 smithi194 ceph-mon[33679]: pgmap v1074: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 240 KiB/s wr, 137 op/s 2024-05-08T07:20:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:28 smithi070 ceph-mon[29591]: pgmap v1074: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 240 KiB/s wr, 137 op/s 2024-05-08T07:20:29.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:28 smithi172 ceph-mon[33377]: pgmap v1074: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 240 KiB/s wr, 137 op/s 2024-05-08T07:20:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:30 smithi194 ceph-mon[33679]: pgmap v1075: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:20:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:30 smithi070 ceph-mon[29591]: pgmap v1075: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:20:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:30 smithi172 ceph-mon[33377]: pgmap v1075: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:20:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:32 smithi194 ceph-mon[33679]: pgmap v1076: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:20:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:32 smithi070 ceph-mon[29591]: pgmap v1076: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:20:33.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:32 smithi172 ceph-mon[33377]: pgmap v1076: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T07:20:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:34 smithi194 ceph-mon[33679]: pgmap v1077: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:20:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:34 smithi070 ceph-mon[29591]: pgmap v1077: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:20:35.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:34 smithi172 ceph-mon[33377]: pgmap v1077: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:20:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:36 smithi194 ceph-mon[33679]: pgmap v1078: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-05-08T07:20:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:36 smithi070 ceph-mon[29591]: pgmap v1078: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-05-08T07:20:37.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:36 smithi172 ceph-mon[33377]: pgmap v1078: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 10 KiB/s wr, 8 op/s 2024-05-08T07:20:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:38 smithi194 ceph-mon[33679]: pgmap v1079: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-05-08T07:20:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:38 smithi070 ceph-mon[29591]: pgmap v1079: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-05-08T07:20:39.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:38 smithi172 ceph-mon[33377]: pgmap v1079: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.9 KiB/s wr, 5 op/s 2024-05-08T07:20:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:40 smithi194 ceph-mon[33679]: pgmap v1080: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-05-08T07:20:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:40 smithi070 ceph-mon[29591]: pgmap v1080: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-05-08T07:20:41.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:40 smithi172 ceph-mon[33377]: pgmap v1080: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.9 KiB/s wr, 7 op/s 2024-05-08T07:20:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:42 smithi194 ceph-mon[33679]: pgmap v1081: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5 op/s 2024-05-08T07:20:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:42 smithi070 ceph-mon[29591]: pgmap v1081: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5 op/s 2024-05-08T07:20:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:42 smithi172 ceph-mon[33377]: pgmap v1081: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5 op/s 2024-05-08T07:20:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:44 smithi194 ceph-mon[33679]: pgmap v1082: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5 op/s 2024-05-08T07:20:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:44 smithi070 ceph-mon[29591]: pgmap v1082: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5 op/s 2024-05-08T07:20:45.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:44 smithi172 ceph-mon[33377]: pgmap v1082: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 5 op/s 2024-05-08T07:20:46.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:20:47.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:46 smithi070 ceph-mon[29591]: pgmap v1083: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7 op/s 2024-05-08T07:20:47.177 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:20:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:46 smithi194 ceph-mon[33679]: pgmap v1083: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7 op/s 2024-05-08T07:20:47.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:46 smithi172 ceph-mon[33377]: pgmap v1083: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 7 op/s 2024-05-08T07:20:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:49 smithi070 ceph-mon[29591]: pgmap v1084: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:20:49.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:49 smithi194 ceph-mon[33679]: pgmap v1084: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:20:49.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:49 smithi172 ceph-mon[33377]: pgmap v1084: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:20:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.771+0000 7f88ad200700 1 -- 172.21.15.70:0/324637357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 msgr2=0x7f88a8105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.771+0000 7f88ad200700 1 --2- 172.21.15.70:0/324637357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 0x7f88a8105b60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8894009990 tx=0x7f8894009ca0 comp rx=0 tx=0).stop 2024-05-08T07:20:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.771+0000 7f88ad200700 1 -- 172.21.15.70:0/324637357 shutdown_connections 2024-05-08T07:20:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.771+0000 7f88ad200700 1 --2- 172.21.15.70:0/324637357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a81060a0 0x7f88a81125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:49.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.771+0000 7f88ad200700 1 --2- 172.21.15.70:0/324637357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a810b6e0 0x7f88a810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:49.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.771+0000 7f88ad200700 1 --2- 172.21.15.70:0/324637357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 0x7f88a8105b60 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:49.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.771+0000 7f88ad200700 1 -- 172.21.15.70:0/324637357 >> 172.21.15.70:0/324637357 conn(0x7f88a81011d0 msgr2=0x7f88a81035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:49.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.772+0000 7f88ad200700 1 -- 172.21.15.70:0/324637357 shutdown_connections 2024-05-08T07:20:49.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.772+0000 7f88ad200700 1 -- 172.21.15.70:0/324637357 wait complete. 2024-05-08T07:20:49.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.773+0000 7f88ad200700 1 Processor -- start 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.773+0000 7f88ad200700 1 -- start start 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88ad200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 0x7f88a81a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88ad200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a81060a0 0x7f88a81a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88ad200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a810b6e0 0x7f88a819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88ad200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88a8115820 con 0x7f88a81056e0 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88ad200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f88a81156a0 con 0x7f88a810b6e0 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88ad200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f88a81159a0 con 0x7f88a81060a0 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88a5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 0x7f88a81a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88a5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 0x7f88a81a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59498/0 (socket says 172.21.15.70:59498) 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88a5e00700 1 -- 172.21.15.70:0/2049778336 learned_addr learned my addr 172.21.15.70:0/2049778336 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88a5400700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a81060a0 0x7f88a81a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.774+0000 7f88a6800700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a810b6e0 0x7f88a819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:49.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f88a5e00700 1 -- 172.21.15.70:0/2049778336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a81060a0 msgr2=0x7f88a81a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f88a5e00700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a81060a0 0x7f88a81a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f88a5e00700 1 -- 172.21.15.70:0/2049778336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a810b6e0 msgr2=0x7f88a819bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f88a5e00700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a810b6e0 0x7f88a819bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f88a5e00700 1 -- 172.21.15.70:0/2049778336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a819c260 con 0x7f88a81056e0 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f88a5e00700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 0x7f88a81a18f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f889800d980 tx=0x7f889800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f889ea00700 1 -- 172.21.15.70:0/2049778336 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898017070 con 0x7f88a81056e0 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f889ea00700 1 -- 172.21.15.70:0/2049778336 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8898004830 con 0x7f88a81056e0 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a819c550 con 0x7f88a81056e0 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f889ea00700 1 -- 172.21.15.70:0/2049778336 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88980053a0 con 0x7f88a81056e0 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.775+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a81a87c0 con 0x7f88a81056e0 2024-05-08T07:20:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.777+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a806a190 con 0x7f88a81056e0 2024-05-08T07:20:49.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.779+0000 7f889ea00700 1 -- 172.21.15.70:0/2049778336 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f88980049e0 con 0x7f88a81056e0 2024-05-08T07:20:49.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.781+0000 7f889ea00700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f888c0b29f0 0x7f888c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:49.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.782+0000 7f889ea00700 1 -- 172.21.15.70:0/2049778336 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 9583+0+0 (secure 0 0 0) 0x7f88980e2df0 con 0x7f88a81056e0 2024-05-08T07:20:49.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.782+0000 7f88a5400700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f888c0b29f0 0x7f888c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:49.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.783+0000 7f88a5400700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f888c0b29f0 0x7f888c0b4eb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f889400b5c0 tx=0x7f889401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:20:49.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:49.784+0000 7f889ea00700 1 -- 172.21.15.70:0/2049778336 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8898020020 con 0x7f88a81056e0 2024-05-08T07:20:50.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.065+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88a802e510 con 0x7f88a81056e0 2024-05-08T07:20:50.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.067+0000 7f889ea00700 1 -- 172.21.15.70:0/2049778336 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11879 (secure 0 0 0) 0x7f88980aa350 con 0x7f88a81056e0 2024-05-08T07:20:50.067 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:20:50.067 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:17:08.396412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:20:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f888c0b29f0 msgr2=0x7f888c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f888c0b29f0 0x7f888c0b4eb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f889400b5c0 tx=0x7f889401a040 comp rx=0 tx=0).stop 2024-05-08T07:20:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 msgr2=0x7f88a81a18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:50.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 0x7f88a81a18f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f889800d980 tx=0x7f889800dd40 comp rx=0 tx=0).stop 2024-05-08T07:20:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 shutdown_connections 2024-05-08T07:20:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f888c0b29f0 0x7f888c0b4eb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f88a810b6e0 0x7f88a819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f88a81056e0 0x7f88a81a18f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 --2- 172.21.15.70:0/2049778336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a81060a0 0x7f88a81a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 >> 172.21.15.70:0/2049778336 conn(0x7f88a81011d0 msgr2=0x7f88a81019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 shutdown_connections 2024-05-08T07:20:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:50.071+0000 7f88ad200700 1 -- 172.21.15.70:0/2049778336 wait complete. 2024-05-08T07:20:50.071 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 36 2024-05-08T07:20:50.924 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 24670a6 --release --await' 2024-05-08T07:20:50.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 24670a6 --release --await 2024-05-08T07:20:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:51 smithi070 ceph-mon[29591]: pgmap v1085: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T07:20:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:51 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2049778336' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:20:51.362 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:20:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:51 smithi172 ceph-mon[33377]: pgmap v1085: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T07:20:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:51 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2049778336' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:20:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:51 smithi194 ceph-mon[33679]: pgmap v1085: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T07:20:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:51 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2049778336' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:20:53.087 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:53 smithi070 ceph-mon[29591]: pgmap v1086: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:20:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:53 smithi172 ceph-mon[33377]: pgmap v1086: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:20:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:53 smithi194 ceph-mon[33679]: pgmap v1086: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:20:53.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.655+0000 7f4397c00700 1 -- 172.21.15.70:0/196570886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f439010fb60 msgr2=0x7f439010ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.655+0000 7f4397c00700 1 --2- 172.21.15.70:0/196570886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f439010fb60 0x7f439010ff40 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4384009990 tx=0x7f4384009ca0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.655+0000 7f4397c00700 1 -- 172.21.15.70:0/196570886 shutdown_connections 2024-05-08T07:20:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.655+0000 7f4397c00700 1 --2- 172.21.15.70:0/196570886 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f439010a490 0x7f43901169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.655+0000 7f4397c00700 1 --2- 172.21.15.70:0/196570886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f439010fb60 0x7f439010ff40 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.655+0000 7f4397c00700 1 --2- 172.21.15.70:0/196570886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4390109ad0 0x7f4390109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.655+0000 7f4397c00700 1 -- 172.21.15.70:0/196570886 >> 172.21.15.70:0/196570886 conn(0x7f4390076c70 msgr2=0x7f43901082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.655+0000 7f4397c00700 1 -- 172.21.15.70:0/196570886 shutdown_connections 2024-05-08T07:20:53.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.655+0000 7f4397c00700 1 -- 172.21.15.70:0/196570886 wait complete. 2024-05-08T07:20:53.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.656+0000 7f4397c00700 1 Processor -- start 2024-05-08T07:20:53.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4397c00700 1 -- start start 2024-05-08T07:20:53.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4397c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4390109ad0 0x7f43901a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4397c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f439010a490 0x7f43901a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4397c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f439010fb60 0x7f43901a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4397c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4390119bd0 con 0x7f4390109ad0 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4397c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4390119a50 con 0x7f439010fb60 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4397c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4390119d50 con 0x7f439010a490 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4395200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4390109ad0 0x7f43901a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4395200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4390109ad0 0x7f43901a0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59520/0 (socket says 172.21.15.70:59520) 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.657+0000 7f4395200700 1 -- 172.21.15.70:0/202163954 learned_addr learned my addr 172.21.15.70:0/202163954 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.658+0000 7f438fe00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f439010a490 0x7f43901a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.658+0000 7f4395c00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f439010fb60 0x7f43901a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.658+0000 7f4395200700 1 -- 172.21.15.70:0/202163954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f439010a490 msgr2=0x7f43901a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.658+0000 7f4395200700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f439010a490 0x7f43901a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.658+0000 7f4395200700 1 -- 172.21.15.70:0/202163954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f439010fb60 msgr2=0x7f43901a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:53.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.658+0000 7f4395200700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f439010fb60 0x7f43901a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.658+0000 7f4395200700 1 -- 172.21.15.70:0/202163954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43901a5090 con 0x7f4390109ad0 2024-05-08T07:20:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.658+0000 7f4395200700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4390109ad0 0x7f43901a0080 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4384005910 tx=0x7f4384009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:20:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.659+0000 7f438d600700 1 -- 172.21.15.70:0/202163954 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384027070 con 0x7f4390109ad0 2024-05-08T07:20:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.659+0000 7f438d600700 1 -- 172.21.15.70:0/202163954 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f438400fce0 con 0x7f4390109ad0 2024-05-08T07:20:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.659+0000 7f4397c00700 1 -- 172.21.15.70:0/202163954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43901a5320 con 0x7f4390109ad0 2024-05-08T07:20:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.659+0000 7f438d600700 1 -- 172.21.15.70:0/202163954 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43840173f0 con 0x7f4390109ad0 2024-05-08T07:20:53.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.659+0000 7f4397c00700 1 -- 172.21.15.70:0/202163954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43901acc00 con 0x7f4390109ad0 2024-05-08T07:20:53.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.662+0000 7f438d600700 1 -- 172.21.15.70:0/202163954 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f438402a070 con 0x7f4390109ad0 2024-05-08T07:20:53.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.663+0000 7f43a2609b80 1 Processor -- start 2024-05-08T07:20:53.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f43a2609b80 1 -- start start 2024-05-08T07:20:53.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f438d600700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43780b29f0 0x7f43780b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff9692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f438d600700 1 -- 172.21.15.70:0/202163954 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 9583+0+0 (secure 0 0 0) 0x7f43840e3b40 con 0x7f4390109ad0 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff963910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 0x564fff96fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f43a2609b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564fff8b5b20 con 0x564fff963490 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f43a2609b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564fff853860 con 0x564fff963e50 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f43a2609b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564fff8b1ae0 con 0x564fff968ec0 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.664+0000 7f438fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff963910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f438fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff963910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59524/0 (socket says 172.21.15.70:59524) 2024-05-08T07:20:53.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f438fe00700 1 -- 172.21.15.70:0/3028214084 learned_addr learned my addr 172.21.15.70:0/3028214084 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f4395c00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43780b29f0 0x7f43780b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f4395200700 1 --2- 172.21.15.70:0/3028214084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff9692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f4395c00700 1 --2- 172.21.15.70:0/3028214084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 0x564fff96fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f438fe00700 1 -- 172.21.15.70:0/3028214084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 msgr2=0x564fff9692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f438fe00700 1 --2- 172.21.15.70:0/3028214084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff9692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f438fe00700 1 -- 172.21.15.70:0/3028214084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 msgr2=0x564fff96fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f438fe00700 1 --2- 172.21.15.70:0/3028214084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 0x564fff96fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f438fe00700 1 -- 172.21.15.70:0/3028214084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fff8029d0 con 0x564fff963490 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.665+0000 7f438fe00700 1 --2- 172.21.15.70:0/3028214084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff963910 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f437c005e00 tx=0x7f437c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e482b704f214fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.666+0000 7f4395c00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43780b29f0 0x7f43780b4eb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4388007fd0 tx=0x7f43880132f0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.666+0000 7f4382000700 1 -- 172.21.15.70:0/3028214084 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c014070 con 0x564fff963490 2024-05-08T07:20:53.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.666+0000 7f4382000700 1 -- 172.21.15.70:0/3028214084 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f437c00edc0 con 0x564fff963490 2024-05-08T07:20:53.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.666+0000 7f4382000700 1 -- 172.21.15.70:0/3028214084 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c010650 con 0x564fff963490 2024-05-08T07:20:53.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 -- 172.21.15.70:0/3028214084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 msgr2=0x564fff963910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:53.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3028214084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff963910 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f437c005e00 tx=0x7f437c00cf50 comp rx=0 tx=0).stop 2024-05-08T07:20:53.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 -- 172.21.15.70:0/3028214084 shutdown_connections 2024-05-08T07:20:53.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3028214084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 0x564fff96fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3028214084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff9692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3028214084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff963910 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 -- 172.21.15.70:0/3028214084 >> 172.21.15.70:0/3028214084 conn(0x564fff891c60 msgr2=0x564fff95dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:53.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 -- 172.21.15.70:0/3028214084 shutdown_connections 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 -- 172.21.15.70:0/3028214084 wait complete. 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.667+0000 7f43a2609b80 1 -- start start 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.668+0000 7f43a2609b80 1 Processor -- start 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.668+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963490 0x564fff96f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.668+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff96cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.668+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff96d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.668+0000 7f43a2609b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564fff970280 con 0x564fff963e50 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.668+0000 7f43a2609b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564fff81bc20 con 0x564fff963490 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.668+0000 7f43a2609b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564fff970400 con 0x564fff968ec0 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.668+0000 7f43a2609b80 10 client.0 _ll_register_callbacks cb 0x564fff85cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f438fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff96cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f438fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff96cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59530/0 (socket says 172.21.15.70:59530) 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f438fe00700 1 -- 172.21.15.70:0/1131020064 learned_addr learned my addr 172.21.15.70:0/1131020064 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f4395200700 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963490 0x564fff96f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f438fe00700 1 -- 172.21.15.70:0/1131020064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 msgr2=0x564fff96d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f4395c00700 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff96d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f438fe00700 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff96d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f438fe00700 1 -- 172.21.15.70:0/1131020064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963490 msgr2=0x564fff96f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f438fe00700 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963490 0x564fff96f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f438fe00700 1 -- 172.21.15.70:0/1131020064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fff87b520 con 0x564fff963e50 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f438fe00700 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff96cc50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f437c0056e0 tx=0x7f437c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11caaab159ee7fb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.669+0000 7f4376a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.670+0000 7f4376a00700 1 -- 172.21.15.70:0/1131020064 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c027060 con 0x564fff963e50 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.670+0000 7f4376a00700 1 -- 172.21.15.70:0/1131020064 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 9583+0+0 (secure 0 0 0) 0x7f437c004a20 con 0x564fff963e50 2024-05-08T07:20:53.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.670+0000 7f43a2609b80 1 -- 172.21.15.70:0/1131020064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f437c00edc0 con 0x564fff963e50 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.670+0000 7f4376a00700 1 -- 172.21.15.70:0/1131020064 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f437c02e050 con 0x564fff963e50 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.670+0000 7f43a2609b80 10 client.16446 fetch_fsmap learned FSMap version 36 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.670+0000 7f43a2609b80 1 -- 172.21.15.70:0/1131020064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564fff97aaa0 con 0x564fff963e50 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.670+0000 7f4376a00700 1 -- 172.21.15.70:0/1131020064 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f437c00edc0 con 0x564fff963e50 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.671+0000 7f4376a00700 1 -- 172.21.15.70:0/1131020064 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f437c010430 con 0x564fff963e50 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.671+0000 7f43a2609b80 10 client.16446 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.671+0000 7f43a2609b80 10 client.16446 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.671+0000 7f43a2609b80 20 client.16446 populate_metadata read hostname 'smithi070' 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.671+0000 7f43a2609b80 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fff97d080 0x564fff97f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.671+0000 7f43a2609b80 4 client.16446 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:20:53.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.671+0000 7f43a2609b80 1 -- 172.21.15.70:0/1131020064 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fff9301a0 con 0x564fff97d080 2024-05-08T07:20:53.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.672+0000 7f4395200700 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fff97d080 0x564fff97f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.673+0000 7f4395200700 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fff97d080 0x564fff97f470 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfa741773cdc88f2 server_cookie=43c2fae6dcc1c63b in_seq=0 out_seq=0 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.673+0000 7f4376a00700 10 client.16446 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f4376a00700 1 -- 172.21.15.70:0/1131020064 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564fff9301a0 con 0x564fff97d080 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f4376a00700 10 client.16446 handle_command_reply: tid=0 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 client.16446 shutdown 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 -- 172.21.15.70:0/1131020064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 msgr2=0x564fff96cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff96cc50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f437c0056e0 tx=0x7f437c0057c0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 -- 172.21.15.70:0/1131020064 shutdown_connections 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fff97d080 0x564fff97f470 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff96d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963490 0x564fff96f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 --2- 172.21.15.70:0/1131020064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff96cc50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 -- 172.21.15.70:0/1131020064 >> 172.21.15.70:0/1131020064 conn(0x564fff891c60 msgr2=0x564fff958850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:53.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f4376a00700 0 client.16446 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:20:53.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 -- 172.21.15.70:0/1131020064 shutdown_connections 2024-05-08T07:20:53.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.675+0000 7f43a2609b80 1 -- 172.21.15.70:0/1131020064 wait complete. 2024-05-08T07:20:53.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.676+0000 7f43a2609b80 20 client.16446 trim_cache size 0 max 16384 2024-05-08T07:20:53.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.697+0000 7f43a2609b80 1 Processor -- start 2024-05-08T07:20:53.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.697+0000 7f43a2609b80 1 -- start start 2024-05-08T07:20:53.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.697+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff96bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.697+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 0x564fff9792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.697+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff96ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.697+0000 7f43a2609b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43901b82a0 con 0x564fff963490 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.697+0000 7f43a2609b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43901b5b30 con 0x564fff963e50 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.697+0000 7f43a2609b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f43901b39a0 con 0x564fff968ec0 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f4395200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff96bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f4395200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff96bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59532/0 (socket says 172.21.15.70:59532) 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f4395200700 1 -- 172.21.15.70:0/765699174 learned_addr learned my addr 172.21.15.70:0/765699174 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f4395200700 1 -- 172.21.15.70:0/765699174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 msgr2=0x564fff96ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:20:53.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f4395200700 1 --2- 172.21.15.70:0/765699174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff96ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f4395200700 1 -- 172.21.15.70:0/765699174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 msgr2=0x564fff9792d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:20:53.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f438fe00700 1 --2- 172.21.15.70:0/765699174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 0x564fff9792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f4395200700 1 --2- 172.21.15.70:0/765699174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 0x564fff9792d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f4395200700 1 -- 172.21.15.70:0/765699174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fff9700b0 con 0x564fff963490 2024-05-08T07:20:53.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.698+0000 7f4395200700 1 --2- 172.21.15.70:0/765699174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff96bc10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f43840a7ca0 tx=0x7f4384009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a2b9232fc7bc2b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:20:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f4381600700 1 -- 172.21.15.70:0/765699174 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384090070 con 0x564fff963490 2024-05-08T07:20:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f4381600700 1 -- 172.21.15.70:0/765699174 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43840aa540 con 0x564fff963490 2024-05-08T07:20:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f4381600700 1 -- 172.21.15.70:0/765699174 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384022620 con 0x564fff963490 2024-05-08T07:20:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f43a2609b80 1 -- 172.21.15.70:0/765699174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 msgr2=0x564fff96bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f43a2609b80 1 --2- 172.21.15.70:0/765699174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff96bc10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f43840a7ca0 tx=0x7f4384009ca0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f43a2609b80 1 -- 172.21.15.70:0/765699174 shutdown_connections 2024-05-08T07:20:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f43a2609b80 1 --2- 172.21.15.70:0/765699174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff968ec0 0x564fff96ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f43a2609b80 1 --2- 172.21.15.70:0/765699174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963490 0x564fff96bc10 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f43a2609b80 1 --2- 172.21.15.70:0/765699174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff963e50 0x564fff9792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.699+0000 7f43a2609b80 1 -- 172.21.15.70:0/765699174 >> 172.21.15.70:0/765699174 conn(0x564fff891c60 msgr2=0x564fff96e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:53.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.700+0000 7f43a2609b80 1 -- 172.21.15.70:0/765699174 shutdown_connections 2024-05-08T07:20:53.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.700+0000 7f43a2609b80 1 -- 172.21.15.70:0/765699174 wait complete. 2024-05-08T07:20:53.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.700+0000 7f43a2609b80 1 -- start start 2024-05-08T07:20:53.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.700+0000 7f43a2609b80 1 Processor -- start 2024-05-08T07:20:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff963490 0x564fff984640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff984b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f43a2609b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff968ec0 0x564fff973ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f43a2609b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43901b3ff0 con 0x564fff963e50 2024-05-08T07:20:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f43a2609b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f43901b5460 con 0x564fff968ec0 2024-05-08T07:20:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f43a2609b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f43901b46c0 con 0x564fff963490 2024-05-08T07:20:53.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f43a2609b80 10 client.0 _ll_register_callbacks cb 0x564fff85cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f438fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff984b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f438fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff984b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59540/0 (socket says 172.21.15.70:59540) 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f438fe00700 1 -- 172.21.15.70:0/3213207409 learned_addr learned my addr 172.21.15.70:0/3213207409 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f4395200700 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff963490 0x564fff984640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f4395c00700 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff968ec0 0x564fff973ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.701+0000 7f438fe00700 1 -- 172.21.15.70:0/3213207409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff963490 msgr2=0x564fff984640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f438fe00700 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff963490 0x564fff984640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f438fe00700 1 -- 172.21.15.70:0/3213207409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff968ec0 msgr2=0x564fff973ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f438fe00700 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff968ec0 0x564fff973ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f438fe00700 1 -- 172.21.15.70:0/3213207409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fff95a980 con 0x564fff963e50 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f438fe00700 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff984b80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f437c010850 tx=0x7f437c0106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c229cf71889dc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f4376a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:20:53.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f4376a00700 1 -- 172.21.15.70:0/3213207409 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c027040 con 0x564fff963e50 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f43a2609b80 1 -- 172.21.15.70:0/3213207409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43840aa540 con 0x564fff963e50 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f4376a00700 1 -- 172.21.15.70:0/3213207409 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(147..147 src has 1..147) ==== 9583+0+0 (secure 0 0 0) 0x7f437c00edd0 con 0x564fff963e50 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f4376a00700 1 -- 172.21.15.70:0/3213207409 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f437c014070 con 0x564fff963e50 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f43a2609b80 10 client.16452 fetch_fsmap learned FSMap version 36 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.702+0000 7f43a2609b80 1 -- 172.21.15.70:0/3213207409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564fff9e7ad0 con 0x564fff963e50 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.703+0000 7f4376a00700 1 -- 172.21.15.70:0/3213207409 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43840aa540 con 0x564fff963e50 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.703+0000 7f4376a00700 1 -- 172.21.15.70:0/3213207409 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7f437c019460 con 0x564fff963e50 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.703+0000 7f43a2609b80 10 client.16452 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.703+0000 7f43a2609b80 10 client.16452 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.703+0000 7f43a2609b80 20 client.16452 populate_metadata read hostname 'smithi070' 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.703+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fff9e81a0 0x564fff9ea5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.703+0000 7f43a2609b80 4 client.16452 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "24670a6", "release": true, "await": true}] 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.703+0000 7f43a2609b80 1 -- 172.21.15.70:0/3213207409 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "24670a6", "release": true, "await": true}) -- 0x564fff8c3500 con 0x564fff9e81a0 2024-05-08T07:20:53.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.704+0000 7f4395200700 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fff9e81a0 0x564fff9ea5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:20:53.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.705+0000 7f4395200700 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fff9e81a0 0x564fff9ea5c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ab259b07b75a8be server_cookie=3041dd85a7660de3 in_seq=0 out_seq=0 2024-05-08T07:20:53.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:53.705+0000 7f4376a00700 10 client.16452 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:20:55.312 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:55 smithi194 ceph-mon[33679]: pgmap v1087: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:20:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:55 smithi070 ceph-mon[29591]: pgmap v1087: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:20:55.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:55 smithi172 ceph-mon[33377]: pgmap v1087: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:20:57.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.356+0000 7f4376a00700 1 -- 172.21.15.70:0/3213207409 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x564fff8c3500 con 0x564fff9e81a0 2024-05-08T07:20:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.356+0000 7f4376a00700 10 client.16452 handle_command_reply: tid=0 2024-05-08T07:20:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.356+0000 7f43a2609b80 1 client.16452 shutdown 2024-05-08T07:20:57.356 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:57 smithi070 ceph-mon[29591]: pgmap v1088: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T07:20:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.357+0000 7f43a2609b80 1 -- 172.21.15.70:0/3213207409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 msgr2=0x564fff984b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:57.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.357+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff984b80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f437c010850 tx=0x7f437c0106e0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.357+0000 7f43a2609b80 1 -- 172.21.15.70:0/3213207409 shutdown_connections 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.357+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564fff9e81a0 0x564fff9ea5c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.357+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564fff968ec0 0x564fff973ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.357+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564fff963490 0x564fff984640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.357+0000 7f43a2609b80 1 --2- 172.21.15.70:0/3213207409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564fff963e50 0x564fff984b80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.357+0000 7f43a2609b80 1 -- 172.21.15.70:0/3213207409 >> 172.21.15.70:0/3213207409 conn(0x564fff891c60 msgr2=0x564fff962480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.358+0000 7f4376a00700 0 client.16452 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.358+0000 7f43a2609b80 1 -- 172.21.15.70:0/3213207409 shutdown_connections 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.358+0000 7f43a2609b80 1 -- 172.21.15.70:0/3213207409 wait complete. 2024-05-08T07:20:57.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.358+0000 7f43a2609b80 20 client.16452 trim_cache size 0 max 16384 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 36, 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 88, 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "24670a6": { 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 88, 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:20:57.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 89.4, 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:57.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:20:57.360 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:20:57.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.359+0000 7f4397c00700 1 -- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43780b29f0 msgr2=0x7f43780b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:57.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.359+0000 7f4397c00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43780b29f0 0x7f43780b4eb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4388007fd0 tx=0x7f43880132f0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.359+0000 7f4397c00700 1 -- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4390109ad0 msgr2=0x7f43901a0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:20:57.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.359+0000 7f4397c00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4390109ad0 0x7f43901a0080 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4384005910 tx=0x7f4384009f90 comp rx=0 tx=0).stop 2024-05-08T07:20:57.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.360+0000 7f4397c00700 1 -- 172.21.15.70:0/202163954 shutdown_connections 2024-05-08T07:20:57.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.360+0000 7f4397c00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43780b29f0 0x7f43780b4eb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.360+0000 7f4397c00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f439010fb60 0x7f43901a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.360+0000 7f4397c00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4390109ad0 0x7f43901a0080 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.360+0000 7f4397c00700 1 --2- 172.21.15.70:0/202163954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f439010a490 0x7f43901a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:20:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.360+0000 7f4397c00700 1 -- 172.21.15.70:0/202163954 >> 172.21.15.70:0/202163954 conn(0x7f4390076c70 msgr2=0x7f4390077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:20:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.360+0000 7f4397c00700 1 -- 172.21.15.70:0/202163954 shutdown_connections 2024-05-08T07:20:57.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:20:57.360+0000 7f4397c00700 1 -- 172.21.15.70:0/202163954 wait complete. 2024-05-08T07:20:57.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:57 smithi172 ceph-mon[33377]: pgmap v1088: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T07:20:57.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:57 smithi194 ceph-mon[33679]: pgmap v1088: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T07:20:58.230 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '24670a6', seconds elapsed: 69.8 2024-05-08T07:20:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:20:59 smithi070 ceph-mon[29591]: pgmap v1089: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:20:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:20:59 smithi172 ceph-mon[33377]: pgmap v1089: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:20:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:20:59 smithi194 ceph-mon[33679]: pgmap v1089: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:21:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:01 smithi070 ceph-mon[29591]: pgmap v1090: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 156 KiB/s wr, 22 op/s 2024-05-08T07:21:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:01 smithi172 ceph-mon[33377]: pgmap v1090: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 156 KiB/s wr, 22 op/s 2024-05-08T07:21:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:01 smithi194 ceph-mon[33679]: pgmap v1090: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 156 KiB/s wr, 22 op/s 2024-05-08T07:21:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:03 smithi070 ceph-mon[29591]: pgmap v1091: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 156 KiB/s wr, 20 op/s 2024-05-08T07:21:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:03 smithi172 ceph-mon[33377]: pgmap v1091: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 156 KiB/s wr, 20 op/s 2024-05-08T07:21:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:03 smithi194 ceph-mon[33679]: pgmap v1091: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 156 KiB/s wr, 20 op/s 2024-05-08T07:21:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:05 smithi070 ceph-mon[29591]: pgmap v1092: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 156 KiB/s wr, 20 op/s 2024-05-08T07:21:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:05 smithi070 ceph-mon[29591]: osdmap e148: 12 total, 12 up, 12 in 2024-05-08T07:21:05.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:05 smithi172 ceph-mon[33377]: pgmap v1092: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 156 KiB/s wr, 20 op/s 2024-05-08T07:21:05.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:05 smithi172 ceph-mon[33377]: osdmap e148: 12 total, 12 up, 12 in 2024-05-08T07:21:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:05 smithi194 ceph-mon[33679]: pgmap v1092: 129 pgs: 129 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 156 KiB/s wr, 20 op/s 2024-05-08T07:21:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:05 smithi194 ceph-mon[33679]: osdmap e148: 12 total, 12 up, 12 in 2024-05-08T07:21:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:07 smithi070 ceph-mon[29591]: pgmap v1094: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1017 KiB/s wr, 179 op/s 2024-05-08T07:21:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:07 smithi172 ceph-mon[33377]: pgmap v1094: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1017 KiB/s wr, 179 op/s 2024-05-08T07:21:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:07 smithi194 ceph-mon[33679]: pgmap v1094: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1017 KiB/s wr, 179 op/s 2024-05-08T07:21:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:09 smithi070 ceph-mon[29591]: pgmap v1095: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1017 KiB/s wr, 179 op/s 2024-05-08T07:21:09.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:09 smithi172 ceph-mon[33377]: pgmap v1095: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1017 KiB/s wr, 179 op/s 2024-05-08T07:21:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:09 smithi194 ceph-mon[33679]: pgmap v1095: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 1017 KiB/s wr, 179 op/s 2024-05-08T07:21:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:11 smithi070 ceph-mon[29591]: pgmap v1096: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-05-08T07:21:11.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:11 smithi172 ceph-mon[33377]: pgmap v1096: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-05-08T07:21:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:11 smithi194 ceph-mon[33679]: pgmap v1096: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-05-08T07:21:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:13 smithi070 ceph-mon[29591]: pgmap v1097: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-05-08T07:21:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:13 smithi070 ceph-mon[29591]: osdmap e149: 12 total, 12 up, 12 in 2024-05-08T07:21:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:13 smithi172 ceph-mon[33377]: pgmap v1097: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-05-08T07:21:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:13 smithi172 ceph-mon[33377]: osdmap e149: 12 total, 12 up, 12 in 2024-05-08T07:21:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:13 smithi194 ceph-mon[33679]: pgmap v1097: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.6 MiB/s wr, 215 op/s 2024-05-08T07:21:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:13 smithi194 ceph-mon[33679]: osdmap e149: 12 total, 12 up, 12 in 2024-05-08T07:21:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:15 smithi070 ceph-mon[29591]: pgmap v1099: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 1.0 MiB/s wr, 113 op/s 2024-05-08T07:21:15.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:15 smithi172 ceph-mon[33377]: pgmap v1099: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 1.0 MiB/s wr, 113 op/s 2024-05-08T07:21:15.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:15 smithi194 ceph-mon[33679]: pgmap v1099: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 1.0 MiB/s wr, 113 op/s 2024-05-08T07:21:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:17 smithi070 ceph-mon[29591]: pgmap v1100: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.3 MiB/s wr, 292 op/s 2024-05-08T07:21:17.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:17 smithi172 ceph-mon[33377]: pgmap v1100: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.3 MiB/s wr, 292 op/s 2024-05-08T07:21:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:17 smithi194 ceph-mon[33679]: pgmap v1100: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.3 MiB/s wr, 292 op/s 2024-05-08T07:21:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:19 smithi070 ceph-mon[29591]: pgmap v1101: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.3 MiB/s wr, 292 op/s 2024-05-08T07:21:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:19 smithi172 ceph-mon[33377]: pgmap v1101: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.3 MiB/s wr, 292 op/s 2024-05-08T07:21:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:19 smithi194 ceph-mon[33679]: pgmap v1101: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 1.3 MiB/s wr, 292 op/s 2024-05-08T07:21:20.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:21:20.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:21:20.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:21:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:21 smithi172 ceph-mon[33377]: pgmap v1102: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1.2 MiB/s wr, 405 op/s 2024-05-08T07:21:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:21 smithi194 ceph-mon[33679]: pgmap v1102: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1.2 MiB/s wr, 405 op/s 2024-05-08T07:21:21.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:21 smithi070 ceph-mon[29591]: pgmap v1102: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1.2 MiB/s wr, 405 op/s 2024-05-08T07:21:22.427 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:22 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:21:22.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:22 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:21:22.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:22 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:21:22.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:22 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:21:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:22 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:21:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:22 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:21:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:22 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:21:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:22 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:21:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:22 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:21:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:23 smithi070 ceph-mon[29591]: pgmap v1103: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1.2 MiB/s wr, 405 op/s 2024-05-08T07:21:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:23 smithi194 ceph-mon[33679]: pgmap v1103: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1.2 MiB/s wr, 405 op/s 2024-05-08T07:21:23.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:23 smithi172 ceph-mon[33377]: pgmap v1103: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 1.2 MiB/s wr, 405 op/s 2024-05-08T07:21:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:25 smithi194 ceph-mon[33679]: pgmap v1104: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 1.1 MiB/s wr, 371 op/s 2024-05-08T07:21:25.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:25 smithi070 ceph-mon[29591]: pgmap v1104: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 1.1 MiB/s wr, 371 op/s 2024-05-08T07:21:25.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:25 smithi172 ceph-mon[33377]: pgmap v1104: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 1.1 MiB/s wr, 371 op/s 2024-05-08T07:21:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:27 smithi194 ceph-mon[33679]: pgmap v1105: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 1.7 MiB/s wr, 469 op/s 2024-05-08T07:21:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:27 smithi070 ceph-mon[29591]: pgmap v1105: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 1.7 MiB/s wr, 469 op/s 2024-05-08T07:21:27.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:27 smithi172 ceph-mon[33377]: pgmap v1105: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 1.7 MiB/s wr, 469 op/s 2024-05-08T07:21:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:29 smithi070 ceph-mon[29591]: pgmap v1106: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-05-08T07:21:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:29 smithi172 ceph-mon[33377]: pgmap v1106: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-05-08T07:21:30.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:29 smithi194 ceph-mon[33679]: pgmap v1106: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 1.2 MiB/s wr, 274 op/s 2024-05-08T07:21:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:31 smithi070 ceph-mon[29591]: pgmap v1107: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 2.0 MiB/s wr, 446 op/s 2024-05-08T07:21:31.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:31 smithi172 ceph-mon[33377]: pgmap v1107: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 2.0 MiB/s wr, 446 op/s 2024-05-08T07:21:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:31 smithi194 ceph-mon[33679]: pgmap v1107: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 732 KiB/s rd, 2.0 MiB/s wr, 446 op/s 2024-05-08T07:21:33.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:33 smithi070 ceph-mon[29591]: pgmap v1108: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-05-08T07:21:33.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:33 smithi172 ceph-mon[33377]: pgmap v1108: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-05-08T07:21:34.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:33 smithi194 ceph-mon[33679]: pgmap v1108: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-05-08T07:21:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:35 smithi070 ceph-mon[29591]: pgmap v1109: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-05-08T07:21:35.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:35 smithi172 ceph-mon[33377]: pgmap v1109: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-05-08T07:21:36.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:35 smithi194 ceph-mon[33679]: pgmap v1109: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.5 MiB/s wr, 304 op/s 2024-05-08T07:21:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:37 smithi070 ceph-mon[29591]: pgmap v1110: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 2.1 MiB/s wr, 361 op/s 2024-05-08T07:21:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:37 smithi172 ceph-mon[33377]: pgmap v1110: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 2.1 MiB/s wr, 361 op/s 2024-05-08T07:21:38.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:37 smithi194 ceph-mon[33679]: pgmap v1110: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 2.1 MiB/s wr, 361 op/s 2024-05-08T07:21:38.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:38 smithi070 ceph-mon[29591]: pgmap v1111: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2024-05-08T07:21:38.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:38 smithi172 ceph-mon[33377]: pgmap v1111: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2024-05-08T07:21:39.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:38 smithi194 ceph-mon[33679]: pgmap v1111: 129 pgs: 129 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2024-05-08T07:21:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:40 smithi070 ceph-mon[29591]: pgmap v1112: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 2.3 MiB/s wr, 449 op/s 2024-05-08T07:21:41.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:40 smithi172 ceph-mon[33377]: pgmap v1112: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 2.3 MiB/s wr, 449 op/s 2024-05-08T07:21:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:40 smithi194 ceph-mon[33679]: pgmap v1112: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 2.3 MiB/s wr, 449 op/s 2024-05-08T07:21:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:42 smithi070 ceph-mon[29591]: pgmap v1113: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.5 MiB/s wr, 277 op/s 2024-05-08T07:21:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:42 smithi172 ceph-mon[33377]: pgmap v1113: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.5 MiB/s wr, 277 op/s 2024-05-08T07:21:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:42 smithi194 ceph-mon[33679]: pgmap v1113: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.5 MiB/s wr, 277 op/s 2024-05-08T07:21:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:44 smithi070 ceph-mon[29591]: pgmap v1114: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.5 MiB/s wr, 277 op/s 2024-05-08T07:21:45.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:44 smithi172 ceph-mon[33377]: pgmap v1114: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.5 MiB/s wr, 277 op/s 2024-05-08T07:21:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:44 smithi194 ceph-mon[33679]: pgmap v1114: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 1.5 MiB/s wr, 277 op/s 2024-05-08T07:21:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:46 smithi070 ceph-mon[29591]: pgmap v1115: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 2.3 MiB/s wr, 319 op/s 2024-05-08T07:21:47.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:46 smithi172 ceph-mon[33377]: pgmap v1115: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 2.3 MiB/s wr, 319 op/s 2024-05-08T07:21:47.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:46 smithi194 ceph-mon[33679]: pgmap v1115: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 2.3 MiB/s wr, 319 op/s 2024-05-08T07:21:49.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:48 smithi070 ceph-mon[29591]: pgmap v1116: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.7 MiB/s wr, 262 op/s 2024-05-08T07:21:49.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:48 smithi172 ceph-mon[33377]: pgmap v1116: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.7 MiB/s wr, 262 op/s 2024-05-08T07:21:49.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:48 smithi194 ceph-mon[33679]: pgmap v1116: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 1.7 MiB/s wr, 262 op/s 2024-05-08T07:21:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:50 smithi070 ceph-mon[29591]: pgmap v1117: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 2.3 MiB/s wr, 375 op/s 2024-05-08T07:21:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:50 smithi172 ceph-mon[33377]: pgmap v1117: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 2.3 MiB/s wr, 375 op/s 2024-05-08T07:21:51.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:50 smithi194 ceph-mon[33679]: pgmap v1117: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 2.3 MiB/s wr, 375 op/s 2024-05-08T07:21:52.830 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 15.2 2024-05-08T07:21:52.831 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:21:53.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:52 smithi070 ceph-mon[29591]: pgmap v1118: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-05-08T07:21:53.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:52 smithi172 ceph-mon[33377]: pgmap v1118: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-05-08T07:21:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:52 smithi194 ceph-mon[33679]: pgmap v1118: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-05-08T07:21:53.338 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:21:55.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:54 smithi070 ceph-mon[29591]: pgmap v1119: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-05-08T07:21:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:54 smithi172 ceph-mon[33377]: pgmap v1119: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-05-08T07:21:55.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:54 smithi194 ceph-mon[33679]: pgmap v1119: 129 pgs: 129 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-05-08T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.726+0000 7fb972a00700 1 -- 172.21.15.70:0/2748828447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c101880 msgr2=0x7fb96c101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.726+0000 7fb972a00700 1 --2- 172.21.15.70:0/2748828447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c101880 0x7fb96c101c60 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009990 tx=0x7fb95c009ca0 comp rx=0 tx=0).stop 2024-05-08T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.726+0000 7fb972a00700 1 -- 172.21.15.70:0/2748828447 shutdown_connections 2024-05-08T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.727+0000 7fb972a00700 1 --2- 172.21.15.70:0/2748828447 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c10fc90 0x7fb96c112130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.727+0000 7fb972a00700 1 --2- 172.21.15.70:0/2748828447 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c101880 0x7fb96c101c60 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.727+0000 7fb972a00700 1 --2- 172.21.15.70:0/2748828447 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb96c1021a0 0x7fb96c10f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:55.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.727+0000 7fb972a00700 1 -- 172.21.15.70:0/2748828447 >> 172.21.15.70:0/2748828447 conn(0x7fb96c0785a0 msgr2=0x7fb96c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:21:55.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.727+0000 7fb972a00700 1 -- 172.21.15.70:0/2748828447 shutdown_connections 2024-05-08T07:21:55.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.727+0000 7fb972a00700 1 -- 172.21.15.70:0/2748828447 wait complete. 2024-05-08T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.728+0000 7fb972a00700 1 Processor -- start 2024-05-08T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.728+0000 7fb972a00700 1 -- start start 2024-05-08T07:21:55.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb972a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c101880 0x7fb96c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:55.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb972a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c1021a0 0x7fb96c1a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:55.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb972a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb96c10fc90 0x7fb96c19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:55.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb972a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c115790 con 0x7fb96c1021a0 2024-05-08T07:21:55.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb972a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c115610 con 0x7fb96c10fc90 2024-05-08T07:21:55.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb972a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb96c115910 con 0x7fb96c101880 2024-05-08T07:21:55.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb963400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c1021a0 0x7fb96c1a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:55.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb963400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c1021a0 0x7fb96c1a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33228/0 (socket says 172.21.15.70:33228) 2024-05-08T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb963400700 1 -- 172.21.15.70:0/2359660960 learned_addr learned my addr 172.21.15.70:0/2359660960 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb970a00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb96c10fc90 0x7fb96c19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.729+0000 7fb96be00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c101880 0x7fb96c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb963400700 1 -- 172.21.15.70:0/2359660960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c101880 msgr2=0x7fb96c1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb963400700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c101880 0x7fb96c1a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb963400700 1 -- 172.21.15.70:0/2359660960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb96c10fc90 msgr2=0x7fb96c19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb963400700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb96c10fc90 0x7fb96c19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:55.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb963400700 1 -- 172.21.15.70:0/2359660960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb96c19c210 con 0x7fb96c1021a0 2024-05-08T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb963400700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c1021a0 0x7fb96c1a1e30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb95400d950 tx=0x7fb95400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb969600700 1 -- 172.21.15.70:0/2359660960 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954017070 con 0x7fb96c1021a0 2024-05-08T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb96c19c500 con 0x7fb96c1021a0 2024-05-08T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb969600700 1 -- 172.21.15.70:0/2359660960 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb95400de30 con 0x7fb96c1021a0 2024-05-08T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb969600700 1 -- 172.21.15.70:0/2359660960 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954003aa0 con 0x7fb96c1021a0 2024-05-08T07:21:55.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.730+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96c1a87c0 con 0x7fb96c1021a0 2024-05-08T07:21:55.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.732+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96c1029b0 con 0x7fb96c1021a0 2024-05-08T07:21:55.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.734+0000 7fb969600700 1 -- 172.21.15.70:0/2359660960 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb954003c40 con 0x7fb96c1021a0 2024-05-08T07:21:55.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.737+0000 7fb969600700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9500b2a70 0x7fb9500b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:55.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.737+0000 7fb969600700 1 -- 172.21.15.70:0/2359660960 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 9583+0+0 (secure 0 0 0) 0x7fb9540e25b0 con 0x7fb96c1021a0 2024-05-08T07:21:55.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.737+0000 7fb96be00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9500b2a70 0x7fb9500b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:55.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.738+0000 7fb96be00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9500b2a70 0x7fb9500b4f30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb95c005f50 tx=0x7fb95c005e80 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:21:55.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:55.742+0000 7fb969600700 1 -- 172.21.15.70:0/2359660960 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb954020030 con 0x7fb96c1021a0 2024-05-08T07:21:56.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.060+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb96c02e510 con 0x7fb96c1021a0 2024-05-08T07:21:56.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.062+0000 7fb969600700 1 -- 172.21.15.70:0/2359660960 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11879 (secure 0 0 0) 0x7fb954009940 con 0x7fb96c1021a0 2024-05-08T07:21:56.061 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:21:56.062 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:17:08.396412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:21:56.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9500b2a70 msgr2=0x7fb9500b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9500b2a70 0x7fb9500b4f30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb95c005f50 tx=0x7fb95c005e80 comp rx=0 tx=0).stop 2024-05-08T07:21:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c1021a0 msgr2=0x7fb96c1a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c1021a0 0x7fb96c1a1e30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb95400d950 tx=0x7fb95400dd10 comp rx=0 tx=0).stop 2024-05-08T07:21:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 shutdown_connections 2024-05-08T07:21:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9500b2a70 0x7fb9500b4f30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb96c10fc90 0x7fb96c19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:56.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb96c101880 0x7fb96c1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:56.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 --2- 172.21.15.70:0/2359660960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb96c1021a0 0x7fb96c1a1e30 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:56.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.066+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 >> 172.21.15.70:0/2359660960 conn(0x7fb96c0785a0 msgr2=0x7fb96c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:21:56.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.067+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 shutdown_connections 2024-05-08T07:21:56.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:56.067+0000 7fb972a00700 1 -- 172.21.15.70:0/2359660960 wait complete. 2024-05-08T07:21:56.067 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 36 2024-05-08T07:21:56.916 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 75.2 --await-for 42.0' 2024-05-08T07:21:56.916 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 75.2 --await-for 42.0 2024-05-08T07:21:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:56 smithi070 ceph-mon[29591]: pgmap v1120: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 2.0 MiB/s wr, 275 op/s 2024-05-08T07:21:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:56 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2359660960' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:21:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:56 smithi172 ceph-mon[33377]: pgmap v1120: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 2.0 MiB/s wr, 275 op/s 2024-05-08T07:21:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:56 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2359660960' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:21:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:56 smithi194 ceph-mon[33679]: pgmap v1120: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 2.0 MiB/s wr, 275 op/s 2024-05-08T07:21:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:56 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2359660960' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:21:57.398 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:21:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:21:58 smithi070 ceph-mon[29591]: pgmap v1121: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-05-08T07:21:59.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:21:58 smithi172 ceph-mon[33377]: pgmap v1121: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-05-08T07:21:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:21:58 smithi194 ceph-mon[33679]: pgmap v1121: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 1.2 MiB/s wr, 233 op/s 2024-05-08T07:21:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.913+0000 7efff0600700 1 -- 172.21.15.70:0/2965158412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effe8108460 msgr2=0x7effe8108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.913+0000 7efff0600700 1 --2- 172.21.15.70:0/2965158412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effe8108460 0x7effe8108840 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7effdc009990 tx=0x7effdc009ca0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.914+0000 7efff0600700 1 -- 172.21.15.70:0/2965158412 shutdown_connections 2024-05-08T07:21:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.914+0000 7efff0600700 1 --2- 172.21.15.70:0/2965158412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effe8103ef0 0x7effe81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.914+0000 7efff0600700 1 --2- 172.21.15.70:0/2965158412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effe8108460 0x7effe8108840 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.914+0000 7efff0600700 1 --2- 172.21.15.70:0/2965158412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe8103550 0x7effe81039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.914+0000 7efff0600700 1 -- 172.21.15.70:0/2965158412 >> 172.21.15.70:0/2965158412 conn(0x7effe807a600 msgr2=0x7effe807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:21:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.914+0000 7efff0600700 1 -- 172.21.15.70:0/2965158412 shutdown_connections 2024-05-08T07:21:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.914+0000 7efff0600700 1 -- 172.21.15.70:0/2965158412 wait complete. 2024-05-08T07:21:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.915+0000 7efff0600700 1 Processor -- start 2024-05-08T07:21:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.915+0000 7efff0600700 1 -- start start 2024-05-08T07:21:59.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7efff0600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effe8103550 0x7effe810a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7efff0600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effe8103ef0 0x7effe810a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7efff0600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe8108460 0x7effe810ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7efff0600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7effe8113530 con 0x7effe8103ef0 2024-05-08T07:21:59.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7efff0600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effe81133b0 con 0x7effe8103550 2024-05-08T07:21:59.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7efff0600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7effe81136b0 con 0x7effe8108460 2024-05-08T07:21:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7effedc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effe8103550 0x7effe810a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7effed200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effe8103ef0 0x7effe810a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7effedc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effe8103550 0x7effe810a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:35226/0 (socket says 172.21.15.70:35226) 2024-05-08T07:21:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.916+0000 7effedc00700 1 -- 172.21.15.70:0/4180967128 learned_addr learned my addr 172.21.15.70:0/4180967128 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:21:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.917+0000 7effee600700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe8108460 0x7effe810ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.917+0000 7effedc00700 1 -- 172.21.15.70:0/4180967128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe8108460 msgr2=0x7effe810ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.917+0000 7effedc00700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe8108460 0x7effe810ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.917+0000 7effedc00700 1 -- 172.21.15.70:0/4180967128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effe8103ef0 msgr2=0x7effe810a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:59.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.917+0000 7effedc00700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effe8103ef0 0x7effe810a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.917+0000 7effedc00700 1 -- 172.21.15.70:0/4180967128 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe81ac290 con 0x7effe8103550 2024-05-08T07:21:59.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.918+0000 7effedc00700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effe8103550 0x7effe810a3e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effdc0059d0 tx=0x7effdc0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:21:59.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.919+0000 7effe6000700 1 -- 172.21.15.70:0/4180967128 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc027070 con 0x7effe8103550 2024-05-08T07:21:59.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.919+0000 7efff0600700 1 -- 172.21.15.70:0/4180967128 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe81ac520 con 0x7effe8103550 2024-05-08T07:21:59.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.919+0000 7effe6000700 1 -- 172.21.15.70:0/4180967128 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effdc022470 con 0x7effe8103550 2024-05-08T07:21:59.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.919+0000 7effe6000700 1 -- 172.21.15.70:0/4180967128 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc017650 con 0x7effe8103550 2024-05-08T07:21:59.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.919+0000 7efff0600700 1 -- 172.21.15.70:0/4180967128 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe81ac9d0 con 0x7effe8103550 2024-05-08T07:21:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.925+0000 7efffaf3bb80 1 Processor -- start 2024-05-08T07:21:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.926+0000 7efffaf3bb80 1 -- start start 2024-05-08T07:21:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.926+0000 7effe6000700 1 -- 172.21.15.70:0/4180967128 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7effdc02a070 con 0x7effe8103550 2024-05-08T07:21:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.926+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.926+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.926+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.926+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1dd802bb0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.926+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a1dd7a08f0 con 0x55a1dd8b0810 2024-05-08T07:21:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.926+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a1dd7feb70 con 0x55a1dd8b6240 2024-05-08T07:21:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.927+0000 7effee600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.927+0000 7effed200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.927+0000 7effee600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:38916/0 (socket says 172.21.15.70:38916) 2024-05-08T07:21:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.927+0000 7effee600700 1 -- 172.21.15.70:0/3941298305 learned_addr learned my addr 172.21.15.70:0/3941298305 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:21:59.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.928+0000 7effedc00700 1 --2- 172.21.15.70:0/3941298305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.928+0000 7effee600700 1 -- 172.21.15.70:0/3941298305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 msgr2=0x55a1dd8b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:21:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.928+0000 7effee600700 1 --2- 172.21.15.70:0/3941298305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.928+0000 7effee600700 1 -- 172.21.15.70:0/3941298305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 msgr2=0x55a1dd8bd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:21:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.928+0000 7effee600700 1 --2- 172.21.15.70:0/3941298305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.928+0000 7effee600700 1 -- 172.21.15.70:0/3941298305 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1dd74fa60 con 0x55a1dd8b6240 2024-05-08T07:21:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.928+0000 7effed200700 1 --2- 172.21.15.70:0/3941298305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:21:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.929+0000 7effee600700 1 --2- 172.21.15.70:0/3941298305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8b6620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effe0011670 tx=0x7effe0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14786291053d0790 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:21:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.929+0000 7effe6000700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effd00b2ba0 0x7effd00b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.929+0000 7effe6000700 1 -- 172.21.15.70:0/4180967128 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 9583+0+0 (secure 0 0 0) 0x7effdc0e37b0 con 0x7effe8103550 2024-05-08T07:21:59.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.929+0000 7effdaa00700 1 -- 172.21.15.70:0/3941298305 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0019030 con 0x55a1dd8b6240 2024-05-08T07:21:59.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.929+0000 7effdaa00700 1 -- 172.21.15.70:0/3941298305 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effe00092e0 con 0x55a1dd8b6240 2024-05-08T07:21:59.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.929+0000 7effedc00700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effd00b2ba0 0x7effd00b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.929+0000 7effdaa00700 1 -- 172.21.15.70:0/3941298305 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0004810 con 0x55a1dd8b6240 2024-05-08T07:21:59.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.930+0000 7efffaf3bb80 1 -- 172.21.15.70:0/3941298305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 msgr2=0x55a1dd8b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.930+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/3941298305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8b6620 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7effe0011670 tx=0x7effe0009920 comp rx=0 tx=0).stop 2024-05-08T07:21:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.930+0000 7effedc00700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effd00b2ba0 0x7effd00b5060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7effdc0a6720 tx=0x7effdc009ca0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:21:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.930+0000 7efffaf3bb80 1 -- 172.21.15.70:0/3941298305 shutdown_connections 2024-05-08T07:21:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.930+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/3941298305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.930+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/3941298305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8b6620 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.930+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/3941298305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.930+0000 7efffaf3bb80 1 -- 172.21.15.70:0/3941298305 >> 172.21.15.70:0/3941298305 conn(0x55a1dd828860 msgr2=0x55a1dd8ab100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:21:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.931+0000 7efffaf3bb80 1 -- 172.21.15.70:0/3941298305 shutdown_connections 2024-05-08T07:21:59.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.931+0000 7efffaf3bb80 1 -- 172.21.15.70:0/3941298305 wait complete. 2024-05-08T07:21:59.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.931+0000 7efffaf3bb80 1 -- start start 2024-05-08T07:21:59.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.932+0000 7efffaf3bb80 1 Processor -- start 2024-05-08T07:21:59.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.932+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b0810 0x55a1dd8bcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.932+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.932+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b6240 0x55a1dd8ba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.932+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1dd8bd600 con 0x55a1dd8b11d0 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.932+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a1dd768cb0 con 0x55a1dd8b6240 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.932+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a1dd8bd780 con 0x55a1dd8b0810 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.933+0000 7efffaf3bb80 10 client.0 _ll_register_callbacks cb 0x55a1dd7a9e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.933+0000 7effed200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.933+0000 7effed200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8b9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57270/0 (socket says 172.21.15.70:57270) 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.933+0000 7effed200700 1 -- 172.21.15.70:0/605984475 learned_addr learned my addr 172.21.15.70:0/605984475 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:21:59.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.933+0000 7effee600700 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b0810 0x55a1dd8bcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.933+0000 7effee600700 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b6240 0x55a1dd8ba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.933+0000 7effed200700 1 -- 172.21.15.70:0/605984475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b0810 msgr2=0x55a1dd8bcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.933+0000 7effed200700 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b0810 0x55a1dd8bcaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.933+0000 7effed200700 1 -- 172.21.15.70:0/605984475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b6240 msgr2=0x55a1dd8ba3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.934+0000 7effed200700 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b6240 0x55a1dd8ba3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.934+0000 7effed200700 1 -- 172.21.15.70:0/605984475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1dd7c85b0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.934+0000 7effee600700 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b6240 0x55a1dd8ba3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.934+0000 7effed200700 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8b9e90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7effd40117b0 tx=0x7effd4011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af6b113e7edbf46 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.934+0000 7effcf400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.934+0000 7effcf400700 1 -- 172.21.15.70:0/605984475 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd401e020 con 0x55a1dd8b11d0 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.934+0000 7effcf400700 1 -- 172.21.15.70:0/605984475 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 9583+0+0 (secure 0 0 0) 0x7effd400f8b0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.935+0000 7efffaf3bb80 1 -- 172.21.15.70:0/605984475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effe00092e0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.935+0000 7effcf400700 1 -- 172.21.15.70:0/605984475 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7effd4026050 con 0x55a1dd8b11d0 2024-05-08T07:21:59.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.935+0000 7efffaf3bb80 10 client.16470 fetch_fsmap learned FSMap version 36 2024-05-08T07:21:59.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.935+0000 7efffaf3bb80 1 -- 172.21.15.70:0/605984475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a1dd8c7df0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.935+0000 7effcf400700 1 -- 172.21.15.70:0/605984475 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effe00092e0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.936+0000 7effcf400700 1 -- 172.21.15.70:0/605984475 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7effd4019070 con 0x55a1dd8b11d0 2024-05-08T07:21:59.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.936+0000 7efffaf3bb80 10 client.16470 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:21:59.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.936+0000 7efffaf3bb80 10 client.16470 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:21:59.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.936+0000 7efffaf3bb80 20 client.16470 populate_metadata read hostname 'smithi070' 2024-05-08T07:21:59.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.936+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1dd8ca510 0x55a1dd8cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.936+0000 7efffaf3bb80 4 client.16470 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:21:59.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.936+0000 7efffaf3bb80 1 -- 172.21.15.70:0/605984475 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1dd87d2d0 con 0x55a1dd8ca510 2024-05-08T07:21:59.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.937+0000 7effee600700 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1dd8ca510 0x55a1dd8cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.938+0000 7effee600700 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1dd8ca510 0x55a1dd8cc930 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11bf79039c46195e server_cookie=d141dfdc329bb0ba in_seq=0 out_seq=0 2024-05-08T07:21:59.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.938+0000 7effcf400700 10 client.16470 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:21:59.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.942+0000 7effcf400700 1 -- 172.21.15.70:0/605984475 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a1dd87d2d0 con 0x55a1dd8ca510 2024-05-08T07:21:59.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.942+0000 7effcf400700 10 client.16470 handle_command_reply: tid=0 2024-05-08T07:21:59.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 client.16470 shutdown 2024-05-08T07:21:59.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 -- 172.21.15.70:0/605984475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 msgr2=0x55a1dd8b9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:59.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8b9e90 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7effd40117b0 tx=0x7effd4011b70 comp rx=0 tx=0).stop 2024-05-08T07:21:59.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 -- 172.21.15.70:0/605984475 shutdown_connections 2024-05-08T07:21:59.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1dd8ca510 0x55a1dd8cc930 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b6240 0x55a1dd8ba3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7effcf400700 0 client.16470 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:21:59.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b0810 0x55a1dd8bcaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/605984475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8b9e90 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 -- 172.21.15.70:0/605984475 >> 172.21.15.70:0/605984475 conn(0x55a1dd828860 msgr2=0x55a1dd8a5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:21:59.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 -- 172.21.15.70:0/605984475 shutdown_connections 2024-05-08T07:21:59.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.943+0000 7efffaf3bb80 1 -- 172.21.15.70:0/605984475 wait complete. 2024-05-08T07:21:59.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.944+0000 7efffaf3bb80 20 client.16470 trim_cache size 0 max 16384 2024-05-08T07:21:59.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.970+0000 7efffaf3bb80 1 Processor -- start 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.970+0000 7efffaf3bb80 1 -- start start 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.970+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.970+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.970+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.970+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7effc8011830 con 0x55a1dd8b11d0 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.970+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effc800f0c0 con 0x55a1dd8b0810 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.970+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7effc800cf30 con 0x55a1dd8b6240 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effed200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effed200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8d2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57282/0 (socket says 172.21.15.70:57282) 2024-05-08T07:21:59.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effed200700 1 -- 172.21.15.70:0/1405944384 learned_addr learned my addr 172.21.15.70:0/1405944384 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:21:59.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effee600700 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effed200700 1 -- 172.21.15.70:0/1405944384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 msgr2=0x55a1dd8d2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effee600700 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effed200700 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8d2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effed200700 1 -- 172.21.15.70:0/1405944384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 msgr2=0x55a1dd8aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effed200700 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effed200700 1 -- 172.21.15.70:0/1405944384 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1dd8a7d00 con 0x55a1dd8b11d0 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.971+0000 7effee600700 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.972+0000 7effed200700 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8d2200 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7effd401ad00 tx=0x7effd400fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42750f9c1cd4a1dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.972+0000 7effda000700 1 -- 172.21.15.70:0/1405944384 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd401e040 con 0x55a1dd8b11d0 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.972+0000 7effda000700 1 -- 172.21.15.70:0/1405944384 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd400fcb0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.972+0000 7effda000700 1 -- 172.21.15.70:0/1405944384 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4005450 con 0x55a1dd8b11d0 2024-05-08T07:21:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.973+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1405944384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 msgr2=0x55a1dd8d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:21:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.973+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8d2200 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7effd401ad00 tx=0x7effd400fac0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.974+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1405944384 shutdown_connections 2024-05-08T07:21:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.974+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8d2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.974+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.974+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1405944384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8d2200 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.974+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1405944384 >> 172.21.15.70:0/1405944384 conn(0x55a1dd828860 msgr2=0x55a1dd8af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.974+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1405944384 shutdown_connections 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.974+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1405944384 wait complete. 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.974+0000 7efffaf3bb80 1 -- start start 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.975+0000 7efffaf3bb80 1 Processor -- start 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.975+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8c3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.975+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.975+0000 7efffaf3bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8c0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.975+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7effc800d580 con 0x55a1dd8b11d0 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.975+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7effc800e9f0 con 0x55a1dd8b0810 2024-05-08T07:21:59.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.975+0000 7efffaf3bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7effc800dc50 con 0x55a1dd8b6240 2024-05-08T07:21:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.976+0000 7efffaf3bb80 10 client.0 _ll_register_callbacks cb 0x55a1dd7a9e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:21:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.976+0000 7effee600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.976+0000 7effee600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:35252/0 (socket says 172.21.15.70:35252) 2024-05-08T07:21:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.976+0000 7effee600700 1 -- 172.21.15.70:0/1561189662 learned_addr learned my addr 172.21.15.70:0/1561189662 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:21:59.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.976+0000 7effed200700 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.976+0000 7effee600700 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.977+0000 7effed200700 1 -- 172.21.15.70:0/1561189662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 msgr2=0x55a1dd8c0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:21:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.977+0000 7effed200700 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8c0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.977+0000 7effed200700 1 -- 172.21.15.70:0/1561189662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 msgr2=0x55a1dd8c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:21:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.977+0000 7effed200700 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:21:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.977+0000 7effed200700 1 -- 172.21.15.70:0/1561189662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1dd934dc0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.977+0000 7effee600700 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:21:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.978+0000 7effed200700 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bfa40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x55a1dd8a7940 tx=0x7effd401a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01e9edd142b9d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:21:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.978+0000 7effcf400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:21:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.978+0000 7effcf400700 1 -- 172.21.15.70:0/1561189662 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd401e040 con 0x55a1dd8b11d0 2024-05-08T07:21:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.978+0000 7effcf400700 1 -- 172.21.15.70:0/1561189662 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(149..149 src has 1..149) ==== 9583+0+0 (secure 0 0 0) 0x7effd4011070 con 0x55a1dd8b11d0 2024-05-08T07:21:59.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.979+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1561189662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effd400fcb0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.979+0000 7effcf400700 1 -- 172.21.15.70:0/1561189662 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7effd4039050 con 0x55a1dd8b11d0 2024-05-08T07:21:59.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.979+0000 7efffaf3bb80 10 client.16476 fetch_fsmap learned FSMap version 36 2024-05-08T07:21:59.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.979+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1561189662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a1dd935ef0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.981+0000 7effcf400700 1 -- 172.21.15.70:0/1561189662 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7effd400fcb0 con 0x55a1dd8b11d0 2024-05-08T07:21:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.981+0000 7effcf400700 1 -- 172.21.15.70:0/1561189662 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7effd403c080 con 0x55a1dd8b11d0 2024-05-08T07:21:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.981+0000 7efffaf3bb80 10 client.16476 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:21:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.981+0000 7efffaf3bb80 10 client.16476 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:21:59.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.981+0000 7efffaf3bb80 20 client.16476 populate_metadata read hostname 'smithi070' 2024-05-08T07:21:59.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.981+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1dd8ca510 0x55a1dd9385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:21:59.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.981+0000 7efffaf3bb80 4 client.16476 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.2, "await_for": 42.0}] 2024-05-08T07:21:59.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.981+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1561189662 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.2, "await_for": 42.0}) -- 0x55a1dd810590 con 0x55a1dd8ca510 2024-05-08T07:21:59.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.982+0000 7effee600700 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1dd8ca510 0x55a1dd9385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:21:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.983+0000 7effcf400700 10 client.16476 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:21:59.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:21:59.983+0000 7effee600700 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1dd8ca510 0x55a1dd9385a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ab0a8c3bd6d8219 server_cookie=680acd679a3d0962 in_seq=0 out_seq=0 2024-05-08T07:22:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:00 smithi070 ceph-mon[29591]: pgmap v1122: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-05-08T07:22:01.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:00 smithi172 ceph-mon[33377]: pgmap v1122: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-05-08T07:22:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:00 smithi194 ceph-mon[33679]: pgmap v1122: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 1.7 MiB/s wr, 408 op/s 2024-05-08T07:22:03.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:02 smithi172 ceph-mon[33377]: pgmap v1123: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-05-08T07:22:03.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:02 smithi194 ceph-mon[33679]: pgmap v1123: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-05-08T07:22:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:02 smithi070 ceph-mon[29591]: pgmap v1123: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-05-08T07:22:05.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:04 smithi172 ceph-mon[33377]: pgmap v1124: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-05-08T07:22:05.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:04 smithi194 ceph-mon[33679]: pgmap v1124: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-05-08T07:22:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:04 smithi070 ceph-mon[29591]: pgmap v1124: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 1.1 MiB/s wr, 295 op/s 2024-05-08T07:22:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:06 smithi172 ceph-mon[33377]: pgmap v1125: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.2 MiB/s wr, 403 op/s 2024-05-08T07:22:07.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:06 smithi194 ceph-mon[33679]: pgmap v1125: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.2 MiB/s wr, 403 op/s 2024-05-08T07:22:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:06 smithi070 ceph-mon[29591]: pgmap v1125: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 1.2 MiB/s wr, 403 op/s 2024-05-08T07:22:09.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:08 smithi172 ceph-mon[33377]: pgmap v1126: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 588 KiB/s wr, 283 op/s 2024-05-08T07:22:09.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:08 smithi194 ceph-mon[33679]: pgmap v1126: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 588 KiB/s wr, 283 op/s 2024-05-08T07:22:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:08 smithi070 ceph-mon[29591]: pgmap v1126: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 588 KiB/s wr, 283 op/s 2024-05-08T07:22:11.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:10 smithi172 ceph-mon[33377]: pgmap v1127: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 593 KiB/s wr, 289 op/s 2024-05-08T07:22:11.181 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:10 smithi070 ceph-mon[29591]: pgmap v1127: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 593 KiB/s wr, 289 op/s 2024-05-08T07:22:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:10 smithi194 ceph-mon[33679]: pgmap v1127: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 593 KiB/s wr, 289 op/s 2024-05-08T07:22:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:12 smithi070 ceph-mon[29591]: pgmap v1128: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 94 KiB/s wr, 114 op/s 2024-05-08T07:22:13.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:12 smithi172 ceph-mon[33377]: pgmap v1128: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 94 KiB/s wr, 114 op/s 2024-05-08T07:22:13.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:12 smithi194 ceph-mon[33679]: pgmap v1128: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 94 KiB/s wr, 114 op/s 2024-05-08T07:22:15.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:14 smithi172 ceph-mon[33377]: pgmap v1129: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 94 KiB/s wr, 114 op/s 2024-05-08T07:22:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:14 smithi194 ceph-mon[33679]: pgmap v1129: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 94 KiB/s wr, 114 op/s 2024-05-08T07:22:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:14 smithi070 ceph-mon[29591]: pgmap v1129: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 94 KiB/s wr, 114 op/s 2024-05-08T07:22:17.187 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:16 smithi172 ceph-mon[33377]: pgmap v1130: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 184 KiB/s wr, 134 op/s 2024-05-08T07:22:17.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:16 smithi194 ceph-mon[33679]: pgmap v1130: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 184 KiB/s wr, 134 op/s 2024-05-08T07:22:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:16 smithi070 ceph-mon[29591]: pgmap v1130: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 184 KiB/s wr, 134 op/s 2024-05-08T07:22:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:18 smithi194 ceph-mon[33679]: pgmap v1131: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 95 KiB/s wr, 25 op/s 2024-05-08T07:22:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:18 smithi070 ceph-mon[29591]: pgmap v1131: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 95 KiB/s wr, 25 op/s 2024-05-08T07:22:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:18 smithi172 ceph-mon[33377]: pgmap v1131: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 95 KiB/s wr, 25 op/s 2024-05-08T07:22:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:20 smithi194 ceph-mon[33679]: pgmap v1132: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 294 KiB/s wr, 36 op/s 2024-05-08T07:22:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:20 smithi194 ceph-mon[33679]: osdmap e150: 12 total, 12 up, 12 in 2024-05-08T07:22:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:20 smithi070 ceph-mon[29591]: pgmap v1132: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 294 KiB/s wr, 36 op/s 2024-05-08T07:22:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:20 smithi070 ceph-mon[29591]: osdmap e150: 12 total, 12 up, 12 in 2024-05-08T07:22:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:20 smithi172 ceph-mon[33377]: pgmap v1132: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 294 KiB/s wr, 36 op/s 2024-05-08T07:22:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:20 smithi172 ceph-mon[33377]: osdmap e150: 12 total, 12 up, 12 in 2024-05-08T07:22:22.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:22:22.350 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:22:22.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.350+0000 7effcf400700 1 -- 172.21.15.70:0/1561189662 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55a1dd810590 con 0x55a1dd8ca510 2024-05-08T07:22:22.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.350+0000 7effcf400700 10 client.16476 handle_command_reply: tid=0 2024-05-08T07:22:22.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.350+0000 7efffaf3bb80 1 client.16476 shutdown 2024-05-08T07:22:22.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.351+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1561189662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 msgr2=0x55a1dd8bfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:22.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.351+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bfa40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x55a1dd8a7940 tx=0x7effd401a620 comp rx=0 tx=0).stop 2024-05-08T07:22:22.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.351+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1561189662 shutdown_connections 2024-05-08T07:22:22.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.351+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1dd8ca510 0x55a1dd9385a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.351+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1dd8b6240 0x55a1dd8c0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.351+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1dd8b0810 0x55a1dd8c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.351+0000 7efffaf3bb80 1 --2- 172.21.15.70:0/1561189662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1dd8b11d0 0x55a1dd8bfa40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.351+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1561189662 >> 172.21.15.70:0/1561189662 conn(0x55a1dd828860 msgr2=0x55a1dd8b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:22.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.351+0000 7effcf400700 0 client.16476 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:22:22.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.352+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1561189662 shutdown_connections 2024-05-08T07:22:22.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.352+0000 7efffaf3bb80 1 -- 172.21.15.70:0/1561189662 wait complete. 2024-05-08T07:22:22.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.352+0000 7efffaf3bb80 20 client.16476 trim_cache size 0 max 16384 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 36, 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 90, 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "fa5126fe": { 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 90, 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:22:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 75.2, 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:22.354 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:22:22.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 -- 172.21.15.70:0/4180967128 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effd00b2ba0 msgr2=0x7effd00b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:22.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effd00b2ba0 0x7effd00b5060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7effdc0a6720 tx=0x7effdc009ca0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 -- 172.21.15.70:0/4180967128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effe8103550 msgr2=0x7effe810a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:22.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effe8103550 0x7effe810a3e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effdc0059d0 tx=0x7effdc0057c0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 -- 172.21.15.70:0/4180967128 shutdown_connections 2024-05-08T07:22:22.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7effd00b2ba0 0x7effd00b5060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effe8108460 0x7effe810ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7effe8103550 0x7effe810a3e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 --2- 172.21.15.70:0/4180967128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7effe8103ef0 0x7effe810a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 -- 172.21.15.70:0/4180967128 >> 172.21.15.70:0/4180967128 conn(0x7effe807a600 msgr2=0x7effe81013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 -- 172.21.15.70:0/4180967128 shutdown_connections 2024-05-08T07:22:22.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:22.354+0000 7efff0600700 1 -- 172.21.15.70:0/4180967128 wait complete. 2024-05-08T07:22:22.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:22:23.308 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fa5126fe', quiesce took 30.5 seconds. Will release after: 15.2 2024-05-08T07:22:23.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:23 smithi194 ceph-mon[33679]: pgmap v1134: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 347 KiB/s wr, 36 op/s 2024-05-08T07:22:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:23 smithi070 ceph-mon[29591]: pgmap v1134: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 347 KiB/s wr, 36 op/s 2024-05-08T07:22:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:23 smithi172 ceph-mon[33377]: pgmap v1134: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 347 KiB/s wr, 36 op/s 2024-05-08T07:22:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:25 smithi194 ceph-mon[33679]: pgmap v1135: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 347 KiB/s wr, 36 op/s 2024-05-08T07:22:25.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:25 smithi070 ceph-mon[29591]: pgmap v1135: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 347 KiB/s wr, 36 op/s 2024-05-08T07:22:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:25 smithi172 ceph-mon[33377]: pgmap v1135: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 347 KiB/s wr, 36 op/s 2024-05-08T07:22:27.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:27 smithi172 ceph-mon[33377]: pgmap v1136: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 425 KiB/s wr, 254 op/s 2024-05-08T07:22:27.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:22:27.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:22:27.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:22:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:27 smithi194 ceph-mon[33679]: pgmap v1136: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 425 KiB/s wr, 254 op/s 2024-05-08T07:22:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:22:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:22:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:22:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:27 smithi070 ceph-mon[29591]: pgmap v1136: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 425 KiB/s wr, 254 op/s 2024-05-08T07:22:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:22:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:22:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:22:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:28 smithi070 ceph-mon[29591]: pgmap v1137: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 425 KiB/s wr, 254 op/s 2024-05-08T07:22:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:28 smithi070 ceph-mon[29591]: osdmap e151: 12 total, 12 up, 12 in 2024-05-08T07:22:29.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:28 smithi172 ceph-mon[33377]: pgmap v1137: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 425 KiB/s wr, 254 op/s 2024-05-08T07:22:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:28 smithi172 ceph-mon[33377]: osdmap e151: 12 total, 12 up, 12 in 2024-05-08T07:22:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:28 smithi194 ceph-mon[33679]: pgmap v1137: 129 pgs: 129 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 425 KiB/s wr, 254 op/s 2024-05-08T07:22:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:28 smithi194 ceph-mon[33679]: osdmap e151: 12 total, 12 up, 12 in 2024-05-08T07:22:31.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:30 smithi172 ceph-mon[33377]: pgmap v1139: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 210 KiB/s wr, 251 op/s 2024-05-08T07:22:31.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:30 smithi194 ceph-mon[33679]: pgmap v1139: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 210 KiB/s wr, 251 op/s 2024-05-08T07:22:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:30 smithi070 ceph-mon[29591]: pgmap v1139: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 210 KiB/s wr, 251 op/s 2024-05-08T07:22:33.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:32 smithi172 ceph-mon[33377]: pgmap v1140: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 206 KiB/s wr, 246 op/s 2024-05-08T07:22:33.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:32 smithi194 ceph-mon[33679]: pgmap v1140: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 206 KiB/s wr, 246 op/s 2024-05-08T07:22:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:32 smithi070 ceph-mon[29591]: pgmap v1140: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 206 KiB/s wr, 246 op/s 2024-05-08T07:22:35.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:34 smithi172 ceph-mon[33377]: pgmap v1141: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 206 KiB/s wr, 246 op/s 2024-05-08T07:22:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:34 smithi194 ceph-mon[33679]: pgmap v1141: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 206 KiB/s wr, 246 op/s 2024-05-08T07:22:35.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:34 smithi070 ceph-mon[29591]: pgmap v1141: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 206 KiB/s wr, 246 op/s 2024-05-08T07:22:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:36 smithi172 ceph-mon[33377]: pgmap v1142: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 37 KiB/s wr, 9 op/s 2024-05-08T07:22:37.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:36 smithi194 ceph-mon[33679]: pgmap v1142: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 37 KiB/s wr, 9 op/s 2024-05-08T07:22:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:36 smithi070 ceph-mon[29591]: pgmap v1142: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 37 KiB/s wr, 9 op/s 2024-05-08T07:22:38.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:22:38.954 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:22:39.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:38 smithi172 ceph-mon[33377]: pgmap v1143: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 37 KiB/s wr, 9 op/s 2024-05-08T07:22:39.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:38 smithi194 ceph-mon[33679]: pgmap v1143: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 37 KiB/s wr, 9 op/s 2024-05-08T07:22:39.289 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:38 smithi070 ceph-mon[29591]: pgmap v1143: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 37 KiB/s wr, 9 op/s 2024-05-08T07:22:40.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:40 smithi070 ceph-mon[29591]: pgmap v1144: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-05-08T07:22:41.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:40 smithi172 ceph-mon[33377]: pgmap v1144: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-05-08T07:22:41.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.221+0000 7fde7e200700 1 -- 172.21.15.70:0/3552935842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810a490 msgr2=0x7fde781169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:41.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.221+0000 7fde7e200700 1 --2- 172.21.15.70:0/3552935842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810a490 0x7fde781169a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fde7000b0a0 tx=0x7fde7000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.221+0000 7fde7e200700 1 -- 172.21.15.70:0/3552935842 shutdown_connections 2024-05-08T07:22:41.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.221+0000 7fde7e200700 1 --2- 172.21.15.70:0/3552935842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810a490 0x7fde781169a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.221+0000 7fde7e200700 1 --2- 172.21.15.70:0/3552935842 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde7810fb60 0x7fde7810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.221+0000 7fde7e200700 1 --2- 172.21.15.70:0/3552935842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde78109ad0 0x7fde78109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.221+0000 7fde7e200700 1 -- 172.21.15.70:0/3552935842 >> 172.21.15.70:0/3552935842 conn(0x7fde78076c70 msgr2=0x7fde781082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:41.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.221+0000 7fde7e200700 1 -- 172.21.15.70:0/3552935842 shutdown_connections 2024-05-08T07:22:41.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.221+0000 7fde7e200700 1 -- 172.21.15.70:0/3552935842 wait complete. 2024-05-08T07:22:41.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.222+0000 7fde7e200700 1 Processor -- start 2024-05-08T07:22:41.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.222+0000 7fde7e200700 1 -- start start 2024-05-08T07:22:41.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde7e200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde78109ad0 0x7fde781a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:41.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde7e200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7810a490 0x7fde781a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:41.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde7e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810fb60 0x7fde781a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:41.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde7e200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde78119bd0 con 0x7fde7810fb60 2024-05-08T07:22:41.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde7e200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde78119a50 con 0x7fde78109ad0 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde7e200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fde78119d50 con 0x7fde7810a490 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde77e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810fb60 0x7fde781a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde77e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810fb60 0x7fde781a4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38768/0 (socket says 172.21.15.70:38768) 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde77e00700 1 -- 172.21.15.70:0/1214246971 learned_addr learned my addr 172.21.15.70:0/1214246971 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde76a00700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7810a490 0x7fde781a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde77400700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde78109ad0 0x7fde781a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.223+0000 7fde77e00700 1 -- 172.21.15.70:0/1214246971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7810a490 msgr2=0x7fde781a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde77e00700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7810a490 0x7fde781a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde77e00700 1 -- 172.21.15.70:0/1214246971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde78109ad0 msgr2=0x7fde781a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde77e00700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde78109ad0 0x7fde781a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde77e00700 1 -- 172.21.15.70:0/1214246971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde781a50d0 con 0x7fde7810fb60 2024-05-08T07:22:41.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde76a00700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7810a490 0x7fde781a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:22:41.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde77400700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde78109ad0 0x7fde781a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:22:41.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde77e00700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810fb60 0x7fde781a4990 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fde7000b070 tx=0x7fde70004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:22:41.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde6fe00700 1 -- 172.21.15.70:0/1214246971 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70021070 con 0x7fde7810fb60 2024-05-08T07:22:41.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde781a5360 con 0x7fde7810fb60 2024-05-08T07:22:41.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde6fe00700 1 -- 172.21.15.70:0/1214246971 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde70007c00 con 0x7fde7810fb60 2024-05-08T07:22:41.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde6fe00700 1 -- 172.21.15.70:0/1214246971 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde70004780 con 0x7fde7810fb60 2024-05-08T07:22:41.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.224+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde781acc40 con 0x7fde7810fb60 2024-05-08T07:22:41.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.226+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde7806a190 con 0x7fde7810fb60 2024-05-08T07:22:41.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.228+0000 7fde6fe00700 1 -- 172.21.15.70:0/1214246971 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fde70003f20 con 0x7fde7810fb60 2024-05-08T07:22:41.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.229+0000 7fde6fe00700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde5c0b29f0 0x7fde5c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:41.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.230+0000 7fde6fe00700 1 -- 172.21.15.70:0/1214246971 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 9583+0+0 (secure 0 0 0) 0x7fde7000f020 con 0x7fde7810fb60 2024-05-08T07:22:41.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.230+0000 7fde77400700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde5c0b29f0 0x7fde5c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:41.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.230+0000 7fde77400700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde5c0b29f0 0x7fde5c0b4eb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde68009b50 tx=0x7fde68009550 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:22:41.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.232+0000 7fde6fe00700 1 -- 172.21.15.70:0/1214246971 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fde7002a020 con 0x7fde7810fb60 2024-05-08T07:22:41.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:40 smithi194 ceph-mon[33679]: pgmap v1144: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 41 KiB/s wr, 10 op/s 2024-05-08T07:22:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.524+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde781a1420 con 0x7fde7810fb60 2024-05-08T07:22:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.525+0000 7fde6fe00700 1 -- 172.21.15.70:0/1214246971 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11879 (secure 0 0 0) 0x7fde700aba20 con 0x7fde7810fb60 2024-05-08T07:22:41.524 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:22:41.525 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:17:08.396412+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:22:41.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.528+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde5c0b29f0 msgr2=0x7fde5c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:41.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.528+0000 7fde7e200700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde5c0b29f0 0x7fde5c0b4eb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde68009b50 tx=0x7fde68009550 comp rx=0 tx=0).stop 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.528+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810fb60 msgr2=0x7fde781a4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.528+0000 7fde7e200700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810fb60 0x7fde781a4990 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fde7000b070 tx=0x7fde70004e00 comp rx=0 tx=0).stop 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.529+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 shutdown_connections 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.529+0000 7fde7e200700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde5c0b29f0 0x7fde5c0b4eb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.529+0000 7fde7e200700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde7810fb60 0x7fde781a4990 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.529+0000 7fde7e200700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde78109ad0 0x7fde781a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.529+0000 7fde7e200700 1 --2- 172.21.15.70:0/1214246971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde7810a490 0x7fde781a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.529+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 >> 172.21.15.70:0/1214246971 conn(0x7fde78076c70 msgr2=0x7fde78077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.529+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 shutdown_connections 2024-05-08T07:22:41.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:41.529+0000 7fde7e200700 1 -- 172.21.15.70:0/1214246971 wait complete. 2024-05-08T07:22:41.529 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 36 2024-05-08T07:22:42.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:41 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1214246971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:22:42.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:41 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1214246971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:22:42.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:41 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1214246971' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:22:42.450 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id fa5126fe --release --await' 2024-05-08T07:22:42.451 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id fa5126fe --release --await 2024-05-08T07:22:42.872 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:22:43.203 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:42 smithi070 ceph-mon[29591]: pgmap v1145: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T07:22:43.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:42 smithi194 ceph-mon[33679]: pgmap v1145: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T07:22:43.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:42 smithi172 ceph-mon[33377]: pgmap v1145: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T07:22:45.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.178+0000 7fc00de00700 1 -- 172.21.15.70:0/634201037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 msgr2=0x7fc00810baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:45.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.178+0000 7fc00de00700 1 --2- 172.21.15.70:0/634201037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 0x7fc00810baa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009990 tx=0x7fbff8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.178+0000 7fc00de00700 1 -- 172.21.15.70:0/634201037 shutdown_connections 2024-05-08T07:22:45.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.178+0000 7fc00de00700 1 --2- 172.21.15.70:0/634201037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008106080 0x7fc008112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.178+0000 7fc00de00700 1 --2- 172.21.15.70:0/634201037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 0x7fc00810baa0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.178+0000 7fc00de00700 1 --2- 172.21.15.70:0/634201037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0081056c0 0x7fc008105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.178+0000 7fc00de00700 1 -- 172.21.15.70:0/634201037 >> 172.21.15.70:0/634201037 conn(0x7fc0081011b0 msgr2=0x7fc0081035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:45.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.178+0000 7fc00de00700 1 -- 172.21.15.70:0/634201037 shutdown_connections 2024-05-08T07:22:45.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.178+0000 7fc00de00700 1 -- 172.21.15.70:0/634201037 wait complete. 2024-05-08T07:22:45.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.179+0000 7fc00de00700 1 Processor -- start 2024-05-08T07:22:45.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.179+0000 7fc00de00700 1 -- start start 2024-05-08T07:22:45.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc00de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0081056c0 0x7fc0081a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc00de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008106080 0x7fc0081a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc00de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 0x7fc00819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc00de00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc008115750 con 0x7fc00810b6c0 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc00de00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081155d0 con 0x7fc0081056c0 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc00de00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081158d0 con 0x7fc008106080 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc007400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 0x7fc00819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc007400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 0x7fc00819ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38790/0 (socket says 172.21.15.70:38790) 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc007400700 1 -- 172.21.15.70:0/1962060643 learned_addr learned my addr 172.21.15.70:0/1962060643 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fc006a00700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0081056c0 0x7fc0081a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.180+0000 7fbfffe00700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008106080 0x7fc0081a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc007400700 1 -- 172.21.15.70:0/1962060643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008106080 msgr2=0x7fc0081a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc007400700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008106080 0x7fc0081a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc007400700 1 -- 172.21.15.70:0/1962060643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0081056c0 msgr2=0x7fc0081a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc007400700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0081056c0 0x7fc0081a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc007400700 1 -- 172.21.15.70:0/1962060643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc00819c190 con 0x7fc00810b6c0 2024-05-08T07:22:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc007400700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 0x7fc00819ba30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc000007d70 tx=0x7fc00000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:22:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc00ca00700 1 -- 172.21.15.70:0/1962060643 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000016020 con 0x7fc00810b6c0 2024-05-08T07:22:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc00ca00700 1 -- 172.21.15.70:0/1962060643 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc00000ad40 con 0x7fc00810b6c0 2024-05-08T07:22:45.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc00ca00700 1 -- 172.21.15.70:0/1962060643 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0000115e0 con 0x7fc00810b6c0 2024-05-08T07:22:45.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc00de00700 1 -- 172.21.15.70:0/1962060643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc00819c480 con 0x7fc00810b6c0 2024-05-08T07:22:45.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.181+0000 7fc00de00700 1 -- 172.21.15.70:0/1962060643 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0081a8740 con 0x7fc00810b6c0 2024-05-08T07:22:45.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.185+0000 7fc00ca00700 1 -- 172.21.15.70:0/1962060643 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc000019020 con 0x7fc00810b6c0 2024-05-08T07:22:45.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.187+0000 7fc018805b80 1 Processor -- start 2024-05-08T07:22:45.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.187+0000 7fc018805b80 1 -- start start 2024-05-08T07:22:45.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.187+0000 7fc018805b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.187+0000 7fc018805b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de03910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.187+0000 7fc018805b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de0fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.187+0000 7fc018805b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55990dd55b20 con 0x55990de03490 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.187+0000 7fc018805b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55990dcf3860 con 0x55990de08ec0 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.187+0000 7fc018805b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55990dd51ae0 con 0x55990de03e50 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.187+0000 7fc00ca00700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbfec0b29f0 0x7fbfec0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc006a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de03910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc00ca00700 1 -- 172.21.15.70:0/1962060643 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 9583+0+0 (secure 0 0 0) 0x7fc0000e2960 con 0x7fc00810b6c0 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc006a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de03910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38804/0 (socket says 172.21.15.70:38804) 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc006a00700 1 -- 172.21.15.70:0/1635386214 learned_addr learned my addr 172.21.15.70:0/1635386214 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc007400700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbfec0b29f0 0x7fbfec0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fbfffe00700 1 --2- 172.21.15.70:0/1635386214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fbfffe00700 1 --2- 172.21.15.70:0/1635386214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de0fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc006a00700 1 -- 172.21.15.70:0/1635386214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 msgr2=0x55990de0fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:22:45.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc006a00700 1 --2- 172.21.15.70:0/1635386214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de0fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc006a00700 1 -- 172.21.15.70:0/1635386214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 msgr2=0x55990de092a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:22:45.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc006a00700 1 --2- 172.21.15.70:0/1635386214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de092a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.188+0000 7fc006a00700 1 -- 172.21.15.70:0/1635386214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990dca29d0 con 0x55990de03490 2024-05-08T07:22:45.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:44 smithi070 ceph-mon[29591]: pgmap v1146: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T07:22:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.189+0000 7fc006a00700 1 --2- 172.21.15.70:0/1635386214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de03910 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbff8015000 tx=0x7fbff8005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e68d0c90d5e5fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:22:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.189+0000 7fc007400700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbfec0b29f0 0x7fbfec0b4eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc000012c40 tx=0x7fc00000aef0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:22:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.189+0000 7fbffcc00700 1 -- 172.21.15.70:0/1635386214 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8027070 con 0x55990de03490 2024-05-08T07:22:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.189+0000 7fbffcc00700 1 -- 172.21.15.70:0/1635386214 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbff8005070 con 0x55990de03490 2024-05-08T07:22:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.189+0000 7fbffcc00700 1 -- 172.21.15.70:0/1635386214 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8003a20 con 0x55990de03490 2024-05-08T07:22:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.190+0000 7fc018805b80 1 -- 172.21.15.70:0/1635386214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 msgr2=0x55990de03910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.190+0000 7fc018805b80 1 --2- 172.21.15.70:0/1635386214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de03910 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fbff8015000 tx=0x7fbff8005c80 comp rx=0 tx=0).stop 2024-05-08T07:22:45.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.190+0000 7fc018805b80 1 -- 172.21.15.70:0/1635386214 shutdown_connections 2024-05-08T07:22:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.190+0000 7fc018805b80 1 --2- 172.21.15.70:0/1635386214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de0fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.190+0000 7fc018805b80 1 --2- 172.21.15.70:0/1635386214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.190+0000 7fc018805b80 1 --2- 172.21.15.70:0/1635386214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de03910 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.190+0000 7fc018805b80 1 -- 172.21.15.70:0/1635386214 >> 172.21.15.70:0/1635386214 conn(0x55990dd31c60 msgr2=0x55990ddfdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.191+0000 7fc018805b80 1 -- 172.21.15.70:0/1635386214 shutdown_connections 2024-05-08T07:22:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.191+0000 7fc018805b80 1 -- 172.21.15.70:0/1635386214 wait complete. 2024-05-08T07:22:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.191+0000 7fc018805b80 1 -- start start 2024-05-08T07:22:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.192+0000 7fc018805b80 1 Processor -- start 2024-05-08T07:22:45.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.192+0000 7fc018805b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de0f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.192+0000 7fc018805b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de0cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.192+0000 7fc018805b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de0d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.192+0000 7fc018805b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55990de10220 con 0x55990de03490 2024-05-08T07:22:45.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.192+0000 7fc018805b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55990dcbbc20 con 0x55990de08ec0 2024-05-08T07:22:45.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.192+0000 7fc018805b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55990de103a0 con 0x55990de03e50 2024-05-08T07:22:45.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.192+0000 7fc018805b80 10 client.0 _ll_register_callbacks cb 0x55990dcfcd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:22:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fbfffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de0f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fbfffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de0f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38810/0 (socket says 172.21.15.70:38810) 2024-05-08T07:22:45.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fbfffe00700 1 -- 172.21.15.70:0/3359332398 learned_addr learned my addr 172.21.15.70:0/3359332398 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:22:45.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fc006a00700 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de0cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fbfffe00700 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de0d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fbfffe00700 1 -- 172.21.15.70:0/3359332398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 msgr2=0x55990de0cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:22:45.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fbfffe00700 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de0cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fbfffe00700 1 -- 172.21.15.70:0/3359332398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 msgr2=0x55990de0d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:22:45.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fbfffe00700 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de0d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.193+0000 7fbfffe00700 1 -- 172.21.15.70:0/3359332398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990dd1b520 con 0x55990de03490 2024-05-08T07:22:45.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.194+0000 7fbfffe00700 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de0f860 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbff000df20 tx=0x7fbff00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd7107ee39d278a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:22:45.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.194+0000 7fbff5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:22:45.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.194+0000 7fbff5600700 1 -- 172.21.15.70:0/3359332398 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0010be0 con 0x55990de03490 2024-05-08T07:22:45.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.194+0000 7fbff5600700 1 -- 172.21.15.70:0/3359332398 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(151..151 src has 1..151) ==== 9583+0+0 (secure 0 0 0) 0x7fbff0010d80 con 0x55990de03490 2024-05-08T07:22:45.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.194+0000 7fc018805b80 1 -- 172.21.15.70:0/3359332398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbff8005070 con 0x55990de03490 2024-05-08T07:22:45.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.194+0000 7fbff5600700 1 -- 172.21.15.70:0/3359332398 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbff0004020 con 0x55990de03490 2024-05-08T07:22:45.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.194+0000 7fc018805b80 10 client.16494 fetch_fsmap learned FSMap version 36 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.194+0000 7fc018805b80 1 -- 172.21.15.70:0/3359332398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55990de1aab0 con 0x55990de03490 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.195+0000 7fbff5600700 1 -- 172.21.15.70:0/3359332398 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbff8005070 con 0x55990de03490 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.195+0000 7fbff5600700 1 -- 172.21.15.70:0/3359332398 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fbff000f430 con 0x55990de03490 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.195+0000 7fc018805b80 10 client.16494 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.195+0000 7fc018805b80 10 client.16494 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.195+0000 7fc018805b80 20 client.16494 populate_metadata read hostname 'smithi070' 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.195+0000 7fc018805b80 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990de1d0f0 0x55990de1f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.195+0000 7fc018805b80 4 client.16494 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.195+0000 7fc018805b80 1 -- 172.21.15.70:0/3359332398 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55990ddd01a0 con 0x55990de1d0f0 2024-05-08T07:22:45.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.196+0000 7fc006a00700 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990de1d0f0 0x55990de1f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.197+0000 7fc006a00700 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990de1d0f0 0x55990de1f4e0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=105a1f8d5832d9d4 server_cookie=188ebcd9a3e67fdc in_seq=0 out_seq=0 2024-05-08T07:22:45.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.197+0000 7fbff5600700 10 client.16494 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:22:45.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fbff5600700 1 -- 172.21.15.70:0/3359332398 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55990ddd01a0 con 0x55990de1d0f0 2024-05-08T07:22:45.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fbff5600700 10 client.16494 handle_command_reply: tid=0 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 client.16494 shutdown 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 -- 172.21.15.70:0/3359332398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 msgr2=0x55990de0f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de0f860 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fbff000df20 tx=0x7fbff00047c0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 -- 172.21.15.70:0/3359332398 shutdown_connections 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990de1d0f0 0x55990de1f4e0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de0d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de0f860 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 --2- 172.21.15.70:0/3359332398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de0cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fbff5600700 0 client.16494 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 -- 172.21.15.70:0/3359332398 >> 172.21.15.70:0/3359332398 conn(0x55990dd31c60 msgr2=0x55990ddf8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.199+0000 7fc018805b80 1 -- 172.21.15.70:0/3359332398 shutdown_connections 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.200+0000 7fc018805b80 1 -- 172.21.15.70:0/3359332398 wait complete. 2024-05-08T07:22:45.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.200+0000 7fc018805b80 20 client.16494 trim_cache size 0 max 16384 2024-05-08T07:22:45.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.221+0000 7fc018805b80 1 Processor -- start 2024-05-08T07:22:45.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.221+0000 7fc018805b80 1 -- start start 2024-05-08T07:22:45.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fc018805b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fc018805b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de03e50 0x55990ddf86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fc018805b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de08ec0 0x55990de05940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fc018805b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081b3e70 con 0x55990de03490 2024-05-08T07:22:45.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fc018805b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081b1700 con 0x55990de03e50 2024-05-08T07:22:45.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fc018805b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081af570 con 0x55990de08ec0 2024-05-08T07:22:45.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fbfffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fbfffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de192b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38826/0 (socket says 172.21.15.70:38826) 2024-05-08T07:22:45.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fbfffe00700 1 -- 172.21.15.70:0/1469281746 learned_addr learned my addr 172.21.15.70:0/1469281746 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:22:45.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.222+0000 7fc006a00700 1 --2- 172.21.15.70:0/1469281746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de03e50 0x55990ddf86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fbfffe00700 1 -- 172.21.15.70:0/1469281746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de08ec0 msgr2=0x55990de05940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:22:45.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fbfffe00700 1 --2- 172.21.15.70:0/1469281746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de08ec0 0x55990de05940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fbfffe00700 1 -- 172.21.15.70:0/1469281746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de03e50 msgr2=0x55990ddf86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:22:45.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fbfffe00700 1 --2- 172.21.15.70:0/1469281746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de03e50 0x55990ddf86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fbfffe00700 1 -- 172.21.15.70:0/1469281746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990de10060 con 0x55990de03490 2024-05-08T07:22:45.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fc006a00700 1 --2- 172.21.15.70:0/1469281746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de03e50 0x55990ddf86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:22:45.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fbfffe00700 1 --2- 172.21.15.70:0/1469281746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de192b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbff0005e20 tx=0x7fbff0010a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6cc326fd4e22a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:22:45.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fbff7e00700 1 -- 172.21.15.70:0/1469281746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff002f070 con 0x55990de03490 2024-05-08T07:22:45.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fbff7e00700 1 -- 172.21.15.70:0/1469281746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbff000fe20 con 0x55990de03490 2024-05-08T07:22:45.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.223+0000 7fbff7e00700 1 -- 172.21.15.70:0/1469281746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0010be0 con 0x55990de03490 2024-05-08T07:22:45.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.224+0000 7fc018805b80 1 -- 172.21.15.70:0/1469281746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 msgr2=0x55990de192b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:45.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.224+0000 7fc018805b80 1 --2- 172.21.15.70:0/1469281746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de192b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fbff0005e20 tx=0x7fbff0010a90 comp rx=0 tx=0).stop 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.224+0000 7fc018805b80 1 -- 172.21.15.70:0/1469281746 shutdown_connections 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.224+0000 7fc018805b80 1 --2- 172.21.15.70:0/1469281746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de08ec0 0x55990de05940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.224+0000 7fc018805b80 1 --2- 172.21.15.70:0/1469281746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de192b0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.224+0000 7fc018805b80 1 --2- 172.21.15.70:0/1469281746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de03e50 0x55990ddf86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.224+0000 7fc018805b80 1 -- 172.21.15.70:0/1469281746 >> 172.21.15.70:0/1469281746 conn(0x55990dd31c60 msgr2=0x55990ddf7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.224+0000 7fc018805b80 1 -- 172.21.15.70:0/1469281746 shutdown_connections 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.224+0000 7fc018805b80 1 -- 172.21.15.70:0/1469281746 wait complete. 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.225+0000 7fc018805b80 1 -- start start 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.225+0000 7fc018805b80 1 Processor -- start 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.225+0000 7fc018805b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de105f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.225+0000 7fc018805b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de10b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.225+0000 7fc018805b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.225+0000 7fc018805b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081afbc0 con 0x55990de03490 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.225+0000 7fc018805b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081b1030 con 0x55990de08ec0 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.225+0000 7fc018805b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc0081b0290 con 0x55990de03e50 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fc018805b80 10 client.0 _ll_register_callbacks cb 0x55990dcfcd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbfffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de105f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbfffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de105f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38830/0 (socket says 172.21.15.70:38830) 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbfffe00700 1 -- 172.21.15.70:0/1749758957 learned_addr learned my addr 172.21.15.70:0/1749758957 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fc006a00700 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de10b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbfffe00700 1 -- 172.21.15.70:0/1749758957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 msgr2=0x55990de10b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbfffe00700 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de10b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbfffe00700 1 -- 172.21.15.70:0/1749758957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 msgr2=0x55990de878b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbfffe00700 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbfffe00700 1 -- 172.21.15.70:0/1749758957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990de113d0 con 0x55990de03490 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbfffe00700 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de105f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbff002d040 tx=0x7fbff000fca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfbb76f05a28a18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:22:45.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.226+0000 7fbff5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.227+0000 7fbff5600700 1 -- 172.21.15.70:0/1749758957 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff002f040 con 0x55990de03490 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.227+0000 7fbff5600700 1 -- 172.21.15.70:0/1749758957 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(151..151 src has 1..151) ==== 9583+0+0 (secure 0 0 0) 0x7fbff00041c0 con 0x55990de03490 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.227+0000 7fc018805b80 1 -- 172.21.15.70:0/1749758957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbff000fe20 con 0x55990de03490 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.227+0000 7fbff5600700 1 -- 172.21.15.70:0/1749758957 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fbff0010ea0 con 0x55990de03490 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.227+0000 7fc018805b80 10 client.16500 fetch_fsmap learned FSMap version 36 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.227+0000 7fc018805b80 1 -- 172.21.15.70:0/1749758957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55990de88f00 con 0x55990de03490 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.227+0000 7fbff5600700 1 -- 172.21.15.70:0/1749758957 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbff000fe20 con 0x55990de03490 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.228+0000 7fbff5600700 1 -- 172.21.15.70:0/1749758957 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 36) ==== 8354+0+0 (secure 0 0 0) 0x7fbff001a040 con 0x55990de03490 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.228+0000 7fc018805b80 10 client.16500 fetch_fsmap finished waiting for FSMap version 36 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.228+0000 7fc018805b80 10 client.16500 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.228+0000 7fc018805b80 20 client.16500 populate_metadata read hostname 'smithi070' 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.228+0000 7fc018805b80 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990de89490 0x55990de8b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.228+0000 7fc018805b80 4 client.16500 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fa5126fe", "release": true, "await": true}] 2024-05-08T07:22:45.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.228+0000 7fc018805b80 1 -- 172.21.15.70:0/1749758957 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fa5126fe", "release": true, "await": true}) -- 0x55990ddfe2e0 con 0x55990de89490 2024-05-08T07:22:45.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.228+0000 7fc006a00700 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990de89490 0x55990de8b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:22:45.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.229+0000 7fc006a00700 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990de89490 0x55990de8b8b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=447535f4447ec159 server_cookie=3e63f6a0b01a70d6 in_seq=0 out_seq=0 2024-05-08T07:22:45.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:45.229+0000 7fbff5600700 10 client.16500 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:22:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:44 smithi194 ceph-mon[33679]: pgmap v1146: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T07:22:45.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:44 smithi172 ceph-mon[33377]: pgmap v1146: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T07:22:47.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:46 smithi194 ceph-mon[33679]: pgmap v1147: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 KiB/s wr, 8 op/s 2024-05-08T07:22:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:46 smithi070 ceph-mon[29591]: pgmap v1147: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 KiB/s wr, 8 op/s 2024-05-08T07:22:47.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:46 smithi172 ceph-mon[33377]: pgmap v1147: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 32 KiB/s wr, 8 op/s 2024-05-08T07:22:49.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.071+0000 7fbff5600700 1 -- 172.21.15.70:0/1749758957 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55990ddfe2e0 con 0x55990de89490 2024-05-08T07:22:49.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.071+0000 7fbff5600700 10 client.16500 handle_command_reply: tid=0 2024-05-08T07:22:49.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.071+0000 7fc018805b80 1 client.16500 shutdown 2024-05-08T07:22:49.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.072+0000 7fc018805b80 1 -- 172.21.15.70:0/1749758957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 msgr2=0x55990de105f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:49.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.072+0000 7fc018805b80 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de105f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fbff002d040 tx=0x7fbff000fca0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.073+0000 7fc018805b80 1 -- 172.21.15.70:0/1749758957 shutdown_connections 2024-05-08T07:22:49.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.073+0000 7fc018805b80 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55990de89490 0x55990de8b8b0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.073+0000 7fc018805b80 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55990de08ec0 0x55990de878b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.073+0000 7fc018805b80 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55990de03490 0x55990de105f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.073+0000 7fc018805b80 1 --2- 172.21.15.70:0/1749758957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55990de03e50 0x55990de10b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.073+0000 7fc018805b80 1 -- 172.21.15.70:0/1749758957 >> 172.21.15.70:0/1749758957 conn(0x55990dd31c60 msgr2=0x55990ddf8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:49.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.073+0000 7fbff5600700 0 client.16500 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:22:49.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.074+0000 7fc018805b80 1 -- 172.21.15.70:0/1749758957 shutdown_connections 2024-05-08T07:22:49.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.074+0000 7fc018805b80 1 -- 172.21.15.70:0/1749758957 wait complete. 2024-05-08T07:22:49.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.075+0000 7fc018805b80 20 client.16500 trim_cache size 0 max 16384 2024-05-08T07:22:49.074 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:22:49.074 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 36, 2024-05-08T07:22:49.074 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:22:49.074 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 92, 2024-05-08T07:22:49.074 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:22:49.074 INFO:teuthology.orchestra.run.smithi070.stdout: "fa5126fe": { 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 92, 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 75.2, 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:22:49.075 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:22:49.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:49.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:49.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:49.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:49.076 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:22:49.076 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:22:49.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.076+0000 7fc00de00700 1 -- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbfec0b29f0 msgr2=0x7fbfec0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:49.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.076+0000 7fc00de00700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbfec0b29f0 0x7fbfec0b4eb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc000012c40 tx=0x7fc00000aef0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.076+0000 7fc00de00700 1 -- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 msgr2=0x7fc00819ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:22:49.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.076+0000 7fc00de00700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 0x7fc00819ba30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc000007d70 tx=0x7fc00000a340 comp rx=0 tx=0).stop 2024-05-08T07:22:49.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.077+0000 7fc00de00700 1 -- 172.21.15.70:0/1962060643 shutdown_connections 2024-05-08T07:22:49.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.077+0000 7fc00de00700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbfec0b29f0 0x7fbfec0b4eb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.077+0000 7fc00de00700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc00810b6c0 0x7fc00819ba30 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.077+0000 7fc00de00700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc0081056c0 0x7fc0081a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.077+0000 7fc00de00700 1 --2- 172.21.15.70:0/1962060643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008106080 0x7fc0081a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:22:49.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.077+0000 7fc00de00700 1 -- 172.21.15.70:0/1962060643 >> 172.21.15.70:0/1962060643 conn(0x7fc0081011b0 msgr2=0x7fc0081018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:22:49.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.077+0000 7fc00de00700 1 -- 172.21.15.70:0/1962060643 shutdown_connections 2024-05-08T07:22:49.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:22:49.077+0000 7fc00de00700 1 -- 172.21.15.70:0/1962060643 wait complete. 2024-05-08T07:22:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:48 smithi194 ceph-mon[33679]: pgmap v1148: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T07:22:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:48 smithi070 ceph-mon[29591]: pgmap v1148: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T07:22:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:48 smithi172 ceph-mon[33377]: pgmap v1148: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T07:22:49.905 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fa5126fe', seconds elapsed: 57.1 2024-05-08T07:22:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:50 smithi194 ceph-mon[33679]: pgmap v1149: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-05-08T07:22:51.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:50 smithi070 ceph-mon[29591]: pgmap v1149: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-05-08T07:22:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:50 smithi172 ceph-mon[33377]: pgmap v1149: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-05-08T07:22:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:52 smithi194 ceph-mon[33679]: pgmap v1150: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 111 KiB/s wr, 8 op/s 2024-05-08T07:22:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:52 smithi070 ceph-mon[29591]: pgmap v1150: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 111 KiB/s wr, 8 op/s 2024-05-08T07:22:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:52 smithi172 ceph-mon[33377]: pgmap v1150: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 111 KiB/s wr, 8 op/s 2024-05-08T07:22:55.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:54 smithi194 ceph-mon[33679]: pgmap v1151: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 111 KiB/s wr, 8 op/s 2024-05-08T07:22:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:54 smithi070 ceph-mon[29591]: pgmap v1151: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 111 KiB/s wr, 8 op/s 2024-05-08T07:22:55.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:54 smithi172 ceph-mon[33377]: pgmap v1151: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 111 KiB/s wr, 8 op/s 2024-05-08T07:22:56.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:56 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:22:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:55 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:22:56.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:56 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:22:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:57 smithi194 ceph-mon[33679]: pgmap v1152: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 498 KiB/s wr, 69 op/s 2024-05-08T07:22:57.330 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:57 smithi172 ceph-mon[33377]: pgmap v1152: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 498 KiB/s wr, 69 op/s 2024-05-08T07:22:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:57 smithi070 ceph-mon[29591]: pgmap v1152: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 498 KiB/s wr, 69 op/s 2024-05-08T07:22:59.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:22:59 smithi194 ceph-mon[33679]: pgmap v1153: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 489 KiB/s wr, 67 op/s 2024-05-08T07:22:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:22:59 smithi070 ceph-mon[29591]: pgmap v1153: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 489 KiB/s wr, 67 op/s 2024-05-08T07:22:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:22:59 smithi172 ceph-mon[33377]: pgmap v1153: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 489 KiB/s wr, 67 op/s 2024-05-08T07:23:01.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:01 smithi070 ceph-mon[29591]: pgmap v1154: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 729 KiB/s wr, 175 op/s 2024-05-08T07:23:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:01 smithi172 ceph-mon[33377]: pgmap v1154: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 729 KiB/s wr, 175 op/s 2024-05-08T07:23:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:01 smithi194 ceph-mon[33679]: pgmap v1154: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 729 KiB/s wr, 175 op/s 2024-05-08T07:23:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:03 smithi070 ceph-mon[29591]: pgmap v1155: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 627 KiB/s wr, 169 op/s 2024-05-08T07:23:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:03 smithi172 ceph-mon[33377]: pgmap v1155: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 627 KiB/s wr, 169 op/s 2024-05-08T07:23:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:03 smithi194 ceph-mon[33679]: pgmap v1155: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 627 KiB/s wr, 169 op/s 2024-05-08T07:23:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:05 smithi070 ceph-mon[29591]: pgmap v1156: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 627 KiB/s wr, 169 op/s 2024-05-08T07:23:05.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:05 smithi172 ceph-mon[33377]: pgmap v1156: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 627 KiB/s wr, 169 op/s 2024-05-08T07:23:05.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:05 smithi194 ceph-mon[33679]: pgmap v1156: 129 pgs: 129 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 627 KiB/s wr, 169 op/s 2024-05-08T07:23:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:06 smithi070 ceph-mon[29591]: osdmap e152: 12 total, 12 up, 12 in 2024-05-08T07:23:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:06 smithi172 ceph-mon[33377]: osdmap e152: 12 total, 12 up, 12 in 2024-05-08T07:23:06.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:06 smithi194 ceph-mon[33679]: osdmap e152: 12 total, 12 up, 12 in 2024-05-08T07:23:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:07 smithi070 ceph-mon[29591]: pgmap v1158: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-05-08T07:23:07.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:07 smithi172 ceph-mon[33377]: pgmap v1158: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-05-08T07:23:07.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:07 smithi194 ceph-mon[33679]: pgmap v1158: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-05-08T07:23:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:09 smithi070 ceph-mon[29591]: pgmap v1159: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-05-08T07:23:09.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:09 smithi172 ceph-mon[33377]: pgmap v1159: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-05-08T07:23:09.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:09 smithi194 ceph-mon[33679]: pgmap v1159: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-05-08T07:23:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:11 smithi070 ceph-mon[29591]: pgmap v1160: 129 pgs: 129 active+clean; 1.7 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.5 MiB/s wr, 420 op/s 2024-05-08T07:23:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:11 smithi172 ceph-mon[33377]: pgmap v1160: 129 pgs: 129 active+clean; 1.7 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.5 MiB/s wr, 420 op/s 2024-05-08T07:23:11.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:11 smithi194 ceph-mon[33679]: pgmap v1160: 129 pgs: 129 active+clean; 1.7 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.5 MiB/s wr, 420 op/s 2024-05-08T07:23:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:13 smithi070 ceph-mon[29591]: pgmap v1161: 129 pgs: 129 active+clean; 1.7 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.5 MiB/s wr, 420 op/s 2024-05-08T07:23:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:13 smithi070 ceph-mon[29591]: osdmap e153: 12 total, 12 up, 12 in 2024-05-08T07:23:13.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:13 smithi172 ceph-mon[33377]: pgmap v1161: 129 pgs: 129 active+clean; 1.7 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.5 MiB/s wr, 420 op/s 2024-05-08T07:23:13.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:13 smithi172 ceph-mon[33377]: osdmap e153: 12 total, 12 up, 12 in 2024-05-08T07:23:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:13 smithi194 ceph-mon[33679]: pgmap v1161: 129 pgs: 129 active+clean; 1.7 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.5 MiB/s wr, 420 op/s 2024-05-08T07:23:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:13 smithi194 ceph-mon[33679]: osdmap e153: 12 total, 12 up, 12 in 2024-05-08T07:23:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:15 smithi070 ceph-mon[29591]: pgmap v1163: 129 pgs: 129 active+clean; 1.7 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 867 KiB/s wr, 159 op/s 2024-05-08T07:23:15.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:15 smithi172 ceph-mon[33377]: pgmap v1163: 129 pgs: 129 active+clean; 1.7 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 867 KiB/s wr, 159 op/s 2024-05-08T07:23:15.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:15 smithi194 ceph-mon[33679]: pgmap v1163: 129 pgs: 129 active+clean; 1.7 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 867 KiB/s wr, 159 op/s 2024-05-08T07:23:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:17 smithi070 ceph-mon[29591]: pgmap v1164: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 2.4 MiB/s wr, 234 op/s 2024-05-08T07:23:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:17 smithi172 ceph-mon[33377]: pgmap v1164: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 2.4 MiB/s wr, 234 op/s 2024-05-08T07:23:17.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:17 smithi194 ceph-mon[33679]: pgmap v1164: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 2.4 MiB/s wr, 234 op/s 2024-05-08T07:23:18.135 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.6 2024-05-08T07:23:18.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:23:18.650 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:23:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:19 smithi070 ceph-mon[29591]: pgmap v1165: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 2.4 MiB/s wr, 234 op/s 2024-05-08T07:23:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:19 smithi172 ceph-mon[33377]: pgmap v1165: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 2.4 MiB/s wr, 234 op/s 2024-05-08T07:23:19.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:19 smithi194 ceph-mon[33679]: pgmap v1165: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 2.4 MiB/s wr, 234 op/s 2024-05-08T07:23:21.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.087+0000 7f8ebdc00700 1 -- 172.21.15.70:0/3461453091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 msgr2=0x7f8eb8105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:21.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.087+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/3461453091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 0x7f8eb8105a50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009990 tx=0x7f8ea4009ca0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.087+0000 7f8ebdc00700 1 -- 172.21.15.70:0/3461453091 shutdown_connections 2024-05-08T07:23:21.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.087+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/3461453091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8eb8105f90 0x7f8eb81124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.087+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/3461453091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810b660 0x7f8eb810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.087+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/3461453091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 0x7f8eb8105a50 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.087+0000 7f8ebdc00700 1 -- 172.21.15.70:0/3461453091 >> 172.21.15.70:0/3461453091 conn(0x7f8eb81010c0 msgr2=0x7f8eb81034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:23:21.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.087+0000 7f8ebdc00700 1 -- 172.21.15.70:0/3461453091 shutdown_connections 2024-05-08T07:23:21.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.087+0000 7f8ebdc00700 1 -- 172.21.15.70:0/3461453091 wait complete. 2024-05-08T07:23:21.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.088+0000 7f8ebdc00700 1 Processor -- start 2024-05-08T07:23:21.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.089+0000 7f8ebdc00700 1 -- start start 2024-05-08T07:23:21.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.089+0000 7f8ebdc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 0x7f8eb81a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:21.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.089+0000 7f8ebdc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8eb8105f90 0x7f8eb81a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:21.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.089+0000 7f8ebdc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810b660 0x7f8eb819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:21.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.089+0000 7f8ebdc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb8115660 con 0x7f8eb81055d0 2024-05-08T07:23:21.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.089+0000 7f8ebdc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81154e0 con 0x7f8eb8105f90 2024-05-08T07:23:21.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.089+0000 7f8ebdc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81157e0 con 0x7f8eb810b660 2024-05-08T07:23:21.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.089+0000 7f8eb7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 0x7f8eb81a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 0x7f8eb81a16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52100/0 (socket says 172.21.15.70:52100) 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7e00700 1 -- 172.21.15.70:0/1715434463 learned_addr learned my addr 172.21.15.70:0/1715434463 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7400700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8eb8105f90 0x7f8eb81a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8ebd200700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810b660 0x7f8eb819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7e00700 1 -- 172.21.15.70:0/1715434463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810b660 msgr2=0x7f8eb819b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7e00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810b660 0x7f8eb819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7e00700 1 -- 172.21.15.70:0/1715434463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8eb8105f90 msgr2=0x7f8eb81a1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7e00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8eb8105f90 0x7f8eb81a1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7e00700 1 -- 172.21.15.70:0/1715434463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb819c040 con 0x7f8eb81055d0 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7400700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8eb8105f90 0x7f8eb81a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.090+0000 7f8eb7e00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 0x7f8eb81a16d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800c990 tx=0x7f8ea800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.091+0000 7f8eb4c00700 1 -- 172.21.15.70:0/1715434463 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8007b00 con 0x7f8eb81055d0 2024-05-08T07:23:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.091+0000 7f8eb4c00700 1 -- 172.21.15.70:0/1715434463 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ea8007ca0 con 0x7f8eb81055d0 2024-05-08T07:23:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.091+0000 7f8eb4c00700 1 -- 172.21.15.70:0/1715434463 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8018660 con 0x7f8eb81055d0 2024-05-08T07:23:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.091+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb819c330 con 0x7f8eb81055d0 2024-05-08T07:23:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.091+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb81a85a0 con 0x7f8eb81055d0 2024-05-08T07:23:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.092+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb806a190 con 0x7f8eb81055d0 2024-05-08T07:23:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.094+0000 7f8eb4c00700 1 -- 172.21.15.70:0/1715434463 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8ea800f450 con 0x7f8eb81055d0 2024-05-08T07:23:21.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.096+0000 7f8eb4c00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e9c0b2a70 0x7f8e9c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.096+0000 7f8eb4c00700 1 -- 172.21.15.70:0/1715434463 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 9583+0+0 (secure 0 0 0) 0x7f8ea80e2a30 con 0x7f8eb81055d0 2024-05-08T07:23:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.096+0000 7f8eb7400700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e9c0b2a70 0x7f8e9c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.097+0000 7f8eb7400700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e9c0b2a70 0x7f8e9c0b4f30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4000c00 tx=0x7f8ea4005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:23:21.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.101+0000 7f8eb4c00700 1 -- 172.21.15.70:0/1715434463 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8ea8014030 con 0x7f8eb81055d0 2024-05-08T07:23:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:21 smithi070 ceph-mon[29591]: pgmap v1166: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 2.1 MiB/s wr, 243 op/s 2024-05-08T07:23:21.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.402+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8eb802e510 con 0x7f8eb81055d0 2024-05-08T07:23:21.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.404+0000 7f8eb4c00700 1 -- 172.21.15.70:0/1715434463 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11880 (secure 0 0 0) 0x7f8ea80a9f90 con 0x7f8eb81055d0 2024-05-08T07:23:21.403 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:23:21.404 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:22:54.313493+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T07:23:21.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.407+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e9c0b2a70 msgr2=0x7f8e9c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:21.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.407+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e9c0b2a70 0x7f8e9c0b4f30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4000c00 tx=0x7f8ea4005fb0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.407+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 msgr2=0x7f8eb81a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:21.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.407+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 0x7f8eb81a16d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8ea800c990 tx=0x7f8ea800cd50 comp rx=0 tx=0).stop 2024-05-08T07:23:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.407+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 shutdown_connections 2024-05-08T07:23:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.407+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e9c0b2a70 0x7f8e9c0b4f30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.407+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb810b660 0x7f8eb819b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.408+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8eb81055d0 0x7f8eb81a16d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.408+0000 7f8ebdc00700 1 --2- 172.21.15.70:0/1715434463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8eb8105f90 0x7f8eb81a1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.408+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 >> 172.21.15.70:0/1715434463 conn(0x7f8eb81010c0 msgr2=0x7f8eb81027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:23:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.408+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 shutdown_connections 2024-05-08T07:23:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:21.408+0000 7f8ebdc00700 1 -- 172.21.15.70:0/1715434463 wait complete. 2024-05-08T07:23:21.413 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 37 2024-05-08T07:23:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:21 smithi172 ceph-mon[33377]: pgmap v1166: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 2.1 MiB/s wr, 243 op/s 2024-05-08T07:23:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:21 smithi194 ceph-mon[33679]: pgmap v1166: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 2.1 MiB/s wr, 243 op/s 2024-05-08T07:23:22.241 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 82.6 --await-for 42.0' 2024-05-08T07:23:22.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 82.6 --await-for 42.0 2024-05-08T07:23:22.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1715434463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:23:22.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:22 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1715434463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:23:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:22 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1715434463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:23:22.737 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:23:23.219 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:23 smithi070 ceph-mon[29591]: pgmap v1167: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 2.1 MiB/s wr, 243 op/s 2024-05-08T07:23:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:23 smithi172 ceph-mon[33377]: pgmap v1167: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 2.1 MiB/s wr, 243 op/s 2024-05-08T07:23:23.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:23 smithi194 ceph-mon[33679]: pgmap v1167: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 2.1 MiB/s wr, 243 op/s 2024-05-08T07:23:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.220+0000 7f9ae8000700 1 -- 172.21.15.70:0/2920915611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01056e0 msgr2=0x7f9ae0105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.220+0000 7f9ae8000700 1 --2- 172.21.15.70:0/2920915611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01056e0 0x7f9ae0105b60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9acc009990 tx=0x7f9acc009ca0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.221+0000 7f9ae8000700 1 -- 172.21.15.70:0/2920915611 shutdown_connections 2024-05-08T07:23:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.221+0000 7f9ae8000700 1 --2- 172.21.15.70:0/2920915611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae01060a0 0x7f9ae01125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.221+0000 7f9ae8000700 1 --2- 172.21.15.70:0/2920915611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ae010b6e0 0x7f9ae010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.221+0000 7f9ae8000700 1 --2- 172.21.15.70:0/2920915611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01056e0 0x7f9ae0105b60 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.221+0000 7f9ae8000700 1 -- 172.21.15.70:0/2920915611 >> 172.21.15.70:0/2920915611 conn(0x7f9ae01011d0 msgr2=0x7f9ae01035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:23:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.221+0000 7f9ae8000700 1 -- 172.21.15.70:0/2920915611 shutdown_connections 2024-05-08T07:23:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.221+0000 7f9ae8000700 1 -- 172.21.15.70:0/2920915611 wait complete. 2024-05-08T07:23:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.222+0000 7f9ae8000700 1 Processor -- start 2024-05-08T07:23:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.222+0000 7f9ae8000700 1 -- start start 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae8000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae01056e0 0x7f9ae01a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae8000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01060a0 0x7f9ae01a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae8000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ae010b6e0 0x7f9ae019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae8000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0115790 con 0x7f9ae01060a0 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae8000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0115610 con 0x7f9ae01056e0 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae8000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae0115910 con 0x7f9ae010b6e0 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01060a0 0x7f9ae01a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01060a0 0x7f9ae01a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52112/0 (socket says 172.21.15.70:52112) 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae4c00700 1 -- 172.21.15.70:0/187564180 learned_addr learned my addr 172.21.15.70:0/187564180 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:23:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae5600700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae01056e0 0x7f9ae01a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.223+0000 7f9ae6000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ae010b6e0 0x7f9ae019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.224+0000 7f9ae4c00700 1 -- 172.21.15.70:0/187564180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ae010b6e0 msgr2=0x7f9ae019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.224+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ae010b6e0 0x7f9ae019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.224+0000 7f9ae4c00700 1 -- 172.21.15.70:0/187564180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae01056e0 msgr2=0x7f9ae01a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.224+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae01056e0 0x7f9ae01a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.224+0000 7f9ae4c00700 1 -- 172.21.15.70:0/187564180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae019c190 con 0x7f9ae01060a0 2024-05-08T07:23:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.224+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01060a0 0x7f9ae01a1db0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0057c0 tx=0x7f9acc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:23:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.225+0000 7f9ade000700 1 -- 172.21.15.70:0/187564180 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc027070 con 0x7f9ae01060a0 2024-05-08T07:23:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.225+0000 7f9ade000700 1 -- 172.21.15.70:0/187564180 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9acc00fb00 con 0x7f9ae01060a0 2024-05-08T07:23:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.225+0000 7f9ae8000700 1 -- 172.21.15.70:0/187564180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae019c420 con 0x7f9ae01060a0 2024-05-08T07:23:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.225+0000 7f9ade000700 1 -- 172.21.15.70:0/187564180 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9acc022a40 con 0x7f9ae01060a0 2024-05-08T07:23:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.225+0000 7f9ae8000700 1 -- 172.21.15.70:0/187564180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae01a8740 con 0x7f9ae01060a0 2024-05-08T07:23:25.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.231+0000 7f9ade000700 1 -- 172.21.15.70:0/187564180 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9acc02a070 con 0x7f9ae01060a0 2024-05-08T07:23:25.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.231+0000 7f9af2a2bb80 1 Processor -- start 2024-05-08T07:23:25.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.232+0000 7f9af2a2bb80 1 -- start start 2024-05-08T07:23:25.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.232+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 0x5628472d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.232+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.232+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472ccee0 0x5628472d8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.232+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56284721ebb0 con 0x5628472ccee0 2024-05-08T07:23:25.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.232+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5628471bc8f0 con 0x5628472d1f50 2024-05-08T07:23:25.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.232+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56284721ab70 con 0x5628472cc520 2024-05-08T07:23:25.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.233+0000 7f9ae6000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 0x5628472d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.233+0000 7f9ae6000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 0x5628472d2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:38674/0 (socket says 172.21.15.70:38674) 2024-05-08T07:23:25.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.233+0000 7f9ae6000700 1 -- 172.21.15.70:0/108236058 learned_addr learned my addr 172.21.15.70:0/108236058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:23:25.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.233+0000 7f9ae5600700 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.234+0000 7f9ae6000700 1 -- 172.21.15.70:0/108236058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 msgr2=0x5628472cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:23:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.234+0000 7f9ae6000700 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.234+0000 7f9ae6000700 1 -- 172.21.15.70:0/108236058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472ccee0 msgr2=0x5628472d8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:23:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.234+0000 7f9ade000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9ac80b2aa0 0x7f9ac80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.235+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472ccee0 0x5628472d8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.235+0000 7f9ae6000700 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472ccee0 0x5628472d8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.235+0000 7f9ae6000700 1 -- 172.21.15.70:0/108236058 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56284716ba60 con 0x5628472d1f50 2024-05-08T07:23:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.235+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472ccee0 0x5628472d8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:23:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.235+0000 7f9ade000700 1 -- 172.21.15.70:0/187564180 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 9583+0+0 (secure 0 0 0) 0x7f9acc0e3860 con 0x7f9ae01060a0 2024-05-08T07:23:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.235+0000 7f9ae6000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9ac80b2aa0 0x7f9ac80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.235+0000 7f9ae6000700 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 0x5628472d2330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80098f0 tx=0x7f9ad8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89024d214824869e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:23:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.236+0000 7f9ad2a00700 1 -- 172.21.15.70:0/108236058 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80048f0 con 0x5628472d1f50 2024-05-08T07:23:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.236+0000 7f9ad2a00700 1 -- 172.21.15.70:0/108236058 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ad8007b90 con 0x5628472d1f50 2024-05-08T07:23:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.236+0000 7f9ad2a00700 1 -- 172.21.15.70:0/108236058 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8015df0 con 0x5628472d1f50 2024-05-08T07:23:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.237+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/108236058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 msgr2=0x5628472d2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.237+0000 7f9ae6000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9ac80b2aa0 0x7f9ac80b4f60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ad801c000 tx=0x7f9ad8021670 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:23:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.237+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 0x5628472d2330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9ad80098f0 tx=0x7f9ad8009c00 comp rx=0 tx=0).stop 2024-05-08T07:23:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.237+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/108236058 shutdown_connections 2024-05-08T07:23:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.237+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472ccee0 0x5628472d8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.237+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 0x5628472d2330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.237+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/108236058 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.237+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/108236058 >> 172.21.15.70:0/108236058 conn(0x5628471facf0 msgr2=0x5628472c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:23:25.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.237+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/108236058 shutdown_connections 2024-05-08T07:23:25.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.238+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/108236058 wait complete. 2024-05-08T07:23:25.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.238+0000 7f9af2a2bb80 1 -- start start 2024-05-08T07:23:25.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.238+0000 7f9af2a2bb80 1 Processor -- start 2024-05-08T07:23:25.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.239+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472cc520 0x5628472d8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.239+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472ccee0 0x5628472d5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.239+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 0x5628472d6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.239+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5628472d9310 con 0x5628472cc520 2024-05-08T07:23:25.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.239+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562847184cb0 con 0x5628472d1f50 2024-05-08T07:23:25.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.239+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5628472d9490 con 0x5628472ccee0 2024-05-08T07:23:25.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.239+0000 7f9af2a2bb80 10 client.0 _ll_register_callbacks cb 0x5628471c5e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:23:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.240+0000 7f9ae5600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472cc520 0x5628472d8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.240+0000 7f9ae5600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472cc520 0x5628472d8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52138/0 (socket says 172.21.15.70:52138) 2024-05-08T07:23:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.240+0000 7f9ae5600700 1 -- 172.21.15.70:0/2028466611 learned_addr learned my addr 172.21.15.70:0/2028466611 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:23:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.240+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472ccee0 0x5628472d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.241+0000 7f9ae5600700 1 -- 172.21.15.70:0/2028466611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472ccee0 msgr2=0x5628472d5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:23:25.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.241+0000 7f9ae5600700 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472ccee0 0x5628472d5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.241+0000 7f9ae5600700 1 -- 172.21.15.70:0/2028466611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 msgr2=0x5628472d6170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T07:23:25.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.241+0000 7f9ae5600700 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 0x5628472d6170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.241+0000 7f9ae5600700 1 -- 172.21.15.70:0/2028466611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628471e45b0 con 0x5628472cc520 2024-05-08T07:23:25.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.241+0000 7f9ae5600700 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472cc520 0x5628472d8890 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4010840 tx=0x7f9ad4010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5114ea7ea40bddd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:23:25.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.241+0000 7f9ac7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:23:25.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.241+0000 7f9ac7400700 1 -- 172.21.15.70:0/2028466611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad401e060 con 0x5628472cc520 2024-05-08T07:23:25.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.242+0000 7f9ac7400700 1 -- 172.21.15.70:0/2028466611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 9583+0+0 (secure 0 0 0) 0x7f9ad400f830 con 0x5628472cc520 2024-05-08T07:23:25.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.242+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/2028466611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ad8007b90 con 0x5628472cc520 2024-05-08T07:23:25.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.242+0000 7f9ac7400700 1 -- 172.21.15.70:0/2028466611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f9ad400fa30 con 0x5628472cc520 2024-05-08T07:23:25.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.243+0000 7f9af2a2bb80 10 client.16515 fetch_fsmap learned FSMap version 37 2024-05-08T07:23:25.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.243+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/2028466611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5628472e3ae0 con 0x5628472cc520 2024-05-08T07:23:25.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.243+0000 7f9ac7400700 1 -- 172.21.15.70:0/2028466611 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ad8007b90 con 0x5628472cc520 2024-05-08T07:23:25.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.243+0000 7f9ac7400700 1 -- 172.21.15.70:0/2028466611 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f9ad400ec90 con 0x5628472cc520 2024-05-08T07:23:25.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.244+0000 7f9af2a2bb80 10 client.16515 fetch_fsmap finished waiting for FSMap version 37 2024-05-08T07:23:25.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.244+0000 7f9af2a2bb80 10 client.16515 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:23:25.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.244+0000 7f9af2a2bb80 20 client.16515 populate_metadata read hostname 'smithi070' 2024-05-08T07:23:25.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.244+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5628472e6070 0x5628472e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.244+0000 7f9af2a2bb80 4 client.16515 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:23:25.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.244+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/2028466611 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562847299230 con 0x5628472e6070 2024-05-08T07:23:25.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.244+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5628472e6070 0x5628472e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.246+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5628472e6070 0x5628472e84f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59fe236d8f98a90f server_cookie=825062fccde623b3 in_seq=0 out_seq=0 2024-05-08T07:23:25.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.246+0000 7f9ac7400700 10 client.16515 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:23:25.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.247+0000 7f9ac7400700 1 -- 172.21.15.70:0/2028466611 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562847299230 con 0x5628472e6070 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.247+0000 7f9ac7400700 10 client.16515 handle_command_reply: tid=0 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.247+0000 7f9af2a2bb80 1 client.16515 shutdown 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/2028466611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472cc520 msgr2=0x5628472d8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472cc520 0x5628472d8890 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4010840 tx=0x7f9ad4010b50 comp rx=0 tx=0).stop 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/2028466611 shutdown_connections 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5628472e6070 0x5628472e84f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472d1f50 0x5628472d6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472cc520 0x5628472d8890 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9ac7400700 0 client.16515 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/2028466611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472ccee0 0x5628472d5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/2028466611 >> 172.21.15.70:0/2028466611 conn(0x5628471facf0 msgr2=0x5628472c18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:23:25.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/2028466611 shutdown_connections 2024-05-08T07:23:25.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/2028466611 wait complete. 2024-05-08T07:23:25.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.248+0000 7f9af2a2bb80 20 client.16515 trim_cache size 0 max 16384 2024-05-08T07:23:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.277+0000 7f9af2a2bb80 1 Processor -- start 2024-05-08T07:23:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.277+0000 7f9af2a2bb80 1 -- start start 2024-05-08T07:23:25.277 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:25 smithi070 ceph-mon[29591]: pgmap v1168: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 2.0 MiB/s wr, 223 op/s 2024-05-08T07:23:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.277+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472e23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.277+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.277+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.277+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b3f90 con 0x5628472d1f50 2024-05-08T07:23:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.277+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b17f0 con 0x5628472ccee0 2024-05-08T07:23:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.277+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01af660 con 0x5628472cc520 2024-05-08T07:23:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52154/0 (socket says 172.21.15.70:52154) 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae6000700 1 -- 172.21.15.70:0/1709235174 learned_addr learned my addr 172.21.15.70:0/1709235174 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae5600700 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472e23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae6000700 1 -- 172.21.15.70:0/1709235174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 msgr2=0x5628472e23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae6000700 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472e23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae6000700 1 -- 172.21.15.70:0/1709235174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 msgr2=0x5628472d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae6000700 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae6000700 1 -- 172.21.15.70:0/1709235174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628472c79e0 con 0x5628472d1f50 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.278+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.279+0000 7f9ae6000700 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472cbc20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8003aa0 tx=0x7f9ad8017050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a8075b28565c41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.279+0000 7f9ad2000700 1 -- 172.21.15.70:0/1709235174 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8004950 con 0x5628472d1f50 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.279+0000 7f9ad2000700 1 -- 172.21.15.70:0/1709235174 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ad8007500 con 0x5628472d1f50 2024-05-08T07:23:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.279+0000 7f9ad2000700 1 -- 172.21.15.70:0/1709235174 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80156e0 con 0x5628472d1f50 2024-05-08T07:23:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.280+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1709235174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 msgr2=0x5628472cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.280+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472cbc20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8003aa0 tx=0x7f9ad8017050 comp rx=0 tx=0).stop 2024-05-08T07:23:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.280+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1709235174 shutdown_connections 2024-05-08T07:23:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.280+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472cbc20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.280+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472e23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.280+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1709235174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.280+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1709235174 >> 172.21.15.70:0/1709235174 conn(0x5628471facf0 msgr2=0x5628472cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.280+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1709235174 shutdown_connections 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.280+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1709235174 wait complete. 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.281+0000 7f9af2a2bb80 1 -- start start 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.281+0000 7f9af2a2bb80 1 Processor -- start 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472dea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472db720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9af2a2bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01afcb0 con 0x5628472d1f50 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b1120 con 0x5628472ccee0 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9af2a2bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae01b0380 con 0x5628472cc520 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9af2a2bb80 10 client.0 _ll_register_callbacks cb 0x5628471c5e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9ae6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9ae6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472dbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52158/0 (socket says 172.21.15.70:52158) 2024-05-08T07:23:25.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9ae6000700 1 -- 172.21.15.70:0/1720779644 learned_addr learned my addr 172.21.15.70:0/1720779644 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:23:25.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472db720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.282+0000 7f9ae5600700 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ae6000700 1 -- 172.21.15.70:0/1720779644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 msgr2=0x5628472dea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:23:25.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ae6000700 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472dea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ae6000700 1 -- 172.21.15.70:0/1720779644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 msgr2=0x5628472db720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:23:25.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ae6000700 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472db720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:25.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ae6000700 1 -- 172.21.15.70:0/1720779644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628472dc250 con 0x5628472d1f50 2024-05-08T07:23:25.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ae4c00700 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472db720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:23:25.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ae6000700 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472dbc60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8007e30 tx=0x7f9ad8007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce28eb68884de9aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:23:25.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ac7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:23:25.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ac7400700 1 -- 172.21.15.70:0/1720779644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad803a020 con 0x5628472d1f50 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9ac7400700 1 -- 172.21.15.70:0/1720779644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(153..153 src has 1..153) ==== 9583+0+0 (secure 0 0 0) 0x7f9ad8015680 con 0x5628472d1f50 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.283+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1720779644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ad8007500 con 0x5628472d1f50 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.284+0000 7f9ac7400700 1 -- 172.21.15.70:0/1720779644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f9ad8045050 con 0x5628472d1f50 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.284+0000 7f9af2a2bb80 10 client.16521 fetch_fsmap learned FSMap version 37 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.284+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1720779644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5628473517f0 con 0x5628472d1f50 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.284+0000 7f9ac7400700 1 -- 172.21.15.70:0/1720779644 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ad8007500 con 0x5628472d1f50 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.284+0000 7f9ac7400700 1 -- 172.21.15.70:0/1720779644 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f9ad802c930 con 0x5628472d1f50 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.284+0000 7f9af2a2bb80 10 client.16521 fetch_fsmap finished waiting for FSMap version 37 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.284+0000 7f9af2a2bb80 10 client.16521 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.284+0000 7f9af2a2bb80 20 client.16521 populate_metadata read hostname 'smithi070' 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.285+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562847351d90 0x5628473541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.285+0000 7f9af2a2bb80 4 client.16521 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.6, "await_for": 42.0}] 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.285+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1720779644 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.6, "await_for": 42.0}) -- 0x5628472c7370 con 0x562847351d90 2024-05-08T07:23:25.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.285+0000 7f9ae5600700 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562847351d90 0x5628473541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:23:25.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.286+0000 7f9ac7400700 10 client.16521 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:23:25.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:25.286+0000 7f9ae5600700 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562847351d90 0x5628473541b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46cc8c3f22e6166e server_cookie=9c04982cf3356f96 in_seq=0 out_seq=0 2024-05-08T07:23:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:25 smithi172 ceph-mon[33377]: pgmap v1168: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 2.0 MiB/s wr, 223 op/s 2024-05-08T07:23:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:25 smithi194 ceph-mon[33679]: pgmap v1168: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 2.0 MiB/s wr, 223 op/s 2024-05-08T07:23:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:27 smithi172 ceph-mon[33377]: pgmap v1169: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 2.3 MiB/s wr, 259 op/s 2024-05-08T07:23:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:23:27.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:27 smithi194 ceph-mon[33679]: pgmap v1169: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 2.3 MiB/s wr, 259 op/s 2024-05-08T07:23:27.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:23:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:27 smithi070 ceph-mon[29591]: pgmap v1169: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 2.3 MiB/s wr, 259 op/s 2024-05-08T07:23:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:23:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:29 smithi172 ceph-mon[33377]: pgmap v1170: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 970 KiB/s wr, 180 op/s 2024-05-08T07:23:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:23:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:23:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:23:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:29 smithi194 ceph-mon[33679]: pgmap v1170: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 970 KiB/s wr, 180 op/s 2024-05-08T07:23:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:23:29.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:23:29.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:23:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:29 smithi070 ceph-mon[29591]: pgmap v1170: 129 pgs: 129 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 970 KiB/s wr, 180 op/s 2024-05-08T07:23:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:23:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:23:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:23:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:31 smithi172 ceph-mon[33377]: pgmap v1171: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 1.2 MiB/s wr, 258 op/s 2024-05-08T07:23:31.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:31 smithi194 ceph-mon[33679]: pgmap v1171: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 1.2 MiB/s wr, 258 op/s 2024-05-08T07:23:31.511 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:31 smithi070 ceph-mon[29591]: pgmap v1171: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 1.2 MiB/s wr, 258 op/s 2024-05-08T07:23:33.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:33 smithi172 ceph-mon[33377]: pgmap v1172: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 833 KiB/s wr, 135 op/s 2024-05-08T07:23:33.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:33 smithi194 ceph-mon[33679]: pgmap v1172: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 833 KiB/s wr, 135 op/s 2024-05-08T07:23:33.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:33 smithi070 ceph-mon[29591]: pgmap v1172: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 833 KiB/s wr, 135 op/s 2024-05-08T07:23:35.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:35 smithi172 ceph-mon[33377]: pgmap v1173: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 833 KiB/s wr, 135 op/s 2024-05-08T07:23:35.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:35 smithi194 ceph-mon[33679]: pgmap v1173: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 833 KiB/s wr, 135 op/s 2024-05-08T07:23:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:35 smithi070 ceph-mon[29591]: pgmap v1173: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 833 KiB/s wr, 135 op/s 2024-05-08T07:23:37.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:37 smithi172 ceph-mon[33377]: pgmap v1174: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 843 KiB/s wr, 140 op/s 2024-05-08T07:23:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:37 smithi194 ceph-mon[33679]: pgmap v1174: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 843 KiB/s wr, 140 op/s 2024-05-08T07:23:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:37 smithi070 ceph-mon[29591]: pgmap v1174: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 843 KiB/s wr, 140 op/s 2024-05-08T07:23:39.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:39 smithi172 ceph-mon[33377]: pgmap v1175: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 318 KiB/s wr, 83 op/s 2024-05-08T07:23:39.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:39 smithi194 ceph-mon[33679]: pgmap v1175: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 318 KiB/s wr, 83 op/s 2024-05-08T07:23:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:39 smithi070 ceph-mon[29591]: pgmap v1175: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 318 KiB/s wr, 83 op/s 2024-05-08T07:23:41.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:41 smithi172 ceph-mon[33377]: pgmap v1176: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 359 KiB/s wr, 181 op/s 2024-05-08T07:23:41.432 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:41 smithi070 ceph-mon[29591]: pgmap v1176: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 359 KiB/s wr, 181 op/s 2024-05-08T07:23:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:41 smithi194 ceph-mon[33679]: pgmap v1176: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 359 KiB/s wr, 181 op/s 2024-05-08T07:23:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:43 smithi194 ceph-mon[33679]: pgmap v1177: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 52 KiB/s wr, 102 op/s 2024-05-08T07:23:43.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:43 smithi070 ceph-mon[29591]: pgmap v1177: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 52 KiB/s wr, 102 op/s 2024-05-08T07:23:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:43 smithi172 ceph-mon[33377]: pgmap v1177: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 52 KiB/s wr, 102 op/s 2024-05-08T07:23:45.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:45 smithi070 ceph-mon[29591]: pgmap v1178: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 52 KiB/s wr, 102 op/s 2024-05-08T07:23:45.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.477+0000 7f9ac7400700 1 -- 172.21.15.70:0/1720779644 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5628472c7370 con 0x562847351d90 2024-05-08T07:23:45.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.477+0000 7f9ac7400700 10 client.16521 handle_command_reply: tid=0 2024-05-08T07:23:45.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.477+0000 7f9af2a2bb80 1 client.16521 shutdown 2024-05-08T07:23:45.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.477+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1720779644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 msgr2=0x5628472dbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:45.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.477+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472dbc60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8007e30 tx=0x7f9ad8007990 comp rx=0 tx=0).stop 2024-05-08T07:23:45.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.478+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1720779644 shutdown_connections 2024-05-08T07:23:45.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.478+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562847351d90 0x5628473541b0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:45.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.478+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628472d1f50 0x5628472dbc60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:45.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.478+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5628472cc520 0x5628472dea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:45.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.478+0000 7f9af2a2bb80 1 --2- 172.21.15.70:0/1720779644 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5628472ccee0 0x5628472db720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:45.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.478+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1720779644 >> 172.21.15.70:0/1720779644 conn(0x5628471facf0 msgr2=0x5628472d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:23:45.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.478+0000 7f9ac7400700 0 client.16521 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:23:45.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.479+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1720779644 shutdown_connections 2024-05-08T07:23:45.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.479+0000 7f9af2a2bb80 1 -- 172.21.15.70:0/1720779644 wait complete. 2024-05-08T07:23:45.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.479+0000 7f9af2a2bb80 20 client.16521 trim_cache size 0 max 16384 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 37, 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 94, 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "cdd159a0": { 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 94, 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:23:45.480 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:23:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 82.6, 2024-05-08T07:23:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:23:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:23:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:23:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:23:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:23:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:23:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:23:45.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:23:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:23:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:23:45.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:23:45.482 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:23:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 -- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9ac80b2aa0 msgr2=0x7f9ac80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9ac80b2aa0 0x7f9ac80b4f60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9ad801c000 tx=0x7f9ad8021670 comp rx=0 tx=0).stop 2024-05-08T07:23:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 -- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01060a0 msgr2=0x7f9ae01a1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:23:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01060a0 0x7f9ae01a1db0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0057c0 tx=0x7f9acc0057f0 comp rx=0 tx=0).stop 2024-05-08T07:23:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 -- 172.21.15.70:0/187564180 shutdown_connections 2024-05-08T07:23:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9ac80b2aa0 0x7f9ac80b4f60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:45.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ae010b6e0 0x7f9ae019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ae01056e0 0x7f9ae01a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 --2- 172.21.15.70:0/187564180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ae01060a0 0x7f9ae01a1db0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:23:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 -- 172.21.15.70:0/187564180 >> 172.21.15.70:0/187564180 conn(0x7f9ae01011d0 msgr2=0x7f9ae0101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:23:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 -- 172.21.15.70:0/187564180 shutdown_connections 2024-05-08T07:23:45.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:23:45.481+0000 7f9ae8000700 1 -- 172.21.15.70:0/187564180 wait complete. 2024-05-08T07:23:45.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:45 smithi194 ceph-mon[33679]: pgmap v1178: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 52 KiB/s wr, 102 op/s 2024-05-08T07:23:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:45 smithi172 ceph-mon[33377]: pgmap v1178: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 52 KiB/s wr, 102 op/s 2024-05-08T07:23:46.574 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cdd159a0', quiesce took 28.4 seconds. Will release after: 22.6 2024-05-08T07:23:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:47 smithi194 ceph-mon[33679]: pgmap v1179: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 88 KiB/s wr, 107 op/s 2024-05-08T07:23:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:47 smithi070 ceph-mon[29591]: pgmap v1179: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 88 KiB/s wr, 107 op/s 2024-05-08T07:23:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:47 smithi172 ceph-mon[33377]: pgmap v1179: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 88 KiB/s wr, 107 op/s 2024-05-08T07:23:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:49 smithi194 ceph-mon[33679]: pgmap v1180: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 77 KiB/s wr, 102 op/s 2024-05-08T07:23:49.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:49 smithi070 ceph-mon[29591]: pgmap v1180: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 77 KiB/s wr, 102 op/s 2024-05-08T07:23:49.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:49 smithi172 ceph-mon[33377]: pgmap v1180: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 77 KiB/s wr, 102 op/s 2024-05-08T07:23:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:51 smithi194 ceph-mon[33679]: pgmap v1181: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 90 KiB/s wr, 106 op/s 2024-05-08T07:23:51.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:51 smithi070 ceph-mon[29591]: pgmap v1181: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 90 KiB/s wr, 106 op/s 2024-05-08T07:23:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:51 smithi172 ceph-mon[33377]: pgmap v1181: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 90 KiB/s wr, 106 op/s 2024-05-08T07:23:53.509 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:53 smithi070 ceph-mon[29591]: pgmap v1182: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:23:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:53 smithi194 ceph-mon[33679]: pgmap v1182: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:23:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:53 smithi172 ceph-mon[33377]: pgmap v1182: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:23:55.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:55 smithi194 ceph-mon[33679]: pgmap v1183: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:23:55.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:55 smithi070 ceph-mon[29591]: pgmap v1183: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:23:55.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:55 smithi172 ceph-mon[33377]: pgmap v1183: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:23:57.482 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:57 smithi172 ceph-mon[33377]: pgmap v1184: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-05-08T07:23:57.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:57 smithi194 ceph-mon[33679]: pgmap v1184: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-05-08T07:23:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:57 smithi070 ceph-mon[29591]: pgmap v1184: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-05-08T07:23:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:23:59 smithi194 ceph-mon[33679]: pgmap v1185: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T07:23:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:23:59 smithi070 ceph-mon[29591]: pgmap v1185: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T07:23:59.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:23:59 smithi172 ceph-mon[33377]: pgmap v1185: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T07:24:01.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:01 smithi194 ceph-mon[33679]: pgmap v1186: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-08T07:24:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:01 smithi070 ceph-mon[29591]: pgmap v1186: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-08T07:24:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:01 smithi172 ceph-mon[33377]: pgmap v1186: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-08T07:24:03.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:03 smithi194 ceph-mon[33679]: pgmap v1187: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2024-05-08T07:24:03.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:03 smithi070 ceph-mon[29591]: pgmap v1187: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2024-05-08T07:24:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:03 smithi172 ceph-mon[33377]: pgmap v1187: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2024-05-08T07:24:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:05 smithi194 ceph-mon[33679]: pgmap v1188: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2024-05-08T07:24:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:05 smithi070 ceph-mon[29591]: pgmap v1188: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2024-05-08T07:24:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:05 smithi172 ceph-mon[33377]: pgmap v1188: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 6 op/s 2024-05-08T07:24:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:07 smithi194 ceph-mon[33679]: pgmap v1189: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-05-08T07:24:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:07 smithi070 ceph-mon[29591]: pgmap v1189: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-05-08T07:24:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:07 smithi172 ceph-mon[33377]: pgmap v1189: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 64 KiB/s wr, 25 op/s 2024-05-08T07:24:09.177 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:24:09.621 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:24:09.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:09 smithi070 ceph-mon[29591]: pgmap v1190: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-05-08T07:24:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:09 smithi172 ceph-mon[33377]: pgmap v1190: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-05-08T07:24:09.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:09 smithi194 ceph-mon[33679]: pgmap v1190: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 54 KiB/s wr, 22 op/s 2024-05-08T07:24:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:11 smithi070 ceph-mon[29591]: pgmap v1191: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 61 KiB/s wr, 25 op/s 2024-05-08T07:24:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:11 smithi070 ceph-mon[29591]: osdmap e154: 12 total, 12 up, 12 in 2024-05-08T07:24:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:11 smithi172 ceph-mon[33377]: pgmap v1191: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 61 KiB/s wr, 25 op/s 2024-05-08T07:24:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:11 smithi172 ceph-mon[33377]: osdmap e154: 12 total, 12 up, 12 in 2024-05-08T07:24:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:11 smithi194 ceph-mon[33679]: pgmap v1191: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 61 KiB/s wr, 25 op/s 2024-05-08T07:24:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:11 smithi194 ceph-mon[33679]: osdmap e154: 12 total, 12 up, 12 in 2024-05-08T07:24:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:11.998+0000 7f953dc00700 1 -- 172.21.15.70:0/2247052443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 msgr2=0x7f9538112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:11.998+0000 7f953dc00700 1 --2- 172.21.15.70:0/2247052443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 0x7f9538112590 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f953000b0a0 tx=0x7f953000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:11.998+0000 7f953dc00700 1 -- 172.21.15.70:0/2247052443 shutdown_connections 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:11.998+0000 7f953dc00700 1 --2- 172.21.15.70:0/2247052443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 0x7f9538112590 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:11.998+0000 7f953dc00700 1 --2- 172.21.15.70:0/2247052443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f953810b6c0 0x7f953810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:11.998+0000 7f953dc00700 1 --2- 172.21.15.70:0/2247052443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95381056c0 0x7f9538105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:11.998+0000 7f953dc00700 1 -- 172.21.15.70:0/2247052443 >> 172.21.15.70:0/2247052443 conn(0x7f95381011b0 msgr2=0x7f95381035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:11.999+0000 7f953dc00700 1 -- 172.21.15.70:0/2247052443 shutdown_connections 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:11.999+0000 7f953dc00700 1 -- 172.21.15.70:0/2247052443 wait complete. 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.000+0000 7f953dc00700 1 Processor -- start 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.000+0000 7f953dc00700 1 -- start start 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.000+0000 7f953dc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95381056c0 0x7f95381a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.000+0000 7f953dc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 0x7f95381a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.000+0000 7f953dc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f953810b6c0 0x7f953819ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.000+0000 7f953dc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95381157b0 con 0x7f9538106080 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.000+0000 7f953dc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9538115630 con 0x7f95381056c0 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.000+0000 7f953dc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9538115930 con 0x7f953810b6c0 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.000+0000 7f9536000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 0x7f95381a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 0x7f95381a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52376/0 (socket says 172.21.15.70:52376) 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536000700 1 -- 172.21.15.70:0/3968703771 learned_addr learned my addr 172.21.15.70:0/3968703771 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536a00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95381056c0 0x7f95381a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9537400700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f953810b6c0 0x7f953819ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536000700 1 -- 172.21.15.70:0/3968703771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f953810b6c0 msgr2=0x7f953819ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536000700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f953810b6c0 0x7f953819ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536000700 1 -- 172.21.15.70:0/3968703771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95381056c0 msgr2=0x7f95381a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536000700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95381056c0 0x7f95381a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536000700 1 -- 172.21.15.70:0/3968703771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f953819c1f0 con 0x7f9538106080 2024-05-08T07:24:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536a00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95381056c0 0x7f95381a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:24:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.001+0000 7f9536000700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 0x7f95381a1dc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f952400d950 tx=0x7f952400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:24:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.002+0000 7f952f400700 1 -- 172.21.15.70:0/3968703771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524016070 con 0x7f9538106080 2024-05-08T07:24:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.002+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f953819c4e0 con 0x7f9538106080 2024-05-08T07:24:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.002+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95381a8750 con 0x7f9538106080 2024-05-08T07:24:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.002+0000 7f952f400700 1 -- 172.21.15.70:0/3968703771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9524010460 con 0x7f9538106080 2024-05-08T07:24:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.002+0000 7f952f400700 1 -- 172.21.15.70:0/3968703771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952400f620 con 0x7f9538106080 2024-05-08T07:24:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.003+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9518005330 con 0x7f9538106080 2024-05-08T07:24:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.006+0000 7f952f400700 1 -- 172.21.15.70:0/3968703771 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9524019070 con 0x7f9538106080 2024-05-08T07:24:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.008+0000 7f952f400700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f951c0b2a70 0x7f951c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.008+0000 7f952f400700 1 -- 172.21.15.70:0/3968703771 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 9671+0+0 (secure 0 0 0) 0x7f95240e29f0 con 0x7f9538106080 2024-05-08T07:24:12.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.008+0000 7f9536a00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f951c0b2a70 0x7f951c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:12.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.009+0000 7f9536a00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f951c0b2a70 0x7f951c0b4f30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9528005e10 tx=0x7f9528005d60 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:24:12.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.010+0000 7f952f400700 1 -- 172.21.15.70:0/3968703771 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f95240a9ef0 con 0x7f9538106080 2024-05-08T07:24:12.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.294+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9518005620 con 0x7f9538106080 2024-05-08T07:24:12.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.295+0000 7f952f400700 1 -- 172.21.15.70:0/3968703771 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+11880 (secure 0 0 0) 0x7f95240a97f0 con 0x7f9538106080 2024-05-08T07:24:12.295 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:24:12.295 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:22:54.313493+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f951c0b2a70 msgr2=0x7f951c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f951c0b2a70 0x7f951c0b4f30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9528005e10 tx=0x7f9528005d60 comp rx=0 tx=0).stop 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 msgr2=0x7f95381a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 0x7f95381a1dc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f952400d950 tx=0x7f952400dd10 comp rx=0 tx=0).stop 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 shutdown_connections 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f951c0b2a70 0x7f951c0b4f30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f953810b6c0 0x7f953819ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f95381056c0 0x7f95381a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 --2- 172.21.15.70:0/3968703771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9538106080 0x7f95381a1dc0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:12.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 >> 172.21.15.70:0/3968703771 conn(0x7f95381011b0 msgr2=0x7f95381019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:24:12.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 shutdown_connections 2024-05-08T07:24:12.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:12.299+0000 7f953dc00700 1 -- 172.21.15.70:0/3968703771 wait complete. 2024-05-08T07:24:12.299 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 37 2024-05-08T07:24:13.099 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id cdd159a0 --release --await' 2024-05-08T07:24:13.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id cdd159a0 --release --await 2024-05-08T07:24:13.523 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:24:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:13 smithi070 ceph-mon[29591]: pgmap v1193: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-05-08T07:24:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3968703771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:24:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:13 smithi172 ceph-mon[33377]: pgmap v1193: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-05-08T07:24:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:13 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3968703771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:24:13.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:13 smithi194 ceph-mon[33679]: pgmap v1193: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-05-08T07:24:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:13 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3968703771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:24:15.522 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:15 smithi070 ceph-mon[29591]: pgmap v1194: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-05-08T07:24:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:15 smithi172 ceph-mon[33377]: pgmap v1194: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-05-08T07:24:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:15 smithi194 ceph-mon[33679]: pgmap v1194: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-05-08T07:24:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.833+0000 7f1932a00700 1 -- 172.21.15.70:0/2667654329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c10fd80 msgr2=0x7f192c112170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.833+0000 7f1932a00700 1 --2- 172.21.15.70:0/2667654329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c10fd80 0x7f192c112170 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f192400b0a0 tx=0x7f192400b3b0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.833+0000 7f1932a00700 1 -- 172.21.15.70:0/2667654329 shutdown_connections 2024-05-08T07:24:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.833+0000 7f1932a00700 1 --2- 172.21.15.70:0/2667654329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c10fd80 0x7f192c112170 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.833+0000 7f1932a00700 1 --2- 172.21.15.70:0/2667654329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f192c101840 0x7f192c101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.833+0000 7f1932a00700 1 --2- 172.21.15.70:0/2667654329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f192c102160 0x7f192c10f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.833+0000 7f1932a00700 1 -- 172.21.15.70:0/2667654329 >> 172.21.15.70:0/2667654329 conn(0x7f192c077140 msgr2=0x7f192c077550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:24:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.833+0000 7f1932a00700 1 -- 172.21.15.70:0/2667654329 shutdown_connections 2024-05-08T07:24:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.833+0000 7f1932a00700 1 -- 172.21.15.70:0/2667654329 wait complete. 2024-05-08T07:24:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.835+0000 7f1932a00700 1 Processor -- start 2024-05-08T07:24:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.835+0000 7f1932a00700 1 -- start start 2024-05-08T07:24:15.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.835+0000 7f1932a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f192c101840 0x7f192c1a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.835+0000 7f1932a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c102160 0x7f192c1a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.835+0000 7f1932a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f192c10fd80 0x7f192c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.835+0000 7f1932a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f192c115630 con 0x7f192c102160 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.835+0000 7f1932a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1154b0 con 0x7f192c101840 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.835+0000 7f1932a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1157b0 con 0x7f192c10fd80 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1930c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c102160 0x7f192c1a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1930c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c102160 0x7f192c1a1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52394/0 (socket says 172.21.15.70:52394) 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1930c00700 1 -- 172.21.15.70:0/457343050 learned_addr learned my addr 172.21.15.70:0/457343050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1931600700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f192c101840 0x7f192c1a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1932000700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f192c10fd80 0x7f192c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1930c00700 1 -- 172.21.15.70:0/457343050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f192c10fd80 msgr2=0x7f192c19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1930c00700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f192c10fd80 0x7f192c19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1930c00700 1 -- 172.21.15.70:0/457343050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f192c101840 msgr2=0x7f192c1a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1930c00700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f192c101840 0x7f192c1a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1930c00700 1 -- 172.21.15.70:0/457343050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192c19c050 con 0x7f192c102160 2024-05-08T07:24:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1932000700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f192c10fd80 0x7f192c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:24:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.836+0000 7f1930c00700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c102160 0x7f192c1a1c70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f191800d950 tx=0x7f191800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:24:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.837+0000 7f192a000700 1 -- 172.21.15.70:0/457343050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1918016070 con 0x7f192c102160 2024-05-08T07:24:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.837+0000 7f192a000700 1 -- 172.21.15.70:0/457343050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1918010460 con 0x7f192c102160 2024-05-08T07:24:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.837+0000 7f1932a00700 1 -- 172.21.15.70:0/457343050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192c19c2e0 con 0x7f192c102160 2024-05-08T07:24:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.837+0000 7f192a000700 1 -- 172.21.15.70:0/457343050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191800f620 con 0x7f192c102160 2024-05-08T07:24:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.837+0000 7f1932a00700 1 -- 172.21.15.70:0/457343050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f192c1a8600 con 0x7f192c102160 2024-05-08T07:24:15.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.842+0000 7f192a000700 1 -- 172.21.15.70:0/457343050 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1918019070 con 0x7f192c102160 2024-05-08T07:24:15.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.843+0000 7f193e918b80 1 Processor -- start 2024-05-08T07:24:15.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.843+0000 7f193e918b80 1 -- start start 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.843+0000 7f192a000700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b2a70 0x7f19140b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f193e918b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694db1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f193e918b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1b70 0x55a694dab780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f193e918b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694dabda0 0x55a694dac200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f193e918b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a694cfdb20 con 0x55a694dabda0 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f192a000700 1 -- 172.21.15.70:0/457343050 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 9671+0+0 (secure 0 0 0) 0x7f19180e2630 con 0x7f192c102160 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f193e918b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a694c9b860 con 0x55a694db1b70 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f193e918b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a694cf9ae0 con 0x55a694db1250 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f1932000700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b2a70 0x7f19140b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f1932000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694dabda0 0x55a694dac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f1932000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694dabda0 0x55a694dac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52402/0 (socket says 172.21.15.70:52402) 2024-05-08T07:24:15.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f1932000700 1 -- 172.21.15.70:0/529260124 learned_addr learned my addr 172.21.15.70:0/529260124 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:24:15.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.844+0000 7f1931600700 1 --2- 172.21.15.70:0/529260124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694db1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f1930c00700 1 --2- 172.21.15.70:0/529260124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1b70 0x55a694dab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f1932000700 1 -- 172.21.15.70:0/529260124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 msgr2=0x55a694db1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:24:15.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f1932000700 1 --2- 172.21.15.70:0/529260124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694db1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f1932000700 1 -- 172.21.15.70:0/529260124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1b70 msgr2=0x55a694dab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:24:15.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f1932000700 1 --2- 172.21.15.70:0/529260124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1b70 0x55a694dab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f1932000700 1 -- 172.21.15.70:0/529260124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a694c4a9d0 con 0x55a694dabda0 2024-05-08T07:24:15.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f1932000700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b2a70 0x7f19140b4f30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1924015000 tx=0x7f1924009bc0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:24:15.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f1932000700 1 --2- 172.21.15.70:0/529260124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694dabda0 0x55a694dac200 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1924009510 tx=0x7f1924024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d6823cfea88e5d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:24:15.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f191ea00700 1 -- 172.21.15.70:0/529260124 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19240074e0 con 0x55a694dabda0 2024-05-08T07:24:15.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f191ea00700 1 -- 172.21.15.70:0/529260124 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1924007b10 con 0x55a694dabda0 2024-05-08T07:24:15.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.845+0000 7f191ea00700 1 -- 172.21.15.70:0/529260124 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192401fab0 con 0x55a694dabda0 2024-05-08T07:24:15.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.846+0000 7f193e918b80 1 -- 172.21.15.70:0/529260124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694dabda0 msgr2=0x55a694dac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:15.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.846+0000 7f193e918b80 1 --2- 172.21.15.70:0/529260124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694dabda0 0x55a694dac200 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1924009510 tx=0x7f1924024000 comp rx=0 tx=0).stop 2024-05-08T07:24:15.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.846+0000 7f193e918b80 1 -- 172.21.15.70:0/529260124 shutdown_connections 2024-05-08T07:24:15.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.846+0000 7f193e918b80 1 --2- 172.21.15.70:0/529260124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694dabda0 0x55a694dac200 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.846+0000 7f193e918b80 1 --2- 172.21.15.70:0/529260124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694db1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.846+0000 7f193e918b80 1 --2- 172.21.15.70:0/529260124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1b70 0x55a694dab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.846+0000 7f193e918b80 1 -- 172.21.15.70:0/529260124 >> 172.21.15.70:0/529260124 conn(0x55a694d237d0 msgr2=0x55a694da62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:24:15.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.847+0000 7f193e918b80 1 -- 172.21.15.70:0/529260124 shutdown_connections 2024-05-08T07:24:15.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.847+0000 7f193e918b80 1 -- 172.21.15.70:0/529260124 wait complete. 2024-05-08T07:24:15.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.847+0000 7f193e918b80 1 -- start start 2024-05-08T07:24:15.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f193e918b80 1 Processor -- start 2024-05-08T07:24:15.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f193e918b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694dabda0 0x55a694db7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f193e918b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1250 0x55a694db4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f193e918b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694db5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f193e918b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a694db8630 con 0x55a694db1b70 2024-05-08T07:24:15.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f193e918b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a694c63c20 con 0x55a694db1250 2024-05-08T07:24:15.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f193e918b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a694db87b0 con 0x55a694dabda0 2024-05-08T07:24:15.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f193e918b80 10 client.0 _ll_register_callbacks cb 0x55a694ca4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:24:15.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f1932000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694db5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.848+0000 7f1932000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694db5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52404/0 (socket says 172.21.15.70:52404) 2024-05-08T07:24:15.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1932000700 1 -- 172.21.15.70:0/1641532038 learned_addr learned my addr 172.21.15.70:0/1641532038 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1931600700 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694dabda0 0x55a694db7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1930c00700 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1250 0x55a694db4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1932000700 1 -- 172.21.15.70:0/1641532038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694dabda0 msgr2=0x55a694db7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1932000700 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694dabda0 0x55a694db7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1932000700 1 -- 172.21.15.70:0/1641532038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1250 msgr2=0x55a694db4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1932000700 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1250 0x55a694db4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1932000700 1 -- 172.21.15.70:0/1641532038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a694cc3520 con 0x55a694db1b70 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1932000700 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694db5140 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1924007a60 tx=0x7f1924007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588142eb3a9d3bf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.849+0000 7f1913400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.850+0000 7f1913400700 1 -- 172.21.15.70:0/1641532038 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924030070 con 0x55a694db1b70 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.850+0000 7f1913400700 1 -- 172.21.15.70:0/1641532038 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9671+0+0 (secure 0 0 0) 0x7f192401f730 con 0x55a694db1b70 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.850+0000 7f193e918b80 1 -- 172.21.15.70:0/1641532038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1924007b10 con 0x55a694db1b70 2024-05-08T07:24:15.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.850+0000 7f1913400700 1 -- 172.21.15.70:0/1641532038 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f192401f930 con 0x55a694db1b70 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.850+0000 7f193e918b80 10 client.16539 fetch_fsmap learned FSMap version 37 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.850+0000 7f193e918b80 1 -- 172.21.15.70:0/1641532038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a694dc2e30 con 0x55a694db1b70 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.850+0000 7f1913400700 1 -- 172.21.15.70:0/1641532038 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1924007b10 con 0x55a694db1b70 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.850+0000 7f1913400700 1 -- 172.21.15.70:0/1641532038 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f1924011070 con 0x55a694db1b70 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.851+0000 7f193e918b80 10 client.16539 fetch_fsmap finished waiting for FSMap version 37 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.851+0000 7f193e918b80 10 client.16539 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.851+0000 7f193e918b80 20 client.16539 populate_metadata read hostname 'smithi070' 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.851+0000 7f193e918b80 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a694dc5300 0x55a694dc76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.851+0000 7f193e918b80 4 client.16539 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:24:15.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.851+0000 7f193e918b80 1 -- 172.21.15.70:0/1641532038 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a694d78240 con 0x55a694dc5300 2024-05-08T07:24:15.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.851+0000 7f1931600700 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a694dc5300 0x55a694dc76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.852+0000 7f1931600700 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a694dc5300 0x55a694dc76f0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4449b9bf775dfc80 server_cookie=d9877e63b6db2487 in_seq=0 out_seq=0 2024-05-08T07:24:15.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.852+0000 7f1913400700 10 client.16539 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:24:15.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.854+0000 7f1913400700 1 -- 172.21.15.70:0/1641532038 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a694d78240 con 0x55a694dc5300 2024-05-08T07:24:15.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.854+0000 7f1913400700 10 client.16539 handle_command_reply: tid=0 2024-05-08T07:24:15.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.854+0000 7f193e918b80 1 client.16539 shutdown 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 -- 172.21.15.70:0/1641532038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 msgr2=0x55a694db5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694db5140 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1924007a60 tx=0x7f1924007a90 comp rx=0 tx=0).stop 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 -- 172.21.15.70:0/1641532038 shutdown_connections 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a694dc5300 0x55a694dc76f0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694db5140 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694dabda0 0x55a694db7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 --2- 172.21.15.70:0/1641532038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694db1250 0x55a694db4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f1913400700 0 client.16539 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 -- 172.21.15.70:0/1641532038 >> 172.21.15.70:0/1641532038 conn(0x55a694d237d0 msgr2=0x55a694daa770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:24:15.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 -- 172.21.15.70:0/1641532038 shutdown_connections 2024-05-08T07:24:15.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 1 -- 172.21.15.70:0/1641532038 wait complete. 2024-05-08T07:24:15.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.855+0000 7f193e918b80 20 client.16539 trim_cache size 0 max 16384 2024-05-08T07:24:15.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.877+0000 7f193e918b80 1 Processor -- start 2024-05-08T07:24:15.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f193e918b80 1 -- start start 2024-05-08T07:24:15.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f193e918b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 0x55a694dc16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f193e918b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694db2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f193e918b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dcccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f193e918b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1b3f00 con 0x55a694db1b70 2024-05-08T07:24:15.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f193e918b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1b1760 con 0x55a694dabda0 2024-05-08T07:24:15.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f193e918b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1af5d0 con 0x55a694db1250 2024-05-08T07:24:15.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f1932000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dcccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f1932000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dcccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52410/0 (socket says 172.21.15.70:52410) 2024-05-08T07:24:15.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.878+0000 7f1932000700 1 -- 172.21.15.70:0/1906933304 learned_addr learned my addr 172.21.15.70:0/1906933304 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:24:15.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.879+0000 7f1930c00700 1 --2- 172.21.15.70:0/1906933304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694db2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.879+0000 7f1931600700 1 --2- 172.21.15.70:0/1906933304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 0x55a694dc16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.879+0000 7f1932000700 1 -- 172.21.15.70:0/1906933304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 msgr2=0x55a694db2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:24:15.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.879+0000 7f1932000700 1 --2- 172.21.15.70:0/1906933304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694db2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.879+0000 7f1932000700 1 -- 172.21.15.70:0/1906933304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 msgr2=0x55a694dc16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:24:15.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.879+0000 7f1932000700 1 --2- 172.21.15.70:0/1906933304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 0x55a694dc16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.879+0000 7f1932000700 1 -- 172.21.15.70:0/1906933304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a694db87a0 con 0x55a694db1b70 2024-05-08T07:24:15.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.879+0000 7f1932000700 1 --2- 172.21.15.70:0/1906933304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dcccf0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1924009fd0 tx=0x7f1924006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ec8c7eac4906a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:24:15.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f191e000700 1 -- 172.21.15.70:0/1906933304 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1924007b10 con 0x55a694db1b70 2024-05-08T07:24:15.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f191e000700 1 -- 172.21.15.70:0/1906933304 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f192401f650 con 0x55a694db1b70 2024-05-08T07:24:15.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f191e000700 1 -- 172.21.15.70:0/1906933304 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192401c440 con 0x55a694db1b70 2024-05-08T07:24:15.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f193e918b80 1 -- 172.21.15.70:0/1906933304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 msgr2=0x55a694dcccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:15.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f193e918b80 1 --2- 172.21.15.70:0/1906933304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dcccf0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1924009fd0 tx=0x7f1924006060 comp rx=0 tx=0).stop 2024-05-08T07:24:15.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f193e918b80 1 -- 172.21.15.70:0/1906933304 shutdown_connections 2024-05-08T07:24:15.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f193e918b80 1 --2- 172.21.15.70:0/1906933304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dcccf0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f193e918b80 1 --2- 172.21.15.70:0/1906933304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 0x55a694dc16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f193e918b80 1 --2- 172.21.15.70:0/1906933304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694db2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.880+0000 7f193e918b80 1 -- 172.21.15.70:0/1906933304 >> 172.21.15.70:0/1906933304 conn(0x55a694d237d0 msgr2=0x55a694db2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.881+0000 7f193e918b80 1 -- 172.21.15.70:0/1906933304 shutdown_connections 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.881+0000 7f193e918b80 1 -- 172.21.15.70:0/1906933304 wait complete. 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.881+0000 7f193e918b80 1 -- start start 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.881+0000 7f193e918b80 1 Processor -- start 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f193e918b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 0x55a694dba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f193e918b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694dbab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f193e918b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dbb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f193e918b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1afc20 con 0x55a694db1b70 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f193e918b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1b1090 con 0x55a694dabda0 2024-05-08T07:24:15.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f193e918b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f192c1b02f0 con 0x55a694db1250 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f193e918b80 10 client.0 _ll_register_callbacks cb 0x55a694ca4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f1932000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dbb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f1932000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dbb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52424/0 (socket says 172.21.15.70:52424) 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f1932000700 1 -- 172.21.15.70:0/2805780326 learned_addr learned my addr 172.21.15.70:0/2805780326 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.882+0000 7f1931600700 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 0x55a694dba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1930c00700 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694dbab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1932000700 1 -- 172.21.15.70:0/2805780326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 msgr2=0x55a694dbab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1932000700 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694dbab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1932000700 1 -- 172.21.15.70:0/2805780326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 msgr2=0x55a694dba5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1932000700 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 0x55a694dba5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1932000700 1 -- 172.21.15.70:0/2805780326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a694da2c20 con 0x55a694db1b70 2024-05-08T07:24:15.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1931600700 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 0x55a694dba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:24:15.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1932000700 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dbb060 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f192400d010 tx=0x7f192401cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782725b3439d83e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:24:15.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1913400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:24:15.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1913400700 1 -- 172.21.15.70:0/2805780326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192401fe20 con 0x55a694db1b70 2024-05-08T07:24:15.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f1913400700 1 -- 172.21.15.70:0/2805780326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 9671+0+0 (secure 0 0 0) 0x7f1924025070 con 0x55a694db1b70 2024-05-08T07:24:15.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.883+0000 7f193e918b80 1 -- 172.21.15.70:0/2805780326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f192401f650 con 0x55a694db1b70 2024-05-08T07:24:15.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f1913400700 1 -- 172.21.15.70:0/2805780326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f192401c440 con 0x55a694db1b70 2024-05-08T07:24:15.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f193e918b80 10 client.16545 fetch_fsmap learned FSMap version 37 2024-05-08T07:24:15.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f193e918b80 1 -- 172.21.15.70:0/2805780326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55a694e30a10 con 0x55a694db1b70 2024-05-08T07:24:15.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f1913400700 1 -- 172.21.15.70:0/2805780326 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f192401f650 con 0x55a694db1b70 2024-05-08T07:24:15.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f1913400700 1 -- 172.21.15.70:0/2805780326 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 37) ==== 8358+0+0 (secure 0 0 0) 0x7f1924011040 con 0x55a694db1b70 2024-05-08T07:24:15.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f193e918b80 10 client.16545 fetch_fsmap finished waiting for FSMap version 37 2024-05-08T07:24:15.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f193e918b80 10 client.16545 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:24:15.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f193e918b80 20 client.16545 populate_metadata read hostname 'smithi070' 2024-05-08T07:24:15.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f193e918b80 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a694e30e20 0x55a694e33210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:24:15.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f193e918b80 4 client.16545 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cdd159a0", "release": true, "await": true}] 2024-05-08T07:24:15.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.884+0000 7f193e918b80 1 -- 172.21.15.70:0/2805780326 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cdd159a0", "release": true, "await": true}) -- 0x55a694d0b500 con 0x55a694e30e20 2024-05-08T07:24:15.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.885+0000 7f1931600700 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a694e30e20 0x55a694e33210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:24:15.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.886+0000 7f1931600700 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a694e30e20 0x55a694e33210 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8383ff008fd1587 server_cookie=4e357743f77d9c7a in_seq=0 out_seq=0 2024-05-08T07:24:15.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:15.886+0000 7f1913400700 10 client.16545 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:24:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:17 smithi070 ceph-mon[29591]: pgmap v1195: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 6 op/s 2024-05-08T07:24:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:17 smithi172 ceph-mon[33377]: pgmap v1195: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 6 op/s 2024-05-08T07:24:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:17 smithi194 ceph-mon[33679]: pgmap v1195: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 6 op/s 2024-05-08T07:24:19.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:18 smithi172 ceph-mon[33377]: pgmap v1196: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 6 op/s 2024-05-08T07:24:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:18 smithi172 ceph-mon[33377]: osdmap e155: 12 total, 12 up, 12 in 2024-05-08T07:24:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:18 smithi194 ceph-mon[33679]: pgmap v1196: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 6 op/s 2024-05-08T07:24:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:18 smithi194 ceph-mon[33679]: osdmap e155: 12 total, 12 up, 12 in 2024-05-08T07:24:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:18 smithi070 ceph-mon[29591]: pgmap v1196: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 6 op/s 2024-05-08T07:24:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:18 smithi070 ceph-mon[29591]: osdmap e155: 12 total, 12 up, 12 in 2024-05-08T07:24:19.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.895+0000 7f1913400700 1 -- 172.21.15.70:0/2805780326 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55a694d0b500 con 0x55a694e30e20 2024-05-08T07:24:19.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.895+0000 7f1913400700 10 client.16545 handle_command_reply: tid=0 2024-05-08T07:24:19.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.895+0000 7f193e918b80 1 client.16545 shutdown 2024-05-08T07:24:19.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.895+0000 7f193e918b80 1 -- 172.21.15.70:0/2805780326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 msgr2=0x55a694dbb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:19.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.895+0000 7f193e918b80 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dbb060 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f192400d010 tx=0x7f192401cf80 comp rx=0 tx=0).stop 2024-05-08T07:24:19.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.896+0000 7f193e918b80 1 -- 172.21.15.70:0/2805780326 shutdown_connections 2024-05-08T07:24:19.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.896+0000 7f193e918b80 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a694e30e20 0x55a694e33210 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:19.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.896+0000 7f193e918b80 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a694db1b70 0x55a694dbb060 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:19.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.896+0000 7f193e918b80 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a694dabda0 0x55a694dba5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:19.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.896+0000 7f193e918b80 1 --2- 172.21.15.70:0/2805780326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a694db1250 0x55a694dbab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:19.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.896+0000 7f193e918b80 1 -- 172.21.15.70:0/2805780326 >> 172.21.15.70:0/2805780326 conn(0x55a694d237d0 msgr2=0x55a694dafd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:24:19.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.896+0000 7f1913400700 0 client.16545 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:24:19.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.896+0000 7f193e918b80 1 -- 172.21.15.70:0/2805780326 shutdown_connections 2024-05-08T07:24:19.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.896+0000 7f193e918b80 1 -- 172.21.15.70:0/2805780326 wait complete. 2024-05-08T07:24:19.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.897+0000 7f193e918b80 20 client.16545 trim_cache size 0 max 16384 2024-05-08T07:24:19.897 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:24:19.897 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 37, 2024-05-08T07:24:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:24:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 96, 2024-05-08T07:24:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:24:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: "cdd159a0": { 2024-05-08T07:24:19.898 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 96, 2024-05-08T07:24:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:24:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:24:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:24:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:24:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:24:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:24:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 82.6, 2024-05-08T07:24:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:24:19.899 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:24:19.900 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:24:19.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.898+0000 7f1932a00700 1 -- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b2a70 msgr2=0x7f19140b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:19.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.898+0000 7f1932a00700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b2a70 0x7f19140b4f30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1924015000 tx=0x7f1924009bc0 comp rx=0 tx=0).stop 2024-05-08T07:24:19.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.898+0000 7f1932a00700 1 -- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c102160 msgr2=0x7f192c1a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:24:19.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.899+0000 7f1932a00700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c102160 0x7f192c1a1c70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f191800d950 tx=0x7f191800dd10 comp rx=0 tx=0).stop 2024-05-08T07:24:19.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.899+0000 7f1932a00700 1 -- 172.21.15.70:0/457343050 shutdown_connections 2024-05-08T07:24:19.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.899+0000 7f1932a00700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b2a70 0x7f19140b4f30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:19.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.899+0000 7f1932a00700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f192c10fd80 0x7f192c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:19.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.899+0000 7f1932a00700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f192c101840 0x7f192c1a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:19.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.899+0000 7f1932a00700 1 --2- 172.21.15.70:0/457343050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f192c102160 0x7f192c1a1c70 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:24:19.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.899+0000 7f1932a00700 1 -- 172.21.15.70:0/457343050 >> 172.21.15.70:0/457343050 conn(0x7f192c077140 msgr2=0x7f192c110300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:24:19.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.900+0000 7f1932a00700 1 -- 172.21.15.70:0/457343050 shutdown_connections 2024-05-08T07:24:19.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:24:19.900+0000 7f1932a00700 1 -- 172.21.15.70:0/457343050 wait complete. 2024-05-08T07:24:20.736 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cdd159a0', seconds elapsed: 62.6 2024-05-08T07:24:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:20 smithi172 ceph-mon[33377]: pgmap v1198: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-05-08T07:24:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:20 smithi194 ceph-mon[33679]: pgmap v1198: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-05-08T07:24:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:20 smithi070 ceph-mon[29591]: pgmap v1198: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-05-08T07:24:23.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:22 smithi172 ceph-mon[33377]: pgmap v1199: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2024-05-08T07:24:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:22 smithi194 ceph-mon[33679]: pgmap v1199: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2024-05-08T07:24:23.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:22 smithi070 ceph-mon[29591]: pgmap v1199: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2024-05-08T07:24:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:24 smithi194 ceph-mon[33679]: pgmap v1200: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2024-05-08T07:24:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:24 smithi070 ceph-mon[29591]: pgmap v1200: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2024-05-08T07:24:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:24 smithi172 ceph-mon[33377]: pgmap v1200: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.4 KiB/s wr, 6 op/s 2024-05-08T07:24:27.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:26 smithi172 ceph-mon[33377]: pgmap v1201: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 375 KiB/s wr, 47 op/s 2024-05-08T07:24:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:26 smithi194 ceph-mon[33679]: pgmap v1201: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 375 KiB/s wr, 47 op/s 2024-05-08T07:24:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:26 smithi070 ceph-mon[29591]: pgmap v1201: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 375 KiB/s wr, 47 op/s 2024-05-08T07:24:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:28 smithi194 ceph-mon[33679]: pgmap v1202: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 375 KiB/s wr, 47 op/s 2024-05-08T07:24:29.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:24:29.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:28 smithi070 ceph-mon[29591]: pgmap v1202: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 375 KiB/s wr, 47 op/s 2024-05-08T07:24:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:24:29.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:28 smithi172 ceph-mon[33377]: pgmap v1202: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 375 KiB/s wr, 47 op/s 2024-05-08T07:24:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:24:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:30 smithi070 ceph-mon[29591]: pgmap v1203: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 757 KiB/s wr, 165 op/s 2024-05-08T07:24:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:30 smithi172 ceph-mon[33377]: pgmap v1203: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 757 KiB/s wr, 165 op/s 2024-05-08T07:24:30.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:30.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:31.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:31.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:31.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:31.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:31.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:30 smithi194 ceph-mon[33679]: pgmap v1203: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 757 KiB/s wr, 165 op/s 2024-05-08T07:24:31.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:31.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:24:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:24:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:32.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:24:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:24:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:24:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:24:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:24:33.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:32 smithi194 ceph-mon[33679]: pgmap v1204: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 746 KiB/s wr, 161 op/s 2024-05-08T07:24:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:32 smithi070 ceph-mon[29591]: pgmap v1204: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 746 KiB/s wr, 161 op/s 2024-05-08T07:24:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:32 smithi172 ceph-mon[33377]: pgmap v1204: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 746 KiB/s wr, 161 op/s 2024-05-08T07:24:35.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:34 smithi172 ceph-mon[33377]: pgmap v1205: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 746 KiB/s wr, 161 op/s 2024-05-08T07:24:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:34 smithi194 ceph-mon[33679]: pgmap v1205: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 746 KiB/s wr, 161 op/s 2024-05-08T07:24:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:34 smithi070 ceph-mon[29591]: pgmap v1205: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 746 KiB/s wr, 161 op/s 2024-05-08T07:24:37.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:36 smithi172 ceph-mon[33377]: pgmap v1206: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-05-08T07:24:37.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:36 smithi194 ceph-mon[33679]: pgmap v1206: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-05-08T07:24:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:36 smithi070 ceph-mon[29591]: pgmap v1206: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 1.1 MiB/s wr, 317 op/s 2024-05-08T07:24:39.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:38 smithi172 ceph-mon[33377]: pgmap v1207: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 796 KiB/s wr, 280 op/s 2024-05-08T07:24:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:38 smithi194 ceph-mon[33679]: pgmap v1207: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 796 KiB/s wr, 280 op/s 2024-05-08T07:24:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:38 smithi070 ceph-mon[29591]: pgmap v1207: 129 pgs: 129 active+clean; 1.7 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 796 KiB/s wr, 280 op/s 2024-05-08T07:24:41.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:40 smithi172 ceph-mon[33377]: pgmap v1208: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 1.2 MiB/s wr, 589 op/s 2024-05-08T07:24:41.182 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:40 smithi070 ceph-mon[29591]: pgmap v1208: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 1.2 MiB/s wr, 589 op/s 2024-05-08T07:24:41.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:40 smithi194 ceph-mon[33679]: pgmap v1208: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 1.2 MiB/s wr, 589 op/s 2024-05-08T07:24:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:42 smithi172 ceph-mon[33377]: pgmap v1209: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 809 KiB/s wr, 464 op/s 2024-05-08T07:24:43.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:42 smithi194 ceph-mon[33679]: pgmap v1209: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 809 KiB/s wr, 464 op/s 2024-05-08T07:24:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:42 smithi070 ceph-mon[29591]: pgmap v1209: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 809 KiB/s wr, 464 op/s 2024-05-08T07:24:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:44 smithi172 ceph-mon[33377]: pgmap v1210: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 809 KiB/s wr, 464 op/s 2024-05-08T07:24:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:44 smithi194 ceph-mon[33679]: pgmap v1210: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 809 KiB/s wr, 464 op/s 2024-05-08T07:24:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:44 smithi070 ceph-mon[29591]: pgmap v1210: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 809 KiB/s wr, 464 op/s 2024-05-08T07:24:47.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:46 smithi172 ceph-mon[33377]: pgmap v1211: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.1 MiB/s wr, 522 op/s 2024-05-08T07:24:47.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:46 smithi194 ceph-mon[33679]: pgmap v1211: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.1 MiB/s wr, 522 op/s 2024-05-08T07:24:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:46 smithi070 ceph-mon[29591]: pgmap v1211: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 1.1 MiB/s wr, 522 op/s 2024-05-08T07:24:49.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:48 smithi194 ceph-mon[33679]: pgmap v1212: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 762 KiB/s wr, 366 op/s 2024-05-08T07:24:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:48 smithi070 ceph-mon[29591]: pgmap v1212: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 762 KiB/s wr, 366 op/s 2024-05-08T07:24:49.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:48 smithi172 ceph-mon[33377]: pgmap v1212: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 762 KiB/s wr, 366 op/s 2024-05-08T07:24:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:50 smithi194 ceph-mon[33679]: pgmap v1213: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 1.1 MiB/s wr, 526 op/s 2024-05-08T07:24:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:50 smithi070 ceph-mon[29591]: pgmap v1213: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 1.1 MiB/s wr, 526 op/s 2024-05-08T07:24:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:50 smithi172 ceph-mon[33377]: pgmap v1213: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 1.1 MiB/s wr, 526 op/s 2024-05-08T07:24:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:52 smithi194 ceph-mon[33679]: pgmap v1214: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 737 KiB/s wr, 241 op/s 2024-05-08T07:24:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:52 smithi070 ceph-mon[29591]: pgmap v1214: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 737 KiB/s wr, 241 op/s 2024-05-08T07:24:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:52 smithi172 ceph-mon[33377]: pgmap v1214: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 737 KiB/s wr, 241 op/s 2024-05-08T07:24:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:54 smithi194 ceph-mon[33679]: pgmap v1215: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 737 KiB/s wr, 241 op/s 2024-05-08T07:24:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:54 smithi070 ceph-mon[29591]: pgmap v1215: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 737 KiB/s wr, 241 op/s 2024-05-08T07:24:55.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:54 smithi172 ceph-mon[33377]: pgmap v1215: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 737 KiB/s wr, 241 op/s 2024-05-08T07:24:57.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:56 smithi172 ceph-mon[33377]: pgmap v1216: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 1.2 MiB/s wr, 388 op/s 2024-05-08T07:24:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:56 smithi194 ceph-mon[33679]: pgmap v1216: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 1.2 MiB/s wr, 388 op/s 2024-05-08T07:24:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:56 smithi070 ceph-mon[29591]: pgmap v1216: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 572 KiB/s rd, 1.2 MiB/s wr, 388 op/s 2024-05-08T07:24:59.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:24:58 smithi194 ceph-mon[33679]: pgmap v1217: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 938 KiB/s wr, 329 op/s 2024-05-08T07:24:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:24:58 smithi070 ceph-mon[29591]: pgmap v1217: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 938 KiB/s wr, 329 op/s 2024-05-08T07:24:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:24:58 smithi172 ceph-mon[33377]: pgmap v1217: 129 pgs: 129 active+clean; 1.7 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 938 KiB/s wr, 329 op/s 2024-05-08T07:25:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:00 smithi194 ceph-mon[33679]: pgmap v1218: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 1.3 MiB/s wr, 389 op/s 2024-05-08T07:25:01.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:00 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:25:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:00 smithi070 ceph-mon[29591]: pgmap v1218: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 1.3 MiB/s wr, 389 op/s 2024-05-08T07:25:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:00 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:25:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:00 smithi172 ceph-mon[33377]: pgmap v1218: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 1.3 MiB/s wr, 389 op/s 2024-05-08T07:25:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:00 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:25:02.709 INFO:tasks.quiescer.fs.[cephfs]:Total duration (41.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T07:25:02.710 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.8 2024-05-08T07:25:02.711 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:25:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:03 smithi070 ceph-mon[29591]: pgmap v1219: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 932 KiB/s wr, 237 op/s 2024-05-08T07:25:03.220 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:25:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:03 smithi194 ceph-mon[33679]: pgmap v1219: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 932 KiB/s wr, 237 op/s 2024-05-08T07:25:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:03 smithi172 ceph-mon[33377]: pgmap v1219: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 932 KiB/s wr, 237 op/s 2024-05-08T07:25:05.276 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:05 smithi070 ceph-mon[29591]: pgmap v1220: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 879 KiB/s wr, 213 op/s 2024-05-08T07:25:05.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:05 smithi172 ceph-mon[33377]: pgmap v1220: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 879 KiB/s wr, 213 op/s 2024-05-08T07:25:05.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:05 smithi194 ceph-mon[33679]: pgmap v1220: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 879 KiB/s wr, 213 op/s 2024-05-08T07:25:05.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.563+0000 7f6182000700 1 -- 172.21.15.70:0/4109959096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 msgr2=0x7f617c102760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:05.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.563+0000 7f6182000700 1 --2- 172.21.15.70:0/4109959096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 0x7f617c102760 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f616c00b0a0 tx=0x7f616c00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.564+0000 7f6182000700 1 -- 172.21.15.70:0/4109959096 shutdown_connections 2024-05-08T07:25:05.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.564+0000 7f6182000700 1 --2- 172.21.15.70:0/4109959096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f617c107790 0x7f617c107c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.564+0000 7f6182000700 1 --2- 172.21.15.70:0/4109959096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 0x7f617c102760 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.564+0000 7f6182000700 1 --2- 172.21.15.70:0/4109959096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f617c102ca0 0x7f617c107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.564+0000 7f6182000700 1 -- 172.21.15.70:0/4109959096 >> 172.21.15.70:0/4109959096 conn(0x7f617c0fddc0 msgr2=0x7f617c1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:05.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.565+0000 7f6182000700 1 -- 172.21.15.70:0/4109959096 shutdown_connections 2024-05-08T07:25:05.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.565+0000 7f6182000700 1 -- 172.21.15.70:0/4109959096 wait complete. 2024-05-08T07:25:05.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.566+0000 7f6182000700 1 Processor -- start 2024-05-08T07:25:05.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.566+0000 7f6182000700 1 -- start start 2024-05-08T07:25:05.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.567+0000 7f6182000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 0x7f617c1a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:05.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.567+0000 7f6182000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f617c102ca0 0x7f617c1a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:05.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.567+0000 7f6182000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f617c107790 0x7f617c1a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:05.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.567+0000 7f6182000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f617c119b00 con 0x7f617c102380 2024-05-08T07:25:05.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.567+0000 7f6182000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f617c119980 con 0x7f617c102ca0 2024-05-08T07:25:05.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.567+0000 7f6182000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f617c119c80 con 0x7f617c107790 2024-05-08T07:25:05.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.567+0000 7f6180c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 0x7f617c1a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:05.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.567+0000 7f6180c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 0x7f617c1a0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42696/0 (socket says 172.21.15.70:42696) 2024-05-08T07:25:05.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.567+0000 7f6180c00700 1 -- 172.21.15.70:0/3701329222 learned_addr learned my addr 172.21.15.70:0/3701329222 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:25:05.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f6180c00700 1 -- 172.21.15.70:0/3701329222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f617c107790 msgr2=0x7f617c1a4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:05.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f6173e00700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f617c102ca0 0x7f617c1a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:05.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f6180c00700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f617c107790 0x7f617c1a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f6180c00700 1 -- 172.21.15.70:0/3701329222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f617c102ca0 msgr2=0x7f617c1a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:05.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f6180c00700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f617c102ca0 0x7f617c1a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f6180c00700 1 -- 172.21.15.70:0/3701329222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f617c1a50a0 con 0x7f617c102380 2024-05-08T07:25:05.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f6180c00700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 0x7f617c1a0090 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f616c0062a0 tx=0x7f616c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:05.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f617a000700 1 -- 172.21.15.70:0/3701329222 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c021070 con 0x7f617c102380 2024-05-08T07:25:05.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f617a000700 1 -- 172.21.15.70:0/3701329222 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f616c007b80 con 0x7f617c102380 2024-05-08T07:25:05.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f617a000700 1 -- 172.21.15.70:0/3701329222 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f616c0046f0 con 0x7f617c102380 2024-05-08T07:25:05.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.568+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f617c1a5330 con 0x7f617c102380 2024-05-08T07:25:05.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.569+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f617c1acc10 con 0x7f617c102380 2024-05-08T07:25:05.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.570+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617c06a190 con 0x7f617c102380 2024-05-08T07:25:05.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.573+0000 7f617a000700 1 -- 172.21.15.70:0/3701329222 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f616c003a00 con 0x7f617c102380 2024-05-08T07:25:05.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.575+0000 7f617a000700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61600b2aa0 0x7f61600b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:05.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.575+0000 7f617a000700 1 -- 172.21.15.70:0/3701329222 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 9671+0+0 (secure 0 0 0) 0x7f616c00f020 con 0x7f617c102380 2024-05-08T07:25:05.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.576+0000 7f6173e00700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61600b2aa0 0x7f61600b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:05.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.576+0000 7f6173e00700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61600b2aa0 0x7f61600b4f60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f617c101590 tx=0x7f6168009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:05.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.582+0000 7f617a000700 1 -- 172.21.15.70:0/3701329222 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f616c02a020 con 0x7f617c102380 2024-05-08T07:25:05.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.944+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f617c1acde0 con 0x7f617c102380 2024-05-08T07:25:05.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.945+0000 7f617a000700 1 -- 172.21.15.70:0/3701329222 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11879 (secure 0 0 0) 0x7f616c004000 con 0x7f617c102380 2024-05-08T07:25:05.944 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:25:05.945 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:24:59.339131+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:25:05.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61600b2aa0 msgr2=0x7f61600b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:05.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61600b2aa0 0x7f61600b4f60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f617c101590 tx=0x7f6168009260 comp rx=0 tx=0).stop 2024-05-08T07:25:05.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 msgr2=0x7f617c1a0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:05.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 0x7f617c1a0090 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f616c0062a0 tx=0x7f616c004d10 comp rx=0 tx=0).stop 2024-05-08T07:25:05.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 shutdown_connections 2024-05-08T07:25:05.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61600b2aa0 0x7f61600b4f60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f617c107790 0x7f617c1a4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f617c102380 0x7f617c1a0090 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 --2- 172.21.15.70:0/3701329222 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f617c102ca0 0x7f617c1a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:05.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.948+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 >> 172.21.15.70:0/3701329222 conn(0x7f617c0fddc0 msgr2=0x7f617c105140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:05.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.949+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 shutdown_connections 2024-05-08T07:25:05.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:05.949+0000 7f6182000700 1 -- 172.21.15.70:0/3701329222 wait complete. 2024-05-08T07:25:05.949 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 38 2024-05-08T07:25:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:06 smithi070 ceph-mon[29591]: osdmap e156: 12 total, 12 up, 12 in 2024-05-08T07:25:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:06 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3701329222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:25:06.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:06 smithi172 ceph-mon[33377]: osdmap e156: 12 total, 12 up, 12 in 2024-05-08T07:25:06.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:06 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3701329222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:25:06.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:06 smithi194 ceph-mon[33679]: osdmap e156: 12 total, 12 up, 12 in 2024-05-08T07:25:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:06 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3701329222' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:25:07.037 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 80.8 --await-for 42.0' 2024-05-08T07:25:07.037 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 80.8 --await-for 42.0 2024-05-08T07:25:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:07 smithi070 ceph-mon[29591]: pgmap v1222: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 908 KiB/s wr, 413 op/s 2024-05-08T07:25:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:07 smithi172 ceph-mon[33377]: pgmap v1222: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 908 KiB/s wr, 413 op/s 2024-05-08T07:25:07.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:07 smithi194 ceph-mon[33679]: pgmap v1222: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 908 KiB/s wr, 413 op/s 2024-05-08T07:25:07.532 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:25:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:09 smithi070 ceph-mon[29591]: pgmap v1223: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 908 KiB/s wr, 413 op/s 2024-05-08T07:25:09.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:09 smithi172 ceph-mon[33377]: pgmap v1223: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 908 KiB/s wr, 413 op/s 2024-05-08T07:25:09.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:09 smithi194 ceph-mon[33679]: pgmap v1223: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 908 KiB/s wr, 413 op/s 2024-05-08T07:25:10.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.376+0000 7f3416a00700 1 -- 172.21.15.70:0/3440549607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410109a80 msgr2=0x7f3410110400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:10.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.376+0000 7f3416a00700 1 --2- 172.21.15.70:0/3440549607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410109a80 0x7f3410110400 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f340800b0d0 tx=0x7f340800b3e0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.376+0000 7f3416a00700 1 -- 172.21.15.70:0/3440549607 shutdown_connections 2024-05-08T07:25:10.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.376+0000 7f3416a00700 1 --2- 172.21.15.70:0/3440549607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410109a80 0x7f3410110400 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.376+0000 7f3416a00700 1 --2- 172.21.15.70:0/3440549607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3410104560 0x7f3410104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.376+0000 7f3416a00700 1 --2- 172.21.15.70:0/3440549607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3410104f10 0x7f3410109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.376+0000 7f3416a00700 1 -- 172.21.15.70:0/3440549607 >> 172.21.15.70:0/3440549607 conn(0x7f34100fdcf0 msgr2=0x7f3410100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:10.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.376+0000 7f3416a00700 1 -- 172.21.15.70:0/3440549607 shutdown_connections 2024-05-08T07:25:10.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.376+0000 7f3416a00700 1 -- 172.21.15.70:0/3440549607 wait complete. 2024-05-08T07:25:10.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.377+0000 7f3416a00700 1 Processor -- start 2024-05-08T07:25:10.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.377+0000 7f3416a00700 1 -- start start 2024-05-08T07:25:10.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.378+0000 7f3416a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3410104560 0x7f34101a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.378+0000 7f3416a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410104f10 0x7f34101a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.378+0000 7f3416a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3410109a80 0x7f341019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.378+0000 7f3416a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3410113500 con 0x7f3410104f10 2024-05-08T07:25:10.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.378+0000 7f3416a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3410113380 con 0x7f3410104560 2024-05-08T07:25:10.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.378+0000 7f3416a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3410113680 con 0x7f3410109a80 2024-05-08T07:25:10.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3416000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3410109a80 0x7f341019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3415600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3410104560 0x7f34101a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3416000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3410109a80 0x7f341019b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:38060/0 (socket says 172.21.15.70:38060) 2024-05-08T07:25:10.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3416000700 1 -- 172.21.15.70:0/2128478665 learned_addr learned my addr 172.21.15.70:0/2128478665 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:25:10.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3414c00700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410104f10 0x7f34101a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3416000700 1 -- 172.21.15.70:0/2128478665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3410104560 msgr2=0x7f34101a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:10.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3416000700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3410104560 0x7f34101a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3416000700 1 -- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410104f10 msgr2=0x7f34101a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:10.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3416000700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410104f10 0x7f34101a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.379+0000 7f3416000700 1 -- 172.21.15.70:0/2128478665 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f341019c050 con 0x7f3410109a80 2024-05-08T07:25:10.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.380+0000 7f3416000700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3410109a80 0x7f341019b8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f340800d010 tx=0x7f3408004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:10.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.381+0000 7f340e000700 1 -- 172.21.15.70:0/2128478665 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3408021070 con 0x7f3410109a80 2024-05-08T07:25:10.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.381+0000 7f3416a00700 1 -- 172.21.15.70:0/2128478665 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f341019c2e0 con 0x7f3410109a80 2024-05-08T07:25:10.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.381+0000 7f3416a00700 1 -- 172.21.15.70:0/2128478665 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34101a8600 con 0x7f3410109a80 2024-05-08T07:25:10.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.381+0000 7f340e000700 1 -- 172.21.15.70:0/2128478665 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3408007b80 con 0x7f3410109a80 2024-05-08T07:25:10.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.381+0000 7f340e000700 1 -- 172.21.15.70:0/2128478665 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340801b430 con 0x7f3410109a80 2024-05-08T07:25:10.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.386+0000 7f342293eb80 1 Processor -- start 2024-05-08T07:25:10.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.387+0000 7f340e000700 1 -- 172.21.15.70:0/2128478665 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3408024070 con 0x7f3410109a80 2024-05-08T07:25:10.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.387+0000 7f342293eb80 1 -- start start 2024-05-08T07:25:10.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.388+0000 7f342293eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c0f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.388+0000 7f342293eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0f910 0x561044c09520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.388+0000 7f342293eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c09b40 0x561044c09fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.388+0000 7f342293eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561044b5bbb0 con 0x561044c0eff0 2024-05-08T07:25:10.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.388+0000 7f342293eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561044af98f0 con 0x561044c09b40 2024-05-08T07:25:10.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.388+0000 7f342293eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561044b57b70 con 0x561044c0f910 2024-05-08T07:25:10.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.388+0000 7f3414c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c0f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.388+0000 7f3414c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c0f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43930/0 (socket says 172.21.15.70:43930) 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.388+0000 7f3414c00700 1 -- 172.21.15.70:0/375706360 learned_addr learned my addr 172.21.15.70:0/375706360 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f3415600700 1 --2- 172.21.15.70:0/375706360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0f910 0x561044c09520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f3414c00700 1 --2- 172.21.15.70:0/375706360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c09b40 0x561044c09fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f3414c00700 1 -- 172.21.15.70:0/375706360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0f910 msgr2=0x561044c09520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f3414c00700 1 --2- 172.21.15.70:0/375706360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0f910 0x561044c09520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f3414c00700 1 -- 172.21.15.70:0/375706360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c09b40 msgr2=0x561044c09fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f3414c00700 1 --2- 172.21.15.70:0/375706360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c09b40 0x561044c09fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f3414c00700 1 -- 172.21.15.70:0/375706360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561044aa8a60 con 0x561044c0eff0 2024-05-08T07:25:10.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f340e000700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33f80b2aa0 0x7f33f80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f3414c00700 1 --2- 172.21.15.70:0/375706360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c0f3d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b6c0 tx=0x7f33fc00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21504381b3e93a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:10.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.389+0000 7f340e000700 1 -- 172.21.15.70:0/2128478665 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 9671+0+0 (secure 0 0 0) 0x7f34080e3900 con 0x7f3410109a80 2024-05-08T07:25:10.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.390+0000 7f3415600700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33f80b2aa0 0x7f33f80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.390+0000 7f3402a00700 1 -- 172.21.15.70:0/375706360 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004030 con 0x561044c0eff0 2024-05-08T07:25:10.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.390+0000 7f3402a00700 1 -- 172.21.15.70:0/375706360 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33fc004830 con 0x561044c0eff0 2024-05-08T07:25:10.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.390+0000 7f3402a00700 1 -- 172.21.15.70:0/375706360 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc005310 con 0x561044c0eff0 2024-05-08T07:25:10.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f342293eb80 1 -- 172.21.15.70:0/375706360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 msgr2=0x561044c0f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:10.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f3415600700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33f80b2aa0 0x7f33f80b4f60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f341019ca30 tx=0x7f340400a380 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:10.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f342293eb80 1 --2- 172.21.15.70:0/375706360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c0f3d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f33fc00b6c0 tx=0x7f33fc00b7e0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f342293eb80 1 -- 172.21.15.70:0/375706360 shutdown_connections 2024-05-08T07:25:10.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f342293eb80 1 --2- 172.21.15.70:0/375706360 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c09b40 0x561044c09fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f342293eb80 1 --2- 172.21.15.70:0/375706360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c0f3d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f342293eb80 1 --2- 172.21.15.70:0/375706360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0f910 0x561044c09520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f342293eb80 1 -- 172.21.15.70:0/375706360 >> 172.21.15.70:0/375706360 conn(0x561044b37cf0 msgr2=0x561044c04080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:10.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f342293eb80 1 -- 172.21.15.70:0/375706360 shutdown_connections 2024-05-08T07:25:10.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.391+0000 7f342293eb80 1 -- 172.21.15.70:0/375706360 wait complete. 2024-05-08T07:25:10.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.392+0000 7f342293eb80 1 -- start start 2024-05-08T07:25:10.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.392+0000 7f342293eb80 1 Processor -- start 2024-05-08T07:25:10.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f342293eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c09b40 0x561044c15650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f342293eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c129f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f342293eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c12f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f342293eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561044c16430 con 0x561044c0eff0 2024-05-08T07:25:10.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f342293eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561044ac1cb0 con 0x561044c0f910 2024-05-08T07:25:10.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f342293eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561044c165b0 con 0x561044c09b40 2024-05-08T07:25:10.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f342293eb80 10 client.0 _ll_register_callbacks cb 0x561044b02e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:25:10.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f3414c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f3414c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c129f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43934/0 (socket says 172.21.15.70:43934) 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.393+0000 7f3414c00700 1 -- 172.21.15.70:0/3575326663 learned_addr learned my addr 172.21.15.70:0/3575326663 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.394+0000 7f3415600700 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c09b40 0x561044c15650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.394+0000 7f3416000700 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c12f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.394+0000 7f3414c00700 1 -- 172.21.15.70:0/3575326663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c09b40 msgr2=0x561044c15650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.394+0000 7f3414c00700 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c09b40 0x561044c15650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.394+0000 7f3414c00700 1 -- 172.21.15.70:0/3575326663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 msgr2=0x561044c12f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.394+0000 7f3414c00700 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c12f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.394+0000 7f3414c00700 1 -- 172.21.15.70:0/3575326663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561044b215b0 con 0x561044c0eff0 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.394+0000 7f3414c00700 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c129f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f33fc005cb0 tx=0x7f33fc012230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865270580353d6c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.394+0000 7f33f7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.395+0000 7f33f7400700 1 -- 172.21.15.70:0/3575326663 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33fc004030 con 0x561044c0eff0 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.395+0000 7f33f7400700 1 -- 172.21.15.70:0/3575326663 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9671+0+0 (secure 0 0 0) 0x7f33fc0041d0 con 0x561044c0eff0 2024-05-08T07:25:10.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.395+0000 7f342293eb80 1 -- 172.21.15.70:0/3575326663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33fc004830 con 0x561044c0eff0 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.395+0000 7f33f7400700 1 -- 172.21.15.70:0/3575326663 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f33fc030050 con 0x561044c0eff0 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.395+0000 7f342293eb80 10 client.16563 fetch_fsmap learned FSMap version 38 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.395+0000 7f342293eb80 1 -- 172.21.15.70:0/3575326663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561044c20d00 con 0x561044c0eff0 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.395+0000 7f33f7400700 1 -- 172.21.15.70:0/3575326663 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33fc004830 con 0x561044c0eff0 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.396+0000 7f33f7400700 1 -- 172.21.15.70:0/3575326663 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f33fc003680 con 0x561044c0eff0 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.396+0000 7f342293eb80 10 client.16563 fetch_fsmap finished waiting for FSMap version 38 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.396+0000 7f342293eb80 10 client.16563 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.396+0000 7f342293eb80 20 client.16563 populate_metadata read hostname 'smithi070' 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.396+0000 7f342293eb80 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561044c23230 0x561044c25620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.396+0000 7f342293eb80 4 client.16563 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:25:10.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.396+0000 7f342293eb80 1 -- 172.21.15.70:0/3575326663 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561044bd6230 con 0x561044c23230 2024-05-08T07:25:10.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.397+0000 7f3415600700 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561044c23230 0x561044c25620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.398+0000 7f33f7400700 10 client.16563 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:25:10.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.398+0000 7f3415600700 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561044c23230 0x561044c25620 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b51ea4e68940651a server_cookie=b59775d27f158dce in_seq=0 out_seq=0 2024-05-08T07:25:10.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.399+0000 7f33f7400700 1 -- 172.21.15.70:0/3575326663 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561044bd6230 con 0x561044c23230 2024-05-08T07:25:10.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.399+0000 7f33f7400700 10 client.16563 handle_command_reply: tid=0 2024-05-08T07:25:10.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 client.16563 shutdown 2024-05-08T07:25:10.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 -- 172.21.15.70:0/3575326663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 msgr2=0x561044c129f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:10.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c129f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f33fc005cb0 tx=0x7f33fc012230 comp rx=0 tx=0).stop 2024-05-08T07:25:10.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 -- 172.21.15.70:0/3575326663 shutdown_connections 2024-05-08T07:25:10.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561044c23230 0x561044c25620 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c12f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c09b40 0x561044c15650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 --2- 172.21.15.70:0/3575326663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c0eff0 0x561044c129f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f33f7400700 0 client.16563 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:25:10.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 -- 172.21.15.70:0/3575326663 >> 172.21.15.70:0/3575326663 conn(0x561044b37cf0 msgr2=0x561044c08510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:10.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 -- 172.21.15.70:0/3575326663 shutdown_connections 2024-05-08T07:25:10.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 1 -- 172.21.15.70:0/3575326663 wait complete. 2024-05-08T07:25:10.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.400+0000 7f342293eb80 20 client.16563 trim_cache size 0 max 16384 2024-05-08T07:25:10.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.425+0000 7f342293eb80 1 Processor -- start 2024-05-08T07:25:10.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.425+0000 7f342293eb80 1 -- start start 2024-05-08T07:25:10.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.426+0000 7f342293eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c122f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.426+0000 7f342293eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 0x561044c2ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.426+0000 7f342293eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c2b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.426+0000 7f342293eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33f0011920 con 0x561044c09b40 2024-05-08T07:25:10.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.426+0000 7f342293eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33f000f1b0 con 0x561044c0f910 2024-05-08T07:25:10.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.426+0000 7f342293eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f33f000d020 con 0x561044c0eff0 2024-05-08T07:25:10.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3416000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c2b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3414c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 0x561044c2ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3416000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c2b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:33958/0 (socket says 172.21.15.70:33958) 2024-05-08T07:25:10.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3416000700 1 -- 172.21.15.70:0/1224352318 learned_addr learned my addr 172.21.15.70:0/1224352318 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:25:10.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3415600700 1 --2- 172.21.15.70:0/1224352318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3416000700 1 -- 172.21.15.70:0/1224352318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 msgr2=0x561044c2ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:25:10.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3416000700 1 --2- 172.21.15.70:0/1224352318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 0x561044c2ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3416000700 1 -- 172.21.15.70:0/1224352318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 msgr2=0x561044c122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:25:10.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3416000700 1 --2- 172.21.15.70:0/1224352318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3416000700 1 -- 172.21.15.70:0/1224352318 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561044c1f550 con 0x561044c0f910 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.427+0000 7f3414c00700 1 --2- 172.21.15.70:0/1224352318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 0x561044c2ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.428+0000 7f3416000700 1 --2- 172.21.15.70:0/1224352318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c2b350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34080e0bd0 tx=0x7f3408009960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74ea50e1b359f72 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.428+0000 7f3402000700 1 -- 172.21.15.70:0/1224352318 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34080a9f00 con 0x561044c0f910 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.428+0000 7f3402000700 1 -- 172.21.15.70:0/1224352318 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34080aa2a0 con 0x561044c0f910 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.428+0000 7f3402000700 1 -- 172.21.15.70:0/1224352318 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34080b3560 con 0x561044c0f910 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.429+0000 7f342293eb80 1 -- 172.21.15.70:0/1224352318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 msgr2=0x561044c2b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.429+0000 7f342293eb80 1 --2- 172.21.15.70:0/1224352318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c2b350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34080e0bd0 tx=0x7f3408009960 comp rx=0 tx=0).stop 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.429+0000 7f342293eb80 1 -- 172.21.15.70:0/1224352318 shutdown_connections 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.429+0000 7f342293eb80 1 --2- 172.21.15.70:0/1224352318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c2b350 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.429+0000 7f342293eb80 1 --2- 172.21.15.70:0/1224352318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.429+0000 7f342293eb80 1 --2- 172.21.15.70:0/1224352318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 0x561044c2ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.429+0000 7f342293eb80 1 -- 172.21.15.70:0/1224352318 >> 172.21.15.70:0/1224352318 conn(0x561044b37cf0 msgr2=0x561044c0ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:10.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.429+0000 7f342293eb80 1 -- 172.21.15.70:0/1224352318 shutdown_connections 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.429+0000 7f342293eb80 1 -- 172.21.15.70:0/1224352318 wait complete. 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.430+0000 7f342293eb80 1 -- start start 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.430+0000 7f342293eb80 1 Processor -- start 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f342293eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c188a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f342293eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 0x561044c18de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f342293eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c19320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f342293eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33f000d670 con 0x561044c09b40 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f342293eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33f000eae0 con 0x561044c0f910 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f342293eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f33f000dd40 con 0x561044c0eff0 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f342293eb80 10 client.0 _ll_register_callbacks cb 0x561044b02e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3415600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3415600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c188a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43948/0 (socket says 172.21.15.70:43948) 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3415600700 1 -- 172.21.15.70:0/1980361923 learned_addr learned my addr 172.21.15.70:0/1980361923 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3414c00700 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 0x561044c18de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3415600700 1 -- 172.21.15.70:0/1980361923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 msgr2=0x561044c18de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3415600700 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 0x561044c18de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3415600700 1 -- 172.21.15.70:0/1980361923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 msgr2=0x561044c19320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3416000700 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c19320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3415600700 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c19320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3415600700 1 -- 172.21.15.70:0/1980361923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561044c8db70 con 0x561044c09b40 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.431+0000 7f3416000700 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c19320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.432+0000 7f3415600700 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c188a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f340400a7f0 tx=0x7f3404004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ec68b83bee0b84 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.432+0000 7f33f7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.432+0000 7f33f7400700 1 -- 172.21.15.70:0/1980361923 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f340401ba30 con 0x561044c09b40 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.432+0000 7f33f7400700 1 -- 172.21.15.70:0/1980361923 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(156..156 src has 1..156) ==== 9671+0+0 (secure 0 0 0) 0x7f340401bbd0 con 0x561044c09b40 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.432+0000 7f342293eb80 1 -- 172.21.15.70:0/1980361923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34080aa2a0 con 0x561044c09b40 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f33f7400700 1 -- 172.21.15.70:0/1980361923 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f340401bdd0 con 0x561044c09b40 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f342293eb80 10 client.16569 fetch_fsmap learned FSMap version 38 2024-05-08T07:25:10.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f342293eb80 1 -- 172.21.15.70:0/1980361923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x561044c8ee70 con 0x561044c09b40 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f33f7400700 1 -- 172.21.15.70:0/1980361923 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f34080aa2a0 con 0x561044c09b40 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f33f7400700 1 -- 172.21.15.70:0/1980361923 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f3404019040 con 0x561044c09b40 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f342293eb80 10 client.16569 fetch_fsmap finished waiting for FSMap version 38 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f342293eb80 10 client.16569 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f342293eb80 20 client.16569 populate_metadata read hostname 'smithi070' 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f342293eb80 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561044c8f700 0x561044c91b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f342293eb80 4 client.16569 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.8, "await_for": 42.0}] 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.433+0000 7f342293eb80 1 -- 172.21.15.70:0/1980361923 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.8, "await_for": 42.0}) -- 0x561044b69590 con 0x561044c8f700 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.434+0000 7f3414c00700 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561044c8f700 0x561044c91b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.435+0000 7f3414c00700 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561044c8f700 0x561044c91b20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5c7efb9fb7ad521 server_cookie=261aacf52a380834 in_seq=0 out_seq=0 2024-05-08T07:25:10.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:10.435+0000 7f33f7400700 10 client.16569 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:25:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:11 smithi070 ceph-mon[29591]: pgmap v1224: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 975 KiB/s wr, 489 op/s 2024-05-08T07:25:11.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:11 smithi172 ceph-mon[33377]: pgmap v1224: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 975 KiB/s wr, 489 op/s 2024-05-08T07:25:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:11 smithi194 ceph-mon[33679]: pgmap v1224: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 975 KiB/s wr, 489 op/s 2024-05-08T07:25:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:13 smithi070 ceph-mon[29591]: pgmap v1225: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 1.0 MiB/s wr, 532 op/s 2024-05-08T07:25:13.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:13 smithi070 ceph-mon[29591]: osdmap e157: 12 total, 12 up, 12 in 2024-05-08T07:25:13.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:13 smithi172 ceph-mon[33377]: pgmap v1225: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 1.0 MiB/s wr, 532 op/s 2024-05-08T07:25:13.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:13 smithi172 ceph-mon[33377]: osdmap e157: 12 total, 12 up, 12 in 2024-05-08T07:25:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:13 smithi194 ceph-mon[33679]: pgmap v1225: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 1.0 MiB/s wr, 532 op/s 2024-05-08T07:25:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:13 smithi194 ceph-mon[33679]: osdmap e157: 12 total, 12 up, 12 in 2024-05-08T07:25:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:15 smithi070 ceph-mon[29591]: pgmap v1227: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 674 KiB/s wr, 227 op/s 2024-05-08T07:25:15.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:15 smithi172 ceph-mon[33377]: pgmap v1227: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 674 KiB/s wr, 227 op/s 2024-05-08T07:25:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:15 smithi194 ceph-mon[33679]: pgmap v1227: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 674 KiB/s wr, 227 op/s 2024-05-08T07:25:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:17 smithi070 ceph-mon[29591]: pgmap v1228: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 866 KiB/s wr, 247 op/s 2024-05-08T07:25:17.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:17 smithi172 ceph-mon[33377]: pgmap v1228: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 866 KiB/s wr, 247 op/s 2024-05-08T07:25:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:17 smithi194 ceph-mon[33679]: pgmap v1228: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 866 KiB/s wr, 247 op/s 2024-05-08T07:25:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:19 smithi070 ceph-mon[29591]: pgmap v1229: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 866 KiB/s wr, 247 op/s 2024-05-08T07:25:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:19 smithi172 ceph-mon[33377]: pgmap v1229: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 866 KiB/s wr, 247 op/s 2024-05-08T07:25:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:19 smithi194 ceph-mon[33679]: pgmap v1229: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 866 KiB/s wr, 247 op/s 2024-05-08T07:25:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:21 smithi070 ceph-mon[29591]: pgmap v1230: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 433 KiB/s wr, 106 op/s 2024-05-08T07:25:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:21 smithi172 ceph-mon[33377]: pgmap v1230: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 433 KiB/s wr, 106 op/s 2024-05-08T07:25:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:21 smithi194 ceph-mon[33679]: pgmap v1230: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 433 KiB/s wr, 106 op/s 2024-05-08T07:25:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:23 smithi070 ceph-mon[29591]: pgmap v1231: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 322 KiB/s wr, 53 op/s 2024-05-08T07:25:23.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:23 smithi172 ceph-mon[33377]: pgmap v1231: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 322 KiB/s wr, 53 op/s 2024-05-08T07:25:23.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:23 smithi194 ceph-mon[33679]: pgmap v1231: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 322 KiB/s wr, 53 op/s 2024-05-08T07:25:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:25 smithi070 ceph-mon[29591]: pgmap v1232: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 295 KiB/s wr, 49 op/s 2024-05-08T07:25:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:25 smithi172 ceph-mon[33377]: pgmap v1232: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 295 KiB/s wr, 49 op/s 2024-05-08T07:25:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:25 smithi194 ceph-mon[33679]: pgmap v1232: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 295 KiB/s wr, 49 op/s 2024-05-08T07:25:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:27 smithi070 ceph-mon[29591]: pgmap v1233: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 312 KiB/s wr, 49 op/s 2024-05-08T07:25:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:27 smithi172 ceph-mon[33377]: pgmap v1233: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 312 KiB/s wr, 49 op/s 2024-05-08T07:25:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:27 smithi194 ceph-mon[33679]: pgmap v1233: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 312 KiB/s wr, 49 op/s 2024-05-08T07:25:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:29 smithi070 ceph-mon[29591]: pgmap v1234: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 86 KiB/s wr, 11 op/s 2024-05-08T07:25:29.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:29 smithi172 ceph-mon[33377]: pgmap v1234: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 86 KiB/s wr, 11 op/s 2024-05-08T07:25:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:29 smithi194 ceph-mon[33679]: pgmap v1234: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 86 KiB/s wr, 11 op/s 2024-05-08T07:25:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:31 smithi070 ceph-mon[29591]: pgmap v1235: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 158 KiB/s wr, 18 op/s 2024-05-08T07:25:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:31 smithi172 ceph-mon[33377]: pgmap v1235: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 158 KiB/s wr, 18 op/s 2024-05-08T07:25:31.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:31 smithi194 ceph-mon[33679]: pgmap v1235: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 158 KiB/s wr, 18 op/s 2024-05-08T07:25:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.054+0000 7f33f7400700 1 -- 172.21.15.70:0/1980361923 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x561044b69590 con 0x561044c8f700 2024-05-08T07:25:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.054+0000 7f33f7400700 10 client.16569 handle_command_reply: tid=0 2024-05-08T07:25:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.054+0000 7f342293eb80 1 client.16569 shutdown 2024-05-08T07:25:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.054+0000 7f342293eb80 1 -- 172.21.15.70:0/1980361923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 msgr2=0x561044c188a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.054+0000 7f342293eb80 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c188a0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f340400a7f0 tx=0x7f3404004750 comp rx=0 tx=0).stop 2024-05-08T07:25:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.054+0000 7f342293eb80 1 -- 172.21.15.70:0/1980361923 shutdown_connections 2024-05-08T07:25:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.054+0000 7f342293eb80 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561044c8f700 0x561044c91b20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.055+0000 7f342293eb80 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561044c0f910 0x561044c19320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.055+0000 7f342293eb80 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561044c09b40 0x561044c188a0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.055+0000 7f342293eb80 1 --2- 172.21.15.70:0/1980361923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561044c0eff0 0x561044c18de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.055+0000 7f342293eb80 1 -- 172.21.15.70:0/1980361923 >> 172.21.15.70:0/1980361923 conn(0x561044b37cf0 msgr2=0x561044c0fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.055+0000 7f33f7400700 0 client.16569 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:25:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.055+0000 7f342293eb80 1 -- 172.21.15.70:0/1980361923 shutdown_connections 2024-05-08T07:25:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.055+0000 7f342293eb80 1 -- 172.21.15.70:0/1980361923 wait complete. 2024-05-08T07:25:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.055+0000 7f342293eb80 20 client.16569 trim_cache size 0 max 16384 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 38, 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 98, 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "2a9e219": { 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 98, 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:25:32.055 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.8, 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:25:32.056 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:25:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.056+0000 7f3416a00700 1 -- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33f80b2aa0 msgr2=0x7f33f80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.056+0000 7f3416a00700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33f80b2aa0 0x7f33f80b4f60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f341019ca30 tx=0x7f340400a380 comp rx=0 tx=0).stop 2024-05-08T07:25:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.056+0000 7f3416a00700 1 -- 172.21.15.70:0/2128478665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3410109a80 msgr2=0x7f341019b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.056+0000 7f3416a00700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3410109a80 0x7f341019b8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f340800d010 tx=0x7f3408004c80 comp rx=0 tx=0).stop 2024-05-08T07:25:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.057+0000 7f3416a00700 1 -- 172.21.15.70:0/2128478665 shutdown_connections 2024-05-08T07:25:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.057+0000 7f3416a00700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33f80b2aa0 0x7f33f80b4f60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.057+0000 7f3416a00700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3410109a80 0x7f341019b8f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.057+0000 7f3416a00700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3410104560 0x7f34101a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:32.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.057+0000 7f3416a00700 1 --2- 172.21.15.70:0/2128478665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3410104f10 0x7f34101a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:32.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.057+0000 7f3416a00700 1 -- 172.21.15.70:0/2128478665 >> 172.21.15.70:0/2128478665 conn(0x7f34100fdcf0 msgr2=0x7f34100ff8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:32.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.057+0000 7f3416a00700 1 -- 172.21.15.70:0/2128478665 shutdown_connections 2024-05-08T07:25:32.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:32.057+0000 7f3416a00700 1 -- 172.21.15.70:0/2128478665 wait complete. 2024-05-08T07:25:32.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:25:32.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:25:32.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:25:33.133 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2a9e219', quiesce took 30.4 seconds. Will release after: 20.8 2024-05-08T07:25:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:33 smithi070 ceph-mon[29591]: pgmap v1236: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 118 KiB/s wr, 13 op/s 2024-05-08T07:25:33.434 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:33 smithi172 ceph-mon[33377]: pgmap v1236: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 118 KiB/s wr, 13 op/s 2024-05-08T07:25:33.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:33 smithi194 ceph-mon[33679]: pgmap v1236: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 118 KiB/s wr, 13 op/s 2024-05-08T07:25:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:25:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:25:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:25:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:25:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:25:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:25:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:25:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:25:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:25:35.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:35 smithi194 ceph-mon[33679]: pgmap v1237: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 118 KiB/s wr, 12 op/s 2024-05-08T07:25:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:35 smithi070 ceph-mon[29591]: pgmap v1237: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 118 KiB/s wr, 12 op/s 2024-05-08T07:25:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:35 smithi172 ceph-mon[33377]: pgmap v1237: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 118 KiB/s wr, 12 op/s 2024-05-08T07:25:37.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:37 smithi194 ceph-mon[33679]: pgmap v1238: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 144 KiB/s wr, 18 op/s 2024-05-08T07:25:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:37 smithi070 ceph-mon[29591]: pgmap v1238: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 144 KiB/s wr, 18 op/s 2024-05-08T07:25:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:37 smithi172 ceph-mon[33377]: pgmap v1238: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 144 KiB/s wr, 18 op/s 2024-05-08T07:25:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:39 smithi194 ceph-mon[33679]: pgmap v1239: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 100 KiB/s wr, 13 op/s 2024-05-08T07:25:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:39 smithi070 ceph-mon[29591]: pgmap v1239: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 100 KiB/s wr, 13 op/s 2024-05-08T07:25:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:39 smithi172 ceph-mon[33377]: pgmap v1239: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 100 KiB/s wr, 13 op/s 2024-05-08T07:25:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:41 smithi194 ceph-mon[33679]: pgmap v1240: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 115 KiB/s wr, 16 op/s 2024-05-08T07:25:41.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:41 smithi070 ceph-mon[29591]: pgmap v1240: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 115 KiB/s wr, 16 op/s 2024-05-08T07:25:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:41 smithi172 ceph-mon[33377]: pgmap v1240: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 115 KiB/s wr, 16 op/s 2024-05-08T07:25:43.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:43 smithi194 ceph-mon[33679]: pgmap v1241: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 43 KiB/s wr, 9 op/s 2024-05-08T07:25:43.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:43 smithi070 ceph-mon[29591]: pgmap v1241: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 43 KiB/s wr, 9 op/s 2024-05-08T07:25:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:43 smithi172 ceph-mon[33377]: pgmap v1241: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 43 KiB/s wr, 9 op/s 2024-05-08T07:25:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:45 smithi194 ceph-mon[33679]: pgmap v1242: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-05-08T07:25:45.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:45 smithi070 ceph-mon[29591]: pgmap v1242: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-05-08T07:25:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:45 smithi172 ceph-mon[33377]: pgmap v1242: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-05-08T07:25:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:47 smithi194 ceph-mon[33679]: pgmap v1243: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-05-08T07:25:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:47 smithi070 ceph-mon[29591]: pgmap v1243: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-05-08T07:25:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:47 smithi172 ceph-mon[33377]: pgmap v1243: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 52 KiB/s wr, 12 op/s 2024-05-08T07:25:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:49 smithi194 ceph-mon[33679]: pgmap v1244: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-05-08T07:25:49.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:49 smithi070 ceph-mon[29591]: pgmap v1244: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-05-08T07:25:49.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:49 smithi172 ceph-mon[33377]: pgmap v1244: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-05-08T07:25:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:51 smithi194 ceph-mon[33679]: pgmap v1245: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2024-05-08T07:25:51.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:51 smithi070 ceph-mon[29591]: pgmap v1245: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2024-05-08T07:25:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:51 smithi172 ceph-mon[33377]: pgmap v1245: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 8 op/s 2024-05-08T07:25:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:53 smithi194 ceph-mon[33679]: pgmap v1246: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:25:53.517 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:53 smithi070 ceph-mon[29591]: pgmap v1246: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:25:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:53 smithi172 ceph-mon[33377]: pgmap v1246: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:25:53.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:25:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:25:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:55 smithi194 ceph-mon[33679]: pgmap v1247: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:25:55.590 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:55 smithi070 ceph-mon[29591]: pgmap v1247: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:25:55.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:55 smithi172 ceph-mon[33377]: pgmap v1247: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:25:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.739+0000 7fb16e600700 1 -- 172.21.15.70:0/3361594461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810aef0 msgr2=0x7fb16810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.739+0000 7fb16e600700 1 --2- 172.21.15.70:0/3361594461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810aef0 0x7fb16810e780 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb1540099c0 tx=0x7fb154009cd0 comp rx=0 tx=0).stop 2024-05-08T07:25:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.740+0000 7fb16e600700 1 -- 172.21.15.70:0/3361594461 shutdown_connections 2024-05-08T07:25:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.740+0000 7fb16e600700 1 --2- 172.21.15.70:0/3361594461 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb16810ee60 0x7fb1681169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.740+0000 7fb16e600700 1 --2- 172.21.15.70:0/3361594461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb16810a540 0x7fb16810a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.740+0000 7fb16e600700 1 --2- 172.21.15.70:0/3361594461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810aef0 0x7fb16810e780 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.740+0000 7fb16e600700 1 -- 172.21.15.70:0/3361594461 >> 172.21.15.70:0/3361594461 conn(0x7fb168079370 msgr2=0x7fb16807b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:56.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.740+0000 7fb16e600700 1 -- 172.21.15.70:0/3361594461 shutdown_connections 2024-05-08T07:25:56.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.740+0000 7fb16e600700 1 -- 172.21.15.70:0/3361594461 wait complete. 2024-05-08T07:25:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.741+0000 7fb16e600700 1 Processor -- start 2024-05-08T07:25:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.741+0000 7fb16e600700 1 -- start start 2024-05-08T07:25:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.741+0000 7fb16e600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb16810a540 0x7fb1681a0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.741+0000 7fb16e600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb16810aef0 0x7fb1681a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.741+0000 7fb16e600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810ee60 0x7fb1681a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:56.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.741+0000 7fb16e600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb168119b60 con 0x7fb16810ee60 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.741+0000 7fb16e600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb1681199e0 con 0x7fb16810aef0 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.741+0000 7fb16e600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb168119ce0 con 0x7fb16810a540 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb167e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810ee60 0x7fb1681a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb167e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810ee60 0x7fb1681a4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45220/0 (socket says 172.21.15.70:45220) 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb167e00700 1 -- 172.21.15.70:0/3802168698 learned_addr learned my addr 172.21.15.70:0/3802168698 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb167400700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb16810a540 0x7fb1681a0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb166a00700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb16810aef0 0x7fb1681a0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb167e00700 1 -- 172.21.15.70:0/3802168698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb16810a540 msgr2=0x7fb1681a0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb167e00700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb16810a540 0x7fb1681a0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb167e00700 1 -- 172.21.15.70:0/3802168698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb16810aef0 msgr2=0x7fb1681a0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb167e00700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb16810aef0 0x7fb1681a0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb167e00700 1 -- 172.21.15.70:0/3802168698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1681a5060 con 0x7fb16810ee60 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.742+0000 7fb166a00700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb16810aef0 0x7fb1681a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:25:56.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.743+0000 7fb167e00700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810ee60 0x7fb1681a4920 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb16000ab50 tx=0x7fb16000ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:56.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.743+0000 7fb15fe00700 1 -- 172.21.15.70:0/3802168698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160017020 con 0x7fb16810ee60 2024-05-08T07:25:56.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.743+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1681a5350 con 0x7fb16810ee60 2024-05-08T07:25:56.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.743+0000 7fb15fe00700 1 -- 172.21.15.70:0/3802168698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb160004bb0 con 0x7fb16810ee60 2024-05-08T07:25:56.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.743+0000 7fb15fe00700 1 -- 172.21.15.70:0/3802168698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160005280 con 0x7fb16810ee60 2024-05-08T07:25:56.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.743+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1681acbd0 con 0x7fb16810ee60 2024-05-08T07:25:56.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.745+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1681a13b0 con 0x7fb16810ee60 2024-05-08T07:25:56.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.747+0000 7fb15fe00700 1 -- 172.21.15.70:0/3802168698 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb16000c620 con 0x7fb16810ee60 2024-05-08T07:25:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.748+0000 7fb15fe00700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb14c0b29f0 0x7fb14c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:25:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.749+0000 7fb15fe00700 1 -- 172.21.15.70:0/3802168698 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 9583+0+0 (secure 0 0 0) 0x7fb1600e20b0 con 0x7fb16810ee60 2024-05-08T07:25:56.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.749+0000 7fb167400700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb14c0b29f0 0x7fb14c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:25:56.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.750+0000 7fb167400700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb14c0b29f0 0x7fb14c0b4eb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb158004630 tx=0x7fb15800b3c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:25:56.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:56.753+0000 7fb15fe00700 1 -- 172.21.15.70:0/3802168698 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb160021020 con 0x7fb16810ee60 2024-05-08T07:25:57.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.045+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb16802e510 con 0x7fb16810ee60 2024-05-08T07:25:57.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.046+0000 7fb15fe00700 1 -- 172.21.15.70:0/3802168698 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11879 (secure 0 0 0) 0x7fb1600a96a0 con 0x7fb16810ee60 2024-05-08T07:25:57.045 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:25:57.045 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:24:59.339131+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:25:57.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb14c0b29f0 msgr2=0x7fb14c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb14c0b29f0 0x7fb14c0b4eb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb158004630 tx=0x7fb15800b3c0 comp rx=0 tx=0).stop 2024-05-08T07:25:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810ee60 msgr2=0x7fb1681a4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:25:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810ee60 0x7fb1681a4920 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fb16000ab50 tx=0x7fb16000ae60 comp rx=0 tx=0).stop 2024-05-08T07:25:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 shutdown_connections 2024-05-08T07:25:57.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb14c0b29f0 0x7fb14c0b4eb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb16810ee60 0x7fb1681a4920 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb16810a540 0x7fb1681a0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 --2- 172.21.15.70:0/3802168698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb16810aef0 0x7fb1681a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:25:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 >> 172.21.15.70:0/3802168698 conn(0x7fb168079370 msgr2=0x7fb16807b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:25:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 shutdown_connections 2024-05-08T07:25:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:25:57.049+0000 7fb16e600700 1 -- 172.21.15.70:0/3802168698 wait complete. 2024-05-08T07:25:57.049 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 38 2024-05-08T07:25:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:57 smithi070 ceph-mon[29591]: pgmap v1248: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2024-05-08T07:25:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:57 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3802168698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:25:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:57 smithi172 ceph-mon[33377]: pgmap v1248: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2024-05-08T07:25:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:57 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3802168698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:25:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:57 smithi194 ceph-mon[33679]: pgmap v1248: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 8 op/s 2024-05-08T07:25:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:57 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3802168698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:25:57.935 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 2a9e219 --release --await' 2024-05-08T07:25:57.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 2a9e219 --release --await 2024-05-08T07:25:58.358 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:25:59.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:25:59 smithi070 ceph-mon[29591]: pgmap v1249: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T07:25:59.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:25:59 smithi172 ceph-mon[33377]: pgmap v1249: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T07:25:59.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:25:59 smithi194 ceph-mon[33679]: pgmap v1249: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T07:26:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.710+0000 7f70b0c00700 1 -- 172.21.15.70:0/4911955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac06b180 msgr2=0x7f70ac06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.710+0000 7f70b0c00700 1 --2- 172.21.15.70:0/4911955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac06b180 0x7f70ac06b600 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7098009990 tx=0x7f7098009ca0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.710+0000 7f70b0c00700 1 -- 172.21.15.70:0/4911955 shutdown_connections 2024-05-08T07:26:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.710+0000 7f70b0c00700 1 --2- 172.21.15.70:0/4911955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70ac06bb40 0x7f70ac110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.710+0000 7f70b0c00700 1 --2- 172.21.15.70:0/4911955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70ac109510 0x7f70ac1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.710+0000 7f70b0c00700 1 --2- 172.21.15.70:0/4911955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac06b180 0x7f70ac06b600 secure :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7098009990 tx=0x7f7098009ca0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.710+0000 7f70b0c00700 1 -- 172.21.15.70:0/4911955 >> 172.21.15.70:0/4911955 conn(0x7f70ac079350 msgr2=0x7f70ac079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:00.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.711+0000 7f70b0c00700 1 -- 172.21.15.70:0/4911955 shutdown_connections 2024-05-08T07:26:00.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.711+0000 7f70b0c00700 1 -- 172.21.15.70:0/4911955 wait complete. 2024-05-08T07:26:00.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.712+0000 7f70b0c00700 1 Processor -- start 2024-05-08T07:26:00.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.713+0000 7f70b0c00700 1 -- start start 2024-05-08T07:26:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.713+0000 7f70b0c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70ac06bb40 0x7f70ac10a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.713+0000 7f70b0c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac109510 0x7f70ac10a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.713+0000 7f70b0c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70ac10ada0 0x7f70ac1ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.713+0000 7f70b0c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac113570 con 0x7f70ac109510 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.713+0000 7f70b0c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1133f0 con 0x7f70ac06bb40 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.713+0000 7f70b0c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1136f0 con 0x7f70ac10ada0 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70a9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac109510 0x7f70ac10a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70a9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac109510 0x7f70ac10a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51098/0 (socket says 172.21.15.70:51098) 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70a9400700 1 -- 172.21.15.70:0/349772810 learned_addr learned my addr 172.21.15.70:0/349772810 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70aa800700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70ac10ada0 0x7f70ac1ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70a9400700 1 -- 172.21.15.70:0/349772810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70ac10ada0 msgr2=0x7f70ac1ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70a9400700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70ac10ada0 0x7f70ac1ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70a9400700 1 -- 172.21.15.70:0/349772810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70ac06bb40 msgr2=0x7f70ac10a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:00.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70a9e00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70ac06bb40 0x7f70ac10a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70a9400700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70ac06bb40 0x7f70ac10a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.714+0000 7f70a9400700 1 -- 172.21.15.70:0/349772810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac1aca20 con 0x7f70ac109510 2024-05-08T07:26:00.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.715+0000 7f70a9400700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac109510 0x7f70ac10a860 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7098006010 tx=0x7f70980036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:00.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.715+0000 7f70a2a00700 1 -- 172.21.15.70:0/349772810 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098026070 con 0x7f70ac109510 2024-05-08T07:26:00.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.715+0000 7f70a2a00700 1 -- 172.21.15.70:0/349772810 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f709800fb80 con 0x7f70ac109510 2024-05-08T07:26:00.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.715+0000 7f70b0c00700 1 -- 172.21.15.70:0/349772810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac1accb0 con 0x7f70ac109510 2024-05-08T07:26:00.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.716+0000 7f70b0c00700 1 -- 172.21.15.70:0/349772810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac1ad0b0 con 0x7f70ac109510 2024-05-08T07:26:00.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.716+0000 7f70a2a00700 1 -- 172.21.15.70:0/349772810 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098021aa0 con 0x7f70ac109510 2024-05-08T07:26:00.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.720+0000 7f70a2a00700 1 -- 172.21.15.70:0/349772810 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7098029070 con 0x7f70ac109510 2024-05-08T07:26:00.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.722+0000 7f70a2a00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70900b2aa0 0x7f70900b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.722+0000 7f70a2a00700 1 -- 172.21.15.70:0/349772810 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 9583+0+0 (secure 0 0 0) 0x7f70980e3070 con 0x7f70ac109510 2024-05-08T07:26:00.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.722+0000 7f70a9e00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70900b2aa0 0x7f70900b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.723+0000 7f70a9e00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70900b2aa0 0x7f70900b4f60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f709c005fd0 tx=0x7f709c005ee0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:00.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.724+0000 7f70bb564b80 1 Processor -- start 2024-05-08T07:26:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.724+0000 7f70bb564b80 1 -- start start 2024-05-08T07:26:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.724+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56ec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c56e6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70bb564b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605c5638b20 con 0x5605c56e6e50 2024-05-08T07:26:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70bb564b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5605c55d6860 con 0x5605c56e6490 2024-05-08T07:26:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70bb564b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5605c5634ae0 con 0x5605c56ebec0 2024-05-08T07:26:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70a9e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56ec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70a9e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56ec2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:48976/0 (socket says 172.21.15.70:48976) 2024-05-08T07:26:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70a9e00700 1 -- 172.21.15.70:0/640459496 learned_addr learned my addr 172.21.15.70:0/640459496 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70aa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.725+0000 7f70a9400700 1 --2- 172.21.15.70:0/640459496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c56e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.726+0000 7f70a9e00700 1 -- 172.21.15.70:0/640459496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 msgr2=0x5605c56e6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.726+0000 7f70a9e00700 1 --2- 172.21.15.70:0/640459496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c56e6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.726+0000 7f70a9e00700 1 -- 172.21.15.70:0/640459496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 msgr2=0x5605c56f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.726+0000 7f70a9e00700 1 --2- 172.21.15.70:0/640459496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.726+0000 7f70a9e00700 1 -- 172.21.15.70:0/640459496 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c55859d0 con 0x5605c56ebec0 2024-05-08T07:26:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.726+0000 7f70a9e00700 1 --2- 172.21.15.70:0/640459496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56ec2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f709c00ec00 tx=0x7f709c011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa42d66a0b0e0b7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.727+0000 7f7097400700 1 -- 172.21.15.70:0/640459496 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c011b00 con 0x5605c56ebec0 2024-05-08T07:26:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.727+0000 7f7097400700 1 -- 172.21.15.70:0/640459496 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f709c023070 con 0x5605c56ebec0 2024-05-08T07:26:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.727+0000 7f7097400700 1 -- 172.21.15.70:0/640459496 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c0103d0 con 0x5605c56ebec0 2024-05-08T07:26:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.728+0000 7f70bb564b80 1 -- 172.21.15.70:0/640459496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 msgr2=0x5605c56ec2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.728+0000 7f70bb564b80 1 --2- 172.21.15.70:0/640459496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56ec2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f709c00ec00 tx=0x7f709c011000 comp rx=0 tx=0).stop 2024-05-08T07:26:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.729+0000 7f70bb564b80 1 -- 172.21.15.70:0/640459496 shutdown_connections 2024-05-08T07:26:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.729+0000 7f70bb564b80 1 --2- 172.21.15.70:0/640459496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.729+0000 7f70bb564b80 1 --2- 172.21.15.70:0/640459496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56ec2a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.729+0000 7f70bb564b80 1 --2- 172.21.15.70:0/640459496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c56e6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.729+0000 7f70bb564b80 1 -- 172.21.15.70:0/640459496 >> 172.21.15.70:0/640459496 conn(0x5605c5614c60 msgr2=0x5605c56e0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.729+0000 7f70bb564b80 1 -- 172.21.15.70:0/640459496 shutdown_connections 2024-05-08T07:26:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.729+0000 7f70bb564b80 1 -- 172.21.15.70:0/640459496 wait complete. 2024-05-08T07:26:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.730+0000 7f70bb564b80 1 -- start start 2024-05-08T07:26:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.730+0000 7f70bb564b80 1 Processor -- start 2024-05-08T07:26:00.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c56f2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56f0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70bb564b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605c5704230 con 0x5605c56e6e50 2024-05-08T07:26:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70bb564b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5605c559ec20 con 0x5605c56e6490 2024-05-08T07:26:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70bb564b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5605c57043b0 con 0x5605c56ebec0 2024-05-08T07:26:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70bb564b80 10 client.0 _ll_register_callbacks cb 0x5605c55dfd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:26:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70a9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70a9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56efbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51116/0 (socket says 172.21.15.70:51116) 2024-05-08T07:26:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.731+0000 7f70a9400700 1 -- 172.21.15.70:0/107206656 learned_addr learned my addr 172.21.15.70:0/107206656 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f70a9e00700 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c56f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f70aa800700 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f70a9400700 1 -- 172.21.15.70:0/107206656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 msgr2=0x5605c56f0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f70a9400700 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56f0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f70a9400700 1 -- 172.21.15.70:0/107206656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 msgr2=0x5605c56f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f70a9400700 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c56f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f70a9400700 1 -- 172.21.15.70:0/107206656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c55fe520 con 0x5605c56e6e50 2024-05-08T07:26:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f70aa800700 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56f0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:26:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f70a9400700 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56efbd0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7098003760 tx=0x7f7098021640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19420898177c9f7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.732+0000 7f708be00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:26:00.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.733+0000 7f708be00700 1 -- 172.21.15.70:0/107206656 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70980aa6c0 con 0x5605c56e6e50 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.733+0000 7f708be00700 1 -- 172.21.15.70:0/107206656 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 9583+0+0 (secure 0 0 0) 0x7f70980aa220 con 0x5605c56e6e50 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.733+0000 7f70bb564b80 1 -- 172.21.15.70:0/107206656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f709c023070 con 0x5605c56e6e50 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.733+0000 7f708be00700 1 -- 172.21.15.70:0/107206656 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f70980a9fc0 con 0x5605c56e6e50 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.733+0000 7f70bb564b80 10 client.16587 fetch_fsmap learned FSMap version 38 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.733+0000 7f70bb564b80 1 -- 172.21.15.70:0/107206656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5605c570ea30 con 0x5605c56e6e50 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.734+0000 7f708be00700 1 -- 172.21.15.70:0/107206656 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f709c023070 con 0x5605c56e6e50 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.734+0000 7f708be00700 1 -- 172.21.15.70:0/107206656 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f70980ac070 con 0x5605c56e6e50 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.734+0000 7f70bb564b80 10 client.16587 fetch_fsmap finished waiting for FSMap version 38 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.734+0000 7f70bb564b80 10 client.16587 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.734+0000 7f70bb564b80 20 client.16587 populate_metadata read hostname 'smithi070' 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.734+0000 7f70bb564b80 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605c5711080 0x5605c57134a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.734+0000 7f70bb564b80 4 client.16587 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:26:00.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.734+0000 7f70bb564b80 1 -- 172.21.15.70:0/107206656 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605c56b31a0 con 0x5605c5711080 2024-05-08T07:26:00.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.735+0000 7f70a9e00700 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605c5711080 0x5605c57134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.736+0000 7f708be00700 10 client.16587 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:26:00.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.736+0000 7f70a9e00700 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605c5711080 0x5605c57134a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e3b7fe6afa68e70 server_cookie=b97693d0c9ed78d8 in_seq=0 out_seq=0 2024-05-08T07:26:00.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.738+0000 7f708be00700 1 -- 172.21.15.70:0/107206656 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5605c56b31a0 con 0x5605c5711080 2024-05-08T07:26:00.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.738+0000 7f708be00700 10 client.16587 handle_command_reply: tid=0 2024-05-08T07:26:00.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.738+0000 7f70bb564b80 1 client.16587 shutdown 2024-05-08T07:26:00.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.739+0000 7f70bb564b80 1 -- 172.21.15.70:0/107206656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 msgr2=0x5605c56efbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:00.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.739+0000 7f70bb564b80 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56efbd0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f7098003760 tx=0x7f7098021640 comp rx=0 tx=0).stop 2024-05-08T07:26:00.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.739+0000 7f70bb564b80 1 -- 172.21.15.70:0/107206656 shutdown_connections 2024-05-08T07:26:00.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.739+0000 7f70bb564b80 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605c5711080 0x5605c57134a0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.739+0000 7f70bb564b80 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56ebec0 0x5605c56f0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.739+0000 7f70bb564b80 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c56f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.739+0000 7f70bb564b80 1 --2- 172.21.15.70:0/107206656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6e50 0x5605c56efbd0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.739+0000 7f70bb564b80 1 -- 172.21.15.70:0/107206656 >> 172.21.15.70:0/107206656 conn(0x5605c5614c60 msgr2=0x5605c56db850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:00.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.739+0000 7f708be00700 0 client.16587 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:26:00.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.740+0000 7f70bb564b80 1 -- 172.21.15.70:0/107206656 shutdown_connections 2024-05-08T07:26:00.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.740+0000 7f70bb564b80 1 -- 172.21.15.70:0/107206656 wait complete. 2024-05-08T07:26:00.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.740+0000 7f70bb564b80 20 client.16587 trim_cache size 0 max 16384 2024-05-08T07:26:00.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.766+0000 7f70bb564b80 1 Processor -- start 2024-05-08T07:26:00.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.767+0000 7f70bb564b80 1 -- start start 2024-05-08T07:26:00.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.767+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6490 0x5605c570d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.767+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 0x5605c56eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.767+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56ebec0 0x5605c5718db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.767+0000 7f70bb564b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f708c011800 con 0x5605c56e6490 2024-05-08T07:26:00.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.767+0000 7f70bb564b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f708c00f090 con 0x5605c56ebec0 2024-05-08T07:26:00.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.767+0000 7f70bb564b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f708c00cf00 con 0x5605c56e6e50 2024-05-08T07:26:00.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70a9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6490 0x5605c570d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70a9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6490 0x5605c570d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51126/0 (socket says 172.21.15.70:51126) 2024-05-08T07:26:00.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70a9e00700 1 -- 172.21.15.70:0/54681182 learned_addr learned my addr 172.21.15.70:0/54681182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:00.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70aa800700 1 --2- 172.21.15.70:0/54681182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56ebec0 0x5605c5718db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70a9400700 1 --2- 172.21.15.70:0/54681182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 0x5605c56eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70a9e00700 1 -- 172.21.15.70:0/54681182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 msgr2=0x5605c56eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:00.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70a9e00700 1 --2- 172.21.15.70:0/54681182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 0x5605c56eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70a9e00700 1 -- 172.21.15.70:0/54681182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56ebec0 msgr2=0x5605c5718db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:00.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70a9e00700 1 --2- 172.21.15.70:0/54681182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56ebec0 0x5605c5718db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.768+0000 7f70a9e00700 1 -- 172.21.15.70:0/54681182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605c56e1950 con 0x5605c56e6490 2024-05-08T07:26:00.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.769+0000 7f70a9e00700 1 --2- 172.21.15.70:0/54681182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6490 0x5605c570d320 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f709c011750 tx=0x7f709c01ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e172b2465c65139f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:00.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.769+0000 7f7096a00700 1 -- 172.21.15.70:0/54681182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c01e440 con 0x5605c56e6490 2024-05-08T07:26:00.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.769+0000 7f7096a00700 1 -- 172.21.15.70:0/54681182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f709c023040 con 0x5605c56e6490 2024-05-08T07:26:00.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.769+0000 7f7096a00700 1 -- 172.21.15.70:0/54681182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c032420 con 0x5605c56e6490 2024-05-08T07:26:00.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.770+0000 7f70bb564b80 1 -- 172.21.15.70:0/54681182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6490 msgr2=0x5605c570d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:00.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.770+0000 7f70bb564b80 1 --2- 172.21.15.70:0/54681182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6490 0x5605c570d320 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f709c011750 tx=0x7f709c01ee00 comp rx=0 tx=0).stop 2024-05-08T07:26:00.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.770+0000 7f70bb564b80 1 -- 172.21.15.70:0/54681182 shutdown_connections 2024-05-08T07:26:00.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.770+0000 7f70bb564b80 1 --2- 172.21.15.70:0/54681182 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56ebec0 0x5605c5718db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.770+0000 7f70bb564b80 1 --2- 172.21.15.70:0/54681182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56e6490 0x5605c570d320 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.770+0000 7f70bb564b80 1 --2- 172.21.15.70:0/54681182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 0x5605c56eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.770+0000 7f70bb564b80 1 -- 172.21.15.70:0/54681182 >> 172.21.15.70:0/54681182 conn(0x5605c5614c60 msgr2=0x5605c56ea1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:00.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.771+0000 7f70bb564b80 1 -- 172.21.15.70:0/54681182 shutdown_connections 2024-05-08T07:26:00.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.771+0000 7f70bb564b80 1 -- 172.21.15.70:0/54681182 wait complete. 2024-05-08T07:26:00.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.771+0000 7f70bb564b80 1 -- start start 2024-05-08T07:26:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.772+0000 7f70bb564b80 1 Processor -- start 2024-05-08T07:26:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.772+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c5706a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.772+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 0x5605c5706f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.772+0000 7f70bb564b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56ebec0 0x5605c577b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.772+0000 7f70bb564b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f708c00d550 con 0x5605c56ebec0 2024-05-08T07:26:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.772+0000 7f70bb564b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f708c00e9c0 con 0x5605c56e6490 2024-05-08T07:26:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.772+0000 7f70bb564b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f708c00dc20 con 0x5605c56e6e50 2024-05-08T07:26:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.772+0000 7f70bb564b80 10 client.0 _ll_register_callbacks cb 0x5605c55dfd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:26:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.773+0000 7f70a9e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c5706a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.773+0000 7f70aa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56ebec0 0x5605c577b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.773+0000 7f70aa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56ebec0 0x5605c577b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51136/0 (socket says 172.21.15.70:51136) 2024-05-08T07:26:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.773+0000 7f70a9400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 0x5605c5706f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.773+0000 7f70aa800700 1 -- 172.21.15.70:0/3368638158 learned_addr learned my addr 172.21.15.70:0/3368638158 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:00.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.774+0000 7f70aa800700 1 -- 172.21.15.70:0/3368638158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 msgr2=0x5605c5706f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:00.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.774+0000 7f70aa800700 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 0x5605c5706f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.774+0000 7f70aa800700 1 -- 172.21.15.70:0/3368638158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 msgr2=0x5605c5706a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:00.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.774+0000 7f70aa800700 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c5706a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:00.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.774+0000 7f70aa800700 1 -- 172.21.15.70:0/3368638158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605c577bfb0 con 0x5605c56ebec0 2024-05-08T07:26:00.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.774+0000 7f70aa800700 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56ebec0 0x5605c577b970 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f70a4007c40 tx=0x7f70a4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529ffbdf40238875 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:00.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.774+0000 7f708be00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:26:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.775+0000 7f708be00700 1 -- 172.21.15.70:0/3368638158 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a401c070 con 0x5605c56ebec0 2024-05-08T07:26:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.775+0000 7f708be00700 1 -- 172.21.15.70:0/3368638158 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(157..157 src has 1..157) ==== 9583+0+0 (secure 0 0 0) 0x7f70a4004db0 con 0x5605c56ebec0 2024-05-08T07:26:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.775+0000 7f70bb564b80 1 -- 172.21.15.70:0/3368638158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f709c023040 con 0x5605c56ebec0 2024-05-08T07:26:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.775+0000 7f708be00700 1 -- 172.21.15.70:0/3368638158 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f70a4029050 con 0x5605c56ebec0 2024-05-08T07:26:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.775+0000 7f70bb564b80 10 client.16593 fetch_fsmap learned FSMap version 38 2024-05-08T07:26:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.775+0000 7f70bb564b80 1 -- 172.21.15.70:0/3368638158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x5605c577d330 con 0x5605c56ebec0 2024-05-08T07:26:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.776+0000 7f708be00700 1 -- 172.21.15.70:0/3368638158 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f709c023040 con 0x5605c56ebec0 2024-05-08T07:26:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.776+0000 7f708be00700 1 -- 172.21.15.70:0/3368638158 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f70a4018ab0 con 0x5605c56ebec0 2024-05-08T07:26:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.776+0000 7f70bb564b80 10 client.16593 fetch_fsmap finished waiting for FSMap version 38 2024-05-08T07:26:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.776+0000 7f70bb564b80 10 client.16593 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:26:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.776+0000 7f70bb564b80 20 client.16593 populate_metadata read hostname 'smithi070' 2024-05-08T07:26:00.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.776+0000 7f70bb564b80 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605c577dad0 0x5605c577fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:00.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.776+0000 7f70bb564b80 4 client.16593 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2a9e219", "release": true, "await": true}] 2024-05-08T07:26:00.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.776+0000 7f70bb564b80 1 -- 172.21.15.70:0/3368638158 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2a9e219", "release": true, "await": true}) -- 0x5605c5646500 con 0x5605c577dad0 2024-05-08T07:26:00.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.777+0000 7f70a9e00700 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605c577dad0 0x5605c577fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.778+0000 7f70a9e00700 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605c577dad0 0x5605c577fef0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae91bfaf8b3af77c server_cookie=fa3c7c5f4924a4ec in_seq=0 out_seq=0 2024-05-08T07:26:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:00.778+0000 7f708be00700 10 client.16593 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:26:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:01 smithi070 ceph-mon[29591]: pgmap v1250: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-05-08T07:26:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:01 smithi172 ceph-mon[33377]: pgmap v1250: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-05-08T07:26:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:01 smithi194 ceph-mon[33679]: pgmap v1250: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-05-08T07:26:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:03 smithi070 ceph-mon[29591]: pgmap v1251: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T07:26:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:03 smithi172 ceph-mon[33377]: pgmap v1251: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T07:26:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:03 smithi194 ceph-mon[33679]: pgmap v1251: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T07:26:05.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.195+0000 7f708be00700 1 -- 172.21.15.70:0/3368638158 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5605c5646500 con 0x5605c577dad0 2024-05-08T07:26:05.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.195+0000 7f708be00700 10 client.16593 handle_command_reply: tid=0 2024-05-08T07:26:05.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.195+0000 7f70bb564b80 1 client.16593 shutdown 2024-05-08T07:26:05.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.195+0000 7f70bb564b80 1 -- 172.21.15.70:0/3368638158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56ebec0 msgr2=0x5605c577b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.195+0000 7f70bb564b80 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56ebec0 0x5605c577b970 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f70a4007c40 tx=0x7f70a4007f50 comp rx=0 tx=0).stop 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f70bb564b80 1 -- 172.21.15.70:0/3368638158 shutdown_connections 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f70bb564b80 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605c577dad0 0x5605c577fef0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f70bb564b80 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605c56ebec0 0x5605c577b970 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f70bb564b80 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605c56e6490 0x5605c5706a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f70bb564b80 1 --2- 172.21.15.70:0/3368638158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605c56e6e50 0x5605c5706f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f708be00700 0 client.16593 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f70bb564b80 1 -- 172.21.15.70:0/3368638158 >> 172.21.15.70:0/3368638158 conn(0x5605c5614c60 msgr2=0x5605c56ea1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f70bb564b80 1 -- 172.21.15.70:0/3368638158 shutdown_connections 2024-05-08T07:26:05.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f70bb564b80 1 -- 172.21.15.70:0/3368638158 wait complete. 2024-05-08T07:26:05.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.196+0000 7f70bb564b80 20 client.16593 trim_cache size 0 max 16384 2024-05-08T07:26:05.195 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:26:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 38, 2024-05-08T07:26:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:26:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 100, 2024-05-08T07:26:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:26:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "2a9e219": { 2024-05-08T07:26:05.195 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 100, 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.8, 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:05.196 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:05.197 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:05.197 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:26:05.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 -- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70900b2aa0 msgr2=0x7f70900b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:05.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70900b2aa0 0x7f70900b4f60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f709c005fd0 tx=0x7f709c005ee0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 -- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac109510 msgr2=0x7f70ac10a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac109510 0x7f70ac10a860 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7098006010 tx=0x7f70980036f0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 -- 172.21.15.70:0/349772810 shutdown_connections 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70900b2aa0 0x7f70900b4f60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70ac10ada0 0x7f70ac1ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f70ac06bb40 0x7f70ac10a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 --2- 172.21.15.70:0/349772810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70ac109510 0x7f70ac10a860 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.198+0000 7f70b0c00700 1 -- 172.21.15.70:0/349772810 >> 172.21.15.70:0/349772810 conn(0x7f70ac079350 msgr2=0x7f70ac101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.199+0000 7f70b0c00700 1 -- 172.21.15.70:0/349772810 shutdown_connections 2024-05-08T07:26:05.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:05.199+0000 7f70b0c00700 1 -- 172.21.15.70:0/349772810 wait complete. 2024-05-08T07:26:05.608 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:05 smithi070 ceph-mon[29591]: pgmap v1252: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T07:26:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:05 smithi172 ceph-mon[33377]: pgmap v1252: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T07:26:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:05 smithi194 ceph-mon[33679]: pgmap v1252: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T07:26:06.049 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2a9e219', seconds elapsed: 63.3 2024-05-08T07:26:06.049 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.8 2024-05-08T07:26:06.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:26:06.529 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:26:07.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:07 smithi070 ceph-mon[29591]: pgmap v1253: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-05-08T07:26:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:07 smithi172 ceph-mon[33377]: pgmap v1253: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-05-08T07:26:07.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:07 smithi194 ceph-mon[33679]: pgmap v1253: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 KiB/s wr, 23 op/s 2024-05-08T07:26:07.828 INFO:tasks.workunit.client.0.smithi070.stderr:+ cd linux-6.5.11 2024-05-08T07:26:07.849 INFO:tasks.workunit.client.0.smithi070.stderr:+ make defconfig 2024-05-08T07:26:08.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.743+0000 7f0acd600700 1 -- 172.21.15.70:0/1070492323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac80756d0 msgr2=0x7f0ac8075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:08.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.743+0000 7f0acd600700 1 --2- 172.21.15.70:0/1070492323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac80756d0 0x7f0ac8075ab0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009990 tx=0x7f0ab8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:26:08.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.743+0000 7f0acd600700 1 -- 172.21.15.70:0/1070492323 shutdown_connections 2024-05-08T07:26:08.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.743+0000 7f0acd600700 1 --2- 172.21.15.70:0/1070492323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8114670 0x7f0ac8116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:08.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.743+0000 7f0acd600700 1 --2- 172.21.15.70:0/1070492323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac80756d0 0x7f0ac8075ab0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:08.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.743+0000 7f0acd600700 1 --2- 172.21.15.70:0/1070492323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac8075ff0 0x7f0ac8114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:08.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.743+0000 7f0acd600700 1 -- 172.21.15.70:0/1070492323 >> 172.21.15.70:0/1070492323 conn(0x7f0ac807a600 msgr2=0x7f0ac807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:08.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.743+0000 7f0acd600700 1 -- 172.21.15.70:0/1070492323 shutdown_connections 2024-05-08T07:26:08.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.743+0000 7f0acd600700 1 -- 172.21.15.70:0/1070492323 wait complete. 2024-05-08T07:26:08.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.744+0000 7f0acd600700 1 Processor -- start 2024-05-08T07:26:08.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.745+0000 7f0acd600700 1 -- start start 2024-05-08T07:26:08.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.745+0000 7f0acd600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac80756d0 0x7f0ac81a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:08.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.745+0000 7f0acd600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8075ff0 0x7f0ac81a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:08.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.745+0000 7f0acd600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8114670 0x7f0ac81a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:08.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.745+0000 7f0acd600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8119c00 con 0x7f0ac8114670 2024-05-08T07:26:08.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.745+0000 7f0acd600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8119a80 con 0x7f0ac80756d0 2024-05-08T07:26:08.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.745+0000 7f0acd600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac8119d80 con 0x7f0ac8075ff0 2024-05-08T07:26:08.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8114670 0x7f0ac81a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:08.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8114670 0x7f0ac81a4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47608/0 (socket says 172.21.15.70:47608) 2024-05-08T07:26:08.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac7400700 1 -- 172.21.15.70:0/105763725 learned_addr learned my addr 172.21.15.70:0/105763725 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:08.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac6a00700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac80756d0 0x7f0ac81a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:08.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac6000700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8075ff0 0x7f0ac81a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:08.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac7400700 1 -- 172.21.15.70:0/105763725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8075ff0 msgr2=0x7f0ac81a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:08.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac7400700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8075ff0 0x7f0ac81a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:08.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac7400700 1 -- 172.21.15.70:0/105763725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac80756d0 msgr2=0x7f0ac81a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:08.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac7400700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac80756d0 0x7f0ac81a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:08.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.746+0000 7f0ac7400700 1 -- 172.21.15.70:0/105763725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac81a5240 con 0x7f0ac8114670 2024-05-08T07:26:08.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.747+0000 7f0ac7400700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8114670 0x7f0ac81a4b00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000b9e0 tx=0x7f0ac000bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:08.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.747+0000 7f0abf400700 1 -- 172.21.15.70:0/105763725 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0019070 con 0x7f0ac8114670 2024-05-08T07:26:08.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.747+0000 7f0abf400700 1 -- 172.21.15.70:0/105763725 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ac000cdc0 con 0x7f0ac8114670 2024-05-08T07:26:08.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.747+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac81a5530 con 0x7f0ac8114670 2024-05-08T07:26:08.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.747+0000 7f0abf400700 1 -- 172.21.15.70:0/105763725 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0014e50 con 0x7f0ac8114670 2024-05-08T07:26:08.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.747+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac81acdb0 con 0x7f0ac8114670 2024-05-08T07:26:08.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.749+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac806a190 con 0x7f0ac8114670 2024-05-08T07:26:08.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.751+0000 7f0abf400700 1 -- 172.21.15.70:0/105763725 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f0ac001c070 con 0x7f0ac8114670 2024-05-08T07:26:08.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.752+0000 7f0abf400700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f0aac0b2c10 0x7f0aac0b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:08.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.752+0000 7f0abf400700 1 -- 172.21.15.70:0/105763725 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 9583+0+0 (secure 0 0 0) 0x7f0ac00e1be0 con 0x7f0ac8114670 2024-05-08T07:26:08.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.753+0000 7f0ac6a00700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f0aac0b2c10 0x7f0aac0b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:08.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.753+0000 7f0ac6a00700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f0aac0b2c10 0x7f0aac0b50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80098e0 tx=0x7f0ab8005960 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:08.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:08.757+0000 7f0abf400700 1 -- 172.21.15.70:0/105763725 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0ac00a9250 con 0x7f0ac8114670 2024-05-08T07:26:09.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.062+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ac81a1590 con 0x7f0ac8114670 2024-05-08T07:26:09.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.064+0000 7f0abf400700 1 -- 172.21.15.70:0/105763725 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11879 (secure 0 0 0) 0x7f0ac00a8b50 con 0x7f0ac8114670 2024-05-08T07:26:09.063 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:26:09.063 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:24:59.339131+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:26:09.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.066+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f0aac0b2c10 msgr2=0x7f0aac0b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.066+0000 7f0acd600700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f0aac0b2c10 0x7f0aac0b50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80098e0 tx=0x7f0ab8005960 comp rx=0 tx=0).stop 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.066+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8114670 msgr2=0x7f0ac81a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.066+0000 7f0acd600700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8114670 0x7f0ac81a4b00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0ac000b9e0 tx=0x7f0ac000bcf0 comp rx=0 tx=0).stop 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.067+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 shutdown_connections 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.067+0000 7f0acd600700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f0aac0b2c10 0x7f0aac0b50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.067+0000 7f0acd600700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ac8114670 0x7f0ac81a4b00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.067+0000 7f0acd600700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0ac80756d0 0x7f0ac81a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.067+0000 7f0acd600700 1 --2- 172.21.15.70:0/105763725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ac8075ff0 0x7f0ac81a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.067+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 >> 172.21.15.70:0/105763725 conn(0x7f0ac807a600 msgr2=0x7f0ac8110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.067+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 shutdown_connections 2024-05-08T07:26:09.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:09.067+0000 7f0acd600700 1 -- 172.21.15.70:0/105763725 wait complete. 2024-05-08T07:26:09.067 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 38 2024-05-08T07:26:09.229 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/basic/fixdep 2024-05-08T07:26:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:09 smithi070 ceph-mon[29591]: pgmap v1254: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T07:26:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/105763725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:26:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:09 smithi172 ceph-mon[33377]: pgmap v1254: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T07:26:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/105763725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:26:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:09 smithi194 ceph-mon[33679]: pgmap v1254: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T07:26:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/105763725' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:26:09.949 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 80.8 --await-for 42.0' 2024-05-08T07:26:09.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 80.8 --await-for 42.0 2024-05-08T07:26:10.188 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kconfig/conf.o 2024-05-08T07:26:10.394 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:26:10.628 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kconfig/confdata.o 2024-05-08T07:26:11.276 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kconfig/expr.o 2024-05-08T07:26:11.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:11 smithi070 ceph-mon[29591]: pgmap v1255: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 156 KiB/s wr, 86 op/s 2024-05-08T07:26:11.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:11 smithi070 ceph-mon[29591]: osdmap e158: 12 total, 12 up, 12 in 2024-05-08T07:26:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:11 smithi172 ceph-mon[33377]: pgmap v1255: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 156 KiB/s wr, 86 op/s 2024-05-08T07:26:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:11 smithi172 ceph-mon[33377]: osdmap e158: 12 total, 12 up, 12 in 2024-05-08T07:26:11.710 INFO:tasks.workunit.client.0.smithi070.stdout: LEX scripts/kconfig/lexer.lex.c 2024-05-08T07:26:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:11 smithi194 ceph-mon[33679]: pgmap v1255: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 156 KiB/s wr, 86 op/s 2024-05-08T07:26:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:11 smithi194 ceph-mon[33679]: osdmap e158: 12 total, 12 up, 12 in 2024-05-08T07:26:11.797 INFO:tasks.workunit.client.0.smithi070.stdout: YACC scripts/kconfig/parser.tab.[ch] 2024-05-08T07:26:11.932 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kconfig/lexer.lex.o 2024-05-08T07:26:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.709+0000 7f8602000700 1 -- 172.21.15.70:0/840535330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc1087a0 msgr2=0x7f85fc1103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.709+0000 7f8602000700 1 --2- 172.21.15.70:0/840535330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc1087a0 0x7f85fc1103b0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f85f40099c0 tx=0x7f85f4009cd0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.710+0000 7f8602000700 1 -- 172.21.15.70:0/840535330 shutdown_connections 2024-05-08T07:26:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.710+0000 7f8602000700 1 --2- 172.21.15.70:0/840535330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc1087a0 0x7f85fc1103b0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.710+0000 7f8602000700 1 --2- 172.21.15.70:0/840535330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85fc1037b0 0x7f85fc103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.710+0000 7f8602000700 1 --2- 172.21.15.70:0/840535330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85fc104160 0x7f85fc1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.710+0000 7f8602000700 1 -- 172.21.15.70:0/840535330 >> 172.21.15.70:0/840535330 conn(0x7f85fc07a570 msgr2=0x7f85fc07a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.710+0000 7f8602000700 1 -- 172.21.15.70:0/840535330 shutdown_connections 2024-05-08T07:26:12.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.710+0000 7f8602000700 1 -- 172.21.15.70:0/840535330 wait complete. 2024-05-08T07:26:12.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.711+0000 7f8602000700 1 Processor -- start 2024-05-08T07:26:12.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.711+0000 7f8602000700 1 -- start start 2024-05-08T07:26:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.712+0000 7f8602000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85fc1037b0 0x7f85fc1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.712+0000 7f8602000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc104160 0x7f85fc1a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.712+0000 7f8602000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85fc1087a0 0x7f85fc19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.712+0000 7f8602000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc113580 con 0x7f85fc104160 2024-05-08T07:26:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.712+0000 7f8602000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc113400 con 0x7f85fc1087a0 2024-05-08T07:26:12.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.712+0000 7f8602000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc113700 con 0x7f85fc1037b0 2024-05-08T07:26:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.712+0000 7f85f2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc104160 0x7f85fc1a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.713+0000 7f85f2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc104160 0x7f85fc1a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47624/0 (socket says 172.21.15.70:47624) 2024-05-08T07:26:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.713+0000 7f85f2a00700 1 -- 172.21.15.70:0/2855611944 learned_addr learned my addr 172.21.15.70:0/2855611944 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.713+0000 7f85fb400700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85fc1037b0 0x7f85fc1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.713+0000 7f85fbe00700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85fc1087a0 0x7f85fc19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.713+0000 7f85f2a00700 1 -- 172.21.15.70:0/2855611944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85fc1037b0 msgr2=0x7f85fc1a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.713+0000 7f85f2a00700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85fc1037b0 0x7f85fc1a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.713+0000 7f85f2a00700 1 -- 172.21.15.70:0/2855611944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85fc1087a0 msgr2=0x7f85fc19b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.713+0000 7f85f2a00700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85fc1087a0 0x7f85fc19b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.713+0000 7f85f2a00700 1 -- 172.21.15.70:0/2855611944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85fc19c130 con 0x7f85fc104160 2024-05-08T07:26:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.714+0000 7f85f2a00700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc104160 0x7f85fc1a1d50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c9e0 tx=0x7f85e400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.714+0000 7f85f8c00700 1 -- 172.21.15.70:0/2855611944 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4007aa0 con 0x7f85fc104160 2024-05-08T07:26:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.714+0000 7f85f8c00700 1 -- 172.21.15.70:0/2855611944 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85e4007c40 con 0x7f85fc104160 2024-05-08T07:26:12.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.714+0000 7f8602000700 1 -- 172.21.15.70:0/2855611944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85fc19c420 con 0x7f85fc104160 2024-05-08T07:26:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.714+0000 7f85f8c00700 1 -- 172.21.15.70:0/2855611944 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e4018660 con 0x7f85fc104160 2024-05-08T07:26:12.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.714+0000 7f8602000700 1 -- 172.21.15.70:0/2855611944 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85fc1a86e0 con 0x7f85fc104160 2024-05-08T07:26:12.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.718+0000 7f85f8c00700 1 -- 172.21.15.70:0/2855611944 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f85e400f450 con 0x7f85fc104160 2024-05-08T07:26:12.718 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kconfig/menu.o 2024-05-08T07:26:12.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.720+0000 7f860c9d1b80 1 Processor -- start 2024-05-08T07:26:12.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.721+0000 7f860c9d1b80 1 -- start start 2024-05-08T07:26:12.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.721+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8fef50 0x55a78f8ff330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.721+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f8f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.721+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8f9ee0 0x55a78f905d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.721+0000 7f85f8c00700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85e00b2b20 0x7f85e00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.721+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a78f84bbb0 con 0x55a78f8f9ee0 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.721+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a78f7e98f0 con 0x55a78f8fef50 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.721+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a78f847b70 con 0x55a78f8f9520 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.721+0000 7f85f8c00700 1 -- 172.21.15.70:0/2855611944 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 9671+0+0 (secure 0 0 0) 0x7f85e40e29d0 con 0x7f85fc104160 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8f9ee0 0x55a78f905d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8fef50 0x55a78f8ff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8fef50 0x55a78f8ff330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:53824/0 (socket says 172.21.15.70:53824) 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85f2a00700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85e00b2b20 0x7f85e00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fbe00700 1 -- 172.21.15.70:0/2983242078 learned_addr learned my addr 172.21.15.70:0/2983242078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fb400700 1 --2- 172.21.15.70:0/2983242078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f8f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fbe00700 1 -- 172.21.15.70:0/2983242078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 msgr2=0x55a78f8f99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fbe00700 1 --2- 172.21.15.70:0/2983242078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f8f99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fbe00700 1 -- 172.21.15.70:0/2983242078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8fef50 msgr2=0x55a78f8ff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fbe00700 1 --2- 172.21.15.70:0/2983242078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8fef50 0x55a78f8ff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.723+0000 7f85f2a00700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85e00b2b20 0x7f85e00b4fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f85e40a50d0 tx=0x7f85e4020000 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.722+0000 7f85fbe00700 1 -- 172.21.15.70:0/2983242078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a78f798a60 con 0x55a78f8f9ee0 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.723+0000 7f85fbe00700 1 --2- 172.21.15.70:0/2983242078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8f9ee0 0x55a78f905d10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f85f40099c0 tx=0x7f85f4005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998c30859f5d01c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.723+0000 7f85f0c00700 1 -- 172.21.15.70:0/2983242078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4021040 con 0x55a78f8f9ee0 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.723+0000 7f85f0c00700 1 -- 172.21.15.70:0/2983242078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85f400bbc0 con 0x55a78f8f9ee0 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.723+0000 7f85f0c00700 1 -- 172.21.15.70:0/2983242078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4003ad0 con 0x55a78f8f9ee0 2024-05-08T07:26:12.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.724+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2983242078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8f9ee0 msgr2=0x55a78f905d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:12.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.724+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2983242078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8f9ee0 0x55a78f905d10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f85f40099c0 tx=0x7f85f4005fb0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.724+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2983242078 shutdown_connections 2024-05-08T07:26:12.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.724+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2983242078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8f9ee0 0x55a78f905d10 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.724+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2983242078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8fef50 0x55a78f8ff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.724+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2983242078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f8f99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.724+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2983242078 >> 172.21.15.70:0/2983242078 conn(0x55a78f827cf0 msgr2=0x55a78f8f3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:12.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.725+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2983242078 shutdown_connections 2024-05-08T07:26:12.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.725+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2983242078 wait complete. 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.725+0000 7f860c9d1b80 1 -- start start 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.725+0000 7f860c9d1b80 1 Processor -- start 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.726+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f905980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.726+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 0x55a78f902d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.726+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f903260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.726+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a78f9062b0 con 0x55a78f8fef50 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.726+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a78f7b1cb0 con 0x55a78f8f9ee0 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.726+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a78f906430 con 0x55a78f8f9520 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.726+0000 7f860c9d1b80 10 client.0 _ll_register_callbacks cb 0x55a78f7f2e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f903260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f903260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47642/0 (socket says 172.21.15.70:47642) 2024-05-08T07:26:12.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fbe00700 1 -- 172.21.15.70:0/1499863545 learned_addr learned my addr 172.21.15.70:0/1499863545 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fbe00700 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f905980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fb400700 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 0x55a78f902d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fbe00700 1 -- 172.21.15.70:0/1499863545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 msgr2=0x55a78f905980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fbe00700 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f905980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fbe00700 1 -- 172.21.15.70:0/1499863545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 msgr2=0x55a78f902d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fbe00700 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 0x55a78f902d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.727+0000 7f85fbe00700 1 -- 172.21.15.70:0/1499863545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a78f8115b0 con 0x55a78f8fef50 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.728+0000 7f85fbe00700 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f903260 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f85f40058e0 tx=0x7f85f4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186c5bef025e3aca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.728+0000 7f85e9600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.728+0000 7f85e9600700 1 -- 172.21.15.70:0/1499863545 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f400be20 con 0x55a78f8fef50 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.728+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1499863545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85f400bbc0 con 0x55a78f8fef50 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.728+0000 7f85e9600700 1 -- 172.21.15.70:0/1499863545 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9671+0+0 (secure 0 0 0) 0x7f85f4003870 con 0x55a78f8fef50 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.728+0000 7f85e9600700 1 -- 172.21.15.70:0/1499863545 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f85f403b050 con 0x55a78f8fef50 2024-05-08T07:26:12.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.728+0000 7f860c9d1b80 10 client.16611 fetch_fsmap learned FSMap version 38 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.728+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1499863545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a78f9062b0 con 0x55a78f8fef50 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.729+0000 7f85e9600700 1 -- 172.21.15.70:0/1499863545 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85f400bbc0 con 0x55a78f8fef50 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.729+0000 7f85e9600700 1 -- 172.21.15.70:0/1499863545 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f85f400f6f0 con 0x55a78f8fef50 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.729+0000 7f860c9d1b80 10 client.16611 fetch_fsmap finished waiting for FSMap version 38 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.729+0000 7f860c9d1b80 10 client.16611 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.729+0000 7f860c9d1b80 20 client.16611 populate_metadata read hostname 'smithi070' 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.729+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a78f912e10 0x55a78f915200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.729+0000 7f860c9d1b80 4 client.16611 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.729+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1499863545 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a78f8c6230 con 0x55a78f912e10 2024-05-08T07:26:12.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.730+0000 7f85fb400700 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a78f912e10 0x55a78f915200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.731+0000 7f85fb400700 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a78f912e10 0x55a78f915200 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fa5a2cc48321381 server_cookie=f849b2417b88dc40 in_seq=0 out_seq=0 2024-05-08T07:26:12.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.731+0000 7f85e9600700 10 client.16611 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:26:12.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f85e9600700 1 -- 172.21.15.70:0/1499863545 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a78f8c6230 con 0x55a78f912e10 2024-05-08T07:26:12.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f85e9600700 10 client.16611 handle_command_reply: tid=0 2024-05-08T07:26:12.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 client.16611 shutdown 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1499863545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 msgr2=0x55a78f903260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f903260 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f85f40058e0 tx=0x7f85f4009cd0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1499863545 shutdown_connections 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a78f912e10 0x55a78f915200 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f903260 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f905980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1499863545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 0x55a78f902d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1499863545 >> 172.21.15.70:0/1499863545 conn(0x55a78f827cf0 msgr2=0x55a78f8ee8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f85e9600700 0 client.16611 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.733+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1499863545 shutdown_connections 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.734+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1499863545 wait complete. 2024-05-08T07:26:12.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.734+0000 7f860c9d1b80 20 client.16611 trim_cache size 0 max 16384 2024-05-08T07:26:12.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.757+0000 7f860c9d1b80 1 Processor -- start 2024-05-08T07:26:12.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.757+0000 7f860c9d1b80 1 -- start start 2024-05-08T07:26:12.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f90f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 0x55a78f8fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f91a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc1b3fb0 con 0x55a78f8fef50 2024-05-08T07:26:12.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc1b1840 con 0x55a78f8f9ee0 2024-05-08T07:26:12.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc1af700 con 0x55a78f8f9520 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f85fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f91a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f85fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f91a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47650/0 (socket says 172.21.15.70:47650) 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f85fbe00700 1 -- 172.21.15.70:0/1887793752 learned_addr learned my addr 172.21.15.70:0/1887793752 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f85fbe00700 1 --2- 172.21.15.70:0/1887793752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f90f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f85fb400700 1 --2- 172.21.15.70:0/1887793752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 0x55a78f8fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f85fbe00700 1 -- 172.21.15.70:0/1887793752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 msgr2=0x55a78f90f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.758+0000 7f85fbe00700 1 --2- 172.21.15.70:0/1887793752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f90f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.759+0000 7f85fbe00700 1 -- 172.21.15.70:0/1887793752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 msgr2=0x55a78f8fd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.759+0000 7f85fbe00700 1 --2- 172.21.15.70:0/1887793752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 0x55a78f8fd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.759+0000 7f85fbe00700 1 -- 172.21.15.70:0/1887793752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a78f8f0a10 con 0x55a78f8fef50 2024-05-08T07:26:12.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.759+0000 7f85fbe00700 1 --2- 172.21.15.70:0/1887793752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f91a890 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f85f400fc80 tx=0x7f85f4019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e7c905d8e0f99e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:12.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.759+0000 7f85ebe00700 1 -- 172.21.15.70:0/1887793752 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4046070 con 0x55a78f8fef50 2024-05-08T07:26:12.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.759+0000 7f85ebe00700 1 -- 172.21.15.70:0/1887793752 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85f4003870 con 0x55a78f8fef50 2024-05-08T07:26:12.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.759+0000 7f85ebe00700 1 -- 172.21.15.70:0/1887793752 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f400be20 con 0x55a78f8fef50 2024-05-08T07:26:12.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.760+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1887793752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 msgr2=0x55a78f91a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:12.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.760+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1887793752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f91a890 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f85f400fc80 tx=0x7f85f4019040 comp rx=0 tx=0).stop 2024-05-08T07:26:12.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.760+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1887793752 shutdown_connections 2024-05-08T07:26:12.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.760+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1887793752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f91a890 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.760+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1887793752 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9520 0x55a78f90f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.760+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/1887793752 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9ee0 0x55a78f8fd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.760+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1887793752 >> 172.21.15.70:0/1887793752 conn(0x55a78f827cf0 msgr2=0x55a78f8fc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.760+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1887793752 shutdown_connections 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.760+0000 7f860c9d1b80 1 -- 172.21.15.70:0/1887793752 wait complete. 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.761+0000 7f860c9d1b80 1 -- start start 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.761+0000 7f860c9d1b80 1 Processor -- start 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.761+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9520 0x55a78f908690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9ee0 0x55a78f908bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f860c9d1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f909150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc1afd50 con 0x55a78f8fef50 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc1b1170 con 0x55a78f8f9520 2024-05-08T07:26:12.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f860c9d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f85fc1b03d0 con 0x55a78f8f9ee0 2024-05-08T07:26:12.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f860c9d1b80 10 client.0 _ll_register_callbacks cb 0x55a78f7f2e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:26:12.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f909150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f909150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47662/0 (socket says 172.21.15.70:47662) 2024-05-08T07:26:12.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fbe00700 1 -- 172.21.15.70:0/2288111934 learned_addr learned my addr 172.21.15.70:0/2288111934 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:12.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fbe00700 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9520 0x55a78f908690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fb400700 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9ee0 0x55a78f908bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fbe00700 1 -- 172.21.15.70:0/2288111934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9ee0 msgr2=0x55a78f908bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fbe00700 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9ee0 0x55a78f908bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fbe00700 1 -- 172.21.15.70:0/2288111934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9520 msgr2=0x55a78f908690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fbe00700 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9520 0x55a78f908690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fbe00700 1 -- 172.21.15.70:0/2288111934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a78f97d750 con 0x55a78f8fef50 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.762+0000 7f85fb400700 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9ee0 0x55a78f908bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.763+0000 7f85fbe00700 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f909150 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009290 tx=0x7f85f40095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95383c64692b4728 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.763+0000 7f85e9600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.763+0000 7f85e9600700 1 -- 172.21.15.70:0/2288111934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f4046040 con 0x55a78f8fef50 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.763+0000 7f85e9600700 1 -- 172.21.15.70:0/2288111934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(158..158 src has 1..158) ==== 9671+0+0 (secure 0 0 0) 0x7f85f400f670 con 0x55a78f8fef50 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.763+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2288111934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85f4003870 con 0x55a78f8fef50 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.763+0000 7f85e9600700 1 -- 172.21.15.70:0/2288111934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f85f400f8f0 con 0x55a78f8fef50 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.763+0000 7f860c9d1b80 10 client.16617 fetch_fsmap learned FSMap version 38 2024-05-08T07:26:12.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.763+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2288111934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a78f97ea30 con 0x55a78f8fef50 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.764+0000 7f85e9600700 1 -- 172.21.15.70:0/2288111934 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85f4003870 con 0x55a78f8fef50 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.764+0000 7f85e9600700 1 -- 172.21.15.70:0/2288111934 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7f85f4028660 con 0x55a78f8fef50 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.764+0000 7f860c9d1b80 10 client.16617 fetch_fsmap finished waiting for FSMap version 38 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.764+0000 7f860c9d1b80 10 client.16617 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.764+0000 7f860c9d1b80 20 client.16617 populate_metadata read hostname 'smithi070' 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.764+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a78f97f130 0x55a78f981550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.764+0000 7f860c9d1b80 4 client.16617 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.8, "await_for": 42.0}] 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.764+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2288111934 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.8, "await_for": 42.0}) -- 0x55a78f859590 con 0x55a78f97f130 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.765+0000 7f85fb400700 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a78f97f130 0x55a78f981550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.765+0000 7f85fb400700 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a78f97f130 0x55a78f981550 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc051d2eb76ceec3 server_cookie=69c6089ee9ace53 in_seq=0 out_seq=0 2024-05-08T07:26:12.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:12.765+0000 7f85e9600700 10 client.16617 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:26:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:13 smithi070 ceph-mon[29591]: pgmap v1257: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 188 KiB/s wr, 110 op/s 2024-05-08T07:26:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:13 smithi172 ceph-mon[33377]: pgmap v1257: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 188 KiB/s wr, 110 op/s 2024-05-08T07:26:13.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:13 smithi194 ceph-mon[33679]: pgmap v1257: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 188 KiB/s wr, 110 op/s 2024-05-08T07:26:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:15 smithi070 ceph-mon[29591]: pgmap v1258: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 188 KiB/s wr, 110 op/s 2024-05-08T07:26:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:15 smithi172 ceph-mon[33377]: pgmap v1258: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 188 KiB/s wr, 110 op/s 2024-05-08T07:26:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:15 smithi194 ceph-mon[33679]: pgmap v1258: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 188 KiB/s wr, 110 op/s 2024-05-08T07:26:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:17 smithi070 ceph-mon[29591]: pgmap v1259: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 237 KiB/s wr, 103 op/s 2024-05-08T07:26:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:17 smithi172 ceph-mon[33377]: pgmap v1259: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 237 KiB/s wr, 103 op/s 2024-05-08T07:26:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:17 smithi194 ceph-mon[33679]: pgmap v1259: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 237 KiB/s wr, 103 op/s 2024-05-08T07:26:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:18 smithi194 ceph-mon[33679]: pgmap v1260: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 237 KiB/s wr, 103 op/s 2024-05-08T07:26:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:18 smithi194 ceph-mon[33679]: osdmap e159: 12 total, 12 up, 12 in 2024-05-08T07:26:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:18 smithi070 ceph-mon[29591]: pgmap v1260: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 237 KiB/s wr, 103 op/s 2024-05-08T07:26:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:18 smithi070 ceph-mon[29591]: osdmap e159: 12 total, 12 up, 12 in 2024-05-08T07:26:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:18 smithi172 ceph-mon[33377]: pgmap v1260: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 237 KiB/s wr, 103 op/s 2024-05-08T07:26:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:18 smithi172 ceph-mon[33377]: osdmap e159: 12 total, 12 up, 12 in 2024-05-08T07:26:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:20 smithi194 ceph-mon[33679]: pgmap v1262: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 140 KiB/s wr, 20 op/s 2024-05-08T07:26:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:20 smithi070 ceph-mon[29591]: pgmap v1262: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 140 KiB/s wr, 20 op/s 2024-05-08T07:26:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:20 smithi172 ceph-mon[33377]: pgmap v1262: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 140 KiB/s wr, 20 op/s 2024-05-08T07:26:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:22 smithi194 ceph-mon[33679]: pgmap v1263: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 134 KiB/s wr, 19 op/s 2024-05-08T07:26:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:22 smithi070 ceph-mon[29591]: pgmap v1263: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 134 KiB/s wr, 19 op/s 2024-05-08T07:26:23.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:22 smithi172 ceph-mon[33377]: pgmap v1263: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 134 KiB/s wr, 19 op/s 2024-05-08T07:26:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:24 smithi194 ceph-mon[33679]: pgmap v1264: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 134 KiB/s wr, 19 op/s 2024-05-08T07:26:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:24 smithi070 ceph-mon[29591]: pgmap v1264: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 134 KiB/s wr, 19 op/s 2024-05-08T07:26:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:24 smithi172 ceph-mon[33377]: pgmap v1264: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 134 KiB/s wr, 19 op/s 2024-05-08T07:26:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:26 smithi194 ceph-mon[33679]: pgmap v1265: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 11 op/s 2024-05-08T07:26:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:26 smithi070 ceph-mon[29591]: pgmap v1265: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 11 op/s 2024-05-08T07:26:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:26 smithi172 ceph-mon[33377]: pgmap v1265: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 11 op/s 2024-05-08T07:26:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:29 smithi194 ceph-mon[33679]: pgmap v1266: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 11 op/s 2024-05-08T07:26:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:29 smithi070 ceph-mon[29591]: pgmap v1266: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 11 op/s 2024-05-08T07:26:29.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:29 smithi172 ceph-mon[33377]: pgmap v1266: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 11 op/s 2024-05-08T07:26:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:31 smithi194 ceph-mon[33679]: pgmap v1267: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 12 op/s 2024-05-08T07:26:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:31 smithi070 ceph-mon[29591]: pgmap v1267: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 12 op/s 2024-05-08T07:26:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:31 smithi172 ceph-mon[33377]: pgmap v1267: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 12 op/s 2024-05-08T07:26:32.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f85e9600700 1 -- 172.21.15.70:0/2288111934 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55a78f859590 con 0x55a78f97f130 2024-05-08T07:26:32.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f85e9600700 10 client.16617 handle_command_reply: tid=0 2024-05-08T07:26:32.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f860c9d1b80 1 client.16617 shutdown 2024-05-08T07:26:32.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2288111934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 msgr2=0x55a78f909150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:32.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f909150 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009290 tx=0x7f85f40095f0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2288111934 shutdown_connections 2024-05-08T07:26:32.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a78f97f130 0x55a78f981550 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a78f8fef50 0x55a78f909150 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a78f8f9520 0x55a78f908690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f85e9600700 0 client.16617 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:26:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f860c9d1b80 1 --2- 172.21.15.70:0/2288111934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a78f8f9ee0 0x55a78f908bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.848+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2288111934 >> 172.21.15.70:0/2288111934 conn(0x55a78f827cf0 msgr2=0x55a78f8fd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.849+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2288111934 shutdown_connections 2024-05-08T07:26:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.849+0000 7f860c9d1b80 1 -- 172.21.15.70:0/2288111934 wait complete. 2024-05-08T07:26:32.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.849+0000 7f860c9d1b80 20 client.16617 trim_cache size 0 max 16384 2024-05-08T07:26:32.851 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:26:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 38, 2024-05-08T07:26:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:26:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 102, 2024-05-08T07:26:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:26:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "db1c699d": { 2024-05-08T07:26:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 102, 2024-05-08T07:26:32.851 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.8, 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:32.852 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 -- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85e00b2b20 msgr2=0x7f85e00b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85e00b2b20 0x7f85e00b4fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f85e40a50d0 tx=0x7f85e4020000 comp rx=0 tx=0).stop 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 -- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc104160 msgr2=0x7f85fc1a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc104160 0x7f85fc1a1d50 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f85e400c9e0 tx=0x7f85e400ccf0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 -- 172.21.15.70:0/2855611944 shutdown_connections 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85e00b2b20 0x7f85e00b4fe0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85fc1087a0 0x7f85fc19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85fc1037b0 0x7f85fc1a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 --2- 172.21.15.70:0/2855611944 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85fc104160 0x7f85fc1a1d50 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:32.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 -- 172.21.15.70:0/2855611944 >> 172.21.15.70:0/2855611944 conn(0x7f85fc07a570 msgr2=0x7f85fc1016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:32.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 -- 172.21.15.70:0/2855611944 shutdown_connections 2024-05-08T07:26:32.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:32.851+0000 7f8602000700 1 -- 172.21.15.70:0/2855611944 wait complete. 2024-05-08T07:26:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:33 smithi070 ceph-mon[29591]: pgmap v1268: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:26:33.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:33 smithi172 ceph-mon[33377]: pgmap v1268: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:26:33.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:33 smithi194 ceph-mon[33679]: pgmap v1268: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:26:33.693 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'db1c699d', quiesce took 27.6 seconds. Will release after: 20.8 2024-05-08T07:26:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:26:34.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:26:34.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:26:35.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:35 smithi070 ceph-mon[29591]: pgmap v1269: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:26:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:26:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:26:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:26:35.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:35 smithi172 ceph-mon[33377]: pgmap v1269: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:26:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:26:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:26:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:26:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:35 smithi194 ceph-mon[33679]: pgmap v1269: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:26:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:26:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:26:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:26:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:37 smithi070 ceph-mon[29591]: pgmap v1270: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-05-08T07:26:37.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:37 smithi172 ceph-mon[33377]: pgmap v1270: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-05-08T07:26:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:37 smithi194 ceph-mon[33679]: pgmap v1270: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-05-08T07:26:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:39 smithi070 ceph-mon[29591]: pgmap v1271: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2024-05-08T07:26:39.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:39 smithi172 ceph-mon[33377]: pgmap v1271: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2024-05-08T07:26:39.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:39 smithi194 ceph-mon[33679]: pgmap v1271: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 6 op/s 2024-05-08T07:26:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:41 smithi070 ceph-mon[29591]: pgmap v1272: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 8 op/s 2024-05-08T07:26:41.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:41 smithi172 ceph-mon[33377]: pgmap v1272: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 8 op/s 2024-05-08T07:26:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:41 smithi194 ceph-mon[33679]: pgmap v1272: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 8 op/s 2024-05-08T07:26:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:43 smithi070 ceph-mon[29591]: pgmap v1273: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2024-05-08T07:26:43.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:43 smithi172 ceph-mon[33377]: pgmap v1273: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2024-05-08T07:26:43.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:43 smithi194 ceph-mon[33679]: pgmap v1273: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2024-05-08T07:26:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:45 smithi070 ceph-mon[29591]: pgmap v1274: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2024-05-08T07:26:45.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:45 smithi172 ceph-mon[33377]: pgmap v1274: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2024-05-08T07:26:45.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:45 smithi194 ceph-mon[33679]: pgmap v1274: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 5 op/s 2024-05-08T07:26:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:47 smithi070 ceph-mon[29591]: pgmap v1275: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-05-08T07:26:47.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:47 smithi172 ceph-mon[33377]: pgmap v1275: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-05-08T07:26:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:47 smithi194 ceph-mon[33679]: pgmap v1275: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-05-08T07:26:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:49 smithi070 ceph-mon[29591]: pgmap v1276: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T07:26:49.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:49 smithi172 ceph-mon[33377]: pgmap v1276: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T07:26:49.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:49 smithi194 ceph-mon[33679]: pgmap v1276: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T07:26:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:51 smithi070 ceph-mon[29591]: pgmap v1277: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2024-05-08T07:26:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:51 smithi172 ceph-mon[33377]: pgmap v1277: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2024-05-08T07:26:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:51 smithi194 ceph-mon[33679]: pgmap v1277: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.6 KiB/s wr, 7 op/s 2024-05-08T07:26:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:53 smithi070 ceph-mon[29591]: pgmap v1278: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T07:26:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:53 smithi172 ceph-mon[33377]: pgmap v1278: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T07:26:53.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:53 smithi194 ceph-mon[33679]: pgmap v1278: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.6 KiB/s wr, 5 op/s 2024-05-08T07:26:54.495 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:26:54.944 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:26:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:55 smithi070 ceph-mon[29591]: pgmap v1279: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2024-05-08T07:26:55.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:55 smithi172 ceph-mon[33377]: pgmap v1279: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2024-05-08T07:26:55.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:55 smithi194 ceph-mon[33679]: pgmap v1279: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.6 KiB/s wr, 6 op/s 2024-05-08T07:26:57.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.273+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1285250454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0103ef0 msgr2=0x7fc4e01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.273+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1285250454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0103ef0 0x7fc4e01103d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8009990 tx=0x7fc4d8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.273+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1285250454 shutdown_connections 2024-05-08T07:26:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.273+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1285250454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0103ef0 0x7fc4e01103d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.273+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1285250454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0108460 0x7fc4e0108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.273+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1285250454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0103550 0x7fc4e01039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.273+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1285250454 >> 172.21.15.70:0/1285250454 conn(0x7fc4e007a600 msgr2=0x7fc4e007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.273+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1285250454 shutdown_connections 2024-05-08T07:26:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.273+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1285250454 wait complete. 2024-05-08T07:26:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.274+0000 7fc4e7e00700 1 Processor -- start 2024-05-08T07:26:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.274+0000 7fc4e7e00700 1 -- start start 2024-05-08T07:26:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e7e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0103550 0x7fc4e01a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e7e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0103ef0 0x7fc4e01a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0108460 0x7fc4e019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e7e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e01135a0 con 0x7fc4e0108460 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e7e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0113420 con 0x7fc4e0103ef0 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e7e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e0113720 con 0x7fc4e0103550 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0108460 0x7fc4e019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0108460 0x7fc4e019baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38560/0 (socket says 172.21.15.70:38560) 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e5e00700 1 -- 172.21.15.70:0/1803734888 learned_addr learned my addr 172.21.15.70:0/1803734888 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e5400700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0103550 0x7fc4e01a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.275+0000 7fc4e4a00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0103ef0 0x7fc4e01a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4e5e00700 1 -- 172.21.15.70:0/1803734888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0103550 msgr2=0x7fc4e01a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4e5e00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0103550 0x7fc4e01a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4e5e00700 1 -- 172.21.15.70:0/1803734888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0103ef0 msgr2=0x7fc4e01a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4e5e00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0103ef0 0x7fc4e01a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4e5e00700 1 -- 172.21.15.70:0/1803734888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e019c200 con 0x7fc4e0108460 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4e5400700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0103550 0x7fc4e01a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4e5e00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0108460 0x7fc4e019baa0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80047b0 tx=0x7fc4d8009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:57.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4de000700 1 -- 172.21.15.70:0/1803734888 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8004830 con 0x7fc4e0108460 2024-05-08T07:26:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4de000700 1 -- 172.21.15.70:0/1803734888 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc4d8005020 con 0x7fc4e0108460 2024-05-08T07:26:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e019c490 con 0x7fc4e0108460 2024-05-08T07:26:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.276+0000 7fc4de000700 1 -- 172.21.15.70:0/1803734888 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800faf0 con 0x7fc4e0108460 2024-05-08T07:26:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.277+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e01a87b0 con 0x7fc4e0108460 2024-05-08T07:26:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.278+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4e006a190 con 0x7fc4e0108460 2024-05-08T07:26:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.280+0000 7fc4de000700 1 -- 172.21.15.70:0/1803734888 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc4d80051d0 con 0x7fc4e0108460 2024-05-08T07:26:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.281+0000 7fc4de000700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:26:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.282+0000 7fc4de000700 1 -- 172.21.15.70:0/1803734888 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 9583+0+0 (secure 0 0 0) 0x7fc4d80e3b90 con 0x7fc4e0108460 2024-05-08T07:26:57.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.282+0000 7fc4e5400700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:26:57.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.282+0000 7fc4e5400700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4007720 tx=0x7fc4d40076b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:26:57.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.284+0000 7fc4de000700 1 -- 172.21.15.70:0/1803734888 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc4d8013070 con 0x7fc4e0108460 2024-05-08T07:26:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:57 smithi070 ceph-mon[29591]: pgmap v1280: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 KiB/s wr, 7 op/s 2024-05-08T07:26:57.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:57 smithi172 ceph-mon[33377]: pgmap v1280: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 KiB/s wr, 7 op/s 2024-05-08T07:26:57.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:57 smithi194 ceph-mon[33679]: pgmap v1280: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 KiB/s wr, 7 op/s 2024-05-08T07:26:57.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.565+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4e01a8980 con 0x7fc4e0108460 2024-05-08T07:26:57.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.567+0000 7fc4de000700 1 -- 172.21.15.70:0/1803734888 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+11879 (secure 0 0 0) 0x7fc4d80ab0e0 con 0x7fc4e0108460 2024-05-08T07:26:57.566 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:26:57.566 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:24:59.339131+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:26:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 msgr2=0x7fc4c80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4007720 tx=0x7fc4d40076b0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0108460 msgr2=0x7fc4e019baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:26:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0108460 0x7fc4e019baa0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fc4d80047b0 tx=0x7fc4d8009ee0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 shutdown_connections 2024-05-08T07:26:57.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4c80b2a70 0x7fc4c80b4f30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4e0108460 0x7fc4e019baa0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0103550 0x7fc4e01a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 --2- 172.21.15.70:0/1803734888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4e0103ef0 0x7fc4e01a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:26:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.570+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 >> 172.21.15.70:0/1803734888 conn(0x7fc4e007a600 msgr2=0x7fc4e01013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:26:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.571+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 shutdown_connections 2024-05-08T07:26:57.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:26:57.571+0000 7fc4e7e00700 1 -- 172.21.15.70:0/1803734888 wait complete. 2024-05-08T07:26:57.573 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 38 2024-05-08T07:26:58.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:58 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1803734888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:26:58.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:58 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1803734888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:26:58.495 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id db1c699d --release --await' 2024-05-08T07:26:58.495 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id db1c699d --release --await 2024-05-08T07:26:58.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:58 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1803734888' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:26:58.943 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:26:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:26:59 smithi070 ceph-mon[29591]: pgmap v1281: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T07:26:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:26:59 smithi172 ceph-mon[33377]: pgmap v1281: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T07:26:59.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:26:59 smithi194 ceph-mon[33679]: pgmap v1281: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T07:27:01.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.174+0000 7fdcdba00700 1 -- 172.21.15.70:0/3543738143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 msgr2=0x7fdcd41087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:27:01.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.174+0000 7fdcdba00700 1 --2- 172.21.15.70:0/3543738143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 0x7fdcd41087f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009990 tx=0x7fdcc8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.174+0000 7fdcdba00700 1 -- 172.21.15.70:0/3543738143 shutdown_connections 2024-05-08T07:27:01.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.174+0000 7fdcdba00700 1 --2- 172.21.15.70:0/3543738143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcd4102d60 0x7fdcd410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.174+0000 7fdcdba00700 1 --2- 172.21.15.70:0/3543738143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 0x7fdcd41087f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.174+0000 7fdcdba00700 1 --2- 172.21.15.70:0/3543738143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd41023a0 0x7fdcd4102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.174+0000 7fdcdba00700 1 -- 172.21.15.70:0/3543738143 >> 172.21.15.70:0/3543738143 conn(0x7fdcd4079350 msgr2=0x7fdcd4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:27:01.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.174+0000 7fdcdba00700 1 -- 172.21.15.70:0/3543738143 shutdown_connections 2024-05-08T07:27:01.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.175+0000 7fdcdba00700 1 -- 172.21.15.70:0/3543738143 wait complete. 2024-05-08T07:27:01.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.176+0000 7fdcdba00700 1 Processor -- start 2024-05-08T07:27:01.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.176+0000 7fdcdba00700 1 -- start start 2024-05-08T07:27:01.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcdba00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd41023a0 0x7fdcd4104080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcdba00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcd4102d60 0x7fdcd41045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcdba00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 0x7fdcd4104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcdba00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41123e0 con 0x7fdcd4108410 2024-05-08T07:27:01.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcdba00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4112260 con 0x7fdcd41023a0 2024-05-08T07:27:01.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcdba00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4112560 con 0x7fdcd4102d60 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcd9a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 0x7fdcd4104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcd9000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd41023a0 0x7fdcd4104080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcd9a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 0x7fdcd4104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38572/0 (socket says 172.21.15.70:38572) 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.177+0000 7fdcd9a00700 1 -- 172.21.15.70:0/534894954 learned_addr learned my addr 172.21.15.70:0/534894954 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.178+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcd4102d60 0x7fdcd41045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.178+0000 7fdcd9a00700 1 -- 172.21.15.70:0/534894954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcd4102d60 msgr2=0x7fdcd41045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.178+0000 7fdcd9a00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcd4102d60 0x7fdcd41045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.178+0000 7fdcd9a00700 1 -- 172.21.15.70:0/534894954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd41023a0 msgr2=0x7fdcd4104080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.178+0000 7fdcd9a00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd41023a0 0x7fdcd4104080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.178+0000 7fdcd9a00700 1 -- 172.21.15.70:0/534894954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd41a7f50 con 0x7fdcd4108410 2024-05-08T07:27:01.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.179+0000 7fdcd9a00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 0x7fdcd4104b00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdccc007d70 tx=0x7fdccc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:27:01.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.179+0000 7fdcd1600700 1 -- 172.21.15.70:0/534894954 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc016020 con 0x7fdcd4108410 2024-05-08T07:27:01.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.179+0000 7fdcdba00700 1 -- 172.21.15.70:0/534894954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd41a8240 con 0x7fdcd4108410 2024-05-08T07:27:01.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.179+0000 7fdcd1600700 1 -- 172.21.15.70:0/534894954 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdccc00ac90 con 0x7fdcd4108410 2024-05-08T07:27:01.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.179+0000 7fdcd1600700 1 -- 172.21.15.70:0/534894954 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0115e0 con 0x7fdcd4108410 2024-05-08T07:27:01.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.179+0000 7fdcdba00700 1 -- 172.21.15.70:0/534894954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd41a8730 con 0x7fdcd4108410 2024-05-08T07:27:01.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.184+0000 7fdce62dab80 1 Processor -- start 2024-05-08T07:27:01.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.184+0000 7fdcd1600700 1 -- 172.21.15.70:0/534894954 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fdccc019020 con 0x7fdcd4108410 2024-05-08T07:27:01.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.184+0000 7fdce62dab80 1 -- start start 2024-05-08T07:27:01.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089dd82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 0x55d089dd2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089ddec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdce62dab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d089d24b20 con 0x55d089dd2e50 2024-05-08T07:27:01.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdce62dab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d089cc2860 con 0x55d089dd7ec0 2024-05-08T07:27:01.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdce62dab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d089d20ae0 con 0x55d089dd2490 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdcd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089ddec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdcd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089ddec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38584/0 (socket says 172.21.15.70:38584) 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3311862760 learned_addr learned my addr 172.21.15.70:0/3311862760 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.185+0000 7fdcd9000700 1 --2- 172.21.15.70:0/3311862760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 0x55d089dd2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.186+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3311862760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089dd82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.186+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3311862760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 msgr2=0x55d089dd2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.186+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3311862760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 0x55d089dd2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.186+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3311862760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 msgr2=0x55d089dd82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.186+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3311862760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089dd82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.186+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3311862760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d089c719d0 con 0x55d089dd2e50 2024-05-08T07:27:01.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.186+0000 7fdcd1600700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdcbc0b29f0 0x7fdcbc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.187+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3311862760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089ddec80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0005d90 tx=0x7fdcc0005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6204e59ad72c45 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:27:01.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.187+0000 7fdcd1600700 1 -- 172.21.15.70:0/534894954 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 9583+0+0 (secure 0 0 0) 0x7fdccc0e2880 con 0x7fdcd4108410 2024-05-08T07:27:01.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.187+0000 7fdcc6000700 1 -- 172.21.15.70:0/3311862760 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0012e00 con 0x55d089dd2e50 2024-05-08T07:27:01.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.187+0000 7fdcd9000700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdcbc0b29f0 0x7fdcbc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.187+0000 7fdcc6000700 1 -- 172.21.15.70:0/3311862760 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcc0004cc0 con 0x55d089dd2e50 2024-05-08T07:27:01.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.187+0000 7fdcc6000700 1 -- 172.21.15.70:0/3311862760 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc000f3f0 con 0x55d089dd2e50 2024-05-08T07:27:01.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.188+0000 7fdce62dab80 1 -- 172.21.15.70:0/3311862760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 msgr2=0x55d089ddec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:27:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.188+0000 7fdcd9000700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdcbc0b29f0 0x7fdcbc0b4eb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80098e0 tx=0x7fdcc8005960 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:27:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.188+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3311862760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089ddec80 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0005d90 tx=0x7fdcc0005d20 comp rx=0 tx=0).stop 2024-05-08T07:27:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.189+0000 7fdce62dab80 1 -- 172.21.15.70:0/3311862760 shutdown_connections 2024-05-08T07:27:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.189+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3311862760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089ddec80 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.189+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3311862760 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089dd82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.189+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3311862760 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 0x55d089dd2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.189+0000 7fdce62dab80 1 -- 172.21.15.70:0/3311862760 >> 172.21.15.70:0/3311862760 conn(0x55d089d00c60 msgr2=0x55d089dccd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:27:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.189+0000 7fdce62dab80 1 -- 172.21.15.70:0/3311862760 shutdown_connections 2024-05-08T07:27:01.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.189+0000 7fdce62dab80 1 -- 172.21.15.70:0/3311862760 wait complete. 2024-05-08T07:27:01.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.189+0000 7fdce62dab80 1 -- start start 2024-05-08T07:27:01.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.190+0000 7fdce62dab80 1 Processor -- start 2024-05-08T07:27:01.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.190+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2490 0x55d089dde8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.190+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2e50 0x55d089ddbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.190+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089ddc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.190+0000 7fdce62dab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d089ddf220 con 0x55d089dd2490 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.190+0000 7fdce62dab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d089c8ac20 con 0x55d089dd7ec0 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.190+0000 7fdce62dab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d089ddf3a0 con 0x55d089dd2e50 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.190+0000 7fdce62dab80 10 client.0 _ll_register_callbacks cb 0x55d089ccbd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2490 0x55d089dde8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2490 0x55d089dde8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38598/0 (socket says 172.21.15.70:38598) 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9000700 1 -- 172.21.15.70:0/1221308401 learned_addr learned my addr 172.21.15.70:0/1221308401 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:27:01.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2e50 0x55d089ddbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9a00700 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089ddc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9000700 1 -- 172.21.15.70:0/1221308401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2e50 msgr2=0x55d089ddbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9000700 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2e50 0x55d089ddbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9000700 1 -- 172.21.15.70:0/1221308401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 msgr2=0x55d089ddc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9000700 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089ddc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9000700 1 -- 172.21.15.70:0/1221308401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d089cea520 con 0x55d089dd2490 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.191+0000 7fdcd9a00700 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089ddc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.192+0000 7fdcd9000700 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2490 0x55d089dde8b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8015000 tx=0x7fdcc8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b1603947844ca3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.192+0000 7fdcbaa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.192+0000 7fdcbaa00700 1 -- 172.21.15.70:0/1221308401 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8034060 con 0x55d089dd2490 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.192+0000 7fdcbaa00700 1 -- 172.21.15.70:0/1221308401 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(159..159 src has 1..159) ==== 9583+0+0 (secure 0 0 0) 0x7fdcc800bbe0 con 0x55d089dd2490 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.192+0000 7fdce62dab80 1 -- 172.21.15.70:0/1221308401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcc0004cc0 con 0x55d089dd2490 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.192+0000 7fdcbaa00700 1 -- 172.21.15.70:0/1221308401 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fdcc803b050 con 0x55d089dd2490 2024-05-08T07:27:01.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdce62dab80 10 client.16635 fetch_fsmap learned FSMap version 38 2024-05-08T07:27:01.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdce62dab80 1 -- 172.21.15.70:0/1221308401 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d089df2250 con 0x55d089dd2490 2024-05-08T07:27:01.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdcbaa00700 1 -- 172.21.15.70:0/1221308401 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcc0004cc0 con 0x55d089dd2490 2024-05-08T07:27:01.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdcbaa00700 1 -- 172.21.15.70:0/1221308401 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fdcc8024440 con 0x55d089dd2490 2024-05-08T07:27:01.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdce62dab80 10 client.16635 fetch_fsmap finished waiting for FSMap version 38 2024-05-08T07:27:01.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdce62dab80 10 client.16635 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:27:01.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdce62dab80 20 client.16635 populate_metadata read hostname 'smithi070' 2024-05-08T07:27:01.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdce62dab80 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d089df4890 0x55d089df6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdce62dab80 4 client.16635 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:27:01.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.193+0000 7fdce62dab80 1 -- 172.21.15.70:0/1221308401 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d089d9f1a0 con 0x55d089df4890 2024-05-08T07:27:01.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.194+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d089df4890 0x55d089df6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.195+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d089df4890 0x55d089df6ca0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c581f39f173e240b server_cookie=236b284c9299733e in_seq=0 out_seq=0 2024-05-08T07:27:01.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.195+0000 7fdcbaa00700 10 client.16635 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:27:01.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdcbaa00700 1 -- 172.21.15.70:0/1221308401 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d089d9f1a0 con 0x55d089df4890 2024-05-08T07:27:01.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdcbaa00700 10 client.16635 handle_command_reply: tid=0 2024-05-08T07:27:01.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdce62dab80 1 client.16635 shutdown 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdce62dab80 1 -- 172.21.15.70:0/1221308401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2490 msgr2=0x55d089dde8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdce62dab80 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2490 0x55d089dde8b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8015000 tx=0x7fdcc8009310 comp rx=0 tx=0).stop 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdce62dab80 1 -- 172.21.15.70:0/1221308401 shutdown_connections 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdce62dab80 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d089df4890 0x55d089df6ca0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdce62dab80 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089ddc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdce62dab80 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2490 0x55d089dde8b0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdce62dab80 1 --2- 172.21.15.70:0/1221308401 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2e50 0x55d089ddbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.197+0000 7fdce62dab80 1 -- 172.21.15.70:0/1221308401 >> 172.21.15.70:0/1221308401 conn(0x55d089d00c60 msgr2=0x55d089dc7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.198+0000 7fdcbaa00700 0 client.16635 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.198+0000 7fdce62dab80 1 -- 172.21.15.70:0/1221308401 shutdown_connections 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.198+0000 7fdce62dab80 1 -- 172.21.15.70:0/1221308401 wait complete. 2024-05-08T07:27:01.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.198+0000 7fdce62dab80 20 client.16635 trim_cache size 0 max 16384 2024-05-08T07:27:01.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.220+0000 7fdce62dab80 1 Processor -- start 2024-05-08T07:27:01.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.220+0000 7fdce62dab80 1 -- start start 2024-05-08T07:27:01.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 0x55d089df0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089dc76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089dd4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdce62dab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41afc50 con 0x55d089dd2e50 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdce62dab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41ad4e0 con 0x55d089dd7ec0 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdce62dab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41ab350 con 0x55d089dd2490 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdcd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089dc76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdcd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089dc76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38612/0 (socket says 172.21.15.70:38612) 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3227723785 learned_addr learned my addr 172.21.15.70:0/3227723785 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.221+0000 7fdcd9000700 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 0x55d089df0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.222+0000 7fdcd9a00700 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089dd4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.222+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3227723785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 msgr2=0x55d089df0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.222+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 0x55d089df0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.222+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3227723785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 msgr2=0x55d089dd4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.222+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089dd4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.222+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3227723785 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d089dcd2c0 con 0x55d089dd2e50 2024-05-08T07:27:01.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.222+0000 7fdcd9000700 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 0x55d089df0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:27:01.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.222+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089dc76d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0005d90 tx=0x7fdcc000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81701191c36662d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:27:01.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.223+0000 7fdcc5600700 1 -- 172.21.15.70:0/3227723785 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00050d0 con 0x55d089dd2e50 2024-05-08T07:27:01.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.223+0000 7fdcc5600700 1 -- 172.21.15.70:0/3227723785 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcc0016040 con 0x55d089dd2e50 2024-05-08T07:27:01.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.223+0000 7fdcc5600700 1 -- 172.21.15.70:0/3227723785 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0003680 con 0x55d089dd2e50 2024-05-08T07:27:01.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.223+0000 7fdce62dab80 1 -- 172.21.15.70:0/3227723785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 msgr2=0x55d089dc76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:27:01.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.223+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089dc76d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0005d90 tx=0x7fdcc000b650 comp rx=0 tx=0).stop 2024-05-08T07:27:01.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.224+0000 7fdce62dab80 1 -- 172.21.15.70:0/3227723785 shutdown_connections 2024-05-08T07:27:01.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.224+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd7ec0 0x55d089dd4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.224+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd2490 0x55d089df0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.224+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3227723785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089dc76d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.224+0000 7fdce62dab80 1 -- 172.21.15.70:0/3227723785 >> 172.21.15.70:0/3227723785 conn(0x55d089d00c60 msgr2=0x55d089dc6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:27:01.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.224+0000 7fdce62dab80 1 -- 172.21.15.70:0/3227723785 shutdown_connections 2024-05-08T07:27:01.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.224+0000 7fdce62dab80 1 -- 172.21.15.70:0/3227723785 wait complete. 2024-05-08T07:27:01.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.224+0000 7fdce62dab80 1 -- start start 2024-05-08T07:27:01.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.224+0000 7fdce62dab80 1 Processor -- start 2024-05-08T07:27:01.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd2490 0x55d089ded3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089de7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdce62dab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd7ec0 0x55d089de83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdce62dab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41ab9a0 con 0x55d089dd2e50 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdce62dab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41ace10 con 0x55d089dd2490 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdce62dab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41ac070 con 0x55d089dd7ec0 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdce62dab80 10 client.0 _ll_register_callbacks cb 0x55d089ccbd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdcd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089de7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdcd3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089de7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38622/0 (socket says 172.21.15.70:38622) 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.225+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3122942216 learned_addr learned my addr 172.21.15.70:0/3122942216 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcd9a00700 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd7ec0 0x55d089de83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcd9000700 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd2490 0x55d089ded3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3122942216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd7ec0 msgr2=0x55d089de83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd7ec0 0x55d089de83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3122942216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd2490 msgr2=0x55d089ded3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd2490 0x55d089ded3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcd3e00700 1 -- 172.21.15.70:0/3122942216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d089de8bf0 con 0x55d089dd2e50 2024-05-08T07:27:01.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcd3e00700 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089de7e80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0005d60 tx=0x7fdcc000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b470a0dfcafd8be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:27:01.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcbaa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:27:01.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.226+0000 7fdcbaa00700 1 -- 172.21.15.70:0/3122942216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc0037060 con 0x55d089dd2e50 2024-05-08T07:27:01.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.227+0000 7fdce62dab80 1 -- 172.21.15.70:0/3122942216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcc0016040 con 0x55d089dd2e50 2024-05-08T07:27:01.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.227+0000 7fdcbaa00700 1 -- 172.21.15.70:0/3122942216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(159..159 src has 1..159) ==== 9583+0+0 (secure 0 0 0) 0x7fdcc002f040 con 0x55d089dd2e50 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.227+0000 7fdcbaa00700 1 -- 172.21.15.70:0/3122942216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fdcc00295c0 con 0x55d089dd2e50 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.227+0000 7fdce62dab80 10 client.16641 fetch_fsmap learned FSMap version 38 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.227+0000 7fdce62dab80 1 -- 172.21.15.70:0/3122942216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55d089e60170 con 0x55d089dd2e50 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.227+0000 7fdcbaa00700 1 -- 172.21.15.70:0/3122942216 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdcc0016040 con 0x55d089dd2e50 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.228+0000 7fdcbaa00700 1 -- 172.21.15.70:0/3122942216 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 38) ==== 8354+0+0 (secure 0 0 0) 0x7fdcc0003c60 con 0x55d089dd2e50 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.228+0000 7fdce62dab80 10 client.16641 fetch_fsmap finished waiting for FSMap version 38 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.228+0000 7fdce62dab80 10 client.16641 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.228+0000 7fdce62dab80 20 client.16641 populate_metadata read hostname 'smithi070' 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.228+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d089e60750 0x55d089e62b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:27:01.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.228+0000 7fdce62dab80 4 client.16641 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "db1c699d", "release": true, "await": true}] 2024-05-08T07:27:01.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.228+0000 7fdce62dab80 1 -- 172.21.15.70:0/3122942216 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "db1c699d", "release": true, "await": true}) -- 0x55d089d32500 con 0x55d089e60750 2024-05-08T07:27:01.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.229+0000 7fdcd9000700 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d089e60750 0x55d089e62b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:27:01.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.229+0000 7fdcd9000700 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d089e60750 0x55d089e62b70 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c1c8def5ce34647 server_cookie=ff12ecebeab917ff in_seq=0 out_seq=0 2024-05-08T07:27:01.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:01.229+0000 7fdcbaa00700 10 client.16641 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:27:01.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:01 smithi070 ceph-mon[29591]: pgmap v1282: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-05-08T07:27:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:01 smithi172 ceph-mon[33377]: pgmap v1282: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-05-08T07:27:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:01 smithi194 ceph-mon[33679]: pgmap v1282: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-05-08T07:27:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:03 smithi172 ceph-mon[33377]: pgmap v1283: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T07:27:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:03 smithi194 ceph-mon[33679]: pgmap v1283: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T07:27:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:03 smithi070 ceph-mon[29591]: pgmap v1283: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 5 op/s 2024-05-08T07:27:05.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:05 smithi172 ceph-mon[33377]: pgmap v1284: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 KiB/s wr, 5 op/s 2024-05-08T07:27:05.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:05 smithi194 ceph-mon[33679]: pgmap v1284: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 KiB/s wr, 5 op/s 2024-05-08T07:27:05.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:05 smithi070 ceph-mon[29591]: pgmap v1284: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 3.3 KiB/s wr, 5 op/s 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.552+0000 7fdcbaa00700 1 -- 172.21.15.70:0/3122942216 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55d089d32500 con 0x55d089e60750 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.552+0000 7fdcbaa00700 10 client.16641 handle_command_reply: tid=0 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.552+0000 7fdce62dab80 1 client.16641 shutdown 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.553+0000 7fdce62dab80 1 -- 172.21.15.70:0/3122942216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 msgr2=0x55d089de7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.553+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089de7e80 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0005d60 tx=0x7fdcc000bbb0 comp rx=0 tx=0).stop 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.553+0000 7fdce62dab80 1 -- 172.21.15.70:0/3122942216 shutdown_connections 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.553+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d089e60750 0x55d089e62b70 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.553+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d089dd7ec0 0x55d089de83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.553+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d089dd2490 0x55d089ded3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.553+0000 7fdce62dab80 1 --2- 172.21.15.70:0/3122942216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d089dd2e50 0x55d089de7e80 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.553+0000 7fdce62dab80 1 -- 172.21.15.70:0/3122942216 >> 172.21.15.70:0/3122942216 conn(0x55d089d00c60 msgr2=0x55d089dc7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:27:05.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.553+0000 7fdcbaa00700 0 client.16641 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:27:05.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.554+0000 7fdce62dab80 1 -- 172.21.15.70:0/3122942216 shutdown_connections 2024-05-08T07:27:05.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.554+0000 7fdce62dab80 1 -- 172.21.15.70:0/3122942216 wait complete. 2024-05-08T07:27:05.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.554+0000 7fdce62dab80 20 client.16641 trim_cache size 0 max 16384 2024-05-08T07:27:05.554 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:27:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 38, 2024-05-08T07:27:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:27:05.554 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 104, 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "db1c699d": { 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 104, 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.8, 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:27:05.555 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:27:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:27:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:27:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:27:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:27:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:27:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:27:05.557 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:27:05.557 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:27:05.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.555+0000 7fdcdba00700 1 -- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdcbc0b29f0 msgr2=0x7fdcbc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:27:05.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.555+0000 7fdcdba00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdcbc0b29f0 0x7fdcbc0b4eb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdcc80098e0 tx=0x7fdcc8005960 comp rx=0 tx=0).stop 2024-05-08T07:27:05.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.555+0000 7fdcdba00700 1 -- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 msgr2=0x7fdcd4104b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:27:05.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.555+0000 7fdcdba00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 0x7fdcd4104b00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdccc007d70 tx=0x7fdccc00a340 comp rx=0 tx=0).stop 2024-05-08T07:27:05.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.556+0000 7fdcdba00700 1 -- 172.21.15.70:0/534894954 shutdown_connections 2024-05-08T07:27:05.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.556+0000 7fdcdba00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdcbc0b29f0 0x7fdcbc0b4eb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:05.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.556+0000 7fdcdba00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdcd4108410 0x7fdcd4104b00 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:05.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.556+0000 7fdcdba00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdcd41023a0 0x7fdcd4104080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:05.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.556+0000 7fdcdba00700 1 --2- 172.21.15.70:0/534894954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdcd4102d60 0x7fdcd41045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:27:05.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.556+0000 7fdcdba00700 1 -- 172.21.15.70:0/534894954 >> 172.21.15.70:0/534894954 conn(0x7fdcd4079350 msgr2=0x7fdcd406b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:27:05.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.556+0000 7fdcdba00700 1 -- 172.21.15.70:0/534894954 shutdown_connections 2024-05-08T07:27:05.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:27:05.556+0000 7fdcdba00700 1 -- 172.21.15.70:0/534894954 wait complete. 2024-05-08T07:27:05.748 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kconfig/parser.tab.o 2024-05-08T07:27:06.433 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kconfig/preprocess.o 2024-05-08T07:27:06.600 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'db1c699d', seconds elapsed: 60.6 2024-05-08T07:27:06.762 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kconfig/symbol.o 2024-05-08T07:27:07.317 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kconfig/util.o 2024-05-08T07:27:07.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:07 smithi172 ceph-mon[33377]: pgmap v1285: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 48 KiB/s wr, 23 op/s 2024-05-08T07:27:07.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:07 smithi194 ceph-mon[33679]: pgmap v1285: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 48 KiB/s wr, 23 op/s 2024-05-08T07:27:07.577 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTLD scripts/kconfig/conf 2024-05-08T07:27:07.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:07 smithi070 ceph-mon[29591]: pgmap v1285: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 48 KiB/s wr, 23 op/s 2024-05-08T07:27:08.260 INFO:tasks.workunit.client.0.smithi070.stdout:*** Default configuration is based on 'x86_64_defconfig' 2024-05-08T07:27:09.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:09 smithi172 ceph-mon[33377]: pgmap v1286: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:27:09.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:09 smithi194 ceph-mon[33679]: pgmap v1286: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:27:09.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:09 smithi070 ceph-mon[29591]: pgmap v1286: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:27:11.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:11 smithi172 ceph-mon[33377]: pgmap v1287: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-05-08T07:27:11.429 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:11 smithi070 ceph-mon[29591]: pgmap v1287: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-05-08T07:27:11.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:11 smithi194 ceph-mon[33679]: pgmap v1287: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 74 KiB/s wr, 28 op/s 2024-05-08T07:27:12.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:12 smithi172 ceph-mon[33377]: osdmap e160: 12 total, 12 up, 12 in 2024-05-08T07:27:12.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:12 smithi194 ceph-mon[33679]: osdmap e160: 12 total, 12 up, 12 in 2024-05-08T07:27:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:12 smithi070 ceph-mon[29591]: osdmap e160: 12 total, 12 up, 12 in 2024-05-08T07:27:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:13 smithi194 ceph-mon[33679]: pgmap v1289: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 92 KiB/s wr, 33 op/s 2024-05-08T07:27:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:13 smithi070 ceph-mon[29591]: pgmap v1289: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 92 KiB/s wr, 33 op/s 2024-05-08T07:27:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:13 smithi172 ceph-mon[33377]: pgmap v1289: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 92 KiB/s wr, 33 op/s 2024-05-08T07:27:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:15 smithi194 ceph-mon[33679]: pgmap v1290: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 93 KiB/s wr, 34 op/s 2024-05-08T07:27:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:15 smithi070 ceph-mon[29591]: pgmap v1290: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 93 KiB/s wr, 34 op/s 2024-05-08T07:27:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:15 smithi172 ceph-mon[33377]: pgmap v1290: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 93 KiB/s wr, 34 op/s 2024-05-08T07:27:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:17 smithi194 ceph-mon[33679]: pgmap v1291: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 220 KiB/s wr, 65 op/s 2024-05-08T07:27:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:17 smithi070 ceph-mon[29591]: pgmap v1291: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 220 KiB/s wr, 65 op/s 2024-05-08T07:27:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:17 smithi172 ceph-mon[33377]: pgmap v1291: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 220 KiB/s wr, 65 op/s 2024-05-08T07:27:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:18 smithi194 ceph-mon[33679]: pgmap v1292: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 220 KiB/s wr, 65 op/s 2024-05-08T07:27:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:18 smithi194 ceph-mon[33679]: osdmap e161: 12 total, 12 up, 12 in 2024-05-08T07:27:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:18 smithi070 ceph-mon[29591]: pgmap v1292: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 220 KiB/s wr, 65 op/s 2024-05-08T07:27:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:18 smithi070 ceph-mon[29591]: osdmap e161: 12 total, 12 up, 12 in 2024-05-08T07:27:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:18 smithi172 ceph-mon[33377]: pgmap v1292: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 220 KiB/s wr, 65 op/s 2024-05-08T07:27:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:18 smithi172 ceph-mon[33377]: osdmap e161: 12 total, 12 up, 12 in 2024-05-08T07:27:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:21 smithi194 ceph-mon[33679]: pgmap v1294: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 252 KiB/s wr, 162 op/s 2024-05-08T07:27:21.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:21 smithi070 ceph-mon[29591]: pgmap v1294: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 252 KiB/s wr, 162 op/s 2024-05-08T07:27:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:21 smithi172 ceph-mon[33377]: pgmap v1294: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 252 KiB/s wr, 162 op/s 2024-05-08T07:27:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:23 smithi194 ceph-mon[33679]: pgmap v1295: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 220 KiB/s wr, 149 op/s 2024-05-08T07:27:23.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:23 smithi070 ceph-mon[29591]: pgmap v1295: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 220 KiB/s wr, 149 op/s 2024-05-08T07:27:23.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:23 smithi172 ceph-mon[33377]: pgmap v1295: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 220 KiB/s wr, 149 op/s 2024-05-08T07:27:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:25 smithi070 ceph-mon[29591]: pgmap v1296: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 223 KiB/s wr, 151 op/s 2024-05-08T07:27:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:25 smithi172 ceph-mon[33377]: pgmap v1296: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 223 KiB/s wr, 151 op/s 2024-05-08T07:27:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:25 smithi194 ceph-mon[33679]: pgmap v1296: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 223 KiB/s wr, 151 op/s 2024-05-08T07:27:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:27 smithi070 ceph-mon[29591]: pgmap v1297: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 113 KiB/s wr, 136 op/s 2024-05-08T07:27:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:27 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:27:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:27 smithi172 ceph-mon[33377]: pgmap v1297: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 113 KiB/s wr, 136 op/s 2024-05-08T07:27:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:27 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:27:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:27 smithi194 ceph-mon[33679]: pgmap v1297: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 113 KiB/s wr, 136 op/s 2024-05-08T07:27:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:27 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:27:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:29 smithi070 ceph-mon[29591]: pgmap v1298: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 113 KiB/s wr, 136 op/s 2024-05-08T07:27:29.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:29 smithi172 ceph-mon[33377]: pgmap v1298: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 113 KiB/s wr, 136 op/s 2024-05-08T07:27:29.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:29 smithi194 ceph-mon[33679]: pgmap v1298: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 113 KiB/s wr, 136 op/s 2024-05-08T07:27:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:31 smithi070 ceph-mon[29591]: pgmap v1299: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 192 KiB/s wr, 146 op/s 2024-05-08T07:27:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:31 smithi172 ceph-mon[33377]: pgmap v1299: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 192 KiB/s wr, 146 op/s 2024-05-08T07:27:31.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:31 smithi194 ceph-mon[33679]: pgmap v1299: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 192 KiB/s wr, 146 op/s 2024-05-08T07:27:33.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:33 smithi070 ceph-mon[29591]: pgmap v1300: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 158 KiB/s wr, 80 op/s 2024-05-08T07:27:33.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:33 smithi172 ceph-mon[33377]: pgmap v1300: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 158 KiB/s wr, 80 op/s 2024-05-08T07:27:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:33 smithi194 ceph-mon[33679]: pgmap v1300: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 158 KiB/s wr, 80 op/s 2024-05-08T07:27:35.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:35 smithi070 ceph-mon[29591]: pgmap v1301: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 164 KiB/s wr, 90 op/s 2024-05-08T07:27:35.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:35 smithi172 ceph-mon[33377]: pgmap v1301: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 164 KiB/s wr, 90 op/s 2024-05-08T07:27:35.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:35 smithi194 ceph-mon[33679]: pgmap v1301: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 164 KiB/s wr, 90 op/s 2024-05-08T07:27:36.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:27:36.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:27:36.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:27:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:37 smithi070 ceph-mon[29591]: pgmap v1302: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 294 KiB/s wr, 226 op/s 2024-05-08T07:27:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:27:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:27:37.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:27:37.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:37 smithi172 ceph-mon[33377]: pgmap v1302: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 294 KiB/s wr, 226 op/s 2024-05-08T07:27:37.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:27:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:27:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:27:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:37 smithi194 ceph-mon[33679]: pgmap v1302: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 294 KiB/s wr, 226 op/s 2024-05-08T07:27:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:27:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:27:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:27:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:39 smithi070 ceph-mon[29591]: pgmap v1303: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 236 KiB/s wr, 194 op/s 2024-05-08T07:27:39.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:39 smithi172 ceph-mon[33377]: pgmap v1303: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 236 KiB/s wr, 194 op/s 2024-05-08T07:27:39.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:39 smithi194 ceph-mon[33679]: pgmap v1303: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 236 KiB/s wr, 194 op/s 2024-05-08T07:27:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:41 smithi070 ceph-mon[29591]: pgmap v1304: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 363 KiB/s wr, 274 op/s 2024-05-08T07:27:41.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:41 smithi172 ceph-mon[33377]: pgmap v1304: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 363 KiB/s wr, 274 op/s 2024-05-08T07:27:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:41 smithi194 ceph-mon[33679]: pgmap v1304: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 363 KiB/s wr, 274 op/s 2024-05-08T07:27:42.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:42 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:27:42.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:42 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:27:42.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:42 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:27:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:43 smithi070 ceph-mon[29591]: pgmap v1305: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 269 KiB/s wr, 257 op/s 2024-05-08T07:27:43.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:43 smithi172 ceph-mon[33377]: pgmap v1305: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 269 KiB/s wr, 257 op/s 2024-05-08T07:27:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:43 smithi194 ceph-mon[33679]: pgmap v1305: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 269 KiB/s wr, 257 op/s 2024-05-08T07:27:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:45 smithi070 ceph-mon[29591]: pgmap v1306: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 269 KiB/s wr, 250 op/s 2024-05-08T07:27:45.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:45 smithi172 ceph-mon[33377]: pgmap v1306: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 269 KiB/s wr, 250 op/s 2024-05-08T07:27:45.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:45 smithi194 ceph-mon[33679]: pgmap v1306: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 269 KiB/s wr, 250 op/s 2024-05-08T07:27:47.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:47 smithi172 ceph-mon[33377]: pgmap v1307: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 715 KiB/s wr, 257 op/s 2024-05-08T07:27:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:47 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:27:47.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:47 smithi194 ceph-mon[33679]: pgmap v1307: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 715 KiB/s wr, 257 op/s 2024-05-08T07:27:47.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:47 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:27:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:47 smithi070 ceph-mon[29591]: pgmap v1307: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 715 KiB/s wr, 257 op/s 2024-05-08T07:27:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:47 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:27:49.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:49 smithi172 ceph-mon[33377]: pgmap v1308: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 582 KiB/s wr, 117 op/s 2024-05-08T07:27:49.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:49 smithi194 ceph-mon[33679]: pgmap v1308: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 582 KiB/s wr, 117 op/s 2024-05-08T07:27:49.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:49 smithi070 ceph-mon[29591]: pgmap v1308: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 582 KiB/s wr, 117 op/s 2024-05-08T07:27:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:51 smithi172 ceph-mon[33377]: pgmap v1309: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 703 KiB/s wr, 218 op/s 2024-05-08T07:27:51.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:51 smithi194 ceph-mon[33679]: pgmap v1309: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 703 KiB/s wr, 218 op/s 2024-05-08T07:27:51.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:51 smithi070 ceph-mon[29591]: pgmap v1309: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 703 KiB/s wr, 218 op/s 2024-05-08T07:27:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:53 smithi172 ceph-mon[33377]: pgmap v1310: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 701 KiB/s wr, 163 op/s 2024-05-08T07:27:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:53 smithi194 ceph-mon[33679]: pgmap v1310: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 701 KiB/s wr, 163 op/s 2024-05-08T07:27:53.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:53 smithi070 ceph-mon[29591]: pgmap v1310: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 701 KiB/s wr, 163 op/s 2024-05-08T07:27:55.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:55 smithi172 ceph-mon[33377]: pgmap v1311: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 847 KiB/s wr, 157 op/s 2024-05-08T07:27:55.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:55 smithi194 ceph-mon[33679]: pgmap v1311: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 847 KiB/s wr, 157 op/s 2024-05-08T07:27:55.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:55 smithi070 ceph-mon[29591]: pgmap v1311: 129 pgs: 129 active+clean; 1.7 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 847 KiB/s wr, 157 op/s 2024-05-08T07:27:57.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:57 smithi172 ceph-mon[33377]: pgmap v1312: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 1.0 MiB/s wr, 177 op/s 2024-05-08T07:27:57.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:57 smithi194 ceph-mon[33679]: pgmap v1312: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 1.0 MiB/s wr, 177 op/s 2024-05-08T07:27:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:57 smithi070 ceph-mon[29591]: pgmap v1312: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 1.0 MiB/s wr, 177 op/s 2024-05-08T07:27:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:27:59 smithi172 ceph-mon[33377]: pgmap v1313: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 575 KiB/s wr, 154 op/s 2024-05-08T07:27:59.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:27:59 smithi194 ceph-mon[33679]: pgmap v1313: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 575 KiB/s wr, 154 op/s 2024-05-08T07:27:59.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:27:59 smithi070 ceph-mon[29591]: pgmap v1313: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 575 KiB/s wr, 154 op/s 2024-05-08T07:28:01.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:01 smithi194 ceph-mon[33679]: pgmap v1314: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.0 MiB/s wr, 177 op/s 2024-05-08T07:28:01.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:01 smithi070 ceph-mon[29591]: pgmap v1314: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.0 MiB/s wr, 177 op/s 2024-05-08T07:28:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:01 smithi172 ceph-mon[33377]: pgmap v1314: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.0 MiB/s wr, 177 op/s 2024-05-08T07:28:03.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:03 smithi194 ceph-mon[33679]: pgmap v1315: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 936 KiB/s wr, 77 op/s 2024-05-08T07:28:03.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:03 smithi070 ceph-mon[29591]: pgmap v1315: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 936 KiB/s wr, 77 op/s 2024-05-08T07:28:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:03 smithi172 ceph-mon[33377]: pgmap v1315: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 936 KiB/s wr, 77 op/s 2024-05-08T07:28:05.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:05 smithi194 ceph-mon[33679]: pgmap v1316: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 812 KiB/s wr, 53 op/s 2024-05-08T07:28:05.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:05 smithi070 ceph-mon[29591]: pgmap v1316: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 812 KiB/s wr, 53 op/s 2024-05-08T07:28:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:05 smithi172 ceph-mon[33377]: pgmap v1316: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 812 KiB/s wr, 53 op/s 2024-05-08T07:28:07.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:07 smithi194 ceph-mon[33679]: pgmap v1317: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1.0 MiB/s wr, 80 op/s 2024-05-08T07:28:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:07 smithi194 ceph-mon[33679]: osdmap e162: 12 total, 12 up, 12 in 2024-05-08T07:28:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:07 smithi070 ceph-mon[29591]: pgmap v1317: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1.0 MiB/s wr, 80 op/s 2024-05-08T07:28:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:07 smithi070 ceph-mon[29591]: osdmap e162: 12 total, 12 up, 12 in 2024-05-08T07:28:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:07 smithi172 ceph-mon[33377]: pgmap v1317: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 975 KiB/s rd, 1.0 MiB/s wr, 80 op/s 2024-05-08T07:28:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:07 smithi172 ceph-mon[33377]: osdmap e162: 12 total, 12 up, 12 in 2024-05-08T07:28:09.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:09 smithi194 ceph-mon[33679]: pgmap v1319: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.0 MiB/s wr, 71 op/s 2024-05-08T07:28:09.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:09 smithi070 ceph-mon[29591]: pgmap v1319: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.0 MiB/s wr, 71 op/s 2024-05-08T07:28:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:09 smithi172 ceph-mon[33377]: pgmap v1319: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.0 MiB/s wr, 71 op/s 2024-05-08T07:28:11.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:11 smithi194 ceph-mon[33679]: pgmap v1320: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 627 KiB/s wr, 121 op/s 2024-05-08T07:28:11.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:11 smithi070 ceph-mon[29591]: pgmap v1320: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 627 KiB/s wr, 121 op/s 2024-05-08T07:28:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:11 smithi172 ceph-mon[33377]: pgmap v1320: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 627 KiB/s wr, 121 op/s 2024-05-08T07:28:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:13 smithi194 ceph-mon[33679]: pgmap v1321: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 911 KiB/s wr, 138 op/s 2024-05-08T07:28:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:13 smithi194 ceph-mon[33679]: osdmap e163: 12 total, 12 up, 12 in 2024-05-08T07:28:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:13 smithi070 ceph-mon[29591]: pgmap v1321: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 911 KiB/s wr, 138 op/s 2024-05-08T07:28:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:13 smithi070 ceph-mon[29591]: osdmap e163: 12 total, 12 up, 12 in 2024-05-08T07:28:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:13 smithi172 ceph-mon[33377]: pgmap v1321: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 879 KiB/s rd, 911 KiB/s wr, 138 op/s 2024-05-08T07:28:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:13 smithi172 ceph-mon[33377]: osdmap e163: 12 total, 12 up, 12 in 2024-05-08T07:28:15.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:15 smithi194 ceph-mon[33679]: pgmap v1323: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 541 KiB/s wr, 120 op/s 2024-05-08T07:28:15.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:15 smithi070 ceph-mon[29591]: pgmap v1323: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 541 KiB/s wr, 120 op/s 2024-05-08T07:28:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:15 smithi172 ceph-mon[33377]: pgmap v1323: 129 pgs: 129 active+clean; 1.7 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 541 KiB/s wr, 120 op/s 2024-05-08T07:28:17.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:17 smithi194 ceph-mon[33679]: pgmap v1324: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 960 KiB/s wr, 125 op/s 2024-05-08T07:28:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:17 smithi070 ceph-mon[29591]: pgmap v1324: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 960 KiB/s wr, 125 op/s 2024-05-08T07:28:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:17 smithi172 ceph-mon[33377]: pgmap v1324: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 985 KiB/s rd, 960 KiB/s wr, 125 op/s 2024-05-08T07:28:19.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:19 smithi194 ceph-mon[33679]: pgmap v1325: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 933 KiB/s wr, 122 op/s 2024-05-08T07:28:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:19 smithi070 ceph-mon[29591]: pgmap v1325: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 933 KiB/s wr, 122 op/s 2024-05-08T07:28:19.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:19 smithi172 ceph-mon[33377]: pgmap v1325: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 933 KiB/s wr, 122 op/s 2024-05-08T07:28:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:21 smithi194 ceph-mon[33679]: pgmap v1326: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-05-08T07:28:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:21 smithi070 ceph-mon[29591]: pgmap v1326: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-05-08T07:28:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:21 smithi172 ceph-mon[33377]: pgmap v1326: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 67 op/s 2024-05-08T07:28:23.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:23 smithi070 ceph-mon[29591]: pgmap v1327: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.0 MiB/s wr, 51 op/s 2024-05-08T07:28:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:23 smithi172 ceph-mon[33377]: pgmap v1327: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.0 MiB/s wr, 51 op/s 2024-05-08T07:28:23.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:23 smithi194 ceph-mon[33679]: pgmap v1327: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.0 MiB/s wr, 51 op/s 2024-05-08T07:28:23.858 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.8 2024-05-08T07:28:23.859 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:28:24.319 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:28:25.521 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:25 smithi070 ceph-mon[29591]: pgmap v1328: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 954 KiB/s wr, 47 op/s 2024-05-08T07:28:25.562 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:25 smithi194 ceph-mon[33679]: pgmap v1328: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 954 KiB/s wr, 47 op/s 2024-05-08T07:28:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:25 smithi172 ceph-mon[33377]: pgmap v1328: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 875 KiB/s rd, 954 KiB/s wr, 47 op/s 2024-05-08T07:28:26.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.612+0000 7fb0d3000700 1 -- 172.21.15.70:0/978382070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 msgr2=0x7fb0cc10fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:26.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.612+0000 7fb0d3000700 1 --2- 172.21.15.70:0/978382070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 0x7fb0cc10fe70 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400b0a0 tx=0x7fb0c400b3b0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.612+0000 7fb0d3000700 1 -- 172.21.15.70:0/978382070 shutdown_connections 2024-05-08T07:28:26.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.612+0000 7fb0d3000700 1 --2- 172.21.15.70:0/978382070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 0x7fb0cc10fe70 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.612+0000 7fb0d3000700 1 --2- 172.21.15.70:0/978382070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc1045f0 0x7fb0cc1049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.612+0000 7fb0d3000700 1 --2- 172.21.15.70:0/978382070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0cc104f10 0x7fb0cc10d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.612+0000 7fb0d3000700 1 -- 172.21.15.70:0/978382070 >> 172.21.15.70:0/978382070 conn(0x7fb0cc0fddc0 msgr2=0x7fb0cc1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:28:26.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.612+0000 7fb0d3000700 1 -- 172.21.15.70:0/978382070 shutdown_connections 2024-05-08T07:28:26.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.613+0000 7fb0d3000700 1 -- 172.21.15.70:0/978382070 wait complete. 2024-05-08T07:28:26.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.613+0000 7fb0d3000700 1 Processor -- start 2024-05-08T07:28:26.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.614+0000 7fb0d3000700 1 -- start start 2024-05-08T07:28:26.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.614+0000 7fb0d3000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc1045f0 0x7fb0cc1a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.614+0000 7fb0d3000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0cc104f10 0x7fb0cc1a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.614+0000 7fb0d3000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 0x7fb0cc19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.614+0000 7fb0d3000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc1134b0 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.614+0000 7fb0d3000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc113330 con 0x7fb0cc104f10 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.614+0000 7fb0d3000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc113630 con 0x7fb0cc1045f0 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.614+0000 7fb0d2600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 0x7fb0cc19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.614+0000 7fb0d2600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 0x7fb0cc19b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60272/0 (socket says 172.21.15.70:60272) 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.615+0000 7fb0d2600700 1 -- 172.21.15.70:0/1403850955 learned_addr learned my addr 172.21.15.70:0/1403850955 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.615+0000 7fb0d1c00700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc1045f0 0x7fb0cc1a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.615+0000 7fb0d1200700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0cc104f10 0x7fb0cc1a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.615+0000 7fb0d2600700 1 -- 172.21.15.70:0/1403850955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc1045f0 msgr2=0x7fb0cc1a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.615+0000 7fb0d2600700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc1045f0 0x7fb0cc1a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.615+0000 7fb0d2600700 1 -- 172.21.15.70:0/1403850955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0cc104f10 msgr2=0x7fb0cc1a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.615+0000 7fb0d2600700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0cc104f10 0x7fb0cc1a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.615+0000 7fb0d2600700 1 -- 172.21.15.70:0/1403850955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0cc19c110 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.615+0000 7fb0d2600700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 0x7fb0cc19b9b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4004dc0 tx=0x7fb0c4004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:28:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.616+0000 7fb0ca000700 1 -- 172.21.15.70:0/1403850955 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4021020 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.616+0000 7fb0ca000700 1 -- 172.21.15.70:0/1403850955 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0c4007cf0 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.616+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0cc19c3a0 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.616+0000 7fb0ca000700 1 -- 172.21.15.70:0/1403850955 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4005370 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.616+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0cc1a86c0 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.617+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0cc06a190 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.620+0000 7fb0ca000700 1 -- 172.21.15.70:0/1403850955 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb0c4024020 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.621+0000 7fb0ca000700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0b40b2a70 0x7fb0b40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:26.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.621+0000 7fb0ca000700 1 -- 172.21.15.70:0/1403850955 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 9583+0+0 (secure 0 0 0) 0x7fb0c40e4340 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.621+0000 7fb0d1c00700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0b40b2a70 0x7fb0b40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:26.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.622+0000 7fb0d1c00700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0b40b2a70 0x7fb0b40b4f30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0005ea0 tx=0x7fb0c0005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:28:26.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.624+0000 7fb0ca000700 1 -- 172.21.15.70:0/1403850955 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb0c402b020 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.922+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0cc1a88f0 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.924+0000 7fb0ca000700 1 -- 172.21.15.70:0/1403850955 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11877 (secure 0 0 0) 0x7fb0c40ab930 con 0x7fb0cc10d9d0 2024-05-08T07:28:26.923 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:28:26.923 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:27:45.565549+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0b40b2a70 msgr2=0x7fb0b40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0b40b2a70 0x7fb0b40b4f30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0005ea0 tx=0x7fb0c0005e30 comp rx=0 tx=0).stop 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 msgr2=0x7fb0cc19b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 0x7fb0cc19b9b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4004dc0 tx=0x7fb0c4004ea0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 shutdown_connections 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0b40b2a70 0x7fb0b40b4f30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb0cc10d9d0 0x7fb0cc19b9b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0cc1045f0 0x7fb0cc1a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 --2- 172.21.15.70:0/1403850955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb0cc104f10 0x7fb0cc1a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 >> 172.21.15.70:0/1403850955 conn(0x7fb0cc0fddc0 msgr2=0x7fb0cc10fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 shutdown_connections 2024-05-08T07:28:26.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:26.928+0000 7fb0d3000700 1 -- 172.21.15.70:0/1403850955 wait complete. 2024-05-08T07:28:26.928 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 41 2024-05-08T07:28:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:27 smithi070 ceph-mon[29591]: pgmap v1329: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T07:28:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:27 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1403850955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:28:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:27 smithi172 ceph-mon[33377]: pgmap v1329: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T07:28:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:27 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1403850955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:28:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:27 smithi194 ceph-mon[33679]: pgmap v1329: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 73 op/s 2024-05-08T07:28:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:27 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1403850955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:28:27.792 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 77.8 --await-for 42.0' 2024-05-08T07:28:27.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 77.8 --await-for 42.0 2024-05-08T07:28:28.248 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:28:28.275 INFO:tasks.workunit.client.0.smithi070.stdout:# 2024-05-08T07:28:28.275 INFO:tasks.workunit.client.0.smithi070.stdout:# configuration written to .config 2024-05-08T07:28:28.275 INFO:tasks.workunit.client.0.smithi070.stdout:# 2024-05-08T07:28:28.293 INFO:tasks.workunit.client.0.smithi070.stderr:++ grep -c processor /proc/cpuinfo 2024-05-08T07:28:28.296 INFO:tasks.workunit.client.0.smithi070.stderr:+ make -j8 2024-05-08T07:28:29.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:29 smithi070 ceph-mon[29591]: pgmap v1330: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 849 KiB/s wr, 52 op/s 2024-05-08T07:28:29.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:29 smithi172 ceph-mon[33377]: pgmap v1330: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 849 KiB/s wr, 52 op/s 2024-05-08T07:28:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:29 smithi194 ceph-mon[33679]: pgmap v1330: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 849 KiB/s wr, 52 op/s 2024-05-08T07:28:30.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.488+0000 7f6408e00700 1 -- 172.21.15.70:0/2496523343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 msgr2=0x7f640410bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:30.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.488+0000 7f6408e00700 1 --2- 172.21.15.70:0/2496523343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 0x7f640410bac0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009990 tx=0x7f63f4009ca0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.488+0000 7f6408e00700 1 -- 172.21.15.70:0/2496523343 shutdown_connections 2024-05-08T07:28:30.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.488+0000 7f6408e00700 1 --2- 172.21.15.70:0/2496523343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64041060a0 0x7f64041125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.488+0000 7f6408e00700 1 --2- 172.21.15.70:0/2496523343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 0x7f640410bac0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.488+0000 7f6408e00700 1 --2- 172.21.15.70:0/2496523343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64041056e0 0x7f6404105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.488+0000 7f6408e00700 1 -- 172.21.15.70:0/2496523343 >> 172.21.15.70:0/2496523343 conn(0x7f64041011d0 msgr2=0x7f64041035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:28:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.488+0000 7f6408e00700 1 -- 172.21.15.70:0/2496523343 shutdown_connections 2024-05-08T07:28:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.489+0000 7f6408e00700 1 -- 172.21.15.70:0/2496523343 wait complete. 2024-05-08T07:28:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.490+0000 7f6408e00700 1 Processor -- start 2024-05-08T07:28:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.490+0000 7f6408e00700 1 -- start start 2024-05-08T07:28:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.490+0000 7f6408e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64041056e0 0x7f64041a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.490+0000 7f6408e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64041060a0 0x7f64041a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.490+0000 7f6408e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 0x7f640419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.490+0000 7f6408e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64041157d0 con 0x7f640410b6e0 2024-05-08T07:28:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.490+0000 7f6408e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6404115650 con 0x7f64041060a0 2024-05-08T07:28:30.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.490+0000 7f6408e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6404115950 con 0x7f64041056e0 2024-05-08T07:28:30.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6402800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 0x7f640419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6402800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 0x7f640419b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60168/0 (socket says 172.21.15.70:60168) 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6402800700 1 -- 172.21.15.70:0/856595212 learned_addr learned my addr 172.21.15.70:0/856595212 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6401e00700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64041056e0 0x7f64041a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6401400700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64041060a0 0x7f64041a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6402800700 1 -- 172.21.15.70:0/856595212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64041056e0 msgr2=0x7f64041a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6402800700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64041056e0 0x7f64041a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6402800700 1 -- 172.21.15.70:0/856595212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64041060a0 msgr2=0x7f64041a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6402800700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64041060a0 0x7f64041a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6402800700 1 -- 172.21.15.70:0/856595212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640419c110 con 0x7f640410b6e0 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.491+0000 7f6401e00700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64041056e0 0x7f64041a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.492+0000 7f6402800700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 0x7f640419b9b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f63fc007d70 tx=0x7f63fc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.492+0000 7f63faa00700 1 -- 172.21.15.70:0/856595212 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc016020 con 0x7f640410b6e0 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.492+0000 7f63faa00700 1 -- 172.21.15.70:0/856595212 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63fc00ad40 con 0x7f640410b6e0 2024-05-08T07:28:30.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.492+0000 7f6408e00700 1 -- 172.21.15.70:0/856595212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f640419c400 con 0x7f640410b6e0 2024-05-08T07:28:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.492+0000 7f63faa00700 1 -- 172.21.15.70:0/856595212 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0115e0 con 0x7f640410b6e0 2024-05-08T07:28:30.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.492+0000 7f6408e00700 1 -- 172.21.15.70:0/856595212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64041a86c0 con 0x7f640410b6e0 2024-05-08T07:28:30.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.496+0000 7f63faa00700 1 -- 172.21.15.70:0/856595212 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f63fc019020 con 0x7f640410b6e0 2024-05-08T07:28:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.497+0000 7f64136cfb80 1 Processor -- start 2024-05-08T07:28:30.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.497+0000 7f64136cfb80 1 -- start start 2024-05-08T07:28:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.497+0000 7f63faa00700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63e80b2aa0 0x7f63e80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.497+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b7a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.497+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b74520 0x5613b3b749a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.497+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b80d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.497+0000 7f64136cfb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613b3ac6bb0 con 0x5613b3b79f50 2024-05-08T07:28:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.497+0000 7f64136cfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5613b3a648f0 con 0x5613b3b74520 2024-05-08T07:28:30.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.497+0000 7f64136cfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5613b3ac2b70 con 0x5613b3b74ee0 2024-05-08T07:28:30.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f63faa00700 1 -- 172.21.15.70:0/856595212 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 9583+0+0 (secure 0 0 0) 0x7f63fc0e2990 con 0x7f640410b6e0 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f6401400700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63e80b2aa0 0x7f63e80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f6401e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b7a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f6401e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b7a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60170/0 (socket says 172.21.15.70:60170) 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f6401e00700 1 -- 172.21.15.70:0/1031419955 learned_addr learned my addr 172.21.15.70:0/1031419955 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f6402800700 1 --2- 172.21.15.70:0/1031419955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b80d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f6401e00700 1 -- 172.21.15.70:0/1031419955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 msgr2=0x5613b3b80d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f6401e00700 1 --2- 172.21.15.70:0/1031419955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b80d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f6401e00700 1 -- 172.21.15.70:0/1031419955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b74520 msgr2=0x5613b3b749a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.498+0000 7f6401e00700 1 --2- 172.21.15.70:0/1031419955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b74520 0x5613b3b749a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.499+0000 7f6401e00700 1 -- 172.21.15.70:0/1031419955 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b3a13a60 con 0x5613b3b79f50 2024-05-08T07:28:30.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.499+0000 7f6401400700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63e80b2aa0 0x7f63e80b4f60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f63f0006fd0 tx=0x7f63f0008040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:28:30.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.499+0000 7f6401e00700 1 --2- 172.21.15.70:0/1031419955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b7a330 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f63f4015000 tx=0x7f63f4003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b09d73a3a2581c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:28:30.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.499+0000 7f63ef400700 1 -- 172.21.15.70:0/1031419955 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4027070 con 0x5613b3b79f50 2024-05-08T07:28:30.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.499+0000 7f63ef400700 1 -- 172.21.15.70:0/1031419955 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63f400b850 con 0x5613b3b79f50 2024-05-08T07:28:30.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.499+0000 7f63ef400700 1 -- 172.21.15.70:0/1031419955 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4003ab0 con 0x5613b3b79f50 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.500+0000 7f64136cfb80 1 -- 172.21.15.70:0/1031419955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 msgr2=0x5613b3b7a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.500+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1031419955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b7a330 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f63f4015000 tx=0x7f63f4003680 comp rx=0 tx=0).stop 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.501+0000 7f64136cfb80 1 -- 172.21.15.70:0/1031419955 shutdown_connections 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.501+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1031419955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b80d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.501+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1031419955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b7a330 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.501+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1031419955 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b74520 0x5613b3b749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.501+0000 7f64136cfb80 1 -- 172.21.15.70:0/1031419955 >> 172.21.15.70:0/1031419955 conn(0x5613b3aa2cf0 msgr2=0x5613b3b6ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.501+0000 7f64136cfb80 1 -- 172.21.15.70:0/1031419955 shutdown_connections 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.501+0000 7f64136cfb80 1 -- 172.21.15.70:0/1031419955 wait complete. 2024-05-08T07:28:30.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.501+0000 7f64136cfb80 1 -- start start 2024-05-08T07:28:30.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.502+0000 7f64136cfb80 1 Processor -- start 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.502+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74520 0x5613b3b80900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.502+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74ee0 0x5613b3b7dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.502+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 0x5613b3b7e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.502+0000 7f64136cfb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613b3b812b0 con 0x5613b3b74ee0 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.502+0000 7f64136cfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5613b3a2ccb0 con 0x5613b3b79f50 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.502+0000 7f64136cfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5613b3b81430 con 0x5613b3b74520 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.502+0000 7f64136cfb80 10 client.0 _ll_register_callbacks cb 0x5613b3a6de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74ee0 0x5613b3b7dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74ee0 0x5613b3b7dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60176/0 (socket says 172.21.15.70:60176) 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401400700 1 -- 172.21.15.70:0/1798919492 learned_addr learned my addr 172.21.15.70:0/1798919492 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401e00700 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74520 0x5613b3b80900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6402800700 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 0x5613b3b7e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401400700 1 -- 172.21.15.70:0/1798919492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74520 msgr2=0x5613b3b80900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:28:30.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401400700 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74520 0x5613b3b80900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401400700 1 -- 172.21.15.70:0/1798919492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 msgr2=0x5613b3b7e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:28:30.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401400700 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 0x5613b3b7e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401400700 1 -- 172.21.15.70:0/1798919492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613b3a8c5b0 con 0x5613b3b74ee0 2024-05-08T07:28:30.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401e00700 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74520 0x5613b3b80900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:28:30.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f6401400700 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74ee0 0x5613b3b7dca0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f63f0006e20 tx=0x7f63f0004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33b9d3430afc1a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:28:30.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.503+0000 7f63e3e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:28:30.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.504+0000 7f63e3e00700 1 -- 172.21.15.70:0/1798919492 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0024060 con 0x5613b3b74ee0 2024-05-08T07:28:30.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.504+0000 7f63e3e00700 1 -- 172.21.15.70:0/1798919492 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 9583+0+0 (secure 0 0 0) 0x7f63f0014c50 con 0x5613b3b74ee0 2024-05-08T07:28:30.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.504+0000 7f64136cfb80 1 -- 172.21.15.70:0/1798919492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63f400b850 con 0x5613b3b74ee0 2024-05-08T07:28:30.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.504+0000 7f63e3e00700 1 -- 172.21.15.70:0/1798919492 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f63f002b050 con 0x5613b3b74ee0 2024-05-08T07:28:30.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.504+0000 7f64136cfb80 10 client.16659 fetch_fsmap learned FSMap version 41 2024-05-08T07:28:30.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.504+0000 7f64136cfb80 1 -- 172.21.15.70:0/1798919492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5613b3b8bb60 con 0x5613b3b74ee0 2024-05-08T07:28:30.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.504+0000 7f63e3e00700 1 -- 172.21.15.70:0/1798919492 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63f400b850 con 0x5613b3b74ee0 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.505+0000 7f63e3e00700 1 -- 172.21.15.70:0/1798919492 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 41) ==== 8350+0+0 (secure 0 0 0) 0x7f63f0013070 con 0x5613b3b74ee0 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.505+0000 7f64136cfb80 10 client.16659 fetch_fsmap finished waiting for FSMap version 41 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.505+0000 7f64136cfb80 10 client.16659 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.505+0000 7f64136cfb80 20 client.16659 populate_metadata read hostname 'smithi070' 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.505+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613b3b8e1a0 0x5613b3b905b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.505+0000 7f64136cfb80 4 client.16659 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.505+0000 7f64136cfb80 1 -- 172.21.15.70:0/1798919492 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613b3b41230 con 0x5613b3b8e1a0 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.506+0000 7f6401e00700 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613b3b8e1a0 0x5613b3b905b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.507+0000 7f6401e00700 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613b3b8e1a0 0x5613b3b905b0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=764cab236dbf6b0 server_cookie=d71b95ec4bb4c900 in_seq=0 out_seq=0 2024-05-08T07:28:30.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.507+0000 7f63e3e00700 10 client.16659 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f63e3e00700 1 -- 172.21.15.70:0/1798919492 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5613b3b41230 con 0x5613b3b8e1a0 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f63e3e00700 10 client.16659 handle_command_reply: tid=0 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 client.16659 shutdown 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 -- 172.21.15.70:0/1798919492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74ee0 msgr2=0x5613b3b7dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74ee0 0x5613b3b7dca0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f63f0006e20 tx=0x7f63f0004860 comp rx=0 tx=0).stop 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 -- 172.21.15.70:0/1798919492 shutdown_connections 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613b3b8e1a0 0x5613b3b905b0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 0x5613b3b7e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74520 0x5613b3b80900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 --2- 172.21.15.70:0/1798919492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74ee0 0x5613b3b7dca0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 -- 172.21.15.70:0/1798919492 >> 172.21.15.70:0/1798919492 conn(0x5613b3aa2cf0 msgr2=0x5613b3b698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f63e3e00700 0 client.16659 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:28:30.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 -- 172.21.15.70:0/1798919492 shutdown_connections 2024-05-08T07:28:30.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 1 -- 172.21.15.70:0/1798919492 wait complete. 2024-05-08T07:28:30.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.509+0000 7f64136cfb80 20 client.16659 trim_cache size 0 max 16384 2024-05-08T07:28:30.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.534+0000 7f64136cfb80 1 Processor -- start 2024-05-08T07:28:30.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.534+0000 7f64136cfb80 1 -- start start 2024-05-08T07:28:30.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b74520 0x5613b3b8a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b780e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b95ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f64136cfb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64041b3df0 con 0x5613b3b79f50 2024-05-08T07:28:30.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f64136cfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64041b1680 con 0x5613b3b74520 2024-05-08T07:28:30.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f64136cfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64041af4f0 con 0x5613b3b74ee0 2024-05-08T07:28:30.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f6402800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b95ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f6402800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b95ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60190/0 (socket says 172.21.15.70:60190) 2024-05-08T07:28:30.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f6402800700 1 -- 172.21.15.70:0/94332417 learned_addr learned my addr 172.21.15.70:0/94332417 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:28:30.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f6401400700 1 --2- 172.21.15.70:0/94332417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b780e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.535+0000 7f6401e00700 1 --2- 172.21.15.70:0/94332417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b74520 0x5613b3b8a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.536+0000 7f6402800700 1 -- 172.21.15.70:0/94332417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 msgr2=0x5613b3b780e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:28:30.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.536+0000 7f6402800700 1 --2- 172.21.15.70:0/94332417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b780e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.536+0000 7f6402800700 1 -- 172.21.15.70:0/94332417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b74520 msgr2=0x5613b3b8a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:28:30.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.536+0000 7f6402800700 1 --2- 172.21.15.70:0/94332417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b74520 0x5613b3b8a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.536+0000 7f6402800700 1 -- 172.21.15.70:0/94332417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613b3b80540 con 0x5613b3b79f50 2024-05-08T07:28:30.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.536+0000 7f6402800700 1 --2- 172.21.15.70:0/94332417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b95ec0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0a9600 tx=0x7f63fc0a9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fccb39d5358f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:28:30.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.536+0000 7f63eea00700 1 -- 172.21.15.70:0/94332417 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0b20a0 con 0x5613b3b79f50 2024-05-08T07:28:30.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.536+0000 7f63eea00700 1 -- 172.21.15.70:0/94332417 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63fc0a9410 con 0x5613b3b79f50 2024-05-08T07:28:30.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.536+0000 7f63eea00700 1 -- 172.21.15.70:0/94332417 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc019310 con 0x5613b3b79f50 2024-05-08T07:28:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.537+0000 7f64136cfb80 1 -- 172.21.15.70:0/94332417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 msgr2=0x5613b3b95ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.537+0000 7f64136cfb80 1 --2- 172.21.15.70:0/94332417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b95ec0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0a9600 tx=0x7f63fc0a9070 comp rx=0 tx=0).stop 2024-05-08T07:28:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.537+0000 7f64136cfb80 1 -- 172.21.15.70:0/94332417 shutdown_connections 2024-05-08T07:28:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.537+0000 7f64136cfb80 1 --2- 172.21.15.70:0/94332417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b79f50 0x5613b3b95ec0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.537+0000 7f64136cfb80 1 --2- 172.21.15.70:0/94332417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b74520 0x5613b3b8a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.537+0000 7f64136cfb80 1 --2- 172.21.15.70:0/94332417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b780e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.537+0000 7f64136cfb80 1 -- 172.21.15.70:0/94332417 >> 172.21.15.70:0/94332417 conn(0x5613b3aa2cf0 msgr2=0x5613b3b779d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.537+0000 7f64136cfb80 1 -- 172.21.15.70:0/94332417 shutdown_connections 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.537+0000 7f64136cfb80 1 -- 172.21.15.70:0/94332417 wait complete. 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.538+0000 7f64136cfb80 1 -- start start 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.538+0000 7f64136cfb80 1 Processor -- start 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74520 0x5613b3b83690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b83bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f64136cfb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 0x5613b3b84110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f64136cfb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64041afb40 con 0x5613b3b74520 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f64136cfb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64041b0fb0 con 0x5613b3b79f50 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f64136cfb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64041b0210 con 0x5613b3b74ee0 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f64136cfb80 10 client.0 _ll_register_callbacks cb 0x5613b3a6de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6401e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74520 0x5613b3b83690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6401e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74520 0x5613b3b83690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60196/0 (socket says 172.21.15.70:60196) 2024-05-08T07:28:30.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6401e00700 1 -- 172.21.15.70:0/3928844072 learned_addr learned my addr 172.21.15.70:0/3928844072 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:28:30.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6401400700 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b83bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6401e00700 1 -- 172.21.15.70:0/3928844072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 msgr2=0x5613b3b83bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:28:30.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6401e00700 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b83bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6402800700 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 0x5613b3b84110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6401e00700 1 -- 172.21.15.70:0/3928844072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 msgr2=0x5613b3b84110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:28:30.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6401e00700 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 0x5613b3b84110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:30.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.539+0000 7f6401e00700 1 -- 172.21.15.70:0/3928844072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613b3bf8c40 con 0x5613b3b74520 2024-05-08T07:28:30.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.540+0000 7f6401e00700 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74520 0x5613b3b83690 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009ce0 tx=0x7f63f4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2327ce2687fff1fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:28:30.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.540+0000 7f63e3e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:28:30.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.540+0000 7f63e3e00700 1 -- 172.21.15.70:0/3928844072 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f4035030 con 0x5613b3b74520 2024-05-08T07:28:30.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.540+0000 7f63e3e00700 1 -- 172.21.15.70:0/3928844072 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(163..163 src has 1..163) ==== 9583+0+0 (secure 0 0 0) 0x7f63f400bb40 con 0x5613b3b74520 2024-05-08T07:28:30.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.540+0000 7f64136cfb80 1 -- 172.21.15.70:0/3928844072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63fc0a9410 con 0x5613b3b74520 2024-05-08T07:28:30.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f63e3e00700 1 -- 172.21.15.70:0/3928844072 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f63f4042050 con 0x5613b3b74520 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f64136cfb80 10 client.16665 fetch_fsmap learned FSMap version 41 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f64136cfb80 1 -- 172.21.15.70:0/3928844072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x5613b3bf9f00 con 0x5613b3b74520 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f63e3e00700 1 -- 172.21.15.70:0/3928844072 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63fc0a9410 con 0x5613b3b74520 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f63e3e00700 1 -- 172.21.15.70:0/3928844072 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 41) ==== 8350+0+0 (secure 0 0 0) 0x7f63f40039a0 con 0x5613b3b74520 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f64136cfb80 10 client.16665 fetch_fsmap finished waiting for FSMap version 41 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f64136cfb80 10 client.16665 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f64136cfb80 20 client.16665 populate_metadata read hostname 'smithi070' 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f64136cfb80 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613b3bfa180 0x5613b3bfc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f64136cfb80 4 client.16665 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 77.8, "await_for": 42.0}] 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.541+0000 7f64136cfb80 1 -- 172.21.15.70:0/3928844072 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 77.8, "await_for": 42.0}) -- 0x5613b3ad4590 con 0x5613b3bfa180 2024-05-08T07:28:30.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.542+0000 7f6401400700 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613b3bfa180 0x5613b3bfc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:28:30.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.544+0000 7f6401400700 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613b3bfa180 0x5613b3bfc570 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c988d6044715485e server_cookie=414c3813e0bb79b6 in_seq=0 out_seq=0 2024-05-08T07:28:30.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:30.544+0000 7f63e3e00700 10 client.16665 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:28:31.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:31 smithi070 ceph-mon[29591]: pgmap v1331: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 964 KiB/s wr, 155 op/s 2024-05-08T07:28:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:31 smithi172 ceph-mon[33377]: pgmap v1331: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 964 KiB/s wr, 155 op/s 2024-05-08T07:28:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:31 smithi194 ceph-mon[33679]: pgmap v1331: 129 pgs: 129 active+clean; 1.7 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 964 KiB/s wr, 155 op/s 2024-05-08T07:28:33.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:33 smithi070 ceph-mon[29591]: pgmap v1332: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 734 KiB/s wr, 161 op/s 2024-05-08T07:28:33.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:33 smithi172 ceph-mon[33377]: pgmap v1332: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 734 KiB/s wr, 161 op/s 2024-05-08T07:28:33.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:33 smithi194 ceph-mon[33679]: pgmap v1332: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 734 KiB/s wr, 161 op/s 2024-05-08T07:28:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:35 smithi070 ceph-mon[29591]: pgmap v1333: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 789 KiB/s wr, 166 op/s 2024-05-08T07:28:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:35 smithi172 ceph-mon[33377]: pgmap v1333: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 789 KiB/s wr, 166 op/s 2024-05-08T07:28:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:35 smithi194 ceph-mon[33679]: pgmap v1333: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 789 KiB/s wr, 166 op/s 2024-05-08T07:28:37.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:37 smithi070 ceph-mon[29591]: pgmap v1334: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 806 KiB/s wr, 176 op/s 2024-05-08T07:28:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:37 smithi172 ceph-mon[33377]: pgmap v1334: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 806 KiB/s wr, 176 op/s 2024-05-08T07:28:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:37 smithi194 ceph-mon[33679]: pgmap v1334: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 806 KiB/s wr, 176 op/s 2024-05-08T07:28:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:28:38.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:28:38.751 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:28:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:39 smithi194 ceph-mon[33679]: pgmap v1335: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 408 KiB/s wr, 145 op/s 2024-05-08T07:28:39.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:39 smithi070 ceph-mon[29591]: pgmap v1335: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 408 KiB/s wr, 145 op/s 2024-05-08T07:28:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:39 smithi172 ceph-mon[33377]: pgmap v1335: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 408 KiB/s wr, 145 op/s 2024-05-08T07:28:41.499 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:41 smithi070 ceph-mon[29591]: pgmap v1336: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 409 KiB/s wr, 149 op/s 2024-05-08T07:28:41.499 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.499 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.499 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.499 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:41 smithi194 ceph-mon[33679]: pgmap v1336: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 409 KiB/s wr, 149 op/s 2024-05-08T07:28:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:41 smithi172 ceph-mon[33377]: pgmap v1336: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 409 KiB/s wr, 149 op/s 2024-05-08T07:28:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:28:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:28:42.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:28:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:28:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:28:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:28:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:43.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:43 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:28:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:43 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:28:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:43 smithi194 ceph-mon[33679]: pgmap v1337: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 295 KiB/s wr, 47 op/s 2024-05-08T07:28:43.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:43 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:28:43.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:43 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:28:43.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:43 smithi070 ceph-mon[29591]: pgmap v1337: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 295 KiB/s wr, 47 op/s 2024-05-08T07:28:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:43 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:28:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:43 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:28:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:43 smithi172 ceph-mon[33377]: pgmap v1337: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 295 KiB/s wr, 47 op/s 2024-05-08T07:28:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:45 smithi194 ceph-mon[33679]: pgmap v1338: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 114 KiB/s wr, 22 op/s 2024-05-08T07:28:45.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:45 smithi070 ceph-mon[29591]: pgmap v1338: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 114 KiB/s wr, 22 op/s 2024-05-08T07:28:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:45 smithi172 ceph-mon[33377]: pgmap v1338: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 114 KiB/s wr, 22 op/s 2024-05-08T07:28:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:47 smithi194 ceph-mon[33679]: pgmap v1339: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-05-08T07:28:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:47 smithi070 ceph-mon[29591]: pgmap v1339: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-05-08T07:28:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:47 smithi172 ceph-mon[33377]: pgmap v1339: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 45 KiB/s wr, 18 op/s 2024-05-08T07:28:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:49 smithi194 ceph-mon[33679]: pgmap v1340: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-05-08T07:28:49.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:49 smithi070 ceph-mon[29591]: pgmap v1340: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-05-08T07:28:49.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:49 smithi172 ceph-mon[33377]: pgmap v1340: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-05-08T07:28:51.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:51 smithi070 ceph-mon[29591]: pgmap v1341: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 10 op/s 2024-05-08T07:28:51.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:51.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:51 smithi172 ceph-mon[33377]: pgmap v1341: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 10 op/s 2024-05-08T07:28:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:51 smithi194 ceph-mon[33679]: pgmap v1341: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 10 op/s 2024-05-08T07:28:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.030+0000 7f63e3e00700 1 -- 172.21.15.70:0/3928844072 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5613b3ad4590 con 0x5613b3bfa180 2024-05-08T07:28:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.030+0000 7f63e3e00700 10 client.16665 handle_command_reply: tid=0 2024-05-08T07:28:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.030+0000 7f64136cfb80 1 client.16665 shutdown 2024-05-08T07:28:52.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.030+0000 7f64136cfb80 1 -- 172.21.15.70:0/3928844072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74520 msgr2=0x5613b3b83690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.030+0000 7f64136cfb80 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74520 0x5613b3b83690 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009ce0 tx=0x7f63f4005e80 comp rx=0 tx=0).stop 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f64136cfb80 1 -- 172.21.15.70:0/3928844072 shutdown_connections 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f64136cfb80 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613b3bfa180 0x5613b3bfc570 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f64136cfb80 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613b3b79f50 0x5613b3b84110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f64136cfb80 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613b3b74520 0x5613b3b83690 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f64136cfb80 1 --2- 172.21.15.70:0/3928844072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613b3b74ee0 0x5613b3b83bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f64136cfb80 1 -- 172.21.15.70:0/3928844072 >> 172.21.15.70:0/3928844072 conn(0x5613b3aa2cf0 msgr2=0x5613b3b78260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f63e3e00700 0 client.16665 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f64136cfb80 1 -- 172.21.15.70:0/3928844072 shutdown_connections 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f64136cfb80 1 -- 172.21.15.70:0/3928844072 wait complete. 2024-05-08T07:28:52.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.031+0000 7f64136cfb80 20 client.16665 trim_cache size 0 max 16384 2024-05-08T07:28:52.032 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:28:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 41, 2024-05-08T07:28:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:28:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 106, 2024-05-08T07:28:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:28:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "180850c8": { 2024-05-08T07:28:52.032 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 106, 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 77.8, 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:28:52.033 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:28:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:28:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:28:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:28:52.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:28:52.034 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:28:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 -- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63e80b2aa0 msgr2=0x7f63e80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63e80b2aa0 0x7f63e80b4f60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f63f0006fd0 tx=0x7f63f0008040 comp rx=0 tx=0).stop 2024-05-08T07:28:52.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 -- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 msgr2=0x7f640419b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:28:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 0x7f640419b9b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f63fc007d70 tx=0x7f63fc00a340 comp rx=0 tx=0).stop 2024-05-08T07:28:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 -- 172.21.15.70:0/856595212 shutdown_connections 2024-05-08T07:28:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63e80b2aa0 0x7f63e80b4f60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f640410b6e0 0x7f640419b9b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64041056e0 0x7f64041a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 --2- 172.21.15.70:0/856595212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64041060a0 0x7f64041a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:28:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.033+0000 7f6408e00700 1 -- 172.21.15.70:0/856595212 >> 172.21.15.70:0/856595212 conn(0x7f64041011d0 msgr2=0x7f6404101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:28:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.034+0000 7f6408e00700 1 -- 172.21.15.70:0/856595212 shutdown_connections 2024-05-08T07:28:52.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:28:52.034+0000 7f6408e00700 1 -- 172.21.15.70:0/856595212 wait complete. 2024-05-08T07:28:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:52 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:28:52.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:52 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:28:52.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:28:52.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:28:52.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:52 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:28:52.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:52 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:28:52.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:28:52.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:28:52.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:28:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:52 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:28:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:52 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:28:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:28:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:28:52.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:28:52.987 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '180850c8', quiesce took 29.1 seconds. Will release after: 17.8 2024-05-08T07:28:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:53 smithi070 ceph-mon[29591]: pgmap v1342: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T07:28:53.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:53 smithi172 ceph-mon[33377]: pgmap v1342: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T07:28:54.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:53 smithi194 ceph-mon[33679]: pgmap v1342: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T07:28:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:55 smithi070 ceph-mon[29591]: pgmap v1343: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T07:28:55.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:55 smithi172 ceph-mon[33377]: pgmap v1343: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T07:28:56.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:55 smithi194 ceph-mon[33679]: pgmap v1343: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T07:28:57.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:57 smithi172 ceph-mon[33377]: pgmap v1344: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:28:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:57 smithi194 ceph-mon[33679]: pgmap v1344: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:28:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:57 smithi070 ceph-mon[29591]: pgmap v1344: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:28:59.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:28:58 smithi194 ceph-mon[33679]: pgmap v1345: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T07:28:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:28:58 smithi070 ceph-mon[29591]: pgmap v1345: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T07:28:59.139 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:28:58 smithi172 ceph-mon[33377]: pgmap v1345: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T07:29:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:01 smithi070 ceph-mon[29591]: pgmap v1346: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 7 op/s 2024-05-08T07:29:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:01 smithi172 ceph-mon[33377]: pgmap v1346: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 7 op/s 2024-05-08T07:29:01.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:01 smithi194 ceph-mon[33679]: pgmap v1346: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 7 op/s 2024-05-08T07:29:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:03 smithi070 ceph-mon[29591]: pgmap v1347: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2024-05-08T07:29:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:03 smithi172 ceph-mon[33377]: pgmap v1347: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2024-05-08T07:29:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:03 smithi194 ceph-mon[33679]: pgmap v1347: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.4 KiB/s wr, 5 op/s 2024-05-08T07:29:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:05 smithi070 ceph-mon[29591]: pgmap v1348: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 6 op/s 2024-05-08T07:29:05.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:05 smithi172 ceph-mon[33377]: pgmap v1348: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 6 op/s 2024-05-08T07:29:05.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:05 smithi194 ceph-mon[33679]: pgmap v1348: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 KiB/s wr, 6 op/s 2024-05-08T07:29:07.259 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:07 smithi194 ceph-mon[33679]: pgmap v1349: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 52 KiB/s wr, 23 op/s 2024-05-08T07:29:07.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:07 smithi070 ceph-mon[29591]: pgmap v1349: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 52 KiB/s wr, 23 op/s 2024-05-08T07:29:07.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:07 smithi172 ceph-mon[33377]: pgmap v1349: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 52 KiB/s wr, 23 op/s 2024-05-08T07:29:08.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:08 smithi070 ceph-mon[29591]: osdmap e164: 12 total, 12 up, 12 in 2024-05-08T07:29:08.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:08 smithi172 ceph-mon[33377]: osdmap e164: 12 total, 12 up, 12 in 2024-05-08T07:29:08.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:08 smithi194 ceph-mon[33679]: osdmap e164: 12 total, 12 up, 12 in 2024-05-08T07:29:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:09 smithi070 ceph-mon[29591]: pgmap v1351: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-05-08T07:29:09.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:09 smithi172 ceph-mon[33377]: pgmap v1351: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-05-08T07:29:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:09 smithi194 ceph-mon[33679]: pgmap v1351: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 62 KiB/s wr, 26 op/s 2024-05-08T07:29:10.789 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:29:11.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:11 smithi070 ceph-mon[29591]: pgmap v1352: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:29:11.254 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:29:11.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:11 smithi172 ceph-mon[33377]: pgmap v1352: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:29:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:11 smithi194 ceph-mon[33679]: pgmap v1352: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:29:13.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:13 smithi070 ceph-mon[29591]: pgmap v1353: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:29:13.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:13 smithi070 ceph-mon[29591]: osdmap e165: 12 total, 12 up, 12 in 2024-05-08T07:29:13.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:13 smithi172 ceph-mon[33377]: pgmap v1353: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:29:13.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:13 smithi172 ceph-mon[33377]: osdmap e165: 12 total, 12 up, 12 in 2024-05-08T07:29:13.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:13 smithi194 ceph-mon[33679]: pgmap v1353: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:29:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:13 smithi194 ceph-mon[33679]: osdmap e165: 12 total, 12 up, 12 in 2024-05-08T07:29:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.628+0000 7fa437e00700 1 -- 172.21.15.70:0/2189335038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4300756d0 msgr2=0x7fa430075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.628+0000 7fa437e00700 1 --2- 172.21.15.70:0/2189335038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4300756d0 0x7fa430075ab0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fa424009990 tx=0x7fa424009ca0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.629+0000 7fa437e00700 1 -- 172.21.15.70:0/2189335038 shutdown_connections 2024-05-08T07:29:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.629+0000 7fa437e00700 1 --2- 172.21.15.70:0/2189335038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa43010fea0 0x7fa430112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.629+0000 7fa437e00700 1 --2- 172.21.15.70:0/2189335038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4300756d0 0x7fa430075ab0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.629+0000 7fa437e00700 1 --2- 172.21.15.70:0/2189335038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa430075ff0 0x7fa43010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.629+0000 7fa437e00700 1 -- 172.21.15.70:0/2189335038 >> 172.21.15.70:0/2189335038 conn(0x7fa43007a600 msgr2=0x7fa43007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:29:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.629+0000 7fa437e00700 1 -- 172.21.15.70:0/2189335038 shutdown_connections 2024-05-08T07:29:13.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.630+0000 7fa437e00700 1 -- 172.21.15.70:0/2189335038 wait complete. 2024-05-08T07:29:13.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.631+0000 7fa437e00700 1 Processor -- start 2024-05-08T07:29:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.631+0000 7fa437e00700 1 -- start start 2024-05-08T07:29:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.631+0000 7fa437e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4300756d0 0x7fa4301a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.631+0000 7fa437e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa430075ff0 0x7fa4301a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.631+0000 7fa437e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa43010fea0 0x7fa43019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.631+0000 7fa437e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa430115730 con 0x7fa43010fea0 2024-05-08T07:29:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.631+0000 7fa437e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301155b0 con 0x7fa4300756d0 2024-05-08T07:29:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.631+0000 7fa437e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa4301158b0 con 0x7fa430075ff0 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa435e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa43010fea0 0x7fa43019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa435e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa43010fea0 0x7fa43019baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40880/0 (socket says 172.21.15.70:40880) 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa435400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4300756d0 0x7fa4301a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa435e00700 1 -- 172.21.15.70:0/482780305 learned_addr learned my addr 172.21.15.70:0/482780305 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa434a00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa430075ff0 0x7fa4301a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa435e00700 1 -- 172.21.15.70:0/482780305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa430075ff0 msgr2=0x7fa4301a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa435e00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa430075ff0 0x7fa4301a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa435e00700 1 -- 172.21.15.70:0/482780305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4300756d0 msgr2=0x7fa4301a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa435e00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4300756d0 0x7fa4301a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.632+0000 7fa435e00700 1 -- 172.21.15.70:0/482780305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43019c250 con 0x7fa43010fea0 2024-05-08T07:29:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.633+0000 7fa435e00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa43010fea0 0x7fa43019baf0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa4280094f0 tx=0x7fa42800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:29:13.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.633+0000 7fa42e000700 1 -- 172.21.15.70:0/482780305 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428004db0 con 0x7fa43010fea0 2024-05-08T07:29:13.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.633+0000 7fa42e000700 1 -- 172.21.15.70:0/482780305 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa428009e20 con 0x7fa43010fea0 2024-05-08T07:29:13.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.633+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43019c540 con 0x7fa43010fea0 2024-05-08T07:29:13.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.633+0000 7fa42e000700 1 -- 172.21.15.70:0/482780305 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428015400 con 0x7fa43010fea0 2024-05-08T07:29:13.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.633+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4301a8800 con 0x7fa43010fea0 2024-05-08T07:29:13.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.635+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43006a190 con 0x7fa43010fea0 2024-05-08T07:29:13.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.639+0000 7fa42e000700 1 -- 172.21.15.70:0/482780305 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa428005260 con 0x7fa43010fea0 2024-05-08T07:29:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.640+0000 7fa42e000700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4180b29f0 0x7fa4180b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:13.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.640+0000 7fa42e000700 1 -- 172.21.15.70:0/482780305 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 9583+0+0 (secure 0 0 0) 0x7fa4280e2c50 con 0x7fa43010fea0 2024-05-08T07:29:13.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.641+0000 7fa435400700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4180b29f0 0x7fa4180b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:13.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.641+0000 7fa435400700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4180b29f0 0x7fa4180b4eb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098e0 tx=0x7fa424005960 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:29:13.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.643+0000 7fa42e000700 1 -- 172.21.15.70:0/482780305 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa428010070 con 0x7fa43010fea0 2024-05-08T07:29:13.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.927+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa43002e510 con 0x7fa43010fea0 2024-05-08T07:29:13.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.929+0000 7fa42e000700 1 -- 172.21.15.70:0/482780305 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11877 (secure 0 0 0) 0x7fa4280aa1b0 con 0x7fa43010fea0 2024-05-08T07:29:13.928 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:29:13.928 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:27:45.565549+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.932+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4180b29f0 msgr2=0x7fa4180b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.932+0000 7fa437e00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4180b29f0 0x7fa4180b4eb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa4240098e0 tx=0x7fa424005960 comp rx=0 tx=0).stop 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.932+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa43010fea0 msgr2=0x7fa43019baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.932+0000 7fa437e00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa43010fea0 0x7fa43019baf0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa4280094f0 tx=0x7fa42800d3b0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.933+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 shutdown_connections 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.933+0000 7fa437e00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa4180b29f0 0x7fa4180b4eb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.933+0000 7fa437e00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa43010fea0 0x7fa43019baf0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.933+0000 7fa437e00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa4300756d0 0x7fa4301a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.933+0000 7fa437e00700 1 --2- 172.21.15.70:0/482780305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa430075ff0 0x7fa4301a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.933+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 >> 172.21.15.70:0/482780305 conn(0x7fa43007a600 msgr2=0x7fa430100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:29:13.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.933+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 shutdown_connections 2024-05-08T07:29:13.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:13.933+0000 7fa437e00700 1 -- 172.21.15.70:0/482780305 wait complete. 2024-05-08T07:29:13.933 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 41 2024-05-08T07:29:14.364 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:14 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/482780305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:29:14.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:14 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/482780305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:29:14.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:14 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/482780305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:29:14.858 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 180850c8 --release --await' 2024-05-08T07:29:14.859 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 180850c8 --release --await 2024-05-08T07:29:15.297 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:29:15.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:15 smithi070 ceph-mon[29591]: pgmap v1355: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-08T07:29:15.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:15 smithi172 ceph-mon[33377]: pgmap v1355: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-08T07:29:15.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:15 smithi194 ceph-mon[33679]: pgmap v1355: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-05-08T07:29:17.312 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:17 smithi070 ceph-mon[29591]: pgmap v1356: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T07:29:17.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:17 smithi172 ceph-mon[33377]: pgmap v1356: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T07:29:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:17 smithi194 ceph-mon[33679]: pgmap v1356: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T07:29:17.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.615+0000 7f78dc800700 1 -- 172.21.15.70:0/4185908744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4109ad0 msgr2=0x7f78d4109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:17.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.615+0000 7f78dc800700 1 --2- 172.21.15.70:0/4185908744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4109ad0 0x7f78d4109f50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009990 tx=0x7f78c4009ca0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.615+0000 7f78dc800700 1 -- 172.21.15.70:0/4185908744 shutdown_connections 2024-05-08T07:29:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.615+0000 7f78dc800700 1 --2- 172.21.15.70:0/4185908744 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d410a490 0x7f78d41169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.615+0000 7f78dc800700 1 --2- 172.21.15.70:0/4185908744 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410fb60 0x7f78d410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.615+0000 7f78dc800700 1 --2- 172.21.15.70:0/4185908744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d4109ad0 0x7f78d4109f50 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.615+0000 7f78dc800700 1 -- 172.21.15.70:0/4185908744 >> 172.21.15.70:0/4185908744 conn(0x7f78d4076c70 msgr2=0x7f78d41082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:29:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.615+0000 7f78dc800700 1 -- 172.21.15.70:0/4185908744 shutdown_connections 2024-05-08T07:29:17.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.615+0000 7f78dc800700 1 -- 172.21.15.70:0/4185908744 wait complete. 2024-05-08T07:29:17.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78dc800700 1 Processor -- start 2024-05-08T07:29:17.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78dc800700 1 -- start start 2024-05-08T07:29:17.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78dc800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4109ad0 0x7f78d41a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78dc800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d410a490 0x7f78d41a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78dc800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410fb60 0x7f78d41a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78dc800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78d4119bd0 con 0x7f78d410a490 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78dc800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78d4119a50 con 0x7f78d4109ad0 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78dc800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78d4119d50 con 0x7f78d410fb60 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78d9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d410a490 0x7f78d41a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78d9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d410a490 0x7f78d41a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45072/0 (socket says 172.21.15.70:45072) 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.617+0000 7f78d9400700 1 -- 172.21.15.70:0/1884348868 learned_addr learned my addr 172.21.15.70:0/1884348868 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.618+0000 7f78d9e00700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4109ad0 0x7f78d41a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.618+0000 7f78da800700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410fb60 0x7f78d41a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.618+0000 7f78d9400700 1 -- 172.21.15.70:0/1884348868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410fb60 msgr2=0x7f78d41a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.618+0000 7f78d9400700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410fb60 0x7f78d41a49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.618+0000 7f78d9400700 1 -- 172.21.15.70:0/1884348868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4109ad0 msgr2=0x7f78d41a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.618+0000 7f78d9400700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4109ad0 0x7f78d41a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.618+0000 7f78d9400700 1 -- 172.21.15.70:0/1884348868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d41a5110 con 0x7f78d410a490 2024-05-08T07:29:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.618+0000 7f78d9400700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d410a490 0x7f78d41a0640 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f78c4000c00 tx=0x7f78c4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:29:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.618+0000 7f78cea00700 1 -- 172.21.15.70:0/1884348868 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4027070 con 0x7f78d410a490 2024-05-08T07:29:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.619+0000 7f78cea00700 1 -- 172.21.15.70:0/1884348868 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78c400fb80 con 0x7f78d410a490 2024-05-08T07:29:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.619+0000 7f78cea00700 1 -- 172.21.15.70:0/1884348868 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4022c30 con 0x7f78d410a490 2024-05-08T07:29:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.619+0000 7f78dc800700 1 -- 172.21.15.70:0/1884348868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d41a53a0 con 0x7f78d410a490 2024-05-08T07:29:17.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.619+0000 7f78dc800700 1 -- 172.21.15.70:0/1884348868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d41acc80 con 0x7f78d410a490 2024-05-08T07:29:17.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.622+0000 7f78cea00700 1 -- 172.21.15.70:0/1884348868 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f78c402a070 con 0x7f78d410a490 2024-05-08T07:29:17.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78e70a8b80 1 Processor -- start 2024-05-08T07:29:17.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78e70a8b80 1 -- start start 2024-05-08T07:29:17.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78cea00700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78bc0b2a70 0x7f78bc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac982a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 0x55c94ac92910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c94abe4b20 con 0x55c94ac92e50 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c94ab82860 con 0x55c94ac92490 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c94abe0ae0 con 0x55c94ac97ec0 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.624+0000 7f78cea00700 1 -- 172.21.15.70:0/1884348868 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 9583+0+0 (secure 0 0 0) 0x7f78c40e3970 con 0x7f78d410a490 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.625+0000 7f78da800700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78bc0b2a70 0x7f78bc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.625+0000 7f78d9e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.625+0000 7f78d9e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:50300/0 (socket says 172.21.15.70:50300) 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.625+0000 7f78d9e00700 1 -- 172.21.15.70:0/2429876368 learned_addr learned my addr 172.21.15.70:0/2429876368 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.625+0000 7f78d9400700 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 0x55c94ac92910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.625+0000 7f78da800700 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78da800700 1 -- 172.21.15.70:0/2429876368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 msgr2=0x55c94ac982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:29:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78da800700 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78da800700 1 -- 172.21.15.70:0/2429876368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 msgr2=0x55c94ac92910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:29:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78da800700 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 0x55c94ac92910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78da800700 1 -- 172.21.15.70:0/2429876368 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94ab319d0 con 0x55c94ac92e50 2024-05-08T07:29:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78d9e00700 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:29:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78d9400700 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 0x55c94ac92910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:29:17.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78da800700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78bc0b2a70 0x7f78bc0b4f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f78d00060b0 tx=0x7f78d0009c30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78da800700 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9ec80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f78d0018a40 tx=0x7f78d001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b32243e6537a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78c3400700 1 -- 172.21.15.70:0/2429876368 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d001a750 con 0x55c94ac92e50 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78c3400700 1 -- 172.21.15.70:0/2429876368 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78d0027070 con 0x55c94ac92e50 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.626+0000 7f78c3400700 1 -- 172.21.15.70:0/2429876368 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0022970 con 0x55c94ac92e50 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.627+0000 7f78e70a8b80 1 -- 172.21.15.70:0/2429876368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 msgr2=0x55c94ac9ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.627+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9ec80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f78d0018a40 tx=0x7f78d001b000 comp rx=0 tx=0).stop 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.627+0000 7f78e70a8b80 1 -- 172.21.15.70:0/2429876368 shutdown_connections 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.627+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9ec80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.627+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.627+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/2429876368 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 0x55c94ac92910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.627+0000 7f78e70a8b80 1 -- 172.21.15.70:0/2429876368 >> 172.21.15.70:0/2429876368 conn(0x55c94abc0c60 msgr2=0x55c94ac8cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.627+0000 7f78e70a8b80 1 -- 172.21.15.70:0/2429876368 shutdown_connections 2024-05-08T07:29:17.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.627+0000 7f78e70a8b80 1 -- 172.21.15.70:0/2429876368 wait complete. 2024-05-08T07:29:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.628+0000 7f78e70a8b80 1 -- start start 2024-05-08T07:29:17.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.628+0000 7f78e70a8b80 1 Processor -- start 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 0x55c94ac9e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac9c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c94ac9f220 con 0x55c94ac92e50 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c94ab4ac20 con 0x55c94ac92490 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c94ac9f3a0 con 0x55c94ac97ec0 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78e70a8b80 10 client.0 _ll_register_callbacks cb 0x55c94ab8bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78d9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78d9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45102/0 (socket says 172.21.15.70:45102) 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78d9400700 1 -- 172.21.15.70:0/3441680343 learned_addr learned my addr 172.21.15.70:0/3441680343 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.629+0000 7f78d9e00700 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 0x55c94ac9e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78da800700 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac9c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78d9400700 1 -- 172.21.15.70:0/3441680343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 msgr2=0x55c94ac9c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78d9400700 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac9c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78d9400700 1 -- 172.21.15.70:0/3441680343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 msgr2=0x55c94ac9e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78d9400700 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 0x55c94ac9e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78d9400700 1 -- 172.21.15.70:0/3441680343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c94abaa520 con 0x55c94ac92e50 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78d9400700 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9bcc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f78c40a68e0 tx=0x7f78c40aa080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ffea5dceeb58a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78b7e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78b7e00700 1 -- 172.21.15.70:0/3441680343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c40aa370 con 0x55c94ac92e50 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78b7e00700 1 -- 172.21.15.70:0/3441680343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 9583+0+0 (secure 0 0 0) 0x7f78c40b10b0 con 0x55c94ac92e50 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.630+0000 7f78e70a8b80 1 -- 172.21.15.70:0/3441680343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78d0027070 con 0x55c94ac92e50 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78b7e00700 1 -- 172.21.15.70:0/3441680343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f78c40aaf60 con 0x55c94ac92e50 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78e70a8b80 10 client.16683 fetch_fsmap learned FSMap version 41 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78e70a8b80 1 -- 172.21.15.70:0/3441680343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c94aca9b00 con 0x55c94ac92e50 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78b7e00700 1 -- 172.21.15.70:0/3441680343 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78d0027070 con 0x55c94ac92e50 2024-05-08T07:29:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78b7e00700 1 -- 172.21.15.70:0/3441680343 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 41) ==== 8350+0+0 (secure 0 0 0) 0x7f78c4085650 con 0x55c94ac92e50 2024-05-08T07:29:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78e70a8b80 10 client.16683 fetch_fsmap finished waiting for FSMap version 41 2024-05-08T07:29:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78e70a8b80 10 client.16683 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:29:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78e70a8b80 20 client.16683 populate_metadata read hostname 'smithi070' 2024-05-08T07:29:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c94acac070 0x55c94acae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78e70a8b80 4 client.16683 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:29:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.631+0000 7f78e70a8b80 1 -- 172.21.15.70:0/3441680343 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c94ac5f1a0 con 0x55c94acac070 2024-05-08T07:29:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.632+0000 7f78d9e00700 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c94acac070 0x55c94acae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.633+0000 7f78d9e00700 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c94acac070 0x55c94acae490 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c269657e216a2854 server_cookie=27ff596e3a93d01f in_seq=0 out_seq=0 2024-05-08T07:29:17.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.633+0000 7f78b7e00700 10 client.16683 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:29:17.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78b7e00700 1 -- 172.21.15.70:0/3441680343 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c94ac5f1a0 con 0x55c94acac070 2024-05-08T07:29:17.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78b7e00700 10 client.16683 handle_command_reply: tid=0 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 client.16683 shutdown 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 -- 172.21.15.70:0/3441680343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 msgr2=0x55c94ac9bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9bcc0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f78c40a68e0 tx=0x7f78c40aa080 comp rx=0 tx=0).stop 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 -- 172.21.15.70:0/3441680343 shutdown_connections 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c94acac070 0x55c94acae490 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94ac9c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac92490 0x55c94ac9e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/3441680343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94ac9bcc0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78b7e00700 0 client.16683 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 -- 172.21.15.70:0/3441680343 >> 172.21.15.70:0/3441680343 conn(0x55c94abc0c60 msgr2=0x55c94ac87850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.635+0000 7f78e70a8b80 1 -- 172.21.15.70:0/3441680343 shutdown_connections 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.636+0000 7f78e70a8b80 1 -- 172.21.15.70:0/3441680343 wait complete. 2024-05-08T07:29:17.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.636+0000 7f78e70a8b80 20 client.16683 trim_cache size 0 max 16384 2024-05-08T07:29:17.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.658+0000 7f78e70a8b80 1 Processor -- start 2024-05-08T07:29:17.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.658+0000 7f78e70a8b80 1 -- start start 2024-05-08T07:29:17.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.658+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac92490 0x55c94ac97690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.658+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94aca8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.658+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac97ec0 0x55c94ac91b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.658+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78d41b8340 con 0x55c94ac92e50 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.658+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78d41b5bd0 con 0x55c94ac97ec0 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.658+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78d41b3a40 con 0x55c94ac92490 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.658+0000 7f78d9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94aca8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78d9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94aca8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45110/0 (socket says 172.21.15.70:45110) 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78d9400700 1 -- 172.21.15.70:0/280778426 learned_addr learned my addr 172.21.15.70:0/280778426 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78d9e00700 1 --2- 172.21.15.70:0/280778426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac92490 0x55c94ac97690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78da800700 1 --2- 172.21.15.70:0/280778426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac97ec0 0x55c94ac91b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78d9400700 1 -- 172.21.15.70:0/280778426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac92490 msgr2=0x55c94ac97690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78d9400700 1 --2- 172.21.15.70:0/280778426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac92490 0x55c94ac97690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78d9400700 1 -- 172.21.15.70:0/280778426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac97ec0 msgr2=0x55c94ac91b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:29:17.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78d9400700 1 --2- 172.21.15.70:0/280778426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac97ec0 0x55c94ac91b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78d9400700 1 -- 172.21.15.70:0/280778426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94acaeb10 con 0x55c94ac92e50 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.659+0000 7f78d9400700 1 --2- 172.21.15.70:0/280778426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94aca8300 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009750 tx=0x7f78c40b30c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadde0d58e3411ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78c2a00700 1 -- 172.21.15.70:0/280778426 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c40aa860 con 0x55c94ac92e50 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78c2a00700 1 -- 172.21.15.70:0/280778426 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78c40aec10 con 0x55c94ac92e50 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78c2a00700 1 -- 172.21.15.70:0/280778426 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c40aad50 con 0x55c94ac92e50 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78e70a8b80 1 -- 172.21.15.70:0/280778426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 msgr2=0x55c94aca8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/280778426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94aca8300 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009750 tx=0x7f78c40b30c0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78e70a8b80 1 -- 172.21.15.70:0/280778426 shutdown_connections 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/280778426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94ac97ec0 0x55c94ac91b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/280778426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac92490 0x55c94ac97690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/280778426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92e50 0x55c94aca8300 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78e70a8b80 1 -- 172.21.15.70:0/280778426 >> 172.21.15.70:0/280778426 conn(0x55c94abc0c60 msgr2=0x55c94ac91480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:29:17.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.660+0000 7f78e70a8b80 1 -- 172.21.15.70:0/280778426 shutdown_connections 2024-05-08T07:29:17.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.661+0000 7f78e70a8b80 1 -- 172.21.15.70:0/280778426 wait complete. 2024-05-08T07:29:17.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.661+0000 7f78e70a8b80 1 -- start start 2024-05-08T07:29:17.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.661+0000 7f78e70a8b80 1 Processor -- start 2024-05-08T07:29:17.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92490 0x55c94aca1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94aca1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78e70a8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94aca20d0 0x55c94ad16960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78d41b4090 con 0x55c94ac92490 2024-05-08T07:29:17.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78d41b5500 con 0x55c94aca20d0 2024-05-08T07:29:17.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78e70a8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78d41b4760 con 0x55c94ac97ec0 2024-05-08T07:29:17.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78e70a8b80 10 client.0 _ll_register_callbacks cb 0x55c94ab8bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:29:17.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78d9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92490 0x55c94aca1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78d9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92490 0x55c94aca1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45118/0 (socket says 172.21.15.70:45118) 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78d9e00700 1 -- 172.21.15.70:0/473037190 learned_addr learned my addr 172.21.15.70:0/473037190 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78d9400700 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94aca1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78da800700 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94aca20d0 0x55c94ad16960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78d9e00700 1 -- 172.21.15.70:0/473037190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 msgr2=0x55c94aca1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78d9e00700 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94aca1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78d9e00700 1 -- 172.21.15.70:0/473037190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94aca20d0 msgr2=0x55c94ad16960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78d9e00700 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94aca20d0 0x55c94ad16960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.662+0000 7f78d9e00700 1 -- 172.21.15.70:0/473037190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c94ac89980 con 0x55c94ac92490 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.663+0000 7f78d9e00700 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92490 0x55c94aca1650 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f78c800bbf0 tx=0x7f78c8013880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca1ca561152334f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.663+0000 7f78b7e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.663+0000 7f78b7e00700 1 -- 172.21.15.70:0/473037190 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c8004230 con 0x55c94ac92490 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.663+0000 7f78b7e00700 1 -- 172.21.15.70:0/473037190 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(165..165 src has 1..165) ==== 9583+0+0 (secure 0 0 0) 0x7f78c80043d0 con 0x55c94ac92490 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.663+0000 7f78e70a8b80 1 -- 172.21.15.70:0/473037190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78c40aec10 con 0x55c94ac92490 2024-05-08T07:29:17.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.663+0000 7f78b7e00700 1 -- 172.21.15.70:0/473037190 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f78c802d050 con 0x55c94ac92490 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.663+0000 7f78e70a8b80 10 client.16689 fetch_fsmap learned FSMap version 41 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.663+0000 7f78e70a8b80 1 -- 172.21.15.70:0/473037190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x55c94ad18010 con 0x55c94ac92490 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.664+0000 7f78b7e00700 1 -- 172.21.15.70:0/473037190 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78c40aec10 con 0x55c94ac92490 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.664+0000 7f78b7e00700 1 -- 172.21.15.70:0/473037190 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 41) ==== 8350+0+0 (secure 0 0 0) 0x7f78c8003880 con 0x55c94ac92490 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.664+0000 7f78e70a8b80 10 client.16689 fetch_fsmap finished waiting for FSMap version 41 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.664+0000 7f78e70a8b80 10 client.16689 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.664+0000 7f78e70a8b80 20 client.16689 populate_metadata read hostname 'smithi070' 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.664+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c94ad18700 0x55c94ad1ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.664+0000 7f78e70a8b80 4 client.16689 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "180850c8", "release": true, "await": true}] 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.664+0000 7f78e70a8b80 1 -- 172.21.15.70:0/473037190 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "180850c8", "release": true, "await": true}) -- 0x55c94abf2500 con 0x55c94ad18700 2024-05-08T07:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.665+0000 7f78d9400700 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c94ad18700 0x55c94ad1ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:29:17.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.665+0000 7f78d9400700 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c94ad18700 0x55c94ad1ab20 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbfb0c3dcdd811ef server_cookie=62c856a91243356c in_seq=0 out_seq=0 2024-05-08T07:29:17.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:17.665+0000 7f78b7e00700 10 client.16689 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:29:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:19 smithi070 ceph-mon[29591]: pgmap v1357: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:29:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:19 smithi172 ceph-mon[33377]: pgmap v1357: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:29:19.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:19 smithi194 ceph-mon[33679]: pgmap v1357: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:29:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:21 smithi070 ceph-mon[29591]: pgmap v1358: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:29:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:21 smithi172 ceph-mon[33377]: pgmap v1358: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:29:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:21 smithi194 ceph-mon[33679]: pgmap v1358: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:29:22.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.089+0000 7f78b7e00700 1 -- 172.21.15.70:0/473037190 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55c94abf2500 con 0x55c94ad18700 2024-05-08T07:29:22.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.089+0000 7f78b7e00700 10 client.16689 handle_command_reply: tid=0 2024-05-08T07:29:22.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.089+0000 7f78e70a8b80 1 client.16689 shutdown 2024-05-08T07:29:22.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 -- 172.21.15.70:0/473037190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92490 msgr2=0x55c94aca1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:22.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92490 0x55c94aca1650 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f78c800bbf0 tx=0x7f78c8013880 comp rx=0 tx=0).stop 2024-05-08T07:29:22.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 -- 172.21.15.70:0/473037190 shutdown_connections 2024-05-08T07:29:22.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c94ad18700 0x55c94ad1ab20 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:22.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c94aca20d0 0x55c94ad16960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:22.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c94ac92490 0x55c94aca1650 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:22.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 --2- 172.21.15.70:0/473037190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c94ac97ec0 0x55c94aca1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:22.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78b7e00700 0 client.16689 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:29:22.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 -- 172.21.15.70:0/473037190 >> 172.21.15.70:0/473037190 conn(0x55c94abc0c60 msgr2=0x55c94ac91d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:29:22.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 -- 172.21.15.70:0/473037190 shutdown_connections 2024-05-08T07:29:22.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 1 -- 172.21.15.70:0/473037190 wait complete. 2024-05-08T07:29:22.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.090+0000 7f78e70a8b80 20 client.16689 trim_cache size 0 max 16384 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 41, 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 108, 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "180850c8": { 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 108, 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:29:22.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 77.8, 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:29:22.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.091+0000 7f78dc800700 1 -- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78bc0b2a70 msgr2=0x7f78bc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.091+0000 7f78dc800700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78bc0b2a70 0x7f78bc0b4f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f78d00060b0 tx=0x7f78d0009c30 comp rx=0 tx=0).stop 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.091+0000 7f78dc800700 1 -- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d410a490 msgr2=0x7f78d41a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.091+0000 7f78dc800700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d410a490 0x7f78d41a0640 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f78c4000c00 tx=0x7f78c4005ef0 comp rx=0 tx=0).stop 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.092+0000 7f78dc800700 1 -- 172.21.15.70:0/1884348868 shutdown_connections 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.092+0000 7f78dc800700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78bc0b2a70 0x7f78bc0b4f30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.092+0000 7f78dc800700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d410fb60 0x7f78d41a49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.092+0000 7f78dc800700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78d4109ad0 0x7f78d41a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:22.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.092+0000 7f78dc800700 1 --2- 172.21.15.70:0/1884348868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78d410a490 0x7f78d41a0640 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:29:22.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.092+0000 7f78dc800700 1 -- 172.21.15.70:0/1884348868 >> 172.21.15.70:0/1884348868 conn(0x7f78d4076c70 msgr2=0x7f78d4077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:29:22.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.092+0000 7f78dc800700 1 -- 172.21.15.70:0/1884348868 shutdown_connections 2024-05-08T07:29:22.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:29:22.092+0000 7f78dc800700 1 -- 172.21.15.70:0/1884348868 wait complete. 2024-05-08T07:29:23.078 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '180850c8', seconds elapsed: 59.2 2024-05-08T07:29:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:23 smithi070 ceph-mon[29591]: pgmap v1359: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:29:23.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:23 smithi172 ceph-mon[33377]: pgmap v1359: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:29:23.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:23 smithi194 ceph-mon[33679]: pgmap v1359: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:29:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:25 smithi070 ceph-mon[29591]: pgmap v1360: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 70 KiB/s wr, 9 op/s 2024-05-08T07:29:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:25 smithi172 ceph-mon[33377]: pgmap v1360: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 70 KiB/s wr, 9 op/s 2024-05-08T07:29:25.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:25 smithi194 ceph-mon[33679]: pgmap v1360: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 70 KiB/s wr, 9 op/s 2024-05-08T07:29:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:27 smithi172 ceph-mon[33377]: pgmap v1361: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 66 KiB/s wr, 11 op/s 2024-05-08T07:29:27.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:27 smithi194 ceph-mon[33679]: pgmap v1361: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 66 KiB/s wr, 11 op/s 2024-05-08T07:29:27.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:27 smithi070 ceph-mon[29591]: pgmap v1361: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 66 KiB/s wr, 11 op/s 2024-05-08T07:29:29.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:29 smithi172 ceph-mon[33377]: pgmap v1362: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 66 KiB/s wr, 9 op/s 2024-05-08T07:29:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:29 smithi194 ceph-mon[33679]: pgmap v1362: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 66 KiB/s wr, 9 op/s 2024-05-08T07:29:29.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:29 smithi070 ceph-mon[29591]: pgmap v1362: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 66 KiB/s wr, 9 op/s 2024-05-08T07:29:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:31 smithi172 ceph-mon[33377]: pgmap v1363: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 68 KiB/s wr, 13 op/s 2024-05-08T07:29:31.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:31 smithi194 ceph-mon[33679]: pgmap v1363: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 68 KiB/s wr, 13 op/s 2024-05-08T07:29:31.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:31 smithi070 ceph-mon[29591]: pgmap v1363: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 68 KiB/s wr, 13 op/s 2024-05-08T07:29:33.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:33 smithi172 ceph-mon[33377]: pgmap v1364: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 68 KiB/s wr, 12 op/s 2024-05-08T07:29:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:33 smithi194 ceph-mon[33679]: pgmap v1364: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 68 KiB/s wr, 12 op/s 2024-05-08T07:29:33.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:33 smithi070 ceph-mon[29591]: pgmap v1364: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 68 KiB/s wr, 12 op/s 2024-05-08T07:29:35.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:35 smithi172 ceph-mon[33377]: pgmap v1365: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 79 KiB/s wr, 13 op/s 2024-05-08T07:29:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:35 smithi194 ceph-mon[33679]: pgmap v1365: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 79 KiB/s wr, 13 op/s 2024-05-08T07:29:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:35 smithi070 ceph-mon[29591]: pgmap v1365: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 79 KiB/s wr, 13 op/s 2024-05-08T07:29:36.138 INFO:tasks.workunit.client.0.smithi070.stdout: GEN arch/x86/include/generated/asm/orc_hash.h 2024-05-08T07:29:36.139 INFO:tasks.workunit.client.0.smithi070.stdout: SYSTBL arch/x86/include/generated/asm/syscalls_32.h 2024-05-08T07:29:36.148 INFO:tasks.workunit.client.0.smithi070.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_32.h 2024-05-08T07:29:36.150 INFO:tasks.workunit.client.0.smithi070.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_x32.h 2024-05-08T07:29:36.150 INFO:tasks.workunit.client.0.smithi070.stdout: SYSHDR arch/x86/include/generated/uapi/asm/unistd_64.h 2024-05-08T07:29:36.259 INFO:tasks.workunit.client.0.smithi070.stdout: SYSHDR arch/x86/include/generated/asm/unistd_32_ia32.h 2024-05-08T07:29:36.357 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC arch/x86/tools/relocs_32.o 2024-05-08T07:29:36.429 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/bpf_perf_event.h 2024-05-08T07:29:36.464 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/errno.h 2024-05-08T07:29:36.497 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/fcntl.h 2024-05-08T07:29:36.534 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/ioctl.h 2024-05-08T07:29:36.561 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/ioctls.h 2024-05-08T07:29:36.585 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/ipcbuf.h 2024-05-08T07:29:36.590 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/param.h 2024-05-08T07:29:36.594 INFO:tasks.workunit.client.0.smithi070.stdout: SYSHDR arch/x86/include/generated/asm/unistd_64_x32.h 2024-05-08T07:29:36.615 INFO:tasks.workunit.client.0.smithi070.stdout: SYSTBL arch/x86/include/generated/asm/syscalls_64.h 2024-05-08T07:29:36.620 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/poll.h 2024-05-08T07:29:36.641 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/resource.h 2024-05-08T07:29:36.653 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/socket.h 2024-05-08T07:29:36.663 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/sockios.h 2024-05-08T07:29:36.670 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC arch/x86/tools/relocs_64.o 2024-05-08T07:29:36.695 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/termbits.h 2024-05-08T07:29:36.729 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/termios.h 2024-05-08T07:29:36.734 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC arch/x86/tools/relocs_common.o 2024-05-08T07:29:36.757 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/uapi/asm/types.h 2024-05-08T07:29:37.009 INFO:tasks.workunit.client.0.smithi070.stdout: UPD include/generated/uapi/linux/version.h 2024-05-08T07:29:37.101 INFO:tasks.workunit.client.0.smithi070.stdout: UPD include/generated/compile.h 2024-05-08T07:29:37.209 INFO:tasks.workunit.client.0.smithi070.stdout: UPD include/config/kernel.release 2024-05-08T07:29:37.315 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/kallsyms 2024-05-08T07:29:37.353 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/selinux/genheaders/genheaders 2024-05-08T07:29:37.370 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/selinux/mdp/mdp 2024-05-08T07:29:37.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:37 smithi172 ceph-mon[33377]: pgmap v1366: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-05-08T07:29:37.467 INFO:tasks.workunit.client.0.smithi070.stdout: DESCEND objtool 2024-05-08T07:29:37.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:37 smithi194 ceph-mon[33679]: pgmap v1366: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-05-08T07:29:37.535 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/early_ioremap.h 2024-05-08T07:29:37.556 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/export.h 2024-05-08T07:29:37.557 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/sorttable 2024-05-08T07:29:37.587 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/mcs_spinlock.h 2024-05-08T07:29:37.610 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/irq_regs.h 2024-05-08T07:29:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:37 smithi070 ceph-mon[29591]: pgmap v1366: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-05-08T07:29:37.634 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/kmap_size.h 2024-05-08T07:29:37.653 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/local64.h 2024-05-08T07:29:37.682 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/mmiowb.h 2024-05-08T07:29:37.700 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTLD arch/x86/tools/relocs 2024-05-08T07:29:37.703 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/module.lds.h 2024-05-08T07:29:37.724 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/rwonce.h 2024-05-08T07:29:37.745 INFO:tasks.workunit.client.0.smithi070.stdout: WRAP arch/x86/include/generated/asm/unaligned.h 2024-05-08T07:29:37.822 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/asn1_compiler 2024-05-08T07:29:37.870 INFO:tasks.workunit.client.0.smithi070.stdout: UPD include/generated/utsrelease.h 2024-05-08T07:29:39.156 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/fixdep.o 2024-05-08T07:29:39.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:39 smithi172 ceph-mon[33377]: pgmap v1367: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-05-08T07:29:39.476 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTLD /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/fixdep-in.o 2024-05-08T07:29:39.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:39 smithi194 ceph-mon[33679]: pgmap v1367: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-05-08T07:29:39.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:39 smithi070 ceph-mon[29591]: pgmap v1367: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-05-08T07:29:39.640 INFO:tasks.workunit.client.0.smithi070.stdout: LINK /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/fixdep 2024-05-08T07:29:40.180 INFO:tasks.workunit.client.0.smithi070.stdout: INSTALL /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/exec-cmd.h 2024-05-08T07:29:40.183 INFO:tasks.workunit.client.0.smithi070.stdout: INSTALL /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/help.h 2024-05-08T07:29:40.188 INFO:tasks.workunit.client.0.smithi070.stdout: INSTALL /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/pager.h 2024-05-08T07:29:40.193 INFO:tasks.workunit.client.0.smithi070.stdout: INSTALL /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/parse-options.h 2024-05-08T07:29:40.198 INFO:tasks.workunit.client.0.smithi070.stdout: INSTALL /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/include/subcmd/run-command.h 2024-05-08T07:29:40.327 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/exec-cmd.o 2024-05-08T07:29:40.337 INFO:tasks.workunit.client.0.smithi070.stdout: INSTALL libsubcmd_headers 2024-05-08T07:29:40.339 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/help.o 2024-05-08T07:29:40.349 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/pager.o 2024-05-08T07:29:40.361 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/parse-options.o 2024-05-08T07:29:40.374 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/run-command.o 2024-05-08T07:29:40.404 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/sigchain.o 2024-05-08T07:29:40.424 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/subcmd-config.o 2024-05-08T07:29:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:41 smithi172 ceph-mon[33377]: pgmap v1368: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 24 op/s 2024-05-08T07:29:41.429 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:41 smithi070 ceph-mon[29591]: pgmap v1368: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 24 op/s 2024-05-08T07:29:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:41 smithi194 ceph-mon[33679]: pgmap v1368: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 92 KiB/s wr, 24 op/s 2024-05-08T07:29:43.179 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:43 smithi070 ceph-mon[29591]: pgmap v1369: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 140 KiB/s wr, 30 op/s 2024-05-08T07:29:43.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:43 smithi194 ceph-mon[33679]: pgmap v1369: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 140 KiB/s wr, 30 op/s 2024-05-08T07:29:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:43 smithi172 ceph-mon[33377]: pgmap v1369: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 140 KiB/s wr, 30 op/s 2024-05-08T07:29:44.392 INFO:tasks.workunit.client.0.smithi070.stdout: LD /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/libsubcmd-in.o 2024-05-08T07:29:44.627 INFO:tasks.workunit.client.0.smithi070.stdout: AR /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libsubcmd/libsubcmd.a 2024-05-08T07:29:45.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:45 smithi194 ceph-mon[33679]: pgmap v1370: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 141 KiB/s wr, 32 op/s 2024-05-08T07:29:45.639 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:45 smithi070 ceph-mon[29591]: pgmap v1370: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 141 KiB/s wr, 32 op/s 2024-05-08T07:29:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:45 smithi172 ceph-mon[33377]: pgmap v1370: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 141 KiB/s wr, 32 op/s 2024-05-08T07:29:47.490 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/weak.o 2024-05-08T07:29:47.505 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/check.o 2024-05-08T07:29:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:47 smithi194 ceph-mon[33679]: pgmap v1371: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 288 KiB/s wr, 45 op/s 2024-05-08T07:29:47.520 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/special.o 2024-05-08T07:29:47.537 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/builtin-check.o 2024-05-08T07:29:47.565 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/elf.o 2024-05-08T07:29:47.590 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/objtool.o 2024-05-08T07:29:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:47 smithi070 ceph-mon[29591]: pgmap v1371: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 288 KiB/s wr, 45 op/s 2024-05-08T07:29:47.628 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/arch/x86/special.o 2024-05-08T07:29:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:47 smithi172 ceph-mon[33377]: pgmap v1371: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 288 KiB/s wr, 45 op/s 2024-05-08T07:29:49.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:49 smithi194 ceph-mon[33679]: pgmap v1372: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 288 KiB/s wr, 44 op/s 2024-05-08T07:29:49.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:49 smithi070 ceph-mon[29591]: pgmap v1372: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 288 KiB/s wr, 44 op/s 2024-05-08T07:29:49.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:49 smithi172 ceph-mon[33377]: pgmap v1372: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 288 KiB/s wr, 44 op/s 2024-05-08T07:29:50.751 INFO:tasks.workunit.client.0.smithi070.stdout: MKDIR /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/arch/x86/lib/ 2024-05-08T07:29:50.794 INFO:tasks.workunit.client.0.smithi070.stdout: GEN /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/arch/x86/lib/inat-tables.c 2024-05-08T07:29:50.893 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/orc_gen.o 2024-05-08T07:29:51.098 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/arch/x86/decode.o 2024-05-08T07:29:51.140 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/orc_dump.o 2024-05-08T07:29:51.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:51 smithi194 ceph-mon[33679]: pgmap v1373: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 432 KiB/s wr, 51 op/s 2024-05-08T07:29:51.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:51 smithi070 ceph-mon[29591]: pgmap v1373: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 432 KiB/s wr, 51 op/s 2024-05-08T07:29:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:51 smithi172 ceph-mon[33377]: pgmap v1373: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 432 KiB/s wr, 51 op/s 2024-05-08T07:29:51.745 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libstring.o 2024-05-08T07:29:51.772 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/libctype.o 2024-05-08T07:29:52.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:29:52.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:29:52.666 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/str_error_r.o 2024-05-08T07:29:52.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:29:53.084 INFO:tasks.workunit.client.0.smithi070.stdout: CC /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/librbtree.o 2024-05-08T07:29:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:53 smithi194 ceph-mon[33679]: pgmap v1374: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 436 KiB/s wr, 38 op/s 2024-05-08T07:29:53.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:53 smithi070 ceph-mon[29591]: pgmap v1374: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 436 KiB/s wr, 38 op/s 2024-05-08T07:29:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:53 smithi172 ceph-mon[33377]: pgmap v1374: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 436 KiB/s wr, 38 op/s 2024-05-08T07:29:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:29:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:29:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:29:54.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:29:54.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:29:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:29:54.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:29:54.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:29:54.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:29:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:55 smithi194 ceph-mon[33679]: pgmap v1375: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 388 KiB/s wr, 31 op/s 2024-05-08T07:29:55.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:55 smithi070 ceph-mon[29591]: pgmap v1375: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 388 KiB/s wr, 31 op/s 2024-05-08T07:29:55.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:55 smithi172 ceph-mon[33377]: pgmap v1375: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 388 KiB/s wr, 31 op/s 2024-05-08T07:29:56.136 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-05-08T07:29:56.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:29:56.592 INFO:tasks.workunit.client.0.smithi070.stdout: LD /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/arch/x86/objtool-in.o 2024-05-08T07:29:56.681 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:29:56.745 INFO:tasks.workunit.client.0.smithi070.stdout: LD /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/objtool-in.o 2024-05-08T07:29:57.169 INFO:tasks.workunit.client.0.smithi070.stdout: LINK /home/ubuntu/cephtest/mnt.0/client.0/tmp/t/linux-6.5.11/tools/objtool/objtool 2024-05-08T07:29:57.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:57 smithi070 ceph-mon[29591]: pgmap v1376: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 542 KiB/s wr, 47 op/s 2024-05-08T07:29:57.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:57 smithi194 ceph-mon[33679]: pgmap v1376: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 542 KiB/s wr, 47 op/s 2024-05-08T07:29:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:57 smithi172 ceph-mon[33377]: pgmap v1376: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 542 KiB/s wr, 47 op/s 2024-05-08T07:29:59.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:29:59 smithi194 ceph-mon[33679]: pgmap v1377: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 384 KiB/s wr, 32 op/s 2024-05-08T07:29:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:29:59 smithi070 ceph-mon[29591]: pgmap v1377: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 384 KiB/s wr, 32 op/s 2024-05-08T07:29:59.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:29:59 smithi172 ceph-mon[33377]: pgmap v1377: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 384 KiB/s wr, 32 op/s 2024-05-08T07:30:00.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T07:30:00.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T07:30:00.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T07:30:01.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:01 smithi194 ceph-mon[33679]: pgmap v1378: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 535 KiB/s wr, 43 op/s 2024-05-08T07:30:01.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:01 smithi070 ceph-mon[29591]: pgmap v1378: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 535 KiB/s wr, 43 op/s 2024-05-08T07:30:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:01 smithi172 ceph-mon[33377]: pgmap v1378: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 535 KiB/s wr, 43 op/s 2024-05-08T07:30:03.513 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:03 smithi070 ceph-mon[29591]: pgmap v1379: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 553 KiB/s wr, 40 op/s 2024-05-08T07:30:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:03 smithi172 ceph-mon[33377]: pgmap v1379: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 553 KiB/s wr, 40 op/s 2024-05-08T07:30:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:03 smithi194 ceph-mon[33679]: pgmap v1379: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 553 KiB/s wr, 40 op/s 2024-05-08T07:30:03.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.772+0000 7f8984000700 1 -- 172.21.15.70:0/2666814674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06be10 msgr2=0x7f897c06c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:03.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.772+0000 7f8984000700 1 --2- 172.21.15.70:0/2666814674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06be10 0x7f897c06c1f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f89700099c0 tx=0x7f8970009cd0 comp rx=0 tx=0).stop 2024-05-08T07:30:03.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.772+0000 7f8984000700 1 -- 172.21.15.70:0/2666814674 shutdown_connections 2024-05-08T07:30:03.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.772+0000 7f8984000700 1 --2- 172.21.15.70:0/2666814674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f897c1087c0 0x7f897c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:03.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.772+0000 7f8984000700 1 --2- 172.21.15.70:0/2666814674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06be10 0x7f897c06c1f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:03.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.772+0000 7f8984000700 1 --2- 172.21.15.70:0/2666814674 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f897c06c7c0 0x7f897c1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:03.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.772+0000 7f8984000700 1 -- 172.21.15.70:0/2666814674 >> 172.21.15.70:0/2666814674 conn(0x7f897c0783f0 msgr2=0x7f897c078800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:30:03.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.772+0000 7f8984000700 1 -- 172.21.15.70:0/2666814674 shutdown_connections 2024-05-08T07:30:03.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.772+0000 7f8984000700 1 -- 172.21.15.70:0/2666814674 wait complete. 2024-05-08T07:30:03.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.773+0000 7f8984000700 1 Processor -- start 2024-05-08T07:30:03.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8984000700 1 -- start start 2024-05-08T07:30:03.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8984000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f897c06be10 0x7f897c1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:03.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8984000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06c7c0 0x7f897c1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:03.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8984000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f897c1087c0 0x7f897c19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:03.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8984000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f897c113570 con 0x7f897c06c7c0 2024-05-08T07:30:03.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8984000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1133f0 con 0x7f897c06be10 2024-05-08T07:30:03.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8984000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f897c1136f0 con 0x7f897c1087c0 2024-05-08T07:30:03.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8980c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06c7c0 0x7f897c1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:03.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8980c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06c7c0 0x7f897c1a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:32910/0 (socket says 172.21.15.70:32910) 2024-05-08T07:30:03.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.774+0000 7f8980c00700 1 -- 172.21.15.70:0/1488153019 learned_addr learned my addr 172.21.15.70:0/1488153019 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:30:03.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.775+0000 7f8982000700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f897c1087c0 0x7f897c19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:03.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.775+0000 7f8981600700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f897c06be10 0x7f897c1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:03.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.775+0000 7f8980c00700 1 -- 172.21.15.70:0/1488153019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f897c1087c0 msgr2=0x7f897c19baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:03.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.775+0000 7f8980c00700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f897c1087c0 0x7f897c19baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:03.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.775+0000 7f8980c00700 1 -- 172.21.15.70:0/1488153019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f897c06be10 msgr2=0x7f897c1a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:03.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.775+0000 7f8980c00700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f897c06be10 0x7f897c1a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:03.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.775+0000 7f8980c00700 1 -- 172.21.15.70:0/1488153019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c19c250 con 0x7f897c06c7c0 2024-05-08T07:30:03.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.775+0000 7f8981600700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f897c06be10 0x7f897c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:30:03.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.776+0000 7f8980c00700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06c7c0 0x7f897c1a1e70 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f896800d980 tx=0x7f896800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:30:03.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.776+0000 7f897a000700 1 -- 172.21.15.70:0/1488153019 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8968017070 con 0x7f897c06c7c0 2024-05-08T07:30:03.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.776+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897c19c540 con 0x7f897c06c7c0 2024-05-08T07:30:03.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.776+0000 7f897a000700 1 -- 172.21.15.70:0/1488153019 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8968009dc0 con 0x7f897c06c7c0 2024-05-08T07:30:03.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.776+0000 7f897a000700 1 -- 172.21.15.70:0/1488153019 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896800f3c0 con 0x7f897c06c7c0 2024-05-08T07:30:03.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.776+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897c1a8800 con 0x7f897c06c7c0 2024-05-08T07:30:03.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.777+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897c06a190 con 0x7f897c06c7c0 2024-05-08T07:30:03.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.782+0000 7f897a000700 1 -- 172.21.15.70:0/1488153019 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8968009930 con 0x7f897c06c7c0 2024-05-08T07:30:03.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.784+0000 7f897a000700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89640b29f0 0x7f89640b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:03.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.784+0000 7f897a000700 1 -- 172.21.15.70:0/1488153019 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 9583+0+0 (secure 0 0 0) 0x7f89680e25b0 con 0x7f897c06c7c0 2024-05-08T07:30:03.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.784+0000 7f8981600700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89640b29f0 0x7f89640b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:03.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.785+0000 7f8981600700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89640b29f0 0x7f89640b4eb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8970000c00 tx=0x7f897001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:30:03.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:03.788+0000 7f897a000700 1 -- 172.21.15.70:0/1488153019 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f89680a9b10 con 0x7f897c06c7c0 2024-05-08T07:30:04.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.102+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f897c19cfe0 con 0x7f897c06c7c0 2024-05-08T07:30:04.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.105+0000 7f897a000700 1 -- 172.21.15.70:0/1488153019 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) ==== 94+0+11877 (secure 0 0 0) 0x7f89680a9410 con 0x7f897c06c7c0 2024-05-08T07:30:04.103 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:30:04.103 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":41,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:27:45.565549+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T07:30:04.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89640b29f0 msgr2=0x7f89640b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:04.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89640b29f0 0x7f89640b4eb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8970000c00 tx=0x7f897001a040 comp rx=0 tx=0).stop 2024-05-08T07:30:04.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06c7c0 msgr2=0x7f897c1a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:04.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06c7c0 0x7f897c1a1e70 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f896800d980 tx=0x7f896800dc90 comp rx=0 tx=0).stop 2024-05-08T07:30:04.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 shutdown_connections 2024-05-08T07:30:04.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89640b29f0 0x7f89640b4eb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:04.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f897c1087c0 0x7f897c19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:04.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f897c06be10 0x7f897c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:04.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 --2- 172.21.15.70:0/1488153019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f897c06c7c0 0x7f897c1a1e70 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:04.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.109+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 >> 172.21.15.70:0/1488153019 conn(0x7f897c0783f0 msgr2=0x7f897c10e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:30:04.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.110+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 shutdown_connections 2024-05-08T07:30:04.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:04.110+0000 7f8984000700 1 -- 172.21.15.70:0/1488153019 wait complete. 2024-05-08T07:30:04.109 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 41 2024-05-08T07:30:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:04 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1488153019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:30:04.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:04 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1488153019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:30:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:04 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1488153019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:30:05.520 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 87.8 --await-for 42.0' 2024-05-08T07:30:05.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 87.8 --await-for 42.0 2024-05-08T07:30:05.592 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:05 smithi070 ceph-mon[29591]: pgmap v1380: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 493 KiB/s wr, 41 op/s 2024-05-08T07:30:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:05 smithi172 ceph-mon[33377]: pgmap v1380: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 493 KiB/s wr, 41 op/s 2024-05-08T07:30:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:05 smithi194 ceph-mon[33679]: pgmap v1380: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 493 KiB/s wr, 41 op/s 2024-05-08T07:30:05.995 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:30:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:07 smithi070 ceph-mon[29591]: pgmap v1381: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 529 KiB/s wr, 56 op/s 2024-05-08T07:30:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:07 smithi172 ceph-mon[33377]: pgmap v1381: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 529 KiB/s wr, 56 op/s 2024-05-08T07:30:07.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:07 smithi194 ceph-mon[33679]: pgmap v1381: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 529 KiB/s wr, 56 op/s 2024-05-08T07:30:08.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:08 smithi070 ceph-mon[29591]: osdmap e166: 12 total, 12 up, 12 in 2024-05-08T07:30:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:08 smithi172 ceph-mon[33377]: osdmap e166: 12 total, 12 up, 12 in 2024-05-08T07:30:08.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:08 smithi194 ceph-mon[33679]: osdmap e166: 12 total, 12 up, 12 in 2024-05-08T07:30:08.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.902+0000 7f8910800700 1 -- 172.21.15.70:0/1649952072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8908106090 msgr2=0x7f89081125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:08.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.902+0000 7f8910800700 1 --2- 172.21.15.70:0/1649952072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8908106090 0x7f89081125a0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f890400b0a0 tx=0x7f890400b3b0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.902+0000 7f8910800700 1 -- 172.21.15.70:0/1649952072 shutdown_connections 2024-05-08T07:30:08.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.902+0000 7f8910800700 1 --2- 172.21.15.70:0/1649952072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8908106090 0x7f89081125a0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.902+0000 7f8910800700 1 --2- 172.21.15.70:0/1649952072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f890810b6d0 0x7f890810bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.902+0000 7f8910800700 1 --2- 172.21.15.70:0/1649952072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89081056d0 0x7f8908105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.902+0000 7f8910800700 1 -- 172.21.15.70:0/1649952072 >> 172.21.15.70:0/1649952072 conn(0x7f89081011c0 msgr2=0x7f89081035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:30:08.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.902+0000 7f8910800700 1 -- 172.21.15.70:0/1649952072 shutdown_connections 2024-05-08T07:30:08.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.902+0000 7f8910800700 1 -- 172.21.15.70:0/1649952072 wait complete. 2024-05-08T07:30:08.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.903+0000 7f8910800700 1 Processor -- start 2024-05-08T07:30:08.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f8910800700 1 -- start start 2024-05-08T07:30:08.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f8910800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89081056d0 0x7f89081a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f8910800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8908106090 0x7f89081a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f8910800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f890810b6d0 0x7f890819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f8910800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89081157d0 con 0x7f890810b6d0 2024-05-08T07:30:08.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f8910800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8908115650 con 0x7f8908106090 2024-05-08T07:30:08.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f8910800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8908115950 con 0x7f89081056d0 2024-05-08T07:30:08.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f890e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f890810b6d0 0x7f890819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f890e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f890810b6d0 0x7f890819ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53250/0 (socket says 172.21.15.70:53250) 2024-05-08T07:30:08.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.904+0000 7f890e800700 1 -- 172.21.15.70:0/2006291220 learned_addr learned my addr 172.21.15.70:0/2006291220 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:30:08.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.905+0000 7f890de00700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89081056d0 0x7f89081a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.905+0000 7f890d400700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8908106090 0x7f89081a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.905+0000 7f890e800700 1 -- 172.21.15.70:0/2006291220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89081056d0 msgr2=0x7f89081a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.905+0000 7f890e800700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89081056d0 0x7f89081a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.905+0000 7f890e800700 1 -- 172.21.15.70:0/2006291220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8908106090 msgr2=0x7f89081a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.905+0000 7f890e800700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8908106090 0x7f89081a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.905+0000 7f890e800700 1 -- 172.21.15.70:0/2006291220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890819c1b0 con 0x7f890810b6d0 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.905+0000 7f890e800700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f890810b6d0 0x7f890819ba50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f890400b070 tx=0x7f8904004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.906+0000 7f8902a00700 1 -- 172.21.15.70:0/2006291220 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904021070 con 0x7f890810b6d0 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.906+0000 7f8902a00700 1 -- 172.21.15.70:0/2006291220 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8904007b80 con 0x7f890810b6d0 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.906+0000 7f8902a00700 1 -- 172.21.15.70:0/2006291220 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904004770 con 0x7f890810b6d0 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.906+0000 7f8910800700 1 -- 172.21.15.70:0/2006291220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890819c440 con 0x7f890810b6d0 2024-05-08T07:30:08.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.906+0000 7f8910800700 1 -- 172.21.15.70:0/2006291220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89081a8760 con 0x7f890810b6d0 2024-05-08T07:30:08.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.911+0000 7f8902a00700 1 -- 172.21.15.70:0/2006291220 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8904003a00 con 0x7f890810b6d0 2024-05-08T07:30:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.912+0000 7f891b140b80 1 Processor -- start 2024-05-08T07:30:08.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.913+0000 7f891b140b80 1 -- start start 2024-05-08T07:30:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.913+0000 7f8902a00700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f88f00b2b20 0x7f88f00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.913+0000 7f891b140b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd584330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.913+0000 7f891b140b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd57e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.913+0000 7f891b140b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd58ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.913+0000 7f8902a00700 1 -- 172.21.15.70:0/2006291220 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 9671+0+0 (secure 0 0 0) 0x7f89040e3a80 con 0x7f890810b6d0 2024-05-08T07:30:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.913+0000 7f891b140b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564bfd4d0bb0 con 0x564bfd583f50 2024-05-08T07:30:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.913+0000 7f891b140b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564bfd46e8f0 con 0x564bfd57e520 2024-05-08T07:30:08.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.913+0000 7f891b140b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564bfd4ccb70 con 0x564bfd57eee0 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd584330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd584330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53258/0 (socket says 172.21.15.70:53258) 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890de00700 1 -- 172.21.15.70:0/1702166424 learned_addr learned my addr 172.21.15.70:0/1702166424 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890d400700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f88f00b2b20 0x7f88f00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890e800700 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd58ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890de00700 1 -- 172.21.15.70:0/1702166424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 msgr2=0x564bfd58ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890de00700 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd58ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890d400700 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd57e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890de00700 1 -- 172.21.15.70:0/1702166424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 msgr2=0x564bfd57e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890de00700 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd57e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.914+0000 7f890de00700 1 -- 172.21.15.70:0/1702166424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bfd41da60 con 0x564bfd583f50 2024-05-08T07:30:08.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.915+0000 7f890d400700 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd57e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:30:08.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.915+0000 7f890de00700 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd584330 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009c90 tx=0x7f88fc0103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ab1f094c59396f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:30:08.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.915+0000 7f890d400700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f88f00b2b20 0x7f88f00b4fe0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f890810ac20 tx=0x7f88f80136e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:30:08.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.915+0000 7f88f7400700 1 -- 172.21.15.70:0/1702166424 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc010c40 con 0x564bfd583f50 2024-05-08T07:30:08.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.915+0000 7f88f7400700 1 -- 172.21.15.70:0/1702166424 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88fc010de0 con 0x564bfd583f50 2024-05-08T07:30:08.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.915+0000 7f88f7400700 1 -- 172.21.15.70:0/1702166424 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc0116a0 con 0x564bfd583f50 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.916+0000 7f891b140b80 1 -- 172.21.15.70:0/1702166424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 msgr2=0x564bfd584330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.916+0000 7f891b140b80 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd584330 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f88fc009c90 tx=0x7f88fc0103d0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.916+0000 7f891b140b80 1 -- 172.21.15.70:0/1702166424 shutdown_connections 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.916+0000 7f891b140b80 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd58ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.916+0000 7f891b140b80 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd584330 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.916+0000 7f891b140b80 1 --2- 172.21.15.70:0/1702166424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd57e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.916+0000 7f891b140b80 1 -- 172.21.15.70:0/1702166424 >> 172.21.15.70:0/1702166424 conn(0x564bfd4accf0 msgr2=0x564bfd578e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.917+0000 7f891b140b80 1 -- 172.21.15.70:0/1702166424 shutdown_connections 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.917+0000 7f891b140b80 1 -- 172.21.15.70:0/1702166424 wait complete. 2024-05-08T07:30:08.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.917+0000 7f891b140b80 1 -- start start 2024-05-08T07:30:08.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f891b140b80 1 Processor -- start 2024-05-08T07:30:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f891b140b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f891b140b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57eee0 0x564bfd587c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f891b140b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd583f50 0x564bfd5881c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f891b140b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564bfd58b310 con 0x564bfd57e520 2024-05-08T07:30:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f891b140b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564bfd436cb0 con 0x564bfd57eee0 2024-05-08T07:30:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f891b140b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564bfd58b490 con 0x564bfd583f50 2024-05-08T07:30:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f891b140b80 10 client.0 _ll_register_callbacks cb 0x564bfd477e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f890de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f890de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53260/0 (socket says 172.21.15.70:53260) 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.918+0000 7f890de00700 1 -- 172.21.15.70:0/1508511932 learned_addr learned my addr 172.21.15.70:0/1508511932 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.919+0000 7f890e800700 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd583f50 0x564bfd5881c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.919+0000 7f890d400700 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57eee0 0x564bfd587c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.919+0000 7f890de00700 1 -- 172.21.15.70:0/1508511932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd583f50 msgr2=0x564bfd5881c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.919+0000 7f890de00700 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd583f50 0x564bfd5881c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.919+0000 7f890de00700 1 -- 172.21.15.70:0/1508511932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57eee0 msgr2=0x564bfd587c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.919+0000 7f890de00700 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57eee0 0x564bfd587c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.919+0000 7f890de00700 1 -- 172.21.15.70:0/1508511932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bfd4965b0 con 0x564bfd57e520 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.919+0000 7f890de00700 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58a8e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f88fc005e10 tx=0x7f88fc004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fba0028d9da6fa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.919+0000 7f88ebe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.920+0000 7f88ebe00700 1 -- 172.21.15.70:0/1508511932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc01de60 con 0x564bfd57e520 2024-05-08T07:30:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.920+0000 7f88ebe00700 1 -- 172.21.15.70:0/1508511932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 9671+0+0 (secure 0 0 0) 0x7f88fc005520 con 0x564bfd57e520 2024-05-08T07:30:08.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.920+0000 7f891b140b80 1 -- 172.21.15.70:0/1508511932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88fc010de0 con 0x564bfd57e520 2024-05-08T07:30:08.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.920+0000 7f88ebe00700 1 -- 172.21.15.70:0/1508511932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f88fc004750 con 0x564bfd57e520 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.920+0000 7f891b140b80 10 client.16707 fetch_fsmap learned FSMap version 41 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.920+0000 7f891b140b80 1 -- 172.21.15.70:0/1508511932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x564bfd595a40 con 0x564bfd57e520 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.920+0000 7f88ebe00700 1 -- 172.21.15.70:0/1508511932 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88fc010de0 con 0x564bfd57e520 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.921+0000 7f88ebe00700 1 -- 172.21.15.70:0/1508511932 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 41) ==== 8350+0+0 (secure 0 0 0) 0x7f88fc024070 con 0x564bfd57e520 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.921+0000 7f891b140b80 10 client.16707 fetch_fsmap finished waiting for FSMap version 41 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.921+0000 7f891b140b80 10 client.16707 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.921+0000 7f891b140b80 20 client.16707 populate_metadata read hostname 'smithi070' 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.921+0000 7f891b140b80 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564bfd597f70 0x564bfd59a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.921+0000 7f891b140b80 4 client.16707 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.921+0000 7f891b140b80 1 -- 172.21.15.70:0/1508511932 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bfd54b230 con 0x564bfd597f70 2024-05-08T07:30:08.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.921+0000 7f890d400700 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564bfd597f70 0x564bfd59a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.922+0000 7f890d400700 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564bfd597f70 0x564bfd59a360 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ff5ca25c37fac7c server_cookie=a549322c3bd7bb73 in_seq=0 out_seq=0 2024-05-08T07:30:08.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.922+0000 7f88ebe00700 10 client.16707 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:30:08.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f88ebe00700 1 -- 172.21.15.70:0/1508511932 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564bfd54b230 con 0x564bfd597f70 2024-05-08T07:30:08.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f88ebe00700 10 client.16707 handle_command_reply: tid=0 2024-05-08T07:30:08.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 client.16707 shutdown 2024-05-08T07:30:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 -- 172.21.15.70:0/1508511932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 msgr2=0x564bfd58a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58a8e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f88fc005e10 tx=0x7f88fc004410 comp rx=0 tx=0).stop 2024-05-08T07:30:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 -- 172.21.15.70:0/1508511932 shutdown_connections 2024-05-08T07:30:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564bfd597f70 0x564bfd59a360 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd583f50 0x564bfd5881c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58a8e0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 --2- 172.21.15.70:0/1508511932 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57eee0 0x564bfd587c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f88ebe00700 0 client.16707 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:30:08.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 -- 172.21.15.70:0/1508511932 >> 172.21.15.70:0/1508511932 conn(0x564bfd4accf0 msgr2=0x564bfd5738e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:30:08.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 -- 172.21.15.70:0/1508511932 shutdown_connections 2024-05-08T07:30:08.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.925+0000 7f891b140b80 1 -- 172.21.15.70:0/1508511932 wait complete. 2024-05-08T07:30:08.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.926+0000 7f891b140b80 20 client.16707 trim_cache size 0 max 16384 2024-05-08T07:30:08.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.950+0000 7f891b140b80 1 Processor -- start 2024-05-08T07:30:08.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.950+0000 7f891b140b80 1 -- start start 2024-05-08T07:30:08.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.950+0000 7f891b140b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd594360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.950+0000 7f891b140b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd589a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.950+0000 7f891b140b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd59fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f891b140b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89081b3fd0 con 0x564bfd583f50 2024-05-08T07:30:08.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f891b140b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89081b1860 con 0x564bfd57e520 2024-05-08T07:30:08.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f891b140b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f89081af6d0 con 0x564bfd57eee0 2024-05-08T07:30:08.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f890e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd59fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f890e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd59fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53264/0 (socket says 172.21.15.70:53264) 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f890e800700 1 -- 172.21.15.70:0/4037870827 learned_addr learned my addr 172.21.15.70:0/4037870827 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f890d400700 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd589a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f890de00700 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd594360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f890e800700 1 -- 172.21.15.70:0/4037870827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 msgr2=0x564bfd589a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f890e800700 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd589a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.951+0000 7f890e800700 1 -- 172.21.15.70:0/4037870827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 msgr2=0x564bfd594360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.952+0000 7f890e800700 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd594360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.952+0000 7f890e800700 1 -- 172.21.15.70:0/4037870827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bfd583b90 con 0x564bfd583f50 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.952+0000 7f890de00700 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd594360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:30:08.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.952+0000 7f890e800700 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd59fbe0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f89040e0d50 tx=0x7f89040b3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7d2b80e773614e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:30:08.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.952+0000 7f88f6a00700 1 -- 172.21.15.70:0/4037870827 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890402a030 con 0x564bfd583f50 2024-05-08T07:30:08.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.952+0000 7f88f6a00700 1 -- 172.21.15.70:0/4037870827 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89040afe50 con 0x564bfd583f50 2024-05-08T07:30:08.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.952+0000 7f88f6a00700 1 -- 172.21.15.70:0/4037870827 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904009ca0 con 0x564bfd583f50 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.953+0000 7f891b140b80 1 -- 172.21.15.70:0/4037870827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 msgr2=0x564bfd59fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.953+0000 7f891b140b80 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd59fbe0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f89040e0d50 tx=0x7f89040b3040 comp rx=0 tx=0).stop 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.953+0000 7f891b140b80 1 -- 172.21.15.70:0/4037870827 shutdown_connections 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.953+0000 7f891b140b80 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd583f50 0x564bfd59fbe0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.953+0000 7f891b140b80 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd57e520 0x564bfd594360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.953+0000 7f891b140b80 1 --2- 172.21.15.70:0/4037870827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd589a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.953+0000 7f891b140b80 1 -- 172.21.15.70:0/4037870827 >> 172.21.15.70:0/4037870827 conn(0x564bfd4accf0 msgr2=0x564bfd589330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.953+0000 7f891b140b80 1 -- 172.21.15.70:0/4037870827 shutdown_connections 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.953+0000 7f891b140b80 1 -- 172.21.15.70:0/4037870827 wait complete. 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.954+0000 7f891b140b80 1 -- start start 2024-05-08T07:30:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.954+0000 7f891b140b80 1 Processor -- start 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f891b140b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f891b140b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd58dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f891b140b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd583f50 0x564bfd58e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f891b140b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89081afd20 con 0x564bfd57e520 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f891b140b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89081b1190 con 0x564bfd583f50 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f891b140b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f89081b03f0 con 0x564bfd57eee0 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f891b140b80 10 client.0 _ll_register_callbacks cb 0x564bfd477e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f890de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f890de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53266/0 (socket says 172.21.15.70:53266) 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f890de00700 1 -- 172.21.15.70:0/1896615554 learned_addr learned my addr 172.21.15.70:0/1896615554 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:30:08.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f890d400700 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd58dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f890de00700 1 -- 172.21.15.70:0/1896615554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 msgr2=0x564bfd58dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f890de00700 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd58dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f890e800700 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd583f50 0x564bfd58e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f890de00700 1 -- 172.21.15.70:0/1896615554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd583f50 msgr2=0x564bfd58e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.955+0000 7f890de00700 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd583f50 0x564bfd58e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.956+0000 7f890de00700 1 -- 172.21.15.70:0/1896615554 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bfd6028d0 con 0x564bfd57e520 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.956+0000 7f890de00700 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58d6b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0098c0 tx=0x7f88fc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f84e9c40023ce8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.956+0000 7f88ebe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.956+0000 7f88ebe00700 1 -- 172.21.15.70:0/1896615554 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88fc01c680 con 0x564bfd57e520 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.956+0000 7f891b140b80 1 -- 172.21.15.70:0/1896615554 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89040afe50 con 0x564bfd57e520 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.956+0000 7f88ebe00700 1 -- 172.21.15.70:0/1896615554 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(166..166 src has 1..166) ==== 9671+0+0 (secure 0 0 0) 0x7f88fc0039d0 con 0x564bfd57e520 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.956+0000 7f88ebe00700 1 -- 172.21.15.70:0/1896615554 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f88fc01c820 con 0x564bfd57e520 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f891b140b80 10 client.16713 fetch_fsmap learned FSMap version 41 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f891b140b80 1 -- 172.21.15.70:0/1896615554 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x564bfd603ac0 con 0x564bfd57e520 2024-05-08T07:30:08.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f88ebe00700 1 -- 172.21.15.70:0/1896615554 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89040afe50 con 0x564bfd57e520 2024-05-08T07:30:08.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f88ebe00700 1 -- 172.21.15.70:0/1896615554 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 41) ==== 8350+0+0 (secure 0 0 0) 0x7f88fc024040 con 0x564bfd57e520 2024-05-08T07:30:08.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f891b140b80 10 client.16713 fetch_fsmap finished waiting for FSMap version 41 2024-05-08T07:30:08.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f891b140b80 10 client.16713 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:30:08.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f891b140b80 20 client.16713 populate_metadata read hostname 'smithi070' 2024-05-08T07:30:08.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f891b140b80 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564bfd6040a0 0x564bfd606490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:30:08.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f891b140b80 4 client.16713 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.8, "await_for": 42.0}] 2024-05-08T07:30:08.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.957+0000 7f891b140b80 1 -- 172.21.15.70:0/1896615554 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.8, "await_for": 42.0}) -- 0x564bfd579370 con 0x564bfd6040a0 2024-05-08T07:30:08.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.958+0000 7f890d400700 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564bfd6040a0 0x564bfd606490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:30:08.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.959+0000 7f890d400700 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564bfd6040a0 0x564bfd606490 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64062fc81468a36 server_cookie=324f9428c3d285c2 in_seq=0 out_seq=0 2024-05-08T07:30:08.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:08.959+0000 7f88ebe00700 10 client.16713 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:30:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:09 smithi070 ceph-mon[29591]: pgmap v1383: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 448 KiB/s wr, 44 op/s 2024-05-08T07:30:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:09 smithi172 ceph-mon[33377]: pgmap v1383: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 448 KiB/s wr, 44 op/s 2024-05-08T07:30:09.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:09 smithi194 ceph-mon[33679]: pgmap v1383: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 448 KiB/s wr, 44 op/s 2024-05-08T07:30:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:11 smithi070 ceph-mon[29591]: pgmap v1384: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 272 KiB/s wr, 36 op/s 2024-05-08T07:30:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:11 smithi172 ceph-mon[33377]: pgmap v1384: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 272 KiB/s wr, 36 op/s 2024-05-08T07:30:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:11 smithi194 ceph-mon[33679]: pgmap v1384: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 272 KiB/s wr, 36 op/s 2024-05-08T07:30:13.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:13 smithi070 ceph-mon[29591]: pgmap v1385: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 KiB/s wr, 31 op/s 2024-05-08T07:30:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:13 smithi070 ceph-mon[29591]: osdmap e167: 12 total, 12 up, 12 in 2024-05-08T07:30:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:13 smithi172 ceph-mon[33377]: pgmap v1385: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 KiB/s wr, 31 op/s 2024-05-08T07:30:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:13 smithi172 ceph-mon[33377]: osdmap e167: 12 total, 12 up, 12 in 2024-05-08T07:30:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:13 smithi194 ceph-mon[33679]: pgmap v1385: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 91 KiB/s wr, 31 op/s 2024-05-08T07:30:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:13 smithi194 ceph-mon[33679]: osdmap e167: 12 total, 12 up, 12 in 2024-05-08T07:30:15.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:15 smithi070 ceph-mon[29591]: pgmap v1387: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-05-08T07:30:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:15 smithi172 ceph-mon[33377]: pgmap v1387: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-05-08T07:30:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:15 smithi194 ceph-mon[33679]: pgmap v1387: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-05-08T07:30:17.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:17 smithi070 ceph-mon[29591]: pgmap v1388: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 10 op/s 2024-05-08T07:30:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:17 smithi172 ceph-mon[33377]: pgmap v1388: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 10 op/s 2024-05-08T07:30:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:17 smithi194 ceph-mon[33679]: pgmap v1388: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 10 op/s 2024-05-08T07:30:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:19 smithi070 ceph-mon[29591]: pgmap v1389: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-08T07:30:19.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:19 smithi172 ceph-mon[33377]: pgmap v1389: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-08T07:30:19.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:19 smithi194 ceph-mon[33679]: pgmap v1389: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-08T07:30:21.615 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:21 smithi070 ceph-mon[29591]: pgmap v1390: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-05-08T07:30:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:21 smithi172 ceph-mon[33377]: pgmap v1390: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-05-08T07:30:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:21 smithi194 ceph-mon[33679]: pgmap v1390: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-05-08T07:30:23.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:23 smithi070 ceph-mon[29591]: pgmap v1391: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-05-08T07:30:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:23 smithi172 ceph-mon[33377]: pgmap v1391: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-05-08T07:30:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:23 smithi194 ceph-mon[33679]: pgmap v1391: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-05-08T07:30:25.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:25 smithi070 ceph-mon[29591]: pgmap v1392: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T07:30:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:25 smithi172 ceph-mon[33377]: pgmap v1392: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T07:30:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:25 smithi194 ceph-mon[33679]: pgmap v1392: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T07:30:27.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:27 smithi070 ceph-mon[29591]: pgmap v1393: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-05-08T07:30:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:27 smithi172 ceph-mon[33377]: pgmap v1393: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-05-08T07:30:27.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:27 smithi194 ceph-mon[33679]: pgmap v1393: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-05-08T07:30:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:29 smithi070 ceph-mon[29591]: pgmap v1394: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:30:29.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:29 smithi172 ceph-mon[33377]: pgmap v1394: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:30:29.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:29 smithi194 ceph-mon[33679]: pgmap v1394: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:30:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:31 smithi172 ceph-mon[33377]: pgmap v1395: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T07:30:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:31 smithi194 ceph-mon[33679]: pgmap v1395: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T07:30:31.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:31 smithi070 ceph-mon[29591]: pgmap v1395: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T07:30:33.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:33 smithi172 ceph-mon[33377]: pgmap v1396: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:30:33.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:33 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:30:33.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:33 smithi194 ceph-mon[33679]: pgmap v1396: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:30:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:33 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:30:33.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:33 smithi070 ceph-mon[29591]: pgmap v1396: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:30:33.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:33 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T07:30:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:35 smithi172 ceph-mon[33377]: pgmap v1397: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-05-08T07:30:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:35 smithi194 ceph-mon[33679]: pgmap v1397: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-05-08T07:30:35.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:35 smithi070 ceph-mon[29591]: pgmap v1397: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 6 op/s 2024-05-08T07:30:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:37 smithi172 ceph-mon[33377]: pgmap v1398: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T07:30:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:37 smithi194 ceph-mon[33679]: pgmap v1398: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T07:30:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:37 smithi070 ceph-mon[29591]: pgmap v1398: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T07:30:38.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.079+0000 7f88ebe00700 1 -- 172.21.15.70:0/1896615554 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x564bfd579370 con 0x564bfd6040a0 2024-05-08T07:30:38.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.079+0000 7f88ebe00700 10 client.16713 handle_command_reply: tid=0 2024-05-08T07:30:38.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.079+0000 7f891b140b80 1 client.16713 shutdown 2024-05-08T07:30:38.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.080+0000 7f891b140b80 1 -- 172.21.15.70:0/1896615554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 msgr2=0x564bfd58d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:38.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.080+0000 7f891b140b80 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58d6b0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0098c0 tx=0x7f88fc0095c0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.080+0000 7f891b140b80 1 -- 172.21.15.70:0/1896615554 shutdown_connections 2024-05-08T07:30:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.080+0000 7f891b140b80 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564bfd6040a0 0x564bfd606490 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.080+0000 7f891b140b80 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564bfd583f50 0x564bfd58e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.080+0000 7f891b140b80 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564bfd57e520 0x564bfd58d6b0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.080+0000 7f891b140b80 1 --2- 172.21.15.70:0/1896615554 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564bfd57eee0 0x564bfd58dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.080+0000 7f88ebe00700 0 client.16713 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:30:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.080+0000 7f891b140b80 1 -- 172.21.15.70:0/1896615554 >> 172.21.15.70:0/1896615554 conn(0x564bfd4accf0 msgr2=0x564bfd57dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:30:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.081+0000 7f891b140b80 1 -- 172.21.15.70:0/1896615554 shutdown_connections 2024-05-08T07:30:38.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.081+0000 7f891b140b80 1 -- 172.21.15.70:0/1896615554 wait complete. 2024-05-08T07:30:38.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.081+0000 7f891b140b80 20 client.16713 trim_cache size 0 max 16384 2024-05-08T07:30:38.080 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:30:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:30:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:30:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 110, 2024-05-08T07:30:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:30:38.080 INFO:teuthology.orchestra.run.smithi070.stdout: "9102f729": { 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 110, 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.8, 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:30:38.081 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:30:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:30:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:30:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:30:38.082 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:30:38.082 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:30:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.082+0000 7f8910800700 1 -- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f88f00b2b20 msgr2=0x7f88f00b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.082+0000 7f8910800700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f88f00b2b20 0x7f88f00b4fe0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f890810ac20 tx=0x7f88f80136e0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.082+0000 7f8910800700 1 -- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f890810b6d0 msgr2=0x7f890819ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.082+0000 7f8910800700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f890810b6d0 0x7f890819ba50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f890400b070 tx=0x7f8904004d10 comp rx=0 tx=0).stop 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.083+0000 7f8910800700 1 -- 172.21.15.70:0/2006291220 shutdown_connections 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.083+0000 7f8910800700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f88f00b2b20 0x7f88f00b4fe0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.083+0000 7f8910800700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f890810b6d0 0x7f890819ba50 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.083+0000 7f8910800700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89081056d0 0x7f89081a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.083+0000 7f8910800700 1 --2- 172.21.15.70:0/2006291220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8908106090 0x7f89081a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.083+0000 7f8910800700 1 -- 172.21.15.70:0/2006291220 >> 172.21.15.70:0/2006291220 conn(0x7f89081011c0 msgr2=0x7f89081016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.083+0000 7f8910800700 1 -- 172.21.15.70:0/2006291220 shutdown_connections 2024-05-08T07:30:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:30:38.083+0000 7f8910800700 1 -- 172.21.15.70:0/2006291220 wait complete. 2024-05-08T07:30:39.308 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9102f729', quiesce took 43.2 seconds. Will release after: 27.8 2024-05-08T07:30:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:39 smithi172 ceph-mon[33377]: pgmap v1399: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:30:39.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:39 smithi194 ceph-mon[33679]: pgmap v1399: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:30:39.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:39 smithi070 ceph-mon[29591]: pgmap v1399: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 5 op/s 2024-05-08T07:30:41.680 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:41 smithi070 ceph-mon[29591]: pgmap v1400: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:30:41.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:41 smithi194 ceph-mon[33679]: pgmap v1400: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:30:41.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:41 smithi172 ceph-mon[33377]: pgmap v1400: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:30:43.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:43 smithi194 ceph-mon[33679]: pgmap v1401: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:30:43.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:43 smithi070 ceph-mon[29591]: pgmap v1401: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:30:43.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:43 smithi172 ceph-mon[33377]: pgmap v1401: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:30:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:45 smithi194 ceph-mon[33679]: pgmap v1402: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-05-08T07:30:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:45 smithi070 ceph-mon[29591]: pgmap v1402: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-05-08T07:30:45.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:45 smithi172 ceph-mon[33377]: pgmap v1402: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 6 op/s 2024-05-08T07:30:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:47 smithi194 ceph-mon[33679]: pgmap v1403: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T07:30:47.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:47 smithi070 ceph-mon[29591]: pgmap v1403: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T07:30:47.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:47 smithi172 ceph-mon[33377]: pgmap v1403: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T07:30:49.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:49 smithi194 ceph-mon[33679]: pgmap v1404: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T07:30:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:49 smithi070 ceph-mon[29591]: pgmap v1404: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T07:30:49.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:49 smithi172 ceph-mon[33377]: pgmap v1404: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T07:30:51.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:51 smithi194 ceph-mon[33679]: pgmap v1405: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-05-08T07:30:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:51 smithi070 ceph-mon[29591]: pgmap v1405: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-05-08T07:30:51.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:51 smithi172 ceph-mon[33377]: pgmap v1405: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.7 KiB/s wr, 8 op/s 2024-05-08T07:30:53.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:53 smithi194 ceph-mon[33679]: pgmap v1406: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2024-05-08T07:30:53.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:53 smithi070 ceph-mon[29591]: pgmap v1406: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2024-05-08T07:30:53.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:53 smithi172 ceph-mon[33377]: pgmap v1406: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.8 KiB/s wr, 8 op/s 2024-05-08T07:30:54.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:30:54.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:30:54.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:30:55.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:55 smithi194 ceph-mon[33679]: pgmap v1407: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.2 KiB/s wr, 8 op/s 2024-05-08T07:30:55.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:55 smithi070 ceph-mon[29591]: pgmap v1407: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.2 KiB/s wr, 8 op/s 2024-05-08T07:30:55.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:55 smithi172 ceph-mon[33377]: pgmap v1407: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.2 KiB/s wr, 8 op/s 2024-05-08T07:30:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:30:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:30:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:30:56.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:30:56.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:30:56.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:30:56.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:30:56.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:30:56.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:30:57.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:57 smithi194 ceph-mon[33679]: pgmap v1408: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-05-08T07:30:57.830 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:57 smithi172 ceph-mon[33377]: pgmap v1408: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-05-08T07:30:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:57 smithi070 ceph-mon[29591]: pgmap v1408: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.4 KiB/s wr, 10 op/s 2024-05-08T07:30:59.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:30:59 smithi194 ceph-mon[33679]: pgmap v1409: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-05-08T07:30:59.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:30:59 smithi070 ceph-mon[29591]: pgmap v1409: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-05-08T07:30:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:30:59 smithi172 ceph-mon[33377]: pgmap v1409: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-05-08T07:31:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:01 smithi194 ceph-mon[33679]: pgmap v1410: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-08T07:31:01.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:01 smithi070 ceph-mon[29591]: pgmap v1410: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-08T07:31:01.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:01 smithi172 ceph-mon[33377]: pgmap v1410: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-08T07:31:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:03 smithi194 ceph-mon[33679]: pgmap v1411: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-05-08T07:31:03.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:03 smithi070 ceph-mon[29591]: pgmap v1411: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-05-08T07:31:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:03 smithi172 ceph-mon[33377]: pgmap v1411: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.8 KiB/s wr, 9 op/s 2024-05-08T07:31:05.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:05 smithi070 ceph-mon[29591]: pgmap v1412: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-05-08T07:31:05.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:05 smithi172 ceph-mon[33377]: pgmap v1412: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-05-08T07:31:06.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:05 smithi194 ceph-mon[33679]: pgmap v1412: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-05-08T07:31:07.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:31:07.821 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:31:07.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:07 smithi070 ceph-mon[29591]: pgmap v1413: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-05-08T07:31:07.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:07 smithi172 ceph-mon[33377]: pgmap v1413: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-05-08T07:31:08.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:07 smithi194 ceph-mon[33679]: pgmap v1413: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-05-08T07:31:08.830 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:08 smithi070 ceph-mon[29591]: osdmap e168: 12 total, 12 up, 12 in 2024-05-08T07:31:08.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:08 smithi172 ceph-mon[33377]: osdmap e168: 12 total, 12 up, 12 in 2024-05-08T07:31:09.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:08 smithi194 ceph-mon[33679]: osdmap e168: 12 total, 12 up, 12 in 2024-05-08T07:31:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:09 smithi070 ceph-mon[29591]: pgmap v1415: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 56 KiB/s wr, 34 op/s 2024-05-08T07:31:09.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:09 smithi172 ceph-mon[33377]: pgmap v1415: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 56 KiB/s wr, 34 op/s 2024-05-08T07:31:10.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:09 smithi194 ceph-mon[33679]: pgmap v1415: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 56 KiB/s wr, 34 op/s 2024-05-08T07:31:10.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.337+0000 7f686d400700 1 -- 172.21.15.70:0/41810223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868102ee0 msgr2=0x7f6868106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.337+0000 7f686d400700 1 --2- 172.21.15.70:0/41810223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868102ee0 0x7f6868106f30 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f68540099c0 tx=0x7f6854009cd0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.338+0000 7f686d400700 1 -- 172.21.15.70:0/41810223 shutdown_connections 2024-05-08T07:31:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.338+0000 7f686d400700 1 --2- 172.21.15.70:0/41810223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6868107610 0x7f686810f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.338+0000 7f686d400700 1 --2- 172.21.15.70:0/41810223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6868102530 0x7f6868102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.338+0000 7f686d400700 1 --2- 172.21.15.70:0/41810223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868102ee0 0x7f6868106f30 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.338+0000 7f686d400700 1 -- 172.21.15.70:0/41810223 >> 172.21.15.70:0/41810223 conn(0x7f68680fddc0 msgr2=0x7f68681001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:31:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.338+0000 7f686d400700 1 -- 172.21.15.70:0/41810223 shutdown_connections 2024-05-08T07:31:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.338+0000 7f686d400700 1 -- 172.21.15.70:0/41810223 wait complete. 2024-05-08T07:31:10.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.339+0000 7f686d400700 1 Processor -- start 2024-05-08T07:31:10.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.339+0000 7f686d400700 1 -- start start 2024-05-08T07:31:10.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.340+0000 7f686d400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6868102530 0x7f6868103fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:10.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.340+0000 7f686d400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6868102ee0 0x7f6868104510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:10.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.340+0000 7f686d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868107610 0x7f6868104a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:10.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.340+0000 7f686d400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6868112400 con 0x7f6868107610 2024-05-08T07:31:10.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.340+0000 7f686d400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6868112280 con 0x7f6868102530 2024-05-08T07:31:10.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.340+0000 7f686d400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6868112580 con 0x7f6868102ee0 2024-05-08T07:31:10.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.340+0000 7f686ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868107610 0x7f6868104a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:10.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.340+0000 7f686ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868107610 0x7f6868104a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60516/0 (socket says 172.21.15.70:60516) 2024-05-08T07:31:10.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.340+0000 7f686ca00700 1 -- 172.21.15.70:0/3242164612 learned_addr learned my addr 172.21.15.70:0/3242164612 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:31:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.341+0000 7f6867400700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6868102ee0 0x7f6868104510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.341+0000 7f6867e00700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6868102530 0x7f6868103fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.341+0000 7f686ca00700 1 -- 172.21.15.70:0/3242164612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6868102ee0 msgr2=0x7f6868104510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.341+0000 7f686ca00700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6868102ee0 0x7f6868104510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.341+0000 7f686ca00700 1 -- 172.21.15.70:0/3242164612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6868102530 msgr2=0x7f6868103fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.341+0000 7f686ca00700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6868102530 0x7f6868103fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.341+0000 7f686ca00700 1 -- 172.21.15.70:0/3242164612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68681a7fa0 con 0x7f6868107610 2024-05-08T07:31:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.341+0000 7f6867e00700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6868102530 0x7f6868103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:31:10.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.341+0000 7f686ca00700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868107610 0x7f6868104a50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f686000b970 tx=0x7f686000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:31:10.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.342+0000 7f6864c00700 1 -- 172.21.15.70:0/3242164612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860019070 con 0x7f6868107610 2024-05-08T07:31:10.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.342+0000 7f6864c00700 1 -- 172.21.15.70:0/3242164612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f686000cdc0 con 0x7f6868107610 2024-05-08T07:31:10.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.342+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68681a8290 con 0x7f6868107610 2024-05-08T07:31:10.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.342+0000 7f6864c00700 1 -- 172.21.15.70:0/3242164612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860014e30 con 0x7f6868107610 2024-05-08T07:31:10.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.342+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68681a87f0 con 0x7f6868107610 2024-05-08T07:31:10.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.343+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686806a190 con 0x7f6868107610 2024-05-08T07:31:10.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.346+0000 7f6864c00700 1 -- 172.21.15.70:0/3242164612 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f686001c070 con 0x7f6868107610 2024-05-08T07:31:10.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.348+0000 7f6864c00700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f684c0b2a70 0x7f684c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:10.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.348+0000 7f6864c00700 1 -- 172.21.15.70:0/3242164612 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(168..168 src has 1..168) ==== 9671+0+0 (secure 0 0 0) 0x7f68600e2160 con 0x7f6868107610 2024-05-08T07:31:10.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.348+0000 7f6867e00700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f684c0b2a70 0x7f684c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:10.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.349+0000 7f6867e00700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f684c0b2a70 0x7f684c0b4f30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6858005fd0 tx=0x7f6858005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:31:10.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.350+0000 7f6864c00700 1 -- 172.21.15.70:0/3242164612 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f68600a9770 con 0x7f6868107610 2024-05-08T07:31:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.642+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68681a8a80 con 0x7f6868107610 2024-05-08T07:31:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.643+0000 7f6864c00700 1 -- 172.21.15.70:0/3242164612 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f68600a9070 con 0x7f6868107610 2024-05-08T07:31:10.641 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:31:10.641 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:31:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f684c0b2a70 msgr2=0x7f684c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f684c0b2a70 0x7f684c0b4f30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6858005fd0 tx=0x7f6858005e30 comp rx=0 tx=0).stop 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868107610 msgr2=0x7f6868104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868107610 0x7f6868104a50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f686000b970 tx=0x7f686000bc80 comp rx=0 tx=0).stop 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 shutdown_connections 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f684c0b2a70 0x7f684c0b4f30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6868107610 0x7f6868104a50 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6868102530 0x7f6868103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 --2- 172.21.15.70:0/3242164612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6868102ee0 0x7f6868104510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 >> 172.21.15.70:0/3242164612 conn(0x7f68680fddc0 msgr2=0x7f68681000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.646+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 shutdown_connections 2024-05-08T07:31:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:10.647+0000 7f686d400700 1 -- 172.21.15.70:0/3242164612 wait complete. 2024-05-08T07:31:10.645 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:31:11.625 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 9102f729 --release --await' 2024-05-08T07:31:11.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 9102f729 --release --await 2024-05-08T07:31:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:11 smithi070 ceph-mon[29591]: pgmap v1416: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 56 KiB/s wr, 37 op/s 2024-05-08T07:31:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:11 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3242164612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:31:11.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:11 smithi172 ceph-mon[33377]: pgmap v1416: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 56 KiB/s wr, 37 op/s 2024-05-08T07:31:11.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:11 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3242164612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:31:12.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:11 smithi194 ceph-mon[33679]: pgmap v1416: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 56 KiB/s wr, 37 op/s 2024-05-08T07:31:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:11 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3242164612' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:31:12.167 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:31:13.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:13 smithi070 ceph-mon[29591]: pgmap v1417: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 36 op/s 2024-05-08T07:31:13.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:13 smithi070 ceph-mon[29591]: osdmap e169: 12 total, 12 up, 12 in 2024-05-08T07:31:13.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:13 smithi172 ceph-mon[33377]: pgmap v1417: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 36 op/s 2024-05-08T07:31:13.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:13 smithi172 ceph-mon[33377]: osdmap e169: 12 total, 12 up, 12 in 2024-05-08T07:31:14.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:13 smithi194 ceph-mon[33679]: pgmap v1417: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 56 KiB/s wr, 36 op/s 2024-05-08T07:31:14.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:13 smithi194 ceph-mon[33679]: osdmap e169: 12 total, 12 up, 12 in 2024-05-08T07:31:15.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.186+0000 7fccef000700 1 -- 172.21.15.70:0/2385602720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce81056e0 msgr2=0x7fcce8105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:15.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.186+0000 7fccef000700 1 --2- 172.21.15.70:0/2385602720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce81056e0 0x7fcce8105b60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fccd4009990 tx=0x7fccd4009ca0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.186+0000 7fccef000700 1 -- 172.21.15.70:0/2385602720 shutdown_connections 2024-05-08T07:31:15.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.186+0000 7fccef000700 1 --2- 172.21.15.70:0/2385602720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcce81060a0 0x7fcce81125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.186+0000 7fccef000700 1 --2- 172.21.15.70:0/2385602720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce810b6e0 0x7fcce810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.186+0000 7fccef000700 1 --2- 172.21.15.70:0/2385602720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce81056e0 0x7fcce8105b60 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.186+0000 7fccef000700 1 -- 172.21.15.70:0/2385602720 >> 172.21.15.70:0/2385602720 conn(0x7fcce81011d0 msgr2=0x7fcce81035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:31:15.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.186+0000 7fccef000700 1 -- 172.21.15.70:0/2385602720 shutdown_connections 2024-05-08T07:31:15.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.186+0000 7fccef000700 1 -- 172.21.15.70:0/2385602720 wait complete. 2024-05-08T07:31:15.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.188+0000 7fccef000700 1 Processor -- start 2024-05-08T07:31:15.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.188+0000 7fccef000700 1 -- start start 2024-05-08T07:31:15.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.189+0000 7fccef000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce81056e0 0x7fcce8112420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.189+0000 7fccef000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce81060a0 0x7fcce810f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.189+0000 7fccef000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcce810b6e0 0x7fcce810fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.189+0000 7fccef000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcce81157d0 con 0x7fcce81056e0 2024-05-08T07:31:15.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.189+0000 7fccef000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcce8115650 con 0x7fcce81060a0 2024-05-08T07:31:15.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.189+0000 7fccef000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcce8115950 con 0x7fcce810b6e0 2024-05-08T07:31:15.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.190+0000 7fcced000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcce810b6e0 0x7fcce810fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.190+0000 7fcce7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce81060a0 0x7fcce810f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.190+0000 7fcced000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcce810b6e0 0x7fcce810fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:53068/0 (socket says 172.21.15.70:53068) 2024-05-08T07:31:15.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.190+0000 7fcced000700 1 -- 172.21.15.70:0/3222843034 learned_addr learned my addr 172.21.15.70:0/3222843034 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:31:15.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.190+0000 7fcce7e00700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce81056e0 0x7fcce8112420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.191+0000 7fcced000700 1 -- 172.21.15.70:0/3222843034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce81060a0 msgr2=0x7fcce810f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:15.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.191+0000 7fcced000700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce81060a0 0x7fcce810f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.191+0000 7fcced000700 1 -- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce81056e0 msgr2=0x7fcce8112420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:15.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.191+0000 7fcced000700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce81056e0 0x7fcce8112420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.191+0000 7fcced000700 1 -- 172.21.15.70:0/3222843034 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce8110310 con 0x7fcce810b6e0 2024-05-08T07:31:15.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.191+0000 7fcced000700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcce810b6e0 0x7fcce810fa10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcce0007ee0 tx=0x7fcce000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:31:15.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.192+0000 7fcce4c00700 1 -- 172.21.15.70:0/3222843034 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0004bb0 con 0x7fcce810b6e0 2024-05-08T07:31:15.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.192+0000 7fccef000700 1 -- 172.21.15.70:0/3222843034 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce81a1dd0 con 0x7fcce810b6e0 2024-05-08T07:31:15.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.192+0000 7fccef000700 1 -- 172.21.15.70:0/3222843034 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce81a2310 con 0x7fcce810b6e0 2024-05-08T07:31:15.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.192+0000 7fcce4c00700 1 -- 172.21.15.70:0/3222843034 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcce0004d50 con 0x7fcce810b6e0 2024-05-08T07:31:15.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.192+0000 7fcce4c00700 1 -- 172.21.15.70:0/3222843034 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce00058b0 con 0x7fcce810b6e0 2024-05-08T07:31:15.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.197+0000 7fccf9987b80 1 Processor -- start 2024-05-08T07:31:15.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.199+0000 7fcce4c00700 1 -- 172.21.15.70:0/3222843034 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fcce001a020 con 0x7fcce810b6e0 2024-05-08T07:31:15.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.199+0000 7fccf9987b80 1 -- start start 2024-05-08T07:31:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.200+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.200+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0490 0x5600b11b0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.200+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0e50 0x5600b11bcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.200+0000 7fccf9987b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5600b1102b20 con 0x5600b11b0490 2024-05-08T07:31:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.200+0000 7fccf9987b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5600b10a0860 con 0x5600b11b5ec0 2024-05-08T07:31:15.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.200+0000 7fccf9987b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5600b10feae0 con 0x5600b11b0e50 2024-05-08T07:31:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.201+0000 7fcce7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0490 0x5600b11b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.201+0000 7fcce7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.201+0000 7fcce7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:48394/0 (socket says 172.21.15.70:48394) 2024-05-08T07:31:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.201+0000 7fcce7400700 1 -- 172.21.15.70:0/862594196 learned_addr learned my addr 172.21.15.70:0/862594196 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:31:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.201+0000 7fcce7400700 1 --2- 172.21.15.70:0/862594196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0e50 0x5600b11bcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.201+0000 7fcce7400700 1 -- 172.21.15.70:0/862594196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0e50 msgr2=0x5600b11bcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:31:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.201+0000 7fcce7400700 1 --2- 172.21.15.70:0/862594196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0e50 0x5600b11bcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.201+0000 7fcce7400700 1 -- 172.21.15.70:0/862594196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0490 msgr2=0x5600b11b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:31:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.201+0000 7fcce4c00700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcccc0b2a70 0x7fcccc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.202+0000 7fcce4c00700 1 -- 172.21.15.70:0/3222843034 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(169..169 src has 1..169) ==== 9583+0+0 (secure 0 0 0) 0x7fcce00e1fc0 con 0x7fcce810b6e0 2024-05-08T07:31:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.202+0000 7fcce7400700 1 --2- 172.21.15.70:0/862594196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0490 0x5600b11b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.202+0000 7fcce7400700 1 -- 172.21.15.70:0/862594196 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b104f9d0 con 0x5600b11b5ec0 2024-05-08T07:31:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.202+0000 7fcce7e00700 1 --2- 172.21.15.70:0/862594196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0490 0x5600b11b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:31:15.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.203+0000 7fcce7400700 1 --2- 172.21.15.70:0/862594196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b62a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fccd4000c00 tx=0x7fccd4003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b9a6befbffa2da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:31:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.203+0000 7fcce7400700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcccc0b2a70 0x7fcccc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.203+0000 7fccdd600700 1 -- 172.21.15.70:0/862594196 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd40037c0 con 0x5600b11b5ec0 2024-05-08T07:31:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.203+0000 7fccdd600700 1 -- 172.21.15.70:0/862594196 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccd400bc30 con 0x5600b11b5ec0 2024-05-08T07:31:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.203+0000 7fccdd600700 1 -- 172.21.15.70:0/862594196 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd40173f0 con 0x5600b11b5ec0 2024-05-08T07:31:15.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.204+0000 7fcce7400700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcccc0b2a70 0x7fcccc0b4f30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fccd4027000 tx=0x7fccd4020000 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:31:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.204+0000 7fccf9987b80 1 -- 172.21.15.70:0/862594196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 msgr2=0x5600b11b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.204+0000 7fccf9987b80 1 --2- 172.21.15.70:0/862594196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b62a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fccd4000c00 tx=0x7fccd4003680 comp rx=0 tx=0).stop 2024-05-08T07:31:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.205+0000 7fccf9987b80 1 -- 172.21.15.70:0/862594196 shutdown_connections 2024-05-08T07:31:15.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.205+0000 7fccf9987b80 1 --2- 172.21.15.70:0/862594196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0e50 0x5600b11bcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.205+0000 7fccf9987b80 1 --2- 172.21.15.70:0/862594196 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b62a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.205+0000 7fccf9987b80 1 --2- 172.21.15.70:0/862594196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0490 0x5600b11b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.205+0000 7fccf9987b80 1 -- 172.21.15.70:0/862594196 >> 172.21.15.70:0/862594196 conn(0x5600b10dec60 msgr2=0x5600b11aad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:31:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.205+0000 7fccf9987b80 1 -- 172.21.15.70:0/862594196 shutdown_connections 2024-05-08T07:31:15.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.205+0000 7fccf9987b80 1 -- 172.21.15.70:0/862594196 wait complete. 2024-05-08T07:31:15.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.205+0000 7fccf9987b80 1 -- start start 2024-05-08T07:31:15.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.206+0000 7fccf9987b80 1 Processor -- start 2024-05-08T07:31:15.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.206+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11bc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.206+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11b9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.206+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 0x5600b11ba0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.206+0000 7fccf9987b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5600b11bd1c0 con 0x5600b11b0e50 2024-05-08T07:31:15.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.206+0000 7fccf9987b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5600b1068c20 con 0x5600b11b0490 2024-05-08T07:31:15.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.206+0000 7fccf9987b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5600b11bd340 con 0x5600b11b5ec0 2024-05-08T07:31:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.206+0000 7fccf9987b80 10 client.0 _ll_register_callbacks cb 0x5600b10a9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:31:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.207+0000 7fcce7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11b9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.207+0000 7fcce7e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.207+0000 7fcce7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11b9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60552/0 (socket says 172.21.15.70:60552) 2024-05-08T07:31:15.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.207+0000 7fcce7400700 1 -- 172.21.15.70:0/4039277159 learned_addr learned my addr 172.21.15.70:0/4039277159 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:31:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.208+0000 7fcce7400700 1 -- 172.21.15.70:0/4039277159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 msgr2=0x5600b11ba0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:31:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.208+0000 7fcced000700 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 0x5600b11ba0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.208+0000 7fcce7400700 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 0x5600b11ba0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.208+0000 7fcce7400700 1 -- 172.21.15.70:0/4039277159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 msgr2=0x5600b11bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:31:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.208+0000 7fcce7400700 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11bc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.208+0000 7fcce7400700 1 -- 172.21.15.70:0/4039277159 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b10c8520 con 0x5600b11b0e50 2024-05-08T07:31:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.208+0000 7fcce7e00700 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:31:15.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.208+0000 7fcced000700 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 0x5600b11ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:31:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.209+0000 7fcce7400700 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11b9b60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fccd4003730 tx=0x7fccd400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4a389df47097a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:31:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.209+0000 7fccd2000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:31:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.209+0000 7fccd2000700 1 -- 172.21.15.70:0/4039277159 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4042060 con 0x5600b11b0e50 2024-05-08T07:31:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.209+0000 7fccf9987b80 1 -- 172.21.15.70:0/4039277159 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccd400bc30 con 0x5600b11b0e50 2024-05-08T07:31:15.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.209+0000 7fccd2000700 1 -- 172.21.15.70:0/4039277159 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(169..169 src has 1..169) ==== 9583+0+0 (secure 0 0 0) 0x7fccd400bde0 con 0x5600b11b0e50 2024-05-08T07:31:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.210+0000 7fccd2000700 1 -- 172.21.15.70:0/4039277159 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fccd4049050 con 0x5600b11b0e50 2024-05-08T07:31:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.210+0000 7fccf9987b80 10 client.16731 fetch_fsmap learned FSMap version 42 2024-05-08T07:31:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.210+0000 7fccf9987b80 1 -- 172.21.15.70:0/4039277159 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5600b11bd1c0 con 0x5600b11b0e50 2024-05-08T07:31:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.210+0000 7fccd2000700 1 -- 172.21.15.70:0/4039277159 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccd400bc30 con 0x5600b11b0e50 2024-05-08T07:31:15.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.210+0000 7fccd2000700 1 -- 172.21.15.70:0/4039277159 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fccd4017850 con 0x5600b11b0e50 2024-05-08T07:31:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.211+0000 7fccf9987b80 10 client.16731 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:31:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.211+0000 7fccf9987b80 10 client.16731 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:31:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.211+0000 7fccf9987b80 20 client.16731 populate_metadata read hostname 'smithi070' 2024-05-08T07:31:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.211+0000 7fccf9987b80 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5600b11c9d50 0x5600b11cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.211+0000 7fccf9987b80 4 client.16731 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:31:15.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.211+0000 7fccf9987b80 1 -- 172.21.15.70:0/4039277159 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600b117d1a0 con 0x5600b11c9d50 2024-05-08T07:31:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.212+0000 7fcce7e00700 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5600b11c9d50 0x5600b11cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.213+0000 7fccd2000700 10 client.16731 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:31:15.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.213+0000 7fcce7e00700 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5600b11c9d50 0x5600b11cc140 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbaf43ef90709326 server_cookie=ad0ab06a7d603cf9 in_seq=0 out_seq=0 2024-05-08T07:31:15.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccd2000700 1 -- 172.21.15.70:0/4039277159 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5600b117d1a0 con 0x5600b11c9d50 2024-05-08T07:31:15.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccd2000700 10 client.16731 handle_command_reply: tid=0 2024-05-08T07:31:15.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccf9987b80 1 client.16731 shutdown 2024-05-08T07:31:15.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccf9987b80 1 -- 172.21.15.70:0/4039277159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 msgr2=0x5600b11b9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:15.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccf9987b80 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11b9b60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fccd4003730 tx=0x7fccd400b670 comp rx=0 tx=0).stop 2024-05-08T07:31:15.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccf9987b80 1 -- 172.21.15.70:0/4039277159 shutdown_connections 2024-05-08T07:31:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccf9987b80 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5600b11c9d50 0x5600b11cc140 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccf9987b80 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 0x5600b11ba0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccf9987b80 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccf9987b80 1 --2- 172.21.15.70:0/4039277159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11b9b60 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccf9987b80 1 -- 172.21.15.70:0/4039277159 >> 172.21.15.70:0/4039277159 conn(0x5600b10dec60 msgr2=0x5600b11a5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:31:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.215+0000 7fccd2000700 0 client.16731 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:31:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.216+0000 7fccf9987b80 1 -- 172.21.15.70:0/4039277159 shutdown_connections 2024-05-08T07:31:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.216+0000 7fccf9987b80 1 -- 172.21.15.70:0/4039277159 wait complete. 2024-05-08T07:31:15.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.216+0000 7fccf9987b80 20 client.16731 trim_cache size 0 max 16384 2024-05-08T07:31:15.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.239+0000 7fccf9987b80 1 Processor -- start 2024-05-08T07:31:15.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.239+0000 7fccf9987b80 1 -- start start 2024-05-08T07:31:15.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0490 0x5600b11b5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11c6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fccf9987b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fccc8011800 con 0x5600b11b0e50 2024-05-08T07:31:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fccf9987b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fccc800f090 con 0x5600b11b5ec0 2024-05-08T07:31:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fccf9987b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fccc800cf00 con 0x5600b11b0490 2024-05-08T07:31:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fcce7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fcce7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60564/0 (socket says 172.21.15.70:60564) 2024-05-08T07:31:15.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fcce7400700 1 -- 172.21.15.70:0/3971931897 learned_addr learned my addr 172.21.15.70:0/3971931897 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:31:15.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fcce7e00700 1 --2- 172.21.15.70:0/3971931897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0490 0x5600b11b5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.240+0000 7fcced000700 1 --2- 172.21.15.70:0/3971931897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.241+0000 7fcce7400700 1 -- 172.21.15.70:0/3971931897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0490 msgr2=0x5600b11b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:31:15.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.241+0000 7fcce7400700 1 --2- 172.21.15.70:0/3971931897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0490 0x5600b11b5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.241+0000 7fcce7400700 1 -- 172.21.15.70:0/3971931897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 msgr2=0x5600b11b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:31:15.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.241+0000 7fcce7400700 1 --2- 172.21.15.70:0/3971931897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.241+0000 7fcce7400700 1 -- 172.21.15.70:0/3971931897 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600b11a7980 con 0x5600b11b0e50 2024-05-08T07:31:15.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.241+0000 7fcce7400700 1 --2- 172.21.15.70:0/3971931897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11c6300 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fccd4017fb0 tx=0x7fccd400bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52541ef6582a71cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:31:15.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.242+0000 7fccdcc00700 1 -- 172.21.15.70:0/3971931897 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4042070 con 0x5600b11b0e50 2024-05-08T07:31:15.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.242+0000 7fccdcc00700 1 -- 172.21.15.70:0/3971931897 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccd4005bc0 con 0x5600b11b0e50 2024-05-08T07:31:15.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.242+0000 7fccdcc00700 1 -- 172.21.15.70:0/3971931897 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4028ad0 con 0x5600b11b0e50 2024-05-08T07:31:15.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 -- 172.21.15.70:0/3971931897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 msgr2=0x5600b11c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:15.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3971931897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11c6300 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fccd4017fb0 tx=0x7fccd400bdc0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 -- 172.21.15.70:0/3971931897 shutdown_connections 2024-05-08T07:31:15.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3971931897 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b5ec0 0x5600b11b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3971931897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b0490 0x5600b11b5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3971931897 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11c6300 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 -- 172.21.15.70:0/3971931897 >> 172.21.15.70:0/3971931897 conn(0x5600b10dec60 msgr2=0x5600b11b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:31:15.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 -- 172.21.15.70:0/3971931897 shutdown_connections 2024-05-08T07:31:15.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 -- 172.21.15.70:0/3971931897 wait complete. 2024-05-08T07:31:15.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.243+0000 7fccf9987b80 1 -- start start 2024-05-08T07:31:15.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.244+0000 7fccf9987b80 1 Processor -- start 2024-05-08T07:31:15.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fccf9987b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 0x5600b11bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fccf9987b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fccc800d550 con 0x5600b11b0e50 2024-05-08T07:31:15.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fccf9987b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fccc800e9c0 con 0x5600b11b0490 2024-05-08T07:31:15.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fccf9987b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fccc800dc20 con 0x5600b11b5ec0 2024-05-08T07:31:15.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fccf9987b80 10 client.0 _ll_register_callbacks cb 0x5600b10a9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:31:15.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fcce7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fcce7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60568/0 (socket says 172.21.15.70:60568) 2024-05-08T07:31:15.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fcce7400700 1 -- 172.21.15.70:0/3607191370 learned_addr learned my addr 172.21.15.70:0/3607191370 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:31:15.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.246+0000 7fcce7e00700 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.247+0000 7fcce7400700 1 -- 172.21.15.70:0/3607191370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 msgr2=0x5600b11bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:31:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.247+0000 7fcce7400700 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 0x5600b11bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.247+0000 7fcce7400700 1 -- 172.21.15.70:0/3607191370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 msgr2=0x5600b11c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:31:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.247+0000 7fcce7400700 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.247+0000 7fcce7400700 1 -- 172.21.15.70:0/3607191370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600b11c03a0 con 0x5600b11b0e50 2024-05-08T07:31:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.247+0000 7fcce7e00700 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:31:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.247+0000 7fcce7400700 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11bf600 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fccd4005b40 tx=0x7fccd4017880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df19e926bfd8046 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:31:15.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.247+0000 7fccd2000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:31:15.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.248+0000 7fccd2000700 1 -- 172.21.15.70:0/3607191370 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd4053070 con 0x5600b11b0e50 2024-05-08T07:31:15.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.248+0000 7fccd2000700 1 -- 172.21.15.70:0/3607191370 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(169..169 src has 1..169) ==== 9583+0+0 (secure 0 0 0) 0x7fccd4034a10 con 0x5600b11b0e50 2024-05-08T07:31:15.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.248+0000 7fccf9987b80 1 -- 172.21.15.70:0/3607191370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccd4005bc0 con 0x5600b11b0e50 2024-05-08T07:31:15.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.248+0000 7fccd2000700 1 -- 172.21.15.70:0/3607191370 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fccd405f050 con 0x5600b11b0e50 2024-05-08T07:31:15.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.248+0000 7fccf9987b80 10 client.16737 fetch_fsmap learned FSMap version 42 2024-05-08T07:31:15.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.248+0000 7fccf9987b80 1 -- 172.21.15.70:0/3607191370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5600b12354f0 con 0x5600b11b0e50 2024-05-08T07:31:15.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.249+0000 7fccd2000700 1 -- 172.21.15.70:0/3607191370 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fccd4005bc0 con 0x5600b11b0e50 2024-05-08T07:31:15.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.249+0000 7fccd2000700 1 -- 172.21.15.70:0/3607191370 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fccd40288e0 con 0x5600b11b0e50 2024-05-08T07:31:15.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.249+0000 7fccf9987b80 10 client.16737 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:31:15.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.249+0000 7fccf9987b80 10 client.16737 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:31:15.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.249+0000 7fccf9987b80 20 client.16737 populate_metadata read hostname 'smithi070' 2024-05-08T07:31:15.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.249+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5600b1235b20 0x5600b1237f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:31:15.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.249+0000 7fccf9987b80 4 client.16737 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9102f729", "release": true, "await": true}] 2024-05-08T07:31:15.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.249+0000 7fccf9987b80 1 -- 172.21.15.70:0/3607191370 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9102f729", "release": true, "await": true}) -- 0x5600b1110500 con 0x5600b1235b20 2024-05-08T07:31:15.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.250+0000 7fcce7e00700 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5600b1235b20 0x5600b1237f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:31:15.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.251+0000 7fcce7e00700 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5600b1235b20 0x5600b1237f40 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631f8b3acb5edc54 server_cookie=6e579eef3ba9f783 in_seq=0 out_seq=0 2024-05-08T07:31:15.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:15.251+0000 7fccd2000700 10 client.16737 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:31:15.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:15 smithi070 ceph-mon[29591]: pgmap v1419: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-08T07:31:15.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:15 smithi172 ceph-mon[33377]: pgmap v1419: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-08T07:31:16.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:15 smithi194 ceph-mon[33679]: pgmap v1419: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-08T07:31:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:17 smithi070 ceph-mon[29591]: pgmap v1420: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-05-08T07:31:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:17 smithi172 ceph-mon[33377]: pgmap v1420: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-05-08T07:31:18.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:17 smithi194 ceph-mon[33679]: pgmap v1420: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-05-08T07:31:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.535+0000 7fccd2000700 1 -- 172.21.15.70:0/3607191370 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5600b1110500 con 0x5600b1235b20 2024-05-08T07:31:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.535+0000 7fccd2000700 10 client.16737 handle_command_reply: tid=0 2024-05-08T07:31:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.536+0000 7fccf9987b80 1 client.16737 shutdown 2024-05-08T07:31:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.536+0000 7fccf9987b80 1 -- 172.21.15.70:0/3607191370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 msgr2=0x5600b11bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.536+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11bf600 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fccd4005b40 tx=0x7fccd4017880 comp rx=0 tx=0).stop 2024-05-08T07:31:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.537+0000 7fccf9987b80 1 -- 172.21.15.70:0/3607191370 shutdown_connections 2024-05-08T07:31:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.537+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5600b1235b20 0x5600b1237f40 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.537+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5600b11b5ec0 0x5600b11bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.537+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5600b11b0490 0x5600b11c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.537+0000 7fccf9987b80 1 --2- 172.21.15.70:0/3607191370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5600b11b0e50 0x5600b11bf600 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.537+0000 7fccf9987b80 1 -- 172.21.15.70:0/3607191370 >> 172.21.15.70:0/3607191370 conn(0x5600b10dec60 msgr2=0x5600b11b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:31:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.537+0000 7fccd2000700 0 client.16737 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:31:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.537+0000 7fccf9987b80 1 -- 172.21.15.70:0/3607191370 shutdown_connections 2024-05-08T07:31:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.537+0000 7fccf9987b80 1 -- 172.21.15.70:0/3607191370 wait complete. 2024-05-08T07:31:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.538+0000 7fccf9987b80 20 client.16737 trim_cache size 0 max 16384 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 112, 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout: "9102f729": { 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 112, 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:31:19.538 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.8, 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:31:19.539 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:31:19.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:31:19.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:31:19.540 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.539+0000 7fccef000700 1 -- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcccc0b2a70 msgr2=0x7fcccc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.539+0000 7fccef000700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcccc0b2a70 0x7fcccc0b4f30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fccd4027000 tx=0x7fccd4020000 comp rx=0 tx=0).stop 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.539+0000 7fccef000700 1 -- 172.21.15.70:0/3222843034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcce810b6e0 msgr2=0x7fcce810fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.539+0000 7fccef000700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcce810b6e0 0x7fcce810fa10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcce0007ee0 tx=0x7fcce000d3b0 comp rx=0 tx=0).stop 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.540+0000 7fccef000700 1 -- 172.21.15.70:0/3222843034 shutdown_connections 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.540+0000 7fccef000700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcccc0b2a70 0x7fcccc0b4f30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.540+0000 7fccef000700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcce810b6e0 0x7fcce810fa10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.540+0000 7fccef000700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcce81056e0 0x7fcce8112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.540+0000 7fccef000700 1 --2- 172.21.15.70:0/3222843034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcce81060a0 0x7fcce810f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.540+0000 7fccef000700 1 -- 172.21.15.70:0/3222843034 >> 172.21.15.70:0/3222843034 conn(0x7fcce81011d0 msgr2=0x7fcce8101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.540+0000 7fccef000700 1 -- 172.21.15.70:0/3222843034 shutdown_connections 2024-05-08T07:31:19.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:31:19.540+0000 7fccef000700 1 -- 172.21.15.70:0/3222843034 wait complete. 2024-05-08T07:31:19.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:19 smithi070 ceph-mon[29591]: pgmap v1421: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-05-08T07:31:19.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:19 smithi172 ceph-mon[33377]: pgmap v1421: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-05-08T07:31:20.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:19 smithi194 ceph-mon[33679]: pgmap v1421: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-05-08T07:31:20.467 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9102f729', seconds elapsed: 84.3 2024-05-08T07:31:21.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:21 smithi070 ceph-mon[29591]: pgmap v1422: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-08T07:31:21.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:21 smithi172 ceph-mon[33377]: pgmap v1422: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-08T07:31:22.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:21 smithi194 ceph-mon[33679]: pgmap v1422: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-08T07:31:23.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:23 smithi070 ceph-mon[29591]: pgmap v1423: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-08T07:31:23.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:23 smithi172 ceph-mon[33377]: pgmap v1423: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-08T07:31:24.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:23 smithi194 ceph-mon[33679]: pgmap v1423: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-05-08T07:31:24.292 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/mod/mk_elfconfig 2024-05-08T07:31:24.293 INFO:tasks.workunit.client.0.smithi070.stdout: CC scripts/mod/empty.o 2024-05-08T07:31:24.293 INFO:tasks.workunit.client.0.smithi070.stdout: CC scripts/mod/devicetable-offsets.s 2024-05-08T07:31:24.812 INFO:tasks.workunit.client.0.smithi070.stdout: MKELF scripts/mod/elfconfig.h 2024-05-08T07:31:24.864 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/mod/modpost.o 2024-05-08T07:31:24.865 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/mod/sumversion.o 2024-05-08T07:31:25.478 INFO:tasks.workunit.client.0.smithi070.stdout: UPD scripts/mod/devicetable-offsets.h 2024-05-08T07:31:25.560 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC scripts/mod/file2alias.o 2024-05-08T07:31:25.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:25 smithi070 ceph-mon[29591]: pgmap v1424: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-05-08T07:31:25.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:25 smithi172 ceph-mon[33377]: pgmap v1424: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-05-08T07:31:26.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:25 smithi194 ceph-mon[33679]: pgmap v1424: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-05-08T07:31:26.221 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTLD scripts/mod/modpost 2024-05-08T07:31:27.215 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/bounds.s 2024-05-08T07:31:27.240 INFO:tasks.workunit.client.0.smithi070.stdout: CHKSHA1 include/linux/atomic/atomic-instrumented.h 2024-05-08T07:31:27.240 INFO:tasks.workunit.client.0.smithi070.stdout: CHKSHA1 include/linux/atomic/atomic-arch-fallback.h 2024-05-08T07:31:27.242 INFO:tasks.workunit.client.0.smithi070.stdout: CHKSHA1 include/linux/atomic/atomic-long.h 2024-05-08T07:31:27.306 INFO:tasks.workunit.client.0.smithi070.stdout: UPD include/generated/timeconst.h 2024-05-08T07:31:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:27 smithi070 ceph-mon[29591]: pgmap v1425: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-05-08T07:31:27.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:27 smithi172 ceph-mon[33377]: pgmap v1425: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-05-08T07:31:28.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:27 smithi194 ceph-mon[33679]: pgmap v1425: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 KiB/s wr, 10 op/s 2024-05-08T07:31:29.170 INFO:tasks.workunit.client.0.smithi070.stdout: UPD include/generated/bounds.h 2024-05-08T07:31:29.240 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/asm-offsets.s 2024-05-08T07:31:29.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:29 smithi070 ceph-mon[29591]: pgmap v1426: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T07:31:29.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:29 smithi172 ceph-mon[33377]: pgmap v1426: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T07:31:30.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:29 smithi194 ceph-mon[33679]: pgmap v1426: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T07:31:31.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:31 smithi070 ceph-mon[29591]: pgmap v1427: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 103 KiB/s wr, 28 op/s 2024-05-08T07:31:31.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:31 smithi172 ceph-mon[33377]: pgmap v1427: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 103 KiB/s wr, 28 op/s 2024-05-08T07:31:32.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:31 smithi194 ceph-mon[33679]: pgmap v1427: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 103 KiB/s wr, 28 op/s 2024-05-08T07:31:33.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:33 smithi070 ceph-mon[29591]: pgmap v1428: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 115 KiB/s wr, 28 op/s 2024-05-08T07:31:33.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:33 smithi172 ceph-mon[33377]: pgmap v1428: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 115 KiB/s wr, 28 op/s 2024-05-08T07:31:34.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:33 smithi194 ceph-mon[33679]: pgmap v1428: 129 pgs: 129 active+clean; 1.7 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 115 KiB/s wr, 28 op/s 2024-05-08T07:31:35.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:35 smithi172 ceph-mon[33377]: pgmap v1429: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 117 KiB/s wr, 35 op/s 2024-05-08T07:31:36.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:35 smithi194 ceph-mon[33679]: pgmap v1429: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 117 KiB/s wr, 35 op/s 2024-05-08T07:31:36.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:35 smithi070 ceph-mon[29591]: pgmap v1429: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 117 KiB/s wr, 35 op/s 2024-05-08T07:31:37.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:37 smithi172 ceph-mon[33377]: pgmap v1430: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 198 KiB/s wr, 52 op/s 2024-05-08T07:31:38.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:37 smithi194 ceph-mon[33679]: pgmap v1430: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 198 KiB/s wr, 52 op/s 2024-05-08T07:31:38.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:37 smithi070 ceph-mon[29591]: pgmap v1430: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 198 KiB/s wr, 52 op/s 2024-05-08T07:31:39.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:39 smithi172 ceph-mon[33377]: pgmap v1431: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 181 KiB/s wr, 48 op/s 2024-05-08T07:31:40.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:39 smithi194 ceph-mon[33679]: pgmap v1431: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 181 KiB/s wr, 48 op/s 2024-05-08T07:31:40.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:39 smithi070 ceph-mon[29591]: pgmap v1431: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 181 KiB/s wr, 48 op/s 2024-05-08T07:31:41.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:41 smithi172 ceph-mon[33377]: pgmap v1432: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 187 KiB/s wr, 67 op/s 2024-05-08T07:31:41.929 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:41 smithi070 ceph-mon[29591]: pgmap v1432: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 187 KiB/s wr, 67 op/s 2024-05-08T07:31:41.946 INFO:tasks.workunit.client.0.smithi070.stdout: UPD include/generated/asm-offsets.h 2024-05-08T07:31:42.008 INFO:tasks.workunit.client.0.smithi070.stdout: CALL scripts/checksyscalls.sh 2024-05-08T07:31:42.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:41 smithi194 ceph-mon[33679]: pgmap v1432: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 187 KiB/s wr, 67 op/s 2024-05-08T07:31:42.537 INFO:tasks.workunit.client.0.smithi070.stdout: LDS scripts/module.lds 2024-05-08T07:31:43.790 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:43 smithi070 ceph-mon[29591]: pgmap v1433: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 164 KiB/s wr, 52 op/s 2024-05-08T07:31:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:43 smithi172 ceph-mon[33377]: pgmap v1433: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 164 KiB/s wr, 52 op/s 2024-05-08T07:31:43.954 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC usr/gen_init_cpio 2024-05-08T07:31:43.957 INFO:tasks.workunit.client.0.smithi070.stdout: CC init/main.o 2024-05-08T07:31:43.980 INFO:tasks.workunit.client.0.smithi070.stdout: CC certs/system_keyring.o 2024-05-08T07:31:44.005 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/compat.o 2024-05-08T07:31:44.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:43 smithi194 ceph-mon[33679]: pgmap v1433: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 164 KiB/s wr, 52 op/s 2024-05-08T07:31:44.405 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/filemap.o 2024-05-08T07:31:44.531 INFO:tasks.workunit.client.0.smithi070.stdout: GEN usr/initramfs_data.cpio 2024-05-08T07:31:44.633 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/notify/dnotify/dnotify.o 2024-05-08T07:31:44.658 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/sched/core.o 2024-05-08T07:31:44.680 INFO:tasks.workunit.client.0.smithi070.stdout: COPY usr/initramfs_inc_data 2024-05-08T07:31:44.729 INFO:tasks.workunit.client.0.smithi070.stdout: AS usr/initramfs_data.o 2024-05-08T07:31:44.733 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vdso/vma.o 2024-05-08T07:31:44.918 INFO:tasks.workunit.client.0.smithi070.stdout: AR usr/built-in.a 2024-05-08T07:31:45.118 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vdso/extable.o 2024-05-08T07:31:45.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:45 smithi172 ceph-mon[33377]: pgmap v1434: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 153 KiB/s wr, 52 op/s 2024-05-08T07:31:46.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:45 smithi194 ceph-mon[33679]: pgmap v1434: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 153 KiB/s wr, 52 op/s 2024-05-08T07:31:46.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:45 smithi070 ceph-mon[29591]: pgmap v1434: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 153 KiB/s wr, 52 op/s 2024-05-08T07:31:47.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:46 smithi194 ceph-mon[33679]: pgmap v1435: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 213 KiB/s wr, 52 op/s 2024-05-08T07:31:47.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:46 smithi070 ceph-mon[29591]: pgmap v1435: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 213 KiB/s wr, 52 op/s 2024-05-08T07:31:47.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:46 smithi172 ceph-mon[33377]: pgmap v1435: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 213 KiB/s wr, 52 op/s 2024-05-08T07:31:49.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:49 smithi070 ceph-mon[29591]: pgmap v1436: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 131 KiB/s wr, 33 op/s 2024-05-08T07:31:49.427 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC certs/extract-cert 2024-05-08T07:31:49.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:49 smithi172 ceph-mon[33377]: pgmap v1436: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 131 KiB/s wr, 33 op/s 2024-05-08T07:31:49.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:49 smithi194 ceph-mon[33679]: pgmap v1436: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 131 KiB/s wr, 33 op/s 2024-05-08T07:31:49.969 INFO:tasks.workunit.client.0.smithi070.stdout: CERT certs/x509_certificate_list 2024-05-08T07:31:50.028 INFO:tasks.workunit.client.0.smithi070.stdout: CERT certs/signing_key.x509 2024-05-08T07:31:50.082 INFO:tasks.workunit.client.0.smithi070.stdout: AS certs/system_certificates.o 2024-05-08T07:31:50.519 INFO:tasks.workunit.client.0.smithi070.stdout: AR certs/built-in.a 2024-05-08T07:31:50.719 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mempool.o 2024-05-08T07:31:51.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:51 smithi070 ceph-mon[29591]: pgmap v1437: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 141 KiB/s wr, 45 op/s 2024-05-08T07:31:51.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:51 smithi172 ceph-mon[33377]: pgmap v1437: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 141 KiB/s wr, 45 op/s 2024-05-08T07:31:51.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:51 smithi194 ceph-mon[33679]: pgmap v1437: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 141 KiB/s wr, 45 op/s 2024-05-08T07:31:51.888 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/notify/dnotify/built-in.a 2024-05-08T07:31:52.471 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/notify/inotify/inotify_fsnotify.o 2024-05-08T07:31:52.829 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/util.o 2024-05-08T07:31:53.383 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:53 smithi070 ceph-mon[29591]: pgmap v1438: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 190 KiB/s wr, 28 op/s 2024-05-08T07:31:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:53 smithi172 ceph-mon[33377]: pgmap v1438: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 190 KiB/s wr, 28 op/s 2024-05-08T07:31:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:53 smithi194 ceph-mon[33679]: pgmap v1438: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 190 KiB/s wr, 28 op/s 2024-05-08T07:31:53.743 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/msgutil.o 2024-05-08T07:31:55.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:55 smithi070 ceph-mon[29591]: pgmap v1439: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 307 KiB/s wr, 146 op/s 2024-05-08T07:31:55.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:55 smithi172 ceph-mon[33377]: pgmap v1439: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 307 KiB/s wr, 146 op/s 2024-05-08T07:31:55.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:55 smithi194 ceph-mon[33679]: pgmap v1439: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 307 KiB/s wr, 146 op/s 2024-05-08T07:31:55.678 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vdso/vdso32-setup.o 2024-05-08T07:31:56.148 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/notify/fanotify/built-in.a 2024-05-08T07:31:56.298 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/oom_kill.o 2024-05-08T07:31:57.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:57 smithi172 ceph-mon[33377]: pgmap v1440: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 464 KiB/s wr, 417 op/s 2024-05-08T07:31:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:31:57.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:57 smithi194 ceph-mon[33679]: pgmap v1440: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 464 KiB/s wr, 417 op/s 2024-05-08T07:31:57.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:31:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:57 smithi070 ceph-mon[29591]: pgmap v1440: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 464 KiB/s wr, 417 op/s 2024-05-08T07:31:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:31:58.695 INFO:tasks.workunit.client.0.smithi070.stdout: UPD init/utsversion-tmp.h 2024-05-08T07:31:58.785 INFO:tasks.workunit.client.0.smithi070.stdout: CC init/do_mounts.o 2024-05-08T07:31:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:59 smithi172 ceph-mon[33377]: pgmap v1441: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 402 KiB/s wr, 411 op/s 2024-05-08T07:31:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:31:59.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:31:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:31:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:31:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:59 smithi194 ceph-mon[33679]: pgmap v1441: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 402 KiB/s wr, 411 op/s 2024-05-08T07:31:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:31:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:31:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:31:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:31:59.594 INFO:tasks.workunit.client.0.smithi070.stdout: CC init/do_mounts_initrd.o 2024-05-08T07:31:59.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:59 smithi070 ceph-mon[29591]: pgmap v1441: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 402 KiB/s wr, 411 op/s 2024-05-08T07:31:59.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:31:59.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:31:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:31:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:31:59.996 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/notify/inotify/inotify_user.o 2024-05-08T07:32:00.275 INFO:tasks.workunit.client.0.smithi070.stdout: LDS arch/x86/entry/vdso/vdso.lds 2024-05-08T07:32:00.852 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/entry/vdso/vdso-note.o 2024-05-08T07:32:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:01 smithi172 ceph-mon[33377]: pgmap v1442: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 552 KiB/s wr, 426 op/s 2024-05-08T07:32:01.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:01 smithi194 ceph-mon[33679]: pgmap v1442: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 552 KiB/s wr, 426 op/s 2024-05-08T07:32:01.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:01 smithi070 ceph-mon[29591]: pgmap v1442: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 552 KiB/s wr, 426 op/s 2024-05-08T07:32:02.064 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vdso/vclock_gettime.o 2024-05-08T07:32:02.524 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/notify/fsnotify.o 2024-05-08T07:32:02.953 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/sched/fair.o 2024-05-08T07:32:03.099 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/msg.o 2024-05-08T07:32:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:03 smithi172 ceph-mon[33377]: pgmap v1443: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 569 KiB/s wr, 447 op/s 2024-05-08T07:32:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:03 smithi194 ceph-mon[33679]: pgmap v1443: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 569 KiB/s wr, 447 op/s 2024-05-08T07:32:03.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:03 smithi070 ceph-mon[29591]: pgmap v1443: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 569 KiB/s wr, 447 op/s 2024-05-08T07:32:05.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:05 smithi194 ceph-mon[33679]: pgmap v1444: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 645 KiB/s wr, 498 op/s 2024-05-08T07:32:05.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:05 smithi070 ceph-mon[29591]: pgmap v1444: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 645 KiB/s wr, 498 op/s 2024-05-08T07:32:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:05 smithi172 ceph-mon[33377]: pgmap v1444: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 645 KiB/s wr, 498 op/s 2024-05-08T07:32:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:06 smithi194 ceph-mon[33679]: osdmap e170: 12 total, 12 up, 12 in 2024-05-08T07:32:06.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:06 smithi070 ceph-mon[29591]: osdmap e170: 12 total, 12 up, 12 in 2024-05-08T07:32:06.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:06 smithi172 ceph-mon[33377]: osdmap e170: 12 total, 12 up, 12 in 2024-05-08T07:32:07.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:07 smithi194 ceph-mon[33679]: pgmap v1446: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 555 KiB/s wr, 232 op/s 2024-05-08T07:32:07.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:07 smithi070 ceph-mon[29591]: pgmap v1446: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 555 KiB/s wr, 232 op/s 2024-05-08T07:32:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:07 smithi172 ceph-mon[33377]: pgmap v1446: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 555 KiB/s wr, 232 op/s 2024-05-08T07:32:07.687 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/fadvise.o 2024-05-08T07:32:08.023 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vdso/vgetcpu.o 2024-05-08T07:32:09.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:09 smithi194 ceph-mon[33679]: pgmap v1447: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 555 KiB/s wr, 232 op/s 2024-05-08T07:32:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:09 smithi070 ceph-mon[29591]: pgmap v1447: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 555 KiB/s wr, 232 op/s 2024-05-08T07:32:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:09 smithi172 ceph-mon[33377]: pgmap v1447: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 555 KiB/s wr, 232 op/s 2024-05-08T07:32:09.934 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC arch/x86/entry/vdso/vdso2c 2024-05-08T07:32:10.260 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/locking/mutex.o 2024-05-08T07:32:10.474 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/notify/inotify/built-in.a 2024-05-08T07:32:10.493 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs_common/nfsacl.o 2024-05-08T07:32:10.803 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/notify/notification.o 2024-05-08T07:32:11.089 INFO:tasks.workunit.client.0.smithi070.stdout: LDS arch/x86/entry/vdso/vdso32/vdso32.lds 2024-05-08T07:32:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:11 smithi194 ceph-mon[33679]: pgmap v1448: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 560 KiB/s wr, 331 op/s 2024-05-08T07:32:11.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:11 smithi070 ceph-mon[29591]: pgmap v1448: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 560 KiB/s wr, 331 op/s 2024-05-08T07:32:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:11 smithi172 ceph-mon[33377]: pgmap v1448: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 560 KiB/s wr, 331 op/s 2024-05-08T07:32:11.746 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/entry/vdso/vdso32/note.o 2024-05-08T07:32:12.036 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/entry/vdso/vdso32/system_call.o 2024-05-08T07:32:12.098 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-08T07:32:12.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:32:12.671 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/entry/vdso/vdso32/sigreturn.o 2024-05-08T07:32:12.699 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:32:12.776 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/sem.o 2024-05-08T07:32:13.279 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vdso/vdso32/vclock_gettime.o 2024-05-08T07:32:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:13 smithi194 ceph-mon[33679]: pgmap v1449: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 554 KiB/s wr, 342 op/s 2024-05-08T07:32:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:13 smithi194 ceph-mon[33679]: osdmap e171: 12 total, 12 up, 12 in 2024-05-08T07:32:13.526 INFO:tasks.workunit.client.0.smithi070.stdout: CC init/initramfs.o 2024-05-08T07:32:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:13 smithi070 ceph-mon[29591]: pgmap v1449: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 554 KiB/s wr, 342 op/s 2024-05-08T07:32:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:13 smithi070 ceph-mon[29591]: osdmap e171: 12 total, 12 up, 12 in 2024-05-08T07:32:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:13 smithi172 ceph-mon[33377]: pgmap v1449: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 554 KiB/s wr, 342 op/s 2024-05-08T07:32:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:13 smithi172 ceph-mon[33377]: osdmap e171: 12 total, 12 up, 12 in 2024-05-08T07:32:15.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:15 smithi194 ceph-mon[33679]: pgmap v1451: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 275 KiB/s wr, 231 op/s 2024-05-08T07:32:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:15 smithi070 ceph-mon[29591]: pgmap v1451: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 275 KiB/s wr, 231 op/s 2024-05-08T07:32:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:15 smithi172 ceph-mon[33377]: pgmap v1451: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 275 KiB/s wr, 231 op/s 2024-05-08T07:32:16.322 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/sched/build_policy.o 2024-05-08T07:32:17.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:17 smithi194 ceph-mon[33679]: pgmap v1452: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 421 KiB/s wr, 243 op/s 2024-05-08T07:32:17.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:17 smithi070 ceph-mon[29591]: pgmap v1452: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 421 KiB/s wr, 243 op/s 2024-05-08T07:32:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:17 smithi172 ceph-mon[33377]: pgmap v1452: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 421 KiB/s wr, 243 op/s 2024-05-08T07:32:17.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.794+0000 7fd378200700 1 -- 172.21.15.70:0/13053832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370103ef0 msgr2=0x7fd3701103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:17.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.794+0000 7fd378200700 1 --2- 172.21.15.70:0/13053832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370103ef0 0x7fd3701103d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd36800b0a0 tx=0x7fd36800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:32:17.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.795+0000 7fd378200700 1 -- 172.21.15.70:0/13053832 shutdown_connections 2024-05-08T07:32:17.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.795+0000 7fd378200700 1 --2- 172.21.15.70:0/13053832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370103ef0 0x7fd3701103d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:17.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.795+0000 7fd378200700 1 --2- 172.21.15.70:0/13053832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd370108460 0x7fd370108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:17.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.795+0000 7fd378200700 1 --2- 172.21.15.70:0/13053832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd370103550 0x7fd3701039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:17.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.795+0000 7fd378200700 1 -- 172.21.15.70:0/13053832 >> 172.21.15.70:0/13053832 conn(0x7fd37007a600 msgr2=0x7fd37007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:32:17.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.795+0000 7fd378200700 1 -- 172.21.15.70:0/13053832 shutdown_connections 2024-05-08T07:32:17.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.795+0000 7fd378200700 1 -- 172.21.15.70:0/13053832 wait complete. 2024-05-08T07:32:17.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.796+0000 7fd378200700 1 Processor -- start 2024-05-08T07:32:17.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.797+0000 7fd378200700 1 -- start start 2024-05-08T07:32:17.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.797+0000 7fd378200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd370103550 0x7fd3701a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:17.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.797+0000 7fd378200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd370103ef0 0x7fd3701a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:17.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.797+0000 7fd378200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370108460 0x7fd37010f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:17.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.797+0000 7fd378200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd3701135b0 con 0x7fd370108460 2024-05-08T07:32:17.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.797+0000 7fd378200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd370113430 con 0x7fd370103ef0 2024-05-08T07:32:17.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.797+0000 7fd378200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd370113730 con 0x7fd370103550 2024-05-08T07:32:17.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd376200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370108460 0x7fd37010f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:17.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd374e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd370103ef0 0x7fd3701a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:17.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd376200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370108460 0x7fd37010f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39016/0 (socket says 172.21.15.70:39016) 2024-05-08T07:32:17.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd376200700 1 -- 172.21.15.70:0/4132186868 learned_addr learned my addr 172.21.15.70:0/4132186868 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:32:17.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd375800700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd370103550 0x7fd3701a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:17.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd376200700 1 -- 172.21.15.70:0/4132186868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd370103550 msgr2=0x7fd3701a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:17.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd376200700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd370103550 0x7fd3701a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:17.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd376200700 1 -- 172.21.15.70:0/4132186868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd370103ef0 msgr2=0x7fd3701a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:17.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd376200700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd370103ef0 0x7fd3701a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:17.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.798+0000 7fd376200700 1 -- 172.21.15.70:0/4132186868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37010fef0 con 0x7fd370108460 2024-05-08T07:32:17.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.799+0000 7fd376200700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370108460 0x7fd37010f620 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd36800b070 tx=0x7fd368004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:32:17.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.799+0000 7fd36e000700 1 -- 172.21.15.70:0/4132186868 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368021070 con 0x7fd370108460 2024-05-08T07:32:17.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.799+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd370110180 con 0x7fd370108460 2024-05-08T07:32:17.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.799+0000 7fd36e000700 1 -- 172.21.15.70:0/4132186868 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd368007b80 con 0x7fd370108460 2024-05-08T07:32:17.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.799+0000 7fd36e000700 1 -- 172.21.15.70:0/4132186868 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd368004540 con 0x7fd370108460 2024-05-08T07:32:17.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.799+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37019c370 con 0x7fd370108460 2024-05-08T07:32:17.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.801+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37006a190 con 0x7fd370108460 2024-05-08T07:32:17.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.805+0000 7fd36e000700 1 -- 172.21.15.70:0/4132186868 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd3680046e0 con 0x7fd370108460 2024-05-08T07:32:17.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.807+0000 7fd36e000700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3580b2af0 0x7fd3580b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:17.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.807+0000 7fd36e000700 1 -- 172.21.15.70:0/4132186868 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 9583+0+0 (secure 0 0 0) 0x7fd3680e38c0 con 0x7fd370108460 2024-05-08T07:32:17.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.807+0000 7fd375800700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3580b2af0 0x7fd3580b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:17.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.809+0000 7fd375800700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3580b2af0 0x7fd3580b4fb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd370104730 tx=0x7fd36400b410 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:32:17.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:17.814+0000 7fd36e000700 1 -- 172.21.15.70:0/4132186868 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd3680aaeb0 con 0x7fd370108460 2024-05-08T07:32:18.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.312+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd37019c690 con 0x7fd370108460 2024-05-08T07:32:18.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.314+0000 7fd36e000700 1 -- 172.21.15.70:0/4132186868 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fd3680aa7b0 con 0x7fd370108460 2024-05-08T07:32:18.312 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:32:18.313 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.318+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3580b2af0 msgr2=0x7fd3580b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.318+0000 7fd378200700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3580b2af0 0x7fd3580b4fb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd370104730 tx=0x7fd36400b410 comp rx=0 tx=0).stop 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.318+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370108460 msgr2=0x7fd37010f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.318+0000 7fd378200700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370108460 0x7fd37010f620 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fd36800b070 tx=0x7fd368004c60 comp rx=0 tx=0).stop 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.319+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 shutdown_connections 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.319+0000 7fd378200700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3580b2af0 0x7fd3580b4fb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.319+0000 7fd378200700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd370108460 0x7fd37010f620 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.319+0000 7fd378200700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd370103550 0x7fd3701a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.319+0000 7fd378200700 1 --2- 172.21.15.70:0/4132186868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd370103ef0 0x7fd3701a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.319+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 >> 172.21.15.70:0/4132186868 conn(0x7fd37007a600 msgr2=0x7fd3701013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:32:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.319+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 shutdown_connections 2024-05-08T07:32:18.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:18.319+0000 7fd378200700 1 -- 172.21.15.70:0/4132186868 wait complete. 2024-05-08T07:32:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:32:18.587 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/maccess.o 2024-05-08T07:32:19.193 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-05-08T07:32:19.193 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-05-08T07:32:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:19 smithi194 ceph-mon[33679]: pgmap v1453: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 421 KiB/s wr, 243 op/s 2024-05-08T07:32:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:19 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4132186868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:32:19.607 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:19 smithi070 ceph-mon[29591]: pgmap v1453: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 421 KiB/s wr, 243 op/s 2024-05-08T07:32:19.608 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:19 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4132186868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:32:19.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:19 smithi172 ceph-mon[33377]: pgmap v1453: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 421 KiB/s wr, 243 op/s 2024-05-08T07:32:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:19 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4132186868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:32:19.794 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:32:19.986 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs_common/grace.o 2024-05-08T07:32:19.997 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/notify/group.o 2024-05-08T07:32:21.012 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/locking/semaphore.o 2024-05-08T07:32:21.407 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vdso/vdso32/vgetcpu.o 2024-05-08T07:32:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:21 smithi194 ceph-mon[33679]: pgmap v1454: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 273 KiB/s wr, 240 op/s 2024-05-08T07:32:21.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:21 smithi070 ceph-mon[29591]: pgmap v1454: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 273 KiB/s wr, 240 op/s 2024-05-08T07:32:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:21 smithi172 ceph-mon[33377]: pgmap v1454: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 273 KiB/s wr, 240 op/s 2024-05-08T07:32:23.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:23 smithi194 ceph-mon[33679]: pgmap v1455: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 409 KiB/s wr, 227 op/s 2024-05-08T07:32:23.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:23 smithi070 ceph-mon[29591]: pgmap v1455: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 409 KiB/s wr, 227 op/s 2024-05-08T07:32:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:23 smithi172 ceph-mon[33377]: pgmap v1455: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 409 KiB/s wr, 227 op/s 2024-05-08T07:32:24.000 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/shm.o 2024-05-08T07:32:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:25 smithi194 ceph-mon[33679]: pgmap v1456: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 374 KiB/s wr, 208 op/s 2024-05-08T07:32:25.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:25 smithi070 ceph-mon[29591]: pgmap v1456: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 374 KiB/s wr, 208 op/s 2024-05-08T07:32:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:25 smithi172 ceph-mon[33377]: pgmap v1456: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 374 KiB/s wr, 208 op/s 2024-05-08T07:32:26.527 INFO:tasks.workunit.client.0.smithi070.stdout: VDSO arch/x86/entry/vdso/vdso64.so.dbg 2024-05-08T07:32:26.983 INFO:tasks.workunit.client.0.smithi070.stdout: VDSO arch/x86/entry/vdso/vdso32.so.dbg 2024-05-08T07:32:27.396 INFO:tasks.workunit.client.0.smithi070.stdout: OBJCOPY arch/x86/entry/vdso/vdso64.so 2024-05-08T07:32:27.471 INFO:tasks.workunit.client.0.smithi070.stdout: OBJCOPY arch/x86/entry/vdso/vdso32.so 2024-05-08T07:32:27.494 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:27 smithi070 ceph-mon[29591]: pgmap v1457: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 443 KiB/s wr, 190 op/s 2024-05-08T07:32:27.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:27 smithi194 ceph-mon[33679]: pgmap v1457: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 443 KiB/s wr, 190 op/s 2024-05-08T07:32:27.552 INFO:tasks.workunit.client.0.smithi070.stdout: VDSO2C arch/x86/entry/vdso/vdso-image-64.c 2024-05-08T07:32:27.611 INFO:tasks.workunit.client.0.smithi070.stdout: VDSO2C arch/x86/entry/vdso/vdso-image-32.c 2024-05-08T07:32:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:27 smithi172 ceph-mon[33377]: pgmap v1457: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 443 KiB/s wr, 190 op/s 2024-05-08T07:32:27.686 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vdso/vdso-image-64.o 2024-05-08T07:32:28.063 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/page-writeback.o 2024-05-08T07:32:28.237 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/notify/mark.o 2024-05-08T07:32:28.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.368+0000 7f87f9e00700 1 -- 172.21.15.70:0/3529688868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f4103ef0 msgr2=0x7f87f41103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:28.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.368+0000 7f87f9e00700 1 --2- 172.21.15.70:0/3529688868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f4103ef0 0x7f87f41103d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00b0a0 tx=0x7f87ec00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.368+0000 7f87f9e00700 1 -- 172.21.15.70:0/3529688868 shutdown_connections 2024-05-08T07:32:28.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.368+0000 7f87f9e00700 1 --2- 172.21.15.70:0/3529688868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f4103ef0 0x7f87f41103d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.368+0000 7f87f9e00700 1 --2- 172.21.15.70:0/3529688868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4108460 0x7f87f4108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.368+0000 7f87f9e00700 1 --2- 172.21.15.70:0/3529688868 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4103550 0x7f87f41039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.368+0000 7f87f9e00700 1 -- 172.21.15.70:0/3529688868 >> 172.21.15.70:0/3529688868 conn(0x7f87f407a600 msgr2=0x7f87f407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:32:28.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.368+0000 7f87f9e00700 1 -- 172.21.15.70:0/3529688868 shutdown_connections 2024-05-08T07:32:28.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.368+0000 7f87f9e00700 1 -- 172.21.15.70:0/3529688868 wait complete. 2024-05-08T07:32:28.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.370+0000 7f87f9e00700 1 Processor -- start 2024-05-08T07:32:28.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.371+0000 7f87f9e00700 1 -- start start 2024-05-08T07:32:28.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.371+0000 7f87f9e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4103550 0x7f87f41a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.371+0000 7f87f9e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4103ef0 0x7f87f41a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.372+0000 7f87f9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f4108460 0x7f87f410f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.372+0000 7f87f9e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87f4113630 con 0x7f87f4108460 2024-05-08T07:32:28.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.372+0000 7f87f2000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4103ef0 0x7f87f41a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.372+0000 7f87f2000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4103ef0 0x7f87f41a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:46074/0 (socket says 172.21.15.70:46074) 2024-05-08T07:32:28.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.372+0000 7f87f2000700 1 -- 172.21.15.70:0/2188892018 learned_addr learned my addr 172.21.15.70:0/2188892018 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:32:28.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.372+0000 7f87f9e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41134b0 con 0x7f87f4103550 2024-05-08T07:32:28.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.372+0000 7f87f9e00700 1 -- 172.21.15.70:0/2188892018 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41137b0 con 0x7f87f4103ef0 2024-05-08T07:32:28.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.372+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4103550 0x7f87f41a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.372+0000 7f87f3400700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f4108460 0x7f87f410f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.373+0000 7f87f2000700 1 -- 172.21.15.70:0/2188892018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4103550 msgr2=0x7f87f41a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:28.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.373+0000 7f87f2000700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4103550 0x7f87f41a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.373+0000 7f87f2000700 1 -- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f4108460 msgr2=0x7f87f410f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:28.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.373+0000 7f87f2000700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f4108460 0x7f87f410f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.373+0000 7f87f2000700 1 -- 172.21.15.70:0/2188892018 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f410fd00 con 0x7f87f4103ef0 2024-05-08T07:32:28.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.373+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4103550 0x7f87f41a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:32:28.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.373+0000 7f87f2000700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4103ef0 0x7f87f41a0c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f87e000d950 tx=0x7f87e000dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:32:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.374+0000 7f87f8a00700 1 -- 172.21.15.70:0/2188892018 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0016070 con 0x7f87f4103ef0 2024-05-08T07:32:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.374+0000 7f87f8a00700 1 -- 172.21.15.70:0/2188892018 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87e0010460 con 0x7f87f4103ef0 2024-05-08T07:32:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.374+0000 7f87f9e00700 1 -- 172.21.15.70:0/2188892018 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f410fff0 con 0x7f87f4103ef0 2024-05-08T07:32:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.374+0000 7f87f8a00700 1 -- 172.21.15.70:0/2188892018 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e000f620 con 0x7f87f4103ef0 2024-05-08T07:32:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.374+0000 7f87f9e00700 1 -- 172.21.15.70:0/2188892018 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f419c2f0 con 0x7f87f4103ef0 2024-05-08T07:32:28.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.381+0000 7f87f8a00700 1 -- 172.21.15.70:0/2188892018 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f87e0019070 con 0x7f87f4103ef0 2024-05-08T07:32:28.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.383+0000 7f87f8a00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87d80b2b20 0x7f87d80b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.383+0000 7f87f8a00700 1 -- 172.21.15.70:0/2188892018 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 9583+0+0 (secure 0 0 0) 0x7f87e00e25c0 con 0x7f87f4103ef0 2024-05-08T07:32:28.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.383+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87d80b2b20 0x7f87d80b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.384+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87d80b2b20 0x7f87d80b4fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f87f4104730 tx=0x7f87e4008040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:32:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.393+0000 7f88047e5b80 1 Processor -- start 2024-05-08T07:32:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.393+0000 7f88047e5b80 1 -- start start 2024-05-08T07:32:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba97f50 0x55fedba98330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba92520 0x55fedba929a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedba9ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f88047e5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fedb9e4bb0 con 0x55fedba92520 2024-05-08T07:32:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f88047e5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fedb9828f0 con 0x55fedba92ee0 2024-05-08T07:32:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f88047e5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fedb9e0b70 con 0x55fedba97f50 2024-05-08T07:32:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f87f2000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba92520 0x55fedba929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f87f2000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba92520 0x55fedba929a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50660/0 (socket says 172.21.15.70:50660) 2024-05-08T07:32:28.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f87f2000700 1 -- 172.21.15.70:0/2260222778 learned_addr learned my addr 172.21.15.70:0/2260222778 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:32:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.394+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba97f50 0x55fedba98330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.395+0000 7f87f3400700 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedba9ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.395+0000 7f87f2a00700 1 -- 172.21.15.70:0/2260222778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 msgr2=0x55fedba9ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:32:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.395+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedba9ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.395+0000 7f87f2a00700 1 -- 172.21.15.70:0/2260222778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba92520 msgr2=0x55fedba929a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:32:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.395+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba92520 0x55fedba929a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.395+0000 7f87f2a00700 1 -- 172.21.15.70:0/2260222778 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fedb931a60 con 0x55fedba97f50 2024-05-08T07:32:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.395+0000 7f87f2000700 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba92520 0x55fedba929a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:32:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.396+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba97f50 0x55fedba98330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87e400d440 tx=0x7f87e4010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d25e23b6fb98fe7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:32:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.396+0000 7f87e8c00700 1 -- 172.21.15.70:0/2260222778 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4024070 con 0x55fedba97f50 2024-05-08T07:32:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.396+0000 7f87e8c00700 1 -- 172.21.15.70:0/2260222778 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87e4014ad0 con 0x55fedba97f50 2024-05-08T07:32:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.396+0000 7f87e8c00700 1 -- 172.21.15.70:0/2260222778 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e401f870 con 0x55fedba97f50 2024-05-08T07:32:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.397+0000 7f88047e5b80 1 -- 172.21.15.70:0/2260222778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba97f50 msgr2=0x55fedba98330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.397+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba97f50 0x55fedba98330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f87e400d440 tx=0x7f87e4010000 comp rx=0 tx=0).stop 2024-05-08T07:32:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.398+0000 7f88047e5b80 1 -- 172.21.15.70:0/2260222778 shutdown_connections 2024-05-08T07:32:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.398+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedba9ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.398+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba97f50 0x55fedba98330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.398+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2260222778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba92520 0x55fedba929a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.398+0000 7f88047e5b80 1 -- 172.21.15.70:0/2260222778 >> 172.21.15.70:0/2260222778 conn(0x55fedb9c0cf0 msgr2=0x55fedba8ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:32:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.398+0000 7f88047e5b80 1 -- 172.21.15.70:0/2260222778 shutdown_connections 2024-05-08T07:32:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.398+0000 7f88047e5b80 1 -- 172.21.15.70:0/2260222778 wait complete. 2024-05-08T07:32:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.399+0000 7f88047e5b80 1 -- start start 2024-05-08T07:32:28.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.399+0000 7f88047e5b80 1 Processor -- start 2024-05-08T07:32:28.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.400+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92520 0x55fedba9e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.400+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba92ee0 0x55fedba9bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.400+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.400+0000 7f88047e5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fedba9f310 con 0x55fedba97f50 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.400+0000 7f88047e5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fedb94acb0 con 0x55fedba92520 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.400+0000 7f88047e5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fedba9f490 con 0x55fedba92ee0 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.401+0000 7f87f2a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92520 0x55fedba9e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.401+0000 7f87f2a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92520 0x55fedba9e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:56960/0 (socket says 172.21.15.70:56960) 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.401+0000 7f87f2a00700 1 -- 172.21.15.70:0/93300162 learned_addr learned my addr 172.21.15.70:0/93300162 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.401+0000 7f88047e5b80 10 client.0 _ll_register_callbacks cb 0x55fedb98be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.401+0000 7f87f3400700 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.401+0000 7f87f2000700 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba92ee0 0x55fedba9bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.402+0000 7f87f2a00700 1 -- 172.21.15.70:0/93300162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba92ee0 msgr2=0x55fedba9bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:32:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.402+0000 7f87f2a00700 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba92ee0 0x55fedba9bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.402+0000 7f87f2a00700 1 -- 172.21.15.70:0/93300162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 msgr2=0x55fedba9c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:32:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.402+0000 7f87f2a00700 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.402+0000 7f87f2a00700 1 -- 172.21.15.70:0/93300162 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fedb9aa5b0 con 0x55fedba92520 2024-05-08T07:32:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.402+0000 7f87f3400700 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:32:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.403+0000 7f87f2a00700 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92520 0x55fedba9e990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f87e4022040 tx=0x7f87e40148f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=359bae42292cdf5d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:32:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.403+0000 7f87dd600700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T07:32:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.403+0000 7f87dd600700 1 -- 172.21.15.70:0/93300162 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e4024040 con 0x55fedba92520 2024-05-08T07:32:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.404+0000 7f88047e5b80 1 -- 172.21.15.70:0/93300162 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87e4014ad0 con 0x55fedba92520 2024-05-08T07:32:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.404+0000 7f87dd600700 1 -- 172.21.15.70:0/93300162 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 9583+0+0 (secure 0 0 0) 0x7f87e4005a50 con 0x55fedba92520 2024-05-08T07:32:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.405+0000 7f87dd600700 1 -- 172.21.15.70:0/93300162 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f87e4035050 con 0x55fedba92520 2024-05-08T07:32:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.405+0000 7f88047e5b80 10 client.35873 fetch_fsmap learned FSMap version 42 2024-05-08T07:32:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.405+0000 7f88047e5b80 1 -- 172.21.15.70:0/93300162 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fedbaa9b60 con 0x55fedba92520 2024-05-08T07:32:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.405+0000 7f87dd600700 1 -- 172.21.15.70:0/93300162 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87e4014ad0 con 0x55fedba92520 2024-05-08T07:32:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.406+0000 7f87dd600700 1 -- 172.21.15.70:0/93300162 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f87e4013070 con 0x55fedba92520 2024-05-08T07:32:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.406+0000 7f88047e5b80 10 client.35873 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:32:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.406+0000 7f88047e5b80 10 client.35873 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:32:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.406+0000 7f88047e5b80 20 client.35873 populate_metadata read hostname 'smithi070' 2024-05-08T07:32:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.406+0000 7f88047e5b80 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fedbaac090 0x55fedbaae480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.406+0000 7f88047e5b80 4 client.35873 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:32:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.406+0000 7f88047e5b80 1 -- 172.21.15.70:0/93300162 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fedba5f230 con 0x55fedbaac090 2024-05-08T07:32:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.407+0000 7f87f2000700 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fedbaac090 0x55fedbaae480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.408+0000 7f87f2000700 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fedbaac090 0x55fedbaae480 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f56ae0b421e4dde7 server_cookie=3820414e3abec910 in_seq=0 out_seq=0 2024-05-08T07:32:28.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.408+0000 7f87dd600700 10 client.35873 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:32:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f87dd600700 1 -- 172.21.15.70:0/93300162 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fedba5f230 con 0x55fedbaac090 2024-05-08T07:32:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f87dd600700 10 client.35873 handle_command_reply: tid=0 2024-05-08T07:32:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f88047e5b80 1 client.35873 shutdown 2024-05-08T07:32:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f88047e5b80 1 -- 172.21.15.70:0/93300162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92520 msgr2=0x55fedba9e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f88047e5b80 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92520 0x55fedba9e990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f87e4022040 tx=0x7f87e40148f0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f88047e5b80 1 -- 172.21.15.70:0/93300162 shutdown_connections 2024-05-08T07:32:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f88047e5b80 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fedbaac090 0x55fedbaae480 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f88047e5b80 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f88047e5b80 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92520 0x55fedba9e990 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f87e4022040 tx=0x7f87e40148f0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f88047e5b80 1 --2- 172.21.15.70:0/93300162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba92ee0 0x55fedba9bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f88047e5b80 1 -- 172.21.15.70:0/93300162 >> 172.21.15.70:0/93300162 conn(0x55fedb9c0cf0 msgr2=0x55fedba878e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:32:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.411+0000 7f87dd600700 0 client.35873 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:32:28.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.412+0000 7f88047e5b80 1 -- 172.21.15.70:0/93300162 shutdown_connections 2024-05-08T07:32:28.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.412+0000 7f88047e5b80 1 -- 172.21.15.70:0/93300162 wait complete. 2024-05-08T07:32:28.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.412+0000 7f88047e5b80 20 client.35873 trim_cache size 0 max 16384 2024-05-08T07:32:28.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.450+0000 7f88047e5b80 1 Processor -- start 2024-05-08T07:32:28.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.450+0000 7f88047e5b80 1 -- start start 2024-05-08T07:32:28.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.450+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedbaa8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.450+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.450+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbab3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.450+0000 7f88047e5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41c0e00 con 0x55fedba97f50 2024-05-08T07:32:28.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.450+0000 7f88047e5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41be690 con 0x55fedba92ee0 2024-05-08T07:32:28.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.450+0000 7f88047e5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41bc500 con 0x55fedba9e340 2024-05-08T07:32:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.451+0000 7f87f2000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.451+0000 7f87f2a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedbaa8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.451+0000 7f87f2000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50666/0 (socket says 172.21.15.70:50666) 2024-05-08T07:32:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.451+0000 7f87f3400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbab3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.451+0000 7f87f2000700 1 -- 172.21.15.70:0/3130275582 learned_addr learned my addr 172.21.15.70:0/3130275582 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:32:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.452+0000 7f87f2000700 1 -- 172.21.15.70:0/3130275582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 msgr2=0x55fedbab3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:32:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.452+0000 7f87f2000700 1 --2- 172.21.15.70:0/3130275582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbab3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.452+0000 7f87f2000700 1 -- 172.21.15.70:0/3130275582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 msgr2=0x55fedbaa8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:32:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.452+0000 7f87f2000700 1 --2- 172.21.15.70:0/3130275582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedbaa8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.452+0000 7f87f2000700 1 -- 172.21.15.70:0/3130275582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fedbaaea10 con 0x55fedba97f50 2024-05-08T07:32:28.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.453+0000 7f87f2000700 1 --2- 172.21.15.70:0/3130275582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9ac00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f87e00a5500 tx=0x7f87e0091040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f30d8eba3321f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:32:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.453+0000 7f87dfe00700 1 -- 172.21.15.70:0/3130275582 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e00c3070 con 0x55fedba97f50 2024-05-08T07:32:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.453+0000 7f87dfe00700 1 -- 172.21.15.70:0/3130275582 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87e00b22e0 con 0x55fedba97f50 2024-05-08T07:32:28.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.453+0000 7f87dfe00700 1 -- 172.21.15.70:0/3130275582 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0014030 con 0x55fedba97f50 2024-05-08T07:32:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.454+0000 7f88047e5b80 1 -- 172.21.15.70:0/3130275582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 msgr2=0x55fedba9ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:32:28.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.454+0000 7f88047e5b80 1 --2- 172.21.15.70:0/3130275582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9ac00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f87e00a5500 tx=0x7f87e0091040 comp rx=0 tx=0).stop 2024-05-08T07:32:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.454+0000 7f88047e5b80 1 -- 172.21.15.70:0/3130275582 shutdown_connections 2024-05-08T07:32:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.454+0000 7f88047e5b80 1 --2- 172.21.15.70:0/3130275582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbab3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.454+0000 7f88047e5b80 1 --2- 172.21.15.70:0/3130275582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedbaa8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.454+0000 7f88047e5b80 1 --2- 172.21.15.70:0/3130275582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedba97f50 0x55fedba9ac00 secure :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f87e00a5500 tx=0x7f87e0091040 comp rx=0 tx=0).stop 2024-05-08T07:32:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.454+0000 7f88047e5b80 1 -- 172.21.15.70:0/3130275582 >> 172.21.15.70:0/3130275582 conn(0x55fedb9c0cf0 msgr2=0x55fedba9a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:32:28.454 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/locking/rwsem.o 2024-05-08T07:32:28.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.455+0000 7f88047e5b80 1 -- 172.21.15.70:0/3130275582 shutdown_connections 2024-05-08T07:32:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.455+0000 7f88047e5b80 1 -- 172.21.15.70:0/3130275582 wait complete. 2024-05-08T07:32:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.456+0000 7f88047e5b80 1 -- start start 2024-05-08T07:32:28.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.456+0000 7f88047e5b80 1 Processor -- start 2024-05-08T07:32:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.457+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedbaa18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.457+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbaa1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.457+0000 7f88047e5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedbb147f0 0x55fedbb16be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.457+0000 7f88047e5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41bcb50 con 0x55fedbb147f0 2024-05-08T07:32:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.457+0000 7f88047e5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41bdfc0 con 0x55fedba92ee0 2024-05-08T07:32:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.457+0000 7f88047e5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f87f41bd220 con 0x55fedba9e340 2024-05-08T07:32:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.457+0000 7f88047e5b80 10 client.0 _ll_register_callbacks cb 0x55fedb98be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:32:28.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.458+0000 7f87f2000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbaa1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.458+0000 7f87f2000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbaa1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:46100/0 (socket says 172.21.15.70:46100) 2024-05-08T07:32:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.458+0000 7f87f2000700 1 -- 172.21.15.70:0/2400630413 learned_addr learned my addr 172.21.15.70:0/2400630413 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:32:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.458+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedbaa18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.458+0000 7f87f3400700 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedbb147f0 0x55fedbb16be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.459+0000 7f87f2000700 1 -- 172.21.15.70:0/2400630413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 msgr2=0x55fedbaa18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:32:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.459+0000 7f87f2000700 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedbaa18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.459+0000 7f87f2000700 1 -- 172.21.15.70:0/2400630413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedbb147f0 msgr2=0x55fedbb16be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:32:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.459+0000 7f87f2000700 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedbb147f0 0x55fedbb16be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:32:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.459+0000 7f87f2000700 1 -- 172.21.15.70:0/2400630413 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fedba9f190 con 0x55fedba9e340 2024-05-08T07:32:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.459+0000 7f87f2000700 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbaa1e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f87e000b2f0 tx=0x7f87e00a5940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4731f8cb26f5e1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:32:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.459+0000 7f87dd600700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T07:32:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.460+0000 7f87dd600700 1 -- 172.21.15.70:0/2400630413 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0014070 con 0x55fedba9e340 2024-05-08T07:32:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.460+0000 7f87dd600700 1 -- 172.21.15.70:0/2400630413 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(171..171 src has 1..171) ==== 9583+0+0 (secure 0 0 0) 0x7f87e00a96e0 con 0x55fedba9e340 2024-05-08T07:32:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.461+0000 7f88047e5b80 1 -- 172.21.15.70:0/2400630413 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87e00b22e0 con 0x55fedba9e340 2024-05-08T07:32:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.461+0000 7f87dd600700 1 -- 172.21.15.70:0/2400630413 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f87e00c3070 con 0x55fedba9e340 2024-05-08T07:32:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.461+0000 7f88047e5b80 10 client.25954 fetch_fsmap learned FSMap version 42 2024-05-08T07:32:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.461+0000 7f88047e5b80 1 -- 172.21.15.70:0/2400630413 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fedba89a10 con 0x55fedba9e340 2024-05-08T07:32:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.462+0000 7f87dd600700 1 -- 172.21.15.70:0/2400630413 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87e00b22e0 con 0x55fedba9e340 2024-05-08T07:32:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.462+0000 7f87dd600700 1 -- 172.21.15.70:0/2400630413 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f87e00b0bb0 con 0x55fedba9e340 2024-05-08T07:32:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.462+0000 7f88047e5b80 10 client.25954 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:32:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.462+0000 7f88047e5b80 10 client.25954 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:32:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.462+0000 7f88047e5b80 20 client.25954 populate_metadata read hostname 'smithi070' 2024-05-08T07:32:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.462+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fedbb295d0 0x55fedbb2b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:32:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.462+0000 7f88047e5b80 4 client.25954 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-05-08T07:32:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.462+0000 7f88047e5b80 1 -- 172.21.15.70:0/2400630413 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x55fedb9f2590 con 0x55fedbb295d0 2024-05-08T07:32:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.463+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fedbb295d0 0x55fedbb2b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:32:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.464+0000 7f87f2a00700 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fedbb295d0 0x55fedbb2b9f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4726a6f958c889a server_cookie=b2f6e610131d82a in_seq=0 out_seq=0 2024-05-08T07:32:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:32:28.464+0000 7f87dd600700 10 client.25954 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:32:28.596 INFO:tasks.workunit.client.0.smithi070.stdout: CC init/calibrate.o 2024-05-08T07:32:28.672 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/nfs_common/built-in.a 2024-05-08T07:32:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:29 smithi070 ceph-mon[29591]: pgmap v1458: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 271 KiB/s wr, 136 op/s 2024-05-08T07:32:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:29 smithi172 ceph-mon[33377]: pgmap v1458: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 271 KiB/s wr, 136 op/s 2024-05-08T07:32:29.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:29 smithi194 ceph-mon[33679]: pgmap v1458: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 271 KiB/s wr, 136 op/s 2024-05-08T07:32:31.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:31 smithi070 ceph-mon[29591]: pgmap v1459: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 321 KiB/s wr, 183 op/s 2024-05-08T07:32:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:31 smithi172 ceph-mon[33377]: pgmap v1459: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 321 KiB/s wr, 183 op/s 2024-05-08T07:32:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:31 smithi194 ceph-mon[33679]: pgmap v1459: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 321 KiB/s wr, 183 op/s 2024-05-08T07:32:33.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:33 smithi070 ceph-mon[29591]: pgmap v1460: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 457 KiB/s wr, 126 op/s 2024-05-08T07:32:33.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:33 smithi172 ceph-mon[33377]: pgmap v1460: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 457 KiB/s wr, 126 op/s 2024-05-08T07:32:33.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:33 smithi194 ceph-mon[33679]: pgmap v1460: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 457 KiB/s wr, 126 op/s 2024-05-08T07:32:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:35 smithi070 ceph-mon[29591]: pgmap v1461: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 365 KiB/s wr, 113 op/s 2024-05-08T07:32:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:35 smithi172 ceph-mon[33377]: pgmap v1461: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 365 KiB/s wr, 113 op/s 2024-05-08T07:32:35.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:35 smithi194 ceph-mon[33679]: pgmap v1461: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 365 KiB/s wr, 113 op/s 2024-05-08T07:32:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:37 smithi070 ceph-mon[29591]: pgmap v1462: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 385 KiB/s wr, 233 op/s 2024-05-08T07:32:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:37 smithi172 ceph-mon[33377]: pgmap v1462: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 385 KiB/s wr, 233 op/s 2024-05-08T07:32:37.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:37 smithi194 ceph-mon[33679]: pgmap v1462: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 385 KiB/s wr, 233 op/s 2024-05-08T07:32:39.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:39 smithi070 ceph-mon[29591]: pgmap v1463: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 280 KiB/s wr, 224 op/s 2024-05-08T07:32:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:39 smithi172 ceph-mon[33377]: pgmap v1463: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 280 KiB/s wr, 224 op/s 2024-05-08T07:32:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:39 smithi194 ceph-mon[33679]: pgmap v1463: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 280 KiB/s wr, 224 op/s 2024-05-08T07:32:41.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:41 smithi070 ceph-mon[29591]: pgmap v1464: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 296 KiB/s wr, 226 op/s 2024-05-08T07:32:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:41 smithi172 ceph-mon[33377]: pgmap v1464: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 296 KiB/s wr, 226 op/s 2024-05-08T07:32:41.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:41 smithi194 ceph-mon[33679]: pgmap v1464: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 296 KiB/s wr, 226 op/s 2024-05-08T07:32:43.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:43 smithi070 ceph-mon[29591]: pgmap v1465: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 245 KiB/s wr, 181 op/s 2024-05-08T07:32:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:43 smithi172 ceph-mon[33377]: pgmap v1465: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 245 KiB/s wr, 181 op/s 2024-05-08T07:32:43.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:43 smithi194 ceph-mon[33679]: pgmap v1465: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 245 KiB/s wr, 181 op/s 2024-05-08T07:32:45.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:45 smithi070 ceph-mon[29591]: pgmap v1466: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 117 KiB/s wr, 146 op/s 2024-05-08T07:32:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:45 smithi172 ceph-mon[33377]: pgmap v1466: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 117 KiB/s wr, 146 op/s 2024-05-08T07:32:45.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:45 smithi194 ceph-mon[33679]: pgmap v1466: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 117 KiB/s wr, 146 op/s 2024-05-08T07:32:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:47 smithi070 ceph-mon[29591]: pgmap v1467: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 131 op/s 2024-05-08T07:32:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:47 smithi172 ceph-mon[33377]: pgmap v1467: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 131 op/s 2024-05-08T07:32:47.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:47 smithi194 ceph-mon[33679]: pgmap v1467: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 131 op/s 2024-05-08T07:32:49.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:49 smithi070 ceph-mon[29591]: pgmap v1468: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 55 KiB/s wr, 10 op/s 2024-05-08T07:32:49.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:49 smithi172 ceph-mon[33377]: pgmap v1468: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 55 KiB/s wr, 10 op/s 2024-05-08T07:32:49.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:49 smithi194 ceph-mon[33679]: pgmap v1468: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 55 KiB/s wr, 10 op/s 2024-05-08T07:32:51.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:51 smithi070 ceph-mon[29591]: pgmap v1469: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 72 KiB/s wr, 12 op/s 2024-05-08T07:32:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:51 smithi172 ceph-mon[33377]: pgmap v1469: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 72 KiB/s wr, 12 op/s 2024-05-08T07:32:51.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:51 smithi194 ceph-mon[33679]: pgmap v1469: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 72 KiB/s wr, 12 op/s 2024-05-08T07:32:53.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:53 smithi070 ceph-mon[29591]: pgmap v1470: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 10 op/s 2024-05-08T07:32:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:53 smithi172 ceph-mon[33377]: pgmap v1470: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 10 op/s 2024-05-08T07:32:53.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:53 smithi194 ceph-mon[33679]: pgmap v1470: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 10 op/s 2024-05-08T07:32:55.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:55 smithi070 ceph-mon[29591]: pgmap v1471: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 10 op/s 2024-05-08T07:32:55.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:55 smithi172 ceph-mon[33377]: pgmap v1471: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 10 op/s 2024-05-08T07:32:55.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:55 smithi194 ceph-mon[33679]: pgmap v1471: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 74 KiB/s wr, 10 op/s 2024-05-08T07:32:57.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:57 smithi070 ceph-mon[29591]: pgmap v1472: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-05-08T07:32:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:57 smithi172 ceph-mon[33377]: pgmap v1472: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-05-08T07:32:57.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:57 smithi194 ceph-mon[33679]: pgmap v1472: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 8 op/s 2024-05-08T07:32:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:59 smithi070 ceph-mon[29591]: pgmap v1473: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2024-05-08T07:32:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:32:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:32:59.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:59 smithi172 ceph-mon[33377]: pgmap v1473: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2024-05-08T07:32:59.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:32:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:32:59.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:59 smithi194 ceph-mon[33679]: pgmap v1473: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2024-05-08T07:32:59.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:32:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:33:00.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.019+0000 7f87dd600700 1 -- 172.21.15.70:0/2400630413 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55fedb9f2590 con 0x55fedbb295d0 2024-05-08T07:33:00.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.019+0000 7f87dd600700 10 client.25954 handle_command_reply: tid=0 2024-05-08T07:33:00.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f88047e5b80 1 client.25954 shutdown 2024-05-08T07:33:00.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f88047e5b80 1 -- 172.21.15.70:0/2400630413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 msgr2=0x55fedbaa1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:00.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbaa1e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f87e000b2f0 tx=0x7f87e00a5940 comp rx=0 tx=0).stop 2024-05-08T07:33:00.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f88047e5b80 1 -- 172.21.15.70:0/2400630413 shutdown_connections 2024-05-08T07:33:00.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fedbb295d0 0x55fedbb2b9f0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:00.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fedbb147f0 0x55fedbb16be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fedba92ee0 0x55fedbaa18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f88047e5b80 1 --2- 172.21.15.70:0/2400630413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fedba9e340 0x55fedbaa1e10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f88047e5b80 1 -- 172.21.15.70:0/2400630413 >> 172.21.15.70:0/2400630413 conn(0x55fedb9c0cf0 msgr2=0x55fedba96260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.020+0000 7f87dd600700 0 client.25954 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:33:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.021+0000 7f88047e5b80 1 -- 172.21.15.70:0/2400630413 shutdown_connections 2024-05-08T07:33:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.021+0000 7f88047e5b80 1 -- 172.21.15.70:0/2400630413 wait complete. 2024-05-08T07:33:00.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.021+0000 7f88047e5b80 20 client.25954 trim_cache size 0 max 16384 2024-05-08T07:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:33:00.021 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 114, 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "b5e966ca": { 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 114, 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T07:33:00.022 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:00.023 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:33:00.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 -- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87d80b2b20 msgr2=0x7f87d80b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:00.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87d80b2b20 0x7f87d80b4fe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f87f4104730 tx=0x7f87e4008040 comp rx=0 tx=0).stop 2024-05-08T07:33:00.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 -- 172.21.15.70:0/2188892018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4103ef0 msgr2=0x7f87f41a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:00.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4103ef0 0x7f87f41a0c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f87e000d950 tx=0x7f87e000dd10 comp rx=0 tx=0).stop 2024-05-08T07:33:00.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 -- 172.21.15.70:0/2188892018 shutdown_connections 2024-05-08T07:33:00.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f87d80b2b20 0x7f87d80b4fe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:00.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f87f4108460 0x7f87f410f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:00.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f87f4103550 0x7f87f41a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:00.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 --2- 172.21.15.70:0/2188892018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4103ef0 0x7f87f41a0c10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:00.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.023+0000 7f87f9e00700 1 -- 172.21.15.70:0/2188892018 >> 172.21.15.70:0/2188892018 conn(0x7f87f407a600 msgr2=0x7f87f41013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:00.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.024+0000 7f87f9e00700 1 -- 172.21.15.70:0/2188892018 shutdown_connections 2024-05-08T07:33:00.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:00.024+0000 7f87f9e00700 1 -- 172.21.15.70:0/2188892018 wait complete. 2024-05-08T07:33:00.113 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vsyscall/vsyscall_64.o 2024-05-08T07:33:00.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:33:00.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:33:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:33:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:33:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:33:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:33:00.840 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:33:00.840 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:33:00.840 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:33:00.890 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b5e966ca', quiesce took 48.8 seconds. Will release after: 10 2024-05-08T07:33:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:01 smithi172 ceph-mon[33377]: pgmap v1474: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 8 op/s 2024-05-08T07:33:01.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:01 smithi194 ceph-mon[33679]: pgmap v1474: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 8 op/s 2024-05-08T07:33:01.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:01 smithi070 ceph-mon[29591]: pgmap v1474: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 45 KiB/s wr, 8 op/s 2024-05-08T07:33:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:03 smithi172 ceph-mon[33377]: pgmap v1475: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 21 op/s 2024-05-08T07:33:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:03 smithi194 ceph-mon[33679]: pgmap v1475: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 21 op/s 2024-05-08T07:33:03.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:03 smithi070 ceph-mon[29591]: pgmap v1475: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 49 KiB/s wr, 21 op/s 2024-05-08T07:33:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:05 smithi172 ceph-mon[33377]: pgmap v1476: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 70 KiB/s wr, 22 op/s 2024-05-08T07:33:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:05 smithi194 ceph-mon[33679]: pgmap v1476: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 70 KiB/s wr, 22 op/s 2024-05-08T07:33:05.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:05 smithi070 ceph-mon[29591]: pgmap v1476: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 70 KiB/s wr, 22 op/s 2024-05-08T07:33:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:07 smithi172 ceph-mon[33377]: pgmap v1477: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 25 op/s 2024-05-08T07:33:07.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:07 smithi194 ceph-mon[33679]: pgmap v1477: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 25 op/s 2024-05-08T07:33:07.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:07 smithi070 ceph-mon[29591]: pgmap v1477: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 25 op/s 2024-05-08T07:33:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:09 smithi172 ceph-mon[33377]: pgmap v1478: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 24 op/s 2024-05-08T07:33:09.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:09 smithi194 ceph-mon[33679]: pgmap v1478: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 24 op/s 2024-05-08T07:33:09.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:09 smithi070 ceph-mon[29591]: pgmap v1478: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 74 KiB/s wr, 24 op/s 2024-05-08T07:33:10.892 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:33:11.379 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:33:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:11 smithi172 ceph-mon[33377]: pgmap v1479: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 128 KiB/s wr, 26 op/s 2024-05-08T07:33:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:11 smithi172 ceph-mon[33377]: osdmap e172: 12 total, 12 up, 12 in 2024-05-08T07:33:11.702 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:11 smithi070 ceph-mon[29591]: pgmap v1479: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 128 KiB/s wr, 26 op/s 2024-05-08T07:33:11.702 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:11 smithi070 ceph-mon[29591]: osdmap e172: 12 total, 12 up, 12 in 2024-05-08T07:33:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:11 smithi194 ceph-mon[33679]: pgmap v1479: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 128 KiB/s wr, 26 op/s 2024-05-08T07:33:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:11 smithi194 ceph-mon[33679]: osdmap e172: 12 total, 12 up, 12 in 2024-05-08T07:33:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:13 smithi172 ceph-mon[33377]: pgmap v1481: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 117 KiB/s wr, 13 op/s 2024-05-08T07:33:13.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:13 smithi194 ceph-mon[33679]: pgmap v1481: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 117 KiB/s wr, 13 op/s 2024-05-08T07:33:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:13 smithi070 ceph-mon[29591]: pgmap v1481: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 117 KiB/s wr, 13 op/s 2024-05-08T07:33:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.973+0000 7fb81dc00700 1 -- 172.21.15.70:0/2049685106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb818075ff0 msgr2=0x7fb81810f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.973+0000 7fb81dc00700 1 --2- 172.21.15.70:0/2049685106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb818075ff0 0x7fb81810f9c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb800009990 tx=0x7fb800009ca0 comp rx=0 tx=0).stop 2024-05-08T07:33:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.973+0000 7fb81dc00700 1 -- 172.21.15.70:0/2049685106 shutdown_connections 2024-05-08T07:33:13.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.973+0000 7fb81dc00700 1 --2- 172.21.15.70:0/2049685106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81810ff00 0x7fb8181122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.973+0000 7fb81dc00700 1 --2- 172.21.15.70:0/2049685106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8180756d0 0x7fb818075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.973+0000 7fb81dc00700 1 --2- 172.21.15.70:0/2049685106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb818075ff0 0x7fb81810f9c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.973+0000 7fb81dc00700 1 -- 172.21.15.70:0/2049685106 >> 172.21.15.70:0/2049685106 conn(0x7fb81807a600 msgr2=0x7fb81807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.973+0000 7fb81dc00700 1 -- 172.21.15.70:0/2049685106 shutdown_connections 2024-05-08T07:33:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.974+0000 7fb81dc00700 1 -- 172.21.15.70:0/2049685106 wait complete. 2024-05-08T07:33:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.975+0000 7fb81dc00700 1 Processor -- start 2024-05-08T07:33:13.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.975+0000 7fb81dc00700 1 -- start start 2024-05-08T07:33:13.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.975+0000 7fb81dc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8180756d0 0x7fb8181a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:13.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.975+0000 7fb81dc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb818075ff0 0x7fb8181a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:13.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.975+0000 7fb81dc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81810ff00 0x7fb81819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.975+0000 7fb81dc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb818115770 con 0x7fb8180756d0 2024-05-08T07:33:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.975+0000 7fb81dc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb8181155f0 con 0x7fb81810ff00 2024-05-08T07:33:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.975+0000 7fb81dc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb8181158f0 con 0x7fb818075ff0 2024-05-08T07:33:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb816a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8180756d0 0x7fb8181a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb816a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8180756d0 0x7fb8181a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51316/0 (socket says 172.21.15.70:51316) 2024-05-08T07:33:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb816a00700 1 -- 172.21.15.70:0/872480072 learned_addr learned my addr 172.21.15.70:0/872480072 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb817400700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81810ff00 0x7fb81819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:13.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb80e000700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb818075ff0 0x7fb8181a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:13.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb816a00700 1 -- 172.21.15.70:0/872480072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb818075ff0 msgr2=0x7fb8181a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:13.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb816a00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb818075ff0 0x7fb8181a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:13.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb816a00700 1 -- 172.21.15.70:0/872480072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81810ff00 msgr2=0x7fb81819ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:13.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb816a00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81810ff00 0x7fb81819ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:13.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb816a00700 1 -- 172.21.15.70:0/872480072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81819c1b0 con 0x7fb8180756d0 2024-05-08T07:33:13.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.976+0000 7fb80e000700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb818075ff0 0x7fb8181a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:33:13.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.977+0000 7fb816a00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8180756d0 0x7fb8181a1890 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb80800d980 tx=0x7fb80800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:13.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.977+0000 7fb80fe00700 1 -- 172.21.15.70:0/872480072 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808017070 con 0x7fb8180756d0 2024-05-08T07:33:13.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.977+0000 7fb80fe00700 1 -- 172.21.15.70:0/872480072 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb808005020 con 0x7fb8180756d0 2024-05-08T07:33:13.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.977+0000 7fb80fe00700 1 -- 172.21.15.70:0/872480072 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb808009ab0 con 0x7fb8180756d0 2024-05-08T07:33:13.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.977+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81819c4a0 con 0x7fb8180756d0 2024-05-08T07:33:13.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.977+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8181a8760 con 0x7fb8180756d0 2024-05-08T07:33:13.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.979+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb81806a190 con 0x7fb8180756d0 2024-05-08T07:33:13.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.983+0000 7fb80fe00700 1 -- 172.21.15.70:0/872480072 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb8080051d0 con 0x7fb8180756d0 2024-05-08T07:33:13.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.984+0000 7fb80fe00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7fc0b2a70 0x7fb7fc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:13.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.985+0000 7fb80fe00700 1 -- 172.21.15.70:0/872480072 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 9671+0+0 (secure 0 0 0) 0x7fb8080e2dd0 con 0x7fb8180756d0 2024-05-08T07:33:13.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.985+0000 7fb80e000700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7fc0b2a70 0x7fb7fc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:13.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.985+0000 7fb80e000700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7fc0b2a70 0x7fb7fc0b4f30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb800006010 tx=0x7fb80001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:13.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:13.987+0000 7fb80fe00700 1 -- 172.21.15.70:0/872480072 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb808020020 con 0x7fb8180756d0 2024-05-08T07:33:14.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.272+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb81802e510 con 0x7fb8180756d0 2024-05-08T07:33:14.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.274+0000 7fb80fe00700 1 -- 172.21.15.70:0/872480072 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fb8080aa350 con 0x7fb8180756d0 2024-05-08T07:33:14.274 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:33:14.274 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:33:14.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7fc0b2a70 msgr2=0x7fb7fc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:14.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7fc0b2a70 0x7fb7fc0b4f30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb800006010 tx=0x7fb80001a040 comp rx=0 tx=0).stop 2024-05-08T07:33:14.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8180756d0 msgr2=0x7fb8181a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:14.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8180756d0 0x7fb8181a1890 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb80800d980 tx=0x7fb80800dc90 comp rx=0 tx=0).stop 2024-05-08T07:33:14.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 shutdown_connections 2024-05-08T07:33:14.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7fc0b2a70 0x7fb7fc0b4f30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:14.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb81810ff00 0x7fb81819ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:14.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8180756d0 0x7fb8181a1890 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:14.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 --2- 172.21.15.70:0/872480072 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb818075ff0 0x7fb8181a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:14.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.278+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 >> 172.21.15.70:0/872480072 conn(0x7fb81807a600 msgr2=0x7fb8181006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:14.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.279+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 shutdown_connections 2024-05-08T07:33:14.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:14.279+0000 7fb81dc00700 1 -- 172.21.15.70:0/872480072 wait complete. 2024-05-08T07:33:14.278 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:33:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:14 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/872480072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:33:14.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:14 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/872480072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:33:14.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:14 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/872480072' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:33:15.102 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id b5e966ca --release --await' 2024-05-08T07:33:15.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id b5e966ca --release --await 2024-05-08T07:33:15.564 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:33:15.715 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:15 smithi070 ceph-mon[29591]: pgmap v1482: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 108 KiB/s wr, 12 op/s 2024-05-08T07:33:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:15 smithi194 ceph-mon[33679]: pgmap v1482: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 108 KiB/s wr, 12 op/s 2024-05-08T07:33:15.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:15 smithi172 ceph-mon[33377]: pgmap v1482: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 108 KiB/s wr, 12 op/s 2024-05-08T07:33:17.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:17 smithi070 ceph-mon[29591]: pgmap v1483: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T07:33:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:17 smithi194 ceph-mon[33679]: pgmap v1483: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T07:33:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:17 smithi172 ceph-mon[33377]: pgmap v1483: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T07:33:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.189+0000 7fb920800700 1 -- 172.21.15.70:0/1051190906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91810b6c0 msgr2=0x7fb91810baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.189+0000 7fb920800700 1 --2- 172.21.15.70:0/1051190906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91810b6c0 0x7fb91810baa0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009990 tx=0x7fb90c009ca0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.190+0000 7fb920800700 1 -- 172.21.15.70:0/1051190906 shutdown_connections 2024-05-08T07:33:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.190+0000 7fb920800700 1 --2- 172.21.15.70:0/1051190906 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb918106080 0x7fb918112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.190+0000 7fb920800700 1 --2- 172.21.15.70:0/1051190906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb91810b6c0 0x7fb91810baa0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.190+0000 7fb920800700 1 --2- 172.21.15.70:0/1051190906 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9181056c0 0x7fb918105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.190+0000 7fb920800700 1 -- 172.21.15.70:0/1051190906 >> 172.21.15.70:0/1051190906 conn(0x7fb9181011b0 msgr2=0x7fb9181035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:18.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.190+0000 7fb920800700 1 -- 172.21.15.70:0/1051190906 shutdown_connections 2024-05-08T07:33:18.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.190+0000 7fb920800700 1 -- 172.21.15.70:0/1051190906 wait complete. 2024-05-08T07:33:18.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.191+0000 7fb920800700 1 Processor -- start 2024-05-08T07:33:18.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.191+0000 7fb920800700 1 -- start start 2024-05-08T07:33:18.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.192+0000 7fb920800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9181056c0 0x7fb9180779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.192+0000 7fb920800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb918106080 0x7fb918077ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.192+0000 7fb920800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91810b6c0 0x7fb918078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.192+0000 7fb920800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181157c0 con 0x7fb9181056c0 2024-05-08T07:33:18.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.192+0000 7fb920800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb918115640 con 0x7fb91810b6c0 2024-05-08T07:33:18.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.192+0000 7fb920800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb918115940 con 0x7fb918106080 2024-05-08T07:33:18.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.193+0000 7fb91de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9181056c0 0x7fb9180779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.193+0000 7fb91de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9181056c0 0x7fb9180779b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50822/0 (socket says 172.21.15.70:50822) 2024-05-08T07:33:18.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.193+0000 7fb91de00700 1 -- 172.21.15.70:0/3566037613 learned_addr learned my addr 172.21.15.70:0/3566037613 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:18.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.193+0000 7fb91e800700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91810b6c0 0x7fb918078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.193+0000 7fb91de00700 1 -- 172.21.15.70:0/3566037613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb918106080 msgr2=0x7fb918077ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T07:33:18.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.193+0000 7fb91de00700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb918106080 0x7fb918077ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.193+0000 7fb91de00700 1 -- 172.21.15.70:0/3566037613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91810b6c0 msgr2=0x7fb918078430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.193+0000 7fb91de00700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91810b6c0 0x7fb918078430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.193+0000 7fb91de00700 1 -- 172.21.15.70:0/3566037613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91819bab0 con 0x7fb9181056c0 2024-05-08T07:33:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.194+0000 7fb91de00700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9181056c0 0x7fb9180779b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb90c000c00 tx=0x7fb90c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:18.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.195+0000 7fb912a00700 1 -- 172.21.15.70:0/3566037613 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c027070 con 0x7fb9181056c0 2024-05-08T07:33:18.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.195+0000 7fb912a00700 1 -- 172.21.15.70:0/3566037613 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb90c00fc40 con 0x7fb9181056c0 2024-05-08T07:33:18.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.195+0000 7fb920800700 1 -- 172.21.15.70:0/3566037613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91819bd40 con 0x7fb9181056c0 2024-05-08T07:33:18.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.195+0000 7fb912a00700 1 -- 172.21.15.70:0/3566037613 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c022cd0 con 0x7fb9181056c0 2024-05-08T07:33:18.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.195+0000 7fb920800700 1 -- 172.21.15.70:0/3566037613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb91819c270 con 0x7fb9181056c0 2024-05-08T07:33:18.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.198+0000 7fb912a00700 1 -- 172.21.15.70:0/3566037613 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb90c02a070 con 0x7fb9181056c0 2024-05-08T07:33:18.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.200+0000 7fb912a00700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9000b2a70 0x7fb9000b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.200+0000 7fb912a00700 1 -- 172.21.15.70:0/3566037613 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 9583+0+0 (secure 0 0 0) 0x7fb90c0e4540 con 0x7fb9181056c0 2024-05-08T07:33:18.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.200+0000 7fb91d400700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9000b2a70 0x7fb9000b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.213+0000 7fb91d400700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9000b2a70 0x7fb9000b4f30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb918079170 tx=0x7fb908005c10 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:18.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.214+0000 7fb92b147b80 1 Processor -- start 2024-05-08T07:33:18.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.215+0000 7fb92b147b80 1 -- start start 2024-05-08T07:33:18.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.215+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 0x5634327f7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.215+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.215+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 0x5634327fdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.215+0000 7fb92b147b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563432743b20 con 0x5634327f1780 2024-05-08T07:33:18.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.215+0000 7fb92b147b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5634326e1860 con 0x5634327f2140 2024-05-08T07:33:18.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.215+0000 7fb92b147b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56343273fae0 con 0x5634327f71b0 2024-05-08T07:33:18.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.215+0000 7fb91d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.215+0000 7fb91d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327f1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50826/0 (socket says 172.21.15.70:50826) 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91d400700 1 -- 172.21.15.70:0/2628843151 learned_addr learned my addr 172.21.15.70:0/2628843151 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91de00700 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 0x5634327f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91e800700 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 0x5634327fdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91d400700 1 -- 172.21.15.70:0/2628843151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 msgr2=0x5634327f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91d400700 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 0x5634327f7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91d400700 1 -- 172.21.15.70:0/2628843151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 msgr2=0x5634327fdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91d400700 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 0x5634327fdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91d400700 1 -- 172.21.15.70:0/2628843151 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634326909d0 con 0x5634327f1780 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91e800700 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 0x5634327fdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.216+0000 7fb91d400700 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327f1c00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb90800caf0 tx=0x7fb90800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc26710d4f14728 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.217+0000 7fb907400700 1 -- 172.21.15.70:0/2628843151 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908020070 con 0x5634327f1780 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.217+0000 7fb907400700 1 -- 172.21.15.70:0/2628843151 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb908016070 con 0x5634327f1780 2024-05-08T07:33:18.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.217+0000 7fb907400700 1 -- 172.21.15.70:0/2628843151 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90801cd50 con 0x5634327f1780 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 -- 172.21.15.70:0/2628843151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 msgr2=0x5634327f1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327f1c00 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fb90800caf0 tx=0x7fb90800f000 comp rx=0 tx=0).stop 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 -- 172.21.15.70:0/2628843151 shutdown_connections 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 0x5634327fdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 0x5634327f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 --2- 172.21.15.70:0/2628843151 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327f1c00 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 -- 172.21.15.70:0/2628843151 >> 172.21.15.70:0/2628843151 conn(0x5634327697d0 msgr2=0x5634327ec070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 -- 172.21.15.70:0/2628843151 shutdown_connections 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 -- 172.21.15.70:0/2628843151 wait complete. 2024-05-08T07:33:18.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.218+0000 7fb92b147b80 1 -- start start 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.219+0000 7fb92b147b80 1 Processor -- start 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.219+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f1780 0x5634327fdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.219+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f2140 0x5634327faf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.219+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 0x5634327fb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.219+0000 7fb92b147b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5634327fe510 con 0x5634327f2140 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.219+0000 7fb92b147b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5634326a9c20 con 0x5634327f1780 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.219+0000 7fb92b147b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5634327fe690 con 0x5634327f71b0 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.219+0000 7fb92b147b80 10 client.0 _ll_register_callbacks cb 0x5634326ead70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f2140 0x5634327faf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f2140 0x5634327faf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50832/0 (socket says 172.21.15.70:50832) 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91d400700 1 -- 172.21.15.70:0/3817112570 learned_addr learned my addr 172.21.15.70:0/3817112570 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91de00700 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f1780 0x5634327fdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91e800700 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 0x5634327fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91d400700 1 -- 172.21.15.70:0/3817112570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 msgr2=0x5634327fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:18.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91d400700 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 0x5634327fb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91d400700 1 -- 172.21.15.70:0/3817112570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f1780 msgr2=0x5634327fdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:18.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91d400700 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f1780 0x5634327fdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91d400700 1 -- 172.21.15.70:0/3817112570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563432709520 con 0x5634327f2140 2024-05-08T07:33:18.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb91d400700 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f2140 0x5634327faf50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb90801c970 tx=0x7fb90801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a564d7906a2511 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:18.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.220+0000 7fb8fbe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:33:18.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.221+0000 7fb8fbe00700 1 -- 172.21.15.70:0/3817112570 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90802b070 con 0x5634327f2140 2024-05-08T07:33:18.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.221+0000 7fb8fbe00700 1 -- 172.21.15.70:0/3817112570 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(173..173 src has 1..173) ==== 9583+0+0 (secure 0 0 0) 0x7fb90800fcf0 con 0x5634327f2140 2024-05-08T07:33:18.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.221+0000 7fb92b147b80 1 -- 172.21.15.70:0/3817112570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb908016070 con 0x5634327f2140 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.221+0000 7fb8fbe00700 1 -- 172.21.15.70:0/3817112570 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb908020040 con 0x5634327f2140 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.221+0000 7fb92b147b80 10 client.16779 fetch_fsmap learned FSMap version 42 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.221+0000 7fb92b147b80 1 -- 172.21.15.70:0/3817112570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563432808cc0 con 0x5634327f2140 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.221+0000 7fb8fbe00700 1 -- 172.21.15.70:0/3817112570 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb908016070 con 0x5634327f2140 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.222+0000 7fb8fbe00700 1 -- 172.21.15.70:0/3817112570 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fb90801b070 con 0x5634327f2140 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.222+0000 7fb92b147b80 10 client.16779 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.222+0000 7fb92b147b80 10 client.16779 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.222+0000 7fb92b147b80 20 client.16779 populate_metadata read hostname 'smithi070' 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.222+0000 7fb92b147b80 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56343280b300 0x56343280d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.222+0000 7fb92b147b80 4 client.16779 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.222+0000 7fb92b147b80 1 -- 172.21.15.70:0/3817112570 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634327be240 con 0x56343280b300 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.222+0000 7fb91de00700 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56343280b300 0x56343280d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.223+0000 7fb91de00700 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56343280b300 0x56343280d6f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b3d2b7decf6b27 server_cookie=9984325485fa32f0 in_seq=0 out_seq=0 2024-05-08T07:33:18.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.223+0000 7fb8fbe00700 10 client.16779 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:33:18.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.225+0000 7fb8fbe00700 1 -- 172.21.15.70:0/3817112570 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5634327be240 con 0x56343280b300 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.225+0000 7fb8fbe00700 10 client.16779 handle_command_reply: tid=0 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.225+0000 7fb92b147b80 1 client.16779 shutdown 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 -- 172.21.15.70:0/3817112570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f2140 msgr2=0x5634327faf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f2140 0x5634327faf50 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb90801c970 tx=0x7fb90801c890 comp rx=0 tx=0).stop 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 -- 172.21.15.70:0/3817112570 shutdown_connections 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56343280b300 0x56343280d6f0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f71b0 0x5634327fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f1780 0x5634327fdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 --2- 172.21.15.70:0/3817112570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f2140 0x5634327faf50 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 -- 172.21.15.70:0/3817112570 >> 172.21.15.70:0/3817112570 conn(0x5634327697d0 msgr2=0x5634327e6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb8fbe00700 0 client.16779 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 -- 172.21.15.70:0/3817112570 shutdown_connections 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 1 -- 172.21.15.70:0/3817112570 wait complete. 2024-05-08T07:33:18.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.226+0000 7fb92b147b80 20 client.16779 trim_cache size 0 max 16384 2024-05-08T07:33:18.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.248+0000 7fb92b147b80 1 Processor -- start 2024-05-08T07:33:18.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.248+0000 7fb92b147b80 1 -- start start 2024-05-08T07:33:18.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.248+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f1780 0x563432807560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.248+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 0x5634327fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.248+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f71b0 0x5634327f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.248+0000 7fb92b147b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181c0c30 con 0x5634327f71b0 2024-05-08T07:33:18.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.248+0000 7fb92b147b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181be4c0 con 0x5634327f2140 2024-05-08T07:33:18.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.248+0000 7fb92b147b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181a3240 con 0x5634327f1780 2024-05-08T07:33:18.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f71b0 0x5634327f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f71b0 0x5634327f3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50848/0 (socket says 172.21.15.70:50848) 2024-05-08T07:33:18.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91e800700 1 -- 172.21.15.70:0/2239278615 learned_addr learned my addr 172.21.15.70:0/2239278615 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:18.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91de00700 1 --2- 172.21.15.70:0/2239278615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f1780 0x563432807560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91e800700 1 -- 172.21.15.70:0/2239278615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f1780 msgr2=0x563432807560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:18.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91e800700 1 --2- 172.21.15.70:0/2239278615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f1780 0x563432807560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91e800700 1 -- 172.21.15.70:0/2239278615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 msgr2=0x5634327fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:18.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91e800700 1 --2- 172.21.15.70:0/2239278615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 0x5634327fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91e800700 1 -- 172.21.15.70:0/2239278615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634327ecc40 con 0x5634327f71b0 2024-05-08T07:33:18.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91de00700 1 --2- 172.21.15.70:0/2239278615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f1780 0x563432807560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:33:18.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.249+0000 7fb91e800700 1 --2- 172.21.15.70:0/2239278615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f71b0 0x5634327f3c30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb914009b70 tx=0x7fb914009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868e0e7f167d8346 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:18.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.250+0000 7fb906a00700 1 -- 172.21.15.70:0/2239278615 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb914019020 con 0x5634327f71b0 2024-05-08T07:33:18.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.250+0000 7fb906a00700 1 -- 172.21.15.70:0/2239278615 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb914007c60 con 0x5634327f71b0 2024-05-08T07:33:18.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.250+0000 7fb906a00700 1 -- 172.21.15.70:0/2239278615 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140145b0 con 0x5634327f71b0 2024-05-08T07:33:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.250+0000 7fb92b147b80 1 -- 172.21.15.70:0/2239278615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f71b0 msgr2=0x5634327f3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.250+0000 7fb92b147b80 1 --2- 172.21.15.70:0/2239278615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f71b0 0x5634327f3c30 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb914009b70 tx=0x7fb914009040 comp rx=0 tx=0).stop 2024-05-08T07:33:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.251+0000 7fb92b147b80 1 -- 172.21.15.70:0/2239278615 shutdown_connections 2024-05-08T07:33:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.251+0000 7fb92b147b80 1 --2- 172.21.15.70:0/2239278615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f71b0 0x5634327f3c30 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.251+0000 7fb92b147b80 1 --2- 172.21.15.70:0/2239278615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f1780 0x563432807560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.251+0000 7fb92b147b80 1 --2- 172.21.15.70:0/2239278615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f2140 0x5634327fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.251+0000 7fb92b147b80 1 -- 172.21.15.70:0/2239278615 >> 172.21.15.70:0/2239278615 conn(0x5634327697d0 msgr2=0x5634327fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.251+0000 7fb92b147b80 1 -- 172.21.15.70:0/2239278615 shutdown_connections 2024-05-08T07:33:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.251+0000 7fb92b147b80 1 -- 172.21.15.70:0/2239278615 wait complete. 2024-05-08T07:33:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.251+0000 7fb92b147b80 1 -- start start 2024-05-08T07:33:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.252+0000 7fb92b147b80 1 Processor -- start 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.252+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327fe8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.252+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f2140 0x5634327fede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.252+0000 7fb92b147b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f71b0 0x5634327ff320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.252+0000 7fb92b147b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181a3890 con 0x5634327f1780 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.252+0000 7fb92b147b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181bddf0 con 0x5634327f71b0 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.252+0000 7fb92b147b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb9181a3f60 con 0x5634327f2140 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.252+0000 7fb92b147b80 10 client.0 _ll_register_callbacks cb 0x5634326ead70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327fe8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327fe8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50864/0 (socket says 172.21.15.70:50864) 2024-05-08T07:33:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91de00700 1 -- 172.21.15.70:0/1703058164 learned_addr learned my addr 172.21.15.70:0/1703058164 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91d400700 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f2140 0x5634327fede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91de00700 1 -- 172.21.15.70:0/1703058164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f2140 msgr2=0x5634327fede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91de00700 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f2140 0x5634327fede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91de00700 1 -- 172.21.15.70:0/1703058164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f71b0 msgr2=0x5634327ff320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91de00700 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f71b0 0x5634327ff320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91de00700 1 -- 172.21.15.70:0/1703058164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634327f6be0 con 0x5634327f1780 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb91de00700 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327fe8a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0a86a0 tx=0x7fb90c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f54aac8c219440 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.253+0000 7fb8fbe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb8fbe00700 1 -- 172.21.15.70:0/1703058164 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c0c4070 con 0x5634327f1780 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb8fbe00700 1 -- 172.21.15.70:0/1703058164 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(173..173 src has 1..173) ==== 9583+0+0 (secure 0 0 0) 0x7fb90c0ab690 con 0x5634327f1780 2024-05-08T07:33:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb92b147b80 1 -- 172.21.15.70:0/1703058164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb914007c60 con 0x5634327f1780 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb8fbe00700 1 -- 172.21.15.70:0/1703058164 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb90c0b4200 con 0x5634327f1780 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb92b147b80 10 client.16785 fetch_fsmap learned FSMap version 42 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb92b147b80 1 -- 172.21.15.70:0/1703058164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563432876a80 con 0x5634327f1780 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb8fbe00700 1 -- 172.21.15.70:0/1703058164 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb914007c60 con 0x5634327f1780 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb8fbe00700 1 -- 172.21.15.70:0/1703058164 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fb90c0b3d70 con 0x5634327f1780 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb92b147b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb92b147b80 10 client.16785 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb92b147b80 20 client.16785 populate_metadata read hostname 'smithi070' 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb92b147b80 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563432877130 0x563432879550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb92b147b80 4 client.16785 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b5e966ca", "release": true, "await": true}] 2024-05-08T07:33:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.254+0000 7fb92b147b80 1 -- 172.21.15.70:0/1703058164 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b5e966ca", "release": true, "await": true}) -- 0x5634327ec5d0 con 0x563432877130 2024-05-08T07:33:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.255+0000 7fb91d400700 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563432877130 0x563432879550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.256+0000 7fb91d400700 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563432877130 0x563432879550 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00866588ed09705 server_cookie=a3c93ca3d235e6f4 in_seq=0 out_seq=0 2024-05-08T07:33:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:18.256+0000 7fb8fbe00700 10 client.16785 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:33:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:19 smithi172 ceph-mon[33377]: pgmap v1484: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T07:33:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:19 smithi172 ceph-mon[33377]: osdmap e173: 12 total, 12 up, 12 in 2024-05-08T07:33:19.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:19 smithi194 ceph-mon[33679]: pgmap v1484: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T07:33:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:19 smithi194 ceph-mon[33679]: osdmap e173: 12 total, 12 up, 12 in 2024-05-08T07:33:19.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:19 smithi070 ceph-mon[29591]: pgmap v1484: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T07:33:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:19 smithi070 ceph-mon[29591]: osdmap e173: 12 total, 12 up, 12 in 2024-05-08T07:33:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:21 smithi172 ceph-mon[33377]: pgmap v1486: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 7 op/s 2024-05-08T07:33:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:21 smithi194 ceph-mon[33679]: pgmap v1486: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 7 op/s 2024-05-08T07:33:21.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:21 smithi070 ceph-mon[29591]: pgmap v1486: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 7 op/s 2024-05-08T07:33:22.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.592+0000 7fb8fbe00700 1 -- 172.21.15.70:0/1703058164 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5634327ec5d0 con 0x563432877130 2024-05-08T07:33:22.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.592+0000 7fb8fbe00700 10 client.16785 handle_command_reply: tid=0 2024-05-08T07:33:22.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.592+0000 7fb92b147b80 1 client.16785 shutdown 2024-05-08T07:33:22.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.593+0000 7fb92b147b80 1 -- 172.21.15.70:0/1703058164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 msgr2=0x5634327fe8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:22.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.593+0000 7fb92b147b80 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327fe8a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb90c0a86a0 tx=0x7fb90c009ca0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.593+0000 7fb92b147b80 1 -- 172.21.15.70:0/1703058164 shutdown_connections 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.593+0000 7fb92b147b80 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563432877130 0x563432879550 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.593+0000 7fb92b147b80 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5634327f71b0 0x5634327ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.593+0000 7fb92b147b80 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5634327f1780 0x5634327fe8a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.593+0000 7fb92b147b80 1 --2- 172.21.15.70:0/1703058164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5634327f2140 0x5634327fede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.593+0000 7fb92b147b80 1 -- 172.21.15.70:0/1703058164 >> 172.21.15.70:0/1703058164 conn(0x5634327697d0 msgr2=0x5634327e6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.593+0000 7fb8fbe00700 0 client.16785 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.594+0000 7fb92b147b80 1 -- 172.21.15.70:0/1703058164 shutdown_connections 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.594+0000 7fb92b147b80 1 -- 172.21.15.70:0/1703058164 wait complete. 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.594+0000 7fb92b147b80 20 client.16785 trim_cache size 0 max 16384 2024-05-08T07:33:22.593 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 116, 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "b5e966ca": { 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 116, 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:33:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:33:22.595 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 -- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9000b2a70 msgr2=0x7fb9000b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9000b2a70 0x7fb9000b4f30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb918079170 tx=0x7fb908005c10 comp rx=0 tx=0).stop 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 -- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9181056c0 msgr2=0x7fb9180779b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9181056c0 0x7fb9180779b0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fb90c000c00 tx=0x7fb90c005ef0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 -- 172.21.15.70:0/3566037613 shutdown_connections 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9000b2a70 0x7fb9000b4f30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb91810b6c0 0x7fb918078430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb9181056c0 0x7fb9180779b0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 --2- 172.21.15.70:0/3566037613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb918106080 0x7fb918077ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.595+0000 7fb920800700 1 -- 172.21.15.70:0/3566037613 >> 172.21.15.70:0/3566037613 conn(0x7fb9181011b0 msgr2=0x7fb918101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.596+0000 7fb920800700 1 -- 172.21.15.70:0/3566037613 shutdown_connections 2024-05-08T07:33:22.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:22.596+0000 7fb920800700 1 -- 172.21.15.70:0/3566037613 wait complete. 2024-05-08T07:33:22.732 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/sched/build_utility.o 2024-05-08T07:33:23.358 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:23 smithi070 ceph-mon[29591]: pgmap v1487: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:33:23.415 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b5e966ca', seconds elapsed: 71.3 2024-05-08T07:33:23.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:23 smithi172 ceph-mon[33377]: pgmap v1487: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:33:23.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:23 smithi194 ceph-mon[33679]: pgmap v1487: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:33:24.079 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/vdso/vdso-image-32.o 2024-05-08T07:33:24.142 INFO:tasks.workunit.client.0.smithi070.stdout: CC init/init_task.o 2024-05-08T07:33:24.720 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/locking/percpu-rwsem.o 2024-05-08T07:33:24.884 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/notify/fdinfo.o 2024-05-08T07:33:25.244 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/entry/vsyscall/vsyscall_emu_64.o 2024-05-08T07:33:25.244 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/folio-compat.o 2024-05-08T07:33:25.329 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/syscall.o 2024-05-08T07:33:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:25 smithi172 ceph-mon[33377]: pgmap v1488: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T07:33:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:25 smithi194 ceph-mon[33679]: pgmap v1488: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T07:33:25.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:25 smithi070 ceph-mon[29591]: pgmap v1488: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T07:33:25.838 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/entry/vsyscall/built-in.a 2024-05-08T07:33:26.117 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/ipc_sysctl.o 2024-05-08T07:33:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:27 smithi172 ceph-mon[33377]: pgmap v1489: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-05-08T07:33:27.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:27 smithi194 ceph-mon[33679]: pgmap v1489: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-05-08T07:33:27.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:27 smithi070 ceph-mon[29591]: pgmap v1489: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-05-08T07:33:28.270 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/entry/vdso/built-in.a 2024-05-08T07:33:28.777 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/entry/entry.o 2024-05-08T07:33:29.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:29 smithi172 ceph-mon[33377]: pgmap v1490: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-05-08T07:33:29.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:29 smithi194 ceph-mon[33679]: pgmap v1490: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-05-08T07:33:29.638 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:29 smithi070 ceph-mon[29591]: pgmap v1490: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-05-08T07:33:30.425 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/entry/entry_64.o 2024-05-08T07:33:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:31 smithi172 ceph-mon[33377]: pgmap v1491: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 173 KiB/s wr, 21 op/s 2024-05-08T07:33:31.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:31 smithi194 ceph-mon[33679]: pgmap v1491: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 173 KiB/s wr, 21 op/s 2024-05-08T07:33:31.617 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/syscall_64.o 2024-05-08T07:33:31.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:31 smithi070 ceph-mon[29591]: pgmap v1491: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 173 KiB/s wr, 21 op/s 2024-05-08T07:33:31.776 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/locking/spinlock.o 2024-05-08T07:33:32.911 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/notify/built-in.a 2024-05-08T07:33:33.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:33 smithi172 ceph-mon[33377]: pgmap v1492: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 188 KiB/s wr, 36 op/s 2024-05-08T07:33:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:33 smithi194 ceph-mon[33679]: pgmap v1492: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 188 KiB/s wr, 36 op/s 2024-05-08T07:33:33.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/iomap/trace.o 2024-05-08T07:33:33.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:33 smithi070 ceph-mon[29591]: pgmap v1492: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 188 KiB/s wr, 36 op/s 2024-05-08T07:33:34.084 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/readahead.o 2024-05-08T07:33:34.149 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/swap.o 2024-05-08T07:33:34.338 INFO:tasks.workunit.client.0.smithi070.stdout: CC init/version.o 2024-05-08T07:33:35.154 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/mqueue.o 2024-05-08T07:33:35.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:35 smithi172 ceph-mon[33377]: pgmap v1493: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 197 KiB/s wr, 42 op/s 2024-05-08T07:33:35.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:35 smithi194 ceph-mon[33679]: pgmap v1493: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 197 KiB/s wr, 42 op/s 2024-05-08T07:33:35.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:35 smithi070 ceph-mon[29591]: pgmap v1493: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 197 KiB/s wr, 42 op/s 2024-05-08T07:33:36.459 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/sched/built-in.a 2024-05-08T07:33:36.802 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/namespace.o 2024-05-08T07:33:37.221 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/locking/osq_lock.o 2024-05-08T07:33:37.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:37 smithi194 ceph-mon[33679]: pgmap v1494: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 338 KiB/s wr, 77 op/s 2024-05-08T07:33:37.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:37 smithi070 ceph-mon[29591]: pgmap v1494: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 338 KiB/s wr, 77 op/s 2024-05-08T07:33:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:37 smithi172 ceph-mon[33377]: pgmap v1494: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 338 KiB/s wr, 77 op/s 2024-05-08T07:33:39.492 INFO:tasks.workunit.client.0.smithi070.stdout: AR init/built-in.a 2024-05-08T07:33:39.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:39 smithi194 ceph-mon[33679]: pgmap v1495: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 311 KiB/s wr, 70 op/s 2024-05-08T07:33:39.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:39 smithi070 ceph-mon[29591]: pgmap v1495: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 311 KiB/s wr, 70 op/s 2024-05-08T07:33:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:39 smithi172 ceph-mon[33377]: pgmap v1495: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 311 KiB/s wr, 70 op/s 2024-05-08T07:33:40.023 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/amd/core.o 2024-05-08T07:33:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:41 smithi194 ceph-mon[33679]: pgmap v1496: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 395 KiB/s wr, 77 op/s 2024-05-08T07:33:41.565 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/common.o 2024-05-08T07:33:41.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:41 smithi070 ceph-mon[29591]: pgmap v1496: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 395 KiB/s wr, 77 op/s 2024-05-08T07:33:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:41 smithi172 ceph-mon[33377]: pgmap v1496: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 395 KiB/s wr, 77 op/s 2024-05-08T07:33:41.988 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10.4 2024-05-08T07:33:41.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:33:42.598 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:33:42.685 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/locking/qspinlock.o 2024-05-08T07:33:43.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:43 smithi194 ceph-mon[33679]: pgmap v1497: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 312 KiB/s wr, 77 op/s 2024-05-08T07:33:43.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:43 smithi070 ceph-mon[29591]: pgmap v1497: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 312 KiB/s wr, 77 op/s 2024-05-08T07:33:43.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:43 smithi172 ceph-mon[33377]: pgmap v1497: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 312 KiB/s wr, 77 op/s 2024-05-08T07:33:44.536 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/iomap/iter.o 2024-05-08T07:33:45.436 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/core.o 2024-05-08T07:33:45.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:45 smithi194 ceph-mon[33679]: pgmap v1498: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 300 KiB/s wr, 71 op/s 2024-05-08T07:33:45.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:45 smithi070 ceph-mon[29591]: pgmap v1498: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 300 KiB/s wr, 71 op/s 2024-05-08T07:33:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:45 smithi172 ceph-mon[33377]: pgmap v1498: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 300 KiB/s wr, 71 op/s 2024-05-08T07:33:45.811 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/realmode/init.o 2024-05-08T07:33:45.887 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/truncate.o 2024-05-08T07:33:47.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:47 smithi194 ceph-mon[33679]: pgmap v1499: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 472 KiB/s wr, 146 op/s 2024-05-08T07:33:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:47 smithi070 ceph-mon[29591]: pgmap v1499: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 472 KiB/s wr, 146 op/s 2024-05-08T07:33:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:47 smithi172 ceph-mon[33377]: pgmap v1499: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 472 KiB/s wr, 146 op/s 2024-05-08T07:33:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:49 smithi194 ceph-mon[33679]: pgmap v1500: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 284 KiB/s wr, 109 op/s 2024-05-08T07:33:49.520 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:49 smithi070 ceph-mon[29591]: pgmap v1500: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 284 KiB/s wr, 109 op/s 2024-05-08T07:33:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:49 smithi172 ceph-mon[33377]: pgmap v1500: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 284 KiB/s wr, 109 op/s 2024-05-08T07:33:50.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.338+0000 7f132be00700 1 -- 172.21.15.70:0/1590031250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1324103ef0 msgr2=0x7f13241103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:50.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.338+0000 7f132be00700 1 --2- 172.21.15.70:0/1590031250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1324103ef0 0x7f13241103d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b0a0 tx=0x7f131c00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.340+0000 7f132be00700 1 -- 172.21.15.70:0/1590031250 shutdown_connections 2024-05-08T07:33:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.340+0000 7f132be00700 1 --2- 172.21.15.70:0/1590031250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1324103ef0 0x7f13241103d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.340+0000 7f132be00700 1 --2- 172.21.15.70:0/1590031250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1324108460 0x7f1324108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.340+0000 7f132be00700 1 --2- 172.21.15.70:0/1590031250 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1324103550 0x7f13241039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.340+0000 7f132be00700 1 -- 172.21.15.70:0/1590031250 >> 172.21.15.70:0/1590031250 conn(0x7f132407a600 msgr2=0x7f132407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:50.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.340+0000 7f132be00700 1 -- 172.21.15.70:0/1590031250 shutdown_connections 2024-05-08T07:33:50.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.340+0000 7f132be00700 1 -- 172.21.15.70:0/1590031250 wait complete. 2024-05-08T07:33:50.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.341+0000 7f132be00700 1 Processor -- start 2024-05-08T07:33:50.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.341+0000 7f132be00700 1 -- start start 2024-05-08T07:33:50.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.342+0000 7f132be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1324103550 0x7f13240757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:50.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.342+0000 7f132be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1324103ef0 0x7f1324075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:50.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.342+0000 7f132be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1324108460 0x7f1324076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:50.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.342+0000 7f132be00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13241135a0 con 0x7f1324103ef0 2024-05-08T07:33:50.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.342+0000 7f132be00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1324113420 con 0x7f1324108460 2024-05-08T07:33:50.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.342+0000 7f132be00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1324113720 con 0x7f1324103550 2024-05-08T07:33:50.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.343+0000 7f1329400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1324103550 0x7f13240757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.343+0000 7f1329400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1324103550 0x7f13240757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:41608/0 (socket says 172.21.15.70:41608) 2024-05-08T07:33:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.343+0000 7f1329400700 1 -- 172.21.15.70:0/2959118469 learned_addr learned my addr 172.21.15.70:0/2959118469 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.343+0000 7f1329e00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1324108460 0x7f1324076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.343+0000 7f1328a00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1324103ef0 0x7f1324075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.344+0000 7f1329e00700 1 -- 172.21.15.70:0/2959118469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1324103550 msgr2=0x7f13240757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.344+0000 7f1329e00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1324103550 0x7f13240757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.344+0000 7f1329e00700 1 -- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1324103ef0 msgr2=0x7f1324075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.344+0000 7f1329e00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1324103ef0 0x7f1324075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.344+0000 7f1329e00700 1 -- 172.21.15.70:0/2959118469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13241a7fc0 con 0x7f1324108460 2024-05-08T07:33:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.344+0000 7f1328a00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1324103ef0 0x7f1324075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:33:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.344+0000 7f1329400700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1324103550 0x7f13240757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:33:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.344+0000 7f1329e00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1324108460 0x7f1324076220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b070 tx=0x7f131c004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:50.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.345+0000 7f1322000700 1 -- 172.21.15.70:0/2959118469 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c021070 con 0x7f1324108460 2024-05-08T07:33:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.345+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13241a8250 con 0x7f1324108460 2024-05-08T07:33:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.345+0000 7f1322000700 1 -- 172.21.15.70:0/2959118469 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f131c007b80 con 0x7f1324108460 2024-05-08T07:33:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.345+0000 7f1322000700 1 -- 172.21.15.70:0/2959118469 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131c005040 con 0x7f1324108460 2024-05-08T07:33:50.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.345+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13241a8650 con 0x7f1324108460 2024-05-08T07:33:50.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.348+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132410ba70 con 0x7f1324108460 2024-05-08T07:33:50.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.351+0000 7f1322000700 1 -- 172.21.15.70:0/2959118469 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f131c024070 con 0x7f1324108460 2024-05-08T07:33:50.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.353+0000 7f1322000700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f130c0b2a70 0x7f130c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:50.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.353+0000 7f1322000700 1 -- 172.21.15.70:0/2959118469 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 9583+0+0 (secure 0 0 0) 0x7f131c00f020 con 0x7f1324108460 2024-05-08T07:33:50.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.354+0000 7f1329400700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f130c0b2a70 0x7f130c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:50.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.355+0000 7f1329400700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f130c0b2a70 0x7f130c0b4f30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1318005950 tx=0x7f1318009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:50.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.365+0000 7f1322000700 1 -- 172.21.15.70:0/2959118469 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f131c02b020 con 0x7f1324108460 2024-05-08T07:33:50.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.825+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f132406a190 con 0x7f1324108460 2024-05-08T07:33:50.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.827+0000 7f1322000700 1 -- 172.21.15.70:0/2959118469 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f131c0ab920 con 0x7f1324108460 2024-05-08T07:33:50.826 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:33:50.827 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:33:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f130c0b2a70 msgr2=0x7f130c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f130c0b2a70 0x7f130c0b4f30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1318005950 tx=0x7f1318009260 comp rx=0 tx=0).stop 2024-05-08T07:33:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1324108460 msgr2=0x7f1324076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1324108460 0x7f1324076220 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b070 tx=0x7f131c004c80 comp rx=0 tx=0).stop 2024-05-08T07:33:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 shutdown_connections 2024-05-08T07:33:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f130c0b2a70 0x7f130c0b4f30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1324108460 0x7f1324076220 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1324103550 0x7f13240757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 --2- 172.21.15.70:0/2959118469 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1324103ef0 0x7f1324075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 >> 172.21.15.70:0/2959118469 conn(0x7f132407a600 msgr2=0x7f1324101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 shutdown_connections 2024-05-08T07:33:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:50.831+0000 7f132be00700 1 -- 172.21.15.70:0/2959118469 wait complete. 2024-05-08T07:33:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:33:51.120 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/locking/rtmutex_api.o 2024-05-08T07:33:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:51 smithi194 ceph-mon[33679]: pgmap v1501: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 294 KiB/s wr, 113 op/s 2024-05-08T07:33:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:51 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2959118469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:33:51.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:51 smithi070 ceph-mon[29591]: pgmap v1501: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 294 KiB/s wr, 113 op/s 2024-05-08T07:33:51.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:51 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2959118469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:33:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:51 smithi172 ceph-mon[33377]: pgmap v1501: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 294 KiB/s wr, 113 op/s 2024-05-08T07:33:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:51 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2959118469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:33:51.825 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/entry/thunk_64.o 2024-05-08T07:33:51.837 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/amd/lbr.o 2024-05-08T07:33:52.273 INFO:tasks.workunit.client.0.smithi070.stdout: CC ipc/mq_sysctl.o 2024-05-08T07:33:52.280 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/iomap/buffered-io.o 2024-05-08T07:33:52.590 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/entry/entry_64_compat.o 2024-05-08T07:33:52.732 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 70.4 --await-for 42.0' 2024-05-08T07:33:52.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 70.4 --await-for 42.0 2024-05-08T07:33:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:33:53.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:53 smithi194 ceph-mon[33679]: pgmap v1502: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 356 KiB/s wr, 113 op/s 2024-05-08T07:33:53.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:53 smithi070 ceph-mon[29591]: pgmap v1502: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 356 KiB/s wr, 113 op/s 2024-05-08T07:33:53.648 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/entry/syscall_32.o 2024-05-08T07:33:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:53 smithi172 ceph-mon[33377]: pgmap v1502: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 356 KiB/s wr, 113 op/s 2024-05-08T07:33:55.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:55 smithi194 ceph-mon[33679]: pgmap v1503: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 342 KiB/s wr, 106 op/s 2024-05-08T07:33:55.575 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:55 smithi070 ceph-mon[29591]: pgmap v1503: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 342 KiB/s wr, 106 op/s 2024-05-08T07:33:55.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:55 smithi172 ceph-mon[33377]: pgmap v1503: 129 pgs: 129 active+clean; 1.7 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 342 KiB/s wr, 106 op/s 2024-05-08T07:33:56.850 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/bts.o 2024-05-08T07:33:57.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.228+0000 7f7a22400700 1 -- 172.21.15.70:0/905108715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10a540 msgr2=0x7f7a1c10a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:57.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.228+0000 7f7a22400700 1 --2- 172.21.15.70:0/905108715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10a540 0x7f7a1c10a920 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0099c0 tx=0x7f7a0c009cd0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.228+0000 7f7a22400700 1 -- 172.21.15.70:0/905108715 shutdown_connections 2024-05-08T07:33:57.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.228+0000 7f7a22400700 1 --2- 172.21.15.70:0/905108715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a1c10ee60 0x7f7a1c1169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.228+0000 7f7a22400700 1 --2- 172.21.15.70:0/905108715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10a540 0x7f7a1c10a920 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.228+0000 7f7a22400700 1 --2- 172.21.15.70:0/905108715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a1c10aef0 0x7f7a1c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.228+0000 7f7a22400700 1 -- 172.21.15.70:0/905108715 >> 172.21.15.70:0/905108715 conn(0x7f7a1c079370 msgr2=0x7f7a1c07b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.228+0000 7f7a22400700 1 -- 172.21.15.70:0/905108715 shutdown_connections 2024-05-08T07:33:57.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.228+0000 7f7a22400700 1 -- 172.21.15.70:0/905108715 wait complete. 2024-05-08T07:33:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.230+0000 7f7a22400700 1 Processor -- start 2024-05-08T07:33:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.230+0000 7f7a22400700 1 -- start start 2024-05-08T07:33:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.230+0000 7f7a22400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a1c10a540 0x7f7a1c1a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.230+0000 7f7a22400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a1c10aef0 0x7f7a1c1a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.231+0000 7f7a22400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10ee60 0x7f7a1c1a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.231+0000 7f7a22400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c119bc0 con 0x7f7a1c10ee60 2024-05-08T07:33:57.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.231+0000 7f7a22400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c119a40 con 0x7f7a1c10a540 2024-05-08T07:33:57.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.231+0000 7f7a22400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1c119d40 con 0x7f7a1c10aef0 2024-05-08T07:33:57.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.231+0000 7f7a1b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a1c10a540 0x7f7a1c1a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.231+0000 7f7a1b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a1c10a540 0x7f7a1c1a0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:41060/0 (socket says 172.21.15.70:41060) 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.231+0000 7f7a1b400700 1 -- 172.21.15.70:0/3571381889 learned_addr learned my addr 172.21.15.70:0/3571381889 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.231+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a1c10aef0 0x7f7a1c1a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.232+0000 7f7a1be00700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10ee60 0x7f7a1c1a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.232+0000 7f7a1b400700 1 -- 172.21.15.70:0/3571381889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a1c10aef0 msgr2=0x7f7a1c1a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.232+0000 7f7a1b400700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a1c10aef0 0x7f7a1c1a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.232+0000 7f7a1b400700 1 -- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10ee60 msgr2=0x7f7a1c1a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.232+0000 7f7a1b400700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10ee60 0x7f7a1c1a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.232+0000 7f7a1b400700 1 -- 172.21.15.70:0/3571381889 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a1c1a5020 con 0x7f7a1c10a540 2024-05-08T07:33:57.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.233+0000 7f7a1b400700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a1c10a540 0x7f7a1c1a0010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00b580 tx=0x7f7a0c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:57.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.233+0000 7f7a13e00700 1 -- 172.21.15.70:0/3571381889 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c026070 con 0x7f7a1c10a540 2024-05-08T07:33:57.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.233+0000 7f7a22400700 1 -- 172.21.15.70:0/3571381889 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a1c1a52b0 con 0x7f7a1c10a540 2024-05-08T07:33:57.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.233+0000 7f7a22400700 1 -- 172.21.15.70:0/3571381889 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a1c1acb90 con 0x7f7a1c10a540 2024-05-08T07:33:57.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.234+0000 7f7a13e00700 1 -- 172.21.15.70:0/3571381889 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a0c005030 con 0x7f7a1c10a540 2024-05-08T07:33:57.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.234+0000 7f7a13e00700 1 -- 172.21.15.70:0/3571381889 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c004b00 con 0x7f7a1c10a540 2024-05-08T07:33:57.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.240+0000 7f7a13e00700 1 -- 172.21.15.70:0/3571381889 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7a0c029070 con 0x7f7a1c10a540 2024-05-08T07:33:57.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.242+0000 7f7a13e00700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a000b2ba0 0x7f7a000b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.242+0000 7f7a13e00700 1 -- 172.21.15.70:0/3571381889 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 9583+0+0 (secure 0 0 0) 0x7f7a0c0e4340 con 0x7f7a1c10a540 2024-05-08T07:33:57.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.242+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a000b2ba0 0x7f7a000b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.254+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a000b2ba0 0x7f7a000b5060 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c10ca90 tx=0x7f7a0800a300 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:57.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.257+0000 7f7a2ccaab80 1 Processor -- start 2024-05-08T07:33:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.258+0000 7f7a2ccaab80 1 -- start start 2024-05-08T07:33:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.258+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563392055240 0x563392055620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.258+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339204fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.258+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633920501d0 0x56339205c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.259+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563391fa1bb0 con 0x563392055240 2024-05-08T07:33:57.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.259+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563391f3f8f0 con 0x56339204f810 2024-05-08T07:33:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.259+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563391f9db70 con 0x5633920501d0 2024-05-08T07:33:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.259+0000 7f7a1aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339204fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.259+0000 7f7a1be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633920501d0 0x56339205c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.259+0000 7f7a1be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633920501d0 0x56339205c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:42598/0 (socket says 172.21.15.70:42598) 2024-05-08T07:33:57.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.259+0000 7f7a1be00700 1 -- 172.21.15.70:0/4203257986 learned_addr learned my addr 172.21.15.70:0/4203257986 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:57.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.259+0000 7f7a1b400700 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563392055240 0x563392055620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.261+0000 7f7a1aa00700 1 -- 172.21.15.70:0/4203257986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633920501d0 msgr2=0x56339205c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.261+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633920501d0 0x56339205c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.261+0000 7f7a1aa00700 1 -- 172.21.15.70:0/4203257986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563392055240 msgr2=0x563392055620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.261+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563392055240 0x563392055620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.261+0000 7f7a1aa00700 1 -- 172.21.15.70:0/4203257986 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563391eeea60 con 0x56339204f810 2024-05-08T07:33:57.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.262+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339204fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c06bf60 tx=0x7f7a08012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc1cc8c0db103d0f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.262+0000 7f7a1be00700 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633920501d0 0x56339205c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:33:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.262+0000 7f7a1b400700 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563392055240 0x563392055620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:33:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.263+0000 7f7a10c00700 1 -- 172.21.15.70:0/4203257986 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08016070 con 0x56339204f810 2024-05-08T07:33:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.263+0000 7f7a10c00700 1 -- 172.21.15.70:0/4203257986 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a08010d50 con 0x56339204f810 2024-05-08T07:33:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.263+0000 7f7a10c00700 1 -- 172.21.15.70:0/4203257986 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08025e10 con 0x56339204f810 2024-05-08T07:33:57.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.264+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/4203257986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 msgr2=0x56339204fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.264+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339204fc90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c06bf60 tx=0x7f7a08012000 comp rx=0 tx=0).stop 2024-05-08T07:33:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.264+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/4203257986 shutdown_connections 2024-05-08T07:33:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.264+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5633920501d0 0x56339205c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.264+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563392055240 0x563392055620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.264+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/4203257986 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339204fc90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.264+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/4203257986 >> 172.21.15.70:0/4203257986 conn(0x563391fc7860 msgr2=0x56339204a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:57.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.264+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/4203257986 shutdown_connections 2024-05-08T07:33:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.265+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/4203257986 wait complete. 2024-05-08T07:33:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.265+0000 7f7a2ccaab80 1 -- start start 2024-05-08T07:33:57.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.266+0000 7f7a2ccaab80 1 Processor -- start 2024-05-08T07:33:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.266+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56339204f810 0x56339205bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.266+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x563392058f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.266+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563392055240 0x563392059440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.266+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56339205c5a0 con 0x5633920501d0 2024-05-08T07:33:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.266+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563391f07cb0 con 0x563392055240 2024-05-08T07:33:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.266+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56339205c720 con 0x56339204f810 2024-05-08T07:33:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.267+0000 7f7a2ccaab80 10 client.0 _ll_register_callbacks cb 0x563391f48e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:33:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.267+0000 7f7a1b400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56339204f810 0x56339205bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.268+0000 7f7a1b400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56339204f810 0x56339205bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:42610/0 (socket says 172.21.15.70:42610) 2024-05-08T07:33:57.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.268+0000 7f7a1b400700 1 -- 172.21.15.70:0/2581064789 learned_addr learned my addr 172.21.15.70:0/2581064789 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.268+0000 7f7a1be00700 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563392055240 0x563392059440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.268+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x563392058f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.268+0000 7f7a1be00700 1 -- 172.21.15.70:0/2581064789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56339204f810 msgr2=0x56339205bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.268+0000 7f7a1be00700 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56339204f810 0x56339205bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.268+0000 7f7a1be00700 1 -- 172.21.15.70:0/2581064789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 msgr2=0x563392058f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.269+0000 7f7a1be00700 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x563392058f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.269+0000 7f7a1be00700 1 -- 172.21.15.70:0/2581064789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563391f675b0 con 0x563392055240 2024-05-08T07:33:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.269+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x563392058f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:33:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.269+0000 7f7a1b400700 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56339204f810 0x56339205bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:33:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.269+0000 7f7a1be00700 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563392055240 0x563392059440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a14008ba0 tx=0x7f7a14008eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a313fbe45dd5246 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:57.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.270+0000 7f7a05600700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T07:33:57.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.271+0000 7f7a05600700 1 -- 172.21.15.70:0/2581064789 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14003c00 con 0x563392055240 2024-05-08T07:33:57.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.271+0000 7f7a05600700 1 -- 172.21.15.70:0/2581064789 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(173..173 src has 1..173) ==== 9583+0+0 (secure 0 0 0) 0x7f7a14003da0 con 0x563392055240 2024-05-08T07:33:57.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.271+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/2581064789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a08010d50 con 0x563392055240 2024-05-08T07:33:57.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.272+0000 7f7a05600700 1 -- 172.21.15.70:0/2581064789 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7a14010890 con 0x563392055240 2024-05-08T07:33:57.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.272+0000 7f7a2ccaab80 10 client.35909 fetch_fsmap learned FSMap version 42 2024-05-08T07:33:57.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.272+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/2581064789 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563392066e70 con 0x563392055240 2024-05-08T07:33:57.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.272+0000 7f7a05600700 1 -- 172.21.15.70:0/2581064789 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a08010d50 con 0x563392055240 2024-05-08T07:33:57.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.274+0000 7f7a05600700 1 -- 172.21.15.70:0/2581064789 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f7a14004710 con 0x563392055240 2024-05-08T07:33:57.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.274+0000 7f7a2ccaab80 10 client.35909 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:33:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.274+0000 7f7a2ccaab80 10 client.35909 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:33:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.274+0000 7f7a2ccaab80 20 client.35909 populate_metadata read hostname 'smithi070' 2024-05-08T07:33:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.274+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5633920694b0 0x56339206b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.274+0000 7f7a2ccaab80 4 client.35909 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:33:57.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.274+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/2581064789 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56339201c2d0 con 0x5633920694b0 2024-05-08T07:33:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.275+0000 7f7a1b400700 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5633920694b0 0x56339206b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.276+0000 7f7a05600700 10 client.35909 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:33:57.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.276+0000 7f7a1b400700 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5633920694b0 0x56339206b8a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9642b1b19037977b server_cookie=31d368599582acc7 in_seq=0 out_seq=0 2024-05-08T07:33:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.277+0000 7f7a05600700 1 -- 172.21.15.70:0/2581064789 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56339201c2d0 con 0x5633920694b0 2024-05-08T07:33:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.277+0000 7f7a05600700 10 client.35909 handle_command_reply: tid=0 2024-05-08T07:33:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.277+0000 7f7a2ccaab80 1 client.35909 shutdown 2024-05-08T07:33:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.277+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/2581064789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563392055240 msgr2=0x563392059440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.277+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563392055240 0x563392059440 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7a14008ba0 tx=0x7f7a14008eb0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.278+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/2581064789 shutdown_connections 2024-05-08T07:33:57.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.278+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5633920694b0 0x56339206b8a0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.278+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563392055240 0x563392059440 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.278+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56339204f810 0x56339205bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.278+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/2581064789 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x563392058f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.278+0000 7f7a05600700 0 client.35909 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:33:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.278+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/2581064789 >> 172.21.15.70:0/2581064789 conn(0x563391fc7860 msgr2=0x563392044bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.278+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/2581064789 shutdown_connections 2024-05-08T07:33:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.278+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/2581064789 wait complete. 2024-05-08T07:33:57.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.279+0000 7f7a2ccaab80 20 client.35909 trim_cache size 0 max 16384 2024-05-08T07:33:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.303+0000 7f7a2ccaab80 1 Processor -- start 2024-05-08T07:33:57.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.303+0000 7f7a2ccaab80 1 -- start start 2024-05-08T07:33:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.304+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56339204f810 0x563392065710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.304+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633920501d0 0x563392054720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.304+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563392055240 0x563392051cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.304+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc011960 con 0x56339204f810 2024-05-08T07:33:57.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.304+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc00f1f0 con 0x5633920501d0 2024-05-08T07:33:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.304+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc00d020 con 0x563392055240 2024-05-08T07:33:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.304+0000 7f7a1b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56339204f810 0x563392065710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.305+0000 7f7a1b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56339204f810 0x563392065710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51874/0 (socket says 172.21.15.70:51874) 2024-05-08T07:33:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.305+0000 7f7a1b400700 1 -- 172.21.15.70:0/1022586982 learned_addr learned my addr 172.21.15.70:0/1022586982 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.305+0000 7f7a1be00700 1 --2- 172.21.15.70:0/1022586982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563392055240 0x563392051cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.305+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/1022586982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633920501d0 0x563392054720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.305+0000 7f7a1b400700 1 -- 172.21.15.70:0/1022586982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563392055240 msgr2=0x563392051cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:57.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.305+0000 7f7a1b400700 1 --2- 172.21.15.70:0/1022586982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563392055240 0x563392051cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.305+0000 7f7a1b400700 1 -- 172.21.15.70:0/1022586982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633920501d0 msgr2=0x563392054720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.305+0000 7f7a1b400700 1 --2- 172.21.15.70:0/1022586982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633920501d0 0x563392054720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.305+0000 7f7a1b400700 1 -- 172.21.15.70:0/1022586982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563392046d00 con 0x56339204f810 2024-05-08T07:33:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.306+0000 7f7a1b400700 1 --2- 172.21.15.70:0/1022586982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56339204f810 0x563392065710 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0aaee0 tx=0x7f7a0c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86939a37ee9791c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.306+0000 7f7a07e00700 1 -- 172.21.15.70:0/1022586982 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0ab230 con 0x56339204f810 2024-05-08T07:33:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.306+0000 7f7a07e00700 1 -- 172.21.15.70:0/1022586982 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a0c0af5e0 con 0x56339204f810 2024-05-08T07:33:57.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.306+0000 7f7a07e00700 1 -- 172.21.15.70:0/1022586982 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0ab6f0 con 0x56339204f810 2024-05-08T07:33:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.307+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/1022586982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56339204f810 msgr2=0x563392065710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:33:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.307+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/1022586982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56339204f810 0x563392065710 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0aaee0 tx=0x7f7a0c01a040 comp rx=0 tx=0).stop 2024-05-08T07:33:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.307+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/1022586982 shutdown_connections 2024-05-08T07:33:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.307+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/1022586982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563392055240 0x563392051cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.307+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/1022586982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56339204f810 0x563392065710 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.307+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/1022586982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5633920501d0 0x563392054720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.307+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/1022586982 >> 172.21.15.70:0/1022586982 conn(0x563391fc7860 msgr2=0x56339204f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:33:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.308+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/1022586982 shutdown_connections 2024-05-08T07:33:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.308+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/1022586982 wait complete. 2024-05-08T07:33:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.309+0000 7f7a2ccaab80 1 -- start start 2024-05-08T07:33:57.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.309+0000 7f7a2ccaab80 1 Processor -- start 2024-05-08T07:33:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.310+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339205ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.310+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x56339205cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.310+0000 7f7a2ccaab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563392055240 0x5633920d3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.311+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc00d6b0 con 0x5633920501d0 2024-05-08T07:33:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.311+0000 7f7a1aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x56339205cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.311+0000 7f7a1b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339205ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.311+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc00eb20 con 0x56339204f810 2024-05-08T07:33:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.311+0000 7f7a1b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339205ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:41106/0 (socket says 172.21.15.70:41106) 2024-05-08T07:33:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.311+0000 7f7a2ccaab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f79fc00dd80 con 0x563392055240 2024-05-08T07:33:57.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.311+0000 7f7a1b400700 1 -- 172.21.15.70:0/394465806 learned_addr learned my addr 172.21.15.70:0/394465806 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:33:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.311+0000 7f7a2ccaab80 10 client.0 _ll_register_callbacks cb 0x563391f48e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:33:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.311+0000 7f7a1aa00700 1 -- 172.21.15.70:0/394465806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563392055240 msgr2=0x5633920d3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.312+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563392055240 0x5633920d3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.312+0000 7f7a1aa00700 1 -- 172.21.15.70:0/394465806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 msgr2=0x56339205ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:33:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.312+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339205ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:33:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.312+0000 7f7a1aa00700 1 -- 172.21.15.70:0/394465806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56339204a640 con 0x5633920501d0 2024-05-08T07:33:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.312+0000 7f7a1b400700 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339205ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:33:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.312+0000 7f7a1aa00700 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x56339205cf90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x56339205a4d0 tx=0x7f7a08010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91dc6c9e754ee27a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:33:57.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.312+0000 7f7a05600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:33:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.313+0000 7f7a05600700 1 -- 172.21.15.70:0/394465806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a080048f0 con 0x5633920501d0 2024-05-08T07:33:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.313+0000 7f7a05600700 1 -- 172.21.15.70:0/394465806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(173..173 src has 1..173) ==== 9583+0+0 (secure 0 0 0) 0x7f7a08004a90 con 0x5633920501d0 2024-05-08T07:33:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.313+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/394465806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a0c0af5e0 con 0x5633920501d0 2024-05-08T07:33:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.313+0000 7f7a05600700 1 -- 172.21.15.70:0/394465806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7a0803e050 con 0x5633920501d0 2024-05-08T07:33:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.313+0000 7f7a2ccaab80 10 client.16809 fetch_fsmap learned FSMap version 42 2024-05-08T07:33:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.313+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/394465806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5633920d5100 con 0x5633920501d0 2024-05-08T07:33:57.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.314+0000 7f7a05600700 1 -- 172.21.15.70:0/394465806 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a0c0af5e0 con 0x5633920501d0 2024-05-08T07:33:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.314+0000 7f7a05600700 1 -- 172.21.15.70:0/394465806 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f7a08030c40 con 0x5633920501d0 2024-05-08T07:33:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.314+0000 7f7a2ccaab80 10 client.16809 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:33:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.314+0000 7f7a2ccaab80 10 client.16809 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:33:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.314+0000 7f7a2ccaab80 20 client.16809 populate_metadata read hostname 'smithi070' 2024-05-08T07:33:57.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.314+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5633920d5530 0x5633920d7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:33:57.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.315+0000 7f7a2ccaab80 4 client.16809 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.4, "await_for": 42.0}] 2024-05-08T07:33:57.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.315+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/394465806 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.4, "await_for": 42.0}) -- 0x563391faf590 con 0x5633920d5530 2024-05-08T07:33:57.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.315+0000 7f7a1b400700 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5633920d5530 0x5633920d7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:33:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.316+0000 7f7a1b400700 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5633920d5530 0x5633920d7950 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=867498b887dce44b server_cookie=795ed2191aed8c9d in_seq=0 out_seq=0 2024-05-08T07:33:57.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:33:57.316+0000 7f7a05600700 10 client.16809 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:33:57.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:57 smithi194 ceph-mon[33679]: pgmap v1504: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 460 KiB/s wr, 107 op/s 2024-05-08T07:33:57.587 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/realmode/rm/header.o 2024-05-08T07:33:57.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:57 smithi070 ceph-mon[29591]: pgmap v1504: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 460 KiB/s wr, 107 op/s 2024-05-08T07:33:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:57 smithi172 ceph-mon[33377]: pgmap v1504: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 460 KiB/s wr, 107 op/s 2024-05-08T07:33:58.705 INFO:tasks.workunit.client.0.smithi070.stdout: AR ipc/built-in.a 2024-05-08T07:33:58.720 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/realmode/rm/trampoline_64.o 2024-05-08T07:33:58.839 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/vmscan.o 2024-05-08T07:33:59.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:33:59 smithi194 ceph-mon[33679]: pgmap v1505: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 278 KiB/s wr, 24 op/s 2024-05-08T07:33:59.512 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:33:59 smithi070 ceph-mon[29591]: pgmap v1505: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 278 KiB/s wr, 24 op/s 2024-05-08T07:33:59.601 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/locking/qrwlock.o 2024-05-08T07:33:59.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:33:59 smithi172 ceph-mon[33377]: pgmap v1505: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 278 KiB/s wr, 24 op/s 2024-05-08T07:34:01.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:01 smithi194 ceph-mon[33679]: pgmap v1506: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 314 KiB/s wr, 98 op/s 2024-05-08T07:34:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:01 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:34:01.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:01 smithi070 ceph-mon[29591]: pgmap v1506: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 314 KiB/s wr, 98 op/s 2024-05-08T07:34:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:01 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:34:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:01 smithi172 ceph-mon[33377]: pgmap v1506: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 314 KiB/s wr, 98 op/s 2024-05-08T07:34:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:01 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:34:02.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:34:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:34:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:34:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:34:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:34:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:34:02.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:34:02.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:34:02.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:34:03.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:03 smithi070 ceph-mon[29591]: pgmap v1507: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 425 KiB/s wr, 131 op/s 2024-05-08T07:34:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:03 smithi172 ceph-mon[33377]: pgmap v1507: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 425 KiB/s wr, 131 op/s 2024-05-08T07:34:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:03 smithi194 ceph-mon[33679]: pgmap v1507: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 425 KiB/s wr, 131 op/s 2024-05-08T07:34:05.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:05 smithi070 ceph-mon[29591]: pgmap v1508: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 280 KiB/s wr, 124 op/s 2024-05-08T07:34:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:05 smithi172 ceph-mon[33377]: pgmap v1508: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 280 KiB/s wr, 124 op/s 2024-05-08T07:34:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:05 smithi194 ceph-mon[33679]: pgmap v1508: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 280 KiB/s wr, 124 op/s 2024-05-08T07:34:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:07 smithi070 ceph-mon[29591]: pgmap v1509: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 283 KiB/s wr, 126 op/s 2024-05-08T07:34:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:07 smithi172 ceph-mon[33377]: pgmap v1509: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 283 KiB/s wr, 126 op/s 2024-05-08T07:34:07.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:07 smithi194 ceph-mon[33679]: pgmap v1509: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 283 KiB/s wr, 126 op/s 2024-05-08T07:34:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:09 smithi070 ceph-mon[29591]: pgmap v1510: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 161 KiB/s wr, 115 op/s 2024-05-08T07:34:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:09 smithi172 ceph-mon[33377]: pgmap v1510: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 161 KiB/s wr, 115 op/s 2024-05-08T07:34:09.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:09 smithi194 ceph-mon[33679]: pgmap v1510: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 161 KiB/s wr, 115 op/s 2024-05-08T07:34:11.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:11 smithi070 ceph-mon[29591]: pgmap v1511: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 161 KiB/s wr, 116 op/s 2024-05-08T07:34:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:11 smithi172 ceph-mon[33377]: pgmap v1511: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 161 KiB/s wr, 116 op/s 2024-05-08T07:34:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:11 smithi194 ceph-mon[33679]: pgmap v1511: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 161 KiB/s wr, 116 op/s 2024-05-08T07:34:13.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:13 smithi070 ceph-mon[29591]: pgmap v1512: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 131 KiB/s wr, 45 op/s 2024-05-08T07:34:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:13 smithi172 ceph-mon[33377]: pgmap v1512: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 131 KiB/s wr, 45 op/s 2024-05-08T07:34:13.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:13 smithi194 ceph-mon[33679]: pgmap v1512: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 131 KiB/s wr, 45 op/s 2024-05-08T07:34:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:15 smithi070 ceph-mon[29591]: pgmap v1513: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-05-08T07:34:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:15 smithi172 ceph-mon[33377]: pgmap v1513: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-05-08T07:34:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:15 smithi194 ceph-mon[33679]: pgmap v1513: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 10 KiB/s wr, 10 op/s 2024-05-08T07:34:17.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:17 smithi070 ceph-mon[29591]: pgmap v1514: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 64 KiB/s wr, 52 op/s 2024-05-08T07:34:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:17 smithi172 ceph-mon[33377]: pgmap v1514: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 64 KiB/s wr, 52 op/s 2024-05-08T07:34:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:17 smithi194 ceph-mon[33679]: pgmap v1514: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 64 KiB/s wr, 52 op/s 2024-05-08T07:34:19.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.429+0000 7f7a05600700 1 -- 172.21.15.70:0/394465806 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x563391faf590 con 0x5633920d5530 2024-05-08T07:34:19.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.429+0000 7f7a05600700 10 client.16809 handle_command_reply: tid=0 2024-05-08T07:34:19.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.429+0000 7f7a2ccaab80 1 client.16809 shutdown 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.430+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/394465806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 msgr2=0x56339205cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.430+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x56339205cf90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x56339205a4d0 tx=0x7f7a08010bd0 comp rx=0 tx=0).stop 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.431+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/394465806 shutdown_connections 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.431+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5633920d5530 0x5633920d7950 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.431+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563392055240 0x5633920d3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.431+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56339204f810 0x56339205ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.431+0000 7f7a2ccaab80 1 --2- 172.21.15.70:0/394465806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633920501d0 0x56339205cf90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.431+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/394465806 >> 172.21.15.70:0/394465806 conn(0x563391fc7860 msgr2=0x563392052c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.431+0000 7f7a05600700 0 client.16809 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:34:19.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.432+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/394465806 shutdown_connections 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.432+0000 7f7a2ccaab80 1 -- 172.21.15.70:0/394465806 wait complete. 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.432+0000 7f7a2ccaab80 20 client.16809 trim_cache size 0 max 16384 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 118, 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "46324a0d": { 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 118, 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:34:19.432 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.4, 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:19.433 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:19.434 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:19.434 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:34:19.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 -- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a000b2ba0 msgr2=0x7f7a000b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a000b2ba0 0x7f7a000b5060 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c10ca90 tx=0x7f7a0800a300 comp rx=0 tx=0).stop 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 -- 172.21.15.70:0/3571381889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a1c10a540 msgr2=0x7f7a1c1a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a1c10a540 0x7f7a1c1a0010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c00b580 tx=0x7f7a0c00f690 comp rx=0 tx=0).stop 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 -- 172.21.15.70:0/3571381889 shutdown_connections 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a000b2ba0 0x7f7a000b5060 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a1c10ee60 0x7f7a1c1a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a1c10a540 0x7f7a1c1a0010 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 --2- 172.21.15.70:0/3571381889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a1c10aef0 0x7f7a1c1a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.434+0000 7f7a22400700 1 -- 172.21.15.70:0/3571381889 >> 172.21.15.70:0/3571381889 conn(0x7f7a1c079370 msgr2=0x7f7a1c10d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.435+0000 7f7a22400700 1 -- 172.21.15.70:0/3571381889 shutdown_connections 2024-05-08T07:34:19.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:19.435+0000 7f7a22400700 1 -- 172.21.15.70:0/3571381889 wait complete. 2024-05-08T07:34:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:19 smithi070 ceph-mon[29591]: pgmap v1515: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 61 KiB/s wr, 49 op/s 2024-05-08T07:34:19.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:19 smithi172 ceph-mon[33377]: pgmap v1515: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 61 KiB/s wr, 49 op/s 2024-05-08T07:34:19.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:19 smithi194 ceph-mon[33679]: pgmap v1515: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 61 KiB/s wr, 49 op/s 2024-05-08T07:34:21.521 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '46324a0d', quiesce took 39.5 seconds. Will release after: 10.4 2024-05-08T07:34:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:21 smithi070 ceph-mon[29591]: pgmap v1516: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 72 KiB/s wr, 51 op/s 2024-05-08T07:34:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:21 smithi172 ceph-mon[33377]: pgmap v1516: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 72 KiB/s wr, 51 op/s 2024-05-08T07:34:21.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:21 smithi194 ceph-mon[33679]: pgmap v1516: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 72 KiB/s wr, 51 op/s 2024-05-08T07:34:23.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:23 smithi070 ceph-mon[29591]: pgmap v1517: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 54 op/s 2024-05-08T07:34:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:23 smithi172 ceph-mon[33377]: pgmap v1517: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 54 op/s 2024-05-08T07:34:23.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:23 smithi194 ceph-mon[33679]: pgmap v1517: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 114 KiB/s wr, 54 op/s 2024-05-08T07:34:25.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:25 smithi070 ceph-mon[29591]: pgmap v1518: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 108 KiB/s wr, 52 op/s 2024-05-08T07:34:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:25 smithi172 ceph-mon[33377]: pgmap v1518: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 108 KiB/s wr, 52 op/s 2024-05-08T07:34:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:25 smithi194 ceph-mon[33679]: pgmap v1518: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 108 KiB/s wr, 52 op/s 2024-05-08T07:34:26.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:26 smithi070 ceph-mon[29591]: osdmap e174: 12 total, 12 up, 12 in 2024-05-08T07:34:26.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:26 smithi172 ceph-mon[33377]: osdmap e174: 12 total, 12 up, 12 in 2024-05-08T07:34:26.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:26 smithi194 ceph-mon[33679]: osdmap e174: 12 total, 12 up, 12 in 2024-05-08T07:34:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:27 smithi070 ceph-mon[29591]: pgmap v1520: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 124 KiB/s wr, 13 op/s 2024-05-08T07:34:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:27 smithi172 ceph-mon[33377]: pgmap v1520: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 124 KiB/s wr, 13 op/s 2024-05-08T07:34:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:27 smithi194 ceph-mon[33679]: pgmap v1520: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 124 KiB/s wr, 13 op/s 2024-05-08T07:34:29.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:29 smithi070 ceph-mon[29591]: pgmap v1521: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 124 KiB/s wr, 13 op/s 2024-05-08T07:34:29.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:29 smithi172 ceph-mon[33377]: pgmap v1521: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 124 KiB/s wr, 13 op/s 2024-05-08T07:34:29.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:29 smithi194 ceph-mon[33679]: pgmap v1521: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 124 KiB/s wr, 13 op/s 2024-05-08T07:34:31.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:31 smithi070 ceph-mon[29591]: pgmap v1522: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 111 KiB/s wr, 12 op/s 2024-05-08T07:34:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:31 smithi172 ceph-mon[33377]: pgmap v1522: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 111 KiB/s wr, 12 op/s 2024-05-08T07:34:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:31 smithi194 ceph-mon[33679]: pgmap v1522: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 111 KiB/s wr, 12 op/s 2024-05-08T07:34:31.922 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:34:32.490 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:34:33.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:33 smithi070 ceph-mon[29591]: pgmap v1523: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 82 KiB/s wr, 11 op/s 2024-05-08T07:34:33.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:33 smithi070 ceph-mon[29591]: osdmap e175: 12 total, 12 up, 12 in 2024-05-08T07:34:33.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:33 smithi172 ceph-mon[33377]: pgmap v1523: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 82 KiB/s wr, 11 op/s 2024-05-08T07:34:33.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:33 smithi172 ceph-mon[33377]: osdmap e175: 12 total, 12 up, 12 in 2024-05-08T07:34:33.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:33 smithi194 ceph-mon[33679]: pgmap v1523: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 82 KiB/s wr, 11 op/s 2024-05-08T07:34:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:33 smithi194 ceph-mon[33679]: osdmap e175: 12 total, 12 up, 12 in 2024-05-08T07:34:35.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.402+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2280657323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c681056c0 msgr2=0x7f2c68105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:35.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.402+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2280657323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c681056c0 0x7f2c68105b40 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f2c54009990 tx=0x7f2c54009ca0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.402+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2280657323 shutdown_connections 2024-05-08T07:34:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.402+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2280657323 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c68106080 0x7f2c68112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.402+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2280657323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c6810b6c0 0x7f2c6810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.402+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2280657323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c681056c0 0x7f2c68105b40 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.402+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2280657323 >> 172.21.15.70:0/2280657323 conn(0x7f2c681011b0 msgr2=0x7f2c681035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.402+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2280657323 shutdown_connections 2024-05-08T07:34:35.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.402+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2280657323 wait complete. 2024-05-08T07:34:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.404+0000 7f2c6fa00700 1 Processor -- start 2024-05-08T07:34:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.404+0000 7f2c6fa00700 1 -- start start 2024-05-08T07:34:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.404+0000 7f2c6fa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c681056c0 0x7f2c681a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.404+0000 7f2c6fa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c68106080 0x7f2c681a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.404+0000 7f2c6fa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c6810b6c0 0x7f2c6819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.404+0000 7f2c6fa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c68115800 con 0x7f2c6810b6c0 2024-05-08T07:34:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.404+0000 7f2c6fa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c68115680 con 0x7f2c68106080 2024-05-08T07:34:35.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.404+0000 7f2c6fa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2c68115980 con 0x7f2c681056c0 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c6810b6c0 0x7f2c6819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c6810b6c0 0x7f2c6819bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34158/0 (socket says 172.21.15.70:34158) 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6da00700 1 -- 172.21.15.70:0/2255326884 learned_addr learned my addr 172.21.15.70:0/2255326884 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c67e00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c68106080 0x7f2c681a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6d000700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c681056c0 0x7f2c681a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6da00700 1 -- 172.21.15.70:0/2255326884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c681056c0 msgr2=0x7f2c681a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6da00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c681056c0 0x7f2c681a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6da00700 1 -- 172.21.15.70:0/2255326884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c68106080 msgr2=0x7f2c681a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6da00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c68106080 0x7f2c681a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6da00700 1 -- 172.21.15.70:0/2255326884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6819c260 con 0x7f2c6810b6c0 2024-05-08T07:34:35.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.405+0000 7f2c6d000700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c681056c0 0x7f2c681a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:34:35.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.406+0000 7f2c6da00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c6810b6c0 0x7f2c6819bb00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000ef30 tx=0x7f2c6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:34:35.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.406+0000 7f2c65600700 1 -- 172.21.15.70:0/2255326884 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c600092e0 con 0x7f2c6810b6c0 2024-05-08T07:34:35.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.406+0000 7f2c65600700 1 -- 172.21.15.70:0/2255326884 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c60004bb0 con 0x7f2c6810b6c0 2024-05-08T07:34:35.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.406+0000 7f2c65600700 1 -- 172.21.15.70:0/2255326884 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c60004020 con 0x7f2c6810b6c0 2024-05-08T07:34:35.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.406+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6819c4f0 con 0x7f2c6810b6c0 2024-05-08T07:34:35.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.407+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c681a8810 con 0x7f2c6810b6c0 2024-05-08T07:34:35.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.408+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6806a190 con 0x7f2c6810b6c0 2024-05-08T07:34:35.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.410+0000 7f2c65600700 1 -- 172.21.15.70:0/2255326884 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2c6001b030 con 0x7f2c6810b6c0 2024-05-08T07:34:35.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.412+0000 7f2c65600700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c500b2a70 0x7f2c500b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:35.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.412+0000 7f2c65600700 1 -- 172.21.15.70:0/2255326884 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 9583+0+0 (secure 0 0 0) 0x7f2c600e25a0 con 0x7f2c6810b6c0 2024-05-08T07:34:35.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.412+0000 7f2c6d000700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c500b2a70 0x7f2c500b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:35.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.413+0000 7f2c6d000700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c500b2a70 0x7f2c500b4f30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009c90 tx=0x7f2c5c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:34:35.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.416+0000 7f2c65600700 1 -- 172.21.15.70:0/2255326884 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2c60022020 con 0x7f2c6810b6c0 2024-05-08T07:34:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:35 smithi172 ceph-mon[33377]: pgmap v1525: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-05-08T07:34:35.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.718+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c6802e510 con 0x7f2c6810b6c0 2024-05-08T07:34:35.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:35 smithi070 ceph-mon[29591]: pgmap v1525: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-05-08T07:34:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.720+0000 7f2c65600700 1 -- 172.21.15.70:0/2255326884 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f2c60010040 con 0x7f2c6810b6c0 2024-05-08T07:34:35.720 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:34:35.721 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:34:35.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c500b2a70 msgr2=0x7f2c500b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:35.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c500b2a70 0x7f2c500b4f30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009c90 tx=0x7f2c5c009260 comp rx=0 tx=0).stop 2024-05-08T07:34:35.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c6810b6c0 msgr2=0x7f2c6819bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:35.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c6810b6c0 0x7f2c6819bb00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000ef30 tx=0x7f2c6000c3a0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 shutdown_connections 2024-05-08T07:34:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c500b2a70 0x7f2c500b4f30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c6810b6c0 0x7f2c6819bb00 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c681056c0 0x7f2c681a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 --2- 172.21.15.70:0/2255326884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c68106080 0x7f2c681a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 >> 172.21.15.70:0/2255326884 conn(0x7f2c681011b0 msgr2=0x7f2c68101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 shutdown_connections 2024-05-08T07:34:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:35.723+0000 7f2c6fa00700 1 -- 172.21.15.70:0/2255326884 wait complete. 2024-05-08T07:34:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:34:35.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:35 smithi194 ceph-mon[33679]: pgmap v1525: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 9 op/s 2024-05-08T07:34:36.533 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 46324a0d --release --await' 2024-05-08T07:34:36.533 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 46324a0d --release --await 2024-05-08T07:34:36.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:36 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2255326884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:34:36.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:36 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2255326884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:34:36.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:36 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2255326884' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:34:36.983 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:34:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:37 smithi172 ceph-mon[33377]: pgmap v1526: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-05-08T07:34:37.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:37 smithi194 ceph-mon[33679]: pgmap v1526: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-05-08T07:34:37.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:37 smithi070 ceph-mon[29591]: pgmap v1526: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-05-08T07:34:39.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.371+0000 7fc3fb200700 1 -- 172.21.15.70:0/345642264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 msgr2=0x7fc3fc103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:39.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.371+0000 7fc3fb200700 1 --2- 172.21.15.70:0/345642264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 0x7fc3fc103850 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009990 tx=0x7fc3e8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.371+0000 7fc3fb200700 1 -- 172.21.15.70:0/345642264 shutdown_connections 2024-05-08T07:34:39.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.371+0000 7fc3fb200700 1 --2- 172.21.15.70:0/345642264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3fc103d90 0x7fc3fc1102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.371+0000 7fc3fb200700 1 --2- 172.21.15.70:0/345642264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3fc109460 0x7fc3fc109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.371+0000 7fc3fb200700 1 --2- 172.21.15.70:0/345642264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 0x7fc3fc103850 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.371+0000 7fc3fb200700 1 -- 172.21.15.70:0/345642264 >> 172.21.15.70:0/345642264 conn(0x7fc3fc0fef20 msgr2=0x7fc3fc101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:39.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.371+0000 7fc3fb200700 1 -- 172.21.15.70:0/345642264 shutdown_connections 2024-05-08T07:34:39.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.371+0000 7fc3fb200700 1 -- 172.21.15.70:0/345642264 wait complete. 2024-05-08T07:34:39.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.372+0000 7fc3fb200700 1 Processor -- start 2024-05-08T07:34:39.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3fb200700 1 -- start start 2024-05-08T07:34:39.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3fb200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 0x7fc3fc0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3fb200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3fc103d90 0x7fc3fc075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3fb200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3fc109460 0x7fc3fc076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3fb200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc113420 con 0x7fc3fc1033d0 2024-05-08T07:34:39.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3fb200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1132a0 con 0x7fc3fc103d90 2024-05-08T07:34:39.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3fb200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1135a0 con 0x7fc3fc109460 2024-05-08T07:34:39.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3f9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 0x7fc3fc0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3f9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 0x7fc3fc0757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38046/0 (socket says 172.21.15.70:38046) 2024-05-08T07:34:39.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.373+0000 7fc3f9e00700 1 -- 172.21.15.70:0/1450552676 learned_addr learned my addr 172.21.15.70:0/1450552676 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.374+0000 7fc3f9400700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3fc103d90 0x7fc3fc075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.374+0000 7fc3fa800700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3fc109460 0x7fc3fc076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.374+0000 7fc3f9e00700 1 -- 172.21.15.70:0/1450552676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3fc109460 msgr2=0x7fc3fc076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.374+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3fc109460 0x7fc3fc076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.374+0000 7fc3f9e00700 1 -- 172.21.15.70:0/1450552676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3fc103d90 msgr2=0x7fc3fc075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.374+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3fc103d90 0x7fc3fc075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.374+0000 7fc3f9e00700 1 -- 172.21.15.70:0/1450552676 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc1a7e80 con 0x7fc3fc1033d0 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.374+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 0x7fc3fc0757a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0060b0 tx=0x7fc3ec007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.375+0000 7fc3f2a00700 1 -- 172.21.15.70:0/1450552676 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec01a070 con 0x7fc3fc1033d0 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.375+0000 7fc3f2a00700 1 -- 172.21.15.70:0/1450552676 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3ec00de20 con 0x7fc3fc1033d0 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.375+0000 7fc3f2a00700 1 -- 172.21.15.70:0/1450552676 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec014690 con 0x7fc3fc1033d0 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.375+0000 7fc3fb200700 1 -- 172.21.15.70:0/1450552676 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc1a8170 con 0x7fc3fc1033d0 2024-05-08T07:34:39.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.375+0000 7fc3fb200700 1 -- 172.21.15.70:0/1450552676 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc1a86b0 con 0x7fc3fc1033d0 2024-05-08T07:34:39.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.378+0000 7fc3f2a00700 1 -- 172.21.15.70:0/1450552676 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc3ec01d070 con 0x7fc3fc1033d0 2024-05-08T07:34:39.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.380+0000 7fc3f2a00700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3e00b29f0 0x7fc3e00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.380+0000 7fc3f2a00700 1 -- 172.21.15.70:0/1450552676 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(175..175 src has 1..175) ==== 9583+0+0 (secure 0 0 0) 0x7fc3ec0e2300 con 0x7fc3fc1033d0 2024-05-08T07:34:39.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.380+0000 7fc3f9400700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3e00b29f0 0x7fc3e00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.381+0000 7fc3f9400700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3e00b29f0 0x7fc3e00b4eb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8006010 tx=0x7fc3e801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:34:39.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.396+0000 7fc40b417b80 1 Processor -- start 2024-05-08T07:34:39.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc40b417b80 1 -- start start 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4af60 0x562ad7e4b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 0x562ad7e45490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 0x562ad7e45f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc40b417b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562ad7d97b20 con 0x562ad7e4af60 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc40b417b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562ad7d35860 con 0x562ad7e4b880 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc40b417b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562ad7d93ae0 con 0x562ad7e45ab0 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc3f9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4af60 0x562ad7e4b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc3f9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4af60 0x562ad7e4b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38054/0 (socket says 172.21.15.70:38054) 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.397+0000 7fc3f9e00700 1 -- 172.21.15.70:0/2464550889 learned_addr learned my addr 172.21.15.70:0/2464550889 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.398+0000 7fc3f9400700 1 --2- 172.21.15.70:0/2464550889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 0x562ad7e45490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.398+0000 7fc3fa800700 1 --2- 172.21.15.70:0/2464550889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 0x562ad7e45f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.398+0000 7fc3f9e00700 1 -- 172.21.15.70:0/2464550889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 msgr2=0x562ad7e45f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.398+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/2464550889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 0x562ad7e45f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.398+0000 7fc3f9e00700 1 -- 172.21.15.70:0/2464550889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 msgr2=0x562ad7e45490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:34:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.398+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/2464550889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 0x562ad7e45490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.398+0000 7fc3f9e00700 1 -- 172.21.15.70:0/2464550889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad7ce49d0 con 0x562ad7e4af60 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.398+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/2464550889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4af60 0x562ad7e4b340 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0df570 tx=0x7fc3ec0a89d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2236409226ba0698 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.399+0000 7fc3e7400700 1 -- 172.21.15.70:0/2464550889 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0ad510 con 0x562ad7e4af60 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.399+0000 7fc3e7400700 1 -- 172.21.15.70:0/2464550889 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3ec0b1fc0 con 0x562ad7e4af60 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.399+0000 7fc3e7400700 1 -- 172.21.15.70:0/2464550889 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0a9620 con 0x562ad7e4af60 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.400+0000 7fc40b417b80 1 -- 172.21.15.70:0/2464550889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4af60 msgr2=0x562ad7e4b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.400+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2464550889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4af60 0x562ad7e4b340 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0df570 tx=0x7fc3ec0a89d0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.400+0000 7fc40b417b80 1 -- 172.21.15.70:0/2464550889 shutdown_connections 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.400+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2464550889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 0x562ad7e45f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.400+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2464550889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4af60 0x562ad7e4b340 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.400+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2464550889 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 0x562ad7e45490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.400+0000 7fc40b417b80 1 -- 172.21.15.70:0/2464550889 >> 172.21.15.70:0/2464550889 conn(0x562ad7d73c60 msgr2=0x562ad7e3fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:39.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.400+0000 7fc40b417b80 1 -- 172.21.15.70:0/2464550889 shutdown_connections 2024-05-08T07:34:39.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.400+0000 7fc40b417b80 1 -- 172.21.15.70:0/2464550889 wait complete. 2024-05-08T07:34:39.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.401+0000 7fc40b417b80 1 -- start start 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.401+0000 7fc40b417b80 1 Processor -- start 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.401+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 0x562ad7e516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.401+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4af60 0x562ad7e4ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.401+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e4efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.401+0000 7fc40b417b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562ad7e523a0 con 0x562ad7e4b880 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.401+0000 7fc40b417b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562ad7cfdc20 con 0x562ad7e4af60 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.401+0000 7fc40b417b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562ad7e52520 con 0x562ad7e45ab0 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc40b417b80 10 client.0 _ll_register_callbacks cb 0x562ad7d3ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3fa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e4efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3fa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e4efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38056/0 (socket says 172.21.15.70:38056) 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3fa800700 1 -- 172.21.15.70:0/1294346710 learned_addr learned my addr 172.21.15.70:0/1294346710 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3f9400700 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4af60 0x562ad7e4ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 0x562ad7e516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3fa800700 1 -- 172.21.15.70:0/1294346710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 msgr2=0x562ad7e516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:34:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3fa800700 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 0x562ad7e516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3fa800700 1 -- 172.21.15.70:0/1294346710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4af60 msgr2=0x562ad7e4ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:34:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3fa800700 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4af60 0x562ad7e4ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3fa800700 1 -- 172.21.15.70:0/1294346710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad7d5d520 con 0x562ad7e4b880 2024-05-08T07:34:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 0x562ad7e516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:34:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.402+0000 7fc3f9400700 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4af60 0x562ad7e4ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:34:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.403+0000 7fc3fa800700 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e4efa0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4010840 tx=0x7fc3f4010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656d283a2d24ff0c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:34:39.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.403+0000 7fc3dbe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:34:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.403+0000 7fc3dbe00700 1 -- 172.21.15.70:0/1294346710 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400ea90 con 0x562ad7e4b880 2024-05-08T07:34:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.403+0000 7fc3dbe00700 1 -- 172.21.15.70:0/1294346710 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(175..175 src has 1..175) ==== 9583+0+0 (secure 0 0 0) 0x7fc3f400ec30 con 0x562ad7e4b880 2024-05-08T07:34:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.403+0000 7fc40b417b80 1 -- 172.21.15.70:0/1294346710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3ec0b1fc0 con 0x562ad7e4b880 2024-05-08T07:34:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.403+0000 7fc3dbe00700 1 -- 172.21.15.70:0/1294346710 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc3f4025050 con 0x562ad7e4b880 2024-05-08T07:34:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.403+0000 7fc40b417b80 10 client.16827 fetch_fsmap learned FSMap version 42 2024-05-08T07:34:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.403+0000 7fc40b417b80 1 -- 172.21.15.70:0/1294346710 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562ad7e5cd50 con 0x562ad7e4b880 2024-05-08T07:34:39.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.404+0000 7fc3dbe00700 1 -- 172.21.15.70:0/1294346710 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3ec0b1fc0 con 0x562ad7e4b880 2024-05-08T07:34:39.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.404+0000 7fc3dbe00700 1 -- 172.21.15.70:0/1294346710 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fc3f4011440 con 0x562ad7e4b880 2024-05-08T07:34:39.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.404+0000 7fc40b417b80 10 client.16827 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:34:39.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.404+0000 7fc40b417b80 10 client.16827 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:34:39.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.404+0000 7fc40b417b80 20 client.16827 populate_metadata read hostname 'smithi070' 2024-05-08T07:34:39.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.404+0000 7fc40b417b80 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562ad7e5f390 0x562ad7e61780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.404+0000 7fc40b417b80 4 client.16827 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:34:39.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.404+0000 7fc40b417b80 1 -- 172.21.15.70:0/1294346710 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ad7e121a0 con 0x562ad7e5f390 2024-05-08T07:34:39.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.405+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562ad7e5f390 0x562ad7e61780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.406+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562ad7e5f390 0x562ad7e61780 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d64e48c601e1c78c server_cookie=e44430c060ac13c7 in_seq=0 out_seq=0 2024-05-08T07:34:39.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.406+0000 7fc3dbe00700 10 client.16827 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:34:39.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.408+0000 7fc3dbe00700 1 -- 172.21.15.70:0/1294346710 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562ad7e121a0 con 0x562ad7e5f390 2024-05-08T07:34:39.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.408+0000 7fc3dbe00700 10 client.16827 handle_command_reply: tid=0 2024-05-08T07:34:39.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 client.16827 shutdown 2024-05-08T07:34:39.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 -- 172.21.15.70:0/1294346710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 msgr2=0x562ad7e4efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:39.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e4efa0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4010840 tx=0x7fc3f4010c00 comp rx=0 tx=0).stop 2024-05-08T07:34:39.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 -- 172.21.15.70:0/1294346710 shutdown_connections 2024-05-08T07:34:39.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562ad7e5f390 0x562ad7e61780 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e4efa0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e45ab0 0x562ad7e516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 --2- 172.21.15.70:0/1294346710 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4af60 0x562ad7e4ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 -- 172.21.15.70:0/1294346710 >> 172.21.15.70:0/1294346710 conn(0x562ad7d73c60 msgr2=0x562ad7e44480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:39.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc3dbe00700 0 client.16827 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:34:39.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 -- 172.21.15.70:0/1294346710 shutdown_connections 2024-05-08T07:34:39.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.409+0000 7fc40b417b80 1 -- 172.21.15.70:0/1294346710 wait complete. 2024-05-08T07:34:39.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.410+0000 7fc40b417b80 20 client.16827 trim_cache size 0 max 16384 2024-05-08T07:34:39.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.432+0000 7fc40b417b80 1 Processor -- start 2024-05-08T07:34:39.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.432+0000 7fc40b417b80 1 -- start start 2024-05-08T07:34:39.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.432+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e45ab0 0x562ad7e5b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.432+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 0x562ad7e4d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.432+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 0x562ad7e4d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.432+0000 7fc40b417b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1b3f40 con 0x562ad7e45ab0 2024-05-08T07:34:39.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.432+0000 7fc40b417b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1b17d0 con 0x562ad7e4b880 2024-05-08T07:34:39.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.432+0000 7fc40b417b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1af640 con 0x562ad7e4af60 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3f9400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 0x562ad7e4d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3f9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e45ab0 0x562ad7e5b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3f9400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 0x562ad7e4d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:46552/0 (socket says 172.21.15.70:46552) 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3f9400700 1 -- 172.21.15.70:0/3462941446 learned_addr learned my addr 172.21.15.70:0/3462941446 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3fa800700 1 --2- 172.21.15.70:0/3462941446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 0x562ad7e4d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3f9e00700 1 -- 172.21.15.70:0/3462941446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 msgr2=0x562ad7e4d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/3462941446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 0x562ad7e4d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3f9e00700 1 -- 172.21.15.70:0/3462941446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 msgr2=0x562ad7e4d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/3462941446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 0x562ad7e4d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3f9e00700 1 -- 172.21.15.70:0/3462941446 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad7e383c0 con 0x562ad7e45ab0 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.433+0000 7fc3fa800700 1 --2- 172.21.15.70:0/3462941446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 0x562ad7e4d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.434+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/3462941446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e45ab0 0x562ad7e5b430 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0a5700 tx=0x7fc3ec0a8f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed4567931a2a3e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.434+0000 7fc3e6a00700 1 -- 172.21.15.70:0/3462941446 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0a53f0 con 0x562ad7e45ab0 2024-05-08T07:34:39.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.434+0000 7fc3e6a00700 1 -- 172.21.15.70:0/3462941446 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3ec0ad120 con 0x562ad7e45ab0 2024-05-08T07:34:39.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.434+0000 7fc3e6a00700 1 -- 172.21.15.70:0/3462941446 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0b1b30 con 0x562ad7e45ab0 2024-05-08T07:34:39.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 -- 172.21.15.70:0/3462941446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e45ab0 msgr2=0x562ad7e5b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:39.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 --2- 172.21.15.70:0/3462941446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e45ab0 0x562ad7e5b430 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0a5700 tx=0x7fc3ec0a8f30 comp rx=0 tx=0).stop 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 -- 172.21.15.70:0/3462941446 shutdown_connections 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 --2- 172.21.15.70:0/3462941446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e4b880 0x562ad7e4d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 --2- 172.21.15.70:0/3462941446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e45ab0 0x562ad7e5b430 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 --2- 172.21.15.70:0/3462941446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 0x562ad7e4d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 -- 172.21.15.70:0/3462941446 >> 172.21.15.70:0/3462941446 conn(0x562ad7d73c60 msgr2=0x562ad7e44480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 -- 172.21.15.70:0/3462941446 shutdown_connections 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 -- 172.21.15.70:0/3462941446 wait complete. 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.435+0000 7fc40b417b80 1 -- start start 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc40b417b80 1 Processor -- start 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e45ab0 0x562ad7ec2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 0x562ad7ec3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc40b417b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e53b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc40b417b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1afc90 con 0x562ad7e4b880 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc40b417b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1b1100 con 0x562ad7e45ab0 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc40b417b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc1b0360 con 0x562ad7e4af60 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc40b417b80 10 client.0 _ll_register_callbacks cb 0x562ad7d3ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc3fa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e53b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.436+0000 7fc3fa800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e53b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38080/0 (socket says 172.21.15.70:38080) 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3fa800700 1 -- 172.21.15.70:0/2201048271 learned_addr learned my addr 172.21.15.70:0/2201048271 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3f9400700 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 0x562ad7ec3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e45ab0 0x562ad7ec2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3fa800700 1 -- 172.21.15.70:0/2201048271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 msgr2=0x562ad7ec3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3fa800700 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 0x562ad7ec3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3fa800700 1 -- 172.21.15.70:0/2201048271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e45ab0 msgr2=0x562ad7ec2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3fa800700 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e45ab0 0x562ad7ec2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:39.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3fa800700 1 -- 172.21.15.70:0/2201048271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad7e54390 con 0x562ad7e4b880 2024-05-08T07:34:39.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e45ab0 0x562ad7ec2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:34:39.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3fa800700 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e53b50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4010840 tx=0x7fc3f400e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172b438ad6120099 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:34:39.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.437+0000 7fc3dbe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:34:39.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.438+0000 7fc3dbe00700 1 -- 172.21.15.70:0/2201048271 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f40115c0 con 0x562ad7e4b880 2024-05-08T07:34:39.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.438+0000 7fc40b417b80 1 -- 172.21.15.70:0/2201048271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3ec0ad120 con 0x562ad7e4b880 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.438+0000 7fc3dbe00700 1 -- 172.21.15.70:0/2201048271 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(175..175 src has 1..175) ==== 9583+0+0 (secure 0 0 0) 0x7fc3f4011c90 con 0x562ad7e4b880 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.438+0000 7fc3dbe00700 1 -- 172.21.15.70:0/2201048271 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc3f400e890 con 0x562ad7e4b880 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.438+0000 7fc40b417b80 10 client.16833 fetch_fsmap learned FSMap version 42 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.438+0000 7fc40b417b80 1 -- 172.21.15.70:0/2201048271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562ad7eca750 con 0x562ad7e4b880 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.438+0000 7fc3dbe00700 1 -- 172.21.15.70:0/2201048271 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3ec0ad120 con 0x562ad7e4b880 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.439+0000 7fc3dbe00700 1 -- 172.21.15.70:0/2201048271 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fc3f4003680 con 0x562ad7e4b880 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.439+0000 7fc40b417b80 10 client.16833 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.439+0000 7fc40b417b80 10 client.16833 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.439+0000 7fc40b417b80 20 client.16833 populate_metadata read hostname 'smithi070' 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.439+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562ad7ecada0 0x562ad7ecd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.439+0000 7fc40b417b80 4 client.16833 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "46324a0d", "release": true, "await": true}] 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.439+0000 7fc40b417b80 1 -- 172.21.15.70:0/2201048271 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "46324a0d", "release": true, "await": true}) -- 0x562ad7da5500 con 0x562ad7ecada0 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.440+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562ad7ecada0 0x562ad7ecd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.440+0000 7fc3f9e00700 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562ad7ecada0 0x562ad7ecd1c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121f12c923989d57 server_cookie=683b3bb7f0b01e59 in_seq=0 out_seq=0 2024-05-08T07:34:39.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:39.440+0000 7fc3dbe00700 10 client.16833 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:34:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:39 smithi070 ceph-mon[29591]: pgmap v1527: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-05-08T07:34:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:39 smithi172 ceph-mon[33377]: pgmap v1527: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-05-08T07:34:39.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:39 smithi194 ceph-mon[33679]: pgmap v1527: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 8 op/s 2024-05-08T07:34:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:41 smithi172 ceph-mon[33377]: pgmap v1528: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T07:34:41.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:41 smithi194 ceph-mon[33679]: pgmap v1528: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T07:34:41.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:41 smithi070 ceph-mon[29591]: pgmap v1528: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T07:34:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:43 smithi172 ceph-mon[33377]: pgmap v1529: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T07:34:43.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:43 smithi194 ceph-mon[33679]: pgmap v1529: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T07:34:43.833 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:43 smithi070 ceph-mon[29591]: pgmap v1529: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.834+0000 7fc3dbe00700 1 -- 172.21.15.70:0/2201048271 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562ad7da5500 con 0x562ad7ecada0 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.834+0000 7fc3dbe00700 10 client.16833 handle_command_reply: tid=0 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.834+0000 7fc40b417b80 1 client.16833 shutdown 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.834+0000 7fc40b417b80 1 -- 172.21.15.70:0/2201048271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 msgr2=0x562ad7e53b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.834+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e53b50 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4010840 tx=0x7fc3f400e450 comp rx=0 tx=0).stop 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.835+0000 7fc40b417b80 1 -- 172.21.15.70:0/2201048271 shutdown_connections 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.835+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562ad7ecada0 0x562ad7ecd1c0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.835+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562ad7e4b880 0x562ad7e53b50 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.835+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562ad7e45ab0 0x562ad7ec2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:43.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.835+0000 7fc40b417b80 1 --2- 172.21.15.70:0/2201048271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562ad7e4af60 0x562ad7ec3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:43.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.835+0000 7fc40b417b80 1 -- 172.21.15.70:0/2201048271 >> 172.21.15.70:0/2201048271 conn(0x562ad7d73c60 msgr2=0x562ad7e4ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:43.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.835+0000 7fc3dbe00700 0 client.16833 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:34:43.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.836+0000 7fc40b417b80 1 -- 172.21.15.70:0/2201048271 shutdown_connections 2024-05-08T07:34:43.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.836+0000 7fc40b417b80 1 -- 172.21.15.70:0/2201048271 wait complete. 2024-05-08T07:34:43.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.836+0000 7fc40b417b80 20 client.16833 trim_cache size 0 max 16384 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 120, 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "46324a0d": { 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 120, 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:34:43.836 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.4, 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:34:43.837 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:34:43.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.837+0000 7fc3fb200700 1 -- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3e00b29f0 msgr2=0x7fc3e00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:43.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.837+0000 7fc3fb200700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3e00b29f0 0x7fc3e00b4eb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8006010 tx=0x7fc3e801a040 comp rx=0 tx=0).stop 2024-05-08T07:34:43.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.837+0000 7fc3fb200700 1 -- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 msgr2=0x7fc3fc0757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:34:43.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.837+0000 7fc3fb200700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 0x7fc3fc0757a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0060b0 tx=0x7fc3ec007f90 comp rx=0 tx=0).stop 2024-05-08T07:34:43.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.838+0000 7fc3fb200700 1 -- 172.21.15.70:0/1450552676 shutdown_connections 2024-05-08T07:34:43.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.838+0000 7fc3fb200700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc3e00b29f0 0x7fc3e00b4eb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:43.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.838+0000 7fc3fb200700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3fc109460 0x7fc3fc076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:43.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.838+0000 7fc3fb200700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3fc1033d0 0x7fc3fc0757a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:43.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.838+0000 7fc3fb200700 1 --2- 172.21.15.70:0/1450552676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc3fc103d90 0x7fc3fc075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:34:43.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.838+0000 7fc3fb200700 1 -- 172.21.15.70:0/1450552676 >> 172.21.15.70:0/1450552676 conn(0x7fc3fc0fef20 msgr2=0x7fc3fc0ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:34:43.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.838+0000 7fc3fb200700 1 -- 172.21.15.70:0/1450552676 shutdown_connections 2024-05-08T07:34:43.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:34:43.838+0000 7fc3fb200700 1 -- 172.21.15.70:0/1450552676 wait complete. 2024-05-08T07:34:43.958 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/realmode/rm/stack.o 2024-05-08T07:34:44.446 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/quota/dquot.o 2024-05-08T07:34:44.624 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/realmode/rm/reboot.o 2024-05-08T07:34:44.700 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '46324a0d', seconds elapsed: 62.7 2024-05-08T07:34:45.368 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/realmode/rm/wakeup_asm.o 2024-05-08T07:34:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:45 smithi172 ceph-mon[33377]: pgmap v1530: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T07:34:45.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:45 smithi194 ceph-mon[33679]: pgmap v1530: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T07:34:45.823 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/locking/built-in.a 2024-05-08T07:34:45.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:45 smithi070 ceph-mon[29591]: pgmap v1530: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T07:34:46.157 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/realmode/rm/wakemain.o 2024-05-08T07:34:46.284 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/iomap/direct-io.o 2024-05-08T07:34:46.309 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/ds.o 2024-05-08T07:34:46.321 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/amd/ibs.o 2024-05-08T07:34:46.532 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/entry/built-in.a 2024-05-08T07:34:46.600 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/qos.o 2024-05-08T07:34:46.601 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/shmem.o 2024-05-08T07:34:47.460 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/realmode/rm/video-mode.o 2024-05-08T07:34:47.489 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/main.o 2024-05-08T07:34:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:47 smithi194 ceph-mon[33679]: pgmap v1531: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 88 KiB/s wr, 13 op/s 2024-05-08T07:34:47.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:47 smithi070 ceph-mon[29591]: pgmap v1531: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 88 KiB/s wr, 13 op/s 2024-05-08T07:34:47.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:47 smithi172 ceph-mon[33377]: pgmap v1531: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 88 KiB/s wr, 13 op/s 2024-05-08T07:34:48.670 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/realmode/rm/copy.o 2024-05-08T07:34:49.167 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/realmode/rm/bioscall.o 2024-05-08T07:34:49.383 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/realmode/rm/regs.o 2024-05-08T07:34:49.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:49 smithi194 ceph-mon[33679]: pgmap v1532: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 88 KiB/s wr, 12 op/s 2024-05-08T07:34:49.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:49 smithi070 ceph-mon[29591]: pgmap v1532: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 88 KiB/s wr, 12 op/s 2024-05-08T07:34:49.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:49 smithi172 ceph-mon[33377]: pgmap v1532: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 88 KiB/s wr, 12 op/s 2024-05-08T07:34:50.498 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/realmode/rm/video-vga.o 2024-05-08T07:34:51.681 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/realmode/rm/video-vesa.o 2024-05-08T07:34:51.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:51 smithi194 ceph-mon[33679]: pgmap v1533: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 109 KiB/s wr, 20 op/s 2024-05-08T07:34:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:51 smithi070 ceph-mon[29591]: pgmap v1533: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 109 KiB/s wr, 20 op/s 2024-05-08T07:34:51.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:51 smithi172 ceph-mon[33377]: pgmap v1533: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 109 KiB/s wr, 20 op/s 2024-05-08T07:34:52.823 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/realmode/rm/video-bios.o 2024-05-08T07:34:53.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:53 smithi194 ceph-mon[33679]: pgmap v1534: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 207 KiB/s wr, 25 op/s 2024-05-08T07:34:53.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:53 smithi070 ceph-mon[29591]: pgmap v1534: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 207 KiB/s wr, 25 op/s 2024-05-08T07:34:53.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:53 smithi172 ceph-mon[33377]: pgmap v1534: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 207 KiB/s wr, 25 op/s 2024-05-08T07:34:54.864 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/quota/quota_v2.o 2024-05-08T07:34:55.283 INFO:tasks.workunit.client.0.smithi070.stdout: PASYMS arch/x86/realmode/rm/pasyms.h 2024-05-08T07:34:55.364 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/iomap/fiemap.o 2024-05-08T07:34:55.621 INFO:tasks.workunit.client.0.smithi070.stdout: LDS arch/x86/realmode/rm/realmode.lds 2024-05-08T07:34:55.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:55 smithi194 ceph-mon[33679]: pgmap v1535: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 254 KiB/s wr, 42 op/s 2024-05-08T07:34:55.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:55 smithi070 ceph-mon[29591]: pgmap v1535: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 254 KiB/s wr, 42 op/s 2024-05-08T07:34:55.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:55 smithi172 ceph-mon[33377]: pgmap v1535: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 254 KiB/s wr, 42 op/s 2024-05-08T07:34:56.052 INFO:tasks.workunit.client.0.smithi070.stdout: LD arch/x86/realmode/rm/realmode.elf 2024-05-08T07:34:56.239 INFO:tasks.workunit.client.0.smithi070.stdout: RELOCS arch/x86/realmode/rm/realmode.relocs 2024-05-08T07:34:56.298 INFO:tasks.workunit.client.0.smithi070.stdout: OBJCOPY arch/x86/realmode/rm/realmode.bin 2024-05-08T07:34:56.381 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/realmode/rmpiggy.o 2024-05-08T07:34:56.482 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/knc.o 2024-05-08T07:34:56.934 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/realmode/built-in.a 2024-05-08T07:34:57.160 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/lbr.o 2024-05-08T07:34:57.380 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/p4.o 2024-05-08T07:34:57.420 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/amd/uncore.o 2024-05-08T07:34:57.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:57 smithi172 ceph-mon[33377]: pgmap v1536: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 396 KiB/s wr, 254 op/s 2024-05-08T07:34:57.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:57 smithi194 ceph-mon[33679]: pgmap v1536: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 396 KiB/s wr, 254 op/s 2024-05-08T07:34:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:57 smithi070 ceph-mon[29591]: pgmap v1536: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 396 KiB/s wr, 254 op/s 2024-05-08T07:34:59.204 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/util.o 2024-05-08T07:34:59.349 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/console.o 2024-05-08T07:34:59.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:34:59 smithi194 ceph-mon[33679]: pgmap v1537: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 320 KiB/s wr, 246 op/s 2024-05-08T07:34:59.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:34:59 smithi070 ceph-mon[29591]: pgmap v1537: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 320 KiB/s wr, 246 op/s 2024-05-08T07:34:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:34:59 smithi172 ceph-mon[33377]: pgmap v1537: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 320 KiB/s wr, 246 op/s 2024-05-08T07:35:01.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:01 smithi194 ceph-mon[33679]: pgmap v1538: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 490 KiB/s wr, 267 op/s 2024-05-08T07:35:01.868 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:01 smithi070 ceph-mon[29591]: pgmap v1538: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 490 KiB/s wr, 267 op/s 2024-05-08T07:35:01.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:01 smithi172 ceph-mon[33377]: pgmap v1538: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 490 KiB/s wr, 267 op/s 2024-05-08T07:35:02.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:35:02.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:35:02.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:35:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:03 smithi194 ceph-mon[33679]: pgmap v1539: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 482 KiB/s wr, 264 op/s 2024-05-08T07:35:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:03 smithi070 ceph-mon[29591]: pgmap v1539: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 482 KiB/s wr, 264 op/s 2024-05-08T07:35:03.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:03 smithi172 ceph-mon[33377]: pgmap v1539: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 482 KiB/s wr, 264 op/s 2024-05-08T07:35:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:03.945 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/quota/quota_tree.o 2024-05-08T07:35:04.015 INFO:tasks.quiescer.fs.[cephfs]:Total duration (35.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T07:35:04.015 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.55 2024-05-08T07:35:04.016 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:35:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:35:04.826 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/iomap/seek.o 2024-05-08T07:35:05.756 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:05 smithi070 ceph-mon[29591]: pgmap v1540: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 464 KiB/s wr, 262 op/s 2024-05-08T07:35:05.756 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:05 smithi070 ceph-mon[29591]: osdmap e176: 12 total, 12 up, 12 in 2024-05-08T07:35:05.757 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:35:05.757 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:35:05.757 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:05 smithi194 ceph-mon[33679]: pgmap v1540: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 464 KiB/s wr, 262 op/s 2024-05-08T07:35:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:05 smithi194 ceph-mon[33679]: osdmap e176: 12 total, 12 up, 12 in 2024-05-08T07:35:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:35:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:35:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:05.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:05 smithi172 ceph-mon[33377]: pgmap v1540: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 464 KiB/s wr, 262 op/s 2024-05-08T07:35:05.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:05 smithi172 ceph-mon[33377]: osdmap e176: 12 total, 12 up, 12 in 2024-05-08T07:35:05.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:35:05.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:35:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:35:07.411 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/gc.o 2024-05-08T07:35:07.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:07 smithi194 ceph-mon[33679]: pgmap v1542: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 386 KiB/s wr, 61 op/s 2024-05-08T07:35:07.773 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:07 smithi070 ceph-mon[29591]: pgmap v1542: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 386 KiB/s wr, 61 op/s 2024-05-08T07:35:07.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:07 smithi172 ceph-mon[33377]: pgmap v1542: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 386 KiB/s wr, 61 op/s 2024-05-08T07:35:08.340 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/key.o 2024-05-08T07:35:08.642 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/p6.o 2024-05-08T07:35:08.811 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/amd/iommu.o 2024-05-08T07:35:09.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:09 smithi070 ceph-mon[29591]: pgmap v1543: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 386 KiB/s wr, 61 op/s 2024-05-08T07:35:09.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:09 smithi172 ceph-mon[33377]: pgmap v1543: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 386 KiB/s wr, 61 op/s 2024-05-08T07:35:10.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:09 smithi194 ceph-mon[33679]: pgmap v1543: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 386 KiB/s wr, 61 op/s 2024-05-08T07:35:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:11 smithi070 ceph-mon[29591]: pgmap v1544: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 327 KiB/s wr, 118 op/s 2024-05-08T07:35:11.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:11 smithi172 ceph-mon[33377]: pgmap v1544: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 327 KiB/s wr, 118 op/s 2024-05-08T07:35:12.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:11 smithi194 ceph-mon[33679]: pgmap v1544: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 327 KiB/s wr, 118 op/s 2024-05-08T07:35:13.684 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/quota/quota.o 2024-05-08T07:35:13.807 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mmzone.o 2024-05-08T07:35:13.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:13 smithi070 ceph-mon[29591]: pgmap v1545: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 483 KiB/s wr, 198 op/s 2024-05-08T07:35:13.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:13 smithi070 ceph-mon[29591]: osdmap e177: 12 total, 12 up, 12 in 2024-05-08T07:35:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:13 smithi172 ceph-mon[33377]: pgmap v1545: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 483 KiB/s wr, 198 op/s 2024-05-08T07:35:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:13 smithi172 ceph-mon[33377]: osdmap e177: 12 total, 12 up, 12 in 2024-05-08T07:35:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:13 smithi194 ceph-mon[33679]: pgmap v1545: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 483 KiB/s wr, 198 op/s 2024-05-08T07:35:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:13 smithi194 ceph-mon[33679]: osdmap e177: 12 total, 12 up, 12 in 2024-05-08T07:35:14.042 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/process.o 2024-05-08T07:35:14.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.390+0000 7f66d1c00700 1 -- 172.21.15.70:0/262788354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc103550 msgr2=0x7f66cc1039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:14.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.390+0000 7f66d1c00700 1 --2- 172.21.15.70:0/262788354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc103550 0x7f66cc1039b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f66b80098f0 tx=0x7f66b8009c00 comp rx=0 tx=0).stop 2024-05-08T07:35:14.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.390+0000 7f66d1c00700 1 -- 172.21.15.70:0/262788354 shutdown_connections 2024-05-08T07:35:14.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.390+0000 7f66d1c00700 1 --2- 172.21.15.70:0/262788354 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc103ef0 0x7f66cc1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:14.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.390+0000 7f66d1c00700 1 --2- 172.21.15.70:0/262788354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc108460 0x7f66cc108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:14.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.390+0000 7f66d1c00700 1 --2- 172.21.15.70:0/262788354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc103550 0x7f66cc1039b0 secure :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f66b80098f0 tx=0x7f66b8009c00 comp rx=0 tx=0).stop 2024-05-08T07:35:14.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.390+0000 7f66d1c00700 1 -- 172.21.15.70:0/262788354 >> 172.21.15.70:0/262788354 conn(0x7f66cc07a600 msgr2=0x7f66cc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:35:14.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.391+0000 7f66d1c00700 1 -- 172.21.15.70:0/262788354 shutdown_connections 2024-05-08T07:35:14.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.391+0000 7f66d1c00700 1 -- 172.21.15.70:0/262788354 wait complete. 2024-05-08T07:35:14.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.392+0000 7f66d1c00700 1 Processor -- start 2024-05-08T07:35:14.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.393+0000 7f66d1c00700 1 -- start start 2024-05-08T07:35:14.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.393+0000 7f66d1c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103ef0 0x7f66cc19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:14.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.393+0000 7f66d1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc108460 0x7f66cc19dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:14.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.393+0000 7f66d1c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc197950 0x7f66cc197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:14.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.393+0000 7f66d1c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc111410 con 0x7f66cc108460 2024-05-08T07:35:14.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.393+0000 7f66d1c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc111290 con 0x7f66cc197950 2024-05-08T07:35:14.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.393+0000 7f66d1c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc111590 con 0x7f66cc103ef0 2024-05-08T07:35:14.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.394+0000 7f66ca000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc108460 0x7f66cc19dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:14.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.394+0000 7f66cb400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc197950 0x7f66cc197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:14.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.394+0000 7f66ca000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc108460 0x7f66cc19dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36996/0 (socket says 172.21.15.70:36996) 2024-05-08T07:35:14.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.394+0000 7f66ca000700 1 -- 172.21.15.70:0/2919805775 learned_addr learned my addr 172.21.15.70:0/2919805775 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:35:14.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.394+0000 7f66caa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103ef0 0x7f66cc19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:14.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.395+0000 7f66ca000700 1 -- 172.21.15.70:0/2919805775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103ef0 msgr2=0x7f66cc19d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:14.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.395+0000 7f66ca000700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103ef0 0x7f66cc19d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:14.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.395+0000 7f66ca000700 1 -- 172.21.15.70:0/2919805775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc197950 msgr2=0x7f66cc197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:14.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.395+0000 7f66ca000700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc197950 0x7f66cc197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:14.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.395+0000 7f66ca000700 1 -- 172.21.15.70:0/2919805775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc1984d0 con 0x7f66cc108460 2024-05-08T07:35:14.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.396+0000 7f66ca000700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc108460 0x7f66cc19dcd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009fd0 tx=0x7f66b800f990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:35:14.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.397+0000 7f66c3400700 1 -- 172.21.15.70:0/2919805775 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b800b560 con 0x7f66cc108460 2024-05-08T07:35:14.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.397+0000 7f66c3400700 1 -- 172.21.15.70:0/2919805775 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66b800bb90 con 0x7f66cc108460 2024-05-08T07:35:14.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.397+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66cc198760 con 0x7f66cc108460 2024-05-08T07:35:14.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.397+0000 7f66c3400700 1 -- 172.21.15.70:0/2919805775 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b80038e0 con 0x7f66cc108460 2024-05-08T07:35:14.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.397+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66cc1a4890 con 0x7f66cc108460 2024-05-08T07:35:14.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.399+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66cc06a190 con 0x7f66cc108460 2024-05-08T07:35:14.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.402+0000 7f66c3400700 1 -- 172.21.15.70:0/2919805775 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f66b8005140 con 0x7f66cc108460 2024-05-08T07:35:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.404+0000 7f66c3400700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66b00b2af0 0x7f66b00b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.405+0000 7f66c3400700 1 -- 172.21.15.70:0/2919805775 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 9583+0+0 (secure 0 0 0) 0x7f66b80e39a0 con 0x7f66cc108460 2024-05-08T07:35:14.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.405+0000 7f66caa00700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66b00b2af0 0x7f66b00b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:14.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.406+0000 7f66caa00700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66b00b2af0 0x7f66b00b4fb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f66cc198a90 tx=0x7f66bc011040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:35:14.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.413+0000 7f66c3400700 1 -- 172.21.15.70:0/2919805775 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f66b8013030 con 0x7f66cc108460 2024-05-08T07:35:14.494 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/iomap/swapfile.o 2024-05-08T07:35:14.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.882+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66cc02e510 con 0x7f66cc108460 2024-05-08T07:35:14.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.883+0000 7f66c3400700 1 -- 172.21.15.70:0/2919805775 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f66b80aaf90 con 0x7f66cc108460 2024-05-08T07:35:14.885 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:35:14.886 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:35:14.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.887+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66b00b2af0 msgr2=0x7f66b00b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:14.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.887+0000 7f66d1c00700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66b00b2af0 0x7f66b00b4fb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f66cc198a90 tx=0x7f66bc011040 comp rx=0 tx=0).stop 2024-05-08T07:35:14.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.887+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc108460 msgr2=0x7f66cc19dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:14.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.887+0000 7f66d1c00700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc108460 0x7f66cc19dcd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009fd0 tx=0x7f66b800f990 comp rx=0 tx=0).stop 2024-05-08T07:35:14.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.888+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 shutdown_connections 2024-05-08T07:35:14.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.888+0000 7f66d1c00700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66b00b2af0 0x7f66b00b4fb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:14.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.888+0000 7f66d1c00700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f66cc197950 0x7f66cc197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:14.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.888+0000 7f66d1c00700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66cc103ef0 0x7f66cc19d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:14.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.888+0000 7f66d1c00700 1 --2- 172.21.15.70:0/2919805775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66cc108460 0x7f66cc19dcd0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:14.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.888+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 >> 172.21.15.70:0/2919805775 conn(0x7f66cc07a600 msgr2=0x7f66cc101800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:35:14.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.888+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 shutdown_connections 2024-05-08T07:35:14.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:14.888+0000 7f66d1c00700 1 -- 172.21.15.70:0/2919805775 wait complete. 2024-05-08T07:35:14.888 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:35:15.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:15 smithi070 ceph-mon[29591]: pgmap v1547: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 405 KiB/s wr, 220 op/s 2024-05-08T07:35:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:15 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2919805775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:35:15.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:15 smithi172 ceph-mon[33377]: pgmap v1547: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 405 KiB/s wr, 220 op/s 2024-05-08T07:35:15.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:15 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2919805775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:35:16.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:15 smithi194 ceph-mon[33679]: pgmap v1547: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 405 KiB/s wr, 220 op/s 2024-05-08T07:35:16.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:15 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2919805775' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:35:16.665 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/vmstat.o 2024-05-08T07:35:17.273 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 77.55 --await-for 42.0' 2024-05-08T07:35:17.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 77.55 --await-for 42.0 2024-05-08T07:35:17.845 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:35:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:17 smithi070 ceph-mon[29591]: pgmap v1548: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 525 KiB/s wr, 353 op/s 2024-05-08T07:35:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:17 smithi172 ceph-mon[33377]: pgmap v1548: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 525 KiB/s wr, 353 op/s 2024-05-08T07:35:18.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:17 smithi194 ceph-mon[33679]: pgmap v1548: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 525 KiB/s wr, 353 op/s 2024-05-08T07:35:18.744 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/keyring.o 2024-05-08T07:35:19.219 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/pt.o 2024-05-08T07:35:19.716 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/events/amd/built-in.a 2024-05-08T07:35:19.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:19 smithi070 ceph-mon[29591]: pgmap v1549: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 525 KiB/s wr, 353 op/s 2024-05-08T07:35:19.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:19 smithi172 ceph-mon[33377]: pgmap v1549: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 525 KiB/s wr, 353 op/s 2024-05-08T07:35:20.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:19 smithi194 ceph-mon[33679]: pgmap v1549: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 525 KiB/s wr, 353 op/s 2024-05-08T07:35:20.209 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/uncore.o 2024-05-08T07:35:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.829+0000 7f83ee600700 1 -- 172.21.15.70:0/4026310194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83e8102600 msgr2=0x7f83e81029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.829+0000 7f83ee600700 1 --2- 172.21.15.70:0/4026310194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83e8102600 0x7f83e81029e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f83e00099c0 tx=0x7f83e0009cd0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.830+0000 7f83ee600700 1 -- 172.21.15.70:0/4026310194 shutdown_connections 2024-05-08T07:35:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.830+0000 7f83ee600700 1 --2- 172.21.15.70:0/4026310194 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e81076d0 0x7f83e810f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.830+0000 7f83ee600700 1 --2- 172.21.15.70:0/4026310194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83e8102600 0x7f83e81029e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.830+0000 7f83ee600700 1 --2- 172.21.15.70:0/4026310194 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83e8102fb0 0x7f83e8106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.830+0000 7f83ee600700 1 -- 172.21.15.70:0/4026310194 >> 172.21.15.70:0/4026310194 conn(0x7f83e8079340 msgr2=0x7f83e8079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:35:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.830+0000 7f83ee600700 1 -- 172.21.15.70:0/4026310194 shutdown_connections 2024-05-08T07:35:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.830+0000 7f83ee600700 1 -- 172.21.15.70:0/4026310194 wait complete. 2024-05-08T07:35:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.831+0000 7f83ee600700 1 Processor -- start 2024-05-08T07:35:20.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.832+0000 7f83ee600700 1 -- start start 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.832+0000 7f83ee600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83e8102600 0x7f83e819f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.832+0000 7f83ee600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83e8102fb0 0x7f83e819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.832+0000 7f83ee600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e81076d0 0x7f83e8199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.832+0000 7f83ee600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83e8112410 con 0x7f83e8102600 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.832+0000 7f83ee600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83e8112290 con 0x7f83e81076d0 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.832+0000 7f83ee600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83e8112590 con 0x7f83e8102fb0 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.833+0000 7f83e7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83e8102600 0x7f83e819f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.833+0000 7f83e7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83e8102600 0x7f83e819f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46264/0 (socket says 172.21.15.70:46264) 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.833+0000 7f83e7400700 1 -- 172.21.15.70:0/3057014709 learned_addr learned my addr 172.21.15.70:0/3057014709 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:35:20.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.833+0000 7f83e6a00700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83e8102fb0 0x7f83e819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.833+0000 7f83e7e00700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e81076d0 0x7f83e8199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.834+0000 7f83e7400700 1 -- 172.21.15.70:0/3057014709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83e8102fb0 msgr2=0x7f83e819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:20.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.834+0000 7f83e7400700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83e8102fb0 0x7f83e819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.834+0000 7f83e7400700 1 -- 172.21.15.70:0/3057014709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e81076d0 msgr2=0x7f83e8199850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:20.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.834+0000 7f83e7400700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e81076d0 0x7f83e8199850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.834+0000 7f83e7400700 1 -- 172.21.15.70:0/3057014709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e819a030 con 0x7f83e8102600 2024-05-08T07:35:20.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.835+0000 7f83e7400700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83e8102600 0x7f83e819f6d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f83e0006010 tx=0x7f83e00055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:35:20.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.835+0000 7f83dfe00700 1 -- 172.21.15.70:0/3057014709 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0026070 con 0x7f83e8102600 2024-05-08T07:35:20.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.835+0000 7f83dfe00700 1 -- 172.21.15.70:0/3057014709 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83e000f460 con 0x7f83e8102600 2024-05-08T07:35:20.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.835+0000 7f83dfe00700 1 -- 172.21.15.70:0/3057014709 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0009e60 con 0x7f83e8102600 2024-05-08T07:35:20.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.836+0000 7f83ee600700 1 -- 172.21.15.70:0/3057014709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e819a2c0 con 0x7f83e8102600 2024-05-08T07:35:20.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.836+0000 7f83ee600700 1 -- 172.21.15.70:0/3057014709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e81a6530 con 0x7f83e8102600 2024-05-08T07:35:20.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.842+0000 7f83dfe00700 1 -- 172.21.15.70:0/3057014709 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f83e000f610 con 0x7f83e8102600 2024-05-08T07:35:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.844+0000 7f83dfe00700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83cc0b2b20 0x7f83cc0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.845+0000 7f83dfe00700 1 -- 172.21.15.70:0/3057014709 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 9583+0+0 (secure 0 0 0) 0x7f83e00e3280 con 0x7f83e8102600 2024-05-08T07:35:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.845+0000 7f83e6a00700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83cc0b2b20 0x7f83cc0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.846+0000 7f83e6a00700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83cc0b2b20 0x7f83cc0b4fe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f83e806bf90 tx=0x7f83d4009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.862+0000 7f83f8ed0b80 1 Processor -- start 2024-05-08T07:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.862+0000 7f83f8ed0b80 1 -- start start 2024-05-08T07:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.862+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 0x557da8577a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.862+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da856a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.862+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.863+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557da84bcbb0 con 0x557da856a520 2024-05-08T07:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.863+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557da845a8f0 con 0x557da856aee0 2024-05-08T07:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.863+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557da84b8b70 con 0x557da85776b0 2024-05-08T07:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.863+0000 7f83e7e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.863+0000 7f83e7e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:57040/0 (socket says 172.21.15.70:57040) 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.863+0000 7f83e7e00700 1 -- 172.21.15.70:0/2761071818 learned_addr learned my addr 172.21.15.70:0/2761071818 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.863+0000 7f83e6a00700 1 --2- 172.21.15.70:0/2761071818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da856a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.864+0000 7f83e7e00700 1 -- 172.21.15.70:0/2761071818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 msgr2=0x557da8577a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.864+0000 7f83e7400700 1 --2- 172.21.15.70:0/2761071818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 0x557da8577a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.864+0000 7f83e7e00700 1 --2- 172.21.15.70:0/2761071818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 0x557da8577a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.864+0000 7f83e7e00700 1 -- 172.21.15.70:0/2761071818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 msgr2=0x557da856a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.864+0000 7f83e7e00700 1 --2- 172.21.15.70:0/2761071818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da856a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.864+0000 7f83e7e00700 1 -- 172.21.15.70:0/2761071818 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557da8409a60 con 0x557da856aee0 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.864+0000 7f83e7e00700 1 --2- 172.21.15.70:0/2761071818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857f570 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f83d8003f50 tx=0x7f83d8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e25af6c5faa919f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.864+0000 7f83dcc00700 1 -- 172.21.15.70:0/2761071818 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8009e60 con 0x557da856aee0 2024-05-08T07:35:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.865+0000 7f83dcc00700 1 -- 172.21.15.70:0/2761071818 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83d801a070 con 0x557da856aee0 2024-05-08T07:35:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.865+0000 7f83dcc00700 1 -- 172.21.15.70:0/2761071818 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d80156e0 con 0x557da856aee0 2024-05-08T07:35:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.865+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/2761071818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 msgr2=0x557da857f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.865+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/2761071818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857f570 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f83d8003f50 tx=0x7f83d8009c20 comp rx=0 tx=0).stop 2024-05-08T07:35:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.866+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/2761071818 shutdown_connections 2024-05-08T07:35:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.866+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/2761071818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857f570 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.866+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/2761071818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 0x557da8577a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.866+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/2761071818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da856a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.866+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/2761071818 >> 172.21.15.70:0/2761071818 conn(0x557da8498cf0 msgr2=0x557da8564e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:35:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.866+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/2761071818 shutdown_connections 2024-05-08T07:35:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.866+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/2761071818 wait complete. 2024-05-08T07:35:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.866+0000 7f83f8ed0b80 1 -- start start 2024-05-08T07:35:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.867+0000 7f83f8ed0b80 1 Processor -- start 2024-05-08T07:35:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.867+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856a520 0x557da857f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.867+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.867+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da85776b0 0x557da857c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.867+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557da857fb10 con 0x557da85776b0 2024-05-08T07:35:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.867+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557da8422cb0 con 0x557da856aee0 2024-05-08T07:35:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.867+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557da857fc90 con 0x557da856a520 2024-05-08T07:35:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.867+0000 7f83f8ed0b80 10 client.0 _ll_register_callbacks cb 0x557da8463e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:35:20.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.868+0000 7f83e7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da85776b0 0x557da857c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.868+0000 7f83e7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da85776b0 0x557da857c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46284/0 (socket says 172.21.15.70:46284) 2024-05-08T07:35:20.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.868+0000 7f83e7e00700 1 -- 172.21.15.70:0/139675852 learned_addr learned my addr 172.21.15.70:0/139675852 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:35:20.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.868+0000 7f83e7400700 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856a520 0x557da857f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.868+0000 7f83e7e00700 1 -- 172.21.15.70:0/139675852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856a520 msgr2=0x557da857f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:35:20.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.868+0000 7f83e7e00700 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856a520 0x557da857f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.868+0000 7f83e7e00700 1 -- 172.21.15.70:0/139675852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 msgr2=0x557da857c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:35:20.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.868+0000 7f83e6a00700 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.869+0000 7f83e7e00700 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.869+0000 7f83e7e00700 1 -- 172.21.15.70:0/139675852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557da84825b0 con 0x557da85776b0 2024-05-08T07:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.869+0000 7f83e7e00700 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da85776b0 0x557da857c9d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f83d8004a60 tx=0x7f83d80077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7499827844954d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.869+0000 7f83d1600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.869+0000 7f83d1600700 1 -- 172.21.15.70:0/139675852 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8015890 con 0x557da85776b0 2024-05-08T07:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.869+0000 7f83d1600700 1 -- 172.21.15.70:0/139675852 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9583+0+0 (secure 0 0 0) 0x7f83d8015a30 con 0x557da85776b0 2024-05-08T07:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.869+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/139675852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83d801a070 con 0x557da85776b0 2024-05-08T07:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.870+0000 7f83d1600700 1 -- 172.21.15.70:0/139675852 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f83d8031050 con 0x557da85776b0 2024-05-08T07:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.870+0000 7f83f8ed0b80 10 client.16848 fetch_fsmap learned FSMap version 42 2024-05-08T07:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.870+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/139675852 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557da858a290 con 0x557da85776b0 2024-05-08T07:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.870+0000 7f83d1600700 1 -- 172.21.15.70:0/139675852 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83d801a070 con 0x557da85776b0 2024-05-08T07:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.871+0000 7f83d1600700 1 -- 172.21.15.70:0/139675852 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f83d8026be0 con 0x557da85776b0 2024-05-08T07:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.871+0000 7f83f8ed0b80 10 client.16848 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.871+0000 7f83f8ed0b80 10 client.16848 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.871+0000 7f83f8ed0b80 20 client.16848 populate_metadata read hostname 'smithi070' 2024-05-08T07:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.871+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557da858c7c0 0x557da858ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.871+0000 7f83f8ed0b80 4 client.16848 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.871+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/139675852 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557da8537230 con 0x557da858c7c0 2024-05-08T07:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.872+0000 7f83e7400700 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557da858c7c0 0x557da858ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.873+0000 7f83d1600700 10 client.16848 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.873+0000 7f83e7400700 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557da858c7c0 0x557da858ebb0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbc58ca77e17c06d server_cookie=d76a6d4bbab4e96c in_seq=0 out_seq=0 2024-05-08T07:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.876+0000 7f83d1600700 1 -- 172.21.15.70:0/139675852 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557da8537230 con 0x557da858c7c0 2024-05-08T07:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.876+0000 7f83d1600700 10 client.16848 handle_command_reply: tid=0 2024-05-08T07:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.876+0000 7f83f8ed0b80 1 client.16848 shutdown 2024-05-08T07:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.876+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/139675852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da85776b0 msgr2=0x557da857c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.876+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da85776b0 0x557da857c9d0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f83d8004a60 tx=0x7f83d80077e0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.877+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/139675852 shutdown_connections 2024-05-08T07:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.877+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557da858c7c0 0x557da858ebb0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.877+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da85776b0 0x557da857c9d0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.877+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856a520 0x557da857f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.877+0000 7f83d1600700 0 client.16848 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.877+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/139675852 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da857c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.877+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/139675852 >> 172.21.15.70:0/139675852 conn(0x557da8498cf0 msgr2=0x557da855f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.877+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/139675852 shutdown_connections 2024-05-08T07:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.877+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/139675852 wait complete. 2024-05-08T07:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.878+0000 7f83f8ed0b80 20 client.16848 trim_cache size 0 max 16384 2024-05-08T07:35:20.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.908+0000 7f83f8ed0b80 1 Processor -- start 2024-05-08T07:35:20.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.908+0000 7f83f8ed0b80 1 -- start start 2024-05-08T07:35:20.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.908+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da857b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da8576840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 0x557da8594180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81afbb0 con 0x557da856a520 2024-05-08T07:35:20.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81ad440 con 0x557da856aee0 2024-05-08T07:35:20.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81ab2b0 con 0x557da85776b0 2024-05-08T07:35:20.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83e7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da857b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83e7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da857b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46300/0 (socket says 172.21.15.70:46300) 2024-05-08T07:35:20.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83e7400700 1 -- 172.21.15.70:0/3430116706 learned_addr learned my addr 172.21.15.70:0/3430116706 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:35:20.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83e6a00700 1 --2- 172.21.15.70:0/3430116706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da8576840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.909+0000 7f83e7e00700 1 --2- 172.21.15.70:0/3430116706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 0x557da8594180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.910+0000 7f83e7400700 1 -- 172.21.15.70:0/3430116706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 msgr2=0x557da8594180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:35:20.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.910+0000 7f83e7400700 1 --2- 172.21.15.70:0/3430116706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 0x557da8594180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.910+0000 7f83e7400700 1 -- 172.21.15.70:0/3430116706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 msgr2=0x557da8576840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:35:20.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.910+0000 7f83e7400700 1 --2- 172.21.15.70:0/3430116706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da8576840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.910+0000 7f83e7400700 1 -- 172.21.15.70:0/3430116706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557da857ed30 con 0x557da856a520 2024-05-08T07:35:20.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.910+0000 7f83e7400700 1 --2- 172.21.15.70:0/3430116706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da857b470 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f83e00a9e70 tx=0x7f83e00a6150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c9ec13222e4831 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:35:20.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.911+0000 7f83d3e00700 1 -- 172.21.15.70:0/3430116706 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00c4070 con 0x557da856a520 2024-05-08T07:35:20.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.911+0000 7f83d3e00700 1 -- 172.21.15.70:0/3430116706 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83e00aa870 con 0x557da856a520 2024-05-08T07:35:20.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.911+0000 7f83d3e00700 1 -- 172.21.15.70:0/3430116706 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00ae170 con 0x557da856a520 2024-05-08T07:35:20.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.912+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3430116706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 msgr2=0x557da857b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:20.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.912+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3430116706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da857b470 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f83e00a9e70 tx=0x7f83e00a6150 comp rx=0 tx=0).stop 2024-05-08T07:35:20.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.912+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3430116706 shutdown_connections 2024-05-08T07:35:20.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.912+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3430116706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da85776b0 0x557da8594180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.912+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3430116706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da857b470 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.912+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3430116706 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da856aee0 0x557da8576840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.912+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3430116706 >> 172.21.15.70:0/3430116706 conn(0x557da8498cf0 msgr2=0x557da8576130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:35:20.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.912+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3430116706 shutdown_connections 2024-05-08T07:35:20.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.913+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3430116706 wait complete. 2024-05-08T07:35:20.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.913+0000 7f83f8ed0b80 1 -- start start 2024-05-08T07:35:20.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.913+0000 7f83f8ed0b80 1 Processor -- start 2024-05-08T07:35:20.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da8585300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856aee0 0x557da8581ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83f8ed0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da85776b0 0x557da8582430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81ab900 con 0x557da856a520 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81acd70 con 0x557da85776b0 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83f8ed0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83e81abfd0 con 0x557da856aee0 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83f8ed0b80 10 client.0 _ll_register_callbacks cb 0x557da8463e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83e7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da8585300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83e7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da8585300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46316/0 (socket says 172.21.15.70:46316) 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.914+0000 7f83e7400700 1 -- 172.21.15.70:0/3680810409 learned_addr learned my addr 172.21.15.70:0/3680810409 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.915+0000 7f83e6a00700 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856aee0 0x557da8581ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.915+0000 7f83e7e00700 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da85776b0 0x557da8582430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.915+0000 7f83e7400700 1 -- 172.21.15.70:0/3680810409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856aee0 msgr2=0x557da8581ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.915+0000 7f83e7400700 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856aee0 0x557da8581ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.915+0000 7f83e7400700 1 -- 172.21.15.70:0/3680810409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da85776b0 msgr2=0x557da8582430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.915+0000 7f83e7400700 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da85776b0 0x557da8582430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.915+0000 7f83e7400700 1 -- 172.21.15.70:0/3680810409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557da8582ae0 con 0x557da856a520 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.915+0000 7f83e7400700 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da8585300 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f83e00a73e0 tx=0x7f83e0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358f3ae7468c37a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.915+0000 7f83d1600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.916+0000 7f83d1600700 1 -- 172.21.15.70:0/3680810409 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e00c4050 con 0x557da856a520 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.916+0000 7f83d1600700 1 -- 172.21.15.70:0/3680810409 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9583+0+0 (secure 0 0 0) 0x7f83e00a6760 con 0x557da856a520 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.916+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3680810409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83e00aa870 con 0x557da856a520 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.916+0000 7f83d1600700 1 -- 172.21.15.70:0/3680810409 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f83e00c4050 con 0x557da856a520 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.916+0000 7f83f8ed0b80 10 client.16854 fetch_fsmap learned FSMap version 42 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.916+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3680810409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557da85f7c00 con 0x557da856a520 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.917+0000 7f83d1600700 1 -- 172.21.15.70:0/3680810409 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83e00aa870 con 0x557da856a520 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.917+0000 7f83d1600700 1 -- 172.21.15.70:0/3680810409 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f83e00aa3d0 con 0x557da856a520 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.917+0000 7f83f8ed0b80 10 client.16854 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:35:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.917+0000 7f83f8ed0b80 10 client.16854 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:35:20.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.917+0000 7f83f8ed0b80 20 client.16854 populate_metadata read hostname 'smithi070' 2024-05-08T07:35:20.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.917+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557da85f8220 0x557da85fa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:35:20.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.917+0000 7f83f8ed0b80 4 client.16854 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 77.55, "await_for": 42.0}] 2024-05-08T07:35:20.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.917+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3680810409 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 77.55, "await_for": 42.0}) -- 0x557da84ca590 con 0x557da85f8220 2024-05-08T07:35:20.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.918+0000 7f83e6a00700 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557da85f8220 0x557da85fa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:35:20.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.919+0000 7f83e6a00700 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557da85f8220 0x557da85fa640 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13afafe617cbe054 server_cookie=9b759fc3a0c3e5aa in_seq=0 out_seq=0 2024-05-08T07:35:20.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:20.919+0000 7f83d1600700 10 client.16854 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:35:21.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:21 smithi070 ceph-mon[29591]: pgmap v1550: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 279 op/s 2024-05-08T07:35:21.916 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/quota/kqid.o 2024-05-08T07:35:21.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:21 smithi172 ceph-mon[33377]: pgmap v1550: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 279 op/s 2024-05-08T07:35:22.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:21 smithi194 ceph-mon[33679]: pgmap v1550: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 402 KiB/s wr, 279 op/s 2024-05-08T07:35:23.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:23 smithi070 ceph-mon[29591]: pgmap v1551: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 341 KiB/s wr, 198 op/s 2024-05-08T07:35:23.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:23 smithi172 ceph-mon[33377]: pgmap v1551: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 341 KiB/s wr, 198 op/s 2024-05-08T07:35:24.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:23 smithi194 ceph-mon[33679]: pgmap v1551: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 341 KiB/s wr, 198 op/s 2024-05-08T07:35:25.812 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:25 smithi194 ceph-mon[33679]: pgmap v1552: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 335 KiB/s wr, 189 op/s 2024-05-08T07:35:25.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:25 smithi070 ceph-mon[29591]: pgmap v1552: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 335 KiB/s wr, 189 op/s 2024-05-08T07:35:25.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:25 smithi172 ceph-mon[33377]: pgmap v1552: 129 pgs: 129 active+clean; 1.7 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 335 KiB/s wr, 189 op/s 2024-05-08T07:35:27.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:27 smithi070 ceph-mon[29591]: pgmap v1553: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 340 KiB/s wr, 217 op/s 2024-05-08T07:35:27.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:27 smithi172 ceph-mon[33377]: pgmap v1553: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 340 KiB/s wr, 217 op/s 2024-05-08T07:35:28.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:27 smithi194 ceph-mon[33679]: pgmap v1553: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 340 KiB/s wr, 217 op/s 2024-05-08T07:35:29.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:29 smithi070 ceph-mon[29591]: pgmap v1554: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 193 KiB/s wr, 82 op/s 2024-05-08T07:35:29.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:29 smithi172 ceph-mon[33377]: pgmap v1554: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 193 KiB/s wr, 82 op/s 2024-05-08T07:35:30.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:29 smithi194 ceph-mon[33679]: pgmap v1554: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 193 KiB/s wr, 82 op/s 2024-05-08T07:35:31.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:31 smithi070 ceph-mon[29591]: pgmap v1555: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 205 KiB/s wr, 85 op/s 2024-05-08T07:35:31.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:31 smithi172 ceph-mon[33377]: pgmap v1555: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 205 KiB/s wr, 85 op/s 2024-05-08T07:35:32.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:31 smithi194 ceph-mon[33679]: pgmap v1555: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 205 KiB/s wr, 85 op/s 2024-05-08T07:35:33.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:33 smithi070 ceph-mon[29591]: pgmap v1556: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 187 KiB/s wr, 81 op/s 2024-05-08T07:35:33.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:33 smithi172 ceph-mon[33377]: pgmap v1556: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 187 KiB/s wr, 81 op/s 2024-05-08T07:35:34.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:33 smithi194 ceph-mon[33679]: pgmap v1556: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 187 KiB/s wr, 81 op/s 2024-05-08T07:35:35.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:35 smithi070 ceph-mon[29591]: pgmap v1557: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 101 KiB/s wr, 77 op/s 2024-05-08T07:35:35.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:35 smithi172 ceph-mon[33377]: pgmap v1557: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 101 KiB/s wr, 77 op/s 2024-05-08T07:35:36.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:35 smithi194 ceph-mon[33679]: pgmap v1557: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 101 KiB/s wr, 77 op/s 2024-05-08T07:35:37.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:37 smithi070 ceph-mon[29591]: pgmap v1558: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 71 op/s 2024-05-08T07:35:37.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:37 smithi172 ceph-mon[33377]: pgmap v1558: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 71 op/s 2024-05-08T07:35:38.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:37 smithi194 ceph-mon[33679]: pgmap v1558: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 71 op/s 2024-05-08T07:35:39.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:39 smithi070 ceph-mon[29591]: pgmap v1559: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:35:39.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:39 smithi172 ceph-mon[33377]: pgmap v1559: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:35:40.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:39 smithi194 ceph-mon[33679]: pgmap v1559: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:35:41.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:41 smithi070 ceph-mon[29591]: pgmap v1560: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-08T07:35:41.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:41 smithi172 ceph-mon[33377]: pgmap v1560: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-08T07:35:42.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:41 smithi194 ceph-mon[33679]: pgmap v1560: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-08T07:35:42.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.587+0000 7f83d1600700 1 -- 172.21.15.70:0/3680810409 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x557da84ca590 con 0x557da85f8220 2024-05-08T07:35:42.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.587+0000 7f83d1600700 10 client.16854 handle_command_reply: tid=0 2024-05-08T07:35:42.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.587+0000 7f83f8ed0b80 1 client.16854 shutdown 2024-05-08T07:35:42.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.588+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3680810409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 msgr2=0x557da8585300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:42.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.588+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da8585300 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f83e00a73e0 tx=0x7f83e0005e80 comp rx=0 tx=0).stop 2024-05-08T07:35:42.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.588+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3680810409 shutdown_connections 2024-05-08T07:35:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.588+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557da85f8220 0x557da85fa640 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.588+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557da85776b0 0x557da8582430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.588+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557da856a520 0x557da8585300 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.588+0000 7f83f8ed0b80 1 --2- 172.21.15.70:0/3680810409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557da856aee0 0x557da8581ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.588+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3680810409 >> 172.21.15.70:0/3680810409 conn(0x557da8498cf0 msgr2=0x557da85769c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:35:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.589+0000 7f83d1600700 0 client.16854 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:35:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.589+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3680810409 shutdown_connections 2024-05-08T07:35:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.589+0000 7f83f8ed0b80 1 -- 172.21.15.70:0/3680810409 wait complete. 2024-05-08T07:35:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.589+0000 7f83f8ed0b80 20 client.16854 trim_cache size 0 max 16384 2024-05-08T07:35:42.589 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:35:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:35:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:35:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 122, 2024-05-08T07:35:42.589 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "bc54f0b6": { 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 122, 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 77.5, 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:35:42.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:35:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:35:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:35:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:35:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:35:42.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:35:42.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:35:42.592 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:35:42.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.591+0000 7f83ee600700 1 -- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83cc0b2b20 msgr2=0x7f83cc0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:42.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.591+0000 7f83ee600700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83cc0b2b20 0x7f83cc0b4fe0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f83e806bf90 tx=0x7f83d4009260 comp rx=0 tx=0).stop 2024-05-08T07:35:42.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.591+0000 7f83ee600700 1 -- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83e8102600 msgr2=0x7f83e819f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:35:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.591+0000 7f83ee600700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83e8102600 0x7f83e819f6d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f83e0006010 tx=0x7f83e00055f0 comp rx=0 tx=0).stop 2024-05-08T07:35:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.592+0000 7f83ee600700 1 -- 172.21.15.70:0/3057014709 shutdown_connections 2024-05-08T07:35:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.592+0000 7f83ee600700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83cc0b2b20 0x7f83cc0b4fe0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.592+0000 7f83ee600700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83e81076d0 0x7f83e8199850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.592+0000 7f83ee600700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f83e8102600 0x7f83e819f6d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.592+0000 7f83ee600700 1 --2- 172.21.15.70:0/3057014709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83e8102fb0 0x7f83e819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:35:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.592+0000 7f83ee600700 1 -- 172.21.15.70:0/3057014709 >> 172.21.15.70:0/3057014709 conn(0x7f83e8079340 msgr2=0x7f83e8101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:35:42.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.592+0000 7f83ee600700 1 -- 172.21.15.70:0/3057014709 shutdown_connections 2024-05-08T07:35:42.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:35:42.592+0000 7f83ee600700 1 -- 172.21.15.70:0/3057014709 wait complete. 2024-05-08T07:35:43.538 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bc54f0b6', quiesce took 39.5 seconds. Will release after: 17.55 2024-05-08T07:35:43.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:43 smithi070 ceph-mon[29591]: pgmap v1561: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T07:35:43.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:43 smithi172 ceph-mon[33377]: pgmap v1561: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T07:35:44.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:43 smithi194 ceph-mon[33679]: pgmap v1561: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T07:35:45.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:45 smithi070 ceph-mon[29591]: pgmap v1562: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T07:35:45.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:45 smithi172 ceph-mon[33377]: pgmap v1562: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T07:35:46.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:45 smithi194 ceph-mon[33679]: pgmap v1562: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T07:35:47.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:47 smithi070 ceph-mon[29591]: pgmap v1563: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 45 KiB/s wr, 8 op/s 2024-05-08T07:35:47.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:47 smithi172 ceph-mon[33377]: pgmap v1563: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 45 KiB/s wr, 8 op/s 2024-05-08T07:35:48.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:47 smithi194 ceph-mon[33679]: pgmap v1563: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 45 KiB/s wr, 8 op/s 2024-05-08T07:35:49.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:49 smithi172 ceph-mon[33377]: pgmap v1564: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 7 op/s 2024-05-08T07:35:50.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:49 smithi194 ceph-mon[33679]: pgmap v1564: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 7 op/s 2024-05-08T07:35:50.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:49 smithi070 ceph-mon[29591]: pgmap v1564: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 KiB/s wr, 7 op/s 2024-05-08T07:35:51.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:51 smithi172 ceph-mon[33377]: pgmap v1565: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 88 KiB/s wr, 9 op/s 2024-05-08T07:35:52.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:51 smithi194 ceph-mon[33679]: pgmap v1565: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 88 KiB/s wr, 9 op/s 2024-05-08T07:35:52.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:51 smithi070 ceph-mon[29591]: pgmap v1565: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 88 KiB/s wr, 9 op/s 2024-05-08T07:35:53.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:53 smithi172 ceph-mon[33377]: pgmap v1566: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 9 op/s 2024-05-08T07:35:54.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:53 smithi194 ceph-mon[33679]: pgmap v1566: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 9 op/s 2024-05-08T07:35:54.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:53 smithi070 ceph-mon[29591]: pgmap v1566: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 9 op/s 2024-05-08T07:35:55.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:55 smithi172 ceph-mon[33377]: pgmap v1567: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 116 KiB/s wr, 10 op/s 2024-05-08T07:35:56.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:55 smithi194 ceph-mon[33679]: pgmap v1567: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 116 KiB/s wr, 10 op/s 2024-05-08T07:35:56.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:55 smithi070 ceph-mon[29591]: pgmap v1567: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 116 KiB/s wr, 10 op/s 2024-05-08T07:35:57.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:57 smithi172 ceph-mon[33377]: pgmap v1568: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 88 KiB/s wr, 9 op/s 2024-05-08T07:35:58.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:57 smithi194 ceph-mon[33679]: pgmap v1568: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 88 KiB/s wr, 9 op/s 2024-05-08T07:35:58.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:57 smithi070 ceph-mon[29591]: pgmap v1568: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 88 KiB/s wr, 9 op/s 2024-05-08T07:35:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:35:59 smithi172 ceph-mon[33377]: pgmap v1569: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2024-05-08T07:36:00.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:35:59 smithi194 ceph-mon[33679]: pgmap v1569: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2024-05-08T07:36:00.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:35:59 smithi070 ceph-mon[29591]: pgmap v1569: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 7 op/s 2024-05-08T07:36:01.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:36:01.813 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:36:01.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:01 smithi172 ceph-mon[33377]: pgmap v1570: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 99 KiB/s wr, 8 op/s 2024-05-08T07:36:01.956 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:01 smithi070 ceph-mon[29591]: pgmap v1570: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 99 KiB/s wr, 8 op/s 2024-05-08T07:36:02.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:01 smithi194 ceph-mon[33679]: pgmap v1570: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 99 KiB/s wr, 8 op/s 2024-05-08T07:36:03.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:03 smithi070 ceph-mon[29591]: pgmap v1571: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:36:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:03 smithi172 ceph-mon[33377]: pgmap v1571: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:36:04.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:03 smithi194 ceph-mon[33679]: pgmap v1571: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:36:04.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.615+0000 7fa53e400700 1 -- 172.21.15.70:0/2811009007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538108370 msgr2=0x7fa538108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:04.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.615+0000 7fa53e400700 1 --2- 172.21.15.70:0/2811009007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538108370 0x7fa538108750 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa52c009990 tx=0x7fa52c009ca0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.616+0000 7fa53e400700 1 -- 172.21.15.70:0/2811009007 shutdown_connections 2024-05-08T07:36:04.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.616+0000 7fa53e400700 1 --2- 172.21.15.70:0/2811009007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa538102f00 0x7fa53810f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.616+0000 7fa53e400700 1 --2- 172.21.15.70:0/2811009007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538108370 0x7fa538108750 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.616+0000 7fa53e400700 1 --2- 172.21.15.70:0/2811009007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538102560 0x7fa5381029c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.616+0000 7fa53e400700 1 -- 172.21.15.70:0/2811009007 >> 172.21.15.70:0/2811009007 conn(0x7fa5380791e0 msgr2=0x7fa5380795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:04.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.616+0000 7fa53e400700 1 -- 172.21.15.70:0/2811009007 shutdown_connections 2024-05-08T07:36:04.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.616+0000 7fa53e400700 1 -- 172.21.15.70:0/2811009007 wait complete. 2024-05-08T07:36:04.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.617+0000 7fa53e400700 1 Processor -- start 2024-05-08T07:36:04.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.617+0000 7fa53e400700 1 -- start start 2024-05-08T07:36:04.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa53e400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa538102560 0x7fa538103fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:04.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa53e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538102f00 0x7fa538104520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:04.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa53e400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538108370 0x7fa538104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:04.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa53e400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa538112380 con 0x7fa538102f00 2024-05-08T07:36:04.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa53e400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa538112200 con 0x7fa538102560 2024-05-08T07:36:04.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa53e400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa538112500 con 0x7fa538108370 2024-05-08T07:36:04.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa537e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538102f00 0x7fa538104520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:04.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa537e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538102f00 0x7fa538104520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53846/0 (socket says 172.21.15.70:53846) 2024-05-08T07:36:04.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa537e00700 1 -- 172.21.15.70:0/3010371231 learned_addr learned my addr 172.21.15.70:0/3010371231 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:04.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa53d000700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa538102560 0x7fa538103fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:04.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.618+0000 7fa53da00700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538108370 0x7fa538104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:04.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.619+0000 7fa537e00700 1 -- 172.21.15.70:0/3010371231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538108370 msgr2=0x7fa538104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:04.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.619+0000 7fa537e00700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538108370 0x7fa538104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.619+0000 7fa537e00700 1 -- 172.21.15.70:0/3010371231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa538102560 msgr2=0x7fa538103fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:04.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.619+0000 7fa537e00700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa538102560 0x7fa538103fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.619+0000 7fa537e00700 1 -- 172.21.15.70:0/3010371231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5381a7f40 con 0x7fa538102f00 2024-05-08T07:36:04.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.619+0000 7fa53d000700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa538102560 0x7fa538103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:36:04.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.619+0000 7fa537e00700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538102f00 0x7fa538104520 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa52400d980 tx=0x7fa52400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.619+0000 7fa535600700 1 -- 172.21.15.70:0/3010371231 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524017070 con 0x7fa538102f00 2024-05-08T07:36:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.620+0000 7fa535600700 1 -- 172.21.15.70:0/3010371231 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa524004830 con 0x7fa538102f00 2024-05-08T07:36:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.620+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5381a8230 con 0x7fa538102f00 2024-05-08T07:36:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.620+0000 7fa535600700 1 -- 172.21.15.70:0/3010371231 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5240053a0 con 0x7fa538102f00 2024-05-08T07:36:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.620+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5381a8720 con 0x7fa538102f00 2024-05-08T07:36:04.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.621+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa53806a190 con 0x7fa538102f00 2024-05-08T07:36:04.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.623+0000 7fa535600700 1 -- 172.21.15.70:0/3010371231 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa5240049e0 con 0x7fa538102f00 2024-05-08T07:36:04.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.625+0000 7fa535600700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5200b29f0 0x7fa5200b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:04.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.625+0000 7fa535600700 1 -- 172.21.15.70:0/3010371231 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 9583+0+0 (secure 0 0 0) 0x7fa5240e2e30 con 0x7fa538102f00 2024-05-08T07:36:04.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.625+0000 7fa53d000700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5200b29f0 0x7fa5200b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:04.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.626+0000 7fa53d000700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5200b29f0 0x7fa5200b4eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00b5c0 tx=0x7fa52c01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:04.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.628+0000 7fa535600700 1 -- 172.21.15.70:0/3010371231 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa524020020 con 0x7fa538102f00 2024-05-08T07:36:04.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.920+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5381a8980 con 0x7fa538102f00 2024-05-08T07:36:04.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.921+0000 7fa535600700 1 -- 172.21.15.70:0/3010371231 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fa5240aa390 con 0x7fa538102f00 2024-05-08T07:36:04.920 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:36:04.920 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:36:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.924+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5200b29f0 msgr2=0x7fa5200b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.924+0000 7fa53e400700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5200b29f0 0x7fa5200b4eb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00b5c0 tx=0x7fa52c01a040 comp rx=0 tx=0).stop 2024-05-08T07:36:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.924+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538102f00 msgr2=0x7fa538104520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.924+0000 7fa53e400700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538102f00 0x7fa538104520 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa52400d980 tx=0x7fa52400dd40 comp rx=0 tx=0).stop 2024-05-08T07:36:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.924+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 shutdown_connections 2024-05-08T07:36:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.924+0000 7fa53e400700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5200b29f0 0x7fa5200b4eb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.924+0000 7fa53e400700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa538108370 0x7fa538104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.924+0000 7fa53e400700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa538102560 0x7fa538103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.924+0000 7fa53e400700 1 --2- 172.21.15.70:0/3010371231 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa538102f00 0x7fa538104520 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.925+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 >> 172.21.15.70:0/3010371231 conn(0x7fa5380791e0 msgr2=0x7fa53806bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.925+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 shutdown_connections 2024-05-08T07:36:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:04.925+0000 7fa53e400700 1 -- 172.21.15.70:0/3010371231 wait complete. 2024-05-08T07:36:04.924 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:36:05.759 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id bc54f0b6 --release --await' 2024-05-08T07:36:05.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id bc54f0b6 --release --await 2024-05-08T07:36:06.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:05 smithi194 ceph-mon[33679]: pgmap v1572: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:36:06.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:05 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3010371231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:36:06.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:36:06.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:05 smithi070 ceph-mon[29591]: pgmap v1572: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:36:06.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:05 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3010371231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:36:06.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:36:06.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:05 smithi172 ceph-mon[33377]: pgmap v1572: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:36:06.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:05 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3010371231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:36:06.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:36:06.199 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:36:07.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:07 smithi070 ceph-mon[29591]: pgmap v1573: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-05-08T07:36:07.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:36:07.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:36:07.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:36:08.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:07 smithi194 ceph-mon[33679]: pgmap v1573: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-05-08T07:36:08.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:36:08.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:36:08.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:36:08.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:07 smithi172 ceph-mon[33377]: pgmap v1573: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 23 op/s 2024-05-08T07:36:08.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:36:08.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:36:08.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:36:08.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.479+0000 7f7a63e00700 1 -- 172.21.15.70:0/1378806011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c103550 msgr2=0x7f7a5c1039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:08.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.479+0000 7f7a63e00700 1 --2- 172.21.15.70:0/1378806011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c103550 0x7f7a5c1039d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7a480099c0 tx=0x7f7a48009cd0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.479+0000 7f7a63e00700 1 -- 172.21.15.70:0/1378806011 shutdown_connections 2024-05-08T07:36:08.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.479+0000 7f7a63e00700 1 --2- 172.21.15.70:0/1378806011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5c103f10 0x7f7a5c1103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.479+0000 7f7a63e00700 1 --2- 172.21.15.70:0/1378806011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c1095d0 0x7f7a5c1099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.479+0000 7f7a63e00700 1 --2- 172.21.15.70:0/1378806011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c103550 0x7f7a5c1039d0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.479+0000 7f7a63e00700 1 -- 172.21.15.70:0/1378806011 >> 172.21.15.70:0/1378806011 conn(0x7f7a5c07a5f0 msgr2=0x7f7a5c07aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:08.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.479+0000 7f7a63e00700 1 -- 172.21.15.70:0/1378806011 shutdown_connections 2024-05-08T07:36:08.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.479+0000 7f7a63e00700 1 -- 172.21.15.70:0/1378806011 wait complete. 2024-05-08T07:36:08.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.480+0000 7f7a63e00700 1 Processor -- start 2024-05-08T07:36:08.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.480+0000 7f7a63e00700 1 -- start start 2024-05-08T07:36:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a63e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5c103550 0x7f7a5c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a63e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c103f10 0x7f7a5c075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a63e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c1095d0 0x7f7a5c076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a63e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c1135d0 con 0x7f7a5c1095d0 2024-05-08T07:36:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a63e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c113450 con 0x7f7a5c103f10 2024-05-08T07:36:08.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a63e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c113750 con 0x7f7a5c103550 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a61e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c1095d0 0x7f7a5c076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a61e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c1095d0 0x7f7a5c076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37590/0 (socket says 172.21.15.70:37590) 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a61e00700 1 -- 172.21.15.70:0/734930187 learned_addr learned my addr 172.21.15.70:0/734930187 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a61400700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5c103550 0x7f7a5c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.481+0000 7f7a60a00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c103f10 0x7f7a5c075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.482+0000 7f7a61e00700 1 -- 172.21.15.70:0/734930187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5c103550 msgr2=0x7f7a5c0757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.482+0000 7f7a61e00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5c103550 0x7f7a5c0757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.482+0000 7f7a61e00700 1 -- 172.21.15.70:0/734930187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c103f10 msgr2=0x7f7a5c075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.482+0000 7f7a61e00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c103f10 0x7f7a5c075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.482+0000 7f7a61e00700 1 -- 172.21.15.70:0/734930187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5c1a80d0 con 0x7f7a5c1095d0 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.482+0000 7f7a61e00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c1095d0 0x7f7a5c076220 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7a54007ee0 tx=0x7f7a5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.482+0000 7f7a5a000700 1 -- 172.21.15.70:0/734930187 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400dbd0 con 0x7f7a5c1095d0 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.482+0000 7f7a5a000700 1 -- 172.21.15.70:0/734930187 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a5400dd70 con 0x7f7a5c1095d0 2024-05-08T07:36:08.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.482+0000 7f7a63e00700 1 -- 172.21.15.70:0/734930187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5c1a83c0 con 0x7f7a5c1095d0 2024-05-08T07:36:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.483+0000 7f7a5a000700 1 -- 172.21.15.70:0/734930187 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a540058d0 con 0x7f7a5c1095d0 2024-05-08T07:36:08.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.483+0000 7f7a63e00700 1 -- 172.21.15.70:0/734930187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a5c1a88d0 con 0x7f7a5c1095d0 2024-05-08T07:36:08.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.486+0000 7f7a5a000700 1 -- 172.21.15.70:0/734930187 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7a5401a020 con 0x7f7a5c1095d0 2024-05-08T07:36:08.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.488+0000 7f7a5a000700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a440b29f0 0x7f7a440b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.488+0000 7f7a5a000700 1 -- 172.21.15.70:0/734930187 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(177..177 src has 1..177) ==== 9583+0+0 (secure 0 0 0) 0x7f7a540e22f0 con 0x7f7a5c1095d0 2024-05-08T07:36:08.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.488+0000 7f7a61400700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a440b29f0 0x7f7a440b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.489+0000 7f7a61400700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a440b29f0 0x7f7a440b4eb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7a50005950 tx=0x7f7a500058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:08.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.502+0000 7f7a6e88bb80 1 Processor -- start 2024-05-08T07:36:08.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.502+0000 7f7a6e88bb80 1 -- start start 2024-05-08T07:36:08.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x5624781fd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x5624781f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478203f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562478149b20 con 0x5624781f8140 2024-05-08T07:36:08.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5624780e7860 con 0x5624781f7780 2024-05-08T07:36:08.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562478145ae0 con 0x5624781fd1b0 2024-05-08T07:36:08.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a61e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478203f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a61e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478203f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37594/0 (socket says 172.21.15.70:37594) 2024-05-08T07:36:08.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a61e00700 1 -- 172.21.15.70:0/1240059365 learned_addr learned my addr 172.21.15.70:0/1240059365 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:08.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a61400700 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x5624781fd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.503+0000 7f7a60a00700 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x5624781f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a61e00700 1 -- 172.21.15.70:0/1240059365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 msgr2=0x5624781fd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a61e00700 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x5624781fd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a61e00700 1 -- 172.21.15.70:0/1240059365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 msgr2=0x5624781f7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a61e00700 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x5624781f7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a61e00700 1 -- 172.21.15.70:0/1240059365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624780969d0 con 0x5624781f8140 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a61400700 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x5624781fd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a61e00700 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478203f70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400dfd0 tx=0x7f7a54005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e7f20cf1ec089c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a4ea00700 1 -- 172.21.15.70:0/1240059365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a540a9150 con 0x5624781f8140 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a4ea00700 1 -- 172.21.15.70:0/1240059365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a540ad500 con 0x5624781f8140 2024-05-08T07:36:08.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.504+0000 7f7a4ea00700 1 -- 172.21.15.70:0/1240059365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a540a93b0 con 0x5624781f8140 2024-05-08T07:36:08.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.505+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1240059365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 msgr2=0x562478203f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:08.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.505+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478203f70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400dfd0 tx=0x7f7a54005ab0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.505+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1240059365 shutdown_connections 2024-05-08T07:36:08.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.505+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478203f70 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.505+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x5624781fd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.505+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1240059365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x5624781f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.505+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1240059365 >> 172.21.15.70:0/1240059365 conn(0x56247816f7d0 msgr2=0x5624781f2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:08.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.505+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1240059365 shutdown_connections 2024-05-08T07:36:08.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.506+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1240059365 wait complete. 2024-05-08T07:36:08.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.506+0000 7f7a6e88bb80 1 -- start start 2024-05-08T07:36:08.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.506+0000 7f7a6e88bb80 1 Processor -- start 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.507+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f7780 0x562478203bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.507+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f8140 0x562478200fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.507+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782014f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.507+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562478204510 con 0x5624781fd1b0 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.507+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5624780afc20 con 0x5624781f8140 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.507+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562478204690 con 0x5624781f7780 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.507+0000 7f7a6e88bb80 10 client.0 _ll_register_callbacks cb 0x5624780f0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782014f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37598/0 (socket says 172.21.15.70:37598) 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f7780 0x562478203bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61e00700 1 -- 172.21.15.70:0/1498328288 learned_addr learned my addr 172.21.15.70:0/1498328288 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a60a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f8140 0x562478200fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61e00700 1 -- 172.21.15.70:0/1498328288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f7780 msgr2=0x562478203bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61e00700 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f7780 0x562478203bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61e00700 1 -- 172.21.15.70:0/1498328288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f8140 msgr2=0x562478200fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61e00700 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f8140 0x562478200fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61e00700 1 -- 172.21.15.70:0/1498328288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56247810f520 con 0x5624781fd1b0 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a61e00700 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782014f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7a540dfb40 tx=0x7f7a54004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d99d3fea5f4dfdb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.508+0000 7f7a43400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.509+0000 7f7a43400700 1 -- 172.21.15.70:0/1498328288 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a540b1fb0 con 0x5624781fd1b0 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.509+0000 7f7a43400700 1 -- 172.21.15.70:0/1498328288 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9583+0+0 (secure 0 0 0) 0x7f7a540a5740 con 0x5624781fd1b0 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.509+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1498328288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a540ad500 con 0x5624781fd1b0 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.509+0000 7f7a43400700 1 -- 172.21.15.70:0/1498328288 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7a540a9150 con 0x5624781fd1b0 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.509+0000 7f7a6e88bb80 10 client.16872 fetch_fsmap learned FSMap version 42 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.509+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1498328288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56247820ed50 con 0x5624781fd1b0 2024-05-08T07:36:08.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.509+0000 7f7a43400700 1 -- 172.21.15.70:0/1498328288 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a540ad500 con 0x5624781fd1b0 2024-05-08T07:36:08.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.509+0000 7f7a43400700 1 -- 172.21.15.70:0/1498328288 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f7a540a4ac0 con 0x5624781fd1b0 2024-05-08T07:36:08.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.510+0000 7f7a6e88bb80 10 client.16872 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:36:08.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.510+0000 7f7a6e88bb80 10 client.16872 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:36:08.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.510+0000 7f7a6e88bb80 20 client.16872 populate_metadata read hostname 'smithi070' 2024-05-08T07:36:08.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.510+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562478211220 0x562478213610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.510+0000 7f7a6e88bb80 4 client.16872 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:36:08.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.510+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1498328288 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624781c4240 con 0x562478211220 2024-05-08T07:36:08.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.510+0000 7f7a61400700 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562478211220 0x562478213610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.511+0000 7f7a61400700 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562478211220 0x562478213610 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a15b6672e9dae74c server_cookie=8b224605c1bf6859 in_seq=0 out_seq=0 2024-05-08T07:36:08.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.511+0000 7f7a43400700 10 client.16872 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:36:08.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.513+0000 7f7a43400700 1 -- 172.21.15.70:0/1498328288 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5624781c4240 con 0x562478211220 2024-05-08T07:36:08.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.513+0000 7f7a43400700 10 client.16872 handle_command_reply: tid=0 2024-05-08T07:36:08.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 client.16872 shutdown 2024-05-08T07:36:08.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1498328288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 msgr2=0x5624782014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:08.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782014f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7a540dfb40 tx=0x7f7a54004d60 comp rx=0 tx=0).stop 2024-05-08T07:36:08.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1498328288 shutdown_connections 2024-05-08T07:36:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562478211220 0x562478213610 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782014f0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f7780 0x562478203bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1498328288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f8140 0x562478200fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1498328288 >> 172.21.15.70:0/1498328288 conn(0x56247816f7d0 msgr2=0x5624781ecb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a43400700 0 client.16872 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:36:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1498328288 shutdown_connections 2024-05-08T07:36:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1498328288 wait complete. 2024-05-08T07:36:08.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.514+0000 7f7a6e88bb80 20 client.16872 trim_cache size 0 max 16384 2024-05-08T07:36:08.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.536+0000 7f7a6e88bb80 1 Processor -- start 2024-05-08T07:36:08.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.536+0000 7f7a6e88bb80 1 -- start start 2024-05-08T07:36:08.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.536+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x5624781fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.536+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478216250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.536+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x562478216790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.536+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c1b4180 con 0x5624781f8140 2024-05-08T07:36:08.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.536+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c1b1a10 con 0x5624781f7780 2024-05-08T07:36:08.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.536+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c1af880 con 0x5624781fd1b0 2024-05-08T07:36:08.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a60a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478216250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a60a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478216250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37608/0 (socket says 172.21.15.70:37608) 2024-05-08T07:36:08.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a60a00700 1 -- 172.21.15.70:0/589571464 learned_addr learned my addr 172.21.15.70:0/589571464 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a61e00700 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x562478216790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a61400700 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x5624781fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a60a00700 1 -- 172.21.15.70:0/589571464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 msgr2=0x562478216790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a60a00700 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x562478216790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a60a00700 1 -- 172.21.15.70:0/589571464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 msgr2=0x5624781fc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a60a00700 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x5624781fc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a60a00700 1 -- 172.21.15.70:0/589571464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624782035a0 con 0x5624781f8140 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.537+0000 7f7a61e00700 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x562478216790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.538+0000 7f7a60a00700 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478216250 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7a480099c0 tx=0x7f7a4801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92272ddccbcdba58 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.538+0000 7f7a4e000700 1 -- 172.21.15.70:0/589571464 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48005470 con 0x5624781f8140 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.538+0000 7f7a4e000700 1 -- 172.21.15.70:0/589571464 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a48005610 con 0x5624781f8140 2024-05-08T07:36:08.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.538+0000 7f7a4e000700 1 -- 172.21.15.70:0/589571464 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a48003bf0 con 0x5624781f8140 2024-05-08T07:36:08.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.539+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/589571464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 msgr2=0x562478216250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:08.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.539+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478216250 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7a480099c0 tx=0x7f7a4801a040 comp rx=0 tx=0).stop 2024-05-08T07:36:08.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.539+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/589571464 shutdown_connections 2024-05-08T07:36:08.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.539+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781fd1b0 0x562478216790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.539+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x5624781fc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.539+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/589571464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781f8140 0x562478216250 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.539+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/589571464 >> 172.21.15.70:0/589571464 conn(0x56247816f7d0 msgr2=0x5624781fc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:08.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.539+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/589571464 shutdown_connections 2024-05-08T07:36:08.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.539+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/589571464 wait complete. 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.540+0000 7f7a6e88bb80 1 -- start start 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.540+0000 7f7a6e88bb80 1 Processor -- start 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.540+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x562478216700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.540+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f8140 0x562478214b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.540+0000 7f7a6e88bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782150e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.540+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c1afed0 con 0x5624781fd1b0 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.540+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c1b1340 con 0x5624781f7780 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.540+0000 7f7a6e88bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c1b05a0 con 0x5624781f8140 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.540+0000 7f7a6e88bb80 10 client.0 _ll_register_callbacks cb 0x5624780f0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a61e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782150e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a61e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782150e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37620/0 (socket says 172.21.15.70:37620) 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a61e00700 1 -- 172.21.15.70:0/1028828287 learned_addr learned my addr 172.21.15.70:0/1028828287 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a61400700 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x562478216700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a60a00700 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f8140 0x562478214b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a61e00700 1 -- 172.21.15.70:0/1028828287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f8140 msgr2=0x562478214b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:08.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a61e00700 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f8140 0x562478214b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a61e00700 1 -- 172.21.15.70:0/1028828287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 msgr2=0x562478216700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:08.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a61e00700 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x562478216700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:08.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.541+0000 7f7a61e00700 1 -- 172.21.15.70:0/1028828287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562478283f60 con 0x5624781fd1b0 2024-05-08T07:36:08.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.542+0000 7f7a61e00700 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782150e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7a540a8e50 tx=0x7f7a5400d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc4912c511c6e9c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:08.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.542+0000 7f7a43400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:36:08.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.542+0000 7f7a43400700 1 -- 172.21.15.70:0/1028828287 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a540a8c60 con 0x5624781fd1b0 2024-05-08T07:36:08.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.542+0000 7f7a43400700 1 -- 172.21.15.70:0/1028828287 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(177..177 src has 1..177) ==== 9583+0+0 (secure 0 0 0) 0x7f7a540a7f70 con 0x5624781fd1b0 2024-05-08T07:36:08.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.542+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1028828287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a48005610 con 0x5624781fd1b0 2024-05-08T07:36:08.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.542+0000 7f7a43400700 1 -- 172.21.15.70:0/1028828287 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7a540b1fb0 con 0x5624781fd1b0 2024-05-08T07:36:08.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.542+0000 7f7a6e88bb80 10 client.16878 fetch_fsmap learned FSMap version 42 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.542+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1028828287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5624782850a0 con 0x5624781fd1b0 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.542+0000 7f7a43400700 1 -- 172.21.15.70:0/1028828287 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a48005610 con 0x5624781fd1b0 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.543+0000 7f7a43400700 1 -- 172.21.15.70:0/1028828287 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f7a540b1b20 con 0x5624781fd1b0 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.543+0000 7f7a6e88bb80 10 client.16878 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.543+0000 7f7a6e88bb80 10 client.16878 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.543+0000 7f7a6e88bb80 20 client.16878 populate_metadata read hostname 'smithi070' 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.543+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562478285560 0x562478287950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.543+0000 7f7a6e88bb80 4 client.16878 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bc54f0b6", "release": true, "await": true}] 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.543+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1028828287 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bc54f0b6", "release": true, "await": true}) -- 0x562478157500 con 0x562478285560 2024-05-08T07:36:08.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.544+0000 7f7a61400700 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562478285560 0x562478287950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:08.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.544+0000 7f7a61400700 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562478285560 0x562478287950 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17f30fdc4d60c575 server_cookie=d0abc504377b65b0 in_seq=0 out_seq=0 2024-05-08T07:36:08.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:08.544+0000 7f7a43400700 10 client.16878 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:36:10.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:09 smithi194 ceph-mon[33679]: pgmap v1574: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-05-08T07:36:10.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:09 smithi070 ceph-mon[29591]: pgmap v1574: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-05-08T07:36:10.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:09 smithi172 ceph-mon[33377]: pgmap v1574: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 56 KiB/s wr, 22 op/s 2024-05-08T07:36:11.960 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:11 smithi070 ceph-mon[29591]: pgmap v1575: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 56 KiB/s wr, 24 op/s 2024-05-08T07:36:12.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:11 smithi194 ceph-mon[33679]: pgmap v1575: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 56 KiB/s wr, 24 op/s 2024-05-08T07:36:12.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:11 smithi172 ceph-mon[33377]: pgmap v1575: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 56 KiB/s wr, 24 op/s 2024-05-08T07:36:12.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a43400700 1 -- 172.21.15.70:0/1028828287 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562478157500 con 0x562478285560 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a43400700 10 client.16878 handle_command_reply: tid=0 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a6e88bb80 1 client.16878 shutdown 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1028828287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 msgr2=0x5624782150e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782150e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7a540a8e50 tx=0x7f7a5400d8e0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1028828287 shutdown_connections 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562478285560 0x562478287950 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5624781fd1b0 0x5624782150e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5624781f7780 0x562478216700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a6e88bb80 1 --2- 172.21.15.70:0/1028828287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5624781f8140 0x562478214b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.785+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1028828287 >> 172.21.15.70:0/1028828287 conn(0x56247816f7d0 msgr2=0x5624781fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.786+0000 7f7a43400700 0 client.16878 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.786+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1028828287 shutdown_connections 2024-05-08T07:36:12.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.786+0000 7f7a6e88bb80 1 -- 172.21.15.70:0/1028828287 wait complete. 2024-05-08T07:36:12.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.786+0000 7f7a6e88bb80 20 client.16878 trim_cache size 0 max 16384 2024-05-08T07:36:12.786 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:36:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:36:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:36:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 124, 2024-05-08T07:36:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:36:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "bc54f0b6": { 2024-05-08T07:36:12.786 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 124, 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 77.5, 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:36:12.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:12.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:12.788 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:36:12.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.787+0000 7f7a63e00700 1 -- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a440b29f0 msgr2=0x7f7a440b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:12.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.787+0000 7f7a63e00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a440b29f0 0x7f7a440b4eb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7a50005950 tx=0x7f7a500058e0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.787+0000 7f7a63e00700 1 -- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c1095d0 msgr2=0x7f7a5c076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:12.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.787+0000 7f7a63e00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c1095d0 0x7f7a5c076220 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7a54007ee0 tx=0x7f7a5400d3b0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.788+0000 7f7a63e00700 1 -- 172.21.15.70:0/734930187 shutdown_connections 2024-05-08T07:36:12.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.788+0000 7f7a63e00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7a440b29f0 0x7f7a440b4eb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.788+0000 7f7a63e00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7a5c1095d0 0x7f7a5c076220 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.788+0000 7f7a63e00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a5c103550 0x7f7a5c0757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.788+0000 7f7a63e00700 1 --2- 172.21.15.70:0/734930187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7a5c103f10 0x7f7a5c075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:12.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.788+0000 7f7a63e00700 1 -- 172.21.15.70:0/734930187 >> 172.21.15.70:0/734930187 conn(0x7f7a5c07a5f0 msgr2=0x7f7a5c102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:12.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.788+0000 7f7a63e00700 1 -- 172.21.15.70:0/734930187 shutdown_connections 2024-05-08T07:36:12.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:12.788+0000 7f7a63e00700 1 -- 172.21.15.70:0/734930187 wait complete. 2024-05-08T07:36:13.793 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bc54f0b6', seconds elapsed: 69.8 2024-05-08T07:36:13.793 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.55 2024-05-08T07:36:13.793 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:36:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:13 smithi070 ceph-mon[29591]: pgmap v1576: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-05-08T07:36:14.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:13 smithi194 ceph-mon[33679]: pgmap v1576: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-05-08T07:36:14.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:13 smithi172 ceph-mon[33377]: pgmap v1576: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 23 op/s 2024-05-08T07:36:14.400 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:36:14.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:14 smithi070 ceph-mon[29591]: osdmap e178: 12 total, 12 up, 12 in 2024-05-08T07:36:14.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:14 smithi070 ceph-mon[29591]: pgmap v1578: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 120 KiB/s wr, 27 op/s 2024-05-08T07:36:15.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:14 smithi194 ceph-mon[33679]: osdmap e178: 12 total, 12 up, 12 in 2024-05-08T07:36:15.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:14 smithi194 ceph-mon[33679]: pgmap v1578: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 120 KiB/s wr, 27 op/s 2024-05-08T07:36:15.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:14 smithi172 ceph-mon[33377]: osdmap e178: 12 total, 12 up, 12 in 2024-05-08T07:36:15.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:14 smithi172 ceph-mon[33377]: pgmap v1578: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 120 KiB/s wr, 27 op/s 2024-05-08T07:36:15.256 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/suspend.o 2024-05-08T07:36:15.985 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/iomap/built-in.a 2024-05-08T07:36:16.033 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/backing-dev.o 2024-05-08T07:36:16.138 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/uncore_nhmex.o 2024-05-08T07:36:16.223 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/quota/netlink.o 2024-05-08T07:36:16.365 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/keyctl.o 2024-05-08T07:36:16.527 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/printk/printk.o 2024-05-08T07:36:16.618 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/irqdesc.o 2024-05-08T07:36:17.288 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/asymmetric_type.o 2024-05-08T07:36:17.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:17 smithi070 ceph-mon[29591]: pgmap v1579: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 106 KiB/s wr, 16 op/s 2024-05-08T07:36:17.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:17 smithi194 ceph-mon[33679]: pgmap v1579: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 106 KiB/s wr, 16 op/s 2024-05-08T07:36:17.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:17 smithi172 ceph-mon[33377]: pgmap v1579: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 106 KiB/s wr, 16 op/s 2024-05-08T07:36:18.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.447+0000 7f8ee1000700 1 -- 172.21.15.70:0/3446183062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8edc10b680 msgr2=0x7f8edc10ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:18.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.447+0000 7f8ee1000700 1 --2- 172.21.15.70:0/3446183062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8edc10b680 0x7f8edc10ba60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0099c0 tx=0x7f8ecc009cd0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.447+0000 7f8ee1000700 1 -- 172.21.15.70:0/3446183062 shutdown_connections 2024-05-08T07:36:18.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.448+0000 7f8ee1000700 1 --2- 172.21.15.70:0/3446183062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8edc105f90 0x7f8edc112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.448+0000 7f8ee1000700 1 --2- 172.21.15.70:0/3446183062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8edc10b680 0x7f8edc10ba60 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.448+0000 7f8ee1000700 1 --2- 172.21.15.70:0/3446183062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8edc1055d0 0x7f8edc105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.448+0000 7f8ee1000700 1 -- 172.21.15.70:0/3446183062 >> 172.21.15.70:0/3446183062 conn(0x7f8edc101080 msgr2=0x7f8edc1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:18.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.448+0000 7f8ee1000700 1 -- 172.21.15.70:0/3446183062 shutdown_connections 2024-05-08T07:36:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.448+0000 7f8ee1000700 1 -- 172.21.15.70:0/3446183062 wait complete. 2024-05-08T07:36:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.450+0000 7f8ee1000700 1 Processor -- start 2024-05-08T07:36:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.450+0000 7f8ee1000700 1 -- start start 2024-05-08T07:36:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.450+0000 7f8ee1000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8edc1055d0 0x7f8edc1a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.450+0000 7f8ee1000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8edc105f90 0x7f8edc1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.450+0000 7f8ee1000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8edc10b680 0x7f8edc19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.450+0000 7f8ee1000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc1156a0 con 0x7f8edc1055d0 2024-05-08T07:36:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.450+0000 7f8ee1000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc115520 con 0x7f8edc10b680 2024-05-08T07:36:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.450+0000 7f8ee1000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8edc115820 con 0x7f8edc105f90 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.451+0000 7f8edaa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8edc105f90 0x7f8edc1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.451+0000 7f8edaa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8edc105f90 0x7f8edc1a1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:45118/0 (socket says 172.21.15.70:45118) 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.451+0000 7f8edaa00700 1 -- 172.21.15.70:0/1896560675 learned_addr learned my addr 172.21.15.70:0/1896560675 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.451+0000 7f8edbe00700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8edc10b680 0x7f8edc19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.452+0000 7f8edb400700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8edc1055d0 0x7f8edc1a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.452+0000 7f8edaa00700 1 -- 172.21.15.70:0/1896560675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8edc10b680 msgr2=0x7f8edc19b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.452+0000 7f8edaa00700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8edc10b680 0x7f8edc19b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.452+0000 7f8edaa00700 1 -- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8edc1055d0 msgr2=0x7f8edc1a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.452+0000 7f8edaa00700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8edc1055d0 0x7f8edc1a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.452+0000 7f8edaa00700 1 -- 172.21.15.70:0/1896560675 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8edc19c080 con 0x7f8edc105f90 2024-05-08T07:36:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.452+0000 7f8edb400700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8edc1055d0 0x7f8edc1a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:36:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.452+0000 7f8edaa00700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8edc105f90 0x7f8edc1a1ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800d980 tx=0x7f8ec800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.453+0000 7f8ed3e00700 1 -- 172.21.15.70:0/1896560675 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8016070 con 0x7f8edc105f90 2024-05-08T07:36:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.453+0000 7f8ed3e00700 1 -- 172.21.15.70:0/1896560675 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ec8004830 con 0x7f8edc105f90 2024-05-08T07:36:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.453+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8edc19c370 con 0x7f8edc105f90 2024-05-08T07:36:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.453+0000 7f8ed3e00700 1 -- 172.21.15.70:0/1896560675 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8005440 con 0x7f8edc105f90 2024-05-08T07:36:18.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.453+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8edc06cec0 con 0x7f8edc105f90 2024-05-08T07:36:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.455+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8edc06a190 con 0x7f8edc105f90 2024-05-08T07:36:18.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.460+0000 7f8ed3e00700 1 -- 172.21.15.70:0/1896560675 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8ec80055e0 con 0x7f8edc105f90 2024-05-08T07:36:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.462+0000 7f8ed3e00700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8ec00b29f0 0x7f8ec00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:18.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.462+0000 7f8ed3e00700 1 -- 172.21.15.70:0/1896560675 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 9671+0+0 (secure 0 0 0) 0x7f8ec80e2e00 con 0x7f8edc105f90 2024-05-08T07:36:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.463+0000 7f8edb400700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8ec00b29f0 0x7f8ec00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:18.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.464+0000 7f8edb400700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8ec00b29f0 0x7f8ec00b4eb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009fd0 tx=0x7f8ecc005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:18.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.474+0000 7f8ed3e00700 1 -- 172.21.15.70:0/1896560675 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8ec801f020 con 0x7f8edc105f90 2024-05-08T07:36:18.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.943+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8edc02e510 con 0x7f8edc105f90 2024-05-08T07:36:18.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.945+0000 7f8ed3e00700 1 -- 172.21.15.70:0/1896560675 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f8ec80aa360 con 0x7f8edc105f90 2024-05-08T07:36:18.943 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:36:18.943 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:36:18.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.949+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8ec00b29f0 msgr2=0x7f8ec00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:18.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.949+0000 7f8ee1000700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8ec00b29f0 0x7f8ec00b4eb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc009fd0 tx=0x7f8ecc005fb0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.949+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8edc105f90 msgr2=0x7f8edc1a1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:18.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.949+0000 7f8ee1000700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8edc105f90 0x7f8edc1a1ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800d980 tx=0x7f8ec800dc90 comp rx=0 tx=0).stop 2024-05-08T07:36:18.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.950+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 shutdown_connections 2024-05-08T07:36:18.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.950+0000 7f8ee1000700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8ec00b29f0 0x7f8ec00b4eb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.950+0000 7f8ee1000700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8edc10b680 0x7f8edc19b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.950+0000 7f8ee1000700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8edc1055d0 0x7f8edc1a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.950+0000 7f8ee1000700 1 --2- 172.21.15.70:0/1896560675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8edc105f90 0x7f8edc1a1ca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:18.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.950+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 >> 172.21.15.70:0/1896560675 conn(0x7f8edc101080 msgr2=0x7f8edc102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:18.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.951+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 shutdown_connections 2024-05-08T07:36:18.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:18.951+0000 7f8ee1000700 1 -- 172.21.15.70:0/1896560675 wait complete. 2024-05-08T07:36:18.950 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:36:19.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:19 smithi194 ceph-mon[33679]: pgmap v1580: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 106 KiB/s wr, 16 op/s 2024-05-08T07:36:19.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:19 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1896560675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:36:19.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:19 smithi070 ceph-mon[29591]: pgmap v1580: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 106 KiB/s wr, 16 op/s 2024-05-08T07:36:19.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:19 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1896560675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:36:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:19 smithi172 ceph-mon[33377]: pgmap v1580: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 106 KiB/s wr, 16 op/s 2024-05-08T07:36:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:19 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1896560675' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:36:20.397 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 77.55 --await-for 42.0' 2024-05-08T07:36:20.398 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 77.55 --await-for 42.0 2024-05-08T07:36:20.986 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:36:21.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:21 smithi070 ceph-mon[29591]: pgmap v1581: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 215 KiB/s wr, 21 op/s 2024-05-08T07:36:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:21 smithi194 ceph-mon[33679]: pgmap v1581: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 215 KiB/s wr, 21 op/s 2024-05-08T07:36:21.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:21 smithi172 ceph-mon[33377]: pgmap v1581: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 215 KiB/s wr, 21 op/s 2024-05-08T07:36:23.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:23 smithi194 ceph-mon[33679]: pgmap v1582: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 234 KiB/s wr, 25 op/s 2024-05-08T07:36:23.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:23 smithi070 ceph-mon[29591]: pgmap v1582: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 234 KiB/s wr, 25 op/s 2024-05-08T07:36:23.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:23 smithi172 ceph-mon[33377]: pgmap v1582: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 234 KiB/s wr, 25 op/s 2024-05-08T07:36:24.405 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:24 smithi070 ceph-mon[29591]: osdmap e179: 12 total, 12 up, 12 in 2024-05-08T07:36:24.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:24 smithi194 ceph-mon[33679]: osdmap e179: 12 total, 12 up, 12 in 2024-05-08T07:36:24.642 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/handle.o 2024-05-08T07:36:24.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:24 smithi172 ceph-mon[33377]: osdmap e179: 12 total, 12 up, 12 in 2024-05-08T07:36:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.186+0000 7fafa0200700 1 -- 172.21.15.70:0/1056022766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf98114200 msgr2=0x7faf981165f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.186+0000 7fafa0200700 1 --2- 172.21.15.70:0/1056022766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf98114200 0x7faf981165f0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7faf9000b0a0 tx=0x7faf9000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.186+0000 7fafa0200700 1 -- 172.21.15.70:0/1056022766 shutdown_connections 2024-05-08T07:36:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.186+0000 7fafa0200700 1 --2- 172.21.15.70:0/1056022766 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf98114200 0x7faf981165f0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.186+0000 7fafa0200700 1 --2- 172.21.15.70:0/1056022766 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf98104450 0x7faf98102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.186+0000 7fafa0200700 1 --2- 172.21.15.70:0/1056022766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf981034a0 0x7faf98103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.186+0000 7fafa0200700 1 -- 172.21.15.70:0/1056022766 >> 172.21.15.70:0/1056022766 conn(0x7faf98079340 msgr2=0x7faf98079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:25.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.186+0000 7fafa0200700 1 -- 172.21.15.70:0/1056022766 shutdown_connections 2024-05-08T07:36:25.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.186+0000 7fafa0200700 1 -- 172.21.15.70:0/1056022766 wait complete. 2024-05-08T07:36:25.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.188+0000 7fafa0200700 1 Processor -- start 2024-05-08T07:36:25.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.188+0000 7fafa0200700 1 -- start start 2024-05-08T07:36:25.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.188+0000 7fafa0200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf981034a0 0x7faf981a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.188+0000 7fafa0200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf98104450 0x7faf981a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.188+0000 7fafa0200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf98114200 0x7faf981a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.188+0000 7fafa0200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf98119b80 con 0x7faf98104450 2024-05-08T07:36:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.188+0000 7fafa0200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf98119a00 con 0x7faf98114200 2024-05-08T07:36:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.188+0000 7fafa0200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faf98119d00 con 0x7faf981034a0 2024-05-08T07:36:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.189+0000 7faf9e200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf98114200 0x7faf981a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.189+0000 7faf9e200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf98114200 0x7faf981a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:39304/0 (socket says 172.21.15.70:39304) 2024-05-08T07:36:25.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.189+0000 7faf9e200700 1 -- 172.21.15.70:0/3421188107 learned_addr learned my addr 172.21.15.70:0/3421188107 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:25.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.190+0000 7faf9e200700 1 -- 172.21.15.70:0/3421188107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf981034a0 msgr2=0x7faf981a0030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T07:36:25.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.190+0000 7faf9e200700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf981034a0 0x7faf981a0030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.190+0000 7faf9e200700 1 -- 172.21.15.70:0/3421188107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf98104450 msgr2=0x7faf981a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:25.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.190+0000 7faf9e200700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf98104450 0x7faf981a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.190+0000 7faf9e200700 1 -- 172.21.15.70:0/3421188107 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf981a5040 con 0x7faf98114200 2024-05-08T07:36:25.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.191+0000 7faf9e200700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf98114200 0x7faf981a4900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf9000b070 tx=0x7faf90004d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:25.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.191+0000 7faf96000700 1 -- 172.21.15.70:0/3421188107 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90021070 con 0x7faf98114200 2024-05-08T07:36:25.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.191+0000 7fafa0200700 1 -- 172.21.15.70:0/3421188107 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf981a52d0 con 0x7faf98114200 2024-05-08T07:36:25.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.191+0000 7fafa0200700 1 -- 172.21.15.70:0/3421188107 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf981acbb0 con 0x7faf98114200 2024-05-08T07:36:25.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.191+0000 7faf96000700 1 -- 172.21.15.70:0/3421188107 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf90007b80 con 0x7faf98114200 2024-05-08T07:36:25.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.191+0000 7faf96000700 1 -- 172.21.15.70:0/3421188107 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf90004480 con 0x7faf98114200 2024-05-08T07:36:25.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.198+0000 7faf96000700 1 -- 172.21.15.70:0/3421188107 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7faf90004620 con 0x7faf98114200 2024-05-08T07:36:25.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.200+0000 7faf96000700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf800b2b20 0x7faf800b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.200+0000 7faf96000700 1 -- 172.21.15.70:0/3421188107 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 9583+0+0 (secure 0 0 0) 0x7faf900e3060 con 0x7faf98114200 2024-05-08T07:36:25.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.201+0000 7faf9d800700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf800b2b20 0x7faf800b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.202+0000 7faf9d800700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf800b2b20 0x7faf800b4fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009a70 tx=0x7faf8c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:25.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.217+0000 7fafaabfdb80 1 Processor -- start 2024-05-08T07:36:25.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.217+0000 7fafaabfdb80 1 -- start start 2024-05-08T07:36:25.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.218+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41e0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.218+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41da810 0x5605b41dac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.218+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41e7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.218+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605b412cbb0 con 0x5605b41da810 2024-05-08T07:36:25.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.218+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5605b40ca8f0 con 0x5605b41e0240 2024-05-08T07:36:25.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.218+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5605b4128b70 con 0x5605b41db1d0 2024-05-08T07:36:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.218+0000 7faf9d800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41e0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.219+0000 7faf9d800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41e0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:39306/0 (socket says 172.21.15.70:39306) 2024-05-08T07:36:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.219+0000 7faf9d800700 1 -- 172.21.15.70:0/3511486623 learned_addr learned my addr 172.21.15.70:0/3511486623 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.219+0000 7faf9ce00700 1 --2- 172.21.15.70:0/3511486623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41da810 0x5605b41dac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.219+0000 7faf9e200700 1 --2- 172.21.15.70:0/3511486623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.220+0000 7faf9ce00700 1 -- 172.21.15.70:0/3511486623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 msgr2=0x5605b41e7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.220+0000 7faf9ce00700 1 --2- 172.21.15.70:0/3511486623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41e7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.220+0000 7faf9ce00700 1 -- 172.21.15.70:0/3511486623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 msgr2=0x5605b41e0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.220+0000 7faf9ce00700 1 --2- 172.21.15.70:0/3511486623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41e0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.220+0000 7faf9ce00700 1 -- 172.21.15.70:0/3511486623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605b4079a60 con 0x5605b41da810 2024-05-08T07:36:25.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.220+0000 7faf9ce00700 1 --2- 172.21.15.70:0/3511486623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41da810 0x5605b41dac90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7faf84009ba0 tx=0x7faf84009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b0ae2d96366d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.221+0000 7faf8aa00700 1 -- 172.21.15.70:0/3511486623 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84004230 con 0x5605b41da810 2024-05-08T07:36:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.221+0000 7faf8aa00700 1 -- 172.21.15.70:0/3511486623 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf8400ed30 con 0x5605b41da810 2024-05-08T07:36:25.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.221+0000 7faf8aa00700 1 -- 172.21.15.70:0/3511486623 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84005020 con 0x5605b41da810 2024-05-08T07:36:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.222+0000 7fafaabfdb80 1 -- 172.21.15.70:0/3511486623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41da810 msgr2=0x5605b41dac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:25.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.222+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/3511486623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41da810 0x5605b41dac90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7faf84009ba0 tx=0x7faf84009eb0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.222+0000 7fafaabfdb80 1 -- 172.21.15.70:0/3511486623 shutdown_connections 2024-05-08T07:36:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.222+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/3511486623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41e7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.222+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/3511486623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41e0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.222+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/3511486623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41da810 0x5605b41dac90 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.222+0000 7fafaabfdb80 1 -- 172.21.15.70:0/3511486623 >> 172.21.15.70:0/3511486623 conn(0x5605b4152860 msgr2=0x5605b41d5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.223+0000 7fafaabfdb80 1 -- 172.21.15.70:0/3511486623 shutdown_connections 2024-05-08T07:36:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.223+0000 7fafaabfdb80 1 -- 172.21.15.70:0/3511486623 wait complete. 2024-05-08T07:36:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.223+0000 7fafaabfdb80 1 -- start start 2024-05-08T07:36:25.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.224+0000 7fafaabfdb80 1 Processor -- start 2024-05-08T07:36:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.224+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.224+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41e40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.224+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41e4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.224+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605b41e7600 con 0x5605b41e4600 2024-05-08T07:36:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.224+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5605b4092cb0 con 0x5605b41e0240 2024-05-08T07:36:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.224+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5605b41e7780 con 0x5605b41db1d0 2024-05-08T07:36:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.224+0000 7fafaabfdb80 10 client.0 _ll_register_callbacks cb 0x5605b40d3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:36:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.225+0000 7faf9e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41e4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.225+0000 7faf9e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41e4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54322/0 (socket says 172.21.15.70:54322) 2024-05-08T07:36:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.225+0000 7faf9e200700 1 -- 172.21.15.70:0/2288743030 learned_addr learned my addr 172.21.15.70:0/2288743030 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:25.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.225+0000 7faf9d800700 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.225+0000 7faf9ce00700 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41e40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.226+0000 7faf9e200700 1 -- 172.21.15.70:0/2288743030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 msgr2=0x5605b41e6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.226+0000 7faf9e200700 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41e6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.226+0000 7faf9e200700 1 -- 172.21.15.70:0/2288743030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 msgr2=0x5605b41e40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.226+0000 7faf9e200700 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41e40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.226+0000 7faf9e200700 1 -- 172.21.15.70:0/2288743030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b40f25b0 con 0x5605b41e4600 2024-05-08T07:36:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.227+0000 7faf9e200700 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41e4a80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7faf90009850 tx=0x7faf900a9ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae20636a683efc16 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.227+0000 7faf7f400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:36:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.227+0000 7faf7f400700 1 -- 172.21.15.70:0/2288743030 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf900a9fb0 con 0x5605b41e4600 2024-05-08T07:36:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.227+0000 7faf7f400700 1 -- 172.21.15.70:0/2288743030 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 9583+0+0 (secure 0 0 0) 0x7faf900a65a0 con 0x5605b41e4600 2024-05-08T07:36:25.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.228+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2288743030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf8400ed30 con 0x5605b41e4600 2024-05-08T07:36:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.228+0000 7faf7f400700 1 -- 172.21.15.70:0/2288743030 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7faf900ae360 con 0x5605b41e4600 2024-05-08T07:36:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.228+0000 7fafaabfdb80 10 client.16890 fetch_fsmap learned FSMap version 42 2024-05-08T07:36:25.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.228+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2288743030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5605b41f2400 con 0x5605b41e4600 2024-05-08T07:36:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.229+0000 7faf7f400700 1 -- 172.21.15.70:0/2288743030 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf8400ed30 con 0x5605b41e4600 2024-05-08T07:36:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.229+0000 7faf7f400700 1 -- 172.21.15.70:0/2288743030 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7faf90011070 con 0x5605b41e4600 2024-05-08T07:36:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.229+0000 7fafaabfdb80 10 client.16890 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:36:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.229+0000 7fafaabfdb80 10 client.16890 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:36:25.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.229+0000 7fafaabfdb80 20 client.16890 populate_metadata read hostname 'smithi070' 2024-05-08T07:36:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.229+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605b41f49c0 0x5605b41f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.229+0000 7fafaabfdb80 4 client.16890 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:36:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.229+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2288743030 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605b41a72d0 con 0x5605b41f49c0 2024-05-08T07:36:25.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.230+0000 7faf9d800700 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605b41f49c0 0x5605b41f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.231+0000 7faf9d800700 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605b41f49c0 0x5605b41f6de0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45bbaf2db2e639c7 server_cookie=af8cb29fbe1850c in_seq=0 out_seq=0 2024-05-08T07:36:25.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.231+0000 7faf7f400700 10 client.16890 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:36:25.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.234+0000 7faf7f400700 1 -- 172.21.15.70:0/2288743030 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5605b41a72d0 con 0x5605b41f49c0 2024-05-08T07:36:25.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.234+0000 7faf7f400700 10 client.16890 handle_command_reply: tid=0 2024-05-08T07:36:25.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.234+0000 7fafaabfdb80 1 client.16890 shutdown 2024-05-08T07:36:25.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2288743030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 msgr2=0x5605b41e4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:25.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41e4a80 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7faf90009850 tx=0x7faf900a9ac0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2288743030 shutdown_connections 2024-05-08T07:36:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605b41f49c0 0x5605b41f6de0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41e4a80 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41e6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2288743030 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41e40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2288743030 >> 172.21.15.70:0/2288743030 conn(0x5605b4152860 msgr2=0x5605b41cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7faf7f400700 0 client.16890 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:36:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2288743030 shutdown_connections 2024-05-08T07:36:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.235+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2288743030 wait complete. 2024-05-08T07:36:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.236+0000 7fafaabfdb80 20 client.16890 trim_cache size 0 max 16384 2024-05-08T07:36:25.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.269+0000 7fafaabfdb80 1 Processor -- start 2024-05-08T07:36:25.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.269+0000 7fafaabfdb80 1 -- start start 2024-05-08T07:36:25.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.270+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41df980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.270+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41d9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.270+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41d9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.270+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf78011890 con 0x5605b41e4600 2024-05-08T07:36:25.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.270+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf7800f120 con 0x5605b41e0240 2024-05-08T07:36:25.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.270+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faf7800cf90 con 0x5605b41db1d0 2024-05-08T07:36:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.270+0000 7faf9e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41d9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.270+0000 7faf9e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41d9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54330/0 (socket says 172.21.15.70:54330) 2024-05-08T07:36:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.270+0000 7faf9e200700 1 -- 172.21.15.70:0/2728822012 learned_addr learned my addr 172.21.15.70:0/2728822012 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.271+0000 7faf9d800700 1 --2- 172.21.15.70:0/2728822012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41df980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.271+0000 7faf9e200700 1 -- 172.21.15.70:0/2728822012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 msgr2=0x5605b41df980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.271+0000 7faf9e200700 1 --2- 172.21.15.70:0/2728822012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41df980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.271+0000 7faf9e200700 1 -- 172.21.15.70:0/2728822012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 msgr2=0x5605b41d9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.271+0000 7faf9e200700 1 --2- 172.21.15.70:0/2728822012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41d9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.271+0000 7faf9e200700 1 -- 172.21.15.70:0/2728822012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605b41d1d00 con 0x5605b41e4600 2024-05-08T07:36:25.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.271+0000 7faf9e200700 1 --2- 172.21.15.70:0/2728822012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41d9d40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7faf9000b780 tx=0x7faf90009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb130352ae4c81b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:25.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.272+0000 7faf8a000700 1 -- 172.21.15.70:0/2728822012 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf900b2d80 con 0x5605b41e4600 2024-05-08T07:36:25.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.272+0000 7faf8a000700 1 -- 172.21.15.70:0/2728822012 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf900a65a0 con 0x5605b41e4600 2024-05-08T07:36:25.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.272+0000 7faf8a000700 1 -- 172.21.15.70:0/2728822012 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf900a5920 con 0x5605b41e4600 2024-05-08T07:36:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.273+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2728822012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 msgr2=0x5605b41d9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.273+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2728822012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41d9d40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7faf9000b780 tx=0x7faf90009b80 comp rx=0 tx=0).stop 2024-05-08T07:36:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.273+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2728822012 shutdown_connections 2024-05-08T07:36:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.273+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2728822012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e4600 0x5605b41d9d40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.273+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2728822012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.273+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2728822012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e0240 0x5605b41d9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.273+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2728822012 >> 172.21.15.70:0/2728822012 conn(0x5605b4152860 msgr2=0x5605b41df270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.273+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2728822012 shutdown_connections 2024-05-08T07:36:25.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.273+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2728822012 wait complete. 2024-05-08T07:36:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.274+0000 7fafaabfdb80 1 -- start start 2024-05-08T07:36:25.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.274+0000 7fafaabfdb80 1 Processor -- start 2024-05-08T07:36:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41ecd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e0240 0x5605b41e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7fafaabfdb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e4600 0x5605b41e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faf7800d5e0 con 0x5605b41e0240 2024-05-08T07:36:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faf7800ea50 con 0x5605b41e4600 2024-05-08T07:36:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7fafaabfdb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faf7800dcb0 con 0x5605b41db1d0 2024-05-08T07:36:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7fafaabfdb80 10 client.0 _ll_register_callbacks cb 0x5605b40d3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:36:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7faf9ce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e0240 0x5605b41e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7faf9ce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e0240 0x5605b41e7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54334/0 (socket says 172.21.15.70:54334) 2024-05-08T07:36:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.275+0000 7faf9ce00700 1 -- 172.21.15.70:0/2745558454 learned_addr learned my addr 172.21.15.70:0/2745558454 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:36:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.276+0000 7faf9e200700 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e4600 0x5605b41e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.276+0000 7faf9d800700 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41ecd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.276+0000 7faf9ce00700 1 -- 172.21.15.70:0/2745558454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 msgr2=0x5605b41ecd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.276+0000 7faf9ce00700 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41ecd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.276+0000 7faf9ce00700 1 -- 172.21.15.70:0/2745558454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e4600 msgr2=0x5605b41e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:36:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.276+0000 7faf9ce00700 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e4600 0x5605b41e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:25.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.276+0000 7faf9ce00700 1 -- 172.21.15.70:0/2745558454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b41e7130 con 0x5605b41e0240 2024-05-08T07:36:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.276+0000 7faf9ce00700 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e0240 0x5605b41e7a30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7faf84009850 tx=0x7faf8400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c30c3c6fa527ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:36:25.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.277+0000 7faf7f400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:36:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.277+0000 7faf7f400700 1 -- 172.21.15.70:0/2745558454 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf840044d0 con 0x5605b41e0240 2024-05-08T07:36:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.277+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2745558454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf900a65a0 con 0x5605b41e0240 2024-05-08T07:36:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.277+0000 7faf7f400700 1 -- 172.21.15.70:0/2745558454 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(179..179 src has 1..179) ==== 9583+0+0 (secure 0 0 0) 0x7faf840042d0 con 0x5605b41e0240 2024-05-08T07:36:25.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.278+0000 7faf7f400700 1 -- 172.21.15.70:0/2745558454 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7faf840044d0 con 0x5605b41e0240 2024-05-08T07:36:25.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.278+0000 7fafaabfdb80 10 client.16896 fetch_fsmap learned FSMap version 42 2024-05-08T07:36:25.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.278+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2745558454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5605b425fe00 con 0x5605b41e0240 2024-05-08T07:36:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.278+0000 7faf7f400700 1 -- 172.21.15.70:0/2745558454 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf900a65a0 con 0x5605b41e0240 2024-05-08T07:36:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.278+0000 7faf7f400700 1 -- 172.21.15.70:0/2745558454 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7faf840054c0 con 0x5605b41e0240 2024-05-08T07:36:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.279+0000 7fafaabfdb80 10 client.16896 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:36:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.279+0000 7fafaabfdb80 10 client.16896 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:36:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.279+0000 7fafaabfdb80 20 client.16896 populate_metadata read hostname 'smithi070' 2024-05-08T07:36:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.279+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605b42603c0 0x5605b42627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:36:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.279+0000 7fafaabfdb80 4 client.16896 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 77.55, "await_for": 42.0}] 2024-05-08T07:36:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.279+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2745558454 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 77.55, "await_for": 42.0}) -- 0x5605b413a590 con 0x5605b42603c0 2024-05-08T07:36:25.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.280+0000 7faf9d800700 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605b42603c0 0x5605b42627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:36:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.281+0000 7faf7f400700 10 client.16896 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:36:25.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:25.281+0000 7faf9d800700 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605b42603c0 0x5605b42627e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa311a6652b68f3f server_cookie=e9109be25e95b82d in_seq=0 out_seq=0 2024-05-08T07:36:25.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:25 smithi194 ceph-mon[33679]: pgmap v1584: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 220 KiB/s wr, 39 op/s 2024-05-08T07:36:25.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:25 smithi070 ceph-mon[29591]: pgmap v1584: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 220 KiB/s wr, 39 op/s 2024-05-08T07:36:25.655 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mm_init.o 2024-05-08T07:36:25.688 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:25 smithi172 ceph-mon[33377]: pgmap v1584: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 220 KiB/s wr, 39 op/s 2024-05-08T07:36:26.140 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/restrict.o 2024-05-08T07:36:26.796 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/uncore_snb.o 2024-05-08T07:36:26.944 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/quota/built-in.a 2024-05-08T07:36:27.623 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/permission.o 2024-05-08T07:36:27.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:27 smithi070 ceph-mon[29591]: pgmap v1585: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 354 KiB/s wr, 185 op/s 2024-05-08T07:36:27.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:27 smithi172 ceph-mon[33377]: pgmap v1585: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 354 KiB/s wr, 185 op/s 2024-05-08T07:36:27.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:27 smithi194 ceph-mon[33679]: pgmap v1585: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 354 KiB/s wr, 185 op/s 2024-05-08T07:36:29.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:29 smithi070 ceph-mon[29591]: pgmap v1586: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 354 KiB/s wr, 185 op/s 2024-05-08T07:36:29.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:29 smithi172 ceph-mon[33377]: pgmap v1586: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 354 KiB/s wr, 185 op/s 2024-05-08T07:36:29.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:29 smithi194 ceph-mon[33679]: pgmap v1586: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 354 KiB/s wr, 185 op/s 2024-05-08T07:36:31.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:31 smithi070 ceph-mon[29591]: pgmap v1587: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 369 KiB/s wr, 187 op/s 2024-05-08T07:36:31.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:31 smithi172 ceph-mon[33377]: pgmap v1587: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 369 KiB/s wr, 187 op/s 2024-05-08T07:36:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:31 smithi194 ceph-mon[33679]: pgmap v1587: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 369 KiB/s wr, 187 op/s 2024-05-08T07:36:33.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:33 smithi070 ceph-mon[29591]: pgmap v1588: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 430 KiB/s wr, 188 op/s 2024-05-08T07:36:33.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:33 smithi172 ceph-mon[33377]: pgmap v1588: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 430 KiB/s wr, 188 op/s 2024-05-08T07:36:33.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:33 smithi194 ceph-mon[33679]: pgmap v1588: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 430 KiB/s wr, 188 op/s 2024-05-08T07:36:35.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:35 smithi070 ceph-mon[29591]: pgmap v1589: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 393 KiB/s wr, 173 op/s 2024-05-08T07:36:35.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:35 smithi172 ceph-mon[33377]: pgmap v1589: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 393 KiB/s wr, 173 op/s 2024-05-08T07:36:35.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:35 smithi194 ceph-mon[33679]: pgmap v1589: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 393 KiB/s wr, 173 op/s 2024-05-08T07:36:37.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:37 smithi070 ceph-mon[29591]: pgmap v1590: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 335 KiB/s wr, 148 op/s 2024-05-08T07:36:37.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:37 smithi172 ceph-mon[33377]: pgmap v1590: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 335 KiB/s wr, 148 op/s 2024-05-08T07:36:37.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:37 smithi194 ceph-mon[33679]: pgmap v1590: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 335 KiB/s wr, 148 op/s 2024-05-08T07:36:39.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:39 smithi070 ceph-mon[29591]: pgmap v1591: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 193 KiB/s wr, 17 op/s 2024-05-08T07:36:39.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:39 smithi172 ceph-mon[33377]: pgmap v1591: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 193 KiB/s wr, 17 op/s 2024-05-08T07:36:39.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:39 smithi194 ceph-mon[33679]: pgmap v1591: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 193 KiB/s wr, 17 op/s 2024-05-08T07:36:41.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:41 smithi070 ceph-mon[29591]: pgmap v1592: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 193 KiB/s wr, 19 op/s 2024-05-08T07:36:41.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:41 smithi172 ceph-mon[33377]: pgmap v1592: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 193 KiB/s wr, 19 op/s 2024-05-08T07:36:41.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:41 smithi194 ceph-mon[33679]: pgmap v1592: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 193 KiB/s wr, 19 op/s 2024-05-08T07:36:43.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:43 smithi070 ceph-mon[29591]: pgmap v1593: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 104 KiB/s wr, 13 op/s 2024-05-08T07:36:43.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:43 smithi172 ceph-mon[33377]: pgmap v1593: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 104 KiB/s wr, 13 op/s 2024-05-08T07:36:43.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:43 smithi194 ceph-mon[33679]: pgmap v1593: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 104 KiB/s wr, 13 op/s 2024-05-08T07:36:45.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:45 smithi070 ceph-mon[29591]: pgmap v1594: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-05-08T07:36:45.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:45 smithi172 ceph-mon[33377]: pgmap v1594: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-05-08T07:36:45.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:45 smithi194 ceph-mon[33679]: pgmap v1594: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-05-08T07:36:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:47 smithi070 ceph-mon[29591]: pgmap v1595: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 10 op/s 2024-05-08T07:36:47.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:47 smithi172 ceph-mon[33377]: pgmap v1595: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 10 op/s 2024-05-08T07:36:47.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.736+0000 7faf7f400700 1 -- 172.21.15.70:0/2745558454 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5605b413a590 con 0x5605b42603c0 2024-05-08T07:36:47.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.736+0000 7faf7f400700 10 client.16896 handle_command_reply: tid=0 2024-05-08T07:36:47.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.737+0000 7fafaabfdb80 1 client.16896 shutdown 2024-05-08T07:36:47.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.737+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2745558454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e0240 msgr2=0x5605b41e7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:47.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.737+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e0240 0x5605b41e7a30 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7faf84009850 tx=0x7faf8400ef00 comp rx=0 tx=0).stop 2024-05-08T07:36:47.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.737+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2745558454 shutdown_connections 2024-05-08T07:36:47.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.738+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5605b42603c0 0x5605b42627e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:47.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.738+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5605b41e4600 0x5605b41e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:47.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.738+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5605b41db1d0 0x5605b41ecd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:47.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.738+0000 7fafaabfdb80 1 --2- 172.21.15.70:0/2745558454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605b41e0240 0x5605b41e7a30 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:47.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.738+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2745558454 >> 172.21.15.70:0/2745558454 conn(0x5605b4152860 msgr2=0x5605b41d9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:47.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.738+0000 7faf7f400700 0 client.16896 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:36:47.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.738+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2745558454 shutdown_connections 2024-05-08T07:36:47.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.738+0000 7fafaabfdb80 1 -- 172.21.15.70:0/2745558454 wait complete. 2024-05-08T07:36:47.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.738+0000 7fafaabfdb80 20 client.16896 trim_cache size 0 max 16384 2024-05-08T07:36:47.739 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:36:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:36:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 126, 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "c4a151a9": { 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 126, 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 77.5, 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:36:47.740 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:36:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:36:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:36:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:36:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:47.741 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:36:47.741 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.740+0000 7fafa0200700 1 -- 172.21.15.70:0/3421188107 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf800b2b20 msgr2=0x7faf800b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.740+0000 7fafa0200700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf800b2b20 0x7faf800b4fe0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009a70 tx=0x7faf8c009260 comp rx=0 tx=0).stop 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.740+0000 7fafa0200700 1 -- 172.21.15.70:0/3421188107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf98114200 msgr2=0x7faf981a4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.740+0000 7fafa0200700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf98114200 0x7faf981a4900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faf9000b070 tx=0x7faf90004d10 comp rx=0 tx=0).stop 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.740+0000 7fafa0200700 1 -- 172.21.15.70:0/3421188107 shutdown_connections 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.740+0000 7fafa0200700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf800b2b20 0x7faf800b4fe0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.740+0000 7fafa0200700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faf98114200 0x7faf981a4900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.741+0000 7fafa0200700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf981034a0 0x7faf981a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.741+0000 7fafa0200700 1 --2- 172.21.15.70:0/3421188107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faf98104450 0x7faf981a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.741+0000 7fafa0200700 1 -- 172.21.15.70:0/3421188107 >> 172.21.15.70:0/3421188107 conn(0x7faf98079340 msgr2=0x7faf98101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:36:47.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.741+0000 7fafa0200700 1 -- 172.21.15.70:0/3421188107 shutdown_connections 2024-05-08T07:36:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:36:47.741+0000 7fafa0200700 1 -- 172.21.15.70:0/3421188107 wait complete. 2024-05-08T07:36:47.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:47 smithi194 ceph-mon[33679]: pgmap v1595: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 10 op/s 2024-05-08T07:36:48.768 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c4a151a9', quiesce took 35.0 seconds. Will release after: 17.55 2024-05-08T07:36:49.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:49 smithi070 ceph-mon[29591]: pgmap v1596: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2024-05-08T07:36:49.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:49 smithi172 ceph-mon[33377]: pgmap v1596: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2024-05-08T07:36:49.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:49 smithi194 ceph-mon[33679]: pgmap v1596: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2024-05-08T07:36:51.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:51 smithi070 ceph-mon[29591]: pgmap v1597: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:36:51.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:51 smithi172 ceph-mon[33377]: pgmap v1597: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:36:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:51 smithi194 ceph-mon[33679]: pgmap v1597: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 29 KiB/s wr, 7 op/s 2024-05-08T07:36:53.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:53 smithi070 ceph-mon[29591]: pgmap v1598: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T07:36:53.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:53 smithi172 ceph-mon[33377]: pgmap v1598: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T07:36:53.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:53 smithi194 ceph-mon[33679]: pgmap v1598: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T07:36:55.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:55 smithi070 ceph-mon[29591]: pgmap v1599: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T07:36:55.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:55 smithi172 ceph-mon[33377]: pgmap v1599: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T07:36:55.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:55 smithi194 ceph-mon[33679]: pgmap v1599: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T07:36:57.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:57 smithi070 ceph-mon[29591]: pgmap v1600: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 9 op/s 2024-05-08T07:36:57.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:57 smithi172 ceph-mon[33377]: pgmap v1600: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 9 op/s 2024-05-08T07:36:57.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:57 smithi194 ceph-mon[33679]: pgmap v1600: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 9 op/s 2024-05-08T07:36:59.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:36:59 smithi070 ceph-mon[29591]: pgmap v1601: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-05-08T07:36:59.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:36:59 smithi172 ceph-mon[33377]: pgmap v1601: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-05-08T07:36:59.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:36:59 smithi194 ceph-mon[33679]: pgmap v1601: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 50 KiB/s wr, 7 op/s 2024-05-08T07:37:01.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:01 smithi070 ceph-mon[29591]: pgmap v1602: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-05-08T07:37:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:01 smithi172 ceph-mon[33377]: pgmap v1602: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-05-08T07:37:01.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:01 smithi194 ceph-mon[33679]: pgmap v1602: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-05-08T07:37:03.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:03 smithi070 ceph-mon[29591]: pgmap v1603: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 72 KiB/s wr, 23 op/s 2024-05-08T07:37:03.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:03 smithi172 ceph-mon[33377]: pgmap v1603: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 72 KiB/s wr, 23 op/s 2024-05-08T07:37:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:03 smithi194 ceph-mon[33679]: pgmap v1603: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 72 KiB/s wr, 23 op/s 2024-05-08T07:37:05.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:05 smithi070 ceph-mon[29591]: pgmap v1604: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 22 op/s 2024-05-08T07:37:05.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:05 smithi172 ceph-mon[33377]: pgmap v1604: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 22 op/s 2024-05-08T07:37:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:05 smithi194 ceph-mon[33679]: pgmap v1604: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 39 KiB/s wr, 22 op/s 2024-05-08T07:37:06.319 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:37:06.813 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:37:07.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:07 smithi070 ceph-mon[29591]: pgmap v1605: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 75 KiB/s wr, 26 op/s 2024-05-08T07:37:07.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:37:07.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:07 smithi172 ceph-mon[33377]: pgmap v1605: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 75 KiB/s wr, 26 op/s 2024-05-08T07:37:07.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:37:07.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:07 smithi194 ceph-mon[33679]: pgmap v1605: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 75 KiB/s wr, 26 op/s 2024-05-08T07:37:07.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:37:09.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:09 smithi172 ceph-mon[33377]: pgmap v1606: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:37:09.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:37:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:37:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:37:09.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:09 smithi194 ceph-mon[33679]: pgmap v1606: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:37:09.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:37:09.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:37:09.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:37:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.797+0000 7f1f05800700 1 -- 172.21.15.70:0/1203688528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f0006b180 msgr2=0x7f1f0006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.797+0000 7f1f05800700 1 --2- 172.21.15.70:0/1203688528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f0006b180 0x7f1f0006b600 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8009990 tx=0x7f1ee8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:37:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.798+0000 7f1f05800700 1 -- 172.21.15.70:0/1203688528 shutdown_connections 2024-05-08T07:37:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.798+0000 7f1f05800700 1 --2- 172.21.15.70:0/1203688528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f0006bb40 0x7f1f00110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.798+0000 7f1f05800700 1 --2- 172.21.15.70:0/1203688528 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f00109510 0x7f1f001098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.798+0000 7f1f05800700 1 --2- 172.21.15.70:0/1203688528 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f0006b180 0x7f1f0006b600 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.798+0000 7f1f05800700 1 -- 172.21.15.70:0/1203688528 >> 172.21.15.70:0/1203688528 conn(0x7f1f00079350 msgr2=0x7f1f00079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:37:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.798+0000 7f1f05800700 1 -- 172.21.15.70:0/1203688528 shutdown_connections 2024-05-08T07:37:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.798+0000 7f1f05800700 1 -- 172.21.15.70:0/1203688528 wait complete. 2024-05-08T07:37:09.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:09 smithi070 ceph-mon[29591]: pgmap v1606: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:37:09.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:37:09.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:37:09.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:37:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.799+0000 7f1f05800700 1 Processor -- start 2024-05-08T07:37:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.800+0000 7f1f05800700 1 -- start start 2024-05-08T07:37:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.800+0000 7f1f05800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f0006b180 0x7f1f0019f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.800+0000 7f1f05800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f0006bb40 0x7f1f0019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.800+0000 7f1f05800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f00109510 0x7f1f001998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.800+0000 7f1f05800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f00113540 con 0x7f1f00109510 2024-05-08T07:37:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.800+0000 7f1f05800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1f001133c0 con 0x7f1f0006b180 2024-05-08T07:37:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.800+0000 7f1f05800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1f001136c0 con 0x7f1f0006bb40 2024-05-08T07:37:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1eff400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f00109510 0x7f1f001998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1eff400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f00109510 0x7f1f001998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42732/0 (socket says 172.21.15.70:42732) 2024-05-08T07:37:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1eff400700 1 -- 172.21.15.70:0/2671209095 learned_addr learned my addr 172.21.15.70:0/2671209095 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:37:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1efea00700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f0006b180 0x7f1f0019f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1ef6000700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f0006bb40 0x7f1f0019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1eff400700 1 -- 172.21.15.70:0/2671209095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f0006bb40 msgr2=0x7f1f0019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:09.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1eff400700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f0006bb40 0x7f1f0019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1eff400700 1 -- 172.21.15.70:0/2671209095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f0006b180 msgr2=0x7f1f0019f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1eff400700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f0006b180 0x7f1f0019f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.801+0000 7f1eff400700 1 -- 172.21.15.70:0/2671209095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0019a000 con 0x7f1f00109510 2024-05-08T07:37:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.802+0000 7f1eff400700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f00109510 0x7f1f001998a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c970 tx=0x7f1ef800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:37:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.802+0000 7f1ef7e00700 1 -- 172.21.15.70:0/2671209095 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8004a30 con 0x7f1f00109510 2024-05-08T07:37:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.802+0000 7f1ef7e00700 1 -- 172.21.15.70:0/2671209095 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1ef80054b0 con 0x7f1f00109510 2024-05-08T07:37:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.802+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0019a2f0 con 0x7f1f00109510 2024-05-08T07:37:09.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.802+0000 7f1ef7e00700 1 -- 172.21.15.70:0/2671209095 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef800eac0 con 0x7f1f00109510 2024-05-08T07:37:09.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.802+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f001a65b0 con 0x7f1f00109510 2024-05-08T07:37:09.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.804+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0006a190 con 0x7f1f00109510 2024-05-08T07:37:09.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.806+0000 7f1ef7e00700 1 -- 172.21.15.70:0/2671209095 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1ef800eca0 con 0x7f1f00109510 2024-05-08T07:37:09.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.807+0000 7f1ef7e00700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ee40b29f0 0x7f1ee40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:09.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.807+0000 7f1ef7e00700 1 -- 172.21.15.70:0/2671209095 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9671+0+0 (secure 0 0 0) 0x7f1ef80e2590 con 0x7f1f00109510 2024-05-08T07:37:09.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.807+0000 7f1efea00700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ee40b29f0 0x7f1ee40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:09.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.808+0000 7f1efea00700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ee40b29f0 0x7f1ee40b4eb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1f0019a9e0 tx=0x7f1ef00079e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:37:09.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:09.812+0000 7f1ef7e00700 1 -- 172.21.15.70:0/2671209095 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1ef8014030 con 0x7f1f00109510 2024-05-08T07:37:10.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.107+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f0019ae00 con 0x7f1f00109510 2024-05-08T07:37:10.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.108+0000 7f1ef7e00700 1 -- 172.21.15.70:0/2671209095 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f1f0019ae00 con 0x7f1f00109510 2024-05-08T07:37:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:37:10.106 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:37:10.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ee40b29f0 msgr2=0x7f1ee40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:10.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ee40b29f0 0x7f1ee40b4eb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1f0019a9e0 tx=0x7f1ef00079e0 comp rx=0 tx=0).stop 2024-05-08T07:37:10.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f00109510 msgr2=0x7f1f001998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:10.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f00109510 0x7f1f001998a0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800c970 tx=0x7f1ef800cc80 comp rx=0 tx=0).stop 2024-05-08T07:37:10.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 shutdown_connections 2024-05-08T07:37:10.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ee40b29f0 0x7f1ee40b4eb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:10.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f00109510 0x7f1f001998a0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:10.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1f0006b180 0x7f1f0019f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:10.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 --2- 172.21.15.70:0/2671209095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f0006bb40 0x7f1f0019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:10.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.111+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 >> 172.21.15.70:0/2671209095 conn(0x7f1f00079350 msgr2=0x7f1f001010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:37:10.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.112+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 shutdown_connections 2024-05-08T07:37:10.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:10.112+0000 7f1f05800700 1 -- 172.21.15.70:0/2671209095 wait complete. 2024-05-08T07:37:10.111 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:37:10.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:10 smithi172 ceph-mon[33377]: osdmap e180: 12 total, 12 up, 12 in 2024-05-08T07:37:10.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:10 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2671209095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:37:10.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:10 smithi194 ceph-mon[33679]: osdmap e180: 12 total, 12 up, 12 in 2024-05-08T07:37:10.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:10 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2671209095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:37:10.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:10 smithi070 ceph-mon[29591]: osdmap e180: 12 total, 12 up, 12 in 2024-05-08T07:37:10.853 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:10 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2671209095' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:37:10.900 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id c4a151a9 --release --await' 2024-05-08T07:37:10.901 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id c4a151a9 --release --await 2024-05-08T07:37:11.349 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:37:11.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:11 smithi172 ceph-mon[33377]: pgmap v1608: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 27 op/s 2024-05-08T07:37:11.678 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:11 smithi070 ceph-mon[29591]: pgmap v1608: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 27 op/s 2024-05-08T07:37:11.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:11 smithi194 ceph-mon[33679]: pgmap v1608: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 27 op/s 2024-05-08T07:37:13.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:13 smithi070 ceph-mon[29591]: pgmap v1609: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 43 KiB/s wr, 9 op/s 2024-05-08T07:37:13.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:13 smithi172 ceph-mon[33377]: pgmap v1609: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 43 KiB/s wr, 9 op/s 2024-05-08T07:37:13.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:13 smithi194 ceph-mon[33679]: pgmap v1609: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 43 KiB/s wr, 9 op/s 2024-05-08T07:37:13.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.987+0000 7fa103000700 1 -- 172.21.15.70:0/3089798300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06b180 msgr2=0x7fa0fc06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:13.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.987+0000 7fa103000700 1 --2- 172.21.15.70:0/3089798300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06b180 0x7fa0fc06b600 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8009990 tx=0x7fa0e8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:37:13.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.987+0000 7fa103000700 1 -- 172.21.15.70:0/3089798300 shutdown_connections 2024-05-08T07:37:13.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.987+0000 7fa103000700 1 --2- 172.21.15.70:0/3089798300 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0fc06bb40 0x7fa0fc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:13.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.987+0000 7fa103000700 1 --2- 172.21.15.70:0/3089798300 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0fc109510 0x7fa0fc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:13.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.987+0000 7fa103000700 1 --2- 172.21.15.70:0/3089798300 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06b180 0x7fa0fc06b600 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:13.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.987+0000 7fa103000700 1 -- 172.21.15.70:0/3089798300 >> 172.21.15.70:0/3089798300 conn(0x7fa0fc079350 msgr2=0x7fa0fc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:37:13.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.987+0000 7fa103000700 1 -- 172.21.15.70:0/3089798300 shutdown_connections 2024-05-08T07:37:13.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.987+0000 7fa103000700 1 -- 172.21.15.70:0/3089798300 wait complete. 2024-05-08T07:37:13.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.988+0000 7fa103000700 1 Processor -- start 2024-05-08T07:37:13.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.989+0000 7fa103000700 1 -- start start 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.989+0000 7fa103000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0fc06b180 0x7fa0fc1a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.989+0000 7fa103000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06bb40 0x7fa0fc1a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.989+0000 7fa103000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0fc109510 0x7fa0fc19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.989+0000 7fa103000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc113520 con 0x7fa0fc06bb40 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.989+0000 7fa103000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1133a0 con 0x7fa0fc06b180 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.989+0000 7fa103000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1136a0 con 0x7fa0fc109510 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.989+0000 7fa0fb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06bb40 0x7fa0fc1a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa0fb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06bb40 0x7fa0fc1a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42748/0 (socket says 172.21.15.70:42748) 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa0fb400700 1 -- 172.21.15.70:0/266598261 learned_addr learned my addr 172.21.15.70:0/266598261 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0fc06b180 0x7fa0fc1a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa101000700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0fc109510 0x7fa0fc19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa0fb400700 1 -- 172.21.15.70:0/266598261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0fc109510 msgr2=0x7fa0fc19ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa0fb400700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0fc109510 0x7fa0fc19ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:13.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa0fb400700 1 -- 172.21.15.70:0/266598261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0fc06b180 msgr2=0x7fa0fc1a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:13.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa0fb400700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0fc06b180 0x7fa0fc1a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:13.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa0fb400700 1 -- 172.21.15.70:0/266598261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0fc19c180 con 0x7fa0fc06bb40 2024-05-08T07:37:13.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.990+0000 7fa0fb400700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06bb40 0x7fa0fc1a1da0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8005910 tx=0x7fa0e80047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:37:13.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.991+0000 7fa0f8c00700 1 -- 172.21.15.70:0/266598261 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e8027070 con 0x7fa0fc06bb40 2024-05-08T07:37:13.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.991+0000 7fa0f8c00700 1 -- 172.21.15.70:0/266598261 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0e800fc80 con 0x7fa0fc06bb40 2024-05-08T07:37:13.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.991+0000 7fa0f8c00700 1 -- 172.21.15.70:0/266598261 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80173f0 con 0x7fa0fc06bb40 2024-05-08T07:37:13.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.991+0000 7fa103000700 1 -- 172.21.15.70:0/266598261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0fc19c410 con 0x7fa0fc06bb40 2024-05-08T07:37:13.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.991+0000 7fa103000700 1 -- 172.21.15.70:0/266598261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0fc1a8730 con 0x7fa0fc06bb40 2024-05-08T07:37:13.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.996+0000 7fa0f8c00700 1 -- 172.21.15.70:0/266598261 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa0e802a070 con 0x7fa0fc06bb40 2024-05-08T07:37:13.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.998+0000 7fa10d9c1b80 1 Processor -- start 2024-05-08T07:37:13.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.998+0000 7fa0f8c00700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0e00b2a70 0x7fa0e00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:13.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.998+0000 7fa10d9c1b80 1 -- start start 2024-05-08T07:37:13.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.998+0000 7fa0f8c00700 1 -- 172.21.15.70:0/266598261 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 9671+0+0 (secure 0 0 0) 0x7fa0e80e39c0 con 0x7fa0fc06bb40 2024-05-08T07:37:13.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.998+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0e00b2a70 0x7fa0e00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:13.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.998+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce8e80 0x55aa18ce9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:13.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.998+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18ced250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:13.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.998+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ced790 0x55aa18cedbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:13.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.999+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aa18c32b20 con 0x55aa18ced790 2024-05-08T07:37:13.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.999+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55aa18bd0860 con 0x55aa18ce97a0 2024-05-08T07:37:13.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.999+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55aa18c2eae0 con 0x55aa18ce8e80 2024-05-08T07:37:14.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.999+0000 7fa101000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ced790 0x55aa18cedbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.999+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0e00b2a70 0x7fa0e00b4f30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc19cb60 tx=0x7fa0ec00a380 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:37:14.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.999+0000 7fa101000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ced790 0x55aa18cedbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42760/0 (socket says 172.21.15.70:42760) 2024-05-08T07:37:14.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.999+0000 7fa101000700 1 -- 172.21.15.70:0/360295984 learned_addr learned my addr 172.21.15.70:0/360295984 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:37:14.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.999+0000 7fa0fb400700 1 --2- 172.21.15.70:0/360295984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18ced250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:13.999+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/360295984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce8e80 0x55aa18ce9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.000+0000 7fa101000700 1 -- 172.21.15.70:0/360295984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce8e80 msgr2=0x55aa18ce9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.000+0000 7fa101000700 1 --2- 172.21.15.70:0/360295984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce8e80 0x55aa18ce9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.000+0000 7fa101000700 1 -- 172.21.15.70:0/360295984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 msgr2=0x55aa18ced250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.000+0000 7fa101000700 1 --2- 172.21.15.70:0/360295984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18ced250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.000+0000 7fa101000700 1 -- 172.21.15.70:0/360295984 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa18b7f9d0 con 0x55aa18ced790 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.000+0000 7fa101000700 1 --2- 172.21.15.70:0/360295984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ced790 0x55aa18cedbd0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400e190 tx=0x7fa0f400e4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7994988630a6bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.000+0000 7fa0f1600700 1 -- 172.21.15.70:0/360295984 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f400ed30 con 0x55aa18ced790 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.000+0000 7fa0f1600700 1 -- 172.21.15.70:0/360295984 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f4004bb0 con 0x55aa18ced790 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.000+0000 7fa0f1600700 1 -- 172.21.15.70:0/360295984 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f4014d10 con 0x55aa18ced790 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.001+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/360295984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ced790 msgr2=0x55aa18cedbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:14.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.001+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/360295984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ced790 0x55aa18cedbd0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa0f400e190 tx=0x7fa0f400e4a0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.001+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/360295984 shutdown_connections 2024-05-08T07:37:14.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.001+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/360295984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ced790 0x55aa18cedbd0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.001+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/360295984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce8e80 0x55aa18ce9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.001+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/360295984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18ced250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.001+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/360295984 >> 172.21.15.70:0/360295984 conn(0x55aa18c0ec60 msgr2=0x55aa18cdad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:37:14.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.001+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/360295984 shutdown_connections 2024-05-08T07:37:14.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.001+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/360295984 wait complete. 2024-05-08T07:37:14.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.002+0000 7fa10d9c1b80 1 -- start start 2024-05-08T07:37:14.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.003+0000 7fa10d9c1b80 1 Processor -- start 2024-05-08T07:37:14.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.003+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cf4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.003+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18cf1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.003+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 0x55aa18cf24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.003+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55aa18cf59c0 con 0x55aa18ce8e80 2024-05-08T07:37:14.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.003+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55aa18b98c20 con 0x55aa18ce97a0 2024-05-08T07:37:14.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.003+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55aa18cf5b40 con 0x55aa18ced790 2024-05-08T07:37:14.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.003+0000 7fa10d9c1b80 10 client.0 _ll_register_callbacks cb 0x55aa18bd9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:37:14.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cf4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cf4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42774/0 (socket says 172.21.15.70:42774) 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fbe00700 1 -- 172.21.15.70:0/3311988027 learned_addr learned my addr 172.21.15.70:0/3311988027 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fb400700 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18cf1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa101000700 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 0x55aa18cf24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fbe00700 1 -- 172.21.15.70:0/3311988027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 msgr2=0x55aa18cf24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 0x55aa18cf24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fbe00700 1 -- 172.21.15.70:0/3311988027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 msgr2=0x55aa18cf1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18cf1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fbe00700 1 -- 172.21.15.70:0/3311988027 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa18bf8520 con 0x55aa18ce8e80 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa0fb400700 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18cf1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:37:14.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.004+0000 7fa101000700 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 0x55aa18cf24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.005+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cf4be0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec010000 tx=0x7fa0ec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f7520fb67d6319 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.005+0000 7fa0e6000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.005+0000 7fa0e6000700 1 -- 172.21.15.70:0/3311988027 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec016070 con 0x55aa18ce8e80 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.005+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/3311988027 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0f4004bb0 con 0x55aa18ce8e80 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.005+0000 7fa0e6000700 1 -- 172.21.15.70:0/3311988027 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 9671+0+0 (secure 0 0 0) 0x7fa0ec010840 con 0x55aa18ce8e80 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.006+0000 7fa0e6000700 1 -- 172.21.15.70:0/3311988027 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa0ec030050 con 0x55aa18ce8e80 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.006+0000 7fa10d9c1b80 10 client.16914 fetch_fsmap learned FSMap version 42 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.006+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/3311988027 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55aa18d002f0 con 0x55aa18ce8e80 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.006+0000 7fa0e6000700 1 -- 172.21.15.70:0/3311988027 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0f4004bb0 con 0x55aa18ce8e80 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.006+0000 7fa0e6000700 1 -- 172.21.15.70:0/3311988027 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa0ec019070 con 0x55aa18ce8e80 2024-05-08T07:37:14.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.006+0000 7fa10d9c1b80 10 client.16914 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:37:14.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.006+0000 7fa10d9c1b80 10 client.16914 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:37:14.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.007+0000 7fa10d9c1b80 20 client.16914 populate_metadata read hostname 'smithi070' 2024-05-08T07:37:14.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.007+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55aa18d02930 0x55aa18d04d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.007+0000 7fa10d9c1b80 4 client.16914 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:37:14.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.007+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/3311988027 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa18cad1a0 con 0x55aa18d02930 2024-05-08T07:37:14.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.007+0000 7fa0fb400700 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55aa18d02930 0x55aa18d04d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.008+0000 7fa0fb400700 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55aa18d02930 0x55aa18d04d20 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e561ad10c9cf35b1 server_cookie=9ac6ed0b08cf907c in_seq=0 out_seq=0 2024-05-08T07:37:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.008+0000 7fa0e6000700 10 client.16914 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:37:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.010+0000 7fa0e6000700 1 -- 172.21.15.70:0/3311988027 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aa18cad1a0 con 0x55aa18d02930 2024-05-08T07:37:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.010+0000 7fa0e6000700 10 client.16914 handle_command_reply: tid=0 2024-05-08T07:37:14.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.010+0000 7fa10d9c1b80 1 client.16914 shutdown 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/3311988027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 msgr2=0x55aa18cf4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cf4be0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec010000 tx=0x7fa0ec0047c0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/3311988027 shutdown_connections 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55aa18d02930 0x55aa18d04d20 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 0x55aa18cf24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cf4be0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/3311988027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18cf1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/3311988027 >> 172.21.15.70:0/3311988027 conn(0x55aa18c0ec60 msgr2=0x55aa18cedb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa0e6000700 0 client.16914 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/3311988027 shutdown_connections 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/3311988027 wait complete. 2024-05-08T07:37:14.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.011+0000 7fa10d9c1b80 20 client.16914 trim_cache size 0 max 16384 2024-05-08T07:37:14.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.033+0000 7fa10d9c1b80 1 Processor -- start 2024-05-08T07:37:14.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.033+0000 7fa10d9c1b80 1 -- start start 2024-05-08T07:37:14.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.034+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.034+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18cf3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.034+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 0x55aa18d0a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.034+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1afc10 con 0x55aa18ce8e80 2024-05-08T07:37:14.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.034+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1ad4a0 con 0x55aa18ce97a0 2024-05-08T07:37:14.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.034+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1ab330 con 0x55aa18ced790 2024-05-08T07:37:14.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.034+0000 7fa0fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.034+0000 7fa0fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42782/0 (socket says 172.21.15.70:42782) 2024-05-08T07:37:14.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.034+0000 7fa0fbe00700 1 -- 172.21.15.70:0/386898269 learned_addr learned my addr 172.21.15.70:0/386898269 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:37:14.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.035+0000 7fa101000700 1 --2- 172.21.15.70:0/386898269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 0x55aa18d0a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.035+0000 7fa0fb400700 1 --2- 172.21.15.70:0/386898269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18cf3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.035+0000 7fa0fbe00700 1 -- 172.21.15.70:0/386898269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 msgr2=0x55aa18d0a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:37:14.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.035+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/386898269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 0x55aa18d0a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.035+0000 7fa0fbe00700 1 -- 172.21.15.70:0/386898269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 msgr2=0x55aa18cf3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:37:14.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.035+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/386898269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18cf3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.035+0000 7fa0fbe00700 1 -- 172.21.15.70:0/386898269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa18cf0530 con 0x55aa18ce8e80 2024-05-08T07:37:14.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.035+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/386898269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfeab0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0040b0 tx=0x7fa0ec0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4398acaead12ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:37:14.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.036+0000 7fa0f0c00700 1 -- 172.21.15.70:0/386898269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec038020 con 0x55aa18ce8e80 2024-05-08T07:37:14.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.036+0000 7fa0f0c00700 1 -- 172.21.15.70:0/386898269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0ec022070 con 0x55aa18ce8e80 2024-05-08T07:37:14.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.036+0000 7fa0f0c00700 1 -- 172.21.15.70:0/386898269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec010c70 con 0x55aa18ce8e80 2024-05-08T07:37:14.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.037+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/386898269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 msgr2=0x55aa18cfeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:14.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.037+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/386898269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfeab0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0040b0 tx=0x7fa0ec0040e0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.037+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/386898269 shutdown_connections 2024-05-08T07:37:14.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.037+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/386898269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ced790 0x55aa18d0a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.037+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/386898269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfeab0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.037+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/386898269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ce97a0 0x55aa18cf3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.037+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/386898269 >> 172.21.15.70:0/386898269 conn(0x55aa18c0ec60 msgr2=0x55aa18cf3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:37:14.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.038+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/386898269 shutdown_connections 2024-05-08T07:37:14.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.038+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/386898269 wait complete. 2024-05-08T07:37:14.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.038+0000 7fa10d9c1b80 1 -- start start 2024-05-08T07:37:14.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.038+0000 7fa10d9c1b80 1 Processor -- start 2024-05-08T07:37:14.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.039+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.039+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce97a0 0x55aa18cfb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.039+0000 7fa10d9c1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ced790 0x55aa18cf9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.039+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1ab980 con 0x55aa18ce8e80 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.039+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1acdd0 con 0x55aa18ced790 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.039+0000 7fa10d9c1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa0fc1ac030 con 0x55aa18ce97a0 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.039+0000 7fa10d9c1b80 10 client.0 _ll_register_callbacks cb 0x55aa18bd9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42798/0 (socket says 172.21.15.70:42798) 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fbe00700 1 -- 172.21.15.70:0/4064729330 learned_addr learned my addr 172.21.15.70:0/4064729330 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fb400700 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce97a0 0x55aa18cfb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fbe00700 1 -- 172.21.15.70:0/4064729330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce97a0 msgr2=0x55aa18cfb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce97a0 0x55aa18cfb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fbe00700 1 -- 172.21.15.70:0/4064729330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ced790 msgr2=0x55aa18cf9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ced790 0x55aa18cf9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fbe00700 1 -- 172.21.15.70:0/4064729330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa18cf9920 con 0x55aa18ce8e80 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0fbe00700 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfac50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0276a0 tx=0x7fa0ec027780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bfa31f37dfa73d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.040+0000 7fa0e6000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.041+0000 7fa0e6000700 1 -- 172.21.15.70:0/4064729330 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec038070 con 0x55aa18ce8e80 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.041+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/4064729330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0ec022070 con 0x55aa18ce8e80 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.041+0000 7fa0e6000700 1 -- 172.21.15.70:0/4064729330 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(180..180 src has 1..180) ==== 9671+0+0 (secure 0 0 0) 0x7fa0ec010b00 con 0x55aa18ce8e80 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.041+0000 7fa0e6000700 1 -- 172.21.15.70:0/4064729330 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa0ec048050 con 0x55aa18ce8e80 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.041+0000 7fa10d9c1b80 10 client.16920 fetch_fsmap learned FSMap version 42 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.041+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/4064729330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55aa18d6dd40 con 0x55aa18ce8e80 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.041+0000 7fa0e6000700 1 -- 172.21.15.70:0/4064729330 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0ec022070 con 0x55aa18ce8e80 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.042+0000 7fa0e6000700 1 -- 172.21.15.70:0/4064729330 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa0ec019070 con 0x55aa18ce8e80 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.042+0000 7fa10d9c1b80 10 client.16920 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.042+0000 7fa10d9c1b80 10 client.16920 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:37:14.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.042+0000 7fa10d9c1b80 20 client.16920 populate_metadata read hostname 'smithi070' 2024-05-08T07:37:14.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.042+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55aa18d6e330 0x55aa18d70750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:37:14.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.042+0000 7fa10d9c1b80 4 client.16920 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c4a151a9", "release": true, "await": true}] 2024-05-08T07:37:14.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.042+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/4064729330 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c4a151a9", "release": true, "await": true}) -- 0x55aa18c40500 con 0x55aa18d6e330 2024-05-08T07:37:14.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.042+0000 7fa0fb400700 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55aa18d6e330 0x55aa18d70750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:37:14.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.043+0000 7fa0fb400700 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55aa18d6e330 0x55aa18d70750 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3822e8dc1740a079 server_cookie=f4357a77752459ad in_seq=0 out_seq=0 2024-05-08T07:37:14.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:14.043+0000 7fa0e6000700 10 client.16920 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:37:15.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:15 smithi172 ceph-mon[33377]: pgmap v1610: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 43 KiB/s wr, 9 op/s 2024-05-08T07:37:15.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:15 smithi194 ceph-mon[33679]: pgmap v1610: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 43 KiB/s wr, 9 op/s 2024-05-08T07:37:15.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:15 smithi070 ceph-mon[29591]: pgmap v1610: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 43 KiB/s wr, 9 op/s 2024-05-08T07:37:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:17 smithi194 ceph-mon[33679]: pgmap v1611: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:37:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:17 smithi070 ceph-mon[29591]: pgmap v1611: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:37:17.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:17 smithi172 ceph-mon[33377]: pgmap v1611: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:37:18.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.517+0000 7fa0e6000700 1 -- 172.21.15.70:0/4064729330 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55aa18c40500 con 0x55aa18d6e330 2024-05-08T07:37:18.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.517+0000 7fa0e6000700 10 client.16920 handle_command_reply: tid=0 2024-05-08T07:37:18.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.517+0000 7fa10d9c1b80 1 client.16920 shutdown 2024-05-08T07:37:18.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.519+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/4064729330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 msgr2=0x55aa18cfac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:18.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.519+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfac50 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0276a0 tx=0x7fa0ec027780 comp rx=0 tx=0).stop 2024-05-08T07:37:18.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.520+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/4064729330 shutdown_connections 2024-05-08T07:37:18.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.520+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55aa18d6e330 0x55aa18d70750 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:18.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.520+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55aa18ced790 0x55aa18cf9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:18.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.520+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55aa18ce8e80 0x55aa18cfac50 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:18.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.520+0000 7fa10d9c1b80 1 --2- 172.21.15.70:0/4064729330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55aa18ce97a0 0x55aa18cfb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:18.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.520+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/4064729330 >> 172.21.15.70:0/4064729330 conn(0x55aa18c0ec60 msgr2=0x55aa18cdfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:37:18.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.520+0000 7fa0e6000700 0 client.16920 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:37:18.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.522+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/4064729330 shutdown_connections 2024-05-08T07:37:18.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.522+0000 7fa10d9c1b80 1 -- 172.21.15.70:0/4064729330 wait complete. 2024-05-08T07:37:18.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.522+0000 7fa10d9c1b80 20 client.16920 trim_cache size 0 max 16384 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 128, 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "c4a151a9": { 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 128, 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:37:18.521 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 77.5, 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:37:18.522 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:37:18.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 -- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0e00b2a70 msgr2=0x7fa0e00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:18.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0e00b2a70 0x7fa0e00b4f30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc19cb60 tx=0x7fa0ec00a380 comp rx=0 tx=0).stop 2024-05-08T07:37:18.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 -- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06bb40 msgr2=0x7fa0fc1a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:37:18.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06bb40 0x7fa0fc1a1da0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8005910 tx=0x7fa0e80047b0 comp rx=0 tx=0).stop 2024-05-08T07:37:18.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 -- 172.21.15.70:0/266598261 shutdown_connections 2024-05-08T07:37:18.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0e00b2a70 0x7fa0e00b4f30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:18.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0fc109510 0x7fa0fc19ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:18.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa0fc06b180 0x7fa0fc1a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:18.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 --2- 172.21.15.70:0/266598261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0fc06bb40 0x7fa0fc1a1da0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:37:18.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.524+0000 7fa103000700 1 -- 172.21.15.70:0/266598261 >> 172.21.15.70:0/266598261 conn(0x7fa0fc079350 msgr2=0x7fa0fc10e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:37:18.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.525+0000 7fa103000700 1 -- 172.21.15.70:0/266598261 shutdown_connections 2024-05-08T07:37:18.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:37:18.525+0000 7fa103000700 1 -- 172.21.15.70:0/266598261 wait complete. 2024-05-08T07:37:19.486 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/hibernate.o 2024-05-08T07:37:19.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:19 smithi194 ceph-mon[33679]: pgmap v1612: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:37:19.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:19 smithi194 ceph-mon[33679]: osdmap e181: 12 total, 12 up, 12 in 2024-05-08T07:37:19.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:19 smithi070 ceph-mon[29591]: pgmap v1612: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:37:19.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:19 smithi070 ceph-mon[29591]: osdmap e181: 12 total, 12 up, 12 in 2024-05-08T07:37:19.669 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c4a151a9', seconds elapsed: 65.9 2024-05-08T07:37:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:19 smithi172 ceph-mon[33377]: pgmap v1612: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:37:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:19 smithi172 ceph-mon[33377]: osdmap e181: 12 total, 12 up, 12 in 2024-05-08T07:37:19.683 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/task_mmu.o 2024-05-08T07:37:20.124 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/printk/printk_safe.o 2024-05-08T07:37:20.397 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/signature.o 2024-05-08T07:37:20.603 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/manage.o 2024-05-08T07:37:20.769 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/process_keys.o 2024-05-08T07:37:20.986 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/percpu.o 2024-05-08T07:37:21.041 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/uncore_snbep.o 2024-05-08T07:37:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:21 smithi194 ceph-mon[33679]: pgmap v1614: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.3 KiB/s wr, 8 op/s 2024-05-08T07:37:21.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:21 smithi070 ceph-mon[29591]: pgmap v1614: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.3 KiB/s wr, 8 op/s 2024-05-08T07:37:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:21 smithi172 ceph-mon[33377]: pgmap v1614: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6.3 KiB/s wr, 8 op/s 2024-05-08T07:37:23.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:23 smithi070 ceph-mon[29591]: pgmap v1615: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 128 KiB/s wr, 15 op/s 2024-05-08T07:37:23.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:23 smithi172 ceph-mon[33377]: pgmap v1615: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 128 KiB/s wr, 15 op/s 2024-05-08T07:37:23.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:23 smithi194 ceph-mon[33679]: pgmap v1615: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 128 KiB/s wr, 15 op/s 2024-05-08T07:37:25.561 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:25 smithi194 ceph-mon[33679]: pgmap v1616: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 197 KiB/s wr, 24 op/s 2024-05-08T07:37:25.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:25 smithi070 ceph-mon[29591]: pgmap v1616: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 197 KiB/s wr, 24 op/s 2024-05-08T07:37:25.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:25 smithi172 ceph-mon[33377]: pgmap v1616: 129 pgs: 129 active+clean; 1.8 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 197 KiB/s wr, 24 op/s 2024-05-08T07:37:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:27 smithi070 ceph-mon[29591]: pgmap v1617: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 235 KiB/s wr, 119 op/s 2024-05-08T07:37:27.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:27 smithi172 ceph-mon[33377]: pgmap v1617: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 235 KiB/s wr, 119 op/s 2024-05-08T07:37:27.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:27 smithi194 ceph-mon[33679]: pgmap v1617: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 235 KiB/s wr, 119 op/s 2024-05-08T07:37:27.781 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/public_key.o 2024-05-08T07:37:28.450 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/printk/printk_ringbuffer.o 2024-05-08T07:37:28.577 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/spurious.o 2024-05-08T07:37:29.362 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/inode.o 2024-05-08T07:37:29.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:29 smithi070 ceph-mon[29591]: pgmap v1618: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 235 KiB/s wr, 119 op/s 2024-05-08T07:37:29.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:29 smithi172 ceph-mon[33377]: pgmap v1618: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 235 KiB/s wr, 119 op/s 2024-05-08T07:37:29.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:29 smithi194 ceph-mon[33679]: pgmap v1618: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 235 KiB/s wr, 119 op/s 2024-05-08T07:37:31.034 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/snapshot.o 2024-05-08T07:37:31.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:31 smithi070 ceph-mon[29591]: pgmap v1619: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 317 KiB/s wr, 107 op/s 2024-05-08T07:37:31.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:31 smithi172 ceph-mon[33377]: pgmap v1619: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 317 KiB/s wr, 107 op/s 2024-05-08T07:37:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:31 smithi194 ceph-mon[33679]: pgmap v1619: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 317 KiB/s wr, 107 op/s 2024-05-08T07:37:32.287 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/request_key.o 2024-05-08T07:37:32.389 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/uncore_discovery.o 2024-05-08T07:37:32.651 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/slab_common.o 2024-05-08T07:37:33.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:33 smithi070 ceph-mon[29591]: pgmap v1620: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 333 KiB/s wr, 108 op/s 2024-05-08T07:37:33.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:33 smithi172 ceph-mon[33377]: pgmap v1620: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 333 KiB/s wr, 108 op/s 2024-05-08T07:37:33.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:33 smithi194 ceph-mon[33679]: pgmap v1620: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 333 KiB/s wr, 108 op/s 2024-05-08T07:37:34.117 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/printk/sysctl.o 2024-05-08T07:37:35.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:35 smithi070 ceph-mon[29591]: pgmap v1621: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 315 KiB/s wr, 105 op/s 2024-05-08T07:37:35.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:35 smithi172 ceph-mon[33377]: pgmap v1621: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 315 KiB/s wr, 105 op/s 2024-05-08T07:37:35.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:35 smithi194 ceph-mon[33679]: pgmap v1621: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 315 KiB/s wr, 105 op/s 2024-05-08T07:37:35.922 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/resend.o 2024-05-08T07:37:36.491 INFO:tasks.workunit.client.0.smithi070.stdout: ASN.1 crypto/asymmetric_keys/x509.asn1.[ch] 2024-05-08T07:37:36.593 INFO:tasks.workunit.client.0.smithi070.stdout: ASN.1 crypto/asymmetric_keys/x509_akid.asn1.[ch] 2024-05-08T07:37:36.663 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/x509_loader.o 2024-05-08T07:37:37.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:37 smithi070 ceph-mon[29591]: pgmap v1622: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 310 KiB/s wr, 104 op/s 2024-05-08T07:37:37.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:37 smithi172 ceph-mon[33377]: pgmap v1622: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 310 KiB/s wr, 104 op/s 2024-05-08T07:37:37.714 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/root.o 2024-05-08T07:37:37.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:37 smithi194 ceph-mon[33679]: pgmap v1622: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 310 KiB/s wr, 104 op/s 2024-05-08T07:37:39.145 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/printk/built-in.a 2024-05-08T07:37:39.429 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/compaction.o 2024-05-08T07:37:39.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:39 smithi070 ceph-mon[29591]: pgmap v1623: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 277 KiB/s wr, 23 op/s 2024-05-08T07:37:39.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:39 smithi172 ceph-mon[33377]: pgmap v1623: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 277 KiB/s wr, 23 op/s 2024-05-08T07:37:39.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:39 smithi194 ceph-mon[33679]: pgmap v1623: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 277 KiB/s wr, 23 op/s 2024-05-08T07:37:40.920 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/x509_public_key.o 2024-05-08T07:37:41.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:41 smithi070 ceph-mon[29591]: pgmap v1624: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 353 KiB/s wr, 37 op/s 2024-05-08T07:37:41.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:41 smithi172 ceph-mon[33377]: pgmap v1624: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 353 KiB/s wr, 37 op/s 2024-05-08T07:37:41.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:41 smithi194 ceph-mon[33679]: pgmap v1624: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 353 KiB/s wr, 37 op/s 2024-05-08T07:37:42.626 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/swap.o 2024-05-08T07:37:42.802 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/request_key_auth.o 2024-05-08T07:37:42.817 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/intel/cstate.o 2024-05-08T07:37:43.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:43 smithi070 ceph-mon[29591]: pgmap v1625: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 250 KiB/s wr, 57 op/s 2024-05-08T07:37:43.654 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/chip.o 2024-05-08T07:37:43.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:43 smithi172 ceph-mon[33377]: pgmap v1625: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 250 KiB/s wr, 57 op/s 2024-05-08T07:37:43.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:43 smithi194 ceph-mon[33679]: pgmap v1625: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 250 KiB/s wr, 57 op/s 2024-05-08T07:37:43.943 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/dummychip.o 2024-05-08T07:37:45.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:45 smithi070 ceph-mon[29591]: pgmap v1626: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 291 KiB/s wr, 85 op/s 2024-05-08T07:37:45.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:45 smithi172 ceph-mon[33377]: pgmap v1626: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 291 KiB/s wr, 85 op/s 2024-05-08T07:37:45.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:45 smithi194 ceph-mon[33679]: pgmap v1626: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 291 KiB/s wr, 85 op/s 2024-05-08T07:37:46.489 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/base.o 2024-05-08T07:37:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:47 smithi070 ceph-mon[29591]: pgmap v1627: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 390 KiB/s wr, 217 op/s 2024-05-08T07:37:47.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:47 smithi172 ceph-mon[33377]: pgmap v1627: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 390 KiB/s wr, 217 op/s 2024-05-08T07:37:47.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:47 smithi194 ceph-mon[33679]: pgmap v1627: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 390 KiB/s wr, 217 op/s 2024-05-08T07:37:49.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:49 smithi070 ceph-mon[29591]: pgmap v1628: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 339 KiB/s wr, 209 op/s 2024-05-08T07:37:49.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:49 smithi172 ceph-mon[33377]: pgmap v1628: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 339 KiB/s wr, 209 op/s 2024-05-08T07:37:49.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:49 smithi194 ceph-mon[33679]: pgmap v1628: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 339 KiB/s wr, 209 op/s 2024-05-08T07:37:49.775 INFO:tasks.workunit.client.0.smithi070.stdout: ASN.1 crypto/asymmetric_keys/pkcs7.asn1.[ch] 2024-05-08T07:37:49.904 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/pkcs7_trust.o 2024-05-08T07:37:50.826 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/user_defined.o 2024-05-08T07:37:50.837 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/show_mem.o 2024-05-08T07:37:51.301 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/devres.o 2024-05-08T07:37:51.611 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/autoprobe.o 2024-05-08T07:37:51.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:51 smithi070 ceph-mon[29591]: pgmap v1629: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 349 KiB/s wr, 214 op/s 2024-05-08T07:37:51.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:51 smithi172 ceph-mon[33377]: pgmap v1629: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 349 KiB/s wr, 214 op/s 2024-05-08T07:37:51.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:51 smithi194 ceph-mon[33679]: pgmap v1629: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 349 KiB/s wr, 214 op/s 2024-05-08T07:37:52.352 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/events/intel/built-in.a 2024-05-08T07:37:52.505 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/user.o 2024-05-08T07:37:53.475 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/zhaoxin/core.o 2024-05-08T07:37:53.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:53 smithi070 ceph-mon[29591]: pgmap v1630: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 394 KiB/s wr, 206 op/s 2024-05-08T07:37:53.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:53 smithi172 ceph-mon[33377]: pgmap v1630: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 394 KiB/s wr, 206 op/s 2024-05-08T07:37:53.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:53 smithi194 ceph-mon[33679]: pgmap v1630: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 394 KiB/s wr, 206 op/s 2024-05-08T07:37:55.011 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/pkcs7_verify.o 2024-05-08T07:37:55.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:55 smithi070 ceph-mon[29591]: pgmap v1631: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 382 KiB/s wr, 182 op/s 2024-05-08T07:37:55.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:55 smithi172 ceph-mon[33377]: pgmap v1631: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 382 KiB/s wr, 182 op/s 2024-05-08T07:37:55.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:55 smithi194 ceph-mon[33679]: pgmap v1631: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 382 KiB/s wr, 182 op/s 2024-05-08T07:37:57.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:57 smithi070 ceph-mon[29591]: pgmap v1632: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 464 KiB/s wr, 162 op/s 2024-05-08T07:37:57.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:57 smithi172 ceph-mon[33377]: pgmap v1632: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 464 KiB/s wr, 162 op/s 2024-05-08T07:37:57.756 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/generic.o 2024-05-08T07:37:57.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:57 smithi194 ceph-mon[33679]: pgmap v1632: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 464 KiB/s wr, 162 op/s 2024-05-08T07:37:58.871 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/array.o 2024-05-08T07:37:59.085 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/irqdomain.o 2024-05-08T07:37:59.238 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/compat.o 2024-05-08T07:37:59.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:37:59 smithi070 ceph-mon[29591]: pgmap v1633: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 280 KiB/s wr, 26 op/s 2024-05-08T07:37:59.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:37:59 smithi172 ceph-mon[33377]: pgmap v1633: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 280 KiB/s wr, 26 op/s 2024-05-08T07:37:59.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:37:59 smithi194 ceph-mon[33679]: pgmap v1633: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 280 KiB/s wr, 26 op/s 2024-05-08T07:38:01.499 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/interval_tree.o 2024-05-08T07:38:01.553 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/x509.asn1.o 2024-05-08T07:38:01.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:01 smithi070 ceph-mon[29591]: pgmap v1634: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 434 KiB/s wr, 129 op/s 2024-05-08T07:38:01.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:01 smithi172 ceph-mon[33377]: pgmap v1634: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 434 KiB/s wr, 129 op/s 2024-05-08T07:38:01.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:01 smithi194 ceph-mon[33679]: pgmap v1634: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 434 KiB/s wr, 129 op/s 2024-05-08T07:38:03.033 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/power/poweroff.o 2024-05-08T07:38:03.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:03 smithi070 ceph-mon[29591]: pgmap v1635: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 481 KiB/s wr, 189 op/s 2024-05-08T07:38:03.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:03 smithi172 ceph-mon[33377]: pgmap v1635: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 481 KiB/s wr, 189 op/s 2024-05-08T07:38:03.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:03 smithi194 ceph-mon[33679]: pgmap v1635: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 481 KiB/s wr, 189 op/s 2024-05-08T07:38:03.972 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/x509_akid.asn1.o 2024-05-08T07:38:04.583 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/x509_cert_parser.o 2024-05-08T07:38:05.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:05 smithi070 ceph-mon[29591]: pgmap v1636: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 360 KiB/s wr, 184 op/s 2024-05-08T07:38:05.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:05 smithi070 ceph-mon[29591]: osdmap e182: 12 total, 12 up, 12 in 2024-05-08T07:38:05.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:05 smithi172 ceph-mon[33377]: pgmap v1636: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 360 KiB/s wr, 184 op/s 2024-05-08T07:38:05.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:05 smithi172 ceph-mon[33377]: osdmap e182: 12 total, 12 up, 12 in 2024-05-08T07:38:05.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:05 smithi194 ceph-mon[33679]: pgmap v1636: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 360 KiB/s wr, 184 op/s 2024-05-08T07:38:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:05 smithi194 ceph-mon[33679]: osdmap e182: 12 total, 12 up, 12 in 2024-05-08T07:38:05.806 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/events/zhaoxin/built-in.a 2024-05-08T07:38:06.029 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/core.o 2024-05-08T07:38:06.879 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/proc.o 2024-05-08T07:38:07.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:07 smithi070 ceph-mon[29591]: pgmap v1638: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 422 KiB/s wr, 219 op/s 2024-05-08T07:38:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:07 smithi172 ceph-mon[33377]: pgmap v1638: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 422 KiB/s wr, 219 op/s 2024-05-08T07:38:07.748 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/power/built-in.a 2024-05-08T07:38:07.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:07 smithi194 ceph-mon[33679]: pgmap v1638: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 422 KiB/s wr, 219 op/s 2024-05-08T07:38:08.490 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/probe.o 2024-05-08T07:38:09.111 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/proc.o 2024-05-08T07:38:09.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:09 smithi172 ceph-mon[33377]: pgmap v1639: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 422 KiB/s wr, 219 op/s 2024-05-08T07:38:09.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:38:09.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:09 smithi194 ceph-mon[33679]: pgmap v1639: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 422 KiB/s wr, 219 op/s 2024-05-08T07:38:09.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:38:09.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:09 smithi070 ceph-mon[29591]: pgmap v1639: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 422 KiB/s wr, 219 op/s 2024-05-08T07:38:09.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:38:10.159 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/pkcs7.asn1.o 2024-05-08T07:38:10.398 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/rcu/update.o 2024-05-08T07:38:10.659 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/fd.o 2024-05-08T07:38:11.018 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/list_lru.o 2024-05-08T07:38:11.183 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/asymmetric_keys/pkcs7_parser.o 2024-05-08T07:38:11.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:11 smithi172 ceph-mon[33377]: pgmap v1640: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 381 KiB/s wr, 108 op/s 2024-05-08T07:38:11.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:38:11.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:38:11.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:38:11.678 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:11 smithi070 ceph-mon[29591]: pgmap v1640: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 381 KiB/s wr, 108 op/s 2024-05-08T07:38:11.678 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:38:11.678 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:38:11.678 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:38:11.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:11 smithi194 ceph-mon[33679]: pgmap v1640: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 381 KiB/s wr, 108 op/s 2024-05-08T07:38:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:38:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:38:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:38:13.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:13 smithi172 ceph-mon[33377]: pgmap v1641: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 334 KiB/s wr, 42 op/s 2024-05-08T07:38:13.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:13 smithi172 ceph-mon[33377]: osdmap e183: 12 total, 12 up, 12 in 2024-05-08T07:38:13.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:13 smithi194 ceph-mon[33679]: pgmap v1641: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 334 KiB/s wr, 42 op/s 2024-05-08T07:38:13.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:13 smithi194 ceph-mon[33679]: osdmap e183: 12 total, 12 up, 12 in 2024-05-08T07:38:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:13 smithi070 ceph-mon[29591]: pgmap v1641: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 334 KiB/s wr, 42 op/s 2024-05-08T07:38:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:13 smithi070 ceph-mon[29591]: osdmap e183: 12 total, 12 up, 12 in 2024-05-08T07:38:15.104 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/livepatch/built-in.a 2024-05-08T07:38:15.482 INFO:tasks.workunit.client.0.smithi070.stdout: GEN security/selinux/flask.h security/selinux/av_permissions.h 2024-05-08T07:38:15.525 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/sysctl.o 2024-05-08T07:38:15.574 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/avc.o 2024-05-08T07:38:15.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:15 smithi172 ceph-mon[33377]: pgmap v1643: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 212 KiB/s wr, 53 op/s 2024-05-08T07:38:15.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:15 smithi194 ceph-mon[33679]: pgmap v1643: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 212 KiB/s wr, 53 op/s 2024-05-08T07:38:15.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:15 smithi070 ceph-mon[29591]: pgmap v1643: 129 pgs: 129 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 212 KiB/s wr, 53 op/s 2024-05-08T07:38:17.407 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/utils.o 2024-05-08T07:38:17.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:17 smithi172 ceph-mon[33377]: pgmap v1644: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 455 KiB/s wr, 176 op/s 2024-05-08T07:38:17.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:17 smithi194 ceph-mon[33679]: pgmap v1644: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 455 KiB/s wr, 176 op/s 2024-05-08T07:38:17.822 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/migration.o 2024-05-08T07:38:17.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:17 smithi070 ceph-mon[29591]: pgmap v1644: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 455 KiB/s wr, 176 op/s 2024-05-08T07:38:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:19 smithi172 ceph-mon[33377]: pgmap v1645: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 455 KiB/s wr, 176 op/s 2024-05-08T07:38:19.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:19 smithi194 ceph-mon[33679]: pgmap v1645: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 455 KiB/s wr, 176 op/s 2024-05-08T07:38:19.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:19 smithi070 ceph-mon[29591]: pgmap v1645: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 455 KiB/s wr, 176 op/s 2024-05-08T07:38:20.313 INFO:tasks.workunit.client.0.smithi070.stdout: AR crypto/asymmetric_keys/built-in.a 2024-05-08T07:38:20.333 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/proc_tty.o 2024-05-08T07:38:20.541 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/workingset.o 2024-05-08T07:38:21.004 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/api.o 2024-05-08T07:38:21.559 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/rcu/sync.o 2024-05-08T07:38:21.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:21 smithi172 ceph-mon[33377]: pgmap v1646: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 350 KiB/s wr, 172 op/s 2024-05-08T07:38:21.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:21 smithi194 ceph-mon[33679]: pgmap v1646: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 350 KiB/s wr, 172 op/s 2024-05-08T07:38:21.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:21 smithi070 ceph-mon[29591]: pgmap v1646: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 350 KiB/s wr, 172 op/s 2024-05-08T07:38:23.066 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/keys/keyctl_pkey.o 2024-05-08T07:38:23.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:23 smithi172 ceph-mon[33377]: pgmap v1647: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 492 KiB/s wr, 167 op/s 2024-05-08T07:38:23.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:23 smithi194 ceph-mon[33679]: pgmap v1647: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 492 KiB/s wr, 167 op/s 2024-05-08T07:38:23.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:23 smithi070 ceph-mon[29591]: pgmap v1647: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 492 KiB/s wr, 167 op/s 2024-05-08T07:38:24.482 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/cpuhotplug.o 2024-05-08T07:38:24.856 INFO:tasks.quiescer.fs.[cephfs]:Total duration (58.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T07:38:24.856 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.0 2024-05-08T07:38:24.857 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:38:25.532 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:38:25.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:25 smithi172 ceph-mon[33377]: pgmap v1648: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 460 KiB/s wr, 153 op/s 2024-05-08T07:38:25.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:25 smithi070 ceph-mon[29591]: pgmap v1648: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 460 KiB/s wr, 153 op/s 2024-05-08T07:38:25.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:25 smithi194 ceph-mon[33679]: pgmap v1648: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 460 KiB/s wr, 153 op/s 2024-05-08T07:38:26.675 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/rapl.o 2024-05-08T07:38:27.134 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/rcu/srcutree.o 2024-05-08T07:38:27.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:27 smithi172 ceph-mon[33377]: pgmap v1649: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 526 KiB/s wr, 160 op/s 2024-05-08T07:38:27.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:27 smithi194 ceph-mon[33679]: pgmap v1649: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 526 KiB/s wr, 160 op/s 2024-05-08T07:38:27.832 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:27 smithi070 ceph-mon[29591]: pgmap v1649: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 526 KiB/s wr, 160 op/s 2024-05-08T07:38:28.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.752+0000 7fe3a1600700 1 -- 172.21.15.70:0/1643352646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe39c103550 msgr2=0x7fe39c1039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:28.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.752+0000 7fe3a1600700 1 --2- 172.21.15.70:0/1643352646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe39c103550 0x7fe39c1039b0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fe388009990 tx=0x7fe388009ca0 comp rx=0 tx=0).stop 2024-05-08T07:38:28.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.753+0000 7fe3a1600700 1 -- 172.21.15.70:0/1643352646 shutdown_connections 2024-05-08T07:38:28.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.753+0000 7fe3a1600700 1 --2- 172.21.15.70:0/1643352646 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe39c103ef0 0x7fe39c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:28.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.753+0000 7fe3a1600700 1 --2- 172.21.15.70:0/1643352646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c108460 0x7fe39c108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:28.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.753+0000 7fe3a1600700 1 --2- 172.21.15.70:0/1643352646 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe39c103550 0x7fe39c1039b0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:28.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.753+0000 7fe3a1600700 1 -- 172.21.15.70:0/1643352646 >> 172.21.15.70:0/1643352646 conn(0x7fe39c07a600 msgr2=0x7fe39c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:38:28.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.753+0000 7fe3a1600700 1 -- 172.21.15.70:0/1643352646 shutdown_connections 2024-05-08T07:38:28.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.753+0000 7fe3a1600700 1 -- 172.21.15.70:0/1643352646 wait complete. 2024-05-08T07:38:28.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.754+0000 7fe3a1600700 1 Processor -- start 2024-05-08T07:38:28.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.754+0000 7fe3a1600700 1 -- start start 2024-05-08T07:38:28.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.755+0000 7fe3a1600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe39c103550 0x7fe39c10fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:28.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.755+0000 7fe3a1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe39c103ef0 0x7fe39c10bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.755+0000 7fe3a1600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c108460 0x7fe39c10c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.755+0000 7fe3a1600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c075ce0 con 0x7fe39c103ef0 2024-05-08T07:38:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.755+0000 7fe3a1600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c075b60 con 0x7fe39c103550 2024-05-08T07:38:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.755+0000 7fe3a1600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe39c075e60 con 0x7fe39c108460 2024-05-08T07:38:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.755+0000 7fe39aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe39c103550 0x7fe39c10fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.756+0000 7fe39a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe39c103ef0 0x7fe39c10bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.756+0000 7fe39aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe39c103550 0x7fe39c10fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:33720/0 (socket says 172.21.15.70:33720) 2024-05-08T07:38:28.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.756+0000 7fe39aa00700 1 -- 172.21.15.70:0/2730854302 learned_addr learned my addr 172.21.15.70:0/2730854302 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:38:28.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.756+0000 7fe39a000700 1 -- 172.21.15.70:0/2730854302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c108460 msgr2=0x7fe39c10c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:28.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.756+0000 7fe39a000700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c108460 0x7fe39c10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:28.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.756+0000 7fe39a000700 1 -- 172.21.15.70:0/2730854302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe39c103550 msgr2=0x7fe39c10fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:28.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.756+0000 7fe39a000700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe39c103550 0x7fe39c10fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:28.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.756+0000 7fe39a000700 1 -- 172.21.15.70:0/2730854302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39c10ca80 con 0x7fe39c103ef0 2024-05-08T07:38:28.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.757+0000 7fe39a000700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe39c103ef0 0x7fe39c10bf80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fe3880098e0 tx=0x7fe3880057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:38:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.757+0000 7fe393400700 1 -- 172.21.15.70:0/2730854302 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388026070 con 0x7fe39c103ef0 2024-05-08T07:38:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.757+0000 7fe393400700 1 -- 172.21.15.70:0/2730854302 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe38800fb00 con 0x7fe39c103ef0 2024-05-08T07:38:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.757+0000 7fe393400700 1 -- 172.21.15.70:0/2730854302 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388021ba0 con 0x7fe39c103ef0 2024-05-08T07:38:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.757+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39c10cd10 con 0x7fe39c103ef0 2024-05-08T07:38:28.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.757+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39c1acad0 con 0x7fe39c103ef0 2024-05-08T07:38:28.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.758+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe39c107f50 con 0x7fe39c103ef0 2024-05-08T07:38:28.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.762+0000 7fe393400700 1 -- 172.21.15.70:0/2730854302 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe388029070 con 0x7fe39c103ef0 2024-05-08T07:38:28.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.764+0000 7fe393400700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3800b2a70 0x7fe3800b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:28.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.764+0000 7fe393400700 1 -- 172.21.15.70:0/2730854302 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 9583+0+0 (secure 0 0 0) 0x7fe3880e3790 con 0x7fe39c103ef0 2024-05-08T07:38:28.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.765+0000 7fe39aa00700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3800b2a70 0x7fe3800b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:28.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.766+0000 7fe39aa00700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3800b2a70 0x7fe3800b4f30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe38c007bf0 tx=0x7fe38c007480 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:38:28.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:28.769+0000 7fe393400700 1 -- 172.21.15.70:0/2730854302 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe388030080 con 0x7fe39c103ef0 2024-05-08T07:38:29.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.218+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe39c06a190 con 0x7fe39c103ef0 2024-05-08T07:38:29.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.219+0000 7fe393400700 1 -- 172.21.15.70:0/2730854302 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fe388013070 con 0x7fe39c103ef0 2024-05-08T07:38:29.217 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:38:29.217 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:38:29.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3800b2a70 msgr2=0x7fe3800b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:29.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3800b2a70 0x7fe3800b4f30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe38c007bf0 tx=0x7fe38c007480 comp rx=0 tx=0).stop 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe39c103ef0 msgr2=0x7fe39c10bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe39c103ef0 0x7fe39c10bf80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fe3880098e0 tx=0x7fe3880057c0 comp rx=0 tx=0).stop 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 shutdown_connections 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3800b2a70 0x7fe3800b4f30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c108460 0x7fe39c10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe39c103550 0x7fe39c10fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 --2- 172.21.15.70:0/2730854302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe39c103ef0 0x7fe39c10bf80 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 >> 172.21.15.70:0/2730854302 conn(0x7fe39c07a600 msgr2=0x7fe39c105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 shutdown_connections 2024-05-08T07:38:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:29.223+0000 7fe3a1600700 1 -- 172.21.15.70:0/2730854302 wait complete. 2024-05-08T07:38:29.222 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:38:29.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:29 smithi070 ceph-mon[29591]: pgmap v1650: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 299 KiB/s wr, 50 op/s 2024-05-08T07:38:29.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:29 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2730854302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:38:29.654 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/cmdline.o 2024-05-08T07:38:29.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:29 smithi194 ceph-mon[33679]: pgmap v1650: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 299 KiB/s wr, 50 op/s 2024-05-08T07:38:29.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:29 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2730854302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:38:29.767 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/cipher.o 2024-05-08T07:38:29.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:29 smithi172 ceph-mon[33377]: pgmap v1650: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 299 KiB/s wr, 50 op/s 2024-05-08T07:38:29.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:29 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2730854302' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:38:29.955 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/hooks.o 2024-05-08T07:38:30.017 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 89.0 --await-for 42.0' 2024-05-08T07:38:30.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 89.0 --await-for 42.0 2024-05-08T07:38:30.302 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/debug.o 2024-05-08T07:38:30.589 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:38:31.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:31 smithi070 ceph-mon[29591]: pgmap v1651: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 447 KiB/s wr, 161 op/s 2024-05-08T07:38:31.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:31 smithi194 ceph-mon[33679]: pgmap v1651: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 447 KiB/s wr, 161 op/s 2024-05-08T07:38:31.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:31 smithi172 ceph-mon[33377]: pgmap v1651: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 447 KiB/s wr, 161 op/s 2024-05-08T07:38:32.693 INFO:tasks.workunit.client.0.smithi070.stdout: AR security/keys/built-in.a 2024-05-08T07:38:33.231 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/pm.o 2024-05-08T07:38:33.469 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/selinuxfs.o 2024-05-08T07:38:33.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:33 smithi194 ceph-mon[33679]: pgmap v1652: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 445 KiB/s wr, 190 op/s 2024-05-08T07:38:33.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:33 smithi070 ceph-mon[29591]: pgmap v1652: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 445 KiB/s wr, 190 op/s 2024-05-08T07:38:33.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.875+0000 7f776b200700 1 -- 172.21.15.70:0/2310572779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7764106090 msgr2=0x7f77641125a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:33.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.875+0000 7f776b200700 1 --2- 172.21.15.70:0/2310572779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7764106090 0x7f77641125a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f775c00b0a0 tx=0x7f775c00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.875+0000 7f776b200700 1 -- 172.21.15.70:0/2310572779 shutdown_connections 2024-05-08T07:38:33.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.875+0000 7f776b200700 1 --2- 172.21.15.70:0/2310572779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7764106090 0x7f77641125a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.875+0000 7f776b200700 1 --2- 172.21.15.70:0/2310572779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f776410b6d0 0x7f776410bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.875+0000 7f776b200700 1 --2- 172.21.15.70:0/2310572779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77641056d0 0x7f7764105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.875+0000 7f776b200700 1 -- 172.21.15.70:0/2310572779 >> 172.21.15.70:0/2310572779 conn(0x7f77641011a0 msgr2=0x7f77641035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:38:33.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.876+0000 7f776b200700 1 -- 172.21.15.70:0/2310572779 shutdown_connections 2024-05-08T07:38:33.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.876+0000 7f776b200700 1 -- 172.21.15.70:0/2310572779 wait complete. 2024-05-08T07:38:33.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.877+0000 7f776b200700 1 Processor -- start 2024-05-08T07:38:33.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.877+0000 7f776b200700 1 -- start start 2024-05-08T07:38:33.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f776b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77641056d0 0x7f77641a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f776b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7764106090 0x7f77641a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f776b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f776410b6d0 0x7f776419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f776b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7764115810 con 0x7f776410b6d0 2024-05-08T07:38:33.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f776b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7764115690 con 0x7f77641056d0 2024-05-08T07:38:33.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f776b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7764115990 con 0x7f7764106090 2024-05-08T07:38:33.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f7763e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77641056d0 0x7f77641a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f7769200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f776410b6d0 0x7f776419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f7763e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77641056d0 0x7f77641a1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:33734/0 (socket says 172.21.15.70:33734) 2024-05-08T07:38:33.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.878+0000 7f7763e00700 1 -- 172.21.15.70:0/1235479745 learned_addr learned my addr 172.21.15.70:0/1235479745 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:38:33.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.879+0000 7f7763400700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7764106090 0x7f77641a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.879+0000 7f7769200700 1 -- 172.21.15.70:0/1235479745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7764106090 msgr2=0x7f77641a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:33.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.879+0000 7f7769200700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7764106090 0x7f77641a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.879+0000 7f7769200700 1 -- 172.21.15.70:0/1235479745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77641056d0 msgr2=0x7f77641a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:33.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.879+0000 7f7769200700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77641056d0 0x7f77641a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.879+0000 7f7769200700 1 -- 172.21.15.70:0/1235479745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776419c190 con 0x7f776410b6d0 2024-05-08T07:38:33.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.879+0000 7f7763400700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7764106090 0x7f77641a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:38:33.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.879+0000 7f7763e00700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77641056d0 0x7f77641a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:38:33.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.880+0000 7f7769200700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f776410b6d0 0x7f776419ba30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f775c00b070 tx=0x7f775c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:38:33.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.880+0000 7f7760c00700 1 -- 172.21.15.70:0/1235479745 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c021070 con 0x7f776410b6d0 2024-05-08T07:38:33.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.880+0000 7f7760c00700 1 -- 172.21.15.70:0/1235479745 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f775c007b80 con 0x7f776410b6d0 2024-05-08T07:38:33.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.880+0000 7f776b200700 1 -- 172.21.15.70:0/1235479745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f776419c420 con 0x7f776410b6d0 2024-05-08T07:38:33.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.880+0000 7f7760c00700 1 -- 172.21.15.70:0/1235479745 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c005040 con 0x7f776410b6d0 2024-05-08T07:38:33.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.880+0000 7f776b200700 1 -- 172.21.15.70:0/1235479745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77640778e0 con 0x7f776410b6d0 2024-05-08T07:38:33.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.886+0000 7f7760c00700 1 -- 172.21.15.70:0/1235479745 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f775c024070 con 0x7f776410b6d0 2024-05-08T07:38:33.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.888+0000 7f7760c00700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77480b2b20 0x7f77480b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.888+0000 7f7760c00700 1 -- 172.21.15.70:0/1235479745 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 9583+0+0 (secure 0 0 0) 0x7f775c00f020 con 0x7f776410b6d0 2024-05-08T07:38:33.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.888+0000 7f7763e00700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77480b2b20 0x7f77480b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.889+0000 7f7763e00700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77480b2b20 0x7f77480b4fe0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f776419cb70 tx=0x7f7754009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:38:33.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:33 smithi172 ceph-mon[33377]: pgmap v1652: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 445 KiB/s wr, 190 op/s 2024-05-08T07:38:33.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.953+0000 7f7775ac1b80 1 Processor -- start 2024-05-08T07:38:33.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.953+0000 7f7775ac1b80 1 -- start start 2024-05-08T07:38:33.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.954+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549b93620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.954+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 0x55f549b8dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.954+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b9a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.954+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f549adfbb0 con 0x55f549b8e1d0 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.954+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f549a7d8f0 con 0x55f549b93240 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.954+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f549adbb70 con 0x55f549b8d810 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.954+0000 7f7769200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b9a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.954+0000 7f7769200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b9a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38008/0 (socket says 172.21.15.70:38008) 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.954+0000 7f7769200700 1 -- 172.21.15.70:0/3554283700 learned_addr learned my addr 172.21.15.70:0/3554283700 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.955+0000 7f7769200700 1 -- 172.21.15.70:0/3554283700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 msgr2=0x55f549b8dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.955+0000 7f7769200700 1 --2- 172.21.15.70:0/3554283700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 0x55f549b8dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.955+0000 7f7763e00700 1 --2- 172.21.15.70:0/3554283700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549b93620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.955+0000 7f7769200700 1 -- 172.21.15.70:0/3554283700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 msgr2=0x55f549b93620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.955+0000 7f7769200700 1 --2- 172.21.15.70:0/3554283700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549b93620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.955+0000 7f7769200700 1 -- 172.21.15.70:0/3554283700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f549a2ca60 con 0x55f549b8e1d0 2024-05-08T07:38:33.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.955+0000 7f7763e00700 1 --2- 172.21.15.70:0/3554283700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549b93620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:38:33.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.955+0000 7f7769200700 1 --2- 172.21.15.70:0/3554283700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b9a000 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f775c0a6da0 tx=0x7f775c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c198a08d10638bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:38:33.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.956+0000 7f7759600700 1 -- 172.21.15.70:0/3554283700 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c0af0d0 con 0x55f549b8e1d0 2024-05-08T07:38:33.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.956+0000 7f7759600700 1 -- 172.21.15.70:0/3554283700 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f775c0b3af0 con 0x55f549b8e1d0 2024-05-08T07:38:33.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.956+0000 7f7759600700 1 -- 172.21.15.70:0/3554283700 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c0aaf80 con 0x55f549b8e1d0 2024-05-08T07:38:33.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.957+0000 7f7775ac1b80 1 -- 172.21.15.70:0/3554283700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 msgr2=0x55f549b9a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:33.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.957+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/3554283700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b9a000 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f775c0a6da0 tx=0x7f775c00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.957+0000 7f7775ac1b80 1 -- 172.21.15.70:0/3554283700 shutdown_connections 2024-05-08T07:38:33.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.957+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/3554283700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b9a000 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.957+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/3554283700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549b93620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.957+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/3554283700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 0x55f549b8dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.957+0000 7f7775ac1b80 1 -- 172.21.15.70:0/3554283700 >> 172.21.15.70:0/3554283700 conn(0x55f549b05860 msgr2=0x55f549b88100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:38:33.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.957+0000 7f7775ac1b80 1 -- 172.21.15.70:0/3554283700 shutdown_connections 2024-05-08T07:38:33.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.957+0000 7f7775ac1b80 1 -- 172.21.15.70:0/3554283700 wait complete. 2024-05-08T07:38:33.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.958+0000 7f7775ac1b80 1 -- start start 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.958+0000 7f7775ac1b80 1 Processor -- start 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 0x55f549b99c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8e1d0 0x55f549b97000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b93240 0x55f549b97540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f549b93d50 con 0x55f549b93240 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f549a45cb0 con 0x55f549b8d810 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f549b9a540 con 0x55f549b8e1d0 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7775ac1b80 10 client.0 _ll_register_callbacks cb 0x55f549a86e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7769200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b93240 0x55f549b97540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7763e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 0x55f549b99c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7763e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 0x55f549b99c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:33746/0 (socket says 172.21.15.70:33746) 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7769200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b93240 0x55f549b97540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38012/0 (socket says 172.21.15.70:38012) 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.959+0000 7f7763e00700 1 -- 172.21.15.70:0/2719170095 learned_addr learned my addr 172.21.15.70:0/2719170095 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.960+0000 7f7763400700 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8e1d0 0x55f549b97000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.960+0000 7f7769200700 1 -- 172.21.15.70:0/2719170095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8e1d0 msgr2=0x55f549b97000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.960+0000 7f7769200700 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8e1d0 0x55f549b97000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.960+0000 7f7769200700 1 -- 172.21.15.70:0/2719170095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 msgr2=0x55f549b99c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.960+0000 7f7769200700 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 0x55f549b99c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.960+0000 7f7769200700 1 -- 172.21.15.70:0/2719170095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f549aa55b0 con 0x55f549b93240 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.960+0000 7f7763400700 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8e1d0 0x55f549b97000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:38:33.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.960+0000 7f7769200700 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b93240 0x55f549b97540 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x55f549b8e790 tx=0x7f775c0aa700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89dd75c62d4ab631 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:38:33.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.960+0000 7f774e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:38:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.961+0000 7f774e000700 1 -- 172.21.15.70:0/2719170095 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c0ca060 con 0x55f549b93240 2024-05-08T07:38:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.961+0000 7f774e000700 1 -- 172.21.15.70:0/2719170095 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 9583+0+0 (secure 0 0 0) 0x7f775c0a7310 con 0x55f549b93240 2024-05-08T07:38:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.961+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2719170095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f775c0b3af0 con 0x55f549b93240 2024-05-08T07:38:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.961+0000 7f774e000700 1 -- 172.21.15.70:0/2719170095 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f775c0aaf80 con 0x55f549b93240 2024-05-08T07:38:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.961+0000 7f7775ac1b80 10 client.16938 fetch_fsmap learned FSMap version 42 2024-05-08T07:38:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.961+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2719170095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f549ba4b00 con 0x55f549b93240 2024-05-08T07:38:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.962+0000 7f774e000700 1 -- 172.21.15.70:0/2719170095 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f775c0b3af0 con 0x55f549b93240 2024-05-08T07:38:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.962+0000 7f774e000700 1 -- 172.21.15.70:0/2719170095 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f775c011070 con 0x55f549b93240 2024-05-08T07:38:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.962+0000 7f7775ac1b80 10 client.16938 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:38:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.962+0000 7f7775ac1b80 10 client.16938 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:38:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.962+0000 7f7775ac1b80 20 client.16938 populate_metadata read hostname 'smithi070' 2024-05-08T07:38:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.963+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f549ba6e00 0x55f549ba91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.963+0000 7f7775ac1b80 4 client.16938 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:38:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.963+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2719170095 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f549b5a2d0 con 0x55f549ba6e00 2024-05-08T07:38:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.963+0000 7f7763e00700 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f549ba6e00 0x55f549ba91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:33.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.964+0000 7f7763e00700 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f549ba6e00 0x55f549ba91f0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=849718c02559bb0c server_cookie=57825a0c7fc3cd79 in_seq=0 out_seq=0 2024-05-08T07:38:33.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.964+0000 7f774e000700 10 client.16938 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:38:33.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f774e000700 1 -- 172.21.15.70:0/2719170095 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f549b5a2d0 con 0x55f549ba6e00 2024-05-08T07:38:33.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f774e000700 10 client.16938 handle_command_reply: tid=0 2024-05-08T07:38:33.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f7775ac1b80 1 client.16938 shutdown 2024-05-08T07:38:33.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2719170095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b93240 msgr2=0x55f549b97540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b93240 0x55f549b97540 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x55f549b8e790 tx=0x7f775c0aa700 comp rx=0 tx=0).stop 2024-05-08T07:38:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2719170095 shutdown_connections 2024-05-08T07:38:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f549ba6e00 0x55f549ba91f0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b93240 0x55f549b97540 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 0x55f549b99c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.967+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2719170095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8e1d0 0x55f549b97000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:33.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.968+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2719170095 >> 172.21.15.70:0/2719170095 conn(0x55f549b05860 msgr2=0x55f549b82bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:38:33.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.968+0000 7f774e000700 0 client.16938 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:38:33.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.968+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2719170095 shutdown_connections 2024-05-08T07:38:33.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.968+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2719170095 wait complete. 2024-05-08T07:38:33.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:33.968+0000 7f7775ac1b80 20 client.16938 trim_cache size 0 max 16384 2024-05-08T07:38:34.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.006+0000 7f7775ac1b80 1 Processor -- start 2024-05-08T07:38:34.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.006+0000 7f7775ac1b80 1 -- start start 2024-05-08T07:38:34.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.006+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 0x55f549ba3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:34.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.006+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b95ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:34.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.006+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549bae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:34.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.006+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77641b8430 con 0x55f549b8e1d0 2024-05-08T07:38:34.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.006+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77641b5cc0 con 0x55f549b93240 2024-05-08T07:38:34.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.006+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f77641b3b30 con 0x55f549b8d810 2024-05-08T07:38:34.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.007+0000 7f7769200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549bae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:34.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.007+0000 7f7763400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b95ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:34.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.007+0000 7f7763e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 0x55f549ba3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:34.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.007+0000 7f7763400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b95ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38028/0 (socket says 172.21.15.70:38028) 2024-05-08T07:38:34.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.007+0000 7f7763400700 1 -- 172.21.15.70:0/2533001819 learned_addr learned my addr 172.21.15.70:0/2533001819 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:38:34.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.008+0000 7f7763e00700 1 -- 172.21.15.70:0/2533001819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 msgr2=0x55f549bae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:38:34.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.008+0000 7f7763e00700 1 --2- 172.21.15.70:0/2533001819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549bae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:34.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.008+0000 7f7763e00700 1 -- 172.21.15.70:0/2533001819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 msgr2=0x55f549b95ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:38:34.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.008+0000 7f7763e00700 1 --2- 172.21.15.70:0/2533001819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b95ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:34.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.008+0000 7f7763e00700 1 -- 172.21.15.70:0/2533001819 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f549b978c0 con 0x55f549b8d810 2024-05-08T07:38:34.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.008+0000 7f7769200700 1 --2- 172.21.15.70:0/2533001819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549bae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:38:34.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.008+0000 7f7763e00700 1 --2- 172.21.15.70:0/2533001819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 0x55f549ba3320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55f549b9a5e0 tx=0x7f7754014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14befadbb9936e87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:38:34.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.009+0000 7f7758c00700 1 -- 172.21.15.70:0/2533001819 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754030070 con 0x55f549b8d810 2024-05-08T07:38:34.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.009+0000 7f7758c00700 1 -- 172.21.15.70:0/2533001819 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7754029440 con 0x55f549b8d810 2024-05-08T07:38:34.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.009+0000 7f7758c00700 1 -- 172.21.15.70:0/2533001819 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7754011e60 con 0x55f549b8d810 2024-05-08T07:38:34.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.010+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2533001819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 msgr2=0x55f549ba3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:34.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.010+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2533001819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 0x55f549ba3320 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55f549b9a5e0 tx=0x7f7754014000 comp rx=0 tx=0).stop 2024-05-08T07:38:34.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.010+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2533001819 shutdown_connections 2024-05-08T07:38:34.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.010+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2533001819 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b93240 0x55f549bae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:34.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.010+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2533001819 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b8d810 0x55f549ba3320 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:34.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.010+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2533001819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549b95ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:34.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.010+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2533001819 >> 172.21.15.70:0/2533001819 conn(0x55f549b05860 msgr2=0x55f549b957c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:38:34.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.010+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2533001819 shutdown_connections 2024-05-08T07:38:34.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.011+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2533001819 wait complete. 2024-05-08T07:38:34.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.011+0000 7f7775ac1b80 1 -- start start 2024-05-08T07:38:34.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.011+0000 7f7775ac1b80 1 Processor -- start 2024-05-08T07:38:34.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.012+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 0x55f549c0b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:34.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.012+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549c0be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:34.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.012+0000 7f7775ac1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b93240 0x55f549b9cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:34.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.012+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77641b4180 con 0x55f549b8e1d0 2024-05-08T07:38:34.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.012+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f77641b55f0 con 0x55f549b8d810 2024-05-08T07:38:34.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.012+0000 7f7775ac1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f77641b4850 con 0x55f549b93240 2024-05-08T07:38:34.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.012+0000 7f7775ac1b80 10 client.0 _ll_register_callbacks cb 0x55f549a86e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:38:34.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.013+0000 7f7763e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 0x55f549c0b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:34.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.013+0000 7f7763400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549c0be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:34.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.013+0000 7f7763400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549c0be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38030/0 (socket says 172.21.15.70:38030) 2024-05-08T07:38:34.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.013+0000 7f7763400700 1 -- 172.21.15.70:0/2790191732 learned_addr learned my addr 172.21.15.70:0/2790191732 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:38:34.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.013+0000 7f7769200700 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b93240 0x55f549b9cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:34.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.013+0000 7f7763400700 1 -- 172.21.15.70:0/2790191732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b93240 msgr2=0x55f549b9cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:38:34.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.014+0000 7f7763400700 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b93240 0x55f549b9cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:34.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.014+0000 7f7763400700 1 -- 172.21.15.70:0/2790191732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 msgr2=0x55f549c0b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:38:34.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.014+0000 7f7763400700 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 0x55f549c0b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:34.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.014+0000 7f7763400700 1 -- 172.21.15.70:0/2790191732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f549b9d200 con 0x55f549b8e1d0 2024-05-08T07:38:34.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.014+0000 7f7763400700 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549c0be00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7750013750 tx=0x7f7750013a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599e4ccce9107cc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:38:34.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.014+0000 7f774e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:38:34.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.014+0000 7f774e000700 1 -- 172.21.15.70:0/2790191732 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7750004240 con 0x55f549b8e1d0 2024-05-08T07:38:34.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.015+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2790191732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7754029440 con 0x55f549b8e1d0 2024-05-08T07:38:34.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.015+0000 7f774e000700 1 -- 172.21.15.70:0/2790191732 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(183..183 src has 1..183) ==== 9583+0+0 (secure 0 0 0) 0x7f77500043e0 con 0x55f549b8e1d0 2024-05-08T07:38:34.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.015+0000 7f774e000700 1 -- 172.21.15.70:0/2790191732 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7750003680 con 0x55f549b8e1d0 2024-05-08T07:38:34.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.015+0000 7f7775ac1b80 10 client.16944 fetch_fsmap learned FSMap version 42 2024-05-08T07:38:34.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.015+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2790191732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f549c13150 con 0x55f549b8e1d0 2024-05-08T07:38:34.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.016+0000 7f774e000700 1 -- 172.21.15.70:0/2790191732 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7754029440 con 0x55f549b8e1d0 2024-05-08T07:38:34.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.016+0000 7f774e000700 1 -- 172.21.15.70:0/2790191732 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f7750011940 con 0x55f549b8e1d0 2024-05-08T07:38:34.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.016+0000 7f7775ac1b80 10 client.16944 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:38:34.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.016+0000 7f7775ac1b80 10 client.16944 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:38:34.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.016+0000 7f7775ac1b80 20 client.16944 populate_metadata read hostname 'smithi070' 2024-05-08T07:38:34.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.016+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f549c13930 0x55f549c15d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:38:34.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.016+0000 7f7775ac1b80 4 client.16944 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.0, "await_for": 42.0}] 2024-05-08T07:38:34.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.016+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2790191732 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.0, "await_for": 42.0}) -- 0x55f549aed590 con 0x55f549c13930 2024-05-08T07:38:34.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.017+0000 7f7763e00700 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f549c13930 0x55f549c15d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:38:34.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.018+0000 7f774e000700 10 client.16944 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:38:34.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:34.018+0000 7f7763e00700 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f549c13930 0x55f549c15d50 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da89a4869afe14ae server_cookie=947cea595809ee3a in_seq=0 out_seq=0 2024-05-08T07:38:35.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:35 smithi194 ceph-mon[33679]: pgmap v1653: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 315 KiB/s wr, 186 op/s 2024-05-08T07:38:35.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:35 smithi070 ceph-mon[29591]: pgmap v1653: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 315 KiB/s wr, 186 op/s 2024-05-08T07:38:35.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:35 smithi172 ceph-mon[33377]: pgmap v1653: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 315 KiB/s wr, 186 op/s 2024-05-08T07:38:37.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:37 smithi194 ceph-mon[33679]: pgmap v1654: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 437 KiB/s wr, 193 op/s 2024-05-08T07:38:37.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:37 smithi070 ceph-mon[29591]: pgmap v1654: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 437 KiB/s wr, 193 op/s 2024-05-08T07:38:37.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:37 smithi172 ceph-mon[33377]: pgmap v1654: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 437 KiB/s wr, 193 op/s 2024-05-08T07:38:39.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:39 smithi194 ceph-mon[33679]: pgmap v1655: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 316 KiB/s wr, 156 op/s 2024-05-08T07:38:39.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:39 smithi070 ceph-mon[29591]: pgmap v1655: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 316 KiB/s wr, 156 op/s 2024-05-08T07:38:39.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:39 smithi172 ceph-mon[33377]: pgmap v1655: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 316 KiB/s wr, 156 op/s 2024-05-08T07:38:41.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:41 smithi194 ceph-mon[33679]: pgmap v1656: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 322 KiB/s wr, 159 op/s 2024-05-08T07:38:41.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:41 smithi070 ceph-mon[29591]: pgmap v1656: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 322 KiB/s wr, 159 op/s 2024-05-08T07:38:41.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:41 smithi172 ceph-mon[33377]: pgmap v1656: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 322 KiB/s wr, 159 op/s 2024-05-08T07:38:43.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:43 smithi194 ceph-mon[33679]: pgmap v1657: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 174 KiB/s wr, 49 op/s 2024-05-08T07:38:43.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:43 smithi070 ceph-mon[29591]: pgmap v1657: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 174 KiB/s wr, 49 op/s 2024-05-08T07:38:43.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:43 smithi172 ceph-mon[33377]: pgmap v1657: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 174 KiB/s wr, 49 op/s 2024-05-08T07:38:45.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:45 smithi194 ceph-mon[33679]: pgmap v1658: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 144 KiB/s wr, 15 op/s 2024-05-08T07:38:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:45 smithi070 ceph-mon[29591]: pgmap v1658: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 144 KiB/s wr, 15 op/s 2024-05-08T07:38:45.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:45 smithi172 ceph-mon[33377]: pgmap v1658: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 144 KiB/s wr, 15 op/s 2024-05-08T07:38:47.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:47 smithi194 ceph-mon[33679]: pgmap v1659: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 144 KiB/s wr, 16 op/s 2024-05-08T07:38:47.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:47 smithi070 ceph-mon[29591]: pgmap v1659: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 144 KiB/s wr, 16 op/s 2024-05-08T07:38:47.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:47 smithi172 ceph-mon[33377]: pgmap v1659: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 144 KiB/s wr, 16 op/s 2024-05-08T07:38:49.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:49 smithi194 ceph-mon[33679]: pgmap v1660: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-05-08T07:38:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:49 smithi070 ceph-mon[29591]: pgmap v1660: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-05-08T07:38:49.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:49 smithi172 ceph-mon[33377]: pgmap v1660: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 KiB/s wr, 8 op/s 2024-05-08T07:38:51.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:51 smithi194 ceph-mon[33679]: pgmap v1661: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 57 KiB/s wr, 24 op/s 2024-05-08T07:38:51.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:51 smithi070 ceph-mon[29591]: pgmap v1661: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 57 KiB/s wr, 24 op/s 2024-05-08T07:38:51.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:51 smithi172 ceph-mon[33377]: pgmap v1661: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 57 KiB/s wr, 24 op/s 2024-05-08T07:38:53.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:53 smithi194 ceph-mon[33679]: pgmap v1662: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 52 KiB/s wr, 30 op/s 2024-05-08T07:38:53.819 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:53 smithi070 ceph-mon[29591]: pgmap v1662: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 52 KiB/s wr, 30 op/s 2024-05-08T07:38:53.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:53 smithi172 ceph-mon[33377]: pgmap v1662: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 52 KiB/s wr, 30 op/s 2024-05-08T07:38:55.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.351+0000 7f774e000700 1 -- 172.21.15.70:0/2790191732 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55f549aed590 con 0x55f549c13930 2024-05-08T07:38:55.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.351+0000 7f774e000700 10 client.16944 handle_command_reply: tid=0 2024-05-08T07:38:55.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.351+0000 7f7775ac1b80 1 client.16944 shutdown 2024-05-08T07:38:55.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.351+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2790191732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 msgr2=0x55f549c0be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:55.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.351+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549c0be00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7750013750 tx=0x7f7750013a60 comp rx=0 tx=0).stop 2024-05-08T07:38:55.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.352+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2790191732 shutdown_connections 2024-05-08T07:38:55.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.352+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f549c13930 0x55f549c15d50 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:55.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.352+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f549b93240 0x55f549b9cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.352+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f549b8d810 0x55f549c0b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.352+0000 7f7775ac1b80 1 --2- 172.21.15.70:0/2790191732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f549b8e1d0 0x55f549c0be00 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.352+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2790191732 >> 172.21.15.70:0/2790191732 conn(0x55f549b05860 msgr2=0x55f549b82bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:38:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.352+0000 7f774e000700 0 client.16944 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:38:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.353+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2790191732 shutdown_connections 2024-05-08T07:38:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.353+0000 7f7775ac1b80 1 -- 172.21.15.70:0/2790191732 wait complete. 2024-05-08T07:38:55.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.353+0000 7f7775ac1b80 20 client.16944 trim_cache size 0 max 16384 2024-05-08T07:38:55.352 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:38:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:38:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:38:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 130, 2024-05-08T07:38:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:38:55.352 INFO:teuthology.orchestra.run.smithi070.stdout: "6961837c": { 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 130, 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 89.0, 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:38:55.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:38:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:38:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:38:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:38:55.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:38:55.354 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 -- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77480b2b20 msgr2=0x7f77480b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77480b2b20 0x7f77480b4fe0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f776419cb70 tx=0x7f7754009260 comp rx=0 tx=0).stop 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 -- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f776410b6d0 msgr2=0x7f776419ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f776410b6d0 0x7f776419ba30 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f775c00b070 tx=0x7f775c004c80 comp rx=0 tx=0).stop 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 -- 172.21.15.70:0/1235479745 shutdown_connections 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77480b2b20 0x7f77480b4fe0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f776410b6d0 0x7f776419ba30 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f77641056d0 0x7f77641a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 --2- 172.21.15.70:0/1235479745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7764106090 0x7f77641a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.355+0000 7f776b200700 1 -- 172.21.15.70:0/1235479745 >> 172.21.15.70:0/1235479745 conn(0x7f77641011a0 msgr2=0x7f7764101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.356+0000 7f776b200700 1 -- 172.21.15.70:0/1235479745 shutdown_connections 2024-05-08T07:38:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:38:55.356+0000 7f776b200700 1 -- 172.21.15.70:0/1235479745 wait complete. 2024-05-08T07:38:55.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:55 smithi070 ceph-mon[29591]: pgmap v1663: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-05-08T07:38:55.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:55 smithi194 ceph-mon[33679]: pgmap v1663: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-05-08T07:38:55.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:55 smithi172 ceph-mon[33377]: pgmap v1663: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 29 op/s 2024-05-08T07:38:56.397 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6961837c', quiesce took 31.5 seconds. Will release after: 29.0 2024-05-08T07:38:57.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:57 smithi070 ceph-mon[29591]: pgmap v1664: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 30 op/s 2024-05-08T07:38:57.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:57 smithi172 ceph-mon[33377]: pgmap v1664: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 30 op/s 2024-05-08T07:38:58.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:57 smithi194 ceph-mon[33679]: pgmap v1664: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 30 op/s 2024-05-08T07:38:59.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:38:59 smithi070 ceph-mon[29591]: pgmap v1665: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-05-08T07:38:59.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:38:59 smithi172 ceph-mon[33377]: pgmap v1665: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-05-08T07:39:00.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:38:59 smithi194 ceph-mon[33679]: pgmap v1665: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-05-08T07:39:01.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:01 smithi070 ceph-mon[29591]: pgmap v1666: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 126 KiB/s wr, 142 op/s 2024-05-08T07:39:01.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:01 smithi172 ceph-mon[33377]: pgmap v1666: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 126 KiB/s wr, 142 op/s 2024-05-08T07:39:02.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:01 smithi194 ceph-mon[33679]: pgmap v1666: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 126 KiB/s wr, 142 op/s 2024-05-08T07:39:03.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:03 smithi070 ceph-mon[29591]: pgmap v1667: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 156 KiB/s wr, 194 op/s 2024-05-08T07:39:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:03 smithi172 ceph-mon[33377]: pgmap v1667: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 156 KiB/s wr, 194 op/s 2024-05-08T07:39:04.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:03 smithi194 ceph-mon[33679]: pgmap v1667: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 156 KiB/s wr, 194 op/s 2024-05-08T07:39:05.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:05 smithi070 ceph-mon[29591]: pgmap v1668: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 178 KiB/s wr, 189 op/s 2024-05-08T07:39:05.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:05 smithi172 ceph-mon[33377]: pgmap v1668: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 178 KiB/s wr, 189 op/s 2024-05-08T07:39:06.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:05 smithi194 ceph-mon[33679]: pgmap v1668: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 178 KiB/s wr, 189 op/s 2024-05-08T07:39:07.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:07 smithi070 ceph-mon[29591]: pgmap v1669: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 213 KiB/s wr, 198 op/s 2024-05-08T07:39:07.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:07 smithi172 ceph-mon[33377]: pgmap v1669: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 213 KiB/s wr, 198 op/s 2024-05-08T07:39:08.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:07 smithi194 ceph-mon[33679]: pgmap v1669: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 213 KiB/s wr, 198 op/s 2024-05-08T07:39:09.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:09 smithi070 ceph-mon[29591]: pgmap v1670: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 199 KiB/s wr, 196 op/s 2024-05-08T07:39:09.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:09 smithi172 ceph-mon[33377]: pgmap v1670: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 199 KiB/s wr, 196 op/s 2024-05-08T07:39:10.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:09 smithi194 ceph-mon[33679]: pgmap v1670: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 199 KiB/s wr, 196 op/s 2024-05-08T07:39:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:11 smithi070 ceph-mon[29591]: pgmap v1671: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 199 KiB/s wr, 198 op/s 2024-05-08T07:39:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:11 smithi070 ceph-mon[29591]: osdmap e184: 12 total, 12 up, 12 in 2024-05-08T07:39:11.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:39:11.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:11 smithi172 ceph-mon[33377]: pgmap v1671: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 199 KiB/s wr, 198 op/s 2024-05-08T07:39:11.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:11 smithi172 ceph-mon[33377]: osdmap e184: 12 total, 12 up, 12 in 2024-05-08T07:39:11.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:39:12.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:11 smithi194 ceph-mon[33679]: pgmap v1671: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 199 KiB/s wr, 198 op/s 2024-05-08T07:39:12.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:11 smithi194 ceph-mon[33679]: osdmap e184: 12 total, 12 up, 12 in 2024-05-08T07:39:12.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:39:13.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:13 smithi172 ceph-mon[33377]: pgmap v1673: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 74 KiB/s wr, 22 op/s 2024-05-08T07:39:13.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:13 smithi070 ceph-mon[29591]: pgmap v1673: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 74 KiB/s wr, 22 op/s 2024-05-08T07:39:14.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:13 smithi194 ceph-mon[33679]: pgmap v1673: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 74 KiB/s wr, 22 op/s 2024-05-08T07:39:15.554 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:15 smithi070 ceph-mon[29591]: pgmap v1674: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-05-08T07:39:15.554 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.554 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.554 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.554 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:15 smithi172 ceph-mon[33377]: pgmap v1674: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-05-08T07:39:15.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:15 smithi194 ceph-mon[33679]: pgmap v1674: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-05-08T07:39:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:16.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:39:16.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:39:16.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:16.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:16.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.605 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: pgmap v1675: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:39:17.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:39:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:39:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:17.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:39:17.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:39:17.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: pgmap v1675: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-05-08T07:39:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:39:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:39:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:39:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:39:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:18.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:39:18.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:39:18.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: pgmap v1675: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-05-08T07:39:18.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:18.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:39:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:39:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:39:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:39:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:39:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:39:19.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:19 smithi070 ceph-mon[29591]: pgmap v1676: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-05-08T07:39:19.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:19 smithi070 ceph-mon[29591]: osdmap e185: 12 total, 12 up, 12 in 2024-05-08T07:39:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:19 smithi172 ceph-mon[33377]: pgmap v1676: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-05-08T07:39:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:19 smithi172 ceph-mon[33377]: osdmap e185: 12 total, 12 up, 12 in 2024-05-08T07:39:19.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:19 smithi194 ceph-mon[33679]: pgmap v1676: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-05-08T07:39:19.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:19 smithi194 ceph-mon[33679]: osdmap e185: 12 total, 12 up, 12 in 2024-05-08T07:39:21.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:21 smithi070 ceph-mon[29591]: pgmap v1678: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 317 B/s wr, 6 op/s 2024-05-08T07:39:21.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:21 smithi172 ceph-mon[33377]: pgmap v1678: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 317 B/s wr, 6 op/s 2024-05-08T07:39:21.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:21 smithi194 ceph-mon[33679]: pgmap v1678: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 317 B/s wr, 6 op/s 2024-05-08T07:39:23.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:23 smithi070 ceph-mon[29591]: pgmap v1679: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:39:23.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:23 smithi172 ceph-mon[33377]: pgmap v1679: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:39:23.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:23 smithi194 ceph-mon[33679]: pgmap v1679: 129 pgs: 129 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:39:25.399 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:39:25.561 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:25 smithi194 ceph-mon[33679]: pgmap v1680: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:39:25.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:25 smithi070 ceph-mon[29591]: pgmap v1680: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:39:25.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:25 smithi172 ceph-mon[33377]: pgmap v1680: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T07:39:25.850 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:39:27.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:27 smithi194 ceph-mon[33679]: pgmap v1681: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:39:27.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:27 smithi070 ceph-mon[29591]: pgmap v1681: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:39:27.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:27 smithi172 ceph-mon[33377]: pgmap v1681: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:39:28.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.393+0000 7f4cc9a00700 1 -- 172.21.15.70:0/2561229271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4114670 msgr2=0x7f4cc4116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:28.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.393+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/2561229271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4114670 0x7f4cc4116a60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00b0a0 tx=0x7f4cbc00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.393+0000 7f4cc9a00700 1 -- 172.21.15.70:0/2561229271 shutdown_connections 2024-05-08T07:39:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.393+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/2561229271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4114670 0x7f4cc4116a60 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.394+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/2561229271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc4075710 0x7f4cc4075af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.394+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/2561229271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cc4076030 0x7f4cc4114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.394+0000 7f4cc9a00700 1 -- 172.21.15.70:0/2561229271 >> 172.21.15.70:0/2561229271 conn(0x7f4cc407a690 msgr2=0x7f4cc407aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.394+0000 7f4cc9a00700 1 -- 172.21.15.70:0/2561229271 shutdown_connections 2024-05-08T07:39:28.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.394+0000 7f4cc9a00700 1 -- 172.21.15.70:0/2561229271 wait complete. 2024-05-08T07:39:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.395+0000 7f4cc9a00700 1 Processor -- start 2024-05-08T07:39:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.395+0000 7f4cc9a00700 1 -- start start 2024-05-08T07:39:28.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.395+0000 7f4cc9a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4075710 0x7f4cc41a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.395+0000 7f4cc9a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cc4076030 0x7f4cc41a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.395+0000 7f4cc9a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc4114670 0x7f4cc41a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.395+0000 7f4cc9a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4119bd0 con 0x7f4cc4075710 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.395+0000 7f4cc9a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4119a50 con 0x7f4cc4076030 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.395+0000 7f4cc9a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4119d50 con 0x7f4cc4114670 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4075710 0x7f4cc41a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4075710 0x7f4cc41a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36802/0 (socket says 172.21.15.70:36802) 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2a00700 1 -- 172.21.15.70:0/467392373 learned_addr learned my addr 172.21.15.70:0/467392373 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2000700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cc4076030 0x7f4cc41a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc3400700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc4114670 0x7f4cc41a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2a00700 1 -- 172.21.15.70:0/467392373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc4114670 msgr2=0x7f4cc41a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2a00700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc4114670 0x7f4cc41a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2a00700 1 -- 172.21.15.70:0/467392373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cc4076030 msgr2=0x7f4cc41a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2a00700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cc4076030 0x7f4cc41a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2a00700 1 -- 172.21.15.70:0/467392373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc41a51e0 con 0x7f4cc4075710 2024-05-08T07:39:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.396+0000 7f4cc2000700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cc4076030 0x7f4cc41a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:39:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.397+0000 7f4cc2a00700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4075710 0x7f4cc41a01d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400d950 tx=0x7f4cb400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.397+0000 7f4cbb400700 1 -- 172.21.15.70:0/467392373 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4016070 con 0x7f4cc4075710 2024-05-08T07:39:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.397+0000 7f4cbb400700 1 -- 172.21.15.70:0/467392373 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4cb4010460 con 0x7f4cc4075710 2024-05-08T07:39:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.397+0000 7f4cbb400700 1 -- 172.21.15.70:0/467392373 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb400f620 con 0x7f4cc4075710 2024-05-08T07:39:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.397+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc41a54d0 con 0x7f4cc4075710 2024-05-08T07:39:28.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.397+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc41acd50 con 0x7f4cc4075710 2024-05-08T07:39:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.398+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc406a190 con 0x7f4cc4075710 2024-05-08T07:39:28.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.401+0000 7f4cbb400700 1 -- 172.21.15.70:0/467392373 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4cb4019070 con 0x7f4cc4075710 2024-05-08T07:39:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.403+0000 7f4cbb400700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca80b2a70 0x7f4ca80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.403+0000 7f4cbb400700 1 -- 172.21.15.70:0/467392373 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 9583+0+0 (secure 0 0 0) 0x7f4cb40e2660 con 0x7f4cc4075710 2024-05-08T07:39:28.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.403+0000 7f4cc2000700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca80b2a70 0x7f4ca80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:28.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.404+0000 7f4cc2000700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca80b2a70 0x7f4ca80b4f30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0005e10 tx=0x7f4cb0005d60 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.406+0000 7f4cbb400700 1 -- 172.21.15.70:0/467392373 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4cb40a9bc0 con 0x7f4cc4075710 2024-05-08T07:39:28.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.691+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cc41acf20 con 0x7f4cc4075710 2024-05-08T07:39:28.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.692+0000 7f4cbb400700 1 -- 172.21.15.70:0/467392373 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f4cb40a94c0 con 0x7f4cc4075710 2024-05-08T07:39:28.690 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:39:28.690 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:39:28.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca80b2a70 msgr2=0x7f4ca80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:28.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca80b2a70 0x7f4ca80b4f30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0005e10 tx=0x7f4cb0005d60 comp rx=0 tx=0).stop 2024-05-08T07:39:28.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4075710 msgr2=0x7f4cc41a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:28.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4075710 0x7f4cc41a01d0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400d950 tx=0x7f4cb400dd10 comp rx=0 tx=0).stop 2024-05-08T07:39:28.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 shutdown_connections 2024-05-08T07:39:28.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4ca80b2a70 0x7f4ca80b4f30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc4114670 0x7f4cc41a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc4075710 0x7f4cc41a01d0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 --2- 172.21.15.70:0/467392373 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4cc4076030 0x7f4cc41a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:28.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 >> 172.21.15.70:0/467392373 conn(0x7f4cc407a690 msgr2=0x7f4cc4113510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:28.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 shutdown_connections 2024-05-08T07:39:28.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:28.696+0000 7f4cc9a00700 1 -- 172.21.15.70:0/467392373 wait complete. 2024-05-08T07:39:28.694 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:39:29.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:29 smithi070 ceph-mon[29591]: pgmap v1682: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:39:29.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:29 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/467392373' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:39:29.496 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 6961837c --release --await' 2024-05-08T07:39:29.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 6961837c --release --await 2024-05-08T07:39:29.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:29 smithi172 ceph-mon[33377]: pgmap v1682: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:39:29.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:29 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/467392373' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:39:29.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:29 smithi194 ceph-mon[33679]: pgmap v1682: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:39:29.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:29 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/467392373' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:39:29.959 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:39:31.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:31 smithi070 ceph-mon[29591]: pgmap v1683: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-05-08T07:39:31.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:31 smithi172 ceph-mon[33377]: pgmap v1683: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-05-08T07:39:31.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:31 smithi194 ceph-mon[33679]: pgmap v1683: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 6 op/s 2024-05-08T07:39:32.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.184+0000 7f1d67e00700 1 -- 172.21.15.70:0/2331861190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 msgr2=0x7f1d6810fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:32.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.184+0000 7f1d67e00700 1 --2- 172.21.15.70:0/2331861190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 0x7f1d6810fef0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000b0a0 tx=0x7f1d6000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.184+0000 7f1d67e00700 1 -- 172.21.15.70:0/2331861190 shutdown_connections 2024-05-08T07:39:32.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.184+0000 7f1d67e00700 1 --2- 172.21.15.70:0/2331861190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 0x7f1d6810fef0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.184+0000 7f1d67e00700 1 --2- 172.21.15.70:0/2331861190 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d68104600 0x7f1d681049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.184+0000 7f1d67e00700 1 --2- 172.21.15.70:0/2331861190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d68104f20 0x7f1d6810d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.184+0000 7f1d67e00700 1 -- 172.21.15.70:0/2331861190 >> 172.21.15.70:0/2331861190 conn(0x7f1d680fde50 msgr2=0x7f1d68100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:32.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.184+0000 7f1d67e00700 1 -- 172.21.15.70:0/2331861190 shutdown_connections 2024-05-08T07:39:32.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.185+0000 7f1d67e00700 1 -- 172.21.15.70:0/2331861190 wait complete. 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.186+0000 7f1d67e00700 1 Processor -- start 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.186+0000 7f1d67e00700 1 -- start start 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.186+0000 7f1d67e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d68104600 0x7f1d681a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.186+0000 7f1d67e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d68104f20 0x7f1d681a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 0x7f1d6819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d681134e0 con 0x7f1d6810da30 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d68113360 con 0x7f1d68104f20 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d68113660 con 0x7f1d68104600 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 0x7f1d6819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 0x7f1d6819ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36828/0 (socket says 172.21.15.70:36828) 2024-05-08T07:39:32.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67400700 1 -- 172.21.15.70:0/598200367 learned_addr learned my addr 172.21.15.70:0/598200367 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d66000700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d68104f20 0x7f1d681a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d66a00700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d68104600 0x7f1d681a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67400700 1 -- 172.21.15.70:0/598200367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d68104600 msgr2=0x7f1d681a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67400700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d68104600 0x7f1d681a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67400700 1 -- 172.21.15.70:0/598200367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d68104f20 msgr2=0x7f1d681a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67400700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d68104f20 0x7f1d681a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.187+0000 7f1d67400700 1 -- 172.21.15.70:0/598200367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6819c160 con 0x7f1d6810da30 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.188+0000 7f1d67400700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 0x7f1d6819ba00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000b830 tx=0x7f1d60004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.188+0000 7f1d5f400700 1 -- 172.21.15.70:0/598200367 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60021070 con 0x7f1d6810da30 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.188+0000 7f1d67e00700 1 -- 172.21.15.70:0/598200367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6819c3f0 con 0x7f1d6810da30 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.188+0000 7f1d5f400700 1 -- 172.21.15.70:0/598200367 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d60007c80 con 0x7f1d6810da30 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.188+0000 7f1d5f400700 1 -- 172.21.15.70:0/598200367 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60005260 con 0x7f1d6810da30 2024-05-08T07:39:32.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.188+0000 7f1d67e00700 1 -- 172.21.15.70:0/598200367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d681a8710 con 0x7f1d6810da30 2024-05-08T07:39:32.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.192+0000 7f1d5f400700 1 -- 172.21.15.70:0/598200367 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1d60024070 con 0x7f1d6810da30 2024-05-08T07:39:32.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.193+0000 7f1d5f400700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d4c0b29f0 0x7f1d4c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.193+0000 7f1d5f400700 1 -- 172.21.15.70:0/598200367 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 9583+0+0 (secure 0 0 0) 0x7f1d6000f020 con 0x7f1d6810da30 2024-05-08T07:39:32.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.194+0000 7f1d66a00700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d4c0b29f0 0x7f1d4c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.194+0000 7f1d66a00700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d4c0b29f0 0x7f1d4c0b4eb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d58005950 tx=0x7f1d580058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:32.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.213+0000 7f1d77fb8b80 1 Processor -- start 2024-05-08T07:39:32.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.213+0000 7f1d77fb8b80 1 -- start start 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.213+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72cf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.213+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 0x5599d72c9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.213+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72c9ab0 0x5599d72c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.213+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599d721bb20 con 0x5599d72cef60 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.213+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599d71b9860 con 0x5599d72c9ab0 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.213+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5599d7217ae0 con 0x5599d72cf880 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.213+0000 7f1d66a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d66a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36832/0 (socket says 172.21.15.70:36832) 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d66a00700 1 -- 172.21.15.70:0/1267197823 learned_addr learned my addr 172.21.15.70:0/1267197823 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d66000700 1 --2- 172.21.15.70:0/1267197823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 0x5599d72c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d67400700 1 --2- 172.21.15.70:0/1267197823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72c9ab0 0x5599d72c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d66a00700 1 -- 172.21.15.70:0/1267197823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 msgr2=0x5599d72c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d66a00700 1 --2- 172.21.15.70:0/1267197823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 0x5599d72c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d66a00700 1 -- 172.21.15.70:0/1267197823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72c9ab0 msgr2=0x5599d72c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d66a00700 1 --2- 172.21.15.70:0/1267197823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72c9ab0 0x5599d72c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d66a00700 1 -- 172.21.15.70:0/1267197823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d71689d0 con 0x5599d72cef60 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.214+0000 7f1d66a00700 1 --2- 172.21.15.70:0/1267197823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72cf340 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800fd40 tx=0x7f1d58012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428c0d0c672a3453 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.215+0000 7f1d53e00700 1 -- 172.21.15.70:0/1267197823 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58022070 con 0x5599d72cef60 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.215+0000 7f1d53e00700 1 -- 172.21.15.70:0/1267197823 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d58011c60 con 0x5599d72cef60 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.215+0000 7f1d53e00700 1 -- 172.21.15.70:0/1267197823 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5801d610 con 0x5599d72cef60 2024-05-08T07:39:32.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/1267197823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 msgr2=0x5599d72cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:32.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/1267197823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72cf340 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800fd40 tx=0x7f1d58012000 comp rx=0 tx=0).stop 2024-05-08T07:39:32.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/1267197823 shutdown_connections 2024-05-08T07:39:32.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/1267197823 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72c9ab0 0x5599d72c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/1267197823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72cf340 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/1267197823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 0x5599d72c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/1267197823 >> 172.21.15.70:0/1267197823 conn(0x5599d71f7c60 msgr2=0x5599d72c3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:32.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/1267197823 shutdown_connections 2024-05-08T07:39:32.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/1267197823 wait complete. 2024-05-08T07:39:32.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.216+0000 7f1d77fb8b80 1 -- start start 2024-05-08T07:39:32.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.217+0000 7f1d77fb8b80 1 Processor -- start 2024-05-08T07:39:32.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.217+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 0x5599d72d55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.217+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.217+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cf880 0x5599d72d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.217+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599d72d63a0 con 0x5599d72cef60 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.217+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599d7181c20 con 0x5599d72cf880 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.217+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5599d72d6520 con 0x5599d72c9ab0 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.217+0000 7f1d77fb8b80 10 client.0 _ll_register_callbacks cb 0x5599d71c2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72d29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36840/0 (socket says 172.21.15.70:36840) 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66000700 1 -- 172.21.15.70:0/3767298743 learned_addr learned my addr 172.21.15.70:0/3767298743 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d67400700 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cf880 0x5599d72d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66a00700 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 0x5599d72d55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66000700 1 -- 172.21.15.70:0/3767298743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 msgr2=0x5599d72d55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66000700 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 0x5599d72d55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66000700 1 -- 172.21.15.70:0/3767298743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cf880 msgr2=0x5599d72d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66000700 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cf880 0x5599d72d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66000700 1 -- 172.21.15.70:0/3767298743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599d71e1520 con 0x5599d72cef60 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.218+0000 7f1d66000700 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72d29e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1d54003b60 tx=0x7f1d54003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c747f9d0efa78651 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.219+0000 7f1d50c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.219+0000 7f1d50c00700 1 -- 172.21.15.70:0/3767298743 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d54011c40 con 0x5599d72cef60 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.219+0000 7f1d50c00700 1 -- 172.21.15.70:0/3767298743 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(185..185 src has 1..185) ==== 9583+0+0 (secure 0 0 0) 0x7f1d54011de0 con 0x5599d72cef60 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.219+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/3767298743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d58011c60 con 0x5599d72cef60 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.219+0000 7f1d50c00700 1 -- 172.21.15.70:0/3767298743 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1d54012450 con 0x5599d72cef60 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.219+0000 7f1d77fb8b80 10 client.16962 fetch_fsmap learned FSMap version 42 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.219+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/3767298743 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5599d72e0d60 con 0x5599d72cef60 2024-05-08T07:39:32.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.219+0000 7f1d50c00700 1 -- 172.21.15.70:0/3767298743 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d58011c60 con 0x5599d72cef60 2024-05-08T07:39:32.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.220+0000 7f1d50c00700 1 -- 172.21.15.70:0/3767298743 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f1d5401b740 con 0x5599d72cef60 2024-05-08T07:39:32.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.220+0000 7f1d77fb8b80 10 client.16962 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:39:32.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.220+0000 7f1d77fb8b80 10 client.16962 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:39:32.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.220+0000 7f1d77fb8b80 20 client.16962 populate_metadata read hostname 'smithi070' 2024-05-08T07:39:32.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.220+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599d72e3440 0x5599d72e5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.220+0000 7f1d77fb8b80 4 client.16962 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:39:32.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.220+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/3767298743 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599d72961a0 con 0x5599d72e3440 2024-05-08T07:39:32.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.221+0000 7f1d66a00700 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599d72e3440 0x5599d72e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.222+0000 7f1d66a00700 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599d72e3440 0x5599d72e5830 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=395e3103c8517f4 server_cookie=a406e7b0f291419b in_seq=0 out_seq=0 2024-05-08T07:39:32.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.222+0000 7f1d50c00700 10 client.16962 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:39:32.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d50c00700 1 -- 172.21.15.70:0/3767298743 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5599d72961a0 con 0x5599d72e3440 2024-05-08T07:39:32.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d50c00700 10 client.16962 handle_command_reply: tid=0 2024-05-08T07:39:32.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 client.16962 shutdown 2024-05-08T07:39:32.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/3767298743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 msgr2=0x5599d72d29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:32.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72d29e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f1d54003b60 tx=0x7f1d54003f20 comp rx=0 tx=0).stop 2024-05-08T07:39:32.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/3767298743 shutdown_connections 2024-05-08T07:39:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599d72e3440 0x5599d72e5830 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cf880 0x5599d72d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 0x5599d72d55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/3767298743 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cef60 0x5599d72d29e0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/3767298743 >> 172.21.15.70:0/3767298743 conn(0x5599d71f7c60 msgr2=0x5599d72c8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d50c00700 0 client.16962 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:39:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/3767298743 shutdown_connections 2024-05-08T07:39:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/3767298743 wait complete. 2024-05-08T07:39:32.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.224+0000 7f1d77fb8b80 20 client.16962 trim_cache size 0 max 16384 2024-05-08T07:39:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.247+0000 7f1d77fb8b80 1 Processor -- start 2024-05-08T07:39:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.247+0000 7f1d77fb8b80 1 -- start start 2024-05-08T07:39:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.247+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72c9ab0 0x5599d72d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.247+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 0x5599d72df460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.247+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 0x5599d72eb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.247+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d681b3ed0 con 0x5599d72c9ab0 2024-05-08T07:39:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.247+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d681b1760 con 0x5599d72cef60 2024-05-08T07:39:32.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.247+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d681af5d0 con 0x5599d72cf880 2024-05-08T07:39:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72c9ab0 0x5599d72d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72c9ab0 0x5599d72d2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36850/0 (socket says 172.21.15.70:36850) 2024-05-08T07:39:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66a00700 1 -- 172.21.15.70:0/376623211 learned_addr learned my addr 172.21.15.70:0/376623211 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d67400700 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 0x5599d72eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66000700 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 0x5599d72df460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66a00700 1 -- 172.21.15.70:0/376623211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 msgr2=0x5599d72eb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66a00700 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 0x5599d72eb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66a00700 1 -- 172.21.15.70:0/376623211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 msgr2=0x5599d72df460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:32.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66a00700 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 0x5599d72df460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66a00700 1 -- 172.21.15.70:0/376623211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d72c5f00 con 0x5599d72c9ab0 2024-05-08T07:39:32.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.248+0000 7f1d66000700 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 0x5599d72df460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:39:32.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.249+0000 7f1d66a00700 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72c9ab0 0x5599d72d2f50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x5599d72e60a0 tx=0x7f1d58015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a16cb4b34b2401 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:32.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.249+0000 7f1d53400700 1 -- 172.21.15.70:0/376623211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58022040 con 0x5599d72c9ab0 2024-05-08T07:39:32.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.249+0000 7f1d53400700 1 -- 172.21.15.70:0/376623211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d5803a070 con 0x5599d72c9ab0 2024-05-08T07:39:32.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.249+0000 7f1d53400700 1 -- 172.21.15.70:0/376623211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58035370 con 0x5599d72c9ab0 2024-05-08T07:39:32.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/376623211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72c9ab0 msgr2=0x5599d72d2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:32.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72c9ab0 0x5599d72d2f50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x5599d72e60a0 tx=0x7f1d58015000 comp rx=0 tx=0).stop 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/376623211 shutdown_connections 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72cf880 0x5599d72eb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72c9ab0 0x5599d72d2f50 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/376623211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 0x5599d72df460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/376623211 >> 172.21.15.70:0/376623211 conn(0x5599d71f7c60 msgr2=0x5599d72d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/376623211 shutdown_connections 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/376623211 wait complete. 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.250+0000 7f1d77fb8b80 1 -- start start 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.251+0000 7f1d77fb8b80 1 Processor -- start 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.251+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 0x5599d72db9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.251+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 0x5599d72da460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.251+0000 7f1d77fb8b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cf880 0x5599d72da9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.251+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d681afc20 con 0x5599d72cf880 2024-05-08T07:39:32.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.251+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d681b1090 con 0x5599d72cef60 2024-05-08T07:39:32.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.251+0000 7f1d77fb8b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d681b02f0 con 0x5599d72c9ab0 2024-05-08T07:39:32.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.251+0000 7f1d77fb8b80 10 client.0 _ll_register_callbacks cb 0x5599d71c2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:39:32.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.251+0000 7f1d67400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cf880 0x5599d72da9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d67400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cf880 0x5599d72da9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36852/0 (socket says 172.21.15.70:36852) 2024-05-08T07:39:32.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d67400700 1 -- 172.21.15.70:0/295772418 learned_addr learned my addr 172.21.15.70:0/295772418 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:32.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d66a00700 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 0x5599d72db9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d66000700 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 0x5599d72da460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d67400700 1 -- 172.21.15.70:0/295772418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 msgr2=0x5599d72db9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d67400700 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 0x5599d72db9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d67400700 1 -- 172.21.15.70:0/295772418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 msgr2=0x5599d72da460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d67400700 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 0x5599d72da460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d67400700 1 -- 172.21.15.70:0/295772418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599d72daee0 con 0x5599d72cf880 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d67400700 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cf880 0x5599d72da9a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1d600ab020 tx=0x7f1d600aaba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23af3883fa928a0f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d50c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.252+0000 7f1d50c00700 1 -- 172.21.15.70:0/295772418 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d600c5060 con 0x5599d72cf880 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d50c00700 1 -- 172.21.15.70:0/295772418 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(185..185 src has 1..185) ==== 9583+0+0 (secure 0 0 0) 0x7f1d6001d9e0 con 0x5599d72cf880 2024-05-08T07:39:32.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/295772418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d5803a070 con 0x5599d72cf880 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d50c00700 1 -- 172.21.15.70:0/295772418 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1d600af440 con 0x5599d72cf880 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d77fb8b80 10 client.16968 fetch_fsmap learned FSMap version 42 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/295772418 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5599d734f9e0 con 0x5599d72cf880 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d50c00700 1 -- 172.21.15.70:0/295772418 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d5803a070 con 0x5599d72cf880 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d50c00700 1 -- 172.21.15.70:0/295772418 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f1d60011070 con 0x5599d72cf880 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d77fb8b80 10 client.16968 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d77fb8b80 10 client.16968 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d77fb8b80 20 client.16968 populate_metadata read hostname 'smithi070' 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599d734fff0 0x5599d73523e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d77fb8b80 4 client.16968 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6961837c", "release": true, "await": true}] 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.253+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/295772418 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6961837c", "release": true, "await": true}) -- 0x5599d7229500 con 0x5599d734fff0 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.254+0000 7f1d66a00700 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599d734fff0 0x5599d73523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.255+0000 7f1d66a00700 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599d734fff0 0x5599d73523e0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d1ba0beed3f89e7 server_cookie=6bdb919108f6fdcb in_seq=0 out_seq=0 2024-05-08T07:39:32.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:32.255+0000 7f1d50c00700 10 client.16968 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:39:33.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:33 smithi070 ceph-mon[29591]: pgmap v1684: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-05-08T07:39:33.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:33 smithi172 ceph-mon[33377]: pgmap v1684: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-05-08T07:39:33.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:33 smithi194 ceph-mon[33679]: pgmap v1684: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 6 op/s 2024-05-08T07:39:35.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:35 smithi070 ceph-mon[29591]: pgmap v1685: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-05-08T07:39:35.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:35 smithi172 ceph-mon[33377]: pgmap v1685: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-05-08T07:39:35.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:35 smithi194 ceph-mon[33679]: pgmap v1685: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 5 op/s 2024-05-08T07:39:36.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.499+0000 7f1d50c00700 1 -- 172.21.15.70:0/295772418 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5599d7229500 con 0x5599d734fff0 2024-05-08T07:39:36.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.499+0000 7f1d50c00700 10 client.16968 handle_command_reply: tid=0 2024-05-08T07:39:36.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.499+0000 7f1d77fb8b80 1 client.16968 shutdown 2024-05-08T07:39:36.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.500+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/295772418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cf880 msgr2=0x5599d72da9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:36.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.500+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cf880 0x5599d72da9a0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f1d600ab020 tx=0x7f1d600aaba0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.500+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/295772418 shutdown_connections 2024-05-08T07:39:36.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.500+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599d734fff0 0x5599d73523e0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.500+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599d72cf880 0x5599d72da9a0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.500+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599d72c9ab0 0x5599d72db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.500+0000 7f1d77fb8b80 1 --2- 172.21.15.70:0/295772418 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599d72cef60 0x5599d72da460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.500+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/295772418 >> 172.21.15.70:0/295772418 conn(0x5599d71f7c60 msgr2=0x5599d72cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:36.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.500+0000 7f1d50c00700 0 client.16968 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:39:36.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.501+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/295772418 shutdown_connections 2024-05-08T07:39:36.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.501+0000 7f1d77fb8b80 1 -- 172.21.15.70:0/295772418 wait complete. 2024-05-08T07:39:36.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.501+0000 7f1d77fb8b80 20 client.16968 trim_cache size 0 max 16384 2024-05-08T07:39:36.499 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 132, 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "6961837c": { 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 132, 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:39:36.500 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 89.0, 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:39:36.501 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:39:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.502+0000 7f1d67e00700 1 -- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d4c0b29f0 msgr2=0x7f1d4c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.502+0000 7f1d67e00700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d4c0b29f0 0x7f1d4c0b4eb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d58005950 tx=0x7f1d580058e0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.502+0000 7f1d67e00700 1 -- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 msgr2=0x7f1d6819ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.502+0000 7f1d67e00700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 0x7f1d6819ba00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1d6000b830 tx=0x7f1d60004db0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.503+0000 7f1d67e00700 1 -- 172.21.15.70:0/598200367 shutdown_connections 2024-05-08T07:39:36.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.503+0000 7f1d67e00700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d4c0b29f0 0x7f1d4c0b4eb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.503+0000 7f1d67e00700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d6810da30 0x7f1d6819ba00 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.503+0000 7f1d67e00700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d68104600 0x7f1d681a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.503+0000 7f1d67e00700 1 --2- 172.21.15.70:0/598200367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d68104f20 0x7f1d681a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:36.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.503+0000 7f1d67e00700 1 -- 172.21.15.70:0/598200367 >> 172.21.15.70:0/598200367 conn(0x7f1d680fde50 msgr2=0x7f1d6810eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:36.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.503+0000 7f1d67e00700 1 -- 172.21.15.70:0/598200367 shutdown_connections 2024-05-08T07:39:36.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:36.503+0000 7f1d67e00700 1 -- 172.21.15.70:0/598200367 wait complete. 2024-05-08T07:39:37.359 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/rcu/tree.o 2024-05-08T07:39:37.483 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6961837c', seconds elapsed: 72.6 2024-05-08T07:39:37.483 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.0 2024-05-08T07:39:37.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:39:37.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:37 smithi070 ceph-mon[29591]: pgmap v1686: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 4.5 KiB/s wr, 6 op/s 2024-05-08T07:39:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:37 smithi172 ceph-mon[33377]: pgmap v1686: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 4.5 KiB/s wr, 6 op/s 2024-05-08T07:39:37.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:37 smithi194 ceph-mon[33679]: pgmap v1686: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 4.5 KiB/s wr, 6 op/s 2024-05-08T07:39:38.046 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:39:38.781 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/consoles.o 2024-05-08T07:39:38.966 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/compress.o 2024-05-08T07:39:39.244 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/events/msr.o 2024-05-08T07:39:39.245 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/msi.o 2024-05-08T07:39:39.348 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:39 smithi070 ceph-mon[29591]: pgmap v1687: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-05-08T07:39:39.359 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/gup.o 2024-05-08T07:39:39.620 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:39 smithi172 ceph-mon[33377]: pgmap v1687: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-05-08T07:39:39.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:39 smithi194 ceph-mon[33679]: pgmap v1687: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-05-08T07:39:39.850 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mmap_lock.o 2024-05-08T07:39:40.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.352+0000 7f1057000700 1 -- 172.21.15.70:0/1885837729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10501056e0 msgr2=0x7f1050105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:40.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.352+0000 7f1057000700 1 --2- 172.21.15.70:0/1885837729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10501056e0 0x7f1050105b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f103c0098f0 tx=0x7f103c009c00 comp rx=0 tx=0).stop 2024-05-08T07:39:40.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.352+0000 7f1057000700 1 -- 172.21.15.70:0/1885837729 shutdown_connections 2024-05-08T07:39:40.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.352+0000 7f1057000700 1 --2- 172.21.15.70:0/1885837729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10501060a0 0x7f10501125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:40.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.352+0000 7f1057000700 1 --2- 172.21.15.70:0/1885837729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f105010b6e0 0x7f105010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:40.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.352+0000 7f1057000700 1 --2- 172.21.15.70:0/1885837729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10501056e0 0x7f1050105b60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:40.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.352+0000 7f1057000700 1 -- 172.21.15.70:0/1885837729 >> 172.21.15.70:0/1885837729 conn(0x7f10501011d0 msgr2=0x7f10501035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:40.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.353+0000 7f1057000700 1 -- 172.21.15.70:0/1885837729 shutdown_connections 2024-05-08T07:39:40.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.353+0000 7f1057000700 1 -- 172.21.15.70:0/1885837729 wait complete. 2024-05-08T07:39:40.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.355+0000 7f1057000700 1 Processor -- start 2024-05-08T07:39:40.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.355+0000 7f1057000700 1 -- start start 2024-05-08T07:39:40.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.356+0000 7f1057000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10501056e0 0x7f10501123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:40.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.356+0000 7f1057000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10501060a0 0x7f105010f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:40.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.356+0000 7f1057000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f105010b6e0 0x7f105010f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:40.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.356+0000 7f1057000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f10501157d0 con 0x7f10501060a0 2024-05-08T07:39:40.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.356+0000 7f1057000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1050115650 con 0x7f10501056e0 2024-05-08T07:39:40.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.356+0000 7f1057000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1050115950 con 0x7f105010b6e0 2024-05-08T07:39:40.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f104f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10501060a0 0x7f105010f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:40.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f104f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10501060a0 0x7f105010f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56440/0 (socket says 172.21.15.70:56440) 2024-05-08T07:39:40.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f104f400700 1 -- 172.21.15.70:0/1158261424 learned_addr learned my addr 172.21.15.70:0/1158261424 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:40.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f1055000700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f105010b6e0 0x7f105010f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:40.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f104fe00700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10501056e0 0x7f10501123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:40.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f104f400700 1 -- 172.21.15.70:0/1158261424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f105010b6e0 msgr2=0x7f105010f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:40.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f104f400700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f105010b6e0 0x7f105010f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:40.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f104f400700 1 -- 172.21.15.70:0/1158261424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10501056e0 msgr2=0x7f10501123d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:40.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f104f400700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10501056e0 0x7f10501123d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:40.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.357+0000 7f104f400700 1 -- 172.21.15.70:0/1158261424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1050110290 con 0x7f10501060a0 2024-05-08T07:39:40.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.358+0000 7f104f400700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10501060a0 0x7f105010f480 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f103c005950 tx=0x7f103c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.359+0000 7f104cc00700 1 -- 172.21.15.70:0/1158261424 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c025070 con 0x7f10501060a0 2024-05-08T07:39:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.359+0000 7f104cc00700 1 -- 172.21.15.70:0/1158261424 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f103c0054c0 con 0x7f10501060a0 2024-05-08T07:39:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.359+0000 7f104cc00700 1 -- 172.21.15.70:0/1158261424 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c004d90 con 0x7f10501060a0 2024-05-08T07:39:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.359+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10501a1d70 con 0x7f10501060a0 2024-05-08T07:39:40.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.359+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10501a21d0 con 0x7f10501060a0 2024-05-08T07:39:40.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.361+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1050106e20 con 0x7f10501060a0 2024-05-08T07:39:40.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.366+0000 7f104cc00700 1 -- 172.21.15.70:0/1158261424 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f103c028070 con 0x7f10501060a0 2024-05-08T07:39:40.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.368+0000 7f104cc00700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10340b2b40 0x7f10340b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.368+0000 7f104cc00700 1 -- 172.21.15.70:0/1158261424 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 9583+0+0 (secure 0 0 0) 0x7f103c0e3530 con 0x7f10501060a0 2024-05-08T07:39:40.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.368+0000 7f104fe00700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10340b2b40 0x7f10340b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:40.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.369+0000 7f104fe00700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10340b2b40 0x7f10340b5000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1040005fd0 tx=0x7f1040009310 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:40.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.376+0000 7f104cc00700 1 -- 172.21.15.70:0/1158261424 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f103c013030 con 0x7f10501060a0 2024-05-08T07:39:40.377 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/netlink.o 2024-05-08T07:39:40.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.889+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10501109b0 con 0x7f10501060a0 2024-05-08T07:39:40.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.890+0000 7f104cc00700 1 -- 172.21.15.70:0/1158261424 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f103c0aab80 con 0x7f10501060a0 2024-05-08T07:39:40.887 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:39:40.887 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:39:40.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.893+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10340b2b40 msgr2=0x7f10340b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:40.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10340b2b40 0x7f10340b5000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1040005fd0 tx=0x7f1040009310 comp rx=0 tx=0).stop 2024-05-08T07:39:40.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10501060a0 msgr2=0x7f105010f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:40.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10501060a0 0x7f105010f480 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f103c005950 tx=0x7f103c00b790 comp rx=0 tx=0).stop 2024-05-08T07:39:40.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 shutdown_connections 2024-05-08T07:39:40.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10340b2b40 0x7f10340b5000 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:40.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f105010b6e0 0x7f105010f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:40.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f10501056e0 0x7f10501123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:40.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 --2- 172.21.15.70:0/1158261424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10501060a0 0x7f105010f480 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:40.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 >> 172.21.15.70:0/1158261424 conn(0x7f10501011d0 msgr2=0x7f10501016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:40.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 shutdown_connections 2024-05-08T07:39:40.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:40.894+0000 7f1057000700 1 -- 172.21.15.70:0/1158261424 wait complete. 2024-05-08T07:39:40.893 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:39:41.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:41 smithi070 ceph-mon[29591]: pgmap v1688: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 37 KiB/s wr, 9 op/s 2024-05-08T07:39:41.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:41 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1158261424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:39:41.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:41 smithi172 ceph-mon[33377]: pgmap v1688: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 37 KiB/s wr, 9 op/s 2024-05-08T07:39:41.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:41 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1158261424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:39:41.704 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 89.0 --await-for 42.0' 2024-05-08T07:39:41.704 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 89.0 --await-for 42.0 2024-05-08T07:39:41.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:41 smithi194 ceph-mon[33679]: pgmap v1688: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 37 KiB/s wr, 9 op/s 2024-05-08T07:39:41.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:41 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1158261424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:39:42.266 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:39:43.465 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:43 smithi070 ceph-mon[29591]: pgmap v1689: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 113 KiB/s wr, 22 op/s 2024-05-08T07:39:43.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:43 smithi172 ceph-mon[33377]: pgmap v1689: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 113 KiB/s wr, 22 op/s 2024-05-08T07:39:43.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:43 smithi194 ceph-mon[33679]: pgmap v1689: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 113 KiB/s wr, 22 op/s 2024-05-08T07:39:45.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.567+0000 7f42e1800700 1 -- 172.21.15.70:0/2587038111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 msgr2=0x7f42dc06b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:45.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.567+0000 7f42e1800700 1 --2- 172.21.15.70:0/2587038111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 0x7f42dc06b7c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0099c0 tx=0x7f42cc009cd0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.567+0000 7f42e1800700 1 -- 172.21.15.70:0/2587038111 shutdown_connections 2024-05-08T07:39:45.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.567+0000 7f42e1800700 1 --2- 172.21.15.70:0/2587038111 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42dc108860 0x7f42dc1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.567+0000 7f42e1800700 1 --2- 172.21.15.70:0/2587038111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 0x7f42dc06b7c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.567+0000 7f42e1800700 1 --2- 172.21.15.70:0/2587038111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc06bd90 0x7f42dc108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.567+0000 7f42e1800700 1 -- 172.21.15.70:0/2587038111 >> 172.21.15.70:0/2587038111 conn(0x7f42dc079340 msgr2=0x7f42dc079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:45.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.568+0000 7f42e1800700 1 -- 172.21.15.70:0/2587038111 shutdown_connections 2024-05-08T07:39:45.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.568+0000 7f42e1800700 1 -- 172.21.15.70:0/2587038111 wait complete. 2024-05-08T07:39:45.567 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:45 smithi070 ceph-mon[29591]: pgmap v1690: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 125 KiB/s wr, 40 op/s 2024-05-08T07:39:45.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.569+0000 7f42e1800700 1 Processor -- start 2024-05-08T07:39:45.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.569+0000 7f42e1800700 1 -- start start 2024-05-08T07:39:45.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.570+0000 7f42e1800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 0x7f42dc102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.570+0000 7f42e1800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42dc06bd90 0x7f42dc1029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.570+0000 7f42e1800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc108860 0x7f42dc102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42daa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 0x7f42dc102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42db400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc108860 0x7f42dc102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.570+0000 7f42e1800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc1134e0 con 0x7f42dc06b3e0 2024-05-08T07:39:45.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42e1800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc113360 con 0x7f42dc06bd90 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42daa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 0x7f42dc102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56456/0 (socket says 172.21.15.70:56456) 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42e1800700 1 -- 172.21.15.70:0/126498171 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc113660 con 0x7f42dc108860 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42daa00700 1 -- 172.21.15.70:0/126498171 learned_addr learned my addr 172.21.15.70:0/126498171 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42da000700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42dc06bd90 0x7f42dc1029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42daa00700 1 -- 172.21.15.70:0/126498171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc108860 msgr2=0x7f42dc102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42daa00700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc108860 0x7f42dc102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42daa00700 1 -- 172.21.15.70:0/126498171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42dc06bd90 msgr2=0x7f42dc1029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.571+0000 7f42daa00700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42dc06bd90 0x7f42dc1029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.572+0000 7f42daa00700 1 -- 172.21.15.70:0/126498171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc1a7ea0 con 0x7f42dc06b3e0 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.572+0000 7f42daa00700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 0x7f42dc102470 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006010 tx=0x7f42cc0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.572+0000 7f42d3400700 1 -- 172.21.15.70:0/126498171 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc026070 con 0x7f42dc06b3e0 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.573+0000 7f42e1800700 1 -- 172.21.15.70:0/126498171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42dc1a8130 con 0x7f42dc06b3e0 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.573+0000 7f42d3400700 1 -- 172.21.15.70:0/126498171 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42cc00f460 con 0x7f42dc06b3e0 2024-05-08T07:39:45.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.573+0000 7f42d3400700 1 -- 172.21.15.70:0/126498171 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc009e60 con 0x7f42dc06b3e0 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.573+0000 7f42e1800700 1 -- 172.21.15.70:0/126498171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc1a85e0 con 0x7f42dc06b3e0 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.577+0000 7f42d3400700 1 -- 172.21.15.70:0/126498171 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f42cc029070 con 0x7f42dc06b3e0 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.579+0000 7f42d3400700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42c00b2b20 0x7f42c00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.580+0000 7f42d3400700 1 -- 172.21.15.70:0/126498171 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 9583+0+0 (secure 0 0 0) 0x7f42cc0e32e0 con 0x7f42dc06b3e0 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.580+0000 7f42da000700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42c00b2b20 0x7f42c00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.581+0000 7f42da000700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42c00b2b20 0x7f42c00b4fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f42c8005950 tx=0x7f42c80058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.603+0000 7f42ec1dcb80 1 Processor -- start 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.604+0000 7f42ec1dcb80 1 -- start start 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.604+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c8f10 0x55a4438c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.604+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c9830 0x55a4438c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.604+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 0x55a4438c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.604+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a443804bb0 con 0x55a4438c9830 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.604+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a4437a28f0 con 0x55a4438c8f10 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.604+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a443800b70 con 0x55a4438c3b50 2024-05-08T07:39:45.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.605+0000 7f42daa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c8f10 0x55a4438c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.605+0000 7f42da000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c9830 0x55a4438c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.605+0000 7f42da000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c9830 0x55a4438c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56470/0 (socket says 172.21.15.70:56470) 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.605+0000 7f42da000700 1 -- 172.21.15.70:0/3130364818 learned_addr learned my addr 172.21.15.70:0/3130364818 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.605+0000 7f42db400700 1 --2- 172.21.15.70:0/3130364818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 0x55a4438c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.606+0000 7f42da000700 1 -- 172.21.15.70:0/3130364818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 msgr2=0x55a4438c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.606+0000 7f42da000700 1 --2- 172.21.15.70:0/3130364818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 0x55a4438c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.606+0000 7f42da000700 1 -- 172.21.15.70:0/3130364818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c8f10 msgr2=0x55a4438c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.606+0000 7f42da000700 1 --2- 172.21.15.70:0/3130364818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c8f10 0x55a4438c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.606+0000 7f42da000700 1 -- 172.21.15.70:0/3130364818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a443751a60 con 0x55a4438c9830 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.607+0000 7f42da000700 1 --2- 172.21.15.70:0/3130364818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c9830 0x55a4438c3530 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f42c800ec20 tx=0x7f42c8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c12ed3dcce0716 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.607+0000 7f42c7e00700 1 -- 172.21.15.70:0/3130364818 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8011b00 con 0x55a4438c9830 2024-05-08T07:39:45.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.607+0000 7f42c7e00700 1 -- 172.21.15.70:0/3130364818 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c8023070 con 0x55a4438c9830 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.607+0000 7f42c7e00700 1 -- 172.21.15.70:0/3130364818 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c80103d0 con 0x55a4438c9830 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.608+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3130364818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c9830 msgr2=0x55a4438c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.608+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3130364818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c9830 0x55a4438c3530 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f42c800ec20 tx=0x7f42c8011000 comp rx=0 tx=0).stop 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.608+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3130364818 shutdown_connections 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.608+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3130364818 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 0x55a4438c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.608+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3130364818 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c8f10 0x55a4438c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.608+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3130364818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c9830 0x55a4438c3530 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.608+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3130364818 >> 172.21.15.70:0/3130364818 conn(0x55a4437e0cf0 msgr2=0x55a4438ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.609+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3130364818 shutdown_connections 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.609+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3130364818 wait complete. 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.609+0000 7f42ec1dcb80 1 -- start start 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.609+0000 7f42ec1dcb80 1 Processor -- start 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.610+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.611+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c8f10 0x55a4438cc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.611+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.611+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a4438d0290 con 0x55a4438c3b50 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.611+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a44376acb0 con 0x55a4438c9830 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.611+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a4438d0410 con 0x55a4438c8f10 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.611+0000 7f42ec1dcb80 10 client.0 _ll_register_callbacks cb 0x55a4437abe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.612+0000 7f42db400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.612+0000 7f42daa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.612+0000 7f42db400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:50704/0 (socket says 172.21.15.70:50704) 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.612+0000 7f42db400700 1 -- 172.21.15.70:0/675194712 learned_addr learned my addr 172.21.15.70:0/675194712 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.612+0000 7f42da000700 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c8f10 0x55a4438cc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.613+0000 7f42daa00700 1 -- 172.21.15.70:0/675194712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c8f10 msgr2=0x55a4438cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.613+0000 7f42daa00700 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c8f10 0x55a4438cc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.613+0000 7f42daa00700 1 -- 172.21.15.70:0/675194712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 msgr2=0x55a4438ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.613+0000 7f42daa00700 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.613+0000 7f42daa00700 1 -- 172.21.15.70:0/675194712 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4437ca5b0 con 0x55a4438c3b50 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.613+0000 7f42db400700 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.613+0000 7f42daa00700 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438cf5c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0e05b0 tx=0x7f42cc0e0ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fb4cdbc6fb9581 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.613+0000 7f42c4c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.614+0000 7f42c4c00700 1 -- 172.21.15.70:0/675194712 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0aa1d0 con 0x55a4438c3b50 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.614+0000 7f42c4c00700 1 -- 172.21.15.70:0/675194712 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(185..185 src has 1..185) ==== 9583+0+0 (secure 0 0 0) 0x7f42cc0aa640 con 0x55a4438c3b50 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.614+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/675194712 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c8023070 con 0x55a4438c3b50 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.614+0000 7f42c4c00700 1 -- 172.21.15.70:0/675194712 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f42cc0ae580 con 0x55a4438c3b50 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.614+0000 7f42ec1dcb80 10 client.16986 fetch_fsmap learned FSMap version 42 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.614+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/675194712 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a4438e3430 con 0x55a4438c3b50 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.615+0000 7f42c4c00700 1 -- 172.21.15.70:0/675194712 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c8023070 con 0x55a4438c3b50 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.615+0000 7f42c4c00700 1 -- 172.21.15.70:0/675194712 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f42cc0a5b40 con 0x55a4438c3b50 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.615+0000 7f42ec1dcb80 10 client.16986 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.615+0000 7f42ec1dcb80 10 client.16986 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:39:45.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.615+0000 7f42ec1dcb80 20 client.16986 populate_metadata read hostname 'smithi070' 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.615+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a4438e5900 0x55a4438e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.615+0000 7f42ec1dcb80 4 client.16986 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.615+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/675194712 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a44387f230 con 0x55a4438e5900 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.616+0000 7f42da000700 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a4438e5900 0x55a4438e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.617+0000 7f42da000700 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a4438e5900 0x55a4438e7cf0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a2777eae1c69978 server_cookie=24dd72c579bee6b4 in_seq=0 out_seq=0 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.617+0000 7f42c4c00700 10 client.16986 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.620+0000 7f42c4c00700 1 -- 172.21.15.70:0/675194712 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a44387f230 con 0x55a4438e5900 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.620+0000 7f42c4c00700 10 client.16986 handle_command_reply: tid=0 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.620+0000 7f42ec1dcb80 1 client.16986 shutdown 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/675194712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 msgr2=0x55a4438cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438cf5c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0e05b0 tx=0x7f42cc0e0ae0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/675194712 shutdown_connections 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a4438e5900 0x55a4438e7cf0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438cf5c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/675194712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c8f10 0x55a4438cc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/675194712 >> 172.21.15.70:0/675194712 conn(0x55a4437e0cf0 msgr2=0x55a4438a78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42c4c00700 0 client.16986 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:39:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.621+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/675194712 shutdown_connections 2024-05-08T07:39:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.622+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/675194712 wait complete. 2024-05-08T07:39:45.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.622+0000 7f42ec1dcb80 20 client.16986 trim_cache size 0 max 16384 2024-05-08T07:39:45.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.657+0000 7f42ec1dcb80 1 Processor -- start 2024-05-08T07:39:45.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42ec1dcb80 1 -- start start 2024-05-08T07:39:45.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 0x55a4438e1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c8f10 0x55a4438ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438edae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc074220 con 0x55a4438c8f10 2024-05-08T07:39:45.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc071ab0 con 0x55a4438c9830 2024-05-08T07:39:45.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc06f940 con 0x55a4438c3b50 2024-05-08T07:39:45.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42da000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c8f10 0x55a4438ed5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42da000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c8f10 0x55a4438ed5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56488/0 (socket says 172.21.15.70:56488) 2024-05-08T07:39:45.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.658+0000 7f42da000700 1 -- 172.21.15.70:0/777412171 learned_addr learned my addr 172.21.15.70:0/777412171 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:45.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.659+0000 7f42daa00700 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 0x55a4438e1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.659+0000 7f42db400700 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.659+0000 7f42da000700 1 -- 172.21.15.70:0/777412171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 msgr2=0x55a4438e1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:45.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.659+0000 7f42da000700 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 0x55a4438e1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.659+0000 7f42da000700 1 -- 172.21.15.70:0/777412171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 msgr2=0x55a4438edae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:45.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.660+0000 7f42da000700 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438edae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.660+0000 7f42da000700 1 -- 172.21.15.70:0/777412171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4438e8340 con 0x55a4438c8f10 2024-05-08T07:39:45.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.660+0000 7f42db400700 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:39:45.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.660+0000 7f42da000700 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c8f10 0x55a4438ed5a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f42c8013040 tx=0x7f42c80097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b78c7edff558a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:45.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.661+0000 7f42c7400700 1 -- 172.21.15.70:0/777412171 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8038070 con 0x55a4438c8f10 2024-05-08T07:39:45.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.661+0000 7f42c7400700 1 -- 172.21.15.70:0/777412171 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c8023050 con 0x55a4438c8f10 2024-05-08T07:39:45.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.661+0000 7f42c7400700 1 -- 172.21.15.70:0/777412171 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8032400 con 0x55a4438c8f10 2024-05-08T07:39:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.663+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/777412171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c8f10 msgr2=0x55a4438ed5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:39:45.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.663+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c8f10 0x55a4438ed5a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f42c8013040 tx=0x7f42c80097d0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.663+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/777412171 shutdown_connections 2024-05-08T07:39:45.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.663+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a4438edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.663+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c3b50 0x55a4438e1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.663+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/777412171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c8f10 0x55a4438ed5a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.663+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/777412171 >> 172.21.15.70:0/777412171 conn(0x55a4437e0cf0 msgr2=0x55a4438ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:39:45.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.663+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/777412171 shutdown_connections 2024-05-08T07:39:45.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.664+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/777412171 wait complete. 2024-05-08T07:39:45.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.664+0000 7f42ec1dcb80 1 -- start start 2024-05-08T07:39:45.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.664+0000 7f42ec1dcb80 1 Processor -- start 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438db2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c8f10 0x55a4438db800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42ec1dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a443950160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc06ff90 con 0x55a4438c3b50 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc0713e0 con 0x55a4438c9830 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42ec1dcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc070640 con 0x55a4438c8f10 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42ec1dcb80 10 client.0 _ll_register_callbacks cb 0x55a4437abe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42daa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438db2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42daa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438db2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56500/0 (socket says 172.21.15.70:56500) 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.665+0000 7f42daa00700 1 -- 172.21.15.70:0/3511429374 learned_addr learned my addr 172.21.15.70:0/3511429374 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.666+0000 7f42daa00700 1 -- 172.21.15.70:0/3511429374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c8f10 msgr2=0x55a4438db800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.666+0000 7f42daa00700 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c8f10 0x55a4438db800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.666+0000 7f42daa00700 1 -- 172.21.15.70:0/3511429374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 msgr2=0x55a443950160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:39:45.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.666+0000 7f42daa00700 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a443950160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:39:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.666+0000 7f42daa00700 1 -- 172.21.15.70:0/3511429374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a443950720 con 0x55a4438c3b50 2024-05-08T07:39:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.666+0000 7f42daa00700 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438db2c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0213e0 tx=0x7f42cc0e3160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25033d4f5b87333 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:39:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.666+0000 7f42c4c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:39:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.667+0000 7f42c4c00700 1 -- 172.21.15.70:0/3511429374 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0a9fa0 con 0x55a4438c3b50 2024-05-08T07:39:45.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.667+0000 7f42c4c00700 1 -- 172.21.15.70:0/3511429374 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(185..185 src has 1..185) ==== 9583+0+0 (secure 0 0 0) 0x7f42cc0b2b10 con 0x55a4438c3b50 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.667+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3511429374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c8023050 con 0x55a4438c3b50 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.667+0000 7f42c4c00700 1 -- 172.21.15.70:0/3511429374 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f42cc0aa1d0 con 0x55a4438c3b50 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.667+0000 7f42ec1dcb80 10 client.16992 fetch_fsmap learned FSMap version 42 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.667+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3511429374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a4439519e0 con 0x55a4438c3b50 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.668+0000 7f42c4c00700 1 -- 172.21.15.70:0/3511429374 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c8023050 con 0x55a4438c3b50 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.669+0000 7f42c4c00700 1 -- 172.21.15.70:0/3511429374 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f42cc0c4a30 con 0x55a4438c3b50 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.669+0000 7f42ec1dcb80 10 client.16992 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.669+0000 7f42ec1dcb80 10 client.16992 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.669+0000 7f42ec1dcb80 20 client.16992 populate_metadata read hostname 'smithi070' 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.669+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a443951f80 0x55a4439543e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.669+0000 7f42ec1dcb80 4 client.16992 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.0, "await_for": 42.0}] 2024-05-08T07:39:45.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.669+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3511429374 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.0, "await_for": 42.0}) -- 0x55a443812590 con 0x55a443951f80 2024-05-08T07:39:45.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.670+0000 7f42da000700 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a443951f80 0x55a4439543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:39:45.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.670+0000 7f42da000700 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a443951f80 0x55a4439543e0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ff51d0f0ada7a1 server_cookie=8b22a4e1f265a997 in_seq=0 out_seq=0 2024-05-08T07:39:45.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:39:45.670+0000 7f42c4c00700 10 client.16992 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:39:45.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:45 smithi172 ceph-mon[33377]: pgmap v1690: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 125 KiB/s wr, 40 op/s 2024-05-08T07:39:45.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:45 smithi194 ceph-mon[33679]: pgmap v1690: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 125 KiB/s wr, 40 op/s 2024-05-08T07:39:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:47 smithi070 ceph-mon[29591]: pgmap v1691: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 228 KiB/s wr, 91 op/s 2024-05-08T07:39:47.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:47 smithi172 ceph-mon[33377]: pgmap v1691: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 228 KiB/s wr, 91 op/s 2024-05-08T07:39:47.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:47 smithi194 ceph-mon[33679]: pgmap v1691: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 228 KiB/s wr, 91 op/s 2024-05-08T07:39:49.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:49 smithi070 ceph-mon[29591]: pgmap v1692: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 223 KiB/s wr, 89 op/s 2024-05-08T07:39:49.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:49 smithi172 ceph-mon[33377]: pgmap v1692: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 223 KiB/s wr, 89 op/s 2024-05-08T07:39:49.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:49 smithi194 ceph-mon[33679]: pgmap v1692: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 223 KiB/s wr, 89 op/s 2024-05-08T07:39:51.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:51 smithi172 ceph-mon[33377]: pgmap v1693: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 267 KiB/s wr, 166 op/s 2024-05-08T07:39:51.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:51 smithi194 ceph-mon[33679]: pgmap v1693: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 267 KiB/s wr, 166 op/s 2024-05-08T07:39:51.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:51 smithi070 ceph-mon[29591]: pgmap v1693: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 267 KiB/s wr, 166 op/s 2024-05-08T07:39:53.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:53 smithi172 ceph-mon[33377]: pgmap v1694: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 359 KiB/s wr, 193 op/s 2024-05-08T07:39:53.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:53 smithi194 ceph-mon[33679]: pgmap v1694: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 359 KiB/s wr, 193 op/s 2024-05-08T07:39:53.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:53 smithi070 ceph-mon[29591]: pgmap v1694: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 359 KiB/s wr, 193 op/s 2024-05-08T07:39:55.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:55 smithi172 ceph-mon[33377]: pgmap v1695: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 307 KiB/s wr, 181 op/s 2024-05-08T07:39:55.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:55 smithi194 ceph-mon[33679]: pgmap v1695: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 307 KiB/s wr, 181 op/s 2024-05-08T07:39:55.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:55 smithi070 ceph-mon[29591]: pgmap v1695: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 307 KiB/s wr, 181 op/s 2024-05-08T07:39:57.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:57 smithi172 ceph-mon[33377]: pgmap v1696: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 299 KiB/s wr, 164 op/s 2024-05-08T07:39:57.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:57 smithi194 ceph-mon[33679]: pgmap v1696: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 299 KiB/s wr, 164 op/s 2024-05-08T07:39:57.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:57 smithi070 ceph-mon[29591]: pgmap v1696: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 299 KiB/s wr, 164 op/s 2024-05-08T07:39:59.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:39:59 smithi172 ceph-mon[33377]: pgmap v1697: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 196 KiB/s wr, 111 op/s 2024-05-08T07:39:59.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:39:59 smithi194 ceph-mon[33679]: pgmap v1697: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 196 KiB/s wr, 111 op/s 2024-05-08T07:39:59.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:39:59 smithi070 ceph-mon[29591]: pgmap v1697: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 196 KiB/s wr, 111 op/s 2024-05-08T07:40:00.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T07:40:00.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T07:40:00.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T07:40:01.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:01 smithi172 ceph-mon[33377]: pgmap v1698: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 199 KiB/s wr, 113 op/s 2024-05-08T07:40:01.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:01 smithi194 ceph-mon[33679]: pgmap v1698: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 199 KiB/s wr, 113 op/s 2024-05-08T07:40:01.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:01 smithi070 ceph-mon[29591]: pgmap v1698: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 199 KiB/s wr, 113 op/s 2024-05-08T07:40:03.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:03 smithi172 ceph-mon[33377]: pgmap v1699: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 156 KiB/s wr, 39 op/s 2024-05-08T07:40:03.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:03 smithi194 ceph-mon[33679]: pgmap v1699: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 156 KiB/s wr, 39 op/s 2024-05-08T07:40:03.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:03 smithi070 ceph-mon[29591]: pgmap v1699: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 156 KiB/s wr, 39 op/s 2024-05-08T07:40:05.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:05 smithi194 ceph-mon[33679]: pgmap v1700: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 KiB/s wr, 9 op/s 2024-05-08T07:40:05.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:05 smithi070 ceph-mon[29591]: pgmap v1700: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 KiB/s wr, 9 op/s 2024-05-08T07:40:05.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:05 smithi172 ceph-mon[33377]: pgmap v1700: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 49 KiB/s wr, 9 op/s 2024-05-08T07:40:07.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.131+0000 7f42c4c00700 1 -- 172.21.15.70:0/3511429374 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55a443812590 con 0x55a443951f80 2024-05-08T07:40:07.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.131+0000 7f42c4c00700 10 client.16992 handle_command_reply: tid=0 2024-05-08T07:40:07.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.131+0000 7f42ec1dcb80 1 client.16992 shutdown 2024-05-08T07:40:07.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.132+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3511429374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 msgr2=0x55a4438db2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:07.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.132+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438db2c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0213e0 tx=0x7f42cc0e3160 comp rx=0 tx=0).stop 2024-05-08T07:40:07.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.132+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3511429374 shutdown_connections 2024-05-08T07:40:07.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.132+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a443951f80 0x55a4439543e0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.132+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a4438c9830 0x55a443950160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.132+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a4438c3b50 0x55a4438db2c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.132+0000 7f42ec1dcb80 1 --2- 172.21.15.70:0/3511429374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a4438c8f10 0x55a4438db800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.132+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3511429374 >> 172.21.15.70:0/3511429374 conn(0x55a4437e0cf0 msgr2=0x55a4438c9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:07.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.132+0000 7f42c4c00700 0 client.16992 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:40:07.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.133+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3511429374 shutdown_connections 2024-05-08T07:40:07.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.133+0000 7f42ec1dcb80 1 -- 172.21.15.70:0/3511429374 wait complete. 2024-05-08T07:40:07.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.133+0000 7f42ec1dcb80 20 client.16992 trim_cache size 0 max 16384 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 134, 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout: "808501c7": { 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 134, 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:40:07.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 89.0, 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:07.133 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:07.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:07.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:07.134 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:07.134 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:40:07.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.136+0000 7f42e1800700 1 -- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42c00b2b20 msgr2=0x7f42c00b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.136+0000 7f42e1800700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42c00b2b20 0x7f42c00b4fe0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f42c8005950 tx=0x7f42c80058e0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.136+0000 7f42e1800700 1 -- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 msgr2=0x7f42dc102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.136+0000 7f42e1800700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 0x7f42dc102470 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f42cc006010 tx=0x7f42cc0055f0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.136+0000 7f42e1800700 1 -- 172.21.15.70:0/126498171 shutdown_connections 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.136+0000 7f42e1800700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42c00b2b20 0x7f42c00b4fe0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.136+0000 7f42e1800700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42dc108860 0x7f42dc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.137+0000 7f42e1800700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42dc06b3e0 0x7f42dc102470 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.137+0000 7f42e1800700 1 --2- 172.21.15.70:0/126498171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42dc06bd90 0x7f42dc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.137+0000 7f42e1800700 1 -- 172.21.15.70:0/126498171 >> 172.21.15.70:0/126498171 conn(0x7f42dc079340 msgr2=0x7f42dc1005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.137+0000 7f42e1800700 1 -- 172.21.15.70:0/126498171 shutdown_connections 2024-05-08T07:40:07.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:07.137+0000 7f42e1800700 1 -- 172.21.15.70:0/126498171 wait complete. 2024-05-08T07:40:07.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:07 smithi194 ceph-mon[33679]: pgmap v1701: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 KiB/s wr, 15 op/s 2024-05-08T07:40:07.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:07 smithi070 ceph-mon[29591]: pgmap v1701: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 KiB/s wr, 15 op/s 2024-05-08T07:40:07.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:07 smithi172 ceph-mon[33377]: pgmap v1701: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 35 KiB/s wr, 15 op/s 2024-05-08T07:40:08.093 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '808501c7', quiesce took 30.6 seconds. Will release after: 29.0 2024-05-08T07:40:09.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:09 smithi194 ceph-mon[33679]: pgmap v1702: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-05-08T07:40:09.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:09 smithi070 ceph-mon[29591]: pgmap v1702: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-05-08T07:40:09.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:09 smithi172 ceph-mon[33377]: pgmap v1702: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 32 KiB/s wr, 13 op/s 2024-05-08T07:40:11.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:11 smithi194 ceph-mon[33679]: pgmap v1703: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 86 KiB/s wr, 18 op/s 2024-05-08T07:40:11.778 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:11 smithi070 ceph-mon[29591]: pgmap v1703: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 86 KiB/s wr, 18 op/s 2024-05-08T07:40:11.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:11 smithi172 ceph-mon[33377]: pgmap v1703: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 86 KiB/s wr, 18 op/s 2024-05-08T07:40:13.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:13 smithi194 ceph-mon[33679]: pgmap v1704: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 94 KiB/s wr, 24 op/s 2024-05-08T07:40:13.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:13 smithi070 ceph-mon[29591]: pgmap v1704: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 94 KiB/s wr, 24 op/s 2024-05-08T07:40:13.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:13 smithi172 ceph-mon[33377]: pgmap v1704: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 94 KiB/s wr, 24 op/s 2024-05-08T07:40:14.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:14 smithi194 ceph-mon[33679]: osdmap e186: 12 total, 12 up, 12 in 2024-05-08T07:40:14.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:14 smithi070 ceph-mon[29591]: osdmap e186: 12 total, 12 up, 12 in 2024-05-08T07:40:14.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:14 smithi172 ceph-mon[33377]: osdmap e186: 12 total, 12 up, 12 in 2024-05-08T07:40:15.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:15 smithi194 ceph-mon[33679]: pgmap v1706: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 101 KiB/s wr, 26 op/s 2024-05-08T07:40:15.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:15 smithi070 ceph-mon[29591]: pgmap v1706: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 101 KiB/s wr, 26 op/s 2024-05-08T07:40:15.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:15 smithi172 ceph-mon[33377]: pgmap v1706: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 101 KiB/s wr, 26 op/s 2024-05-08T07:40:17.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:17 smithi194 ceph-mon[33679]: pgmap v1707: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 89 KiB/s wr, 18 op/s 2024-05-08T07:40:17.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:40:17.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:17 smithi070 ceph-mon[29591]: pgmap v1707: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 89 KiB/s wr, 18 op/s 2024-05-08T07:40:17.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:40:17.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:17 smithi172 ceph-mon[33377]: pgmap v1707: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 89 KiB/s wr, 18 op/s 2024-05-08T07:40:17.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:40:19.561 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:19 smithi070 ceph-mon[29591]: pgmap v1708: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 89 KiB/s wr, 18 op/s 2024-05-08T07:40:19.561 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:19 smithi070 ceph-mon[29591]: osdmap e187: 12 total, 12 up, 12 in 2024-05-08T07:40:19.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:19 smithi172 ceph-mon[33377]: pgmap v1708: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 89 KiB/s wr, 18 op/s 2024-05-08T07:40:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:19 smithi172 ceph-mon[33377]: osdmap e187: 12 total, 12 up, 12 in 2024-05-08T07:40:19.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:19 smithi194 ceph-mon[33679]: pgmap v1708: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 89 KiB/s wr, 18 op/s 2024-05-08T07:40:19.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:19 smithi194 ceph-mon[33679]: osdmap e187: 12 total, 12 up, 12 in 2024-05-08T07:40:21.492 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:21 smithi070 ceph-mon[29591]: pgmap v1710: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 6 op/s 2024-05-08T07:40:21.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:21 smithi172 ceph-mon[33377]: pgmap v1710: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 6 op/s 2024-05-08T07:40:21.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:21 smithi194 ceph-mon[33679]: pgmap v1710: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 6 op/s 2024-05-08T07:40:23.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:23 smithi070 ceph-mon[29591]: pgmap v1711: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 7 op/s 2024-05-08T07:40:23.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:23 smithi172 ceph-mon[33377]: pgmap v1711: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 7 op/s 2024-05-08T07:40:23.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:23 smithi194 ceph-mon[33679]: pgmap v1711: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 31 KiB/s wr, 7 op/s 2024-05-08T07:40:25.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:25 smithi172 ceph-mon[33377]: pgmap v1712: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:40:25.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:25.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:25.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:25 smithi070 ceph-mon[29591]: pgmap v1712: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:40:25.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:25.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:25.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:25 smithi194 ceph-mon[33679]: pgmap v1712: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:40:25.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:25.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:27.491 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:27 smithi172 ceph-mon[33377]: pgmap v1713: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:40:27.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:27 smithi070 ceph-mon[29591]: pgmap v1713: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:40:27.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:27 smithi194 ceph-mon[33679]: pgmap v1713: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:40:29.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:29 smithi070 ceph-mon[29591]: pgmap v1714: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:40:29.628 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:29 smithi172 ceph-mon[33377]: pgmap v1714: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:40:29.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:29 smithi194 ceph-mon[33679]: pgmap v1714: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T07:40:31.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:31 smithi070 ceph-mon[29591]: pgmap v1715: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T07:40:31.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:31.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:31.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:40:31.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:40:31.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:31.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:31 smithi172 ceph-mon[33377]: pgmap v1715: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T07:40:31.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:31.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:31.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:40:31.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:40:31.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:32.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:31 smithi194 ceph-mon[33679]: pgmap v1715: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T07:40:32.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:32.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:32.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:40:32.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:40:32.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:40:33.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:33 smithi070 ceph-mon[29591]: pgmap v1716: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T07:40:33.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:33 smithi172 ceph-mon[33377]: pgmap v1716: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T07:40:34.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:33 smithi194 ceph-mon[33679]: pgmap v1716: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T07:40:35.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:35 smithi070 ceph-mon[29591]: pgmap v1717: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T07:40:35.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:35 smithi172 ceph-mon[33377]: pgmap v1717: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T07:40:36.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:35 smithi194 ceph-mon[33679]: pgmap v1717: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-08T07:40:37.095 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:40:37.542 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:40:37.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:37 smithi070 ceph-mon[29591]: pgmap v1718: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T07:40:37.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:37 smithi172 ceph-mon[33377]: pgmap v1718: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T07:40:38.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:37 smithi194 ceph-mon[33679]: pgmap v1718: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T07:40:39.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:39 smithi172 ceph-mon[33377]: pgmap v1719: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:40:39.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.698+0000 7f0624c00700 1 -- 172.21.15.70:0/4258890974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 msgr2=0x7f0620110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:39.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.698+0000 7f0624c00700 1 --2- 172.21.15.70:0/4258890974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 0x7f0620110330 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f061800b0a0 tx=0x7f061800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.699+0000 7f0624c00700 1 -- 172.21.15.70:0/4258890974 shutdown_connections 2024-05-08T07:40:39.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.699+0000 7f0624c00700 1 --2- 172.21.15.70:0/4258890974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 0x7f0620110330 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.699+0000 7f0624c00700 1 --2- 172.21.15.70:0/4258890974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0620109510 0x7f06201098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.699+0000 7f0624c00700 1 --2- 172.21.15.70:0/4258890974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062006b180 0x7f062006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.699+0000 7f0624c00700 1 -- 172.21.15.70:0/4258890974 >> 172.21.15.70:0/4258890974 conn(0x7f0620079350 msgr2=0x7f0620079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:39.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.699+0000 7f0624c00700 1 -- 172.21.15.70:0/4258890974 shutdown_connections 2024-05-08T07:40:39.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.699+0000 7f0624c00700 1 -- 172.21.15.70:0/4258890974 wait complete. 2024-05-08T07:40:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.700+0000 7f0624c00700 1 Processor -- start 2024-05-08T07:40:39.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.700+0000 7f0624c00700 1 -- start start 2024-05-08T07:40:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f0624c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062006b180 0x7f06201a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f0624c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 0x7f06201a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:39.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f0624c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0620109510 0x7f062019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f0624c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0620113540 con 0x7f062006bb40 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f0624c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06201133c0 con 0x7f0620109510 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f0624c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f06201136c0 con 0x7f062006b180 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f061d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 0x7f06201a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f061d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 0x7f06201a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59280/0 (socket says 172.21.15.70:59280) 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f061d400700 1 -- 172.21.15.70:0/1198180571 learned_addr learned my addr 172.21.15.70:0/1198180571 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f061de00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062006b180 0x7f06201a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.701+0000 7f061e800700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0620109510 0x7f062019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f061d400700 1 -- 172.21.15.70:0/1198180571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062006b180 msgr2=0x7f06201a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f061d400700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062006b180 0x7f06201a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f061d400700 1 -- 172.21.15.70:0/1198180571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0620109510 msgr2=0x7f062019bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f061d400700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0620109510 0x7f062019bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f061d400700 1 -- 172.21.15.70:0/1198180571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062019c220 con 0x7f062006bb40 2024-05-08T07:40:39.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f061de00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062006b180 0x7f06201a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:40:39.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f061d400700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 0x7f06201a1e40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f060c00d980 tx=0x7f060c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:40:39.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f0616a00700 1 -- 172.21.15.70:0/1198180571 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c017070 con 0x7f062006bb40 2024-05-08T07:40:39.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f0616a00700 1 -- 172.21.15.70:0/1198180571 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f060c004830 con 0x7f062006bb40 2024-05-08T07:40:39.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f0616a00700 1 -- 172.21.15.70:0/1198180571 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c0053a0 con 0x7f062006bb40 2024-05-08T07:40:39.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.702+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f062019c510 con 0x7f062006bb40 2024-05-08T07:40:39.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.703+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06201a87d0 con 0x7f062006bb40 2024-05-08T07:40:39.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.704+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f062006a190 con 0x7f062006bb40 2024-05-08T07:40:39.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.707+0000 7f0616a00700 1 -- 172.21.15.70:0/1198180571 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f060c0049e0 con 0x7f062006bb40 2024-05-08T07:40:39.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.708+0000 7f0616a00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06040b2a70 0x7f06040b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:39.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.709+0000 7f0616a00700 1 -- 172.21.15.70:0/1198180571 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 9583+0+0 (secure 0 0 0) 0x7f060c0e2dc0 con 0x7f062006bb40 2024-05-08T07:40:39.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.709+0000 7f061de00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06040b2a70 0x7f06040b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:39.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.709+0000 7f061de00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06040b2a70 0x7f06040b4f30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0610005e10 tx=0x7f0610005d60 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:40:39.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.710+0000 7f0616a00700 1 -- 172.21.15.70:0/1198180571 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f060c020020 con 0x7f062006bb40 2024-05-08T07:40:39.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:39 smithi070 ceph-mon[29591]: pgmap v1719: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:40:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.992+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06201a8a00 con 0x7f062006bb40 2024-05-08T07:40:39.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.993+0000 7f0616a00700 1 -- 172.21.15.70:0/1198180571 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f060c0aa3a0 con 0x7f062006bb40 2024-05-08T07:40:39.990 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:40:39.991 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:40:39.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.996+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06040b2a70 msgr2=0x7f06040b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.996+0000 7f0624c00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06040b2a70 0x7f06040b4f30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0610005e10 tx=0x7f0610005d60 comp rx=0 tx=0).stop 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.996+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 msgr2=0x7f06201a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.996+0000 7f0624c00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 0x7f06201a1e40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f060c00d980 tx=0x7f060c00dd40 comp rx=0 tx=0).stop 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.997+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 shutdown_connections 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.997+0000 7f0624c00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06040b2a70 0x7f06040b4f30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.997+0000 7f0624c00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0620109510 0x7f062019bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.997+0000 7f0624c00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f062006b180 0x7f06201a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.997+0000 7f0624c00700 1 --2- 172.21.15.70:0/1198180571 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f062006bb40 0x7f06201a1e40 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.997+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 >> 172.21.15.70:0/1198180571 conn(0x7f0620079350 msgr2=0x7f062010e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.997+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 shutdown_connections 2024-05-08T07:40:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:39.997+0000 7f0624c00700 1 -- 172.21.15.70:0/1198180571 wait complete. 2024-05-08T07:40:39.995 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:40:40.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:39 smithi194 ceph-mon[33679]: pgmap v1719: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:40:40.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:40 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1198180571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:40:40.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:40 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1198180571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:40:40.935 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 808501c7 --release --await' 2024-05-08T07:40:40.935 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 808501c7 --release --await 2024-05-08T07:40:41.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:40 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1198180571' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:40:41.374 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:40:41.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:41 smithi070 ceph-mon[29591]: pgmap v1720: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-08T07:40:41.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:41 smithi172 ceph-mon[33377]: pgmap v1720: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-08T07:40:42.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:41 smithi194 ceph-mon[33679]: pgmap v1720: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-05-08T07:40:43.607 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:43 smithi070 ceph-mon[29591]: pgmap v1721: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-05-08T07:40:43.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:43 smithi172 ceph-mon[33377]: pgmap v1721: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-05-08T07:40:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.937+0000 7f0148200700 1 -- 172.21.15.70:0/3726212851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140102530 msgr2=0x7f0140112220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.937+0000 7f0148200700 1 --2- 172.21.15.70:0/3726212851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140102530 0x7f0140112220 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f013800b0a0 tx=0x7f013800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.937+0000 7f0148200700 1 -- 172.21.15.70:0/3726212851 shutdown_connections 2024-05-08T07:40:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.937+0000 7f0148200700 1 --2- 172.21.15.70:0/3726212851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140102530 0x7f0140112220 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.937+0000 7f0148200700 1 --2- 172.21.15.70:0/3726212851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01401043b0 0x7f0140104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.937+0000 7f0148200700 1 --2- 172.21.15.70:0/3726212851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0140101a90 0x7f0140101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.937+0000 7f0148200700 1 -- 172.21.15.70:0/3726212851 >> 172.21.15.70:0/3726212851 conn(0x7f0140078a10 msgr2=0x7f01400ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.937+0000 7f0148200700 1 -- 172.21.15.70:0/3726212851 shutdown_connections 2024-05-08T07:40:43.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.937+0000 7f0148200700 1 -- 172.21.15.70:0/3726212851 wait complete. 2024-05-08T07:40:43.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.938+0000 7f0148200700 1 Processor -- start 2024-05-08T07:40:43.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.939+0000 7f0148200700 1 -- start start 2024-05-08T07:40:43.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.939+0000 7f0148200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140101a90 0x7f01401a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.939+0000 7f0148200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140102530 0x7f01401a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.939+0000 7f0148200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01401043b0 0x7f014019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.939+0000 7f0148200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0140115750 con 0x7f0140101a90 2024-05-08T07:40:43.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.939+0000 7f0148200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01401155d0 con 0x7f01401043b0 2024-05-08T07:40:43.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.939+0000 7f0148200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f01401158d0 con 0x7f0140102530 2024-05-08T07:40:43.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0145800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140101a90 0x7f01401a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0145800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140101a90 0x7f01401a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59294/0 (socket says 172.21.15.70:59294) 2024-05-08T07:40:43.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0145800700 1 -- 172.21.15.70:0/1198061993 learned_addr learned my addr 172.21.15.70:0/1198061993 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:40:43.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0144e00700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140102530 0x7f01401a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0146200700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01401043b0 0x7f014019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0145800700 1 -- 172.21.15.70:0/1198061993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140102530 msgr2=0x7f01401a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:43.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0145800700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140102530 0x7f01401a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0145800700 1 -- 172.21.15.70:0/1198061993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01401043b0 msgr2=0x7f014019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:43.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0145800700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01401043b0 0x7f014019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.940+0000 7f0145800700 1 -- 172.21.15.70:0/1198061993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f014019c110 con 0x7f0140101a90 2024-05-08T07:40:43.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.941+0000 7f0145800700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140101a90 0x7f01401a17f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f013400c9b0 tx=0x7f013400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:40:43.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.941+0000 7f013e000700 1 -- 172.21.15.70:0/1198061993 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134007b00 con 0x7f0140101a90 2024-05-08T07:40:43.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.941+0000 7f013e000700 1 -- 172.21.15.70:0/1198061993 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0134007ca0 con 0x7f0140101a90 2024-05-08T07:40:43.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.941+0000 7f0148200700 1 -- 172.21.15.70:0/1198061993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f014019c400 con 0x7f0140101a90 2024-05-08T07:40:43.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.941+0000 7f013e000700 1 -- 172.21.15.70:0/1198061993 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134018660 con 0x7f0140101a90 2024-05-08T07:40:43.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.941+0000 7f0148200700 1 -- 172.21.15.70:0/1198061993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01401a86c0 con 0x7f0140101a90 2024-05-08T07:40:43.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.945+0000 7f013e000700 1 -- 172.21.15.70:0/1198061993 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f013400f450 con 0x7f0140101a90 2024-05-08T07:40:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.946+0000 7f0152aceb80 1 Processor -- start 2024-05-08T07:40:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.946+0000 7f0152aceb80 1 -- start start 2024-05-08T07:40:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f013e000700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f01280b2a70 0x7f01280b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 0x555a24790590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2478ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 0x555a24796f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0152aceb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a246dcb20 con 0x555a2478a780 2024-05-08T07:40:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0152aceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555a2467a860 con 0x555a247901b0 2024-05-08T07:40:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0152aceb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555a246d8ae0 con 0x555a2478b140 2024-05-08T07:40:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f013e000700 1 -- 172.21.15.70:0/1198061993 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 9583+0+0 (secure 0 0 0) 0x7f01340e2a30 con 0x7f0140101a90 2024-05-08T07:40:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0144e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2478ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0146200700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f01280b2a70 0x7f01280b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0144e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2478ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59308/0 (socket says 172.21.15.70:59308) 2024-05-08T07:40:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0144e00700 1 -- 172.21.15.70:0/295513873 learned_addr learned my addr 172.21.15.70:0/295513873 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:40:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.947+0000 7f0145800700 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 0x555a24790590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0146200700 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 0x555a24796f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0144e00700 1 -- 172.21.15.70:0/295513873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 msgr2=0x555a24796f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0144e00700 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 0x555a24796f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0144e00700 1 -- 172.21.15.70:0/295513873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 msgr2=0x555a24790590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0144e00700 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 0x555a24790590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0144e00700 1 -- 172.21.15.70:0/295513873 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a246299d0 con 0x555a2478a780 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0146200700 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 0x555a24796f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0144e00700 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2478ac00 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f012c008c30 tx=0x7f012c008f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45786d26b4d7686 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0146200700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f01280b2a70 0x7f01280b4f30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f013800b070 tx=0x7f01380090d0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0132a00700 1 -- 172.21.15.70:0/295513873 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c014070 con 0x555a2478a780 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0132a00700 1 -- 172.21.15.70:0/295513873 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f012c00edc0 con 0x555a2478a780 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.948+0000 7f0132a00700 1 -- 172.21.15.70:0/295513873 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c010430 con 0x555a2478a780 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.949+0000 7f0152aceb80 1 -- 172.21.15.70:0/295513873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 msgr2=0x555a2478ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.949+0000 7f0152aceb80 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2478ac00 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f012c008c30 tx=0x7f012c008f40 comp rx=0 tx=0).stop 2024-05-08T07:40:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.949+0000 7f0152aceb80 1 -- 172.21.15.70:0/295513873 shutdown_connections 2024-05-08T07:40:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.949+0000 7f0152aceb80 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 0x555a24796f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.949+0000 7f0152aceb80 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 0x555a24790590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.949+0000 7f0152aceb80 1 --2- 172.21.15.70:0/295513873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2478ac00 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.949+0000 7f0152aceb80 1 -- 172.21.15.70:0/295513873 >> 172.21.15.70:0/295513873 conn(0x555a247027d0 msgr2=0x555a24785070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.950+0000 7f0152aceb80 1 -- 172.21.15.70:0/295513873 shutdown_connections 2024-05-08T07:40:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.950+0000 7f0152aceb80 1 -- 172.21.15.70:0/295513873 wait complete. 2024-05-08T07:40:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.950+0000 7f0152aceb80 1 -- start start 2024-05-08T07:40:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.950+0000 7f0152aceb80 1 Processor -- start 2024-05-08T07:40:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478a780 0x555a24796b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478b140 0x555a24793ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a247901b0 0x555a24794420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0152aceb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555a24797570 con 0x555a247901b0 2024-05-08T07:40:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0152aceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555a24642c20 con 0x555a2478b140 2024-05-08T07:40:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0152aceb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555a247976f0 con 0x555a2478a780 2024-05-08T07:40:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0152aceb80 10 client.0 _ll_register_callbacks cb 0x555a24683d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0146200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a247901b0 0x555a24794420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0146200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a247901b0 0x555a24794420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59314/0 (socket says 172.21.15.70:59314) 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.951+0000 7f0146200700 1 -- 172.21.15.70:0/12476808 learned_addr learned my addr 172.21.15.70:0/12476808 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0145800700 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478a780 0x555a24796b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0144e00700 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478b140 0x555a24793ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0146200700 1 -- 172.21.15.70:0/12476808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478a780 msgr2=0x555a24796b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0146200700 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478a780 0x555a24796b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0146200700 1 -- 172.21.15.70:0/12476808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478b140 msgr2=0x555a24793ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0146200700 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478b140 0x555a24793ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0146200700 1 -- 172.21.15.70:0/12476808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a246a2520 con 0x555a247901b0 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0146200700 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a247901b0 0x555a24794420 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0138007760 tx=0x7f01380099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70e7b795362eee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:40:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0127400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.952+0000 7f0127400700 1 -- 172.21.15.70:0/12476808 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0138030060 con 0x555a247901b0 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.953+0000 7f0127400700 1 -- 172.21.15.70:0/12476808 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 9583+0+0 (secure 0 0 0) 0x7f013801d860 con 0x555a247901b0 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.953+0000 7f0152aceb80 1 -- 172.21.15.70:0/12476808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f012c00edc0 con 0x555a247901b0 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.953+0000 7f0127400700 1 -- 172.21.15.70:0/12476808 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f0138037050 con 0x555a247901b0 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.953+0000 7f0152aceb80 10 client.17010 fetch_fsmap learned FSMap version 42 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.953+0000 7f0152aceb80 1 -- 172.21.15.70:0/12476808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555a247a1ca0 con 0x555a247901b0 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.953+0000 7f0127400700 1 -- 172.21.15.70:0/12476808 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f012c00edc0 con 0x555a247901b0 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.953+0000 7f0127400700 1 -- 172.21.15.70:0/12476808 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f0138011070 con 0x555a247901b0 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.953+0000 7f0152aceb80 10 client.17010 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.953+0000 7f0152aceb80 10 client.17010 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:40:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.954+0000 7f0152aceb80 20 client.17010 populate_metadata read hostname 'smithi070' 2024-05-08T07:40:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.954+0000 7f0152aceb80 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555a247a4230 0x555a247a6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.954+0000 7f0152aceb80 4 client.17010 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:40:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.954+0000 7f0152aceb80 1 -- 172.21.15.70:0/12476808 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a24757240 con 0x555a247a4230 2024-05-08T07:40:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.954+0000 7f0145800700 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555a247a4230 0x555a247a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.955+0000 7f0145800700 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555a247a4230 0x555a247a6660 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f2b06ac06dc1ef server_cookie=50581b9dcf9b2eaf in_seq=0 out_seq=0 2024-05-08T07:40:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.955+0000 7f0127400700 10 client.17010 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:40:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0127400700 1 -- 172.21.15.70:0/12476808 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555a24757240 con 0x555a247a4230 2024-05-08T07:40:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0127400700 10 client.17010 handle_command_reply: tid=0 2024-05-08T07:40:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0152aceb80 1 client.17010 shutdown 2024-05-08T07:40:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0152aceb80 1 -- 172.21.15.70:0/12476808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a247901b0 msgr2=0x555a24794420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0152aceb80 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a247901b0 0x555a24794420 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0138007760 tx=0x7f01380099e0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0152aceb80 1 -- 172.21.15.70:0/12476808 shutdown_connections 2024-05-08T07:40:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0152aceb80 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555a247a4230 0x555a247a6660 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0152aceb80 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a247901b0 0x555a24794420 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0152aceb80 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478a780 0x555a24796b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0152aceb80 1 --2- 172.21.15.70:0/12476808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478b140 0x555a24793ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0152aceb80 1 -- 172.21.15.70:0/12476808 >> 172.21.15.70:0/12476808 conn(0x555a247027d0 msgr2=0x555a2477fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.957+0000 7f0127400700 0 client.17010 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:40:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.958+0000 7f0152aceb80 1 -- 172.21.15.70:0/12476808 shutdown_connections 2024-05-08T07:40:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.958+0000 7f0152aceb80 1 -- 172.21.15.70:0/12476808 wait complete. 2024-05-08T07:40:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.958+0000 7f0152aceb80 20 client.17010 trim_cache size 0 max 16384 2024-05-08T07:40:43.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.979+0000 7f0152aceb80 1 Processor -- start 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.979+0000 7f0152aceb80 1 -- start start 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478a780 0x555a247a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478b140 0x555a2478f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a247901b0 0x555a2477f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0152aceb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01401b3fe0 con 0x555a2478b140 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0152aceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01401b1870 con 0x555a2478a780 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0152aceb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f01401af6e0 con 0x555a247901b0 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0144e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478b140 0x555a2478f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0144e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478b140 0x555a2478f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59322/0 (socket says 172.21.15.70:59322) 2024-05-08T07:40:43.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0144e00700 1 -- 172.21.15.70:0/2088969771 learned_addr learned my addr 172.21.15.70:0/2088969771 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:40:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0144e00700 1 -- 172.21.15.70:0/2088969771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a247901b0 msgr2=0x555a2477f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:40:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0146200700 1 --2- 172.21.15.70:0/2088969771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a247901b0 0x555a2477f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0144e00700 1 --2- 172.21.15.70:0/2088969771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a247901b0 0x555a2477f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0145800700 1 --2- 172.21.15.70:0/2088969771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478a780 0x555a247a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0144e00700 1 -- 172.21.15.70:0/2088969771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478a780 msgr2=0x555a247a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:40:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0144e00700 1 --2- 172.21.15.70:0/2088969771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478a780 0x555a247a05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.980+0000 7f0144e00700 1 -- 172.21.15.70:0/2088969771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a24786b70 con 0x555a2478b140 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.981+0000 7f0144e00700 1 --2- 172.21.15.70:0/2088969771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478b140 0x555a2478f6f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f012c00e6e0 tx=0x7f012c008400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b7ce6901c3244b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.981+0000 7f0132000700 1 -- 172.21.15.70:0/2088969771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c014070 con 0x555a2478b140 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.981+0000 7f0132000700 1 -- 172.21.15.70:0/2088969771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f012c00ee30 con 0x555a2478b140 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.981+0000 7f0132000700 1 -- 172.21.15.70:0/2088969771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c003cc0 con 0x555a2478b140 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.982+0000 7f0152aceb80 1 -- 172.21.15.70:0/2088969771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478b140 msgr2=0x555a2478f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.982+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2088969771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478b140 0x555a2478f6f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f012c00e6e0 tx=0x7f012c008400 comp rx=0 tx=0).stop 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.982+0000 7f0152aceb80 1 -- 172.21.15.70:0/2088969771 shutdown_connections 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.982+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2088969771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a247901b0 0x555a2477f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.982+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2088969771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a2478a780 0x555a247a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.982+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2088969771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478b140 0x555a2478f6f0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.982+0000 7f0152aceb80 1 -- 172.21.15.70:0/2088969771 >> 172.21.15.70:0/2088969771 conn(0x555a247027d0 msgr2=0x555a2478efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.982+0000 7f0152aceb80 1 -- 172.21.15.70:0/2088969771 shutdown_connections 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.982+0000 7f0152aceb80 1 -- 172.21.15.70:0/2088969771 wait complete. 2024-05-08T07:40:43.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.983+0000 7f0152aceb80 1 -- start start 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.983+0000 7f0152aceb80 1 Processor -- start 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.983+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2479c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.983+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 0x555a2479ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.983+0000 7f0152aceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 0x555a24797900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.983+0000 7f0152aceb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f01401afd30 con 0x555a2478a780 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.983+0000 7f0152aceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f01401b11a0 con 0x555a247901b0 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.983+0000 7f0152aceb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f01401b0400 con 0x555a2478b140 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.983+0000 7f0152aceb80 10 client.0 _ll_register_callbacks cb 0x555a24683d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0145800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2479c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0145800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2479c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59330/0 (socket says 172.21.15.70:59330) 2024-05-08T07:40:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0145800700 1 -- 172.21.15.70:0/2022270774 learned_addr learned my addr 172.21.15.70:0/2022270774 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0144e00700 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 0x555a2479ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0146200700 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 0x555a24797900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0145800700 1 -- 172.21.15.70:0/2022270774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 msgr2=0x555a2479ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0145800700 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 0x555a2479ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0145800700 1 -- 172.21.15.70:0/2022270774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 msgr2=0x555a24797900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0145800700 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 0x555a24797900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0145800700 1 -- 172.21.15.70:0/2022270774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a24797ef0 con 0x555a2478a780 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.984+0000 7f0146200700 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 0x555a24797900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.985+0000 7f0145800700 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2479c950 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f01340a9590 tx=0x7f01340a5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c4ae7f4828106c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.985+0000 7f0127400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.985+0000 7f0127400700 1 -- 172.21.15.70:0/2022270774 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01340a9890 con 0x555a2478a780 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.985+0000 7f0127400700 1 -- 172.21.15.70:0/2022270774 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(187..187 src has 1..187) ==== 9583+0+0 (secure 0 0 0) 0x7f01340a5b20 con 0x555a2478a780 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.985+0000 7f0152aceb80 1 -- 172.21.15.70:0/2022270774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f012c00ee30 con 0x555a2478a780 2024-05-08T07:40:43.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.985+0000 7f0127400700 1 -- 172.21.15.70:0/2022270774 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f01340adc40 con 0x555a2478a780 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.985+0000 7f0152aceb80 10 client.17016 fetch_fsmap learned FSMap version 42 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.985+0000 7f0152aceb80 1 -- 172.21.15.70:0/2022270774 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555a2480f440 con 0x555a2478a780 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.986+0000 7f0127400700 1 -- 172.21.15.70:0/2022270774 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01340c5080 con 0x555a2478a780 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.986+0000 7f0127400700 1 -- 172.21.15.70:0/2022270774 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f01340bece0 con 0x555a2478a780 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.986+0000 7f0152aceb80 10 client.17016 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.986+0000 7f0152aceb80 10 client.17016 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.986+0000 7f0152aceb80 20 client.17016 populate_metadata read hostname 'smithi070' 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.986+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555a2480faf0 0x555a24811f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.986+0000 7f0152aceb80 4 client.17016 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "808501c7", "release": true, "await": true}] 2024-05-08T07:40:43.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.986+0000 7f0152aceb80 1 -- 172.21.15.70:0/2022270774 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "808501c7", "release": true, "await": true}) -- 0x555a246ea500 con 0x555a2480faf0 2024-05-08T07:40:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.987+0000 7f0144e00700 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555a2480faf0 0x555a24811f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:40:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.988+0000 7f0144e00700 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555a2480faf0 0x555a24811f10 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbc69af688b85044 server_cookie=3791ad649bd748d9 in_seq=0 out_seq=0 2024-05-08T07:40:43.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:43.988+0000 7f0127400700 10 client.17016 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:40:44.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:43 smithi194 ceph-mon[33679]: pgmap v1721: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2024-05-08T07:40:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:45 smithi070 ceph-mon[29591]: pgmap v1722: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-08T07:40:45.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:45 smithi172 ceph-mon[33377]: pgmap v1722: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-08T07:40:46.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:45 smithi194 ceph-mon[33679]: pgmap v1722: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-05-08T07:40:47.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:47 smithi070 ceph-mon[29591]: pgmap v1723: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-05-08T07:40:47.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:47 smithi172 ceph-mon[33377]: pgmap v1723: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-05-08T07:40:48.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:47 smithi194 ceph-mon[33679]: pgmap v1723: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s 2024-05-08T07:40:48.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.319+0000 7f0127400700 1 -- 172.21.15.70:0/2022270774 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x555a246ea500 con 0x555a2480faf0 2024-05-08T07:40:48.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.319+0000 7f0127400700 10 client.17016 handle_command_reply: tid=0 2024-05-08T07:40:48.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.319+0000 7f0152aceb80 1 client.17016 shutdown 2024-05-08T07:40:48.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 -- 172.21.15.70:0/2022270774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 msgr2=0x555a2479c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:48.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2479c950 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f01340a9590 tx=0x7f01340a5040 comp rx=0 tx=0).stop 2024-05-08T07:40:48.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 -- 172.21.15.70:0/2022270774 shutdown_connections 2024-05-08T07:40:48.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555a2480faf0 0x555a24811f10 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555a247901b0 0x555a24797900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555a2478a780 0x555a2479c950 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 --2- 172.21.15.70:0/2022270774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555a2478b140 0x555a2479ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 -- 172.21.15.70:0/2022270774 >> 172.21.15.70:0/2022270774 conn(0x555a247027d0 msgr2=0x555a2478dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0127400700 0 client.17016 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:40:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 -- 172.21.15.70:0/2022270774 shutdown_connections 2024-05-08T07:40:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.320+0000 7f0152aceb80 1 -- 172.21.15.70:0/2022270774 wait complete. 2024-05-08T07:40:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.321+0000 7f0152aceb80 20 client.17016 trim_cache size 0 max 16384 2024-05-08T07:40:48.318 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 136, 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "808501c7": { 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 136, 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:40:48.319 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 89.0, 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:40:48.320 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 -- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f01280b2a70 msgr2=0x7f01280b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f01280b2a70 0x7f01280b4f30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f013800b070 tx=0x7f01380090d0 comp rx=0 tx=0).stop 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 -- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140101a90 msgr2=0x7f01401a17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140101a90 0x7f01401a17f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f013400c9b0 tx=0x7f013400cd70 comp rx=0 tx=0).stop 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 -- 172.21.15.70:0/1198061993 shutdown_connections 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f01280b2a70 0x7f01280b4f30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f01401043b0 0x7f014019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0140101a90 0x7f01401a17f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 --2- 172.21.15.70:0/1198061993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0140102530 0x7f01401a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 -- 172.21.15.70:0/1198061993 >> 172.21.15.70:0/1198061993 conn(0x7f0140078a10 msgr2=0x7f01400ff200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 -- 172.21.15.70:0/1198061993 shutdown_connections 2024-05-08T07:40:48.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:40:48.322+0000 7f0148200700 1 -- 172.21.15.70:0/1198061993 wait complete. 2024-05-08T07:40:48.380 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/cpuinfo.o 2024-05-08T07:40:48.834 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/algapi.o 2024-05-08T07:40:49.158 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '808501c7', seconds elapsed: 71.7 2024-05-08T07:40:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:49 smithi070 ceph-mon[29591]: pgmap v1724: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:40:49.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:49 smithi172 ceph-mon[33377]: pgmap v1724: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:40:50.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:49 smithi194 ceph-mon[33679]: pgmap v1724: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T07:40:50.694 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/affinity.o 2024-05-08T07:40:50.837 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/events/built-in.a 2024-05-08T07:40:50.908 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/highmem.o 2024-05-08T07:40:50.982 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/nlmsgtab.o 2024-05-08T07:40:51.157 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/rcu/rcu_segcblist.o 2024-05-08T07:40:51.687 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/fpu/init.o 2024-05-08T07:40:51.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:51 smithi070 ceph-mon[29591]: pgmap v1725: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 64 KiB/s wr, 11 op/s 2024-05-08T07:40:51.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:51 smithi172 ceph-mon[33377]: pgmap v1725: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 64 KiB/s wr, 11 op/s 2024-05-08T07:40:52.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:51 smithi194 ceph-mon[33679]: pgmap v1725: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 64 KiB/s wr, 11 op/s 2024-05-08T07:40:52.535 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/netif.o 2024-05-08T07:40:53.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:53 smithi070 ceph-mon[29591]: pgmap v1726: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 71 KiB/s wr, 11 op/s 2024-05-08T07:40:53.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:53 smithi172 ceph-mon[33377]: pgmap v1726: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 71 KiB/s wr, 11 op/s 2024-05-08T07:40:54.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:53 smithi194 ceph-mon[33679]: pgmap v1726: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 71 KiB/s wr, 11 op/s 2024-05-08T07:40:55.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:55 smithi070 ceph-mon[29591]: pgmap v1727: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 178 KiB/s wr, 12 op/s 2024-05-08T07:40:55.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:55 smithi172 ceph-mon[33377]: pgmap v1727: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 178 KiB/s wr, 12 op/s 2024-05-08T07:40:56.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:55 smithi194 ceph-mon[33679]: pgmap v1727: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 178 KiB/s wr, 12 op/s 2024-05-08T07:40:56.541 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/devices.o 2024-05-08T07:40:57.292 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq/matrix.o 2024-05-08T07:40:57.429 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/fpu/bugs.o 2024-05-08T07:40:57.766 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/rcu/built-in.a 2024-05-08T07:40:57.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:57 smithi070 ceph-mon[29591]: pgmap v1728: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 199 KiB/s wr, 16 op/s 2024-05-08T07:40:57.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:57 smithi172 ceph-mon[33377]: pgmap v1728: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 199 KiB/s wr, 16 op/s 2024-05-08T07:40:58.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:57 smithi194 ceph-mon[33679]: pgmap v1728: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 199 KiB/s wr, 16 op/s 2024-05-08T07:40:58.218 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/fpu/core.o 2024-05-08T07:40:59.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:40:59 smithi070 ceph-mon[29591]: pgmap v1729: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 199 KiB/s wr, 15 op/s 2024-05-08T07:40:59.904 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/scatterwalk.o 2024-05-08T07:40:59.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:40:59 smithi172 ceph-mon[33377]: pgmap v1729: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 199 KiB/s wr, 15 op/s 2024-05-08T07:40:59.969 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/memory.o 2024-05-08T07:41:00.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:40:59 smithi194 ceph-mon[33679]: pgmap v1729: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 199 KiB/s wr, 15 op/s 2024-05-08T07:41:01.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:01 smithi070 ceph-mon[29591]: pgmap v1730: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 316 KiB/s wr, 80 op/s 2024-05-08T07:41:01.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:01 smithi172 ceph-mon[33377]: pgmap v1730: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 316 KiB/s wr, 80 op/s 2024-05-08T07:41:02.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:01 smithi194 ceph-mon[33679]: pgmap v1730: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 316 KiB/s wr, 80 op/s 2024-05-08T07:41:02.299 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/proc.o 2024-05-08T07:41:03.831 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mincore.o 2024-05-08T07:41:03.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:03 smithi172 ceph-mon[33377]: pgmap v1731: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 486 KiB/s wr, 159 op/s 2024-05-08T07:41:04.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:03 smithi194 ceph-mon[33679]: pgmap v1731: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 486 KiB/s wr, 159 op/s 2024-05-08T07:41:04.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:03 smithi070 ceph-mon[29591]: pgmap v1731: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 486 KiB/s wr, 159 op/s 2024-05-08T07:41:04.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:04 smithi172 ceph-mon[33377]: osdmap e188: 12 total, 12 up, 12 in 2024-05-08T07:41:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:04 smithi194 ceph-mon[33679]: osdmap e188: 12 total, 12 up, 12 in 2024-05-08T07:41:05.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:04 smithi070 ceph-mon[29591]: osdmap e188: 12 total, 12 up, 12 in 2024-05-08T07:41:05.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:05 smithi172 ceph-mon[33377]: pgmap v1733: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 500 KiB/s wr, 239 op/s 2024-05-08T07:41:06.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:05 smithi194 ceph-mon[33679]: pgmap v1733: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 500 KiB/s wr, 239 op/s 2024-05-08T07:41:06.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:05 smithi070 ceph-mon[29591]: pgmap v1733: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 500 KiB/s wr, 239 op/s 2024-05-08T07:41:06.634 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/interrupts.o 2024-05-08T07:41:06.870 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/netnode.o 2024-05-08T07:41:07.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:07 smithi172 ceph-mon[33377]: pgmap v1734: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 602 KiB/s wr, 287 op/s 2024-05-08T07:41:08.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:07 smithi194 ceph-mon[33679]: pgmap v1734: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 602 KiB/s wr, 287 op/s 2024-05-08T07:41:08.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:07 smithi070 ceph-mon[29591]: pgmap v1734: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 602 KiB/s wr, 287 op/s 2024-05-08T07:41:09.148 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/irq/built-in.a 2024-05-08T07:41:09.586 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/netport.o 2024-05-08T07:41:09.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:09 smithi070 ceph-mon[29591]: pgmap v1735: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 602 KiB/s wr, 287 op/s 2024-05-08T07:41:09.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:09 smithi070 ceph-mon[29591]: osdmap e189: 12 total, 12 up, 12 in 2024-05-08T07:41:09.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:09 smithi172 ceph-mon[33377]: pgmap v1735: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 602 KiB/s wr, 287 op/s 2024-05-08T07:41:09.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:09 smithi172 ceph-mon[33377]: osdmap e189: 12 total, 12 up, 12 in 2024-05-08T07:41:09.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:09 smithi194 ceph-mon[33679]: pgmap v1735: 129 pgs: 129 active+clean; 1.8 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 602 KiB/s wr, 287 op/s 2024-05-08T07:41:09.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:09 smithi194 ceph-mon[33679]: osdmap e189: 12 total, 12 up, 12 in 2024-05-08T07:41:10.134 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/dma/mapping.o 2024-05-08T07:41:10.638 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/aead.o 2024-05-08T07:41:10.664 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/fpu/regset.o 2024-05-08T07:41:11.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:11 smithi070 ceph-mon[29591]: pgmap v1737: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 308 KiB/s wr, 246 op/s 2024-05-08T07:41:11.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:11 smithi172 ceph-mon[33377]: pgmap v1737: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 308 KiB/s wr, 246 op/s 2024-05-08T07:41:11.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:11 smithi194 ceph-mon[33679]: pgmap v1737: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 308 KiB/s wr, 246 op/s 2024-05-08T07:41:13.480 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/dma/direct.o 2024-05-08T07:41:13.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:13 smithi070 ceph-mon[29591]: pgmap v1738: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 407 KiB/s wr, 274 op/s 2024-05-08T07:41:13.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:13 smithi172 ceph-mon[33377]: pgmap v1738: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 407 KiB/s wr, 274 op/s 2024-05-08T07:41:13.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:13 smithi194 ceph-mon[33679]: pgmap v1738: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 407 KiB/s wr, 274 op/s 2024-05-08T07:41:14.036 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mlock.o 2024-05-08T07:41:15.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:15 smithi070 ceph-mon[29591]: pgmap v1739: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 491 KiB/s wr, 191 op/s 2024-05-08T07:41:15.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:15 smithi172 ceph-mon[33377]: pgmap v1739: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 491 KiB/s wr, 191 op/s 2024-05-08T07:41:15.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:15 smithi194 ceph-mon[33679]: pgmap v1739: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 491 KiB/s wr, 191 op/s 2024-05-08T07:41:15.853 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/loadavg.o 2024-05-08T07:41:17.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:17 smithi070 ceph-mon[29591]: pgmap v1740: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 399 KiB/s wr, 144 op/s 2024-05-08T07:41:17.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:17 smithi172 ceph-mon[33377]: pgmap v1740: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 399 KiB/s wr, 144 op/s 2024-05-08T07:41:17.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:17 smithi194 ceph-mon[33679]: pgmap v1740: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 399 KiB/s wr, 144 op/s 2024-05-08T07:41:19.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:19 smithi070 ceph-mon[29591]: pgmap v1741: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 399 KiB/s wr, 144 op/s 2024-05-08T07:41:19.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:19 smithi172 ceph-mon[33377]: pgmap v1741: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 399 KiB/s wr, 144 op/s 2024-05-08T07:41:19.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:19 smithi194 ceph-mon[33679]: pgmap v1741: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 399 KiB/s wr, 144 op/s 2024-05-08T07:41:19.940 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/fpu/signal.o 2024-05-08T07:41:20.118 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mmap.o 2024-05-08T07:41:20.712 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/dma/ops_helpers.o 2024-05-08T07:41:21.097 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/geniv.o 2024-05-08T07:41:21.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:21 smithi070 ceph-mon[29591]: pgmap v1742: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 468 KiB/s wr, 186 op/s 2024-05-08T07:41:21.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:21 smithi172 ceph-mon[33377]: pgmap v1742: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 468 KiB/s wr, 186 op/s 2024-05-08T07:41:21.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:21 smithi194 ceph-mon[33679]: pgmap v1742: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 468 KiB/s wr, 186 op/s 2024-05-08T07:41:23.023 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/status.o 2024-05-08T07:41:23.578 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/pat/set_memory.o 2024-05-08T07:41:23.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:23 smithi070 ceph-mon[29591]: pgmap v1743: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 429 KiB/s wr, 144 op/s 2024-05-08T07:41:23.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:23 smithi172 ceph-mon[33377]: pgmap v1743: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 429 KiB/s wr, 144 op/s 2024-05-08T07:41:23.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:23 smithi194 ceph-mon[33679]: pgmap v1743: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 429 KiB/s wr, 144 op/s 2024-05-08T07:41:24.253 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/meminfo.o 2024-05-08T07:41:25.475 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/init.o 2024-05-08T07:41:25.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:25 smithi070 ceph-mon[29591]: pgmap v1744: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 545 KiB/s wr, 123 op/s 2024-05-08T07:41:25.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:25 smithi172 ceph-mon[33377]: pgmap v1744: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 545 KiB/s wr, 123 op/s 2024-05-08T07:41:25.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:25 smithi194 ceph-mon[33679]: pgmap v1744: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 545 KiB/s wr, 123 op/s 2024-05-08T07:41:27.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:27 smithi070 ceph-mon[29591]: pgmap v1745: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 424 KiB/s wr, 145 op/s 2024-05-08T07:41:27.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:27 smithi172 ceph-mon[33377]: pgmap v1745: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 424 KiB/s wr, 145 op/s 2024-05-08T07:41:27.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:27 smithi194 ceph-mon[33679]: pgmap v1745: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 424 KiB/s wr, 145 op/s 2024-05-08T07:41:28.789 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/dma/dummy.o 2024-05-08T07:41:29.033 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/fpu/xstate.o 2024-05-08T07:41:29.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:29 smithi070 ceph-mon[29591]: pgmap v1746: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 394 KiB/s wr, 138 op/s 2024-05-08T07:41:29.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:29 smithi172 ceph-mon[33377]: pgmap v1746: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 394 KiB/s wr, 138 op/s 2024-05-08T07:41:29.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:29 smithi194 ceph-mon[33679]: pgmap v1746: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 394 KiB/s wr, 138 op/s 2024-05-08T07:41:31.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:31 smithi172 ceph-mon[33377]: pgmap v1747: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 455 KiB/s wr, 143 op/s 2024-05-08T07:41:31.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:41:31.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:31 smithi194 ceph-mon[33679]: pgmap v1747: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 455 KiB/s wr, 143 op/s 2024-05-08T07:41:31.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:41:31.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:31 smithi070 ceph-mon[29591]: pgmap v1747: 129 pgs: 129 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 455 KiB/s wr, 143 op/s 2024-05-08T07:41:31.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:41:32.058 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/skcipher.o 2024-05-08T07:41:32.190 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mmu_gather.o 2024-05-08T07:41:33.636 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:33 smithi194 ceph-mon[33679]: pgmap v1748: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 340 KiB/s wr, 82 op/s 2024-05-08T07:41:33.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:33 smithi172 ceph-mon[33377]: pgmap v1748: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 340 KiB/s wr, 82 op/s 2024-05-08T07:41:33.859 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/stat.o 2024-05-08T07:41:33.863 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/pat/memtype.o 2024-05-08T07:41:33.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:33 smithi070 ceph-mon[29591]: pgmap v1748: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 340 KiB/s wr, 82 op/s 2024-05-08T07:41:35.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:35 smithi172 ceph-mon[33377]: pgmap v1749: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 494 KiB/s wr, 85 op/s 2024-05-08T07:41:35.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:35 smithi194 ceph-mon[33679]: pgmap v1749: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 494 KiB/s wr, 85 op/s 2024-05-08T07:41:35.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:35 smithi070 ceph-mon[29591]: pgmap v1749: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 494 KiB/s wr, 85 op/s 2024-05-08T07:41:35.992 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/pat/memtype_interval.o 2024-05-08T07:41:36.205 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/ebitmap.o 2024-05-08T07:41:37.643 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/dma/swiotlb.o 2024-05-08T07:41:37.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:37 smithi172 ceph-mon[33377]: pgmap v1750: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 359 KiB/s wr, 187 op/s 2024-05-08T07:41:37.732 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:37 smithi194 ceph-mon[33679]: pgmap v1750: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 359 KiB/s wr, 187 op/s 2024-05-08T07:41:37.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:37 smithi070 ceph-mon[29591]: pgmap v1750: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 359 KiB/s wr, 187 op/s 2024-05-08T07:41:39.107 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/kernel/fpu/built-in.a 2024-05-08T07:41:39.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:41:39.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:41:39.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:41:39.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:41:39.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:41:39.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:38 smithi070 ceph-mon[29591]: pgmap v1751: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 321 KiB/s wr, 160 op/s 2024-05-08T07:41:39.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:41:39.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:41:39.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:41:39.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:41:39.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:41:39.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:38 smithi172 ceph-mon[33377]: pgmap v1751: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 321 KiB/s wr, 160 op/s 2024-05-08T07:41:39.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:41:39.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:41:39.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:41:39.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:41:39.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:41:39.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:38 smithi194 ceph-mon[33679]: pgmap v1751: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 321 KiB/s wr, 160 op/s 2024-05-08T07:41:40.139 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mce/core.o 2024-05-08T07:41:41.623 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mprotect.o 2024-05-08T07:41:41.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:41 smithi070 ceph-mon[29591]: pgmap v1752: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 333 KiB/s wr, 178 op/s 2024-05-08T07:41:41.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:41 smithi172 ceph-mon[33377]: pgmap v1752: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 333 KiB/s wr, 178 op/s 2024-05-08T07:41:41.679 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/uptime.o 2024-05-08T07:41:41.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:41 smithi194 ceph-mon[33679]: pgmap v1752: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 333 KiB/s wr, 178 op/s 2024-05-08T07:41:42.159 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/init_64.o 2024-05-08T07:41:42.257 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/seqiv.o 2024-05-08T07:41:43.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:43 smithi070 ceph-mon[29591]: pgmap v1753: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 395 KiB/s wr, 178 op/s 2024-05-08T07:41:43.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:43 smithi172 ceph-mon[33377]: pgmap v1753: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 395 KiB/s wr, 178 op/s 2024-05-08T07:41:43.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:43 smithi194 ceph-mon[33679]: pgmap v1753: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 395 KiB/s wr, 178 op/s 2024-05-08T07:41:43.946 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/mm/pat/built-in.a 2024-05-08T07:41:44.312 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mce/severity.o 2024-05-08T07:41:45.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:45 smithi070 ceph-mon[29591]: pgmap v1754: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 380 KiB/s wr, 175 op/s 2024-05-08T07:41:45.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:45 smithi172 ceph-mon[33377]: pgmap v1754: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 380 KiB/s wr, 175 op/s 2024-05-08T07:41:45.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:45 smithi194 ceph-mon[33679]: pgmap v1754: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 380 KiB/s wr, 175 op/s 2024-05-08T07:41:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:47 smithi070 ceph-mon[29591]: pgmap v1755: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 334 KiB/s wr, 150 op/s 2024-05-08T07:41:47.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:47 smithi172 ceph-mon[33377]: pgmap v1755: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 334 KiB/s wr, 150 op/s 2024-05-08T07:41:47.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:47 smithi194 ceph-mon[33679]: pgmap v1755: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 334 KiB/s wr, 150 op/s 2024-05-08T07:41:48.468 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/hashtab.o 2024-05-08T07:41:48.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/dma/remap.o 2024-05-08T07:41:49.396 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/util.o 2024-05-08T07:41:49.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:49 smithi172 ceph-mon[33377]: pgmap v1756: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 264 KiB/s wr, 35 op/s 2024-05-08T07:41:49.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:49 smithi194 ceph-mon[33679]: pgmap v1756: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 264 KiB/s wr, 35 op/s 2024-05-08T07:41:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:49 smithi070 ceph-mon[29591]: pgmap v1756: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 264 KiB/s wr, 35 op/s 2024-05-08T07:41:51.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:51 smithi172 ceph-mon[33377]: pgmap v1757: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 286 KiB/s wr, 72 op/s 2024-05-08T07:41:51.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:51 smithi194 ceph-mon[33679]: pgmap v1757: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 286 KiB/s wr, 72 op/s 2024-05-08T07:41:51.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:51 smithi070 ceph-mon[29591]: pgmap v1757: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 286 KiB/s wr, 72 op/s 2024-05-08T07:41:52.622 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/acpi/boot.o 2024-05-08T07:41:53.259 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/echainiv.o 2024-05-08T07:41:53.377 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/fault.o 2024-05-08T07:41:53.522 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mremap.o 2024-05-08T07:41:53.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:53 smithi172 ceph-mon[33377]: pgmap v1758: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 431 KiB/s wr, 81 op/s 2024-05-08T07:41:53.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:53 smithi194 ceph-mon[33679]: pgmap v1758: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 431 KiB/s wr, 81 op/s 2024-05-08T07:41:53.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:53 smithi070 ceph-mon[29591]: pgmap v1758: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 431 KiB/s wr, 81 op/s 2024-05-08T07:41:55.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:55 smithi172 ceph-mon[33377]: pgmap v1759: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 439 KiB/s wr, 91 op/s 2024-05-08T07:41:55.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:55 smithi194 ceph-mon[33679]: pgmap v1759: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 439 KiB/s wr, 91 op/s 2024-05-08T07:41:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:55 smithi070 ceph-mon[29591]: pgmap v1759: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 439 KiB/s wr, 91 op/s 2024-05-08T07:41:56.293 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/symtab.o 2024-05-08T07:41:56.581 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/version.o 2024-05-08T07:41:56.731 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/dma/built-in.a 2024-05-08T07:41:57.032 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mce/genpool.o 2024-05-08T07:41:57.231 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/entry/common.o 2024-05-08T07:41:57.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:57 smithi172 ceph-mon[33377]: pgmap v1760: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 472 KiB/s wr, 118 op/s 2024-05-08T07:41:57.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:57 smithi194 ceph-mon[33679]: pgmap v1760: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 472 KiB/s wr, 118 op/s 2024-05-08T07:41:57.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:57 smithi070 ceph-mon[29591]: pgmap v1760: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 472 KiB/s wr, 118 op/s 2024-05-08T07:41:59.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:41:59 smithi172 ceph-mon[33377]: pgmap v1761: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 345 KiB/s wr, 107 op/s 2024-05-08T07:41:59.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:41:59 smithi194 ceph-mon[33679]: pgmap v1761: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 345 KiB/s wr, 107 op/s 2024-05-08T07:41:59.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:41:59 smithi070 ceph-mon[29591]: pgmap v1761: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 345 KiB/s wr, 107 op/s 2024-05-08T07:42:01.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:01 smithi172 ceph-mon[33377]: pgmap v1762: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 451 KiB/s wr, 114 op/s 2024-05-08T07:42:01.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:01 smithi194 ceph-mon[33679]: pgmap v1762: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 451 KiB/s wr, 114 op/s 2024-05-08T07:42:01.785 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/ahash.o 2024-05-08T07:42:01.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:01 smithi070 ceph-mon[29591]: pgmap v1762: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 451 KiB/s wr, 114 op/s 2024-05-08T07:42:02.085 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/sidtab.o 2024-05-08T07:42:03.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:03 smithi194 ceph-mon[33679]: pgmap v1763: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 459 KiB/s wr, 94 op/s 2024-05-08T07:42:03.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:03 smithi070 ceph-mon[29591]: pgmap v1763: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 459 KiB/s wr, 94 op/s 2024-05-08T07:42:03.897 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/acpi/sleep.o 2024-05-08T07:42:03.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:03 smithi172 ceph-mon[33377]: pgmap v1763: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 459 KiB/s wr, 94 op/s 2024-05-08T07:42:04.505 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/msync.o 2024-05-08T07:42:04.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:04 smithi194 ceph-mon[33679]: osdmap e190: 12 total, 12 up, 12 in 2024-05-08T07:42:04.862 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/softirqs.o 2024-05-08T07:42:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:04 smithi070 ceph-mon[29591]: osdmap e190: 12 total, 12 up, 12 in 2024-05-08T07:42:04.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:04 smithi172 ceph-mon[33377]: osdmap e190: 12 total, 12 up, 12 in 2024-05-08T07:42:05.374 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/ioremap.o 2024-05-08T07:42:05.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:05 smithi194 ceph-mon[33679]: pgmap v1765: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 368 KiB/s wr, 73 op/s 2024-05-08T07:42:05.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:05 smithi070 ceph-mon[29591]: pgmap v1765: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 368 KiB/s wr, 73 op/s 2024-05-08T07:42:05.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:05 smithi172 ceph-mon[33377]: pgmap v1765: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 368 KiB/s wr, 73 op/s 2024-05-08T07:42:06.063 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mce/intel.o 2024-05-08T07:42:07.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:07 smithi194 ceph-mon[33679]: pgmap v1766: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 368 KiB/s wr, 56 op/s 2024-05-08T07:42:07.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:07 smithi070 ceph-mon[29591]: pgmap v1766: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 368 KiB/s wr, 56 op/s 2024-05-08T07:42:07.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:07 smithi172 ceph-mon[33377]: pgmap v1766: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 368 KiB/s wr, 56 op/s 2024-05-08T07:42:08.800 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/entry/syscall_user_dispatch.o 2024-05-08T07:42:09.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:09 smithi070 ceph-mon[29591]: pgmap v1767: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 368 KiB/s wr, 56 op/s 2024-05-08T07:42:09.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:09 smithi070 ceph-mon[29591]: osdmap e191: 12 total, 12 up, 12 in 2024-05-08T07:42:09.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:09 smithi172 ceph-mon[33377]: pgmap v1767: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 368 KiB/s wr, 56 op/s 2024-05-08T07:42:09.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:09 smithi172 ceph-mon[33377]: osdmap e191: 12 total, 12 up, 12 in 2024-05-08T07:42:09.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:09 smithi194 ceph-mon[33679]: pgmap v1767: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 368 KiB/s wr, 56 op/s 2024-05-08T07:42:09.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:09 smithi194 ceph-mon[33679]: osdmap e191: 12 total, 12 up, 12 in 2024-05-08T07:42:11.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:11 smithi070 ceph-mon[29591]: pgmap v1769: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 350 KiB/s wr, 108 op/s 2024-05-08T07:42:11.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:11 smithi172 ceph-mon[33377]: pgmap v1769: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 350 KiB/s wr, 108 op/s 2024-05-08T07:42:11.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:11 smithi194 ceph-mon[33679]: pgmap v1769: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 350 KiB/s wr, 108 op/s 2024-05-08T07:42:11.867 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/shash.o 2024-05-08T07:42:12.555 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/namespaces.o 2024-05-08T07:42:12.952 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mce/amd.o 2024-05-08T07:42:13.354 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/kernel/acpi/wakeup_64.o 2024-05-08T07:42:13.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:13 smithi070 ceph-mon[29591]: pgmap v1770: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 452 KiB/s wr, 118 op/s 2024-05-08T07:42:13.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:13 smithi172 ceph-mon[33377]: pgmap v1770: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 452 KiB/s wr, 118 op/s 2024-05-08T07:42:13.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:13 smithi194 ceph-mon[33679]: pgmap v1770: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 452 KiB/s wr, 118 op/s 2024-05-08T07:42:14.132 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/avtab.o 2024-05-08T07:42:14.160 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/page_vma_mapped.o 2024-05-08T07:42:14.209 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/acpi/cppc.o 2024-05-08T07:42:15.420 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/extable.o 2024-05-08T07:42:15.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:15 smithi070 ceph-mon[29591]: pgmap v1771: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 245 KiB/s wr, 98 op/s 2024-05-08T07:42:15.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:15 smithi172 ceph-mon[33377]: pgmap v1771: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 245 KiB/s wr, 98 op/s 2024-05-08T07:42:15.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:15 smithi194 ceph-mon[33679]: pgmap v1771: 129 pgs: 129 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 245 KiB/s wr, 98 op/s 2024-05-08T07:42:16.691 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/entry/built-in.a 2024-05-08T07:42:17.052 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/module/main.o 2024-05-08T07:42:17.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:17 smithi070 ceph-mon[29591]: pgmap v1772: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 394 KiB/s wr, 91 op/s 2024-05-08T07:42:17.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:17 smithi172 ceph-mon[33377]: pgmap v1772: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 394 KiB/s wr, 91 op/s 2024-05-08T07:42:17.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:17 smithi194 ceph-mon[33679]: pgmap v1772: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 394 KiB/s wr, 91 op/s 2024-05-08T07:42:19.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:19 smithi070 ceph-mon[29591]: pgmap v1773: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 394 KiB/s wr, 91 op/s 2024-05-08T07:42:19.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:19 smithi172 ceph-mon[33377]: pgmap v1773: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 394 KiB/s wr, 91 op/s 2024-05-08T07:42:19.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:19 smithi194 ceph-mon[33679]: pgmap v1773: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 394 KiB/s wr, 91 op/s 2024-05-08T07:42:21.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:21 smithi070 ceph-mon[29591]: pgmap v1774: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 340 KiB/s wr, 81 op/s 2024-05-08T07:42:21.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:21 smithi172 ceph-mon[33377]: pgmap v1774: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 340 KiB/s wr, 81 op/s 2024-05-08T07:42:21.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:21 smithi194 ceph-mon[33679]: pgmap v1774: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 340 KiB/s wr, 81 op/s 2024-05-08T07:42:21.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/acpi/cstate.o 2024-05-08T07:42:22.046 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/akcipher.o 2024-05-08T07:42:22.467 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/self.o 2024-05-08T07:42:23.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:23 smithi070 ceph-mon[29591]: pgmap v1775: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 364 KiB/s wr, 50 op/s 2024-05-08T07:42:23.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:23 smithi172 ceph-mon[33377]: pgmap v1775: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 364 KiB/s wr, 50 op/s 2024-05-08T07:42:23.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:23 smithi194 ceph-mon[33679]: pgmap v1775: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 364 KiB/s wr, 50 op/s 2024-05-08T07:42:24.159 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/pagewalk.o 2024-05-08T07:42:24.562 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mce/threshold.o 2024-05-08T07:42:25.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:25 smithi172 ceph-mon[33377]: pgmap v1776: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 281 KiB/s wr, 74 op/s 2024-05-08T07:42:25.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:25 smithi194 ceph-mon[33679]: pgmap v1776: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 281 KiB/s wr, 74 op/s 2024-05-08T07:42:25.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:25 smithi070 ceph-mon[29591]: pgmap v1776: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 281 KiB/s wr, 74 op/s 2024-05-08T07:42:27.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:27 smithi172 ceph-mon[33377]: pgmap v1777: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 486 KiB/s wr, 180 op/s 2024-05-08T07:42:27.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:27 smithi194 ceph-mon[33679]: pgmap v1777: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 486 KiB/s wr, 180 op/s 2024-05-08T07:42:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:27 smithi070 ceph-mon[29591]: pgmap v1777: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 486 KiB/s wr, 180 op/s 2024-05-08T07:42:28.490 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/mmap.o 2024-05-08T07:42:28.812 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/policydb.o 2024-05-08T07:42:29.029 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/module/strict_rwx.o 2024-05-08T07:42:29.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:29 smithi172 ceph-mon[33377]: pgmap v1778: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 335 KiB/s wr, 176 op/s 2024-05-08T07:42:29.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:29 smithi194 ceph-mon[33679]: pgmap v1778: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 335 KiB/s wr, 176 op/s 2024-05-08T07:42:29.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:29 smithi070 ceph-mon[29591]: pgmap v1778: 129 pgs: 129 active+clean; 1.8 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 335 KiB/s wr, 176 op/s 2024-05-08T07:42:30.045 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/thread_self.o 2024-05-08T07:42:30.111 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/kernel/acpi/built-in.a 2024-05-08T07:42:30.549 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/pgtable.o 2024-05-08T07:42:31.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:31 smithi172 ceph-mon[33377]: pgmap v1779: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 361 KiB/s wr, 183 op/s 2024-05-08T07:42:31.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:31 smithi194 ceph-mon[33679]: pgmap v1779: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 361 KiB/s wr, 183 op/s 2024-05-08T07:42:31.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:31 smithi070 ceph-mon[29591]: pgmap v1779: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 361 KiB/s wr, 183 op/s 2024-05-08T07:42:32.518 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/sig.o 2024-05-08T07:42:32.940 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/pgtable-generic.o 2024-05-08T07:42:33.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:33 smithi172 ceph-mon[33377]: pgmap v1780: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 432 KiB/s wr, 183 op/s 2024-05-08T07:42:33.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:33 smithi194 ceph-mon[33679]: pgmap v1780: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 432 KiB/s wr, 183 op/s 2024-05-08T07:42:33.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:33 smithi070 ceph-mon[29591]: pgmap v1780: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 432 KiB/s wr, 183 op/s 2024-05-08T07:42:33.997 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/kernel/cpu/mce/built-in.a 2024-05-08T07:42:34.782 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mtrr/mtrr.o 2024-05-08T07:42:35.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:35 smithi172 ceph-mon[33377]: pgmap v1781: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 347 KiB/s wr, 167 op/s 2024-05-08T07:42:35.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:35 smithi194 ceph-mon[33679]: pgmap v1781: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 347 KiB/s wr, 167 op/s 2024-05-08T07:42:35.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:35 smithi070 ceph-mon[29591]: pgmap v1781: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 347 KiB/s wr, 167 op/s 2024-05-08T07:42:36.529 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/proc_sysctl.o 2024-05-08T07:42:36.771 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/module/kmod.o 2024-05-08T07:42:36.873 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.9 2024-05-08T07:42:36.874 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:42:37.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:37 smithi172 ceph-mon[33377]: pgmap v1782: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 451 KiB/s wr, 133 op/s 2024-05-08T07:42:37.735 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:42:37.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:37 smithi194 ceph-mon[33679]: pgmap v1782: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 451 KiB/s wr, 133 op/s 2024-05-08T07:42:37.810 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/module/tree_lookup.o 2024-05-08T07:42:37.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:37 smithi070 ceph-mon[29591]: pgmap v1782: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 451 KiB/s wr, 133 op/s 2024-05-08T07:42:38.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:42:38.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:42:38.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:42:39.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:39 smithi172 ceph-mon[33377]: pgmap v1783: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 243 KiB/s wr, 27 op/s 2024-05-08T07:42:39.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:39 smithi070 ceph-mon[29591]: pgmap v1783: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 243 KiB/s wr, 27 op/s 2024-05-08T07:42:39.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:39 smithi194 ceph-mon[33679]: pgmap v1783: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 243 KiB/s wr, 27 op/s 2024-05-08T07:42:40.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.403+0000 7ff106e00700 1 -- 172.21.15.70:0/3124337340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff10010d9c0 msgr2=0x7ff10010fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:40.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.403+0000 7ff106e00700 1 --2- 172.21.15.70:0/3124337340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff10010d9c0 0x7ff10010fe80 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800b0a0 tx=0x7ff0f800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.404+0000 7ff106e00700 1 -- 172.21.15.70:0/3124337340 shutdown_connections 2024-05-08T07:42:40.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.404+0000 7ff106e00700 1 --2- 172.21.15.70:0/3124337340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff10010d9c0 0x7ff10010fe80 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.404+0000 7ff106e00700 1 --2- 172.21.15.70:0/3124337340 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff100104590 0x7ff100104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.404+0000 7ff106e00700 1 --2- 172.21.15.70:0/3124337340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff100104eb0 0x7ff10010d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.404+0000 7ff106e00700 1 -- 172.21.15.70:0/3124337340 >> 172.21.15.70:0/3124337340 conn(0x7ff1000fddc0 msgr2=0x7ff1001001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:42:40.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.404+0000 7ff106e00700 1 -- 172.21.15.70:0/3124337340 shutdown_connections 2024-05-08T07:42:40.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.404+0000 7ff106e00700 1 -- 172.21.15.70:0/3124337340 wait complete. 2024-05-08T07:42:40.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.406+0000 7ff106e00700 1 Processor -- start 2024-05-08T07:42:40.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.406+0000 7ff106e00700 1 -- start start 2024-05-08T07:42:40.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.406+0000 7ff106e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff100104590 0x7ff1001021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:40.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.407+0000 7ff106e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff100104eb0 0x7ff100102730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:40.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.407+0000 7ff106e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff10010d9c0 0x7ff100102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:40.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.407+0000 7ff106e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff1001134c0 con 0x7ff10010d9c0 2024-05-08T07:42:40.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.407+0000 7ff106e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff100113340 con 0x7ff100104590 2024-05-08T07:42:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.407+0000 7ff106e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff100113640 con 0x7ff100104eb0 2024-05-08T07:42:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.407+0000 7ff105a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff100104590 0x7ff1001021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.407+0000 7ff105000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff100104eb0 0x7ff100102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.407+0000 7ff105a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff100104590 0x7ff1001021f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:59728/0 (socket says 172.21.15.70:59728) 2024-05-08T07:42:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.407+0000 7ff105a00700 1 -- 172.21.15.70:0/745150896 learned_addr learned my addr 172.21.15.70:0/745150896 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:42:40.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.408+0000 7ff106400700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff10010d9c0 0x7ff100102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.408+0000 7ff105a00700 1 -- 172.21.15.70:0/745150896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff100104eb0 msgr2=0x7ff100102730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.408+0000 7ff105a00700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff100104eb0 0x7ff100102730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.408+0000 7ff105a00700 1 -- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff10010d9c0 msgr2=0x7ff100102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.408+0000 7ff105a00700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff10010d9c0 0x7ff100102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.408+0000 7ff105a00700 1 -- 172.21.15.70:0/745150896 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1001a7f10 con 0x7ff100104590 2024-05-08T07:42:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.408+0000 7ff106400700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff10010d9c0 0x7ff100102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:42:40.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.409+0000 7ff105a00700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff100104590 0x7ff1001021f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400d950 tx=0x7ff0f400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:42:40.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.409+0000 7ff0fe000700 1 -- 172.21.15.70:0/745150896 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4016070 con 0x7ff100104590 2024-05-08T07:42:40.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.410+0000 7ff0fe000700 1 -- 172.21.15.70:0/745150896 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0f400fd20 con 0x7ff100104590 2024-05-08T07:42:40.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.410+0000 7ff0fe000700 1 -- 172.21.15.70:0/745150896 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f400e3b0 con 0x7ff100104590 2024-05-08T07:42:40.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.410+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1001a81a0 con 0x7ff100104590 2024-05-08T07:42:40.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.410+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1001a8730 con 0x7ff100104590 2024-05-08T07:42:40.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.412+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff10006a190 con 0x7ff100104590 2024-05-08T07:42:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.417+0000 7ff0fe000700 1 -- 172.21.15.70:0/745150896 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff0f4019070 con 0x7ff100104590 2024-05-08T07:42:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.419+0000 7ff0fe000700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0e80b2a70 0x7ff0e80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.419+0000 7ff0fe000700 1 -- 172.21.15.70:0/745150896 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 9583+0+0 (secure 0 0 0) 0x7ff0f40e2450 con 0x7ff100104590 2024-05-08T07:42:40.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.420+0000 7ff105000700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0e80b2a70 0x7ff0e80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:40.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.421+0000 7ff105000700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0e80b2a70 0x7ff0e80b4f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff10010ed70 tx=0x7ff0ec00b360 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:42:40.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.432+0000 7ff0fe000700 1 -- 172.21.15.70:0/745150896 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff0f40a9a10 con 0x7ff100104590 2024-05-08T07:42:40.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:42:40.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:42:40.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:42:40.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:42:40.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:42:40.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:42:40.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.905+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1001036d0 con 0x7ff100104590 2024-05-08T07:42:40.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.908+0000 7ff0fe000700 1 -- 172.21.15.70:0/745150896 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7ff0f40a9310 con 0x7ff100104590 2024-05-08T07:42:40.905 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:42:40.905 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:42:40.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.911+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0e80b2a70 msgr2=0x7ff0e80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:40.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.911+0000 7ff106e00700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0e80b2a70 0x7ff0e80b4f30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff10010ed70 tx=0x7ff0ec00b360 comp rx=0 tx=0).stop 2024-05-08T07:42:40.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.911+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff100104590 msgr2=0x7ff1001021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:40.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.911+0000 7ff106e00700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff100104590 0x7ff1001021f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400d950 tx=0x7ff0f400dc60 comp rx=0 tx=0).stop 2024-05-08T07:42:40.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.912+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 shutdown_connections 2024-05-08T07:42:40.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.912+0000 7ff106e00700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff0e80b2a70 0x7ff0e80b4f30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.912+0000 7ff106e00700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff10010d9c0 0x7ff100102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.912+0000 7ff106e00700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff100104590 0x7ff1001021f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.912+0000 7ff106e00700 1 --2- 172.21.15.70:0/745150896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff100104eb0 0x7ff100102730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:40.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.912+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 >> 172.21.15.70:0/745150896 conn(0x7ff1000fddc0 msgr2=0x7ff1000fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:42:40.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.912+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 shutdown_connections 2024-05-08T07:42:40.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:40.912+0000 7ff106e00700 1 -- 172.21.15.70:0/745150896 wait complete. 2024-05-08T07:42:40.910 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:42:40.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:42:40.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:42:40.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:42:41.151 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/physaddr.o 2024-05-08T07:42:41.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:41 smithi070 ceph-mon[29591]: pgmap v1784: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 274 KiB/s wr, 143 op/s 2024-05-08T07:42:41.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:41 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/745150896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:42:41.711 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 83.9 --await-for 42.0' 2024-05-08T07:42:41.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 83.9 --await-for 42.0 2024-05-08T07:42:41.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:41 smithi194 ceph-mon[33679]: pgmap v1784: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 274 KiB/s wr, 143 op/s 2024-05-08T07:42:41.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:41 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/745150896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:42:41.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:41 smithi172 ceph-mon[33377]: pgmap v1784: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 274 KiB/s wr, 143 op/s 2024-05-08T07:42:41.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:41 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/745150896' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:42:42.292 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:42:42.476 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/services.o 2024-05-08T07:42:43.200 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/rmap.o 2024-05-08T07:42:43.277 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/kpp.o 2024-05-08T07:42:43.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:43 smithi194 ceph-mon[33679]: pgmap v1785: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 399 KiB/s wr, 192 op/s 2024-05-08T07:42:43.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:43 smithi070 ceph-mon[29591]: pgmap v1785: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 399 KiB/s wr, 192 op/s 2024-05-08T07:42:43.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:43 smithi172 ceph-mon[33377]: pgmap v1785: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 399 KiB/s wr, 192 op/s 2024-05-08T07:42:45.329 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mtrr/if.o 2024-05-08T07:42:45.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:45 smithi194 ceph-mon[33679]: pgmap v1786: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 317 KiB/s wr, 190 op/s 2024-05-08T07:42:45.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:45 smithi070 ceph-mon[29591]: pgmap v1786: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 317 KiB/s wr, 190 op/s 2024-05-08T07:42:45.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:45 smithi172 ceph-mon[33377]: pgmap v1786: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 317 KiB/s wr, 190 op/s 2024-05-08T07:42:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.159+0000 7f89a8200700 1 -- 172.21.15.70:0/1370047460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a0108860 msgr2=0x7f89a01103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.159+0000 7f89a8200700 1 --2- 172.21.15.70:0/1370047460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a0108860 0x7f89a01103e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f899800b0d0 tx=0x7f899800b3e0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.160+0000 7f89a8200700 1 -- 172.21.15.70:0/1370047460 shutdown_connections 2024-05-08T07:42:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.160+0000 7f89a8200700 1 --2- 172.21.15.70:0/1370047460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a0108860 0x7f89a01103e0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.160+0000 7f89a8200700 1 --2- 172.21.15.70:0/1370047460 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89a006b3e0 0x7f89a006b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.160+0000 7f89a8200700 1 --2- 172.21.15.70:0/1370047460 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a006bd90 0x7f89a0108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.160+0000 7f89a8200700 1 -- 172.21.15.70:0/1370047460 >> 172.21.15.70:0/1370047460 conn(0x7f89a0079340 msgr2=0x7f89a0079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:42:46.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.160+0000 7f89a8200700 1 -- 172.21.15.70:0/1370047460 shutdown_connections 2024-05-08T07:42:46.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.160+0000 7f89a8200700 1 -- 172.21.15.70:0/1370047460 wait complete. 2024-05-08T07:42:46.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.162+0000 7f89a8200700 1 Processor -- start 2024-05-08T07:42:46.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.162+0000 7f89a8200700 1 -- start start 2024-05-08T07:42:46.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.162+0000 7f89a8200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a006b3e0 0x7f89a0074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.162+0000 7f89a8200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a006bd90 0x7f89a0075100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.162+0000 7f89a8200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89a0108860 0x7f89a006de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.162+0000 7f89a8200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89a01157c0 con 0x7f89a006bd90 2024-05-08T07:42:46.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.162+0000 7f89a8200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89a0115640 con 0x7f89a006b3e0 2024-05-08T07:42:46.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.162+0000 7f89a8200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f89a0115940 con 0x7f89a0108860 2024-05-08T07:42:46.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.163+0000 7f89a4e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a006bd90 0x7f89a0075100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.163+0000 7f89a4e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a006bd90 0x7f89a0075100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50950/0 (socket says 172.21.15.70:50950) 2024-05-08T07:42:46.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.163+0000 7f89a4e00700 1 -- 172.21.15.70:0/1460678820 learned_addr learned my addr 172.21.15.70:0/1460678820 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:42:46.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.164+0000 7f89a5800700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a006b3e0 0x7f89a0074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.164+0000 7f89a6200700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89a0108860 0x7f89a006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.164+0000 7f89a4e00700 1 -- 172.21.15.70:0/1460678820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89a0108860 msgr2=0x7f89a006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:46.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.164+0000 7f89a4e00700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89a0108860 0x7f89a006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.164+0000 7f89a4e00700 1 -- 172.21.15.70:0/1460678820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a006b3e0 msgr2=0x7f89a0074bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:46.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.164+0000 7f89a4e00700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a006b3e0 0x7f89a0074bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.164+0000 7f89a4e00700 1 -- 172.21.15.70:0/1460678820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a006e6c0 con 0x7f89a006bd90 2024-05-08T07:42:46.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.165+0000 7f89a4e00700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a006bd90 0x7f89a0075100 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f899400e9a0 tx=0x7f899400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:42:46.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.165+0000 7f899e000700 1 -- 172.21.15.70:0/1460678820 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899400cbd0 con 0x7f89a006bd90 2024-05-08T07:42:46.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.165+0000 7f899e000700 1 -- 172.21.15.70:0/1460678820 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f899400cd70 con 0x7f89a006bd90 2024-05-08T07:42:46.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.165+0000 7f899e000700 1 -- 172.21.15.70:0/1460678820 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994018680 con 0x7f89a006bd90 2024-05-08T07:42:46.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.165+0000 7f89a8200700 1 -- 172.21.15.70:0/1460678820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a006e9b0 con 0x7f89a006bd90 2024-05-08T07:42:46.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.165+0000 7f89a8200700 1 -- 172.21.15.70:0/1460678820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a0072980 con 0x7f89a006bd90 2024-05-08T07:42:46.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.171+0000 7f899e000700 1 -- 172.21.15.70:0/1460678820 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8994018820 con 0x7f89a006bd90 2024-05-08T07:42:46.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.173+0000 7f899e000700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89880b2b70 0x7f89880b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.173+0000 7f899e000700 1 -- 172.21.15.70:0/1460678820 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(191..191 src has 1..191) ==== 9583+0+0 (secure 0 0 0) 0x7f89940e3b20 con 0x7f89a006bd90 2024-05-08T07:42:46.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.174+0000 7f89a5800700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89880b2b70 0x7f89880b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.184+0000 7f89a5800700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89880b2b70 0x7f89880b5030 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8990007be0 tx=0x7f89900073d0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:42:46.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.188+0000 7f89b2b05b80 1 Processor -- start 2024-05-08T07:42:46.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.188+0000 7f89b2b05b80 1 -- start start 2024-05-08T07:42:46.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.188+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.188+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c6205edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.188+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c6205f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.188+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563c61fb0bb0 con 0x563c6205b9d0 2024-05-08T07:42:46.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.188+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563c61f4e8f0 con 0x563c6205c2f0 2024-05-08T07:42:46.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.188+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563c61facb70 con 0x563c6205f330 2024-05-08T07:42:46.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.189+0000 7f89a4e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c6205edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.189+0000 7f89a5800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.189+0000 7f89a4e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c6205edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:59756/0 (socket says 172.21.15.70:59756) 2024-05-08T07:42:46.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.189+0000 7f89a4e00700 1 -- 172.21.15.70:0/1780200283 learned_addr learned my addr 172.21.15.70:0/1780200283 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:42:46.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.189+0000 7f89a6200700 1 --2- 172.21.15.70:0/1780200283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c6205f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.190+0000 7f89a5800700 1 -- 172.21.15.70:0/1780200283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 msgr2=0x563c6205f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:42:46.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.190+0000 7f89a5800700 1 --2- 172.21.15.70:0/1780200283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c6205f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.190+0000 7f89a5800700 1 -- 172.21.15.70:0/1780200283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 msgr2=0x563c6205edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:42:46.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.190+0000 7f89a5800700 1 --2- 172.21.15.70:0/1780200283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c6205edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.190+0000 7f89a5800700 1 -- 172.21.15.70:0/1780200283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c61efda60 con 0x563c6205b9d0 2024-05-08T07:42:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.191+0000 7f89a5800700 1 --2- 172.21.15.70:0/1780200283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f8990010dd0 tx=0x7f8990013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb887ceced9a3c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:42:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.191+0000 7f898ea00700 1 -- 172.21.15.70:0/1780200283 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8990024070 con 0x563c6205b9d0 2024-05-08T07:42:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.191+0000 7f898ea00700 1 -- 172.21.15.70:0/1780200283 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8990015070 con 0x563c6205b9d0 2024-05-08T07:42:46.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.191+0000 7f898ea00700 1 -- 172.21.15.70:0/1780200283 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89900117a0 con 0x563c6205b9d0 2024-05-08T07:42:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.192+0000 7f89b2b05b80 1 -- 172.21.15.70:0/1780200283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 msgr2=0x563c6205bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.192+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/1780200283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f8990010dd0 tx=0x7f8990013000 comp rx=0 tx=0).stop 2024-05-08T07:42:46.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.193+0000 7f89b2b05b80 1 -- 172.21.15.70:0/1780200283 shutdown_connections 2024-05-08T07:42:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.193+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/1780200283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c6205f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.193+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/1780200283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.193+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/1780200283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c6205edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.193+0000 7f89b2b05b80 1 -- 172.21.15.70:0/1780200283 >> 172.21.15.70:0/1780200283 conn(0x563c61fd6860 msgr2=0x563c62059100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:42:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.193+0000 7f89b2b05b80 1 -- 172.21.15.70:0/1780200283 shutdown_connections 2024-05-08T07:42:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.193+0000 7f89b2b05b80 1 -- 172.21.15.70:0/1780200283 wait complete. 2024-05-08T07:42:46.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.194+0000 7f89b2b05b80 1 -- start start 2024-05-08T07:42:46.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.194+0000 7f89b2b05b80 1 Processor -- start 2024-05-08T07:42:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.195+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6207f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.195+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c6207f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.195+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c62079440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.195+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563c62060370 con 0x563c6205b9d0 2024-05-08T07:42:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.195+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563c61f16cb0 con 0x563c6205c2f0 2024-05-08T07:42:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.195+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563c620604f0 con 0x563c6205f330 2024-05-08T07:42:46.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.195+0000 7f89b2b05b80 10 client.0 _ll_register_callbacks cb 0x563c61f57e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:42:46.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.196+0000 7f89a4e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c6207f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.196+0000 7f89a6200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c62079440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.196+0000 7f89a6200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c62079440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:60420/0 (socket says 172.21.15.70:60420) 2024-05-08T07:42:46.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.196+0000 7f89a6200700 1 -- 172.21.15.70:0/4073118689 learned_addr learned my addr 172.21.15.70:0/4073118689 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:42:46.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.196+0000 7f89a5800700 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6207f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.198+0000 7f89a6200700 1 -- 172.21.15.70:0/4073118689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 msgr2=0x563c6207f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:42:46.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.198+0000 7f89a6200700 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c6207f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.198+0000 7f89a6200700 1 -- 172.21.15.70:0/4073118689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 msgr2=0x563c6207f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:42:46.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.198+0000 7f89a6200700 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6207f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.198+0000 7f89a6200700 1 -- 172.21.15.70:0/4073118689 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c61f765b0 con 0x563c6205f330 2024-05-08T07:42:46.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.198+0000 7f89a5800700 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6207f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:42:46.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.199+0000 7f89a6200700 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c62079440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f899800bd40 tx=0x7f899800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4282cb5229bc1b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:42:46.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.199+0000 7f8983400700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T07:42:46.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.199+0000 7f8983400700 1 -- 172.21.15.70:0/4073118689 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998021070 con 0x563c6205f330 2024-05-08T07:42:46.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.199+0000 7f8983400700 1 -- 172.21.15.70:0/4073118689 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 9583+0+0 (secure 0 0 0) 0x7f89980074e0 con 0x563c6205f330 2024-05-08T07:42:46.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.200+0000 7f89b2b05b80 1 -- 172.21.15.70:0/4073118689 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8990015070 con 0x563c6205f330 2024-05-08T07:42:46.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.200+0000 7f8983400700 1 -- 172.21.15.70:0/4073118689 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f899802e050 con 0x563c6205f330 2024-05-08T07:42:46.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.200+0000 7f89b2b05b80 10 client.26176 fetch_fsmap learned FSMap version 42 2024-05-08T07:42:46.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.200+0000 7f89b2b05b80 1 -- 172.21.15.70:0/4073118689 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563c62086da0 con 0x563c6205f330 2024-05-08T07:42:46.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.201+0000 7f8983400700 1 -- 172.21.15.70:0/4073118689 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8990015070 con 0x563c6205f330 2024-05-08T07:42:46.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.201+0000 7f8983400700 1 -- 172.21.15.70:0/4073118689 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f8998011070 con 0x563c6205f330 2024-05-08T07:42:46.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.201+0000 7f89b2b05b80 10 client.26176 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:42:46.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.201+0000 7f89b2b05b80 10 client.26176 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:42:46.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.201+0000 7f89b2b05b80 20 client.26176 populate_metadata read hostname 'smithi070' 2024-05-08T07:42:46.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.201+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c620893e0 0x563c6208b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.202+0000 7f89b2b05b80 4 client.26176 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:42:46.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.202+0000 7f89b2b05b80 1 -- 172.21.15.70:0/4073118689 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c6202b2d0 con 0x563c620893e0 2024-05-08T07:42:46.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.203+0000 7f89a5800700 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c620893e0 0x563c6208b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.204+0000 7f8983400700 10 client.26176 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:42:46.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.204+0000 7f89a5800700 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c620893e0 0x563c6208b7d0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3390f0aa130d4755 server_cookie=a887ac60a46fef74 in_seq=0 out_seq=0 2024-05-08T07:42:46.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.207+0000 7f8983400700 1 -- 172.21.15.70:0/4073118689 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563c6202b2d0 con 0x563c620893e0 2024-05-08T07:42:46.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.207+0000 7f8983400700 10 client.26176 handle_command_reply: tid=0 2024-05-08T07:42:46.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.207+0000 7f89b2b05b80 1 client.26176 shutdown 2024-05-08T07:42:46.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.210+0000 7f89b2b05b80 1 -- 172.21.15.70:0/4073118689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 msgr2=0x563c62079440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:46.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.210+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c62079440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f899800bd40 tx=0x7f899800bd70 comp rx=0 tx=0).stop 2024-05-08T07:42:46.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.210+0000 7f89b2b05b80 1 -- 172.21.15.70:0/4073118689 shutdown_connections 2024-05-08T07:42:46.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.210+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c620893e0 0x563c6208b7d0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.210+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205f330 0x563c62079440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.210+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205b9d0 0x563c6207f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.210+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/4073118689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c6207f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.210+0000 7f89b2b05b80 1 -- 172.21.15.70:0/4073118689 >> 172.21.15.70:0/4073118689 conn(0x563c61fd6860 msgr2=0x563c620590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:42:46.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.210+0000 7f8983400700 0 client.26176 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:42:46.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.211+0000 7f89b2b05b80 1 -- 172.21.15.70:0/4073118689 shutdown_connections 2024-05-08T07:42:46.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.211+0000 7f89b2b05b80 1 -- 172.21.15.70:0/4073118689 wait complete. 2024-05-08T07:42:46.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.211+0000 7f89b2b05b80 20 client.26176 trim_cache size 0 max 16384 2024-05-08T07:42:46.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.251+0000 7f89b2b05b80 1 Processor -- start 2024-05-08T07:42:46.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.251+0000 7f89b2b05b80 1 -- start start 2024-05-08T07:42:46.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.251+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.251+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c62061780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.251+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62053a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.251+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89a01b8420 con 0x563c6205f330 2024-05-08T07:42:46.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.251+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89a01b5cb0 con 0x563c6205c2f0 2024-05-08T07:42:46.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.251+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f89a01b3b20 con 0x563c6205b9d0 2024-05-08T07:42:46.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.252+0000 7f89a5800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.252+0000 7f89a4e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c62061780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.252+0000 7f89a5800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:60434/0 (socket says 172.21.15.70:60434) 2024-05-08T07:42:46.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.252+0000 7f89a5800700 1 -- 172.21.15.70:0/61842807 learned_addr learned my addr 172.21.15.70:0/61842807 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:42:46.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.252+0000 7f89a6200700 1 --2- 172.21.15.70:0/61842807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62053a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.253+0000 7f89a4e00700 1 -- 172.21.15.70:0/61842807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 msgr2=0x563c6205bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:42:46.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.253+0000 7f89a4e00700 1 --2- 172.21.15.70:0/61842807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.253+0000 7f89a4e00700 1 -- 172.21.15.70:0/61842807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 msgr2=0x563c62053a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:42:46.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.253+0000 7f89a4e00700 1 --2- 172.21.15.70:0/61842807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62053a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.253+0000 7f89a4e00700 1 -- 172.21.15.70:0/61842807 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c62055d00 con 0x563c6205c2f0 2024-05-08T07:42:46.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.253+0000 7f89a6200700 1 --2- 172.21.15.70:0/61842807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62053a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:42:46.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.253+0000 7f89a4e00700 1 --2- 172.21.15.70:0/61842807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c62061780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8994009230 tx=0x7f8994092040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72302d35a94db46 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:42:46.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.254+0000 7f898e000700 1 -- 172.21.15.70:0/61842807 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940c4070 con 0x563c6205c2f0 2024-05-08T07:42:46.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.254+0000 7f898e000700 1 -- 172.21.15.70:0/61842807 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f89940b3120 con 0x563c6205c2f0 2024-05-08T07:42:46.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.254+0000 7f898e000700 1 -- 172.21.15.70:0/61842807 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89940b37e0 con 0x563c6205c2f0 2024-05-08T07:42:46.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.255+0000 7f89b2b05b80 1 -- 172.21.15.70:0/61842807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 msgr2=0x563c62061780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:42:46.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.255+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/61842807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c62061780 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8994009230 tx=0x7f8994092040 comp rx=0 tx=0).stop 2024-05-08T07:42:46.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.255+0000 7f89b2b05b80 1 -- 172.21.15.70:0/61842807 shutdown_connections 2024-05-08T07:42:46.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.255+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/61842807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62053a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.255+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/61842807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 0x563c6205bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.255+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/61842807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c62061780 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.255+0000 7f89b2b05b80 1 -- 172.21.15.70:0/61842807 >> 172.21.15.70:0/61842807 conn(0x563c61fd6860 msgr2=0x563c62053340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:42:46.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.255+0000 7f89b2b05b80 1 -- 172.21.15.70:0/61842807 shutdown_connections 2024-05-08T07:42:46.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.256+0000 7f89b2b05b80 1 -- 172.21.15.70:0/61842807 wait complete. 2024-05-08T07:42:46.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.256+0000 7f89b2b05b80 1 -- start start 2024-05-08T07:42:46.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.256+0000 7f89b2b05b80 1 Processor -- start 2024-05-08T07:42:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.257+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 0x563c62085950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.257+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c62083d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.257+0000 7f89b2b05b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62084290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.257+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89a01b4170 con 0x563c6205f330 2024-05-08T07:42:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.257+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f89a01b55e0 con 0x563c6205c2f0 2024-05-08T07:42:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.257+0000 7f89b2b05b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f89a01b4840 con 0x563c6205b9d0 2024-05-08T07:42:46.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.257+0000 7f89b2b05b80 10 client.0 _ll_register_callbacks cb 0x563c61f57e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:42:46.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.258+0000 7f89a6200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62084290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.258+0000 7f89a5800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 0x563c62085950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.258+0000 7f89a6200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62084290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50992/0 (socket says 172.21.15.70:50992) 2024-05-08T07:42:46.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.258+0000 7f89a6200700 1 -- 172.21.15.70:0/2386995915 learned_addr learned my addr 172.21.15.70:0/2386995915 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:42:46.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.258+0000 7f89a4e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c62083d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.259+0000 7f89a6200700 1 -- 172.21.15.70:0/2386995915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 msgr2=0x563c62085950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:42:46.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.259+0000 7f89a6200700 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 0x563c62085950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.259+0000 7f89a6200700 1 -- 172.21.15.70:0/2386995915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 msgr2=0x563c62083d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:42:46.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.259+0000 7f89a6200700 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c62083d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:42:46.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.259+0000 7f89a6200700 1 -- 172.21.15.70:0/2386995915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6207f910 con 0x563c6205f330 2024-05-08T07:42:46.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.259+0000 7f89a6200700 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62084290 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8998009a20 tx=0x7f8998009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40afa294932a46e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:42:46.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.259+0000 7f8983400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:42:46.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.260+0000 7f8983400700 1 -- 172.21.15.70:0/2386995915 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998037060 con 0x563c6205f330 2024-05-08T07:42:46.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.260+0000 7f89b2b05b80 1 -- 172.21.15.70:0/2386995915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c61fbe590 con 0x563c6205f330 2024-05-08T07:42:46.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.260+0000 7f8983400700 1 -- 172.21.15.70:0/2386995915 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(191..191 src has 1..191) ==== 9583+0+0 (secure 0 0 0) 0x7f89980056c0 con 0x563c6205f330 2024-05-08T07:42:46.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.261+0000 7f8983400700 1 -- 172.21.15.70:0/2386995915 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f899803e050 con 0x563c6205f330 2024-05-08T07:42:46.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.261+0000 7f89b2b05b80 10 client.17037 fetch_fsmap learned FSMap version 42 2024-05-08T07:42:46.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.261+0000 7f89b2b05b80 1 -- 172.21.15.70:0/2386995915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563c620f4930 con 0x563c6205f330 2024-05-08T07:42:46.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.261+0000 7f8983400700 1 -- 172.21.15.70:0/2386995915 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563c61fbe590 con 0x563c6205f330 2024-05-08T07:42:46.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.262+0000 7f8983400700 1 -- 172.21.15.70:0/2386995915 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f8998011040 con 0x563c6205f330 2024-05-08T07:42:46.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.262+0000 7f89b2b05b80 10 client.17037 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:42:46.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.262+0000 7f89b2b05b80 10 client.17037 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:42:46.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.262+0000 7f89b2b05b80 20 client.17037 populate_metadata read hostname 'smithi070' 2024-05-08T07:42:46.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.262+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c620f5080 0x563c620f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:42:46.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.262+0000 7f89b2b05b80 4 client.17037 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 83.9, "await_for": 42.0}] 2024-05-08T07:42:46.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.262+0000 7f89b2b05b80 1 -- 172.21.15.70:0/2386995915 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 83.9, "await_for": 42.0}) -- 0x563c61fb8630 con 0x563c620f5080 2024-05-08T07:42:46.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.263+0000 7f89a5800700 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c620f5080 0x563c620f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:42:46.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.264+0000 7f89a5800700 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c620f5080 0x563c620f74a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a276bba23858d6aa server_cookie=ae03be043753b8d7 in_seq=0 out_seq=0 2024-05-08T07:42:46.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:42:46.264+0000 7f8983400700 10 client.17037 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:42:46.776 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mtrr/generic.o 2024-05-08T07:42:47.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:47 smithi194 ceph-mon[33679]: pgmap v1787: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 471 KiB/s wr, 192 op/s 2024-05-08T07:42:47.794 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:47 smithi070 ceph-mon[29591]: pgmap v1787: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 471 KiB/s wr, 192 op/s 2024-05-08T07:42:47.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:47 smithi172 ceph-mon[33377]: pgmap v1787: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 471 KiB/s wr, 192 op/s 2024-05-08T07:42:49.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:49 smithi194 ceph-mon[33679]: pgmap v1788: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 350 KiB/s wr, 188 op/s 2024-05-08T07:42:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:49 smithi070 ceph-mon[29591]: pgmap v1788: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 350 KiB/s wr, 188 op/s 2024-05-08T07:42:49.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:49 smithi172 ceph-mon[33377]: pgmap v1788: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 350 KiB/s wr, 188 op/s 2024-05-08T07:42:51.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:51 smithi194 ceph-mon[33679]: pgmap v1789: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 366 KiB/s wr, 191 op/s 2024-05-08T07:42:51.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:51 smithi070 ceph-mon[29591]: pgmap v1789: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 366 KiB/s wr, 191 op/s 2024-05-08T07:42:51.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:51 smithi172 ceph-mon[33377]: pgmap v1789: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 366 KiB/s wr, 191 op/s 2024-05-08T07:42:53.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:53 smithi194 ceph-mon[33679]: pgmap v1790: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 431 KiB/s wr, 73 op/s 2024-05-08T07:42:53.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:53 smithi070 ceph-mon[29591]: pgmap v1790: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 431 KiB/s wr, 73 op/s 2024-05-08T07:42:53.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:53 smithi172 ceph-mon[33377]: pgmap v1790: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 431 KiB/s wr, 73 op/s 2024-05-08T07:42:55.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:55 smithi194 ceph-mon[33679]: pgmap v1791: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 282 KiB/s wr, 18 op/s 2024-05-08T07:42:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:55 smithi070 ceph-mon[29591]: pgmap v1791: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 282 KiB/s wr, 18 op/s 2024-05-08T07:42:55.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:55 smithi172 ceph-mon[33377]: pgmap v1791: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 282 KiB/s wr, 18 op/s 2024-05-08T07:42:57.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:57 smithi172 ceph-mon[33377]: pgmap v1792: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 287 KiB/s wr, 18 op/s 2024-05-08T07:42:57.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:57 smithi194 ceph-mon[33679]: pgmap v1792: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 287 KiB/s wr, 18 op/s 2024-05-08T07:42:57.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:57 smithi070 ceph-mon[29591]: pgmap v1792: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 287 KiB/s wr, 18 op/s 2024-05-08T07:42:59.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:42:59 smithi194 ceph-mon[33679]: pgmap v1793: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 132 KiB/s wr, 14 op/s 2024-05-08T07:42:59.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:42:59 smithi070 ceph-mon[29591]: pgmap v1793: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 132 KiB/s wr, 14 op/s 2024-05-08T07:42:59.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:42:59 smithi172 ceph-mon[33377]: pgmap v1793: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 132 KiB/s wr, 14 op/s 2024-05-08T07:43:01.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:01 smithi194 ceph-mon[33679]: pgmap v1794: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 129 KiB/s wr, 14 op/s 2024-05-08T07:43:01.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:01 smithi070 ceph-mon[29591]: pgmap v1794: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 129 KiB/s wr, 14 op/s 2024-05-08T07:43:01.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:01 smithi172 ceph-mon[33377]: pgmap v1794: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 129 KiB/s wr, 14 op/s 2024-05-08T07:43:03.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:03 smithi194 ceph-mon[33679]: pgmap v1795: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 140 KiB/s wr, 13 op/s 2024-05-08T07:43:03.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:03 smithi070 ceph-mon[29591]: pgmap v1795: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 140 KiB/s wr, 13 op/s 2024-05-08T07:43:03.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:03 smithi172 ceph-mon[33377]: pgmap v1795: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 140 KiB/s wr, 13 op/s 2024-05-08T07:43:05.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:05 smithi194 ceph-mon[33679]: pgmap v1796: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-05-08T07:43:05.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:05 smithi070 ceph-mon[29591]: pgmap v1796: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-05-08T07:43:05.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:05 smithi172 ceph-mon[33377]: pgmap v1796: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-05-08T07:43:07.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:07 smithi070 ceph-mon[29591]: pgmap v1797: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-05-08T07:43:07.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:07 smithi172 ceph-mon[33377]: pgmap v1797: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-05-08T07:43:08.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:07 smithi194 ceph-mon[33679]: pgmap v1797: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 11 op/s 2024-05-08T07:43:08.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.529+0000 7f8983400700 1 -- 172.21.15.70:0/2386995915 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x563c61fb8630 con 0x563c620f5080 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.529+0000 7f8983400700 10 client.17037 handle_command_reply: tid=0 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.529+0000 7f89b2b05b80 1 client.17037 shutdown 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.529+0000 7f89b2b05b80 1 -- 172.21.15.70:0/2386995915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 msgr2=0x563c62084290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.529+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62084290 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8998009a20 tx=0x7f8998009bf0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.530+0000 7f89b2b05b80 1 -- 172.21.15.70:0/2386995915 shutdown_connections 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.530+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c620f5080 0x563c620f74a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.530+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c6205f330 0x563c62084290 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.530+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c6205b9d0 0x563c62085950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.530+0000 7f89b2b05b80 1 --2- 172.21.15.70:0/2386995915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c6205c2f0 0x563c62083d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.530+0000 7f89b2b05b80 1 -- 172.21.15.70:0/2386995915 >> 172.21.15.70:0/2386995915 conn(0x563c61fd6860 msgr2=0x563c62053bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.530+0000 7f8983400700 0 client.17037 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:43:08.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.530+0000 7f89b2b05b80 1 -- 172.21.15.70:0/2386995915 shutdown_connections 2024-05-08T07:43:08.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.530+0000 7f89b2b05b80 1 -- 172.21.15.70:0/2386995915 wait complete. 2024-05-08T07:43:08.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.531+0000 7f89b2b05b80 20 client.17037 trim_cache size 0 max 16384 2024-05-08T07:43:08.529 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:43:08.529 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:43:08.529 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:43:08.529 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 138, 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "9c44ee5c": { 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 138, 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 83.9, 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:43:08.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:43:08.531 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:43:08.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:08.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:08.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:08.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:08.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:08.531 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.532+0000 7f89a8200700 1 -- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89880b2b70 msgr2=0x7f89880b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.532+0000 7f89a8200700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89880b2b70 0x7f89880b5030 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8990007be0 tx=0x7f89900073d0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.532+0000 7f89a8200700 1 -- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a006bd90 msgr2=0x7f89a0075100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.532+0000 7f89a8200700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a006bd90 0x7f89a0075100 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f899400e9a0 tx=0x7f899400ecb0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.533+0000 7f89a8200700 1 -- 172.21.15.70:0/1460678820 shutdown_connections 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.533+0000 7f89a8200700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89880b2b70 0x7f89880b5030 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.533+0000 7f89a8200700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89a0108860 0x7f89a006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.533+0000 7f89a8200700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89a006b3e0 0x7f89a0074bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.533+0000 7f89a8200700 1 --2- 172.21.15.70:0/1460678820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89a006bd90 0x7f89a0075100 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.533+0000 7f89a8200700 1 -- 172.21.15.70:0/1460678820 >> 172.21.15.70:0/1460678820 conn(0x7f89a0079340 msgr2=0x7f89a0100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.533+0000 7f89a8200700 1 -- 172.21.15.70:0/1460678820 shutdown_connections 2024-05-08T07:43:08.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:08.534+0000 7f89a8200700 1 -- 172.21.15.70:0/1460678820 wait complete. 2024-05-08T07:43:09.342 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9c44ee5c', quiesce took 32.5 seconds. Will release after: 23.9 2024-05-08T07:43:09.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:09 smithi070 ceph-mon[29591]: pgmap v1798: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 9 op/s 2024-05-08T07:43:09.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:09 smithi172 ceph-mon[33377]: pgmap v1798: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 9 op/s 2024-05-08T07:43:10.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:09 smithi194 ceph-mon[33679]: pgmap v1798: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 44 KiB/s wr, 9 op/s 2024-05-08T07:43:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:11 smithi070 ceph-mon[29591]: pgmap v1799: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 66 KiB/s wr, 11 op/s 2024-05-08T07:43:11.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:11 smithi172 ceph-mon[33377]: pgmap v1799: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 66 KiB/s wr, 11 op/s 2024-05-08T07:43:12.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:11 smithi194 ceph-mon[33679]: pgmap v1799: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 66 KiB/s wr, 11 op/s 2024-05-08T07:43:13.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:13 smithi070 ceph-mon[29591]: pgmap v1800: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 108 KiB/s wr, 26 op/s 2024-05-08T07:43:13.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:13 smithi172 ceph-mon[33377]: pgmap v1800: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 108 KiB/s wr, 26 op/s 2024-05-08T07:43:14.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:13 smithi194 ceph-mon[33679]: pgmap v1800: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 108 KiB/s wr, 26 op/s 2024-05-08T07:43:14.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:14 smithi070 ceph-mon[29591]: osdmap e192: 12 total, 12 up, 12 in 2024-05-08T07:43:14.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:14 smithi172 ceph-mon[33377]: osdmap e192: 12 total, 12 up, 12 in 2024-05-08T07:43:15.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:14 smithi194 ceph-mon[33679]: osdmap e192: 12 total, 12 up, 12 in 2024-05-08T07:43:15.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:15 smithi070 ceph-mon[29591]: pgmap v1802: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 116 KiB/s wr, 58 op/s 2024-05-08T07:43:15.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:15 smithi172 ceph-mon[33377]: pgmap v1802: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 116 KiB/s wr, 58 op/s 2024-05-08T07:43:16.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:15 smithi194 ceph-mon[33679]: pgmap v1802: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 116 KiB/s wr, 58 op/s 2024-05-08T07:43:17.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:17 smithi070 ceph-mon[29591]: pgmap v1803: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 121 KiB/s wr, 153 op/s 2024-05-08T07:43:17.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:17 smithi172 ceph-mon[33377]: pgmap v1803: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 121 KiB/s wr, 153 op/s 2024-05-08T07:43:18.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:17 smithi194 ceph-mon[33679]: pgmap v1803: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 121 KiB/s wr, 153 op/s 2024-05-08T07:43:19.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:19 smithi070 ceph-mon[29591]: pgmap v1804: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 123 KiB/s wr, 168 op/s 2024-05-08T07:43:19.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:19 smithi172 ceph-mon[33377]: pgmap v1804: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 123 KiB/s wr, 168 op/s 2024-05-08T07:43:20.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:19 smithi194 ceph-mon[33679]: pgmap v1804: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 123 KiB/s wr, 168 op/s 2024-05-08T07:43:21.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:21 smithi070 ceph-mon[29591]: pgmap v1805: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 132 KiB/s wr, 241 op/s 2024-05-08T07:43:21.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:21 smithi172 ceph-mon[33377]: pgmap v1805: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 132 KiB/s wr, 241 op/s 2024-05-08T07:43:22.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:21 smithi194 ceph-mon[33679]: pgmap v1805: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 132 KiB/s wr, 241 op/s 2024-05-08T07:43:23.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:23 smithi070 ceph-mon[29591]: pgmap v1806: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 100 KiB/s wr, 255 op/s 2024-05-08T07:43:23.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:23 smithi070 ceph-mon[29591]: osdmap e193: 12 total, 12 up, 12 in 2024-05-08T07:43:23.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:23 smithi172 ceph-mon[33377]: pgmap v1806: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 100 KiB/s wr, 255 op/s 2024-05-08T07:43:23.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:23 smithi172 ceph-mon[33377]: osdmap e193: 12 total, 12 up, 12 in 2024-05-08T07:43:24.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:23 smithi194 ceph-mon[33679]: pgmap v1806: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 100 KiB/s wr, 255 op/s 2024-05-08T07:43:24.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:23 smithi194 ceph-mon[33679]: osdmap e193: 12 total, 12 up, 12 in 2024-05-08T07:43:25.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:25 smithi070 ceph-mon[29591]: pgmap v1808: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 80 KiB/s wr, 223 op/s 2024-05-08T07:43:25.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:25 smithi172 ceph-mon[33377]: pgmap v1808: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 80 KiB/s wr, 223 op/s 2024-05-08T07:43:26.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:25 smithi194 ceph-mon[33679]: pgmap v1808: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 80 KiB/s wr, 223 op/s 2024-05-08T07:43:27.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:27 smithi070 ceph-mon[29591]: pgmap v1809: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 56 KiB/s wr, 129 op/s 2024-05-08T07:43:27.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:27 smithi172 ceph-mon[33377]: pgmap v1809: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 56 KiB/s wr, 129 op/s 2024-05-08T07:43:28.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:27 smithi194 ceph-mon[33679]: pgmap v1809: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 56 KiB/s wr, 129 op/s 2024-05-08T07:43:29.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:29 smithi070 ceph-mon[29591]: pgmap v1810: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 54 KiB/s wr, 114 op/s 2024-05-08T07:43:29.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:29 smithi172 ceph-mon[33377]: pgmap v1810: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 54 KiB/s wr, 114 op/s 2024-05-08T07:43:30.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:29 smithi194 ceph-mon[33679]: pgmap v1810: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 54 KiB/s wr, 114 op/s 2024-05-08T07:43:31.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:31 smithi070 ceph-mon[29591]: pgmap v1811: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 41 KiB/s wr, 39 op/s 2024-05-08T07:43:31.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:31 smithi172 ceph-mon[33377]: pgmap v1811: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 41 KiB/s wr, 39 op/s 2024-05-08T07:43:32.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:31 smithi194 ceph-mon[33679]: pgmap v1811: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 41 KiB/s wr, 39 op/s 2024-05-08T07:43:33.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:43:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:43:33.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:33 smithi070 ceph-mon[29591]: pgmap v1812: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T07:43:33.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:33 smithi172 ceph-mon[33377]: pgmap v1812: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T07:43:34.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:33 smithi194 ceph-mon[33679]: pgmap v1812: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T07:43:35.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:35 smithi070 ceph-mon[29591]: pgmap v1813: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-05-08T07:43:35.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:35 smithi172 ceph-mon[33377]: pgmap v1813: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-05-08T07:43:36.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:35 smithi194 ceph-mon[33679]: pgmap v1813: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 21 KiB/s wr, 7 op/s 2024-05-08T07:43:36.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.348+0000 7f192fe00700 1 -- 172.21.15.70:0/847368336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 msgr2=0x7f1930102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:36.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.348+0000 7f192fe00700 1 --2- 172.21.15.70:0/847368336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 0x7f1930102310 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f1920009990 tx=0x7f1920009ca0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.348+0000 7f192fe00700 1 -- 172.21.15.70:0/847368336 shutdown_connections 2024-05-08T07:43:36.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.348+0000 7f192fe00700 1 --2- 172.21.15.70:0/847368336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19301087a0 0x7f1930110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.348+0000 7f192fe00700 1 --2- 172.21.15.70:0/847368336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 0x7f1930102310 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.348+0000 7f192fe00700 1 --2- 172.21.15.70:0/847368336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19301028e0 0x7f19301080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.348+0000 7f192fe00700 1 -- 172.21.15.70:0/847368336 >> 172.21.15.70:0/847368336 conn(0x7f1930077650 msgr2=0x7f1930077a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:36.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.348+0000 7f192fe00700 1 -- 172.21.15.70:0/847368336 shutdown_connections 2024-05-08T07:43:36.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.348+0000 7f192fe00700 1 -- 172.21.15.70:0/847368336 wait complete. 2024-05-08T07:43:36.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.350+0000 7f192fe00700 1 Processor -- start 2024-05-08T07:43:36.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.350+0000 7f192fe00700 1 -- start start 2024-05-08T07:43:36.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.350+0000 7f192fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 0x7f1930102eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:36.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.350+0000 7f192fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19301028e0 0x7f19301033f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:36.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.350+0000 7f192fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19301087a0 0x7f1930103930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:36.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.350+0000 7f192fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f19301134d0 con 0x7f1930101f30 2024-05-08T07:43:36.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.350+0000 7f192fe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1930113350 con 0x7f19301087a0 2024-05-08T07:43:36.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.350+0000 7f192fe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1930113650 con 0x7f19301028e0 2024-05-08T07:43:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f192ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 0x7f1930102eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f192ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 0x7f1930102eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49104/0 (socket says 172.21.15.70:49104) 2024-05-08T07:43:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f192ea00700 1 -- 172.21.15.70:0/1590643877 learned_addr learned my addr 172.21.15.70:0/1590643877 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:43:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f1927e00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19301028e0 0x7f19301033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:36.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f192ea00700 1 -- 172.21.15.70:0/1590643877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19301028e0 msgr2=0x7f19301033f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f192f400700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19301087a0 0x7f1930103930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f192ea00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19301028e0 0x7f19301033f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f192ea00700 1 -- 172.21.15.70:0/1590643877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19301087a0 msgr2=0x7f1930103930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f192ea00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19301087a0 0x7f1930103930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.351+0000 7f192ea00700 1 -- 172.21.15.70:0/1590643877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19301a7f70 con 0x7f1930101f30 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.352+0000 7f192ea00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 0x7f1930102eb0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1920000c00 tx=0x7f1920009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.352+0000 7f1927400700 1 -- 172.21.15.70:0/1590643877 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920027070 con 0x7f1930101f30 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.352+0000 7f1927400700 1 -- 172.21.15.70:0/1590643877 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f192000fc70 con 0x7f1930101f30 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.352+0000 7f1927400700 1 -- 172.21.15.70:0/1590643877 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920022d40 con 0x7f1930101f30 2024-05-08T07:43:36.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.352+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19301a8200 con 0x7f1930101f30 2024-05-08T07:43:36.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.352+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19301a8600 con 0x7f1930101f30 2024-05-08T07:43:36.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.353+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193010b9d0 con 0x7f1930101f30 2024-05-08T07:43:36.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.356+0000 7f1927400700 1 -- 172.21.15.70:0/1590643877 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f192002a070 con 0x7f1930101f30 2024-05-08T07:43:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.358+0000 7f1927400700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b29f0 0x7f19140b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.359+0000 7f1927400700 1 -- 172.21.15.70:0/1590643877 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 9583+0+0 (secure 0 0 0) 0x7f19200e3c60 con 0x7f1930101f30 2024-05-08T07:43:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.359+0000 7f1927e00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b29f0 0x7f19140b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.359+0000 7f1927e00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b29f0 0x7f19140b4eb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1918005950 tx=0x7f19180058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:43:36.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.361+0000 7f1927400700 1 -- 172.21.15.70:0/1590643877 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1920031070 con 0x7f1930101f30 2024-05-08T07:43:36.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.641+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19301043e0 con 0x7f1930101f30 2024-05-08T07:43:36.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.642+0000 7f1927400700 1 -- 172.21.15.70:0/1590643877 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f1920013070 con 0x7f1930101f30 2024-05-08T07:43:36.639 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:43:36.639 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:43:36.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.645+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b29f0 msgr2=0x7f19140b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:36.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.645+0000 7f192fe00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b29f0 0x7f19140b4eb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1918005950 tx=0x7f19180058e0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.645+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 msgr2=0x7f1930102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:36.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.645+0000 7f192fe00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 0x7f1930102eb0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1920000c00 tx=0x7f1920009f90 comp rx=0 tx=0).stop 2024-05-08T07:43:36.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.646+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 shutdown_connections 2024-05-08T07:43:36.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.646+0000 7f192fe00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f19140b29f0 0x7f19140b4eb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.646+0000 7f192fe00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f19301087a0 0x7f1930103930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.646+0000 7f192fe00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1930101f30 0x7f1930102eb0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.646+0000 7f192fe00700 1 --2- 172.21.15.70:0/1590643877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19301028e0 0x7f19301033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:36.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.646+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 >> 172.21.15.70:0/1590643877 conn(0x7f1930077650 msgr2=0x7f1930100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:36.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.646+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 shutdown_connections 2024-05-08T07:43:36.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:36.646+0000 7f192fe00700 1 -- 172.21.15.70:0/1590643877 wait complete. 2024-05-08T07:43:36.644 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:43:37.464 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 9c44ee5c --release --await' 2024-05-08T07:43:37.464 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 9c44ee5c --release --await 2024-05-08T07:43:37.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:37 smithi070 ceph-mon[29591]: pgmap v1814: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:43:37.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:37 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1590643877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:43:37.913 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:43:37.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:37 smithi172 ceph-mon[33377]: pgmap v1814: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:43:37.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:37 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1590643877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:43:38.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:37 smithi194 ceph-mon[33679]: pgmap v1814: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:43:38.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:37 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1590643877' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:43:39.892 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:39 smithi070 ceph-mon[29591]: pgmap v1815: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-05-08T07:43:39.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:39 smithi172 ceph-mon[33377]: pgmap v1815: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-05-08T07:43:40.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:39 smithi194 ceph-mon[33679]: pgmap v1815: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-05-08T07:43:40.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.206+0000 7f2ebe600700 1 -- 172.21.15.70:0/734019432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 msgr2=0x7f2eb81124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:40.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.206+0000 7f2ebe600700 1 --2- 172.21.15.70:0/734019432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 0x7f2eb81124a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009990 tx=0x7f2eb0009ca0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.206+0000 7f2ebe600700 1 -- 172.21.15.70:0/734019432 shutdown_connections 2024-05-08T07:43:40.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.206+0000 7f2ebe600700 1 --2- 172.21.15.70:0/734019432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 0x7f2eb81124a0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.206+0000 7f2ebe600700 1 --2- 172.21.15.70:0/734019432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb810b660 0x7f2eb810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.206+0000 7f2ebe600700 1 --2- 172.21.15.70:0/734019432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb81055d0 0x7f2eb8105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.206+0000 7f2ebe600700 1 -- 172.21.15.70:0/734019432 >> 172.21.15.70:0/734019432 conn(0x7f2eb81010c0 msgr2=0x7f2eb81034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:40.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.206+0000 7f2ebe600700 1 -- 172.21.15.70:0/734019432 shutdown_connections 2024-05-08T07:43:40.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.206+0000 7f2ebe600700 1 -- 172.21.15.70:0/734019432 wait complete. 2024-05-08T07:43:40.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.207+0000 7f2ebe600700 1 Processor -- start 2024-05-08T07:43:40.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2ebe600700 1 -- start start 2024-05-08T07:43:40.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2ebe600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb81055d0 0x7f2eb81a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2ebe600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 0x7f2eb81a1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2ebe600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb810b660 0x7f2eb819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2ebe600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81156d0 con 0x7f2eb8105f90 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2ebe600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8115550 con 0x7f2eb81055d0 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2ebe600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb8115850 con 0x7f2eb810b660 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2eb7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 0x7f2eb81a1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2eb7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 0x7f2eb81a1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58090/0 (socket says 172.21.15.70:58090) 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.208+0000 7f2eb7e00700 1 -- 172.21.15.70:0/2414927038 learned_addr learned my addr 172.21.15.70:0/2414927038 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2ebdc00700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb810b660 0x7f2eb819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2ebd200700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb81055d0 0x7f2eb81a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2eb7e00700 1 -- 172.21.15.70:0/2414927038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb810b660 msgr2=0x7f2eb819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb810b660 0x7f2eb819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2eb7e00700 1 -- 172.21.15.70:0/2414927038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb81055d0 msgr2=0x7f2eb81a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb81055d0 0x7f2eb81a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2eb7e00700 1 -- 172.21.15.70:0/2414927038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb819bff0 con 0x7f2eb8105f90 2024-05-08T07:43:40.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 0x7f2eb81a1c10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c9b0 tx=0x7f2ea400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:43:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2eb5600700 1 -- 172.21.15.70:0/2414927038 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4007b00 con 0x7f2eb8105f90 2024-05-08T07:43:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.209+0000 7f2eb5600700 1 -- 172.21.15.70:0/2414927038 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ea4007ca0 con 0x7f2eb8105f90 2024-05-08T07:43:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.210+0000 7f2ebe600700 1 -- 172.21.15.70:0/2414927038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb819c2e0 con 0x7f2eb8105f90 2024-05-08T07:43:40.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.210+0000 7f2eb5600700 1 -- 172.21.15.70:0/2414927038 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4018660 con 0x7f2eb8105f90 2024-05-08T07:43:40.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.210+0000 7f2ebe600700 1 -- 172.21.15.70:0/2414927038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb81a85a0 con 0x7f2eb8105f90 2024-05-08T07:43:40.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.213+0000 7f2eb5600700 1 -- 172.21.15.70:0/2414927038 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2ea400f450 con 0x7f2eb8105f90 2024-05-08T07:43:40.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.215+0000 7f2eb5600700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ea00b29f0 0x7f2ea00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.215+0000 7f2eb5600700 1 -- 172.21.15.70:0/2414927038 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(193..193 src has 1..193) ==== 9583+0+0 (secure 0 0 0) 0x7f2ea40e2b50 con 0x7f2eb8105f90 2024-05-08T07:43:40.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.215+0000 7f2ebd200700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ea00b29f0 0x7f2ea00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.216+0000 7f2ebd200700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ea00b29f0 0x7f2ea00b4eb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2eb819c9d0 tx=0x7f2eac009040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:43:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.232+0000 7f2eca677b80 1 Processor -- start 2024-05-08T07:43:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.232+0000 7f2eca677b80 1 -- start start 2024-05-08T07:43:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.232+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b24fd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.232+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24f7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.232+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24f7ab0 0x5577b24f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.232+0000 7f2eca677b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5577b2449b20 con 0x5577b24fd880 2024-05-08T07:43:40.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.232+0000 7f2eca677b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5577b23e7860 con 0x5577b24f7ab0 2024-05-08T07:43:40.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.232+0000 7f2eca677b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5577b2445ae0 con 0x5577b24fcf60 2024-05-08T07:43:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2eb7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2eb7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24f7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58098/0 (socket says 172.21.15.70:58098) 2024-05-08T07:43:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2eb7e00700 1 -- 172.21.15.70:0/1301865424 learned_addr learned my addr 172.21.15.70:0/1301865424 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:43:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2ebd200700 1 --2- 172.21.15.70:0/1301865424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b24fd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2ebdc00700 1 --2- 172.21.15.70:0/1301865424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24f7ab0 0x5577b24f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2eb7e00700 1 -- 172.21.15.70:0/1301865424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 msgr2=0x5577b24fd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:43:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1301865424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b24fd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2eb7e00700 1 -- 172.21.15.70:0/1301865424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24f7ab0 msgr2=0x5577b24f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:43:40.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1301865424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24f7ab0 0x5577b24f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2eb7e00700 1 -- 172.21.15.70:0/1301865424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577b23969d0 con 0x5577b24fd880 2024-05-08T07:43:40.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.233+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1301865424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24f7490 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400fcf0 tx=0x7f2ea40a94c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0926c1957a8461 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:43:40.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.234+0000 7f2eaa000700 1 -- 172.21.15.70:0/1301865424 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40add60 con 0x5577b24fd880 2024-05-08T07:43:40.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.234+0000 7f2eaa000700 1 -- 172.21.15.70:0/1301865424 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ea40b2810 con 0x5577b24fd880 2024-05-08T07:43:40.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.234+0000 7f2eaa000700 1 -- 172.21.15.70:0/1301865424 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40cc0d0 con 0x5577b24fd880 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.234+0000 7f2eca677b80 1 -- 172.21.15.70:0/1301865424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 msgr2=0x5577b24f7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.234+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1301865424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24f7490 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400fcf0 tx=0x7f2ea40a94c0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.235+0000 7f2eca677b80 1 -- 172.21.15.70:0/1301865424 shutdown_connections 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.235+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1301865424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24f7ab0 0x5577b24f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.235+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1301865424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b24fd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.235+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1301865424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24f7490 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.235+0000 7f2eca677b80 1 -- 172.21.15.70:0/1301865424 >> 172.21.15.70:0/1301865424 conn(0x5577b2425c60 msgr2=0x5577b24f1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.235+0000 7f2eca677b80 1 -- 172.21.15.70:0/1301865424 shutdown_connections 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.235+0000 7f2eca677b80 1 -- 172.21.15.70:0/1301865424 wait complete. 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.235+0000 7f2eca677b80 1 -- start start 2024-05-08T07:43:40.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.236+0000 7f2eca677b80 1 Processor -- start 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.236+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2503600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.236+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b25009a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.236+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 0x5577b2500ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.236+0000 7f2eca677b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5577b2504340 con 0x5577b24f7ab0 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.236+0000 7f2eca677b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5577b23afc20 con 0x5577b24fd880 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.236+0000 7f2eca677b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5577b25044c0 con 0x5577b24fcf60 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.236+0000 7f2eca677b80 10 client.0 _ll_register_callbacks cb 0x5577b23f0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebd200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2503600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebd200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2503600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58110/0 (socket says 172.21.15.70:58110) 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebd200700 1 -- 172.21.15.70:0/3436060431 learned_addr learned my addr 172.21.15.70:0/3436060431 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:43:40.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b25009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebdc00700 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 0x5577b2500ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebd200700 1 -- 172.21.15.70:0/3436060431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 msgr2=0x5577b25009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:43:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebd200700 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b25009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebd200700 1 -- 172.21.15.70:0/3436060431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 msgr2=0x5577b2500ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:43:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebd200700 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 0x5577b2500ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebd200700 1 -- 172.21.15.70:0/3436060431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577b240f520 con 0x5577b24f7ab0 2024-05-08T07:43:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.237+0000 7f2ebdc00700 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 0x5577b2500ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:43:40.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.238+0000 7f2ebd200700 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2503600 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0169a0 tx=0x7f2eac004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a996a81f1febac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.238+0000 7f2e9ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.238+0000 7f2e9ea00700 1 -- 172.21.15.70:0/3436060431 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac016e10 con 0x5577b24f7ab0 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.238+0000 7f2e9ea00700 1 -- 172.21.15.70:0/3436060431 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 9583+0+0 (secure 0 0 0) 0x7f2eac014a70 con 0x5577b24f7ab0 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.238+0000 7f2eca677b80 1 -- 172.21.15.70:0/3436060431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ea40b2810 con 0x5577b24f7ab0 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.238+0000 7f2e9ea00700 1 -- 172.21.15.70:0/3436060431 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2eac030050 con 0x5577b24f7ab0 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.238+0000 7f2eca677b80 10 client.17055 fetch_fsmap learned FSMap version 42 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.238+0000 7f2eca677b80 1 -- 172.21.15.70:0/3436060431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5577b250ebc0 con 0x5577b24f7ab0 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.239+0000 7f2e9ea00700 1 -- 172.21.15.70:0/3436060431 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ea40b2810 con 0x5577b24f7ab0 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.239+0000 7f2e9ea00700 1 -- 172.21.15.70:0/3436060431 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2eac022b70 con 0x5577b24f7ab0 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.239+0000 7f2eca677b80 10 client.17055 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.239+0000 7f2eca677b80 10 client.17055 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.239+0000 7f2eca677b80 20 client.17055 populate_metadata read hostname 'smithi070' 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.239+0000 7f2eca677b80 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577b2511200 0x5577b2513670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.239+0000 7f2eca677b80 4 client.17055 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:43:40.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.239+0000 7f2eca677b80 1 -- 172.21.15.70:0/3436060431 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577b24c41a0 con 0x5577b2511200 2024-05-08T07:43:40.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.240+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577b2511200 0x5577b2513670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.241+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577b2511200 0x5577b2513670 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=640f762355edbdff server_cookie=a00df79fe9c2e3f8 in_seq=0 out_seq=0 2024-05-08T07:43:40.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.241+0000 7f2e9ea00700 10 client.17055 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:43:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2e9ea00700 1 -- 172.21.15.70:0/3436060431 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5577b24c41a0 con 0x5577b2511200 2024-05-08T07:43:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2e9ea00700 10 client.17055 handle_command_reply: tid=0 2024-05-08T07:43:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 client.17055 shutdown 2024-05-08T07:43:40.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 -- 172.21.15.70:0/3436060431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 msgr2=0x5577b2503600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2503600 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0169a0 tx=0x7f2eac004b40 comp rx=0 tx=0).stop 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 -- 172.21.15.70:0/3436060431 shutdown_connections 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577b2511200 0x5577b2513670 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 0x5577b2500ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2503600 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 --2- 172.21.15.70:0/3436060431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b25009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2e9ea00700 0 client.17055 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 -- 172.21.15.70:0/3436060431 >> 172.21.15.70:0/3436060431 conn(0x5577b2425c60 msgr2=0x5577b24f6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 -- 172.21.15.70:0/3436060431 shutdown_connections 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 1 -- 172.21.15.70:0/3436060431 wait complete. 2024-05-08T07:43:40.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.243+0000 7f2eca677b80 20 client.17055 trim_cache size 0 max 16384 2024-05-08T07:43:40.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.265+0000 7f2eca677b80 1 Processor -- start 2024-05-08T07:43:40.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.265+0000 7f2eca677b80 1 -- start start 2024-05-08T07:43:40.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.266+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24f7ab0 0x5577b24f7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.266+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fcf60 0x5577b250d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.266+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24fe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.266+0000 7f2eca677b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81b3e70 con 0x5577b24fd880 2024-05-08T07:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.266+0000 7f2eca677b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81b1700 con 0x5577b24fcf60 2024-05-08T07:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.266+0000 7f2eca677b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81af570 con 0x5577b24f7ab0 2024-05-08T07:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.266+0000 7f2ebdc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.267+0000 7f2ebd200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24f7ab0 0x5577b24f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.267+0000 7f2eb7e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fcf60 0x5577b250d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.267+0000 7f2ebd200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24f7ab0 0x5577b24f7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:45268/0 (socket says 172.21.15.70:45268) 2024-05-08T07:43:40.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.267+0000 7f2ebd200700 1 -- 172.21.15.70:0/1628055640 learned_addr learned my addr 172.21.15.70:0/1628055640 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.267+0000 7f2eb7e00700 1 -- 172.21.15.70:0/1628055640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24f7ab0 msgr2=0x5577b24f7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.267+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1628055640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24f7ab0 0x5577b24f7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.267+0000 7f2eb7e00700 1 -- 172.21.15.70:0/1628055640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 msgr2=0x5577b24fe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.267+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1628055640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24fe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.267+0000 7f2eb7e00700 1 -- 172.21.15.70:0/1628055640 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577b2513cf0 con 0x5577b24fcf60 2024-05-08T07:43:40.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.268+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1628055640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fcf60 0x5577b250d3d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40a5a30 tx=0x7f2ea400a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b79f9e03c22355c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.268+0000 7f2ea9600700 1 -- 172.21.15.70:0/1628055640 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea408e070 con 0x5577b24fcf60 2024-05-08T07:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.268+0000 7f2ea9600700 1 -- 172.21.15.70:0/1628055640 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ea40b2810 con 0x5577b24fcf60 2024-05-08T07:43:40.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.268+0000 7f2ea9600700 1 -- 172.21.15.70:0/1628055640 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40cc0d0 con 0x5577b24fcf60 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 -- 172.21.15.70:0/1628055640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fcf60 msgr2=0x5577b250d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1628055640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fcf60 0x5577b250d3d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2ea40a5a30 tx=0x7f2ea400a610 comp rx=0 tx=0).stop 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 -- 172.21.15.70:0/1628055640 shutdown_connections 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1628055640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24fd880 0x5577b24fe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1628055640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24f7ab0 0x5577b24f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1628055640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fcf60 0x5577b250d3d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 -- 172.21.15.70:0/1628055640 >> 172.21.15.70:0/1628055640 conn(0x5577b2425c60 msgr2=0x5577b24ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 -- 172.21.15.70:0/1628055640 shutdown_connections 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 -- 172.21.15.70:0/1628055640 wait complete. 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.269+0000 7f2eca677b80 1 -- start start 2024-05-08T07:43:40.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2eca677b80 1 Processor -- start 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2506660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b2506ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2eca677b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 0x5577b257bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2eca677b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81afbc0 con 0x5577b24f7ab0 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2eca677b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81b1030 con 0x5577b24fd880 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2eca677b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb81b0290 con 0x5577b24fcf60 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2eca677b80 10 client.0 _ll_register_callbacks cb 0x5577b23f0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2ebd200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2506660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2ebd200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2506660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58132/0 (socket says 172.21.15.70:58132) 2024-05-08T07:43:40.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.270+0000 7f2ebd200700 1 -- 172.21.15.70:0/1316822220 learned_addr learned my addr 172.21.15.70:0/1316822220 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b2506ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2ebd200700 1 -- 172.21.15.70:0/1316822220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 msgr2=0x5577b2506ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2ebd200700 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b2506ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2ebd200700 1 -- 172.21.15.70:0/1316822220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 msgr2=0x5577b257bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2ebd200700 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 0x5577b257bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2ebd200700 1 -- 172.21.15.70:0/1316822220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577b2507490 con 0x5577b24f7ab0 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b2506ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2ebd200700 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2506660 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f2eac005e90 tx=0x7f2eac005f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8dfb71bcb7cf03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2e9ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.271+0000 7f2e9ea00700 1 -- 172.21.15.70:0/1316822220 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0146b0 con 0x5577b24f7ab0 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.272+0000 7f2e9ea00700 1 -- 172.21.15.70:0/1316822220 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(193..193 src has 1..193) ==== 9583+0+0 (secure 0 0 0) 0x7f2eac014c80 con 0x5577b24f7ab0 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.272+0000 7f2eca677b80 1 -- 172.21.15.70:0/1316822220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ea40b2810 con 0x5577b24f7ab0 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.272+0000 7f2e9ea00700 1 -- 172.21.15.70:0/1316822220 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2eac045050 con 0x5577b24f7ab0 2024-05-08T07:43:40.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.272+0000 7f2eca677b80 10 client.17061 fetch_fsmap learned FSMap version 42 2024-05-08T07:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.272+0000 7f2eca677b80 1 -- 172.21.15.70:0/1316822220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5577b257d1e0 con 0x5577b24f7ab0 2024-05-08T07:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.272+0000 7f2e9ea00700 1 -- 172.21.15.70:0/1316822220 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ea40b2810 con 0x5577b24f7ab0 2024-05-08T07:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.272+0000 7f2e9ea00700 1 -- 172.21.15.70:0/1316822220 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2eac022420 con 0x5577b24f7ab0 2024-05-08T07:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.273+0000 7f2eca677b80 10 client.17061 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.273+0000 7f2eca677b80 10 client.17061 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.273+0000 7f2eca677b80 20 client.17061 populate_metadata read hostname 'smithi070' 2024-05-08T07:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.273+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577b257d8f0 0x5577b257fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.273+0000 7f2eca677b80 4 client.17061 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9c44ee5c", "release": true, "await": true}] 2024-05-08T07:43:40.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.273+0000 7f2eca677b80 1 -- 172.21.15.70:0/1316822220 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9c44ee5c", "release": true, "await": true}) -- 0x5577b2457500 con 0x5577b257d8f0 2024-05-08T07:43:40.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.273+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577b257d8f0 0x5577b257fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:43:40.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.274+0000 7f2eb7e00700 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577b257d8f0 0x5577b257fd30 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=894dcbf9ffe03ca6 server_cookie=dd09696635ab5e59 in_seq=0 out_seq=0 2024-05-08T07:43:40.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:40.274+0000 7f2e9ea00700 10 client.17061 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:43:40.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:43:41.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:43:41.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:43:42.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:41 smithi194 ceph-mon[33679]: pgmap v1816: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-05-08T07:43:42.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:41 smithi070 ceph-mon[29591]: pgmap v1816: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-05-08T07:43:42.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:41 smithi172 ceph-mon[33377]: pgmap v1816: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-05-08T07:43:43.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:43:43.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:43:43.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:43:43.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:43:43.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:43:43.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:43:43.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:43:43.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:43:43.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:43:44.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:43 smithi194 ceph-mon[33679]: pgmap v1817: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-05-08T07:43:44.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:43 smithi070 ceph-mon[29591]: pgmap v1817: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-05-08T07:43:44.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:43 smithi172 ceph-mon[33377]: pgmap v1817: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 7 op/s 2024-05-08T07:43:44.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.719+0000 7f2e9ea00700 1 -- 172.21.15.70:0/1316822220 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5577b2457500 con 0x5577b257d8f0 2024-05-08T07:43:44.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.719+0000 7f2e9ea00700 10 client.17061 handle_command_reply: tid=0 2024-05-08T07:43:44.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.719+0000 7f2eca677b80 1 client.17061 shutdown 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.720+0000 7f2eca677b80 1 -- 172.21.15.70:0/1316822220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 msgr2=0x5577b2506660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.720+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2506660 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f2eac005e90 tx=0x7f2eac005f70 comp rx=0 tx=0).stop 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.720+0000 7f2eca677b80 1 -- 172.21.15.70:0/1316822220 shutdown_connections 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.720+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577b257d8f0 0x5577b257fd30 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.720+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577b24fd880 0x5577b257bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.720+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577b24f7ab0 0x5577b2506660 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.720+0000 7f2eca677b80 1 --2- 172.21.15.70:0/1316822220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577b24fcf60 0x5577b2506ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.720+0000 7f2eca677b80 1 -- 172.21.15.70:0/1316822220 >> 172.21.15.70:0/1316822220 conn(0x5577b2425c60 msgr2=0x5577b24fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.720+0000 7f2e9ea00700 0 client.17061 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.721+0000 7f2eca677b80 1 -- 172.21.15.70:0/1316822220 shutdown_connections 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.721+0000 7f2eca677b80 1 -- 172.21.15.70:0/1316822220 wait complete. 2024-05-08T07:43:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.721+0000 7f2eca677b80 20 client.17061 trim_cache size 0 max 16384 2024-05-08T07:43:44.718 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:43:44.718 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:43:44.718 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:43:44.718 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 140, 2024-05-08T07:43:44.718 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:43:44.718 INFO:teuthology.orchestra.run.smithi070.stdout: "9c44ee5c": { 2024-05-08T07:43:44.718 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 140, 2024-05-08T07:43:44.718 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 83.9, 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:44.719 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:44.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:44.720 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:43:44.720 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:43:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 -- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ea00b29f0 msgr2=0x7f2ea00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ea00b29f0 0x7f2ea00b4eb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2eb819c9d0 tx=0x7f2eac009040 comp rx=0 tx=0).stop 2024-05-08T07:43:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 -- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 msgr2=0x7f2eb81a1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:43:44.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 0x7f2eb81a1c10 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c9b0 tx=0x7f2ea400cd70 comp rx=0 tx=0).stop 2024-05-08T07:43:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 -- 172.21.15.70:0/2414927038 shutdown_connections 2024-05-08T07:43:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ea00b29f0 0x7f2ea00b4eb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eb810b660 0x7f2eb819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2eb81055d0 0x7f2eb81a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 --2- 172.21.15.70:0/2414927038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2eb8105f90 0x7f2eb81a1c10 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:43:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 -- 172.21.15.70:0/2414927038 >> 172.21.15.70:0/2414927038 conn(0x7f2eb81010c0 msgr2=0x7f2eb8102600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:43:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.723+0000 7f2ebe600700 1 -- 172.21.15.70:0/2414927038 shutdown_connections 2024-05-08T07:43:44.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:43:44.724+0000 7f2ebe600700 1 -- 172.21.15.70:0/2414927038 wait complete. 2024-05-08T07:43:44.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/module/kallsyms.o 2024-05-08T07:43:45.571 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9c44ee5c', seconds elapsed: 68.7 2024-05-08T07:43:45.869 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/tlb.o 2024-05-08T07:43:45.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:45 smithi070 ceph-mon[29591]: pgmap v1818: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-05-08T07:43:46.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:45 smithi194 ceph-mon[33679]: pgmap v1818: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-05-08T07:43:46.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:45 smithi172 ceph-mon[33377]: pgmap v1818: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-05-08T07:43:46.935 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/proc_net.o 2024-05-08T07:43:47.040 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/conditional.o 2024-05-08T07:43:47.173 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mtrr/cleanup.o 2024-05-08T07:43:47.404 INFO:tasks.workunit.client.0.smithi070.stdout: ASN.1 crypto/rsapubkey.asn1.[ch] 2024-05-08T07:43:47.453 INFO:tasks.workunit.client.0.smithi070.stdout: ASN.1 crypto/rsaprivkey.asn1.[ch] 2024-05-08T07:43:47.499 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/rsa.o 2024-05-08T07:43:47.528 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/vmalloc.o 2024-05-08T07:43:48.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:47 smithi194 ceph-mon[33679]: pgmap v1819: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-05-08T07:43:48.114 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/mls.o 2024-05-08T07:43:48.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:47 smithi070 ceph-mon[29591]: pgmap v1819: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-05-08T07:43:48.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:47 smithi172 ceph-mon[33377]: pgmap v1819: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-05-08T07:43:50.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:49 smithi194 ceph-mon[33679]: pgmap v1820: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-08T07:43:50.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:49 smithi070 ceph-mon[29591]: pgmap v1820: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-08T07:43:50.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:49 smithi172 ceph-mon[33377]: pgmap v1820: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-08T07:43:52.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:51 smithi194 ceph-mon[33679]: pgmap v1821: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 180 KiB/s wr, 15 op/s 2024-05-08T07:43:52.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:51 smithi070 ceph-mon[29591]: pgmap v1821: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 180 KiB/s wr, 15 op/s 2024-05-08T07:43:52.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:51 smithi172 ceph-mon[33377]: pgmap v1821: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 180 KiB/s wr, 15 op/s 2024-05-08T07:43:53.203 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/module/procfs.o 2024-05-08T07:43:54.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:53 smithi194 ceph-mon[33679]: pgmap v1822: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 174 KiB/s wr, 16 op/s 2024-05-08T07:43:54.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:53 smithi070 ceph-mon[29591]: pgmap v1822: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 174 KiB/s wr, 16 op/s 2024-05-08T07:43:54.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:53 smithi172 ceph-mon[33377]: pgmap v1822: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 174 KiB/s wr, 16 op/s 2024-05-08T07:43:54.975 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/cpu_entry_area.o 2024-05-08T07:43:55.946 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/rsa_helper.o 2024-05-08T07:43:56.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:55 smithi070 ceph-mon[29591]: pgmap v1823: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 174 KiB/s wr, 17 op/s 2024-05-08T07:43:56.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:55 smithi172 ceph-mon[33377]: pgmap v1823: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 174 KiB/s wr, 17 op/s 2024-05-08T07:43:56.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:55 smithi194 ceph-mon[33679]: pgmap v1823: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 174 KiB/s wr, 17 op/s 2024-05-08T07:43:56.809 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/kernel/cpu/mtrr/built-in.a 2024-05-08T07:43:57.429 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/kcore.o 2024-05-08T07:43:57.472 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/microcode/core.o 2024-05-08T07:43:57.771 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/rsa-pkcs1pad.o 2024-05-08T07:43:58.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:57 smithi070 ceph-mon[29591]: pgmap v1824: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 266 KiB/s wr, 55 op/s 2024-05-08T07:43:58.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:57 smithi172 ceph-mon[33377]: pgmap v1824: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 266 KiB/s wr, 55 op/s 2024-05-08T07:43:58.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:57 smithi194 ceph-mon[33679]: pgmap v1824: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 266 KiB/s wr, 55 op/s 2024-05-08T07:43:59.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/acompress.o 2024-05-08T07:44:00.117 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/process_vm_access.o 2024-05-08T07:44:00.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:43:59 smithi070 ceph-mon[29591]: pgmap v1825: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 261 KiB/s wr, 71 op/s 2024-05-08T07:44:00.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:43:59 smithi172 ceph-mon[33377]: pgmap v1825: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 261 KiB/s wr, 71 op/s 2024-05-08T07:44:00.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:43:59 smithi194 ceph-mon[33679]: pgmap v1825: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 261 KiB/s wr, 71 op/s 2024-05-08T07:44:00.532 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/ss/context.o 2024-05-08T07:44:02.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:01 smithi070 ceph-mon[29591]: pgmap v1826: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 673 KiB/s wr, 193 op/s 2024-05-08T07:44:02.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:01 smithi172 ceph-mon[33377]: pgmap v1826: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 673 KiB/s wr, 193 op/s 2024-05-08T07:44:02.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:01 smithi194 ceph-mon[33679]: pgmap v1826: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 673 KiB/s wr, 193 op/s 2024-05-08T07:44:02.462 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/module/sysfs.o 2024-05-08T07:44:04.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:03 smithi070 ceph-mon[29591]: pgmap v1827: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 576 KiB/s wr, 213 op/s 2024-05-08T07:44:04.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:03 smithi172 ceph-mon[33377]: pgmap v1827: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 576 KiB/s wr, 213 op/s 2024-05-08T07:44:04.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:03 smithi194 ceph-mon[33679]: pgmap v1827: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 576 KiB/s wr, 213 op/s 2024-05-08T07:44:04.371 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/maccess.o 2024-05-08T07:44:06.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:05 smithi070 ceph-mon[29591]: pgmap v1828: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 593 KiB/s wr, 218 op/s 2024-05-08T07:44:06.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:05 smithi070 ceph-mon[29591]: osdmap e194: 12 total, 12 up, 12 in 2024-05-08T07:44:06.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:05 smithi172 ceph-mon[33377]: pgmap v1828: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 593 KiB/s wr, 218 op/s 2024-05-08T07:44:06.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:05 smithi172 ceph-mon[33377]: osdmap e194: 12 total, 12 up, 12 in 2024-05-08T07:44:06.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:05 smithi194 ceph-mon[33679]: pgmap v1828: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 593 KiB/s wr, 218 op/s 2024-05-08T07:44:06.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:05 smithi194 ceph-mon[33679]: osdmap e194: 12 total, 12 up, 12 in 2024-05-08T07:44:06.992 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/pgprot.o 2024-05-08T07:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/vmcore.o 2024-05-08T07:44:07.473 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/microcode/intel.o 2024-05-08T07:44:08.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:07 smithi070 ceph-mon[29591]: pgmap v1830: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 795 KiB/s wr, 229 op/s 2024-05-08T07:44:08.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:07 smithi172 ceph-mon[33377]: pgmap v1830: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 795 KiB/s wr, 229 op/s 2024-05-08T07:44:08.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:07 smithi194 ceph-mon[33679]: pgmap v1830: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 795 KiB/s wr, 229 op/s 2024-05-08T07:44:10.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:09 smithi070 ceph-mon[29591]: pgmap v1831: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 783 KiB/s wr, 209 op/s 2024-05-08T07:44:10.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:09 smithi172 ceph-mon[33377]: pgmap v1831: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 783 KiB/s wr, 209 op/s 2024-05-08T07:44:10.216 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/page_alloc.o 2024-05-08T07:44:10.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:09 smithi194 ceph-mon[33679]: pgmap v1831: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 783 KiB/s wr, 209 op/s 2024-05-08T07:44:10.262 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/scompress.o 2024-05-08T07:44:10.921 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/module/built-in.a 2024-05-08T07:44:11.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:10 smithi070 ceph-mon[29591]: pgmap v1832: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 301 KiB/s wr, 68 op/s 2024-05-08T07:44:11.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:10 smithi172 ceph-mon[33377]: pgmap v1832: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 301 KiB/s wr, 68 op/s 2024-05-08T07:44:11.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:10 smithi194 ceph-mon[33679]: pgmap v1832: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 301 KiB/s wr, 68 op/s 2024-05-08T07:44:11.441 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/time.o 2024-05-08T07:44:12.969 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/algboss.o 2024-05-08T07:44:13.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:13 smithi172 ceph-mon[33377]: pgmap v1833: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 411 KiB/s wr, 45 op/s 2024-05-08T07:44:13.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:13 smithi172 ceph-mon[33377]: osdmap e195: 12 total, 12 up, 12 in 2024-05-08T07:44:13.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:13 smithi194 ceph-mon[33679]: pgmap v1833: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 411 KiB/s wr, 45 op/s 2024-05-08T07:44:13.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:13 smithi194 ceph-mon[33679]: osdmap e195: 12 total, 12 up, 12 in 2024-05-08T07:44:13.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:13 smithi070 ceph-mon[29591]: pgmap v1833: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 411 KiB/s wr, 45 op/s 2024-05-08T07:44:13.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:13 smithi070 ceph-mon[29591]: osdmap e195: 12 total, 12 up, 12 in 2024-05-08T07:44:14.540 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/hugetlbpage.o 2024-05-08T07:44:15.257 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/selinux/netlabel.o 2024-05-08T07:44:15.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:15 smithi172 ceph-mon[33377]: pgmap v1835: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 297 KiB/s wr, 31 op/s 2024-05-08T07:44:15.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:15 smithi194 ceph-mon[33679]: pgmap v1835: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 297 KiB/s wr, 31 op/s 2024-05-08T07:44:15.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:15 smithi070 ceph-mon[29591]: pgmap v1835: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 297 KiB/s wr, 31 op/s 2024-05-08T07:44:15.972 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/microcode/amd.o 2024-05-08T07:44:16.648 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/kmsg.o 2024-05-08T07:44:17.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:17 smithi172 ceph-mon[33377]: pgmap v1836: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 344 KiB/s wr, 30 op/s 2024-05-08T07:44:17.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:17 smithi194 ceph-mon[33679]: pgmap v1836: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 344 KiB/s wr, 30 op/s 2024-05-08T07:44:17.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:17 smithi070 ceph-mon[29591]: pgmap v1836: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 344 KiB/s wr, 30 op/s 2024-05-08T07:44:19.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:19 smithi194 ceph-mon[33679]: pgmap v1837: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 345 KiB/s wr, 28 op/s 2024-05-08T07:44:19.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:19 smithi070 ceph-mon[29591]: pgmap v1837: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 345 KiB/s wr, 28 op/s 2024-05-08T07:44:19.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:19 smithi172 ceph-mon[33377]: pgmap v1837: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 345 KiB/s wr, 28 op/s 2024-05-08T07:44:20.097 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/init-mm.o 2024-05-08T07:44:21.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:21 smithi194 ceph-mon[33679]: pgmap v1838: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 375 KiB/s wr, 171 op/s 2024-05-08T07:44:21.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:21 smithi070 ceph-mon[29591]: pgmap v1838: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 375 KiB/s wr, 171 op/s 2024-05-08T07:44:21.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:21 smithi172 ceph-mon[33377]: pgmap v1838: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 375 KiB/s wr, 171 op/s 2024-05-08T07:44:22.176 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/timer.o 2024-05-08T07:44:22.325 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/testmgr.o 2024-05-08T07:44:23.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:23 smithi194 ceph-mon[33679]: pgmap v1839: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 402 KiB/s wr, 232 op/s 2024-05-08T07:44:23.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:23 smithi070 ceph-mon[29591]: pgmap v1839: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 402 KiB/s wr, 232 op/s 2024-05-08T07:44:23.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:23 smithi172 ceph-mon[33377]: pgmap v1839: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 402 KiB/s wr, 232 op/s 2024-05-08T07:44:24.923 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/crypto/built-in.a 2024-05-08T07:44:24.974 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/dump_pagetables.o 2024-05-08T07:44:24.988 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc/page.o 2024-05-08T07:44:25.162 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/numa.o 2024-05-08T07:44:25.583 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/kernel/cpu/microcode/built-in.a 2024-05-08T07:44:25.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:25 smithi194 ceph-mon[33679]: pgmap v1840: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 372 KiB/s wr, 214 op/s 2024-05-08T07:44:25.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:25 smithi070 ceph-mon[29591]: pgmap v1840: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 372 KiB/s wr, 214 op/s 2024-05-08T07:44:25.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:25 smithi172 ceph-mon[33377]: pgmap v1840: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 372 KiB/s wr, 214 op/s 2024-05-08T07:44:25.996 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/cacheinfo.o 2024-05-08T07:44:27.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:27 smithi172 ceph-mon[33377]: pgmap v1841: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 362 KiB/s wr, 197 op/s 2024-05-08T07:44:27.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:27 smithi194 ceph-mon[33679]: pgmap v1841: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 362 KiB/s wr, 197 op/s 2024-05-08T07:44:27.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:27 smithi070 ceph-mon[29591]: pgmap v1841: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 362 KiB/s wr, 197 op/s 2024-05-08T07:44:28.815 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/memblock.o 2024-05-08T07:44:29.077 INFO:tasks.workunit.client.0.smithi070.stdout: AR security/selinux/built-in.a 2024-05-08T07:44:29.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:29 smithi194 ceph-mon[33679]: pgmap v1842: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 327 KiB/s wr, 193 op/s 2024-05-08T07:44:29.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:29 smithi070 ceph-mon[29591]: pgmap v1842: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 327 KiB/s wr, 193 op/s 2024-05-08T07:44:29.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:29 smithi172 ceph-mon[33377]: pgmap v1842: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 327 KiB/s wr, 193 op/s 2024-05-08T07:44:29.958 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.5 2024-05-08T07:44:29.959 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:44:30.467 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:44:30.534 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/cmac.o 2024-05-08T07:44:30.645 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/integrity/iint.o 2024-05-08T07:44:31.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:31 smithi194 ceph-mon[33679]: pgmap v1843: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 351 KiB/s wr, 198 op/s 2024-05-08T07:44:31.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:31 smithi070 ceph-mon[29591]: pgmap v1843: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 351 KiB/s wr, 198 op/s 2024-05-08T07:44:31.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:31 smithi172 ceph-mon[33377]: pgmap v1843: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 351 KiB/s wr, 198 op/s 2024-05-08T07:44:33.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:33 smithi070 ceph-mon[29591]: pgmap v1844: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 457 KiB/s wr, 86 op/s 2024-05-08T07:44:33.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:33 smithi194 ceph-mon[33679]: pgmap v1844: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 457 KiB/s wr, 86 op/s 2024-05-08T07:44:33.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:33 smithi172 ceph-mon[33377]: pgmap v1844: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 457 KiB/s wr, 86 op/s 2024-05-08T07:44:34.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.143+0000 7f37ea400700 1 -- 172.21.15.70:0/1052600304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4103eb0 msgr2=0x7f37e4110390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:34.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.143+0000 7f37ea400700 1 --2- 172.21.15.70:0/1052600304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4103eb0 0x7f37e4110390 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00b0a0 tx=0x7f37dc00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:44:34.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.143+0000 7f37ea400700 1 -- 172.21.15.70:0/1052600304 shutdown_connections 2024-05-08T07:44:34.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.143+0000 7f37ea400700 1 --2- 172.21.15.70:0/1052600304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4103eb0 0x7f37e4110390 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:34.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.143+0000 7f37ea400700 1 --2- 172.21.15.70:0/1052600304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37e4109600 0x7f37e41099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:34.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.143+0000 7f37ea400700 1 --2- 172.21.15.70:0/1052600304 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37e41034f0 0x7f37e4103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:34.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.143+0000 7f37ea400700 1 -- 172.21.15.70:0/1052600304 >> 172.21.15.70:0/1052600304 conn(0x7f37e407a650 msgr2=0x7f37e407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:44:34.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.144+0000 7f37ea400700 1 -- 172.21.15.70:0/1052600304 shutdown_connections 2024-05-08T07:44:34.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.144+0000 7f37ea400700 1 -- 172.21.15.70:0/1052600304 wait complete. 2024-05-08T07:44:34.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.145+0000 7f37ea400700 1 Processor -- start 2024-05-08T07:44:34.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.146+0000 7f37ea400700 1 -- start start 2024-05-08T07:44:34.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.146+0000 7f37ea400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37e41034f0 0x7f37e41a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:34.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.146+0000 7f37ea400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37e4103eb0 0x7f37e41a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:34.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.146+0000 7f37ea400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4109600 0x7f37e419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:34.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.146+0000 7f37ea400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37e4113570 con 0x7f37e4109600 2024-05-08T07:44:34.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.146+0000 7f37ea400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f37e41133f0 con 0x7f37e41034f0 2024-05-08T07:44:34.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.146+0000 7f37ea400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f37e41136f0 con 0x7f37e4103eb0 2024-05-08T07:44:34.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.147+0000 7f37e3400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37e41034f0 0x7f37e41a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:34.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.147+0000 7f37e3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4109600 0x7f37e419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:34.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.147+0000 7f37e3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4109600 0x7f37e419ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58116/0 (socket says 172.21.15.70:58116) 2024-05-08T07:44:34.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.147+0000 7f37e3e00700 1 -- 172.21.15.70:0/2342699800 learned_addr learned my addr 172.21.15.70:0/2342699800 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:44:34.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.147+0000 7f37e2a00700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37e4103eb0 0x7f37e41a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:34.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.148+0000 7f37e3e00700 1 -- 172.21.15.70:0/2342699800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37e4103eb0 msgr2=0x7f37e41a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:34.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.148+0000 7f37e3e00700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37e4103eb0 0x7f37e41a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:34.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.148+0000 7f37e3e00700 1 -- 172.21.15.70:0/2342699800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37e41034f0 msgr2=0x7f37e41a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:34.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.148+0000 7f37e3e00700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37e41034f0 0x7f37e41a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:34.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.148+0000 7f37e3e00700 1 -- 172.21.15.70:0/2342699800 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e419c1f0 con 0x7f37e4109600 2024-05-08T07:44:34.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.148+0000 7f37e3e00700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4109600 0x7f37e419ba90 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00b070 tx=0x7f37dc004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:44:34.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.149+0000 7f37dbe00700 1 -- 172.21.15.70:0/2342699800 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc021070 con 0x7f37e4109600 2024-05-08T07:44:34.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.149+0000 7f37dbe00700 1 -- 172.21.15.70:0/2342699800 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37dc007b80 con 0x7f37e4109600 2024-05-08T07:44:34.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.149+0000 7f37dbe00700 1 -- 172.21.15.70:0/2342699800 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc005040 con 0x7f37e4109600 2024-05-08T07:44:34.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.149+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e419c480 con 0x7f37e4109600 2024-05-08T07:44:34.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.149+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e41a8750 con 0x7f37e4109600 2024-05-08T07:44:34.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.151+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37e406a190 con 0x7f37e4109600 2024-05-08T07:44:34.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.155+0000 7f37dbe00700 1 -- 172.21.15.70:0/2342699800 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f37dc024070 con 0x7f37e4109600 2024-05-08T07:44:34.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.157+0000 7f37dbe00700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f37c80b2b40 0x7f37c80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:34.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.157+0000 7f37dbe00700 1 -- 172.21.15.70:0/2342699800 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 9583+0+0 (secure 0 0 0) 0x7f37dc00f020 con 0x7f37e4109600 2024-05-08T07:44:34.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.157+0000 7f37e3400700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f37c80b2b40 0x7f37c80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:34.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.159+0000 7f37e3400700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f37c80b2b40 0x7f37c80b5000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37e4109000 tx=0x7f37d4009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:44:34.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.161+0000 7f37dbe00700 1 -- 172.21.15.70:0/2342699800 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f37dc02b020 con 0x7f37e4109600 2024-05-08T07:44:34.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.678+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37e41a8920 con 0x7f37e4109600 2024-05-08T07:44:34.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.680+0000 7f37dbe00700 1 -- 172.21.15.70:0/2342699800 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f37dc0ab780 con 0x7f37e4109600 2024-05-08T07:44:34.677 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:44:34.677 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:44:34.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.683+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f37c80b2b40 msgr2=0x7f37c80b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:34.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.683+0000 7f37ea400700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f37c80b2b40 0x7f37c80b5000 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37e4109000 tx=0x7f37d4009260 comp rx=0 tx=0).stop 2024-05-08T07:44:34.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.684+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4109600 msgr2=0x7f37e419ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:34.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.684+0000 7f37ea400700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4109600 0x7f37e419ba90 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f37dc00b070 tx=0x7f37dc004c60 comp rx=0 tx=0).stop 2024-05-08T07:44:34.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.684+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 shutdown_connections 2024-05-08T07:44:34.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.684+0000 7f37ea400700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f37c80b2b40 0x7f37c80b5000 secure :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37e4109000 tx=0x7f37d4009260 comp rx=0 tx=0).stop 2024-05-08T07:44:34.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.684+0000 7f37ea400700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37e4109600 0x7f37e419ba90 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:34.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.684+0000 7f37ea400700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f37e41034f0 0x7f37e41a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:34.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.684+0000 7f37ea400700 1 --2- 172.21.15.70:0/2342699800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f37e4103eb0 0x7f37e41a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:34.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.684+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 >> 172.21.15.70:0/2342699800 conn(0x7f37e407a650 msgr2=0x7f37e4101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:44:34.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.684+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 shutdown_connections 2024-05-08T07:44:34.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:34.685+0000 7f37ea400700 1 -- 172.21.15.70:0/2342699800 wait complete. 2024-05-08T07:44:34.684 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:44:34.875 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/hrtimer.o 2024-05-08T07:44:35.147 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/scattered.o 2024-05-08T07:44:35.550 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 73.5 --await-for 42.0' 2024-05-08T07:44:35.550 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 73.5 --await-for 42.0 2024-05-08T07:44:35.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:35 smithi194 ceph-mon[33679]: pgmap v1845: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 315 KiB/s wr, 44 op/s 2024-05-08T07:44:35.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:35 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2342699800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:44:35.817 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:35 smithi070 ceph-mon[29591]: pgmap v1845: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 315 KiB/s wr, 44 op/s 2024-05-08T07:44:35.818 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:35 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2342699800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:44:35.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:35 smithi172 ceph-mon[33377]: pgmap v1845: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 315 KiB/s wr, 44 op/s 2024-05-08T07:44:35.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:35 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2342699800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:44:35.983 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/numa_64.o 2024-05-08T07:44:36.017 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/proc/built-in.a 2024-05-08T07:44:36.774 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/timekeeping.o 2024-05-08T07:44:37.235 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/kernfs/mount.o 2024-05-08T07:44:37.675 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:44:37.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:37 smithi194 ceph-mon[33679]: pgmap v1846: 129 pgs: 129 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 343 KiB/s wr, 88 op/s 2024-05-08T07:44:37.841 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:37 smithi070 ceph-mon[29591]: pgmap v1846: 129 pgs: 129 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 343 KiB/s wr, 88 op/s 2024-05-08T07:44:37.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:37 smithi172 ceph-mon[33377]: pgmap v1846: 129 pgs: 129 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 343 KiB/s wr, 88 op/s 2024-05-08T07:44:39.623 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/madvise.o 2024-05-08T07:44:39.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:39 smithi194 ceph-mon[33679]: pgmap v1847: 129 pgs: 129 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 358 KiB/s wr, 91 op/s 2024-05-08T07:44:39.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:39 smithi070 ceph-mon[29591]: pgmap v1847: 129 pgs: 129 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 358 KiB/s wr, 91 op/s 2024-05-08T07:44:39.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:39 smithi172 ceph-mon[33377]: pgmap v1847: 129 pgs: 129 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 358 KiB/s wr, 91 op/s 2024-05-08T07:44:41.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:41 smithi194 ceph-mon[33679]: pgmap v1848: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 435 KiB/s wr, 95 op/s 2024-05-08T07:44:41.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:41 smithi070 ceph-mon[29591]: pgmap v1848: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 435 KiB/s wr, 95 op/s 2024-05-08T07:44:41.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:41 smithi172 ceph-mon[33377]: pgmap v1848: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 360 KiB/s rd, 435 KiB/s wr, 95 op/s 2024-05-08T07:44:41.927 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/hmac.o 2024-05-08T07:44:42.019 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/topology.o 2024-05-08T07:44:42.301 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/integrity/integrity_audit.o 2024-05-08T07:44:42.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:44:42.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:44:42.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:44:43.601 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/amdtopology.o 2024-05-08T07:44:43.771 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:43 smithi070 ceph-mon[29591]: pgmap v1849: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 429 KiB/s wr, 94 op/s 2024-05-08T07:44:43.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:43 smithi172 ceph-mon[33377]: pgmap v1849: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 429 KiB/s wr, 94 op/s 2024-05-08T07:44:44.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:43 smithi194 ceph-mon[33679]: pgmap v1849: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 429 KiB/s wr, 94 op/s 2024-05-08T07:44:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.339+0000 7fe8bb400700 1 -- 172.21.15.70:0/667264032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41060a0 msgr2=0x7fe8b41125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.339+0000 7fe8bb400700 1 --2- 172.21.15.70:0/667264032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41060a0 0x7fe8b41125b0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac009990 tx=0x7fe8ac009ca0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.339+0000 7fe8bb400700 1 -- 172.21.15.70:0/667264032 shutdown_connections 2024-05-08T07:44:44.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.340+0000 7fe8bb400700 1 --2- 172.21.15.70:0/667264032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41060a0 0x7fe8b41125b0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.340+0000 7fe8bb400700 1 --2- 172.21.15.70:0/667264032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8b410b6e0 0x7fe8b410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.340+0000 7fe8bb400700 1 --2- 172.21.15.70:0/667264032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8b41056e0 0x7fe8b4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.340+0000 7fe8bb400700 1 -- 172.21.15.70:0/667264032 >> 172.21.15.70:0/667264032 conn(0x7fe8b41011d0 msgr2=0x7fe8b41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:44:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.340+0000 7fe8bb400700 1 -- 172.21.15.70:0/667264032 shutdown_connections 2024-05-08T07:44:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.340+0000 7fe8bb400700 1 -- 172.21.15.70:0/667264032 wait complete. 2024-05-08T07:44:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.341+0000 7fe8bb400700 1 Processor -- start 2024-05-08T07:44:44.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.342+0000 7fe8bb400700 1 -- start start 2024-05-08T07:44:44.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.342+0000 7fe8bb400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8b41056e0 0x7fe8b419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.342+0000 7fe8bb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41060a0 0x7fe8b419c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.342+0000 7fe8bb400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8b410b6e0 0x7fe8b419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.342+0000 7fe8bb400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b4115820 con 0x7fe8b41060a0 2024-05-08T07:44:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.342+0000 7fe8bb400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b41156a0 con 0x7fe8b41056e0 2024-05-08T07:44:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.342+0000 7fe8bb400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b41159a0 con 0x7fe8b410b6e0 2024-05-08T07:44:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.343+0000 7fe8b3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41060a0 0x7fe8b419c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.343+0000 7fe8b8a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8b41056e0 0x7fe8b419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.343+0000 7fe8b8a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8b41056e0 0x7fe8b419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:54388/0 (socket says 172.21.15.70:54388) 2024-05-08T07:44:44.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.343+0000 7fe8b8a00700 1 -- 172.21.15.70:0/3482576383 learned_addr learned my addr 172.21.15.70:0/3482576383 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:44:44.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.343+0000 7fe8b9400700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8b410b6e0 0x7fe8b419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.344+0000 7fe8b8a00700 1 -- 172.21.15.70:0/3482576383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8b410b6e0 msgr2=0x7fe8b419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:44.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.344+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8b410b6e0 0x7fe8b419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.344+0000 7fe8b8a00700 1 -- 172.21.15.70:0/3482576383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41060a0 msgr2=0x7fe8b419c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:44.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.344+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41060a0 0x7fe8b419c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.344+0000 7fe8b8a00700 1 -- 172.21.15.70:0/3482576383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b419fc00 con 0x7fe8b41056e0 2024-05-08T07:44:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.344+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8b41056e0 0x7fe8b419bcb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80060b0 tx=0x7fe8a800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:44:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.345+0000 7fe8b1600700 1 -- 172.21.15.70:0/3482576383 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a801a070 con 0x7fe8b41056e0 2024-05-08T07:44:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.345+0000 7fe8bb400700 1 -- 172.21.15.70:0/3482576383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b419fef0 con 0x7fe8b41056e0 2024-05-08T07:44:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.345+0000 7fe8bb400700 1 -- 172.21.15.70:0/3482576383 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b41a8860 con 0x7fe8b41056e0 2024-05-08T07:44:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.345+0000 7fe8b1600700 1 -- 172.21.15.70:0/3482576383 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8a800dca0 con 0x7fe8b41056e0 2024-05-08T07:44:44.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.345+0000 7fe8b1600700 1 -- 172.21.15.70:0/3482576383 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8014600 con 0x7fe8b41056e0 2024-05-08T07:44:44.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.351+0000 7fe8b1600700 1 -- 172.21.15.70:0/3482576383 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe8a801d070 con 0x7fe8b41056e0 2024-05-08T07:44:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.353+0000 7fe8b1600700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe89c0b2b70 0x7fe89c0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.353+0000 7fe8b1600700 1 -- 172.21.15.70:0/3482576383 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(195..195 src has 1..195) ==== 9583+0+0 (secure 0 0 0) 0x7fe8a80e2f50 con 0x7fe8b41056e0 2024-05-08T07:44:44.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.353+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe89c0b2b70 0x7fe89c0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.365+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe89c0b2b70 0x7fe89c0b5030 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe8b410a9e0 tx=0x7fe8a000b3c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:44:44.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.368+0000 7fe8c5cb0b80 1 Processor -- start 2024-05-08T07:44:44.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.368+0000 7fe8c5cb0b80 1 -- start start 2024-05-08T07:44:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.369+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33cdf10 0x5577d33ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.369+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 0x5577d33d22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.369+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33d2820 0x5577d33d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.369+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5577d3317bb0 con 0x5577d33d2820 2024-05-08T07:44:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.369+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5577d32b58f0 con 0x5577d33cdf10 2024-05-08T07:44:44.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.369+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5577d3313b70 con 0x5577d33ce830 2024-05-08T07:44:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.369+0000 7fe8b9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33d2820 0x5577d33d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.369+0000 7fe8b9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33d2820 0x5577d33d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48694/0 (socket says 172.21.15.70:48694) 2024-05-08T07:44:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.369+0000 7fe8b9400700 1 -- 172.21.15.70:0/652998034 learned_addr learned my addr 172.21.15.70:0/652998034 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:44:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.370+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/652998034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33cdf10 0x5577d33ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.370+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/652998034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 0x5577d33d22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.370+0000 7fe8b9400700 1 -- 172.21.15.70:0/652998034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 msgr2=0x5577d33d22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:44:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.370+0000 7fe8b9400700 1 --2- 172.21.15.70:0/652998034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 0x5577d33d22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.370+0000 7fe8b9400700 1 -- 172.21.15.70:0/652998034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33cdf10 msgr2=0x5577d33ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:44:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.370+0000 7fe8b9400700 1 --2- 172.21.15.70:0/652998034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33cdf10 0x5577d33ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.370+0000 7fe8b9400700 1 -- 172.21.15.70:0/652998034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d3264a60 con 0x5577d33d2820 2024-05-08T07:44:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.371+0000 7fe8b9400700 1 --2- 172.21.15.70:0/652998034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33d2820 0x5577d33d2c80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac003740 tx=0x7fe8ac009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee8f621054b6014 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:44:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.371+0000 7fe8a6000700 1 -- 172.21.15.70:0/652998034 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac027070 con 0x5577d33d2820 2024-05-08T07:44:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.371+0000 7fe8a6000700 1 -- 172.21.15.70:0/652998034 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8ac0037c0 con 0x5577d33d2820 2024-05-08T07:44:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.371+0000 7fe8a6000700 1 -- 172.21.15.70:0/652998034 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac00ba30 con 0x5577d33d2820 2024-05-08T07:44:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.372+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/652998034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33d2820 msgr2=0x5577d33d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.372+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/652998034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33d2820 0x5577d33d2c80 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac003740 tx=0x7fe8ac009ee0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.373+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/652998034 shutdown_connections 2024-05-08T07:44:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.373+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/652998034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33d2820 0x5577d33d2c80 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.373+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/652998034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33cdf10 0x5577d33ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.373+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/652998034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 0x5577d33d22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.373+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/652998034 >> 172.21.15.70:0/652998034 conn(0x5577d32f3cf0 msgr2=0x5577d33bfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:44:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.373+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/652998034 shutdown_connections 2024-05-08T07:44:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.373+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/652998034 wait complete. 2024-05-08T07:44:44.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.374+0000 7fe8c5cb0b80 1 -- start start 2024-05-08T07:44:44.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.374+0000 7fe8c5cb0b80 1 Processor -- start 2024-05-08T07:44:44.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.375+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33cdf10 0x5577d33d9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.375+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 0x5577d33d7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.375+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d33d7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.375+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5577d33daa60 con 0x5577d33cdf10 2024-05-08T07:44:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.375+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5577d327dcb0 con 0x5577d33d2820 2024-05-08T07:44:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.375+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5577d33dabe0 con 0x5577d33ce830 2024-05-08T07:44:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.375+0000 7fe8c5cb0b80 10 client.0 _ll_register_callbacks cb 0x5577d32bee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:44:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33cdf10 0x5577d33d9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33cdf10 0x5577d33d9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48704/0 (socket says 172.21.15.70:48704) 2024-05-08T07:44:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b8a00700 1 -- 172.21.15.70:0/108284882 learned_addr learned my addr 172.21.15.70:0/108284882 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:44:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b9400700 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d33d7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 0x5577d33d7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b8a00700 1 -- 172.21.15.70:0/108284882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 msgr2=0x5577d33d7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:44:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 0x5577d33d7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b8a00700 1 -- 172.21.15.70:0/108284882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 msgr2=0x5577d33d7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:44:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d33d7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b8a00700 1 -- 172.21.15.70:0/108284882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d32dd5b0 con 0x5577d33cdf10 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.376+0000 7fe8b9400700 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d33d7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.377+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33cdf10 0x5577d33d9c60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80a5e40 tx=0x7fe8a80aa3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e4f6cb487bdfa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.377+0000 7fe89aa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.377+0000 7fe89aa00700 1 -- 172.21.15.70:0/108284882 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a80ae1c0 con 0x5577d33cdf10 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.377+0000 7fe89aa00700 1 -- 172.21.15.70:0/108284882 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 9583+0+0 (secure 0 0 0) 0x7fe8a80a9070 con 0x5577d33cdf10 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.377+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/108284882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8ac0037c0 con 0x5577d33cdf10 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.378+0000 7fe89aa00700 1 -- 172.21.15.70:0/108284882 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe8a80b2c70 con 0x5577d33cdf10 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.378+0000 7fe8c5cb0b80 10 client.17079 fetch_fsmap learned FSMap version 42 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.378+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/108284882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5577d33e5310 con 0x5577d33cdf10 2024-05-08T07:44:44.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.378+0000 7fe89aa00700 1 -- 172.21.15.70:0/108284882 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8ac0037c0 con 0x5577d33cdf10 2024-05-08T07:44:44.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.379+0000 7fe89aa00700 1 -- 172.21.15.70:0/108284882 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe8a80a8ae0 con 0x5577d33cdf10 2024-05-08T07:44:44.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.379+0000 7fe8c5cb0b80 10 client.17079 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:44:44.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.379+0000 7fe8c5cb0b80 10 client.17079 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:44:44.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.379+0000 7fe8c5cb0b80 20 client.17079 populate_metadata read hostname 'smithi070' 2024-05-08T07:44:44.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.379+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577d33e78a0 0x5577d33e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.379+0000 7fe8c5cb0b80 4 client.17079 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:44:44.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.379+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/108284882 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577d3392230 con 0x5577d33e78a0 2024-05-08T07:44:44.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.379+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577d33e78a0 0x5577d33e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.381+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577d33e78a0 0x5577d33e9c90 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1837e38399c7b2c server_cookie=c2ab531b71102ef9 in_seq=0 out_seq=0 2024-05-08T07:44:44.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.381+0000 7fe89aa00700 10 client.17079 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:44:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.383+0000 7fe89aa00700 1 -- 172.21.15.70:0/108284882 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5577d3392230 con 0x5577d33e78a0 2024-05-08T07:44:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.383+0000 7fe89aa00700 10 client.17079 handle_command_reply: tid=0 2024-05-08T07:44:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.383+0000 7fe8c5cb0b80 1 client.17079 shutdown 2024-05-08T07:44:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.383+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/108284882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33cdf10 msgr2=0x5577d33d9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.383+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33cdf10 0x5577d33d9c60 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80a5e40 tx=0x7fe8a80aa3a0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.383+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/108284882 shutdown_connections 2024-05-08T07:44:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.384+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577d33e78a0 0x5577d33e9c90 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.384+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d33d7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.384+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33cdf10 0x5577d33d9c60 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.384+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/108284882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33ce830 0x5577d33d7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.384+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/108284882 >> 172.21.15.70:0/108284882 conn(0x5577d32f3cf0 msgr2=0x5577d33d3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:44:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.384+0000 7fe89aa00700 0 client.17079 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:44:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.384+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/108284882 shutdown_connections 2024-05-08T07:44:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.384+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/108284882 wait complete. 2024-05-08T07:44:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.384+0000 7fe8c5cb0b80 20 client.17079 trim_cache size 0 max 16384 2024-05-08T07:44:44.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.418+0000 7fe8c5cb0b80 1 Processor -- start 2024-05-08T07:44:44.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.419+0000 7fe8c5cb0b80 1 -- start start 2024-05-08T07:44:44.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.419+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 0x5577d33e3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.419+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33ef560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.419+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d33efaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.419+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe894011800 con 0x5577d33ce830 2024-05-08T07:44:44.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.419+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe89400f090 con 0x5577d33d2820 2024-05-08T07:44:44.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.419+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe89400cf00 con 0x5577d33cdf10 2024-05-08T07:44:44.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d33efaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33ef560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48720/0 (socket says 172.21.15.70:48720) 2024-05-08T07:44:44.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b3e00700 1 -- 172.21.15.70:0/2903426357 learned_addr learned my addr 172.21.15.70:0/2903426357 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:44:44.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/2903426357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 0x5577d33e3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b3e00700 1 -- 172.21.15.70:0/2903426357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 msgr2=0x5577d33e3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:44:44.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/2903426357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 0x5577d33e3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b3e00700 1 -- 172.21.15.70:0/2903426357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 msgr2=0x5577d33efaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:44:44.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/2903426357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d33efaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b3e00700 1 -- 172.21.15.70:0/2903426357 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d33d98a0 con 0x5577d33ce830 2024-05-08T07:44:44.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.420+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/2903426357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 0x5577d33e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:44:44.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.421+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/2903426357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33ef560 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0003750 tx=0x7fe8a0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3407b2307a690c30 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:44:44.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.421+0000 7fe8a5600700 1 -- 172.21.15.70:0/2903426357 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0003e90 con 0x5577d33ce830 2024-05-08T07:44:44.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.421+0000 7fe8a5600700 1 -- 172.21.15.70:0/2903426357 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8a0004cc0 con 0x5577d33ce830 2024-05-08T07:44:44.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.421+0000 7fe8a5600700 1 -- 172.21.15.70:0/2903426357 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0021c70 con 0x5577d33ce830 2024-05-08T07:44:44.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.423+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/2903426357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 msgr2=0x5577d33ef560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:44:44.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.423+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/2903426357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33ef560 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0003750 tx=0x7fe8a0013000 comp rx=0 tx=0).stop 2024-05-08T07:44:44.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.424+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/2903426357 shutdown_connections 2024-05-08T07:44:44.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.424+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/2903426357 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d33efaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.424+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/2903426357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 0x5577d33e3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.424+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/2903426357 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33ef560 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.424+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/2903426357 >> 172.21.15.70:0/2903426357 conn(0x5577d32f3cf0 msgr2=0x5577d33d8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:44:44.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.424+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/2903426357 shutdown_connections 2024-05-08T07:44:44.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.424+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/2903426357 wait complete. 2024-05-08T07:44:44.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.425+0000 7fe8c5cb0b80 1 -- start start 2024-05-08T07:44:44.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.425+0000 7fe8c5cb0b80 1 Processor -- start 2024-05-08T07:44:44.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 0x5577d33dee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33df390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8c5cb0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d3452130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe89400d550 con 0x5577d33ce830 2024-05-08T07:44:44.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe89400e9c0 con 0x5577d33d2820 2024-05-08T07:44:44.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8c5cb0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe89400dc20 con 0x5577d33cdf10 2024-05-08T07:44:44.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8c5cb0b80 10 client.0 _ll_register_callbacks cb 0x5577d32bee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:44:44.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8b3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33df390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8b3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33df390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48730/0 (socket says 172.21.15.70:48730) 2024-05-08T07:44:44.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8b9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d3452130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.426+0000 7fe8b3e00700 1 -- 172.21.15.70:0/3615762458 learned_addr learned my addr 172.21.15.70:0/3615762458 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:44:44.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.427+0000 7fe8b3e00700 1 -- 172.21.15.70:0/3615762458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 msgr2=0x5577d33dee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:44:44.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.427+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 0x5577d33dee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.427+0000 7fe8b3e00700 1 -- 172.21.15.70:0/3615762458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 msgr2=0x5577d3452130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:44:44.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.427+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d3452130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:44:44.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.427+0000 7fe8b3e00700 1 -- 172.21.15.70:0/3615762458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d3463680 con 0x5577d33ce830 2024-05-08T07:44:44.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.428+0000 7fe8b3e00700 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33df390 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00217f0 tx=0x7fe8a0003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164ed5f0ca448333 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:44:44.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.428+0000 7fe89aa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:44:44.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.428+0000 7fe89aa00700 1 -- 172.21.15.70:0/3615762458 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0035020 con 0x5577d33ce830 2024-05-08T07:44:44.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.428+0000 7fe89aa00700 1 -- 172.21.15.70:0/3615762458 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(195..195 src has 1..195) ==== 9583+0+0 (secure 0 0 0) 0x7fe8a0004750 con 0x5577d33ce830 2024-05-08T07:44:44.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.429+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/3615762458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8a0004cc0 con 0x5577d33ce830 2024-05-08T07:44:44.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.429+0000 7fe89aa00700 1 -- 172.21.15.70:0/3615762458 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe8a0004950 con 0x5577d33ce830 2024-05-08T07:44:44.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.429+0000 7fe8c5cb0b80 10 client.17085 fetch_fsmap learned FSMap version 42 2024-05-08T07:44:44.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.429+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/3615762458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5577d3464810 con 0x5577d33ce830 2024-05-08T07:44:44.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.430+0000 7fe89aa00700 1 -- 172.21.15.70:0/3615762458 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe8a0004cc0 con 0x5577d33ce830 2024-05-08T07:44:44.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.430+0000 7fe89aa00700 1 -- 172.21.15.70:0/3615762458 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe8a0028ce0 con 0x5577d33ce830 2024-05-08T07:44:44.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.430+0000 7fe8c5cb0b80 10 client.17085 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:44:44.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.430+0000 7fe8c5cb0b80 10 client.17085 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:44:44.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.430+0000 7fe8c5cb0b80 20 client.17085 populate_metadata read hostname 'smithi070' 2024-05-08T07:44:44.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.430+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577d3464f60 0x5577d3467380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:44:44.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.430+0000 7fe8c5cb0b80 4 client.17085 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 73.5, "await_for": 42.0}] 2024-05-08T07:44:44.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.430+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/3615762458 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 73.5, "await_for": 42.0}) -- 0x5577d3325590 con 0x5577d3464f60 2024-05-08T07:44:44.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.431+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577d3464f60 0x5577d3467380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:44:44.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.432+0000 7fe8b8a00700 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577d3464f60 0x5577d3467380 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3de589add9ce9916 server_cookie=de0acc4335a90a43 in_seq=0 out_seq=0 2024-05-08T07:44:44.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:44:44.432+0000 7fe89aa00700 10 client.17085 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:44:44.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:44:44.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:44:44.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:44:44.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:44:44.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:44:44.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:44:45.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:44:45.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:44:45.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:44:45.351 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/kernfs/inode.o 2024-05-08T07:44:45.699 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/srat.o 2024-05-08T07:44:45.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:45 smithi070 ceph-mon[29591]: pgmap v1850: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 392 KiB/s wr, 85 op/s 2024-05-08T07:44:45.924 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/ntp.o 2024-05-08T07:44:45.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:45 smithi172 ceph-mon[33377]: pgmap v1850: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 392 KiB/s wr, 85 op/s 2024-05-08T07:44:46.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:45 smithi194 ceph-mon[33679]: pgmap v1850: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 392 KiB/s wr, 85 op/s 2024-05-08T07:44:47.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:47 smithi070 ceph-mon[29591]: pgmap v1851: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 401 KiB/s wr, 75 op/s 2024-05-08T07:44:47.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:47 smithi172 ceph-mon[33377]: pgmap v1851: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 401 KiB/s wr, 75 op/s 2024-05-08T07:44:48.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:47 smithi194 ceph-mon[33679]: pgmap v1851: 129 pgs: 129 active+clean; 1.8 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 401 KiB/s wr, 75 op/s 2024-05-08T07:44:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:49 smithi070 ceph-mon[29591]: pgmap v1852: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 375 KiB/s wr, 32 op/s 2024-05-08T07:44:49.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:49 smithi172 ceph-mon[33377]: pgmap v1852: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 375 KiB/s wr, 32 op/s 2024-05-08T07:44:50.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:49 smithi194 ceph-mon[33679]: pgmap v1852: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 375 KiB/s wr, 32 op/s 2024-05-08T07:44:51.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:51 smithi070 ceph-mon[29591]: pgmap v1853: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 392 KiB/s wr, 29 op/s 2024-05-08T07:44:51.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:51 smithi172 ceph-mon[33377]: pgmap v1853: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 392 KiB/s wr, 29 op/s 2024-05-08T07:44:52.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:51 smithi194 ceph-mon[33679]: pgmap v1853: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 392 KiB/s wr, 29 op/s 2024-05-08T07:44:53.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:53 smithi070 ceph-mon[29591]: pgmap v1854: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 217 KiB/s wr, 24 op/s 2024-05-08T07:44:53.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:53 smithi172 ceph-mon[33377]: pgmap v1854: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 217 KiB/s wr, 24 op/s 2024-05-08T07:44:54.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:53 smithi194 ceph-mon[33679]: pgmap v1854: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 217 KiB/s wr, 24 op/s 2024-05-08T07:44:55.810 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:55 smithi194 ceph-mon[33679]: pgmap v1855: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 197 KiB/s wr, 20 op/s 2024-05-08T07:44:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:55 smithi070 ceph-mon[29591]: pgmap v1855: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 197 KiB/s wr, 20 op/s 2024-05-08T07:44:55.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:55 smithi172 ceph-mon[33377]: pgmap v1855: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 197 KiB/s wr, 20 op/s 2024-05-08T07:44:57.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:57 smithi070 ceph-mon[29591]: pgmap v1856: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 95 KiB/s wr, 18 op/s 2024-05-08T07:44:57.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:57 smithi172 ceph-mon[33377]: pgmap v1856: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 95 KiB/s wr, 18 op/s 2024-05-08T07:44:58.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:57 smithi194 ceph-mon[33679]: pgmap v1856: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 95 KiB/s wr, 18 op/s 2024-05-08T07:44:59.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:44:59 smithi070 ceph-mon[29591]: pgmap v1857: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 66 KiB/s wr, 12 op/s 2024-05-08T07:44:59.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:44:59 smithi172 ceph-mon[33377]: pgmap v1857: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 66 KiB/s wr, 12 op/s 2024-05-08T07:45:00.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:44:59 smithi194 ceph-mon[33679]: pgmap v1857: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 66 KiB/s wr, 12 op/s 2024-05-08T07:45:01.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:01 smithi070 ceph-mon[29591]: pgmap v1858: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 88 KiB/s wr, 72 op/s 2024-05-08T07:45:01.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:01 smithi172 ceph-mon[33377]: pgmap v1858: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 88 KiB/s wr, 72 op/s 2024-05-08T07:45:02.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:01 smithi194 ceph-mon[33679]: pgmap v1858: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 88 KiB/s wr, 72 op/s 2024-05-08T07:45:03.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:03 smithi070 ceph-mon[29591]: pgmap v1859: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 49 KiB/s wr, 115 op/s 2024-05-08T07:45:03.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:03 smithi172 ceph-mon[33377]: pgmap v1859: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 49 KiB/s wr, 115 op/s 2024-05-08T07:45:04.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:03 smithi194 ceph-mon[33679]: pgmap v1859: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 49 KiB/s wr, 115 op/s 2024-05-08T07:45:05.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:05 smithi070 ceph-mon[29591]: pgmap v1860: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 126 op/s 2024-05-08T07:45:05.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:05 smithi172 ceph-mon[33377]: pgmap v1860: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 126 op/s 2024-05-08T07:45:06.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:05 smithi194 ceph-mon[33679]: pgmap v1860: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 KiB/s wr, 126 op/s 2024-05-08T07:45:07.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.011+0000 7fe89aa00700 1 -- 172.21.15.70:0/3615762458 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5577d3325590 con 0x5577d3464f60 2024-05-08T07:45:07.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.011+0000 7fe89aa00700 10 client.17085 handle_command_reply: tid=0 2024-05-08T07:45:07.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.011+0000 7fe8c5cb0b80 1 client.17085 shutdown 2024-05-08T07:45:07.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.012+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/3615762458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 msgr2=0x5577d33df390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:07.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.012+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33df390 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00217f0 tx=0x7fe8a0003cb0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.012+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/3615762458 shutdown_connections 2024-05-08T07:45:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.012+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5577d3464f60 0x5577d3467380 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.012+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5577d33d2820 0x5577d3452130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.012+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5577d33cdf10 0x5577d33dee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.012+0000 7fe8c5cb0b80 1 --2- 172.21.15.70:0/3615762458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5577d33ce830 0x5577d33df390 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.012+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/3615762458 >> 172.21.15.70:0/3615762458 conn(0x5577d32f3cf0 msgr2=0x5577d33d1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.013+0000 7fe89aa00700 0 client.17085 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:45:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.013+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/3615762458 shutdown_connections 2024-05-08T07:45:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.013+0000 7fe8c5cb0b80 1 -- 172.21.15.70:0/3615762458 wait complete. 2024-05-08T07:45:07.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.013+0000 7fe8c5cb0b80 20 client.17085 trim_cache size 0 max 16384 2024-05-08T07:45:07.011 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:45:07.011 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:45:07.011 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:45:07.011 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 142, 2024-05-08T07:45:07.011 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:45:07.011 INFO:teuthology.orchestra.run.smithi070.stdout: "e2347807": { 2024-05-08T07:45:07.011 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 142, 2024-05-08T07:45:07.011 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 73.5, 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:07.012 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:07.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:07.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:07.013 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:07.013 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:45:07.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.014+0000 7fe8bb400700 1 -- 172.21.15.70:0/3482576383 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe89c0b2b70 msgr2=0x7fe89c0b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:07.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.014+0000 7fe8bb400700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe89c0b2b70 0x7fe89c0b5030 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe8b410a9e0 tx=0x7fe8a000b3c0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.014+0000 7fe8bb400700 1 -- 172.21.15.70:0/3482576383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8b41056e0 msgr2=0x7fe8b419bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.014+0000 7fe8bb400700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8b41056e0 0x7fe8b419bcb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe8a80060b0 tx=0x7fe8a800d3b0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.015+0000 7fe8bb400700 1 -- 172.21.15.70:0/3482576383 shutdown_connections 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.015+0000 7fe8bb400700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe89c0b2b70 0x7fe89c0b5030 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.015+0000 7fe8bb400700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8b410b6e0 0x7fe8b419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.015+0000 7fe8bb400700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe8b41056e0 0x7fe8b419bcb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.015+0000 7fe8bb400700 1 --2- 172.21.15.70:0/3482576383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8b41060a0 0x7fe8b419c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.015+0000 7fe8bb400700 1 -- 172.21.15.70:0/3482576383 >> 172.21.15.70:0/3482576383 conn(0x7fe8b41011d0 msgr2=0x7fe8b41016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.015+0000 7fe8bb400700 1 -- 172.21.15.70:0/3482576383 shutdown_connections 2024-05-08T07:45:07.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:07.016+0000 7fe8bb400700 1 -- 172.21.15.70:0/3482576383 wait complete. 2024-05-08T07:45:07.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:07 smithi070 ceph-mon[29591]: pgmap v1861: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 48 KiB/s wr, 145 op/s 2024-05-08T07:45:07.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:07 smithi172 ceph-mon[33377]: pgmap v1861: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 48 KiB/s wr, 145 op/s 2024-05-08T07:45:08.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:07 smithi194 ceph-mon[33679]: pgmap v1861: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 48 KiB/s wr, 145 op/s 2024-05-08T07:45:08.871 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e2347807', quiesce took 38.9 seconds. Will release after: 13.5 2024-05-08T07:45:09.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:09 smithi070 ceph-mon[29591]: pgmap v1862: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 94 KiB/s wr, 157 op/s 2024-05-08T07:45:09.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:09 smithi172 ceph-mon[33377]: pgmap v1862: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 94 KiB/s wr, 157 op/s 2024-05-08T07:45:10.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:09 smithi194 ceph-mon[33679]: pgmap v1862: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 94 KiB/s wr, 157 op/s 2024-05-08T07:45:11.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:11 smithi070 ceph-mon[29591]: pgmap v1863: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 116 KiB/s wr, 160 op/s 2024-05-08T07:45:11.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:11 smithi172 ceph-mon[33377]: pgmap v1863: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 116 KiB/s wr, 160 op/s 2024-05-08T07:45:12.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:11 smithi194 ceph-mon[33679]: pgmap v1863: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 116 KiB/s wr, 160 op/s 2024-05-08T07:45:13.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:13 smithi070 ceph-mon[29591]: pgmap v1864: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 169 KiB/s wr, 101 op/s 2024-05-08T07:45:13.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:13 smithi172 ceph-mon[33377]: pgmap v1864: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 169 KiB/s wr, 101 op/s 2024-05-08T07:45:14.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:13 smithi194 ceph-mon[33679]: pgmap v1864: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 169 KiB/s wr, 101 op/s 2024-05-08T07:45:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:15 smithi172 ceph-mon[33377]: pgmap v1865: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 153 KiB/s wr, 56 op/s 2024-05-08T07:45:16.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:15 smithi194 ceph-mon[33679]: pgmap v1865: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 153 KiB/s wr, 56 op/s 2024-05-08T07:45:16.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:15 smithi070 ceph-mon[29591]: pgmap v1865: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 153 KiB/s wr, 56 op/s 2024-05-08T07:45:16.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:16 smithi172 ceph-mon[33377]: osdmap e196: 12 total, 12 up, 12 in 2024-05-08T07:45:17.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:16 smithi194 ceph-mon[33679]: osdmap e196: 12 total, 12 up, 12 in 2024-05-08T07:45:17.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:16 smithi070 ceph-mon[29591]: osdmap e196: 12 total, 12 up, 12 in 2024-05-08T07:45:17.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:17 smithi172 ceph-mon[33377]: pgmap v1867: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 182 KiB/s wr, 27 op/s 2024-05-08T07:45:18.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:17 smithi194 ceph-mon[33679]: pgmap v1867: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 182 KiB/s wr, 27 op/s 2024-05-08T07:45:18.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:17 smithi070 ceph-mon[29591]: pgmap v1867: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 182 KiB/s wr, 27 op/s 2024-05-08T07:45:19.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:19 smithi172 ceph-mon[33377]: pgmap v1868: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 133 KiB/s wr, 13 op/s 2024-05-08T07:45:20.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:19 smithi194 ceph-mon[33679]: pgmap v1868: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 133 KiB/s wr, 13 op/s 2024-05-08T07:45:20.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:19 smithi070 ceph-mon[29591]: pgmap v1868: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 133 KiB/s wr, 13 op/s 2024-05-08T07:45:21.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:21 smithi172 ceph-mon[33377]: pgmap v1869: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 106 KiB/s wr, 10 op/s 2024-05-08T07:45:22.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:21 smithi194 ceph-mon[33679]: pgmap v1869: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 106 KiB/s wr, 10 op/s 2024-05-08T07:45:22.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:21 smithi070 ceph-mon[29591]: pgmap v1869: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 106 KiB/s wr, 10 op/s 2024-05-08T07:45:22.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:45:22.827 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:45:23.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:23 smithi070 ceph-mon[29591]: pgmap v1870: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T07:45:23.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:23 smithi070 ceph-mon[29591]: osdmap e197: 12 total, 12 up, 12 in 2024-05-08T07:45:24.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:23 smithi194 ceph-mon[33679]: pgmap v1870: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T07:45:24.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:23 smithi194 ceph-mon[33679]: osdmap e197: 12 total, 12 up, 12 in 2024-05-08T07:45:24.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:23 smithi172 ceph-mon[33377]: pgmap v1870: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T07:45:24.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:23 smithi172 ceph-mon[33377]: osdmap e197: 12 total, 12 up, 12 in 2024-05-08T07:45:25.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.424+0000 7f532c400700 1 -- 172.21.15.70:0/1783528195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5324075ff0 msgr2=0x7f532410f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:25.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.424+0000 7f532c400700 1 --2- 172.21.15.70:0/1783528195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5324075ff0 0x7f532410f990 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f5310009990 tx=0x7f5310009ca0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.424+0000 7f532c400700 1 -- 172.21.15.70:0/1783528195 shutdown_connections 2024-05-08T07:45:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.424+0000 7f532c400700 1 --2- 172.21.15.70:0/1783528195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f532410fed0 0x7f53241122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.424+0000 7f532c400700 1 --2- 172.21.15.70:0/1783528195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53240756d0 0x7f5324075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.424+0000 7f532c400700 1 --2- 172.21.15.70:0/1783528195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5324075ff0 0x7f532410f990 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.424+0000 7f532c400700 1 -- 172.21.15.70:0/1783528195 >> 172.21.15.70:0/1783528195 conn(0x7f532407a650 msgr2=0x7f532407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.424+0000 7f532c400700 1 -- 172.21.15.70:0/1783528195 shutdown_connections 2024-05-08T07:45:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.424+0000 7f532c400700 1 -- 172.21.15.70:0/1783528195 wait complete. 2024-05-08T07:45:25.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.425+0000 7f532c400700 1 Processor -- start 2024-05-08T07:45:25.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.425+0000 7f532c400700 1 -- start start 2024-05-08T07:45:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f532c400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53240756d0 0x7f53241a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f532c400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5324075ff0 0x7f53241a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f532c400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f532410fed0 0x7f532419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f532c400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5324115750 con 0x7f532410fed0 2024-05-08T07:45:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f532c400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f53241155d0 con 0x7f53240756d0 2024-05-08T07:45:25.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f532c400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f53241158d0 con 0x7f5324075ff0 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f532a400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f532410fed0 0x7f532419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f532a400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f532410fed0 0x7f532419ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39154/0 (socket says 172.21.15.70:39154) 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f532a400700 1 -- 172.21.15.70:0/199332054 learned_addr learned my addr 172.21.15.70:0/199332054 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f5329000700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5324075ff0 0x7f53241a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.426+0000 7f5329a00700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53240756d0 0x7f53241a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.427+0000 7f532a400700 1 -- 172.21.15.70:0/199332054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5324075ff0 msgr2=0x7f53241a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.427+0000 7f532a400700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5324075ff0 0x7f53241a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.427+0000 7f532a400700 1 -- 172.21.15.70:0/199332054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53240756d0 msgr2=0x7f53241a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.427+0000 7f532a400700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53240756d0 0x7f53241a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.427+0000 7f532a400700 1 -- 172.21.15.70:0/199332054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f532419c1d0 con 0x7f532410fed0 2024-05-08T07:45:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.427+0000 7f532a400700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f532410fed0 0x7f532419ba70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f531c00cc30 tx=0x7f531c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:45:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.428+0000 7f5322000700 1 -- 172.21.15.70:0/199332054 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c016020 con 0x7f532410fed0 2024-05-08T07:45:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.428+0000 7f5322000700 1 -- 172.21.15.70:0/199332054 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f531c012420 con 0x7f532410fed0 2024-05-08T07:45:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.428+0000 7f5322000700 1 -- 172.21.15.70:0/199332054 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c0115e0 con 0x7f532410fed0 2024-05-08T07:45:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.428+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f532419c4c0 con 0x7f532410fed0 2024-05-08T07:45:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.428+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53241a8780 con 0x7f532410fed0 2024-05-08T07:45:25.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.429+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f532406a190 con 0x7f532410fed0 2024-05-08T07:45:25.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.433+0000 7f5322000700 1 -- 172.21.15.70:0/199332054 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f531c019020 con 0x7f532410fed0 2024-05-08T07:45:25.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.435+0000 7f5322000700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f530c0b2a70 0x7f530c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:25.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.435+0000 7f5322000700 1 -- 172.21.15.70:0/199332054 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 9583+0+0 (secure 0 0 0) 0x7f531c0e2c90 con 0x7f532410fed0 2024-05-08T07:45:25.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.435+0000 7f5329a00700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f530c0b2a70 0x7f530c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:25.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.436+0000 7f5329a00700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f530c0b2a70 0x7f530c0b4f30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f532419cbb0 tx=0x7f531800b3c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:45:25.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.438+0000 7f5322000700 1 -- 172.21.15.70:0/199332054 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f531c020020 con 0x7f532410fed0 2024-05-08T07:45:25.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.720+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f532419cfa0 con 0x7f532410fed0 2024-05-08T07:45:25.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.722+0000 7f5322000700 1 -- 172.21.15.70:0/199332054 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f531c0aa300 con 0x7f532410fed0 2024-05-08T07:45:25.719 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:45:25.719 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f530c0b2a70 msgr2=0x7f530c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f530c0b2a70 0x7f530c0b4f30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f532419cbb0 tx=0x7f531800b3c0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f532410fed0 msgr2=0x7f532419ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f532410fed0 0x7f532419ba70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f531c00cc30 tx=0x7f531c00cf40 comp rx=0 tx=0).stop 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 shutdown_connections 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f530c0b2a70 0x7f530c0b4f30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f532410fed0 0x7f532419ba70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f53240756d0 0x7f53241a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 --2- 172.21.15.70:0/199332054 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5324075ff0 0x7f53241a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.725+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 >> 172.21.15.70:0/199332054 conn(0x7f532407a650 msgr2=0x7f5324100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.726+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 shutdown_connections 2024-05-08T07:45:25.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:25.726+0000 7f532c400700 1 -- 172.21.15.70:0/199332054 wait complete. 2024-05-08T07:45:25.723 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:45:26.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:25 smithi194 ceph-mon[33679]: pgmap v1872: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2024-05-08T07:45:26.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:25 smithi070 ceph-mon[29591]: pgmap v1872: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2024-05-08T07:45:26.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:25 smithi172 ceph-mon[33377]: pgmap v1872: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 30 KiB/s wr, 6 op/s 2024-05-08T07:45:26.721 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id e2347807 --release --await' 2024-05-08T07:45:26.721 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id e2347807 --release --await 2024-05-08T07:45:27.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:26 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/199332054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:45:27.077 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:26 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/199332054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:45:27.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:26 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/199332054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:45:27.173 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:45:28.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:27 smithi194 ceph-mon[33679]: pgmap v1873: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T07:45:28.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:27 smithi070 ceph-mon[29591]: pgmap v1873: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T07:45:28.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:27 smithi172 ceph-mon[33377]: pgmap v1873: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T07:45:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.412+0000 7f423d800700 1 -- 172.21.15.70:0/3421129337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 msgr2=0x7f42381169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.412+0000 7f423d800700 1 --2- 172.21.15.70:0/3421129337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 0x7f42381169a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f423000b0a0 tx=0x7f423000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.412+0000 7f423d800700 1 -- 172.21.15.70:0/3421129337 shutdown_connections 2024-05-08T07:45:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.412+0000 7f423d800700 1 --2- 172.21.15.70:0/3421129337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 0x7f42381169a0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.412+0000 7f423d800700 1 --2- 172.21.15.70:0/3421129337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f423810fb60 0x7f423810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.412+0000 7f423d800700 1 --2- 172.21.15.70:0/3421129337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4238109ad0 0x7f4238109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.412+0000 7f423d800700 1 -- 172.21.15.70:0/3421129337 >> 172.21.15.70:0/3421129337 conn(0x7f4238076c70 msgr2=0x7f42381082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.412+0000 7f423d800700 1 -- 172.21.15.70:0/3421129337 shutdown_connections 2024-05-08T07:45:29.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.412+0000 7f423d800700 1 -- 172.21.15.70:0/3421129337 wait complete. 2024-05-08T07:45:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.413+0000 7f423d800700 1 Processor -- start 2024-05-08T07:45:29.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.413+0000 7f423d800700 1 -- start start 2024-05-08T07:45:29.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f423d800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4238109ad0 0x7f42381a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f423d800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 0x7f42381a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f423d800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f423810fb60 0x7f42381a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f423d800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4238119c10 con 0x7f423810a490 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f423d800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4238119a90 con 0x7f423810fb60 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f423d800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4238119d90 con 0x7f4238109ad0 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f4236000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 0x7f42381a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f4236000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 0x7f42381a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51064/0 (socket says 172.21.15.70:51064) 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f4236000700 1 -- 172.21.15.70:0/3041891226 learned_addr learned my addr 172.21.15.70:0/3041891226 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f4236a00700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4238109ad0 0x7f42381a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f4237400700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f423810fb60 0x7f42381a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f4236000700 1 -- 172.21.15.70:0/3041891226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4238109ad0 msgr2=0x7f42381a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f4236000700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4238109ad0 0x7f42381a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f4236000700 1 -- 172.21.15.70:0/3041891226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f423810fb60 msgr2=0x7f42381a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.414+0000 7f4236000700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f423810fb60 0x7f42381a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.415+0000 7f4236000700 1 -- 172.21.15.70:0/3041891226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42381a50c0 con 0x7f423810a490 2024-05-08T07:45:29.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.415+0000 7f4237400700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f423810fb60 0x7f42381a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:45:29.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.415+0000 7f4236000700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 0x7f42381a0640 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f422400c920 tx=0x7f422400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:45:29.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.415+0000 7f422f400700 1 -- 172.21.15.70:0/3041891226 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4224007b00 con 0x7f423810a490 2024-05-08T07:45:29.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.415+0000 7f422f400700 1 -- 172.21.15.70:0/3041891226 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4224004cc0 con 0x7f423810a490 2024-05-08T07:45:29.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.415+0000 7f423d800700 1 -- 172.21.15.70:0/3041891226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42381a5350 con 0x7f423810a490 2024-05-08T07:45:29.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.415+0000 7f422f400700 1 -- 172.21.15.70:0/3041891226 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42240054f0 con 0x7f423810a490 2024-05-08T07:45:29.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.415+0000 7f423d800700 1 -- 172.21.15.70:0/3041891226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42381acc30 con 0x7f423810a490 2024-05-08T07:45:29.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.420+0000 7f422f400700 1 -- 172.21.15.70:0/3041891226 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4224007ca0 con 0x7f423810a490 2024-05-08T07:45:29.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.421+0000 7f422f400700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f421c0b2a70 0x7f421c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.422+0000 7f422f400700 1 -- 172.21.15.70:0/3041891226 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 9583+0+0 (secure 0 0 0) 0x7f42240e2670 con 0x7f423810a490 2024-05-08T07:45:29.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.422+0000 7f4236a00700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f421c0b2a70 0x7f421c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.422+0000 7f4236a00700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f421c0b2a70 0x7f421c0b4f30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4228006fd0 tx=0x7f4228008040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:45:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.433+0000 7f4248159b80 1 Processor -- start 2024-05-08T07:45:29.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.433+0000 7f4248159b80 1 -- start start 2024-05-08T07:45:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4248159b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 0x55ae626db2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4248159b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5490 0x55ae626d5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4248159b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 0x55ae626e1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4248159b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ae62627b20 con 0x55ae626d5490 2024-05-08T07:45:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4248159b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae625c5860 con 0x55ae626d5e50 2024-05-08T07:45:29.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4248159b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ae62623ae0 con 0x55ae626daec0 2024-05-08T07:45:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4236000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5490 0x55ae626d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4236000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5490 0x55ae626d5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51068/0 (socket says 172.21.15.70:51068) 2024-05-08T07:45:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4236000700 1 -- 172.21.15.70:0/3285783318 learned_addr learned my addr 172.21.15.70:0/3285783318 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:45:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4236a00700 1 --2- 172.21.15.70:0/3285783318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 0x55ae626db2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4237400700 1 --2- 172.21.15.70:0/3285783318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 0x55ae626e1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4236000700 1 -- 172.21.15.70:0/3285783318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 msgr2=0x55ae626db2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:45:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4236000700 1 --2- 172.21.15.70:0/3285783318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 0x55ae626db2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4236000700 1 -- 172.21.15.70:0/3285783318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 msgr2=0x55ae626e1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:45:29.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4236000700 1 --2- 172.21.15.70:0/3285783318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 0x55ae626e1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.434+0000 7f4236000700 1 -- 172.21.15.70:0/3285783318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae625749d0 con 0x55ae626d5490 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.435+0000 7f4236000700 1 --2- 172.21.15.70:0/3285783318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5490 0x55ae626d5910 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f42240a91d0 tx=0x7f42240a90b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb5fe4c41c07f05 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.435+0000 7f4223e00700 1 -- 172.21.15.70:0/3285783318 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422401d040 con 0x55ae626d5490 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.435+0000 7f4223e00700 1 -- 172.21.15.70:0/3285783318 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42240ad880 con 0x55ae626d5490 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.435+0000 7f4223e00700 1 -- 172.21.15.70:0/3285783318 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42240a99c0 con 0x55ae626d5490 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.436+0000 7f4248159b80 1 -- 172.21.15.70:0/3285783318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5490 msgr2=0x55ae626d5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.436+0000 7f4248159b80 1 --2- 172.21.15.70:0/3285783318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5490 0x55ae626d5910 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f42240a91d0 tx=0x7f42240a90b0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.436+0000 7f4248159b80 1 -- 172.21.15.70:0/3285783318 shutdown_connections 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.436+0000 7f4248159b80 1 --2- 172.21.15.70:0/3285783318 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 0x55ae626e1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.436+0000 7f4248159b80 1 --2- 172.21.15.70:0/3285783318 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 0x55ae626db2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.436+0000 7f4248159b80 1 --2- 172.21.15.70:0/3285783318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5490 0x55ae626d5910 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.436+0000 7f4248159b80 1 -- 172.21.15.70:0/3285783318 >> 172.21.15.70:0/3285783318 conn(0x55ae62603c60 msgr2=0x55ae626cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.436+0000 7f4248159b80 1 -- 172.21.15.70:0/3285783318 shutdown_connections 2024-05-08T07:45:29.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.436+0000 7f4248159b80 1 -- 172.21.15.70:0/3285783318 wait complete. 2024-05-08T07:45:29.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.437+0000 7f4248159b80 1 -- start start 2024-05-08T07:45:29.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.437+0000 7f4248159b80 1 Processor -- start 2024-05-08T07:45:29.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4248159b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5490 0x55ae626e19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4248159b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626ded60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4248159b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 0x55ae626df2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4248159b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ae626e2280 con 0x55ae626d5e50 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4248159b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae6258dc20 con 0x55ae626d5490 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4248159b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ae626e2400 con 0x55ae626daec0 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4248159b80 10 client.0 _ll_register_callbacks cb 0x55ae625ced70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4236000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626ded60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4236000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626ded60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51080/0 (socket says 172.21.15.70:51080) 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4236000700 1 -- 172.21.15.70:0/845334080 learned_addr learned my addr 172.21.15.70:0/845334080 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4236a00700 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5490 0x55ae626e19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4237400700 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 0x55ae626df2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4236000700 1 -- 172.21.15.70:0/845334080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 msgr2=0x55ae626df2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.438+0000 7f4236000700 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 0x55ae626df2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4236000700 1 -- 172.21.15.70:0/845334080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5490 msgr2=0x55ae626e19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4236000700 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5490 0x55ae626e19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4236000700 1 -- 172.21.15.70:0/845334080 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae625ed520 con 0x55ae626d5e50 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4236000700 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626ded60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f422400c8f0 tx=0x7f42240a9af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de71f78f1ea372a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4220c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4220c00700 1 -- 172.21.15.70:0/845334080 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42240c8060 con 0x55ae626d5e50 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4220c00700 1 -- 172.21.15.70:0/845334080 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(197..197 src has 1..197) ==== 9583+0+0 (secure 0 0 0) 0x7f42240e23a0 con 0x55ae626d5e50 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4248159b80 1 -- 172.21.15.70:0/845334080 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42240ad880 con 0x55ae626d5e50 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4220c00700 1 -- 172.21.15.70:0/845334080 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f422401d030 con 0x55ae626d5e50 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.439+0000 7f4248159b80 10 client.17103 fetch_fsmap learned FSMap version 42 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.440+0000 7f4248159b80 1 -- 172.21.15.70:0/845334080 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ae626ecbb0 con 0x55ae626d5e50 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.440+0000 7f4220c00700 1 -- 172.21.15.70:0/845334080 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42240ad880 con 0x55ae626d5e50 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.440+0000 7f4220c00700 1 -- 172.21.15.70:0/845334080 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f42240a4e40 con 0x55ae626d5e50 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.440+0000 7f4248159b80 10 client.17103 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.440+0000 7f4248159b80 10 client.17103 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.440+0000 7f4248159b80 20 client.17103 populate_metadata read hostname 'smithi070' 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.440+0000 7f4248159b80 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae626ef080 0x55ae626f1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.440+0000 7f4248159b80 4 client.17103 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:45:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.440+0000 7f4248159b80 1 -- 172.21.15.70:0/845334080 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae626a21a0 con 0x55ae626ef080 2024-05-08T07:45:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.441+0000 7f4236a00700 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae626ef080 0x55ae626f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.442+0000 7f4236a00700 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae626ef080 0x55ae626f1470 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd671172bdbc57d6 server_cookie=980217ee82dc5de8 in_seq=0 out_seq=0 2024-05-08T07:45:29.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.442+0000 7f4220c00700 10 client.17103 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:45:29.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4220c00700 1 -- 172.21.15.70:0/845334080 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ae626a21a0 con 0x55ae626ef080 2024-05-08T07:45:29.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4220c00700 10 client.17103 handle_command_reply: tid=0 2024-05-08T07:45:29.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4248159b80 1 client.17103 shutdown 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4248159b80 1 -- 172.21.15.70:0/845334080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 msgr2=0x55ae626ded60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4248159b80 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626ded60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f422400c8f0 tx=0x7f42240a9af0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4248159b80 1 -- 172.21.15.70:0/845334080 shutdown_connections 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4248159b80 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae626ef080 0x55ae626f1470 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4248159b80 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626daec0 0x55ae626df2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4248159b80 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5490 0x55ae626e19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4248159b80 1 --2- 172.21.15.70:0/845334080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626ded60 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4220c00700 0 client.17103 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.444+0000 7f4248159b80 1 -- 172.21.15.70:0/845334080 >> 172.21.15.70:0/845334080 conn(0x55ae62603c60 msgr2=0x55ae626ca850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.445+0000 7f4248159b80 1 -- 172.21.15.70:0/845334080 shutdown_connections 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.445+0000 7f4248159b80 1 -- 172.21.15.70:0/845334080 wait complete. 2024-05-08T07:45:29.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.445+0000 7f4248159b80 20 client.17103 trim_cache size 0 max 16384 2024-05-08T07:45:29.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.466+0000 7f4248159b80 1 Processor -- start 2024-05-08T07:45:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.466+0000 7f4248159b80 1 -- start start 2024-05-08T07:45:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4248159b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 0x55ae626df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4248159b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 0x55ae626da5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4248159b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626daec0 0x55ae626d78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4248159b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b8570 con 0x55ae626daec0 2024-05-08T07:45:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4248159b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b5e00 con 0x55ae626d5e50 2024-05-08T07:45:29.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4248159b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b3c70 con 0x55ae626d5490 2024-05-08T07:45:29.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4237400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626daec0 0x55ae626d78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4237400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626daec0 0x55ae626d78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51082/0 (socket says 172.21.15.70:51082) 2024-05-08T07:45:29.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4237400700 1 -- 172.21.15.70:0/1778377308 learned_addr learned my addr 172.21.15.70:0/1778377308 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:45:29.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4236a00700 1 --2- 172.21.15.70:0/1778377308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 0x55ae626df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.467+0000 7f4236000700 1 --2- 172.21.15.70:0/1778377308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 0x55ae626da5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.468+0000 7f4237400700 1 -- 172.21.15.70:0/1778377308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 msgr2=0x55ae626df3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.468+0000 7f4237400700 1 --2- 172.21.15.70:0/1778377308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 0x55ae626df3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.468+0000 7f4237400700 1 -- 172.21.15.70:0/1778377308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 msgr2=0x55ae626da5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.468+0000 7f4237400700 1 --2- 172.21.15.70:0/1778377308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 0x55ae626da5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.468+0000 7f4237400700 1 -- 172.21.15.70:0/1778377308 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae626e21a0 con 0x55ae626daec0 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.468+0000 7f4237400700 1 --2- 172.21.15.70:0/1778377308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626daec0 0x55ae626d78d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f4230009260 tx=0x7f4230009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ca88da6696254c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.468+0000 7f4223400700 1 -- 172.21.15.70:0/1778377308 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4230004a50 con 0x55ae626daec0 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.468+0000 7f4223400700 1 -- 172.21.15.70:0/1778377308 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4230004bf0 con 0x55ae626daec0 2024-05-08T07:45:29.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.468+0000 7f4223400700 1 -- 172.21.15.70:0/1778377308 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300052a0 con 0x55ae626daec0 2024-05-08T07:45:29.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.469+0000 7f4248159b80 1 -- 172.21.15.70:0/1778377308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626daec0 msgr2=0x55ae626d78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:29.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.469+0000 7f4248159b80 1 --2- 172.21.15.70:0/1778377308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626daec0 0x55ae626d78d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f4230009260 tx=0x7f4230009290 comp rx=0 tx=0).stop 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.469+0000 7f4248159b80 1 -- 172.21.15.70:0/1778377308 shutdown_connections 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.469+0000 7f4248159b80 1 --2- 172.21.15.70:0/1778377308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626daec0 0x55ae626d78d0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.469+0000 7f4248159b80 1 --2- 172.21.15.70:0/1778377308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 0x55ae626df3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.469+0000 7f4248159b80 1 --2- 172.21.15.70:0/1778377308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626d5e50 0x55ae626da5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.469+0000 7f4248159b80 1 -- 172.21.15.70:0/1778377308 >> 172.21.15.70:0/1778377308 conn(0x55ae62603c60 msgr2=0x55ae626d4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.469+0000 7f4248159b80 1 -- 172.21.15.70:0/1778377308 shutdown_connections 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.469+0000 7f4248159b80 1 -- 172.21.15.70:0/1778377308 wait complete. 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.470+0000 7f4248159b80 1 -- start start 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.470+0000 7f4248159b80 1 Processor -- start 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4248159b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 0x55ae626f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4248159b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4248159b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626daec0 0x55ae626f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4248159b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b42c0 con 0x55ae626d5e50 2024-05-08T07:45:29.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4248159b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b5730 con 0x55ae626daec0 2024-05-08T07:45:29.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4248159b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42381b4990 con 0x55ae626d5490 2024-05-08T07:45:29.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4248159b80 10 client.0 _ll_register_callbacks cb 0x55ae626dec50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:45:29.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4236000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4236000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626f14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51096/0 (socket says 172.21.15.70:51096) 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4236000700 1 -- 172.21.15.70:0/1039419241 learned_addr learned my addr 172.21.15.70:0/1039419241 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4236a00700 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 0x55ae626f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4237400700 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626daec0 0x55ae626f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4236000700 1 -- 172.21.15.70:0/1039419241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 msgr2=0x55ae626f0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4236000700 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 0x55ae626f0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4236000700 1 -- 172.21.15.70:0/1039419241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626daec0 msgr2=0x55ae626f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4236000700 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626daec0 0x55ae626f19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.471+0000 7f4236000700 1 -- 172.21.15.70:0/1039419241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae627595a0 con 0x55ae626d5e50 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.472+0000 7f4236000700 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626f14a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f42240a9460 tx=0x7f42240a90b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a0f9711e2d9aa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.472+0000 7f4220c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.472+0000 7f4220c00700 1 -- 172.21.15.70:0/1039419241 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42240c8040 con 0x55ae626d5e50 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.472+0000 7f4220c00700 1 -- 172.21.15.70:0/1039419241 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(197..197 src has 1..197) ==== 9583+0+0 (secure 0 0 0) 0x7f42240e23a0 con 0x55ae626d5e50 2024-05-08T07:45:29.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.472+0000 7f4248159b80 1 -- 172.21.15.70:0/1039419241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4230004bf0 con 0x55ae626d5e50 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.472+0000 7f4220c00700 1 -- 172.21.15.70:0/1039419241 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f42240ad880 con 0x55ae626d5e50 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.472+0000 7f4248159b80 10 client.17109 fetch_fsmap learned FSMap version 42 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.472+0000 7f4248159b80 1 -- 172.21.15.70:0/1039419241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ae6275a800 con 0x55ae626d5e50 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.473+0000 7f4220c00700 1 -- 172.21.15.70:0/1039419241 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4230004bf0 con 0x55ae626d5e50 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.473+0000 7f4220c00700 1 -- 172.21.15.70:0/1039419241 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4224083b90 con 0x55ae626d5e50 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.473+0000 7f4248159b80 10 client.17109 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.473+0000 7f4248159b80 10 client.17109 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.473+0000 7f4248159b80 20 client.17109 populate_metadata read hostname 'smithi070' 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.473+0000 7f4248159b80 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae6275ad40 0x55ae6275d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.473+0000 7f4248159b80 4 client.17109 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e2347807", "release": true, "await": true}] 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.473+0000 7f4248159b80 1 -- 172.21.15.70:0/1039419241 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e2347807", "release": true, "await": true}) -- 0x55ae62635500 con 0x55ae6275ad40 2024-05-08T07:45:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.474+0000 7f4236a00700 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae6275ad40 0x55ae6275d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:45:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.474+0000 7f4236a00700 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae6275ad40 0x55ae6275d160 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d285f874e8e11941 server_cookie=12b6965a57b81a82 in_seq=0 out_seq=0 2024-05-08T07:45:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:29.474+0000 7f4220c00700 10 client.17109 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:45:30.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:29 smithi194 ceph-mon[33679]: pgmap v1874: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-05-08T07:45:30.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:29 smithi070 ceph-mon[29591]: pgmap v1874: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-05-08T07:45:30.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:29 smithi172 ceph-mon[33377]: pgmap v1874: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 6 op/s 2024-05-08T07:45:32.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:31 smithi194 ceph-mon[33679]: pgmap v1875: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-05-08T07:45:32.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:31 smithi070 ceph-mon[29591]: pgmap v1875: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-05-08T07:45:32.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:31 smithi172 ceph-mon[33377]: pgmap v1875: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-05-08T07:45:33.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.823+0000 7f4220c00700 1 -- 172.21.15.70:0/1039419241 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55ae62635500 con 0x55ae6275ad40 2024-05-08T07:45:33.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.823+0000 7f4220c00700 10 client.17109 handle_command_reply: tid=0 2024-05-08T07:45:33.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.823+0000 7f4248159b80 1 client.17109 shutdown 2024-05-08T07:45:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.825+0000 7f4248159b80 1 -- 172.21.15.70:0/1039419241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 msgr2=0x55ae626f14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.825+0000 7f4248159b80 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626f14a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f42240a9460 tx=0x7f42240a90b0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.825+0000 7f4248159b80 1 -- 172.21.15.70:0/1039419241 shutdown_connections 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.825+0000 7f4248159b80 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae6275ad40 0x55ae6275d160 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.825+0000 7f4248159b80 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae626daec0 0x55ae626f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.825+0000 7f4248159b80 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae626d5490 0x55ae626f0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.825+0000 7f4248159b80 1 --2- 172.21.15.70:0/1039419241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae626d5e50 0x55ae626f14a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.825+0000 7f4248159b80 1 -- 172.21.15.70:0/1039419241 >> 172.21.15.70:0/1039419241 conn(0x55ae62603c60 msgr2=0x55ae626c9fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.825+0000 7f4220c00700 0 client.17109 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.826+0000 7f4248159b80 1 -- 172.21.15.70:0/1039419241 shutdown_connections 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.826+0000 7f4248159b80 1 -- 172.21.15.70:0/1039419241 wait complete. 2024-05-08T07:45:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.827+0000 7f4248159b80 20 client.17109 trim_cache size 0 max 16384 2024-05-08T07:45:33.823 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:45:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:45:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:45:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 144, 2024-05-08T07:45:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:45:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "e2347807": { 2024-05-08T07:45:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 144, 2024-05-08T07:45:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:45:33.823 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 73.5, 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:33.824 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:45:33.825 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:45:33.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 -- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f421c0b2a70 msgr2=0x7f421c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:33.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f421c0b2a70 0x7f421c0b4f30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4228006fd0 tx=0x7f4228008040 comp rx=0 tx=0).stop 2024-05-08T07:45:33.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 -- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 msgr2=0x7f42381a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:45:33.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 0x7f42381a0640 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f422400c920 tx=0x7f422400cce0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 -- 172.21.15.70:0/3041891226 shutdown_connections 2024-05-08T07:45:33.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f421c0b2a70 0x7f421c0b4f30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f423810fb60 0x7f42381a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4238109ad0 0x7f42381a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 --2- 172.21.15.70:0/3041891226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f423810a490 0x7f42381a0640 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:45:33.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 -- 172.21.15.70:0/3041891226 >> 172.21.15.70:0/3041891226 conn(0x7f4238076c70 msgr2=0x7f4238077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:45:33.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.828+0000 7f423d800700 1 -- 172.21.15.70:0/3041891226 shutdown_connections 2024-05-08T07:45:33.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:45:33.829+0000 7f423d800700 1 -- 172.21.15.70:0/3041891226 wait complete. 2024-05-08T07:45:34.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:33 smithi194 ceph-mon[33679]: pgmap v1876: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-08T07:45:34.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:33 smithi070 ceph-mon[29591]: pgmap v1876: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-08T07:45:34.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:33 smithi172 ceph-mon[33377]: pgmap v1876: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-08T07:45:34.677 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e2347807', seconds elapsed: 64.7 2024-05-08T07:45:35.705 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/common.o 2024-05-08T07:45:36.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:35 smithi194 ceph-mon[33679]: pgmap v1877: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-05-08T07:45:36.087 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/kernfs/dir.o 2024-05-08T07:45:36.112 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/crypto_null.o 2024-05-08T07:45:36.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:35 smithi070 ceph-mon[29591]: pgmap v1877: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-05-08T07:45:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:35 smithi172 ceph-mon[33377]: pgmap v1877: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-05-08T07:45:36.215 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/clocksource.o 2024-05-08T07:45:36.253 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/jiffies.o 2024-05-08T07:45:36.257 INFO:tasks.workunit.client.0.smithi070.stdout: AR security/integrity/built-in.a 2024-05-08T07:45:36.278 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/pkeys.o 2024-05-08T07:45:36.505 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/page_io.o 2024-05-08T07:45:36.520 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/commoncap.o 2024-05-08T07:45:38.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:37 smithi194 ceph-mon[33679]: pgmap v1878: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-05-08T07:45:38.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:37 smithi070 ceph-mon[29591]: pgmap v1878: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-05-08T07:45:38.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:37 smithi172 ceph-mon[33377]: pgmap v1878: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-05-08T07:45:40.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:39 smithi194 ceph-mon[33679]: pgmap v1879: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 118 KiB/s wr, 13 op/s 2024-05-08T07:45:40.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:39 smithi070 ceph-mon[29591]: pgmap v1879: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 118 KiB/s wr, 13 op/s 2024-05-08T07:45:40.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:39 smithi172 ceph-mon[33377]: pgmap v1879: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 118 KiB/s wr, 13 op/s 2024-05-08T07:45:42.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:41 smithi194 ceph-mon[33679]: pgmap v1880: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 144 KiB/s wr, 17 op/s 2024-05-08T07:45:42.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:41 smithi070 ceph-mon[29591]: pgmap v1880: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 144 KiB/s wr, 17 op/s 2024-05-08T07:45:42.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:41 smithi172 ceph-mon[33377]: pgmap v1880: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 144 KiB/s wr, 17 op/s 2024-05-08T07:45:42.448 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/timer_list.o 2024-05-08T07:45:43.230 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/swap_state.o 2024-05-08T07:45:44.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:43 smithi194 ceph-mon[33679]: pgmap v1881: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 176 KiB/s wr, 21 op/s 2024-05-08T07:45:44.083 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:43 smithi070 ceph-mon[29591]: pgmap v1881: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 176 KiB/s wr, 21 op/s 2024-05-08T07:45:44.096 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/md5.o 2024-05-08T07:45:44.103 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/kernfs/file.o 2024-05-08T07:45:44.108 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/kaslr.o 2024-05-08T07:45:44.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:43 smithi172 ceph-mon[33377]: pgmap v1881: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 176 KiB/s wr, 21 op/s 2024-05-08T07:45:45.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:45:45.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:45:45.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:45:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:45 smithi070 ceph-mon[29591]: pgmap v1882: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 175 KiB/s wr, 21 op/s 2024-05-08T07:45:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:45 smithi194 ceph-mon[33679]: pgmap v1882: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 175 KiB/s wr, 21 op/s 2024-05-08T07:45:46.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:45 smithi172 ceph-mon[33377]: pgmap v1882: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 175 KiB/s wr, 21 op/s 2024-05-08T07:45:46.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:46.641 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/min_addr.o 2024-05-08T07:45:48.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:47 smithi070 ceph-mon[29591]: pgmap v1883: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 219 KiB/s wr, 50 op/s 2024-05-08T07:45:48.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:45:48.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:45:48.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:48.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:47 smithi172 ceph-mon[33377]: pgmap v1883: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 219 KiB/s wr, 50 op/s 2024-05-08T07:45:48.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:45:48.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:45:48.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:48.231 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/rdrand.o 2024-05-08T07:45:48.245 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/match.o 2024-05-08T07:45:48.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:47 smithi194 ceph-mon[33679]: pgmap v1883: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 219 KiB/s wr, 50 op/s 2024-05-08T07:45:48.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:45:48.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:45:48.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:45:50.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:49 smithi070 ceph-mon[29591]: pgmap v1884: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 295 KiB/s wr, 57 op/s 2024-05-08T07:45:50.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:49 smithi172 ceph-mon[33377]: pgmap v1884: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 295 KiB/s wr, 57 op/s 2024-05-08T07:45:50.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:49 smithi194 ceph-mon[33679]: pgmap v1884: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 295 KiB/s wr, 57 op/s 2024-05-08T07:45:51.605 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/kernfs/symlink.o 2024-05-08T07:45:51.749 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/sha256_generic.o 2024-05-08T07:45:52.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:51 smithi070 ceph-mon[29591]: pgmap v1885: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 355 KiB/s wr, 111 op/s 2024-05-08T07:45:52.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:51 smithi172 ceph-mon[33377]: pgmap v1885: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 355 KiB/s wr, 111 op/s 2024-05-08T07:45:52.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:51 smithi194 ceph-mon[33679]: pgmap v1885: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 355 KiB/s wr, 111 op/s 2024-05-08T07:45:52.500 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/timeconv.o 2024-05-08T07:45:52.853 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/mm/pti.o 2024-05-08T07:45:53.824 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/swapfile.o 2024-05-08T07:45:54.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:53 smithi070 ceph-mon[29591]: pgmap v1886: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 338 KiB/s wr, 109 op/s 2024-05-08T07:45:54.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:53 smithi172 ceph-mon[33377]: pgmap v1886: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 338 KiB/s wr, 109 op/s 2024-05-08T07:45:54.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:53 smithi194 ceph-mon[33679]: pgmap v1886: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 338 KiB/s wr, 109 op/s 2024-05-08T07:45:54.661 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/swap_slots.o 2024-05-08T07:45:54.663 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/security.o 2024-05-08T07:45:55.257 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/bugs.o 2024-05-08T07:45:56.059 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:55 smithi194 ceph-mon[33679]: pgmap v1887: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 310 KiB/s wr, 107 op/s 2024-05-08T07:45:56.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:55 smithi070 ceph-mon[29591]: pgmap v1887: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 310 KiB/s wr, 107 op/s 2024-05-08T07:45:56.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:55 smithi172 ceph-mon[33377]: pgmap v1887: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 310 KiB/s wr, 107 op/s 2024-05-08T07:45:58.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:57 smithi070 ceph-mon[29591]: pgmap v1888: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 442 KiB/s wr, 116 op/s 2024-05-08T07:45:58.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:57 smithi172 ceph-mon[33377]: pgmap v1888: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 442 KiB/s wr, 116 op/s 2024-05-08T07:45:58.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:57 smithi194 ceph-mon[33679]: pgmap v1888: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 442 KiB/s wr, 116 op/s 2024-05-08T07:45:58.644 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/timecounter.o 2024-05-08T07:45:59.267 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/kernfs/built-in.a 2024-05-08T07:45:59.408 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/alarmtimer.o 2024-05-08T07:45:59.566 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/sha512_generic.o 2024-05-08T07:45:59.746 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/sysfs/file.o 2024-05-08T07:45:59.749 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 22.8 2024-05-08T07:45:59.750 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:46:00.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:45:59 smithi070 ceph-mon[29591]: pgmap v1889: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 398 KiB/s wr, 85 op/s 2024-05-08T07:46:00.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:45:59 smithi172 ceph-mon[33377]: pgmap v1889: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 398 KiB/s wr, 85 op/s 2024-05-08T07:46:00.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:45:59 smithi194 ceph-mon[33679]: pgmap v1889: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 398 KiB/s wr, 85 op/s 2024-05-08T07:46:00.266 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:46:02.055 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/mm/built-in.a 2024-05-08T07:46:02.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:01 smithi070 ceph-mon[29591]: pgmap v1890: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 416 KiB/s wr, 80 op/s 2024-05-08T07:46:02.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:01 smithi172 ceph-mon[33377]: pgmap v1890: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 416 KiB/s wr, 80 op/s 2024-05-08T07:46:02.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:01 smithi194 ceph-mon[33679]: pgmap v1890: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 416 KiB/s wr, 80 op/s 2024-05-08T07:46:04.088 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:03 smithi070 ceph-mon[29591]: pgmap v1891: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 298 KiB/s wr, 41 op/s 2024-05-08T07:46:04.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:03 smithi172 ceph-mon[33377]: pgmap v1891: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 298 KiB/s wr, 41 op/s 2024-05-08T07:46:04.176 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/ia32/audit.o 2024-05-08T07:46:04.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:03 smithi194 ceph-mon[33679]: pgmap v1891: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 298 KiB/s wr, 41 op/s 2024-05-08T07:46:04.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.294+0000 7fe7ffe00700 1 -- 172.21.15.70:0/3163074022 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4017400 con 0x7fe800075ff0 2024-05-08T07:46:04.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.295+0000 7fe808400700 1 -- 172.21.15.70:0/3163074022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe800075ff0 msgr2=0x7fe80010f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:04.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.295+0000 7fe808400700 1 --2- 172.21.15.70:0/3163074022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe800075ff0 0x7fe80010f9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40098f0 tx=0x7fe7f4009c00 comp rx=0 tx=0).stop 2024-05-08T07:46:04.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.296+0000 7fe808400700 1 -- 172.21.15.70:0/3163074022 shutdown_connections 2024-05-08T07:46:04.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.296+0000 7fe808400700 1 --2- 172.21.15.70:0/3163074022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe80010ff00 0x7fe8001122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.296+0000 7fe808400700 1 --2- 172.21.15.70:0/3163074022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8000756d0 0x7fe800075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.296+0000 7fe808400700 1 --2- 172.21.15.70:0/3163074022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe800075ff0 0x7fe80010f9c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.296+0000 7fe808400700 1 -- 172.21.15.70:0/3163074022 >> 172.21.15.70:0/3163074022 conn(0x7fe80007a600 msgr2=0x7fe80007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:46:04.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.296+0000 7fe808400700 1 -- 172.21.15.70:0/3163074022 shutdown_connections 2024-05-08T07:46:04.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.296+0000 7fe808400700 1 -- 172.21.15.70:0/3163074022 wait complete. 2024-05-08T07:46:04.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.298+0000 7fe808400700 1 Processor -- start 2024-05-08T07:46:04.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.298+0000 7fe808400700 1 -- start start 2024-05-08T07:46:04.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.299+0000 7fe808400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8000756d0 0x7fe8001a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:04.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.299+0000 7fe808400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe800075ff0 0x7fe8001a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:04.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.299+0000 7fe808400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe80010ff00 0x7fe80019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:04.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.299+0000 7fe808400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe800115750 con 0x7fe8000756d0 2024-05-08T07:46:04.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.299+0000 7fe808400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001155d0 con 0x7fe80010ff00 2024-05-08T07:46:04.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.299+0000 7fe808400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe8001158d0 con 0x7fe800075ff0 2024-05-08T07:46:04.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.299+0000 7fe805a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8000756d0 0x7fe8001a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:04.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.299+0000 7fe805a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8000756d0 0x7fe8001a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60936/0 (socket says 172.21.15.70:60936) 2024-05-08T07:46:04.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.299+0000 7fe805a00700 1 -- 172.21.15.70:0/2022017157 learned_addr learned my addr 172.21.15.70:0/2022017157 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:46:04.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.300+0000 7fe805000700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe800075ff0 0x7fe8001a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:04.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.300+0000 7fe806400700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe80010ff00 0x7fe80019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:04.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.300+0000 7fe805a00700 1 -- 172.21.15.70:0/2022017157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe800075ff0 msgr2=0x7fe8001a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:04.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.300+0000 7fe805a00700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe800075ff0 0x7fe8001a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.300+0000 7fe805a00700 1 -- 172.21.15.70:0/2022017157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe80010ff00 msgr2=0x7fe80019baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.300+0000 7fe805a00700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe80010ff00 0x7fe80019baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.300+0000 7fe805a00700 1 -- 172.21.15.70:0/2022017157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80019c250 con 0x7fe8000756d0 2024-05-08T07:46:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.300+0000 7fe805a00700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8000756d0 0x7fe8001a18e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000ec10 tx=0x7fe7f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:46:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.301+0000 7fe7fe000700 1 -- 172.21.15.70:0/2022017157 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000cde0 con 0x7fe8000756d0 2024-05-08T07:46:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.301+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80019c540 con 0x7fe8000756d0 2024-05-08T07:46:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.301+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8001a87b0 con 0x7fe8000756d0 2024-05-08T07:46:04.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.301+0000 7fe7fe000700 1 -- 172.21.15.70:0/2022017157 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe7f00044b0 con 0x7fe8000756d0 2024-05-08T07:46:04.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.301+0000 7fe7fe000700 1 -- 172.21.15.70:0/2022017157 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0010430 con 0x7fe8000756d0 2024-05-08T07:46:04.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.303+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e4005330 con 0x7fe8000756d0 2024-05-08T07:46:04.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.306+0000 7fe7fe000700 1 -- 172.21.15.70:0/2022017157 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe7f0003680 con 0x7fe8000756d0 2024-05-08T07:46:04.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.308+0000 7fe7fe000700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7e80b2bf0 0x7fe7e80b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:04.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.308+0000 7fe7fe000700 1 -- 172.21.15.70:0/2022017157 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(197..197 src has 1..197) ==== 9583+0+0 (secure 0 0 0) 0x7fe7f0003c40 con 0x7fe8000756d0 2024-05-08T07:46:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.309+0000 7fe805000700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7e80b2bf0 0x7fe7e80b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:04.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.310+0000 7fe805000700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7e80b2bf0 0x7fe7e80b50b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009230 tx=0x7fe7f4005b40 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:46:04.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.314+0000 7fe7fe000700 1 -- 172.21.15.70:0/2022017157 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe7f00aa380 con 0x7fe8000756d0 2024-05-08T07:46:04.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.788+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7e4005620 con 0x7fe8000756d0 2024-05-08T07:46:04.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.791+0000 7fe7fe000700 1 -- 172.21.15.70:0/2022017157 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fe7f00a9c80 con 0x7fe8000756d0 2024-05-08T07:46:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:46:04.787 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:46:04.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.795+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7e80b2bf0 msgr2=0x7fe7e80b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:04.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.795+0000 7fe808400700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7e80b2bf0 0x7fe7e80b50b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009230 tx=0x7fe7f4005b40 comp rx=0 tx=0).stop 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.795+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8000756d0 msgr2=0x7fe8001a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.795+0000 7fe808400700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8000756d0 0x7fe8001a18e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000ec10 tx=0x7fe7f000c2d0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.796+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 shutdown_connections 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.796+0000 7fe808400700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe7e80b2bf0 0x7fe7e80b50b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.796+0000 7fe808400700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe80010ff00 0x7fe80019baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.796+0000 7fe808400700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8000756d0 0x7fe8001a18e0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.796+0000 7fe808400700 1 --2- 172.21.15.70:0/2022017157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe800075ff0 0x7fe8001a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.796+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 >> 172.21.15.70:0/2022017157 conn(0x7fe80007a600 msgr2=0x7fe8001007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.797+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 shutdown_connections 2024-05-08T07:46:04.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:04.797+0000 7fe808400700 1 -- 172.21.15.70:0/2022017157 wait complete. 2024-05-08T07:46:04.797 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:46:04.820 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/ia32/built-in.a 2024-05-08T07:46:05.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:04 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2022017157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:46:05.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:04 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2022017157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:46:05.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:04 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2022017157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:46:05.286 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/posix-timers.o 2024-05-08T07:46:05.348 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/posix-cpu-timers.o 2024-05-08T07:46:06.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:05 smithi070 ceph-mon[29591]: pgmap v1892: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 294 KiB/s wr, 51 op/s 2024-05-08T07:46:06.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:05 smithi070 ceph-mon[29591]: osdmap e198: 12 total, 12 up, 12 in 2024-05-08T07:46:06.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:05 smithi172 ceph-mon[33377]: pgmap v1892: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 294 KiB/s wr, 51 op/s 2024-05-08T07:46:06.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:05 smithi172 ceph-mon[33377]: osdmap e198: 12 total, 12 up, 12 in 2024-05-08T07:46:06.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:05 smithi194 ceph-mon[33679]: pgmap v1892: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 294 KiB/s wr, 51 op/s 2024-05-08T07:46:06.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:05 smithi194 ceph-mon[33679]: osdmap e198: 12 total, 12 up, 12 in 2024-05-08T07:46:06.408 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 82.8 --await-for 42.0' 2024-05-08T07:46:06.409 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 82.8 --await-for 42.0 2024-05-08T07:46:06.985 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:46:07.650 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/aperfmperf.o 2024-05-08T07:46:07.843 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/dmapool.o 2024-05-08T07:46:08.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:07 smithi070 ceph-mon[29591]: pgmap v1894: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 445 KiB/s wr, 190 op/s 2024-05-08T07:46:08.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:07 smithi172 ceph-mon[33377]: pgmap v1894: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 445 KiB/s wr, 190 op/s 2024-05-08T07:46:08.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:07 smithi194 ceph-mon[33679]: pgmap v1894: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 445 KiB/s wr, 190 op/s 2024-05-08T07:46:08.722 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/lsm_audit.o 2024-05-08T07:46:09.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:09 smithi172 ceph-mon[33377]: pgmap v1895: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 445 KiB/s wr, 190 op/s 2024-05-08T07:46:09.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:09 smithi194 ceph-mon[33679]: pgmap v1895: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 445 KiB/s wr, 190 op/s 2024-05-08T07:46:09.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:09 smithi070 ceph-mon[29591]: pgmap v1895: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 445 KiB/s wr, 190 op/s 2024-05-08T07:46:11.677 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:11 smithi070 ceph-mon[29591]: pgmap v1896: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 464 KiB/s wr, 191 op/s 2024-05-08T07:46:11.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:11 smithi194 ceph-mon[33679]: pgmap v1896: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 464 KiB/s wr, 191 op/s 2024-05-08T07:46:11.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:11 smithi172 ceph-mon[33377]: pgmap v1896: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 464 KiB/s wr, 191 op/s 2024-05-08T07:46:11.978 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/sha3_generic.o 2024-05-08T07:46:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.598+0000 7f6107200700 1 -- 172.21.15.70:0/4000794129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6100102ed0 msgr2=0x7f61001032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.598+0000 7f6107200700 1 --2- 172.21.15.70:0/4000794129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6100102ed0 0x7f61001032b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009990 tx=0x7f60f0009ca0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.598+0000 7f6107200700 1 -- 172.21.15.70:0/4000794129 shutdown_connections 2024-05-08T07:46:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.598+0000 7f6107200700 1 --2- 172.21.15.70:0/4000794129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f610010ff50 0x7f6100112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.598+0000 7f6107200700 1 --2- 172.21.15.70:0/4000794129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6100102ed0 0x7f61001032b0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.598+0000 7f6107200700 1 --2- 172.21.15.70:0/4000794129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f61001037f0 0x7f610010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.598+0000 7f6107200700 1 -- 172.21.15.70:0/4000794129 >> 172.21.15.70:0/4000794129 conn(0x7f6100079340 msgr2=0x7f6100079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:46:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.598+0000 7f6107200700 1 -- 172.21.15.70:0/4000794129 shutdown_connections 2024-05-08T07:46:13.596 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:13 smithi070 ceph-mon[29591]: pgmap v1897: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 442 KiB/s wr, 175 op/s 2024-05-08T07:46:13.596 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:13 smithi070 ceph-mon[29591]: osdmap e199: 12 total, 12 up, 12 in 2024-05-08T07:46:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.598+0000 7f6107200700 1 -- 172.21.15.70:0/4000794129 wait complete. 2024-05-08T07:46:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.599+0000 7f6107200700 1 Processor -- start 2024-05-08T07:46:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.600+0000 7f6107200700 1 -- start start 2024-05-08T07:46:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.601+0000 7f6107200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6100102ed0 0x7f61001a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.601+0000 7f6107200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61001037f0 0x7f61001a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.601+0000 7f6107200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610010ff50 0x7f610019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.601+0000 7f6107200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6100115710 con 0x7f6100102ed0 2024-05-08T07:46:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.601+0000 7f6107200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6100115590 con 0x7f610010ff50 2024-05-08T07:46:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.601+0000 7f6107200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6100115890 con 0x7f61001037f0 2024-05-08T07:46:13.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.602+0000 7f60ffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6100102ed0 0x7f61001a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.602+0000 7f60ff400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61001037f0 0x7f61001a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.602+0000 7f60ff400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61001037f0 0x7f61001a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:39380/0 (socket says 172.21.15.70:39380) 2024-05-08T07:46:13.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.602+0000 7f60ff400700 1 -- 172.21.15.70:0/3462229762 learned_addr learned my addr 172.21.15.70:0/3462229762 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:46:13.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.602+0000 7f6105200700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610010ff50 0x7f610019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.603+0000 7f60ffe00700 1 -- 172.21.15.70:0/3462229762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61001037f0 msgr2=0x7f61001a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:13.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.603+0000 7f60ffe00700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61001037f0 0x7f61001a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.603+0000 7f60ffe00700 1 -- 172.21.15.70:0/3462229762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610010ff50 msgr2=0x7f610019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:13.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.603+0000 7f60ffe00700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610010ff50 0x7f610019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.603+0000 7f60ffe00700 1 -- 172.21.15.70:0/3462229762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610019c190 con 0x7f6100102ed0 2024-05-08T07:46:13.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.603+0000 7f60ff400700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61001037f0 0x7f61001a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:46:13.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.604+0000 7f60ffe00700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6100102ed0 0x7f61001a1870 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f60f0006010 tx=0x7f60f00057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:46:13.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.604+0000 7f60fcc00700 1 -- 172.21.15.70:0/3462229762 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0027070 con 0x7f6100102ed0 2024-05-08T07:46:13.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.605+0000 7f6107200700 1 -- 172.21.15.70:0/3462229762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610019c420 con 0x7f6100102ed0 2024-05-08T07:46:13.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.605+0000 7f60fcc00700 1 -- 172.21.15.70:0/3462229762 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60f000fbc0 con 0x7f6100102ed0 2024-05-08T07:46:13.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.605+0000 7f60fcc00700 1 -- 172.21.15.70:0/3462229762 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0022af0 con 0x7f6100102ed0 2024-05-08T07:46:13.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.605+0000 7f6107200700 1 -- 172.21.15.70:0/3462229762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61001045b0 con 0x7f6100102ed0 2024-05-08T07:46:13.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.611+0000 7f60fcc00700 1 -- 172.21.15.70:0/3462229762 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f60f002a070 con 0x7f6100102ed0 2024-05-08T07:46:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.613+0000 7f60fcc00700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f60e40b2b20 0x7f60e40b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.613+0000 7f60fcc00700 1 -- 172.21.15.70:0/3462229762 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 9583+0+0 (secure 0 0 0) 0x7f60f00e3a60 con 0x7f6100102ed0 2024-05-08T07:46:13.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.614+0000 7f60ff400700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f60e40b2b20 0x7f60e40b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.615+0000 7f60ff400700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f60e40b2b20 0x7f60e40b4fe0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6100102020 tx=0x7f60ec007480 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:46:13.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.632+0000 7f6111c31b80 1 Processor -- start 2024-05-08T07:46:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.632+0000 7f6111c31b80 1 -- start start 2024-05-08T07:46:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.632+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca60f50 0x5611bca61330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.632+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca5b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.632+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca5bee0 0x5611bca67d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.632+0000 7f6111c31b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5611bc9adbb0 con 0x5611bca60f50 2024-05-08T07:46:13.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.632+0000 7f6111c31b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5611bc94b8f0 con 0x5611bca5bee0 2024-05-08T07:46:13.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.632+0000 7f6111c31b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5611bc9a9b70 con 0x5611bca5b520 2024-05-08T07:46:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.633+0000 7f6105200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca5bee0 0x5611bca67d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.633+0000 7f6105200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca5bee0 0x5611bca67d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:49492/0 (socket says 172.21.15.70:49492) 2024-05-08T07:46:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.633+0000 7f6105200700 1 -- 172.21.15.70:0/3125323239 learned_addr learned my addr 172.21.15.70:0/3125323239 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:46:13.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.633+0000 7f60ff400700 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca5b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.634+0000 7f60ffe00700 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca60f50 0x5611bca61330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.634+0000 7f6105200700 1 -- 172.21.15.70:0/3125323239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 msgr2=0x5611bca5b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:46:13.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.634+0000 7f6105200700 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca5b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.634+0000 7f6105200700 1 -- 172.21.15.70:0/3125323239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca60f50 msgr2=0x5611bca61330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:46:13.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.634+0000 7f6105200700 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca60f50 0x5611bca61330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.634+0000 7f6105200700 1 -- 172.21.15.70:0/3125323239 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611bc8faa60 con 0x5611bca5bee0 2024-05-08T07:46:13.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.634+0000 7f60ffe00700 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca60f50 0x5611bca61330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:46:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.636+0000 7f6105200700 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca5bee0 0x5611bca67d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60f8007f40 tx=0x7f60f800e440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3a676939ccf8d32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:46:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.636+0000 7f60f5600700 1 -- 172.21.15.70:0/3125323239 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f800ec70 con 0x5611bca5bee0 2024-05-08T07:46:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.636+0000 7f60f5600700 1 -- 172.21.15.70:0/3125323239 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60f800ee10 con 0x5611bca5bee0 2024-05-08T07:46:13.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.636+0000 7f60f5600700 1 -- 172.21.15.70:0/3125323239 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f8014c70 con 0x5611bca5bee0 2024-05-08T07:46:13.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.637+0000 7f6111c31b80 1 -- 172.21.15.70:0/3125323239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca5bee0 msgr2=0x5611bca67d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.637+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca5bee0 0x5611bca67d10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60f8007f40 tx=0x7f60f800e440 comp rx=0 tx=0).stop 2024-05-08T07:46:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.638+0000 7f6111c31b80 1 -- 172.21.15.70:0/3125323239 shutdown_connections 2024-05-08T07:46:13.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.638+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca5bee0 0x5611bca67d10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.638+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca60f50 0x5611bca61330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.638+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3125323239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca5b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.638+0000 7f6111c31b80 1 -- 172.21.15.70:0/3125323239 >> 172.21.15.70:0/3125323239 conn(0x5611bc989cf0 msgr2=0x5611bca55e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:46:13.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.639+0000 7f6111c31b80 1 -- 172.21.15.70:0/3125323239 shutdown_connections 2024-05-08T07:46:13.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.639+0000 7f6111c31b80 1 -- 172.21.15.70:0/3125323239 wait complete. 2024-05-08T07:46:13.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.639+0000 7f6111c31b80 1 -- start start 2024-05-08T07:46:13.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.640+0000 7f6111c31b80 1 Processor -- start 2024-05-08T07:46:13.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.640+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5b520 0x5611bca679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.640+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5bee0 0x5611bca64d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.640+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bca65280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.640+0000 7f6111c31b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5611bca68250 con 0x5611bca5b520 2024-05-08T07:46:13.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.640+0000 7f6111c31b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5611bc913cb0 con 0x5611bca60f50 2024-05-08T07:46:13.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.640+0000 7f6111c31b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5611bca683d0 con 0x5611bca5bee0 2024-05-08T07:46:13.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.641+0000 7f6111c31b80 10 client.0 _ll_register_callbacks cb 0x5611bc954e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:46:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.641+0000 7f60ffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5b520 0x5611bca679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f60ffe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5b520 0x5611bca679a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44686/0 (socket says 172.21.15.70:44686) 2024-05-08T07:46:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f60ffe00700 1 -- 172.21.15.70:0/3557438287 learned_addr learned my addr 172.21.15.70:0/3557438287 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:46:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f6105200700 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bca65280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f60ff400700 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5bee0 0x5611bca64d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f60ffe00700 1 -- 172.21.15.70:0/3557438287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5bee0 msgr2=0x5611bca64d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:46:13.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f60ffe00700 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5bee0 0x5611bca64d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f60ffe00700 1 -- 172.21.15.70:0/3557438287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 msgr2=0x5611bca65280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:46:13.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f60ffe00700 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bca65280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f60ffe00700 1 -- 172.21.15.70:0/3557438287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611bc9735b0 con 0x5611bca5b520 2024-05-08T07:46:13.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f60ff400700 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5bee0 0x5611bca64d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:46:13.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.642+0000 7f6105200700 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bca65280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:46:13.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.643+0000 7f60ffe00700 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5b520 0x5611bca679a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f60f00aa940 tx=0x7f60f0022520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1dab77b95475ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:46:13.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.643+0000 7f60ea000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:46:13.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.643+0000 7f60ea000700 1 -- 172.21.15.70:0/3557438287 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f00ab0b0 con 0x5611bca5b520 2024-05-08T07:46:13.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.643+0000 7f60ea000700 1 -- 172.21.15.70:0/3557438287 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 9583+0+0 (secure 0 0 0) 0x7f60f00aac10 con 0x5611bca5b520 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.643+0000 7f6111c31b80 1 -- 172.21.15.70:0/3557438287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60f800ee10 con 0x5611bca5b520 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.644+0000 7f60ea000700 1 -- 172.21.15.70:0/3557438287 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f60f00aa9b0 con 0x5611bca5b520 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.644+0000 7f6111c31b80 10 client.17127 fetch_fsmap learned FSMap version 42 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.644+0000 7f6111c31b80 1 -- 172.21.15.70:0/3557438287 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5611bca72ad0 con 0x5611bca5b520 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.645+0000 7f60ea000700 1 -- 172.21.15.70:0/3557438287 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60f800ee10 con 0x5611bca5b520 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.645+0000 7f60ea000700 1 -- 172.21.15.70:0/3557438287 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f60f00abce0 con 0x5611bca5b520 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.645+0000 7f6111c31b80 10 client.17127 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.645+0000 7f6111c31b80 10 client.17127 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.645+0000 7f6111c31b80 20 client.17127 populate_metadata read hostname 'smithi070' 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.645+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5611bca74fa0 0x5611bca77390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.645+0000 7f6111c31b80 4 client.17127 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:46:13.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.645+0000 7f6111c31b80 1 -- 172.21.15.70:0/3557438287 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611bca28230 con 0x5611bca74fa0 2024-05-08T07:46:13.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.646+0000 7f60ff400700 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5611bca74fa0 0x5611bca77390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.649+0000 7f60ea000700 10 client.17127 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:46:13.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.652+0000 7f60ff400700 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5611bca74fa0 0x5611bca77390 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87f9bd0999eed844 server_cookie=b2fb6231dfecbd3c in_seq=0 out_seq=0 2024-05-08T07:46:13.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.654+0000 7f60ea000700 1 -- 172.21.15.70:0/3557438287 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5611bca28230 con 0x5611bca74fa0 2024-05-08T07:46:13.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.654+0000 7f60ea000700 10 client.17127 handle_command_reply: tid=0 2024-05-08T07:46:13.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.654+0000 7f6111c31b80 1 client.17127 shutdown 2024-05-08T07:46:13.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f6111c31b80 1 -- 172.21.15.70:0/3557438287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5b520 msgr2=0x5611bca679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:13.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5b520 0x5611bca679a0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f60f00aa940 tx=0x7f60f0022520 comp rx=0 tx=0).stop 2024-05-08T07:46:13.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f6111c31b80 1 -- 172.21.15.70:0/3557438287 shutdown_connections 2024-05-08T07:46:13.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5611bca74fa0 0x5611bca77390 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bca65280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5b520 0x5611bca679a0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f6111c31b80 1 --2- 172.21.15.70:0/3557438287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5bee0 0x5611bca64d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f6111c31b80 1 -- 172.21.15.70:0/3557438287 >> 172.21.15.70:0/3557438287 conn(0x5611bc989cf0 msgr2=0x5611bca508e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:46:13.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f60ea000700 0 client.17127 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:46:13.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.655+0000 7f6111c31b80 1 -- 172.21.15.70:0/3557438287 shutdown_connections 2024-05-08T07:46:13.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.656+0000 7f6111c31b80 1 -- 172.21.15.70:0/3557438287 wait complete. 2024-05-08T07:46:13.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.656+0000 7f6111c31b80 20 client.17127 trim_cache size 0 max 16384 2024-05-08T07:46:13.669 INFO:tasks.workunit.client.0.smithi070.stdout: CC security/device_cgroup.o 2024-05-08T07:46:13.681 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/sysfs/dir.o 2024-05-08T07:46:13.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.695+0000 7f6111c31b80 1 Processor -- start 2024-05-08T07:46:13.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.695+0000 7f6111c31b80 1 -- start start 2024-05-08T07:46:13.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.695+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.695+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca5f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.695+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bca7cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.695+0000 7f6111c31b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f61001b8260 con 0x5611bca5bee0 2024-05-08T07:46:13.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.695+0000 7f6111c31b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61001b5af0 con 0x5611bca60f50 2024-05-08T07:46:13.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.695+0000 7f6111c31b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f61001b3980 con 0x5611bca5b520 2024-05-08T07:46:13.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.696+0000 7f60ff400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca5f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.696+0000 7f60ff400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca5f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44694/0 (socket says 172.21.15.70:44694) 2024-05-08T07:46:13.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.696+0000 7f60ff400700 1 -- 172.21.15.70:0/2180041208 learned_addr learned my addr 172.21.15.70:0/2180041208 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:46:13.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.696+0000 7f60ffe00700 1 --2- 172.21.15.70:0/2180041208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.697+0000 7f6105200700 1 --2- 172.21.15.70:0/2180041208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bca7cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.697+0000 7f60ff400700 1 -- 172.21.15.70:0/2180041208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 msgr2=0x5611bca712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:46:13.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.697+0000 7f60ff400700 1 --2- 172.21.15.70:0/2180041208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca712a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.697+0000 7f60ff400700 1 -- 172.21.15.70:0/2180041208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 msgr2=0x5611bca7cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:46:13.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.697+0000 7f60ff400700 1 --2- 172.21.15.70:0/2180041208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bca7cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.697+0000 7f60ff400700 1 -- 172.21.15.70:0/2180041208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611bca52a10 con 0x5611bca5bee0 2024-05-08T07:46:13.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.697+0000 7f60ff400700 1 --2- 172.21.15.70:0/2180041208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca5f0e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x5611bca66310 tx=0x7f60ec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f22549a11742a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:46:13.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.698+0000 7f60f4c00700 1 -- 172.21.15.70:0/2180041208 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec027380 con 0x5611bca5bee0 2024-05-08T07:46:13.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.698+0000 7f60f4c00700 1 -- 172.21.15.70:0/2180041208 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60ec02c070 con 0x5611bca5bee0 2024-05-08T07:46:13.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.698+0000 7f60f4c00700 1 -- 172.21.15.70:0/2180041208 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec01ec10 con 0x5611bca5bee0 2024-05-08T07:46:13.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.699+0000 7f6111c31b80 1 -- 172.21.15.70:0/2180041208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 msgr2=0x5611bca5f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:13.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.699+0000 7f6111c31b80 1 --2- 172.21.15.70:0/2180041208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca5f0e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x5611bca66310 tx=0x7f60ec016000 comp rx=0 tx=0).stop 2024-05-08T07:46:13.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.699+0000 7f6111c31b80 1 -- 172.21.15.70:0/2180041208 shutdown_connections 2024-05-08T07:46:13.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.699+0000 7f6111c31b80 1 --2- 172.21.15.70:0/2180041208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bca7cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.699+0000 7f6111c31b80 1 --2- 172.21.15.70:0/2180041208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca712a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.699+0000 7f6111c31b80 1 --2- 172.21.15.70:0/2180041208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca5f0e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.699+0000 7f6111c31b80 1 -- 172.21.15.70:0/2180041208 >> 172.21.15.70:0/2180041208 conn(0x5611bc989cf0 msgr2=0x5611bca5e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:46:13.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.700+0000 7f6111c31b80 1 -- 172.21.15.70:0/2180041208 shutdown_connections 2024-05-08T07:46:13.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.700+0000 7f6111c31b80 1 -- 172.21.15.70:0/2180041208 wait complete. 2024-05-08T07:46:13.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.700+0000 7f6111c31b80 1 -- start start 2024-05-08T07:46:13.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.701+0000 7f6111c31b80 1 Processor -- start 2024-05-08T07:46:13.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca6a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca6ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f6111c31b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bcadf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f6111c31b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f61001b3fd0 con 0x5611bca5bee0 2024-05-08T07:46:13.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f6111c31b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f61001b5420 con 0x5611bca60f50 2024-05-08T07:46:13.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f6111c31b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f61001b4680 con 0x5611bca5b520 2024-05-08T07:46:13.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f6111c31b80 10 client.0 _ll_register_callbacks cb 0x5611bc954e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:46:13.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f60ffe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca6a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f60ffe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca6a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:39434/0 (socket says 172.21.15.70:39434) 2024-05-08T07:46:13.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f60ffe00700 1 -- 172.21.15.70:0/1842710214 learned_addr learned my addr 172.21.15.70:0/1842710214 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:46:13.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.702+0000 7f60ff400700 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca6ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.703+0000 7f6105200700 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bcadf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.703+0000 7f60ff400700 1 -- 172.21.15.70:0/1842710214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 msgr2=0x5611bca6a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:46:13.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.703+0000 7f60ff400700 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca6a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.703+0000 7f60ff400700 1 -- 172.21.15.70:0/1842710214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 msgr2=0x5611bcadf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:46:13.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.703+0000 7f60ff400700 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bcadf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:13.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.703+0000 7f60ff400700 1 -- 172.21.15.70:0/1842710214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611bcadfd60 con 0x5611bca5bee0 2024-05-08T07:46:13.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.704+0000 7f60ff400700 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca6ab30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x5611bca68400 tx=0x7f60ec010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6dd3a5b70e3148 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:46:13.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.704+0000 7f60ea000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:46:13.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.704+0000 7f60ea000700 1 -- 172.21.15.70:0/1842710214 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec01ea90 con 0x5611bca5bee0 2024-05-08T07:46:13.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.704+0000 7f60ea000700 1 -- 172.21.15.70:0/1842710214 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 9583+0+0 (secure 0 0 0) 0x7f60ec01ec30 con 0x5611bca5bee0 2024-05-08T07:46:13.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.704+0000 7f6111c31b80 1 -- 172.21.15.70:0/1842710214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60ec02c070 con 0x5611bca5bee0 2024-05-08T07:46:13.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.705+0000 7f60ea000700 1 -- 172.21.15.70:0/1842710214 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f60ec005040 con 0x5611bca5bee0 2024-05-08T07:46:13.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.705+0000 7f6111c31b80 10 client.17133 fetch_fsmap learned FSMap version 42 2024-05-08T07:46:13.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.705+0000 7f6111c31b80 1 -- 172.21.15.70:0/1842710214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5611bcae0f00 con 0x5611bca5bee0 2024-05-08T07:46:13.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.705+0000 7f60ea000700 1 -- 172.21.15.70:0/1842710214 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60ec02c070 con 0x5611bca5bee0 2024-05-08T07:46:13.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.706+0000 7f60ea000700 1 -- 172.21.15.70:0/1842710214 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f60ec027ce0 con 0x5611bca5bee0 2024-05-08T07:46:13.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.706+0000 7f6111c31b80 10 client.17133 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:46:13.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.706+0000 7f6111c31b80 10 client.17133 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:46:13.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.706+0000 7f6111c31b80 20 client.17133 populate_metadata read hostname 'smithi070' 2024-05-08T07:46:13.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.706+0000 7f6111c31b80 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5611bcae15a0 0x5611bcae39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:46:13.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.706+0000 7f6111c31b80 4 client.17133 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.8, "await_for": 42.0}] 2024-05-08T07:46:13.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.706+0000 7f6111c31b80 1 -- 172.21.15.70:0/1842710214 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 82.8, "await_for": 42.0}) -- 0x5611bc9bb590 con 0x5611bcae15a0 2024-05-08T07:46:13.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.707+0000 7f60ffe00700 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5611bcae15a0 0x5611bcae39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:46:13.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.708+0000 7f60ffe00700 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5611bcae15a0 0x5611bcae39c0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b001e642d9639a19 server_cookie=18e9e6866493d196 in_seq=0 out_seq=0 2024-05-08T07:46:13.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:13.708+0000 7f60ea000700 10 client.17133 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:46:13.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:13 smithi194 ceph-mon[33679]: pgmap v1897: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 442 KiB/s wr, 175 op/s 2024-05-08T07:46:13.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:13 smithi194 ceph-mon[33679]: osdmap e199: 12 total, 12 up, 12 in 2024-05-08T07:46:13.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:13 smithi172 ceph-mon[33377]: pgmap v1897: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 442 KiB/s wr, 175 op/s 2024-05-08T07:46:13.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:13 smithi172 ceph-mon[33377]: osdmap e199: 12 total, 12 up, 12 in 2024-05-08T07:46:14.368 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/cpuid-deps.o 2024-05-08T07:46:15.229 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/posix-clock.o 2024-05-08T07:46:15.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:15 smithi194 ceph-mon[33679]: pgmap v1899: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 229 KiB/s wr, 79 op/s 2024-05-08T07:46:15.821 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/hugetlb.o 2024-05-08T07:46:15.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:15 smithi070 ceph-mon[29591]: pgmap v1899: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 229 KiB/s wr, 79 op/s 2024-05-08T07:46:15.880 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/apic.o 2024-05-08T07:46:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:15 smithi172 ceph-mon[33377]: pgmap v1899: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 229 KiB/s wr, 79 op/s 2024-05-08T07:46:17.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:17 smithi194 ceph-mon[33679]: pgmap v1900: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 377 KiB/s wr, 78 op/s 2024-05-08T07:46:17.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:17 smithi070 ceph-mon[29591]: pgmap v1900: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 377 KiB/s wr, 78 op/s 2024-05-08T07:46:17.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:17 smithi172 ceph-mon[33377]: pgmap v1900: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 377 KiB/s wr, 78 op/s 2024-05-08T07:46:19.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:19 smithi194 ceph-mon[33679]: pgmap v1901: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 377 KiB/s wr, 78 op/s 2024-05-08T07:46:19.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:19 smithi070 ceph-mon[29591]: pgmap v1901: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 377 KiB/s wr, 78 op/s 2024-05-08T07:46:19.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:19 smithi172 ceph-mon[33377]: pgmap v1901: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 377 KiB/s wr, 78 op/s 2024-05-08T07:46:21.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:21 smithi194 ceph-mon[33679]: pgmap v1902: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 399 KiB/s wr, 162 op/s 2024-05-08T07:46:21.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:21 smithi070 ceph-mon[29591]: pgmap v1902: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 399 KiB/s wr, 162 op/s 2024-05-08T07:46:21.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:21 smithi172 ceph-mon[33377]: pgmap v1902: 129 pgs: 129 active+clean; 1.8 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 399 KiB/s wr, 162 op/s 2024-05-08T07:46:23.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:23 smithi194 ceph-mon[33679]: pgmap v1903: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 380 KiB/s wr, 159 op/s 2024-05-08T07:46:23.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:23 smithi070 ceph-mon[29591]: pgmap v1903: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 380 KiB/s wr, 159 op/s 2024-05-08T07:46:23.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:23 smithi172 ceph-mon[33377]: pgmap v1903: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 380 KiB/s wr, 159 op/s 2024-05-08T07:46:25.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:25 smithi194 ceph-mon[33679]: pgmap v1904: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 346 KiB/s wr, 146 op/s 2024-05-08T07:46:25.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:25 smithi070 ceph-mon[29591]: pgmap v1904: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 346 KiB/s wr, 146 op/s 2024-05-08T07:46:25.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:25 smithi172 ceph-mon[33377]: pgmap v1904: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 346 KiB/s wr, 146 op/s 2024-05-08T07:46:27.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:27 smithi194 ceph-mon[33679]: pgmap v1905: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 317 KiB/s wr, 134 op/s 2024-05-08T07:46:27.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:27 smithi070 ceph-mon[29591]: pgmap v1905: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 317 KiB/s wr, 134 op/s 2024-05-08T07:46:27.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:27 smithi172 ceph-mon[33377]: pgmap v1905: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 317 KiB/s wr, 134 op/s 2024-05-08T07:46:29.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:29 smithi194 ceph-mon[33679]: pgmap v1906: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 153 KiB/s wr, 84 op/s 2024-05-08T07:46:29.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:29 smithi070 ceph-mon[29591]: pgmap v1906: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 153 KiB/s wr, 84 op/s 2024-05-08T07:46:29.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:29 smithi172 ceph-mon[33377]: pgmap v1906: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 153 KiB/s wr, 84 op/s 2024-05-08T07:46:31.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:31 smithi194 ceph-mon[33679]: pgmap v1907: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 203 KiB/s wr, 87 op/s 2024-05-08T07:46:31.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:31 smithi070 ceph-mon[29591]: pgmap v1907: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 203 KiB/s wr, 87 op/s 2024-05-08T07:46:31.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:31 smithi172 ceph-mon[33377]: pgmap v1907: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 203 KiB/s wr, 87 op/s 2024-05-08T07:46:33.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:33 smithi194 ceph-mon[33679]: pgmap v1908: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 56 KiB/s wr, 11 op/s 2024-05-08T07:46:33.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:33 smithi070 ceph-mon[29591]: pgmap v1908: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 56 KiB/s wr, 11 op/s 2024-05-08T07:46:33.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:33 smithi172 ceph-mon[33377]: pgmap v1908: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 56 KiB/s wr, 11 op/s 2024-05-08T07:46:35.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:35 smithi194 ceph-mon[33679]: pgmap v1909: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2024-05-08T07:46:35.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:35 smithi070 ceph-mon[29591]: pgmap v1909: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2024-05-08T07:46:35.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:35 smithi172 ceph-mon[33377]: pgmap v1909: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 9 op/s 2024-05-08T07:46:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.767+0000 7f60ea000700 1 -- 172.21.15.70:0/1842710214 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5611bc9bb590 con 0x5611bcae15a0 2024-05-08T07:46:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.767+0000 7f60ea000700 10 client.17133 handle_command_reply: tid=0 2024-05-08T07:46:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.767+0000 7f6111c31b80 1 client.17133 shutdown 2024-05-08T07:46:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.768+0000 7f6111c31b80 1 -- 172.21.15.70:0/1842710214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 msgr2=0x5611bca6ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:36.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.768+0000 7f6111c31b80 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca6ab30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x5611bca68400 tx=0x7f60ec010df0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.769+0000 7f6111c31b80 1 -- 172.21.15.70:0/1842710214 shutdown_connections 2024-05-08T07:46:36.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.769+0000 7f6111c31b80 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5611bcae15a0 0x5611bcae39c0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.769+0000 7f6111c31b80 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5611bca60f50 0x5611bcadf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.769+0000 7f6111c31b80 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5611bca5b520 0x5611bca6a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.769+0000 7f60ea000700 0 client.17133 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:46:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.769+0000 7f6111c31b80 1 --2- 172.21.15.70:0/1842710214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611bca5bee0 0x5611bca6ab30 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.769+0000 7f6111c31b80 1 -- 172.21.15.70:0/1842710214 >> 172.21.15.70:0/1842710214 conn(0x5611bc989cf0 msgr2=0x5611bca5f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:46:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.769+0000 7f6111c31b80 1 -- 172.21.15.70:0/1842710214 shutdown_connections 2024-05-08T07:46:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.770+0000 7f6111c31b80 1 -- 172.21.15.70:0/1842710214 wait complete. 2024-05-08T07:46:36.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.770+0000 7f6111c31b80 20 client.17133 trim_cache size 0 max 16384 2024-05-08T07:46:36.766 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:46:36.766 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 146, 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "6375b89c": { 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 146, 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 82.8, 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:46:36.767 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:46:36.768 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:46:36.768 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:46:36.768 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:46:36.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:46:36.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:46:36.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:46:36.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:46:36.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:46:36.768 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.771+0000 7f6107200700 1 -- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f60e40b2b20 msgr2=0x7f60e40b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.771+0000 7f6107200700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f60e40b2b20 0x7f60e40b4fe0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6100102020 tx=0x7f60ec007480 comp rx=0 tx=0).stop 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.771+0000 7f6107200700 1 -- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6100102ed0 msgr2=0x7f61001a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.771+0000 7f6107200700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6100102ed0 0x7f61001a1870 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f60f0006010 tx=0x7f60f00057a0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.772+0000 7f6107200700 1 -- 172.21.15.70:0/3462229762 shutdown_connections 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.772+0000 7f6107200700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f60e40b2b20 0x7f60e40b4fe0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.772+0000 7f6107200700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f610010ff50 0x7f610019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.772+0000 7f6107200700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6100102ed0 0x7f61001a1870 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.772+0000 7f6107200700 1 --2- 172.21.15.70:0/3462229762 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61001037f0 0x7f61001a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.772+0000 7f6107200700 1 -- 172.21.15.70:0/3462229762 >> 172.21.15.70:0/3462229762 conn(0x7f6100079340 msgr2=0x7f61001114c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:46:36.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.772+0000 7f6107200700 1 -- 172.21.15.70:0/3462229762 shutdown_connections 2024-05-08T07:46:36.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:46:36.772+0000 7f6107200700 1 -- 172.21.15.70:0/3462229762 wait complete. 2024-05-08T07:46:37.651 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6375b89c', quiesce took 37.9 seconds. Will release after: 22.8 2024-05-08T07:46:37.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:37 smithi070 ceph-mon[29591]: pgmap v1910: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 8 op/s 2024-05-08T07:46:37.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:37 smithi172 ceph-mon[33377]: pgmap v1910: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 8 op/s 2024-05-08T07:46:38.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:37 smithi194 ceph-mon[33679]: pgmap v1910: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 8 op/s 2024-05-08T07:46:39.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:39 smithi070 ceph-mon[29591]: pgmap v1911: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T07:46:39.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:39 smithi172 ceph-mon[33377]: pgmap v1911: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T07:46:40.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:39 smithi194 ceph-mon[33679]: pgmap v1911: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T07:46:41.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:41 smithi070 ceph-mon[29591]: pgmap v1912: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2024-05-08T07:46:41.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:41 smithi172 ceph-mon[33377]: pgmap v1912: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2024-05-08T07:46:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:41 smithi194 ceph-mon[33679]: pgmap v1912: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 71 KiB/s wr, 9 op/s 2024-05-08T07:46:43.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:43 smithi070 ceph-mon[29591]: pgmap v1913: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-05-08T07:46:43.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:43 smithi172 ceph-mon[33377]: pgmap v1913: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-05-08T07:46:44.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:43 smithi194 ceph-mon[33679]: pgmap v1913: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-05-08T07:46:45.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:45 smithi070 ceph-mon[29591]: pgmap v1914: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-05-08T07:46:45.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:45 smithi172 ceph-mon[33377]: pgmap v1914: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-05-08T07:46:46.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:45 smithi194 ceph-mon[33679]: pgmap v1914: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 40 KiB/s wr, 10 op/s 2024-05-08T07:46:47.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:47 smithi070 ceph-mon[29591]: pgmap v1915: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2024-05-08T07:46:47.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:47 smithi172 ceph-mon[33377]: pgmap v1915: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2024-05-08T07:46:48.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:47 smithi194 ceph-mon[33679]: pgmap v1915: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2024-05-08T07:46:48.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:46:48.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:46:49.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:46:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:49 smithi070 ceph-mon[29591]: pgmap v1916: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2024-05-08T07:46:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:46:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:46:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:46:49.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:49 smithi172 ceph-mon[33377]: pgmap v1916: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2024-05-08T07:46:49.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:46:49.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:46:49.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:46:50.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:49 smithi194 ceph-mon[33679]: pgmap v1916: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 KiB/s wr, 8 op/s 2024-05-08T07:46:50.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:46:50.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:46:50.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:46:51.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:51 smithi070 ceph-mon[29591]: pgmap v1917: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 77 KiB/s wr, 11 op/s 2024-05-08T07:46:51.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:51 smithi172 ceph-mon[33377]: pgmap v1917: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 77 KiB/s wr, 11 op/s 2024-05-08T07:46:52.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:51 smithi194 ceph-mon[33679]: pgmap v1917: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 77 KiB/s wr, 11 op/s 2024-05-08T07:46:53.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:53 smithi070 ceph-mon[29591]: pgmap v1918: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T07:46:53.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:53 smithi172 ceph-mon[33377]: pgmap v1918: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T07:46:54.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:53 smithi194 ceph-mon[33679]: pgmap v1918: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T07:46:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:55 smithi070 ceph-mon[29591]: pgmap v1919: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 56 KiB/s wr, 10 op/s 2024-05-08T07:46:55.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:55 smithi172 ceph-mon[33377]: pgmap v1919: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 56 KiB/s wr, 10 op/s 2024-05-08T07:46:56.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:55 smithi194 ceph-mon[33679]: pgmap v1919: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 56 KiB/s wr, 10 op/s 2024-05-08T07:46:57.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:57 smithi070 ceph-mon[29591]: pgmap v1920: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 5 op/s 2024-05-08T07:46:57.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:57 smithi172 ceph-mon[33377]: pgmap v1920: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 5 op/s 2024-05-08T07:46:58.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:57 smithi194 ceph-mon[33679]: pgmap v1920: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 5 op/s 2024-05-08T07:46:59.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:46:59 smithi070 ceph-mon[29591]: pgmap v1921: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 5 op/s 2024-05-08T07:46:59.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:46:59 smithi172 ceph-mon[33377]: pgmap v1921: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 5 op/s 2024-05-08T07:47:00.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:46:59 smithi194 ceph-mon[33679]: pgmap v1921: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 5 op/s 2024-05-08T07:47:00.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:47:00.973 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:47:01.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:01 smithi070 ceph-mon[29591]: pgmap v1922: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T07:47:01.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:01 smithi172 ceph-mon[33377]: pgmap v1922: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T07:47:02.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:01 smithi194 ceph-mon[33679]: pgmap v1922: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T07:47:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.328+0000 7f3168a00700 1 -- 172.21.15.70:0/1940426292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31641056c0 msgr2=0x7f3164105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.328+0000 7f3168a00700 1 --2- 172.21.15.70:0/1940426292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31641056c0 0x7f3164105b40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f3150009990 tx=0x7f3150009ca0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.328+0000 7f3168a00700 1 -- 172.21.15.70:0/1940426292 shutdown_connections 2024-05-08T07:47:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.328+0000 7f3168a00700 1 --2- 172.21.15.70:0/1940426292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3164106080 0x7f3164112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.328+0000 7f3168a00700 1 --2- 172.21.15.70:0/1940426292 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f316410b6c0 0x7f316410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.328+0000 7f3168a00700 1 --2- 172.21.15.70:0/1940426292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31641056c0 0x7f3164105b40 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.328+0000 7f3168a00700 1 -- 172.21.15.70:0/1940426292 >> 172.21.15.70:0/1940426292 conn(0x7f31641011b0 msgr2=0x7f31641035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:03.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.328+0000 7f3168a00700 1 -- 172.21.15.70:0/1940426292 shutdown_connections 2024-05-08T07:47:03.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.328+0000 7f3168a00700 1 -- 172.21.15.70:0/1940426292 wait complete. 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.329+0000 7f3168a00700 1 Processor -- start 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.329+0000 7f3168a00700 1 -- start start 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3168a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31641056c0 0x7f31641a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3168a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3164106080 0x7f31641a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3168a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316410b6c0 0x7f316419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3168a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3164115770 con 0x7f3164106080 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3168a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31641155f0 con 0x7f31641056c0 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3168a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31641158f0 con 0x7f316410b6c0 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3161400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3164106080 0x7f31641a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3161400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3164106080 0x7f31641a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59514/0 (socket says 172.21.15.70:59514) 2024-05-08T07:47:03.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3161400700 1 -- 172.21.15.70:0/538406544 learned_addr learned my addr 172.21.15.70:0/538406544 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.330+0000 7f3161e00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31641056c0 0x7f31641a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.331+0000 7f3162800700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316410b6c0 0x7f316419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.331+0000 7f3161400700 1 -- 172.21.15.70:0/538406544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316410b6c0 msgr2=0x7f316419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.331+0000 7f3161400700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316410b6c0 0x7f316419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.331+0000 7f3161400700 1 -- 172.21.15.70:0/538406544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31641056c0 msgr2=0x7f31641a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.331+0000 7f3161400700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31641056c0 0x7f31641a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.331+0000 7f3161400700 1 -- 172.21.15.70:0/538406544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316419c230 con 0x7f3164106080 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.331+0000 7f3161400700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3164106080 0x7f31641a1e50 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f31500057c0 tx=0x7f3150009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.331+0000 7f315aa00700 1 -- 172.21.15.70:0/538406544 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150027070 con 0x7f3164106080 2024-05-08T07:47:03.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.332+0000 7f315aa00700 1 -- 172.21.15.70:0/538406544 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f315000fda0 con 0x7f3164106080 2024-05-08T07:47:03.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.332+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316419c4c0 con 0x7f3164106080 2024-05-08T07:47:03.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.332+0000 7f315aa00700 1 -- 172.21.15.70:0/538406544 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3150022ca0 con 0x7f3164106080 2024-05-08T07:47:03.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.332+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31641a87e0 con 0x7f3164106080 2024-05-08T07:47:03.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.333+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316406a190 con 0x7f3164106080 2024-05-08T07:47:03.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.338+0000 7f315aa00700 1 -- 172.21.15.70:0/538406544 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f315002a070 con 0x7f3164106080 2024-05-08T07:47:03.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.340+0000 7f315aa00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31480b29f0 0x7f31480b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.340+0000 7f315aa00700 1 -- 172.21.15.70:0/538406544 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 9583+0+0 (secure 0 0 0) 0x7f31500e3b20 con 0x7f3164106080 2024-05-08T07:47:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.340+0000 7f3161e00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31480b29f0 0x7f31480b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:03.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.341+0000 7f3161e00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31480b29f0 0x7f31480b4eb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3154005950 tx=0x7f31540058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:03.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.342+0000 7f315aa00700 1 -- 172.21.15.70:0/538406544 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3150031080 con 0x7f3164106080 2024-05-08T07:47:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.650+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f316402e510 con 0x7f3164106080 2024-05-08T07:47:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.651+0000 7f315aa00700 1 -- 172.21.15.70:0/538406544 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f3150013070 con 0x7f3164106080 2024-05-08T07:47:03.650 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:47:03.650 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31480b29f0 msgr2=0x7f31480b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31480b29f0 0x7f31480b4eb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3154005950 tx=0x7f31540058e0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3164106080 msgr2=0x7f31641a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3164106080 0x7f31641a1e50 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f31500057c0 tx=0x7f3150009f90 comp rx=0 tx=0).stop 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 shutdown_connections 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31480b29f0 0x7f31480b4eb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f316410b6c0 0x7f316419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31641056c0 0x7f31641a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 --2- 172.21.15.70:0/538406544 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3164106080 0x7f31641a1e50 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:03.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 >> 172.21.15.70:0/538406544 conn(0x7f31641011b0 msgr2=0x7f31641018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:03.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 shutdown_connections 2024-05-08T07:47:03.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:03.654+0000 7f3168a00700 1 -- 172.21.15.70:0/538406544 wait complete. 2024-05-08T07:47:03.652 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:47:03.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:03 smithi070 ceph-mon[29591]: pgmap v1923: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T07:47:03.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:03 smithi172 ceph-mon[33377]: pgmap v1923: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T07:47:04.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:03 smithi194 ceph-mon[33679]: pgmap v1923: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T07:47:04.795 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:04 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/538406544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:47:04.865 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 6375b89c --release --await' 2024-05-08T07:47:04.865 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 6375b89c --release --await 2024-05-08T07:47:04.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:04 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/538406544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:47:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:04 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/538406544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:47:05.295 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:47:05.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:05 smithi070 ceph-mon[29591]: pgmap v1924: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 63 KiB/s wr, 24 op/s 2024-05-08T07:47:05.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:05 smithi172 ceph-mon[33377]: pgmap v1924: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 63 KiB/s wr, 24 op/s 2024-05-08T07:47:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:05 smithi194 ceph-mon[33679]: pgmap v1924: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 63 KiB/s wr, 24 op/s 2024-05-08T07:47:07.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.600+0000 7fe08c200700 1 -- 172.21.15.70:0/2989795325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe08410a490 msgr2=0x7fe0841169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:07.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.600+0000 7fe08c200700 1 --2- 172.21.15.70:0/2989795325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe08410a490 0x7fe0841169a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00b0a0 tx=0x7fe07c00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.600+0000 7fe08c200700 1 -- 172.21.15.70:0/2989795325 shutdown_connections 2024-05-08T07:47:07.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.600+0000 7fe08c200700 1 --2- 172.21.15.70:0/2989795325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe08410a490 0x7fe0841169a0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.600+0000 7fe08c200700 1 --2- 172.21.15.70:0/2989795325 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08410fb60 0x7fe08410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.600+0000 7fe08c200700 1 --2- 172.21.15.70:0/2989795325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe084109ad0 0x7fe084109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.600+0000 7fe08c200700 1 -- 172.21.15.70:0/2989795325 >> 172.21.15.70:0/2989795325 conn(0x7fe084076c70 msgr2=0x7fe0841082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:07.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.600+0000 7fe08c200700 1 -- 172.21.15.70:0/2989795325 shutdown_connections 2024-05-08T07:47:07.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.600+0000 7fe08c200700 1 -- 172.21.15.70:0/2989795325 wait complete. 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.601+0000 7fe08c200700 1 Processor -- start 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.602+0000 7fe08c200700 1 -- start start 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.602+0000 7fe08c200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe084109ad0 0x7fe0841a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.602+0000 7fe08c200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08410a490 0x7fe0841a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.602+0000 7fe08c200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08410fb60 0x7fe0841a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.602+0000 7fe08c200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe084119bd0 con 0x7fe084109ad0 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.602+0000 7fe08c200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe084119a50 con 0x7fe08410a490 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.602+0000 7fe08c200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe084119d50 con 0x7fe08410fb60 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.602+0000 7fe089800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe084109ad0 0x7fe0841a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe089800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe084109ad0 0x7fe0841a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44330/0 (socket says 172.21.15.70:44330) 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe089800700 1 -- 172.21.15.70:0/1763959812 learned_addr learned my addr 172.21.15.70:0/1763959812 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe088e00700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08410a490 0x7fe0841a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe08a200700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08410fb60 0x7fe0841a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe089800700 1 -- 172.21.15.70:0/1763959812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08410fb60 msgr2=0x7fe0841a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe089800700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08410fb60 0x7fe0841a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe089800700 1 -- 172.21.15.70:0/1763959812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08410a490 msgr2=0x7fe0841a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe089800700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08410a490 0x7fe0841a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe089800700 1 -- 172.21.15.70:0/1763959812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0841a5130 con 0x7fe084109ad0 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.603+0000 7fe089800700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe084109ad0 0x7fe0841a0120 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe07800d950 tx=0x7fe07800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.604+0000 7fe082000700 1 -- 172.21.15.70:0/1763959812 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078016070 con 0x7fe084109ad0 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.604+0000 7fe082000700 1 -- 172.21.15.70:0/1763959812 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe078010460 con 0x7fe084109ad0 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.604+0000 7fe08c200700 1 -- 172.21.15.70:0/1763959812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0841a5420 con 0x7fe084109ad0 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.604+0000 7fe082000700 1 -- 172.21.15.70:0/1763959812 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07800f620 con 0x7fe084109ad0 2024-05-08T07:47:07.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.604+0000 7fe08c200700 1 -- 172.21.15.70:0/1763959812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0841acca0 con 0x7fe084109ad0 2024-05-08T07:47:07.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.608+0000 7fe082000700 1 -- 172.21.15.70:0/1763959812 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe078019070 con 0x7fe084109ad0 2024-05-08T07:47:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.609+0000 7fe082000700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe06c0b2a70 0x7fe06c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.609+0000 7fe082000700 1 -- 172.21.15.70:0/1763959812 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(199..199 src has 1..199) ==== 9583+0+0 (secure 0 0 0) 0x7fe0780e25b0 con 0x7fe084109ad0 2024-05-08T07:47:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.609+0000 7fe088e00700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe06c0b2a70 0x7fe06c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.610+0000 7fe088e00700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe06c0b2a70 0x7fe06c0b4f30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe070005950 tx=0x7fe0700058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:07.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.629+0000 7fe096a8fb80 1 Processor -- start 2024-05-08T07:47:07.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.629+0000 7fe096a8fb80 1 -- start start 2024-05-08T07:47:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e15391b0 0x5654e1539590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1533c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1534140 0x5654e153ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5654e1485b20 con 0x5654e1533780 2024-05-08T07:47:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5654e1423860 con 0x5654e1534140 2024-05-08T07:47:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5654e1481ae0 con 0x5654e15391b0 2024-05-08T07:47:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe088e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1533c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe088e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1533c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44346/0 (socket says 172.21.15.70:44346) 2024-05-08T07:47:07.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe088e00700 1 -- 172.21.15.70:0/2860505664 learned_addr learned my addr 172.21.15.70:0/2860505664 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:47:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe089800700 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e15391b0 0x5654e1539590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.630+0000 7fe08a200700 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1534140 0x5654e153ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe088e00700 1 -- 172.21.15.70:0/2860505664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e15391b0 msgr2=0x5654e1539590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:47:07.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe088e00700 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e15391b0 0x5654e1539590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe088e00700 1 -- 172.21.15.70:0/2860505664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1534140 msgr2=0x5654e153ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:47:07.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe088e00700 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1534140 0x5654e153ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe088e00700 1 -- 172.21.15.70:0/2860505664 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654e13d29d0 con 0x5654e1533780 2024-05-08T07:47:07.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe08a200700 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1534140 0x5654e153ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:47:07.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe088e00700 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1533c00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe07000fd40 tx=0x7fe070012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b0336f5b414294 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:07.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe076a00700 1 -- 172.21.15.70:0/2860505664 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe070022070 con 0x5654e1533780 2024-05-08T07:47:07.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe076a00700 1 -- 172.21.15.70:0/2860505664 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe070011bb0 con 0x5654e1533780 2024-05-08T07:47:07.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.631+0000 7fe076a00700 1 -- 172.21.15.70:0/2860505664 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07001d5d0 con 0x5654e1533780 2024-05-08T07:47:07.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.632+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2860505664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 msgr2=0x5654e1533c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:07.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.632+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1533c00 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe07000fd40 tx=0x7fe070012000 comp rx=0 tx=0).stop 2024-05-08T07:47:07.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.632+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2860505664 shutdown_connections 2024-05-08T07:47:07.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.632+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1534140 0x5654e153ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.632+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e15391b0 0x5654e1539590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.632+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2860505664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1533c00 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.632+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2860505664 >> 172.21.15.70:0/2860505664 conn(0x5654e14ab7d0 msgr2=0x5654e152e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:07.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.633+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2860505664 shutdown_connections 2024-05-08T07:47:07.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.633+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2860505664 wait complete. 2024-05-08T07:47:07.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.633+0000 7fe096a8fb80 1 -- start start 2024-05-08T07:47:07.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe096a8fb80 1 Processor -- start 2024-05-08T07:47:07.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 0x5654e153fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e153cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e153d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5654e1540570 con 0x5654e15391b0 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5654e13ebc20 con 0x5654e1533780 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5654e15406f0 con 0x5654e1534140 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe096a8fb80 10 client.0 _ll_register_callbacks cb 0x5654e142cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe08a200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e153d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.634+0000 7fe08a200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e153d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44356/0 (socket says 172.21.15.70:44356) 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe08a200700 1 -- 172.21.15.70:0/2900612929 learned_addr learned my addr 172.21.15.70:0/2900612929 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe089800700 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 0x5654e153fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe088e00700 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e153cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe08a200700 1 -- 172.21.15.70:0/2900612929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 msgr2=0x5654e153cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:47:07.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe08a200700 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e153cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe08a200700 1 -- 172.21.15.70:0/2900612929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 msgr2=0x5654e153fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:47:07.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe08a200700 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 0x5654e153fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe08a200700 1 -- 172.21.15.70:0/2900612929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654e144b520 con 0x5654e15391b0 2024-05-08T07:47:07.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe08a200700 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e153d460 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe07c015000 tx=0x7fe07c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766b1c800a8d7eb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:07.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.635+0000 7fe06b400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:47:07.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.636+0000 7fe06b400700 1 -- 172.21.15.70:0/2900612929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0076e0 con 0x5654e15391b0 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.636+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2900612929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe070011bb0 con 0x5654e15391b0 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.636+0000 7fe06b400700 1 -- 172.21.15.70:0/2900612929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 9583+0+0 (secure 0 0 0) 0x7fe07c007880 con 0x5654e15391b0 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.636+0000 7fe06b400700 1 -- 172.21.15.70:0/2900612929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe07c02f050 con 0x5654e15391b0 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.636+0000 7fe096a8fb80 10 client.17151 fetch_fsmap learned FSMap version 42 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.636+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2900612929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5654e154adc0 con 0x5654e15391b0 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.636+0000 7fe06b400700 1 -- 172.21.15.70:0/2900612929 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe070011bb0 con 0x5654e15391b0 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.636+0000 7fe06b400700 1 -- 172.21.15.70:0/2900612929 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe07c011070 con 0x5654e15391b0 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.637+0000 7fe096a8fb80 10 client.17151 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.637+0000 7fe096a8fb80 10 client.17151 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.637+0000 7fe096a8fb80 20 client.17151 populate_metadata read hostname 'smithi070' 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.637+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5654e154d350 0x5654e154f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.637+0000 7fe096a8fb80 4 client.17151 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:47:07.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.637+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2900612929 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654e1500240 con 0x5654e154d350 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.637+0000 7fe089800700 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5654e154d350 0x5654e154f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.638+0000 7fe089800700 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5654e154d350 0x5654e154f790 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48df4096ce970059 server_cookie=827b495c4e2f99fa in_seq=0 out_seq=0 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.638+0000 7fe06b400700 10 client.17151 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.640+0000 7fe06b400700 1 -- 172.21.15.70:0/2900612929 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5654e1500240 con 0x5654e154d350 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.640+0000 7fe06b400700 10 client.17151 handle_command_reply: tid=0 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.640+0000 7fe096a8fb80 1 client.17151 shutdown 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.640+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2900612929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 msgr2=0x5654e153d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e153d460 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe07c015000 tx=0x7fe07c004d30 comp rx=0 tx=0).stop 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2900612929 shutdown_connections 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5654e154d350 0x5654e154f790 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e153d460 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 0x5654e153fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2900612929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e153cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2900612929 >> 172.21.15.70:0/2900612929 conn(0x5654e14ab7d0 msgr2=0x5654e1528b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:07.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe06b400700 0 client.17151 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:47:07.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2900612929 shutdown_connections 2024-05-08T07:47:07.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2900612929 wait complete. 2024-05-08T07:47:07.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.641+0000 7fe096a8fb80 20 client.17151 trim_cache size 0 max 16384 2024-05-08T07:47:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.663+0000 7fe096a8fb80 1 Processor -- start 2024-05-08T07:47:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.663+0000 7fe096a8fb80 1 -- start start 2024-05-08T07:47:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.663+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 0x5654e1549600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.663+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e1532de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.663+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e15388e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.663+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841b8500 con 0x5654e15391b0 2024-05-08T07:47:07.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.663+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841b5d90 con 0x5654e1533780 2024-05-08T07:47:07.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.663+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841b3c00 con 0x5654e1534140 2024-05-08T07:47:07.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe08a200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e15388e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe08a200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e15388e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44360/0 (socket says 172.21.15.70:44360) 2024-05-08T07:47:07.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe08a200700 1 -- 172.21.15.70:0/2628672065 learned_addr learned my addr 172.21.15.70:0/2628672065 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:47:07.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe088e00700 1 --2- 172.21.15.70:0/2628672065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e1532de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe089800700 1 --2- 172.21.15.70:0/2628672065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 0x5654e1549600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe08a200700 1 -- 172.21.15.70:0/2628672065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 msgr2=0x5654e1532de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:47:07.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe08a200700 1 --2- 172.21.15.70:0/2628672065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e1532de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe08a200700 1 -- 172.21.15.70:0/2628672065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 msgr2=0x5654e1549600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:47:07.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe08a200700 1 --2- 172.21.15.70:0/2628672065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 0x5654e1549600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.664+0000 7fe08a200700 1 -- 172.21.15.70:0/2628672065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654e154fe10 con 0x5654e15391b0 2024-05-08T07:47:07.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.665+0000 7fe08a200700 1 --2- 172.21.15.70:0/2628672065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e15388e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe07c004ed0 tx=0x7fe07c004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f22c9b5ad5831f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:07.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.665+0000 7fe076000700 1 -- 172.21.15.70:0/2628672065 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c038070 con 0x5654e15391b0 2024-05-08T07:47:07.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.665+0000 7fe076000700 1 -- 172.21.15.70:0/2628672065 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe07c01c410 con 0x5654e15391b0 2024-05-08T07:47:07.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.665+0000 7fe076000700 1 -- 172.21.15.70:0/2628672065 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c01c9c0 con 0x5654e15391b0 2024-05-08T07:47:07.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2628672065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 msgr2=0x5654e15388e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:07.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2628672065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e15388e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe07c004ed0 tx=0x7fe07c004f00 comp rx=0 tx=0).stop 2024-05-08T07:47:07.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2628672065 shutdown_connections 2024-05-08T07:47:07.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2628672065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e15391b0 0x5654e15388e0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2628672065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e1533780 0x5654e1549600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/2628672065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e1532de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2628672065 >> 172.21.15.70:0/2628672065 conn(0x5654e14ab7d0 msgr2=0x5654e1528b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:07.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2628672065 shutdown_connections 2024-05-08T07:47:07.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 -- 172.21.15.70:0/2628672065 wait complete. 2024-05-08T07:47:07.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.666+0000 7fe096a8fb80 1 -- start start 2024-05-08T07:47:07.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe096a8fb80 1 Processor -- start 2024-05-08T07:47:07.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1540910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e1540e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe096a8fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e15391b0 0x5654e1541390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841b4250 con 0x5654e1533780 2024-05-08T07:47:07.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841b56c0 con 0x5654e15391b0 2024-05-08T07:47:07.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe096a8fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841b4920 con 0x5654e1534140 2024-05-08T07:47:07.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe096a8fb80 10 client.0 _ll_register_callbacks cb 0x5654e142cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:47:07.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe089800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1540910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe089800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1540910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44362/0 (socket says 172.21.15.70:44362) 2024-05-08T07:47:07.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.667+0000 7fe089800700 1 -- 172.21.15.70:0/3429503550 learned_addr learned my addr 172.21.15.70:0/3429503550 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:47:07.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe088e00700 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e1540e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe08a200700 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e15391b0 0x5654e1541390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe089800700 1 -- 172.21.15.70:0/3429503550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 msgr2=0x5654e1540e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:47:07.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe089800700 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e1540e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe089800700 1 -- 172.21.15.70:0/3429503550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e15391b0 msgr2=0x5654e1541390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:47:07.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe089800700 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e15391b0 0x5654e1541390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:07.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe089800700 1 -- 172.21.15.70:0/3429503550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654e15b7d10 con 0x5654e1533780 2024-05-08T07:47:07.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe089800700 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1540910 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe0780a5490 tx=0x7fe0780a9060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec763a7dda1f271c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:07.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe06b400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:47:07.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe06b400700 1 -- 172.21.15.70:0/3429503550 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0780c3060 con 0x5654e1533780 2024-05-08T07:47:07.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe06b400700 1 -- 172.21.15.70:0/3429503550 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(199..199 src has 1..199) ==== 9583+0+0 (secure 0 0 0) 0x7fe0780a9670 con 0x5654e1533780 2024-05-08T07:47:07.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.668+0000 7fe096a8fb80 1 -- 172.21.15.70:0/3429503550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe07c01c410 con 0x5654e1533780 2024-05-08T07:47:07.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe06b400700 1 -- 172.21.15.70:0/3429503550 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe078014030 con 0x5654e1533780 2024-05-08T07:47:07.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe096a8fb80 10 client.17157 fetch_fsmap learned FSMap version 42 2024-05-08T07:47:07.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe096a8fb80 1 -- 172.21.15.70:0/3429503550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5654e15b9090 con 0x5654e1533780 2024-05-08T07:47:07.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe06b400700 1 -- 172.21.15.70:0/3429503550 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe07c01c410 con 0x5654e1533780 2024-05-08T07:47:07.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe06b400700 1 -- 172.21.15.70:0/3429503550 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe0780b1de0 con 0x5654e1533780 2024-05-08T07:47:07.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe096a8fb80 10 client.17157 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:47:07.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe096a8fb80 10 client.17157 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:47:07.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe096a8fb80 20 client.17157 populate_metadata read hostname 'smithi070' 2024-05-08T07:47:07.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5654e15b96d0 0x5654e15bbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:07.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe096a8fb80 4 client.17157 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6375b89c", "release": true, "await": true}] 2024-05-08T07:47:07.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.669+0000 7fe096a8fb80 1 -- 172.21.15.70:0/3429503550 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6375b89c", "release": true, "await": true}) -- 0x5654e1493500 con 0x5654e15b96d0 2024-05-08T07:47:07.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.670+0000 7fe088e00700 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5654e15b96d0 0x5654e15bbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:07.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.671+0000 7fe088e00700 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5654e15b96d0 0x5654e15bbaf0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=172c6fe0701891d1 server_cookie=95a98f6d076aa191 in_seq=0 out_seq=0 2024-05-08T07:47:07.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:07.671+0000 7fe06b400700 10 client.17157 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:47:07.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:07 smithi070 ceph-mon[29591]: pgmap v1925: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 63 KiB/s wr, 22 op/s 2024-05-08T07:47:07.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:07 smithi172 ceph-mon[33377]: pgmap v1925: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 63 KiB/s wr, 22 op/s 2024-05-08T07:47:08.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:07 smithi194 ceph-mon[33679]: pgmap v1925: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 63 KiB/s wr, 22 op/s 2024-05-08T07:47:09.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:09 smithi172 ceph-mon[33377]: pgmap v1926: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 63 KiB/s wr, 22 op/s 2024-05-08T07:47:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:09 smithi194 ceph-mon[33679]: pgmap v1926: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 63 KiB/s wr, 22 op/s 2024-05-08T07:47:10.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:09 smithi070 ceph-mon[29591]: pgmap v1926: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 63 KiB/s wr, 22 op/s 2024-05-08T07:47:11.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:11 smithi172 ceph-mon[33377]: pgmap v1927: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 27 op/s 2024-05-08T07:47:11.927 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:11 smithi070 ceph-mon[29591]: pgmap v1927: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 27 op/s 2024-05-08T07:47:12.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:11 smithi194 ceph-mon[33679]: pgmap v1927: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 27 op/s 2024-05-08T07:47:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.024+0000 7fe06b400700 1 -- 172.21.15.70:0/3429503550 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5654e1493500 con 0x5654e15b96d0 2024-05-08T07:47:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.024+0000 7fe06b400700 10 client.17157 handle_command_reply: tid=0 2024-05-08T07:47:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.024+0000 7fe096a8fb80 1 client.17157 shutdown 2024-05-08T07:47:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.024+0000 7fe096a8fb80 1 -- 172.21.15.70:0/3429503550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 msgr2=0x5654e1540910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:12.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.024+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1540910 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fe0780a5490 tx=0x7fe0780a9060 comp rx=0 tx=0).stop 2024-05-08T07:47:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.025+0000 7fe096a8fb80 1 -- 172.21.15.70:0/3429503550 shutdown_connections 2024-05-08T07:47:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.025+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5654e15b96d0 0x5654e15bbaf0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.025+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5654e15391b0 0x5654e1541390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.025+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5654e1533780 0x5654e1540910 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:12.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.025+0000 7fe096a8fb80 1 --2- 172.21.15.70:0/3429503550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5654e1534140 0x5654e1540e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.025+0000 7fe096a8fb80 1 -- 172.21.15.70:0/3429503550 >> 172.21.15.70:0/3429503550 conn(0x5654e14ab7d0 msgr2=0x5654e1536bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.025+0000 7fe06b400700 0 client.17157 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:47:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.026+0000 7fe096a8fb80 1 -- 172.21.15.70:0/3429503550 shutdown_connections 2024-05-08T07:47:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.026+0000 7fe096a8fb80 1 -- 172.21.15.70:0/3429503550 wait complete. 2024-05-08T07:47:12.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.026+0000 7fe096a8fb80 20 client.17157 trim_cache size 0 max 16384 2024-05-08T07:47:12.023 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:47:12.023 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:47:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:47:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 148, 2024-05-08T07:47:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:47:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: "6375b89c": { 2024-05-08T07:47:12.024 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 148, 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 82.8, 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:47:12.025 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:47:12.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:47:12.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:47:12.026 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:47:12.026 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 -- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe06c0b2a70 msgr2=0x7fe06c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe06c0b2a70 0x7fe06c0b4f30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe070005950 tx=0x7fe0700058e0 comp rx=0 tx=0).stop 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 -- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe084109ad0 msgr2=0x7fe0841a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe084109ad0 0x7fe0841a0120 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fe07800d950 tx=0x7fe07800dd10 comp rx=0 tx=0).stop 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 -- 172.21.15.70:0/1763959812 shutdown_connections 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe06c0b2a70 0x7fe06c0b4f30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08410fb60 0x7fe0841a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe084109ad0 0x7fe0841a0120 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 --2- 172.21.15.70:0/1763959812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe08410a490 0x7fe0841a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 -- 172.21.15.70:0/1763959812 >> 172.21.15.70:0/1763959812 conn(0x7fe084076c70 msgr2=0x7fe0840772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 -- 172.21.15.70:0/1763959812 shutdown_connections 2024-05-08T07:47:12.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:12.029+0000 7fe08c200700 1 -- 172.21.15.70:0/1763959812 wait complete. 2024-05-08T07:47:12.993 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6375b89c', seconds elapsed: 73.2 2024-05-08T07:47:13.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:13 smithi172 ceph-mon[33377]: pgmap v1928: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 66 KiB/s wr, 24 op/s 2024-05-08T07:47:13.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:13 smithi172 ceph-mon[33377]: osdmap e200: 12 total, 12 up, 12 in 2024-05-08T07:47:14.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:13 smithi194 ceph-mon[33679]: pgmap v1928: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 66 KiB/s wr, 24 op/s 2024-05-08T07:47:14.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:13 smithi194 ceph-mon[33679]: osdmap e200: 12 total, 12 up, 12 in 2024-05-08T07:47:14.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:13 smithi070 ceph-mon[29591]: pgmap v1928: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 66 KiB/s wr, 24 op/s 2024-05-08T07:47:14.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:13 smithi070 ceph-mon[29591]: osdmap e200: 12 total, 12 up, 12 in 2024-05-08T07:47:14.295 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/umwait.o 2024-05-08T07:47:14.473 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/cbc.o 2024-05-08T07:47:14.608 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/sysfs/symlink.o 2024-05-08T07:47:15.111 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/itimer.o 2024-05-08T07:47:15.231 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/hugetlb_vmemmap.o 2024-05-08T07:47:15.607 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/apic_common.o 2024-05-08T07:47:15.709 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/sysfs/mount.o 2024-05-08T07:47:15.831 INFO:tasks.workunit.client.0.smithi070.stdout: AR security/built-in.a 2024-05-08T07:47:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:15 smithi172 ceph-mon[33377]: pgmap v1930: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 156 KiB/s wr, 173 op/s 2024-05-08T07:47:16.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:15 smithi194 ceph-mon[33679]: pgmap v1930: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 156 KiB/s wr, 173 op/s 2024-05-08T07:47:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:15 smithi070 ceph-mon[29591]: pgmap v1930: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 156 KiB/s wr, 173 op/s 2024-05-08T07:47:17.137 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mempolicy.o 2024-05-08T07:47:17.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:17 smithi172 ceph-mon[33377]: pgmap v1931: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 156 KiB/s wr, 173 op/s 2024-05-08T07:47:18.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:17 smithi194 ceph-mon[33679]: pgmap v1931: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 156 KiB/s wr, 173 op/s 2024-05-08T07:47:18.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:17 smithi070 ceph-mon[29591]: pgmap v1931: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 156 KiB/s wr, 173 op/s 2024-05-08T07:47:19.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:19 smithi194 ceph-mon[33679]: pgmap v1932: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 156 KiB/s wr, 173 op/s 2024-05-08T07:47:19.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:19 smithi194 ceph-mon[33679]: osdmap e201: 12 total, 12 up, 12 in 2024-05-08T07:47:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:19 smithi070 ceph-mon[29591]: pgmap v1932: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 156 KiB/s wr, 173 op/s 2024-05-08T07:47:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:19 smithi070 ceph-mon[29591]: osdmap e201: 12 total, 12 up, 12 in 2024-05-08T07:47:19.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:19 smithi172 ceph-mon[33377]: pgmap v1932: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 156 KiB/s wr, 173 op/s 2024-05-08T07:47:19.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:19 smithi172 ceph-mon[33377]: osdmap e201: 12 total, 12 up, 12 in 2024-05-08T07:47:21.317 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/ctr.o 2024-05-08T07:47:21.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:21 smithi194 ceph-mon[33679]: pgmap v1934: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 453 KiB/s wr, 231 op/s 2024-05-08T07:47:21.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:21 smithi070 ceph-mon[29591]: pgmap v1934: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 453 KiB/s wr, 231 op/s 2024-05-08T07:47:21.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:21 smithi172 ceph-mon[33377]: pgmap v1934: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 453 KiB/s wr, 231 op/s 2024-05-08T07:47:22.335 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/apic_noop.o 2024-05-08T07:47:22.964 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/kprobes/core.o 2024-05-08T07:47:23.705 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/proc.o 2024-05-08T07:47:23.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:23 smithi194 ceph-mon[33679]: pgmap v1935: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 371 KiB/s wr, 189 op/s 2024-05-08T07:47:23.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:23 smithi070 ceph-mon[29591]: pgmap v1935: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 371 KiB/s wr, 189 op/s 2024-05-08T07:47:23.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:23 smithi172 ceph-mon[33377]: pgmap v1935: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 371 KiB/s wr, 189 op/s 2024-05-08T07:47:24.910 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/clockevents.o 2024-05-08T07:47:25.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:25 smithi070 ceph-mon[29591]: pgmap v1936: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 411 KiB/s wr, 124 op/s 2024-05-08T07:47:25.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:25 smithi194 ceph-mon[33679]: pgmap v1936: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 411 KiB/s wr, 124 op/s 2024-05-08T07:47:25.899 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/partitions/core.o 2024-05-08T07:47:25.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:25 smithi172 ceph-mon[33377]: pgmap v1936: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 411 KiB/s wr, 124 op/s 2024-05-08T07:47:26.006 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/sysfs/group.o 2024-05-08T07:47:26.736 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/ipi.o 2024-05-08T07:47:27.728 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:27 smithi172 ceph-mon[33377]: pgmap v1937: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 411 KiB/s wr, 124 op/s 2024-05-08T07:47:27.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:27 smithi194 ceph-mon[33679]: pgmap v1937: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 411 KiB/s wr, 124 op/s 2024-05-08T07:47:27.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:27 smithi070 ceph-mon[29591]: pgmap v1937: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 411 KiB/s wr, 124 op/s 2024-05-08T07:47:27.987 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/gcm.o 2024-05-08T07:47:28.974 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/sparse.o 2024-05-08T07:47:29.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:29 smithi194 ceph-mon[33679]: pgmap v1938: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 411 KiB/s wr, 124 op/s 2024-05-08T07:47:29.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:29 smithi070 ceph-mon[29591]: pgmap v1938: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 411 KiB/s wr, 124 op/s 2024-05-08T07:47:29.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:29 smithi172 ceph-mon[33377]: pgmap v1938: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 411 KiB/s wr, 124 op/s 2024-05-08T07:47:31.329 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/vector.o 2024-05-08T07:47:31.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:31 smithi194 ceph-mon[33679]: pgmap v1939: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 491 KiB/s wr, 132 op/s 2024-05-08T07:47:31.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:31 smithi070 ceph-mon[29591]: pgmap v1939: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 491 KiB/s wr, 132 op/s 2024-05-08T07:47:31.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:31 smithi172 ceph-mon[33377]: pgmap v1939: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 491 KiB/s wr, 132 op/s 2024-05-08T07:47:31.943 INFO:tasks.workunit.client.0.smithi070.stdout: MKCAP arch/x86/kernel/cpu/capflags.c 2024-05-08T07:47:32.003 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/tick-common.o 2024-05-08T07:47:32.687 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/kprobes/opt.o 2024-05-08T07:47:33.677 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/sysfs/built-in.a 2024-05-08T07:47:33.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:33 smithi194 ceph-mon[33679]: pgmap v1940: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 297 KiB/s wr, 117 op/s 2024-05-08T07:47:33.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:33 smithi070 ceph-mon[29591]: pgmap v1940: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 297 KiB/s wr, 117 op/s 2024-05-08T07:47:33.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:33 smithi172 ceph-mon[33377]: pgmap v1940: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 297 KiB/s wr, 117 op/s 2024-05-08T07:47:34.112 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/devpts/inode.o 2024-05-08T07:47:34.990 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/partitions/msdos.o 2024-05-08T07:47:35.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:35 smithi194 ceph-mon[33679]: pgmap v1941: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 485 KiB/s wr, 131 op/s 2024-05-08T07:47:35.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:35 smithi070 ceph-mon[29591]: pgmap v1941: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 485 KiB/s wr, 131 op/s 2024-05-08T07:47:35.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:35 smithi172 ceph-mon[33377]: pgmap v1941: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 485 KiB/s wr, 131 op/s 2024-05-08T07:47:37.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:37 smithi194 ceph-mon[33679]: pgmap v1942: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 336 KiB/s wr, 41 op/s 2024-05-08T07:47:37.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:37 smithi070 ceph-mon[29591]: pgmap v1942: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 336 KiB/s wr, 41 op/s 2024-05-08T07:47:37.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:37 smithi172 ceph-mon[33377]: pgmap v1942: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 336 KiB/s wr, 41 op/s 2024-05-08T07:47:39.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:39 smithi194 ceph-mon[33679]: pgmap v1943: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 336 KiB/s wr, 41 op/s 2024-05-08T07:47:39.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:39 smithi070 ceph-mon[29591]: pgmap v1943: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 336 KiB/s wr, 41 op/s 2024-05-08T07:47:39.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:39 smithi172 ceph-mon[33377]: pgmap v1943: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 336 KiB/s wr, 41 op/s 2024-05-08T07:47:41.303 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/ccm.o 2024-05-08T07:47:41.433 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/sparse-vmemmap.o 2024-05-08T07:47:41.635 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/tick-broadcast.o 2024-05-08T07:47:41.651 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/kernel/kprobes/built-in.a 2024-05-08T07:47:41.696 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/hw_nmi.o 2024-05-08T07:47:41.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:41 smithi070 ceph-mon[29591]: pgmap v1944: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 430 KiB/s wr, 50 op/s 2024-05-08T07:47:41.918 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/devpts/built-in.a 2024-05-08T07:47:41.923 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/partitions/efi.o 2024-05-08T07:47:41.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:41 smithi172 ceph-mon[33377]: pgmap v1944: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 430 KiB/s wr, 50 op/s 2024-05-08T07:47:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:41 smithi194 ceph-mon[33679]: pgmap v1944: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 430 KiB/s wr, 50 op/s 2024-05-08T07:47:42.455 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/netfs/buffered_read.o 2024-05-08T07:47:43.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:43 smithi070 ceph-mon[29591]: pgmap v1945: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 282 KiB/s wr, 22 op/s 2024-05-08T07:47:43.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:43 smithi172 ceph-mon[33377]: pgmap v1945: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 282 KiB/s wr, 22 op/s 2024-05-08T07:47:44.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:43 smithi194 ceph-mon[33679]: pgmap v1945: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 282 KiB/s wr, 22 op/s 2024-05-08T07:47:44.653 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/powerflags.o 2024-05-08T07:47:45.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:45 smithi070 ceph-mon[29591]: pgmap v1946: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 470 KiB/s wr, 179 op/s 2024-05-08T07:47:45.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:45 smithi172 ceph-mon[33377]: pgmap v1946: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 470 KiB/s wr, 179 op/s 2024-05-08T07:47:46.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:45 smithi194 ceph-mon[33679]: pgmap v1946: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 470 KiB/s wr, 179 op/s 2024-05-08T07:47:47.441 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/feat_ctl.o 2024-05-08T07:47:47.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:47 smithi070 ceph-mon[29591]: pgmap v1947: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 282 KiB/s wr, 165 op/s 2024-05-08T07:47:47.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:47 smithi172 ceph-mon[33377]: pgmap v1947: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 282 KiB/s wr, 165 op/s 2024-05-08T07:47:48.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:47 smithi194 ceph-mon[33679]: pgmap v1947: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 282 KiB/s wr, 165 op/s 2024-05-08T07:47:49.167 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/tick-broadcast-hrtimer.o 2024-05-08T07:47:49.391 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/balloc.o 2024-05-08T07:47:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:49 smithi070 ceph-mon[29591]: pgmap v1948: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 282 KiB/s wr, 165 op/s 2024-05-08T07:47:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:47:49.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:49 smithi172 ceph-mon[33377]: pgmap v1948: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 282 KiB/s wr, 165 op/s 2024-05-08T07:47:49.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:47:50.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:49 smithi194 ceph-mon[33679]: pgmap v1948: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 282 KiB/s wr, 165 op/s 2024-05-08T07:47:50.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:47:50.091 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/mmu_notifier.o 2024-05-08T07:47:50.162 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/aes_generic.o 2024-05-08T07:47:50.376 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/io_apic.o 2024-05-08T07:47:51.270 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/netfs/io.o 2024-05-08T07:47:51.480 INFO:tasks.workunit.client.0.smithi070.stdout: AR block/partitions/built-in.a 2024-05-08T07:47:51.720 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/bdev.o 2024-05-08T07:47:51.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:51 smithi070 ceph-mon[29591]: pgmap v1949: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 404 KiB/s wr, 177 op/s 2024-05-08T07:47:51.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:51.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:51.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:51 smithi172 ceph-mon[33377]: pgmap v1949: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 404 KiB/s wr, 177 op/s 2024-05-08T07:47:51.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:51.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:52.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:51 smithi194 ceph-mon[33679]: pgmap v1949: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 404 KiB/s wr, 177 op/s 2024-05-08T07:47:52.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:52.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:53.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:53.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:53.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:53 smithi070 ceph-mon[29591]: pgmap v1950: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 311 KiB/s wr, 168 op/s 2024-05-08T07:47:53.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:53.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:53.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:53 smithi172 ceph-mon[33377]: pgmap v1950: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 311 KiB/s wr, 168 op/s 2024-05-08T07:47:53.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:53.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:53.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:53 smithi194 ceph-mon[33679]: pgmap v1950: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 311 KiB/s wr, 168 op/s 2024-05-08T07:47:54.716 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/intel.o 2024-05-08T07:47:55.338 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-08T07:47:55.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:47:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:55 smithi070 ceph-mon[29591]: pgmap v1951: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 456 KiB/s wr, 179 op/s 2024-05-08T07:47:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:47:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:47:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:55.910 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:47:55.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:55 smithi172 ceph-mon[33377]: pgmap v1951: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 456 KiB/s wr, 179 op/s 2024-05-08T07:47:55.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:55.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:55.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:47:55.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:47:55.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:56.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:55 smithi194 ceph-mon[33679]: pgmap v1951: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 456 KiB/s wr, 179 op/s 2024-05-08T07:47:56.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:56.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:56.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:47:56.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:47:56.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:47:56.918 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/tick-oneshot.o 2024-05-08T07:47:57.054 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/crc32c_generic.o 2024-05-08T07:47:57.730 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:57 smithi070 ceph-mon[29591]: pgmap v1952: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 268 KiB/s wr, 22 op/s 2024-05-08T07:47:57.811 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:57 smithi194 ceph-mon[33679]: pgmap v1952: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 268 KiB/s wr, 22 op/s 2024-05-08T07:47:57.917 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/slub.o 2024-05-08T07:47:57.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:57 smithi172 ceph-mon[33377]: pgmap v1952: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 268 KiB/s wr, 22 op/s 2024-05-08T07:47:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.659+0000 7f795ea00700 1 -- 172.21.15.70:0/2967906826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7958103fc0 msgr2=0x7f7958108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.659+0000 7f795ea00700 1 --2- 172.21.15.70:0/2967906826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7958103fc0 0x7f7958108010 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f79440099c0 tx=0x7f7944009cd0 comp rx=0 tx=0).stop 2024-05-08T07:47:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.659+0000 7f795ea00700 1 -- 172.21.15.70:0/2967906826 shutdown_connections 2024-05-08T07:47:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.659+0000 7f795ea00700 1 --2- 172.21.15.70:0/2967906826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79581086f0 0x7f79581102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.659+0000 7f795ea00700 1 --2- 172.21.15.70:0/2967906826 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7958103610 0x7f79581039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.659+0000 7f795ea00700 1 --2- 172.21.15.70:0/2967906826 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7958103fc0 0x7f7958108010 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.659+0000 7f795ea00700 1 -- 172.21.15.70:0/2967906826 >> 172.21.15.70:0/2967906826 conn(0x7f79580feec0 msgr2=0x7f79581012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.659+0000 7f795ea00700 1 -- 172.21.15.70:0/2967906826 shutdown_connections 2024-05-08T07:47:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.659+0000 7f795ea00700 1 -- 172.21.15.70:0/2967906826 wait complete. 2024-05-08T07:47:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.661+0000 7f795ea00700 1 Processor -- start 2024-05-08T07:47:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.661+0000 7f795ea00700 1 -- start start 2024-05-08T07:47:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.661+0000 7f795ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7958103610 0x7f79581a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.662+0000 7f795ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7958103fc0 0x7f79581a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.662+0000 7f795ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79581086f0 0x7f795819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.662+0000 7f795ea00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f79581134b0 con 0x7f79581086f0 2024-05-08T07:47:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.662+0000 7f795ea00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7958113330 con 0x7f7958103610 2024-05-08T07:47:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.662+0000 7f795ea00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7958113630 con 0x7f7958103fc0 2024-05-08T07:47:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.662+0000 7f795d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7958103610 0x7f79581a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.662+0000 7f795d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7958103610 0x7f79581a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:59366/0 (socket says 172.21.15.70:59366) 2024-05-08T07:47:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.662+0000 7f795d600700 1 -- 172.21.15.70:0/4280703225 learned_addr learned my addr 172.21.15.70:0/4280703225 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:47:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.663+0000 7f795e000700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79581086f0 0x7f795819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.663+0000 7f795cc00700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7958103fc0 0x7f79581a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.663+0000 7f795d600700 1 -- 172.21.15.70:0/4280703225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7958103fc0 msgr2=0x7f79581a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.663+0000 7f795d600700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7958103fc0 0x7f79581a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.663+0000 7f795d600700 1 -- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79581086f0 msgr2=0x7f795819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.664+0000 7f795d600700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79581086f0 0x7f795819baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.664+0000 7f795d600700 1 -- 172.21.15.70:0/4280703225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795819c200 con 0x7f7958103610 2024-05-08T07:47:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.664+0000 7f795e000700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79581086f0 0x7f795819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:47:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.664+0000 7f795d600700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7958103610 0x7f79581a18e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f794c00e920 tx=0x7f794c00ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.665+0000 7f7956000700 1 -- 172.21.15.70:0/4280703225 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c00c9e0 con 0x7f7958103610 2024-05-08T07:47:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.665+0000 7f7956000700 1 -- 172.21.15.70:0/4280703225 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f794c00cb80 con 0x7f7958103610 2024-05-08T07:47:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.665+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795819c4f0 con 0x7f7958103610 2024-05-08T07:47:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.665+0000 7f7956000700 1 -- 172.21.15.70:0/4280703225 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c018420 con 0x7f7958103610 2024-05-08T07:47:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.665+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79581a87b0 con 0x7f7958103610 2024-05-08T07:47:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.668+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7938005330 con 0x7f7958103610 2024-05-08T07:47:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.672+0000 7f7956000700 1 -- 172.21.15.70:0/4280703225 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f794c049ae0 con 0x7f7958103610 2024-05-08T07:47:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.674+0000 7f7956000700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79400b2b80 0x7f79400b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:47:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.674+0000 7f7956000700 1 -- 172.21.15.70:0/4280703225 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(201..201 src has 1..201) ==== 9583+0+0 (secure 0 0 0) 0x7f794c0e2b70 con 0x7f7958103610 2024-05-08T07:47:58.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.674+0000 7f795cc00700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79400b2b80 0x7f79400b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:47:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.676+0000 7f795cc00700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79400b2b80 0x7f79400b5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7944000c00 tx=0x7f7944009e60 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:47:58.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:58.688+0000 7f7956000700 1 -- 172.21.15.70:0/4280703225 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f794c0aa1b0 con 0x7f7958103610 2024-05-08T07:47:59.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.184+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7938005620 con 0x7f7958103610 2024-05-08T07:47:59.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.186+0000 7f7956000700 1 -- 172.21.15.70:0/4280703225 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f794c0b2230 con 0x7f7958103610 2024-05-08T07:47:59.183 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:47:59.183 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:47:59.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79400b2b80 msgr2=0x7f79400b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:59.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79400b2b80 0x7f79400b5040 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7944000c00 tx=0x7f7944009e60 comp rx=0 tx=0).stop 2024-05-08T07:47:59.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7958103610 msgr2=0x7f79581a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:47:59.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7958103610 0x7f79581a18e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f794c00e920 tx=0x7f794c00ec30 comp rx=0 tx=0).stop 2024-05-08T07:47:59.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 shutdown_connections 2024-05-08T07:47:59.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79400b2b80 0x7f79400b5040 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:59.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f79581086f0 0x7f795819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:59.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7958103610 0x7f79581a18e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:59.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 --2- 172.21.15.70:0/4280703225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7958103fc0 0x7f79581a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:47:59.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.190+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 >> 172.21.15.70:0/4280703225 conn(0x7f79580feec0 msgr2=0x7f79581002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:47:59.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.191+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 shutdown_connections 2024-05-08T07:47:59.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:47:59.191+0000 7f795ea00700 1 -- 172.21.15.70:0/4280703225 wait complete. 2024-05-08T07:47:59.188 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:47:59.720 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:59 smithi070 ceph-mon[29591]: pgmap v1953: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 268 KiB/s wr, 22 op/s 2024-05-08T07:47:59.721 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:47:59 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4280703225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:47:59.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:59 smithi172 ceph-mon[33377]: pgmap v1953: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 268 KiB/s wr, 22 op/s 2024-05-08T07:47:59.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:47:59 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4280703225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:48:00.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:59 smithi194 ceph-mon[33679]: pgmap v1953: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 268 KiB/s wr, 22 op/s 2024-05-08T07:48:00.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:47:59 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4280703225' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:48:00.389 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-05-08T07:48:00.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-05-08T07:48:00.979 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:48:01.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:01 smithi070 ceph-mon[29591]: pgmap v1954: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 407 KiB/s wr, 34 op/s 2024-05-08T07:48:01.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:01 smithi172 ceph-mon[33377]: pgmap v1954: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 407 KiB/s wr, 34 op/s 2024-05-08T07:48:02.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:01 smithi194 ceph-mon[33679]: pgmap v1954: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 407 KiB/s wr, 34 op/s 2024-05-08T07:48:02.259 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/netfs/iterator.o 2024-05-08T07:48:02.860 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/bitmap.o 2024-05-08T07:48:03.166 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/msi.o 2024-05-08T07:48:03.872 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/fops.o 2024-05-08T07:48:03.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:03 smithi070 ceph-mon[29591]: pgmap v1955: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 284 KiB/s wr, 22 op/s 2024-05-08T07:48:03.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:03 smithi070 ceph-mon[29591]: osdmap e202: 12 total, 12 up, 12 in 2024-05-08T07:48:03.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:03 smithi172 ceph-mon[33377]: pgmap v1955: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 284 KiB/s wr, 22 op/s 2024-05-08T07:48:03.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:03 smithi172 ceph-mon[33377]: osdmap e202: 12 total, 12 up, 12 in 2024-05-08T07:48:04.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:03 smithi194 ceph-mon[33679]: pgmap v1955: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 284 KiB/s wr, 22 op/s 2024-05-08T07:48:04.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:03 smithi194 ceph-mon[33679]: osdmap e202: 12 total, 12 up, 12 in 2024-05-08T07:48:05.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:05 smithi070 ceph-mon[29591]: pgmap v1957: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 547 KiB/s wr, 274 op/s 2024-05-08T07:48:05.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:05 smithi172 ceph-mon[33377]: pgmap v1957: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 547 KiB/s wr, 274 op/s 2024-05-08T07:48:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:05 smithi194 ceph-mon[33679]: pgmap v1957: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 547 KiB/s wr, 274 op/s 2024-05-08T07:48:07.152 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/intel_pconfig.o 2024-05-08T07:48:07.610 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/authenc.o 2024-05-08T07:48:07.750 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/tick-sched.o 2024-05-08T07:48:07.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:07 smithi070 ceph-mon[29591]: pgmap v1958: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 547 KiB/s wr, 274 op/s 2024-05-08T07:48:07.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:07 smithi172 ceph-mon[33377]: pgmap v1958: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 547 KiB/s wr, 274 op/s 2024-05-08T07:48:08.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:07 smithi194 ceph-mon[33679]: pgmap v1958: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 547 KiB/s wr, 274 op/s 2024-05-08T07:48:09.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:09 smithi194 ceph-mon[33679]: pgmap v1959: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 547 KiB/s wr, 274 op/s 2024-05-08T07:48:09.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:09 smithi194 ceph-mon[33679]: osdmap e203: 12 total, 12 up, 12 in 2024-05-08T07:48:09.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.841+0000 7fac3d200700 1 -- 172.21.15.70:0/3285293648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac38107810 msgr2=0x7fac381124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:09.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.841+0000 7fac3d200700 1 --2- 172.21.15.70:0/3285293648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac38107810 0x7fac381124a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fac3000b0a0 tx=0x7fac3000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.838 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:09 smithi070 ceph-mon[29591]: pgmap v1959: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 547 KiB/s wr, 274 op/s 2024-05-08T07:48:09.838 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:09 smithi070 ceph-mon[29591]: osdmap e203: 12 total, 12 up, 12 in 2024-05-08T07:48:09.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.841+0000 7fac3d200700 1 -- 172.21.15.70:0/3285293648 shutdown_connections 2024-05-08T07:48:09.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.841+0000 7fac3d200700 1 --2- 172.21.15.70:0/3285293648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac38107810 0x7fac381124a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.841+0000 7fac3d200700 1 --2- 172.21.15.70:0/3285293648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38105840 0x7fac38105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.841+0000 7fac3d200700 1 --2- 172.21.15.70:0/3285293648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38106160 0x7fac381070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.841+0000 7fac3d200700 1 -- 172.21.15.70:0/3285293648 >> 172.21.15.70:0/3285293648 conn(0x7fac38100fb0 msgr2=0x7fac381033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:09.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.841+0000 7fac3d200700 1 -- 172.21.15.70:0/3285293648 shutdown_connections 2024-05-08T07:48:09.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.841+0000 7fac3d200700 1 -- 172.21.15.70:0/3285293648 wait complete. 2024-05-08T07:48:09.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.843+0000 7fac3d200700 1 Processor -- start 2024-05-08T07:48:09.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.843+0000 7fac3d200700 1 -- start start 2024-05-08T07:48:09.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.844+0000 7fac3d200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38105840 0x7fac381a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.844+0000 7fac3d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac38106160 0x7fac381a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.844+0000 7fac3d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38107810 0x7fac3819b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.844+0000 7fac3d200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fac381156e0 con 0x7fac38106160 2024-05-08T07:48:09.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.844+0000 7fac3d200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac38115560 con 0x7fac38107810 2024-05-08T07:48:09.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.844+0000 7fac3d200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fac38115860 con 0x7fac38105840 2024-05-08T07:48:09.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.845+0000 7fac36a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac38106160 0x7fac381a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.845+0000 7fac36a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac38106160 0x7fac381a1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43256/0 (socket says 172.21.15.70:43256) 2024-05-08T07:48:09.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.845+0000 7fac37e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38107810 0x7fac3819b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.845+0000 7fac36a00700 1 -- 172.21.15.70:0/2294062829 learned_addr learned my addr 172.21.15.70:0/2294062829 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:09.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.845+0000 7fac37400700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38105840 0x7fac381a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.846+0000 7fac37400700 1 -- 172.21.15.70:0/2294062829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38107810 msgr2=0x7fac3819b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:09.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.846+0000 7fac37400700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38107810 0x7fac3819b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.846+0000 7fac37400700 1 -- 172.21.15.70:0/2294062829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac38106160 msgr2=0x7fac381a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:09.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.846+0000 7fac37400700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac38106160 0x7fac381a1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.846+0000 7fac37400700 1 -- 172.21.15.70:0/2294062829 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3819c0a0 con 0x7fac38105840 2024-05-08T07:48:09.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.846+0000 7fac37400700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38105840 0x7fac381a1730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac2800e9f0 tx=0x7fac2800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:09.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.847+0000 7fac2fe00700 1 -- 172.21.15.70:0/2294062829 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28004220 con 0x7fac38105840 2024-05-08T07:48:09.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.847+0000 7fac3d200700 1 -- 172.21.15.70:0/2294062829 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3819c330 con 0x7fac38105840 2024-05-08T07:48:09.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.847+0000 7fac2fe00700 1 -- 172.21.15.70:0/2294062829 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac280043c0 con 0x7fac38105840 2024-05-08T07:48:09.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.847+0000 7fac2fe00700 1 -- 172.21.15.70:0/2294062829 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28005020 con 0x7fac38105840 2024-05-08T07:48:09.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.847+0000 7fac3d200700 1 -- 172.21.15.70:0/2294062829 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac381a8600 con 0x7fac38105840 2024-05-08T07:48:09.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.854+0000 7fac2fe00700 1 -- 172.21.15.70:0/2294062829 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fac28004750 con 0x7fac38105840 2024-05-08T07:48:09.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.856+0000 7fac2fe00700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fac1c0b2aa0 0x7fac1c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.856+0000 7fac2fe00700 1 -- 172.21.15.70:0/2294062829 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 9583+0+0 (secure 0 0 0) 0x7fac280e2990 con 0x7fac38105840 2024-05-08T07:48:09.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.856+0000 7fac36a00700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fac1c0b2aa0 0x7fac1c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.857+0000 7fac36a00700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fac1c0b2aa0 0x7fac1c0b4f60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fac24009680 tx=0x7fac24009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:09.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.872+0000 7fac49207b80 1 Processor -- start 2024-05-08T07:48:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.872+0000 7fac49207b80 1 -- start start 2024-05-08T07:48:09.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac49207b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b0623d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac49207b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b062910 0x562e0b05c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac49207b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b05cb40 0x562e0b05cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac49207b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e0afaebb0 con 0x562e0b062910 2024-05-08T07:48:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac49207b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e0af4c8f0 con 0x562e0b061ff0 2024-05-08T07:48:09.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac49207b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562e0afaab70 con 0x562e0b05cb40 2024-05-08T07:48:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac37400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b0623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac37400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b0623d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:39836/0 (socket says 172.21.15.70:39836) 2024-05-08T07:48:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac37400700 1 -- 172.21.15.70:0/2530026930 learned_addr learned my addr 172.21.15.70:0/2530026930 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.873+0000 7fac36a00700 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b062910 0x562e0b05c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.874+0000 7fac37e00700 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b05cb40 0x562e0b05cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.874+0000 7fac36a00700 1 -- 172.21.15.70:0/2530026930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b05cb40 msgr2=0x562e0b05cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.874+0000 7fac36a00700 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b05cb40 0x562e0b05cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.874+0000 7fac36a00700 1 -- 172.21.15.70:0/2530026930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 msgr2=0x562e0b0623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.874+0000 7fac36a00700 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b0623d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.874+0000 7fac36a00700 1 -- 172.21.15.70:0/2530026930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e0aefba60 con 0x562e0b062910 2024-05-08T07:48:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.875+0000 7fac37400700 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b0623d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:48:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.875+0000 7fac36a00700 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b062910 0x562e0b05c520 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fac381035c0 tx=0x7fac24014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5b4895288a4a1d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.876+0000 7fac2cc00700 1 -- 172.21.15.70:0/2530026930 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2400edd0 con 0x562e0b062910 2024-05-08T07:48:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.876+0000 7fac2cc00700 1 -- 172.21.15.70:0/2530026930 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac2401c8a0 con 0x562e0b062910 2024-05-08T07:48:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.876+0000 7fac2cc00700 1 -- 172.21.15.70:0/2530026930 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac2401d840 con 0x562e0b062910 2024-05-08T07:48:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.876+0000 7fac49207b80 1 -- 172.21.15.70:0/2530026930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b062910 msgr2=0x562e0b05c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.876+0000 7fac49207b80 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b062910 0x562e0b05c520 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fac381035c0 tx=0x7fac24014000 comp rx=0 tx=0).stop 2024-05-08T07:48:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.877+0000 7fac49207b80 1 -- 172.21.15.70:0/2530026930 shutdown_connections 2024-05-08T07:48:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.877+0000 7fac49207b80 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b05cb40 0x562e0b05cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.877+0000 7fac49207b80 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b0623d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.877+0000 7fac49207b80 1 --2- 172.21.15.70:0/2530026930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b062910 0x562e0b05c520 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.877+0000 7fac49207b80 1 -- 172.21.15.70:0/2530026930 >> 172.21.15.70:0/2530026930 conn(0x562e0af8acf0 msgr2=0x562e0b057080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.877+0000 7fac49207b80 1 -- 172.21.15.70:0/2530026930 shutdown_connections 2024-05-08T07:48:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.877+0000 7fac49207b80 1 -- 172.21.15.70:0/2530026930 wait complete. 2024-05-08T07:48:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.879+0000 7fac49207b80 1 -- start start 2024-05-08T07:48:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.879+0000 7fac49207b80 1 Processor -- start 2024-05-08T07:48:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.880+0000 7fac49207b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b068650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.880+0000 7fac49207b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b061ff0 0x562e0b065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.880+0000 7fac49207b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b062910 0x562e0b065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.880+0000 7fac49207b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e0b069430 con 0x562e0b05cb40 2024-05-08T07:48:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.880+0000 7fac49207b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e0af14cb0 con 0x562e0b062910 2024-05-08T07:48:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.880+0000 7fac49207b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562e0b0695b0 con 0x562e0b061ff0 2024-05-08T07:48:09.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.880+0000 7fac49207b80 10 client.0 _ll_register_callbacks cb 0x562e0af55e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:48:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.881+0000 7fac37400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b068650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.881+0000 7fac36a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b061ff0 0x562e0b065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.881+0000 7fac37400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b068650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43276/0 (socket says 172.21.15.70:43276) 2024-05-08T07:48:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.881+0000 7fac37400700 1 -- 172.21.15.70:0/4032734236 learned_addr learned my addr 172.21.15.70:0/4032734236 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:09.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.881+0000 7fac37e00700 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b062910 0x562e0b065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.881+0000 7fac37400700 1 -- 172.21.15.70:0/4032734236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b061ff0 msgr2=0x562e0b065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.881+0000 7fac37400700 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b061ff0 0x562e0b065ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.881+0000 7fac37400700 1 -- 172.21.15.70:0/4032734236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b062910 msgr2=0x562e0b065ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.881+0000 7fac37400700 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b062910 0x562e0b065ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.882+0000 7fac37400700 1 -- 172.21.15.70:0/4032734236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e0af745b0 con 0x562e0b05cb40 2024-05-08T07:48:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.882+0000 7fac37400700 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b068650 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fac280a6ac0 tx=0x7fac280cc2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65bfacba7f05fc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.882+0000 7fac21600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:48:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.883+0000 7fac21600700 1 -- 172.21.15.70:0/4032734236 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac280c3060 con 0x562e0b05cb40 2024-05-08T07:48:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.883+0000 7fac21600700 1 -- 172.21.15.70:0/4032734236 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(203..203 src has 1..203) ==== 9583+0+0 (secure 0 0 0) 0x7fac280a9cc0 con 0x562e0b05cb40 2024-05-08T07:48:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.883+0000 7fac49207b80 1 -- 172.21.15.70:0/4032734236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac2401c8a0 con 0x562e0b05cb40 2024-05-08T07:48:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.883+0000 7fac21600700 1 -- 172.21.15.70:0/4032734236 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fac2801c040 con 0x562e0b05cb40 2024-05-08T07:48:09.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.883+0000 7fac49207b80 10 client.17175 fetch_fsmap learned FSMap version 42 2024-05-08T07:48:09.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.883+0000 7fac49207b80 1 -- 172.21.15.70:0/4032734236 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562e0b073da0 con 0x562e0b05cb40 2024-05-08T07:48:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.884+0000 7fac21600700 1 -- 172.21.15.70:0/4032734236 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac2401c8a0 con 0x562e0b05cb40 2024-05-08T07:48:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.884+0000 7fac21600700 1 -- 172.21.15.70:0/4032734236 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fac280b2220 con 0x562e0b05cb40 2024-05-08T07:48:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.884+0000 7fac49207b80 10 client.17175 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:48:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.884+0000 7fac49207b80 10 client.17175 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:48:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.884+0000 7fac49207b80 20 client.17175 populate_metadata read hostname 'smithi070' 2024-05-08T07:48:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.885+0000 7fac49207b80 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e0b0763e0 0x562e0b0787d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.885+0000 7fac49207b80 4 client.17175 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:48:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.885+0000 7fac49207b80 1 -- 172.21.15.70:0/4032734236 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e0b029230 con 0x562e0b0763e0 2024-05-08T07:48:09.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.885+0000 7fac36a00700 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e0b0763e0 0x562e0b0787d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.886+0000 7fac36a00700 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e0b0763e0 0x562e0b0787d0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8234eb6937c51874 server_cookie=739b9a730b053d12 in_seq=0 out_seq=0 2024-05-08T07:48:09.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.886+0000 7fac21600700 10 client.17175 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:48:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.889+0000 7fac21600700 1 -- 172.21.15.70:0/4032734236 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562e0b029230 con 0x562e0b0763e0 2024-05-08T07:48:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.889+0000 7fac21600700 10 client.17175 handle_command_reply: tid=0 2024-05-08T07:48:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.889+0000 7fac49207b80 1 client.17175 shutdown 2024-05-08T07:48:09.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.890+0000 7fac49207b80 1 -- 172.21.15.70:0/4032734236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 msgr2=0x562e0b068650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.890+0000 7fac49207b80 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b068650 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fac280a6ac0 tx=0x7fac280cc2d0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.890+0000 7fac49207b80 1 -- 172.21.15.70:0/4032734236 shutdown_connections 2024-05-08T07:48:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.890+0000 7fac49207b80 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e0b0763e0 0x562e0b0787d0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.890+0000 7fac49207b80 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b062910 0x562e0b065ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.890+0000 7fac49207b80 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b068650 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.890+0000 7fac49207b80 1 --2- 172.21.15.70:0/4032734236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b061ff0 0x562e0b065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.890+0000 7fac21600700 0 client.17175 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:48:09.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.890+0000 7fac49207b80 1 -- 172.21.15.70:0/4032734236 >> 172.21.15.70:0/4032734236 conn(0x562e0af8acf0 msgr2=0x562e0b05b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:09.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.891+0000 7fac49207b80 1 -- 172.21.15.70:0/4032734236 shutdown_connections 2024-05-08T07:48:09.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.891+0000 7fac49207b80 1 -- 172.21.15.70:0/4032734236 wait complete. 2024-05-08T07:48:09.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.891+0000 7fac49207b80 20 client.17175 trim_cache size 0 max 16384 2024-05-08T07:48:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.927+0000 7fac49207b80 1 Processor -- start 2024-05-08T07:48:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.927+0000 7fac49207b80 1 -- start start 2024-05-08T07:48:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.928+0000 7fac49207b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b05cb40 0x562e0b0724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.928+0000 7fac49207b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b061ff0 0x562e0b07e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.928+0000 7fac49207b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b07e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.928+0000 7fac49207b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fac381b3de0 con 0x562e0b061ff0 2024-05-08T07:48:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.928+0000 7fac49207b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac381b1670 con 0x562e0b05cb40 2024-05-08T07:48:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.928+0000 7fac49207b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fac381af4e0 con 0x562e0b062910 2024-05-08T07:48:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.928+0000 7fac37e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b07e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.928+0000 7fac37e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b07e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:45332/0 (socket says 172.21.15.70:45332) 2024-05-08T07:48:09.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.928+0000 7fac37e00700 1 -- 172.21.15.70:0/924457161 learned_addr learned my addr 172.21.15.70:0/924457161 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.929+0000 7fac37e00700 1 -- 172.21.15.70:0/924457161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b05cb40 msgr2=0x562e0b0724c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T07:48:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.929+0000 7fac37e00700 1 --2- 172.21.15.70:0/924457161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b05cb40 0x562e0b0724c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.929+0000 7fac37e00700 1 -- 172.21.15.70:0/924457161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b061ff0 msgr2=0x562e0b07e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.929+0000 7fac37e00700 1 --2- 172.21.15.70:0/924457161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b061ff0 0x562e0b07e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.929+0000 7fac37e00700 1 -- 172.21.15.70:0/924457161 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e0b064020 con 0x562e0b062910 2024-05-08T07:48:09.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:09 smithi172 ceph-mon[33377]: pgmap v1959: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 547 KiB/s wr, 274 op/s 2024-05-08T07:48:09.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:09 smithi172 ceph-mon[33377]: osdmap e203: 12 total, 12 up, 12 in 2024-05-08T07:48:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.930+0000 7fac37e00700 1 --2- 172.21.15.70:0/924457161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b07e5c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac30015000 tx=0x7fac30009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=245c4a003c8c0c98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.930+0000 7fac23e00700 1 -- 172.21.15.70:0/924457161 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3000bdb0 con 0x562e0b062910 2024-05-08T07:48:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.931+0000 7fac23e00700 1 -- 172.21.15.70:0/924457161 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac300074e0 con 0x562e0b062910 2024-05-08T07:48:09.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.931+0000 7fac23e00700 1 -- 172.21.15.70:0/924457161 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac300266c0 con 0x562e0b062910 2024-05-08T07:48:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.932+0000 7fac49207b80 1 -- 172.21.15.70:0/924457161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 msgr2=0x562e0b07e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.932+0000 7fac49207b80 1 --2- 172.21.15.70:0/924457161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b07e5c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac30015000 tx=0x7fac30009520 comp rx=0 tx=0).stop 2024-05-08T07:48:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.932+0000 7fac49207b80 1 -- 172.21.15.70:0/924457161 shutdown_connections 2024-05-08T07:48:09.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.932+0000 7fac49207b80 1 --2- 172.21.15.70:0/924457161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b07e5c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.932+0000 7fac49207b80 1 --2- 172.21.15.70:0/924457161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b05cb40 0x562e0b0724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.932+0000 7fac49207b80 1 --2- 172.21.15.70:0/924457161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b061ff0 0x562e0b07e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.932+0000 7fac49207b80 1 -- 172.21.15.70:0/924457161 >> 172.21.15.70:0/924457161 conn(0x562e0af8acf0 msgr2=0x562e0b05bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.932+0000 7fac49207b80 1 -- 172.21.15.70:0/924457161 shutdown_connections 2024-05-08T07:48:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.932+0000 7fac49207b80 1 -- 172.21.15.70:0/924457161 wait complete. 2024-05-08T07:48:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.933+0000 7fac49207b80 1 -- start start 2024-05-08T07:48:09.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.933+0000 7fac49207b80 1 Processor -- start 2024-05-08T07:48:09.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac49207b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b06d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac49207b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac49207b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b06df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac49207b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fac381afb30 con 0x562e0b05cb40 2024-05-08T07:48:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac49207b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fac381b0fa0 con 0x562e0b061ff0 2024-05-08T07:48:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac49207b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fac381b0200 con 0x562e0b062910 2024-05-08T07:48:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac49207b80 10 client.0 _ll_register_callbacks cb 0x562e0b060690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:48:09.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac36a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac37e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b06df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac37e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b06df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:45338/0 (socket says 172.21.15.70:45338) 2024-05-08T07:48:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.934+0000 7fac37e00700 1 -- 172.21.15.70:0/3133777311 learned_addr learned my addr 172.21.15.70:0/3133777311 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.935+0000 7fac37400700 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b06d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.935+0000 7fac37e00700 1 -- 172.21.15.70:0/3133777311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 msgr2=0x562e0b06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:09.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.935+0000 7fac37e00700 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b06d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.935+0000 7fac37e00700 1 -- 172.21.15.70:0/3133777311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 msgr2=0x562e0b06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.935+0000 7fac37e00700 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b06d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.935+0000 7fac37e00700 1 -- 172.21.15.70:0/3133777311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e0b0e94e0 con 0x562e0b062910 2024-05-08T07:48:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.935+0000 7fac37400700 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b06d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:48:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.936+0000 7fac37e00700 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b06df20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fac300062a0 tx=0x7fac30007970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df1acd6ab4e09745 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.936+0000 7fac21600700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T07:48:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.936+0000 7fac21600700 1 -- 172.21.15.70:0/3133777311 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30003e10 con 0x562e0b062910 2024-05-08T07:48:09.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.936+0000 7fac49207b80 1 -- 172.21.15.70:0/3133777311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac300074e0 con 0x562e0b062910 2024-05-08T07:48:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.936+0000 7fac21600700 1 -- 172.21.15.70:0/3133777311 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(203..203 src has 1..203) ==== 9583+0+0 (secure 0 0 0) 0x7fac30026480 con 0x562e0b062910 2024-05-08T07:48:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.937+0000 7fac21600700 1 -- 172.21.15.70:0/3133777311 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fac30026680 con 0x562e0b062910 2024-05-08T07:48:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.937+0000 7fac49207b80 10 client.26308 fetch_fsmap learned FSMap version 42 2024-05-08T07:48:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.937+0000 7fac49207b80 1 -- 172.21.15.70:0/3133777311 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562e0b0ea7c0 con 0x562e0b062910 2024-05-08T07:48:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.937+0000 7fac21600700 1 -- 172.21.15.70:0/3133777311 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac300074e0 con 0x562e0b062910 2024-05-08T07:48:09.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.937+0000 7fac21600700 1 -- 172.21.15.70:0/3133777311 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fac3002d030 con 0x562e0b062910 2024-05-08T07:48:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.938+0000 7fac49207b80 10 client.26308 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:48:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.938+0000 7fac49207b80 10 client.26308 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:48:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.938+0000 7fac49207b80 20 client.26308 populate_metadata read hostname 'smithi070' 2024-05-08T07:48:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.938+0000 7fac49207b80 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e0b0eae90 0x562e0b0ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.938+0000 7fac49207b80 4 client.26308 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-05-08T07:48:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.938+0000 7fac49207b80 1 -- 172.21.15.70:0/3133777311 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x562e0afbc590 con 0x562e0b0eae90 2024-05-08T07:48:09.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.939+0000 7fac37400700 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e0b0eae90 0x562e0b0ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:09.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.939+0000 7fac37400700 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e0b0eae90 0x562e0b0ed2b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29f291d8c0c0a068 server_cookie=9c05f80127a4e085 in_seq=0 out_seq=0 2024-05-08T07:48:09.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:09.940+0000 7fac21600700 10 client.26308 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:48:11.075 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/netfs/main.o 2024-05-08T07:48:11.136 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/migrate.o 2024-05-08T07:48:11.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:11 smithi070 ceph-mon[29591]: pgmap v1961: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 816 KiB/s wr, 467 op/s 2024-05-08T07:48:11.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:11 smithi194 ceph-mon[33679]: pgmap v1961: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 816 KiB/s wr, 467 op/s 2024-05-08T07:48:11.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:11 smithi172 ceph-mon[33377]: pgmap v1961: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 816 KiB/s wr, 467 op/s 2024-05-08T07:48:12.749 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/block_validity.o 2024-05-08T07:48:13.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:13 smithi194 ceph-mon[33679]: pgmap v1962: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 658 KiB/s wr, 377 op/s 2024-05-08T07:48:13.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:13 smithi070 ceph-mon[29591]: pgmap v1962: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 658 KiB/s wr, 377 op/s 2024-05-08T07:48:13.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:13 smithi172 ceph-mon[33377]: pgmap v1962: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 658 KiB/s wr, 377 op/s 2024-05-08T07:48:15.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:15 smithi194 ceph-mon[33679]: pgmap v1963: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 505 KiB/s wr, 132 op/s 2024-05-08T07:48:15.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:15 smithi070 ceph-mon[29591]: pgmap v1963: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 505 KiB/s wr, 132 op/s 2024-05-08T07:48:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:15 smithi172 ceph-mon[33377]: pgmap v1963: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 505 KiB/s wr, 132 op/s 2024-05-08T07:48:17.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:17 smithi194 ceph-mon[33679]: pgmap v1964: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 505 KiB/s wr, 132 op/s 2024-05-08T07:48:17.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:17 smithi070 ceph-mon[29591]: pgmap v1964: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 505 KiB/s wr, 132 op/s 2024-05-08T07:48:17.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:17 smithi172 ceph-mon[33377]: pgmap v1964: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 505 KiB/s wr, 132 op/s 2024-05-08T07:48:19.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:19 smithi070 ceph-mon[29591]: pgmap v1965: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 505 KiB/s wr, 132 op/s 2024-05-08T07:48:19.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:19 smithi172 ceph-mon[33377]: pgmap v1965: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 505 KiB/s wr, 132 op/s 2024-05-08T07:48:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:19 smithi194 ceph-mon[33679]: pgmap v1965: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 505 KiB/s wr, 132 op/s 2024-05-08T07:48:21.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:21 smithi070 ceph-mon[29591]: pgmap v1966: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 444 KiB/s wr, 115 op/s 2024-05-08T07:48:21.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:21 smithi172 ceph-mon[33377]: pgmap v1966: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 444 KiB/s wr, 115 op/s 2024-05-08T07:48:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:21 smithi194 ceph-mon[33679]: pgmap v1966: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 444 KiB/s wr, 115 op/s 2024-05-08T07:48:23.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:23 smithi070 ceph-mon[29591]: pgmap v1967: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 217 KiB/s wr, 20 op/s 2024-05-08T07:48:23.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:23 smithi172 ceph-mon[33377]: pgmap v1967: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 217 KiB/s wr, 20 op/s 2024-05-08T07:48:24.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:23 smithi194 ceph-mon[33679]: pgmap v1967: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 217 KiB/s wr, 20 op/s 2024-05-08T07:48:25.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:25 smithi070 ceph-mon[29591]: pgmap v1968: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 245 KiB/s wr, 24 op/s 2024-05-08T07:48:25.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:25 smithi172 ceph-mon[33377]: pgmap v1968: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 245 KiB/s wr, 24 op/s 2024-05-08T07:48:26.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:25 smithi194 ceph-mon[33679]: pgmap v1968: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 245 KiB/s wr, 24 op/s 2024-05-08T07:48:27.808 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:27 smithi194 ceph-mon[33679]: pgmap v1969: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-05-08T07:48:27.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:27 smithi070 ceph-mon[29591]: pgmap v1969: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-05-08T07:48:27.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:27 smithi172 ceph-mon[33377]: pgmap v1969: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-05-08T07:48:29.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:29 smithi070 ceph-mon[29591]: pgmap v1970: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-05-08T07:48:29.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:29 smithi172 ceph-mon[33377]: pgmap v1970: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-05-08T07:48:30.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:29 smithi194 ceph-mon[33679]: pgmap v1970: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 8 op/s 2024-05-08T07:48:31.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:31 smithi070 ceph-mon[29591]: pgmap v1971: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 74 KiB/s wr, 12 op/s 2024-05-08T07:48:31.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:31 smithi172 ceph-mon[33377]: pgmap v1971: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 74 KiB/s wr, 12 op/s 2024-05-08T07:48:32.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:31 smithi194 ceph-mon[33679]: pgmap v1971: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 74 KiB/s wr, 12 op/s 2024-05-08T07:48:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.131+0000 7fac21600700 1 -- 172.21.15.70:0/3133777311 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562e0afbc590 con 0x562e0b0eae90 2024-05-08T07:48:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.131+0000 7fac21600700 10 client.26308 handle_command_reply: tid=0 2024-05-08T07:48:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.131+0000 7fac49207b80 1 client.26308 shutdown 2024-05-08T07:48:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac49207b80 1 -- 172.21.15.70:0/3133777311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 msgr2=0x562e0b06df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac49207b80 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b06df20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fac300062a0 tx=0x7fac30007970 comp rx=0 tx=0).stop 2024-05-08T07:48:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac49207b80 1 -- 172.21.15.70:0/3133777311 shutdown_connections 2024-05-08T07:48:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac49207b80 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e0b0eae90 0x562e0b0ed2b0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac49207b80 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e0b062910 0x562e0b06df20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac49207b80 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e0b05cb40 0x562e0b06d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac49207b80 1 --2- 172.21.15.70:0/3133777311 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e0b061ff0 0x562e0b06d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac49207b80 1 -- 172.21.15.70:0/3133777311 >> 172.21.15.70:0/3133777311 conn(0x562e0af8acf0 msgr2=0x562e0b062d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac21600700 0 client.26308 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:48:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.132+0000 7fac49207b80 1 -- 172.21.15.70:0/3133777311 shutdown_connections 2024-05-08T07:48:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.133+0000 7fac49207b80 1 -- 172.21.15.70:0/3133777311 wait complete. 2024-05-08T07:48:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.133+0000 7fac49207b80 20 client.26308 trim_cache size 0 max 16384 2024-05-08T07:48:33.130 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:48:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:48:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:48:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 150, 2024-05-08T07:48:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:48:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "3982a7ce": { 2024-05-08T07:48:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 150, 2024-05-08T07:48:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:48:33.130 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:33.131 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:33.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:33.132 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:33.132 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:48:33.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.134+0000 7fac3d200700 1 -- 172.21.15.70:0/2294062829 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fac1c0b2aa0 msgr2=0x7fac1c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:33.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.134+0000 7fac3d200700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fac1c0b2aa0 0x7fac1c0b4f60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fac24009680 tx=0x7fac24009260 comp rx=0 tx=0).stop 2024-05-08T07:48:33.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.134+0000 7fac3d200700 1 -- 172.21.15.70:0/2294062829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38105840 msgr2=0x7fac381a1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:33.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.134+0000 7fac3d200700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38105840 0x7fac381a1730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fac2800e9f0 tx=0x7fac2800ed00 comp rx=0 tx=0).stop 2024-05-08T07:48:33.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.135+0000 7fac3d200700 1 -- 172.21.15.70:0/2294062829 shutdown_connections 2024-05-08T07:48:33.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.135+0000 7fac3d200700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fac1c0b2aa0 0x7fac1c0b4f60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:33.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.135+0000 7fac3d200700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fac38107810 0x7fac3819b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:33.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.135+0000 7fac3d200700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac38105840 0x7fac381a1730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:33.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.135+0000 7fac3d200700 1 --2- 172.21.15.70:0/2294062829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac38106160 0x7fac381a1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:33.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.135+0000 7fac3d200700 1 -- 172.21.15.70:0/2294062829 >> 172.21.15.70:0/2294062829 conn(0x7fac38100fb0 msgr2=0x7fac38101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:33.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.135+0000 7fac3d200700 1 -- 172.21.15.70:0/2294062829 shutdown_connections 2024-05-08T07:48:33.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:33.135+0000 7fac3d200700 1 -- 172.21.15.70:0/2294062829 wait complete. 2024-05-08T07:48:33.561 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:33 smithi070 ceph-mon[29591]: pgmap v1972: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2024-05-08T07:48:33.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:33 smithi172 ceph-mon[33377]: pgmap v1972: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2024-05-08T07:48:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:33 smithi194 ceph-mon[33679]: pgmap v1972: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 8 op/s 2024-05-08T07:48:34.099 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3982a7ce', quiesce took 38.8 seconds. Will release after: 10 2024-05-08T07:48:35.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:35 smithi070 ceph-mon[29591]: pgmap v1973: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-05-08T07:48:35.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:35 smithi172 ceph-mon[33377]: pgmap v1973: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-05-08T07:48:36.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:35 smithi194 ceph-mon[33679]: pgmap v1973: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-05-08T07:48:37.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:37 smithi070 ceph-mon[29591]: pgmap v1974: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T07:48:37.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:37 smithi172 ceph-mon[33377]: pgmap v1974: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T07:48:38.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:37 smithi194 ceph-mon[33679]: pgmap v1974: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T07:48:39.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:39 smithi070 ceph-mon[29591]: pgmap v1975: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T07:48:39.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:39 smithi172 ceph-mon[33377]: pgmap v1975: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T07:48:40.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:39 smithi194 ceph-mon[33679]: pgmap v1975: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T07:48:41.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:41 smithi070 ceph-mon[29591]: pgmap v1976: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-05-08T07:48:41.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:41 smithi172 ceph-mon[33377]: pgmap v1976: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-05-08T07:48:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:41 smithi194 ceph-mon[33679]: pgmap v1976: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 58 KiB/s wr, 11 op/s 2024-05-08T07:48:43.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:43 smithi070 ceph-mon[29591]: pgmap v1977: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 6 op/s 2024-05-08T07:48:43.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:43 smithi172 ceph-mon[33377]: pgmap v1977: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 6 op/s 2024-05-08T07:48:44.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:43 smithi194 ceph-mon[33679]: pgmap v1977: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 6 op/s 2024-05-08T07:48:44.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:48:44.552 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:48:45.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:45 smithi070 ceph-mon[29591]: pgmap v1978: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-05-08T07:48:45.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:45 smithi172 ceph-mon[33377]: pgmap v1978: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-05-08T07:48:46.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:45 smithi194 ceph-mon[33679]: pgmap v1978: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-05-08T07:48:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.867+0000 7f13c0c00700 1 -- 172.21.15.70:0/1687150565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc104100 msgr2=0x7f13bc108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.867+0000 7f13c0c00700 1 --2- 172.21.15.70:0/1687150565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc104100 0x7f13bc108120 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f13a80099c0 tx=0x7f13a8009cd0 comp rx=0 tx=0).stop 2024-05-08T07:48:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.867+0000 7f13c0c00700 1 -- 172.21.15.70:0/1687150565 shutdown_connections 2024-05-08T07:48:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.867+0000 7f13c0c00700 1 --2- 172.21.15.70:0/1687150565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13bc108850 0x7f13bc1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.867+0000 7f13c0c00700 1 --2- 172.21.15.70:0/1687150565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13bc103750 0x7f13bc103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.867+0000 7f13c0c00700 1 --2- 172.21.15.70:0/1687150565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc104100 0x7f13bc108120 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.867+0000 7f13c0c00700 1 -- 172.21.15.70:0/1687150565 >> 172.21.15.70:0/1687150565 conn(0x7f13bc07a600 msgr2=0x7f13bc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.867+0000 7f13c0c00700 1 -- 172.21.15.70:0/1687150565 shutdown_connections 2024-05-08T07:48:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.867+0000 7f13c0c00700 1 -- 172.21.15.70:0/1687150565 wait complete. 2024-05-08T07:48:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.869+0000 7f13c0c00700 1 Processor -- start 2024-05-08T07:48:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.869+0000 7f13c0c00700 1 -- start start 2024-05-08T07:48:46.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13c0c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc103750 0x7f13bc19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:46.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13c0c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13bc104100 0x7f13bc19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:46.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13c0c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13bc108850 0x7f13bc199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:46.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13c0c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc113590 con 0x7f13bc103750 2024-05-08T07:48:46.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13c0c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc113410 con 0x7f13bc108850 2024-05-08T07:48:46.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13c0c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc113710 con 0x7f13bc104100 2024-05-08T07:48:46.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc103750 0x7f13bc19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:46.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc103750 0x7f13bc19f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57710/0 (socket says 172.21.15.70:57710) 2024-05-08T07:48:46.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13b9e00700 1 -- 172.21.15.70:0/2129318912 learned_addr learned my addr 172.21.15.70:0/2129318912 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13b9400700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13bc104100 0x7f13bc19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.870+0000 7f13ba800700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13bc108850 0x7f13bc199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13b9e00700 1 -- 172.21.15.70:0/2129318912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13bc104100 msgr2=0x7f13bc19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13b9e00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13bc104100 0x7f13bc19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13b9e00700 1 -- 172.21.15.70:0/2129318912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13bc108850 msgr2=0x7f13bc199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:46.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13b9e00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13bc108850 0x7f13bc199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13b9e00700 1 -- 172.21.15.70:0/2129318912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13bc19a090 con 0x7f13bc103750 2024-05-08T07:48:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13b9e00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc103750 0x7f13bc19f770 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00b530 tx=0x7f13ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13b2a00700 1 -- 172.21.15.70:0/2129318912 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac015020 con 0x7f13bc103750 2024-05-08T07:48:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13b2a00700 1 -- 172.21.15.70:0/2129318912 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13ac011cc0 con 0x7f13bc103750 2024-05-08T07:48:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc19a380 con 0x7f13bc103750 2024-05-08T07:48:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13b2a00700 1 -- 172.21.15.70:0/2129318912 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ac010d30 con 0x7f13bc103750 2024-05-08T07:48:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.871+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc1a6640 con 0x7f13bc103750 2024-05-08T07:48:46.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.873+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc10ba90 con 0x7f13bc103750 2024-05-08T07:48:46.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.875+0000 7f13b2a00700 1 -- 172.21.15.70:0/2129318912 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f13ac018020 con 0x7f13bc103750 2024-05-08T07:48:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.876+0000 7f13b2a00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13a00b29f0 0x7f13a00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.877+0000 7f13b2a00700 1 -- 172.21.15.70:0/2129318912 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 9583+0+0 (secure 0 0 0) 0x7f13ac0e21d0 con 0x7f13bc103750 2024-05-08T07:48:46.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.877+0000 7f13b9400700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13a00b29f0 0x7f13a00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:46.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.878+0000 7f13b9400700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13a00b29f0 0x7f13a00b4eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13a8000c00 tx=0x7f13a801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:46.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:46.881+0000 7f13b2a00700 1 -- 172.21.15.70:0/2129318912 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f13ac01f020 con 0x7f13bc103750 2024-05-08T07:48:47.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.166+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13bc06a190 con 0x7f13bc103750 2024-05-08T07:48:47.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.167+0000 7f13b2a00700 1 -- 172.21.15.70:0/2129318912 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f13ac0a9840 con 0x7f13bc103750 2024-05-08T07:48:47.163 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:48:47.163 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:48:47.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13a00b29f0 msgr2=0x7f13a00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:47.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13a00b29f0 0x7f13a00b4eb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f13a8000c00 tx=0x7f13a801a040 comp rx=0 tx=0).stop 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc103750 msgr2=0x7f13bc19f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc103750 0x7f13bc19f770 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00b530 tx=0x7f13ac00b8f0 comp rx=0 tx=0).stop 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 shutdown_connections 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13a00b29f0 0x7f13a00b4eb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13bc108850 0x7f13bc199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13bc103750 0x7f13bc19f770 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 --2- 172.21.15.70:0/2129318912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13bc104100 0x7f13bc19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.170+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 >> 172.21.15.70:0/2129318912 conn(0x7f13bc07a600 msgr2=0x7f13bc1018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.171+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 shutdown_connections 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:47.171+0000 7f13c0c00700 1 -- 172.21.15.70:0/2129318912 wait complete. 2024-05-08T07:48:47.167 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:48:47.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:47 smithi070 ceph-mon[29591]: pgmap v1979: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-05-08T07:48:47.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:47 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2129318912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:48:47.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:47 smithi172 ceph-mon[33377]: pgmap v1979: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-05-08T07:48:47.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:47 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2129318912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:48:48.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:47 smithi194 ceph-mon[33679]: pgmap v1979: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-05-08T07:48:48.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:47 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2129318912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:48:48.019 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 3982a7ce --release --await' 2024-05-08T07:48:48.020 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 3982a7ce --release --await 2024-05-08T07:48:48.472 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:48:49.867 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:49 smithi070 ceph-mon[29591]: pgmap v1980: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-05-08T07:48:49.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:49 smithi172 ceph-mon[33377]: pgmap v1980: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-05-08T07:48:50.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:49 smithi194 ceph-mon[33679]: pgmap v1980: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.748+0000 7ff785200700 1 -- 172.21.15.70:0/235687721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff780109ad0 msgr2=0x7ff780109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.748+0000 7ff785200700 1 --2- 172.21.15.70:0/235687721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff780109ad0 0x7ff780109f50 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009990 tx=0x7ff76c009ca0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.748+0000 7ff785200700 1 -- 172.21.15.70:0/235687721 shutdown_connections 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.748+0000 7ff785200700 1 --2- 172.21.15.70:0/235687721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78010a490 0x7ff7801169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.748+0000 7ff785200700 1 --2- 172.21.15.70:0/235687721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff78010fb60 0x7ff78010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.748+0000 7ff785200700 1 --2- 172.21.15.70:0/235687721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff780109ad0 0x7ff780109f50 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.748+0000 7ff785200700 1 -- 172.21.15.70:0/235687721 >> 172.21.15.70:0/235687721 conn(0x7ff780076c70 msgr2=0x7ff7801082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.748+0000 7ff785200700 1 -- 172.21.15.70:0/235687721 shutdown_connections 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.748+0000 7ff785200700 1 -- 172.21.15.70:0/235687721 wait complete. 2024-05-08T07:48:50.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.749+0000 7ff785200700 1 Processor -- start 2024-05-08T07:48:50.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.750+0000 7ff785200700 1 -- start start 2024-05-08T07:48:50.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.750+0000 7ff785200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff780109ad0 0x7ff7801a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.750+0000 7ff785200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff78010a490 0x7ff7801a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.750+0000 7ff785200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78010fb60 0x7ff7801a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.750+0000 7ff785200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff780119bd0 con 0x7ff78010a490 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.750+0000 7ff785200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff780119a50 con 0x7ff780109ad0 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.750+0000 7ff785200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff780119d50 con 0x7ff78010fb60 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.750+0000 7ff77d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff78010a490 0x7ff7801a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.750+0000 7ff77d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff78010a490 0x7ff7801a0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34710/0 (socket says 172.21.15.70:34710) 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77d400700 1 -- 172.21.15.70:0/1209398798 learned_addr learned my addr 172.21.15.70:0/1209398798 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77de00700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff780109ad0 0x7ff7801a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77e800700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78010fb60 0x7ff7801a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77d400700 1 -- 172.21.15.70:0/1209398798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78010fb60 msgr2=0x7ff7801a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77d400700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78010fb60 0x7ff7801a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77d400700 1 -- 172.21.15.70:0/1209398798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff780109ad0 msgr2=0x7ff7801a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77d400700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff780109ad0 0x7ff7801a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77d400700 1 -- 172.21.15.70:0/1209398798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7801a50e0 con 0x7ff78010a490 2024-05-08T07:48:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77de00700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff780109ad0 0x7ff7801a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:48:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.751+0000 7ff77d400700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff78010a490 0x7ff7801a0660 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff76c000c00 tx=0x7ff76c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.752+0000 7ff776a00700 1 -- 172.21.15.70:0/1209398798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c027070 con 0x7ff78010a490 2024-05-08T07:48:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.752+0000 7ff776a00700 1 -- 172.21.15.70:0/1209398798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff76c00fb80 con 0x7ff78010a490 2024-05-08T07:48:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.752+0000 7ff776a00700 1 -- 172.21.15.70:0/1209398798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c022c30 con 0x7ff78010a490 2024-05-08T07:48:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.752+0000 7ff785200700 1 -- 172.21.15.70:0/1209398798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7801a5370 con 0x7ff78010a490 2024-05-08T07:48:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.752+0000 7ff785200700 1 -- 172.21.15.70:0/1209398798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7801acc50 con 0x7ff78010a490 2024-05-08T07:48:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.755+0000 7ff776a00700 1 -- 172.21.15.70:0/1209398798 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff76c02a070 con 0x7ff78010a490 2024-05-08T07:48:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.757+0000 7ff776a00700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7640b2a70 0x7ff7640b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.757+0000 7ff776a00700 1 -- 172.21.15.70:0/1209398798 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(203..203 src has 1..203) ==== 9583+0+0 (secure 0 0 0) 0x7ff76c0e3970 con 0x7ff78010a490 2024-05-08T07:48:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.757+0000 7ff77de00700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7640b2a70 0x7ff7640b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.758+0000 7ff77de00700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7640b2a70 0x7ff7640b4f30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff770005e10 tx=0x7ff770005d60 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:50.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.770+0000 7ff78fae0b80 1 Processor -- start 2024-05-08T07:48:50.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.770+0000 7ff78fae0b80 1 -- start start 2024-05-08T07:48:50.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c0131d1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 0x55c0131cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cc140 0x55c0131d7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c01311db20 con 0x55c0131d11b0 2024-05-08T07:48:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c0130bb860 con 0x55c0131cc140 2024-05-08T07:48:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c013119ae0 con 0x55c0131cb780 2024-05-08T07:48:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff77de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c0131d1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff77de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c0131d1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34722/0 (socket says 172.21.15.70:34722) 2024-05-08T07:48:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff77de00700 1 -- 172.21.15.70:0/672438893 learned_addr learned my addr 172.21.15.70:0/672438893 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:50.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff77d400700 1 --2- 172.21.15.70:0/672438893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 0x55c0131cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.771+0000 7ff77e800700 1 --2- 172.21.15.70:0/672438893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cc140 0x55c0131d7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.772+0000 7ff77de00700 1 -- 172.21.15.70:0/672438893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 msgr2=0x55c0131cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.772+0000 7ff77de00700 1 --2- 172.21.15.70:0/672438893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 0x55c0131cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.772+0000 7ff77de00700 1 -- 172.21.15.70:0/672438893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cc140 msgr2=0x55c0131d7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.772+0000 7ff77de00700 1 --2- 172.21.15.70:0/672438893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cc140 0x55c0131d7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.772+0000 7ff77de00700 1 -- 172.21.15.70:0/672438893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c01306a9d0 con 0x55c0131d11b0 2024-05-08T07:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.772+0000 7ff77de00700 1 --2- 172.21.15.70:0/672438893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c0131d1590 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff7700044e0 tx=0x7ff770012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd31c403c7d467e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.772+0000 7ff76b400700 1 -- 172.21.15.70:0/672438893 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770003880 con 0x55c0131d11b0 2024-05-08T07:48:50.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.772+0000 7ff76b400700 1 -- 172.21.15.70:0/672438893 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff770024070 con 0x55c0131d11b0 2024-05-08T07:48:50.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.772+0000 7ff76b400700 1 -- 172.21.15.70:0/672438893 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77001fb50 con 0x55c0131d11b0 2024-05-08T07:48:50.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.773+0000 7ff78fae0b80 1 -- 172.21.15.70:0/672438893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 msgr2=0x55c0131d1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:50.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.773+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/672438893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c0131d1590 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff7700044e0 tx=0x7ff770012000 comp rx=0 tx=0).stop 2024-05-08T07:48:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.773+0000 7ff78fae0b80 1 -- 172.21.15.70:0/672438893 shutdown_connections 2024-05-08T07:48:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.773+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/672438893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cc140 0x55c0131d7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.773+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/672438893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c0131d1590 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.773+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/672438893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 0x55c0131cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.773+0000 7ff78fae0b80 1 -- 172.21.15.70:0/672438893 >> 172.21.15.70:0/672438893 conn(0x55c0131437d0 msgr2=0x55c0131c6070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.774+0000 7ff78fae0b80 1 -- 172.21.15.70:0/672438893 shutdown_connections 2024-05-08T07:48:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.774+0000 7ff78fae0b80 1 -- 172.21.15.70:0/672438893 wait complete. 2024-05-08T07:48:50.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.774+0000 7ff78fae0b80 1 -- start start 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.774+0000 7ff78fae0b80 1 Processor -- start 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cb780 0x55c0131d7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 0x55c0131d4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 0x55c0131d53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c0131d8510 con 0x55c0131cb780 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c013083c20 con 0x55c0131d11b0 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c0131d8690 con 0x55c0131cc140 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff78fae0b80 10 client.0 _ll_register_callbacks cb 0x55c0130c4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff77de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cb780 0x55c0131d7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff77de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cb780 0x55c0131d7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34728/0 (socket says 172.21.15.70:34728) 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.775+0000 7ff77de00700 1 -- 172.21.15.70:0/3963574611 learned_addr learned my addr 172.21.15.70:0/3963574611 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff77d400700 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 0x55c0131d4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff77e800700 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 0x55c0131d53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff77de00700 1 -- 172.21.15.70:0/3963574611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 msgr2=0x55c0131d4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff77de00700 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 0x55c0131d4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff77de00700 1 -- 172.21.15.70:0/3963574611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 msgr2=0x55c0131d53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff77de00700 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 0x55c0131d53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff77de00700 1 -- 172.21.15.70:0/3963574611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0130e3520 con 0x55c0131cb780 2024-05-08T07:48:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff77e800700 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 0x55c0131d53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:48:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff77de00700 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cb780 0x55c0131d7b10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff7700209d0 tx=0x7ff770020ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756a488053d47754 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:50.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.776+0000 7ff75fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:48:50.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.777+0000 7ff75fe00700 1 -- 172.21.15.70:0/3963574611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770003a90 con 0x55c0131cb780 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.777+0000 7ff75fe00700 1 -- 172.21.15.70:0/3963574611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(203..203 src has 1..203) ==== 9583+0+0 (secure 0 0 0) 0x7ff770003c30 con 0x55c0131cb780 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.777+0000 7ff78fae0b80 1 -- 172.21.15.70:0/3963574611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff770024070 con 0x55c0131cb780 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.777+0000 7ff75fe00700 1 -- 172.21.15.70:0/3963574611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff77003d050 con 0x55c0131cb780 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.777+0000 7ff78fae0b80 10 client.17193 fetch_fsmap learned FSMap version 42 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.777+0000 7ff78fae0b80 1 -- 172.21.15.70:0/3963574611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55c0131e2cb0 con 0x55c0131cb780 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.777+0000 7ff75fe00700 1 -- 172.21.15.70:0/3963574611 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff770024070 con 0x55c0131cb780 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.778+0000 7ff75fe00700 1 -- 172.21.15.70:0/3963574611 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ff770032020 con 0x55c0131cb780 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.778+0000 7ff78fae0b80 10 client.17193 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.778+0000 7ff78fae0b80 10 client.17193 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.778+0000 7ff78fae0b80 20 client.17193 populate_metadata read hostname 'smithi070' 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.778+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c0131e5290 0x55c0131e7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.778+0000 7ff78fae0b80 4 client.17193 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.778+0000 7ff78fae0b80 1 -- 172.21.15.70:0/3963574611 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c013198240 con 0x55c0131e5290 2024-05-08T07:48:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.778+0000 7ff77d400700 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c0131e5290 0x55c0131e7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.779+0000 7ff77d400700 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c0131e5290 0x55c0131e7680 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df97c01cc92fd539 server_cookie=9f684b4072aa3133 in_seq=0 out_seq=0 2024-05-08T07:48:50.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.779+0000 7ff75fe00700 10 client.17193 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:48:50.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.781+0000 7ff75fe00700 1 -- 172.21.15.70:0/3963574611 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c013198240 con 0x55c0131e5290 2024-05-08T07:48:50.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.781+0000 7ff75fe00700 10 client.17193 handle_command_reply: tid=0 2024-05-08T07:48:50.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.781+0000 7ff78fae0b80 1 client.17193 shutdown 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.781+0000 7ff78fae0b80 1 -- 172.21.15.70:0/3963574611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cb780 msgr2=0x55c0131d7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.781+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cb780 0x55c0131d7b10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff7700209d0 tx=0x7ff770020ab0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff78fae0b80 1 -- 172.21.15.70:0/3963574611 shutdown_connections 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c0131e5290 0x55c0131e7680 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 0x55c0131d53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cb780 0x55c0131d7b10 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/3963574611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 0x55c0131d4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff78fae0b80 1 -- 172.21.15.70:0/3963574611 >> 172.21.15.70:0/3963574611 conn(0x55c0131437d0 msgr2=0x55c0131c0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff75fe00700 0 client.17193 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff78fae0b80 1 -- 172.21.15.70:0/3963574611 shutdown_connections 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff78fae0b80 1 -- 172.21.15.70:0/3963574611 wait complete. 2024-05-08T07:48:50.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.782+0000 7ff78fae0b80 20 client.17193 trim_cache size 0 max 16384 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.803+0000 7ff78fae0b80 1 Processor -- start 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff78fae0b80 1 -- start start 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 0x55c0131e1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cc140 0x55c0131d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 0x55c0131d4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801b8450 con 0x55c0131cc140 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801b5ce0 con 0x55c0131d11b0 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801b3b50 con 0x55c0131cb780 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff77d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cc140 0x55c0131d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff77d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cc140 0x55c0131d4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34732/0 (socket says 172.21.15.70:34732) 2024-05-08T07:48:50.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.804+0000 7ff77d400700 1 -- 172.21.15.70:0/1973631224 learned_addr learned my addr 172.21.15.70:0/1973631224 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:50.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff77e800700 1 --2- 172.21.15.70:0/1973631224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 0x55c0131d4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff77de00700 1 --2- 172.21.15.70:0/1973631224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 0x55c0131e1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff77d400700 1 -- 172.21.15.70:0/1973631224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 msgr2=0x55c0131e1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff77d400700 1 --2- 172.21.15.70:0/1973631224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 0x55c0131e1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff77d400700 1 -- 172.21.15.70:0/1973631224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 msgr2=0x55c0131d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff77d400700 1 --2- 172.21.15.70:0/1973631224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 0x55c0131d4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff77d400700 1 -- 172.21.15.70:0/1973631224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0131c2c70 con 0x55c0131cc140 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff77d400700 1 --2- 172.21.15.70:0/1973631224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cc140 0x55c0131d4760 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0a68e0 tx=0x7ff76c092040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146ae8cc1c080590 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff76aa00700 1 -- 172.21.15.70:0/1973631224 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0aa860 con 0x55c0131cc140 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff76aa00700 1 -- 172.21.15.70:0/1973631224 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff76c0aec10 con 0x55c0131cc140 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.805+0000 7ff76aa00700 1 -- 172.21.15.70:0/1973631224 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00fe50 con 0x55c0131cc140 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.806+0000 7ff78fae0b80 1 -- 172.21.15.70:0/1973631224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cc140 msgr2=0x55c0131d4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:50.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.806+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/1973631224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cc140 0x55c0131d4760 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0a68e0 tx=0x7ff76c092040 comp rx=0 tx=0).stop 2024-05-08T07:48:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.806+0000 7ff78fae0b80 1 -- 172.21.15.70:0/1973631224 shutdown_connections 2024-05-08T07:48:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.806+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/1973631224 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131d11b0 0x55c0131d4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.806+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/1973631224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cb780 0x55c0131e1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.806+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/1973631224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131cc140 0x55c0131d4760 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.806+0000 7ff78fae0b80 1 -- 172.21.15.70:0/1973631224 >> 172.21.15.70:0/1973631224 conn(0x55c0131437d0 msgr2=0x55c0131cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.806+0000 7ff78fae0b80 1 -- 172.21.15.70:0/1973631224 shutdown_connections 2024-05-08T07:48:50.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.806+0000 7ff78fae0b80 1 -- 172.21.15.70:0/1973631224 wait complete. 2024-05-08T07:48:50.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.807+0000 7ff78fae0b80 1 -- start start 2024-05-08T07:48:50.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.807+0000 7ff78fae0b80 1 Processor -- start 2024-05-08T07:48:50.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.807+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cb780 0x55c0131d9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.807+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 0x55c0131da210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.807+0000 7ff78fae0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c013248970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.807+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801b41a0 con 0x55c0131d11b0 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.807+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801b5610 con 0x55c0131cb780 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.807+0000 7ff78fae0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801b4870 con 0x55c0131cc140 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.807+0000 7ff78fae0b80 10 client.0 _ll_register_callbacks cb 0x55c0130c4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c013248970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c013248970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34736/0 (socket says 172.21.15.70:34736) 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77e800700 1 -- 172.21.15.70:0/327908281 learned_addr learned my addr 172.21.15.70:0/327908281 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77de00700 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cb780 0x55c0131d9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77d400700 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 0x55c0131da210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77e800700 1 -- 172.21.15.70:0/327908281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 msgr2=0x55c0131da210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77e800700 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 0x55c0131da210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77e800700 1 -- 172.21.15.70:0/327908281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cb780 msgr2=0x55c0131d9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77e800700 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cb780 0x55c0131d9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.808+0000 7ff77e800700 1 -- 172.21.15.70:0/327908281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c013248fb0 con 0x55c0131d11b0 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.809+0000 7ff77e800700 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c013248970 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff7780077b0 tx=0x7ff778007ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0143bf9e08d5822 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:48:50.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.809+0000 7ff75fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.809+0000 7ff75fe00700 1 -- 172.21.15.70:0/327908281 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77801c020 con 0x55c0131d11b0 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.809+0000 7ff75fe00700 1 -- 172.21.15.70:0/327908281 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(203..203 src has 1..203) ==== 9583+0+0 (secure 0 0 0) 0x7ff778018690 con 0x55c0131d11b0 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.809+0000 7ff78fae0b80 1 -- 172.21.15.70:0/327908281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff76c0aec10 con 0x55c0131d11b0 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.809+0000 7ff75fe00700 1 -- 172.21.15.70:0/327908281 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff778027050 con 0x55c0131d11b0 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.809+0000 7ff78fae0b80 10 client.17199 fetch_fsmap learned FSMap version 42 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.809+0000 7ff78fae0b80 1 -- 172.21.15.70:0/327908281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55c0132503e0 con 0x55c0131d11b0 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.810+0000 7ff75fe00700 1 -- 172.21.15.70:0/327908281 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff76c0aec10 con 0x55c0131d11b0 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.810+0000 7ff75fe00700 1 -- 172.21.15.70:0/327908281 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ff778016a20 con 0x55c0131d11b0 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.810+0000 7ff78fae0b80 10 client.17199 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.810+0000 7ff78fae0b80 10 client.17199 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:48:50.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.810+0000 7ff78fae0b80 20 client.17199 populate_metadata read hostname 'smithi070' 2024-05-08T07:48:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.810+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c013250ba0 0x55c013252fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:48:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.810+0000 7ff78fae0b80 4 client.17199 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3982a7ce", "release": true, "await": true}] 2024-05-08T07:48:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.810+0000 7ff78fae0b80 1 -- 172.21.15.70:0/327908281 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3982a7ce", "release": true, "await": true}) -- 0x55c01312b500 con 0x55c013250ba0 2024-05-08T07:48:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.811+0000 7ff77de00700 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c013250ba0 0x55c013252fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:48:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.812+0000 7ff77de00700 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c013250ba0 0x55c013252fc0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ae50f019ce4ca3b server_cookie=f808736e8586b9ff in_seq=0 out_seq=0 2024-05-08T07:48:50.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:50.812+0000 7ff75fe00700 10 client.17199 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:48:51.327 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/tsx.o 2024-05-08T07:48:51.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:51 smithi070 ceph-mon[29591]: pgmap v1981: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-05-08T07:48:51.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:51 smithi172 ceph-mon[33377]: pgmap v1981: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-05-08T07:48:52.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:51 smithi194 ceph-mon[33679]: pgmap v1981: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 10 op/s 2024-05-08T07:48:53.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:53 smithi070 ceph-mon[29591]: pgmap v1982: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:48:53.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:53 smithi172 ceph-mon[33377]: pgmap v1982: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:48:54.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:53 smithi194 ceph-mon[33679]: pgmap v1982: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 6 op/s 2024-05-08T07:48:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.192+0000 7ff75fe00700 1 -- 172.21.15.70:0/327908281 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55c01312b500 con 0x55c013250ba0 2024-05-08T07:48:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.192+0000 7ff75fe00700 10 client.17199 handle_command_reply: tid=0 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.192+0000 7ff78fae0b80 1 client.17199 shutdown 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.193+0000 7ff78fae0b80 1 -- 172.21.15.70:0/327908281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 msgr2=0x55c013248970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.193+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c013248970 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff7780077b0 tx=0x7ff778007ac0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.193+0000 7ff78fae0b80 1 -- 172.21.15.70:0/327908281 shutdown_connections 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.193+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c013250ba0 0x55c013252fc0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.193+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c0131d11b0 0x55c013248970 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.193+0000 7ff75fe00700 0 client.17199 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.193+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c0131cb780 0x55c0131d9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.193+0000 7ff78fae0b80 1 --2- 172.21.15.70:0/327908281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c0131cc140 0x55c0131da210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.193+0000 7ff78fae0b80 1 -- 172.21.15.70:0/327908281 >> 172.21.15.70:0/327908281 conn(0x55c0131437d0 msgr2=0x55c0131c02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.194+0000 7ff78fae0b80 1 -- 172.21.15.70:0/327908281 shutdown_connections 2024-05-08T07:48:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.194+0000 7ff78fae0b80 1 -- 172.21.15.70:0/327908281 wait complete. 2024-05-08T07:48:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.194+0000 7ff78fae0b80 20 client.17199 trim_cache size 0 max 16384 2024-05-08T07:48:55.191 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:48:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:48:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:48:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 152, 2024-05-08T07:48:55.191 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "3982a7ce": { 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 152, 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:48:55.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:48:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:48:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:55.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:48:55.193 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:48:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 -- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7640b2a70 msgr2=0x7ff7640b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7640b2a70 0x7ff7640b4f30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff770005e10 tx=0x7ff770005d60 comp rx=0 tx=0).stop 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 -- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff78010a490 msgr2=0x7ff7801a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff78010a490 0x7ff7801a0660 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff76c000c00 tx=0x7ff76c005ef0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 -- 172.21.15.70:0/1209398798 shutdown_connections 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7640b2a70 0x7ff7640b4f30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff78010fb60 0x7ff7801a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff780109ad0 0x7ff7801a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 --2- 172.21.15.70:0/1209398798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff78010a490 0x7ff7801a0660 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 -- 172.21.15.70:0/1209398798 >> 172.21.15.70:0/1209398798 conn(0x7ff780076c70 msgr2=0x7ff7800772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.196+0000 7ff785200700 1 -- 172.21.15.70:0/1209398798 shutdown_connections 2024-05-08T07:48:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:48:55.197+0000 7ff785200700 1 -- 172.21.15.70:0/1209398798 wait complete. 2024-05-08T07:48:55.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:55 smithi070 ceph-mon[29591]: pgmap v1983: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-05-08T07:48:55.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:48:55.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:55 smithi172 ceph-mon[33377]: pgmap v1983: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-05-08T07:48:55.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:48:56.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:55 smithi194 ceph-mon[33679]: pgmap v1983: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-05-08T07:48:56.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:48:56.243 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3982a7ce', seconds elapsed: 60.9 2024-05-08T07:48:57.500 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/bio.o 2024-05-08T07:48:57.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:57 smithi172 ceph-mon[33377]: pgmap v1984: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T07:48:57.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:48:57.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:48:57.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:48:58.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:57 smithi194 ceph-mon[33679]: pgmap v1984: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T07:48:58.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:48:58.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:48:58.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:48:58.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:57 smithi070 ceph-mon[29591]: pgmap v1984: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T07:48:58.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:48:58.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:48:58.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:48:58.164 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/vsyscall.o 2024-05-08T07:48:58.329 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/dir.o 2024-05-08T07:48:58.352 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/netfs/objects.o 2024-05-08T07:48:58.367 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/apic_flat_64.o 2024-05-08T07:48:58.502 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/memory-tiers.o 2024-05-08T07:48:58.536 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/authencesn.o 2024-05-08T07:48:59.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:48:59 smithi172 ceph-mon[33377]: pgmap v1985: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T07:49:00.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:48:59 smithi194 ceph-mon[33679]: pgmap v1985: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T07:49:00.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:48:59 smithi070 ceph-mon[29591]: pgmap v1985: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T07:49:01.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:01 smithi172 ceph-mon[33377]: pgmap v1986: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 188 KiB/s wr, 147 op/s 2024-05-08T07:49:02.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:01 smithi194 ceph-mon[33679]: pgmap v1986: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 188 KiB/s wr, 147 op/s 2024-05-08T07:49:02.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:01 smithi070 ceph-mon[29591]: pgmap v1986: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 188 KiB/s wr, 147 op/s 2024-05-08T07:49:03.485 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/intel_epb.o 2024-05-08T07:49:03.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:03 smithi172 ceph-mon[33377]: pgmap v1987: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 188 KiB/s wr, 145 op/s 2024-05-08T07:49:04.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:03 smithi194 ceph-mon[33679]: pgmap v1987: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 188 KiB/s wr, 145 op/s 2024-05-08T07:49:04.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:03 smithi070 ceph-mon[29591]: pgmap v1987: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 188 KiB/s wr, 145 op/s 2024-05-08T07:49:05.270 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/timekeeping_debug.o 2024-05-08T07:49:05.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:05 smithi172 ceph-mon[33377]: pgmap v1988: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 341 KiB/s wr, 170 op/s 2024-05-08T07:49:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:05 smithi194 ceph-mon[33679]: pgmap v1988: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 341 KiB/s wr, 170 op/s 2024-05-08T07:49:06.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:05 smithi070 ceph-mon[29591]: pgmap v1988: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 341 KiB/s wr, 170 op/s 2024-05-08T07:49:06.343 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/apic/probe_64.o 2024-05-08T07:49:07.499 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/netfs/built-in.a 2024-05-08T07:49:07.887 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/amd.o 2024-05-08T07:49:07.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:07 smithi172 ceph-mon[33377]: pgmap v1989: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 336 KiB/s wr, 166 op/s 2024-05-08T07:49:08.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:07 smithi194 ceph-mon[33679]: pgmap v1989: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 336 KiB/s wr, 166 op/s 2024-05-08T07:49:08.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:07 smithi070 ceph-mon[29591]: pgmap v1989: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 336 KiB/s wr, 166 op/s 2024-05-08T07:49:08.286 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/page_counter.o 2024-05-08T07:49:08.415 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/ext4_jbd2.o 2024-05-08T07:49:09.115 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/elevator.o 2024-05-08T07:49:09.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:09 smithi172 ceph-mon[33377]: pgmap v1990: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 336 KiB/s wr, 166 op/s 2024-05-08T07:49:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:09 smithi194 ceph-mon[33679]: pgmap v1990: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 336 KiB/s wr, 166 op/s 2024-05-08T07:49:10.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:09 smithi070 ceph-mon[29591]: pgmap v1990: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 336 KiB/s wr, 166 op/s 2024-05-08T07:49:11.080 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/kernel/apic/built-in.a 2024-05-08T07:49:11.305 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/atom/built-in.a 2024-05-08T07:49:11.516 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/rng.o 2024-05-08T07:49:11.534 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/ce4100/built-in.a 2024-05-08T07:49:11.779 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/platform/efi/memmap.o 2024-05-08T07:49:11.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:11 smithi172 ceph-mon[33377]: pgmap v1991: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 531 KiB/s wr, 181 op/s 2024-05-08T07:49:11.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:11 smithi172 ceph-mon[33377]: osdmap e204: 12 total, 12 up, 12 in 2024-05-08T07:49:11.926 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:11 smithi070 ceph-mon[29591]: pgmap v1991: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 531 KiB/s wr, 181 op/s 2024-05-08T07:49:11.926 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:11 smithi070 ceph-mon[29591]: osdmap e204: 12 total, 12 up, 12 in 2024-05-08T07:49:11.992 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/net/built-in.a 2024-05-08T07:49:12.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:11 smithi194 ceph-mon[33679]: pgmap v1991: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 531 KiB/s wr, 181 op/s 2024-05-08T07:49:12.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:11 smithi194 ceph-mon[33679]: osdmap e204: 12 total, 12 up, 12 in 2024-05-08T07:49:12.109 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/platform/efi/quirks.o 2024-05-08T07:49:13.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:13 smithi172 ceph-mon[33377]: pgmap v1993: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 418 KiB/s wr, 47 op/s 2024-05-08T07:49:14.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:13 smithi194 ceph-mon[33679]: pgmap v1993: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 418 KiB/s wr, 47 op/s 2024-05-08T07:49:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:13 smithi070 ceph-mon[29591]: pgmap v1993: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 418 KiB/s wr, 47 op/s 2024-05-08T07:49:14.274 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/hugetlb_cgroup.o 2024-05-08T07:49:14.815 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.6 2024-05-08T07:49:14.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:49:15.446 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:49:15.529 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/time/namespace.o 2024-05-08T07:49:15.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:15 smithi070 ceph-mon[29591]: pgmap v1994: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 500 KiB/s wr, 235 op/s 2024-05-08T07:49:16.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:15 smithi194 ceph-mon[33679]: pgmap v1994: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 500 KiB/s wr, 235 op/s 2024-05-08T07:49:16.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:15 smithi172 ceph-mon[33377]: pgmap v1994: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 500 KiB/s wr, 235 op/s 2024-05-08T07:49:17.662 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/hygon.o 2024-05-08T07:49:17.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:17 smithi070 ceph-mon[29591]: pgmap v1995: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 500 KiB/s wr, 235 op/s 2024-05-08T07:49:18.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:17 smithi194 ceph-mon[33679]: pgmap v1995: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 500 KiB/s wr, 235 op/s 2024-05-08T07:49:18.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:17 smithi172 ceph-mon[33377]: pgmap v1995: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 500 KiB/s wr, 235 op/s 2024-05-08T07:49:19.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:19 smithi070 ceph-mon[29591]: pgmap v1996: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 500 KiB/s wr, 235 op/s 2024-05-08T07:49:19.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:19 smithi070 ceph-mon[29591]: osdmap e205: 12 total, 12 up, 12 in 2024-05-08T07:49:19.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:19 smithi194 ceph-mon[33679]: pgmap v1996: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 500 KiB/s wr, 235 op/s 2024-05-08T07:49:19.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:19 smithi194 ceph-mon[33679]: osdmap e205: 12 total, 12 up, 12 in 2024-05-08T07:49:19.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:19 smithi172 ceph-mon[33377]: pgmap v1996: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 500 KiB/s wr, 235 op/s 2024-05-08T07:49:19.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:19 smithi172 ceph-mon[33377]: osdmap e205: 12 total, 12 up, 12 in 2024-05-08T07:49:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.057+0000 7f22cd200700 1 -- 172.21.15.70:0/1031279378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 msgr2=0x7f22c8077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.057+0000 7f22cd200700 1 --2- 172.21.15.70:0/1031279378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 0x7f22c8077db0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009990 tx=0x7f22b8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.058+0000 7f22cd200700 1 -- 172.21.15.70:0/1031279378 shutdown_connections 2024-05-08T07:49:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.058+0000 7f22cd200700 1 --2- 172.21.15.70:0/1031279378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22c8114250 0x7f22c8116640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.058+0000 7f22cd200700 1 --2- 172.21.15.70:0/1031279378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 0x7f22c8077db0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.058+0000 7f22cd200700 1 --2- 172.21.15.70:0/1031279378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c80782f0 0x7f22c8113d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.058+0000 7f22cd200700 1 -- 172.21.15.70:0/1031279378 >> 172.21.15.70:0/1031279378 conn(0x7f22c8101080 msgr2=0x7f22c81034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:49:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.058+0000 7f22cd200700 1 -- 172.21.15.70:0/1031279378 shutdown_connections 2024-05-08T07:49:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.058+0000 7f22cd200700 1 -- 172.21.15.70:0/1031279378 wait complete. 2024-05-08T07:49:20.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.059+0000 7f22cd200700 1 Processor -- start 2024-05-08T07:49:20.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.059+0000 7f22cd200700 1 -- start start 2024-05-08T07:49:20.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.060+0000 7f22cd200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 0x7f22c81a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:20.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22cd200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c80782f0 0x7f22c81a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:20.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22cd200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22c8114250 0x7f22c81a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:20.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 0x7f22c81a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:20.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22cd200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8119ac0 con 0x7f22c80779d0 2024-05-08T07:49:20.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 0x7f22c81a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48706/0 (socket says 172.21.15.70:48706) 2024-05-08T07:49:20.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c7400700 1 -- 172.21.15.70:0/328890415 learned_addr learned my addr 172.21.15.70:0/328890415 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:49:20.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8119940 con 0x7f22c80782f0 2024-05-08T07:49:20.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22c8119c40 con 0x7f22c8114250 2024-05-08T07:49:20.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c6a00700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c80782f0 0x7f22c81a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:20.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c7e00700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22c8114250 0x7f22c81a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:20.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c7400700 1 -- 172.21.15.70:0/328890415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22c8114250 msgr2=0x7f22c81a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c7400700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22c8114250 0x7f22c81a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c7400700 1 -- 172.21.15.70:0/328890415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c80782f0 msgr2=0x7f22c81a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c7400700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c80782f0 0x7f22c81a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.061+0000 7f22c7400700 1 -- 172.21.15.70:0/328890415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22c81a5080 con 0x7f22c80779d0 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.062+0000 7f22c7e00700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22c8114250 0x7f22c81a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.062+0000 7f22c7400700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 0x7f22c81a00c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f22b80098e0 tx=0x7f22b8009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.062+0000 7f22bfe00700 1 -- 172.21.15.70:0/328890415 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8027070 con 0x7f22c80779d0 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.063+0000 7f22bfe00700 1 -- 172.21.15.70:0/328890415 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22b8022470 con 0x7f22c80779d0 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.063+0000 7f22bfe00700 1 -- 172.21.15.70:0/328890415 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b8017650 con 0x7f22c80779d0 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.063+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22c81a5310 con 0x7f22c80779d0 2024-05-08T07:49:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.063+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22c81acbf0 con 0x7f22c80779d0 2024-05-08T07:49:20.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.065+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a8005330 con 0x7f22c80779d0 2024-05-08T07:49:20.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.068+0000 7f22bfe00700 1 -- 172.21.15.70:0/328890415 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f22b802a070 con 0x7f22c80779d0 2024-05-08T07:49:20.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.070+0000 7f22bfe00700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22ac0b2a70 0x7f22ac0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:20.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.071+0000 7f22bfe00700 1 -- 172.21.15.70:0/328890415 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 9583+0+0 (secure 0 0 0) 0x7f22b80e3750 con 0x7f22c80779d0 2024-05-08T07:49:20.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.072+0000 7f22c6a00700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22ac0b2a70 0x7f22ac0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:20.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.073+0000 7f22c6a00700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22ac0b2a70 0x7f22ac0b4f30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f22b4005950 tx=0x7f22b40058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:49:20.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.077+0000 7f22bfe00700 1 -- 172.21.15.70:0/328890415 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f22b8013070 con 0x7f22c80779d0 2024-05-08T07:49:20.186 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/extents.o 2024-05-08T07:49:20.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.557+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22a80058f0 con 0x7f22c80779d0 2024-05-08T07:49:20.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.559+0000 7f22bfe00700 1 -- 172.21.15.70:0/328890415 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f22b80aada0 con 0x7f22c80779d0 2024-05-08T07:49:20.555 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:49:20.555 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:49:20.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22ac0b2a70 msgr2=0x7f22ac0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:20.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22ac0b2a70 0x7f22ac0b4f30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f22b4005950 tx=0x7f22b40058e0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 msgr2=0x7f22c81a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:20.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 0x7f22c81a00c0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f22b80098e0 tx=0x7f22b8009550 comp rx=0 tx=0).stop 2024-05-08T07:49:20.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 shutdown_connections 2024-05-08T07:49:20.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22ac0b2a70 0x7f22ac0b4f30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22c8114250 0x7f22c81a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22c80779d0 0x7f22c81a00c0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 --2- 172.21.15.70:0/328890415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22c80782f0 0x7f22c81a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:20.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.562+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 >> 172.21.15.70:0/328890415 conn(0x7f22c8101080 msgr2=0x7f22c8103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:49:20.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.563+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 shutdown_connections 2024-05-08T07:49:20.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:20.563+0000 7f22cd200700 1 -- 172.21.15.70:0/328890415 wait complete. 2024-05-08T07:49:20.561 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:49:20.876 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-core.o 2024-05-08T07:49:21.378 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 74.6 --await-for 42.0' 2024-05-08T07:49:21.378 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 74.6 --await-for 42.0 2024-05-08T07:49:21.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:21 smithi070 ceph-mon[29591]: pgmap v1998: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 423 KiB/s wr, 234 op/s 2024-05-08T07:49:21.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:21 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/328890415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:49:21.710 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/drbg.o 2024-05-08T07:49:21.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:21 smithi194 ceph-mon[33679]: pgmap v1998: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 423 KiB/s wr, 234 op/s 2024-05-08T07:49:21.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:21 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/328890415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:49:21.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:21 smithi172 ceph-mon[33377]: pgmap v1998: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 423 KiB/s wr, 234 op/s 2024-05-08T07:49:21.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:21 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/328890415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:49:21.947 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:49:22.588 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/geode/built-in.a 2024-05-08T07:49:22.923 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/jbd2/transaction.o 2024-05-08T07:49:23.375 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/platform/efi/efi.o 2024-05-08T07:49:23.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:23 smithi070 ceph-mon[29591]: pgmap v1999: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 415 KiB/s wr, 230 op/s 2024-05-08T07:49:23.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:23 smithi172 ceph-mon[33377]: pgmap v1999: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 415 KiB/s wr, 230 op/s 2024-05-08T07:49:24.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:23 smithi194 ceph-mon[33679]: pgmap v1999: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 415 KiB/s wr, 230 op/s 2024-05-08T07:49:24.461 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/early_ioremap.o 2024-05-08T07:49:24.650 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/time/built-in.a 2024-05-08T07:49:25.816 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:25 smithi070 ceph-mon[29591]: pgmap v2000: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 355 KiB/s wr, 24 op/s 2024-05-08T07:49:25.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:25 smithi172 ceph-mon[33377]: pgmap v2000: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 355 KiB/s wr, 24 op/s 2024-05-08T07:49:25.955 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/futex/core.o 2024-05-08T07:49:26.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:25 smithi194 ceph-mon[33679]: pgmap v2000: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 355 KiB/s wr, 24 op/s 2024-05-08T07:49:26.055 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/centaur.o 2024-05-08T07:49:26.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.575+0000 7fcc5d600700 1 -- 172.21.15.70:0/3050012327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc58102050 msgr2=0x7fcc58102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:26.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.575+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3050012327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc58102050 0x7fcc58102430 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fcc50009990 tx=0x7fcc50009ca0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.575+0000 7fcc5d600700 1 -- 172.21.15.70:0/3050012327 shutdown_connections 2024-05-08T07:49:26.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.575+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3050012327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc58107650 0x7fcc58107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.575+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3050012327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc58102050 0x7fcc58102430 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.575+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3050012327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc58102970 0x7fcc58107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.575+0000 7fcc5d600700 1 -- 172.21.15.70:0/3050012327 >> 172.21.15.70:0/3050012327 conn(0x7fcc580fdcf0 msgr2=0x7fcc58100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:49:26.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.575+0000 7fcc5d600700 1 -- 172.21.15.70:0/3050012327 shutdown_connections 2024-05-08T07:49:26.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.576+0000 7fcc5d600700 1 -- 172.21.15.70:0/3050012327 wait complete. 2024-05-08T07:49:26.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.577+0000 7fcc5d600700 1 Processor -- start 2024-05-08T07:49:26.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.577+0000 7fcc5d600700 1 -- start start 2024-05-08T07:49:26.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.577+0000 7fcc5d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc58102050 0x7fcc581a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.577+0000 7fcc5d600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc58102970 0x7fcc581a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.577+0000 7fcc5d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc58107650 0x7fcc581a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.578+0000 7fcc5d600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcc58119b80 con 0x7fcc58107650 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.578+0000 7fcc5d600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc58119a00 con 0x7fcc58102050 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.578+0000 7fcc5d600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc58119d00 con 0x7fcc58102970 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.578+0000 7fcc57e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc58102050 0x7fcc581a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.578+0000 7fcc57e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc58102050 0x7fcc581a0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:60760/0 (socket says 172.21.15.70:60760) 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.578+0000 7fcc57e00700 1 -- 172.21.15.70:0/3286610765 learned_addr learned my addr 172.21.15.70:0/3286610765 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.578+0000 7fcc57400700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc58102970 0x7fcc581a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.578+0000 7fcc5cc00700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc58107650 0x7fcc581a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.579+0000 7fcc57e00700 1 -- 172.21.15.70:0/3286610765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc58102970 msgr2=0x7fcc581a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.579+0000 7fcc57e00700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc58102970 0x7fcc581a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.579+0000 7fcc57e00700 1 -- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc58107650 msgr2=0x7fcc581a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:26.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.579+0000 7fcc57e00700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc58107650 0x7fcc581a4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.579+0000 7fcc57e00700 1 -- 172.21.15.70:0/3286610765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc581a4fd0 con 0x7fcc58102050 2024-05-08T07:49:26.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.579+0000 7fcc57400700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc58102970 0x7fcc581a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:49:26.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.580+0000 7fcc57e00700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc58102050 0x7fcc581a0010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc500098e0 tx=0x7fcc500057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:49:26.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.580+0000 7fcc54c00700 1 -- 172.21.15.70:0/3286610765 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50026070 con 0x7fcc58102050 2024-05-08T07:49:26.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.580+0000 7fcc5d600700 1 -- 172.21.15.70:0/3286610765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc581a5260 con 0x7fcc58102050 2024-05-08T07:49:26.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.580+0000 7fcc5d600700 1 -- 172.21.15.70:0/3286610765 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc581acb40 con 0x7fcc58102050 2024-05-08T07:49:26.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.580+0000 7fcc54c00700 1 -- 172.21.15.70:0/3286610765 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc5000fb00 con 0x7fcc58102050 2024-05-08T07:49:26.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.580+0000 7fcc54c00700 1 -- 172.21.15.70:0/3286610765 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc50021bc0 con 0x7fcc58102050 2024-05-08T07:49:26.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.586+0000 7fcc54c00700 1 -- 172.21.15.70:0/3286610765 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fcc50029070 con 0x7fcc58102050 2024-05-08T07:49:26.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.588+0000 7fcc54c00700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2b70 0x7fcc3c0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.588+0000 7fcc54c00700 1 -- 172.21.15.70:0/3286610765 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(205..205 src has 1..205) ==== 9583+0+0 (secure 0 0 0) 0x7fcc500e3630 con 0x7fcc58102050 2024-05-08T07:49:26.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.588+0000 7fcc57400700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2b70 0x7fcc3c0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.589+0000 7fcc57400700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2b70 0x7fcc3c0b5030 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcc5806cb50 tx=0x7fcc4000d040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:49:26.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.696+0000 7fcc69533b80 1 Processor -- start 2024-05-08T07:49:26.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.696+0000 7fcc69533b80 1 -- start start 2024-05-08T07:49:26.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce776c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce77c00 0x55a1cce71810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce72290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc69533b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1ccdc3bb0 con 0x55a1cce772e0 2024-05-08T07:49:26.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc69533b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a1ccd618f0 con 0x55a1cce71e30 2024-05-08T07:49:26.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc69533b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a1ccdbfb70 con 0x55a1cce77c00 2024-05-08T07:49:26.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc57e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce776c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc57e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce776c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48734/0 (socket says 172.21.15.70:48734) 2024-05-08T07:49:26.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc57e00700 1 -- 172.21.15.70:0/2118145682 learned_addr learned my addr 172.21.15.70:0/2118145682 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:49:26.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc57400700 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce77c00 0x55a1cce71810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.697+0000 7fcc5cc00700 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce72290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.698+0000 7fcc57e00700 1 -- 172.21.15.70:0/2118145682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce77c00 msgr2=0x55a1cce71810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:49:26.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.698+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce77c00 0x55a1cce71810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.698+0000 7fcc57e00700 1 -- 172.21.15.70:0/2118145682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 msgr2=0x55a1cce72290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:49:26.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.698+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce72290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.698+0000 7fcc57e00700 1 -- 172.21.15.70:0/2118145682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1ccd10a60 con 0x55a1cce772e0 2024-05-08T07:49:26.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.698+0000 7fcc5cc00700 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce72290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:49:26.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.699+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce776c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fcc500a65a0 tx=0x7fcc500a9d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c19026223731c2dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:49:26.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.699+0000 7fcc4d600700 1 -- 172.21.15.70:0/2118145682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc500aac20 con 0x55a1cce772e0 2024-05-08T07:49:26.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.699+0000 7fcc4d600700 1 -- 172.21.15.70:0/2118145682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc500920b0 con 0x55a1cce772e0 2024-05-08T07:49:26.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.699+0000 7fcc4d600700 1 -- 172.21.15.70:0/2118145682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc500b2e60 con 0x55a1cce772e0 2024-05-08T07:49:26.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.700+0000 7fcc69533b80 1 -- 172.21.15.70:0/2118145682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 msgr2=0x55a1cce776c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:26.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.700+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce776c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fcc500a65a0 tx=0x7fcc500a9d10 comp rx=0 tx=0).stop 2024-05-08T07:49:26.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.700+0000 7fcc69533b80 1 -- 172.21.15.70:0/2118145682 shutdown_connections 2024-05-08T07:49:26.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.700+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce72290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.700+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce776c0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.700+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2118145682 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce77c00 0x55a1cce71810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.700+0000 7fcc69533b80 1 -- 172.21.15.70:0/2118145682 >> 172.21.15.70:0/2118145682 conn(0x55a1ccde9860 msgr2=0x55a1cce6c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:49:26.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.701+0000 7fcc69533b80 1 -- 172.21.15.70:0/2118145682 shutdown_connections 2024-05-08T07:49:26.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.701+0000 7fcc69533b80 1 -- 172.21.15.70:0/2118145682 wait complete. 2024-05-08T07:49:26.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.701+0000 7fcc69533b80 1 -- start start 2024-05-08T07:49:26.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.702+0000 7fcc69533b80 1 Processor -- start 2024-05-08T07:49:26.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.703+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce71e30 0x55a1cce7d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.703+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce7ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.703+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce77c00 0x55a1cce7b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.703+0000 7fcc69533b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1cce7e4e0 con 0x55a1cce71e30 2024-05-08T07:49:26.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.703+0000 7fcc69533b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a1ccd29cb0 con 0x55a1cce77c00 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.703+0000 7fcc69533b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a1cce7e660 con 0x55a1cce772e0 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.703+0000 7fcc69533b80 10 client.0 _ll_register_callbacks cb 0x55a1ccd6ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.704+0000 7fcc57e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce71e30 0x55a1cce7d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.704+0000 7fcc57e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce71e30 0x55a1cce7d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48750/0 (socket says 172.21.15.70:48750) 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.704+0000 7fcc57e00700 1 -- 172.21.15.70:0/2607885109 learned_addr learned my addr 172.21.15.70:0/2607885109 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.704+0000 7fcc5cc00700 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce77c00 0x55a1cce7b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.705+0000 7fcc57e00700 1 -- 172.21.15.70:0/2607885109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 msgr2=0x55a1cce7ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.705+0000 7fcc57400700 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce7ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.705+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce7ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.705+0000 7fcc57e00700 1 -- 172.21.15.70:0/2607885109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce77c00 msgr2=0x55a1cce7b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.705+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce77c00 0x55a1cce7b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.705+0000 7fcc57e00700 1 -- 172.21.15.70:0/2607885109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ccd895b0 con 0x55a1cce71e30 2024-05-08T07:49:26.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.705+0000 7fcc5cc00700 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce77c00 0x55a1cce7b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:49:26.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.705+0000 7fcc57400700 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce7ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:49:26.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.706+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce71e30 0x55a1cce7d900 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fcc500aea90 tx=0x7fcc500b3090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc66ea643fb44f0f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:49:26.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.706+0000 7fcc46000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:49:26.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.706+0000 7fcc46000700 1 -- 172.21.15.70:0/2607885109 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc500c3070 con 0x55a1cce71e30 2024-05-08T07:49:26.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.706+0000 7fcc46000700 1 -- 172.21.15.70:0/2607885109 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(205..205 src has 1..205) ==== 9583+0+0 (secure 0 0 0) 0x7fcc500b1dd0 con 0x55a1cce71e30 2024-05-08T07:49:26.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.706+0000 7fcc69533b80 1 -- 172.21.15.70:0/2607885109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc500920b0 con 0x55a1cce71e30 2024-05-08T07:49:26.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.707+0000 7fcc46000700 1 -- 172.21.15.70:0/2607885109 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcc500ae8d0 con 0x55a1cce71e30 2024-05-08T07:49:26.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.707+0000 7fcc69533b80 10 client.17214 fetch_fsmap learned FSMap version 42 2024-05-08T07:49:26.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.707+0000 7fcc69533b80 1 -- 172.21.15.70:0/2607885109 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a1cce7e4e0 con 0x55a1cce71e30 2024-05-08T07:49:26.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.707+0000 7fcc46000700 1 -- 172.21.15.70:0/2607885109 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc500920b0 con 0x55a1cce71e30 2024-05-08T07:49:26.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.708+0000 7fcc46000700 1 -- 172.21.15.70:0/2607885109 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fcc500e3150 con 0x55a1cce71e30 2024-05-08T07:49:26.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.708+0000 7fcc69533b80 10 client.17214 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:49:26.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.708+0000 7fcc69533b80 10 client.17214 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:49:26.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.708+0000 7fcc69533b80 20 client.17214 populate_metadata read hostname 'smithi070' 2024-05-08T07:49:26.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.708+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1cce8b090 0x55a1cce8d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.708+0000 7fcc69533b80 4 client.17214 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:49:26.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.708+0000 7fcc69533b80 1 -- 172.21.15.70:0/2607885109 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1cce3e2d0 con 0x55a1cce8b090 2024-05-08T07:49:26.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.708+0000 7fcc57400700 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1cce8b090 0x55a1cce8d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.709+0000 7fcc57400700 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1cce8b090 0x55a1cce8d480 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=429b397d2f4ae00d server_cookie=70120eee22ddd5ff in_seq=0 out_seq=0 2024-05-08T07:49:26.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.709+0000 7fcc46000700 10 client.17214 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:49:26.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.711+0000 7fcc46000700 1 -- 172.21.15.70:0/2607885109 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a1cce3e2d0 con 0x55a1cce8b090 2024-05-08T07:49:26.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.711+0000 7fcc46000700 10 client.17214 handle_command_reply: tid=0 2024-05-08T07:49:26.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.712+0000 7fcc69533b80 1 client.17214 shutdown 2024-05-08T07:49:26.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.712+0000 7fcc69533b80 1 -- 172.21.15.70:0/2607885109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce71e30 msgr2=0x55a1cce7d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:26.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.712+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce71e30 0x55a1cce7d900 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fcc500aea90 tx=0x7fcc500b3090 comp rx=0 tx=0).stop 2024-05-08T07:49:26.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.713+0000 7fcc69533b80 1 -- 172.21.15.70:0/2607885109 shutdown_connections 2024-05-08T07:49:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.713+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1cce8b090 0x55a1cce8d480 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.713+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce77c00 0x55a1cce7b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.713+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce71e30 0x55a1cce7d900 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.713+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2607885109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce7ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.713+0000 7fcc69533b80 1 -- 172.21.15.70:0/2607885109 >> 172.21.15.70:0/2607885109 conn(0x55a1ccde9860 msgr2=0x55a1cce70800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:49:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.713+0000 7fcc46000700 0 client.17214 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:49:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.713+0000 7fcc69533b80 1 -- 172.21.15.70:0/2607885109 shutdown_connections 2024-05-08T07:49:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.714+0000 7fcc69533b80 1 -- 172.21.15.70:0/2607885109 wait complete. 2024-05-08T07:49:26.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.714+0000 7fcc69533b80 20 client.17214 trim_cache size 0 max 16384 2024-05-08T07:49:26.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.750+0000 7fcc69533b80 1 Processor -- start 2024-05-08T07:49:26.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.750+0000 7fcc69533b80 1 -- start start 2024-05-08T07:49:26.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce71800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce786f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce77c00 0x55a1cce92d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc69533b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581b8150 con 0x55a1cce772e0 2024-05-08T07:49:26.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc69533b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581b59e0 con 0x55a1cce71e30 2024-05-08T07:49:26.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc69533b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581b3850 con 0x55a1cce77c00 2024-05-08T07:49:26.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc57400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce786f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc57400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce786f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48752/0 (socket says 172.21.15.70:48752) 2024-05-08T07:49:26.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc57400700 1 -- 172.21.15.70:0/2028790804 learned_addr learned my addr 172.21.15.70:0/2028790804 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:49:26.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.751+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2028790804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce71800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.752+0000 7fcc57400700 1 -- 172.21.15.70:0/2028790804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce77c00 msgr2=0x55a1cce92d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:49:26.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.752+0000 7fcc57400700 1 --2- 172.21.15.70:0/2028790804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce77c00 0x55a1cce92d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.752+0000 7fcc57400700 1 -- 172.21.15.70:0/2028790804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 msgr2=0x55a1cce71800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:49:26.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.752+0000 7fcc57400700 1 --2- 172.21.15.70:0/2028790804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce71800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.752+0000 7fcc57400700 1 -- 172.21.15.70:0/2028790804 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1cce87530 con 0x55a1cce772e0 2024-05-08T07:49:26.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.752+0000 7fcc57400700 1 --2- 172.21.15.70:0/2028790804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce786f0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x55a1cce6d010 tx=0x7fcc40011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ca96e4c3c9e4df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:49:26.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.753+0000 7fcc4cc00700 1 -- 172.21.15.70:0/2028790804 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400249f0 con 0x55a1cce772e0 2024-05-08T07:49:26.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.753+0000 7fcc4cc00700 1 -- 172.21.15.70:0/2028790804 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc40024b90 con 0x55a1cce772e0 2024-05-08T07:49:26.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.753+0000 7fcc4cc00700 1 -- 172.21.15.70:0/2028790804 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc40030680 con 0x55a1cce772e0 2024-05-08T07:49:26.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.754+0000 7fcc69533b80 1 -- 172.21.15.70:0/2028790804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 msgr2=0x55a1cce786f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:26.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.754+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2028790804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce786f0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x55a1cce6d010 tx=0x7fcc40011000 comp rx=0 tx=0).stop 2024-05-08T07:49:26.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.754+0000 7fcc69533b80 1 -- 172.21.15.70:0/2028790804 shutdown_connections 2024-05-08T07:49:26.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.754+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2028790804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce77c00 0x55a1cce92d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.754+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2028790804 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce71800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.754+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2028790804 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce772e0 0x55a1cce786f0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.754+0000 7fcc69533b80 1 -- 172.21.15.70:0/2028790804 >> 172.21.15.70:0/2028790804 conn(0x55a1ccde9860 msgr2=0x55a1cce77fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:49:26.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.755+0000 7fcc69533b80 1 -- 172.21.15.70:0/2028790804 shutdown_connections 2024-05-08T07:49:26.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.755+0000 7fcc69533b80 1 -- 172.21.15.70:0/2028790804 wait complete. 2024-05-08T07:49:26.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.755+0000 7fcc69533b80 1 -- start start 2024-05-08T07:49:26.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.756+0000 7fcc69533b80 1 Processor -- start 2024-05-08T07:49:26.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.757+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce827a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.757+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce82ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.757+0000 7fcc69533b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce77c00 0x55a1ccef5920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.757+0000 7fcc69533b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581b3ea0 con 0x55a1cce77c00 2024-05-08T07:49:26.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.757+0000 7fcc69533b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581b5310 con 0x55a1cce71e30 2024-05-08T07:49:26.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.757+0000 7fcc69533b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581b4570 con 0x55a1cce772e0 2024-05-08T07:49:26.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.757+0000 7fcc69533b80 10 client.0 _ll_register_callbacks cb 0x55a1ccd6ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:49:26.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc5cc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce77c00 0x55a1ccef5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc57400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce82ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc5cc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce77c00 0x55a1ccef5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48756/0 (socket says 172.21.15.70:48756) 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc5cc00700 1 -- 172.21.15.70:0/2024615619 learned_addr learned my addr 172.21.15.70:0/2024615619 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce827a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc5cc00700 1 -- 172.21.15.70:0/2024615619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 msgr2=0x55a1cce82ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc5cc00700 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce82ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc5cc00700 1 -- 172.21.15.70:0/2024615619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 msgr2=0x55a1cce827a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc5cc00700 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce827a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc5cc00700 1 -- 172.21.15.70:0/2024615619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ccef5e60 con 0x55a1cce77c00 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.758+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.759+0000 7fcc5cc00700 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce77c00 0x55a1ccef5920 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fcc48011400 tx=0x7fcc480117c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294183fa737a0387 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.759+0000 7fcc46000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.759+0000 7fcc57400700 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce82ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.759+0000 7fcc46000700 1 -- 172.21.15.70:0/2024615619 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48004440 con 0x55a1cce77c00 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.759+0000 7fcc46000700 1 -- 172.21.15.70:0/2024615619 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(205..205 src has 1..205) ==== 9583+0+0 (secure 0 0 0) 0x7fcc48003680 con 0x55a1cce77c00 2024-05-08T07:49:26.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.760+0000 7fcc69533b80 1 -- 172.21.15.70:0/2024615619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc40024b90 con 0x55a1cce77c00 2024-05-08T07:49:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.760+0000 7fcc46000700 1 -- 172.21.15.70:0/2024615619 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcc48003880 con 0x55a1cce77c00 2024-05-08T07:49:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.760+0000 7fcc69533b80 10 client.17220 fetch_fsmap learned FSMap version 42 2024-05-08T07:49:26.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.760+0000 7fcc69533b80 1 -- 172.21.15.70:0/2024615619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a1ccef7030 con 0x55a1cce77c00 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.761+0000 7fcc46000700 1 -- 172.21.15.70:0/2024615619 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc40024b90 con 0x55a1cce77c00 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.761+0000 7fcc46000700 1 -- 172.21.15.70:0/2024615619 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fcc4801ba30 con 0x55a1cce77c00 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.761+0000 7fcc69533b80 10 client.17220 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.761+0000 7fcc69533b80 10 client.17220 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.761+0000 7fcc69533b80 20 client.17220 populate_metadata read hostname 'smithi070' 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.761+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1ccef77c0 0x55a1ccef9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.761+0000 7fcc69533b80 4 client.17220 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 74.6, "await_for": 42.0}] 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.761+0000 7fcc69533b80 1 -- 172.21.15.70:0/2024615619 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 74.6, "await_for": 42.0}) -- 0x55a1ccdd1590 con 0x55a1ccef77c0 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.762+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1ccef77c0 0x55a1ccef9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:49:26.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.763+0000 7fcc57e00700 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1ccef77c0 0x55a1ccef9be0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b43cbdf3aec548f4 server_cookie=d3f21c32a86d67fd in_seq=0 out_seq=0 2024-05-08T07:49:26.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:26.763+0000 7fcc46000700 10 client.17220 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:49:27.809 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:27 smithi194 ceph-mon[33679]: pgmap v2001: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 355 KiB/s wr, 24 op/s 2024-05-08T07:49:27.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:27 smithi070 ceph-mon[29591]: pgmap v2001: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 355 KiB/s wr, 24 op/s 2024-05-08T07:49:27.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:27 smithi172 ceph-mon[33377]: pgmap v2001: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 355 KiB/s wr, 24 op/s 2024-05-08T07:49:29.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:29 smithi070 ceph-mon[29591]: pgmap v2002: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 355 KiB/s wr, 24 op/s 2024-05-08T07:49:29.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:29 smithi172 ceph-mon[33377]: pgmap v2002: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 355 KiB/s wr, 24 op/s 2024-05-08T07:49:30.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:29 smithi194 ceph-mon[33679]: pgmap v2002: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 355 KiB/s wr, 24 op/s 2024-05-08T07:49:31.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:31 smithi070 ceph-mon[29591]: pgmap v2003: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 459 KiB/s wr, 123 op/s 2024-05-08T07:49:31.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:31 smithi172 ceph-mon[33377]: pgmap v2003: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 459 KiB/s wr, 123 op/s 2024-05-08T07:49:32.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:31 smithi194 ceph-mon[33679]: pgmap v2003: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 404 KiB/s rd, 459 KiB/s wr, 123 op/s 2024-05-08T07:49:33.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:33 smithi070 ceph-mon[29591]: pgmap v2004: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 334 KiB/s wr, 113 op/s 2024-05-08T07:49:33.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:33 smithi172 ceph-mon[33377]: pgmap v2004: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 334 KiB/s wr, 113 op/s 2024-05-08T07:49:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:33 smithi194 ceph-mon[33679]: pgmap v2004: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 334 KiB/s wr, 113 op/s 2024-05-08T07:49:35.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:35 smithi070 ceph-mon[29591]: pgmap v2005: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 401 KiB/s wr, 116 op/s 2024-05-08T07:49:35.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:35 smithi172 ceph-mon[33377]: pgmap v2005: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 401 KiB/s wr, 116 op/s 2024-05-08T07:49:36.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:35 smithi194 ceph-mon[33679]: pgmap v2005: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 401 KiB/s wr, 116 op/s 2024-05-08T07:49:37.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:37 smithi070 ceph-mon[29591]: pgmap v2006: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 229 KiB/s wr, 106 op/s 2024-05-08T07:49:37.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:37 smithi172 ceph-mon[33377]: pgmap v2006: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 229 KiB/s wr, 106 op/s 2024-05-08T07:49:38.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:37 smithi194 ceph-mon[33679]: pgmap v2006: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 229 KiB/s wr, 106 op/s 2024-05-08T07:49:39.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:39 smithi070 ceph-mon[29591]: pgmap v2007: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 229 KiB/s wr, 106 op/s 2024-05-08T07:49:39.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:39 smithi172 ceph-mon[33377]: pgmap v2007: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 229 KiB/s wr, 106 op/s 2024-05-08T07:49:40.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:39 smithi194 ceph-mon[33679]: pgmap v2007: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 229 KiB/s wr, 106 op/s 2024-05-08T07:49:41.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:41 smithi070 ceph-mon[29591]: pgmap v2008: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 251 KiB/s wr, 109 op/s 2024-05-08T07:49:41.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:41 smithi172 ceph-mon[33377]: pgmap v2008: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 251 KiB/s wr, 109 op/s 2024-05-08T07:49:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:41 smithi194 ceph-mon[33679]: pgmap v2008: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 251 KiB/s wr, 109 op/s 2024-05-08T07:49:43.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:43 smithi070 ceph-mon[29591]: pgmap v2009: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2024-05-08T07:49:43.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:43 smithi172 ceph-mon[33377]: pgmap v2009: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2024-05-08T07:49:44.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:43 smithi194 ceph-mon[33679]: pgmap v2009: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 89 KiB/s wr, 6 op/s 2024-05-08T07:49:45.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:45 smithi070 ceph-mon[29591]: pgmap v2010: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 129 KiB/s wr, 10 op/s 2024-05-08T07:49:45.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:45 smithi172 ceph-mon[33377]: pgmap v2010: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 129 KiB/s wr, 10 op/s 2024-05-08T07:49:46.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:45 smithi194 ceph-mon[33679]: pgmap v2010: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 129 KiB/s wr, 10 op/s 2024-05-08T07:49:47.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:47 smithi070 ceph-mon[29591]: pgmap v2011: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2024-05-08T07:49:47.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:47 smithi172 ceph-mon[33377]: pgmap v2011: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2024-05-08T07:49:48.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:47 smithi194 ceph-mon[33679]: pgmap v2011: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2024-05-08T07:49:48.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.317+0000 7fcc46000700 1 -- 172.21.15.70:0/2024615619 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55a1ccdd1590 con 0x55a1ccef77c0 2024-05-08T07:49:48.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.317+0000 7fcc46000700 10 client.17220 handle_command_reply: tid=0 2024-05-08T07:49:48.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.317+0000 7fcc69533b80 1 client.17220 shutdown 2024-05-08T07:49:48.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.318+0000 7fcc69533b80 1 -- 172.21.15.70:0/2024615619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce77c00 msgr2=0x55a1ccef5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:48.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.318+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce77c00 0x55a1ccef5920 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fcc48011400 tx=0x7fcc480117c0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.318+0000 7fcc69533b80 1 -- 172.21.15.70:0/2024615619 shutdown_connections 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.318+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1ccef77c0 0x55a1ccef9be0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.318+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1cce77c00 0x55a1ccef5920 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.318+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1cce71e30 0x55a1cce827a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.318+0000 7fcc69533b80 1 --2- 172.21.15.70:0/2024615619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1cce772e0 0x55a1cce82ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.318+0000 7fcc69533b80 1 -- 172.21.15.70:0/2024615619 >> 172.21.15.70:0/2024615619 conn(0x55a1ccde9860 msgr2=0x55a1cce78870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.318+0000 7fcc46000700 0 client.17220 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.319+0000 7fcc69533b80 1 -- 172.21.15.70:0/2024615619 shutdown_connections 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.319+0000 7fcc69533b80 1 -- 172.21.15.70:0/2024615619 wait complete. 2024-05-08T07:49:48.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.319+0000 7fcc69533b80 20 client.17220 trim_cache size 0 max 16384 2024-05-08T07:49:48.316 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:49:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:49:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:49:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 154, 2024-05-08T07:49:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:49:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "7d055cb8": { 2024-05-08T07:49:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 154, 2024-05-08T07:49:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:49:48.316 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 74.6, 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:49:48.317 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:49:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:49:48.318 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:49:48.318 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:49:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 -- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2b70 msgr2=0x7fcc3c0b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2b70 0x7fcc3c0b5030 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcc5806cb50 tx=0x7fcc4000d040 comp rx=0 tx=0).stop 2024-05-08T07:49:48.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 -- 172.21.15.70:0/3286610765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc58102050 msgr2=0x7fcc581a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:49:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc58102050 0x7fcc581a0010 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc500098e0 tx=0x7fcc500057c0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 -- 172.21.15.70:0/3286610765 shutdown_connections 2024-05-08T07:49:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2b70 0x7fcc3c0b5030 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc58107650 0x7fcc581a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc58102050 0x7fcc581a0010 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 --2- 172.21.15.70:0/3286610765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc58102970 0x7fcc581a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:49:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.321+0000 7fcc5d600700 1 -- 172.21.15.70:0/3286610765 >> 172.21.15.70:0/3286610765 conn(0x7fcc580fdcf0 msgr2=0x7fcc581050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:49:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.323+0000 7fcc5d600700 1 -- 172.21.15.70:0/3286610765 shutdown_connections 2024-05-08T07:49:48.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:49:48.323+0000 7fcc5d600700 1 -- 172.21.15.70:0/3286610765 wait complete. 2024-05-08T07:49:49.765 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7d055cb8', quiesce took 34.9 seconds. Will release after: 14.6 2024-05-08T07:49:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:49 smithi070 ceph-mon[29591]: pgmap v2012: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2024-05-08T07:49:49.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:49 smithi172 ceph-mon[33377]: pgmap v2012: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2024-05-08T07:49:50.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:49 smithi194 ceph-mon[33679]: pgmap v2012: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 6 op/s 2024-05-08T07:49:51.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:51 smithi070 ceph-mon[29591]: pgmap v2013: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 9 op/s 2024-05-08T07:49:51.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:51 smithi172 ceph-mon[33377]: pgmap v2013: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 9 op/s 2024-05-08T07:49:52.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:51 smithi194 ceph-mon[33679]: pgmap v2013: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 81 KiB/s wr, 9 op/s 2024-05-08T07:49:53.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:53 smithi070 ceph-mon[29591]: pgmap v2014: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2024-05-08T07:49:53.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:53 smithi172 ceph-mon[33377]: pgmap v2014: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2024-05-08T07:49:54.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:53 smithi194 ceph-mon[33679]: pgmap v2014: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 6 op/s 2024-05-08T07:49:55.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:55 smithi070 ceph-mon[29591]: pgmap v2015: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 74 KiB/s wr, 11 op/s 2024-05-08T07:49:55.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:55 smithi172 ceph-mon[33377]: pgmap v2015: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 74 KiB/s wr, 11 op/s 2024-05-08T07:49:56.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:55 smithi194 ceph-mon[33679]: pgmap v2015: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 74 KiB/s wr, 11 op/s 2024-05-08T07:49:57.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:57 smithi070 ceph-mon[29591]: pgmap v2016: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T07:49:57.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:57 smithi172 ceph-mon[33377]: pgmap v2016: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T07:49:58.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:57 smithi194 ceph-mon[33679]: pgmap v2016: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T07:49:58.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:49:58.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:49:59.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:49:59.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:49:59 smithi070 ceph-mon[29591]: pgmap v2017: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T07:49:59.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:49:59 smithi172 ceph-mon[33377]: pgmap v2017: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T07:50:00.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:49:59 smithi194 ceph-mon[33679]: pgmap v2017: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T07:50:00.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T07:50:00.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:00.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T07:50:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:01.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:01.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T07:50:01.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:01.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:01.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:01 smithi172 ceph-mon[33377]: pgmap v2018: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 59 KiB/s wr, 10 op/s 2024-05-08T07:50:01.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:01 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:01.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:01 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:02.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:01 smithi194 ceph-mon[33679]: pgmap v2018: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 59 KiB/s wr, 10 op/s 2024-05-08T07:50:02.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:01 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:02.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:01 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:02.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:01 smithi070 ceph-mon[29591]: pgmap v2018: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 59 KiB/s wr, 10 op/s 2024-05-08T07:50:02.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:01 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:02.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:01 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:03.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:03.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:03.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:03.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:03.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:04.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:03 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:50:04.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:03 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:50:04.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:03 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:50:04.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:03 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:50:04.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:03 smithi194 ceph-mon[33679]: pgmap v2019: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-05-08T07:50:04.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:03 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:50:04.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:03 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:50:04.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:03 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:50:04.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:03 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:50:04.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:03 smithi070 ceph-mon[29591]: pgmap v2019: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-05-08T07:50:04.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:03 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T07:50:04.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:03 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T07:50:04.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:03 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T07:50:04.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:03 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T07:50:04.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:03 smithi172 ceph-mon[33377]: pgmap v2019: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 40 KiB/s wr, 7 op/s 2024-05-08T07:50:04.366 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:50:04.818 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:50:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:04 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:50:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:50:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:50:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:05.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:04 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:50:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:50:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:50:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:05.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:05.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:05.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:05.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T07:50:05.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:04 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T07:50:05.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:50:05.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:50:05.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:50:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:05 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:50:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:05 smithi194 ceph-mon[33679]: pgmap v2020: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 85 KiB/s wr, 27 op/s 2024-05-08T07:50:06.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:05 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:50:06.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:05 smithi070 ceph-mon[29591]: pgmap v2020: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 85 KiB/s wr, 27 op/s 2024-05-08T07:50:06.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:05 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T07:50:06.176 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:05 smithi172 ceph-mon[33377]: pgmap v2020: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 85 KiB/s wr, 27 op/s 2024-05-08T07:50:07.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:06 smithi172 ceph-mon[33377]: osdmap e206: 12 total, 12 up, 12 in 2024-05-08T07:50:07.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:06 smithi172 ceph-mon[33377]: pgmap v2022: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 26 op/s 2024-05-08T07:50:07.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:06 smithi070 ceph-mon[29591]: osdmap e206: 12 total, 12 up, 12 in 2024-05-08T07:50:07.209 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:06 smithi070 ceph-mon[29591]: pgmap v2022: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 26 op/s 2024-05-08T07:50:07.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:06 smithi194 ceph-mon[33679]: osdmap e206: 12 total, 12 up, 12 in 2024-05-08T07:50:07.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:06 smithi194 ceph-mon[33679]: pgmap v2022: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 26 op/s 2024-05-08T07:50:07.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.730+0000 7fd253200700 1 -- 172.21.15.70:0/107677519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c10b6e0 msgr2=0x7fd24c10bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:07.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.730+0000 7fd253200700 1 --2- 172.21.15.70:0/107677519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c10b6e0 0x7fd24c10bac0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009990 tx=0x7fd23c009ca0 comp rx=0 tx=0).stop 2024-05-08T07:50:07.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.730+0000 7fd253200700 1 -- 172.21.15.70:0/107677519 shutdown_connections 2024-05-08T07:50:07.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.730+0000 7fd253200700 1 --2- 172.21.15.70:0/107677519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd24c1060a0 0x7fd24c1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:07.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.730+0000 7fd253200700 1 --2- 172.21.15.70:0/107677519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c10b6e0 0x7fd24c10bac0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:07.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.730+0000 7fd253200700 1 --2- 172.21.15.70:0/107677519 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd24c1056e0 0x7fd24c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:07.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.730+0000 7fd253200700 1 -- 172.21.15.70:0/107677519 >> 172.21.15.70:0/107677519 conn(0x7fd24c1011d0 msgr2=0x7fd24c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:07.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.730+0000 7fd253200700 1 -- 172.21.15.70:0/107677519 shutdown_connections 2024-05-08T07:50:07.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.730+0000 7fd253200700 1 -- 172.21.15.70:0/107677519 wait complete. 2024-05-08T07:50:07.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.731+0000 7fd253200700 1 Processor -- start 2024-05-08T07:50:07.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.731+0000 7fd253200700 1 -- start start 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.731+0000 7fd253200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c1056e0 0x7fd24c1a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.731+0000 7fd253200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd24c1060a0 0x7fd24c1a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.731+0000 7fd253200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd24c10b6e0 0x7fd24c19bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.731+0000 7fd253200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1157d0 con 0x7fd24c1056e0 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.731+0000 7fd253200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c115650 con 0x7fd24c1060a0 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.731+0000 7fd253200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c115950 con 0x7fd24c10b6e0 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd24be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c1056e0 0x7fd24c1a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd24be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c1056e0 0x7fd24c1a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49496/0 (socket says 172.21.15.70:49496) 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd24be00700 1 -- 172.21.15.70:0/3611104330 learned_addr learned my addr 172.21.15.70:0/3611104330 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd251200700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd24c10b6e0 0x7fd24c19bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:07.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd24b400700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd24c1060a0 0x7fd24c1a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd24be00700 1 -- 172.21.15.70:0/3611104330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd24c10b6e0 msgr2=0x7fd24c19bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd24be00700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd24c10b6e0 0x7fd24c19bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd24be00700 1 -- 172.21.15.70:0/3611104330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd24c1060a0 msgr2=0x7fd24c1a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd24be00700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd24c1060a0 0x7fd24c1a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd24be00700 1 -- 172.21.15.70:0/3611104330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c19c290 con 0x7fd24c1056e0 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.732+0000 7fd251200700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd24c10b6e0 0x7fd24c19bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.733+0000 7fd24be00700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c1056e0 0x7fd24c1a1920 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd23c005910 tx=0x7fd23c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.733+0000 7fd248c00700 1 -- 172.21.15.70:0/3611104330 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c027070 con 0x7fd24c1056e0 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.733+0000 7fd248c00700 1 -- 172.21.15.70:0/3611104330 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd23c00fc00 con 0x7fd24c1056e0 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.733+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c19c520 con 0x7fd24c1056e0 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.733+0000 7fd248c00700 1 -- 172.21.15.70:0/3611104330 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c022d40 con 0x7fd24c1056e0 2024-05-08T07:50:07.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.734+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24c1a87f0 con 0x7fd24c1056e0 2024-05-08T07:50:07.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.735+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24c06a190 con 0x7fd24c1056e0 2024-05-08T07:50:07.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.736+0000 7fd248c00700 1 -- 172.21.15.70:0/3611104330 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd23c02a070 con 0x7fd24c1056e0 2024-05-08T07:50:07.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.738+0000 7fd248c00700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2300b2a70 0x7fd2300b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:07.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.738+0000 7fd248c00700 1 -- 172.21.15.70:0/3611104330 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 9671+0+0 (secure 0 0 0) 0x7fd23c0e3730 con 0x7fd24c1056e0 2024-05-08T07:50:07.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.738+0000 7fd24b400700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2300b2a70 0x7fd2300b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:07.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.739+0000 7fd24b400700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2300b2a70 0x7fd2300b4f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd238005950 tx=0x7fd2380058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:07.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:07.743+0000 7fd248c00700 1 -- 172.21.15.70:0/3611104330 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd23c013070 con 0x7fd24c1056e0 2024-05-08T07:50:08.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.026+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd24c19cfd0 con 0x7fd24c1056e0 2024-05-08T07:50:08.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.027+0000 7fd248c00700 1 -- 172.21.15.70:0/3611104330 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fd23c0aacc0 con 0x7fd24c1056e0 2024-05-08T07:50:08.022 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:50:08.023 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:50:08.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.030+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2300b2a70 msgr2=0x7fd2300b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:08.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.030+0000 7fd253200700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2300b2a70 0x7fd2300b4f30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd238005950 tx=0x7fd2380058e0 comp rx=0 tx=0).stop 2024-05-08T07:50:08.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.030+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c1056e0 msgr2=0x7fd24c1a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:08.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.030+0000 7fd253200700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c1056e0 0x7fd24c1a1920 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd23c005910 tx=0x7fd23c0047b0 comp rx=0 tx=0).stop 2024-05-08T07:50:08.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.031+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 shutdown_connections 2024-05-08T07:50:08.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.031+0000 7fd253200700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd2300b2a70 0x7fd2300b4f30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:08.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.031+0000 7fd253200700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd24c10b6e0 0x7fd24c19bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:08.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.031+0000 7fd253200700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd24c1056e0 0x7fd24c1a1920 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:08.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.031+0000 7fd253200700 1 --2- 172.21.15.70:0/3611104330 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd24c1060a0 0x7fd24c1a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:08.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.031+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 >> 172.21.15.70:0/3611104330 conn(0x7fd24c1011d0 msgr2=0x7fd24c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:08.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.031+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 shutdown_connections 2024-05-08T07:50:08.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:08.031+0000 7fd253200700 1 -- 172.21.15.70:0/3611104330 wait complete. 2024-05-08T07:50:08.027 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:50:08.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3611104330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:50:08.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3611104330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:50:08.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3611104330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:50:08.947 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 7d055cb8 --release --await' 2024-05-08T07:50:08.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 7d055cb8 --release --await 2024-05-08T07:50:09.389 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:50:09.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:09 smithi070 ceph-mon[29591]: pgmap v2023: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 26 op/s 2024-05-08T07:50:09.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:09 smithi172 ceph-mon[33377]: pgmap v2023: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 26 op/s 2024-05-08T07:50:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:09 smithi194 ceph-mon[33679]: pgmap v2023: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 83 KiB/s wr, 26 op/s 2024-05-08T07:50:11.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.711+0000 7fb992800700 1 -- 172.21.15.70:0/2369323073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c0756d0 msgr2=0x7fb98c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:11.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.711+0000 7fb992800700 1 --2- 172.21.15.70:0/2369323073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c0756d0 0x7fb98c075ab0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009990 tx=0x7fb97c009ca0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.712+0000 7fb992800700 1 -- 172.21.15.70:0/2369323073 shutdown_connections 2024-05-08T07:50:11.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.712+0000 7fb992800700 1 --2- 172.21.15.70:0/2369323073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb98c114670 0x7fb98c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.712+0000 7fb992800700 1 --2- 172.21.15.70:0/2369323073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c0756d0 0x7fb98c075ab0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.712+0000 7fb992800700 1 --2- 172.21.15.70:0/2369323073 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb98c075ff0 0x7fb98c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.712+0000 7fb992800700 1 -- 172.21.15.70:0/2369323073 >> 172.21.15.70:0/2369323073 conn(0x7fb98c07a600 msgr2=0x7fb98c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.712+0000 7fb992800700 1 -- 172.21.15.70:0/2369323073 shutdown_connections 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.712+0000 7fb992800700 1 -- 172.21.15.70:0/2369323073 wait complete. 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.713+0000 7fb992800700 1 Processor -- start 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.713+0000 7fb992800700 1 -- start start 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.713+0000 7fb992800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb98c0756d0 0x7fb98c1a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.713+0000 7fb992800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb98c075ff0 0x7fb98c1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.713+0000 7fb992800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c114670 0x7fb98c1a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.713+0000 7fb992800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c119b30 con 0x7fb98c114670 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.713+0000 7fb992800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c1199b0 con 0x7fb98c0756d0 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.713+0000 7fb992800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c119cb0 con 0x7fb98c075ff0 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c114670 0x7fb98c1a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c114670 0x7fb98c1a4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49512/0 (socket says 172.21.15.70:49512) 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98be00700 1 -- 172.21.15.70:0/2024041832 learned_addr learned my addr 172.21.15.70:0/2024041832 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98b400700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb98c0756d0 0x7fb98c1a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98aa00700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb98c075ff0 0x7fb98c1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98be00700 1 -- 172.21.15.70:0/2024041832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb98c075ff0 msgr2=0x7fb98c1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98be00700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb98c075ff0 0x7fb98c1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98be00700 1 -- 172.21.15.70:0/2024041832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb98c0756d0 msgr2=0x7fb98c1a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98be00700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb98c0756d0 0x7fb98c1a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.714+0000 7fb98be00700 1 -- 172.21.15.70:0/2024041832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98c1a50b0 con 0x7fb98c114670 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.715+0000 7fb98be00700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c114670 0x7fb98c1a4970 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb9840094f0 tx=0x7fb984007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.715+0000 7fb983e00700 1 -- 172.21.15.70:0/2024041832 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984004db0 con 0x7fb98c114670 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.715+0000 7fb983e00700 1 -- 172.21.15.70:0/2024041832 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb984005020 con 0x7fb98c114670 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.715+0000 7fb992800700 1 -- 172.21.15.70:0/2024041832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98c1a53a0 con 0x7fb98c114670 2024-05-08T07:50:11.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.715+0000 7fb983e00700 1 -- 172.21.15.70:0/2024041832 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984015660 con 0x7fb98c114670 2024-05-08T07:50:11.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.715+0000 7fb992800700 1 -- 172.21.15.70:0/2024041832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb98c1acc20 con 0x7fb98c114670 2024-05-08T07:50:11.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.718+0000 7fb983e00700 1 -- 172.21.15.70:0/2024041832 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb9840051d0 con 0x7fb98c114670 2024-05-08T07:50:11.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.720+0000 7fb983e00700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9700b2a70 0x7fb9700b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.720+0000 7fb983e00700 1 -- 172.21.15.70:0/2024041832 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(206..206 src has 1..206) ==== 9671+0+0 (secure 0 0 0) 0x7fb9840e2490 con 0x7fb98c114670 2024-05-08T07:50:11.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.720+0000 7fb98b400700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9700b2a70 0x7fb9700b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.721+0000 7fb98b400700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9700b2a70 0x7fb9700b4f30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00b5c0 tx=0x7fb97c01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:11.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.752+0000 7fb99d13db80 1 Processor -- start 2024-05-08T07:50:11.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.752+0000 7fb99d13db80 1 -- start start 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf55ec0 0x55b76cf562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50490 0x55b76cf50910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 0x55b76cf5cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb99d13db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b76cea2b20 con 0x55b76cf55ec0 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb99d13db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b76ce40860 con 0x55b76cf50e50 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb99d13db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b76ce9eae0 con 0x55b76cf50490 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb98b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf55ec0 0x55b76cf562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb98b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf55ec0 0x55b76cf562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49516/0 (socket says 172.21.15.70:49516) 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb98b400700 1 -- 172.21.15.70:0/2640551409 learned_addr learned my addr 172.21.15.70:0/2640551409 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:11.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.753+0000 7fb98aa00700 1 --2- 172.21.15.70:0/2640551409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50490 0x55b76cf50910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.754+0000 7fb98be00700 1 --2- 172.21.15.70:0/2640551409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 0x55b76cf5cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.754+0000 7fb98b400700 1 -- 172.21.15.70:0/2640551409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50490 msgr2=0x55b76cf50910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:11.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.754+0000 7fb98b400700 1 --2- 172.21.15.70:0/2640551409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50490 0x55b76cf50910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.754+0000 7fb98b400700 1 -- 172.21.15.70:0/2640551409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 msgr2=0x55b76cf5cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:11.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.754+0000 7fb98b400700 1 --2- 172.21.15.70:0/2640551409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 0x55b76cf5cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.754+0000 7fb98b400700 1 -- 172.21.15.70:0/2640551409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76cdef9d0 con 0x55b76cf55ec0 2024-05-08T07:50:11.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.754+0000 7fb98b400700 1 --2- 172.21.15.70:0/2640551409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf55ec0 0x55b76cf562a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009990 tx=0x7fb97c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86326d6698916853 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:11.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.755+0000 7fb980c00700 1 -- 172.21.15.70:0/2640551409 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00f760 con 0x55b76cf55ec0 2024-05-08T07:50:11.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.755+0000 7fb980c00700 1 -- 172.21.15.70:0/2640551409 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb97c032070 con 0x55b76cf55ec0 2024-05-08T07:50:11.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.755+0000 7fb980c00700 1 -- 172.21.15.70:0/2640551409 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c023ad0 con 0x55b76cf55ec0 2024-05-08T07:50:11.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.756+0000 7fb99d13db80 1 -- 172.21.15.70:0/2640551409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf55ec0 msgr2=0x55b76cf562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:11.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.756+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2640551409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf55ec0 0x55b76cf562a0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009990 tx=0x7fb97c01e000 comp rx=0 tx=0).stop 2024-05-08T07:50:11.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.756+0000 7fb99d13db80 1 -- 172.21.15.70:0/2640551409 shutdown_connections 2024-05-08T07:50:11.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.756+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2640551409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 0x55b76cf5cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.756+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2640551409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf55ec0 0x55b76cf562a0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.756+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2640551409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50490 0x55b76cf50910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.756+0000 7fb99d13db80 1 -- 172.21.15.70:0/2640551409 >> 172.21.15.70:0/2640551409 conn(0x55b76ce7ec60 msgr2=0x55b76cf4ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:11.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.756+0000 7fb99d13db80 1 -- 172.21.15.70:0/2640551409 shutdown_connections 2024-05-08T07:50:11.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.756+0000 7fb99d13db80 1 -- 172.21.15.70:0/2640551409 wait complete. 2024-05-08T07:50:11.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.757+0000 7fb99d13db80 1 -- start start 2024-05-08T07:50:11.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.757+0000 7fb99d13db80 1 Processor -- start 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf5c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 0x55b76cf59c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 0x55b76cf5a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb99d13db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b76cf5d220 con 0x55b76cf50490 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb99d13db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b76ce08c20 con 0x55b76cf55ec0 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb99d13db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b76cf5d3a0 con 0x55b76cf50e50 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb99d13db80 10 client.0 _ll_register_callbacks cb 0x55b76ce49d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf5c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf5c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49518/0 (socket says 172.21.15.70:49518) 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98b400700 1 -- 172.21.15.70:0/3562210060 learned_addr learned my addr 172.21.15.70:0/3562210060 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98aa00700 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 0x55b76cf59c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98be00700 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 0x55b76cf5a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98b400700 1 -- 172.21.15.70:0/3562210060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 msgr2=0x55b76cf59c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:11.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98b400700 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 0x55b76cf59c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98b400700 1 -- 172.21.15.70:0/3562210060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 msgr2=0x55b76cf5a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:11.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98b400700 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 0x55b76cf5a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98b400700 1 -- 172.21.15.70:0/3562210060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76ce68520 con 0x55b76cf50490 2024-05-08T07:50:11.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.758+0000 7fb98be00700 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 0x55b76cf5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:50:11.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.759+0000 7fb98b400700 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf5c810 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0094e0 tx=0x7fb97c023af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6ff679777ec2ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:11.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.759+0000 7fb975600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:50:11.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.759+0000 7fb975600700 1 -- 172.21.15.70:0/3562210060 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c004c60 con 0x55b76cf50490 2024-05-08T07:50:11.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.759+0000 7fb975600700 1 -- 172.21.15.70:0/3562210060 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 9671+0+0 (secure 0 0 0) 0x7fb97c004e00 con 0x55b76cf50490 2024-05-08T07:50:11.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.759+0000 7fb99d13db80 1 -- 172.21.15.70:0/3562210060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb97c032070 con 0x55b76cf50490 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.759+0000 7fb975600700 1 -- 172.21.15.70:0/3562210060 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb97c046050 con 0x55b76cf50490 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb99d13db80 10 client.17238 fetch_fsmap learned FSMap version 42 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb99d13db80 1 -- 172.21.15.70:0/3562210060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b76cf679d0 con 0x55b76cf50490 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb975600700 1 -- 172.21.15.70:0/3562210060 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb97c032070 con 0x55b76cf50490 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb975600700 1 -- 172.21.15.70:0/3562210060 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fb97c00fb40 con 0x55b76cf50490 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb99d13db80 10 client.17238 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb99d13db80 10 client.17238 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb99d13db80 20 client.17238 populate_metadata read hostname 'smithi070' 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b76cf69ea0 0x55b76cf6c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb99d13db80 4 client.17238 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.760+0000 7fb99d13db80 1 -- 172.21.15.70:0/3562210060 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b76cf1d1a0 con 0x55b76cf69ea0 2024-05-08T07:50:11.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.761+0000 7fb98aa00700 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b76cf69ea0 0x55b76cf6c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.762+0000 7fb98aa00700 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b76cf69ea0 0x55b76cf6c290 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d16398eefe0fe95b server_cookie=2f016c8dd0f6be90 in_seq=0 out_seq=0 2024-05-08T07:50:11.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.762+0000 7fb975600700 10 client.17238 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:50:11.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb975600700 1 -- 172.21.15.70:0/3562210060 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b76cf1d1a0 con 0x55b76cf69ea0 2024-05-08T07:50:11.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb975600700 10 client.17238 handle_command_reply: tid=0 2024-05-08T07:50:11.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb99d13db80 1 client.17238 shutdown 2024-05-08T07:50:11.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb99d13db80 1 -- 172.21.15.70:0/3562210060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 msgr2=0x55b76cf5c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:11.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf5c810 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0094e0 tx=0x7fb97c023af0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb99d13db80 1 -- 172.21.15.70:0/3562210060 shutdown_connections 2024-05-08T07:50:11.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b76cf69ea0 0x55b76cf6c290 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 0x55b76cf5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf5c810 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3562210060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 0x55b76cf59c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb975600700 0 client.17238 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:50:11.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.764+0000 7fb99d13db80 1 -- 172.21.15.70:0/3562210060 >> 172.21.15.70:0/3562210060 conn(0x55b76ce7ec60 msgr2=0x55b76cf45850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:11.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.765+0000 7fb99d13db80 1 -- 172.21.15.70:0/3562210060 shutdown_connections 2024-05-08T07:50:11.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.765+0000 7fb99d13db80 1 -- 172.21.15.70:0/3562210060 wait complete. 2024-05-08T07:50:11.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.765+0000 7fb99d13db80 20 client.17238 trim_cache size 0 max 16384 2024-05-08T07:50:11.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.786+0000 7fb99d13db80 1 Processor -- start 2024-05-08T07:50:11.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.787+0000 7fb99d13db80 1 -- start start 2024-05-08T07:50:11.783 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:11 smithi070 ceph-mon[29591]: pgmap v2024: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 26 op/s 2024-05-08T07:50:11.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.787+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.787+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 0x55b76cf6f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.787+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf55ec0 0x55b76cf65660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.787+0000 7fb99d13db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c1b85c0 con 0x55b76cf50490 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.787+0000 7fb99d13db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c1b5e50 con 0x55b76cf50e50 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.787+0000 7fb99d13db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c1b3cc0 con 0x55b76cf55ec0 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49534/0 (socket says 172.21.15.70:49534) 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98b400700 1 -- 172.21.15.70:0/3294699773 learned_addr learned my addr 172.21.15.70:0/3294699773 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98aa00700 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 0x55b76cf6f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98be00700 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf55ec0 0x55b76cf65660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98b400700 1 -- 172.21.15.70:0/3294699773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf55ec0 msgr2=0x55b76cf65660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98b400700 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf55ec0 0x55b76cf65660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98b400700 1 -- 172.21.15.70:0/3294699773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 msgr2=0x55b76cf6f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98b400700 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 0x55b76cf6f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98b400700 1 -- 172.21.15.70:0/3294699773 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b76cf47980 con 0x55b76cf50490 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.788+0000 7fb98aa00700 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 0x55b76cf6f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.789+0000 7fb98b400700 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6f2b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009350 tx=0x7fb97c023720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396f6cb61ed78e78 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:11.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.789+0000 7fb977e00700 1 -- 172.21.15.70:0/3294699773 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0400d0 con 0x55b76cf50490 2024-05-08T07:50:11.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.789+0000 7fb977e00700 1 -- 172.21.15.70:0/3294699773 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb97c032040 con 0x55b76cf50490 2024-05-08T07:50:11.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.789+0000 7fb977e00700 1 -- 172.21.15.70:0/3294699773 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c036650 con 0x55b76cf50490 2024-05-08T07:50:11.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.790+0000 7fb99d13db80 1 -- 172.21.15.70:0/3294699773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 msgr2=0x55b76cf6f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.790+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6f2b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009350 tx=0x7fb97c023720 comp rx=0 tx=0).stop 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.790+0000 7fb99d13db80 1 -- 172.21.15.70:0/3294699773 shutdown_connections 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.790+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf55ec0 0x55b76cf65660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.790+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6f2b0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.790+0000 7fb99d13db80 1 --2- 172.21.15.70:0/3294699773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf50e50 0x55b76cf6f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.790+0000 7fb99d13db80 1 -- 172.21.15.70:0/3294699773 >> 172.21.15.70:0/3294699773 conn(0x55b76ce7ec60 msgr2=0x55b76cf4fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.790+0000 7fb99d13db80 1 -- 172.21.15.70:0/3294699773 shutdown_connections 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.790+0000 7fb99d13db80 1 -- 172.21.15.70:0/3294699773 wait complete. 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.791+0000 7fb99d13db80 1 -- start start 2024-05-08T07:50:11.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.791+0000 7fb99d13db80 1 Processor -- start 2024-05-08T07:50:11.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 0x55b76cf6e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb99d13db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 0x55b76cfd43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb99d13db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c1b4310 con 0x55b76cf50490 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb99d13db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c1b5780 con 0x55b76cf55ec0 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb99d13db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb98c1b49e0 con 0x55b76cf50e50 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb99d13db80 10 client.0 _ll_register_callbacks cb 0x55b76ce49d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb98b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb98b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49536/0 (socket says 172.21.15.70:49536) 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb98b400700 1 -- 172.21.15.70:0/2581080551 learned_addr learned my addr 172.21.15.70:0/2581080551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb98be00700 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 0x55b76cfd43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.792+0000 7fb98aa00700 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 0x55b76cf6e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.793+0000 7fb98b400700 1 -- 172.21.15.70:0/2581080551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 msgr2=0x55b76cf6e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.793+0000 7fb98b400700 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 0x55b76cf6e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.793+0000 7fb98b400700 1 -- 172.21.15.70:0/2581080551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 msgr2=0x55b76cfd43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.793+0000 7fb98b400700 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 0x55b76cfd43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.793+0000 7fb98b400700 1 -- 172.21.15.70:0/2581080551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b76cf6eff0 con 0x55b76cf50490 2024-05-08T07:50:11.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.793+0000 7fb98b400700 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6e1e0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00ff10 tx=0x7fb97c040900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45314dfdbb2a9159 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:11.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.793+0000 7fb975600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.794+0000 7fb975600700 1 -- 172.21.15.70:0/2581080551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c04e020 con 0x55b76cf50490 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.794+0000 7fb975600700 1 -- 172.21.15.70:0/2581080551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(206..206 src has 1..206) ==== 9671+0+0 (secure 0 0 0) 0x7fb97c040a60 con 0x55b76cf50490 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.794+0000 7fb99d13db80 1 -- 172.21.15.70:0/2581080551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb97c032040 con 0x55b76cf50490 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.794+0000 7fb975600700 1 -- 172.21.15.70:0/2581080551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb97c040c60 con 0x55b76cf50490 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.794+0000 7fb99d13db80 10 client.17244 fetch_fsmap learned FSMap version 42 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.794+0000 7fb99d13db80 1 -- 172.21.15.70:0/2581080551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b76cfd5a50 con 0x55b76cf50490 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.794+0000 7fb975600700 1 -- 172.21.15.70:0/2581080551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb97c032040 con 0x55b76cf50490 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.795+0000 7fb975600700 1 -- 172.21.15.70:0/2581080551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fb97c04a7a0 con 0x55b76cf50490 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.795+0000 7fb99d13db80 10 client.17244 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.795+0000 7fb99d13db80 10 client.17244 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:50:11.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.795+0000 7fb99d13db80 20 client.17244 populate_metadata read hostname 'smithi070' 2024-05-08T07:50:11.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.795+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b76cfd5eb0 0x55b76cfd82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:11.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.795+0000 7fb99d13db80 4 client.17244 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7d055cb8", "release": true, "await": true}] 2024-05-08T07:50:11.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.795+0000 7fb99d13db80 1 -- 172.21.15.70:0/2581080551 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7d055cb8", "release": true, "await": true}) -- 0x55b76ceb0500 con 0x55b76cfd5eb0 2024-05-08T07:50:11.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.796+0000 7fb98aa00700 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b76cfd5eb0 0x55b76cfd82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:11.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.797+0000 7fb975600700 10 client.17244 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:50:11.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:11.796+0000 7fb98aa00700 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b76cfd5eb0 0x55b76cfd82a0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59a046a2ec7b36a6 server_cookie=2ae29e23dc6ed1b2 in_seq=0 out_seq=0 2024-05-08T07:50:11.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:11 smithi172 ceph-mon[33377]: pgmap v2024: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 26 op/s 2024-05-08T07:50:12.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:11 smithi194 ceph-mon[33679]: pgmap v2024: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 26 op/s 2024-05-08T07:50:13.850 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:13 smithi070 ceph-mon[29591]: pgmap v2025: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 26 op/s 2024-05-08T07:50:13.850 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:13 smithi070 ceph-mon[29591]: osdmap e207: 12 total, 12 up, 12 in 2024-05-08T07:50:13.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:13 smithi172 ceph-mon[33377]: pgmap v2025: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 26 op/s 2024-05-08T07:50:13.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:13 smithi172 ceph-mon[33377]: osdmap e207: 12 total, 12 up, 12 in 2024-05-08T07:50:14.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:13 smithi194 ceph-mon[33679]: pgmap v2025: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 70 KiB/s wr, 26 op/s 2024-05-08T07:50:14.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:13 smithi194 ceph-mon[33679]: osdmap e207: 12 total, 12 up, 12 in 2024-05-08T07:50:15.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:15 smithi070 ceph-mon[29591]: pgmap v2027: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-05-08T07:50:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:15 smithi172 ceph-mon[33377]: pgmap v2027: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-05-08T07:50:16.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:15 smithi194 ceph-mon[33679]: pgmap v2027: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-05-08T07:50:16.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.091+0000 7fb975600700 1 -- 172.21.15.70:0/2581080551 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55b76ceb0500 con 0x55b76cfd5eb0 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.091+0000 7fb975600700 10 client.17244 handle_command_reply: tid=0 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.091+0000 7fb99d13db80 1 client.17244 shutdown 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 -- 172.21.15.70:0/2581080551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 msgr2=0x55b76cf6e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6e1e0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00ff10 tx=0x7fb97c040900 comp rx=0 tx=0).stop 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 -- 172.21.15.70:0/2581080551 shutdown_connections 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b76cfd5eb0 0x55b76cfd82a0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b76cf55ec0 0x55b76cfd43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b76cf50490 0x55b76cf6e1e0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 --2- 172.21.15.70:0/2581080551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b76cf50e50 0x55b76cf6e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 -- 172.21.15.70:0/2581080551 >> 172.21.15.70:0/2581080551 conn(0x55b76ce7ec60 msgr2=0x55b76cf44fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb975600700 0 client.17244 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 -- 172.21.15.70:0/2581080551 shutdown_connections 2024-05-08T07:50:16.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.092+0000 7fb99d13db80 1 -- 172.21.15.70:0/2581080551 wait complete. 2024-05-08T07:50:16.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.093+0000 7fb99d13db80 20 client.17244 trim_cache size 0 max 16384 2024-05-08T07:50:16.090 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:50:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:50:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:50:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 156, 2024-05-08T07:50:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:50:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "7d055cb8": { 2024-05-08T07:50:16.090 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 156, 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 74.6, 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:50:16.091 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:50:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:50:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:50:16.092 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:50:16.092 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:50:16.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.094+0000 7fb992800700 1 -- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9700b2a70 msgr2=0x7fb9700b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:16.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.094+0000 7fb992800700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9700b2a70 0x7fb9700b4f30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb97c00b5c0 tx=0x7fb97c01a040 comp rx=0 tx=0).stop 2024-05-08T07:50:16.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.094+0000 7fb992800700 1 -- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c114670 msgr2=0x7fb98c1a4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:16.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.094+0000 7fb992800700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c114670 0x7fb98c1a4970 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb9840094f0 tx=0x7fb984007f90 comp rx=0 tx=0).stop 2024-05-08T07:50:16.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.095+0000 7fb992800700 1 -- 172.21.15.70:0/2024041832 shutdown_connections 2024-05-08T07:50:16.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.095+0000 7fb992800700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9700b2a70 0x7fb9700b4f30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:16.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.095+0000 7fb992800700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb98c114670 0x7fb98c1a4970 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:16.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.095+0000 7fb992800700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb98c0756d0 0x7fb98c1a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:16.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.095+0000 7fb992800700 1 --2- 172.21.15.70:0/2024041832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb98c075ff0 0x7fb98c1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:16.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.095+0000 7fb992800700 1 -- 172.21.15.70:0/2024041832 >> 172.21.15.70:0/2024041832 conn(0x7fb98c07a600 msgr2=0x7fb98c113510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:16.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.095+0000 7fb992800700 1 -- 172.21.15.70:0/2024041832 shutdown_connections 2024-05-08T07:50:16.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:16.095+0000 7fb992800700 1 -- 172.21.15.70:0/2024041832 wait complete. 2024-05-08T07:50:16.957 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7d055cb8', seconds elapsed: 62.1 2024-05-08T07:50:17.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:17 smithi070 ceph-mon[29591]: pgmap v2028: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 KiB/s wr, 8 op/s 2024-05-08T07:50:17.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:17 smithi172 ceph-mon[33377]: pgmap v2028: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 KiB/s wr, 8 op/s 2024-05-08T07:50:18.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:17 smithi194 ceph-mon[33679]: pgmap v2028: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 KiB/s wr, 8 op/s 2024-05-08T07:50:18.831 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/jitterentropy.o 2024-05-08T07:50:18.831 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/zhaoxin.o 2024-05-08T07:50:18.946 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/futex/syscalls.o 2024-05-08T07:50:18.952 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/secretmem.o 2024-05-08T07:50:18.994 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/jbd2/commit.o 2024-05-08T07:50:19.119 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/extents_status.o 2024-05-08T07:50:19.142 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/jitterentropy-kcapi.o 2024-05-08T07:50:19.340 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/platform/efi/efi_64.o 2024-05-08T07:50:19.453 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-sysfs.o 2024-05-08T07:50:19.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:19 smithi070 ceph-mon[29591]: pgmap v2029: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 KiB/s wr, 8 op/s 2024-05-08T07:50:19.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:19 smithi172 ceph-mon[33377]: pgmap v2029: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 KiB/s wr, 8 op/s 2024-05-08T07:50:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:19 smithi194 ceph-mon[33679]: pgmap v2029: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 KiB/s wr, 8 op/s 2024-05-08T07:50:21.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:21 smithi070 ceph-mon[29591]: pgmap v2030: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 181 KiB/s wr, 171 op/s 2024-05-08T07:50:21.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:21 smithi172 ceph-mon[33377]: pgmap v2030: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 181 KiB/s wr, 171 op/s 2024-05-08T07:50:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:21 smithi194 ceph-mon[33679]: pgmap v2030: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 181 KiB/s wr, 171 op/s 2024-05-08T07:50:23.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:23 smithi070 ceph-mon[29591]: pgmap v2031: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 181 KiB/s wr, 171 op/s 2024-05-08T07:50:23.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:23 smithi172 ceph-mon[33377]: pgmap v2031: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 181 KiB/s wr, 171 op/s 2024-05-08T07:50:24.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:23 smithi194 ceph-mon[33679]: pgmap v2031: 129 pgs: 129 active+clean; 1.8 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 181 KiB/s wr, 171 op/s 2024-05-08T07:50:25.087 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/perfctr-watchdog.o 2024-05-08T07:50:25.353 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/ghash-generic.o 2024-05-08T07:50:25.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:25 smithi070 ceph-mon[29591]: pgmap v2032: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 343 KiB/s wr, 166 op/s 2024-05-08T07:50:25.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:25 smithi172 ceph-mon[33377]: pgmap v2032: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 343 KiB/s wr, 166 op/s 2024-05-08T07:50:26.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:25 smithi194 ceph-mon[33679]: pgmap v2032: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 343 KiB/s wr, 166 op/s 2024-05-08T07:50:27.433 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/jbd2/recovery.o 2024-05-08T07:50:27.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:27 smithi194 ceph-mon[33679]: pgmap v2033: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 306 KiB/s wr, 148 op/s 2024-05-08T07:50:27.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:27 smithi070 ceph-mon[29591]: pgmap v2033: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 306 KiB/s wr, 148 op/s 2024-05-08T07:50:27.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:27 smithi172 ceph-mon[33377]: pgmap v2033: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 306 KiB/s wr, 148 op/s 2024-05-08T07:50:28.306 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/memfd.o 2024-05-08T07:50:29.198 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/futex/pi.o 2024-05-08T07:50:29.664 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/file.o 2024-05-08T07:50:29.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:29 smithi194 ceph-mon[33679]: pgmap v2034: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 306 KiB/s wr, 148 op/s 2024-05-08T07:50:29.777 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-flush.o 2024-05-08T07:50:29.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:29 smithi070 ceph-mon[29591]: pgmap v2034: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 306 KiB/s wr, 148 op/s 2024-05-08T07:50:29.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:29 smithi172 ceph-mon[33377]: pgmap v2034: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 306 KiB/s wr, 148 op/s 2024-05-08T07:50:30.065 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/platform/efi/efi_stub_64.o 2024-05-08T07:50:31.511 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/platform/efi/efi_thunk_64.o 2024-05-08T07:50:31.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:31 smithi070 ceph-mon[29591]: pgmap v2035: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 435 KiB/s wr, 159 op/s 2024-05-08T07:50:31.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:31 smithi172 ceph-mon[33377]: pgmap v2035: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 435 KiB/s wr, 159 op/s 2024-05-08T07:50:32.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:31 smithi194 ceph-mon[33679]: pgmap v2035: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 435 KiB/s wr, 159 op/s 2024-05-08T07:50:32.374 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/platform/efi/runtime-map.o 2024-05-08T07:50:32.604 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/hash_info.o 2024-05-08T07:50:33.643 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/rsapubkey.asn1.o 2024-05-08T07:50:33.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:33 smithi070 ceph-mon[29591]: pgmap v2036: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 292 KiB/s wr, 20 op/s 2024-05-08T07:50:33.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:33 smithi172 ceph-mon[33377]: pgmap v2036: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 292 KiB/s wr, 20 op/s 2024-05-08T07:50:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:33 smithi194 ceph-mon[33679]: pgmap v2036: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 292 KiB/s wr, 20 op/s 2024-05-08T07:50:34.164 INFO:tasks.workunit.client.0.smithi070.stdout: CC crypto/rsaprivkey.asn1.o 2024-05-08T07:50:34.663 INFO:tasks.workunit.client.0.smithi070.stdout: AR crypto/built-in.a 2024-05-08T07:50:34.851 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/vmware.o 2024-05-08T07:50:35.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:35 smithi070 ceph-mon[29591]: pgmap v2037: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 468 KiB/s wr, 115 op/s 2024-05-08T07:50:35.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:35 smithi172 ceph-mon[33377]: pgmap v2037: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 468 KiB/s wr, 115 op/s 2024-05-08T07:50:36.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:35 smithi194 ceph-mon[33679]: pgmap v2037: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 468 KiB/s wr, 115 op/s 2024-05-08T07:50:36.040 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/futex/requeue.o 2024-05-08T07:50:36.429 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/iris/built-in.a 2024-05-08T07:50:36.536 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/futex/waitwake.o 2024-05-08T07:50:36.758 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/jbd2/checkpoint.o 2024-05-08T07:50:37.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:37 smithi070 ceph-mon[29591]: pgmap v2038: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 304 KiB/s wr, 106 op/s 2024-05-08T07:50:37.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:37 smithi172 ceph-mon[33377]: pgmap v2038: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 304 KiB/s wr, 106 op/s 2024-05-08T07:50:38.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:37 smithi194 ceph-mon[33679]: pgmap v2038: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 304 KiB/s wr, 106 op/s 2024-05-08T07:50:39.056 INFO:tasks.workunit.client.0.smithi070.stdout: CC mm/ptdump.o 2024-05-08T07:50:39.127 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-settings.o 2024-05-08T07:50:39.795 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/fsmap.o 2024-05-08T07:50:39.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:39 smithi070 ceph-mon[29591]: pgmap v2039: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 304 KiB/s wr, 106 op/s 2024-05-08T07:50:39.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:39 smithi172 ceph-mon[33377]: pgmap v2039: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 304 KiB/s wr, 106 op/s 2024-05-08T07:50:40.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:39 smithi194 ceph-mon[33679]: pgmap v2039: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 304 KiB/s wr, 106 op/s 2024-05-08T07:50:41.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:41 smithi070 ceph-mon[29591]: pgmap v2040: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 489 KiB/s wr, 118 op/s 2024-05-08T07:50:41.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:41 smithi172 ceph-mon[33377]: pgmap v2040: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 489 KiB/s wr, 118 op/s 2024-05-08T07:50:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:41 smithi194 ceph-mon[33679]: pgmap v2040: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 489 KiB/s wr, 118 op/s 2024-05-08T07:50:42.017 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/efi/built-in.a 2024-05-08T07:50:42.183 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/hypervisor.o 2024-05-08T07:50:42.349 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/io_uring.o 2024-05-08T07:50:42.797 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/platform/intel/iosf_mbi.o 2024-05-08T07:50:42.872 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/futex/built-in.a 2024-05-08T07:50:43.356 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/cgroup.o 2024-05-08T07:50:43.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:43 smithi070 ceph-mon[29591]: pgmap v2041: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 360 KiB/s wr, 107 op/s 2024-05-08T07:50:43.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:43 smithi172 ceph-mon[33377]: pgmap v2041: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 360 KiB/s wr, 107 op/s 2024-05-08T07:50:44.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:43 smithi194 ceph-mon[33679]: pgmap v2041: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 360 KiB/s wr, 107 op/s 2024-05-08T07:50:44.073 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.7 2024-05-08T07:50:44.074 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:50:45.010 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:50:45.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:45 smithi070 ceph-mon[29591]: pgmap v2042: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 556 KiB/s wr, 120 op/s 2024-05-08T07:50:45.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/jbd2/revoke.o 2024-05-08T07:50:45.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:45 smithi172 ceph-mon[33377]: pgmap v2042: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 556 KiB/s wr, 120 op/s 2024-05-08T07:50:46.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:45 smithi194 ceph-mon[33679]: pgmap v2042: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 556 KiB/s wr, 120 op/s 2024-05-08T07:50:47.219 INFO:tasks.workunit.client.0.smithi070.stdout: AR mm/built-in.a 2024-05-08T07:50:47.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:47 smithi070 ceph-mon[29591]: pgmap v2043: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 380 KiB/s wr, 25 op/s 2024-05-08T07:50:47.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:47 smithi172 ceph-mon[33377]: pgmap v2043: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 380 KiB/s wr, 25 op/s 2024-05-08T07:50:48.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:47 smithi194 ceph-mon[33679]: pgmap v2043: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 380 KiB/s wr, 25 op/s 2024-05-08T07:50:48.570 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/jbd2/journal.o 2024-05-08T07:50:49.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:49 smithi172 ceph-mon[33377]: pgmap v2044: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 380 KiB/s wr, 25 op/s 2024-05-08T07:50:50.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:49 smithi194 ceph-mon[33679]: pgmap v2044: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 380 KiB/s wr, 25 op/s 2024-05-08T07:50:50.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:49 smithi070 ceph-mon[29591]: pgmap v2044: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 380 KiB/s wr, 25 op/s 2024-05-08T07:50:51.496 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/mshyperv.o 2024-05-08T07:50:51.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:51 smithi070 ceph-mon[29591]: pgmap v2045: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 583 KiB/s wr, 153 op/s 2024-05-08T07:50:51.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:51 smithi172 ceph-mon[33377]: pgmap v2045: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 583 KiB/s wr, 153 op/s 2024-05-08T07:50:52.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:51 smithi194 ceph-mon[33679]: pgmap v2045: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 583 KiB/s wr, 153 op/s 2024-05-08T07:50:52.230 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-ioc.o 2024-05-08T07:50:52.308 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/intel/built-in.a 2024-05-08T07:50:52.482 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/fsync.o 2024-05-08T07:50:52.676 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/intel-mid/built-in.a 2024-05-08T07:50:52.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.700+0000 7f3b81600700 1 -- 172.21.15.70:0/1600422155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b7c10ee60 msgr2=0x7f3b7c1169f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:52.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.700+0000 7f3b81600700 1 --2- 172.21.15.70:0/1600422155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b7c10ee60 0x7f3b7c1169f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400b0d0 tx=0x7f3b7400b3e0 comp rx=0 tx=0).stop 2024-05-08T07:50:52.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.701+0000 7f3b81600700 1 -- 172.21.15.70:0/1600422155 shutdown_connections 2024-05-08T07:50:52.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.701+0000 7f3b81600700 1 --2- 172.21.15.70:0/1600422155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b7c10ee60 0x7f3b7c1169f0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:52.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.701+0000 7f3b81600700 1 --2- 172.21.15.70:0/1600422155 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c10a540 0x7f3b7c10a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:52.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.701+0000 7f3b81600700 1 --2- 172.21.15.70:0/1600422155 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7c10aef0 0x7f3b7c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:52.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.701+0000 7f3b81600700 1 -- 172.21.15.70:0/1600422155 >> 172.21.15.70:0/1600422155 conn(0x7f3b7c079370 msgr2=0x7f3b7c07b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:52.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.701+0000 7f3b81600700 1 -- 172.21.15.70:0/1600422155 shutdown_connections 2024-05-08T07:50:52.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.701+0000 7f3b81600700 1 -- 172.21.15.70:0/1600422155 wait complete. 2024-05-08T07:50:52.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.702+0000 7f3b81600700 1 Processor -- start 2024-05-08T07:50:52.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.703+0000 7f3b81600700 1 -- start start 2024-05-08T07:50:52.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.703+0000 7f3b81600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7c10a540 0x7f3b7c1a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:52.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.703+0000 7f3b81600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c10aef0 0x7f3b7c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:52.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.703+0000 7f3b81600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b7c10ee60 0x7f3b7c1a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:52.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.703+0000 7f3b81600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c119be0 con 0x7f3b7c10ee60 2024-05-08T07:50:52.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.703+0000 7f3b81600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c119a60 con 0x7f3b7c10a540 2024-05-08T07:50:52.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.703+0000 7f3b81600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c119d60 con 0x7f3b7c10aef0 2024-05-08T07:50:52.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.704+0000 7f3b7aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7c10a540 0x7f3b7c1a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:52.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.704+0000 7f3b7aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7c10a540 0x7f3b7c1a00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:51316/0 (socket says 172.21.15.70:51316) 2024-05-08T07:50:52.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.704+0000 7f3b7aa00700 1 -- 172.21.15.70:0/2789189981 learned_addr learned my addr 172.21.15.70:0/2789189981 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:52.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.704+0000 7f3b7b400700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b7c10ee60 0x7f3b7c1a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:52.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.704+0000 7f3b7a000700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c10aef0 0x7f3b7c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:52.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.705+0000 7f3b7aa00700 1 -- 172.21.15.70:0/2789189981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c10aef0 msgr2=0x7f3b7c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:52.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.705+0000 7f3b7aa00700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c10aef0 0x7f3b7c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:52.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.705+0000 7f3b7aa00700 1 -- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b7c10ee60 msgr2=0x7f3b7c1a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:52.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.705+0000 7f3b7aa00700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b7c10ee60 0x7f3b7c1a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:52.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.705+0000 7f3b7aa00700 1 -- 172.21.15.70:0/2789189981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c1a5090 con 0x7f3b7c10a540 2024-05-08T07:50:52.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.706+0000 7f3b7aa00700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7c10a540 0x7f3b7c1a00d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00d980 tx=0x7f3b6c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:52.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.707+0000 7f3b73400700 1 -- 172.21.15.70:0/2789189981 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c017070 con 0x7f3b7c10a540 2024-05-08T07:50:52.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.707+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c1a5380 con 0x7f3b7c10a540 2024-05-08T07:50:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.707+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c1acc00 con 0x7f3b7c10a540 2024-05-08T07:50:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.707+0000 7f3b73400700 1 -- 172.21.15.70:0/2789189981 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b6c005020 con 0x7f3b7c10a540 2024-05-08T07:50:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.707+0000 7f3b73400700 1 -- 172.21.15.70:0/2789189981 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00f980 con 0x7f3b7c10a540 2024-05-08T07:50:52.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.709+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7c06a190 con 0x7f3b7c10a540 2024-05-08T07:50:52.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.715+0000 7f3b73400700 1 -- 172.21.15.70:0/2789189981 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3b6c004a30 con 0x7f3b7c10a540 2024-05-08T07:50:52.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.717+0000 7f3b73400700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b600b2af0 0x7f3b600b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:52.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.717+0000 7f3b73400700 1 -- 172.21.15.70:0/2789189981 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 9583+0+0 (secure 0 0 0) 0x7f3b6c0e2cd0 con 0x7f3b7c10a540 2024-05-08T07:50:52.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.718+0000 7f3b7a000700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b600b2af0 0x7f3b600b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:52.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.719+0000 7f3b7a000700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b600b2af0 0x7f3b600b4fb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c1106b0 tx=0x7f3b680073d0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:52.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:52.735+0000 7f3b73400700 1 -- 172.21.15.70:0/2789189981 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3b6c020020 con 0x7f3b7c10a540 2024-05-08T07:50:52.961 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/intel-quark/built-in.a 2024-05-08T07:50:53.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.237+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b7c1a13e0 con 0x7f3b7c10a540 2024-05-08T07:50:53.237 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:50:53.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.240+0000 7f3b73400700 1 -- 172.21.15.70:0/2789189981 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f3b6c0aa2b0 con 0x7f3b7c10a540 2024-05-08T07:50:53.237 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.248+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b600b2af0 msgr2=0x7f3b600b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.248+0000 7f3b81600700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b600b2af0 0x7f3b600b4fb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c1106b0 tx=0x7f3b680073d0 comp rx=0 tx=0).stop 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.248+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7c10a540 msgr2=0x7f3b7c1a00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.248+0000 7f3b81600700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7c10a540 0x7f3b7c1a00d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00d980 tx=0x7f3b6c00dc90 comp rx=0 tx=0).stop 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.249+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 shutdown_connections 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.249+0000 7f3b81600700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3b600b2af0 0x7f3b600b4fb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.249+0000 7f3b81600700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3b7c10ee60 0x7f3b7c1a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.249+0000 7f3b81600700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3b7c10a540 0x7f3b7c1a00d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.249+0000 7f3b81600700 1 --2- 172.21.15.70:0/2789189981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c10aef0 0x7f3b7c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:53.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.249+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 >> 172.21.15.70:0/2789189981 conn(0x7f3b7c079370 msgr2=0x7f3b7c10d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:53.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.249+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 shutdown_connections 2024-05-08T07:50:53.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:53.250+0000 7f3b81600700 1 -- 172.21.15.70:0/2789189981 wait complete. 2024-05-08T07:50:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:50:53.357 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/olpc/built-in.a 2024-05-08T07:50:53.838 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/scx200/built-in.a 2024-05-08T07:50:53.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:53 smithi070 ceph-mon[29591]: pgmap v2046: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 399 KiB/s wr, 140 op/s 2024-05-08T07:50:53.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:53 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2789189981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:50:53.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:53 smithi172 ceph-mon[33377]: pgmap v2046: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 399 KiB/s wr, 140 op/s 2024-05-08T07:50:53.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:53 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2789189981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:50:53.927 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/hash.o 2024-05-08T07:50:54.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:53 smithi194 ceph-mon[33679]: pgmap v2046: 129 pgs: 129 active+clean; 1.8 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 399 KiB/s wr, 140 op/s 2024-05-08T07:50:54.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:53 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2789189981' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:50:54.022 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/ts5500/built-in.a 2024-05-08T07:50:54.373 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/uv/built-in.a 2024-05-08T07:50:54.561 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/platform/built-in.a 2024-05-08T07:50:55.146 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 85.7 --await-for 42.0' 2024-05-08T07:50:55.146 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 85.7 --await-for 42.0 2024-05-08T07:50:55.664 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/xattr.o 2024-05-08T07:50:55.817 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:50:55.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:55 smithi172 ceph-mon[33377]: pgmap v2047: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 593 KiB/s wr, 224 op/s 2024-05-08T07:50:55.988 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:55 smithi070 ceph-mon[29591]: pgmap v2047: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 593 KiB/s wr, 224 op/s 2024-05-08T07:50:56.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:55 smithi194 ceph-mon[33679]: pgmap v2047: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 593 KiB/s wr, 224 op/s 2024-05-08T07:50:57.541 INFO:tasks.workunit.client.0.smithi070.stdout: LDS arch/x86/kernel/vmlinux.lds 2024-05-08T07:50:57.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:57 smithi070 ceph-mon[29591]: pgmap v2048: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 397 KiB/s wr, 211 op/s 2024-05-08T07:50:57.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:57 smithi172 ceph-mon[33377]: pgmap v2048: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 397 KiB/s wr, 211 op/s 2024-05-08T07:50:58.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:57 smithi194 ceph-mon[33679]: pgmap v2048: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 397 KiB/s wr, 211 op/s 2024-05-08T07:50:58.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.244+0000 7fab86600700 1 -- 172.21.15.70:0/1065222750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab80108650 msgr2=0x7fab80110220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:58.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.244+0000 7fab86600700 1 --2- 172.21.15.70:0/1065222750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab80108650 0x7fab80110220 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fab7800b0d0 tx=0x7fab7800b3e0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.244+0000 7fab86600700 1 -- 172.21.15.70:0/1065222750 shutdown_connections 2024-05-08T07:50:58.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.244+0000 7fab86600700 1 --2- 172.21.15.70:0/1065222750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab80108650 0x7fab80110220 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.244+0000 7fab86600700 1 --2- 172.21.15.70:0/1065222750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab80103570 0x7fab80103950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.244+0000 7fab86600700 1 --2- 172.21.15.70:0/1065222750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab80103f20 0x7fab80107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.244+0000 7fab86600700 1 -- 172.21.15.70:0/1065222750 >> 172.21.15.70:0/1065222750 conn(0x7fab800fee40 msgr2=0x7fab80101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:58.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.245+0000 7fab86600700 1 -- 172.21.15.70:0/1065222750 shutdown_connections 2024-05-08T07:50:58.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.245+0000 7fab86600700 1 -- 172.21.15.70:0/1065222750 wait complete. 2024-05-08T07:50:58.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.247+0000 7fab86600700 1 Processor -- start 2024-05-08T07:50:58.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.247+0000 7fab86600700 1 -- start start 2024-05-08T07:50:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.248+0000 7fab86600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab80103570 0x7fab8010fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.248+0000 7fab86600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab80103f20 0x7fab80110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.248+0000 7fab86600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab80108650 0x7fab8010de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.249+0000 7fab7fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab80103f20 0x7fab80110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.249+0000 7fab7fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab80103f20 0x7fab80110150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:55102/0 (socket says 172.21.15.70:55102) 2024-05-08T07:50:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.249+0000 7fab7fe00700 1 -- 172.21.15.70:0/1529048487 learned_addr learned my addr 172.21.15.70:0/1529048487 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.249+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fab80111240 con 0x7fab80108650 2024-05-08T07:50:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.249+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab801110c0 con 0x7fab80103f20 2024-05-08T07:50:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.249+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fab801113c0 con 0x7fab80103570 2024-05-08T07:50:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.249+0000 7fab85c00700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab80108650 0x7fab8010de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.249+0000 7fab85200700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab80103570 0x7fab8010fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.250+0000 7fab7fe00700 1 -- 172.21.15.70:0/1529048487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab80103570 msgr2=0x7fab8010fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.250+0000 7fab7fe00700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab80103570 0x7fab8010fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.250+0000 7fab7fe00700 1 -- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab80108650 msgr2=0x7fab8010de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.250+0000 7fab7fe00700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab80108650 0x7fab8010de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.250+0000 7fab7fe00700 1 -- 172.21.15.70:0/1529048487 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8010e790 con 0x7fab80103f20 2024-05-08T07:50:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.251+0000 7fab7fe00700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab80103f20 0x7fab80110150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e9f0 tx=0x7fab6c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.251+0000 7fab7d600700 1 -- 172.21.15.70:0/1529048487 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c004a30 con 0x7fab80103f20 2024-05-08T07:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.251+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8010ea80 con 0x7fab80103f20 2024-05-08T07:50:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.251+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab801ac9f0 con 0x7fab80103f20 2024-05-08T07:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.251+0000 7fab7d600700 1 -- 172.21.15.70:0/1529048487 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab6c00cc50 con 0x7fab80103f20 2024-05-08T07:50:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.252+0000 7fab7d600700 1 -- 172.21.15.70:0/1529048487 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c005490 con 0x7fab80103f20 2024-05-08T07:50:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.257+0000 7fab7d600700 1 -- 172.21.15.70:0/1529048487 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fab6c021440 con 0x7fab80103f20 2024-05-08T07:50:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.259+0000 7fab7d600700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fab680b2bf0 0x7fab680b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.260+0000 7fab7d600700 1 -- 172.21.15.70:0/1529048487 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(207..207 src has 1..207) ==== 9583+0+0 (secure 0 0 0) 0x7fab6c0e3a90 con 0x7fab80103f20 2024-05-08T07:50:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.260+0000 7fab85200700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fab680b2bf0 0x7fab680b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.281+0000 7fab85200700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fab680b2bf0 0x7fab680b50b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fab74007be0 tx=0x7fab740073d0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:58.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.284+0000 7fab92635b80 1 Processor -- start 2024-05-08T07:50:58.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.285+0000 7fab92635b80 1 -- start start 2024-05-08T07:50:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.285+0000 7fab92635b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a95ff0 0x564520a963d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.285+0000 7fab92635b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a96910 0x564520a90520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.285+0000 7fab92635b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.285+0000 7fab92635b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5645209e2bb0 con 0x564520a96910 2024-05-08T07:50:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.285+0000 7fab92635b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5645209808f0 con 0x564520a95ff0 2024-05-08T07:50:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.285+0000 7fab92635b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5645209deb70 con 0x564520a90b40 2024-05-08T07:50:58.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.286+0000 7fab85c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.286+0000 7fab85c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:51710/0 (socket says 172.21.15.70:51710) 2024-05-08T07:50:58.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.286+0000 7fab85c00700 1 -- 172.21.15.70:0/3505203050 learned_addr learned my addr 172.21.15.70:0/3505203050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:58.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.286+0000 7fab85200700 1 --2- 172.21.15.70:0/3505203050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a95ff0 0x564520a963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.286+0000 7fab7fe00700 1 --2- 172.21.15.70:0/3505203050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a96910 0x564520a90520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.287+0000 7fab85c00700 1 -- 172.21.15.70:0/3505203050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a95ff0 msgr2=0x564520a963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:58.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.287+0000 7fab85c00700 1 --2- 172.21.15.70:0/3505203050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a95ff0 0x564520a963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.287+0000 7fab85c00700 1 -- 172.21.15.70:0/3505203050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a96910 msgr2=0x564520a90520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:58.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.287+0000 7fab85c00700 1 --2- 172.21.15.70:0/3505203050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a96910 0x564520a90520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.287+0000 7fab85c00700 1 -- 172.21.15.70:0/3505203050 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56452092fa60 con 0x564520a90b40 2024-05-08T07:50:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.288+0000 7fab85c00700 1 --2- 172.21.15.70:0/3505203050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90fa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fab78009e10 tx=0x7fab78005ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c2c2294da74eeae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.288+0000 7fab72000700 1 -- 172.21.15.70:0/3505203050 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7800baa0 con 0x564520a90b40 2024-05-08T07:50:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.288+0000 7fab72000700 1 -- 172.21.15.70:0/3505203050 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab78020030 con 0x564520a90b40 2024-05-08T07:50:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.288+0000 7fab72000700 1 -- 172.21.15.70:0/3505203050 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab78005580 con 0x564520a90b40 2024-05-08T07:50:58.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.290+0000 7fab92635b80 1 -- 172.21.15.70:0/3505203050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 msgr2=0x564520a90fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:58.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.290+0000 7fab92635b80 1 --2- 172.21.15.70:0/3505203050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90fa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fab78009e10 tx=0x7fab78005ac0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.290+0000 7fab92635b80 1 -- 172.21.15.70:0/3505203050 shutdown_connections 2024-05-08T07:50:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.290+0000 7fab92635b80 1 --2- 172.21.15.70:0/3505203050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90fa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.290+0000 7fab92635b80 1 --2- 172.21.15.70:0/3505203050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a95ff0 0x564520a963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.290+0000 7fab92635b80 1 --2- 172.21.15.70:0/3505203050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a96910 0x564520a90520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.290+0000 7fab92635b80 1 -- 172.21.15.70:0/3505203050 >> 172.21.15.70:0/3505203050 conn(0x5645209becf0 msgr2=0x564520a8b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.290+0000 7fab92635b80 1 -- 172.21.15.70:0/3505203050 shutdown_connections 2024-05-08T07:50:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.291+0000 7fab92635b80 1 -- 172.21.15.70:0/3505203050 wait complete. 2024-05-08T07:50:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.291+0000 7fab92635b80 1 -- start start 2024-05-08T07:50:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.291+0000 7fab92635b80 1 Processor -- start 2024-05-08T07:50:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.292+0000 7fab92635b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520a9c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.292+0000 7fab92635b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 0x564520a998a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.292+0000 7fab92635b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520a99de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.292+0000 7fab92635b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564520a9d3d0 con 0x564520a90b40 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.292+0000 7fab92635b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564520948cb0 con 0x564520a96910 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.292+0000 7fab92635b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564520a9d550 con 0x564520a95ff0 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.292+0000 7fab92635b80 10 client.0 _ll_register_callbacks cb 0x564520989e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.293+0000 7fab85c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520a99de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.293+0000 7fab85c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520a99de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:55114/0 (socket says 172.21.15.70:55114) 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.293+0000 7fab85c00700 1 -- 172.21.15.70:0/3557886599 learned_addr learned my addr 172.21.15.70:0/3557886599 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.293+0000 7fab85200700 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520a9c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.293+0000 7fab7fe00700 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 0x564520a998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.294+0000 7fab85c00700 1 -- 172.21.15.70:0/3557886599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 msgr2=0x564520a998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.294+0000 7fab85c00700 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 0x564520a998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.294+0000 7fab85c00700 1 -- 172.21.15.70:0/3557886599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 msgr2=0x564520a9c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.294+0000 7fab85c00700 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520a9c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.294+0000 7fab85c00700 1 -- 172.21.15.70:0/3557886599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645209a85b0 con 0x564520a96910 2024-05-08T07:50:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.294+0000 7fab85c00700 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520a99de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab7800b420 tx=0x7fab78004a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=191ec6520261a51f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.294+0000 7fab66a00700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T07:50:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.295+0000 7fab66a00700 1 -- 172.21.15.70:0/3557886599 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7802c070 con 0x564520a96910 2024-05-08T07:50:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.295+0000 7fab92635b80 1 -- 172.21.15.70:0/3557886599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab78020030 con 0x564520a96910 2024-05-08T07:50:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.295+0000 7fab66a00700 1 -- 172.21.15.70:0/3557886599 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(207..207 src has 1..207) ==== 9583+0+0 (secure 0 0 0) 0x7fab78005180 con 0x564520a96910 2024-05-08T07:50:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.295+0000 7fab66a00700 1 -- 172.21.15.70:0/3557886599 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fab78038050 con 0x564520a96910 2024-05-08T07:50:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.295+0000 7fab92635b80 10 client.36299 fetch_fsmap learned FSMap version 42 2024-05-08T07:50:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.295+0000 7fab92635b80 1 -- 172.21.15.70:0/3557886599 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x564520aa7b60 con 0x564520a96910 2024-05-08T07:50:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.296+0000 7fab66a00700 1 -- 172.21.15.70:0/3557886599 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab78020030 con 0x564520a96910 2024-05-08T07:50:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.297+0000 7fab66a00700 1 -- 172.21.15.70:0/3557886599 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fab78011070 con 0x564520a96910 2024-05-08T07:50:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.297+0000 7fab92635b80 10 client.36299 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:50:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.297+0000 7fab92635b80 10 client.36299 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:50:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.297+0000 7fab92635b80 20 client.36299 populate_metadata read hostname 'smithi070' 2024-05-08T07:50:58.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.297+0000 7fab92635b80 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564520aaa030 0x564520aac420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.297+0000 7fab92635b80 4 client.36299 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:50:58.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.297+0000 7fab92635b80 1 -- 172.21.15.70:0/3557886599 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564520a5d230 con 0x564520aaa030 2024-05-08T07:50:58.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.298+0000 7fab85200700 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564520aaa030 0x564520aac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.298+0000 7fab85200700 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564520aaa030 0x564520aac420 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a626e1e1ecd6a8f3 server_cookie=f60ece0233b6a2c1 in_seq=0 out_seq=0 2024-05-08T07:50:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.298+0000 7fab66a00700 10 client.36299 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:50:58.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.300+0000 7fab66a00700 1 -- 172.21.15.70:0/3557886599 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564520a5d230 con 0x564520aaa030 2024-05-08T07:50:58.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.300+0000 7fab66a00700 10 client.36299 handle_command_reply: tid=0 2024-05-08T07:50:58.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.300+0000 7fab92635b80 1 client.36299 shutdown 2024-05-08T07:50:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.300+0000 7fab92635b80 1 -- 172.21.15.70:0/3557886599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 msgr2=0x564520a99de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.300+0000 7fab92635b80 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520a99de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fab7800b420 tx=0x7fab78004a10 comp rx=0 tx=0).stop 2024-05-08T07:50:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.301+0000 7fab92635b80 1 -- 172.21.15.70:0/3557886599 shutdown_connections 2024-05-08T07:50:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.301+0000 7fab92635b80 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564520aaa030 0x564520aac420 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.301+0000 7fab92635b80 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520a99de0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.301+0000 7fab92635b80 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520a9c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.301+0000 7fab92635b80 1 --2- 172.21.15.70:0/3557886599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 0x564520a998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.301+0000 7fab92635b80 1 -- 172.21.15.70:0/3557886599 >> 172.21.15.70:0/3557886599 conn(0x5645209becf0 msgr2=0x564520a8af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.301+0000 7fab66a00700 0 client.36299 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:50:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.302+0000 7fab92635b80 1 -- 172.21.15.70:0/3557886599 shutdown_connections 2024-05-08T07:50:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.302+0000 7fab92635b80 1 -- 172.21.15.70:0/3557886599 wait complete. 2024-05-08T07:50:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.302+0000 7fab92635b80 20 client.36299 trim_cache size 0 max 16384 2024-05-08T07:50:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.341+0000 7fab92635b80 1 Processor -- start 2024-05-08T07:50:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.341+0000 7fab92635b80 1 -- start start 2024-05-08T07:50:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.341+0000 7fab92635b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.341+0000 7fab92635b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a95ff0 0x564520a991c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.341+0000 7fab92635b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520aa5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.341+0000 7fab92635b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fab60011800 con 0x564520a95ff0 2024-05-08T07:50:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.341+0000 7fab92635b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab6000f090 con 0x564520a96910 2024-05-08T07:50:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.341+0000 7fab92635b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fab6000cf00 con 0x564520a90b40 2024-05-08T07:50:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab7fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a95ff0 0x564520a991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab7fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a95ff0 0x564520a991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40000/0 (socket says 172.21.15.70:40000) 2024-05-08T07:50:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab7fe00700 1 -- 172.21.15.70:0/3514799705 learned_addr learned my addr 172.21.15.70:0/3514799705 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab85200700 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab85c00700 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520aa5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab85200700 1 -- 172.21.15.70:0/3514799705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 msgr2=0x564520aa5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab85200700 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520aa5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab85200700 1 -- 172.21.15.70:0/3514799705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a95ff0 msgr2=0x564520a991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab85200700 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a95ff0 0x564520a991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.342+0000 7fab85200700 1 -- 172.21.15.70:0/3514799705 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564520a9d5d0 con 0x564520a90b40 2024-05-08T07:50:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.343+0000 7fab7fe00700 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a95ff0 0x564520a991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:50:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.343+0000 7fab85200700 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab74011010 tx=0x7fab74013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4283bee8a4c77388 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.344+0000 7fab71600700 1 -- 172.21.15.70:0/3514799705 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7402e070 con 0x564520a90b40 2024-05-08T07:50:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.344+0000 7fab71600700 1 -- 172.21.15.70:0/3514799705 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab74015070 con 0x564520a90b40 2024-05-08T07:50:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.344+0000 7fab71600700 1 -- 172.21.15.70:0/3514799705 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74028490 con 0x564520a90b40 2024-05-08T07:50:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.345+0000 7fab92635b80 1 -- 172.21.15.70:0/3514799705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 msgr2=0x564520a90520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:50:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.345+0000 7fab92635b80 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90520 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab74011010 tx=0x7fab74013000 comp rx=0 tx=0).stop 2024-05-08T07:50:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.345+0000 7fab92635b80 1 -- 172.21.15.70:0/3514799705 shutdown_connections 2024-05-08T07:50:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.345+0000 7fab92635b80 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520aa5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.345+0000 7fab92635b80 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a90b40 0x564520a90520 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.345+0000 7fab92635b80 1 --2- 172.21.15.70:0/3514799705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a95ff0 0x564520a991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.345+0000 7fab92635b80 1 -- 172.21.15.70:0/3514799705 >> 172.21.15.70:0/3514799705 conn(0x5645209becf0 msgr2=0x564520aa5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:50:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.345+0000 7fab92635b80 1 -- 172.21.15.70:0/3514799705 shutdown_connections 2024-05-08T07:50:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.345+0000 7fab92635b80 1 -- 172.21.15.70:0/3514799705 wait complete. 2024-05-08T07:50:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.346+0000 7fab92635b80 1 -- start start 2024-05-08T07:50:58.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.346+0000 7fab92635b80 1 Processor -- start 2024-05-08T07:50:58.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab92635b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520aadb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab92635b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 0x564520aae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab92635b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520aae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab92635b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fab6000d550 con 0x564520a90b40 2024-05-08T07:50:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab92635b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fab6000e9c0 con 0x564520a96910 2024-05-08T07:50:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab92635b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fab6000dc20 con 0x564520a95ff0 2024-05-08T07:50:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab92635b80 10 client.0 _ll_register_callbacks cb 0x564520989e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:50:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab85200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520aadb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab85200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520aadb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40002/0 (socket says 172.21.15.70:40002) 2024-05-08T07:50:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.347+0000 7fab85200700 1 -- 172.21.15.70:0/3178853209 learned_addr learned my addr 172.21.15.70:0/3178853209 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:50:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.348+0000 7fab7fe00700 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 0x564520aae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.348+0000 7fab85c00700 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520aae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.348+0000 7fab85200700 1 -- 172.21.15.70:0/3178853209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 msgr2=0x564520aae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:58.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.348+0000 7fab85200700 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 0x564520aae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.348+0000 7fab85200700 1 -- 172.21.15.70:0/3178853209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 msgr2=0x564520aae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:50:58.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.348+0000 7fab85200700 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520aae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:50:58.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.348+0000 7fab85200700 1 -- 172.21.15.70:0/3178853209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564520b14560 con 0x564520a90b40 2024-05-08T07:50:58.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.348+0000 7fab85c00700 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520aae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:50:58.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.349+0000 7fab85200700 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520aadb60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fab740046c0 tx=0x7fab74003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59039ce09488b19 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:50:58.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.349+0000 7fab66a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:50:58.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.350+0000 7fab66a00700 1 -- 172.21.15.70:0/3178853209 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7402e070 con 0x564520a90b40 2024-05-08T07:50:58.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.350+0000 7fab66a00700 1 -- 172.21.15.70:0/3178853209 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(207..207 src has 1..207) ==== 9583+0+0 (secure 0 0 0) 0x7fab74003a90 con 0x564520a90b40 2024-05-08T07:50:58.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.350+0000 7fab92635b80 1 -- 172.21.15.70:0/3178853209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab74015070 con 0x564520a90b40 2024-05-08T07:50:58.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.350+0000 7fab66a00700 1 -- 172.21.15.70:0/3178853209 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fab74033460 con 0x564520a90b40 2024-05-08T07:50:58.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.350+0000 7fab92635b80 10 client.17268 fetch_fsmap learned FSMap version 42 2024-05-08T07:50:58.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.350+0000 7fab92635b80 1 -- 172.21.15.70:0/3178853209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x564520b15760 con 0x564520a90b40 2024-05-08T07:50:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.351+0000 7fab66a00700 1 -- 172.21.15.70:0/3178853209 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab74015070 con 0x564520a90b40 2024-05-08T07:50:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.351+0000 7fab66a00700 1 -- 172.21.15.70:0/3178853209 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fab74028ce0 con 0x564520a90b40 2024-05-08T07:50:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.351+0000 7fab92635b80 10 client.17268 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:50:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.351+0000 7fab92635b80 10 client.17268 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:50:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.351+0000 7fab92635b80 20 client.17268 populate_metadata read hostname 'smithi070' 2024-05-08T07:50:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.351+0000 7fab92635b80 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564520b15d30 0x564520b18150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:50:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.352+0000 7fab92635b80 4 client.17268 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.7, "await_for": 42.0}] 2024-05-08T07:50:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.352+0000 7fab92635b80 1 -- 172.21.15.70:0/3178853209 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.7, "await_for": 42.0}) -- 0x5645209f0590 con 0x564520b15d30 2024-05-08T07:50:58.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.352+0000 7fab7fe00700 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564520b15d30 0x564520b18150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:50:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.354+0000 7fab7fe00700 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564520b15d30 0x564520b18150 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86b2c9adece4ac02 server_cookie=869e34badeb90309 in_seq=0 out_seq=0 2024-05-08T07:50:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:50:58.354+0000 7fab66a00700 10 client.17268 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:50:59.515 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/rstat.o 2024-05-08T07:50:59.737 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/jbd2/built-in.a 2024-05-08T07:50:59.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:50:59 smithi172 ceph-mon[33377]: pgmap v2049: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 397 KiB/s wr, 211 op/s 2024-05-08T07:51:00.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:50:59 smithi194 ceph-mon[33679]: pgmap v2049: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 397 KiB/s wr, 211 op/s 2024-05-08T07:51:00.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:50:59 smithi070 ceph-mon[29591]: pgmap v2049: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 322 KiB/s rd, 397 KiB/s wr, 211 op/s 2024-05-08T07:51:01.897 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/nop.o 2024-05-08T07:51:02.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:01 smithi194 ceph-mon[33679]: pgmap v2050: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 671 KiB/s wr, 228 op/s 2024-05-08T07:51:02.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:01 smithi070 ceph-mon[29591]: pgmap v2050: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 671 KiB/s wr, 228 op/s 2024-05-08T07:51:02.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:01 smithi172 ceph-mon[33377]: pgmap v2050: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 671 KiB/s wr, 228 op/s 2024-05-08T07:51:04.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:03 smithi194 ceph-mon[33679]: pgmap v2051: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 468 KiB/s wr, 100 op/s 2024-05-08T07:51:04.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:03 smithi070 ceph-mon[29591]: pgmap v2051: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 468 KiB/s wr, 100 op/s 2024-05-08T07:51:04.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:03 smithi172 ceph-mon[33377]: pgmap v2051: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 468 KiB/s wr, 100 op/s 2024-05-08T07:51:05.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:51:05.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:51:05.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:51:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:05 smithi194 ceph-mon[33679]: pgmap v2052: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 507 KiB/s wr, 108 op/s 2024-05-08T07:51:06.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:05 smithi070 ceph-mon[29591]: pgmap v2052: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 507 KiB/s wr, 108 op/s 2024-05-08T07:51:06.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:05 smithi172 ceph-mon[33377]: pgmap v2052: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 507 KiB/s wr, 108 op/s 2024-05-08T07:51:07.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:51:07.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:51:07.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:51:07.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:51:07.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:51:07.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:51:07.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:51:07.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:51:07.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:51:08.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:07 smithi194 ceph-mon[33679]: pgmap v2053: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 313 KiB/s wr, 25 op/s 2024-05-08T07:51:08.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:07 smithi070 ceph-mon[29591]: pgmap v2053: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 313 KiB/s wr, 25 op/s 2024-05-08T07:51:08.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:07 smithi172 ceph-mon[33377]: pgmap v2053: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 313 KiB/s wr, 25 op/s 2024-05-08T07:51:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:09 smithi194 ceph-mon[33679]: pgmap v2054: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 313 KiB/s wr, 25 op/s 2024-05-08T07:51:10.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:09 smithi070 ceph-mon[29591]: pgmap v2054: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 313 KiB/s wr, 25 op/s 2024-05-08T07:51:10.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:09 smithi172 ceph-mon[33377]: pgmap v2054: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 313 KiB/s wr, 25 op/s 2024-05-08T07:51:12.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:11 smithi194 ceph-mon[33679]: pgmap v2055: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 339 KiB/s wr, 29 op/s 2024-05-08T07:51:12.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:11 smithi070 ceph-mon[29591]: pgmap v2055: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 339 KiB/s wr, 29 op/s 2024-05-08T07:51:12.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:11 smithi172 ceph-mon[33377]: pgmap v2055: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 339 KiB/s wr, 29 op/s 2024-05-08T07:51:13.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:13 smithi070 ceph-mon[29591]: pgmap v2056: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 13 op/s 2024-05-08T07:51:14.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:13 smithi194 ceph-mon[33679]: pgmap v2056: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 13 op/s 2024-05-08T07:51:14.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:13 smithi172 ceph-mon[33377]: pgmap v2056: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 64 KiB/s wr, 13 op/s 2024-05-08T07:51:16.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:15 smithi194 ceph-mon[33679]: pgmap v2057: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 96 KiB/s wr, 17 op/s 2024-05-08T07:51:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:15 smithi070 ceph-mon[29591]: pgmap v2057: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 96 KiB/s wr, 17 op/s 2024-05-08T07:51:16.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:15 smithi172 ceph-mon[33377]: pgmap v2057: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 96 KiB/s wr, 17 op/s 2024-05-08T07:51:18.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:17 smithi194 ceph-mon[33679]: pgmap v2058: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 9 op/s 2024-05-08T07:51:18.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:17 smithi070 ceph-mon[29591]: pgmap v2058: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 9 op/s 2024-05-08T07:51:18.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:17 smithi172 ceph-mon[33377]: pgmap v2058: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 9 op/s 2024-05-08T07:51:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:19 smithi194 ceph-mon[33679]: pgmap v2059: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 9 op/s 2024-05-08T07:51:20.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:19 smithi070 ceph-mon[29591]: pgmap v2059: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 9 op/s 2024-05-08T07:51:20.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:19 smithi172 ceph-mon[33377]: pgmap v2059: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 9 op/s 2024-05-08T07:51:20.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.809+0000 7fab66a00700 1 -- 172.21.15.70:0/3178853209 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5645209f0590 con 0x564520b15d30 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.809+0000 7fab66a00700 10 client.17268 handle_command_reply: tid=0 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.809+0000 7fab92635b80 1 client.17268 shutdown 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 -- 172.21.15.70:0/3178853209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 msgr2=0x564520aadb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520aadb60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fab740046c0 tx=0x7fab74003f90 comp rx=0 tx=0).stop 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 -- 172.21.15.70:0/3178853209 shutdown_connections 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564520b15d30 0x564520b18150 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564520a96910 0x564520aae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564520a90b40 0x564520aadb60 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 --2- 172.21.15.70:0/3178853209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564520a95ff0 0x564520aae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab66a00700 0 client.17268 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:51:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 -- 172.21.15.70:0/3178853209 >> 172.21.15.70:0/3178853209 conn(0x5645209becf0 msgr2=0x564520a97400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:51:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 -- 172.21.15.70:0/3178853209 shutdown_connections 2024-05-08T07:51:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.810+0000 7fab92635b80 1 -- 172.21.15.70:0/3178853209 wait complete. 2024-05-08T07:51:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.811+0000 7fab92635b80 20 client.17268 trim_cache size 0 max 16384 2024-05-08T07:51:20.807 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:51:20.807 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:51:20.807 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:51:20.807 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 158, 2024-05-08T07:51:20.807 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "fb233910": { 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 158, 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.7, 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:51:20.808 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:51:20.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:51:20.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:51:20.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:51:20.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:51:20.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:51:20.809 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:51:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fab680b2bf0 msgr2=0x7fab680b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:20.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fab680b2bf0 0x7fab680b50b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fab74007be0 tx=0x7fab740073d0 comp rx=0 tx=0).stop 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab80103f20 msgr2=0x7fab80110150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab80103f20 0x7fab80110150 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00e9f0 tx=0x7fab6c00ed00 comp rx=0 tx=0).stop 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 shutdown_connections 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fab680b2bf0 0x7fab680b50b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fab80108650 0x7fab8010de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab80103570 0x7fab8010fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 --2- 172.21.15.70:0/1529048487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fab80103f20 0x7fab80110150 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.813+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 >> 172.21.15.70:0/1529048487 conn(0x7fab800fee40 msgr2=0x7fab800ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.814+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 shutdown_connections 2024-05-08T07:51:20.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:20.814+0000 7fab86600700 1 -- 172.21.15.70:0/1529048487 wait complete. 2024-05-08T07:51:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:21 smithi194 ceph-mon[33679]: pgmap v2060: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 81 KiB/s wr, 26 op/s 2024-05-08T07:51:22.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:21 smithi070 ceph-mon[29591]: pgmap v2060: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 81 KiB/s wr, 26 op/s 2024-05-08T07:51:22.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:21 smithi172 ceph-mon[33377]: pgmap v2060: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 81 KiB/s wr, 26 op/s 2024-05-08T07:51:22.563 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fb233910', quiesce took 38.5 seconds. Will release after: 25.7 2024-05-08T07:51:24.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:23 smithi194 ceph-mon[33679]: pgmap v2061: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 55 KiB/s wr, 21 op/s 2024-05-08T07:51:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:23 smithi070 ceph-mon[29591]: pgmap v2061: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 55 KiB/s wr, 21 op/s 2024-05-08T07:51:24.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:23 smithi172 ceph-mon[33377]: pgmap v2061: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 55 KiB/s wr, 21 op/s 2024-05-08T07:51:26.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:25 smithi070 ceph-mon[29591]: pgmap v2062: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 157 op/s 2024-05-08T07:51:26.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:25 smithi172 ceph-mon[33377]: pgmap v2062: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 157 op/s 2024-05-08T07:51:26.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:25 smithi194 ceph-mon[33679]: pgmap v2062: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 167 KiB/s wr, 157 op/s 2024-05-08T07:51:28.059 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:27 smithi194 ceph-mon[33679]: pgmap v2063: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 135 KiB/s wr, 152 op/s 2024-05-08T07:51:28.059 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:27 smithi194 ceph-mon[33679]: osdmap e208: 12 total, 12 up, 12 in 2024-05-08T07:51:28.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:27 smithi070 ceph-mon[29591]: pgmap v2063: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 135 KiB/s wr, 152 op/s 2024-05-08T07:51:28.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:27 smithi070 ceph-mon[29591]: osdmap e208: 12 total, 12 up, 12 in 2024-05-08T07:51:28.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:27 smithi172 ceph-mon[33377]: pgmap v2063: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 135 KiB/s wr, 152 op/s 2024-05-08T07:51:28.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:27 smithi172 ceph-mon[33377]: osdmap e208: 12 total, 12 up, 12 in 2024-05-08T07:51:30.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:29 smithi070 ceph-mon[29591]: pgmap v2065: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 162 KiB/s wr, 183 op/s 2024-05-08T07:51:30.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:29 smithi172 ceph-mon[33377]: pgmap v2065: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 162 KiB/s wr, 183 op/s 2024-05-08T07:51:30.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:29 smithi194 ceph-mon[33679]: pgmap v2065: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 162 KiB/s wr, 183 op/s 2024-05-08T07:51:32.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:31 smithi070 ceph-mon[29591]: pgmap v2066: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 176 KiB/s wr, 173 op/s 2024-05-08T07:51:32.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:31 smithi172 ceph-mon[33377]: pgmap v2066: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 176 KiB/s wr, 173 op/s 2024-05-08T07:51:32.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:31 smithi194 ceph-mon[33679]: pgmap v2066: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 176 KiB/s wr, 173 op/s 2024-05-08T07:51:34.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:33 smithi070 ceph-mon[29591]: pgmap v2067: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 176 KiB/s wr, 173 op/s 2024-05-08T07:51:34.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:33 smithi070 ceph-mon[29591]: osdmap e209: 12 total, 12 up, 12 in 2024-05-08T07:51:34.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:33 smithi172 ceph-mon[33377]: pgmap v2067: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 176 KiB/s wr, 173 op/s 2024-05-08T07:51:34.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:33 smithi172 ceph-mon[33377]: osdmap e209: 12 total, 12 up, 12 in 2024-05-08T07:51:34.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:33 smithi194 ceph-mon[33679]: pgmap v2067: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 176 KiB/s wr, 173 op/s 2024-05-08T07:51:34.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:33 smithi194 ceph-mon[33679]: osdmap e209: 12 total, 12 up, 12 in 2024-05-08T07:51:36.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:35 smithi070 ceph-mon[29591]: pgmap v2069: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 17 op/s 2024-05-08T07:51:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:35 smithi172 ceph-mon[33377]: pgmap v2069: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 17 op/s 2024-05-08T07:51:36.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:35 smithi194 ceph-mon[33679]: pgmap v2069: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 96 KiB/s wr, 17 op/s 2024-05-08T07:51:38.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:37 smithi070 ceph-mon[29591]: pgmap v2070: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 14 op/s 2024-05-08T07:51:38.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:37 smithi172 ceph-mon[33377]: pgmap v2070: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 14 op/s 2024-05-08T07:51:38.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:37 smithi194 ceph-mon[33679]: pgmap v2070: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 14 op/s 2024-05-08T07:51:40.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:39 smithi070 ceph-mon[29591]: pgmap v2071: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 14 op/s 2024-05-08T07:51:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:39 smithi172 ceph-mon[33377]: pgmap v2071: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 14 op/s 2024-05-08T07:51:40.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:39 smithi194 ceph-mon[33679]: pgmap v2071: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 77 KiB/s wr, 14 op/s 2024-05-08T07:51:42.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:41 smithi070 ceph-mon[29591]: pgmap v2072: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 KiB/s wr, 76 op/s 2024-05-08T07:51:42.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:41 smithi172 ceph-mon[33377]: pgmap v2072: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 KiB/s wr, 76 op/s 2024-05-08T07:51:42.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:41 smithi194 ceph-mon[33679]: pgmap v2072: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 KiB/s wr, 76 op/s 2024-05-08T07:51:44.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:43 smithi070 ceph-mon[29591]: pgmap v2073: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 KiB/s wr, 76 op/s 2024-05-08T07:51:44.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:43 smithi172 ceph-mon[33377]: pgmap v2073: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 KiB/s wr, 76 op/s 2024-05-08T07:51:44.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:43 smithi194 ceph-mon[33679]: pgmap v2073: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 53 KiB/s wr, 76 op/s 2024-05-08T07:51:46.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:45 smithi070 ceph-mon[29591]: pgmap v2074: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 KiB/s wr, 73 op/s 2024-05-08T07:51:46.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:45 smithi172 ceph-mon[33377]: pgmap v2074: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 KiB/s wr, 73 op/s 2024-05-08T07:51:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:45 smithi194 ceph-mon[33679]: pgmap v2074: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 48 KiB/s wr, 73 op/s 2024-05-08T07:51:48.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:47 smithi070 ceph-mon[29591]: pgmap v2075: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 KiB/s wr, 63 op/s 2024-05-08T07:51:48.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:47 smithi172 ceph-mon[33377]: pgmap v2075: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 KiB/s wr, 63 op/s 2024-05-08T07:51:48.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:47 smithi194 ceph-mon[33679]: pgmap v2075: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 KiB/s wr, 63 op/s 2024-05-08T07:51:48.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:51:48.715 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:51:50.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:49 smithi070 ceph-mon[29591]: pgmap v2076: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 KiB/s wr, 63 op/s 2024-05-08T07:51:50.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:49 smithi172 ceph-mon[33377]: pgmap v2076: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 KiB/s wr, 63 op/s 2024-05-08T07:51:50.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:49 smithi194 ceph-mon[33679]: pgmap v2076: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 KiB/s wr, 63 op/s 2024-05-08T07:51:51.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.277+0000 7f1087e00700 1 -- 172.21.15.70:0/1516096626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 msgr2=0x7f10801169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:51.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.277+0000 7f1087e00700 1 --2- 172.21.15.70:0/1516096626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 0x7f10801169a0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f107800b0a0 tx=0x7f107800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.278+0000 7f1087e00700 1 -- 172.21.15.70:0/1516096626 shutdown_connections 2024-05-08T07:51:51.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.278+0000 7f1087e00700 1 --2- 172.21.15.70:0/1516096626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 0x7f10801169a0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.278+0000 7f1087e00700 1 --2- 172.21.15.70:0/1516096626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108010fb60 0x7f108010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.278+0000 7f1087e00700 1 --2- 172.21.15.70:0/1516096626 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1080109ad0 0x7f1080109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.278+0000 7f1087e00700 1 -- 172.21.15.70:0/1516096626 >> 172.21.15.70:0/1516096626 conn(0x7f1080076c70 msgr2=0x7f10801082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:51:51.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.278+0000 7f1087e00700 1 -- 172.21.15.70:0/1516096626 shutdown_connections 2024-05-08T07:51:51.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.278+0000 7f1087e00700 1 -- 172.21.15.70:0/1516096626 wait complete. 2024-05-08T07:51:51.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.279+0000 7f1087e00700 1 Processor -- start 2024-05-08T07:51:51.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1087e00700 1 -- start start 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1087e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1080109ad0 0x7f10801a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1087e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 0x7f10801a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1087e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108010fb60 0x7f10801a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1087e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1080119c10 con 0x7f108010a490 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1087e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1080119a90 con 0x7f1080109ad0 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1087e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1080119d90 con 0x7f108010fb60 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1084a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 0x7f10801a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1084a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 0x7f10801a05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48256/0 (socket says 172.21.15.70:48256) 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.280+0000 7f1084a00700 1 -- 172.21.15.70:0/2220285184 learned_addr learned my addr 172.21.15.70:0/2220285184 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.281+0000 7f1085400700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1080109ad0 0x7f10801a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:51.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.281+0000 7f1085e00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108010fb60 0x7f10801a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.281+0000 7f1084a00700 1 -- 172.21.15.70:0/2220285184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108010fb60 msgr2=0x7f10801a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.281+0000 7f1084a00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108010fb60 0x7f10801a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.281+0000 7f1084a00700 1 -- 172.21.15.70:0/2220285184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1080109ad0 msgr2=0x7f10801a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.281+0000 7f1084a00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1080109ad0 0x7f10801a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.281+0000 7f1084a00700 1 -- 172.21.15.70:0/2220285184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10801a5090 con 0x7f108010a490 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.281+0000 7f1085400700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1080109ad0 0x7f10801a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.281+0000 7f1084a00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 0x7f10801a05c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f106c00d950 tx=0x7f106c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.282+0000 7f107e000700 1 -- 172.21.15.70:0/2220285184 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c016070 con 0x7f108010a490 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.282+0000 7f107e000700 1 -- 172.21.15.70:0/2220285184 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f106c010460 con 0x7f108010a490 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.282+0000 7f107e000700 1 -- 172.21.15.70:0/2220285184 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c00f620 con 0x7f108010a490 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.282+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10801a5380 con 0x7f108010a490 2024-05-08T07:51:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.282+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10801acc00 con 0x7f108010a490 2024-05-08T07:51:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.283+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108006a190 con 0x7f108010a490 2024-05-08T07:51:51.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.285+0000 7f107e000700 1 -- 172.21.15.70:0/2220285184 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f106c019070 con 0x7f108010a490 2024-05-08T07:51:51.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.287+0000 7f107e000700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10680b2a70 0x7f10680b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:51.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.287+0000 7f107e000700 1 -- 172.21.15.70:0/2220285184 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 9583+0+0 (secure 0 0 0) 0x7f106c0e2660 con 0x7f108010a490 2024-05-08T07:51:51.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.287+0000 7f1085400700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10680b2a70 0x7f10680b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:51.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.288+0000 7f1085400700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10680b2a70 0x7f10680b4f30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1074005e10 tx=0x7f1074005d80 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:51:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.290+0000 7f107e000700 1 -- 172.21.15.70:0/2220285184 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f106c0a9bc0 con 0x7f108010a490 2024-05-08T07:51:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.574+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f108002e510 con 0x7f108010a490 2024-05-08T07:51:51.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.575+0000 7f107e000700 1 -- 172.21.15.70:0/2220285184 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f106c0a94c0 con 0x7f108010a490 2024-05-08T07:51:51.570 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:51:51.570 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.578+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10680b2a70 msgr2=0x7f10680b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.578+0000 7f1087e00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10680b2a70 0x7f10680b4f30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1074005e10 tx=0x7f1074005d80 comp rx=0 tx=0).stop 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.578+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 msgr2=0x7f10801a05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.578+0000 7f1087e00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 0x7f10801a05c0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f106c00d950 tx=0x7f106c00dd10 comp rx=0 tx=0).stop 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.579+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 shutdown_connections 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.579+0000 7f1087e00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f10680b2a70 0x7f10680b4f30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.579+0000 7f1087e00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108010fb60 0x7f10801a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.579+0000 7f1087e00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1080109ad0 0x7f10801a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.579+0000 7f1087e00700 1 --2- 172.21.15.70:0/2220285184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f108010a490 0x7f10801a05c0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.579+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 >> 172.21.15.70:0/2220285184 conn(0x7f1080076c70 msgr2=0x7f1080077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:51:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.579+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 shutdown_connections 2024-05-08T07:51:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:51.579+0000 7f1087e00700 1 -- 172.21.15.70:0/2220285184 wait complete. 2024-05-08T07:51:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:51:52.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:51 smithi070 ceph-mon[29591]: pgmap v2077: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 KiB/s wr, 66 op/s 2024-05-08T07:51:52.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:51 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2220285184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:51:52.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:51 smithi172 ceph-mon[33377]: pgmap v2077: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 KiB/s wr, 66 op/s 2024-05-08T07:51:52.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:51 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2220285184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:51:52.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:51 smithi194 ceph-mon[33679]: pgmap v2077: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 KiB/s wr, 66 op/s 2024-05-08T07:51:52.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:51 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2220285184' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:51:52.402 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id fb233910 --release --await' 2024-05-08T07:51:52.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id fb233910 --release --await 2024-05-08T07:51:52.850 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:51:54.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:53 smithi070 ceph-mon[29591]: pgmap v2078: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T07:51:54.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:53 smithi172 ceph-mon[33377]: pgmap v2078: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T07:51:54.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:53 smithi194 ceph-mon[33679]: pgmap v2078: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T07:51:55.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.866+0000 7fc776a00700 1 -- 172.21.15.70:0/1692493379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc77010da00 msgr2=0x7fc77010fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:55.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.866+0000 7fc776a00700 1 --2- 172.21.15.70:0/1692493379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc77010da00 0x7fc77010fe70 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fc76800b0a0 tx=0x7fc76800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.866+0000 7fc776a00700 1 -- 172.21.15.70:0/1692493379 shutdown_connections 2024-05-08T07:51:55.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.866+0000 7fc776a00700 1 --2- 172.21.15.70:0/1692493379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc77010da00 0x7fc77010fe70 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.866+0000 7fc776a00700 1 --2- 172.21.15.70:0/1692493379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7701045d0 0x7fc7701049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.866+0000 7fc776a00700 1 --2- 172.21.15.70:0/1692493379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc770104ef0 0x7fc77010d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.867+0000 7fc776a00700 1 -- 172.21.15.70:0/1692493379 >> 172.21.15.70:0/1692493379 conn(0x7fc7700fddc0 msgr2=0x7fc7701001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:51:55.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.867+0000 7fc776a00700 1 -- 172.21.15.70:0/1692493379 shutdown_connections 2024-05-08T07:51:55.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.867+0000 7fc776a00700 1 -- 172.21.15.70:0/1692493379 wait complete. 2024-05-08T07:51:55.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.868+0000 7fc776a00700 1 Processor -- start 2024-05-08T07:51:55.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.868+0000 7fc776a00700 1 -- start start 2024-05-08T07:51:55.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.868+0000 7fc776a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7701045d0 0x7fc7701a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.868+0000 7fc776a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770104ef0 0x7fc7701a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.868+0000 7fc776a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77010da00 0x7fc77019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.868+0000 7fc776a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701134b0 con 0x7fc770104ef0 2024-05-08T07:51:55.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.868+0000 7fc776a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc770113330 con 0x7fc7701045d0 2024-05-08T07:51:55.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.868+0000 7fc776a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc770113630 con 0x7fc77010da00 2024-05-08T07:51:55.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc774c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770104ef0 0x7fc7701a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc774c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770104ef0 0x7fc7701a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48262/0 (socket says 172.21.15.70:48262) 2024-05-08T07:51:55.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc774c00700 1 -- 172.21.15.70:0/3046470888 learned_addr learned my addr 172.21.15.70:0/3046470888 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:51:55.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc775600700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7701045d0 0x7fc7701a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc776000700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77010da00 0x7fc77019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc774c00700 1 -- 172.21.15.70:0/3046470888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77010da00 msgr2=0x7fc77019ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:55.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc774c00700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77010da00 0x7fc77019ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc774c00700 1 -- 172.21.15.70:0/3046470888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7701045d0 msgr2=0x7fc7701a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:55.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc774c00700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7701045d0 0x7fc7701a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc774c00700 1 -- 172.21.15.70:0/3046470888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77019c170 con 0x7fc770104ef0 2024-05-08T07:51:55.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.869+0000 7fc775600700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7701045d0 0x7fc7701a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:51:55.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.870+0000 7fc774c00700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770104ef0 0x7fc7701a1d90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00d950 tx=0x7fc75c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:51:55.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.870+0000 7fc76e000700 1 -- 172.21.15.70:0/3046470888 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c016070 con 0x7fc770104ef0 2024-05-08T07:51:55.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.870+0000 7fc76e000700 1 -- 172.21.15.70:0/3046470888 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc75c00de30 con 0x7fc770104ef0 2024-05-08T07:51:55.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.870+0000 7fc76e000700 1 -- 172.21.15.70:0/3046470888 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c005240 con 0x7fc770104ef0 2024-05-08T07:51:55.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.870+0000 7fc776a00700 1 -- 172.21.15.70:0/3046470888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77019c460 con 0x7fc770104ef0 2024-05-08T07:51:55.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.871+0000 7fc776a00700 1 -- 172.21.15.70:0/3046470888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7701a8720 con 0x7fc770104ef0 2024-05-08T07:51:55.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.876+0000 7fc76e000700 1 -- 172.21.15.70:0/3046470888 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc75c0053e0 con 0x7fc770104ef0 2024-05-08T07:51:55.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.878+0000 7fc76e000700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7580b2a70 0x7fc7580b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.878+0000 7fc76e000700 1 -- 172.21.15.70:0/3046470888 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(209..209 src has 1..209) ==== 9583+0+0 (secure 0 0 0) 0x7fc75c0e3190 con 0x7fc770104ef0 2024-05-08T07:51:55.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.878+0000 7fc775600700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7580b2a70 0x7fc7580b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.893+0000 7fc775600700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7580b2a70 0x7fc7580b4f30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc764005950 tx=0x7fc7640058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:51:55.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.895+0000 7fc782a8cb80 1 Processor -- start 2024-05-08T07:51:55.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.895+0000 7fc782a8cb80 1 -- start start 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 0x557977a4d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a47780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 0x557977a48200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557977999b20 con 0x557977a4db70 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557977937860 con 0x557977a47da0 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557977995ae0 con 0x557977a4d250 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc774c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a47780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc774c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a47780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48270/0 (socket says 172.21.15.70:48270) 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc774c00700 1 -- 172.21.15.70:0/3158289365 learned_addr learned my addr 172.21.15.70:0/3158289365 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc776000700 1 --2- 172.21.15.70:0/3158289365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 0x557977a48200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.896+0000 7fc775600700 1 --2- 172.21.15.70:0/3158289365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 0x557977a4d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.897+0000 7fc774c00700 1 -- 172.21.15.70:0/3158289365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 msgr2=0x557977a4d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:51:55.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.897+0000 7fc774c00700 1 --2- 172.21.15.70:0/3158289365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 0x557977a4d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.897+0000 7fc774c00700 1 -- 172.21.15.70:0/3158289365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 msgr2=0x557977a48200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:51:55.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.897+0000 7fc774c00700 1 --2- 172.21.15.70:0/3158289365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 0x557977a48200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.897+0000 7fc774c00700 1 -- 172.21.15.70:0/3158289365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579778e69d0 con 0x557977a4db70 2024-05-08T07:51:55.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.897+0000 7fc774c00700 1 --2- 172.21.15.70:0/3158289365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a47780 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0a9f80 tx=0x7fc75c0aa770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e68f40bdf7858 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:51:55.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.897+0000 7fc762a00700 1 -- 172.21.15.70:0/3158289365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0ae3a0 con 0x557977a4db70 2024-05-08T07:51:55.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.897+0000 7fc762a00700 1 -- 172.21.15.70:0/3158289365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc75c0b2e50 con 0x557977a4db70 2024-05-08T07:51:55.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.897+0000 7fc762a00700 1 -- 172.21.15.70:0/3158289365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0e0bb0 con 0x557977a4db70 2024-05-08T07:51:55.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.898+0000 7fc782a8cb80 1 -- 172.21.15.70:0/3158289365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 msgr2=0x557977a47780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:55.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.898+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/3158289365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a47780 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0a9f80 tx=0x7fc75c0aa770 comp rx=0 tx=0).stop 2024-05-08T07:51:55.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.898+0000 7fc782a8cb80 1 -- 172.21.15.70:0/3158289365 shutdown_connections 2024-05-08T07:51:55.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.898+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/3158289365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 0x557977a48200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.898+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/3158289365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 0x557977a4d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.898+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/3158289365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a47780 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.898+0000 7fc782a8cb80 1 -- 172.21.15.70:0/3158289365 >> 172.21.15.70:0/3158289365 conn(0x5579779bf7d0 msgr2=0x557977a422e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:51:55.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.899+0000 7fc782a8cb80 1 -- 172.21.15.70:0/3158289365 shutdown_connections 2024-05-08T07:51:55.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.899+0000 7fc782a8cb80 1 -- 172.21.15.70:0/3158289365 wait complete. 2024-05-08T07:51:55.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:55 smithi070 ceph-mon[29591]: pgmap v2079: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.5 KiB/s wr, 8 op/s 2024-05-08T07:51:55.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.899+0000 7fc782a8cb80 1 -- start start 2024-05-08T07:51:55.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.899+0000 7fc782a8cb80 1 Processor -- start 2024-05-08T07:51:55.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.900+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 0x557977a53910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.900+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a50cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.900+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 0x557977a511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.900+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557977a54690 con 0x557977a4d250 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.900+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5579778ffc20 con 0x557977a4db70 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.900+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557977a54810 con 0x557977a47da0 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.900+0000 7fc782a8cb80 10 client.0 _ll_register_callbacks cb 0x557977940d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.900+0000 7fc774c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a50cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.901+0000 7fc774c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a50cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48276/0 (socket says 172.21.15.70:48276) 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.901+0000 7fc774c00700 1 -- 172.21.15.70:0/2488306555 learned_addr learned my addr 172.21.15.70:0/2488306555 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.901+0000 7fc775600700 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 0x557977a53910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.901+0000 7fc776000700 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 0x557977a511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.901+0000 7fc774c00700 1 -- 172.21.15.70:0/2488306555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 msgr2=0x557977a53910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.901+0000 7fc774c00700 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 0x557977a53910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.901+0000 7fc774c00700 1 -- 172.21.15.70:0/2488306555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 msgr2=0x557977a511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:51:55.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.901+0000 7fc774c00700 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 0x557977a511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.901+0000 7fc774c00700 1 -- 172.21.15.70:0/2488306555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55797795f520 con 0x557977a4d250 2024-05-08T07:51:55.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.902+0000 7fc774c00700 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a50cb0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0a9f30 tx=0x7fc75c004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e540928e4facc456 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:51:55.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.902+0000 7fc757400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:51:55.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.902+0000 7fc757400700 1 -- 172.21.15.70:0/2488306555 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0c8030 con 0x557977a4d250 2024-05-08T07:51:55.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.902+0000 7fc757400700 1 -- 172.21.15.70:0/2488306555 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(209..209 src has 1..209) ==== 9583+0+0 (secure 0 0 0) 0x7fc75c0a65e0 con 0x557977a4d250 2024-05-08T07:51:55.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.902+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2488306555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc75c0b2e50 con 0x557977a4d250 2024-05-08T07:51:55.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.903+0000 7fc757400700 1 -- 172.21.15.70:0/2488306555 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc75c0c3070 con 0x557977a4d250 2024-05-08T07:51:55.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.903+0000 7fc782a8cb80 10 client.17286 fetch_fsmap learned FSMap version 42 2024-05-08T07:51:55.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.903+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2488306555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557977a54690 con 0x557977a4d250 2024-05-08T07:51:55.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.903+0000 7fc757400700 1 -- 172.21.15.70:0/2488306555 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc75c0b2e50 con 0x557977a4d250 2024-05-08T07:51:55.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.903+0000 7fc757400700 1 -- 172.21.15.70:0/2488306555 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fc75c0e0cc0 con 0x557977a4d250 2024-05-08T07:51:55.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.903+0000 7fc782a8cb80 10 client.17286 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:51:55.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.903+0000 7fc782a8cb80 10 client.17286 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:51:55.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.904+0000 7fc782a8cb80 20 client.17286 populate_metadata read hostname 'smithi070' 2024-05-08T07:51:55.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.904+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557977a61240 0x557977a63630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.904+0000 7fc782a8cb80 4 client.17286 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:51:55.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.904+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2488306555 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557977a14240 con 0x557977a61240 2024-05-08T07:51:55.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.904+0000 7fc775600700 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557977a61240 0x557977a63630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.905+0000 7fc775600700 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557977a61240 0x557977a63630 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91f137371efd7c24 server_cookie=8114309124b28cdc in_seq=0 out_seq=0 2024-05-08T07:51:55.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.905+0000 7fc757400700 10 client.17286 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:51:55.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc757400700 1 -- 172.21.15.70:0/2488306555 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557977a14240 con 0x557977a61240 2024-05-08T07:51:55.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc757400700 10 client.17286 handle_command_reply: tid=0 2024-05-08T07:51:55.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc782a8cb80 1 client.17286 shutdown 2024-05-08T07:51:55.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2488306555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 msgr2=0x557977a50cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:55.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a50cb0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0a9f30 tx=0x7fc75c004c50 comp rx=0 tx=0).stop 2024-05-08T07:51:55.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2488306555 shutdown_connections 2024-05-08T07:51:55.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557977a61240 0x557977a63630 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 0x557977a511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 0x557977a53910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2488306555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a50cb0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2488306555 >> 172.21.15.70:0/2488306555 conn(0x5579779bf7d0 msgr2=0x557977a46770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:51:55.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.907+0000 7fc757400700 0 client.17286 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:51:55.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.908+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2488306555 shutdown_connections 2024-05-08T07:51:55.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.908+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2488306555 wait complete. 2024-05-08T07:51:55.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.908+0000 7fc782a8cb80 20 client.17286 trim_cache size 0 max 16384 2024-05-08T07:51:55.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.941+0000 7fc782a8cb80 1 Processor -- start 2024-05-08T07:51:55.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.941+0000 7fc782a8cb80 1 -- start start 2024-05-08T07:51:55.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 0x557977a5d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 0x557977a68cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a69230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701b40d0 con 0x557977a4db70 2024-05-08T07:51:55.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701b1960 con 0x557977a47da0 2024-05-08T07:51:55.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701af7d0 con 0x557977a4d250 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc776000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a69230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc776000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a69230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48290/0 (socket says 172.21.15.70:48290) 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc776000700 1 -- 172.21.15.70:0/1979015524 learned_addr learned my addr 172.21.15.70:0/1979015524 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc774c00700 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 0x557977a68cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.942+0000 7fc775600700 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 0x557977a5d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc776000700 1 -- 172.21.15.70:0/1979015524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 msgr2=0x557977a68cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc776000700 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 0x557977a68cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc776000700 1 -- 172.21.15.70:0/1979015524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 msgr2=0x557977a5d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc776000700 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 0x557977a5d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc776000700 1 -- 172.21.15.70:0/1979015524 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557977a425e0 con 0x557977a4db70 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc775600700 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 0x557977a5d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc776000700 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a69230 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc768015000 tx=0x7fc768009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f895c2057d96b736 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:51:55.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc762000700 1 -- 172.21.15.70:0/1979015524 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768004c50 con 0x557977a4db70 2024-05-08T07:51:55.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc762000700 1 -- 172.21.15.70:0/1979015524 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc768004df0 con 0x557977a4db70 2024-05-08T07:51:55.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.943+0000 7fc762000700 1 -- 172.21.15.70:0/1979015524 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc768005400 con 0x557977a4db70 2024-05-08T07:51:55.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.944+0000 7fc782a8cb80 1 -- 172.21.15.70:0/1979015524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 msgr2=0x557977a69230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:51:55.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.944+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a69230 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fc768015000 tx=0x7fc768009310 comp rx=0 tx=0).stop 2024-05-08T07:51:55.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.944+0000 7fc782a8cb80 1 -- 172.21.15.70:0/1979015524 shutdown_connections 2024-05-08T07:51:55.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.944+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4db70 0x557977a69230 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.944+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a47da0 0x557977a5d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.944+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/1979015524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a4d250 0x557977a68cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.944+0000 7fc782a8cb80 1 -- 172.21.15.70:0/1979015524 >> 172.21.15.70:0/1979015524 conn(0x5579779bf7d0 msgr2=0x557977a47160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.944+0000 7fc782a8cb80 1 -- 172.21.15.70:0/1979015524 shutdown_connections 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.944+0000 7fc782a8cb80 1 -- 172.21.15.70:0/1979015524 wait complete. 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.945+0000 7fc782a8cb80 1 -- start start 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.945+0000 7fc782a8cb80 1 Processor -- start 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 0x557977a56a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a56fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc782a8cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 0x557977a574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701afe20 con 0x557977a4d250 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701b1290 con 0x557977a4db70 2024-05-08T07:51:55.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc782a8cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701b04f0 con 0x557977a47da0 2024-05-08T07:51:55.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc782a8cb80 10 client.0 _ll_register_callbacks cb 0x557977940d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:51:55.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc774c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a56fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc774c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a56fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48302/0 (socket says 172.21.15.70:48302) 2024-05-08T07:51:55.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc774c00700 1 -- 172.21.15.70:0/2329889387 learned_addr learned my addr 172.21.15.70:0/2329889387 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:51:55.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc775600700 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 0x557977a56a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.946+0000 7fc776000700 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 0x557977a574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc774c00700 1 -- 172.21.15.70:0/2329889387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 msgr2=0x557977a56a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc774c00700 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 0x557977a56a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc774c00700 1 -- 172.21.15.70:0/2329889387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 msgr2=0x557977a574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc774c00700 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 0x557977a574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc774c00700 1 -- 172.21.15.70:0/2329889387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557977acb8b0 con 0x557977a4d250 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc775600700 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 0x557977a56a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc774c00700 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a56fb0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0aa1b0 tx=0x7fc75c005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258ce0d171c4dae0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc757400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc757400700 1 -- 172.21.15.70:0/2329889387 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0c8070 con 0x557977a4d250 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc757400700 1 -- 172.21.15.70:0/2329889387 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(209..209 src has 1..209) ==== 9583+0+0 (secure 0 0 0) 0x7fc75c0e0bb0 con 0x557977a4d250 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2329889387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc768004df0 con 0x557977a4d250 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc757400700 1 -- 172.21.15.70:0/2329889387 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc75c0a5eb0 con 0x557977a4d250 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc782a8cb80 10 client.17292 fetch_fsmap learned FSMap version 42 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.947+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2329889387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557977accbc0 con 0x557977a4d250 2024-05-08T07:51:55.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.948+0000 7fc757400700 1 -- 172.21.15.70:0/2329889387 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc768004df0 con 0x557977a4d250 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.948+0000 7fc757400700 1 -- 172.21.15.70:0/2329889387 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fc75c0900c0 con 0x557977a4d250 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.948+0000 7fc782a8cb80 10 client.17292 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.948+0000 7fc782a8cb80 10 client.17292 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.948+0000 7fc782a8cb80 20 client.17292 populate_metadata read hostname 'smithi070' 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.948+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557977acd090 0x557977acf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.948+0000 7fc782a8cb80 4 client.17292 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fb233910", "release": true, "await": true}] 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.948+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2329889387 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fb233910", "release": true, "await": true}) -- 0x5579779a7500 con 0x557977acd090 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.949+0000 7fc775600700 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557977acd090 0x557977acf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.950+0000 7fc775600700 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557977acd090 0x557977acf4b0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfaaf3eca2403f6d server_cookie=670d17b97cf0875 in_seq=0 out_seq=0 2024-05-08T07:51:55.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:51:55.950+0000 7fc757400700 10 client.17292 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:51:56.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:55 smithi172 ceph-mon[33377]: pgmap v2079: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.5 KiB/s wr, 8 op/s 2024-05-08T07:51:56.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:55 smithi194 ceph-mon[33679]: pgmap v2079: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 5.5 KiB/s wr, 8 op/s 2024-05-08T07:51:58.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:57 smithi070 ceph-mon[29591]: pgmap v2080: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T07:51:58.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:57 smithi172 ceph-mon[33377]: pgmap v2080: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T07:51:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:57 smithi194 ceph-mon[33679]: pgmap v2080: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T07:52:00.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:51:59 smithi070 ceph-mon[29591]: pgmap v2081: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T07:52:00.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:51:59 smithi172 ceph-mon[33377]: pgmap v2081: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T07:52:00.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:51:59 smithi194 ceph-mon[33679]: pgmap v2081: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.5 KiB/s wr, 5 op/s 2024-05-08T07:52:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.394+0000 7fc757400700 1 -- 172.21.15.70:0/2329889387 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5579779a7500 con 0x557977acd090 2024-05-08T07:52:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.394+0000 7fc757400700 10 client.17292 handle_command_reply: tid=0 2024-05-08T07:52:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.395+0000 7fc782a8cb80 1 client.17292 shutdown 2024-05-08T07:52:00.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.395+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2329889387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 msgr2=0x557977a56fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.395+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a56fb0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0aa1b0 tx=0x7fc75c005bb0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.395+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2329889387 shutdown_connections 2024-05-08T07:52:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.395+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557977acd090 0x557977acf4b0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.396+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557977a4db70 0x557977a574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.396+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557977a47da0 0x557977a56a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.396+0000 7fc782a8cb80 1 --2- 172.21.15.70:0/2329889387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557977a4d250 0x557977a56fb0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.396+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2329889387 >> 172.21.15.70:0/2329889387 conn(0x5579779bf7d0 msgr2=0x557977a4fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:52:00.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.396+0000 7fc757400700 0 client.17292 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:52:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.396+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2329889387 shutdown_connections 2024-05-08T07:52:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.396+0000 7fc782a8cb80 1 -- 172.21.15.70:0/2329889387 wait complete. 2024-05-08T07:52:00.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.397+0000 7fc782a8cb80 20 client.17292 trim_cache size 0 max 16384 2024-05-08T07:52:00.393 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:52:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:52:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:52:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 160, 2024-05-08T07:52:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:52:00.393 INFO:teuthology.orchestra.run.smithi070.stdout: "fb233910": { 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 160, 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.7, 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:52:00.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:52:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:52:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:52:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:52:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:52:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:52:00.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:52:00.395 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:52:00.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 -- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7580b2a70 msgr2=0x7fc7580b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:00.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7580b2a70 0x7fc7580b4f30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc764005950 tx=0x7fc7640058e0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 -- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770104ef0 msgr2=0x7fc7701a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770104ef0 0x7fc7701a1d90 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00d950 tx=0x7fc75c00dd10 comp rx=0 tx=0).stop 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 -- 172.21.15.70:0/3046470888 shutdown_connections 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7580b2a70 0x7fc7580b4f30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc77010da00 0x7fc77019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc7701045d0 0x7fc7701a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 --2- 172.21.15.70:0/3046470888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770104ef0 0x7fc7701a1d90 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 -- 172.21.15.70:0/3046470888 >> 172.21.15.70:0/3046470888 conn(0x7fc7700fddc0 msgr2=0x7fc7701001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.398+0000 7fc776a00700 1 -- 172.21.15.70:0/3046470888 shutdown_connections 2024-05-08T07:52:00.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:00.399+0000 7fc776a00700 1 -- 172.21.15.70:0/3046470888 wait complete. 2024-05-08T07:52:00.455 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/fs.o 2024-05-08T07:52:01.247 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fb233910', seconds elapsed: 77.2 2024-05-08T07:52:02.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:01 smithi172 ceph-mon[33377]: pgmap v2082: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-05-08T07:52:02.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:01 smithi194 ceph-mon[33679]: pgmap v2082: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-05-08T07:52:02.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:01 smithi070 ceph-mon[29591]: pgmap v2082: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 9.7 KiB/s wr, 8 op/s 2024-05-08T07:52:03.538 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-map.o 2024-05-08T07:52:03.550 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/kernel/head_64.o 2024-05-08T07:52:03.566 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/ialloc.o 2024-05-08T07:52:03.724 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/namespace.o 2024-05-08T07:52:03.834 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_clock.o 2024-05-08T07:52:03.991 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpu/capflags.o 2024-05-08T07:52:04.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:03 smithi172 ceph-mon[33377]: pgmap v2083: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-05-08T07:52:04.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:03 smithi194 ceph-mon[33679]: pgmap v2083: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-05-08T07:52:04.339 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/kernel/cpu/built-in.a 2024-05-08T07:52:04.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:03 smithi070 ceph-mon[29591]: pgmap v2083: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-05-08T07:52:04.417 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/math/div64.o 2024-05-08T07:52:04.736 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/math/gcd.o 2024-05-08T07:52:05.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:04 smithi194 ceph-mon[33679]: pgmap v2084: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 280 KiB/s wr, 35 op/s 2024-05-08T07:52:05.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:04 smithi070 ceph-mon[29591]: pgmap v2084: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 280 KiB/s wr, 35 op/s 2024-05-08T07:52:05.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:04 smithi172 ceph-mon[33377]: pgmap v2084: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 280 KiB/s wr, 35 op/s 2024-05-08T07:52:05.703 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/cgroup-v1.o 2024-05-08T07:52:06.611 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/math/lcm.o 2024-05-08T07:52:07.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:06 smithi194 ceph-mon[33679]: osdmap e210: 12 total, 12 up, 12 in 2024-05-08T07:52:07.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:06 smithi194 ceph-mon[33679]: pgmap v2086: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 336 KiB/s wr, 39 op/s 2024-05-08T07:52:07.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:52:07.340 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/head64.o 2024-05-08T07:52:07.365 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/math/int_pow.o 2024-05-08T07:52:07.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:06 smithi070 ceph-mon[29591]: osdmap e210: 12 total, 12 up, 12 in 2024-05-08T07:52:07.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:06 smithi070 ceph-mon[29591]: pgmap v2086: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 336 KiB/s wr, 39 op/s 2024-05-08T07:52:07.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:52:07.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:06 smithi172 ceph-mon[33377]: osdmap e210: 12 total, 12 up, 12 in 2024-05-08T07:52:07.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:06 smithi172 ceph-mon[33377]: pgmap v2086: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 336 KiB/s wr, 39 op/s 2024-05-08T07:52:07.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:52:08.159 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/math/int_sqrt.o 2024-05-08T07:52:08.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:52:08.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:52:08.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:52:08.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:52:08.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:52:08.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:52:08.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:52:08.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:52:08.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:52:09.433 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/math/reciprocal_div.o 2024-05-08T07:52:09.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:09 smithi194 ceph-mon[33679]: pgmap v2087: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 337 KiB/s wr, 39 op/s 2024-05-08T07:52:09.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:09 smithi070 ceph-mon[29591]: pgmap v2087: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 337 KiB/s wr, 39 op/s 2024-05-08T07:52:09.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:09 smithi172 ceph-mon[33377]: pgmap v2087: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 337 KiB/s wr, 39 op/s 2024-05-08T07:52:10.497 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/ring_buffer.o 2024-05-08T07:52:11.199 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/splice.o 2024-05-08T07:52:11.536 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/math/rational.o 2024-05-08T07:52:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:11 smithi070 ceph-mon[29591]: pgmap v2088: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 487 KiB/s wr, 54 op/s 2024-05-08T07:52:11.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:11 smithi172 ceph-mon[33377]: pgmap v2088: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 487 KiB/s wr, 54 op/s 2024-05-08T07:52:12.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:11 smithi194 ceph-mon[33679]: pgmap v2088: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 487 KiB/s wr, 54 op/s 2024-05-08T07:52:12.947 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-merge.o 2024-05-08T07:52:13.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:13 smithi172 ceph-mon[33377]: pgmap v2089: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 486 KiB/s wr, 54 op/s 2024-05-08T07:52:13.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:13 smithi172 ceph-mon[33377]: osdmap e211: 12 total, 12 up, 12 in 2024-05-08T07:52:14.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:13 smithi194 ceph-mon[33679]: pgmap v2089: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 486 KiB/s wr, 54 op/s 2024-05-08T07:52:14.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:13 smithi194 ceph-mon[33679]: osdmap e211: 12 total, 12 up, 12 in 2024-05-08T07:52:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:13 smithi070 ceph-mon[29591]: pgmap v2089: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 486 KiB/s wr, 54 op/s 2024-05-08T07:52:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:13 smithi070 ceph-mon[29591]: osdmap e211: 12 total, 12 up, 12 in 2024-05-08T07:52:14.546 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/indirect.o 2024-05-08T07:52:15.103 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/bpf/core.o 2024-05-08T07:52:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:15 smithi172 ceph-mon[33377]: pgmap v2091: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 567 KiB/s wr, 220 op/s 2024-05-08T07:52:16.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:15 smithi194 ceph-mon[33679]: pgmap v2091: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 567 KiB/s wr, 220 op/s 2024-05-08T07:52:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:15 smithi070 ceph-mon[29591]: pgmap v2091: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 488 KiB/s rd, 567 KiB/s wr, 220 op/s 2024-05-08T07:52:16.769 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/freezer.o 2024-05-08T07:52:16.783 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/ebda.o 2024-05-08T07:52:17.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:17 smithi172 ceph-mon[33377]: pgmap v2092: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 489 KiB/s wr, 190 op/s 2024-05-08T07:52:17.928 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/math/built-in.a 2024-05-08T07:52:18.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:17 smithi194 ceph-mon[33679]: pgmap v2092: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 489 KiB/s wr, 190 op/s 2024-05-08T07:52:18.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:17 smithi070 ceph-mon[29591]: pgmap v2092: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 489 KiB/s wr, 190 op/s 2024-05-08T07:52:18.447 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/memneq.o 2024-05-08T07:52:19.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:19 smithi172 ceph-mon[33377]: pgmap v2093: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 489 KiB/s wr, 190 op/s 2024-05-08T07:52:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:19 smithi194 ceph-mon[33679]: pgmap v2093: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 489 KiB/s wr, 190 op/s 2024-05-08T07:52:20.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:19 smithi070 ceph-mon[29591]: pgmap v2093: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 489 KiB/s wr, 190 op/s 2024-05-08T07:52:20.456 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/sync.o 2024-05-08T07:52:21.426 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace.o 2024-05-08T07:52:21.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:21 smithi172 ceph-mon[33377]: pgmap v2094: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 528 KiB/s wr, 192 op/s 2024-05-08T07:52:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:21 smithi194 ceph-mon[33679]: pgmap v2094: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 528 KiB/s wr, 192 op/s 2024-05-08T07:52:22.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:21 smithi070 ceph-mon[29591]: pgmap v2094: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 528 KiB/s wr, 192 op/s 2024-05-08T07:52:23.151 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-timeout.o 2024-05-08T07:52:23.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:23 smithi172 ceph-mon[33377]: pgmap v2095: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 528 KiB/s wr, 192 op/s 2024-05-08T07:52:24.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:23 smithi194 ceph-mon[33679]: pgmap v2095: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 528 KiB/s wr, 192 op/s 2024-05-08T07:52:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:23 smithi070 ceph-mon[29591]: pgmap v2095: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 528 KiB/s wr, 192 op/s 2024-05-08T07:52:24.716 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/platform-quirks.o 2024-05-08T07:52:25.255 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/inline.o 2024-05-08T07:52:25.340 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/utils.o 2024-05-08T07:52:25.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:25 smithi172 ceph-mon[33377]: pgmap v2096: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 643 KiB/s wr, 221 op/s 2024-05-08T07:52:26.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:25 smithi194 ceph-mon[33679]: pgmap v2096: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 643 KiB/s wr, 221 op/s 2024-05-08T07:52:26.067 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/legacy_freezer.o 2024-05-08T07:52:26.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:25 smithi070 ceph-mon[29591]: pgmap v2096: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 643 KiB/s wr, 221 op/s 2024-05-08T07:52:27.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:27 smithi070 ceph-mon[29591]: pgmap v2097: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 311 KiB/s wr, 60 op/s 2024-05-08T07:52:27.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:27 smithi172 ceph-mon[33377]: pgmap v2097: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 311 KiB/s wr, 60 op/s 2024-05-08T07:52:28.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:27 smithi194 ceph-mon[33679]: pgmap v2097: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 311 KiB/s wr, 60 op/s 2024-05-08T07:52:29.553 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/bpf/built-in.a 2024-05-08T07:52:29.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:29 smithi172 ceph-mon[33377]: pgmap v2098: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 311 KiB/s wr, 60 op/s 2024-05-08T07:52:30.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:29 smithi194 ceph-mon[33679]: pgmap v2098: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 311 KiB/s wr, 60 op/s 2024-05-08T07:52:30.098 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/clear_page_64.o 2024-05-08T07:52:30.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:29 smithi070 ceph-mon[29591]: pgmap v2098: 129 pgs: 129 active+clean; 1.8 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 311 KiB/s wr, 60 op/s 2024-05-08T07:52:30.383 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/advise.o 2024-05-08T07:52:31.009 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/cmdline.o 2024-05-08T07:52:31.507 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/chacha.o 2024-05-08T07:52:32.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:31 smithi194 ceph-mon[33679]: pgmap v2099: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 641 KiB/s wr, 233 op/s 2024-05-08T07:52:32.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:31 smithi070 ceph-mon[29591]: pgmap v2099: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 641 KiB/s wr, 233 op/s 2024-05-08T07:52:32.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:31 smithi172 ceph-mon[33377]: pgmap v2099: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 641 KiB/s wr, 233 op/s 2024-05-08T07:52:32.320 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/process_64.o 2024-05-08T07:52:32.810 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-lib.o 2024-05-08T07:52:33.204 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/cmpxchg16b_emu.o 2024-05-08T07:52:33.538 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/aes.o 2024-05-08T07:52:33.785 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/copy_mc.o 2024-05-08T07:52:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:33 smithi194 ceph-mon[33679]: pgmap v2100: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 479 KiB/s wr, 215 op/s 2024-05-08T07:52:34.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:33 smithi070 ceph-mon[29591]: pgmap v2100: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 479 KiB/s wr, 215 op/s 2024-05-08T07:52:34.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:33 smithi172 ceph-mon[33377]: pgmap v2100: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 479 KiB/s wr, 215 op/s 2024-05-08T07:52:34.629 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_output.o 2024-05-08T07:52:34.921 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/pids.o 2024-05-08T07:52:35.326 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/inode.o 2024-05-08T07:52:36.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:35 smithi194 ceph-mon[33679]: pgmap v2101: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 750 KiB/s wr, 292 op/s 2024-05-08T07:52:36.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:35 smithi070 ceph-mon[29591]: pgmap v2101: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 750 KiB/s wr, 292 op/s 2024-05-08T07:52:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:35 smithi172 ceph-mon[33377]: pgmap v2101: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 750 KiB/s wr, 292 op/s 2024-05-08T07:52:38.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:37 smithi194 ceph-mon[33679]: pgmap v2102: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 602 KiB/s wr, 249 op/s 2024-05-08T07:52:38.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:37 smithi070 ceph-mon[29591]: pgmap v2102: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 602 KiB/s wr, 249 op/s 2024-05-08T07:52:38.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:37 smithi172 ceph-mon[33377]: pgmap v2102: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 602 KiB/s wr, 249 op/s 2024-05-08T07:52:39.858 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/copy_mc_64.o 2024-05-08T07:52:40.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:39 smithi194 ceph-mon[33679]: pgmap v2103: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 602 KiB/s wr, 249 op/s 2024-05-08T07:52:40.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:39 smithi070 ceph-mon[29591]: pgmap v2103: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 602 KiB/s wr, 249 op/s 2024-05-08T07:52:40.161 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/filetable.o 2024-05-08T07:52:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:39 smithi172 ceph-mon[33377]: pgmap v2103: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 602 KiB/s wr, 249 op/s 2024-05-08T07:52:40.342 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/copy_page_64.o 2024-05-08T07:52:40.427 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/arc4.o 2024-05-08T07:52:40.900 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/copy_user_64.o 2024-05-08T07:52:41.403 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/copy_user_uncached_64.o 2024-05-08T07:52:41.618 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-mq.o 2024-05-08T07:52:41.966 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/cpu.o 2024-05-08T07:52:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:41 smithi194 ceph-mon[33679]: pgmap v2104: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 682 KiB/s wr, 260 op/s 2024-05-08T07:52:42.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:41 smithi070 ceph-mon[29591]: pgmap v2104: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 682 KiB/s wr, 260 op/s 2024-05-08T07:52:42.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:41 smithi172 ceph-mon[33377]: pgmap v2104: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 682 KiB/s wr, 260 op/s 2024-05-08T07:52:43.332 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/rdma.o 2024-05-08T07:52:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:43 smithi194 ceph-mon[33679]: pgmap v2105: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 352 KiB/s wr, 87 op/s 2024-05-08T07:52:44.027 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/signal.o 2024-05-08T07:52:44.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:43 smithi070 ceph-mon[29591]: pgmap v2105: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 352 KiB/s wr, 87 op/s 2024-05-08T07:52:44.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:43 smithi172 ceph-mon[33377]: pgmap v2105: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 352 KiB/s wr, 87 op/s 2024-05-08T07:52:45.777 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_seq.o 2024-05-08T07:52:46.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:45 smithi194 ceph-mon[33679]: pgmap v2106: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 582 KiB/s wr, 181 op/s 2024-05-08T07:52:46.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:45 smithi070 ceph-mon[29591]: pgmap v2106: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 582 KiB/s wr, 181 op/s 2024-05-08T07:52:46.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:45 smithi172 ceph-mon[33377]: pgmap v2106: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 582 KiB/s wr, 181 op/s 2024-05-08T07:52:48.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:47 smithi194 ceph-mon[33679]: pgmap v2107: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 310 KiB/s wr, 104 op/s 2024-05-08T07:52:48.030 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/ioctl.o 2024-05-08T07:52:48.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:47 smithi070 ceph-mon[29591]: pgmap v2107: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 310 KiB/s wr, 104 op/s 2024-05-08T07:52:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:47 smithi172 ceph-mon[33377]: pgmap v2107: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 310 KiB/s wr, 104 op/s 2024-05-08T07:52:48.977 INFO:tasks.quiescer.fs.[cephfs]:Total duration (57.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T07:52:48.977 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.5 2024-05-08T07:52:48.977 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:52:49.418 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/gf128mul.o 2024-05-08T07:52:49.478 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/csum-copy_64.o 2024-05-08T07:52:49.585 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:52:49.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:49 smithi070 ceph-mon[29591]: pgmap v2108: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 310 KiB/s wr, 104 op/s 2024-05-08T07:52:50.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:49 smithi194 ceph-mon[33679]: pgmap v2108: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 310 KiB/s wr, 104 op/s 2024-05-08T07:52:50.126 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/csum-partial_64.o 2024-05-08T07:52:50.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:49 smithi172 ceph-mon[33377]: pgmap v2108: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 310 KiB/s wr, 104 op/s 2024-05-08T07:52:51.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:51 smithi070 ceph-mon[29591]: pgmap v2109: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 450 KiB/s wr, 149 op/s 2024-05-08T07:52:52.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:51 smithi194 ceph-mon[33679]: pgmap v2109: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 450 KiB/s wr, 149 op/s 2024-05-08T07:52:52.019 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/csum-wrappers_64.o 2024-05-08T07:52:52.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:51 smithi172 ceph-mon[33377]: pgmap v2109: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 450 KiB/s wr, 149 op/s 2024-05-08T07:52:52.731 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/cpuset.o 2024-05-08T07:52:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.044+0000 7f64a2600700 1 -- 172.21.15.70:0/3693228257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c06efe0 msgr2=0x7f649c06f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.044+0000 7f64a2600700 1 --2- 172.21.15.70:0/3693228257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c06efe0 0x7f649c06f3c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f648c009990 tx=0x7f648c009ca0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.044+0000 7f64a2600700 1 -- 172.21.15.70:0/3693228257 shutdown_connections 2024-05-08T07:52:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.044+0000 7f64a2600700 1 --2- 172.21.15.70:0/3693228257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f649c11cb50 0x7f649c11ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.044+0000 7f64a2600700 1 --2- 172.21.15.70:0/3693228257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c06efe0 0x7f649c06f3c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.044+0000 7f64a2600700 1 --2- 172.21.15.70:0/3693228257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649c06f900 0x7f649c11c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.044+0000 7f64a2600700 1 -- 172.21.15.70:0/3693228257 >> 172.21.15.70:0/3693228257 conn(0x7f649c06e6c0 msgr2=0x7f649c10c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:52:53.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.045+0000 7f64a2600700 1 -- 172.21.15.70:0/3693228257 shutdown_connections 2024-05-08T07:52:53.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.045+0000 7f64a2600700 1 -- 172.21.15.70:0/3693228257 wait complete. 2024-05-08T07:52:53.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.048+0000 7f64a2600700 1 Processor -- start 2024-05-08T07:52:53.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.048+0000 7f64a2600700 1 -- start start 2024-05-08T07:52:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f64a2600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649c06f900 0x7f649c1ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f64a2600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f649c11cb50 0x7f649c1aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f64a2600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1a89c0 0x7f649c1a8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f64a2600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f649c1223c0 con 0x7f649c1a89c0 2024-05-08T07:52:53.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f64a2600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f649c122240 con 0x7f649c06f900 2024-05-08T07:52:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f64a2600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f649c122540 con 0x7f649c11cb50 2024-05-08T07:52:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f649be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1a89c0 0x7f649c1a8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f649aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f649c11cb50 0x7f649c1aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f649be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1a89c0 0x7f649c1a8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57262/0 (socket says 172.21.15.70:57262) 2024-05-08T07:52:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f649be00700 1 -- 172.21.15.70:0/2153973592 learned_addr learned my addr 172.21.15.70:0/2153973592 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:52:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.049+0000 7f649b400700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649c06f900 0x7f649c1ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.050+0000 7f649be00700 1 -- 172.21.15.70:0/2153973592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f649c11cb50 msgr2=0x7f649c1aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.050+0000 7f649be00700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f649c11cb50 0x7f649c1aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.050+0000 7f649be00700 1 -- 172.21.15.70:0/2153973592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649c06f900 msgr2=0x7f649c1ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.050+0000 7f649be00700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649c06f900 0x7f649c1ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.050+0000 7f649be00700 1 -- 172.21.15.70:0/2153973592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c1a9540 con 0x7f649c1a89c0 2024-05-08T07:52:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.051+0000 7f649be00700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1a89c0 0x7f649c1a8e40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6494007f10 tx=0x7f649400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:52:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.051+0000 7f6493e00700 1 -- 172.21.15.70:0/2153973592 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494004db0 con 0x7f649c1a89c0 2024-05-08T07:52:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.051+0000 7f6493e00700 1 -- 172.21.15.70:0/2153973592 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6494009e20 con 0x7f649c1a89c0 2024-05-08T07:52:53.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.051+0000 7f6493e00700 1 -- 172.21.15.70:0/2153973592 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940059e0 con 0x7f649c1a89c0 2024-05-08T07:52:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.051+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c1b5680 con 0x7f649c1a89c0 2024-05-08T07:52:53.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.052+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c1b5a20 con 0x7f649c1a89c0 2024-05-08T07:52:53.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.053+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649c06a190 con 0x7f649c1a89c0 2024-05-08T07:52:53.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.056+0000 7f6493e00700 1 -- 172.21.15.70:0/2153973592 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6494005140 con 0x7f649c1a89c0 2024-05-08T07:52:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.059+0000 7f6493e00700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64800b2af0 0x7f64800b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:53.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.060+0000 7f6493e00700 1 -- 172.21.15.70:0/2153973592 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 9583+0+0 (secure 0 0 0) 0x7f64940e2330 con 0x7f649c1a89c0 2024-05-08T07:52:53.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.060+0000 7f649b400700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64800b2af0 0x7f64800b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:53.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.061+0000 7f649b400700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64800b2af0 0x7f64800b4fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f648c000c00 tx=0x7f648c01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:52:53.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.066+0000 7f6493e00700 1 -- 172.21.15.70:0/2153973592 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6494010070 con 0x7f649c1a89c0 2024-05-08T07:52:53.453 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/openclose.o 2024-05-08T07:52:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.541+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f649c02e6d0 con 0x7f649c1a89c0 2024-05-08T07:52:53.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.542+0000 7f6493e00700 1 -- 172.21.15.70:0/2153973592 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f64940a97f0 con 0x7f649c1a89c0 2024-05-08T07:52:53.539 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:52:53.539 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.546+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64800b2af0 msgr2=0x7f64800b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.546+0000 7f64a2600700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64800b2af0 0x7f64800b4fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f648c000c00 tx=0x7f648c01a040 comp rx=0 tx=0).stop 2024-05-08T07:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.546+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1a89c0 msgr2=0x7f649c1a8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.546+0000 7f64a2600700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1a89c0 0x7f649c1a8e40 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f6494007f10 tx=0x7f649400d3b0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.547+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 shutdown_connections 2024-05-08T07:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.547+0000 7f64a2600700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64800b2af0 0x7f64800b4fb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.547+0000 7f64a2600700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f649c1a89c0 0x7f649c1a8e40 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.547+0000 7f64a2600700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f649c06f900 0x7f649c1ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.547+0000 7f64a2600700 1 --2- 172.21.15.70:0/2153973592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f649c11cb50 0x7f649c1aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.547+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 >> 172.21.15.70:0/2153973592 conn(0x7f649c06e6c0 msgr2=0x7f649c10c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.547+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 shutdown_connections 2024-05-08T07:52:53.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:53.547+0000 7f64a2600700 1 -- 172.21.15.70:0/2153973592 wait complete. 2024-05-08T07:52:53.544 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:52:53.698 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_stat.o 2024-05-08T07:52:53.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:53 smithi070 ceph-mon[29591]: pgmap v2110: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 370 KiB/s wr, 139 op/s 2024-05-08T07:52:53.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:53 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2153973592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:52:54.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:53 smithi194 ceph-mon[33679]: pgmap v2110: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 370 KiB/s wr, 139 op/s 2024-05-08T07:52:54.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:53 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2153973592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:52:54.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:53 smithi172 ceph-mon[33377]: pgmap v2110: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 370 KiB/s wr, 139 op/s 2024-05-08T07:52:54.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:53 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2153973592' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:52:54.376 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 88.5 --await-for 42.0' 2024-05-08T07:52:54.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 88.5 --await-for 42.0 2024-05-08T07:52:54.524 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-mq-tag.o 2024-05-08T07:52:54.963 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:52:55.106 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/signal_64.o 2024-05-08T07:52:55.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:55 smithi070 ceph-mon[29591]: pgmap v2111: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 594 KiB/s wr, 154 op/s 2024-05-08T07:52:56.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:55 smithi194 ceph-mon[33679]: pgmap v2111: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 594 KiB/s wr, 154 op/s 2024-05-08T07:52:56.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:55 smithi172 ceph-mon[33377]: pgmap v2111: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 594 KiB/s wr, 154 op/s 2024-05-08T07:52:56.522 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/blake2s.o 2024-05-08T07:52:57.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:57 smithi070 ceph-mon[29591]: pgmap v2112: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 364 KiB/s wr, 60 op/s 2024-05-08T07:52:58.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:57 smithi172 ceph-mon[33377]: pgmap v2112: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 364 KiB/s wr, 60 op/s 2024-05-08T07:52:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.256+0000 7f984e000700 1 -- 172.21.15.70:0/2509151479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848108460 msgr2=0x7f9848108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.256+0000 7f984e000700 1 --2- 172.21.15.70:0/2509151479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848108460 0x7f9848108840 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f9838009990 tx=0x7f9838009ca0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.256+0000 7f984e000700 1 -- 172.21.15.70:0/2509151479 shutdown_connections 2024-05-08T07:52:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.256+0000 7f984e000700 1 --2- 172.21.15.70:0/2509151479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848103ef0 0x7f98481103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.256+0000 7f984e000700 1 --2- 172.21.15.70:0/2509151479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848108460 0x7f9848108840 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.256+0000 7f984e000700 1 --2- 172.21.15.70:0/2509151479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848103550 0x7f98481039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.256+0000 7f984e000700 1 -- 172.21.15.70:0/2509151479 >> 172.21.15.70:0/2509151479 conn(0x7f984807a600 msgr2=0x7f984807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:52:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.256+0000 7f984e000700 1 -- 172.21.15.70:0/2509151479 shutdown_connections 2024-05-08T07:52:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.256+0000 7f984e000700 1 -- 172.21.15.70:0/2509151479 wait complete. 2024-05-08T07:52:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.257+0000 7f984e000700 1 Processor -- start 2024-05-08T07:52:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.257+0000 7f984e000700 1 -- start start 2024-05-08T07:52:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.258+0000 7f984e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848103550 0x7f984810a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.258+0000 7f984e000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848103ef0 0x7f984810a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.258+0000 7f984e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848108460 0x7f984810ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.258+0000 7f984e000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f98481136d0 con 0x7f9848103550 2024-05-08T07:52:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.258+0000 7f984e000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9848113550 con 0x7f9848108460 2024-05-08T07:52:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.258+0000 7f984e000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9848113850 con 0x7f9848103ef0 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.259+0000 7f9847e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848108460 0x7f984810ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.259+0000 7f9846a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848103ef0 0x7f984810a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.259+0000 7f9847e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848108460 0x7f984810ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36400/0 (socket says 172.21.15.70:36400) 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.259+0000 7f9847e00700 1 -- 172.21.15.70:0/2608609609 learned_addr learned my addr 172.21.15.70:0/2608609609 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.259+0000 7f9846a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848103ef0 0x7f984810a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:60394/0 (socket says 172.21.15.70:60394) 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.259+0000 7f9847400700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848103550 0x7f984810a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.260+0000 7f9847e00700 1 -- 172.21.15.70:0/2608609609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848103ef0 msgr2=0x7f984810a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.260+0000 7f9847e00700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848103ef0 0x7f984810a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.260+0000 7f9847e00700 1 -- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848103550 msgr2=0x7f984810a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.260+0000 7f9847e00700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848103550 0x7f984810a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.260+0000 7f9847e00700 1 -- 172.21.15.70:0/2608609609 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98481ac470 con 0x7f9848108460 2024-05-08T07:52:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.260+0000 7f9847e00700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848108460 0x7f984810ae60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f984000b9e0 tx=0x7f984000bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:52:58.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:57 smithi194 ceph-mon[33679]: pgmap v2112: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 364 KiB/s wr, 60 op/s 2024-05-08T07:52:58.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.261+0000 7f983fe00700 1 -- 172.21.15.70:0/2608609609 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984000d8e0 con 0x7f9848108460 2024-05-08T07:52:58.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.261+0000 7f984e000700 1 -- 172.21.15.70:0/2608609609 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98481ac760 con 0x7f9848108460 2024-05-08T07:52:58.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.261+0000 7f983fe00700 1 -- 172.21.15.70:0/2608609609 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9840015420 con 0x7f9848108460 2024-05-08T07:52:58.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.261+0000 7f983fe00700 1 -- 172.21.15.70:0/2608609609 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840014630 con 0x7f9848108460 2024-05-08T07:52:58.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.261+0000 7f984e000700 1 -- 172.21.15.70:0/2608609609 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98481acca0 con 0x7f9848108460 2024-05-08T07:52:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.267+0000 7f983fe00700 1 -- 172.21.15.70:0/2608609609 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f98400147d0 con 0x7f9848108460 2024-05-08T07:52:58.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.270+0000 7f983fe00700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f982c0b2ba0 0x7f982c0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.270+0000 7f983fe00700 1 -- 172.21.15.70:0/2608609609 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 9583+0+0 (secure 0 0 0) 0x7f98400e2390 con 0x7f9848108460 2024-05-08T07:52:58.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.270+0000 7f9847400700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f982c0b2ba0 0x7f982c0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.271+0000 7f9847400700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f982c0b2ba0 0x7f982c0b5060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f983800b5c0 tx=0x7f983801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:52:58.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.282+0000 7f98589a5b80 1 Processor -- start 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.283+0000 7f98589a5b80 1 -- start start 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.283+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dffef50 0x555d4dfff330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.283+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 0x555d4dff99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.283+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e005d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.283+0000 7f98589a5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555d4df4bbb0 con 0x555d4dff9ee0 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.283+0000 7f98589a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d4dee98f0 con 0x555d4dff9520 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.283+0000 7f98589a5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555d4df47b70 con 0x555d4dffef50 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.284+0000 7f9847e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e005d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.284+0000 7f9846a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 0x555d4dff99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.284+0000 7f9847e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e005d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49768/0 (socket says 172.21.15.70:49768) 2024-05-08T07:52:58.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.284+0000 7f9847e00700 1 -- 172.21.15.70:0/1153528870 learned_addr learned my addr 172.21.15.70:0/1153528870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:52:58.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.284+0000 7f9847400700 1 --2- 172.21.15.70:0/1153528870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dffef50 0x555d4dfff330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.285+0000 7f9846a00700 1 -- 172.21.15.70:0/1153528870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dffef50 msgr2=0x555d4dfff330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:52:58.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.285+0000 7f9846a00700 1 --2- 172.21.15.70:0/1153528870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dffef50 0x555d4dfff330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.285+0000 7f9846a00700 1 -- 172.21.15.70:0/1153528870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 msgr2=0x555d4e005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:52:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.285+0000 7f9846a00700 1 --2- 172.21.15.70:0/1153528870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e005d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.285+0000 7f9846a00700 1 -- 172.21.15.70:0/1153528870 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d4de98a60 con 0x555d4dff9520 2024-05-08T07:52:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.285+0000 7f9847400700 1 --2- 172.21.15.70:0/1153528870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dffef50 0x555d4dfff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:52:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.285+0000 7f9846a00700 1 --2- 172.21.15.70:0/1153528870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 0x555d4dff99a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f984810bbe0 tx=0x7f9834009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d59e093f1e6d54d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:52:58.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.286+0000 7f983cc00700 1 -- 172.21.15.70:0/1153528870 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834017070 con 0x555d4dff9520 2024-05-08T07:52:58.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.286+0000 7f983cc00700 1 -- 172.21.15.70:0/1153528870 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f983400ed60 con 0x555d4dff9520 2024-05-08T07:52:58.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.286+0000 7f983cc00700 1 -- 172.21.15.70:0/1153528870 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834013ca0 con 0x555d4dff9520 2024-05-08T07:52:58.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.288+0000 7f98589a5b80 1 -- 172.21.15.70:0/1153528870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 msgr2=0x555d4dff99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:58.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.288+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1153528870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 0x555d4dff99a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f984810bbe0 tx=0x7f9834009cd0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.288+0000 7f98589a5b80 1 -- 172.21.15.70:0/1153528870 shutdown_connections 2024-05-08T07:52:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.288+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1153528870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e005d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.288+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1153528870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dffef50 0x555d4dfff330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.288+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1153528870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 0x555d4dff99a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.289+0000 7f98589a5b80 1 -- 172.21.15.70:0/1153528870 >> 172.21.15.70:0/1153528870 conn(0x555d4df27cf0 msgr2=0x555d4dff3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:52:58.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.289+0000 7f98589a5b80 1 -- 172.21.15.70:0/1153528870 shutdown_connections 2024-05-08T07:52:58.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.289+0000 7f98589a5b80 1 -- 172.21.15.70:0/1153528870 wait complete. 2024-05-08T07:52:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.290+0000 7f98589a5b80 1 -- start start 2024-05-08T07:52:58.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.291+0000 7f98589a5b80 1 Processor -- start 2024-05-08T07:52:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.291+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 0x555d4e005950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.291+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e002cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.292+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 0x555d4e003230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.292+0000 7f98589a5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555d4e0172c0 con 0x555d4dff9ee0 2024-05-08T07:52:58.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.292+0000 7f98589a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555d4deb1cb0 con 0x555d4dffef50 2024-05-08T07:52:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.292+0000 7f98589a5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555d4e017440 con 0x555d4dff9520 2024-05-08T07:52:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.292+0000 7f98589a5b80 10 client.0 _ll_register_callbacks cb 0x555d4def2e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:52:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.292+0000 7f9846a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e002cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.292+0000 7f9846a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e002cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49782/0 (socket says 172.21.15.70:49782) 2024-05-08T07:52:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.292+0000 7f9846a00700 1 -- 172.21.15.70:0/1603696928 learned_addr learned my addr 172.21.15.70:0/1603696928 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:52:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.292+0000 7f9847400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 0x555d4e005950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.293+0000 7f9847e00700 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 0x555d4e003230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.293+0000 7f9846a00700 1 -- 172.21.15.70:0/1603696928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 msgr2=0x555d4e005950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:52:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.293+0000 7f9846a00700 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 0x555d4e005950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.293+0000 7f9846a00700 1 -- 172.21.15.70:0/1603696928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 msgr2=0x555d4e003230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:52:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.293+0000 7f9846a00700 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 0x555d4e003230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.293+0000 7f9846a00700 1 -- 172.21.15.70:0/1603696928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d4df115b0 con 0x555d4dff9ee0 2024-05-08T07:52:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.294+0000 7f9846a00700 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e002cf0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f98340095f0 tx=0x7f983400eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be87fb76a922c99 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:52:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.294+0000 7f9831600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:52:58.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.294+0000 7f9831600700 1 -- 172.21.15.70:0/1603696928 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834017040 con 0x555d4dff9ee0 2024-05-08T07:52:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.295+0000 7f9831600700 1 -- 172.21.15.70:0/1603696928 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 9583+0+0 (secure 0 0 0) 0x7f9834013cf0 con 0x555d4dff9ee0 2024-05-08T07:52:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.295+0000 7f98589a5b80 1 -- 172.21.15.70:0/1603696928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f983400ed60 con 0x555d4dff9ee0 2024-05-08T07:52:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.295+0000 7f9831600700 1 -- 172.21.15.70:0/1603696928 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f983401c450 con 0x555d4dff9ee0 2024-05-08T07:52:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.295+0000 7f98589a5b80 10 client.17310 fetch_fsmap learned FSMap version 42 2024-05-08T07:52:58.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.296+0000 7f98589a5b80 1 -- 172.21.15.70:0/1603696928 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555d4e021a70 con 0x555d4dff9ee0 2024-05-08T07:52:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.296+0000 7f9831600700 1 -- 172.21.15.70:0/1603696928 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f983400ed60 con 0x555d4dff9ee0 2024-05-08T07:52:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.296+0000 7f9831600700 1 -- 172.21.15.70:0/1603696928 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9834023070 con 0x555d4dff9ee0 2024-05-08T07:52:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.297+0000 7f98589a5b80 10 client.17310 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:52:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.297+0000 7f98589a5b80 10 client.17310 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:52:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.297+0000 7f98589a5b80 20 client.17310 populate_metadata read hostname 'smithi070' 2024-05-08T07:52:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.297+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555d4e023f40 0x555d4e026330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.297+0000 7f98589a5b80 4 client.17310 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:52:58.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.297+0000 7f98589a5b80 1 -- 172.21.15.70:0/1603696928 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d4dfc6230 con 0x555d4e023f40 2024-05-08T07:52:58.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.297+0000 7f9847400700 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555d4e023f40 0x555d4e026330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.299+0000 7f9847400700 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555d4e023f40 0x555d4e026330 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856aa797a4994cb0 server_cookie=773474aa4cdebb4e in_seq=0 out_seq=0 2024-05-08T07:52:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.299+0000 7f9831600700 10 client.17310 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:52:58.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.302+0000 7f9831600700 1 -- 172.21.15.70:0/1603696928 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555d4dfc6230 con 0x555d4e023f40 2024-05-08T07:52:58.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.302+0000 7f9831600700 10 client.17310 handle_command_reply: tid=0 2024-05-08T07:52:58.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.302+0000 7f98589a5b80 1 client.17310 shutdown 2024-05-08T07:52:58.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 -- 172.21.15.70:0/1603696928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 msgr2=0x555d4e002cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:58.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e002cf0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f98340095f0 tx=0x7f983400eb00 comp rx=0 tx=0).stop 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 -- 172.21.15.70:0/1603696928 shutdown_connections 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555d4e023f40 0x555d4e026330 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 0x555d4e003230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 0x555d4e005950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 --2- 172.21.15.70:0/1603696928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff9ee0 0x555d4e002cf0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 -- 172.21.15.70:0/1603696928 >> 172.21.15.70:0/1603696928 conn(0x555d4df27cf0 msgr2=0x555d4dfee8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f9831600700 0 client.17310 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 -- 172.21.15.70:0/1603696928 shutdown_connections 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 1 -- 172.21.15.70:0/1603696928 wait complete. 2024-05-08T07:52:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.303+0000 7f98589a5b80 20 client.17310 trim_cache size 0 max 16384 2024-05-08T07:52:58.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.336+0000 7f98589a5b80 1 Processor -- start 2024-05-08T07:52:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.336+0000 7f98589a5b80 1 -- start start 2024-05-08T07:52:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.336+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 0x555d4e020310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.336+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 0x555d4e02b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.336+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff8970 0x555d4e02be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.336+0000 7f98589a5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f98481afe90 con 0x555d4dff8970 2024-05-08T07:52:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.336+0000 7f98589a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f98481ad720 con 0x555d4dffef50 2024-05-08T07:52:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.336+0000 7f98589a5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f98481a2980 con 0x555d4dff9520 2024-05-08T07:52:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.337+0000 7f9847e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff8970 0x555d4e02be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.337+0000 7f9847e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff8970 0x555d4e02be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49794/0 (socket says 172.21.15.70:49794) 2024-05-08T07:52:58.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.337+0000 7f9847e00700 1 -- 172.21.15.70:0/3640817471 learned_addr learned my addr 172.21.15.70:0/3640817471 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:52:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.337+0000 7f9846a00700 1 --2- 172.21.15.70:0/3640817471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 0x555d4e02b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.337+0000 7f9847400700 1 --2- 172.21.15.70:0/3640817471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 0x555d4e020310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.337+0000 7f9847e00700 1 -- 172.21.15.70:0/3640817471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 msgr2=0x555d4e020310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:52:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.337+0000 7f9847e00700 1 --2- 172.21.15.70:0/3640817471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 0x555d4e020310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.338+0000 7f9847e00700 1 -- 172.21.15.70:0/3640817471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 msgr2=0x555d4e02b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:52:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.338+0000 7f9847e00700 1 --2- 172.21.15.70:0/3640817471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 0x555d4e02b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.338+0000 7f9847e00700 1 -- 172.21.15.70:0/3640817471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d4e0266f0 con 0x555d4dff8970 2024-05-08T07:52:58.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.338+0000 7f9847e00700 1 --2- 172.21.15.70:0/3640817471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff8970 0x555d4e02be70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f984000b9b0 tx=0x7f9840004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ea3de2e762bf74 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:52:58.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.339+0000 7f9833e00700 1 -- 172.21.15.70:0/3640817471 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98400a91f0 con 0x555d4dff8970 2024-05-08T07:52:58.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.339+0000 7f9833e00700 1 -- 172.21.15.70:0/3640817471 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98400ad5a0 con 0x555d4dff8970 2024-05-08T07:52:58.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.339+0000 7f9833e00700 1 -- 172.21.15.70:0/3640817471 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98400a9450 con 0x555d4dff8970 2024-05-08T07:52:58.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.340+0000 7f98589a5b80 1 -- 172.21.15.70:0/3640817471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff8970 msgr2=0x555d4e02be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:52:58.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.340+0000 7f98589a5b80 1 --2- 172.21.15.70:0/3640817471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff8970 0x555d4e02be70 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f984000b9b0 tx=0x7f9840004be0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.340+0000 7f98589a5b80 1 -- 172.21.15.70:0/3640817471 shutdown_connections 2024-05-08T07:52:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.340+0000 7f98589a5b80 1 --2- 172.21.15.70:0/3640817471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dff8970 0x555d4e02be70 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.340+0000 7f98589a5b80 1 --2- 172.21.15.70:0/3640817471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff9520 0x555d4e020310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.340+0000 7f98589a5b80 1 --2- 172.21.15.70:0/3640817471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dffef50 0x555d4e02b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.340+0000 7f98589a5b80 1 -- 172.21.15.70:0/3640817471 >> 172.21.15.70:0/3640817471 conn(0x555d4df27cf0 msgr2=0x555d4dfee8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:52:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.340+0000 7f98589a5b80 1 -- 172.21.15.70:0/3640817471 shutdown_connections 2024-05-08T07:52:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.340+0000 7f98589a5b80 1 -- 172.21.15.70:0/3640817471 wait complete. 2024-05-08T07:52:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.341+0000 7f98589a5b80 1 -- start start 2024-05-08T07:52:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.341+0000 7f98589a5b80 1 Processor -- start 2024-05-08T07:52:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.342+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff8970 0x555d4e01cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.342+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 0x555d4e0180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.342+0000 7f98589a5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dffef50 0x555d4e018670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.342+0000 7f98589a5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f98481a2fd0 con 0x555d4dffef50 2024-05-08T07:52:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.342+0000 7f98589a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f98481ad050 con 0x555d4dff9520 2024-05-08T07:52:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.342+0000 7f98589a5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f98481a36a0 con 0x555d4dff8970 2024-05-08T07:52:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.342+0000 7f98589a5b80 10 client.0 _ll_register_callbacks cb 0x555d4def2e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:52:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.343+0000 7f9847e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dffef50 0x555d4e018670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.343+0000 7f9847e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dffef50 0x555d4e018670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49800/0 (socket says 172.21.15.70:49800) 2024-05-08T07:52:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.343+0000 7f9847e00700 1 -- 172.21.15.70:0/466562012 learned_addr learned my addr 172.21.15.70:0/466562012 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:52:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.343+0000 7f9847e00700 1 -- 172.21.15.70:0/466562012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff8970 msgr2=0x555d4e01cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:52:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.343+0000 7f9847e00700 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff8970 0x555d4e01cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.343+0000 7f9847e00700 1 -- 172.21.15.70:0/466562012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 msgr2=0x555d4e0180f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:52:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.343+0000 7f9847e00700 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 0x555d4e0180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:52:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.343+0000 7f9847e00700 1 -- 172.21.15.70:0/466562012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d4e018eb0 con 0x555d4dffef50 2024-05-08T07:52:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.344+0000 7f9847e00700 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dffef50 0x555d4e018670 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f9840009ee0 tx=0x7f9840004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6113212dd9838b78 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:52:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.344+0000 7f9831600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:52:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.344+0000 7f9831600700 1 -- 172.21.15.70:0/466562012 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984006c020 con 0x555d4dffef50 2024-05-08T07:52:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.344+0000 7f9831600700 1 -- 172.21.15.70:0/466562012 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(211..211 src has 1..211) ==== 9583+0+0 (secure 0 0 0) 0x7f98400a9450 con 0x555d4dffef50 2024-05-08T07:52:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.344+0000 7f98589a5b80 1 -- 172.21.15.70:0/466562012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98400ad5a0 con 0x555d4dffef50 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.345+0000 7f9831600700 1 -- 172.21.15.70:0/466562012 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f98400a9650 con 0x555d4dffef50 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.345+0000 7f98589a5b80 10 client.17316 fetch_fsmap learned FSMap version 42 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.345+0000 7f98589a5b80 1 -- 172.21.15.70:0/466562012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555d4e090580 con 0x555d4dffef50 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.345+0000 7f9831600700 1 -- 172.21.15.70:0/466562012 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98400ad5a0 con 0x555d4dffef50 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.345+0000 7f9831600700 1 -- 172.21.15.70:0/466562012 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f98400c3c00 con 0x555d4dffef50 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.346+0000 7f98589a5b80 10 client.17316 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.346+0000 7f98589a5b80 10 client.17316 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.346+0000 7f98589a5b80 20 client.17316 populate_metadata read hostname 'smithi070' 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.346+0000 7f98589a5b80 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555d4e090c60 0x555d4e0930a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.346+0000 7f98589a5b80 4 client.17316 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.5, "await_for": 42.0}] 2024-05-08T07:52:58.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.346+0000 7f98589a5b80 1 -- 172.21.15.70:0/466562012 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.5, "await_for": 42.0}) -- 0x555d4df59590 con 0x555d4e090c60 2024-05-08T07:52:58.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.346+0000 7f9847400700 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555d4e090c60 0x555d4e0930a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:52:58.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.347+0000 7f9847400700 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555d4e090c60 0x555d4e0930a0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce568cb9ef0bc34 server_cookie=2b98881da7bf210b in_seq=0 out_seq=0 2024-05-08T07:52:58.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:52:58.347+0000 7f9831600700 10 client.17316 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:52:58.550 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/delay.o 2024-05-08T07:53:00.059 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:52:59 smithi194 ceph-mon[33679]: pgmap v2113: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 364 KiB/s wr, 60 op/s 2024-05-08T07:53:00.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:52:59 smithi070 ceph-mon[29591]: pgmap v2113: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 364 KiB/s wr, 60 op/s 2024-05-08T07:53:00.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:52:59 smithi172 ceph-mon[33377]: pgmap v2113: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 364 KiB/s wr, 60 op/s 2024-05-08T07:53:02.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:01 smithi070 ceph-mon[29591]: pgmap v2114: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 517 KiB/s wr, 127 op/s 2024-05-08T07:53:02.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:01 smithi172 ceph-mon[33377]: pgmap v2114: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 517 KiB/s wr, 127 op/s 2024-05-08T07:53:02.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:01 smithi194 ceph-mon[33679]: pgmap v2114: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 517 KiB/s wr, 127 op/s 2024-05-08T07:53:04.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:03 smithi070 ceph-mon[29591]: pgmap v2115: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 376 KiB/s wr, 82 op/s 2024-05-08T07:53:04.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:03 smithi172 ceph-mon[33377]: pgmap v2115: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 376 KiB/s wr, 82 op/s 2024-05-08T07:53:04.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:03 smithi194 ceph-mon[33679]: pgmap v2115: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 376 KiB/s wr, 82 op/s 2024-05-08T07:53:06.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:05 smithi070 ceph-mon[29591]: pgmap v2116: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 457 KiB/s wr, 88 op/s 2024-05-08T07:53:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:05 smithi172 ceph-mon[33377]: pgmap v2116: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 457 KiB/s wr, 88 op/s 2024-05-08T07:53:06.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:05 smithi194 ceph-mon[33679]: pgmap v2116: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 388 KiB/s rd, 457 KiB/s wr, 88 op/s 2024-05-08T07:53:08.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:07 smithi070 ceph-mon[29591]: pgmap v2117: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 233 KiB/s wr, 72 op/s 2024-05-08T07:53:08.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:07 smithi172 ceph-mon[33377]: pgmap v2117: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 233 KiB/s wr, 72 op/s 2024-05-08T07:53:08.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:07 smithi194 ceph-mon[33679]: pgmap v2117: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 233 KiB/s wr, 72 op/s 2024-05-08T07:53:09.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:53:09.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:53:09.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:53:10.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:09 smithi070 ceph-mon[29591]: pgmap v2118: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 233 KiB/s wr, 72 op/s 2024-05-08T07:53:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:09 smithi172 ceph-mon[33377]: pgmap v2118: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 233 KiB/s wr, 72 op/s 2024-05-08T07:53:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:09 smithi194 ceph-mon[33679]: pgmap v2118: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 233 KiB/s wr, 72 op/s 2024-05-08T07:53:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:53:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:53:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:53:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:53:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:53:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:53:11.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:53:11.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:53:11.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:53:12.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:11 smithi070 ceph-mon[29591]: pgmap v2119: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 279 KiB/s wr, 77 op/s 2024-05-08T07:53:12.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:11 smithi172 ceph-mon[33377]: pgmap v2119: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 279 KiB/s wr, 77 op/s 2024-05-08T07:53:12.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:11 smithi194 ceph-mon[33679]: pgmap v2119: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 238 KiB/s rd, 279 KiB/s wr, 77 op/s 2024-05-08T07:53:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:13 smithi070 ceph-mon[29591]: pgmap v2120: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 126 KiB/s wr, 9 op/s 2024-05-08T07:53:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:13 smithi172 ceph-mon[33377]: pgmap v2120: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 126 KiB/s wr, 9 op/s 2024-05-08T07:53:14.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:13 smithi194 ceph-mon[33679]: pgmap v2120: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 126 KiB/s wr, 9 op/s 2024-05-08T07:53:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:15 smithi070 ceph-mon[29591]: pgmap v2121: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 192 KiB/s wr, 28 op/s 2024-05-08T07:53:16.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:15 smithi172 ceph-mon[33377]: pgmap v2121: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 192 KiB/s wr, 28 op/s 2024-05-08T07:53:16.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:15 smithi194 ceph-mon[33679]: pgmap v2121: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 192 KiB/s wr, 28 op/s 2024-05-08T07:53:18.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:17 smithi070 ceph-mon[29591]: pgmap v2122: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 111 KiB/s wr, 22 op/s 2024-05-08T07:53:18.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:17 smithi172 ceph-mon[33377]: pgmap v2122: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 111 KiB/s wr, 22 op/s 2024-05-08T07:53:18.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:17 smithi194 ceph-mon[33679]: pgmap v2122: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 111 KiB/s wr, 22 op/s 2024-05-08T07:53:20.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:19 smithi070 ceph-mon[29591]: pgmap v2123: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 111 KiB/s wr, 22 op/s 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.145+0000 7f9831600700 1 -- 172.21.15.70:0/466562012 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x555d4df59590 con 0x555d4e090c60 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.145+0000 7f9831600700 10 client.17316 handle_command_reply: tid=0 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.145+0000 7f98589a5b80 1 client.17316 shutdown 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.146+0000 7f98589a5b80 1 -- 172.21.15.70:0/466562012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dffef50 msgr2=0x555d4e018670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.146+0000 7f98589a5b80 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dffef50 0x555d4e018670 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f9840009ee0 tx=0x7f9840004ad0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.146+0000 7f98589a5b80 1 -- 172.21.15.70:0/466562012 shutdown_connections 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.146+0000 7f98589a5b80 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555d4e090c60 0x555d4e0930a0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.146+0000 7f98589a5b80 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555d4dffef50 0x555d4e018670 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.146+0000 7f98589a5b80 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555d4dff8970 0x555d4e01cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.146+0000 7f98589a5b80 1 --2- 172.21.15.70:0/466562012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555d4dff9520 0x555d4e0180f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.146+0000 7f98589a5b80 1 -- 172.21.15.70:0/466562012 >> 172.21.15.70:0/466562012 conn(0x555d4df27cf0 msgr2=0x555d4e0042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:53:20.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.146+0000 7f9831600700 0 client.17316 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:53:20.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.147+0000 7f98589a5b80 1 -- 172.21.15.70:0/466562012 shutdown_connections 2024-05-08T07:53:20.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.147+0000 7f98589a5b80 1 -- 172.21.15.70:0/466562012 wait complete. 2024-05-08T07:53:20.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.147+0000 7f98589a5b80 20 client.17316 trim_cache size 0 max 16384 2024-05-08T07:53:20.144 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:53:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:53:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:53:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 162, 2024-05-08T07:53:20.144 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "4bf4017b": { 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 162, 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.5, 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:53:20.145 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:53:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:53:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:53:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:53:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:53:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:53:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:53:20.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:53:20.146 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:53:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.149+0000 7f984e000700 1 -- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f982c0b2ba0 msgr2=0x7f982c0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.149+0000 7f984e000700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f982c0b2ba0 0x7f982c0b5060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f983800b5c0 tx=0x7f983801a040 comp rx=0 tx=0).stop 2024-05-08T07:53:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.149+0000 7f984e000700 1 -- 172.21.15.70:0/2608609609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848108460 msgr2=0x7f984810ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.149+0000 7f984e000700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848108460 0x7f984810ae60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f984000b9e0 tx=0x7f984000bcf0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.150+0000 7f984e000700 1 -- 172.21.15.70:0/2608609609 shutdown_connections 2024-05-08T07:53:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.150+0000 7f984e000700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f982c0b2ba0 0x7f982c0b5060 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.150+0000 7f984e000700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9848108460 0x7f984810ae60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.150+0000 7f984e000700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9848103550 0x7f984810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.150+0000 7f984e000700 1 --2- 172.21.15.70:0/2608609609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9848103ef0 0x7f984810a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.150+0000 7f984e000700 1 -- 172.21.15.70:0/2608609609 >> 172.21.15.70:0/2608609609 conn(0x7f984807a600 msgr2=0x7f98481013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:53:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.150+0000 7f984e000700 1 -- 172.21.15.70:0/2608609609 shutdown_connections 2024-05-08T07:53:20.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:20.151+0000 7f984e000700 1 -- 172.21.15.70:0/2608609609 wait complete. 2024-05-08T07:53:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:19 smithi172 ceph-mon[33377]: pgmap v2123: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 111 KiB/s wr, 22 op/s 2024-05-08T07:53:20.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:19 smithi194 ceph-mon[33679]: pgmap v2123: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 111 KiB/s wr, 22 op/s 2024-05-08T07:53:21.922 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4bf4017b', quiesce took 32.9 seconds. Will release after: 28.5 2024-05-08T07:53:22.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:21 smithi070 ceph-mon[29591]: pgmap v2124: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 188 KiB/s wr, 28 op/s 2024-05-08T07:53:22.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:21 smithi172 ceph-mon[33377]: pgmap v2124: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 188 KiB/s wr, 28 op/s 2024-05-08T07:53:22.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:21 smithi194 ceph-mon[33679]: pgmap v2124: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 188 KiB/s wr, 28 op/s 2024-05-08T07:53:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:23 smithi070 ceph-mon[29591]: pgmap v2125: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 142 KiB/s wr, 24 op/s 2024-05-08T07:53:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:23 smithi172 ceph-mon[33377]: pgmap v2125: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 142 KiB/s wr, 24 op/s 2024-05-08T07:53:24.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:23 smithi194 ceph-mon[33679]: pgmap v2125: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 142 KiB/s wr, 24 op/s 2024-05-08T07:53:26.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:25 smithi070 ceph-mon[29591]: pgmap v2126: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 171 KiB/s wr, 28 op/s 2024-05-08T07:53:26.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:25 smithi172 ceph-mon[33377]: pgmap v2126: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 171 KiB/s wr, 28 op/s 2024-05-08T07:53:26.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:25 smithi194 ceph-mon[33679]: pgmap v2126: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 171 KiB/s wr, 28 op/s 2024-05-08T07:53:27.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:26 smithi070 ceph-mon[29591]: osdmap e212: 12 total, 12 up, 12 in 2024-05-08T07:53:27.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:26 smithi172 ceph-mon[33377]: osdmap e212: 12 total, 12 up, 12 in 2024-05-08T07:53:27.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:26 smithi194 ceph-mon[33679]: osdmap e212: 12 total, 12 up, 12 in 2024-05-08T07:53:28.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:27 smithi172 ceph-mon[33377]: pgmap v2128: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 127 KiB/s wr, 12 op/s 2024-05-08T07:53:28.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:27 smithi194 ceph-mon[33679]: pgmap v2128: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 127 KiB/s wr, 12 op/s 2024-05-08T07:53:28.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:27 smithi070 ceph-mon[29591]: pgmap v2128: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 127 KiB/s wr, 12 op/s 2024-05-08T07:53:30.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:29 smithi172 ceph-mon[33377]: pgmap v2129: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 127 KiB/s wr, 12 op/s 2024-05-08T07:53:30.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:29 smithi194 ceph-mon[33679]: pgmap v2129: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 127 KiB/s wr, 12 op/s 2024-05-08T07:53:30.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:29 smithi070 ceph-mon[29591]: pgmap v2129: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 127 KiB/s wr, 12 op/s 2024-05-08T07:53:32.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:31 smithi172 ceph-mon[33377]: pgmap v2130: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 9 op/s 2024-05-08T07:53:32.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:31 smithi194 ceph-mon[33679]: pgmap v2130: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 9 op/s 2024-05-08T07:53:32.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:31 smithi070 ceph-mon[29591]: pgmap v2130: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 9 op/s 2024-05-08T07:53:34.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:33 smithi172 ceph-mon[33377]: pgmap v2131: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 9 op/s 2024-05-08T07:53:34.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:33 smithi172 ceph-mon[33377]: osdmap e213: 12 total, 12 up, 12 in 2024-05-08T07:53:34.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:33 smithi194 ceph-mon[33679]: pgmap v2131: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 9 op/s 2024-05-08T07:53:34.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:33 smithi194 ceph-mon[33679]: osdmap e213: 12 total, 12 up, 12 in 2024-05-08T07:53:34.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:33 smithi070 ceph-mon[29591]: pgmap v2131: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 9 op/s 2024-05-08T07:53:34.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:33 smithi070 ceph-mon[29591]: osdmap e213: 12 total, 12 up, 12 in 2024-05-08T07:53:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:35 smithi172 ceph-mon[33377]: pgmap v2133: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 97 KiB/s wr, 156 op/s 2024-05-08T07:53:36.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:35 smithi194 ceph-mon[33679]: pgmap v2133: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 97 KiB/s wr, 156 op/s 2024-05-08T07:53:36.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:35 smithi070 ceph-mon[29591]: pgmap v2133: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 97 KiB/s wr, 156 op/s 2024-05-08T07:53:37.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:36 smithi172 ceph-mon[33377]: pgmap v2134: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 84 KiB/s wr, 136 op/s 2024-05-08T07:53:37.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:36 smithi194 ceph-mon[33679]: pgmap v2134: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 84 KiB/s wr, 136 op/s 2024-05-08T07:53:37.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:36 smithi070 ceph-mon[29591]: pgmap v2134: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 84 KiB/s wr, 136 op/s 2024-05-08T07:53:39.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:39 smithi172 ceph-mon[33377]: pgmap v2135: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 84 KiB/s wr, 136 op/s 2024-05-08T07:53:40.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:39 smithi194 ceph-mon[33679]: pgmap v2135: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 84 KiB/s wr, 136 op/s 2024-05-08T07:53:40.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:39 smithi070 ceph-mon[29591]: pgmap v2135: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 84 KiB/s wr, 136 op/s 2024-05-08T07:53:41.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:41 smithi172 ceph-mon[33377]: pgmap v2136: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 48 KiB/s wr, 135 op/s 2024-05-08T07:53:41.926 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:41 smithi070 ceph-mon[29591]: pgmap v2136: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 48 KiB/s wr, 135 op/s 2024-05-08T07:53:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:41 smithi194 ceph-mon[33679]: pgmap v2136: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 48 KiB/s wr, 135 op/s 2024-05-08T07:53:43.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:43 smithi172 ceph-mon[33377]: pgmap v2137: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 48 KiB/s wr, 135 op/s 2024-05-08T07:53:44.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:43 smithi194 ceph-mon[33679]: pgmap v2137: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 48 KiB/s wr, 135 op/s 2024-05-08T07:53:44.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:43 smithi070 ceph-mon[29591]: pgmap v2137: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 48 KiB/s wr, 135 op/s 2024-05-08T07:53:46.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:45 smithi194 ceph-mon[33679]: pgmap v2138: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 64 KiB/s wr, 126 op/s 2024-05-08T07:53:46.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:45 smithi070 ceph-mon[29591]: pgmap v2138: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 64 KiB/s wr, 126 op/s 2024-05-08T07:53:46.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:45 smithi172 ceph-mon[33377]: pgmap v2138: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 64 KiB/s wr, 126 op/s 2024-05-08T07:53:48.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:47 smithi194 ceph-mon[33679]: pgmap v2139: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2024-05-08T07:53:48.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:47 smithi070 ceph-mon[29591]: pgmap v2139: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2024-05-08T07:53:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:47 smithi172 ceph-mon[33377]: pgmap v2139: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2024-05-08T07:53:50.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:49 smithi194 ceph-mon[33679]: pgmap v2140: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2024-05-08T07:53:50.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:49 smithi070 ceph-mon[29591]: pgmap v2140: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2024-05-08T07:53:50.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:49 smithi172 ceph-mon[33377]: pgmap v2140: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 5 op/s 2024-05-08T07:53:50.424 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:53:51.020 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:53:51.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:51 smithi070 ceph-mon[29591]: pgmap v2141: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T07:53:52.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:51 smithi194 ceph-mon[33679]: pgmap v2141: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T07:53:52.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:51 smithi172 ceph-mon[33377]: pgmap v2141: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T07:53:53.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:53 smithi070 ceph-mon[29591]: pgmap v2142: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 5 op/s 2024-05-08T07:53:54.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:53 smithi194 ceph-mon[33679]: pgmap v2142: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 5 op/s 2024-05-08T07:53:54.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.076+0000 7fb935000700 1 -- 172.21.15.70:0/804072381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102f30 msgr2=0x7fb930106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:54.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.076+0000 7fb935000700 1 --2- 172.21.15.70:0/804072381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102f30 0x7fb930106f80 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0099c0 tx=0x7fb91c009cd0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.076+0000 7fb935000700 1 -- 172.21.15.70:0/804072381 shutdown_connections 2024-05-08T07:53:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.076+0000 7fb935000700 1 --2- 172.21.15.70:0/804072381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930107660 0x7fb93010f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.076+0000 7fb935000700 1 --2- 172.21.15.70:0/804072381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb930102580 0x7fb930102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.076+0000 7fb935000700 1 --2- 172.21.15.70:0/804072381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102f30 0x7fb930106f80 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.076+0000 7fb935000700 1 -- 172.21.15.70:0/804072381 >> 172.21.15.70:0/804072381 conn(0x7fb9300fde30 msgr2=0x7fb930100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:53:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.076+0000 7fb935000700 1 -- 172.21.15.70:0/804072381 shutdown_connections 2024-05-08T07:53:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.076+0000 7fb935000700 1 -- 172.21.15.70:0/804072381 wait complete. 2024-05-08T07:53:54.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.078+0000 7fb935000700 1 Processor -- start 2024-05-08T07:53:54.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.078+0000 7fb935000700 1 -- start start 2024-05-08T07:53:54.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.079+0000 7fb935000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102580 0x7fb9301a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:54.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.079+0000 7fb935000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb930102f30 0x7fb9301a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:54.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.079+0000 7fb935000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930107660 0x7fb93019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:54.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.079+0000 7fb935000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9301123d0 con 0x7fb930102580 2024-05-08T07:53:54.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.079+0000 7fb935000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb930112250 con 0x7fb930102f30 2024-05-08T07:53:54.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.079+0000 7fb935000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb930112550 con 0x7fb930107660 2024-05-08T07:53:54.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.079+0000 7fb92f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102580 0x7fb9301a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:54.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.079+0000 7fb92f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102580 0x7fb9301a1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42366/0 (socket says 172.21.15.70:42366) 2024-05-08T07:53:54.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.079+0000 7fb92f400700 1 -- 172.21.15.70:0/2008236521 learned_addr learned my addr 172.21.15.70:0/2008236521 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:53:54.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.080+0000 7fb92ea00700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb930102f30 0x7fb9301a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.080+0000 7fb92fe00700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930107660 0x7fb93019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.080+0000 7fb92f400700 1 -- 172.21.15.70:0/2008236521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930107660 msgr2=0x7fb93019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.080+0000 7fb92f400700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930107660 0x7fb93019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.080+0000 7fb92f400700 1 -- 172.21.15.70:0/2008236521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb930102f30 msgr2=0x7fb9301a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.080+0000 7fb92f400700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb930102f30 0x7fb9301a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.080+0000 7fb92f400700 1 -- 172.21.15.70:0/2008236521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93019c410 con 0x7fb930102580 2024-05-08T07:53:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.080+0000 7fb92ea00700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb930102f30 0x7fb9301a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:53:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.080+0000 7fb92f400700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102580 0x7fb9301a1870 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb92000d950 tx=0x7fb92000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:53:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.081+0000 7fb927e00700 1 -- 172.21.15.70:0/2008236521 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb920016070 con 0x7fb930102580 2024-05-08T07:53:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.081+0000 7fb927e00700 1 -- 172.21.15.70:0/2008236521 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb920010460 con 0x7fb930102580 2024-05-08T07:53:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.081+0000 7fb927e00700 1 -- 172.21.15.70:0/2008236521 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92000f620 con 0x7fb930102580 2024-05-08T07:53:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.081+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93019c700 con 0x7fb930102580 2024-05-08T07:53:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.081+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9301a8740 con 0x7fb930102580 2024-05-08T07:53:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.083+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb93006a190 con 0x7fb930102580 2024-05-08T07:53:54.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.086+0000 7fb927e00700 1 -- 172.21.15.70:0/2008236521 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb920019070 con 0x7fb930102580 2024-05-08T07:53:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.089+0000 7fb927e00700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9140b29f0 0x7fb9140b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.089+0000 7fb927e00700 1 -- 172.21.15.70:0/2008236521 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 9583+0+0 (secure 0 0 0) 0x7fb9200e2680 con 0x7fb930102580 2024-05-08T07:53:54.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.089+0000 7fb92ea00700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9140b29f0 0x7fb9140b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:54.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.091+0000 7fb92ea00700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9140b29f0 0x7fb9140b4eb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009990 tx=0x7fb91c01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:53:54.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.095+0000 7fb927e00700 1 -- 172.21.15.70:0/2008236521 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb9200a9c40 con 0x7fb930102580 2024-05-08T07:53:54.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:53 smithi172 ceph-mon[33377]: pgmap v2142: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 5 op/s 2024-05-08T07:53:54.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.382+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9301a8910 con 0x7fb930102580 2024-05-08T07:53:54.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.383+0000 7fb927e00700 1 -- 172.21.15.70:0/2008236521 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fb9200a9540 con 0x7fb930102580 2024-05-08T07:53:54.379 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:53:54.379 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.386+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9140b29f0 msgr2=0x7fb9140b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.386+0000 7fb935000700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9140b29f0 0x7fb9140b4eb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb91c009990 tx=0x7fb91c01a040 comp rx=0 tx=0).stop 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.386+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102580 msgr2=0x7fb9301a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.386+0000 7fb935000700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102580 0x7fb9301a1870 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb92000d950 tx=0x7fb92000dd10 comp rx=0 tx=0).stop 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.386+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 shutdown_connections 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.386+0000 7fb935000700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb9140b29f0 0x7fb9140b4eb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.386+0000 7fb935000700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb930107660 0x7fb93019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.386+0000 7fb935000700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb930102580 0x7fb9301a1870 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.386+0000 7fb935000700 1 --2- 172.21.15.70:0/2008236521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb930102f30 0x7fb9301a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:54.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.387+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 >> 172.21.15.70:0/2008236521 conn(0x7fb9300fde30 msgr2=0x7fb9300ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:53:54.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.387+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 shutdown_connections 2024-05-08T07:53:54.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:54.387+0000 7fb935000700 1 -- 172.21.15.70:0/2008236521 wait complete. 2024-05-08T07:53:54.383 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:53:54.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:54 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2008236521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:53:55.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:54 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2008236521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:53:55.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:54 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2008236521' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:53:55.729 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 4bf4017b --release --await' 2024-05-08T07:53:55.730 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 4bf4017b --release --await 2024-05-08T07:53:56.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:55 smithi194 ceph-mon[33679]: pgmap v2143: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:53:56.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:55 smithi070 ceph-mon[29591]: pgmap v2143: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:53:56.158 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:53:56.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:55 smithi172 ceph-mon[33377]: pgmap v2143: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T07:53:57.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:57 smithi070 ceph-mon[29591]: pgmap v2144: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:53:57.977 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:57 smithi172 ceph-mon[33377]: pgmap v2144: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:53:58.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:57 smithi194 ceph-mon[33679]: pgmap v2144: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:53:58.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.508+0000 7f1a49c00700 1 -- 172.21.15.70:0/4192790708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 msgr2=0x7f1a44113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:58.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.508+0000 7f1a49c00700 1 --2- 172.21.15.70:0/4192790708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 0x7f1a44113ea0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009990 tx=0x7f1a30009ca0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.509+0000 7f1a49c00700 1 -- 172.21.15.70:0/4192790708 shutdown_connections 2024-05-08T07:53:58.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.509+0000 7f1a49c00700 1 --2- 172.21.15.70:0/4192790708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a441143e0 0x7f1a441167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.509+0000 7f1a49c00700 1 --2- 172.21.15.70:0/4192790708 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a44075840 0x7f1a44075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.509+0000 7f1a49c00700 1 --2- 172.21.15.70:0/4192790708 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 0x7f1a44113ea0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.509+0000 7f1a49c00700 1 -- 172.21.15.70:0/4192790708 >> 172.21.15.70:0/4192790708 conn(0x7f1a440fef20 msgr2=0x7f1a44101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:53:58.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.509+0000 7f1a49c00700 1 -- 172.21.15.70:0/4192790708 shutdown_connections 2024-05-08T07:53:58.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.509+0000 7f1a49c00700 1 -- 172.21.15.70:0/4192790708 wait complete. 2024-05-08T07:53:58.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.510+0000 7f1a49c00700 1 Processor -- start 2024-05-08T07:53:58.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.510+0000 7f1a49c00700 1 -- start start 2024-05-08T07:53:58.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.511+0000 7f1a49c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44075840 0x7f1a441a0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.511+0000 7f1a49c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 0x7f1a441a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.511+0000 7f1a49c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a441143e0 0x7f1a441a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.511+0000 7f1a49c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44119ad0 con 0x7f1a44076160 2024-05-08T07:53:58.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.511+0000 7f1a49c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44119950 con 0x7f1a441143e0 2024-05-08T07:53:58.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.511+0000 7f1a49c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44119c50 con 0x7f1a44075840 2024-05-08T07:53:58.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a43400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 0x7f1a441a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a43400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 0x7f1a441a05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58304/0 (socket says 172.21.15.70:58304) 2024-05-08T07:53:58.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a43400700 1 -- 172.21.15.70:0/1556917755 learned_addr learned my addr 172.21.15.70:0/1556917755 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:53:58.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a43e00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44075840 0x7f1a441a0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a49200700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a441143e0 0x7f1a441a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a43400700 1 -- 172.21.15.70:0/1556917755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44075840 msgr2=0x7f1a441a0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:58.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a43400700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44075840 0x7f1a441a0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a43400700 1 -- 172.21.15.70:0/1556917755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a441143e0 msgr2=0x7f1a441a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:58.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a43400700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a441143e0 0x7f1a441a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.512+0000 7f1a43400700 1 -- 172.21.15.70:0/1556917755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a441a5090 con 0x7f1a44076160 2024-05-08T07:53:58.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.513+0000 7f1a43400700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 0x7f1a441a05c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1a300047b0 tx=0x7f1a30009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:53:58.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.513+0000 7f1a40c00700 1 -- 172.21.15.70:0/1556917755 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30027070 con 0x7f1a44076160 2024-05-08T07:53:58.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.513+0000 7f1a40c00700 1 -- 172.21.15.70:0/1556917755 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a30022470 con 0x7f1a44076160 2024-05-08T07:53:58.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.513+0000 7f1a40c00700 1 -- 172.21.15.70:0/1556917755 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30017650 con 0x7f1a44076160 2024-05-08T07:53:58.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.513+0000 7f1a49c00700 1 -- 172.21.15.70:0/1556917755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a441a5320 con 0x7f1a44076160 2024-05-08T07:53:58.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.514+0000 7f1a49c00700 1 -- 172.21.15.70:0/1556917755 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a441acc00 con 0x7f1a44076160 2024-05-08T07:53:58.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.518+0000 7f1a40c00700 1 -- 172.21.15.70:0/1556917755 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1a3002a070 con 0x7f1a44076160 2024-05-08T07:53:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.520+0000 7f1a40c00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a280b2a70 0x7f1a280b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.520+0000 7f1a40c00700 1 -- 172.21.15.70:0/1556917755 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 9583+0+0 (secure 0 0 0) 0x7f1a300e3900 con 0x7f1a44076160 2024-05-08T07:53:58.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.520+0000 7f1a43e00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a280b2a70 0x7f1a280b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.521+0000 7f1a43e00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a280b2a70 0x7f1a280b4f30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a34007be0 tx=0x7f1a340073d0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:53:58.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.543+0000 7f1a55b60b80 1 Processor -- start 2024-05-08T07:53:58.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.543+0000 7f1a55b60b80 1 -- start start 2024-05-08T07:53:58.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.543+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.543+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a2c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.544+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2c4da0 0x562b4a2c5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.544+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562b4a216b20 con 0x562b4a2c4da0 2024-05-08T07:53:58.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.544+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562b4a1b4860 con 0x562b4a2cab70 2024-05-08T07:53:58.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.544+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562b4a212ae0 con 0x562b4a2ca250 2024-05-08T07:53:58.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.544+0000 7f1a49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2c4da0 0x562b4a2c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.544+0000 7f1a49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2c4da0 0x562b4a2c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58312/0 (socket says 172.21.15.70:58312) 2024-05-08T07:53:58.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.544+0000 7f1a49200700 1 -- 172.21.15.70:0/2055485180 learned_addr learned my addr 172.21.15.70:0/2055485180 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:53:58.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.544+0000 7f1a43400700 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a2c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.544+0000 7f1a43e00700 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.545+0000 7f1a49200700 1 -- 172.21.15.70:0/2055485180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 msgr2=0x562b4a2ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:53:58.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.545+0000 7f1a49200700 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.545+0000 7f1a49200700 1 -- 172.21.15.70:0/2055485180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 msgr2=0x562b4a2c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:53:58.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.545+0000 7f1a49200700 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a2c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.545+0000 7f1a49200700 1 -- 172.21.15.70:0/2055485180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b4a1639d0 con 0x562b4a2c4da0 2024-05-08T07:53:58.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.545+0000 7f1a43400700 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a2c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:53:58.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.545+0000 7f1a49200700 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2c4da0 0x562b4a2c5200 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0093e0 tx=0x7f1a3c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5090990f48208638 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:53:58.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.546+0000 7f1a39600700 1 -- 172.21.15.70:0/2055485180 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c019030 con 0x562b4a2c4da0 2024-05-08T07:53:58.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.546+0000 7f1a39600700 1 -- 172.21.15.70:0/2055485180 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a3c0158d0 con 0x562b4a2c4da0 2024-05-08T07:53:58.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.546+0000 7f1a39600700 1 -- 172.21.15.70:0/2055485180 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c014600 con 0x562b4a2c4da0 2024-05-08T07:53:58.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.547+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2055485180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2c4da0 msgr2=0x562b4a2c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:58.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.547+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2c4da0 0x562b4a2c5200 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0093e0 tx=0x7f1a3c009920 comp rx=0 tx=0).stop 2024-05-08T07:53:58.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.547+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2055485180 shutdown_connections 2024-05-08T07:53:58.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.547+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2c4da0 0x562b4a2c5200 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.547+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.547+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2055485180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a2c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.547+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2055485180 >> 172.21.15.70:0/2055485180 conn(0x562b4a23c7d0 msgr2=0x562b4a2bf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:53:58.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.547+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2055485180 shutdown_connections 2024-05-08T07:53:58.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.547+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2055485180 wait complete. 2024-05-08T07:53:58.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.548+0000 7f1a55b60b80 1 -- start start 2024-05-08T07:53:58.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.548+0000 7f1a55b60b80 1 Processor -- start 2024-05-08T07:53:58.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.548+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.548+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.548+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562b4a2d1690 con 0x562b4a2cab70 2024-05-08T07:53:58.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562b4a17cc20 con 0x562b4a2c4da0 2024-05-08T07:53:58.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562b4a2d1810 con 0x562b4a2ca250 2024-05-08T07:53:58.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a55b60b80 10 client.0 _ll_register_callbacks cb 0x562b4a1bdd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58324/0 (socket says 172.21.15.70:58324) 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a49200700 1 -- 172.21.15.70:0/2935472792 learned_addr learned my addr 172.21.15.70:0/2935472792 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a43e00700 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a43400700 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a49200700 1 -- 172.21.15.70:0/2935472792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 msgr2=0x562b4a2cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a49200700 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.549+0000 7f1a49200700 1 -- 172.21.15.70:0/2935472792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 msgr2=0x562b4a2d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.550+0000 7f1a49200700 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.550+0000 7f1a49200700 1 -- 172.21.15.70:0/2935472792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b4a1dc520 con 0x562b4a2cab70 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.550+0000 7f1a43e00700 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:53:58.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.550+0000 7f1a49200700 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2ce1f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c004b50 tx=0x7f1a3c004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55d6e9e1c9f8a7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:53:58.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.550+0000 7f1a2e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.550+0000 7f1a2e000700 1 -- 172.21.15.70:0/2935472792 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c004e50 con 0x562b4a2cab70 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.550+0000 7f1a2e000700 1 -- 172.21.15.70:0/2935472792 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(213..213 src has 1..213) ==== 9583+0+0 (secure 0 0 0) 0x7f1a3c01f450 con 0x562b4a2cab70 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.550+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2935472792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a3c0158d0 con 0x562b4a2cab70 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a2e000700 1 -- 172.21.15.70:0/2935472792 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1a3c032050 con 0x562b4a2cab70 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a55b60b80 10 client.17334 fetch_fsmap learned FSMap version 42 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2935472792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562b4a2dbf40 con 0x562b4a2cab70 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a2e000700 1 -- 172.21.15.70:0/2935472792 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a3c0158d0 con 0x562b4a2cab70 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a2e000700 1 -- 172.21.15.70:0/2935472792 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f1a3c0052d0 con 0x562b4a2cab70 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a55b60b80 10 client.17334 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a55b60b80 10 client.17334 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:53:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a55b60b80 20 client.17334 populate_metadata read hostname 'smithi070' 2024-05-08T07:53:58.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562b4a2de4c0 0x562b4a2e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a55b60b80 4 client.17334 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:53:58.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.551+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2935472792 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b4a291240 con 0x562b4a2de4c0 2024-05-08T07:53:58.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.552+0000 7f1a43e00700 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562b4a2de4c0 0x562b4a2e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.553+0000 7f1a43e00700 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562b4a2de4c0 0x562b4a2e08b0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99c3ddbcad1838e7 server_cookie=4e7e54e055f4c182 in_seq=0 out_seq=0 2024-05-08T07:53:58.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.553+0000 7f1a2e000700 10 client.17334 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:53:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a2e000700 1 -- 172.21.15.70:0/2935472792 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562b4a291240 con 0x562b4a2de4c0 2024-05-08T07:53:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a2e000700 10 client.17334 handle_command_reply: tid=0 2024-05-08T07:53:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a55b60b80 1 client.17334 shutdown 2024-05-08T07:53:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2935472792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 msgr2=0x562b4a2ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2ce1f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c004b50 tx=0x7f1a3c004b80 comp rx=0 tx=0).stop 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2935472792 shutdown_connections 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562b4a2de4c0 0x562b4a2e08b0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2ce1f0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2935472792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a2e000700 0 client.17334 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.555+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2935472792 >> 172.21.15.70:0/2935472792 conn(0x562b4a23c7d0 msgr2=0x562b4a2bf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.556+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2935472792 shutdown_connections 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.556+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2935472792 wait complete. 2024-05-08T07:53:58.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.556+0000 7f1a55b60b80 20 client.17334 trim_cache size 0 max 16384 2024-05-08T07:53:58.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.577+0000 7f1a55b60b80 1 Processor -- start 2024-05-08T07:53:58.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.577+0000 7f1a55b60b80 1 -- start start 2024-05-08T07:53:58.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.578+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.578+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2e3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.578+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2e3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.578+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441b8360 con 0x562b4a2cab70 2024-05-08T07:53:58.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.578+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441b5bf0 con 0x562b4a2c4da0 2024-05-08T07:53:58.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.578+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441b3a60 con 0x562b4a2ca250 2024-05-08T07:53:58.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.578+0000 7f1a49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2e3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.578+0000 7f1a49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2e3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58334/0 (socket says 172.21.15.70:58334) 2024-05-08T07:53:58.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.578+0000 7f1a49200700 1 -- 172.21.15.70:0/2658285264 learned_addr learned my addr 172.21.15.70:0/2658285264 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:53:58.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a43e00700 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a43400700 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a49200700 1 -- 172.21.15.70:0/2658285264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 msgr2=0x562b4a2e3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:53:58.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a49200700 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2e3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a49200700 1 -- 172.21.15.70:0/2658285264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 msgr2=0x562b4a2c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:53:58.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a49200700 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a49200700 1 -- 172.21.15.70:0/2658285264 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b4a2e3f80 con 0x562b4a2cab70 2024-05-08T07:53:58.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a43e00700 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:53:58.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a49200700 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2e3a40 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0157d0 tx=0x7f1a3c009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7535adc6d972d0ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:53:58.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a38c00700 1 -- 172.21.15.70:0/2658285264 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c019070 con 0x562b4a2cab70 2024-05-08T07:53:58.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a38c00700 1 -- 172.21.15.70:0/2658285264 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a3c009a10 con 0x562b4a2cab70 2024-05-08T07:53:58.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.579+0000 7f1a38c00700 1 -- 172.21.15.70:0/2658285264 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c004ca0 con 0x562b4a2cab70 2024-05-08T07:53:58.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.580+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2658285264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 msgr2=0x562b4a2e3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:53:58.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.580+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2e3a40 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0157d0 tx=0x7f1a3c009e00 comp rx=0 tx=0).stop 2024-05-08T07:53:58.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.580+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2658285264 shutdown_connections 2024-05-08T07:53:58.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.580+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2cab70 0x562b4a2e3a40 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.580+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2c4da0 0x562b4a2c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.580+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/2658285264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2ca250 0x562b4a2e3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.580+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2658285264 >> 172.21.15.70:0/2658285264 conn(0x562b4a23c7d0 msgr2=0x562b4a2e6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.580+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2658285264 shutdown_connections 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.580+0000 7f1a55b60b80 1 -- 172.21.15.70:0/2658285264 wait complete. 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.581+0000 7f1a55b60b80 1 -- start start 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.581+0000 7f1a55b60b80 1 Processor -- start 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.581+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2c4da0 0x562b4a33cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.581+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2ca250 0x562b4a33d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.581+0000 7f1a55b60b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a3419c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.581+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441b40b0 con 0x562b4a2ca250 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.581+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441b5520 con 0x562b4a2cab70 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.581+0000 7f1a55b60b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441b4780 con 0x562b4a2c4da0 2024-05-08T07:53:58.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.582+0000 7f1a55b60b80 10 client.0 _ll_register_callbacks cb 0x562b4a1bdd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:53:58.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.582+0000 7f1a43400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2ca250 0x562b4a33d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.582+0000 7f1a43400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2ca250 0x562b4a33d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58336/0 (socket says 172.21.15.70:58336) 2024-05-08T07:53:58.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.582+0000 7f1a43400700 1 -- 172.21.15.70:0/3940580405 learned_addr learned my addr 172.21.15.70:0/3940580405 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:53:58.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.582+0000 7f1a43e00700 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2c4da0 0x562b4a33cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.582+0000 7f1a49200700 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a3419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.583+0000 7f1a43e00700 1 -- 172.21.15.70:0/3940580405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 msgr2=0x562b4a3419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:53:58.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.583+0000 7f1a43e00700 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a3419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.583+0000 7f1a43e00700 1 -- 172.21.15.70:0/3940580405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2ca250 msgr2=0x562b4a33d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:53:58.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.583+0000 7f1a43e00700 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2ca250 0x562b4a33d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.583+0000 7f1a43e00700 1 -- 172.21.15.70:0/3940580405 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b4a341fb0 con 0x562b4a2c4da0 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.583+0000 7f1a49200700 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a3419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.583+0000 7f1a43e00700 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2c4da0 0x562b4a33cb50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a34011010 tx=0x7f1a340047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23b706e77b711d5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.583+0000 7f1a2e000700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.584+0000 7f1a2e000700 1 -- 172.21.15.70:0/3940580405 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34003a90 con 0x562b4a2c4da0 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.584+0000 7f1a55b60b80 1 -- 172.21.15.70:0/3940580405 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a3c009a10 con 0x562b4a2c4da0 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.584+0000 7f1a2e000700 1 -- 172.21.15.70:0/3940580405 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(213..213 src has 1..213) ==== 9583+0+0 (secure 0 0 0) 0x7f1a34003c30 con 0x562b4a2c4da0 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.584+0000 7f1a2e000700 1 -- 172.21.15.70:0/3940580405 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1a34037050 con 0x562b4a2c4da0 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.584+0000 7f1a55b60b80 10 client.26446 fetch_fsmap learned FSMap version 42 2024-05-08T07:53:58.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.584+0000 7f1a55b60b80 1 -- 172.21.15.70:0/3940580405 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562b4a349320 con 0x562b4a2c4da0 2024-05-08T07:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.585+0000 7f1a2e000700 1 -- 172.21.15.70:0/3940580405 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a3c009a10 con 0x562b4a2c4da0 2024-05-08T07:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.585+0000 7f1a2e000700 1 -- 172.21.15.70:0/3940580405 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f1a34028ce0 con 0x562b4a2c4da0 2024-05-08T07:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.585+0000 7f1a55b60b80 10 client.26446 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.585+0000 7f1a55b60b80 10 client.26446 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.585+0000 7f1a55b60b80 20 client.26446 populate_metadata read hostname 'smithi070' 2024-05-08T07:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.585+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562b4a349a60 0x562b4a34be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.585+0000 7f1a55b60b80 4 client.26446 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4bf4017b", "release": true, "await": true}] 2024-05-08T07:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.585+0000 7f1a55b60b80 1 -- 172.21.15.70:0/3940580405 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4bf4017b", "release": true, "await": true}) -- 0x562b4a224500 con 0x562b4a349a60 2024-05-08T07:53:58.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.586+0000 7f1a43400700 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562b4a349a60 0x562b4a34be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:53:58.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.587+0000 7f1a43400700 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562b4a349a60 0x562b4a34be80 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b685496df71d4c35 server_cookie=c357043e7e568e6d in_seq=0 out_seq=0 2024-05-08T07:53:58.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:53:58.587+0000 7f1a2e000700 10 client.26446 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:54:00.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:53:59 smithi194 ceph-mon[33679]: pgmap v2145: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:54:00.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:53:59 smithi070 ceph-mon[29591]: pgmap v2145: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:54:00.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:53:59 smithi172 ceph-mon[33377]: pgmap v2145: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:54:02.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:01 smithi194 ceph-mon[33679]: pgmap v2146: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T07:54:02.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:01 smithi070 ceph-mon[29591]: pgmap v2146: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T07:54:02.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:01 smithi172 ceph-mon[33377]: pgmap v2146: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T07:54:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.143+0000 7f1a2e000700 1 -- 172.21.15.70:0/3940580405 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562b4a224500 con 0x562b4a349a60 2024-05-08T07:54:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.143+0000 7f1a2e000700 10 client.26446 handle_command_reply: tid=0 2024-05-08T07:54:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.143+0000 7f1a55b60b80 1 client.26446 shutdown 2024-05-08T07:54:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a55b60b80 1 -- 172.21.15.70:0/3940580405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2c4da0 msgr2=0x562b4a33cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2c4da0 0x562b4a33cb50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1a34011010 tx=0x7f1a340047c0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a55b60b80 1 -- 172.21.15.70:0/3940580405 shutdown_connections 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562b4a349a60 0x562b4a34be80 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562b4a2cab70 0x562b4a3419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562b4a2c4da0 0x562b4a33cb50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a55b60b80 1 --2- 172.21.15.70:0/3940580405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b4a2ca250 0x562b4a33d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a2e000700 0 client.26446 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a55b60b80 1 -- 172.21.15.70:0/3940580405 >> 172.21.15.70:0/3940580405 conn(0x562b4a23c7d0 msgr2=0x562b4a2caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.144+0000 7f1a55b60b80 1 -- 172.21.15.70:0/3940580405 shutdown_connections 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.145+0000 7f1a55b60b80 1 -- 172.21.15.70:0/3940580405 wait complete. 2024-05-08T07:54:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.145+0000 7f1a55b60b80 20 client.26446 trim_cache size 0 max 16384 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 164, 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "4bf4017b": { 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 164, 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:54:03.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.5, 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:03.142 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:54:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.147+0000 7f1a49c00700 1 -- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a280b2a70 msgr2=0x7f1a280b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.147+0000 7f1a49c00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a280b2a70 0x7f1a280b4f30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1a34007be0 tx=0x7f1a340073d0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.147+0000 7f1a49c00700 1 -- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 msgr2=0x7f1a441a05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.147+0000 7f1a49c00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 0x7f1a441a05c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f1a300047b0 tx=0x7f1a30009550 comp rx=0 tx=0).stop 2024-05-08T07:54:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.148+0000 7f1a49c00700 1 -- 172.21.15.70:0/1556917755 shutdown_connections 2024-05-08T07:54:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.148+0000 7f1a49c00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a280b2a70 0x7f1a280b4f30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.148+0000 7f1a49c00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1a441143e0 0x7f1a441a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.148+0000 7f1a49c00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44075840 0x7f1a441a0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.148+0000 7f1a49c00700 1 --2- 172.21.15.70:0/1556917755 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1a44076160 0x7f1a441a05c0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.148+0000 7f1a49c00700 1 -- 172.21.15.70:0/1556917755 >> 172.21.15.70:0/1556917755 conn(0x7f1a440fef20 msgr2=0x7f1a441008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.148+0000 7f1a49c00700 1 -- 172.21.15.70:0/1556917755 shutdown_connections 2024-05-08T07:54:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:03.148+0000 7f1a49c00700 1 -- 172.21.15.70:0/1556917755 wait complete. 2024-05-08T07:54:03.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:03 smithi070 ceph-mon[29591]: pgmap v2147: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:54:03.964 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4bf4017b', seconds elapsed: 75.0 2024-05-08T07:54:03.964 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.5 2024-05-08T07:54:03.964 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:54:04.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:03 smithi194 ceph-mon[33679]: pgmap v2147: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:54:04.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:03 smithi172 ceph-mon[33377]: pgmap v2147: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:54:04.411 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:54:06.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:05 smithi194 ceph-mon[33679]: pgmap v2148: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 53 KiB/s wr, 10 op/s 2024-05-08T07:54:06.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:05 smithi070 ceph-mon[29591]: pgmap v2148: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 53 KiB/s wr, 10 op/s 2024-05-08T07:54:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:05 smithi172 ceph-mon[33377]: pgmap v2148: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 53 KiB/s wr, 10 op/s 2024-05-08T07:54:06.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.686+0000 7f4c21400700 1 -- 172.21.15.70:0/3716195257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 msgr2=0x7f4c1c108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:06.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.686+0000 7f4c21400700 1 --2- 172.21.15.70:0/3716195257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 0x7f4c1c108020 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f4c080099c0 tx=0x7f4c08009cd0 comp rx=0 tx=0).stop 2024-05-08T07:54:06.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.686+0000 7f4c21400700 1 -- 172.21.15.70:0/3716195257 shutdown_connections 2024-05-08T07:54:06.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.686+0000 7f4c21400700 1 --2- 172.21.15.70:0/3716195257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c1c108700 0x7f4c1c1102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:06.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.686+0000 7f4c21400700 1 --2- 172.21.15.70:0/3716195257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c1c103620 0x7f4c1c103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:06.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.686+0000 7f4c21400700 1 --2- 172.21.15.70:0/3716195257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 0x7f4c1c108020 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:06.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.686+0000 7f4c21400700 1 -- 172.21.15.70:0/3716195257 >> 172.21.15.70:0/3716195257 conn(0x7f4c1c0feeb0 msgr2=0x7f4c1c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:06.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.686+0000 7f4c21400700 1 -- 172.21.15.70:0/3716195257 shutdown_connections 2024-05-08T07:54:06.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.686+0000 7f4c21400700 1 -- 172.21.15.70:0/3716195257 wait complete. 2024-05-08T07:54:06.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.687+0000 7f4c21400700 1 Processor -- start 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.688+0000 7f4c21400700 1 -- start start 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.688+0000 7f4c21400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c1c103620 0x7f4c1c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.688+0000 7f4c21400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 0x7f4c1c075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.688+0000 7f4c21400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c1c108700 0x7f4c1c076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.688+0000 7f4c21400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c113490 con 0x7f4c1c103fd0 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.688+0000 7f4c21400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c113310 con 0x7f4c1c108700 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.688+0000 7f4c21400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1c113610 con 0x7f4c1c103620 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.688+0000 7f4c1b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 0x7f4c1c075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c1b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 0x7f4c1c075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58352/0 (socket says 172.21.15.70:58352) 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c1b400700 1 -- 172.21.15.70:0/3039664662 learned_addr learned my addr 172.21.15.70:0/3039664662 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c1be00700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c1c103620 0x7f4c1c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:06.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c20a00700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c1c108700 0x7f4c1c076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:06.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c1b400700 1 -- 172.21.15.70:0/3039664662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c1c103620 msgr2=0x7f4c1c0757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:06.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c1b400700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c1c103620 0x7f4c1c0757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:06.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c1b400700 1 -- 172.21.15.70:0/3039664662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c1c108700 msgr2=0x7f4c1c076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:06.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c1b400700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c1c108700 0x7f4c1c076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c1b400700 1 -- 172.21.15.70:0/3039664662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1c1a7f90 con 0x7f4c1c103fd0 2024-05-08T07:54:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.689+0000 7f4c1b400700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 0x7f4c1c075ce0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4c080098e0 tx=0x7f4c080047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:54:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.690+0000 7f4c18c00700 1 -- 172.21.15.70:0/3039664662 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08027070 con 0x7f4c1c103fd0 2024-05-08T07:54:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.690+0000 7f4c18c00700 1 -- 172.21.15.70:0/3039664662 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c0800fd30 con 0x7f4c1c103fd0 2024-05-08T07:54:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.690+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1c1a8220 con 0x7f4c1c103fd0 2024-05-08T07:54:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.690+0000 7f4c18c00700 1 -- 172.21.15.70:0/3039664662 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c08022dc0 con 0x7f4c1c103fd0 2024-05-08T07:54:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.690+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1c1a8670 con 0x7f4c1c103fd0 2024-05-08T07:54:06.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.691+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1c06a190 con 0x7f4c1c103fd0 2024-05-08T07:54:06.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.693+0000 7f4c18c00700 1 -- 172.21.15.70:0/3039664662 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4c0802a070 con 0x7f4c1c103fd0 2024-05-08T07:54:06.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.695+0000 7f4c18c00700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c000b29f0 0x7f4c000b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:06.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.695+0000 7f4c18c00700 1 -- 172.21.15.70:0/3039664662 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(213..213 src has 1..213) ==== 9583+0+0 (secure 0 0 0) 0x7f4c080e3fe0 con 0x7f4c1c103fd0 2024-05-08T07:54:06.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.695+0000 7f4c1be00700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c000b29f0 0x7f4c000b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:06.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.696+0000 7f4c1be00700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c000b29f0 0x7f4c000b4eb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c005950 tx=0x7f4c0c0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:54:06.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:06.698+0000 7f4c18c00700 1 -- 172.21.15.70:0/3039664662 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4c08031070 con 0x7f4c1c103fd0 2024-05-08T07:54:07.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.025+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c1c02e510 con 0x7f4c1c103fd0 2024-05-08T07:54:07.022 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:54:07.022 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:54:07.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.027+0000 7f4c18c00700 1 -- 172.21.15.70:0/3039664662 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f4c08013070 con 0x7f4c1c103fd0 2024-05-08T07:54:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c000b29f0 msgr2=0x7f4c000b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c000b29f0 0x7f4c000b4eb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c005950 tx=0x7f4c0c0058e0 comp rx=0 tx=0).stop 2024-05-08T07:54:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 msgr2=0x7f4c1c075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:07.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 0x7f4c1c075ce0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f4c080098e0 tx=0x7f4c080047b0 comp rx=0 tx=0).stop 2024-05-08T07:54:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 shutdown_connections 2024-05-08T07:54:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c000b29f0 0x7f4c000b4eb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c1c108700 0x7f4c1c076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:07.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c1c103620 0x7f4c1c0757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 --2- 172.21.15.70:0/3039664662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c1c103fd0 0x7f4c1c075ce0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.030+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 >> 172.21.15.70:0/3039664662 conn(0x7f4c1c0feeb0 msgr2=0x7f4c1c1002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.031+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 shutdown_connections 2024-05-08T07:54:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:07.031+0000 7f4c21400700 1 -- 172.21.15.70:0/3039664662 wait complete. 2024-05-08T07:54:07.028 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:54:07.820 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 88.5 --await-for 42.0' 2024-05-08T07:54:07.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 88.5 --await-for 42.0 2024-05-08T07:54:08.123 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/mballoc.o 2024-05-08T07:54:08.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:07 smithi070 ceph-mon[29591]: pgmap v2149: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 53 KiB/s wr, 7 op/s 2024-05-08T07:54:08.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:07 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3039664662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:54:08.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:07 smithi172 ceph-mon[33377]: pgmap v2149: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 53 KiB/s wr, 7 op/s 2024-05-08T07:54:08.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:07 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3039664662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:54:08.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:07 smithi194 ceph-mon[33679]: pgmap v2149: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 53 KiB/s wr, 7 op/s 2024-05-08T07:54:08.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:07 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3039664662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:54:08.392 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:54:09.443 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/getuser.o 2024-05-08T07:54:09.644 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/blake2s-generic.o 2024-05-08T07:54:09.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:09 smithi070 ceph-mon[29591]: pgmap v2150: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 53 KiB/s wr, 7 op/s 2024-05-08T07:54:09.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:09 smithi070 ceph-mon[29591]: osdmap e214: 12 total, 12 up, 12 in 2024-05-08T07:54:10.164 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-stat.o 2024-05-08T07:54:10.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:09 smithi172 ceph-mon[33377]: pgmap v2150: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 53 KiB/s wr, 7 op/s 2024-05-08T07:54:10.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:09 smithi172 ceph-mon[33377]: osdmap e214: 12 total, 12 up, 12 in 2024-05-08T07:54:10.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:09 smithi194 ceph-mon[33679]: pgmap v2150: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 53 KiB/s wr, 7 op/s 2024-05-08T07:54:10.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:09 smithi194 ceph-mon[33679]: osdmap e214: 12 total, 12 up, 12 in 2024-05-08T07:54:10.372 INFO:tasks.workunit.client.0.smithi070.stdout: GEN arch/x86/lib/inat-tables.c 2024-05-08T07:54:10.381 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/misc.o 2024-05-08T07:54:10.431 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_printk.o 2024-05-08T07:54:10.481 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/traps.o 2024-05-08T07:54:10.508 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/insn-eval.o 2024-05-08T07:54:10.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.806+0000 7f098b000700 1 -- 172.21.15.70:0/1224236598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f098410a4b0 msgr2=0x7f09841169c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:10.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.806+0000 7f098b000700 1 --2- 172.21.15.70:0/1224236598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f098410a4b0 0x7f09841169c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f097c00b0a0 tx=0x7f097c00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.807+0000 7f098b000700 1 -- 172.21.15.70:0/1224236598 shutdown_connections 2024-05-08T07:54:10.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.807+0000 7f098b000700 1 --2- 172.21.15.70:0/1224236598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f098410a4b0 0x7f09841169c0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.807+0000 7f098b000700 1 --2- 172.21.15.70:0/1224236598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098410fb80 0x7f098410ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.807+0000 7f098b000700 1 --2- 172.21.15.70:0/1224236598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0984109af0 0x7f0984109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.807+0000 7f098b000700 1 -- 172.21.15.70:0/1224236598 >> 172.21.15.70:0/1224236598 conn(0x7f0984076cb0 msgr2=0x7f09841082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:10.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.808+0000 7f098b000700 1 -- 172.21.15.70:0/1224236598 shutdown_connections 2024-05-08T07:54:10.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.808+0000 7f098b000700 1 -- 172.21.15.70:0/1224236598 wait complete. 2024-05-08T07:54:10.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.809+0000 7f098b000700 1 Processor -- start 2024-05-08T07:54:10.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.810+0000 7f098b000700 1 -- start start 2024-05-08T07:54:10.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.810+0000 7f098b000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0984109af0 0x7f098419ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.810+0000 7f098b000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098410a4b0 0x7f09841a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.810+0000 7f098b000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f098410fb80 0x7f09841a4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.811+0000 7f0983e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0984109af0 0x7f098419ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.811+0000 7f0983e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0984109af0 0x7f098419ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:33726/0 (socket says 172.21.15.70:33726) 2024-05-08T07:54:10.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.811+0000 7f0983400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098410a4b0 0x7f09841a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.811+0000 7f0983e00700 1 -- 172.21.15.70:0/1735006607 learned_addr learned my addr 172.21.15.70:0/1735006607 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:54:10.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.811+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0984119bf0 con 0x7f098410fb80 2024-05-08T07:54:10.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.811+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0984119a70 con 0x7f098410a4b0 2024-05-08T07:54:10.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.811+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0984119d70 con 0x7f0984109af0 2024-05-08T07:54:10.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.812+0000 7f0983400700 1 -- 172.21.15.70:0/1735006607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0984109af0 msgr2=0x7f098419ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:10.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.812+0000 7f0983400700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0984109af0 0x7f098419ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.812+0000 7f0983400700 1 -- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f098410fb80 msgr2=0x7f09841a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:10.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.812+0000 7f0989000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f098410fb80 0x7f09841a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.812+0000 7f0983400700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f098410fb80 0x7f09841a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.812+0000 7f0983400700 1 -- 172.21.15.70:0/1735006607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09841a4fb0 con 0x7f098410a4b0 2024-05-08T07:54:10.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.812+0000 7f0989000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f098410fb80 0x7f09841a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:54:10.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.813+0000 7f0983400700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098410a4b0 0x7f09841a04e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f097400e9f0 tx=0x7f097400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:54:10.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.814+0000 7f0980c00700 1 -- 172.21.15.70:0/1735006607 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097400cbd0 con 0x7f098410a4b0 2024-05-08T07:54:10.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.814+0000 7f0980c00700 1 -- 172.21.15.70:0/1735006607 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f097400cd70 con 0x7f098410a4b0 2024-05-08T07:54:10.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.814+0000 7f0980c00700 1 -- 172.21.15.70:0/1735006607 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0974018680 con 0x7f098410a4b0 2024-05-08T07:54:10.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.814+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09841a5240 con 0x7f098410a4b0 2024-05-08T07:54:10.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.814+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09841acb20 con 0x7f098410a4b0 2024-05-08T07:54:10.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.821+0000 7f0980c00700 1 -- 172.21.15.70:0/1735006607 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f0974010430 con 0x7f098410a4b0 2024-05-08T07:54:10.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.821+0000 7f09959adb80 1 Processor -- start 2024-05-08T07:54:10.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.821+0000 7f09959adb80 1 -- start start 2024-05-08T07:54:10.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.821+0000 7f09959adb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86e02240 0x562a86e02620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.822+0000 7f09959adb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86dfcc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.822+0000 7f09959adb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e09000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.822+0000 7f09959adb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562a86d4ebb0 con 0x562a86dfc810 2024-05-08T07:54:10.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.822+0000 7f09959adb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562a86cec8f0 con 0x562a86e02240 2024-05-08T07:54:10.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.822+0000 7f09959adb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562a86d4ab70 con 0x562a86dfd1d0 2024-05-08T07:54:10.817 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:54:10.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.822+0000 7f0983e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86dfcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.822+0000 7f0983e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86dfcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44298/0 (socket says 172.21.15.70:44298) 2024-05-08T07:54:10.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.822+0000 7f0983e00700 1 -- 172.21.15.70:0/226930421 learned_addr learned my addr 172.21.15.70:0/226930421 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:54:10.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.822+0000 7f0989000700 1 --2- 172.21.15.70:0/226930421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86e02240 0x562a86e02620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.823+0000 7f0983400700 1 --2- 172.21.15.70:0/226930421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e09000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.823+0000 7f0983400700 1 -- 172.21.15.70:0/226930421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86e02240 msgr2=0x562a86e02620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:54:10.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.823+0000 7f0983400700 1 --2- 172.21.15.70:0/226930421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86e02240 0x562a86e02620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.823+0000 7f0983400700 1 -- 172.21.15.70:0/226930421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 msgr2=0x562a86dfcc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:54:10.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.823+0000 7f0983400700 1 --2- 172.21.15.70:0/226930421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86dfcc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.823+0000 7f0983400700 1 -- 172.21.15.70:0/226930421 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a86c9ba60 con 0x562a86dfd1d0 2024-05-08T07:54:10.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.824+0000 7f0983400700 1 --2- 172.21.15.70:0/226930421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e09000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f09740dfe60 tx=0x7f09740eb260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cf90e7f926e4ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:54:10.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.824+0000 7f0980c00700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09680b2bf0 0x7f09680b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.825+0000 7f0980c00700 1 -- 172.21.15.70:0/1735006607 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 9671+0+0 (secure 0 0 0) 0x7f09740e2bf0 con 0x7f098410a4b0 2024-05-08T07:54:10.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.825+0000 7f0989000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09680b2bf0 0x7f09680b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.825+0000 7f0979600700 1 -- 172.21.15.70:0/226930421 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09740a6040 con 0x562a86dfd1d0 2024-05-08T07:54:10.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.825+0000 7f0979600700 1 -- 172.21.15.70:0/226930421 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09740f4070 con 0x562a86dfd1d0 2024-05-08T07:54:10.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.825+0000 7f0979600700 1 -- 172.21.15.70:0/226930421 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09740a9160 con 0x562a86dfd1d0 2024-05-08T07:54:10.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.826+0000 7f09959adb80 1 -- 172.21.15.70:0/226930421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 msgr2=0x562a86e09000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:10.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.826+0000 7f09959adb80 1 --2- 172.21.15.70:0/226930421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e09000 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f09740dfe60 tx=0x7f09740eb260 comp rx=0 tx=0).stop 2024-05-08T07:54:10.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.827+0000 7f0989000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09680b2bf0 0x7f09680b50b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f097c00b780 tx=0x7f097c009b80 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:54:10.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.827+0000 7f09959adb80 1 -- 172.21.15.70:0/226930421 shutdown_connections 2024-05-08T07:54:10.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.827+0000 7f09959adb80 1 --2- 172.21.15.70:0/226930421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e09000 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.827+0000 7f09959adb80 1 --2- 172.21.15.70:0/226930421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86e02240 0x562a86e02620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.827+0000 7f09959adb80 1 --2- 172.21.15.70:0/226930421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86dfcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.827+0000 7f09959adb80 1 -- 172.21.15.70:0/226930421 >> 172.21.15.70:0/226930421 conn(0x562a86d74860 msgr2=0x562a86df7100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:10.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.827+0000 7f09959adb80 1 -- 172.21.15.70:0/226930421 shutdown_connections 2024-05-08T07:54:10.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.827+0000 7f09959adb80 1 -- 172.21.15.70:0/226930421 wait complete. 2024-05-08T07:54:10.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.828+0000 7f09959adb80 1 -- start start 2024-05-08T07:54:10.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.828+0000 7f09959adb80 1 Processor -- start 2024-05-08T07:54:10.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.829+0000 7f09959adb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86e08bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.829+0000 7f09959adb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 0x562a86e05f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.829+0000 7f09959adb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e06490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.829+0000 7f09959adb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562a86e095a0 con 0x562a86dfc810 2024-05-08T07:54:10.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.829+0000 7f09959adb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562a86cb4cb0 con 0x562a86dfd1d0 2024-05-08T07:54:10.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.829+0000 7f09959adb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562a86e09720 con 0x562a86e02240 2024-05-08T07:54:10.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.829+0000 7f09959adb80 10 client.0 _ll_register_callbacks cb 0x562a86cf5e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:54:10.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.829+0000 7f0983e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86e08bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.830+0000 7f0989000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e06490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.830+0000 7f0989000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e06490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:33738/0 (socket says 172.21.15.70:33738) 2024-05-08T07:54:10.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.830+0000 7f0989000700 1 -- 172.21.15.70:0/113151669 learned_addr learned my addr 172.21.15.70:0/113151669 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.830+0000 7f0983400700 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 0x562a86e05f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.831+0000 7f0989000700 1 -- 172.21.15.70:0/113151669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 msgr2=0x562a86e05f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.831+0000 7f0989000700 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 0x562a86e05f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.831+0000 7f0989000700 1 -- 172.21.15.70:0/113151669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 msgr2=0x562a86e08bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.831+0000 7f0989000700 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86e08bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.831+0000 7f0989000700 1 -- 172.21.15.70:0/113151669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a86d145b0 con 0x562a86e02240 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.831+0000 7f0989000700 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e06490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f097c004d00 tx=0x7f097c00b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fc0cf2077bb3bc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.831+0000 7f0972000700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.832+0000 7f0972000700 1 -- 172.21.15.70:0/113151669 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c02c030 con 0x562a86e02240 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.832+0000 7f0972000700 1 -- 172.21.15.70:0/113151669 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(214..214 src has 1..214) ==== 9671+0+0 (secure 0 0 0) 0x7f097c007970 con 0x562a86e02240 2024-05-08T07:54:10.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.832+0000 7f09959adb80 1 -- 172.21.15.70:0/113151669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09740f4070 con 0x562a86e02240 2024-05-08T07:54:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.833+0000 7f0972000700 1 -- 172.21.15.70:0/113151669 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f097c039050 con 0x562a86e02240 2024-05-08T07:54:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.833+0000 7f09959adb80 10 client.26464 fetch_fsmap learned FSMap version 42 2024-05-08T07:54:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.833+0000 7f09959adb80 1 -- 172.21.15.70:0/113151669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562a86e13d90 con 0x562a86e02240 2024-05-08T07:54:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.833+0000 7f0972000700 1 -- 172.21.15.70:0/113151669 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f09740f4070 con 0x562a86e02240 2024-05-08T07:54:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.833+0000 7f0972000700 1 -- 172.21.15.70:0/113151669 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f097c011070 con 0x562a86e02240 2024-05-08T07:54:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.834+0000 7f09959adb80 10 client.26464 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:54:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.834+0000 7f09959adb80 10 client.26464 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:54:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.834+0000 7f09959adb80 20 client.26464 populate_metadata read hostname 'smithi070' 2024-05-08T07:54:10.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.834+0000 7f09959adb80 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562a86e16320 0x562a86e18780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.834+0000 7f09959adb80 4 client.26464 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:54:10.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.834+0000 7f09959adb80 1 -- 172.21.15.70:0/113151669 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a86dc92d0 con 0x562a86e16320 2024-05-08T07:54:10.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.834+0000 7f0983e00700 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562a86e16320 0x562a86e18780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.835+0000 7f0983e00700 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562a86e16320 0x562a86e18780 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b566a673f6e2686 server_cookie=d3a046783068ba3 in_seq=0 out_seq=0 2024-05-08T07:54:10.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.835+0000 7f0972000700 10 client.26464 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:54:10.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.837+0000 7f0972000700 1 -- 172.21.15.70:0/113151669 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562a86dc92d0 con 0x562a86e16320 2024-05-08T07:54:10.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.837+0000 7f0972000700 10 client.26464 handle_command_reply: tid=0 2024-05-08T07:54:10.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.837+0000 7f09959adb80 1 client.26464 shutdown 2024-05-08T07:54:10.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.838+0000 7f09959adb80 1 -- 172.21.15.70:0/113151669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 msgr2=0x562a86e06490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:10.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.838+0000 7f09959adb80 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e06490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f097c004d00 tx=0x7f097c00b3b0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.838+0000 7f09959adb80 1 -- 172.21.15.70:0/113151669 shutdown_connections 2024-05-08T07:54:10.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.838+0000 7f09959adb80 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562a86e16320 0x562a86e18780 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.838+0000 7f09959adb80 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e06490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.838+0000 7f09959adb80 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86e08bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.838+0000 7f09959adb80 1 --2- 172.21.15.70:0/113151669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 0x562a86e05f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.838+0000 7f0972000700 0 client.26464 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:54:10.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.838+0000 7f09959adb80 1 -- 172.21.15.70:0/113151669 >> 172.21.15.70:0/113151669 conn(0x562a86d74860 msgr2=0x562a86df1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:10.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.839+0000 7f09959adb80 1 -- 172.21.15.70:0/113151669 shutdown_connections 2024-05-08T07:54:10.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.839+0000 7f09959adb80 1 -- 172.21.15.70:0/113151669 wait complete. 2024-05-08T07:54:10.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.841+0000 7f09959adb80 20 client.26464 trim_cache size 0 max 16384 2024-05-08T07:54:10.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.876+0000 7f09959adb80 1 Processor -- start 2024-05-08T07:54:10.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.876+0000 7f09959adb80 1 -- start start 2024-05-08T07:54:10.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f09959adb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86e12680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f09959adb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 0x562a86dfbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f09959adb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e1e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f09959adb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09841b8600 con 0x562a86dfc810 2024-05-08T07:54:10.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f09959adb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09841b5e90 con 0x562a86dfd1d0 2024-05-08T07:54:10.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f09959adb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f09841b3d00 con 0x562a86e02240 2024-05-08T07:54:10.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f0983e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86e12680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f0989000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e1e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f0989000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e1e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:33744/0 (socket says 172.21.15.70:33744) 2024-05-08T07:54:10.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.877+0000 7f0989000700 1 -- 172.21.15.70:0/3197134071 learned_addr learned my addr 172.21.15.70:0/3197134071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.878+0000 7f0983400700 1 --2- 172.21.15.70:0/3197134071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 0x562a86dfbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.878+0000 7f0983e00700 1 -- 172.21.15.70:0/3197134071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 msgr2=0x562a86e1e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.878+0000 7f0983e00700 1 --2- 172.21.15.70:0/3197134071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e1e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.878+0000 7f0983e00700 1 -- 172.21.15.70:0/3197134071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 msgr2=0x562a86dfbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.878+0000 7f0983e00700 1 --2- 172.21.15.70:0/3197134071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 0x562a86dfbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.878+0000 7f0983e00700 1 -- 172.21.15.70:0/3197134071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a86e093b0 con 0x562a86dfc810 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.878+0000 7f0983e00700 1 --2- 172.21.15.70:0/3197134071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86e12680 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x562a86e16700 tx=0x7f096c00b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0ceaa1a3cf2264 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.878+0000 7f0978c00700 1 -- 172.21.15.70:0/3197134071 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c005020 con 0x562a86dfc810 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.879+0000 7f0978c00700 1 -- 172.21.15.70:0/3197134071 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f096c005650 con 0x562a86dfc810 2024-05-08T07:54:10.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.879+0000 7f0978c00700 1 -- 172.21.15.70:0/3197134071 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f096c004af0 con 0x562a86dfc810 2024-05-08T07:54:10.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.880+0000 7f09959adb80 1 -- 172.21.15.70:0/3197134071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 msgr2=0x562a86e12680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:10.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.880+0000 7f09959adb80 1 --2- 172.21.15.70:0/3197134071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86e12680 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x562a86e16700 tx=0x7f096c00b500 comp rx=0 tx=0).stop 2024-05-08T07:54:10.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.880+0000 7f09959adb80 1 -- 172.21.15.70:0/3197134071 shutdown_connections 2024-05-08T07:54:10.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.880+0000 7f09959adb80 1 --2- 172.21.15.70:0/3197134071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86e02240 0x562a86e1e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.880+0000 7f09959adb80 1 --2- 172.21.15.70:0/3197134071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86dfc810 0x562a86e12680 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.880+0000 7f09959adb80 1 --2- 172.21.15.70:0/3197134071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfd1d0 0x562a86dfbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.880+0000 7f09959adb80 1 -- 172.21.15.70:0/3197134071 >> 172.21.15.70:0/3197134071 conn(0x562a86d74860 msgr2=0x562a86dfb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:10.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.880+0000 7f09959adb80 1 -- 172.21.15.70:0/3197134071 shutdown_connections 2024-05-08T07:54:10.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.881+0000 7f09959adb80 1 -- 172.21.15.70:0/3197134071 wait complete. 2024-05-08T07:54:10.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.881+0000 7f09959adb80 1 -- start start 2024-05-08T07:54:10.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.881+0000 7f09959adb80 1 Processor -- start 2024-05-08T07:54:10.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.882+0000 7f09959adb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfc810 0x562a86e7c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.882+0000 7f09959adb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e7abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.882+0000 7f09959adb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86e02240 0x562a86e7b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.882+0000 7f09959adb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09841b4350 con 0x562a86e02240 2024-05-08T07:54:10.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.882+0000 7f09959adb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09841b57c0 con 0x562a86dfc810 2024-05-08T07:54:10.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.882+0000 7f09959adb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f09841b4a20 con 0x562a86dfd1d0 2024-05-08T07:54:10.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.882+0000 7f09959adb80 10 client.0 _ll_register_callbacks cb 0x562a86cf5e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:54:10.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.883+0000 7f0983e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfc810 0x562a86e7c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.883+0000 7f0983400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e7abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.883+0000 7f0983e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfc810 0x562a86e7c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:59830/0 (socket says 172.21.15.70:59830) 2024-05-08T07:54:10.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.883+0000 7f0983400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e7abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:33754/0 (socket says 172.21.15.70:33754) 2024-05-08T07:54:10.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.883+0000 7f0983e00700 1 -- 172.21.15.70:0/1136955115 learned_addr learned my addr 172.21.15.70:0/1136955115 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:54:10.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.883+0000 7f0989000700 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86e02240 0x562a86e7b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.884+0000 7f0983400700 1 -- 172.21.15.70:0/1136955115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfc810 msgr2=0x562a86e7c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:54:10.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.884+0000 7f0983400700 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfc810 0x562a86e7c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.884+0000 7f0983400700 1 -- 172.21.15.70:0/1136955115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86e02240 msgr2=0x562a86e7b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:54:10.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.884+0000 7f0983400700 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86e02240 0x562a86e7b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:10.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.884+0000 7f0983400700 1 -- 172.21.15.70:0/1136955115 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a86e7b950 con 0x562a86dfd1d0 2024-05-08T07:54:10.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.884+0000 7f0989000700 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86e02240 0x562a86e7b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:54:10.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.885+0000 7f0983400700 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e7abd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f09740a5a70 tx=0x7f09740e0310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b80565bff783f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:54:10.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.885+0000 7f0972000700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T07:54:10.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.885+0000 7f0972000700 1 -- 172.21.15.70:0/1136955115 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09740a9340 con 0x562a86dfd1d0 2024-05-08T07:54:10.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.885+0000 7f0972000700 1 -- 172.21.15.70:0/1136955115 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(214..214 src has 1..214) ==== 9671+0+0 (secure 0 0 0) 0x7f09740a9e60 con 0x562a86dfd1d0 2024-05-08T07:54:10.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.886+0000 7f09959adb80 1 -- 172.21.15.70:0/1136955115 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562a86df7660 con 0x562a86dfd1d0 2024-05-08T07:54:10.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.886+0000 7f0972000700 1 -- 172.21.15.70:0/1136955115 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f09740c3050 con 0x562a86dfd1d0 2024-05-08T07:54:10.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.886+0000 7f09959adb80 10 client.26470 fetch_fsmap learned FSMap version 42 2024-05-08T07:54:10.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.886+0000 7f09959adb80 1 -- 172.21.15.70:0/1136955115 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562a86e0e9d0 con 0x562a86dfd1d0 2024-05-08T07:54:10.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.886+0000 7f0972000700 1 -- 172.21.15.70:0/1136955115 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x562a86df7660 con 0x562a86dfd1d0 2024-05-08T07:54:10.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.887+0000 7f0972000700 1 -- 172.21.15.70:0/1136955115 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f09740b23c0 con 0x562a86dfd1d0 2024-05-08T07:54:10.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.887+0000 7f09959adb80 10 client.26470 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:54:10.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.887+0000 7f09959adb80 10 client.26470 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:54:10.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.887+0000 7f09959adb80 20 client.26470 populate_metadata read hostname 'smithi070' 2024-05-08T07:54:10.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.887+0000 7f09959adb80 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562a86e0ecb0 0x562a86e0f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:54:10.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.887+0000 7f09959adb80 4 client.26470 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.5, "await_for": 42.0}] 2024-05-08T07:54:10.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.887+0000 7f09959adb80 1 -- 172.21.15.70:0/1136955115 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.5, "await_for": 42.0}) -- 0x562a86d5c590 con 0x562a86e0ecb0 2024-05-08T07:54:10.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.888+0000 7f0983e00700 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562a86e0ecb0 0x562a86e0f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:54:10.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.889+0000 7f0983e00700 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562a86e0ecb0 0x562a86e0f090 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d58453836effda04 server_cookie=217a1a43a8bcc7a6 in_seq=0 out_seq=0 2024-05-08T07:54:10.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:10.889+0000 7f0972000700 10 client.26470 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:54:10.887 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/uring_cmd.o 2024-05-08T07:54:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:54:11.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:54:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:11 smithi070 ceph-mon[29591]: pgmap v2152: 129 pgs: 3 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 125 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 263 KiB/s wr, 37 op/s 2024-05-08T07:54:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:54:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:54:11.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:54:12.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:11 smithi172 ceph-mon[33377]: pgmap v2152: 129 pgs: 3 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 125 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 263 KiB/s wr, 37 op/s 2024-05-08T07:54:12.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:54:12.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:54:12.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:54:12.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:11 smithi194 ceph-mon[33679]: pgmap v2152: 129 pgs: 3 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 125 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 263 KiB/s wr, 37 op/s 2024-05-08T07:54:12.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:54:12.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:54:12.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:54:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:13 smithi070 ceph-mon[29591]: pgmap v2153: 129 pgs: 3 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 125 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 263 KiB/s wr, 37 op/s 2024-05-08T07:54:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:13 smithi172 ceph-mon[33377]: pgmap v2153: 129 pgs: 3 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 125 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 263 KiB/s wr, 37 op/s 2024-05-08T07:54:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:13 smithi194 ceph-mon[33679]: pgmap v2153: 129 pgs: 3 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 125 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 263 KiB/s wr, 37 op/s 2024-05-08T07:54:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:15 smithi070 ceph-mon[29591]: pgmap v2154: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 428 KiB/s wr, 43 op/s 2024-05-08T07:54:16.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:15 smithi172 ceph-mon[33377]: pgmap v2154: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 428 KiB/s wr, 43 op/s 2024-05-08T07:54:16.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:15 smithi194 ceph-mon[33679]: pgmap v2154: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 428 KiB/s wr, 43 op/s 2024-05-08T07:54:18.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:17 smithi070 ceph-mon[29591]: pgmap v2155: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 428 KiB/s wr, 43 op/s 2024-05-08T07:54:18.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:17 smithi172 ceph-mon[33377]: pgmap v2155: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 428 KiB/s wr, 43 op/s 2024-05-08T07:54:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:17 smithi194 ceph-mon[33679]: pgmap v2155: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 428 KiB/s wr, 43 op/s 2024-05-08T07:54:19.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:19 smithi070 ceph-mon[29591]: pgmap v2156: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 428 KiB/s wr, 43 op/s 2024-05-08T07:54:19.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:19 smithi070 ceph-mon[29591]: osdmap e215: 12 total, 12 up, 12 in 2024-05-08T07:54:19.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:19 smithi172 ceph-mon[33377]: pgmap v2156: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 428 KiB/s wr, 43 op/s 2024-05-08T07:54:19.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:19 smithi172 ceph-mon[33377]: osdmap e215: 12 total, 12 up, 12 in 2024-05-08T07:54:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:19 smithi194 ceph-mon[33679]: pgmap v2156: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 428 KiB/s wr, 43 op/s 2024-05-08T07:54:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:19 smithi194 ceph-mon[33679]: osdmap e215: 12 total, 12 up, 12 in 2024-05-08T07:54:21.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:21 smithi172 ceph-mon[33377]: pgmap v2158: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 277 KiB/s wr, 111 op/s 2024-05-08T07:54:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:21 smithi194 ceph-mon[33679]: pgmap v2158: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 277 KiB/s wr, 111 op/s 2024-05-08T07:54:22.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:21 smithi070 ceph-mon[29591]: pgmap v2158: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 277 KiB/s wr, 111 op/s 2024-05-08T07:54:23.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:23 smithi172 ceph-mon[33377]: pgmap v2159: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 277 KiB/s wr, 111 op/s 2024-05-08T07:54:24.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:23 smithi194 ceph-mon[33679]: pgmap v2159: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 277 KiB/s wr, 111 op/s 2024-05-08T07:54:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:23 smithi070 ceph-mon[29591]: pgmap v2159: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 277 KiB/s wr, 111 op/s 2024-05-08T07:54:25.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:25 smithi172 ceph-mon[33377]: pgmap v2160: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 102 op/s 2024-05-08T07:54:26.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:25 smithi194 ceph-mon[33679]: pgmap v2160: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 102 op/s 2024-05-08T07:54:26.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:25 smithi070 ceph-mon[29591]: pgmap v2160: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 102 op/s 2024-05-08T07:54:27.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:27 smithi172 ceph-mon[33377]: pgmap v2161: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 102 op/s 2024-05-08T07:54:28.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:27 smithi194 ceph-mon[33679]: pgmap v2161: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 102 op/s 2024-05-08T07:54:28.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:27 smithi070 ceph-mon[29591]: pgmap v2161: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 102 op/s 2024-05-08T07:54:29.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:29 smithi172 ceph-mon[33377]: pgmap v2162: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 102 op/s 2024-05-08T07:54:30.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:29 smithi194 ceph-mon[33679]: pgmap v2162: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 102 op/s 2024-05-08T07:54:30.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:29 smithi070 ceph-mon[29591]: pgmap v2162: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 50 KiB/s wr, 102 op/s 2024-05-08T07:54:31.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.419+0000 7f0972000700 1 -- 172.21.15.70:0/1136955115 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x562a86d5c590 con 0x562a86e0ecb0 2024-05-08T07:54:31.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.419+0000 7f0972000700 10 client.26470 handle_command_reply: tid=0 2024-05-08T07:54:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.419+0000 7f09959adb80 1 client.26470 shutdown 2024-05-08T07:54:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 -- 172.21.15.70:0/1136955115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 msgr2=0x562a86e7abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e7abd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f09740a5a70 tx=0x7f09740e0310 comp rx=0 tx=0).stop 2024-05-08T07:54:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 -- 172.21.15.70:0/1136955115 shutdown_connections 2024-05-08T07:54:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562a86e0ecb0 0x562a86e0f090 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562a86e02240 0x562a86e7b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562a86dfc810 0x562a86e7c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 --2- 172.21.15.70:0/1136955115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562a86dfd1d0 0x562a86e7abd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f0972000700 0 client.26470 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:54:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 -- 172.21.15.70:0/1136955115 >> 172.21.15.70:0/1136955115 conn(0x562a86d74860 msgr2=0x562a86dfc090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 -- 172.21.15.70:0/1136955115 shutdown_connections 2024-05-08T07:54:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.421+0000 7f09959adb80 1 -- 172.21.15.70:0/1136955115 wait complete. 2024-05-08T07:54:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.422+0000 7f09959adb80 20 client.26470 trim_cache size 0 max 16384 2024-05-08T07:54:31.418 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:54:31.418 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:54:31.418 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:54:31.418 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 166, 2024-05-08T07:54:31.418 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "f0b0bb4": { 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 166, 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.5, 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:54:31.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:54:31.420 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:54:31.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:31.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:31.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:31.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:31.420 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:54:31.420 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09680b2bf0 msgr2=0x7f09680b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09680b2bf0 0x7f09680b50b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f097c00b780 tx=0x7f097c009b80 comp rx=0 tx=0).stop 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098410a4b0 msgr2=0x7f09841a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098410a4b0 0x7f09841a04e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f097400e9f0 tx=0x7f097400ed00 comp rx=0 tx=0).stop 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 shutdown_connections 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09680b2bf0 0x7f09680b50b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f098410fb80 0x7f09841a4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0984109af0 0x7f098419ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 --2- 172.21.15.70:0/1735006607 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f098410a4b0 0x7f09841a04e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:54:31.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 >> 172.21.15.70:0/1735006607 conn(0x7f0984076cb0 msgr2=0x7f09840771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:54:31.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 shutdown_connections 2024-05-08T07:54:31.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:54:31.424+0000 7f098b000700 1 -- 172.21.15.70:0/1735006607 wait complete. 2024-05-08T07:54:31.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:31 smithi070 ceph-mon[29591]: pgmap v2163: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 64 KiB/s wr, 88 op/s 2024-05-08T07:54:31.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:31 smithi172 ceph-mon[33377]: pgmap v2163: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 64 KiB/s wr, 88 op/s 2024-05-08T07:54:32.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:31 smithi194 ceph-mon[33679]: pgmap v2163: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 64 KiB/s wr, 88 op/s 2024-05-08T07:54:32.408 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f0b0bb4', quiesce took 28.4 seconds. Will release after: 28.5 2024-05-08T07:54:33.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:33 smithi172 ceph-mon[33377]: pgmap v2164: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T07:54:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:33 smithi194 ceph-mon[33679]: pgmap v2164: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T07:54:34.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:33 smithi070 ceph-mon[29591]: pgmap v2164: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T07:54:35.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:35 smithi172 ceph-mon[33377]: pgmap v2165: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 73 KiB/s wr, 9 op/s 2024-05-08T07:54:36.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:35 smithi194 ceph-mon[33679]: pgmap v2165: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 73 KiB/s wr, 9 op/s 2024-05-08T07:54:36.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:35 smithi070 ceph-mon[29591]: pgmap v2165: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 73 KiB/s wr, 9 op/s 2024-05-08T07:54:38.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:37 smithi194 ceph-mon[33679]: pgmap v2166: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T07:54:38.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:37 smithi070 ceph-mon[29591]: pgmap v2166: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T07:54:38.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:37 smithi172 ceph-mon[33377]: pgmap v2166: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T07:54:40.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:39 smithi194 ceph-mon[33679]: pgmap v2167: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T07:54:40.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:39 smithi070 ceph-mon[29591]: pgmap v2167: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T07:54:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:39 smithi172 ceph-mon[33377]: pgmap v2167: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T07:54:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:41 smithi194 ceph-mon[33679]: pgmap v2168: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 110 KiB/s wr, 10 op/s 2024-05-08T07:54:42.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:41 smithi070 ceph-mon[29591]: pgmap v2168: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 110 KiB/s wr, 10 op/s 2024-05-08T07:54:42.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:41 smithi172 ceph-mon[33377]: pgmap v2168: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 110 KiB/s wr, 10 op/s 2024-05-08T07:54:44.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:43 smithi194 ceph-mon[33679]: pgmap v2169: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 88 KiB/s wr, 7 op/s 2024-05-08T07:54:44.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:43 smithi070 ceph-mon[29591]: pgmap v2169: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 88 KiB/s wr, 7 op/s 2024-05-08T07:54:44.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:43 smithi172 ceph-mon[33377]: pgmap v2169: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 88 KiB/s wr, 7 op/s 2024-05-08T07:54:46.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:45 smithi194 ceph-mon[33679]: pgmap v2170: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 96 KiB/s wr, 11 op/s 2024-05-08T07:54:46.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:45 smithi070 ceph-mon[29591]: pgmap v2170: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 96 KiB/s wr, 11 op/s 2024-05-08T07:54:46.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:45 smithi172 ceph-mon[33377]: pgmap v2170: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 96 KiB/s wr, 11 op/s 2024-05-08T07:54:48.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:47 smithi194 ceph-mon[33679]: pgmap v2171: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:54:48.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:47 smithi070 ceph-mon[29591]: pgmap v2171: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:54:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:47 smithi172 ceph-mon[33377]: pgmap v2171: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:54:50.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:49 smithi194 ceph-mon[33679]: pgmap v2172: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:54:50.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:49 smithi070 ceph-mon[29591]: pgmap v2172: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:54:50.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:49 smithi172 ceph-mon[33377]: pgmap v2172: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T07:54:52.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:51 smithi194 ceph-mon[33679]: pgmap v2173: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 48 KiB/s wr, 10 op/s 2024-05-08T07:54:52.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:51 smithi070 ceph-mon[29591]: pgmap v2173: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 48 KiB/s wr, 10 op/s 2024-05-08T07:54:52.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:51 smithi172 ceph-mon[33377]: pgmap v2173: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 48 KiB/s wr, 10 op/s 2024-05-08T07:54:54.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:53 smithi194 ceph-mon[33679]: pgmap v2174: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.4 KiB/s wr, 6 op/s 2024-05-08T07:54:54.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:53 smithi070 ceph-mon[29591]: pgmap v2174: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.4 KiB/s wr, 6 op/s 2024-05-08T07:54:54.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:53 smithi172 ceph-mon[33377]: pgmap v2174: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 8.4 KiB/s wr, 6 op/s 2024-05-08T07:54:56.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:55 smithi194 ceph-mon[33679]: pgmap v2175: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.4 KiB/s wr, 8 op/s 2024-05-08T07:54:56.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:55 smithi070 ceph-mon[29591]: pgmap v2175: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.4 KiB/s wr, 8 op/s 2024-05-08T07:54:56.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:55 smithi172 ceph-mon[33377]: pgmap v2175: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 8.4 KiB/s wr, 8 op/s 2024-05-08T07:54:58.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:57 smithi194 ceph-mon[33679]: pgmap v2176: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5 op/s 2024-05-08T07:54:58.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:57 smithi070 ceph-mon[29591]: pgmap v2176: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5 op/s 2024-05-08T07:54:58.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:57 smithi172 ceph-mon[33377]: pgmap v2176: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5 op/s 2024-05-08T07:55:00.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:54:59 smithi194 ceph-mon[33679]: pgmap v2177: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5 op/s 2024-05-08T07:55:00.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:54:59 smithi070 ceph-mon[29591]: pgmap v2177: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5 op/s 2024-05-08T07:55:00.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:54:59 smithi172 ceph-mon[33377]: pgmap v2177: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5 op/s 2024-05-08T07:55:00.909 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:55:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:55:01.912 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:01 smithi070 ceph-mon[29591]: pgmap v2178: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7 op/s 2024-05-08T07:55:02.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:01 smithi172 ceph-mon[33377]: pgmap v2178: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7 op/s 2024-05-08T07:55:02.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:01 smithi194 ceph-mon[33679]: pgmap v2178: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7 op/s 2024-05-08T07:55:04.010 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:03 smithi070 ceph-mon[29591]: pgmap v2179: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:55:04.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:03 smithi172 ceph-mon[33377]: pgmap v2179: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:55:04.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:03 smithi194 ceph-mon[33679]: pgmap v2179: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T07:55:04.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.568+0000 7f123a200700 1 -- 172.21.15.70:0/3538251467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234108850 msgr2=0x7f12341103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:04.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.568+0000 7f123a200700 1 --2- 172.21.15.70:0/3538251467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234108850 0x7f12341103d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f122c00b0d0 tx=0x7f122c00b3e0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.568+0000 7f123a200700 1 -- 172.21.15.70:0/3538251467 shutdown_connections 2024-05-08T07:55:04.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.568+0000 7f123a200700 1 --2- 172.21.15.70:0/3538251467 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234108850 0x7f12341103d0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.568+0000 7f123a200700 1 --2- 172.21.15.70:0/3538251467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1234103750 0x7f1234103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.568+0000 7f123a200700 1 --2- 172.21.15.70:0/3538251467 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1234104100 0x7f1234108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.568+0000 7f123a200700 1 -- 172.21.15.70:0/3538251467 >> 172.21.15.70:0/3538251467 conn(0x7f123407a600 msgr2=0x7f123407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:55:04.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.568+0000 7f123a200700 1 -- 172.21.15.70:0/3538251467 shutdown_connections 2024-05-08T07:55:04.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.569+0000 7f123a200700 1 -- 172.21.15.70:0/3538251467 wait complete. 2024-05-08T07:55:04.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.570+0000 7f123a200700 1 Processor -- start 2024-05-08T07:55:04.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.570+0000 7f123a200700 1 -- start start 2024-05-08T07:55:04.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.571+0000 7f123a200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1234103750 0x7f123419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:04.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.571+0000 7f123a200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234104100 0x7f123419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.571+0000 7f123a200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1234108850 0x7f1234199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.571+0000 7f123a200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1234113540 con 0x7f1234104100 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.571+0000 7f123a200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f12341133c0 con 0x7f1234103750 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.571+0000 7f123a200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f12341136c0 con 0x7f1234108850 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.571+0000 7f1232a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234104100 0x7f123419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.571+0000 7f1232a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234104100 0x7f123419fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41044/0 (socket says 172.21.15.70:41044) 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.572+0000 7f1232a00700 1 -- 172.21.15.70:0/897488033 learned_addr learned my addr 172.21.15.70:0/897488033 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.572+0000 7f1233400700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1234103750 0x7f123419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.572+0000 7f1233e00700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1234108850 0x7f1234199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:04.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.572+0000 7f1232a00700 1 -- 172.21.15.70:0/897488033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1234108850 msgr2=0x7f1234199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.572+0000 7f1232a00700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1234108850 0x7f1234199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.572+0000 7f1232a00700 1 -- 172.21.15.70:0/897488033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1234103750 msgr2=0x7f123419f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.572+0000 7f1232a00700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1234103750 0x7f123419f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.572+0000 7f1232a00700 1 -- 172.21.15.70:0/897488033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123419a000 con 0x7f1234104100 2024-05-08T07:55:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.572+0000 7f1233400700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1234103750 0x7f123419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:55:04.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.573+0000 7f1232a00700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234104100 0x7f123419fbe0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f122000e9a0 tx=0x7f122000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:55:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.573+0000 7f122be00700 1 -- 172.21.15.70:0/897488033 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1220020070 con 0x7f1234104100 2024-05-08T07:55:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.573+0000 7f122be00700 1 -- 172.21.15.70:0/897488033 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f122000cc50 con 0x7f1234104100 2024-05-08T07:55:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.573+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123419a2f0 con 0x7f1234104100 2024-05-08T07:55:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.573+0000 7f122be00700 1 -- 172.21.15.70:0/897488033 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122001b800 con 0x7f1234104100 2024-05-08T07:55:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.573+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12340756d0 con 0x7f1234104100 2024-05-08T07:55:04.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.574+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1234104be0 con 0x7f1234104100 2024-05-08T07:55:04.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.578+0000 7f122be00700 1 -- 172.21.15.70:0/897488033 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1220023070 con 0x7f1234104100 2024-05-08T07:55:04.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.581+0000 7f122be00700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12180b29f0 0x7f12180b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:04.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.581+0000 7f122be00700 1 -- 172.21.15.70:0/897488033 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(215..215 src has 1..215) ==== 9583+0+0 (secure 0 0 0) 0x7f12200e6a50 con 0x7f1234104100 2024-05-08T07:55:04.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.581+0000 7f1233400700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12180b29f0 0x7f12180b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:04.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.582+0000 7f1233400700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12180b29f0 0x7f12180b4eb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1224009cb0 tx=0x7f1224009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:55:04.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.583+0000 7f122be00700 1 -- 172.21.15.70:0/897488033 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f12200ae0c0 con 0x7f1234104100 2024-05-08T07:55:04.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.872+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f123419ad50 con 0x7f1234104100 2024-05-08T07:55:04.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.875+0000 7f122be00700 1 -- 172.21.15.70:0/897488033 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f12200ad9c0 con 0x7f1234104100 2024-05-08T07:55:04.870 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:55:04.870 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:55:04.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.877+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12180b29f0 msgr2=0x7f12180b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:04.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.877+0000 7f123a200700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12180b29f0 0x7f12180b4eb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1224009cb0 tx=0x7f1224009260 comp rx=0 tx=0).stop 2024-05-08T07:55:04.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.877+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234104100 msgr2=0x7f123419fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:04.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.877+0000 7f123a200700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234104100 0x7f123419fbe0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f122000e9a0 tx=0x7f122000ecb0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.878+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 shutdown_connections 2024-05-08T07:55:04.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.878+0000 7f123a200700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12180b29f0 0x7f12180b4eb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.878+0000 7f123a200700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1234108850 0x7f1234199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.878+0000 7f123a200700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1234103750 0x7f123419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.878+0000 7f123a200700 1 --2- 172.21.15.70:0/897488033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1234104100 0x7f123419fbe0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:04.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.878+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 >> 172.21.15.70:0/897488033 conn(0x7f123407a600 msgr2=0x7f12341017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:55:04.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.878+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 shutdown_connections 2024-05-08T07:55:04.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:04.878+0000 7f123a200700 1 -- 172.21.15.70:0/897488033 wait complete. 2024-05-08T07:55:04.875 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:55:05.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:05 smithi070 ceph-mon[29591]: pgmap v2180: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:55:05.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:05 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/897488033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:55:06.103 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id f0b0bb4 --release --await' 2024-05-08T07:55:06.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id f0b0bb4 --release --await 2024-05-08T07:55:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:05 smithi172 ceph-mon[33377]: pgmap v2180: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:55:06.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:05 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/897488033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:55:06.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:05 smithi194 ceph-mon[33679]: pgmap v2180: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T07:55:06.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:05 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/897488033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:55:06.562 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:55:08.090 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:07 smithi070 ceph-mon[29591]: pgmap v2181: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:55:08.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:07 smithi172 ceph-mon[33377]: pgmap v2181: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:55:08.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:07 smithi194 ceph-mon[33679]: pgmap v2181: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:55:09.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.700+0000 7f03b6600700 1 -- 172.21.15.70:0/2150479372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 msgr2=0x7f03b0108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:09.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.700+0000 7f03b6600700 1 --2- 172.21.15.70:0/2150479372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 0x7f03b0108120 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f039c0099c0 tx=0x7f039c009cd0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.700+0000 7f03b6600700 1 -- 172.21.15.70:0/2150479372 shutdown_connections 2024-05-08T07:55:09.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.700+0000 7f03b6600700 1 --2- 172.21.15.70:0/2150479372 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03b0108850 0x7f03b01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.700+0000 7f03b6600700 1 --2- 172.21.15.70:0/2150479372 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b0103750 0x7f03b0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.700+0000 7f03b6600700 1 --2- 172.21.15.70:0/2150479372 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 0x7f03b0108120 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.700+0000 7f03b6600700 1 -- 172.21.15.70:0/2150479372 >> 172.21.15.70:0/2150479372 conn(0x7f03b007a600 msgr2=0x7f03b007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:55:09.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.701+0000 7f03b6600700 1 -- 172.21.15.70:0/2150479372 shutdown_connections 2024-05-08T07:55:09.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.701+0000 7f03b6600700 1 -- 172.21.15.70:0/2150479372 wait complete. 2024-05-08T07:55:09.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.702+0000 7f03b6600700 1 Processor -- start 2024-05-08T07:55:09.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.702+0000 7f03b6600700 1 -- start start 2024-05-08T07:55:09.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03b6600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03b0103750 0x7f03b00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03b6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 0x7f03b0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03b6600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b0108850 0x7f03b0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03b6600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01134c0 con 0x7f03b0104100 2024-05-08T07:55:09.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03b6600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0113340 con 0x7f03b0108850 2024-05-08T07:55:09.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03b6600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f03b0113640 con 0x7f03b0103750 2024-05-08T07:55:09.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03aea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 0x7f03b0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03aea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 0x7f03b0075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51524/0 (socket says 172.21.15.70:51524) 2024-05-08T07:55:09.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03aea00700 1 -- 172.21.15.70:0/3097045456 learned_addr learned my addr 172.21.15.70:0/3097045456 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:55:09.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.703+0000 7f03af400700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03b0103750 0x7f03b00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.704+0000 7f03afe00700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b0108850 0x7f03b0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.704+0000 7f03aea00700 1 -- 172.21.15.70:0/3097045456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03b0103750 msgr2=0x7f03b00757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.704+0000 7f03aea00700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03b0103750 0x7f03b00757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.704+0000 7f03aea00700 1 -- 172.21.15.70:0/3097045456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b0108850 msgr2=0x7f03b0076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.704+0000 7f03aea00700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b0108850 0x7f03b0076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.704+0000 7f03aea00700 1 -- 172.21.15.70:0/3097045456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b01a7f40 con 0x7f03b0104100 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.704+0000 7f03aea00700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 0x7f03b0075ce0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f039c000c00 tx=0x7f039c00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.704+0000 7f03a7e00700 1 -- 172.21.15.70:0/3097045456 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c00f940 con 0x7f03b0104100 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.704+0000 7f03a7e00700 1 -- 172.21.15.70:0/3097045456 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f039c004830 con 0x7f03b0104100 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.705+0000 7f03b6600700 1 -- 172.21.15.70:0/3097045456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b01a81d0 con 0x7f03b0104100 2024-05-08T07:55:09.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.705+0000 7f03a7e00700 1 -- 172.21.15.70:0/3097045456 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c0054b0 con 0x7f03b0104100 2024-05-08T07:55:09.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.705+0000 7f03b6600700 1 -- 172.21.15.70:0/3097045456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b01a85c0 con 0x7f03b0104100 2024-05-08T07:55:09.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.708+0000 7f03a7e00700 1 -- 172.21.15.70:0/3097045456 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f039c029060 con 0x7f03b0104100 2024-05-08T07:55:09.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.710+0000 7f03a7e00700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f03940b29f0 0x7f03940b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.710+0000 7f03a7e00700 1 -- 172.21.15.70:0/3097045456 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(216..216 src has 1..216) ==== 9671+0+0 (secure 0 0 0) 0x7f039c0e3620 con 0x7f03b0104100 2024-05-08T07:55:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.710+0000 7f03af400700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f03940b29f0 0x7f03940b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.711+0000 7f03af400700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f03940b29f0 0x7f03940b4eb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f03a0005950 tx=0x7f03a00058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:55:09.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.727+0000 7f03c0fa6b80 1 Processor -- start 2024-05-08T07:55:09.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.727+0000 7f03c0fa6b80 1 -- start start 2024-05-08T07:55:09.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9068590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 0x5627a9062c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 0x5627a906ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5627a8fb4b20 con 0x5627a90681b0 2024-05-08T07:55:09.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5627a8f52860 con 0x5627a9063140 2024-05-08T07:55:09.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5627a8fb0ae0 con 0x5627a9062780 2024-05-08T07:55:09.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03af400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03af400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9068590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51538/0 (socket says 172.21.15.70:51538) 2024-05-08T07:55:09.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03af400700 1 -- 172.21.15.70:0/1926398215 learned_addr learned my addr 172.21.15.70:0/1926398215 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:55:09.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03aea00700 1 --2- 172.21.15.70:0/1926398215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 0x5627a9062c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.728+0000 7f03afe00700 1 --2- 172.21.15.70:0/1926398215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 0x5627a906ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.729+0000 7f03af400700 1 -- 172.21.15.70:0/1926398215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 msgr2=0x5627a9062c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.729+0000 7f03af400700 1 --2- 172.21.15.70:0/1926398215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 0x5627a9062c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.729+0000 7f03af400700 1 -- 172.21.15.70:0/1926398215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 msgr2=0x5627a906ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.729+0000 7f03af400700 1 --2- 172.21.15.70:0/1926398215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 0x5627a906ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.729+0000 7f03af400700 1 -- 172.21.15.70:0/1926398215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627a8f019d0 con 0x5627a90681b0 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.729+0000 7f03af400700 1 --2- 172.21.15.70:0/1926398215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9068590 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f03a000fd70 tx=0x7f03a0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa97dce725f4249a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.729+0000 7f03a4c00700 1 -- 172.21.15.70:0/1926398215 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0022070 con 0x5627a90681b0 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.729+0000 7f03a4c00700 1 -- 172.21.15.70:0/1926398215 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03a0011bb0 con 0x5627a90681b0 2024-05-08T07:55:09.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.729+0000 7f03a4c00700 1 -- 172.21.15.70:0/1926398215 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a001d5b0 con 0x5627a90681b0 2024-05-08T07:55:09.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.730+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1926398215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 msgr2=0x5627a9068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:09.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.730+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1926398215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9068590 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f03a000fd70 tx=0x7f03a0012000 comp rx=0 tx=0).stop 2024-05-08T07:55:09.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.730+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1926398215 shutdown_connections 2024-05-08T07:55:09.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.730+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1926398215 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 0x5627a906ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.730+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1926398215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9068590 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.730+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1926398215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 0x5627a9062c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.730+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1926398215 >> 172.21.15.70:0/1926398215 conn(0x5627a8fda7d0 msgr2=0x5627a905d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:55:09.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.731+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1926398215 shutdown_connections 2024-05-08T07:55:09.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.731+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1926398215 wait complete. 2024-05-08T07:55:09.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.731+0000 7f03c0fa6b80 1 -- start start 2024-05-08T07:55:09.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.731+0000 7f03c0fa6b80 1 Processor -- start 2024-05-08T07:55:09.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 0x5627a906eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 0x5627a906beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a906c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5627a906f570 con 0x5627a90681b0 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5627a8f1ac20 con 0x5627a9063140 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5627a906f6f0 con 0x5627a9062780 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03c0fa6b80 10 client.0 _ll_register_callbacks cb 0x5627a8f5bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03afe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a906c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03afe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a906c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51540/0 (socket says 172.21.15.70:51540) 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.732+0000 7f03afe00700 1 -- 172.21.15.70:0/1260427011 learned_addr learned my addr 172.21.15.70:0/1260427011 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f03af400700 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 0x5627a906eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f03aea00700 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 0x5627a906beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f03afe00700 1 -- 172.21.15.70:0/1260427011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 msgr2=0x5627a906eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f03afe00700 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 0x5627a906eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f03afe00700 1 -- 172.21.15.70:0/1260427011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 msgr2=0x5627a906beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f03afe00700 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 0x5627a906beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f03afe00700 1 -- 172.21.15.70:0/1260427011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627a8f7a520 con 0x5627a90681b0 2024-05-08T07:55:09.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f03af400700 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 0x5627a906eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:55:09.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f03afe00700 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a906c3f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f03a8007b70 tx=0x7f03a8007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e788f83c04acb89 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:55:09.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.733+0000 7f0399600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:55:09.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.734+0000 7f0399600700 1 -- 172.21.15.70:0/1260427011 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a801a020 con 0x5627a90681b0 2024-05-08T07:55:09.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.734+0000 7f0399600700 1 -- 172.21.15.70:0/1260427011 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(216..216 src has 1..216) ==== 9671+0+0 (secure 0 0 0) 0x7f03a8011870 con 0x5627a90681b0 2024-05-08T07:55:09.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.734+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1260427011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03a0011bb0 con 0x5627a90681b0 2024-05-08T07:55:09.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.734+0000 7f0399600700 1 -- 172.21.15.70:0/1260427011 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f03a8025050 con 0x5627a90681b0 2024-05-08T07:55:09.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.734+0000 7f03c0fa6b80 10 client.17373 fetch_fsmap learned FSMap version 42 2024-05-08T07:55:09.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.734+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1260427011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5627a9079d70 con 0x5627a90681b0 2024-05-08T07:55:09.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.734+0000 7f0399600700 1 -- 172.21.15.70:0/1260427011 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03a0011bb0 con 0x5627a90681b0 2024-05-08T07:55:09.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.735+0000 7f0399600700 1 -- 172.21.15.70:0/1260427011 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f03a8016cd0 con 0x5627a90681b0 2024-05-08T07:55:09.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.735+0000 7f03c0fa6b80 10 client.17373 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:55:09.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.735+0000 7f03c0fa6b80 10 client.17373 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:55:09.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.735+0000 7f03c0fa6b80 20 client.17373 populate_metadata read hostname 'smithi070' 2024-05-08T07:55:09.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.735+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5627a907c3b0 0x5627a907e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.735+0000 7f03c0fa6b80 4 client.17373 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:55:09.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.735+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1260427011 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627a902f240 con 0x5627a907c3b0 2024-05-08T07:55:09.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.735+0000 7f03af400700 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5627a907c3b0 0x5627a907e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.736+0000 7f03af400700 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5627a907c3b0 0x5627a907e810 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdedfe132fd342be server_cookie=fa696782d273c7dd in_seq=0 out_seq=0 2024-05-08T07:55:09.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.736+0000 7f0399600700 10 client.17373 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:55:09.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f0399600700 1 -- 172.21.15.70:0/1260427011 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5627a902f240 con 0x5627a907c3b0 2024-05-08T07:55:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f0399600700 10 client.17373 handle_command_reply: tid=0 2024-05-08T07:55:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 client.17373 shutdown 2024-05-08T07:55:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1260427011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 msgr2=0x5627a906c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a906c3f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f03a8007b70 tx=0x7f03a8007f30 comp rx=0 tx=0).stop 2024-05-08T07:55:09.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1260427011 shutdown_connections 2024-05-08T07:55:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5627a907c3b0 0x5627a907e810 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a906c3f0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9062780 0x5627a906eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/1260427011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9063140 0x5627a906beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1260427011 >> 172.21.15.70:0/1260427011 conn(0x5627a8fda7d0 msgr2=0x5627a9057b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:55:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f0399600700 0 client.17373 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:55:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1260427011 shutdown_connections 2024-05-08T07:55:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/1260427011 wait complete. 2024-05-08T07:55:09.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.739+0000 7f03c0fa6b80 20 client.17373 trim_cache size 0 max 16384 2024-05-08T07:55:09.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.762+0000 7f03c0fa6b80 1 Processor -- start 2024-05-08T07:55:09.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.762+0000 7f03c0fa6b80 1 -- start start 2024-05-08T07:55:09.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.762+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 0x5627a90785c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.762+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a9063140 0x5627a90664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.762+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a90681b0 0x5627a9061e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.762+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b4180 con 0x5627a9063140 2024-05-08T07:55:09.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.762+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b1a10 con 0x5627a9062780 2024-05-08T07:55:09.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.762+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01af880 con 0x5627a90681b0 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03aea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a9063140 0x5627a90664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03afe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a90681b0 0x5627a9061e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03aea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a9063140 0x5627a90664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51544/0 (socket says 172.21.15.70:51544) 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03aea00700 1 -- 172.21.15.70:0/3040617500 learned_addr learned my addr 172.21.15.70:0/3040617500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03af400700 1 --2- 172.21.15.70:0/3040617500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 0x5627a90785c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03aea00700 1 -- 172.21.15.70:0/3040617500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a90681b0 msgr2=0x5627a9061e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03aea00700 1 --2- 172.21.15.70:0/3040617500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a90681b0 0x5627a9061e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03aea00700 1 -- 172.21.15.70:0/3040617500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 msgr2=0x5627a90785c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03aea00700 1 --2- 172.21.15.70:0/3040617500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 0x5627a90785c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.763+0000 7f03aea00700 1 -- 172.21.15.70:0/3040617500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627a906e750 con 0x5627a9063140 2024-05-08T07:55:09.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.764+0000 7f03aea00700 1 --2- 172.21.15.70:0/3040617500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a9063140 0x5627a90664c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f039c0e09a0 tx=0x7f039c0096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5b46c6059bd3c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:55:09.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.764+0000 7f039be00700 1 -- 172.21.15.70:0/3040617500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c0c3020 con 0x5627a9063140 2024-05-08T07:55:09.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.764+0000 7f039be00700 1 -- 172.21.15.70:0/3040617500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f039c0aa510 con 0x5627a9063140 2024-05-08T07:55:09.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.764+0000 7f039be00700 1 -- 172.21.15.70:0/3040617500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f039c0a67a0 con 0x5627a9063140 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3040617500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a9063140 msgr2=0x5627a90664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3040617500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a9063140 0x5627a90664c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f039c0e09a0 tx=0x7f039c0096a0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3040617500 shutdown_connections 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3040617500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a90681b0 0x5627a9061e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3040617500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 0x5627a90785c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3040617500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a9063140 0x5627a90664c0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3040617500 >> 172.21.15.70:0/3040617500 conn(0x5627a8fda7d0 msgr2=0x5627a9061770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3040617500 shutdown_connections 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3040617500 wait complete. 2024-05-08T07:55:09.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.765+0000 7f03c0fa6b80 1 -- start start 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.766+0000 7f03c0fa6b80 1 Processor -- start 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.766+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 0x5627a9071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.766+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9063140 0x5627a9071e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.766+0000 7f03c0fa6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9072390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.766+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01afed0 con 0x5627a90681b0 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.766+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b1340 con 0x5627a9062780 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.766+0000 7f03c0fa6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f03b01b05a0 con 0x5627a9063140 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.766+0000 7f03c0fa6b80 10 client.0 _ll_register_callbacks cb 0x5627a8f5bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03afe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03afe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9072390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51548/0 (socket says 172.21.15.70:51548) 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03afe00700 1 -- 172.21.15.70:0/3157056930 learned_addr learned my addr 172.21.15.70:0/3157056930 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03af400700 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 0x5627a9071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03aea00700 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9063140 0x5627a9071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03afe00700 1 -- 172.21.15.70:0/3157056930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9063140 msgr2=0x5627a9071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:55:09.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03afe00700 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9063140 0x5627a9071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03afe00700 1 -- 172.21.15.70:0/3157056930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 msgr2=0x5627a9071910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:55:09.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03afe00700 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 0x5627a9071910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:09.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03afe00700 1 -- 172.21.15.70:0/3157056930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627a90ef4e0 con 0x5627a90681b0 2024-05-08T07:55:09.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f03afe00700 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9072390 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f03a8007840 tx=0x7f03a8005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf95ab2797dc1556 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:55:09.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.767+0000 7f0399600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:55:09.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.768+0000 7f0399600700 1 -- 172.21.15.70:0/3157056930 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a801a040 con 0x5627a90681b0 2024-05-08T07:55:09.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.768+0000 7f0399600700 1 -- 172.21.15.70:0/3157056930 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(216..216 src has 1..216) ==== 9671+0+0 (secure 0 0 0) 0x7f03a80156a0 con 0x5627a90681b0 2024-05-08T07:55:09.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.768+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3157056930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f039c0aa510 con 0x5627a90681b0 2024-05-08T07:55:09.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.768+0000 7f0399600700 1 -- 172.21.15.70:0/3157056930 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f03a80114b0 con 0x5627a90681b0 2024-05-08T07:55:09.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.768+0000 7f03c0fa6b80 10 client.17379 fetch_fsmap learned FSMap version 42 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.768+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3157056930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5627a90f0800 con 0x5627a90681b0 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.768+0000 7f0399600700 1 -- 172.21.15.70:0/3157056930 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f039c0aa510 con 0x5627a90681b0 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.769+0000 7f0399600700 1 -- 172.21.15.70:0/3157056930 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f03a80168e0 con 0x5627a90681b0 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.769+0000 7f03c0fa6b80 10 client.17379 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.769+0000 7f03c0fa6b80 10 client.17379 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.769+0000 7f03c0fa6b80 20 client.17379 populate_metadata read hostname 'smithi070' 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.769+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5627a90f0f30 0x5627a90f3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.769+0000 7f03c0fa6b80 4 client.17379 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f0b0bb4", "release": true, "await": true}] 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.769+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3157056930 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f0b0bb4", "release": true, "await": true}) -- 0x5627a8fc2500 con 0x5627a90f0f30 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.769+0000 7f03af400700 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5627a90f0f30 0x5627a90f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.770+0000 7f03af400700 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5627a90f0f30 0x5627a90f3350 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47f764666610a37 server_cookie=44b25b32203a3f84 in_seq=0 out_seq=0 2024-05-08T07:55:09.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:09.770+0000 7f0399600700 10 client.17379 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:55:10.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:09 smithi070 ceph-mon[29591]: pgmap v2182: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:55:10.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:09 smithi070 ceph-mon[29591]: osdmap e216: 12 total, 12 up, 12 in 2024-05-08T07:55:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:09 smithi172 ceph-mon[33377]: pgmap v2182: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:55:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:09 smithi172 ceph-mon[33377]: osdmap e216: 12 total, 12 up, 12 in 2024-05-08T07:55:10.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:09 smithi194 ceph-mon[33679]: pgmap v2182: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T07:55:10.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:09 smithi194 ceph-mon[33679]: osdmap e216: 12 total, 12 up, 12 in 2024-05-08T07:55:12.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:11 smithi070 ceph-mon[29591]: pgmap v2184: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:55:12.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:11 smithi172 ceph-mon[33377]: pgmap v2184: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:55:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:11 smithi194 ceph-mon[33679]: pgmap v2184: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:55:13.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:55:13.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:55:13.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:55:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:13 smithi070 ceph-mon[29591]: pgmap v2185: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:55:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:55:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:55:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:55:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:13 smithi172 ceph-mon[33377]: pgmap v2185: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:55:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:55:14.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:55:14.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:55:14.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.184+0000 7f0399600700 1 -- 172.21.15.70:0/3157056930 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5627a8fc2500 con 0x5627a90f0f30 2024-05-08T07:55:14.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.184+0000 7f0399600700 10 client.17379 handle_command_reply: tid=0 2024-05-08T07:55:14.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.184+0000 7f03c0fa6b80 1 client.17379 shutdown 2024-05-08T07:55:14.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.185+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3157056930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 msgr2=0x5627a9072390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.185+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9072390 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f03a8007840 tx=0x7f03a8005f40 comp rx=0 tx=0).stop 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.185+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3157056930 shutdown_connections 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.185+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5627a90f0f30 0x5627a90f3350 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.185+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627a90681b0 0x5627a9072390 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.185+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5627a9062780 0x5627a9071910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.185+0000 7f03c0fa6b80 1 --2- 172.21.15.70:0/3157056930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5627a9063140 0x5627a9071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.185+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3157056930 >> 172.21.15.70:0/3157056930 conn(0x5627a8fda7d0 msgr2=0x5627a9066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.185+0000 7f0399600700 0 client.17379 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.186+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3157056930 shutdown_connections 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.186+0000 7f03c0fa6b80 1 -- 172.21.15.70:0/3157056930 wait complete. 2024-05-08T07:55:14.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.186+0000 7f03c0fa6b80 20 client.17379 trim_cache size 0 max 16384 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 168, 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "f0b0bb4": { 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 168, 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:55:14.183 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.5, 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:55:14.184 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:55:14.185 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:55:14.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.187+0000 7f03b6600700 1 -- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f03940b29f0 msgr2=0x7f03940b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:14.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.187+0000 7f03b6600700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f03940b29f0 0x7f03940b4eb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f03a0005950 tx=0x7f03a00058e0 comp rx=0 tx=0).stop 2024-05-08T07:55:14.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.187+0000 7f03b6600700 1 -- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 msgr2=0x7f03b0075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:55:14.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.187+0000 7f03b6600700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 0x7f03b0075ce0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f039c000c00 tx=0x7f039c00f510 comp rx=0 tx=0).stop 2024-05-08T07:55:14.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.188+0000 7f03b6600700 1 -- 172.21.15.70:0/3097045456 shutdown_connections 2024-05-08T07:55:14.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.188+0000 7f03b6600700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f03940b29f0 0x7f03940b4eb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:14.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.188+0000 7f03b6600700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f03b0108850 0x7f03b0076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:14.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.188+0000 7f03b6600700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f03b0103750 0x7f03b00757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:14.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.188+0000 7f03b6600700 1 --2- 172.21.15.70:0/3097045456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03b0104100 0x7f03b0075ce0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:55:14.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.188+0000 7f03b6600700 1 -- 172.21.15.70:0/3097045456 >> 172.21.15.70:0/3097045456 conn(0x7f03b007a600 msgr2=0x7f03b0101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:55:14.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.188+0000 7f03b6600700 1 -- 172.21.15.70:0/3097045456 shutdown_connections 2024-05-08T07:55:14.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:55:14.188+0000 7f03b6600700 1 -- 172.21.15.70:0/3097045456 wait complete. 2024-05-08T07:55:14.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:13 smithi194 ceph-mon[33679]: pgmap v2185: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:55:14.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:55:14.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:55:14.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:55:14.940 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/sha1.o 2024-05-08T07:55:15.098 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f0b0bb4', seconds elapsed: 71.1 2024-05-08T07:55:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:15 smithi070 ceph-mon[29591]: pgmap v2186: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-05-08T07:55:16.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:15 smithi172 ceph-mon[33377]: pgmap v2186: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-05-08T07:55:16.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:15 smithi194 ceph-mon[33679]: pgmap v2186: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-05-08T07:55:16.559 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/insn.o 2024-05-08T07:55:16.576 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cgroup/debug.o 2024-05-08T07:55:16.579 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-mq-sysfs.o 2024-05-08T07:55:16.765 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/pid_list.o 2024-05-08T07:55:16.815 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/migrate.o 2024-05-08T07:55:17.111 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/epoll.o 2024-05-08T07:55:17.202 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/idt.o 2024-05-08T07:55:18.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:17 smithi070 ceph-mon[29591]: pgmap v2187: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-05-08T07:55:18.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:17 smithi172 ceph-mon[33377]: pgmap v2187: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-05-08T07:55:18.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:17 smithi194 ceph-mon[33679]: pgmap v2187: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-05-08T07:55:18.788 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/kaslr.o 2024-05-08T07:55:19.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:19 smithi172 ceph-mon[33377]: osdmap e217: 12 total, 12 up, 12 in 2024-05-08T07:55:19.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:19 smithi172 ceph-mon[33377]: pgmap v2189: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 7 op/s 2024-05-08T07:55:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:19 smithi194 ceph-mon[33679]: osdmap e217: 12 total, 12 up, 12 in 2024-05-08T07:55:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:19 smithi194 ceph-mon[33679]: pgmap v2189: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 7 op/s 2024-05-08T07:55:20.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:19 smithi070 ceph-mon[29591]: osdmap e217: 12 total, 12 up, 12 in 2024-05-08T07:55:20.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:19 smithi070 ceph-mon[29591]: pgmap v2189: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 10 KiB/s wr, 7 op/s 2024-05-08T07:55:21.399 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crypto/sha256.o 2024-05-08T07:55:21.709 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/memcpy_64.o 2024-05-08T07:55:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:21 smithi194 ceph-mon[33679]: pgmap v2190: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 231 KiB/s wr, 21 op/s 2024-05-08T07:55:22.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:21 smithi070 ceph-mon[29591]: pgmap v2190: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 231 KiB/s wr, 21 op/s 2024-05-08T07:55:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:21 smithi172 ceph-mon[33377]: pgmap v2190: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 231 KiB/s wr, 21 op/s 2024-05-08T07:55:22.266 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/memmove_64.o 2024-05-08T07:55:22.744 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/memset_64.o 2024-05-08T07:55:23.276 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/misc.o 2024-05-08T07:55:23.888 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/pc-conf-reg.o 2024-05-08T07:55:24.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:23 smithi194 ceph-mon[33679]: pgmap v2191: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 231 KiB/s wr, 21 op/s 2024-05-08T07:55:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:23 smithi070 ceph-mon[29591]: pgmap v2191: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 231 KiB/s wr, 21 op/s 2024-05-08T07:55:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:23 smithi172 ceph-mon[33377]: pgmap v2191: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 231 KiB/s wr, 21 op/s 2024-05-08T07:55:25.279 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/cgroup/built-in.a 2024-05-08T07:55:25.764 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-mq-cpumap.o 2024-05-08T07:55:26.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:25 smithi194 ceph-mon[33679]: pgmap v2192: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 407 KiB/s wr, 194 op/s 2024-05-08T07:55:26.035 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-mq-sched.o 2024-05-08T07:55:26.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:25 smithi070 ceph-mon[29591]: pgmap v2192: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 407 KiB/s wr, 194 op/s 2024-05-08T07:55:26.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:25 smithi172 ceph-mon[33377]: pgmap v2192: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 407 KiB/s wr, 194 op/s 2024-05-08T07:55:26.825 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/mmp.o 2024-05-08T07:55:27.068 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_sched_switch.o 2024-05-08T07:55:27.088 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/statx.o 2024-05-08T07:55:27.653 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/irq.o 2024-05-08T07:55:27.856 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/putuser.o 2024-05-08T07:55:27.977 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:27 smithi172 ceph-mon[33377]: pgmap v2193: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 407 KiB/s wr, 194 op/s 2024-05-08T07:55:28.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:27 smithi194 ceph-mon[33679]: pgmap v2193: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 407 KiB/s wr, 194 op/s 2024-05-08T07:55:28.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:27 smithi070 ceph-mon[29591]: pgmap v2193: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 407 KiB/s wr, 194 op/s 2024-05-08T07:55:28.625 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/retpoline.o 2024-05-08T07:55:28.717 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/crypto/built-in.a 2024-05-08T07:55:29.379 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zlib_inflate/inffast.o 2024-05-08T07:55:29.415 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/usercopy.o 2024-05-08T07:55:30.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:29 smithi194 ceph-mon[33679]: pgmap v2194: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 407 KiB/s wr, 194 op/s 2024-05-08T07:55:30.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:29 smithi070 ceph-mon[29591]: pgmap v2194: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 407 KiB/s wr, 194 op/s 2024-05-08T07:55:30.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:29 smithi172 ceph-mon[33377]: pgmap v2194: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 407 KiB/s wr, 194 op/s 2024-05-08T07:55:32.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:31 smithi194 ceph-mon[33679]: pgmap v2195: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 577 KiB/s wr, 178 op/s 2024-05-08T07:55:32.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:31 smithi070 ceph-mon[29591]: pgmap v2195: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 577 KiB/s wr, 178 op/s 2024-05-08T07:55:32.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:31 smithi172 ceph-mon[33377]: pgmap v2195: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 577 KiB/s wr, 178 op/s 2024-05-08T07:55:34.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:33 smithi194 ceph-mon[33679]: pgmap v2196: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 392 KiB/s wr, 164 op/s 2024-05-08T07:55:34.067 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zlib_inflate/inflate.o 2024-05-08T07:55:34.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:33 smithi070 ceph-mon[29591]: pgmap v2196: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 392 KiB/s wr, 164 op/s 2024-05-08T07:55:34.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:33 smithi172 ceph-mon[33377]: pgmap v2196: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 392 KiB/s wr, 164 op/s 2024-05-08T07:55:35.547 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zlib_inflate/infutil.o 2024-05-08T07:55:35.704 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/usercopy_64.o 2024-05-08T07:55:36.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:35 smithi194 ceph-mon[33679]: pgmap v2197: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 544 KiB/s wr, 265 op/s 2024-05-08T07:55:36.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:35 smithi070 ceph-mon[29591]: pgmap v2197: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 544 KiB/s wr, 265 op/s 2024-05-08T07:55:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:35 smithi172 ceph-mon[33377]: pgmap v2197: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 544 KiB/s wr, 265 op/s 2024-05-08T07:55:36.581 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/ioctl.o 2024-05-08T07:55:36.663 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/events/core.o 2024-05-08T07:55:36.820 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/move_extent.o 2024-05-08T07:55:36.887 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/net.o 2024-05-08T07:55:37.403 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_nop.o 2024-05-08T07:55:38.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:37 smithi194 ceph-mon[33679]: pgmap v2198: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 389 KiB/s wr, 118 op/s 2024-05-08T07:55:38.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:37 smithi070 ceph-mon[29591]: pgmap v2198: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 389 KiB/s wr, 118 op/s 2024-05-08T07:55:38.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:37 smithi172 ceph-mon[33377]: pgmap v2198: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 389 KiB/s wr, 118 op/s 2024-05-08T07:55:39.244 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/irq_64.o 2024-05-08T07:55:40.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:39 smithi194 ceph-mon[33679]: pgmap v2199: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 389 KiB/s wr, 118 op/s 2024-05-08T07:55:40.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:39 smithi070 ceph-mon[29591]: pgmap v2199: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 389 KiB/s wr, 118 op/s 2024-05-08T07:55:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:39 smithi172 ceph-mon[33377]: pgmap v2199: 129 pgs: 129 active+clean; 1.8 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 389 KiB/s wr, 118 op/s 2024-05-08T07:55:40.518 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zlib_inflate/inftrees.o 2024-05-08T07:55:42.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:41 smithi194 ceph-mon[33679]: pgmap v2200: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 625 KiB/s wr, 131 op/s 2024-05-08T07:55:42.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:41 smithi070 ceph-mon[29591]: pgmap v2200: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 625 KiB/s wr, 131 op/s 2024-05-08T07:55:42.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:41 smithi172 ceph-mon[33377]: pgmap v2200: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 625 KiB/s wr, 131 op/s 2024-05-08T07:55:42.290 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zlib_inflate/inflate_syms.o 2024-05-08T07:55:44.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:43 smithi194 ceph-mon[33679]: pgmap v2201: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 388 KiB/s wr, 115 op/s 2024-05-08T07:55:44.063 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/msr-smp.o 2024-05-08T07:55:44.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:43 smithi070 ceph-mon[29591]: pgmap v2201: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 388 KiB/s wr, 115 op/s 2024-05-08T07:55:44.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:43 smithi172 ceph-mon[33377]: pgmap v2201: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 388 KiB/s wr, 115 op/s 2024-05-08T07:55:46.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:45 smithi070 ceph-mon[29591]: pgmap v2202: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 510 KiB/s wr, 125 op/s 2024-05-08T07:55:46.146 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/genhd.o 2024-05-08T07:55:46.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:45 smithi172 ceph-mon[33377]: pgmap v2202: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 510 KiB/s wr, 125 op/s 2024-05-08T07:55:46.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:45 smithi194 ceph-mon[33679]: pgmap v2202: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 510 KiB/s wr, 125 op/s 2024-05-08T07:55:46.447 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/namei.o 2024-05-08T07:55:47.247 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/blktrace.o 2024-05-08T07:55:48.115 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/cache-smp.o 2024-05-08T07:55:48.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:47 smithi070 ceph-mon[29591]: pgmap v2203: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 359 KiB/s wr, 24 op/s 2024-05-08T07:55:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:47 smithi172 ceph-mon[33377]: pgmap v2203: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 359 KiB/s wr, 24 op/s 2024-05-08T07:55:48.221 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/dumpstack_64.o 2024-05-08T07:55:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:47 smithi194 ceph-mon[33679]: pgmap v2203: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 359 KiB/s wr, 24 op/s 2024-05-08T07:55:48.912 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/zlib_inflate/built-in.a 2024-05-08T07:55:49.302 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/msg_ring.o 2024-05-08T07:55:49.375 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zlib_deflate/deflate.o 2024-05-08T07:55:50.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:49 smithi070 ceph-mon[29591]: pgmap v2204: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 359 KiB/s wr, 24 op/s 2024-05-08T07:55:50.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:49 smithi172 ceph-mon[33377]: pgmap v2204: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 359 KiB/s wr, 24 op/s 2024-05-08T07:55:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:49 smithi194 ceph-mon[33679]: pgmap v2204: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 359 KiB/s wr, 24 op/s 2024-05-08T07:55:51.408 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/msr.o 2024-05-08T07:55:52.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:51 smithi070 ceph-mon[29591]: pgmap v2205: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 649 KiB/s wr, 72 op/s 2024-05-08T07:55:52.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:51 smithi172 ceph-mon[33377]: pgmap v2205: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 649 KiB/s wr, 72 op/s 2024-05-08T07:55:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:51 smithi194 ceph-mon[33679]: pgmap v2205: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 550 KiB/s rd, 649 KiB/s wr, 72 op/s 2024-05-08T07:55:52.962 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/events/ring_buffer.o 2024-05-08T07:55:54.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:53 smithi070 ceph-mon[29591]: pgmap v2206: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 413 KiB/s wr, 58 op/s 2024-05-08T07:55:54.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:53 smithi172 ceph-mon[33377]: pgmap v2206: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 413 KiB/s wr, 58 op/s 2024-05-08T07:55:54.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:53 smithi194 ceph-mon[33679]: pgmap v2206: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 413 KiB/s wr, 58 op/s 2024-05-08T07:55:55.823 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zlib_deflate/deftree.o 2024-05-08T07:55:56.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:55 smithi070 ceph-mon[29591]: pgmap v2207: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 557 KiB/s wr, 69 op/s 2024-05-08T07:55:56.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:55 smithi172 ceph-mon[33377]: pgmap v2207: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 557 KiB/s wr, 69 op/s 2024-05-08T07:55:56.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:55 smithi194 ceph-mon[33679]: pgmap v2207: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 557 KiB/s wr, 69 op/s 2024-05-08T07:55:56.314 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/ioprio.o 2024-05-08T07:55:57.436 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/time.o 2024-05-08T07:55:57.636 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/page-io.o 2024-05-08T07:55:58.101 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zlib_deflate/deflate_syms.o 2024-05-08T07:55:58.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:57 smithi070 ceph-mon[29591]: pgmap v2208: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 435 KiB/s wr, 58 op/s 2024-05-08T07:55:58.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:57 smithi172 ceph-mon[33377]: pgmap v2208: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 435 KiB/s wr, 58 op/s 2024-05-08T07:55:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:57 smithi194 ceph-mon[33679]: pgmap v2208: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 435 KiB/s wr, 58 op/s 2024-05-08T07:55:58.418 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_events.o 2024-05-08T07:56:00.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:55:59 smithi070 ceph-mon[29591]: pgmap v2209: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 435 KiB/s wr, 58 op/s 2024-05-08T07:56:00.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:55:59 smithi172 ceph-mon[33377]: pgmap v2209: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 435 KiB/s wr, 58 op/s 2024-05-08T07:56:00.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:55:59 smithi194 ceph-mon[33679]: pgmap v2209: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 435 KiB/s wr, 58 op/s 2024-05-08T07:56:01.579 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/timeout.o 2024-05-08T07:56:01.693 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/msr-reg.o 2024-05-08T07:56:02.059 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:01 smithi194 ceph-mon[33679]: pgmap v2210: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 689 KiB/s wr, 72 op/s 2024-05-08T07:56:02.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:01 smithi070 ceph-mon[29591]: pgmap v2210: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 689 KiB/s wr, 72 op/s 2024-05-08T07:56:02.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:01 smithi172 ceph-mon[33377]: pgmap v2210: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 689 KiB/s wr, 72 op/s 2024-05-08T07:56:02.382 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/msr-reg-export.o 2024-05-08T07:56:03.007 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/events/callchain.o 2024-05-08T07:56:04.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:03 smithi070 ceph-mon[29591]: pgmap v2211: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 398 KiB/s wr, 24 op/s 2024-05-08T07:56:04.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:03 smithi172 ceph-mon[33377]: pgmap v2211: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 398 KiB/s wr, 24 op/s 2024-05-08T07:56:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:03 smithi194 ceph-mon[33679]: pgmap v2211: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 398 KiB/s wr, 24 op/s 2024-05-08T07:56:04.551 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/hweight.o 2024-05-08T07:56:05.469 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/zlib_deflate/built-in.a 2024-05-08T07:56:05.627 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/ioport.o 2024-05-08T07:56:05.790 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/lzo/lzo1x_compress.o 2024-05-08T07:56:06.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:05 smithi070 ceph-mon[29591]: pgmap v2212: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 633 KiB/s wr, 53 op/s 2024-05-08T07:56:06.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:05 smithi070 ceph-mon[29591]: osdmap e218: 12 total, 12 up, 12 in 2024-05-08T07:56:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:05 smithi172 ceph-mon[33377]: pgmap v2212: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 633 KiB/s wr, 53 op/s 2024-05-08T07:56:06.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:05 smithi172 ceph-mon[33377]: osdmap e218: 12 total, 12 up, 12 in 2024-05-08T07:56:06.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:05 smithi194 ceph-mon[33679]: pgmap v2212: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 633 KiB/s wr, 53 op/s 2024-05-08T07:56:06.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:05 smithi194 ceph-mon[33679]: osdmap e218: 12 total, 12 up, 12 in 2024-05-08T07:56:08.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:07 smithi070 ceph-mon[29591]: pgmap v2214: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 586 KiB/s wr, 50 op/s 2024-05-08T07:56:08.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:07 smithi172 ceph-mon[33377]: pgmap v2214: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 586 KiB/s wr, 50 op/s 2024-05-08T07:56:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:07 smithi194 ceph-mon[33679]: pgmap v2214: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 586 KiB/s wr, 50 op/s 2024-05-08T07:56:09.568 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_export.o 2024-05-08T07:56:10.114 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/iomem.o 2024-05-08T07:56:10.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:09 smithi070 ceph-mon[29591]: pgmap v2215: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 586 KiB/s wr, 50 op/s 2024-05-08T07:56:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:09 smithi172 ceph-mon[33377]: pgmap v2215: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 586 KiB/s wr, 50 op/s 2024-05-08T07:56:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:09 smithi194 ceph-mon[33679]: pgmap v2215: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 586 KiB/s wr, 50 op/s 2024-05-08T07:56:11.565 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/lzo/lzo1x_decompress_safe.o 2024-05-08T07:56:12.097 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/sqpoll.o 2024-05-08T07:56:12.120 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/readpage.o 2024-05-08T07:56:12.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:11 smithi070 ceph-mon[29591]: pgmap v2216: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 519 KiB/s wr, 257 op/s 2024-05-08T07:56:12.138 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/events/hw_breakpoint.o 2024-05-08T07:56:12.173 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/badblocks.o 2024-05-08T07:56:12.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:11 smithi172 ceph-mon[33377]: pgmap v2216: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 519 KiB/s wr, 257 op/s 2024-05-08T07:56:12.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:11 smithi194 ceph-mon[33679]: pgmap v2216: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 519 KiB/s wr, 257 op/s 2024-05-08T07:56:14.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:13 smithi070 ceph-mon[29591]: pgmap v2217: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 519 KiB/s wr, 257 op/s 2024-05-08T07:56:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:13 smithi070 ceph-mon[29591]: osdmap e219: 12 total, 12 up, 12 in 2024-05-08T07:56:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:56:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:13 smithi172 ceph-mon[33377]: pgmap v2217: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 519 KiB/s wr, 257 op/s 2024-05-08T07:56:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:13 smithi172 ceph-mon[33377]: osdmap e219: 12 total, 12 up, 12 in 2024-05-08T07:56:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:56:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:13 smithi194 ceph-mon[33679]: pgmap v2217: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 519 KiB/s wr, 257 op/s 2024-05-08T07:56:14.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:13 smithi194 ceph-mon[33679]: osdmap e219: 12 total, 12 up, 12 in 2024-05-08T07:56:14.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:56:14.376 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/dumpstack.o 2024-05-08T07:56:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:15 smithi172 ceph-mon[33377]: pgmap v2219: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 555 KiB/s wr, 241 op/s 2024-05-08T07:56:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:15.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:15 smithi194 ceph-mon[33679]: pgmap v2219: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 555 KiB/s wr, 241 op/s 2024-05-08T07:56:16.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:15 smithi070 ceph-mon[29591]: pgmap v2219: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 555 KiB/s wr, 241 op/s 2024-05-08T07:56:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:16.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:56:16.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:56:16.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:56:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:56:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:17.012 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/lib/iomap_copy_64.o 2024-05-08T07:56:17.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:56:17.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:56:17.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:56:17.596 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/lib/inat.o 2024-05-08T07:56:18.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:17 smithi194 ceph-mon[33679]: pgmap v2220: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 546 KiB/s wr, 238 op/s 2024-05-08T07:56:18.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:17 smithi070 ceph-mon[29591]: pgmap v2220: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 546 KiB/s wr, 238 op/s 2024-05-08T07:56:18.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:17 smithi172 ceph-mon[33377]: pgmap v2220: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 546 KiB/s wr, 238 op/s 2024-05-08T07:56:18.318 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/lzo/built-in.a 2024-05-08T07:56:18.437 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/lib/built-in.a 2024-05-08T07:56:18.788 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/lz4/lz4_decompress.o 2024-05-08T07:56:18.933 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/lib/lib.a 2024-05-08T07:56:18.963 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-rq-qos.o 2024-05-08T07:56:19.636 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_event_perf.o 2024-05-08T07:56:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:19 smithi194 ceph-mon[33679]: pgmap v2221: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 546 KiB/s wr, 238 op/s 2024-05-08T07:56:20.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:19 smithi070 ceph-mon[29591]: pgmap v2221: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 546 KiB/s wr, 238 op/s 2024-05-08T07:56:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:19 smithi172 ceph-mon[33377]: pgmap v2221: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 546 KiB/s wr, 238 op/s 2024-05-08T07:56:21.063 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/zstd_decompress_module.o 2024-05-08T07:56:21.960 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/resize.o 2024-05-08T07:56:22.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:21 smithi194 ceph-mon[33679]: pgmap v2222: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 580 KiB/s wr, 36 op/s 2024-05-08T07:56:22.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:21 smithi070 ceph-mon[29591]: pgmap v2222: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 580 KiB/s wr, 36 op/s 2024-05-08T07:56:22.141 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/events/uprobes.o 2024-05-08T07:56:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:21 smithi172 ceph-mon[33377]: pgmap v2222: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 580 KiB/s wr, 36 op/s 2024-05-08T07:56:22.186 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/fdinfo.o 2024-05-08T07:56:23.911 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/nmi.o 2024-05-08T07:56:24.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:23 smithi194 ceph-mon[33679]: pgmap v2223: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 580 KiB/s wr, 36 op/s 2024-05-08T07:56:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:23 smithi070 ceph-mon[29591]: pgmap v2223: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 580 KiB/s wr, 36 op/s 2024-05-08T07:56:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:23 smithi172 ceph-mon[33377]: pgmap v2223: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 580 KiB/s wr, 36 op/s 2024-05-08T07:56:25.766 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/lz4/built-in.a 2024-05-08T07:56:25.933 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/decompress/huf_decompress.o 2024-05-08T07:56:26.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:25 smithi194 ceph-mon[33679]: pgmap v2224: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 695 KiB/s wr, 47 op/s 2024-05-08T07:56:26.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:25 smithi070 ceph-mon[29591]: pgmap v2224: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 695 KiB/s wr, 47 op/s 2024-05-08T07:56:26.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:25 smithi172 ceph-mon[33377]: pgmap v2224: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 695 KiB/s wr, 47 op/s 2024-05-08T07:56:27.518 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/super.o 2024-05-08T07:56:27.693 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/disk-events.o 2024-05-08T07:56:27.977 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:27 smithi172 ceph-mon[33377]: pgmap v2225: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 380 KiB/s wr, 30 op/s 2024-05-08T07:56:28.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:27 smithi194 ceph-mon[33679]: pgmap v2225: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 380 KiB/s wr, 30 op/s 2024-05-08T07:56:28.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:27 smithi070 ceph-mon[29591]: pgmap v2225: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 380 KiB/s wr, 30 op/s 2024-05-08T07:56:28.916 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/decompress/zstd_ddict.o 2024-05-08T07:56:29.775 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_events_filter.o 2024-05-08T07:56:30.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:29 smithi194 ceph-mon[33679]: pgmap v2226: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 380 KiB/s wr, 30 op/s 2024-05-08T07:56:30.036 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/decompress/zstd_decompress.o 2024-05-08T07:56:30.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:29 smithi070 ceph-mon[29591]: pgmap v2226: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 380 KiB/s wr, 30 op/s 2024-05-08T07:56:30.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:29 smithi172 ceph-mon[33377]: pgmap v2226: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 380 KiB/s wr, 30 op/s 2024-05-08T07:56:31.680 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/decompress/zstd_decompress_block.o 2024-05-08T07:56:31.919 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/ldt.o 2024-05-08T07:56:32.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:31 smithi194 ceph-mon[33679]: pgmap v2227: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 637 KiB/s wr, 119 op/s 2024-05-08T07:56:32.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:31 smithi070 ceph-mon[29591]: pgmap v2227: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 637 KiB/s wr, 119 op/s 2024-05-08T07:56:32.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:31 smithi172 ceph-mon[33377]: pgmap v2227: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 637 KiB/s wr, 119 op/s 2024-05-08T07:56:32.201 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/events/built-in.a 2024-05-08T07:56:33.092 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-ia-ranges.o 2024-05-08T07:56:34.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:33 smithi194 ceph-mon[33679]: pgmap v2228: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 411 KiB/s wr, 101 op/s 2024-05-08T07:56:34.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:33 smithi070 ceph-mon[29591]: pgmap v2228: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 411 KiB/s wr, 101 op/s 2024-05-08T07:56:34.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:33 smithi172 ceph-mon[33377]: pgmap v2228: 129 pgs: 129 active+clean; 1.8 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 411 KiB/s wr, 101 op/s 2024-05-08T07:56:34.267 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/tctx.o 2024-05-08T07:56:34.841 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/zstd_common_module.o 2024-05-08T07:56:35.207 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_events_trigger.o 2024-05-08T07:56:36.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:35 smithi194 ceph-mon[33679]: pgmap v2229: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 773 KiB/s wr, 275 op/s 2024-05-08T07:56:36.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:35 smithi070 ceph-mon[29591]: pgmap v2229: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 773 KiB/s wr, 275 op/s 2024-05-08T07:56:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:35 smithi172 ceph-mon[33377]: pgmap v2229: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 773 KiB/s wr, 275 op/s 2024-05-08T07:56:36.747 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/setup.o 2024-05-08T07:56:38.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:37 smithi194 ceph-mon[33679]: pgmap v2230: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 619 KiB/s wr, 262 op/s 2024-05-08T07:56:38.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:37 smithi070 ceph-mon[29591]: pgmap v2230: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 619 KiB/s wr, 262 op/s 2024-05-08T07:56:38.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:37 smithi172 ceph-mon[33377]: pgmap v2230: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 619 KiB/s wr, 262 op/s 2024-05-08T07:56:40.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:39 smithi194 ceph-mon[33679]: pgmap v2231: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 619 KiB/s wr, 262 op/s 2024-05-08T07:56:40.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:39 smithi070 ceph-mon[29591]: pgmap v2231: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 619 KiB/s wr, 262 op/s 2024-05-08T07:56:40.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:39 smithi172 ceph-mon[33377]: pgmap v2231: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 619 KiB/s wr, 262 op/s 2024-05-08T07:56:40.447 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/poll.o 2024-05-08T07:56:41.437 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/common/debug.o 2024-05-08T07:56:41.733 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/early-lookup.o 2024-05-08T07:56:42.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:41 smithi194 ceph-mon[33679]: pgmap v2232: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 784 KiB/s wr, 273 op/s 2024-05-08T07:56:42.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:41 smithi070 ceph-mon[29591]: pgmap v2232: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 784 KiB/s wr, 273 op/s 2024-05-08T07:56:42.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:41 smithi172 ceph-mon[33377]: pgmap v2232: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 784 KiB/s wr, 273 op/s 2024-05-08T07:56:43.889 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/symlink.o 2024-05-08T07:56:44.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:43 smithi194 ceph-mon[33679]: pgmap v2233: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 527 KiB/s wr, 185 op/s 2024-05-08T07:56:44.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:43 smithi070 ceph-mon[29591]: pgmap v2233: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 527 KiB/s wr, 185 op/s 2024-05-08T07:56:44.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:43 smithi172 ceph-mon[33377]: pgmap v2233: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 527 KiB/s wr, 185 op/s 2024-05-08T07:56:44.260 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/common/entropy_common.o 2024-05-08T07:56:45.040 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_eprobe.o 2024-05-08T07:56:45.343 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/common/error_private.o 2024-05-08T07:56:46.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:45 smithi194 ceph-mon[33679]: pgmap v2234: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 825 KiB/s wr, 292 op/s 2024-05-08T07:56:46.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:45 smithi070 ceph-mon[29591]: pgmap v2234: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 825 KiB/s wr, 292 op/s 2024-05-08T07:56:46.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:45 smithi172 ceph-mon[33377]: pgmap v2234: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 825 KiB/s wr, 292 op/s 2024-05-08T07:56:46.214 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/common/fse_decompress.o 2024-05-08T07:56:46.246 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/x86_init.o 2024-05-08T07:56:46.379 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/bsg.o 2024-05-08T07:56:47.606 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/zstd/common/zstd_common.o 2024-05-08T07:56:48.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:47 smithi070 ceph-mon[29591]: pgmap v2235: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 463 KiB/s wr, 118 op/s 2024-05-08T07:56:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:47 smithi172 ceph-mon[33377]: pgmap v2235: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 463 KiB/s wr, 118 op/s 2024-05-08T07:56:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:47 smithi194 ceph-mon[33679]: pgmap v2235: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 463 KiB/s wr, 118 op/s 2024-05-08T07:56:48.698 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/zstd/built-in.a 2024-05-08T07:56:48.917 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/sysfs.o 2024-05-08T07:56:49.454 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/xz/xz_dec_syms.o 2024-05-08T07:56:49.619 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/cancel.o 2024-05-08T07:56:49.829 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/kbuf.o 2024-05-08T07:56:50.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:49 smithi070 ceph-mon[29591]: pgmap v2236: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 463 KiB/s wr, 118 op/s 2024-05-08T07:56:50.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:49 smithi172 ceph-mon[33377]: pgmap v2236: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 463 KiB/s wr, 118 op/s 2024-05-08T07:56:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:49 smithi194 ceph-mon[33679]: pgmap v2236: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 463 KiB/s wr, 118 op/s 2024-05-08T07:56:52.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:51 smithi070 ceph-mon[29591]: pgmap v2237: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 631 KiB/s wr, 133 op/s 2024-05-08T07:56:52.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:51 smithi172 ceph-mon[33377]: pgmap v2237: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 631 KiB/s wr, 133 op/s 2024-05-08T07:56:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:51 smithi194 ceph-mon[33679]: pgmap v2237: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 631 KiB/s wr, 133 op/s 2024-05-08T07:56:53.233 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/rsrc.o 2024-05-08T07:56:54.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:53 smithi070 ceph-mon[29591]: pgmap v2238: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 465 KiB/s wr, 122 op/s 2024-05-08T07:56:54.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:53 smithi172 ceph-mon[33377]: pgmap v2238: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 465 KiB/s wr, 122 op/s 2024-05-08T07:56:54.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:53 smithi194 ceph-mon[33679]: pgmap v2238: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 465 KiB/s wr, 122 op/s 2024-05-08T07:56:55.992 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-cgroup.o 2024-05-08T07:56:56.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:55 smithi070 ceph-mon[29591]: pgmap v2239: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 707 KiB/s wr, 277 op/s 2024-05-08T07:56:56.154 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/xz/xz_dec_stream.o 2024-05-08T07:56:56.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:55 smithi172 ceph-mon[33377]: pgmap v2239: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 707 KiB/s wr, 277 op/s 2024-05-08T07:56:56.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:55 smithi194 ceph-mon[33679]: pgmap v2239: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 707 KiB/s wr, 277 op/s 2024-05-08T07:56:56.423 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_kprobe.o 2024-05-08T07:56:56.540 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/i8259.o 2024-05-08T07:56:58.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:57 smithi070 ceph-mon[29591]: pgmap v2240: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 410 KiB/s wr, 170 op/s 2024-05-08T07:56:58.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:57 smithi172 ceph-mon[33377]: pgmap v2240: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 410 KiB/s wr, 170 op/s 2024-05-08T07:56:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:57 smithi194 ceph-mon[33679]: pgmap v2240: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 410 KiB/s wr, 170 op/s 2024-05-08T07:56:58.751 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/xattr.o 2024-05-08T07:56:59.280 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-ioprio.o 2024-05-08T07:56:59.702 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-iolatency.o 2024-05-08T07:57:00.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:56:59 smithi070 ceph-mon[29591]: pgmap v2241: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 410 KiB/s wr, 170 op/s 2024-05-08T07:57:00.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:56:59 smithi172 ceph-mon[33377]: pgmap v2241: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 410 KiB/s wr, 170 op/s 2024-05-08T07:57:00.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:56:59 smithi194 ceph-mon[33679]: pgmap v2241: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 410 KiB/s wr, 170 op/s 2024-05-08T07:57:00.956 INFO:tasks.quiescer.fs.[cephfs]:Total duration (49.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T07:57:00.956 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.85 2024-05-08T07:57:00.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:57:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:57:01.870 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/xz/xz_dec_lzma2.o 2024-05-08T07:57:02.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:01 smithi070 ceph-mon[29591]: pgmap v2242: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 611 KiB/s wr, 208 op/s 2024-05-08T07:57:02.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:01 smithi172 ceph-mon[33377]: pgmap v2242: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 611 KiB/s wr, 208 op/s 2024-05-08T07:57:02.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:01 smithi194 ceph-mon[33679]: pgmap v2242: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 561 KiB/s rd, 611 KiB/s wr, 208 op/s 2024-05-08T07:57:04.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.060+0000 7f52e4800700 1 -- 172.21.15.70:0/4000892018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 msgr2=0x7f52dc10f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:04.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.060+0000 7f52e4800700 1 --2- 172.21.15.70:0/4000892018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 0x7f52dc10f250 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f52d8009990 tx=0x7f52d8009ca0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.060+0000 7f52e4800700 1 -- 172.21.15.70:0/4000892018 shutdown_connections 2024-05-08T07:57:04.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.060+0000 7f52e4800700 1 --2- 172.21.15.70:0/4000892018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 0x7f52dc10f250 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.060+0000 7f52e4800700 1 --2- 172.21.15.70:0/4000892018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52dc108410 0x7f52dc1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.060+0000 7f52e4800700 1 --2- 172.21.15.70:0/4000892018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52dc1023a0 0x7f52dc102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.060+0000 7f52e4800700 1 -- 172.21.15.70:0/4000892018 >> 172.21.15.70:0/4000892018 conn(0x7f52dc079350 msgr2=0x7f52dc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:57:04.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.061+0000 7f52e4800700 1 -- 172.21.15.70:0/4000892018 shutdown_connections 2024-05-08T07:57:04.057 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:03 smithi070 ceph-mon[29591]: pgmap v2243: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 443 KiB/s wr, 193 op/s 2024-05-08T07:57:04.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.061+0000 7f52e4800700 1 -- 172.21.15.70:0/4000892018 wait complete. 2024-05-08T07:57:04.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.062+0000 7f52e4800700 1 Processor -- start 2024-05-08T07:57:04.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.062+0000 7f52e4800700 1 -- start start 2024-05-08T07:57:04.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.062+0000 7f52e4800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52dc1023a0 0x7f52dc1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:04.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.062+0000 7f52e4800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 0x7f52dc1a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:04.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.062+0000 7f52e4800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52dc108410 0x7f52dc10e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:04.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.063+0000 7f52e4800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc113560 con 0x7f52dc102d60 2024-05-08T07:57:04.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.063+0000 7f52e4800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc1133e0 con 0x7f52dc1023a0 2024-05-08T07:57:04.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.063+0000 7f52e4800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f52dc1136e0 con 0x7f52dc108410 2024-05-08T07:57:04.059 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:03 smithi194 ceph-mon[33679]: pgmap v2243: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 443 KiB/s wr, 193 op/s 2024-05-08T07:57:04.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.063+0000 7f52e1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 0x7f52dc1a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:04.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.063+0000 7f52e1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 0x7f52dc1a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59150/0 (socket says 172.21.15.70:59150) 2024-05-08T07:57:04.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.063+0000 7f52e1400700 1 -- 172.21.15.70:0/2804625218 learned_addr learned my addr 172.21.15.70:0/2804625218 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:57:04.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.063+0000 7f52e2800700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52dc108410 0x7f52dc10e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:04.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.064+0000 7f52e1400700 1 -- 172.21.15.70:0/2804625218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52dc108410 msgr2=0x7f52dc10e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:04.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.064+0000 7f52e1400700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52dc108410 0x7f52dc10e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.064+0000 7f52e1400700 1 -- 172.21.15.70:0/2804625218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52dc1023a0 msgr2=0x7f52dc1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:04.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.064+0000 7f52e1400700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52dc1023a0 0x7f52dc1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.064+0000 7f52e1400700 1 -- 172.21.15.70:0/2804625218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52dc10ed00 con 0x7f52dc102d60 2024-05-08T07:57:04.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.064+0000 7f52e1400700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 0x7f52dc1a0b20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d950 tx=0x7f52cc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:57:04.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.065+0000 7f52d2a00700 1 -- 172.21.15.70:0/2804625218 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc016070 con 0x7f52dc102d60 2024-05-08T07:57:04.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.065+0000 7f52d2a00700 1 -- 172.21.15.70:0/2804625218 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52cc010460 con 0x7f52dc102d60 2024-05-08T07:57:04.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.065+0000 7f52d2a00700 1 -- 172.21.15.70:0/2804625218 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00f620 con 0x7f52dc102d60 2024-05-08T07:57:04.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.065+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52dc10eff0 con 0x7f52dc102d60 2024-05-08T07:57:04.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.065+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52dc19c2f0 con 0x7f52dc102d60 2024-05-08T07:57:04.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.067+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52dc06a190 con 0x7f52dc102d60 2024-05-08T07:57:04.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.070+0000 7f52d2a00700 1 -- 172.21.15.70:0/2804625218 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f52cc019070 con 0x7f52dc102d60 2024-05-08T07:57:04.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.072+0000 7f52d2a00700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f52c80b2b40 0x7f52c80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:04.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.073+0000 7f52d2a00700 1 -- 172.21.15.70:0/2804625218 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(219..219 src has 1..219) ==== 9583+0+0 (secure 0 0 0) 0x7f52cc0e2520 con 0x7f52dc102d60 2024-05-08T07:57:04.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.075+0000 7f52e1e00700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f52c80b2b40 0x7f52c80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:04.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.076+0000 7f52e1e00700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f52c80b2b40 0x7f52c80b5000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f52d4007fb0 tx=0x7f52d4007570 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:57:04.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.080+0000 7f52d2a00700 1 -- 172.21.15.70:0/2804625218 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f52cc0a9ae0 con 0x7f52dc102d60 2024-05-08T07:57:04.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:03 smithi172 ceph-mon[33377]: pgmap v2243: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 443 KiB/s wr, 193 op/s 2024-05-08T07:57:04.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.552+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52dc19c550 con 0x7f52dc102d60 2024-05-08T07:57:04.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.553+0000 7f52d2a00700 1 -- 172.21.15.70:0/2804625218 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f52cc0a93e0 con 0x7f52dc102d60 2024-05-08T07:57:04.551 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:57:04.551 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:57:04.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.557+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f52c80b2b40 msgr2=0x7f52c80b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:04.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.558+0000 7f52e4800700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f52c80b2b40 0x7f52c80b5000 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f52d4007fb0 tx=0x7f52d4007570 comp rx=0 tx=0).stop 2024-05-08T07:57:04.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.558+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 msgr2=0x7f52dc1a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:04.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.558+0000 7f52e4800700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 0x7f52dc1a0b20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d950 tx=0x7f52cc00dd10 comp rx=0 tx=0).stop 2024-05-08T07:57:04.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.558+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 shutdown_connections 2024-05-08T07:57:04.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.558+0000 7f52e4800700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f52c80b2b40 0x7f52c80b5000 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.558+0000 7f52e4800700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52dc108410 0x7f52dc10e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.558+0000 7f52e4800700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f52dc1023a0 0x7f52dc1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.558+0000 7f52e4800700 1 --2- 172.21.15.70:0/2804625218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52dc102d60 0x7f52dc1a0b20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:04.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.558+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 >> 172.21.15.70:0/2804625218 conn(0x7f52dc079350 msgr2=0x7f52dc10fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:57:04.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.560+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 shutdown_connections 2024-05-08T07:57:04.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:04.561+0000 7f52e4800700 1 -- 172.21.15.70:0/2804625218 wait complete. 2024-05-08T07:57:04.572 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:57:05.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:04 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2804625218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:57:05.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:04 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2804625218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:57:05.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:04 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2804625218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:57:05.973 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/irqinit.o 2024-05-08T07:57:06.026 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 84.85 --await-for 42.0' 2024-05-08T07:57:06.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 84.85 --await-for 42.0 2024-05-08T07:57:06.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:05 smithi070 ceph-mon[29591]: pgmap v2244: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 641 KiB/s wr, 220 op/s 2024-05-08T07:57:06.102 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:05 smithi070 ceph-mon[29591]: osdmap e220: 12 total, 12 up, 12 in 2024-05-08T07:57:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:05 smithi172 ceph-mon[33377]: pgmap v2244: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 641 KiB/s wr, 220 op/s 2024-05-08T07:57:06.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:05 smithi172 ceph-mon[33377]: osdmap e220: 12 total, 12 up, 12 in 2024-05-08T07:57:06.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:05 smithi194 ceph-mon[33679]: pgmap v2244: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 641 KiB/s wr, 220 op/s 2024-05-08T07:57:06.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:05 smithi194 ceph-mon[33679]: osdmap e220: 12 total, 12 up, 12 in 2024-05-08T07:57:06.773 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:57:07.507 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/xattr_hurd.o 2024-05-08T07:57:07.831 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/rw.o 2024-05-08T07:57:07.942 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/xz/xz_dec_bcj.o 2024-05-08T07:57:08.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:07 smithi070 ceph-mon[29591]: pgmap v2246: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 478 KiB/s wr, 78 op/s 2024-05-08T07:57:08.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:07 smithi172 ceph-mon[33377]: pgmap v2246: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 478 KiB/s wr, 78 op/s 2024-05-08T07:57:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:07 smithi194 ceph-mon[33679]: pgmap v2246: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 478 KiB/s wr, 78 op/s 2024-05-08T07:57:10.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:09 smithi070 ceph-mon[29591]: pgmap v2247: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 478 KiB/s wr, 78 op/s 2024-05-08T07:57:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:09 smithi172 ceph-mon[33377]: pgmap v2247: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 478 KiB/s wr, 78 op/s 2024-05-08T07:57:10.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:09 smithi194 ceph-mon[33679]: pgmap v2247: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 478 KiB/s wr, 78 op/s 2024-05-08T07:57:10.708 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/error_report-traces.o 2024-05-08T07:57:12.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:11 smithi070 ceph-mon[29591]: pgmap v2248: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 550 KiB/s wr, 215 op/s 2024-05-08T07:57:12.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:11 smithi172 ceph-mon[33377]: pgmap v2248: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 550 KiB/s wr, 215 op/s 2024-05-08T07:57:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:11 smithi194 ceph-mon[33679]: pgmap v2248: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 550 KiB/s wr, 215 op/s 2024-05-08T07:57:12.475 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/power-traces.o 2024-05-08T07:57:12.829 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/xz/built-in.a 2024-05-08T07:57:13.278 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/jump_label.o 2024-05-08T07:57:13.341 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-iocost.o 2024-05-08T07:57:13.396 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/generic_mpih-lshift.o 2024-05-08T07:57:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:13 smithi070 ceph-mon[29591]: pgmap v2249: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 550 KiB/s wr, 215 op/s 2024-05-08T07:57:14.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:13 smithi070 ceph-mon[29591]: osdmap e221: 12 total, 12 up, 12 in 2024-05-08T07:57:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:13 smithi172 ceph-mon[33377]: pgmap v2249: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 550 KiB/s wr, 215 op/s 2024-05-08T07:57:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:13 smithi172 ceph-mon[33377]: osdmap e221: 12 total, 12 up, 12 in 2024-05-08T07:57:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:13 smithi194 ceph-mon[33679]: pgmap v2249: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 550 KiB/s wr, 215 op/s 2024-05-08T07:57:14.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:13 smithi194 ceph-mon[33679]: osdmap e221: 12 total, 12 up, 12 in 2024-05-08T07:57:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:15 smithi070 ceph-mon[29591]: pgmap v2251: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 505 KiB/s wr, 199 op/s 2024-05-08T07:57:16.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:15 smithi172 ceph-mon[33377]: pgmap v2251: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 505 KiB/s wr, 199 op/s 2024-05-08T07:57:16.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:15 smithi194 ceph-mon[33679]: pgmap v2251: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 505 KiB/s wr, 199 op/s 2024-05-08T07:57:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.492+0000 7fae9f400700 1 -- 172.21.15.70:0/3125881542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 msgr2=0x7fae98103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.492+0000 7fae9f400700 1 --2- 172.21.15.70:0/3125881542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 0x7fae98103b90 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0099c0 tx=0x7fae8c009cd0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.492+0000 7fae9f400700 1 -- 172.21.15.70:0/3125881542 shutdown_connections 2024-05-08T07:57:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.492+0000 7fae9f400700 1 --2- 172.21.15.70:0/3125881542 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae981087a0 0x7fae981103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.492+0000 7fae9f400700 1 --2- 172.21.15.70:0/3125881542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 0x7fae98103b90 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.492+0000 7fae9f400700 1 --2- 172.21.15.70:0/3125881542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae98104160 0x7fae981080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.492+0000 7fae9f400700 1 -- 172.21.15.70:0/3125881542 >> 172.21.15.70:0/3125881542 conn(0x7fae9807a570 msgr2=0x7fae9807a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:57:16.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.494+0000 7fae9f400700 1 -- 172.21.15.70:0/3125881542 shutdown_connections 2024-05-08T07:57:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.494+0000 7fae9f400700 1 -- 172.21.15.70:0/3125881542 wait complete. 2024-05-08T07:57:16.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.496+0000 7fae9f400700 1 Processor -- start 2024-05-08T07:57:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.496+0000 7fae9f400700 1 -- start start 2024-05-08T07:57:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae9f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 0x7fae980757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae9f400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae98104160 0x7fae98075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae9f400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae981087a0 0x7fae98076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae9f400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae98113590 con 0x7fae981037b0 2024-05-08T07:57:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae9f400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae98113410 con 0x7fae981087a0 2024-05-08T07:57:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae9f400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fae98113710 con 0x7fae98104160 2024-05-08T07:57:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae9ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 0x7fae980757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae9ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 0x7fae980757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55480/0 (socket says 172.21.15.70:55480) 2024-05-08T07:57:16.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae9ca00700 1 -- 172.21.15.70:0/4036541161 learned_addr learned my addr 172.21.15.70:0/4036541161 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:57:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.497+0000 7fae97e00700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae98104160 0x7fae98075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.498+0000 7fae9d400700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae981087a0 0x7fae98076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.498+0000 7fae9ca00700 1 -- 172.21.15.70:0/4036541161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae98104160 msgr2=0x7fae98075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.498+0000 7fae9ca00700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae98104160 0x7fae98075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.498+0000 7fae9ca00700 1 -- 172.21.15.70:0/4036541161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae981087a0 msgr2=0x7fae98076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.498+0000 7fae9ca00700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae981087a0 0x7fae98076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.498+0000 7fae9ca00700 1 -- 172.21.15.70:0/4036541161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae981a7f70 con 0x7fae981037b0 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.498+0000 7fae9d400700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae981087a0 0x7fae98076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.498+0000 7fae97e00700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae98104160 0x7fae98075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.498+0000 7fae9ca00700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 0x7fae980757a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fae8c006010 tx=0x7fae8c0056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.499+0000 7fae95600700 1 -- 172.21.15.70:0/4036541161 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c026070 con 0x7fae981037b0 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.499+0000 7fae9f400700 1 -- 172.21.15.70:0/4036541161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae981a8200 con 0x7fae981037b0 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.499+0000 7fae95600700 1 -- 172.21.15.70:0/4036541161 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae8c00f460 con 0x7fae981037b0 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.499+0000 7fae9f400700 1 -- 172.21.15.70:0/4036541161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae981a86b0 con 0x7fae981037b0 2024-05-08T07:57:16.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.499+0000 7fae95600700 1 -- 172.21.15.70:0/4036541161 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c009e60 con 0x7fae981037b0 2024-05-08T07:57:16.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.504+0000 7fae95600700 1 -- 172.21.15.70:0/4036541161 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fae8c029070 con 0x7fae981037b0 2024-05-08T07:57:16.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.506+0000 7fae95600700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fae800b2ba0 0x7fae800b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.506+0000 7fae95600700 1 -- 172.21.15.70:0/4036541161 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 9583+0+0 (secure 0 0 0) 0x7fae8c0e41d0 con 0x7fae981037b0 2024-05-08T07:57:16.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.507+0000 7fae97e00700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fae800b2ba0 0x7fae800b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.521+0000 7fae97e00700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fae800b2ba0 0x7fae800b5060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae98103090 tx=0x7fae84009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:57:16.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.523+0000 7faea9cdcb80 1 Processor -- start 2024-05-08T07:57:16.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.524+0000 7faea9cdcb80 1 -- start start 2024-05-08T07:57:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.524+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f679240 0x557c5f679620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.524+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 0x557c5f673c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.524+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f680000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.524+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557c5f5c5bb0 con 0x557c5f6741d0 2024-05-08T07:57:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.524+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557c5f5638f0 con 0x557c5f673810 2024-05-08T07:57:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.524+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557c5f5c1b70 con 0x557c5f679240 2024-05-08T07:57:16.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.525+0000 7fae9d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f680000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.525+0000 7fae9ca00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f679240 0x557c5f679620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.525+0000 7fae9d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f680000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55494/0 (socket says 172.21.15.70:55494) 2024-05-08T07:57:16.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.525+0000 7fae9d400700 1 -- 172.21.15.70:0/519021050 learned_addr learned my addr 172.21.15.70:0/519021050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:57:16.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.525+0000 7fae97e00700 1 --2- 172.21.15.70:0/519021050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 0x557c5f673c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.526+0000 7fae9ca00700 1 -- 172.21.15.70:0/519021050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 msgr2=0x557c5f673c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:57:16.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.526+0000 7fae9ca00700 1 --2- 172.21.15.70:0/519021050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 0x557c5f673c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.526+0000 7fae9ca00700 1 -- 172.21.15.70:0/519021050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 msgr2=0x557c5f680000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:57:16.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.526+0000 7fae9ca00700 1 --2- 172.21.15.70:0/519021050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f680000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.526+0000 7fae9ca00700 1 -- 172.21.15.70:0/519021050 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5f512a60 con 0x557c5f679240 2024-05-08T07:57:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.526+0000 7fae9d400700 1 --2- 172.21.15.70:0/519021050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f680000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:57:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.527+0000 7fae9ca00700 1 --2- 172.21.15.70:0/519021050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f679240 0x557c5f679620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0e14a0 tx=0x7fae8c0aabd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9efe54109a8b6e8c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:57:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.527+0000 7fae8a000700 1 -- 172.21.15.70:0/519021050 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0af470 con 0x557c5f679240 2024-05-08T07:57:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.527+0000 7fae8a000700 1 -- 172.21.15.70:0/519021050 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae8c0b3e90 con 0x557c5f679240 2024-05-08T07:57:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.527+0000 7fae8a000700 1 -- 172.21.15.70:0/519021050 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8c0b3a00 con 0x557c5f679240 2024-05-08T07:57:16.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.528+0000 7faea9cdcb80 1 -- 172.21.15.70:0/519021050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f679240 msgr2=0x557c5f679620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:16.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.528+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/519021050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f679240 0x557c5f679620 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0e14a0 tx=0x7fae8c0aabd0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.528+0000 7faea9cdcb80 1 -- 172.21.15.70:0/519021050 shutdown_connections 2024-05-08T07:57:16.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.528+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/519021050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f680000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.528+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/519021050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f679240 0x557c5f679620 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.528+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/519021050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 0x557c5f673c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.528+0000 7faea9cdcb80 1 -- 172.21.15.70:0/519021050 >> 172.21.15.70:0/519021050 conn(0x557c5f5eb860 msgr2=0x557c5f66e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:57:16.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.529+0000 7faea9cdcb80 1 -- 172.21.15.70:0/519021050 shutdown_connections 2024-05-08T07:57:16.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.529+0000 7faea9cdcb80 1 -- 172.21.15.70:0/519021050 wait complete. 2024-05-08T07:57:16.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.530+0000 7faea9cdcb80 1 -- start start 2024-05-08T07:57:16.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.530+0000 7faea9cdcb80 1 Processor -- start 2024-05-08T07:57:16.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 0x557c5f67fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f6741d0 0x557c5f67cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f67d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557c5f679d50 con 0x557c5f679240 2024-05-08T07:57:16.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557c5f52bcb0 con 0x557c5f6741d0 2024-05-08T07:57:16.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557c5f680540 con 0x557c5f673810 2024-05-08T07:57:16.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7faea9cdcb80 10 client.0 _ll_register_callbacks cb 0x557c5f56ce00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7fae9d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f67d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7fae9d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f67d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55506/0 (socket says 172.21.15.70:55506) 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7fae9d400700 1 -- 172.21.15.70:0/3080556958 learned_addr learned my addr 172.21.15.70:0/3080556958 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7fae97e00700 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f6741d0 0x557c5f67cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.531+0000 7fae9ca00700 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 0x557c5f67fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.532+0000 7fae9d400700 1 -- 172.21.15.70:0/3080556958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 msgr2=0x557c5f67fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.532+0000 7fae9d400700 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 0x557c5f67fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.532+0000 7fae9d400700 1 -- 172.21.15.70:0/3080556958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f6741d0 msgr2=0x557c5f67cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.532+0000 7fae9d400700 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f6741d0 0x557c5f67cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.532+0000 7fae9d400700 1 -- 172.21.15.70:0/3080556958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c5f58b5b0 con 0x557c5f679240 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.532+0000 7fae9d400700 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f67d4b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fae90007b70 tx=0x7fae90007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5514c7813a1a4dce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:57:16.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.532+0000 7fae7ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:57:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.533+0000 7fae7ea00700 1 -- 172.21.15.70:0/3080556958 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90010800 con 0x557c5f679240 2024-05-08T07:57:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.533+0000 7fae7ea00700 1 -- 172.21.15.70:0/3080556958 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(221..221 src has 1..221) ==== 9583+0+0 (secure 0 0 0) 0x7fae900109a0 con 0x557c5f679240 2024-05-08T07:57:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.533+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3080556958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae8c0b3e90 con 0x557c5f679240 2024-05-08T07:57:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.533+0000 7fae7ea00700 1 -- 172.21.15.70:0/3080556958 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fae90024050 con 0x557c5f679240 2024-05-08T07:57:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.533+0000 7faea9cdcb80 10 client.17397 fetch_fsmap learned FSMap version 42 2024-05-08T07:57:16.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.533+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3080556958 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557c5f68ab50 con 0x557c5f679240 2024-05-08T07:57:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.534+0000 7fae7ea00700 1 -- 172.21.15.70:0/3080556958 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae8c0b3e90 con 0x557c5f679240 2024-05-08T07:57:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.534+0000 7fae7ea00700 1 -- 172.21.15.70:0/3080556958 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fae900153e0 con 0x557c5f679240 2024-05-08T07:57:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.534+0000 7faea9cdcb80 10 client.17397 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:57:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.534+0000 7faea9cdcb80 10 client.17397 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:57:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.534+0000 7faea9cdcb80 20 client.17397 populate_metadata read hostname 'smithi070' 2024-05-08T07:57:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.534+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557c5f68d1e0 0x557c5f68f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.534+0000 7faea9cdcb80 4 client.17397 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:57:16.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.534+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3080556958 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c5f6402d0 con 0x557c5f68d1e0 2024-05-08T07:57:16.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.535+0000 7fae9ca00700 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557c5f68d1e0 0x557c5f68f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.536+0000 7fae7ea00700 10 client.17397 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:57:16.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.536+0000 7fae9ca00700 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557c5f68d1e0 0x557c5f68f660 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8dd70b920b50179 server_cookie=b68a97382f746844 in_seq=0 out_seq=0 2024-05-08T07:57:16.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.539+0000 7fae7ea00700 1 -- 172.21.15.70:0/3080556958 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557c5f6402d0 con 0x557c5f68d1e0 2024-05-08T07:57:16.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.539+0000 7fae7ea00700 10 client.17397 handle_command_reply: tid=0 2024-05-08T07:57:16.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.539+0000 7faea9cdcb80 1 client.17397 shutdown 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3080556958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 msgr2=0x557c5f67d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f67d4b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fae90007b70 tx=0x7fae90007f30 comp rx=0 tx=0).stop 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3080556958 shutdown_connections 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557c5f68d1e0 0x557c5f68f660 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f67d4b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 0x557c5f67fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3080556958 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f6741d0 0x557c5f67cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3080556958 >> 172.21.15.70:0/3080556958 conn(0x557c5f5eb860 msgr2=0x557c5f668bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7fae7ea00700 0 client.17397 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3080556958 shutdown_connections 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3080556958 wait complete. 2024-05-08T07:57:16.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.540+0000 7faea9cdcb80 20 client.17397 trim_cache size 0 max 16384 2024-05-08T07:57:16.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.577+0000 7faea9cdcb80 1 Processor -- start 2024-05-08T07:57:16.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.577+0000 7faea9cdcb80 1 -- start start 2024-05-08T07:57:16.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.577+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 0x557c5f677330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.577+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f6788a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.577+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f679240 0x557c5f694f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.577+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae780118f0 con 0x557c5f6741d0 2024-05-08T07:57:16.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.577+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae7800f180 con 0x557c5f679240 2024-05-08T07:57:16.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.577+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fae7800cff0 con 0x557c5f673810 2024-05-08T07:57:16.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.578+0000 7fae97e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f6788a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.578+0000 7fae97e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f6788a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55522/0 (socket says 172.21.15.70:55522) 2024-05-08T07:57:16.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.578+0000 7fae97e00700 1 -- 172.21.15.70:0/3174158865 learned_addr learned my addr 172.21.15.70:0/3174158865 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:57:16.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.578+0000 7fae9ca00700 1 --2- 172.21.15.70:0/3174158865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 0x557c5f677330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.579+0000 7fae9d400700 1 --2- 172.21.15.70:0/3174158865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f679240 0x557c5f694f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.579+0000 7fae97e00700 1 -- 172.21.15.70:0/3174158865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 msgr2=0x557c5f677330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:57:16.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.579+0000 7fae97e00700 1 --2- 172.21.15.70:0/3174158865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 0x557c5f677330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.579+0000 7fae97e00700 1 -- 172.21.15.70:0/3174158865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f679240 msgr2=0x557c5f694f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:57:16.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.579+0000 7fae97e00700 1 --2- 172.21.15.70:0/3174158865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f679240 0x557c5f694f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.579+0000 7fae97e00700 1 -- 172.21.15.70:0/3174158865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5f678e80 con 0x557c5f6741d0 2024-05-08T07:57:16.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.580+0000 7fae97e00700 1 --2- 172.21.15.70:0/3174158865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f6788a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fae98077230 tx=0x7fae84014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02812a2cd2200f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:57:16.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.580+0000 7fae89600700 1 -- 172.21.15.70:0/3174158865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae840129f0 con 0x557c5f6741d0 2024-05-08T07:57:16.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.580+0000 7fae89600700 1 -- 172.21.15.70:0/3174158865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae84012b90 con 0x557c5f6741d0 2024-05-08T07:57:16.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.580+0000 7fae89600700 1 -- 172.21.15.70:0/3174158865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae84020690 con 0x557c5f6741d0 2024-05-08T07:57:16.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.581+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3174158865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 msgr2=0x557c5f6788a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:16.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.581+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3174158865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f6788a0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fae98077230 tx=0x7fae84014000 comp rx=0 tx=0).stop 2024-05-08T07:57:16.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.582+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3174158865 shutdown_connections 2024-05-08T07:57:16.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.582+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3174158865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f679240 0x557c5f694f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.582+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3174158865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f673810 0x557c5f677330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.582+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3174158865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f6741d0 0x557c5f6788a0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.582+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3174158865 >> 172.21.15.70:0/3174158865 conn(0x557c5f5eb860 msgr2=0x557c5f673090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:57:16.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.582+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3174158865 shutdown_connections 2024-05-08T07:57:16.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.582+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3174158865 wait complete. 2024-05-08T07:57:16.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.582+0000 7faea9cdcb80 1 -- start start 2024-05-08T07:57:16.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.583+0000 7faea9cdcb80 1 Processor -- start 2024-05-08T07:57:16.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.583+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 0x557c5f6829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.583+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f6741d0 0x557c5f682f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.583+0000 7faea9cdcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f6f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.583+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae7800d640 con 0x557c5f679240 2024-05-08T07:57:16.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae7800eab0 con 0x557c5f673810 2024-05-08T07:57:16.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7faea9cdcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fae7800dd10 con 0x557c5f6741d0 2024-05-08T07:57:16.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7fae9d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f6f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7fae9d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f6f7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55524/0 (socket says 172.21.15.70:55524) 2024-05-08T07:57:16.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7fae9d400700 1 -- 172.21.15.70:0/3333895668 learned_addr learned my addr 172.21.15.70:0/3333895668 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:57:16.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7fae9ca00700 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 0x557c5f6829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7faea9cdcb80 10 client.0 _ll_register_callbacks cb 0x557c5f56ce00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:57:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7fae97e00700 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f6741d0 0x557c5f682f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7fae9d400700 1 -- 172.21.15.70:0/3333895668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f6741d0 msgr2=0x557c5f682f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:57:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.584+0000 7fae9d400700 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f6741d0 0x557c5f682f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.585+0000 7fae9d400700 1 -- 172.21.15.70:0/3333895668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 msgr2=0x557c5f6829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:57:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.585+0000 7fae9d400700 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 0x557c5f6829e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.585+0000 7fae9d400700 1 -- 172.21.15.70:0/3333895668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c5f6f8030 con 0x557c5f679240 2024-05-08T07:57:16.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.585+0000 7fae9ca00700 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 0x557c5f6829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:57:16.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.585+0000 7fae9d400700 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f6f7af0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fae900157b0 tx=0x7fae90015610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1daf76d35e86f3bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:57:16.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.585+0000 7fae7ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:57:16.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.585+0000 7fae7ea00700 1 -- 172.21.15.70:0/3333895668 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90004a30 con 0x557c5f679240 2024-05-08T07:57:16.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.585+0000 7fae7ea00700 1 -- 172.21.15.70:0/3333895668 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(221..221 src has 1..221) ==== 9583+0+0 (secure 0 0 0) 0x7fae90002030 con 0x557c5f679240 2024-05-08T07:57:16.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.585+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3333895668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae84012b90 con 0x557c5f679240 2024-05-08T07:57:16.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.586+0000 7fae7ea00700 1 -- 172.21.15.70:0/3333895668 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fae90038050 con 0x557c5f679240 2024-05-08T07:57:16.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.586+0000 7faea9cdcb80 10 client.17403 fetch_fsmap learned FSMap version 42 2024-05-08T07:57:16.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.586+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3333895668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557c5f6f92b0 con 0x557c5f679240 2024-05-08T07:57:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.586+0000 7fae7ea00700 1 -- 172.21.15.70:0/3333895668 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae84012b90 con 0x557c5f679240 2024-05-08T07:57:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.587+0000 7fae7ea00700 1 -- 172.21.15.70:0/3333895668 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fae90010840 con 0x557c5f679240 2024-05-08T07:57:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.587+0000 7faea9cdcb80 10 client.17403 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:57:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.587+0000 7faea9cdcb80 10 client.17403 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:57:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.587+0000 7faea9cdcb80 20 client.17403 populate_metadata read hostname 'smithi070' 2024-05-08T07:57:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.587+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557c5f6f9ab0 0x557c5f6fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:57:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.587+0000 7faea9cdcb80 4 client.17403 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.85, "await_for": 42.0}] 2024-05-08T07:57:16.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.587+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3333895668 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.85, "await_for": 42.0}) -- 0x557c5f5d3590 con 0x557c5f6f9ab0 2024-05-08T07:57:16.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.588+0000 7fae9ca00700 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557c5f6f9ab0 0x557c5f6fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:57:16.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.589+0000 7fae9ca00700 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557c5f6f9ab0 0x557c5f6fbed0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a859d46aa4483 server_cookie=2f443a5993955e27 in_seq=0 out_seq=0 2024-05-08T07:57:16.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:16.589+0000 7fae7ea00700 10 client.17403 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:57:17.351 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/xattr_trusted.o 2024-05-08T07:57:18.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:17 smithi172 ceph-mon[33377]: pgmap v2252: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 497 KiB/s wr, 196 op/s 2024-05-08T07:57:18.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:57:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:17 smithi194 ceph-mon[33679]: pgmap v2252: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 497 KiB/s wr, 196 op/s 2024-05-08T07:57:18.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:57:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:17 smithi070 ceph-mon[29591]: pgmap v2252: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 497 KiB/s wr, 196 op/s 2024-05-08T07:57:18.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:57:19.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:57:19.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:57:19.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:57:19.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:57:19.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:57:19.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:57:19.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:57:19.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:57:19.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:57:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:19 smithi172 ceph-mon[33377]: pgmap v2253: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 497 KiB/s wr, 196 op/s 2024-05-08T07:57:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:19 smithi194 ceph-mon[33679]: pgmap v2253: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 497 KiB/s wr, 196 op/s 2024-05-08T07:57:20.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:19 smithi070 ceph-mon[29591]: pgmap v2253: 129 pgs: 129 active+clean; 1.9 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 497 KiB/s wr, 196 op/s 2024-05-08T07:57:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:21 smithi172 ceph-mon[33377]: pgmap v2254: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 306 KiB/s wr, 98 op/s 2024-05-08T07:57:22.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:21 smithi194 ceph-mon[33679]: pgmap v2254: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 306 KiB/s wr, 98 op/s 2024-05-08T07:57:22.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:21 smithi070 ceph-mon[29591]: pgmap v2254: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 306 KiB/s wr, 98 op/s 2024-05-08T07:57:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:23 smithi172 ceph-mon[33377]: pgmap v2255: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 306 KiB/s wr, 98 op/s 2024-05-08T07:57:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:23 smithi194 ceph-mon[33679]: pgmap v2255: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 306 KiB/s wr, 98 op/s 2024-05-08T07:57:24.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:23 smithi070 ceph-mon[29591]: pgmap v2255: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 306 KiB/s wr, 98 op/s 2024-05-08T07:57:26.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:25 smithi172 ceph-mon[33377]: pgmap v2256: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 455 KiB/s wr, 93 op/s 2024-05-08T07:57:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:25 smithi194 ceph-mon[33679]: pgmap v2256: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 455 KiB/s wr, 93 op/s 2024-05-08T07:57:26.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:25 smithi070 ceph-mon[29591]: pgmap v2256: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 455 KiB/s wr, 93 op/s 2024-05-08T07:57:28.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:27 smithi172 ceph-mon[33377]: pgmap v2257: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 263 KiB/s wr, 75 op/s 2024-05-08T07:57:28.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:27 smithi194 ceph-mon[33679]: pgmap v2257: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 263 KiB/s wr, 75 op/s 2024-05-08T07:57:28.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:27 smithi070 ceph-mon[29591]: pgmap v2257: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 263 KiB/s wr, 75 op/s 2024-05-08T07:57:30.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:29 smithi194 ceph-mon[33679]: pgmap v2258: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 263 KiB/s wr, 75 op/s 2024-05-08T07:57:30.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:29 smithi070 ceph-mon[29591]: pgmap v2258: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 263 KiB/s wr, 75 op/s 2024-05-08T07:57:30.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:29 smithi172 ceph-mon[33377]: pgmap v2258: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 263 KiB/s wr, 75 op/s 2024-05-08T07:57:32.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:31 smithi194 ceph-mon[33679]: pgmap v2259: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 287 KiB/s wr, 78 op/s 2024-05-08T07:57:32.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:31 smithi070 ceph-mon[29591]: pgmap v2259: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 287 KiB/s wr, 78 op/s 2024-05-08T07:57:32.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:31 smithi172 ceph-mon[33377]: pgmap v2259: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 287 KiB/s wr, 78 op/s 2024-05-08T07:57:34.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:33 smithi194 ceph-mon[33679]: pgmap v2260: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 185 KiB/s wr, 6 op/s 2024-05-08T07:57:34.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:33 smithi070 ceph-mon[29591]: pgmap v2260: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 185 KiB/s wr, 6 op/s 2024-05-08T07:57:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:33 smithi172 ceph-mon[33377]: pgmap v2260: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 185 KiB/s wr, 6 op/s 2024-05-08T07:57:36.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:35 smithi194 ceph-mon[33679]: pgmap v2261: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 211 KiB/s wr, 10 op/s 2024-05-08T07:57:36.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:35 smithi070 ceph-mon[29591]: pgmap v2261: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 211 KiB/s wr, 10 op/s 2024-05-08T07:57:36.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:35 smithi172 ceph-mon[33377]: pgmap v2261: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 211 KiB/s wr, 10 op/s 2024-05-08T07:57:37.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:37 smithi194 ceph-mon[33679]: pgmap v2262: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T07:57:37.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:37 smithi070 ceph-mon[29591]: pgmap v2262: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T07:57:37.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:37 smithi172 ceph-mon[33377]: pgmap v2262: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T07:57:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:39 smithi194 ceph-mon[33679]: pgmap v2263: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T07:57:40.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:39 smithi070 ceph-mon[29591]: pgmap v2263: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T07:57:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:39 smithi172 ceph-mon[33377]: pgmap v2263: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T07:57:40.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.340+0000 7fae7ea00700 1 -- 172.21.15.70:0/3333895668 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x557c5f5d3590 con 0x557c5f6f9ab0 2024-05-08T07:57:40.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.341+0000 7fae7ea00700 10 client.17403 handle_command_reply: tid=0 2024-05-08T07:57:40.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.341+0000 7faea9cdcb80 1 client.17403 shutdown 2024-05-08T07:57:40.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.341+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3333895668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 msgr2=0x557c5f6f7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:40.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.341+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f6f7af0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fae900157b0 tx=0x7fae90015610 comp rx=0 tx=0).stop 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.342+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3333895668 shutdown_connections 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.342+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557c5f6f9ab0 0x557c5f6fbed0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.342+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557c5f679240 0x557c5f6f7af0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.342+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557c5f673810 0x557c5f6829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.342+0000 7faea9cdcb80 1 --2- 172.21.15.70:0/3333895668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557c5f6741d0 0x557c5f682f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.342+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3333895668 >> 172.21.15.70:0/3333895668 conn(0x557c5f5eb860 msgr2=0x557c5f668340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.342+0000 7fae7ea00700 0 client.17403 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.342+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3333895668 shutdown_connections 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.343+0000 7faea9cdcb80 1 -- 172.21.15.70:0/3333895668 wait complete. 2024-05-08T07:57:40.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.343+0000 7faea9cdcb80 20 client.17403 trim_cache size 0 max 16384 2024-05-08T07:57:40.338 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:57:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:57:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:57:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 170, 2024-05-08T07:57:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:57:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "a20cbf99": { 2024-05-08T07:57:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 170, 2024-05-08T07:57:40.338 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.8, 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:57:40.339 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:57:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:57:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:57:40.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:57:40.340 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:57:40.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 -- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fae800b2ba0 msgr2=0x7fae800b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fae800b2ba0 0x7fae800b5060 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fae98103090 tx=0x7fae84009260 comp rx=0 tx=0).stop 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 -- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 msgr2=0x7fae980757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 0x7fae980757a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fae8c006010 tx=0x7fae8c0056a0 comp rx=0 tx=0).stop 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 -- 172.21.15.70:0/4036541161 shutdown_connections 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fae800b2ba0 0x7fae800b5060 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae981087a0 0x7fae98076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae981037b0 0x7fae980757a0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 --2- 172.21.15.70:0/4036541161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae98104160 0x7fae98075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 -- 172.21.15.70:0/4036541161 >> 172.21.15.70:0/4036541161 conn(0x7fae9807a570 msgr2=0x7fae98101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.345+0000 7fae9f400700 1 -- 172.21.15.70:0/4036541161 shutdown_connections 2024-05-08T07:57:40.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:57:40.346+0000 7fae9f400700 1 -- 172.21.15.70:0/4036541161 wait complete. 2024-05-08T07:57:41.208 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a20cbf99', quiesce took 40.3 seconds. Will release after: 24.85 2024-05-08T07:57:42.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:41 smithi070 ceph-mon[29591]: pgmap v2264: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 9 op/s 2024-05-08T07:57:42.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:41 smithi172 ceph-mon[33377]: pgmap v2264: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 9 op/s 2024-05-08T07:57:42.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:41 smithi194 ceph-mon[33679]: pgmap v2264: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 75 KiB/s wr, 9 op/s 2024-05-08T07:57:44.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:43 smithi070 ceph-mon[29591]: pgmap v2265: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2024-05-08T07:57:44.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:43 smithi172 ceph-mon[33377]: pgmap v2265: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2024-05-08T07:57:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:43 smithi194 ceph-mon[33679]: pgmap v2265: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 6 op/s 2024-05-08T07:57:46.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:45 smithi070 ceph-mon[29591]: pgmap v2266: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 10 op/s 2024-05-08T07:57:46.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:45 smithi172 ceph-mon[33377]: pgmap v2266: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 10 op/s 2024-05-08T07:57:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:45 smithi194 ceph-mon[33679]: pgmap v2266: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 10 op/s 2024-05-08T07:57:48.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:47 smithi070 ceph-mon[29591]: pgmap v2267: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:57:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:47 smithi172 ceph-mon[33377]: pgmap v2267: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:57:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:47 smithi194 ceph-mon[33679]: pgmap v2267: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:57:50.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:49 smithi070 ceph-mon[29591]: pgmap v2268: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:57:50.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:49 smithi172 ceph-mon[33377]: pgmap v2268: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:57:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:49 smithi194 ceph-mon[33679]: pgmap v2268: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T07:57:52.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:51 smithi070 ceph-mon[29591]: pgmap v2269: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 10 op/s 2024-05-08T07:57:52.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:51 smithi172 ceph-mon[33377]: pgmap v2269: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 10 op/s 2024-05-08T07:57:52.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:51 smithi194 ceph-mon[33679]: pgmap v2269: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 10 op/s 2024-05-08T07:57:54.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:53 smithi070 ceph-mon[29591]: pgmap v2270: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2024-05-08T07:57:54.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:53 smithi172 ceph-mon[33377]: pgmap v2270: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2024-05-08T07:57:54.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:53 smithi194 ceph-mon[33679]: pgmap v2270: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 8 op/s 2024-05-08T07:57:56.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:55 smithi070 ceph-mon[29591]: pgmap v2271: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 10 op/s 2024-05-08T07:57:56.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:55 smithi172 ceph-mon[33377]: pgmap v2271: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 10 op/s 2024-05-08T07:57:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:55 smithi194 ceph-mon[33679]: pgmap v2271: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 10 op/s 2024-05-08T07:57:58.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:57 smithi070 ceph-mon[29591]: pgmap v2272: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2024-05-08T07:57:58.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:57 smithi172 ceph-mon[33377]: pgmap v2272: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2024-05-08T07:57:58.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:57 smithi194 ceph-mon[33679]: pgmap v2272: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2024-05-08T07:58:00.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:57:59 smithi070 ceph-mon[29591]: pgmap v2273: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2024-05-08T07:58:00.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:57:59 smithi172 ceph-mon[33377]: pgmap v2273: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2024-05-08T07:58:00.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:57:59 smithi194 ceph-mon[33679]: pgmap v2273: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 6 op/s 2024-05-08T07:58:02.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:01 smithi070 ceph-mon[29591]: pgmap v2274: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-08T07:58:02.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:01 smithi172 ceph-mon[33377]: pgmap v2274: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-08T07:58:02.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:01 smithi194 ceph-mon[33679]: pgmap v2274: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-08T07:58:04.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:03 smithi070 ceph-mon[29591]: pgmap v2275: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T07:58:04.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:03 smithi172 ceph-mon[33377]: pgmap v2275: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T07:58:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:03 smithi194 ceph-mon[33679]: pgmap v2275: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T07:58:06.059 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:58:06.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:05 smithi070 ceph-mon[29591]: pgmap v2276: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-05-08T07:58:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:05 smithi172 ceph-mon[33377]: pgmap v2276: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-05-08T07:58:06.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:05 smithi194 ceph-mon[33679]: pgmap v2276: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-05-08T07:58:06.526 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:58:08.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:07 smithi070 ceph-mon[29591]: pgmap v2277: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:58:08.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:07 smithi172 ceph-mon[33377]: pgmap v2277: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:58:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:07 smithi194 ceph-mon[33679]: pgmap v2277: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:58:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.109+0000 7f1385000700 1 -- 172.21.15.70:0/2084132262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010a490 msgr2=0x7f13801169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.109+0000 7f1385000700 1 --2- 172.21.15.70:0/2084132262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010a490 0x7f13801169a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f137800b0a0 tx=0x7f137800b3b0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.110+0000 7f1385000700 1 -- 172.21.15.70:0/2084132262 shutdown_connections 2024-05-08T07:58:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.110+0000 7f1385000700 1 --2- 172.21.15.70:0/2084132262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010a490 0x7f13801169a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.110+0000 7f1385000700 1 --2- 172.21.15.70:0/2084132262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f138010fb60 0x7f138010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.110+0000 7f1385000700 1 --2- 172.21.15.70:0/2084132262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1380109ad0 0x7f1380109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.110+0000 7f1385000700 1 -- 172.21.15.70:0/2084132262 >> 172.21.15.70:0/2084132262 conn(0x7f1380076c70 msgr2=0x7f1380079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.110+0000 7f1385000700 1 -- 172.21.15.70:0/2084132262 shutdown_connections 2024-05-08T07:58:09.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.110+0000 7f1385000700 1 -- 172.21.15.70:0/2084132262 wait complete. 2024-05-08T07:58:09.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.111+0000 7f1385000700 1 Processor -- start 2024-05-08T07:58:09.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.111+0000 7f1385000700 1 -- start start 2024-05-08T07:58:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f1385000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1380109ad0 0x7f138019ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f1385000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f138010a490 0x7f13801a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f1385000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010fb60 0x7f13801a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f1385000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1380119bd0 con 0x7f138010fb60 2024-05-08T07:58:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f1385000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1380119a50 con 0x7f138010a490 2024-05-08T07:58:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f1385000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1380119d50 con 0x7f1380109ad0 2024-05-08T07:58:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f137e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010fb60 0x7f13801a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f137e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010fb60 0x7f13801a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37232/0 (socket says 172.21.15.70:37232) 2024-05-08T07:58:09.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f137e800700 1 -- 172.21.15.70:0/1700681374 learned_addr learned my addr 172.21.15.70:0/1700681374 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:09.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f137d400700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f138010a490 0x7f13801a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:09.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.112+0000 7f137de00700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1380109ad0 0x7f138019ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:09.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f137e800700 1 -- 172.21.15.70:0/1700681374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1380109ad0 msgr2=0x7f138019ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:09.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f137e800700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1380109ad0 0x7f138019ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f137e800700 1 -- 172.21.15.70:0/1700681374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f138010a490 msgr2=0x7f13801a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:09.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f137e800700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f138010a490 0x7f13801a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f137e800700 1 -- 172.21.15.70:0/1700681374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13801a4ff0 con 0x7f138010fb60 2024-05-08T07:58:09.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f137e800700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010fb60 0x7f13801a48b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f137800b070 tx=0x7f1378004e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:09.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f1376a00700 1 -- 172.21.15.70:0/1700681374 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378021070 con 0x7f138010fb60 2024-05-08T07:58:09.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f1376a00700 1 -- 172.21.15.70:0/1700681374 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1378007c00 con 0x7f138010fb60 2024-05-08T07:58:09.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13801a5280 con 0x7f138010fb60 2024-05-08T07:58:09.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.113+0000 7f1376a00700 1 -- 172.21.15.70:0/1700681374 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378004780 con 0x7f138010fb60 2024-05-08T07:58:09.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.114+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13801acb60 con 0x7f138010fb60 2024-05-08T07:58:09.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.115+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138006a190 con 0x7f138010fb60 2024-05-08T07:58:09.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.117+0000 7f1376a00700 1 -- 172.21.15.70:0/1700681374 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1378003a00 con 0x7f138010fb60 2024-05-08T07:58:09.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.120+0000 7f1376a00700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13640b29f0 0x7f13640b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:09.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.120+0000 7f1376a00700 1 -- 172.21.15.70:0/1700681374 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(221..221 src has 1..221) ==== 9583+0+0 (secure 0 0 0) 0x7f137800f020 con 0x7f138010fb60 2024-05-08T07:58:09.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.120+0000 7f137de00700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13640b29f0 0x7f13640b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:09.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.121+0000 7f137de00700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13640b29f0 0x7f13640b4eb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1370005fd0 tx=0x7f137000af20 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:09.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.123+0000 7f1376a00700 1 -- 172.21.15.70:0/1700681374 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f137802a020 con 0x7f138010fb60 2024-05-08T07:58:09.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.405+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f138002e510 con 0x7f138010fb60 2024-05-08T07:58:09.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.406+0000 7f1376a00700 1 -- 172.21.15.70:0/1700681374 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f137802e3e0 con 0x7f138010fb60 2024-05-08T07:58:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:58:09.402 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13640b29f0 msgr2=0x7f13640b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13640b29f0 0x7f13640b4eb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1370005fd0 tx=0x7f137000af20 comp rx=0 tx=0).stop 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010fb60 msgr2=0x7f13801a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010fb60 0x7f13801a48b0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f137800b070 tx=0x7f1378004e00 comp rx=0 tx=0).stop 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 shutdown_connections 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13640b29f0 0x7f13640b4eb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f138010fb60 0x7f13801a48b0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1380109ad0 0x7f138019ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 --2- 172.21.15.70:0/1700681374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f138010a490 0x7f13801a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 >> 172.21.15.70:0/1700681374 conn(0x7f1380076c70 msgr2=0x7f13800771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 shutdown_connections 2024-05-08T07:58:09.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:09.410+0000 7f1385000700 1 -- 172.21.15.70:0/1700681374 wait complete. 2024-05-08T07:58:09.406 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:58:10.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:09 smithi194 ceph-mon[33679]: pgmap v2278: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:58:10.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1700681374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:58:10.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:09 smithi070 ceph-mon[29591]: pgmap v2278: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:58:10.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1700681374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:58:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:09 smithi172 ceph-mon[33377]: pgmap v2278: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 58 KiB/s wr, 22 op/s 2024-05-08T07:58:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1700681374' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:58:10.194 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id a20cbf99 --release --await' 2024-05-08T07:58:10.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id a20cbf99 --release --await 2024-05-08T07:58:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:58:12.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:11 smithi194 ceph-mon[33679]: pgmap v2279: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-05-08T07:58:12.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:11 smithi194 ceph-mon[33679]: osdmap e222: 12 total, 12 up, 12 in 2024-05-08T07:58:12.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:11 smithi070 ceph-mon[29591]: pgmap v2279: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-05-08T07:58:12.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:11 smithi070 ceph-mon[29591]: osdmap e222: 12 total, 12 up, 12 in 2024-05-08T07:58:12.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:11 smithi172 ceph-mon[33377]: pgmap v2279: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 58 KiB/s wr, 25 op/s 2024-05-08T07:58:12.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:11 smithi172 ceph-mon[33377]: osdmap e222: 12 total, 12 up, 12 in 2024-05-08T07:58:14.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:13 smithi194 ceph-mon[33679]: pgmap v2281: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:58:14.050 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:13 smithi070 ceph-mon[29591]: pgmap v2281: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:58:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:13 smithi172 ceph-mon[33377]: pgmap v2281: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T07:58:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.303+0000 7fe312000700 1 -- 172.21.15.70:0/1516852503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c0756d0 msgr2=0x7fe30c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.303+0000 7fe312000700 1 --2- 172.21.15.70:0/1516852503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c0756d0 0x7fe30c075ab0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009990 tx=0x7fe2fc009ca0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.303+0000 7fe312000700 1 -- 172.21.15.70:0/1516852503 shutdown_connections 2024-05-08T07:58:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.303+0000 7fe312000700 1 --2- 172.21.15.70:0/1516852503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c10fea0 0x7fe30c112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.303+0000 7fe312000700 1 --2- 172.21.15.70:0/1516852503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c0756d0 0x7fe30c075ab0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.303+0000 7fe312000700 1 --2- 172.21.15.70:0/1516852503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe30c075ff0 0x7fe30c10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.304+0000 7fe312000700 1 -- 172.21.15.70:0/1516852503 >> 172.21.15.70:0/1516852503 conn(0x7fe30c07a650 msgr2=0x7fe30c07aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.304+0000 7fe312000700 1 -- 172.21.15.70:0/1516852503 shutdown_connections 2024-05-08T07:58:14.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.304+0000 7fe312000700 1 -- 172.21.15.70:0/1516852503 wait complete. 2024-05-08T07:58:14.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.305+0000 7fe312000700 1 Processor -- start 2024-05-08T07:58:14.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.305+0000 7fe312000700 1 -- start start 2024-05-08T07:58:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.306+0000 7fe312000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0756d0 0x7fe30c1a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.306+0000 7fe312000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c075ff0 0x7fe30c1a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.306+0000 7fe312000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe30c10fea0 0x7fe30c19bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.306+0000 7fe312000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c1157a0 con 0x7fe30c075ff0 2024-05-08T07:58:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.306+0000 7fe312000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c115620 con 0x7fe30c10fea0 2024-05-08T07:58:14.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.306+0000 7fe312000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c115920 con 0x7fe30c0756d0 2024-05-08T07:58:14.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.306+0000 7fe30aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c075ff0 0x7fe30c1a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.306+0000 7fe30aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c075ff0 0x7fe30c1a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37252/0 (socket says 172.21.15.70:37252) 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.306+0000 7fe30aa00700 1 -- 172.21.15.70:0/1065264172 learned_addr learned my addr 172.21.15.70:0/1065264172 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.307+0000 7fe30b400700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0756d0 0x7fe30c1a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.307+0000 7fe30be00700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe30c10fea0 0x7fe30c19bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.307+0000 7fe30aa00700 1 -- 172.21.15.70:0/1065264172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0756d0 msgr2=0x7fe30c1a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.307+0000 7fe30aa00700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0756d0 0x7fe30c1a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.307+0000 7fe30aa00700 1 -- 172.21.15.70:0/1065264172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe30c10fea0 msgr2=0x7fe30c19bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.307+0000 7fe30aa00700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe30c10fea0 0x7fe30c19bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.307+0000 7fe30aa00700 1 -- 172.21.15.70:0/1065264172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c19c460 con 0x7fe30c075ff0 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.307+0000 7fe30aa00700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c075ff0 0x7fe30c1a1fa0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800d950 tx=0x7fe2f800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.308+0000 7fe303e00700 1 -- 172.21.15.70:0/1065264172 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8016070 con 0x7fe30c075ff0 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.308+0000 7fe303e00700 1 -- 172.21.15.70:0/1065264172 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2f8010460 con 0x7fe30c075ff0 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.308+0000 7fe312000700 1 -- 172.21.15.70:0/1065264172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c19c750 con 0x7fe30c075ff0 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.308+0000 7fe303e00700 1 -- 172.21.15.70:0/1065264172 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800f620 con 0x7fe30c075ff0 2024-05-08T07:58:14.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.308+0000 7fe312000700 1 -- 172.21.15.70:0/1065264172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1a89e0 con 0x7fe30c075ff0 2024-05-08T07:58:14.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.312+0000 7fe303e00700 1 -- 172.21.15.70:0/1065264172 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe2f8019070 con 0x7fe30c075ff0 2024-05-08T07:58:14.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.314+0000 7fe303e00700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe2f00b29f0 0x7fe2f00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.314+0000 7fe303e00700 1 -- 172.21.15.70:0/1065264172 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(222..222 src has 1..222) ==== 9671+0+0 (secure 0 0 0) 0x7fe2f80e2740 con 0x7fe30c075ff0 2024-05-08T07:58:14.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.314+0000 7fe30b400700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe2f00b29f0 0x7fe2f00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.315+0000 7fe30b400700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe2f00b29f0 0x7fe2f00b4eb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00b5c0 tx=0x7fe2fc01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:14.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.326+0000 7fe31c8d2b80 1 Processor -- start 2024-05-08T07:58:14.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.327+0000 7fe31c8d2b80 1 -- start start 2024-05-08T07:58:14.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.327+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce12161b0 0x55bce1216590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.327+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 0x55bce1210c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.327+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce121cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.327+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bce1162b20 con 0x55bce1211140 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.327+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bce1100860 con 0x55bce1210780 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.327+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bce115eae0 con 0x55bce12161b0 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce121cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce121cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37256/0 (socket says 172.21.15.70:37256) 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30be00700 1 -- 172.21.15.70:0/1466931631 learned_addr learned my addr 172.21.15.70:0/1466931631 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30b400700 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce12161b0 0x55bce1216590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30aa00700 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 0x55bce1210c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30be00700 1 -- 172.21.15.70:0/1466931631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce12161b0 msgr2=0x55bce1216590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30be00700 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce12161b0 0x55bce1216590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30be00700 1 -- 172.21.15.70:0/1466931631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 msgr2=0x55bce1210c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30be00700 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 0x55bce1210c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30be00700 1 -- 172.21.15.70:0/1466931631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce10af9d0 con 0x55bce1211140 2024-05-08T07:58:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30aa00700 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 0x55bce1210c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:58:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30b400700 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce12161b0 0x55bce1216590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:58:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.328+0000 7fe30be00700 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce121cf70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe304009c40 tx=0x7fe304009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678903490a4b008c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.329+0000 7fe300c00700 1 -- 172.21.15.70:0/1466931631 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304007d70 con 0x55bce1211140 2024-05-08T07:58:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.329+0000 7fe300c00700 1 -- 172.21.15.70:0/1466931631 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe304004bb0 con 0x55bce1211140 2024-05-08T07:58:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.329+0000 7fe300c00700 1 -- 172.21.15.70:0/1466931631 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe304005220 con 0x55bce1211140 2024-05-08T07:58:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1466931631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 msgr2=0x55bce121cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce121cf70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fe304009c40 tx=0x7fe304009f50 comp rx=0 tx=0).stop 2024-05-08T07:58:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1466931631 shutdown_connections 2024-05-08T07:58:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce121cf70 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce12161b0 0x55bce1216590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/1466931631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 0x55bce1210c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1466931631 >> 172.21.15.70:0/1466931631 conn(0x55bce11887d0 msgr2=0x55bce120b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1466931631 shutdown_connections 2024-05-08T07:58:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1466931631 wait complete. 2024-05-08T07:58:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.330+0000 7fe31c8d2b80 1 -- start start 2024-05-08T07:58:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.331+0000 7fe31c8d2b80 1 Processor -- start 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.331+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 0x55bce121cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.331+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1219f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.331+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce12161b0 0x55bce121a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.331+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bce121d570 con 0x55bce1211140 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.331+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bce10c8c20 con 0x55bce12161b0 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.331+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bce121d6f0 con 0x55bce1210780 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.331+0000 7fe31c8d2b80 10 client.0 _ll_register_callbacks cb 0x55bce1109d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1219f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1219f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37264/0 (socket says 172.21.15.70:37264) 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30aa00700 1 -- 172.21.15.70:0/2509613713 learned_addr learned my addr 172.21.15.70:0/2509613713 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30b400700 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 0x55bce121cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30be00700 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce12161b0 0x55bce121a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30aa00700 1 -- 172.21.15.70:0/2509613713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 msgr2=0x55bce121cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30aa00700 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 0x55bce121cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30aa00700 1 -- 172.21.15.70:0/2509613713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce12161b0 msgr2=0x55bce121a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30aa00700 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce12161b0 0x55bce121a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30aa00700 1 -- 172.21.15.70:0/2509613713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce1128520 con 0x55bce1211140 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe30aa00700 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1219f20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80a67b0 tx=0x7fe2f80a9100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4e309b6779fd1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.332+0000 7fe2f5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.333+0000 7fe2f5600700 1 -- 172.21.15.70:0/2509613713 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80e2070 con 0x55bce1211140 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.333+0000 7fe2f5600700 1 -- 172.21.15.70:0/2509613713 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(222..222 src has 1..222) ==== 9671+0+0 (secure 0 0 0) 0x7fe2f8010930 con 0x55bce1211140 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.333+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/2509613713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe304004bb0 con 0x55bce1211140 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.333+0000 7fe2f5600700 1 -- 172.21.15.70:0/2509613713 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe2f8020040 con 0x55bce1211140 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.333+0000 7fe31c8d2b80 10 client.17421 fetch_fsmap learned FSMap version 42 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.333+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/2509613713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bce1227ca0 con 0x55bce1211140 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.333+0000 7fe2f5600700 1 -- 172.21.15.70:0/2509613713 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe304004bb0 con 0x55bce1211140 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.333+0000 7fe2f5600700 1 -- 172.21.15.70:0/2509613713 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe2f80b1f10 con 0x55bce1211140 2024-05-08T07:58:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.334+0000 7fe31c8d2b80 10 client.17421 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:58:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.334+0000 7fe31c8d2b80 10 client.17421 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:58:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.334+0000 7fe31c8d2b80 20 client.17421 populate_metadata read hostname 'smithi070' 2024-05-08T07:58:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.334+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bce122a230 0x55bce122c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.334+0000 7fe31c8d2b80 4 client.17421 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:58:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.334+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/2509613713 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bce11dd240 con 0x55bce122a230 2024-05-08T07:58:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.334+0000 7fe30b400700 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bce122a230 0x55bce122c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.335+0000 7fe30b400700 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bce122a230 0x55bce122c620 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd8e994683aad5a1 server_cookie=f272c3d24f651d2d in_seq=0 out_seq=0 2024-05-08T07:58:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.335+0000 7fe2f5600700 10 client.17421 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:58:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.337+0000 7fe2f5600700 1 -- 172.21.15.70:0/2509613713 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bce11dd240 con 0x55bce122a230 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.337+0000 7fe2f5600700 10 client.17421 handle_command_reply: tid=0 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.337+0000 7fe31c8d2b80 1 client.17421 shutdown 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.337+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/2509613713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 msgr2=0x55bce1219f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.337+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1219f20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80a67b0 tx=0x7fe2f80a9100 comp rx=0 tx=0).stop 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/2509613713 shutdown_connections 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bce122a230 0x55bce122c620 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce12161b0 0x55bce121a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe2f5600700 0 client.17421 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 0x55bce121cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/2509613713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1219f20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/2509613713 >> 172.21.15.70:0/2509613713 conn(0x55bce11887d0 msgr2=0x55bce1205b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/2509613713 shutdown_connections 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/2509613713 wait complete. 2024-05-08T07:58:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.338+0000 7fe31c8d2b80 20 client.17421 trim_cache size 0 max 16384 2024-05-08T07:58:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.359+0000 7fe31c8d2b80 1 Processor -- start 2024-05-08T07:58:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.359+0000 7fe31c8d2b80 1 -- start start 2024-05-08T07:58:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 0x55bce1226600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1218e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce12161b0 0x55bce12144c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c1b4270 con 0x55bce1211140 2024-05-08T07:58:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c1b1b00 con 0x55bce12161b0 2024-05-08T07:58:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c1af970 con 0x55bce1210780 2024-05-08T07:58:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe30aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1218e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe30aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1218e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37268/0 (socket says 172.21.15.70:37268) 2024-05-08T07:58:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe30aa00700 1 -- 172.21.15.70:0/1900050813 learned_addr learned my addr 172.21.15.70:0/1900050813 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.360+0000 7fe30b400700 1 --2- 172.21.15.70:0/1900050813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 0x55bce1226600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.361+0000 7fe30aa00700 1 -- 172.21.15.70:0/1900050813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 msgr2=0x55bce1226600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.361+0000 7fe30aa00700 1 --2- 172.21.15.70:0/1900050813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 0x55bce1226600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.361+0000 7fe30aa00700 1 -- 172.21.15.70:0/1900050813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce12161b0 msgr2=0x55bce12144c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.361+0000 7fe30aa00700 1 --2- 172.21.15.70:0/1900050813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce12161b0 0x55bce12144c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.361+0000 7fe30aa00700 1 -- 172.21.15.70:0/1900050813 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bce1207c70 con 0x55bce1211140 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.361+0000 7fe30aa00700 1 --2- 172.21.15.70:0/1900050813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1218e80 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80b2280 tx=0x7fe2f80a96c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641d62d4fa133f82 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.361+0000 7fe2f7e00700 1 -- 172.21.15.70:0/1900050813 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80c8070 con 0x55bce1211140 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.361+0000 7fe2f7e00700 1 -- 172.21.15.70:0/1900050813 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2f80ad8f0 con 0x55bce1211140 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.361+0000 7fe2f7e00700 1 -- 172.21.15.70:0/1900050813 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80e2040 con 0x55bce1211140 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.362+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1900050813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 msgr2=0x55bce1218e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.362+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/1900050813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1218e80 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80b2280 tx=0x7fe2f80a96c0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.362+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1900050813 shutdown_connections 2024-05-08T07:58:14.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.362+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/1900050813 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce12161b0 0x55bce12144c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.362+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/1900050813 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce1210780 0x55bce1226600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.362+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/1900050813 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce1211140 0x55bce1218e80 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.362+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1900050813 >> 172.21.15.70:0/1900050813 conn(0x55bce11887d0 msgr2=0x55bce120f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:14.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.362+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1900050813 shutdown_connections 2024-05-08T07:58:14.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.363+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/1900050813 wait complete. 2024-05-08T07:58:14.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.363+0000 7fe31c8d2b80 1 -- start start 2024-05-08T07:58:14.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.363+0000 7fe31c8d2b80 1 Processor -- start 2024-05-08T07:58:14.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 0x55bce1220110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce12161b0 0x55bce1220650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe31c8d2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce128da20 0x55bce128dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c1affc0 con 0x55bce12161b0 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c1b1430 con 0x55bce1210780 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe31c8d2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c1b0690 con 0x55bce128da20 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe31c8d2b80 10 client.0 _ll_register_callbacks cb 0x55bce1109d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe30aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce12161b0 0x55bce1220650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe30aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce12161b0 0x55bce1220650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37272/0 (socket says 172.21.15.70:37272) 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe30aa00700 1 -- 172.21.15.70:0/552083201 learned_addr learned my addr 172.21.15.70:0/552083201 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe30b400700 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 0x55bce1220110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.364+0000 7fe30be00700 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce128da20 0x55bce128dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe30aa00700 1 -- 172.21.15.70:0/552083201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce128da20 msgr2=0x55bce128dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe30aa00700 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce128da20 0x55bce128dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe30aa00700 1 -- 172.21.15.70:0/552083201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 msgr2=0x55bce1220110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:14.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe30aa00700 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 0x55bce1220110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe30aa00700 1 -- 172.21.15.70:0/552083201 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bce128e460 con 0x55bce12161b0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe30aa00700 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce12161b0 0x55bce1220650 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80a67b0 tx=0x7fe2f80a54f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315e081c6355a3ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe2f5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe2f5600700 1 -- 172.21.15.70:0/552083201 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80c8070 con 0x55bce12161b0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe2f5600700 1 -- 172.21.15.70:0/552083201 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(222..222 src has 1..222) ==== 9671+0+0 (secure 0 0 0) 0x7fe2f80e21e0 con 0x55bce12161b0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/552083201 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2f80ad8f0 con 0x55bce12161b0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.365+0000 7fe2f5600700 1 -- 172.21.15.70:0/552083201 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe2f80e2040 con 0x55bce12161b0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe31c8d2b80 10 client.17427 fetch_fsmap learned FSMap version 42 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/552083201 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bce128e460 con 0x55bce12161b0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe2f5600700 1 -- 172.21.15.70:0/552083201 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2f80ad8f0 con 0x55bce12161b0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe2f5600700 1 -- 172.21.15.70:0/552083201 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe2f80a87a0 con 0x55bce12161b0 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe31c8d2b80 10 client.17427 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe31c8d2b80 10 client.17427 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:58:14.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe31c8d2b80 20 client.17427 populate_metadata read hostname 'smithi070' 2024-05-08T07:58:14.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bce1296c40 0x55bce1299030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:14.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe31c8d2b80 4 client.17427 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a20cbf99", "release": true, "await": true}] 2024-05-08T07:58:14.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.366+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/552083201 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a20cbf99", "release": true, "await": true}) -- 0x55bce1170500 con 0x55bce1296c40 2024-05-08T07:58:14.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.367+0000 7fe30b400700 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bce1296c40 0x55bce1299030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:14.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.369+0000 7fe30b400700 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bce1296c40 0x55bce1299030 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=503a1ce26d9599dd server_cookie=55771c7227fded37 in_seq=0 out_seq=0 2024-05-08T07:58:14.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:14.369+0000 7fe2f5600700 10 client.17427 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:58:16.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:15 smithi194 ceph-mon[33679]: pgmap v2282: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:58:16.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:15 smithi070 ceph-mon[29591]: pgmap v2282: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:58:16.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:15 smithi172 ceph-mon[33377]: pgmap v2282: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:58:18.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:17 smithi194 ceph-mon[33679]: pgmap v2283: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:58:18.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:17 smithi070 ceph-mon[29591]: pgmap v2283: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:58:18.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:17 smithi172 ceph-mon[33377]: pgmap v2283: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:58:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.423+0000 7fe2f5600700 1 -- 172.21.15.70:0/552083201 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55bce1170500 con 0x55bce1296c40 2024-05-08T07:58:19.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.423+0000 7fe2f5600700 10 client.17427 handle_command_reply: tid=0 2024-05-08T07:58:19.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.424+0000 7fe31c8d2b80 1 client.17427 shutdown 2024-05-08T07:58:19.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.425+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/552083201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce12161b0 msgr2=0x55bce1220650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:19.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.425+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce12161b0 0x55bce1220650 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80a67b0 tx=0x7fe2f80a54f0 comp rx=0 tx=0).stop 2024-05-08T07:58:19.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.426+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/552083201 shutdown_connections 2024-05-08T07:58:19.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.426+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bce1296c40 0x55bce1299030 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:19.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.426+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bce128da20 0x55bce128dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:19.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.426+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bce1210780 0x55bce1220110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:19.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.426+0000 7fe31c8d2b80 1 --2- 172.21.15.70:0/552083201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bce12161b0 0x55bce1220650 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:19.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.426+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/552083201 >> 172.21.15.70:0/552083201 conn(0x55bce11887d0 msgr2=0x55bce1210000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:19.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.426+0000 7fe2f5600700 0 client.17427 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:58:19.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.427+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/552083201 shutdown_connections 2024-05-08T07:58:19.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.427+0000 7fe31c8d2b80 1 -- 172.21.15.70:0/552083201 wait complete. 2024-05-08T07:58:19.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.428+0000 7fe31c8d2b80 20 client.17427 trim_cache size 0 max 16384 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 172, 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "a20cbf99": { 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 172, 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:58:19.425 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.8, 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:19.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:19.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:19.427 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:58:19.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.432+0000 7fe312000700 1 -- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe2f00b29f0 msgr2=0x7fe2f00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:19.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.432+0000 7fe312000700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe2f00b29f0 0x7fe2f00b4eb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00b5c0 tx=0x7fe2fc01a040 comp rx=0 tx=0).stop 2024-05-08T07:58:19.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.432+0000 7fe312000700 1 -- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c075ff0 msgr2=0x7fe30c1a1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:19.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.432+0000 7fe312000700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c075ff0 0x7fe30c1a1fa0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800d950 tx=0x7fe2f800dd10 comp rx=0 tx=0).stop 2024-05-08T07:58:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.433+0000 7fe312000700 1 -- 172.21.15.70:0/1065264172 shutdown_connections 2024-05-08T07:58:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.433+0000 7fe312000700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe2f00b29f0 0x7fe2f00b4eb0 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00b5c0 tx=0x7fe2fc01a040 comp rx=0 tx=0).stop 2024-05-08T07:58:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.433+0000 7fe312000700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe30c10fea0 0x7fe30c19bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.433+0000 7fe312000700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe30c0756d0 0x7fe30c1a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:19.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.433+0000 7fe312000700 1 --2- 172.21.15.70:0/1065264172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe30c075ff0 0x7fe30c1a1fa0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:19.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.433+0000 7fe312000700 1 -- 172.21.15.70:0/1065264172 >> 172.21.15.70:0/1065264172 conn(0x7fe30c07a650 msgr2=0x7fe30c100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:19.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.435+0000 7fe312000700 1 -- 172.21.15.70:0/1065264172 shutdown_connections 2024-05-08T07:58:19.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:19.438+0000 7fe312000700 1 -- 172.21.15.70:0/1065264172 wait complete. 2024-05-08T07:58:20.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:19 smithi194 ceph-mon[33679]: pgmap v2285: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T07:58:20.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:19 smithi194 ceph-mon[33679]: osdmap e223: 12 total, 12 up, 12 in 2024-05-08T07:58:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:58:20.046 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/mq-deadline.o 2024-05-08T07:58:20.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:19 smithi070 ceph-mon[29591]: pgmap v2285: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T07:58:20.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:19 smithi070 ceph-mon[29591]: osdmap e223: 12 total, 12 up, 12 in 2024-05-08T07:58:20.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:58:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:19 smithi172 ceph-mon[33377]: pgmap v2285: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T07:58:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:19 smithi172 ceph-mon[33377]: osdmap e223: 12 total, 12 up, 12 in 2024-05-08T07:58:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:58:20.493 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a20cbf99', seconds elapsed: 79.5 2024-05-08T07:58:20.493 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.85 2024-05-08T07:58:20.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:58:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:58:21.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:21 smithi070 ceph-mon[29591]: pgmap v2286: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T07:58:21.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:58:21.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:58:21.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:58:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:21 smithi194 ceph-mon[33679]: pgmap v2286: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T07:58:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:58:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:58:22.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:58:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:21 smithi172 ceph-mon[33377]: pgmap v2286: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T07:58:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:58:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:58:22.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:58:22.219 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/generic_mpih-mul1.o 2024-05-08T07:58:22.437 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/irq_work.o 2024-05-08T07:58:22.464 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/xattr_user.o 2024-05-08T07:58:22.534 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/fast_commit.o 2024-05-08T07:58:22.610 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/rpm-traces.o 2024-05-08T07:58:22.733 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/orphan.o 2024-05-08T07:58:22.735 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/opdef.o 2024-05-08T07:58:23.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.294+0000 7f1297800700 1 -- 172.21.15.70:0/1242680356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1290105ee0 msgr2=0x7f1290106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:23.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.294+0000 7f1297800700 1 --2- 172.21.15.70:0/1242680356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1290105ee0 0x7f1290106370 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f1288009990 tx=0x7f1288009ca0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.294+0000 7f1297800700 1 -- 172.21.15.70:0/1242680356 shutdown_connections 2024-05-08T07:58:23.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.294+0000 7f1297800700 1 --2- 172.21.15.70:0/1242680356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1290105ee0 0x7f1290106370 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.294+0000 7f1297800700 1 --2- 172.21.15.70:0/1242680356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f12901083d0 0x7f129006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.294+0000 7f1297800700 1 --2- 172.21.15.70:0/1242680356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f129006b6f0 0x7f129006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.294+0000 7f1297800700 1 -- 172.21.15.70:0/1242680356 >> 172.21.15.70:0/1242680356 conn(0x7f1290079350 msgr2=0x7f1290079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:23.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.294+0000 7f1297800700 1 -- 172.21.15.70:0/1242680356 shutdown_connections 2024-05-08T07:58:23.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.294+0000 7f1297800700 1 -- 172.21.15.70:0/1242680356 wait complete. 2024-05-08T07:58:23.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.295+0000 7f1297800700 1 Processor -- start 2024-05-08T07:58:23.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.296+0000 7f1297800700 1 -- start start 2024-05-08T07:58:23.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.296+0000 7f1297800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f129006b6f0 0x7f12901a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:23.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.296+0000 7f1297800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1290105ee0 0x7f12901a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:23.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1297800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12901083d0 0x7f12901a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:23.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1297800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1290119b10 con 0x7f129006b6f0 2024-05-08T07:58:23.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1297800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1290119990 con 0x7f1290105ee0 2024-05-08T07:58:23.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1297800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1290119c90 con 0x7f12901083d0 2024-05-08T07:58:23.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1294e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f129006b6f0 0x7f12901a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:23.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1294e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f129006b6f0 0x7f12901a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51956/0 (socket says 172.21.15.70:51956) 2024-05-08T07:58:23.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1294e00700 1 -- 172.21.15.70:0/530829313 learned_addr learned my addr 172.21.15.70:0/530829313 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:23.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1294e00700 1 -- 172.21.15.70:0/530829313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12901083d0 msgr2=0x7f12901a48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:23.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1294e00700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12901083d0 0x7f12901a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1294e00700 1 -- 172.21.15.70:0/530829313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1290105ee0 msgr2=0x7f12901a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:23.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1294e00700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1290105ee0 0x7f12901a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.297+0000 7f1294e00700 1 -- 172.21.15.70:0/530829313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12901a5010 con 0x7f129006b6f0 2024-05-08T07:58:23.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.298+0000 7f1294e00700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f129006b6f0 0x7f12901a0000 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f12840060b0 tx=0x7f1284007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:23.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.298+0000 7f128d600700 1 -- 172.21.15.70:0/530829313 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128401a070 con 0x7f129006b6f0 2024-05-08T07:58:23.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.298+0000 7f128d600700 1 -- 172.21.15.70:0/530829313 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f128400de20 con 0x7f129006b6f0 2024-05-08T07:58:23.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.298+0000 7f128d600700 1 -- 172.21.15.70:0/530829313 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1284014690 con 0x7f129006b6f0 2024-05-08T07:58:23.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.298+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12901a5300 con 0x7f129006b6f0 2024-05-08T07:58:23.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.298+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12901acb80 con 0x7f129006b6f0 2024-05-08T07:58:23.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.300+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f129006a190 con 0x7f129006b6f0 2024-05-08T07:58:23.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.303+0000 7f128d600700 1 -- 172.21.15.70:0/530829313 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f128401d070 con 0x7f129006b6f0 2024-05-08T07:58:23.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.305+0000 7f128d600700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12780b2b40 0x7f12780b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:23.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.305+0000 7f128d600700 1 -- 172.21.15.70:0/530829313 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 9583+0+0 (secure 0 0 0) 0x7f12840e26a0 con 0x7f129006b6f0 2024-05-08T07:58:23.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.306+0000 7f128fe00700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12780b2b40 0x7f12780b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:23.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.308+0000 7f128fe00700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12780b2b40 0x7f12780b5000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f129006b5c0 tx=0x7f127c005c80 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:23.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.310+0000 7f128d600700 1 -- 172.21.15.70:0/530829313 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1284010070 con 0x7f129006b6f0 2024-05-08T07:58:23.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.783+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f12901a1360 con 0x7f129006b6f0 2024-05-08T07:58:23.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.784+0000 7f128d600700 1 -- 172.21.15.70:0/530829313 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f12840a9ce0 con 0x7f129006b6f0 2024-05-08T07:58:23.780 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:58:23.780 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:58:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12780b2b40 msgr2=0x7f12780b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12780b2b40 0x7f12780b5000 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f129006b5c0 tx=0x7f127c005c80 comp rx=0 tx=0).stop 2024-05-08T07:58:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f129006b6f0 msgr2=0x7f12901a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f129006b6f0 0x7f12901a0000 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f12840060b0 tx=0x7f1284007f90 comp rx=0 tx=0).stop 2024-05-08T07:58:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 shutdown_connections 2024-05-08T07:58:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f12780b2b40 0x7f12780b5000 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12901083d0 0x7f12901a48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f129006b6f0 0x7f12901a0000 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 --2- 172.21.15.70:0/530829313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1290105ee0 0x7f12901a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.788+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 >> 172.21.15.70:0/530829313 conn(0x7f1290079350 msgr2=0x7f1290104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.789+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 shutdown_connections 2024-05-08T07:58:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:23.789+0000 7f1297800700 1 -- 172.21.15.70:0/530829313 wait complete. 2024-05-08T07:58:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:58:24.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:23 smithi194 ceph-mon[33679]: pgmap v2287: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:58:24.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:23 smithi070 ceph-mon[29591]: pgmap v2287: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:58:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:23 smithi172 ceph-mon[33377]: pgmap v2287: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2024-05-08T07:58:24.740 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 84.85 --await-for 42.0' 2024-05-08T07:58:24.740 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 84.85 --await-for 42.0 2024-05-08T07:58:24.815 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:24 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/530829313' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:58:25.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:24 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/530829313' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:58:25.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:24 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/530829313' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:58:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:58:25.810 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:25 smithi070 ceph-mon[29591]: pgmap v2288: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 321 KiB/s wr, 169 op/s 2024-05-08T07:58:26.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:25 smithi172 ceph-mon[33377]: pgmap v2288: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 321 KiB/s wr, 169 op/s 2024-05-08T07:58:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:25 smithi194 ceph-mon[33679]: pgmap v2288: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 321 KiB/s wr, 169 op/s 2024-05-08T07:58:28.114 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:27 smithi070 ceph-mon[29591]: pgmap v2289: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 321 KiB/s wr, 169 op/s 2024-05-08T07:58:28.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:27 smithi172 ceph-mon[33377]: pgmap v2289: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 321 KiB/s wr, 169 op/s 2024-05-08T07:58:28.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:27 smithi194 ceph-mon[33679]: pgmap v2289: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 321 KiB/s wr, 169 op/s 2024-05-08T07:58:28.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.590+0000 7f3f1d200700 1 -- 172.21.15.70:0/3834312729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1806b3e0 msgr2=0x7f3f1806b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:28.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.590+0000 7f3f1d200700 1 --2- 172.21.15.70:0/3834312729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1806b3e0 0x7f3f1806b7c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f3f080099c0 tx=0x7f3f08009cd0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.591+0000 7f3f1d200700 1 -- 172.21.15.70:0/3834312729 shutdown_connections 2024-05-08T07:58:28.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.591+0000 7f3f1d200700 1 --2- 172.21.15.70:0/3834312729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18108860 0x7f3f181103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.591+0000 7f3f1d200700 1 --2- 172.21.15.70:0/3834312729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1806b3e0 0x7f3f1806b7c0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.591+0000 7f3f1d200700 1 --2- 172.21.15.70:0/3834312729 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f1806bd90 0x7f3f18108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.591+0000 7f3f1d200700 1 -- 172.21.15.70:0/3834312729 >> 172.21.15.70:0/3834312729 conn(0x7f3f18079340 msgr2=0x7f3f18079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:28.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.591+0000 7f3f1d200700 1 -- 172.21.15.70:0/3834312729 shutdown_connections 2024-05-08T07:58:28.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.591+0000 7f3f1d200700 1 -- 172.21.15.70:0/3834312729 wait complete. 2024-05-08T07:58:28.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.592+0000 7f3f1d200700 1 Processor -- start 2024-05-08T07:58:28.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.592+0000 7f3f1d200700 1 -- start start 2024-05-08T07:58:28.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.593+0000 7f3f1d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1806b3e0 0x7f3f1819f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.593+0000 7f3f1d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f1806bd90 0x7f3f1819fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.593+0000 7f3f1d200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18108860 0x7f3f18199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.593+0000 7f3f1d200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f18113550 con 0x7f3f1806b3e0 2024-05-08T07:58:28.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.593+0000 7f3f1d200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181133d0 con 0x7f3f1806bd90 2024-05-08T07:58:28.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.593+0000 7f3f1d200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181136d0 con 0x7f3f18108860 2024-05-08T07:58:28.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.594+0000 7f3f15e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1806b3e0 0x7f3f1819f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.594+0000 7f3f16800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18108860 0x7f3f18199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.594+0000 7f3f16800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18108860 0x7f3f18199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:35602/0 (socket says 172.21.15.70:35602) 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.594+0000 7f3f16800700 1 -- 172.21.15.70:0/1873843801 learned_addr learned my addr 172.21.15.70:0/1873843801 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.594+0000 7f3f15400700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f1806bd90 0x7f3f1819fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.594+0000 7f3f15e00700 1 -- 172.21.15.70:0/1873843801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18108860 msgr2=0x7f3f18199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.594+0000 7f3f15e00700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18108860 0x7f3f18199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.594+0000 7f3f15e00700 1 -- 172.21.15.70:0/1873843801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f1806bd90 msgr2=0x7f3f1819fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.594+0000 7f3f15e00700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f1806bd90 0x7f3f1819fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.595+0000 7f3f15e00700 1 -- 172.21.15.70:0/1873843801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1819a050 con 0x7f3f1806b3e0 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.595+0000 7f3f16800700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18108860 0x7f3f18199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.595+0000 7f3f15e00700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1806b3e0 0x7f3f1819f650 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f3f080098e0 tx=0x7f3f080047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.595+0000 7f3f0ea00700 1 -- 172.21.15.70:0/1873843801 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08027070 con 0x7f3f1806b3e0 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.595+0000 7f3f1d200700 1 -- 172.21.15.70:0/1873843801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1819a2e0 con 0x7f3f1806b3e0 2024-05-08T07:58:28.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.595+0000 7f3f0ea00700 1 -- 172.21.15.70:0/1873843801 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f0800fd30 con 0x7f3f1806b3e0 2024-05-08T07:58:28.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.596+0000 7f3f1d200700 1 -- 172.21.15.70:0/1873843801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f181a65d0 con 0x7f3f1806b3e0 2024-05-08T07:58:28.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.596+0000 7f3f0ea00700 1 -- 172.21.15.70:0/1873843801 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08031060 con 0x7f3f1806b3e0 2024-05-08T07:58:28.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.601+0000 7f3f0ea00700 1 -- 172.21.15.70:0/1873843801 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3f0802a070 con 0x7f3f1806b3e0 2024-05-08T07:58:28.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.603+0000 7f3f0ea00700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3efc0b2aa0 0x7f3efc0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.603+0000 7f3f0ea00700 1 -- 172.21.15.70:0/1873843801 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(223..223 src has 1..223) ==== 9583+0+0 (secure 0 0 0) 0x7f3f080e35d0 con 0x7f3f1806b3e0 2024-05-08T07:58:28.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.604+0000 7f3f15400700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3efc0b2aa0 0x7f3efc0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.605+0000 7f3f15400700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3efc0b2aa0 0x7f3efc0b4f60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3f1819aee0 tx=0x7f3f04005d50 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.616+0000 7f3f27bc4b80 1 Processor -- start 2024-05-08T07:58:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.616+0000 7f3f27bc4b80 1 -- start start 2024-05-08T07:58:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.617+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a2fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.617+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a22520 0x55fa63a229a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.617+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a37570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.617+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fa63974bb0 con 0x55fa63a22ee0 2024-05-08T07:58:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.617+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fa639128f0 con 0x55fa63a22520 2024-05-08T07:58:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.617+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fa63970b70 con 0x55fa63a2f6b0 2024-05-08T07:58:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f15e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a2fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f15e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a2fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:35606/0 (socket says 172.21.15.70:35606) 2024-05-08T07:58:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f15e00700 1 -- 172.21.15.70:0/680542920 learned_addr learned my addr 172.21.15.70:0/680542920 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f16800700 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a37570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f15400700 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a22520 0x55fa63a229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f15e00700 1 -- 172.21.15.70:0/680542920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a22520 msgr2=0x55fa63a229a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f15e00700 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a22520 0x55fa63a229a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f15e00700 1 -- 172.21.15.70:0/680542920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 msgr2=0x55fa63a37570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f15e00700 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a37570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f15e00700 1 -- 172.21.15.70:0/680542920 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa638c1a60 con 0x55fa63a2f6b0 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.618+0000 7f3f16800700 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a37570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.619+0000 7f3f15e00700 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a2fa90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f080a6540 tx=0x7f3f080a9e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d73325e3614b3be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.619+0000 7f3f03400700 1 -- 172.21.15.70:0/680542920 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080aabc0 con 0x55fa63a2f6b0 2024-05-08T07:58:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.619+0000 7f3f03400700 1 -- 172.21.15.70:0/680542920 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f080aa4c0 con 0x55fa63a2f6b0 2024-05-08T07:58:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.619+0000 7f3f03400700 1 -- 172.21.15.70:0/680542920 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080a4e40 con 0x55fa63a2f6b0 2024-05-08T07:58:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.620+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/680542920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 msgr2=0x55fa63a2fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.620+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a2fa90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f080a6540 tx=0x7f3f080a9e10 comp rx=0 tx=0).stop 2024-05-08T07:58:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.621+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/680542920 shutdown_connections 2024-05-08T07:58:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.621+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a37570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.621+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a2fa90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.621+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/680542920 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a22520 0x55fa63a229a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.621+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/680542920 >> 172.21.15.70:0/680542920 conn(0x55fa63950cf0 msgr2=0x55fa63a1ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.621+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/680542920 shutdown_connections 2024-05-08T07:58:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.621+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/680542920 wait complete. 2024-05-08T07:58:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.621+0000 7f3f27bc4b80 1 -- start start 2024-05-08T07:58:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.622+0000 7f3f27bc4b80 1 Processor -- start 2024-05-08T07:58:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22520 0x55fa63a372b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22ee0 0x55fa63a34650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 0x55fa63a34b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fa63a30170 con 0x55fa63a22520 2024-05-08T07:58:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fa638dacb0 con 0x55fa63a2f6b0 2024-05-08T07:58:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fa63a37ab0 con 0x55fa63a22ee0 2024-05-08T07:58:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f15400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22ee0 0x55fa63a34650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f27bc4b80 10 client.0 _ll_register_callbacks cb 0x55fa6391be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:58:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f15e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22520 0x55fa63a372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f15400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22ee0 0x55fa63a34650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:35616/0 (socket says 172.21.15.70:35616) 2024-05-08T07:58:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f15400700 1 -- 172.21.15.70:0/1719096723 learned_addr learned my addr 172.21.15.70:0/1719096723 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.623+0000 7f3f16800700 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 0x55fa63a34b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.624+0000 7f3f15e00700 1 -- 172.21.15.70:0/1719096723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22ee0 msgr2=0x55fa63a34650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.624+0000 7f3f15e00700 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22ee0 0x55fa63a34650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.624+0000 7f3f15e00700 1 -- 172.21.15.70:0/1719096723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 msgr2=0x55fa63a34b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.624+0000 7f3f15e00700 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 0x55fa63a34b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.624+0000 7f3f15e00700 1 -- 172.21.15.70:0/1719096723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa6393a5b0 con 0x55fa63a22520 2024-05-08T07:58:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.624+0000 7f3f15e00700 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22520 0x55fa63a372b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f3f080aa450 tx=0x7f3f08092070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10044faed606296 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.625+0000 7f3ef7e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:58:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.625+0000 7f3ef7e00700 1 -- 172.21.15.70:0/1719096723 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080b3290 con 0x55fa63a22520 2024-05-08T07:58:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.625+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1719096723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f080aa4c0 con 0x55fa63a22520 2024-05-08T07:58:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.625+0000 7f3ef7e00700 1 -- 172.21.15.70:0/1719096723 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(223..223 src has 1..223) ==== 9583+0+0 (secure 0 0 0) 0x7f3f080a6ab0 con 0x55fa63a22520 2024-05-08T07:58:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.626+0000 7f3ef7e00700 1 -- 172.21.15.70:0/1719096723 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3f080b3290 con 0x55fa63a22520 2024-05-08T07:58:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.627+0000 7f3f27bc4b80 10 client.17445 fetch_fsmap learned FSMap version 42 2024-05-08T07:58:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.627+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1719096723 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fa63a42150 con 0x55fa63a22520 2024-05-08T07:58:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.628+0000 7f3ef7e00700 1 -- 172.21.15.70:0/1719096723 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f080c4070 con 0x55fa63a22520 2024-05-08T07:58:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.628+0000 7f3ef7e00700 1 -- 172.21.15.70:0/1719096723 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3f080b2f10 con 0x55fa63a22520 2024-05-08T07:58:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.628+0000 7f3f27bc4b80 10 client.17445 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:58:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.628+0000 7f3f27bc4b80 10 client.17445 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:58:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.628+0000 7f3f27bc4b80 20 client.17445 populate_metadata read hostname 'smithi070' 2024-05-08T07:58:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.628+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fa63a44620 0x55fa63a46a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.629+0000 7f3f27bc4b80 4 client.17445 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:58:28.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.629+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1719096723 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3f080aa4c0 con 0x55fa63a44620 2024-05-08T07:58:28.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.629+0000 7f3f15400700 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fa63a44620 0x55fa63a46a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.630+0000 7f3ef7e00700 10 client.17445 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:58:28.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.630+0000 7f3f15400700 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fa63a44620 0x55fa63a46a10 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e35e2e87eb0c8506 server_cookie=1095075e8dd9cf7a in_seq=0 out_seq=0 2024-05-08T07:58:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.632+0000 7f3ef7e00700 1 -- 172.21.15.70:0/1719096723 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f3f080aa4c0 con 0x55fa63a44620 2024-05-08T07:58:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.632+0000 7f3ef7e00700 10 client.17445 handle_command_reply: tid=0 2024-05-08T07:58:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.632+0000 7f3f27bc4b80 1 client.17445 shutdown 2024-05-08T07:58:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.633+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1719096723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22520 msgr2=0x55fa63a372b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.633+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22520 0x55fa63a372b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f3f080aa450 tx=0x7f3f08092070 comp rx=0 tx=0).stop 2024-05-08T07:58:28.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.633+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1719096723 shutdown_connections 2024-05-08T07:58:28.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.633+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fa63a44620 0x55fa63a46a10 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.633+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 0x55fa63a34b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.633+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22520 0x55fa63a372b0 secure :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f3f080aa450 tx=0x7f3f08092070 comp rx=0 tx=0).stop 2024-05-08T07:58:28.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.633+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1719096723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22ee0 0x55fa63a34650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.633+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1719096723 >> 172.21.15.70:0/1719096723 conn(0x55fa63950cf0 msgr2=0x55fa63a178e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:28.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.633+0000 7f3ef7e00700 0 client.17445 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:58:28.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.634+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1719096723 shutdown_connections 2024-05-08T07:58:28.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.635+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1719096723 wait complete. 2024-05-08T07:58:28.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.635+0000 7f3f27bc4b80 20 client.17445 trim_cache size 0 max 16384 2024-05-08T07:58:28.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.665+0000 7f3f27bc4b80 1 Processor -- start 2024-05-08T07:58:28.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.665+0000 7f3f27bc4b80 1 -- start start 2024-05-08T07:58:28.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 0x55fa63a36410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22130 0x55fa63a4c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181afa80 con 0x55fa63a22ee0 2024-05-08T07:58:28.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181ad310 con 0x55fa63a2f6b0 2024-05-08T07:58:28.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181ab1a0 con 0x55fa63a22130 2024-05-08T07:58:28.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f15e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f15e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39152/0 (socket says 172.21.15.70:39152) 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f15e00700 1 -- 172.21.15.70:0/1526404689 learned_addr learned my addr 172.21.15.70:0/1526404689 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f16800700 1 --2- 172.21.15.70:0/1526404689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22130 0x55fa63a4c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.666+0000 7f3f15400700 1 --2- 172.21.15.70:0/1526404689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 0x55fa63a36410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.667+0000 7f3f15e00700 1 -- 172.21.15.70:0/1526404689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22130 msgr2=0x55fa63a4c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.667+0000 7f3f15e00700 1 --2- 172.21.15.70:0/1526404689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22130 0x55fa63a4c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.667+0000 7f3f15e00700 1 -- 172.21.15.70:0/1526404689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 msgr2=0x55fa63a36410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.667+0000 7f3f15e00700 1 --2- 172.21.15.70:0/1526404689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 0x55fa63a36410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.667+0000 7f3f15e00700 1 -- 172.21.15.70:0/1526404689 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa63a1ecf0 con 0x55fa63a22ee0 2024-05-08T07:58:28.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.667+0000 7f3f15e00700 1 --2- 172.21.15.70:0/1526404689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a408f0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f3f080a7730 tx=0x7f3f080228a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550dbee59ea9fcae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:28.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.668+0000 7f3f02a00700 1 -- 172.21.15.70:0/1526404689 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080aabc0 con 0x55fa63a22ee0 2024-05-08T07:58:28.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.668+0000 7f3f02a00700 1 -- 172.21.15.70:0/1526404689 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f080c4050 con 0x55fa63a22ee0 2024-05-08T07:58:28.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.668+0000 7f3f02a00700 1 -- 172.21.15.70:0/1526404689 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080aa4c0 con 0x55fa63a22ee0 2024-05-08T07:58:28.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.668+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1526404689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 msgr2=0x55fa63a408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:28.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.668+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1526404689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a408f0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f3f080a7730 tx=0x7f3f080228a0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.669+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1526404689 shutdown_connections 2024-05-08T07:58:28.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.669+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1526404689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a22130 0x55fa63a4c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.669+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1526404689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a408f0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.669+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/1526404689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a2f6b0 0x55fa63a36410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.669+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1526404689 >> 172.21.15.70:0/1526404689 conn(0x55fa63950cf0 msgr2=0x55fa63a35d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:28.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.669+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1526404689 shutdown_connections 2024-05-08T07:58:28.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.669+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/1526404689 wait complete. 2024-05-08T07:58:28.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.670+0000 7f3f27bc4b80 1 -- start start 2024-05-08T07:58:28.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.670+0000 7f3f27bc4b80 1 Processor -- start 2024-05-08T07:58:28.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.670+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a3cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.670+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a3d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.670+0000 7f3f27bc4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a38230 0x55fa63a38670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.671+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181ab7f0 con 0x55fa63a22ee0 2024-05-08T07:58:28.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.671+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181acc40 con 0x55fa63a38230 2024-05-08T07:58:28.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.671+0000 7f3f27bc4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f181abea0 con 0x55fa63a2f6b0 2024-05-08T07:58:28.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.671+0000 7f3f27bc4b80 10 client.0 _ll_register_callbacks cb 0x55fa6391be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:58:28.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.671+0000 7f3f15e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a3cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.671+0000 7f3f16800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a38230 0x55fa63a38670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.671+0000 7f3f15e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a3cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39162/0 (socket says 172.21.15.70:39162) 2024-05-08T07:58:28.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.671+0000 7f3f15e00700 1 -- 172.21.15.70:0/3216446595 learned_addr learned my addr 172.21.15.70:0/3216446595 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:58:28.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.671+0000 7f3f15400700 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a3d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.672+0000 7f3f16800700 1 -- 172.21.15.70:0/3216446595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 msgr2=0x55fa63a3d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:28.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.672+0000 7f3f16800700 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a3d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.672+0000 7f3f16800700 1 -- 172.21.15.70:0/3216446595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 msgr2=0x55fa63a3cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:58:28.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.672+0000 7f3f16800700 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a3cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:28.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.672+0000 7f3f16800700 1 -- 172.21.15.70:0/3216446595 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa63a35590 con 0x55fa63a38230 2024-05-08T07:58:28.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.672+0000 7f3f15e00700 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a3cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T07:58:28.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.672+0000 7f3f16800700 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a38230 0x55fa63a38670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55fa63a359e0 tx=0x7f3f10018470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341b061763ee820a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:58:28.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.672+0000 7f3ef7e00700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T07:58:28.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.673+0000 7f3ef7e00700 1 -- 172.21.15.70:0/3216446595 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10004bb0 con 0x55fa63a38230 2024-05-08T07:58:28.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.673+0000 7f3ef7e00700 1 -- 172.21.15.70:0/3216446595 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(223..223 src has 1..223) ==== 9583+0+0 (secure 0 0 0) 0x7f3f10004d50 con 0x55fa63a38230 2024-05-08T07:58:28.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.673+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/3216446595 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f080c4050 con 0x55fa63a38230 2024-05-08T07:58:28.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.674+0000 7f3ef7e00700 1 -- 172.21.15.70:0/3216446595 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3f10005020 con 0x55fa63a38230 2024-05-08T07:58:28.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.674+0000 7f3f27bc4b80 10 client.36461 fetch_fsmap learned FSMap version 42 2024-05-08T07:58:28.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.674+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/3216446595 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fa63ab0b20 con 0x55fa63a38230 2024-05-08T07:58:28.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.675+0000 7f3ef7e00700 1 -- 172.21.15.70:0/3216446595 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f080c4050 con 0x55fa63a38230 2024-05-08T07:58:28.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.675+0000 7f3ef7e00700 1 -- 172.21.15.70:0/3216446595 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3f1001f070 con 0x55fa63a38230 2024-05-08T07:58:28.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.675+0000 7f3f27bc4b80 10 client.36461 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:58:28.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.675+0000 7f3f27bc4b80 10 client.36461 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:58:28.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.675+0000 7f3f27bc4b80 20 client.36461 populate_metadata read hostname 'smithi070' 2024-05-08T07:58:28.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.675+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fa63ab12f0 0x55fa63ab3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:58:28.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.675+0000 7f3f27bc4b80 4 client.36461 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.85, "await_for": 42.0}] 2024-05-08T07:58:28.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.675+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/3216446595 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.85, "await_for": 42.0}) -- 0x55fa639ef230 con 0x55fa63ab12f0 2024-05-08T07:58:28.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.676+0000 7f3f15e00700 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fa63ab12f0 0x55fa63ab3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:58:28.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.677+0000 7f3f15e00700 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fa63ab12f0 0x55fa63ab3710 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=632c7aad6da3aafa server_cookie=c7779ecddeda6cfe in_seq=0 out_seq=0 2024-05-08T07:58:28.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:28.677+0000 7f3ef7e00700 10 client.36461 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:58:30.112 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/generic_mpih-mul2.o 2024-05-08T07:58:30.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:29 smithi070 ceph-mon[29591]: pgmap v2290: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 321 KiB/s wr, 169 op/s 2024-05-08T07:58:30.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:29 smithi172 ceph-mon[33377]: pgmap v2290: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 321 KiB/s wr, 169 op/s 2024-05-08T07:58:30.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:29 smithi194 ceph-mon[33679]: pgmap v2290: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 321 KiB/s wr, 169 op/s 2024-05-08T07:58:30.555 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/kyber-iosched.o 2024-05-08T07:58:32.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:31 smithi070 ceph-mon[29591]: pgmap v2291: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 358 KiB/s wr, 150 op/s 2024-05-08T07:58:32.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:31 smithi172 ceph-mon[33377]: pgmap v2291: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 358 KiB/s wr, 150 op/s 2024-05-08T07:58:32.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:31 smithi194 ceph-mon[33679]: pgmap v2291: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 358 KiB/s wr, 150 op/s 2024-05-08T07:58:34.058 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:33 smithi194 ceph-mon[33679]: pgmap v2292: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 349 KiB/s wr, 146 op/s 2024-05-08T07:58:34.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:33 smithi070 ceph-mon[29591]: pgmap v2292: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 349 KiB/s wr, 146 op/s 2024-05-08T07:58:34.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:33 smithi172 ceph-mon[33377]: pgmap v2292: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 349 KiB/s wr, 146 op/s 2024-05-08T07:58:36.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:35 smithi070 ceph-mon[29591]: pgmap v2293: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 436 KiB/s wr, 152 op/s 2024-05-08T07:58:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:35 smithi172 ceph-mon[33377]: pgmap v2293: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 436 KiB/s wr, 152 op/s 2024-05-08T07:58:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:35 smithi194 ceph-mon[33679]: pgmap v2293: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 436 KiB/s wr, 152 op/s 2024-05-08T07:58:38.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:37 smithi070 ceph-mon[29591]: pgmap v2294: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 178 KiB/s wr, 13 op/s 2024-05-08T07:58:38.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:37 smithi172 ceph-mon[33377]: pgmap v2294: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 178 KiB/s wr, 13 op/s 2024-05-08T07:58:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:37 smithi194 ceph-mon[33679]: pgmap v2294: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 178 KiB/s wr, 13 op/s 2024-05-08T07:58:40.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:39 smithi070 ceph-mon[29591]: pgmap v2295: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 178 KiB/s wr, 13 op/s 2024-05-08T07:58:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:39 smithi172 ceph-mon[33377]: pgmap v2295: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 178 KiB/s wr, 13 op/s 2024-05-08T07:58:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:39 smithi194 ceph-mon[33679]: pgmap v2295: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 178 KiB/s wr, 13 op/s 2024-05-08T07:58:42.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:41 smithi070 ceph-mon[29591]: pgmap v2296: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 181 KiB/s wr, 17 op/s 2024-05-08T07:58:42.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:41 smithi172 ceph-mon[33377]: pgmap v2296: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 181 KiB/s wr, 17 op/s 2024-05-08T07:58:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:41 smithi194 ceph-mon[33679]: pgmap v2296: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 181 KiB/s wr, 17 op/s 2024-05-08T07:58:44.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:43 smithi070 ceph-mon[29591]: pgmap v2297: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 91 KiB/s wr, 9 op/s 2024-05-08T07:58:44.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:43 smithi172 ceph-mon[33377]: pgmap v2297: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 91 KiB/s wr, 9 op/s 2024-05-08T07:58:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:43 smithi194 ceph-mon[33679]: pgmap v2297: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 91 KiB/s wr, 9 op/s 2024-05-08T07:58:46.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:45 smithi070 ceph-mon[29591]: pgmap v2298: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-05-08T07:58:46.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:45 smithi172 ceph-mon[33377]: pgmap v2298: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-05-08T07:58:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:45 smithi194 ceph-mon[33679]: pgmap v2298: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-05-08T07:58:48.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:47 smithi070 ceph-mon[29591]: pgmap v2299: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-08T07:58:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:47 smithi172 ceph-mon[33377]: pgmap v2299: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-08T07:58:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:47 smithi194 ceph-mon[33679]: pgmap v2299: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-08T07:58:49.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.725+0000 7f3ef7e00700 1 -- 172.21.15.70:0/3216446595 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55fa639ef230 con 0x55fa63ab12f0 2024-05-08T07:58:49.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.725+0000 7f3ef7e00700 10 client.36461 handle_command_reply: tid=0 2024-05-08T07:58:49.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.725+0000 7f3f27bc4b80 1 client.36461 shutdown 2024-05-08T07:58:49.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.726+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/3216446595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a38230 msgr2=0x55fa63a38670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.726+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a38230 0x55fa63a38670 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55fa63a359e0 tx=0x7f3f10018470 comp rx=0 tx=0).stop 2024-05-08T07:58:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.726+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/3216446595 shutdown_connections 2024-05-08T07:58:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.726+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fa63ab12f0 0x55fa63ab3710 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.726+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fa63a38230 0x55fa63a38670 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.726+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fa63a22ee0 0x55fa63a3cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:49.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.726+0000 7f3f27bc4b80 1 --2- 172.21.15.70:0/3216446595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fa63a2f6b0 0x55fa63a3d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:49.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.726+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/3216446595 >> 172.21.15.70:0/3216446595 conn(0x55fa63950cf0 msgr2=0x55fa63a364e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:49.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.727+0000 7f3ef7e00700 0 client.36461 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:58:49.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.727+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/3216446595 shutdown_connections 2024-05-08T07:58:49.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.727+0000 7f3f27bc4b80 1 -- 172.21.15.70:0/3216446595 wait complete. 2024-05-08T07:58:49.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.727+0000 7f3f27bc4b80 20 client.36461 trim_cache size 0 max 16384 2024-05-08T07:58:49.724 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 174, 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "fd5dc58c": { 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 174, 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:58:49.725 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.8, 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:58:49.726 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.729+0000 7f3f1d200700 1 -- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3efc0b2aa0 msgr2=0x7f3efc0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.729+0000 7f3f1d200700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3efc0b2aa0 0x7f3efc0b4f60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3f1819aee0 tx=0x7f3f04005d50 comp rx=0 tx=0).stop 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.729+0000 7f3f1d200700 1 -- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1806b3e0 msgr2=0x7f3f1819f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.729+0000 7f3f1d200700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1806b3e0 0x7f3f1819f650 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f3f080098e0 tx=0x7f3f080047b0 comp rx=0 tx=0).stop 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.729+0000 7f3f1d200700 1 -- 172.21.15.70:0/1873843801 shutdown_connections 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.730+0000 7f3f1d200700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3efc0b2aa0 0x7f3efc0b4f60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.730+0000 7f3f1d200700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f18108860 0x7f3f18199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.730+0000 7f3f1d200700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1806b3e0 0x7f3f1819f650 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.730+0000 7f3f1d200700 1 --2- 172.21.15.70:0/1873843801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f1806bd90 0x7f3f1819fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:58:49.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.730+0000 7f3f1d200700 1 -- 172.21.15.70:0/1873843801 >> 172.21.15.70:0/1873843801 conn(0x7f3f18079340 msgr2=0x7f3f181004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:58:49.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.730+0000 7f3f1d200700 1 -- 172.21.15.70:0/1873843801 shutdown_connections 2024-05-08T07:58:49.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:58:49.730+0000 7f3f1d200700 1 -- 172.21.15.70:0/1873843801 wait complete. 2024-05-08T07:58:50.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:49 smithi070 ceph-mon[29591]: pgmap v2300: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-08T07:58:50.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:49 smithi172 ceph-mon[33377]: pgmap v2300: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-08T07:58:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:49 smithi194 ceph-mon[33679]: pgmap v2300: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-05-08T07:58:51.228 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fd5dc58c', quiesce took 30.7 seconds. Will release after: 24.85 2024-05-08T07:58:52.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:51 smithi070 ceph-mon[29591]: pgmap v2301: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-05-08T07:58:52.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:51 smithi172 ceph-mon[33377]: pgmap v2301: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-05-08T07:58:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:51 smithi194 ceph-mon[33679]: pgmap v2301: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 66 KiB/s wr, 28 op/s 2024-05-08T07:58:54.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:53 smithi070 ceph-mon[29591]: pgmap v2302: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 24 op/s 2024-05-08T07:58:54.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:53 smithi172 ceph-mon[33377]: pgmap v2302: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 24 op/s 2024-05-08T07:58:54.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:53 smithi194 ceph-mon[33679]: pgmap v2302: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 24 op/s 2024-05-08T07:58:56.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:55 smithi070 ceph-mon[29591]: pgmap v2303: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 29 op/s 2024-05-08T07:58:56.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:55 smithi172 ceph-mon[33377]: pgmap v2303: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 29 op/s 2024-05-08T07:58:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:55 smithi194 ceph-mon[33679]: pgmap v2303: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 99 KiB/s wr, 29 op/s 2024-05-08T07:58:58.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:57 smithi070 ceph-mon[29591]: pgmap v2304: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 7 op/s 2024-05-08T07:58:58.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:57 smithi172 ceph-mon[33377]: pgmap v2304: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 7 op/s 2024-05-08T07:58:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:57 smithi194 ceph-mon[33679]: pgmap v2304: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 7 op/s 2024-05-08T07:59:00.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:58:59 smithi070 ceph-mon[29591]: pgmap v2305: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 7 op/s 2024-05-08T07:59:00.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:58:59 smithi172 ceph-mon[33377]: pgmap v2305: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 7 op/s 2024-05-08T07:59:00.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:58:59 smithi194 ceph-mon[33679]: pgmap v2305: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 59 KiB/s wr, 7 op/s 2024-05-08T07:59:02.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:01 smithi172 ceph-mon[33377]: pgmap v2306: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 95 KiB/s wr, 11 op/s 2024-05-08T07:59:02.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:01 smithi194 ceph-mon[33679]: pgmap v2306: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 95 KiB/s wr, 11 op/s 2024-05-08T07:59:02.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:01 smithi070 ceph-mon[29591]: pgmap v2306: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 95 KiB/s wr, 11 op/s 2024-05-08T07:59:04.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:03 smithi172 ceph-mon[33377]: pgmap v2307: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 8 op/s 2024-05-08T07:59:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:03 smithi194 ceph-mon[33679]: pgmap v2307: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 8 op/s 2024-05-08T07:59:04.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:03 smithi070 ceph-mon[29591]: pgmap v2307: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 73 KiB/s wr, 8 op/s 2024-05-08T07:59:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:05 smithi172 ceph-mon[33377]: pgmap v2308: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 133 KiB/s wr, 28 op/s 2024-05-08T07:59:06.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:05 smithi194 ceph-mon[33679]: pgmap v2308: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 133 KiB/s wr, 28 op/s 2024-05-08T07:59:06.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:05 smithi070 ceph-mon[29591]: pgmap v2308: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 133 KiB/s wr, 28 op/s 2024-05-08T07:59:08.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:07 smithi172 ceph-mon[33377]: pgmap v2309: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 96 KiB/s wr, 24 op/s 2024-05-08T07:59:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:07 smithi194 ceph-mon[33679]: pgmap v2309: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 96 KiB/s wr, 24 op/s 2024-05-08T07:59:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:07 smithi070 ceph-mon[29591]: pgmap v2309: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 96 KiB/s wr, 24 op/s 2024-05-08T07:59:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:09 smithi172 ceph-mon[33377]: pgmap v2310: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 96 KiB/s wr, 24 op/s 2024-05-08T07:59:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:09 smithi194 ceph-mon[33679]: pgmap v2310: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 96 KiB/s wr, 24 op/s 2024-05-08T07:59:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:09 smithi070 ceph-mon[29591]: pgmap v2310: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 96 KiB/s wr, 24 op/s 2024-05-08T07:59:12.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:11 smithi172 ceph-mon[33377]: pgmap v2311: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 96 KiB/s wr, 27 op/s 2024-05-08T07:59:12.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:11 smithi172 ceph-mon[33377]: osdmap e224: 12 total, 12 up, 12 in 2024-05-08T07:59:12.176 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:11 smithi070 ceph-mon[29591]: pgmap v2311: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 96 KiB/s wr, 27 op/s 2024-05-08T07:59:12.176 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:11 smithi070 ceph-mon[29591]: osdmap e224: 12 total, 12 up, 12 in 2024-05-08T07:59:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:11 smithi194 ceph-mon[33679]: pgmap v2311: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 96 KiB/s wr, 27 op/s 2024-05-08T07:59:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:11 smithi194 ceph-mon[33679]: osdmap e224: 12 total, 12 up, 12 in 2024-05-08T07:59:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:13 smithi194 ceph-mon[33679]: pgmap v2313: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 72 KiB/s wr, 27 op/s 2024-05-08T07:59:14.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:13 smithi070 ceph-mon[29591]: pgmap v2313: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 72 KiB/s wr, 27 op/s 2024-05-08T07:59:14.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:13 smithi172 ceph-mon[33377]: pgmap v2313: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 72 KiB/s wr, 27 op/s 2024-05-08T07:59:16.080 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T07:59:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:15 smithi194 ceph-mon[33679]: pgmap v2314: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:59:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:15 smithi070 ceph-mon[29591]: pgmap v2314: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:59:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:15 smithi172 ceph-mon[33377]: pgmap v2314: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:59:16.551 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:59:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:17 smithi194 ceph-mon[33679]: pgmap v2315: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:59:18.343 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:17 smithi070 ceph-mon[29591]: pgmap v2315: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:59:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:17 smithi172 ceph-mon[33377]: pgmap v2315: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:59:19.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.051+0000 7fc1df400700 1 -- 172.21.15.70:0/3871881974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 msgr2=0x7fc1d8110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:19.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.051+0000 7fc1df400700 1 --2- 172.21.15.70:0/3871881974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 0x7fc1d8110340 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000b0a0 tx=0x7fc1d000b3b0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.052+0000 7fc1df400700 1 -- 172.21.15.70:0/3871881974 shutdown_connections 2024-05-08T07:59:19.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.052+0000 7fc1df400700 1 --2- 172.21.15.70:0/3871881974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 0x7fc1d8110340 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.052+0000 7fc1df400700 1 --2- 172.21.15.70:0/3871881974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1d8109520 0x7fc1d8109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.052+0000 7fc1df400700 1 --2- 172.21.15.70:0/3871881974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d8101a90 0x7fc1d8101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.052+0000 7fc1df400700 1 -- 172.21.15.70:0/3871881974 >> 172.21.15.70:0/3871881974 conn(0x7fc1d8078a10 msgr2=0x7fc1d80ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:59:19.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.052+0000 7fc1df400700 1 -- 172.21.15.70:0/3871881974 shutdown_connections 2024-05-08T07:59:19.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.052+0000 7fc1df400700 1 -- 172.21.15.70:0/3871881974 wait complete. 2024-05-08T07:59:19.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.053+0000 7fc1df400700 1 Processor -- start 2024-05-08T07:59:19.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.053+0000 7fc1df400700 1 -- start start 2024-05-08T07:59:19.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1df400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d8101a90 0x7fc1d8102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:19.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1df400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 0x7fc1d81031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:19.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1df400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1d8109520 0x7fc1d81036f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:19.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1df400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d8113550 con 0x7fc1d8102450 2024-05-08T07:59:19.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1df400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d81133d0 con 0x7fc1d8109520 2024-05-08T07:59:19.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1df400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d81136d0 con 0x7fc1d8101a90 2024-05-08T07:59:19.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 0x7fc1d81031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:19.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 0x7fc1d81031b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47106/0 (socket says 172.21.15.70:47106) 2024-05-08T07:59:19.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1d7e00700 1 -- 172.21.15.70:0/3098797391 learned_addr learned my addr 172.21.15.70:0/3098797391 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:59:19.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.054+0000 7fc1dca00700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d8101a90 0x7fc1d8102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:19.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1dd400700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1d8109520 0x7fc1d81036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:19.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1d7e00700 1 -- 172.21.15.70:0/3098797391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d8101a90 msgr2=0x7fc1d8102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:19.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1d7e00700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d8101a90 0x7fc1d8102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1d7e00700 1 -- 172.21.15.70:0/3098797391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1d8109520 msgr2=0x7fc1d81036f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:19.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1d7e00700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1d8109520 0x7fc1d81036f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1d7e00700 1 -- 172.21.15.70:0/3098797391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d81a7ed0 con 0x7fc1d8102450 2024-05-08T07:59:19.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1dd400700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1d8109520 0x7fc1d81036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T07:59:19.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1d7e00700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 0x7fc1d81031b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c970 tx=0x7fc1c400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:59:19.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1d5600700 1 -- 172.21.15.70:0/3098797391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4007aa0 con 0x7fc1d8102450 2024-05-08T07:59:19.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1d5600700 1 -- 172.21.15.70:0/3098797391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1c4004cc0 con 0x7fc1d8102450 2024-05-08T07:59:19.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d81a8160 con 0x7fc1d8102450 2024-05-08T07:59:19.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1d5600700 1 -- 172.21.15.70:0/3098797391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c4005500 con 0x7fc1d8102450 2024-05-08T07:59:19.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.055+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d81a8650 con 0x7fc1d8102450 2024-05-08T07:59:19.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.057+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d806a190 con 0x7fc1d8102450 2024-05-08T07:59:19.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.059+0000 7fc1d5600700 1 -- 172.21.15.70:0/3098797391 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc1c4007c40 con 0x7fc1d8102450 2024-05-08T07:59:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.062+0000 7fc1d5600700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1c00b29f0 0x7fc1c00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:19.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.062+0000 7fc1d5600700 1 -- 172.21.15.70:0/3098797391 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(225..225 src has 1..225) ==== 9583+0+0 (secure 0 0 0) 0x7fc1c40e2bc0 con 0x7fc1d8102450 2024-05-08T07:59:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.062+0000 7fc1dca00700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1c00b29f0 0x7fc1c00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.063+0000 7fc1dca00700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1c00b29f0 0x7fc1c00b4eb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc005fd0 tx=0x7fc1cc00af20 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:59:19.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.065+0000 7fc1d5600700 1 -- 172.21.15.70:0/3098797391 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc1c40aa240 con 0x7fc1d8102450 2024-05-08T07:59:19.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.346+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1d802e510 con 0x7fc1d8102450 2024-05-08T07:59:19.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.349+0000 7fc1d5600700 1 -- 172.21.15.70:0/3098797391 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fc1c40a9b40 con 0x7fc1d8102450 2024-05-08T07:59:19.344 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T07:59:19.345 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T07:59:19.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1c00b29f0 msgr2=0x7fc1c00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:19.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1c00b29f0 0x7fc1c00b4eb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc005fd0 tx=0x7fc1cc00af20 comp rx=0 tx=0).stop 2024-05-08T07:59:19.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 msgr2=0x7fc1d81031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:19.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 0x7fc1d81031b0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc1c400c970 tx=0x7fc1c400cd30 comp rx=0 tx=0).stop 2024-05-08T07:59:19.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 shutdown_connections 2024-05-08T07:59:19.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1c00b29f0 0x7fc1c00b4eb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1d8109520 0x7fc1d81036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1d8101a90 0x7fc1d8102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 --2- 172.21.15.70:0/3098797391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1d8102450 0x7fc1d81031b0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:19.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.352+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 >> 172.21.15.70:0/3098797391 conn(0x7fc1d8078a10 msgr2=0x7fc1d81000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:59:19.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.353+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 shutdown_connections 2024-05-08T07:59:19.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:19.353+0000 7fc1df400700 1 -- 172.21.15.70:0/3098797391 wait complete. 2024-05-08T07:59:19.349 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T07:59:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:19 smithi194 ceph-mon[33679]: osdmap e225: 12 total, 12 up, 12 in 2024-05-08T07:59:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:19 smithi194 ceph-mon[33679]: pgmap v2317: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T07:59:20.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:19 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3098797391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:59:20.069 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:19 smithi070 ceph-mon[29591]: osdmap e225: 12 total, 12 up, 12 in 2024-05-08T07:59:20.070 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:19 smithi070 ceph-mon[29591]: pgmap v2317: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T07:59:20.070 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:19 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3098797391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:59:20.120 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id fd5dc58c --release --await' 2024-05-08T07:59:20.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id fd5dc58c --release --await 2024-05-08T07:59:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:19 smithi172 ceph-mon[33377]: osdmap e225: 12 total, 12 up, 12 in 2024-05-08T07:59:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:19 smithi172 ceph-mon[33377]: pgmap v2317: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T07:59:20.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:19 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3098797391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T07:59:20.561 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T07:59:21.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:21 smithi070 ceph-mon[29591]: pgmap v2318: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 312 B/s wr, 6 op/s 2024-05-08T07:59:21.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:59:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:21 smithi172 ceph-mon[33377]: pgmap v2318: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 312 B/s wr, 6 op/s 2024-05-08T07:59:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:59:22.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:21 smithi194 ceph-mon[33679]: pgmap v2318: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 312 B/s wr, 6 op/s 2024-05-08T07:59:22.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T07:59:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.666+0000 7fcc5d000700 1 -- 172.21.15.70:0/2918210225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 msgr2=0x7fcc5810fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.666+0000 7fcc5d000700 1 --2- 172.21.15.70:0/2918210225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 0x7fcc5810fa10 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009990 tx=0x7fcc44009ca0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.666+0000 7fcc5d000700 1 -- 172.21.15.70:0/2918210225 shutdown_connections 2024-05-08T07:59:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.666+0000 7fcc5d000700 1 --2- 172.21.15.70:0/2918210225 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc5810ff50 0x7fcc58112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.666+0000 7fcc5d000700 1 --2- 172.21.15.70:0/2918210225 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5806b1b0 0x7fcc5806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.666+0000 7fcc5d000700 1 --2- 172.21.15.70:0/2918210225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 0x7fcc5810fa10 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.666+0000 7fcc5d000700 1 -- 172.21.15.70:0/2918210225 >> 172.21.15.70:0/2918210225 conn(0x7fcc58079350 msgr2=0x7fcc58079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:59:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.666+0000 7fcc5d000700 1 -- 172.21.15.70:0/2918210225 shutdown_connections 2024-05-08T07:59:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.666+0000 7fcc5d000700 1 -- 172.21.15.70:0/2918210225 wait complete. 2024-05-08T07:59:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.668+0000 7fcc5d000700 1 Processor -- start 2024-05-08T07:59:23.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.668+0000 7fcc5d000700 1 -- start start 2024-05-08T07:59:23.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.668+0000 7fcc5d000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5806b1b0 0x7fcc581a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.668+0000 7fcc5d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 0x7fcc581a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.668+0000 7fcc5d000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc5810ff50 0x7fcc5819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.668+0000 7fcc5d000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcc58115730 con 0x7fcc5806bad0 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.668+0000 7fcc5d000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581155b0 con 0x7fcc5810ff50 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.668+0000 7fcc5d000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581158b0 con 0x7fcc5806b1b0 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 0x7fcc581a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 0x7fcc581a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47114/0 (socket says 172.21.15.70:47114) 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc55400700 1 -- 172.21.15.70:0/3641402746 learned_addr learned my addr 172.21.15.70:0/3641402746 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc55e00700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5806b1b0 0x7fcc581a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc56800700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc5810ff50 0x7fcc5819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc55400700 1 -- 172.21.15.70:0/3641402746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5806b1b0 msgr2=0x7fcc581a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:23.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc55400700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5806b1b0 0x7fcc581a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc55400700 1 -- 172.21.15.70:0/3641402746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc5810ff50 msgr2=0x7fcc5819baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc55400700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc5810ff50 0x7fcc5819baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.669+0000 7fcc55400700 1 -- 172.21.15.70:0/3641402746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc5819c250 con 0x7fcc5806bad0 2024-05-08T07:59:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.670+0000 7fcc55400700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 0x7fcc581a1e70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fcc440057c0 tx=0x7fcc44009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:59:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.670+0000 7fcc4ea00700 1 -- 172.21.15.70:0/3641402746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44027070 con 0x7fcc5806bad0 2024-05-08T07:59:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.670+0000 7fcc4ea00700 1 -- 172.21.15.70:0/3641402746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc4400fda0 con 0x7fcc5806bad0 2024-05-08T07:59:23.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.670+0000 7fcc5d000700 1 -- 172.21.15.70:0/3641402746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5819c4e0 con 0x7fcc5806bad0 2024-05-08T07:59:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.670+0000 7fcc4ea00700 1 -- 172.21.15.70:0/3641402746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44022ca0 con 0x7fcc5806bad0 2024-05-08T07:59:23.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.670+0000 7fcc5d000700 1 -- 172.21.15.70:0/3641402746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc581a8800 con 0x7fcc5806bad0 2024-05-08T07:59:23.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.674+0000 7fcc4ea00700 1 -- 172.21.15.70:0/3641402746 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fcc4402a070 con 0x7fcc5806bad0 2024-05-08T07:59:23.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.675+0000 7fcc4ea00700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2af0 0x7fcc3c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.676+0000 7fcc4ea00700 1 -- 172.21.15.70:0/3641402746 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(225..225 src has 1..225) ==== 9583+0+0 (secure 0 0 0) 0x7fcc440e3890 con 0x7fcc5806bad0 2024-05-08T07:59:23.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.676+0000 7fcc55e00700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2af0 0x7fcc3c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.676+0000 7fcc55e00700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2af0 0x7fcc3c0b4fb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcc48005950 tx=0x7fcc480058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:59:23.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.695+0000 7fcc67974b80 1 Processor -- start 2024-05-08T07:59:23.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.695+0000 7fcc67974b80 1 -- start start 2024-05-08T07:59:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e06187e80 0x563e06188260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e0618c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 0x563e0618cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc67974b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e060d1b20 con 0x563e061887a0 2024-05-08T07:59:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc67974b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563e0606f860 con 0x563e0618c790 2024-05-08T07:59:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc67974b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563e060cdae0 con 0x563e06187e80 2024-05-08T07:59:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e0618c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e0618c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47120/0 (socket says 172.21.15.70:47120) 2024-05-08T07:59:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc55400700 1 -- 172.21.15.70:0/2975906157 learned_addr learned my addr 172.21.15.70:0/2975906157 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:59:23.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc55e00700 1 --2- 172.21.15.70:0/2975906157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e06187e80 0x563e06188260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.696+0000 7fcc56800700 1 --2- 172.21.15.70:0/2975906157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 0x563e0618cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.697+0000 7fcc55400700 1 -- 172.21.15.70:0/2975906157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e06187e80 msgr2=0x563e06188260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:59:23.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.697+0000 7fcc55400700 1 --2- 172.21.15.70:0/2975906157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e06187e80 0x563e06188260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.697+0000 7fcc55400700 1 -- 172.21.15.70:0/2975906157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 msgr2=0x563e0618cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:59:23.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.697+0000 7fcc55400700 1 --2- 172.21.15.70:0/2975906157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 0x563e0618cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.697+0000 7fcc55400700 1 -- 172.21.15.70:0/2975906157 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0601e9d0 con 0x563e061887a0 2024-05-08T07:59:23.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.697+0000 7fcc55400700 1 --2- 172.21.15.70:0/2975906157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e0618c250 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcc440a6800 tx=0x7fcc440aa200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92b5c6936d684b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:59:23.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.697+0000 7fcc43400700 1 -- 172.21.15.70:0/2975906157 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc440e0ff0 con 0x563e061887a0 2024-05-08T07:59:23.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.697+0000 7fcc43400700 1 -- 172.21.15.70:0/2975906157 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc440aa290 con 0x563e061887a0 2024-05-08T07:59:23.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.697+0000 7fcc43400700 1 -- 172.21.15.70:0/2975906157 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc440922d0 con 0x563e061887a0 2024-05-08T07:59:23.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.698+0000 7fcc67974b80 1 -- 172.21.15.70:0/2975906157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 msgr2=0x563e0618c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:23.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.698+0000 7fcc67974b80 1 --2- 172.21.15.70:0/2975906157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e0618c250 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcc440a6800 tx=0x7fcc440aa200 comp rx=0 tx=0).stop 2024-05-08T07:59:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.699+0000 7fcc67974b80 1 -- 172.21.15.70:0/2975906157 shutdown_connections 2024-05-08T07:59:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.699+0000 7fcc67974b80 1 --2- 172.21.15.70:0/2975906157 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 0x563e0618cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.699+0000 7fcc67974b80 1 --2- 172.21.15.70:0/2975906157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e06187e80 0x563e06188260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.699+0000 7fcc67974b80 1 --2- 172.21.15.70:0/2975906157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e0618c250 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.699+0000 7fcc67974b80 1 -- 172.21.15.70:0/2975906157 >> 172.21.15.70:0/2975906157 conn(0x563e060adc60 msgr2=0x563e06179d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:59:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.699+0000 7fcc67974b80 1 -- 172.21.15.70:0/2975906157 shutdown_connections 2024-05-08T07:59:23.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.699+0000 7fcc67974b80 1 -- 172.21.15.70:0/2975906157 wait complete. 2024-05-08T07:59:23.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.700+0000 7fcc67974b80 1 -- start start 2024-05-08T07:59:23.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.700+0000 7fcc67974b80 1 Processor -- start 2024-05-08T07:59:23.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.700+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 0x563e06193c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.700+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06190ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.700+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 0x563e06191530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.700+0000 7fcc67974b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e061947f0 con 0x563e061887a0 2024-05-08T07:59:23.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.700+0000 7fcc67974b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563e06037c20 con 0x563e06187e80 2024-05-08T07:59:23.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.701+0000 7fcc67974b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563e06194970 con 0x563e0618c790 2024-05-08T07:59:23.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.701+0000 7fcc67974b80 10 client.0 _ll_register_callbacks cb 0x563e06078d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.701+0000 7fcc55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06190ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.701+0000 7fcc55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06190ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47134/0 (socket says 172.21.15.70:47134) 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.701+0000 7fcc55400700 1 -- 172.21.15.70:0/1057599149 learned_addr learned my addr 172.21.15.70:0/1057599149 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.701+0000 7fcc55e00700 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 0x563e06193c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.701+0000 7fcc56800700 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 0x563e06191530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.701+0000 7fcc55400700 1 -- 172.21.15.70:0/1057599149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 msgr2=0x563e06191530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc55400700 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 0x563e06191530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc55400700 1 -- 172.21.15.70:0/1057599149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 msgr2=0x563e06193c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc55400700 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 0x563e06193c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc55400700 1 -- 172.21.15.70:0/1057599149 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e06097520 con 0x563e061887a0 2024-05-08T07:59:23.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc55e00700 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 0x563e06193c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T07:59:23.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc55400700 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06190ff0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcc44005f50 tx=0x7fcc44009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987e213c9f7a3a99 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:59:23.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc37e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc37e00700 1 -- 172.21.15.70:0/1057599149 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc440e0ff0 con 0x563e061887a0 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc37e00700 1 -- 172.21.15.70:0/1057599149 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(225..225 src has 1..225) ==== 9583+0+0 (secure 0 0 0) 0x7fcc440b32d0 con 0x563e061887a0 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.702+0000 7fcc67974b80 1 -- 172.21.15.70:0/1057599149 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc440aa290 con 0x563e061887a0 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.703+0000 7fcc37e00700 1 -- 172.21.15.70:0/1057599149 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcc440aa780 con 0x563e061887a0 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.703+0000 7fcc67974b80 10 client.17469 fetch_fsmap learned FSMap version 42 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.703+0000 7fcc67974b80 1 -- 172.21.15.70:0/1057599149 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563e061947f0 con 0x563e061887a0 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.703+0000 7fcc37e00700 1 -- 172.21.15.70:0/1057599149 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc440aa290 con 0x563e061887a0 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.703+0000 7fcc37e00700 1 -- 172.21.15.70:0/1057599149 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fcc4400f910 con 0x563e061887a0 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.703+0000 7fcc67974b80 10 client.17469 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:59:23.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.703+0000 7fcc67974b80 10 client.17469 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:59:23.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.704+0000 7fcc67974b80 20 client.17469 populate_metadata read hostname 'smithi070' 2024-05-08T07:59:23.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.704+0000 7fcc67974b80 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e061a1310 0x563e061a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.704+0000 7fcc67974b80 4 client.17469 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T07:59:23.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.704+0000 7fcc67974b80 1 -- 172.21.15.70:0/1057599149 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e0614c1a0 con 0x563e061a1310 2024-05-08T07:59:23.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.704+0000 7fcc55e00700 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e061a1310 0x563e061a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.705+0000 7fcc37e00700 10 client.17469 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:59:23.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.705+0000 7fcc55e00700 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e061a1310 0x563e061a3720 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11d0189ba2bf035f server_cookie=c24c7fe74f938590 in_seq=0 out_seq=0 2024-05-08T07:59:23.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.707+0000 7fcc37e00700 1 -- 172.21.15.70:0/1057599149 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563e0614c1a0 con 0x563e061a1310 2024-05-08T07:59:23.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.707+0000 7fcc37e00700 10 client.17469 handle_command_reply: tid=0 2024-05-08T07:59:23.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 client.17469 shutdown 2024-05-08T07:59:23.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 -- 172.21.15.70:0/1057599149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 msgr2=0x563e06190ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:23.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06190ff0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcc44005f50 tx=0x7fcc44009ca0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 -- 172.21.15.70:0/1057599149 shutdown_connections 2024-05-08T07:59:23.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e061a1310 0x563e061a3720 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 0x563e06191530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 0x563e06193c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 --2- 172.21.15.70:0/1057599149 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06190ff0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 -- 172.21.15.70:0/1057599149 >> 172.21.15.70:0/1057599149 conn(0x563e060adc60 msgr2=0x563e0618dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:59:23.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc37e00700 0 client.17469 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:59:23.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 -- 172.21.15.70:0/1057599149 shutdown_connections 2024-05-08T07:59:23.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 1 -- 172.21.15.70:0/1057599149 wait complete. 2024-05-08T07:59:23.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.708+0000 7fcc67974b80 20 client.17469 trim_cache size 0 max 16384 2024-05-08T07:59:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.730+0000 7fcc67974b80 1 Processor -- start 2024-05-08T07:59:23.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc67974b80 1 -- start start 2024-05-08T07:59:23.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e06187e80 0x563e0619d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e061887a0 0x563e061a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 0x563e061a9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc67974b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581afc80 con 0x563e06187e80 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc67974b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581ad510 con 0x563e0618c790 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc67974b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581ab380 con 0x563e061887a0 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc55e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e06187e80 0x563e0619d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc55e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e06187e80 0x563e0619d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47146/0 (socket says 172.21.15.70:47146) 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.731+0000 7fcc55e00700 1 -- 172.21.15.70:0/2624498426 learned_addr learned my addr 172.21.15.70:0/2624498426 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.732+0000 7fcc55400700 1 --2- 172.21.15.70:0/2624498426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e061887a0 0x563e061a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.732+0000 7fcc55e00700 1 -- 172.21.15.70:0/2624498426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e061887a0 msgr2=0x563e061a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.732+0000 7fcc55e00700 1 --2- 172.21.15.70:0/2624498426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e061887a0 0x563e061a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.732+0000 7fcc56800700 1 --2- 172.21.15.70:0/2624498426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 0x563e061a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.732+0000 7fcc55e00700 1 -- 172.21.15.70:0/2624498426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 msgr2=0x563e061a9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:59:23.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.732+0000 7fcc55e00700 1 --2- 172.21.15.70:0/2624498426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 0x563e061a9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.732+0000 7fcc55e00700 1 -- 172.21.15.70:0/2624498426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e0618eb80 con 0x563e06187e80 2024-05-08T07:59:23.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.732+0000 7fcc55e00700 1 --2- 172.21.15.70:0/2624498426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e06187e80 0x563e0619d840 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x563e061a3f90 tx=0x7fcc48015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49020fe728f9210 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.733+0000 7fcc42a00700 1 -- 172.21.15.70:0/2624498426 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48021dc0 con 0x563e06187e80 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.733+0000 7fcc42a00700 1 -- 172.21.15.70:0/2624498426 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc4802f070 con 0x563e06187e80 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.733+0000 7fcc42a00700 1 -- 172.21.15.70:0/2624498426 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48011a70 con 0x563e06187e80 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 -- 172.21.15.70:0/2624498426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e06187e80 msgr2=0x563e0619d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 --2- 172.21.15.70:0/2624498426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e06187e80 0x563e0619d840 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x563e061a3f90 tx=0x7fcc48015000 comp rx=0 tx=0).stop 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 -- 172.21.15.70:0/2624498426 shutdown_connections 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 --2- 172.21.15.70:0/2624498426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e0618c790 0x563e061a9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 --2- 172.21.15.70:0/2624498426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e06187e80 0x563e0619d840 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 --2- 172.21.15.70:0/2624498426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e061887a0 0x563e061a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 -- 172.21.15.70:0/2624498426 >> 172.21.15.70:0/2624498426 conn(0x563e060adc60 msgr2=0x563e06173fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:59:23.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 -- 172.21.15.70:0/2624498426 shutdown_connections 2024-05-08T07:59:23.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 -- 172.21.15.70:0/2624498426 wait complete. 2024-05-08T07:59:23.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.734+0000 7fcc67974b80 1 -- start start 2024-05-08T07:59:23.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc67974b80 1 Processor -- start 2024-05-08T07:59:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 0x563e061989f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06198f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc67974b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 0x563e06199470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc67974b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581ab9d0 con 0x563e061887a0 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc67974b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581ace40 con 0x563e06187e80 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc67974b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc581ac0a0 con 0x563e0618c790 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc67974b80 10 client.0 _ll_register_callbacks cb 0x563e06078d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06198f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47154/0 (socket says 172.21.15.70:47154) 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.735+0000 7fcc55400700 1 -- 172.21.15.70:0/3625816587 learned_addr learned my addr 172.21.15.70:0/3625816587 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.736+0000 7fcc55e00700 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 0x563e061989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.736+0000 7fcc56800700 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 0x563e06199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.736+0000 7fcc55400700 1 -- 172.21.15.70:0/3625816587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 msgr2=0x563e06199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.736+0000 7fcc55400700 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 0x563e06199470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.736+0000 7fcc55400700 1 -- 172.21.15.70:0/3625816587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 msgr2=0x563e061989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T07:59:23.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.736+0000 7fcc55400700 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 0x563e061989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.736+0000 7fcc55400700 1 -- 172.21.15.70:0/3625816587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e0620bdf0 con 0x563e061887a0 2024-05-08T07:59:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.736+0000 7fcc55400700 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06198f30 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fcc44005560 tx=0x7fcc44009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c1a9329b931755 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T07:59:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.736+0000 7fcc37e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T07:59:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.737+0000 7fcc37e00700 1 -- 172.21.15.70:0/3625816587 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc440e0ff0 con 0x563e061887a0 2024-05-08T07:59:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.737+0000 7fcc37e00700 1 -- 172.21.15.70:0/3625816587 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(225..225 src has 1..225) ==== 9583+0+0 (secure 0 0 0) 0x7fcc440e33a0 con 0x563e061887a0 2024-05-08T07:59:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.737+0000 7fcc67974b80 1 -- 172.21.15.70:0/3625816587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc4802f070 con 0x563e061887a0 2024-05-08T07:59:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.737+0000 7fcc37e00700 1 -- 172.21.15.70:0/3625816587 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcc4400fb20 con 0x563e061887a0 2024-05-08T07:59:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.737+0000 7fcc67974b80 10 client.17475 fetch_fsmap learned FSMap version 42 2024-05-08T07:59:23.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.737+0000 7fcc67974b80 1 -- 172.21.15.70:0/3625816587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563e0620bdf0 con 0x563e061887a0 2024-05-08T07:59:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.737+0000 7fcc37e00700 1 -- 172.21.15.70:0/3625816587 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc4802f070 con 0x563e061887a0 2024-05-08T07:59:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.737+0000 7fcc37e00700 1 -- 172.21.15.70:0/3625816587 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fcc440a60f0 con 0x563e061887a0 2024-05-08T07:59:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.738+0000 7fcc67974b80 10 client.17475 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T07:59:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.738+0000 7fcc67974b80 10 client.17475 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T07:59:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.738+0000 7fcc67974b80 20 client.17475 populate_metadata read hostname 'smithi070' 2024-05-08T07:59:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.738+0000 7fcc67974b80 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e0620d420 0x563e0620f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T07:59:23.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.738+0000 7fcc67974b80 4 client.17475 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fd5dc58c", "release": true, "await": true}] 2024-05-08T07:59:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.738+0000 7fcc67974b80 1 -- 172.21.15.70:0/3625816587 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fd5dc58c", "release": true, "await": true}) -- 0x563e060df500 con 0x563e0620d420 2024-05-08T07:59:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.738+0000 7fcc55e00700 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e0620d420 0x563e0620f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T07:59:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.739+0000 7fcc55e00700 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e0620d420 0x563e0620f840 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b85bd318c7939a86 server_cookie=1d4f2ebc7dce57b4 in_seq=0 out_seq=0 2024-05-08T07:59:23.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:23.739+0000 7fcc37e00700 10 client.17475 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T07:59:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:23 smithi070 ceph-mon[29591]: pgmap v2319: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:59:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:59:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:59:24.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:59:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:23 smithi172 ceph-mon[33377]: pgmap v2319: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:59:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:59:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:59:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:59:24.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:23 smithi194 ceph-mon[33679]: pgmap v2319: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T07:59:24.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T07:59:24.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T07:59:24.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T07:59:26.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:25 smithi070 ceph-mon[29591]: pgmap v2320: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:59:26.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:25 smithi172 ceph-mon[33377]: pgmap v2320: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:59:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:25 smithi194 ceph-mon[33679]: pgmap v2320: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:59:28.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:27 smithi070 ceph-mon[29591]: pgmap v2321: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:59:28.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:27 smithi172 ceph-mon[33377]: pgmap v2321: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:59:28.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.206+0000 7fcc37e00700 1 -- 172.21.15.70:0/3625816587 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x563e060df500 con 0x563e0620d420 2024-05-08T07:59:28.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.206+0000 7fcc37e00700 10 client.17475 handle_command_reply: tid=0 2024-05-08T07:59:28.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.206+0000 7fcc67974b80 1 client.17475 shutdown 2024-05-08T07:59:28.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.206+0000 7fcc67974b80 1 -- 172.21.15.70:0/3625816587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 msgr2=0x563e06198f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:28.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.206+0000 7fcc67974b80 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06198f30 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fcc44005560 tx=0x7fcc44009640 comp rx=0 tx=0).stop 2024-05-08T07:59:28.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.207+0000 7fcc67974b80 1 -- 172.21.15.70:0/3625816587 shutdown_connections 2024-05-08T07:59:28.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.207+0000 7fcc67974b80 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e0620d420 0x563e0620f840 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:28.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.207+0000 7fcc67974b80 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e0618c790 0x563e06199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:28.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.207+0000 7fcc67974b80 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e06187e80 0x563e061989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:28.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.207+0000 7fcc67974b80 1 --2- 172.21.15.70:0/3625816587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e061887a0 0x563e06198f30 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:28.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.207+0000 7fcc37e00700 0 client.17475 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T07:59:28.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.207+0000 7fcc67974b80 1 -- 172.21.15.70:0/3625816587 >> 172.21.15.70:0/3625816587 conn(0x563e060adc60 msgr2=0x563e0617e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:59:28.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.207+0000 7fcc67974b80 1 -- 172.21.15.70:0/3625816587 shutdown_connections 2024-05-08T07:59:28.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.207+0000 7fcc67974b80 1 -- 172.21.15.70:0/3625816587 wait complete. 2024-05-08T07:59:28.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.208+0000 7fcc67974b80 20 client.17475 trim_cache size 0 max 16384 2024-05-08T07:59:28.202 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T07:59:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T07:59:28.202 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 176, 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "fd5dc58c": { 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 176, 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.8, 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T07:59:28.203 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T07:59:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T07:59:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T07:59:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:59:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:59:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:59:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:59:28.204 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T07:59:28.204 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 -- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2af0 msgr2=0x7fcc3c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2af0 0x7fcc3c0b4fb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcc48005950 tx=0x7fcc480058e0 comp rx=0 tx=0).stop 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 -- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 msgr2=0x7fcc581a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 0x7fcc581a1e70 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fcc440057c0 tx=0x7fcc44009f90 comp rx=0 tx=0).stop 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 -- 172.21.15.70:0/3641402746 shutdown_connections 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc3c0b2af0 0x7fcc3c0b4fb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc5810ff50 0x7fcc5819baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc5806b1b0 0x7fcc581a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 --2- 172.21.15.70:0/3641402746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc5806bad0 0x7fcc581a1e70 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.209+0000 7fcc5d000700 1 -- 172.21.15.70:0/3641402746 >> 172.21.15.70:0/3641402746 conn(0x7fcc58079350 msgr2=0x7fcc58111460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T07:59:28.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.210+0000 7fcc5d000700 1 -- 172.21.15.70:0/3641402746 shutdown_connections 2024-05-08T07:59:28.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T07:59:28.210+0000 7fcc5d000700 1 -- 172.21.15.70:0/3641402746 wait complete. 2024-05-08T07:59:28.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:27 smithi194 ceph-mon[33679]: pgmap v2321: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:59:29.057 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fd5dc58c', seconds elapsed: 68.6 2024-05-08T07:59:29.645 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/generic_mpih-mul3.o 2024-05-08T07:59:30.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:29 smithi070 ceph-mon[29591]: pgmap v2322: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:59:30.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:29 smithi172 ceph-mon[33377]: pgmap v2322: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:59:30.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:29 smithi194 ceph-mon[33679]: pgmap v2322: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T07:59:30.801 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/notif.o 2024-05-08T07:59:30.875 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/irqchip/built-in.a 2024-05-08T07:59:31.001 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/acl.o 2024-05-08T07:59:31.009 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_dynevent.o 2024-05-08T07:59:31.117 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/probe_roms.o 2024-05-08T07:59:31.181 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-mq-pci.o 2024-05-08T07:59:31.248 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/bus/mhi/built-in.a 2024-05-08T07:59:31.353 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/bus/built-in.a 2024-05-08T07:59:31.398 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ext4/xattr_security.o 2024-05-08T07:59:31.511 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pwm/built-in.a 2024-05-08T07:59:31.892 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/msi/pcidev_msi.o 2024-05-08T07:59:32.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:31 smithi070 ceph-mon[29591]: pgmap v2323: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-05-08T07:59:32.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:31 smithi172 ceph-mon[33377]: pgmap v2323: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-05-08T07:59:32.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:31 smithi194 ceph-mon[33679]: pgmap v2323: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-05-08T07:59:34.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:33 smithi070 ceph-mon[29591]: pgmap v2324: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-05-08T07:59:34.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:33 smithi172 ceph-mon[33377]: pgmap v2324: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-05-08T07:59:34.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:33 smithi194 ceph-mon[33679]: pgmap v2324: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 120 KiB/s wr, 11 op/s 2024-05-08T07:59:36.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:35 smithi070 ceph-mon[29591]: pgmap v2325: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 260 KiB/s wr, 22 op/s 2024-05-08T07:59:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:35 smithi172 ceph-mon[33377]: pgmap v2325: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 260 KiB/s wr, 22 op/s 2024-05-08T07:59:36.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:35 smithi194 ceph-mon[33679]: pgmap v2325: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 260 KiB/s wr, 22 op/s 2024-05-08T07:59:37.589 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/generic_mpih-rshift.o 2024-05-08T07:59:38.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:37 smithi070 ceph-mon[29591]: pgmap v2326: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 260 KiB/s wr, 19 op/s 2024-05-08T07:59:38.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:37 smithi172 ceph-mon[33377]: pgmap v2326: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 260 KiB/s wr, 19 op/s 2024-05-08T07:59:38.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:37 smithi194 ceph-mon[33679]: pgmap v2326: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 260 KiB/s wr, 19 op/s 2024-05-08T07:59:40.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:39 smithi194 ceph-mon[33679]: pgmap v2327: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 260 KiB/s wr, 19 op/s 2024-05-08T07:59:40.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:39 smithi070 ceph-mon[29591]: pgmap v2327: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 260 KiB/s wr, 19 op/s 2024-05-08T07:59:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:39 smithi172 ceph-mon[33377]: pgmap v2327: 129 pgs: 129 active+clean; 1.8 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 260 KiB/s wr, 19 op/s 2024-05-08T07:59:40.665 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-mq-virtio.o 2024-05-08T07:59:40.687 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/sys_ia32.o 2024-05-08T07:59:40.868 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-mq-debugfs.o 2024-05-08T07:59:41.088 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/msi/api.o 2024-05-08T07:59:41.287 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_probe.o 2024-05-08T07:59:41.369 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/ext4/built-in.a 2024-05-08T07:59:42.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:41 smithi070 ceph-mon[29591]: pgmap v2328: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 484 KiB/s wr, 144 op/s 2024-05-08T07:59:42.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:41 smithi172 ceph-mon[33377]: pgmap v2328: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 484 KiB/s wr, 144 op/s 2024-05-08T07:59:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:41 smithi194 ceph-mon[33679]: pgmap v2328: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 484 KiB/s wr, 144 op/s 2024-05-08T07:59:42.844 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ramfs/inode.o 2024-05-08T07:59:43.189 INFO:tasks.workunit.client.0.smithi070.stdout: CC io_uring/io-wq.o 2024-05-08T07:59:44.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:43 smithi070 ceph-mon[29591]: pgmap v2329: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 364 KiB/s wr, 135 op/s 2024-05-08T07:59:44.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:43 smithi172 ceph-mon[33377]: pgmap v2329: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 364 KiB/s wr, 135 op/s 2024-05-08T07:59:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:43 smithi194 ceph-mon[33679]: pgmap v2329: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 364 KiB/s wr, 135 op/s 2024-05-08T07:59:46.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:45 smithi070 ceph-mon[29591]: pgmap v2330: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 500 KiB/s wr, 144 op/s 2024-05-08T07:59:46.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:45 smithi172 ceph-mon[33377]: pgmap v2330: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 500 KiB/s wr, 144 op/s 2024-05-08T07:59:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:45 smithi194 ceph-mon[33679]: pgmap v2330: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 500 KiB/s wr, 144 op/s 2024-05-08T07:59:46.367 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/generic_mpih-sub1.o 2024-05-08T07:59:48.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:47 smithi070 ceph-mon[29591]: pgmap v2331: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 360 KiB/s wr, 133 op/s 2024-05-08T07:59:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:47 smithi172 ceph-mon[33377]: pgmap v2331: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 360 KiB/s wr, 133 op/s 2024-05-08T07:59:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:47 smithi194 ceph-mon[33679]: pgmap v2331: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 360 KiB/s wr, 133 op/s 2024-05-08T07:59:50.116 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/generic_mpih-add1.o 2024-05-08T07:59:50.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:49 smithi070 ceph-mon[29591]: pgmap v2332: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 360 KiB/s wr, 133 op/s 2024-05-08T07:59:50.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:49 smithi172 ceph-mon[33377]: pgmap v2332: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 360 KiB/s wr, 133 op/s 2024-05-08T07:59:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:49 smithi194 ceph-mon[33679]: pgmap v2332: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 360 KiB/s wr, 133 op/s 2024-05-08T07:59:50.701 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/blk-pm.o 2024-05-08T07:59:50.968 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/msi/msi.o 2024-05-08T07:59:51.997 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ramfs/file-mmu.o 2024-05-08T07:59:52.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:51 smithi070 ceph-mon[29591]: pgmap v2333: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 492 KiB/s wr, 204 op/s 2024-05-08T07:59:52.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:51 smithi172 ceph-mon[33377]: pgmap v2333: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 492 KiB/s wr, 204 op/s 2024-05-08T07:59:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:51 smithi194 ceph-mon[33679]: pgmap v2333: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 422 KiB/s rd, 492 KiB/s wr, 204 op/s 2024-05-08T07:59:52.518 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/signal_32.o 2024-05-08T07:59:53.005 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/trace_uprobe.o 2024-05-08T07:59:53.665 INFO:tasks.workunit.client.0.smithi070.stdout: AR io_uring/built-in.a 2024-05-08T07:59:54.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:53 smithi070 ceph-mon[29591]: pgmap v2334: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 268 KiB/s wr, 79 op/s 2024-05-08T07:59:54.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:53 smithi172 ceph-mon[33377]: pgmap v2334: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 268 KiB/s wr, 79 op/s 2024-05-08T07:59:54.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:53 smithi194 ceph-mon[33679]: pgmap v2334: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 268 KiB/s wr, 79 op/s 2024-05-08T07:59:54.442 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/trace/rethook.o 2024-05-08T07:59:55.134 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq.o 2024-05-08T07:59:56.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:55 smithi070 ceph-mon[29591]: pgmap v2335: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 503 KiB/s wr, 91 op/s 2024-05-08T07:59:56.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:55 smithi172 ceph-mon[33377]: pgmap v2335: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 503 KiB/s wr, 91 op/s 2024-05-08T07:59:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:55 smithi194 ceph-mon[33679]: pgmap v2335: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 503 KiB/s wr, 91 op/s 2024-05-08T07:59:57.986 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/ec.o 2024-05-08T07:59:58.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:57 smithi070 ceph-mon[29591]: pgmap v2336: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 366 KiB/s wr, 82 op/s 2024-05-08T07:59:58.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:57 smithi172 ceph-mon[33377]: pgmap v2336: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 366 KiB/s wr, 82 op/s 2024-05-08T07:59:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:57 smithi194 ceph-mon[33679]: pgmap v2336: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 366 KiB/s wr, 82 op/s 2024-05-08T07:59:59.512 INFO:tasks.workunit.client.0.smithi070.stdout: CC block/holder.o 2024-05-08T07:59:59.699 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/ramfs/built-in.a 2024-05-08T08:00:00.051 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/hugetlbfs/inode.o 2024-05-08T08:00:00.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 07:59:59 smithi070 ceph-mon[29591]: pgmap v2337: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 366 KiB/s wr, 82 op/s 2024-05-08T08:00:00.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 07:59:59 smithi172 ceph-mon[33377]: pgmap v2337: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 366 KiB/s wr, 82 op/s 2024-05-08T08:00:00.211 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/msi/irqdomain.o 2024-05-08T08:00:00.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 07:59:59 smithi194 ceph-mon[33679]: pgmap v2337: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 366 KiB/s wr, 82 op/s 2024-05-08T08:00:01.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T08:00:01.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T08:00:01.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T08:00:02.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:01 smithi172 ceph-mon[33377]: pgmap v2338: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 558 KiB/s wr, 210 op/s 2024-05-08T08:00:02.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:01 smithi194 ceph-mon[33679]: pgmap v2338: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 558 KiB/s wr, 210 op/s 2024-05-08T08:00:02.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:01 smithi070 ceph-mon[29591]: pgmap v2338: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 558 KiB/s wr, 210 op/s 2024-05-08T08:00:03.749 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/sys_x86_64.o 2024-05-08T08:00:03.894 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_lock.o 2024-05-08T08:00:04.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:03 smithi172 ceph-mon[33377]: pgmap v2339: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 426 KiB/s wr, 139 op/s 2024-05-08T08:00:04.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:03 smithi194 ceph-mon[33679]: pgmap v2339: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 426 KiB/s wr, 139 op/s 2024-05-08T08:00:04.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:03 smithi070 ceph-mon[29591]: pgmap v2339: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 426 KiB/s wr, 139 op/s 2024-05-08T08:00:05.144 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/i2c/other/built-in.a 2024-05-08T08:00:05.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:04 smithi172 ceph-mon[33377]: osdmap e226: 12 total, 12 up, 12 in 2024-05-08T08:00:05.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:04 smithi194 ceph-mon[33679]: osdmap e226: 12 total, 12 up, 12 in 2024-05-08T08:00:05.362 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/i2c/built-in.a 2024-05-08T08:00:05.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:04 smithi070 ceph-mon[29591]: osdmap e226: 12 total, 12 up, 12 in 2024-05-08T08:00:05.580 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/fork.o 2024-05-08T08:00:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:05 smithi172 ceph-mon[33377]: pgmap v2341: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 583 KiB/s wr, 191 op/s 2024-05-08T08:00:06.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:05 smithi194 ceph-mon[33679]: pgmap v2341: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 583 KiB/s wr, 191 op/s 2024-05-08T08:00:06.293 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:05 smithi070 ceph-mon[29591]: pgmap v2341: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 583 KiB/s wr, 191 op/s 2024-05-08T08:00:07.965 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/trace/built-in.a 2024-05-08T08:00:07.989 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpicoder.o 2024-05-08T08:00:08.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:07 smithi172 ceph-mon[33377]: pgmap v2342: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 583 KiB/s wr, 191 op/s 2024-05-08T08:00:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:07 smithi194 ceph-mon[33679]: pgmap v2342: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 583 KiB/s wr, 191 op/s 2024-05-08T08:00:08.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:07 smithi070 ceph-mon[29591]: pgmap v2342: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 583 KiB/s wr, 191 op/s 2024-05-08T08:00:09.228 INFO:tasks.workunit.client.0.smithi070.stdout: AR block/built-in.a 2024-05-08T08:00:09.457 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_clientmgr.o 2024-05-08T08:00:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:09 smithi194 ceph-mon[33679]: pgmap v2343: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 583 KiB/s wr, 191 op/s 2024-05-08T08:00:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:09 smithi070 ceph-mon[29591]: pgmap v2343: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 583 KiB/s wr, 191 op/s 2024-05-08T08:00:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:09 smithi172 ceph-mon[33377]: pgmap v2343: 129 pgs: 1 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 125 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 583 KiB/s wr, 191 op/s 2024-05-08T08:00:10.752 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/video/console/dummycon.o 2024-05-08T08:00:11.474 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fat/cache.o 2024-05-08T08:00:11.492 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pci/msi/built-in.a 2024-05-08T08:00:11.843 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/hugetlbfs/built-in.a 2024-05-08T08:00:11.928 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/pcie/portdrv.o 2024-05-08T08:00:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:11 smithi194 ceph-mon[33679]: pgmap v2344: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 571 KiB/s wr, 201 op/s 2024-05-08T08:00:12.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:11 smithi070 ceph-mon[29591]: pgmap v2344: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 571 KiB/s wr, 201 op/s 2024-05-08T08:00:12.405 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/sock.o 2024-05-08T08:00:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:11 smithi172 ceph-mon[33377]: pgmap v2344: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 571 KiB/s wr, 201 op/s 2024-05-08T08:00:14.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:13 smithi194 ceph-mon[33679]: pgmap v2345: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 571 KiB/s wr, 201 op/s 2024-05-08T08:00:14.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:13 smithi194 ceph-mon[33679]: osdmap e227: 12 total, 12 up, 12 in 2024-05-08T08:00:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:13 smithi070 ceph-mon[29591]: pgmap v2345: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 571 KiB/s wr, 201 op/s 2024-05-08T08:00:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:14 smithi070 ceph-mon[29591]: osdmap e227: 12 total, 12 up, 12 in 2024-05-08T08:00:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:13 smithi172 ceph-mon[33377]: pgmap v2345: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 571 KiB/s wr, 201 op/s 2024-05-08T08:00:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:13 smithi172 ceph-mon[33377]: osdmap e227: 12 total, 12 up, 12 in 2024-05-08T08:00:16.146 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/espfix_64.o 2024-05-08T08:00:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:15 smithi194 ceph-mon[33679]: pgmap v2347: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 534 KiB/s wr, 200 op/s 2024-05-08T08:00:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:15 smithi070 ceph-mon[29591]: pgmap v2347: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 534 KiB/s wr, 200 op/s 2024-05-08T08:00:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:15 smithi172 ceph-mon[33377]: pgmap v2347: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 534 KiB/s wr, 200 op/s 2024-05-08T08:00:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:17 smithi194 ceph-mon[33679]: pgmap v2348: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 534 KiB/s wr, 200 op/s 2024-05-08T08:00:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:17 smithi070 ceph-mon[29591]: pgmap v2348: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 534 KiB/s wr, 200 op/s 2024-05-08T08:00:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:17 smithi172 ceph-mon[33377]: pgmap v2348: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 534 KiB/s wr, 200 op/s 2024-05-08T08:00:18.657 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_memory.o 2024-05-08T08:00:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:19 smithi194 ceph-mon[33679]: pgmap v2349: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 534 KiB/s wr, 200 op/s 2024-05-08T08:00:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:19 smithi070 ceph-mon[29591]: pgmap v2349: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 534 KiB/s wr, 200 op/s 2024-05-08T08:00:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:19 smithi172 ceph-mon[33377]: pgmap v2349: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 534 KiB/s wr, 200 op/s 2024-05-08T08:00:20.716 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpi-add.o 2024-05-08T08:00:20.871 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fat/dir.o 2024-05-08T08:00:20.888 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/pcie/rcec.o 2024-05-08T08:00:20.900 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/video/console/vgacon.o 2024-05-08T08:00:21.565 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/exec_domain.o 2024-05-08T08:00:22.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:21 smithi194 ceph-mon[33679]: pgmap v2350: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 613 KiB/s wr, 140 op/s 2024-05-08T08:00:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:21 smithi070 ceph-mon[29591]: pgmap v2350: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 613 KiB/s wr, 140 op/s 2024-05-08T08:00:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:21 smithi172 ceph-mon[33377]: pgmap v2350: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 613 KiB/s wr, 140 op/s 2024-05-08T08:00:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:23 smithi194 ceph-mon[33679]: pgmap v2351: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 613 KiB/s wr, 140 op/s 2024-05-08T08:00:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:00:24.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:23 smithi070 ceph-mon[29591]: pgmap v2351: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 613 KiB/s wr, 140 op/s 2024-05-08T08:00:24.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:00:24.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:23 smithi172 ceph-mon[33377]: pgmap v2351: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 613 KiB/s wr, 140 op/s 2024-05-08T08:00:24.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:00:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:25 smithi194 ceph-mon[33679]: pgmap v2352: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 921 KiB/s wr, 155 op/s 2024-05-08T08:00:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:25 smithi070 ceph-mon[29591]: pgmap v2352: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 921 KiB/s wr, 155 op/s 2024-05-08T08:00:26.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:25 smithi172 ceph-mon[33377]: pgmap v2352: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 921 KiB/s wr, 155 op/s 2024-05-08T08:00:26.520 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/ksysfs.o 2024-05-08T08:00:27.321 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/request_sock.o 2024-05-08T08:00:27.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:27 smithi194 ceph-mon[33679]: pgmap v2353: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 582 KiB/s wr, 110 op/s 2024-05-08T08:00:27.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:27 smithi070 ceph-mon[29591]: pgmap v2353: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 582 KiB/s wr, 110 op/s 2024-05-08T08:00:27.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:27 smithi172 ceph-mon[33377]: pgmap v2353: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 582 KiB/s wr, 110 op/s 2024-05-08T08:00:27.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:27.840 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_queue.o 2024-05-08T08:00:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:28 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:00:28.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:28 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:00:28.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:28 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:00:28.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:28 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:00:28.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:28.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:28 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:00:28.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:28 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:00:29.203 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpi-bit.o 2024-05-08T08:00:29.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:00:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:00:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:00:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:00:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:00:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:00:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:29 smithi194 ceph-mon[33679]: pgmap v2354: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 582 KiB/s wr, 110 op/s 2024-05-08T08:00:29.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:00:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:00:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:00:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:00:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:00:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:00:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:29 smithi070 ceph-mon[29591]: pgmap v2354: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 582 KiB/s wr, 110 op/s 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:00:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:00:29.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:00:29.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:00:29.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:00:29.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:00:29.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:00:29.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:29 smithi172 ceph-mon[33377]: pgmap v2354: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 582 KiB/s wr, 110 op/s 2024-05-08T08:00:30.005 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/pcie/aspm.o 2024-05-08T08:00:30.778 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/console/built-in.a 2024-05-08T08:00:30.783 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fat/fatent.o 2024-05-08T08:00:31.109 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/video/backlight/backlight.o 2024-05-08T08:00:31.497 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/panic.o 2024-05-08T08:00:32.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:31 smithi070 ceph-mon[29591]: pgmap v2355: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 770 KiB/s wr, 124 op/s 2024-05-08T08:00:32.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:31 smithi172 ceph-mon[33377]: pgmap v2355: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 770 KiB/s wr, 124 op/s 2024-05-08T08:00:32.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:31 smithi194 ceph-mon[33679]: pgmap v2355: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 770 KiB/s wr, 124 op/s 2024-05-08T08:00:34.086 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:33 smithi194 ceph-mon[33679]: pgmap v2356: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 522 KiB/s wr, 38 op/s 2024-05-08T08:00:34.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:33 smithi070 ceph-mon[29591]: pgmap v2356: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 522 KiB/s wr, 38 op/s 2024-05-08T08:00:34.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:33 smithi172 ceph-mon[33377]: pgmap v2356: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 522 KiB/s wr, 38 op/s 2024-05-08T08:00:34.492 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/bootflag.o 2024-05-08T08:00:36.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:35 smithi194 ceph-mon[33679]: pgmap v2357: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 663 KiB/s wr, 50 op/s 2024-05-08T08:00:36.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:35 smithi070 ceph-mon[29591]: pgmap v2357: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 663 KiB/s wr, 50 op/s 2024-05-08T08:00:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:35 smithi172 ceph-mon[33377]: pgmap v2357: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 663 KiB/s wr, 50 op/s 2024-05-08T08:00:36.257 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_fifo.o 2024-05-08T08:00:37.104 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpi-cmp.o 2024-05-08T08:00:38.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:37 smithi070 ceph-mon[29591]: pgmap v2358: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 329 KiB/s wr, 25 op/s 2024-05-08T08:00:38.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:37 smithi172 ceph-mon[33377]: pgmap v2358: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 329 KiB/s wr, 25 op/s 2024-05-08T08:00:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:37 smithi194 ceph-mon[33679]: pgmap v2358: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 329 KiB/s wr, 25 op/s 2024-05-08T08:00:38.781 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/skbuff.o 2024-05-08T08:00:38.904 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/pcie/pme.o 2024-05-08T08:00:39.535 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fat/file.o 2024-05-08T08:00:40.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:39 smithi070 ceph-mon[29591]: pgmap v2359: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 329 KiB/s wr, 25 op/s 2024-05-08T08:00:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:39 smithi172 ceph-mon[33377]: pgmap v2359: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 329 KiB/s wr, 25 op/s 2024-05-08T08:00:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:39 smithi194 ceph-mon[33679]: pgmap v2359: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 329 KiB/s wr, 25 op/s 2024-05-08T08:00:41.256 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/backlight/built-in.a 2024-05-08T08:00:41.505 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cpu.o 2024-05-08T08:00:41.639 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/fbdev/core/built-in.a 2024-05-08T08:00:41.850 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/fbdev/omap/built-in.a 2024-05-08T08:00:42.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:41 smithi070 ceph-mon[29591]: pgmap v2360: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 555 KiB/s wr, 40 op/s 2024-05-08T08:00:42.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:41 smithi172 ceph-mon[33377]: pgmap v2360: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 555 KiB/s wr, 40 op/s 2024-05-08T08:00:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:41 smithi194 ceph-mon[33679]: pgmap v2360: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 555 KiB/s wr, 40 op/s 2024-05-08T08:00:42.306 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/fbdev/omap2/omapfb/dss/built-in.a 2024-05-08T08:00:42.545 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/fbdev/omap2/omapfb/displays/built-in.a 2024-05-08T08:00:42.688 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/fbdev/omap2/omapfb/built-in.a 2024-05-08T08:00:42.832 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/fbdev/omap2/built-in.a 2024-05-08T08:00:42.961 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/fbdev/built-in.a 2024-05-08T08:00:43.109 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/video/aperture.o 2024-05-08T08:00:43.412 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/e820.o 2024-05-08T08:00:44.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:43 smithi070 ceph-mon[29591]: pgmap v2361: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 368 KiB/s wr, 26 op/s 2024-05-08T08:00:44.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:43 smithi172 ceph-mon[33377]: pgmap v2361: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 368 KiB/s wr, 26 op/s 2024-05-08T08:00:44.250 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_prioq.o 2024-05-08T08:00:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:43 smithi194 ceph-mon[33679]: pgmap v2361: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 368 KiB/s wr, 26 op/s 2024-05-08T08:00:45.261 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpi-sub-ui.o 2024-05-08T08:00:46.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:45 smithi070 ceph-mon[29591]: pgmap v2362: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 557 KiB/s wr, 43 op/s 2024-05-08T08:00:46.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:45 smithi172 ceph-mon[33377]: pgmap v2362: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 557 KiB/s wr, 43 op/s 2024-05-08T08:00:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:45 smithi194 ceph-mon[33679]: pgmap v2362: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 557 KiB/s wr, 43 op/s 2024-05-08T08:00:47.624 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pci/pcie/built-in.a 2024-05-08T08:00:48.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:47 smithi070 ceph-mon[29591]: pgmap v2363: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 416 KiB/s wr, 31 op/s 2024-05-08T08:00:48.154 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/hotplug/pci_hotplug_core.o 2024-05-08T08:00:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:47 smithi172 ceph-mon[33377]: pgmap v2363: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 416 KiB/s wr, 31 op/s 2024-05-08T08:00:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:47 smithi194 ceph-mon[33679]: pgmap v2363: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 416 KiB/s wr, 31 op/s 2024-05-08T08:00:49.038 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fat/inode.o 2024-05-08T08:00:49.865 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:49 smithi070 ceph-mon[29591]: pgmap v2364: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 416 KiB/s wr, 31 op/s 2024-05-08T08:00:50.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:49 smithi172 ceph-mon[33377]: pgmap v2364: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 416 KiB/s wr, 31 op/s 2024-05-08T08:00:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:49 smithi194 ceph-mon[33679]: pgmap v2364: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 416 KiB/s wr, 31 op/s 2024-05-08T08:00:52.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:51 smithi070 ceph-mon[29591]: pgmap v2365: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 598 KiB/s wr, 43 op/s 2024-05-08T08:00:52.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:51 smithi172 ceph-mon[33377]: pgmap v2365: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 598 KiB/s wr, 43 op/s 2024-05-08T08:00:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:51 smithi194 ceph-mon[33679]: pgmap v2365: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 598 KiB/s wr, 43 op/s 2024-05-08T08:00:52.634 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_timer.o 2024-05-08T08:00:53.068 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/exit.o 2024-05-08T08:00:54.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:53 smithi172 ceph-mon[33377]: pgmap v2366: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 371 KiB/s wr, 28 op/s 2024-05-08T08:00:54.249 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/datagram.o 2024-05-08T08:00:54.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:53 smithi194 ceph-mon[33679]: pgmap v2366: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 371 KiB/s wr, 28 op/s 2024-05-08T08:00:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:53 smithi070 ceph-mon[29591]: pgmap v2366: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 371 KiB/s wr, 28 op/s 2024-05-08T08:00:56.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:55 smithi172 ceph-mon[33377]: pgmap v2367: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 590 KiB/s wr, 43 op/s 2024-05-08T08:00:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:55 smithi194 ceph-mon[33679]: pgmap v2367: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 590 KiB/s wr, 43 op/s 2024-05-08T08:00:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:55 smithi070 ceph-mon[29591]: pgmap v2367: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 590 KiB/s wr, 43 op/s 2024-05-08T08:00:58.075 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpi-div.o 2024-05-08T08:00:58.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:57 smithi172 ceph-mon[33377]: pgmap v2368: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 401 KiB/s wr, 26 op/s 2024-05-08T08:00:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:57 smithi194 ceph-mon[33679]: pgmap v2368: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 401 KiB/s wr, 26 op/s 2024-05-08T08:00:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:57 smithi070 ceph-mon[29591]: pgmap v2368: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 401 KiB/s wr, 26 op/s 2024-05-08T08:00:58.439 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fat/misc.o 2024-05-08T08:00:58.452 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/hotplug/acpi_pcihp.o 2024-05-08T08:00:58.667 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/video/cmdline.o 2024-05-08T08:00:58.725 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/pci-dma.o 2024-05-08T08:00:59.703 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_system.o 2024-05-08T08:01:00.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:00:59 smithi172 ceph-mon[33377]: pgmap v2369: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 401 KiB/s wr, 26 op/s 2024-05-08T08:01:00.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:00:59 smithi194 ceph-mon[33679]: pgmap v2369: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 401 KiB/s wr, 26 op/s 2024-05-08T08:01:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:00:59 smithi070 ceph-mon[29591]: pgmap v2369: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 401 KiB/s wr, 26 op/s 2024-05-08T08:01:01.358 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:01:01.358 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T08:01:01.359 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:01:01.988 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:01:02.149 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:01 smithi070 ceph-mon[29591]: pgmap v2370: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 684 KiB/s wr, 59 op/s 2024-05-08T08:01:02.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:01 smithi172 ceph-mon[33377]: pgmap v2370: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 684 KiB/s wr, 59 op/s 2024-05-08T08:01:02.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:01 smithi194 ceph-mon[33679]: pgmap v2370: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 684 KiB/s wr, 59 op/s 2024-05-08T08:01:04.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:03 smithi070 ceph-mon[29591]: pgmap v2371: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 501 KiB/s wr, 47 op/s 2024-05-08T08:01:04.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:03 smithi172 ceph-mon[33377]: pgmap v2371: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 501 KiB/s wr, 47 op/s 2024-05-08T08:01:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:03 smithi194 ceph-mon[33679]: pgmap v2371: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 434 KiB/s rd, 501 KiB/s wr, 47 op/s 2024-05-08T08:01:05.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.673+0000 7f4ef7200700 1 -- 172.21.15.70:0/147305757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ef80758d0 msgr2=0x7f4ef8075cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:05.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.673+0000 7f4ef7200700 1 --2- 172.21.15.70:0/147305757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ef80758d0 0x7f4ef8075cb0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00098f0 tx=0x7f4ee0009c00 comp rx=0 tx=0).stop 2024-05-08T08:01:05.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.673+0000 7f4ef7200700 1 -- 172.21.15.70:0/147305757 shutdown_connections 2024-05-08T08:01:05.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.673+0000 7f4ef7200700 1 --2- 172.21.15.70:0/147305757 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef810fc10 0x7f4ef8112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:05.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.673+0000 7f4ef7200700 1 --2- 172.21.15.70:0/147305757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ef80758d0 0x7f4ef8075cb0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:05.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.673+0000 7f4ef7200700 1 --2- 172.21.15.70:0/147305757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ef80761f0 0x7f4ef810f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:05.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.673+0000 7f4ef7200700 1 -- 172.21.15.70:0/147305757 >> 172.21.15.70:0/147305757 conn(0x7f4ef80fef20 msgr2=0x7f4ef8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:01:05.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.674+0000 7f4ef7200700 1 -- 172.21.15.70:0/147305757 shutdown_connections 2024-05-08T08:01:05.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.674+0000 7f4ef7200700 1 -- 172.21.15.70:0/147305757 wait complete. 2024-05-08T08:01:05.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.676+0000 7f4ef7200700 1 Processor -- start 2024-05-08T08:01:05.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.677+0000 7f4ef7200700 1 -- start start 2024-05-08T08:01:05.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.677+0000 7f4ef7200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ef80758d0 0x7f4ef81a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:05.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.677+0000 7f4ef7200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef80761f0 0x7f4ef81a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:05.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.677+0000 7f4ef7200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ef810fc10 0x7f4ef819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:05.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.678+0000 7f4ef7200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef81156f0 con 0x7f4ef810fc10 2024-05-08T08:01:05.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.678+0000 7f4ef7200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8115570 con 0x7f4ef80761f0 2024-05-08T08:01:05.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.678+0000 7f4ef7200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4ef8115870 con 0x7f4ef80758d0 2024-05-08T08:01:05.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.678+0000 7f4ef5400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef80761f0 0x7f4ef81a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:05.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.678+0000 7f4ef5e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ef80758d0 0x7f4ef81a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:05.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.678+0000 7f4ef6800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ef810fc10 0x7f4ef819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:05.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.678+0000 7f4ef5e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ef80758d0 0x7f4ef81a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:48714/0 (socket says 172.21.15.70:48714) 2024-05-08T08:01:05.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.678+0000 7f4ef5e00700 1 -- 172.21.15.70:0/3007966956 learned_addr learned my addr 172.21.15.70:0/3007966956 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:01:05.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.679+0000 7f4ef5e00700 1 -- 172.21.15.70:0/3007966956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef80761f0 msgr2=0x7f4ef81a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:05.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.679+0000 7f4ef5e00700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef80761f0 0x7f4ef81a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:05.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.679+0000 7f4ef5e00700 1 -- 172.21.15.70:0/3007966956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ef810fc10 msgr2=0x7f4ef819bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:05.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.679+0000 7f4ef5e00700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ef810fc10 0x7f4ef819bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:05.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.679+0000 7f4ef5e00700 1 -- 172.21.15.70:0/3007966956 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ef819c230 con 0x7f4ef80758d0 2024-05-08T08:01:05.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.679+0000 7f4ef5e00700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ef80758d0 0x7f4ef81a18c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0005950 tx=0x7f4ee000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:01:05.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.680+0000 7f4eeea00700 1 -- 172.21.15.70:0/3007966956 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000b790 con 0x7f4ef80758d0 2024-05-08T08:01:05.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.680+0000 7f4eeea00700 1 -- 172.21.15.70:0/3007966956 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ee00054d0 con 0x7f4ef80758d0 2024-05-08T08:01:05.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.680+0000 7f4eeea00700 1 -- 172.21.15.70:0/3007966956 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0003970 con 0x7f4ef80758d0 2024-05-08T08:01:05.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.680+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ef819c4c0 con 0x7f4ef80758d0 2024-05-08T08:01:05.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.680+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ef81a8790 con 0x7f4ef80758d0 2024-05-08T08:01:05.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.682+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ef806a190 con 0x7f4ef80758d0 2024-05-08T08:01:05.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.686+0000 7f4eeea00700 1 -- 172.21.15.70:0/3007966956 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4ee0005040 con 0x7f4ef80758d0 2024-05-08T08:01:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.689+0000 7f4eeea00700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4edc0b2a70 0x7f4edc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.689+0000 7f4eeea00700 1 -- 172.21.15.70:0/3007966956 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(227..227 src has 1..227) ==== 9583+0+0 (secure 0 0 0) 0x7f4ee00e3a10 con 0x7f4ef80758d0 2024-05-08T08:01:05.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.690+0000 7f4ef5400700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4edc0b2a70 0x7f4edc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:05.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.691+0000 7f4ef5400700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4edc0b2a70 0x7f4edc0b4f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8111200 tx=0x7f4ee8009310 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:01:05.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:05.700+0000 7f4eeea00700 1 -- 172.21.15.70:0/3007966956 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4ee005fdf0 con 0x7f4ef80758d0 2024-05-08T08:01:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:05 smithi172 ceph-mon[33377]: pgmap v2372: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 651 KiB/s wr, 73 op/s 2024-05-08T08:01:06.235 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:05 smithi070 ceph-mon[29591]: pgmap v2372: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 651 KiB/s wr, 73 op/s 2024-05-08T08:01:06.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.239+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ef802e510 con 0x7f4ef80758d0 2024-05-08T08:01:06.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.241+0000 7f4eeea00700 1 -- 172.21.15.70:0/3007966956 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f4ee0013030 con 0x7f4ef80758d0 2024-05-08T08:01:06.237 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:01:06.237 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:01:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.245+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4edc0b2a70 msgr2=0x7f4edc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.245+0000 7f4ef7200700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4edc0b2a70 0x7f4edc0b4f30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8111200 tx=0x7f4ee8009310 comp rx=0 tx=0).stop 2024-05-08T08:01:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.245+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ef80758d0 msgr2=0x7f4ef81a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:06.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.245+0000 7f4ef7200700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ef80758d0 0x7f4ef81a18c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0005950 tx=0x7f4ee000fa00 comp rx=0 tx=0).stop 2024-05-08T08:01:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.246+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 shutdown_connections 2024-05-08T08:01:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.246+0000 7f4ef7200700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4edc0b2a70 0x7f4edc0b4f30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.246+0000 7f4ef7200700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ef810fc10 0x7f4ef819bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.246+0000 7f4ef7200700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ef80758d0 0x7f4ef81a18c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.246+0000 7f4ef7200700 1 --2- 172.21.15.70:0/3007966956 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ef80761f0 0x7f4ef81a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.246+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 >> 172.21.15.70:0/3007966956 conn(0x7f4ef80fef20 msgr2=0x7f4ef80ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:01:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.246+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 shutdown_connections 2024-05-08T08:01:06.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:06.246+0000 7f4ef7200700 1 -- 172.21.15.70:0/3007966956 wait complete. 2024-05-08T08:01:06.244 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:01:06.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:05 smithi194 ceph-mon[33679]: pgmap v2372: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 651 KiB/s wr, 73 op/s 2024-05-08T08:01:06.459 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/softirq.o 2024-05-08T08:01:06.916 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:06 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3007966956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:01:07.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:06 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3007966956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:01:07.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:06 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3007966956' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:01:07.628 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/stream.o 2024-05-08T08:01:07.791 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpi-inv.o 2024-05-08T08:01:08.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:07 smithi172 ceph-mon[33377]: pgmap v2373: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 432 KiB/s wr, 59 op/s 2024-05-08T08:01:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:07 smithi194 ceph-mon[33679]: pgmap v2373: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 432 KiB/s wr, 59 op/s 2024-05-08T08:01:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:07 smithi070 ceph-mon[29591]: pgmap v2373: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 432 KiB/s wr, 59 op/s 2024-05-08T08:01:08.491 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fat/nfs.o 2024-05-08T08:01:08.834 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pci/hotplug/built-in.a 2024-05-08T08:01:09.210 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pci/controller/dwc/built-in.a 2024-05-08T08:01:09.433 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pci/controller/mobiveil/built-in.a 2024-05-08T08:01:09.540 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T08:01:09.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T08:01:09.596 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pci/controller/built-in.a 2024-05-08T08:01:09.861 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pci/switch/built-in.a 2024-05-08T08:01:10.068 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/access.o 2024-05-08T08:01:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:01:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:09 smithi194 ceph-mon[33679]: pgmap v2374: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 432 KiB/s wr, 59 op/s 2024-05-08T08:01:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:09 smithi194 ceph-mon[33679]: osdmap e228: 12 total, 12 up, 12 in 2024-05-08T08:01:10.299 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:09 smithi070 ceph-mon[29591]: pgmap v2374: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 432 KiB/s wr, 59 op/s 2024-05-08T08:01:10.299 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:09 smithi070 ceph-mon[29591]: osdmap e228: 12 total, 12 up, 12 in 2024-05-08T08:01:10.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:09 smithi172 ceph-mon[33377]: pgmap v2374: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 432 KiB/s wr, 59 op/s 2024-05-08T08:01:10.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:09 smithi172 ceph-mon[33377]: osdmap e228: 12 total, 12 up, 12 in 2024-05-08T08:01:11.289 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_ports.o 2024-05-08T08:01:11.857 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/quirks.o 2024-05-08T08:01:11.933 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/video/nomodeset.o 2024-05-08T08:01:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:11 smithi194 ceph-mon[33679]: pgmap v2376: 129 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 124 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 555 KiB/s wr, 73 op/s 2024-05-08T08:01:12.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:11 smithi070 ceph-mon[29591]: pgmap v2376: 129 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 124 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 555 KiB/s wr, 73 op/s 2024-05-08T08:01:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:11 smithi172 ceph-mon[33377]: pgmap v2376: 129 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 124 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 555 KiB/s wr, 73 op/s 2024-05-08T08:01:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.321+0000 7ff2f4600700 1 -- 172.21.15.70:0/555312680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec075ff0 msgr2=0x7ff2ec10f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.321+0000 7ff2f4600700 1 --2- 172.21.15.70:0/555312680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec075ff0 0x7ff2ec10f9c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009990 tx=0x7ff2d8009ca0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.322+0000 7ff2f4600700 1 -- 172.21.15.70:0/555312680 shutdown_connections 2024-05-08T08:01:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.322+0000 7ff2f4600700 1 --2- 172.21.15.70:0/555312680 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2ec10ff00 0x7ff2ec1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.322+0000 7ff2f4600700 1 --2- 172.21.15.70:0/555312680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2ec0756d0 0x7ff2ec075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.322+0000 7ff2f4600700 1 --2- 172.21.15.70:0/555312680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec075ff0 0x7ff2ec10f9c0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.322+0000 7ff2f4600700 1 -- 172.21.15.70:0/555312680 >> 172.21.15.70:0/555312680 conn(0x7ff2ec07a600 msgr2=0x7ff2ec07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:01:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.322+0000 7ff2f4600700 1 -- 172.21.15.70:0/555312680 shutdown_connections 2024-05-08T08:01:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.322+0000 7ff2f4600700 1 -- 172.21.15.70:0/555312680 wait complete. 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.324+0000 7ff2f4600700 1 Processor -- start 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.324+0000 7ff2f4600700 1 -- start start 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.324+0000 7ff2f4600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec0756d0 0x7ff2ec10f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.324+0000 7ff2f4600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2ec075ff0 0x7ff2ec10c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.324+0000 7ff2f4600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2ec10ff00 0x7ff2ec10cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.324+0000 7ff2f4600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1157a0 con 0x7ff2ec0756d0 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.324+0000 7ff2f4600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec115620 con 0x7ff2ec075ff0 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.324+0000 7ff2f4600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec115920 con 0x7ff2ec10ff00 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.325+0000 7ff2f1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec0756d0 0x7ff2ec10f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.325+0000 7ff2f1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec0756d0 0x7ff2ec10f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36106/0 (socket says 172.21.15.70:36106) 2024-05-08T08:01:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.325+0000 7ff2f1c00700 1 -- 172.21.15.70:0/2102766042 learned_addr learned my addr 172.21.15.70:0/2102766042 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.326+0000 7ff2f1c00700 1 -- 172.21.15.70:0/2102766042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2ec10ff00 msgr2=0x7ff2ec10cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.326+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2ec10ff00 0x7ff2ec10cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.326+0000 7ff2f1c00700 1 -- 172.21.15.70:0/2102766042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2ec075ff0 msgr2=0x7ff2ec10c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.326+0000 7ff2f1200700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2ec075ff0 0x7ff2ec10c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.326+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2ec075ff0 0x7ff2ec10c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.326+0000 7ff2f1c00700 1 -- 172.21.15.70:0/2102766042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2ec10d600 con 0x7ff2ec0756d0 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.326+0000 7ff2f1200700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2ec075ff0 0x7ff2ec10c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.327+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec0756d0 0x7ff2ec10f750 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000c920 tx=0x7ff2e000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.327+0000 7ff2ea000700 1 -- 172.21.15.70:0/2102766042 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0007b00 con 0x7ff2ec0756d0 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.327+0000 7ff2ea000700 1 -- 172.21.15.70:0/2102766042 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2e0004cc0 con 0x7ff2ec0756d0 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.327+0000 7ff2ea000700 1 -- 172.21.15.70:0/2102766042 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00054f0 con 0x7ff2ec0756d0 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.327+0000 7ff2f4600700 1 -- 172.21.15.70:0/2102766042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2ec1ac540 con 0x7ff2ec0756d0 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.327+0000 7ff2f4600700 1 -- 172.21.15.70:0/2102766042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2ec1aca00 con 0x7ff2ec0756d0 2024-05-08T08:01:13.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.333+0000 7ff2ea000700 1 -- 172.21.15.70:0/2102766042 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff2e0007ca0 con 0x7ff2ec0756d0 2024-05-08T08:01:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.335+0000 7ff2ea000700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2d40b2be0 0x7ff2d40b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.335+0000 7ff2ea000700 1 -- 172.21.15.70:0/2102766042 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(228..228 src has 1..228) ==== 9671+0+0 (secure 0 0 0) 0x7ff2e00e2620 con 0x7ff2ec0756d0 2024-05-08T08:01:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.336+0000 7ff2f1200700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2d40b2be0 0x7ff2d40b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.337+0000 7ff2f1200700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2d40b2be0 0x7ff2d40b50a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8003760 tx=0x7ff2d8005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:01:13.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.814+0000 7ff2ff012b80 1 Processor -- start 2024-05-08T08:01:13.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.814+0000 7ff2ff012b80 1 -- start start 2024-05-08T08:01:13.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.815+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f4a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.815+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f449a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.815+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f50d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.816+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a227e96bb0 con 0x55a227f49f50 2024-05-08T08:01:13.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.816+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a227e348f0 con 0x55a227f44ee0 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.816+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a227e92b70 con 0x55a227f44520 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.816+0000 7ff2f2600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f50d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.816+0000 7ff2f2600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f50d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:33212/0 (socket says 172.21.15.70:33212) 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.816+0000 7ff2f2600700 1 -- 172.21.15.70:0/2009429875 learned_addr learned my addr 172.21.15.70:0/2009429875 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.817+0000 7ff2f2600700 1 -- 172.21.15.70:0/2009429875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 msgr2=0x55a227f449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.817+0000 7ff2f2600700 1 --2- 172.21.15.70:0/2009429875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.817+0000 7ff2f2600700 1 -- 172.21.15.70:0/2009429875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 msgr2=0x55a227f4a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.817+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/2009429875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f4a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.817+0000 7ff2f2600700 1 --2- 172.21.15.70:0/2009429875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f4a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.817+0000 7ff2f2600700 1 -- 172.21.15.70:0/2009429875 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a227de3a60 con 0x55a227f44ee0 2024-05-08T08:01:13.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.817+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/2009429875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f4a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:01:13.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.817+0000 7ff2f2600700 1 --2- 172.21.15.70:0/2009429875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f50d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4008f80 tx=0x7ff2e400d3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ded1332d75d02de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:01:13.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.818+0000 7ff2dea00700 1 -- 172.21.15.70:0/2009429875 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4013420 con 0x55a227f44ee0 2024-05-08T08:01:13.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.818+0000 7ff2dea00700 1 -- 172.21.15.70:0/2009429875 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2e4018070 con 0x55a227f44ee0 2024-05-08T08:01:13.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.818+0000 7ff2dea00700 1 -- 172.21.15.70:0/2009429875 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4012890 con 0x55a227f44ee0 2024-05-08T08:01:13.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.819+0000 7ff2ff012b80 1 -- 172.21.15.70:0/2009429875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 msgr2=0x55a227f50d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:13.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.819+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/2009429875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f50d10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4008f80 tx=0x7ff2e400d3c0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.819+0000 7ff2ff012b80 1 -- 172.21.15.70:0/2009429875 shutdown_connections 2024-05-08T08:01:13.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.819+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/2009429875 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f50d10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.819+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/2009429875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f4a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.819+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/2009429875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.820+0000 7ff2ff012b80 1 -- 172.21.15.70:0/2009429875 >> 172.21.15.70:0/2009429875 conn(0x55a227e72cf0 msgr2=0x55a227f3ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:01:13.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.820+0000 7ff2ff012b80 1 -- 172.21.15.70:0/2009429875 shutdown_connections 2024-05-08T08:01:13.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.820+0000 7ff2ff012b80 1 -- 172.21.15.70:0/2009429875 wait complete. 2024-05-08T08:01:13.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.820+0000 7ff2ff012b80 1 -- start start 2024-05-08T08:01:13.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.821+0000 7ff2ff012b80 1 Processor -- start 2024-05-08T08:01:13.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.821+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.821+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44ee0 0x55a227f4dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 0x55a227f4e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a227f51250 con 0x55a227f44ee0 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a227dfccb0 con 0x55a227f49f50 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a227f513d0 con 0x55a227f44520 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2ff012b80 10 client.0 _ll_register_callbacks cb 0x55a227e3de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2f1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44ee0 0x55a227f4dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2f1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44ee0 0x55a227f4dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36126/0 (socket says 172.21.15.70:36126) 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2f1200700 1 -- 172.21.15.70:0/3375086496 learned_addr learned my addr 172.21.15.70:0/3375086496 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.822+0000 7ff2f2600700 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 0x55a227f4e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.823+0000 7ff2f1c00700 1 -- 172.21.15.70:0/3375086496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 msgr2=0x55a227f4e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:01:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.823+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 0x55a227f4e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.823+0000 7ff2f1c00700 1 -- 172.21.15.70:0/3375086496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44ee0 msgr2=0x55a227f4dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:01:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.823+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44ee0 0x55a227f4dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.823+0000 7ff2f1c00700 1 -- 172.21.15.70:0/3375086496 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a227e5c5b0 con 0x55a227f44520 2024-05-08T08:01:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.823+0000 7ff2f1200700 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44ee0 0x55a227f4dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:01:13.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.824+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f509d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00df8f0 tx=0x7ff2e00a9000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fc8654cbbc61eb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:01:13.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.824+0000 7ff2d3400700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T08:01:13.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.825+0000 7ff2d3400700 1 -- 172.21.15.70:0/3375086496 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e001d070 con 0x55a227f44520 2024-05-08T08:01:13.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.825+0000 7ff2ff012b80 1 -- 172.21.15.70:0/3375086496 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2e4018070 con 0x55a227f44520 2024-05-08T08:01:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.825+0000 7ff2d3400700 1 -- 172.21.15.70:0/3375086496 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(228..228 src has 1..228) ==== 9671+0+0 (secure 0 0 0) 0x7ff2e00b2060 con 0x55a227f44520 2024-05-08T08:01:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.826+0000 7ff2d3400700 1 -- 172.21.15.70:0/3375086496 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff2e00a9480 con 0x55a227f44520 2024-05-08T08:01:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.826+0000 7ff2ff012b80 10 client.26587 fetch_fsmap learned FSMap version 42 2024-05-08T08:01:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.826+0000 7ff2ff012b80 1 -- 172.21.15.70:0/3375086496 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a227f5bb20 con 0x55a227f44520 2024-05-08T08:01:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.826+0000 7ff2d3400700 1 -- 172.21.15.70:0/3375086496 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2e4018070 con 0x55a227f44520 2024-05-08T08:01:13.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.827+0000 7ff2d3400700 1 -- 172.21.15.70:0/3375086496 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ff2e00a3c30 con 0x55a227f44520 2024-05-08T08:01:13.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.827+0000 7ff2ff012b80 10 client.26587 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:01:13.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.827+0000 7ff2ff012b80 10 client.26587 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:01:13.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.827+0000 7ff2ff012b80 20 client.26587 populate_metadata read hostname 'smithi070' 2024-05-08T08:01:13.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.827+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a227f5dff0 0x55a227f60400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.827+0000 7ff2ff012b80 4 client.26587 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:01:13.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.827+0000 7ff2ff012b80 1 -- 172.21.15.70:0/3375086496 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a227f11230 con 0x55a227f5dff0 2024-05-08T08:01:13.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.828+0000 7ff2f1200700 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a227f5dff0 0x55a227f60400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.829+0000 7ff2f1200700 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a227f5dff0 0x55a227f60400 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f8953336345c963 server_cookie=eac60c04b56989c1 in_seq=0 out_seq=0 2024-05-08T08:01:13.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.829+0000 7ff2d3400700 10 client.26587 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:01:13.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.831+0000 7ff2d3400700 1 -- 172.21.15.70:0/3375086496 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a227f11230 con 0x55a227f5dff0 2024-05-08T08:01:13.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.831+0000 7ff2d3400700 10 client.26587 handle_command_reply: tid=0 2024-05-08T08:01:13.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.831+0000 7ff2ff012b80 1 client.26587 shutdown 2024-05-08T08:01:13.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2ff012b80 1 -- 172.21.15.70:0/3375086496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 msgr2=0x55a227f509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:13.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f509d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00df8f0 tx=0x7ff2e00a9000 comp rx=0 tx=0).stop 2024-05-08T08:01:13.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2ff012b80 1 -- 172.21.15.70:0/3375086496 shutdown_connections 2024-05-08T08:01:13.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a227f5dff0 0x55a227f60400 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 0x55a227f4e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f509d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/3375086496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44ee0 0x55a227f4dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2ff012b80 1 -- 172.21.15.70:0/3375086496 >> 172.21.15.70:0/3375086496 conn(0x55a227e72cf0 msgr2=0x55a227f398e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:01:13.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2d3400700 0 client.26587 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:01:13.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.832+0000 7ff2ff012b80 1 -- 172.21.15.70:0/3375086496 shutdown_connections 2024-05-08T08:01:13.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.833+0000 7ff2ff012b80 1 -- 172.21.15.70:0/3375086496 wait complete. 2024-05-08T08:01:13.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.833+0000 7ff2ff012b80 20 client.26587 trim_cache size 0 max 16384 2024-05-08T08:01:13.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.868+0000 7ff2ff012b80 1 Processor -- start 2024-05-08T08:01:13.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.868+0000 7ff2ff012b80 1 -- start start 2024-05-08T08:01:13.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.869+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f5a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.869+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f4cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.869+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f65cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.869+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1b8570 con 0x55a227f49f50 2024-05-08T08:01:13.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.869+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1b5e00 con 0x55a227f44ee0 2024-05-08T08:01:13.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.869+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1b3c70 con 0x55a227f44520 2024-05-08T08:01:13.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.869+0000 7ff2f1c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f5a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f2600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f65cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f1c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f5a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:57930/0 (socket says 172.21.15.70:57930) 2024-05-08T08:01:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f1c00700 1 -- 172.21.15.70:0/480530470 learned_addr learned my addr 172.21.15.70:0/480530470 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:01:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f2600700 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f65cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36134/0 (socket says 172.21.15.70:36134) 2024-05-08T08:01:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f1200700 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f4cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f2600700 1 -- 172.21.15.70:0/480530470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 msgr2=0x55a227f5a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:01:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f2600700 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f5a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f2600700 1 -- 172.21.15.70:0/480530470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 msgr2=0x55a227f4cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:01:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f2600700 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f4cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.870+0000 7ff2f2600700 1 -- 172.21.15.70:0/480530470 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a227f3ba10 con 0x55a227f49f50 2024-05-08T08:01:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.871+0000 7ff2f1200700 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f4cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:01:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.871+0000 7ff2f2600700 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f65cd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400d7c0 tx=0x7ff2e400ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c893a5db89fc86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:01:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.872+0000 7ff2de000700 1 -- 172.21.15.70:0/480530470 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004db0 con 0x55a227f49f50 2024-05-08T08:01:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.872+0000 7ff2de000700 1 -- 172.21.15.70:0/480530470 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2e4020070 con 0x55a227f49f50 2024-05-08T08:01:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.872+0000 7ff2de000700 1 -- 172.21.15.70:0/480530470 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4004430 con 0x55a227f49f50 2024-05-08T08:01:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.873+0000 7ff2ff012b80 1 -- 172.21.15.70:0/480530470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 msgr2=0x55a227f65cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.873+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f65cd0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400d7c0 tx=0x7ff2e400ddf0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.873+0000 7ff2ff012b80 1 -- 172.21.15.70:0/480530470 shutdown_connections 2024-05-08T08:01:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.873+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f49f50 0x55a227f65cd0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.873+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44520 0x55a227f5a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.873+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/480530470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f44ee0 0x55a227f4cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.873+0000 7ff2ff012b80 1 -- 172.21.15.70:0/480530470 >> 172.21.15.70:0/480530470 conn(0x55a227e72cf0 msgr2=0x55a227f4c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.874+0000 7ff2ff012b80 1 -- 172.21.15.70:0/480530470 shutdown_connections 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.874+0000 7ff2ff012b80 1 -- 172.21.15.70:0/480530470 wait complete. 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.874+0000 7ff2ff012b80 1 -- start start 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.874+0000 7ff2ff012b80 1 Processor -- start 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.875+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44520 0x55a227f56ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.875+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44ee0 0x55a227f53030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.875+0000 7ff2ff012b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 0x55a227f53620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.875+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1b42c0 con 0x55a227f44520 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.875+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1b5730 con 0x55a227f49f50 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.875+0000 7ff2ff012b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff2ec1b4990 con 0x55a227f44ee0 2024-05-08T08:01:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.875+0000 7ff2ff012b80 10 client.0 _ll_register_callbacks cb 0x55a227e3de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.875+0000 7ff2f1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44520 0x55a227f56ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.876+0000 7ff2f1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44520 0x55a227f56ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36136/0 (socket says 172.21.15.70:36136) 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.876+0000 7ff2f1c00700 1 -- 172.21.15.70:0/161595615 learned_addr learned my addr 172.21.15.70:0/161595615 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.876+0000 7ff2f1200700 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44ee0 0x55a227f53030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.876+0000 7ff2f2600700 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 0x55a227f53620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.876+0000 7ff2f1c00700 1 -- 172.21.15.70:0/161595615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44ee0 msgr2=0x55a227f53030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.876+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44ee0 0x55a227f53030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.876+0000 7ff2f1c00700 1 -- 172.21.15.70:0/161595615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 msgr2=0x55a227f53620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.876+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 0x55a227f53620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.876+0000 7ff2f1c00700 1 -- 172.21.15.70:0/161595615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a227f53e60 con 0x55a227f44520 2024-05-08T08:01:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.877+0000 7ff2f1c00700 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44520 0x55a227f56ca0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00dfef0 tx=0x7ff2e00b0de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d5df7f013258d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:01:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.877+0000 7ff2d3400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.878+0000 7ff2d3400700 1 -- 172.21.15.70:0/161595615 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e001d040 con 0x55a227f44520 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.878+0000 7ff2d3400700 1 -- 172.21.15.70:0/161595615 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(228..228 src has 1..228) ==== 9671+0+0 (secure 0 0 0) 0x7ff2e00a5a70 con 0x55a227f44520 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.878+0000 7ff2ff012b80 1 -- 172.21.15.70:0/161595615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2e4020070 con 0x55a227f44520 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.878+0000 7ff2d3400700 1 -- 172.21.15.70:0/161595615 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff2e00ad830 con 0x55a227f44520 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.878+0000 7ff2ff012b80 10 client.17496 fetch_fsmap learned FSMap version 42 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.878+0000 7ff2ff012b80 1 -- 172.21.15.70:0/161595615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a227fc99a0 con 0x55a227f44520 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.879+0000 7ff2d3400700 1 -- 172.21.15.70:0/161595615 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2e00bb070 con 0x55a227f44520 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.879+0000 7ff2d3400700 1 -- 172.21.15.70:0/161595615 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ff2e00ca340 con 0x55a227f44520 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.880+0000 7ff2ff012b80 10 client.17496 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.880+0000 7ff2ff012b80 10 client.17496 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.880+0000 7ff2ff012b80 20 client.17496 populate_metadata read hostname 'smithi070' 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.880+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a227fca090 0x55a227fcc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.880+0000 7ff2ff012b80 4 client.17496 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T08:01:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.880+0000 7ff2ff012b80 1 -- 172.21.15.70:0/161595615 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55a227ea4590 con 0x55a227fca090 2024-05-08T08:01:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.881+0000 7ff2f1200700 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a227fca090 0x55a227fcc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:01:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.882+0000 7ff2f1200700 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a227fca090 0x55a227fcc4b0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=991a139f9996b331 server_cookie=de8259a985931c39 in_seq=0 out_seq=0 2024-05-08T08:01:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:13.882+0000 7ff2d3400700 10 client.17496 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:01:14.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:13 smithi070 ceph-mon[29591]: pgmap v2377: 129 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 124 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 555 KiB/s wr, 73 op/s 2024-05-08T08:01:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:13 smithi194 ceph-mon[33679]: pgmap v2377: 129 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 124 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 555 KiB/s wr, 73 op/s 2024-05-08T08:01:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:13 smithi172 ceph-mon[33377]: pgmap v2377: 129 pgs: 2 active+clean+snaptrim, 3 active+clean+snaptrim_wait, 124 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 555 KiB/s wr, 73 op/s 2024-05-08T08:01:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:15 smithi194 ceph-mon[33679]: pgmap v2378: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 597 KiB/s wr, 57 op/s 2024-05-08T08:01:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:15 smithi070 ceph-mon[29591]: pgmap v2378: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 597 KiB/s wr, 57 op/s 2024-05-08T08:01:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:15 smithi172 ceph-mon[33377]: pgmap v2378: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 597 KiB/s wr, 57 op/s 2024-05-08T08:01:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:17 smithi194 ceph-mon[33679]: pgmap v2379: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 597 KiB/s wr, 57 op/s 2024-05-08T08:01:18.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:17 smithi070 ceph-mon[29591]: pgmap v2379: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 597 KiB/s wr, 57 op/s 2024-05-08T08:01:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:17 smithi172 ceph-mon[33377]: pgmap v2379: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 597 KiB/s wr, 57 op/s 2024-05-08T08:01:20.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:19 smithi070 ceph-mon[29591]: osdmap e229: 12 total, 12 up, 12 in 2024-05-08T08:01:20.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:19 smithi070 ceph-mon[29591]: pgmap v2381: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 601 KiB/s wr, 55 op/s 2024-05-08T08:01:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:19 smithi172 ceph-mon[33377]: osdmap e229: 12 total, 12 up, 12 in 2024-05-08T08:01:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:19 smithi172 ceph-mon[33377]: pgmap v2381: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 601 KiB/s wr, 55 op/s 2024-05-08T08:01:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:19 smithi194 ceph-mon[33679]: osdmap e229: 12 total, 12 up, 12 in 2024-05-08T08:01:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:19 smithi194 ceph-mon[33679]: pgmap v2381: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 601 KiB/s wr, 55 op/s 2024-05-08T08:01:22.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:21 smithi070 ceph-mon[29591]: pgmap v2382: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 400 KiB/s wr, 23 op/s 2024-05-08T08:01:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:21 smithi172 ceph-mon[33377]: pgmap v2382: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 400 KiB/s wr, 23 op/s 2024-05-08T08:01:22.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:21 smithi194 ceph-mon[33679]: pgmap v2382: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 400 KiB/s wr, 23 op/s 2024-05-08T08:01:24.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:23 smithi070 ceph-mon[29591]: pgmap v2383: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 400 KiB/s wr, 23 op/s 2024-05-08T08:01:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:23 smithi172 ceph-mon[33377]: pgmap v2383: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 400 KiB/s wr, 23 op/s 2024-05-08T08:01:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:23 smithi194 ceph-mon[33679]: pgmap v2383: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 400 KiB/s wr, 23 op/s 2024-05-08T08:01:26.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:25 smithi070 ceph-mon[29591]: pgmap v2384: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 235 KiB/s wr, 13 op/s 2024-05-08T08:01:26.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:25 smithi172 ceph-mon[33377]: pgmap v2384: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 235 KiB/s wr, 13 op/s 2024-05-08T08:01:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:25 smithi194 ceph-mon[33679]: pgmap v2384: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 235 KiB/s wr, 13 op/s 2024-05-08T08:01:28.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:27 smithi070 ceph-mon[29591]: pgmap v2385: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 235 KiB/s wr, 13 op/s 2024-05-08T08:01:28.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:27 smithi172 ceph-mon[33377]: pgmap v2385: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 235 KiB/s wr, 13 op/s 2024-05-08T08:01:28.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:27 smithi194 ceph-mon[33679]: pgmap v2385: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 235 KiB/s wr, 13 op/s 2024-05-08T08:01:30.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:29 smithi070 ceph-mon[29591]: pgmap v2386: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 235 KiB/s wr, 13 op/s 2024-05-08T08:01:30.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:01:30.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:29 smithi172 ceph-mon[33377]: pgmap v2386: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 235 KiB/s wr, 13 op/s 2024-05-08T08:01:30.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:01:30.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:29 smithi194 ceph-mon[33679]: pgmap v2386: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 235 KiB/s wr, 13 op/s 2024-05-08T08:01:30.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:01:32.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:31 smithi172 ceph-mon[33377]: pgmap v2387: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 197 KiB/s wr, 14 op/s 2024-05-08T08:01:32.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:31 smithi194 ceph-mon[33679]: pgmap v2387: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 197 KiB/s wr, 14 op/s 2024-05-08T08:01:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:31 smithi070 ceph-mon[29591]: pgmap v2387: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 197 KiB/s wr, 14 op/s 2024-05-08T08:01:34.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:33 smithi172 ceph-mon[33377]: pgmap v2388: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T08:01:34.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:33 smithi194 ceph-mon[33679]: pgmap v2388: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T08:01:34.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:33 smithi070 ceph-mon[29591]: pgmap v2388: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 48 KiB/s wr, 8 op/s 2024-05-08T08:01:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:35 smithi172 ceph-mon[33377]: pgmap v2389: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 92 KiB/s wr, 11 op/s 2024-05-08T08:01:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:35 smithi194 ceph-mon[33679]: pgmap v2389: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 92 KiB/s wr, 11 op/s 2024-05-08T08:01:36.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:35 smithi070 ceph-mon[29591]: pgmap v2389: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 92 KiB/s wr, 11 op/s 2024-05-08T08:01:36.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.874+0000 7ff2d3400700 1 -- 172.21.15.70:0/161595615 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55a227ea4590 con 0x55a227fca090 2024-05-08T08:01:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.874+0000 7ff2d3400700 10 client.17496 handle_command_reply: tid=0 2024-05-08T08:01:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.874+0000 7ff2ff012b80 1 client.17496 shutdown 2024-05-08T08:01:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.875+0000 7ff2ff012b80 1 -- 172.21.15.70:0/161595615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44520 msgr2=0x55a227f56ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.875+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44520 0x55a227f56ca0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff2e00dfef0 tx=0x7ff2e00b0de0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.876+0000 7ff2ff012b80 1 -- 172.21.15.70:0/161595615 shutdown_connections 2024-05-08T08:01:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.876+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a227fca090 0x55a227fcc4b0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.876+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a227f49f50 0x55a227f53620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.876+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a227f44520 0x55a227f56ca0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.876+0000 7ff2ff012b80 1 --2- 172.21.15.70:0/161595615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a227f44ee0 0x55a227f53030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.876+0000 7ff2ff012b80 1 -- 172.21.15.70:0/161595615 >> 172.21.15.70:0/161595615 conn(0x55a227e72cf0 msgr2=0x55a227f398e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:01:36.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.876+0000 7ff2d3400700 0 client.17496 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:01:36.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.876+0000 7ff2ff012b80 1 -- 172.21.15.70:0/161595615 shutdown_connections 2024-05-08T08:01:36.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.876+0000 7ff2ff012b80 1 -- 172.21.15.70:0/161595615 wait complete. 2024-05-08T08:01:36.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.877+0000 7ff2ff012b80 20 client.17496 trim_cache size 0 max 16384 2024-05-08T08:01:36.873 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:01:36.873 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:01:36.873 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:01:36.873 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 178, 2024-05-08T08:01:36.873 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:01:36.873 INFO:teuthology.orchestra.run.smithi070.stdout: "46e17b6d": { 2024-05-08T08:01:36.874 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 178, 2024-05-08T08:01:36.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:01:36.874 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:01:36.874 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:01:36.874 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:01:36.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:01:36.874 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:01:36.874 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:01:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:01:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:01:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:01:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:01:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:01:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:01:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:01:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:01:36.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:01:36.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:01:36.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:01:36.876 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:01:36.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.878+0000 7ff2f4600700 1 -- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2d40b2be0 msgr2=0x7ff2d40b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.878+0000 7ff2f4600700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2d40b2be0 0x7ff2d40b50a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8003760 tx=0x7ff2d8005fb0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.878+0000 7ff2f4600700 1 -- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec0756d0 msgr2=0x7ff2ec10f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:01:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.878+0000 7ff2f4600700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec0756d0 0x7ff2ec10f750 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000c920 tx=0x7ff2e000cce0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.879+0000 7ff2f4600700 1 -- 172.21.15.70:0/2102766042 shutdown_connections 2024-05-08T08:01:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.879+0000 7ff2f4600700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2d40b2be0 0x7ff2d40b50a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.879+0000 7ff2f4600700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2ec10ff00 0x7ff2ec10cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.879+0000 7ff2f4600700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2ec0756d0 0x7ff2ec10f750 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.879+0000 7ff2f4600700 1 --2- 172.21.15.70:0/2102766042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff2ec075ff0 0x7ff2ec10c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:01:36.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.879+0000 7ff2f4600700 1 -- 172.21.15.70:0/2102766042 >> 172.21.15.70:0/2102766042 conn(0x7ff2ec07a600 msgr2=0x7ff2ec1009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:01:36.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.879+0000 7ff2f4600700 1 -- 172.21.15.70:0/2102766042 shutdown_connections 2024-05-08T08:01:36.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:01:36.879+0000 7ff2f4600700 1 -- 172.21.15.70:0/2102766042 wait complete. 2024-05-08T08:01:37.814 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '46e17b6d', quiesce took 36.5 seconds. Will release after: 30.0 2024-05-08T08:01:38.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:37 smithi070 ceph-mon[29591]: pgmap v2390: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 6 op/s 2024-05-08T08:01:38.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:37 smithi172 ceph-mon[33377]: pgmap v2390: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 6 op/s 2024-05-08T08:01:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:37 smithi194 ceph-mon[33679]: pgmap v2390: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 6 op/s 2024-05-08T08:01:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:39 smithi172 ceph-mon[33377]: pgmap v2391: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 6 op/s 2024-05-08T08:01:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:39 smithi194 ceph-mon[33679]: pgmap v2391: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 6 op/s 2024-05-08T08:01:40.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:39 smithi070 ceph-mon[29591]: pgmap v2391: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 44 KiB/s wr, 6 op/s 2024-05-08T08:01:41.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:01:41.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:01:41.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:01:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:01:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:01:41.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:01:41.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:01:41.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:01:41.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:01:42.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:41 smithi172 ceph-mon[33377]: pgmap v2392: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 79 KiB/s wr, 10 op/s 2024-05-08T08:01:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:41 smithi194 ceph-mon[33679]: pgmap v2392: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 79 KiB/s wr, 10 op/s 2024-05-08T08:01:42.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:41 smithi070 ceph-mon[29591]: pgmap v2392: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 79 KiB/s wr, 10 op/s 2024-05-08T08:01:44.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:43 smithi172 ceph-mon[33377]: pgmap v2393: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 78 KiB/s wr, 7 op/s 2024-05-08T08:01:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:43 smithi194 ceph-mon[33679]: pgmap v2393: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 78 KiB/s wr, 7 op/s 2024-05-08T08:01:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:43 smithi070 ceph-mon[29591]: pgmap v2393: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 78 KiB/s wr, 7 op/s 2024-05-08T08:01:46.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:45 smithi172 ceph-mon[33377]: pgmap v2394: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 104 KiB/s wr, 11 op/s 2024-05-08T08:01:46.176 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:45 smithi070 ceph-mon[29591]: pgmap v2394: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 104 KiB/s wr, 11 op/s 2024-05-08T08:01:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:45 smithi194 ceph-mon[33679]: pgmap v2394: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 104 KiB/s wr, 11 op/s 2024-05-08T08:01:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:47 smithi194 ceph-mon[33679]: pgmap v2395: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 61 KiB/s wr, 7 op/s 2024-05-08T08:01:48.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:47 smithi070 ceph-mon[29591]: pgmap v2395: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 61 KiB/s wr, 7 op/s 2024-05-08T08:01:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:47 smithi172 ceph-mon[33377]: pgmap v2395: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 61 KiB/s wr, 7 op/s 2024-05-08T08:01:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:49 smithi194 ceph-mon[33679]: pgmap v2396: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 61 KiB/s wr, 7 op/s 2024-05-08T08:01:50.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:49 smithi070 ceph-mon[29591]: pgmap v2396: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 61 KiB/s wr, 7 op/s 2024-05-08T08:01:50.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:49 smithi172 ceph-mon[33377]: pgmap v2396: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 61 KiB/s wr, 7 op/s 2024-05-08T08:01:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:51 smithi194 ceph-mon[33679]: pgmap v2397: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 61 KiB/s wr, 10 op/s 2024-05-08T08:01:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:51 smithi070 ceph-mon[29591]: pgmap v2397: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 61 KiB/s wr, 10 op/s 2024-05-08T08:01:52.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:51 smithi172 ceph-mon[33377]: pgmap v2397: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 61 KiB/s wr, 10 op/s 2024-05-08T08:01:54.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:53 smithi194 ceph-mon[33679]: pgmap v2398: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-05-08T08:01:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:53 smithi070 ceph-mon[29591]: pgmap v2398: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-05-08T08:01:54.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:53 smithi172 ceph-mon[33377]: pgmap v2398: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-05-08T08:01:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:55 smithi194 ceph-mon[33679]: pgmap v2399: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 51 KiB/s wr, 9 op/s 2024-05-08T08:01:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:55 smithi070 ceph-mon[29591]: pgmap v2399: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 51 KiB/s wr, 9 op/s 2024-05-08T08:01:56.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:55 smithi172 ceph-mon[33377]: pgmap v2399: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 51 KiB/s wr, 9 op/s 2024-05-08T08:01:58.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:57 smithi172 ceph-mon[33377]: pgmap v2400: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:01:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:57 smithi194 ceph-mon[33679]: pgmap v2400: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:01:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:57 smithi070 ceph-mon[29591]: pgmap v2400: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:02:00.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:01:59 smithi194 ceph-mon[33679]: pgmap v2401: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:02:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:01:59 smithi070 ceph-mon[29591]: pgmap v2401: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:02:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:01:59 smithi172 ceph-mon[33377]: pgmap v2401: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:02:02.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:01 smithi194 ceph-mon[33679]: pgmap v2402: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T08:02:02.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:01 smithi070 ceph-mon[29591]: pgmap v2402: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T08:02:02.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:01 smithi172 ceph-mon[33377]: pgmap v2402: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T08:02:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:03 smithi194 ceph-mon[33679]: pgmap v2403: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:02:04.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:03 smithi070 ceph-mon[29591]: pgmap v2403: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:02:04.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:03 smithi172 ceph-mon[33377]: pgmap v2403: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:02:06.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:05 smithi194 ceph-mon[33679]: pgmap v2404: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 74 KiB/s wr, 25 op/s 2024-05-08T08:02:06.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:05 smithi070 ceph-mon[29591]: pgmap v2404: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 74 KiB/s wr, 25 op/s 2024-05-08T08:02:06.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:05 smithi172 ceph-mon[33377]: pgmap v2404: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 74 KiB/s wr, 25 op/s 2024-05-08T08:02:07.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:02:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:07 smithi194 ceph-mon[33679]: pgmap v2405: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 22 op/s 2024-05-08T08:02:08.288 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:02:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:07 smithi070 ceph-mon[29591]: pgmap v2405: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 22 op/s 2024-05-08T08:02:08.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:07 smithi172 ceph-mon[33377]: pgmap v2405: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 22 op/s 2024-05-08T08:02:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:10 smithi194 ceph-mon[33679]: pgmap v2406: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 22 op/s 2024-05-08T08:02:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:10 smithi194 ceph-mon[33679]: osdmap e230: 12 total, 12 up, 12 in 2024-05-08T08:02:10.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:10 smithi070 ceph-mon[29591]: pgmap v2406: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 22 op/s 2024-05-08T08:02:10.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:10 smithi070 ceph-mon[29591]: osdmap e230: 12 total, 12 up, 12 in 2024-05-08T08:02:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:10 smithi172 ceph-mon[33377]: pgmap v2406: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 48 KiB/s wr, 22 op/s 2024-05-08T08:02:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:10 smithi172 ceph-mon[33377]: osdmap e230: 12 total, 12 up, 12 in 2024-05-08T08:02:10.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.639+0000 7faaf9400700 1 -- 172.21.15.70:0/2644109947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf410b660 msgr2=0x7faaf410ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:10.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.639+0000 7faaf9400700 1 --2- 172.21.15.70:0/2644109947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf410b660 0x7faaf410ba40 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7faae4009990 tx=0x7faae4009ca0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.639+0000 7faaf9400700 1 -- 172.21.15.70:0/2644109947 shutdown_connections 2024-05-08T08:02:10.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.639+0000 7faaf9400700 1 --2- 172.21.15.70:0/2644109947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf4105f90 0x7faaf41124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.639+0000 7faaf9400700 1 --2- 172.21.15.70:0/2644109947 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf410b660 0x7faaf410ba40 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.639+0000 7faaf9400700 1 --2- 172.21.15.70:0/2644109947 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf41055d0 0x7faaf4105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.639+0000 7faaf9400700 1 -- 172.21.15.70:0/2644109947 >> 172.21.15.70:0/2644109947 conn(0x7faaf41010c0 msgr2=0x7faaf41034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:10.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.639+0000 7faaf9400700 1 -- 172.21.15.70:0/2644109947 shutdown_connections 2024-05-08T08:02:10.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.639+0000 7faaf9400700 1 -- 172.21.15.70:0/2644109947 wait complete. 2024-05-08T08:02:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.640+0000 7faaf9400700 1 Processor -- start 2024-05-08T08:02:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.641+0000 7faaf9400700 1 -- start start 2024-05-08T08:02:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.641+0000 7faaf9400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf41055d0 0x7faaf41a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:10.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.641+0000 7faaf9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf4105f90 0x7faaf41a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.641+0000 7faaf9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf410b660 0x7faaf419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.641+0000 7faaf9400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faaf4115660 con 0x7faaf4105f90 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.641+0000 7faaf9400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faaf41154e0 con 0x7faaf410b660 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.641+0000 7faaf9400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faaf41157e0 con 0x7faaf41055d0 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf4105f90 0x7faaf41a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf4105f90 0x7faaf41a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57380/0 (socket says 172.21.15.70:57380) 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3400700 1 -- 172.21.15.70:0/1602362589 learned_addr learned my addr 172.21.15.70:0/1602362589 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3e00700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf41055d0 0x7faaf41a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3400700 1 -- 172.21.15.70:0/1602362589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf41055d0 msgr2=0x7faaf41a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3400700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf41055d0 0x7faaf41a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3400700 1 -- 172.21.15.70:0/1602362589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf410b660 msgr2=0x7faaf419b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3400700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf410b660 0x7faaf419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3400700 1 -- 172.21.15.70:0/1602362589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf419c100 con 0x7faaf4105f90 2024-05-08T08:02:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.642+0000 7faaf3400700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf4105f90 0x7faaf41a1cd0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7faae000d950 tx=0x7faae000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.643+0000 7faaf0c00700 1 -- 172.21.15.70:0/1602362589 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0016070 con 0x7faaf4105f90 2024-05-08T08:02:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.643+0000 7faaf0c00700 1 -- 172.21.15.70:0/1602362589 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faae0010460 con 0x7faaf4105f90 2024-05-08T08:02:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.643+0000 7faaf0c00700 1 -- 172.21.15.70:0/1602362589 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae000f620 con 0x7faaf4105f90 2024-05-08T08:02:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.643+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf419c3f0 con 0x7faaf4105f90 2024-05-08T08:02:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.643+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf41a8660 con 0x7faaf4105f90 2024-05-08T08:02:10.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.644+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf406a190 con 0x7faaf4105f90 2024-05-08T08:02:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.647+0000 7faaf0c00700 1 -- 172.21.15.70:0/1602362589 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7faae0019070 con 0x7faaf4105f90 2024-05-08T08:02:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.649+0000 7faaf0c00700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faad80b2a70 0x7faad80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.649+0000 7faaf0c00700 1 -- 172.21.15.70:0/1602362589 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 9671+0+0 (secure 0 0 0) 0x7faae00e2630 con 0x7faaf4105f90 2024-05-08T08:02:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.649+0000 7faaf3e00700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faad80b2a70 0x7faad80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.650+0000 7faaf3e00700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faad80b2a70 0x7faad80b4f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faae4006010 tx=0x7faae401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:10.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.654+0000 7faaf0c00700 1 -- 172.21.15.70:0/1602362589 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7faae00a9b90 con 0x7faaf4105f90 2024-05-08T08:02:10.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.936+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaf402e510 con 0x7faaf4105f90 2024-05-08T08:02:10.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.937+0000 7faaf0c00700 1 -- 172.21.15.70:0/1602362589 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7faae00a9490 con 0x7faaf4105f90 2024-05-08T08:02:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:02:10.932 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:02:10.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.940+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faad80b2a70 msgr2=0x7faad80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:10.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.940+0000 7faaf9400700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faad80b2a70 0x7faad80b4f30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faae4006010 tx=0x7faae401a040 comp rx=0 tx=0).stop 2024-05-08T08:02:10.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.940+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf4105f90 msgr2=0x7faaf41a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.940+0000 7faaf9400700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf4105f90 0x7faaf41a1cd0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7faae000d950 tx=0x7faae000dd10 comp rx=0 tx=0).stop 2024-05-08T08:02:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.941+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 shutdown_connections 2024-05-08T08:02:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.941+0000 7faaf9400700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faad80b2a70 0x7faad80b4f30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.941+0000 7faaf9400700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaf410b660 0x7faaf419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.941+0000 7faaf9400700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaf41055d0 0x7faaf41a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.941+0000 7faaf9400700 1 --2- 172.21.15.70:0/1602362589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaf4105f90 0x7faaf41a1cd0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.941+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 >> 172.21.15.70:0/1602362589 conn(0x7faaf41010c0 msgr2=0x7faaf41028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.941+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 shutdown_connections 2024-05-08T08:02:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:10.941+0000 7faaf9400700 1 -- 172.21.15.70:0/1602362589 wait complete. 2024-05-08T08:02:10.937 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:02:11.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:11 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1602362589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:02:11.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:11 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1602362589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:02:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:11 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1602362589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:02:11.726 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 46e17b6d --release --await' 2024-05-08T08:02:11.727 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 46e17b6d --release --await 2024-05-08T08:02:12.162 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:02:12.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:12 smithi070 ceph-mon[29591]: pgmap v2408: 129 pgs: 10 active+clean+snaptrim_wait, 119 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 26 op/s 2024-05-08T08:02:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:12 smithi172 ceph-mon[33377]: pgmap v2408: 129 pgs: 10 active+clean+snaptrim_wait, 119 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 26 op/s 2024-05-08T08:02:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:12 smithi194 ceph-mon[33679]: pgmap v2408: 129 pgs: 10 active+clean+snaptrim_wait, 119 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 26 op/s 2024-05-08T08:02:13.349 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:13 smithi070 ceph-mon[29591]: pgmap v2409: 129 pgs: 10 active+clean+snaptrim_wait, 119 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 26 op/s 2024-05-08T08:02:13.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:13 smithi172 ceph-mon[33377]: pgmap v2409: 129 pgs: 10 active+clean+snaptrim_wait, 119 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 26 op/s 2024-05-08T08:02:13.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:13 smithi194 ceph-mon[33679]: pgmap v2409: 129 pgs: 10 active+clean+snaptrim_wait, 119 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 58 KiB/s wr, 26 op/s 2024-05-08T08:02:14.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.781+0000 7fb772c00700 1 -- 172.21.15.70:0/2856992974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c10fd50 msgr2=0x7fb76c112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:14.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.781+0000 7fb772c00700 1 --2- 172.21.15.70:0/2856992974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c10fd50 0x7fb76c112140 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fb76400b0a0 tx=0x7fb76400b3b0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.782+0000 7fb772c00700 1 -- 172.21.15.70:0/2856992974 shutdown_connections 2024-05-08T08:02:14.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.782+0000 7fb772c00700 1 --2- 172.21.15.70:0/2856992974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c10fd50 0x7fb76c112140 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.782+0000 7fb772c00700 1 --2- 172.21.15.70:0/2856992974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb76c1021a0 0x7fb76c102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.782+0000 7fb772c00700 1 --2- 172.21.15.70:0/2856992974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c102b50 0x7fb76c10f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.782+0000 7fb772c00700 1 -- 172.21.15.70:0/2856992974 >> 172.21.15.70:0/2856992974 conn(0x7fb76c0fddc0 msgr2=0x7fb76c1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:14.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.782+0000 7fb772c00700 1 -- 172.21.15.70:0/2856992974 shutdown_connections 2024-05-08T08:02:14.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.782+0000 7fb772c00700 1 -- 172.21.15.70:0/2856992974 wait complete. 2024-05-08T08:02:14.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.783+0000 7fb772c00700 1 Processor -- start 2024-05-08T08:02:14.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.783+0000 7fb772c00700 1 -- start start 2024-05-08T08:02:14.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.783+0000 7fb772c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb76c1021a0 0x7fb76c1a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.783+0000 7fb772c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c102b50 0x7fb76c1a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.783+0000 7fb772c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c10fd50 0x7fb76c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.783+0000 7fb772c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c1156c0 con 0x7fb76c102b50 2024-05-08T08:02:14.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.783+0000 7fb772c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c115540 con 0x7fb76c10fd50 2024-05-08T08:02:14.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.783+0000 7fb772c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c115840 con 0x7fb76c1021a0 2024-05-08T08:02:14.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb770e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c102b50 0x7fb76c1a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb770e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c102b50 0x7fb76c1a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57396/0 (socket says 172.21.15.70:57396) 2024-05-08T08:02:14.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb770e00700 1 -- 172.21.15.70:0/251267493 learned_addr learned my addr 172.21.15.70:0/251267493 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:14.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb771800700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb76c1021a0 0x7fb76c1a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb772200700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c10fd50 0x7fb76c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb770e00700 1 -- 172.21.15.70:0/251267493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb76c1021a0 msgr2=0x7fb76c1a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:14.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb770e00700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb76c1021a0 0x7fb76c1a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb770e00700 1 -- 172.21.15.70:0/251267493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c10fd50 msgr2=0x7fb76c19bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:14.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb770e00700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c10fd50 0x7fb76c19bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.784+0000 7fb770e00700 1 -- 172.21.15.70:0/251267493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c19c260 con 0x7fb76c102b50 2024-05-08T08:02:14.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.785+0000 7fb770e00700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c102b50 0x7fb76c1a1e30 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb75800d950 tx=0x7fb75800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:14.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.785+0000 7fb76a000700 1 -- 172.21.15.70:0/251267493 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758016070 con 0x7fb76c102b50 2024-05-08T08:02:14.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.785+0000 7fb76a000700 1 -- 172.21.15.70:0/251267493 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb758010460 con 0x7fb76c102b50 2024-05-08T08:02:14.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.785+0000 7fb772c00700 1 -- 172.21.15.70:0/251267493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c19c550 con 0x7fb76c102b50 2024-05-08T08:02:14.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.785+0000 7fb76a000700 1 -- 172.21.15.70:0/251267493 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75800f620 con 0x7fb76c102b50 2024-05-08T08:02:14.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.785+0000 7fb772c00700 1 -- 172.21.15.70:0/251267493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c1a87c0 con 0x7fb76c102b50 2024-05-08T08:02:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.789+0000 7fb76a000700 1 -- 172.21.15.70:0/251267493 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb758019070 con 0x7fb76c102b50 2024-05-08T08:02:14.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.790+0000 7fb76a000700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7540b29f0 0x7fb7540b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.791+0000 7fb76a000700 1 -- 172.21.15.70:0/251267493 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(230..230 src has 1..230) ==== 9671+0+0 (secure 0 0 0) 0x7fb7580e2a00 con 0x7fb76c102b50 2024-05-08T08:02:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.791+0000 7fb771800700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7540b29f0 0x7fb7540b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.792+0000 7fb771800700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7540b29f0 0x7fb7540b4eb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb760005950 tx=0x7fb7600058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:14.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.856+0000 7fb77eacbb80 1 Processor -- start 2024-05-08T08:02:14.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.856+0000 7fb77eacbb80 1 -- start start 2024-05-08T08:02:14.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.857+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 0x5641a8c7de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.857+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7e380 0x5641a8c77f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.857+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 0x5641a8c789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.857+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641a8bc1b20 con 0x5641a8c7e380 2024-05-08T08:02:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.857+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641a8b5f860 con 0x5641a8c7da60 2024-05-08T08:02:14.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.857+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5641a8bbdae0 con 0x5641a8c785b0 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb770e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7e380 0x5641a8c77f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb770e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7e380 0x5641a8c77f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57406/0 (socket says 172.21.15.70:57406) 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb770e00700 1 -- 172.21.15.70:0/2263110952 learned_addr learned my addr 172.21.15.70:0/2263110952 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb771800700 1 --2- 172.21.15.70:0/2263110952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 0x5641a8c7de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb772200700 1 --2- 172.21.15.70:0/2263110952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 0x5641a8c789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb770e00700 1 -- 172.21.15.70:0/2263110952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 msgr2=0x5641a8c789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb770e00700 1 --2- 172.21.15.70:0/2263110952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 0x5641a8c789f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb770e00700 1 -- 172.21.15.70:0/2263110952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 msgr2=0x5641a8c7de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb770e00700 1 --2- 172.21.15.70:0/2263110952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 0x5641a8c7de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.858+0000 7fb770e00700 1 -- 172.21.15.70:0/2263110952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641a8b0e9d0 con 0x5641a8c7e380 2024-05-08T08:02:14.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.859+0000 7fb770e00700 1 --2- 172.21.15.70:0/2263110952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7e380 0x5641a8c77f90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fb7580a5880 tx=0x7fb7580a9390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5253b30020cc190b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:14.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.859+0000 7fb75ea00700 1 -- 172.21.15.70:0/2263110952 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758020070 con 0x5641a8c7e380 2024-05-08T08:02:14.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.859+0000 7fb75ea00700 1 -- 172.21.15.70:0/2263110952 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7580a9800 con 0x5641a8c7e380 2024-05-08T08:02:14.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.859+0000 7fb75ea00700 1 -- 172.21.15.70:0/2263110952 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758010930 con 0x5641a8c7e380 2024-05-08T08:02:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.860+0000 7fb77eacbb80 1 -- 172.21.15.70:0/2263110952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7e380 msgr2=0x5641a8c77f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.860+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/2263110952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7e380 0x5641a8c77f90 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fb7580a5880 tx=0x7fb7580a9390 comp rx=0 tx=0).stop 2024-05-08T08:02:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.860+0000 7fb77eacbb80 1 -- 172.21.15.70:0/2263110952 shutdown_connections 2024-05-08T08:02:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.860+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/2263110952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 0x5641a8c789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.860+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/2263110952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 0x5641a8c7de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.860+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/2263110952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7e380 0x5641a8c77f90 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.860+0000 7fb77eacbb80 1 -- 172.21.15.70:0/2263110952 >> 172.21.15.70:0/2263110952 conn(0x5641a8be77d0 msgr2=0x5641a8c6a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.861+0000 7fb77eacbb80 1 -- 172.21.15.70:0/2263110952 shutdown_connections 2024-05-08T08:02:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.861+0000 7fb77eacbb80 1 -- 172.21.15.70:0/2263110952 wait complete. 2024-05-08T08:02:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.861+0000 7fb77eacbb80 1 -- start start 2024-05-08T08:02:14.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.862+0000 7fb77eacbb80 1 Processor -- start 2024-05-08T08:02:14.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.862+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c84080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.862+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7da60 0x5641a8c814e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.862+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c81a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.862+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641a8c84ea0 con 0x5641a8c785b0 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.862+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5641a8b27c20 con 0x5641a8c7e380 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.862+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5641a8c85020 con 0x5641a8c7da60 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.862+0000 7fb77eacbb80 10 client.0 _ll_register_callbacks cb 0x5641a8b68d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb771800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c84080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb771800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c84080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57414/0 (socket says 172.21.15.70:57414) 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb771800700 1 -- 172.21.15.70:0/549675481 learned_addr learned my addr 172.21.15.70:0/549675481 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb772200700 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c81a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb770e00700 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7da60 0x5641a8c814e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb771800700 1 -- 172.21.15.70:0/549675481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7da60 msgr2=0x5641a8c814e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb771800700 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7da60 0x5641a8c814e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb771800700 1 -- 172.21.15.70:0/549675481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 msgr2=0x5641a8c81a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb771800700 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c81a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb771800700 1 -- 172.21.15.70:0/549675481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641a8b87520 con 0x5641a8c785b0 2024-05-08T08:02:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.863+0000 7fb772200700 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c81a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.864+0000 7fb771800700 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c84080 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb760011490 tx=0x7fb760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e58bb92cda42aed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.864+0000 7fb753400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.864+0000 7fb753400700 1 -- 172.21.15.70:0/549675481 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760004a30 con 0x5641a8c785b0 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.864+0000 7fb753400700 1 -- 172.21.15.70:0/549675481 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 9671+0+0 (secure 0 0 0) 0x7fb760004bd0 con 0x5641a8c785b0 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.864+0000 7fb77eacbb80 1 -- 172.21.15.70:0/549675481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7580a9800 con 0x5641a8c785b0 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.865+0000 7fb753400700 1 -- 172.21.15.70:0/549675481 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb760011e50 con 0x5641a8c785b0 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.865+0000 7fb77eacbb80 10 client.17514 fetch_fsmap learned FSMap version 42 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.865+0000 7fb77eacbb80 1 -- 172.21.15.70:0/549675481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5641a8c8f800 con 0x5641a8c785b0 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.865+0000 7fb753400700 1 -- 172.21.15.70:0/549675481 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7580a9800 con 0x5641a8c785b0 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.865+0000 7fb753400700 1 -- 172.21.15.70:0/549675481 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fb76001f710 con 0x5641a8c785b0 2024-05-08T08:02:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.865+0000 7fb77eacbb80 10 client.17514 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:02:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.865+0000 7fb77eacbb80 10 client.17514 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:02:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.865+0000 7fb77eacbb80 20 client.17514 populate_metadata read hostname 'smithi070' 2024-05-08T08:02:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.866+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641a8c91e40 0x5641a8c94250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.866+0000 7fb77eacbb80 4 client.17514 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:02:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.866+0000 7fb77eacbb80 1 -- 172.21.15.70:0/549675481 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641a8c3c240 con 0x5641a8c91e40 2024-05-08T08:02:14.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.866+0000 7fb770e00700 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641a8c91e40 0x5641a8c94250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.867+0000 7fb770e00700 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641a8c91e40 0x5641a8c94250 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39dafdc8492bb41a server_cookie=15e540c2a46b286 in_seq=0 out_seq=0 2024-05-08T08:02:14.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.867+0000 7fb753400700 10 client.17514 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:02:14.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.869+0000 7fb753400700 1 -- 172.21.15.70:0/549675481 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5641a8c3c240 con 0x5641a8c91e40 2024-05-08T08:02:14.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.869+0000 7fb753400700 10 client.17514 handle_command_reply: tid=0 2024-05-08T08:02:14.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.869+0000 7fb77eacbb80 1 client.17514 shutdown 2024-05-08T08:02:14.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 -- 172.21.15.70:0/549675481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 msgr2=0x5641a8c84080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:14.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c84080 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb760011490 tx=0x7fb760004750 comp rx=0 tx=0).stop 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 -- 172.21.15.70:0/549675481 shutdown_connections 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641a8c91e40 0x5641a8c94250 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c81a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c84080 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/549675481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7da60 0x5641a8c814e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 -- 172.21.15.70:0/549675481 >> 172.21.15.70:0/549675481 conn(0x5641a8be77d0 msgr2=0x5641a8c6e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb753400700 0 client.17514 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 -- 172.21.15.70:0/549675481 shutdown_connections 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 1 -- 172.21.15.70:0/549675481 wait complete. 2024-05-08T08:02:14.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.870+0000 7fb77eacbb80 20 client.17514 trim_cache size 0 max 16384 2024-05-08T08:02:14.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.894+0000 7fb77eacbb80 1 Processor -- start 2024-05-08T08:02:14.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.894+0000 7fb77eacbb80 1 -- start start 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.894+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c8df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.894+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 0x5641a8c99b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.894+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7e380 0x5641a8c9a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.894+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c1afd40 con 0x5641a8c785b0 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.894+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c1ad5d0 con 0x5641a8c7da60 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.894+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c1ab440 con 0x5641a8c7e380 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb771800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c8df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb771800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c8df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57426/0 (socket says 172.21.15.70:57426) 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb771800700 1 -- 172.21.15.70:0/1362530297 learned_addr learned my addr 172.21.15.70:0/1362530297 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb770e00700 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 0x5641a8c99b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb772200700 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7e380 0x5641a8c9a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb771800700 1 -- 172.21.15.70:0/1362530297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7e380 msgr2=0x5641a8c9a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:14.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb771800700 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7e380 0x5641a8c9a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb771800700 1 -- 172.21.15.70:0/1362530297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 msgr2=0x5641a8c99b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:14.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb771800700 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 0x5641a8c99b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb771800700 1 -- 172.21.15.70:0/1362530297 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641a8c66c20 con 0x5641a8c785b0 2024-05-08T08:02:14.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.895+0000 7fb772200700 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7e380 0x5641a8c9a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:02:14.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.896+0000 7fb771800700 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c8df60 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb760022040 tx=0x7fb76000b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cba2d96132696b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:14.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.896+0000 7fb75e000700 1 -- 172.21.15.70:0/1362530297 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb760011be0 con 0x5641a8c785b0 2024-05-08T08:02:14.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.896+0000 7fb75e000700 1 -- 172.21.15.70:0/1362530297 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb760039070 con 0x5641a8c785b0 2024-05-08T08:02:14.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.896+0000 7fb75e000700 1 -- 172.21.15.70:0/1362530297 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76003ecf0 con 0x5641a8c785b0 2024-05-08T08:02:14.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.897+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1362530297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 msgr2=0x5641a8c8df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:14.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.897+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c8df60 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fb760022040 tx=0x7fb76000b340 comp rx=0 tx=0).stop 2024-05-08T08:02:14.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.897+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1362530297 shutdown_connections 2024-05-08T08:02:14.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.897+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c7e380 0x5641a8c9a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.897+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c785b0 0x5641a8c8df60 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.897+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1362530297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7da60 0x5641a8c99b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.897+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1362530297 >> 172.21.15.70:0/1362530297 conn(0x5641a8be77d0 msgr2=0x5641a8c7fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:14.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.897+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1362530297 shutdown_connections 2024-05-08T08:02:14.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.897+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1362530297 wait complete. 2024-05-08T08:02:14.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.898+0000 7fb77eacbb80 1 -- start start 2024-05-08T08:02:14.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.898+0000 7fb77eacbb80 1 Processor -- start 2024-05-08T08:02:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.898+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 0x5641a8c8a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.898+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7da60 0x5641a8c872b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.898+0000 7fb77eacbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c877f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.898+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c1aba90 con 0x5641a8c7da60 2024-05-08T08:02:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.898+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c1acf00 con 0x5641a8c7e380 2024-05-08T08:02:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.898+0000 7fb77eacbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c1ac160 con 0x5641a8c785b0 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.898+0000 7fb77eacbb80 10 client.0 _ll_register_callbacks cb 0x5641a8b68d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb770e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7da60 0x5641a8c872b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb770e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7da60 0x5641a8c872b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57438/0 (socket says 172.21.15.70:57438) 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb770e00700 1 -- 172.21.15.70:0/1141489313 learned_addr learned my addr 172.21.15.70:0/1141489313 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb771800700 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 0x5641a8c8a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb772200700 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c877f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb770e00700 1 -- 172.21.15.70:0/1141489313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 msgr2=0x5641a8c8a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb770e00700 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 0x5641a8c8a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb770e00700 1 -- 172.21.15.70:0/1141489313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 msgr2=0x5641a8c877f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb770e00700 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c877f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb770e00700 1 -- 172.21.15.70:0/1141489313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641a8c88010 con 0x5641a8c7da60 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb771800700 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 0x5641a8c8a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:02:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.899+0000 7fb772200700 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c877f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.900+0000 7fb770e00700 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7da60 0x5641a8c872b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fb7580a9790 tx=0x7fb75800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b897dd121208e7bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.900+0000 7fb753400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.900+0000 7fb753400700 1 -- 172.21.15.70:0/1141489313 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb758020040 con 0x5641a8c7da60 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.900+0000 7fb753400700 1 -- 172.21.15.70:0/1141489313 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(230..230 src has 1..230) ==== 9671+0+0 (secure 0 0 0) 0x7fb758010930 con 0x5641a8c7da60 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.900+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1141489313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb760039070 con 0x5641a8c7da60 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.900+0000 7fb753400700 1 -- 172.21.15.70:0/1141489313 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb7580a56c0 con 0x5641a8c7da60 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.900+0000 7fb77eacbb80 10 client.17520 fetch_fsmap learned FSMap version 42 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.900+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1141489313 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5641a8cfd730 con 0x5641a8c7da60 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.900+0000 7fb753400700 1 -- 172.21.15.70:0/1141489313 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb760039070 con 0x5641a8c7da60 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.901+0000 7fb753400700 1 -- 172.21.15.70:0/1141489313 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fb7580dfef0 con 0x5641a8c7da60 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.901+0000 7fb77eacbb80 10 client.17520 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.901+0000 7fb77eacbb80 10 client.17520 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.901+0000 7fb77eacbb80 20 client.17520 populate_metadata read hostname 'smithi070' 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.901+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641a8cfda20 0x5641a8cffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:14.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.901+0000 7fb77eacbb80 4 client.17520 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "46e17b6d", "release": true, "await": true}] 2024-05-08T08:02:14.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.901+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1141489313 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "46e17b6d", "release": true, "await": true}) -- 0x5641a8bcf500 con 0x5641a8cfda20 2024-05-08T08:02:14.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.901+0000 7fb771800700 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641a8cfda20 0x5641a8cffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:14.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.902+0000 7fb771800700 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641a8cfda20 0x5641a8cffe10 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe874dd44ff41425 server_cookie=c91ac28bd34cfd98 in_seq=0 out_seq=0 2024-05-08T08:02:14.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:14.902+0000 7fb753400700 10 client.17520 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:02:16.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:15 smithi070 ceph-mon[29591]: pgmap v2410: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:02:16.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:15 smithi172 ceph-mon[33377]: pgmap v2410: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:02:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:15 smithi194 ceph-mon[33679]: pgmap v2410: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:02:18.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:17 smithi172 ceph-mon[33377]: pgmap v2411: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:02:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:17 smithi194 ceph-mon[33679]: pgmap v2411: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:02:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:17 smithi070 ceph-mon[29591]: pgmap v2411: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:02:19.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.505+0000 7fb753400700 1 -- 172.21.15.70:0/1141489313 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5641a8bcf500 con 0x5641a8cfda20 2024-05-08T08:02:19.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.505+0000 7fb753400700 10 client.17520 handle_command_reply: tid=0 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.505+0000 7fb77eacbb80 1 client.17520 shutdown 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.506+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1141489313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7da60 msgr2=0x5641a8c872b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.506+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7da60 0x5641a8c872b0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fb7580a9790 tx=0x7fb75800b5b0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.506+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1141489313 shutdown_connections 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.506+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5641a8cfda20 0x5641a8cffe10 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.506+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5641a8c7e380 0x5641a8c877f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.506+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5641a8c785b0 0x5641a8c8a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.506+0000 7fb77eacbb80 1 --2- 172.21.15.70:0/1141489313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641a8c7da60 0x5641a8c872b0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.506+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1141489313 >> 172.21.15.70:0/1141489313 conn(0x5641a8be77d0 msgr2=0x5641a8c7e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:19.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.507+0000 7fb753400700 0 client.17520 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:02:19.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.508+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1141489313 shutdown_connections 2024-05-08T08:02:19.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.508+0000 7fb77eacbb80 1 -- 172.21.15.70:0/1141489313 wait complete. 2024-05-08T08:02:19.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.511+0000 7fb77eacbb80 20 client.17520 trim_cache size 0 max 16384 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 180, 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "46e17b6d": { 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 180, 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:02:19.507 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:19.508 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:19.509 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:02:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 -- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7540b29f0 msgr2=0x7fb7540b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7540b29f0 0x7fb7540b4eb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb760005950 tx=0x7fb7600058e0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 -- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c102b50 msgr2=0x7fb76c1a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c102b50 0x7fb76c1a1e30 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb75800d950 tx=0x7fb75800dd10 comp rx=0 tx=0).stop 2024-05-08T08:02:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 -- 172.21.15.70:0/251267493 shutdown_connections 2024-05-08T08:02:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb7540b29f0 0x7fb7540b4eb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb76c10fd50 0x7fb76c19bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb76c1021a0 0x7fb76c1a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 --2- 172.21.15.70:0/251267493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb76c102b50 0x7fb76c1a1e30 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 -- 172.21.15.70:0/251267493 >> 172.21.15.70:0/251267493 conn(0x7fb76c0fddc0 msgr2=0x7fb76c1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.516+0000 7fb772c00700 1 -- 172.21.15.70:0/251267493 shutdown_connections 2024-05-08T08:02:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:19.517+0000 7fb772c00700 1 -- 172.21.15.70:0/251267493 wait complete. 2024-05-08T08:02:19.738 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpi-mod.o 2024-05-08T08:02:20.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:19 smithi070 ceph-mon[29591]: osdmap e231: 12 total, 12 up, 12 in 2024-05-08T08:02:20.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:19 smithi070 ceph-mon[29591]: pgmap v2413: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 208 B/s wr, 4 op/s 2024-05-08T08:02:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:19 smithi172 ceph-mon[33377]: osdmap e231: 12 total, 12 up, 12 in 2024-05-08T08:02:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:19 smithi172 ceph-mon[33377]: pgmap v2413: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 208 B/s wr, 4 op/s 2024-05-08T08:02:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:19 smithi194 ceph-mon[33679]: osdmap e231: 12 total, 12 up, 12 in 2024-05-08T08:02:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:19 smithi194 ceph-mon[33679]: pgmap v2413: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 208 B/s wr, 4 op/s 2024-05-08T08:02:21.083 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '46e17b6d', seconds elapsed: 79.7 2024-05-08T08:02:21.083 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T08:02:21.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:02:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:02:21.863 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/video/hdmi.o 2024-05-08T08:02:22.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:21 smithi070 ceph-mon[29591]: pgmap v2414: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T08:02:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:21 smithi172 ceph-mon[33377]: pgmap v2414: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T08:02:22.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:21 smithi194 ceph-mon[33679]: pgmap v2414: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T08:02:22.343 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_info.o 2024-05-08T08:02:22.395 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/bus.o 2024-05-08T08:02:22.420 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fat/namei_vfat.o 2024-05-08T08:02:22.467 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/topology.o 2024-05-08T08:02:22.827 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/resource.o 2024-05-08T08:02:23.017 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/scm.o 2024-05-08T08:02:24.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.132+0000 7f6717e00700 1 -- 172.21.15.70:0/3494893443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6718075870 msgr2=0x7f6718075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:24.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.132+0000 7f6717e00700 1 --2- 172.21.15.70:0/3494893443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6718075870 0x7f6718075c50 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f6708009990 tx=0x7f6708009ca0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.132+0000 7f6717e00700 1 -- 172.21.15.70:0/3494893443 shutdown_connections 2024-05-08T08:02:24.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.132+0000 7f6717e00700 1 --2- 172.21.15.70:0/3494893443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f671810fc50 0x7f6718112060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.132+0000 7f6717e00700 1 --2- 172.21.15.70:0/3494893443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6718075870 0x7f6718075c50 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.132+0000 7f6717e00700 1 --2- 172.21.15.70:0/3494893443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6718076190 0x7f671810f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.132+0000 7f6717e00700 1 -- 172.21.15.70:0/3494893443 >> 172.21.15.70:0/3494893443 conn(0x7f67180fee80 msgr2=0x7f67181012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:24.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.132+0000 7f6717e00700 1 -- 172.21.15.70:0/3494893443 shutdown_connections 2024-05-08T08:02:24.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.132+0000 7f6717e00700 1 -- 172.21.15.70:0/3494893443 wait complete. 2024-05-08T08:02:24.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.134+0000 7f6717e00700 1 Processor -- start 2024-05-08T08:02:24.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.134+0000 7f6717e00700 1 -- start start 2024-05-08T08:02:24.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.135+0000 7f6717e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6718075870 0x7f6718103370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:24.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.135+0000 7f6717e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6718076190 0x7f67181038b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:24.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.135+0000 7f6717e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f671810fc50 0x7f6718103df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:24.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.135+0000 7f6717e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6718115690 con 0x7f671810fc50 2024-05-08T08:02:24.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.135+0000 7f6717e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6718115510 con 0x7f6718076190 2024-05-08T08:02:24.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.135+0000 7f6717e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6718115810 con 0x7f6718075870 2024-05-08T08:02:24.132 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:23 smithi070 ceph-mon[29591]: pgmap v2415: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T08:02:24.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.135+0000 7f6717400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f671810fc50 0x7f6718103df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:24.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.135+0000 7f6717400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f671810fc50 0x7f6718103df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37004/0 (socket says 172.21.15.70:37004) 2024-05-08T08:02:24.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.135+0000 7f6717400700 1 -- 172.21.15.70:0/1602209083 learned_addr learned my addr 172.21.15.70:0/1602209083 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:24.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.136+0000 7f6716000700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6718076190 0x7f67181038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:24.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.136+0000 7f6716a00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6718075870 0x7f6718103370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:24.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.136+0000 7f6716000700 1 -- 172.21.15.70:0/1602209083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6718075870 msgr2=0x7f6718103370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:24.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.136+0000 7f6716000700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6718075870 0x7f6718103370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.136+0000 7f6716000700 1 -- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f671810fc50 msgr2=0x7f6718103df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:24.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.136+0000 7f6716000700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f671810fc50 0x7f6718103df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.136+0000 7f6716000700 1 -- 172.21.15.70:0/1602209083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67181ac2b0 con 0x7f6718076190 2024-05-08T08:02:24.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.136+0000 7f6717400700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f671810fc50 0x7f6718103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:02:24.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.137+0000 7f6716000700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6718076190 0x7f67181038b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f670400ea20 tx=0x7f670400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:24.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.137+0000 7f671ca00700 1 -- 172.21.15.70:0/1602209083 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670400cbd0 con 0x7f6718076190 2024-05-08T08:02:24.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.138+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67181ac5a0 con 0x7f6718076190 2024-05-08T08:02:24.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.138+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67181acb30 con 0x7f6718076190 2024-05-08T08:02:24.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.138+0000 7f671ca00700 1 -- 172.21.15.70:0/1602209083 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f670400cd70 con 0x7f6718076190 2024-05-08T08:02:24.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.138+0000 7f671ca00700 1 -- 172.21.15.70:0/1602209083 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704018680 con 0x7f6718076190 2024-05-08T08:02:24.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.141+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f8005330 con 0x7f6718076190 2024-05-08T08:02:24.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.144+0000 7f671ca00700 1 -- 172.21.15.70:0/1602209083 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6704018820 con 0x7f6718076190 2024-05-08T08:02:24.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.146+0000 7f671ca00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66fc0b2af0 0x7f66fc0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:24.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.146+0000 7f671ca00700 1 -- 172.21.15.70:0/1602209083 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(231..231 src has 1..231) ==== 9583+0+0 (secure 0 0 0) 0x7f67040e2a90 con 0x7f6718076190 2024-05-08T08:02:24.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.147+0000 7f6716a00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66fc0b2af0 0x7f66fc0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:24.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.148+0000 7f6716a00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66fc0b2af0 0x7f66fc0b4fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f670800b2e0 tx=0x7f670800b610 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:24.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.162+0000 7f671ca00700 1 -- 172.21.15.70:0/1602209083 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f67040a9ff0 con 0x7f6718076190 2024-05-08T08:02:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:23 smithi172 ceph-mon[33377]: pgmap v2415: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T08:02:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:23 smithi194 ceph-mon[33679]: pgmap v2415: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T08:02:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.638+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66f80058f0 con 0x7f6718076190 2024-05-08T08:02:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.640+0000 7f671ca00700 1 -- 172.21.15.70:0/1602209083 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f67040b2070 con 0x7f6718076190 2024-05-08T08:02:24.635 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:02:24.635 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66fc0b2af0 msgr2=0x7f66fc0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66fc0b2af0 0x7f66fc0b4fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f670800b2e0 tx=0x7f670800b610 comp rx=0 tx=0).stop 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6718076190 msgr2=0x7f67181038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6718076190 0x7f67181038b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f670400ea20 tx=0x7f670400ed30 comp rx=0 tx=0).stop 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 shutdown_connections 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f66fc0b2af0 0x7f66fc0b4fb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f671810fc50 0x7f6718103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6718075870 0x7f6718103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 --2- 172.21.15.70:0/1602209083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6718076190 0x7f67181038b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 >> 172.21.15.70:0/1602209083 conn(0x7f67180fee80 msgr2=0x7f67180ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.644+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 shutdown_connections 2024-05-08T08:02:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:24.645+0000 7f6717e00700 1 -- 172.21.15.70:0/1602209083 wait complete. 2024-05-08T08:02:24.641 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:02:25.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:24 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1602209083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:02:25.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:24 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1602209083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:02:25.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:24 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1602209083' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:02:26.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:25 smithi172 ceph-mon[33377]: pgmap v2416: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 292 KiB/s wr, 27 op/s 2024-05-08T08:02:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:25 smithi194 ceph-mon[33679]: pgmap v2416: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 292 KiB/s wr, 27 op/s 2024-05-08T08:02:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:25 smithi070 ceph-mon[29591]: pgmap v2416: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 292 KiB/s wr, 27 op/s 2024-05-08T08:02:27.257 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T08:02:27.258 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T08:02:27.834 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:02:28.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:27 smithi070 ceph-mon[29591]: pgmap v2417: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 292 KiB/s wr, 27 op/s 2024-05-08T08:02:28.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:27 smithi172 ceph-mon[33377]: pgmap v2417: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 292 KiB/s wr, 27 op/s 2024-05-08T08:02:28.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:27 smithi194 ceph-mon[33679]: pgmap v2417: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 292 KiB/s wr, 27 op/s 2024-05-08T08:02:28.658 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpi-mul.o 2024-05-08T08:02:29.008 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/video/built-in.a 2024-05-08T08:02:29.488 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/sysctl.o 2024-05-08T08:02:29.720 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/kdebugfs.o 2024-05-08T08:02:30.170 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:29 smithi070 ceph-mon[29591]: pgmap v2418: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 291 KiB/s wr, 27 op/s 2024-05-08T08:02:30.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:29 smithi172 ceph-mon[33377]: pgmap v2418: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 291 KiB/s wr, 27 op/s 2024-05-08T08:02:30.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:29 smithi194 ceph-mon[33679]: pgmap v2418: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 291 KiB/s wr, 27 op/s 2024-05-08T08:02:30.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.581+0000 7f1509200700 1 -- 172.21.15.70:0/2261351952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103550 msgr2=0x7f15041039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:30.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.581+0000 7f1509200700 1 --2- 172.21.15.70:0/2261351952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103550 0x7f15041039b0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009990 tx=0x7f14f4009ca0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.581+0000 7f1509200700 1 -- 172.21.15.70:0/2261351952 shutdown_connections 2024-05-08T08:02:30.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.581+0000 7f1509200700 1 --2- 172.21.15.70:0/2261351952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1504103ef0 0x7f15041103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.581+0000 7f1509200700 1 --2- 172.21.15.70:0/2261351952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1504108460 0x7f1504108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.581+0000 7f1509200700 1 --2- 172.21.15.70:0/2261351952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103550 0x7f15041039b0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.581+0000 7f1509200700 1 -- 172.21.15.70:0/2261351952 >> 172.21.15.70:0/2261351952 conn(0x7f150407a600 msgr2=0x7f150407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:30.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.581+0000 7f1509200700 1 -- 172.21.15.70:0/2261351952 shutdown_connections 2024-05-08T08:02:30.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.581+0000 7f1509200700 1 -- 172.21.15.70:0/2261351952 wait complete. 2024-05-08T08:02:30.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.582+0000 7f1509200700 1 Processor -- start 2024-05-08T08:02:30.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.583+0000 7f1509200700 1 -- start start 2024-05-08T08:02:30.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.583+0000 7f1509200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1504103550 0x7f150410a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.583+0000 7f1509200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103ef0 0x7f150410a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.583+0000 7f1509200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1504108460 0x7f150410ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.583+0000 7f1509200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1504113550 con 0x7f1504103ef0 2024-05-08T08:02:30.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.583+0000 7f1509200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f15041133d0 con 0x7f1504108460 2024-05-08T08:02:30.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.583+0000 7f1509200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f15041136d0 con 0x7f1504103550 2024-05-08T08:02:30.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.584+0000 7f1501400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103ef0 0x7f150410a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.584+0000 7f1501400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103ef0 0x7f150410a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46362/0 (socket says 172.21.15.70:46362) 2024-05-08T08:02:30.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.584+0000 7f1501400700 1 -- 172.21.15.70:0/2095232736 learned_addr learned my addr 172.21.15.70:0/2095232736 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:30.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.584+0000 7f1502800700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1504108460 0x7f150410ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.584+0000 7f1501e00700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1504103550 0x7f150410a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.585+0000 7f1501400700 1 -- 172.21.15.70:0/2095232736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1504103550 msgr2=0x7f150410a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:30.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.585+0000 7f1501400700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1504103550 0x7f150410a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.585+0000 7f1501400700 1 -- 172.21.15.70:0/2095232736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1504108460 msgr2=0x7f150410ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:30.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.585+0000 7f1501400700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1504108460 0x7f150410ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.585+0000 7f1501400700 1 -- 172.21.15.70:0/2095232736 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150419ba00 con 0x7f1504103ef0 2024-05-08T08:02:30.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.585+0000 7f1501400700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103ef0 0x7f150410a920 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f14f40057f0 tx=0x7f14f4009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:30.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.586+0000 7f14faa00700 1 -- 172.21.15.70:0/2095232736 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4027070 con 0x7f1504103ef0 2024-05-08T08:02:30.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.586+0000 7f14faa00700 1 -- 172.21.15.70:0/2095232736 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14f400fc80 con 0x7f1504103ef0 2024-05-08T08:02:30.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.586+0000 7f14faa00700 1 -- 172.21.15.70:0/2095232736 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4022c60 con 0x7f1504103ef0 2024-05-08T08:02:30.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.586+0000 7f1509200700 1 -- 172.21.15.70:0/2095232736 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150419bc90 con 0x7f1504103ef0 2024-05-08T08:02:30.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.586+0000 7f1509200700 1 -- 172.21.15.70:0/2095232736 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f150419c120 con 0x7f1504103ef0 2024-05-08T08:02:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.591+0000 7f14faa00700 1 -- 172.21.15.70:0/2095232736 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f14f402a070 con 0x7f1504103ef0 2024-05-08T08:02:30.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.593+0000 7f14faa00700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14e80b2b20 0x7f14e80b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.593+0000 7f14faa00700 1 -- 172.21.15.70:0/2095232736 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(231..231 src has 1..231) ==== 9583+0+0 (secure 0 0 0) 0x7f14f4022e00 con 0x7f1504103ef0 2024-05-08T08:02:30.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.594+0000 7f1501e00700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14e80b2b20 0x7f14e80b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.594+0000 7f1501e00700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14e80b2b20 0x7f14e80b4fe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f14ec005fd0 tx=0x7f14ec005db0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:30.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.612+0000 7f1513c5eb80 1 Processor -- start 2024-05-08T08:02:30.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.612+0000 7f1513c5eb80 1 -- start start 2024-05-08T08:02:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.612+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.612+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 0x557fd4e9f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.612+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 0x557fd4eabd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.613+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557fd4df1bb0 con 0x557fd4ea4f50 2024-05-08T08:02:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.613+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557fd4d8f8f0 con 0x557fd4e9fee0 2024-05-08T08:02:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.613+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557fd4dedb70 con 0x557fd4e9f520 2024-05-08T08:02:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.613+0000 7f1501e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.613+0000 7f1501e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46368/0 (socket says 172.21.15.70:46368) 2024-05-08T08:02:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.613+0000 7f1501e00700 1 -- 172.21.15.70:0/2096811465 learned_addr learned my addr 172.21.15.70:0/2096811465 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.613+0000 7f1502800700 1 --2- 172.21.15.70:0/2096811465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 0x557fd4eabd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.613+0000 7f1501400700 1 --2- 172.21.15.70:0/2096811465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 0x557fd4e9f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.614+0000 7f1501e00700 1 -- 172.21.15.70:0/2096811465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 msgr2=0x557fd4e9f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.614+0000 7f1501e00700 1 --2- 172.21.15.70:0/2096811465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 0x557fd4e9f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.614+0000 7f1501e00700 1 -- 172.21.15.70:0/2096811465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 msgr2=0x557fd4eabd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.614+0000 7f1501e00700 1 --2- 172.21.15.70:0/2096811465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 0x557fd4eabd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.614+0000 7f1501e00700 1 -- 172.21.15.70:0/2096811465 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd4d3ea60 con 0x557fd4ea4f50 2024-05-08T08:02:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.615+0000 7f1501e00700 1 --2- 172.21.15.70:0/2096811465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea5330 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00eb90 tx=0x7f14ec011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430002d25f739206 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.615+0000 7f14f3400700 1 -- 172.21.15.70:0/2096811465 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec021070 con 0x557fd4ea4f50 2024-05-08T08:02:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.615+0000 7f14f3400700 1 -- 172.21.15.70:0/2096811465 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14ec010cd0 con 0x557fd4ea4f50 2024-05-08T08:02:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.615+0000 7f14f3400700 1 -- 172.21.15.70:0/2096811465 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14ec00f620 con 0x557fd4ea4f50 2024-05-08T08:02:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.616+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2096811465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 msgr2=0x557fd4ea5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.616+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2096811465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea5330 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00eb90 tx=0x7f14ec011000 comp rx=0 tx=0).stop 2024-05-08T08:02:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.617+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2096811465 shutdown_connections 2024-05-08T08:02:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.617+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2096811465 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 0x557fd4eabd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.617+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2096811465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea5330 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.617+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2096811465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 0x557fd4e9f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.617+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2096811465 >> 172.21.15.70:0/2096811465 conn(0x557fd4dcdcf0 msgr2=0x557fd4e99e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.617+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2096811465 shutdown_connections 2024-05-08T08:02:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.617+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2096811465 wait complete. 2024-05-08T08:02:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.618+0000 7f1513c5eb80 1 -- start start 2024-05-08T08:02:30.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.618+0000 7f1513c5eb80 1 Processor -- start 2024-05-08T08:02:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9fee0 0x557fd4ea8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557fd4eac310 con 0x557fd4ea4f50 2024-05-08T08:02:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557fd4d57cb0 con 0x557fd4e9f520 2024-05-08T08:02:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557fd4eac490 con 0x557fd4e9fee0 2024-05-08T08:02:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1513c5eb80 10 client.0 _ll_register_callbacks cb 0x557fd4d98e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:02:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1501e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1502800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1501e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:40038/0 (socket says 172.21.15.70:40038) 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.619+0000 7f1501e00700 1 -- 172.21.15.70:0/2752872378 learned_addr learned my addr 172.21.15.70:0/2752872378 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.620+0000 7f1501400700 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9fee0 0x557fd4ea8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.620+0000 7f1502800700 1 -- 172.21.15.70:0/2752872378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9fee0 msgr2=0x557fd4ea8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.620+0000 7f1502800700 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9fee0 0x557fd4ea8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.620+0000 7f1502800700 1 -- 172.21.15.70:0/2752872378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 msgr2=0x557fd4eab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.620+0000 7f1502800700 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.620+0000 7f1502800700 1 -- 172.21.15.70:0/2752872378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fd4db75b0 con 0x557fd4ea4f50 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.620+0000 7f1501400700 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9fee0 0x557fd4ea8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:02:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.621+0000 7f1502800700 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea91b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00aeb0 tx=0x7f14fc012510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ca630d3531a340 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.621+0000 7f14e7e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:02:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.621+0000 7f14e7e00700 1 -- 172.21.15.70:0/2752872378 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc01a070 con 0x557fd4ea4f50 2024-05-08T08:02:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.621+0000 7f14e7e00700 1 -- 172.21.15.70:0/2752872378 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(231..231 src has 1..231) ==== 9583+0+0 (secure 0 0 0) 0x7f14fc012ca0 con 0x557fd4ea4f50 2024-05-08T08:02:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.621+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2752872378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14ec010cd0 con 0x557fd4ea4f50 2024-05-08T08:02:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.622+0000 7f14e7e00700 1 -- 172.21.15.70:0/2752872378 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f14fc012ea0 con 0x557fd4ea4f50 2024-05-08T08:02:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.622+0000 7f1513c5eb80 10 client.17538 fetch_fsmap learned FSMap version 42 2024-05-08T08:02:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.622+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2752872378 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557fd4eb6b30 con 0x557fd4ea4f50 2024-05-08T08:02:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.622+0000 7f14e7e00700 1 -- 172.21.15.70:0/2752872378 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14ec010cd0 con 0x557fd4ea4f50 2024-05-08T08:02:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.623+0000 7f14e7e00700 1 -- 172.21.15.70:0/2752872378 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f14fc016bd0 con 0x557fd4ea4f50 2024-05-08T08:02:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.623+0000 7f1513c5eb80 10 client.17538 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:02:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.623+0000 7f1513c5eb80 10 client.17538 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:02:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.623+0000 7f1513c5eb80 20 client.17538 populate_metadata read hostname 'smithi070' 2024-05-08T08:02:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.623+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fd4eb90c0 0x557fd4ebb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.623+0000 7f1513c5eb80 4 client.17538 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:02:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.623+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2752872378 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fd4e6c230 con 0x557fd4eb90c0 2024-05-08T08:02:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.624+0000 7f1501e00700 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fd4eb90c0 0x557fd4ebb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.625+0000 7f1501e00700 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fd4eb90c0 0x557fd4ebb4b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=673c277b9f994e56 server_cookie=cfa828369332e8bf in_seq=0 out_seq=0 2024-05-08T08:02:30.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.625+0000 7f14e7e00700 10 client.17538 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:02:30.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.627+0000 7f14e7e00700 1 -- 172.21.15.70:0/2752872378 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557fd4e6c230 con 0x557fd4eb90c0 2024-05-08T08:02:30.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.627+0000 7f14e7e00700 10 client.17538 handle_command_reply: tid=0 2024-05-08T08:02:30.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.627+0000 7f1513c5eb80 1 client.17538 shutdown 2024-05-08T08:02:30.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.627+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2752872378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 msgr2=0x557fd4ea91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:30.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.627+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea91b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00aeb0 tx=0x7f14fc012510 comp rx=0 tx=0).stop 2024-05-08T08:02:30.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2752872378 shutdown_connections 2024-05-08T08:02:30.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fd4eb90c0 0x557fd4ebb4b0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4ea91b0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/2752872378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9fee0 0x557fd4ea8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2752872378 >> 172.21.15.70:0/2752872378 conn(0x557fd4dcdcf0 msgr2=0x557fd4e948e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:30.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f14e7e00700 0 client.17538 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:02:30.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2752872378 shutdown_connections 2024-05-08T08:02:30.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f1513c5eb80 1 -- 172.21.15.70:0/2752872378 wait complete. 2024-05-08T08:02:30.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.628+0000 7f1513c5eb80 20 client.17538 trim_cache size 0 max 16384 2024-05-08T08:02:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.661+0000 7f1513c5eb80 1 Processor -- start 2024-05-08T08:02:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.661+0000 7f1513c5eb80 1 -- start start 2024-05-08T08:02:30.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 0x557fd4ea4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 0x557fd4eb5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4e99ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15041c0c40 con 0x557fd4ea4f50 2024-05-08T08:02:30.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f15041be4d0 con 0x557fd4e9fee0 2024-05-08T08:02:30.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f15041a3240 con 0x557fd4e9f520 2024-05-08T08:02:30.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1502800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4e99ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1502800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4e99ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46378/0 (socket says 172.21.15.70:46378) 2024-05-08T08:02:30.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1502800700 1 -- 172.21.15.70:0/1828067031 learned_addr learned my addr 172.21.15.70:0/1828067031 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:30.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1501400700 1 --2- 172.21.15.70:0/1828067031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 0x557fd4eb5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.662+0000 7f1501e00700 1 --2- 172.21.15.70:0/1828067031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 0x557fd4ea4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.663+0000 7f1502800700 1 -- 172.21.15.70:0/1828067031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 msgr2=0x557fd4ea4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:30.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.663+0000 7f1502800700 1 --2- 172.21.15.70:0/1828067031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 0x557fd4ea4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.663+0000 7f1502800700 1 -- 172.21.15.70:0/1828067031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 msgr2=0x557fd4eb5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:30.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.663+0000 7f1502800700 1 --2- 172.21.15.70:0/1828067031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 0x557fd4eb5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.663+0000 7f1502800700 1 -- 172.21.15.70:0/1828067031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd4e96a10 con 0x557fd4ea4f50 2024-05-08T08:02:30.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.664+0000 7f1502800700 1 --2- 172.21.15.70:0/1828067031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4e99ca0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f14fc018040 tx=0x7f14fc012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bad0aa0ac89e4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:30.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.664+0000 7f14f2a00700 1 -- 172.21.15.70:0/1828067031 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc02e020 con 0x557fd4ea4f50 2024-05-08T08:02:30.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.664+0000 7f14f2a00700 1 -- 172.21.15.70:0/1828067031 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14fc005c60 con 0x557fd4ea4f50 2024-05-08T08:02:30.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.664+0000 7f14f2a00700 1 -- 172.21.15.70:0/1828067031 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14fc01a070 con 0x557fd4ea4f50 2024-05-08T08:02:30.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.665+0000 7f1513c5eb80 1 -- 172.21.15.70:0/1828067031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 msgr2=0x557fd4e99ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:30.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.665+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/1828067031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4e99ca0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f14fc018040 tx=0x7f14fc012c30 comp rx=0 tx=0).stop 2024-05-08T08:02:30.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.665+0000 7f1513c5eb80 1 -- 172.21.15.70:0/1828067031 shutdown_connections 2024-05-08T08:02:30.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.665+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/1828067031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4ea4f50 0x557fd4e99ca0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.665+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/1828067031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4e9f520 0x557fd4ea4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.665+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/1828067031 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9fee0 0x557fd4eb5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.665+0000 7f1513c5eb80 1 -- 172.21.15.70:0/1828067031 >> 172.21.15.70:0/1828067031 conn(0x557fd4dcdcf0 msgr2=0x557fd4ea3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:30.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.666+0000 7f1513c5eb80 1 -- 172.21.15.70:0/1828067031 shutdown_connections 2024-05-08T08:02:30.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.666+0000 7f1513c5eb80 1 -- 172.21.15.70:0/1828067031 wait complete. 2024-05-08T08:02:30.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.666+0000 7f1513c5eb80 1 -- start start 2024-05-08T08:02:30.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.667+0000 7f1513c5eb80 1 Processor -- start 2024-05-08T08:02:30.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.667+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.667+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4e9fee0 0x557fd4eaebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.667+0000 7f1513c5eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4ea4f50 0x557fd4eaf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.667+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15041a3890 con 0x557fd4e9fee0 2024-05-08T08:02:30.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.667+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f15041bde00 con 0x557fd4e9f520 2024-05-08T08:02:30.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.667+0000 7f1513c5eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f15041a3f60 con 0x557fd4ea4f50 2024-05-08T08:02:30.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.667+0000 7f1513c5eb80 10 client.0 _ll_register_callbacks cb 0x557fd4d98e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:02:30.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.668+0000 7f1501400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4e9fee0 0x557fd4eaebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.668+0000 7f1502800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4ea4f50 0x557fd4eaf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.668+0000 7f1501e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.668+0000 7f1501e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:40064/0 (socket says 172.21.15.70:40064) 2024-05-08T08:02:30.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.668+0000 7f1502800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4ea4f50 0x557fd4eaf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:52282/0 (socket says 172.21.15.70:52282) 2024-05-08T08:02:30.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.668+0000 7f1501e00700 1 -- 172.21.15.70:0/900312903 learned_addr learned my addr 172.21.15.70:0/900312903 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:02:30.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.669+0000 7f1501400700 1 -- 172.21.15.70:0/900312903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4ea4f50 msgr2=0x557fd4eaf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:30.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.669+0000 7f1501400700 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4ea4f50 0x557fd4eaf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.669+0000 7f1501400700 1 -- 172.21.15.70:0/900312903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 msgr2=0x557fd4eae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:02:30.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.669+0000 7f1501400700 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:30.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.669+0000 7f1501400700 1 -- 172.21.15.70:0/900312903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fd4f23a00 con 0x557fd4e9fee0 2024-05-08T08:02:30.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.669+0000 7f1501400700 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4e9fee0 0x557fd4eaebf0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f14f40e0ab0 tx=0x7f14f4005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b35cac1c462718 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:02:30.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.669+0000 7f14e7e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:02:30.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.669+0000 7f14e7e00700 1 -- 172.21.15.70:0/900312903 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f40aadd0 con 0x557fd4e9fee0 2024-05-08T08:02:30.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.669+0000 7f14e7e00700 1 -- 172.21.15.70:0/900312903 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(231..231 src has 1..231) ==== 9583+0+0 (secure 0 0 0) 0x7f14f40a6cc0 con 0x557fd4e9fee0 2024-05-08T08:02:30.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.670+0000 7f1513c5eb80 1 -- 172.21.15.70:0/900312903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14fc005c60 con 0x557fd4e9fee0 2024-05-08T08:02:30.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.670+0000 7f14e7e00700 1 -- 172.21.15.70:0/900312903 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f14f40aa6d0 con 0x557fd4e9fee0 2024-05-08T08:02:30.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.670+0000 7f1513c5eb80 10 client.17544 fetch_fsmap learned FSMap version 42 2024-05-08T08:02:30.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.670+0000 7f1513c5eb80 1 -- 172.21.15.70:0/900312903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557fd4f24d40 con 0x557fd4e9fee0 2024-05-08T08:02:30.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.671+0000 7f14e7e00700 1 -- 172.21.15.70:0/900312903 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14fc005c60 con 0x557fd4e9fee0 2024-05-08T08:02:30.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.672+0000 7f14e7e00700 1 -- 172.21.15.70:0/900312903 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f14f40b3010 con 0x557fd4e9fee0 2024-05-08T08:02:30.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.672+0000 7f1513c5eb80 10 client.17544 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:02:30.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.672+0000 7f1513c5eb80 10 client.17544 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:02:30.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.672+0000 7f1513c5eb80 20 client.17544 populate_metadata read hostname 'smithi070' 2024-05-08T08:02:30.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.672+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fd4f25470 0x557fd4f27890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:02:30.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.672+0000 7f1513c5eb80 4 client.17544 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T08:02:30.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.672+0000 7f1513c5eb80 1 -- 172.21.15.70:0/900312903 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x557fd4dff590 con 0x557fd4f25470 2024-05-08T08:02:30.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.673+0000 7f1501e00700 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fd4f25470 0x557fd4f27890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:02:30.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.674+0000 7f14e7e00700 10 client.17544 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:02:30.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:30.674+0000 7f1501e00700 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fd4f25470 0x557fd4f27890 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec2ed6523d39ae1a server_cookie=3002ad6fbf86e546 in_seq=0 out_seq=0 2024-05-08T08:02:31.037 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq/seq_dummy.o 2024-05-08T08:02:31.672 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/probe.o 2024-05-08T08:02:31.954 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpih-cmp.o 2024-05-08T08:02:32.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:31 smithi172 ceph-mon[33377]: pgmap v2419: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 396 KiB/s wr, 33 op/s 2024-05-08T08:02:32.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:31 smithi194 ceph-mon[33679]: pgmap v2419: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 396 KiB/s wr, 33 op/s 2024-05-08T08:02:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:31 smithi070 ceph-mon[29591]: pgmap v2419: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 396 KiB/s wr, 33 op/s 2024-05-08T08:02:34.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:33 smithi172 ceph-mon[33377]: pgmap v2420: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 377 KiB/s wr, 30 op/s 2024-05-08T08:02:34.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:33 smithi194 ceph-mon[33679]: pgmap v2420: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 377 KiB/s wr, 30 op/s 2024-05-08T08:02:34.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:33 smithi070 ceph-mon[29591]: pgmap v2420: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 377 KiB/s wr, 30 op/s 2024-05-08T08:02:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:35 smithi172 ceph-mon[33377]: pgmap v2421: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 478 KiB/s wr, 46 op/s 2024-05-08T08:02:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:35 smithi194 ceph-mon[33679]: pgmap v2421: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 478 KiB/s wr, 46 op/s 2024-05-08T08:02:36.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:35 smithi070 ceph-mon[29591]: pgmap v2421: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 478 KiB/s wr, 46 op/s 2024-05-08T08:02:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:37 smithi194 ceph-mon[33679]: pgmap v2422: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 255 KiB/s wr, 27 op/s 2024-05-08T08:02:38.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:37 smithi070 ceph-mon[29591]: pgmap v2422: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 255 KiB/s wr, 27 op/s 2024-05-08T08:02:38.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:37 smithi172 ceph-mon[33377]: pgmap v2422: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 255 KiB/s wr, 27 op/s 2024-05-08T08:02:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:39 smithi194 ceph-mon[33679]: pgmap v2423: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 255 KiB/s wr, 27 op/s 2024-05-08T08:02:40.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:39 smithi070 ceph-mon[29591]: pgmap v2423: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 255 KiB/s wr, 27 op/s 2024-05-08T08:02:40.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:39 smithi172 ceph-mon[33377]: pgmap v2423: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 255 KiB/s wr, 27 op/s 2024-05-08T08:02:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:02:41.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:02:41.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:02:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:41 smithi194 ceph-mon[33679]: pgmap v2424: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 368 KiB/s wr, 30 op/s 2024-05-08T08:02:42.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:41 smithi070 ceph-mon[29591]: pgmap v2424: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 368 KiB/s wr, 30 op/s 2024-05-08T08:02:42.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:41 smithi172 ceph-mon[33377]: pgmap v2424: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 368 KiB/s wr, 30 op/s 2024-05-08T08:02:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:43 smithi194 ceph-mon[33679]: pgmap v2425: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 215 KiB/s wr, 19 op/s 2024-05-08T08:02:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:43 smithi070 ceph-mon[29591]: pgmap v2425: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 215 KiB/s wr, 19 op/s 2024-05-08T08:02:44.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:43 smithi172 ceph-mon[33377]: pgmap v2425: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 215 KiB/s wr, 19 op/s 2024-05-08T08:02:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:45 smithi194 ceph-mon[33679]: pgmap v2426: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 297 KiB/s wr, 23 op/s 2024-05-08T08:02:46.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:45 smithi070 ceph-mon[29591]: pgmap v2426: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 297 KiB/s wr, 23 op/s 2024-05-08T08:02:46.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:45 smithi172 ceph-mon[33377]: pgmap v2426: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 297 KiB/s wr, 23 op/s 2024-05-08T08:02:47.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:02:47.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:02:47.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:02:47.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:02:47.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:02:47.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:02:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:02:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:02:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:02:48.224 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:47 smithi070 ceph-mon[29591]: pgmap v2427: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 196 KiB/s wr, 7 op/s 2024-05-08T08:02:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:47 smithi194 ceph-mon[33679]: pgmap v2427: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 196 KiB/s wr, 7 op/s 2024-05-08T08:02:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:47 smithi172 ceph-mon[33377]: pgmap v2427: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 196 KiB/s wr, 7 op/s 2024-05-08T08:02:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:49 smithi194 ceph-mon[33679]: pgmap v2428: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 196 KiB/s wr, 7 op/s 2024-05-08T08:02:50.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:49 smithi070 ceph-mon[29591]: pgmap v2428: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 196 KiB/s wr, 7 op/s 2024-05-08T08:02:50.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:49 smithi172 ceph-mon[33377]: pgmap v2428: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 196 KiB/s wr, 7 op/s 2024-05-08T08:02:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:51 smithi194 ceph-mon[33679]: pgmap v2429: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 246 KiB/s wr, 10 op/s 2024-05-08T08:02:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:51 smithi070 ceph-mon[29591]: pgmap v2429: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 246 KiB/s wr, 10 op/s 2024-05-08T08:02:52.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:51 smithi172 ceph-mon[33377]: pgmap v2429: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 246 KiB/s wr, 10 op/s 2024-05-08T08:02:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.501+0000 7f14e7e00700 1 -- 172.21.15.70:0/900312903 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x557fd4dff590 con 0x557fd4f25470 2024-05-08T08:02:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.501+0000 7f14e7e00700 10 client.17544 handle_command_reply: tid=0 2024-05-08T08:02:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.501+0000 7f1513c5eb80 1 client.17544 shutdown 2024-05-08T08:02:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.502+0000 7f1513c5eb80 1 -- 172.21.15.70:0/900312903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4e9fee0 msgr2=0x557fd4eaebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.502+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4e9fee0 0x557fd4eaebf0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f14f40e0ab0 tx=0x7f14f4005a00 comp rx=0 tx=0).stop 2024-05-08T08:02:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.502+0000 7f1513c5eb80 1 -- 172.21.15.70:0/900312903 shutdown_connections 2024-05-08T08:02:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.502+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557fd4f25470 0x557fd4f27890 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.502+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557fd4ea4f50 0x557fd4eaf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.502+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557fd4e9f520 0x557fd4eae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.502+0000 7f1513c5eb80 1 --2- 172.21.15.70:0/900312903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557fd4e9fee0 0x557fd4eaebf0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.502+0000 7f1513c5eb80 1 -- 172.21.15.70:0/900312903 >> 172.21.15.70:0/900312903 conn(0x557fd4dcdcf0 msgr2=0x557fd4e9e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:53.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.502+0000 7f14e7e00700 0 client.17544 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:02:53.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.503+0000 7f1513c5eb80 1 -- 172.21.15.70:0/900312903 shutdown_connections 2024-05-08T08:02:53.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.503+0000 7f1513c5eb80 1 -- 172.21.15.70:0/900312903 wait complete. 2024-05-08T08:02:53.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.503+0000 7f1513c5eb80 20 client.17544 trim_cache size 0 max 16384 2024-05-08T08:02:53.498 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 182, 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "58df8905": { 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 182, 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:02:53.499 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:02:53.500 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:02:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 -- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14e80b2b20 msgr2=0x7f14e80b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14e80b2b20 0x7f14e80b4fe0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f14ec005fd0 tx=0x7f14ec005db0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 -- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103ef0 msgr2=0x7f150410a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:02:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103ef0 0x7f150410a920 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f14f40057f0 tx=0x7f14f4009ee0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 -- 172.21.15.70:0/2095232736 shutdown_connections 2024-05-08T08:02:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14e80b2b20 0x7f14e80b4fe0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1504108460 0x7f150410ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1504103550 0x7f150410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 --2- 172.21.15.70:0/2095232736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1504103ef0 0x7f150410a920 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:02:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.505+0000 7f1509200700 1 -- 172.21.15.70:0/2095232736 >> 172.21.15.70:0/2095232736 conn(0x7f150407a600 msgr2=0x7f15041013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:02:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.506+0000 7f1509200700 1 -- 172.21.15.70:0/2095232736 shutdown_connections 2024-05-08T08:02:53.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:02:53.506+0000 7f1509200700 1 -- 172.21.15.70:0/2095232736 wait complete. 2024-05-08T08:02:54.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:53 smithi194 ceph-mon[33679]: pgmap v2430: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2024-05-08T08:02:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:53 smithi070 ceph-mon[29591]: pgmap v2430: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2024-05-08T08:02:54.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:53 smithi172 ceph-mon[33377]: pgmap v2430: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 133 KiB/s wr, 7 op/s 2024-05-08T08:02:54.499 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '58df8905', quiesce took 33.4 seconds. Will release after: 30.0 2024-05-08T08:02:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:55 smithi194 ceph-mon[33679]: pgmap v2431: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 11 op/s 2024-05-08T08:02:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:55 smithi070 ceph-mon[29591]: pgmap v2431: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 11 op/s 2024-05-08T08:02:56.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:55 smithi172 ceph-mon[33377]: pgmap v2431: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 162 KiB/s wr, 11 op/s 2024-05-08T08:02:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:02:58 smithi194 ceph-mon[33679]: pgmap v2432: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:02:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:02:58 smithi070 ceph-mon[29591]: pgmap v2432: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:02:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:02:58 smithi172 ceph-mon[33377]: pgmap v2432: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:03:00.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:00 smithi194 ceph-mon[33679]: pgmap v2433: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:03:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:00 smithi070 ceph-mon[29591]: pgmap v2433: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:03:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:00 smithi172 ceph-mon[33377]: pgmap v2433: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:03:02.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:02 smithi070 ceph-mon[29591]: pgmap v2434: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 81 KiB/s wr, 11 op/s 2024-05-08T08:03:02.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:02 smithi172 ceph-mon[33377]: pgmap v2434: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 81 KiB/s wr, 11 op/s 2024-05-08T08:03:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:02 smithi194 ceph-mon[33679]: pgmap v2434: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 81 KiB/s wr, 11 op/s 2024-05-08T08:03:03.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:03 smithi070 ceph-mon[29591]: pgmap v2435: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2024-05-08T08:03:03.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:03 smithi172 ceph-mon[33377]: pgmap v2435: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2024-05-08T08:03:03.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:03 smithi194 ceph-mon[33679]: pgmap v2435: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 8 op/s 2024-05-08T08:03:06.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:05 smithi070 ceph-mon[29591]: pgmap v2436: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 120 KiB/s wr, 29 op/s 2024-05-08T08:03:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:05 smithi172 ceph-mon[33377]: pgmap v2436: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 120 KiB/s wr, 29 op/s 2024-05-08T08:03:06.208 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:05 smithi194 ceph-mon[33679]: pgmap v2436: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 120 KiB/s wr, 29 op/s 2024-05-08T08:03:08.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:07 smithi172 ceph-mon[33377]: pgmap v2437: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 90 KiB/s wr, 25 op/s 2024-05-08T08:03:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:07 smithi194 ceph-mon[33679]: pgmap v2437: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 90 KiB/s wr, 25 op/s 2024-05-08T08:03:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:07 smithi070 ceph-mon[29591]: pgmap v2437: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 90 KiB/s wr, 25 op/s 2024-05-08T08:03:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:09 smithi172 ceph-mon[33377]: pgmap v2438: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 90 KiB/s wr, 25 op/s 2024-05-08T08:03:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:09 smithi194 ceph-mon[33679]: pgmap v2438: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 90 KiB/s wr, 25 op/s 2024-05-08T08:03:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:09 smithi070 ceph-mon[29591]: pgmap v2438: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 90 KiB/s wr, 25 op/s 2024-05-08T08:03:11.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:10 smithi194 ceph-mon[33679]: osdmap e232: 12 total, 12 up, 12 in 2024-05-08T08:03:11.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:10 smithi070 ceph-mon[29591]: osdmap e232: 12 total, 12 up, 12 in 2024-05-08T08:03:11.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:10 smithi172 ceph-mon[33377]: osdmap e232: 12 total, 12 up, 12 in 2024-05-08T08:03:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:11 smithi194 ceph-mon[33679]: pgmap v2440: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 28 op/s 2024-05-08T08:03:12.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:11 smithi070 ceph-mon[29591]: pgmap v2440: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 28 op/s 2024-05-08T08:03:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:11 smithi172 ceph-mon[33377]: pgmap v2440: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 28 op/s 2024-05-08T08:03:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:13 smithi194 ceph-mon[33679]: pgmap v2441: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 28 op/s 2024-05-08T08:03:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:13 smithi070 ceph-mon[29591]: pgmap v2441: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 28 op/s 2024-05-08T08:03:14.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:13 smithi172 ceph-mon[33377]: pgmap v2441: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 109 KiB/s wr, 28 op/s 2024-05-08T08:03:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:15 smithi194 ceph-mon[33679]: pgmap v2442: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-05-08T08:03:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:15 smithi070 ceph-mon[29591]: pgmap v2442: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-05-08T08:03:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:15 smithi172 ceph-mon[33377]: pgmap v2442: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-05-08T08:03:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:17 smithi194 ceph-mon[33679]: pgmap v2443: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-05-08T08:03:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:17 smithi070 ceph-mon[29591]: pgmap v2443: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-05-08T08:03:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:17 smithi172 ceph-mon[33377]: pgmap v2443: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 10 op/s 2024-05-08T08:03:20.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:19 smithi070 ceph-mon[29591]: osdmap e233: 12 total, 12 up, 12 in 2024-05-08T08:03:20.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:19 smithi070 ceph-mon[29591]: pgmap v2445: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 8 op/s 2024-05-08T08:03:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:19 smithi172 ceph-mon[33377]: osdmap e233: 12 total, 12 up, 12 in 2024-05-08T08:03:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:19 smithi172 ceph-mon[33377]: pgmap v2445: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 8 op/s 2024-05-08T08:03:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:19 smithi194 ceph-mon[33679]: osdmap e233: 12 total, 12 up, 12 in 2024-05-08T08:03:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:19 smithi194 ceph-mon[33679]: pgmap v2445: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 8 op/s 2024-05-08T08:03:22.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:21 smithi172 ceph-mon[33377]: pgmap v2446: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-05-08T08:03:22.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:21 smithi194 ceph-mon[33679]: pgmap v2446: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-05-08T08:03:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:21 smithi070 ceph-mon[29591]: pgmap v2446: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-05-08T08:03:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:23 smithi172 ceph-mon[33377]: pgmap v2447: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-05-08T08:03:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:23 smithi194 ceph-mon[33679]: pgmap v2447: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-05-08T08:03:24.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:23 smithi070 ceph-mon[29591]: pgmap v2447: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 10 op/s 2024-05-08T08:03:24.501 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:03:24.972 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:03:26.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:25 smithi172 ceph-mon[33377]: pgmap v2448: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T08:03:26.181 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:25 smithi070 ceph-mon[29591]: pgmap v2448: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T08:03:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:25 smithi194 ceph-mon[33679]: pgmap v2448: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T08:03:27.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.370+0000 7f641e200700 1 -- 172.21.15.70:0/1538350825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 msgr2=0x7f641810f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.370+0000 7f641e200700 1 --2- 172.21.15.70:0/1538350825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 0x7f641810f960 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f640000b0a0 tx=0x7f640000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.370+0000 7f641e200700 1 -- 172.21.15.70:0/1538350825 shutdown_connections 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.370+0000 7f641e200700 1 --2- 172.21.15.70:0/1538350825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f641810fea0 0x7f6418112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.370+0000 7f641e200700 1 --2- 172.21.15.70:0/1538350825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64180756d0 0x7f6418075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.370+0000 7f641e200700 1 --2- 172.21.15.70:0/1538350825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 0x7f641810f960 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.370+0000 7f641e200700 1 -- 172.21.15.70:0/1538350825 >> 172.21.15.70:0/1538350825 conn(0x7f641807a600 msgr2=0x7f641807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.370+0000 7f641e200700 1 -- 172.21.15.70:0/1538350825 shutdown_connections 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.370+0000 7f641e200700 1 -- 172.21.15.70:0/1538350825 wait complete. 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.371+0000 7f641e200700 1 Processor -- start 2024-05-08T08:03:27.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.371+0000 7f641e200700 1 -- start start 2024-05-08T08:03:27.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f641e200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64180756d0 0x7f64181a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f641e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 0x7f64181a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f641e200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641810fea0 0x7f641819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f641e200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6418115780 con 0x7f6418075ff0 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f641e200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6418115600 con 0x7f641810fea0 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f641e200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6418115900 con 0x7f64180756d0 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f640ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 0x7f64181a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f640ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 0x7f64181a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48304/0 (socket says 172.21.15.70:48304) 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f640ea00700 1 -- 172.21.15.70:0/417998385 learned_addr learned my addr 172.21.15.70:0/417998385 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.372+0000 7f6417400700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64180756d0 0x7f64181a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f640ea00700 1 -- 172.21.15.70:0/417998385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64180756d0 msgr2=0x7f64181a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f640ea00700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64180756d0 0x7f64181a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f640ea00700 1 -- 172.21.15.70:0/417998385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641810fea0 msgr2=0x7f641819bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f6417e00700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641810fea0 0x7f641819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f640ea00700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641810fea0 0x7f641819bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f640ea00700 1 -- 172.21.15.70:0/417998385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641819c260 con 0x7f6418075ff0 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f640ea00700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 0x7f64181a1e30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f640000b830 tx=0x7f6400004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f6414c00700 1 -- 172.21.15.70:0/417998385 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400021070 con 0x7f6418075ff0 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f6414c00700 1 -- 172.21.15.70:0/417998385 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6400007c80 con 0x7f6418075ff0 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641819c4f0 con 0x7f6418075ff0 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.373+0000 7f6414c00700 1 -- 172.21.15.70:0/417998385 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400005260 con 0x7f6418075ff0 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.374+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64181a87c0 con 0x7f6418075ff0 2024-05-08T08:03:27.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.375+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641806a190 con 0x7f6418075ff0 2024-05-08T08:03:27.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.377+0000 7f6414c00700 1 -- 172.21.15.70:0/417998385 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6400024070 con 0x7f6418075ff0 2024-05-08T08:03:27.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.378+0000 7f6414c00700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63fc0b2a70 0x7f63fc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:27.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.378+0000 7f6414c00700 1 -- 172.21.15.70:0/417998385 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(233..233 src has 1..233) ==== 9583+0+0 (secure 0 0 0) 0x7f640000f020 con 0x7f6418075ff0 2024-05-08T08:03:27.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.379+0000 7f6417400700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63fc0b2a70 0x7f63fc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:27.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.379+0000 7f6417400700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63fc0b2a70 0x7f63fc0b4f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6408005950 tx=0x7f6408005ed0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:03:27.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.381+0000 7f6414c00700 1 -- 172.21.15.70:0/417998385 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f640002b020 con 0x7f6418075ff0 2024-05-08T08:03:27.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.661+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f641819cfe0 con 0x7f6418075ff0 2024-05-08T08:03:27.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.663+0000 7f6414c00700 1 -- 172.21.15.70:0/417998385 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f64000abae0 con 0x7f6418075ff0 2024-05-08T08:03:27.658 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:03:27.658 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:03:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63fc0b2a70 msgr2=0x7f63fc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63fc0b2a70 0x7f63fc0b4f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6408005950 tx=0x7f6408005ed0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 msgr2=0x7f64181a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 0x7f64181a1e30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f640000b830 tx=0x7f6400004db0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 shutdown_connections 2024-05-08T08:03:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f63fc0b2a70 0x7f63fc0b4f30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f641810fea0 0x7f641819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64180756d0 0x7f64181a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 --2- 172.21.15.70:0/417998385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6418075ff0 0x7f64181a1e30 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 >> 172.21.15.70:0/417998385 conn(0x7f641807a600 msgr2=0x7f6418100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:03:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 shutdown_connections 2024-05-08T08:03:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:27.667+0000 7f641e200700 1 -- 172.21.15.70:0/417998385 wait complete. 2024-05-08T08:03:27.664 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:03:28.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:27 smithi172 ceph-mon[33377]: pgmap v2449: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T08:03:28.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:27 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/417998385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:03:28.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:27 smithi194 ceph-mon[33679]: pgmap v2449: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T08:03:28.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:27 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/417998385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:03:28.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:27 smithi070 ceph-mon[29591]: pgmap v2449: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T08:03:28.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:27 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/417998385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:03:28.486 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 58df8905 --release --await' 2024-05-08T08:03:28.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 58df8905 --release --await 2024-05-08T08:03:28.952 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:03:30.191 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:29 smithi070 ceph-mon[29591]: pgmap v2450: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T08:03:30.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:29 smithi194 ceph-mon[33679]: pgmap v2450: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T08:03:30.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:29 smithi172 ceph-mon[33377]: pgmap v2450: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T08:03:31.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.386+0000 7f9dcc200700 1 -- 172.21.15.70:0/3860298553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc4109510 msgr2=0x7f9dc41098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:31.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.386+0000 7f9dcc200700 1 --2- 172.21.15.70:0/3860298553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc4109510 0x7f9dc41098f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009990 tx=0x7f9db8009ca0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.387+0000 7f9dcc200700 1 -- 172.21.15.70:0/3860298553 shutdown_connections 2024-05-08T08:03:31.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.387+0000 7f9dcc200700 1 --2- 172.21.15.70:0/3860298553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dc406bb40 0x7f9dc4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.387+0000 7f9dcc200700 1 --2- 172.21.15.70:0/3860298553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc4109510 0x7f9dc41098f0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.387+0000 7f9dcc200700 1 --2- 172.21.15.70:0/3860298553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc406b180 0x7f9dc406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.387+0000 7f9dcc200700 1 -- 172.21.15.70:0/3860298553 >> 172.21.15.70:0/3860298553 conn(0x7f9dc4079350 msgr2=0x7f9dc4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:03:31.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.387+0000 7f9dcc200700 1 -- 172.21.15.70:0/3860298553 shutdown_connections 2024-05-08T08:03:31.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.387+0000 7f9dcc200700 1 -- 172.21.15.70:0/3860298553 wait complete. 2024-05-08T08:03:31.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.388+0000 7f9dcc200700 1 Processor -- start 2024-05-08T08:03:31.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.388+0000 7f9dcc200700 1 -- start start 2024-05-08T08:03:31.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.388+0000 7f9dcc200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dc406b180 0x7f9dc4102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.388+0000 7f9dcc200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc406bb40 0x7f9dc41029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.388+0000 7f9dcc200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4109510 0x7f9dc4102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.388+0000 7f9dcc200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc4113540 con 0x7f9dc406bb40 2024-05-08T08:03:31.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.388+0000 7f9dcc200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41133c0 con 0x7f9dc406b180 2024-05-08T08:03:31.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.388+0000 7f9dcc200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41136c0 con 0x7f9dc4109510 2024-05-08T08:03:31.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dc8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc406bb40 0x7f9dc41029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dc8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc406bb40 0x7f9dc41029b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48326/0 (socket says 172.21.15.70:48326) 2024-05-08T08:03:31.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dc8e00700 1 -- 172.21.15.70:0/1378189698 learned_addr learned my addr 172.21.15.70:0/1378189698 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:03:31.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dc9800700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dc406b180 0x7f9dc4102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dc8e00700 1 -- 172.21.15.70:0/1378189698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4109510 msgr2=0x7f9dc4102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dca200700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4109510 0x7f9dc4102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4109510 0x7f9dc4102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dc8e00700 1 -- 172.21.15.70:0/1378189698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dc406b180 msgr2=0x7f9dc4102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dc406b180 0x7f9dc4102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dc8e00700 1 -- 172.21.15.70:0/1378189698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc41a7fe0 con 0x7f9dc406bb40 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.389+0000 7f9dca200700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4109510 0x7f9dc4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.390+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc406bb40 0x7f9dc41029b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9db000d980 tx=0x7f9db000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.390+0000 7f9dc2000700 1 -- 172.21.15.70:0/1378189698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db0017070 con 0x7f9dc406bb40 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.390+0000 7f9dc2000700 1 -- 172.21.15.70:0/1378189698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db0004830 con 0x7f9dc406bb40 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.390+0000 7f9dc2000700 1 -- 172.21.15.70:0/1378189698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db00053a0 con 0x7f9dc406bb40 2024-05-08T08:03:31.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.390+0000 7f9dcc200700 1 -- 172.21.15.70:0/1378189698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc41a82d0 con 0x7f9dc406bb40 2024-05-08T08:03:31.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.390+0000 7f9dcc200700 1 -- 172.21.15.70:0/1378189698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc41a87c0 con 0x7f9dc406bb40 2024-05-08T08:03:31.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.394+0000 7f9dc2000700 1 -- 172.21.15.70:0/1378189698 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9db00049e0 con 0x7f9dc406bb40 2024-05-08T08:03:31.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.395+0000 7f9dc2000700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9dac0b29f0 0x7f9dac0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.395+0000 7f9dc2000700 1 -- 172.21.15.70:0/1378189698 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(233..233 src has 1..233) ==== 9583+0+0 (secure 0 0 0) 0x7f9db00e2a40 con 0x7f9dc406bb40 2024-05-08T08:03:31.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.395+0000 7f9dc9800700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9dac0b29f0 0x7f9dac0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.396+0000 7f9dc9800700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9dac0b29f0 0x7f9dac0b4eb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9db800b5c0 tx=0x7f9db801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:03:31.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.414+0000 7f9dd6b70b80 1 Processor -- start 2024-05-08T08:03:31.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.415+0000 7f9dd6b70b80 1 -- start start 2024-05-08T08:03:31.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.415+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.415+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 0x557b4e0cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.415+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 0x557b4e0d7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.415+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b4e01db20 con 0x557b4e0d0ec0 2024-05-08T08:03:31.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.415+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557b4dfbb860 con 0x557b4e0cbe50 2024-05-08T08:03:31.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.415+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557b4e019ae0 con 0x557b4e0cb490 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.415+0000 7f9dc9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.416+0000 7f9dc9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48334/0 (socket says 172.21.15.70:48334) 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.416+0000 7f9dc9800700 1 -- 172.21.15.70:0/1085376914 learned_addr learned my addr 172.21.15.70:0/1085376914 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.416+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/1085376914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 0x557b4e0cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.416+0000 7f9dca200700 1 --2- 172.21.15.70:0/1085376914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 0x557b4e0d7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.416+0000 7f9dc9800700 1 -- 172.21.15.70:0/1085376914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 msgr2=0x557b4e0cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.416+0000 7f9dc9800700 1 --2- 172.21.15.70:0/1085376914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 0x557b4e0cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.416+0000 7f9dc9800700 1 -- 172.21.15.70:0/1085376914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 msgr2=0x557b4e0d7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.416+0000 7f9dc9800700 1 --2- 172.21.15.70:0/1085376914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 0x557b4e0d7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.416+0000 7f9dc9800700 1 -- 172.21.15.70:0/1085376914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4df6a9d0 con 0x557b4e0d0ec0 2024-05-08T08:03:31.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.417+0000 7f9dc9800700 1 --2- 172.21.15.70:0/1085376914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d12a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9db800ba40 tx=0x7f9db801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2862d1693db9f013 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:03:31.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.417+0000 7f9db6a00700 1 -- 172.21.15.70:0/1085376914 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db800f810 con 0x557b4e0d0ec0 2024-05-08T08:03:31.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.417+0000 7f9db6a00700 1 -- 172.21.15.70:0/1085376914 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db8032070 con 0x557b4e0d0ec0 2024-05-08T08:03:31.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.417+0000 7f9db6a00700 1 -- 172.21.15.70:0/1085376914 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8023c70 con 0x557b4e0d0ec0 2024-05-08T08:03:31.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.418+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1085376914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0d0ec0 msgr2=0x557b4e0d12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:31.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.418+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1085376914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d12a0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9db800ba40 tx=0x7f9db801e000 comp rx=0 tx=0).stop 2024-05-08T08:03:31.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.418+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1085376914 shutdown_connections 2024-05-08T08:03:31.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.418+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1085376914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 0x557b4e0d7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.418+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1085376914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d12a0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.418+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1085376914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 0x557b4e0cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.418+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1085376914 >> 172.21.15.70:0/1085376914 conn(0x557b4dff9c60 msgr2=0x557b4e0c5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:03:31.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.418+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1085376914 shutdown_connections 2024-05-08T08:03:31.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.418+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1085376914 wait complete. 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.419+0000 7f9dd6b70b80 1 -- start start 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.419+0000 7f9dd6b70b80 1 Processor -- start 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.419+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cb490 0x557b4e0d7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.419+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0d4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557b4e0d8220 con 0x557b4e0cbe50 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557b4df83c20 con 0x557b4e0cb490 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557b4e0d83a0 con 0x557b4e0d0ec0 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dd6b70b80 10 client.0 _ll_register_callbacks cb 0x557b4dfc4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:03:31.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0d4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0d4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48350/0 (socket says 172.21.15.70:48350) 2024-05-08T08:03:31.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc8e00700 1 -- 172.21.15.70:0/3257268020 learned_addr learned my addr 172.21.15.70:0/3257268020 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:03:31.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc9800700 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cb490 0x557b4e0d7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dca200700 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc8e00700 1 -- 172.21.15.70:0/3257268020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 msgr2=0x557b4e0d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc8e00700 1 -- 172.21.15.70:0/3257268020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cb490 msgr2=0x557b4e0d7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cb490 0x557b4e0d7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc8e00700 1 -- 172.21.15.70:0/3257268020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b4dfe3520 con 0x557b4e0cbe50 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.420+0000 7f9dc9800700 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cb490 0x557b4e0d7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.421+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0d4c20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9db000bfd0 tx=0x7f9db00a94f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73e20c9a2bf4f7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.421+0000 7f9dab400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.421+0000 7f9dab400700 1 -- 172.21.15.70:0/3257268020 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db00b2700 con 0x557b4e0cbe50 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.421+0000 7f9dab400700 1 -- 172.21.15.70:0/3257268020 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(233..233 src has 1..233) ==== 9583+0+0 (secure 0 0 0) 0x7f9db00a9b00 con 0x557b4e0cbe50 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.421+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3257268020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9db8032070 con 0x557b4e0cbe50 2024-05-08T08:03:31.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.421+0000 7f9dab400700 1 -- 172.21.15.70:0/3257268020 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9db00a9d00 con 0x557b4e0cbe50 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.421+0000 7f9dd6b70b80 10 client.17562 fetch_fsmap learned FSMap version 42 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.421+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3257268020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557b4e0e2ad0 con 0x557b4e0cbe50 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.422+0000 7f9dab400700 1 -- 172.21.15.70:0/3257268020 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db8032070 con 0x557b4e0cbe50 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.422+0000 7f9dab400700 1 -- 172.21.15.70:0/3257268020 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9db00aabd0 con 0x557b4e0cbe50 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.422+0000 7f9dd6b70b80 10 client.17562 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.422+0000 7f9dd6b70b80 10 client.17562 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.422+0000 7f9dd6b70b80 20 client.17562 populate_metadata read hostname 'smithi070' 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.422+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557b4e0e5110 0x557b4e0e7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.422+0000 7f9dd6b70b80 4 client.17562 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.422+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3257268020 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b4e0981a0 con 0x557b4e0e5110 2024-05-08T08:03:31.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.423+0000 7f9dc9800700 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557b4e0e5110 0x557b4e0e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.423+0000 7f9dc9800700 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557b4e0e5110 0x557b4e0e7500 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1c0cbb509fb44d7 server_cookie=4e7f0117ae46ae68 in_seq=0 out_seq=0 2024-05-08T08:03:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.423+0000 7f9dab400700 10 client.17562 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:03:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.425+0000 7f9dab400700 1 -- 172.21.15.70:0/3257268020 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557b4e0981a0 con 0x557b4e0e5110 2024-05-08T08:03:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.425+0000 7f9dab400700 10 client.17562 handle_command_reply: tid=0 2024-05-08T08:03:31.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.425+0000 7f9dd6b70b80 1 client.17562 shutdown 2024-05-08T08:03:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3257268020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 msgr2=0x557b4e0d4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0d4c20 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9db000bfd0 tx=0x7f9db00a94f0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3257268020 shutdown_connections 2024-05-08T08:03:31.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557b4e0e5110 0x557b4e0e7500 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 0x557b4e0d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cb490 0x557b4e0d7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3257268020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0d4c20 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3257268020 >> 172.21.15.70:0/3257268020 conn(0x557b4dff9c60 msgr2=0x557b4e0c0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:03:31.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dab400700 0 client.17562 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:03:31.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3257268020 shutdown_connections 2024-05-08T08:03:31.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3257268020 wait complete. 2024-05-08T08:03:31.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.426+0000 7f9dd6b70b80 20 client.17562 trim_cache size 0 max 16384 2024-05-08T08:03:31.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.448+0000 7f9dd6b70b80 1 Processor -- start 2024-05-08T08:03:31.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.448+0000 7f9dd6b70b80 1 -- start start 2024-05-08T08:03:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.448+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 0x557b4e0d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.448+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0e1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.448+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0d0ec0 0x557b4e0ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.448+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41b3f90 con 0x557b4e0cbe50 2024-05-08T08:03:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.448+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41b1820 con 0x557b4e0d0ec0 2024-05-08T08:03:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.448+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41af690 con 0x557b4e0cb490 2024-05-08T08:03:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dc8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0e1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dc8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0e1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48362/0 (socket says 172.21.15.70:48362) 2024-05-08T08:03:31.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dc8e00700 1 -- 172.21.15.70:0/3040878498 learned_addr learned my addr 172.21.15.70:0/3040878498 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:03:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dc9800700 1 --2- 172.21.15.70:0/3040878498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 0x557b4e0d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dca200700 1 --2- 172.21.15.70:0/3040878498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0d0ec0 0x557b4e0ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dc8e00700 1 -- 172.21.15.70:0/3040878498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 msgr2=0x557b4e0d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/3040878498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 0x557b4e0d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dc8e00700 1 -- 172.21.15.70:0/3040878498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0d0ec0 msgr2=0x557b4e0ecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/3040878498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0d0ec0 0x557b4e0ecd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.449+0000 7f9dc8e00700 1 -- 172.21.15.70:0/3040878498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4e0c2980 con 0x557b4e0cbe50 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.450+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/3040878498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0e1270 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9db00b0fd0 tx=0x7f9db00a9ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e82b7a4f5e000c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.450+0000 7f9db6000700 1 -- 172.21.15.70:0/3040878498 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db00a91f0 con 0x557b4e0cbe50 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.450+0000 7f9db6000700 1 -- 172.21.15.70:0/3040878498 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db00b2700 con 0x557b4e0cbe50 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.450+0000 7f9db6000700 1 -- 172.21.15.70:0/3040878498 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db00b22f0 con 0x557b4e0cbe50 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.450+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3040878498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 msgr2=0x557b4e0e1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.450+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3040878498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0e1270 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f9db00b0fd0 tx=0x7f9db00a9ea0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.450+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3040878498 shutdown_connections 2024-05-08T08:03:31.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.450+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3040878498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0d0ec0 0x557b4e0ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.450+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3040878498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0cb490 0x557b4e0d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.451+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/3040878498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cbe50 0x557b4e0e1270 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.451+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3040878498 >> 172.21.15.70:0/3040878498 conn(0x557b4dff9c60 msgr2=0x557b4e0cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:03:31.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.451+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3040878498 shutdown_connections 2024-05-08T08:03:31.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.451+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/3040878498 wait complete. 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.451+0000 7f9dd6b70b80 1 -- start start 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.451+0000 7f9dd6b70b80 1 Processor -- start 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cb490 0x557b4e0dabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 0x557b4e0db100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dd6b70b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 0x557b4e149910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41afce0 con 0x557b4e0cb490 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41b1150 con 0x557b4e0cbe50 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dd6b70b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc41b03b0 con 0x557b4e0d0ec0 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dd6b70b80 10 client.0 _ll_register_callbacks cb 0x557b4dfc4d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dc9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cb490 0x557b4e0dabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dc9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cb490 0x557b4e0dabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48374/0 (socket says 172.21.15.70:48374) 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.452+0000 7f9dc9800700 1 -- 172.21.15.70:0/1939518918 learned_addr learned my addr 172.21.15.70:0/1939518918 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dca200700 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 0x557b4e149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 0x557b4e0db100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dc9800700 1 -- 172.21.15.70:0/1939518918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 msgr2=0x557b4e149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dc9800700 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 0x557b4e149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dc9800700 1 -- 172.21.15.70:0/1939518918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 msgr2=0x557b4e0db100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dc9800700 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 0x557b4e0db100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dc9800700 1 -- 172.21.15.70:0/1939518918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b4e149ff0 con 0x557b4e0cb490 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dc9800700 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cb490 0x557b4e0dabc0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009350 tx=0x7f9db8005a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7189210efd8ff80a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dab400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dab400700 1 -- 172.21.15.70:0/1939518918 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db80238c0 con 0x557b4e0cb490 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.453+0000 7f9dab400700 1 -- 172.21.15.70:0/1939518918 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(233..233 src has 1..233) ==== 9583+0+0 (secure 0 0 0) 0x7f9db8023a60 con 0x557b4e0cb490 2024-05-08T08:03:31.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1939518918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9db00b2700 con 0x557b4e0cb490 2024-05-08T08:03:31.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dab400700 1 -- 172.21.15.70:0/1939518918 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9db804b050 con 0x557b4e0cb490 2024-05-08T08:03:31.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dd6b70b80 10 client.17568 fetch_fsmap learned FSMap version 42 2024-05-08T08:03:31.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1939518918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557b4e1513a0 con 0x557b4e0cb490 2024-05-08T08:03:31.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dab400700 1 -- 172.21.15.70:0/1939518918 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db00b2700 con 0x557b4e0cb490 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dab400700 1 -- 172.21.15.70:0/1939518918 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9db8004860 con 0x557b4e0cb490 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dd6b70b80 10 client.17568 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dd6b70b80 10 client.17568 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dd6b70b80 20 client.17568 populate_metadata read hostname 'smithi070' 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557b4e151630 0x557b4e153a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dd6b70b80 4 client.17568 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "58df8905", "release": true, "await": true}] 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.454+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1939518918 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "58df8905", "release": true, "await": true}) -- 0x557b4e02b500 con 0x557b4e151630 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.455+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557b4e151630 0x557b4e153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.456+0000 7f9dc8e00700 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557b4e151630 0x557b4e153a20 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=caf44bffad851706 server_cookie=bfb3f3007f621d1 in_seq=0 out_seq=0 2024-05-08T08:03:31.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:31.456+0000 7f9dab400700 10 client.17568 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:03:32.226 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:31 smithi172 ceph-mon[33377]: pgmap v2451: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T08:03:32.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:31 smithi194 ceph-mon[33679]: pgmap v2451: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T08:03:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:31 smithi070 ceph-mon[29591]: pgmap v2451: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T08:03:34.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:33 smithi194 ceph-mon[33679]: pgmap v2452: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:03:34.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:33 smithi070 ceph-mon[29591]: pgmap v2452: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:03:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:33 smithi172 ceph-mon[33377]: pgmap v2452: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.094+0000 7f9dab400700 1 -- 172.21.15.70:0/1939518918 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x557b4e02b500 con 0x557b4e151630 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.094+0000 7f9dab400700 10 client.17568 handle_command_reply: tid=0 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.094+0000 7f9dd6b70b80 1 client.17568 shutdown 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.095+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1939518918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cb490 msgr2=0x557b4e0dabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.095+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cb490 0x557b4e0dabc0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009350 tx=0x7f9db8005a30 comp rx=0 tx=0).stop 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.095+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1939518918 shutdown_connections 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.095+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557b4e151630 0x557b4e153a20 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.095+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557b4e0d0ec0 0x557b4e149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.095+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557b4e0cb490 0x557b4e0dabc0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:36.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.095+0000 7f9dd6b70b80 1 --2- 172.21.15.70:0/1939518918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557b4e0cbe50 0x557b4e0db100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:36.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.095+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1939518918 >> 172.21.15.70:0/1939518918 conn(0x557b4dff9c60 msgr2=0x557b4e0ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:03:36.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.095+0000 7f9dab400700 0 client.17568 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:03:36.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.096+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1939518918 shutdown_connections 2024-05-08T08:03:36.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.096+0000 7f9dd6b70b80 1 -- 172.21.15.70:0/1939518918 wait complete. 2024-05-08T08:03:36.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.096+0000 7f9dd6b70b80 20 client.17568 trim_cache size 0 max 16384 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 184, 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "58df8905": { 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 184, 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:03:36.093 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:03:36.094 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:03:36.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.097+0000 7f9dcc200700 1 -- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9dac0b29f0 msgr2=0x7f9dac0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:36.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.097+0000 7f9dcc200700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9dac0b29f0 0x7f9dac0b4eb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9db800b5c0 tx=0x7f9db801a040 comp rx=0 tx=0).stop 2024-05-08T08:03:36.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 -- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc406bb40 msgr2=0x7f9dc41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:03:36.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc406bb40 0x7f9dc41029b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9db000d980 tx=0x7f9db000dd40 comp rx=0 tx=0).stop 2024-05-08T08:03:36.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 -- 172.21.15.70:0/1378189698 shutdown_connections 2024-05-08T08:03:36.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9dac0b29f0 0x7f9dac0b4eb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:36.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dc4109510 0x7f9dc4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:36.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9dc406b180 0x7f9dc4102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:36.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 --2- 172.21.15.70:0/1378189698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dc406bb40 0x7f9dc41029b0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:03:36.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 -- 172.21.15.70:0/1378189698 >> 172.21.15.70:0/1378189698 conn(0x7f9dc4079350 msgr2=0x7f9dc41010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:03:36.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 -- 172.21.15.70:0/1378189698 shutdown_connections 2024-05-08T08:03:36.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:03:36.098+0000 7f9dcc200700 1 -- 172.21.15.70:0/1378189698 wait complete. 2024-05-08T08:03:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:35 smithi194 ceph-mon[33679]: pgmap v2453: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T08:03:36.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:35 smithi070 ceph-mon[29591]: pgmap v2453: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T08:03:36.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:35 smithi172 ceph-mon[33377]: pgmap v2453: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T08:03:36.487 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fat/namei_msdos.o 2024-05-08T08:03:36.926 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '58df8905', seconds elapsed: 75.8 2024-05-08T08:03:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:37 smithi194 ceph-mon[33679]: pgmap v2454: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:03:38.318 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/capability.o 2024-05-08T08:03:38.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:37 smithi070 ceph-mon[29591]: pgmap v2454: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:03:38.393 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpih-div.o 2024-05-08T08:03:38.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:37 smithi172 ceph-mon[33377]: pgmap v2454: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:03:38.552 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/alternative.o 2024-05-08T08:03:38.566 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/core/seq/built-in.a 2024-05-08T08:03:38.696 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/host-bridge.o 2024-05-08T08:03:38.708 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/gen_stats.o 2024-05-08T08:03:39.392 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/sound.o 2024-05-08T08:03:39.527 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/remove.o 2024-05-08T08:03:40.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:39 smithi194 ceph-mon[33679]: pgmap v2455: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:03:40.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:39 smithi070 ceph-mon[29591]: pgmap v2455: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:03:40.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:39 smithi172 ceph-mon[33377]: pgmap v2455: 129 pgs: 129 active+clean; 1.8 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:03:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:41 smithi194 ceph-mon[33679]: pgmap v2456: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 240 KiB/s wr, 17 op/s 2024-05-08T08:03:42.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:41 smithi070 ceph-mon[29591]: pgmap v2456: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 240 KiB/s wr, 17 op/s 2024-05-08T08:03:42.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:41 smithi172 ceph-mon[33377]: pgmap v2456: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 240 KiB/s wr, 17 op/s 2024-05-08T08:03:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:43 smithi194 ceph-mon[33679]: pgmap v2457: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 240 KiB/s wr, 14 op/s 2024-05-08T08:03:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:43 smithi070 ceph-mon[29591]: pgmap v2457: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 240 KiB/s wr, 14 op/s 2024-05-08T08:03:44.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:43 smithi172 ceph-mon[33377]: pgmap v2457: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 240 KiB/s wr, 14 op/s 2024-05-08T08:03:45.708 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/fat/built-in.a 2024-05-08T08:03:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:45 smithi194 ceph-mon[33679]: pgmap v2458: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 364 KiB/s wr, 27 op/s 2024-05-08T08:03:46.322 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpih-mul.o 2024-05-08T08:03:46.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:45 smithi070 ceph-mon[29591]: pgmap v2458: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 364 KiB/s wr, 27 op/s 2024-05-08T08:03:46.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:45 smithi172 ceph-mon[33377]: pgmap v2458: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 364 KiB/s wr, 27 op/s 2024-05-08T08:03:46.549 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/isofs/namei.o 2024-05-08T08:03:47.082 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/isofs/inode.o 2024-05-08T08:03:47.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:03:47.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:03:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:03:47.721 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/init.o 2024-05-08T08:03:48.195 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/ptrace.o 2024-05-08T08:03:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:47 smithi194 ceph-mon[33679]: pgmap v2459: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 364 KiB/s wr, 24 op/s 2024-05-08T08:03:48.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:47 smithi070 ceph-mon[29591]: pgmap v2459: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 364 KiB/s wr, 24 op/s 2024-05-08T08:03:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:47 smithi172 ceph-mon[33377]: pgmap v2459: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 364 KiB/s wr, 24 op/s 2024-05-08T08:03:48.543 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/pci.o 2024-05-08T08:03:49.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:03:49.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:03:49.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:03:49.329 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/i8253.o 2024-05-08T08:03:49.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:03:49.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:03:49.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:03:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:03:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:03:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:03:49.974 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/gen_estimator.o 2024-05-08T08:03:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:50 smithi194 ceph-mon[33679]: pgmap v2460: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 364 KiB/s wr, 24 op/s 2024-05-08T08:03:50.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:50 smithi070 ceph-mon[29591]: pgmap v2460: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 364 KiB/s wr, 24 op/s 2024-05-08T08:03:50.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:50 smithi172 ceph-mon[33377]: pgmap v2460: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 364 KiB/s wr, 24 op/s 2024-05-08T08:03:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:52 smithi194 ceph-mon[33679]: pgmap v2461: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 782 KiB/s wr, 53 op/s 2024-05-08T08:03:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:52 smithi070 ceph-mon[29591]: pgmap v2461: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 782 KiB/s wr, 53 op/s 2024-05-08T08:03:52.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:52 smithi172 ceph-mon[33377]: pgmap v2461: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 782 KiB/s wr, 53 op/s 2024-05-08T08:03:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:54 smithi070 ceph-mon[29591]: pgmap v2462: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 541 KiB/s wr, 42 op/s 2024-05-08T08:03:54.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:54 smithi172 ceph-mon[33377]: pgmap v2462: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 541 KiB/s wr, 42 op/s 2024-05-08T08:03:54.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:54 smithi194 ceph-mon[33679]: pgmap v2462: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 543 KiB/s rd, 541 KiB/s wr, 42 op/s 2024-05-08T08:03:54.971 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpi-pow.o 2024-05-08T08:03:55.599 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/hw_breakpoint.o 2024-05-08T08:03:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:56 smithi070 ceph-mon[29591]: pgmap v2463: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 758 KiB/s wr, 54 op/s 2024-05-08T08:03:56.415 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/memory.o 2024-05-08T08:03:56.422 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/control.o 2024-05-08T08:03:56.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:56 smithi172 ceph-mon[33377]: pgmap v2463: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 758 KiB/s wr, 54 op/s 2024-05-08T08:03:56.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:56 smithi194 ceph-mon[33679]: pgmap v2463: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 758 KiB/s wr, 54 op/s 2024-05-08T08:03:56.774 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/isofs/dir.o 2024-05-08T08:03:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:03:58 smithi070 ceph-mon[29591]: pgmap v2464: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 634 KiB/s wr, 41 op/s 2024-05-08T08:03:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:03:58 smithi172 ceph-mon[33377]: pgmap v2464: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 634 KiB/s wr, 41 op/s 2024-05-08T08:03:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:03:58 smithi194 ceph-mon[33679]: pgmap v2464: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 634 KiB/s wr, 41 op/s 2024-05-08T08:03:58.632 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/user.o 2024-05-08T08:03:59.321 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/pci-driver.o 2024-05-08T08:04:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:00 smithi070 ceph-mon[29591]: pgmap v2465: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 634 KiB/s wr, 41 op/s 2024-05-08T08:04:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:00 smithi172 ceph-mon[33377]: pgmap v2465: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 634 KiB/s wr, 41 op/s 2024-05-08T08:04:00.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:00 smithi194 ceph-mon[33679]: pgmap v2465: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 634 KiB/s wr, 41 op/s 2024-05-08T08:04:01.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:01 smithi070 ceph-mon[29591]: pgmap v2466: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 834 KiB/s wr, 56 op/s 2024-05-08T08:04:01.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:01 smithi172 ceph-mon[33377]: pgmap v2466: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 834 KiB/s wr, 56 op/s 2024-05-08T08:04:01.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:01 smithi194 ceph-mon[33679]: pgmap v2466: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 834 KiB/s wr, 56 op/s 2024-05-08T08:04:02.094 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/net_namespace.o 2024-05-08T08:04:04.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:03 smithi172 ceph-mon[33377]: pgmap v2467: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 416 KiB/s wr, 26 op/s 2024-05-08T08:04:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:03 smithi194 ceph-mon[33679]: pgmap v2467: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 416 KiB/s wr, 26 op/s 2024-05-08T08:04:04.284 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/mpi/mpiutil.o 2024-05-08T08:04:04.342 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/signal.o 2024-05-08T08:04:04.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:03 smithi070 ceph-mon[29591]: pgmap v2467: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 416 KiB/s wr, 26 op/s 2024-05-08T08:04:05.684 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/search.o 2024-05-08T08:04:06.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:05 smithi172 ceph-mon[33377]: pgmap v2468: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 613 KiB/s wr, 58 op/s 2024-05-08T08:04:06.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:05 smithi194 ceph-mon[33679]: pgmap v2468: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 613 KiB/s wr, 58 op/s 2024-05-08T08:04:06.340 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/isofs/util.o 2024-05-08T08:04:06.349 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/tsc.o 2024-05-08T08:04:06.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:05 smithi070 ceph-mon[29591]: pgmap v2468: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 613 KiB/s wr, 58 op/s 2024-05-08T08:04:06.952 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/misc.o 2024-05-08T08:04:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:07 smithi194 ceph-mon[33679]: pgmap v2469: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 396 KiB/s wr, 45 op/s 2024-05-08T08:04:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:07 smithi194 ceph-mon[33679]: osdmap e234: 12 total, 12 up, 12 in 2024-05-08T08:04:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:07 smithi070 ceph-mon[29591]: pgmap v2469: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 396 KiB/s wr, 45 op/s 2024-05-08T08:04:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:07 smithi070 ceph-mon[29591]: osdmap e234: 12 total, 12 up, 12 in 2024-05-08T08:04:08.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:07 smithi172 ceph-mon[33377]: pgmap v2469: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 396 KiB/s wr, 45 op/s 2024-05-08T08:04:08.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:07 smithi172 ceph-mon[33377]: osdmap e234: 12 total, 12 up, 12 in 2024-05-08T08:04:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:09 smithi194 ceph-mon[33679]: pgmap v2471: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 475 KiB/s wr, 54 op/s 2024-05-08T08:04:10.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:09 smithi070 ceph-mon[29591]: pgmap v2471: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 475 KiB/s wr, 54 op/s 2024-05-08T08:04:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:09 smithi172 ceph-mon[33377]: pgmap v2471: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 475 KiB/s wr, 54 op/s 2024-05-08T08:04:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:11 smithi194 ceph-mon[33679]: pgmap v2472: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 537 KiB/s wr, 55 op/s 2024-05-08T08:04:12.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:11 smithi070 ceph-mon[29591]: pgmap v2472: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 537 KiB/s wr, 55 op/s 2024-05-08T08:04:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:11 smithi172 ceph-mon[33377]: pgmap v2472: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 537 KiB/s wr, 55 op/s 2024-05-08T08:04:12.579 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/mpi/built-in.a 2024-05-08T08:04:12.625 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/isofs/rock.o 2024-05-08T08:04:13.720 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/fonts/fonts.o 2024-05-08T08:04:13.778 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/secure_seq.o 2024-05-08T08:04:14.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:13 smithi194 ceph-mon[33679]: pgmap v2473: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 537 KiB/s wr, 55 op/s 2024-05-08T08:04:14.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:13 smithi194 ceph-mon[33679]: osdmap e235: 12 total, 12 up, 12 in 2024-05-08T08:04:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:13 smithi070 ceph-mon[29591]: pgmap v2473: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 537 KiB/s wr, 55 op/s 2024-05-08T08:04:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:13 smithi070 ceph-mon[29591]: osdmap e235: 12 total, 12 up, 12 in 2024-05-08T08:04:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:13 smithi172 ceph-mon[33377]: pgmap v2473: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 537 KiB/s wr, 55 op/s 2024-05-08T08:04:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:13 smithi172 ceph-mon[33377]: osdmap e235: 12 total, 12 up, 12 in 2024-05-08T08:04:14.536 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/pci-sysfs.o 2024-05-08T08:04:14.820 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/fonts/font_8x16.o 2024-05-08T08:04:15.315 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/tsc_msr.o 2024-05-08T08:04:15.671 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/device.o 2024-05-08T08:04:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:15 smithi194 ceph-mon[33679]: pgmap v2475: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 809 KiB/s wr, 51 op/s 2024-05-08T08:04:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:15 smithi070 ceph-mon[29591]: pgmap v2475: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 809 KiB/s wr, 51 op/s 2024-05-08T08:04:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:15 smithi172 ceph-mon[33377]: pgmap v2475: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 809 KiB/s wr, 51 op/s 2024-05-08T08:04:16.647 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/sys.o 2024-05-08T08:04:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:17 smithi194 ceph-mon[33679]: pgmap v2476: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 652 KiB/s wr, 41 op/s 2024-05-08T08:04:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:17 smithi070 ceph-mon[29591]: pgmap v2476: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 652 KiB/s wr, 41 op/s 2024-05-08T08:04:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:17 smithi172 ceph-mon[33377]: pgmap v2476: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 652 KiB/s wr, 41 op/s 2024-05-08T08:04:20.112 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/io_delay.o 2024-05-08T08:04:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:19 smithi194 ceph-mon[33679]: pgmap v2477: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 647 KiB/s wr, 41 op/s 2024-05-08T08:04:20.324 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/flow_dissector.o 2024-05-08T08:04:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:19 smithi070 ceph-mon[29591]: pgmap v2477: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 647 KiB/s wr, 41 op/s 2024-05-08T08:04:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:19 smithi172 ceph-mon[33377]: pgmap v2477: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 647 KiB/s wr, 41 op/s 2024-05-08T08:04:21.212 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/fonts/built-in.a 2024-05-08T08:04:21.435 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/isofs/export.o 2024-05-08T08:04:21.436 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/argv_split.o 2024-05-08T08:04:22.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:21 smithi194 ceph-mon[33679]: pgmap v2478: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 549 KiB/s wr, 38 op/s 2024-05-08T08:04:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:21 smithi070 ceph-mon[29591]: pgmap v2478: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 549 KiB/s wr, 38 op/s 2024-05-08T08:04:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:21 smithi172 ceph-mon[33377]: pgmap v2478: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 549 KiB/s wr, 38 op/s 2024-05-08T08:04:22.512 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/info.o 2024-05-08T08:04:24.100 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/rom.o 2024-05-08T08:04:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:23 smithi194 ceph-mon[33679]: pgmap v2479: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 549 KiB/s wr, 38 op/s 2024-05-08T08:04:24.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:23 smithi070 ceph-mon[29591]: pgmap v2479: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 549 KiB/s wr, 38 op/s 2024-05-08T08:04:24.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:23 smithi172 ceph-mon[33377]: pgmap v2479: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 549 KiB/s wr, 38 op/s 2024-05-08T08:04:26.198 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/bug.o 2024-05-08T08:04:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:25 smithi194 ceph-mon[33679]: pgmap v2480: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 733 KiB/s wr, 51 op/s 2024-05-08T08:04:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:25 smithi070 ceph-mon[29591]: pgmap v2480: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 733 KiB/s wr, 51 op/s 2024-05-08T08:04:26.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:25 smithi172 ceph-mon[33377]: pgmap v2480: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 733 KiB/s wr, 51 op/s 2024-05-08T08:04:26.572 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/setup-res.o 2024-05-08T08:04:26.667 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/rtc.o 2024-05-08T08:04:28.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:27 smithi194 ceph-mon[33679]: pgmap v2481: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 386 KiB/s wr, 27 op/s 2024-05-08T08:04:28.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:27 smithi070 ceph-mon[29591]: pgmap v2481: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 386 KiB/s wr, 27 op/s 2024-05-08T08:04:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:27 smithi172 ceph-mon[33377]: pgmap v2481: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 386 KiB/s wr, 27 op/s 2024-05-08T08:04:28.689 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/umh.o 2024-05-08T08:04:29.806 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/isofs/joliet.o 2024-05-08T08:04:30.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:29 smithi194 ceph-mon[33679]: pgmap v2482: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 386 KiB/s wr, 27 op/s 2024-05-08T08:04:30.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:29 smithi070 ceph-mon[29591]: pgmap v2482: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 386 KiB/s wr, 27 op/s 2024-05-08T08:04:30.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:29 smithi172 ceph-mon[33377]: pgmap v2482: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 386 KiB/s wr, 27 op/s 2024-05-08T08:04:30.906 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/isadma.o 2024-05-08T08:04:32.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:31 smithi194 ceph-mon[33679]: pgmap v2483: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 613 KiB/s wr, 47 op/s 2024-05-08T08:04:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:31 smithi070 ceph-mon[29591]: pgmap v2483: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 613 KiB/s wr, 47 op/s 2024-05-08T08:04:32.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:31 smithi172 ceph-mon[33377]: pgmap v2483: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 613 KiB/s wr, 47 op/s 2024-05-08T08:04:32.474 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/isofs/compress.o 2024-05-08T08:04:34.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:34 smithi194 ceph-mon[33679]: pgmap v2484: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 443 KiB/s wr, 34 op/s 2024-05-08T08:04:34.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:34 smithi070 ceph-mon[29591]: pgmap v2484: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 443 KiB/s wr, 34 op/s 2024-05-08T08:04:34.398 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/buildid.o 2024-05-08T08:04:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:34 smithi172 ceph-mon[33377]: pgmap v2484: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 443 KiB/s wr, 34 op/s 2024-05-08T08:04:35.335 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/irq.o 2024-05-08T08:04:35.549 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/sysctl_net_core.o 2024-05-08T08:04:35.949 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/resource.o 2024-05-08T08:04:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:36 smithi194 ceph-mon[33679]: pgmap v2485: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 793 KiB/s wr, 57 op/s 2024-05-08T08:04:36.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:36 smithi070 ceph-mon[29591]: pgmap v2485: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 793 KiB/s wr, 57 op/s 2024-05-08T08:04:36.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:36 smithi172 ceph-mon[33377]: pgmap v2485: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 793 KiB/s wr, 57 op/s 2024-05-08T08:04:37.757 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/vmaster.o 2024-05-08T08:04:38.295 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/ctljack.o 2024-05-08T08:04:38.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:38 smithi070 ceph-mon[29591]: pgmap v2486: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 577 KiB/s wr, 42 op/s 2024-05-08T08:04:38.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:38 smithi172 ceph-mon[33377]: pgmap v2486: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 577 KiB/s wr, 42 op/s 2024-05-08T08:04:38.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:38 smithi194 ceph-mon[33679]: pgmap v2486: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 577 KiB/s wr, 42 op/s 2024-05-08T08:04:38.731 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/workqueue.o 2024-05-08T08:04:39.778 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/kernel/irqflags.o 2024-05-08T08:04:40.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:40 smithi070 ceph-mon[29591]: pgmap v2487: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 577 KiB/s wr, 42 op/s 2024-05-08T08:04:40.421 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/static_call.o 2024-05-08T08:04:40.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:40 smithi172 ceph-mon[33377]: pgmap v2487: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 577 KiB/s wr, 42 op/s 2024-05-08T08:04:40.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:40 smithi194 ceph-mon[33679]: pgmap v2487: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 577 KiB/s wr, 42 op/s 2024-05-08T08:04:41.215 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/isofs/built-in.a 2024-05-08T08:04:42.051 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/client.o 2024-05-08T08:04:42.065 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/clz_tab.o 2024-05-08T08:04:42.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:42 smithi070 ceph-mon[29591]: pgmap v2488: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 839 KiB/s wr, 61 op/s 2024-05-08T08:04:42.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:42 smithi172 ceph-mon[33377]: pgmap v2488: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 839 KiB/s wr, 61 op/s 2024-05-08T08:04:42.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:42 smithi194 ceph-mon[33679]: pgmap v2488: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 839 KiB/s wr, 61 op/s 2024-05-08T08:04:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:44 smithi070 ceph-mon[29591]: pgmap v2489: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 612 KiB/s wr, 42 op/s 2024-05-08T08:04:44.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:44 smithi172 ceph-mon[33377]: pgmap v2489: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 612 KiB/s wr, 42 op/s 2024-05-08T08:04:44.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:44 smithi194 ceph-mon[33679]: pgmap v2489: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 612 KiB/s wr, 42 op/s 2024-05-08T08:04:45.654 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/cmdline.o 2024-05-08T08:04:46.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:46 smithi070 ceph-mon[29591]: pgmap v2490: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 740 KiB/s wr, 66 op/s 2024-05-08T08:04:46.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:46 smithi172 ceph-mon[33377]: pgmap v2490: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 740 KiB/s wr, 66 op/s 2024-05-08T08:04:46.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:46 smithi194 ceph-mon[33679]: pgmap v2490: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 740 KiB/s wr, 66 op/s 2024-05-08T08:04:47.263 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/dir.o 2024-05-08T08:04:47.304 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/jack.o 2024-05-08T08:04:47.359 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/process.o 2024-05-08T08:04:47.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:47 smithi070 ceph-mon[29591]: pgmap v2491: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 390 KiB/s wr, 43 op/s 2024-05-08T08:04:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:47 smithi172 ceph-mon[33377]: pgmap v2491: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 390 KiB/s wr, 43 op/s 2024-05-08T08:04:47.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:47 smithi194 ceph-mon[33679]: pgmap v2491: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 390 KiB/s wr, 43 op/s 2024-05-08T08:04:47.575 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/vpd.o 2024-05-08T08:04:48.231 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/dev.o 2024-05-08T08:04:48.769 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/cpumask.o 2024-05-08T08:04:49.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:04:49.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:04:49.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:04:49.545 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/pid.o 2024-05-08T08:04:50.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:49 smithi194 ceph-mon[33679]: pgmap v2492: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 390 KiB/s wr, 43 op/s 2024-05-08T08:04:50.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:49 smithi070 ceph-mon[29591]: pgmap v2492: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 390 KiB/s wr, 43 op/s 2024-05-08T08:04:50.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:49 smithi172 ceph-mon[33377]: pgmap v2492: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 390 KiB/s wr, 43 op/s 2024-05-08T08:04:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:51 smithi194 ceph-mon[33679]: pgmap v2493: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 673 KiB/s wr, 55 op/s 2024-05-08T08:04:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:51 smithi070 ceph-mon[29591]: pgmap v2493: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 673 KiB/s wr, 55 op/s 2024-05-08T08:04:52.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:51 smithi172 ceph-mon[33377]: pgmap v2493: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 673 KiB/s wr, 55 op/s 2024-05-08T08:04:54.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:53 smithi194 ceph-mon[33679]: pgmap v2494: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 412 KiB/s wr, 36 op/s 2024-05-08T08:04:54.356 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/idle/built-in.a 2024-05-08T08:04:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:53 smithi070 ceph-mon[29591]: pgmap v2494: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 412 KiB/s wr, 36 op/s 2024-05-08T08:04:54.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:53 smithi172 ceph-mon[33377]: pgmap v2494: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 412 KiB/s wr, 36 op/s 2024-05-08T08:04:54.495 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/ctype.o 2024-05-08T08:04:55.232 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethernet/eth.o 2024-05-08T08:04:55.835 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/hwdep.o 2024-05-08T08:04:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:55 smithi194 ceph-mon[33679]: pgmap v2495: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 580 KiB/s wr, 49 op/s 2024-05-08T08:04:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:55 smithi070 ceph-mon[29591]: pgmap v2495: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 580 KiB/s wr, 49 op/s 2024-05-08T08:04:56.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:55 smithi172 ceph-mon[33377]: pgmap v2495: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 580 KiB/s wr, 49 op/s 2024-05-08T08:04:56.613 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/setup-bus.o 2024-05-08T08:04:56.712 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/dec_and_lock.o 2024-05-08T08:04:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:57 smithi194 ceph-mon[33679]: pgmap v2496: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 451 KiB/s wr, 25 op/s 2024-05-08T08:04:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:04:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:04:58.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:04:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:57 smithi070 ceph-mon[29591]: pgmap v2496: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 451 KiB/s wr, 25 op/s 2024-05-08T08:04:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:04:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:04:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:04:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:57 smithi172 ceph-mon[33377]: pgmap v2496: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 451 KiB/s wr, 25 op/s 2024-05-08T08:04:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:04:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:04:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:04:58.984 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/ptrace.o 2024-05-08T08:05:00.214 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/decompress.o 2024-05-08T08:05:00.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:04:59 smithi194 ceph-mon[33679]: pgmap v2497: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 451 KiB/s wr, 25 op/s 2024-05-08T08:05:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:04:59 smithi070 ceph-mon[29591]: pgmap v2497: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 451 KiB/s wr, 25 op/s 2024-05-08T08:05:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:04:59 smithi172 ceph-mon[33377]: pgmap v2497: 129 pgs: 129 active+clean; 1.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 451 KiB/s wr, 25 op/s 2024-05-08T08:05:02.165 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/file.o 2024-05-08T08:05:02.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:01 smithi194 ceph-mon[33679]: pgmap v2498: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 794 KiB/s wr, 39 op/s 2024-05-08T08:05:02.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:01 smithi070 ceph-mon[29591]: pgmap v2498: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 794 KiB/s wr, 39 op/s 2024-05-08T08:05:02.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:01 smithi172 ceph-mon[33377]: pgmap v2498: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 794 KiB/s wr, 39 op/s 2024-05-08T08:05:02.539 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/decompress_bunzip2.o 2024-05-08T08:05:02.610 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/task_work.o 2024-05-08T08:05:04.229 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:03 smithi172 ceph-mon[33377]: pgmap v2499: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 510 KiB/s wr, 26 op/s 2024-05-08T08:05:04.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:03 smithi194 ceph-mon[33679]: pgmap v2499: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 510 KiB/s wr, 26 op/s 2024-05-08T08:05:04.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:03 smithi070 ceph-mon[29591]: pgmap v2499: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 486 KiB/s rd, 510 KiB/s wr, 26 op/s 2024-05-08T08:05:05.239 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/timer.o 2024-05-08T08:05:06.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:05 smithi194 ceph-mon[33679]: pgmap v2500: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 745 KiB/s wr, 60 op/s 2024-05-08T08:05:06.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:05 smithi070 ceph-mon[29591]: pgmap v2500: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 745 KiB/s wr, 60 op/s 2024-05-08T08:05:06.404 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/dev_addr_lists.o 2024-05-08T08:05:06.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:05 smithi172 ceph-mon[33377]: pgmap v2500: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 745 KiB/s wr, 60 op/s 2024-05-08T08:05:07.039 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/vc.o 2024-05-08T08:05:08.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:07 smithi194 ceph-mon[33679]: pgmap v2501: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 577 KiB/s wr, 46 op/s 2024-05-08T08:05:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:07 smithi070 ceph-mon[29591]: pgmap v2501: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 577 KiB/s wr, 46 op/s 2024-05-08T08:05:08.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:07 smithi172 ceph-mon[33377]: pgmap v2501: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 577 KiB/s wr, 46 op/s 2024-05-08T08:05:09.020 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/ethernet/built-in.a 2024-05-08T08:05:09.188 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/mmap.o 2024-05-08T08:05:09.891 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/decompress_inflate.o 2024-05-08T08:05:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:09 smithi194 ceph-mon[33679]: pgmap v2502: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 577 KiB/s wr, 46 op/s 2024-05-08T08:05:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:09 smithi070 ceph-mon[29591]: pgmap v2502: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 577 KiB/s wr, 46 op/s 2024-05-08T08:05:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:09 smithi172 ceph-mon[33377]: pgmap v2502: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 577 KiB/s wr, 46 op/s 2024-05-08T08:05:10.579 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/tls.o 2024-05-08T08:05:11.274 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/extable.o 2024-05-08T08:05:12.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:11 smithi194 ceph-mon[33679]: pgmap v2503: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 925 KiB/s wr, 70 op/s 2024-05-08T08:05:12.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:11 smithi070 ceph-mon[29591]: pgmap v2503: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 925 KiB/s wr, 70 op/s 2024-05-08T08:05:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:11 smithi172 ceph-mon[33377]: pgmap v2503: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 925 KiB/s wr, 70 op/s 2024-05-08T08:05:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:13 smithi194 ceph-mon[33679]: pgmap v2504: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 583 KiB/s wr, 56 op/s 2024-05-08T08:05:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:13 smithi070 ceph-mon[29591]: pgmap v2504: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 583 KiB/s wr, 56 op/s 2024-05-08T08:05:14.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:13 smithi172 ceph-mon[33377]: pgmap v2504: 129 pgs: 129 active+clean; 1.9 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 583 KiB/s wr, 56 op/s 2024-05-08T08:05:14.603 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/hrtimer.o 2024-05-08T08:05:15.311 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/getroot.o 2024-05-08T08:05:15.883 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/params.o 2024-05-08T08:05:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:15 smithi194 ceph-mon[33679]: pgmap v2505: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 889 KiB/s wr, 85 op/s 2024-05-08T08:05:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:15 smithi070 ceph-mon[29591]: pgmap v2505: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 889 KiB/s wr, 85 op/s 2024-05-08T08:05:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:15 smithi172 ceph-mon[33377]: pgmap v2505: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 889 KiB/s wr, 85 op/s 2024-05-08T08:05:17.745 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/decompress_unlz4.o 2024-05-08T08:05:17.859 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/dst.o 2024-05-08T08:05:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:17 smithi194 ceph-mon[33679]: pgmap v2506: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 653 KiB/s wr, 52 op/s 2024-05-08T08:05:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:17 smithi070 ceph-mon[29591]: pgmap v2506: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 653 KiB/s wr, 52 op/s 2024-05-08T08:05:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:17 smithi172 ceph-mon[33377]: pgmap v2506: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 653 KiB/s wr, 52 op/s 2024-05-08T08:05:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:20 smithi194 ceph-mon[33679]: pgmap v2507: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 653 KiB/s wr, 52 op/s 2024-05-08T08:05:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:20 smithi070 ceph-mon[29591]: pgmap v2507: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 653 KiB/s wr, 52 op/s 2024-05-08T08:05:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:20 smithi172 ceph-mon[33377]: pgmap v2507: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 653 KiB/s wr, 52 op/s 2024-05-08T08:05:22.047 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/pcm.o 2024-05-08T08:05:22.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:22 smithi194 ceph-mon[33679]: pgmap v2508: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 882 KiB/s wr, 61 op/s 2024-05-08T08:05:22.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:22 smithi070 ceph-mon[29591]: pgmap v2508: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 882 KiB/s wr, 61 op/s 2024-05-08T08:05:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:22 smithi172 ceph-mon[33377]: pgmap v2508: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 882 KiB/s wr, 61 op/s 2024-05-08T08:05:22.434 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/setup-irq.o 2024-05-08T08:05:22.722 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/step.o 2024-05-08T08:05:22.885 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/i8237.o 2024-05-08T08:05:23.759 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/kthread.o 2024-05-08T08:05:24.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:24 smithi070 ceph-mon[29591]: pgmap v2509: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 535 KiB/s wr, 37 op/s 2024-05-08T08:05:24.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:24 smithi172 ceph-mon[33377]: pgmap v2509: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 535 KiB/s wr, 37 op/s 2024-05-08T08:05:24.425 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/decompress_unlzma.o 2024-05-08T08:05:24.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:24 smithi194 ceph-mon[33679]: pgmap v2509: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 535 KiB/s wr, 37 op/s 2024-05-08T08:05:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:26 smithi070 ceph-mon[29591]: pgmap v2510: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 755 KiB/s wr, 49 op/s 2024-05-08T08:05:26.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:26 smithi172 ceph-mon[33377]: pgmap v2510: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 755 KiB/s wr, 49 op/s 2024-05-08T08:05:26.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:26 smithi194 ceph-mon[33679]: pgmap v2510: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 755 KiB/s wr, 49 op/s 2024-05-08T08:05:27.656 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/inode.o 2024-05-08T08:05:28.356 INFO:tasks.quiescer.fs.[cephfs]:Total duration (48.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:05:28.357 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.45 2024-05-08T08:05:28.357 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:05:28.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:28 smithi070 ceph-mon[29591]: pgmap v2511: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 449 KiB/s wr, 20 op/s 2024-05-08T08:05:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:28 smithi172 ceph-mon[33377]: pgmap v2511: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 449 KiB/s wr, 20 op/s 2024-05-08T08:05:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:28 smithi194 ceph-mon[33679]: pgmap v2511: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 449 KiB/s wr, 20 op/s 2024-05-08T08:05:28.917 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:05:29.560 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/proc.o 2024-05-08T08:05:30.258 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/netevent.o 2024-05-08T08:05:30.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:30 smithi070 ceph-mon[29591]: pgmap v2512: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 449 KiB/s wr, 20 op/s 2024-05-08T08:05:30.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:30 smithi172 ceph-mon[33377]: pgmap v2512: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 449 KiB/s wr, 20 op/s 2024-05-08T08:05:30.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:30 smithi194 ceph-mon[33679]: pgmap v2512: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 449 KiB/s wr, 20 op/s 2024-05-08T08:05:31.349 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/pcm_native.o 2024-05-08T08:05:31.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.543+0000 7fb69a000700 1 -- 172.21.15.70:0/3587105496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69410fc50 msgr2=0x7fb694112060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:31.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.543+0000 7fb69a000700 1 --2- 172.21.15.70:0/3587105496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69410fc50 0x7fb694112060 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00b0a0 tx=0x7fb68c00b3b0 comp rx=0 tx=0).stop 2024-05-08T08:05:31.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.544+0000 7fb69a000700 1 -- 172.21.15.70:0/3587105496 shutdown_connections 2024-05-08T08:05:31.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.544+0000 7fb69a000700 1 --2- 172.21.15.70:0/3587105496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69410fc50 0x7fb694112060 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:31.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.544+0000 7fb69a000700 1 --2- 172.21.15.70:0/3587105496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb694075870 0x7fb694075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:31.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.544+0000 7fb69a000700 1 --2- 172.21.15.70:0/3587105496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb694076190 0x7fb69410f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:31.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.544+0000 7fb69a000700 1 -- 172.21.15.70:0/3587105496 >> 172.21.15.70:0/3587105496 conn(0x7fb6940feec0 msgr2=0x7fb6941012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:05:31.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.544+0000 7fb69a000700 1 -- 172.21.15.70:0/3587105496 shutdown_connections 2024-05-08T08:05:31.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.545+0000 7fb69a000700 1 -- 172.21.15.70:0/3587105496 wait complete. 2024-05-08T08:05:31.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.546+0000 7fb69a000700 1 Processor -- start 2024-05-08T08:05:31.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.546+0000 7fb69a000700 1 -- start start 2024-05-08T08:05:31.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.547+0000 7fb69a000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb694075870 0x7fb6941a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:31.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.547+0000 7fb69a000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb694076190 0x7fb6941a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:31.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.547+0000 7fb69a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69410fc50 0x7fb69419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:31.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.547+0000 7fb69a000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb694115680 con 0x7fb69410fc50 2024-05-08T08:05:31.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.547+0000 7fb69a000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb694115500 con 0x7fb694076190 2024-05-08T08:05:31.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.547+0000 7fb69a000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb694115800 con 0x7fb694075870 2024-05-08T08:05:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.548+0000 7fb699600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69410fc50 0x7fb69419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.548+0000 7fb698c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb694075870 0x7fb6941a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.548+0000 7fb698c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb694075870 0x7fb6941a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:59544/0 (socket says 172.21.15.70:59544) 2024-05-08T08:05:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.548+0000 7fb698c00700 1 -- 172.21.15.70:0/1639426002 learned_addr learned my addr 172.21.15.70:0/1639426002 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:05:31.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.548+0000 7fb693e00700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb694076190 0x7fb6941a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.549+0000 7fb699600700 1 -- 172.21.15.70:0/1639426002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb694075870 msgr2=0x7fb6941a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.549+0000 7fb699600700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb694075870 0x7fb6941a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.549+0000 7fb699600700 1 -- 172.21.15.70:0/1639426002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb694076190 msgr2=0x7fb6941a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.549+0000 7fb699600700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb694076190 0x7fb6941a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.549+0000 7fb699600700 1 -- 172.21.15.70:0/1639426002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69419c1a0 con 0x7fb69410fc50 2024-05-08T08:05:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.549+0000 7fb693e00700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb694076190 0x7fb6941a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:05:31.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.550+0000 7fb699600700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69410fc50 0x7fb69419ba40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00b070 tx=0x7fb68c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:05:31.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.550+0000 7fb691600700 1 -- 172.21.15.70:0/1639426002 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c021070 con 0x7fb69410fc50 2024-05-08T08:05:31.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.550+0000 7fb691600700 1 -- 172.21.15.70:0/1639426002 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb68c007b80 con 0x7fb69410fc50 2024-05-08T08:05:31.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.550+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69419c430 con 0x7fb69410fc50 2024-05-08T08:05:31.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.550+0000 7fb691600700 1 -- 172.21.15.70:0/1639426002 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0052c0 con 0x7fb69410fc50 2024-05-08T08:05:31.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.550+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6941a8700 con 0x7fb69410fc50 2024-05-08T08:05:31.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.551+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69406a190 con 0x7fb69410fc50 2024-05-08T08:05:31.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.558+0000 7fb691600700 1 -- 172.21.15.70:0/1639426002 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb68c024070 con 0x7fb69410fc50 2024-05-08T08:05:31.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.560+0000 7fb691600700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb67c0b2a70 0x7fb67c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:31.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.561+0000 7fb691600700 1 -- 172.21.15.70:0/1639426002 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 9583+0+0 (secure 0 0 0) 0x7fb68c00f020 con 0x7fb69410fc50 2024-05-08T08:05:31.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.561+0000 7fb698c00700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb67c0b2a70 0x7fb67c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:31.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.562+0000 7fb698c00700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb67c0b2a70 0x7fb67c0b4f30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb694102730 tx=0x7fb688007480 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:05:31.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:31.563+0000 7fb691600700 1 -- 172.21.15.70:0/1639426002 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb68c02b020 con 0x7fb69410fc50 2024-05-08T08:05:31.640 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/neighbour.o 2024-05-08T08:05:32.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.036+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb69402e510 con 0x7fb69410fc50 2024-05-08T08:05:32.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.037+0000 7fb691600700 1 -- 172.21.15.70:0/1639426002 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fb68c0aba60 con 0x7fb69410fc50 2024-05-08T08:05:32.031 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:05:32.032 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:05:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.041+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb67c0b2a70 msgr2=0x7fb67c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.041+0000 7fb69a000700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb67c0b2a70 0x7fb67c0b4f30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb694102730 tx=0x7fb688007480 comp rx=0 tx=0).stop 2024-05-08T08:05:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.041+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69410fc50 msgr2=0x7fb69419ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.041+0000 7fb69a000700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69410fc50 0x7fb69419ba40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00b070 tx=0x7fb68c004c80 comp rx=0 tx=0).stop 2024-05-08T08:05:32.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.042+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 shutdown_connections 2024-05-08T08:05:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.042+0000 7fb69a000700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb67c0b2a70 0x7fb67c0b4f30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.042+0000 7fb69a000700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb69410fc50 0x7fb69419ba40 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.042+0000 7fb69a000700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb694075870 0x7fb6941a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.042+0000 7fb69a000700 1 --2- 172.21.15.70:0/1639426002 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb694076190 0x7fb6941a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.042+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 >> 172.21.15.70:0/1639426002 conn(0x7fb6940feec0 msgr2=0x7fb6940ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:05:32.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.043+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 shutdown_connections 2024-05-08T08:05:32.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:32.043+0000 7fb69a000700 1 -- 172.21.15.70:0/1639426002 wait complete. 2024-05-08T08:05:32.039 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:05:32.125 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/stacktrace.o 2024-05-08T08:05:32.230 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/decompress_unlzo.o 2024-05-08T08:05:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:32 smithi070 ceph-mon[29591]: pgmap v2513: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 619 KiB/s wr, 31 op/s 2024-05-08T08:05:32.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:32 smithi172 ceph-mon[33377]: pgmap v2513: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 619 KiB/s wr, 31 op/s 2024-05-08T08:05:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:32 smithi194 ceph-mon[33679]: pgmap v2513: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 619 KiB/s wr, 31 op/s 2024-05-08T08:05:33.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:33 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1639426002' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:05:33.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:33 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1639426002' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:05:33.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:33 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1639426002' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:05:33.518 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 84.45 --await-for 42.0' 2024-05-08T08:05:33.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 84.45 --await-for 42.0 2024-05-08T08:05:34.126 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:05:34.287 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:34 smithi070 ceph-mon[29591]: pgmap v2514: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 390 KiB/s wr, 22 op/s 2024-05-08T08:05:34.326 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:34 smithi172 ceph-mon[33377]: pgmap v2514: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 390 KiB/s wr, 22 op/s 2024-05-08T08:05:34.493 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/sys_ni.o 2024-05-08T08:05:34.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:34 smithi194 ceph-mon[33679]: pgmap v2514: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 390 KiB/s wr, 22 op/s 2024-05-08T08:05:35.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:35 smithi070 ceph-mon[29591]: pgmap v2515: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 613 KiB/s wr, 42 op/s 2024-05-08T08:05:35.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:35 smithi172 ceph-mon[33377]: pgmap v2515: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 613 KiB/s wr, 42 op/s 2024-05-08T08:05:35.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:35 smithi194 ceph-mon[33679]: pgmap v2515: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 562 KiB/s rd, 613 KiB/s wr, 42 op/s 2024-05-08T08:05:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.166+0000 7fa6d6600700 1 -- 172.21.15.70:0/1497511227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d0102050 msgr2=0x7fa6d0102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.166+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1497511227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d0102050 0x7fa6d0102430 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800b0a0 tx=0x7fa6c800b3b0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.167+0000 7fa6d6600700 1 -- 172.21.15.70:0/1497511227 shutdown_connections 2024-05-08T08:05:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.167+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1497511227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d0107650 0x7fa6d0107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.167+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1497511227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d0102050 0x7fa6d0102430 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.167+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1497511227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6d0102970 0x7fa6d0107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.167+0000 7fa6d6600700 1 -- 172.21.15.70:0/1497511227 >> 172.21.15.70:0/1497511227 conn(0x7fa6d00fdcf0 msgr2=0x7fa6d0100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:05:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.167+0000 7fa6d6600700 1 -- 172.21.15.70:0/1497511227 shutdown_connections 2024-05-08T08:05:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.167+0000 7fa6d6600700 1 -- 172.21.15.70:0/1497511227 wait complete. 2024-05-08T08:05:37.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.169+0000 7fa6d6600700 1 Processor -- start 2024-05-08T08:05:37.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.169+0000 7fa6d6600700 1 -- start start 2024-05-08T08:05:37.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.170+0000 7fa6d6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d0102050 0x7fa6d019ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.170+0000 7fa6d6600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6d0102970 0x7fa6d01a0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.170+0000 7fa6d6600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d0107650 0x7fa6d01a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.170+0000 7fa6d6600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0119b40 con 0x7fa6d0102050 2024-05-08T08:05:37.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.170+0000 7fa6d6600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01199c0 con 0x7fa6d0102970 2024-05-08T08:05:37.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.170+0000 7fa6d6600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0119cc0 con 0x7fa6d0107650 2024-05-08T08:05:37.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.170+0000 7fa6d5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d0102050 0x7fa6d019ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.171+0000 7fa6d5c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d0107650 0x7fa6d01a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.171+0000 7fa6d5c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d0107650 0x7fa6d01a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:59560/0 (socket says 172.21.15.70:59560) 2024-05-08T08:05:37.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.171+0000 7fa6d5c00700 1 -- 172.21.15.70:0/1266027588 learned_addr learned my addr 172.21.15.70:0/1266027588 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:05:37.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.171+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6d0102970 0x7fa6d01a0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.171+0000 7fa6d5c00700 1 -- 172.21.15.70:0/1266027588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6d0102970 msgr2=0x7fa6d01a0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:37.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.171+0000 7fa6d5c00700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6d0102970 0x7fa6d01a0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.171+0000 7fa6d5c00700 1 -- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d0102050 msgr2=0x7fa6d019ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:37.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.171+0000 7fa6d5c00700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d0102050 0x7fa6d019ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.171+0000 7fa6d5c00700 1 -- 172.21.15.70:0/1266027588 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d01a4f60 con 0x7fa6d0107650 2024-05-08T08:05:37.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.172+0000 7fa6d5200700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d0102050 0x7fa6d019ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:05:37.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.172+0000 7fa6d5c00700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d0107650 0x7fa6d01a4820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800c900 tx=0x7fa6b800cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:05:37.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.173+0000 7fa6cd600700 1 -- 172.21.15.70:0/1266027588 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8007b00 con 0x7fa6d0107650 2024-05-08T08:05:37.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.173+0000 7fa6d6600700 1 -- 172.21.15.70:0/1266027588 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d01a51f0 con 0x7fa6d0107650 2024-05-08T08:05:37.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.173+0000 7fa6d6600700 1 -- 172.21.15.70:0/1266027588 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d01acad0 con 0x7fa6d0107650 2024-05-08T08:05:37.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.173+0000 7fa6cd600700 1 -- 172.21.15.70:0/1266027588 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6b800ce50 con 0x7fa6d0107650 2024-05-08T08:05:37.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.173+0000 7fa6cd600700 1 -- 172.21.15.70:0/1266027588 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8018660 con 0x7fa6d0107650 2024-05-08T08:05:37.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.180+0000 7fa6cd600700 1 -- 172.21.15.70:0/1266027588 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa6b8007ca0 con 0x7fa6d0107650 2024-05-08T08:05:37.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.182+0000 7fa6cd600700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6b40b2bf0 0x7fa6b40b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.182+0000 7fa6cd600700 1 -- 172.21.15.70:0/1266027588 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(235..235 src has 1..235) ==== 9583+0+0 (secure 0 0 0) 0x7fa6b80e27c0 con 0x7fa6d0107650 2024-05-08T08:05:37.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.182+0000 7fa6d5200700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6b40b2bf0 0x7fa6b40b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.184+0000 7fa6d5200700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6b40b2bf0 0x7fa6b40b50b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009e60 tx=0x7fa6c800b700 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:05:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.195+0000 7fa6e255bb80 1 Processor -- start 2024-05-08T08:05:37.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.195+0000 7fa6e255bb80 1 -- start start 2024-05-08T08:05:37.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.196+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 0x5589e1a6e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.196+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a68520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.196+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a68fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.196+0000 7fa6e255bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5589e19babb0 con 0x5589e1a68b40 2024-05-08T08:05:37.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.196+0000 7fa6e255bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5589e19588f0 con 0x5589e1a6dff0 2024-05-08T08:05:37.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.196+0000 7fa6e255bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5589e19b6b70 con 0x5589e1a6e910 2024-05-08T08:05:37.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.197+0000 7fa6d5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a68fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.197+0000 7fa6d5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a68fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58110/0 (socket says 172.21.15.70:58110) 2024-05-08T08:05:37.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.197+0000 7fa6d5c00700 1 -- 172.21.15.70:0/1227603628 learned_addr learned my addr 172.21.15.70:0/1227603628 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:05:37.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.197+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/1227603628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a68520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.198+0000 7fa6d5200700 1 --2- 172.21.15.70:0/1227603628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 0x5589e1a6e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.198+0000 7fa6cfe00700 1 -- 172.21.15.70:0/1227603628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 msgr2=0x5589e1a6e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:05:37.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.198+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/1227603628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 0x5589e1a6e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.198+0000 7fa6cfe00700 1 -- 172.21.15.70:0/1227603628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 msgr2=0x5589e1a68fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:05:37.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.198+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/1227603628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a68fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.198+0000 7fa6cfe00700 1 -- 172.21.15.70:0/1227603628 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589e1907a60 con 0x5589e1a6e910 2024-05-08T08:05:37.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.199+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/1227603628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a68520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009af0 tx=0x7fa6c0009e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef633234f59578b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:05:37.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.199+0000 7fa6c6000700 1 -- 172.21.15.70:0/1227603628 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c0010b20 con 0x5589e1a6e910 2024-05-08T08:05:37.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.200+0000 7fa6c6000700 1 -- 172.21.15.70:0/1227603628 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c0010cc0 con 0x5589e1a6e910 2024-05-08T08:05:37.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.200+0000 7fa6c6000700 1 -- 172.21.15.70:0/1227603628 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c00126b0 con 0x5589e1a6e910 2024-05-08T08:05:37.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.201+0000 7fa6e255bb80 1 -- 172.21.15.70:0/1227603628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 msgr2=0x5589e1a68520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:37.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.201+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/1227603628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a68520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009af0 tx=0x7fa6c0009e00 comp rx=0 tx=0).stop 2024-05-08T08:05:37.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.202+0000 7fa6e255bb80 1 -- 172.21.15.70:0/1227603628 shutdown_connections 2024-05-08T08:05:37.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.202+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/1227603628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a68fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.202+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/1227603628 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 0x5589e1a6e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.202+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/1227603628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a68520 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.202+0000 7fa6e255bb80 1 -- 172.21.15.70:0/1227603628 >> 172.21.15.70:0/1227603628 conn(0x5589e1996cf0 msgr2=0x5589e1a63080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:05:37.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.203+0000 7fa6e255bb80 1 -- 172.21.15.70:0/1227603628 shutdown_connections 2024-05-08T08:05:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.203+0000 7fa6e255bb80 1 -- 172.21.15.70:0/1227603628 wait complete. 2024-05-08T08:05:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.204+0000 7fa6e255bb80 1 -- start start 2024-05-08T08:05:37.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.204+0000 7fa6e255bb80 1 Processor -- start 2024-05-08T08:05:37.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.205+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.206+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 0x5589e1a71980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.206+0000 7fa6d5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.207+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a71ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.207+0000 7fa6d5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58124/0 (socket says 172.21.15.70:58124) 2024-05-08T08:05:37.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.207+0000 7fa6d5200700 1 -- 172.21.15.70:0/2281237121 learned_addr learned my addr 172.21.15.70:0/2281237121 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:05:37.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.207+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5589e1a75430 con 0x5589e1a68b40 2024-05-08T08:05:37.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.207+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5589e1920cb0 con 0x5589e1a6dff0 2024-05-08T08:05:37.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.207+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5589e1a755b0 con 0x5589e1a6e910 2024-05-08T08:05:37.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.207+0000 7fa6e255bb80 10 client.0 _ll_register_callbacks cb 0x5589e1961e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:05:37.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.207+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 0x5589e1a71980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.207+0000 7fa6d5c00700 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a71ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.208+0000 7fa6d5200700 1 -- 172.21.15.70:0/2281237121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 msgr2=0x5589e1a71ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:05:37.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.208+0000 7fa6d5200700 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a71ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.208+0000 7fa6d5200700 1 -- 172.21.15.70:0/2281237121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 msgr2=0x5589e1a71980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:05:37.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.208+0000 7fa6d5200700 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 0x5589e1a71980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.208+0000 7fa6d5200700 1 -- 172.21.15.70:0/2281237121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589e19805b0 con 0x5589e1a68b40 2024-05-08T08:05:37.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.208+0000 7fa6d5200700 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a745e0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8015000 tx=0x7fa6c800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca11183aa85a502b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:05:37.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.208+0000 7fa6bea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:05:37.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.209+0000 7fa6bea00700 1 -- 172.21.15.70:0/2281237121 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8021070 con 0x5589e1a68b40 2024-05-08T08:05:37.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.209+0000 7fa6bea00700 1 -- 172.21.15.70:0/2281237121 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(235..235 src has 1..235) ==== 9583+0+0 (secure 0 0 0) 0x7fa6c8005450 con 0x5589e1a68b40 2024-05-08T08:05:37.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.209+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c0010cc0 con 0x5589e1a68b40 2024-05-08T08:05:37.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.210+0000 7fa6bea00700 1 -- 172.21.15.70:0/2281237121 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa6c8005650 con 0x5589e1a68b40 2024-05-08T08:05:37.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.210+0000 7fa6e255bb80 10 client.17586 fetch_fsmap learned FSMap version 42 2024-05-08T08:05:37.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.210+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5589e1a7fcd0 con 0x5589e1a68b40 2024-05-08T08:05:37.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.210+0000 7fa6bea00700 1 -- 172.21.15.70:0/2281237121 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c0010cc0 con 0x5589e1a68b40 2024-05-08T08:05:37.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.211+0000 7fa6bea00700 1 -- 172.21.15.70:0/2281237121 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa6c8024070 con 0x5589e1a68b40 2024-05-08T08:05:37.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.211+0000 7fa6e255bb80 10 client.17586 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:05:37.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.211+0000 7fa6e255bb80 10 client.17586 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:05:37.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.211+0000 7fa6e255bb80 20 client.17586 populate_metadata read hostname 'smithi070' 2024-05-08T08:05:37.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.212+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5589e1a82310 0x5589e1a84700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.212+0000 7fa6e255bb80 4 client.17586 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:05:37.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.212+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589e1a35230 con 0x5589e1a82310 2024-05-08T08:05:37.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.213+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5589e1a82310 0x5589e1a84700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.214+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5589e1a82310 0x5589e1a84700 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3765b5298f1b569e server_cookie=5b2646e06f56c27d in_seq=0 out_seq=0 2024-05-08T08:05:37.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.214+0000 7fa6bea00700 10 client.17586 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:05:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.216+0000 7fa6bea00700 1 -- 172.21.15.70:0/2281237121 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5589e1a35230 con 0x5589e1a82310 2024-05-08T08:05:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.216+0000 7fa6bea00700 10 client.17586 handle_command_reply: tid=0 2024-05-08T08:05:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.216+0000 7fa6e255bb80 1 client.17586 shutdown 2024-05-08T08:05:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.216+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 msgr2=0x5589e1a745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.216+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a745e0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8015000 tx=0x7fa6c800b3b0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 shutdown_connections 2024-05-08T08:05:37.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5589e1a82310 0x5589e1a84700 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a71ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a68b40 0x5589e1a745e0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/2281237121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6dff0 0x5589e1a71980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6bea00700 0 client.17586 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:05:37.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 >> 172.21.15.70:0/2281237121 conn(0x5589e1996cf0 msgr2=0x5589e1a67510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:05:37.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 shutdown_connections 2024-05-08T08:05:37.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6e255bb80 1 -- 172.21.15.70:0/2281237121 wait complete. 2024-05-08T08:05:37.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.217+0000 7fa6e255bb80 20 client.17586 trim_cache size 0 max 16384 2024-05-08T08:05:37.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.254+0000 7fa6e255bb80 1 Processor -- start 2024-05-08T08:05:37.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.254+0000 7fa6e255bb80 1 -- start start 2024-05-08T08:05:37.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.255+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a68b40 0x5589e1a71ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.255+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1a7e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.255+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a89ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.255+0000 7fa6e255bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac011800 con 0x5589e1a6dff0 2024-05-08T08:05:37.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.255+0000 7fa6e255bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac00f090 con 0x5589e1a68b40 2024-05-08T08:05:37.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.255+0000 7fa6e255bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac00cf00 con 0x5589e1a6e910 2024-05-08T08:05:37.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.255+0000 7fa6cfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1a7e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.255+0000 7fa6cfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1a7e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58132/0 (socket says 172.21.15.70:58132) 2024-05-08T08:05:37.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.256+0000 7fa6d5200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a68b40 0x5589e1a71ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.256+0000 7fa6d5200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a68b40 0x5589e1a71ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:48320/0 (socket says 172.21.15.70:48320) 2024-05-08T08:05:37.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.256+0000 7fa6d5200700 1 -- 172.21.15.70:0/3327867446 learned_addr learned my addr 172.21.15.70:0/3327867446 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:05:37.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.256+0000 7fa6d5c00700 1 --2- 172.21.15.70:0/3327867446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a89ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.257+0000 7fa6d5c00700 1 -- 172.21.15.70:0/3327867446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a68b40 msgr2=0x5589e1a71ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:05:37.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.257+0000 7fa6d5c00700 1 --2- 172.21.15.70:0/3327867446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a68b40 0x5589e1a71ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.257+0000 7fa6d5c00700 1 -- 172.21.15.70:0/3327867446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 msgr2=0x5589e1a7e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:05:37.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.257+0000 7fa6d5c00700 1 --2- 172.21.15.70:0/3327867446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1a7e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.257+0000 7fa6d5c00700 1 -- 172.21.15.70:0/3327867446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589e1a727a0 con 0x5589e1a6e910 2024-05-08T08:05:37.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.257+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/3327867446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1a7e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:05:37.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.258+0000 7fa6d5c00700 1 --2- 172.21.15.70:0/3327867446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a89ff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80a56a0 tx=0x7fa6b80a9d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a07ceef352661d0d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:05:37.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.258+0000 7fa6c5600700 1 -- 172.21.15.70:0/3327867446 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80b2480 con 0x5589e1a6e910 2024-05-08T08:05:37.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.258+0000 7fa6c5600700 1 -- 172.21.15.70:0/3327867446 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6b8016de0 con 0x5589e1a6e910 2024-05-08T08:05:37.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.258+0000 7fa6c5600700 1 -- 172.21.15.70:0/3327867446 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b80a9ae0 con 0x5589e1a6e910 2024-05-08T08:05:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.259+0000 7fa6e255bb80 1 -- 172.21.15.70:0/3327867446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 msgr2=0x5589e1a89ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.259+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/3327867446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a89ff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa6b80a56a0 tx=0x7fa6b80a9d20 comp rx=0 tx=0).stop 2024-05-08T08:05:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.259+0000 7fa6e255bb80 1 -- 172.21.15.70:0/3327867446 shutdown_connections 2024-05-08T08:05:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.259+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/3327867446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a6e910 0x5589e1a89ff0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.259+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/3327867446 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a68b40 0x5589e1a71ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.259+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/3327867446 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1a7e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.260+0000 7fa6e255bb80 1 -- 172.21.15.70:0/3327867446 >> 172.21.15.70:0/3327867446 conn(0x5589e1996cf0 msgr2=0x5589e1a70270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:05:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.260+0000 7fa6e255bb80 1 -- 172.21.15.70:0/3327867446 shutdown_connections 2024-05-08T08:05:37.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.261+0000 7fa6e255bb80 1 -- 172.21.15.70:0/3327867446 wait complete. 2024-05-08T08:05:37.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.261+0000 7fa6e255bb80 1 -- start start 2024-05-08T08:05:37.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.261+0000 7fa6e255bb80 1 Processor -- start 2024-05-08T08:05:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.262+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a68b40 0x5589e1ae8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.262+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1ae6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.262+0000 7fa6e255bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6e910 0x5589e1ae70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.262+0000 7fa6e255bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac00d550 con 0x5589e1a6dff0 2024-05-08T08:05:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.263+0000 7fa6e255bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac00e9c0 con 0x5589e1a6e910 2024-05-08T08:05:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.263+0000 7fa6e255bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac00dc20 con 0x5589e1a68b40 2024-05-08T08:05:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.263+0000 7fa6e255bb80 10 client.0 _ll_register_callbacks cb 0x5589e1961e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:05:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.264+0000 7fa6d5200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a68b40 0x5589e1ae8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.264+0000 7fa6d5200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a68b40 0x5589e1ae8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:48732/0 (socket says 172.21.15.70:48732) 2024-05-08T08:05:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.264+0000 7fa6d5200700 1 -- 172.21.15.70:0/473670275 learned_addr learned my addr 172.21.15.70:0/473670275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:05:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.264+0000 7fa6d5c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6e910 0x5589e1ae70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.265+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1ae6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.265+0000 7fa6d5200700 1 -- 172.21.15.70:0/473670275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6e910 msgr2=0x5589e1ae70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:05:37.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.265+0000 7fa6d5200700 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6e910 0x5589e1ae70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.265+0000 7fa6d5200700 1 -- 172.21.15.70:0/473670275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 msgr2=0x5589e1ae6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:05:37.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.265+0000 7fa6d5200700 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1ae6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:37.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.265+0000 7fa6d5200700 1 -- 172.21.15.70:0/473670275 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589e1ae77b0 con 0x5589e1a68b40 2024-05-08T08:05:37.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.265+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1ae6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:05:37.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.266+0000 7fa6d5200700 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a68b40 0x5589e1ae8330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8031f50 tx=0x7fa6c80099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a876e4750948a2d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:05:37.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.266+0000 7fa6bea00700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T08:05:37.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.266+0000 7fa6bea00700 1 -- 172.21.15.70:0/473670275 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80059f0 con 0x5589e1a68b40 2024-05-08T08:05:37.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.266+0000 7fa6bea00700 1 -- 172.21.15.70:0/473670275 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(235..235 src has 1..235) ==== 9583+0+0 (secure 0 0 0) 0x7fa6c8029880 con 0x5589e1a68b40 2024-05-08T08:05:37.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.266+0000 7fa6e255bb80 1 -- 172.21.15.70:0/473670275 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b8016de0 con 0x5589e1a68b40 2024-05-08T08:05:37.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.267+0000 7fa6bea00700 1 -- 172.21.15.70:0/473670275 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa6c8005460 con 0x5589e1a68b40 2024-05-08T08:05:37.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.267+0000 7fa6e255bb80 10 client.26671 fetch_fsmap learned FSMap version 42 2024-05-08T08:05:37.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.267+0000 7fa6e255bb80 1 -- 172.21.15.70:0/473670275 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5589e1a7a780 con 0x5589e1a68b40 2024-05-08T08:05:37.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.268+0000 7fa6bea00700 1 -- 172.21.15.70:0/473670275 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6b8016de0 con 0x5589e1a68b40 2024-05-08T08:05:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.268+0000 7fa6bea00700 1 -- 172.21.15.70:0/473670275 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa6c8024050 con 0x5589e1a68b40 2024-05-08T08:05:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.268+0000 7fa6e255bb80 10 client.26671 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:05:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.268+0000 7fa6e255bb80 10 client.26671 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:05:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.268+0000 7fa6e255bb80 20 client.26671 populate_metadata read hostname 'smithi070' 2024-05-08T08:05:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.268+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5589e1a7af30 0x5589e1b01bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:05:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.268+0000 7fa6e255bb80 4 client.26671 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.45, "await_for": 42.0}] 2024-05-08T08:05:37.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.268+0000 7fa6e255bb80 1 -- 172.21.15.70:0/473670275 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.45, "await_for": 42.0}) -- 0x5589e19c8590 con 0x5589e1a7af30 2024-05-08T08:05:37.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.270+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5589e1a7af30 0x5589e1b01bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:05:37.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.271+0000 7fa6cfe00700 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5589e1a7af30 0x5589e1b01bd0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4dbf143140c7132 server_cookie=dbdb44f141acf451 in_seq=0 out_seq=0 2024-05-08T08:05:37.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:37.271+0000 7fa6bea00700 10 client.26671 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:05:37.402 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/nsproxy.o 2024-05-08T08:05:38.209 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:37 smithi194 ceph-mon[33679]: pgmap v2516: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 393 KiB/s wr, 30 op/s 2024-05-08T08:05:38.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:37 smithi070 ceph-mon[29591]: pgmap v2516: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 393 KiB/s wr, 30 op/s 2024-05-08T08:05:38.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:37 smithi172 ceph-mon[33377]: pgmap v2516: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 393 KiB/s wr, 30 op/s 2024-05-08T08:05:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:39 smithi194 ceph-mon[33679]: pgmap v2517: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 393 KiB/s wr, 30 op/s 2024-05-08T08:05:40.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:39 smithi070 ceph-mon[29591]: pgmap v2517: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 393 KiB/s wr, 30 op/s 2024-05-08T08:05:40.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:39 smithi172 ceph-mon[33377]: pgmap v2517: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 393 KiB/s wr, 30 op/s 2024-05-08T08:05:42.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:41 smithi194 ceph-mon[33679]: pgmap v2518: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 532 KiB/s wr, 40 op/s 2024-05-08T08:05:42.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:41 smithi070 ceph-mon[29591]: pgmap v2518: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 532 KiB/s wr, 40 op/s 2024-05-08T08:05:42.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:41 smithi172 ceph-mon[33377]: pgmap v2518: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 532 KiB/s wr, 40 op/s 2024-05-08T08:05:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:43 smithi194 ceph-mon[33679]: pgmap v2519: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 362 KiB/s wr, 30 op/s 2024-05-08T08:05:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:43 smithi070 ceph-mon[29591]: pgmap v2519: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 362 KiB/s wr, 30 op/s 2024-05-08T08:05:44.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:43 smithi172 ceph-mon[33377]: pgmap v2519: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 362 KiB/s wr, 30 op/s 2024-05-08T08:05:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:45 smithi194 ceph-mon[33679]: pgmap v2520: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 465 KiB/s wr, 36 op/s 2024-05-08T08:05:46.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:45 smithi070 ceph-mon[29591]: pgmap v2520: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 465 KiB/s wr, 36 op/s 2024-05-08T08:05:46.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:45 smithi172 ceph-mon[33377]: pgmap v2520: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 465 KiB/s wr, 36 op/s 2024-05-08T08:05:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:47 smithi194 ceph-mon[33679]: pgmap v2521: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 242 KiB/s wr, 15 op/s 2024-05-08T08:05:48.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:47 smithi070 ceph-mon[29591]: pgmap v2521: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 242 KiB/s wr, 15 op/s 2024-05-08T08:05:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:47 smithi172 ceph-mon[33377]: pgmap v2521: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 242 KiB/s wr, 15 op/s 2024-05-08T08:05:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:49 smithi194 ceph-mon[33679]: pgmap v2522: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 242 KiB/s wr, 15 op/s 2024-05-08T08:05:50.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:49 smithi070 ceph-mon[29591]: pgmap v2522: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 242 KiB/s wr, 15 op/s 2024-05-08T08:05:50.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:49 smithi172 ceph-mon[33377]: pgmap v2522: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 242 KiB/s wr, 15 op/s 2024-05-08T08:05:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:51 smithi194 ceph-mon[33679]: pgmap v2523: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 277 KiB/s wr, 19 op/s 2024-05-08T08:05:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:51 smithi070 ceph-mon[29591]: pgmap v2523: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 277 KiB/s wr, 19 op/s 2024-05-08T08:05:52.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:51 smithi172 ceph-mon[33377]: pgmap v2523: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 277 KiB/s wr, 19 op/s 2024-05-08T08:05:54.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:54 smithi194 ceph-mon[33679]: pgmap v2524: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 138 KiB/s wr, 9 op/s 2024-05-08T08:05:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:54 smithi070 ceph-mon[29591]: pgmap v2524: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 138 KiB/s wr, 9 op/s 2024-05-08T08:05:54.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:54 smithi172 ceph-mon[33377]: pgmap v2524: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 138 KiB/s wr, 9 op/s 2024-05-08T08:05:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:56 smithi194 ceph-mon[33679]: pgmap v2525: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 185 KiB/s wr, 14 op/s 2024-05-08T08:05:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:56 smithi070 ceph-mon[29591]: pgmap v2525: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 185 KiB/s wr, 14 op/s 2024-05-08T08:05:56.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:56 smithi172 ceph-mon[33377]: pgmap v2525: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 185 KiB/s wr, 14 op/s 2024-05-08T08:05:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:58 smithi070 ceph-mon[29591]: pgmap v2526: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T08:05:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:05:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:05:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:58 smithi172 ceph-mon[33377]: pgmap v2526: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T08:05:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:05:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:05:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:58 smithi194 ceph-mon[33679]: pgmap v2526: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T08:05:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:05:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:05:59.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.848+0000 7fa6bea00700 1 -- 172.21.15.70:0/473670275 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5589e19c8590 con 0x5589e1a7af30 2024-05-08T08:05:59.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.848+0000 7fa6bea00700 10 client.26671 handle_command_reply: tid=0 2024-05-08T08:05:59.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.848+0000 7fa6e255bb80 1 client.26671 shutdown 2024-05-08T08:05:59.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.848+0000 7fa6e255bb80 1 -- 172.21.15.70:0/473670275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a68b40 msgr2=0x5589e1ae8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:59.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.848+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a68b40 0x5589e1ae8330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8031f50 tx=0x7fa6c80099e0 comp rx=0 tx=0).stop 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.849+0000 7fa6e255bb80 1 -- 172.21.15.70:0/473670275 shutdown_connections 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.849+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5589e1a7af30 0x5589e1b01bd0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.849+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5589e1a6e910 0x5589e1ae70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.849+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5589e1a68b40 0x5589e1ae8330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.849+0000 7fa6e255bb80 1 --2- 172.21.15.70:0/473670275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589e1a6dff0 0x5589e1ae6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.849+0000 7fa6e255bb80 1 -- 172.21.15.70:0/473670275 >> 172.21.15.70:0/473670275 conn(0x5589e1996cf0 msgr2=0x5589e1a6edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.849+0000 7fa6bea00700 0 client.26671 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.849+0000 7fa6e255bb80 1 -- 172.21.15.70:0/473670275 shutdown_connections 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.850+0000 7fa6e255bb80 1 -- 172.21.15.70:0/473670275 wait complete. 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.850+0000 7fa6e255bb80 20 client.26671 trim_cache size 0 max 16384 2024-05-08T08:05:59.845 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 186, 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "6480e5fa": { 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 186, 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:05:59.846 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.5, 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:05:59.847 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:05:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 -- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6b40b2bf0 msgr2=0x7fa6b40b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6b40b2bf0 0x7fa6b40b50b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009e60 tx=0x7fa6c800b700 comp rx=0 tx=0).stop 2024-05-08T08:05:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 -- 172.21.15.70:0/1266027588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d0107650 msgr2=0x7fa6d01a4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:05:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d0107650 0x7fa6d01a4820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6b800c900 tx=0x7fa6b800cc10 comp rx=0 tx=0).stop 2024-05-08T08:05:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 -- 172.21.15.70:0/1266027588 shutdown_connections 2024-05-08T08:05:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa6b40b2bf0 0x7fa6b40b50b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6d0107650 0x7fa6d01a4820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa6d0102050 0x7fa6d019ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:59.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 --2- 172.21.15.70:0/1266027588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa6d0102970 0x7fa6d01a0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:05:59.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.852+0000 7fa6d6600700 1 -- 172.21.15.70:0/1266027588 >> 172.21.15.70:0/1266027588 conn(0x7fa6d00fdcf0 msgr2=0x7fa6d01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:05:59.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.853+0000 7fa6d6600700 1 -- 172.21.15.70:0/1266027588 shutdown_connections 2024-05-08T08:05:59.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:05:59.853+0000 7fa6d6600700 1 -- 172.21.15.70:0/1266027588 wait complete. 2024-05-08T08:06:00.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:00 smithi070 ceph-mon[29591]: pgmap v2527: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T08:06:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:00 smithi172 ceph-mon[33377]: pgmap v2527: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T08:06:00.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:00 smithi194 ceph-mon[33679]: pgmap v2527: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 82 KiB/s wr, 8 op/s 2024-05-08T08:06:00.797 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6480e5fa', quiesce took 32.4 seconds. Will release after: 24.45 2024-05-08T08:06:02.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:02 smithi070 ceph-mon[29591]: pgmap v2528: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 144 KiB/s wr, 12 op/s 2024-05-08T08:06:02.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:02 smithi172 ceph-mon[33377]: pgmap v2528: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 144 KiB/s wr, 12 op/s 2024-05-08T08:06:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:02 smithi194 ceph-mon[33679]: pgmap v2528: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 144 KiB/s wr, 12 op/s 2024-05-08T08:06:04.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:04 smithi070 ceph-mon[29591]: pgmap v2529: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 109 KiB/s wr, 8 op/s 2024-05-08T08:06:04.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:04 smithi172 ceph-mon[33377]: pgmap v2529: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 109 KiB/s wr, 8 op/s 2024-05-08T08:06:04.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:04 smithi194 ceph-mon[33679]: pgmap v2529: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 109 KiB/s wr, 8 op/s 2024-05-08T08:06:06.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:06 smithi070 ceph-mon[29591]: pgmap v2530: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 173 KiB/s wr, 29 op/s 2024-05-08T08:06:06.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:06 smithi172 ceph-mon[33377]: pgmap v2530: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 173 KiB/s wr, 29 op/s 2024-05-08T08:06:06.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:06 smithi194 ceph-mon[33679]: pgmap v2530: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 173 KiB/s wr, 29 op/s 2024-05-08T08:06:08.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:08 smithi194 ceph-mon[33679]: pgmap v2531: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 126 KiB/s wr, 25 op/s 2024-05-08T08:06:08.308 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:08 smithi194 ceph-mon[33679]: osdmap e236: 12 total, 12 up, 12 in 2024-05-08T08:06:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:08 smithi070 ceph-mon[29591]: pgmap v2531: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 126 KiB/s wr, 25 op/s 2024-05-08T08:06:08.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:08 smithi070 ceph-mon[29591]: osdmap e236: 12 total, 12 up, 12 in 2024-05-08T08:06:08.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:08 smithi172 ceph-mon[33377]: pgmap v2531: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 126 KiB/s wr, 25 op/s 2024-05-08T08:06:08.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:08 smithi172 ceph-mon[33377]: osdmap e236: 12 total, 12 up, 12 in 2024-05-08T08:06:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:09 smithi172 ceph-mon[33377]: pgmap v2533: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 151 KiB/s wr, 30 op/s 2024-05-08T08:06:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:06:10.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:06:10.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:06:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:09 smithi194 ceph-mon[33679]: pgmap v2533: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 151 KiB/s wr, 30 op/s 2024-05-08T08:06:10.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:06:10.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:06:10.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:06:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:09 smithi070 ceph-mon[29591]: pgmap v2533: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 151 KiB/s wr, 30 op/s 2024-05-08T08:06:10.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:06:10.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:06:10.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:06:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:11 smithi194 ceph-mon[33679]: pgmap v2534: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 134 KiB/s wr, 29 op/s 2024-05-08T08:06:12.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:11 smithi070 ceph-mon[29591]: pgmap v2534: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 134 KiB/s wr, 29 op/s 2024-05-08T08:06:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:11 smithi172 ceph-mon[33377]: pgmap v2534: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 134 KiB/s wr, 29 op/s 2024-05-08T08:06:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:13 smithi194 ceph-mon[33679]: pgmap v2535: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 134 KiB/s wr, 29 op/s 2024-05-08T08:06:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:13 smithi070 ceph-mon[29591]: pgmap v2535: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 134 KiB/s wr, 29 op/s 2024-05-08T08:06:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:13 smithi172 ceph-mon[33377]: pgmap v2535: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 134 KiB/s wr, 29 op/s 2024-05-08T08:06:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:15 smithi194 ceph-mon[33679]: pgmap v2536: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 8 op/s 2024-05-08T08:06:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:15 smithi070 ceph-mon[29591]: pgmap v2536: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 8 op/s 2024-05-08T08:06:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:15 smithi172 ceph-mon[33377]: pgmap v2536: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 8 op/s 2024-05-08T08:06:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:17 smithi194 ceph-mon[33679]: pgmap v2537: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 8 op/s 2024-05-08T08:06:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:17 smithi070 ceph-mon[29591]: pgmap v2537: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 8 op/s 2024-05-08T08:06:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:17 smithi172 ceph-mon[33377]: pgmap v2537: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 8 op/s 2024-05-08T08:06:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:19 smithi172 ceph-mon[33377]: osdmap e237: 12 total, 12 up, 12 in 2024-05-08T08:06:20.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:19 smithi172 ceph-mon[33377]: pgmap v2539: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 8 op/s 2024-05-08T08:06:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:19 smithi194 ceph-mon[33679]: osdmap e237: 12 total, 12 up, 12 in 2024-05-08T08:06:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:19 smithi194 ceph-mon[33679]: pgmap v2539: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 8 op/s 2024-05-08T08:06:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:19 smithi070 ceph-mon[29591]: osdmap e237: 12 total, 12 up, 12 in 2024-05-08T08:06:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:19 smithi070 ceph-mon[29591]: pgmap v2539: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 83 KiB/s wr, 8 op/s 2024-05-08T08:06:22.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:21 smithi194 ceph-mon[33679]: pgmap v2540: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 63 KiB/s wr, 7 op/s 2024-05-08T08:06:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:21 smithi070 ceph-mon[29591]: pgmap v2540: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 63 KiB/s wr, 7 op/s 2024-05-08T08:06:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:21 smithi172 ceph-mon[33377]: pgmap v2540: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 63 KiB/s wr, 7 op/s 2024-05-08T08:06:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:23 smithi194 ceph-mon[33679]: pgmap v2541: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 63 KiB/s wr, 7 op/s 2024-05-08T08:06:24.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:23 smithi070 ceph-mon[29591]: pgmap v2541: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 63 KiB/s wr, 7 op/s 2024-05-08T08:06:24.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:23 smithi172 ceph-mon[33377]: pgmap v2541: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 63 KiB/s wr, 7 op/s 2024-05-08T08:06:25.249 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:06:25.710 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:06:26.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:25 smithi070 ceph-mon[29591]: pgmap v2542: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:06:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:25 smithi194 ceph-mon[33679]: pgmap v2542: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:06:26.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:25 smithi172 ceph-mon[33377]: pgmap v2542: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:06:28.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.258+0000 7f09ad200700 1 -- 172.21.15.70:0/782007699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 msgr2=0x7f09a8103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:28.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.258+0000 7f09ad200700 1 --2- 172.21.15.70:0/782007699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 0x7f09a8103b30 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f09980099c0 tx=0x7f0998009cd0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.258+0000 7f09ad200700 1 -- 172.21.15.70:0/782007699 shutdown_connections 2024-05-08T08:06:28.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.258+0000 7f09ad200700 1 --2- 172.21.15.70:0/782007699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09a8108850 0x7f09a81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.258+0000 7f09ad200700 1 --2- 172.21.15.70:0/782007699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 0x7f09a8103b30 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.258+0000 7f09ad200700 1 --2- 172.21.15.70:0/782007699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a8104100 0x7f09a8108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.258+0000 7f09ad200700 1 -- 172.21.15.70:0/782007699 >> 172.21.15.70:0/782007699 conn(0x7f09a807a600 msgr2=0x7f09a807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:28.254 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:27 smithi070 ceph-mon[29591]: pgmap v2543: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:06:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.259+0000 7f09ad200700 1 -- 172.21.15.70:0/782007699 shutdown_connections 2024-05-08T08:06:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.259+0000 7f09ad200700 1 -- 172.21.15.70:0/782007699 wait complete. 2024-05-08T08:06:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.260+0000 7f09ad200700 1 Processor -- start 2024-05-08T08:06:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.260+0000 7f09ad200700 1 -- start start 2024-05-08T08:06:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.260+0000 7f09ad200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 0x7f09a81a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.260+0000 7f09ad200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a8104100 0x7f09a81a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.260+0000 7f09ad200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09a8108850 0x7f09a819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.260+0000 7f09ad200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09a81134f0 con 0x7f09a8103750 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.260+0000 7f09ad200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f09a8113370 con 0x7f09a8104100 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.260+0000 7f09ad200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f09a8113670 con 0x7f09a8108850 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f09a5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 0x7f09a81a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f09a5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 0x7f09a81a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51992/0 (socket says 172.21.15.70:51992) 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f09a5e00700 1 -- 172.21.15.70:0/3878008314 learned_addr learned my addr 172.21.15.70:0/3878008314 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f099fe00700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a8104100 0x7f09a81a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f09a5e00700 1 -- 172.21.15.70:0/3878008314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09a8108850 msgr2=0x7f09a819ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f09a5e00700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09a8108850 0x7f09a819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f09a5e00700 1 -- 172.21.15.70:0/3878008314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a8104100 msgr2=0x7f09a81a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f09a5e00700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a8104100 0x7f09a81a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f09a5e00700 1 -- 172.21.15.70:0/3878008314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a819c1b0 con 0x7f09a8103750 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.261+0000 7f099fe00700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a8104100 0x7f09a81a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.262+0000 7f09a5e00700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 0x7f09a81a1890 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f0998005f50 tx=0x7f099800f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.262+0000 7f099ea00700 1 -- 172.21.15.70:0/3878008314 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998027070 con 0x7f09a8103750 2024-05-08T08:06:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.262+0000 7f099ea00700 1 -- 172.21.15.70:0/3878008314 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f099800fdd0 con 0x7f09a8103750 2024-05-08T08:06:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.262+0000 7f099ea00700 1 -- 172.21.15.70:0/3878008314 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09980173f0 con 0x7f09a8103750 2024-05-08T08:06:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.262+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a819c440 con 0x7f09a8103750 2024-05-08T08:06:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.262+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a81a8760 con 0x7f09a8103750 2024-05-08T08:06:28.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:27 smithi194 ceph-mon[33679]: pgmap v2543: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:06:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.263+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a8104be0 con 0x7f09a8103750 2024-05-08T08:06:28.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.265+0000 7f099ea00700 1 -- 172.21.15.70:0/3878008314 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f099802a070 con 0x7f09a8103750 2024-05-08T08:06:28.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.267+0000 7f099ea00700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f098c0b2a70 0x7f098c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:28.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.267+0000 7f099ea00700 1 -- 172.21.15.70:0/3878008314 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(237..237 src has 1..237) ==== 9583+0+0 (secure 0 0 0) 0x7f09980e3860 con 0x7f09a8103750 2024-05-08T08:06:28.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.267+0000 7f099fe00700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f098c0b2a70 0x7f098c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:28.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.268+0000 7f099fe00700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f098c0b2a70 0x7f098c0b4f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0990005fd0 tx=0x7f0990005ee0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:28.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.272+0000 7f099ea00700 1 -- 172.21.15.70:0/3878008314 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f099805fdf0 con 0x7f09a8103750 2024-05-08T08:06:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:27 smithi172 ceph-mon[33377]: pgmap v2543: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:06:28.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.551+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09a806a190 con 0x7f09a8103750 2024-05-08T08:06:28.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.552+0000 7f099ea00700 1 -- 172.21.15.70:0/3878008314 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f0998013070 con 0x7f09a8103750 2024-05-08T08:06:28.547 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:06:28.547 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:06:28.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f098c0b2a70 msgr2=0x7f098c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:28.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f098c0b2a70 0x7f098c0b4f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0990005fd0 tx=0x7f0990005ee0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 msgr2=0x7f09a81a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 0x7f09a81a1890 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f0998005f50 tx=0x7f099800f460 comp rx=0 tx=0).stop 2024-05-08T08:06:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 shutdown_connections 2024-05-08T08:06:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f098c0b2a70 0x7f098c0b4f30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09a8108850 0x7f09a819ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09a8103750 0x7f09a81a1890 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 --2- 172.21.15.70:0/3878008314 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f09a8104100 0x7f09a81a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 >> 172.21.15.70:0/3878008314 conn(0x7f09a807a600 msgr2=0x7f09a81019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 shutdown_connections 2024-05-08T08:06:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:28.556+0000 7f09ad200700 1 -- 172.21.15.70:0/3878008314 wait complete. 2024-05-08T08:06:28.552 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:06:29.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:29 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3878008314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:06:29.290 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:28 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3878008314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:06:29.359 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 6480e5fa --release --await' 2024-05-08T08:06:29.360 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 6480e5fa --release --await 2024-05-08T08:06:29.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:29 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3878008314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:06:29.809 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:06:30.304 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:30 smithi070 ceph-mon[29591]: pgmap v2544: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 6 op/s 2024-05-08T08:06:30.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:30 smithi172 ceph-mon[33377]: pgmap v2544: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 6 op/s 2024-05-08T08:06:30.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:30 smithi194 ceph-mon[33679]: pgmap v2544: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 37 KiB/s wr, 6 op/s 2024-05-08T08:06:32.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.286+0000 7f6a6ea00700 1 -- 172.21.15.70:0/3584690649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 msgr2=0x7f6a6810ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:32.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.286+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/3584690649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 0x7f6a6810ff40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009990 tx=0x7f6a58009ca0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.281 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:32 smithi070 ceph-mon[29591]: pgmap v2545: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T08:06:32.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.286+0000 7f6a6ea00700 1 -- 172.21.15.70:0/3584690649 shutdown_connections 2024-05-08T08:06:32.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.286+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/3584690649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a6810a490 0x7f6a681169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.286+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/3584690649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 0x7f6a6810ff40 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.286+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/3584690649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a68109ad0 0x7f6a68109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.286+0000 7f6a6ea00700 1 -- 172.21.15.70:0/3584690649 >> 172.21.15.70:0/3584690649 conn(0x7f6a68076c70 msgr2=0x7f6a681082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:32.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.287+0000 7f6a6ea00700 1 -- 172.21.15.70:0/3584690649 shutdown_connections 2024-05-08T08:06:32.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.287+0000 7f6a6ea00700 1 -- 172.21.15.70:0/3584690649 wait complete. 2024-05-08T08:06:32.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.288+0000 7f6a6ea00700 1 Processor -- start 2024-05-08T08:06:32.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.288+0000 7f6a6ea00700 1 -- start start 2024-05-08T08:06:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a6ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a68109ad0 0x7f6a681a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a6ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a6810a490 0x7f6a681a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a6ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 0x7f6a681a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a6ea00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a68119c70 con 0x7f6a6810fb60 2024-05-08T08:06:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a6ea00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a68119af0 con 0x7f6a68109ad0 2024-05-08T08:06:32.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a6ea00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a68119df0 con 0x7f6a6810a490 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a6ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 0x7f6a681a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a6ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 0x7f6a681a4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52010/0 (socket says 172.21.15.70:52010) 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a6ca00700 1 -- 172.21.15.70:0/1160396659 learned_addr learned my addr 172.21.15.70:0/1160396659 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a67e00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a68109ad0 0x7f6a681a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.289+0000 7f6a67400700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a6810a490 0x7f6a681a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a6ca00700 1 -- 172.21.15.70:0/1160396659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a6810a490 msgr2=0x7f6a681a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a6ca00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a6810a490 0x7f6a681a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a6ca00700 1 -- 172.21.15.70:0/1160396659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a68109ad0 msgr2=0x7f6a681a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a6ca00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a68109ad0 0x7f6a681a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a6ca00700 1 -- 172.21.15.70:0/1160396659 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a681a5250 con 0x7f6a6810fb60 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a6ca00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 0x7f6a681a4b10 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000b970 tx=0x7f6a6000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:32.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a64c00700 1 -- 172.21.15.70:0/1160396659 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60019070 con 0x7f6a6810fb60 2024-05-08T08:06:32.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a64c00700 1 -- 172.21.15.70:0/1160396659 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a6000ce40 con 0x7f6a6810fb60 2024-05-08T08:06:32.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a6ea00700 1 -- 172.21.15.70:0/1160396659 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a681a5540 con 0x7f6a6810fb60 2024-05-08T08:06:32.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.290+0000 7f6a64c00700 1 -- 172.21.15.70:0/1160396659 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a60007370 con 0x7f6a6810fb60 2024-05-08T08:06:32.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.291+0000 7f6a6ea00700 1 -- 172.21.15.70:0/1160396659 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a681acdc0 con 0x7f6a6810fb60 2024-05-08T08:06:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.294+0000 7f6a64c00700 1 -- 172.21.15.70:0/1160396659 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6a6001c070 con 0x7f6a6810fb60 2024-05-08T08:06:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.295+0000 7f6a64c00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6a4c0b29f0 0x7f6a4c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.296+0000 7f6a64c00700 1 -- 172.21.15.70:0/1160396659 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(237..237 src has 1..237) ==== 9583+0+0 (secure 0 0 0) 0x7f6a600e1ff0 con 0x7f6a6810fb60 2024-05-08T08:06:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.296+0000 7f6a67e00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6a4c0b29f0 0x7f6a4c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.296+0000 7f6a67e00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6a4c0b29f0 0x7f6a4c0b4eb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800b5c0 tx=0x7f6a5801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:32.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.323+0000 7f6a792e0b80 1 Processor -- start 2024-05-08T08:06:32.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.323+0000 7f6a792e0b80 1 -- start start 2024-05-08T08:06:32.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a981b0 0x55ae35a98590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a92c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a93140 0x55ae35a9ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ae359e4b20 con 0x55ae35a92780 2024-05-08T08:06:32.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae35982860 con 0x55ae35a981b0 2024-05-08T08:06:32.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ae359e0ae0 con 0x55ae35a93140 2024-05-08T08:06:32.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a67400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a92c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a67400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a92c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52020/0 (socket says 172.21.15.70:52020) 2024-05-08T08:06:32.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a67400700 1 -- 172.21.15.70:0/888761455 learned_addr learned my addr 172.21.15.70:0/888761455 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:32.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a67e00700 1 --2- 172.21.15.70:0/888761455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a981b0 0x55ae35a98590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.324+0000 7f6a6ca00700 1 --2- 172.21.15.70:0/888761455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a93140 0x55ae35a9ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.325+0000 7f6a67400700 1 -- 172.21.15.70:0/888761455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a93140 msgr2=0x55ae35a9ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.325+0000 7f6a67400700 1 --2- 172.21.15.70:0/888761455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a93140 0x55ae35a9ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.325+0000 7f6a67400700 1 -- 172.21.15.70:0/888761455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a981b0 msgr2=0x55ae35a98590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.325+0000 7f6a67400700 1 --2- 172.21.15.70:0/888761455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a981b0 0x55ae35a98590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.325+0000 7f6a67400700 1 -- 172.21.15.70:0/888761455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae359319d0 con 0x55ae35a92780 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.325+0000 7f6a67400700 1 --2- 172.21.15.70:0/888761455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a92c00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6a540077f0 tx=0x7f6a54007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8af70ec69887b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.325+0000 7f6a5d600700 1 -- 172.21.15.70:0/888761455 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54011590 con 0x55ae35a92780 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.326+0000 7f6a5d600700 1 -- 172.21.15.70:0/888761455 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a54017070 con 0x55ae35a92780 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.326+0000 7f6a5d600700 1 -- 172.21.15.70:0/888761455 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54012b30 con 0x55ae35a92780 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.326+0000 7f6a792e0b80 1 -- 172.21.15.70:0/888761455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 msgr2=0x55ae35a92c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:32.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.326+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/888761455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a92c00 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6a540077f0 tx=0x7f6a54007b00 comp rx=0 tx=0).stop 2024-05-08T08:06:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.326+0000 7f6a792e0b80 1 -- 172.21.15.70:0/888761455 shutdown_connections 2024-05-08T08:06:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.326+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/888761455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a93140 0x55ae35a9ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.326+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/888761455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a981b0 0x55ae35a98590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.326+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/888761455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a92c00 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.327+0000 7f6a792e0b80 1 -- 172.21.15.70:0/888761455 >> 172.21.15.70:0/888761455 conn(0x55ae35a0a7d0 msgr2=0x55ae35a8d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.327+0000 7f6a792e0b80 1 -- 172.21.15.70:0/888761455 shutdown_connections 2024-05-08T08:06:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.327+0000 7f6a792e0b80 1 -- 172.21.15.70:0/888761455 wait complete. 2024-05-08T08:06:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.327+0000 7f6a792e0b80 1 -- start start 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.327+0000 7f6a792e0b80 1 Processor -- start 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a9eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 0x55ae35a9c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ae35a9f570 con 0x55ae35a92780 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ae3594ac20 con 0x55ae35a93140 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ae35a9f6f0 con 0x55ae35a981b0 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a792e0b80 10 client.0 _ll_register_callbacks cb 0x55ae3598bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a67e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a9eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a67e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a9eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52030/0 (socket says 172.21.15.70:52030) 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.328+0000 7f6a67e00700 1 -- 172.21.15.70:0/581032345 learned_addr learned my addr 172.21.15.70:0/581032345 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.329+0000 7f6a67400700 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.329+0000 7f6a6ca00700 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 0x55ae35a9c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.329+0000 7f6a67e00700 1 -- 172.21.15.70:0/581032345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 msgr2=0x55ae35a9c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.329+0000 7f6a67e00700 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 0x55ae35a9c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.329+0000 7f6a67e00700 1 -- 172.21.15.70:0/581032345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 msgr2=0x55ae35a9bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.329+0000 7f6a67e00700 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.329+0000 7f6a67e00700 1 -- 172.21.15.70:0/581032345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae359aa520 con 0x55ae35a92780 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.329+0000 7f6a67400700 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.330+0000 7f6a67e00700 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a9eb60 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f6a58015000 tx=0x7f6a58009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20b514a41e162db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.330+0000 7f6a52000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.330+0000 7f6a52000700 1 -- 172.21.15.70:0/581032345 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58005020 con 0x55ae35a92780 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.330+0000 7f6a52000700 1 -- 172.21.15.70:0/581032345 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(237..237 src has 1..237) ==== 9583+0+0 (secure 0 0 0) 0x7f6a580051c0 con 0x55ae35a92780 2024-05-08T08:06:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.330+0000 7f6a792e0b80 1 -- 172.21.15.70:0/581032345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a54017070 con 0x55ae35a92780 2024-05-08T08:06:32.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.330+0000 7f6a52000700 1 -- 172.21.15.70:0/581032345 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6a5803c050 con 0x55ae35a92780 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.330+0000 7f6a792e0b80 10 client.17607 fetch_fsmap learned FSMap version 42 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.330+0000 7f6a792e0b80 1 -- 172.21.15.70:0/581032345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ae35aa9d70 con 0x55ae35a92780 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.331+0000 7f6a52000700 1 -- 172.21.15.70:0/581032345 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a54017070 con 0x55ae35a92780 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.331+0000 7f6a52000700 1 -- 172.21.15.70:0/581032345 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f6a5802f650 con 0x55ae35a92780 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.331+0000 7f6a792e0b80 10 client.17607 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.331+0000 7f6a792e0b80 10 client.17607 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.331+0000 7f6a792e0b80 20 client.17607 populate_metadata read hostname 'smithi070' 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.331+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae35aac400 0x55ae35aae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.331+0000 7f6a792e0b80 4 client.17607 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.331+0000 7f6a792e0b80 1 -- 172.21.15.70:0/581032345 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae35a5f240 con 0x55ae35aac400 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.332+0000 7f6a67400700 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae35aac400 0x55ae35aae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.333+0000 7f6a52000700 10 client.17607 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:06:32.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.333+0000 7f6a67400700 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae35aac400 0x55ae35aae880 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8747e997e754a43f server_cookie=51888309ec85591f in_seq=0 out_seq=0 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a52000700 1 -- 172.21.15.70:0/581032345 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ae35a5f240 con 0x55ae35aac400 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a52000700 10 client.17607 handle_command_reply: tid=0 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 client.17607 shutdown 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 -- 172.21.15.70:0/581032345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 msgr2=0x55ae35a9eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a9eb60 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f6a58015000 tx=0x7f6a58009310 comp rx=0 tx=0).stop 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 -- 172.21.15.70:0/581032345 shutdown_connections 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae35aac400 0x55ae35aae880 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 0x55ae35a9c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a92780 0x55ae35a9eb60 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/581032345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a52000700 0 client.17607 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:06:32.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 -- 172.21.15.70:0/581032345 >> 172.21.15.70:0/581032345 conn(0x55ae35a0a7d0 msgr2=0x55ae35a87b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:32.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 -- 172.21.15.70:0/581032345 shutdown_connections 2024-05-08T08:06:32.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.335+0000 7f6a792e0b80 1 -- 172.21.15.70:0/581032345 wait complete. 2024-05-08T08:06:32.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.336+0000 7f6a792e0b80 20 client.17607 trim_cache size 0 max 16384 2024-05-08T08:06:32.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.357+0000 7f6a792e0b80 1 Processor -- start 2024-05-08T08:06:32.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.357+0000 7f6a792e0b80 1 -- start start 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.357+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a92780 0x55ae35aa8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.357+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a93140 0x55ae35a9c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.357+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 0x55ae35a879c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a681b8590 con 0x55ae35a93140 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a681b5e20 con 0x55ae35a92780 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a681b3c90 con 0x55ae35a981b0 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a67400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a93140 0x55ae35a9c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a67400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a93140 0x55ae35a9c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52046/0 (socket says 172.21.15.70:52046) 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a67400700 1 -- 172.21.15.70:0/3208030012 learned_addr learned my addr 172.21.15.70:0/3208030012 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a6ca00700 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 0x55ae35a879c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a67e00700 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a92780 0x55ae35aa8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a67400700 1 -- 172.21.15.70:0/3208030012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 msgr2=0x55ae35a879c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:32.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a67400700 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 0x55ae35a879c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a67400700 1 -- 172.21.15.70:0/3208030012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a92780 msgr2=0x55ae35aa8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:32.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a67400700 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a92780 0x55ae35aa8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.358+0000 7f6a67400700 1 -- 172.21.15.70:0/3208030012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae35a89890 con 0x55ae35a93140 2024-05-08T08:06:32.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.359+0000 7f6a67e00700 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a92780 0x55ae35aa8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:06:32.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.359+0000 7f6a67400700 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a93140 0x55ae35a9c350 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6a540077f0 tx=0x7f6a54012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a376481cc72a4a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:32.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.359+0000 7f6a5cc00700 1 -- 172.21.15.70:0/3208030012 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5402e070 con 0x55ae35a93140 2024-05-08T08:06:32.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.359+0000 7f6a5cc00700 1 -- 172.21.15.70:0/3208030012 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a54017040 con 0x55ae35a93140 2024-05-08T08:06:32.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.359+0000 7f6a5cc00700 1 -- 172.21.15.70:0/3208030012 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54011e20 con 0x55ae35a93140 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.360+0000 7f6a792e0b80 1 -- 172.21.15.70:0/3208030012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a93140 msgr2=0x55ae35a9c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.360+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a93140 0x55ae35a9c350 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6a540077f0 tx=0x7f6a54012910 comp rx=0 tx=0).stop 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.360+0000 7f6a792e0b80 1 -- 172.21.15.70:0/3208030012 shutdown_connections 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.360+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a981b0 0x55ae35a879c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.360+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a92780 0x55ae35aa8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.360+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/3208030012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a93140 0x55ae35a9c350 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.360+0000 7f6a792e0b80 1 -- 172.21.15.70:0/3208030012 >> 172.21.15.70:0/3208030012 conn(0x55ae35a0a7d0 msgr2=0x55ae35a872b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.360+0000 7f6a792e0b80 1 -- 172.21.15.70:0/3208030012 shutdown_connections 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.360+0000 7f6a792e0b80 1 -- 172.21.15.70:0/3208030012 wait complete. 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.361+0000 7f6a792e0b80 1 -- start start 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.361+0000 7f6a792e0b80 1 Processor -- start 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.361+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a92780 0x55ae35a9f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.361+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.361+0000 7f6a792e0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a981b0 0x55ae35aa03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.361+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a681b42e0 con 0x55ae35a981b0 2024-05-08T08:06:32.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.361+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a681b5750 con 0x55ae35a93140 2024-05-08T08:06:32.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.361+0000 7f6a792e0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a681b49b0 con 0x55ae35a92780 2024-05-08T08:06:32.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.361+0000 7f6a792e0b80 10 client.0 _ll_register_callbacks cb 0x55ae35aaed10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a6ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a981b0 0x55ae35aa03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a6ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a981b0 0x55ae35aa03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52054/0 (socket says 172.21.15.70:52054) 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a6ca00700 1 -- 172.21.15.70:0/2732765476 learned_addr learned my addr 172.21.15.70:0/2732765476 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a67400700 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a67e00700 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a92780 0x55ae35a9f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a6ca00700 1 -- 172.21.15.70:0/2732765476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a92780 msgr2=0x55ae35a9f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a6ca00700 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a92780 0x55ae35a9f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a6ca00700 1 -- 172.21.15.70:0/2732765476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 msgr2=0x55ae35a9fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a6ca00700 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a6ca00700 1 -- 172.21.15.70:0/2732765476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae35b16e30 con 0x55ae35a981b0 2024-05-08T08:06:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a67e00700 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a92780 0x55ae35a9f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a67400700 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a6ca00700 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a981b0 0x55ae35aa03c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6a600df450 tx=0x7f6a60014870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67290cf3537fc94d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.362+0000 7f6a52000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.363+0000 7f6a52000700 1 -- 172.21.15.70:0/2732765476 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6006d060 con 0x55ae35a981b0 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.363+0000 7f6a52000700 1 -- 172.21.15.70:0/2732765476 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(237..237 src has 1..237) ==== 9583+0+0 (secure 0 0 0) 0x7f6a60014440 con 0x55ae35a981b0 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.363+0000 7f6a792e0b80 1 -- 172.21.15.70:0/2732765476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a54017040 con 0x55ae35a981b0 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.363+0000 7f6a52000700 1 -- 172.21.15.70:0/2732765476 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6a600c3070 con 0x55ae35a981b0 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.363+0000 7f6a792e0b80 10 client.17613 fetch_fsmap learned FSMap version 42 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.363+0000 7f6a792e0b80 1 -- 172.21.15.70:0/2732765476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ae35b18140 con 0x55ae35a981b0 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.363+0000 7f6a52000700 1 -- 172.21.15.70:0/2732765476 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a54017040 con 0x55ae35a981b0 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.363+0000 7f6a52000700 1 -- 172.21.15.70:0/2732765476 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f6a600a8370 con 0x55ae35a981b0 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.364+0000 7f6a792e0b80 10 client.17613 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.364+0000 7f6a792e0b80 10 client.17613 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:06:32.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.364+0000 7f6a792e0b80 20 client.17613 populate_metadata read hostname 'smithi070' 2024-05-08T08:06:32.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.364+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae35b187d0 0x55ae35b1abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:32.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.364+0000 7f6a792e0b80 4 client.17613 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6480e5fa", "release": true, "await": true}] 2024-05-08T08:06:32.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.364+0000 7f6a792e0b80 1 -- 172.21.15.70:0/2732765476 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6480e5fa", "release": true, "await": true}) -- 0x55ae359f2500 con 0x55ae35b187d0 2024-05-08T08:06:32.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.364+0000 7f6a67e00700 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae35b187d0 0x55ae35b1abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:32.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.365+0000 7f6a67e00700 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae35b187d0 0x55ae35b1abf0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bde231cba3068cf server_cookie=3ff286b8970c615f in_seq=0 out_seq=0 2024-05-08T08:06:32.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:32.365+0000 7f6a52000700 10 client.17613 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:06:32.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:32 smithi172 ceph-mon[33377]: pgmap v2545: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T08:06:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:32 smithi194 ceph-mon[33679]: pgmap v2545: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T08:06:34.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:34 smithi070 ceph-mon[29591]: pgmap v2546: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T08:06:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:34 smithi172 ceph-mon[33377]: pgmap v2546: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T08:06:34.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:34 smithi194 ceph-mon[33679]: pgmap v2546: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T08:06:36.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:36 smithi070 ceph-mon[29591]: pgmap v2547: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T08:06:36.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:36 smithi172 ceph-mon[33377]: pgmap v2547: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T08:06:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:36 smithi194 ceph-mon[33679]: pgmap v2547: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T08:06:36.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.714+0000 7f6a52000700 1 -- 172.21.15.70:0/2732765476 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55ae359f2500 con 0x55ae35b187d0 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.715+0000 7f6a52000700 10 client.17613 handle_command_reply: tid=0 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.715+0000 7f6a792e0b80 1 client.17613 shutdown 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.715+0000 7f6a792e0b80 1 -- 172.21.15.70:0/2732765476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a981b0 msgr2=0x55ae35aa03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.715+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a981b0 0x55ae35aa03c0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6a600df450 tx=0x7f6a60014870 comp rx=0 tx=0).stop 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.716+0000 7f6a792e0b80 1 -- 172.21.15.70:0/2732765476 shutdown_connections 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.716+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ae35b187d0 0x55ae35b1abf0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.716+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae35a981b0 0x55ae35aa03c0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.716+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ae35a92780 0x55ae35a9f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.716+0000 7f6a792e0b80 1 --2- 172.21.15.70:0/2732765476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ae35a93140 0x55ae35a9fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.716+0000 7f6a52000700 0 client.17613 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:06:36.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.716+0000 7f6a792e0b80 1 -- 172.21.15.70:0/2732765476 >> 172.21.15.70:0/2732765476 conn(0x55ae35a0a7d0 msgr2=0x55ae35a87b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:36.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.717+0000 7f6a792e0b80 1 -- 172.21.15.70:0/2732765476 shutdown_connections 2024-05-08T08:06:36.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.717+0000 7f6a792e0b80 1 -- 172.21.15.70:0/2732765476 wait complete. 2024-05-08T08:06:36.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.717+0000 7f6a792e0b80 20 client.17613 trim_cache size 0 max 16384 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 188, 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "6480e5fa": { 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 188, 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:06:36.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.5, 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:06:36.714 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:06:36.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.719+0000 7f6a6ea00700 1 -- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6a4c0b29f0 msgr2=0x7f6a4c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:36.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.719+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6a4c0b29f0 0x7f6a4c0b4eb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6a5800b5c0 tx=0x7f6a5801a040 comp rx=0 tx=0).stop 2024-05-08T08:06:36.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.719+0000 7f6a6ea00700 1 -- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 msgr2=0x7f6a681a4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:36.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.719+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 0x7f6a681a4b10 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000b970 tx=0x7f6a6000bd30 comp rx=0 tx=0).stop 2024-05-08T08:06:36.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.720+0000 7f6a6ea00700 1 -- 172.21.15.70:0/1160396659 shutdown_connections 2024-05-08T08:06:36.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.720+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6a4c0b29f0 0x7f6a4c0b4eb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:36.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.720+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a6810fb60 0x7f6a681a4b10 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:36.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.720+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a68109ad0 0x7f6a681a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:36.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.720+0000 7f6a6ea00700 1 --2- 172.21.15.70:0/1160396659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a6810a490 0x7f6a681a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:36.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.720+0000 7f6a6ea00700 1 -- 172.21.15.70:0/1160396659 >> 172.21.15.70:0/1160396659 conn(0x7f6a68076c70 msgr2=0x7f6a68077390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:36.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.720+0000 7f6a6ea00700 1 -- 172.21.15.70:0/1160396659 shutdown_connections 2024-05-08T08:06:36.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:36.720+0000 7f6a6ea00700 1 -- 172.21.15.70:0/1160396659 wait complete. 2024-05-08T08:06:37.659 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6480e5fa', seconds elapsed: 69.3 2024-05-08T08:06:37.660 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.45 2024-05-08T08:06:37.660 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:06:38.221 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:06:38.308 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:38 smithi194 ceph-mon[33679]: pgmap v2548: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T08:06:38.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:38 smithi070 ceph-mon[29591]: pgmap v2548: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T08:06:38.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:38 smithi172 ceph-mon[33377]: pgmap v2548: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T08:06:38.804 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/decompress_unxz.o 2024-05-08T08:06:38.994 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/pcm_lib.o 2024-05-08T08:06:39.132 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/slot.o 2024-05-08T08:06:39.241 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/reboot.o 2024-05-08T08:06:39.581 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/char/ipmi/built-in.a 2024-05-08T08:06:39.663 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/notifier.o 2024-05-08T08:06:39.713 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/rtnetlink.o 2024-05-08T08:06:39.806 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/msr.o 2024-05-08T08:06:39.926 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/super.o 2024-05-08T08:06:40.034 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:40 smithi070 ceph-mon[29591]: pgmap v2549: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T08:06:40.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:40 smithi172 ceph-mon[33377]: pgmap v2549: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T08:06:40.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:40 smithi194 ceph-mon[33679]: pgmap v2549: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 5 op/s 2024-05-08T08:06:40.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.671+0000 7f162d200700 1 -- 172.21.15.70:0/3355777503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 msgr2=0x7f162806b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:40.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.671+0000 7f162d200700 1 --2- 172.21.15.70:0/3355777503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 0x7f162806b590 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f1618009990 tx=0x7f1618009ca0 comp rx=0 tx=0).stop 2024-05-08T08:06:40.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.672+0000 7f162d200700 1 -- 172.21.15.70:0/3355777503 shutdown_connections 2024-05-08T08:06:40.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.672+0000 7f162d200700 1 --2- 172.21.15.70:0/3355777503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162810ff50 0x7f1628112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:40.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.672+0000 7f162d200700 1 --2- 172.21.15.70:0/3355777503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 0x7f162806b590 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:40.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.672+0000 7f162d200700 1 --2- 172.21.15.70:0/3355777503 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f162806bad0 0x7f162810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:40.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.672+0000 7f162d200700 1 -- 172.21.15.70:0/3355777503 >> 172.21.15.70:0/3355777503 conn(0x7f1628079350 msgr2=0x7f1628079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:40.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.672+0000 7f162d200700 1 -- 172.21.15.70:0/3355777503 shutdown_connections 2024-05-08T08:06:40.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.672+0000 7f162d200700 1 -- 172.21.15.70:0/3355777503 wait complete. 2024-05-08T08:06:40.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.674+0000 7f162d200700 1 Processor -- start 2024-05-08T08:06:40.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.674+0000 7f162d200700 1 -- start start 2024-05-08T08:06:40.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f162d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 0x7f16281a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:40.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f162d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f162806bad0 0x7f16281a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:40.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f162d200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162810ff50 0x7f162819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:40.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f162d200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1628115770 con 0x7f162806b1b0 2024-05-08T08:06:40.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f162d200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f16281155f0 con 0x7f162806bad0 2024-05-08T08:06:40.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f162d200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f16281158f0 con 0x7f162810ff50 2024-05-08T08:06:40.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f1625e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 0x7f16281a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:40.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f1625400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f162806bad0 0x7f16281a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:40.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f1625e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 0x7f16281a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54268/0 (socket says 172.21.15.70:54268) 2024-05-08T08:06:40.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f1625e00700 1 -- 172.21.15.70:0/171630830 learned_addr learned my addr 172.21.15.70:0/171630830 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:40.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.675+0000 7f1625400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f162806bad0 0x7f16281a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:35788/0 (socket says 172.21.15.70:35788) 2024-05-08T08:06:40.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.676+0000 7f1626800700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162810ff50 0x7f162819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:40.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.676+0000 7f1625e00700 1 -- 172.21.15.70:0/171630830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162810ff50 msgr2=0x7f162819bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:40.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.676+0000 7f1625e00700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162810ff50 0x7f162819bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:40.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.676+0000 7f1625e00700 1 -- 172.21.15.70:0/171630830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f162806bad0 msgr2=0x7f16281a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:40.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.676+0000 7f1625e00700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f162806bad0 0x7f16281a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:40.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.676+0000 7f1625e00700 1 -- 172.21.15.70:0/171630830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162819c410 con 0x7f162806b1b0 2024-05-08T08:06:40.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.676+0000 7f1625400700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f162806bad0 0x7f16281a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:06:40.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.677+0000 7f1625e00700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 0x7f16281a1a60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1618000c00 tx=0x7f16180057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:40.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.677+0000 7f161ea00700 1 -- 172.21.15.70:0/171630830 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1618027070 con 0x7f162806b1b0 2024-05-08T08:06:40.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.677+0000 7f161ea00700 1 -- 172.21.15.70:0/171630830 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f161800fb00 con 0x7f162806b1b0 2024-05-08T08:06:40.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.677+0000 7f161ea00700 1 -- 172.21.15.70:0/171630830 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1618022a00 con 0x7f162806b1b0 2024-05-08T08:06:40.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.677+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f162819c6a0 con 0x7f162806b1b0 2024-05-08T08:06:40.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.677+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16281045b0 con 0x7f162806b1b0 2024-05-08T08:06:40.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.679+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16281029c0 con 0x7f162806b1b0 2024-05-08T08:06:40.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.682+0000 7f161ea00700 1 -- 172.21.15.70:0/171630830 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f161800fcb0 con 0x7f162806b1b0 2024-05-08T08:06:40.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.685+0000 7f161ea00700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f160c0b2a70 0x7f160c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:40.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.686+0000 7f161ea00700 1 -- 172.21.15.70:0/171630830 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(237..237 src has 1..237) ==== 9583+0+0 (secure 0 0 0) 0x7f16180e33b0 con 0x7f162806b1b0 2024-05-08T08:06:40.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.686+0000 7f1625400700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f160c0b2a70 0x7f160c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:40.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.688+0000 7f1625400700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f160c0b2a70 0x7f160c0b4f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f162819d280 tx=0x7f161400b410 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:40.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:40.688+0000 7f161ea00700 1 -- 172.21.15.70:0/171630830 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1618013070 con 0x7f162806b1b0 2024-05-08T08:06:41.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.146+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f162819cff0 con 0x7f162806b1b0 2024-05-08T08:06:41.143 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:06:41.143 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:06:41.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.147+0000 7f161ea00700 1 -- 172.21.15.70:0/171630830 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f16180aa9a0 con 0x7f162806b1b0 2024-05-08T08:06:41.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.151+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f160c0b2a70 msgr2=0x7f160c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.151+0000 7f162d200700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f160c0b2a70 0x7f160c0b4f30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f162819d280 tx=0x7f161400b410 comp rx=0 tx=0).stop 2024-05-08T08:06:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.151+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 msgr2=0x7f16281a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.151+0000 7f162d200700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 0x7f16281a1a60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1618000c00 tx=0x7f16180057a0 comp rx=0 tx=0).stop 2024-05-08T08:06:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.152+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 shutdown_connections 2024-05-08T08:06:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.152+0000 7f162d200700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f160c0b2a70 0x7f160c0b4f30 secure :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f162819d280 tx=0x7f161400b410 comp rx=0 tx=0).stop 2024-05-08T08:06:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.152+0000 7f162d200700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f162810ff50 0x7f162819bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.152+0000 7f162d200700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f162806b1b0 0x7f16281a1a60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.152+0000 7f162d200700 1 --2- 172.21.15.70:0/171630830 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f162806bad0 0x7f16281a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:41.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.152+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 >> 172.21.15.70:0/171630830 conn(0x7f1628079350 msgr2=0x7f1628111460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:41.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.152+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 shutdown_connections 2024-05-08T08:06:41.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:41.152+0000 7f162d200700 1 -- 172.21.15.70:0/171630830 wait complete. 2024-05-08T08:06:41.148 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:06:42.042 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:42 smithi070 ceph-mon[29591]: pgmap v2550: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 126 KiB/s wr, 12 op/s 2024-05-08T08:06:42.042 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:42 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/171630830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:06:42.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:42 smithi172 ceph-mon[33377]: pgmap v2550: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 126 KiB/s wr, 12 op/s 2024-05-08T08:06:42.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:42 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/171630830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:06:42.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:42 smithi194 ceph-mon[33679]: pgmap v2550: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 126 KiB/s wr, 12 op/s 2024-05-08T08:06:42.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:42 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/171630830' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:06:42.539 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 84.45 --await-for 42.0' 2024-05-08T08:06:42.539 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 84.45 --await-for 42.0 2024-05-08T08:06:43.107 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:06:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:44 smithi070 ceph-mon[29591]: pgmap v2551: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 102 KiB/s wr, 9 op/s 2024-05-08T08:06:44.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:44 smithi172 ceph-mon[33377]: pgmap v2551: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 102 KiB/s wr, 9 op/s 2024-05-08T08:06:44.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:44 smithi194 ceph-mon[33679]: pgmap v2551: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 102 KiB/s wr, 9 op/s 2024-05-08T08:06:45.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:45 smithi070 ceph-mon[29591]: pgmap v2552: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 267 KiB/s wr, 28 op/s 2024-05-08T08:06:45.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:45 smithi172 ceph-mon[33377]: pgmap v2552: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 267 KiB/s wr, 28 op/s 2024-05-08T08:06:45.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:45 smithi194 ceph-mon[33679]: pgmap v2552: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 267 KiB/s wr, 28 op/s 2024-05-08T08:06:47.287 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/decompress_unzstd.o 2024-05-08T08:06:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.581+0000 7f6a0de00700 1 -- 172.21.15.70:0/2597708253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0810ff50 msgr2=0x7f6a08112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.581+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2597708253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0810ff50 0x7f6a08112340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009f90 tx=0x7f6a0000b330 comp rx=0 tx=0).stop 2024-05-08T08:06:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.582+0000 7f6a0de00700 1 -- 172.21.15.70:0/2597708253 shutdown_connections 2024-05-08T08:06:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.582+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2597708253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0810ff50 0x7f6a08112340 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.582+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2597708253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a08102ed0 0x7f6a081032b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.582+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2597708253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a081037f0 0x7f6a0810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.582+0000 7f6a0de00700 1 -- 172.21.15.70:0/2597708253 >> 172.21.15.70:0/2597708253 conn(0x7f6a08079340 msgr2=0x7f6a08079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:47.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.583+0000 7f6a0de00700 1 -- 172.21.15.70:0/2597708253 shutdown_connections 2024-05-08T08:06:47.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.583+0000 7f6a0de00700 1 -- 172.21.15.70:0/2597708253 wait complete. 2024-05-08T08:06:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.585+0000 7f6a0de00700 1 Processor -- start 2024-05-08T08:06:47.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.585+0000 7f6a0de00700 1 -- start start 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.586+0000 7f6a0de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08102ed0 0x7f6a08104680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.586+0000 7f6a0de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a081037f0 0x7f6a08104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.586+0000 7f6a0de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0810ff50 0x7f6a08105100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.586+0000 7f6a0de00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a081157a0 con 0x7f6a081037f0 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.586+0000 7f6a0de00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08115620 con 0x7f6a0810ff50 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.586+0000 7f6a0de00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6a08115920 con 0x7f6a08102ed0 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.586+0000 7f6a07400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0810ff50 0x7f6a08105100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.586+0000 7f6a07400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0810ff50 0x7f6a08105100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:51562/0 (socket says 172.21.15.70:51562) 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.586+0000 7f6a07400700 1 -- 172.21.15.70:0/2550189747 learned_addr learned my addr 172.21.15.70:0/2550189747 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:47.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.587+0000 7f6a06a00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08102ed0 0x7f6a08104680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.587+0000 7f6a06000700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a081037f0 0x7f6a08104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.587+0000 7f6a06000700 1 -- 172.21.15.70:0/2550189747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08102ed0 msgr2=0x7f6a08104680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:47.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.587+0000 7f6a06000700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08102ed0 0x7f6a08104680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.587+0000 7f6a06000700 1 -- 172.21.15.70:0/2550189747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0810ff50 msgr2=0x7f6a08105100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:47.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.587+0000 7f6a06000700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0810ff50 0x7f6a08105100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.587+0000 7f6a06000700 1 -- 172.21.15.70:0/2550189747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a081ac280 con 0x7f6a081037f0 2024-05-08T08:06:47.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.588+0000 7f6a06000700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a081037f0 0x7f6a08104bc0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f69f4005fd0 tx=0x7f69f400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:47.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.589+0000 7f6a0ca00700 1 -- 172.21.15.70:0/2550189747 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4004220 con 0x7f6a081037f0 2024-05-08T08:06:47.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.590+0000 7f6a0ca00700 1 -- 172.21.15.70:0/2550189747 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69f400cd10 con 0x7f6a081037f0 2024-05-08T08:06:47.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.590+0000 7f6a0de00700 1 -- 172.21.15.70:0/2550189747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a081ac570 con 0x7f6a081037f0 2024-05-08T08:06:47.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.590+0000 7f6a0de00700 1 -- 172.21.15.70:0/2550189747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a081acb00 con 0x7f6a081037f0 2024-05-08T08:06:47.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.590+0000 7f6a0ca00700 1 -- 172.21.15.70:0/2550189747 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4003ce0 con 0x7f6a081037f0 2024-05-08T08:06:47.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.597+0000 7f6a0ca00700 1 -- 172.21.15.70:0/2550189747 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f69f40043c0 con 0x7f6a081037f0 2024-05-08T08:06:47.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.599+0000 7f6a0ca00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f69ec0b2ba0 0x7f69ec0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.599+0000 7f6a0ca00700 1 -- 172.21.15.70:0/2550189747 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(237..237 src has 1..237) ==== 9583+0+0 (secure 0 0 0) 0x7f69f40e2a50 con 0x7f6a081037f0 2024-05-08T08:06:47.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.599+0000 7f6a06a00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f69ec0b2ba0 0x7f69ec0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.601+0000 7f6a06a00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f69ec0b2ba0 0x7f69ec0b5060 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009bf0 tx=0x7f69f8009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:47.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.612+0000 7f6a186c0b80 1 Processor -- start 2024-05-08T08:06:47.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.612+0000 7f6a186c0b80 1 -- start start 2024-05-08T08:06:47.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.613+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 0x556db7103330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.613+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db70fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.613+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7109d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.613+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556db704fbb0 con 0x556db70fd520 2024-05-08T08:06:47.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.613+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556db6fed8f0 con 0x556db7102f50 2024-05-08T08:06:47.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.613+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556db704bb70 con 0x556db70fdee0 2024-05-08T08:06:47.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.614+0000 7f6a07400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7109d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.614+0000 7f6a06a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 0x556db7103330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.614+0000 7f6a07400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7109d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:44178/0 (socket says 172.21.15.70:44178) 2024-05-08T08:06:47.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.614+0000 7f6a07400700 1 -- 172.21.15.70:0/1220020582 learned_addr learned my addr 172.21.15.70:0/1220020582 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:47.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.614+0000 7f6a06000700 1 --2- 172.21.15.70:0/1220020582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db70fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.615+0000 7f6a07400700 1 -- 172.21.15.70:0/1220020582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 msgr2=0x556db7103330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:47.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.615+0000 7f6a07400700 1 --2- 172.21.15.70:0/1220020582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 0x556db7103330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.615+0000 7f6a07400700 1 -- 172.21.15.70:0/1220020582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 msgr2=0x556db70fd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:47.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.615+0000 7f6a07400700 1 --2- 172.21.15.70:0/1220020582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db70fd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.615+0000 7f6a07400700 1 -- 172.21.15.70:0/1220020582 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db6f9ca60 con 0x556db70fdee0 2024-05-08T08:06:47.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.615+0000 7f6a06000700 1 --2- 172.21.15.70:0/1220020582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db70fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:06:47.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.615+0000 7f6a07400700 1 --2- 172.21.15.70:0/1220020582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7109d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009c80 tx=0x7f6a00009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7e3006530d48598 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:47.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.616+0000 7f69fcc00700 1 -- 172.21.15.70:0/1220020582 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00020030 con 0x556db70fdee0 2024-05-08T08:06:47.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.616+0000 7f69fcc00700 1 -- 172.21.15.70:0/1220020582 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a0000b9f0 con 0x556db70fdee0 2024-05-08T08:06:47.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.616+0000 7f69fcc00700 1 -- 172.21.15.70:0/1220020582 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a00007b40 con 0x556db70fdee0 2024-05-08T08:06:47.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.617+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1220020582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 msgr2=0x556db7109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:47.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.617+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1220020582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7109d10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a00009c80 tx=0x7f6a00009510 comp rx=0 tx=0).stop 2024-05-08T08:06:47.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.618+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1220020582 shutdown_connections 2024-05-08T08:06:47.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.618+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1220020582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7109d10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.618+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1220020582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 0x556db7103330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.618+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1220020582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db70fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.618+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1220020582 >> 172.21.15.70:0/1220020582 conn(0x556db702bcf0 msgr2=0x556db70f7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:47.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.618+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1220020582 shutdown_connections 2024-05-08T08:06:47.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.618+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1220020582 wait complete. 2024-05-08T08:06:47.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.619+0000 7f6a186c0b80 1 -- start start 2024-05-08T08:06:47.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.620+0000 7f6a186c0b80 1 Processor -- start 2024-05-08T08:06:47.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.620+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db7109880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.620+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7106c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.620+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 0x556db71071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.620+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556db710a2b0 con 0x556db70fd520 2024-05-08T08:06:47.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.620+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556db6fb5cb0 con 0x556db7102f50 2024-05-08T08:06:47.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.620+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556db710a430 con 0x556db70fdee0 2024-05-08T08:06:47.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.621+0000 7f6a186c0b80 10 client.0 _ll_register_callbacks cb 0x556db6ff6e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:06:47.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.621+0000 7f6a06000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7106c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.621+0000 7f6a06000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7106c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:44180/0 (socket says 172.21.15.70:44180) 2024-05-08T08:06:47.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.621+0000 7f6a06000700 1 -- 172.21.15.70:0/1315553043 learned_addr learned my addr 172.21.15.70:0/1315553043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:47.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.621+0000 7f6a06a00700 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db7109880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.621+0000 7f6a07400700 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 0x556db71071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.622+0000 7f6a06000700 1 -- 172.21.15.70:0/1315553043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 msgr2=0x556db71071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:47.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.622+0000 7f6a06000700 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 0x556db71071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.622+0000 7f6a06000700 1 -- 172.21.15.70:0/1315553043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 msgr2=0x556db7109880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:47.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.622+0000 7f6a06000700 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db7109880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.622+0000 7f6a06000700 1 -- 172.21.15.70:0/1315553043 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db70155b0 con 0x556db70fdee0 2024-05-08T08:06:47.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.623+0000 7f6a06000700 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7106c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69f40a6b20 tx=0x7f69f40e0250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0c619807852e329 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:47.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.623+0000 7f69f1600700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T08:06:47.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.623+0000 7f69f1600700 1 -- 172.21.15.70:0/1315553043 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4003680 con 0x556db70fdee0 2024-05-08T08:06:47.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.623+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1315553043 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a0000b9f0 con 0x556db70fdee0 2024-05-08T08:06:47.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.623+0000 7f69f1600700 1 -- 172.21.15.70:0/1315553043 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(237..237 src has 1..237) ==== 9583+0+0 (secure 0 0 0) 0x7f69f40b2490 con 0x556db70fdee0 2024-05-08T08:06:47.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.624+0000 7f69f1600700 1 -- 172.21.15.70:0/1315553043 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f69f40a5770 con 0x556db70fdee0 2024-05-08T08:06:47.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.624+0000 7f6a186c0b80 10 client.26704 fetch_fsmap learned FSMap version 42 2024-05-08T08:06:47.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.624+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1315553043 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x556db7114b10 con 0x556db70fdee0 2024-05-08T08:06:47.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.624+0000 7f69f1600700 1 -- 172.21.15.70:0/1315553043 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a0000b9f0 con 0x556db70fdee0 2024-05-08T08:06:47.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.625+0000 7f69f1600700 1 -- 172.21.15.70:0/1315553043 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f69f40aabe0 con 0x556db70fdee0 2024-05-08T08:06:47.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.625+0000 7f6a186c0b80 10 client.26704 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:06:47.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.625+0000 7f6a186c0b80 10 client.26704 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:06:47.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.625+0000 7f6a186c0b80 20 client.26704 populate_metadata read hostname 'smithi070' 2024-05-08T08:06:47.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.625+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556db71170a0 0x556db7119490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.625+0000 7f6a186c0b80 4 client.26704 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:06:47.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.625+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1315553043 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556db70ca230 con 0x556db71170a0 2024-05-08T08:06:47.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.626+0000 7f6a06a00700 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556db71170a0 0x556db7119490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.627+0000 7f6a06a00700 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556db71170a0 0x556db7119490 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c0c35377ac37906 server_cookie=e660d3c5a45f0609 in_seq=0 out_seq=0 2024-05-08T08:06:47.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.627+0000 7f69f1600700 10 client.26704 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:06:47.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.630+0000 7f69f1600700 1 -- 172.21.15.70:0/1315553043 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556db70ca230 con 0x556db71170a0 2024-05-08T08:06:47.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.630+0000 7f69f1600700 10 client.26704 handle_command_reply: tid=0 2024-05-08T08:06:47.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.630+0000 7f6a186c0b80 1 client.26704 shutdown 2024-05-08T08:06:47.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1315553043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 msgr2=0x556db7106c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:47.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7106c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69f40a6b20 tx=0x7f69f40e0250 comp rx=0 tx=0).stop 2024-05-08T08:06:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1315553043 shutdown_connections 2024-05-08T08:06:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556db71170a0 0x556db7119490 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db7102f50 0x556db71071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db7109880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/1315553043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fdee0 0x556db7106c70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1315553043 >> 172.21.15.70:0/1315553043 conn(0x556db702bcf0 msgr2=0x556db70f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f69f1600700 0 client.26704 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:06:47.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.631+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1315553043 shutdown_connections 2024-05-08T08:06:47.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.632+0000 7f6a186c0b80 1 -- 172.21.15.70:0/1315553043 wait complete. 2024-05-08T08:06:47.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.632+0000 7f6a186c0b80 20 client.26704 trim_cache size 0 max 16384 2024-05-08T08:06:47.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.660+0000 7f6a186c0b80 1 Processor -- start 2024-05-08T08:06:47.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.660+0000 7f6a186c0b80 1 -- start start 2024-05-08T08:06:47.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.661+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db71024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.661+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db7102f50 0x556db711ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.661+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db711f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.661+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8011800 con 0x556db70fd520 2024-05-08T08:06:47.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.661+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69e800f090 con 0x556db70f9d30 2024-05-08T08:06:47.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.661+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f69e800cf00 con 0x556db7102f50 2024-05-08T08:06:47.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.661+0000 7f6a07400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db711f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.662+0000 7f6a06a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db71024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.662+0000 7f6a06000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db7102f50 0x556db711ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.662+0000 7f6a06000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db7102f50 0x556db711ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:44186/0 (socket says 172.21.15.70:44186) 2024-05-08T08:06:47.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.662+0000 7f6a06000700 1 -- 172.21.15.70:0/3551627504 learned_addr learned my addr 172.21.15.70:0/3551627504 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:47.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.663+0000 7f6a06a00700 1 -- 172.21.15.70:0/3551627504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db7102f50 msgr2=0x556db711ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:47.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.663+0000 7f6a06a00700 1 --2- 172.21.15.70:0/3551627504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db7102f50 0x556db711ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.663+0000 7f6a06a00700 1 -- 172.21.15.70:0/3551627504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 msgr2=0x556db711f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:47.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.663+0000 7f6a06a00700 1 --2- 172.21.15.70:0/3551627504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db711f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.663+0000 7f6a06a00700 1 -- 172.21.15.70:0/3551627504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556db71094c0 con 0x556db70fd520 2024-05-08T08:06:47.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.663+0000 7f6a06a00700 1 --2- 172.21.15.70:0/3551627504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db71024c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x556db7119ca0 tx=0x7f69f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d3b8a006af9311 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:47.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.664+0000 7f69f3e00700 1 -- 172.21.15.70:0/3551627504 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8004020 con 0x556db70fd520 2024-05-08T08:06:47.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.664+0000 7f69f3e00700 1 -- 172.21.15.70:0/3551627504 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69f802a3b0 con 0x556db70fd520 2024-05-08T08:06:47.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.664+0000 7f69f3e00700 1 -- 172.21.15.70:0/3551627504 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f80038e0 con 0x556db70fd520 2024-05-08T08:06:47.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.665+0000 7f6a186c0b80 1 -- 172.21.15.70:0/3551627504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 msgr2=0x556db71024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:06:47.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.665+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/3551627504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db71024c0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x556db7119ca0 tx=0x7f69f8014000 comp rx=0 tx=0).stop 2024-05-08T08:06:47.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.665+0000 7f6a186c0b80 1 -- 172.21.15.70:0/3551627504 shutdown_connections 2024-05-08T08:06:47.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.665+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/3551627504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db711f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.665+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/3551627504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db70fd520 0x556db71024c0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.665+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/3551627504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db7102f50 0x556db711ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.665+0000 7f6a186c0b80 1 -- 172.21.15.70:0/3551627504 >> 172.21.15.70:0/3551627504 conn(0x556db702bcf0 msgr2=0x556db7101db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:06:47.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.666+0000 7f6a186c0b80 1 -- 172.21.15.70:0/3551627504 shutdown_connections 2024-05-08T08:06:47.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.666+0000 7f6a186c0b80 1 -- 172.21.15.70:0/3551627504 wait complete. 2024-05-08T08:06:47.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.666+0000 7f6a186c0b80 1 -- start start 2024-05-08T08:06:47.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.667+0000 7f6a186c0b80 1 Processor -- start 2024-05-08T08:06:47.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.667+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db710fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.667+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fd520 0x556db710c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.667+0000 7f6a186c0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db7102f50 0x556db710cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.667+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f69e800d550 con 0x556db7102f50 2024-05-08T08:06:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.667+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f69e800e9c0 con 0x556db70f9d30 2024-05-08T08:06:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.667+0000 7f6a186c0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f69e800dc20 con 0x556db70fd520 2024-05-08T08:06:47.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.667+0000 7f6a186c0b80 10 client.0 _ll_register_callbacks cb 0x556db6ff6e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:06:47.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.668+0000 7f6a06a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db710fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.668+0000 7f6a07400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db7102f50 0x556db710cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.669+0000 7f6a06a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db710fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:51590/0 (socket says 172.21.15.70:51590) 2024-05-08T08:06:47.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.669+0000 7f6a06a00700 1 -- 172.21.15.70:0/2598123860 learned_addr learned my addr 172.21.15.70:0/2598123860 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:06:47.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.669+0000 7f6a06000700 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fd520 0x556db710c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.669+0000 7f6a06a00700 1 -- 172.21.15.70:0/2598123860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fd520 msgr2=0x556db710c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:47.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.670+0000 7f6a06a00700 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fd520 0x556db710c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.670+0000 7f6a06a00700 1 -- 172.21.15.70:0/2598123860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db7102f50 msgr2=0x556db710cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:06:47.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.670+0000 7f6a06a00700 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db7102f50 0x556db710cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:06:47.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.670+0000 7f6a06a00700 1 -- 172.21.15.70:0/2598123860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556db710d450 con 0x556db70f9d30 2024-05-08T08:06:47.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.670+0000 7f6a07400700 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db7102f50 0x556db710cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:06:47.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.671+0000 7f6a06a00700 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db710fc80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f69f8011c00 tx=0x7f69f8012f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abc5f5c4f3ff9755 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:06:47.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.671+0000 7f69f1600700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:06:47.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.671+0000 7f69f1600700 1 -- 172.21.15.70:0/2598123860 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8038060 con 0x556db70f9d30 2024-05-08T08:06:47.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.672+0000 7f6a186c0b80 1 -- 172.21.15.70:0/2598123860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69f802a3b0 con 0x556db70f9d30 2024-05-08T08:06:47.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.672+0000 7f69f1600700 1 -- 172.21.15.70:0/2598123860 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(237..237 src has 1..237) ==== 9583+0+0 (secure 0 0 0) 0x7f69f802a770 con 0x556db70f9d30 2024-05-08T08:06:47.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.672+0000 7f69f1600700 1 -- 172.21.15.70:0/2598123860 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f69f802a990 con 0x556db70f9d30 2024-05-08T08:06:47.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.672+0000 7f6a186c0b80 10 client.36608 fetch_fsmap learned FSMap version 42 2024-05-08T08:06:47.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.672+0000 7f6a186c0b80 1 -- 172.21.15.70:0/2598123860 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x556db7182870 con 0x556db70f9d30 2024-05-08T08:06:47.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.673+0000 7f69f1600700 1 -- 172.21.15.70:0/2598123860 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69f802a3b0 con 0x556db70f9d30 2024-05-08T08:06:47.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.673+0000 7f69f1600700 1 -- 172.21.15.70:0/2598123860 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f69f8004a10 con 0x556db70f9d30 2024-05-08T08:06:47.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.673+0000 7f6a186c0b80 10 client.36608 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:06:47.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.673+0000 7f6a186c0b80 10 client.36608 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:06:47.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.673+0000 7f6a186c0b80 20 client.36608 populate_metadata read hostname 'smithi070' 2024-05-08T08:06:47.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.673+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556db7182ec0 0x556db71852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:06:47.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.673+0000 7f6a186c0b80 4 client.36608 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.45, "await_for": 42.0}] 2024-05-08T08:06:47.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.673+0000 7f6a186c0b80 1 -- 172.21.15.70:0/2598123860 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 84.45, "await_for": 42.0}) -- 0x556db705d590 con 0x556db7182ec0 2024-05-08T08:06:47.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.674+0000 7f6a06000700 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556db7182ec0 0x556db71852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:06:47.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.676+0000 7f6a06000700 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556db7182ec0 0x556db71852e0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d66273a659a70e06 server_cookie=ca901f6dcdc17e6b in_seq=0 out_seq=0 2024-05-08T08:06:47.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:06:47.676+0000 7f69f1600700 10 client.36608 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:06:48.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:47 smithi194 ceph-mon[33679]: pgmap v2553: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 267 KiB/s wr, 25 op/s 2024-05-08T08:06:48.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:47 smithi070 ceph-mon[29591]: pgmap v2553: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 267 KiB/s wr, 25 op/s 2024-05-08T08:06:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:47 smithi172 ceph-mon[33377]: pgmap v2553: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 267 KiB/s wr, 25 op/s 2024-05-08T08:06:49.076 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/pcm_misc.o 2024-05-08T08:06:49.178 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/pci-acpi.o 2024-05-08T08:06:50.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:49 smithi194 ceph-mon[33679]: pgmap v2554: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 267 KiB/s wr, 25 op/s 2024-05-08T08:06:50.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:49 smithi070 ceph-mon[29591]: pgmap v2554: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 267 KiB/s wr, 25 op/s 2024-05-08T08:06:50.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:49 smithi172 ceph-mon[33377]: pgmap v2554: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 267 KiB/s wr, 25 op/s 2024-05-08T08:06:52.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:51 smithi194 ceph-mon[33679]: pgmap v2555: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 436 KiB/s wr, 37 op/s 2024-05-08T08:06:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:51 smithi070 ceph-mon[29591]: pgmap v2555: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 436 KiB/s wr, 37 op/s 2024-05-08T08:06:52.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:51 smithi172 ceph-mon[33377]: pgmap v2555: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 436 KiB/s wr, 37 op/s 2024-05-08T08:06:54.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:54 smithi194 ceph-mon[33679]: pgmap v2556: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 334 KiB/s wr, 29 op/s 2024-05-08T08:06:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:54 smithi070 ceph-mon[29591]: pgmap v2556: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 334 KiB/s wr, 29 op/s 2024-05-08T08:06:54.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:54 smithi172 ceph-mon[33377]: pgmap v2556: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 334 KiB/s wr, 29 op/s 2024-05-08T08:06:56.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:56 smithi194 ceph-mon[33679]: pgmap v2557: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 433 KiB/s wr, 35 op/s 2024-05-08T08:06:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:56 smithi070 ceph-mon[29591]: pgmap v2557: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 433 KiB/s wr, 35 op/s 2024-05-08T08:06:56.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:56 smithi172 ceph-mon[33377]: pgmap v2557: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 433 KiB/s wr, 35 op/s 2024-05-08T08:06:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:06:58 smithi070 ceph-mon[29591]: pgmap v2558: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 268 KiB/s wr, 16 op/s 2024-05-08T08:06:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:06:58 smithi172 ceph-mon[33377]: pgmap v2558: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 268 KiB/s wr, 16 op/s 2024-05-08T08:06:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:06:58 smithi194 ceph-mon[33679]: pgmap v2558: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 268 KiB/s wr, 16 op/s 2024-05-08T08:07:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:00 smithi070 ceph-mon[29591]: pgmap v2559: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 268 KiB/s wr, 16 op/s 2024-05-08T08:07:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:00 smithi172 ceph-mon[33377]: pgmap v2559: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 268 KiB/s wr, 16 op/s 2024-05-08T08:07:00.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:00 smithi194 ceph-mon[33679]: pgmap v2559: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 268 KiB/s wr, 16 op/s 2024-05-08T08:07:02.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:02 smithi070 ceph-mon[29591]: pgmap v2560: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 311 KiB/s wr, 27 op/s 2024-05-08T08:07:02.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:02 smithi172 ceph-mon[33377]: pgmap v2560: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 311 KiB/s wr, 27 op/s 2024-05-08T08:07:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:02 smithi194 ceph-mon[33679]: pgmap v2560: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 311 KiB/s wr, 27 op/s 2024-05-08T08:07:04.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:04 smithi070 ceph-mon[29591]: pgmap v2561: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 142 KiB/s wr, 16 op/s 2024-05-08T08:07:04.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:04 smithi172 ceph-mon[33377]: pgmap v2561: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 142 KiB/s wr, 16 op/s 2024-05-08T08:07:04.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:04 smithi194 ceph-mon[33679]: pgmap v2561: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 142 KiB/s wr, 16 op/s 2024-05-08T08:07:06.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:06 smithi070 ceph-mon[29591]: pgmap v2562: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 176 KiB/s wr, 20 op/s 2024-05-08T08:07:06.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:06 smithi172 ceph-mon[33377]: pgmap v2562: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 176 KiB/s wr, 20 op/s 2024-05-08T08:07:06.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:06 smithi194 ceph-mon[33679]: pgmap v2562: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 176 KiB/s wr, 20 op/s 2024-05-08T08:07:08.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:08 smithi194 ceph-mon[33679]: pgmap v2563: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 77 KiB/s wr, 15 op/s 2024-05-08T08:07:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:08 smithi070 ceph-mon[29591]: pgmap v2563: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 77 KiB/s wr, 15 op/s 2024-05-08T08:07:08.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:08 smithi172 ceph-mon[33377]: pgmap v2563: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 77 KiB/s wr, 15 op/s 2024-05-08T08:07:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:10 smithi070 ceph-mon[29591]: pgmap v2564: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 77 KiB/s wr, 16 op/s 2024-05-08T08:07:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:07:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:10 smithi172 ceph-mon[33377]: pgmap v2564: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 77 KiB/s wr, 16 op/s 2024-05-08T08:07:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:07:10.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:10 smithi194 ceph-mon[33679]: pgmap v2564: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 77 KiB/s wr, 16 op/s 2024-05-08T08:07:10.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:07:10.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.555+0000 7f69f1600700 1 -- 172.21.15.70:0/2598123860 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x556db705d590 con 0x556db7182ec0 2024-05-08T08:07:10.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.555+0000 7f69f1600700 10 client.36608 handle_command_reply: tid=0 2024-05-08T08:07:10.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.555+0000 7f6a186c0b80 1 client.36608 shutdown 2024-05-08T08:07:10.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f6a186c0b80 1 -- 172.21.15.70:0/2598123860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 msgr2=0x556db710fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:10.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db710fc80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f69f8011c00 tx=0x7f69f8012f80 comp rx=0 tx=0).stop 2024-05-08T08:07:10.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f6a186c0b80 1 -- 172.21.15.70:0/2598123860 shutdown_connections 2024-05-08T08:07:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556db7182ec0 0x556db71852e0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556db7102f50 0x556db710cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556db70f9d30 0x556db710fc80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f6a186c0b80 1 --2- 172.21.15.70:0/2598123860 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556db70fd520 0x556db710c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f69f1600700 0 client.36608 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:07:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f6a186c0b80 1 -- 172.21.15.70:0/2598123860 >> 172.21.15.70:0/2598123860 conn(0x556db702bcf0 msgr2=0x556db71009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.556+0000 7f6a186c0b80 1 -- 172.21.15.70:0/2598123860 shutdown_connections 2024-05-08T08:07:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.557+0000 7f6a186c0b80 1 -- 172.21.15.70:0/2598123860 wait complete. 2024-05-08T08:07:10.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.557+0000 7f6a186c0b80 20 client.36608 trim_cache size 0 max 16384 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 190, 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "47edde8b": { 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 190, 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:07:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.5, 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:10.555 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:07:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 -- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f69ec0b2ba0 msgr2=0x7f69ec0b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f69ec0b2ba0 0x7f69ec0b5060 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f69f8009bf0 tx=0x7f69f8009260 comp rx=0 tx=0).stop 2024-05-08T08:07:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 -- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a081037f0 msgr2=0x7f6a08104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a081037f0 0x7f6a08104bc0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f69f4005fd0 tx=0x7f69f400ee90 comp rx=0 tx=0).stop 2024-05-08T08:07:10.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 -- 172.21.15.70:0/2550189747 shutdown_connections 2024-05-08T08:07:10.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f69ec0b2ba0 0x7f69ec0b5060 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:10.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6a0810ff50 0x7f6a08105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:10.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08102ed0 0x7f6a08104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:10.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 --2- 172.21.15.70:0/2550189747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a081037f0 0x7f6a08104bc0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:10.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.559+0000 7f6a0de00700 1 -- 172.21.15.70:0/2550189747 >> 172.21.15.70:0/2550189747 conn(0x7f6a08079340 msgr2=0x7f6a08111360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:10.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.560+0000 7f6a0de00700 1 -- 172.21.15.70:0/2550189747 shutdown_connections 2024-05-08T08:07:10.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:10.560+0000 7f6a0de00700 1 -- 172.21.15.70:0/2550189747 wait complete. 2024-05-08T08:07:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:11 smithi172 ceph-mon[33377]: pgmap v2565: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 32 op/s 2024-05-08T08:07:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:11 smithi194 ceph-mon[33679]: pgmap v2565: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 32 op/s 2024-05-08T08:07:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:11 smithi070 ceph-mon[29591]: pgmap v2565: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 147 KiB/s wr, 32 op/s 2024-05-08T08:07:12.028 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '47edde8b', quiesce took 34.4 seconds. Will release after: 24.45 2024-05-08T08:07:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:13 smithi194 ceph-mon[33679]: pgmap v2566: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 104 KiB/s wr, 20 op/s 2024-05-08T08:07:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:13 smithi070 ceph-mon[29591]: pgmap v2566: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 104 KiB/s wr, 20 op/s 2024-05-08T08:07:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:13 smithi172 ceph-mon[33377]: pgmap v2566: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 104 KiB/s wr, 20 op/s 2024-05-08T08:07:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:16 smithi194 ceph-mon[33679]: pgmap v2567: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 183 KiB/s wr, 27 op/s 2024-05-08T08:07:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:16 smithi070 ceph-mon[29591]: pgmap v2567: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 183 KiB/s wr, 27 op/s 2024-05-08T08:07:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:16.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:16 smithi172 ceph-mon[33377]: pgmap v2567: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 183 KiB/s wr, 27 op/s 2024-05-08T08:07:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:17.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:07:17.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:07:17.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:17.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:07:17.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:07:17.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:07:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:07:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:07:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:18 smithi070 ceph-mon[29591]: pgmap v2568: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 150 KiB/s wr, 22 op/s 2024-05-08T08:07:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:18 smithi172 ceph-mon[33377]: pgmap v2568: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 150 KiB/s wr, 22 op/s 2024-05-08T08:07:18.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:18 smithi194 ceph-mon[33679]: pgmap v2568: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 150 KiB/s wr, 22 op/s 2024-05-08T08:07:19.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:19 smithi070 ceph-mon[29591]: osdmap e238: 12 total, 12 up, 12 in 2024-05-08T08:07:19.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:19 smithi172 ceph-mon[33377]: osdmap e238: 12 total, 12 up, 12 in 2024-05-08T08:07:19.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:19 smithi194 ceph-mon[33679]: osdmap e238: 12 total, 12 up, 12 in 2024-05-08T08:07:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:20 smithi070 ceph-mon[29591]: pgmap v2570: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 180 KiB/s wr, 27 op/s 2024-05-08T08:07:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:20 smithi172 ceph-mon[33377]: pgmap v2570: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 180 KiB/s wr, 27 op/s 2024-05-08T08:07:20.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:20 smithi194 ceph-mon[33679]: pgmap v2570: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 180 KiB/s wr, 27 op/s 2024-05-08T08:07:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:22 smithi070 ceph-mon[29591]: pgmap v2571: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 118 KiB/s wr, 12 op/s 2024-05-08T08:07:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:22 smithi172 ceph-mon[33377]: pgmap v2571: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 118 KiB/s wr, 12 op/s 2024-05-08T08:07:22.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:22 smithi194 ceph-mon[33679]: pgmap v2571: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 118 KiB/s wr, 12 op/s 2024-05-08T08:07:23.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:23 smithi070 ceph-mon[29591]: pgmap v2572: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 118 KiB/s wr, 12 op/s 2024-05-08T08:07:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:23 smithi172 ceph-mon[33377]: pgmap v2572: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 118 KiB/s wr, 12 op/s 2024-05-08T08:07:23.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:23 smithi194 ceph-mon[33679]: pgmap v2572: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 118 KiB/s wr, 12 op/s 2024-05-08T08:07:25.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:24 smithi172 ceph-mon[33377]: osdmap e239: 12 total, 12 up, 12 in 2024-05-08T08:07:25.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:24 smithi194 ceph-mon[33679]: osdmap e239: 12 total, 12 up, 12 in 2024-05-08T08:07:25.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:24 smithi070 ceph-mon[29591]: osdmap e239: 12 total, 12 up, 12 in 2024-05-08T08:07:26.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:25 smithi172 ceph-mon[33377]: pgmap v2574: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-08T08:07:26.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:25 smithi194 ceph-mon[33679]: pgmap v2574: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-08T08:07:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:25 smithi070 ceph-mon[29591]: pgmap v2574: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-08T08:07:28.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:28 smithi194 ceph-mon[33679]: pgmap v2575: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-05-08T08:07:28.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:28 smithi070 ceph-mon[29591]: pgmap v2575: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-05-08T08:07:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:28 smithi172 ceph-mon[33377]: pgmap v2575: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 8 op/s 2024-05-08T08:07:30.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:30 smithi070 ceph-mon[29591]: pgmap v2576: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T08:07:30.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:30 smithi172 ceph-mon[33377]: pgmap v2576: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T08:07:30.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:30 smithi194 ceph-mon[33679]: pgmap v2576: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T08:07:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:32 smithi070 ceph-mon[29591]: pgmap v2577: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-05-08T08:07:32.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:32 smithi172 ceph-mon[33377]: pgmap v2577: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-05-08T08:07:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:32 smithi194 ceph-mon[33679]: pgmap v2577: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-05-08T08:07:34.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:34 smithi070 ceph-mon[29591]: pgmap v2578: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-05-08T08:07:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:34 smithi172 ceph-mon[33377]: pgmap v2578: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-05-08T08:07:34.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:34 smithi194 ceph-mon[33679]: pgmap v2578: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-05-08T08:07:36.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:36 smithi070 ceph-mon[29591]: pgmap v2579: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-05-08T08:07:36.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:36 smithi172 ceph-mon[33377]: pgmap v2579: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-05-08T08:07:36.479 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:07:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:36 smithi194 ceph-mon[33679]: pgmap v2579: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.0 KiB/s wr, 8 op/s 2024-05-08T08:07:36.977 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:07:38.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:38 smithi194 ceph-mon[33679]: pgmap v2580: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:07:38.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:38 smithi070 ceph-mon[29591]: pgmap v2580: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:07:38.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:38 smithi172 ceph-mon[33377]: pgmap v2580: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:07:39.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.395+0000 7f4b42e00700 1 -- 172.21.15.70:0/3541428479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 msgr2=0x7f4b3c116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:39.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.395+0000 7f4b42e00700 1 --2- 172.21.15.70:0/3541428479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 0x7f4b3c116a60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400b0a0 tx=0x7f4b3400b3b0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.396+0000 7f4b42e00700 1 -- 172.21.15.70:0/3541428479 shutdown_connections 2024-05-08T08:07:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.396+0000 7f4b42e00700 1 --2- 172.21.15.70:0/3541428479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 0x7f4b3c116a60 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.396+0000 7f4b42e00700 1 --2- 172.21.15.70:0/3541428479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3c0756d0 0x7f4b3c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.396+0000 7f4b42e00700 1 --2- 172.21.15.70:0/3541428479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b3c075ff0 0x7f4b3c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.396+0000 7f4b42e00700 1 -- 172.21.15.70:0/3541428479 >> 172.21.15.70:0/3541428479 conn(0x7f4b3c07a600 msgr2=0x7f4b3c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.396+0000 7f4b42e00700 1 -- 172.21.15.70:0/3541428479 shutdown_connections 2024-05-08T08:07:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.396+0000 7f4b42e00700 1 -- 172.21.15.70:0/3541428479 wait complete. 2024-05-08T08:07:39.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.397+0000 7f4b42e00700 1 Processor -- start 2024-05-08T08:07:39.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.397+0000 7f4b42e00700 1 -- start start 2024-05-08T08:07:39.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.397+0000 7f4b42e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b3c0756d0 0x7f4b3c19ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:39.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.397+0000 7f4b42e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3c075ff0 0x7f4b3c1a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:39.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.397+0000 7f4b42e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 0x7f4b3c1a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:39.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.397+0000 7f4b42e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c119af0 con 0x7f4b3c114670 2024-05-08T08:07:39.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.397+0000 7f4b42e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c119970 con 0x7f4b3c0756d0 2024-05-08T08:07:39.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.397+0000 7f4b42e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3c119c70 con 0x7f4b3c075ff0 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b40e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 0x7f4b3c1a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b40e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 0x7f4b3c1a47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40198/0 (socket says 172.21.15.70:40198) 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b40e00700 1 -- 172.21.15.70:0/1896314337 learned_addr learned my addr 172.21.15.70:0/1896314337 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b3be00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b3c0756d0 0x7f4b3c19ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b33400700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3c075ff0 0x7f4b3c1a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b40e00700 1 -- 172.21.15.70:0/1896314337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3c075ff0 msgr2=0x7f4b3c1a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b40e00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3c075ff0 0x7f4b3c1a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b40e00700 1 -- 172.21.15.70:0/1896314337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b3c0756d0 msgr2=0x7f4b3c19ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b40e00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b3c0756d0 0x7f4b3c19ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b40e00700 1 -- 172.21.15.70:0/1896314337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3c1a4f10 con 0x7f4b3c114670 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.398+0000 7f4b40e00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 0x7f4b3c1a47d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f4b340062a0 tx=0x7f4b34004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.399+0000 7f4b39600700 1 -- 172.21.15.70:0/1896314337 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34021070 con 0x7f4b3c114670 2024-05-08T08:07:39.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.399+0000 7f4b39600700 1 -- 172.21.15.70:0/1896314337 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b34007d00 con 0x7f4b3c114670 2024-05-08T08:07:39.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.399+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b3c1a51a0 con 0x7f4b3c114670 2024-05-08T08:07:39.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.399+0000 7f4b39600700 1 -- 172.21.15.70:0/1896314337 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34005280 con 0x7f4b3c114670 2024-05-08T08:07:39.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.399+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b3c1aca80 con 0x7f4b3c114670 2024-05-08T08:07:39.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.400+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3c076dc0 con 0x7f4b3c114670 2024-05-08T08:07:39.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.402+0000 7f4b39600700 1 -- 172.21.15.70:0/1896314337 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4b34024070 con 0x7f4b3c114670 2024-05-08T08:07:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.404+0000 7f4b39600700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b200b29f0 0x7f4b200b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.404+0000 7f4b39600700 1 -- 172.21.15.70:0/1896314337 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(239..239 src has 1..239) ==== 9583+0+0 (secure 0 0 0) 0x7f4b3400f020 con 0x7f4b3c114670 2024-05-08T08:07:39.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.404+0000 7f4b3be00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b200b29f0 0x7f4b200b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:39.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.405+0000 7f4b3be00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b200b29f0 0x7f4b200b4eb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c005ea0 tx=0x7f4b2c005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:07:39.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.409+0000 7f4b39600700 1 -- 172.21.15.70:0/1896314337 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4b3402b020 con 0x7f4b3c114670 2024-05-08T08:07:39.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.694+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b3c1acc50 con 0x7f4b3c114670 2024-05-08T08:07:39.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.695+0000 7f4b39600700 1 -- 172.21.15.70:0/1896314337 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f4b340074e0 con 0x7f4b3c114670 2024-05-08T08:07:39.689 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:07:39.690 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b200b29f0 msgr2=0x7f4b200b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b200b29f0 0x7f4b200b4eb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c005ea0 tx=0x7f4b2c005e30 comp rx=0 tx=0).stop 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 msgr2=0x7f4b3c1a47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 0x7f4b3c1a47d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f4b340062a0 tx=0x7f4b34004ed0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 shutdown_connections 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b200b29f0 0x7f4b200b4eb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b3c114670 0x7f4b3c1a47d0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b3c0756d0 0x7f4b3c19ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 --2- 172.21.15.70:0/1896314337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b3c075ff0 0x7f4b3c1a0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.698+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 >> 172.21.15.70:0/1896314337 conn(0x7f4b3c07a600 msgr2=0x7f4b3c113430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:39.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.699+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 shutdown_connections 2024-05-08T08:07:39.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:39.699+0000 7f4b42e00700 1 -- 172.21.15.70:0/1896314337 wait complete. 2024-05-08T08:07:39.694 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:07:40.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:40 smithi070 ceph-mon[29591]: pgmap v2581: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:07:40.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:40 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1896314337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:07:40.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:40 smithi172 ceph-mon[33377]: pgmap v2581: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:07:40.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:40 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1896314337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:07:40.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:40 smithi194 ceph-mon[33679]: pgmap v2581: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T08:07:40.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:40 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1896314337' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:07:40.563 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 47edde8b --release --await' 2024-05-08T08:07:40.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 47edde8b --release --await 2024-05-08T08:07:41.011 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:07:42.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:42 smithi070 ceph-mon[29591]: pgmap v2582: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:07:42.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:42 smithi172 ceph-mon[33377]: pgmap v2582: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:07:42.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:42 smithi194 ceph-mon[33679]: pgmap v2582: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:07:43.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.477+0000 7f65bbe00700 1 -- 172.21.15.70:0/1716536846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc102580 msgr2=0x7f65bc102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.477+0000 7f65bbe00700 1 --2- 172.21.15.70:0/1716536846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc102580 0x7f65bc102960 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f65ac0099c0 tx=0x7f65ac009cd0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.477+0000 7f65bbe00700 1 -- 172.21.15.70:0/1716536846 shutdown_connections 2024-05-08T08:07:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.477+0000 7f65bbe00700 1 --2- 172.21.15.70:0/1716536846 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65bc107660 0x7f65bc10f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.477+0000 7f65bbe00700 1 --2- 172.21.15.70:0/1716536846 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc102580 0x7f65bc102960 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.477+0000 7f65bbe00700 1 --2- 172.21.15.70:0/1716536846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc102f30 0x7f65bc106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.477+0000 7f65bbe00700 1 -- 172.21.15.70:0/1716536846 >> 172.21.15.70:0/1716536846 conn(0x7f65bc0fde30 msgr2=0x7f65bc100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:43.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.478+0000 7f65bbe00700 1 -- 172.21.15.70:0/1716536846 shutdown_connections 2024-05-08T08:07:43.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.478+0000 7f65bbe00700 1 -- 172.21.15.70:0/1716536846 wait complete. 2024-05-08T08:07:43.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.479+0000 7f65bbe00700 1 Processor -- start 2024-05-08T08:07:43.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.479+0000 7f65bbe00700 1 -- start start 2024-05-08T08:07:43.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65bbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65bc102580 0x7f65bc1a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65bbe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc102f30 0x7f65bc1a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc107660 0x7f65bc19ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65bbe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1123c0 con 0x7f65bc107660 2024-05-08T08:07:43.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65bbe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc112240 con 0x7f65bc102580 2024-05-08T08:07:43.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65bbe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc112540 con 0x7f65bc102f30 2024-05-08T08:07:43.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65bb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc107660 0x7f65bc19ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65bb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc107660 0x7f65bc19ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40204/0 (socket says 172.21.15.70:40204) 2024-05-08T08:07:43.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65bb400700 1 -- 172.21.15.70:0/2298377640 learned_addr learned my addr 172.21.15.70:0/2298377640 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:07:43.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65ba000700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc102f30 0x7f65bc1a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.480+0000 7f65baa00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65bc102580 0x7f65bc1a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.481+0000 7f65bb400700 1 -- 172.21.15.70:0/2298377640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc102f30 msgr2=0x7f65bc1a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:43.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.481+0000 7f65bb400700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc102f30 0x7f65bc1a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.481+0000 7f65bb400700 1 -- 172.21.15.70:0/2298377640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65bc102580 msgr2=0x7f65bc1a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:43.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.481+0000 7f65bb400700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65bc102580 0x7f65bc1a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.481+0000 7f65bb400700 1 -- 172.21.15.70:0/2298377640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65bc19c1c0 con 0x7f65bc107660 2024-05-08T08:07:43.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.481+0000 7f65baa00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65bc102580 0x7f65bc1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:07:43.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.481+0000 7f65bb400700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc107660 0x7f65bc19ba60 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f65b400ada0 tx=0x7f65b400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:07:43.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.482+0000 7f65b3400700 1 -- 172.21.15.70:0/2298377640 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4017020 con 0x7f65bc107660 2024-05-08T08:07:43.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.482+0000 7f65b3400700 1 -- 172.21.15.70:0/2298377640 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65b400ce10 con 0x7f65bc107660 2024-05-08T08:07:43.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.482+0000 7f65bbe00700 1 -- 172.21.15.70:0/2298377640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65bc19c4b0 con 0x7f65bc107660 2024-05-08T08:07:43.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.482+0000 7f65b3400700 1 -- 172.21.15.70:0/2298377640 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b4005280 con 0x7f65bc107660 2024-05-08T08:07:43.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.482+0000 7f65bbe00700 1 -- 172.21.15.70:0/2298377640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65bc1a8770 con 0x7f65bc107660 2024-05-08T08:07:43.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.485+0000 7f65b3400700 1 -- 172.21.15.70:0/2298377640 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f65b400c980 con 0x7f65bc107660 2024-05-08T08:07:43.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.487+0000 7f65b3400700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65a00b2a70 0x7f65a00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.487+0000 7f65b3400700 1 -- 172.21.15.70:0/2298377640 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(239..239 src has 1..239) ==== 9583+0+0 (secure 0 0 0) 0x7f65b40e1f60 con 0x7f65bc107660 2024-05-08T08:07:43.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.487+0000 7f65baa00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65a00b2a70 0x7f65a00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.488+0000 7f65baa00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65a00b2a70 0x7f65a00b4f30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009990 tx=0x7f65ac01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:07:43.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.500+0000 7f65cbf17b80 1 Processor -- start 2024-05-08T08:07:43.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.501+0000 7f65cbf17b80 1 -- start start 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.501+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd2d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.501+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2d880 0x55bf1cd27490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.501+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd27f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.501+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bf1cc79b20 con 0x55bf1cd2d880 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.501+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf1cc17860 con 0x55bf1cd2cf60 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.501+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bf1cc75ae0 con 0x55bf1cd27ab0 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65ba000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2d880 0x55bf1cd27490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65ba000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2d880 0x55bf1cd27490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40206/0 (socket says 172.21.15.70:40206) 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65ba000700 1 -- 172.21.15.70:0/3255224302 learned_addr learned my addr 172.21.15.70:0/3255224302 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:07:43.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65baa00700 1 --2- 172.21.15.70:0/3255224302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd2d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65bb400700 1 --2- 172.21.15.70:0/3255224302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd27f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65ba000700 1 -- 172.21.15.70:0/3255224302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 msgr2=0x55bf1cd27f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:07:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65ba000700 1 --2- 172.21.15.70:0/3255224302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd27f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65ba000700 1 -- 172.21.15.70:0/3255224302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 msgr2=0x55bf1cd2d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:07:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65ba000700 1 --2- 172.21.15.70:0/3255224302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd2d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65ba000700 1 -- 172.21.15.70:0/3255224302 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1cbc69d0 con 0x55bf1cd2d880 2024-05-08T08:07:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.502+0000 7f65ba000700 1 --2- 172.21.15.70:0/3255224302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2d880 0x55bf1cd27490 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f65a80046c0 tx=0x7f65a800b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06d8bea2e468583 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:07:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.503+0000 7f65a7e00700 1 -- 172.21.15.70:0/3255224302 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8004a30 con 0x55bf1cd2d880 2024-05-08T08:07:43.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.503+0000 7f65a7e00700 1 -- 172.21.15.70:0/3255224302 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65a8015070 con 0x55bf1cd2d880 2024-05-08T08:07:43.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.503+0000 7f65a7e00700 1 -- 172.21.15.70:0/3255224302 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8003aa0 con 0x55bf1cd2d880 2024-05-08T08:07:43.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.504+0000 7f65cbf17b80 1 -- 172.21.15.70:0/3255224302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2d880 msgr2=0x55bf1cd27490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:43.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.504+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/3255224302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2d880 0x55bf1cd27490 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f65a80046c0 tx=0x7f65a800b9e0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.504+0000 7f65cbf17b80 1 -- 172.21.15.70:0/3255224302 shutdown_connections 2024-05-08T08:07:43.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.504+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/3255224302 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd27f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.504+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/3255224302 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd2d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.504+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/3255224302 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2d880 0x55bf1cd27490 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.504+0000 7f65cbf17b80 1 -- 172.21.15.70:0/3255224302 >> 172.21.15.70:0/3255224302 conn(0x55bf1cc55c60 msgr2=0x55bf1cd21ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.504+0000 7f65cbf17b80 1 -- 172.21.15.70:0/3255224302 shutdown_connections 2024-05-08T08:07:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.504+0000 7f65cbf17b80 1 -- 172.21.15.70:0/3255224302 wait complete. 2024-05-08T08:07:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.505+0000 7f65cbf17b80 1 -- start start 2024-05-08T08:07:43.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.505+0000 7f65cbf17b80 1 Processor -- start 2024-05-08T08:07:43.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd335f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd30a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 0x55bf1cd30f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bf1cd343a0 con 0x55bf1cd27ab0 2024-05-08T08:07:43.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bf1cbdfc20 con 0x55bf1cd2cf60 2024-05-08T08:07:43.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bf1cd34520 con 0x55bf1cd2d880 2024-05-08T08:07:43.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65cbf17b80 10 client.0 _ll_register_callbacks cb 0x55bf1cc20d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:07:43.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65baa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65baa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd335f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40222/0 (socket says 172.21.15.70:40222) 2024-05-08T08:07:43.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65baa00700 1 -- 172.21.15.70:0/2139280717 learned_addr learned my addr 172.21.15.70:0/2139280717 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:07:43.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65ba000700 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd30a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.506+0000 7f65bb400700 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 0x55bf1cd30f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65baa00700 1 -- 172.21.15.70:0/2139280717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 msgr2=0x55bf1cd30f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65baa00700 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 0x55bf1cd30f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65baa00700 1 -- 172.21.15.70:0/2139280717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 msgr2=0x55bf1cd30a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65baa00700 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd30a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65baa00700 1 -- 172.21.15.70:0/2139280717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1cc3f520 con 0x55bf1cd27ab0 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65ba000700 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd30a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65baa00700 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd335f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005b40 tx=0x7f65ac009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba25cd2026e7b907 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65a4c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65a4c00700 1 -- 172.21.15.70:0/2139280717 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac023820 con 0x55bf1cd27ab0 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65a4c00700 1 -- 172.21.15.70:0/2139280717 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(239..239 src has 1..239) ==== 9583+0+0 (secure 0 0 0) 0x7f65ac0239c0 con 0x55bf1cd27ab0 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.507+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2139280717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65a8015070 con 0x55bf1cd27ab0 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.508+0000 7f65a4c00700 1 -- 172.21.15.70:0/2139280717 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f65ac03c050 con 0x55bf1cd27ab0 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.508+0000 7f65cbf17b80 10 client.17655 fetch_fsmap learned FSMap version 42 2024-05-08T08:07:43.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.508+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2139280717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bf1cd3ed40 con 0x55bf1cd27ab0 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.508+0000 7f65a4c00700 1 -- 172.21.15.70:0/2139280717 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65a8015070 con 0x55bf1cd27ab0 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.508+0000 7f65a4c00700 1 -- 172.21.15.70:0/2139280717 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f65ac02ea80 con 0x55bf1cd27ab0 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.508+0000 7f65cbf17b80 10 client.17655 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.508+0000 7f65cbf17b80 10 client.17655 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.508+0000 7f65cbf17b80 20 client.17655 populate_metadata read hostname 'smithi070' 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.509+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bf1cd413d0 0x55bf1cd43800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.509+0000 7f65cbf17b80 4 client.17655 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.509+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2139280717 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf1ccf41a0 con 0x55bf1cd413d0 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.509+0000 7f65ba000700 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bf1cd413d0 0x55bf1cd43800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.510+0000 7f65ba000700 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bf1cd413d0 0x55bf1cd43800 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1ecd8802142d8b2 server_cookie=8d33d936d9264b48 in_seq=0 out_seq=0 2024-05-08T08:07:43.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.510+0000 7f65a4c00700 10 client.17655 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:07:43.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.512+0000 7f65a4c00700 1 -- 172.21.15.70:0/2139280717 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bf1ccf41a0 con 0x55bf1cd413d0 2024-05-08T08:07:43.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.512+0000 7f65a4c00700 10 client.17655 handle_command_reply: tid=0 2024-05-08T08:07:43.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.512+0000 7f65cbf17b80 1 client.17655 shutdown 2024-05-08T08:07:43.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.512+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2139280717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd27ab0 msgr2=0x55bf1cd335f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:43.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.512+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd335f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f65ac005b40 tx=0x7f65ac009310 comp rx=0 tx=0).stop 2024-05-08T08:07:43.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.512+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2139280717 shutdown_connections 2024-05-08T08:07:43.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.512+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bf1cd413d0 0x55bf1cd43800 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.512+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 0x55bf1cd30f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.513+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd335f0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.513+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2139280717 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd30a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.513+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2139280717 >> 172.21.15.70:0/2139280717 conn(0x55bf1cc55c60 msgr2=0x55bf1cd26480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:43.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.513+0000 7f65a4c00700 0 client.17655 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:07:43.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.513+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2139280717 shutdown_connections 2024-05-08T08:07:43.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.513+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2139280717 wait complete. 2024-05-08T08:07:43.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.513+0000 7f65cbf17b80 20 client.17655 trim_cache size 0 max 16384 2024-05-08T08:07:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.534+0000 7f65cbf17b80 1 Processor -- start 2024-05-08T08:07:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.534+0000 7f65cbf17b80 1 -- start start 2024-05-08T08:07:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.535+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd3d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.535+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd490d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.535+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2d880 0x55bf1cd49610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.535+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1b3de0 con 0x55bf1cd2cf60 2024-05-08T08:07:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.535+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1b1670 con 0x55bf1cd2d880 2024-05-08T08:07:43.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.535+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1af4e0 con 0x55bf1cd27ab0 2024-05-08T08:07:43.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.535+0000 7f65ba000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.535+0000 7f65ba000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd490d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40230/0 (socket says 172.21.15.70:40230) 2024-05-08T08:07:43.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.535+0000 7f65ba000700 1 -- 172.21.15.70:0/2507382008 learned_addr learned my addr 172.21.15.70:0/2507382008 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:07:43.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.536+0000 7f65baa00700 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd3d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.536+0000 7f65bb400700 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2d880 0x55bf1cd49610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.536+0000 7f65ba000700 1 -- 172.21.15.70:0/2507382008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 msgr2=0x55bf1cd3d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:07:43.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.536+0000 7f65ba000700 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd3d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.536+0000 7f65ba000700 1 -- 172.21.15.70:0/2507382008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2d880 msgr2=0x55bf1cd49610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:07:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.536+0000 7f65ba000700 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2d880 0x55bf1cd49610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.536+0000 7f65ba000700 1 -- 172.21.15.70:0/2507382008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf1cd23a40 con 0x55bf1cd2cf60 2024-05-08T08:07:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.536+0000 7f65bb400700 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2d880 0x55bf1cd49610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:07:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.536+0000 7f65ba000700 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd490d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f65a8004690 tx=0x7f65a8005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b78f80bd7e8427d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:07:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.537+0000 7f65a7400700 1 -- 172.21.15.70:0/2507382008 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a802e070 con 0x55bf1cd2cf60 2024-05-08T08:07:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.537+0000 7f65a7400700 1 -- 172.21.15.70:0/2507382008 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65a8015030 con 0x55bf1cd2cf60 2024-05-08T08:07:43.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.537+0000 7f65a7400700 1 -- 172.21.15.70:0/2507382008 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a80039e0 con 0x55bf1cd2cf60 2024-05-08T08:07:43.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.537+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2507382008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 msgr2=0x55bf1cd490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:43.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.537+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd490d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f65a8004690 tx=0x7f65a8005d00 comp rx=0 tx=0).stop 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.538+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2507382008 shutdown_connections 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.538+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd2d880 0x55bf1cd49610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.538+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd3d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.538+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/2507382008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd490d0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.538+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2507382008 >> 172.21.15.70:0/2507382008 conn(0x55bf1cc55c60 msgr2=0x55bf1cd2f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.538+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2507382008 shutdown_connections 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.538+0000 7f65cbf17b80 1 -- 172.21.15.70:0/2507382008 wait complete. 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.538+0000 7f65cbf17b80 1 -- start start 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.538+0000 7f65cbf17b80 1 Processor -- start 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd39af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd367e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65cbf17b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 0x55bf1cd36d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1afb30 con 0x55bf1cd2cf60 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1b0fa0 con 0x55bf1cd27ab0 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65cbf17b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65bc1b0200 con 0x55bf1cd2d880 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65cbf17b80 10 client.0 _ll_register_callbacks cb 0x55bf1cc20d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65ba000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65ba000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd367e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40238/0 (socket says 172.21.15.70:40238) 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.539+0000 7f65ba000700 1 -- 172.21.15.70:0/998185113 learned_addr learned my addr 172.21.15.70:0/998185113 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.540+0000 7f65baa00700 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd39af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.540+0000 7f65bb400700 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 0x55bf1cd36d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.540+0000 7f65ba000700 1 -- 172.21.15.70:0/998185113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 msgr2=0x55bf1cd36d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:07:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.540+0000 7f65ba000700 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 0x55bf1cd36d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.540+0000 7f65ba000700 1 -- 172.21.15.70:0/998185113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd27ab0 msgr2=0x55bf1cd39af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:07:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.540+0000 7f65ba000700 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd39af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.540+0000 7f65ba000700 1 -- 172.21.15.70:0/998185113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf1cd37310 con 0x55bf1cd2cf60 2024-05-08T08:07:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.540+0000 7f65ba000700 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd367e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f65a802c040 tx=0x7f65a80046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e26c8c50ff480c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:07:43.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.540+0000 7f65a4c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:07:43.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.541+0000 7f65a4c00700 1 -- 172.21.15.70:0/998185113 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a802e040 con 0x55bf1cd2cf60 2024-05-08T08:07:43.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.541+0000 7f65cbf17b80 1 -- 172.21.15.70:0/998185113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65a8015030 con 0x55bf1cd2cf60 2024-05-08T08:07:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.541+0000 7f65a4c00700 1 -- 172.21.15.70:0/998185113 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(239..239 src has 1..239) ==== 9583+0+0 (secure 0 0 0) 0x7f65a8004e60 con 0x55bf1cd2cf60 2024-05-08T08:07:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.541+0000 7f65a4c00700 1 -- 172.21.15.70:0/998185113 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f65a8005060 con 0x55bf1cd2cf60 2024-05-08T08:07:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.541+0000 7f65cbf17b80 10 client.17661 fetch_fsmap learned FSMap version 42 2024-05-08T08:07:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.541+0000 7f65cbf17b80 1 -- 172.21.15.70:0/998185113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bf1cdacad0 con 0x55bf1cd2cf60 2024-05-08T08:07:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.542+0000 7f65a4c00700 1 -- 172.21.15.70:0/998185113 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65a8015030 con 0x55bf1cd2cf60 2024-05-08T08:07:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.542+0000 7f65a4c00700 1 -- 172.21.15.70:0/998185113 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f65a8032460 con 0x55bf1cd2cf60 2024-05-08T08:07:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.542+0000 7f65cbf17b80 10 client.17661 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:07:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.542+0000 7f65cbf17b80 10 client.17661 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:07:43.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.542+0000 7f65cbf17b80 20 client.17661 populate_metadata read hostname 'smithi070' 2024-05-08T08:07:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.542+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bf1cdad0b0 0x55bf1cdaf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:07:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.542+0000 7f65cbf17b80 4 client.17661 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "47edde8b", "release": true, "await": true}] 2024-05-08T08:07:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.542+0000 7f65cbf17b80 1 -- 172.21.15.70:0/998185113 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "47edde8b", "release": true, "await": true}) -- 0x55bf1cc87500 con 0x55bf1cdad0b0 2024-05-08T08:07:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.543+0000 7f65baa00700 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bf1cdad0b0 0x55bf1cdaf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:07:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.544+0000 7f65baa00700 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bf1cdad0b0 0x55bf1cdaf4d0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93d696508af507f5 server_cookie=ee0a04ddef66c87a in_seq=0 out_seq=0 2024-05-08T08:07:43.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:43.544+0000 7f65a4c00700 10 client.17661 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:07:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:44 smithi070 ceph-mon[29591]: pgmap v2583: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:07:44.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:44 smithi172 ceph-mon[33377]: pgmap v2583: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:07:44.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:44 smithi194 ceph-mon[33679]: pgmap v2583: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:07:46.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:46 smithi070 ceph-mon[29591]: pgmap v2584: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:07:46.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:46 smithi172 ceph-mon[33377]: pgmap v2584: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:07:46.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:46 smithi194 ceph-mon[33679]: pgmap v2584: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:07:48.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.128+0000 7f65a4c00700 1 -- 172.21.15.70:0/998185113 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55bf1cc87500 con 0x55bf1cdad0b0 2024-05-08T08:07:48.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.129+0000 7f65a4c00700 10 client.17661 handle_command_reply: tid=0 2024-05-08T08:07:48.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.129+0000 7f65cbf17b80 1 client.17661 shutdown 2024-05-08T08:07:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.129+0000 7f65cbf17b80 1 -- 172.21.15.70:0/998185113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 msgr2=0x55bf1cd367e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.129+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd367e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f65a802c040 tx=0x7f65a80046f0 comp rx=0 tx=0).stop 2024-05-08T08:07:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65cbf17b80 1 -- 172.21.15.70:0/998185113 shutdown_connections 2024-05-08T08:07:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bf1cdad0b0 0x55bf1cdaf4d0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bf1cd2d880 0x55bf1cd36d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bf1cd27ab0 0x55bf1cd39af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65cbf17b80 1 --2- 172.21.15.70:0/998185113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bf1cd2cf60 0x55bf1cd367e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65cbf17b80 1 -- 172.21.15.70:0/998185113 >> 172.21.15.70:0/998185113 conn(0x55bf1cc55c60 msgr2=0x55bf1cd2c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:48.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65a4c00700 0 client.17661 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:07:48.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65cbf17b80 1 -- 172.21.15.70:0/998185113 shutdown_connections 2024-05-08T08:07:48.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65cbf17b80 1 -- 172.21.15.70:0/998185113 wait complete. 2024-05-08T08:07:48.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.130+0000 7f65cbf17b80 20 client.17661 trim_cache size 0 max 16384 2024-05-08T08:07:48.125 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 192, 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "47edde8b": { 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 192, 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.1, 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:07:48.126 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 84.5, 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:07:48.127 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:07:48.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 -- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65a00b2a70 msgr2=0x7f65a00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:48.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65a00b2a70 0x7f65a00b4f30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009990 tx=0x7f65ac01a040 comp rx=0 tx=0).stop 2024-05-08T08:07:48.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 -- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc107660 msgr2=0x7f65bc19ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:07:48.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc107660 0x7f65bc19ba60 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f65b400ada0 tx=0x7f65b400c330 comp rx=0 tx=0).stop 2024-05-08T08:07:48.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 -- 172.21.15.70:0/2298377640 shutdown_connections 2024-05-08T08:07:48.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f65a00b2a70 0x7f65a00b4f30 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:48.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65bc107660 0x7f65bc19ba60 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:48.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f65bc102580 0x7f65bc1a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:48.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 --2- 172.21.15.70:0/2298377640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc102f30 0x7f65bc1a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:07:48.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 -- 172.21.15.70:0/2298377640 >> 172.21.15.70:0/2298377640 conn(0x7f65bc0fde30 msgr2=0x7f65bc0ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:07:48.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 -- 172.21.15.70:0/2298377640 shutdown_connections 2024-05-08T08:07:48.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:07:48.132+0000 7f65bbe00700 1 -- 172.21.15.70:0/2298377640 wait complete. 2024-05-08T08:07:48.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:48 smithi070 ceph-mon[29591]: pgmap v2585: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:07:48.401 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/quirks.o 2024-05-08T08:07:48.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:48 smithi172 ceph-mon[33377]: pgmap v2585: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:07:48.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:48 smithi194 ceph-mon[33679]: pgmap v2585: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:07:49.046 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '47edde8b', seconds elapsed: 71.4 2024-05-08T08:07:49.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:49 smithi070 ceph-mon[29591]: pgmap v2586: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-05-08T08:07:49.382 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/ksysfs.o 2024-05-08T08:07:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:49 smithi172 ceph-mon[33377]: pgmap v2586: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-05-08T08:07:49.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:49 smithi194 ceph-mon[33679]: pgmap v2586: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 5.0 KiB/s wr, 5 op/s 2024-05-08T08:07:50.256 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/dump_stack.o 2024-05-08T08:07:50.693 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/pcm_memory.o 2024-05-08T08:07:50.711 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/memalloc.o 2024-05-08T08:07:51.423 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/cpuid.o 2024-05-08T08:07:51.738 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/utils.o 2024-05-08T08:07:51.823 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/io.o 2024-05-08T08:07:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:52 smithi070 ceph-mon[29591]: pgmap v2587: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 115 KiB/s wr, 13 op/s 2024-05-08T08:07:52.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:52 smithi172 ceph-mon[33377]: pgmap v2587: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 115 KiB/s wr, 13 op/s 2024-05-08T08:07:52.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:52 smithi194 ceph-mon[33679]: pgmap v2587: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 115 KiB/s wr, 13 op/s 2024-05-08T08:07:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:54 smithi070 ceph-mon[29591]: pgmap v2588: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 115 KiB/s wr, 11 op/s 2024-05-08T08:07:54.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:54 smithi172 ceph-mon[33377]: pgmap v2588: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 115 KiB/s wr, 11 op/s 2024-05-08T08:07:54.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:54 smithi194 ceph-mon[33679]: pgmap v2588: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 115 KiB/s wr, 11 op/s 2024-05-08T08:07:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:56 smithi070 ceph-mon[29591]: pgmap v2589: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 320 KiB/s wr, 24 op/s 2024-05-08T08:07:56.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:56 smithi172 ceph-mon[33377]: pgmap v2589: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 320 KiB/s wr, 24 op/s 2024-05-08T08:07:56.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:56 smithi194 ceph-mon[33679]: pgmap v2589: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 320 KiB/s wr, 24 op/s 2024-05-08T08:07:58.175 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/cred.o 2024-05-08T08:07:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:07:58 smithi070 ceph-mon[29591]: pgmap v2590: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 320 KiB/s wr, 21 op/s 2024-05-08T08:07:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:07:58 smithi172 ceph-mon[33377]: pgmap v2590: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 320 KiB/s wr, 21 op/s 2024-05-08T08:07:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:07:58 smithi194 ceph-mon[33679]: pgmap v2590: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 320 KiB/s wr, 21 op/s 2024-05-08T08:07:59.241 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/direct.o 2024-05-08T08:07:59.447 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/pcm_timer.o 2024-05-08T08:07:59.484 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/earlycpio.o 2024-05-08T08:07:59.673 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/early-quirks.o 2024-05-08T08:07:59.923 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/ats.o 2024-05-08T08:08:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:00 smithi070 ceph-mon[29591]: pgmap v2591: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 322 KiB/s wr, 23 op/s 2024-05-08T08:08:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:00 smithi172 ceph-mon[33377]: pgmap v2591: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 322 KiB/s wr, 23 op/s 2024-05-08T08:08:00.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:00 smithi194 ceph-mon[33679]: pgmap v2591: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 322 KiB/s wr, 23 op/s 2024-05-08T08:08:02.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:02 smithi070 ceph-mon[29591]: pgmap v2592: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 551 KiB/s wr, 32 op/s 2024-05-08T08:08:02.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:02 smithi172 ceph-mon[33377]: pgmap v2592: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 551 KiB/s wr, 32 op/s 2024-05-08T08:08:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:02 smithi194 ceph-mon[33679]: pgmap v2592: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 551 KiB/s wr, 32 op/s 2024-05-08T08:08:02.916 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/extable.o 2024-05-08T08:08:04.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:04 smithi070 ceph-mon[29591]: pgmap v2593: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 441 KiB/s wr, 24 op/s 2024-05-08T08:08:04.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:04 smithi172 ceph-mon[33377]: pgmap v2593: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 441 KiB/s wr, 24 op/s 2024-05-08T08:08:04.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:04 smithi194 ceph-mon[33679]: pgmap v2593: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 441 KiB/s wr, 24 op/s 2024-05-08T08:08:04.804 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/link_watch.o 2024-05-08T08:08:04.972 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/reboot.o 2024-05-08T08:08:05.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:05 smithi070 ceph-mon[29591]: osdmap e240: 12 total, 12 up, 12 in 2024-05-08T08:08:05.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:05 smithi172 ceph-mon[33377]: osdmap e240: 12 total, 12 up, 12 in 2024-05-08T08:08:05.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:05 smithi194 ceph-mon[33679]: osdmap e240: 12 total, 12 up, 12 in 2024-05-08T08:08:06.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:06 smithi070 ceph-mon[29591]: pgmap v2595: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 565 KiB/s wr, 47 op/s 2024-05-08T08:08:06.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:06 smithi172 ceph-mon[33377]: pgmap v2595: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 565 KiB/s wr, 47 op/s 2024-05-08T08:08:06.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:06 smithi194 ceph-mon[33679]: pgmap v2595: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 565 KiB/s wr, 47 op/s 2024-05-08T08:08:07.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:07 smithi070 ceph-mon[29591]: pgmap v2596: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 565 KiB/s wr, 47 op/s 2024-05-08T08:08:07.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:07 smithi172 ceph-mon[33377]: pgmap v2596: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 565 KiB/s wr, 47 op/s 2024-05-08T08:08:07.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:07 smithi194 ceph-mon[33679]: pgmap v2596: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 565 KiB/s wr, 47 op/s 2024-05-08T08:08:08.450 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/core/seq_device.o 2024-05-08T08:08:09.302 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/pagelist.o 2024-05-08T08:08:09.421 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/pci-label.o 2024-05-08T08:08:09.472 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/flex_proportions.o 2024-05-08T08:08:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:10 smithi070 ceph-mon[29591]: pgmap v2597: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 565 KiB/s wr, 47 op/s 2024-05-08T08:08:10.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:10 smithi172 ceph-mon[33377]: pgmap v2597: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 565 KiB/s wr, 47 op/s 2024-05-08T08:08:10.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:10 smithi194 ceph-mon[33679]: pgmap v2597: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 565 KiB/s wr, 47 op/s 2024-05-08T08:08:10.681 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/smp.o 2024-05-08T08:08:12.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:12 smithi070 ceph-mon[29591]: pgmap v2598: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 585 KiB/s wr, 48 op/s 2024-05-08T08:08:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:12 smithi172 ceph-mon[33377]: pgmap v2598: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 585 KiB/s wr, 48 op/s 2024-05-08T08:08:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:12 smithi194 ceph-mon[33679]: pgmap v2598: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 585 KiB/s wr, 48 op/s 2024-05-08T08:08:13.314 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/exportfs/expfs.o 2024-05-08T08:08:14.240 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/idr.o 2024-05-08T08:08:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:14 smithi070 ceph-mon[29591]: pgmap v2599: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 585 KiB/s wr, 48 op/s 2024-05-08T08:08:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:14 smithi070 ceph-mon[29591]: osdmap e241: 12 total, 12 up, 12 in 2024-05-08T08:08:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:14 smithi172 ceph-mon[33377]: pgmap v2599: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 585 KiB/s wr, 48 op/s 2024-05-08T08:08:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:14 smithi172 ceph-mon[33377]: osdmap e241: 12 total, 12 up, 12 in 2024-05-08T08:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:14 smithi194 ceph-mon[33679]: pgmap v2599: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 585 KiB/s wr, 48 op/s 2024-05-08T08:08:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:14 smithi194 ceph-mon[33679]: osdmap e241: 12 total, 12 up, 12 in 2024-05-08T08:08:15.475 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/async.o 2024-05-08T08:08:16.360 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/filter.o 2024-05-08T08:08:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:16 smithi070 ceph-mon[29591]: pgmap v2601: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 570 KiB/s wr, 37 op/s 2024-05-08T08:08:16.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:16 smithi172 ceph-mon[33377]: pgmap v2601: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 570 KiB/s wr, 37 op/s 2024-05-08T08:08:16.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:16 smithi194 ceph-mon[33679]: pgmap v2601: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 570 KiB/s wr, 37 op/s 2024-05-08T08:08:16.650 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/core/built-in.a 2024-05-08T08:08:18.367 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/drivers/opl3/built-in.a 2024-05-08T08:08:18.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:18 smithi070 ceph-mon[29591]: pgmap v2602: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 570 KiB/s wr, 37 op/s 2024-05-08T08:08:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:08:18.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:18 smithi172 ceph-mon[33377]: pgmap v2602: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 570 KiB/s wr, 37 op/s 2024-05-08T08:08:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:08:18.449 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pci/vgaarb.o 2024-05-08T08:08:18.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:18 smithi194 ceph-mon[33679]: pgmap v2602: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 570 KiB/s wr, 37 op/s 2024-05-08T08:08:18.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:08:18.619 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/drivers/opl4/built-in.a 2024-05-08T08:08:18.818 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/drivers/mpu401/built-in.a 2024-05-08T08:08:19.046 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/drivers/vx/built-in.a 2024-05-08T08:08:19.269 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/drivers/pcsp/built-in.a 2024-05-08T08:08:19.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:08:19.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:08:19.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:08:19.405 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/drivers/built-in.a 2024-05-08T08:08:19.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:08:19.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:08:19.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:08:19.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:08:19.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:08:19.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:08:19.699 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/ad1816a/built-in.a 2024-05-08T08:08:19.891 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/ad1848/built-in.a 2024-05-08T08:08:20.177 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/cs423x/built-in.a 2024-05-08T08:08:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:20 smithi070 ceph-mon[29591]: pgmap v2603: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 794 KiB/s wr, 38 op/s 2024-05-08T08:08:20.383 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/es1688/built-in.a 2024-05-08T08:08:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:20 smithi172 ceph-mon[33377]: pgmap v2603: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 794 KiB/s wr, 38 op/s 2024-05-08T08:08:20.484 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/irq_regs.o 2024-05-08T08:08:20.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:20 smithi194 ceph-mon[33679]: pgmap v2603: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 794 KiB/s wr, 38 op/s 2024-05-08T08:08:20.597 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/galaxy/built-in.a 2024-05-08T08:08:20.797 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/gus/built-in.a 2024-05-08T08:08:20.992 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/msnd/built-in.a 2024-05-08T08:08:21.213 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/opti9xx/built-in.a 2024-05-08T08:08:21.420 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/exportfs/built-in.a 2024-05-08T08:08:21.528 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/sb/built-in.a 2024-05-08T08:08:21.672 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/802/built-in.a 2024-05-08T08:08:21.701 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/wavefront/built-in.a 2024-05-08T08:08:21.781 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/smpboot.o 2024-05-08T08:08:21.794 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/sock_diag.o 2024-05-08T08:08:21.900 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/wss/built-in.a 2024-05-08T08:08:22.038 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/isa/built-in.a 2024-05-08T08:08:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:22 smithi070 ceph-mon[29591]: pgmap v2604: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 633 KiB/s wr, 39 op/s 2024-05-08T08:08:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:22 smithi172 ceph-mon[33377]: pgmap v2604: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 633 KiB/s wr, 39 op/s 2024-05-08T08:08:22.448 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/ac97/built-in.a 2024-05-08T08:08:22.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:22 smithi194 ceph-mon[33679]: pgmap v2604: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 633 KiB/s wr, 39 op/s 2024-05-08T08:08:22.926 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/range.o 2024-05-08T08:08:22.989 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/read.o 2024-05-08T08:08:23.024 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/ali5451/built-in.a 2024-05-08T08:08:23.281 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/asihpi/built-in.a 2024-05-08T08:08:23.456 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/au88x0/built-in.a 2024-05-08T08:08:23.636 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/aw2/built-in.a 2024-05-08T08:08:23.840 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/ctxfi/built-in.a 2024-05-08T08:08:24.034 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/ca0106/built-in.a 2024-05-08T08:08:24.254 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/cs46xx/built-in.a 2024-05-08T08:08:24.276 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/is_single_threaded.o 2024-05-08T08:08:24.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:24 smithi070 ceph-mon[29591]: pgmap v2605: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 633 KiB/s wr, 39 op/s 2024-05-08T08:08:24.410 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/smpboot.o 2024-05-08T08:08:24.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:24 smithi172 ceph-mon[33377]: pgmap v2605: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 633 KiB/s wr, 39 op/s 2024-05-08T08:08:24.445 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/cs5535audio/built-in.a 2024-05-08T08:08:24.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:24 smithi194 ceph-mon[33679]: pgmap v2605: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 633 KiB/s wr, 39 op/s 2024-05-08T08:08:24.614 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/lola/built-in.a 2024-05-08T08:08:24.802 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/lx6464es/built-in.a 2024-05-08T08:08:24.987 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/echoaudio/built-in.a 2024-05-08T08:08:25.178 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/emu10k1/built-in.a 2024-05-08T08:08:25.405 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/pci/hda/hda_bind.o 2024-05-08T08:08:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:26 smithi070 ceph-mon[29591]: pgmap v2606: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 989 KiB/s wr, 70 op/s 2024-05-08T08:08:26.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:26 smithi172 ceph-mon[33377]: pgmap v2606: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 989 KiB/s wr, 70 op/s 2024-05-08T08:08:26.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:26 smithi194 ceph-mon[33679]: pgmap v2606: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 989 KiB/s wr, 70 op/s 2024-05-08T08:08:28.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:28 smithi070 ceph-mon[29591]: pgmap v2607: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 688 KiB/s wr, 45 op/s 2024-05-08T08:08:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:28 smithi172 ceph-mon[33377]: pgmap v2607: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 688 KiB/s wr, 45 op/s 2024-05-08T08:08:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:28 smithi194 ceph-mon[33679]: pgmap v2607: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 688 KiB/s wr, 45 op/s 2024-05-08T08:08:28.852 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pci/built-in.a 2024-05-08T08:08:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:29 smithi070 ceph-mon[29591]: pgmap v2608: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 688 KiB/s wr, 46 op/s 2024-05-08T08:08:29.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:29 smithi172 ceph-mon[33377]: pgmap v2608: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 688 KiB/s wr, 46 op/s 2024-05-08T08:08:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:29 smithi194 ceph-mon[33679]: pgmap v2608: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 688 KiB/s wr, 46 op/s 2024-05-08T08:08:30.704 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/klist.o 2024-05-08T08:08:31.592 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/ucount.o 2024-05-08T08:08:32.108 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dsargs.o 2024-05-08T08:08:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:32 smithi070 ceph-mon[29591]: pgmap v2609: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 730 KiB/s wr, 61 op/s 2024-05-08T08:08:32.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:32 smithi172 ceph-mon[33377]: pgmap v2609: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 730 KiB/s wr, 61 op/s 2024-05-08T08:08:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:32 smithi194 ceph-mon[33679]: pgmap v2609: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 730 KiB/s wr, 61 op/s 2024-05-08T08:08:32.882 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/tsc_sync.o 2024-05-08T08:08:34.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:34 smithi070 ceph-mon[29591]: pgmap v2610: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 614 KiB/s wr, 50 op/s 2024-05-08T08:08:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:34 smithi172 ceph-mon[33377]: pgmap v2610: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 614 KiB/s wr, 50 op/s 2024-05-08T08:08:34.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:34 smithi194 ceph-mon[33679]: pgmap v2610: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 614 KiB/s wr, 50 op/s 2024-05-08T08:08:35.072 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/pci/hda/hda_codec.o 2024-05-08T08:08:35.293 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/ice1712/built-in.a 2024-05-08T08:08:35.660 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/pnpacpi/core.o 2024-05-08T08:08:35.751 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/dev_ioctl.o 2024-05-08T08:08:36.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:36 smithi070 ceph-mon[29591]: pgmap v2611: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 1.0 MiB/s wr, 72 op/s 2024-05-08T08:08:36.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:36 smithi172 ceph-mon[33377]: pgmap v2611: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 1.0 MiB/s wr, 72 op/s 2024-05-08T08:08:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:36 smithi194 ceph-mon[33679]: pgmap v2611: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 1.0 MiB/s wr, 72 op/s 2024-05-08T08:08:36.708 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/symlink.o 2024-05-08T08:08:38.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:38 smithi070 ceph-mon[29591]: pgmap v2612: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 671 KiB/s wr, 40 op/s 2024-05-08T08:08:38.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:38 smithi172 ceph-mon[33377]: pgmap v2612: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 671 KiB/s wr, 40 op/s 2024-05-08T08:08:38.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:38 smithi194 ceph-mon[33679]: pgmap v2612: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 671 KiB/s wr, 40 op/s 2024-05-08T08:08:40.307 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:40 smithi194 ceph-mon[33679]: pgmap v2613: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 706 KiB/s wr, 42 op/s 2024-05-08T08:08:40.352 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/kobject.o 2024-05-08T08:08:40.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:40 smithi070 ceph-mon[29591]: pgmap v2613: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 706 KiB/s wr, 42 op/s 2024-05-08T08:08:40.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:40 smithi172 ceph-mon[33377]: pgmap v2613: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 730 KiB/s rd, 706 KiB/s wr, 42 op/s 2024-05-08T08:08:40.554 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/regset.o 2024-05-08T08:08:40.651 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dscontrol.o 2024-05-08T08:08:40.757 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/setup_percpu.o 2024-05-08T08:08:42.359 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/pnpacpi/rsparser.o 2024-05-08T08:08:42.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:42 smithi070 ceph-mon[29591]: pgmap v2614: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 962 KiB/s wr, 60 op/s 2024-05-08T08:08:42.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:42 smithi172 ceph-mon[33377]: pgmap v2614: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 962 KiB/s wr, 60 op/s 2024-05-08T08:08:42.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:42 smithi194 ceph-mon[33679]: pgmap v2614: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 962 KiB/s wr, 60 op/s 2024-05-08T08:08:44.184 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/pci/hda/hda_jack.o 2024-05-08T08:08:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:44 smithi070 ceph-mon[29591]: pgmap v2615: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 731 KiB/s wr, 43 op/s 2024-05-08T08:08:44.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:44 smithi172 ceph-mon[33377]: pgmap v2615: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 731 KiB/s wr, 43 op/s 2024-05-08T08:08:44.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:44 smithi194 ceph-mon[33679]: pgmap v2615: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 731 KiB/s wr, 43 op/s 2024-05-08T08:08:46.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:46 smithi070 ceph-mon[29591]: pgmap v2616: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 930 KiB/s wr, 61 op/s 2024-05-08T08:08:46.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:46 smithi172 ceph-mon[33377]: pgmap v2616: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 930 KiB/s wr, 61 op/s 2024-05-08T08:08:46.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:46 smithi194 ceph-mon[33679]: pgmap v2616: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 895 KiB/s rd, 930 KiB/s wr, 61 op/s 2024-05-08T08:08:47.093 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dsdebug.o 2024-05-08T08:08:47.100 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/ksyms_common.o 2024-05-08T08:08:47.100 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/kobject_uevent.o 2024-05-08T08:08:47.298 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/tso.o 2024-05-08T08:08:48.163 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/unlink.o 2024-05-08T08:08:48.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:48 smithi070 ceph-mon[29591]: pgmap v2617: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 490 KiB/s wr, 39 op/s 2024-05-08T08:08:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:48 smithi172 ceph-mon[33377]: pgmap v2617: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 490 KiB/s wr, 39 op/s 2024-05-08T08:08:48.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:48 smithi194 ceph-mon[33679]: pgmap v2617: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 490 KiB/s wr, 39 op/s 2024-05-08T08:08:50.020 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/mpparse.o 2024-05-08T08:08:50.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:50 smithi070 ceph-mon[29591]: pgmap v2618: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 490 KiB/s wr, 40 op/s 2024-05-08T08:08:50.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:50 smithi172 ceph-mon[33377]: pgmap v2618: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 490 KiB/s wr, 40 op/s 2024-05-08T08:08:50.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:50 smithi194 ceph-mon[33679]: pgmap v2618: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 490 KiB/s wr, 40 op/s 2024-05-08T08:08:51.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:51 smithi070 ceph-mon[29591]: pgmap v2619: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 722 KiB/s wr, 49 op/s 2024-05-08T08:08:51.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:51 smithi172 ceph-mon[33377]: pgmap v2619: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 722 KiB/s wr, 49 op/s 2024-05-08T08:08:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:51 smithi194 ceph-mon[33679]: pgmap v2619: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 722 KiB/s wr, 49 op/s 2024-05-08T08:08:51.592 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pnp/pnpacpi/built-in.a 2024-05-08T08:08:51.857 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/core.o 2024-05-08T08:08:53.181 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dsfield.o 2024-05-08T08:08:53.249 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/pci/hda/hda_auto_parser.o 2024-05-08T08:08:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:54 smithi070 ceph-mon[29591]: pgmap v2620: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 465 KiB/s wr, 31 op/s 2024-05-08T08:08:54.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:54 smithi172 ceph-mon[33377]: pgmap v2620: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 465 KiB/s wr, 31 op/s 2024-05-08T08:08:54.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:54 smithi194 ceph-mon[33679]: pgmap v2620: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 465 KiB/s wr, 31 op/s 2024-05-08T08:08:54.930 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/groups.o 2024-05-08T08:08:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:56 smithi070 ceph-mon[29591]: pgmap v2621: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 673 KiB/s wr, 43 op/s 2024-05-08T08:08:56.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:56 smithi172 ceph-mon[33377]: pgmap v2621: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 673 KiB/s wr, 43 op/s 2024-05-08T08:08:56.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:56 smithi194 ceph-mon[33679]: pgmap v2621: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 651 KiB/s rd, 673 KiB/s wr, 43 op/s 2024-05-08T08:08:58.157 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/logic_pio.o 2024-05-08T08:08:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:08:58 smithi070 ceph-mon[29591]: pgmap v2622: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 474 KiB/s wr, 24 op/s 2024-05-08T08:08:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:08:58 smithi172 ceph-mon[33377]: pgmap v2622: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 474 KiB/s wr, 24 op/s 2024-05-08T08:08:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:08:58 smithi194 ceph-mon[33679]: pgmap v2622: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 474 KiB/s wr, 24 op/s 2024-05-08T08:08:59.027 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/sock_reuseport.o 2024-05-08T08:08:59.410 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dsinit.o 2024-05-08T08:09:00.318 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/card.o 2024-05-08T08:09:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:00 smithi070 ceph-mon[29591]: pgmap v2623: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 474 KiB/s wr, 25 op/s 2024-05-08T08:09:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:00 smithi172 ceph-mon[33377]: pgmap v2623: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 474 KiB/s wr, 25 op/s 2024-05-08T08:09:00.478 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/trace_clock.o 2024-05-08T08:09:00.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:00 smithi194 ceph-mon[33679]: pgmap v2623: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 474 KiB/s wr, 25 op/s 2024-05-08T08:09:02.028 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/write.o 2024-05-08T08:09:02.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:02 smithi070 ceph-mon[29591]: pgmap v2624: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 673 KiB/s wr, 35 op/s 2024-05-08T08:09:02.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:02 smithi172 ceph-mon[33377]: pgmap v2624: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 673 KiB/s wr, 35 op/s 2024-05-08T08:09:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:02 smithi194 ceph-mon[33679]: pgmap v2624: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 673 KiB/s wr, 35 op/s 2024-05-08T08:09:03.493 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/pci/hda/hda_sysfs.o 2024-05-08T08:09:04.155 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/trace.o 2024-05-08T08:09:04.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:04 smithi070 ceph-mon[29591]: pgmap v2625: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 407 KiB/s wr, 24 op/s 2024-05-08T08:09:04.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:04 smithi172 ceph-mon[33377]: pgmap v2625: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 407 KiB/s wr, 24 op/s 2024-05-08T08:09:04.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:04 smithi194 ceph-mon[33679]: pgmap v2625: 129 pgs: 129 active+clean; 1.9 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 407 KiB/s wr, 24 op/s 2024-05-08T08:09:05.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:05 smithi070 ceph-mon[29591]: osdmap e242: 12 total, 12 up, 12 in 2024-05-08T08:09:05.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:05 smithi172 ceph-mon[33377]: osdmap e242: 12 total, 12 up, 12 in 2024-05-08T08:09:05.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:05 smithi194 ceph-mon[33679]: osdmap e242: 12 total, 12 up, 12 in 2024-05-08T08:09:05.589 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/kcmp.o 2024-05-08T08:09:06.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:06 smithi070 ceph-mon[29591]: pgmap v2627: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 545 KiB/s wr, 54 op/s 2024-05-08T08:09:06.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:06 smithi172 ceph-mon[33377]: pgmap v2627: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 545 KiB/s wr, 54 op/s 2024-05-08T08:09:06.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:06 smithi194 ceph-mon[33679]: pgmap v2627: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 545 KiB/s wr, 54 op/s 2024-05-08T08:09:06.679 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dsmethod.o 2024-05-08T08:09:06.821 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/maple_tree.o 2024-05-08T08:09:07.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:07 smithi070 ceph-mon[29591]: pgmap v2628: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 545 KiB/s wr, 54 op/s 2024-05-08T08:09:07.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:07 smithi172 ceph-mon[33377]: pgmap v2628: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 545 KiB/s wr, 54 op/s 2024-05-08T08:09:07.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:07 smithi194 ceph-mon[33679]: pgmap v2628: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 545 KiB/s wr, 54 op/s 2024-05-08T08:09:10.209 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:09 smithi194 ceph-mon[33679]: pgmap v2629: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 730 KiB/s wr, 56 op/s 2024-05-08T08:09:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:09 smithi070 ceph-mon[29591]: pgmap v2629: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 730 KiB/s wr, 56 op/s 2024-05-08T08:09:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:09 smithi172 ceph-mon[33377]: pgmap v2629: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 730 KiB/s wr, 56 op/s 2024-05-08T08:09:10.517 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/driver.o 2024-05-08T08:09:12.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:12 smithi070 ceph-mon[29591]: pgmap v2630: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 515 KiB/s wr, 51 op/s 2024-05-08T08:09:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:12 smithi172 ceph-mon[33377]: pgmap v2630: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 515 KiB/s wr, 51 op/s 2024-05-08T08:09:12.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:12 smithi194 ceph-mon[33679]: pgmap v2630: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 515 KiB/s wr, 51 op/s 2024-05-08T08:09:12.801 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/rethook.o 2024-05-08T08:09:13.334 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/pci/hda/hda_controller.o 2024-05-08T08:09:14.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:14 smithi070 ceph-mon[29591]: pgmap v2631: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 515 KiB/s wr, 51 op/s 2024-05-08T08:09:14.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:14 smithi070 ceph-mon[29591]: osdmap e243: 12 total, 12 up, 12 in 2024-05-08T08:09:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:14 smithi172 ceph-mon[33377]: pgmap v2631: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 515 KiB/s wr, 51 op/s 2024-05-08T08:09:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:14 smithi172 ceph-mon[33377]: osdmap e243: 12 total, 12 up, 12 in 2024-05-08T08:09:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:14 smithi194 ceph-mon[33679]: pgmap v2631: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 515 KiB/s wr, 51 op/s 2024-05-08T08:09:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:14 smithi194 ceph-mon[33679]: osdmap e243: 12 total, 12 up, 12 in 2024-05-08T08:09:14.545 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/fib_notifier.o 2024-05-08T08:09:15.565 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dsmthdat.o 2024-05-08T08:09:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:16 smithi070 ceph-mon[29591]: pgmap v2633: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 492 KiB/s wr, 29 op/s 2024-05-08T08:09:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:16 smithi172 ceph-mon[33377]: pgmap v2633: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 492 KiB/s wr, 29 op/s 2024-05-08T08:09:16.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:16 smithi194 ceph-mon[33679]: pgmap v2633: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 492 KiB/s wr, 29 op/s 2024-05-08T08:09:17.601 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/namespace.o 2024-05-08T08:09:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:18 smithi070 ceph-mon[29591]: pgmap v2634: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 492 KiB/s wr, 29 op/s 2024-05-08T08:09:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:18 smithi172 ceph-mon[33377]: pgmap v2634: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 492 KiB/s wr, 29 op/s 2024-05-08T08:09:18.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:18 smithi194 ceph-mon[33679]: pgmap v2634: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 492 KiB/s wr, 29 op/s 2024-05-08T08:09:19.861 INFO:tasks.quiescer.fs.[cephfs]:Total duration (53.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:09:19.862 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.75 2024-05-08T08:09:19.862 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:09:20.103 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/memcat_p.o 2024-05-08T08:09:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:20 smithi070 ceph-mon[29591]: pgmap v2635: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 328 KiB/s wr, 29 op/s 2024-05-08T08:09:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:09:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:20 smithi172 ceph-mon[33377]: pgmap v2635: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 328 KiB/s wr, 29 op/s 2024-05-08T08:09:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:09:20.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:20 smithi194 ceph-mon[33679]: pgmap v2635: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 328 KiB/s wr, 29 op/s 2024-05-08T08:09:20.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:09:20.513 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:09:21.256 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:09:21.257 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:09:21.257 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:09:21.400 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/resource.o 2024-05-08T08:09:21.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:09:21.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:09:21.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:09:21.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:09:21.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:09:21.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:09:21.627 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dsobject.o 2024-05-08T08:09:21.768 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/crash_core_64.o 2024-05-08T08:09:21.898 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/freezer.o 2024-05-08T08:09:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:22 smithi070 ceph-mon[29591]: pgmap v2636: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 554 KiB/s wr, 30 op/s 2024-05-08T08:09:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:22 smithi172 ceph-mon[33377]: pgmap v2636: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 554 KiB/s wr, 30 op/s 2024-05-08T08:09:22.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:22 smithi194 ceph-mon[33679]: pgmap v2636: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 554 KiB/s wr, 30 op/s 2024-05-08T08:09:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.110+0000 7f82e6a00700 1 -- 172.21.15.70:0/3705878185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e006b6f0 msgr2=0x7f82e006bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.110+0000 7f82e6a00700 1 --2- 172.21.15.70:0/3705878185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e006b6f0 0x7f82e006bb50 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009990 tx=0x7f82cc009ca0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.110+0000 7f82e6a00700 1 -- 172.21.15.70:0/3705878185 shutdown_connections 2024-05-08T08:09:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.110+0000 7f82e6a00700 1 --2- 172.21.15.70:0/3705878185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e0105ee0 0x7f82e0106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.110+0000 7f82e6a00700 1 --2- 172.21.15.70:0/3705878185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e01083d0 0x7f82e006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.110+0000 7f82e6a00700 1 --2- 172.21.15.70:0/3705878185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e006b6f0 0x7f82e006bb50 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.110+0000 7f82e6a00700 1 -- 172.21.15.70:0/3705878185 >> 172.21.15.70:0/3705878185 conn(0x7f82e0079350 msgr2=0x7f82e0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:09:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.111+0000 7f82e6a00700 1 -- 172.21.15.70:0/3705878185 shutdown_connections 2024-05-08T08:09:23.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.111+0000 7f82e6a00700 1 -- 172.21.15.70:0/3705878185 wait complete. 2024-05-08T08:09:23.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.113+0000 7f82e6a00700 1 Processor -- start 2024-05-08T08:09:23.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.113+0000 7f82e6a00700 1 -- start start 2024-05-08T08:09:23.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.114+0000 7f82e6a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e0105ee0 0x7f82e01a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:23.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.114+0000 7f82e6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e01083d0 0x7f82e01a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:23.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.114+0000 7f82e6a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e01a4bc0 0x7f82e01a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:23.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.114+0000 7f82e6a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82e0119b30 con 0x7f82e01083d0 2024-05-08T08:09:23.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.114+0000 7f82e6a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82e01199b0 con 0x7f82e01a4bc0 2024-05-08T08:09:23.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.114+0000 7f82e6a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f82e0119cb0 con 0x7f82e0105ee0 2024-05-08T08:09:23.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.114+0000 7f82df400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e01083d0 0x7f82e01a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:23.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.114+0000 7f82df400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e01083d0 0x7f82e01a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57338/0 (socket says 172.21.15.70:57338) 2024-05-08T08:09:23.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.114+0000 7f82df400700 1 -- 172.21.15.70:0/4086199239 learned_addr learned my addr 172.21.15.70:0/4086199239 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:09:23.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.115+0000 7f82dfe00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e0105ee0 0x7f82e01a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:23.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.115+0000 7f82e4a00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e01a4bc0 0x7f82e01a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:23.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.115+0000 7f82df400700 1 -- 172.21.15.70:0/4086199239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e0105ee0 msgr2=0x7f82e01a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:23.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.115+0000 7f82df400700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e0105ee0 0x7f82e01a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.115+0000 7f82df400700 1 -- 172.21.15.70:0/4086199239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e01a4bc0 msgr2=0x7f82e01a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:23.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.115+0000 7f82df400700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e01a4bc0 0x7f82e01a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.115+0000 7f82df400700 1 -- 172.21.15.70:0/4086199239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e01a56e0 con 0x7f82e01083d0 2024-05-08T08:09:23.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.116+0000 7f82df400700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e01083d0 0x7f82e01a0830 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0098e0 tx=0x7f82cc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:09:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.116+0000 7f82dcc00700 1 -- 172.21.15.70:0/4086199239 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc026070 con 0x7f82e01083d0 2024-05-08T08:09:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.116+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82e01a5970 con 0x7f82e01083d0 2024-05-08T08:09:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.117+0000 7f82dcc00700 1 -- 172.21.15.70:0/4086199239 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82cc021410 con 0x7f82e01083d0 2024-05-08T08:09:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.117+0000 7f82dcc00700 1 -- 172.21.15.70:0/4086199239 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc017650 con 0x7f82e01083d0 2024-05-08T08:09:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.117+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82e01ad090 con 0x7f82e01083d0 2024-05-08T08:09:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.118+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82e006a190 con 0x7f82e01083d0 2024-05-08T08:09:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.124+0000 7f82dcc00700 1 -- 172.21.15.70:0/4086199239 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f82cc029070 con 0x7f82e01083d0 2024-05-08T08:09:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.126+0000 7f82dcc00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82c40b29f0 0x7f82c40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.126+0000 7f82dcc00700 1 -- 172.21.15.70:0/4086199239 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(243..243 src has 1..243) ==== 9583+0+0 (secure 0 0 0) 0x7f82cc0e3de0 con 0x7f82e01083d0 2024-05-08T08:09:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.127+0000 7f82dfe00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82c40b29f0 0x7f82c40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.128+0000 7f82dfe00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82c40b29f0 0x7f82c40b4eb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009be0 tx=0x7f82d0009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:09:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.128+0000 7f82dcc00700 1 -- 172.21.15.70:0/4086199239 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f82cc030070 con 0x7f82e01083d0 2024-05-08T08:09:23.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.588+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82e01ad350 con 0x7f82e01083d0 2024-05-08T08:09:23.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.589+0000 7f82dcc00700 1 -- 172.21.15.70:0/4086199239 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f82cc013070 con 0x7f82e01083d0 2024-05-08T08:09:23.584 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:09:23.584 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:09:23.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82c40b29f0 msgr2=0x7f82c40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:23.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82c40b29f0 0x7f82c40b4eb0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009be0 tx=0x7f82d0009260 comp rx=0 tx=0).stop 2024-05-08T08:09:23.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e01083d0 msgr2=0x7f82e01a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:23.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e01083d0 0x7f82e01a0830 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0098e0 tx=0x7f82cc0047b0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 shutdown_connections 2024-05-08T08:09:23.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f82c40b29f0 0x7f82c40b4eb0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82e01a4bc0 0x7f82e01a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82e0105ee0 0x7f82e01a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 --2- 172.21.15.70:0/4086199239 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82e01083d0 0x7f82e01a0830 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:23.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.593+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 >> 172.21.15.70:0/4086199239 conn(0x7f82e0079350 msgr2=0x7f82e0102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:09:23.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.594+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 shutdown_connections 2024-05-08T08:09:23.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:23.594+0000 7f82e6a00700 1 -- 172.21.15.70:0/4086199239 wait complete. 2024-05-08T08:09:23.590 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:09:23.851 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/pci/hda/hda_proc.o 2024-05-08T08:09:24.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:24 smithi070 ceph-mon[29591]: pgmap v2637: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 554 KiB/s wr, 30 op/s 2024-05-08T08:09:24.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:24 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4086199239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:09:24.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:24 smithi172 ceph-mon[33377]: pgmap v2637: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 554 KiB/s wr, 30 op/s 2024-05-08T08:09:24.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:24 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4086199239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:09:24.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:24 smithi194 ceph-mon[33679]: pgmap v2637: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 554 KiB/s wr, 30 op/s 2024-05-08T08:09:24.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:24 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4086199239' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:09:24.794 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/xdp.o 2024-05-08T08:09:25.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:25 smithi172 ceph-mon[33377]: pgmap v2638: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 758 KiB/s wr, 43 op/s 2024-05-08T08:09:25.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:25 smithi194 ceph-mon[33679]: pgmap v2638: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 758 KiB/s wr, 43 op/s 2024-05-08T08:09:25.600 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:25 smithi070 ceph-mon[29591]: pgmap v2638: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 758 KiB/s wr, 43 op/s 2024-05-08T08:09:25.655 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 86.75 --await-for 42.0' 2024-05-08T08:09:25.655 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 86.75 --await-for 42.0 2024-05-08T08:09:25.865 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/nmi_backtrace.o 2024-05-08T08:09:26.220 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:09:28.057 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dsopcode.o 2024-05-08T08:09:28.277 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:28 smithi070 ceph-mon[29591]: pgmap v2639: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 464 KiB/s wr, 25 op/s 2024-05-08T08:09:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:28 smithi172 ceph-mon[33377]: pgmap v2639: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 464 KiB/s wr, 25 op/s 2024-05-08T08:09:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:28 smithi194 ceph-mon[33679]: pgmap v2639: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 464 KiB/s wr, 25 op/s 2024-05-08T08:09:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.226+0000 7f5785000700 1 -- 172.21.15.70:0/2959165903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 msgr2=0x7f57801125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.226+0000 7f5785000700 1 --2- 172.21.15.70:0/2959165903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 0x7f57801125b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f577800b0a0 tx=0x7f577800b3b0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.227+0000 7f5785000700 1 -- 172.21.15.70:0/2959165903 shutdown_connections 2024-05-08T08:09:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.227+0000 7f5785000700 1 --2- 172.21.15.70:0/2959165903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 0x7f57801125b0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.227+0000 7f5785000700 1 --2- 172.21.15.70:0/2959165903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578010b6e0 0x7f578010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.227+0000 7f5785000700 1 --2- 172.21.15.70:0/2959165903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57801056e0 0x7f5780105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.227+0000 7f5785000700 1 -- 172.21.15.70:0/2959165903 >> 172.21.15.70:0/2959165903 conn(0x7f57801011d0 msgr2=0x7f57801035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:09:29.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.227+0000 7f5785000700 1 -- 172.21.15.70:0/2959165903 shutdown_connections 2024-05-08T08:09:29.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.227+0000 7f5785000700 1 -- 172.21.15.70:0/2959165903 wait complete. 2024-05-08T08:09:29.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.228+0000 7f5785000700 1 Processor -- start 2024-05-08T08:09:29.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.228+0000 7f5785000700 1 -- start start 2024-05-08T08:09:29.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f5785000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57801056e0 0x7f57801a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f5785000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 0x7f57801a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f5785000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578010b6e0 0x7f578019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f5785000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f57801157e0 con 0x7f57801060a0 2024-05-08T08:09:29.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f5785000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5780115660 con 0x7f578010b6e0 2024-05-08T08:09:29.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f5785000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5780115960 con 0x7f57801056e0 2024-05-08T08:09:29.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f577d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 0x7f57801a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f577de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57801056e0 0x7f57801a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f577d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 0x7f57801a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46744/0 (socket says 172.21.15.70:46744) 2024-05-08T08:09:29.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.229+0000 7f577d400700 1 -- 172.21.15.70:0/4265754933 learned_addr learned my addr 172.21.15.70:0/4265754933 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:09:29.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.230+0000 7f577e800700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578010b6e0 0x7f578019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.230+0000 7f577d400700 1 -- 172.21.15.70:0/4265754933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57801056e0 msgr2=0x7f57801a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:29.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.230+0000 7f577d400700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57801056e0 0x7f57801a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.230+0000 7f577d400700 1 -- 172.21.15.70:0/4265754933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578010b6e0 msgr2=0x7f578019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:29.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.230+0000 7f577d400700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578010b6e0 0x7f578019ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.230+0000 7f577d400700 1 -- 172.21.15.70:0/4265754933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578019c1c0 con 0x7f57801060a0 2024-05-08T08:09:29.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.231+0000 7f577d400700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 0x7f57801a1d90 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f576c00e9c0 tx=0x7f576c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:09:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.232+0000 7f5776a00700 1 -- 172.21.15.70:0/4265754933 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c00cbd0 con 0x7f57801060a0 2024-05-08T08:09:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.232+0000 7f5776a00700 1 -- 172.21.15.70:0/4265754933 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f576c00ee60 con 0x7f57801060a0 2024-05-08T08:09:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.232+0000 7f5785000700 1 -- 172.21.15.70:0/4265754933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578019c450 con 0x7f57801060a0 2024-05-08T08:09:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.232+0000 7f5776a00700 1 -- 172.21.15.70:0/4265754933 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c0054b0 con 0x7f57801060a0 2024-05-08T08:09:29.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.232+0000 7f5785000700 1 -- 172.21.15.70:0/4265754933 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57801a8720 con 0x7f57801060a0 2024-05-08T08:09:29.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.238+0000 7f5776a00700 1 -- 172.21.15.70:0/4265754933 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f576c004750 con 0x7f57801060a0 2024-05-08T08:09:29.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.240+0000 7f5776a00700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f57640b2b20 0x7f57640b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.240+0000 7f5776a00700 1 -- 172.21.15.70:0/4265754933 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(243..243 src has 1..243) ==== 9583+0+0 (secure 0 0 0) 0x7f576c0e2d20 con 0x7f57801060a0 2024-05-08T08:09:29.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.241+0000 7f577de00700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f57640b2b20 0x7f57640b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.242+0000 7f577de00700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f57640b2b20 0x7f57640b4fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5770009680 tx=0x7f5770009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:09:29.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.259+0000 7f578fa57b80 1 Processor -- start 2024-05-08T08:09:29.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.260+0000 7f578fa57b80 1 -- start start 2024-05-08T08:09:29.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.260+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d021330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.260+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 0x563d2d01b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.260+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d027d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.260+0000 7f578fa57b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563d2cf6dbb0 con 0x563d2d020f50 2024-05-08T08:09:29.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.260+0000 7f578fa57b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563d2cf0b8f0 con 0x563d2d01bee0 2024-05-08T08:09:29.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.260+0000 7f578fa57b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563d2cf69b70 con 0x563d2d01b520 2024-05-08T08:09:29.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577e800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d027d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577d400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 0x563d2d01b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d021330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577e800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d027d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:37662/0 (socket says 172.21.15.70:37662) 2024-05-08T08:09:29.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577e800700 1 -- 172.21.15.70:0/748252210 learned_addr learned my addr 172.21.15.70:0/748252210 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:09:29.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577e800700 1 -- 172.21.15.70:0/748252210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 msgr2=0x563d2d01b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:09:29.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577e800700 1 --2- 172.21.15.70:0/748252210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 0x563d2d01b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577e800700 1 -- 172.21.15.70:0/748252210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 msgr2=0x563d2d021330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:09:29.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577e800700 1 --2- 172.21.15.70:0/748252210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d021330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577e800700 1 -- 172.21.15.70:0/748252210 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d2cebaa60 con 0x563d2d01bee0 2024-05-08T08:09:29.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.261+0000 7f577de00700 1 --2- 172.21.15.70:0/748252210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d021330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:09:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.262+0000 7f577e800700 1 --2- 172.21.15.70:0/748252210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d027d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f577800b0a0 tx=0x7f57780092e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80aef1ddb8589211 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:09:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.262+0000 7f576b400700 1 -- 172.21.15.70:0/748252210 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577800bcb0 con 0x563d2d01bee0 2024-05-08T08:09:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.263+0000 7f576b400700 1 -- 172.21.15.70:0/748252210 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57780074a0 con 0x563d2d01bee0 2024-05-08T08:09:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.263+0000 7f576b400700 1 -- 172.21.15.70:0/748252210 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57780052a0 con 0x563d2d01bee0 2024-05-08T08:09:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.263+0000 7f578fa57b80 1 -- 172.21.15.70:0/748252210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 msgr2=0x563d2d027d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:29.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.263+0000 7f578fa57b80 1 --2- 172.21.15.70:0/748252210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d027d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f577800b0a0 tx=0x7f57780092e0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.264+0000 7f578fa57b80 1 -- 172.21.15.70:0/748252210 shutdown_connections 2024-05-08T08:09:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.264+0000 7f578fa57b80 1 --2- 172.21.15.70:0/748252210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d027d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.264+0000 7f578fa57b80 1 --2- 172.21.15.70:0/748252210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d021330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.264+0000 7f578fa57b80 1 --2- 172.21.15.70:0/748252210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 0x563d2d01b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.264+0000 7f578fa57b80 1 -- 172.21.15.70:0/748252210 >> 172.21.15.70:0/748252210 conn(0x563d2cf49cf0 msgr2=0x563d2d015e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:09:29.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.264+0000 7f578fa57b80 1 -- 172.21.15.70:0/748252210 shutdown_connections 2024-05-08T08:09:29.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.264+0000 7f578fa57b80 1 -- 172.21.15.70:0/748252210 wait complete. 2024-05-08T08:09:29.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.265+0000 7f578fa57b80 1 -- start start 2024-05-08T08:09:29.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.265+0000 7f578fa57b80 1 Processor -- start 2024-05-08T08:09:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.266+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01b520 0x563d2d027910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.266+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01bee0 0x563d2d024d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.266+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d025240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.266+0000 7f578fa57b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563d2d028250 con 0x563d2d020f50 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.266+0000 7f578fa57b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563d2ced3cb0 con 0x563d2d01b520 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.266+0000 7f578fa57b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563d2d0283d0 con 0x563d2d01bee0 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.266+0000 7f578fa57b80 10 client.0 _ll_register_callbacks cb 0x563d2cf14e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.267+0000 7f577de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01b520 0x563d2d027910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.267+0000 7f577d400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01bee0 0x563d2d024d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.267+0000 7f577de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01b520 0x563d2d027910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:37676/0 (socket says 172.21.15.70:37676) 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.267+0000 7f577d400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01bee0 0x563d2d024d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:40000/0 (socket says 172.21.15.70:40000) 2024-05-08T08:09:29.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.267+0000 7f577de00700 1 -- 172.21.15.70:0/593742858 learned_addr learned my addr 172.21.15.70:0/593742858 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:09:29.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.267+0000 7f577e800700 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d025240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.268+0000 7f577e800700 1 -- 172.21.15.70:0/593742858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01bee0 msgr2=0x563d2d024d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:09:29.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.268+0000 7f577e800700 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01bee0 0x563d2d024d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.268+0000 7f577e800700 1 -- 172.21.15.70:0/593742858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01b520 msgr2=0x563d2d027910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:09:29.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.268+0000 7f577e800700 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01b520 0x563d2d027910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.268+0000 7f577e800700 1 -- 172.21.15.70:0/593742858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d2cf335b0 con 0x563d2d020f50 2024-05-08T08:09:29.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.268+0000 7f577e800700 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d025240 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f577800b3f0 tx=0x7f5778009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb5b3c5258676f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:09:29.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.268+0000 7f575fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:09:29.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.269+0000 7f575fe00700 1 -- 172.21.15.70:0/593742858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5778007650 con 0x563d2d020f50 2024-05-08T08:09:29.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.269+0000 7f575fe00700 1 -- 172.21.15.70:0/593742858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(243..243 src has 1..243) ==== 9583+0+0 (secure 0 0 0) 0x7f57780077f0 con 0x563d2d020f50 2024-05-08T08:09:29.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.269+0000 7f578fa57b80 1 -- 172.21.15.70:0/593742858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57780074a0 con 0x563d2d020f50 2024-05-08T08:09:29.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.270+0000 7f575fe00700 1 -- 172.21.15.70:0/593742858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f5778038050 con 0x563d2d020f50 2024-05-08T08:09:29.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.270+0000 7f578fa57b80 10 client.17679 fetch_fsmap learned FSMap version 42 2024-05-08T08:09:29.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.270+0000 7f578fa57b80 1 -- 172.21.15.70:0/593742858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563d2d03b260 con 0x563d2d020f50 2024-05-08T08:09:29.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.270+0000 7f575fe00700 1 -- 172.21.15.70:0/593742858 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57780074a0 con 0x563d2d020f50 2024-05-08T08:09:29.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.270+0000 7f575fe00700 1 -- 172.21.15.70:0/593742858 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f5778011070 con 0x563d2d020f50 2024-05-08T08:09:29.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.271+0000 7f578fa57b80 10 client.17679 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:09:29.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.271+0000 7f578fa57b80 10 client.17679 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:09:29.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.271+0000 7f578fa57b80 20 client.17679 populate_metadata read hostname 'smithi070' 2024-05-08T08:09:29.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.271+0000 7f578fa57b80 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563d2d03d730 0x563d2d03fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.271+0000 7f578fa57b80 4 client.17679 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:09:29.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.271+0000 7f578fa57b80 1 -- 172.21.15.70:0/593742858 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d2cfe8230 con 0x563d2d03d730 2024-05-08T08:09:29.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.271+0000 7f577de00700 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563d2d03d730 0x563d2d03fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.273+0000 7f575fe00700 10 client.17679 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:09:29.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.273+0000 7f577de00700 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563d2d03d730 0x563d2d03fb20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b89b348cc8e4721 server_cookie=444964754ba0b8d in_seq=0 out_seq=0 2024-05-08T08:09:29.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.275+0000 7f575fe00700 1 -- 172.21.15.70:0/593742858 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563d2cfe8230 con 0x563d2d03d730 2024-05-08T08:09:29.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.275+0000 7f575fe00700 10 client.17679 handle_command_reply: tid=0 2024-05-08T08:09:29.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.275+0000 7f578fa57b80 1 client.17679 shutdown 2024-05-08T08:09:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.275+0000 7f578fa57b80 1 -- 172.21.15.70:0/593742858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 msgr2=0x563d2d025240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.275+0000 7f578fa57b80 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d025240 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f577800b3f0 tx=0x7f5778009be0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f578fa57b80 1 -- 172.21.15.70:0/593742858 shutdown_connections 2024-05-08T08:09:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f578fa57b80 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563d2d03d730 0x563d2d03fb20 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f578fa57b80 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d025240 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f578fa57b80 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01b520 0x563d2d027910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f578fa57b80 1 --2- 172.21.15.70:0/593742858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01bee0 0x563d2d024d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f578fa57b80 1 -- 172.21.15.70:0/593742858 >> 172.21.15.70:0/593742858 conn(0x563d2cf49cf0 msgr2=0x563d2d0108e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:09:29.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f575fe00700 0 client.17679 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:09:29.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f578fa57b80 1 -- 172.21.15.70:0/593742858 shutdown_connections 2024-05-08T08:09:29.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f578fa57b80 1 -- 172.21.15.70:0/593742858 wait complete. 2024-05-08T08:09:29.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.276+0000 7f578fa57b80 20 client.17679 trim_cache size 0 max 16384 2024-05-08T08:09:29.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.306+0000 7f578fa57b80 1 Processor -- start 2024-05-08T08:09:29.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.306+0000 7f578fa57b80 1 -- start start 2024-05-08T08:09:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.307+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d01b520 0x563d2d01f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.307+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d042b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.307+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d020f50 0x563d2d043080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.307+0000 7f578fa57b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f57801afba0 con 0x563d2d01b520 2024-05-08T08:09:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.307+0000 7f578fa57b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57801ad430 con 0x563d2d01bee0 2024-05-08T08:09:29.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.307+0000 7f578fa57b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f57801ab2c0 con 0x563d2d020f50 2024-05-08T08:09:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.307+0000 7f577de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d01b520 0x563d2d01f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.308+0000 7f577de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d01b520 0x563d2d01f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46772/0 (socket says 172.21.15.70:46772) 2024-05-08T08:09:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.308+0000 7f577de00700 1 -- 172.21.15.70:0/19067984 learned_addr learned my addr 172.21.15.70:0/19067984 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:09:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.308+0000 7f577d400700 1 --2- 172.21.15.70:0/19067984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d042b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.308+0000 7f577e800700 1 --2- 172.21.15.70:0/19067984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d020f50 0x563d2d043080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.308+0000 7f577de00700 1 -- 172.21.15.70:0/19067984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d020f50 msgr2=0x563d2d043080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:09:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.308+0000 7f577de00700 1 --2- 172.21.15.70:0/19067984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d020f50 0x563d2d043080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.308+0000 7f577de00700 1 -- 172.21.15.70:0/19067984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 msgr2=0x563d2d042b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:09:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.308+0000 7f577de00700 1 --2- 172.21.15.70:0/19067984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d042b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.308+0000 7f577de00700 1 -- 172.21.15.70:0/19067984 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d2d012a10 con 0x563d2d01b520 2024-05-08T08:09:29.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.309+0000 7f577de00700 1 --2- 172.21.15.70:0/19067984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d01b520 0x563d2d01f0e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x563d2d028520 tx=0x7f5770014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6898638ab6fe5911 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:09:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.309+0000 7f576aa00700 1 -- 172.21.15.70:0/19067984 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770031070 con 0x563d2d01b520 2024-05-08T08:09:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.310+0000 7f576aa00700 1 -- 172.21.15.70:0/19067984 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f577001de20 con 0x563d2d01b520 2024-05-08T08:09:29.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.310+0000 7f576aa00700 1 -- 172.21.15.70:0/19067984 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577001bdc0 con 0x563d2d01b520 2024-05-08T08:09:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.310+0000 7f578fa57b80 1 -- 172.21.15.70:0/19067984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d01b520 msgr2=0x563d2d01f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.310+0000 7f578fa57b80 1 --2- 172.21.15.70:0/19067984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d01b520 0x563d2d01f0e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x563d2d028520 tx=0x7f5770014000 comp rx=0 tx=0).stop 2024-05-08T08:09:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.311+0000 7f578fa57b80 1 -- 172.21.15.70:0/19067984 shutdown_connections 2024-05-08T08:09:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.311+0000 7f578fa57b80 1 --2- 172.21.15.70:0/19067984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d020f50 0x563d2d043080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.311+0000 7f578fa57b80 1 --2- 172.21.15.70:0/19067984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d01b520 0x563d2d01f0e0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.311+0000 7f578fa57b80 1 --2- 172.21.15.70:0/19067984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d042b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.311+0000 7f578fa57b80 1 -- 172.21.15.70:0/19067984 >> 172.21.15.70:0/19067984 conn(0x563d2cf49cf0 msgr2=0x563d2d01e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:09:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.311+0000 7f578fa57b80 1 -- 172.21.15.70:0/19067984 shutdown_connections 2024-05-08T08:09:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.311+0000 7f578fa57b80 1 -- 172.21.15.70:0/19067984 wait complete. 2024-05-08T08:09:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.312+0000 7f578fa57b80 1 -- start start 2024-05-08T08:09:29.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.312+0000 7f578fa57b80 1 Processor -- start 2024-05-08T08:09:29.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.313+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 0x563d2d041910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.313+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d041e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.313+0000 7f578fa57b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d042390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.313+0000 7f578fa57b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f57801ab910 con 0x563d2d020f50 2024-05-08T08:09:29.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.313+0000 7f578fa57b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57801acd60 con 0x563d2d01bee0 2024-05-08T08:09:29.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.313+0000 7f578fa57b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f57801abfc0 con 0x563d2d01b520 2024-05-08T08:09:29.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.313+0000 7f578fa57b80 10 client.0 _ll_register_callbacks cb 0x563d2cf14e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:09:29.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.313+0000 7f577d400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d041e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.314+0000 7f577de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 0x563d2d041910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.314+0000 7f577d400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d041e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:37682/0 (socket says 172.21.15.70:37682) 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.314+0000 7f577d400700 1 -- 172.21.15.70:0/1369829389 learned_addr learned my addr 172.21.15.70:0/1369829389 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.314+0000 7f577e800700 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d042390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.314+0000 7f577e800700 1 -- 172.21.15.70:0/1369829389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 msgr2=0x563d2d041910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.314+0000 7f577e800700 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 0x563d2d041910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.314+0000 7f577e800700 1 -- 172.21.15.70:0/1369829389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 msgr2=0x563d2d041e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.314+0000 7f577e800700 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d041e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.314+0000 7f577e800700 1 -- 172.21.15.70:0/1369829389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d2d0a7ec0 con 0x563d2d020f50 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.315+0000 7f577e800700 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d042390 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f577800b780 tx=0x7f577802f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6027d7c8aef1a455 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:09:29.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.315+0000 7f575fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:09:29.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.315+0000 7f575fe00700 1 -- 172.21.15.70:0/1369829389 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577802fa20 con 0x563d2d020f50 2024-05-08T08:09:29.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.315+0000 7f575fe00700 1 -- 172.21.15.70:0/1369829389 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(243..243 src has 1..243) ==== 9583+0+0 (secure 0 0 0) 0x7f577802fbc0 con 0x563d2d020f50 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.315+0000 7f578fa57b80 1 -- 172.21.15.70:0/1369829389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f577001de20 con 0x563d2d020f50 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.315+0000 7f575fe00700 1 -- 172.21.15.70:0/1369829389 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f5778045050 con 0x563d2d020f50 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.316+0000 7f578fa57b80 10 client.17685 fetch_fsmap learned FSMap version 42 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.316+0000 7f578fa57b80 1 -- 172.21.15.70:0/1369829389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563d2d0a91a0 con 0x563d2d020f50 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.316+0000 7f575fe00700 1 -- 172.21.15.70:0/1369829389 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f577001de20 con 0x563d2d020f50 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.316+0000 7f575fe00700 1 -- 172.21.15.70:0/1369829389 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f5778011040 con 0x563d2d020f50 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.316+0000 7f578fa57b80 10 client.17685 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.316+0000 7f578fa57b80 10 client.17685 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.316+0000 7f578fa57b80 20 client.17685 populate_metadata read hostname 'smithi070' 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.316+0000 7f578fa57b80 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563d2d0a9860 0x563d2d0abc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.317+0000 7f578fa57b80 4 client.17685 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.75, "await_for": 42.0}] 2024-05-08T08:09:29.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.317+0000 7f578fa57b80 1 -- 172.21.15.70:0/1369829389 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.75, "await_for": 42.0}) -- 0x563d2cf7b590 con 0x563d2d0a9860 2024-05-08T08:09:29.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.317+0000 7f577de00700 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563d2d0a9860 0x563d2d0abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:09:29.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.318+0000 7f577de00700 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563d2d0a9860 0x563d2d0abc80 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64e28048911fde2f server_cookie=f3717d1bf1d749f1 in_seq=0 out_seq=0 2024-05-08T08:09:29.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:29.318+0000 7f575fe00700 10 client.17685 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:09:30.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:30 smithi070 ceph-mon[29591]: pgmap v2640: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 646 KiB/s wr, 28 op/s 2024-05-08T08:09:30.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:30 smithi172 ceph-mon[33377]: pgmap v2640: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 646 KiB/s wr, 28 op/s 2024-05-08T08:09:30.448 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/mount_clnt.o 2024-05-08T08:09:30.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:30 smithi194 ceph-mon[33679]: pgmap v2640: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 646 KiB/s wr, 28 op/s 2024-05-08T08:09:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:32 smithi070 ceph-mon[29591]: pgmap v2641: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 650 KiB/s wr, 33 op/s 2024-05-08T08:09:32.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:32 smithi172 ceph-mon[33377]: pgmap v2641: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 650 KiB/s wr, 33 op/s 2024-05-08T08:09:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:32 smithi194 ceph-mon[33679]: pgmap v2641: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 650 KiB/s wr, 33 op/s 2024-05-08T08:09:34.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:34 smithi070 ceph-mon[29591]: pgmap v2642: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 441 KiB/s wr, 25 op/s 2024-05-08T08:09:34.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:34 smithi172 ceph-mon[33377]: pgmap v2642: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 441 KiB/s wr, 25 op/s 2024-05-08T08:09:34.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:34 smithi194 ceph-mon[33679]: pgmap v2642: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 441 KiB/s wr, 25 op/s 2024-05-08T08:09:36.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:36 smithi070 ceph-mon[29591]: pgmap v2643: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 617 KiB/s wr, 34 op/s 2024-05-08T08:09:36.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:36 smithi172 ceph-mon[33377]: pgmap v2643: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 617 KiB/s wr, 34 op/s 2024-05-08T08:09:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:36 smithi194 ceph-mon[33679]: pgmap v2643: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 617 KiB/s wr, 34 op/s 2024-05-08T08:09:38.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:38 smithi070 ceph-mon[29591]: pgmap v2644: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 381 KiB/s wr, 19 op/s 2024-05-08T08:09:38.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:38 smithi172 ceph-mon[33377]: pgmap v2644: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 381 KiB/s wr, 19 op/s 2024-05-08T08:09:38.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:38 smithi194 ceph-mon[33679]: pgmap v2644: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 381 KiB/s wr, 19 op/s 2024-05-08T08:09:40.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:40 smithi070 ceph-mon[29591]: pgmap v2645: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 381 KiB/s wr, 19 op/s 2024-05-08T08:09:40.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:40 smithi172 ceph-mon[33377]: pgmap v2645: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 381 KiB/s wr, 19 op/s 2024-05-08T08:09:40.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:40 smithi194 ceph-mon[33679]: pgmap v2645: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 381 KiB/s wr, 19 op/s 2024-05-08T08:09:41.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:41 smithi172 ceph-mon[33377]: pgmap v2646: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 255 KiB/s wr, 20 op/s 2024-05-08T08:09:41.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:41 smithi194 ceph-mon[33679]: pgmap v2646: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 255 KiB/s wr, 20 op/s 2024-05-08T08:09:41.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:41 smithi070 ceph-mon[29591]: pgmap v2646: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 255 KiB/s wr, 20 op/s 2024-05-08T08:09:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:44 smithi070 ceph-mon[29591]: pgmap v2647: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 233 KiB/s wr, 12 op/s 2024-05-08T08:09:44.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:44 smithi172 ceph-mon[33377]: pgmap v2647: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 233 KiB/s wr, 12 op/s 2024-05-08T08:09:44.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:44 smithi194 ceph-mon[33679]: pgmap v2647: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 233 KiB/s wr, 12 op/s 2024-05-08T08:09:46.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:46 smithi070 ceph-mon[29591]: pgmap v2648: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 266 KiB/s wr, 16 op/s 2024-05-08T08:09:46.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:46 smithi172 ceph-mon[33377]: pgmap v2648: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 266 KiB/s wr, 16 op/s 2024-05-08T08:09:46.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:46 smithi194 ceph-mon[33679]: pgmap v2648: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 266 KiB/s wr, 16 op/s 2024-05-08T08:09:48.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:48 smithi070 ceph-mon[29591]: pgmap v2649: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T08:09:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:48 smithi172 ceph-mon[33377]: pgmap v2649: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T08:09:48.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:48 smithi194 ceph-mon[33679]: pgmap v2649: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T08:09:50.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:50 smithi070 ceph-mon[29591]: pgmap v2650: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T08:09:50.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:50 smithi172 ceph-mon[33377]: pgmap v2650: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T08:09:50.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:50 smithi194 ceph-mon[33679]: pgmap v2650: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T08:09:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:52 smithi070 ceph-mon[29591]: pgmap v2651: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 126 KiB/s wr, 10 op/s 2024-05-08T08:09:52.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:52 smithi172 ceph-mon[33377]: pgmap v2651: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 126 KiB/s wr, 10 op/s 2024-05-08T08:09:52.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:52 smithi194 ceph-mon[33679]: pgmap v2651: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 126 KiB/s wr, 10 op/s 2024-05-08T08:09:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.877+0000 7f575fe00700 1 -- 172.21.15.70:0/1369829389 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x563d2cf7b590 con 0x563d2d0a9860 2024-05-08T08:09:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.877+0000 7f575fe00700 10 client.17685 handle_command_reply: tid=0 2024-05-08T08:09:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f578fa57b80 1 client.17685 shutdown 2024-05-08T08:09:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f578fa57b80 1 -- 172.21.15.70:0/1369829389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 msgr2=0x563d2d042390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f578fa57b80 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d042390 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f577800b780 tx=0x7f577802f750 comp rx=0 tx=0).stop 2024-05-08T08:09:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f578fa57b80 1 -- 172.21.15.70:0/1369829389 shutdown_connections 2024-05-08T08:09:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f578fa57b80 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563d2d0a9860 0x563d2d0abc80 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f578fa57b80 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563d2d020f50 0x563d2d042390 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:52.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f575fe00700 0 client.17685 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:09:52.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f578fa57b80 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563d2d01b520 0x563d2d041910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:52.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f578fa57b80 1 --2- 172.21.15.70:0/1369829389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563d2d01bee0 0x563d2d041e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:52.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.878+0000 7f578fa57b80 1 -- 172.21.15.70:0/1369829389 >> 172.21.15.70:0/1369829389 conn(0x563d2cf49cf0 msgr2=0x563d2d01f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:09:52.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.879+0000 7f578fa57b80 1 -- 172.21.15.70:0/1369829389 shutdown_connections 2024-05-08T08:09:52.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.879+0000 7f578fa57b80 1 -- 172.21.15.70:0/1369829389 wait complete. 2024-05-08T08:09:52.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.880+0000 7f578fa57b80 20 client.17685 trim_cache size 0 max 16384 2024-05-08T08:09:52.876 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:09:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:09:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:09:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 194, 2024-05-08T08:09:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:09:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "dcfd0beb": { 2024-05-08T08:09:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 194, 2024-05-08T08:09:52.876 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.8, 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:09:52.877 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:09:52.878 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:09:52.878 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:09:52.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.881+0000 7f5785000700 1 -- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f57640b2b20 msgr2=0x7f57640b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:52.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.881+0000 7f5785000700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f57640b2b20 0x7f57640b4fe0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5770009680 tx=0x7f5770009260 comp rx=0 tx=0).stop 2024-05-08T08:09:52.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.881+0000 7f5785000700 1 -- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 msgr2=0x7f57801a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:09:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.881+0000 7f5785000700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 0x7f57801a1d90 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f576c00e9c0 tx=0x7f576c00ecd0 comp rx=0 tx=0).stop 2024-05-08T08:09:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.882+0000 7f5785000700 1 -- 172.21.15.70:0/4265754933 shutdown_connections 2024-05-08T08:09:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.882+0000 7f5785000700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f57640b2b20 0x7f57640b4fe0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.882+0000 7f5785000700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578010b6e0 0x7f578019ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.882+0000 7f5785000700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57801056e0 0x7f57801a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.882+0000 7f5785000700 1 --2- 172.21.15.70:0/4265754933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f57801060a0 0x7f57801a1d90 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:09:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.882+0000 7f5785000700 1 -- 172.21.15.70:0/4265754933 >> 172.21.15.70:0/4265754933 conn(0x7f57801011d0 msgr2=0x7f57801016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:09:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.882+0000 7f5785000700 1 -- 172.21.15.70:0/4265754933 shutdown_connections 2024-05-08T08:09:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:09:52.882+0000 7f5785000700 1 -- 172.21.15.70:0/4265754933 wait complete. 2024-05-08T08:09:54.320 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'dcfd0beb', quiesce took 34.5 seconds. Will release after: 26.75 2024-05-08T08:09:54.345 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:54 smithi070 ceph-mon[29591]: pgmap v2652: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-05-08T08:09:54.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:54 smithi172 ceph-mon[33377]: pgmap v2652: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-05-08T08:09:54.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:54 smithi194 ceph-mon[33679]: pgmap v2652: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-05-08T08:09:55.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:55 smithi172 ceph-mon[33377]: pgmap v2653: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 122 KiB/s wr, 10 op/s 2024-05-08T08:09:55.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:55 smithi194 ceph-mon[33679]: pgmap v2653: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 122 KiB/s wr, 10 op/s 2024-05-08T08:09:55.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:55 smithi070 ceph-mon[29591]: pgmap v2653: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 122 KiB/s wr, 10 op/s 2024-05-08T08:09:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:09:58 smithi070 ceph-mon[29591]: pgmap v2654: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2024-05-08T08:09:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:09:58 smithi172 ceph-mon[33377]: pgmap v2654: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2024-05-08T08:09:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:09:58 smithi194 ceph-mon[33679]: pgmap v2654: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2024-05-08T08:10:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:00 smithi070 ceph-mon[29591]: pgmap v2655: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2024-05-08T08:10:00.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T08:10:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:00 smithi172 ceph-mon[33377]: pgmap v2655: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2024-05-08T08:10:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T08:10:00.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:00 smithi194 ceph-mon[33679]: pgmap v2655: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 89 KiB/s wr, 7 op/s 2024-05-08T08:10:00.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T08:10:02.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:02 smithi070 ceph-mon[29591]: pgmap v2656: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 110 KiB/s wr, 16 op/s 2024-05-08T08:10:02.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:02 smithi172 ceph-mon[33377]: pgmap v2656: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 110 KiB/s wr, 16 op/s 2024-05-08T08:10:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:02 smithi194 ceph-mon[33679]: pgmap v2656: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 110 KiB/s wr, 16 op/s 2024-05-08T08:10:04.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:04 smithi070 ceph-mon[29591]: pgmap v2657: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 13 op/s 2024-05-08T08:10:04.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:04 smithi172 ceph-mon[33377]: pgmap v2657: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 13 op/s 2024-05-08T08:10:04.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:04 smithi194 ceph-mon[33679]: pgmap v2657: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 74 KiB/s wr, 13 op/s 2024-05-08T08:10:06.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:06 smithi070 ceph-mon[29591]: pgmap v2658: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 183 KiB/s wr, 34 op/s 2024-05-08T08:10:06.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:06 smithi172 ceph-mon[33377]: pgmap v2658: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 183 KiB/s wr, 34 op/s 2024-05-08T08:10:06.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:06 smithi194 ceph-mon[33679]: pgmap v2658: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 183 KiB/s wr, 34 op/s 2024-05-08T08:10:07.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:07 smithi070 ceph-mon[29591]: pgmap v2659: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-05-08T08:10:07.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:07 smithi172 ceph-mon[33377]: pgmap v2659: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-05-08T08:10:07.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:07 smithi194 ceph-mon[33679]: pgmap v2659: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-05-08T08:10:10.208 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:09 smithi194 ceph-mon[33679]: pgmap v2660: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-05-08T08:10:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:09 smithi070 ceph-mon[29591]: pgmap v2660: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-05-08T08:10:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:09 smithi172 ceph-mon[33377]: pgmap v2660: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-05-08T08:10:11.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:10 smithi194 ceph-mon[33679]: osdmap e244: 12 total, 12 up, 12 in 2024-05-08T08:10:11.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:10 smithi070 ceph-mon[29591]: osdmap e244: 12 total, 12 up, 12 in 2024-05-08T08:10:11.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:10 smithi172 ceph-mon[33377]: osdmap e244: 12 total, 12 up, 12 in 2024-05-08T08:10:12.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:11 smithi194 ceph-mon[33679]: pgmap v2662: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 141 KiB/s wr, 29 op/s 2024-05-08T08:10:12.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:11 smithi070 ceph-mon[29591]: pgmap v2662: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 141 KiB/s wr, 29 op/s 2024-05-08T08:10:12.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:11 smithi172 ceph-mon[33377]: pgmap v2662: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 141 KiB/s wr, 29 op/s 2024-05-08T08:10:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:14 smithi070 ceph-mon[29591]: pgmap v2663: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 141 KiB/s wr, 29 op/s 2024-05-08T08:10:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:14 smithi172 ceph-mon[33377]: pgmap v2663: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 141 KiB/s wr, 29 op/s 2024-05-08T08:10:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:14 smithi194 ceph-mon[33679]: pgmap v2663: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 141 KiB/s wr, 29 op/s 2024-05-08T08:10:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:16 smithi070 ceph-mon[29591]: pgmap v2664: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T08:10:16.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:16 smithi172 ceph-mon[33377]: pgmap v2664: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T08:10:16.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:16 smithi194 ceph-mon[33679]: pgmap v2664: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T08:10:18.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:18 smithi070 ceph-mon[29591]: pgmap v2665: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T08:10:18.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:18 smithi172 ceph-mon[33377]: pgmap v2665: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T08:10:18.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:18 smithi194 ceph-mon[33679]: pgmap v2665: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T08:10:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:19 smithi194 ceph-mon[33679]: osdmap e245: 12 total, 12 up, 12 in 2024-05-08T08:10:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:19 smithi194 ceph-mon[33679]: pgmap v2667: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-05-08T08:10:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:19 smithi070 ceph-mon[29591]: osdmap e245: 12 total, 12 up, 12 in 2024-05-08T08:10:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:19 smithi070 ceph-mon[29591]: pgmap v2667: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-05-08T08:10:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:19 smithi172 ceph-mon[33377]: osdmap e245: 12 total, 12 up, 12 in 2024-05-08T08:10:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:19 smithi172 ceph-mon[33377]: pgmap v2667: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-05-08T08:10:21.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:10:21.542 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:10:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:22 smithi070 ceph-mon[29591]: pgmap v2668: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-05-08T08:10:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:22 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:10:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:22 smithi172 ceph-mon[33377]: pgmap v2668: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-05-08T08:10:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:22 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:10:22.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:22 smithi194 ceph-mon[33679]: pgmap v2668: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-05-08T08:10:22.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:22 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:10:23.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:10:23.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:10:23.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:10:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:10:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:10:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:10:23.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:10:23.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:10:23.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:10:24.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.352+0000 7fc241400700 1 -- 172.21.15.70:0/2057265444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 msgr2=0x7fc23c105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:24.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.352+0000 7fc241400700 1 --2- 172.21.15.70:0/2057265444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 0x7fc23c105b40 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fc22400b0a0 tx=0x7fc22400b3b0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.352+0000 7fc241400700 1 -- 172.21.15.70:0/2057265444 shutdown_connections 2024-05-08T08:10:24.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.352+0000 7fc241400700 1 --2- 172.21.15.70:0/2057265444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c106080 0x7fc23c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.352+0000 7fc241400700 1 --2- 172.21.15.70:0/2057265444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc23c10b6c0 0x7fc23c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.352+0000 7fc241400700 1 --2- 172.21.15.70:0/2057265444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 0x7fc23c105b40 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.352+0000 7fc241400700 1 -- 172.21.15.70:0/2057265444 >> 172.21.15.70:0/2057265444 conn(0x7fc23c1011b0 msgr2=0x7fc23c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:24.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.352+0000 7fc241400700 1 -- 172.21.15.70:0/2057265444 shutdown_connections 2024-05-08T08:10:24.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.352+0000 7fc241400700 1 -- 172.21.15.70:0/2057265444 wait complete. 2024-05-08T08:10:24.348 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:24 smithi070 ceph-mon[29591]: pgmap v2669: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-05-08T08:10:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.353+0000 7fc241400700 1 Processor -- start 2024-05-08T08:10:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.353+0000 7fc241400700 1 -- start start 2024-05-08T08:10:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.354+0000 7fc241400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 0x7fc23c1a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.354+0000 7fc241400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc23c106080 0x7fc23c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.354+0000 7fc241400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c10b6c0 0x7fc23c19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:24.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.354+0000 7fc241400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c1157c0 con 0x7fc23c1056c0 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.354+0000 7fc241400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c115640 con 0x7fc23c106080 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.354+0000 7fc241400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc23c115940 con 0x7fc23c10b6c0 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.354+0000 7fc23a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 0x7fc23c1a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.354+0000 7fc23a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 0x7fc23c1a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50640/0 (socket says 172.21.15.70:50640) 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.354+0000 7fc23a800700 1 -- 172.21.15.70:0/2358527326 learned_addr learned my addr 172.21.15.70:0/2358527326 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc23b200700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c10b6c0 0x7fc23c19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc231e00700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc23c106080 0x7fc23c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc23a800700 1 -- 172.21.15.70:0/2358527326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c10b6c0 msgr2=0x7fc23c19bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc23a800700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c10b6c0 0x7fc23c19bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc23a800700 1 -- 172.21.15.70:0/2358527326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc23c106080 msgr2=0x7fc23c1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc23a800700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc23c106080 0x7fc23c1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc23a800700 1 -- 172.21.15.70:0/2358527326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c19c400 con 0x7fc23c1056c0 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc231e00700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc23c106080 0x7fc23c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:10:24.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc23a800700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 0x7fc23c1a1a50 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00d950 tx=0x7fc22c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc233e00700 1 -- 172.21.15.70:0/2358527326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c016070 con 0x7fc23c1056c0 2024-05-08T08:10:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc233e00700 1 -- 172.21.15.70:0/2358527326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc22c010460 con 0x7fc23c1056c0 2024-05-08T08:10:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c19c690 con 0x7fc23c1056c0 2024-05-08T08:10:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.355+0000 7fc233e00700 1 -- 172.21.15.70:0/2358527326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c00f620 con 0x7fc23c1056c0 2024-05-08T08:10:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.356+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc23c1a89d0 con 0x7fc23c1056c0 2024-05-08T08:10:24.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.357+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23c106e00 con 0x7fc23c1056c0 2024-05-08T08:10:24.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.359+0000 7fc233e00700 1 -- 172.21.15.70:0/2358527326 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc22c019070 con 0x7fc23c1056c0 2024-05-08T08:10:24.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.360+0000 7fc233e00700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2200b2a70 0x7fc2200b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:24.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.361+0000 7fc233e00700 1 -- 172.21.15.70:0/2358527326 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(245..245 src has 1..245) ==== 9583+0+0 (secure 0 0 0) 0x7fc22c0e25d0 con 0x7fc23c1056c0 2024-05-08T08:10:24.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.361+0000 7fc231e00700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2200b2a70 0x7fc2200b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:24.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.362+0000 7fc231e00700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2200b2a70 0x7fc2200b4f30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc224009e60 tx=0x7fc22400b7f0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:24.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.363+0000 7fc233e00700 1 -- 172.21.15.70:0/2358527326 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc22c0a9b30 con 0x7fc23c1056c0 2024-05-08T08:10:24.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:24 smithi172 ceph-mon[33377]: pgmap v2669: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-05-08T08:10:24.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:24 smithi194 ceph-mon[33679]: pgmap v2669: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.1 KiB/s wr, 6 op/s 2024-05-08T08:10:24.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.648+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc23c19cfe0 con 0x7fc23c1056c0 2024-05-08T08:10:24.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.650+0000 7fc233e00700 1 -- 172.21.15.70:0/2358527326 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fc22c0a9430 con 0x7fc23c1056c0 2024-05-08T08:10:24.645 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:10:24.645 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:10:24.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2200b2a70 msgr2=0x7fc2200b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:24.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2200b2a70 0x7fc2200b4f30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc224009e60 tx=0x7fc22400b7f0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 msgr2=0x7fc23c1a1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:24.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 0x7fc23c1a1a50 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00d950 tx=0x7fc22c00dd10 comp rx=0 tx=0).stop 2024-05-08T08:10:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 shutdown_connections 2024-05-08T08:10:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2200b2a70 0x7fc2200b4f30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c10b6c0 0x7fc23c19bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc23c1056c0 0x7fc23c1a1a50 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 --2- 172.21.15.70:0/2358527326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc23c106080 0x7fc23c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:24.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.653+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 >> 172.21.15.70:0/2358527326 conn(0x7fc23c1011b0 msgr2=0x7fc23c1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:24.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.654+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 shutdown_connections 2024-05-08T08:10:24.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:24.654+0000 7fc241400700 1 -- 172.21.15.70:0/2358527326 wait complete. 2024-05-08T08:10:24.649 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:10:25.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:25 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2358527326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:10:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:25 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2358527326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:10:25.467 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id dcfd0beb --release --await' 2024-05-08T08:10:25.467 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id dcfd0beb --release --await 2024-05-08T08:10:25.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:25 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2358527326' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:10:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:10:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:26 smithi070 ceph-mon[29591]: pgmap v2670: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:10:26.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:26 smithi172 ceph-mon[33377]: pgmap v2670: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:10:26.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:26 smithi194 ceph-mon[33679]: pgmap v2670: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:10:27.295 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:27 smithi070 ceph-mon[29591]: pgmap v2671: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:10:27.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:27 smithi172 ceph-mon[33377]: pgmap v2671: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:10:27.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:27 smithi194 ceph-mon[33679]: pgmap v2671: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:10:28.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.688+0000 7f42dbc00700 1 -- 172.21.15.70:0/48069424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 msgr2=0x7f42d4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:28.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.688+0000 7f42dbc00700 1 --2- 172.21.15.70:0/48069424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 0x7f42d4110330 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00b0a0 tx=0x7f42cc00b3b0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.688+0000 7f42dbc00700 1 -- 172.21.15.70:0/48069424 shutdown_connections 2024-05-08T08:10:28.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.688+0000 7f42dbc00700 1 --2- 172.21.15.70:0/48069424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 0x7f42d4110330 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.688+0000 7f42dbc00700 1 --2- 172.21.15.70:0/48069424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d4109510 0x7f42d41098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.688+0000 7f42dbc00700 1 --2- 172.21.15.70:0/48069424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42d406b180 0x7f42d406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.688+0000 7f42dbc00700 1 -- 172.21.15.70:0/48069424 >> 172.21.15.70:0/48069424 conn(0x7f42d4079350 msgr2=0x7f42d4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:28.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.688+0000 7f42dbc00700 1 -- 172.21.15.70:0/48069424 shutdown_connections 2024-05-08T08:10:28.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.688+0000 7f42dbc00700 1 -- 172.21.15.70:0/48069424 wait complete. 2024-05-08T08:10:28.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.689+0000 7f42dbc00700 1 Processor -- start 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.689+0000 7f42dbc00700 1 -- start start 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42dbc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d406b180 0x7f42d41a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42dbc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 0x7f42d41a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42dbc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42d4109510 0x7f42d419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42dbc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42d41135a0 con 0x7f42d406bb40 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42dbc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4113420 con 0x7f42d406b180 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42dbc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4113720 con 0x7f42d4109510 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42cbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 0x7f42d41a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42cbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 0x7f42d41a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47610/0 (socket says 172.21.15.70:47610) 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42cbe00700 1 -- 172.21.15.70:0/2309871489 learned_addr learned my addr 172.21.15.70:0/2309871489 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42d9c00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42d4109510 0x7f42d419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42d9200700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d406b180 0x7f42d41a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42cbe00700 1 -- 172.21.15.70:0/2309871489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42d4109510 msgr2=0x7f42d419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:28.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42cbe00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42d4109510 0x7f42d419ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42cbe00700 1 -- 172.21.15.70:0/2309871489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d406b180 msgr2=0x7f42d41a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:28.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42cbe00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d406b180 0x7f42d41a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.690+0000 7f42cbe00700 1 -- 172.21.15.70:0/2309871489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d419c1c0 con 0x7f42d406bb40 2024-05-08T08:10:28.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.691+0000 7f42d9200700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d406b180 0x7f42d41a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:10:28.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.691+0000 7f42cbe00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 0x7f42d41a1de0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f42c400b530 tx=0x7f42c400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:28.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.691+0000 7f42d2000700 1 -- 172.21.15.70:0/2309871489 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4015020 con 0x7f42d406bb40 2024-05-08T08:10:28.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.691+0000 7f42d2000700 1 -- 172.21.15.70:0/2309871489 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c4011cc0 con 0x7f42d406bb40 2024-05-08T08:10:28.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.691+0000 7f42d2000700 1 -- 172.21.15.70:0/2309871489 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4010d30 con 0x7f42d406bb40 2024-05-08T08:10:28.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.691+0000 7f42dbc00700 1 -- 172.21.15.70:0/2309871489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d419c450 con 0x7f42d406bb40 2024-05-08T08:10:28.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.691+0000 7f42dbc00700 1 -- 172.21.15.70:0/2309871489 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d41a8770 con 0x7f42d406bb40 2024-05-08T08:10:28.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.695+0000 7f42d2000700 1 -- 172.21.15.70:0/2309871489 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f42c4018020 con 0x7f42d406bb40 2024-05-08T08:10:28.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.696+0000 7f42d2000700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42b40b29f0 0x7f42b40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.697+0000 7f42d2000700 1 -- 172.21.15.70:0/2309871489 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(245..245 src has 1..245) ==== 9583+0+0 (secure 0 0 0) 0x7f42c40e2220 con 0x7f42d406bb40 2024-05-08T08:10:28.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.697+0000 7f42d9200700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42b40b29f0 0x7f42b40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.697+0000 7f42d9200700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42b40b29f0 0x7f42b40b4eb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005fd0 tx=0x7f42bc005e40 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.711+0000 7f42e6603b80 1 Processor -- start 2024-05-08T08:10:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.711+0000 7f42e6603b80 1 -- start start 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.712+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f3550252a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.712+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 0x55f35501f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.712+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f35502bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.712+0000 7f42e6603b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f354f71b20 con 0x55f355024ec0 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.712+0000 7f42e6603b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f354f0f860 con 0x55f35501fe50 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.712+0000 7f42e6603b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f354f6dae0 con 0x55f35501f490 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.712+0000 7f42d9200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f3550252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.712+0000 7f42d9200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f3550252a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47624/0 (socket says 172.21.15.70:47624) 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.712+0000 7f42d9200700 1 -- 172.21.15.70:0/2308474526 learned_addr learned my addr 172.21.15.70:0/2308474526 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42cbe00700 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 0x55f35501f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42d9c00700 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f35502bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42d9200700 1 -- 172.21.15.70:0/2308474526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 msgr2=0x55f35501f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42d9200700 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 0x55f35501f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42d9200700 1 -- 172.21.15.70:0/2308474526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 msgr2=0x55f35502bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42d9200700 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f35502bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42d9200700 1 -- 172.21.15.70:0/2308474526 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f354ebe9d0 con 0x55f355024ec0 2024-05-08T08:10:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42d9c00700 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f35502bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:10:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42d9200700 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f3550252a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00dc30 tx=0x7f42bc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd7609c02b5958e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42ca000700 1 -- 172.21.15.70:0/2308474526 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc020070 con 0x55f355024ec0 2024-05-08T08:10:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42ca000700 1 -- 172.21.15.70:0/2308474526 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42bc01c450 con 0x55f355024ec0 2024-05-08T08:10:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.713+0000 7f42ca000700 1 -- 172.21.15.70:0/2308474526 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc01b5f0 con 0x55f355024ec0 2024-05-08T08:10:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.714+0000 7f42e6603b80 1 -- 172.21.15.70:0/2308474526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 msgr2=0x55f3550252a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.714+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f3550252a0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00dc30 tx=0x7f42bc010000 comp rx=0 tx=0).stop 2024-05-08T08:10:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.714+0000 7f42e6603b80 1 -- 172.21.15.70:0/2308474526 shutdown_connections 2024-05-08T08:10:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.714+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f35502bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.714+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f3550252a0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.714+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2308474526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 0x55f35501f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.714+0000 7f42e6603b80 1 -- 172.21.15.70:0/2308474526 >> 172.21.15.70:0/2308474526 conn(0x55f354f4dc60 msgr2=0x55f355019d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.715+0000 7f42e6603b80 1 -- 172.21.15.70:0/2308474526 shutdown_connections 2024-05-08T08:10:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.715+0000 7f42e6603b80 1 -- 172.21.15.70:0/2308474526 wait complete. 2024-05-08T08:10:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.715+0000 7f42e6603b80 1 -- start start 2024-05-08T08:10:28.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.715+0000 7f42e6603b80 1 Processor -- start 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 0x55f35502b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f355028c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f355029150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42e6603b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f35502c280 con 0x55f355024ec0 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42e6603b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f354ed7c20 con 0x55f35501fe50 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42e6603b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f35502c400 con 0x55f35501f490 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42e6603b80 10 client.0 _ll_register_callbacks cb 0x55f354f18d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42d9c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f355029150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42d9c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f355029150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47630/0 (socket says 172.21.15.70:47630) 2024-05-08T08:10:28.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42d9c00700 1 -- 172.21.15.70:0/3191259421 learned_addr learned my addr 172.21.15.70:0/3191259421 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.716+0000 7f42d9200700 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 0x55f35502b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.717+0000 7f42cbe00700 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f355028c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.717+0000 7f42d9c00700 1 -- 172.21.15.70:0/3191259421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 msgr2=0x55f35502b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.717+0000 7f42d9c00700 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 0x55f35502b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.717+0000 7f42d9c00700 1 -- 172.21.15.70:0/3191259421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 msgr2=0x55f355028c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.717+0000 7f42d9c00700 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f355028c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.717+0000 7f42d9c00700 1 -- 172.21.15.70:0/3191259421 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f354f37520 con 0x55f355024ec0 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.717+0000 7f42d9c00700 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f355029150 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0062a0 tx=0x7f42cc004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b0091e318d5077 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.717+0000 7f42c2a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.717+0000 7f42c2a00700 1 -- 172.21.15.70:0/3191259421 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc022070 con 0x55f355024ec0 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.718+0000 7f42c2a00700 1 -- 172.21.15.70:0/3191259421 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(245..245 src has 1..245) ==== 9583+0+0 (secure 0 0 0) 0x7f42cc0078f0 con 0x55f355024ec0 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.718+0000 7f42e6603b80 1 -- 172.21.15.70:0/3191259421 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42bc01c450 con 0x55f355024ec0 2024-05-08T08:10:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.718+0000 7f42c2a00700 1 -- 172.21.15.70:0/3191259421 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f42cc02e050 con 0x55f355024ec0 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.718+0000 7f42e6603b80 10 client.17703 fetch_fsmap learned FSMap version 42 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.718+0000 7f42e6603b80 1 -- 172.21.15.70:0/3191259421 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f3550369f0 con 0x55f355024ec0 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.718+0000 7f42c2a00700 1 -- 172.21.15.70:0/3191259421 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42bc01c450 con 0x55f355024ec0 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.718+0000 7f42c2a00700 1 -- 172.21.15.70:0/3191259421 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f42cc011070 con 0x55f355024ec0 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.719+0000 7f42e6603b80 10 client.17703 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.719+0000 7f42e6603b80 10 client.17703 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.719+0000 7f42e6603b80 20 client.17703 populate_metadata read hostname 'smithi070' 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.719+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f355038fd0 0x55f35503b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.719+0000 7f42e6603b80 4 client.17703 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:10:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.719+0000 7f42e6603b80 1 -- 172.21.15.70:0/3191259421 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f354fec1a0 con 0x55f355038fd0 2024-05-08T08:10:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.719+0000 7f42d9200700 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f355038fd0 0x55f35503b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.720+0000 7f42d9200700 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f355038fd0 0x55f35503b3c0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=903ad55bcc322015 server_cookie=1b30d67259daf224 in_seq=0 out_seq=0 2024-05-08T08:10:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.720+0000 7f42c2a00700 10 client.17703 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.722+0000 7f42c2a00700 1 -- 172.21.15.70:0/3191259421 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f354fec1a0 con 0x55f355038fd0 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.722+0000 7f42c2a00700 10 client.17703 handle_command_reply: tid=0 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 client.17703 shutdown 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 -- 172.21.15.70:0/3191259421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 msgr2=0x55f355029150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f355029150 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0062a0 tx=0x7f42cc004d30 comp rx=0 tx=0).stop 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 -- 172.21.15.70:0/3191259421 shutdown_connections 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f355038fd0 0x55f35503b3c0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f355024ec0 0x55f355029150 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501f490 0x55f35502b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3191259421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f355028c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 -- 172.21.15.70:0/3191259421 >> 172.21.15.70:0/3191259421 conn(0x55f354f4dc60 msgr2=0x55f355014850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42c2a00700 0 client.17703 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:10:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 -- 172.21.15.70:0/3191259421 shutdown_connections 2024-05-08T08:10:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 1 -- 172.21.15.70:0/3191259421 wait complete. 2024-05-08T08:10:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.723+0000 7f42e6603b80 20 client.17703 trim_cache size 0 max 16384 2024-05-08T08:10:28.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.745+0000 7f42e6603b80 1 Processor -- start 2024-05-08T08:10:28.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.745+0000 7f42e6603b80 1 -- start start 2024-05-08T08:10:28.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.746+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f355035310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.746+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f355040c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.746+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f355024ec0 0x55f3550411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.746+0000 7f42e6603b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42d41b3fe0 con 0x55f35501f490 2024-05-08T08:10:28.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.746+0000 7f42e6603b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42d41b1870 con 0x55f35501fe50 2024-05-08T08:10:28.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.746+0000 7f42e6603b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42d41af6e0 con 0x55f355024ec0 2024-05-08T08:10:28.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.746+0000 7f42d9200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f355035310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.746+0000 7f42d9200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f355035310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47636/0 (socket says 172.21.15.70:47636) 2024-05-08T08:10:28.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.746+0000 7f42d9200700 1 -- 172.21.15.70:0/3079847348 learned_addr learned my addr 172.21.15.70:0/3079847348 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.747+0000 7f42d9c00700 1 --2- 172.21.15.70:0/3079847348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f355024ec0 0x55f3550411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.747+0000 7f42cbe00700 1 --2- 172.21.15.70:0/3079847348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f355040c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.747+0000 7f42d9200700 1 -- 172.21.15.70:0/3079847348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f355024ec0 msgr2=0x55f3550411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.747+0000 7f42d9200700 1 --2- 172.21.15.70:0/3079847348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f355024ec0 0x55f3550411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.747+0000 7f42d9200700 1 -- 172.21.15.70:0/3079847348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 msgr2=0x55f355040c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.747+0000 7f42d9200700 1 --2- 172.21.15.70:0/3079847348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f355040c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.747+0000 7f42d9200700 1 -- 172.21.15.70:0/3079847348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f355016980 con 0x55f35501f490 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.747+0000 7f42d9200700 1 --2- 172.21.15.70:0/3079847348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f355035310 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f42bc01cdb0 tx=0x7f42bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597b9d8d9f5c976f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.748+0000 7f42c9600700 1 -- 172.21.15.70:0/3079847348 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc020040 con 0x55f35501f490 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.748+0000 7f42c9600700 1 -- 172.21.15.70:0/3079847348 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42bc039070 con 0x55f35501f490 2024-05-08T08:10:28.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.748+0000 7f42c9600700 1 -- 172.21.15.70:0/3079847348 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc025450 con 0x55f35501f490 2024-05-08T08:10:28.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.748+0000 7f42e6603b80 1 -- 172.21.15.70:0/3079847348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 msgr2=0x55f355035310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.748+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3079847348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f355035310 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f42bc01cdb0 tx=0x7f42bc004750 comp rx=0 tx=0).stop 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.749+0000 7f42e6603b80 1 -- 172.21.15.70:0/3079847348 shutdown_connections 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.749+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3079847348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f355024ec0 0x55f3550411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.749+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3079847348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f355035310 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.749+0000 7f42e6603b80 1 --2- 172.21.15.70:0/3079847348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f35501fe50 0x55f355040c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.749+0000 7f42e6603b80 1 -- 172.21.15.70:0/3079847348 >> 172.21.15.70:0/3079847348 conn(0x55f354f4dc60 msgr2=0x55f35501ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.749+0000 7f42e6603b80 1 -- 172.21.15.70:0/3079847348 shutdown_connections 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.749+0000 7f42e6603b80 1 -- 172.21.15.70:0/3079847348 wait complete. 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.749+0000 7f42e6603b80 1 -- start start 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.749+0000 7f42e6603b80 1 Processor -- start 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f3550314e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501fe50 0x55f355031a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42e6603b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f355024ec0 0x55f35502fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42e6603b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42d41afd30 con 0x55f35501f490 2024-05-08T08:10:28.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42e6603b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42d41b11a0 con 0x55f355024ec0 2024-05-08T08:10:28.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42e6603b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42d41b0400 con 0x55f35501fe50 2024-05-08T08:10:28.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42e6603b80 10 client.0 _ll_register_callbacks cb 0x55f354f18d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:10:28.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42d9200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f3550314e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42d9200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f3550314e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47644/0 (socket says 172.21.15.70:47644) 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42d9200700 1 -- 172.21.15.70:0/2402141105 learned_addr learned my addr 172.21.15.70:0/2402141105 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.750+0000 7f42cbe00700 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501fe50 0x55f355031a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42d9c00700 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f355024ec0 0x55f35502fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42d9200700 1 -- 172.21.15.70:0/2402141105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501fe50 msgr2=0x55f355031a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42d9200700 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501fe50 0x55f355031a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42d9200700 1 -- 172.21.15.70:0/2402141105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f355024ec0 msgr2=0x55f35502fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42d9200700 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f355024ec0 0x55f35502fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42d9200700 1 -- 172.21.15.70:0/2402141105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3550300f0 con 0x55f35501f490 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42d9c00700 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f355024ec0 0x55f35502fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42d9200700 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f3550314e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00e010 tx=0x7f42bc00f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b78dadcc92c860 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42c2a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:10:28.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42c2a00700 1 -- 172.21.15.70:0/2402141105 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc044060 con 0x55f35501f490 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42c2a00700 1 -- 172.21.15.70:0/2402141105 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(245..245 src has 1..245) ==== 9583+0+0 (secure 0 0 0) 0x7f42bc00fa50 con 0x55f35501f490 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.751+0000 7f42e6603b80 1 -- 172.21.15.70:0/2402141105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42bc039070 con 0x55f35501f490 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42c2a00700 1 -- 172.21.15.70:0/2402141105 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f42bc020040 con 0x55f35501f490 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42e6603b80 10 client.17709 fetch_fsmap learned FSMap version 42 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42e6603b80 1 -- 172.21.15.70:0/2402141105 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f3550acb30 con 0x55f35501f490 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42c2a00700 1 -- 172.21.15.70:0/2402141105 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42bc039070 con 0x55f35501f490 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42c2a00700 1 -- 172.21.15.70:0/2402141105 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f42bc033860 con 0x55f35501f490 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42e6603b80 10 client.17709 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42e6603b80 10 client.17709 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42e6603b80 20 client.17709 populate_metadata read hostname 'smithi070' 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f3550ad010 0x55f3550af430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42e6603b80 4 client.17709 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "dcfd0beb", "release": true, "await": true}] 2024-05-08T08:10:28.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.752+0000 7f42e6603b80 1 -- 172.21.15.70:0/2402141105 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "dcfd0beb", "release": true, "await": true}) -- 0x55f354f7f500 con 0x55f3550ad010 2024-05-08T08:10:28.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.753+0000 7f42cbe00700 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f3550ad010 0x55f3550af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:28.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.754+0000 7f42cbe00700 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f3550ad010 0x55f3550af430 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9134b8fff41e65e server_cookie=9d3bb0d6fec18ff9 in_seq=0 out_seq=0 2024-05-08T08:10:28.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:28.754+0000 7f42c2a00700 10 client.17709 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:10:30.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:30 smithi070 ceph-mon[29591]: pgmap v2672: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2024-05-08T08:10:30.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:30 smithi172 ceph-mon[33377]: pgmap v2672: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2024-05-08T08:10:30.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:30 smithi194 ceph-mon[33679]: pgmap v2672: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2024-05-08T08:10:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:32 smithi070 ceph-mon[29591]: pgmap v2673: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T08:10:32.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:32 smithi172 ceph-mon[33377]: pgmap v2673: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T08:10:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:32 smithi194 ceph-mon[33679]: pgmap v2673: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T08:10:33.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.244+0000 7f42c2a00700 1 -- 172.21.15.70:0/2402141105 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55f354f7f500 con 0x55f3550ad010 2024-05-08T08:10:33.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.244+0000 7f42c2a00700 10 client.17709 handle_command_reply: tid=0 2024-05-08T08:10:33.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.244+0000 7f42e6603b80 1 client.17709 shutdown 2024-05-08T08:10:33.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.244+0000 7f42e6603b80 1 -- 172.21.15.70:0/2402141105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 msgr2=0x55f3550314e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:33.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.244+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f3550314e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00e010 tx=0x7f42bc00f920 comp rx=0 tx=0).stop 2024-05-08T08:10:33.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.245+0000 7f42e6603b80 1 -- 172.21.15.70:0/2402141105 shutdown_connections 2024-05-08T08:10:33.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.245+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f3550ad010 0x55f3550af430 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:33.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.245+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f355024ec0 0x55f35502fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:33.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.245+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f35501f490 0x55f3550314e0 secure :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00e010 tx=0x7f42bc00f920 comp rx=0 tx=0).stop 2024-05-08T08:10:33.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.245+0000 7f42e6603b80 1 --2- 172.21.15.70:0/2402141105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f35501fe50 0x55f355031a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:33.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.245+0000 7f42e6603b80 1 -- 172.21.15.70:0/2402141105 >> 172.21.15.70:0/2402141105 conn(0x55f354f4dc60 msgr2=0x55f355013fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:33.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.245+0000 7f42c2a00700 0 client.17709 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:10:33.242 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:10:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:10:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:10:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 196, 2024-05-08T08:10:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:10:33.242 INFO:teuthology.orchestra.run.smithi070.stdout: "dcfd0beb": { 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 196, 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.8, 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:10:33.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:10:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:10:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:10:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:10:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:10:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:10:33.244 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:10:33.244 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:10:33.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.245+0000 7f42e6603b80 1 -- 172.21.15.70:0/2402141105 shutdown_connections 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.246+0000 7f42e6603b80 1 -- 172.21.15.70:0/2402141105 wait complete. 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.246+0000 7f42e6603b80 20 client.17709 trim_cache size 0 max 16384 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.247+0000 7f42dbc00700 1 -- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42b40b29f0 msgr2=0x7f42b40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.247+0000 7f42dbc00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42b40b29f0 0x7f42b40b4eb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005fd0 tx=0x7f42bc005e40 comp rx=0 tx=0).stop 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.247+0000 7f42dbc00700 1 -- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 msgr2=0x7f42d41a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.247+0000 7f42dbc00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 0x7f42d41a1de0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f42c400b530 tx=0x7f42c400b8f0 comp rx=0 tx=0).stop 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.249+0000 7f42dbc00700 1 -- 172.21.15.70:0/2309871489 shutdown_connections 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.249+0000 7f42dbc00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42b40b29f0 0x7f42b40b4eb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.249+0000 7f42dbc00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42d4109510 0x7f42d419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.249+0000 7f42dbc00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42d406b180 0x7f42d41a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.249+0000 7f42dbc00700 1 --2- 172.21.15.70:0/2309871489 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42d406bb40 0x7f42d41a1de0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.249+0000 7f42dbc00700 1 -- 172.21.15.70:0/2309871489 >> 172.21.15.70:0/2309871489 conn(0x7f42d4079350 msgr2=0x7f42d410e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.249+0000 7f42dbc00700 1 -- 172.21.15.70:0/2309871489 shutdown_connections 2024-05-08T08:10:33.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:33.250+0000 7f42dbc00700 1 -- 172.21.15.70:0/2309871489 wait complete. 2024-05-08T08:10:33.494 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/machine_kexec_64.o 2024-05-08T08:10:33.695 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/manager.o 2024-05-08T08:10:34.180 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/profile.o 2024-05-08T08:10:34.301 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'dcfd0beb', seconds elapsed: 74.4 2024-05-08T08:10:34.302 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.75 2024-05-08T08:10:34.302 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:10:34.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:34 smithi070 ceph-mon[29591]: pgmap v2674: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:10:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:34 smithi172 ceph-mon[33377]: pgmap v2674: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:10:34.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:34 smithi194 ceph-mon[33679]: pgmap v2674: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:10:34.860 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:10:35.251 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dspkginit.o 2024-05-08T08:10:35.609 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/pci/hda/hda_hwdep.o 2024-05-08T08:10:35.725 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/plist.o 2024-05-08T08:10:36.284 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/flow_offload.o 2024-05-08T08:10:36.307 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:36 smithi070 ceph-mon[29591]: pgmap v2675: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 114 KiB/s wr, 11 op/s 2024-05-08T08:10:36.330 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfstrace.o 2024-05-08T08:10:36.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:36 smithi172 ceph-mon[33377]: pgmap v2675: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 114 KiB/s wr, 11 op/s 2024-05-08T08:10:36.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:36 smithi194 ceph-mon[33679]: pgmap v2675: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 114 KiB/s wr, 11 op/s 2024-05-08T08:10:37.049 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/radix-tree.o 2024-05-08T08:10:37.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.214+0000 7f893aa00700 1 -- 172.21.15.70:0/3032239248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89341060a0 msgr2=0x7f89341125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:37.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.214+0000 7f893aa00700 1 --2- 172.21.15.70:0/3032239248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89341060a0 0x7f89341125b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f892c009f90 tx=0x7f892c00b330 comp rx=0 tx=0).stop 2024-05-08T08:10:37.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.215+0000 7f893aa00700 1 -- 172.21.15.70:0/3032239248 shutdown_connections 2024-05-08T08:10:37.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.215+0000 7f893aa00700 1 --2- 172.21.15.70:0/3032239248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89341060a0 0x7f89341125b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.215+0000 7f893aa00700 1 --2- 172.21.15.70:0/3032239248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f893410b6e0 0x7f893410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.215+0000 7f893aa00700 1 --2- 172.21.15.70:0/3032239248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89341056e0 0x7f8934105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.215+0000 7f893aa00700 1 -- 172.21.15.70:0/3032239248 >> 172.21.15.70:0/3032239248 conn(0x7f89341011d0 msgr2=0x7f89341035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:37.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.215+0000 7f893aa00700 1 -- 172.21.15.70:0/3032239248 shutdown_connections 2024-05-08T08:10:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.215+0000 7f893aa00700 1 -- 172.21.15.70:0/3032239248 wait complete. 2024-05-08T08:10:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.216+0000 7f893aa00700 1 Processor -- start 2024-05-08T08:10:37.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.217+0000 7f893aa00700 1 -- start start 2024-05-08T08:10:37.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.217+0000 7f893aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89341056e0 0x7f89341a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:37.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.217+0000 7f893aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89341060a0 0x7f89341a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:37.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.217+0000 7f893aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f893410b6e0 0x7f893419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:37.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.217+0000 7f893aa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8934115790 con 0x7f893410b6e0 2024-05-08T08:10:37.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.217+0000 7f893aa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8934115610 con 0x7f89341060a0 2024-05-08T08:10:37.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.217+0000 7f893aa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8934115910 con 0x7f89341056e0 2024-05-08T08:10:37.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8938a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f893410b6e0 0x7f893419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:37.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8933400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89341060a0 0x7f89341a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8933400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89341060a0 0x7f89341a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:32770/0 (socket says 172.21.15.70:32770) 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8933400700 1 -- 172.21.15.70:0/1386859369 learned_addr learned my addr 172.21.15.70:0/1386859369 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8933e00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89341056e0 0x7f89341a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8938a00700 1 -- 172.21.15.70:0/1386859369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89341056e0 msgr2=0x7f89341a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8938a00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89341056e0 0x7f89341a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8938a00700 1 -- 172.21.15.70:0/1386859369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89341060a0 msgr2=0x7f89341a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8938a00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89341060a0 0x7f89341a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.218+0000 7f8938a00700 1 -- 172.21.15.70:0/1386859369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893419c210 con 0x7f893410b6e0 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.219+0000 7f8933e00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89341056e0 0x7f89341a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:10:37.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.219+0000 7f8938a00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f893410b6e0 0x7f893419bab0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f892c009790 tx=0x7f892c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:37.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.219+0000 7f8930c00700 1 -- 172.21.15.70:0/1386859369 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c021070 con 0x7f893410b6e0 2024-05-08T08:10:37.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.220+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893419c4a0 con 0x7f893410b6e0 2024-05-08T08:10:37.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.220+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89341a87c0 con 0x7f893410b6e0 2024-05-08T08:10:37.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.220+0000 7f8930c00700 1 -- 172.21.15.70:0/1386859369 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f892c007ac0 con 0x7f893410b6e0 2024-05-08T08:10:37.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.220+0000 7f8930c00700 1 -- 172.21.15.70:0/1386859369 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c005040 con 0x7f893410b6e0 2024-05-08T08:10:37.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.221+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8914005330 con 0x7f893410b6e0 2024-05-08T08:10:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.225+0000 7f8930c00700 1 -- 172.21.15.70:0/1386859369 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f892c024070 con 0x7f893410b6e0 2024-05-08T08:10:37.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.228+0000 7f8930c00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89180b2af0 0x7f89180b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:37.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.228+0000 7f8930c00700 1 -- 172.21.15.70:0/1386859369 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(245..245 src has 1..245) ==== 9583+0+0 (secure 0 0 0) 0x7f892c00f020 con 0x7f893410b6e0 2024-05-08T08:10:37.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.229+0000 7f8933e00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89180b2af0 0x7f89180b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.230+0000 7f8933e00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89180b2af0 0x7f89180b4fb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f893419cbf0 tx=0x7f8924009310 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:37.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.231+0000 7f8930c00700 1 -- 172.21.15.70:0/1386859369 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f892c02b020 con 0x7f893410b6e0 2024-05-08T08:10:37.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:37 smithi070 ceph-mon[29591]: pgmap v2676: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 114 KiB/s wr, 9 op/s 2024-05-08T08:10:37.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:37 smithi172 ceph-mon[33377]: pgmap v2676: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 114 KiB/s wr, 9 op/s 2024-05-08T08:10:37.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:37 smithi194 ceph-mon[33679]: pgmap v2676: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 114 KiB/s wr, 9 op/s 2024-05-08T08:10:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.690+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8914005620 con 0x7f893410b6e0 2024-05-08T08:10:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.692+0000 7f8930c00700 1 -- 172.21.15.70:0/1386859369 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f892c0ab800 con 0x7f893410b6e0 2024-05-08T08:10:37.686 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:10:37.686 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:10:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.695+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89180b2af0 msgr2=0x7f89180b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.695+0000 7f893aa00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89180b2af0 0x7f89180b4fb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f893419cbf0 tx=0x7f8924009310 comp rx=0 tx=0).stop 2024-05-08T08:10:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.695+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f893410b6e0 msgr2=0x7f893419bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.695+0000 7f893aa00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f893410b6e0 0x7f893419bab0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f892c009790 tx=0x7f892c00ccb0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.696+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 shutdown_connections 2024-05-08T08:10:37.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.696+0000 7f893aa00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f89180b2af0 0x7f89180b4fb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.696+0000 7f893aa00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f893410b6e0 0x7f893419bab0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.696+0000 7f893aa00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f89341056e0 0x7f89341a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.696+0000 7f893aa00700 1 --2- 172.21.15.70:0/1386859369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f89341060a0 0x7f89341a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:37.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.696+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 >> 172.21.15.70:0/1386859369 conn(0x7f89341011d0 msgr2=0x7f8934101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:37.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.697+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 shutdown_connections 2024-05-08T08:10:37.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:37.697+0000 7f893aa00700 1 -- 172.21.15.70:0/1386859369 wait complete. 2024-05-08T08:10:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:10:38.392 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:38 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1386859369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:10:38.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:38 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1386859369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:10:38.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:38 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1386859369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:10:38.889 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 86.75 --await-for 42.0' 2024-05-08T08:10:38.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 86.75 --await-for 42.0 2024-05-08T08:10:39.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:39 smithi172 ceph-mon[33377]: pgmap v2677: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 114 KiB/s wr, 9 op/s 2024-05-08T08:10:39.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:39 smithi194 ceph-mon[33679]: pgmap v2677: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 114 KiB/s wr, 9 op/s 2024-05-08T08:10:39.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:39 smithi070 ceph-mon[29591]: pgmap v2677: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 114 KiB/s wr, 9 op/s 2024-05-08T08:10:40.685 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/support.o 2024-05-08T08:10:40.753 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:10:42.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:42 smithi070 ceph-mon[29591]: pgmap v2678: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 256 KiB/s wr, 16 op/s 2024-05-08T08:10:42.164 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dsutils.o 2024-05-08T08:10:42.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:42 smithi172 ceph-mon[33377]: pgmap v2678: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 256 KiB/s wr, 16 op/s 2024-05-08T08:10:42.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:42 smithi194 ceph-mon[33679]: pgmap v2678: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 256 KiB/s wr, 16 op/s 2024-05-08T08:10:43.106 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/stacktrace.o 2024-05-08T08:10:43.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.588+0000 7f455f600700 1 -- 172.21.15.70:0/3783234186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4558101620 msgr2=0x7f4558101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:43.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.588+0000 7f455f600700 1 --2- 172.21.15.70:0/3783234186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4558101620 0x7f4558101aa0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f45440099c0 tx=0x7f4544009cd0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.588+0000 7f455f600700 1 -- 172.21.15.70:0/3783234186 shutdown_connections 2024-05-08T08:10:43.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.588+0000 7f455f600700 1 --2- 172.21.15.70:0/3783234186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4558101fe0 0x7f4558110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.588+0000 7f455f600700 1 --2- 172.21.15.70:0/3783234186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45581095e0 0x7f45581099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.588+0000 7f455f600700 1 --2- 172.21.15.70:0/3783234186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4558101620 0x7f4558101aa0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.588+0000 7f455f600700 1 -- 172.21.15.70:0/3783234186 >> 172.21.15.70:0/3783234186 conn(0x7f45580785d0 msgr2=0x7f45580ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:43.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.588+0000 7f455f600700 1 -- 172.21.15.70:0/3783234186 shutdown_connections 2024-05-08T08:10:43.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.588+0000 7f455f600700 1 -- 172.21.15.70:0/3783234186 wait complete. 2024-05-08T08:10:43.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.590+0000 7f455f600700 1 Processor -- start 2024-05-08T08:10:43.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.590+0000 7f455f600700 1 -- start start 2024-05-08T08:10:43.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f455f600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4558101620 0x7f4558103090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f455f600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4558101fe0 0x7f45581035d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f455f600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45581095e0 0x7f4558103b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f455f600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45581135c0 con 0x7f45581095e0 2024-05-08T08:10:43.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f455f600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4558113440 con 0x7f4558101620 2024-05-08T08:10:43.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f455f600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4558113740 con 0x7f4558101fe0 2024-05-08T08:10:43.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f455cc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4558101620 0x7f4558103090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f4557e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4558101fe0 0x7f45581035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f455d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45581095e0 0x7f4558103b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f4557e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4558101fe0 0x7f45581035d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:43034/0 (socket says 172.21.15.70:43034) 2024-05-08T08:10:43.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.591+0000 7f4557e00700 1 -- 172.21.15.70:0/3736913014 learned_addr learned my addr 172.21.15.70:0/3736913014 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:43.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.592+0000 7f455d600700 1 -- 172.21.15.70:0/3736913014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4558101fe0 msgr2=0x7f45581035d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:43.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.592+0000 7f455d600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4558101fe0 0x7f45581035d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.592+0000 7f455d600700 1 -- 172.21.15.70:0/3736913014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4558101620 msgr2=0x7f4558103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:43.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.592+0000 7f455d600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4558101620 0x7f4558103090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.592+0000 7f455d600700 1 -- 172.21.15.70:0/3736913014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45581a8000 con 0x7f45581095e0 2024-05-08T08:10:43.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.592+0000 7f455d600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45581095e0 0x7f4558103b10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f455000efb0 tx=0x7f455000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:43.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.593+0000 7f4555600700 1 -- 172.21.15.70:0/3736913014 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550003a00 con 0x7f45581095e0 2024-05-08T08:10:43.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.593+0000 7f4555600700 1 -- 172.21.15.70:0/3736913014 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f455000ce30 con 0x7f45581095e0 2024-05-08T08:10:43.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.593+0000 7f4555600700 1 -- 172.21.15.70:0/3736913014 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45500046b0 con 0x7f45581095e0 2024-05-08T08:10:43.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.593+0000 7f455f600700 1 -- 172.21.15.70:0/3736913014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45581a82f0 con 0x7f45581095e0 2024-05-08T08:10:43.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.593+0000 7f455f600700 1 -- 172.21.15.70:0/3736913014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45581a87b0 con 0x7f45581095e0 2024-05-08T08:10:43.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.599+0000 7f4555600700 1 -- 172.21.15.70:0/3736913014 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4550012050 con 0x7f45581095e0 2024-05-08T08:10:43.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.601+0000 7f4555600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f45400b2b20 0x7f45400b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.602+0000 7f4555600700 1 -- 172.21.15.70:0/3736913014 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(245..245 src has 1..245) ==== 9583+0+0 (secure 0 0 0) 0x7f45500e2380 con 0x7f45581095e0 2024-05-08T08:10:43.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.602+0000 7f455cc00700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f45400b2b20 0x7f45400b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.603+0000 7f455cc00700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f45400b2b20 0x7f45400b4fe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f454c0045b0 tx=0x7f454c00b3c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.617+0000 7f456a050b80 1 Processor -- start 2024-05-08T08:10:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.618+0000 7f456a050b80 1 -- start start 2024-05-08T08:10:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.618+0000 7f456a050b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c5c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.618+0000 7f456a050b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c569a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.618+0000 7f456a050b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c62d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.618+0000 7f456a050b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555e59ba8bb0 con 0x555e59c56ee0 2024-05-08T08:10:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.618+0000 7f456a050b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555e59b468f0 con 0x555e59c5bf50 2024-05-08T08:10:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.618+0000 7f456a050b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555e59ba4b70 con 0x555e59c56520 2024-05-08T08:10:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.619+0000 7f455cc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c5c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.619+0000 7f455d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c62d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.619+0000 7f455d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c62d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42686/0 (socket says 172.21.15.70:42686) 2024-05-08T08:10:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.619+0000 7f455d600700 1 -- 172.21.15.70:0/2464485326 learned_addr learned my addr 172.21.15.70:0/2464485326 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:43.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.619+0000 7f4557e00700 1 --2- 172.21.15.70:0/2464485326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.620+0000 7f455d600700 1 -- 172.21.15.70:0/2464485326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 msgr2=0x555e59c569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.620+0000 7f455d600700 1 --2- 172.21.15.70:0/2464485326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.620+0000 7f455d600700 1 -- 172.21.15.70:0/2464485326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 msgr2=0x555e59c5c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:43.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.620+0000 7f455d600700 1 --2- 172.21.15.70:0/2464485326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c5c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.620+0000 7f455d600700 1 -- 172.21.15.70:0/2464485326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e59af5a60 con 0x555e59c56ee0 2024-05-08T08:10:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.620+0000 7f455cc00700 1 --2- 172.21.15.70:0/2464485326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c5c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:10:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.620+0000 7f455d600700 1 --2- 172.21.15.70:0/2464485326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c62d10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f45500090a0 tx=0x7f45500a8c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b43b7a488a53ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.621+0000 7f454a000700 1 -- 172.21.15.70:0/2464485326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45500a8d80 con 0x555e59c56ee0 2024-05-08T08:10:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.621+0000 7f454a000700 1 -- 172.21.15.70:0/2464485326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45500a9970 con 0x555e59c56ee0 2024-05-08T08:10:43.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.621+0000 7f454a000700 1 -- 172.21.15.70:0/2464485326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45500a5580 con 0x555e59c56ee0 2024-05-08T08:10:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.622+0000 7f456a050b80 1 -- 172.21.15.70:0/2464485326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 msgr2=0x555e59c62d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.622+0000 7f456a050b80 1 --2- 172.21.15.70:0/2464485326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c62d10 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f45500090a0 tx=0x7f45500a8c40 comp rx=0 tx=0).stop 2024-05-08T08:10:43.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.622+0000 7f456a050b80 1 -- 172.21.15.70:0/2464485326 shutdown_connections 2024-05-08T08:10:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.622+0000 7f456a050b80 1 --2- 172.21.15.70:0/2464485326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c62d10 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.622+0000 7f456a050b80 1 --2- 172.21.15.70:0/2464485326 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c5c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.622+0000 7f456a050b80 1 --2- 172.21.15.70:0/2464485326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.623+0000 7f456a050b80 1 -- 172.21.15.70:0/2464485326 >> 172.21.15.70:0/2464485326 conn(0x555e59b84cf0 msgr2=0x555e59c50e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.623+0000 7f456a050b80 1 -- 172.21.15.70:0/2464485326 shutdown_connections 2024-05-08T08:10:43.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.623+0000 7f456a050b80 1 -- 172.21.15.70:0/2464485326 wait complete. 2024-05-08T08:10:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.624+0000 7f456a050b80 1 -- start start 2024-05-08T08:10:43.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.624+0000 7f456a050b80 1 Processor -- start 2024-05-08T08:10:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.625+0000 7f456a050b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c62960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.625+0000 7f456a050b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c5fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.625+0000 7f456a050b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c60240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.625+0000 7f456a050b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555e59c63310 con 0x555e59c56ee0 2024-05-08T08:10:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.625+0000 7f456a050b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555e59b0ecb0 con 0x555e59c5bf50 2024-05-08T08:10:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.625+0000 7f456a050b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555e59c63490 con 0x555e59c56520 2024-05-08T08:10:43.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.625+0000 7f456a050b80 10 client.0 _ll_register_callbacks cb 0x555e59b4fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:10:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.625+0000 7f4557e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c5fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.626+0000 7f455cc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c62960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.626+0000 7f455cc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c62960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:43046/0 (socket says 172.21.15.70:43046) 2024-05-08T08:10:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.626+0000 7f455cc00700 1 -- 172.21.15.70:0/1615592586 learned_addr learned my addr 172.21.15.70:0/1615592586 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:43.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.626+0000 7f455d600700 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c60240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.626+0000 7f4557e00700 1 -- 172.21.15.70:0/1615592586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 msgr2=0x555e59c62960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.626+0000 7f4557e00700 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c62960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.626+0000 7f4557e00700 1 -- 172.21.15.70:0/1615592586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 msgr2=0x555e59c60240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.626+0000 7f4557e00700 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c60240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.626+0000 7f4557e00700 1 -- 172.21.15.70:0/1615592586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e59b6e5b0 con 0x555e59c56ee0 2024-05-08T08:10:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.627+0000 7f4557e00700 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c5fd00 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4544005b40 tx=0x7f45440057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d74f34e3c509498 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:43.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.627+0000 7f453ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:10:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.628+0000 7f453ea00700 1 -- 172.21.15.70:0/1615592586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4544003bd0 con 0x555e59c56ee0 2024-05-08T08:10:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.628+0000 7f453ea00700 1 -- 172.21.15.70:0/1615592586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(245..245 src has 1..245) ==== 9583+0+0 (secure 0 0 0) 0x7f4544003d70 con 0x555e59c56ee0 2024-05-08T08:10:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.628+0000 7f456a050b80 1 -- 172.21.15.70:0/1615592586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45500a9970 con 0x555e59c56ee0 2024-05-08T08:10:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.628+0000 7f453ea00700 1 -- 172.21.15.70:0/1615592586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4544032050 con 0x555e59c56ee0 2024-05-08T08:10:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.628+0000 7f456a050b80 10 client.17727 fetch_fsmap learned FSMap version 42 2024-05-08T08:10:43.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.628+0000 7f456a050b80 1 -- 172.21.15.70:0/1615592586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555e59c76360 con 0x555e59c56ee0 2024-05-08T08:10:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.629+0000 7f453ea00700 1 -- 172.21.15.70:0/1615592586 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45500a9970 con 0x555e59c56ee0 2024-05-08T08:10:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.629+0000 7f453ea00700 1 -- 172.21.15.70:0/1615592586 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f454400f580 con 0x555e59c56ee0 2024-05-08T08:10:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.629+0000 7f456a050b80 10 client.17727 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:10:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.629+0000 7f456a050b80 10 client.17727 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:10:43.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.629+0000 7f456a050b80 20 client.17727 populate_metadata read hostname 'smithi070' 2024-05-08T08:10:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.629+0000 7f456a050b80 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555e59c789a0 0x555e59c7ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.629+0000 7f456a050b80 4 client.17727 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:10:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.629+0000 7f456a050b80 1 -- 172.21.15.70:0/1615592586 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e59c23230 con 0x555e59c789a0 2024-05-08T08:10:43.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.630+0000 7f455cc00700 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555e59c789a0 0x555e59c7ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.631+0000 7f455cc00700 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555e59c789a0 0x555e59c7ad90 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=519ebef4539baa7f server_cookie=b56b9b7f81aff8a3 in_seq=0 out_seq=0 2024-05-08T08:10:43.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.631+0000 7f453ea00700 10 client.17727 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:10:43.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f453ea00700 1 -- 172.21.15.70:0/1615592586 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555e59c23230 con 0x555e59c789a0 2024-05-08T08:10:43.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f453ea00700 10 client.17727 handle_command_reply: tid=0 2024-05-08T08:10:43.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f456a050b80 1 client.17727 shutdown 2024-05-08T08:10:43.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f456a050b80 1 -- 172.21.15.70:0/1615592586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 msgr2=0x555e59c5fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:43.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f456a050b80 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c5fd00 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4544005b40 tx=0x7f45440057c0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f456a050b80 1 -- 172.21.15.70:0/1615592586 shutdown_connections 2024-05-08T08:10:43.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f456a050b80 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555e59c789a0 0x555e59c7ad90 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f456a050b80 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c60240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f456a050b80 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c62960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f453ea00700 0 client.17727 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:10:43.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f456a050b80 1 --2- 172.21.15.70:0/1615592586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c5fd00 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.633+0000 7f456a050b80 1 -- 172.21.15.70:0/1615592586 >> 172.21.15.70:0/1615592586 conn(0x555e59b84cf0 msgr2=0x555e59c4b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:43.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.634+0000 7f456a050b80 1 -- 172.21.15.70:0/1615592586 shutdown_connections 2024-05-08T08:10:43.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.634+0000 7f456a050b80 1 -- 172.21.15.70:0/1615592586 wait complete. 2024-05-08T08:10:43.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.634+0000 7f456a050b80 20 client.17727 trim_cache size 0 max 16384 2024-05-08T08:10:43.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.672+0000 7f456a050b80 1 Processor -- start 2024-05-08T08:10:43.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.672+0000 7f456a050b80 1 -- start start 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.672+0000 7f456a050b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c74c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.672+0000 7f456a050b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c80640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.672+0000 7f456a050b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c80b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.672+0000 7f456a050b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45581afb80 con 0x555e59c56ee0 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.672+0000 7f456a050b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45581ad410 con 0x555e59c5bf50 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.672+0000 7f456a050b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f45581ab280 con 0x555e59c56520 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f4557e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c80640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f4557e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c80640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42696/0 (socket says 172.21.15.70:42696) 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f4557e00700 1 -- 172.21.15.70:0/4180731898 learned_addr learned my addr 172.21.15.70:0/4180731898 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:43.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f455cc00700 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c74c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f4557e00700 1 -- 172.21.15.70:0/4180731898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 msgr2=0x555e59c74c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:43.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f455d600700 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c80b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f4557e00700 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c74c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f4557e00700 1 -- 172.21.15.70:0/4180731898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 msgr2=0x555e59c80b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:43.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f4557e00700 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c80b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.673+0000 7f4557e00700 1 -- 172.21.15.70:0/4180731898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e59c625a0 con 0x555e59c56ee0 2024-05-08T08:10:43.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.674+0000 7f455cc00700 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c74c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:10:43.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.674+0000 7f455d600700 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c80b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:10:43.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.674+0000 7f4557e00700 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c80640 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f454400f940 tx=0x7f4544009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df65f1923e19417d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:43.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.674+0000 7f4549600700 1 -- 172.21.15.70:0/4180731898 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454403a070 con 0x555e59c56ee0 2024-05-08T08:10:43.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.674+0000 7f4549600700 1 -- 172.21.15.70:0/4180731898 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4544009e60 con 0x555e59c56ee0 2024-05-08T08:10:43.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.674+0000 7f4549600700 1 -- 172.21.15.70:0/4180731898 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454400b6b0 con 0x555e59c56ee0 2024-05-08T08:10:43.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.675+0000 7f456a050b80 1 -- 172.21.15.70:0/4180731898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 msgr2=0x555e59c80640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:10:43.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.675+0000 7f456a050b80 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c80640 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f454400f940 tx=0x7f4544009310 comp rx=0 tx=0).stop 2024-05-08T08:10:43.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.676+0000 7f456a050b80 1 -- 172.21.15.70:0/4180731898 shutdown_connections 2024-05-08T08:10:43.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.676+0000 7f456a050b80 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c5bf50 0x555e59c80b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.676+0000 7f456a050b80 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c56520 0x555e59c74c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.676+0000 7f456a050b80 1 --2- 172.21.15.70:0/4180731898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59c56ee0 0x555e59c80640 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.676+0000 7f456a050b80 1 -- 172.21.15.70:0/4180731898 >> 172.21.15.70:0/4180731898 conn(0x555e59b84cf0 msgr2=0x555e59c55da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:10:43.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.676+0000 7f456a050b80 1 -- 172.21.15.70:0/4180731898 shutdown_connections 2024-05-08T08:10:43.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.676+0000 7f456a050b80 1 -- 172.21.15.70:0/4180731898 wait complete. 2024-05-08T08:10:43.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.677+0000 7f456a050b80 1 -- start start 2024-05-08T08:10:43.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.677+0000 7f456a050b80 1 Processor -- start 2024-05-08T08:10:43.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.678+0000 7f456a050b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c56520 0x555e59c6e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.678+0000 7f456a050b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c5bf50 0x555e59c6e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.678+0000 7f456a050b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59ce11f0 0x555e59ce35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.678+0000 7f456a050b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45581ab8d0 con 0x555e59ce11f0 2024-05-08T08:10:43.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.678+0000 7f456a050b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f45581acd40 con 0x555e59c56520 2024-05-08T08:10:43.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.678+0000 7f456a050b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f45581abfa0 con 0x555e59c5bf50 2024-05-08T08:10:43.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.678+0000 7f456a050b80 10 client.0 _ll_register_callbacks cb 0x555e59b4fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:10:43.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.678+0000 7f455d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59ce11f0 0x555e59ce35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.678+0000 7f455cc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c56520 0x555e59c6e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.679+0000 7f455d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59ce11f0 0x555e59ce35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42710/0 (socket says 172.21.15.70:42710) 2024-05-08T08:10:43.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.679+0000 7f455d600700 1 -- 172.21.15.70:0/1620276881 learned_addr learned my addr 172.21.15.70:0/1620276881 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:10:43.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.679+0000 7f4557e00700 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c5bf50 0x555e59c6e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.679+0000 7f455d600700 1 -- 172.21.15.70:0/1620276881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c5bf50 msgr2=0x555e59c6e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:43.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.679+0000 7f455d600700 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c5bf50 0x555e59c6e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.679+0000 7f455d600700 1 -- 172.21.15.70:0/1620276881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c56520 msgr2=0x555e59c6e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:10:43.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.679+0000 7f455d600700 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c56520 0x555e59c6e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:10:43.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.679+0000 7f455d600700 1 -- 172.21.15.70:0/1620276881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e59ce3b70 con 0x555e59ce11f0 2024-05-08T08:10:43.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.680+0000 7f455d600700 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59ce11f0 0x555e59ce35e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f45500a8f70 tx=0x7f45500b1e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1312d83da81a4f7e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:10:43.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.680+0000 7f453ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:10:43.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.680+0000 7f453ea00700 1 -- 172.21.15.70:0/1620276881 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45500a8d80 con 0x555e59ce11f0 2024-05-08T08:10:43.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.680+0000 7f456a050b80 1 -- 172.21.15.70:0/1620276881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4544009e60 con 0x555e59ce11f0 2024-05-08T08:10:43.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.681+0000 7f453ea00700 1 -- 172.21.15.70:0/1620276881 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(245..245 src has 1..245) ==== 9583+0+0 (secure 0 0 0) 0x7f45500a5860 con 0x555e59ce11f0 2024-05-08T08:10:43.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.681+0000 7f453ea00700 1 -- 172.21.15.70:0/1620276881 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f45500a9970 con 0x555e59ce11f0 2024-05-08T08:10:43.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.681+0000 7f456a050b80 10 client.17733 fetch_fsmap learned FSMap version 42 2024-05-08T08:10:43.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.681+0000 7f456a050b80 1 -- 172.21.15.70:0/1620276881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555e59ce4e10 con 0x555e59ce11f0 2024-05-08T08:10:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.682+0000 7f453ea00700 1 -- 172.21.15.70:0/1620276881 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4544009e60 con 0x555e59ce11f0 2024-05-08T08:10:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.682+0000 7f453ea00700 1 -- 172.21.15.70:0/1620276881 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4550004bd0 con 0x555e59ce11f0 2024-05-08T08:10:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.682+0000 7f456a050b80 10 client.17733 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:10:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.682+0000 7f456a050b80 10 client.17733 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:10:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.682+0000 7f456a050b80 20 client.17733 populate_metadata read hostname 'smithi070' 2024-05-08T08:10:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.682+0000 7f456a050b80 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555e59ce51a0 0x555e59ce7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:10:43.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.682+0000 7f456a050b80 4 client.17733 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.75, "await_for": 42.0}] 2024-05-08T08:10:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.682+0000 7f456a050b80 1 -- 172.21.15.70:0/1620276881 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.75, "await_for": 42.0}) -- 0x555e59bb6590 con 0x555e59ce51a0 2024-05-08T08:10:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.683+0000 7f455cc00700 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555e59ce51a0 0x555e59ce7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:10:43.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.684+0000 7f455cc00700 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555e59ce51a0 0x555e59ce7590 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b449324791e5e549 server_cookie=9fa31b2a1c0f0914 in_seq=0 out_seq=0 2024-05-08T08:10:43.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:10:43.684+0000 7f453ea00700 10 client.17733 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:10:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:44 smithi070 ceph-mon[29591]: pgmap v2679: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 256 KiB/s wr, 13 op/s 2024-05-08T08:10:44.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:44 smithi172 ceph-mon[33377]: pgmap v2679: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 256 KiB/s wr, 13 op/s 2024-05-08T08:10:44.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:44 smithi194 ceph-mon[33679]: pgmap v2679: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 256 KiB/s wr, 13 op/s 2024-05-08T08:10:44.982 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/ratelimit.o 2024-05-08T08:10:46.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:46 smithi070 ceph-mon[29591]: pgmap v2680: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 487 KiB/s wr, 24 op/s 2024-05-08T08:10:46.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:46 smithi172 ceph-mon[33377]: pgmap v2680: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 487 KiB/s wr, 24 op/s 2024-05-08T08:10:46.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:46 smithi194 ceph-mon[33679]: pgmap v2680: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 487 KiB/s wr, 24 op/s 2024-05-08T08:10:48.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:48 smithi070 ceph-mon[29591]: pgmap v2681: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 373 KiB/s wr, 18 op/s 2024-05-08T08:10:48.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:48 smithi172 ceph-mon[33377]: pgmap v2681: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 373 KiB/s wr, 18 op/s 2024-05-08T08:10:48.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:48 smithi194 ceph-mon[33679]: pgmap v2681: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 373 KiB/s wr, 18 op/s 2024-05-08T08:10:49.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:49 smithi070 ceph-mon[29591]: pgmap v2682: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 374 KiB/s wr, 18 op/s 2024-05-08T08:10:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:49 smithi172 ceph-mon[33377]: pgmap v2682: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 374 KiB/s wr, 18 op/s 2024-05-08T08:10:49.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:49 smithi194 ceph-mon[33679]: pgmap v2682: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 374 KiB/s wr, 18 op/s 2024-05-08T08:10:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:52 smithi070 ceph-mon[29591]: pgmap v2683: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 378 KiB/s wr, 22 op/s 2024-05-08T08:10:52.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:52 smithi172 ceph-mon[33377]: pgmap v2683: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 378 KiB/s wr, 22 op/s 2024-05-08T08:10:52.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:52 smithi194 ceph-mon[33679]: pgmap v2683: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 378 KiB/s wr, 22 op/s 2024-05-08T08:10:54.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:54 smithi070 ceph-mon[29591]: pgmap v2684: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 236 KiB/s wr, 16 op/s 2024-05-08T08:10:54.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:54 smithi172 ceph-mon[33377]: pgmap v2684: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 236 KiB/s wr, 16 op/s 2024-05-08T08:10:54.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:54 smithi194 ceph-mon[33679]: pgmap v2684: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 236 KiB/s wr, 16 op/s 2024-05-08T08:10:56.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:56 smithi070 ceph-mon[29591]: pgmap v2685: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 320 KiB/s wr, 20 op/s 2024-05-08T08:10:56.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:56 smithi172 ceph-mon[33377]: pgmap v2685: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 320 KiB/s wr, 20 op/s 2024-05-08T08:10:56.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:56 smithi194 ceph-mon[33679]: pgmap v2685: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 320 KiB/s wr, 20 op/s 2024-05-08T08:10:57.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:10:57 smithi070 ceph-mon[29591]: pgmap v2686: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-05-08T08:10:57.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:10:57 smithi172 ceph-mon[33377]: pgmap v2686: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-05-08T08:10:57.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:10:57 smithi194 ceph-mon[33679]: pgmap v2686: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-05-08T08:11:00.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:00 smithi070 ceph-mon[29591]: pgmap v2687: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-05-08T08:11:00.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:00 smithi172 ceph-mon[33377]: pgmap v2687: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-05-08T08:11:00.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:00 smithi194 ceph-mon[33679]: pgmap v2687: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 90 KiB/s wr, 9 op/s 2024-05-08T08:11:02.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:02 smithi070 ceph-mon[29591]: pgmap v2688: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 151 KiB/s wr, 12 op/s 2024-05-08T08:11:02.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:02 smithi172 ceph-mon[33377]: pgmap v2688: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 151 KiB/s wr, 12 op/s 2024-05-08T08:11:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:02 smithi194 ceph-mon[33679]: pgmap v2688: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 151 KiB/s wr, 12 op/s 2024-05-08T08:11:03.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:03 smithi172 ceph-mon[33377]: pgmap v2689: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 146 KiB/s wr, 7 op/s 2024-05-08T08:11:03.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:03 smithi194 ceph-mon[33679]: pgmap v2689: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 146 KiB/s wr, 7 op/s 2024-05-08T08:11:03.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:03 smithi070 ceph-mon[29591]: pgmap v2689: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 146 KiB/s wr, 7 op/s 2024-05-08T08:11:06.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:06 smithi070 ceph-mon[29591]: pgmap v2690: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 147 KiB/s wr, 12 op/s 2024-05-08T08:11:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.426+0000 7f453ea00700 1 -- 172.21.15.70:0/1620276881 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x555e59bb6590 con 0x555e59ce51a0 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.426+0000 7f453ea00700 10 client.17733 handle_command_reply: tid=0 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.426+0000 7f456a050b80 1 client.17733 shutdown 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.427+0000 7f456a050b80 1 -- 172.21.15.70:0/1620276881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59ce11f0 msgr2=0x555e59ce35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.427+0000 7f456a050b80 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59ce11f0 0x555e59ce35e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f45500a8f70 tx=0x7f45500b1e60 comp rx=0 tx=0).stop 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.428+0000 7f456a050b80 1 -- 172.21.15.70:0/1620276881 shutdown_connections 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.428+0000 7f456a050b80 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555e59ce51a0 0x555e59ce7590 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.428+0000 7f456a050b80 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555e59ce11f0 0x555e59ce35e0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.428+0000 7f456a050b80 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555e59c56520 0x555e59c6e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.428+0000 7f456a050b80 1 --2- 172.21.15.70:0/1620276881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555e59c5bf50 0x555e59c6e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.428+0000 7f453ea00700 0 client.17733 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.428+0000 7f456a050b80 1 -- 172.21.15.70:0/1620276881 >> 172.21.15.70:0/1620276881 conn(0x555e59b84cf0 msgr2=0x555e59c599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.429+0000 7f456a050b80 1 -- 172.21.15.70:0/1620276881 shutdown_connections 2024-05-08T08:11:06.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:06 smithi172 ceph-mon[33377]: pgmap v2690: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 147 KiB/s wr, 12 op/s 2024-05-08T08:11:06.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.429+0000 7f456a050b80 1 -- 172.21.15.70:0/1620276881 wait complete. 2024-05-08T08:11:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.429+0000 7f456a050b80 20 client.17733 trim_cache size 0 max 16384 2024-05-08T08:11:06.425 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:11:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:11:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:11:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 198, 2024-05-08T08:11:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:11:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "b6ce0bc7": { 2024-05-08T08:11:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 198, 2024-05-08T08:11:06.425 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.8, 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:06.426 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:06.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:06.427 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:11:06.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.430+0000 7f455f600700 1 -- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f45400b2b20 msgr2=0x7f45400b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:06.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.430+0000 7f455f600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f45400b2b20 0x7f45400b4fe0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f454c0045b0 tx=0x7f454c00b3c0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.430+0000 7f455f600700 1 -- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45581095e0 msgr2=0x7f4558103b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.430+0000 7f455f600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45581095e0 0x7f4558103b10 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f455000efb0 tx=0x7f455000c3a0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.431+0000 7f455f600700 1 -- 172.21.15.70:0/3736913014 shutdown_connections 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.431+0000 7f455f600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f45400b2b20 0x7f45400b4fe0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.431+0000 7f455f600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45581095e0 0x7f4558103b10 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.431+0000 7f455f600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4558101620 0x7f4558103090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.431+0000 7f455f600700 1 --2- 172.21.15.70:0/3736913014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4558101fe0 0x7f45581035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.431+0000 7f455f600700 1 -- 172.21.15.70:0/3736913014 >> 172.21.15.70:0/3736913014 conn(0x7f45580785d0 msgr2=0x7f45580ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.431+0000 7f455f600700 1 -- 172.21.15.70:0/3736913014 shutdown_connections 2024-05-08T08:11:06.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:06.431+0000 7f455f600700 1 -- 172.21.15.70:0/3736913014 wait complete. 2024-05-08T08:11:06.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:06 smithi194 ceph-mon[33679]: pgmap v2690: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 147 KiB/s wr, 12 op/s 2024-05-08T08:11:08.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:08 smithi070 ceph-mon[29591]: pgmap v2691: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:11:08.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:08 smithi172 ceph-mon[33377]: pgmap v2691: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:11:08.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:08 smithi194 ceph-mon[33679]: pgmap v2691: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:11:08.677 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b6ce0bc7', quiesce took 34.4 seconds. Will release after: 26.75 2024-05-08T08:11:09.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:09 smithi172 ceph-mon[33377]: pgmap v2692: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:11:09.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:09 smithi194 ceph-mon[33679]: pgmap v2692: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:11:09.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:09 smithi070 ceph-mon[29591]: pgmap v2692: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:11:11.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:11 smithi172 ceph-mon[33377]: osdmap e246: 12 total, 12 up, 12 in 2024-05-08T08:11:11.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:11 smithi172 ceph-mon[33377]: pgmap v2694: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 29 op/s 2024-05-08T08:11:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:11 smithi194 ceph-mon[33679]: osdmap e246: 12 total, 12 up, 12 in 2024-05-08T08:11:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:11 smithi194 ceph-mon[33679]: pgmap v2694: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 29 op/s 2024-05-08T08:11:11.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:11 smithi070 ceph-mon[29591]: osdmap e246: 12 total, 12 up, 12 in 2024-05-08T08:11:11.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:11 smithi070 ceph-mon[29591]: pgmap v2694: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 29 op/s 2024-05-08T08:11:14.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:14 smithi070 ceph-mon[29591]: pgmap v2695: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 29 op/s 2024-05-08T08:11:14.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:14 smithi172 ceph-mon[33377]: pgmap v2695: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 29 op/s 2024-05-08T08:11:14.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:14 smithi194 ceph-mon[33679]: pgmap v2695: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 29 op/s 2024-05-08T08:11:16.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:16 smithi194 ceph-mon[33679]: pgmap v2696: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 27 op/s 2024-05-08T08:11:16.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:16 smithi070 ceph-mon[29591]: pgmap v2696: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 27 op/s 2024-05-08T08:11:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:16 smithi172 ceph-mon[33377]: pgmap v2696: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 27 op/s 2024-05-08T08:11:17.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:17 smithi070 ceph-mon[29591]: pgmap v2697: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 27 op/s 2024-05-08T08:11:17.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:17 smithi172 ceph-mon[33377]: pgmap v2697: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 27 op/s 2024-05-08T08:11:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:17 smithi194 ceph-mon[33679]: pgmap v2697: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 108 KiB/s wr, 27 op/s 2024-05-08T08:11:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:19 smithi194 ceph-mon[33679]: osdmap e247: 12 total, 12 up, 12 in 2024-05-08T08:11:20.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:19 smithi194 ceph-mon[33679]: pgmap v2699: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 5 op/s 2024-05-08T08:11:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:19 smithi070 ceph-mon[29591]: osdmap e247: 12 total, 12 up, 12 in 2024-05-08T08:11:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:19 smithi070 ceph-mon[29591]: pgmap v2699: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 5 op/s 2024-05-08T08:11:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:19 smithi172 ceph-mon[33377]: osdmap e247: 12 total, 12 up, 12 in 2024-05-08T08:11:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:19 smithi172 ceph-mon[33377]: pgmap v2699: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 5 op/s 2024-05-08T08:11:22.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:22 smithi070 ceph-mon[29591]: pgmap v2700: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 9 op/s 2024-05-08T08:11:22.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:22 smithi172 ceph-mon[33377]: pgmap v2700: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 9 op/s 2024-05-08T08:11:22.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:22 smithi194 ceph-mon[33679]: pgmap v2700: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 9 op/s 2024-05-08T08:11:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:23 smithi172 ceph-mon[33377]: pgmap v2701: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 9 op/s 2024-05-08T08:11:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:11:23.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:23 smithi194 ceph-mon[33679]: pgmap v2701: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 9 op/s 2024-05-08T08:11:23.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:11:23.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:23 smithi070 ceph-mon[29591]: pgmap v2701: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 9 op/s 2024-05-08T08:11:23.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:11:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:26 smithi070 ceph-mon[29591]: pgmap v2702: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-05-08T08:11:26.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:26.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:26.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:26.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:26 smithi172 ceph-mon[33377]: pgmap v2702: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-05-08T08:11:26.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:26.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:26.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:26.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:26 smithi194 ceph-mon[33679]: pgmap v2702: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-05-08T08:11:26.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:26.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:26.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:27 smithi194 ceph-mon[33679]: pgmap v2703: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-05-08T08:11:27.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:27 smithi070 ceph-mon[29591]: pgmap v2703: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-05-08T08:11:27.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:27.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:27 smithi172 ceph-mon[33377]: pgmap v2703: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-05-08T08:11:28.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:28 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:11:28.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:28 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:11:28.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:28 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:11:28.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:28 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:11:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:28 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:11:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:28 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:11:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:29 smithi070 ceph-mon[29591]: pgmap v2704: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2024-05-08T08:11:29.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:29 smithi172 ceph-mon[33377]: pgmap v2704: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2024-05-08T08:11:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:29 smithi194 ceph-mon[33679]: pgmap v2704: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 8 op/s 2024-05-08T08:11:32.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:32 smithi070 ceph-mon[29591]: pgmap v2705: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 8 op/s 2024-05-08T08:11:32.402 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:32 smithi172 ceph-mon[33377]: pgmap v2705: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 8 op/s 2024-05-08T08:11:32.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:32 smithi194 ceph-mon[33679]: pgmap v2705: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 8 op/s 2024-05-08T08:11:33.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:33 smithi070 ceph-mon[29591]: pgmap v2706: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T08:11:33.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:33 smithi172 ceph-mon[33377]: pgmap v2706: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T08:11:33.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:33 smithi194 ceph-mon[33679]: pgmap v2706: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T08:11:35.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:35.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:35.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:34 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:11:35.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:34 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:11:35.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:35.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:35.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:34 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:11:35.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:34 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:11:35.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:35.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:34 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:11:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:34 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:11:35.429 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:11:35.881 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:11:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: pgmap v2707: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T08:11:36.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:11:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:11:36.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: pgmap v2707: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:11:36.212 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: pgmap v2707: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T08:11:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:11:36.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:11:36.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:11:36.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:11:37.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:36 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:11:37.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:36 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:11:37.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:36 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:11:37.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:36 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:11:37.356 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:36 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:11:37.356 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:36 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:11:38.013 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:37 smithi070 ceph-mon[29591]: pgmap v2708: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T08:11:38.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:37 smithi172 ceph-mon[33377]: pgmap v2708: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T08:11:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.189+0000 7fee33200700 1 -- 172.21.15.70:0/1950662000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 msgr2=0x7fee341039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.189+0000 7fee33200700 1 --2- 172.21.15.70:0/1950662000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 0x7fee341039f0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fee240099c0 tx=0x7fee24009cd0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.189+0000 7fee33200700 1 -- 172.21.15.70:0/1950662000 shutdown_connections 2024-05-08T08:11:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.189+0000 7fee33200700 1 --2- 172.21.15.70:0/1950662000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee341086f0 0x7fee341102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.189+0000 7fee33200700 1 --2- 172.21.15.70:0/1950662000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 0x7fee341039f0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.189+0000 7fee33200700 1 --2- 172.21.15.70:0/1950662000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34103fc0 0x7fee34108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.189+0000 7fee33200700 1 -- 172.21.15.70:0/1950662000 >> 172.21.15.70:0/1950662000 conn(0x7fee340feec0 msgr2=0x7fee341012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.189+0000 7fee33200700 1 -- 172.21.15.70:0/1950662000 shutdown_connections 2024-05-08T08:11:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.189+0000 7fee33200700 1 -- 172.21.15.70:0/1950662000 wait complete. 2024-05-08T08:11:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.190+0000 7fee33200700 1 Processor -- start 2024-05-08T08:11:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.190+0000 7fee33200700 1 -- start start 2024-05-08T08:11:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.190+0000 7fee33200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 0x7fee341a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee33200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34103fc0 0x7fee341a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee33200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee341086f0 0x7fee3419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee33200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fee341134a0 con 0x7fee34103610 2024-05-08T08:11:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee33200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fee34113320 con 0x7fee341086f0 2024-05-08T08:11:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee33200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fee34113620 con 0x7fee34103fc0 2024-05-08T08:11:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee31e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 0x7fee341a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee31e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 0x7fee341a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43512/0 (socket says 172.21.15.70:43512) 2024-05-08T08:11:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee31e00700 1 -- 172.21.15.70:0/961116369 learned_addr learned my addr 172.21.15.70:0/961116369 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:11:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee32800700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee341086f0 0x7fee3419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.191+0000 7fee31400700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34103fc0 0x7fee341a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.192+0000 7fee31e00700 1 -- 172.21.15.70:0/961116369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34103fc0 msgr2=0x7fee341a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.192+0000 7fee31e00700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34103fc0 0x7fee341a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.192+0000 7fee31e00700 1 -- 172.21.15.70:0/961116369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee341086f0 msgr2=0x7fee3419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.192+0000 7fee31e00700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee341086f0 0x7fee3419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.192+0000 7fee31e00700 1 -- 172.21.15.70:0/961116369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee3419c1a0 con 0x7fee34103610 2024-05-08T08:11:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.192+0000 7fee31400700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34103fc0 0x7fee341a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:11:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.192+0000 7fee31e00700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 0x7fee341a1880 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fee2400b580 tx=0x7fee240047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:11:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.193+0000 7fee2aa00700 1 -- 172.21.15.70:0/961116369 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24027070 con 0x7fee34103610 2024-05-08T08:11:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.193+0000 7fee2aa00700 1 -- 172.21.15.70:0/961116369 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee2400fd30 con 0x7fee34103610 2024-05-08T08:11:38.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.193+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3419c430 con 0x7fee34103610 2024-05-08T08:11:38.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.193+0000 7fee2aa00700 1 -- 172.21.15.70:0/961116369 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24022e50 con 0x7fee34103610 2024-05-08T08:11:38.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.193+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee341a8750 con 0x7fee34103610 2024-05-08T08:11:38.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.194+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3406a190 con 0x7fee34103610 2024-05-08T08:11:38.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.196+0000 7fee2aa00700 1 -- 172.21.15.70:0/961116369 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fee2402a070 con 0x7fee34103610 2024-05-08T08:11:38.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.198+0000 7fee2aa00700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fee180b2c10 0x7fee180b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:38.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.198+0000 7fee2aa00700 1 -- 172.21.15.70:0/961116369 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(247..247 src has 1..247) ==== 9583+0+0 (secure 0 0 0) 0x7fee240e35e0 con 0x7fee34103610 2024-05-08T08:11:38.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.198+0000 7fee31400700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fee180b2c10 0x7fee180b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:38.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.199+0000 7fee31400700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fee180b2c10 0x7fee180b50d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fee340ff780 tx=0x7fee2000b2c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:11:38.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.202+0000 7fee2aa00700 1 -- 172.21.15.70:0/961116369 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fee24013070 con 0x7fee34103610 2024-05-08T08:11:38.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:37 smithi194 ceph-mon[33679]: pgmap v2708: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T08:11:38.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.487+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee3419cf70 con 0x7fee34103610 2024-05-08T08:11:38.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.490+0000 7fee2aa00700 1 -- 172.21.15.70:0/961116369 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fee240aac30 con 0x7fee34103610 2024-05-08T08:11:38.484 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:11:38.484 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:11:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fee180b2c10 msgr2=0x7fee180b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fee180b2c10 0x7fee180b50d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fee340ff780 tx=0x7fee2000b2c0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 msgr2=0x7fee341a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 0x7fee341a1880 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fee2400b580 tx=0x7fee240047b0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 shutdown_connections 2024-05-08T08:11:38.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fee180b2c10 0x7fee180b50d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fee341086f0 0x7fee3419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fee34103610 0x7fee341a1880 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 --2- 172.21.15.70:0/961116369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee34103fc0 0x7fee341a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:38.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 >> 172.21.15.70:0/961116369 conn(0x7fee340feec0 msgr2=0x7fee34100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:38.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.493+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 shutdown_connections 2024-05-08T08:11:38.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:38.494+0000 7fee33200700 1 -- 172.21.15.70:0/961116369 wait complete. 2024-05-08T08:11:38.489 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:11:39.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:38 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/961116369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:11:39.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:38 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/961116369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:11:39.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:38 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/961116369' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:11:39.372 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id b6ce0bc7 --release --await' 2024-05-08T08:11:39.372 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id b6ce0bc7 --release --await 2024-05-08T08:11:39.829 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:11:40.167 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:39 smithi070 ceph-mon[29591]: pgmap v2709: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T08:11:40.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:39 smithi172 ceph-mon[33377]: pgmap v2709: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T08:11:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:39 smithi194 ceph-mon[33679]: pgmap v2709: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 5 op/s 2024-05-08T08:11:41.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:41 smithi070 ceph-mon[29591]: pgmap v2710: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:11:41.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:41 smithi172 ceph-mon[33377]: pgmap v2710: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:11:41.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:41 smithi194 ceph-mon[33679]: pgmap v2710: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:11:42.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.634+0000 7f707f000700 1 -- 172.21.15.70:0/796447025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078107610 msgr2=0x7f707810f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.634+0000 7f707f000700 1 --2- 172.21.15.70:0/796447025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078107610 0x7f707810f1e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f707000b0d0 tx=0x7f707000b3e0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.634+0000 7f707f000700 1 -- 172.21.15.70:0/796447025 shutdown_connections 2024-05-08T08:11:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.634+0000 7f707f000700 1 --2- 172.21.15.70:0/796447025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078107610 0x7f707810f1e0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.634+0000 7f707f000700 1 --2- 172.21.15.70:0/796447025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7078102530 0x7f7078102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.634+0000 7f707f000700 1 --2- 172.21.15.70:0/796447025 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7078102ee0 0x7f7078106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.634+0000 7f707f000700 1 -- 172.21.15.70:0/796447025 >> 172.21.15.70:0/796447025 conn(0x7f70780fddc0 msgr2=0x7f70781001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.634+0000 7f707f000700 1 -- 172.21.15.70:0/796447025 shutdown_connections 2024-05-08T08:11:42.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.634+0000 7f707f000700 1 -- 172.21.15.70:0/796447025 wait complete. 2024-05-08T08:11:42.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.636+0000 7f707f000700 1 Processor -- start 2024-05-08T08:11:42.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.636+0000 7f707f000700 1 -- start start 2024-05-08T08:11:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707f000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7078102530 0x7f7078197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707f000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078102ee0 0x7f7078197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707f000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7078107610 0x7f707819c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707f000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7078111310 con 0x7f7078102ee0 2024-05-08T08:11:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707f000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7078111190 con 0x7f7078102530 2024-05-08T08:11:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707f000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7078111490 con 0x7f7078107610 2024-05-08T08:11:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078102ee0 0x7f7078197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078102ee0 0x7f7078197c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43542/0 (socket says 172.21.15.70:43542) 2024-05-08T08:11:42.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707d200700 1 -- 172.21.15.70:0/340105745 learned_addr learned my addr 172.21.15.70:0/340105745 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:11:42.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707dc00700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7078102530 0x7f7078197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.637+0000 7f707e600700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7078107610 0x7f707819c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.638+0000 7f707d200700 1 -- 172.21.15.70:0/340105745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7078107610 msgr2=0x7f707819c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.638+0000 7f707d200700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7078107610 0x7f707819c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.638+0000 7f707d200700 1 -- 172.21.15.70:0/340105745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7078102530 msgr2=0x7f7078197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.638+0000 7f707d200700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7078102530 0x7f7078197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.638+0000 7f707d200700 1 -- 172.21.15.70:0/340105745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707819c750 con 0x7f7078102ee0 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.638+0000 7f707e600700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7078107610 0x7f707819c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.638+0000 7f707d200700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078102ee0 0x7f7078197c80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f706800b500 tx=0x7f706800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.638+0000 7f7076000700 1 -- 172.21.15.70:0/340105745 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068015020 con 0x7f7078102ee0 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.639+0000 7f7076000700 1 -- 172.21.15.70:0/340105745 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7068011cc0 con 0x7f7078102ee0 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.639+0000 7f707f000700 1 -- 172.21.15.70:0/340105745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f707819ca40 con 0x7f7078102ee0 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.639+0000 7f7076000700 1 -- 172.21.15.70:0/340105745 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068010c80 con 0x7f7078102ee0 2024-05-08T08:11:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.639+0000 7f707f000700 1 -- 172.21.15.70:0/340105745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70781a42c0 con 0x7f7078102ee0 2024-05-08T08:11:42.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.642+0000 7f7076000700 1 -- 172.21.15.70:0/340105745 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7068018020 con 0x7f7078102ee0 2024-05-08T08:11:42.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.644+0000 7f7076000700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70600b4c80 0x7f70600b7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.644+0000 7f7076000700 1 -- 172.21.15.70:0/340105745 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(247..247 src has 1..247) ==== 9583+0+0 (secure 0 0 0) 0x7f70680e20f0 con 0x7f7078102ee0 2024-05-08T08:11:42.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.644+0000 7f707dc00700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70600b4c80 0x7f70600b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.645+0000 7f707dc00700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70600b4c80 0x7f70600b7140 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f706c005ea0 tx=0x7f706c005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:11:42.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.670+0000 7f708afc3b80 1 Processor -- start 2024-05-08T08:11:42.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.671+0000 7f708afc3b80 1 -- start start 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.671+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 0x55d0fabce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.671+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabc8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.671+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabc8ab0 0x55d0fabc8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.671+0000 7f708afc3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d0fab1ab20 con 0x55d0fabce880 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.671+0000 7f708afc3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d0faab8860 con 0x55d0fabcdf60 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.671+0000 7f708afc3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d0fab16ae0 con 0x55d0fabc8ab0 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabc8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabc8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43552/0 (socket says 172.21.15.70:43552) 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707d200700 1 -- 172.21.15.70:0/4051231141 learned_addr learned my addr 172.21.15.70:0/4051231141 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707dc00700 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 0x55d0fabce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707e600700 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabc8ab0 0x55d0fabc8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707d200700 1 -- 172.21.15.70:0/4051231141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabc8ab0 msgr2=0x55d0fabc8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:11:42.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707d200700 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabc8ab0 0x55d0fabc8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707d200700 1 -- 172.21.15.70:0/4051231141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 msgr2=0x55d0fabce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:11:42.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707d200700 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 0x55d0fabce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707d200700 1 -- 172.21.15.70:0/4051231141 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0faa679d0 con 0x55d0fabce880 2024-05-08T08:11:42.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.672+0000 7f707dc00700 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 0x55d0fabce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:11:42.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.673+0000 7f707d200700 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabc8490 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f70680a50e0 tx=0x7f70680a8bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c858bc0951f8e4b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:11:42.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.673+0000 7f7066a00700 1 -- 172.21.15.70:0/4051231141 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680ad410 con 0x55d0fabce880 2024-05-08T08:11:42.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.673+0000 7f7066a00700 1 -- 172.21.15.70:0/4051231141 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70680b1ec0 con 0x55d0fabce880 2024-05-08T08:11:42.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.673+0000 7f7066a00700 1 -- 172.21.15.70:0/4051231141 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7068018310 con 0x55d0fabce880 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.674+0000 7f708afc3b80 1 -- 172.21.15.70:0/4051231141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 msgr2=0x55d0fabc8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.674+0000 7f708afc3b80 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabc8490 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f70680a50e0 tx=0x7f70680a8bf0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.674+0000 7f708afc3b80 1 -- 172.21.15.70:0/4051231141 shutdown_connections 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.674+0000 7f708afc3b80 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabc8ab0 0x55d0fabc8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.674+0000 7f708afc3b80 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 0x55d0fabce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.674+0000 7f708afc3b80 1 --2- 172.21.15.70:0/4051231141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabc8490 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.674+0000 7f708afc3b80 1 -- 172.21.15.70:0/4051231141 >> 172.21.15.70:0/4051231141 conn(0x55d0faaf6c60 msgr2=0x55d0fabc2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.674+0000 7f708afc3b80 1 -- 172.21.15.70:0/4051231141 shutdown_connections 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.675+0000 7f708afc3b80 1 -- 172.21.15.70:0/4051231141 wait complete. 2024-05-08T08:11:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.675+0000 7f708afc3b80 1 -- start start 2024-05-08T08:11:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.675+0000 7f708afc3b80 1 Processor -- start 2024-05-08T08:11:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabc8ab0 0x55d0fabd4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 0x55d0fabd18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 0x55d0fabd1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f708afc3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d0fabd5340 con 0x55d0fabc8ab0 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f708afc3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55d0faa80c20 con 0x55d0fabcdf60 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f708afc3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55d0fabd54c0 con 0x55d0fabce880 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f708afc3b80 10 client.0 _ll_register_callbacks cb 0x55d0faac1d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f707dc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabc8ab0 0x55d0fabd4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f707dc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabc8ab0 0x55d0fabd4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43560/0 (socket says 172.21.15.70:43560) 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f707dc00700 1 -- 172.21.15.70:0/2824029305 learned_addr learned my addr 172.21.15.70:0/2824029305 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.676+0000 7f707e600700 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 0x55d0fabd1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f707d200700 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 0x55d0fabd18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f707dc00700 1 -- 172.21.15.70:0/2824029305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 msgr2=0x55d0fabd1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f707dc00700 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 0x55d0fabd1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f707dc00700 1 -- 172.21.15.70:0/2824029305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 msgr2=0x55d0fabd18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:11:42.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f707dc00700 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 0x55d0fabd18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f707dc00700 1 -- 172.21.15.70:0/2824029305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0faae0520 con 0x55d0fabc8ab0 2024-05-08T08:11:42.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f707e600700 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 0x55d0fabd1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:11:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f707dc00700 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabc8ab0 0x55d0fabd4530 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f706c010a90 tx=0x7f706c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5479b08ab0b84ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:11:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f705b400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:11:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f705b400700 1 -- 172.21.15.70:0/2824029305 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f706c00fa60 con 0x55d0fabc8ab0 2024-05-08T08:11:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.677+0000 7f705b400700 1 -- 172.21.15.70:0/2824029305 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(247..247 src has 1..247) ==== 9583+0+0 (secure 0 0 0) 0x7f706c00fc00 con 0x55d0fabc8ab0 2024-05-08T08:11:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.678+0000 7f708afc3b80 1 -- 172.21.15.70:0/2824029305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70680b1ec0 con 0x55d0fabc8ab0 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.678+0000 7f705b400700 1 -- 172.21.15.70:0/2824029305 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f706c02f050 con 0x55d0fabc8ab0 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.678+0000 7f708afc3b80 10 client.17751 fetch_fsmap learned FSMap version 42 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.678+0000 7f708afc3b80 1 -- 172.21.15.70:0/2824029305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55d0fabe3f70 con 0x55d0fabc8ab0 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.678+0000 7f705b400700 1 -- 172.21.15.70:0/2824029305 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70680b1ec0 con 0x55d0fabc8ab0 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.678+0000 7f705b400700 1 -- 172.21.15.70:0/2824029305 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f706c01d3c0 con 0x55d0fabc8ab0 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.679+0000 7f708afc3b80 10 client.17751 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.679+0000 7f708afc3b80 10 client.17751 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.679+0000 7f708afc3b80 20 client.17751 populate_metadata read hostname 'smithi070' 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.679+0000 7f708afc3b80 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d0fabe65b0 0x55d0fabe89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.679+0000 7f708afc3b80 4 client.17751 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.679+0000 7f708afc3b80 1 -- 172.21.15.70:0/2824029305 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0fab951a0 con 0x55d0fabe65b0 2024-05-08T08:11:42.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.679+0000 7f707d200700 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d0fabe65b0 0x55d0fabe89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.680+0000 7f705b400700 10 client.17751 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:11:42.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.680+0000 7f707d200700 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d0fabe65b0 0x55d0fabe89a0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f56868f45de7420a server_cookie=ce06591d4d733ed9 in_seq=0 out_seq=0 2024-05-08T08:11:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.682+0000 7f705b400700 1 -- 172.21.15.70:0/2824029305 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d0fab951a0 con 0x55d0fabe65b0 2024-05-08T08:11:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.682+0000 7f705b400700 10 client.17751 handle_command_reply: tid=0 2024-05-08T08:11:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.682+0000 7f708afc3b80 1 client.17751 shutdown 2024-05-08T08:11:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.682+0000 7f708afc3b80 1 -- 172.21.15.70:0/2824029305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabc8ab0 msgr2=0x55d0fabd4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.682+0000 7f708afc3b80 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabc8ab0 0x55d0fabd4530 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f706c010a90 tx=0x7f706c0047c0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.682+0000 7f708afc3b80 1 -- 172.21.15.70:0/2824029305 shutdown_connections 2024-05-08T08:11:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.682+0000 7f708afc3b80 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d0fabe65b0 0x55d0fabe89a0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.682+0000 7f708afc3b80 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 0x55d0fabd1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.683+0000 7f708afc3b80 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabc8ab0 0x55d0fabd4530 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.683+0000 7f708afc3b80 1 --2- 172.21.15.70:0/2824029305 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabcdf60 0x55d0fabd18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.683+0000 7f705b400700 0 client.17751 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:11:42.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.683+0000 7f708afc3b80 1 -- 172.21.15.70:0/2824029305 >> 172.21.15.70:0/2824029305 conn(0x55d0faaf6c60 msgr2=0x55d0fabc7480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:42.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.683+0000 7f708afc3b80 1 -- 172.21.15.70:0/2824029305 shutdown_connections 2024-05-08T08:11:42.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.683+0000 7f708afc3b80 1 -- 172.21.15.70:0/2824029305 wait complete. 2024-05-08T08:11:42.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.683+0000 7f708afc3b80 20 client.17751 trim_cache size 0 max 16384 2024-05-08T08:11:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.705+0000 7f708afc3b80 1 Processor -- start 2024-05-08T08:11:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.705+0000 7f708afc3b80 1 -- start start 2024-05-08T08:11:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.705+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 0x55d0fabbcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.705+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabcdf60 0x55d0fabee220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.705+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.705+0000 7f708afc3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70781afb60 con 0x55d0fabce880 2024-05-08T08:11:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.705+0000 7f708afc3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70781ad3f0 con 0x55d0fabc8ab0 2024-05-08T08:11:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.705+0000 7f708afc3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f70781ab260 con 0x55d0fabcdf60 2024-05-08T08:11:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707e600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707e600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabee760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43574/0 (socket says 172.21.15.70:43574) 2024-05-08T08:11:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707e600700 1 -- 172.21.15.70:0/1296013915 learned_addr learned my addr 172.21.15.70:0/1296013915 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:11:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707dc00700 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 0x55d0fabbcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707d200700 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabcdf60 0x55d0fabee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707e600700 1 -- 172.21.15.70:0/1296013915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabcdf60 msgr2=0x55d0fabee220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:11:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707e600700 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabcdf60 0x55d0fabee220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707e600700 1 -- 172.21.15.70:0/1296013915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 msgr2=0x55d0fabbcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:11:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707e600700 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 0x55d0fabbcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707e600700 1 -- 172.21.15.70:0/1296013915 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0fabe8fd0 con 0x55d0fabce880 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.706+0000 7f707dc00700 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 0x55d0fabbcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.707+0000 7f707e600700 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabee760 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7070009350 tx=0x7f7070009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500544f0d3ce9958 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.707+0000 7f7066000700 1 -- 172.21.15.70:0/1296013915 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070004cd0 con 0x55d0fabce880 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.707+0000 7f7066000700 1 -- 172.21.15.70:0/1296013915 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7070007970 con 0x55d0fabce880 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.707+0000 7f7066000700 1 -- 172.21.15.70:0/1296013915 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7070026870 con 0x55d0fabce880 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 -- 172.21.15.70:0/1296013915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 msgr2=0x55d0fabee760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabee760 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7070009350 tx=0x7f7070009380 comp rx=0 tx=0).stop 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 -- 172.21.15.70:0/1296013915 shutdown_connections 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabce880 0x55d0fabee760 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 0x55d0fabbcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 --2- 172.21.15.70:0/1296013915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabcdf60 0x55d0fabee220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 -- 172.21.15.70:0/1296013915 >> 172.21.15.70:0/1296013915 conn(0x55d0faaf6c60 msgr2=0x55d0fabd01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 -- 172.21.15.70:0/1296013915 shutdown_connections 2024-05-08T08:11:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 -- 172.21.15.70:0/1296013915 wait complete. 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.708+0000 7f708afc3b80 1 -- start start 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.709+0000 7f708afc3b80 1 Processor -- start 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.709+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 0x55d0fabdbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.709+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabcdf60 0x55d0fabdc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.709+0000 7f708afc3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 0x55d0fabdc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.709+0000 7f708afc3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70781ab8b0 con 0x55d0fabcdf60 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.709+0000 7f708afc3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f70781acd20 con 0x55d0fabc8ab0 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.709+0000 7f708afc3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f70781abf80 con 0x55d0fabce880 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.709+0000 7f708afc3b80 10 client.0 _ll_register_callbacks cb 0x55d0fabc3650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabcdf60 0x55d0fabdc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabcdf60 0x55d0fabdc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43576/0 (socket says 172.21.15.70:43576) 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707d200700 1 -- 172.21.15.70:0/3799677006 learned_addr learned my addr 172.21.15.70:0/3799677006 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707dc00700 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 0x55d0fabdbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707d200700 1 -- 172.21.15.70:0/3799677006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 msgr2=0x55d0fabdc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:11:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707e600700 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 0x55d0fabdc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707d200700 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 0x55d0fabdc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707d200700 1 -- 172.21.15.70:0/3799677006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 msgr2=0x55d0fabdbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707d200700 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 0x55d0fabdbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707d200700 1 -- 172.21.15.70:0/3799677006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0fac50ee0 con 0x55d0fabcdf60 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f707d200700 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabcdf60 0x55d0fabdc0f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f70680a8d60 tx=0x7f70680a8b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268ee2a043460d19 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.710+0000 7f705b400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.711+0000 7f705b400700 1 -- 172.21.15.70:0/3799677006 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70680b1ec0 con 0x55d0fabcdf60 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.711+0000 7f705b400700 1 -- 172.21.15.70:0/3799677006 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(247..247 src has 1..247) ==== 9583+0+0 (secure 0 0 0) 0x7f7068018310 con 0x55d0fabcdf60 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.711+0000 7f708afc3b80 1 -- 172.21.15.70:0/3799677006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7070007970 con 0x55d0fabcdf60 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.711+0000 7f705b400700 1 -- 172.21.15.70:0/3799677006 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7068018510 con 0x55d0fabcdf60 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.711+0000 7f708afc3b80 10 client.17757 fetch_fsmap learned FSMap version 42 2024-05-08T08:11:42.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.711+0000 7f708afc3b80 1 -- 172.21.15.70:0/3799677006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55d0fac52200 con 0x55d0fabcdf60 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.711+0000 7f705b400700 1 -- 172.21.15.70:0/3799677006 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7070007970 con 0x55d0fabcdf60 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.711+0000 7f705b400700 1 -- 172.21.15.70:0/3799677006 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f70680df5b0 con 0x55d0fabcdf60 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.712+0000 7f708afc3b80 10 client.17757 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.712+0000 7f708afc3b80 10 client.17757 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.712+0000 7f708afc3b80 20 client.17757 populate_metadata read hostname 'smithi070' 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.712+0000 7f708afc3b80 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d0fac52490 0x55d0fac54880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.712+0000 7f708afc3b80 4 client.17757 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b6ce0bc7", "release": true, "await": true}] 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.712+0000 7f708afc3b80 1 -- 172.21.15.70:0/3799677006 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b6ce0bc7", "release": true, "await": true}) -- 0x55d0fab28500 con 0x55d0fac52490 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.712+0000 7f707dc00700 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d0fac52490 0x55d0fac54880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.713+0000 7f707dc00700 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d0fac52490 0x55d0fac54880 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1196cb823fbaeeeb server_cookie=ea9aa25b71cb83bb in_seq=0 out_seq=0 2024-05-08T08:11:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:42.713+0000 7f705b400700 10 client.17757 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:11:43.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:43 smithi172 ceph-mon[33377]: pgmap v2711: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:11:43.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:43 smithi194 ceph-mon[33679]: pgmap v2711: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:11:43.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:43 smithi070 ceph-mon[29591]: pgmap v2711: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:11:45.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:45 smithi172 ceph-mon[33377]: pgmap v2712: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:11:45.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:45 smithi194 ceph-mon[33679]: pgmap v2712: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:11:45.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:45 smithi070 ceph-mon[29591]: pgmap v2712: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:11:47.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.241+0000 7f705b400700 1 -- 172.21.15.70:0/3799677006 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55d0fab28500 con 0x55d0fac52490 2024-05-08T08:11:47.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.241+0000 7f705b400700 10 client.17757 handle_command_reply: tid=0 2024-05-08T08:11:47.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f708afc3b80 1 client.17757 shutdown 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f708afc3b80 1 -- 172.21.15.70:0/3799677006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabcdf60 msgr2=0x55d0fabdc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f708afc3b80 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabcdf60 0x55d0fabdc0f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f70680a8d60 tx=0x7f70680a8b70 comp rx=0 tx=0).stop 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f708afc3b80 1 -- 172.21.15.70:0/3799677006 shutdown_connections 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f708afc3b80 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55d0fac52490 0x55d0fac54880 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f708afc3b80 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55d0fabce880 0x55d0fabdc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f708afc3b80 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55d0fabc8ab0 0x55d0fabdbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f708afc3b80 1 --2- 172.21.15.70:0/3799677006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0fabcdf60 0x55d0fabdc0f0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f708afc3b80 1 -- 172.21.15.70:0/3799677006 >> 172.21.15.70:0/3799677006 conn(0x55d0faaf6c60 msgr2=0x55d0fabcec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.242+0000 7f705b400700 0 client.17757 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:11:47.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.243+0000 7f708afc3b80 1 -- 172.21.15.70:0/3799677006 shutdown_connections 2024-05-08T08:11:47.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.243+0000 7f708afc3b80 1 -- 172.21.15.70:0/3799677006 wait complete. 2024-05-08T08:11:47.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.243+0000 7f708afc3b80 20 client.17757 trim_cache size 0 max 16384 2024-05-08T08:11:47.238 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:11:47.238 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:11:47.238 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 200, 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "b6ce0bc7": { 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 200, 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.8, 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:11:47.239 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:11:47.240 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:11:47.240 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:11:47.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:47.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:47.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:47.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:47.240 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:11:47.240 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 -- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70600b4c80 msgr2=0x7f70600b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70600b4c80 0x7f70600b7140 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f706c005ea0 tx=0x7f706c005e30 comp rx=0 tx=0).stop 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 -- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078102ee0 msgr2=0x7f7078197c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078102ee0 0x7f7078197c80 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f706800b500 tx=0x7f706800b8c0 comp rx=0 tx=0).stop 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 -- 172.21.15.70:0/340105745 shutdown_connections 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70600b4c80 0x7f70600b7140 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7078107610 0x7f707819c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7078102530 0x7f7078197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 --2- 172.21.15.70:0/340105745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7078102ee0 0x7f7078197c80 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.245+0000 7f707f000700 1 -- 172.21.15.70:0/340105745 >> 172.21.15.70:0/340105745 conn(0x7f70780fddc0 msgr2=0x7f70780fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:11:47.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.246+0000 7f707f000700 1 -- 172.21.15.70:0/340105745 shutdown_connections 2024-05-08T08:11:47.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:11:47.246+0000 7f707f000700 1 -- 172.21.15.70:0/340105745 wait complete. 2024-05-08T08:11:47.341 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/pci/hda/hda_intel.o 2024-05-08T08:11:47.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:47 smithi172 ceph-mon[33377]: pgmap v2713: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:11:47.425 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:47 smithi070 ceph-mon[29591]: pgmap v2713: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:11:47.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:47 smithi194 ceph-mon[33679]: pgmap v2713: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:11:48.239 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b6ce0bc7', seconds elapsed: 73.9 2024-05-08T08:11:48.263 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/kernel/relocate_kernel_64.o 2024-05-08T08:11:48.933 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/rbtree.o 2024-05-08T08:11:49.213 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dswexec.o 2024-05-08T08:11:49.249 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/interface.o 2024-05-08T08:11:49.311 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/crash.o 2024-05-08T08:11:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:49 smithi172 ceph-mon[33377]: pgmap v2714: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 156 KiB/s wr, 6 op/s 2024-05-08T08:11:49.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:49 smithi194 ceph-mon[33679]: pgmap v2714: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 156 KiB/s wr, 6 op/s 2024-05-08T08:11:49.600 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/dma.o 2024-05-08T08:11:49.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:49 smithi070 ceph-mon[29591]: pgmap v2714: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 156 KiB/s wr, 6 op/s 2024-05-08T08:11:50.089 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/gro.o 2024-05-08T08:11:50.519 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/export.o 2024-05-08T08:11:51.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:51 smithi172 ceph-mon[33377]: pgmap v2715: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 213 KiB/s wr, 14 op/s 2024-05-08T08:11:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:51 smithi194 ceph-mon[33679]: pgmap v2715: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 213 KiB/s wr, 14 op/s 2024-05-08T08:11:51.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:51 smithi070 ceph-mon[29591]: pgmap v2715: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 213 KiB/s wr, 14 op/s 2024-05-08T08:11:52.308 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/seq_buf.o 2024-05-08T08:11:53.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:53 smithi172 ceph-mon[33377]: pgmap v2716: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 213 KiB/s wr, 12 op/s 2024-05-08T08:11:53.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:53 smithi194 ceph-mon[33679]: pgmap v2716: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 213 KiB/s wr, 12 op/s 2024-05-08T08:11:53.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:53 smithi070 ceph-mon[29591]: pgmap v2716: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 213 KiB/s wr, 12 op/s 2024-05-08T08:11:55.211 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dswload.o 2024-05-08T08:11:55.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:55 smithi172 ceph-mon[33377]: pgmap v2717: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 373 KiB/s wr, 27 op/s 2024-05-08T08:11:55.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:55 smithi194 ceph-mon[33679]: pgmap v2717: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 373 KiB/s wr, 27 op/s 2024-05-08T08:11:55.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:55 smithi070 ceph-mon[29591]: pgmap v2717: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 373 KiB/s wr, 27 op/s 2024-05-08T08:11:56.144 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/quirks.o 2024-05-08T08:11:56.633 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/smp.o 2024-05-08T08:11:57.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:57 smithi172 ceph-mon[33377]: pgmap v2718: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 373 KiB/s wr, 24 op/s 2024-05-08T08:11:57.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:57 smithi194 ceph-mon[33679]: pgmap v2718: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 373 KiB/s wr, 24 op/s 2024-05-08T08:11:57.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:57 smithi070 ceph-mon[29591]: pgmap v2718: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 373 KiB/s wr, 24 op/s 2024-05-08T08:11:58.490 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/crash_dump_64.o 2024-05-08T08:11:59.337 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/hda/built-in.a 2024-05-08T08:11:59.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:11:59 smithi172 ceph-mon[33377]: pgmap v2719: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 375 KiB/s wr, 25 op/s 2024-05-08T08:11:59.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:11:59 smithi194 ceph-mon[33679]: pgmap v2719: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 375 KiB/s wr, 25 op/s 2024-05-08T08:11:59.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:11:59 smithi070 ceph-mon[29591]: pgmap v2719: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 375 KiB/s wr, 25 op/s 2024-05-08T08:11:59.675 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/siphash.o 2024-05-08T08:12:00.333 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/korg1212/built-in.a 2024-05-08T08:12:01.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:01 smithi172 ceph-mon[33377]: pgmap v2720: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 631 KiB/s wr, 41 op/s 2024-05-08T08:12:01.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:01 smithi194 ceph-mon[33679]: pgmap v2720: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 631 KiB/s wr, 41 op/s 2024-05-08T08:12:01.514 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/mixart/built-in.a 2024-05-08T08:12:01.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:01 smithi070 ceph-mon[29591]: pgmap v2720: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 631 KiB/s wr, 41 op/s 2024-05-08T08:12:01.715 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/nm256/built-in.a 2024-05-08T08:12:01.910 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/oxygen/built-in.a 2024-05-08T08:12:02.103 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/pcxhr/built-in.a 2024-05-08T08:12:02.367 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/riptide/built-in.a 2024-05-08T08:12:02.570 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/rme9652/built-in.a 2024-05-08T08:12:02.755 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/trident/built-in.a 2024-05-08T08:12:02.964 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/ymfpci/built-in.a 2024-05-08T08:12:03.181 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/vx222/built-in.a 2024-05-08T08:12:03.391 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dswload2.o 2024-05-08T08:12:03.410 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pci/built-in.a 2024-05-08T08:12:03.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:03 smithi070 ceph-mon[29591]: osdmap e248: 12 total, 12 up, 12 in 2024-05-08T08:12:03.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:03 smithi070 ceph-mon[29591]: pgmap v2722: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 688 KiB/s wr, 39 op/s 2024-05-08T08:12:03.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:03 smithi172 ceph-mon[33377]: osdmap e248: 12 total, 12 up, 12 in 2024-05-08T08:12:03.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:03 smithi172 ceph-mon[33377]: pgmap v2722: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 688 KiB/s wr, 39 op/s 2024-05-08T08:12:03.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:03 smithi194 ceph-mon[33679]: osdmap e248: 12 total, 12 up, 12 in 2024-05-08T08:12:03.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:03 smithi194 ceph-mon[33679]: pgmap v2722: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 688 KiB/s wr, 39 op/s 2024-05-08T08:12:04.547 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/ppc/built-in.a 2024-05-08T08:12:04.741 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/arm/built-in.a 2024-05-08T08:12:04.809 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/netdev-genl.o 2024-05-08T08:12:04.928 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/sh/built-in.a 2024-05-08T08:12:05.002 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/string.o 2024-05-08T08:12:05.066 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/sysfs.o 2024-05-08T08:12:05.193 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/synth/emux/built-in.a 2024-05-08T08:12:05.319 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/synth/built-in.a 2024-05-08T08:12:05.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:05 smithi172 ceph-mon[33377]: pgmap v2723: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 874 KiB/s wr, 69 op/s 2024-05-08T08:12:05.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:05 smithi194 ceph-mon[33679]: pgmap v2723: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 874 KiB/s wr, 69 op/s 2024-05-08T08:12:05.578 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/usb/misc/built-in.a 2024-05-08T08:12:05.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:05 smithi070 ceph-mon[29591]: pgmap v2723: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 874 KiB/s wr, 69 op/s 2024-05-08T08:12:05.757 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/usb/usx2y/built-in.a 2024-05-08T08:12:05.948 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/usb/caiaq/built-in.a 2024-05-08T08:12:06.185 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/usb/6fire/built-in.a 2024-05-08T08:12:06.410 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/usb/hiface/built-in.a 2024-05-08T08:12:06.602 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/usb/bcd2000/built-in.a 2024-05-08T08:12:06.747 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/usb/built-in.a 2024-05-08T08:12:06.792 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pnp/system.o 2024-05-08T08:12:06.964 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/firewire/built-in.a 2024-05-08T08:12:07.177 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/sparc/built-in.a 2024-05-08T08:12:07.365 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/spi/built-in.a 2024-05-08T08:12:07.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:07 smithi172 ceph-mon[33377]: pgmap v2724: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 874 KiB/s wr, 69 op/s 2024-05-08T08:12:07.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:07 smithi194 ceph-mon[33679]: pgmap v2724: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 874 KiB/s wr, 69 op/s 2024-05-08T08:12:07.556 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/parisc/built-in.a 2024-05-08T08:12:07.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:07 smithi070 ceph-mon[29591]: pgmap v2724: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 847 KiB/s rd, 874 KiB/s wr, 69 op/s 2024-05-08T08:12:07.810 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pcmcia/vx/built-in.a 2024-05-08T08:12:08.000 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pcmcia/pdaudiocf/built-in.a 2024-05-08T08:12:08.127 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/pcmcia/built-in.a 2024-05-08T08:12:08.423 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/mips/built-in.a 2024-05-08T08:12:08.628 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/soc/built-in.a 2024-05-08T08:12:08.795 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/atmel/built-in.a 2024-05-08T08:12:09.118 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hda_bus_type.o 2024-05-08T08:12:09.172 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/uid16.o 2024-05-08T08:12:09.326 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/module.o 2024-05-08T08:12:10.023 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dswscope.o 2024-05-08T08:12:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:10 smithi194 ceph-mon[33679]: osdmap e249: 12 total, 12 up, 12 in 2024-05-08T08:12:10.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:10 smithi194 ceph-mon[33679]: pgmap v2726: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 474 KiB/s wr, 61 op/s 2024-05-08T08:12:10.357 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/timerqueue.o 2024-05-08T08:12:10.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:10 smithi070 ceph-mon[29591]: osdmap e249: 12 total, 12 up, 12 in 2024-05-08T08:12:10.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:10 smithi070 ceph-mon[29591]: pgmap v2726: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 474 KiB/s wr, 61 op/s 2024-05-08T08:12:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:10 smithi172 ceph-mon[33377]: osdmap e249: 12 total, 12 up, 12 in 2024-05-08T08:12:10.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:10 smithi172 ceph-mon[33377]: pgmap v2726: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 474 KiB/s wr, 61 op/s 2024-05-08T08:12:11.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:11 smithi172 ceph-mon[33377]: pgmap v2727: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 930 KiB/s wr, 95 op/s 2024-05-08T08:12:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:11 smithi194 ceph-mon[33679]: pgmap v2727: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 930 KiB/s wr, 95 op/s 2024-05-08T08:12:11.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:11 smithi070 ceph-mon[29591]: pgmap v2727: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 930 KiB/s wr, 95 op/s 2024-05-08T08:12:13.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:13 smithi172 ceph-mon[33377]: pgmap v2728: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 814 KiB/s wr, 83 op/s 2024-05-08T08:12:13.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:13 smithi194 ceph-mon[33679]: pgmap v2728: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 814 KiB/s wr, 83 op/s 2024-05-08T08:12:13.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:13 smithi070 ceph-mon[29591]: pgmap v2728: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 814 KiB/s wr, 83 op/s 2024-05-08T08:12:13.727 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pnp/built-in.a 2024-05-08T08:12:14.225 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/vsprintf.o 2024-05-08T08:12:14.322 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/dswstate.o 2024-05-08T08:12:15.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:15 smithi172 ceph-mon[33377]: pgmap v2729: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 630 KiB/s wr, 55 op/s 2024-05-08T08:12:15.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:15 smithi194 ceph-mon[33679]: pgmap v2729: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 630 KiB/s wr, 55 op/s 2024-05-08T08:12:15.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:15 smithi070 ceph-mon[29591]: pgmap v2729: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 630 KiB/s wr, 55 op/s 2024-05-08T08:12:16.389 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hdac_bus.o 2024-05-08T08:12:17.076 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/netdev-genl-gen.o 2024-05-08T08:12:17.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:17 smithi172 ceph-mon[33377]: pgmap v2730: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 630 KiB/s wr, 55 op/s 2024-05-08T08:12:17.425 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:17 smithi070 ceph-mon[29591]: pgmap v2730: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 630 KiB/s wr, 55 op/s 2024-05-08T08:12:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:17 smithi194 ceph-mon[33679]: pgmap v2730: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 630 KiB/s wr, 55 op/s 2024-05-08T08:12:18.257 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/fs_context.o 2024-05-08T08:12:18.345 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/win_minmax.o 2024-05-08T08:12:18.453 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/early_printk.o 2024-05-08T08:12:19.037 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/kallsyms.o 2024-05-08T08:12:19.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:19 smithi172 ceph-mon[33377]: pgmap v2731: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 627 KiB/s wr, 54 op/s 2024-05-08T08:12:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:19 smithi194 ceph-mon[33679]: pgmap v2731: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 627 KiB/s wr, 54 op/s 2024-05-08T08:12:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:19 smithi070 ceph-mon[29591]: pgmap v2731: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 627 KiB/s wr, 54 op/s 2024-05-08T08:12:20.727 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evevent.o 2024-05-08T08:12:21.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:21 smithi172 ceph-mon[33377]: pgmap v2732: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 804 KiB/s wr, 59 op/s 2024-05-08T08:12:21.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:21 smithi194 ceph-mon[33679]: pgmap v2732: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 804 KiB/s wr, 59 op/s 2024-05-08T08:12:21.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:21 smithi070 ceph-mon[29591]: pgmap v2732: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 804 KiB/s wr, 59 op/s 2024-05-08T08:12:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:23 smithi172 ceph-mon[33377]: pgmap v2733: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 441 KiB/s wr, 30 op/s 2024-05-08T08:12:23.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:23 smithi194 ceph-mon[33679]: pgmap v2733: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 441 KiB/s wr, 30 op/s 2024-05-08T08:12:23.534 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/hpet.o 2024-05-08T08:12:23.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:23 smithi070 ceph-mon[29591]: pgmap v2733: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 441 KiB/s wr, 30 op/s 2024-05-08T08:12:24.429 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/acct.o 2024-05-08T08:12:25.132 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hdac_device.o 2024-05-08T08:12:25.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:25 smithi172 ceph-mon[33377]: pgmap v2734: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 693 KiB/s wr, 51 op/s 2024-05-08T08:12:25.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:25 smithi194 ceph-mon[33679]: pgmap v2734: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 693 KiB/s wr, 51 op/s 2024-05-08T08:12:25.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:25 smithi070 ceph-mon[29591]: pgmap v2734: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 693 KiB/s wr, 51 op/s 2024-05-08T08:12:27.324 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evgpe.o 2024-05-08T08:12:27.414 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/gso.o 2024-05-08T08:12:27.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:27 smithi172 ceph-mon[33377]: pgmap v2735: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 531 KiB/s wr, 35 op/s 2024-05-08T08:12:27.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:27 smithi194 ceph-mon[33679]: pgmap v2735: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 531 KiB/s wr, 35 op/s 2024-05-08T08:12:27.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:27 smithi070 ceph-mon[29591]: pgmap v2735: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 531 KiB/s wr, 35 op/s 2024-05-08T08:12:27.955 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/xarray.o 2024-05-08T08:12:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:29 smithi172 ceph-mon[33377]: pgmap v2736: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 662 KiB/s wr, 37 op/s 2024-05-08T08:12:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:29 smithi194 ceph-mon[33679]: pgmap v2736: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 662 KiB/s wr, 37 op/s 2024-05-08T08:12:29.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:29 smithi070 ceph-mon[29591]: pgmap v2736: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 662 KiB/s wr, 37 op/s 2024-05-08T08:12:31.229 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/amd_nb.o 2024-05-08T08:12:31.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:31 smithi172 ceph-mon[33377]: pgmap v2737: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 695 KiB/s wr, 44 op/s 2024-05-08T08:12:31.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:31 smithi194 ceph-mon[33679]: pgmap v2737: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 695 KiB/s wr, 44 op/s 2024-05-08T08:12:31.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:31 smithi070 ceph-mon[29591]: pgmap v2737: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 695 KiB/s wr, 44 op/s 2024-05-08T08:12:31.763 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfsroot.o 2024-05-08T08:12:33.145 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/sysctl.o 2024-05-08T08:12:33.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:33 smithi172 ceph-mon[33377]: pgmap v2738: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 417 KiB/s wr, 31 op/s 2024-05-08T08:12:33.504 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evgpeblk.o 2024-05-08T08:12:33.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:33 smithi194 ceph-mon[33679]: pgmap v2738: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 417 KiB/s wr, 31 op/s 2024-05-08T08:12:33.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:33 smithi070 ceph-mon[29591]: pgmap v2738: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 417 KiB/s wr, 31 op/s 2024-05-08T08:12:34.304 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hdac_sysfs.o 2024-05-08T08:12:34.557 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/lockref.o 2024-05-08T08:12:34.769 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/crash_core.o 2024-05-08T08:12:35.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:35 smithi172 ceph-mon[33377]: pgmap v2739: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 707 KiB/s wr, 52 op/s 2024-05-08T08:12:35.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:35 smithi194 ceph-mon[33679]: pgmap v2739: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 707 KiB/s wr, 52 op/s 2024-05-08T08:12:35.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:35 smithi070 ceph-mon[29591]: pgmap v2739: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 707 KiB/s wr, 52 op/s 2024-05-08T08:12:36.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:12:36.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:12:36.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:12:37.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:37 smithi172 ceph-mon[33377]: pgmap v2740: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 455 KiB/s wr, 31 op/s 2024-05-08T08:12:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:37 smithi194 ceph-mon[33679]: pgmap v2740: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 455 KiB/s wr, 31 op/s 2024-05-08T08:12:37.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:37 smithi070 ceph-mon[29591]: pgmap v2740: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 424 KiB/s rd, 455 KiB/s wr, 31 op/s 2024-05-08T08:12:38.231 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/bcd.o 2024-05-08T08:12:38.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/sort.o 2024-05-08T08:12:39.309 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/net-sysfs.o 2024-05-08T08:12:39.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:39 smithi172 ceph-mon[33377]: pgmap v2741: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 517 KiB/s wr, 33 op/s 2024-05-08T08:12:39.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:39 smithi194 ceph-mon[33679]: pgmap v2741: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 517 KiB/s wr, 33 op/s 2024-05-08T08:12:39.607 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/parser.o 2024-05-08T08:12:39.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:39 smithi070 ceph-mon[29591]: pgmap v2741: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 517 KiB/s wr, 33 op/s 2024-05-08T08:12:39.940 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evgpeinit.o 2024-05-08T08:12:40.343 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/kvm.o 2024-05-08T08:12:41.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:41 smithi172 ceph-mon[33377]: pgmap v2742: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 560 KiB/s wr, 43 op/s 2024-05-08T08:12:41.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:41 smithi194 ceph-mon[33679]: pgmap v2742: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 560 KiB/s wr, 43 op/s 2024-05-08T08:12:41.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:41 smithi070 ceph-mon[29591]: pgmap v2742: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 480 KiB/s rd, 560 KiB/s wr, 43 op/s 2024-05-08T08:12:42.776 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/kexec_core.o 2024-05-08T08:12:43.284 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hdac_regmap.o 2024-05-08T08:12:43.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:12:43.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:12:43.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:12:43.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:12:43.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:12:43.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:43 smithi172 ceph-mon[33377]: pgmap v2743: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 525 KiB/s wr, 35 op/s 2024-05-08T08:12:43.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:12:43.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:12:43.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:12:43.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:12:43.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:12:43.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:43 smithi194 ceph-mon[33679]: pgmap v2743: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 525 KiB/s wr, 35 op/s 2024-05-08T08:12:43.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:12:43.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:12:43.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:12:43.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:12:43.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:12:43.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:43 smithi070 ceph-mon[29591]: pgmap v2743: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 525 KiB/s wr, 35 op/s 2024-05-08T08:12:44.490 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/kvmclock.o 2024-05-08T08:12:44.673 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/debug_locks.o 2024-05-08T08:12:45.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:45 smithi172 ceph-mon[33377]: pgmap v2744: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 761 KiB/s wr, 48 op/s 2024-05-08T08:12:45.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:45 smithi194 ceph-mon[33679]: pgmap v2744: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 761 KiB/s wr, 48 op/s 2024-05-08T08:12:45.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:45 smithi070 ceph-mon[29591]: pgmap v2744: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 761 KiB/s wr, 48 op/s 2024-05-08T08:12:45.732 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs2super.o 2024-05-08T08:12:46.126 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evgpeutil.o 2024-05-08T08:12:47.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:47 smithi172 ceph-mon[33377]: pgmap v2745: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 471 KiB/s wr, 27 op/s 2024-05-08T08:12:47.424 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:47 smithi070 ceph-mon[29591]: pgmap v2745: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 471 KiB/s wr, 27 op/s 2024-05-08T08:12:47.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:47 smithi194 ceph-mon[33679]: pgmap v2745: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 471 KiB/s wr, 27 op/s 2024-05-08T08:12:49.278 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/random32.o 2024-05-08T08:12:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:49 smithi172 ceph-mon[33377]: pgmap v2746: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 556 KiB/s wr, 28 op/s 2024-05-08T08:12:49.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:49 smithi194 ceph-mon[33679]: pgmap v2746: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 556 KiB/s wr, 28 op/s 2024-05-08T08:12:49.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:49 smithi070 ceph-mon[29591]: pgmap v2746: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 556 KiB/s wr, 28 op/s 2024-05-08T08:12:51.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:51 smithi172 ceph-mon[33377]: pgmap v2747: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 618 KiB/s wr, 35 op/s 2024-05-08T08:12:51.466 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/net-procfs.o 2024-05-08T08:12:51.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:51 smithi194 ceph-mon[33679]: pgmap v2747: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 618 KiB/s wr, 35 op/s 2024-05-08T08:12:51.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:51 smithi070 ceph-mon[29591]: pgmap v2747: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 618 KiB/s wr, 35 op/s 2024-05-08T08:12:53.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:53 smithi172 ceph-mon[33377]: pgmap v2748: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 444 KiB/s wr, 22 op/s 2024-05-08T08:12:53.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:53 smithi194 ceph-mon[33679]: pgmap v2748: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 444 KiB/s wr, 22 op/s 2024-05-08T08:12:53.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:53 smithi070 ceph-mon[29591]: pgmap v2748: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 444 KiB/s wr, 22 op/s 2024-05-08T08:12:54.270 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evglock.o 2024-05-08T08:12:54.561 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/bust_spinlocks.o 2024-05-08T08:12:54.768 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hdac_controller.o 2024-05-08T08:12:54.776 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hdac_stream.o 2024-05-08T08:12:55.131 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/kexec.o 2024-05-08T08:12:55.300 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/paravirt.o 2024-05-08T08:12:55.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:55 smithi172 ceph-mon[33377]: pgmap v2749: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 683 KiB/s wr, 35 op/s 2024-05-08T08:12:55.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:55 smithi194 ceph-mon[33679]: pgmap v2749: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 683 KiB/s wr, 35 op/s 2024-05-08T08:12:55.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:55 smithi070 ceph-mon[29591]: pgmap v2749: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 683 KiB/s wr, 35 op/s 2024-05-08T08:12:57.358 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/proc.o 2024-05-08T08:12:57.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:57 smithi172 ceph-mon[33377]: pgmap v2750: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 447 KiB/s wr, 23 op/s 2024-05-08T08:12:57.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:57 smithi194 ceph-mon[33679]: pgmap v2750: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 447 KiB/s wr, 23 op/s 2024-05-08T08:12:57.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:57 smithi070 ceph-mon[29591]: pgmap v2750: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 447 KiB/s wr, 23 op/s 2024-05-08T08:12:59.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:12:59 smithi172 ceph-mon[33377]: pgmap v2751: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 448 KiB/s wr, 24 op/s 2024-05-08T08:12:59.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:12:59 smithi194 ceph-mon[33679]: pgmap v2751: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 448 KiB/s wr, 24 op/s 2024-05-08T08:12:59.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:12:59 smithi070 ceph-mon[29591]: pgmap v2751: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 448 KiB/s wr, 24 op/s 2024-05-08T08:13:01.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:01 smithi172 ceph-mon[33377]: pgmap v2752: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 607 KiB/s wr, 41 op/s 2024-05-08T08:13:01.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:01 smithi194 ceph-mon[33679]: pgmap v2752: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 607 KiB/s wr, 41 op/s 2024-05-08T08:13:01.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:01 smithi070 ceph-mon[29591]: pgmap v2752: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 607 KiB/s wr, 41 op/s 2024-05-08T08:13:01.688 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evhandler.o 2024-05-08T08:13:02.805 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/netpoll.o 2024-05-08T08:13:03.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:03 smithi172 ceph-mon[33377]: pgmap v2753: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 483 KiB/s wr, 32 op/s 2024-05-08T08:13:03.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:03 smithi194 ceph-mon[33679]: pgmap v2753: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 483 KiB/s wr, 32 op/s 2024-05-08T08:13:03.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:03 smithi070 ceph-mon[29591]: pgmap v2753: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 483 KiB/s wr, 32 op/s 2024-05-08T08:13:04.467 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/kasprintf.o 2024-05-08T08:13:05.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:05 smithi172 ceph-mon[33377]: pgmap v2754: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 705 KiB/s wr, 58 op/s 2024-05-08T08:13:05.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:05 smithi194 ceph-mon[33679]: pgmap v2754: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 705 KiB/s wr, 58 op/s 2024-05-08T08:13:05.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:05 smithi070 ceph-mon[29591]: pgmap v2754: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 705 KiB/s wr, 58 op/s 2024-05-08T08:13:06.451 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evmisc.o 2024-05-08T08:13:06.895 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/array.o 2024-05-08T08:13:07.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:07 smithi172 ceph-mon[33377]: pgmap v2755: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 466 KiB/s wr, 44 op/s 2024-05-08T08:13:07.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:07 smithi194 ceph-mon[33679]: pgmap v2755: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 466 KiB/s wr, 44 op/s 2024-05-08T08:13:07.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:07 smithi070 ceph-mon[29591]: pgmap v2755: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 466 KiB/s wr, 44 op/s 2024-05-08T08:13:07.732 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/compat.o 2024-05-08T08:13:07.854 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/pvclock.o 2024-05-08T08:13:09.007 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs2xdr.o 2024-05-08T08:13:09.458 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:09 smithi172 ceph-mon[33377]: osdmap e250: 12 total, 12 up, 12 in 2024-05-08T08:13:09.458 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:09 smithi172 ceph-mon[33377]: pgmap v2757: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 565 KiB/s wr, 53 op/s 2024-05-08T08:13:09.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:09 smithi194 ceph-mon[33679]: osdmap e250: 12 total, 12 up, 12 in 2024-05-08T08:13:09.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:09 smithi194 ceph-mon[33679]: pgmap v2757: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 565 KiB/s wr, 53 op/s 2024-05-08T08:13:09.512 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/bitmap.o 2024-05-08T08:13:09.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:09 smithi070 ceph-mon[29591]: osdmap e250: 12 total, 12 up, 12 in 2024-05-08T08:13:09.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:09 smithi070 ceph-mon[29591]: pgmap v2757: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 565 KiB/s wr, 53 op/s 2024-05-08T08:13:11.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:11 smithi172 ceph-mon[33377]: pgmap v2758: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 629 KiB/s wr, 53 op/s 2024-05-08T08:13:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:11 smithi194 ceph-mon[33679]: pgmap v2758: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 629 KiB/s wr, 53 op/s 2024-05-08T08:13:11.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:11 smithi070 ceph-mon[29591]: pgmap v2758: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 629 KiB/s wr, 53 op/s 2024-05-08T08:13:12.869 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evregion.o 2024-05-08T08:13:13.013 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evrgnini.o 2024-05-08T08:13:13.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:13 smithi172 ceph-mon[33377]: pgmap v2759: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 629 KiB/s wr, 53 op/s 2024-05-08T08:13:13.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:13 smithi194 ceph-mon[33679]: pgmap v2759: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 629 KiB/s wr, 53 op/s 2024-05-08T08:13:13.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:13 smithi070 ceph-mon[29591]: pgmap v2759: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 629 KiB/s wr, 53 op/s 2024-05-08T08:13:15.308 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:15 smithi194 ceph-mon[33679]: osdmap e251: 12 total, 12 up, 12 in 2024-05-08T08:13:15.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:15 smithi070 ceph-mon[29591]: osdmap e251: 12 total, 12 up, 12 in 2024-05-08T08:13:15.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:15 smithi172 ceph-mon[33377]: osdmap e251: 12 total, 12 up, 12 in 2024-05-08T08:13:15.780 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hdmi_chmap.o 2024-05-08T08:13:16.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:16 smithi070 ceph-mon[29591]: pgmap v2761: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 680 KiB/s wr, 44 op/s 2024-05-08T08:13:16.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:16 smithi172 ceph-mon[33377]: pgmap v2761: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 680 KiB/s wr, 44 op/s 2024-05-08T08:13:16.457 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/pcspeaker.o 2024-05-08T08:13:16.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:16 smithi194 ceph-mon[33679]: pgmap v2761: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 680 KiB/s wr, 44 op/s 2024-05-08T08:13:17.384 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/fib_rules.o 2024-05-08T08:13:17.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:17 smithi172 ceph-mon[33377]: pgmap v2762: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 611 KiB/s wr, 40 op/s 2024-05-08T08:13:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:17 smithi194 ceph-mon[33679]: pgmap v2762: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 611 KiB/s wr, 40 op/s 2024-05-08T08:13:17.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:17 smithi070 ceph-mon[29591]: pgmap v2762: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 611 KiB/s wr, 40 op/s 2024-05-08T08:13:17.751 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/scatterlist.o 2024-05-08T08:13:18.230 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/utsname.o 2024-05-08T08:13:19.345 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evsci.o 2024-05-08T08:13:19.388 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/clntlock.o 2024-05-08T08:13:19.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:19 smithi172 ceph-mon[33377]: pgmap v2763: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 539 KiB/s wr, 35 op/s 2024-05-08T08:13:19.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:19 smithi194 ceph-mon[33679]: pgmap v2763: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 539 KiB/s wr, 35 op/s 2024-05-08T08:13:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:19 smithi070 ceph-mon[29591]: pgmap v2763: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 539 KiB/s wr, 35 op/s 2024-05-08T08:13:21.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:21 smithi172 ceph-mon[33377]: pgmap v2764: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 561 KiB/s wr, 27 op/s 2024-05-08T08:13:21.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:21 smithi194 ceph-mon[33679]: pgmap v2764: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 561 KiB/s wr, 27 op/s 2024-05-08T08:13:21.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:21 smithi070 ceph-mon[29591]: pgmap v2764: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 561 KiB/s wr, 27 op/s 2024-05-08T08:13:22.162 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs3super.o 2024-05-08T08:13:23.043 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/check.o 2024-05-08T08:13:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:23 smithi172 ceph-mon[33377]: pgmap v2765: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 561 KiB/s wr, 27 op/s 2024-05-08T08:13:23.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:23 smithi194 ceph-mon[33679]: pgmap v2765: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 561 KiB/s wr, 27 op/s 2024-05-08T08:13:23.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:23 smithi070 ceph-mon[29591]: pgmap v2765: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 561 KiB/s wr, 27 op/s 2024-05-08T08:13:24.762 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/pid_namespace.o 2024-05-08T08:13:24.950 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/trace.o 2024-05-08T08:13:25.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:25 smithi172 ceph-mon[33377]: pgmap v2766: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 725 KiB/s wr, 39 op/s 2024-05-08T08:13:25.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:25 smithi194 ceph-mon[33679]: pgmap v2766: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 725 KiB/s wr, 39 op/s 2024-05-08T08:13:25.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:25 smithi070 ceph-mon[29591]: pgmap v2766: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 725 KiB/s wr, 39 op/s 2024-05-08T08:13:26.722 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evxface.o 2024-05-08T08:13:27.037 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/list_sort.o 2024-05-08T08:13:27.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:27 smithi172 ceph-mon[33377]: pgmap v2767: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 517 KiB/s wr, 26 op/s 2024-05-08T08:13:27.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:27 smithi194 ceph-mon[33679]: pgmap v2767: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 517 KiB/s wr, 26 op/s 2024-05-08T08:13:27.597 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:13:27.597 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T08:13:27.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:13:27.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:27 smithi070 ceph-mon[29591]: pgmap v2767: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 517 KiB/s wr, 26 op/s 2024-05-08T08:13:28.179 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:13:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:29 smithi172 ceph-mon[33377]: pgmap v2768: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 517 KiB/s wr, 27 op/s 2024-05-08T08:13:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:29 smithi194 ceph-mon[33679]: pgmap v2768: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 517 KiB/s wr, 27 op/s 2024-05-08T08:13:29.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:29 smithi070 ceph-mon[29591]: pgmap v2768: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 517 KiB/s wr, 27 op/s 2024-05-08T08:13:30.415 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/net-traces.o 2024-05-08T08:13:31.351 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/uuid.o 2024-05-08T08:13:31.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:31 smithi070 ceph-mon[29591]: pgmap v2769: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 780 KiB/s wr, 35 op/s 2024-05-08T08:13:31.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:31 smithi172 ceph-mon[33377]: pgmap v2769: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 780 KiB/s wr, 35 op/s 2024-05-08T08:13:31.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:31 smithi194 ceph-mon[33679]: pgmap v2769: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 780 KiB/s wr, 35 op/s 2024-05-08T08:13:32.782 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/uprobes.o 2024-05-08T08:13:33.079 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evxfevnt.o 2024-05-08T08:13:33.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.335+0000 7f48ba000700 1 -- 172.21.15.70:0/2653501153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48b410b6e0 msgr2=0x7f48b410bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:33.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.335+0000 7f48ba000700 1 --2- 172.21.15.70:0/2653501153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48b410b6e0 0x7f48b410bac0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009990 tx=0x7f48ac009ca0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.335+0000 7f48ba000700 1 -- 172.21.15.70:0/2653501153 shutdown_connections 2024-05-08T08:13:33.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.335+0000 7f48ba000700 1 --2- 172.21.15.70:0/2653501153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41060a0 0x7f48b41125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.335+0000 7f48ba000700 1 --2- 172.21.15.70:0/2653501153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48b410b6e0 0x7f48b410bac0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.335+0000 7f48ba000700 1 --2- 172.21.15.70:0/2653501153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b41056e0 0x7f48b4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.335+0000 7f48ba000700 1 -- 172.21.15.70:0/2653501153 >> 172.21.15.70:0/2653501153 conn(0x7f48b41011d0 msgr2=0x7f48b41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:13:33.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.335+0000 7f48ba000700 1 -- 172.21.15.70:0/2653501153 shutdown_connections 2024-05-08T08:13:33.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.335+0000 7f48ba000700 1 -- 172.21.15.70:0/2653501153 wait complete. 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.336+0000 7f48ba000700 1 Processor -- start 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.336+0000 7f48ba000700 1 -- start start 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.337+0000 7f48ba000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48b41056e0 0x7f48b41124e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.337+0000 7f48ba000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41060a0 0x7f48b410f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.337+0000 7f48ba000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b410b6e0 0x7f48b410fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.337+0000 7f48ba000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48b4115770 con 0x7f48b41056e0 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.337+0000 7f48ba000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f48b41155f0 con 0x7f48b410b6e0 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.337+0000 7f48ba000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f48b41158f0 con 0x7f48b41060a0 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.337+0000 7f48b3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48b41056e0 0x7f48b41124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b410b6e0 0x7f48b410fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b410b6e0 0x7f48b410fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:58502/0 (socket says 172.21.15.70:58502) 2024-05-08T08:13:33.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b3e00700 1 -- 172.21.15.70:0/2330693496 learned_addr learned my addr 172.21.15.70:0/2330693496 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:13:33.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b2a00700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41060a0 0x7f48b410f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:33.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b3400700 1 -- 172.21.15.70:0/2330693496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41060a0 msgr2=0x7f48b410f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b3400700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41060a0 0x7f48b410f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b3400700 1 -- 172.21.15.70:0/2330693496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b410b6e0 msgr2=0x7f48b410fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b3400700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b410b6e0 0x7f48b410fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b3400700 1 -- 172.21.15.70:0/2330693496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b41ac470 con 0x7f48b41056e0 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.338+0000 7f48b3e00700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b410b6e0 0x7f48b410fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.339+0000 7f48b3400700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48b41056e0 0x7f48b41124e0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f48ac006010 tx=0x7f48ac0057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.339+0000 7f48abe00700 1 -- 172.21.15.70:0/2330693496 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac027070 con 0x7f48b41056e0 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.339+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b41ac640 con 0x7f48b41056e0 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.339+0000 7f48abe00700 1 -- 172.21.15.70:0/2330693496 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48ac00fb00 con 0x7f48b41056e0 2024-05-08T08:13:33.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.340+0000 7f48abe00700 1 -- 172.21.15.70:0/2330693496 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac022a10 con 0x7f48b41056e0 2024-05-08T08:13:33.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.340+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b41aca90 con 0x7f48b41056e0 2024-05-08T08:13:33.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.342+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b4106e20 con 0x7f48b41056e0 2024-05-08T08:13:33.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.346+0000 7f48abe00700 1 -- 172.21.15.70:0/2330693496 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f48ac02a070 con 0x7f48b41056e0 2024-05-08T08:13:33.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.349+0000 7f48abe00700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48980b2af0 0x7f48980b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:33.343 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:33 smithi070 ceph-mon[29591]: pgmap v2770: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 464 KiB/s wr, 23 op/s 2024-05-08T08:13:33.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.349+0000 7f48abe00700 1 -- 172.21.15.70:0/2330693496 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(251..251 src has 1..251) ==== 9583+0+0 (secure 0 0 0) 0x7f48ac0e34c0 con 0x7f48b41056e0 2024-05-08T08:13:33.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.350+0000 7f48b2a00700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48980b2af0 0x7f48980b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:33.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.351+0000 7f48b2a00700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48980b2af0 0x7f48980b4fb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009550 tx=0x7f48a00091b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:13:33.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.357+0000 7f48abe00700 1 -- 172.21.15.70:0/2330693496 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f48ac013070 con 0x7f48b41056e0 2024-05-08T08:13:33.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:33 smithi172 ceph-mon[33377]: pgmap v2770: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 464 KiB/s wr, 23 op/s 2024-05-08T08:13:33.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:33 smithi194 ceph-mon[33679]: pgmap v2770: 129 pgs: 129 active+clean; 1.9 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 464 KiB/s wr, 23 op/s 2024-05-08T08:13:33.671 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/clntproc.o 2024-05-08T08:13:33.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.845+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48b402e6d0 con 0x7f48b41056e0 2024-05-08T08:13:33.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.846+0000 7f48abe00700 1 -- 172.21.15.70:0/2330693496 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f48ac0aaab0 con 0x7f48b41056e0 2024-05-08T08:13:33.841 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:13:33.841 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:13:33.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48980b2af0 msgr2=0x7f48980b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:33.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48980b2af0 0x7f48980b4fb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f48a0009550 tx=0x7f48a00091b0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48b41056e0 msgr2=0x7f48b41124e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:33.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48b41056e0 0x7f48b41124e0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f48ac006010 tx=0x7f48ac0057a0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 shutdown_connections 2024-05-08T08:13:33.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48980b2af0 0x7f48980b4fb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48b410b6e0 0x7f48b410fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48b41056e0 0x7f48b41124e0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 --2- 172.21.15.70:0/2330693496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48b41060a0 0x7f48b410f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:33.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 >> 172.21.15.70:0/2330693496 conn(0x7f48b41011d0 msgr2=0x7f48b4101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:13:33.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 shutdown_connections 2024-05-08T08:13:33.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:33.850+0000 7f48ba000700 1 -- 172.21.15.70:0/2330693496 wait complete. 2024-05-08T08:13:33.846 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:13:34.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2330693496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:13:34.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2330693496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:13:34.530 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2330693496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:13:35.104 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T08:13:35.104 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T08:13:35.105 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/stop_machine.o 2024-05-08T08:13:35.135 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs3client.o 2024-05-08T08:13:35.190 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hdac_component.o 2024-05-08T08:13:35.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:35 smithi070 ceph-mon[29591]: pgmap v2771: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 693 KiB/s wr, 42 op/s 2024-05-08T08:13:35.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:35 smithi172 ceph-mon[33377]: pgmap v2771: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 693 KiB/s wr, 42 op/s 2024-05-08T08:13:35.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:35 smithi194 ceph-mon[33679]: pgmap v2771: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 693 KiB/s wr, 42 op/s 2024-05-08T08:13:36.031 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/iov_iter.o 2024-05-08T08:13:36.668 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:13:37.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:37 smithi172 ceph-mon[33377]: pgmap v2772: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 492 KiB/s wr, 28 op/s 2024-05-08T08:13:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:37 smithi194 ceph-mon[33679]: pgmap v2772: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 492 KiB/s wr, 28 op/s 2024-05-08T08:13:37.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:37 smithi070 ceph-mon[29591]: pgmap v2772: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 492 KiB/s wr, 28 op/s 2024-05-08T08:13:39.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:39 smithi172 ceph-mon[33377]: pgmap v2773: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 492 KiB/s wr, 28 op/s 2024-05-08T08:13:39.476 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:39 smithi070 ceph-mon[29591]: pgmap v2773: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 492 KiB/s wr, 28 op/s 2024-05-08T08:13:39.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:39 smithi194 ceph-mon[33679]: pgmap v2773: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 492 KiB/s wr, 28 op/s 2024-05-08T08:13:40.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.413+0000 7fdee9400700 1 -- 172.21.15.70:0/602426175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee4109a50 msgr2=0x7fdee41103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:40.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.413+0000 7fdee9400700 1 --2- 172.21.15.70:0/602426175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee4109a50 0x7fdee41103d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009fc0 tx=0x7fdedc00b330 comp rx=0 tx=0).stop 2024-05-08T08:13:40.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.413+0000 7fdee9400700 1 -- 172.21.15.70:0/602426175 shutdown_connections 2024-05-08T08:13:40.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.413+0000 7fdee9400700 1 --2- 172.21.15.70:0/602426175 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee4109a50 0x7fdee41103d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.413+0000 7fdee9400700 1 --2- 172.21.15.70:0/602426175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee41044c0 0x7fdee41048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.413+0000 7fdee9400700 1 --2- 172.21.15.70:0/602426175 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdee4104e70 0x7fdee4109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.413+0000 7fdee9400700 1 -- 172.21.15.70:0/602426175 >> 172.21.15.70:0/602426175 conn(0x7fdee40fdcf0 msgr2=0x7fdee4100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:13:40.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.413+0000 7fdee9400700 1 -- 172.21.15.70:0/602426175 shutdown_connections 2024-05-08T08:13:40.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.413+0000 7fdee9400700 1 -- 172.21.15.70:0/602426175 wait complete. 2024-05-08T08:13:40.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.415+0000 7fdee9400700 1 Processor -- start 2024-05-08T08:13:40.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.415+0000 7fdee9400700 1 -- start start 2024-05-08T08:13:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.416+0000 7fdee9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee41044c0 0x7fdee410fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.416+0000 7fdee9400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdee4104e70 0x7fdee4110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.416+0000 7fdee9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee4109a50 0x7fdee410cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.416+0000 7fdee9400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4103590 con 0x7fdee41044c0 2024-05-08T08:13:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.416+0000 7fdee9400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4103410 con 0x7fdee4109a50 2024-05-08T08:13:40.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.416+0000 7fdee9400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdee4103710 con 0x7fdee4104e70 2024-05-08T08:13:40.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.416+0000 7fdee8a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee4109a50 0x7fdee410cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.416+0000 7fdee3400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdee4104e70 0x7fdee4110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.417+0000 7fdee3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee41044c0 0x7fdee410fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.417+0000 7fdee3400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdee4104e70 0x7fdee4110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:54932/0 (socket says 172.21.15.70:54932) 2024-05-08T08:13:40.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.417+0000 7fdee3400700 1 -- 172.21.15.70:0/1081350898 learned_addr learned my addr 172.21.15.70:0/1081350898 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:13:40.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.417+0000 7fdee3e00700 1 -- 172.21.15.70:0/1081350898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdee4104e70 msgr2=0x7fdee4110130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:40.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.417+0000 7fdee3e00700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdee4104e70 0x7fdee4110130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.417+0000 7fdee3e00700 1 -- 172.21.15.70:0/1081350898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee4109a50 msgr2=0x7fdee410cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:40.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.417+0000 7fdee3e00700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee4109a50 0x7fdee410cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.417+0000 7fdee3e00700 1 -- 172.21.15.70:0/1081350898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee410d630 con 0x7fdee41044c0 2024-05-08T08:13:40.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.418+0000 7fdee3e00700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee41044c0 0x7fdee410fbf0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fded4005fd0 tx=0x7fded400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:13:40.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.418+0000 7fdee0c00700 1 -- 172.21.15.70:0/1081350898 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4004220 con 0x7fdee41044c0 2024-05-08T08:13:40.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.418+0000 7fdee0c00700 1 -- 172.21.15.70:0/1081350898 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fded40043c0 con 0x7fdee41044c0 2024-05-08T08:13:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.418+0000 7fdee0c00700 1 -- 172.21.15.70:0/1081350898 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded4003b40 con 0x7fdee41044c0 2024-05-08T08:13:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.418+0000 7fdee9400700 1 -- 172.21.15.70:0/1081350898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee410d920 con 0x7fdee41044c0 2024-05-08T08:13:40.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.418+0000 7fdee9400700 1 -- 172.21.15.70:0/1081350898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee41acaf0 con 0x7fdee41044c0 2024-05-08T08:13:40.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.424+0000 7fdee0c00700 1 -- 172.21.15.70:0/1081350898 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fded4003ce0 con 0x7fdee41044c0 2024-05-08T08:13:40.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.426+0000 7fdee0c00700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdec80b2ba0 0x7fdec80b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.426+0000 7fdee0c00700 1 -- 172.21.15.70:0/1081350898 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(251..251 src has 1..251) ==== 9583+0+0 (secure 0 0 0) 0x7fded40e2af0 con 0x7fdee41044c0 2024-05-08T08:13:40.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.426+0000 7fdee3400700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdec80b2ba0 0x7fdec80b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.427+0000 7fdee3400700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdec80b2ba0 0x7fdec80b5060 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdee410e4f0 tx=0x7fded0009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:13:40.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.502+0000 7fdef530ab80 1 Processor -- start 2024-05-08T08:13:40.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.502+0000 7fdef530ab80 1 -- start start 2024-05-08T08:13:40.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.502+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cddb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.502+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cdd5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.502+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cdd6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.503+0000 7fdef530ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56378cd27bb0 con 0x56378cdd5e30 2024-05-08T08:13:40.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.503+0000 7fdef530ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56378ccc58f0 con 0x56378cddbc00 2024-05-08T08:13:40.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.503+0000 7fdef530ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56378cd23b70 con 0x56378cddb2e0 2024-05-08T08:13:40.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.503+0000 7fdee8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cdd6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.503+0000 7fdee8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cdd6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54606/0 (socket says 172.21.15.70:54606) 2024-05-08T08:13:40.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.503+0000 7fdee8a00700 1 -- 172.21.15.70:0/238651162 learned_addr learned my addr 172.21.15.70:0/238651162 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:13:40.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.503+0000 7fdee3400700 1 --2- 172.21.15.70:0/238651162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cdd5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.504+0000 7fdee8a00700 1 -- 172.21.15.70:0/238651162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 msgr2=0x56378cddb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:13:40.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.504+0000 7fdee8a00700 1 --2- 172.21.15.70:0/238651162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cddb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.504+0000 7fdee8a00700 1 -- 172.21.15.70:0/238651162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 msgr2=0x56378cdd5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:13:40.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.504+0000 7fdee8a00700 1 --2- 172.21.15.70:0/238651162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cdd5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.504+0000 7fdee8a00700 1 -- 172.21.15.70:0/238651162 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56378cc74a60 con 0x56378cdd5e30 2024-05-08T08:13:40.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.504+0000 7fdee3400700 1 --2- 172.21.15.70:0/238651162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cdd5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:13:40.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.504+0000 7fdee8a00700 1 --2- 172.21.15.70:0/238651162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cdd6290 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009b70 tx=0x7fdedc009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4417f8fe73598183 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:13:40.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.505+0000 7fded9600700 1 -- 172.21.15.70:0/238651162 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc020070 con 0x56378cdd5e30 2024-05-08T08:13:40.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.505+0000 7fded9600700 1 -- 172.21.15.70:0/238651162 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdedc003d00 con 0x56378cdd5e30 2024-05-08T08:13:40.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.505+0000 7fded9600700 1 -- 172.21.15.70:0/238651162 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc007b70 con 0x56378cdd5e30 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.506+0000 7fdef530ab80 1 -- 172.21.15.70:0/238651162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 msgr2=0x56378cdd6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.506+0000 7fdef530ab80 1 --2- 172.21.15.70:0/238651162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cdd6290 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009b70 tx=0x7fdedc009ba0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.506+0000 7fdef530ab80 1 -- 172.21.15.70:0/238651162 shutdown_connections 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.506+0000 7fdef530ab80 1 --2- 172.21.15.70:0/238651162 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cdd6290 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.506+0000 7fdef530ab80 1 --2- 172.21.15.70:0/238651162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cddb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.506+0000 7fdef530ab80 1 --2- 172.21.15.70:0/238651162 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cdd5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.506+0000 7fdef530ab80 1 -- 172.21.15.70:0/238651162 >> 172.21.15.70:0/238651162 conn(0x56378cd4d860 msgr2=0x56378cdd0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.507+0000 7fdef530ab80 1 -- 172.21.15.70:0/238651162 shutdown_connections 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.507+0000 7fdef530ab80 1 -- 172.21.15.70:0/238651162 wait complete. 2024-05-08T08:13:40.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.507+0000 7fdef530ab80 1 -- start start 2024-05-08T08:13:40.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.507+0000 7fdef530ab80 1 Processor -- start 2024-05-08T08:13:40.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.508+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cde19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.508+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddb2e0 0x56378cddeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.508+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddbc00 0x56378cddf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.508+0000 7fdef530ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56378cde26c0 con 0x56378cddb2e0 2024-05-08T08:13:40.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.508+0000 7fdef530ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56378cc8dcb0 con 0x56378cdd5e30 2024-05-08T08:13:40.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.508+0000 7fdef530ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56378cde2840 con 0x56378cddbc00 2024-05-08T08:13:40.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.508+0000 7fdef530ab80 10 client.0 _ll_register_callbacks cb 0x56378cccee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:13:40.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.509+0000 7fdee3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cde19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.509+0000 7fdee8a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddbc00 0x56378cddf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.509+0000 7fdee3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddb2e0 0x56378cddeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.509+0000 7fdee3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddb2e0 0x56378cddeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54622/0 (socket says 172.21.15.70:54622) 2024-05-08T08:13:40.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.509+0000 7fdee3400700 1 -- 172.21.15.70:0/3482353337 learned_addr learned my addr 172.21.15.70:0/3482353337 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:13:40.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.511+0000 7fdee3400700 1 -- 172.21.15.70:0/3482353337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddbc00 msgr2=0x56378cddf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:13:40.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.511+0000 7fdee3400700 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddbc00 0x56378cddf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.511+0000 7fdee3400700 1 -- 172.21.15.70:0/3482353337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 msgr2=0x56378cde19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:13:40.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.511+0000 7fdee3400700 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cde19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.511+0000 7fdee3400700 1 -- 172.21.15.70:0/3482353337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56378cced5b0 con 0x56378cddb2e0 2024-05-08T08:13:40.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.511+0000 7fdee3e00700 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cde19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:13:40.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.511+0000 7fdee8a00700 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddbc00 0x56378cddf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:13:40.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.512+0000 7fdee3400700 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddb2e0 0x56378cddeda0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fded0003980 tx=0x7fded00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35eff0a9df8349c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:13:40.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.512+0000 7fdece000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:13:40.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.512+0000 7fdece000700 1 -- 172.21.15.70:0/3482353337 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded001f810 con 0x56378cddb2e0 2024-05-08T08:13:40.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.512+0000 7fdef530ab80 1 -- 172.21.15.70:0/3482353337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdedc003d00 con 0x56378cddb2e0 2024-05-08T08:13:40.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.512+0000 7fdece000700 1 -- 172.21.15.70:0/3482353337 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(251..251 src has 1..251) ==== 9583+0+0 (secure 0 0 0) 0x7fded001f9b0 con 0x56378cddb2e0 2024-05-08T08:13:40.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.513+0000 7fdece000700 1 -- 172.21.15.70:0/3482353337 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fded001fbb0 con 0x56378cddb2e0 2024-05-08T08:13:40.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.513+0000 7fdef530ab80 10 client.17775 fetch_fsmap learned FSMap version 42 2024-05-08T08:13:40.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.513+0000 7fdef530ab80 1 -- 172.21.15.70:0/3482353337 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56378cdece10 con 0x56378cddb2e0 2024-05-08T08:13:40.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.513+0000 7fdece000700 1 -- 172.21.15.70:0/3482353337 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdedc003d00 con 0x56378cddb2e0 2024-05-08T08:13:40.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.514+0000 7fdece000700 1 -- 172.21.15.70:0/3482353337 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fded0032420 con 0x56378cddb2e0 2024-05-08T08:13:40.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.514+0000 7fdef530ab80 10 client.17775 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:13:40.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.514+0000 7fdef530ab80 10 client.17775 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:13:40.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.514+0000 7fdef530ab80 20 client.17775 populate_metadata read hostname 'smithi070' 2024-05-08T08:13:40.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.514+0000 7fdef530ab80 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56378cdef3a0 0x56378cdf1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.514+0000 7fdef530ab80 4 client.17775 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:13:40.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.514+0000 7fdef530ab80 1 -- 172.21.15.70:0/3482353337 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56378cda22d0 con 0x56378cdef3a0 2024-05-08T08:13:40.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.515+0000 7fdee3e00700 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56378cdef3a0 0x56378cdf1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.516+0000 7fdee3e00700 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56378cdef3a0 0x56378cdf1790 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca2728c779334004 server_cookie=66c86fe1c7326d5b in_seq=0 out_seq=0 2024-05-08T08:13:40.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.516+0000 7fdece000700 10 client.17775 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:13:40.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdece000700 1 -- 172.21.15.70:0/3482353337 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56378cda22d0 con 0x56378cdef3a0 2024-05-08T08:13:40.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdece000700 10 client.17775 handle_command_reply: tid=0 2024-05-08T08:13:40.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdef530ab80 1 client.17775 shutdown 2024-05-08T08:13:40.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdef530ab80 1 -- 172.21.15.70:0/3482353337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddb2e0 msgr2=0x56378cddeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:40.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdef530ab80 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddb2e0 0x56378cddeda0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fded0003980 tx=0x7fded00047c0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdef530ab80 1 -- 172.21.15.70:0/3482353337 shutdown_connections 2024-05-08T08:13:40.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdef530ab80 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56378cdef3a0 0x56378cdf1790 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdef530ab80 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddbc00 0x56378cddf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdef530ab80 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cde19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdece000700 0 client.17775 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:13:40.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdef530ab80 1 --2- 172.21.15.70:0/3482353337 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddb2e0 0x56378cddeda0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.518+0000 7fdef530ab80 1 -- 172.21.15.70:0/3482353337 >> 172.21.15.70:0/3482353337 conn(0x56378cd4d860 msgr2=0x56378cdd4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:13:40.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.519+0000 7fdef530ab80 1 -- 172.21.15.70:0/3482353337 shutdown_connections 2024-05-08T08:13:40.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.519+0000 7fdef530ab80 1 -- 172.21.15.70:0/3482353337 wait complete. 2024-05-08T08:13:40.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.519+0000 7fdef530ab80 20 client.17775 trim_cache size 0 max 16384 2024-05-08T08:13:40.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.555+0000 7fdef530ab80 1 Processor -- start 2024-05-08T08:13:40.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.555+0000 7fdef530ab80 1 -- start start 2024-05-08T08:13:40.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.555+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cdeb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.555+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cdf7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.555+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddbc00 0x56378cdf75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.555+0000 7fdef530ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b8290 con 0x56378cddbc00 2024-05-08T08:13:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.555+0000 7fdef530ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b5b20 con 0x56378cdd5e30 2024-05-08T08:13:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.555+0000 7fdef530ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b3990 con 0x56378cddb2e0 2024-05-08T08:13:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.556+0000 7fdee3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cdeb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.556+0000 7fdee8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddbc00 0x56378cdf75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.556+0000 7fdee3e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cdeb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:39906/0 (socket says 172.21.15.70:39906) 2024-05-08T08:13:40.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.556+0000 7fdee3e00700 1 -- 172.21.15.70:0/4153272375 learned_addr learned my addr 172.21.15.70:0/4153272375 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:13:40.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.556+0000 7fdee3400700 1 --2- 172.21.15.70:0/4153272375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cdf7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.557+0000 7fdee8a00700 1 -- 172.21.15.70:0/4153272375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 msgr2=0x56378cdf7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:13:40.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.557+0000 7fdee8a00700 1 --2- 172.21.15.70:0/4153272375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cdf7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.557+0000 7fdee8a00700 1 -- 172.21.15.70:0/4153272375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 msgr2=0x56378cdeb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:13:40.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.557+0000 7fdee8a00700 1 --2- 172.21.15.70:0/4153272375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cdeb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.557+0000 7fdee8a00700 1 -- 172.21.15.70:0/4153272375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56378cdf1dc0 con 0x56378cddbc00 2024-05-08T08:13:40.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.557+0000 7fdee3400700 1 --2- 172.21.15.70:0/4153272375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cdf7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:13:40.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.558+0000 7fdee8a00700 1 --2- 172.21.15.70:0/4153272375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddbc00 0x56378cdf75c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009b40 tx=0x7fdedc005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bc56e62aeb2221 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:13:40.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.558+0000 7fded8c00700 1 -- 172.21.15.70:0/4153272375 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc020040 con 0x56378cddbc00 2024-05-08T08:13:40.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.558+0000 7fded8c00700 1 -- 172.21.15.70:0/4153272375 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdedc003d00 con 0x56378cddbc00 2024-05-08T08:13:40.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.558+0000 7fded8c00700 1 -- 172.21.15.70:0/4153272375 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0056e0 con 0x56378cddbc00 2024-05-08T08:13:40.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.560+0000 7fdef530ab80 1 -- 172.21.15.70:0/4153272375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddbc00 msgr2=0x56378cdf75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:13:40.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.560+0000 7fdef530ab80 1 --2- 172.21.15.70:0/4153272375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddbc00 0x56378cdf75c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009b40 tx=0x7fdedc005040 comp rx=0 tx=0).stop 2024-05-08T08:13:40.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.560+0000 7fdef530ab80 1 -- 172.21.15.70:0/4153272375 shutdown_connections 2024-05-08T08:13:40.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.560+0000 7fdef530ab80 1 --2- 172.21.15.70:0/4153272375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cddbc00 0x56378cdf75c0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.560+0000 7fdef530ab80 1 --2- 172.21.15.70:0/4153272375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cdd5e30 0x56378cdeb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.560+0000 7fdef530ab80 1 --2- 172.21.15.70:0/4153272375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cdf7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.560+0000 7fdef530ab80 1 -- 172.21.15.70:0/4153272375 >> 172.21.15.70:0/4153272375 conn(0x56378cd4d860 msgr2=0x56378cdd5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:13:40.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.560+0000 7fdef530ab80 1 -- 172.21.15.70:0/4153272375 shutdown_connections 2024-05-08T08:13:40.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.561+0000 7fdef530ab80 1 -- 172.21.15.70:0/4153272375 wait complete. 2024-05-08T08:13:40.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.561+0000 7fdef530ab80 1 -- start start 2024-05-08T08:13:40.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.562+0000 7fdef530ab80 1 Processor -- start 2024-05-08T08:13:40.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.562+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cde81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.562+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cde4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.562+0000 7fdef530ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cde51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.562+0000 7fdef530ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b3fe0 con 0x56378cdd5e30 2024-05-08T08:13:40.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.562+0000 7fdef530ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b5450 con 0x56378cddbc00 2024-05-08T08:13:40.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.562+0000 7fdef530ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdee41b46b0 con 0x56378cddb2e0 2024-05-08T08:13:40.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.563+0000 7fdee3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cde81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.563+0000 7fdee3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cde81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54634/0 (socket says 172.21.15.70:54634) 2024-05-08T08:13:40.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.563+0000 7fdee3e00700 1 -- 172.21.15.70:0/260611188 learned_addr learned my addr 172.21.15.70:0/260611188 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:13:40.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.563+0000 7fdef530ab80 10 client.0 _ll_register_callbacks cb 0x56378cccee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:13:40.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.563+0000 7fdee3400700 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cde4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.563+0000 7fdee8a00700 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cde51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.563+0000 7fdee3e00700 1 -- 172.21.15.70:0/260611188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 msgr2=0x56378cde4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:13:40.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.564+0000 7fdee3e00700 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cde4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.564+0000 7fdee3e00700 1 -- 172.21.15.70:0/260611188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 msgr2=0x56378cde51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:13:40.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.564+0000 7fdee3e00700 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cde51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:13:40.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.564+0000 7fdee3e00700 1 -- 172.21.15.70:0/260611188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56378ce59c40 con 0x56378cdd5e30 2024-05-08T08:13:40.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.564+0000 7fdee8a00700 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cde51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:13:40.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.564+0000 7fdee3e00700 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cde81e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fded40a9650 tx=0x7fded4091040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2d1964f70b6b32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:13:40.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.564+0000 7fdece000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:13:40.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.565+0000 7fdece000700 1 -- 172.21.15.70:0/260611188 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded40e0250 con 0x56378cdd5e30 2024-05-08T08:13:40.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.565+0000 7fdece000700 1 -- 172.21.15.70:0/260611188 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(251..251 src has 1..251) ==== 9583+0+0 (secure 0 0 0) 0x7fded40a9bb0 con 0x56378cdd5e30 2024-05-08T08:13:40.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.565+0000 7fdef530ab80 1 -- 172.21.15.70:0/260611188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdedc003d00 con 0x56378cdd5e30 2024-05-08T08:13:40.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.565+0000 7fdece000700 1 -- 172.21.15.70:0/260611188 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fded40aa050 con 0x56378cdd5e30 2024-05-08T08:13:40.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.565+0000 7fdef530ab80 10 client.17781 fetch_fsmap learned FSMap version 42 2024-05-08T08:13:40.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.565+0000 7fdef530ab80 1 -- 172.21.15.70:0/260611188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56378ce5ae70 con 0x56378cdd5e30 2024-05-08T08:13:40.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.566+0000 7fdece000700 1 -- 172.21.15.70:0/260611188 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdedc003d00 con 0x56378cdd5e30 2024-05-08T08:13:40.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.566+0000 7fdece000700 1 -- 172.21.15.70:0/260611188 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fded400c2d0 con 0x56378cdd5e30 2024-05-08T08:13:40.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.566+0000 7fdef530ab80 10 client.17781 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:13:40.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.566+0000 7fdef530ab80 10 client.17781 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:13:40.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.566+0000 7fdef530ab80 20 client.17781 populate_metadata read hostname 'smithi070' 2024-05-08T08:13:40.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.566+0000 7fdef530ab80 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56378ce5b570 0x56378ce5d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:13:40.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.566+0000 7fdef530ab80 4 client.17781 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T08:13:40.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.566+0000 7fdef530ab80 1 -- 172.21.15.70:0/260611188 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x56378cd35590 con 0x56378ce5b570 2024-05-08T08:13:40.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.567+0000 7fdee3400700 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56378ce5b570 0x56378ce5d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:13:40.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.569+0000 7fdece000700 10 client.17781 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:13:40.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:13:40.569+0000 7fdee3400700 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56378ce5b570 0x56378ce5d990 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3703acbac8f38d server_cookie=14b9d98a980b1872 in_seq=0 out_seq=0 2024-05-08T08:13:40.728 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evxfgpe.o 2024-05-08T08:13:41.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:41 smithi172 ceph-mon[33377]: pgmap v2774: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 859 KiB/s wr, 39 op/s 2024-05-08T08:13:41.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:41 smithi194 ceph-mon[33679]: pgmap v2774: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 859 KiB/s wr, 39 op/s 2024-05-08T08:13:41.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:41 smithi070 ceph-mon[29591]: pgmap v2774: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 618 KiB/s rd, 859 KiB/s wr, 39 op/s 2024-05-08T08:13:43.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:13:43.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:13:43.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:13:44.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:43 smithi172 ceph-mon[33377]: pgmap v2775: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 596 KiB/s wr, 30 op/s 2024-05-08T08:13:44.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:43 smithi194 ceph-mon[33679]: pgmap v2775: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 596 KiB/s wr, 30 op/s 2024-05-08T08:13:44.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:43 smithi070 ceph-mon[29591]: pgmap v2775: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 596 KiB/s wr, 30 op/s 2024-05-08T08:13:45.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:13:45.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:13:45.157 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:13:45.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:13:45.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:13:45.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:13:45.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:13:45.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:13:45.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:13:46.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:45 smithi172 ceph-mon[33377]: pgmap v2776: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 777 KiB/s wr, 50 op/s 2024-05-08T08:13:46.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:45 smithi194 ceph-mon[33679]: pgmap v2776: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 777 KiB/s wr, 50 op/s 2024-05-08T08:13:46.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:45 smithi070 ceph-mon[29591]: pgmap v2776: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 777 KiB/s wr, 50 op/s 2024-05-08T08:13:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:47 smithi172 ceph-mon[33377]: pgmap v2777: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 548 KiB/s wr, 31 op/s 2024-05-08T08:13:47.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:47 smithi194 ceph-mon[33679]: pgmap v2777: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 548 KiB/s wr, 31 op/s 2024-05-08T08:13:47.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:47 smithi070 ceph-mon[29591]: pgmap v2777: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 548 KiB/s wr, 31 op/s 2024-05-08T08:13:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:49 smithi172 ceph-mon[33377]: pgmap v2778: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 548 KiB/s wr, 31 op/s 2024-05-08T08:13:49.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:49 smithi194 ceph-mon[33679]: pgmap v2778: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 548 KiB/s wr, 31 op/s 2024-05-08T08:13:49.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:49 smithi070 ceph-mon[29591]: pgmap v2778: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 548 KiB/s wr, 31 op/s 2024-05-08T08:13:51.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:51 smithi172 ceph-mon[33377]: pgmap v2779: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 553 KiB/s wr, 35 op/s 2024-05-08T08:13:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:51 smithi194 ceph-mon[33679]: pgmap v2779: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 553 KiB/s wr, 35 op/s 2024-05-08T08:13:51.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:51 smithi070 ceph-mon[29591]: pgmap v2779: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 553 KiB/s wr, 35 op/s 2024-05-08T08:13:53.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:53 smithi172 ceph-mon[33377]: pgmap v2780: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 185 KiB/s wr, 24 op/s 2024-05-08T08:13:53.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:53 smithi194 ceph-mon[33679]: pgmap v2780: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 185 KiB/s wr, 24 op/s 2024-05-08T08:13:53.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:53 smithi070 ceph-mon[29591]: pgmap v2780: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 358 KiB/s rd, 185 KiB/s wr, 24 op/s 2024-05-08T08:13:55.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:55 smithi172 ceph-mon[33377]: pgmap v2781: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 207 KiB/s wr, 27 op/s 2024-05-08T08:13:55.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:55 smithi194 ceph-mon[33679]: pgmap v2781: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 207 KiB/s wr, 27 op/s 2024-05-08T08:13:55.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:55 smithi070 ceph-mon[29591]: pgmap v2781: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 207 KiB/s wr, 27 op/s 2024-05-08T08:13:57.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:57 smithi172 ceph-mon[33377]: pgmap v2782: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T08:13:57.493 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:57 smithi070 ceph-mon[29591]: pgmap v2782: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T08:13:57.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:57 smithi194 ceph-mon[33679]: pgmap v2782: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T08:13:59.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:13:59 smithi172 ceph-mon[33377]: pgmap v2783: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T08:13:59.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:13:59 smithi194 ceph-mon[33679]: pgmap v2783: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T08:13:59.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:13:59 smithi070 ceph-mon[29591]: pgmap v2783: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-08T08:14:01.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:01 smithi172 ceph-mon[33377]: pgmap v2784: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 98 KiB/s wr, 11 op/s 2024-05-08T08:14:01.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:01 smithi194 ceph-mon[33679]: pgmap v2784: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 98 KiB/s wr, 11 op/s 2024-05-08T08:14:01.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:01 smithi070 ceph-mon[29591]: pgmap v2784: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 98 KiB/s wr, 11 op/s 2024-05-08T08:14:03.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:03 smithi172 ceph-mon[33377]: pgmap v2785: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2024-05-08T08:14:03.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:03 smithi194 ceph-mon[33679]: pgmap v2785: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2024-05-08T08:14:03.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:03 smithi070 ceph-mon[29591]: pgmap v2785: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 93 KiB/s wr, 6 op/s 2024-05-08T08:14:04.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.010+0000 7fdece000700 1 -- 172.21.15.70:0/260611188 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x56378cd35590 con 0x56378ce5b570 2024-05-08T08:14:04.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.010+0000 7fdece000700 10 client.17781 handle_command_reply: tid=0 2024-05-08T08:14:04.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.010+0000 7fdef530ab80 1 client.17781 shutdown 2024-05-08T08:14:04.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdef530ab80 1 -- 172.21.15.70:0/260611188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 msgr2=0x56378cde81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:04.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdef530ab80 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cde81e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fded40a9650 tx=0x7fded4091040 comp rx=0 tx=0).stop 2024-05-08T08:14:04.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdef530ab80 1 -- 172.21.15.70:0/260611188 shutdown_connections 2024-05-08T08:14:04.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdef530ab80 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56378ce5b570 0x56378ce5d990 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:04.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdef530ab80 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56378cddbc00 0x56378cde51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:04.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdef530ab80 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56378cdd5e30 0x56378cde81e0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:04.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdef530ab80 1 --2- 172.21.15.70:0/260611188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56378cddb2e0 0x56378cde4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:04.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdef530ab80 1 -- 172.21.15.70:0/260611188 >> 172.21.15.70:0/260611188 conn(0x56378cd4d860 msgr2=0x56378cdd8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:04.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdece000700 0 client.17781 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:14:04.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.011+0000 7fdef530ab80 1 -- 172.21.15.70:0/260611188 shutdown_connections 2024-05-08T08:14:04.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.012+0000 7fdef530ab80 1 -- 172.21.15.70:0/260611188 wait complete. 2024-05-08T08:14:04.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.012+0000 7fdef530ab80 20 client.17781 trim_cache size 0 max 16384 2024-05-08T08:14:04.007 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:14:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:14:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:14:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 202, 2024-05-08T08:14:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:14:04.007 INFO:teuthology.orchestra.run.smithi070.stdout: "1ff6f6ec": { 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 202, 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:14:04.008 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:14:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:04.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:04.009 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.014+0000 7fdee9400700 1 -- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdec80b2ba0 msgr2=0x7fdec80b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.014+0000 7fdee9400700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdec80b2ba0 0x7fdec80b5060 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdee410e4f0 tx=0x7fded0009260 comp rx=0 tx=0).stop 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.014+0000 7fdee9400700 1 -- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee41044c0 msgr2=0x7fdee410fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.014+0000 7fdee9400700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee41044c0 0x7fdee410fbf0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fded4005fd0 tx=0x7fded400eca0 comp rx=0 tx=0).stop 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.014+0000 7fdee9400700 1 -- 172.21.15.70:0/1081350898 shutdown_connections 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.014+0000 7fdee9400700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdec80b2ba0 0x7fdec80b5060 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.014+0000 7fdee9400700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdee4109a50 0x7fdee410cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.015+0000 7fdee9400700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdee41044c0 0x7fdee410fbf0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.015+0000 7fdee9400700 1 --2- 172.21.15.70:0/1081350898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdee4104e70 0x7fdee4110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.015+0000 7fdee9400700 1 -- 172.21.15.70:0/1081350898 >> 172.21.15.70:0/1081350898 conn(0x7fdee40fdcf0 msgr2=0x7fdee40ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.015+0000 7fdee9400700 1 -- 172.21.15.70:0/1081350898 shutdown_connections 2024-05-08T08:14:04.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:04.015+0000 7fdee9400700 1 -- 172.21.15.70:0/1081350898 wait complete. 2024-05-08T08:14:05.170 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:05 smithi070 ceph-mon[29591]: pgmap v2786: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 159 KiB/s wr, 27 op/s 2024-05-08T08:14:05.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:05 smithi172 ceph-mon[33377]: pgmap v2786: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 159 KiB/s wr, 27 op/s 2024-05-08T08:14:05.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:05 smithi194 ceph-mon[33679]: pgmap v2786: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 159 KiB/s wr, 27 op/s 2024-05-08T08:14:05.597 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1ff6f6ec', quiesce took 38.0 seconds. Will release after: 30.0 2024-05-08T08:14:07.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:07 smithi172 ceph-mon[33377]: pgmap v2787: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 137 KiB/s wr, 24 op/s 2024-05-08T08:14:07.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:07 smithi194 ceph-mon[33679]: pgmap v2787: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 137 KiB/s wr, 24 op/s 2024-05-08T08:14:07.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:07 smithi070 ceph-mon[29591]: pgmap v2787: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 137 KiB/s wr, 24 op/s 2024-05-08T08:14:10.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:10 smithi070 ceph-mon[29591]: pgmap v2788: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 137 KiB/s wr, 24 op/s 2024-05-08T08:14:10.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:10 smithi172 ceph-mon[33377]: pgmap v2788: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 137 KiB/s wr, 24 op/s 2024-05-08T08:14:10.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:10 smithi194 ceph-mon[33679]: pgmap v2788: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 137 KiB/s wr, 24 op/s 2024-05-08T08:14:11.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:11 smithi172 ceph-mon[33377]: pgmap v2789: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 184 KiB/s wr, 27 op/s 2024-05-08T08:14:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:11 smithi194 ceph-mon[33679]: pgmap v2789: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 184 KiB/s wr, 27 op/s 2024-05-08T08:14:11.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:11 smithi070 ceph-mon[29591]: pgmap v2789: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 184 KiB/s wr, 27 op/s 2024-05-08T08:14:14.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:13 smithi070 ceph-mon[29591]: osdmap e252: 12 total, 12 up, 12 in 2024-05-08T08:14:14.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:13 smithi070 ceph-mon[29591]: pgmap v2791: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 135 KiB/s wr, 28 op/s 2024-05-08T08:14:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:13 smithi172 ceph-mon[33377]: osdmap e252: 12 total, 12 up, 12 in 2024-05-08T08:14:14.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:13 smithi172 ceph-mon[33377]: pgmap v2791: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 135 KiB/s wr, 28 op/s 2024-05-08T08:14:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:13 smithi194 ceph-mon[33679]: osdmap e252: 12 total, 12 up, 12 in 2024-05-08T08:14:14.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:13 smithi194 ceph-mon[33679]: pgmap v2791: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 135 KiB/s wr, 28 op/s 2024-05-08T08:14:15.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:15 smithi194 ceph-mon[33679]: pgmap v2792: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2024-05-08T08:14:15.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:15 smithi070 ceph-mon[29591]: pgmap v2792: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2024-05-08T08:14:15.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:15 smithi172 ceph-mon[33377]: pgmap v2792: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2024-05-08T08:14:17.426 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:17 smithi070 ceph-mon[29591]: pgmap v2793: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2024-05-08T08:14:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:17 smithi194 ceph-mon[33679]: pgmap v2793: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2024-05-08T08:14:17.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:17 smithi172 ceph-mon[33377]: pgmap v2793: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 86 KiB/s wr, 7 op/s 2024-05-08T08:14:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:20 smithi070 ceph-mon[29591]: osdmap e253: 12 total, 12 up, 12 in 2024-05-08T08:14:20.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:20 smithi070 ceph-mon[29591]: pgmap v2795: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 4 op/s 2024-05-08T08:14:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:20 smithi172 ceph-mon[33377]: osdmap e253: 12 total, 12 up, 12 in 2024-05-08T08:14:20.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:20 smithi172 ceph-mon[33377]: pgmap v2795: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 4 op/s 2024-05-08T08:14:20.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:20 smithi194 ceph-mon[33679]: osdmap e253: 12 total, 12 up, 12 in 2024-05-08T08:14:20.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:20 smithi194 ceph-mon[33679]: pgmap v2795: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 4 op/s 2024-05-08T08:14:21.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:21 smithi194 ceph-mon[33679]: pgmap v2796: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 8 op/s 2024-05-08T08:14:21.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:21 smithi070 ceph-mon[29591]: pgmap v2796: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 8 op/s 2024-05-08T08:14:21.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:21 smithi172 ceph-mon[33377]: pgmap v2796: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 8 op/s 2024-05-08T08:14:23.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:23 smithi194 ceph-mon[33679]: pgmap v2797: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2024-05-08T08:14:23.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:23 smithi070 ceph-mon[29591]: pgmap v2797: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2024-05-08T08:14:23.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:23 smithi172 ceph-mon[33377]: pgmap v2797: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 6 op/s 2024-05-08T08:14:25.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:25 smithi194 ceph-mon[33679]: pgmap v2798: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T08:14:25.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:25 smithi070 ceph-mon[29591]: pgmap v2798: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T08:14:25.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:25 smithi172 ceph-mon[33377]: pgmap v2798: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T08:14:27.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:27 smithi194 ceph-mon[33679]: pgmap v2799: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T08:14:27.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:27 smithi070 ceph-mon[29591]: pgmap v2799: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T08:14:27.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:27 smithi172 ceph-mon[33377]: pgmap v2799: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T08:14:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:29 smithi194 ceph-mon[33679]: pgmap v2800: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T08:14:29.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:29 smithi070 ceph-mon[29591]: pgmap v2800: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T08:14:29.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:29 smithi172 ceph-mon[33377]: pgmap v2800: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 6 op/s 2024-05-08T08:14:31.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:31 smithi194 ceph-mon[33679]: pgmap v2801: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T08:14:31.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:31 smithi070 ceph-mon[29591]: pgmap v2801: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T08:14:31.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:31 smithi172 ceph-mon[33377]: pgmap v2801: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 7 op/s 2024-05-08T08:14:33.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:33 smithi194 ceph-mon[33679]: pgmap v2802: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-05-08T08:14:33.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:33 smithi070 ceph-mon[29591]: pgmap v2802: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-05-08T08:14:33.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:33 smithi172 ceph-mon[33377]: pgmap v2802: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-05-08T08:14:35.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:35 smithi194 ceph-mon[33679]: pgmap v2803: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-05-08T08:14:35.598 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:14:35.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:35 smithi070 ceph-mon[29591]: pgmap v2803: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-05-08T08:14:35.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:35 smithi172 ceph-mon[33377]: pgmap v2803: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 7 op/s 2024-05-08T08:14:36.058 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:14:37.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:37 smithi172 ceph-mon[33377]: pgmap v2804: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T08:14:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:37 smithi194 ceph-mon[33679]: pgmap v2804: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T08:14:37.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:37 smithi070 ceph-mon[29591]: pgmap v2804: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T08:14:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.524+0000 7f80aee00700 1 -- 172.21.15.70:0/942916938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810e8b0 msgr2=0x7f80a810ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.524+0000 7f80aee00700 1 --2- 172.21.15.70:0/942916938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810e8b0 0x7f80a810ec90 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f809c00b0a0 tx=0x7f809c00b3b0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.525+0000 7f80aee00700 1 -- 172.21.15.70:0/942916938 shutdown_connections 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.525+0000 7f80aee00700 1 --2- 172.21.15.70:0/942916938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a810a3a0 0x7f80a8116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.525+0000 7f80aee00700 1 --2- 172.21.15.70:0/942916938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810e8b0 0x7f80a810ec90 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.525+0000 7f80aee00700 1 --2- 172.21.15.70:0/942916938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a81099e0 0x7f80a8109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.525+0000 7f80aee00700 1 -- 172.21.15.70:0/942916938 >> 172.21.15.70:0/942916938 conn(0x7f80a8079230 msgr2=0x7f80a81082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.525+0000 7f80aee00700 1 -- 172.21.15.70:0/942916938 shutdown_connections 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.525+0000 7f80aee00700 1 -- 172.21.15.70:0/942916938 wait complete. 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.526+0000 7f80aee00700 1 Processor -- start 2024-05-08T08:14:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.526+0000 7f80aee00700 1 -- start start 2024-05-08T08:14:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.526+0000 7f80aee00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a81099e0 0x7f80a81a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.526+0000 7f80aee00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810a3a0 0x7f80a81a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.526+0000 7f80aee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a810e8b0 0x7f80a81a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.526+0000 7f80aee00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f80a8119aa0 con 0x7f80a810a3a0 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.526+0000 7f80aee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f80a8119920 con 0x7f80a810e8b0 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.526+0000 7f80aee00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f80a8119c20 con 0x7f80a81099e0 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ad000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810a3a0 0x7f80a81a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ad000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810a3a0 0x7f80a81a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44426/0 (socket says 172.21.15.70:44426) 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ad000700 1 -- 172.21.15.70:0/2019056129 learned_addr learned my addr 172.21.15.70:0/2019056129 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ae400700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a810e8b0 0x7f80a81a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ada00700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a81099e0 0x7f80a81a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ad000700 1 -- 172.21.15.70:0/2019056129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a81099e0 msgr2=0x7f80a81a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ad000700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a81099e0 0x7f80a81a0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ad000700 1 -- 172.21.15.70:0/2019056129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a810e8b0 msgr2=0x7f80a81a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ad000700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a810e8b0 0x7f80a81a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.527+0000 7f80ad000700 1 -- 172.21.15.70:0/2019056129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a81a5040 con 0x7f80a810a3a0 2024-05-08T08:14:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.528+0000 7f80ad000700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810a3a0 0x7f80a81a0570 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f809400d980 tx=0x7f809400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.528+0000 7f80a6000700 1 -- 172.21.15.70:0/2019056129 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8094017070 con 0x7f80a810a3a0 2024-05-08T08:14:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.528+0000 7f80a6000700 1 -- 172.21.15.70:0/2019056129 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8094004830 con 0x7f80a810a3a0 2024-05-08T08:14:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.528+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a81a52d0 con 0x7f80a810a3a0 2024-05-08T08:14:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.528+0000 7f80a6000700 1 -- 172.21.15.70:0/2019056129 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80940053a0 con 0x7f80a810a3a0 2024-05-08T08:14:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.528+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a81acbb0 con 0x7f80a810a3a0 2024-05-08T08:14:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.529+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80a806a190 con 0x7f80a810a3a0 2024-05-08T08:14:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.532+0000 7f80a6000700 1 -- 172.21.15.70:0/2019056129 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f80940049e0 con 0x7f80a810a3a0 2024-05-08T08:14:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.533+0000 7f80a6000700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f80900b2a70 0x7f80900b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.533+0000 7f80a6000700 1 -- 172.21.15.70:0/2019056129 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(253..253 src has 1..253) ==== 9583+0+0 (secure 0 0 0) 0x7f80940e29c0 con 0x7f80a810a3a0 2024-05-08T08:14:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.534+0000 7f80ada00700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f80900b2a70 0x7f80900b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.534+0000 7f80ada00700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f80900b2a70 0x7f80900b4f30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f809c00b070 tx=0x7f809c00b7b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.538+0000 7f80a6000700 1 -- 172.21.15.70:0/2019056129 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8094020020 con 0x7f80a810a3a0 2024-05-08T08:14:38.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.822+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80a802e510 con 0x7f80a810a3a0 2024-05-08T08:14:38.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.824+0000 7f80a6000700 1 -- 172.21.15.70:0/2019056129 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f80940a9f20 con 0x7f80a810a3a0 2024-05-08T08:14:38.818 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:14:38.819 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f80900b2a70 msgr2=0x7f80900b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f80900b2a70 0x7f80900b4f30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f809c00b070 tx=0x7f809c00b7b0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810a3a0 msgr2=0x7f80a81a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810a3a0 0x7f80a81a0570 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f809400d980 tx=0x7f809400dd40 comp rx=0 tx=0).stop 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 shutdown_connections 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f80900b2a70 0x7f80900b4f30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f80a810e8b0 0x7f80a81a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80a81099e0 0x7f80a81a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 --2- 172.21.15.70:0/2019056129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f80a810a3a0 0x7f80a81a0570 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.827+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 >> 172.21.15.70:0/2019056129 conn(0x7f80a8079230 msgr2=0x7f80a80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:38.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.828+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 shutdown_connections 2024-05-08T08:14:38.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:38.828+0000 7f80aee00700 1 -- 172.21.15.70:0/2019056129 wait complete. 2024-05-08T08:14:38.823 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:14:39.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:38 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2019056129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:14:39.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:38 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2019056129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:14:39.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:38 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2019056129' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:14:39.621 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 1ff6f6ec --release --await' 2024-05-08T08:14:39.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 1ff6f6ec --release --await 2024-05-08T08:14:40.106 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:14:40.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:39 smithi172 ceph-mon[33377]: pgmap v2805: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T08:14:40.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:39 smithi194 ceph-mon[33679]: pgmap v2805: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T08:14:40.257 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:39 smithi070 ceph-mon[29591]: pgmap v2805: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T08:14:41.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:41 smithi194 ceph-mon[33679]: pgmap v2806: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-05-08T08:14:41.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:41 smithi070 ceph-mon[29591]: pgmap v2806: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-05-08T08:14:41.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:41 smithi172 ceph-mon[33377]: pgmap v2806: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 4.4 KiB/s wr, 7 op/s 2024-05-08T08:14:42.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.363+0000 7f54c1200700 1 -- 172.21.15.70:0/1389010809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 msgr2=0x7f54bc109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:42.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.363+0000 7f54c1200700 1 --2- 172.21.15.70:0/1389010809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 0x7f54bc109f50 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f54a8009990 tx=0x7f54a8009ca0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.363+0000 7f54c1200700 1 -- 172.21.15.70:0/1389010809 shutdown_connections 2024-05-08T08:14:42.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.363+0000 7f54c1200700 1 --2- 172.21.15.70:0/1389010809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc10a490 0x7f54bc1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.363+0000 7f54c1200700 1 --2- 172.21.15.70:0/1389010809 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc10fb60 0x7f54bc10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.363+0000 7f54c1200700 1 --2- 172.21.15.70:0/1389010809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 0x7f54bc109f50 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.363+0000 7f54c1200700 1 -- 172.21.15.70:0/1389010809 >> 172.21.15.70:0/1389010809 conn(0x7f54bc076c70 msgr2=0x7f54bc1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:42.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.364+0000 7f54c1200700 1 -- 172.21.15.70:0/1389010809 shutdown_connections 2024-05-08T08:14:42.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.364+0000 7f54c1200700 1 -- 172.21.15.70:0/1389010809 wait complete. 2024-05-08T08:14:42.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.365+0000 7f54c1200700 1 Processor -- start 2024-05-08T08:14:42.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.365+0000 7f54c1200700 1 -- start start 2024-05-08T08:14:42.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.365+0000 7f54c1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 0x7f54bc1a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.365+0000 7f54c1200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc10a490 0x7f54bc1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.365+0000 7f54c1200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc10fb60 0x7f54bc1a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.365+0000 7f54c1200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc119bd0 con 0x7f54bc109ad0 2024-05-08T08:14:42.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.365+0000 7f54c1200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc119a50 con 0x7f54bc10fb60 2024-05-08T08:14:42.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.365+0000 7f54c1200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc119d50 con 0x7f54bc10a490 2024-05-08T08:14:42.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.365+0000 7f54b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 0x7f54bc1a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 0x7f54bc1a00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44442/0 (socket says 172.21.15.70:44442) 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9e00700 1 -- 172.21.15.70:0/3387851969 learned_addr learned my addr 172.21.15.70:0/3387851969 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9400700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc10a490 0x7f54bc1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54ba800700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc10fb60 0x7f54bc1a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9e00700 1 -- 172.21.15.70:0/3387851969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc10a490 msgr2=0x7f54bc1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9e00700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc10a490 0x7f54bc1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9e00700 1 -- 172.21.15.70:0/3387851969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc10fb60 msgr2=0x7f54bc1a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9e00700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc10fb60 0x7f54bc1a49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9e00700 1 -- 172.21.15.70:0/3387851969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc1a50f0 con 0x7f54bc109ad0 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9400700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc10a490 0x7f54bc1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:14:42.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.366+0000 7f54b9e00700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 0x7f54bc1a00e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c920 tx=0x7f54ac00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:42.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.367+0000 7f54b2a00700 1 -- 172.21.15.70:0/3387851969 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac007b00 con 0x7f54bc109ad0 2024-05-08T08:14:42.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.367+0000 7f54b2a00700 1 -- 172.21.15.70:0/3387851969 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54ac004cc0 con 0x7f54bc109ad0 2024-05-08T08:14:42.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.367+0000 7f54c1200700 1 -- 172.21.15.70:0/3387851969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc1a53e0 con 0x7f54bc109ad0 2024-05-08T08:14:42.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.367+0000 7f54b2a00700 1 -- 172.21.15.70:0/3387851969 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0054f0 con 0x7f54bc109ad0 2024-05-08T08:14:42.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.367+0000 7f54c1200700 1 -- 172.21.15.70:0/3387851969 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc1acc60 con 0x7f54bc109ad0 2024-05-08T08:14:42.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.371+0000 7f54b2a00700 1 -- 172.21.15.70:0/3387851969 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f54ac007ca0 con 0x7f54bc109ad0 2024-05-08T08:14:42.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.372+0000 7f54b2a00700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54a00b29f0 0x7f54a00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.372+0000 7f54b2a00700 1 -- 172.21.15.70:0/3387851969 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(253..253 src has 1..253) ==== 9583+0+0 (secure 0 0 0) 0x7f54ac0e2660 con 0x7f54bc109ad0 2024-05-08T08:14:42.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.372+0000 7f54b9400700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54a00b29f0 0x7f54a00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.373+0000 7f54b9400700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54a00b29f0 0x7f54a00b4eb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f54a800b5c0 tx=0x7f54a8005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:42.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.395+0000 7f54cbb09b80 1 Processor -- start 2024-05-08T08:14:42.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.396+0000 7f54cbb09b80 1 -- start start 2024-05-08T08:14:42.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.396+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 0x55e2040dc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.396+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6490 0x55e2040d6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.396+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6e50 0x55e2040e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.396+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e204028b20 con 0x55e2040d6e50 2024-05-08T08:14:42.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.396+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e203fc6860 con 0x55e2040dbec0 2024-05-08T08:14:42.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.396+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e204024ae0 con 0x55e2040d6490 2024-05-08T08:14:42.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54ba800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6e50 0x55e2040e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54ba800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6e50 0x55e2040e2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44458/0 (socket says 172.21.15.70:44458) 2024-05-08T08:14:42.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54ba800700 1 -- 172.21.15.70:0/4286090464 learned_addr learned my addr 172.21.15.70:0/4286090464 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:42.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54b9400700 1 --2- 172.21.15.70:0/4286090464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6490 0x55e2040d6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54b9e00700 1 --2- 172.21.15.70:0/4286090464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 0x55e2040dc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54ba800700 1 -- 172.21.15.70:0/4286090464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6490 msgr2=0x55e2040d6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:42.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54ba800700 1 --2- 172.21.15.70:0/4286090464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6490 0x55e2040d6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54ba800700 1 -- 172.21.15.70:0/4286090464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 msgr2=0x55e2040dc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:42.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54ba800700 1 --2- 172.21.15.70:0/4286090464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 0x55e2040dc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.397+0000 7f54ba800700 1 -- 172.21.15.70:0/4286090464 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e203f759d0 con 0x55e2040d6e50 2024-05-08T08:14:42.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.398+0000 7f54ba800700 1 --2- 172.21.15.70:0/4286090464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6e50 0x55e2040e2c80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d250 tx=0x7f54b400d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759ee39ace67dcb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:42.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.398+0000 7f54a7400700 1 -- 172.21.15.70:0/4286090464 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4016020 con 0x55e2040d6e50 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.398+0000 7f54a7400700 1 -- 172.21.15.70:0/4286090464 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54b400de30 con 0x55e2040d6e50 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.398+0000 7f54a7400700 1 -- 172.21.15.70:0/4286090464 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4011850 con 0x55e2040d6e50 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.399+0000 7f54cbb09b80 1 -- 172.21.15.70:0/4286090464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6e50 msgr2=0x55e2040e2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.399+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/4286090464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6e50 0x55e2040e2c80 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d250 tx=0x7f54b400d610 comp rx=0 tx=0).stop 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.399+0000 7f54cbb09b80 1 -- 172.21.15.70:0/4286090464 shutdown_connections 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.399+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/4286090464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6e50 0x55e2040e2c80 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.399+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/4286090464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 0x55e2040dc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.399+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/4286090464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6490 0x55e2040d6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.399+0000 7f54cbb09b80 1 -- 172.21.15.70:0/4286090464 >> 172.21.15.70:0/4286090464 conn(0x55e204004c60 msgr2=0x55e2040d0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.399+0000 7f54cbb09b80 1 -- 172.21.15.70:0/4286090464 shutdown_connections 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.399+0000 7f54cbb09b80 1 -- 172.21.15.70:0/4286090464 wait complete. 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.400+0000 7f54cbb09b80 1 -- start start 2024-05-08T08:14:42.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.400+0000 7f54cbb09b80 1 Processor -- start 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.400+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6490 0x55e2040e2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040dfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 0x55e2040e0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e2040e3280 con 0x55e2040d6490 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e203f8ec20 con 0x55e2040dbec0 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e2040e3400 con 0x55e2040d6e50 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54cbb09b80 10 client.0 _ll_register_callbacks cb 0x55e203fcfd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6490 0x55e2040e2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6490 0x55e2040e2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44474/0 (socket says 172.21.15.70:44474) 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9e00700 1 -- 172.21.15.70:0/1971592523 learned_addr learned my addr 172.21.15.70:0/1971592523 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:42.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54ba800700 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 0x55e2040e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9400700 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040dfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9e00700 1 -- 172.21.15.70:0/1971592523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 msgr2=0x55e2040dfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9e00700 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040dfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9e00700 1 -- 172.21.15.70:0/1971592523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 msgr2=0x55e2040e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9e00700 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 0x55e2040e0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9e00700 1 -- 172.21.15.70:0/1971592523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e203fee520 con 0x55e2040d6490 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.401+0000 7f54b9400700 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040dfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.402+0000 7f54b9e00700 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6490 0x55e2040e2820 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0a91c0 tx=0x7f54ac0a8d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb5f777ea3e5cfa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.402+0000 7f549be00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.402+0000 7f549be00700 1 -- 172.21.15.70:0/1971592523 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac0c3060 con 0x55e2040d6490 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.402+0000 7f549be00700 1 -- 172.21.15.70:0/1971592523 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(253..253 src has 1..253) ==== 9583+0+0 (secure 0 0 0) 0x7f54ac0a9930 con 0x55e2040d6490 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.402+0000 7f54cbb09b80 1 -- 172.21.15.70:0/1971592523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b400de30 con 0x55e2040d6490 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.402+0000 7f549be00700 1 -- 172.21.15.70:0/1971592523 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f54ac01d040 con 0x55e2040d6490 2024-05-08T08:14:42.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.402+0000 7f54cbb09b80 10 client.17799 fetch_fsmap learned FSMap version 42 2024-05-08T08:14:42.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.402+0000 7f54cbb09b80 1 -- 172.21.15.70:0/1971592523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e2040eda80 con 0x55e2040d6490 2024-05-08T08:14:42.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.403+0000 7f549be00700 1 -- 172.21.15.70:0/1971592523 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54b400de30 con 0x55e2040d6490 2024-05-08T08:14:42.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.403+0000 7f549be00700 1 -- 172.21.15.70:0/1971592523 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f54ac0a8720 con 0x55e2040d6490 2024-05-08T08:14:42.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.403+0000 7f54cbb09b80 10 client.17799 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:14:42.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.403+0000 7f54cbb09b80 10 client.17799 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:14:42.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.403+0000 7f54cbb09b80 20 client.17799 populate_metadata read hostname 'smithi070' 2024-05-08T08:14:42.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.403+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e2040f0010 0x55e2040f2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.403+0000 7f54cbb09b80 4 client.17799 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:14:42.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.403+0000 7f54cbb09b80 1 -- 172.21.15.70:0/1971592523 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2040a31a0 con 0x55e2040f0010 2024-05-08T08:14:42.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.404+0000 7f54b9400700 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e2040f0010 0x55e2040f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.405+0000 7f54b9400700 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e2040f0010 0x55e2040f2490 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c84cf12145c6ce2 server_cookie=e1b8eba6600dc9a7 in_seq=0 out_seq=0 2024-05-08T08:14:42.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.405+0000 7f549be00700 10 client.17799 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:14:42.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.407+0000 7f549be00700 1 -- 172.21.15.70:0/1971592523 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e2040a31a0 con 0x55e2040f0010 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.407+0000 7f549be00700 10 client.17799 handle_command_reply: tid=0 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.407+0000 7f54cbb09b80 1 client.17799 shutdown 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.407+0000 7f54cbb09b80 1 -- 172.21.15.70:0/1971592523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6490 msgr2=0x55e2040e2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.407+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6490 0x55e2040e2820 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0a91c0 tx=0x7f54ac0a8d50 comp rx=0 tx=0).stop 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.407+0000 7f54cbb09b80 1 -- 172.21.15.70:0/1971592523 shutdown_connections 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.408+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e2040f0010 0x55e2040f2490 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.408+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040dbec0 0x55e2040e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.408+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040d6490 0x55e2040e2820 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.408+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/1971592523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040dfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.408+0000 7f549be00700 0 client.17799 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.408+0000 7f54cbb09b80 1 -- 172.21.15.70:0/1971592523 >> 172.21.15.70:0/1971592523 conn(0x55e204004c60 msgr2=0x55e2040cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:42.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.408+0000 7f54cbb09b80 1 -- 172.21.15.70:0/1971592523 shutdown_connections 2024-05-08T08:14:42.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.408+0000 7f54cbb09b80 1 -- 172.21.15.70:0/1971592523 wait complete. 2024-05-08T08:14:42.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.408+0000 7f54cbb09b80 20 client.17799 trim_cache size 0 max 16384 2024-05-08T08:14:42.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.430+0000 7f54cbb09b80 1 Processor -- start 2024-05-08T08:14:42.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.430+0000 7f54cbb09b80 1 -- start start 2024-05-08T08:14:42.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 0x55e2040ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040dea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e2040f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1b85e0 con 0x55e2040dbec0 2024-05-08T08:14:42.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1b5e70 con 0x55e2040d6490 2024-05-08T08:14:42.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1b3ce0 con 0x55e2040d6e50 2024-05-08T08:14:42.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54ba800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e2040f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54ba800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e2040f7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44484/0 (socket says 172.21.15.70:44484) 2024-05-08T08:14:42.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54ba800700 1 -- 172.21.15.70:0/48705451 learned_addr learned my addr 172.21.15.70:0/48705451 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:42.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.431+0000 7f54b9400700 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.432+0000 7f54b9e00700 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 0x55e2040ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.432+0000 7f54ba800700 1 -- 172.21.15.70:0/48705451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 msgr2=0x55e2040dea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:42.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.432+0000 7f54ba800700 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040dea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.432+0000 7f54ba800700 1 -- 172.21.15.70:0/48705451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 msgr2=0x55e2040ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:42.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.432+0000 7f54ba800700 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 0x55e2040ec2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.432+0000 7f54ba800700 1 -- 172.21.15.70:0/48705451 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2040cd980 con 0x55e2040dbec0 2024-05-08T08:14:42.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.432+0000 7f54ba800700 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e2040f7d60 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f54b40078b0 tx=0x7f54b40078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6318247e0008df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:42.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.432+0000 7f54b9e00700 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 0x55e2040ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.433+0000 7f54a6a00700 1 -- 172.21.15.70:0/48705451 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4016070 con 0x55e2040dbec0 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.433+0000 7f54a6a00700 1 -- 172.21.15.70:0/48705451 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54b4004c50 con 0x55e2040dbec0 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.433+0000 7f54a6a00700 1 -- 172.21.15.70:0/48705451 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b401b680 con 0x55e2040dbec0 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.433+0000 7f54cbb09b80 1 -- 172.21.15.70:0/48705451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 msgr2=0x55e2040f7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.433+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e2040f7d60 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f54b40078b0 tx=0x7f54b40078e0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.433+0000 7f54cbb09b80 1 -- 172.21.15.70:0/48705451 shutdown_connections 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.433+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e2040f7d60 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.433+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 0x55e2040ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.434+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/48705451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040dea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.434+0000 7f54cbb09b80 1 -- 172.21.15.70:0/48705451 >> 172.21.15.70:0/48705451 conn(0x55e204004c60 msgr2=0x55e2040de380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.434+0000 7f54cbb09b80 1 -- 172.21.15.70:0/48705451 shutdown_connections 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.434+0000 7f54cbb09b80 1 -- 172.21.15.70:0/48705451 wait complete. 2024-05-08T08:14:42.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.434+0000 7f54cbb09b80 1 -- start start 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.434+0000 7f54cbb09b80 1 Processor -- start 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 0x55e2040e5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040e5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54cbb09b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e20415a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1b4330 con 0x55e2040dbec0 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1b57a0 con 0x55e2040d6490 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54cbb09b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1b4a00 con 0x55e2040d6e50 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54cbb09b80 10 client.0 _ll_register_callbacks cb 0x55e2040da850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54ba800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e20415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54ba800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e20415a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44496/0 (socket says 172.21.15.70:44496) 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.435+0000 7f54ba800700 1 -- 172.21.15.70:0/895575614 learned_addr learned my addr 172.21.15.70:0/895575614 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:42.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.436+0000 7f54b9400700 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040e5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.436+0000 7f54b9e00700 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 0x55e2040e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.436+0000 7f54ba800700 1 -- 172.21.15.70:0/895575614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 msgr2=0x55e2040e5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:42.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.436+0000 7f54ba800700 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040e5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.436+0000 7f54ba800700 1 -- 172.21.15.70:0/895575614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 msgr2=0x55e2040e5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:42.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.436+0000 7f54ba800700 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 0x55e2040e5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:42.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.436+0000 7f54ba800700 1 -- 172.21.15.70:0/895575614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e20415ae60 con 0x55e2040dbec0 2024-05-08T08:14:42.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.436+0000 7f54ba800700 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e20415a920 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d650 tx=0x7f54b400df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37facc55851052f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:42.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.436+0000 7f549be00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:14:42.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.437+0000 7f549be00700 1 -- 172.21.15.70:0/895575614 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4016070 con 0x55e2040dbec0 2024-05-08T08:14:42.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.437+0000 7f54cbb09b80 1 -- 172.21.15.70:0/895575614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b4004c50 con 0x55e2040dbec0 2024-05-08T08:14:42.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.437+0000 7f549be00700 1 -- 172.21.15.70:0/895575614 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(253..253 src has 1..253) ==== 9583+0+0 (secure 0 0 0) 0x7f54b4005090 con 0x55e2040dbec0 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.437+0000 7f549be00700 1 -- 172.21.15.70:0/895575614 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f54b4005290 con 0x55e2040dbec0 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.437+0000 7f54cbb09b80 10 client.17805 fetch_fsmap learned FSMap version 42 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.437+0000 7f54cbb09b80 1 -- 172.21.15.70:0/895575614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e20415bfc0 con 0x55e2040dbec0 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.438+0000 7f549be00700 1 -- 172.21.15.70:0/895575614 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f54b4004c50 con 0x55e2040dbec0 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.438+0000 7f549be00700 1 -- 172.21.15.70:0/895575614 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f54b4024a70 con 0x55e2040dbec0 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.438+0000 7f54cbb09b80 10 client.17805 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.438+0000 7f54cbb09b80 10 client.17805 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.438+0000 7f54cbb09b80 20 client.17805 populate_metadata read hostname 'smithi070' 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.438+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e20415c2d0 0x55e20415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.438+0000 7f54cbb09b80 4 client.17805 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1ff6f6ec", "release": true, "await": true}] 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.438+0000 7f54cbb09b80 1 -- 172.21.15.70:0/895575614 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1ff6f6ec", "release": true, "await": true}) -- 0x55e204036500 con 0x55e20415c2d0 2024-05-08T08:14:42.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.439+0000 7f54b9e00700 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e20415c2d0 0x55e20415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:42.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.440+0000 7f54b9e00700 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e20415c2d0 0x55e20415e6c0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d41db5fb04b9759f server_cookie=7274af2d4b60a94d in_seq=0 out_seq=0 2024-05-08T08:14:42.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:42.440+0000 7f549be00700 10 client.17805 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:14:43.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:43 smithi194 ceph-mon[33679]: pgmap v2807: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T08:14:43.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:43 smithi070 ceph-mon[29591]: pgmap v2807: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T08:14:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:43 smithi172 ceph-mon[33377]: pgmap v2807: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.4 KiB/s wr, 5 op/s 2024-05-08T08:14:44.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:14:45.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:14:45.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:14:45.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:45 smithi172 ceph-mon[33377]: pgmap v2808: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-05-08T08:14:46.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:45 smithi194 ceph-mon[33679]: pgmap v2808: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-05-08T08:14:46.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:45 smithi070 ceph-mon[29591]: pgmap v2808: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-05-08T08:14:46.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:14:46.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:14:46.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:14:46.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.951+0000 7f549be00700 1 -- 172.21.15.70:0/895575614 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55e204036500 con 0x55e20415c2d0 2024-05-08T08:14:46.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.951+0000 7f549be00700 10 client.17805 handle_command_reply: tid=0 2024-05-08T08:14:46.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.951+0000 7f54cbb09b80 1 client.17805 shutdown 2024-05-08T08:14:46.947 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:14:46.947 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:14:46.947 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:14:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.952+0000 7f54cbb09b80 1 -- 172.21.15.70:0/895575614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 msgr2=0x55e20415a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.952+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e20415a920 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f54b400d650 tx=0x7f54b400df60 comp rx=0 tx=0).stop 2024-05-08T08:14:46.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.953+0000 7f54cbb09b80 1 -- 172.21.15.70:0/895575614 shutdown_connections 2024-05-08T08:14:46.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.953+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e20415c2d0 0x55e20415e6c0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.953+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e2040dbec0 0x55e20415a920 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.953+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e2040d6490 0x55e2040e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.953+0000 7f54cbb09b80 1 --2- 172.21.15.70:0/895575614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e2040d6e50 0x55e2040e5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.953+0000 7f54cbb09b80 1 -- 172.21.15.70:0/895575614 >> 172.21.15.70:0/895575614 conn(0x55e204004c60 msgr2=0x55e2040dec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:46.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.953+0000 7f549be00700 0 client.17805 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:14:46.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.954+0000 7f54cbb09b80 1 -- 172.21.15.70:0/895575614 shutdown_connections 2024-05-08T08:14:46.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.954+0000 7f54cbb09b80 1 -- 172.21.15.70:0/895575614 wait complete. 2024-05-08T08:14:46.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.954+0000 7f54cbb09b80 20 client.17805 trim_cache size 0 max 16384 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 204, 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "1ff6f6ec": { 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 204, 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:14:46.949 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:46.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:46.951 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:14:46.951 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:14:46.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 -- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54a00b29f0 msgr2=0x7f54a00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:46.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54a00b29f0 0x7f54a00b4eb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f54a800b5c0 tx=0x7f54a8005fb0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 -- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 msgr2=0x7f54bc1a00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 0x7f54bc1a00e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c920 tx=0x7f54ac00cce0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 -- 172.21.15.70:0/3387851969 shutdown_connections 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54a00b29f0 0x7f54a00b4eb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54bc10fb60 0x7f54bc1a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54bc109ad0 0x7f54bc1a00e0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 --2- 172.21.15.70:0/3387851969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc10a490 0x7f54bc1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.956+0000 7f54c1200700 1 -- 172.21.15.70:0/3387851969 >> 172.21.15.70:0/3387851969 conn(0x7f54bc076c70 msgr2=0x7f54bc077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.957+0000 7f54c1200700 1 -- 172.21.15.70:0/3387851969 shutdown_connections 2024-05-08T08:14:46.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:46.957+0000 7f54c1200700 1 -- 172.21.15.70:0/3387851969 wait complete. 2024-05-08T08:14:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:14:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:14:47.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:14:47.768 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1ff6f6ec', seconds elapsed: 80.2 2024-05-08T08:14:47.768 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T08:14:47.768 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:14:48.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:47 smithi194 ceph-mon[33679]: pgmap v2809: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-05-08T08:14:48.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:47 smithi070 ceph-mon[29591]: pgmap v2809: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-05-08T08:14:48.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:47 smithi172 ceph-mon[33377]: pgmap v2809: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-05-08T08:14:48.333 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:14:49.110 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/evxfregn.o 2024-05-08T08:14:49.496 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:49 smithi070 ceph-mon[29591]: pgmap v2810: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T08:14:49.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:49 smithi194 ceph-mon[33679]: pgmap v2810: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T08:14:49.626 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/clz_ctz.o 2024-05-08T08:14:49.668 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/audit.o 2024-05-08T08:14:49.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:49 smithi172 ceph-mon[33377]: pgmap v2810: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 11 KiB/s wr, 7 op/s 2024-05-08T08:14:49.748 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/hdac_i915.o 2024-05-08T08:14:49.795 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/perf_regs.o 2024-05-08T08:14:50.429 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/clntxdr.o 2024-05-08T08:14:50.444 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs3proc.o 2024-05-08T08:14:50.618 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/selftests.o 2024-05-08T08:14:50.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.918+0000 7efc48200700 1 -- 172.21.15.70:0/4132802037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc401083d0 msgr2=0x7efc4006b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:50.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.918+0000 7efc48200700 1 --2- 172.21.15.70:0/4132802037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc401083d0 0x7efc4006b1b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efc34009990 tx=0x7efc34009ca0 comp rx=0 tx=0).stop 2024-05-08T08:14:50.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.918+0000 7efc48200700 1 -- 172.21.15.70:0/4132802037 shutdown_connections 2024-05-08T08:14:50.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.918+0000 7efc48200700 1 --2- 172.21.15.70:0/4132802037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc40105ee0 0x7efc40106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:50.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.918+0000 7efc48200700 1 --2- 172.21.15.70:0/4132802037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc401083d0 0x7efc4006b1b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:50.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.918+0000 7efc48200700 1 --2- 172.21.15.70:0/4132802037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc4006b6f0 0x7efc4006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:50.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.918+0000 7efc48200700 1 -- 172.21.15.70:0/4132802037 >> 172.21.15.70:0/4132802037 conn(0x7efc40079350 msgr2=0x7efc40079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:50.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.918+0000 7efc48200700 1 -- 172.21.15.70:0/4132802037 shutdown_connections 2024-05-08T08:14:50.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.918+0000 7efc48200700 1 -- 172.21.15.70:0/4132802037 wait complete. 2024-05-08T08:14:50.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.920+0000 7efc48200700 1 Processor -- start 2024-05-08T08:14:50.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.920+0000 7efc48200700 1 -- start start 2024-05-08T08:14:50.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.921+0000 7efc48200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc4006b6f0 0x7efc401a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:50.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.921+0000 7efc48200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc40105ee0 0x7efc401a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:50.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.921+0000 7efc48200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc401083d0 0x7efc401a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:50.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.921+0000 7efc48200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc40119ac0 con 0x7efc40105ee0 2024-05-08T08:14:50.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.921+0000 7efc48200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc40119940 con 0x7efc4006b6f0 2024-05-08T08:14:50.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.921+0000 7efc48200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efc40119c40 con 0x7efc401083d0 2024-05-08T08:14:50.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.921+0000 7efc44e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc40105ee0 0x7efc401a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:50.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.922+0000 7efc45800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc4006b6f0 0x7efc401a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:50.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.922+0000 7efc45800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc4006b6f0 0x7efc401a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:56904/0 (socket says 172.21.15.70:56904) 2024-05-08T08:14:50.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.922+0000 7efc45800700 1 -- 172.21.15.70:0/913912895 learned_addr learned my addr 172.21.15.70:0/913912895 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:50.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.922+0000 7efc46200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc401083d0 0x7efc401a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:50.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.923+0000 7efc46200700 1 -- 172.21.15.70:0/913912895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc4006b6f0 msgr2=0x7efc401a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:50.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.923+0000 7efc46200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc4006b6f0 0x7efc401a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:50.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.923+0000 7efc46200700 1 -- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc40105ee0 msgr2=0x7efc401a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:50.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.923+0000 7efc46200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc40105ee0 0x7efc401a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:50.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.923+0000 7efc46200700 1 -- 172.21.15.70:0/913912895 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc401a51c0 con 0x7efc401083d0 2024-05-08T08:14:50.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.923+0000 7efc44e00700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc40105ee0 0x7efc401a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:14:50.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.923+0000 7efc46200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc401083d0 0x7efc401a4a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc3800efb0 tx=0x7efc3800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:50.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.924+0000 7efc3e000700 1 -- 172.21.15.70:0/913912895 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38003a00 con 0x7efc401083d0 2024-05-08T08:14:50.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.924+0000 7efc3e000700 1 -- 172.21.15.70:0/913912895 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc3800ce30 con 0x7efc401083d0 2024-05-08T08:14:50.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.924+0000 7efc3e000700 1 -- 172.21.15.70:0/913912895 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38004720 con 0x7efc401083d0 2024-05-08T08:14:50.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.924+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc401a54b0 con 0x7efc401083d0 2024-05-08T08:14:50.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.924+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc401acd30 con 0x7efc401083d0 2024-05-08T08:14:50.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.926+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc4006a190 con 0x7efc401083d0 2024-05-08T08:14:50.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.931+0000 7efc3e000700 1 -- 172.21.15.70:0/913912895 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7efc38012050 con 0x7efc401083d0 2024-05-08T08:14:50.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.933+0000 7efc3e000700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc280b2af0 0x7efc280b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:50.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.933+0000 7efc3e000700 1 -- 172.21.15.70:0/913912895 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(253..253 src has 1..253) ==== 9583+0+0 (secure 0 0 0) 0x7efc380e2470 con 0x7efc401083d0 2024-05-08T08:14:50.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.934+0000 7efc45800700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc280b2af0 0x7efc280b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.936+0000 7efc45800700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc280b2af0 0x7efc280b4fb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efc34009750 tx=0x7efc34005960 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:50.944+0000 7efc3e000700 1 -- 172.21.15.70:0/913912895 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efc38022060 con 0x7efc401083d0 2024-05-08T08:14:51.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.389+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc401a1510 con 0x7efc401083d0 2024-05-08T08:14:51.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.391+0000 7efc3e000700 1 -- 172.21.15.70:0/913912895 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7efc38010040 con 0x7efc401083d0 2024-05-08T08:14:51.385 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:14:51.385 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:14:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc280b2af0 msgr2=0x7efc280b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc280b2af0 0x7efc280b4fb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7efc34009750 tx=0x7efc34005960 comp rx=0 tx=0).stop 2024-05-08T08:14:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc401083d0 msgr2=0x7efc401a4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc401083d0 0x7efc401a4a80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efc3800efb0 tx=0x7efc3800c3a0 comp rx=0 tx=0).stop 2024-05-08T08:14:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 shutdown_connections 2024-05-08T08:14:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc280b2af0 0x7efc280b4fb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:51.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc401083d0 0x7efc401a4a80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:51.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc4006b6f0 0x7efc401a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:51.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 --2- 172.21.15.70:0/913912895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc40105ee0 0x7efc401a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:51.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 >> 172.21.15.70:0/913912895 conn(0x7efc40079350 msgr2=0x7efc40101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:51.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 shutdown_connections 2024-05-08T08:14:51.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:51.395+0000 7efc48200700 1 -- 172.21.15.70:0/913912895 wait complete. 2024-05-08T08:14:51.390 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:14:51.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:51 smithi070 ceph-mon[29591]: pgmap v2811: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 172 KiB/s wr, 17 op/s 2024-05-08T08:14:51.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:51 smithi194 ceph-mon[33679]: pgmap v2811: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 172 KiB/s wr, 17 op/s 2024-05-08T08:14:51.540 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/bsearch.o 2024-05-08T08:14:51.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:51 smithi172 ceph-mon[33377]: pgmap v2811: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 172 KiB/s wr, 17 op/s 2024-05-08T08:14:52.225 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T08:14:52.226 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T08:14:52.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:52 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/913912895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:14:52.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:52 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/913912895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:14:52.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:52 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/913912895' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:14:52.808 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:14:53.334 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:53 smithi070 ceph-mon[29591]: pgmap v2812: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 172 KiB/s wr, 15 op/s 2024-05-08T08:14:53.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:53 smithi194 ceph-mon[33679]: pgmap v2812: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 172 KiB/s wr, 15 op/s 2024-05-08T08:14:53.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:53 smithi172 ceph-mon[33377]: pgmap v2812: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 172 KiB/s wr, 15 op/s 2024-05-08T08:14:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.174+0000 7fa062c00700 1 -- 172.21.15.70:0/2881817223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05c108860 msgr2=0x7fa05c1103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.174+0000 7fa062c00700 1 --2- 172.21.15.70:0/2881817223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05c108860 0x7fa05c1103e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fa05400b0a0 tx=0x7fa05400b3b0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.175+0000 7fa062c00700 1 -- 172.21.15.70:0/2881817223 shutdown_connections 2024-05-08T08:14:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.175+0000 7fa062c00700 1 --2- 172.21.15.70:0/2881817223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05c108860 0x7fa05c1103e0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.175+0000 7fa062c00700 1 --2- 172.21.15.70:0/2881817223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa05c06b3e0 0x7fa05c06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.175+0000 7fa062c00700 1 --2- 172.21.15.70:0/2881817223 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa05c06bd90 0x7fa05c108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.175+0000 7fa062c00700 1 -- 172.21.15.70:0/2881817223 >> 172.21.15.70:0/2881817223 conn(0x7fa05c079340 msgr2=0x7fa05c079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.175+0000 7fa062c00700 1 -- 172.21.15.70:0/2881817223 shutdown_connections 2024-05-08T08:14:55.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.175+0000 7fa062c00700 1 -- 172.21.15.70:0/2881817223 wait complete. 2024-05-08T08:14:55.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.177+0000 7fa062c00700 1 Processor -- start 2024-05-08T08:14:55.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.177+0000 7fa062c00700 1 -- start start 2024-05-08T08:14:55.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa062c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa05c06b3e0 0x7fa05c1a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa062c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05c06bd90 0x7fa05c1a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa062c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa05c108860 0x7fa05c19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa062c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c115770 con 0x7fa05c06bd90 2024-05-08T08:14:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa062c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1155f0 con 0x7fa05c108860 2024-05-08T08:14:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa062c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa05c1158f0 con 0x7fa05c06b3e0 2024-05-08T08:14:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa060c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa05c108860 0x7fa05c19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa05be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa05c06b3e0 0x7fa05c1a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa05be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa05c06b3e0 0x7fa05c1a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:34216/0 (socket says 172.21.15.70:34216) 2024-05-08T08:14:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.178+0000 7fa05be00700 1 -- 172.21.15.70:0/54320498 learned_addr learned my addr 172.21.15.70:0/54320498 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.179+0000 7fa05b400700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05c06bd90 0x7fa05c1a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.179+0000 7fa060c00700 1 -- 172.21.15.70:0/54320498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa05c06b3e0 msgr2=0x7fa05c1a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.179+0000 7fa060c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa05c06b3e0 0x7fa05c1a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.179+0000 7fa060c00700 1 -- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05c06bd90 msgr2=0x7fa05c1a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:55.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.179+0000 7fa060c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05c06bd90 0x7fa05c1a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.179+0000 7fa060c00700 1 -- 172.21.15.70:0/54320498 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05c19c0f0 con 0x7fa05c108860 2024-05-08T08:14:55.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.180+0000 7fa060c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa05c108860 0x7fa05c19b990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa05400b0a0 tx=0x7fa054004d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:55.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.187+0000 7fa058c00700 1 -- 172.21.15.70:0/54320498 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054021070 con 0x7fa05c108860 2024-05-08T08:14:55.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.187+0000 7fa062c00700 1 -- 172.21.15.70:0/54320498 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05c19c380 con 0x7fa05c108860 2024-05-08T08:14:55.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.188+0000 7fa062c00700 1 -- 172.21.15.70:0/54320498 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05c1a86a0 con 0x7fa05c108860 2024-05-08T08:14:55.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.188+0000 7fa058c00700 1 -- 172.21.15.70:0/54320498 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0540074e0 con 0x7fa05c108860 2024-05-08T08:14:55.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.188+0000 7fa058c00700 1 -- 172.21.15.70:0/54320498 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05401db20 con 0x7fa05c108860 2024-05-08T08:14:55.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.194+0000 7fa058c00700 1 -- 172.21.15.70:0/54320498 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa054024070 con 0x7fa05c108860 2024-05-08T08:14:55.188 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:55 smithi070 ceph-mon[29591]: pgmap v2813: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 432 KiB/s wr, 24 op/s 2024-05-08T08:14:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.196+0000 7fa06d66bb80 1 Processor -- start 2024-05-08T08:14:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.196+0000 7fa06d66bb80 1 -- start start 2024-05-08T08:14:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.197+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d4585620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.197+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 0x55b6d457fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.197+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d45801d0 0x55b6d458c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.197+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b6d44d1bb0 con 0x55b6d4585240 2024-05-08T08:14:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.197+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b6d446f8f0 con 0x55b6d457f810 2024-05-08T08:14:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.197+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b6d44cdb70 con 0x55b6d45801d0 2024-05-08T08:14:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.198+0000 7fa05be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 0x55b6d457fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.199+0000 7fa05be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 0x55b6d457fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:56920/0 (socket says 172.21.15.70:56920) 2024-05-08T08:14:55.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.199+0000 7fa05be00700 1 -- 172.21.15.70:0/1384621297 learned_addr learned my addr 172.21.15.70:0/1384621297 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.200+0000 7fa05be00700 1 -- 172.21.15.70:0/1384621297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d45801d0 msgr2=0x55b6d458c000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T08:14:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.200+0000 7fa05be00700 1 --2- 172.21.15.70:0/1384621297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d45801d0 0x55b6d458c000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.200+0000 7fa05be00700 1 -- 172.21.15.70:0/1384621297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 msgr2=0x55b6d4585620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T08:14:55.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.201+0000 7fa058c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0400b2b70 0x7fa0400b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.201+0000 7fa058c00700 1 -- 172.21.15.70:0/54320498 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(253..253 src has 1..253) ==== 9583+0+0 (secure 0 0 0) 0x7fa05400f020 con 0x7fa05c108860 2024-05-08T08:14:55.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.202+0000 7fa05b400700 1 --2- 172.21.15.70:0/1384621297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d4585620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.202+0000 7fa05be00700 1 --2- 172.21.15.70:0/1384621297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d4585620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.203+0000 7fa05be00700 1 -- 172.21.15.70:0/1384621297 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d441ea60 con 0x55b6d457f810 2024-05-08T08:14:55.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.203+0000 7fa05b400700 1 --2- 172.21.15.70:0/1384621297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d4585620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:14:55.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.203+0000 7fa05be00700 1 --2- 172.21.15.70:0/1384621297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 0x55b6d457fc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00be60 tx=0x7fa04c0106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f3db24c5a147a60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:55.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.203+0000 7fa05b400700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0400b2b70 0x7fa0400b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.204+0000 7fa051600700 1 -- 172.21.15.70:0/1384621297 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c011440 con 0x55b6d457f810 2024-05-08T08:14:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.204+0000 7fa051600700 1 -- 172.21.15.70:0/1384621297 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa04c011a70 con 0x55b6d457f810 2024-05-08T08:14:55.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.204+0000 7fa051600700 1 -- 172.21.15.70:0/1384621297 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c019990 con 0x55b6d457f810 2024-05-08T08:14:55.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1384621297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 msgr2=0x55b6d457fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:55.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa05b400700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0400b2b70 0x7fa0400b5030 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa04800b6c0 tx=0x7fa048004750 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:55.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1384621297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 0x55b6d457fc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00be60 tx=0x7fa04c0106b0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1384621297 shutdown_connections 2024-05-08T08:14:55.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1384621297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d45801d0 0x55b6d458c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1384621297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d4585620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1384621297 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 0x55b6d457fc90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1384621297 >> 172.21.15.70:0/1384621297 conn(0x55b6d44f7860 msgr2=0x55b6d457a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:55.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1384621297 shutdown_connections 2024-05-08T08:14:55.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.206+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1384621297 wait complete. 2024-05-08T08:14:55.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.207+0000 7fa06d66bb80 1 -- start start 2024-05-08T08:14:55.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.207+0000 7fa06d66bb80 1 Processor -- start 2024-05-08T08:14:55.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.208+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 0x55b6d458bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.208+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d45801d0 0x55b6d4588fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.208+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4585240 0x55b6d4589520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.208+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b6d458c5a0 con 0x55b6d45801d0 2024-05-08T08:14:55.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.208+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b6d4437cb0 con 0x55b6d457f810 2024-05-08T08:14:55.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.208+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b6d458c720 con 0x55b6d4585240 2024-05-08T08:14:55.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.208+0000 7fa06d66bb80 10 client.0 _ll_register_callbacks cb 0x55b6d4478e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:14:55.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.208+0000 7fa05b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d45801d0 0x55b6d4588fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.209+0000 7fa05b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d45801d0 0x55b6d4588fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43350/0 (socket says 172.21.15.70:43350) 2024-05-08T08:14:55.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.209+0000 7fa05b400700 1 -- 172.21.15.70:0/1035483270 learned_addr learned my addr 172.21.15.70:0/1035483270 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:55.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.209+0000 7fa060c00700 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4585240 0x55b6d4589520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.209+0000 7fa05b400700 1 -- 172.21.15.70:0/1035483270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4585240 msgr2=0x55b6d4589520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:55.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.209+0000 7fa05b400700 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4585240 0x55b6d4589520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.209+0000 7fa05b400700 1 -- 172.21.15.70:0/1035483270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 msgr2=0x55b6d458bc40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T08:14:55.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.209+0000 7fa05b400700 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 0x55b6d458bc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.209+0000 7fa05b400700 1 -- 172.21.15.70:0/1035483270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d44975b0 con 0x55b6d45801d0 2024-05-08T08:14:55.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.210+0000 7fa05b400700 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d45801d0 0x55b6d4588fe0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa04801c8b0 tx=0x7fa0480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffabd13453bc2f11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:55.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.210+0000 7fa046000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:14:55.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.210+0000 7fa046000700 1 -- 172.21.15.70:0/1035483270 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048004830 con 0x55b6d45801d0 2024-05-08T08:14:55.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.211+0000 7fa046000700 1 -- 172.21.15.70:0/1035483270 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(253..253 src has 1..253) ==== 9583+0+0 (secure 0 0 0) 0x7fa0480049d0 con 0x55b6d45801d0 2024-05-08T08:14:55.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.211+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1035483270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa04c011a70 con 0x55b6d45801d0 2024-05-08T08:14:55.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.211+0000 7fa046000700 1 -- 172.21.15.70:0/1035483270 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa04802f050 con 0x55b6d45801d0 2024-05-08T08:14:55.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.211+0000 7fa06d66bb80 10 client.17820 fetch_fsmap learned FSMap version 42 2024-05-08T08:14:55.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.211+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1035483270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b6d459f650 con 0x55b6d45801d0 2024-05-08T08:14:55.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.212+0000 7fa046000700 1 -- 172.21.15.70:0/1035483270 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0480054b0 con 0x55b6d45801d0 2024-05-08T08:14:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.212+0000 7fa046000700 1 -- 172.21.15.70:0/1035483270 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa048018040 con 0x55b6d45801d0 2024-05-08T08:14:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.212+0000 7fa06d66bb80 10 client.17820 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:14:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.212+0000 7fa06d66bb80 10 client.17820 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:14:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.212+0000 7fa06d66bb80 20 client.17820 populate_metadata read hostname 'smithi070' 2024-05-08T08:14:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.212+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b6d45a1d30 0x55b6d45a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.212+0000 7fa06d66bb80 4 client.17820 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:14:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.212+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1035483270 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa04c011a70 con 0x55b6d45a1d30 2024-05-08T08:14:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.213+0000 7fa05be00700 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b6d45a1d30 0x55b6d45a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.214+0000 7fa046000700 10 client.17820 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:14:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.214+0000 7fa05be00700 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b6d45a1d30 0x55b6d45a41b0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45b714b85687734b server_cookie=fc68806e6ff1807c in_seq=0 out_seq=0 2024-05-08T08:14:55.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.216+0000 7fa046000700 1 -- 172.21.15.70:0/1035483270 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fa04c011a70 con 0x55b6d45a1d30 2024-05-08T08:14:55.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.216+0000 7fa046000700 10 client.17820 handle_command_reply: tid=0 2024-05-08T08:14:55.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.217+0000 7fa06d66bb80 1 client.17820 shutdown 2024-05-08T08:14:55.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.217+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1035483270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d45801d0 msgr2=0x55b6d4588fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:55.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.217+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d45801d0 0x55b6d4588fe0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fa04801c8b0 tx=0x7fa0480047c0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.217+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1035483270 shutdown_connections 2024-05-08T08:14:55.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.218+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b6d45a1d30 0x55b6d45a41b0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.218+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4585240 0x55b6d4589520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.218+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d457f810 0x55b6d458bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.218+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1035483270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d45801d0 0x55b6d4588fe0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.218+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1035483270 >> 172.21.15.70:0/1035483270 conn(0x55b6d44f7860 msgr2=0x55b6d4574bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:55.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.218+0000 7fa046000700 0 client.17820 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:14:55.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.218+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1035483270 shutdown_connections 2024-05-08T08:14:55.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.218+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1035483270 wait complete. 2024-05-08T08:14:55.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.219+0000 7fa06d66bb80 20 client.17820 trim_cache size 0 max 16384 2024-05-08T08:14:55.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.254+0000 7fa06d66bb80 1 Processor -- start 2024-05-08T08:14:55.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.254+0000 7fa06d66bb80 1 -- start start 2024-05-08T08:14:55.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.254+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d457f810 0x55b6d459df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4585240 0x55b6d457ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4589610 0x55b6d45a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c011850 con 0x55b6d457f810 2024-05-08T08:14:55.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c00f0e0 con 0x55b6d4585240 2024-05-08T08:14:55.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c00cf50 con 0x55b6d4589610 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa05be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d457f810 0x55b6d459df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa05be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d457f810 0x55b6d459df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43358/0 (socket says 172.21.15.70:43358) 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa060c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4589610 0x55b6d45a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa05be00700 1 -- 172.21.15.70:0/2316887577 learned_addr learned my addr 172.21.15.70:0/2316887577 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.255+0000 7fa05b400700 1 --2- 172.21.15.70:0/2316887577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4585240 0x55b6d457ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.256+0000 7fa060c00700 1 -- 172.21.15.70:0/2316887577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4585240 msgr2=0x55b6d457ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.256+0000 7fa060c00700 1 --2- 172.21.15.70:0/2316887577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4585240 0x55b6d457ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.256+0000 7fa060c00700 1 -- 172.21.15.70:0/2316887577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d457f810 msgr2=0x55b6d459df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.256+0000 7fa060c00700 1 --2- 172.21.15.70:0/2316887577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d457f810 0x55b6d459df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.256+0000 7fa060c00700 1 -- 172.21.15.70:0/2316887577 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d4576d00 con 0x55b6d4589610 2024-05-08T08:14:55.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.256+0000 7fa05be00700 1 --2- 172.21.15.70:0/2316887577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d457f810 0x55b6d459df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:14:55.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.257+0000 7fa060c00700 1 --2- 172.21.15.70:0/2316887577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4589610 0x55b6d45a9ac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa0540e0f70 tx=0x7fa0540aaa80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=278e90f66364b6a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:55.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.257+0000 7fa050c00700 1 -- 172.21.15.70:0/2316887577 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0540c4070 con 0x55b6d4589610 2024-05-08T08:14:55.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.257+0000 7fa050c00700 1 -- 172.21.15.70:0/2316887577 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0540b32a0 con 0x55b6d4589610 2024-05-08T08:14:55.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.257+0000 7fa050c00700 1 -- 172.21.15.70:0/2316887577 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0540aef40 con 0x55b6d4589610 2024-05-08T08:14:55.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.258+0000 7fa06d66bb80 1 -- 172.21.15.70:0/2316887577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4589610 msgr2=0x55b6d45a9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:14:55.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.258+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/2316887577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4589610 0x55b6d45a9ac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa0540e0f70 tx=0x7fa0540aaa80 comp rx=0 tx=0).stop 2024-05-08T08:14:55.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.258+0000 7fa06d66bb80 1 -- 172.21.15.70:0/2316887577 shutdown_connections 2024-05-08T08:14:55.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.258+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/2316887577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d4589610 0x55b6d45a9ac0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.258+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/2316887577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d457f810 0x55b6d459df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.258+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/2316887577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4585240 0x55b6d457ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.258+0000 7fa06d66bb80 1 -- 172.21.15.70:0/2316887577 >> 172.21.15.70:0/2316887577 conn(0x55b6d44f7860 msgr2=0x55b6d457e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:14:55.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.259+0000 7fa06d66bb80 1 -- 172.21.15.70:0/2316887577 shutdown_connections 2024-05-08T08:14:55.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.259+0000 7fa06d66bb80 1 -- 172.21.15.70:0/2316887577 wait complete. 2024-05-08T08:14:55.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.259+0000 7fa06d66bb80 1 -- start start 2024-05-08T08:14:55.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.260+0000 7fa06d66bb80 1 Processor -- start 2024-05-08T08:14:55.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.260+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d457f810 0x55b6d4595260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.260+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d45957a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.260+0000 7fa06d66bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4589610 0x55b6d4595ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.260+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c00d5a0 con 0x55b6d4585240 2024-05-08T08:14:55.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.260+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c00ea10 con 0x55b6d4589610 2024-05-08T08:14:55.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.260+0000 7fa06d66bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa03c00dc70 con 0x55b6d457f810 2024-05-08T08:14:55.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.260+0000 7fa06d66bb80 10 client.0 _ll_register_callbacks cb 0x55b6d4478e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:14:55.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.261+0000 7fa05b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d45957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.261+0000 7fa05b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d45957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43366/0 (socket says 172.21.15.70:43366) 2024-05-08T08:14:55.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.261+0000 7fa05b400700 1 -- 172.21.15.70:0/1186917730 learned_addr learned my addr 172.21.15.70:0/1186917730 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:14:55.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.261+0000 7fa060c00700 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4589610 0x55b6d4595ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.262+0000 7fa05be00700 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d457f810 0x55b6d4595260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.262+0000 7fa05b400700 1 -- 172.21.15.70:0/1186917730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d457f810 msgr2=0x55b6d4595260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.262+0000 7fa05b400700 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d457f810 0x55b6d4595260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.262+0000 7fa05b400700 1 -- 172.21.15.70:0/1186917730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4589610 msgr2=0x55b6d4595ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:14:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.262+0000 7fa05b400700 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4589610 0x55b6d4595ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:14:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.262+0000 7fa05b400700 1 -- 172.21.15.70:0/1186917730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6d460c7a0 con 0x55b6d4585240 2024-05-08T08:14:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.263+0000 7fa05b400700 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d45957a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fa04801abc0 tx=0x7fa04801a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85be201e7367390c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:14:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.263+0000 7fa046000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:14:55.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.263+0000 7fa046000700 1 -- 172.21.15.70:0/1186917730 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa048004830 con 0x55b6d4585240 2024-05-08T08:14:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.263+0000 7fa046000700 1 -- 172.21.15.70:0/1186917730 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(253..253 src has 1..253) ==== 9583+0+0 (secure 0 0 0) 0x7fa0480049d0 con 0x55b6d4585240 2024-05-08T08:14:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.263+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1186917730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6d454c2d0 con 0x55b6d4585240 2024-05-08T08:14:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.264+0000 7fa046000700 1 -- 172.21.15.70:0/1186917730 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa048004bd0 con 0x55b6d4585240 2024-05-08T08:14:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.264+0000 7fa06d66bb80 10 client.17826 fetch_fsmap learned FSMap version 42 2024-05-08T08:14:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.264+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1186917730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b6d460da80 con 0x55b6d4585240 2024-05-08T08:14:55.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.264+0000 7fa046000700 1 -- 172.21.15.70:0/1186917730 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55b6d454c2d0 con 0x55b6d4585240 2024-05-08T08:14:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.265+0000 7fa046000700 1 -- 172.21.15.70:0/1186917730 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa048018040 con 0x55b6d4585240 2024-05-08T08:14:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.265+0000 7fa06d66bb80 10 client.17826 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:14:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.265+0000 7fa06d66bb80 10 client.17826 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:14:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.265+0000 7fa06d66bb80 20 client.17826 populate_metadata read hostname 'smithi070' 2024-05-08T08:14:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.265+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b6d460e1b0 0x55b6d46105d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:14:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.265+0000 7fa06d66bb80 4 client.17826 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T08:14:55.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.265+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1186917730 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55b6d44df590 con 0x55b6d460e1b0 2024-05-08T08:14:55.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.266+0000 7fa05be00700 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b6d460e1b0 0x55b6d46105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:14:55.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.267+0000 7fa05be00700 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b6d460e1b0 0x55b6d46105d0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e5d96448b1360 server_cookie=7c8764e8c7c82e55 in_seq=0 out_seq=0 2024-05-08T08:14:55.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:14:55.267+0000 7fa046000700 10 client.17826 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:14:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:55 smithi194 ceph-mon[33679]: pgmap v2813: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 432 KiB/s wr, 24 op/s 2024-05-08T08:14:55.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:55 smithi172 ceph-mon[33377]: pgmap v2813: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 432 KiB/s wr, 24 op/s 2024-05-08T08:14:57.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:57 smithi194 ceph-mon[33679]: pgmap v2814: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 431 KiB/s wr, 22 op/s 2024-05-08T08:14:57.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:57 smithi070 ceph-mon[29591]: pgmap v2814: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 431 KiB/s wr, 22 op/s 2024-05-08T08:14:57.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:57 smithi172 ceph-mon[33377]: pgmap v2814: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 431 KiB/s wr, 22 op/s 2024-05-08T08:14:59.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:14:59 smithi194 ceph-mon[33679]: pgmap v2815: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 432 KiB/s wr, 22 op/s 2024-05-08T08:14:59.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:14:59 smithi070 ceph-mon[29591]: pgmap v2815: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 432 KiB/s wr, 22 op/s 2024-05-08T08:14:59.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:14:59 smithi172 ceph-mon[33377]: pgmap v2815: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 432 KiB/s wr, 22 op/s 2024-05-08T08:15:01.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:01 smithi194 ceph-mon[33679]: pgmap v2816: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 463 KiB/s wr, 25 op/s 2024-05-08T08:15:01.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:01 smithi070 ceph-mon[29591]: pgmap v2816: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 463 KiB/s wr, 25 op/s 2024-05-08T08:15:01.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:01 smithi172 ceph-mon[33377]: pgmap v2816: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 463 KiB/s wr, 25 op/s 2024-05-08T08:15:03.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:03 smithi194 ceph-mon[33679]: pgmap v2817: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 302 KiB/s wr, 14 op/s 2024-05-08T08:15:03.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:03 smithi070 ceph-mon[29591]: pgmap v2817: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 302 KiB/s wr, 14 op/s 2024-05-08T08:15:03.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:03 smithi172 ceph-mon[33377]: pgmap v2817: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 302 KiB/s wr, 14 op/s 2024-05-08T08:15:05.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:05 smithi194 ceph-mon[33679]: pgmap v2818: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 328 KiB/s wr, 19 op/s 2024-05-08T08:15:05.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:05 smithi070 ceph-mon[29591]: pgmap v2818: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 328 KiB/s wr, 19 op/s 2024-05-08T08:15:05.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:05 smithi172 ceph-mon[33377]: pgmap v2818: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 328 KiB/s wr, 19 op/s 2024-05-08T08:15:07.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:07 smithi172 ceph-mon[33377]: pgmap v2819: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 68 KiB/s wr, 9 op/s 2024-05-08T08:15:07.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:07 smithi194 ceph-mon[33679]: pgmap v2819: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 68 KiB/s wr, 9 op/s 2024-05-08T08:15:07.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:07 smithi070 ceph-mon[29591]: pgmap v2819: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 68 KiB/s wr, 9 op/s 2024-05-08T08:15:09.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:09 smithi194 ceph-mon[33679]: pgmap v2820: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 68 KiB/s wr, 9 op/s 2024-05-08T08:15:09.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:09 smithi070 ceph-mon[29591]: pgmap v2820: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 68 KiB/s wr, 9 op/s 2024-05-08T08:15:09.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:09 smithi172 ceph-mon[33377]: pgmap v2820: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 68 KiB/s wr, 9 op/s 2024-05-08T08:15:11.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:11 smithi194 ceph-mon[33679]: pgmap v2821: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 109 KiB/s wr, 13 op/s 2024-05-08T08:15:11.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:11 smithi070 ceph-mon[29591]: pgmap v2821: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 109 KiB/s wr, 13 op/s 2024-05-08T08:15:11.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:11 smithi172 ceph-mon[33377]: pgmap v2821: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 109 KiB/s wr, 13 op/s 2024-05-08T08:15:13.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:13 smithi194 ceph-mon[33679]: pgmap v2822: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 8 op/s 2024-05-08T08:15:13.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:13 smithi070 ceph-mon[29591]: pgmap v2822: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 8 op/s 2024-05-08T08:15:13.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:13 smithi172 ceph-mon[33377]: pgmap v2822: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 68 KiB/s wr, 8 op/s 2024-05-08T08:15:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:15 smithi194 ceph-mon[33679]: pgmap v2823: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 142 KiB/s wr, 37 op/s 2024-05-08T08:15:15.547 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:15 smithi070 ceph-mon[29591]: pgmap v2823: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 142 KiB/s wr, 37 op/s 2024-05-08T08:15:15.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.553+0000 7fa046000700 1 -- 172.21.15.70:0/1186917730 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55b6d44df590 con 0x55b6d460e1b0 2024-05-08T08:15:15.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.553+0000 7fa046000700 10 client.17826 handle_command_reply: tid=0 2024-05-08T08:15:15.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.553+0000 7fa06d66bb80 1 client.17826 shutdown 2024-05-08T08:15:15.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.554+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1186917730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 msgr2=0x55b6d45957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:15.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.554+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d45957a0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fa04801abc0 tx=0x7fa04801a710 comp rx=0 tx=0).stop 2024-05-08T08:15:15.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.554+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1186917730 shutdown_connections 2024-05-08T08:15:15.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.554+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b6d460e1b0 0x55b6d46105d0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:15.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.554+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b6d4589610 0x55b6d4595ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:15.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.554+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b6d457f810 0x55b6d4595260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:15.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.554+0000 7fa06d66bb80 1 --2- 172.21.15.70:0/1186917730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b6d4585240 0x55b6d45957a0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:15.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.554+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1186917730 >> 172.21.15.70:0/1186917730 conn(0x55b6d44f7860 msgr2=0x55b6d457f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:15.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.554+0000 7fa046000700 0 client.17826 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.555+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1186917730 shutdown_connections 2024-05-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.555+0000 7fa06d66bb80 1 -- 172.21.15.70:0/1186917730 wait complete. 2024-05-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.555+0000 7fa06d66bb80 20 client.17826 trim_cache size 0 max 16384 2024-05-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 206, 2024-05-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:15:15.550 INFO:teuthology.orchestra.run.smithi070.stdout: "f3ab6051": { 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 206, 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:15:15.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:15.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:15.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:15.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:15.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:15.552 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:15:15.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 -- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0400b2b70 msgr2=0x7fa0400b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0400b2b70 0x7fa0400b5030 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa04800b6c0 tx=0x7fa048004750 comp rx=0 tx=0).stop 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 -- 172.21.15.70:0/54320498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa05c108860 msgr2=0x7fa05c19b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa05c108860 0x7fa05c19b990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa05400b0a0 tx=0x7fa054004d50 comp rx=0 tx=0).stop 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 -- 172.21.15.70:0/54320498 shutdown_connections 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa0400b2b70 0x7fa0400b5030 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa05c108860 0x7fa05c19b990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa05c06b3e0 0x7fa05c1a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 --2- 172.21.15.70:0/54320498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa05c06bd90 0x7fa05c1a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.557+0000 7fa062c00700 1 -- 172.21.15.70:0/54320498 >> 172.21.15.70:0/54320498 conn(0x7fa05c079340 msgr2=0x7fa05c107360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.558+0000 7fa062c00700 1 -- 172.21.15.70:0/54320498 shutdown_connections 2024-05-08T08:15:15.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:15.558+0000 7fa062c00700 1 -- 172.21.15.70:0/54320498 wait complete. 2024-05-08T08:15:15.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:15 smithi172 ceph-mon[33377]: pgmap v2823: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 142 KiB/s wr, 37 op/s 2024-05-08T08:15:17.387 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f3ab6051', quiesce took 29.6 seconds. Will release after: 30.0 2024-05-08T08:15:17.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:17 smithi194 ceph-mon[33679]: pgmap v2824: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 117 KiB/s wr, 32 op/s 2024-05-08T08:15:17.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:17 smithi070 ceph-mon[29591]: pgmap v2824: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 117 KiB/s wr, 32 op/s 2024-05-08T08:15:17.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:17 smithi172 ceph-mon[33377]: pgmap v2824: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 117 KiB/s wr, 32 op/s 2024-05-08T08:15:19.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:19 smithi194 ceph-mon[33679]: pgmap v2825: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 128 KiB/s wr, 33 op/s 2024-05-08T08:15:19.611 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:19 smithi070 ceph-mon[29591]: pgmap v2825: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 128 KiB/s wr, 33 op/s 2024-05-08T08:15:19.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:19 smithi172 ceph-mon[33377]: pgmap v2825: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 128 KiB/s wr, 33 op/s 2024-05-08T08:15:21.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:21 smithi194 ceph-mon[33679]: pgmap v2826: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 197 KiB/s wr, 39 op/s 2024-05-08T08:15:21.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:21 smithi070 ceph-mon[29591]: pgmap v2826: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 197 KiB/s wr, 39 op/s 2024-05-08T08:15:21.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:21 smithi172 ceph-mon[33377]: pgmap v2826: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 197 KiB/s wr, 39 op/s 2024-05-08T08:15:24.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:23 smithi070 ceph-mon[29591]: osdmap e254: 12 total, 12 up, 12 in 2024-05-08T08:15:24.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:23 smithi070 ceph-mon[29591]: pgmap v2828: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 186 KiB/s wr, 42 op/s 2024-05-08T08:15:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:23 smithi172 ceph-mon[33377]: osdmap e254: 12 total, 12 up, 12 in 2024-05-08T08:15:24.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:23 smithi172 ceph-mon[33377]: pgmap v2828: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 186 KiB/s wr, 42 op/s 2024-05-08T08:15:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:23 smithi194 ceph-mon[33679]: osdmap e254: 12 total, 12 up, 12 in 2024-05-08T08:15:24.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:23 smithi194 ceph-mon[33679]: pgmap v2828: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 186 KiB/s wr, 42 op/s 2024-05-08T08:15:25.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:25 smithi194 ceph-mon[33679]: pgmap v2829: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 125 KiB/s wr, 12 op/s 2024-05-08T08:15:25.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:25 smithi070 ceph-mon[29591]: pgmap v2829: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 125 KiB/s wr, 12 op/s 2024-05-08T08:15:25.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:25 smithi172 ceph-mon[33377]: pgmap v2829: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 125 KiB/s wr, 12 op/s 2024-05-08T08:15:28.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:28 smithi194 ceph-mon[33679]: pgmap v2830: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 125 KiB/s wr, 12 op/s 2024-05-08T08:15:28.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:28 smithi070 ceph-mon[29591]: pgmap v2830: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 125 KiB/s wr, 12 op/s 2024-05-08T08:15:28.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:28 smithi172 ceph-mon[33377]: pgmap v2830: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 125 KiB/s wr, 12 op/s 2024-05-08T08:15:30.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:30 smithi070 ceph-mon[29591]: osdmap e255: 12 total, 12 up, 12 in 2024-05-08T08:15:30.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:30 smithi172 ceph-mon[33377]: osdmap e255: 12 total, 12 up, 12 in 2024-05-08T08:15:30.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:30 smithi194 ceph-mon[33679]: osdmap e255: 12 total, 12 up, 12 in 2024-05-08T08:15:31.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:31 smithi070 ceph-mon[29591]: pgmap v2832: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2024-05-08T08:15:31.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:31 smithi172 ceph-mon[33377]: pgmap v2832: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2024-05-08T08:15:31.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:31 smithi194 ceph-mon[33679]: pgmap v2832: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 6 op/s 2024-05-08T08:15:33.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:33 smithi070 ceph-mon[29591]: pgmap v2833: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-08T08:15:33.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:33 smithi172 ceph-mon[33377]: pgmap v2833: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-08T08:15:33.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:33 smithi194 ceph-mon[33679]: pgmap v2833: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-08T08:15:35.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:35 smithi070 ceph-mon[29591]: pgmap v2834: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2024-05-08T08:15:35.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:35 smithi172 ceph-mon[33377]: pgmap v2834: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2024-05-08T08:15:35.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:35 smithi194 ceph-mon[33679]: pgmap v2834: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 8 op/s 2024-05-08T08:15:37.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:37 smithi070 ceph-mon[29591]: pgmap v2835: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:15:37.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:37 smithi172 ceph-mon[33377]: pgmap v2835: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:15:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:37 smithi194 ceph-mon[33679]: pgmap v2835: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:15:39.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:39 smithi070 ceph-mon[29591]: pgmap v2836: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:15:39.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:39 smithi172 ceph-mon[33377]: pgmap v2836: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:15:39.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:39 smithi194 ceph-mon[33679]: pgmap v2836: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:15:41.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:41 smithi070 ceph-mon[29591]: pgmap v2837: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2024-05-08T08:15:41.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:41 smithi172 ceph-mon[33377]: pgmap v2837: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2024-05-08T08:15:41.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:41 smithi194 ceph-mon[33679]: pgmap v2837: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 101 B/s wr, 6 op/s 2024-05-08T08:15:43.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:43 smithi172 ceph-mon[33377]: pgmap v2838: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T08:15:43.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:43 smithi194 ceph-mon[33679]: pgmap v2838: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T08:15:43.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:43 smithi070 ceph-mon[29591]: pgmap v2838: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T08:15:45.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:45 smithi172 ceph-mon[33377]: pgmap v2839: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:45.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:45 smithi194 ceph-mon[33679]: pgmap v2839: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:45.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:45 smithi070 ceph-mon[29591]: pgmap v2839: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:47.389 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:15:47.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:47 smithi172 ceph-mon[33377]: pgmap v2840: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:15:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:15:47.425 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:47 smithi070 ceph-mon[29591]: pgmap v2840: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:15:47.425 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:15:47.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:47 smithi194 ceph-mon[33679]: pgmap v2840: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:15:47.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:15:47.847 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:15:48.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:48 smithi070 ceph-mon[29591]: pgmap v2841: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:48.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:15:48.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:15:48.165 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:15:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:48 smithi172 ceph-mon[33377]: pgmap v2841: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:15:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:15:48.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:15:48.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:48 smithi194 ceph-mon[33679]: pgmap v2841: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:48.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:15:48.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:15:48.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:15:50.291 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:50 smithi070 ceph-mon[29591]: pgmap v2842: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:50.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:50 smithi172 ceph-mon[33377]: pgmap v2842: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:50.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:50 smithi194 ceph-mon[33679]: pgmap v2842: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:50.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.659+0000 7f33d8600700 1 -- 172.21.15.70:0/2270066497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d010fea0 msgr2=0x7f33d0112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:50.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.659+0000 7f33d8600700 1 --2- 172.21.15.70:0/2270066497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d010fea0 0x7f33d0112290 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f33c800b0a0 tx=0x7f33c800b3b0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.659+0000 7f33d8600700 1 -- 172.21.15.70:0/2270066497 shutdown_connections 2024-05-08T08:15:50.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.659+0000 7f33d8600700 1 --2- 172.21.15.70:0/2270066497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d010fea0 0x7f33d0112290 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.659+0000 7f33d8600700 1 --2- 172.21.15.70:0/2270066497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33d00756d0 0x7f33d0075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.659+0000 7f33d8600700 1 --2- 172.21.15.70:0/2270066497 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33d0075ff0 0x7f33d010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.659+0000 7f33d8600700 1 -- 172.21.15.70:0/2270066497 >> 172.21.15.70:0/2270066497 conn(0x7f33d007a600 msgr2=0x7f33d007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:50.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.659+0000 7f33d8600700 1 -- 172.21.15.70:0/2270066497 shutdown_connections 2024-05-08T08:15:50.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.659+0000 7f33d8600700 1 -- 172.21.15.70:0/2270066497 wait complete. 2024-05-08T08:15:50.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.660+0000 7f33d8600700 1 Processor -- start 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d8600700 1 -- start start 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d8600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d00756d0 0x7f33d01a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d8600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33d0075ff0 0x7f33d01a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d8600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33d010fea0 0x7f33d019ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d8600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33d0115730 con 0x7f33d00756d0 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d8600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33d01155b0 con 0x7f33d0075ff0 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d8600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f33d01158b0 con 0x7f33d010fea0 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d00756d0 0x7f33d01a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d00756d0 0x7f33d01a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56790/0 (socket says 172.21.15.70:56790) 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.661+0000 7f33d5c00700 1 -- 172.21.15.70:0/1723509316 learned_addr learned my addr 172.21.15.70:0/1723509316 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.662+0000 7f33d5200700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33d0075ff0 0x7f33d01a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.662+0000 7f33d6600700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33d010fea0 0x7f33d019ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.662+0000 7f33d5c00700 1 -- 172.21.15.70:0/1723509316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33d010fea0 msgr2=0x7f33d019ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.662+0000 7f33d5c00700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33d010fea0 0x7f33d019ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.662+0000 7f33d5c00700 1 -- 172.21.15.70:0/1723509316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33d0075ff0 msgr2=0x7f33d01a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.662+0000 7f33d5c00700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33d0075ff0 0x7f33d01a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.662+0000 7f33d5c00700 1 -- 172.21.15.70:0/1723509316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d019c1b0 con 0x7f33d00756d0 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.662+0000 7f33d6600700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33d010fea0 0x7f33d019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.662+0000 7f33d5c00700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d00756d0 0x7f33d01a1890 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f33c400d950 tx=0x7f33c400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.663+0000 7f33ce000700 1 -- 172.21.15.70:0/1723509316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c4016070 con 0x7f33d00756d0 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.663+0000 7f33ce000700 1 -- 172.21.15.70:0/1723509316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33c4010460 con 0x7f33d00756d0 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.663+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d019c440 con 0x7f33d00756d0 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.663+0000 7f33ce000700 1 -- 172.21.15.70:0/1723509316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c400f620 con 0x7f33d00756d0 2024-05-08T08:15:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.663+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d01a8760 con 0x7f33d00756d0 2024-05-08T08:15:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.664+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d006a190 con 0x7f33d00756d0 2024-05-08T08:15:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.666+0000 7f33ce000700 1 -- 172.21.15.70:0/1723509316 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f33c4019070 con 0x7f33d00756d0 2024-05-08T08:15:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.668+0000 7f33ce000700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33b80b2a70 0x7f33b80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.668+0000 7f33ce000700 1 -- 172.21.15.70:0/1723509316 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(255..255 src has 1..255) ==== 9583+0+0 (secure 0 0 0) 0x7f33c40e25d0 con 0x7f33d00756d0 2024-05-08T08:15:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.668+0000 7f33d5200700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33b80b2a70 0x7f33b80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.669+0000 7f33d5200700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33b80b2a70 0x7f33b80b4f30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f33bc005950 tx=0x7f33bc0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:15:50.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.673+0000 7f33ce000700 1 -- 172.21.15.70:0/1723509316 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f33c40a9b90 con 0x7f33d00756d0 2024-05-08T08:15:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.954+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33d002e510 con 0x7f33d00756d0 2024-05-08T08:15:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.956+0000 7f33ce000700 1 -- 172.21.15.70:0/1723509316 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f33c40a9490 con 0x7f33d00756d0 2024-05-08T08:15:50.950 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:15:50.950 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:15:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33b80b2a70 msgr2=0x7f33b80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33b80b2a70 0x7f33b80b4f30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f33bc005950 tx=0x7f33bc0058e0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d00756d0 msgr2=0x7f33d01a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d00756d0 0x7f33d01a1890 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f33c400d950 tx=0x7f33c400dd10 comp rx=0 tx=0).stop 2024-05-08T08:15:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 shutdown_connections 2024-05-08T08:15:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33b80b2a70 0x7f33b80b4f30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33d010fea0 0x7f33d019ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33d00756d0 0x7f33d01a1890 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 --2- 172.21.15.70:0/1723509316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33d0075ff0 0x7f33d01a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:50.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 >> 172.21.15.70:0/1723509316 conn(0x7f33d007a600 msgr2=0x7f33d01006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:50.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 shutdown_connections 2024-05-08T08:15:50.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:50.959+0000 7f33d8600700 1 -- 172.21.15.70:0/1723509316 wait complete. 2024-05-08T08:15:50.954 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:15:51.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:51 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1723509316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:15:51.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:51 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1723509316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:15:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:51 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1723509316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:15:51.757 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id f3ab6051 --release --await' 2024-05-08T08:15:51.758 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id f3ab6051 --release --await 2024-05-08T08:15:52.246 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:15:52.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:52 smithi172 ceph-mon[33377]: pgmap v2843: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:15:52.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:52 smithi070 ceph-mon[29591]: pgmap v2843: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:15:52.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:52 smithi194 ceph-mon[33679]: pgmap v2843: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:15:54.290 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:54 smithi070 ceph-mon[29591]: pgmap v2844: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:54.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.480+0000 7f913aa00700 1 -- 172.21.15.70:0/3843528473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103550 msgr2=0x7f91341039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:54.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.480+0000 7f913aa00700 1 --2- 172.21.15.70:0/3843528473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103550 0x7f91341039d0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f91200099c0 tx=0x7f9120009cd0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.480+0000 7f913aa00700 1 -- 172.21.15.70:0/3843528473 shutdown_connections 2024-05-08T08:15:54.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.480+0000 7f913aa00700 1 --2- 172.21.15.70:0/3843528473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9134103f10 0x7f91341103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.480+0000 7f913aa00700 1 --2- 172.21.15.70:0/3843528473 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91341095d0 0x7f91341099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.480+0000 7f913aa00700 1 --2- 172.21.15.70:0/3843528473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103550 0x7f91341039d0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.480+0000 7f913aa00700 1 -- 172.21.15.70:0/3843528473 >> 172.21.15.70:0/3843528473 conn(0x7f913407a5f0 msgr2=0x7f913407aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:54.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.480+0000 7f913aa00700 1 -- 172.21.15.70:0/3843528473 shutdown_connections 2024-05-08T08:15:54.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.480+0000 7f913aa00700 1 -- 172.21.15.70:0/3843528473 wait complete. 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.481+0000 7f913aa00700 1 Processor -- start 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f913aa00700 1 -- start start 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f913aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9134103550 0x7f91341a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f913aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103f10 0x7f91341a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f913aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91341095d0 0x7f913419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f913aa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91341135b0 con 0x7f9134103f10 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f913aa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9134113430 con 0x7f91341095d0 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f913aa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9134113730 con 0x7f9134103550 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f9133400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103f10 0x7f91341a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f9133400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103f10 0x7f91341a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56810/0 (socket says 172.21.15.70:56810) 2024-05-08T08:15:54.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.482+0000 7f9133400700 1 -- 172.21.15.70:0/1038769356 learned_addr learned my addr 172.21.15.70:0/1038769356 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.483+0000 7f9133e00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9134103550 0x7f91341a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.483+0000 7f9138a00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91341095d0 0x7f913419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.483+0000 7f9133400700 1 -- 172.21.15.70:0/1038769356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9134103550 msgr2=0x7f91341a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.483+0000 7f9133400700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9134103550 0x7f91341a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.483+0000 7f9133400700 1 -- 172.21.15.70:0/1038769356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91341095d0 msgr2=0x7f913419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.483+0000 7f9133400700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91341095d0 0x7f913419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.483+0000 7f9133400700 1 -- 172.21.15.70:0/1038769356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913419c1a0 con 0x7f9134103f10 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.483+0000 7f9133400700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103f10 0x7f91341a1dc0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f912000b580 tx=0x7f912000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.484+0000 7f9130c00700 1 -- 172.21.15.70:0/1038769356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120027070 con 0x7f9134103f10 2024-05-08T08:15:54.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.484+0000 7f9130c00700 1 -- 172.21.15.70:0/1038769356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f912000fdd0 con 0x7f9134103f10 2024-05-08T08:15:54.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.484+0000 7f9130c00700 1 -- 172.21.15.70:0/1038769356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91200173f0 con 0x7f9134103f10 2024-05-08T08:15:54.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.484+0000 7f913aa00700 1 -- 172.21.15.70:0/1038769356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913419c430 con 0x7f9134103f10 2024-05-08T08:15:54.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.484+0000 7f913aa00700 1 -- 172.21.15.70:0/1038769356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91341a8750 con 0x7f9134103f10 2024-05-08T08:15:54.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.487+0000 7f9130c00700 1 -- 172.21.15.70:0/1038769356 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f912002a070 con 0x7f9134103f10 2024-05-08T08:15:54.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.489+0000 7f9130c00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91180b29f0 0x7f91180b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.489+0000 7f9130c00700 1 -- 172.21.15.70:0/1038769356 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(255..255 src has 1..255) ==== 9583+0+0 (secure 0 0 0) 0x7f91200e39f0 con 0x7f9134103f10 2024-05-08T08:15:54.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.489+0000 7f9133e00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91180b29f0 0x7f91180b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.490+0000 7f9133e00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91180b29f0 0x7f91180b4eb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f913419cb80 tx=0x7f9124009040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:15:54.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.504+0000 7f9145382b80 1 Processor -- start 2024-05-08T08:15:54.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.504+0000 7f9145382b80 1 -- start start 2024-05-08T08:15:54.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.505+0000 7f9145382b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac90f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.505+0000 7f9145382b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 0x5604ac909c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.505+0000 7f9145382b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 0x5604ac915f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.505+0000 7f9145382b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5604ac85bb20 con 0x5604ac90f1b0 2024-05-08T08:15:54.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.505+0000 7f9145382b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5604ac7f9860 con 0x5604ac909780 2024-05-08T08:15:54.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.505+0000 7f9145382b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5604ac857ae0 con 0x5604ac90a140 2024-05-08T08:15:54.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.505+0000 7f9133e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac90f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.505+0000 7f9133e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac90f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56826/0 (socket says 172.21.15.70:56826) 2024-05-08T08:15:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.505+0000 7f9133e00700 1 -- 172.21.15.70:0/3867505283 learned_addr learned my addr 172.21.15.70:0/3867505283 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:15:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9133400700 1 --2- 172.21.15.70:0/3867505283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 0x5604ac909c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9138a00700 1 --2- 172.21.15.70:0/3867505283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 0x5604ac915f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9133e00700 1 -- 172.21.15.70:0/3867505283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 msgr2=0x5604ac915f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:15:54.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9133e00700 1 --2- 172.21.15.70:0/3867505283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 0x5604ac915f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9133e00700 1 -- 172.21.15.70:0/3867505283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 msgr2=0x5604ac909c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:15:54.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9133e00700 1 --2- 172.21.15.70:0/3867505283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 0x5604ac909c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9133e00700 1 -- 172.21.15.70:0/3867505283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ac7a89d0 con 0x5604ac90f1b0 2024-05-08T08:15:54.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9133e00700 1 --2- 172.21.15.70:0/3867505283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac90f590 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f9124016450 tx=0x7f9124012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4400e3181f2882 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:15:54.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9129600700 1 -- 172.21.15.70:0/3867505283 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124026070 con 0x5604ac90f1b0 2024-05-08T08:15:54.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9129600700 1 -- 172.21.15.70:0/3867505283 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9124021a90 con 0x5604ac90f1b0 2024-05-08T08:15:54.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.506+0000 7f9129600700 1 -- 172.21.15.70:0/3867505283 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124014920 con 0x5604ac90f1b0 2024-05-08T08:15:54.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.507+0000 7f9145382b80 1 -- 172.21.15.70:0/3867505283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 msgr2=0x5604ac90f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:54.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.507+0000 7f9145382b80 1 --2- 172.21.15.70:0/3867505283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac90f590 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f9124016450 tx=0x7f9124012000 comp rx=0 tx=0).stop 2024-05-08T08:15:54.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.507+0000 7f9145382b80 1 -- 172.21.15.70:0/3867505283 shutdown_connections 2024-05-08T08:15:54.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.507+0000 7f9145382b80 1 --2- 172.21.15.70:0/3867505283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 0x5604ac915f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.507+0000 7f9145382b80 1 --2- 172.21.15.70:0/3867505283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac90f590 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.507+0000 7f9145382b80 1 --2- 172.21.15.70:0/3867505283 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 0x5604ac909c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.507+0000 7f9145382b80 1 -- 172.21.15.70:0/3867505283 >> 172.21.15.70:0/3867505283 conn(0x5604ac8817d0 msgr2=0x5604ac904070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:54.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.508+0000 7f9145382b80 1 -- 172.21.15.70:0/3867505283 shutdown_connections 2024-05-08T08:15:54.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.508+0000 7f9145382b80 1 -- 172.21.15.70:0/3867505283 wait complete. 2024-05-08T08:15:54.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.508+0000 7f9145382b80 1 -- start start 2024-05-08T08:15:54.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.508+0000 7f9145382b80 1 Processor -- start 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9145382b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac909780 0x5604ac915bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9145382b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90a140 0x5604ac912f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9145382b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac9134b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9145382b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5604ac916570 con 0x5604ac90f1b0 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9145382b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5604ac7c1c20 con 0x5604ac90a140 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9145382b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5604ac9166f0 con 0x5604ac909780 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9145382b80 10 client.0 _ll_register_callbacks cb 0x5604ac802d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9138a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac9134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9138a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac9134b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56828/0 (socket says 172.21.15.70:56828) 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.509+0000 7f9138a00700 1 -- 172.21.15.70:0/922960284 learned_addr learned my addr 172.21.15.70:0/922960284 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f9133e00700 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac909780 0x5604ac915bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f9133400700 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90a140 0x5604ac912f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f9138a00700 1 -- 172.21.15.70:0/922960284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac909780 msgr2=0x5604ac915bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f9138a00700 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac909780 0x5604ac915bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f9138a00700 1 -- 172.21.15.70:0/922960284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90a140 msgr2=0x5604ac912f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f9138a00700 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90a140 0x5604ac912f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f9138a00700 1 -- 172.21.15.70:0/922960284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ac821520 con 0x5604ac90f1b0 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f9133400700 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90a140 0x5604ac912f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f9138a00700 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac9134b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f912c010840 tx=0x7f912c010c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25303ee9f0249716 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.510+0000 7f911e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.511+0000 7f911e000700 1 -- 172.21.15.70:0/922960284 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c00ea90 con 0x5604ac90f1b0 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.511+0000 7f911e000700 1 -- 172.21.15.70:0/922960284 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(255..255 src has 1..255) ==== 9583+0+0 (secure 0 0 0) 0x7f912c00ec30 con 0x5604ac90f1b0 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.511+0000 7f9145382b80 1 -- 172.21.15.70:0/922960284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9124021a90 con 0x5604ac90f1b0 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.511+0000 7f911e000700 1 -- 172.21.15.70:0/922960284 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f912c025050 con 0x5604ac90f1b0 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.511+0000 7f9145382b80 10 client.17844 fetch_fsmap learned FSMap version 42 2024-05-08T08:15:54.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.511+0000 7f9145382b80 1 -- 172.21.15.70:0/922960284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5604ac920e30 con 0x5604ac90f1b0 2024-05-08T08:15:54.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:54 smithi194 ceph-mon[33679]: pgmap v2844: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:54.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.511+0000 7f911e000700 1 -- 172.21.15.70:0/922960284 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9124021a90 con 0x5604ac90f1b0 2024-05-08T08:15:54.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.512+0000 7f911e000700 1 -- 172.21.15.70:0/922960284 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f912c011440 con 0x5604ac90f1b0 2024-05-08T08:15:54.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.512+0000 7f9145382b80 10 client.17844 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:15:54.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.512+0000 7f9145382b80 10 client.17844 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:15:54.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.512+0000 7f9145382b80 20 client.17844 populate_metadata read hostname 'smithi070' 2024-05-08T08:15:54.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.512+0000 7f9145382b80 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5604ac923470 0x5604ac925860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.512+0000 7f9145382b80 4 client.17844 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:15:54.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.512+0000 7f9145382b80 1 -- 172.21.15.70:0/922960284 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604ac8d6240 con 0x5604ac923470 2024-05-08T08:15:54.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.513+0000 7f9133e00700 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5604ac923470 0x5604ac925860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.514+0000 7f9133e00700 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5604ac923470 0x5604ac925860 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd8b2a5080e43c62 server_cookie=5903830987131f26 in_seq=0 out_seq=0 2024-05-08T08:15:54.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.514+0000 7f911e000700 10 client.17844 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:15:54.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f911e000700 1 -- 172.21.15.70:0/922960284 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5604ac8d6240 con 0x5604ac923470 2024-05-08T08:15:54.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f911e000700 10 client.17844 handle_command_reply: tid=0 2024-05-08T08:15:54.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 client.17844 shutdown 2024-05-08T08:15:54.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 -- 172.21.15.70:0/922960284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 msgr2=0x5604ac9134b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:54.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac9134b0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f912c010840 tx=0x7f912c010c00 comp rx=0 tx=0).stop 2024-05-08T08:15:54.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 -- 172.21.15.70:0/922960284 shutdown_connections 2024-05-08T08:15:54.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5604ac923470 0x5604ac925860 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90f1b0 0x5604ac9134b0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac909780 0x5604ac915bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 --2- 172.21.15.70:0/922960284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90a140 0x5604ac912f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 -- 172.21.15.70:0/922960284 >> 172.21.15.70:0/922960284 conn(0x5604ac8817d0 msgr2=0x5604ac8feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:54.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f911e000700 0 client.17844 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:15:54.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 -- 172.21.15.70:0/922960284 shutdown_connections 2024-05-08T08:15:54.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 1 -- 172.21.15.70:0/922960284 wait complete. 2024-05-08T08:15:54.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.516+0000 7f9145382b80 20 client.17844 trim_cache size 0 max 16384 2024-05-08T08:15:54.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.538+0000 7f9145382b80 1 Processor -- start 2024-05-08T08:15:54.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.538+0000 7f9145382b80 1 -- start start 2024-05-08T08:15:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.538+0000 7f9145382b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac909780 0x5604ac9134e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.538+0000 7f9145382b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 0x5604ac91f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.538+0000 7f9145382b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90f1b0 0x5604ac90d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.538+0000 7f9145382b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91341b3eb0 con 0x5604ac909780 2024-05-08T08:15:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.538+0000 7f9145382b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91341b1740 con 0x5604ac90f1b0 2024-05-08T08:15:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.538+0000 7f9145382b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f91341af5b0 con 0x5604ac90a140 2024-05-08T08:15:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac909780 0x5604ac9134e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac909780 0x5604ac9134e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56832/0 (socket says 172.21.15.70:56832) 2024-05-08T08:15:54.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133e00700 1 -- 172.21.15.70:0/20259479 learned_addr learned my addr 172.21.15.70:0/20259479 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:15:54.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133400700 1 --2- 172.21.15.70:0/20259479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 0x5604ac91f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133e00700 1 -- 172.21.15.70:0/20259479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 msgr2=0x5604ac91f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:15:54.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133e00700 1 --2- 172.21.15.70:0/20259479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 0x5604ac91f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133e00700 1 -- 172.21.15.70:0/20259479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90f1b0 msgr2=0x5604ac90d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:15:54.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133e00700 1 --2- 172.21.15.70:0/20259479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90f1b0 0x5604ac90d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133e00700 1 -- 172.21.15.70:0/20259479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604ac904c20 con 0x5604ac909780 2024-05-08T08:15:54.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.539+0000 7f9133e00700 1 --2- 172.21.15.70:0/20259479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac909780 0x5604ac9134e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f9124009240 tx=0x7f9124004eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398296097286f989 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:15:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.540+0000 7f9128c00700 1 -- 172.21.15.70:0/20259479 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124026040 con 0x5604ac909780 2024-05-08T08:15:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.540+0000 7f9128c00700 1 -- 172.21.15.70:0/20259479 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f912403a070 con 0x5604ac909780 2024-05-08T08:15:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.540+0000 7f9128c00700 1 -- 172.21.15.70:0/20259479 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912402eae0 con 0x5604ac909780 2024-05-08T08:15:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 -- 172.21.15.70:0/20259479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac909780 msgr2=0x5604ac9134e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 --2- 172.21.15.70:0/20259479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac909780 0x5604ac9134e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f9124009240 tx=0x7f9124004eb0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 -- 172.21.15.70:0/20259479 shutdown_connections 2024-05-08T08:15:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 --2- 172.21.15.70:0/20259479 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac90f1b0 0x5604ac90d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 --2- 172.21.15.70:0/20259479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac909780 0x5604ac9134e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 --2- 172.21.15.70:0/20259479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90a140 0x5604ac91f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 -- 172.21.15.70:0/20259479 >> 172.21.15.70:0/20259479 conn(0x5604ac8817d0 msgr2=0x5604ac90cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 -- 172.21.15.70:0/20259479 shutdown_connections 2024-05-08T08:15:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 -- 172.21.15.70:0/20259479 wait complete. 2024-05-08T08:15:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.541+0000 7f9145382b80 1 -- start start 2024-05-08T08:15:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.542+0000 7f9145382b80 1 Processor -- start 2024-05-08T08:15:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.542+0000 7f9145382b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 0x5604ac91bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.542+0000 7f9145382b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90a140 0x5604ac918910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.542+0000 7f9145382b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90f1b0 0x5604ac918e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.542+0000 7f9145382b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91341afc00 con 0x5604ac90a140 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.542+0000 7f9145382b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91341b1070 con 0x5604ac909780 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.542+0000 7f9145382b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f91341b02d0 con 0x5604ac90f1b0 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.542+0000 7f9145382b80 10 client.0 _ll_register_callbacks cb 0x5604ac802d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.542+0000 7f9133400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90a140 0x5604ac918910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9133400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90a140 0x5604ac918910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56836/0 (socket says 172.21.15.70:56836) 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9133400700 1 -- 172.21.15.70:0/3390498730 learned_addr learned my addr 172.21.15.70:0/3390498730 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9138a00700 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90f1b0 0x5604ac918e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9133e00700 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 0x5604ac91bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9133400700 1 -- 172.21.15.70:0/3390498730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90f1b0 msgr2=0x5604ac918e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:15:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9133400700 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90f1b0 0x5604ac918e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9133400700 1 -- 172.21.15.70:0/3390498730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 msgr2=0x5604ac91bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9133400700 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 0x5604ac91bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9133400700 1 -- 172.21.15.70:0/3390498730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604ac9194d0 con 0x5604ac90a140 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f9133400700 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90a140 0x5604ac918910 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f9120009990 tx=0x7f91200e1220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33d65679aa701a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f911e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.543+0000 7f911e000700 1 -- 172.21.15.70:0/3390498730 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91200aa3f0 con 0x5604ac90a140 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f911e000700 1 -- 172.21.15.70:0/3390498730 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(255..255 src has 1..255) ==== 9583+0+0 (secure 0 0 0) 0x7f91200a6ed0 con 0x5604ac90a140 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f9145382b80 1 -- 172.21.15.70:0/3390498730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f912403a070 con 0x5604ac90a140 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f911e000700 1 -- 172.21.15.70:0/3390498730 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f91200aafe0 con 0x5604ac90a140 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f9145382b80 10 client.17850 fetch_fsmap learned FSMap version 42 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f9145382b80 1 -- 172.21.15.70:0/3390498730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5604ac98ebd0 con 0x5604ac90a140 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f911e000700 1 -- 172.21.15.70:0/3390498730 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f912403a070 con 0x5604ac90a140 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f911e000700 1 -- 172.21.15.70:0/3390498730 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f91200700f0 con 0x5604ac90a140 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f9145382b80 10 client.17850 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:15:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f9145382b80 10 client.17850 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:15:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f9145382b80 20 client.17850 populate_metadata read hostname 'smithi070' 2024-05-08T08:15:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.544+0000 7f9145382b80 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5604ac98f360 0x5604ac991780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:15:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.545+0000 7f9145382b80 4 client.17850 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f3ab6051", "release": true, "await": true}] 2024-05-08T08:15:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.545+0000 7f9145382b80 1 -- 172.21.15.70:0/3390498730 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f3ab6051", "release": true, "await": true}) -- 0x5604ac869500 con 0x5604ac98f360 2024-05-08T08:15:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.545+0000 7f9133e00700 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5604ac98f360 0x5604ac991780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:15:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.546+0000 7f9133e00700 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5604ac98f360 0x5604ac991780 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=597633c758ab7088 server_cookie=d080ac3b1d57606a in_seq=0 out_seq=0 2024-05-08T08:15:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:54.546+0000 7f911e000700 10 client.17850 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:15:54.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:54 smithi172 ceph-mon[33377]: pgmap v2844: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:56.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:56 smithi194 ceph-mon[33679]: pgmap v2845: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:15:56.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:56 smithi070 ceph-mon[29591]: pgmap v2845: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:15:56.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:56 smithi172 ceph-mon[33377]: pgmap v2845: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:15:58.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:15:58 smithi194 ceph-mon[33679]: pgmap v2846: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:58.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:15:58 smithi070 ceph-mon[29591]: pgmap v2846: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:58.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:15:58 smithi172 ceph-mon[33377]: pgmap v2846: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:15:58.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.914+0000 7f911e000700 1 -- 172.21.15.70:0/3390498730 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5604ac869500 con 0x5604ac98f360 2024-05-08T08:15:58.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.914+0000 7f911e000700 10 client.17850 handle_command_reply: tid=0 2024-05-08T08:15:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.914+0000 7f9145382b80 1 client.17850 shutdown 2024-05-08T08:15:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.915+0000 7f9145382b80 1 -- 172.21.15.70:0/3390498730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90a140 msgr2=0x5604ac918910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.915+0000 7f9145382b80 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90a140 0x5604ac918910 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f9120009990 tx=0x7f91200e1220 comp rx=0 tx=0).stop 2024-05-08T08:15:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.915+0000 7f9145382b80 1 -- 172.21.15.70:0/3390498730 shutdown_connections 2024-05-08T08:15:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.915+0000 7f9145382b80 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5604ac98f360 0x5604ac991780 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.915+0000 7f9145382b80 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5604ac90f1b0 0x5604ac918e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.915+0000 7f9145382b80 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5604ac909780 0x5604ac91bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.915+0000 7f9145382b80 1 --2- 172.21.15.70:0/3390498730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604ac90a140 0x5604ac918910 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.915+0000 7f911e000700 0 client.17850 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:15:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.915+0000 7f9145382b80 1 -- 172.21.15.70:0/3390498730 >> 172.21.15.70:0/3390498730 conn(0x5604ac8817d0 msgr2=0x5604ac8feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.916+0000 7f9145382b80 1 -- 172.21.15.70:0/3390498730 shutdown_connections 2024-05-08T08:15:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.916+0000 7f9145382b80 1 -- 172.21.15.70:0/3390498730 wait complete. 2024-05-08T08:15:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.916+0000 7f9145382b80 20 client.17850 trim_cache size 0 max 16384 2024-05-08T08:15:58.911 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:15:58.911 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:15:58.911 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:15:58.911 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 208, 2024-05-08T08:15:58.911 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:15:58.911 INFO:teuthology.orchestra.run.smithi070.stdout: "f3ab6051": { 2024-05-08T08:15:58.911 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 208, 2024-05-08T08:15:58.911 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:15:58.911 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:58.912 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:58.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:58.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:15:58.913 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:15:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.917+0000 7f913aa00700 1 -- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91180b29f0 msgr2=0x7f91180b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.917+0000 7f913aa00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91180b29f0 0x7f91180b4eb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f913419cb80 tx=0x7f9124009040 comp rx=0 tx=0).stop 2024-05-08T08:15:58.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.917+0000 7f913aa00700 1 -- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103f10 msgr2=0x7f91341a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:15:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.917+0000 7f913aa00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103f10 0x7f91341a1dc0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f912000b580 tx=0x7f912000f510 comp rx=0 tx=0).stop 2024-05-08T08:15:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.918+0000 7f913aa00700 1 -- 172.21.15.70:0/1038769356 shutdown_connections 2024-05-08T08:15:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.918+0000 7f913aa00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91180b29f0 0x7f91180b4eb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.918+0000 7f913aa00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91341095d0 0x7f913419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.918+0000 7f913aa00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9134103550 0x7f91341a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.918+0000 7f913aa00700 1 --2- 172.21.15.70:0/1038769356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9134103f10 0x7f91341a1dc0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:15:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.918+0000 7f913aa00700 1 -- 172.21.15.70:0/1038769356 >> 172.21.15.70:0/1038769356 conn(0x7f913407a5f0 msgr2=0x7f913410e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:15:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.918+0000 7f913aa00700 1 -- 172.21.15.70:0/1038769356 shutdown_connections 2024-05-08T08:15:58.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:15:58.918+0000 7f913aa00700 1 -- 172.21.15.70:0/1038769356 wait complete. 2024-05-08T08:15:59.094 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exconcat.o 2024-05-08T08:15:59.719 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f3ab6051', seconds elapsed: 72.0 2024-05-08T08:16:00.461 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:00 smithi070 ceph-mon[29591]: pgmap v2847: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3.9 KiB/s wr, 6 op/s 2024-05-08T08:16:00.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:00 smithi194 ceph-mon[33679]: pgmap v2847: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3.9 KiB/s wr, 6 op/s 2024-05-08T08:16:00.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:00 smithi172 ceph-mon[33377]: pgmap v2847: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3.9 KiB/s wr, 6 op/s 2024-05-08T08:16:02.413 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/find_bit.o 2024-05-08T08:16:02.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:02 smithi194 ceph-mon[33679]: pgmap v2848: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 106 KiB/s wr, 12 op/s 2024-05-08T08:16:02.508 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/intel-dsp-config.o 2024-05-08T08:16:02.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:02 smithi070 ceph-mon[29591]: pgmap v2848: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 106 KiB/s wr, 12 op/s 2024-05-08T08:16:02.623 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/tracepoint.o 2024-05-08T08:16:02.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:02 smithi172 ceph-mon[33377]: pgmap v2848: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 106 KiB/s wr, 12 op/s 2024-05-08T08:16:03.138 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/host.o 2024-05-08T08:16:03.144 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/auditfilter.o 2024-05-08T08:16:03.157 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs3xdr.o 2024-05-08T08:16:03.249 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/ptp_classifier.o 2024-05-08T08:16:04.078 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/llist.o 2024-05-08T08:16:04.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:04 smithi194 ceph-mon[33679]: pgmap v2849: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 106 KiB/s wr, 9 op/s 2024-05-08T08:16:04.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:04 smithi070 ceph-mon[29591]: pgmap v2849: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 106 KiB/s wr, 9 op/s 2024-05-08T08:16:04.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:04 smithi172 ceph-mon[33377]: pgmap v2849: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 106 KiB/s wr, 9 op/s 2024-05-08T08:16:05.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:05 smithi194 ceph-mon[33679]: osdmap e256: 12 total, 12 up, 12 in 2024-05-08T08:16:05.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:05 smithi070 ceph-mon[29591]: osdmap e256: 12 total, 12 up, 12 in 2024-05-08T08:16:05.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:05 smithi172 ceph-mon[33377]: osdmap e256: 12 total, 12 up, 12 in 2024-05-08T08:16:05.816 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/memweight.o 2024-05-08T08:16:06.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:06 smithi194 ceph-mon[33679]: pgmap v2851: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 410 KiB/s wr, 53 op/s 2024-05-08T08:16:06.602 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exconfig.o 2024-05-08T08:16:06.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:06 smithi070 ceph-mon[29591]: pgmap v2851: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 410 KiB/s wr, 53 op/s 2024-05-08T08:16:06.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:06 smithi172 ceph-mon[33377]: pgmap v2851: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 410 KiB/s wr, 53 op/s 2024-05-08T08:16:07.446 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/kfifo.o 2024-05-08T08:16:08.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:08 smithi194 ceph-mon[33679]: pgmap v2852: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 410 KiB/s wr, 53 op/s 2024-05-08T08:16:08.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:08 smithi070 ceph-mon[29591]: pgmap v2852: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 410 KiB/s wr, 53 op/s 2024-05-08T08:16:08.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:08 smithi172 ceph-mon[33377]: pgmap v2852: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 313 KiB/s rd, 410 KiB/s wr, 53 op/s 2024-05-08T08:16:09.330 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/itmt.o 2024-05-08T08:16:10.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:10 smithi194 ceph-mon[33679]: pgmap v2853: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 409 KiB/s wr, 54 op/s 2024-05-08T08:16:10.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:10 smithi070 ceph-mon[29591]: pgmap v2853: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 409 KiB/s wr, 54 op/s 2024-05-08T08:16:10.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:10 smithi172 ceph-mon[33377]: pgmap v2853: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 409 KiB/s wr, 54 op/s 2024-05-08T08:16:11.455 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/intel-nhlt.o 2024-05-08T08:16:12.566 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exconvrt.o 2024-05-08T08:16:12.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:12 smithi070 ceph-mon[29591]: pgmap v2854: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 569 KiB/s wr, 56 op/s 2024-05-08T08:16:12.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:12 smithi172 ceph-mon[33377]: pgmap v2854: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 569 KiB/s wr, 56 op/s 2024-05-08T08:16:12.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:12 smithi194 ceph-mon[33679]: pgmap v2854: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 569 KiB/s wr, 56 op/s 2024-05-08T08:16:15.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:15 smithi070 ceph-mon[29591]: pgmap v2855: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 569 KiB/s wr, 56 op/s 2024-05-08T08:16:15.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:15 smithi070 ceph-mon[29591]: osdmap e257: 12 total, 12 up, 12 in 2024-05-08T08:16:15.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:15 smithi172 ceph-mon[33377]: pgmap v2855: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 569 KiB/s wr, 56 op/s 2024-05-08T08:16:15.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:15 smithi172 ceph-mon[33377]: osdmap e257: 12 total, 12 up, 12 in 2024-05-08T08:16:15.458 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:15 smithi194 ceph-mon[33679]: pgmap v2855: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 569 KiB/s wr, 56 op/s 2024-05-08T08:16:15.458 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:15 smithi194 ceph-mon[33679]: osdmap e257: 12 total, 12 up, 12 in 2024-05-08T08:16:15.459 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/netprio_cgroup.o 2024-05-08T08:16:15.513 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/auditsc.o 2024-05-08T08:16:15.605 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/percpu-refcount.o 2024-05-08T08:16:15.612 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/svc.o 2024-05-08T08:16:16.475 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs3acl.o 2024-05-08T08:16:17.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:17 smithi070 ceph-mon[29591]: pgmap v2857: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 598 KiB/s wr, 27 op/s 2024-05-08T08:16:17.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:17 smithi172 ceph-mon[33377]: pgmap v2857: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 598 KiB/s wr, 27 op/s 2024-05-08T08:16:17.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:17 smithi194 ceph-mon[33679]: pgmap v2857: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 598 KiB/s wr, 27 op/s 2024-05-08T08:16:19.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:19 smithi070 ceph-mon[29591]: pgmap v2858: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 598 KiB/s wr, 27 op/s 2024-05-08T08:16:19.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:19 smithi172 ceph-mon[33377]: pgmap v2858: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 598 KiB/s wr, 27 op/s 2024-05-08T08:16:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:19 smithi194 ceph-mon[33679]: pgmap v2858: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 598 KiB/s wr, 27 op/s 2024-05-08T08:16:19.742 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/excreate.o 2024-05-08T08:16:19.984 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/hda/intel-sdw-acpi.o 2024-05-08T08:16:20.327 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/umip.o 2024-05-08T08:16:21.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:21 smithi070 ceph-mon[29591]: pgmap v2859: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 613 KiB/s wr, 26 op/s 2024-05-08T08:16:21.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:21 smithi172 ceph-mon[33377]: pgmap v2859: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 613 KiB/s wr, 26 op/s 2024-05-08T08:16:21.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:21 smithi194 ceph-mon[33679]: pgmap v2859: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 613 KiB/s wr, 26 op/s 2024-05-08T08:16:22.795 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/rhashtable.o 2024-05-08T08:16:23.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:23 smithi070 ceph-mon[29591]: pgmap v2860: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 592 KiB/s wr, 26 op/s 2024-05-08T08:16:23.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:23 smithi172 ceph-mon[33377]: pgmap v2860: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 592 KiB/s wr, 26 op/s 2024-05-08T08:16:23.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:23 smithi194 ceph-mon[33679]: pgmap v2860: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 592 KiB/s wr, 26 op/s 2024-05-08T08:16:25.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:25 smithi070 ceph-mon[29591]: pgmap v2861: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 592 KiB/s wr, 26 op/s 2024-05-08T08:16:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:25 smithi172 ceph-mon[33377]: pgmap v2861: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 592 KiB/s wr, 26 op/s 2024-05-08T08:16:25.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:25 smithi194 ceph-mon[33679]: pgmap v2861: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 541 KiB/s rd, 592 KiB/s wr, 26 op/s 2024-05-08T08:16:26.106 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exdebug.o 2024-05-08T08:16:26.959 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/netclassid_cgroup.o 2024-05-08T08:16:27.048 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/audit_watch.o 2024-05-08T08:16:27.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:27 smithi070 ceph-mon[29591]: pgmap v2862: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 780 KiB/s wr, 37 op/s 2024-05-08T08:16:27.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:27 smithi172 ceph-mon[33377]: pgmap v2862: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 780 KiB/s wr, 37 op/s 2024-05-08T08:16:27.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:27 smithi194 ceph-mon[33679]: pgmap v2862: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 780 KiB/s wr, 37 op/s 2024-05-08T08:16:27.606 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/hda/built-in.a 2024-05-08T08:16:28.014 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/svclock.o 2024-05-08T08:16:28.316 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/x86/built-in.a 2024-05-08T08:16:28.496 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/xen/built-in.a 2024-05-08T08:16:28.549 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4proc.o 2024-05-08T08:16:28.694 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/virtio/built-in.a 2024-05-08T08:16:28.817 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/sound_core.o 2024-05-08T08:16:29.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:29 smithi070 ceph-mon[29591]: pgmap v2863: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 461 KiB/s wr, 23 op/s 2024-05-08T08:16:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:29 smithi172 ceph-mon[33377]: pgmap v2863: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 461 KiB/s wr, 23 op/s 2024-05-08T08:16:29.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:29 smithi194 ceph-mon[33679]: pgmap v2863: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 461 KiB/s wr, 23 op/s 2024-05-08T08:16:30.159 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/unwind_orc.o 2024-05-08T08:16:30.777 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/base64.o 2024-05-08T08:16:31.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:31 smithi070 ceph-mon[29591]: pgmap v2864: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 657 KiB/s wr, 33 op/s 2024-05-08T08:16:31.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:31 smithi172 ceph-mon[33377]: pgmap v2864: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 657 KiB/s wr, 33 op/s 2024-05-08T08:16:31.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:31 smithi194 ceph-mon[33679]: pgmap v2864: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 657 KiB/s wr, 33 op/s 2024-05-08T08:16:32.447 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exdump.o 2024-05-08T08:16:32.548 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/once.o 2024-05-08T08:16:33.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:33 smithi172 ceph-mon[33377]: pgmap v2865: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 681 KiB/s wr, 45 op/s 2024-05-08T08:16:33.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:33 smithi194 ceph-mon[33679]: pgmap v2865: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 681 KiB/s wr, 45 op/s 2024-05-08T08:16:33.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:33 smithi070 ceph-mon[29591]: pgmap v2865: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 681 KiB/s wr, 45 op/s 2024-05-08T08:16:35.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:35 smithi172 ceph-mon[33377]: pgmap v2866: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 463 KiB/s wr, 36 op/s 2024-05-08T08:16:35.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:35 smithi194 ceph-mon[33679]: pgmap v2866: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 463 KiB/s wr, 36 op/s 2024-05-08T08:16:35.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:35 smithi070 ceph-mon[29591]: pgmap v2866: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 463 KiB/s wr, 36 op/s 2024-05-08T08:16:35.735 INFO:tasks.workunit.client.0.smithi070.stdout: CC sound/last.o 2024-05-08T08:16:37.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:37 smithi172 ceph-mon[33377]: pgmap v2867: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 566 KiB/s wr, 44 op/s 2024-05-08T08:16:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:37 smithi194 ceph-mon[33679]: pgmap v2867: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 566 KiB/s wr, 44 op/s 2024-05-08T08:16:37.514 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/audit_fsnotify.o 2024-05-08T08:16:37.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:37 smithi070 ceph-mon[29591]: pgmap v2867: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 566 KiB/s wr, 44 op/s 2024-05-08T08:16:38.740 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/dst_cache.o 2024-05-08T08:16:39.061 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exfield.o 2024-05-08T08:16:39.177 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/callthunks.o 2024-05-08T08:16:39.292 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/refcount.o 2024-05-08T08:16:39.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:39 smithi172 ceph-mon[33377]: pgmap v2868: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 338 KiB/s wr, 31 op/s 2024-05-08T08:16:39.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:39 smithi194 ceph-mon[33679]: pgmap v2868: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 338 KiB/s wr, 31 op/s 2024-05-08T08:16:39.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:39 smithi070 ceph-mon[29591]: pgmap v2868: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 338 KiB/s wr, 31 op/s 2024-05-08T08:16:40.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:40 smithi194 ceph-mon[33679]: pgmap v2869: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 662 KiB/s wr, 44 op/s 2024-05-08T08:16:40.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:40 smithi070 ceph-mon[29591]: pgmap v2869: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 662 KiB/s wr, 44 op/s 2024-05-08T08:16:40.625 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/svcshare.o 2024-05-08T08:16:40.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:40 smithi172 ceph-mon[33377]: pgmap v2869: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 662 KiB/s wr, 44 op/s 2024-05-08T08:16:42.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:42 smithi194 ceph-mon[33679]: pgmap v2870: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 467 KiB/s wr, 33 op/s 2024-05-08T08:16:42.547 INFO:tasks.workunit.client.0.smithi070.stdout: AR sound/built-in.a 2024-05-08T08:16:42.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:42 smithi070 ceph-mon[29591]: pgmap v2870: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 467 KiB/s wr, 33 op/s 2024-05-08T08:16:42.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:42 smithi172 ceph-mon[33377]: pgmap v2870: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 467 KiB/s wr, 33 op/s 2024-05-08T08:16:42.792 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/rcuref.o 2024-05-08T08:16:44.148 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4xdr.o 2024-05-08T08:16:44.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:44 smithi194 ceph-mon[33679]: pgmap v2871: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 427 KiB/s wr, 20 op/s 2024-05-08T08:16:44.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:44 smithi070 ceph-mon[29591]: pgmap v2871: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 427 KiB/s wr, 20 op/s 2024-05-08T08:16:44.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:44 smithi172 ceph-mon[33377]: pgmap v2871: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 427 KiB/s wr, 20 op/s 2024-05-08T08:16:44.743 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/svcproc.o 2024-05-08T08:16:45.084 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exfldio.o 2024-05-08T08:16:46.165 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/usercopy.o 2024-05-08T08:16:46.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:46 smithi194 ceph-mon[33679]: pgmap v2872: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 571 KiB/s wr, 31 op/s 2024-05-08T08:16:46.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:46 smithi070 ceph-mon[29591]: pgmap v2872: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 571 KiB/s wr, 31 op/s 2024-05-08T08:16:46.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:46 smithi172 ceph-mon[33377]: pgmap v2872: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 571 KiB/s wr, 31 op/s 2024-05-08T08:16:47.569 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/audit_tree.o 2024-05-08T08:16:48.077 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/audit_64.o 2024-05-08T08:16:48.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:48 smithi194 ceph-mon[33679]: pgmap v2873: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 468 KiB/s wr, 23 op/s 2024-05-08T08:16:48.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:16:48.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:48 smithi070 ceph-mon[29591]: pgmap v2873: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 468 KiB/s wr, 23 op/s 2024-05-08T08:16:48.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:16:48.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:48 smithi172 ceph-mon[33377]: pgmap v2873: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 468 KiB/s wr, 23 op/s 2024-05-08T08:16:48.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:16:50.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:50 smithi194 ceph-mon[33679]: pgmap v2874: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 844 KiB/s wr, 46 op/s 2024-05-08T08:16:50.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:16:50.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:16:50.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:16:50.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:50 smithi070 ceph-mon[29591]: pgmap v2874: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 844 KiB/s wr, 46 op/s 2024-05-08T08:16:50.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:16:50.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:16:50.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:16:50.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:50 smithi172 ceph-mon[33377]: pgmap v2874: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 844 KiB/s wr, 46 op/s 2024-05-08T08:16:50.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:16:50.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:16:50.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:16:50.882 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/gro_cells.o 2024-05-08T08:16:52.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:52 smithi194 ceph-mon[33679]: pgmap v2875: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 520 KiB/s wr, 33 op/s 2024-05-08T08:16:52.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:52 smithi070 ceph-mon[29591]: pgmap v2875: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 520 KiB/s wr, 33 op/s 2024-05-08T08:16:52.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:52 smithi172 ceph-mon[33377]: pgmap v2875: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 520 KiB/s wr, 33 op/s 2024-05-08T08:16:54.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:54 smithi194 ceph-mon[33679]: pgmap v2876: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 520 KiB/s wr, 33 op/s 2024-05-08T08:16:54.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:54 smithi070 ceph-mon[29591]: pgmap v2876: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 520 KiB/s wr, 33 op/s 2024-05-08T08:16:54.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:54 smithi172 ceph-mon[33377]: pgmap v2876: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 520 KiB/s wr, 33 op/s 2024-05-08T08:16:55.941 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/errseq.o 2024-05-08T08:16:56.047 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exmisc.o 2024-05-08T08:16:56.497 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/mmconf-fam10h_64.o 2024-05-08T08:16:56.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:56 smithi070 ceph-mon[29591]: pgmap v2877: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 595 KiB/s wr, 40 op/s 2024-05-08T08:16:56.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:56 smithi172 ceph-mon[33377]: pgmap v2877: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 595 KiB/s wr, 40 op/s 2024-05-08T08:16:56.738 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/kprobes.o 2024-05-08T08:16:56.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:56 smithi194 ceph-mon[33679]: pgmap v2877: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 595 KiB/s wr, 40 op/s 2024-05-08T08:16:57.131 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/kernel/vsmp_64.o 2024-05-08T08:16:57.210 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/svcsubs.o 2024-05-08T08:16:57.573 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4state.o 2024-05-08T08:16:57.824 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/bucket_locks.o 2024-05-08T08:16:58.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:16:58 smithi070 ceph-mon[29591]: pgmap v2878: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 452 KiB/s wr, 29 op/s 2024-05-08T08:16:58.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:16:58 smithi172 ceph-mon[33377]: pgmap v2878: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 452 KiB/s wr, 29 op/s 2024-05-08T08:16:58.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:16:58 smithi194 ceph-mon[33679]: pgmap v2878: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 452 KiB/s wr, 29 op/s 2024-05-08T08:17:00.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:00 smithi070 ceph-mon[29591]: pgmap v2879: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 769 KiB/s wr, 48 op/s 2024-05-08T08:17:00.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:00 smithi172 ceph-mon[33377]: pgmap v2879: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 769 KiB/s wr, 48 op/s 2024-05-08T08:17:00.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:00 smithi194 ceph-mon[33679]: pgmap v2879: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 769 KiB/s wr, 48 op/s 2024-05-08T08:17:02.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:02 smithi070 ceph-mon[29591]: pgmap v2880: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 393 KiB/s wr, 26 op/s 2024-05-08T08:17:02.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:02 smithi172 ceph-mon[33377]: pgmap v2880: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 393 KiB/s wr, 26 op/s 2024-05-08T08:17:02.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:02 smithi194 ceph-mon[33679]: pgmap v2880: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 393 KiB/s wr, 26 op/s 2024-05-08T08:17:02.945 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exmutex.o 2024-05-08T08:17:04.443 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/core/failover.o 2024-05-08T08:17:04.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:04 smithi070 ceph-mon[29591]: pgmap v2881: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 393 KiB/s wr, 26 op/s 2024-05-08T08:17:04.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:04 smithi172 ceph-mon[33377]: pgmap v2881: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 393 KiB/s wr, 26 op/s 2024-05-08T08:17:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:04 smithi194 ceph-mon[33679]: pgmap v2881: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 393 KiB/s wr, 26 op/s 2024-05-08T08:17:05.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:05 smithi070 ceph-mon[29591]: osdmap e258: 12 total, 12 up, 12 in 2024-05-08T08:17:05.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:05 smithi172 ceph-mon[33377]: osdmap e258: 12 total, 12 up, 12 in 2024-05-08T08:17:05.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:05 smithi194 ceph-mon[33679]: osdmap e258: 12 total, 12 up, 12 in 2024-05-08T08:17:06.045 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/generic-radix-tree.o 2024-05-08T08:17:06.066 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/string_helpers.o 2024-05-08T08:17:06.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:06 smithi070 ceph-mon[29591]: pgmap v2883: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 705 KiB/s wr, 57 op/s 2024-05-08T08:17:06.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:06 smithi172 ceph-mon[33377]: pgmap v2883: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 705 KiB/s wr, 57 op/s 2024-05-08T08:17:06.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:06 smithi194 ceph-mon[33679]: pgmap v2883: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 705 KiB/s wr, 57 op/s 2024-05-08T08:17:07.283 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/kernel/built-in.a 2024-05-08T08:17:07.432 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/seccomp.o 2024-05-08T08:17:08.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:08 smithi070 ceph-mon[29591]: pgmap v2884: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 705 KiB/s wr, 57 op/s 2024-05-08T08:17:08.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:08 smithi172 ceph-mon[33377]: pgmap v2884: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 705 KiB/s wr, 57 op/s 2024-05-08T08:17:08.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:08 smithi194 ceph-mon[33679]: pgmap v2884: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 505 KiB/s rd, 705 KiB/s wr, 57 op/s 2024-05-08T08:17:09.798 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exnames.o 2024-05-08T08:17:10.577 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/mon.o 2024-05-08T08:17:10.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:10 smithi070 ceph-mon[29591]: pgmap v2885: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 718 KiB/s wr, 51 op/s 2024-05-08T08:17:10.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:10 smithi172 ceph-mon[33377]: pgmap v2885: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 718 KiB/s wr, 51 op/s 2024-05-08T08:17:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:10 smithi194 ceph-mon[33679]: pgmap v2885: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 718 KiB/s wr, 51 op/s 2024-05-08T08:17:11.642 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/relay.o 2024-05-08T08:17:12.450 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4renewd.o 2024-05-08T08:17:12.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:12 smithi070 ceph-mon[29591]: pgmap v2886: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 718 KiB/s wr, 51 op/s 2024-05-08T08:17:12.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:12 smithi172 ceph-mon[33377]: pgmap v2886: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 718 KiB/s wr, 51 op/s 2024-05-08T08:17:12.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:12 smithi194 ceph-mon[33679]: pgmap v2886: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 718 KiB/s wr, 51 op/s 2024-05-08T08:17:14.845 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/hexdump.o 2024-05-08T08:17:15.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:15 smithi070 ceph-mon[29591]: pgmap v2887: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 718 KiB/s wr, 51 op/s 2024-05-08T08:17:15.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:15 smithi070 ceph-mon[29591]: osdmap e259: 12 total, 12 up, 12 in 2024-05-08T08:17:15.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:15 smithi172 ceph-mon[33377]: pgmap v2887: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 718 KiB/s wr, 51 op/s 2024-05-08T08:17:15.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:15 smithi172 ceph-mon[33377]: osdmap e259: 12 total, 12 up, 12 in 2024-05-08T08:17:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:15 smithi194 ceph-mon[33679]: pgmap v2887: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 718 KiB/s wr, 51 op/s 2024-05-08T08:17:15.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:15 smithi194 ceph-mon[33679]: osdmap e259: 12 total, 12 up, 12 in 2024-05-08T08:17:16.018 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/core/built-in.a 2024-05-08T08:17:16.076 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exoparg1.o 2024-05-08T08:17:16.677 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/kstrtox.o 2024-05-08T08:17:17.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:17 smithi070 ceph-mon[29591]: pgmap v2889: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 536 KiB/s wr, 33 op/s 2024-05-08T08:17:17.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:17 smithi172 ceph-mon[33377]: pgmap v2889: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 536 KiB/s wr, 33 op/s 2024-05-08T08:17:17.425 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/built-in.a 2024-05-08T08:17:17.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:17 smithi194 ceph-mon[33679]: pgmap v2889: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 536 KiB/s wr, 33 op/s 2024-05-08T08:17:17.815 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/sch_generic.o 2024-05-08T08:17:19.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:19 smithi070 ceph-mon[29591]: pgmap v2890: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 536 KiB/s wr, 33 op/s 2024-05-08T08:17:19.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:19 smithi172 ceph-mon[33377]: pgmap v2890: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 536 KiB/s wr, 33 op/s 2024-05-08T08:17:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:19 smithi194 ceph-mon[33679]: pgmap v2890: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 594 KiB/s rd, 536 KiB/s wr, 33 op/s 2024-05-08T08:17:20.266 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/utsname_sysctl.o 2024-05-08T08:17:20.342 INFO:tasks.workunit.client.0.smithi070.stdout: AR virt/lib/built-in.a 2024-05-08T08:17:20.506 INFO:tasks.workunit.client.0.smithi070.stdout: AR virt/built-in.a 2024-05-08T08:17:20.600 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exoparg2.o 2024-05-08T08:17:21.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:21 smithi070 ceph-mon[29591]: pgmap v2891: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 704 KiB/s wr, 46 op/s 2024-05-08T08:17:21.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:21 smithi172 ceph-mon[33377]: pgmap v2891: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 704 KiB/s wr, 46 op/s 2024-05-08T08:17:21.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:21 smithi194 ceph-mon[33679]: pgmap v2891: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 704 KiB/s wr, 46 op/s 2024-05-08T08:17:22.508 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4super.o 2024-05-08T08:17:22.684 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/iomap.o 2024-05-08T08:17:22.812 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/trace.o 2024-05-08T08:17:23.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:23 smithi070 ceph-mon[29591]: pgmap v2892: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 704 KiB/s wr, 46 op/s 2024-05-08T08:17:23.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:23 smithi172 ceph-mon[33377]: pgmap v2892: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 704 KiB/s wr, 46 op/s 2024-05-08T08:17:23.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:23 smithi194 ceph-mon[33679]: pgmap v2892: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 704 KiB/s wr, 46 op/s 2024-05-08T08:17:24.783 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/amba/built-in.a 2024-05-08T08:17:24.923 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4file.o 2024-05-08T08:17:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:25 smithi172 ceph-mon[33377]: pgmap v2893: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 704 KiB/s wr, 46 op/s 2024-05-08T08:17:25.483 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/delayacct.o 2024-05-08T08:17:25.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:25 smithi194 ceph-mon[33679]: pgmap v2893: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 704 KiB/s wr, 46 op/s 2024-05-08T08:17:25.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:25 smithi070 ceph-mon[29591]: pgmap v2893: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 731 KiB/s rd, 704 KiB/s wr, 46 op/s 2024-05-08T08:17:26.804 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exoparg3.o 2024-05-08T08:17:27.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:27 smithi172 ceph-mon[33377]: pgmap v2894: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 844 KiB/s wr, 41 op/s 2024-05-08T08:17:27.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:27 smithi194 ceph-mon[33679]: pgmap v2894: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 844 KiB/s wr, 41 op/s 2024-05-08T08:17:27.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:27 smithi070 ceph-mon[29591]: pgmap v2894: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 844 KiB/s wr, 41 op/s 2024-05-08T08:17:29.052 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/taskstats.o 2024-05-08T08:17:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:29 smithi172 ceph-mon[33377]: pgmap v2895: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 779 KiB/s wr, 38 op/s 2024-05-08T08:17:29.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:29 smithi194 ceph-mon[33679]: pgmap v2895: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 779 KiB/s wr, 38 op/s 2024-05-08T08:17:29.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:29 smithi070 ceph-mon[29591]: pgmap v2895: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 779 KiB/s wr, 38 op/s 2024-05-08T08:17:31.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:31 smithi172 ceph-mon[33377]: pgmap v2896: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 1.0 MiB/s wr, 47 op/s 2024-05-08T08:17:31.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:31 smithi194 ceph-mon[33679]: pgmap v2896: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 1.0 MiB/s wr, 47 op/s 2024-05-08T08:17:31.509 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/pci_iomap.o 2024-05-08T08:17:31.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:31 smithi070 ceph-mon[29591]: pgmap v2896: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 864 KiB/s rd, 1.0 MiB/s wr, 47 op/s 2024-05-08T08:17:31.699 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/sch_mq.o 2024-05-08T08:17:33.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:33 smithi172 ceph-mon[33377]: pgmap v2897: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 583 KiB/s wr, 22 op/s 2024-05-08T08:17:33.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:33 smithi194 ceph-mon[33679]: pgmap v2897: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 583 KiB/s wr, 22 op/s 2024-05-08T08:17:33.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:33 smithi070 ceph-mon[29591]: pgmap v2897: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 583 KiB/s wr, 22 op/s 2024-05-08T08:17:34.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:34 smithi194 ceph-mon[33679]: pgmap v2898: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 583 KiB/s wr, 22 op/s 2024-05-08T08:17:34.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:34 smithi070 ceph-mon[29591]: pgmap v2898: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 583 KiB/s wr, 22 op/s 2024-05-08T08:17:34.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:34 smithi172 ceph-mon[33377]: pgmap v2898: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 428 KiB/s rd, 583 KiB/s wr, 22 op/s 2024-05-08T08:17:35.681 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/xdr.o 2024-05-08T08:17:35.736 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exoparg6.o 2024-05-08T08:17:36.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:36 smithi194 ceph-mon[33679]: pgmap v2899: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 773 KiB/s wr, 39 op/s 2024-05-08T08:17:36.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:36 smithi070 ceph-mon[29591]: pgmap v2899: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 773 KiB/s wr, 39 op/s 2024-05-08T08:17:36.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:36 smithi172 ceph-mon[33377]: pgmap v2899: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 773 KiB/s wr, 39 op/s 2024-05-08T08:17:36.885 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/delegation.o 2024-05-08T08:17:36.891 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/clnt4xdr.o 2024-05-08T08:17:38.294 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nls/nls_base.o 2024-05-08T08:17:38.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:38 smithi194 ceph-mon[33679]: pgmap v2900: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 463 KiB/s wr, 26 op/s 2024-05-08T08:17:38.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:38 smithi070 ceph-mon[29591]: pgmap v2900: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 463 KiB/s wr, 26 op/s 2024-05-08T08:17:38.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:38 smithi172 ceph-mon[33377]: pgmap v2900: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 463 KiB/s wr, 26 op/s 2024-05-08T08:17:39.867 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/iomap_copy.o 2024-05-08T08:17:39.902 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/tsacct.o 2024-05-08T08:17:40.476 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:40 smithi172 ceph-mon[33377]: pgmap v2901: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 741 KiB/s wr, 40 op/s 2024-05-08T08:17:40.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:40 smithi194 ceph-mon[33679]: pgmap v2901: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 741 KiB/s wr, 40 op/s 2024-05-08T08:17:40.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:40 smithi070 ceph-mon[29591]: pgmap v2901: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 741 KiB/s wr, 40 op/s 2024-05-08T08:17:42.021 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exprep.o 2024-05-08T08:17:42.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:42 smithi194 ceph-mon[33679]: pgmap v2902: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 468 KiB/s wr, 31 op/s 2024-05-08T08:17:42.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:42 smithi070 ceph-mon[29591]: pgmap v2902: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 468 KiB/s wr, 31 op/s 2024-05-08T08:17:42.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:42 smithi172 ceph-mon[33377]: pgmap v2902: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 468 KiB/s wr, 31 op/s 2024-05-08T08:17:42.882 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/sch_frag.o 2024-05-08T08:17:43.500 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/devres.o 2024-05-08T08:17:44.443 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nls/nls_cp437.o 2024-05-08T08:17:44.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:44 smithi194 ceph-mon[33679]: pgmap v2903: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 468 KiB/s wr, 31 op/s 2024-05-08T08:17:44.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:44 smithi070 ceph-mon[29591]: pgmap v2903: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 468 KiB/s wr, 31 op/s 2024-05-08T08:17:44.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:44 smithi172 ceph-mon[33377]: pgmap v2903: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 468 KiB/s wr, 31 op/s 2024-05-08T08:17:46.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:46 smithi194 ceph-mon[33679]: pgmap v2904: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 702 KiB/s wr, 42 op/s 2024-05-08T08:17:46.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:46 smithi070 ceph-mon[29591]: pgmap v2904: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 702 KiB/s wr, 42 op/s 2024-05-08T08:17:46.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:46 smithi172 ceph-mon[33377]: pgmap v2904: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 702 KiB/s wr, 42 op/s 2024-05-08T08:17:47.768 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/tracepoint.o 2024-05-08T08:17:48.229 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/irq_work.o 2024-05-08T08:17:48.401 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exregion.o 2024-05-08T08:17:48.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:48 smithi194 ceph-mon[33679]: pgmap v2905: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 512 KiB/s wr, 25 op/s 2024-05-08T08:17:48.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:48 smithi070 ceph-mon[29591]: pgmap v2905: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 512 KiB/s wr, 25 op/s 2024-05-08T08:17:48.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:48 smithi172 ceph-mon[33377]: pgmap v2905: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 512 KiB/s wr, 25 op/s 2024-05-08T08:17:49.160 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/xdr4.o 2024-05-08T08:17:49.983 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4idmap.o 2024-05-08T08:17:50.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:50 smithi194 ceph-mon[33679]: pgmap v2906: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 699 KiB/s wr, 45 op/s 2024-05-08T08:17:50.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:50 smithi070 ceph-mon[29591]: pgmap v2906: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 699 KiB/s wr, 45 op/s 2024-05-08T08:17:50.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:50 smithi172 ceph-mon[33377]: pgmap v2906: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 699 KiB/s wr, 45 op/s 2024-05-08T08:17:51.149 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.3 2024-05-08T08:17:51.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:17:51.553 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nls/nls_ascii.o 2024-05-08T08:17:51.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:17:51.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:17:51.743 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:17:51.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:17:52.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:52 smithi070 ceph-mon[29591]: pgmap v2907: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 420 KiB/s wr, 31 op/s 2024-05-08T08:17:52.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:52 smithi172 ceph-mon[33377]: pgmap v2907: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 420 KiB/s wr, 31 op/s 2024-05-08T08:17:52.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:52 smithi194 ceph-mon[33679]: pgmap v2907: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 420 KiB/s wr, 31 op/s 2024-05-08T08:17:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:52.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:53.193 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/check_signature.o 2024-05-08T08:17:54.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.225+0000 7fc91ea00700 1 -- 172.21.15.70:0/2633657070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc918105f90 msgr2=0x7fc9181124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:17:54.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.225+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2633657070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc918105f90 0x7fc9181124a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc910009f90 tx=0x7fc91000b330 comp rx=0 tx=0).stop 2024-05-08T08:17:54.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.225+0000 7fc91ea00700 1 -- 172.21.15.70:0/2633657070 shutdown_connections 2024-05-08T08:17:54.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.225+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2633657070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc918105f90 0x7fc9181124a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:17:54.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.225+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2633657070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc91810b660 0x7fc91810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:17:54.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.225+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2633657070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9181055d0 0x7fc918105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:17:54.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.225+0000 7fc91ea00700 1 -- 172.21.15.70:0/2633657070 >> 172.21.15.70:0/2633657070 conn(0x7fc918101080 msgr2=0x7fc9181034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:17:54.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.226+0000 7fc91ea00700 1 -- 172.21.15.70:0/2633657070 shutdown_connections 2024-05-08T08:17:54.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.226+0000 7fc91ea00700 1 -- 172.21.15.70:0/2633657070 wait complete. 2024-05-08T08:17:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:54 smithi070 ceph-mon[29591]: pgmap v2908: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 420 KiB/s wr, 31 op/s 2024-05-08T08:17:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:54.221 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.227+0000 7fc91ea00700 1 Processor -- start 2024-05-08T08:17:54.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.227+0000 7fc91ea00700 1 -- start start 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.228+0000 7fc91ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9181055d0 0x7fc9181a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.228+0000 7fc91ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc918105f90 0x7fc9181a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.228+0000 7fc91ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc91810b660 0x7fc91819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.228+0000 7fc91ea00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9181156d0 con 0x7fc91810b660 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.228+0000 7fc91ea00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc918115550 con 0x7fc9181055d0 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.228+0000 7fc91ea00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc918115850 con 0x7fc918105f90 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.228+0000 7fc91cc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc918105f90 0x7fc9181a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.229+0000 7fc91e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc91810b660 0x7fc91819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.229+0000 7fc91e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc91810b660 0x7fc91819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50798/0 (socket says 172.21.15.70:50798) 2024-05-08T08:17:54.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.229+0000 7fc91cc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc918105f90 0x7fc9181a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:52696/0 (socket says 172.21.15.70:52696) 2024-05-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.229+0000 7fc91cc00700 1 -- 172.21.15.70:0/2745181076 learned_addr learned my addr 172.21.15.70:0/2745181076 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.229+0000 7fc91d600700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9181055d0 0x7fc9181a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.229+0000 7fc91e000700 1 -- 172.21.15.70:0/2745181076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc918105f90 msgr2=0x7fc9181a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.230+0000 7fc91e000700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc918105f90 0x7fc9181a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.230+0000 7fc91e000700 1 -- 172.21.15.70:0/2745181076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9181055d0 msgr2=0x7fc9181a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.230+0000 7fc91e000700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9181055d0 0x7fc9181a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:17:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.230+0000 7fc91e000700 1 -- 172.21.15.70:0/2745181076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91819c0f0 con 0x7fc91810b660 2024-05-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.230+0000 7fc91e000700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc91810b660 0x7fc91819b990 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc91000b6c0 tx=0x7fc91000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.231+0000 7fc916000700 1 -- 172.21.15.70:0/2745181076 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91001f030 con 0x7fc91810b660 2024-05-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.231+0000 7fc916000700 1 -- 172.21.15.70:0/2745181076 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc91000be40 con 0x7fc91810b660 2024-05-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.231+0000 7fc916000700 1 -- 172.21.15.70:0/2745181076 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc910005990 con 0x7fc91810b660 2024-05-08T08:17:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.231+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91819c380 con 0x7fc91810b660 2024-05-08T08:17:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.232+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9181a8650 con 0x7fc91810b660 2024-05-08T08:17:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.233+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc918106d10 con 0x7fc91810b660 2024-05-08T08:17:54.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.236+0000 7fc916000700 1 -- 172.21.15.70:0/2745181076 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc910022030 con 0x7fc91810b660 2024-05-08T08:17:54.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.238+0000 7fc916000700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc9000b2aa0 0x7fc9000b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:17:54.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.239+0000 7fc916000700 1 -- 172.21.15.70:0/2745181076 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(259..259 src has 1..259) ==== 9583+0+0 (secure 0 0 0) 0x7fc91000f020 con 0x7fc91810b660 2024-05-08T08:17:54.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.239+0000 7fc91d600700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc9000b2aa0 0x7fc9000b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:17:54.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.240+0000 7fc91d600700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc9000b2aa0 0x7fc9000b4f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc91810a790 tx=0x7fc90c009310 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:17:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.245+0000 7fc916000700 1 -- 172.21.15.70:0/2745181076 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc910029020 con 0x7fc91810b660 2024-05-08T08:17:54.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:54 smithi194 ceph-mon[33679]: pgmap v2908: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 420 KiB/s wr, 31 op/s 2024-05-08T08:17:54.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:54.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:54.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:54 smithi172 ceph-mon[33377]: pgmap v2908: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 420 KiB/s wr, 31 op/s 2024-05-08T08:17:54.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:54.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:54.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.704+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc91802e510 con 0x7fc91810b660 2024-05-08T08:17:54.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.705+0000 7fc916000700 1 -- 172.21.15.70:0/2745181076 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fc9100aadc0 con 0x7fc91810b660 2024-05-08T08:17:54.699 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:17:54.700 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:17:54.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.709+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc9000b2aa0 msgr2=0x7fc9000b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:17:54.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.709+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc9000b2aa0 0x7fc9000b4f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc91810a790 tx=0x7fc90c009310 comp rx=0 tx=0).stop 2024-05-08T08:17:54.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.709+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc91810b660 msgr2=0x7fc91819b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:17:54.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.709+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc91810b660 0x7fc91819b990 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc91000b6c0 tx=0x7fc91000bc20 comp rx=0 tx=0).stop 2024-05-08T08:17:54.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.710+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 shutdown_connections 2024-05-08T08:17:54.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.710+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc9000b2aa0 0x7fc9000b4f60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:17:54.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.710+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc91810b660 0x7fc91819b990 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:17:54.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.710+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc9181055d0 0x7fc9181a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:17:54.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.710+0000 7fc91ea00700 1 --2- 172.21.15.70:0/2745181076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc918105f90 0x7fc9181a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:17:54.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.710+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 >> 172.21.15.70:0/2745181076 conn(0x7fc918101080 msgr2=0x7fc918102790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:17:54.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.711+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 shutdown_connections 2024-05-08T08:17:54.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:17:54.711+0000 7fc91ea00700 1 -- 172.21.15.70:0/2745181076 wait complete. 2024-05-08T08:17:54.706 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:17:55.268 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exresnte.o 2024-05-08T08:17:55.660 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 86.3 --await-for 42.0' 2024-05-08T08:17:55.660 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 86.3 --await-for 42.0 2024-05-08T08:17:55.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:55.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:55.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:17:55.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:17:55.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:55.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:55 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2745181076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:17:55.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:55.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:55.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:17:55.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:17:55.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:55.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:55 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2745181076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:17:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:17:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:17:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:17:56.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:55 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2745181076' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:17:56.245 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:17:56.570 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/svc4proc.o 2024-05-08T08:17:56.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:56 smithi070 ceph-mon[29591]: pgmap v2909: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 613 KiB/s wr, 39 op/s 2024-05-08T08:17:56.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:56 smithi172 ceph-mon[33377]: pgmap v2909: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 613 KiB/s wr, 39 op/s 2024-05-08T08:17:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:56 smithi194 ceph-mon[33679]: pgmap v2909: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 613 KiB/s wr, 39 op/s 2024-05-08T08:17:57.096 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/sch_api.o 2024-05-08T08:17:57.158 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/static_call.o 2024-05-08T08:17:57.678 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/interval_tree.o 2024-05-08T08:17:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:17:58 smithi070 ceph-mon[29591]: pgmap v2910: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 380 KiB/s wr, 28 op/s 2024-05-08T08:17:58.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:17:58 smithi172 ceph-mon[33377]: pgmap v2910: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 380 KiB/s wr, 28 op/s 2024-05-08T08:17:59.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:17:58 smithi194 ceph-mon[33679]: pgmap v2910: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 380 KiB/s wr, 28 op/s 2024-05-08T08:17:59.258 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nls/nls_iso8859-1.o 2024-05-08T08:18:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.686+0000 7f074bc00700 1 -- 172.21.15.70:0/1990561327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0744108450 msgr2=0x7f0744105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:00.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.686+0000 7f074bc00700 1 --2- 172.21.15.70:0/1990561327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0744108450 0x7f0744105f00 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f0738009990 tx=0x7f0738009ca0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.686+0000 7f074bc00700 1 -- 172.21.15.70:0/1990561327 shutdown_connections 2024-05-08T08:18:00.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.686+0000 7f074bc00700 1 --2- 172.21.15.70:0/1990561327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f074406b1a0 0x7f074406b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.686+0000 7f074bc00700 1 --2- 172.21.15.70:0/1990561327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0744108450 0x7f0744105f00 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.686+0000 7f074bc00700 1 --2- 172.21.15.70:0/1990561327 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0744106440 0x7f07441068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.686+0000 7f074bc00700 1 -- 172.21.15.70:0/1990561327 >> 172.21.15.70:0/1990561327 conn(0x7f0744079340 msgr2=0x7f0744079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:00.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.687+0000 7f074bc00700 1 -- 172.21.15.70:0/1990561327 shutdown_connections 2024-05-08T08:18:00.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.687+0000 7f074bc00700 1 -- 172.21.15.70:0/1990561327 wait complete. 2024-05-08T08:18:00.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.688+0000 7f074bc00700 1 Processor -- start 2024-05-08T08:18:00.683 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:00 smithi070 ceph-mon[29591]: pgmap v2911: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 734 KiB/s wr, 48 op/s 2024-05-08T08:18:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.688+0000 7f074bc00700 1 -- start start 2024-05-08T08:18:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.689+0000 7f074bc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f074406b1a0 0x7f074419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.689+0000 7f074bc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0744106440 0x7f07441a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.689+0000 7f074bc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744108450 0x7f07441a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.689+0000 7f074bc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0744119b50 con 0x7f0744106440 2024-05-08T08:18:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.689+0000 7f074bc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f07441199d0 con 0x7f074406b1a0 2024-05-08T08:18:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.689+0000 7f074bc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0744119cd0 con 0x7f0744108450 2024-05-08T08:18:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.690+0000 7f0743e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0744106440 0x7f07441a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.690+0000 7f0749200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f074406b1a0 0x7f074419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.690+0000 7f0749200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f074406b1a0 0x7f074419fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:47564/0 (socket says 172.21.15.70:47564) 2024-05-08T08:18:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.690+0000 7f0749200700 1 -- 172.21.15.70:0/3275233298 learned_addr learned my addr 172.21.15.70:0/3275233298 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:00.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.690+0000 7f0749c00700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744108450 0x7f07441a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.691+0000 7f0749200700 1 -- 172.21.15.70:0/3275233298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744108450 msgr2=0x7f07441a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.691+0000 7f0749200700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744108450 0x7f07441a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.691+0000 7f0749200700 1 -- 172.21.15.70:0/3275233298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0744106440 msgr2=0x7f07441a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.691+0000 7f0749200700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0744106440 0x7f07441a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.691+0000 7f0749200700 1 -- 172.21.15.70:0/3275233298 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07441a4e50 con 0x7f074406b1a0 2024-05-08T08:18:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.691+0000 7f0749200700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f074406b1a0 0x7f074419fe40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0738006010 tx=0x7f073800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.692+0000 7f0741600700 1 -- 172.21.15.70:0/3275233298 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738026070 con 0x7f074406b1a0 2024-05-08T08:18:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.692+0000 7f074bc00700 1 -- 172.21.15.70:0/3275233298 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07441a50e0 con 0x7f074406b1a0 2024-05-08T08:18:00.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.692+0000 7f074bc00700 1 -- 172.21.15.70:0/3275233298 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07441ac9c0 con 0x7f074406b1a0 2024-05-08T08:18:00.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.692+0000 7f0741600700 1 -- 172.21.15.70:0/3275233298 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f073800be40 con 0x7f074406b1a0 2024-05-08T08:18:00.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.693+0000 7f0741600700 1 -- 172.21.15.70:0/3275233298 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07380173f0 con 0x7f074406b1a0 2024-05-08T08:18:00.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.699+0000 7f0741600700 1 -- 172.21.15.70:0/3275233298 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f0738009d10 con 0x7f074406b1a0 2024-05-08T08:18:00.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.702+0000 7f0741600700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f072c0b2aa0 0x7f072c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.702+0000 7f0741600700 1 -- 172.21.15.70:0/3275233298 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(259..259 src has 1..259) ==== 9583+0+0 (secure 0 0 0) 0x7f07380e3530 con 0x7f074406b1a0 2024-05-08T08:18:00.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.702+0000 7f0743e00700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f072c0b2aa0 0x7f072c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.703+0000 7f0743e00700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f072c0b2aa0 0x7f072c0b4f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0744102020 tx=0x7f0730009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:00.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.719+0000 7f0756583b80 1 Processor -- start 2024-05-08T08:18:00.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.719+0000 7f0756583b80 1 -- start start 2024-05-08T08:18:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.720+0000 7f0756583b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a93383620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.720+0000 7f0756583b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a9337dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.720+0000 7f0756583b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.720+0000 7f0756583b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559a932cfbb0 con 0x559a9337e1d0 2024-05-08T08:18:00.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.720+0000 7f0756583b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559a9326d8f0 con 0x559a9337d810 2024-05-08T08:18:00.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.720+0000 7f0756583b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559a932cbb70 con 0x559a93383240 2024-05-08T08:18:00.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.720+0000 7f0749c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.721+0000 7f0749c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43208/0 (socket says 172.21.15.70:43208) 2024-05-08T08:18:00.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.721+0000 7f0749c00700 1 -- 172.21.15.70:0/1492067480 learned_addr learned my addr 172.21.15.70:0/1492067480 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:00.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.721+0000 7f0749200700 1 --2- 172.21.15.70:0/1492067480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a93383620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.721+0000 7f0749c00700 1 -- 172.21.15.70:0/1492067480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 msgr2=0x559a93383620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:00.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.721+0000 7f0749c00700 1 --2- 172.21.15.70:0/1492067480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a93383620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.721+0000 7f0749c00700 1 -- 172.21.15.70:0/1492067480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 msgr2=0x559a9337dc90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T08:18:00.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.721+0000 7f0749c00700 1 --2- 172.21.15.70:0/1492067480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a9337dc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.721+0000 7f0749c00700 1 -- 172.21.15.70:0/1492067480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9321ca60 con 0x559a9337e1d0 2024-05-08T08:18:00.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.722+0000 7f0749c00700 1 --2- 172.21.15.70:0/1492067480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338a000 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f073c00a430 tx=0x7f073c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63baeb197a9121b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:00.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.722+0000 7f0736000700 1 -- 172.21.15.70:0/1492067480 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c014620 con 0x559a9337e1d0 2024-05-08T08:18:00.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.722+0000 7f0736000700 1 -- 172.21.15.70:0/1492067480 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f073c019070 con 0x559a9337e1d0 2024-05-08T08:18:00.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.723+0000 7f0736000700 1 -- 172.21.15.70:0/1492067480 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c0139b0 con 0x559a9337e1d0 2024-05-08T08:18:00.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.724+0000 7f0756583b80 1 -- 172.21.15.70:0/1492067480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 msgr2=0x559a9338a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:00.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.724+0000 7f0756583b80 1 --2- 172.21.15.70:0/1492067480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338a000 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f073c00a430 tx=0x7f073c009650 comp rx=0 tx=0).stop 2024-05-08T08:18:00.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.724+0000 7f0756583b80 1 -- 172.21.15.70:0/1492067480 shutdown_connections 2024-05-08T08:18:00.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.724+0000 7f0756583b80 1 --2- 172.21.15.70:0/1492067480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338a000 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.724+0000 7f0756583b80 1 --2- 172.21.15.70:0/1492067480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a93383620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.724+0000 7f0756583b80 1 --2- 172.21.15.70:0/1492067480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a9337dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.724+0000 7f0756583b80 1 -- 172.21.15.70:0/1492067480 >> 172.21.15.70:0/1492067480 conn(0x559a932f5860 msgr2=0x559a93378100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:00.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.724+0000 7f0756583b80 1 -- 172.21.15.70:0/1492067480 shutdown_connections 2024-05-08T08:18:00.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.724+0000 7f0756583b80 1 -- 172.21.15.70:0/1492067480 wait complete. 2024-05-08T08:18:00.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.725+0000 7f0756583b80 1 -- start start 2024-05-08T08:18:00.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.725+0000 7f0756583b80 1 Processor -- start 2024-05-08T08:18:00.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.726+0000 7f0756583b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a9337d810 0x559a93389bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.726+0000 7f0756583b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a93386fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.726+0000 7f0756583b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a93383240 0x559a933874f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.726+0000 7f0756583b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559a9338a600 con 0x559a9337e1d0 2024-05-08T08:18:00.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.726+0000 7f0756583b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559a93235cb0 con 0x559a93383240 2024-05-08T08:18:00.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.726+0000 7f0756583b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559a9338a780 con 0x559a9337d810 2024-05-08T08:18:00.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.726+0000 7f0756583b80 10 client.0 _ll_register_callbacks cb 0x559a93276e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:18:00.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.726+0000 7f0743e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a93386fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0743e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a93386fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43218/0 (socket says 172.21.15.70:43218) 2024-05-08T08:18:00.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0743e00700 1 -- 172.21.15.70:0/1158167811 learned_addr learned my addr 172.21.15.70:0/1158167811 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:00.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0749200700 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a9337d810 0x559a93389bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0749c00700 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a93383240 0x559a933874f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0743e00700 1 -- 172.21.15.70:0/1158167811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a9337d810 msgr2=0x559a93389bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0743e00700 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a9337d810 0x559a93389bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0743e00700 1 -- 172.21.15.70:0/1158167811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a93383240 msgr2=0x559a933874f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0743e00700 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a93383240 0x559a933874f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0743e00700 1 -- 172.21.15.70:0/1158167811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a932955b0 con 0x559a9337e1d0 2024-05-08T08:18:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.727+0000 7f0749c00700 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a93383240 0x559a933874f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:18:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.728+0000 7f0743e00700 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a93386fb0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f073000e7d0 tx=0x7f07300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdd1b45d2df6487 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:00.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.728+0000 7f072aa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:18:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.729+0000 7f072aa00700 1 -- 172.21.15.70:0/1158167811 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730004020 con 0x559a9337e1d0 2024-05-08T08:18:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.729+0000 7f0756583b80 1 -- 172.21.15.70:0/1158167811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f073c019070 con 0x559a9337e1d0 2024-05-08T08:18:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.729+0000 7f072aa00700 1 -- 172.21.15.70:0/1158167811 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(259..259 src has 1..259) ==== 9583+0+0 (secure 0 0 0) 0x7f07300041c0 con 0x559a9337e1d0 2024-05-08T08:18:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.729+0000 7f072aa00700 1 -- 172.21.15.70:0/1158167811 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f073002e050 con 0x559a9337e1d0 2024-05-08T08:18:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.729+0000 7f0756583b80 10 client.17868 fetch_fsmap learned FSMap version 42 2024-05-08T08:18:00.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.729+0000 7f0756583b80 1 -- 172.21.15.70:0/1158167811 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559a93394f00 con 0x559a9337e1d0 2024-05-08T08:18:00.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.730+0000 7f072aa00700 1 -- 172.21.15.70:0/1158167811 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f073c019070 con 0x559a9337e1d0 2024-05-08T08:18:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.732+0000 7f072aa00700 1 -- 172.21.15.70:0/1158167811 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f073001e7d0 con 0x559a9337e1d0 2024-05-08T08:18:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.732+0000 7f0756583b80 10 client.17868 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:18:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.732+0000 7f0756583b80 10 client.17868 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:18:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.732+0000 7f0756583b80 20 client.17868 populate_metadata read hostname 'smithi070' 2024-05-08T08:18:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.732+0000 7f0756583b80 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559a93397490 0x559a93399910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.732+0000 7f0756583b80 4 client.17868 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:18:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.732+0000 7f0756583b80 1 -- 172.21.15.70:0/1158167811 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a9334a2d0 con 0x559a93397490 2024-05-08T08:18:00.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.732+0000 7f0749200700 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559a93397490 0x559a93399910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.733+0000 7f0749200700 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559a93397490 0x559a93399910 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b873544255772d1d server_cookie=f00269719cab57a2 in_seq=0 out_seq=0 2024-05-08T08:18:00.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.733+0000 7f072aa00700 10 client.17868 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:18:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.735+0000 7f072aa00700 1 -- 172.21.15.70:0/1158167811 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559a9334a2d0 con 0x559a93397490 2024-05-08T08:18:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.735+0000 7f072aa00700 10 client.17868 handle_command_reply: tid=0 2024-05-08T08:18:00.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.735+0000 7f0756583b80 1 client.17868 shutdown 2024-05-08T08:18:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.736+0000 7f0756583b80 1 -- 172.21.15.70:0/1158167811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 msgr2=0x559a93386fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.736+0000 7f0756583b80 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a93386fb0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f073000e7d0 tx=0x7f07300047c0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.736+0000 7f0756583b80 1 -- 172.21.15.70:0/1158167811 shutdown_connections 2024-05-08T08:18:00.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.736+0000 7f0756583b80 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559a93397490 0x559a93399910 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.737+0000 7f072aa00700 0 client.17868 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:18:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.737+0000 7f0756583b80 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a93383240 0x559a933874f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.737+0000 7f0756583b80 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a9337d810 0x559a93389bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.737+0000 7f0756583b80 1 --2- 172.21.15.70:0/1158167811 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a93386fb0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.737+0000 7f0756583b80 1 -- 172.21.15.70:0/1158167811 >> 172.21.15.70:0/1158167811 conn(0x559a932f5860 msgr2=0x559a93372bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.737+0000 7f0756583b80 1 -- 172.21.15.70:0/1158167811 shutdown_connections 2024-05-08T08:18:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.737+0000 7f0756583b80 1 -- 172.21.15.70:0/1158167811 wait complete. 2024-05-08T08:18:00.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.737+0000 7f0756583b80 20 client.17868 trim_cache size 0 max 16384 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.773+0000 7f0756583b80 1 Processor -- start 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.774+0000 7f0756583b80 1 -- start start 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.774+0000 7f0756583b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a933936f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.774+0000 7f0756583b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9337c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.774+0000 7f0756583b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9337cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.774+0000 7f0756583b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0724011800 con 0x559a9337e1d0 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.774+0000 7f0756583b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f072400f090 con 0x559a9337d810 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.774+0000 7f0756583b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f072400cf00 con 0x559a93383240 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0743e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9337c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0743e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9337c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43226/0 (socket says 172.21.15.70:43226) 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0749200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a933936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0743e00700 1 -- 172.21.15.70:0/3023864934 learned_addr learned my addr 172.21.15.70:0/3023864934 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0749c00700 1 --2- 172.21.15.70:0/3023864934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9337cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0743e00700 1 -- 172.21.15.70:0/3023864934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 msgr2=0x559a9337cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0743e00700 1 --2- 172.21.15.70:0/3023864934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9337cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0743e00700 1 -- 172.21.15.70:0/3023864934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 msgr2=0x559a933936f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0743e00700 1 --2- 172.21.15.70:0/3023864934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a933936f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.775+0000 7f0743e00700 1 -- 172.21.15.70:0/3023864934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a93374920 con 0x559a9337e1d0 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.776+0000 7f0749c00700 1 --2- 172.21.15.70:0/3023864934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9337cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:18:00.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.776+0000 7f0743e00700 1 --2- 172.21.15.70:0/3023864934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9337c800 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0730009340 tx=0x7f0730011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3c7cc43b556277 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:00.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.776+0000 7f0735600700 1 -- 172.21.15.70:0/3023864934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730036070 con 0x559a9337e1d0 2024-05-08T08:18:00.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.777+0000 7f0735600700 1 -- 172.21.15.70:0/3023864934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0730004040 con 0x559a9337e1d0 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.777+0000 7f0735600700 1 -- 172.21.15.70:0/3023864934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730003990 con 0x559a9337e1d0 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.778+0000 7f0756583b80 1 -- 172.21.15.70:0/3023864934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 msgr2=0x559a9337c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.778+0000 7f0756583b80 1 --2- 172.21.15.70:0/3023864934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9337c800 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f0730009340 tx=0x7f0730011bb0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.778+0000 7f0756583b80 1 -- 172.21.15.70:0/3023864934 shutdown_connections 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.778+0000 7f0756583b80 1 --2- 172.21.15.70:0/3023864934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9337cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.778+0000 7f0756583b80 1 --2- 172.21.15.70:0/3023864934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a933936f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.778+0000 7f0756583b80 1 --2- 172.21.15.70:0/3023864934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9337c800 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.778+0000 7f0756583b80 1 -- 172.21.15.70:0/3023864934 >> 172.21.15.70:0/3023864934 conn(0x559a932f5860 msgr2=0x559a93386f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.778+0000 7f0756583b80 1 -- 172.21.15.70:0/3023864934 shutdown_connections 2024-05-08T08:18:00.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.778+0000 7f0756583b80 1 -- 172.21.15.70:0/3023864934 wait complete. 2024-05-08T08:18:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.779+0000 7f0756583b80 1 -- start start 2024-05-08T08:18:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.779+0000 7f0756583b80 1 Processor -- start 2024-05-08T08:18:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.780+0000 7f0756583b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a933900b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.780+0000 7f0756583b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.780+0000 7f0756583b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9338d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.780+0000 7f0756583b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f072400d550 con 0x559a9337e1d0 2024-05-08T08:18:00.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.780+0000 7f0756583b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f072400e9c0 con 0x559a9337d810 2024-05-08T08:18:00.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.780+0000 7f0756583b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f072400dc20 con 0x559a93383240 2024-05-08T08:18:00.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.780+0000 7f0756583b80 10 client.0 _ll_register_callbacks cb 0x559a93276e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:18:00.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.781+0000 7f0749c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9338d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.781+0000 7f0749c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9338d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:52418/0 (socket says 172.21.15.70:52418) 2024-05-08T08:18:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.781+0000 7f0749c00700 1 -- 172.21.15.70:0/1280780085 learned_addr learned my addr 172.21.15.70:0/1280780085 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.781+0000 7f0743e00700 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.781+0000 7f0749200700 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a933900b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.782+0000 7f0743e00700 1 -- 172.21.15.70:0/1280780085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 msgr2=0x559a9338d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.782+0000 7f0743e00700 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9338d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.782+0000 7f0743e00700 1 -- 172.21.15.70:0/1280780085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 msgr2=0x559a933900b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.782+0000 7f0743e00700 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a933900b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:00.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.782+0000 7f0743e00700 1 -- 172.21.15.70:0/1280780085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a9338d870 con 0x559a9337e1d0 2024-05-08T08:18:00.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.782+0000 7f0743e00700 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338ca40 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f073001ece0 tx=0x7f073001e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfb477f803ab2d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:00.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.782+0000 7f072aa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:18:00.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.783+0000 7f072aa00700 1 -- 172.21.15.70:0/1280780085 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730040060 con 0x559a9337e1d0 2024-05-08T08:18:00.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.783+0000 7f0756583b80 1 -- 172.21.15.70:0/1280780085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0730004040 con 0x559a9337e1d0 2024-05-08T08:18:00.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.783+0000 7f072aa00700 1 -- 172.21.15.70:0/1280780085 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(259..259 src has 1..259) ==== 9583+0+0 (secure 0 0 0) 0x7f0730003680 con 0x559a9337e1d0 2024-05-08T08:18:00.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.783+0000 7f072aa00700 1 -- 172.21.15.70:0/1280780085 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f0730047050 con 0x559a9337e1d0 2024-05-08T08:18:00.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.783+0000 7f0756583b80 10 client.17874 fetch_fsmap learned FSMap version 42 2024-05-08T08:18:00.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.783+0000 7f0756583b80 1 -- 172.21.15.70:0/1280780085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559a93402ef0 con 0x559a9337e1d0 2024-05-08T08:18:00.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.784+0000 7f072aa00700 1 -- 172.21.15.70:0/1280780085 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0730004040 con 0x559a9337e1d0 2024-05-08T08:18:00.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.785+0000 7f072aa00700 1 -- 172.21.15.70:0/1280780085 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f073003b7e0 con 0x559a9337e1d0 2024-05-08T08:18:00.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.785+0000 7f0756583b80 10 client.17874 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:18:00.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.785+0000 7f0756583b80 10 client.17874 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:18:00.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.785+0000 7f0756583b80 20 client.17874 populate_metadata read hostname 'smithi070' 2024-05-08T08:18:00.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.785+0000 7f0756583b80 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559a934035b0 0x559a934059d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:00.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.785+0000 7f0756583b80 4 client.17874 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.3, "await_for": 42.0}] 2024-05-08T08:18:00.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.785+0000 7f0756583b80 1 -- 172.21.15.70:0/1280780085 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.3, "await_for": 42.0}) -- 0x559a93378660 con 0x559a934035b0 2024-05-08T08:18:00.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.786+0000 7f0749200700 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559a934035b0 0x559a934059d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:00.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.787+0000 7f072aa00700 10 client.17874 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:18:00.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:00.787+0000 7f0749200700 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559a934035b0 0x559a934059d0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59929aa6e9858bc0 server_cookie=e64320726905b6ed in_seq=0 out_seq=0 2024-05-08T08:18:00.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:00 smithi172 ceph-mon[33377]: pgmap v2911: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 734 KiB/s wr, 48 op/s 2024-05-08T08:18:01.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:00 smithi194 ceph-mon[33679]: pgmap v2911: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 734 KiB/s wr, 48 op/s 2024-05-08T08:18:02.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:02 smithi070 ceph-mon[29591]: pgmap v2912: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 547 KiB/s wr, 27 op/s 2024-05-08T08:18:02.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:02 smithi172 ceph-mon[33377]: pgmap v2912: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 547 KiB/s wr, 27 op/s 2024-05-08T08:18:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:02 smithi194 ceph-mon[33679]: pgmap v2912: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 547 KiB/s wr, 27 op/s 2024-05-08T08:18:04.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:04 smithi070 ceph-mon[29591]: pgmap v2913: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 547 KiB/s wr, 27 op/s 2024-05-08T08:18:04.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:04 smithi172 ceph-mon[33377]: pgmap v2913: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 547 KiB/s wr, 27 op/s 2024-05-08T08:18:05.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:04 smithi194 ceph-mon[33679]: pgmap v2913: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 547 KiB/s wr, 27 op/s 2024-05-08T08:18:06.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:06 smithi070 ceph-mon[29591]: pgmap v2914: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 733 KiB/s wr, 37 op/s 2024-05-08T08:18:06.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:06 smithi172 ceph-mon[33377]: pgmap v2914: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 733 KiB/s wr, 37 op/s 2024-05-08T08:18:07.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:06 smithi194 ceph-mon[33679]: pgmap v2914: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 733 KiB/s wr, 37 op/s 2024-05-08T08:18:08.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:08 smithi070 ceph-mon[29591]: pgmap v2915: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 539 KiB/s wr, 29 op/s 2024-05-08T08:18:08.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:08 smithi172 ceph-mon[33377]: pgmap v2915: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 539 KiB/s wr, 29 op/s 2024-05-08T08:18:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:08 smithi194 ceph-mon[33679]: pgmap v2915: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 539 KiB/s wr, 29 op/s 2024-05-08T08:18:11.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:11 smithi070 ceph-mon[29591]: pgmap v2916: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 618 KiB/s wr, 48 op/s 2024-05-08T08:18:11.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:11 smithi172 ceph-mon[33377]: pgmap v2916: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 618 KiB/s wr, 48 op/s 2024-05-08T08:18:11.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:11 smithi194 ceph-mon[33679]: pgmap v2916: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 618 KiB/s wr, 48 op/s 2024-05-08T08:18:13.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:13 smithi172 ceph-mon[33377]: pgmap v2917: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:18:13.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:13 smithi194 ceph-mon[33679]: pgmap v2917: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:18:13.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:13 smithi070 ceph-mon[29591]: pgmap v2917: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:18:15.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:15 smithi172 ceph-mon[33377]: pgmap v2918: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:18:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:15 smithi194 ceph-mon[33679]: pgmap v2918: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:18:15.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:15 smithi070 ceph-mon[29591]: pgmap v2918: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:18:17.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:17 smithi172 ceph-mon[33377]: pgmap v2919: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 297 KiB/s wr, 38 op/s 2024-05-08T08:18:17.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:17 smithi194 ceph-mon[33679]: pgmap v2919: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 297 KiB/s wr, 38 op/s 2024-05-08T08:18:17.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:17 smithi070 ceph-mon[29591]: pgmap v2919: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 297 KiB/s wr, 38 op/s 2024-05-08T08:18:19.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:19 smithi172 ceph-mon[33377]: pgmap v2920: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 112 KiB/s wr, 28 op/s 2024-05-08T08:18:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:19 smithi194 ceph-mon[33679]: pgmap v2920: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 112 KiB/s wr, 28 op/s 2024-05-08T08:18:19.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:19 smithi070 ceph-mon[29591]: pgmap v2920: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 112 KiB/s wr, 28 op/s 2024-05-08T08:18:21.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:21 smithi172 ceph-mon[33377]: pgmap v2921: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 137 KiB/s wr, 34 op/s 2024-05-08T08:18:21.426 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:21 smithi070 ceph-mon[29591]: pgmap v2921: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 137 KiB/s wr, 34 op/s 2024-05-08T08:18:21.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:21 smithi194 ceph-mon[33679]: pgmap v2921: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 137 KiB/s wr, 34 op/s 2024-05-08T08:18:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:23 smithi172 ceph-mon[33377]: pgmap v2922: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-05-08T08:18:23.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:23 smithi194 ceph-mon[33679]: pgmap v2922: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-05-08T08:18:23.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:23 smithi070 ceph-mon[29591]: pgmap v2922: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-05-08T08:18:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.790+0000 7f072aa00700 1 -- 172.21.15.70:0/1280780085 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x559a93378660 con 0x559a934035b0 2024-05-08T08:18:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.790+0000 7f072aa00700 10 client.17874 handle_command_reply: tid=0 2024-05-08T08:18:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.790+0000 7f0756583b80 1 client.17874 shutdown 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.791+0000 7f0756583b80 1 -- 172.21.15.70:0/1280780085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 msgr2=0x559a9338ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.791+0000 7f0756583b80 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338ca40 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f073001ece0 tx=0x7f073001e8e0 comp rx=0 tx=0).stop 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.791+0000 7f0756583b80 1 -- 172.21.15.70:0/1280780085 shutdown_connections 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.791+0000 7f0756583b80 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559a934035b0 0x559a934059d0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.791+0000 7f0756583b80 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559a93383240 0x559a9338d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.791+0000 7f0756583b80 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559a9337d810 0x559a933900b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.791+0000 7f0756583b80 1 --2- 172.21.15.70:0/1280780085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559a9337e1d0 0x559a9338ca40 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.791+0000 7f072aa00700 0 client.17874 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.791+0000 7f0756583b80 1 -- 172.21.15.70:0/1280780085 >> 172.21.15.70:0/1280780085 conn(0x559a932f5860 msgr2=0x559a93372340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.792+0000 7f0756583b80 1 -- 172.21.15.70:0/1280780085 shutdown_connections 2024-05-08T08:18:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.792+0000 7f0756583b80 1 -- 172.21.15.70:0/1280780085 wait complete. 2024-05-08T08:18:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.792+0000 7f0756583b80 20 client.17874 trim_cache size 0 max 16384 2024-05-08T08:18:23.786 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:18:23.786 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:18:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:18:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 210, 2024-05-08T08:18:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:18:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "8f2db9a9": { 2024-05-08T08:18:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 210, 2024-05-08T08:18:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:18:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:18:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:18:23.787 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.3, 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:18:23.788 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:18:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.793+0000 7f074bc00700 1 -- 172.21.15.70:0/3275233298 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f072c0b2aa0 msgr2=0x7f072c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.793+0000 7f074bc00700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f072c0b2aa0 0x7f072c0b4f60 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0744102020 tx=0x7f0730009260 comp rx=0 tx=0).stop 2024-05-08T08:18:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.793+0000 7f074bc00700 1 -- 172.21.15.70:0/3275233298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f074406b1a0 msgr2=0x7f074419fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.793+0000 7f074bc00700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f074406b1a0 0x7f074419fe40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0738006010 tx=0x7f073800f690 comp rx=0 tx=0).stop 2024-05-08T08:18:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.795+0000 7f074bc00700 1 -- 172.21.15.70:0/3275233298 shutdown_connections 2024-05-08T08:18:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.795+0000 7f074bc00700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f072c0b2aa0 0x7f072c0b4f60 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.795+0000 7f074bc00700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744108450 0x7f07441a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.795+0000 7f074bc00700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f074406b1a0 0x7f074419fe40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.795+0000 7f074bc00700 1 --2- 172.21.15.70:0/3275233298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0744106440 0x7f07441a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.795+0000 7f074bc00700 1 -- 172.21.15.70:0/3275233298 >> 172.21.15.70:0/3275233298 conn(0x7f0744079340 msgr2=0x7f0744100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.795+0000 7f074bc00700 1 -- 172.21.15.70:0/3275233298 shutdown_connections 2024-05-08T08:18:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:23.795+0000 7f074bc00700 1 -- 172.21.15.70:0/3275233298 wait complete. 2024-05-08T08:18:24.660 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8f2db9a9', quiesce took 33.5 seconds. Will release after: 26.3 2024-05-08T08:18:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:25 smithi172 ceph-mon[33377]: pgmap v2923: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-05-08T08:18:25.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:25 smithi194 ceph-mon[33679]: pgmap v2923: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-05-08T08:18:25.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:25 smithi070 ceph-mon[29591]: pgmap v2923: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 58 KiB/s wr, 15 op/s 2024-05-08T08:18:26.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:26 smithi194 ceph-mon[33679]: osdmap e260: 12 total, 12 up, 12 in 2024-05-08T08:18:26.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:26 smithi194 ceph-mon[33679]: pgmap v2925: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 148 KiB/s wr, 11 op/s 2024-05-08T08:18:26.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:26 smithi070 ceph-mon[29591]: osdmap e260: 12 total, 12 up, 12 in 2024-05-08T08:18:26.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:26 smithi070 ceph-mon[29591]: pgmap v2925: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 148 KiB/s wr, 11 op/s 2024-05-08T08:18:26.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:26 smithi172 ceph-mon[33377]: osdmap e260: 12 total, 12 up, 12 in 2024-05-08T08:18:26.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:26 smithi172 ceph-mon[33377]: pgmap v2925: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 148 KiB/s wr, 11 op/s 2024-05-08T08:18:28.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:28 smithi070 ceph-mon[29591]: pgmap v2926: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 148 KiB/s wr, 11 op/s 2024-05-08T08:18:28.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:28 smithi172 ceph-mon[33377]: pgmap v2926: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 148 KiB/s wr, 11 op/s 2024-05-08T08:18:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:28 smithi194 ceph-mon[33679]: pgmap v2926: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 148 KiB/s wr, 11 op/s 2024-05-08T08:18:30.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:30 smithi070 ceph-mon[29591]: pgmap v2927: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 147 KiB/s wr, 9 op/s 2024-05-08T08:18:30.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:30 smithi172 ceph-mon[33377]: pgmap v2927: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 147 KiB/s wr, 9 op/s 2024-05-08T08:18:30.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:30 smithi194 ceph-mon[33679]: pgmap v2927: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 147 KiB/s wr, 9 op/s 2024-05-08T08:18:32.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:32 smithi070 ceph-mon[29591]: pgmap v2928: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 147 KiB/s wr, 9 op/s 2024-05-08T08:18:32.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:32 smithi172 ceph-mon[33377]: pgmap v2928: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 147 KiB/s wr, 9 op/s 2024-05-08T08:18:32.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:32 smithi194 ceph-mon[33679]: pgmap v2928: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 147 KiB/s wr, 9 op/s 2024-05-08T08:18:35.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:35 smithi172 ceph-mon[33377]: pgmap v2929: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 147 KiB/s wr, 9 op/s 2024-05-08T08:18:35.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:35 smithi172 ceph-mon[33377]: osdmap e261: 12 total, 12 up, 12 in 2024-05-08T08:18:35.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:35 smithi194 ceph-mon[33679]: pgmap v2929: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 147 KiB/s wr, 9 op/s 2024-05-08T08:18:35.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:35 smithi194 ceph-mon[33679]: osdmap e261: 12 total, 12 up, 12 in 2024-05-08T08:18:35.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:35 smithi070 ceph-mon[29591]: pgmap v2929: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 147 KiB/s wr, 9 op/s 2024-05-08T08:18:35.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:35 smithi070 ceph-mon[29591]: osdmap e261: 12 total, 12 up, 12 in 2024-05-08T08:18:37.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:37 smithi172 ceph-mon[33377]: pgmap v2931: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 100 KiB/s wr, 9 op/s 2024-05-08T08:18:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:37 smithi194 ceph-mon[33679]: pgmap v2931: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 100 KiB/s wr, 9 op/s 2024-05-08T08:18:37.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:37 smithi070 ceph-mon[29591]: pgmap v2931: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 100 KiB/s wr, 9 op/s 2024-05-08T08:18:39.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:39 smithi172 ceph-mon[33377]: pgmap v2932: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 100 KiB/s wr, 9 op/s 2024-05-08T08:18:39.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:39 smithi194 ceph-mon[33679]: pgmap v2932: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 100 KiB/s wr, 9 op/s 2024-05-08T08:18:39.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:39 smithi070 ceph-mon[29591]: pgmap v2932: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 100 KiB/s wr, 9 op/s 2024-05-08T08:18:41.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:41 smithi172 ceph-mon[33377]: pgmap v2933: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:18:41.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:41 smithi194 ceph-mon[33679]: pgmap v2933: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:18:41.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:41 smithi070 ceph-mon[29591]: pgmap v2933: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:18:43.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:43 smithi172 ceph-mon[33377]: pgmap v2934: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:18:43.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:43 smithi194 ceph-mon[33679]: pgmap v2934: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:18:43.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:43 smithi070 ceph-mon[29591]: pgmap v2934: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:18:45.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:45 smithi172 ceph-mon[33377]: pgmap v2935: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:18:45.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:45 smithi194 ceph-mon[33679]: pgmap v2935: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:18:45.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:45 smithi070 ceph-mon[29591]: pgmap v2935: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:18:47.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:47 smithi172 ceph-mon[33377]: pgmap v2936: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 5 op/s 2024-05-08T08:18:47.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:47 smithi194 ceph-mon[33679]: pgmap v2936: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 5 op/s 2024-05-08T08:18:47.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:47 smithi070 ceph-mon[29591]: pgmap v2936: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 5 op/s 2024-05-08T08:18:48.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:48 smithi194 ceph-mon[33679]: pgmap v2937: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2024-05-08T08:18:48.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:48 smithi070 ceph-mon[29591]: pgmap v2937: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2024-05-08T08:18:48.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:48 smithi172 ceph-mon[33377]: pgmap v2937: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 5 op/s 2024-05-08T08:18:50.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:50 smithi070 ceph-mon[29591]: pgmap v2938: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-05-08T08:18:50.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:50 smithi172 ceph-mon[33377]: pgmap v2938: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-05-08T08:18:50.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:50 smithi194 ceph-mon[33679]: pgmap v2938: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 7 op/s 2024-05-08T08:18:50.961 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:18:51.413 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:18:52.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:52 smithi070 ceph-mon[29591]: pgmap v2939: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2024-05-08T08:18:52.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:52 smithi172 ceph-mon[33377]: pgmap v2939: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2024-05-08T08:18:52.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:52 smithi194 ceph-mon[33679]: pgmap v2939: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2024-05-08T08:18:53.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.734+0000 7f553d000700 1 -- 172.21.15.70:0/3493969844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 msgr2=0x7f5538112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:53.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.734+0000 7f553d000700 1 --2- 172.21.15.70:0/3493969844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 0x7f5538112340 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f553000b0a0 tx=0x7f553000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:18:53.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.734+0000 7f553d000700 1 -- 172.21.15.70:0/3493969844 shutdown_connections 2024-05-08T08:18:53.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.734+0000 7f553d000700 1 --2- 172.21.15.70:0/3493969844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 0x7f5538112340 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:53.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.734+0000 7f553d000700 1 --2- 172.21.15.70:0/3493969844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553806b1b0 0x7f553806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:53.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.734+0000 7f553d000700 1 --2- 172.21.15.70:0/3493969844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f553806bad0 0x7f553810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:53.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.734+0000 7f553d000700 1 -- 172.21.15.70:0/3493969844 >> 172.21.15.70:0/3493969844 conn(0x7f5538079350 msgr2=0x7f5538079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:53.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.734+0000 7f553d000700 1 -- 172.21.15.70:0/3493969844 shutdown_connections 2024-05-08T08:18:53.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.735+0000 7f553d000700 1 -- 172.21.15.70:0/3493969844 wait complete. 2024-05-08T08:18:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.736+0000 7f553d000700 1 Processor -- start 2024-05-08T08:18:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.736+0000 7f553d000700 1 -- start start 2024-05-08T08:18:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.736+0000 7f553d000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f553806b1b0 0x7f55381a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.736+0000 7f553d000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553806bad0 0x7f55381a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.736+0000 7f553d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 0x7f553819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:53.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.736+0000 7f553d000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5538115720 con 0x7f553810ff50 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.736+0000 7f553d000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f55381155a0 con 0x7f553806b1b0 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.736+0000 7f553d000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f55381158a0 con 0x7f553806bad0 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f5536800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 0x7f553819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f5536800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 0x7f553819baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50804/0 (socket says 172.21.15.70:50804) 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f5536800700 1 -- 172.21.15.70:0/3014404416 learned_addr learned my addr 172.21.15.70:0/3014404416 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f5535e00700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f553806b1b0 0x7f55381a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f552d400700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553806bad0 0x7f55381a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f5536800700 1 -- 172.21.15.70:0/3014404416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553806bad0 msgr2=0x7f55381a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f5536800700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553806bad0 0x7f55381a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f5536800700 1 -- 172.21.15.70:0/3014404416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f553806b1b0 msgr2=0x7f55381a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f5536800700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f553806b1b0 0x7f55381a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.737+0000 7f5536800700 1 -- 172.21.15.70:0/3014404416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f553819c200 con 0x7f553810ff50 2024-05-08T08:18:53.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.738+0000 7f5536800700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 0x7f553819baa0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f553000b780 tx=0x7f5530004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.738+0000 7f552f400700 1 -- 172.21.15.70:0/3014404416 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530021070 con 0x7f553810ff50 2024-05-08T08:18:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.738+0000 7f552f400700 1 -- 172.21.15.70:0/3014404416 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5530007b80 con 0x7f553810ff50 2024-05-08T08:18:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.738+0000 7f552f400700 1 -- 172.21.15.70:0/3014404416 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530005040 con 0x7f553810ff50 2024-05-08T08:18:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.738+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f553819c490 con 0x7f553810ff50 2024-05-08T08:18:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.738+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55381a87b0 con 0x7f553810ff50 2024-05-08T08:18:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.740+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55381029c0 con 0x7f553810ff50 2024-05-08T08:18:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.742+0000 7f552f400700 1 -- 172.21.15.70:0/3014404416 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5530024070 con 0x7f553810ff50 2024-05-08T08:18:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.745+0000 7f552f400700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f551c0b29f0 0x7f551c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.745+0000 7f552f400700 1 -- 172.21.15.70:0/3014404416 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(261..261 src has 1..261) ==== 9583+0+0 (secure 0 0 0) 0x7f553000f020 con 0x7f553810ff50 2024-05-08T08:18:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.745+0000 7f5535e00700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f551c0b29f0 0x7f551c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.746+0000 7f5535e00700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f551c0b29f0 0x7f551c0b4eb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f553819cbe0 tx=0x7f5528009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:53.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:53.748+0000 7f552f400700 1 -- 172.21.15.70:0/3014404416 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f553002b020 con 0x7f553810ff50 2024-05-08T08:18:54.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.038+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f553802e510 con 0x7f553810ff50 2024-05-08T08:18:54.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.039+0000 7f552f400700 1 -- 172.21.15.70:0/3014404416 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f55300ab8e0 con 0x7f553810ff50 2024-05-08T08:18:54.032 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:18:54.032 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:18:54.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f551c0b29f0 msgr2=0x7f551c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:54.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f551c0b29f0 0x7f551c0b4eb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f553819cbe0 tx=0x7f5528009260 comp rx=0 tx=0).stop 2024-05-08T08:18:54.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 msgr2=0x7f553819baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:54.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 0x7f553819baa0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f553000b780 tx=0x7f5530004d00 comp rx=0 tx=0).stop 2024-05-08T08:18:54.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 shutdown_connections 2024-05-08T08:18:54.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f551c0b29f0 0x7f551c0b4eb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:54.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f553810ff50 0x7f553819baa0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:54.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f553806b1b0 0x7f55381a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:54.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 --2- 172.21.15.70:0/3014404416 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f553806bad0 0x7f55381a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:54.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.042+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 >> 172.21.15.70:0/3014404416 conn(0x7f5538079350 msgr2=0x7f5538111460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:54.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.043+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 shutdown_connections 2024-05-08T08:18:54.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:54.043+0000 7f553d000700 1 -- 172.21.15.70:0/3014404416 wait complete. 2024-05-08T08:18:54.037 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:18:54.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:54 smithi070 ceph-mon[29591]: pgmap v2940: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2024-05-08T08:18:54.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:54 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3014404416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:18:54.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:54 smithi172 ceph-mon[33377]: pgmap v2940: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2024-05-08T08:18:54.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:54 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3014404416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:18:54.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:54 smithi194 ceph-mon[33679]: pgmap v2940: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 5 op/s 2024-05-08T08:18:54.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:54 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3014404416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:18:54.867 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 8f2db9a9 --release --await' 2024-05-08T08:18:54.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 8f2db9a9 --release --await 2024-05-08T08:18:55.331 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:18:55.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:18:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:18:55.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:18:56.524 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:56 smithi070 ceph-mon[29591]: pgmap v2941: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 7 op/s 2024-05-08T08:18:56.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:56 smithi172 ceph-mon[33377]: pgmap v2941: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 7 op/s 2024-05-08T08:18:56.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:56 smithi194 ceph-mon[33679]: pgmap v2941: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 7 op/s 2024-05-08T08:18:57.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.946+0000 7fe398800700 1 -- 172.21.15.70:0/2734219684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103550 msgr2=0x7fe3901039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:57.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.946+0000 7fe398800700 1 --2- 172.21.15.70:0/2734219684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103550 0x7fe3901039b0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fe380009990 tx=0x7fe380009ca0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.947+0000 7fe398800700 1 -- 172.21.15.70:0/2734219684 shutdown_connections 2024-05-08T08:18:57.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.947+0000 7fe398800700 1 --2- 172.21.15.70:0/2734219684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390103ef0 0x7fe3901103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.947+0000 7fe398800700 1 --2- 172.21.15.70:0/2734219684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390108460 0x7fe390108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.947+0000 7fe398800700 1 --2- 172.21.15.70:0/2734219684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103550 0x7fe3901039b0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.947+0000 7fe398800700 1 -- 172.21.15.70:0/2734219684 >> 172.21.15.70:0/2734219684 conn(0x7fe39007a600 msgr2=0x7fe39007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:57.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.947+0000 7fe398800700 1 -- 172.21.15.70:0/2734219684 shutdown_connections 2024-05-08T08:18:57.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.947+0000 7fe398800700 1 -- 172.21.15.70:0/2734219684 wait complete. 2024-05-08T08:18:57.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.948+0000 7fe398800700 1 Processor -- start 2024-05-08T08:18:57.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.948+0000 7fe398800700 1 -- start start 2024-05-08T08:18:57.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.948+0000 7fe398800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390103550 0x7fe3900757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.948+0000 7fe398800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103ef0 0x7fe390075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe398800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390108460 0x7fe390076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe398800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901135c0 con 0x7fe390103ef0 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe398800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe390113440 con 0x7fe390103550 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe398800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe390113740 con 0x7fe390108460 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe395400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103ef0 0x7fe390075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe395400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103ef0 0x7fe390075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36566/0 (socket says 172.21.15.70:36566) 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe395400700 1 -- 172.21.15.70:0/2129411891 learned_addr learned my addr 172.21.15.70:0/2129411891 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe395e00700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390103550 0x7fe3900757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe396800700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390108460 0x7fe390076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe395400700 1 -- 172.21.15.70:0/2129411891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390108460 msgr2=0x7fe390076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe395400700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390108460 0x7fe390076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe395400700 1 -- 172.21.15.70:0/2129411891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390103550 msgr2=0x7fe3900757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe395400700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390103550 0x7fe3900757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.949+0000 7fe395400700 1 -- 172.21.15.70:0/2129411891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3901a7f70 con 0x7fe390103ef0 2024-05-08T08:18:57.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.950+0000 7fe395400700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103ef0 0x7fe390075ce0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fe380005910 tx=0x7fe3800047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.950+0000 7fe38aa00700 1 -- 172.21.15.70:0/2129411891 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380027070 con 0x7fe390103ef0 2024-05-08T08:18:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.950+0000 7fe38aa00700 1 -- 172.21.15.70:0/2129411891 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe38000fc00 con 0x7fe390103ef0 2024-05-08T08:18:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.950+0000 7fe398800700 1 -- 172.21.15.70:0/2129411891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3901a8200 con 0x7fe390103ef0 2024-05-08T08:18:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.950+0000 7fe38aa00700 1 -- 172.21.15.70:0/2129411891 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380022d40 con 0x7fe390103ef0 2024-05-08T08:18:57.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.950+0000 7fe398800700 1 -- 172.21.15.70:0/2129411891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3901a8650 con 0x7fe390103ef0 2024-05-08T08:18:57.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.954+0000 7fe38aa00700 1 -- 172.21.15.70:0/2129411891 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe38002a070 con 0x7fe390103ef0 2024-05-08T08:18:57.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.956+0000 7fe38aa00700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3780b29f0 0x7fe3780b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.956+0000 7fe38aa00700 1 -- 172.21.15.70:0/2129411891 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(261..261 src has 1..261) ==== 9583+0+0 (secure 0 0 0) 0x7fe3800e37b0 con 0x7fe390103ef0 2024-05-08T08:18:57.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.956+0000 7fe395e00700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3780b29f0 0x7fe3780b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.957+0000 7fe395e00700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3780b29f0 0x7fe3780b4eb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe384005fd0 tx=0x7fe384005e50 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.972+0000 7fe3a316fb80 1 Processor -- start 2024-05-08T08:18:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.972+0000 7fe3a316fb80 1 -- start start 2024-05-08T08:18:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.973+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.973+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 0x55fd5b3bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.973+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.973+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd5b30eb20 con 0x55fd5b3bd140 2024-05-08T08:18:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.973+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fd5b2ac860 con 0x55fd5b3c21b0 2024-05-08T08:18:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.973+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fd5b30aae0 con 0x55fd5b3bc780 2024-05-08T08:18:57.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.973+0000 7fe396800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.973+0000 7fe396800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36578/0 (socket says 172.21.15.70:36578) 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.973+0000 7fe396800700 1 -- 172.21.15.70:0/3671701060 learned_addr learned my addr 172.21.15.70:0/3671701060 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.974+0000 7fe395400700 1 --2- 172.21.15.70:0/3671701060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 0x55fd5b3bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.974+0000 7fe395e00700 1 --2- 172.21.15.70:0/3671701060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.974+0000 7fe396800700 1 -- 172.21.15.70:0/3671701060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 msgr2=0x55fd5b3bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.974+0000 7fe396800700 1 --2- 172.21.15.70:0/3671701060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 0x55fd5b3bcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.974+0000 7fe396800700 1 -- 172.21.15.70:0/3671701060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3c21b0 msgr2=0x55fd5b3c2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.974+0000 7fe396800700 1 --2- 172.21.15.70:0/3671701060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.974+0000 7fe396800700 1 -- 172.21.15.70:0/3671701060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd5b25b9d0 con 0x55fd5b3bd140 2024-05-08T08:18:57.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.974+0000 7fe396800700 1 --2- 172.21.15.70:0/3671701060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c8f70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009d30 tx=0x7fe38c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcfa95aadb19805 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:57.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.975+0000 7fe37f400700 1 -- 172.21.15.70:0/3671701060 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c004bb0 con 0x55fd5b3bd140 2024-05-08T08:18:57.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.975+0000 7fe37f400700 1 -- 172.21.15.70:0/3671701060 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe38c004d50 con 0x55fd5b3bd140 2024-05-08T08:18:57.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.975+0000 7fe37f400700 1 -- 172.21.15.70:0/3671701060 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c005020 con 0x55fd5b3bd140 2024-05-08T08:18:57.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.976+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3671701060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bd140 msgr2=0x55fd5b3c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.976+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3671701060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c8f70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009d30 tx=0x7fe38c0077e0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.976+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3671701060 shutdown_connections 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.976+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3671701060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c8f70 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.976+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3671701060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.976+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3671701060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 0x55fd5b3bcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.976+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3671701060 >> 172.21.15.70:0/3671701060 conn(0x55fd5b3347d0 msgr2=0x55fd5b3b7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.976+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3671701060 shutdown_connections 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.976+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3671701060 wait complete. 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.977+0000 7fe3a316fb80 1 -- start start 2024-05-08T08:18:57.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.977+0000 7fe3a316fb80 1 Processor -- start 2024-05-08T08:18:57.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.978+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bc780 0x55fd5b3c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.978+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.978+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.978+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd5b3c9570 con 0x55fd5b3c21b0 2024-05-08T08:18:57.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.978+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fd5b274c20 con 0x55fd5b3bc780 2024-05-08T08:18:57.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.978+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fd5b3c96f0 con 0x55fd5b3bd140 2024-05-08T08:18:57.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.978+0000 7fe3a316fb80 10 client.0 _ll_register_callbacks cb 0x55fd5b2b5d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:18:57.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe396800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe396800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36586/0 (socket says 172.21.15.70:36586) 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe396800700 1 -- 172.21.15.70:0/3739266556 learned_addr learned my addr 172.21.15.70:0/3739266556 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe395400700 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe395e00700 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bc780 0x55fd5b3c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe396800700 1 -- 172.21.15.70:0/3739266556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bd140 msgr2=0x55fd5b3c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe396800700 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe396800700 1 -- 172.21.15.70:0/3739266556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bc780 msgr2=0x55fd5b3c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe396800700 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bc780 0x55fd5b3c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe396800700 1 -- 172.21.15.70:0/3739266556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd5b2d4520 con 0x55fd5b3c21b0 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.979+0000 7fe395400700 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.980+0000 7fe396800700 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c6460 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b010 tx=0x7fe38c0060b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7739919cec2930ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:57.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.980+0000 7fe373e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:18:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.980+0000 7fe373e00700 1 -- 172.21.15.70:0/3739266556 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c025070 con 0x55fd5b3c21b0 2024-05-08T08:18:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.980+0000 7fe373e00700 1 -- 172.21.15.70:0/3739266556 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(261..261 src has 1..261) ==== 9583+0+0 (secure 0 0 0) 0x7fe38c0158b0 con 0x55fd5b3c21b0 2024-05-08T08:18:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.980+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3739266556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe38c004d50 con 0x55fd5b3c21b0 2024-05-08T08:18:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.980+0000 7fe373e00700 1 -- 172.21.15.70:0/3739266556 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe38c031050 con 0x55fd5b3c21b0 2024-05-08T08:18:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.980+0000 7fe3a316fb80 10 client.17892 fetch_fsmap learned FSMap version 42 2024-05-08T08:18:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.980+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3739266556 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fd5b3d3d30 con 0x55fd5b3c21b0 2024-05-08T08:18:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.981+0000 7fe373e00700 1 -- 172.21.15.70:0/3739266556 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe38c004d50 con 0x55fd5b3c21b0 2024-05-08T08:18:57.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.981+0000 7fe373e00700 1 -- 172.21.15.70:0/3739266556 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe38c01e440 con 0x55fd5b3c21b0 2024-05-08T08:18:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.981+0000 7fe3a316fb80 10 client.17892 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:18:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.981+0000 7fe3a316fb80 10 client.17892 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:18:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.981+0000 7fe3a316fb80 20 client.17892 populate_metadata read hostname 'smithi070' 2024-05-08T08:18:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.981+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd5b3d6260 0x55fd5b3d8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.981+0000 7fe3a316fb80 4 client.17892 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:18:57.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.981+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3739266556 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd5b389240 con 0x55fd5b3d6260 2024-05-08T08:18:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.982+0000 7fe395e00700 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd5b3d6260 0x55fd5b3d8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:57.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.983+0000 7fe395e00700 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd5b3d6260 0x55fd5b3d8650 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=446214f4f514ba90 server_cookie=81d31a578d82b481 in_seq=0 out_seq=0 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.983+0000 7fe373e00700 10 client.17892 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe373e00700 1 -- 172.21.15.70:0/3739266556 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fd5b389240 con 0x55fd5b3d6260 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe373e00700 10 client.17892 handle_command_reply: tid=0 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe3a316fb80 1 client.17892 shutdown 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3739266556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 msgr2=0x55fd5b3c6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c6460 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b010 tx=0x7fe38c0060b0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3739266556 shutdown_connections 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd5b3d6260 0x55fd5b3d8650 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3c6460 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bc780 0x55fd5b3c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe373e00700 0 client.17892 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:18:57.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3739266556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bd140 0x55fd5b3c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.985+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3739266556 >> 172.21.15.70:0/3739266556 conn(0x55fd5b3347d0 msgr2=0x55fd5b3b1b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.986+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3739266556 shutdown_connections 2024-05-08T08:18:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.986+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3739266556 wait complete. 2024-05-08T08:18:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:57.986+0000 7fe3a316fb80 20 client.17892 trim_cache size 0 max 16384 2024-05-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.020+0000 7fe3a316fb80 1 Processor -- start 2024-05-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.020+0000 7fe3a316fb80 1 -- start start 2024-05-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.020+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bc780 0x55fd5b3d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.020+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 0x55fd5b3bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.020+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3ddca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.020+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901b3ee0 con 0x55fd5b3bc780 2024-05-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.020+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901b1770 con 0x55fd5b3bd140 2024-05-08T08:18:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.020+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901af5e0 con 0x55fd5b3c21b0 2024-05-08T08:18:58.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe395e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bc780 0x55fd5b3d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:58.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe395e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bc780 0x55fd5b3d2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36590/0 (socket says 172.21.15.70:36590) 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe395e00700 1 -- 172.21.15.70:0/3189898890 learned_addr learned my addr 172.21.15.70:0/3189898890 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe396800700 1 --2- 172.21.15.70:0/3189898890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3ddca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe395400700 1 --2- 172.21.15.70:0/3189898890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 0x55fd5b3bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe395e00700 1 -- 172.21.15.70:0/3189898890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3c21b0 msgr2=0x55fd5b3ddca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe395e00700 1 --2- 172.21.15.70:0/3189898890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3ddca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe395e00700 1 -- 172.21.15.70:0/3189898890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 msgr2=0x55fd5b3bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe395e00700 1 --2- 172.21.15.70:0/3189898890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 0x55fd5b3bbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.021+0000 7fe395e00700 1 -- 172.21.15.70:0/3189898890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd5b3c5cf0 con 0x55fd5b3bc780 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.022+0000 7fe395e00700 1 --2- 172.21.15.70:0/3189898890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bc780 0x55fd5b3d2600 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x55fd5b3d8c40 tx=0x7fe384014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=833dd50493e332f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.022+0000 7fe37ea00700 1 -- 172.21.15.70:0/3189898890 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384020bc0 con 0x55fd5b3bc780 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.022+0000 7fe37ea00700 1 -- 172.21.15.70:0/3189898890 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe384020d60 con 0x55fd5b3bc780 2024-05-08T08:18:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.022+0000 7fe37ea00700 1 -- 172.21.15.70:0/3189898890 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384005440 con 0x55fd5b3bc780 2024-05-08T08:18:58.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.023+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3189898890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bc780 msgr2=0x55fd5b3d2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:18:58.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.023+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3189898890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bc780 0x55fd5b3d2600 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x55fd5b3d8c40 tx=0x7fe384014000 comp rx=0 tx=0).stop 2024-05-08T08:18:58.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.023+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3189898890 shutdown_connections 2024-05-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.023+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3189898890 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3c21b0 0x55fd5b3ddca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.023+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3189898890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3bc780 0x55fd5b3d2600 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.023+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/3189898890 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 0x55fd5b3bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.023+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3189898890 >> 172.21.15.70:0/3189898890 conn(0x55fd5b3347d0 msgr2=0x55fd5b3bb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.023+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3189898890 shutdown_connections 2024-05-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.023+0000 7fe3a316fb80 1 -- 172.21.15.70:0/3189898890 wait complete. 2024-05-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.024+0000 7fe3a316fb80 1 -- start start 2024-05-08T08:18:58.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.024+0000 7fe3a316fb80 1 Processor -- start 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.024+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 0x55fd5b3cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.024+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 0x55fd5b3cc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.024+0000 7fe3a316fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b449070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.025+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901afc30 con 0x55fd5b3c21b0 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.025+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901b10a0 con 0x55fd5b3bd140 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.025+0000 7fe3a316fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901b0300 con 0x55fd5b3bc780 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.025+0000 7fe3a316fb80 10 client.0 _ll_register_callbacks cb 0x55fd5b2b5d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.025+0000 7fe396800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b449070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.025+0000 7fe395400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 0x55fd5b3cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:58.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.025+0000 7fe395e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 0x55fd5b3cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:58.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.025+0000 7fe396800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b449070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36596/0 (socket says 172.21.15.70:36596) 2024-05-08T08:18:58.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.025+0000 7fe396800700 1 -- 172.21.15.70:0/603900080 learned_addr learned my addr 172.21.15.70:0/603900080 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe396800700 1 -- 172.21.15.70:0/603900080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 msgr2=0x55fd5b3cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe396800700 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 0x55fd5b3cbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe396800700 1 -- 172.21.15.70:0/603900080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 msgr2=0x55fd5b3cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe396800700 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 0x55fd5b3cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:18:58.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe396800700 1 -- 172.21.15.70:0/603900080 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd5b449660 con 0x55fd5b3c21b0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe396800700 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b449070 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe38c007820 tx=0x7fe38c015ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d391eb40d727ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe373e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe373e00700 1 -- 172.21.15.70:0/603900080 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c03a060 con 0x55fd5b3c21b0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe373e00700 1 -- 172.21.15.70:0/603900080 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(261..261 src has 1..261) ==== 9583+0+0 (secure 0 0 0) 0x7fe38c01e3b0 con 0x55fd5b3c21b0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.026+0000 7fe3a316fb80 1 -- 172.21.15.70:0/603900080 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe384020d60 con 0x55fd5b3c21b0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.027+0000 7fe373e00700 1 -- 172.21.15.70:0/603900080 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe38c041050 con 0x55fd5b3c21b0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.027+0000 7fe3a316fb80 10 client.17898 fetch_fsmap learned FSMap version 42 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.027+0000 7fe3a316fb80 1 -- 172.21.15.70:0/603900080 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fd5b44a980 con 0x55fd5b3c21b0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.027+0000 7fe373e00700 1 -- 172.21.15.70:0/603900080 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe384020d60 con 0x55fd5b3c21b0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.027+0000 7fe373e00700 1 -- 172.21.15.70:0/603900080 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe38c01f450 con 0x55fd5b3c21b0 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.027+0000 7fe3a316fb80 10 client.17898 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.028+0000 7fe3a316fb80 10 client.17898 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:18:58.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.028+0000 7fe3a316fb80 20 client.17898 populate_metadata read hostname 'smithi070' 2024-05-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.028+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd5b44b090 0x55fd5b44d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.028+0000 7fe3a316fb80 4 client.17898 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8f2db9a9", "release": true, "await": true}] 2024-05-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.028+0000 7fe3a316fb80 1 -- 172.21.15.70:0/603900080 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8f2db9a9", "release": true, "await": true}) -- 0x55fd5b3b75d0 con 0x55fd5b44b090 2024-05-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.028+0000 7fe395e00700 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd5b44b090 0x55fd5b44d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.029+0000 7fe395e00700 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd5b44b090 0x55fd5b44d4b0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd1707e871b81873 server_cookie=7acc1a03f051575c in_seq=0 out_seq=0 2024-05-08T08:18:58.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:18:58.029+0000 7fe373e00700 10 client.17898 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:18:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:18:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:18:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:18:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:18:58.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:18:58.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:18:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:18:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:18:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:18:58.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:18:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:18:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:18:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:18:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:18:58.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:18:59.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:18:59 smithi070 ceph-mon[29591]: pgmap v2942: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T08:18:59.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:18:59 smithi172 ceph-mon[33377]: pgmap v2942: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T08:18:59.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:18:59 smithi194 ceph-mon[33679]: pgmap v2942: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T08:19:01.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:01 smithi070 ceph-mon[29591]: pgmap v2943: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-05-08T08:19:01.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:01 smithi172 ceph-mon[33377]: pgmap v2943: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-05-08T08:19:01.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:01 smithi194 ceph-mon[33679]: pgmap v2943: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 7 op/s 2024-05-08T08:19:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.596+0000 7fe373e00700 1 -- 172.21.15.70:0/603900080 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55fd5b3b75d0 con 0x55fd5b44b090 2024-05-08T08:19:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.596+0000 7fe373e00700 10 client.17898 handle_command_reply: tid=0 2024-05-08T08:19:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.596+0000 7fe3a316fb80 1 client.17898 shutdown 2024-05-08T08:19:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.597+0000 7fe3a316fb80 1 -- 172.21.15.70:0/603900080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 msgr2=0x55fd5b449070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:19:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.597+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b449070 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe38c007820 tx=0x7fe38c015ae0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.597+0000 7fe3a316fb80 1 -- 172.21.15.70:0/603900080 shutdown_connections 2024-05-08T08:19:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.597+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd5b44b090 0x55fd5b44d4b0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.597+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd5b3c21b0 0x55fd5b449070 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.597+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd5b3bc780 0x55fd5b3cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.597+0000 7fe3a316fb80 1 --2- 172.21.15.70:0/603900080 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd5b3bd140 0x55fd5b3cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.597+0000 7fe3a316fb80 1 -- 172.21.15.70:0/603900080 >> 172.21.15.70:0/603900080 conn(0x55fd5b3347d0 msgr2=0x55fd5b3bc000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:19:02.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.598+0000 7fe373e00700 0 client.17898 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:19:02.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.598+0000 7fe3a316fb80 1 -- 172.21.15.70:0/603900080 shutdown_connections 2024-05-08T08:19:02.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.598+0000 7fe3a316fb80 1 -- 172.21.15.70:0/603900080 wait complete. 2024-05-08T08:19:02.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.598+0000 7fe3a316fb80 20 client.17898 trim_cache size 0 max 16384 2024-05-08T08:19:02.593 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 212, 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "8f2db9a9": { 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 212, 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.3, 2024-05-08T08:19:02.594 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:19:02.595 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.599+0000 7fe398800700 1 -- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3780b29f0 msgr2=0x7fe3780b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.599+0000 7fe398800700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3780b29f0 0x7fe3780b4eb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe384005fd0 tx=0x7fe384005e50 comp rx=0 tx=0).stop 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.599+0000 7fe398800700 1 -- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103ef0 msgr2=0x7fe390075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.599+0000 7fe398800700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103ef0 0x7fe390075ce0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fe380005910 tx=0x7fe3800047b0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.600+0000 7fe398800700 1 -- 172.21.15.70:0/2129411891 shutdown_connections 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.600+0000 7fe398800700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe3780b29f0 0x7fe3780b4eb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.600+0000 7fe398800700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe390108460 0x7fe390076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.600+0000 7fe398800700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe390103550 0x7fe3900757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.600+0000 7fe398800700 1 --2- 172.21.15.70:0/2129411891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe390103ef0 0x7fe390075ce0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.600+0000 7fe398800700 1 -- 172.21.15.70:0/2129411891 >> 172.21.15.70:0/2129411891 conn(0x7fe39007a600 msgr2=0x7fe390101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.600+0000 7fe398800700 1 -- 172.21.15.70:0/2129411891 shutdown_connections 2024-05-08T08:19:02.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:19:02.600+0000 7fe398800700 1 -- 172.21.15.70:0/2129411891 wait complete. 2024-05-08T08:19:03.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:03 smithi070 ceph-mon[29591]: pgmap v2944: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T08:19:03.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:03 smithi172 ceph-mon[33377]: pgmap v2944: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T08:19:03.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:03 smithi194 ceph-mon[33679]: pgmap v2944: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T08:19:03.665 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8f2db9a9', seconds elapsed: 72.5 2024-05-08T08:19:05.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:05 smithi070 ceph-mon[29591]: pgmap v2945: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T08:19:05.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:05 smithi172 ceph-mon[33377]: pgmap v2945: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T08:19:05.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:05 smithi194 ceph-mon[33679]: pgmap v2945: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 18 KiB/s wr, 5 op/s 2024-05-08T08:19:07.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:07 smithi070 ceph-mon[29591]: pgmap v2946: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 124 KiB/s wr, 17 op/s 2024-05-08T08:19:07.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:07 smithi172 ceph-mon[33377]: pgmap v2946: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 124 KiB/s wr, 17 op/s 2024-05-08T08:19:07.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:07 smithi194 ceph-mon[33679]: pgmap v2946: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 124 KiB/s wr, 17 op/s 2024-05-08T08:19:08.591 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/assoc_array.o 2024-05-08T08:19:09.043 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/bitrev.o 2024-05-08T08:19:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:09 smithi070 ceph-mon[29591]: pgmap v2947: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 105 KiB/s wr, 14 op/s 2024-05-08T08:19:09.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:09 smithi172 ceph-mon[33377]: pgmap v2947: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 105 KiB/s wr, 14 op/s 2024-05-08T08:19:09.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:09 smithi194 ceph-mon[33679]: pgmap v2947: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 105 KiB/s wr, 14 op/s 2024-05-08T08:19:10.380 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nls/nls_utf8.o 2024-05-08T08:19:10.387 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exresolv.o 2024-05-08T08:19:10.398 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/static_call_inline.o 2024-05-08T08:19:11.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:11 smithi070 ceph-mon[29591]: pgmap v2948: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 319 KiB/s wr, 39 op/s 2024-05-08T08:19:11.404 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/sch_blackhole.o 2024-05-08T08:19:11.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:11 smithi172 ceph-mon[33377]: pgmap v2948: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 319 KiB/s wr, 39 op/s 2024-05-08T08:19:11.443 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/lockd/procfs.o 2024-05-08T08:19:11.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:11 smithi194 ceph-mon[33679]: pgmap v2948: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 319 KiB/s wr, 39 op/s 2024-05-08T08:19:11.520 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/callback.o 2024-05-08T08:19:13.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:13 smithi070 ceph-mon[29591]: pgmap v2949: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 319 KiB/s wr, 36 op/s 2024-05-08T08:19:13.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:13 smithi172 ceph-mon[33377]: pgmap v2949: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 319 KiB/s wr, 36 op/s 2024-05-08T08:19:13.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:13 smithi194 ceph-mon[33679]: pgmap v2949: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 319 KiB/s wr, 36 op/s 2024-05-08T08:19:13.888 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/crash_dump.o 2024-05-08T08:19:14.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:14 smithi172 ceph-mon[33377]: osdmap e262: 12 total, 12 up, 12 in 2024-05-08T08:19:14.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:14 smithi194 ceph-mon[33679]: osdmap e262: 12 total, 12 up, 12 in 2024-05-08T08:19:14.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:14 smithi070 ceph-mon[29591]: osdmap e262: 12 total, 12 up, 12 in 2024-05-08T08:19:15.133 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crc-ccitt.o 2024-05-08T08:19:15.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:15 smithi172 ceph-mon[33377]: pgmap v2951: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 382 KiB/s wr, 43 op/s 2024-05-08T08:19:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:15 smithi194 ceph-mon[33679]: pgmap v2951: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 382 KiB/s wr, 43 op/s 2024-05-08T08:19:15.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:15 smithi070 ceph-mon[29591]: pgmap v2951: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 270 KiB/s rd, 382 KiB/s wr, 43 op/s 2024-05-08T08:19:16.587 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exresop.o 2024-05-08T08:19:16.663 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/nls/built-in.a 2024-05-08T08:19:17.061 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/cls_api.o 2024-05-08T08:19:17.096 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/jump_label.o 2024-05-08T08:19:17.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:17 smithi172 ceph-mon[33377]: pgmap v2952: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 512 KiB/s wr, 40 op/s 2024-05-08T08:19:17.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:17 smithi194 ceph-mon[33679]: pgmap v2952: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 512 KiB/s wr, 40 op/s 2024-05-08T08:19:17.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:17 smithi070 ceph-mon[29591]: pgmap v2952: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 512 KiB/s wr, 40 op/s 2024-05-08T08:19:19.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:19 smithi172 ceph-mon[33377]: pgmap v2953: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 512 KiB/s wr, 40 op/s 2024-05-08T08:19:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:19 smithi194 ceph-mon[33679]: pgmap v2953: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 512 KiB/s wr, 40 op/s 2024-05-08T08:19:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:19 smithi070 ceph-mon[29591]: pgmap v2953: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 512 KiB/s wr, 40 op/s 2024-05-08T08:19:20.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:20 smithi172 ceph-mon[33377]: osdmap e263: 12 total, 12 up, 12 in 2024-05-08T08:19:20.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:20 smithi194 ceph-mon[33679]: osdmap e263: 12 total, 12 up, 12 in 2024-05-08T08:19:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:20 smithi070 ceph-mon[29591]: osdmap e263: 12 total, 12 up, 12 in 2024-05-08T08:19:20.911 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/lockd/built-in.a 2024-05-08T08:19:21.204 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crc16.o 2024-05-08T08:19:21.481 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/act_api.o 2024-05-08T08:19:21.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:21 smithi194 ceph-mon[33679]: pgmap v2955: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 656 KiB/s wr, 26 op/s 2024-05-08T08:19:21.524 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:21 smithi070 ceph-mon[29591]: pgmap v2955: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 656 KiB/s wr, 26 op/s 2024-05-08T08:19:21.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:21 smithi172 ceph-mon[33377]: pgmap v2955: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 656 KiB/s wr, 26 op/s 2024-05-08T08:19:22.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:22 smithi194 ceph-mon[33679]: pgmap v2956: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 648 KiB/s wr, 26 op/s 2024-05-08T08:19:22.539 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:22 smithi070 ceph-mon[29591]: pgmap v2956: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 648 KiB/s wr, 26 op/s 2024-05-08T08:19:22.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:22 smithi172 ceph-mon[33377]: pgmap v2956: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 648 KiB/s wr, 26 op/s 2024-05-08T08:19:24.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:24 smithi070 ceph-mon[29591]: pgmap v2957: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 525 KiB/s wr, 21 op/s 2024-05-08T08:19:24.490 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exserial.o 2024-05-08T08:19:24.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:24 smithi172 ceph-mon[33377]: pgmap v2957: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 525 KiB/s wr, 21 op/s 2024-05-08T08:19:24.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:24 smithi194 ceph-mon[33679]: pgmap v2957: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 525 KiB/s wr, 21 op/s 2024-05-08T08:19:24.818 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/unicode/built-in.a 2024-05-08T08:19:24.943 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/context_tracking.o 2024-05-08T08:19:24.961 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC lib/gen_crc32table 2024-05-08T08:19:25.326 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/sch_fifo.o 2024-05-08T08:19:25.558 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/xxhash.o 2024-05-08T08:19:25.746 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/callback_xdr.o 2024-05-08T08:19:26.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:26 smithi070 ceph-mon[29591]: pgmap v2958: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 600 KiB/s wr, 41 op/s 2024-05-08T08:19:26.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:26 smithi172 ceph-mon[33377]: pgmap v2958: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 600 KiB/s wr, 41 op/s 2024-05-08T08:19:26.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:26 smithi194 ceph-mon[33679]: pgmap v2958: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 600 KiB/s wr, 41 op/s 2024-05-08T08:19:27.126 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/autofs/init.o 2024-05-08T08:19:28.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:28 smithi070 ceph-mon[29591]: pgmap v2959: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 600 KiB/s wr, 41 op/s 2024-05-08T08:19:28.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:28 smithi172 ceph-mon[33377]: pgmap v2959: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 600 KiB/s wr, 41 op/s 2024-05-08T08:19:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:28 smithi194 ceph-mon[33679]: pgmap v2959: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 600 KiB/s wr, 41 op/s 2024-05-08T08:19:30.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:30 smithi070 ceph-mon[29591]: pgmap v2960: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 592 KiB/s wr, 55 op/s 2024-05-08T08:19:30.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:30 smithi172 ceph-mon[33377]: pgmap v2960: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 592 KiB/s wr, 55 op/s 2024-05-08T08:19:30.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:30 smithi194 ceph-mon[33679]: pgmap v2960: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 592 KiB/s wr, 55 op/s 2024-05-08T08:19:30.855 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exstore.o 2024-05-08T08:19:31.392 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/autofs/inode.o 2024-05-08T08:19:31.777 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/genalloc.o 2024-05-08T08:19:32.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:32 smithi070 ceph-mon[29591]: pgmap v2961: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 497 KiB/s wr, 46 op/s 2024-05-08T08:19:32.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:32 smithi172 ceph-mon[33377]: pgmap v2961: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 497 KiB/s wr, 46 op/s 2024-05-08T08:19:32.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:32 smithi194 ceph-mon[33679]: pgmap v2961: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 497 KiB/s wr, 46 op/s 2024-05-08T08:19:33.752 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/iomem.o 2024-05-08T08:19:33.824 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/numa/srat.o 2024-05-08T08:19:34.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:34 smithi070 ceph-mon[29591]: pgmap v2962: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 497 KiB/s wr, 46 op/s 2024-05-08T08:19:34.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:34 smithi172 ceph-mon[33377]: pgmap v2962: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 497 KiB/s wr, 46 op/s 2024-05-08T08:19:34.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:34 smithi194 ceph-mon[33679]: pgmap v2962: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 433 KiB/s rd, 497 KiB/s wr, 46 op/s 2024-05-08T08:19:34.773 INFO:tasks.workunit.client.0.smithi070.stdout: CC kernel/rseq.o 2024-05-08T08:19:36.575 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/cls_cgroup.o 2024-05-08T08:19:36.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:36 smithi070 ceph-mon[29591]: pgmap v2963: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 805 KiB/s wr, 67 op/s 2024-05-08T08:19:36.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:36 smithi172 ceph-mon[33377]: pgmap v2963: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 805 KiB/s wr, 67 op/s 2024-05-08T08:19:36.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:36 smithi194 ceph-mon[33679]: pgmap v2963: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 724 KiB/s rd, 805 KiB/s wr, 67 op/s 2024-05-08T08:19:37.210 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exstoren.o 2024-05-08T08:19:38.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:38 smithi070 ceph-mon[29591]: pgmap v2964: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 529 KiB/s wr, 41 op/s 2024-05-08T08:19:38.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:38 smithi172 ceph-mon[33377]: pgmap v2964: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 529 KiB/s wr, 41 op/s 2024-05-08T08:19:38.707 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/callback_proc.o 2024-05-08T08:19:38.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:38 smithi194 ceph-mon[33679]: pgmap v2964: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 529 KiB/s wr, 41 op/s 2024-05-08T08:19:38.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/percpu_counter.o 2024-05-08T08:19:39.326 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/autofs/root.o 2024-05-08T08:19:40.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:40 smithi070 ceph-mon[29591]: pgmap v2965: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 784 KiB/s wr, 55 op/s 2024-05-08T08:19:40.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:40 smithi172 ceph-mon[33377]: pgmap v2965: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 784 KiB/s wr, 55 op/s 2024-05-08T08:19:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:40 smithi194 ceph-mon[33679]: pgmap v2965: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 784 KiB/s wr, 55 op/s 2024-05-08T08:19:42.001 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/acpi/pmic/built-in.a 2024-05-08T08:19:42.192 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exstorob.o 2024-05-08T08:19:42.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:42 smithi070 ceph-mon[29591]: pgmap v2966: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 563 KiB/s wr, 34 op/s 2024-05-08T08:19:42.651 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/acpi/numa/built-in.a 2024-05-08T08:19:42.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:42 smithi172 ceph-mon[33377]: pgmap v2966: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 563 KiB/s wr, 34 op/s 2024-05-08T08:19:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:42 smithi194 ceph-mon[33679]: pgmap v2966: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 563 KiB/s wr, 34 op/s 2024-05-08T08:19:42.850 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sched/ematch.o 2024-05-08T08:19:43.407 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exsystem.o 2024-05-08T08:19:44.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:44 smithi070 ceph-mon[29591]: pgmap v2967: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 563 KiB/s wr, 34 op/s 2024-05-08T08:19:44.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:44 smithi172 ceph-mon[33377]: pgmap v2967: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 563 KiB/s wr, 34 op/s 2024-05-08T08:19:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:44 smithi194 ceph-mon[33679]: pgmap v2967: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 563 KiB/s wr, 34 op/s 2024-05-08T08:19:44.888 INFO:tasks.workunit.client.0.smithi070.stdout: AR kernel/built-in.a 2024-05-08T08:19:45.388 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/syscall.o 2024-05-08T08:19:46.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:46 smithi070 ceph-mon[29591]: pgmap v2968: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 807 KiB/s wr, 47 op/s 2024-05-08T08:19:46.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:46 smithi172 ceph-mon[33377]: pgmap v2968: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 807 KiB/s wr, 47 op/s 2024-05-08T08:19:46.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:46 smithi194 ceph-mon[33679]: pgmap v2968: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 807 KiB/s wr, 47 op/s 2024-05-08T08:19:47.209 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/autofs/symlink.o 2024-05-08T08:19:48.427 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/autofs/waitq.o 2024-05-08T08:19:48.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:48 smithi070 ceph-mon[29591]: pgmap v2969: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 499 KiB/s wr, 26 op/s 2024-05-08T08:19:48.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:48 smithi172 ceph-mon[33377]: pgmap v2969: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 499 KiB/s wr, 26 op/s 2024-05-08T08:19:48.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:48 smithi194 ceph-mon[33679]: pgmap v2969: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 499 KiB/s wr, 26 op/s 2024-05-08T08:19:48.755 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/i386.o 2024-05-08T08:19:49.589 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/extrace.o 2024-05-08T08:19:50.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:50 smithi070 ceph-mon[29591]: pgmap v2970: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 899 KiB/s wr, 45 op/s 2024-05-08T08:19:50.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:50 smithi172 ceph-mon[33377]: pgmap v2970: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 899 KiB/s wr, 45 op/s 2024-05-08T08:19:50.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:50 smithi194 ceph-mon[33679]: pgmap v2970: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 818 KiB/s rd, 899 KiB/s wr, 45 op/s 2024-05-08T08:19:51.872 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4namespace.o 2024-05-08T08:19:51.914 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/actions/built-in.a 2024-05-08T08:19:52.114 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/analogbits/built-in.a 2024-05-08T08:19:52.308 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/bcm/built-in.a 2024-05-08T08:19:52.510 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:19:52.510 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T08:19:52.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:19:52.573 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/imgtec/built-in.a 2024-05-08T08:19:52.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:52 smithi070 ceph-mon[29591]: pgmap v2971: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 644 KiB/s wr, 31 op/s 2024-05-08T08:19:52.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:52 smithi172 ceph-mon[33377]: pgmap v2971: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 644 KiB/s wr, 31 op/s 2024-05-08T08:19:52.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:52 smithi194 ceph-mon[33679]: pgmap v2971: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 644 KiB/s wr, 31 op/s 2024-05-08T08:19:52.802 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/imx/built-in.a 2024-05-08T08:19:53.034 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/ingenic/built-in.a 2024-05-08T08:19:53.118 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:19:53.339 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/mediatek/built-in.a 2024-05-08T08:19:53.373 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/errname.o 2024-05-08T08:19:53.539 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/microchip/built-in.a 2024-05-08T08:19:53.743 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/mstar/built-in.a 2024-05-08T08:19:54.025 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/mvebu/built-in.a 2024-05-08T08:19:54.239 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/ralink/built-in.a 2024-05-08T08:19:54.436 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/renesas/built-in.a 2024-05-08T08:19:54.472 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/sched/built-in.a 2024-05-08T08:19:54.616 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/socfpga/built-in.a 2024-05-08T08:19:54.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:54 smithi070 ceph-mon[29591]: pgmap v2972: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 644 KiB/s wr, 31 op/s 2024-05-08T08:19:54.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:54 smithi172 ceph-mon[33377]: pgmap v2972: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 644 KiB/s wr, 31 op/s 2024-05-08T08:19:54.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:54 smithi194 ceph-mon[33679]: pgmap v2972: 129 pgs: 129 active+clean; 1.9 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 644 KiB/s wr, 31 op/s 2024-05-08T08:19:54.797 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/sprd/built-in.a 2024-05-08T08:19:55.004 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/starfive/built-in.a 2024-05-08T08:19:55.205 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/sunxi-ng/built-in.a 2024-05-08T08:19:55.226 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlink/af_netlink.o 2024-05-08T08:19:55.279 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/bpf/built-in.a 2024-05-08T08:19:55.362 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/ti/built-in.a 2024-05-08T08:19:55.401 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlink/genetlink.o 2024-05-08T08:19:55.483 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/versatile/built-in.a 2024-05-08T08:19:55.937 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/xilinx/built-in.a 2024-05-08T08:19:56.051 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clk/built-in.a 2024-05-08T08:19:56.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:56 smithi070 ceph-mon[29591]: pgmap v2973: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 942 KiB/s wr, 58 op/s 2024-05-08T08:19:56.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:56 smithi172 ceph-mon[33377]: pgmap v2973: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 942 KiB/s wr, 58 op/s 2024-05-08T08:19:56.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:56 smithi194 ceph-mon[33679]: pgmap v2973: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 942 KiB/s wr, 58 op/s 2024-05-08T08:19:56.921 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/nlattr.o 2024-05-08T08:19:57.095 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/ioctl.o 2024-05-08T08:19:57.774 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/exutils.o 2024-05-08T08:19:57.953 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/autofs/expire.o 2024-05-08T08:19:58.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:58 smithi070 ceph-mon[29591]: pgmap v2974: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 699 KiB/s wr, 45 op/s 2024-05-08T08:19:58.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:19:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:19:58.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:58 smithi172 ceph-mon[33377]: pgmap v2974: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 699 KiB/s wr, 45 op/s 2024-05-08T08:19:58.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:19:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:19:58.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:58 smithi194 ceph-mon[33679]: pgmap v2974: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 699 KiB/s wr, 45 op/s 2024-05-08T08:19:58.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:19:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:19:59.006 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/init.o 2024-05-08T08:20:00.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:00 smithi070 ceph-mon[29591]: pgmap v2975: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 916 KiB/s wr, 71 op/s 2024-05-08T08:20:00.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T08:20:00.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:00 smithi172 ceph-mon[33377]: pgmap v2975: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 916 KiB/s wr, 71 op/s 2024-05-08T08:20:00.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T08:20:00.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:00 smithi194 ceph-mon[33679]: pgmap v2975: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 916 KiB/s wr, 71 op/s 2024-05-08T08:20:00.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T08:20:02.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:02 smithi070 ceph-mon[29591]: pgmap v2976: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 516 KiB/s wr, 53 op/s 2024-05-08T08:20:02.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:02 smithi172 ceph-mon[33377]: pgmap v2976: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 516 KiB/s wr, 53 op/s 2024-05-08T08:20:02.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:02 smithi194 ceph-mon[33679]: pgmap v2976: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 516 KiB/s wr, 53 op/s 2024-05-08T08:20:04.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:04 smithi172 ceph-mon[33377]: pgmap v2977: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 516 KiB/s wr, 53 op/s 2024-05-08T08:20:04.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:20:04.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:20:04.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:20:04.741 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:04 smithi070 ceph-mon[29591]: pgmap v2977: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 516 KiB/s wr, 53 op/s 2024-05-08T08:20:04.741 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:20:04.741 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:20:04.742 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:20:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:04 smithi194 ceph-mon[33679]: pgmap v2977: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 516 KiB/s wr, 53 op/s 2024-05-08T08:20:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:20:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:20:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:20:05.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.425+0000 7fc48be00700 1 -- 172.21.15.70:0/1111003136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4840abd50 msgr2=0x7fc4840ac130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.425+0000 7fc48be00700 1 --2- 172.21.15.70:0/1111003136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4840abd50 0x7fc4840ac130 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009990 tx=0x7fc47c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.426+0000 7fc48be00700 1 -- 172.21.15.70:0/1111003136 shutdown_connections 2024-05-08T08:20:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.426+0000 7fc48be00700 1 --2- 172.21.15.70:0/1111003136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4840a5790 0x7fc4840b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.426+0000 7fc48be00700 1 --2- 172.21.15.70:0/1111003136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4840abd50 0x7fc4840ac130 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.426+0000 7fc48be00700 1 --2- 172.21.15.70:0/1111003136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4840a4dd0 0x7fc4840a5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.426+0000 7fc48be00700 1 -- 172.21.15.70:0/1111003136 >> 172.21.15.70:0/1111003136 conn(0x7fc48401a690 msgr2=0x7fc48401aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:20:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.426+0000 7fc48be00700 1 -- 172.21.15.70:0/1111003136 shutdown_connections 2024-05-08T08:20:05.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.426+0000 7fc48be00700 1 -- 172.21.15.70:0/1111003136 wait complete. 2024-05-08T08:20:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.427+0000 7fc48be00700 1 Processor -- start 2024-05-08T08:20:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.428+0000 7fc48be00700 1 -- start start 2024-05-08T08:20:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.428+0000 7fc48be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4840a4dd0 0x7fc48413f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.428+0000 7fc48be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4840a5790 0x7fc48413fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.428+0000 7fc48be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4840abd50 0x7fc484143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:05.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.428+0000 7fc48be00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840b6dc0 con 0x7fc4840abd50 2024-05-08T08:20:05.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4840a4dd0 0x7fc48413f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:05.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.428+0000 7fc48be00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840b6c40 con 0x7fc4840a4dd0 2024-05-08T08:20:05.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48be00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840b6f40 con 0x7fc4840a5790 2024-05-08T08:20:05.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4840abd50 0x7fc484143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:05.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4840abd50 0x7fc484143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47910/0 (socket says 172.21.15.70:47910) 2024-05-08T08:20:05.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48b400700 1 -- 172.21.15.70:0/7173426 learned_addr learned my addr 172.21.15.70:0/7173426 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:20:05.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48a000700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4840a5790 0x7fc48413fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:05.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48b400700 1 -- 172.21.15.70:0/7173426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4840a5790 msgr2=0x7fc48413fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48b400700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4840a5790 0x7fc48413fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48b400700 1 -- 172.21.15.70:0/7173426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4840a4dd0 msgr2=0x7fc48413f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48b400700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4840a4dd0 0x7fc48413f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.429+0000 7fc48b400700 1 -- 172.21.15.70:0/7173426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc484144520 con 0x7fc4840abd50 2024-05-08T08:20:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.430+0000 7fc48b400700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4840abd50 0x7fc484143de0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc48c066610 tx=0x7fc48c06ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:20:05.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.431+0000 7fc483400700 1 -- 172.21.15.70:0/7173426 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c0779c0 con 0x7fc4840abd50 2024-05-08T08:20:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.431+0000 7fc483400700 1 -- 172.21.15.70:0/7173426 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc48c076420 con 0x7fc4840abd50 2024-05-08T08:20:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.431+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc484144810 con 0x7fc4840abd50 2024-05-08T08:20:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.431+0000 7fc483400700 1 -- 172.21.15.70:0/7173426 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c07f660 con 0x7fc4840abd50 2024-05-08T08:20:05.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.431+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48414c090 con 0x7fc4840abd50 2024-05-08T08:20:05.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.435+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4840a6250 con 0x7fc4840abd50 2024-05-08T08:20:05.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.437+0000 7fc483400700 1 -- 172.21.15.70:0/7173426 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc48c07f800 con 0x7fc4840abd50 2024-05-08T08:20:05.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.439+0000 7fc483400700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4700b2bc0 0x7fc4700b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:05.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.439+0000 7fc483400700 1 -- 172.21.15.70:0/7173426 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(263..263 src has 1..263) ==== 9583+0+0 (secure 0 0 0) 0x7fc48c147db0 con 0x7fc4840abd50 2024-05-08T08:20:05.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.440+0000 7fc48aa00700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4700b2bc0 0x7fc4700b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:05.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.441+0000 7fc48aa00700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4700b2bc0 0x7fc4700b5080 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00b2e0 tx=0x7fc47c00b610 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:20:05.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.445+0000 7fc483400700 1 -- 172.21.15.70:0/7173426 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc48c07b030 con 0x7fc4840abd50 2024-05-08T08:20:05.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.912+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc48414c2c0 con 0x7fc4840abd50 2024-05-08T08:20:05.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.914+0000 7fc483400700 1 -- 172.21.15.70:0/7173426 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fc48c10f3a0 con 0x7fc4840abd50 2024-05-08T08:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:20:05.907 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:20:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.918+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4700b2bc0 msgr2=0x7fc4700b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.918+0000 7fc48be00700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4700b2bc0 0x7fc4700b5080 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00b2e0 tx=0x7fc47c00b610 comp rx=0 tx=0).stop 2024-05-08T08:20:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.918+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4840abd50 msgr2=0x7fc484143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:05.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.918+0000 7fc48be00700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4840abd50 0x7fc484143de0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc48c066610 tx=0x7fc48c06ba70 comp rx=0 tx=0).stop 2024-05-08T08:20:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.918+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 shutdown_connections 2024-05-08T08:20:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.918+0000 7fc48be00700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc4700b2bc0 0x7fc4700b5080 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.918+0000 7fc48be00700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc4840abd50 0x7fc484143de0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.918+0000 7fc48be00700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc4840a4dd0 0x7fc48413f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.918+0000 7fc48be00700 1 --2- 172.21.15.70:0/7173426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4840a5790 0x7fc48413fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.919+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 >> 172.21.15.70:0/7173426 conn(0x7fc48401a690 msgr2=0x7fc4840a2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:20:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.919+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 shutdown_connections 2024-05-08T08:20:05.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:05.919+0000 7fc48be00700 1 -- 172.21.15.70:0/7173426 wait complete. 2024-05-08T08:20:05.914 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:20:06.154 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/hwacpi.o 2024-05-08T08:20:06.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:06 smithi172 ceph-mon[33377]: pgmap v2978: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 768 KiB/s wr, 78 op/s 2024-05-08T08:20:06.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:06 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/7173426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:20:06.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:06 smithi070 ceph-mon[29591]: pgmap v2978: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 768 KiB/s wr, 78 op/s 2024-05-08T08:20:06.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:06 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/7173426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:20:06.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:06 smithi194 ceph-mon[33679]: pgmap v2978: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 768 KiB/s wr, 78 op/s 2024-05-08T08:20:06.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:06 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/7173426' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:20:07.032 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T08:20:07.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T08:20:07.205 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/autofs/dev-ioctl.o 2024-05-08T08:20:07.397 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4getroot.o 2024-05-08T08:20:07.618 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:20:08.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:08 smithi172 ceph-mon[33377]: pgmap v2979: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 470 KiB/s wr, 51 op/s 2024-05-08T08:20:08.711 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/cpu_rmap.o 2024-05-08T08:20:08.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:08 smithi194 ceph-mon[33679]: pgmap v2979: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 470 KiB/s wr, 51 op/s 2024-05-08T08:20:08.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:08 smithi070 ceph-mon[29591]: pgmap v2979: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 470 KiB/s wr, 51 op/s 2024-05-08T08:20:09.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:09 smithi070 ceph-mon[29591]: osdmap e264: 12 total, 12 up, 12 in 2024-05-08T08:20:09.654 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/mmconfig_64.o 2024-05-08T08:20:09.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:09 smithi172 ceph-mon[33377]: osdmap e264: 12 total, 12 up, 12 in 2024-05-08T08:20:09.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:09 smithi194 ceph-mon[33679]: osdmap e264: 12 total, 12 up, 12 in 2024-05-08T08:20:10.151 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/vfs_super.o 2024-05-08T08:20:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.647+0000 7ffa7a200700 1 -- 172.21.15.70:0/345003741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079600 msgr2=0x7ffa740799e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:10.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.647+0000 7ffa7a200700 1 --2- 172.21.15.70:0/345003741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079600 0x7ffa740799e0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009990 tx=0x7ffa68009ca0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.647+0000 7ffa7a200700 1 -- 172.21.15.70:0/345003741 shutdown_connections 2024-05-08T08:20:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.647+0000 7ffa7a200700 1 --2- 172.21.15.70:0/345003741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa741141a0 0x7ffa74116590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.647+0000 7ffa7a200700 1 --2- 172.21.15.70:0/345003741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079600 0x7ffa740799e0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.647+0000 7ffa7a200700 1 --2- 172.21.15.70:0/345003741 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74079fb0 0x7ffa74113c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.647+0000 7ffa7a200700 1 -- 172.21.15.70:0/345003741 >> 172.21.15.70:0/345003741 conn(0x7ffa74100fb0 msgr2=0x7ffa741033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:20:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.647+0000 7ffa7a200700 1 -- 172.21.15.70:0/345003741 shutdown_connections 2024-05-08T08:20:10.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.647+0000 7ffa7a200700 1 -- 172.21.15.70:0/345003741 wait complete. 2024-05-08T08:20:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.649+0000 7ffa7a200700 1 Processor -- start 2024-05-08T08:20:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.649+0000 7ffa7a200700 1 -- start start 2024-05-08T08:20:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.649+0000 7ffa7a200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74079600 0x7ffa7419ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.649+0000 7ffa7a200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079fb0 0x7ffa741a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.649+0000 7ffa7a200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa741141a0 0x7ffa741a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.649+0000 7ffa7a200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa74119ad0 con 0x7ffa74079fb0 2024-05-08T08:20:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.649+0000 7ffa7a200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa74119950 con 0x7ffa74079600 2024-05-08T08:20:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.649+0000 7ffa7a200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa74119c50 con 0x7ffa741141a0 2024-05-08T08:20:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa78e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74079600 0x7ffa7419ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa73e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079fb0 0x7ffa741a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa73e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079fb0 0x7ffa741a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54112/0 (socket says 172.21.15.70:54112) 2024-05-08T08:20:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa73e00700 1 -- 172.21.15.70:0/688791593 learned_addr learned my addr 172.21.15.70:0/688791593 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:20:10.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa79800700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa741141a0 0x7ffa741a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa73e00700 1 -- 172.21.15.70:0/688791593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa741141a0 msgr2=0x7ffa741a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:10.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa73e00700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa741141a0 0x7ffa741a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa73e00700 1 -- 172.21.15.70:0/688791593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74079600 msgr2=0x7ffa7419ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:10.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa73e00700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74079600 0x7ffa7419ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa73e00700 1 -- 172.21.15.70:0/688791593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa741a4f60 con 0x7ffa74079fb0 2024-05-08T08:20:10.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.650+0000 7ffa78e00700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74079600 0x7ffa7419ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:20:10.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.651+0000 7ffa73e00700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079fb0 0x7ffa741a04e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000e9a0 tx=0x7ffa6000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:20:10.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.651+0000 7ffa71600700 1 -- 172.21.15.70:0/688791593 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6000cbd0 con 0x7ffa74079fb0 2024-05-08T08:20:10.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.651+0000 7ffa71600700 1 -- 172.21.15.70:0/688791593 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa6000cd70 con 0x7ffa74079fb0 2024-05-08T08:20:10.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.651+0000 7ffa71600700 1 -- 172.21.15.70:0/688791593 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa60018680 con 0x7ffa74079fb0 2024-05-08T08:20:10.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.652+0000 7ffa7a200700 1 -- 172.21.15.70:0/688791593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa741a5250 con 0x7ffa74079fb0 2024-05-08T08:20:10.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.652+0000 7ffa7a200700 1 -- 172.21.15.70:0/688791593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa741acad0 con 0x7ffa74079fb0 2024-05-08T08:20:10.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.656+0000 7ffa71600700 1 -- 172.21.15.70:0/688791593 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ffa60010950 con 0x7ffa74079fb0 2024-05-08T08:20:10.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.659+0000 7ffa71600700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa5c0b2aa0 0x7ffa5c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.659+0000 7ffa71600700 1 -- 172.21.15.70:0/688791593 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(264..264 src has 1..264) ==== 9671+0+0 (secure 0 0 0) 0x7ffa600e2c90 con 0x7ffa74079fb0 2024-05-08T08:20:10.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.659+0000 7ffa78e00700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa5c0b2aa0 0x7ffa5c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.660+0000 7ffa78e00700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa5c0b2aa0 0x7ffa5c0b4f60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ffa6800b650 tx=0x7ffa6801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:20:10.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.673+0000 7ffa8609cb80 1 Processor -- start 2024-05-08T08:20:10.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.673+0000 7ffa8609cb80 1 -- start start 2024-05-08T08:20:10.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.673+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e5eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.673+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eb910 0x560c2e5e5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.673+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5e5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.673+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c2e537bb0 con 0x560c2e5e5b40 2024-05-08T08:20:10.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.673+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560c2e4d58f0 con 0x560c2e5eb910 2024-05-08T08:20:10.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.673+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560c2e533b70 con 0x560c2e5eaff0 2024-05-08T08:20:10.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.674+0000 7ffa79800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5e5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.674+0000 7ffa79800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5e5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54118/0 (socket says 172.21.15.70:54118) 2024-05-08T08:20:10.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.674+0000 7ffa79800700 1 -- 172.21.15.70:0/1621826078 learned_addr learned my addr 172.21.15.70:0/1621826078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:20:10.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.674+0000 7ffa78e00700 1 --2- 172.21.15.70:0/1621826078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e5eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.674+0000 7ffa73e00700 1 --2- 172.21.15.70:0/1621826078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eb910 0x560c2e5e5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.675+0000 7ffa79800700 1 -- 172.21.15.70:0/1621826078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 msgr2=0x560c2e5eb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:20:10.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.675+0000 7ffa79800700 1 --2- 172.21.15.70:0/1621826078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e5eb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.675+0000 7ffa79800700 1 -- 172.21.15.70:0/1621826078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eb910 msgr2=0x560c2e5e5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:20:10.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.675+0000 7ffa79800700 1 --2- 172.21.15.70:0/1621826078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eb910 0x560c2e5e5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.675+0000 7ffa79800700 1 -- 172.21.15.70:0/1621826078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c2e484a60 con 0x560c2e5e5b40 2024-05-08T08:20:10.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.675+0000 7ffa79800700 1 --2- 172.21.15.70:0/1621826078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5e5fa0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009d20 tx=0x7ffa6c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcecb7603e6e339 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:20:10.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.676+0000 7ffa66000700 1 -- 172.21.15.70:0/1621826078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c004bb0 con 0x560c2e5e5b40 2024-05-08T08:20:10.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.676+0000 7ffa66000700 1 -- 172.21.15.70:0/1621826078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa6c004d50 con 0x560c2e5e5b40 2024-05-08T08:20:10.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.676+0000 7ffa66000700 1 -- 172.21.15.70:0/1621826078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c014450 con 0x560c2e5e5b40 2024-05-08T08:20:10.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.677+0000 7ffa8609cb80 1 -- 172.21.15.70:0/1621826078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 msgr2=0x560c2e5e5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:10.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.677+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/1621826078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5e5fa0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009d20 tx=0x7ffa6c0077e0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.677+0000 7ffa8609cb80 1 -- 172.21.15.70:0/1621826078 shutdown_connections 2024-05-08T08:20:10.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.677+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/1621826078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5e5fa0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.677+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/1621826078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e5eb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.677+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/1621826078 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eb910 0x560c2e5e5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.678+0000 7ffa8609cb80 1 -- 172.21.15.70:0/1621826078 >> 172.21.15.70:0/1621826078 conn(0x560c2e513cf0 msgr2=0x560c2e5e0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:20:10.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.678+0000 7ffa8609cb80 1 -- 172.21.15.70:0/1621826078 shutdown_connections 2024-05-08T08:20:10.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.678+0000 7ffa8609cb80 1 -- 172.21.15.70:0/1621826078 wait complete. 2024-05-08T08:20:10.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.679+0000 7ffa8609cb80 1 -- start start 2024-05-08T08:20:10.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.679+0000 7ffa8609cb80 1 Processor -- start 2024-05-08T08:20:10.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.679+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 0x560c2e5f1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.679+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e5eea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.680+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e5eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.680+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c2e5f2430 con 0x560c2e5eb910 2024-05-08T08:20:10.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.680+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560c2e49dcb0 con 0x560c2e5e5b40 2024-05-08T08:20:10.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.680+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560c2e5f25b0 con 0x560c2e5eaff0 2024-05-08T08:20:10.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.680+0000 7ffa8609cb80 10 client.0 _ll_register_callbacks cb 0x560c2e4dee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:20:10.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.680+0000 7ffa79800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e5eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.680+0000 7ffa79800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e5eefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54126/0 (socket says 172.21.15.70:54126) 2024-05-08T08:20:10.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.680+0000 7ffa79800700 1 -- 172.21.15.70:0/3030205075 learned_addr learned my addr 172.21.15.70:0/3030205075 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:20:10.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.680+0000 7ffa78e00700 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 0x560c2e5f1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.681+0000 7ffa79800700 1 -- 172.21.15.70:0/3030205075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 msgr2=0x560c2e5eea60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T08:20:10.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.681+0000 7ffa73e00700 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e5eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.681+0000 7ffa79800700 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e5eea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.681+0000 7ffa79800700 1 -- 172.21.15.70:0/3030205075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 msgr2=0x560c2e5f1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:20:10.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.681+0000 7ffa79800700 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 0x560c2e5f1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.681+0000 7ffa79800700 1 -- 172.21.15.70:0/3030205075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c2e4fd5b0 con 0x560c2e5eb910 2024-05-08T08:20:10.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.682+0000 7ffa79800700 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e5eefa0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c005580 tx=0x7ffa6c005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2aea6a305c55f2f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:20:10.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.682+0000 7ffa5aa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:20:10.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.682+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3030205075 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c022070 con 0x560c2e5eb910 2024-05-08T08:20:10.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.682+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3030205075 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(264..264 src has 1..264) ==== 9671+0+0 (secure 0 0 0) 0x7ffa6c005900 con 0x560c2e5eb910 2024-05-08T08:20:10.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.682+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3030205075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa6c004d50 con 0x560c2e5eb910 2024-05-08T08:20:10.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.683+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3030205075 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ffa6c02c050 con 0x560c2e5eb910 2024-05-08T08:20:10.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.683+0000 7ffa8609cb80 10 client.17916 fetch_fsmap learned FSMap version 42 2024-05-08T08:20:10.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.683+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3030205075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560c2e5fccd0 con 0x560c2e5eb910 2024-05-08T08:20:10.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.683+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3030205075 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa6c004d50 con 0x560c2e5eb910 2024-05-08T08:20:10.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.684+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3030205075 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ffa6c01e420 con 0x560c2e5eb910 2024-05-08T08:20:10.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.684+0000 7ffa8609cb80 10 client.17916 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:20:10.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.684+0000 7ffa8609cb80 10 client.17916 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:20:10.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.684+0000 7ffa8609cb80 20 client.17916 populate_metadata read hostname 'smithi070' 2024-05-08T08:20:10.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.684+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c2e5ff1a0 0x560c2e601590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.684+0000 7ffa8609cb80 4 client.17916 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:20:10.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.684+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3030205075 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c2e5b2230 con 0x560c2e5ff1a0 2024-05-08T08:20:10.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.684+0000 7ffa78e00700 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c2e5ff1a0 0x560c2e601590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.686+0000 7ffa78e00700 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c2e5ff1a0 0x560c2e601590 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86ed4586eb2c83f8 server_cookie=5fed36a49d89a3b1 in_seq=0 out_seq=0 2024-05-08T08:20:10.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.686+0000 7ffa5aa00700 10 client.17916 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:20:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.688+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3030205075 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560c2e5b2230 con 0x560c2e5ff1a0 2024-05-08T08:20:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.688+0000 7ffa5aa00700 10 client.17916 handle_command_reply: tid=0 2024-05-08T08:20:10.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.688+0000 7ffa8609cb80 1 client.17916 shutdown 2024-05-08T08:20:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.688+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3030205075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 msgr2=0x560c2e5eefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.688+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e5eefa0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c005580 tx=0x7ffa6c005660 comp rx=0 tx=0).stop 2024-05-08T08:20:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.689+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3030205075 shutdown_connections 2024-05-08T08:20:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.689+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c2e5ff1a0 0x560c2e601590 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.689+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e5eefa0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.689+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 0x560c2e5f1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.689+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3030205075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e5eea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.689+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3030205075 >> 172.21.15.70:0/3030205075 conn(0x560c2e513cf0 msgr2=0x560c2e5dff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:20:10.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.689+0000 7ffa5aa00700 0 client.17916 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:20:10.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.689+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3030205075 shutdown_connections 2024-05-08T08:20:10.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.690+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3030205075 wait complete. 2024-05-08T08:20:10.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.690+0000 7ffa8609cb80 20 client.17916 trim_cache size 0 max 16384 2024-05-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.729+0000 7ffa8609cb80 1 Processor -- start 2024-05-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.729+0000 7ffa8609cb80 1 -- start start 2024-05-08T08:20:10.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.730+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 0x560c2e5fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.730+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e606b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.730+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e607070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.730+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa741b84f0 con 0x560c2e5eb910 2024-05-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.730+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa741b5d80 con 0x560c2e5e5b40 2024-05-08T08:20:10.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.730+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa741b3bf0 con 0x560c2e5eaff0 2024-05-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.730+0000 7ffa78e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 0x560c2e5fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa78e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 0x560c2e5fb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:44860/0 (socket says 172.21.15.70:44860) 2024-05-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa78e00700 1 -- 172.21.15.70:0/3079331171 learned_addr learned my addr 172.21.15.70:0/3079331171 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa79800700 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e607070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa73e00700 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e606b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa79800700 1 -- 172.21.15.70:0/3079331171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 msgr2=0x560c2e606b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:20:10.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa79800700 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e606b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa79800700 1 -- 172.21.15.70:0/3079331171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 msgr2=0x560c2e5fb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:20:10.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa79800700 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 0x560c2e5fb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa79800700 1 -- 172.21.15.70:0/3079331171 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c2e5eb620 con 0x560c2e5eb910 2024-05-08T08:20:10.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.731+0000 7ffa73e00700 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e606b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:20:10.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.732+0000 7ffa79800700 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e607070 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009c70 tx=0x7ffa6c007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819f5f0d05b77143 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.732+0000 7ffa65600700 1 -- 172.21.15.70:0/3079331171 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c022040 con 0x560c2e5eb910 2024-05-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.732+0000 7ffa65600700 1 -- 172.21.15.70:0/3079331171 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa6c006000 con 0x560c2e5eb910 2024-05-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.732+0000 7ffa65600700 1 -- 172.21.15.70:0/3079331171 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c005800 con 0x560c2e5eb910 2024-05-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.733+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3079331171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 msgr2=0x560c2e607070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.733+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e607070 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009c70 tx=0x7ffa6c007b30 comp rx=0 tx=0).stop 2024-05-08T08:20:10.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.733+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3079331171 shutdown_connections 2024-05-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.733+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5eb910 0x560c2e607070 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.733+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5e5b40 0x560c2e5fb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.733+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3079331171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eaff0 0x560c2e606b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.733+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3079331171 >> 172.21.15.70:0/3079331171 conn(0x560c2e513cf0 msgr2=0x560c2e5ea470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.733+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3079331171 shutdown_connections 2024-05-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.734+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3079331171 wait complete. 2024-05-08T08:20:10.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.734+0000 7ffa8609cb80 1 -- start start 2024-05-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.734+0000 7ffa8609cb80 1 Processor -- start 2024-05-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.735+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.735+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eaff0 0x560c2e5f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.735+0000 7ffa8609cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eb910 0x560c2e5f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.735+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffa741b4240 con 0x560c2e5e5b40 2024-05-08T08:20:10.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.735+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffa741b56b0 con 0x560c2e5eaff0 2024-05-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.735+0000 7ffa8609cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffa741b4910 con 0x560c2e5eb910 2024-05-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.735+0000 7ffa8609cb80 10 client.0 _ll_register_callbacks cb 0x560c2e4dee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa78e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa78e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5f7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54150/0 (socket says 172.21.15.70:54150) 2024-05-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa78e00700 1 -- 172.21.15.70:0/3358280848 learned_addr learned my addr 172.21.15.70:0/3358280848 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa73e00700 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eaff0 0x560c2e5f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa78e00700 1 -- 172.21.15.70:0/3358280848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eb910 msgr2=0x560c2e5f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:20:10.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa79800700 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eb910 0x560c2e5f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa78e00700 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eb910 0x560c2e5f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa78e00700 1 -- 172.21.15.70:0/3358280848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eaff0 msgr2=0x560c2e5f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:20:10.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa78e00700 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eaff0 0x560c2e5f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:10.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa78e00700 1 -- 172.21.15.70:0/3358280848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c2e5f6ff0 con 0x560c2e5e5b40 2024-05-08T08:20:10.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.736+0000 7ffa73e00700 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eaff0 0x560c2e5f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:20:10.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.737+0000 7ffa79800700 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eb910 0x560c2e5f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:20:10.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.737+0000 7ffa78e00700 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5f7e10 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ffa68015000 tx=0x7ffa68009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fce3bad9a390c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:20:10.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.737+0000 7ffa5aa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:20:10.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.737+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3358280848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa68039060 con 0x560c2e5e5b40 2024-05-08T08:20:10.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.737+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3358280848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(264..264 src has 1..264) ==== 9671+0+0 (secure 0 0 0) 0x7ffa6800fd10 con 0x560c2e5e5b40 2024-05-08T08:20:10.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.738+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3358280848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa6c006000 con 0x560c2e5e5b40 2024-05-08T08:20:10.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.738+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3358280848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ffa68032430 con 0x560c2e5e5b40 2024-05-08T08:20:10.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.738+0000 7ffa8609cb80 10 client.17922 fetch_fsmap learned FSMap version 42 2024-05-08T08:20:10.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.738+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3358280848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560c2e66a780 con 0x560c2e5e5b40 2024-05-08T08:20:10.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.738+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3358280848 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa6c006000 con 0x560c2e5e5b40 2024-05-08T08:20:10.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.739+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3358280848 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ffa68022070 con 0x560c2e5e5b40 2024-05-08T08:20:10.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.739+0000 7ffa8609cb80 10 client.17922 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:20:10.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.739+0000 7ffa8609cb80 10 client.17922 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:20:10.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.739+0000 7ffa8609cb80 20 client.17922 populate_metadata read hostname 'smithi070' 2024-05-08T08:20:10.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.739+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c2e66aee0 0x560c2e66d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:20:10.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.739+0000 7ffa8609cb80 4 client.17922 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T08:20:10.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.739+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3358280848 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x560c2e545590 con 0x560c2e66aee0 2024-05-08T08:20:10.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.740+0000 7ffa73e00700 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c2e66aee0 0x560c2e66d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:20:10.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.741+0000 7ffa73e00700 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c2e66aee0 0x560c2e66d300 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c2120d735633a4e server_cookie=d99692bef2a3a52 in_seq=0 out_seq=0 2024-05-08T08:20:10.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:10.741+0000 7ffa5aa00700 10 client.17922 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:20:11.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:11 smithi172 ceph-mon[33377]: pgmap v2981: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 634 KiB/s wr, 42 op/s 2024-05-08T08:20:11.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:11 smithi194 ceph-mon[33679]: pgmap v2981: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 634 KiB/s wr, 42 op/s 2024-05-08T08:20:11.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:11 smithi070 ceph-mon[29591]: pgmap v2981: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 634 KiB/s wr, 42 op/s 2024-05-08T08:20:11.958 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlink/policy.o 2024-05-08T08:20:13.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:13 smithi172 ceph-mon[33377]: pgmap v2982: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 634 KiB/s wr, 42 op/s 2024-05-08T08:20:13.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:13 smithi194 ceph-mon[33679]: pgmap v2982: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 634 KiB/s wr, 42 op/s 2024-05-08T08:20:13.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:13 smithi070 ceph-mon[29591]: pgmap v2982: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 634 KiB/s wr, 42 op/s 2024-05-08T08:20:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:15 smithi194 ceph-mon[33679]: pgmap v2983: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 634 KiB/s wr, 42 op/s 2024-05-08T08:20:15.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:15 smithi070 ceph-mon[29591]: pgmap v2983: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 634 KiB/s wr, 42 op/s 2024-05-08T08:20:15.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:15 smithi172 ceph-mon[33377]: pgmap v2983: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 634 KiB/s wr, 42 op/s 2024-05-08T08:20:16.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:16 smithi194 ceph-mon[33679]: pgmap v2984: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 563 KiB/s wr, 24 op/s 2024-05-08T08:20:16.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:16 smithi070 ceph-mon[29591]: pgmap v2984: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 563 KiB/s wr, 24 op/s 2024-05-08T08:20:16.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:16 smithi172 ceph-mon[33377]: pgmap v2984: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 563 KiB/s wr, 24 op/s 2024-05-08T08:20:18.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:18 smithi070 ceph-mon[29591]: pgmap v2985: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 563 KiB/s wr, 24 op/s 2024-05-08T08:20:18.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:18 smithi172 ceph-mon[33377]: pgmap v2985: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 563 KiB/s wr, 24 op/s 2024-05-08T08:20:18.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:18 smithi194 ceph-mon[33679]: pgmap v2985: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 563 KiB/s wr, 24 op/s 2024-05-08T08:20:20.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:20 smithi194 ceph-mon[33679]: osdmap e265: 12 total, 12 up, 12 in 2024-05-08T08:20:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:20 smithi070 ceph-mon[29591]: osdmap e265: 12 total, 12 up, 12 in 2024-05-08T08:20:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:20 smithi172 ceph-mon[33377]: osdmap e265: 12 total, 12 up, 12 in 2024-05-08T08:20:21.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:21 smithi194 ceph-mon[33679]: pgmap v2987: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 338 KiB/s wr, 26 op/s 2024-05-08T08:20:21.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:21 smithi070 ceph-mon[29591]: pgmap v2987: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 338 KiB/s wr, 26 op/s 2024-05-08T08:20:21.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:21 smithi172 ceph-mon[33377]: pgmap v2987: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 338 KiB/s wr, 26 op/s 2024-05-08T08:20:23.458 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:23 smithi070 ceph-mon[29591]: pgmap v2988: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 338 KiB/s wr, 26 op/s 2024-05-08T08:20:23.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:23 smithi194 ceph-mon[33679]: pgmap v2988: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 338 KiB/s wr, 26 op/s 2024-05-08T08:20:23.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:23 smithi172 ceph-mon[33377]: pgmap v2988: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 338 KiB/s wr, 26 op/s 2024-05-08T08:20:24.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:24 smithi194 ceph-mon[33679]: pgmap v2989: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 338 KiB/s wr, 26 op/s 2024-05-08T08:20:24.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:24 smithi070 ceph-mon[29591]: pgmap v2989: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 338 KiB/s wr, 26 op/s 2024-05-08T08:20:24.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:24 smithi172 ceph-mon[33377]: pgmap v2989: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 338 KiB/s wr, 26 op/s 2024-05-08T08:20:26.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:26 smithi070 ceph-mon[29591]: pgmap v2990: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 149 KiB/s wr, 17 op/s 2024-05-08T08:20:26.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:26 smithi172 ceph-mon[33377]: pgmap v2990: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 149 KiB/s wr, 17 op/s 2024-05-08T08:20:26.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:26 smithi194 ceph-mon[33679]: pgmap v2990: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 149 KiB/s wr, 17 op/s 2024-05-08T08:20:28.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:28 smithi070 ceph-mon[29591]: pgmap v2991: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 149 KiB/s wr, 17 op/s 2024-05-08T08:20:28.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:28 smithi172 ceph-mon[33377]: pgmap v2991: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 149 KiB/s wr, 17 op/s 2024-05-08T08:20:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:28 smithi194 ceph-mon[33679]: pgmap v2991: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 149 KiB/s wr, 17 op/s 2024-05-08T08:20:31.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:31 smithi194 ceph-mon[33679]: pgmap v2992: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 8 op/s 2024-05-08T08:20:31.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:31 smithi070 ceph-mon[29591]: pgmap v2992: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 8 op/s 2024-05-08T08:20:31.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:31 smithi172 ceph-mon[33377]: pgmap v2992: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 8 op/s 2024-05-08T08:20:33.495 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:33 smithi070 ceph-mon[29591]: pgmap v2993: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.499+0000 7ffa5aa00700 1 -- 172.21.15.70:0/3358280848 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x560c2e545590 con 0x560c2e66aee0 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.499+0000 7ffa5aa00700 10 client.17922 handle_command_reply: tid=0 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.499+0000 7ffa8609cb80 1 client.17922 shutdown 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.500+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3358280848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 msgr2=0x560c2e5f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.500+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5f7e10 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7ffa68015000 tx=0x7ffa68009310 comp rx=0 tx=0).stop 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.500+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3358280848 shutdown_connections 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.500+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c2e66aee0 0x560c2e66d300 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.501+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c2e5eb910 0x560c2e5f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.501+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c2e5e5b40 0x560c2e5f7e10 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.501+0000 7ffa8609cb80 1 --2- 172.21.15.70:0/3358280848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c2e5eaff0 0x560c2e5f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.501+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3358280848 >> 172.21.15.70:0/3358280848 conn(0x560c2e513cf0 msgr2=0x560c2e5efef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.501+0000 7ffa5aa00700 0 client.17922 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:20:33.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.501+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3358280848 shutdown_connections 2024-05-08T08:20:33.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.501+0000 7ffa8609cb80 1 -- 172.21.15.70:0/3358280848 wait complete. 2024-05-08T08:20:33.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.501+0000 7ffa8609cb80 20 client.17922 trim_cache size 0 max 16384 2024-05-08T08:20:33.497 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:20:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:20:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:20:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 214, 2024-05-08T08:20:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:20:33.497 INFO:teuthology.orchestra.run.smithi070.stdout: "52d90407": { 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 214, 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:20:33.498 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:20:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:20:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:20:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:20:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:20:33.499 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:20:33.499 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 -- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa5c0b2aa0 msgr2=0x7ffa5c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa5c0b2aa0 0x7ffa5c0b4f60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ffa6800b650 tx=0x7ffa6801a040 comp rx=0 tx=0).stop 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 -- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079fb0 msgr2=0x7ffa741a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079fb0 0x7ffa741a04e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7ffa6000e9a0 tx=0x7ffa6000ed60 comp rx=0 tx=0).stop 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 -- 172.21.15.70:0/688791593 shutdown_connections 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffa5c0b2aa0 0x7ffa5c0b4f60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa741141a0 0x7ffa741a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffa74079600 0x7ffa7419ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 --2- 172.21.15.70:0/688791593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffa74079fb0 0x7ffa741a04e0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.503+0000 7ffa7a200700 1 -- 172.21.15.70:0/688791593 >> 172.21.15.70:0/688791593 conn(0x7ffa74100fb0 msgr2=0x7ffa741033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.504+0000 7ffa7a200700 1 -- 172.21.15.70:0/688791593 shutdown_connections 2024-05-08T08:20:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:20:33.504+0000 7ffa7a200700 1 -- 172.21.15.70:0/688791593 wait complete. 2024-05-08T08:20:33.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:33 smithi194 ceph-mon[33679]: pgmap v2993: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2024-05-08T08:20:33.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:33 smithi172 ceph-mon[33377]: pgmap v2993: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2024-05-08T08:20:34.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:34 smithi194 ceph-mon[33679]: pgmap v2994: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2024-05-08T08:20:34.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:34 smithi070 ceph-mon[29591]: pgmap v2994: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2024-05-08T08:20:34.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:34 smithi172 ceph-mon[33377]: pgmap v2994: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2024-05-08T08:20:35.099 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '52d90407', quiesce took 42.6 seconds. Will release after: 30.0 2024-05-08T08:20:36.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:36 smithi070 ceph-mon[29591]: pgmap v2995: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 10 op/s 2024-05-08T08:20:36.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:36 smithi172 ceph-mon[33377]: pgmap v2995: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 10 op/s 2024-05-08T08:20:36.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:36 smithi194 ceph-mon[33679]: pgmap v2995: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 10 op/s 2024-05-08T08:20:38.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:38 smithi070 ceph-mon[29591]: pgmap v2996: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 105 KiB/s wr, 7 op/s 2024-05-08T08:20:38.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:38 smithi172 ceph-mon[33377]: pgmap v2996: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 105 KiB/s wr, 7 op/s 2024-05-08T08:20:38.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:38 smithi194 ceph-mon[33679]: pgmap v2996: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 105 KiB/s wr, 7 op/s 2024-05-08T08:20:40.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:40 smithi070 ceph-mon[29591]: pgmap v2997: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 171 KiB/s wr, 11 op/s 2024-05-08T08:20:40.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:40 smithi172 ceph-mon[33377]: pgmap v2997: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 171 KiB/s wr, 11 op/s 2024-05-08T08:20:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:40 smithi194 ceph-mon[33679]: pgmap v2997: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 171 KiB/s wr, 11 op/s 2024-05-08T08:20:42.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:42 smithi070 ceph-mon[29591]: pgmap v2998: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 123 KiB/s wr, 7 op/s 2024-05-08T08:20:42.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:42 smithi172 ceph-mon[33377]: pgmap v2998: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 123 KiB/s wr, 7 op/s 2024-05-08T08:20:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:42 smithi194 ceph-mon[33679]: pgmap v2998: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 123 KiB/s wr, 7 op/s 2024-05-08T08:20:44.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:44 smithi070 ceph-mon[29591]: pgmap v2999: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 123 KiB/s wr, 7 op/s 2024-05-08T08:20:44.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:44 smithi172 ceph-mon[33377]: pgmap v2999: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 123 KiB/s wr, 7 op/s 2024-05-08T08:20:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:44 smithi194 ceph-mon[33679]: pgmap v2999: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 123 KiB/s wr, 7 op/s 2024-05-08T08:20:46.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:46 smithi070 ceph-mon[29591]: pgmap v3000: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-05-08T08:20:46.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:46 smithi172 ceph-mon[33377]: pgmap v3000: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-05-08T08:20:46.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:46 smithi194 ceph-mon[33679]: pgmap v3000: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 163 KiB/s wr, 11 op/s 2024-05-08T08:20:48.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:48 smithi070 ceph-mon[29591]: pgmap v3001: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 106 KiB/s wr, 7 op/s 2024-05-08T08:20:48.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:48 smithi172 ceph-mon[33377]: pgmap v3001: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 106 KiB/s wr, 7 op/s 2024-05-08T08:20:48.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:48 smithi194 ceph-mon[33679]: pgmap v3001: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 106 KiB/s wr, 7 op/s 2024-05-08T08:20:50.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:50 smithi070 ceph-mon[29591]: pgmap v3002: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 106 KiB/s wr, 10 op/s 2024-05-08T08:20:50.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:50 smithi172 ceph-mon[33377]: pgmap v3002: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 106 KiB/s wr, 10 op/s 2024-05-08T08:20:50.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:50 smithi194 ceph-mon[33679]: pgmap v3002: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 106 KiB/s wr, 10 op/s 2024-05-08T08:20:52.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:52 smithi070 ceph-mon[29591]: pgmap v3003: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 5 op/s 2024-05-08T08:20:52.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:52 smithi172 ceph-mon[33377]: pgmap v3003: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 5 op/s 2024-05-08T08:20:52.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:52 smithi194 ceph-mon[33679]: pgmap v3003: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 5 op/s 2024-05-08T08:20:54.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:54 smithi070 ceph-mon[29591]: pgmap v3004: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 5 op/s 2024-05-08T08:20:54.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:54 smithi172 ceph-mon[33377]: pgmap v3004: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 5 op/s 2024-05-08T08:20:54.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:54 smithi194 ceph-mon[33679]: pgmap v3004: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 5 op/s 2024-05-08T08:20:56.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:56 smithi070 ceph-mon[29591]: pgmap v3005: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 8 op/s 2024-05-08T08:20:56.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:56 smithi172 ceph-mon[33377]: pgmap v3005: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 8 op/s 2024-05-08T08:20:56.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:56 smithi194 ceph-mon[33679]: pgmap v3005: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 8 op/s 2024-05-08T08:20:58.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:20:58 smithi172 ceph-mon[33377]: pgmap v3006: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-05-08T08:20:58.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:20:58 smithi194 ceph-mon[33679]: pgmap v3006: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-05-08T08:20:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:20:58 smithi070 ceph-mon[29591]: pgmap v3006: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-05-08T08:21:00.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:00 smithi172 ceph-mon[33377]: pgmap v3007: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-05-08T08:21:00.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:00 smithi194 ceph-mon[33679]: pgmap v3007: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-05-08T08:21:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:00 smithi070 ceph-mon[29591]: pgmap v3007: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 4.7 KiB/s wr, 7 op/s 2024-05-08T08:21:02.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:02 smithi172 ceph-mon[33377]: pgmap v3008: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-05-08T08:21:02.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:02 smithi194 ceph-mon[33679]: pgmap v3008: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-05-08T08:21:02.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:02 smithi070 ceph-mon[29591]: pgmap v3008: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-05-08T08:21:04.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:04 smithi172 ceph-mon[33377]: pgmap v3009: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-05-08T08:21:04.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:21:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:04 smithi194 ceph-mon[33679]: pgmap v3009: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-05-08T08:21:04.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:21:04.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:04 smithi070 ceph-mon[29591]: pgmap v3009: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-05-08T08:21:04.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:21:05.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:21:05.532 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:21:05.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:21:05.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:21:05.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:21:05.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:21:05.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:21:05.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:21:05.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:21:05.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:21:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:21:06.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:06 smithi070 ceph-mon[29591]: pgmap v3010: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-05-08T08:21:06.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:06 smithi172 ceph-mon[33377]: pgmap v3010: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-05-08T08:21:06.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:06 smithi194 ceph-mon[33679]: pgmap v3010: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 50 KiB/s wr, 24 op/s 2024-05-08T08:21:08.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.107+0000 7fb263e00700 1 -- 172.21.15.70:0/1604643374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c06b180 msgr2=0x7fb25c06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:08.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.107+0000 7fb263e00700 1 --2- 172.21.15.70:0/1604643374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c06b180 0x7fb25c06b600 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fb248009990 tx=0x7fb248009ca0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.107+0000 7fb263e00700 1 -- 172.21.15.70:0/1604643374 shutdown_connections 2024-05-08T08:21:08.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.107+0000 7fb263e00700 1 --2- 172.21.15.70:0/1604643374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c06bb40 0x7fb25c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.107+0000 7fb263e00700 1 --2- 172.21.15.70:0/1604643374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c109510 0x7fb25c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.107+0000 7fb263e00700 1 --2- 172.21.15.70:0/1604643374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c06b180 0x7fb25c06b600 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.107+0000 7fb263e00700 1 -- 172.21.15.70:0/1604643374 >> 172.21.15.70:0/1604643374 conn(0x7fb25c079350 msgr2=0x7fb25c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:08.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.107+0000 7fb263e00700 1 -- 172.21.15.70:0/1604643374 shutdown_connections 2024-05-08T08:21:08.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.107+0000 7fb263e00700 1 -- 172.21.15.70:0/1604643374 wait complete. 2024-05-08T08:21:08.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.108+0000 7fb263e00700 1 Processor -- start 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.108+0000 7fb263e00700 1 -- start start 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.108+0000 7fb263e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c06b180 0x7fb25c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.108+0000 7fb263e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c06bb40 0x7fb25c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb263e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c109510 0x7fb25c1998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb263e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c113520 con 0x7fb25c109510 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb263e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c1133a0 con 0x7fb25c06bb40 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb263e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c1136a0 con 0x7fb25c06b180 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb261e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c109510 0x7fb25c1998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb261e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c109510 0x7fb25c1998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53966/0 (socket says 172.21.15.70:53966) 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb261e00700 1 -- 172.21.15.70:0/232324582 learned_addr learned my addr 172.21.15.70:0/232324582 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:08.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb261400700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c06b180 0x7fb25c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb260a00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c06bb40 0x7fb25c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb261e00700 1 -- 172.21.15.70:0/232324582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c06b180 msgr2=0x7fb25c19f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb261e00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c06b180 0x7fb25c19f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb261e00700 1 -- 172.21.15.70:0/232324582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c06bb40 msgr2=0x7fb25c19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb261e00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c06bb40 0x7fb25c19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb261e00700 1 -- 172.21.15.70:0/232324582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c19a040 con 0x7fb25c109510 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.109+0000 7fb260a00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c06bb40 0x7fb25c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.110+0000 7fb261e00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c109510 0x7fb25c1998e0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fb254007d70 tx=0x7fb25400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.110+0000 7fb25a000700 1 -- 172.21.15.70:0/232324582 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254016020 con 0x7fb25c109510 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.110+0000 7fb25a000700 1 -- 172.21.15.70:0/232324582 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb25400ad40 con 0x7fb25c109510 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.110+0000 7fb25a000700 1 -- 172.21.15.70:0/232324582 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2540115e0 con 0x7fb25c109510 2024-05-08T08:21:08.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.110+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25c19a330 con 0x7fb25c109510 2024-05-08T08:21:08.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.110+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25c1a65a0 con 0x7fb25c109510 2024-05-08T08:21:08.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.111+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25c06a190 con 0x7fb25c109510 2024-05-08T08:21:08.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.114+0000 7fb25a000700 1 -- 172.21.15.70:0/232324582 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb254019020 con 0x7fb25c109510 2024-05-08T08:21:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.115+0000 7fb25a000700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb2440b29f0 0x7fb2440b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.115+0000 7fb25a000700 1 -- 172.21.15.70:0/232324582 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(265..265 src has 1..265) ==== 9583+0+0 (secure 0 0 0) 0x7fb2540e2a20 con 0x7fb25c109510 2024-05-08T08:21:08.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.116+0000 7fb261400700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb2440b29f0 0x7fb2440b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:08.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.117+0000 7fb261400700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb2440b29f0 0x7fb2440b4eb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb250005fd0 tx=0x7fb25000af00 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:08.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.120+0000 7fb25a000700 1 -- 172.21.15.70:0/232324582 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb254020020 con 0x7fb25c109510 2024-05-08T08:21:08.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.398+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb25c19adc0 con 0x7fb25c109510 2024-05-08T08:21:08.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.399+0000 7fb25a000700 1 -- 172.21.15.70:0/232324582 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fb2540aa090 con 0x7fb25c109510 2024-05-08T08:21:08.393 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:21:08.393 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:21:08.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb2440b29f0 msgr2=0x7fb2440b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:08.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb2440b29f0 0x7fb2440b4eb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb250005fd0 tx=0x7fb25000af00 comp rx=0 tx=0).stop 2024-05-08T08:21:08.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c109510 msgr2=0x7fb25c1998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c109510 0x7fb25c1998e0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fb254007d70 tx=0x7fb25400a340 comp rx=0 tx=0).stop 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 shutdown_connections 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb2440b29f0 0x7fb2440b4eb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25c109510 0x7fb25c1998e0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25c06b180 0x7fb25c19f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 --2- 172.21.15.70:0/232324582 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25c06bb40 0x7fb25c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.402+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 >> 172.21.15.70:0/232324582 conn(0x7fb25c079350 msgr2=0x7fb25c101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.403+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 shutdown_connections 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:08.403+0000 7fb263e00700 1 -- 172.21.15.70:0/232324582 wait complete. 2024-05-08T08:21:08.399 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:21:08.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:08 smithi172 ceph-mon[33377]: pgmap v3011: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T08:21:08.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/232324582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:21:08.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:08 smithi194 ceph-mon[33679]: pgmap v3011: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T08:21:08.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/232324582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:21:08.844 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:08 smithi070 ceph-mon[29591]: pgmap v3011: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T08:21:08.844 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/232324582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:21:09.376 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 52d90407 --release --await' 2024-05-08T08:21:09.376 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 52d90407 --release --await 2024-05-08T08:21:09.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:09 smithi070 ceph-mon[29591]: osdmap e266: 12 total, 12 up, 12 in 2024-05-08T08:21:09.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:09 smithi194 ceph-mon[33679]: osdmap e266: 12 total, 12 up, 12 in 2024-05-08T08:21:09.830 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:21:09.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:09 smithi172 ceph-mon[33377]: osdmap e266: 12 total, 12 up, 12 in 2024-05-08T08:21:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:10 smithi194 ceph-mon[33679]: pgmap v3013: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:21:10.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:10 smithi070 ceph-mon[29591]: pgmap v3013: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:21:10.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:10 smithi172 ceph-mon[33377]: pgmap v3013: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:21:12.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:12 smithi070 ceph-mon[29591]: pgmap v3014: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:21:12.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:12 smithi194 ceph-mon[33679]: pgmap v3014: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:21:12.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:12 smithi172 ceph-mon[33377]: pgmap v3014: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:21:13.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.524+0000 7fddd8200700 1 -- 172.21.15.70:0/412736872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd010fb60 msgr2=0x7fddd010ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:13.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.524+0000 7fddd8200700 1 --2- 172.21.15.70:0/412736872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd010fb60 0x7fddd010ff40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009990 tx=0x7fddc4009ca0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.524+0000 7fddd8200700 1 -- 172.21.15.70:0/412736872 shutdown_connections 2024-05-08T08:21:13.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.524+0000 7fddd8200700 1 --2- 172.21.15.70:0/412736872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd010a490 0x7fddd01169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.524+0000 7fddd8200700 1 --2- 172.21.15.70:0/412736872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd010fb60 0x7fddd010ff40 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.524+0000 7fddd8200700 1 --2- 172.21.15.70:0/412736872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd0109ad0 0x7fddd0109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.524+0000 7fddd8200700 1 -- 172.21.15.70:0/412736872 >> 172.21.15.70:0/412736872 conn(0x7fddd0076c70 msgr2=0x7fddd01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:13.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.525+0000 7fddd8200700 1 -- 172.21.15.70:0/412736872 shutdown_connections 2024-05-08T08:21:13.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.525+0000 7fddd8200700 1 -- 172.21.15.70:0/412736872 wait complete. 2024-05-08T08:21:13.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.526+0000 7fddd8200700 1 Processor -- start 2024-05-08T08:21:13.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.526+0000 7fddd8200700 1 -- start start 2024-05-08T08:21:13.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.526+0000 7fddd8200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0109ad0 0x7fddd01a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd8200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd010a490 0x7fddd01a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd8200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd010fb60 0x7fddd01a48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd8200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0119b60 con 0x7fddd0109ad0 2024-05-08T08:21:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd8200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddd01199e0 con 0x7fddd010fb60 2024-05-08T08:21:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd8200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fddd0119ce0 con 0x7fddd010a490 2024-05-08T08:21:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd5800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0109ad0 0x7fddd01a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd5800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0109ad0 0x7fddd01a0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53980/0 (socket says 172.21.15.70:53980) 2024-05-08T08:21:13.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd5800700 1 -- 172.21.15.70:0/2944852010 learned_addr learned my addr 172.21.15.70:0/2944852010 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd4e00700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd010a490 0x7fddd01a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd5800700 1 -- 172.21.15.70:0/2944852010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd010a490 msgr2=0x7fddd01a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd6200700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd010fb60 0x7fddd01a48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd5800700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd010a490 0x7fddd01a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd5800700 1 -- 172.21.15.70:0/2944852010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd010fb60 msgr2=0x7fddd01a48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd5800700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd010fb60 0x7fddd01a48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd5800700 1 -- 172.21.15.70:0/2944852010 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd01a5020 con 0x7fddd0109ad0 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd4e00700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd010a490 0x7fddd01a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.527+0000 7fddd6200700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd010fb60 0x7fddd01a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:21:13.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.528+0000 7fddd5800700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0109ad0 0x7fddd01a0010 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fddc40057f0 tx=0x7fddc4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.528+0000 7fddce000700 1 -- 172.21.15.70:0/2944852010 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4027070 con 0x7fddd0109ad0 2024-05-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.528+0000 7fddce000700 1 -- 172.21.15.70:0/2944852010 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddc400fd60 con 0x7fddd0109ad0 2024-05-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.528+0000 7fddd8200700 1 -- 172.21.15.70:0/2944852010 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd01a52b0 con 0x7fddd0109ad0 2024-05-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.528+0000 7fddce000700 1 -- 172.21.15.70:0/2944852010 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4022d70 con 0x7fddd0109ad0 2024-05-08T08:21:13.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.528+0000 7fddd8200700 1 -- 172.21.15.70:0/2944852010 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd01acb90 con 0x7fddd0109ad0 2024-05-08T08:21:13.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.532+0000 7fddce000700 1 -- 172.21.15.70:0/2944852010 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fddc402a070 con 0x7fddd0109ad0 2024-05-08T08:21:13.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.533+0000 7fddce000700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fddb80b2af0 0x7fddb80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.534+0000 7fddce000700 1 -- 172.21.15.70:0/2944852010 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(266..266 src has 1..266) ==== 9671+0+0 (secure 0 0 0) 0x7fddc40e3a30 con 0x7fddd0109ad0 2024-05-08T08:21:13.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.534+0000 7fddd4e00700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fddb80b2af0 0x7fddb80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.534+0000 7fddd4e00700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fddb80b2af0 0x7fddb80b4fb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fddbc005fd0 tx=0x7fddbc005e20 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:13.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.559+0000 7fdde2b20b80 1 Processor -- start 2024-05-08T08:21:13.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.559+0000 7fdde2b20b80 1 -- start start 2024-05-08T08:21:13.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.560+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f132a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.560+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 0x55de67f0d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.560+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 0x55de67f19c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.560+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55de67e5fb20 con 0x55de67f12ec0 2024-05-08T08:21:13.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.560+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55de67dfd860 con 0x55de67f0de50 2024-05-08T08:21:13.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.560+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55de67e5bae0 con 0x55de67f0d490 2024-05-08T08:21:13.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.561+0000 7fddd4e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 0x55de67f0d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.561+0000 7fddd4e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 0x55de67f0d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:59784/0 (socket says 172.21.15.70:59784) 2024-05-08T08:21:13.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.561+0000 7fddd4e00700 1 -- 172.21.15.70:0/1066798096 learned_addr learned my addr 172.21.15.70:0/1066798096 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:13.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.561+0000 7fddd5800700 1 --2- 172.21.15.70:0/1066798096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.561+0000 7fddd6200700 1 --2- 172.21.15.70:0/1066798096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 0x55de67f19c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.562+0000 7fddd5800700 1 -- 172.21.15.70:0/1066798096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 msgr2=0x55de67f0d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:13.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.562+0000 7fddd5800700 1 --2- 172.21.15.70:0/1066798096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 0x55de67f0d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.562+0000 7fddd5800700 1 -- 172.21.15.70:0/1066798096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 msgr2=0x55de67f19c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:13.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.562+0000 7fddd5800700 1 --2- 172.21.15.70:0/1066798096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 0x55de67f19c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.562+0000 7fddd5800700 1 -- 172.21.15.70:0/1066798096 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de67dac9d0 con 0x55de67f12ec0 2024-05-08T08:21:13.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.562+0000 7fddd5800700 1 --2- 172.21.15.70:0/1066798096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f132a0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fddc40e0ca0 tx=0x7fddc4022470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57157f482c5a4462 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:13.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.562+0000 7fddc2a00700 1 -- 172.21.15.70:0/1066798096 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40aafc0 con 0x55de67f12ec0 2024-05-08T08:21:13.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.562+0000 7fddc2a00700 1 -- 172.21.15.70:0/1066798096 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddc40aa8c0 con 0x55de67f12ec0 2024-05-08T08:21:13.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.562+0000 7fddc2a00700 1 -- 172.21.15.70:0/1066798096 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc40e0f20 con 0x55de67f12ec0 2024-05-08T08:21:13.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.563+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1066798096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 msgr2=0x55de67f132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:13.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.563+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/1066798096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f132a0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fddc40e0ca0 tx=0x7fddc4022470 comp rx=0 tx=0).stop 2024-05-08T08:21:13.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.563+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1066798096 shutdown_connections 2024-05-08T08:21:13.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.563+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/1066798096 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 0x55de67f19c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.563+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/1066798096 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f132a0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.563+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/1066798096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 0x55de67f0d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.563+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1066798096 >> 172.21.15.70:0/1066798096 conn(0x55de67e3bc60 msgr2=0x55de67f07d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.563+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1066798096 shutdown_connections 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.563+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1066798096 wait complete. 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.564+0000 7fdde2b20b80 1 -- start start 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.564+0000 7fdde2b20b80 1 Processor -- start 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 0x55de67f198c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 0x55de67f16c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f171a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55de67f139d0 con 0x55de67f12ec0 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55de67dc5c20 con 0x55de67f0de50 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55de67f1a1c0 con 0x55de67f0d490 2024-05-08T08:21:13.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fdde2b20b80 10 client.0 _ll_register_callbacks cb 0x55de67e06d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fddd6200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fddd6200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f171a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53986/0 (socket says 172.21.15.70:53986) 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fddd6200700 1 -- 172.21.15.70:0/3245913062 learned_addr learned my addr 172.21.15.70:0/3245913062 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fddd4e00700 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 0x55de67f16c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.565+0000 7fddd5800700 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 0x55de67f198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddd6200700 1 -- 172.21.15.70:0/3245913062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 msgr2=0x55de67f198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddd6200700 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 0x55de67f198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddd6200700 1 -- 172.21.15.70:0/3245913062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 msgr2=0x55de67f16c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddd6200700 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 0x55de67f16c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddd6200700 1 -- 172.21.15.70:0/3245913062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de67e25520 con 0x55de67f12ec0 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddd6200700 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f171a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fddc8008ed0 tx=0x7fddc80104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5875279a0522a1d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:13.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddb7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:21:13.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddb7400700 1 -- 172.21.15.70:0/3245913062 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8019020 con 0x55de67f12ec0 2024-05-08T08:21:13.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fdde2b20b80 1 -- 172.21.15.70:0/3245913062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc40aa8c0 con 0x55de67f12ec0 2024-05-08T08:21:13.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddb7400700 1 -- 172.21.15.70:0/3245913062 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(266..266 src has 1..266) ==== 9671+0+0 (secure 0 0 0) 0x7fddc8010cd0 con 0x55de67f12ec0 2024-05-08T08:21:13.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.566+0000 7fddb7400700 1 -- 172.21.15.70:0/3245913062 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fddc8024050 con 0x55de67f12ec0 2024-05-08T08:21:13.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fdde2b20b80 10 client.17940 fetch_fsmap learned FSMap version 42 2024-05-08T08:21:13.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fdde2b20b80 1 -- 172.21.15.70:0/3245913062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55de67f247d0 con 0x55de67f12ec0 2024-05-08T08:21:13.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fddb7400700 1 -- 172.21.15.70:0/3245913062 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddc40aa8c0 con 0x55de67f12ec0 2024-05-08T08:21:13.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fddb7400700 1 -- 172.21.15.70:0/3245913062 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fddc80143d0 con 0x55de67f12ec0 2024-05-08T08:21:13.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fdde2b20b80 10 client.17940 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:21:13.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fdde2b20b80 10 client.17940 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:21:13.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fdde2b20b80 20 client.17940 populate_metadata read hostname 'smithi070' 2024-05-08T08:21:13.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55de67f26eb0 0x55de67f292d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fdde2b20b80 4 client.17940 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:21:13.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.567+0000 7fdde2b20b80 1 -- 172.21.15.70:0/3245913062 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de67eda1a0 con 0x55de67f26eb0 2024-05-08T08:21:13.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.568+0000 7fddd5800700 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55de67f26eb0 0x55de67f292d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.569+0000 7fddd5800700 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55de67f26eb0 0x55de67f292d0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c90a40565bff1b2 server_cookie=2ca1f4b3c70b131 in_seq=0 out_seq=0 2024-05-08T08:21:13.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.569+0000 7fddb7400700 10 client.17940 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:21:13.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fddb7400700 1 -- 172.21.15.70:0/3245913062 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55de67eda1a0 con 0x55de67f26eb0 2024-05-08T08:21:13.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fddb7400700 10 client.17940 handle_command_reply: tid=0 2024-05-08T08:21:13.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 client.17940 shutdown 2024-05-08T08:21:13.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 -- 172.21.15.70:0/3245913062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 msgr2=0x55de67f171a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:13.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f171a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fddc8008ed0 tx=0x7fddc80104b0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 -- 172.21.15.70:0/3245913062 shutdown_connections 2024-05-08T08:21:13.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55de67f26eb0 0x55de67f292d0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f171a0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0d490 0x55de67f198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/3245913062 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0de50 0x55de67f16c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 -- 172.21.15.70:0/3245913062 >> 172.21.15.70:0/3245913062 conn(0x55de67e3bc60 msgr2=0x55de67f02850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:13.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fddb7400700 0 client.17940 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:21:13.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 -- 172.21.15.70:0/3245913062 shutdown_connections 2024-05-08T08:21:13.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.571+0000 7fdde2b20b80 1 -- 172.21.15.70:0/3245913062 wait complete. 2024-05-08T08:21:13.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.572+0000 7fdde2b20b80 20 client.17940 trim_cache size 0 max 16384 2024-05-08T08:21:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.593+0000 7fdde2b20b80 1 Processor -- start 2024-05-08T08:21:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.593+0000 7fdde2b20b80 1 -- start start 2024-05-08T08:21:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.593+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0d490 0x55de67f22f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.593+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0de50 0x55de67f123f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.593+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f2eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.593+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fddd01b8560 con 0x55de67f12ec0 2024-05-08T08:21:13.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.593+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddd01b5df0 con 0x55de67f0d490 2024-05-08T08:21:13.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.593+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fddd01b3c60 con 0x55de67f0de50 2024-05-08T08:21:13.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.594+0000 7fddd6200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f2eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.594+0000 7fddd6200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f2eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54000/0 (socket says 172.21.15.70:54000) 2024-05-08T08:21:13.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.594+0000 7fddd6200700 1 -- 172.21.15.70:0/1638016560 learned_addr learned my addr 172.21.15.70:0/1638016560 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:13.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.594+0000 7fddd6200700 1 -- 172.21.15.70:0/1638016560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0de50 msgr2=0x55de67f123f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:13.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.594+0000 7fddd6200700 1 --2- 172.21.15.70:0/1638016560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0de50 0x55de67f123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.594+0000 7fddd6200700 1 -- 172.21.15.70:0/1638016560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0d490 msgr2=0x55de67f22f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:13.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.594+0000 7fddd6200700 1 --2- 172.21.15.70:0/1638016560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0d490 0x55de67f22f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.594+0000 7fddd6200700 1 -- 172.21.15.70:0/1638016560 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de67f04980 con 0x55de67f12ec0 2024-05-08T08:21:13.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.595+0000 7fddd6200700 1 --2- 172.21.15.70:0/1638016560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f2eb80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fddc8014840 tx=0x7fddc8004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753ac7e277486f77 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:13.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.595+0000 7fddc2000700 1 -- 172.21.15.70:0/1638016560 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc802d070 con 0x55de67f12ec0 2024-05-08T08:21:13.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.595+0000 7fddc2000700 1 -- 172.21.15.70:0/1638016560 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddc8014ec0 con 0x55de67f12ec0 2024-05-08T08:21:13.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.595+0000 7fddc2000700 1 -- 172.21.15.70:0/1638016560 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8019040 con 0x55de67f12ec0 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1638016560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 msgr2=0x55de67f2eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/1638016560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f2eb80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fddc8014840 tx=0x7fddc8004b10 comp rx=0 tx=0).stop 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1638016560 shutdown_connections 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/1638016560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f12ec0 0x55de67f2eb80 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/1638016560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0d490 0x55de67f22f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/1638016560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f0de50 0x55de67f123f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1638016560 >> 172.21.15.70:0/1638016560 conn(0x55de67e3bc60 msgr2=0x55de67f111d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1638016560 shutdown_connections 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 -- 172.21.15.70:0/1638016560 wait complete. 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 -- start start 2024-05-08T08:21:13.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.596+0000 7fdde2b20b80 1 Processor -- start 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0d490 0x55de67f8aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f0de50 0x55de67f8b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fdde2b20b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f12ec0 0x55de67f1c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fddd01b42b0 con 0x55de67f0de50 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fddd01b5720 con 0x55de67f0d490 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fdde2b20b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fddd01b4980 con 0x55de67f12ec0 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fdde2b20b80 10 client.0 _ll_register_callbacks cb 0x55de67e06d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fddd4e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f0de50 0x55de67f8b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fddd4e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f0de50 0x55de67f8b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54006/0 (socket says 172.21.15.70:54006) 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.597+0000 7fddd4e00700 1 -- 172.21.15.70:0/190826425 learned_addr learned my addr 172.21.15.70:0/190826425 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddd5800700 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0d490 0x55de67f8aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddd6200700 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f12ec0 0x55de67f1c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddd4e00700 1 -- 172.21.15.70:0/190826425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f12ec0 msgr2=0x55de67f1c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddd4e00700 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f12ec0 0x55de67f1c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddd4e00700 1 -- 172.21.15.70:0/190826425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0d490 msgr2=0x55de67f8aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddd4e00700 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0d490 0x55de67f8aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddd4e00700 1 -- 172.21.15.70:0/190826425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de67f1cee0 con 0x55de67f0de50 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddd6200700 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f12ec0 0x55de67f1c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddd4e00700 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f0de50 0x55de67f8b000 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fddbc01e6e0 tx=0x7fddbc01e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90463320207686c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddb7400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddb7400700 1 -- 172.21.15.70:0/190826425 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00f8f0 con 0x55de67f0de50 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fddb7400700 1 -- 172.21.15.70:0/190826425 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(266..266 src has 1..266) ==== 9671+0+0 (secure 0 0 0) 0x7fddbc00fa90 con 0x55de67f0de50 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.598+0000 7fdde2b20b80 1 -- 172.21.15.70:0/190826425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc8014ec0 con 0x55de67f0de50 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fddb7400700 1 -- 172.21.15.70:0/190826425 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fddbc00fc90 con 0x55de67f0de50 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fdde2b20b80 10 client.17946 fetch_fsmap learned FSMap version 42 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fdde2b20b80 1 -- 172.21.15.70:0/190826425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55de67f93350 con 0x55de67f0de50 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fddb7400700 1 -- 172.21.15.70:0/190826425 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fddc8014ec0 con 0x55de67f0de50 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fddb7400700 1 -- 172.21.15.70:0/190826425 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fddbc025070 con 0x55de67f0de50 2024-05-08T08:21:13.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fdde2b20b80 10 client.17946 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:21:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fdde2b20b80 10 client.17946 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:21:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fdde2b20b80 20 client.17946 populate_metadata read hostname 'smithi070' 2024-05-08T08:21:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55de67f93b10 0x55de67f95f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fdde2b20b80 4 client.17946 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "52d90407", "release": true, "await": true}] 2024-05-08T08:21:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.599+0000 7fdde2b20b80 1 -- 172.21.15.70:0/190826425 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "52d90407", "release": true, "await": true}) -- 0x55de67e6d500 con 0x55de67f93b10 2024-05-08T08:21:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.600+0000 7fddd5800700 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55de67f93b10 0x55de67f95f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.601+0000 7fddd5800700 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55de67f93b10 0x55de67f95f30 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8890af2f037a0836 server_cookie=5b6f593268d6047c in_seq=0 out_seq=0 2024-05-08T08:21:13.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:13.601+0000 7fddb7400700 10 client.17946 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:21:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:15 smithi194 ceph-mon[33679]: pgmap v3015: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:21:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:15 smithi194 ceph-mon[33679]: osdmap e267: 12 total, 12 up, 12 in 2024-05-08T08:21:15.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:15 smithi070 ceph-mon[29591]: pgmap v3015: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:21:15.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:15 smithi070 ceph-mon[29591]: osdmap e267: 12 total, 12 up, 12 in 2024-05-08T08:21:15.627 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:15 smithi172 ceph-mon[33377]: pgmap v3015: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:21:15.627 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:15 smithi172 ceph-mon[33377]: osdmap e267: 12 total, 12 up, 12 in 2024-05-08T08:21:16.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:16 smithi194 ceph-mon[33679]: pgmap v3017: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T08:21:16.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:16 smithi070 ceph-mon[29591]: pgmap v3017: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T08:21:16.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:16 smithi172 ceph-mon[33377]: pgmap v3017: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T08:21:18.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.348+0000 7fddb7400700 1 -- 172.21.15.70:0/190826425 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55de67e6d500 con 0x55de67f93b10 2024-05-08T08:21:18.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.348+0000 7fddb7400700 10 client.17946 handle_command_reply: tid=0 2024-05-08T08:21:18.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.348+0000 7fdde2b20b80 1 client.17946 shutdown 2024-05-08T08:21:18.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.349+0000 7fdde2b20b80 1 -- 172.21.15.70:0/190826425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f0de50 msgr2=0x55de67f8b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:18.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.349+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f0de50 0x55de67f8b000 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fddbc01e6e0 tx=0x7fddbc01e7c0 comp rx=0 tx=0).stop 2024-05-08T08:21:18.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.350+0000 7fdde2b20b80 1 -- 172.21.15.70:0/190826425 shutdown_connections 2024-05-08T08:21:18.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.350+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55de67f93b10 0x55de67f95f30 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:18.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.350+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55de67f12ec0 0x55de67f1c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:18.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.350+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55de67f0d490 0x55de67f8aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:18.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.350+0000 7fdde2b20b80 1 --2- 172.21.15.70:0/190826425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55de67f0de50 0x55de67f8b000 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:18.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.350+0000 7fdde2b20b80 1 -- 172.21.15.70:0/190826425 >> 172.21.15.70:0/190826425 conn(0x55de67e3bc60 msgr2=0x55de67f0c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:18.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.350+0000 7fddb7400700 0 client.17946 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:21:18.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.351+0000 7fdde2b20b80 1 -- 172.21.15.70:0/190826425 shutdown_connections 2024-05-08T08:21:18.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.351+0000 7fdde2b20b80 1 -- 172.21.15.70:0/190826425 wait complete. 2024-05-08T08:21:18.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.351+0000 7fdde2b20b80 20 client.17946 trim_cache size 0 max 16384 2024-05-08T08:21:18.346 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 216, 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "52d90407": { 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 216, 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:21:18.347 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:18.348 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 -- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fddb80b2af0 msgr2=0x7fddb80b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fddb80b2af0 0x7fddb80b4fb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fddbc005fd0 tx=0x7fddbc005e20 comp rx=0 tx=0).stop 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 -- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0109ad0 msgr2=0x7fddd01a0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0109ad0 0x7fddd01a0010 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fddc40057f0 tx=0x7fddc4009f90 comp rx=0 tx=0).stop 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 -- 172.21.15.70:0/2944852010 shutdown_connections 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fddb80b2af0 0x7fddb80b4fb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fddd010fb60 0x7fddd01a48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fddd0109ad0 0x7fddd01a0010 secure :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fddc40057f0 tx=0x7fddc4009f90 comp rx=0 tx=0).stop 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 --2- 172.21.15.70:0/2944852010 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddd010a490 0x7fddd01a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:18.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.354+0000 7fddd8200700 1 -- 172.21.15.70:0/2944852010 >> 172.21.15.70:0/2944852010 conn(0x7fddd0076c70 msgr2=0x7fddd0077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:18.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.355+0000 7fddd8200700 1 -- 172.21.15.70:0/2944852010 shutdown_connections 2024-05-08T08:21:18.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:18.355+0000 7fddd8200700 1 -- 172.21.15.70:0/2944852010 wait complete. 2024-05-08T08:21:18.416 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/common.o 2024-05-08T08:21:18.592 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/hwesleep.o 2024-05-08T08:21:18.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:18 smithi070 ceph-mon[29591]: pgmap v3018: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 347 B/s wr, 7 op/s 2024-05-08T08:21:18.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:18 smithi172 ceph-mon[33377]: pgmap v3018: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 347 B/s wr, 7 op/s 2024-05-08T08:21:18.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:18 smithi194 ceph-mon[33679]: pgmap v3018: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 347 B/s wr, 7 op/s 2024-05-08T08:21:19.150 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '52d90407', seconds elapsed: 86.6 2024-05-08T08:21:19.150 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T08:21:19.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:21:19.719 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:21:20.226 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/dynamic_queue_limits.o 2024-05-08T08:21:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:20 smithi070 ceph-mon[29591]: pgmap v3019: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 154 KiB/s wr, 12 op/s 2024-05-08T08:21:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:20 smithi172 ceph-mon[33377]: pgmap v3019: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 154 KiB/s wr, 12 op/s 2024-05-08T08:21:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:20 smithi194 ceph-mon[33679]: pgmap v3019: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 154 KiB/s wr, 12 op/s 2024-05-08T08:21:20.799 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/autofs/built-in.a 2024-05-08T08:21:20.826 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/vfs_inode.o 2024-05-08T08:21:20.919 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/direct.o 2024-05-08T08:21:20.977 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/netlink/built-in.a 2024-05-08T08:21:21.307 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/glob.o 2024-05-08T08:21:21.318 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/strncpy_from_user.o 2024-05-08T08:21:21.380 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4client.o 2024-05-08T08:21:21.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.856+0000 7feb3ec00700 1 -- 172.21.15.70:0/1535005625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb38104590 msgr2=0x7feb38104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:21.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.856+0000 7feb3ec00700 1 --2- 172.21.15.70:0/1535005625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb38104590 0x7feb38104970 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7feb2c009990 tx=0x7feb2c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:21:21.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.856+0000 7feb3ec00700 1 -- 172.21.15.70:0/1535005625 shutdown_connections 2024-05-08T08:21:21.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.856+0000 7feb3ec00700 1 --2- 172.21.15.70:0/1535005625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb3810d9c0 0x7feb3810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:21.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.856+0000 7feb3ec00700 1 --2- 172.21.15.70:0/1535005625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb38104590 0x7feb38104970 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:21.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.856+0000 7feb3ec00700 1 --2- 172.21.15.70:0/1535005625 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb38104eb0 0x7feb3810d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:21.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.856+0000 7feb3ec00700 1 -- 172.21.15.70:0/1535005625 >> 172.21.15.70:0/1535005625 conn(0x7feb380fddc0 msgr2=0x7feb381001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:21.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.856+0000 7feb3ec00700 1 -- 172.21.15.70:0/1535005625 shutdown_connections 2024-05-08T08:21:21.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.857+0000 7feb3ec00700 1 -- 172.21.15.70:0/1535005625 wait complete. 2024-05-08T08:21:21.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.858+0000 7feb3ec00700 1 Processor -- start 2024-05-08T08:21:21.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.858+0000 7feb3ec00700 1 -- start start 2024-05-08T08:21:21.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3ec00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb38104eb0 0x7feb3819be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:21.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3ec00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3810d9c0 0x7feb3819c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:21.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3ec00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb381a0750 0x7feb381a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:21.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3ec00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb381134d0 con 0x7feb381a0750 2024-05-08T08:21:21.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3ec00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb38113350 con 0x7feb3810d9c0 2024-05-08T08:21:21.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3ec00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feb38113650 con 0x7feb38104eb0 2024-05-08T08:21:21.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb381a0750 0x7feb381a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:21.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3ce00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3810d9c0 0x7feb3819c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:21.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb381a0750 0x7feb381a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36634/0 (socket says 172.21.15.70:36634) 2024-05-08T08:21:21.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3e200700 1 -- 172.21.15.70:0/3398387269 learned_addr learned my addr 172.21.15.70:0/3398387269 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:21.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.859+0000 7feb3d800700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb38104eb0 0x7feb3819be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:21.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.860+0000 7feb3e200700 1 -- 172.21.15.70:0/3398387269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb38104eb0 msgr2=0x7feb3819be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:21.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.860+0000 7feb3e200700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb38104eb0 0x7feb3819be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:21.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.860+0000 7feb3e200700 1 -- 172.21.15.70:0/3398387269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3810d9c0 msgr2=0x7feb3819c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:21.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.860+0000 7feb3e200700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3810d9c0 0x7feb3819c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:21.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.860+0000 7feb3e200700 1 -- 172.21.15.70:0/3398387269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb381a1270 con 0x7feb381a0750 2024-05-08T08:21:21.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.860+0000 7feb3e200700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb381a0750 0x7feb381a0bd0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7feb30007ee0 tx=0x7feb3000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:21.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.861+0000 7feb36000700 1 -- 172.21.15.70:0/3398387269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30004bb0 con 0x7feb381a0750 2024-05-08T08:21:21.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.861+0000 7feb36000700 1 -- 172.21.15.70:0/3398387269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb30004d50 con 0x7feb381a0750 2024-05-08T08:21:21.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.861+0000 7feb36000700 1 -- 172.21.15.70:0/3398387269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb300058b0 con 0x7feb381a0750 2024-05-08T08:21:21.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.861+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb381a1560 con 0x7feb381a0750 2024-05-08T08:21:21.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.862+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb381a8cf0 con 0x7feb381a0750 2024-05-08T08:21:21.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.863+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3806ba60 con 0x7feb381a0750 2024-05-08T08:21:21.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.866+0000 7feb36000700 1 -- 172.21.15.70:0/3398387269 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7feb3001a020 con 0x7feb381a0750 2024-05-08T08:21:21.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.868+0000 7feb36000700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb200b2af0 0x7feb200b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:21.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.868+0000 7feb36000700 1 -- 172.21.15.70:0/3398387269 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(267..267 src has 1..267) ==== 9583+0+0 (secure 0 0 0) 0x7feb300e1ad0 con 0x7feb381a0750 2024-05-08T08:21:21.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.869+0000 7feb3d800700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb200b2af0 0x7feb200b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:21.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.870+0000 7feb3d800700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb200b2af0 0x7feb200b4fb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7feb2c000c00 tx=0x7feb2c005fd0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:21.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:21.876+0000 7feb36000700 1 -- 172.21.15.70:0/3398387269 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feb30010070 con 0x7feb381a0750 2024-05-08T08:21:22.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.367+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb3806a190 con 0x7feb381a0750 2024-05-08T08:21:22.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.368+0000 7feb36000700 1 -- 172.21.15.70:0/3398387269 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7feb3806a190 con 0x7feb381a0750 2024-05-08T08:21:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:21:22.363 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:21:22.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.373+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb200b2af0 msgr2=0x7feb200b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:22.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.373+0000 7feb3ec00700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb200b2af0 0x7feb200b4fb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7feb2c000c00 tx=0x7feb2c005fd0 comp rx=0 tx=0).stop 2024-05-08T08:21:22.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.373+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb381a0750 msgr2=0x7feb381a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:22.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.373+0000 7feb3ec00700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb381a0750 0x7feb381a0bd0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7feb30007ee0 tx=0x7feb3000d3b0 comp rx=0 tx=0).stop 2024-05-08T08:21:22.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.374+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 shutdown_connections 2024-05-08T08:21:22.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.374+0000 7feb3ec00700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb200b2af0 0x7feb200b4fb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:22.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.374+0000 7feb3ec00700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb381a0750 0x7feb381a0bd0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:22.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.374+0000 7feb3ec00700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb38104eb0 0x7feb3819be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:22.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.374+0000 7feb3ec00700 1 --2- 172.21.15.70:0/3398387269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb3810d9c0 0x7feb3819c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:22.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.374+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 >> 172.21.15.70:0/3398387269 conn(0x7feb380fddc0 msgr2=0x7feb381001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:22.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.374+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 shutdown_connections 2024-05-08T08:21:22.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:22.374+0000 7feb3ec00700 1 -- 172.21.15.70:0/3398387269 wait complete. 2024-05-08T08:21:22.369 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:21:22.611 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:22 smithi070 ceph-mon[29591]: pgmap v3020: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 154 KiB/s wr, 12 op/s 2024-05-08T08:21:22.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:22 smithi172 ceph-mon[33377]: pgmap v3020: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 154 KiB/s wr, 12 op/s 2024-05-08T08:21:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:22 smithi194 ceph-mon[33679]: pgmap v3020: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 154 KiB/s wr, 12 op/s 2024-05-08T08:21:23.239 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T08:21:23.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T08:21:23.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:23 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3398387269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:21:23.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:23 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3398387269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:21:23.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:23 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3398387269' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:21:23.784 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/power/cpu.o 2024-05-08T08:21:23.812 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:21:24.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:24 smithi070 ceph-mon[29591]: pgmap v3021: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 154 KiB/s wr, 12 op/s 2024-05-08T08:21:24.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:24 smithi172 ceph-mon[33377]: pgmap v3021: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 154 KiB/s wr, 12 op/s 2024-05-08T08:21:24.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:24 smithi194 ceph-mon[33679]: pgmap v3021: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 154 KiB/s wr, 12 op/s 2024-05-08T08:21:25.341 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/hwgpe.o 2024-05-08T08:21:26.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:26 smithi070 ceph-mon[29591]: pgmap v3022: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 357 KiB/s wr, 18 op/s 2024-05-08T08:21:26.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:26 smithi172 ceph-mon[33377]: pgmap v3022: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 357 KiB/s wr, 18 op/s 2024-05-08T08:21:26.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:26 smithi194 ceph-mon[33679]: pgmap v3022: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 386 KiB/s rd, 357 KiB/s wr, 18 op/s 2024-05-08T08:21:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.669+0000 7f4417600700 1 -- 172.21.15.70:0/765265584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f441010ff00 msgr2=0x7f44101122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.669+0000 7f4417600700 1 --2- 172.21.15.70:0/765265584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f441010ff00 0x7f44101122f0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f440800b0a0 tx=0x7f440800b3b0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.669+0000 7f4417600700 1 -- 172.21.15.70:0/765265584 shutdown_connections 2024-05-08T08:21:27.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.669+0000 7f4417600700 1 --2- 172.21.15.70:0/765265584 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f441010ff00 0x7f44101122f0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.669+0000 7f4417600700 1 --2- 172.21.15.70:0/765265584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44100756d0 0x7f4410075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.669+0000 7f4417600700 1 --2- 172.21.15.70:0/765265584 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4410075ff0 0x7f441010f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.669+0000 7f4417600700 1 -- 172.21.15.70:0/765265584 >> 172.21.15.70:0/765265584 conn(0x7f441007a600 msgr2=0x7f441007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:27.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.670+0000 7f4417600700 1 -- 172.21.15.70:0/765265584 shutdown_connections 2024-05-08T08:21:27.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.670+0000 7f4417600700 1 -- 172.21.15.70:0/765265584 wait complete. 2024-05-08T08:21:27.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.671+0000 7f4417600700 1 Processor -- start 2024-05-08T08:21:27.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.672+0000 7f4417600700 1 -- start start 2024-05-08T08:21:27.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.672+0000 7f4417600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44100756d0 0x7f44101a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.672+0000 7f4417600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4410075ff0 0x7f44101a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.672+0000 7f4417600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f441010ff00 0x7f441019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.672+0000 7f4417600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4410115790 con 0x7f4410075ff0 2024-05-08T08:21:27.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.672+0000 7f4417600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4410115610 con 0x7f441010ff00 2024-05-08T08:21:27.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.672+0000 7f4417600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4410115910 con 0x7f44100756d0 2024-05-08T08:21:27.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.673+0000 7f4415600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f441010ff00 0x7f441019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.673+0000 7f4415600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f441010ff00 0x7f441019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:50618/0 (socket says 172.21.15.70:50618) 2024-05-08T08:21:27.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.673+0000 7f4414c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44100756d0 0x7f44101a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.673+0000 7f4415600700 1 -- 172.21.15.70:0/1351751476 learned_addr learned my addr 172.21.15.70:0/1351751476 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:27.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.673+0000 7f440fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4410075ff0 0x7f44101a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.674+0000 7f4414c00700 1 -- 172.21.15.70:0/1351751476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f441010ff00 msgr2=0x7f441019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:27.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.674+0000 7f4414c00700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f441010ff00 0x7f441019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.674+0000 7f4414c00700 1 -- 172.21.15.70:0/1351751476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4410075ff0 msgr2=0x7f44101a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:27.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.674+0000 7f4414c00700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4410075ff0 0x7f44101a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.674+0000 7f4414c00700 1 -- 172.21.15.70:0/1351751476 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441019c130 con 0x7f44100756d0 2024-05-08T08:21:27.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.675+0000 7f4414c00700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44100756d0 0x7f44101a1810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f440400e9f0 tx=0x7f440400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:27.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.676+0000 7f440d600700 1 -- 172.21.15.70:0/1351751476 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404004220 con 0x7f44100756d0 2024-05-08T08:21:27.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.676+0000 7f440d600700 1 -- 172.21.15.70:0/1351751476 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44040043c0 con 0x7f44100756d0 2024-05-08T08:21:27.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.676+0000 7f440d600700 1 -- 172.21.15.70:0/1351751476 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440400ce30 con 0x7f44100756d0 2024-05-08T08:21:27.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.676+0000 7f4417600700 1 -- 172.21.15.70:0/1351751476 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441019c3c0 con 0x7f44100756d0 2024-05-08T08:21:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.676+0000 7f4417600700 1 -- 172.21.15.70:0/1351751476 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44101a86e0 con 0x7f44100756d0 2024-05-08T08:21:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.683+0000 7f440d600700 1 -- 172.21.15.70:0/1351751476 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4404004750 con 0x7f44100756d0 2024-05-08T08:21:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.685+0000 7f440d600700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43f80b2af0 0x7f43f80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.685+0000 7f440d600700 1 -- 172.21.15.70:0/1351751476 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(267..267 src has 1..267) ==== 9583+0+0 (secure 0 0 0) 0x7f44040e29f0 con 0x7f44100756d0 2024-05-08T08:21:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.686+0000 7f440fe00700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43f80b2af0 0x7f43f80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.687+0000 7f440fe00700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43f80b2af0 0x7f43f80b4fb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4410111a50 tx=0x7f43fc009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.697+0000 7f442203bb80 1 Processor -- start 2024-05-08T08:21:27.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.697+0000 7f442203bb80 1 -- start start 2024-05-08T08:21:27.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.697+0000 7f442203bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b4e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.697+0000 7f442203bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b48810 0x558c75b48c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.697+0000 7f442203bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b491d0 0x558c75b55000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.697+0000 7f442203bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c75a9abb0 con 0x558c75b4e240 2024-05-08T08:21:27.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.697+0000 7f442203bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c75a388f0 con 0x558c75b48810 2024-05-08T08:21:27.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.697+0000 7f442203bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558c75a96b70 con 0x558c75b491d0 2024-05-08T08:21:27.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.698+0000 7f440fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b48810 0x558c75b48c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.698+0000 7f440fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b48810 0x558c75b48c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:50622/0 (socket says 172.21.15.70:50622) 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.698+0000 7f440fe00700 1 -- 172.21.15.70:0/1938954777 learned_addr learned my addr 172.21.15.70:0/1938954777 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.698+0000 7f4415600700 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b491d0 0x558c75b55000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.698+0000 7f4414c00700 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b4e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.699+0000 7f440fe00700 1 -- 172.21.15.70:0/1938954777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b491d0 msgr2=0x558c75b55000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.699+0000 7f440fe00700 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b491d0 0x558c75b55000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.699+0000 7f440fe00700 1 -- 172.21.15.70:0/1938954777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 msgr2=0x558c75b4e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.699+0000 7f440fe00700 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b4e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.699+0000 7f440fe00700 1 -- 172.21.15.70:0/1938954777 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c759e7a60 con 0x558c75b48810 2024-05-08T08:21:27.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.699+0000 7f4415600700 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b491d0 0x558c75b55000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:21:27.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.699+0000 7f4414c00700 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b4e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:21:27.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.700+0000 7f440fe00700 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b48810 0x558c75b48c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f43fc011d50 tx=0x7f43fc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6572556854c2985d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:27.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.701+0000 7f4402000700 1 -- 172.21.15.70:0/1938954777 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc00eb20 con 0x558c75b48810 2024-05-08T08:21:27.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.701+0000 7f4402000700 1 -- 172.21.15.70:0/1938954777 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43fc00ecc0 con 0x558c75b48810 2024-05-08T08:21:27.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.701+0000 7f4402000700 1 -- 172.21.15.70:0/1938954777 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc01d670 con 0x558c75b48810 2024-05-08T08:21:27.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.702+0000 7f442203bb80 1 -- 172.21.15.70:0/1938954777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b48810 msgr2=0x558c75b48c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:27.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.702+0000 7f442203bb80 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b48810 0x558c75b48c90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f43fc011d50 tx=0x7f43fc014000 comp rx=0 tx=0).stop 2024-05-08T08:21:27.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.703+0000 7f442203bb80 1 -- 172.21.15.70:0/1938954777 shutdown_connections 2024-05-08T08:21:27.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.703+0000 7f442203bb80 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b491d0 0x558c75b55000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.703+0000 7f442203bb80 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b4e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.703+0000 7f442203bb80 1 --2- 172.21.15.70:0/1938954777 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b48810 0x558c75b48c90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.703+0000 7f442203bb80 1 -- 172.21.15.70:0/1938954777 >> 172.21.15.70:0/1938954777 conn(0x558c75ac0860 msgr2=0x558c75b43100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:27.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.703+0000 7f442203bb80 1 -- 172.21.15.70:0/1938954777 shutdown_connections 2024-05-08T08:21:27.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.704+0000 7f442203bb80 1 -- 172.21.15.70:0/1938954777 wait complete. 2024-05-08T08:21:27.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.704+0000 7f442203bb80 1 -- start start 2024-05-08T08:21:27.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.705+0000 7f442203bb80 1 Processor -- start 2024-05-08T08:21:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.707+0000 7f442203bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b54c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.707+0000 7f442203bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b51fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.707+0000 7f442203bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b52520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.707+0000 7f442203bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c75b555a0 con 0x558c75b4e240 2024-05-08T08:21:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.707+0000 7f442203bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c75a00cb0 con 0x558c75b491d0 2024-05-08T08:21:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.707+0000 7f442203bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558c75b55720 con 0x558c75b48810 2024-05-08T08:21:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.707+0000 7f442203bb80 10 client.0 _ll_register_callbacks cb 0x558c75a41e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:21:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.708+0000 7f4414c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b54c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.708+0000 7f440fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b51fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.708+0000 7f4415600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b52520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.708+0000 7f440fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b51fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:50628/0 (socket says 172.21.15.70:50628) 2024-05-08T08:21:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.708+0000 7f4415600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b52520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51048/0 (socket says 172.21.15.70:51048) 2024-05-08T08:21:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.708+0000 7f440fe00700 1 -- 172.21.15.70:0/3190029316 learned_addr learned my addr 172.21.15.70:0/3190029316 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.709+0000 7f4415600700 1 -- 172.21.15.70:0/3190029316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 msgr2=0x558c75b54c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.709+0000 7f4415600700 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b54c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.709+0000 7f4415600700 1 -- 172.21.15.70:0/3190029316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 msgr2=0x558c75b51fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.709+0000 7f4415600700 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b51fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.709+0000 7f4415600700 1 -- 172.21.15.70:0/3190029316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c75a605b0 con 0x558c75b4e240 2024-05-08T08:21:27.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.710+0000 7f440fe00700 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b51fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:21:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.710+0000 7f4415600700 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b52520 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f44080062a0 tx=0x7f440800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbe86feae2aa392 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.710+0000 7f43f6a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:21:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.710+0000 7f43f6a00700 1 -- 172.21.15.70:0/3190029316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080074e0 con 0x558c75b4e240 2024-05-08T08:21:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.710+0000 7f43f6a00700 1 -- 172.21.15.70:0/3190029316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(267..267 src has 1..267) ==== 9583+0+0 (secure 0 0 0) 0x7f4408007680 con 0x558c75b4e240 2024-05-08T08:21:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.710+0000 7f442203bb80 1 -- 172.21.15.70:0/3190029316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43fc00ecc0 con 0x558c75b4e240 2024-05-08T08:21:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.711+0000 7f43f6a00700 1 -- 172.21.15.70:0/3190029316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4408007880 con 0x558c75b4e240 2024-05-08T08:21:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.711+0000 7f442203bb80 10 client.17964 fetch_fsmap learned FSMap version 42 2024-05-08T08:21:27.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.711+0000 7f442203bb80 1 -- 172.21.15.70:0/3190029316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558c75b68640 con 0x558c75b4e240 2024-05-08T08:21:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.711+0000 7f43f6a00700 1 -- 172.21.15.70:0/3190029316 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43fc00ecc0 con 0x558c75b4e240 2024-05-08T08:21:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.712+0000 7f43f6a00700 1 -- 172.21.15.70:0/3190029316 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4408011070 con 0x558c75b4e240 2024-05-08T08:21:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.712+0000 7f442203bb80 10 client.17964 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:21:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.712+0000 7f442203bb80 10 client.17964 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:21:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.712+0000 7f442203bb80 20 client.17964 populate_metadata read hostname 'smithi070' 2024-05-08T08:21:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.712+0000 7f442203bb80 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c75b6ac80 0x558c75b6d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.712+0000 7f442203bb80 4 client.17964 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:21:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.712+0000 7f442203bb80 1 -- 172.21.15.70:0/3190029316 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c75b152d0 con 0x558c75b6ac80 2024-05-08T08:21:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.712+0000 7f4414c00700 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c75b6ac80 0x558c75b6d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.713+0000 7f4414c00700 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c75b6ac80 0x558c75b6d070 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c834d399679014b9 server_cookie=7d12ff3fe01d510a in_seq=0 out_seq=0 2024-05-08T08:21:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.713+0000 7f43f6a00700 10 client.17964 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:21:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.716+0000 7f43f6a00700 1 -- 172.21.15.70:0/3190029316 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558c75b152d0 con 0x558c75b6ac80 2024-05-08T08:21:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.716+0000 7f43f6a00700 10 client.17964 handle_command_reply: tid=0 2024-05-08T08:21:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.716+0000 7f442203bb80 1 client.17964 shutdown 2024-05-08T08:21:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.717+0000 7f442203bb80 1 -- 172.21.15.70:0/3190029316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 msgr2=0x558c75b52520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.717+0000 7f442203bb80 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b52520 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f44080062a0 tx=0x7f440800bf90 comp rx=0 tx=0).stop 2024-05-08T08:21:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.717+0000 7f442203bb80 1 -- 172.21.15.70:0/3190029316 shutdown_connections 2024-05-08T08:21:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.717+0000 7f442203bb80 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c75b6ac80 0x558c75b6d070 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.717+0000 7f442203bb80 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b52520 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.717+0000 7f442203bb80 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b54c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.717+0000 7f442203bb80 1 --2- 172.21.15.70:0/3190029316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b51fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.717+0000 7f442203bb80 1 -- 172.21.15.70:0/3190029316 >> 172.21.15.70:0/3190029316 conn(0x558c75ac0860 msgr2=0x558c75b3dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.717+0000 7f43f6a00700 0 client.17964 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:21:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.718+0000 7f442203bb80 1 -- 172.21.15.70:0/3190029316 shutdown_connections 2024-05-08T08:21:27.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.718+0000 7f442203bb80 1 -- 172.21.15.70:0/3190029316 wait complete. 2024-05-08T08:21:27.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.719+0000 7f442203bb80 20 client.17964 trim_cache size 0 max 16384 2024-05-08T08:21:27.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.757+0000 7f442203bb80 1 Processor -- start 2024-05-08T08:21:27.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.757+0000 7f442203bb80 1 -- start start 2024-05-08T08:21:27.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.757+0000 7f442203bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b4d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.757+0000 7f442203bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b72900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.757+0000 7f442203bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b72e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.757+0000 7f442203bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44101afbb0 con 0x558c75b4e240 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.757+0000 7f442203bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f44101ad440 con 0x558c75b491d0 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.757+0000 7f442203bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f44101ab2b0 con 0x558c75b48810 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.758+0000 7f4415600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b72e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.758+0000 7f440fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b72900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.758+0000 7f440fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b72900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:50630/0 (socket says 172.21.15.70:50630) 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.758+0000 7f440fe00700 1 -- 172.21.15.70:0/3996392981 learned_addr learned my addr 172.21.15.70:0/3996392981 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:27.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.758+0000 7f4414c00700 1 --2- 172.21.15.70:0/3996392981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b4d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.759+0000 7f440fe00700 1 -- 172.21.15.70:0/3996392981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 msgr2=0x558c75b4d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:27.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.759+0000 7f440fe00700 1 --2- 172.21.15.70:0/3996392981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b4d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.759+0000 7f440fe00700 1 -- 172.21.15.70:0/3996392981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 msgr2=0x558c75b72e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:27.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.760+0000 7f440fe00700 1 --2- 172.21.15.70:0/3996392981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b72e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.760+0000 7f440fe00700 1 -- 172.21.15.70:0/3996392981 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c75b51db0 con 0x558c75b491d0 2024-05-08T08:21:27.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.760+0000 7f4415600700 1 --2- 172.21.15.70:0/3996392981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b72e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:21:27.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.761+0000 7f440fe00700 1 --2- 172.21.15.70:0/3996392981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b72900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43fc005950 tx=0x7f43fc0092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa9bf641a01b6fa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.761+0000 7f4401600700 1 -- 172.21.15.70:0/3996392981 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc034070 con 0x558c75b491d0 2024-05-08T08:21:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.761+0000 7f4401600700 1 -- 172.21.15.70:0/3996392981 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43fc005040 con 0x558c75b491d0 2024-05-08T08:21:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.761+0000 7f4401600700 1 -- 172.21.15.70:0/3996392981 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0038e0 con 0x558c75b491d0 2024-05-08T08:21:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.762+0000 7f442203bb80 1 -- 172.21.15.70:0/3996392981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 msgr2=0x558c75b72900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.762+0000 7f442203bb80 1 --2- 172.21.15.70:0/3996392981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b72900 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f43fc005950 tx=0x7f43fc0092d0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.763+0000 7f442203bb80 1 -- 172.21.15.70:0/3996392981 shutdown_connections 2024-05-08T08:21:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.763+0000 7f442203bb80 1 --2- 172.21.15.70:0/3996392981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b72e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.763+0000 7f442203bb80 1 --2- 172.21.15.70:0/3996392981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b4d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.763+0000 7f442203bb80 1 --2- 172.21.15.70:0/3996392981 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b72900 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.763+0000 7f442203bb80 1 -- 172.21.15.70:0/3996392981 >> 172.21.15.70:0/3996392981 conn(0x558c75ac0860 msgr2=0x558c75b48090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.763+0000 7f442203bb80 1 -- 172.21.15.70:0/3996392981 shutdown_connections 2024-05-08T08:21:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.764+0000 7f442203bb80 1 -- 172.21.15.70:0/3996392981 wait complete. 2024-05-08T08:21:27.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.764+0000 7f442203bb80 1 -- start start 2024-05-08T08:21:27.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.764+0000 7f442203bb80 1 Processor -- start 2024-05-08T08:21:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.765+0000 7f442203bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b55930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.765+0000 7f442203bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b55e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.765+0000 7f442203bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.765+0000 7f442203bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f44101ab900 con 0x558c75b4e240 2024-05-08T08:21:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.765+0000 7f442203bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f44101acd70 con 0x558c75b491d0 2024-05-08T08:21:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.765+0000 7f442203bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f44101abfd0 con 0x558c75b48810 2024-05-08T08:21:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.765+0000 7f442203bb80 10 client.0 _ll_register_callbacks cb 0x558c75a41e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:21:27.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.766+0000 7f4415600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.766+0000 7f4414c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b55930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.766+0000 7f4415600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51072/0 (socket says 172.21.15.70:51072) 2024-05-08T08:21:27.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.766+0000 7f440fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b55e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.766+0000 7f4415600700 1 -- 172.21.15.70:0/1583204504 learned_addr learned my addr 172.21.15.70:0/1583204504 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:21:27.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.767+0000 7f4415600700 1 -- 172.21.15.70:0/1583204504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 msgr2=0x558c75b55930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.767+0000 7f4415600700 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b55930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.767+0000 7f4415600700 1 -- 172.21.15.70:0/1583204504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 msgr2=0x558c75b55e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:21:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.767+0000 7f4415600700 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b55e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.767+0000 7f4415600700 1 -- 172.21.15.70:0/1583204504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c75bd56e0 con 0x558c75b4e240 2024-05-08T08:21:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.767+0000 7f4414c00700 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b55930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:21:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.768+0000 7f4415600700 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b563b0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f4408009850 tx=0x7f4408007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710e7a6c16d6636e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:21:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.768+0000 7f43f6a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:21:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.769+0000 7f43f6a00700 1 -- 172.21.15.70:0/1583204504 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408007a20 con 0x558c75b4e240 2024-05-08T08:21:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.769+0000 7f43f6a00700 1 -- 172.21.15.70:0/1583204504 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(267..267 src has 1..267) ==== 9583+0+0 (secure 0 0 0) 0x7f4408007bc0 con 0x558c75b4e240 2024-05-08T08:21:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.770+0000 7f442203bb80 1 -- 172.21.15.70:0/1583204504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43fc005040 con 0x558c75b4e240 2024-05-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.770+0000 7f43f6a00700 1 -- 172.21.15.70:0/1583204504 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4408005c60 con 0x558c75b4e240 2024-05-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.770+0000 7f442203bb80 10 client.17970 fetch_fsmap learned FSMap version 42 2024-05-08T08:21:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.771+0000 7f442203bb80 1 -- 172.21.15.70:0/1583204504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558c75bd69c0 con 0x558c75b4e240 2024-05-08T08:21:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.771+0000 7f43f6a00700 1 -- 172.21.15.70:0/1583204504 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43fc005040 con 0x558c75b4e240 2024-05-08T08:21:27.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.772+0000 7f43f6a00700 1 -- 172.21.15.70:0/1583204504 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4408011070 con 0x558c75b4e240 2024-05-08T08:21:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.772+0000 7f442203bb80 10 client.17970 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:21:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.772+0000 7f442203bb80 10 client.17970 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:21:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.773+0000 7f442203bb80 20 client.17970 populate_metadata read hostname 'smithi070' 2024-05-08T08:21:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.773+0000 7f442203bb80 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c75bd7070 0x558c75bd9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:21:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.773+0000 7f442203bb80 4 client.17970 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T08:21:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.773+0000 7f442203bb80 1 -- 172.21.15.70:0/1583204504 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x558c75b43660 con 0x558c75bd7070 2024-05-08T08:21:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.773+0000 7f4414c00700 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c75bd7070 0x558c75bd9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:21:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.774+0000 7f43f6a00700 10 client.17970 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:21:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:27.774+0000 7f4414c00700 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c75bd7070 0x558c75bd9460 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=938cc611b00e9873 server_cookie=cfa646d91c54eb36 in_seq=0 out_seq=0 2024-05-08T08:21:27.870 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4session.o 2024-05-08T08:21:28.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:28 smithi070 ceph-mon[29591]: pgmap v3023: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 330 KiB/s wr, 16 op/s 2024-05-08T08:21:28.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:28 smithi172 ceph-mon[33377]: pgmap v3023: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 330 KiB/s wr, 16 op/s 2024-05-08T08:21:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:28 smithi194 ceph-mon[33679]: pgmap v3023: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 330 KiB/s wr, 16 op/s 2024-05-08T08:21:29.218 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/strnlen_user.o 2024-05-08T08:21:30.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:30 smithi172 ceph-mon[33377]: pgmap v3024: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 540 KiB/s wr, 28 op/s 2024-05-08T08:21:30.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:30 smithi194 ceph-mon[33679]: pgmap v3024: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 540 KiB/s wr, 28 op/s 2024-05-08T08:21:30.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:30 smithi070 ceph-mon[29591]: pgmap v3024: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 540 KiB/s wr, 28 op/s 2024-05-08T08:21:32.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:32 smithi172 ceph-mon[33377]: pgmap v3025: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 412 KiB/s wr, 20 op/s 2024-05-08T08:21:32.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:32 smithi194 ceph-mon[33679]: pgmap v3025: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 412 KiB/s wr, 20 op/s 2024-05-08T08:21:32.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:32 smithi070 ceph-mon[29591]: pgmap v3025: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 412 KiB/s wr, 20 op/s 2024-05-08T08:21:34.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:34 smithi172 ceph-mon[33377]: pgmap v3026: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 412 KiB/s wr, 20 op/s 2024-05-08T08:21:34.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:34 smithi194 ceph-mon[33679]: pgmap v3026: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 412 KiB/s wr, 20 op/s 2024-05-08T08:21:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:34 smithi070 ceph-mon[29591]: pgmap v3026: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 412 KiB/s wr, 20 op/s 2024-05-08T08:21:36.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:36 smithi172 ceph-mon[33377]: pgmap v3027: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 477 KiB/s wr, 25 op/s 2024-05-08T08:21:36.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:36 smithi194 ceph-mon[33679]: pgmap v3027: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 477 KiB/s wr, 25 op/s 2024-05-08T08:21:36.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:36 smithi070 ceph-mon[29591]: pgmap v3027: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 477 KiB/s wr, 25 op/s 2024-05-08T08:21:38.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:38 smithi172 ceph-mon[33377]: pgmap v3028: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 276 KiB/s wr, 15 op/s 2024-05-08T08:21:38.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:38 smithi070 ceph-mon[29591]: pgmap v3028: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 276 KiB/s wr, 15 op/s 2024-05-08T08:21:38.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:38 smithi194 ceph-mon[33679]: pgmap v3028: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 276 KiB/s wr, 15 op/s 2024-05-08T08:21:40.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:40 smithi172 ceph-mon[33377]: pgmap v3029: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 301 KiB/s wr, 20 op/s 2024-05-08T08:21:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:40 smithi194 ceph-mon[33679]: pgmap v3029: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 301 KiB/s wr, 20 op/s 2024-05-08T08:21:40.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:40 smithi070 ceph-mon[29591]: pgmap v3029: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 292 KiB/s rd, 301 KiB/s wr, 20 op/s 2024-05-08T08:21:42.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:42 smithi172 ceph-mon[33377]: pgmap v3030: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 91 KiB/s wr, 8 op/s 2024-05-08T08:21:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:42 smithi194 ceph-mon[33679]: pgmap v3030: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 91 KiB/s wr, 8 op/s 2024-05-08T08:21:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:42 smithi070 ceph-mon[29591]: pgmap v3030: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 91 KiB/s wr, 8 op/s 2024-05-08T08:21:44.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:44 smithi172 ceph-mon[33377]: pgmap v3031: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 91 KiB/s wr, 8 op/s 2024-05-08T08:21:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:44 smithi194 ceph-mon[33679]: pgmap v3031: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 91 KiB/s wr, 8 op/s 2024-05-08T08:21:44.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:44 smithi070 ceph-mon[29591]: pgmap v3031: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 91 KiB/s wr, 8 op/s 2024-05-08T08:21:46.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:46 smithi194 ceph-mon[33679]: pgmap v3032: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 138 KiB/s wr, 12 op/s 2024-05-08T08:21:46.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:46 smithi070 ceph-mon[29591]: pgmap v3032: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 138 KiB/s wr, 12 op/s 2024-05-08T08:21:46.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:46 smithi172 ceph-mon[33377]: pgmap v3032: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 138 KiB/s wr, 12 op/s 2024-05-08T08:21:48.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:48 smithi194 ceph-mon[33679]: pgmap v3033: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 73 KiB/s wr, 7 op/s 2024-05-08T08:21:48.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:48 smithi070 ceph-mon[29591]: pgmap v3033: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 73 KiB/s wr, 7 op/s 2024-05-08T08:21:48.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:48 smithi172 ceph-mon[33377]: pgmap v3033: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 73 KiB/s wr, 7 op/s 2024-05-08T08:21:50.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:50 smithi194 ceph-mon[33679]: pgmap v3034: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-05-08T08:21:50.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:50 smithi070 ceph-mon[29591]: pgmap v3034: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-05-08T08:21:50.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:50 smithi172 ceph-mon[33377]: pgmap v3034: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 73 KiB/s wr, 10 op/s 2024-05-08T08:21:51.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.190+0000 7f43f6a00700 1 -- 172.21.15.70:0/1583204504 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x558c75b43660 con 0x558c75bd7070 2024-05-08T08:21:51.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.190+0000 7f43f6a00700 10 client.17970 handle_command_reply: tid=0 2024-05-08T08:21:51.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.190+0000 7f442203bb80 1 client.17970 shutdown 2024-05-08T08:21:51.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.190+0000 7f442203bb80 1 -- 172.21.15.70:0/1583204504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 msgr2=0x558c75b563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:51.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.190+0000 7f442203bb80 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b563b0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f4408009850 tx=0x7f4408007520 comp rx=0 tx=0).stop 2024-05-08T08:21:51.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.191+0000 7f442203bb80 1 -- 172.21.15.70:0/1583204504 shutdown_connections 2024-05-08T08:21:51.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.191+0000 7f442203bb80 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c75bd7070 0x558c75bd9460 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.191+0000 7f442203bb80 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c75b4e240 0x558c75b563b0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.191+0000 7f442203bb80 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c75b48810 0x558c75b55930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.191+0000 7f442203bb80 1 --2- 172.21.15.70:0/1583204504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c75b491d0 0x558c75b55e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.191+0000 7f442203bb80 1 -- 172.21.15.70:0/1583204504 >> 172.21.15.70:0/1583204504 conn(0x558c75ac0860 msgr2=0x558c75b48090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.191+0000 7f43f6a00700 0 client.17970 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:21:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.191+0000 7f442203bb80 1 -- 172.21.15.70:0/1583204504 shutdown_connections 2024-05-08T08:21:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.191+0000 7f442203bb80 1 -- 172.21.15.70:0/1583204504 wait complete. 2024-05-08T08:21:51.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.192+0000 7f442203bb80 20 client.17970 trim_cache size 0 max 16384 2024-05-08T08:21:51.185 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:21:51.185 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:21:51.185 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:21:51.185 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 218, 2024-05-08T08:21:51.185 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:21:51.185 INFO:teuthology.orchestra.run.smithi070.stdout: "fc2bef83": { 2024-05-08T08:21:51.185 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 218, 2024-05-08T08:21:51.185 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:21:51.185 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:51.186 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:51.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:51.187 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:21:51.187 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:21:51.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 -- 172.21.15.70:0/1351751476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43f80b2af0 msgr2=0x7f43f80b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:51.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43f80b2af0 0x7f43f80b4fb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4410111a50 tx=0x7f43fc009260 comp rx=0 tx=0).stop 2024-05-08T08:21:51.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 -- 172.21.15.70:0/1351751476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44100756d0 msgr2=0x7f44101a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:21:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44100756d0 0x7f44101a1810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f440400e9f0 tx=0x7f440400ed00 comp rx=0 tx=0).stop 2024-05-08T08:21:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 -- 172.21.15.70:0/1351751476 shutdown_connections 2024-05-08T08:21:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f43f80b2af0 0x7f43f80b4fb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f441010ff00 0x7f441019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44100756d0 0x7f44101a1810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 --2- 172.21.15.70:0/1351751476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4410075ff0 0x7f44101a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:21:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.193+0000 7f4417600700 1 -- 172.21.15.70:0/1351751476 >> 172.21.15.70:0/1351751476 conn(0x7f441007a600 msgr2=0x7f44101005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:21:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.194+0000 7f4417600700 1 -- 172.21.15.70:0/1351751476 shutdown_connections 2024-05-08T08:21:51.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:21:51.194+0000 7f4417600700 1 -- 172.21.15.70:0/1351751476 wait complete. 2024-05-08T08:21:52.026 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fc2bef83', quiesce took 32.9 seconds. Will release after: 30.0 2024-05-08T08:21:52.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:52 smithi194 ceph-mon[33679]: pgmap v3035: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2024-05-08T08:21:52.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:52 smithi070 ceph-mon[29591]: pgmap v3035: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2024-05-08T08:21:52.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:52 smithi172 ceph-mon[33377]: pgmap v3035: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2024-05-08T08:21:54.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:54 smithi194 ceph-mon[33679]: pgmap v3036: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2024-05-08T08:21:54.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:54 smithi070 ceph-mon[29591]: pgmap v3036: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2024-05-08T08:21:54.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:54 smithi172 ceph-mon[33377]: pgmap v3036: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 48 KiB/s wr, 5 op/s 2024-05-08T08:21:56.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:56 smithi194 ceph-mon[33679]: pgmap v3037: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 9 op/s 2024-05-08T08:21:56.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:56 smithi070 ceph-mon[29591]: pgmap v3037: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 9 op/s 2024-05-08T08:21:56.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:56 smithi172 ceph-mon[33377]: pgmap v3037: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 114 KiB/s wr, 9 op/s 2024-05-08T08:21:58.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:21:58 smithi194 ceph-mon[33679]: pgmap v3038: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2024-05-08T08:21:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:21:58 smithi070 ceph-mon[29591]: pgmap v3038: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2024-05-08T08:21:58.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:21:58 smithi172 ceph-mon[33377]: pgmap v3038: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 66 KiB/s wr, 6 op/s 2024-05-08T08:22:00.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:00 smithi194 ceph-mon[33679]: pgmap v3039: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 10 op/s 2024-05-08T08:22:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:00 smithi070 ceph-mon[29591]: pgmap v3039: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 10 op/s 2024-05-08T08:22:00.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:00 smithi172 ceph-mon[33377]: pgmap v3039: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 80 KiB/s wr, 10 op/s 2024-05-08T08:22:02.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:02 smithi194 ceph-mon[33679]: pgmap v3040: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T08:22:02.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:02 smithi070 ceph-mon[29591]: pgmap v3040: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T08:22:02.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:02 smithi172 ceph-mon[33377]: pgmap v3040: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T08:22:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:04 smithi194 ceph-mon[33679]: pgmap v3041: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T08:22:04.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:04 smithi070 ceph-mon[29591]: pgmap v3041: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T08:22:04.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:04 smithi172 ceph-mon[33377]: pgmap v3041: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 80 KiB/s wr, 8 op/s 2024-05-08T08:22:06.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:06 smithi194 ceph-mon[33679]: pgmap v3042: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 161 KiB/s wr, 34 op/s 2024-05-08T08:22:06.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:22:06.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:06 smithi070 ceph-mon[29591]: pgmap v3042: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 161 KiB/s wr, 34 op/s 2024-05-08T08:22:06.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:22:06.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:06 smithi172 ceph-mon[33377]: pgmap v3042: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 161 KiB/s wr, 34 op/s 2024-05-08T08:22:06.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:22:08.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:08 smithi194 ceph-mon[33679]: pgmap v3043: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 95 KiB/s wr, 30 op/s 2024-05-08T08:22:08.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:08 smithi070 ceph-mon[29591]: pgmap v3043: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 95 KiB/s wr, 30 op/s 2024-05-08T08:22:08.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:08 smithi172 ceph-mon[33377]: pgmap v3043: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 95 KiB/s wr, 30 op/s 2024-05-08T08:22:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:10.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:11.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: pgmap v3044: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 33 op/s 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:22:11.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:22:11.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:22:11.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:10 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:11.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: pgmap v3044: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 33 op/s 2024-05-08T08:22:11.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:22:11.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:22:11.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:10 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: pgmap v3044: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 96 KiB/s wr, 33 op/s 2024-05-08T08:22:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:22:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:22:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:22:11.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:10 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:22:12.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:11 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:22:12.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:11 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:22:12.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:11 smithi194 ceph-mon[33679]: osdmap e268: 12 total, 12 up, 12 in 2024-05-08T08:22:12.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:11 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:22:12.159 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:11 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:22:12.160 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:11 smithi070 ceph-mon[29591]: osdmap e268: 12 total, 12 up, 12 in 2024-05-08T08:22:12.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:11 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:22:12.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:11 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:22:12.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:11 smithi172 ceph-mon[33377]: osdmap e268: 12 total, 12 up, 12 in 2024-05-08T08:22:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:12 smithi194 ceph-mon[33679]: pgmap v3046: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 98 KiB/s wr, 34 op/s 2024-05-08T08:22:13.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:12 smithi070 ceph-mon[29591]: pgmap v3046: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 98 KiB/s wr, 34 op/s 2024-05-08T08:22:13.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:12 smithi172 ceph-mon[33377]: pgmap v3046: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 98 KiB/s wr, 34 op/s 2024-05-08T08:22:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:14 smithi194 ceph-mon[33679]: pgmap v3047: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 98 KiB/s wr, 34 op/s 2024-05-08T08:22:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:14 smithi070 ceph-mon[29591]: pgmap v3047: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 98 KiB/s wr, 34 op/s 2024-05-08T08:22:15.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:14 smithi172 ceph-mon[33377]: pgmap v3047: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 98 KiB/s wr, 34 op/s 2024-05-08T08:22:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:16 smithi194 ceph-mon[33679]: pgmap v3048: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:22:17.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:16 smithi070 ceph-mon[29591]: pgmap v3048: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:22:17.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:16 smithi172 ceph-mon[33377]: pgmap v3048: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:22:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:18 smithi194 ceph-mon[33679]: pgmap v3049: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:22:19.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:18 smithi070 ceph-mon[29591]: pgmap v3049: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:22:19.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:18 smithi172 ceph-mon[33377]: pgmap v3049: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:22:20.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:20 smithi194 ceph-mon[33679]: osdmap e269: 12 total, 12 up, 12 in 2024-05-08T08:22:20.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:20 smithi194 ceph-mon[33679]: pgmap v3051: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 8 op/s 2024-05-08T08:22:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:20 smithi070 ceph-mon[29591]: osdmap e269: 12 total, 12 up, 12 in 2024-05-08T08:22:20.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:20 smithi070 ceph-mon[29591]: pgmap v3051: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 8 op/s 2024-05-08T08:22:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:20 smithi172 ceph-mon[33377]: osdmap e269: 12 total, 12 up, 12 in 2024-05-08T08:22:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:20 smithi172 ceph-mon[33377]: pgmap v3051: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 34 KiB/s wr, 8 op/s 2024-05-08T08:22:22.027 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:22:22.473 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:22:22.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:22 smithi194 ceph-mon[33679]: pgmap v3052: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2024-05-08T08:22:22.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:22 smithi070 ceph-mon[29591]: pgmap v3052: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2024-05-08T08:22:22.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:22 smithi172 ceph-mon[33377]: pgmap v3052: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2024-05-08T08:22:24.521 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:24 smithi070 ceph-mon[29591]: pgmap v3053: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2024-05-08T08:22:24.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:24 smithi172 ceph-mon[33377]: pgmap v3053: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2024-05-08T08:22:24.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:24 smithi194 ceph-mon[33679]: pgmap v3053: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 6 op/s 2024-05-08T08:22:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.855+0000 7f2906400700 1 -- 172.21.15.70:0/3597844060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2900075ff0 msgr2=0x7f2900114190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.855+0000 7f2906400700 1 --2- 172.21.15.70:0/3597844060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2900075ff0 0x7f2900114190 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009990 tx=0x7f28e8009ca0 comp rx=0 tx=0).stop 2024-05-08T08:22:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.855+0000 7f2906400700 1 -- 172.21.15.70:0/3597844060 shutdown_connections 2024-05-08T08:22:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.855+0000 7f2906400700 1 --2- 172.21.15.70:0/3597844060 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29001146d0 0x7f2900116ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.855+0000 7f2906400700 1 --2- 172.21.15.70:0/3597844060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29000756d0 0x7f2900075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.855+0000 7f2906400700 1 --2- 172.21.15.70:0/3597844060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2900075ff0 0x7f2900114190 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.855+0000 7f2906400700 1 -- 172.21.15.70:0/3597844060 >> 172.21.15.70:0/3597844060 conn(0x7f290007a600 msgr2=0x7f290007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:22:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.855+0000 7f2906400700 1 -- 172.21.15.70:0/3597844060 shutdown_connections 2024-05-08T08:22:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.855+0000 7f2906400700 1 -- 172.21.15.70:0/3597844060 wait complete. 2024-05-08T08:22:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.856+0000 7f2906400700 1 Processor -- start 2024-05-08T08:22:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.856+0000 7f2906400700 1 -- start start 2024-05-08T08:22:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f2906400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29000756d0 0x7f29001a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f2906400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2900075ff0 0x7f29001a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f2906400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29001146d0 0x7f29001a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f2906400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2900119b90 con 0x7f29000756d0 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f2906400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2900119a10 con 0x7f2900075ff0 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f2906400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2900119d10 con 0x7f29001146d0 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f28ff400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29000756d0 0x7f29001a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f28ff400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29000756d0 0x7f29001a0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49550/0 (socket says 172.21.15.70:49550) 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f28ff400700 1 -- 172.21.15.70:0/2451063042 learned_addr learned my addr 172.21.15.70:0/2451063042 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.857+0000 7f28f6a00700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2900075ff0 0x7f29001a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.858+0000 7f28ffe00700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29001146d0 0x7f29001a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.858+0000 7f28ff400700 1 -- 172.21.15.70:0/2451063042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29001146d0 msgr2=0x7f29001a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.858+0000 7f28ff400700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29001146d0 0x7f29001a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.858+0000 7f28ff400700 1 -- 172.21.15.70:0/2451063042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2900075ff0 msgr2=0x7f29001a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.858+0000 7f28ff400700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2900075ff0 0x7f29001a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:24.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.858+0000 7f28ff400700 1 -- 172.21.15.70:0/2451063042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29001a5030 con 0x7f29000756d0 2024-05-08T08:22:24.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.858+0000 7f28f6a00700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2900075ff0 0x7f29001a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:22:24.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.858+0000 7f28ff400700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29000756d0 0x7f29001a0020 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f28f0007e20 tx=0x7f28f000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:22:24.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.858+0000 7f28fcc00700 1 -- 172.21.15.70:0/2451063042 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0016020 con 0x7f29000756d0 2024-05-08T08:22:24.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.859+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29001a5320 con 0x7f29000756d0 2024-05-08T08:22:24.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.859+0000 7f28fcc00700 1 -- 172.21.15.70:0/2451063042 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28f000ae00 con 0x7f29000756d0 2024-05-08T08:22:24.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.859+0000 7f28fcc00700 1 -- 172.21.15.70:0/2451063042 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0011670 con 0x7f29000756d0 2024-05-08T08:22:24.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.859+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29001acba0 con 0x7f29000756d0 2024-05-08T08:22:24.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.860+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f290006a190 con 0x7f29000756d0 2024-05-08T08:22:24.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.862+0000 7f28fcc00700 1 -- 172.21.15.70:0/2451063042 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f28f0019020 con 0x7f29000756d0 2024-05-08T08:22:24.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.864+0000 7f28fcc00700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f28e40b29f0 0x7f28e40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:24.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.864+0000 7f28fcc00700 1 -- 172.21.15.70:0/2451063042 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(269..269 src has 1..269) ==== 9583+0+0 (secure 0 0 0) 0x7f28f00e2b30 con 0x7f29000756d0 2024-05-08T08:22:24.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.864+0000 7f28f6a00700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f28e40b29f0 0x7f28e40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:24.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.865+0000 7f28f6a00700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f28e40b29f0 0x7f28e40b4eb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009750 tx=0x7f28e801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:22:24.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:24.867+0000 7f28fcc00700 1 -- 172.21.15.70:0/2451063042 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f28f00aa1a0 con 0x7f29000756d0 2024-05-08T08:22:25.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.150+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29001a1380 con 0x7f29000756d0 2024-05-08T08:22:25.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.151+0000 7f28fcc00700 1 -- 172.21.15.70:0/2451063042 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f28f00b2220 con 0x7f29000756d0 2024-05-08T08:22:25.144 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:22:25.145 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f28e40b29f0 msgr2=0x7f28e40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f28e40b29f0 0x7f28e40b4eb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009750 tx=0x7f28e801a040 comp rx=0 tx=0).stop 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29000756d0 msgr2=0x7f29001a0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29000756d0 0x7f29001a0020 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f28f0007e20 tx=0x7f28f000a340 comp rx=0 tx=0).stop 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 shutdown_connections 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f28e40b29f0 0x7f28e40b4eb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29001146d0 0x7f29001a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29000756d0 0x7f29001a0020 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 --2- 172.21.15.70:0/2451063042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2900075ff0 0x7f29001a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 >> 172.21.15.70:0/2451063042 conn(0x7f290007a600 msgr2=0x7f2900113490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 shutdown_connections 2024-05-08T08:22:25.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:25.155+0000 7f2906400700 1 -- 172.21.15.70:0/2451063042 wait complete. 2024-05-08T08:22:25.149 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:22:25.576 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:25 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2451063042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:22:25.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:25 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2451063042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:22:25.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:25 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2451063042' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:22:26.044 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id fc2bef83 --release --await' 2024-05-08T08:22:26.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id fc2bef83 --release --await 2024-05-08T08:22:26.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:26 smithi070 ceph-mon[29591]: pgmap v3054: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:22:26.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:26 smithi172 ceph-mon[33377]: pgmap v3054: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:22:26.674 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:22:26.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:26 smithi194 ceph-mon[33679]: pgmap v3054: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:22:28.667 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:28 smithi070 ceph-mon[29591]: pgmap v3055: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:22:28.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:28 smithi172 ceph-mon[33377]: pgmap v3055: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:22:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:28 smithi194 ceph-mon[33679]: pgmap v3055: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:22:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.716+0000 7f7711c00700 1 -- 172.21.15.70:0/502304769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 msgr2=0x7f770c10fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.716+0000 7f7711c00700 1 --2- 172.21.15.70:0/502304769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 0x7f770c10fe80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f770400b0a0 tx=0x7f770400b3b0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.716+0000 7f7711c00700 1 -- 172.21.15.70:0/502304769 shutdown_connections 2024-05-08T08:22:29.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.716+0000 7f7711c00700 1 --2- 172.21.15.70:0/502304769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 0x7f770c10fe80 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.716+0000 7f7711c00700 1 --2- 172.21.15.70:0/502304769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f770c104590 0x7f770c104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.716+0000 7f7711c00700 1 --2- 172.21.15.70:0/502304769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f770c104eb0 0x7f770c10d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.716+0000 7f7711c00700 1 -- 172.21.15.70:0/502304769 >> 172.21.15.70:0/502304769 conn(0x7f770c0fddc0 msgr2=0x7f770c1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:22:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.716+0000 7f7711c00700 1 -- 172.21.15.70:0/502304769 shutdown_connections 2024-05-08T08:22:29.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.716+0000 7f7711c00700 1 -- 172.21.15.70:0/502304769 wait complete. 2024-05-08T08:22:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.718+0000 7f7711c00700 1 Processor -- start 2024-05-08T08:22:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.718+0000 7f7711c00700 1 -- start start 2024-05-08T08:22:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.718+0000 7f7711c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f770c104590 0x7f770c1a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.718+0000 7f7711c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f770c104eb0 0x7f770c1a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.718+0000 7f7711c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 0x7f770c19b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.718+0000 7f7711c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f770c113470 con 0x7f770c10d9c0 2024-05-08T08:22:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.718+0000 7f7711c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1132f0 con 0x7f770c104590 2024-05-08T08:22:29.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.718+0000 7f7711c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1135f0 con 0x7f770c104eb0 2024-05-08T08:22:29.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f7711200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 0x7f770c19b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f7711200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 0x7f770c19b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54100/0 (socket says 172.21.15.70:54100) 2024-05-08T08:22:29.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f7711200700 1 -- 172.21.15.70:0/2763199013 learned_addr learned my addr 172.21.15.70:0/2763199013 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:22:29.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f770be00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f770c104590 0x7f770c1a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f7711200700 1 -- 172.21.15.70:0/2763199013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f770c104eb0 msgr2=0x7f770c1a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f7711200700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f770c104eb0 0x7f770c1a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f7711200700 1 -- 172.21.15.70:0/2763199013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f770c104590 msgr2=0x7f770c1a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f7711200700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f770c104590 0x7f770c1a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f7711200700 1 -- 172.21.15.70:0/2763199013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c19c080 con 0x7f770c10d9c0 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.719+0000 7f7711200700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 0x7f770c19b920 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f770400b830 tx=0x7f7704004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.720+0000 7f7708c00700 1 -- 172.21.15.70:0/2763199013 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704021070 con 0x7f770c10d9c0 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.720+0000 7f7708c00700 1 -- 172.21.15.70:0/2763199013 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7704007c80 con 0x7f770c10d9c0 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.720+0000 7f7711c00700 1 -- 172.21.15.70:0/2763199013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770c19c310 con 0x7f770c10d9c0 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.720+0000 7f7708c00700 1 -- 172.21.15.70:0/2763199013 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704005260 con 0x7f770c10d9c0 2024-05-08T08:22:29.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.720+0000 7f7711c00700 1 -- 172.21.15.70:0/2763199013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770c1a8630 con 0x7f770c10d9c0 2024-05-08T08:22:29.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.723+0000 7f7708c00700 1 -- 172.21.15.70:0/2763199013 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7704024070 con 0x7f770c10d9c0 2024-05-08T08:22:29.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.725+0000 7f7708c00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f76f00b2a70 0x7f76f00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.725+0000 7f7708c00700 1 -- 172.21.15.70:0/2763199013 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(269..269 src has 1..269) ==== 9583+0+0 (secure 0 0 0) 0x7f770400f020 con 0x7f770c10d9c0 2024-05-08T08:22:29.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.725+0000 7f770be00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f76f00b2a70 0x7f76f00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.726+0000 7f770be00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f76f00b2a70 0x7f76f00b4f30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f76fc005950 tx=0x7f76fc0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:22:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.867+0000 7f771dc64b80 1 Processor -- start 2024-05-08T08:22:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.867+0000 7f771dc64b80 1 -- start start 2024-05-08T08:22:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.868+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 0x56251d965340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.868+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d95f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.868+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d95fab0 0x56251d95ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.868+0000 7f771dc64b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56251d8b1b20 con 0x56251d95fab0 2024-05-08T08:22:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.868+0000 7f771dc64b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56251d84f860 con 0x56251d965880 2024-05-08T08:22:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.868+0000 7f771dc64b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56251d8adae0 con 0x56251d964f60 2024-05-08T08:22:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f7711200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d95fab0 0x56251d95ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f7711200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d95fab0 0x56251d95ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54110/0 (socket says 172.21.15.70:54110) 2024-05-08T08:22:29.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f7711200700 1 -- 172.21.15.70:0/560113881 learned_addr learned my addr 172.21.15.70:0/560113881 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:22:29.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f770b400700 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d95f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f770be00700 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 0x56251d965340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f7711200700 1 -- 172.21.15.70:0/560113881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 msgr2=0x56251d965340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f7711200700 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 0x56251d965340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f7711200700 1 -- 172.21.15.70:0/560113881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 msgr2=0x56251d95f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f7711200700 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d95f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f7711200700 1 -- 172.21.15.70:0/560113881 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56251d7fe9d0 con 0x56251d95fab0 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.869+0000 7f770b400700 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d95f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.870+0000 7f7711200700 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d95fab0 0x56251d95ff10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f77040aaf80 tx=0x7f77040099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79feaf1417379d29 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.870+0000 7f7701600700 1 -- 172.21.15.70:0/560113881 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77040af3a0 con 0x56251d95fab0 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.870+0000 7f7701600700 1 -- 172.21.15.70:0/560113881 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77040b3dc0 con 0x56251d95fab0 2024-05-08T08:22:29.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.870+0000 7f7701600700 1 -- 172.21.15.70:0/560113881 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77040ab4d0 con 0x56251d95fab0 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.872+0000 7f771dc64b80 1 -- 172.21.15.70:0/560113881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d95fab0 msgr2=0x56251d95ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.872+0000 7f771dc64b80 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d95fab0 0x56251d95ff10 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f77040aaf80 tx=0x7f77040099e0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.872+0000 7f771dc64b80 1 -- 172.21.15.70:0/560113881 shutdown_connections 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.872+0000 7f771dc64b80 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d95fab0 0x56251d95ff10 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.872+0000 7f771dc64b80 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 0x56251d965340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.872+0000 7f771dc64b80 1 --2- 172.21.15.70:0/560113881 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d95f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.872+0000 7f771dc64b80 1 -- 172.21.15.70:0/560113881 >> 172.21.15.70:0/560113881 conn(0x56251d88dc60 msgr2=0x56251d959ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.872+0000 7f771dc64b80 1 -- 172.21.15.70:0/560113881 shutdown_connections 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.872+0000 7f771dc64b80 1 -- 172.21.15.70:0/560113881 wait complete. 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.873+0000 7f771dc64b80 1 -- start start 2024-05-08T08:22:29.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.873+0000 7f771dc64b80 1 Processor -- start 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 0x56251d96b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d968930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d968e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f771dc64b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56251d96c160 con 0x56251d964f60 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f771dc64b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56251d817c20 con 0x56251d965880 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f771dc64b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56251d96c2e0 con 0x56251d95fab0 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f771dc64b80 10 client.0 _ll_register_callbacks cb 0x56251d858d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f770b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d968930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f770b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d968930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54120/0 (socket says 172.21.15.70:54120) 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f770b400700 1 -- 172.21.15.70:0/2067731011 learned_addr learned my addr 172.21.15.70:0/2067731011 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.874+0000 7f770be00700 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 0x56251d96b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.875+0000 7f7711200700 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d968e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.875+0000 7f770b400700 1 -- 172.21.15.70:0/2067731011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 msgr2=0x56251d96b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.875+0000 7f770b400700 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 0x56251d96b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.875+0000 7f770b400700 1 -- 172.21.15.70:0/2067731011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 msgr2=0x56251d968e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.875+0000 7f770b400700 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d968e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.875+0000 7f770b400700 1 -- 172.21.15.70:0/2067731011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56251d877520 con 0x56251d964f60 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.875+0000 7f770b400700 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d968930 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f76f800e680 tx=0x7f76f800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bd0a7447000f0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.875+0000 7f76f6000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.876+0000 7f76f6000700 1 -- 172.21.15.70:0/2067731011 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8014070 con 0x56251d964f60 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.876+0000 7f76f6000700 1 -- 172.21.15.70:0/2067731011 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(269..269 src has 1..269) ==== 9583+0+0 (secure 0 0 0) 0x7f76f8004220 con 0x56251d964f60 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.876+0000 7f771dc64b80 1 -- 172.21.15.70:0/2067731011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77040b3dc0 con 0x56251d964f60 2024-05-08T08:22:29.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.876+0000 7f76f6000700 1 -- 172.21.15.70:0/2067731011 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f76f8020050 con 0x56251d964f60 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.876+0000 7f771dc64b80 10 client.17988 fetch_fsmap learned FSMap version 42 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.876+0000 7f771dc64b80 1 -- 172.21.15.70:0/2067731011 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56251d976920 con 0x56251d964f60 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.877+0000 7f76f6000700 1 -- 172.21.15.70:0/2067731011 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77040b3dc0 con 0x56251d964f60 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.877+0000 7f76f6000700 1 -- 172.21.15.70:0/2067731011 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f76f80052b0 con 0x56251d964f60 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.877+0000 7f771dc64b80 10 client.17988 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.877+0000 7f771dc64b80 10 client.17988 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.877+0000 7f771dc64b80 20 client.17988 populate_metadata read hostname 'smithi070' 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.877+0000 7f771dc64b80 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56251d978fb0 0x56251d97b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.877+0000 7f771dc64b80 4 client.17988 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:22:29.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.877+0000 7f771dc64b80 1 -- 172.21.15.70:0/2067731011 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56251d92c1a0 con 0x56251d978fb0 2024-05-08T08:22:29.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.878+0000 7f770be00700 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56251d978fb0 0x56251d97b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.879+0000 7f770be00700 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56251d978fb0 0x56251d97b3a0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dcbbdf8bf1d7052 server_cookie=8127e77240fa8cfa in_seq=0 out_seq=0 2024-05-08T08:22:29.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.879+0000 7f76f6000700 10 client.17988 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:22:29.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.881+0000 7f76f6000700 1 -- 172.21.15.70:0/2067731011 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56251d92c1a0 con 0x56251d978fb0 2024-05-08T08:22:29.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.881+0000 7f76f6000700 10 client.17988 handle_command_reply: tid=0 2024-05-08T08:22:29.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 client.17988 shutdown 2024-05-08T08:22:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 -- 172.21.15.70:0/2067731011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 msgr2=0x56251d968930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d968930 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f76f800e680 tx=0x7f76f800e990 comp rx=0 tx=0).stop 2024-05-08T08:22:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 -- 172.21.15.70:0/2067731011 shutdown_connections 2024-05-08T08:22:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56251d978fb0 0x56251d97b3a0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d968e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 0x56251d96b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 --2- 172.21.15.70:0/2067731011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d968930 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 -- 172.21.15.70:0/2067731011 >> 172.21.15.70:0/2067731011 conn(0x56251d88dc60 msgr2=0x56251d95e480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:22:29.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f76f6000700 0 client.17988 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:22:29.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 -- 172.21.15.70:0/2067731011 shutdown_connections 2024-05-08T08:22:29.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 1 -- 172.21.15.70:0/2067731011 wait complete. 2024-05-08T08:22:29.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.882+0000 7f771dc64b80 20 client.17988 trim_cache size 0 max 16384 2024-05-08T08:22:29.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.906+0000 7f771dc64b80 1 Processor -- start 2024-05-08T08:22:29.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.906+0000 7f771dc64b80 1 -- start start 2024-05-08T08:22:29.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.906+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d95fab0 0x56251d95f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.906+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 0x56251d968ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.906+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d965880 0x56251d959c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.906+0000 7f771dc64b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b3ec0 con 0x56251d965880 2024-05-08T08:22:29.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.906+0000 7f771dc64b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b1750 con 0x56251d95fab0 2024-05-08T08:22:29.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.906+0000 7f771dc64b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1af5c0 con 0x56251d964f60 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f7711200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d965880 0x56251d959c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f7711200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d965880 0x56251d959c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54126/0 (socket says 172.21.15.70:54126) 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f7711200700 1 -- 172.21.15.70:0/956139106 learned_addr learned my addr 172.21.15.70:0/956139106 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f770b400700 1 --2- 172.21.15.70:0/956139106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 0x56251d968ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f770be00700 1 --2- 172.21.15.70:0/956139106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d95fab0 0x56251d95f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f7711200700 1 -- 172.21.15.70:0/956139106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 msgr2=0x56251d968ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f7711200700 1 --2- 172.21.15.70:0/956139106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 0x56251d968ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f7711200700 1 -- 172.21.15.70:0/956139106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d95fab0 msgr2=0x56251d95f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f7711200700 1 --2- 172.21.15.70:0/956139106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d95fab0 0x56251d95f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.907+0000 7f7711200700 1 -- 172.21.15.70:0/956139106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56251d956920 con 0x56251d965880 2024-05-08T08:22:29.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.908+0000 7f7711200700 1 --2- 172.21.15.70:0/956139106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d965880 0x56251d959c10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f77040aaf80 tx=0x7f77040ab170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71237302581b4285 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:22:29.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.908+0000 7f7700c00700 1 -- 172.21.15.70:0/956139106 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77040af3a0 con 0x56251d965880 2024-05-08T08:22:29.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.908+0000 7f7700c00700 1 -- 172.21.15.70:0/956139106 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77040a7280 con 0x56251d965880 2024-05-08T08:22:29.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.908+0000 7f7700c00700 1 -- 172.21.15.70:0/956139106 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77040b3930 con 0x56251d965880 2024-05-08T08:22:29.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.909+0000 7f771dc64b80 1 -- 172.21.15.70:0/956139106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d965880 msgr2=0x56251d959c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:29.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.909+0000 7f771dc64b80 1 --2- 172.21.15.70:0/956139106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d965880 0x56251d959c10 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f77040aaf80 tx=0x7f77040ab170 comp rx=0 tx=0).stop 2024-05-08T08:22:29.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.909+0000 7f771dc64b80 1 -- 172.21.15.70:0/956139106 shutdown_connections 2024-05-08T08:22:29.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.909+0000 7f771dc64b80 1 --2- 172.21.15.70:0/956139106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d965880 0x56251d959c10 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.909+0000 7f771dc64b80 1 --2- 172.21.15.70:0/956139106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d95fab0 0x56251d95f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.909+0000 7f771dc64b80 1 --2- 172.21.15.70:0/956139106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d964f60 0x56251d968ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.909+0000 7f771dc64b80 1 -- 172.21.15.70:0/956139106 >> 172.21.15.70:0/956139106 conn(0x56251d88dc60 msgr2=0x56251d967240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:22:29.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.909+0000 7f771dc64b80 1 -- 172.21.15.70:0/956139106 shutdown_connections 2024-05-08T08:22:29.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.909+0000 7f771dc64b80 1 -- 172.21.15.70:0/956139106 wait complete. 2024-05-08T08:22:29.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.910+0000 7f771dc64b80 1 -- start start 2024-05-08T08:22:29.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.910+0000 7f771dc64b80 1 Processor -- start 2024-05-08T08:22:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.911+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 0x56251d9717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.911+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d96e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.911+0000 7f771dc64b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d96ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.911+0000 7f771dc64b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1afc10 con 0x56251d964f60 2024-05-08T08:22:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.911+0000 7f771dc64b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b1080 con 0x56251d965880 2024-05-08T08:22:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.911+0000 7f771dc64b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b02e0 con 0x56251d95fab0 2024-05-08T08:22:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.911+0000 7f771dc64b80 10 client.0 _ll_register_callbacks cb 0x56251d858d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:22:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.912+0000 7f770be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 0x56251d9717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.912+0000 7f770be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 0x56251d9717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:35592/0 (socket says 172.21.15.70:35592) 2024-05-08T08:22:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.912+0000 7f770b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d96e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.912+0000 7f770be00700 1 -- 172.21.15.70:0/922412602 learned_addr learned my addr 172.21.15.70:0/922412602 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:22:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.912+0000 7f770b400700 1 -- 172.21.15.70:0/922412602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 msgr2=0x56251d9717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:22:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.912+0000 7f770b400700 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 0x56251d9717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.912+0000 7f770b400700 1 -- 172.21.15.70:0/922412602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 msgr2=0x56251d96ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:22:29.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.912+0000 7f770b400700 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d96ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:29.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.912+0000 7f770b400700 1 -- 172.21.15.70:0/922412602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56251d96ef80 con 0x56251d964f60 2024-05-08T08:22:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.913+0000 7f770b400700 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d96e500 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f76f8005720 tx=0x7f76f8005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cba44e37f19a990 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:22:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.913+0000 7f76f6000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:22:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.913+0000 7f76f6000700 1 -- 172.21.15.70:0/922412602 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8014040 con 0x56251d964f60 2024-05-08T08:22:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.913+0000 7f76f6000700 1 -- 172.21.15.70:0/922412602 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(269..269 src has 1..269) ==== 9583+0+0 (secure 0 0 0) 0x7f76f8004c40 con 0x56251d964f60 2024-05-08T08:22:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.913+0000 7f771dc64b80 1 -- 172.21.15.70:0/922412602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77040a7280 con 0x56251d964f60 2024-05-08T08:22:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f76f6000700 1 -- 172.21.15.70:0/922412602 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f76f8035050 con 0x56251d964f60 2024-05-08T08:22:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f771dc64b80 10 client.17994 fetch_fsmap learned FSMap version 42 2024-05-08T08:22:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f771dc64b80 1 -- 172.21.15.70:0/922412602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56251d9ecd90 con 0x56251d964f60 2024-05-08T08:22:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f76f6000700 1 -- 172.21.15.70:0/922412602 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77040a7280 con 0x56251d964f60 2024-05-08T08:22:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f76f6000700 1 -- 172.21.15.70:0/922412602 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f76f8010cd0 con 0x56251d964f60 2024-05-08T08:22:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f771dc64b80 10 client.17994 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:22:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f771dc64b80 10 client.17994 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:22:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f771dc64b80 20 client.17994 populate_metadata read hostname 'smithi070' 2024-05-08T08:22:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f771dc64b80 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56251d9ed520 0x56251d9ef940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:22:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f771dc64b80 4 client.17994 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fc2bef83", "release": true, "await": true}] 2024-05-08T08:22:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.914+0000 7f771dc64b80 1 -- 172.21.15.70:0/922412602 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fc2bef83", "release": true, "await": true}) -- 0x56251d8bf500 con 0x56251d9ed520 2024-05-08T08:22:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.915+0000 7f770be00700 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56251d9ed520 0x56251d9ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:22:29.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.916+0000 7f770be00700 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56251d9ed520 0x56251d9ef940 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1482f940f368a67b server_cookie=30ebe7a65bbbdf1c in_seq=0 out_seq=0 2024-05-08T08:22:29.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:29.916+0000 7f76f6000700 10 client.17994 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:22:30.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:30 smithi172 ceph-mon[33377]: pgmap v3056: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:22:30.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:30 smithi194 ceph-mon[33679]: pgmap v3056: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:22:30.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:30 smithi070 ceph-mon[29591]: pgmap v3056: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:22:32.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:32 smithi172 ceph-mon[33377]: pgmap v3057: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:22:32.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:32 smithi194 ceph-mon[33679]: pgmap v3057: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:22:32.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:32 smithi070 ceph-mon[29591]: pgmap v3057: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:22:34.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.336+0000 7f76f6000700 1 -- 172.21.15.70:0/922412602 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x56251d8bf500 con 0x56251d9ed520 2024-05-08T08:22:34.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.336+0000 7f76f6000700 10 client.17994 handle_command_reply: tid=0 2024-05-08T08:22:34.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.336+0000 7f771dc64b80 1 client.17994 shutdown 2024-05-08T08:22:34.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.337+0000 7f771dc64b80 1 -- 172.21.15.70:0/922412602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 msgr2=0x56251d96e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:34.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.337+0000 7f771dc64b80 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d96e500 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f76f8005720 tx=0x7f76f8005990 comp rx=0 tx=0).stop 2024-05-08T08:22:34.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.337+0000 7f771dc64b80 1 -- 172.21.15.70:0/922412602 shutdown_connections 2024-05-08T08:22:34.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.337+0000 7f771dc64b80 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56251d9ed520 0x56251d9ef940 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.338+0000 7f771dc64b80 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56251d965880 0x56251d96ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.338+0000 7f771dc64b80 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56251d95fab0 0x56251d9717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.338+0000 7f771dc64b80 1 --2- 172.21.15.70:0/922412602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56251d964f60 0x56251d96e500 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.338+0000 7f771dc64b80 1 -- 172.21.15.70:0/922412602 >> 172.21.15.70:0/922412602 conn(0x56251d88dc60 msgr2=0x56251d965d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:22:34.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.338+0000 7f76f6000700 0 client.17994 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:22:34.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.339+0000 7f771dc64b80 1 -- 172.21.15.70:0/922412602 shutdown_connections 2024-05-08T08:22:34.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.339+0000 7f771dc64b80 1 -- 172.21.15.70:0/922412602 wait complete. 2024-05-08T08:22:34.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.339+0000 7f771dc64b80 20 client.17994 trim_cache size 0 max 16384 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 220, 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "fc2bef83": { 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 220, 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:22:34.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:22:34.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:22:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:22:34.336 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:22:34.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.341+0000 7f7711c00700 1 -- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f76f00b2a70 msgr2=0x7f76f00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:34.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.341+0000 7f7711c00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f76f00b2a70 0x7f76f00b4f30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f76fc005950 tx=0x7f76fc0058e0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.341+0000 7f7711c00700 1 -- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 msgr2=0x7f770c19b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:22:34.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.341+0000 7f7711c00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 0x7f770c19b920 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f770400b830 tx=0x7f7704004db0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.342+0000 7f7711c00700 1 -- 172.21.15.70:0/2763199013 shutdown_connections 2024-05-08T08:22:34.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.342+0000 7f7711c00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f76f00b2a70 0x7f76f00b4f30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.342+0000 7f7711c00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f770c10d9c0 0x7f770c19b920 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.342+0000 7f7711c00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f770c104590 0x7f770c1a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.342+0000 7f7711c00700 1 --2- 172.21.15.70:0/2763199013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f770c104eb0 0x7f770c1a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:22:34.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.342+0000 7f7711c00700 1 -- 172.21.15.70:0/2763199013 >> 172.21.15.70:0/2763199013 conn(0x7f770c0fddc0 msgr2=0x7f770c10fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:22:34.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.343+0000 7f7711c00700 1 -- 172.21.15.70:0/2763199013 shutdown_connections 2024-05-08T08:22:34.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:22:34.343+0000 7f7711c00700 1 -- 172.21.15.70:0/2763199013 wait complete. 2024-05-08T08:22:34.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:34 smithi070 ceph-mon[29591]: pgmap v3058: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:22:34.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:34 smithi172 ceph-mon[33377]: pgmap v3058: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:22:34.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:34 smithi194 ceph-mon[33679]: pgmap v3058: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:22:34.764 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/vfs_inode_dotl.o 2024-05-08T08:22:34.859 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/mmconfig-shared.o 2024-05-08T08:22:35.234 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fc2bef83', seconds elapsed: 76.1 2024-05-08T08:22:35.495 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/netlink.o 2024-05-08T08:22:36.478 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/net_utils.o 2024-05-08T08:22:36.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/hwregs.o 2024-05-08T08:22:36.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:36 smithi172 ceph-mon[33377]: pgmap v3059: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.1 KiB/s wr, 7 op/s 2024-05-08T08:22:36.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:36 smithi194 ceph-mon[33679]: pgmap v3059: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.1 KiB/s wr, 7 op/s 2024-05-08T08:22:36.763 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/power/hibernate_64.o 2024-05-08T08:22:36.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:36 smithi070 ceph-mon[29591]: pgmap v3059: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6.1 KiB/s wr, 7 op/s 2024-05-08T08:22:37.077 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/power/hibernate_asm_64.o 2024-05-08T08:22:37.113 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/dns_resolve.o 2024-05-08T08:22:38.219 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/core.o 2024-05-08T08:22:38.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:38 smithi172 ceph-mon[33377]: pgmap v3060: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6.1 KiB/s wr, 5 op/s 2024-05-08T08:22:38.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:38 smithi194 ceph-mon[33679]: pgmap v3060: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6.1 KiB/s wr, 5 op/s 2024-05-08T08:22:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:38 smithi070 ceph-mon[29591]: pgmap v3060: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6.1 KiB/s wr, 5 op/s 2024-05-08T08:22:40.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:40 smithi172 ceph-mon[33377]: pgmap v3061: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 162 KiB/s wr, 14 op/s 2024-05-08T08:22:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:40 smithi194 ceph-mon[33679]: pgmap v3061: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 162 KiB/s wr, 14 op/s 2024-05-08T08:22:40.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:40 smithi070 ceph-mon[29591]: pgmap v3061: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 162 KiB/s wr, 14 op/s 2024-05-08T08:22:42.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:42 smithi172 ceph-mon[33377]: pgmap v3062: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 11 op/s 2024-05-08T08:22:42.693 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/hwsleep.o 2024-05-08T08:22:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:42 smithi194 ceph-mon[33679]: pgmap v3062: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 11 op/s 2024-05-08T08:22:42.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:42 smithi070 ceph-mon[29591]: pgmap v3062: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 11 op/s 2024-05-08T08:22:44.179 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/vfs_addr.o 2024-05-08T08:22:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:44 smithi194 ceph-mon[33679]: pgmap v3063: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 11 op/s 2024-05-08T08:22:44.851 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/fixup.o 2024-05-08T08:22:44.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:44 smithi070 ceph-mon[29591]: pgmap v3063: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 11 op/s 2024-05-08T08:22:44.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:44 smithi172 ceph-mon[33377]: pgmap v3063: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 162 KiB/s wr, 11 op/s 2024-05-08T08:22:45.168 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/sg_pool.o 2024-05-08T08:22:46.194 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/power/hibernate.o 2024-05-08T08:22:46.725 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:46 smithi172 ceph-mon[33377]: pgmap v3064: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 410 KiB/s wr, 27 op/s 2024-05-08T08:22:46.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:46 smithi194 ceph-mon[33679]: pgmap v3064: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 410 KiB/s wr, 27 op/s 2024-05-08T08:22:46.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:46 smithi070 ceph-mon[29591]: pgmap v3064: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 410 KiB/s wr, 27 op/s 2024-05-08T08:22:47.398 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/bitset.o 2024-05-08T08:22:48.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:48 smithi194 ceph-mon[33679]: pgmap v3065: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 404 KiB/s wr, 24 op/s 2024-05-08T08:22:48.793 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4trace.o 2024-05-08T08:22:48.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:48 smithi070 ceph-mon[29591]: pgmap v3065: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 404 KiB/s wr, 24 op/s 2024-05-08T08:22:48.887 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/hwvalid.o 2024-05-08T08:22:48.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:48 smithi172 ceph-mon[33377]: pgmap v3065: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 404 KiB/s wr, 24 op/s 2024-05-08T08:22:50.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:50 smithi194 ceph-mon[33679]: pgmap v3066: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 749 KiB/s wr, 33 op/s 2024-05-08T08:22:50.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:50 smithi070 ceph-mon[29591]: pgmap v3066: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 749 KiB/s wr, 33 op/s 2024-05-08T08:22:50.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:50 smithi172 ceph-mon[33377]: pgmap v3066: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 749 KiB/s wr, 33 op/s 2024-05-08T08:22:51.138 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_log.o 2024-05-08T08:22:52.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:52 smithi070 ceph-mon[29591]: pgmap v3067: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 593 KiB/s wr, 24 op/s 2024-05-08T08:22:52.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:52 smithi172 ceph-mon[33377]: pgmap v3067: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 593 KiB/s wr, 24 op/s 2024-05-08T08:22:52.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:52 smithi194 ceph-mon[33679]: pgmap v3067: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 593 KiB/s wr, 24 op/s 2024-05-08T08:22:52.912 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/stackdepot.o 2024-05-08T08:22:53.570 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/vfs_file.o 2024-05-08T08:22:54.148 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/acpi.o 2024-05-08T08:22:54.437 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:54 smithi070 ceph-mon[29591]: pgmap v3068: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 593 KiB/s wr, 24 op/s 2024-05-08T08:22:54.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:54 smithi172 ceph-mon[33377]: pgmap v3068: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 593 KiB/s wr, 24 op/s 2024-05-08T08:22:54.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:54 smithi194 ceph-mon[33679]: pgmap v3068: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 593 KiB/s wr, 24 op/s 2024-05-08T08:22:55.021 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/hwxface.o 2024-05-08T08:22:55.973 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/power/built-in.a 2024-05-08T08:22:56.368 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/hwxfsleep.o 2024-05-08T08:22:56.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:56 smithi172 ceph-mon[33377]: pgmap v3069: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 775 KiB/s wr, 40 op/s 2024-05-08T08:22:56.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:56 smithi194 ceph-mon[33679]: pgmap v3069: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 775 KiB/s wr, 40 op/s 2024-05-08T08:22:56.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:56 smithi070 ceph-mon[29591]: pgmap v3069: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 775 KiB/s wr, 40 op/s 2024-05-08T08:22:58.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:22:58 smithi172 ceph-mon[33377]: pgmap v3070: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 528 KiB/s wr, 25 op/s 2024-05-08T08:22:58.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:22:58 smithi194 ceph-mon[33679]: pgmap v3070: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 528 KiB/s wr, 25 op/s 2024-05-08T08:22:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:22:58 smithi070 ceph-mon[29591]: pgmap v3070: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 528 KiB/s wr, 25 op/s 2024-05-08T08:23:00.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:00 smithi172 ceph-mon[33377]: pgmap v3071: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 748 KiB/s wr, 41 op/s 2024-05-08T08:23:00.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:00 smithi194 ceph-mon[33679]: pgmap v3071: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 748 KiB/s wr, 41 op/s 2024-05-08T08:23:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:00 smithi070 ceph-mon[29591]: pgmap v3071: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 705 KiB/s rd, 748 KiB/s wr, 41 op/s 2024-05-08T08:23:02.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:02 smithi172 ceph-mon[33377]: pgmap v3072: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 402 KiB/s wr, 32 op/s 2024-05-08T08:23:02.728 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:02 smithi070 ceph-mon[29591]: pgmap v3072: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 402 KiB/s wr, 32 op/s 2024-05-08T08:23:02.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:02 smithi194 ceph-mon[33679]: pgmap v3072: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 402 KiB/s wr, 32 op/s 2024-05-08T08:23:02.867 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/legacy.o 2024-05-08T08:23:03.157 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/asn1_decoder.o 2024-05-08T08:23:03.337 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/vfs_dir.o 2024-05-08T08:23:03.673 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/hwpci.o 2024-05-08T08:23:03.950 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/strset.o 2024-05-08T08:23:04.110 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_queue.o 2024-05-08T08:23:04.405 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/linkinfo.o 2024-05-08T08:23:04.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:04 smithi070 ceph-mon[29591]: pgmap v3073: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 402 KiB/s wr, 32 op/s 2024-05-08T08:23:04.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:04 smithi172 ceph-mon[33377]: pgmap v3073: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 402 KiB/s wr, 32 op/s 2024-05-08T08:23:04.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:04 smithi194 ceph-mon[33679]: pgmap v3073: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 502 KiB/s rd, 402 KiB/s wr, 32 op/s 2024-05-08T08:23:04.850 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nfs/nfs4sysctl.o 2024-05-08T08:23:05.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:05 smithi172 ceph-mon[33377]: osdmap e270: 12 total, 12 up, 12 in 2024-05-08T08:23:05.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:05 smithi194 ceph-mon[33679]: osdmap e270: 12 total, 12 up, 12 in 2024-05-08T08:23:05.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:05 smithi070 ceph-mon[29591]: osdmap e270: 12 total, 12 up, 12 in 2024-05-08T08:23:06.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:06 smithi194 ceph-mon[33679]: pgmap v3075: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 656 KiB/s wr, 53 op/s 2024-05-08T08:23:06.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:06 smithi070 ceph-mon[29591]: pgmap v3075: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 656 KiB/s wr, 53 op/s 2024-05-08T08:23:06.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:06 smithi172 ceph-mon[33377]: pgmap v3075: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 656 KiB/s wr, 53 op/s 2024-05-08T08:23:08.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:08 smithi194 ceph-mon[33679]: pgmap v3076: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 656 KiB/s wr, 53 op/s 2024-05-08T08:23:08.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:08 smithi070 ceph-mon[29591]: pgmap v3076: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 656 KiB/s wr, 53 op/s 2024-05-08T08:23:08.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:08 smithi172 ceph-mon[33377]: pgmap v3076: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 555 KiB/s rd, 656 KiB/s wr, 53 op/s 2024-05-08T08:23:09.486 INFO:tasks.workunit.client.0.smithi070.stdout: GEN lib/oid_registry_data.c 2024-05-08T08:23:09.634 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/ucs2_string.o 2024-05-08T08:23:09.680 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsaccess.o 2024-05-08T08:23:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:10 smithi194 ceph-mon[33679]: pgmap v3077: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 618 KiB/s wr, 50 op/s 2024-05-08T08:23:10.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:10 smithi070 ceph-mon[29591]: pgmap v3077: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 618 KiB/s wr, 50 op/s 2024-05-08T08:23:10.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:10 smithi172 ceph-mon[33377]: pgmap v3077: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 618 KiB/s wr, 50 op/s 2024-05-08T08:23:11.368 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/irq.o 2024-05-08T08:23:11.529 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/vfs_dentry.o 2024-05-08T08:23:11.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:23:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:23:11.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:23:12.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:12 smithi194 ceph-mon[33679]: pgmap v3078: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 618 KiB/s wr, 50 op/s 2024-05-08T08:23:12.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:12 smithi070 ceph-mon[29591]: pgmap v3078: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 618 KiB/s wr, 50 op/s 2024-05-08T08:23:12.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:12 smithi172 ceph-mon[33377]: pgmap v3078: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 618 KiB/s wr, 50 op/s 2024-05-08T08:23:13.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:23:13.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:23:13.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:23:13.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:23:13.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:23:13.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:23:13.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:23:13.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:23:13.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:23:14.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:14 smithi070 ceph-mon[29591]: pgmap v3079: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 618 KiB/s wr, 50 op/s 2024-05-08T08:23:14.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:14 smithi070 ceph-mon[29591]: osdmap e271: 12 total, 12 up, 12 in 2024-05-08T08:23:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:14 smithi194 ceph-mon[33679]: pgmap v3079: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 618 KiB/s wr, 50 op/s 2024-05-08T08:23:14.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:14 smithi194 ceph-mon[33679]: osdmap e271: 12 total, 12 up, 12 in 2024-05-08T08:23:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:14 smithi172 ceph-mon[33377]: pgmap v3079: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 618 KiB/s wr, 50 op/s 2024-05-08T08:23:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:14 smithi172 ceph-mon[33377]: osdmap e271: 12 total, 12 up, 12 in 2024-05-08T08:23:16.434 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsalloc.o 2024-05-08T08:23:16.451 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/sbitmap.o 2024-05-08T08:23:16.699 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/v9fs.o 2024-05-08T08:23:16.727 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:16 smithi172 ceph-mon[33377]: pgmap v3081: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 619 KiB/s wr, 27 op/s 2024-05-08T08:23:16.740 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/linkmodes.o 2024-05-08T08:23:16.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:16 smithi194 ceph-mon[33679]: pgmap v3081: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 619 KiB/s wr, 27 op/s 2024-05-08T08:23:16.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:16 smithi070 ceph-mon[29591]: pgmap v3081: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 619 KiB/s wr, 27 op/s 2024-05-08T08:23:17.589 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_sockopt.o 2024-05-08T08:23:17.654 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/nfs/built-in.a 2024-05-08T08:23:18.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:18 smithi194 ceph-mon[33679]: pgmap v3082: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 619 KiB/s wr, 27 op/s 2024-05-08T08:23:18.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:18 smithi070 ceph-mon[29591]: pgmap v3082: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 619 KiB/s wr, 27 op/s 2024-05-08T08:23:18.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:18 smithi172 ceph-mon[33377]: pgmap v3082: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 619 KiB/s wr, 27 op/s 2024-05-08T08:23:19.626 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/utils.o 2024-05-08T08:23:20.015 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsarguments.o 2024-05-08T08:23:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:20 smithi194 ceph-mon[33679]: pgmap v3083: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 797 KiB/s wr, 29 op/s 2024-05-08T08:23:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:20 smithi070 ceph-mon[29591]: pgmap v3083: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 797 KiB/s wr, 29 op/s 2024-05-08T08:23:20.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:20 smithi172 ceph-mon[33377]: pgmap v3083: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 797 KiB/s wr, 29 op/s 2024-05-08T08:23:21.097 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/common.o 2024-05-08T08:23:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:22 smithi194 ceph-mon[33679]: pgmap v3084: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 797 KiB/s wr, 29 op/s 2024-05-08T08:23:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:22 smithi070 ceph-mon[29591]: pgmap v3084: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 797 KiB/s wr, 29 op/s 2024-05-08T08:23:22.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:22 smithi172 ceph-mon[33377]: pgmap v3084: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 797 KiB/s wr, 29 op/s 2024-05-08T08:23:23.202 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/early.o 2024-05-08T08:23:24.207 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/group_cpus.o 2024-05-08T08:23:24.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:24 smithi194 ceph-mon[33679]: pgmap v3085: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 797 KiB/s wr, 29 op/s 2024-05-08T08:23:24.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:24 smithi070 ceph-mon[29591]: pgmap v3085: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 797 KiB/s wr, 29 op/s 2024-05-08T08:23:24.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:24 smithi172 ceph-mon[33377]: pgmap v3085: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 797 KiB/s wr, 29 op/s 2024-05-08T08:23:25.484 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/fid.o 2024-05-08T08:23:26.580 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsconvert.o 2024-05-08T08:23:26.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:26 smithi194 ceph-mon[33679]: pgmap v3086: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 848 KiB/s wr, 35 op/s 2024-05-08T08:23:26.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:26 smithi070 ceph-mon[29591]: pgmap v3086: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 848 KiB/s wr, 35 op/s 2024-05-08T08:23:26.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:26 smithi172 ceph-mon[33377]: pgmap v3086: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 848 KiB/s wr, 35 op/s 2024-05-08T08:23:28.532 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/rss.o 2024-05-08T08:23:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:28 smithi194 ceph-mon[33679]: pgmap v3087: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 782 KiB/s wr, 32 op/s 2024-05-08T08:23:28.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:28 smithi070 ceph-mon[29591]: pgmap v3087: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 782 KiB/s wr, 32 op/s 2024-05-08T08:23:28.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:28 smithi172 ceph-mon[33377]: pgmap v3087: 129 pgs: 129 active+clean; 1.9 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 782 KiB/s wr, 32 op/s 2024-05-08T08:23:29.461 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nfnetlink.o 2024-05-08T08:23:30.680 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/bus_numa.o 2024-05-08T08:23:30.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:30 smithi070 ceph-mon[29591]: pgmap v3088: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.0 MiB/s wr, 41 op/s 2024-05-08T08:23:30.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:30 smithi172 ceph-mon[33377]: pgmap v3088: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.0 MiB/s wr, 41 op/s 2024-05-08T08:23:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:30 smithi194 ceph-mon[33679]: pgmap v3088: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 1.0 MiB/s wr, 41 op/s 2024-05-08T08:23:31.729 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/lib.a 2024-05-08T08:23:32.208 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nfnetlink_log.o 2024-05-08T08:23:32.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:32 smithi070 ceph-mon[29591]: pgmap v3089: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 694 KiB/s wr, 26 op/s 2024-05-08T08:23:32.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:32 smithi172 ceph-mon[33377]: pgmap v3089: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 694 KiB/s wr, 26 op/s 2024-05-08T08:23:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:32 smithi194 ceph-mon[33679]: pgmap v3089: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 694 KiB/s wr, 26 op/s 2024-05-08T08:23:33.105 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsdump.o 2024-05-08T08:23:33.120 INFO:tasks.workunit.client.0.smithi070.stdout: GEN lib/crc32table.h 2024-05-08T08:23:33.167 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nseval.o 2024-05-08T08:23:33.305 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/oid_registry.o 2024-05-08T08:23:34.283 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/9p/xattr.o 2024-05-08T08:23:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:34 smithi070 ceph-mon[29591]: pgmap v3090: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 694 KiB/s wr, 26 op/s 2024-05-08T08:23:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:34 smithi172 ceph-mon[33377]: pgmap v3090: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 694 KiB/s wr, 26 op/s 2024-05-08T08:23:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:34 smithi194 ceph-mon[33679]: pgmap v3090: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 694 KiB/s wr, 26 op/s 2024-05-08T08:23:36.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:36 smithi070 ceph-mon[29591]: pgmap v3091: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 1.1 MiB/s wr, 45 op/s 2024-05-08T08:23:36.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:36 smithi172 ceph-mon[33377]: pgmap v3091: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 1.1 MiB/s wr, 45 op/s 2024-05-08T08:23:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:36 smithi194 ceph-mon[33679]: pgmap v3091: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 997 KiB/s rd, 1.1 MiB/s wr, 45 op/s 2024-05-08T08:23:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:38 smithi070 ceph-mon[29591]: pgmap v3092: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 639 KiB/s wr, 28 op/s 2024-05-08T08:23:38.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:38 smithi172 ceph-mon[33377]: pgmap v3092: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 639 KiB/s wr, 28 op/s 2024-05-08T08:23:39.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:38 smithi194 ceph-mon[33679]: pgmap v3092: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 639 KiB/s wr, 28 op/s 2024-05-08T08:23:39.314 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsinit.o 2024-05-08T08:23:39.328 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/pci/amd_bus.o 2024-05-08T08:23:39.624 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma/dw/core.o 2024-05-08T08:23:39.635 INFO:tasks.workunit.client.0.smithi070.stdout: CC lib/crc32.o 2024-05-08T08:23:39.982 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/linkstate.o 2024-05-08T08:23:40.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:40 smithi070 ceph-mon[29591]: pgmap v3093: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 915 KiB/s wr, 51 op/s 2024-05-08T08:23:40.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:40 smithi172 ceph-mon[33377]: pgmap v3093: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 915 KiB/s wr, 51 op/s 2024-05-08T08:23:41.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:40 smithi194 ceph-mon[33679]: pgmap v3093: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 915 KiB/s wr, 51 op/s 2024-05-08T08:23:41.262 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma/hsu/hsu.o 2024-05-08T08:23:42.852 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/9p/built-in.a 2024-05-08T08:23:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:42 smithi070 ceph-mon[29591]: pgmap v3094: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 667 KiB/s wr, 42 op/s 2024-05-08T08:23:42.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:42 smithi172 ceph-mon[33377]: pgmap v3094: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 667 KiB/s wr, 42 op/s 2024-05-08T08:23:43.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:42 smithi194 ceph-mon[33679]: pgmap v3094: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 667 KiB/s wr, 42 op/s 2024-05-08T08:23:43.381 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/hostfs/built-in.a 2024-05-08T08:23:43.546 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/debugfs/inode.o 2024-05-08T08:23:44.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:44 smithi070 ceph-mon[29591]: pgmap v3095: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 667 KiB/s wr, 42 op/s 2024-05-08T08:23:44.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:44 smithi172 ceph-mon[33377]: pgmap v3095: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 667 KiB/s wr, 42 op/s 2024-05-08T08:23:45.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:44 smithi194 ceph-mon[33679]: pgmap v3095: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 667 KiB/s wr, 42 op/s 2024-05-08T08:23:45.650 INFO:tasks.workunit.client.0.smithi070.stdout: AR lib/built-in.a 2024-05-08T08:23:46.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:46 smithi070 ceph-mon[29591]: pgmap v3096: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 895 KiB/s wr, 53 op/s 2024-05-08T08:23:46.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:46 smithi172 ceph-mon[33377]: pgmap v3096: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 895 KiB/s wr, 53 op/s 2024-05-08T08:23:47.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:46 smithi194 ceph-mon[33679]: pgmap v3096: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 795 KiB/s rd, 895 KiB/s wr, 53 op/s 2024-05-08T08:23:47.970 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsload.o 2024-05-08T08:23:48.533 INFO:tasks.workunit.client.0.smithi070.stdout: AR arch/x86/pci/built-in.a 2024-05-08T08:23:48.700 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma/dw/dw.o 2024-05-08T08:23:48.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:48 smithi070 ceph-mon[29591]: pgmap v3097: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 505 KiB/s wr, 35 op/s 2024-05-08T08:23:48.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:48 smithi172 ceph-mon[33377]: pgmap v3097: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 505 KiB/s wr, 35 op/s 2024-05-08T08:23:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:48 smithi194 ceph-mon[33679]: pgmap v3097: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 505 KiB/s wr, 35 op/s 2024-05-08T08:23:49.288 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_core.o 2024-05-08T08:23:49.419 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsnames.o 2024-05-08T08:23:50.113 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dma/hsu/built-in.a 2024-05-08T08:23:50.464 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/apple/built-in.a 2024-05-08T08:23:50.568 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/aspeed/built-in.a 2024-05-08T08:23:50.677 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/tracefs/inode.o 2024-05-08T08:23:50.807 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:50 smithi194 ceph-mon[33679]: pgmap v3098: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 812 KiB/s wr, 47 op/s 2024-05-08T08:23:50.839 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/bcm/bcm63xx/built-in.a 2024-05-08T08:23:50.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:50 smithi070 ceph-mon[29591]: pgmap v3098: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 812 KiB/s wr, 47 op/s 2024-05-08T08:23:50.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:50 smithi172 ceph-mon[33377]: pgmap v3098: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 812 KiB/s wr, 47 op/s 2024-05-08T08:23:50.983 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/bcm/built-in.a 2024-05-08T08:23:51.237 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/fsl/built-in.a 2024-05-08T08:23:51.417 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/fujitsu/built-in.a 2024-05-08T08:23:51.531 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/debug.o 2024-05-08T08:23:51.619 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/imx/built-in.a 2024-05-08T08:23:51.825 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/ixp4xx/built-in.a 2024-05-08T08:23:52.030 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/loongson/built-in.a 2024-05-08T08:23:52.265 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/debugfs/file.o 2024-05-08T08:23:52.292 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/mediatek/built-in.a 2024-05-08T08:23:52.461 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/microchip/built-in.a 2024-05-08T08:23:52.638 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/nuvoton/built-in.a 2024-05-08T08:23:52.810 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/pxa/built-in.a 2024-05-08T08:23:52.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:52 smithi070 ceph-mon[29591]: pgmap v3099: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 535 KiB/s wr, 24 op/s 2024-05-08T08:23:52.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:52 smithi172 ceph-mon[33377]: pgmap v3099: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 535 KiB/s wr, 24 op/s 2024-05-08T08:23:53.002 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/amlogic/built-in.a 2024-05-08T08:23:53.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:52 smithi194 ceph-mon[33679]: pgmap v3099: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 535 KiB/s wr, 24 op/s 2024-05-08T08:23:53.190 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/qcom/built-in.a 2024-05-08T08:23:53.398 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/renesas/built-in.a 2024-05-08T08:23:53.585 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/rockchip/built-in.a 2024-05-08T08:23:53.764 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/sifive/built-in.a 2024-05-08T08:23:53.940 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/sunxi/built-in.a 2024-05-08T08:23:54.130 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/ti/built-in.a 2024-05-08T08:23:54.372 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/xilinx/built-in.a 2024-05-08T08:23:54.497 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/soc/built-in.a 2024-05-08T08:23:54.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:54 smithi070 ceph-mon[29591]: pgmap v3100: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 535 KiB/s wr, 24 op/s 2024-05-08T08:23:54.901 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsobject.o 2024-05-08T08:23:54.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:54 smithi172 ceph-mon[33377]: pgmap v3100: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 535 KiB/s wr, 24 op/s 2024-05-08T08:23:55.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:54 smithi194 ceph-mon[33679]: pgmap v3100: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 535 KiB/s wr, 24 op/s 2024-05-08T08:23:55.088 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/netfilter/nf_defrag_ipv4.o 2024-05-08T08:23:55.929 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_policy.o 2024-05-08T08:23:56.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:56 smithi070 ceph-mon[29591]: pgmap v3101: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 888 KiB/s wr, 51 op/s 2024-05-08T08:23:56.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:56 smithi172 ceph-mon[33377]: pgmap v3101: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 888 KiB/s wr, 51 op/s 2024-05-08T08:23:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:56 smithi194 ceph-mon[33679]: pgmap v3101: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 888 KiB/s wr, 51 op/s 2024-05-08T08:23:57.265 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma/dw/idma32.o 2024-05-08T08:23:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:23:58 smithi070 ceph-mon[29591]: pgmap v3102: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 659 KiB/s wr, 39 op/s 2024-05-08T08:23:58.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:23:58 smithi172 ceph-mon[33377]: pgmap v3102: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 659 KiB/s wr, 39 op/s 2024-05-08T08:23:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:23:58 smithi194 ceph-mon[33679]: pgmap v3102: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 659 KiB/s wr, 39 op/s 2024-05-08T08:23:59.219 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/tracefs/built-in.a 2024-05-08T08:23:59.410 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma/dw/acpi.o 2024-05-08T08:24:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:00 smithi070 ceph-mon[29591]: pgmap v3103: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 800 KiB/s wr, 53 op/s 2024-05-08T08:24:00.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:00 smithi172 ceph-mon[33377]: pgmap v3103: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 800 KiB/s wr, 53 op/s 2024-05-08T08:24:01.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:00 smithi194 ceph-mon[33679]: pgmap v3103: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 800 KiB/s wr, 53 op/s 2024-05-08T08:24:01.990 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsparse.o 2024-05-08T08:24:02.075 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/debugfs/built-in.a 2024-05-08T08:24:02.548 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] fs/efivarfs/inode.o 2024-05-08T08:24:02.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:02 smithi070 ceph-mon[29591]: pgmap v3104: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 494 KiB/s wr, 40 op/s 2024-05-08T08:24:02.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:02 smithi172 ceph-mon[33377]: pgmap v3104: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 494 KiB/s wr, 40 op/s 2024-05-08T08:24:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:02 smithi194 ceph-mon[33679]: pgmap v3104: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 494 KiB/s wr, 40 op/s 2024-05-08T08:24:04.004 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_standalone.o 2024-05-08T08:24:04.229 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/wol.o 2024-05-08T08:24:04.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:04 smithi070 ceph-mon[29591]: pgmap v3105: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 494 KiB/s wr, 40 op/s 2024-05-08T08:24:04.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:04 smithi172 ceph-mon[33377]: pgmap v3105: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 494 KiB/s wr, 40 op/s 2024-05-08T08:24:05.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:04 smithi194 ceph-mon[33679]: pgmap v3105: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 494 KiB/s wr, 40 op/s 2024-05-08T08:24:05.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:05 smithi070 ceph-mon[29591]: osdmap e272: 12 total, 12 up, 12 in 2024-05-08T08:24:05.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:05 smithi172 ceph-mon[33377]: osdmap e272: 12 total, 12 up, 12 in 2024-05-08T08:24:06.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:05 smithi194 ceph-mon[33679]: osdmap e272: 12 total, 12 up, 12 in 2024-05-08T08:24:06.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:06 smithi070 ceph-mon[29591]: pgmap v3107: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 645 KiB/s wr, 62 op/s 2024-05-08T08:24:06.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:06 smithi172 ceph-mon[33377]: pgmap v3107: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 645 KiB/s wr, 62 op/s 2024-05-08T08:24:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:06 smithi194 ceph-mon[33679]: pgmap v3107: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 645 KiB/s wr, 62 op/s 2024-05-08T08:24:07.308 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/unix/af_unix.o 2024-05-08T08:24:08.302 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nspredef.o 2024-05-08T08:24:08.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:08 smithi172 ceph-mon[33377]: pgmap v3108: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 645 KiB/s wr, 62 op/s 2024-05-08T08:24:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:08 smithi194 ceph-mon[33679]: pgmap v3108: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 645 KiB/s wr, 62 op/s 2024-05-08T08:24:09.042 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/netfilter/nf_reject_ipv4.o 2024-05-08T08:24:09.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:08 smithi070 ceph-mon[29591]: pgmap v3108: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 645 KiB/s wr, 62 op/s 2024-05-08T08:24:09.527 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dma/dw/built-in.a 2024-05-08T08:24:09.979 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dma/idxd/built-in.a 2024-05-08T08:24:10.157 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dma/mediatek/built-in.a 2024-05-08T08:24:10.386 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dma/qcom/built-in.a 2024-05-08T08:24:10.653 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dma/ti/built-in.a 2024-05-08T08:24:10.837 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dma/xilinx/built-in.a 2024-05-08T08:24:10.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:10 smithi172 ceph-mon[33377]: pgmap v3109: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 717 KiB/s wr, 59 op/s 2024-05-08T08:24:10.927 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] fs/efivarfs/file.o 2024-05-08T08:24:10.958 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma/dmaengine.o 2024-05-08T08:24:11.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:10 smithi194 ceph-mon[33679]: pgmap v3109: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 717 KiB/s wr, 59 op/s 2024-05-08T08:24:11.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:10 smithi070 ceph-mon[29591]: pgmap v3109: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 717 KiB/s wr, 59 op/s 2024-05-08T08:24:11.504 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_state.o 2024-05-08T08:24:12.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:12 smithi172 ceph-mon[33377]: pgmap v3110: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 717 KiB/s wr, 59 op/s 2024-05-08T08:24:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:12 smithi194 ceph-mon[33679]: pgmap v3110: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 717 KiB/s wr, 59 op/s 2024-05-08T08:24:13.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:12 smithi070 ceph-mon[29591]: pgmap v3110: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 717 KiB/s wr, 59 op/s 2024-05-08T08:24:14.813 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsprepkg.o 2024-05-08T08:24:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:14 smithi172 ceph-mon[33377]: pgmap v3111: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 717 KiB/s wr, 59 op/s 2024-05-08T08:24:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:24:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:14 smithi172 ceph-mon[33377]: osdmap e273: 12 total, 12 up, 12 in 2024-05-08T08:24:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:14 smithi194 ceph-mon[33679]: pgmap v3111: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 717 KiB/s wr, 59 op/s 2024-05-08T08:24:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:24:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:14 smithi194 ceph-mon[33679]: osdmap e273: 12 total, 12 up, 12 in 2024-05-08T08:24:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:14 smithi070 ceph-mon[29591]: pgmap v3111: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 717 KiB/s wr, 59 op/s 2024-05-08T08:24:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:24:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:14 smithi070 ceph-mon[29591]: osdmap e273: 12 total, 12 up, 12 in 2024-05-08T08:24:15.768 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/features.o 2024-05-08T08:24:15.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:24:15.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:24:15.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:24:16.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:24:16.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:24:16.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:24:16.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:24:16.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:24:16.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:24:16.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:16 smithi172 ceph-mon[33377]: pgmap v3113: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 519 KiB/s wr, 34 op/s 2024-05-08T08:24:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:16 smithi194 ceph-mon[33679]: pgmap v3113: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 519 KiB/s wr, 34 op/s 2024-05-08T08:24:17.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:16 smithi070 ceph-mon[29591]: pgmap v3113: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 519 KiB/s wr, 34 op/s 2024-05-08T08:24:18.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:18 smithi172 ceph-mon[33377]: pgmap v3114: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 519 KiB/s wr, 34 op/s 2024-05-08T08:24:18.975 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_expect.o 2024-05-08T08:24:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:18 smithi194 ceph-mon[33679]: pgmap v3114: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 519 KiB/s wr, 34 op/s 2024-05-08T08:24:19.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:18 smithi070 ceph-mon[29591]: pgmap v3114: 129 pgs: 129 active+clean; 2.0 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 519 KiB/s wr, 34 op/s 2024-05-08T08:24:20.545 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma/virt-dma.o 2024-05-08T08:24:20.909 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/unix/garbage.o 2024-05-08T08:24:20.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:20 smithi172 ceph-mon[33377]: pgmap v3115: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 626 KiB/s wr, 32 op/s 2024-05-08T08:24:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:20 smithi194 ceph-mon[33679]: pgmap v3115: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 626 KiB/s wr, 32 op/s 2024-05-08T08:24:21.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:20 smithi070 ceph-mon[29591]: pgmap v3115: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 626 KiB/s wr, 32 op/s 2024-05-08T08:24:22.199 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsrepair.o 2024-05-08T08:24:22.697 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] fs/efivarfs/super.o 2024-05-08T08:24:22.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:22 smithi172 ceph-mon[33377]: pgmap v3116: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 626 KiB/s wr, 32 op/s 2024-05-08T08:24:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:22 smithi194 ceph-mon[33679]: pgmap v3116: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 626 KiB/s wr, 32 op/s 2024-05-08T08:24:23.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:22 smithi070 ceph-mon[29591]: pgmap v3116: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 626 KiB/s wr, 32 op/s 2024-05-08T08:24:23.326 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/netfilter/ip_tables.o 2024-05-08T08:24:24.922 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_hash.o 2024-05-08T08:24:24.925 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:24 smithi070 ceph-mon[29591]: pgmap v3117: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 626 KiB/s wr, 32 op/s 2024-05-08T08:24:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:24 smithi194 ceph-mon[33679]: pgmap v3117: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 626 KiB/s wr, 32 op/s 2024-05-08T08:24:25.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:24 smithi172 ceph-mon[33377]: pgmap v3117: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 626 KiB/s wr, 32 op/s 2024-05-08T08:24:26.665 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.1 2024-05-08T08:24:26.665 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:24:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:26 smithi194 ceph-mon[33679]: pgmap v3118: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 643 KiB/s wr, 25 op/s 2024-05-08T08:24:27.016 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/privflags.o 2024-05-08T08:24:27.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:26 smithi070 ceph-mon[29591]: pgmap v3118: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 643 KiB/s wr, 25 op/s 2024-05-08T08:24:27.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:26 smithi172 ceph-mon[33377]: pgmap v3118: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 643 KiB/s wr, 25 op/s 2024-05-08T08:24:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:24:28.439 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsrepair2.o 2024-05-08T08:24:29.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:28 smithi194 ceph-mon[33679]: pgmap v3119: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 594 KiB/s wr, 23 op/s 2024-05-08T08:24:29.055 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma/acpi-dma.o 2024-05-08T08:24:29.113 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:28 smithi070 ceph-mon[29591]: pgmap v3119: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 594 KiB/s wr, 23 op/s 2024-05-08T08:24:29.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:28 smithi172 ceph-mon[33377]: pgmap v3119: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 594 KiB/s wr, 23 op/s 2024-05-08T08:24:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.911+0000 7f4203600700 1 -- 172.21.15.70:0/802670092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41fc10a4a0 msgr2=0x7f41fc10a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.911+0000 7f4203600700 1 --2- 172.21.15.70:0/802670092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41fc10a4a0 0x7f41fc10a880 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f41f00098f0 tx=0x7f41f0009c00 comp rx=0 tx=0).stop 2024-05-08T08:24:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.912+0000 7f4203600700 1 -- 172.21.15.70:0/802670092 shutdown_connections 2024-05-08T08:24:29.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.912+0000 7f4203600700 1 --2- 172.21.15.70:0/802670092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41fc1165f0 0x7f41fc1189e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.912+0000 7f4203600700 1 --2- 172.21.15.70:0/802670092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41fc10a4a0 0x7f41fc10a880 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.912+0000 7f4203600700 1 --2- 172.21.15.70:0/802670092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41fc10adc0 0x7f41fc1160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.912+0000 7f4203600700 1 -- 172.21.15.70:0/802670092 >> 172.21.15.70:0/802670092 conn(0x7f41fc06e610 msgr2=0x7f41fc06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:24:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.912+0000 7f4203600700 1 -- 172.21.15.70:0/802670092 shutdown_connections 2024-05-08T08:24:29.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.912+0000 7f4203600700 1 -- 172.21.15.70:0/802670092 wait complete. 2024-05-08T08:24:29.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.914+0000 7f4203600700 1 Processor -- start 2024-05-08T08:24:29.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.914+0000 7f4203600700 1 -- start start 2024-05-08T08:24:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.914+0000 7f4203600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41fc10a4a0 0x7f41fc115c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.914+0000 7f4203600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41fc10adc0 0x7f41fc112de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.915+0000 7f4203600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41fc1165f0 0x7f41fc113320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.915+0000 7f4203600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc10d420 con 0x7f41fc1165f0 2024-05-08T08:24:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.915+0000 7f4203600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc10d2a0 con 0x7f41fc10adc0 2024-05-08T08:24:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.915+0000 7f4203600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc10d5a0 con 0x7f41fc10a4a0 2024-05-08T08:24:29.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.915+0000 7f41fbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41fc10adc0 0x7f41fc112de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.915+0000 7f4201600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41fc1165f0 0x7f41fc113320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.915+0000 7f4201600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41fc1165f0 0x7f41fc113320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45240/0 (socket says 172.21.15.70:45240) 2024-05-08T08:24:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.915+0000 7f4201600700 1 -- 172.21.15.70:0/1940256751 learned_addr learned my addr 172.21.15.70:0/1940256751 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:24:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.915+0000 7f4200c00700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41fc10a4a0 0x7f41fc115c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.916+0000 7f4201600700 1 -- 172.21.15.70:0/1940256751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41fc10a4a0 msgr2=0x7f41fc115c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:29.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.916+0000 7f4201600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41fc10a4a0 0x7f41fc115c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:29.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.916+0000 7f4201600700 1 -- 172.21.15.70:0/1940256751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41fc10adc0 msgr2=0x7f41fc112de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:29.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.916+0000 7f4201600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41fc10adc0 0x7f41fc112de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:29.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.916+0000 7f4201600700 1 -- 172.21.15.70:0/1940256751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc113a50 con 0x7f41fc1165f0 2024-05-08T08:24:29.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.917+0000 7f41fbe00700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41fc10adc0 0x7f41fc112de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:24:29.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.917+0000 7f4201600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41fc1165f0 0x7f41fc113320 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c110 tx=0x7f41f400c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:24:29.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.918+0000 7f41f9600700 1 -- 172.21.15.70:0/1940256751 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f40092e0 con 0x7f41fc1165f0 2024-05-08T08:24:29.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.918+0000 7f41f9600700 1 -- 172.21.15.70:0/1940256751 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41f4004bb0 con 0x7f41fc1165f0 2024-05-08T08:24:29.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.918+0000 7f41f9600700 1 -- 172.21.15.70:0/1940256751 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f4007b20 con 0x7f41fc1165f0 2024-05-08T08:24:29.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.918+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc1b5170 con 0x7f41fc1165f0 2024-05-08T08:24:29.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.918+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc1b5510 con 0x7f41fc1165f0 2024-05-08T08:24:29.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.920+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41fc06fba0 con 0x7f41fc1165f0 2024-05-08T08:24:29.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.924+0000 7f41f9600700 1 -- 172.21.15.70:0/1940256751 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f41f401a020 con 0x7f41fc1165f0 2024-05-08T08:24:29.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.926+0000 7f41f9600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41e40b2af0 0x7f41e40b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:29.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.926+0000 7f41f9600700 1 -- 172.21.15.70:0/1940256751 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(273..273 src has 1..273) ==== 9583+0+0 (secure 0 0 0) 0x7f41f40e2e30 con 0x7f41fc1165f0 2024-05-08T08:24:29.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.927+0000 7f4200c00700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41e40b2af0 0x7f41e40b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:29.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.928+0000 7f4200c00700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41e40b2af0 0x7f41e40b4fb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f41f00098c0 tx=0x7f41f0019040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:24:29.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:29.930+0000 7f41f9600700 1 -- 172.21.15.70:0/1940256751 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f41f4010040 con 0x7f41fc1165f0 2024-05-08T08:24:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.405+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41fc1142a0 con 0x7f41fc1165f0 2024-05-08T08:24:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.406+0000 7f41f9600700 1 -- 172.21.15.70:0/1940256751 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f41fc1142a0 con 0x7f41fc1165f0 2024-05-08T08:24:30.400 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:24:30.400 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:24:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41e40b2af0 msgr2=0x7f41e40b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41e40b2af0 0x7f41e40b4fb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f41f00098c0 tx=0x7f41f0019040 comp rx=0 tx=0).stop 2024-05-08T08:24:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41fc1165f0 msgr2=0x7f41fc113320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41fc1165f0 0x7f41fc113320 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f41f400c110 tx=0x7f41f400c420 comp rx=0 tx=0).stop 2024-05-08T08:24:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 shutdown_connections 2024-05-08T08:24:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41e40b2af0 0x7f41e40b4fb0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41fc1165f0 0x7f41fc113320 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41fc10a4a0 0x7f41fc115c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 --2- 172.21.15.70:0/1940256751 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f41fc10adc0 0x7f41fc112de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.410+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 >> 172.21.15.70:0/1940256751 conn(0x7f41fc06e610 msgr2=0x7f41fc11c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:24:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.411+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 shutdown_connections 2024-05-08T08:24:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:30.411+0000 7f4203600700 1 -- 172.21.15.70:0/1940256751 wait complete. 2024-05-08T08:24:30.406 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:24:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:30 smithi194 ceph-mon[33679]: pgmap v3120: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 759 KiB/s wr, 36 op/s 2024-05-08T08:24:31.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:30 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1940256751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:24:31.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:30 smithi070 ceph-mon[29591]: pgmap v3120: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 759 KiB/s wr, 36 op/s 2024-05-08T08:24:31.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:30 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1940256751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:24:31.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:30 smithi172 ceph-mon[33377]: pgmap v3120: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 759 KiB/s wr, 36 op/s 2024-05-08T08:24:31.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:30 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1940256751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:24:31.273 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 85.1 --await-for 42.0' 2024-05-08T08:24:31.273 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 85.1 --await-for 42.0 2024-05-08T08:24:31.934 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_helper.o 2024-05-08T08:24:31.953 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] fs/efivarfs/vars.o 2024-05-08T08:24:32.324 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:24:32.528 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/unix/sysctl_net_unix.o 2024-05-08T08:24:32.738 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:32 smithi070 ceph-mon[29591]: pgmap v3121: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 470 KiB/s wr, 27 op/s 2024-05-08T08:24:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:32 smithi194 ceph-mon[33679]: pgmap v3121: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 470 KiB/s wr, 27 op/s 2024-05-08T08:24:33.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:32 smithi172 ceph-mon[33377]: pgmap v3121: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 470 KiB/s wr, 27 op/s 2024-05-08T08:24:33.939 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_input.o 2024-05-08T08:24:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:34 smithi070 ceph-mon[29591]: pgmap v3122: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 470 KiB/s wr, 27 op/s 2024-05-08T08:24:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:34 smithi194 ceph-mon[33679]: pgmap v3122: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 470 KiB/s wr, 27 op/s 2024-05-08T08:24:35.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:34 smithi172 ceph-mon[33377]: pgmap v3122: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 407 KiB/s rd, 470 KiB/s wr, 27 op/s 2024-05-08T08:24:35.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.688+0000 7f2bc2a00700 1 -- 172.21.15.70:0/1068940904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc06bd90 msgr2=0x7f2bbc108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:35.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.688+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/1068940904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc06bd90 0x7f2bbc108130 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b0d0 tx=0x7f2ba400b3e0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.689+0000 7f2bc2a00700 1 -- 172.21.15.70:0/1068940904 shutdown_connections 2024-05-08T08:24:35.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.689+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/1068940904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bbc108860 0x7f2bbc1103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.689+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/1068940904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bbc06b3e0 0x7f2bbc06b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.689+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/1068940904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc06bd90 0x7f2bbc108130 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.689+0000 7f2bc2a00700 1 -- 172.21.15.70:0/1068940904 >> 172.21.15.70:0/1068940904 conn(0x7f2bbc079340 msgr2=0x7f2bbc079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:24:35.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.689+0000 7f2bc2a00700 1 -- 172.21.15.70:0/1068940904 shutdown_connections 2024-05-08T08:24:35.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.689+0000 7f2bc2a00700 1 -- 172.21.15.70:0/1068940904 wait complete. 2024-05-08T08:24:35.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.691+0000 7f2bc2a00700 1 Processor -- start 2024-05-08T08:24:35.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.692+0000 7f2bc2a00700 1 -- start start 2024-05-08T08:24:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.692+0000 7f2bc2a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bbc06b3e0 0x7f2bbc102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.692+0000 7f2bc2a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bbc06bd90 0x7f2bbc1029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.692+0000 7f2bc2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc108860 0x7f2bbc102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.692+0000 7f2bc2a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc113620 con 0x7f2bbc108860 2024-05-08T08:24:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.692+0000 7f2bc2a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1134a0 con 0x7f2bbc06b3e0 2024-05-08T08:24:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.693+0000 7f2bc2a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1137a0 con 0x7f2bbc06bd90 2024-05-08T08:24:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.693+0000 7f2bc0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc108860 0x7f2bbc102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.693+0000 7f2bbbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bbc06b3e0 0x7f2bbc102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.693+0000 7f2bc0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc108860 0x7f2bbc102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45250/0 (socket says 172.21.15.70:45250) 2024-05-08T08:24:35.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.693+0000 7f2bc0a00700 1 -- 172.21.15.70:0/851141138 learned_addr learned my addr 172.21.15.70:0/851141138 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:24:35.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.693+0000 7f2bbbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bbc06b3e0 0x7f2bbc102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:46952/0 (socket says 172.21.15.70:46952) 2024-05-08T08:24:35.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.694+0000 7f2bc0a00700 1 -- 172.21.15.70:0/851141138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bbc06bd90 msgr2=0x7f2bbc1029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:35.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.694+0000 7f2bbb400700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bbc06bd90 0x7f2bbc1029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.694+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bbc06bd90 0x7f2bbc1029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.694+0000 7f2bc0a00700 1 -- 172.21.15.70:0/851141138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bbc06b3e0 msgr2=0x7f2bbc102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:35.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.694+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bbc06b3e0 0x7f2bbc102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.694+0000 7f2bc0a00700 1 -- 172.21.15.70:0/851141138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bbc1a8000 con 0x7f2bbc108860 2024-05-08T08:24:35.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.694+0000 7f2bbb400700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bbc06bd90 0x7f2bbc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:24:35.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.694+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc108860 0x7f2bbc102ef0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b550 tx=0x7f2bac00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:24:35.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.695+0000 7f2bb8c00700 1 -- 172.21.15.70:0/851141138 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac015020 con 0x7f2bbc108860 2024-05-08T08:24:35.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.695+0000 7f2bb8c00700 1 -- 172.21.15.70:0/851141138 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bac011cc0 con 0x7f2bbc108860 2024-05-08T08:24:35.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.695+0000 7f2bb8c00700 1 -- 172.21.15.70:0/851141138 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac010c80 con 0x7f2bbc108860 2024-05-08T08:24:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.695+0000 7f2bc2a00700 1 -- 172.21.15.70:0/851141138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc1a82f0 con 0x7f2bbc108860 2024-05-08T08:24:35.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.695+0000 7f2bc2a00700 1 -- 172.21.15.70:0/851141138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc1a87e0 con 0x7f2bbc108860 2024-05-08T08:24:35.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.700+0000 7f2bb8c00700 1 -- 172.21.15.70:0/851141138 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2bac018020 con 0x7f2bbc108860 2024-05-08T08:24:35.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.703+0000 7f2bb8c00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ba00b2ba0 0x7f2ba00b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.704+0000 7f2bb8c00700 1 -- 172.21.15.70:0/851141138 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(273..273 src has 1..273) ==== 9583+0+0 (secure 0 0 0) 0x7f2bac0e2080 con 0x7f2bbc108860 2024-05-08T08:24:35.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.704+0000 7f2bbbe00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ba00b2ba0 0x7f2ba00b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.705+0000 7f2bbbe00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ba00b2ba0 0x7f2ba00b5060 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009a10 tx=0x7f2bb4009190 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:24:35.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.722+0000 7f2bcd38cb80 1 Processor -- start 2024-05-08T08:24:35.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.722+0000 7f2bcd38cb80 1 -- start start 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.723+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c9912f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.723+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c991830 0x56131c9952e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.723+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c995820 0x56131c995c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.723+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56131c8dabb0 con 0x56131c991830 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.723+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56131c8788f0 con 0x56131c990f10 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.723+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56131c8d6b70 con 0x56131c995820 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.723+0000 7f2bbb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c991830 0x56131c9952e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.723+0000 7f2bbb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c991830 0x56131c9952e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45258/0 (socket says 172.21.15.70:45258) 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.723+0000 7f2bbb400700 1 -- 172.21.15.70:0/2397490278 learned_addr learned my addr 172.21.15.70:0/2397490278 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:24:35.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.724+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/2397490278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c995820 0x56131c995c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.724+0000 7f2bbb400700 1 -- 172.21.15.70:0/2397490278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c995820 msgr2=0x56131c995c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:24:35.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.724+0000 7f2bbb400700 1 --2- 172.21.15.70:0/2397490278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c995820 0x56131c995c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.724+0000 7f2bbb400700 1 -- 172.21.15.70:0/2397490278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 msgr2=0x56131c9912f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:24:35.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.724+0000 7f2bbb400700 1 --2- 172.21.15.70:0/2397490278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c9912f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.724+0000 7f2bbb400700 1 -- 172.21.15.70:0/2397490278 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56131c827a60 con 0x56131c991830 2024-05-08T08:24:35.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.724+0000 7f2bbb400700 1 --2- 172.21.15.70:0/2397490278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c991830 0x56131c9952e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4015000 tx=0x7f2ba4009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1bb28f02622e63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:24:35.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.725+0000 7f2bb1600700 1 -- 172.21.15.70:0/2397490278 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4021020 con 0x56131c991830 2024-05-08T08:24:35.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.725+0000 7f2bb1600700 1 -- 172.21.15.70:0/2397490278 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ba40074e0 con 0x56131c991830 2024-05-08T08:24:35.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.725+0000 7f2bb1600700 1 -- 172.21.15.70:0/2397490278 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba401b670 con 0x56131c991830 2024-05-08T08:24:35.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.726+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2397490278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c991830 msgr2=0x56131c9952e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:35.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.726+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2397490278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c991830 0x56131c9952e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4015000 tx=0x7f2ba4009d90 comp rx=0 tx=0).stop 2024-05-08T08:24:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.726+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2397490278 shutdown_connections 2024-05-08T08:24:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.726+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2397490278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c995820 0x56131c995c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.726+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2397490278 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c9912f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.726+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2397490278 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c991830 0x56131c9952e0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.726+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2397490278 >> 172.21.15.70:0/2397490278 conn(0x56131c8b6cf0 msgr2=0x56131c982e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:24:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.726+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2397490278 shutdown_connections 2024-05-08T08:24:35.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.727+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2397490278 wait complete. 2024-05-08T08:24:35.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.727+0000 7f2bcd38cb80 1 -- start start 2024-05-08T08:24:35.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.728+0000 7f2bcd38cb80 1 Processor -- start 2024-05-08T08:24:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.729+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c99a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.729+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c99a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.729+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 0x56131c9a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.729+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56131c99da60 con 0x56131c995820 2024-05-08T08:24:35.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.729+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56131c840cb0 con 0x56131c990f10 2024-05-08T08:24:35.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.729+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56131c99dbe0 con 0x56131c99ae20 2024-05-08T08:24:35.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.729+0000 7f2bcd38cb80 10 client.0 _ll_register_callbacks cb 0x56131c881e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:24:35.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.730+0000 7f2bbbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c99a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.730+0000 7f2bbbe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c99a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:46974/0 (socket says 172.21.15.70:46974) 2024-05-08T08:24:35.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.730+0000 7f2bbbe00700 1 -- 172.21.15.70:0/3294866714 learned_addr learned my addr 172.21.15.70:0/3294866714 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:24:35.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.730+0000 7f2bbb400700 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c99a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.730+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 0x56131c9a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.731+0000 7f2bc0a00700 1 -- 172.21.15.70:0/3294866714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 msgr2=0x56131c99a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:24:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.731+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c99a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.731+0000 7f2bc0a00700 1 -- 172.21.15.70:0/3294866714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 msgr2=0x56131c99a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:24:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.731+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c99a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.731+0000 7f2bc0a00700 1 -- 172.21.15.70:0/3294866714 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56131c8a05b0 con 0x56131c99ae20 2024-05-08T08:24:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.731+0000 7f2bbb400700 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c99a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:24:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.731+0000 7f2bbbe00700 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c99a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:24:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.733+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 0x56131c9a6f10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0df460 tx=0x7f2bac0df8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb5b24b3ec24191d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:24:35.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.733+0000 7f2baa000700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T08:24:35.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.733+0000 7f2baa000700 1 -- 172.21.15.70:0/3294866714 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0c2020 con 0x56131c99ae20 2024-05-08T08:24:35.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.733+0000 7f2baa000700 1 -- 172.21.15.70:0/3294866714 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(273..273 src has 1..273) ==== 9583+0+0 (secure 0 0 0) 0x7f2bac0b1bd0 con 0x56131c99ae20 2024-05-08T08:24:35.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.734+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/3294866714 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ba40074e0 con 0x56131c99ae20 2024-05-08T08:24:35.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.734+0000 7f2baa000700 1 -- 172.21.15.70:0/3294866714 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2bac0a8b00 con 0x56131c99ae20 2024-05-08T08:24:35.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.734+0000 7f2bcd38cb80 10 client.26989 fetch_fsmap learned FSMap version 42 2024-05-08T08:24:35.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.734+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/3294866714 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56131c9a8aa0 con 0x56131c99ae20 2024-05-08T08:24:35.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.735+0000 7f2baa000700 1 -- 172.21.15.70:0/3294866714 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ba40074e0 con 0x56131c99ae20 2024-05-08T08:24:35.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.735+0000 7f2baa000700 1 -- 172.21.15.70:0/3294866714 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2bac0a8250 con 0x56131c99ae20 2024-05-08T08:24:35.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.736+0000 7f2bcd38cb80 10 client.26989 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:24:35.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.736+0000 7f2bcd38cb80 10 client.26989 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:24:35.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.736+0000 7f2bcd38cb80 20 client.26989 populate_metadata read hostname 'smithi070' 2024-05-08T08:24:35.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.736+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56131c9ab0e0 0x56131c9ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.736+0000 7f2bcd38cb80 4 client.26989 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:24:35.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.736+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/3294866714 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56131c955230 con 0x56131c9ab0e0 2024-05-08T08:24:35.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.737+0000 7f2bbbe00700 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56131c9ab0e0 0x56131c9ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.739+0000 7f2baa000700 10 client.26989 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:24:35.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.739+0000 7f2bbbe00700 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56131c9ab0e0 0x56131c9ad4d0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89cf31a4dc4de00 server_cookie=854f880a3b9cc52d in_seq=0 out_seq=0 2024-05-08T08:24:35.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.741+0000 7f2baa000700 1 -- 172.21.15.70:0/3294866714 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56131c955230 con 0x56131c9ab0e0 2024-05-08T08:24:35.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.741+0000 7f2baa000700 10 client.26989 handle_command_reply: tid=0 2024-05-08T08:24:35.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.741+0000 7f2bcd38cb80 1 client.26989 shutdown 2024-05-08T08:24:35.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.742+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/3294866714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 msgr2=0x56131c9a6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:35.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.742+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 0x56131c9a6f10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0df460 tx=0x7f2bac0df8b0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.742+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/3294866714 shutdown_connections 2024-05-08T08:24:35.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.742+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56131c9ab0e0 0x56131c9ad4d0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.742+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 0x56131c9a6f10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.742+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c99a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.742+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/3294866714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c99a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.742+0000 7f2baa000700 0 client.26989 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:24:35.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.742+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/3294866714 >> 172.21.15.70:0/3294866714 conn(0x56131c8b6cf0 msgr2=0x56131c996ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:24:35.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.743+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/3294866714 shutdown_connections 2024-05-08T08:24:35.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.743+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/3294866714 wait complete. 2024-05-08T08:24:35.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.743+0000 7f2bcd38cb80 20 client.26989 trim_cache size 0 max 16384 2024-05-08T08:24:35.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.779+0000 7f2bcd38cb80 1 Processor -- start 2024-05-08T08:24:35.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.780+0000 7f2bcd38cb80 1 -- start start 2024-05-08T08:24:35.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.780+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c97d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.780+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c995820 0x56131c999580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.780+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c99ae20 0x56131c99c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.780+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1afd90 con 0x56131c99ae20 2024-05-08T08:24:35.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.780+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1ad620 con 0x56131c990f10 2024-05-08T08:24:35.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.780+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1ab490 con 0x56131c995820 2024-05-08T08:24:35.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.780+0000 7f2bc0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c99ae20 0x56131c99c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.781+0000 7f2bc0a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c99ae20 0x56131c99c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45278/0 (socket says 172.21.15.70:45278) 2024-05-08T08:24:35.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.781+0000 7f2bc0a00700 1 -- 172.21.15.70:0/2426057808 learned_addr learned my addr 172.21.15.70:0/2426057808 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:24:35.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.781+0000 7f2bbbe00700 1 --2- 172.21.15.70:0/2426057808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c97d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.781+0000 7f2bc0a00700 1 -- 172.21.15.70:0/2426057808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c995820 msgr2=0x56131c999580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:24:35.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.781+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/2426057808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c995820 0x56131c999580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.781+0000 7f2bc0a00700 1 -- 172.21.15.70:0/2426057808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 msgr2=0x56131c97d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:24:35.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.781+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/2426057808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c97d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.781+0000 7f2bc0a00700 1 -- 172.21.15.70:0/2426057808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56131c97def0 con 0x56131c99ae20 2024-05-08T08:24:35.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.782+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/2426057808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c99ae20 0x56131c99c2e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b520 tx=0x7f2bac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a943f660b4be266 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:24:35.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.782+0000 7f2bb0c00700 1 -- 172.21.15.70:0/2426057808 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0c2070 con 0x56131c99ae20 2024-05-08T08:24:35.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.782+0000 7f2bb0c00700 1 -- 172.21.15.70:0/2426057808 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bac0a96f0 con 0x56131c99ae20 2024-05-08T08:24:35.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.782+0000 7f2bb0c00700 1 -- 172.21.15.70:0/2426057808 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0a4c60 con 0x56131c99ae20 2024-05-08T08:24:35.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.783+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2426057808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c99ae20 msgr2=0x56131c99c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:35.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.783+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2426057808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c99ae20 0x56131c99c2e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b520 tx=0x7f2bac004750 comp rx=0 tx=0).stop 2024-05-08T08:24:35.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.783+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2426057808 shutdown_connections 2024-05-08T08:24:35.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.783+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2426057808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c99ae20 0x56131c99c2e0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.783+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2426057808 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c97d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.783+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2426057808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c995820 0x56131c999580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.783+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2426057808 >> 172.21.15.70:0/2426057808 conn(0x56131c8b6cf0 msgr2=0x56131c99bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:24:35.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.784+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2426057808 shutdown_connections 2024-05-08T08:24:35.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.784+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2426057808 wait complete. 2024-05-08T08:24:35.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.784+0000 7f2bcd38cb80 1 -- start start 2024-05-08T08:24:35.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.784+0000 7f2bcd38cb80 1 Processor -- start 2024-05-08T08:24:35.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.785+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c9a3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.785+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c9a3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.785+0000 7f2bcd38cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 0x56131c99fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.785+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1abae0 con 0x56131c995820 2024-05-08T08:24:35.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.785+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1acf50 con 0x56131c990f10 2024-05-08T08:24:35.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.785+0000 7f2bcd38cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1ac1b0 con 0x56131c99ae20 2024-05-08T08:24:35.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.785+0000 7f2bcd38cb80 10 client.0 _ll_register_callbacks cb 0x56131c881e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:24:35.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bbb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c9a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bbb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c9a3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45294/0 (socket says 172.21.15.70:45294) 2024-05-08T08:24:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bbb400700 1 -- 172.21.15.70:0/2504836561 learned_addr learned my addr 172.21.15.70:0/2504836561 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:24:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bbbe00700 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c9a3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bc0a00700 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 0x56131c99fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bbb400700 1 -- 172.21.15.70:0/2504836561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 msgr2=0x56131c99fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:24:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bbb400700 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 0x56131c99fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bbb400700 1 -- 172.21.15.70:0/2504836561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 msgr2=0x56131c9a3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:24:35.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bbb400700 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c9a3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:35.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.786+0000 7f2bbb400700 1 -- 172.21.15.70:0/2504836561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56131c9a0830 con 0x56131c995820 2024-05-08T08:24:35.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.787+0000 7f2bbb400700 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c9a3590 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b0d0 tx=0x7f2ba40077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618f0f22e81ab3c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:24:35.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.787+0000 7f2baa000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:24:35.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.787+0000 7f2baa000700 1 -- 172.21.15.70:0/2504836561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4021040 con 0x56131c995820 2024-05-08T08:24:35.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.787+0000 7f2baa000700 1 -- 172.21.15.70:0/2504836561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(273..273 src has 1..273) ==== 9583+0+0 (secure 0 0 0) 0x7f2ba4007b70 con 0x56131c995820 2024-05-08T08:24:35.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.788+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2504836561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bac0a96f0 con 0x56131c995820 2024-05-08T08:24:35.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.788+0000 7f2baa000700 1 -- 172.21.15.70:0/2504836561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2ba400b820 con 0x56131c995820 2024-05-08T08:24:35.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.788+0000 7f2bcd38cb80 10 client.18018 fetch_fsmap learned FSMap version 42 2024-05-08T08:24:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.788+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2504836561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56131ca16440 con 0x56131c995820 2024-05-08T08:24:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.788+0000 7f2baa000700 1 -- 172.21.15.70:0/2504836561 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ba400b820 con 0x56131c995820 2024-05-08T08:24:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.789+0000 7f2baa000700 1 -- 172.21.15.70:0/2504836561 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2ba4011070 con 0x56131c995820 2024-05-08T08:24:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.789+0000 7f2bcd38cb80 10 client.18018 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:24:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.789+0000 7f2bcd38cb80 10 client.18018 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:24:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.789+0000 7f2bcd38cb80 20 client.18018 populate_metadata read hostname 'smithi070' 2024-05-08T08:24:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.789+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56131ca16720 0x56131ca18b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:24:35.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.789+0000 7f2bcd38cb80 4 client.18018 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.1, "await_for": 42.0}] 2024-05-08T08:24:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.789+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2504836561 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.1, "await_for": 42.0}) -- 0x56131c8e8590 con 0x56131ca16720 2024-05-08T08:24:35.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.789+0000 7f2bbbe00700 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56131ca16720 0x56131ca18b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:24:35.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.791+0000 7f2bbbe00700 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56131ca16720 0x56131ca18b40 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ed371cddc5c134a server_cookie=e634d72e9566bd36 in_seq=0 out_seq=0 2024-05-08T08:24:35.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:35.791+0000 7f2baa000700 10 client.18018 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:24:35.889 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nssearch.o 2024-05-08T08:24:36.793 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/netfilter/iptable_filter.o 2024-05-08T08:24:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:36 smithi194 ceph-mon[33679]: pgmap v3123: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 688 KiB/s wr, 38 op/s 2024-05-08T08:24:37.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:36 smithi070 ceph-mon[29591]: pgmap v3123: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 688 KiB/s wr, 38 op/s 2024-05-08T08:24:37.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:36 smithi172 ceph-mon[33377]: pgmap v3123: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 688 KiB/s wr, 38 op/s 2024-05-08T08:24:39.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:38 smithi194 ceph-mon[33679]: pgmap v3124: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 384 KiB/s wr, 24 op/s 2024-05-08T08:24:39.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:38 smithi070 ceph-mon[29591]: pgmap v3124: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 384 KiB/s wr, 24 op/s 2024-05-08T08:24:39.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:38 smithi172 ceph-mon[33377]: pgmap v3124: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 384 KiB/s wr, 24 op/s 2024-05-08T08:24:41.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:40 smithi194 ceph-mon[33679]: pgmap v3125: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 465 KiB/s wr, 34 op/s 2024-05-08T08:24:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:40 smithi070 ceph-mon[29591]: pgmap v3125: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 465 KiB/s wr, 34 op/s 2024-05-08T08:24:41.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:40 smithi172 ceph-mon[33377]: pgmap v3125: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 465 KiB/s wr, 34 op/s 2024-05-08T08:24:43.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:42 smithi194 ceph-mon[33679]: pgmap v3126: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 300 KiB/s wr, 20 op/s 2024-05-08T08:24:43.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:42 smithi070 ceph-mon[29591]: pgmap v3126: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 300 KiB/s wr, 20 op/s 2024-05-08T08:24:43.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:42 smithi172 ceph-mon[33377]: pgmap v3126: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 300 KiB/s wr, 20 op/s 2024-05-08T08:24:45.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:44 smithi194 ceph-mon[33679]: pgmap v3127: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 300 KiB/s wr, 20 op/s 2024-05-08T08:24:45.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:44 smithi070 ceph-mon[29591]: pgmap v3127: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 300 KiB/s wr, 20 op/s 2024-05-08T08:24:45.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:44 smithi172 ceph-mon[33377]: pgmap v3127: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 300 KiB/s wr, 20 op/s 2024-05-08T08:24:47.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:46 smithi194 ceph-mon[33679]: pgmap v3128: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 434 KiB/s wr, 27 op/s 2024-05-08T08:24:47.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:46 smithi070 ceph-mon[29591]: pgmap v3128: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 434 KiB/s wr, 27 op/s 2024-05-08T08:24:47.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:46 smithi172 ceph-mon[33377]: pgmap v3128: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 434 KiB/s wr, 27 op/s 2024-05-08T08:24:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:48 smithi194 ceph-mon[33679]: pgmap v3129: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 216 KiB/s wr, 15 op/s 2024-05-08T08:24:49.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:48 smithi070 ceph-mon[29591]: pgmap v3129: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 216 KiB/s wr, 15 op/s 2024-05-08T08:24:49.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:48 smithi172 ceph-mon[33377]: pgmap v3129: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 216 KiB/s wr, 15 op/s 2024-05-08T08:24:51.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:50 smithi194 ceph-mon[33679]: pgmap v3130: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 222 KiB/s wr, 19 op/s 2024-05-08T08:24:51.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:50 smithi070 ceph-mon[29591]: pgmap v3130: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 222 KiB/s wr, 19 op/s 2024-05-08T08:24:51.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:50 smithi172 ceph-mon[33377]: pgmap v3130: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 222 KiB/s wr, 19 op/s 2024-05-08T08:24:53.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:52 smithi070 ceph-mon[29591]: pgmap v3131: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 9 op/s 2024-05-08T08:24:53.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:52 smithi172 ceph-mon[33377]: pgmap v3131: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 9 op/s 2024-05-08T08:24:53.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:52 smithi194 ceph-mon[33679]: pgmap v3131: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 9 op/s 2024-05-08T08:24:55.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:54 smithi070 ceph-mon[29591]: pgmap v3132: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 9 op/s 2024-05-08T08:24:55.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:54 smithi172 ceph-mon[33377]: pgmap v3132: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 9 op/s 2024-05-08T08:24:55.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:54 smithi194 ceph-mon[33679]: pgmap v3132: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 9 op/s 2024-05-08T08:24:57.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:56 smithi070 ceph-mon[29591]: pgmap v3133: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 14 op/s 2024-05-08T08:24:57.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:56 smithi172 ceph-mon[33377]: pgmap v3133: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 14 op/s 2024-05-08T08:24:57.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:56 smithi194 ceph-mon[33679]: pgmap v3133: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 14 op/s 2024-05-08T08:24:59.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:24:58 smithi070 ceph-mon[29591]: pgmap v3134: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 64 KiB/s wr, 8 op/s 2024-05-08T08:24:59.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:24:58 smithi172 ceph-mon[33377]: pgmap v3134: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 64 KiB/s wr, 8 op/s 2024-05-08T08:24:59.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:24:58 smithi194 ceph-mon[33679]: pgmap v3134: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 64 KiB/s wr, 8 op/s 2024-05-08T08:24:59.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.523+0000 7f2baa000700 1 -- 172.21.15.70:0/2504836561 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56131c8e8590 con 0x56131ca16720 2024-05-08T08:24:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.523+0000 7f2baa000700 10 client.18018 handle_command_reply: tid=0 2024-05-08T08:24:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.523+0000 7f2bcd38cb80 1 client.18018 shutdown 2024-05-08T08:24:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.524+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2504836561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 msgr2=0x56131c9a3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.524+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c9a3590 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400b0d0 tx=0x7f2ba40077c0 comp rx=0 tx=0).stop 2024-05-08T08:24:59.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.524+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2504836561 shutdown_connections 2024-05-08T08:24:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.524+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56131ca16720 0x56131ca18b40 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.524+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56131c99ae20 0x56131c99fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.524+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56131c990f10 0x56131c9a3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.524+0000 7f2bcd38cb80 1 --2- 172.21.15.70:0/2504836561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56131c995820 0x56131c9a3590 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.524+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2504836561 >> 172.21.15.70:0/2504836561 conn(0x56131c8b6cf0 msgr2=0x56131c99bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:24:59.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.525+0000 7f2baa000700 0 client.18018 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:24:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.525+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2504836561 shutdown_connections 2024-05-08T08:24:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.525+0000 7f2bcd38cb80 1 -- 172.21.15.70:0/2504836561 wait complete. 2024-05-08T08:24:59.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.526+0000 7f2bcd38cb80 20 client.18018 trim_cache size 0 max 16384 2024-05-08T08:24:59.523 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:24:59.523 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:24:59.523 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:24:59.524 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 222, 2024-05-08T08:24:59.524 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:24:59.524 INFO:teuthology.orchestra.run.smithi070.stdout: "c6256f9": { 2024-05-08T08:24:59.524 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 222, 2024-05-08T08:24:59.524 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:24:59.524 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:24:59.525 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:24:59.525 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:24:59.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:24:59.525 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:24:59.525 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.1, 2024-05-08T08:24:59.525 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:24:59.525 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:24:59.525 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:24:59.526 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:24:59.526 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:24:59.526 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:24:59.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:24:59.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:24:59.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:24:59.526 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:24:59.527 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:24:59.527 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:24:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.527+0000 7f2bc2a00700 1 -- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ba00b2ba0 msgr2=0x7f2ba00b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.527+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ba00b2ba0 0x7f2ba00b5060 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009a10 tx=0x7f2bb4009190 comp rx=0 tx=0).stop 2024-05-08T08:24:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.527+0000 7f2bc2a00700 1 -- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc108860 msgr2=0x7f2bbc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:24:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.527+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc108860 0x7f2bbc102ef0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b550 tx=0x7f2bac00b860 comp rx=0 tx=0).stop 2024-05-08T08:24:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.528+0000 7f2bc2a00700 1 -- 172.21.15.70:0/851141138 shutdown_connections 2024-05-08T08:24:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.528+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2ba00b2ba0 0x7f2ba00b5060 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.528+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bbc108860 0x7f2bbc102ef0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:59.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.528+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2bbc06b3e0 0x7f2bbc102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.528+0000 7f2bc2a00700 1 --2- 172.21.15.70:0/851141138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bbc06bd90 0x7f2bbc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:24:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.528+0000 7f2bc2a00700 1 -- 172.21.15.70:0/851141138 >> 172.21.15.70:0/851141138 conn(0x7f2bbc079340 msgr2=0x7f2bbc100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:24:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.528+0000 7f2bc2a00700 1 -- 172.21.15.70:0/851141138 shutdown_connections 2024-05-08T08:24:59.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:24:59.528+0000 7f2bc2a00700 1 -- 172.21.15.70:0/851141138 wait complete. 2024-05-08T08:25:00.472 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c6256f9', quiesce took 33.8 seconds. Will release after: 25.1 2024-05-08T08:25:01.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:00 smithi070 ceph-mon[29591]: pgmap v3135: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 96 KiB/s wr, 11 op/s 2024-05-08T08:25:01.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:00 smithi172 ceph-mon[33377]: pgmap v3135: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 96 KiB/s wr, 11 op/s 2024-05-08T08:25:01.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:00 smithi194 ceph-mon[33679]: pgmap v3135: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 96 KiB/s wr, 11 op/s 2024-05-08T08:25:03.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:02 smithi070 ceph-mon[29591]: pgmap v3136: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 8 op/s 2024-05-08T08:25:03.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:02 smithi172 ceph-mon[33377]: pgmap v3136: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 8 op/s 2024-05-08T08:25:03.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:02 smithi194 ceph-mon[33679]: pgmap v3136: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 8 op/s 2024-05-08T08:25:05.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:04 smithi070 ceph-mon[29591]: pgmap v3137: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 8 op/s 2024-05-08T08:25:05.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:04 smithi172 ceph-mon[33377]: pgmap v3137: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 8 op/s 2024-05-08T08:25:05.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:04 smithi194 ceph-mon[33679]: pgmap v3137: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 8 op/s 2024-05-08T08:25:07.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:06 smithi070 ceph-mon[29591]: pgmap v3138: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 202 KiB/s wr, 29 op/s 2024-05-08T08:25:07.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:06 smithi172 ceph-mon[33377]: pgmap v3138: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 202 KiB/s wr, 29 op/s 2024-05-08T08:25:07.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:06 smithi194 ceph-mon[33679]: pgmap v3138: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 202 KiB/s wr, 29 op/s 2024-05-08T08:25:09.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:08 smithi070 ceph-mon[29591]: pgmap v3139: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 145 KiB/s wr, 24 op/s 2024-05-08T08:25:09.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:08 smithi172 ceph-mon[33377]: pgmap v3139: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 145 KiB/s wr, 24 op/s 2024-05-08T08:25:09.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:08 smithi194 ceph-mon[33679]: pgmap v3139: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 145 KiB/s wr, 24 op/s 2024-05-08T08:25:11.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:10 smithi070 ceph-mon[29591]: pgmap v3140: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 207 KiB/s wr, 29 op/s 2024-05-08T08:25:11.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:10 smithi172 ceph-mon[33377]: pgmap v3140: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 207 KiB/s wr, 29 op/s 2024-05-08T08:25:11.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:10 smithi194 ceph-mon[33679]: pgmap v3140: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 207 KiB/s wr, 29 op/s 2024-05-08T08:25:12.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:11 smithi070 ceph-mon[29591]: osdmap e274: 12 total, 12 up, 12 in 2024-05-08T08:25:12.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:11 smithi172 ceph-mon[33377]: osdmap e274: 12 total, 12 up, 12 in 2024-05-08T08:25:12.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:11 smithi194 ceph-mon[33679]: osdmap e274: 12 total, 12 up, 12 in 2024-05-08T08:25:13.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:12 smithi070 ceph-mon[29591]: pgmap v3142: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 209 KiB/s wr, 30 op/s 2024-05-08T08:25:13.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:12 smithi172 ceph-mon[33377]: pgmap v3142: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 209 KiB/s wr, 30 op/s 2024-05-08T08:25:13.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:12 smithi194 ceph-mon[33679]: pgmap v3142: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 209 KiB/s wr, 30 op/s 2024-05-08T08:25:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:14 smithi070 ceph-mon[29591]: pgmap v3143: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 209 KiB/s wr, 30 op/s 2024-05-08T08:25:15.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:14 smithi172 ceph-mon[33377]: pgmap v3143: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 209 KiB/s wr, 30 op/s 2024-05-08T08:25:15.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:14 smithi194 ceph-mon[33679]: pgmap v3143: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 209 KiB/s wr, 30 op/s 2024-05-08T08:25:16.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:15 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:25:16.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:15 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:25:16.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:15 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:25:17.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:16 smithi070 ceph-mon[29591]: pgmap v3144: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2024-05-08T08:25:17.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:16 smithi172 ceph-mon[33377]: pgmap v3144: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2024-05-08T08:25:17.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:16 smithi194 ceph-mon[33679]: pgmap v3144: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2024-05-08T08:25:18.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:25:18.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:25:18.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:17 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:25:18.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:25:18.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:25:18.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:17 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:25:18.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:25:18.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:25:18.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:17 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:25:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:19 smithi194 ceph-mon[33679]: pgmap v3145: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2024-05-08T08:25:19.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:19 smithi070 ceph-mon[29591]: pgmap v3145: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2024-05-08T08:25:19.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:19 smithi172 ceph-mon[33377]: pgmap v3145: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 101 KiB/s wr, 8 op/s 2024-05-08T08:25:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:20 smithi070 ceph-mon[29591]: osdmap e275: 12 total, 12 up, 12 in 2024-05-08T08:25:20.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:20 smithi070 ceph-mon[29591]: pgmap v3147: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 75 KiB/s wr, 7 op/s 2024-05-08T08:25:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:20 smithi172 ceph-mon[33377]: osdmap e275: 12 total, 12 up, 12 in 2024-05-08T08:25:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:20 smithi172 ceph-mon[33377]: pgmap v3147: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 75 KiB/s wr, 7 op/s 2024-05-08T08:25:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:20 smithi194 ceph-mon[33679]: osdmap e275: 12 total, 12 up, 12 in 2024-05-08T08:25:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:20 smithi194 ceph-mon[33679]: pgmap v3147: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 75 KiB/s wr, 7 op/s 2024-05-08T08:25:22.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:22 smithi172 ceph-mon[33377]: pgmap v3148: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T08:25:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:22 smithi194 ceph-mon[33679]: pgmap v3148: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T08:25:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:22 smithi070 ceph-mon[29591]: pgmap v3148: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T08:25:24.678 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:24 smithi070 ceph-mon[29591]: pgmap v3149: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T08:25:24.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:24 smithi194 ceph-mon[33679]: pgmap v3149: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T08:25:24.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:24 smithi172 ceph-mon[33377]: pgmap v3149: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T08:25:25.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:25:26.030 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:25:26.697 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:26 smithi070 ceph-mon[29591]: pgmap v3150: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:25:26.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:26 smithi194 ceph-mon[33679]: pgmap v3150: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:25:26.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:26 smithi172 ceph-mon[33377]: pgmap v3150: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:25:28.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.650+0000 7f9a8ac00700 1 -- 172.21.15.70:0/3783890185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a84109530 msgr2=0x7f9a84109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:28.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.650+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/3783890185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a84109530 0x7f9a84109910 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009990 tx=0x7f9a74009ca0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.650+0000 7f9a8ac00700 1 -- 172.21.15.70:0/3783890185 shutdown_connections 2024-05-08T08:25:28.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.650+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/3783890185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a8406c530 0x7f9a84110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.650+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/3783890185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a84109530 0x7f9a84109910 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.650+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/3783890185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a8406bb70 0x7f9a8406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.650+0000 7f9a8ac00700 1 -- 172.21.15.70:0/3783890185 >> 172.21.15.70:0/3783890185 conn(0x7f9a84079350 msgr2=0x7f9a84079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:25:28.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.650+0000 7f9a8ac00700 1 -- 172.21.15.70:0/3783890185 shutdown_connections 2024-05-08T08:25:28.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.650+0000 7f9a8ac00700 1 -- 172.21.15.70:0/3783890185 wait complete. 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.651+0000 7f9a8ac00700 1 Processor -- start 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.652+0000 7f9a8ac00700 1 -- start start 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.652+0000 7f9a8ac00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a8406bb70 0x7f9a841a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.652+0000 7f9a8ac00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a8406c530 0x7f9a841a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.652+0000 7f9a8ac00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a84109530 0x7f9a8419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.652+0000 7f9a8ac00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84113510 con 0x7f9a8406c530 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.652+0000 7f9a8ac00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84113390 con 0x7f9a84109530 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.652+0000 7f9a8ac00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9a84113690 con 0x7f9a8406bb70 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.653+0000 7f9a83400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a8406c530 0x7f9a841a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.653+0000 7f9a83400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a8406c530 0x7f9a841a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51894/0 (socket says 172.21.15.70:51894) 2024-05-08T08:25:28.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.653+0000 7f9a83400700 1 -- 172.21.15.70:0/784105553 learned_addr learned my addr 172.21.15.70:0/784105553 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:25:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.653+0000 7f9a83400700 1 -- 172.21.15.70:0/784105553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a8406bb70 msgr2=0x7f9a841a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.653+0000 7f9a83400700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a8406bb70 0x7f9a841a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.653+0000 7f9a83400700 1 -- 172.21.15.70:0/784105553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a84109530 msgr2=0x7f9a8419ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.653+0000 7f9a83400700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a84109530 0x7f9a8419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.653+0000 7f9a83400700 1 -- 172.21.15.70:0/784105553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8419c1d0 con 0x7f9a8406c530 2024-05-08T08:25:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.653+0000 7f9a83400700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a8406c530 0x7f9a841a1df0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000d950 tx=0x7f9a7000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:25:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.654+0000 7f9a80c00700 1 -- 172.21.15.70:0/784105553 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70016070 con 0x7f9a8406c530 2024-05-08T08:25:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.654+0000 7f9a80c00700 1 -- 172.21.15.70:0/784105553 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a70010460 con 0x7f9a8406c530 2024-05-08T08:25:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.654+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8419c4c0 con 0x7f9a8406c530 2024-05-08T08:25:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.654+0000 7f9a80c00700 1 -- 172.21.15.70:0/784105553 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7000f620 con 0x7f9a8406c530 2024-05-08T08:25:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.654+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a841a8780 con 0x7f9a8406c530 2024-05-08T08:25:28.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.655+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a84104bf0 con 0x7f9a8406c530 2024-05-08T08:25:28.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.657+0000 7f9a80c00700 1 -- 172.21.15.70:0/784105553 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9a70019070 con 0x7f9a8406c530 2024-05-08T08:25:28.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.659+0000 7f9a80c00700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a680b2a70 0x7f9a680b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:28.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.659+0000 7f9a80c00700 1 -- 172.21.15.70:0/784105553 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(275..275 src has 1..275) ==== 9583+0+0 (secure 0 0 0) 0x7f9a700e2600 con 0x7f9a8406c530 2024-05-08T08:25:28.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.659+0000 7f9a83e00700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a680b2a70 0x7f9a680b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:28.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.660+0000 7f9a83e00700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a680b2a70 0x7f9a680b4f30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9a740098e0 tx=0x7f9a74005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:25:28.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.662+0000 7f9a80c00700 1 -- 172.21.15.70:0/784105553 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9a700a9bc0 con 0x7f9a8406c530 2024-05-08T08:25:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:28 smithi194 ceph-mon[33679]: pgmap v3151: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:25:28.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:28 smithi070 ceph-mon[29591]: pgmap v3151: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:25:28.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:28 smithi172 ceph-mon[33377]: pgmap v3151: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T08:25:28.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.946+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a8406a190 con 0x7f9a8406c530 2024-05-08T08:25:28.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.948+0000 7f9a80c00700 1 -- 172.21.15.70:0/784105553 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f9a700a94c0 con 0x7f9a8406c530 2024-05-08T08:25:28.942 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:25:28.942 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a680b2a70 msgr2=0x7f9a680b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a680b2a70 0x7f9a680b4f30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9a740098e0 tx=0x7f9a74005fb0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a8406c530 msgr2=0x7f9a841a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a8406c530 0x7f9a841a1df0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000d950 tx=0x7f9a7000dd10 comp rx=0 tx=0).stop 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 shutdown_connections 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a680b2a70 0x7f9a680b4f30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9a84109530 0x7f9a8419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a8406bb70 0x7f9a841a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 --2- 172.21.15.70:0/784105553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a8406c530 0x7f9a841a1df0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:28.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.951+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 >> 172.21.15.70:0/784105553 conn(0x7f9a84079350 msgr2=0x7f9a8410e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:25:28.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.952+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 shutdown_connections 2024-05-08T08:25:28.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:28.952+0000 7f9a8ac00700 1 -- 172.21.15.70:0/784105553 wait complete. 2024-05-08T08:25:28.946 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:25:29.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:29 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/784105553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:25:29.730 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id c6256f9 --release --await' 2024-05-08T08:25:29.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id c6256f9 --release --await 2024-05-08T08:25:29.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:29 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/784105553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:25:29.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:29 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/784105553' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:25:30.173 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:25:30.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:30 smithi070 ceph-mon[29591]: pgmap v3152: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:25:30.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:30 smithi194 ceph-mon[33679]: pgmap v3152: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:25:30.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:30 smithi172 ceph-mon[33377]: pgmap v3152: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:25:32.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:32 smithi194 ceph-mon[33679]: pgmap v3153: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:25:32.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:32 smithi070 ceph-mon[29591]: pgmap v3153: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:25:32.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:32 smithi172 ceph-mon[33377]: pgmap v3153: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:25:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.510+0000 7f593a400700 1 -- 172.21.15.70:0/1742010135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5934104f00 msgr2=0x7f593410d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.510+0000 7f593a400700 1 --2- 172.21.15.70:0/1742010135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5934104f00 0x7f593410d3f0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5920009990 tx=0x7f5920009ca0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.510+0000 7f593a400700 1 -- 172.21.15.70:0/1742010135 shutdown_connections 2024-05-08T08:25:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.510+0000 7f593a400700 1 --2- 172.21.15.70:0/1742010135 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593410da10 0x7f593410fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.510+0000 7f593a400700 1 --2- 172.21.15.70:0/1742010135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59341045e0 0x7f59341049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.510+0000 7f593a400700 1 --2- 172.21.15.70:0/1742010135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5934104f00 0x7f593410d3f0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.510+0000 7f593a400700 1 -- 172.21.15.70:0/1742010135 >> 172.21.15.70:0/1742010135 conn(0x7f59340fde30 msgr2=0x7f5934100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:25:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.510+0000 7f593a400700 1 -- 172.21.15.70:0/1742010135 shutdown_connections 2024-05-08T08:25:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.510+0000 7f593a400700 1 -- 172.21.15.70:0/1742010135 wait complete. 2024-05-08T08:25:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.511+0000 7f593a400700 1 Processor -- start 2024-05-08T08:25:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.511+0000 7f593a400700 1 -- start start 2024-05-08T08:25:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f593a400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59341045e0 0x7f593419f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f593a400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5934104f00 0x7f593419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f593a400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593410da10 0x7f5934199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f593a400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5934113560 con 0x7f59341045e0 2024-05-08T08:25:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f593a400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59341133e0 con 0x7f593410da10 2024-05-08T08:25:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f593a400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f59341136e0 con 0x7f5934104f00 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f5939000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59341045e0 0x7f593419f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f5939000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59341045e0 0x7f593419f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51920/0 (socket says 172.21.15.70:51920) 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f5939000700 1 -- 172.21.15.70:0/2367419218 learned_addr learned my addr 172.21.15.70:0/2367419218 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f5933e00700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5934104f00 0x7f593419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.512+0000 7f5939a00700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593410da10 0x7f5934199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f5939000700 1 -- 172.21.15.70:0/2367419218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5934104f00 msgr2=0x7f593419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f5939000700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5934104f00 0x7f593419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f5939000700 1 -- 172.21.15.70:0/2367419218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593410da10 msgr2=0x7f5934199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f5939000700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593410da10 0x7f5934199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f5939000700 1 -- 172.21.15.70:0/2367419218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593419a0b0 con 0x7f59341045e0 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f5939000700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59341045e0 0x7f593419f740 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f59280060b0 tx=0x7f5928007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f5931600700 1 -- 172.21.15.70:0/2367419218 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592801a070 con 0x7f59341045e0 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f5931600700 1 -- 172.21.15.70:0/2367419218 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f592800de20 con 0x7f59341045e0 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f5931600700 1 -- 172.21.15.70:0/2367419218 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5928014690 con 0x7f59341045e0 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.513+0000 7f593a400700 1 -- 172.21.15.70:0/2367419218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593419a3a0 con 0x7f59341045e0 2024-05-08T08:25:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.514+0000 7f593a400700 1 -- 172.21.15.70:0/2367419218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59341a6610 con 0x7f59341045e0 2024-05-08T08:25:33.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.518+0000 7f5931600700 1 -- 172.21.15.70:0/2367419218 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f592801d070 con 0x7f59341045e0 2024-05-08T08:25:33.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.519+0000 7f5931600700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f591c0b2a70 0x7f591c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.519+0000 7f5931600700 1 -- 172.21.15.70:0/2367419218 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(275..275 src has 1..275) ==== 9583+0+0 (secure 0 0 0) 0x7f59280e22d0 con 0x7f59341045e0 2024-05-08T08:25:33.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.519+0000 7f5933e00700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f591c0b2a70 0x7f591c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.520+0000 7f5933e00700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f591c0b2a70 0x7f591c0b4f30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f592000b5c0 tx=0x7f592001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:25:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.532+0000 7f5946298b80 1 Processor -- start 2024-05-08T08:25:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.532+0000 7f5946298b80 1 -- start start 2024-05-08T08:25:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5946298b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5946298b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bc98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5946298b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113bca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5946298b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558113b17b20 con 0x558113bcf370 2024-05-08T08:25:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5946298b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558113ab5860 con 0x558113bcfc90 2024-05-08T08:25:33.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5946298b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558113b13ae0 con 0x558113bc9ec0 2024-05-08T08:25:33.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5939000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5939000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51922/0 (socket says 172.21.15.70:51922) 2024-05-08T08:25:33.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5939000700 1 -- 172.21.15.70:0/963715595 learned_addr learned my addr 172.21.15.70:0/963715595 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5933e00700 1 --2- 172.21.15.70:0/963715595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bc98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.533+0000 7f5939a00700 1 --2- 172.21.15.70:0/963715595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113bca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.534+0000 7f5939000700 1 -- 172.21.15.70:0/963715595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 msgr2=0x558113bca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.534+0000 7f5939000700 1 --2- 172.21.15.70:0/963715595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113bca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.534+0000 7f5939000700 1 -- 172.21.15.70:0/963715595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 msgr2=0x558113bc98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.534+0000 7f5939000700 1 --2- 172.21.15.70:0/963715595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bc98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.534+0000 7f5939000700 1 -- 172.21.15.70:0/963715595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558113a649d0 con 0x558113bcf370 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.534+0000 7f5939000700 1 --2- 172.21.15.70:0/963715595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcf750 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f59280a9120 tx=0x7f59280a8d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6aa4632ef272c4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.534+0000 7f5926000700 1 -- 172.21.15.70:0/963715595 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59280ad540 con 0x558113bcf370 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.534+0000 7f5926000700 1 -- 172.21.15.70:0/963715595 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59280b1ff0 con 0x558113bcf370 2024-05-08T08:25:33.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.534+0000 7f5926000700 1 -- 172.21.15.70:0/963715595 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59280a9650 con 0x558113bcf370 2024-05-08T08:25:33.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.535+0000 7f5946298b80 1 -- 172.21.15.70:0/963715595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 msgr2=0x558113bcf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.535+0000 7f5946298b80 1 --2- 172.21.15.70:0/963715595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcf750 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f59280a9120 tx=0x7f59280a8d20 comp rx=0 tx=0).stop 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.535+0000 7f5946298b80 1 -- 172.21.15.70:0/963715595 shutdown_connections 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.535+0000 7f5946298b80 1 --2- 172.21.15.70:0/963715595 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113bca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.535+0000 7f5946298b80 1 --2- 172.21.15.70:0/963715595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcf750 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.535+0000 7f5946298b80 1 --2- 172.21.15.70:0/963715595 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bc98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.535+0000 7f5946298b80 1 -- 172.21.15.70:0/963715595 >> 172.21.15.70:0/963715595 conn(0x558113af3c60 msgr2=0x558113bbfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.536+0000 7f5946298b80 1 -- 172.21.15.70:0/963715595 shutdown_connections 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.536+0000 7f5946298b80 1 -- 172.21.15.70:0/963715595 wait complete. 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.536+0000 7f5946298b80 1 -- start start 2024-05-08T08:25:33.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.536+0000 7f5946298b80 1 Processor -- start 2024-05-08T08:25:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5946298b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bc9ec0 0x558113bd5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5946298b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bcf370 0x558113bd2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5946298b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bd3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5946298b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558113bd6790 con 0x558113bc9ec0 2024-05-08T08:25:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5946298b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558113a7dc20 con 0x558113bcfc90 2024-05-08T08:25:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5946298b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558113bd6910 con 0x558113bcf370 2024-05-08T08:25:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5946298b80 10 client.0 _ll_register_callbacks cb 0x558113abed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:25:33.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5939000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bc9ec0 0x558113bd5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5939000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bc9ec0 0x558113bd5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51932/0 (socket says 172.21.15.70:51932) 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5939000700 1 -- 172.21.15.70:0/805555256 learned_addr learned my addr 172.21.15.70:0/805555256 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.537+0000 7f5933e00700 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bcf370 0x558113bd2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.538+0000 7f5939a00700 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bd3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.538+0000 7f5939000700 1 -- 172.21.15.70:0/805555256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bcf370 msgr2=0x558113bd2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.538+0000 7f5939000700 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bcf370 0x558113bd2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.538+0000 7f5939000700 1 -- 172.21.15.70:0/805555256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 msgr2=0x558113bd3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.538+0000 7f5939000700 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bd3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.538+0000 7f5939000700 1 -- 172.21.15.70:0/805555256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558113add520 con 0x558113bc9ec0 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.538+0000 7f5939a00700 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bd3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.538+0000 7f5939000700 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bc9ec0 0x558113bd5a70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f59280df6b0 tx=0x7f59280ad420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61ab88070267257 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.538+0000 7f591aa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.539+0000 7f591aa00700 1 -- 172.21.15.70:0/805555256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59280c2020 con 0x558113bc9ec0 2024-05-08T08:25:33.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.539+0000 7f591aa00700 1 -- 172.21.15.70:0/805555256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(275..275 src has 1..275) ==== 9583+0+0 (secure 0 0 0) 0x7f59280a9600 con 0x558113bc9ec0 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.539+0000 7f5946298b80 1 -- 172.21.15.70:0/805555256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59280b1ff0 con 0x558113bc9ec0 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.539+0000 7f591aa00700 1 -- 172.21.15.70:0/805555256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f59280ca020 con 0x558113bc9ec0 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.539+0000 7f5946298b80 10 client.18036 fetch_fsmap learned FSMap version 42 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.539+0000 7f5946298b80 1 -- 172.21.15.70:0/805555256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558113be1090 con 0x558113bc9ec0 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.539+0000 7f591aa00700 1 -- 172.21.15.70:0/805555256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59280b1ff0 con 0x558113bc9ec0 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.539+0000 7f591aa00700 1 -- 172.21.15.70:0/805555256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f5928004ad0 con 0x558113bc9ec0 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.540+0000 7f5946298b80 10 client.18036 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.540+0000 7f5946298b80 10 client.18036 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.540+0000 7f5946298b80 20 client.18036 populate_metadata read hostname 'smithi070' 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.540+0000 7f5946298b80 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558113be3560 0x558113be5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.540+0000 7f5946298b80 4 client.18036 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:25:33.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.540+0000 7f5946298b80 1 -- 172.21.15.70:0/805555256 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558113b921a0 con 0x558113be3560 2024-05-08T08:25:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.540+0000 7f5933e00700 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558113be3560 0x558113be5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.541+0000 7f5933e00700 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558113be3560 0x558113be5950 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b689659d12c9651 server_cookie=6844f0fceb40d355 in_seq=0 out_seq=0 2024-05-08T08:25:33.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.541+0000 7f591aa00700 10 client.18036 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:25:33.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.543+0000 7f591aa00700 1 -- 172.21.15.70:0/805555256 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558113b921a0 con 0x558113be3560 2024-05-08T08:25:33.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.543+0000 7f591aa00700 10 client.18036 handle_command_reply: tid=0 2024-05-08T08:25:33.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.543+0000 7f5946298b80 1 client.18036 shutdown 2024-05-08T08:25:33.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 -- 172.21.15.70:0/805555256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bc9ec0 msgr2=0x558113bd5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:33.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bc9ec0 0x558113bd5a70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f59280df6b0 tx=0x7f59280ad420 comp rx=0 tx=0).stop 2024-05-08T08:25:33.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 -- 172.21.15.70:0/805555256 shutdown_connections 2024-05-08T08:25:33.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558113be3560 0x558113be5950 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bd3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bc9ec0 0x558113bd5a70 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 --2- 172.21.15.70:0/805555256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bcf370 0x558113bd2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 -- 172.21.15.70:0/805555256 >> 172.21.15.70:0/805555256 conn(0x558113af3c60 msgr2=0x558113bc4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:25:33.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f591aa00700 0 client.18036 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:25:33.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 -- 172.21.15.70:0/805555256 shutdown_connections 2024-05-08T08:25:33.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 1 -- 172.21.15.70:0/805555256 wait complete. 2024-05-08T08:25:33.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.544+0000 7f5946298b80 20 client.18036 trim_cache size 0 max 16384 2024-05-08T08:25:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.575+0000 7f5946298b80 1 Processor -- start 2024-05-08T08:25:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.575+0000 7f5946298b80 1 -- start start 2024-05-08T08:25:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.575+0000 7f5946298b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113bd0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.575+0000 7f5946298b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.575+0000 7f5946298b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bd1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.575+0000 7f5946298b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59341afcb0 con 0x558113bcf370 2024-05-08T08:25:33.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.575+0000 7f5946298b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59341ad540 con 0x558113bcfc90 2024-05-08T08:25:33.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.575+0000 7f5946298b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f59341ab3d0 con 0x558113bc9ec0 2024-05-08T08:25:33.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5933e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5933e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51934/0 (socket says 172.21.15.70:51934) 2024-05-08T08:25:33.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5933e00700 1 -- 172.21.15.70:0/380443 learned_addr learned my addr 172.21.15.70:0/380443 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:25:33.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5939000700 1 --2- 172.21.15.70:0/380443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113bd0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5933e00700 1 -- 172.21.15.70:0/380443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 msgr2=0x558113bd0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5933e00700 1 --2- 172.21.15.70:0/380443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113bd0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5933e00700 1 -- 172.21.15.70:0/380443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 msgr2=0x558113bd1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5939a00700 1 --2- 172.21.15.70:0/380443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bd1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5933e00700 1 --2- 172.21.15.70:0/380443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bd1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.576+0000 7f5933e00700 1 -- 172.21.15.70:0/380443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558113bc0ac0 con 0x558113bcf370 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.577+0000 7f5933e00700 1 --2- 172.21.15.70:0/380443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcd440 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f5934105360 tx=0x7f592001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12674d2aae596250 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.577+0000 7f5925600700 1 -- 172.21.15.70:0/380443 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5920005020 con 0x558113bcf370 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.577+0000 7f5925600700 1 -- 172.21.15.70:0/380443 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5920005650 con 0x558113bcf370 2024-05-08T08:25:33.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.577+0000 7f5925600700 1 -- 172.21.15.70:0/380443 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592000f840 con 0x558113bcf370 2024-05-08T08:25:33.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.578+0000 7f5946298b80 1 -- 172.21.15.70:0/380443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 msgr2=0x558113bcd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:33.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.578+0000 7f5946298b80 1 --2- 172.21.15.70:0/380443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcd440 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f5934105360 tx=0x7f592001e000 comp rx=0 tx=0).stop 2024-05-08T08:25:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.578+0000 7f5946298b80 1 -- 172.21.15.70:0/380443 shutdown_connections 2024-05-08T08:25:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.578+0000 7f5946298b80 1 --2- 172.21.15.70:0/380443 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcfc90 0x558113bd1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.578+0000 7f5946298b80 1 --2- 172.21.15.70:0/380443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113bd0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.578+0000 7f5946298b80 1 --2- 172.21.15.70:0/380443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcf370 0x558113bcd440 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.578+0000 7f5946298b80 1 -- 172.21.15.70:0/380443 >> 172.21.15.70:0/380443 conn(0x558113af3c60 msgr2=0x558113bd1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:25:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.579+0000 7f5946298b80 1 -- 172.21.15.70:0/380443 shutdown_connections 2024-05-08T08:25:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.579+0000 7f5946298b80 1 -- 172.21.15.70:0/380443 wait complete. 2024-05-08T08:25:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.579+0000 7f5946298b80 1 -- start start 2024-05-08T08:25:33.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.579+0000 7f5946298b80 1 Processor -- start 2024-05-08T08:25:33.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5946298b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113be6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5946298b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcf370 0x558113be6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5946298b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcfc90 0x558113c46ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5946298b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59341aba20 con 0x558113bcfc90 2024-05-08T08:25:33.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5946298b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59341ace70 con 0x558113bcf370 2024-05-08T08:25:33.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5946298b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f59341ac0d0 con 0x558113bc9ec0 2024-05-08T08:25:33.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5946298b80 10 client.0 _ll_register_callbacks cb 0x558113abed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:25:33.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5939a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcfc90 0x558113c46ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5939a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcfc90 0x558113c46ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51950/0 (socket says 172.21.15.70:51950) 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.580+0000 7f5939a00700 1 -- 172.21.15.70:0/2378040663 learned_addr learned my addr 172.21.15.70:0/2378040663 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.581+0000 7f5939a00700 1 -- 172.21.15.70:0/2378040663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 msgr2=0x558113be6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.581+0000 7f5939000700 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113be6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.581+0000 7f5939a00700 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113be6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.581+0000 7f5939a00700 1 -- 172.21.15.70:0/2378040663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcf370 msgr2=0x558113be6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.581+0000 7f5939a00700 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcf370 0x558113be6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.581+0000 7f5939a00700 1 -- 172.21.15.70:0/2378040663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558113c47100 con 0x558113bcfc90 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.581+0000 7f5939a00700 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcfc90 0x558113c46ac0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f592c012370 tx=0x7f592c012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf386319c11d6cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.581+0000 7f591aa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.582+0000 7f591aa00700 1 -- 172.21.15.70:0/2378040663 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c012e60 con 0x558113bcfc90 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.582+0000 7f5946298b80 1 -- 172.21.15.70:0/2378040663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5920005650 con 0x558113bcfc90 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.582+0000 7f591aa00700 1 -- 172.21.15.70:0/2378040663 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(275..275 src has 1..275) ==== 9583+0+0 (secure 0 0 0) 0x7f592c015600 con 0x558113bcfc90 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.582+0000 7f591aa00700 1 -- 172.21.15.70:0/2378040663 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f592c027050 con 0x558113bcfc90 2024-05-08T08:25:33.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.582+0000 7f5946298b80 10 client.18042 fetch_fsmap learned FSMap version 42 2024-05-08T08:25:33.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.582+0000 7f5946298b80 1 -- 172.21.15.70:0/2378040663 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558113c4e560 con 0x558113bcfc90 2024-05-08T08:25:33.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.582+0000 7f591aa00700 1 -- 172.21.15.70:0/2378040663 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5920005650 con 0x558113bcfc90 2024-05-08T08:25:33.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.583+0000 7f591aa00700 1 -- 172.21.15.70:0/2378040663 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f592c01e9e0 con 0x558113bcfc90 2024-05-08T08:25:33.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.583+0000 7f5946298b80 10 client.18042 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:25:33.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.583+0000 7f5946298b80 10 client.18042 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:25:33.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.583+0000 7f5946298b80 20 client.18042 populate_metadata read hostname 'smithi070' 2024-05-08T08:25:33.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.583+0000 7f5946298b80 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558113c4ecd0 0x558113c510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:25:33.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.583+0000 7f5946298b80 4 client.18042 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c6256f9", "release": true, "await": true}] 2024-05-08T08:25:33.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.583+0000 7f5946298b80 1 -- 172.21.15.70:0/2378040663 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c6256f9", "release": true, "await": true}) -- 0x558113b25500 con 0x558113c4ecd0 2024-05-08T08:25:33.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.584+0000 7f5939000700 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558113c4ecd0 0x558113c510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:25:33.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.585+0000 7f591aa00700 10 client.18042 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:25:33.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:33.585+0000 7f5939000700 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558113c4ecd0 0x558113c510f0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6491c68daabf7cce server_cookie=19c9c6b0b5005e45 in_seq=0 out_seq=0 2024-05-08T08:25:34.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:34 smithi194 ceph-mon[33679]: pgmap v3154: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:25:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:34 smithi070 ceph-mon[29591]: pgmap v3154: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:25:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:34 smithi172 ceph-mon[33377]: pgmap v3154: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:25:36.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:36 smithi194 ceph-mon[33679]: pgmap v3155: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:25:36.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:36 smithi070 ceph-mon[29591]: pgmap v3155: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:25:36.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:36 smithi172 ceph-mon[33377]: pgmap v3155: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:25:38.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.124+0000 7f591aa00700 1 -- 172.21.15.70:0/2378040663 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558113b25500 con 0x558113c4ecd0 2024-05-08T08:25:38.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.124+0000 7f591aa00700 10 client.18042 handle_command_reply: tid=0 2024-05-08T08:25:38.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.124+0000 7f5946298b80 1 client.18042 shutdown 2024-05-08T08:25:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.125+0000 7f5946298b80 1 -- 172.21.15.70:0/2378040663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcfc90 msgr2=0x558113c46ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:38.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.125+0000 7f5946298b80 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcfc90 0x558113c46ac0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f592c012370 tx=0x7f592c012730 comp rx=0 tx=0).stop 2024-05-08T08:25:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.125+0000 7f5946298b80 1 -- 172.21.15.70:0/2378040663 shutdown_connections 2024-05-08T08:25:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.125+0000 7f5946298b80 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558113c4ecd0 0x558113c510f0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.126+0000 7f5946298b80 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558113bcfc90 0x558113c46ac0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.126+0000 7f5946298b80 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558113bc9ec0 0x558113be6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.126+0000 7f5946298b80 1 --2- 172.21.15.70:0/2378040663 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558113bcf370 0x558113be6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.126+0000 7f5946298b80 1 -- 172.21.15.70:0/2378040663 >> 172.21.15.70:0/2378040663 conn(0x558113af3c60 msgr2=0x558113bd0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:25:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.126+0000 7f591aa00700 0 client.18042 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:25:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.126+0000 7f5946298b80 1 -- 172.21.15.70:0/2378040663 shutdown_connections 2024-05-08T08:25:38.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.126+0000 7f5946298b80 1 -- 172.21.15.70:0/2378040663 wait complete. 2024-05-08T08:25:38.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.127+0000 7f5946298b80 20 client.18042 trim_cache size 0 max 16384 2024-05-08T08:25:38.121 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:25:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:25:38.121 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 224, 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "c6256f9": { 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 224, 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:25:38.122 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.1, 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:25:38.123 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:25:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.132+0000 7f593a400700 1 -- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f591c0b2a70 msgr2=0x7f591c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:38.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.132+0000 7f593a400700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f591c0b2a70 0x7f591c0b4f30 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f592000b5c0 tx=0x7f592001a040 comp rx=0 tx=0).stop 2024-05-08T08:25:38.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.132+0000 7f593a400700 1 -- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59341045e0 msgr2=0x7f593419f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:25:38.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.132+0000 7f593a400700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59341045e0 0x7f593419f740 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f59280060b0 tx=0x7f5928007f90 comp rx=0 tx=0).stop 2024-05-08T08:25:38.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.132+0000 7f593a400700 1 -- 172.21.15.70:0/2367419218 shutdown_connections 2024-05-08T08:25:38.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.132+0000 7f593a400700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f591c0b2a70 0x7f591c0b4f30 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:38.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.133+0000 7f593a400700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f593410da10 0x7f5934199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:38.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.133+0000 7f593a400700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59341045e0 0x7f593419f740 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:38.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.133+0000 7f593a400700 1 --2- 172.21.15.70:0/2367419218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5934104f00 0x7f593419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:25:38.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.133+0000 7f593a400700 1 -- 172.21.15.70:0/2367419218 >> 172.21.15.70:0/2367419218 conn(0x7f59340fde30 msgr2=0x7f59340fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:25:38.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.134+0000 7f593a400700 1 -- 172.21.15.70:0/2367419218 shutdown_connections 2024-05-08T08:25:38.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:25:38.134+0000 7f593a400700 1 -- 172.21.15.70:0/2367419218 wait complete. 2024-05-08T08:25:38.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:38 smithi194 ceph-mon[33679]: pgmap v3156: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:25:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:38 smithi070 ceph-mon[29591]: pgmap v3156: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:25:38.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:38 smithi172 ceph-mon[33377]: pgmap v3156: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:25:39.294 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c6256f9', seconds elapsed: 72.6 2024-05-08T08:25:40.015 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsutils.o 2024-05-08T08:25:40.746 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] fs/efivarfs/efivarfs.o 2024-05-08T08:25:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:40 smithi194 ceph-mon[33679]: pgmap v3157: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 137 KiB/s wr, 16 op/s 2024-05-08T08:25:40.852 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dma/built-in.a 2024-05-08T08:25:40.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:40 smithi070 ceph-mon[29591]: pgmap v3157: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 137 KiB/s wr, 16 op/s 2024-05-08T08:25:40.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:40 smithi172 ceph-mon[33377]: pgmap v3157: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 137 KiB/s wr, 16 op/s 2024-05-08T08:25:41.023 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/unix/scm.o 2024-05-08T08:25:41.114 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/rings.o 2024-05-08T08:25:41.196 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/open.o 2024-05-08T08:25:41.261 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/netfilter/iptable_mangle.o 2024-05-08T08:25:41.305 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_output.o 2024-05-08T08:25:41.414 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/read_write.o 2024-05-08T08:25:41.424 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_proto.o 2024-05-08T08:25:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:42 smithi194 ceph-mon[33679]: pgmap v3158: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 137 KiB/s wr, 14 op/s 2024-05-08T08:25:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:42 smithi070 ceph-mon[29591]: pgmap v3158: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 137 KiB/s wr, 14 op/s 2024-05-08T08:25:42.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:42 smithi172 ceph-mon[33377]: pgmap v3158: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 137 KiB/s wr, 14 op/s 2024-05-08T08:25:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:44 smithi194 ceph-mon[33679]: pgmap v3159: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 137 KiB/s wr, 14 op/s 2024-05-08T08:25:44.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:44 smithi070 ceph-mon[29591]: pgmap v3159: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 137 KiB/s wr, 14 op/s 2024-05-08T08:25:44.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:44 smithi172 ceph-mon[33377]: pgmap v3159: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 137 KiB/s wr, 14 op/s 2024-05-08T08:25:46.123 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nswalk.o 2024-05-08T08:25:46.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:46 smithi194 ceph-mon[33679]: pgmap v3160: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 375 KiB/s wr, 25 op/s 2024-05-08T08:25:46.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:46 smithi070 ceph-mon[29591]: pgmap v3160: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 375 KiB/s wr, 25 op/s 2024-05-08T08:25:46.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:46 smithi172 ceph-mon[33377]: pgmap v3160: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 375 KiB/s wr, 25 op/s 2024-05-08T08:25:48.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:48 smithi194 ceph-mon[33679]: pgmap v3161: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 375 KiB/s wr, 22 op/s 2024-05-08T08:25:48.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:48 smithi070 ceph-mon[29591]: pgmap v3161: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 375 KiB/s wr, 22 op/s 2024-05-08T08:25:48.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:48 smithi172 ceph-mon[33377]: pgmap v3161: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 375 KiB/s wr, 22 op/s 2024-05-08T08:25:50.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:50 smithi070 ceph-mon[29591]: pgmap v3162: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 684 KiB/s wr, 33 op/s 2024-05-08T08:25:50.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:50 smithi172 ceph-mon[33377]: pgmap v3162: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 684 KiB/s wr, 33 op/s 2024-05-08T08:25:51.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:50 smithi194 ceph-mon[33679]: pgmap v3162: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 684 KiB/s wr, 33 op/s 2024-05-08T08:25:51.769 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/channels.o 2024-05-08T08:25:52.157 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/unix/built-in.a 2024-05-08T08:25:52.250 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsxfeval.o 2024-05-08T08:25:52.251 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_proto_generic.o 2024-05-08T08:25:52.495 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/file_table.o 2024-05-08T08:25:52.533 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/netfilter/ipt_REJECT.o 2024-05-08T08:25:52.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:52 smithi070 ceph-mon[29591]: pgmap v3163: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 546 KiB/s wr, 22 op/s 2024-05-08T08:25:52.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:52 smithi172 ceph-mon[33377]: pgmap v3163: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 546 KiB/s wr, 22 op/s 2024-05-08T08:25:53.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:52 smithi194 ceph-mon[33679]: pgmap v3163: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 546 KiB/s wr, 22 op/s 2024-05-08T08:25:53.381 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/netfilter/ip6_tables.o 2024-05-08T08:25:53.902 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_sysctl.o 2024-05-08T08:25:54.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:54 smithi070 ceph-mon[29591]: pgmap v3164: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 547 KiB/s wr, 22 op/s 2024-05-08T08:25:54.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:54 smithi172 ceph-mon[33377]: pgmap v3164: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 547 KiB/s wr, 22 op/s 2024-05-08T08:25:55.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:54 smithi194 ceph-mon[33679]: pgmap v3164: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 547 KiB/s wr, 22 op/s 2024-05-08T08:25:56.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:56 smithi070 ceph-mon[29591]: pgmap v3165: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 853 KiB/s wr, 36 op/s 2024-05-08T08:25:56.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:56 smithi172 ceph-mon[33377]: pgmap v3165: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 853 KiB/s wr, 36 op/s 2024-05-08T08:25:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:56 smithi194 ceph-mon[33679]: pgmap v3165: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 886 KiB/s rd, 853 KiB/s wr, 36 op/s 2024-05-08T08:25:57.128 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_replay.o 2024-05-08T08:25:58.642 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsxfname.o 2024-05-08T08:25:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:25:58 smithi070 ceph-mon[29591]: pgmap v3166: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T08:25:58.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:25:58 smithi172 ceph-mon[33377]: pgmap v3166: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T08:25:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:25:58 smithi194 ceph-mon[33679]: pgmap v3166: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T08:26:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:00 smithi070 ceph-mon[29591]: pgmap v3167: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 825 KiB/s wr, 33 op/s 2024-05-08T08:26:00.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:00 smithi172 ceph-mon[33377]: pgmap v3167: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 825 KiB/s wr, 33 op/s 2024-05-08T08:26:01.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:00 smithi194 ceph-mon[33679]: pgmap v3167: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 825 KiB/s wr, 33 op/s 2024-05-08T08:26:02.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:02 smithi070 ceph-mon[29591]: pgmap v3168: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 516 KiB/s wr, 21 op/s 2024-05-08T08:26:02.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:02 smithi172 ceph-mon[33377]: pgmap v3168: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 516 KiB/s wr, 21 op/s 2024-05-08T08:26:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:02 smithi194 ceph-mon[33679]: pgmap v3168: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 516 KiB/s wr, 21 op/s 2024-05-08T08:26:03.549 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/super.o 2024-05-08T08:26:04.758 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/coalesce.o 2024-05-08T08:26:04.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:04 smithi070 ceph-mon[29591]: pgmap v3169: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 516 KiB/s wr, 21 op/s 2024-05-08T08:26:04.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:04 smithi172 ceph-mon[33377]: pgmap v3169: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 516 KiB/s wr, 21 op/s 2024-05-08T08:26:05.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:04 smithi194 ceph-mon[33679]: pgmap v3169: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 516 KiB/s wr, 21 op/s 2024-05-08T08:26:05.726 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/nsxfobj.o 2024-05-08T08:26:05.874 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/ipv4/netfilter/iptable_nat.o 2024-05-08T08:26:06.223 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_proto_tcp.o 2024-05-08T08:26:06.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:06 smithi070 ceph-mon[29591]: pgmap v3170: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 787 KiB/s wr, 51 op/s 2024-05-08T08:26:06.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:06 smithi172 ceph-mon[33377]: pgmap v3170: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 787 KiB/s wr, 51 op/s 2024-05-08T08:26:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:06 smithi194 ceph-mon[33679]: pgmap v3170: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 787 KiB/s wr, 51 op/s 2024-05-08T08:26:07.526 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_proto_udp.o 2024-05-08T08:26:07.971 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/netfilter/ip6table_filter.o 2024-05-08T08:26:08.843 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:08 smithi070 ceph-mon[29591]: pgmap v3171: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 480 KiB/s wr, 37 op/s 2024-05-08T08:26:08.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:08 smithi172 ceph-mon[33377]: pgmap v3171: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 480 KiB/s wr, 37 op/s 2024-05-08T08:26:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:08 smithi194 ceph-mon[33679]: pgmap v3171: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 480 KiB/s wr, 37 op/s 2024-05-08T08:26:09.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:09 smithi070 ceph-mon[29591]: osdmap e276: 12 total, 12 up, 12 in 2024-05-08T08:26:09.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:09 smithi172 ceph-mon[33377]: osdmap e276: 12 total, 12 up, 12 in 2024-05-08T08:26:10.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:09 smithi194 ceph-mon[33679]: osdmap e276: 12 total, 12 up, 12 in 2024-05-08T08:26:10.442 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_device.o 2024-05-08T08:26:10.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:10 smithi070 ceph-mon[29591]: pgmap v3173: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 569 KiB/s wr, 51 op/s 2024-05-08T08:26:10.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:10 smithi172 ceph-mon[33377]: pgmap v3173: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 569 KiB/s wr, 51 op/s 2024-05-08T08:26:11.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:10 smithi194 ceph-mon[33679]: pgmap v3173: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 569 KiB/s wr, 51 op/s 2024-05-08T08:26:11.842 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/psargs.o 2024-05-08T08:26:12.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:12 smithi070 ceph-mon[29591]: pgmap v3174: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 569 KiB/s wr, 51 op/s 2024-05-08T08:26:12.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:12 smithi172 ceph-mon[33377]: pgmap v3174: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 569 KiB/s wr, 51 op/s 2024-05-08T08:26:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:12 smithi194 ceph-mon[33679]: pgmap v3174: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 569 KiB/s wr, 51 op/s 2024-05-08T08:26:13.077 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/char_dev.o 2024-05-08T08:26:14.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:14 smithi070 ceph-mon[29591]: pgmap v3175: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 569 KiB/s wr, 51 op/s 2024-05-08T08:26:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:14 smithi172 ceph-mon[33377]: pgmap v3175: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 569 KiB/s wr, 51 op/s 2024-05-08T08:26:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:14 smithi194 ceph-mon[33679]: pgmap v3175: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 569 KiB/s wr, 51 op/s 2024-05-08T08:26:16.453 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/pause.o 2024-05-08T08:26:16.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:16 smithi070 ceph-mon[29591]: pgmap v3176: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 536 KiB/s wr, 24 op/s 2024-05-08T08:26:16.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:16 smithi172 ceph-mon[33377]: pgmap v3176: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 536 KiB/s wr, 24 op/s 2024-05-08T08:26:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:16 smithi194 ceph-mon[33679]: pgmap v3176: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 536 KiB/s wr, 24 op/s 2024-05-08T08:26:18.077 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/psloop.o 2024-05-08T08:26:18.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:18 smithi070 ceph-mon[29591]: pgmap v3177: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 536 KiB/s wr, 24 op/s 2024-05-08T08:26:18.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:26:18.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:18 smithi172 ceph-mon[33377]: pgmap v3177: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 536 KiB/s wr, 24 op/s 2024-05-08T08:26:18.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:26:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:18 smithi194 ceph-mon[33679]: pgmap v3177: 129 pgs: 129 active+clean; 1.9 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 536 KiB/s wr, 24 op/s 2024-05-08T08:26:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:26:19.149 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/ipv4/netfilter/built-in.a 2024-05-08T08:26:19.771 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/route.o 2024-05-08T08:26:20.621 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/psobject.o 2024-05-08T08:26:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:20 smithi070 ceph-mon[29591]: osdmap e277: 12 total, 12 up, 12 in 2024-05-08T08:26:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:26:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:26:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:26:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:20 smithi070 ceph-mon[29591]: pgmap v3179: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 527 KiB/s wr, 27 op/s 2024-05-08T08:26:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:20 smithi172 ceph-mon[33377]: osdmap e277: 12 total, 12 up, 12 in 2024-05-08T08:26:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:26:20.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:26:20.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:26:20.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:20 smithi172 ceph-mon[33377]: pgmap v3179: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 527 KiB/s wr, 27 op/s 2024-05-08T08:26:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:20 smithi194 ceph-mon[33679]: osdmap e277: 12 total, 12 up, 12 in 2024-05-08T08:26:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:26:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:26:20.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:26:20.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:20 smithi194 ceph-mon[33679]: pgmap v3179: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 527 KiB/s wr, 27 op/s 2024-05-08T08:26:21.478 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/netfilter/ip6table_mangle.o 2024-05-08T08:26:21.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_proto_icmp.o 2024-05-08T08:26:22.349 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/stat.o 2024-05-08T08:26:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:22 smithi194 ceph-mon[33679]: pgmap v3180: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 527 KiB/s wr, 27 op/s 2024-05-08T08:26:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:22 smithi070 ceph-mon[29591]: pgmap v3180: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 527 KiB/s wr, 27 op/s 2024-05-08T08:26:22.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:22 smithi172 ceph-mon[33377]: pgmap v3180: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 527 KiB/s wr, 27 op/s 2024-05-08T08:26:23.104 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_algo.o 2024-05-08T08:26:24.725 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/netfilter/nf_defrag_ipv6_hooks.o 2024-05-08T08:26:24.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:24 smithi194 ceph-mon[33679]: pgmap v3181: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 527 KiB/s wr, 27 op/s 2024-05-08T08:26:24.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:24 smithi070 ceph-mon[29591]: pgmap v3181: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 527 KiB/s wr, 27 op/s 2024-05-08T08:26:24.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:24 smithi172 ceph-mon[33377]: pgmap v3181: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 527 KiB/s wr, 27 op/s 2024-05-08T08:26:25.909 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.7 2024-05-08T08:26:25.910 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:26:26.498 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:26:26.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:26 smithi194 ceph-mon[33679]: pgmap v3182: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 524 KiB/s wr, 31 op/s 2024-05-08T08:26:26.860 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/psopcode.o 2024-05-08T08:26:26.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:26 smithi070 ceph-mon[29591]: pgmap v3182: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 524 KiB/s wr, 31 op/s 2024-05-08T08:26:26.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:26 smithi172 ceph-mon[33377]: pgmap v3182: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 524 KiB/s wr, 31 op/s 2024-05-08T08:26:28.581 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/eee.o 2024-05-08T08:26:28.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:28 smithi070 ceph-mon[29591]: pgmap v3183: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 524 KiB/s wr, 31 op/s 2024-05-08T08:26:28.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:28 smithi194 ceph-mon[33679]: pgmap v3183: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 524 KiB/s wr, 31 op/s 2024-05-08T08:26:28.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:28 smithi172 ceph-mon[33377]: pgmap v3183: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 524 KiB/s wr, 31 op/s 2024-05-08T08:26:30.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:30 smithi194 ceph-mon[33679]: pgmap v3184: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 617 KiB/s wr, 28 op/s 2024-05-08T08:26:30.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:30 smithi070 ceph-mon[29591]: pgmap v3184: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 617 KiB/s wr, 28 op/s 2024-05-08T08:26:30.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:30 smithi172 ceph-mon[33377]: pgmap v3184: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 617 KiB/s wr, 28 op/s 2024-05-08T08:26:32.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:32 smithi194 ceph-mon[33679]: pgmap v3185: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 519 KiB/s wr, 23 op/s 2024-05-08T08:26:32.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:32 smithi070 ceph-mon[29591]: pgmap v3185: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 519 KiB/s wr, 23 op/s 2024-05-08T08:26:32.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:32 smithi172 ceph-mon[33377]: pgmap v3185: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 519 KiB/s wr, 23 op/s 2024-05-08T08:26:34.195 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/inetpeer.o 2024-05-08T08:26:34.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:34 smithi194 ceph-mon[33679]: pgmap v3186: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 519 KiB/s wr, 23 op/s 2024-05-08T08:26:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:34 smithi070 ceph-mon[29591]: pgmap v3186: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 519 KiB/s wr, 23 op/s 2024-05-08T08:26:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:34 smithi172 ceph-mon[33377]: pgmap v3186: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 519 KiB/s wr, 23 op/s 2024-05-08T08:26:36.446 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/psopinfo.o 2024-05-08T08:26:36.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:36 smithi194 ceph-mon[33679]: pgmap v3187: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 726 KiB/s wr, 36 op/s 2024-05-08T08:26:36.768 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:36 smithi070 ceph-mon[29591]: pgmap v3187: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 726 KiB/s wr, 36 op/s 2024-05-08T08:26:36.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:36 smithi172 ceph-mon[33377]: pgmap v3187: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 695 KiB/s rd, 726 KiB/s wr, 36 op/s 2024-05-08T08:26:37.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.259+0000 7f1e86600700 1 -- 172.21.15.70:0/770182851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8006b180 msgr2=0x7f1e8006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:37.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.259+0000 7f1e86600700 1 --2- 172.21.15.70:0/770182851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8006b180 0x7f1e8006b600 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009990 tx=0x7f1e68009ca0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.260+0000 7f1e86600700 1 -- 172.21.15.70:0/770182851 shutdown_connections 2024-05-08T08:26:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.260+0000 7f1e86600700 1 --2- 172.21.15.70:0/770182851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e8006bb40 0x7f1e80110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.260+0000 7f1e86600700 1 --2- 172.21.15.70:0/770182851 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e80109510 0x7f1e801098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.260+0000 7f1e86600700 1 --2- 172.21.15.70:0/770182851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8006b180 0x7f1e8006b600 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.260+0000 7f1e86600700 1 -- 172.21.15.70:0/770182851 >> 172.21.15.70:0/770182851 conn(0x7f1e80079350 msgr2=0x7f1e80079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:26:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.261+0000 7f1e86600700 1 -- 172.21.15.70:0/770182851 shutdown_connections 2024-05-08T08:26:37.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.261+0000 7f1e86600700 1 -- 172.21.15.70:0/770182851 wait complete. 2024-05-08T08:26:37.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.262+0000 7f1e86600700 1 Processor -- start 2024-05-08T08:26:37.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.262+0000 7f1e86600700 1 -- start start 2024-05-08T08:26:37.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e86600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8006b180 0x7f1e8019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:37.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e86600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e8006bb40 0x7f1e8019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:37.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e86600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e80109510 0x7f1e80199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:37.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e86600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1e80113520 con 0x7f1e8006b180 2024-05-08T08:26:37.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e86600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1e801133a0 con 0x7f1e8006bb40 2024-05-08T08:26:37.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e86600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1e801136a0 con 0x7f1e80109510 2024-05-08T08:26:37.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e7f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8006b180 0x7f1e8019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:37.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e77e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e8006bb40 0x7f1e8019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:37.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e7f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8006b180 0x7f1e8019f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43638/0 (socket says 172.21.15.70:43638) 2024-05-08T08:26:37.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.263+0000 7f1e7f400700 1 -- 172.21.15.70:0/2503240440 learned_addr learned my addr 172.21.15.70:0/2503240440 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:26:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.264+0000 7f1e7fe00700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e80109510 0x7f1e80199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.264+0000 7f1e77e00700 1 -- 172.21.15.70:0/2503240440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e80109510 msgr2=0x7f1e80199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.264+0000 7f1e77e00700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e80109510 0x7f1e80199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.264+0000 7f1e77e00700 1 -- 172.21.15.70:0/2503240440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8006b180 msgr2=0x7f1e8019f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.264+0000 7f1e77e00700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8006b180 0x7f1e8019f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.264+0000 7f1e77e00700 1 -- 172.21.15.70:0/2503240440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e8019a060 con 0x7f1e8006bb40 2024-05-08T08:26:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.265+0000 7f1e77e00700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e8006bb40 0x7f1e8019fc80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1e68000c00 tx=0x7f1e680057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:26:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.265+0000 7f1e7cc00700 1 -- 172.21.15.70:0/2503240440 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68026070 con 0x7f1e8006bb40 2024-05-08T08:26:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.265+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e8019a2f0 con 0x7f1e8006bb40 2024-05-08T08:26:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.266+0000 7f1e7cc00700 1 -- 172.21.15.70:0/2503240440 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e68021410 con 0x7f1e8006bb40 2024-05-08T08:26:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.266+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e801a6610 con 0x7f1e8006bb40 2024-05-08T08:26:37.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.266+0000 7f1e7cc00700 1 -- 172.21.15.70:0/2503240440 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e68017650 con 0x7f1e8006bb40 2024-05-08T08:26:37.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.267+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e8006a190 con 0x7f1e8006bb40 2024-05-08T08:26:37.261 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/exec.o 2024-05-08T08:26:37.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.271+0000 7f1e7cc00700 1 -- 172.21.15.70:0/2503240440 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1e68029070 con 0x7f1e8006bb40 2024-05-08T08:26:37.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.274+0000 7f1e7cc00700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1e640b2af0 0x7f1e640b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:37.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.274+0000 7f1e7cc00700 1 -- 172.21.15.70:0/2503240440 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(277..277 src has 1..277) ==== 9583+0+0 (secure 0 0 0) 0x7f1e680e3ac0 con 0x7f1e8006bb40 2024-05-08T08:26:37.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.274+0000 7f1e7f400700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1e640b2af0 0x7f1e640b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:37.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.275+0000 7f1e7f400700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1e640b2af0 0x7f1e640b4fb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1e8019aa40 tx=0x7f1e70009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:26:37.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.278+0000 7f1e7cc00700 1 -- 172.21.15.70:0/2503240440 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1e68030080 con 0x7f1e8006bb40 2024-05-08T08:26:37.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.737+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e8019ae30 con 0x7f1e8006bb40 2024-05-08T08:26:37.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.740+0000 7f1e7cc00700 1 -- 172.21.15.70:0/2503240440 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f1e68013070 con 0x7f1e8006bb40 2024-05-08T08:26:37.734 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:26:37.734 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:26:37.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1e640b2af0 msgr2=0x7f1e640b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:37.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1e640b2af0 0x7f1e640b4fb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1e8019aa40 tx=0x7f1e70009260 comp rx=0 tx=0).stop 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e8006bb40 msgr2=0x7f1e8019fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e8006bb40 0x7f1e8019fc80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1e68000c00 tx=0x7f1e680057c0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 shutdown_connections 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1e640b2af0 0x7f1e640b4fb0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e80109510 0x7f1e80199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e8006b180 0x7f1e8019f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 --2- 172.21.15.70:0/2503240440 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1e8006bb40 0x7f1e8019fc80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 >> 172.21.15.70:0/2503240440 conn(0x7f1e80079350 msgr2=0x7f1e80101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 shutdown_connections 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:37.744+0000 7f1e86600700 1 -- 172.21.15.70:0/2503240440 wait complete. 2024-05-08T08:26:37.738 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:26:37.775 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/xfrm/xfrm_user.o 2024-05-08T08:26:37.842 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/protocol.o 2024-05-08T08:26:38.018 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_extend.o 2024-05-08T08:26:38.339 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/netfilter/nf_conntrack_reasm.o 2024-05-08T08:26:38.597 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 85.7 --await-for 42.0' 2024-05-08T08:26:38.597 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 85.7 --await-for 42.0 2024-05-08T08:26:38.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:38 smithi194 ceph-mon[33679]: pgmap v3188: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 484 KiB/s wr, 25 op/s 2024-05-08T08:26:38.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:38 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2503240440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:26:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:38 smithi070 ceph-mon[29591]: pgmap v3188: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 484 KiB/s wr, 25 op/s 2024-05-08T08:26:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:38 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2503240440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:26:38.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:38 smithi172 ceph-mon[33377]: pgmap v3188: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 484 KiB/s wr, 25 op/s 2024-05-08T08:26:38.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:38 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2503240440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:26:39.176 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:26:39.632 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/tsinfo.o 2024-05-08T08:26:40.483 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:40 smithi070 ceph-mon[29591]: pgmap v3189: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 770 KiB/s wr, 33 op/s 2024-05-08T08:26:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:40 smithi194 ceph-mon[33679]: pgmap v3189: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 770 KiB/s wr, 33 op/s 2024-05-08T08:26:40.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:40 smithi172 ceph-mon[33377]: pgmap v3189: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 770 KiB/s wr, 33 op/s 2024-05-08T08:26:42.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.581+0000 7f9346200700 1 -- 172.21.15.70:0/850279039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934006b3e0 msgr2=0x7f934006b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.581+0000 7f9346200700 1 --2- 172.21.15.70:0/850279039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934006b3e0 0x7f934006b7c0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f93300099c0 tx=0x7f9330009cd0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.581+0000 7f9346200700 1 -- 172.21.15.70:0/850279039 shutdown_connections 2024-05-08T08:26:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.581+0000 7f9346200700 1 --2- 172.21.15.70:0/850279039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9340108860 0x7f93401103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.581+0000 7f9346200700 1 --2- 172.21.15.70:0/850279039 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f934006b3e0 0x7f934006b7c0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.581+0000 7f9346200700 1 --2- 172.21.15.70:0/850279039 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f934006bd90 0x7f9340108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.581+0000 7f9346200700 1 -- 172.21.15.70:0/850279039 >> 172.21.15.70:0/850279039 conn(0x7f9340079340 msgr2=0x7f9340079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:26:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.581+0000 7f9346200700 1 -- 172.21.15.70:0/850279039 shutdown_connections 2024-05-08T08:26:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.582+0000 7f9346200700 1 -- 172.21.15.70:0/850279039 wait complete. 2024-05-08T08:26:42.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.583+0000 7f9346200700 1 Processor -- start 2024-05-08T08:26:42.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.583+0000 7f9346200700 1 -- start start 2024-05-08T08:26:42.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f9346200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f934006b3e0 0x7f934010d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f9346200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f934006bd90 0x7f934010d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f9346200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9340108860 0x7f934010f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f9346200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9340103960 con 0x7f9340108860 2024-05-08T08:26:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f9346200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93401037e0 con 0x7f934006bd90 2024-05-08T08:26:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f9346200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9340103ae0 con 0x7f934006b3e0 2024-05-08T08:26:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f933ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f934006bd90 0x7f934010d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f933fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9340108860 0x7f934010f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f933ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f934006bd90 0x7f934010d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36120/0 (socket says 172.21.15.70:36120) 2024-05-08T08:26:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f933ea00700 1 -- 172.21.15.70:0/3143213631 learned_addr learned my addr 172.21.15.70:0/3143213631 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:26:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.584+0000 7f933f400700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f934006b3e0 0x7f934010d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.585+0000 7f933ea00700 1 -- 172.21.15.70:0/3143213631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f934006b3e0 msgr2=0x7f934010d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.585+0000 7f933ea00700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f934006b3e0 0x7f934010d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.585+0000 7f933ea00700 1 -- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9340108860 msgr2=0x7f934010f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.585+0000 7f933ea00700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9340108860 0x7f934010f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.585+0000 7f933ea00700 1 -- 172.21.15.70:0/3143213631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934010ffb0 con 0x7f934006bd90 2024-05-08T08:26:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.585+0000 7f933fe00700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9340108860 0x7f934010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:26:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.586+0000 7f933ea00700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f934006bd90 0x7f934010d590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f932c00d950 tx=0x7f932c00dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:26:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.586+0000 7f9337e00700 1 -- 172.21.15.70:0/3143213631 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c016070 con 0x7f934006bd90 2024-05-08T08:26:42.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.587+0000 7f9346200700 1 -- 172.21.15.70:0/3143213631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93401102a0 con 0x7f934006bd90 2024-05-08T08:26:42.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.587+0000 7f9337e00700 1 -- 172.21.15.70:0/3143213631 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f932c010460 con 0x7f934006bd90 2024-05-08T08:26:42.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.587+0000 7f9337e00700 1 -- 172.21.15.70:0/3143213631 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c00f620 con 0x7f934006bd90 2024-05-08T08:26:42.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.587+0000 7f9346200700 1 -- 172.21.15.70:0/3143213631 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93401acb60 con 0x7f934006bd90 2024-05-08T08:26:42.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.593+0000 7f9337e00700 1 -- 172.21.15.70:0/3143213631 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f932c019070 con 0x7f934006bd90 2024-05-08T08:26:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.595+0000 7f9337e00700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f93240b2aa0 0x7f93240b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.595+0000 7f9337e00700 1 -- 172.21.15.70:0/3143213631 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(277..277 src has 1..277) ==== 9583+0+0 (secure 0 0 0) 0x7f932c0e3580 con 0x7f934006bd90 2024-05-08T08:26:42.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.596+0000 7f933f400700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f93240b2aa0 0x7f93240b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.614+0000 7f933f400700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f93240b2aa0 0x7f93240b4f60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9330000c00 tx=0x7f933001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:26:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.617+0000 7f9350be0b80 1 Processor -- start 2024-05-08T08:26:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.618+0000 7f9350be0b80 1 -- start start 2024-05-08T08:26:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.618+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x556344385330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.618+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634437f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.618+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x55634438bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.618+0000 7f9350be0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5563442d1bb0 con 0x55634437fee0 2024-05-08T08:26:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.618+0000 7f9350be0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55634426f8f0 con 0x556344384f50 2024-05-08T08:26:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.618+0000 7f9350be0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5563442cdb70 con 0x55634437f520 2024-05-08T08:26:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.619+0000 7f933f400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x556344385330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.619+0000 7f933fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x55634438bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.619+0000 7f933ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634437f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.619+0000 7f933ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634437f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:56814/0 (socket says 172.21.15.70:56814) 2024-05-08T08:26:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.619+0000 7f933ea00700 1 -- 172.21.15.70:0/2921583643 learned_addr learned my addr 172.21.15.70:0/2921583643 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:26:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.620+0000 7f933ea00700 1 -- 172.21.15.70:0/2921583643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 msgr2=0x556344385330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:26:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.620+0000 7f933ea00700 1 --2- 172.21.15.70:0/2921583643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x556344385330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.620+0000 7f933ea00700 1 -- 172.21.15.70:0/2921583643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 msgr2=0x55634438bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:26:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.620+0000 7f933ea00700 1 --2- 172.21.15.70:0/2921583643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x55634438bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.620+0000 7f933ea00700 1 -- 172.21.15.70:0/2921583643 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55634421ea60 con 0x55634437f520 2024-05-08T08:26:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.620+0000 7f933fe00700 1 --2- 172.21.15.70:0/2921583643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x55634438bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:26:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.620+0000 7f933ea00700 1 --2- 172.21.15.70:0/2921583643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634437f9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f932c005950 tx=0x7f932c0a9ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b30e65da204ac3df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:26:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.621+0000 7f9334c00700 1 -- 172.21.15.70:0/2921583643 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c020070 con 0x55634437f520 2024-05-08T08:26:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.621+0000 7f9334c00700 1 -- 172.21.15.70:0/2921583643 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f932c0ae790 con 0x55634437f520 2024-05-08T08:26:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.621+0000 7f9334c00700 1 -- 172.21.15.70:0/2921583643 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c0aa640 con 0x55634437f520 2024-05-08T08:26:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.622+0000 7f9350be0b80 1 -- 172.21.15.70:0/2921583643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 msgr2=0x55634437f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.622+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2921583643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634437f9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f932c005950 tx=0x7f932c0a9ff0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.622+0000 7f9350be0b80 1 -- 172.21.15.70:0/2921583643 shutdown_connections 2024-05-08T08:26:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.622+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2921583643 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x55634438bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.622+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2921583643 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x556344385330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.622+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2921583643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634437f9a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.622+0000 7f9350be0b80 1 -- 172.21.15.70:0/2921583643 >> 172.21.15.70:0/2921583643 conn(0x5563442adcf0 msgr2=0x556344379e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:26:42.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.623+0000 7f9350be0b80 1 -- 172.21.15.70:0/2921583643 shutdown_connections 2024-05-08T08:26:42.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.623+0000 7f9350be0b80 1 -- 172.21.15.70:0/2921583643 wait complete. 2024-05-08T08:26:42.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.623+0000 7f9350be0b80 1 -- start start 2024-05-08T08:26:42.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.624+0000 7f9350be0b80 1 Processor -- start 2024-05-08T08:26:42.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.624+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634438b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.624+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x556344388d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.624+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x556344389270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.624+0000 7f9350be0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55634439d260 con 0x55634437fee0 2024-05-08T08:26:42.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.625+0000 7f9350be0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556344237cb0 con 0x556344384f50 2024-05-08T08:26:42.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.625+0000 7f9350be0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55634439d3e0 con 0x55634437f520 2024-05-08T08:26:42.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.625+0000 7f9350be0b80 10 client.0 _ll_register_callbacks cb 0x556344278e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:26:42.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.625+0000 7f933ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x556344388d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:42 smithi070 ceph-mon[29591]: pgmap v3190: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 492 KiB/s wr, 20 op/s 2024-05-08T08:26:42.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.625+0000 7f933ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x556344388d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43668/0 (socket says 172.21.15.70:43668) 2024-05-08T08:26:42.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.625+0000 7f933ea00700 1 -- 172.21.15.70:0/2958251694 learned_addr learned my addr 172.21.15.70:0/2958251694 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:26:42.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.625+0000 7f933fe00700 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x556344389270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.626+0000 7f933f400700 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634438b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.627+0000 7f933fe00700 1 -- 172.21.15.70:0/2958251694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 msgr2=0x55634438b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:26:42.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.627+0000 7f933fe00700 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634438b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.627+0000 7f933fe00700 1 -- 172.21.15.70:0/2958251694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 msgr2=0x556344388d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:26:42.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.627+0000 7f933fe00700 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x556344388d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.628+0000 7f933fe00700 1 -- 172.21.15.70:0/2958251694 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563442975b0 con 0x556344384f50 2024-05-08T08:26:42.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.629+0000 7f933fe00700 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x556344389270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9338007b90 tx=0x7f9338007ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca80366724e9cefa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:26:42.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.629+0000 7f9329600700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:26:42.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.629+0000 7f9329600700 1 -- 172.21.15.70:0/2958251694 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933801a070 con 0x556344384f50 2024-05-08T08:26:42.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.629+0000 7f9329600700 1 -- 172.21.15.70:0/2958251694 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(277..277 src has 1..277) ==== 9583+0+0 (secure 0 0 0) 0x7f9338012ba0 con 0x556344384f50 2024-05-08T08:26:42.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.631+0000 7f9350be0b80 1 -- 172.21.15.70:0/2958251694 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f932c0ae790 con 0x556344384f50 2024-05-08T08:26:42.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.632+0000 7f9329600700 1 -- 172.21.15.70:0/2958251694 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9338024050 con 0x556344384f50 2024-05-08T08:26:42.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.632+0000 7f9350be0b80 10 client.36929 fetch_fsmap learned FSMap version 42 2024-05-08T08:26:42.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.632+0000 7f9350be0b80 1 -- 172.21.15.70:0/2958251694 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5563443a7b30 con 0x556344384f50 2024-05-08T08:26:42.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.632+0000 7f9329600700 1 -- 172.21.15.70:0/2958251694 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f932c0ae790 con 0x556344384f50 2024-05-08T08:26:42.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.633+0000 7f9329600700 1 -- 172.21.15.70:0/2958251694 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9338016420 con 0x556344384f50 2024-05-08T08:26:42.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.633+0000 7f9350be0b80 10 client.36929 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:26:42.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.633+0000 7f9350be0b80 10 client.36929 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:26:42.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.633+0000 7f9350be0b80 20 client.36929 populate_metadata read hostname 'smithi070' 2024-05-08T08:26:42.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.633+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5563443aa1c0 0x5563443ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.633+0000 7f9350be0b80 4 client.36929 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:26:42.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.633+0000 7f9350be0b80 1 -- 172.21.15.70:0/2958251694 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55634434c230 con 0x5563443aa1c0 2024-05-08T08:26:42.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.635+0000 7f933f400700 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5563443aa1c0 0x5563443ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.638+0000 7f933f400700 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5563443aa1c0 0x5563443ac5b0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cd40a03166c77cd server_cookie=d9e784c0f5de92cb in_seq=0 out_seq=0 2024-05-08T08:26:42.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.638+0000 7f9329600700 10 client.36929 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:26:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.641+0000 7f9329600700 1 -- 172.21.15.70:0/2958251694 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55634434c230 con 0x5563443aa1c0 2024-05-08T08:26:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.641+0000 7f9329600700 10 client.36929 handle_command_reply: tid=0 2024-05-08T08:26:42.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.641+0000 7f9350be0b80 1 client.36929 shutdown 2024-05-08T08:26:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.642+0000 7f9350be0b80 1 -- 172.21.15.70:0/2958251694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 msgr2=0x556344389270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.642+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x556344389270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9338007b90 tx=0x7f9338007ea0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.642+0000 7f9350be0b80 1 -- 172.21.15.70:0/2958251694 shutdown_connections 2024-05-08T08:26:42.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.642+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5563443aa1c0 0x5563443ac5b0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.642+0000 7f9329600700 0 client.36929 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:26:42.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.642+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x556344389270 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.642+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437f520 0x55634438b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.642+0000 7f9350be0b80 1 --2- 172.21.15.70:0/2958251694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437fee0 0x556344388d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.642+0000 7f9350be0b80 1 -- 172.21.15.70:0/2958251694 >> 172.21.15.70:0/2958251694 conn(0x5563442adcf0 msgr2=0x5563443748e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:26:42.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.643+0000 7f9350be0b80 1 -- 172.21.15.70:0/2958251694 shutdown_connections 2024-05-08T08:26:42.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.643+0000 7f9350be0b80 1 -- 172.21.15.70:0/2958251694 wait complete. 2024-05-08T08:26:42.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.644+0000 7f9350be0b80 20 client.36929 trim_cache size 0 max 16384 2024-05-08T08:26:42.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.682+0000 7f9350be0b80 1 Processor -- start 2024-05-08T08:26:42.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.682+0000 7f9350be0b80 1 -- start start 2024-05-08T08:26:42.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x5563443a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437fee0 0x556344384500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x5563443b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f9350be0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f93401afd10 con 0x55634437f520 2024-05-08T08:26:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f9350be0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93401ad5a0 con 0x556344384f50 2024-05-08T08:26:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f9350be0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9340073db0 con 0x55634437fee0 2024-05-08T08:26:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f933f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x5563443a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f933f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x5563443a62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43676/0 (socket says 172.21.15.70:43676) 2024-05-08T08:26:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f933f400700 1 -- 172.21.15.70:0/3914475343 learned_addr learned my addr 172.21.15.70:0/3914475343 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:26:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.683+0000 7f933fe00700 1 --2- 172.21.15.70:0/3914475343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x5563443b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.684+0000 7f933ea00700 1 --2- 172.21.15.70:0/3914475343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437fee0 0x556344384500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.684+0000 7f933f400700 1 -- 172.21.15.70:0/3914475343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437fee0 msgr2=0x556344384500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:26:42.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.684+0000 7f933f400700 1 --2- 172.21.15.70:0/3914475343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437fee0 0x556344384500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.684+0000 7f933f400700 1 -- 172.21.15.70:0/3914475343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 msgr2=0x5563443b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:26:42.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.684+0000 7f933f400700 1 --2- 172.21.15.70:0/3914475343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x5563443b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.684+0000 7f933f400700 1 -- 172.21.15.70:0/3914475343 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556344376a10 con 0x55634437f520 2024-05-08T08:26:42.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.684+0000 7f933f400700 1 --2- 172.21.15.70:0/3914475343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x5563443a62f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9330009990 tx=0x7f9330022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed7fbc87046c2bf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:26:42.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.685+0000 7f932be00700 1 -- 172.21.15.70:0/3914475343 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933000faa0 con 0x55634437f520 2024-05-08T08:26:42.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.685+0000 7f932be00700 1 -- 172.21.15.70:0/3914475343 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f933000fc40 con 0x55634437f520 2024-05-08T08:26:42.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.685+0000 7f932be00700 1 -- 172.21.15.70:0/3914475343 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330023410 con 0x55634437f520 2024-05-08T08:26:42.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.686+0000 7f9350be0b80 1 -- 172.21.15.70:0/3914475343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 msgr2=0x5563443a62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:26:42.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.686+0000 7f9350be0b80 1 --2- 172.21.15.70:0/3914475343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x5563443a62f0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f9330009990 tx=0x7f9330022000 comp rx=0 tx=0).stop 2024-05-08T08:26:42.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.687+0000 7f9350be0b80 1 -- 172.21.15.70:0/3914475343 shutdown_connections 2024-05-08T08:26:42.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.687+0000 7f9350be0b80 1 --2- 172.21.15.70:0/3914475343 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556344384f50 0x5563443b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.687+0000 7f9350be0b80 1 --2- 172.21.15.70:0/3914475343 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x5563443a62f0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.687+0000 7f9350be0b80 1 --2- 172.21.15.70:0/3914475343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55634437fee0 0x556344384500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.687+0000 7f9350be0b80 1 -- 172.21.15.70:0/3914475343 >> 172.21.15.70:0/3914475343 conn(0x5563442adcf0 msgr2=0x55634437eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:26:42.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.687+0000 7f9350be0b80 1 -- 172.21.15.70:0/3914475343 shutdown_connections 2024-05-08T08:26:42.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.687+0000 7f9350be0b80 1 -- 172.21.15.70:0/3914475343 wait complete. 2024-05-08T08:26:42.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.688+0000 7f9350be0b80 1 -- start start 2024-05-08T08:26:42.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.688+0000 7f9350be0b80 1 Processor -- start 2024-05-08T08:26:42.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.688+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x55634439d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.688+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55634437fee0 0x55634439de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.688+0000 7f9350be0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556344384f50 0x556344414a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.688+0000 7f9350be0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9340074400 con 0x55634437f520 2024-05-08T08:26:42.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.688+0000 7f9350be0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f93401aced0 con 0x55634437fee0 2024-05-08T08:26:42.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.688+0000 7f9350be0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9340074ad0 con 0x556344384f50 2024-05-08T08:26:42.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.689+0000 7f9350be0b80 10 client.0 _ll_register_callbacks cb 0x556344278e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:26:42.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.689+0000 7f933f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x55634439d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.689+0000 7f933f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x55634439d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43688/0 (socket says 172.21.15.70:43688) 2024-05-08T08:26:42.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.689+0000 7f933f400700 1 -- 172.21.15.70:0/1465320551 learned_addr learned my addr 172.21.15.70:0/1465320551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:26:42.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.689+0000 7f933fe00700 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556344384f50 0x556344414a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.689+0000 7f933ea00700 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55634437fee0 0x55634439de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.689+0000 7f933f400700 1 -- 172.21.15.70:0/1465320551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556344384f50 msgr2=0x556344414a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:26:42.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.690+0000 7f933f400700 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556344384f50 0x556344414a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.690+0000 7f933f400700 1 -- 172.21.15.70:0/1465320551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55634437fee0 msgr2=0x55634439de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:26:42.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.690+0000 7f933f400700 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55634437fee0 0x55634439de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:26:42.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.690+0000 7f933f400700 1 -- 172.21.15.70:0/1465320551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556344376630 con 0x55634437f520 2024-05-08T08:26:42.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.690+0000 7f933fe00700 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556344384f50 0x556344414a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:26:42.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.690+0000 7f933ea00700 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55634437fee0 0x55634439de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:26:42.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.690+0000 7f933f400700 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x55634439d8d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f93300058e0 tx=0x7f933000beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7e314a6db52a0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:26:42.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.691+0000 7f9329600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:26:42.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.691+0000 7f9329600700 1 -- 172.21.15.70:0/1465320551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9330042070 con 0x55634437f520 2024-05-08T08:26:42.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.691+0000 7f9350be0b80 1 -- 172.21.15.70:0/1465320551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f933000fc40 con 0x55634437f520 2024-05-08T08:26:42.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.691+0000 7f9329600700 1 -- 172.21.15.70:0/1465320551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(277..277 src has 1..277) ==== 9583+0+0 (secure 0 0 0) 0x7f93300353f0 con 0x55634437f520 2024-05-08T08:26:42.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.691+0000 7f9329600700 1 -- 172.21.15.70:0/1465320551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f933004e050 con 0x55634437f520 2024-05-08T08:26:42.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9350be0b80 10 client.18066 fetch_fsmap learned FSMap version 42 2024-05-08T08:26:42.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9350be0b80 1 -- 172.21.15.70:0/1465320551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x556344416030 con 0x55634437f520 2024-05-08T08:26:42.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9329600700 1 -- 172.21.15.70:0/1465320551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f933000fc40 con 0x55634437f520 2024-05-08T08:26:42.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9329600700 1 -- 172.21.15.70:0/1465320551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f933003e8a0 con 0x55634437f520 2024-05-08T08:26:42.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9350be0b80 10 client.18066 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:26:42.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9350be0b80 10 client.18066 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:26:42.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9350be0b80 20 client.18066 populate_metadata read hostname 'smithi070' 2024-05-08T08:26:42.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9350be0b80 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556344416690 0x556344418ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:26:42.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9350be0b80 4 client.18066 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.7, "await_for": 42.0}] 2024-05-08T08:26:42.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.692+0000 7f9350be0b80 1 -- 172.21.15.70:0/1465320551 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.7, "await_for": 42.0}) -- 0x5563442df590 con 0x556344416690 2024-05-08T08:26:42.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.693+0000 7f933ea00700 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556344416690 0x556344418ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:26:42.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.694+0000 7f933ea00700 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556344416690 0x556344418ab0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40d446fc5db0c1f0 server_cookie=50a4e6a9b1b4c2d0 in_seq=0 out_seq=0 2024-05-08T08:26:42.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:26:42.694+0000 7f9329600700 10 client.18066 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:26:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:42 smithi194 ceph-mon[33679]: pgmap v3190: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 492 KiB/s wr, 20 op/s 2024-05-08T08:26:42.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:42 smithi172 ceph-mon[33377]: pgmap v3190: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 492 KiB/s wr, 20 op/s 2024-05-08T08:26:43.197 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/psparse.o 2024-05-08T08:26:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:44 smithi194 ceph-mon[33679]: pgmap v3191: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 492 KiB/s wr, 20 op/s 2024-05-08T08:26:44.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:44 smithi070 ceph-mon[29591]: pgmap v3191: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 492 KiB/s wr, 20 op/s 2024-05-08T08:26:44.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:44 smithi172 ceph-mon[33377]: pgmap v3191: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 492 KiB/s wr, 20 op/s 2024-05-08T08:26:46.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:46 smithi194 ceph-mon[33679]: pgmap v3192: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 683 KiB/s wr, 28 op/s 2024-05-08T08:26:46.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:46 smithi070 ceph-mon[29591]: pgmap v3192: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 683 KiB/s wr, 28 op/s 2024-05-08T08:26:46.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:46 smithi172 ceph-mon[33377]: pgmap v3192: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 683 KiB/s wr, 28 op/s 2024-05-08T08:26:48.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:48 smithi070 ceph-mon[29591]: pgmap v3193: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 476 KiB/s wr, 16 op/s 2024-05-08T08:26:48.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:48 smithi172 ceph-mon[33377]: pgmap v3193: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 476 KiB/s wr, 16 op/s 2024-05-08T08:26:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:48 smithi194 ceph-mon[33679]: pgmap v3193: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 476 KiB/s wr, 16 op/s 2024-05-08T08:26:50.806 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:50 smithi194 ceph-mon[33679]: pgmap v3194: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 540 KiB/s wr, 20 op/s 2024-05-08T08:26:50.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:50 smithi070 ceph-mon[29591]: pgmap v3194: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 540 KiB/s wr, 20 op/s 2024-05-08T08:26:50.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:50 smithi172 ceph-mon[33377]: pgmap v3194: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 540 KiB/s wr, 20 op/s 2024-05-08T08:26:52.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:52 smithi070 ceph-mon[29591]: pgmap v3195: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 255 KiB/s wr, 12 op/s 2024-05-08T08:26:52.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:52 smithi172 ceph-mon[33377]: pgmap v3195: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 255 KiB/s wr, 12 op/s 2024-05-08T08:26:53.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:52 smithi194 ceph-mon[33679]: pgmap v3195: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 255 KiB/s wr, 12 op/s 2024-05-08T08:26:54.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:54 smithi070 ceph-mon[29591]: pgmap v3196: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 255 KiB/s wr, 12 op/s 2024-05-08T08:26:54.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:54 smithi172 ceph-mon[33377]: pgmap v3196: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 255 KiB/s wr, 12 op/s 2024-05-08T08:26:55.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:54 smithi194 ceph-mon[33679]: pgmap v3196: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 255 KiB/s wr, 12 op/s 2024-05-08T08:26:56.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:56 smithi070 ceph-mon[29591]: pgmap v3197: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 276 KiB/s wr, 16 op/s 2024-05-08T08:26:56.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:56 smithi172 ceph-mon[33377]: pgmap v3197: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 276 KiB/s wr, 16 op/s 2024-05-08T08:26:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:56 smithi194 ceph-mon[33679]: pgmap v3197: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 276 KiB/s wr, 16 op/s 2024-05-08T08:26:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:26:58 smithi070 ceph-mon[29591]: pgmap v3198: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 86 KiB/s wr, 8 op/s 2024-05-08T08:26:58.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:26:58 smithi172 ceph-mon[33377]: pgmap v3198: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 86 KiB/s wr, 8 op/s 2024-05-08T08:26:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:26:58 smithi194 ceph-mon[33679]: pgmap v3198: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 86 KiB/s wr, 8 op/s 2024-05-08T08:27:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:00 smithi070 ceph-mon[29591]: pgmap v3199: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 135 KiB/s wr, 11 op/s 2024-05-08T08:27:00.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:00 smithi172 ceph-mon[33377]: pgmap v3199: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 135 KiB/s wr, 11 op/s 2024-05-08T08:27:01.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:00 smithi194 ceph-mon[33679]: pgmap v3199: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 135 KiB/s wr, 11 op/s 2024-05-08T08:27:02.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:02 smithi070 ceph-mon[29591]: pgmap v3200: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 71 KiB/s wr, 7 op/s 2024-05-08T08:27:02.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:02 smithi172 ceph-mon[33377]: pgmap v3200: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 71 KiB/s wr, 7 op/s 2024-05-08T08:27:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:02 smithi194 ceph-mon[33679]: pgmap v3200: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 71 KiB/s wr, 7 op/s 2024-05-08T08:27:04.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:04 smithi070 ceph-mon[29591]: pgmap v3201: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 71 KiB/s wr, 7 op/s 2024-05-08T08:27:04.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:04 smithi172 ceph-mon[33377]: pgmap v3201: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 71 KiB/s wr, 7 op/s 2024-05-08T08:27:05.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:04 smithi194 ceph-mon[33679]: pgmap v3201: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 71 KiB/s wr, 7 op/s 2024-05-08T08:27:05.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.771+0000 7f9329600700 1 -- 172.21.15.70:0/1465320551 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5563442df590 con 0x556344416690 2024-05-08T08:27:05.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.771+0000 7f9329600700 10 client.18066 handle_command_reply: tid=0 2024-05-08T08:27:05.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.771+0000 7f9350be0b80 1 client.18066 shutdown 2024-05-08T08:27:05.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9350be0b80 1 -- 172.21.15.70:0/1465320551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 msgr2=0x55634439d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:05.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9350be0b80 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x55634439d8d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f93300058e0 tx=0x7f933000beb0 comp rx=0 tx=0).stop 2024-05-08T08:27:05.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9350be0b80 1 -- 172.21.15.70:0/1465320551 shutdown_connections 2024-05-08T08:27:05.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9350be0b80 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556344416690 0x556344418ab0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:05.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9350be0b80 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556344384f50 0x556344414a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:05.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9350be0b80 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55634437f520 0x55634439d8d0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:05.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9350be0b80 1 --2- 172.21.15.70:0/1465320551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55634437fee0 0x55634439de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:05.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9350be0b80 1 -- 172.21.15.70:0/1465320551 >> 172.21.15.70:0/1465320551 conn(0x5563442adcf0 msgr2=0x5563443748e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:05.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9329600700 0 client.18066 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:27:05.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.772+0000 7f9350be0b80 1 -- 172.21.15.70:0/1465320551 shutdown_connections 2024-05-08T08:27:05.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.773+0000 7f9350be0b80 1 -- 172.21.15.70:0/1465320551 wait complete. 2024-05-08T08:27:05.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.773+0000 7f9350be0b80 20 client.18066 trim_cache size 0 max 16384 2024-05-08T08:27:05.767 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 226, 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "ae0facac": { 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 226, 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.7, 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:27:05.768 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:05.769 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 -- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f93240b2aa0 msgr2=0x7f93240b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f93240b2aa0 0x7f93240b4f60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f9330000c00 tx=0x7f933001a040 comp rx=0 tx=0).stop 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 -- 172.21.15.70:0/3143213631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f934006bd90 msgr2=0x7f934010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f934006bd90 0x7f934010d590 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f932c00d950 tx=0x7f932c00dd10 comp rx=0 tx=0).stop 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 -- 172.21.15.70:0/3143213631 shutdown_connections 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f93240b2aa0 0x7f93240b4f60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9340108860 0x7f934010f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f934006b3e0 0x7f934010d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 --2- 172.21.15.70:0/3143213631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f934006bd90 0x7f934010d590 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.775+0000 7f9346200700 1 -- 172.21.15.70:0/3143213631 >> 172.21.15.70:0/3143213631 conn(0x7f9340079340 msgr2=0x7f9340100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.776+0000 7f9346200700 1 -- 172.21.15.70:0/3143213631 shutdown_connections 2024-05-08T08:27:05.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:05.776+0000 7f9346200700 1 -- 172.21.15.70:0/3143213631 wait complete. 2024-05-08T08:27:06.795 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ae0facac', quiesce took 40.9 seconds. Will release after: 25.7 2024-05-08T08:27:06.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:06 smithi070 ceph-mon[29591]: pgmap v3202: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 71 KiB/s wr, 11 op/s 2024-05-08T08:27:06.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:06 smithi172 ceph-mon[33377]: pgmap v3202: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 71 KiB/s wr, 11 op/s 2024-05-08T08:27:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:06 smithi194 ceph-mon[33679]: pgmap v3202: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 71 KiB/s wr, 11 op/s 2024-05-08T08:27:08.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:08 smithi070 ceph-mon[29591]: pgmap v3203: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T08:27:08.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:08 smithi172 ceph-mon[33377]: pgmap v3203: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T08:27:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:08 smithi194 ceph-mon[33679]: pgmap v3203: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T08:27:10.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:10 smithi070 ceph-mon[29591]: pgmap v3204: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 157 KiB/s wr, 26 op/s 2024-05-08T08:27:10.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:10 smithi172 ceph-mon[33377]: pgmap v3204: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 157 KiB/s wr, 26 op/s 2024-05-08T08:27:11.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:10 smithi194 ceph-mon[33679]: pgmap v3204: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 157 KiB/s wr, 26 op/s 2024-05-08T08:27:12.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:12 smithi070 ceph-mon[29591]: pgmap v3205: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 108 KiB/s wr, 23 op/s 2024-05-08T08:27:12.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:12 smithi172 ceph-mon[33377]: pgmap v3205: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 108 KiB/s wr, 23 op/s 2024-05-08T08:27:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:12 smithi194 ceph-mon[33679]: pgmap v3205: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 108 KiB/s wr, 23 op/s 2024-05-08T08:27:14.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:14 smithi070 ceph-mon[29591]: pgmap v3206: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 108 KiB/s wr, 23 op/s 2024-05-08T08:27:14.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:14 smithi070 ceph-mon[29591]: osdmap e278: 12 total, 12 up, 12 in 2024-05-08T08:27:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:14 smithi172 ceph-mon[33377]: pgmap v3206: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 108 KiB/s wr, 23 op/s 2024-05-08T08:27:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:14 smithi172 ceph-mon[33377]: osdmap e278: 12 total, 12 up, 12 in 2024-05-08T08:27:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:14 smithi194 ceph-mon[33679]: pgmap v3206: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 108 KiB/s wr, 23 op/s 2024-05-08T08:27:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:14 smithi194 ceph-mon[33679]: osdmap e278: 12 total, 12 up, 12 in 2024-05-08T08:27:16.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:16 smithi070 ceph-mon[29591]: pgmap v3208: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 177 KiB/s wr, 28 op/s 2024-05-08T08:27:16.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:16 smithi172 ceph-mon[33377]: pgmap v3208: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 177 KiB/s wr, 28 op/s 2024-05-08T08:27:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:16 smithi194 ceph-mon[33679]: pgmap v3208: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 177 KiB/s wr, 28 op/s 2024-05-08T08:27:18.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:18 smithi070 ceph-mon[29591]: pgmap v3209: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 177 KiB/s wr, 28 op/s 2024-05-08T08:27:18.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:18 smithi172 ceph-mon[33377]: pgmap v3209: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 177 KiB/s wr, 28 op/s 2024-05-08T08:27:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:18 smithi194 ceph-mon[33679]: pgmap v3209: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 177 KiB/s wr, 28 op/s 2024-05-08T08:27:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:20 smithi070 ceph-mon[29591]: pgmap v3210: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 48 KiB/s wr, 12 op/s 2024-05-08T08:27:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:27:20.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:20 smithi172 ceph-mon[33377]: pgmap v3210: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 48 KiB/s wr, 12 op/s 2024-05-08T08:27:20.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:27:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:20 smithi194 ceph-mon[33679]: pgmap v3210: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 48 KiB/s wr, 12 op/s 2024-05-08T08:27:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:27:21.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:27:21.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:27:21.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:27:21.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:27:21.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:27:21.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:27:22.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:27:22.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:27:22.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:27:23.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:23 smithi172 ceph-mon[33377]: pgmap v3211: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 48 KiB/s wr, 12 op/s 2024-05-08T08:27:23.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:23 smithi194 ceph-mon[33679]: pgmap v3211: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 48 KiB/s wr, 12 op/s 2024-05-08T08:27:23.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:23 smithi070 ceph-mon[29591]: pgmap v3211: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 48 KiB/s wr, 12 op/s 2024-05-08T08:27:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:25 smithi172 ceph-mon[33377]: pgmap v3212: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 48 KiB/s wr, 12 op/s 2024-05-08T08:27:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:25 smithi172 ceph-mon[33377]: osdmap e279: 12 total, 12 up, 12 in 2024-05-08T08:27:25.425 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:25 smithi070 ceph-mon[29591]: pgmap v3212: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 48 KiB/s wr, 12 op/s 2024-05-08T08:27:25.425 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:25 smithi070 ceph-mon[29591]: osdmap e279: 12 total, 12 up, 12 in 2024-05-08T08:27:25.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:25 smithi194 ceph-mon[33679]: pgmap v3212: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 48 KiB/s wr, 12 op/s 2024-05-08T08:27:25.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:25 smithi194 ceph-mon[33679]: osdmap e279: 12 total, 12 up, 12 in 2024-05-08T08:27:27.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:27 smithi172 ceph-mon[33377]: pgmap v3214: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-08T08:27:27.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:27 smithi194 ceph-mon[33679]: pgmap v3214: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-08T08:27:27.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:27 smithi070 ceph-mon[29591]: pgmap v3214: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-08T08:27:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:29 smithi172 ceph-mon[33377]: pgmap v3215: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-08T08:27:29.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:29 smithi194 ceph-mon[33679]: pgmap v3215: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-08T08:27:29.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:29 smithi070 ceph-mon[29591]: pgmap v3215: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-08T08:27:31.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:31 smithi172 ceph-mon[33377]: pgmap v3216: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-05-08T08:27:31.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:31 smithi194 ceph-mon[33679]: pgmap v3216: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-05-08T08:27:31.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:31 smithi070 ceph-mon[29591]: pgmap v3216: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-05-08T08:27:32.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:27:32.955 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:27:33.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:33 smithi070 ceph-mon[29591]: pgmap v3217: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-05-08T08:27:33.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:33 smithi172 ceph-mon[33377]: pgmap v3217: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-05-08T08:27:33.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:33 smithi194 ceph-mon[33679]: pgmap v3217: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-05-08T08:27:35.337 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:35 smithi070 ceph-mon[29591]: pgmap v3218: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-05-08T08:27:35.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:35 smithi172 ceph-mon[33377]: pgmap v3218: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-05-08T08:27:35.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:35 smithi194 ceph-mon[33679]: pgmap v3218: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 6 op/s 2024-05-08T08:27:35.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.674+0000 7fb895400700 1 -- 172.21.15.70:0/2188625727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8900756d0 msgr2=0x7fb890075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:35.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.674+0000 7fb895400700 1 --2- 172.21.15.70:0/2188625727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8900756d0 0x7fb890075ab0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fb880009990 tx=0x7fb880009ca0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.674+0000 7fb895400700 1 -- 172.21.15.70:0/2188625727 shutdown_connections 2024-05-08T08:27:35.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.674+0000 7fb895400700 1 --2- 172.21.15.70:0/2188625727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb89010fea0 0x7fb890112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.674+0000 7fb895400700 1 --2- 172.21.15.70:0/2188625727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8900756d0 0x7fb890075ab0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.674+0000 7fb895400700 1 --2- 172.21.15.70:0/2188625727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb890075ff0 0x7fb89010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.675+0000 7fb895400700 1 -- 172.21.15.70:0/2188625727 >> 172.21.15.70:0/2188625727 conn(0x7fb89007a600 msgr2=0x7fb89007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:35.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.675+0000 7fb895400700 1 -- 172.21.15.70:0/2188625727 shutdown_connections 2024-05-08T08:27:35.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.675+0000 7fb895400700 1 -- 172.21.15.70:0/2188625727 wait complete. 2024-05-08T08:27:35.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.676+0000 7fb895400700 1 Processor -- start 2024-05-08T08:27:35.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.676+0000 7fb895400700 1 -- start start 2024-05-08T08:27:35.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb895400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8900756d0 0x7fb8901a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:35.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb895400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb890075ff0 0x7fb8901a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:35.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb895400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89010fea0 0x7fb89019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:35.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb895400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb890115780 con 0x7fb890075ff0 2024-05-08T08:27:35.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb895400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb890115600 con 0x7fb8900756d0 2024-05-08T08:27:35.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb895400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb890115900 con 0x7fb89010fea0 2024-05-08T08:27:35.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb88de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb890075ff0 0x7fb8901a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:35.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb88de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb890075ff0 0x7fb8901a1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39834/0 (socket says 172.21.15.70:39834) 2024-05-08T08:27:35.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb88de00700 1 -- 172.21.15.70:0/2797130288 learned_addr learned my addr 172.21.15.70:0/2797130288 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:27:35.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.677+0000 7fb88e800700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8900756d0 0x7fb8901a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb88f200700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89010fea0 0x7fb89019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb88de00700 1 -- 172.21.15.70:0/2797130288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89010fea0 msgr2=0x7fb89019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb88de00700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89010fea0 0x7fb89019ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb88de00700 1 -- 172.21.15.70:0/2797130288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8900756d0 msgr2=0x7fb8901a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb88de00700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8900756d0 0x7fb8901a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb88de00700 1 -- 172.21.15.70:0/2797130288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb89019c1a0 con 0x7fb890075ff0 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb88e800700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8900756d0 0x7fb8901a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb88de00700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb890075ff0 0x7fb8901a1dc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c9b0 tx=0x7fb87c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb887400700 1 -- 172.21.15.70:0/2797130288 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c007b00 con 0x7fb890075ff0 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb887400700 1 -- 172.21.15.70:0/2797130288 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb87c007ca0 con 0x7fb890075ff0 2024-05-08T08:27:35.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb887400700 1 -- 172.21.15.70:0/2797130288 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c018660 con 0x7fb890075ff0 2024-05-08T08:27:35.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.678+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb89019c490 con 0x7fb890075ff0 2024-05-08T08:27:35.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.679+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8901a8750 con 0x7fb890075ff0 2024-05-08T08:27:35.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.680+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb89006a190 con 0x7fb890075ff0 2024-05-08T08:27:35.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.683+0000 7fb887400700 1 -- 172.21.15.70:0/2797130288 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb87c00f450 con 0x7fb890075ff0 2024-05-08T08:27:35.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.684+0000 7fb887400700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8740b29f0 0x7fb8740b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:35.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.685+0000 7fb887400700 1 -- 172.21.15.70:0/2797130288 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(279..279 src has 1..279) ==== 9583+0+0 (secure 0 0 0) 0x7fb87c0e2b50 con 0x7fb890075ff0 2024-05-08T08:27:35.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.685+0000 7fb88e800700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8740b29f0 0x7fb8740b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:35.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.686+0000 7fb88e800700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8740b29f0 0x7fb8740b4eb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb880006010 tx=0x7fb88001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:27:35.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.689+0000 7fb887400700 1 -- 172.21.15.70:0/2797130288 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb87c014030 con 0x7fb890075ff0 2024-05-08T08:27:35.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.975+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb89002e510 con 0x7fb890075ff0 2024-05-08T08:27:35.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.977+0000 7fb887400700 1 -- 172.21.15.70:0/2797130288 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fb87c0aa0b0 con 0x7fb890075ff0 2024-05-08T08:27:35.969 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:27:35.969 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:27:35.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8740b29f0 msgr2=0x7fb8740b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:35.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8740b29f0 0x7fb8740b4eb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb880006010 tx=0x7fb88001a040 comp rx=0 tx=0).stop 2024-05-08T08:27:35.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb890075ff0 msgr2=0x7fb8901a1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:35.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb890075ff0 0x7fb8901a1dc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c9b0 tx=0x7fb87c00cd70 comp rx=0 tx=0).stop 2024-05-08T08:27:35.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 shutdown_connections 2024-05-08T08:27:35.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8740b29f0 0x7fb8740b4eb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb89010fea0 0x7fb89019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb8900756d0 0x7fb8901a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 --2- 172.21.15.70:0/2797130288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb890075ff0 0x7fb8901a1dc0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:35.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.980+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 >> 172.21.15.70:0/2797130288 conn(0x7fb89007a600 msgr2=0x7fb890100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:35.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.981+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 shutdown_connections 2024-05-08T08:27:35.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:35.981+0000 7fb895400700 1 -- 172.21.15.70:0/2797130288 wait complete. 2024-05-08T08:27:35.974 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:27:36.346 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:36 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2797130288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:27:36.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:36 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2797130288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:27:36.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:36 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2797130288' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:27:36.787 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id ae0facac --release --await' 2024-05-08T08:27:36.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id ae0facac --release --await 2024-05-08T08:27:37.240 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:27:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:37 smithi194 ceph-mon[33679]: pgmap v3219: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-05-08T08:27:37.552 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:37 smithi070 ceph-mon[29591]: pgmap v3219: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-05-08T08:27:37.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:37 smithi172 ceph-mon[33377]: pgmap v3219: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 9.5 KiB/s wr, 5 op/s 2024-05-08T08:27:39.336 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:39 smithi070 ceph-mon[29591]: pgmap v3220: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:39.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:39 smithi194 ceph-mon[33679]: pgmap v3220: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:39.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:39 smithi172 ceph-mon[33377]: pgmap v3220: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.863+0000 7fba97e00700 1 -- 172.21.15.70:0/3230640536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 msgr2=0x7fba9010f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.863+0000 7fba97e00700 1 --2- 172.21.15.70:0/3230640536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 0x7fba9010f9c0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009990 tx=0x7fba7c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.863+0000 7fba97e00700 1 -- 172.21.15.70:0/3230640536 shutdown_connections 2024-05-08T08:27:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.863+0000 7fba97e00700 1 --2- 172.21.15.70:0/3230640536 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba9010ff00 0x7fba901122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.863+0000 7fba97e00700 1 --2- 172.21.15.70:0/3230640536 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba900756d0 0x7fba90075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.863+0000 7fba97e00700 1 --2- 172.21.15.70:0/3230640536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 0x7fba9010f9c0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.863+0000 7fba97e00700 1 -- 172.21.15.70:0/3230640536 >> 172.21.15.70:0/3230640536 conn(0x7fba9007a600 msgr2=0x7fba9007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:39.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.863+0000 7fba97e00700 1 -- 172.21.15.70:0/3230640536 shutdown_connections 2024-05-08T08:27:39.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.863+0000 7fba97e00700 1 -- 172.21.15.70:0/3230640536 wait complete. 2024-05-08T08:27:39.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.864+0000 7fba97e00700 1 Processor -- start 2024-05-08T08:27:39.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.865+0000 7fba97e00700 1 -- start start 2024-05-08T08:27:39.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.865+0000 7fba97e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba900756d0 0x7fba901a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.865+0000 7fba97e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 0x7fba901a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.865+0000 7fba97e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba9010ff00 0x7fba9019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.865+0000 7fba97e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba90115770 con 0x7fba90075ff0 2024-05-08T08:27:39.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.865+0000 7fba97e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba901155f0 con 0x7fba900756d0 2024-05-08T08:27:39.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.865+0000 7fba97e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fba901158f0 con 0x7fba9010ff00 2024-05-08T08:27:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.865+0000 7fba94a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 0x7fba901a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba94a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 0x7fba901a1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39604/0 (socket says 172.21.15.70:39604) 2024-05-08T08:27:39.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba94a00700 1 -- 172.21.15.70:0/3841754409 learned_addr learned my addr 172.21.15.70:0/3841754409 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:27:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba95400700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba900756d0 0x7fba901a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba95e00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba9010ff00 0x7fba9019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba94a00700 1 -- 172.21.15.70:0/3841754409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba9010ff00 msgr2=0x7fba9019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba94a00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba9010ff00 0x7fba9019bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba94a00700 1 -- 172.21.15.70:0/3841754409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba900756d0 msgr2=0x7fba901a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba94a00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba900756d0 0x7fba901a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba94a00700 1 -- 172.21.15.70:0/3841754409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9019c210 con 0x7fba90075ff0 2024-05-08T08:27:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.866+0000 7fba94a00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 0x7fba901a1de0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fba7c000c00 tx=0x7fba7c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:27:39.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.867+0000 7fba8e000700 1 -- 172.21.15.70:0/3841754409 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c027070 con 0x7fba90075ff0 2024-05-08T08:27:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.867+0000 7fba97e00700 1 -- 172.21.15.70:0/3841754409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba9019c4a0 con 0x7fba90075ff0 2024-05-08T08:27:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.867+0000 7fba8e000700 1 -- 172.21.15.70:0/3841754409 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba7c00fc70 con 0x7fba90075ff0 2024-05-08T08:27:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.867+0000 7fba97e00700 1 -- 172.21.15.70:0/3841754409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba901a8770 con 0x7fba90075ff0 2024-05-08T08:27:39.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.867+0000 7fba8e000700 1 -- 172.21.15.70:0/3841754409 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c022ce0 con 0x7fba90075ff0 2024-05-08T08:27:39.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.870+0000 7fba8e000700 1 -- 172.21.15.70:0/3841754409 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fba7c02a070 con 0x7fba90075ff0 2024-05-08T08:27:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.872+0000 7fba8e000700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fba780b29f0 0x7fba780b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.872+0000 7fba8e000700 1 -- 172.21.15.70:0/3841754409 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(279..279 src has 1..279) ==== 9583+0+0 (secure 0 0 0) 0x7fba7c0e37b0 con 0x7fba90075ff0 2024-05-08T08:27:39.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.872+0000 7fba95400700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fba780b29f0 0x7fba780b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.873+0000 7fba95400700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fba780b29f0 0x7fba780b4eb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fba84005950 tx=0x7fba840058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:27:39.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.888+0000 7fbaa27b6b80 1 Processor -- start 2024-05-08T08:27:39.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.888+0000 7fbaa27b6b80 1 -- start start 2024-05-08T08:27:39.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.888+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c0473aec0 0x563c0473b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.888+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04735910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.889+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 0x563c04741c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.889+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563c04687b20 con 0x563c04735490 2024-05-08T08:27:39.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.889+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563c04625860 con 0x563c0473aec0 2024-05-08T08:27:39.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.889+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563c04683ae0 con 0x563c04735e50 2024-05-08T08:27:39.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.889+0000 7fba94a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04735910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.889+0000 7fba94a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04735910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39616/0 (socket says 172.21.15.70:39616) 2024-05-08T08:27:39.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.889+0000 7fba94a00700 1 -- 172.21.15.70:0/327140345 learned_addr learned my addr 172.21.15.70:0/327140345 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.889+0000 7fba95400700 1 --2- 172.21.15.70:0/327140345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c0473aec0 0x563c0473b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.889+0000 7fba95e00700 1 --2- 172.21.15.70:0/327140345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 0x563c04741c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.890+0000 7fba94a00700 1 -- 172.21.15.70:0/327140345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 msgr2=0x563c04741c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.890+0000 7fba94a00700 1 --2- 172.21.15.70:0/327140345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 0x563c04741c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.890+0000 7fba94a00700 1 -- 172.21.15.70:0/327140345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c0473aec0 msgr2=0x563c0473b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.890+0000 7fba94a00700 1 --2- 172.21.15.70:0/327140345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c0473aec0 0x563c0473b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.890+0000 7fba94a00700 1 -- 172.21.15.70:0/327140345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c045d49d0 con 0x563c04735490 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.890+0000 7fba94a00700 1 --2- 172.21.15.70:0/327140345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04735910 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0e0b40 tx=0x7fba7c023f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf2e6ac60435edf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.890+0000 7fba82a00700 1 -- 172.21.15.70:0/327140345 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0aae00 con 0x563c04735490 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.890+0000 7fba82a00700 1 -- 172.21.15.70:0/327140345 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba7c0aa700 con 0x563c04735490 2024-05-08T08:27:39.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.890+0000 7fba82a00700 1 -- 172.21.15.70:0/327140345 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0aa960 con 0x563c04735490 2024-05-08T08:27:39.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.891+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/327140345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 msgr2=0x563c04735910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:39.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.892+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/327140345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04735910 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0e0b40 tx=0x7fba7c023f10 comp rx=0 tx=0).stop 2024-05-08T08:27:39.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.892+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/327140345 shutdown_connections 2024-05-08T08:27:39.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.892+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/327140345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 0x563c04741c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.892+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/327140345 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c0473aec0 0x563c0473b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.892+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/327140345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04735910 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.892+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/327140345 >> 172.21.15.70:0/327140345 conn(0x563c04663c60 msgr2=0x563c0472fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:39.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.892+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/327140345 shutdown_connections 2024-05-08T08:27:39.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.892+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/327140345 wait complete. 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.892+0000 7fbaa27b6b80 1 -- start start 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.893+0000 7fbaa27b6b80 1 Processor -- start 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.893+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735490 0x563c047418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.893+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 0x563c0473ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.893+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c0473f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.893+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563c0473b9d0 con 0x563c0473aec0 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.893+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563c045edc20 con 0x563c04735e50 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.893+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563c047421c0 con 0x563c04735490 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.893+0000 7fbaa27b6b80 10 client.0 _ll_register_callbacks cb 0x563c0462ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.893+0000 7fba95e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c0473f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.894+0000 7fba95e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c0473f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39624/0 (socket says 172.21.15.70:39624) 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.894+0000 7fba95e00700 1 -- 172.21.15.70:0/2550948077 learned_addr learned my addr 172.21.15.70:0/2550948077 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.894+0000 7fba94a00700 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 0x563c0473ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.894+0000 7fba95400700 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735490 0x563c047418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.894+0000 7fba95e00700 1 -- 172.21.15.70:0/2550948077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735490 msgr2=0x563c047418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.894+0000 7fba95e00700 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735490 0x563c047418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.894+0000 7fba95e00700 1 -- 172.21.15.70:0/2550948077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 msgr2=0x563c0473ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.894+0000 7fba95e00700 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 0x563c0473ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.894+0000 7fba95e00700 1 -- 172.21.15.70:0/2550948077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c0464d520 con 0x563c0473aec0 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.895+0000 7fba95e00700 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c0473f1c0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fba88008b80 tx=0x7fba88008e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ad96a95a49c280 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.895+0000 7fba77400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.895+0000 7fba77400700 1 -- 172.21.15.70:0/2550948077 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88004bb0 con 0x563c0473aec0 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.895+0000 7fba77400700 1 -- 172.21.15.70:0/2550948077 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(279..279 src has 1..279) ==== 9583+0+0 (secure 0 0 0) 0x7fba88011040 con 0x563c0473aec0 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.895+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/2550948077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba7c0aa700 con 0x563c0473aec0 2024-05-08T08:27:39.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.895+0000 7fba77400700 1 -- 172.21.15.70:0/2550948077 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fba88022050 con 0x563c0473aec0 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.895+0000 7fbaa27b6b80 10 client.18084 fetch_fsmap learned FSMap version 42 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.895+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/2550948077 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563c0474c870 con 0x563c0473aec0 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.896+0000 7fba77400700 1 -- 172.21.15.70:0/2550948077 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba7c0aa700 con 0x563c0473aec0 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.896+0000 7fba77400700 1 -- 172.21.15.70:0/2550948077 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fba880158c0 con 0x563c0473aec0 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.896+0000 7fbaa27b6b80 10 client.18084 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.896+0000 7fbaa27b6b80 10 client.18084 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.896+0000 7fbaa27b6b80 20 client.18084 populate_metadata read hostname 'smithi070' 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.896+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c0474ef00 0x563c047512f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.896+0000 7fbaa27b6b80 4 client.18084 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.896+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/2550948077 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c047021a0 con 0x563c0474ef00 2024-05-08T08:27:39.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.897+0000 7fba95400700 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c0474ef00 0x563c047512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.898+0000 7fba95400700 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c0474ef00 0x563c047512f0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9a4c2c4594d53db server_cookie=984aa703b90dbaea in_seq=0 out_seq=0 2024-05-08T08:27:39.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.898+0000 7fba77400700 10 client.18084 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:27:39.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fba77400700 1 -- 172.21.15.70:0/2550948077 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563c047021a0 con 0x563c0474ef00 2024-05-08T08:27:39.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fba77400700 10 client.18084 handle_command_reply: tid=0 2024-05-08T08:27:39.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fbaa27b6b80 1 client.18084 shutdown 2024-05-08T08:27:39.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/2550948077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 msgr2=0x563c0473f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:39.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c0473f1c0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fba88008b80 tx=0x7fba88008e90 comp rx=0 tx=0).stop 2024-05-08T08:27:39.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/2550948077 shutdown_connections 2024-05-08T08:27:39.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c0474ef00 0x563c047512f0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c0473f1c0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735490 0x563c047418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/2550948077 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 0x563c0473ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/2550948077 >> 172.21.15.70:0/2550948077 conn(0x563c04663c60 msgr2=0x563c0472a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:39.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.900+0000 7fba77400700 0 client.18084 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:27:39.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.901+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/2550948077 shutdown_connections 2024-05-08T08:27:39.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.901+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/2550948077 wait complete. 2024-05-08T08:27:39.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.901+0000 7fbaa27b6b80 20 client.18084 trim_cache size 0 max 16384 2024-05-08T08:27:39.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.922+0000 7fbaa27b6b80 1 Processor -- start 2024-05-08T08:27:39.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.922+0000 7fbaa27b6b80 1 -- start start 2024-05-08T08:27:39.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735490 0x563c0474b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 0x563c0473e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c04740280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba901b4030 con 0x563c0473aec0 2024-05-08T08:27:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba901b18c0 con 0x563c04735490 2024-05-08T08:27:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fba901af730 con 0x563c04735e50 2024-05-08T08:27:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fba95e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c04740280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fba95e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c04740280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39626/0 (socket says 172.21.15.70:39626) 2024-05-08T08:27:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fba95e00700 1 -- 172.21.15.70:0/623426532 learned_addr learned my addr 172.21.15.70:0/623426532 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:27:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fba94a00700 1 --2- 172.21.15.70:0/623426532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 0x563c0473e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.923+0000 7fba95400700 1 --2- 172.21.15.70:0/623426532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735490 0x563c0474b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.924+0000 7fba95e00700 1 -- 172.21.15.70:0/623426532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 msgr2=0x563c0473e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:27:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.924+0000 7fba95e00700 1 --2- 172.21.15.70:0/623426532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 0x563c0473e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.924+0000 7fba95e00700 1 -- 172.21.15.70:0/623426532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735490 msgr2=0x563c0474b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:27:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.924+0000 7fba95e00700 1 --2- 172.21.15.70:0/623426532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735490 0x563c0474b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.924+0000 7fba95e00700 1 -- 172.21.15.70:0/623426532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c0472c5a0 con 0x563c0473aec0 2024-05-08T08:27:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.924+0000 7fba95e00700 1 --2- 172.21.15.70:0/623426532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c04740280 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fba88015ce0 tx=0x7fba88007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8582611ecf6502ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:27:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.925+0000 7fba82000700 1 -- 172.21.15.70:0/623426532 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88007ac0 con 0x563c0473aec0 2024-05-08T08:27:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.925+0000 7fba82000700 1 -- 172.21.15.70:0/623426532 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba8800fdb0 con 0x563c0473aec0 2024-05-08T08:27:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.925+0000 7fba82000700 1 -- 172.21.15.70:0/623426532 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88015880 con 0x563c0473aec0 2024-05-08T08:27:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.925+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/623426532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 msgr2=0x563c04740280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.925+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/623426532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c04740280 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fba88015ce0 tx=0x7fba88007800 comp rx=0 tx=0).stop 2024-05-08T08:27:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.926+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/623426532 shutdown_connections 2024-05-08T08:27:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.926+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/623426532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c0473aec0 0x563c04740280 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.926+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/623426532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735490 0x563c0474b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.926+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/623426532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c04735e50 0x563c0473e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.926+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/623426532 >> 172.21.15.70:0/623426532 conn(0x563c04663c60 msgr2=0x563c04734d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.926+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/623426532 shutdown_connections 2024-05-08T08:27:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.926+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/623426532 wait complete. 2024-05-08T08:27:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.926+0000 7fbaa27b6b80 1 -- start start 2024-05-08T08:27:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.926+0000 7fbaa27b6b80 1 Processor -- start 2024-05-08T08:27:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.927+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04747830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.927+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 0x563c04746310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.927+0000 7fbaa27b6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c0473aec0 0x563c04746850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.927+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba901afd80 con 0x563c04735490 2024-05-08T08:27:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.927+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fba901b11f0 con 0x563c04735e50 2024-05-08T08:27:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.927+0000 7fbaa27b6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fba901b0450 con 0x563c0473aec0 2024-05-08T08:27:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.927+0000 7fbaa27b6b80 10 client.0 _ll_register_callbacks cb 0x563c0462ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.927+0000 7fba95400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04747830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.928+0000 7fba95400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04747830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39638/0 (socket says 172.21.15.70:39638) 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.928+0000 7fba95400700 1 -- 172.21.15.70:0/44536613 learned_addr learned my addr 172.21.15.70:0/44536613 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.928+0000 7fba94a00700 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 0x563c04746310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.928+0000 7fba95e00700 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c0473aec0 0x563c04746850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.928+0000 7fba95400700 1 -- 172.21.15.70:0/44536613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c0473aec0 msgr2=0x563c04746850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.928+0000 7fba95400700 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c0473aec0 0x563c04746850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.928+0000 7fba95400700 1 -- 172.21.15.70:0/44536613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 msgr2=0x563c04746310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.928+0000 7fba95400700 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 0x563c04746310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.928+0000 7fba95400700 1 -- 172.21.15.70:0/44536613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c0472c980 con 0x563c04735490 2024-05-08T08:27:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.929+0000 7fba95400700 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04747830 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fba8400b590 tx=0x7fba840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6c60f122f36e58 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:27:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.929+0000 7fba77400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.929+0000 7fba77400700 1 -- 172.21.15.70:0/44536613 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84011c80 con 0x563c04735490 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.929+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/44536613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba8800fdb0 con 0x563c04735490 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.929+0000 7fba77400700 1 -- 172.21.15.70:0/44536613 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(279..279 src has 1..279) ==== 9583+0+0 (secure 0 0 0) 0x7fba84004830 con 0x563c04735490 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.929+0000 7fba77400700 1 -- 172.21.15.70:0/44536613 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fba84039050 con 0x563c04735490 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.929+0000 7fbaa27b6b80 10 client.18090 fetch_fsmap learned FSMap version 42 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.929+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/44536613 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563c047ba5f0 con 0x563c04735490 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.930+0000 7fba77400700 1 -- 172.21.15.70:0/44536613 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba8800fdb0 con 0x563c04735490 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.930+0000 7fba77400700 1 -- 172.21.15.70:0/44536613 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fba840054b0 con 0x563c04735490 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.930+0000 7fbaa27b6b80 10 client.18090 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.930+0000 7fbaa27b6b80 10 client.18090 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.930+0000 7fbaa27b6b80 20 client.18090 populate_metadata read hostname 'smithi070' 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.930+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c047bad10 0x563c047bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.930+0000 7fbaa27b6b80 4 client.18090 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ae0facac", "release": true, "await": true}] 2024-05-08T08:27:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.930+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/44536613 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ae0facac", "release": true, "await": true}) -- 0x563c04695500 con 0x563c047bad10 2024-05-08T08:27:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.931+0000 7fba94a00700 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c047bad10 0x563c047bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:27:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.932+0000 7fba94a00700 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c047bad10 0x563c047bd130 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63f87431094857f4 server_cookie=7ae17df168a2c299 in_seq=0 out_seq=0 2024-05-08T08:27:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:39.932+0000 7fba77400700 10 client.18090 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:27:41.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:41 smithi194 ceph-mon[33679]: pgmap v3221: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2024-05-08T08:27:41.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:41 smithi070 ceph-mon[29591]: pgmap v3221: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2024-05-08T08:27:41.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:41 smithi172 ceph-mon[33377]: pgmap v3221: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.7 KiB/s wr, 7 op/s 2024-05-08T08:27:43.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:43 smithi194 ceph-mon[33679]: pgmap v3222: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:43 smithi070 ceph-mon[29591]: pgmap v3222: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:43.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:43 smithi172 ceph-mon[33377]: pgmap v3222: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:44.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.398+0000 7fba77400700 1 -- 172.21.15.70:0/44536613 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x563c04695500 con 0x563c047bad10 2024-05-08T08:27:44.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.398+0000 7fba77400700 10 client.18090 handle_command_reply: tid=0 2024-05-08T08:27:44.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.398+0000 7fbaa27b6b80 1 client.18090 shutdown 2024-05-08T08:27:44.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.399+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/44536613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 msgr2=0x563c04747830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.399+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04747830 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fba8400b590 tx=0x7fba840047c0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.399+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/44536613 shutdown_connections 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.399+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563c047bad10 0x563c047bd130 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.399+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563c0473aec0 0x563c04746850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.399+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c04735490 0x563c04747830 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.399+0000 7fbaa27b6b80 1 --2- 172.21.15.70:0/44536613 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563c04735e50 0x563c04746310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.399+0000 7fba77400700 0 client.18090 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.399+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/44536613 >> 172.21.15.70:0/44536613 conn(0x563c04663c60 msgr2=0x563c04729fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.400+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/44536613 shutdown_connections 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.400+0000 7fbaa27b6b80 1 -- 172.21.15.70:0/44536613 wait complete. 2024-05-08T08:27:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.400+0000 7fbaa27b6b80 20 client.18090 trim_cache size 0 max 16384 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 228, 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "ae0facac": { 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 228, 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:27:44.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.7, 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:27:44.396 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:27:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 -- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fba780b29f0 msgr2=0x7fba780b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fba780b29f0 0x7fba780b4eb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fba84005950 tx=0x7fba840058e0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 -- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 msgr2=0x7fba901a1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:27:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 0x7fba901a1de0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fba7c000c00 tx=0x7fba7c009f90 comp rx=0 tx=0).stop 2024-05-08T08:27:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 -- 172.21.15.70:0/3841754409 shutdown_connections 2024-05-08T08:27:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fba780b29f0 0x7fba780b4eb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba9010ff00 0x7fba9019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fba900756d0 0x7fba901a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 --2- 172.21.15.70:0/3841754409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba90075ff0 0x7fba901a1de0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:27:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.402+0000 7fba97e00700 1 -- 172.21.15.70:0/3841754409 >> 172.21.15.70:0/3841754409 conn(0x7fba9007a600 msgr2=0x7fba90100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:27:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.403+0000 7fba97e00700 1 -- 172.21.15.70:0/3841754409 shutdown_connections 2024-05-08T08:27:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:27:44.403+0000 7fba97e00700 1 -- 172.21.15.70:0/3841754409 wait complete. 2024-05-08T08:27:45.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:45 smithi070 ceph-mon[29591]: pgmap v3223: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:45.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:45 smithi194 ceph-mon[33679]: pgmap v3223: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:45.607 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ae0facac', seconds elapsed: 79.7 2024-05-08T08:27:45.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:45 smithi172 ceph-mon[33377]: pgmap v3223: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:46.386 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/psscope.o 2024-05-08T08:27:47.470 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/cabletest.o 2024-05-08T08:27:47.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:47 smithi172 ceph-mon[33377]: pgmap v3224: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T08:27:47.486 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/tunnels.o 2024-05-08T08:27:47.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:47 smithi194 ceph-mon[33679]: pgmap v3224: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T08:27:47.517 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/pipe.o 2024-05-08T08:27:47.537 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ip_input.o 2024-05-08T08:27:47.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:47 smithi070 ceph-mon[29591]: pgmap v3224: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T08:27:47.631 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/xfrm/built-in.a 2024-05-08T08:27:47.682 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/netfilter/nf_reject_ipv6.o 2024-05-08T08:27:47.854 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_acct.o 2024-05-08T08:27:48.027 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/pstree.o 2024-05-08T08:27:49.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:49 smithi194 ceph-mon[33679]: pgmap v3225: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:49.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:49 smithi070 ceph-mon[29591]: pgmap v3225: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:49.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:49 smithi172 ceph-mon[33377]: pgmap v3225: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T08:27:51.219 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:51 smithi070 ceph-mon[29591]: pgmap v3226: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 360 KiB/s wr, 16 op/s 2024-05-08T08:27:51.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:51 smithi194 ceph-mon[33679]: pgmap v3226: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 360 KiB/s wr, 16 op/s 2024-05-08T08:27:51.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:51 smithi172 ceph-mon[33377]: pgmap v3226: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 360 KiB/s wr, 16 op/s 2024-05-08T08:27:52.425 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/packet/af_packet.o 2024-05-08T08:27:53.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:53 smithi194 ceph-mon[33679]: pgmap v3227: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 360 KiB/s wr, 14 op/s 2024-05-08T08:27:53.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:53 smithi070 ceph-mon[29591]: pgmap v3227: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 360 KiB/s wr, 14 op/s 2024-05-08T08:27:53.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:53 smithi172 ceph-mon[33377]: pgmap v3227: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 360 KiB/s wr, 14 op/s 2024-05-08T08:27:53.900 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/psutils.o 2024-05-08T08:27:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:55 smithi194 ceph-mon[33679]: pgmap v3228: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 360 KiB/s wr, 14 op/s 2024-05-08T08:27:55.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:55 smithi070 ceph-mon[29591]: pgmap v3228: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 360 KiB/s wr, 14 op/s 2024-05-08T08:27:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:55 smithi172 ceph-mon[33377]: pgmap v3228: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 360 KiB/s wr, 14 op/s 2024-05-08T08:27:57.402 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/namei.o 2024-05-08T08:27:57.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:57 smithi194 ceph-mon[33679]: pgmap v3229: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 406 KiB/s wr, 22 op/s 2024-05-08T08:27:57.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:57 smithi070 ceph-mon[29591]: pgmap v3229: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 406 KiB/s wr, 22 op/s 2024-05-08T08:27:57.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:57 smithi172 ceph-mon[33377]: pgmap v3229: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 350 KiB/s rd, 406 KiB/s wr, 22 op/s 2024-05-08T08:27:59.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:27:59 smithi194 ceph-mon[33679]: pgmap v3230: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 397 KiB/s wr, 19 op/s 2024-05-08T08:27:59.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:27:59 smithi070 ceph-mon[29591]: pgmap v3230: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 397 KiB/s wr, 19 op/s 2024-05-08T08:27:59.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:27:59 smithi172 ceph-mon[33377]: pgmap v3230: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 397 KiB/s wr, 19 op/s 2024-05-08T08:28:00.569 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/pswalk.o 2024-05-08T08:28:00.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/af_inet6.o 2024-05-08T08:28:00.622 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/fec.o 2024-05-08T08:28:00.624 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_seqadj.o 2024-05-08T08:28:00.630 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ip_fragment.o 2024-05-08T08:28:01.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:01 smithi194 ceph-mon[33679]: pgmap v3231: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 747 KiB/s wr, 29 op/s 2024-05-08T08:28:01.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:01 smithi070 ceph-mon[29591]: pgmap v3231: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 747 KiB/s wr, 29 op/s 2024-05-08T08:28:01.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:01 smithi172 ceph-mon[33377]: pgmap v3231: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 677 KiB/s rd, 747 KiB/s wr, 29 op/s 2024-05-08T08:28:01.709 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/netfilter/ip6t_ipv6header.o 2024-05-08T08:28:03.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:03 smithi194 ceph-mon[33679]: pgmap v3232: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 396 KiB/s wr, 18 op/s 2024-05-08T08:28:03.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:03 smithi070 ceph-mon[29591]: pgmap v3232: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 396 KiB/s wr, 18 op/s 2024-05-08T08:28:03.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:03 smithi172 ceph-mon[33377]: pgmap v3232: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 396 KiB/s wr, 18 op/s 2024-05-08T08:28:05.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:05 smithi194 ceph-mon[33679]: pgmap v3233: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 396 KiB/s wr, 18 op/s 2024-05-08T08:28:05.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:05 smithi070 ceph-mon[29591]: pgmap v3233: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 396 KiB/s wr, 18 op/s 2024-05-08T08:28:05.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:05 smithi172 ceph-mon[33377]: pgmap v3233: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 396 KiB/s wr, 18 op/s 2024-05-08T08:28:07.402 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/psxface.o 2024-05-08T08:28:07.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:07 smithi070 ceph-mon[29591]: pgmap v3234: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 625 KiB/s wr, 45 op/s 2024-05-08T08:28:07.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:07 smithi172 ceph-mon[33377]: pgmap v3234: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 625 KiB/s wr, 45 op/s 2024-05-08T08:28:07.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:07 smithi194 ceph-mon[33679]: pgmap v3234: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 625 KiB/s wr, 45 op/s 2024-05-08T08:28:08.257 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/packet/built-in.a 2024-05-08T08:28:08.442 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_proto_icmpv6.o 2024-05-08T08:28:09.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:09 smithi070 ceph-mon[29591]: pgmap v3235: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 579 KiB/s wr, 38 op/s 2024-05-08T08:28:09.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:09 smithi172 ceph-mon[33377]: pgmap v3235: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 579 KiB/s wr, 38 op/s 2024-05-08T08:28:09.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:09 smithi194 ceph-mon[33679]: pgmap v3235: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 579 KiB/s wr, 38 op/s 2024-05-08T08:28:10.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:10 smithi070 ceph-mon[29591]: pgmap v3236: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 941 KiB/s wr, 50 op/s 2024-05-08T08:28:10.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:10 smithi070 ceph-mon[29591]: osdmap e280: 12 total, 12 up, 12 in 2024-05-08T08:28:10.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:10 smithi172 ceph-mon[33377]: pgmap v3236: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 941 KiB/s wr, 50 op/s 2024-05-08T08:28:10.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:10 smithi172 ceph-mon[33377]: osdmap e280: 12 total, 12 up, 12 in 2024-05-08T08:28:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:10 smithi194 ceph-mon[33679]: pgmap v3236: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 941 KiB/s wr, 50 op/s 2024-05-08T08:28:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:10 smithi194 ceph-mon[33679]: osdmap e280: 12 total, 12 up, 12 in 2024-05-08T08:28:12.041 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fcntl.o 2024-05-08T08:28:12.503 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/eeprom.o 2024-05-08T08:28:12.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:12 smithi194 ceph-mon[33679]: pgmap v3238: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 710 KiB/s wr, 48 op/s 2024-05-08T08:28:12.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:12 smithi070 ceph-mon[29591]: pgmap v3238: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 710 KiB/s wr, 48 op/s 2024-05-08T08:28:12.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:12 smithi172 ceph-mon[33377]: pgmap v3238: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 710 KiB/s wr, 48 op/s 2024-05-08T08:28:13.703 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ip_forward.o 2024-05-08T08:28:13.733 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsaddr.o 2024-05-08T08:28:14.471 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/netfilter/ip6t_REJECT.o 2024-05-08T08:28:14.663 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_netlink.o 2024-05-08T08:28:14.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:14 smithi194 ceph-mon[33679]: pgmap v3239: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 710 KiB/s wr, 48 op/s 2024-05-08T08:28:14.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:14 smithi070 ceph-mon[29591]: pgmap v3239: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 710 KiB/s wr, 48 op/s 2024-05-08T08:28:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:14 smithi172 ceph-mon[33377]: pgmap v3239: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 710 KiB/s wr, 48 op/s 2024-05-08T08:28:15.268 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_ftp.o 2024-05-08T08:28:16.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:16 smithi194 ceph-mon[33679]: pgmap v3240: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 718 KiB/s wr, 29 op/s 2024-05-08T08:28:16.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:16 smithi070 ceph-mon[29591]: pgmap v3240: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 718 KiB/s wr, 29 op/s 2024-05-08T08:28:16.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:16 smithi172 ceph-mon[33377]: pgmap v3240: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 718 KiB/s wr, 29 op/s 2024-05-08T08:28:18.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:18 smithi194 ceph-mon[33679]: pgmap v3241: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 718 KiB/s wr, 29 op/s 2024-05-08T08:28:18.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:18 smithi070 ceph-mon[29591]: pgmap v3241: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 718 KiB/s wr, 29 op/s 2024-05-08T08:28:18.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:18 smithi172 ceph-mon[33377]: pgmap v3241: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 718 KiB/s wr, 29 op/s 2024-05-08T08:28:19.726 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rscalc.o 2024-05-08T08:28:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:20 smithi070 ceph-mon[29591]: osdmap e281: 12 total, 12 up, 12 in 2024-05-08T08:28:20.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:20 smithi070 ceph-mon[29591]: pgmap v3243: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 786 KiB/s wr, 35 op/s 2024-05-08T08:28:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:20 smithi172 ceph-mon[33377]: osdmap e281: 12 total, 12 up, 12 in 2024-05-08T08:28:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:20 smithi172 ceph-mon[33377]: pgmap v3243: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 786 KiB/s wr, 35 op/s 2024-05-08T08:28:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:20 smithi194 ceph-mon[33679]: osdmap e281: 12 total, 12 up, 12 in 2024-05-08T08:28:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:20 smithi194 ceph-mon[33679]: pgmap v3243: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 786 KiB/s wr, 35 op/s 2024-05-08T08:28:22.153 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/anycast.o 2024-05-08T08:28:22.231 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/ioctl.o 2024-05-08T08:28:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:22 smithi194 ceph-mon[33679]: pgmap v3244: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 719 KiB/s wr, 32 op/s 2024-05-08T08:28:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:22 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:28:22.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:22 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:22.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:22 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:22 smithi070 ceph-mon[29591]: pgmap v3244: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 719 KiB/s wr, 32 op/s 2024-05-08T08:28:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:22 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:28:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:22 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:22 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:22.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:22 smithi172 ceph-mon[33377]: pgmap v3244: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 719 KiB/s wr, 32 op/s 2024-05-08T08:28:22.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:22 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:28:22.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:22 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:22.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:22 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:23.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:23.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:23.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:23.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:24.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:24.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:24.125 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/stats.o 2024-05-08T08:28:24.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:24 smithi070 ceph-mon[29591]: pgmap v3245: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 719 KiB/s wr, 32 op/s 2024-05-08T08:28:24.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:24 smithi172 ceph-mon[33377]: pgmap v3245: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 719 KiB/s wr, 32 op/s 2024-05-08T08:28:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:24 smithi194 ceph-mon[33679]: pgmap v3245: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 719 KiB/s wr, 32 op/s 2024-05-08T08:28:26.447 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rscreate.o 2024-05-08T08:28:26.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:26 smithi070 ceph-mon[29591]: pgmap v3246: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 584 KiB/s wr, 27 op/s 2024-05-08T08:28:26.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:26 smithi172 ceph-mon[33377]: pgmap v3246: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 584 KiB/s wr, 27 op/s 2024-05-08T08:28:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:26 smithi194 ceph-mon[33679]: pgmap v3246: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 584 KiB/s wr, 27 op/s 2024-05-08T08:28:27.875 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/ipv6/netfilter/built-in.a 2024-05-08T08:28:27.892 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ip_options.o 2024-05-08T08:28:28.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:28.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:28.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:28.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:28.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:28.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:28.615 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsdumpinfo.o 2024-05-08T08:28:29.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:29 smithi070 ceph-mon[29591]: pgmap v3247: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 584 KiB/s wr, 27 op/s 2024-05-08T08:28:29.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:28:29.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:28:29.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:29.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:29 smithi172 ceph-mon[33377]: pgmap v3247: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 584 KiB/s wr, 27 op/s 2024-05-08T08:28:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:28:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:28:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:29.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:29 smithi194 ceph-mon[33679]: pgmap v3247: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 584 KiB/s wr, 27 op/s 2024-05-08T08:28:29.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:28:29.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:28:29.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:28:29.713 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsinfo.o 2024-05-08T08:28:29.733 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_irc.o 2024-05-08T08:28:31.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:31 smithi070 ceph-mon[29591]: pgmap v3248: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 615 KiB/s wr, 24 op/s 2024-05-08T08:28:31.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:31 smithi172 ceph-mon[33377]: pgmap v3248: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 615 KiB/s wr, 24 op/s 2024-05-08T08:28:31.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:31 smithi194 ceph-mon[33679]: pgmap v3248: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 615 KiB/s wr, 24 op/s 2024-05-08T08:28:33.137 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/readdir.o 2024-05-08T08:28:33.145 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ip6_output.o 2024-05-08T08:28:33.337 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-08T08:28:33.338 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:28:33.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:33 smithi070 ceph-mon[29591]: pgmap v3249: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 517 KiB/s wr, 20 op/s 2024-05-08T08:28:33.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:33 smithi172 ceph-mon[33377]: pgmap v3249: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 517 KiB/s wr, 20 op/s 2024-05-08T08:28:33.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:33 smithi194 ceph-mon[33679]: pgmap v3249: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 517 KiB/s wr, 20 op/s 2024-05-08T08:28:33.917 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:28:34.560 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ip_output.o 2024-05-08T08:28:35.074 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ip_sockglue.o 2024-05-08T08:28:35.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:35 smithi070 ceph-mon[29591]: pgmap v3250: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 517 KiB/s wr, 20 op/s 2024-05-08T08:28:35.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:35 smithi172 ceph-mon[33377]: pgmap v3250: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 517 KiB/s wr, 20 op/s 2024-05-08T08:28:35.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:35 smithi194 ceph-mon[33679]: pgmap v3250: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 517 KiB/s wr, 20 op/s 2024-05-08T08:28:36.274 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsio.o 2024-05-08T08:28:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.364+0000 7f1397e00700 1 -- 172.21.15.70:0/3621546351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13981033d0 msgr2=0x7f1398103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.364+0000 7f1397e00700 1 --2- 172.21.15.70:0/3621546351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13981033d0 0x7f1398103850 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f1384009990 tx=0x7f1384009ca0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.365+0000 7f1397e00700 1 -- 172.21.15.70:0/3621546351 shutdown_connections 2024-05-08T08:28:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.365+0000 7f1397e00700 1 --2- 172.21.15.70:0/3621546351 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1398103d90 0x7f13981102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.365+0000 7f1397e00700 1 --2- 172.21.15.70:0/3621546351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1398109460 0x7f1398109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.365+0000 7f1397e00700 1 --2- 172.21.15.70:0/3621546351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13981033d0 0x7f1398103850 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.365+0000 7f1397e00700 1 -- 172.21.15.70:0/3621546351 >> 172.21.15.70:0/3621546351 conn(0x7f13980fef20 msgr2=0x7f1398101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:28:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.365+0000 7f1397e00700 1 -- 172.21.15.70:0/3621546351 shutdown_connections 2024-05-08T08:28:36.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.365+0000 7f1397e00700 1 -- 172.21.15.70:0/3621546351 wait complete. 2024-05-08T08:28:36.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.367+0000 7f1397e00700 1 Processor -- start 2024-05-08T08:28:36.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.367+0000 7f1397e00700 1 -- start start 2024-05-08T08:28:36.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.367+0000 7f1397e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13981033d0 0x7f13981a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:36.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.368+0000 7f1397e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1398103d90 0x7f13981a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:36.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.368+0000 7f1397e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1398109460 0x7f139810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:36.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.368+0000 7f1397e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1398113490 con 0x7f1398109460 2024-05-08T08:28:36.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.368+0000 7f1397e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1398113310 con 0x7f13981033d0 2024-05-08T08:28:36.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.368+0000 7f1397e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1398113610 con 0x7f1398103d90 2024-05-08T08:28:36.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.368+0000 7f1396a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13981033d0 0x7f13981a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:36.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.368+0000 7f1396a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13981033d0 0x7f13981a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:49860/0 (socket says 172.21.15.70:49860) 2024-05-08T08:28:36.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.368+0000 7f1396a00700 1 -- 172.21.15.70:0/4260801720 learned_addr learned my addr 172.21.15.70:0/4260801720 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:28:36.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.369+0000 7f1396000700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1398103d90 0x7f13981a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:36.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.369+0000 7f1397400700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1398109460 0x7f139810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:36.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.369+0000 7f1396a00700 1 -- 172.21.15.70:0/4260801720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1398103d90 msgr2=0x7f13981a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:36.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.369+0000 7f1396a00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1398103d90 0x7f13981a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.369+0000 7f1396a00700 1 -- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1398109460 msgr2=0x7f139810e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:36.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.369+0000 7f1396a00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1398109460 0x7f139810e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.369+0000 7f1396a00700 1 -- 172.21.15.70:0/4260801720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f139810ee70 con 0x7f13981033d0 2024-05-08T08:28:36.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.369+0000 7f1397400700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1398109460 0x7f139810e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:28:36.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.370+0000 7f1396a00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13981033d0 0x7f13981a06b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f138800d980 tx=0x7f138800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:28:36.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.370+0000 7f139ca00700 1 -- 172.21.15.70:0/4260801720 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388017070 con 0x7f13981033d0 2024-05-08T08:28:36.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.371+0000 7f139ca00700 1 -- 172.21.15.70:0/4260801720 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1388005020 con 0x7f13981033d0 2024-05-08T08:28:36.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.371+0000 7f139ca00700 1 -- 172.21.15.70:0/4260801720 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1388009ab0 con 0x7f13981033d0 2024-05-08T08:28:36.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.371+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f139810f160 con 0x7f13981033d0 2024-05-08T08:28:36.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.371+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f139819c260 con 0x7f13981033d0 2024-05-08T08:28:36.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.372+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1398104b10 con 0x7f13981033d0 2024-05-08T08:28:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.377+0000 7f139ca00700 1 -- 172.21.15.70:0/4260801720 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f13880051d0 con 0x7f13981033d0 2024-05-08T08:28:36.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.379+0000 7f139ca00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f137c0b2a70 0x7f137c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:36.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.379+0000 7f139ca00700 1 -- 172.21.15.70:0/4260801720 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(281..281 src has 1..281) ==== 9583+0+0 (secure 0 0 0) 0x7f13880e2c80 con 0x7f13981033d0 2024-05-08T08:28:36.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.379+0000 7f1396000700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f137c0b2a70 0x7f137c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:36.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.380+0000 7f1396000700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f137c0b2a70 0x7f137c0b4f30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1398198e50 tx=0x7f138400b540 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:28:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.386+0000 7f139ca00700 1 -- 172.21.15.70:0/4260801720 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1388020020 con 0x7f13981033d0 2024-05-08T08:28:36.606 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/phc_vclocks.o 2024-05-08T08:28:36.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.870+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f139819c510 con 0x7f13981033d0 2024-05-08T08:28:36.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.872+0000 7f139ca00700 1 -- 172.21.15.70:0/4260801720 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f13880aa2c0 con 0x7f13981033d0 2024-05-08T08:28:36.866 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:28:36.866 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:28:36.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f137c0b2a70 msgr2=0x7f137c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:36.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f137c0b2a70 0x7f137c0b4f30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1398198e50 tx=0x7f138400b540 comp rx=0 tx=0).stop 2024-05-08T08:28:36.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13981033d0 msgr2=0x7f13981a06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13981033d0 0x7f13981a06b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f138800d980 tx=0x7f138800dc90 comp rx=0 tx=0).stop 2024-05-08T08:28:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 shutdown_connections 2024-05-08T08:28:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f137c0b2a70 0x7f137c0b4f30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1398109460 0x7f139810e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f13981033d0 0x7f13981a06b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 --2- 172.21.15.70:0/4260801720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1398103d90 0x7f13981a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.876+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 >> 172.21.15.70:0/4260801720 conn(0x7f13980fef20 msgr2=0x7f13980756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:28:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.877+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 shutdown_connections 2024-05-08T08:28:36.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:36.877+0000 7f1397e00700 1 -- 172.21.15.70:0/4260801720 wait complete. 2024-05-08T08:28:36.871 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:28:37.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:37 smithi070 ceph-mon[29591]: pgmap v3251: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 616 KiB/s wr, 29 op/s 2024-05-08T08:28:37.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:37 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4260801720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:28:37.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:37 smithi172 ceph-mon[33377]: pgmap v3251: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 616 KiB/s wr, 29 op/s 2024-05-08T08:28:37.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:37 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4260801720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:28:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:37 smithi194 ceph-mon[33679]: pgmap v3251: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 567 KiB/s rd, 616 KiB/s wr, 29 op/s 2024-05-08T08:28:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:37 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4260801720' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:28:39.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:39 smithi070 ceph-mon[29591]: pgmap v3252: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 493 KiB/s wr, 21 op/s 2024-05-08T08:28:39.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:39 smithi172 ceph-mon[33377]: pgmap v3252: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 493 KiB/s wr, 21 op/s 2024-05-08T08:28:39.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:39 smithi194 ceph-mon[33679]: pgmap v3252: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 493 KiB/s wr, 21 op/s 2024-05-08T08:28:40.801 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-05-08T08:28:40.801 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-05-08T08:28:41.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:41 smithi070 ceph-mon[29591]: pgmap v3253: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 731 KiB/s wr, 29 op/s 2024-05-08T08:28:41.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:41 smithi172 ceph-mon[33377]: pgmap v3253: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 731 KiB/s wr, 29 op/s 2024-05-08T08:28:41.427 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:28:41.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:41 smithi194 ceph-mon[33679]: pgmap v3253: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 686 KiB/s rd, 731 KiB/s wr, 29 op/s 2024-05-08T08:28:43.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:43 smithi070 ceph-mon[29591]: pgmap v3254: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 338 KiB/s wr, 16 op/s 2024-05-08T08:28:43.119 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/mm.o 2024-05-08T08:28:43.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:43 smithi172 ceph-mon[33377]: pgmap v3254: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 338 KiB/s wr, 16 op/s 2024-05-08T08:28:43.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:43 smithi194 ceph-mon[33679]: pgmap v3254: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 338 KiB/s wr, 16 op/s 2024-05-08T08:28:43.746 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsirq.o 2024-05-08T08:28:44.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.206+0000 7f1d82e00700 1 -- 172.21.15.70:0/1184967395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0779d0 msgr2=0x7f1d7c077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:44.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.206+0000 7f1d82e00700 1 --2- 172.21.15.70:0/1184967395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0779d0 0x7f1d7c077db0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009990 tx=0x7f1d6c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.206+0000 7f1d82e00700 1 -- 172.21.15.70:0/1184967395 shutdown_connections 2024-05-08T08:28:44.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.206+0000 7f1d82e00700 1 --2- 172.21.15.70:0/1184967395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7c114380 0x7f1d7c116770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.206+0000 7f1d82e00700 1 --2- 172.21.15.70:0/1184967395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c0779d0 0x7f1d7c077db0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.206+0000 7f1d82e00700 1 --2- 172.21.15.70:0/1184967395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7c0782f0 0x7f1d7c113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.206+0000 7f1d82e00700 1 -- 172.21.15.70:0/1184967395 >> 172.21.15.70:0/1184967395 conn(0x7f1d7c1011d0 msgr2=0x7f1d7c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:28:44.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.206+0000 7f1d82e00700 1 -- 172.21.15.70:0/1184967395 shutdown_connections 2024-05-08T08:28:44.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.206+0000 7f1d82e00700 1 -- 172.21.15.70:0/1184967395 wait complete. 2024-05-08T08:28:44.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.208+0000 7f1d82e00700 1 Processor -- start 2024-05-08T08:28:44.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.208+0000 7f1d82e00700 1 -- start start 2024-05-08T08:28:44.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.208+0000 7f1d82e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7c0779d0 0x7f1d7c1a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.208+0000 7f1d82e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7c0782f0 0x7f1d7c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.208+0000 7f1d82e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c114380 0x7f1d7c1a49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.208+0000 7f1d82e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c119c00 con 0x7f1d7c114380 2024-05-08T08:28:44.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.208+0000 7f1d82e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c119a80 con 0x7f1d7c0782f0 2024-05-08T08:28:44.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.208+0000 7f1d82e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c119d80 con 0x7f1d7c0779d0 2024-05-08T08:28:44.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.209+0000 7f1d80e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c114380 0x7f1d7c1a49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.209+0000 7f1d80e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c114380 0x7f1d7c1a49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53916/0 (socket says 172.21.15.70:53916) 2024-05-08T08:28:44.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.209+0000 7f1d80e00700 1 -- 172.21.15.70:0/3674580090 learned_addr learned my addr 172.21.15.70:0/3674580090 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:28:44.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.209+0000 7f1d7be00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7c0779d0 0x7f1d7c1a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.209+0000 7f1d7b400700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7c0782f0 0x7f1d7c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.210+0000 7f1d7be00700 1 -- 172.21.15.70:0/3674580090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7c0782f0 msgr2=0x7f1d7c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:44.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.210+0000 7f1d7be00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7c0782f0 0x7f1d7c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.210+0000 7f1d7be00700 1 -- 172.21.15.70:0/3674580090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c114380 msgr2=0x7f1d7c1a49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:44.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.210+0000 7f1d7be00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c114380 0x7f1d7c1a49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.210+0000 7f1d7be00700 1 -- 172.21.15.70:0/3674580090 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7c1a50e0 con 0x7f1d7c0779d0 2024-05-08T08:28:44.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.211+0000 7f1d7be00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7c0779d0 0x7f1d7c1a00d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0098e0 tx=0x7f1d6c0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:28:44.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.211+0000 7f1d78c00700 1 -- 172.21.15.70:0/3674580090 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c026070 con 0x7f1d7c0779d0 2024-05-08T08:28:44.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.211+0000 7f1d78c00700 1 -- 172.21.15.70:0/3674580090 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d6c00fb00 con 0x7f1d7c0779d0 2024-05-08T08:28:44.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.211+0000 7f1d82e00700 1 -- 172.21.15.70:0/3674580090 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7c1a5370 con 0x7f1d7c0779d0 2024-05-08T08:28:44.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.212+0000 7f1d82e00700 1 -- 172.21.15.70:0/3674580090 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7c1acc50 con 0x7f1d7c0779d0 2024-05-08T08:28:44.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.212+0000 7f1d78c00700 1 -- 172.21.15.70:0/3674580090 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c021a30 con 0x7f1d7c0779d0 2024-05-08T08:28:44.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.218+0000 7f1d78c00700 1 -- 172.21.15.70:0/3674580090 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1d6c005080 con 0x7f1d7c0779d0 2024-05-08T08:28:44.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.220+0000 7f1d78c00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d600b2b20 0x7f1d600b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.220+0000 7f1d78c00700 1 -- 172.21.15.70:0/3674580090 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(281..281 src has 1..281) ==== 9583+0+0 (secure 0 0 0) 0x7f1d6c0e3dc0 con 0x7f1d7c0779d0 2024-05-08T08:28:44.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.220+0000 7f1d7b400700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d600b2b20 0x7f1d600b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.738+0000 7f1d7b400700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d600b2b20 0x7f1d600b4fe0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c104830 tx=0x7f1d6800b410 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:28:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.741+0000 7f1d8d740b80 1 Processor -- start 2024-05-08T08:28:44.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.741+0000 7f1d8d740b80 1 -- start start 2024-05-08T08:28:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.741+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b336240 0x55818b336620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.742+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b330c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.742+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b3311d0 0x55818b33d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.742+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55818b282bb0 con 0x55818b336240 2024-05-08T08:28:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.742+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55818b2208f0 con 0x55818b3311d0 2024-05-08T08:28:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.742+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55818b27eb70 con 0x55818b330810 2024-05-08T08:28:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.742+0000 7f1d80e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b3311d0 0x55818b33d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.742+0000 7f1d7be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b336240 0x55818b336620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.742+0000 7f1d7be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b336240 0x55818b336620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53932/0 (socket says 172.21.15.70:53932) 2024-05-08T08:28:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.742+0000 7f1d7be00700 1 -- 172.21.15.70:0/4135271387 learned_addr learned my addr 172.21.15.70:0/4135271387 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:28:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.743+0000 7f1d7b400700 1 --2- 172.21.15.70:0/4135271387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b330c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.743+0000 7f1d7be00700 1 -- 172.21.15.70:0/4135271387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 msgr2=0x55818b330c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:28:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.743+0000 7f1d7be00700 1 --2- 172.21.15.70:0/4135271387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b330c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.743+0000 7f1d7be00700 1 -- 172.21.15.70:0/4135271387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b3311d0 msgr2=0x55818b33d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:28:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.743+0000 7f1d7be00700 1 --2- 172.21.15.70:0/4135271387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b3311d0 0x55818b33d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.743+0000 7f1d7be00700 1 -- 172.21.15.70:0/4135271387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55818b1cfa60 con 0x55818b336240 2024-05-08T08:28:44.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.743+0000 7f1d7be00700 1 --2- 172.21.15.70:0/4135271387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b336240 0x55818b336620 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c005f50 tx=0x7f1d6c009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f129e2a225183256 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:28:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.744+0000 7f1d71600700 1 -- 172.21.15.70:0/4135271387 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0c2020 con 0x55818b336240 2024-05-08T08:28:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.744+0000 7f1d71600700 1 -- 172.21.15.70:0/4135271387 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d6c0b3430 con 0x55818b336240 2024-05-08T08:28:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.744+0000 7f1d71600700 1 -- 172.21.15.70:0/4135271387 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00fcb0 con 0x55818b336240 2024-05-08T08:28:44.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.745+0000 7f1d8d740b80 1 -- 172.21.15.70:0/4135271387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b336240 msgr2=0x55818b336620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.745+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/4135271387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b336240 0x55818b336620 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c005f50 tx=0x7f1d6c009640 comp rx=0 tx=0).stop 2024-05-08T08:28:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.745+0000 7f1d8d740b80 1 -- 172.21.15.70:0/4135271387 shutdown_connections 2024-05-08T08:28:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.745+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/4135271387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b3311d0 0x55818b33d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.745+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/4135271387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b336240 0x55818b336620 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.745+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/4135271387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b330c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.745+0000 7f1d8d740b80 1 -- 172.21.15.70:0/4135271387 >> 172.21.15.70:0/4135271387 conn(0x55818b2a8860 msgr2=0x55818b32b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:28:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.746+0000 7f1d8d740b80 1 -- 172.21.15.70:0/4135271387 shutdown_connections 2024-05-08T08:28:44.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.746+0000 7f1d8d740b80 1 -- 172.21.15.70:0/4135271387 wait complete. 2024-05-08T08:28:44.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.746+0000 7f1d8d740b80 1 -- start start 2024-05-08T08:28:44.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.747+0000 7f1d8d740b80 1 Processor -- start 2024-05-08T08:28:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.748+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b33cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.748+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b3311d0 0x55818b33a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.748+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b33a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.749+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55818b336d50 con 0x55818b3311d0 2024-05-08T08:28:44.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.749+0000 7f1d7be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b33cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.749+0000 7f1d7be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b33cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:36768/0 (socket says 172.21.15.70:36768) 2024-05-08T08:28:44.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.749+0000 7f1d7be00700 1 -- 172.21.15.70:0/1440474216 learned_addr learned my addr 172.21.15.70:0/1440474216 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:28:44.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.749+0000 7f1d7b400700 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b3311d0 0x55818b33a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.750+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55818b1e8cb0 con 0x55818b336240 2024-05-08T08:28:44.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.750+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55818b33d540 con 0x55818b330810 2024-05-08T08:28:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.750+0000 7f1d80e00700 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b33a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.750+0000 7f1d8d740b80 10 client.0 _ll_register_callbacks cb 0x55818b229e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:28:44.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.751+0000 7f1d7b400700 1 -- 172.21.15.70:0/1440474216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 msgr2=0x55818b33cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:28:44.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.751+0000 7f1d7b400700 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b33cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.751+0000 7f1d7b400700 1 -- 172.21.15.70:0/1440474216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 msgr2=0x55818b33a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:28:44.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.751+0000 7f1d7b400700 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b33a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.751+0000 7f1d7b400700 1 -- 172.21.15.70:0/1440474216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55818b2485b0 con 0x55818b3311d0 2024-05-08T08:28:44.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.752+0000 7f1d7b400700 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b3311d0 0x55818b33a080 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f1d68005950 tx=0x7f1d680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0a8dc5eb9b0554 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:28:44.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.752+0000 7f1d66000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:28:44.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.753+0000 7f1d66000700 1 -- 172.21.15.70:0/1440474216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d68004a30 con 0x55818b3311d0 2024-05-08T08:28:44.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.753+0000 7f1d66000700 1 -- 172.21.15.70:0/1440474216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(281..281 src has 1..281) ==== 9583+0+0 (secure 0 0 0) 0x7f1d68004bd0 con 0x55818b3311d0 2024-05-08T08:28:44.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.753+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d6c0b3430 con 0x55818b3311d0 2024-05-08T08:28:44.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.753+0000 7f1d66000700 1 -- 172.21.15.70:0/1440474216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1d68030050 con 0x55818b3311d0 2024-05-08T08:28:44.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.753+0000 7f1d8d740b80 10 client.18108 fetch_fsmap learned FSMap version 42 2024-05-08T08:28:44.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.753+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55818b347ca0 con 0x55818b3311d0 2024-05-08T08:28:44.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.754+0000 7f1d66000700 1 -- 172.21.15.70:0/1440474216 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d6c0b3430 con 0x55818b3311d0 2024-05-08T08:28:44.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.754+0000 7f1d66000700 1 -- 172.21.15.70:0/1440474216 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f1d6801f640 con 0x55818b3311d0 2024-05-08T08:28:44.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.754+0000 7f1d8d740b80 10 client.18108 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:28:44.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.754+0000 7f1d8d740b80 10 client.18108 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:28:44.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.754+0000 7f1d8d740b80 20 client.18108 populate_metadata read hostname 'smithi070' 2024-05-08T08:28:44.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.754+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55818b34a2e0 0x55818b34c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.755+0000 7f1d8d740b80 4 client.18108 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:28:44.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.755+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55818b2fd2d0 con 0x55818b34a2e0 2024-05-08T08:28:44.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.755+0000 7f1d7be00700 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55818b34a2e0 0x55818b34c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.756+0000 7f1d7be00700 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55818b34a2e0 0x55818b34c700 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a76c99a8f810504 server_cookie=90092698516790df in_seq=0 out_seq=0 2024-05-08T08:28:44.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.756+0000 7f1d66000700 10 client.18108 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:28:44.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.757+0000 7f1d66000700 1 -- 172.21.15.70:0/1440474216 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55818b2fd2d0 con 0x55818b34a2e0 2024-05-08T08:28:44.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.757+0000 7f1d66000700 10 client.18108 handle_command_reply: tid=0 2024-05-08T08:28:44.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d8d740b80 1 client.18108 shutdown 2024-05-08T08:28:44.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b3311d0 msgr2=0x55818b33a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:44.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b3311d0 0x55818b33a080 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f1d68005950 tx=0x7f1d680047c0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 shutdown_connections 2024-05-08T08:28:44.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55818b34a2e0 0x55818b34c700 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b33a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b33cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/1440474216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b3311d0 0x55818b33a080 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 >> 172.21.15.70:0/1440474216 conn(0x55818b2a8860 msgr2=0x55818b325bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:28:44.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.758+0000 7f1d66000700 0 client.18108 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:28:44.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.759+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 shutdown_connections 2024-05-08T08:28:44.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.759+0000 7f1d8d740b80 1 -- 172.21.15.70:0/1440474216 wait complete. 2024-05-08T08:28:44.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.759+0000 7f1d8d740b80 20 client.18108 trim_cache size 0 max 16384 2024-05-08T08:28:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.800+0000 7f1d8d740b80 1 Processor -- start 2024-05-08T08:28:44.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.800+0000 7f1d8d740b80 1 -- start start 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.800+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b3358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.800+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b3259b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.801+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 0x55818b352040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.801+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c011930 con 0x55818b346410 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.801+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c00f1c0 con 0x55818b336240 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.801+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c00d030 con 0x55818b330810 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.801+0000 7f1d7b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b3259b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.801+0000 7f1d7b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b3259b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36982/0 (socket says 172.21.15.70:36982) 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.801+0000 7f1d7b400700 1 -- 172.21.15.70:0/3255248866 learned_addr learned my addr 172.21.15.70:0/3255248866 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.801+0000 7f1d80e00700 1 --2- 172.21.15.70:0/3255248866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 0x55818b352040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.802+0000 7f1d7b400700 1 -- 172.21.15.70:0/3255248866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 msgr2=0x55818b3358b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T08:28:44.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.802+0000 7f1d7b400700 1 --2- 172.21.15.70:0/3255248866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b3358b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.802+0000 7f1d7b400700 1 -- 172.21.15.70:0/3255248866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 msgr2=0x55818b352040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:28:44.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.802+0000 7f1d7b400700 1 --2- 172.21.15.70:0/3255248866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 0x55818b352040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.802+0000 7f1d7b400700 1 -- 172.21.15.70:0/3255248866 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55818b327d00 con 0x55818b336240 2024-05-08T08:28:44.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.803+0000 7f1d7b400700 1 --2- 172.21.15.70:0/3255248866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b3259b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1d6801fa10 tx=0x7f1d68004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ea7869af687bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:28:44.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.803+0000 7f1d70c00700 1 -- 172.21.15.70:0/3255248866 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6801f640 con 0x55818b336240 2024-05-08T08:28:44.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.803+0000 7f1d70c00700 1 -- 172.21.15.70:0/3255248866 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d68023070 con 0x55818b336240 2024-05-08T08:28:44.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.803+0000 7f1d70c00700 1 -- 172.21.15.70:0/3255248866 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d680356d0 con 0x55818b336240 2024-05-08T08:28:44.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.804+0000 7f1d8d740b80 1 -- 172.21.15.70:0/3255248866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 msgr2=0x55818b3259b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:28:44.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.804+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/3255248866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b3259b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1d6801fa10 tx=0x7f1d68004740 comp rx=0 tx=0).stop 2024-05-08T08:28:44.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.805+0000 7f1d8d740b80 1 -- 172.21.15.70:0/3255248866 shutdown_connections 2024-05-08T08:28:44.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.805+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/3255248866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 0x55818b352040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.805+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/3255248866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b3358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.805+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/3255248866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b3259b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.805+0000 7f1d8d740b80 1 -- 172.21.15.70:0/3255248866 >> 172.21.15.70:0/3255248866 conn(0x55818b2a8860 msgr2=0x55818b334550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:28:44.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.805+0000 7f1d8d740b80 1 -- 172.21.15.70:0/3255248866 shutdown_connections 2024-05-08T08:28:44.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.805+0000 7f1d8d740b80 1 -- 172.21.15.70:0/3255248866 wait complete. 2024-05-08T08:28:44.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.805+0000 7f1d8d740b80 1 -- start start 2024-05-08T08:28:44.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.806+0000 7f1d8d740b80 1 Processor -- start 2024-05-08T08:28:44.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.806+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b3414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.806+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b341a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.806+0000 7f1d8d740b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 0x55818b341f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.806+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c00d680 con 0x55818b346410 2024-05-08T08:28:44.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.806+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c00eaf0 con 0x55818b336240 2024-05-08T08:28:44.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.806+0000 7f1d8d740b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5c00dd50 con 0x55818b330810 2024-05-08T08:28:44.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.806+0000 7f1d8d740b80 10 client.0 _ll_register_callbacks cb 0x55818b229e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:28:44.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.807+0000 7f1d7b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b341a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.807+0000 7f1d80e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 0x55818b341f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.807+0000 7f1d7b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b341a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36984/0 (socket says 172.21.15.70:36984) 2024-05-08T08:28:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.807+0000 7f1d7b400700 1 -- 172.21.15.70:0/2784959201 learned_addr learned my addr 172.21.15.70:0/2784959201 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:28:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.807+0000 7f1d7be00700 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b3414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.808+0000 7f1d7b400700 1 -- 172.21.15.70:0/2784959201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 msgr2=0x55818b3414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:28:44.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.808+0000 7f1d7b400700 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b3414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.808+0000 7f1d7b400700 1 -- 172.21.15.70:0/2784959201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 msgr2=0x55818b341f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:28:44.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.808+0000 7f1d7b400700 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 0x55818b341f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:28:44.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.808+0000 7f1d7b400700 1 -- 172.21.15.70:0/2784959201 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55818b3b4da0 con 0x55818b336240 2024-05-08T08:28:44.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.808+0000 7f1d80e00700 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 0x55818b341f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:28:44.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.809+0000 7f1d7b400700 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b341a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d68005dd0 tx=0x7f1d6801ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6c1270c2b0cea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:28:44.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.809+0000 7f1d66000700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:28:44.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.809+0000 7f1d66000700 1 -- 172.21.15.70:0/2784959201 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6801e840 con 0x55818b336240 2024-05-08T08:28:44.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.809+0000 7f1d66000700 1 -- 172.21.15.70:0/2784959201 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(281..281 src has 1..281) ==== 9583+0+0 (secure 0 0 0) 0x7f1d68005040 con 0x55818b336240 2024-05-08T08:28:44.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.809+0000 7f1d8d740b80 1 -- 172.21.15.70:0/2784959201 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d68023070 con 0x55818b336240 2024-05-08T08:28:44.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.810+0000 7f1d66000700 1 -- 172.21.15.70:0/2784959201 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f1d6804e050 con 0x55818b336240 2024-05-08T08:28:44.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.810+0000 7f1d8d740b80 10 client.36977 fetch_fsmap learned FSMap version 42 2024-05-08T08:28:44.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.810+0000 7f1d8d740b80 1 -- 172.21.15.70:0/2784959201 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55818b3b6080 con 0x55818b336240 2024-05-08T08:28:44.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.810+0000 7f1d66000700 1 -- 172.21.15.70:0/2784959201 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1d68023070 con 0x55818b336240 2024-05-08T08:28:44.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.811+0000 7f1d66000700 1 -- 172.21.15.70:0/2784959201 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f1d68033040 con 0x55818b336240 2024-05-08T08:28:44.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.811+0000 7f1d8d740b80 10 client.36977 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:28:44.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.811+0000 7f1d8d740b80 10 client.36977 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:28:44.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.811+0000 7f1d8d740b80 20 client.36977 populate_metadata read hostname 'smithi070' 2024-05-08T08:28:44.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.811+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55818b3b6770 0x55818b3b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:28:44.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.811+0000 7f1d8d740b80 4 client.36977 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-05-08T08:28:44.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.811+0000 7f1d8d740b80 1 -- 172.21.15.70:0/2784959201 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x55818b290590 con 0x55818b3b6770 2024-05-08T08:28:44.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.811+0000 7f1d7be00700 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55818b3b6770 0x55818b3b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:28:44.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.812+0000 7f1d7be00700 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55818b3b6770 0x55818b3b8b90 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40dfcb10c59b6d69 server_cookie=40c16c75b26b053 in_seq=0 out_seq=0 2024-05-08T08:28:44.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:28:44.812+0000 7f1d66000700 10 client.36977 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:28:45.215 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/select.o 2024-05-08T08:28:45.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:45 smithi070 ceph-mon[29591]: pgmap v3255: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 338 KiB/s wr, 16 op/s 2024-05-08T08:28:45.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:45 smithi172 ceph-mon[33377]: pgmap v3255: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 338 KiB/s wr, 16 op/s 2024-05-08T08:28:45.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:45 smithi194 ceph-mon[33679]: pgmap v3255: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 338 KiB/s wr, 16 op/s 2024-05-08T08:28:46.914 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_conntrack_sip.o 2024-05-08T08:28:47.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:47 smithi070 ceph-mon[29591]: pgmap v3256: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 647 KiB/s wr, 30 op/s 2024-05-08T08:28:47.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:47 smithi172 ceph-mon[33377]: pgmap v3256: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 647 KiB/s wr, 30 op/s 2024-05-08T08:28:47.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:47 smithi194 ceph-mon[33679]: pgmap v3256: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 647 KiB/s wr, 30 op/s 2024-05-08T08:28:49.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:49 smithi070 ceph-mon[29591]: pgmap v3257: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 548 KiB/s wr, 21 op/s 2024-05-08T08:28:49.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:49 smithi172 ceph-mon[33377]: pgmap v3257: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 548 KiB/s wr, 21 op/s 2024-05-08T08:28:49.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:49 smithi194 ceph-mon[33679]: pgmap v3257: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 548 KiB/s wr, 21 op/s 2024-05-08T08:28:50.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:50 smithi070 ceph-mon[29591]: pgmap v3258: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 767 KiB/s wr, 27 op/s 2024-05-08T08:28:50.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:50 smithi172 ceph-mon[33377]: pgmap v3258: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 767 KiB/s wr, 27 op/s 2024-05-08T08:28:50.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:50 smithi194 ceph-mon[33679]: pgmap v3258: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 767 KiB/s wr, 27 op/s 2024-05-08T08:28:52.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:52 smithi194 ceph-mon[33679]: pgmap v3259: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 528 KiB/s wr, 19 op/s 2024-05-08T08:28:52.800 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:52 smithi070 ceph-mon[29591]: pgmap v3259: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 528 KiB/s wr, 19 op/s 2024-05-08T08:28:52.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:52 smithi172 ceph-mon[33377]: pgmap v3259: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 528 KiB/s wr, 19 op/s 2024-05-08T08:28:54.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:54 smithi070 ceph-mon[29591]: pgmap v3260: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 528 KiB/s wr, 19 op/s 2024-05-08T08:28:54.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:54 smithi172 ceph-mon[33377]: pgmap v3260: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 528 KiB/s wr, 19 op/s 2024-05-08T08:28:55.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:54 smithi194 ceph-mon[33679]: pgmap v3260: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 528 KiB/s wr, 19 op/s 2024-05-08T08:28:56.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:56 smithi070 ceph-mon[29591]: pgmap v3261: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 540 KiB/s wr, 24 op/s 2024-05-08T08:28:56.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:56 smithi172 ceph-mon[33377]: pgmap v3261: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 540 KiB/s wr, 24 op/s 2024-05-08T08:28:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:56 smithi194 ceph-mon[33679]: pgmap v3261: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 540 KiB/s wr, 24 op/s 2024-05-08T08:28:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:28:58 smithi070 ceph-mon[29591]: pgmap v3262: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 231 KiB/s wr, 11 op/s 2024-05-08T08:28:58.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:28:58 smithi172 ceph-mon[33377]: pgmap v3262: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 231 KiB/s wr, 11 op/s 2024-05-08T08:28:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:28:58 smithi194 ceph-mon[33679]: pgmap v3262: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 222 KiB/s rd, 231 KiB/s wr, 11 op/s 2024-05-08T08:29:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:00 smithi070 ceph-mon[29591]: pgmap v3263: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 280 KiB/s wr, 14 op/s 2024-05-08T08:29:00.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:00 smithi172 ceph-mon[33377]: pgmap v3263: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 280 KiB/s wr, 14 op/s 2024-05-08T08:29:01.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:00 smithi194 ceph-mon[33679]: pgmap v3263: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 280 KiB/s wr, 14 op/s 2024-05-08T08:29:02.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:02 smithi070 ceph-mon[29591]: pgmap v3264: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-05-08T08:29:02.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:02 smithi172 ceph-mon[33377]: pgmap v3264: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-05-08T08:29:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:02 smithi194 ceph-mon[33679]: pgmap v3264: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-05-08T08:29:04.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:04 smithi070 ceph-mon[29591]: pgmap v3265: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-05-08T08:29:04.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:04 smithi172 ceph-mon[33377]: pgmap v3265: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-05-08T08:29:05.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:04 smithi194 ceph-mon[33679]: pgmap v3265: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-05-08T08:29:06.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:06 smithi070 ceph-mon[29591]: pgmap v3266: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 94 KiB/s wr, 12 op/s 2024-05-08T08:29:06.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:06 smithi172 ceph-mon[33377]: pgmap v3266: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 94 KiB/s wr, 12 op/s 2024-05-08T08:29:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:06 smithi194 ceph-mon[33679]: pgmap v3266: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 94 KiB/s wr, 12 op/s 2024-05-08T08:29:07.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.593+0000 7f1d66000700 1 -- 172.21.15.70:0/2784959201 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55818b290590 con 0x55818b3b6770 2024-05-08T08:29:07.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.593+0000 7f1d66000700 10 client.36977 handle_command_reply: tid=0 2024-05-08T08:29:07.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.593+0000 7f1d8d740b80 1 client.36977 shutdown 2024-05-08T08:29:07.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.593+0000 7f1d8d740b80 1 -- 172.21.15.70:0/2784959201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 msgr2=0x55818b341a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:07.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.594+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b341a30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d68005dd0 tx=0x7f1d6801ebd0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.594+0000 7f1d8d740b80 1 -- 172.21.15.70:0/2784959201 shutdown_connections 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.594+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55818b3b6770 0x55818b3b8b90 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.594+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55818b346410 0x55818b341f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.594+0000 7f1d66000700 0 client.36977 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.594+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55818b330810 0x55818b3414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.594+0000 7f1d8d740b80 1 --2- 172.21.15.70:0/2784959201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55818b336240 0x55818b341a30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.594+0000 7f1d8d740b80 1 -- 172.21.15.70:0/2784959201 >> 172.21.15.70:0/2784959201 conn(0x55818b2a8860 msgr2=0x55818b33b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.595+0000 7f1d8d740b80 1 -- 172.21.15.70:0/2784959201 shutdown_connections 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.595+0000 7f1d8d740b80 1 -- 172.21.15.70:0/2784959201 wait complete. 2024-05-08T08:29:07.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.595+0000 7f1d8d740b80 20 client.36977 trim_cache size 0 max 16384 2024-05-08T08:29:07.589 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:29:07.589 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:29:07.589 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:29:07.589 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 230, 2024-05-08T08:29:07.589 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:29:07.589 INFO:teuthology.orchestra.run.smithi070.stdout: "d8aba1ff": { 2024-05-08T08:29:07.589 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 230, 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:29:07.590 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:07.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:07.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:07.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:07.591 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:07.591 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:29:07.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 -- 172.21.15.70:0/3674580090 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d600b2b20 msgr2=0x7f1d600b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:07.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d600b2b20 0x7f1d600b4fe0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c104830 tx=0x7f1d6800b410 comp rx=0 tx=0).stop 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 -- 172.21.15.70:0/3674580090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7c0779d0 msgr2=0x7f1d7c1a00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7c0779d0 0x7f1d7c1a00d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0098e0 tx=0x7f1d6c0057c0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 -- 172.21.15.70:0/3674580090 shutdown_connections 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1d600b2b20 0x7f1d600b4fe0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d7c114380 0x7f1d7c1a49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d7c0779d0 0x7f1d7c1a00d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 --2- 172.21.15.70:0/3674580090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1d7c0782f0 0x7f1d7c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.597+0000 7f1d82e00700 1 -- 172.21.15.70:0/3674580090 >> 172.21.15.70:0/3674580090 conn(0x7f1d7c1011d0 msgr2=0x7f1d7c1035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.598+0000 7f1d82e00700 1 -- 172.21.15.70:0/3674580090 shutdown_connections 2024-05-08T08:29:07.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:07.598+0000 7f1d82e00700 1 -- 172.21.15.70:0/3674580090 wait complete. 2024-05-08T08:29:08.809 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:08 smithi070 ceph-mon[29591]: pgmap v3267: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 7 op/s 2024-05-08T08:29:08.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:08 smithi172 ceph-mon[33377]: pgmap v3267: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 7 op/s 2024-05-08T08:29:08.988 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd8aba1ff', quiesce took 35.7 seconds. Will release after: 10 2024-05-08T08:29:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:08 smithi194 ceph-mon[33679]: pgmap v3267: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 83 KiB/s wr, 7 op/s 2024-05-08T08:29:10.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:10 smithi070 ceph-mon[29591]: pgmap v3268: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 148 KiB/s wr, 27 op/s 2024-05-08T08:29:10.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:10 smithi172 ceph-mon[33377]: pgmap v3268: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 148 KiB/s wr, 27 op/s 2024-05-08T08:29:11.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:10 smithi194 ceph-mon[33679]: pgmap v3268: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 148 KiB/s wr, 27 op/s 2024-05-08T08:29:12.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:12 smithi070 ceph-mon[29591]: pgmap v3269: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 99 KiB/s wr, 23 op/s 2024-05-08T08:29:12.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:12 smithi172 ceph-mon[33377]: pgmap v3269: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 99 KiB/s wr, 23 op/s 2024-05-08T08:29:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:12 smithi194 ceph-mon[33679]: pgmap v3269: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 99 KiB/s wr, 23 op/s 2024-05-08T08:29:14.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:14 smithi070 ceph-mon[29591]: pgmap v3270: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 99 KiB/s wr, 23 op/s 2024-05-08T08:29:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:14 smithi172 ceph-mon[33377]: pgmap v3270: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 99 KiB/s wr, 23 op/s 2024-05-08T08:29:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:14 smithi194 ceph-mon[33679]: pgmap v3270: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 99 KiB/s wr, 23 op/s 2024-05-08T08:29:16.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:16 smithi070 ceph-mon[29591]: pgmap v3271: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 102 KiB/s wr, 27 op/s 2024-05-08T08:29:16.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:16 smithi070 ceph-mon[29591]: osdmap e282: 12 total, 12 up, 12 in 2024-05-08T08:29:16.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:16 smithi172 ceph-mon[33377]: pgmap v3271: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 102 KiB/s wr, 27 op/s 2024-05-08T08:29:16.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:16 smithi172 ceph-mon[33377]: osdmap e282: 12 total, 12 up, 12 in 2024-05-08T08:29:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:16 smithi194 ceph-mon[33679]: pgmap v3271: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 102 KiB/s wr, 27 op/s 2024-05-08T08:29:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:16 smithi194 ceph-mon[33679]: osdmap e282: 12 total, 12 up, 12 in 2024-05-08T08:29:18.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:18 smithi070 ceph-mon[29591]: pgmap v3273: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 82 KiB/s wr, 27 op/s 2024-05-08T08:29:18.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:18 smithi172 ceph-mon[33377]: pgmap v3273: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 82 KiB/s wr, 27 op/s 2024-05-08T08:29:18.988 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:29:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:18 smithi194 ceph-mon[33679]: pgmap v3273: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 82 KiB/s wr, 27 op/s 2024-05-08T08:29:19.453 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:29:20.792 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:20 smithi070 ceph-mon[29591]: pgmap v3274: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T08:29:20.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:20 smithi172 ceph-mon[33377]: pgmap v3274: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T08:29:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:20 smithi194 ceph-mon[33679]: pgmap v3274: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T08:29:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.826+0000 7ff4c5c00700 1 -- 172.21.15.70:0/3157657969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c0105f90 msgr2=0x7ff4c01124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.826+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/3157657969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c0105f90 0x7ff4c01124a0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff4b800b0a0 tx=0x7ff4b800b3b0 comp rx=0 tx=0).stop 2024-05-08T08:29:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.826+0000 7ff4c5c00700 1 -- 172.21.15.70:0/3157657969 shutdown_connections 2024-05-08T08:29:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.826+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/3157657969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c0105f90 0x7ff4c01124a0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.826+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/3157657969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c010b660 0x7ff4c010ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.826+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/3157657969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c01055d0 0x7ff4c0105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.826+0000 7ff4c5c00700 1 -- 172.21.15.70:0/3157657969 >> 172.21.15.70:0/3157657969 conn(0x7ff4c01010c0 msgr2=0x7ff4c01034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.827+0000 7ff4c5c00700 1 -- 172.21.15.70:0/3157657969 shutdown_connections 2024-05-08T08:29:21.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.827+0000 7ff4c5c00700 1 -- 172.21.15.70:0/3157657969 wait complete. 2024-05-08T08:29:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.828+0000 7ff4c5c00700 1 Processor -- start 2024-05-08T08:29:21.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.829+0000 7ff4c5c00700 1 -- start start 2024-05-08T08:29:21.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.829+0000 7ff4c5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c01055d0 0x7ff4c01a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:21.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.829+0000 7ff4c5c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c0105f90 0x7ff4c01a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:21.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.829+0000 7ff4c5c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c010b660 0x7ff4c019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:21.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.829+0000 7ff4c5c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01156d0 con 0x7ff4c01055d0 2024-05-08T08:29:21.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.829+0000 7ff4c5c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0115550 con 0x7ff4c010b660 2024-05-08T08:29:21.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.829+0000 7ff4c5c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0115850 con 0x7ff4c0105f90 2024-05-08T08:29:21.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4bfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c01055d0 0x7ff4c01a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4bfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c01055d0 0x7ff4c01a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56510/0 (socket says 172.21.15.70:56510) 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4bfe00700 1 -- 172.21.15.70:0/1152658839 learned_addr learned my addr 172.21.15.70:0/1152658839 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4bf400700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c0105f90 0x7ff4c01a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4c5200700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c010b660 0x7ff4c019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4bfe00700 1 -- 172.21.15.70:0/1152658839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c0105f90 msgr2=0x7ff4c01a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4bfe00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c0105f90 0x7ff4c01a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4bfe00700 1 -- 172.21.15.70:0/1152658839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c010b660 msgr2=0x7ff4c019b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4bfe00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c010b660 0x7ff4c019b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4bfe00700 1 -- 172.21.15.70:0/1152658839 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c019c090 con 0x7ff4c01055d0 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.830+0000 7ff4c5200700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c010b660 0x7ff4c019b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.831+0000 7ff4bfe00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c01055d0 0x7ff4c01a1720 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000d980 tx=0x7ff4b000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.831+0000 7ff4bcc00700 1 -- 172.21.15.70:0/1152658839 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0017030 con 0x7ff4c01055d0 2024-05-08T08:29:21.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.831+0000 7ff4bcc00700 1 -- 172.21.15.70:0/1152658839 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff4b00044b0 con 0x7ff4c01055d0 2024-05-08T08:29:21.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.831+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c019c380 con 0x7ff4c01055d0 2024-05-08T08:29:21.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.831+0000 7ff4bcc00700 1 -- 172.21.15.70:0/1152658839 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0003970 con 0x7ff4c01055d0 2024-05-08T08:29:21.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.831+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c01a85f0 con 0x7ff4c01055d0 2024-05-08T08:29:21.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.833+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c006a190 con 0x7ff4c01055d0 2024-05-08T08:29:21.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.836+0000 7ff4bcc00700 1 -- 172.21.15.70:0/1152658839 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff4b001a070 con 0x7ff4c01055d0 2024-05-08T08:29:21.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.838+0000 7ff4bcc00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff4a40b2a70 0x7ff4a40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:21.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.838+0000 7ff4bcc00700 1 -- 172.21.15.70:0/1152658839 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(282..282 src has 1..282) ==== 9671+0+0 (secure 0 0 0) 0x7ff4b00e2870 con 0x7ff4c01055d0 2024-05-08T08:29:21.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.838+0000 7ff4bf400700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff4a40b2a70 0x7ff4a40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:21.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.839+0000 7ff4bf400700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff4a40b2a70 0x7ff4a40b4f30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac005950 tx=0x7ff4ac0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:21.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:21.841+0000 7ff4bcc00700 1 -- 172.21.15.70:0/1152658839 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff4b00a9df0 con 0x7ff4c01055d0 2024-05-08T08:29:22.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.122+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4c019ce10 con 0x7ff4c01055d0 2024-05-08T08:29:22.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.123+0000 7ff4bcc00700 1 -- 172.21.15.70:0/1152658839 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7ff4b00b0e20 con 0x7ff4c01055d0 2024-05-08T08:29:22.115 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:29:22.115 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:29:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff4a40b2a70 msgr2=0x7ff4a40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff4a40b2a70 0x7ff4a40b4f30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac005950 tx=0x7ff4ac0058e0 comp rx=0 tx=0).stop 2024-05-08T08:29:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c01055d0 msgr2=0x7ff4c01a1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c01055d0 0x7ff4c01a1720 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7ff4b000d980 tx=0x7ff4b000dd40 comp rx=0 tx=0).stop 2024-05-08T08:29:22.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 shutdown_connections 2024-05-08T08:29:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff4a40b2a70 0x7ff4a40b4f30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff4c010b660 0x7ff4c019b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff4c01055d0 0x7ff4c01a1720 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 --2- 172.21.15.70:0/1152658839 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4c0105f90 0x7ff4c01a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 >> 172.21.15.70:0/1152658839 conn(0x7ff4c01010c0 msgr2=0x7ff4c01027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 shutdown_connections 2024-05-08T08:29:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:22.126+0000 7ff4c5c00700 1 -- 172.21.15.70:0/1152658839 wait complete. 2024-05-08T08:29:22.119 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:29:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:22 smithi070 ceph-mon[29591]: pgmap v3275: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T08:29:22.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1152658839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:29:22.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:22 smithi172 ceph-mon[33377]: pgmap v3275: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T08:29:22.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:22 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1152658839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:29:22.960 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id d8aba1ff --release --await' 2024-05-08T08:29:22.960 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id d8aba1ff --release --await 2024-05-08T08:29:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:22 smithi194 ceph-mon[33679]: pgmap v3275: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T08:29:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:22 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1152658839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:29:23.400 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:29:24.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:24 smithi070 ceph-mon[29591]: pgmap v3276: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T08:29:24.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:24 smithi070 ceph-mon[29591]: osdmap e283: 12 total, 12 up, 12 in 2024-05-08T08:29:24.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:24 smithi172 ceph-mon[33377]: pgmap v3276: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T08:29:24.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:24 smithi172 ceph-mon[33377]: osdmap e283: 12 total, 12 up, 12 in 2024-05-08T08:29:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:24 smithi194 ceph-mon[33679]: pgmap v3276: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T08:29:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:24 smithi194 ceph-mon[33679]: osdmap e283: 12 total, 12 up, 12 in 2024-05-08T08:29:25.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.913+0000 7fe6bfa00700 1 -- 172.21.15.70:0/2485351807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b81023a0 msgr2=0x7fe6b8102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:25.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.913+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/2485351807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b81023a0 0x7fe6b8102820 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400b0a0 tx=0x7fe6a400b3b0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.913+0000 7fe6bfa00700 1 -- 172.21.15.70:0/2485351807 shutdown_connections 2024-05-08T08:29:25.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.913+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/2485351807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b8102d60 0x7fe6b810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.913+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/2485351807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b8108410 0x7fe6b81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.913+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/2485351807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b81023a0 0x7fe6b8102820 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.913+0000 7fe6bfa00700 1 -- 172.21.15.70:0/2485351807 >> 172.21.15.70:0/2485351807 conn(0x7fe6b8079350 msgr2=0x7fe6b8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:25.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.913+0000 7fe6bfa00700 1 -- 172.21.15.70:0/2485351807 shutdown_connections 2024-05-08T08:29:25.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.913+0000 7fe6bfa00700 1 -- 172.21.15.70:0/2485351807 wait complete. 2024-05-08T08:29:25.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.914+0000 7fe6bfa00700 1 Processor -- start 2024-05-08T08:29:25.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.914+0000 7fe6bfa00700 1 -- start start 2024-05-08T08:29:25.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6bfa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b81023a0 0x7fe6b819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6bfa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b8102d60 0x7fe6b819c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6bfa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b8108410 0x7fe6b81a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6bfa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81124b0 con 0x7fe6b8102d60 2024-05-08T08:29:25.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6bfa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b8112330 con 0x7fe6b81023a0 2024-05-08T08:29:25.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6bfa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b8112630 con 0x7fe6b8108410 2024-05-08T08:29:25.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6afe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b8102d60 0x7fe6b819c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6afe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b8102d60 0x7fe6b819c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56516/0 (socket says 172.21.15.70:56516) 2024-05-08T08:29:25.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6afe00700 1 -- 172.21.15.70:0/3354719942 learned_addr learned my addr 172.21.15.70:0/3354719942 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6bd000700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b81023a0 0x7fe6b819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.915+0000 7fe6bda00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b8108410 0x7fe6b81a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.916+0000 7fe6afe00700 1 -- 172.21.15.70:0/3354719942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b8108410 msgr2=0x7fe6b81a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.916+0000 7fe6afe00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b8108410 0x7fe6b81a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.916+0000 7fe6afe00700 1 -- 172.21.15.70:0/3354719942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b81023a0 msgr2=0x7fe6b819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.916+0000 7fe6afe00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b81023a0 0x7fe6b819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.916+0000 7fe6afe00700 1 -- 172.21.15.70:0/3354719942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b81a0d50 con 0x7fe6b8102d60 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.916+0000 7fe6afe00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b8102d60 0x7fe6b819c280 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400b070 tx=0x7fe6a4004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.916+0000 7fe6b6000700 1 -- 172.21.15.70:0/3354719942 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a4021070 con 0x7fe6b8102d60 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.916+0000 7fe6b6000700 1 -- 172.21.15.70:0/3354719942 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a4007d00 con 0x7fe6b8102d60 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.916+0000 7fe6b6000700 1 -- 172.21.15.70:0/3354719942 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a401d450 con 0x7fe6b8102d60 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.917+0000 7fe6bfa00700 1 -- 172.21.15.70:0/3354719942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b81a0fe0 con 0x7fe6b8102d60 2024-05-08T08:29:25.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.917+0000 7fe6bfa00700 1 -- 172.21.15.70:0/3354719942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b81a88c0 con 0x7fe6b8102d60 2024-05-08T08:29:25.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.920+0000 7fe6b6000700 1 -- 172.21.15.70:0/3354719942 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe6a4004140 con 0x7fe6b8102d60 2024-05-08T08:29:25.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.922+0000 7fe6b6000700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe69c0b29f0 0x7fe69c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.922+0000 7fe6b6000700 1 -- 172.21.15.70:0/3354719942 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(283..283 src has 1..283) ==== 9583+0+0 (secure 0 0 0) 0x7fe6a400f020 con 0x7fe6b8102d60 2024-05-08T08:29:25.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.922+0000 7fe6bd000700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe69c0b29f0 0x7fe69c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.923+0000 7fe6bd000700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe69c0b29f0 0x7fe69c0b4eb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005fd0 tx=0x7fe6a800a560 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:25.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.938+0000 7fe6ca2f2b80 1 Processor -- start 2024-05-08T08:29:25.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.938+0000 7fe6ca2f2b80 1 -- start start 2024-05-08T08:29:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.939+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.939+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86ee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.939+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 0x55b5f86fac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.939+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b5f8640b20 con 0x55b5f86f3ec0 2024-05-08T08:29:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.939+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b5f85de860 con 0x55b5f86eee50 2024-05-08T08:29:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.939+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b5f863cae0 con 0x55b5f86ee490 2024-05-08T08:29:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.939+0000 7fe6bd000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.939+0000 7fe6bd000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56522/0 (socket says 172.21.15.70:56522) 2024-05-08T08:29:25.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.939+0000 7fe6bd000700 1 -- 172.21.15.70:0/3866598203 learned_addr learned my addr 172.21.15.70:0/3866598203 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:29:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6bda00700 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 0x55b5f86fac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6afe00700 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86ee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6bd000700 1 -- 172.21.15.70:0/3866598203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 msgr2=0x55b5f86ee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6bd000700 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86ee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6bd000700 1 -- 172.21.15.70:0/3866598203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 msgr2=0x55b5f86fac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6bd000700 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 0x55b5f86fac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6bd000700 1 -- 172.21.15.70:0/3866598203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f858d9d0 con 0x55b5f86f3ec0 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6bda00700 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 0x55b5f86fac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6afe00700 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86ee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6bd000700 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f42a0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800ec80 tx=0x7fe6a8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad4bbda7da1769c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6ae000700 1 -- 172.21.15.70:0/3866598203 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8021070 con 0x55b5f86f3ec0 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6ae000700 1 -- 172.21.15.70:0/3866598203 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a8010cd0 con 0x55b5f86f3ec0 2024-05-08T08:29:25.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.940+0000 7fe6ae000700 1 -- 172.21.15.70:0/3866598203 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a800f620 con 0x55b5f86f3ec0 2024-05-08T08:29:25.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.941+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3866598203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 msgr2=0x55b5f86f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:25.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.941+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f42a0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800ec80 tx=0x7fe6a8011000 comp rx=0 tx=0).stop 2024-05-08T08:29:25.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.941+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3866598203 shutdown_connections 2024-05-08T08:29:25.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.941+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 0x55b5f86fac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.941+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f42a0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.941+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3866598203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86ee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.941+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3866598203 >> 172.21.15.70:0/3866598203 conn(0x55b5f861cc60 msgr2=0x55b5f86e8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:25.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.942+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3866598203 shutdown_connections 2024-05-08T08:29:25.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.942+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3866598203 wait complete. 2024-05-08T08:29:25.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.942+0000 7fe6ca2f2b80 1 -- start start 2024-05-08T08:29:25.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.943+0000 7fe6ca2f2b80 1 Processor -- start 2024-05-08T08:29:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.943+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86fa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.943+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 0x55b5f86f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.943+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.943+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b5f86fb280 con 0x55b5f86f3ec0 2024-05-08T08:29:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.943+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b5f85a6c20 con 0x55b5f86eee50 2024-05-08T08:29:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.943+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b5f86fb400 con 0x55b5f86ee490 2024-05-08T08:29:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.943+0000 7fe6ca2f2b80 10 client.0 _ll_register_callbacks cb 0x55b5f85e7d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:29:25.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bda00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bda00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56526/0 (socket says 172.21.15.70:56526) 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bda00700 1 -- 172.21.15.70:0/1427846738 learned_addr learned my addr 172.21.15.70:0/1427846738 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bd000700 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86fa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6afe00700 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 0x55b5f86f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bda00700 1 -- 172.21.15.70:0/1427846738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 msgr2=0x55b5f86fa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bda00700 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86fa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bda00700 1 -- 172.21.15.70:0/1427846738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 msgr2=0x55b5f86f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bda00700 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 0x55b5f86f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bda00700 1 -- 172.21.15.70:0/1427846738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f8606520 con 0x55b5f86f3ec0 2024-05-08T08:29:25.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.944+0000 7fe6bd000700 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86fa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:29:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.945+0000 7fe6bda00700 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f80c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000e220 tx=0x7fe6b000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb151e2682aeed5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.945+0000 7fe6a2a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:29:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.945+0000 7fe6a2a00700 1 -- 172.21.15.70:0/1427846738 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0017020 con 0x55b5f86f3ec0 2024-05-08T08:29:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.945+0000 7fe6a2a00700 1 -- 172.21.15.70:0/1427846738 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(283..283 src has 1..283) ==== 9583+0+0 (secure 0 0 0) 0x7fe6b0013410 con 0x55b5f86f3ec0 2024-05-08T08:29:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.945+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/1427846738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a8010cd0 con 0x55b5f86f3ec0 2024-05-08T08:29:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.945+0000 7fe6a2a00700 1 -- 172.21.15.70:0/1427846738 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe6b0022050 con 0x55b5f86f3ec0 2024-05-08T08:29:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.945+0000 7fe6ca2f2b80 10 client.18132 fetch_fsmap learned FSMap version 42 2024-05-08T08:29:25.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.945+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/1427846738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b5f8705a00 con 0x55b5f86f3ec0 2024-05-08T08:29:25.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.946+0000 7fe6a2a00700 1 -- 172.21.15.70:0/1427846738 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a8010cd0 con 0x55b5f86f3ec0 2024-05-08T08:29:25.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.946+0000 7fe6a2a00700 1 -- 172.21.15.70:0/1427846738 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe6b0012050 con 0x55b5f86f3ec0 2024-05-08T08:29:25.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.946+0000 7fe6ca2f2b80 10 client.18132 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:29:25.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.946+0000 7fe6ca2f2b80 10 client.18132 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:29:25.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.946+0000 7fe6ca2f2b80 20 client.18132 populate_metadata read hostname 'smithi070' 2024-05-08T08:29:25.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.946+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b5f8708040 0x55b5f870a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.946+0000 7fe6ca2f2b80 4 client.18132 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:29:25.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.946+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/1427846738 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5f86bb1a0 con 0x55b5f8708040 2024-05-08T08:29:25.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.947+0000 7fe6bd000700 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b5f8708040 0x55b5f870a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.948+0000 7fe6bd000700 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b5f8708040 0x55b5f870a450 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91252bae7a1b4c5e server_cookie=6938b8ed7108b154 in_seq=0 out_seq=0 2024-05-08T08:29:25.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.948+0000 7fe6a2a00700 10 client.18132 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:29:25.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6a2a00700 1 -- 172.21.15.70:0/1427846738 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b5f86bb1a0 con 0x55b5f8708040 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6a2a00700 10 client.18132 handle_command_reply: tid=0 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6ca2f2b80 1 client.18132 shutdown 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/1427846738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 msgr2=0x55b5f86f80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f80c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe6b000e220 tx=0x7fe6b000e530 comp rx=0 tx=0).stop 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/1427846738 shutdown_connections 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b5f8708040 0x55b5f870a450 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86f3ec0 0x55b5f86f80c0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6a2a00700 0 client.18132 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86ee490 0x55b5f86fa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/1427846738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86eee50 0x55b5f86f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.950+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/1427846738 >> 172.21.15.70:0/1427846738 conn(0x55b5f861cc60 msgr2=0x55b5f86e3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.951+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/1427846738 shutdown_connections 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.951+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/1427846738 wait complete. 2024-05-08T08:29:25.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.951+0000 7fe6ca2f2b80 20 client.18132 trim_cache size 0 max 16384 2024-05-08T08:29:25.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.974+0000 7fe6ca2f2b80 1 Processor -- start 2024-05-08T08:29:25.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.974+0000 7fe6ca2f2b80 1 -- start start 2024-05-08T08:29:25.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.974+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86ee490 0x55b5f87042d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.974+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86eee50 0x55b5f86edb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.974+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86f3ec0 0x55b5f870fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.974+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81b4020 con 0x55b5f86ee490 2024-05-08T08:29:25.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.975+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81b18b0 con 0x55b5f86f3ec0 2024-05-08T08:29:25.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.975+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81af720 con 0x55b5f86eee50 2024-05-08T08:29:25.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.975+0000 7fe6bd000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86ee490 0x55b5f87042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.975+0000 7fe6bd000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86ee490 0x55b5f87042d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56532/0 (socket says 172.21.15.70:56532) 2024-05-08T08:29:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.975+0000 7fe6bd000700 1 -- 172.21.15.70:0/4247691003 learned_addr learned my addr 172.21.15.70:0/4247691003 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:29:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.975+0000 7fe6afe00700 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86eee50 0x55b5f86edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.975+0000 7fe6bda00700 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86f3ec0 0x55b5f870fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6bd000700 1 -- 172.21.15.70:0/4247691003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86eee50 msgr2=0x55b5f86edb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:29:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6bd000700 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86eee50 0x55b5f86edb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6bd000700 1 -- 172.21.15.70:0/4247691003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86f3ec0 msgr2=0x55b5f870fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:29:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6bd000700 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86f3ec0 0x55b5f870fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6bd000700 1 -- 172.21.15.70:0/4247691003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5f86e92c0 con 0x55b5f86ee490 2024-05-08T08:29:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6bda00700 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86f3ec0 0x55b5f870fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:29:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6bd000700 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86ee490 0x55b5f87042d0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8010fd0 tx=0x7fe6a8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962d4dc897e87b0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6ad600700 1 -- 172.21.15.70:0/4247691003 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8021070 con 0x55b5f86ee490 2024-05-08T08:29:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6ad600700 1 -- 172.21.15.70:0/4247691003 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a8033e50 con 0x55b5f86ee490 2024-05-08T08:29:25.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.976+0000 7fe6ad600700 1 -- 172.21.15.70:0/4247691003 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a80046f0 con 0x55b5f86ee490 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.977+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/4247691003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86ee490 msgr2=0x55b5f87042d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.977+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86ee490 0x55b5f87042d0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8010fd0 tx=0x7fe6a8014000 comp rx=0 tx=0).stop 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.977+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/4247691003 shutdown_connections 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.977+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86f3ec0 0x55b5f870fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.977+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86ee490 0x55b5f87042d0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.977+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/4247691003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86eee50 0x55b5f86edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.977+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/4247691003 >> 172.21.15.70:0/4247691003 conn(0x55b5f861cc60 msgr2=0x55b5f86ed480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.977+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/4247691003 shutdown_connections 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.977+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/4247691003 wait complete. 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.978+0000 7fe6ca2f2b80 1 -- start start 2024-05-08T08:29:25.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.978+0000 7fe6ca2f2b80 1 Processor -- start 2024-05-08T08:29:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.978+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86eee50 0x55b5f8700a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.978+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86f3ec0 0x55b5f86fd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.978+0000 7fe6ca2f2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86fdb60 0x55b5f86fdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81afd70 con 0x55b5f86eee50 2024-05-08T08:29:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81b11e0 con 0x55b5f86fdb60 2024-05-08T08:29:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6ca2f2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b81b0440 con 0x55b5f86f3ec0 2024-05-08T08:29:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6ca2f2b80 10 client.0 _ll_register_callbacks cb 0x55b5f85e7d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6bd000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86eee50 0x55b5f8700a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6bd000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86eee50 0x55b5f8700a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56542/0 (socket says 172.21.15.70:56542) 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6bd000700 1 -- 172.21.15.70:0/3521750532 learned_addr learned my addr 172.21.15.70:0/3521750532 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6afe00700 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86f3ec0 0x55b5f86fd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6bd000700 1 -- 172.21.15.70:0/3521750532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86f3ec0 msgr2=0x55b5f86fd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6bd000700 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86f3ec0 0x55b5f86fd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6bd000700 1 -- 172.21.15.70:0/3521750532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86fdb60 msgr2=0x55b5f86fdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6bd000700 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86fdb60 0x55b5f86fdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6bd000700 1 -- 172.21.15.70:0/3521750532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5f87728e0 con 0x55b5f86eee50 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.979+0000 7fe6afe00700 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86f3ec0 0x55b5f86fd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.980+0000 7fe6bd000700 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86eee50 0x55b5f8700a90 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fe6a801dfd0 tx=0x7fe6a8010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4e733329a11576 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.980+0000 7fe6a2a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.980+0000 7fe6a2a00700 1 -- 172.21.15.70:0/3521750532 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8042060 con 0x55b5f86eee50 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.980+0000 7fe6a2a00700 1 -- 172.21.15.70:0/3521750532 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(283..283 src has 1..283) ==== 9583+0+0 (secure 0 0 0) 0x7fe6a80056d0 con 0x55b5f86eee50 2024-05-08T08:29:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.980+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3521750532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6a8033e50 con 0x55b5f86eee50 2024-05-08T08:29:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.981+0000 7fe6a2a00700 1 -- 172.21.15.70:0/3521750532 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe6a8021050 con 0x55b5f86eee50 2024-05-08T08:29:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.981+0000 7fe6ca2f2b80 10 client.18138 fetch_fsmap learned FSMap version 42 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.981+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3521750532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b5f8773b70 con 0x55b5f86eee50 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.981+0000 7fe6a2a00700 1 -- 172.21.15.70:0/3521750532 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe6a8033e50 con 0x55b5f86eee50 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.981+0000 7fe6a2a00700 1 -- 172.21.15.70:0/3521750532 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe6a8004bf0 con 0x55b5f86eee50 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.982+0000 7fe6ca2f2b80 10 client.18138 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.982+0000 7fe6ca2f2b80 10 client.18138 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.982+0000 7fe6ca2f2b80 20 client.18138 populate_metadata read hostname 'smithi070' 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.982+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b5f8773f20 0x55b5f8776310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.982+0000 7fe6ca2f2b80 4 client.18138 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d8aba1ff", "release": true, "await": true}] 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.982+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3521750532 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d8aba1ff", "release": true, "await": true}) -- 0x55b5f864e500 con 0x55b5f8773f20 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.982+0000 7fe6afe00700 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b5f8773f20 0x55b5f8776310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.983+0000 7fe6afe00700 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b5f8773f20 0x55b5f8776310 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c69ed1ec2f57ce71 server_cookie=50678b513a3a117c in_seq=0 out_seq=0 2024-05-08T08:29:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:25.983+0000 7fe6a2a00700 10 client.18138 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:29:26.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:26 smithi070 ceph-mon[29591]: pgmap v3278: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 8 op/s 2024-05-08T08:29:26.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:26 smithi172 ceph-mon[33377]: pgmap v3278: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 8 op/s 2024-05-08T08:29:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:26 smithi194 ceph-mon[33679]: pgmap v3278: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 KiB/s wr, 8 op/s 2024-05-08T08:29:28.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:28 smithi070 ceph-mon[29591]: pgmap v3279: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 8 op/s 2024-05-08T08:29:28.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:28 smithi172 ceph-mon[33377]: pgmap v3279: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 8 op/s 2024-05-08T08:29:29.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:28 smithi194 ceph-mon[33679]: pgmap v3279: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 8 op/s 2024-05-08T08:29:29.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:29:30.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:29:30.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:29:30.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6a2a00700 1 -- 172.21.15.70:0/3521750532 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55b5f864e500 con 0x55b5f8773f20 2024-05-08T08:29:30.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6a2a00700 10 client.18138 handle_command_reply: tid=0 2024-05-08T08:29:30.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 client.18138 shutdown 2024-05-08T08:29:30.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3521750532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86eee50 msgr2=0x55b5f8700a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:30.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86eee50 0x55b5f8700a90 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fe6a801dfd0 tx=0x7fe6a8010bf0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3521750532 shutdown_connections 2024-05-08T08:29:30.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b5f8773f20 0x55b5f8776310 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b5f86fdb60 0x55b5f86fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b5f86eee50 0x55b5f8700a90 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 --2- 172.21.15.70:0/3521750532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b5f86f3ec0 0x55b5f86fd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3521750532 >> 172.21.15.70:0/3521750532 conn(0x55b5f861cc60 msgr2=0x55b5f86edd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6a2a00700 0 client.18138 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.490+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3521750532 shutdown_connections 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.491+0000 7fe6ca2f2b80 1 -- 172.21.15.70:0/3521750532 wait complete. 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.491+0000 7fe6ca2f2b80 20 client.18138 trim_cache size 0 max 16384 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 232, 2024-05-08T08:29:30.485 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "d8aba1ff": { 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 232, 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:29:30.486 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:29:30.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:29:30.487 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:29:30.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:30.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:30.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:30.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:30.487 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:29:30.487 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 -- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe69c0b29f0 msgr2=0x7fe69c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe69c0b29f0 0x7fe69c0b4eb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8005fd0 tx=0x7fe6a800a560 comp rx=0 tx=0).stop 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 -- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b8102d60 msgr2=0x7fe6b819c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b8102d60 0x7fe6b819c280 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe6a400b070 tx=0x7fe6a4004ed0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 -- 172.21.15.70:0/3354719942 shutdown_connections 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe69c0b29f0 0x7fe69c0b4eb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6b8108410 0x7fe6b81a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe6b81023a0 0x7fe6b819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 --2- 172.21.15.70:0/3354719942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6b8102d60 0x7fe6b819c280 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 -- 172.21.15.70:0/3354719942 >> 172.21.15.70:0/3354719942 conn(0x7fe6b8079350 msgr2=0x7fe6b806b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 -- 172.21.15.70:0/3354719942 shutdown_connections 2024-05-08T08:29:30.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:30.492+0000 7fe6bfa00700 1 -- 172.21.15.70:0/3354719942 wait complete. 2024-05-08T08:29:30.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:30 smithi070 ceph-mon[29591]: pgmap v3280: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T08:29:30.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:29:30.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:29:30.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:29:30.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:30 smithi172 ceph-mon[33377]: pgmap v3280: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T08:29:30.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:29:30.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:29:30.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:29:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:30 smithi194 ceph-mon[33679]: pgmap v3280: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T08:29:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:29:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:29:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:29:31.517 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd8aba1ff', seconds elapsed: 58.2 2024-05-08T08:29:32.284 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rslist.o 2024-05-08T08:29:32.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:32 smithi172 ceph-mon[33377]: pgmap v3281: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T08:29:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:32 smithi194 ceph-mon[33679]: pgmap v3281: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T08:29:33.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:32 smithi070 ceph-mon[29591]: pgmap v3281: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T08:29:33.323 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsmemory.o 2024-05-08T08:29:33.369 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/module.o 2024-05-08T08:29:33.584 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/pse-pd.o 2024-05-08T08:29:33.688 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/inet_hashtables.o 2024-05-08T08:29:33.696 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ip6_input.o 2024-05-08T08:29:33.753 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/dcache.o 2024-05-08T08:29:33.879 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_nat_core.o 2024-05-08T08:29:34.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:34 smithi172 ceph-mon[33377]: pgmap v3282: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T08:29:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:34 smithi194 ceph-mon[33679]: pgmap v3282: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T08:29:35.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:34 smithi070 ceph-mon[29591]: pgmap v3282: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 16 KiB/s wr, 6 op/s 2024-05-08T08:29:36.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:36 smithi172 ceph-mon[33377]: pgmap v3283: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 217 KiB/s wr, 17 op/s 2024-05-08T08:29:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:36 smithi194 ceph-mon[33679]: pgmap v3283: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 217 KiB/s wr, 17 op/s 2024-05-08T08:29:37.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:36 smithi070 ceph-mon[29591]: pgmap v3283: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 217 KiB/s wr, 17 op/s 2024-05-08T08:29:38.373 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ethtool/plca.o 2024-05-08T08:29:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:38 smithi070 ceph-mon[29591]: pgmap v3284: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 200 KiB/s wr, 16 op/s 2024-05-08T08:29:38.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:38 smithi172 ceph-mon[33377]: pgmap v3284: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 200 KiB/s wr, 16 op/s 2024-05-08T08:29:39.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:38 smithi194 ceph-mon[33679]: pgmap v3284: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 200 KiB/s wr, 16 op/s 2024-05-08T08:29:39.207 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsmisc.o 2024-05-08T08:29:40.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:40 smithi172 ceph-mon[33377]: pgmap v3285: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 464 KiB/s wr, 25 op/s 2024-05-08T08:29:41.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:40 smithi194 ceph-mon[33679]: pgmap v3285: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 464 KiB/s wr, 25 op/s 2024-05-08T08:29:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:40 smithi070 ceph-mon[29591]: pgmap v3285: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 464 KiB/s wr, 25 op/s 2024-05-08T08:29:42.254 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/inode.o 2024-05-08T08:29:42.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:42 smithi172 ceph-mon[33377]: pgmap v3286: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 451 KiB/s wr, 23 op/s 2024-05-08T08:29:43.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:42 smithi194 ceph-mon[33679]: pgmap v3286: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 451 KiB/s wr, 23 op/s 2024-05-08T08:29:43.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:42 smithi070 ceph-mon[29591]: pgmap v3286: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 451 KiB/s wr, 23 op/s 2024-05-08T08:29:44.239 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/dptf/int340x_thermal.o 2024-05-08T08:29:44.831 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsserial.o 2024-05-08T08:29:44.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:44 smithi172 ceph-mon[33377]: pgmap v3287: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 451 KiB/s wr, 23 op/s 2024-05-08T08:29:45.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:44 smithi194 ceph-mon[33679]: pgmap v3287: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 451 KiB/s wr, 23 op/s 2024-05-08T08:29:45.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:44 smithi070 ceph-mon[29591]: pgmap v3287: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 451 KiB/s wr, 23 op/s 2024-05-08T08:29:45.801 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/attr.o 2024-05-08T08:29:46.946 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/inet_timewait_sock.o 2024-05-08T08:29:47.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:46 smithi194 ceph-mon[33679]: pgmap v3288: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 616 KiB/s wr, 30 op/s 2024-05-08T08:29:47.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:46 smithi070 ceph-mon[29591]: pgmap v3288: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 616 KiB/s wr, 30 op/s 2024-05-08T08:29:47.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:46 smithi172 ceph-mon[33377]: pgmap v3288: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 616 KiB/s wr, 30 op/s 2024-05-08T08:29:47.608 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/addrconf.o 2024-05-08T08:29:47.658 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_nat_proto.o 2024-05-08T08:29:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:48 smithi194 ceph-mon[33679]: pgmap v3289: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 429 KiB/s wr, 17 op/s 2024-05-08T08:29:49.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:48 smithi070 ceph-mon[29591]: pgmap v3289: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 429 KiB/s wr, 17 op/s 2024-05-08T08:29:49.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:48 smithi172 ceph-mon[33377]: pgmap v3289: 129 pgs: 129 active+clean; 2.0 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 429 KiB/s wr, 17 op/s 2024-05-08T08:29:50.090 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.2 2024-05-08T08:29:50.090 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:29:50.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:50 smithi172 ceph-mon[33377]: pgmap v3290: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 789 KiB/s wr, 32 op/s 2024-05-08T08:29:51.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:50 smithi194 ceph-mon[33679]: pgmap v3290: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 789 KiB/s wr, 32 op/s 2024-05-08T08:29:51.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:50 smithi070 ceph-mon[29591]: pgmap v3290: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 789 KiB/s wr, 32 op/s 2024-05-08T08:29:51.312 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:29:52.316 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsutils.o 2024-05-08T08:29:52.556 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/acpi/dptf/built-in.a 2024-05-08T08:29:52.794 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/inet_connection_sock.o 2024-05-08T08:29:53.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:52 smithi194 ceph-mon[33679]: pgmap v3291: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 22 op/s 2024-05-08T08:29:53.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:52 smithi070 ceph-mon[29591]: pgmap v3291: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 22 op/s 2024-05-08T08:29:53.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:52 smithi172 ceph-mon[33377]: pgmap v3291: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 22 op/s 2024-05-08T08:29:53.422 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/ethtool/built-in.a 2024-05-08T08:29:53.432 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_nat_helper.o 2024-05-08T08:29:54.751 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:54 smithi070 ceph-mon[29591]: pgmap v3292: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 22 op/s 2024-05-08T08:29:54.837 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/dsa/built-in.a 2024-05-08T08:29:54.968 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_nat_masquerade.o 2024-05-08T08:29:55.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:54 smithi194 ceph-mon[33679]: pgmap v3292: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 22 op/s 2024-05-08T08:29:55.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:54 smithi172 ceph-mon[33377]: pgmap v3292: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 526 KiB/s wr, 22 op/s 2024-05-08T08:29:55.216 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/bad_inode.o 2024-05-08T08:29:55.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.343+0000 7f68dce00700 1 -- 172.21.15.70:0/3197991136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d810ff00 msgr2=0x7f68d81122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:55.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.343+0000 7f68dce00700 1 --2- 172.21.15.70:0/3197991136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d810ff00 0x7f68d81122f0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f68d000b0a0 tx=0x7f68d000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.343+0000 7f68dce00700 1 -- 172.21.15.70:0/3197991136 shutdown_connections 2024-05-08T08:29:55.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.343+0000 7f68dce00700 1 --2- 172.21.15.70:0/3197991136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d810ff00 0x7f68d81122f0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.343+0000 7f68dce00700 1 --2- 172.21.15.70:0/3197991136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68d80756d0 0x7f68d8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.343+0000 7f68dce00700 1 --2- 172.21.15.70:0/3197991136 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68d8075ff0 0x7f68d810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.343+0000 7f68dce00700 1 -- 172.21.15.70:0/3197991136 >> 172.21.15.70:0/3197991136 conn(0x7f68d807a600 msgr2=0x7f68d807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:55.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.344+0000 7f68dce00700 1 -- 172.21.15.70:0/3197991136 shutdown_connections 2024-05-08T08:29:55.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.345+0000 7f68dce00700 1 -- 172.21.15.70:0/3197991136 wait complete. 2024-05-08T08:29:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.347+0000 7f68dce00700 1 Processor -- start 2024-05-08T08:29:55.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.347+0000 7f68dce00700 1 -- start start 2024-05-08T08:29:55.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.348+0000 7f68dce00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68d80756d0 0x7f68d8074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:55.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.349+0000 7f68dce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d8075ff0 0x7f68d80750d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:55.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.349+0000 7f68dce00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68d810ff00 0x7f68d806de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:55.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.349+0000 7f68d5e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68d80756d0 0x7f68d8074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:55.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.349+0000 7f68d5e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68d80756d0 0x7f68d8074b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36962/0 (socket says 172.21.15.70:36962) 2024-05-08T08:29:55.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.350+0000 7f68d5e00700 1 -- 172.21.15.70:0/2444023450 learned_addr learned my addr 172.21.15.70:0/2444023450 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:29:55.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.350+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8115770 con 0x7f68d8075ff0 2024-05-08T08:29:55.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.350+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81155f0 con 0x7f68d80756d0 2024-05-08T08:29:55.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.350+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81158f0 con 0x7f68d810ff00 2024-05-08T08:29:55.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.351+0000 7f68d6800700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68d810ff00 0x7f68d806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:55.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.351+0000 7f68d5400700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d8075ff0 0x7f68d80750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:55.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.351+0000 7f68d5e00700 1 -- 172.21.15.70:0/2444023450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68d810ff00 msgr2=0x7f68d806de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:55.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.351+0000 7f68d5e00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68d810ff00 0x7f68d806de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.351+0000 7f68d5e00700 1 -- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d8075ff0 msgr2=0x7f68d80750d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.351+0000 7f68d5e00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d8075ff0 0x7f68d80750d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.351+0000 7f68d5e00700 1 -- 172.21.15.70:0/2444023450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d806e700 con 0x7f68d80756d0 2024-05-08T08:29:55.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.352+0000 7f68d5e00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68d80756d0 0x7f68d8074b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68c800d950 tx=0x7f68c800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:55.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.353+0000 7f68cea00700 1 -- 172.21.15.70:0/2444023450 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c8016070 con 0x7f68d80756d0 2024-05-08T08:29:55.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.353+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d806e990 con 0x7f68d80756d0 2024-05-08T08:29:55.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.353+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d8072940 con 0x7f68d80756d0 2024-05-08T08:29:55.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.353+0000 7f68cea00700 1 -- 172.21.15.70:0/2444023450 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f68c8009dd0 con 0x7f68d80756d0 2024-05-08T08:29:55.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.353+0000 7f68cea00700 1 -- 172.21.15.70:0/2444023450 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c800f3c0 con 0x7f68d80756d0 2024-05-08T08:29:55.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.354+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b8005330 con 0x7f68d80756d0 2024-05-08T08:29:55.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.361+0000 7f68cea00700 1 -- 172.21.15.70:0/2444023450 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f68c8019070 con 0x7f68d80756d0 2024-05-08T08:29:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.362+0000 7f68cea00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68bc0b2aa0 0x7f68bc0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:29:55.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.363+0000 7f68cea00700 1 -- 172.21.15.70:0/2444023450 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(283..283 src has 1..283) ==== 9583+0+0 (secure 0 0 0) 0x7f68c80e29a0 con 0x7f68d80756d0 2024-05-08T08:29:55.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.363+0000 7f68d5400700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68bc0b2aa0 0x7f68bc0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:29:55.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.364+0000 7f68d5400700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68bc0b2aa0 0x7f68bc0b4f60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68c4005fd0 tx=0x7f68c400af20 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:29:55.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.375+0000 7f68cea00700 1 -- 172.21.15.70:0/2444023450 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f68c80a9f60 con 0x7f68d80756d0 2024-05-08T08:29:55.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.809+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68b8005620 con 0x7f68d80756d0 2024-05-08T08:29:55.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.812+0000 7f68cea00700 1 -- 172.21.15.70:0/2444023450 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f68c80a9860 con 0x7f68d80756d0 2024-05-08T08:29:55.805 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:29:55.805 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:29:55.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.816+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68bc0b2aa0 msgr2=0x7f68bc0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:55.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.816+0000 7f68dce00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68bc0b2aa0 0x7f68bc0b4f60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f68c4005fd0 tx=0x7f68c400af20 comp rx=0 tx=0).stop 2024-05-08T08:29:55.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.816+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68d80756d0 msgr2=0x7f68d8074b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:29:55.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.816+0000 7f68dce00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68d80756d0 0x7f68d8074b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68c800d950 tx=0x7f68c800dc60 comp rx=0 tx=0).stop 2024-05-08T08:29:55.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.816+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 shutdown_connections 2024-05-08T08:29:55.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.817+0000 7f68dce00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f68bc0b2aa0 0x7f68bc0b4f60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.817+0000 7f68dce00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68d810ff00 0x7f68d806de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.817+0000 7f68dce00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f68d80756d0 0x7f68d8074b90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.817+0000 7f68dce00700 1 --2- 172.21.15.70:0/2444023450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68d8075ff0 0x7f68d80750d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:29:55.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.817+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 >> 172.21.15.70:0/2444023450 conn(0x7f68d807a600 msgr2=0x7f68d8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:29:55.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.817+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 shutdown_connections 2024-05-08T08:29:55.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:29:55.819+0000 7f68dce00700 1 -- 172.21.15.70:0/2444023450 wait complete. 2024-05-08T08:29:55.812 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:29:57.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:56 smithi194 ceph-mon[33679]: pgmap v3293: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 756 KiB/s wr, 31 op/s 2024-05-08T08:29:57.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:56 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2444023450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:29:57.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:56 smithi070 ceph-mon[29591]: pgmap v3293: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 756 KiB/s wr, 31 op/s 2024-05-08T08:29:57.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:56 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2444023450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:29:57.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:56 smithi172 ceph-mon[33377]: pgmap v3293: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 756 KiB/s wr, 31 op/s 2024-05-08T08:29:57.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:56 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2444023450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:29:57.791 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 76.2 --await-for 42.0' 2024-05-08T08:29:57.791 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 76.2 --await-for 42.0 2024-05-08T08:29:58.379 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:29:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:29:58 smithi070 ceph-mon[29591]: pgmap v3294: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 591 KiB/s wr, 24 op/s 2024-05-08T08:29:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:29:58 smithi194 ceph-mon[33679]: pgmap v3294: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 591 KiB/s wr, 24 op/s 2024-05-08T08:29:59.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:29:58 smithi172 ceph-mon[33377]: pgmap v3294: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 591 KiB/s wr, 24 op/s 2024-05-08T08:29:59.544 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/rsxface.o 2024-05-08T08:30:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:00 smithi070 ceph-mon[29591]: pgmap v3295: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 724 KiB/s wr, 38 op/s 2024-05-08T08:30:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T08:30:01.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:00 smithi194 ceph-mon[33679]: pgmap v3295: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 724 KiB/s wr, 38 op/s 2024-05-08T08:30:01.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T08:30:01.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:00 smithi172 ceph-mon[33377]: pgmap v3295: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 724 KiB/s wr, 38 op/s 2024-05-08T08:30:01.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T08:30:01.559 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/auth_gss.o 2024-05-08T08:30:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.065+0000 7fbb49a00700 1 -- 172.21.15.70:0/2938554772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 msgr2=0x7fbb441068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.065+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2938554772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 0x7fbb441068c0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009990 tx=0x7fbb30009ca0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.066+0000 7fbb49a00700 1 -- 172.21.15.70:0/2938554772 shutdown_connections 2024-05-08T08:30:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.066+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2938554772 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb4406b1a0 0x7fbb4406b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.066+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2938554772 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb44108450 0x7fbb44105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.066+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2938554772 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 0x7fbb441068c0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.066+0000 7fbb49a00700 1 -- 172.21.15.70:0/2938554772 >> 172.21.15.70:0/2938554772 conn(0x7fbb44079340 msgr2=0x7fbb44079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.066+0000 7fbb49a00700 1 -- 172.21.15.70:0/2938554772 shutdown_connections 2024-05-08T08:30:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.066+0000 7fbb49a00700 1 -- 172.21.15.70:0/2938554772 wait complete. 2024-05-08T08:30:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.067+0000 7fbb49a00700 1 Processor -- start 2024-05-08T08:30:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.068+0000 7fbb49a00700 1 -- start start 2024-05-08T08:30:02.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.068+0000 7fbb49a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb4406b1a0 0x7fbb4419ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.068+0000 7fbb49a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 0x7fbb441a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.068+0000 7fbb49a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb44108450 0x7fbb441a4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.068+0000 7fbb49a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb44119b50 con 0x7fbb44106440 2024-05-08T08:30:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.068+0000 7fbb49a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441199d0 con 0x7fbb44108450 2024-05-08T08:30:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.068+0000 7fbb49a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbb44119cd0 con 0x7fbb4406b1a0 2024-05-08T08:30:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.069+0000 7fbb42000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 0x7fbb441a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.069+0000 7fbb42000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 0x7fbb441a0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56002/0 (socket says 172.21.15.70:56002) 2024-05-08T08:30:02.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.069+0000 7fbb42000700 1 -- 172.21.15.70:0/2089832015 learned_addr learned my addr 172.21.15.70:0/2089832015 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:02.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.069+0000 7fbb42a00700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb4406b1a0 0x7fbb4419ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.069+0000 7fbb43400700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb44108450 0x7fbb441a4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.070+0000 7fbb42000700 1 -- 172.21.15.70:0/2089832015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb4406b1a0 msgr2=0x7fbb4419ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:02.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.070+0000 7fbb42000700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb4406b1a0 0x7fbb4419ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.070+0000 7fbb42000700 1 -- 172.21.15.70:0/2089832015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb44108450 msgr2=0x7fbb441a4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:02.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.070+0000 7fbb42000700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb44108450 0x7fbb441a4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.070+0000 7fbb42000700 1 -- 172.21.15.70:0/2089832015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb441a4fd0 con 0x7fbb44106440 2024-05-08T08:30:02.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.071+0000 7fbb42000700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 0x7fbb441a0500 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fbb30006010 tx=0x7fbb300057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:02.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.071+0000 7fbb3b400700 1 -- 172.21.15.70:0/2089832015 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30027070 con 0x7fbb44106440 2024-05-08T08:30:02.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.071+0000 7fbb49a00700 1 -- 172.21.15.70:0/2089832015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb441a5260 con 0x7fbb44106440 2024-05-08T08:30:02.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.072+0000 7fbb3b400700 1 -- 172.21.15.70:0/2089832015 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb3000fb90 con 0x7fbb44106440 2024-05-08T08:30:02.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.072+0000 7fbb3b400700 1 -- 172.21.15.70:0/2089832015 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb300173f0 con 0x7fbb44106440 2024-05-08T08:30:02.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.072+0000 7fbb49a00700 1 -- 172.21.15.70:0/2089832015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb441acb40 con 0x7fbb44106440 2024-05-08T08:30:02.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.075+0000 7fbb3b400700 1 -- 172.21.15.70:0/2089832015 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbb3002a070 con 0x7fbb44106440 2024-05-08T08:30:02.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.077+0000 7fbb3b400700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbb280b2b20 0x7fbb280b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.077+0000 7fbb3b400700 1 -- 172.21.15.70:0/2089832015 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(283..283 src has 1..283) ==== 9583+0+0 (secure 0 0 0) 0x7fbb300e3890 con 0x7fbb44106440 2024-05-08T08:30:02.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.078+0000 7fbb42a00700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbb280b2b20 0x7fbb280b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.079+0000 7fbb42a00700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbb280b2b20 0x7fbb280b4fe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009be0 tx=0x7fbb34009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:02.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.098+0000 7fbb542d3b80 1 Processor -- start 2024-05-08T08:30:02.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.098+0000 7fbb542d3b80 1 -- start start 2024-05-08T08:30:02.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 0x56380dae8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380dae2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 0x56380daef000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56380da34bb0 con 0x56380dae2810 2024-05-08T08:30:02.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56380d9d28f0 con 0x56380dae31d0 2024-05-08T08:30:02.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56380da30b70 con 0x56380dae8240 2024-05-08T08:30:02.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb42000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380dae2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb42000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380dae2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56004/0 (socket says 172.21.15.70:56004) 2024-05-08T08:30:02.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb42000700 1 -- 172.21.15.70:0/4049447666 learned_addr learned my addr 172.21.15.70:0/4049447666 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:02.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.099+0000 7fbb42a00700 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 0x56380dae8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.100+0000 7fbb43400700 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 0x56380daef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.100+0000 7fbb42000700 1 -- 172.21.15.70:0/4049447666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 msgr2=0x56380dae8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:02.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.100+0000 7fbb42000700 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 0x56380dae8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.100+0000 7fbb42000700 1 -- 172.21.15.70:0/4049447666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 msgr2=0x56380daef000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:02.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.100+0000 7fbb42000700 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 0x56380daef000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.100+0000 7fbb42000700 1 -- 172.21.15.70:0/4049447666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56380d981a60 con 0x56380dae2810 2024-05-08T08:30:02.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.100+0000 7fbb43400700 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 0x56380daef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:30:02.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.101+0000 7fbb42000700 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380dae2c90 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fbb30024000 tx=0x7fbb300a9fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29852bc825e6adb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:02.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.101+0000 7fbb2fe00700 1 -- 172.21.15.70:0/4049447666 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb300aa780 con 0x56380dae2810 2024-05-08T08:30:02.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.101+0000 7fbb2fe00700 1 -- 172.21.15.70:0/4049447666 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb300aeb30 con 0x56380dae2810 2024-05-08T08:30:02.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.101+0000 7fbb2fe00700 1 -- 172.21.15.70:0/4049447666 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb300aa9e0 con 0x56380dae2810 2024-05-08T08:30:02.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.102+0000 7fbb542d3b80 1 -- 172.21.15.70:0/4049447666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 msgr2=0x56380dae2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:02.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.102+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380dae2c90 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fbb30024000 tx=0x7fbb300a9fc0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.103+0000 7fbb542d3b80 1 -- 172.21.15.70:0/4049447666 shutdown_connections 2024-05-08T08:30:02.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.103+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 0x56380daef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.103+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 0x56380dae8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.103+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/4049447666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380dae2c90 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.103+0000 7fbb542d3b80 1 -- 172.21.15.70:0/4049447666 >> 172.21.15.70:0/4049447666 conn(0x56380da5a860 msgr2=0x56380dadd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.103+0000 7fbb542d3b80 1 -- 172.21.15.70:0/4049447666 shutdown_connections 2024-05-08T08:30:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.103+0000 7fbb542d3b80 1 -- 172.21.15.70:0/4049447666 wait complete. 2024-05-08T08:30:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.104+0000 7fbb542d3b80 1 -- start start 2024-05-08T08:30:02.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.104+0000 7fbb542d3b80 1 Processor -- start 2024-05-08T08:30:02.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.105+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380daeec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.105+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 0x56380daec080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.105+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 0x56380daec5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.105+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56380dae8d50 con 0x56380dae2810 2024-05-08T08:30:02.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.105+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56380d99acb0 con 0x56380dae31d0 2024-05-08T08:30:02.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.105+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56380daef540 con 0x56380dae8240 2024-05-08T08:30:02.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb542d3b80 10 client.0 _ll_register_callbacks cb 0x56380d9dbe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb42a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380daeec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb42a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380daeec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56006/0 (socket says 172.21.15.70:56006) 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb42a00700 1 -- 172.21.15.70:0/623135639 learned_addr learned my addr 172.21.15.70:0/623135639 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb43400700 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 0x56380daec5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb42000700 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 0x56380daec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb42a00700 1 -- 172.21.15.70:0/623135639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 msgr2=0x56380daec5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb42a00700 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 0x56380daec5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb42a00700 1 -- 172.21.15.70:0/623135639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 msgr2=0x56380daec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb42a00700 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 0x56380daec080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.106+0000 7fbb42a00700 1 -- 172.21.15.70:0/623135639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56380d9fa5b0 con 0x56380dae2810 2024-05-08T08:30:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.107+0000 7fbb42a00700 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380daeec70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fbb3401fbf0 tx=0x7fbb340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ed8e351a73fa5b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.107+0000 7fbb2cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:30:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.107+0000 7fbb2cc00700 1 -- 172.21.15.70:0/623135639 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb34004020 con 0x56380dae2810 2024-05-08T08:30:02.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.107+0000 7fbb2cc00700 1 -- 172.21.15.70:0/623135639 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(283..283 src has 1..283) ==== 9583+0+0 (secure 0 0 0) 0x7fbb34009040 con 0x56380dae2810 2024-05-08T08:30:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.108+0000 7fbb542d3b80 1 -- 172.21.15.70:0/623135639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb300aeb30 con 0x56380dae2810 2024-05-08T08:30:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.108+0000 7fbb2cc00700 1 -- 172.21.15.70:0/623135639 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fbb340041c0 con 0x56380dae2810 2024-05-08T08:30:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.108+0000 7fbb542d3b80 10 client.18156 fetch_fsmap learned FSMap version 42 2024-05-08T08:30:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.108+0000 7fbb542d3b80 1 -- 172.21.15.70:0/623135639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56380daf9c40 con 0x56380dae2810 2024-05-08T08:30:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.109+0000 7fbb2cc00700 1 -- 172.21.15.70:0/623135639 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb300aeb30 con 0x56380dae2810 2024-05-08T08:30:02.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.109+0000 7fbb2cc00700 1 -- 172.21.15.70:0/623135639 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fbb34003860 con 0x56380dae2810 2024-05-08T08:30:02.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.110+0000 7fbb542d3b80 10 client.18156 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:30:02.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.110+0000 7fbb542d3b80 10 client.18156 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:30:02.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.110+0000 7fbb542d3b80 20 client.18156 populate_metadata read hostname 'smithi070' 2024-05-08T08:30:02.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.110+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56380dafc280 0x56380dafe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.110+0000 7fbb542d3b80 4 client.18156 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:30:02.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.110+0000 7fbb542d3b80 1 -- 172.21.15.70:0/623135639 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56380daaf2d0 con 0x56380dafc280 2024-05-08T08:30:02.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.111+0000 7fbb42000700 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56380dafc280 0x56380dafe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.112+0000 7fbb42000700 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56380dafc280 0x56380dafe670 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f75b9ea662aedf7e server_cookie=6e76e672c64d2fcc in_seq=0 out_seq=0 2024-05-08T08:30:02.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.112+0000 7fbb2cc00700 10 client.18156 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:30:02.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb2cc00700 1 -- 172.21.15.70:0/623135639 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56380daaf2d0 con 0x56380dafc280 2024-05-08T08:30:02.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb2cc00700 10 client.18156 handle_command_reply: tid=0 2024-05-08T08:30:02.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb542d3b80 1 client.18156 shutdown 2024-05-08T08:30:02.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb542d3b80 1 -- 172.21.15.70:0/623135639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 msgr2=0x56380daeec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380daeec70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fbb3401fbf0 tx=0x7fbb340047c0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb542d3b80 1 -- 172.21.15.70:0/623135639 shutdown_connections 2024-05-08T08:30:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56380dafc280 0x56380dafe670 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae8240 0x56380daec5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae2810 0x56380daeec70 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb2cc00700 0 client.18156 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:30:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/623135639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae31d0 0x56380daec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.114+0000 7fbb542d3b80 1 -- 172.21.15.70:0/623135639 >> 172.21.15.70:0/623135639 conn(0x56380da5a860 msgr2=0x56380dad7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:02.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.115+0000 7fbb542d3b80 1 -- 172.21.15.70:0/623135639 shutdown_connections 2024-05-08T08:30:02.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.115+0000 7fbb542d3b80 1 -- 172.21.15.70:0/623135639 wait complete. 2024-05-08T08:30:02.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.116+0000 7fbb542d3b80 20 client.18156 trim_cache size 0 max 16384 2024-05-08T08:30:02.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.153+0000 7fbb542d3b80 1 Processor -- start 2024-05-08T08:30:02.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.153+0000 7fbb542d3b80 1 -- start start 2024-05-08T08:30:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 0x56380daec5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 0x56380daf8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daed730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b8390 con 0x56380dae8240 2024-05-08T08:30:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b5c20 con 0x56380dae2810 2024-05-08T08:30:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b3a90 con 0x56380dae31d0 2024-05-08T08:30:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb43400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb43400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daed730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56014/0 (socket says 172.21.15.70:56014) 2024-05-08T08:30:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb43400700 1 -- 172.21.15.70:0/3268894449 learned_addr learned my addr 172.21.15.70:0/3268894449 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb42000700 1 --2- 172.21.15.70:0/3268894449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 0x56380daf8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.154+0000 7fbb42a00700 1 --2- 172.21.15.70:0/3268894449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 0x56380daec5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.155+0000 7fbb43400700 1 -- 172.21.15.70:0/3268894449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 msgr2=0x56380daf8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.155+0000 7fbb43400700 1 --2- 172.21.15.70:0/3268894449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 0x56380daf8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.155+0000 7fbb43400700 1 -- 172.21.15.70:0/3268894449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 msgr2=0x56380daec5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.155+0000 7fbb43400700 1 --2- 172.21.15.70:0/3268894449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 0x56380daec5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.155+0000 7fbb43400700 1 -- 172.21.15.70:0/3268894449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56380daddcd0 con 0x56380dae8240 2024-05-08T08:30:02.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.155+0000 7fbb43400700 1 --2- 172.21.15.70:0/3268894449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daed730 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009ce0 tx=0x7fbb3c007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9e140d9ff67b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:02.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.156+0000 7fbb2f400700 1 -- 172.21.15.70:0/3268894449 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c01b030 con 0x56380dae8240 2024-05-08T08:30:02.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.156+0000 7fbb2f400700 1 -- 172.21.15.70:0/3268894449 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb3c007d90 con 0x56380dae8240 2024-05-08T08:30:02.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.156+0000 7fbb2f400700 1 -- 172.21.15.70:0/3268894449 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c017ca0 con 0x56380dae8240 2024-05-08T08:30:02.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.157+0000 7fbb542d3b80 1 -- 172.21.15.70:0/3268894449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 msgr2=0x56380daed730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:02.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.157+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/3268894449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daed730 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c009ce0 tx=0x7fbb3c007500 comp rx=0 tx=0).stop 2024-05-08T08:30:02.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.157+0000 7fbb542d3b80 1 -- 172.21.15.70:0/3268894449 shutdown_connections 2024-05-08T08:30:02.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.157+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/3268894449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daed730 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.157+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/3268894449 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 0x56380daec5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.157+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/3268894449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 0x56380daf8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.157+0000 7fbb542d3b80 1 -- 172.21.15.70:0/3268894449 >> 172.21.15.70:0/3268894449 conn(0x56380da5a860 msgr2=0x56380dae2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:02.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.158+0000 7fbb542d3b80 1 -- 172.21.15.70:0/3268894449 shutdown_connections 2024-05-08T08:30:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.158+0000 7fbb542d3b80 1 -- 172.21.15.70:0/3268894449 wait complete. 2024-05-08T08:30:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.158+0000 7fbb542d3b80 1 -- start start 2024-05-08T08:30:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.159+0000 7fbb542d3b80 1 Processor -- start 2024-05-08T08:30:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.159+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 0x56380daf48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.159+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 0x56380daef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.159+0000 7fbb542d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daefb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.159+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b40e0 con 0x56380dae8240 2024-05-08T08:30:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.159+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b5550 con 0x56380dae2810 2024-05-08T08:30:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.159+0000 7fbb542d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441b47b0 con 0x56380dae31d0 2024-05-08T08:30:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.159+0000 7fbb542d3b80 10 client.0 _ll_register_callbacks cb 0x56380d9dbe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:30:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.160+0000 7fbb42a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 0x56380daf48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.160+0000 7fbb43400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daefb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.160+0000 7fbb43400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daefb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56026/0 (socket says 172.21.15.70:56026) 2024-05-08T08:30:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.160+0000 7fbb42000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 0x56380daef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.160+0000 7fbb43400700 1 -- 172.21.15.70:0/990911872 learned_addr learned my addr 172.21.15.70:0/990911872 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.161+0000 7fbb43400700 1 -- 172.21.15.70:0/990911872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 msgr2=0x56380daef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.161+0000 7fbb43400700 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 0x56380daef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.161+0000 7fbb43400700 1 -- 172.21.15.70:0/990911872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 msgr2=0x56380daf48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.161+0000 7fbb43400700 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 0x56380daf48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.161+0000 7fbb43400700 1 -- 172.21.15.70:0/990911872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56380dafe9e0 con 0x56380dae8240 2024-05-08T08:30:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.161+0000 7fbb43400700 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daefb70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c004d10 tx=0x7fbb3c004d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84067f1b7d2b2bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.161+0000 7fbb2cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:30:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.162+0000 7fbb2cc00700 1 -- 172.21.15.70:0/990911872 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c029670 con 0x56380dae8240 2024-05-08T08:30:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.162+0000 7fbb2cc00700 1 -- 172.21.15.70:0/990911872 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(283..283 src has 1..283) ==== 9583+0+0 (secure 0 0 0) 0x7fbb3c029810 con 0x56380dae8240 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.162+0000 7fbb542d3b80 1 -- 172.21.15.70:0/990911872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3c007d90 con 0x56380dae8240 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.162+0000 7fbb2cc00700 1 -- 172.21.15.70:0/990911872 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fbb3c029a10 con 0x56380dae8240 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.162+0000 7fbb542d3b80 10 client.18162 fetch_fsmap learned FSMap version 42 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.162+0000 7fbb542d3b80 1 -- 172.21.15.70:0/990911872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56380dad9d00 con 0x56380dae8240 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.163+0000 7fbb2cc00700 1 -- 172.21.15.70:0/990911872 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb3c007d90 con 0x56380dae8240 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.163+0000 7fbb2cc00700 1 -- 172.21.15.70:0/990911872 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fbb3c020c70 con 0x56380dae8240 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.163+0000 7fbb542d3b80 10 client.18162 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.163+0000 7fbb542d3b80 10 client.18162 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.163+0000 7fbb542d3b80 20 client.18162 populate_metadata read hostname 'smithi070' 2024-05-08T08:30:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.163+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56380db67a10 0x56380db69e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.163+0000 7fbb542d3b80 4 client.18162 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 76.2, "await_for": 42.0}] 2024-05-08T08:30:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.163+0000 7fbb542d3b80 1 -- 172.21.15.70:0/990911872 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 76.2, "await_for": 42.0}) -- 0x56380da42590 con 0x56380db67a10 2024-05-08T08:30:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.164+0000 7fbb42a00700 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56380db67a10 0x56380db69e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.165+0000 7fbb42a00700 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56380db67a10 0x56380db69e30 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6adc515ba1530cce server_cookie=aea57ed7abc1b120 in_seq=0 out_seq=0 2024-05-08T08:30:02.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:02.165+0000 7fbb2cc00700 10 client.18162 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:30:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:02 smithi194 ceph-mon[33679]: pgmap v3296: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 364 KiB/s wr, 23 op/s 2024-05-08T08:30:03.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:02 smithi070 ceph-mon[29591]: pgmap v3296: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 364 KiB/s wr, 23 op/s 2024-05-08T08:30:03.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:02 smithi172 ceph-mon[33377]: pgmap v3296: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 364 KiB/s wr, 23 op/s 2024-05-08T08:30:03.799 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/addrlabel.o 2024-05-08T08:30:05.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:04 smithi194 ceph-mon[33679]: pgmap v3297: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 364 KiB/s wr, 23 op/s 2024-05-08T08:30:05.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:04 smithi070 ceph-mon[29591]: pgmap v3297: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 364 KiB/s wr, 23 op/s 2024-05-08T08:30:05.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:04 smithi172 ceph-mon[33377]: pgmap v3297: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 364 KiB/s wr, 23 op/s 2024-05-08T08:30:05.515 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp.o 2024-05-08T08:30:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:06 smithi194 ceph-mon[33679]: pgmap v3298: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 685 KiB/s wr, 50 op/s 2024-05-08T08:30:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:06 smithi194 ceph-mon[33679]: osdmap e284: 12 total, 12 up, 12 in 2024-05-08T08:30:07.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:06 smithi070 ceph-mon[29591]: pgmap v3298: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 685 KiB/s wr, 50 op/s 2024-05-08T08:30:07.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:06 smithi070 ceph-mon[29591]: osdmap e284: 12 total, 12 up, 12 in 2024-05-08T08:30:07.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:06 smithi172 ceph-mon[33377]: pgmap v3298: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 685 KiB/s wr, 50 op/s 2024-05-08T08:30:07.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:06 smithi172 ceph-mon[33377]: osdmap e284: 12 total, 12 up, 12 in 2024-05-08T08:30:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:08 smithi194 ceph-mon[33679]: pgmap v3300: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 545 KiB/s wr, 49 op/s 2024-05-08T08:30:09.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:08 smithi070 ceph-mon[29591]: pgmap v3300: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 545 KiB/s wr, 49 op/s 2024-05-08T08:30:09.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:08 smithi172 ceph-mon[33377]: pgmap v3300: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 545 KiB/s wr, 49 op/s 2024-05-08T08:30:10.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:10 smithi172 ceph-mon[33377]: pgmap v3301: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 579 KiB/s wr, 36 op/s 2024-05-08T08:30:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:10 smithi194 ceph-mon[33679]: pgmap v3301: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 579 KiB/s wr, 36 op/s 2024-05-08T08:30:10.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:10 smithi070 ceph-mon[29591]: pgmap v3301: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 579 KiB/s wr, 36 op/s 2024-05-08T08:30:12.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:12 smithi070 ceph-mon[29591]: pgmap v3302: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 579 KiB/s wr, 36 op/s 2024-05-08T08:30:12.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:12 smithi172 ceph-mon[33377]: pgmap v3302: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 579 KiB/s wr, 36 op/s 2024-05-08T08:30:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:12 smithi194 ceph-mon[33679]: pgmap v3302: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 579 KiB/s wr, 36 op/s 2024-05-08T08:30:14.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:14 smithi070 ceph-mon[29591]: pgmap v3303: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 579 KiB/s wr, 36 op/s 2024-05-08T08:30:14.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:14 smithi070 ceph-mon[29591]: osdmap e285: 12 total, 12 up, 12 in 2024-05-08T08:30:14.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:14 smithi172 ceph-mon[33377]: pgmap v3303: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 579 KiB/s wr, 36 op/s 2024-05-08T08:30:14.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:14 smithi172 ceph-mon[33377]: osdmap e285: 12 total, 12 up, 12 in 2024-05-08T08:30:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:14 smithi194 ceph-mon[33679]: pgmap v3303: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 579 KiB/s wr, 36 op/s 2024-05-08T08:30:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:14 smithi194 ceph-mon[33679]: osdmap e285: 12 total, 12 up, 12 in 2024-05-08T08:30:16.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:16 smithi070 ceph-mon[29591]: pgmap v3305: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 256 KiB/s wr, 9 op/s 2024-05-08T08:30:16.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:16 smithi172 ceph-mon[33377]: pgmap v3305: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 256 KiB/s wr, 9 op/s 2024-05-08T08:30:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:16 smithi194 ceph-mon[33679]: pgmap v3305: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 256 KiB/s wr, 9 op/s 2024-05-08T08:30:18.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:18 smithi070 ceph-mon[29591]: pgmap v3306: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 249 KiB/s wr, 9 op/s 2024-05-08T08:30:18.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:18 smithi172 ceph-mon[33377]: pgmap v3306: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 249 KiB/s wr, 9 op/s 2024-05-08T08:30:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:18 smithi194 ceph-mon[33679]: pgmap v3306: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 249 KiB/s wr, 9 op/s 2024-05-08T08:30:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:20 smithi070 ceph-mon[29591]: pgmap v3307: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-08T08:30:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:20 smithi172 ceph-mon[33377]: pgmap v3307: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-08T08:30:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:20 smithi194 ceph-mon[33679]: pgmap v3307: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-08T08:30:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:22 smithi070 ceph-mon[29591]: pgmap v3308: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-08T08:30:22.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:22 smithi172 ceph-mon[33377]: pgmap v3308: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-08T08:30:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:22 smithi194 ceph-mon[33679]: pgmap v3308: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-08T08:30:24.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:24 smithi070 ceph-mon[29591]: pgmap v3309: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-08T08:30:24.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:24 smithi172 ceph-mon[33377]: pgmap v3309: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-08T08:30:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:24 smithi194 ceph-mon[33679]: pgmap v3309: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 109 KiB/s wr, 7 op/s 2024-05-08T08:30:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.240+0000 7fbb2cc00700 1 -- 172.21.15.70:0/990911872 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x56380da42590 con 0x56380db67a10 2024-05-08T08:30:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.240+0000 7fbb2cc00700 10 client.18162 handle_command_reply: tid=0 2024-05-08T08:30:25.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.240+0000 7fbb542d3b80 1 client.18162 shutdown 2024-05-08T08:30:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.241+0000 7fbb542d3b80 1 -- 172.21.15.70:0/990911872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 msgr2=0x56380daefb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:25.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.241+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daefb70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c004d10 tx=0x7fbb3c004d40 comp rx=0 tx=0).stop 2024-05-08T08:30:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.241+0000 7fbb542d3b80 1 -- 172.21.15.70:0/990911872 shutdown_connections 2024-05-08T08:30:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.241+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56380db67a10 0x56380db69e30 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.241+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56380dae8240 0x56380daefb70 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.241+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56380dae2810 0x56380daf48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.241+0000 7fbb542d3b80 1 --2- 172.21.15.70:0/990911872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56380dae31d0 0x56380daef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.241+0000 7fbb542d3b80 1 -- 172.21.15.70:0/990911872 >> 172.21.15.70:0/990911872 conn(0x56380da5a860 msgr2=0x56380dad7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.241+0000 7fbb2cc00700 0 client.18162 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:30:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.242+0000 7fbb542d3b80 1 -- 172.21.15.70:0/990911872 shutdown_connections 2024-05-08T08:30:25.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.242+0000 7fbb542d3b80 1 -- 172.21.15.70:0/990911872 wait complete. 2024-05-08T08:30:25.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.242+0000 7fbb542d3b80 20 client.18162 trim_cache size 0 max 16384 2024-05-08T08:30:25.236 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:30:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:30:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:30:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 234, 2024-05-08T08:30:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:30:25.236 INFO:teuthology.orchestra.run.smithi070.stdout: "1c3948e2": { 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 234, 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 76.2, 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:30:25.237 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:30:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:25.238 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:25.238 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.243+0000 7fbb49a00700 1 -- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbb280b2b20 msgr2=0x7fbb280b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.244+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbb280b2b20 0x7fbb280b4fe0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009be0 tx=0x7fbb34009260 comp rx=0 tx=0).stop 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.244+0000 7fbb49a00700 1 -- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 msgr2=0x7fbb441a0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.244+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 0x7fbb441a0500 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fbb30006010 tx=0x7fbb300057c0 comp rx=0 tx=0).stop 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.244+0000 7fbb49a00700 1 -- 172.21.15.70:0/2089832015 shutdown_connections 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.244+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fbb280b2b20 0x7fbb280b4fe0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.244+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fbb44108450 0x7fbb441a4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.244+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb4406b1a0 0x7fbb4419ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.244+0000 7fbb49a00700 1 --2- 172.21.15.70:0/2089832015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb44106440 0x7fbb441a0500 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.244+0000 7fbb49a00700 1 -- 172.21.15.70:0/2089832015 >> 172.21.15.70:0/2089832015 conn(0x7fbb44079340 msgr2=0x7fbb44100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.245+0000 7fbb49a00700 1 -- 172.21.15.70:0/2089832015 shutdown_connections 2024-05-08T08:30:25.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:25.245+0000 7fbb49a00700 1 -- 172.21.15.70:0/2089832015 wait complete. 2024-05-08T08:30:26.087 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1c3948e2', quiesce took 36.0 seconds. Will release after: 16.2 2024-05-08T08:30:26.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:26 smithi070 ceph-mon[29591]: pgmap v3310: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2024-05-08T08:30:26.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:26 smithi172 ceph-mon[33377]: pgmap v3310: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2024-05-08T08:30:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:26 smithi194 ceph-mon[33679]: pgmap v3310: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 6 op/s 2024-05-08T08:30:28.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:28 smithi070 ceph-mon[29591]: pgmap v3311: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 5 op/s 2024-05-08T08:30:28.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:28 smithi172 ceph-mon[33377]: pgmap v3311: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 5 op/s 2024-05-08T08:30:29.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:28 smithi194 ceph-mon[33679]: pgmap v3311: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 83 KiB/s wr, 5 op/s 2024-05-08T08:30:30.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:30 smithi070 ceph-mon[29591]: pgmap v3312: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 10 op/s 2024-05-08T08:30:30.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:30 smithi172 ceph-mon[33377]: pgmap v3312: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 10 op/s 2024-05-08T08:30:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:30 smithi194 ceph-mon[33679]: pgmap v3312: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 118 KiB/s wr, 10 op/s 2024-05-08T08:30:31.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:30:31.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:30:32.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:30:32.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:32 smithi070 ceph-mon[29591]: pgmap v3313: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 74 KiB/s wr, 7 op/s 2024-05-08T08:30:32.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:30:32.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:30:32.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:30:32.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:32 smithi172 ceph-mon[33377]: pgmap v3313: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 74 KiB/s wr, 7 op/s 2024-05-08T08:30:32.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:30:32.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:30:32.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:30:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:32 smithi194 ceph-mon[33679]: pgmap v3313: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 74 KiB/s wr, 7 op/s 2024-05-08T08:30:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:30:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:30:33.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:30:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:34 smithi070 ceph-mon[29591]: pgmap v3314: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 74 KiB/s wr, 7 op/s 2024-05-08T08:30:34.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:34 smithi172 ceph-mon[33377]: pgmap v3314: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 74 KiB/s wr, 7 op/s 2024-05-08T08:30:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:34 smithi194 ceph-mon[33679]: pgmap v3314: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 74 KiB/s wr, 7 op/s 2024-05-08T08:30:36.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:36 smithi070 ceph-mon[29591]: pgmap v3315: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 132 KiB/s wr, 16 op/s 2024-05-08T08:30:36.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:36 smithi172 ceph-mon[33377]: pgmap v3315: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 132 KiB/s wr, 16 op/s 2024-05-08T08:30:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:36 smithi194 ceph-mon[33679]: pgmap v3315: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 132 KiB/s wr, 16 op/s 2024-05-08T08:30:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:38 smithi070 ceph-mon[29591]: pgmap v3316: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 13 op/s 2024-05-08T08:30:38.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:38 smithi172 ceph-mon[33377]: pgmap v3316: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 13 op/s 2024-05-08T08:30:39.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:38 smithi194 ceph-mon[33679]: pgmap v3316: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 93 KiB/s wr, 13 op/s 2024-05-08T08:30:40.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:40 smithi172 ceph-mon[33377]: pgmap v3317: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 100 KiB/s wr, 16 op/s 2024-05-08T08:30:40.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:40 smithi194 ceph-mon[33679]: pgmap v3317: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 100 KiB/s wr, 16 op/s 2024-05-08T08:30:40.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:40 smithi070 ceph-mon[29591]: pgmap v3317: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 100 KiB/s wr, 16 op/s 2024-05-08T08:30:42.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:30:42.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:42 smithi070 ceph-mon[29591]: pgmap v3318: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 11 op/s 2024-05-08T08:30:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:30:42.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:42 smithi172 ceph-mon[33377]: pgmap v3318: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 11 op/s 2024-05-08T08:30:43.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:42 smithi194 ceph-mon[33679]: pgmap v3318: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 11 op/s 2024-05-08T08:30:44.826 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:44 smithi070 ceph-mon[29591]: pgmap v3319: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 11 op/s 2024-05-08T08:30:44.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:44 smithi172 ceph-mon[33377]: pgmap v3319: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 11 op/s 2024-05-08T08:30:45.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:44 smithi194 ceph-mon[33679]: pgmap v3319: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 65 KiB/s wr, 11 op/s 2024-05-08T08:30:45.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.287+0000 7f067be00700 1 -- 172.21.15.70:0/2818172572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c109460 msgr2=0x7f067c109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:45.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.287+0000 7f067be00700 1 --2- 172.21.15.70:0/2818172572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c109460 0x7f067c109840 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f066c009990 tx=0x7f066c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.287+0000 7f067be00700 1 -- 172.21.15.70:0/2818172572 shutdown_connections 2024-05-08T08:30:45.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.287+0000 7f067be00700 1 --2- 172.21.15.70:0/2818172572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c103d90 0x7f067c1102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.287+0000 7f067be00700 1 --2- 172.21.15.70:0/2818172572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c109460 0x7f067c109840 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.287+0000 7f067be00700 1 --2- 172.21.15.70:0/2818172572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067c1033d0 0x7f067c103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.287+0000 7f067be00700 1 -- 172.21.15.70:0/2818172572 >> 172.21.15.70:0/2818172572 conn(0x7f067c0fef20 msgr2=0x7f067c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:45.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.287+0000 7f067be00700 1 -- 172.21.15.70:0/2818172572 shutdown_connections 2024-05-08T08:30:45.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.287+0000 7f067be00700 1 -- 172.21.15.70:0/2818172572 wait complete. 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.289+0000 7f067be00700 1 Processor -- start 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.289+0000 7f067be00700 1 -- start start 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.289+0000 7f067be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067c1033d0 0x7f067c1a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.289+0000 7f067be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c103d90 0x7f067c1a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.289+0000 7f067be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c109460 0x7f067c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.289+0000 7f067be00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f067c113420 con 0x7f067c103d90 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.289+0000 7f067be00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f067c1132a0 con 0x7f067c109460 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.289+0000 7f067be00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f067c1135a0 con 0x7f067c1033d0 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c103d90 0x7f067c1a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c103d90 0x7f067c1a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51480/0 (socket says 172.21.15.70:51480) 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067a000700 1 -- 172.21.15.70:0/3771099044 learned_addr learned my addr 172.21.15.70:0/3771099044 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:45.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067c1033d0 0x7f067c1a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:45.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067b400700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c109460 0x7f067c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067a000700 1 -- 172.21.15.70:0/3771099044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067c1033d0 msgr2=0x7f067c1a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067a000700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067c1033d0 0x7f067c1a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067a000700 1 -- 172.21.15.70:0/3771099044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c109460 msgr2=0x7f067c19b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067a000700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c109460 0x7f067c19b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067a000700 1 -- 172.21.15.70:0/3771099044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f067c19c120 con 0x7f067c103d90 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.290+0000 7f067b400700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c109460 0x7f067c19b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.291+0000 7f067a000700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c103d90 0x7f067c1a1d40 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f066800c920 tx=0x7f066800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.291+0000 7f0673400700 1 -- 172.21.15.70:0/3771099044 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668007b00 con 0x7f067c103d90 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.291+0000 7f0673400700 1 -- 172.21.15.70:0/3771099044 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0668004cc0 con 0x7f067c103d90 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.291+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067c19c410 con 0x7f067c103d90 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.291+0000 7f0673400700 1 -- 172.21.15.70:0/3771099044 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668005440 con 0x7f067c103d90 2024-05-08T08:30:45.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.291+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f067c1a86d0 con 0x7f067c103d90 2024-05-08T08:30:45.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.293+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f067c06a190 con 0x7f067c103d90 2024-05-08T08:30:45.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.296+0000 7f0673400700 1 -- 172.21.15.70:0/3771099044 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f0668004750 con 0x7f067c103d90 2024-05-08T08:30:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.297+0000 7f0673400700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06600b2a70 0x7f06600b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.297+0000 7f0673400700 1 -- 172.21.15.70:0/3771099044 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(285..285 src has 1..285) ==== 9583+0+0 (secure 0 0 0) 0x7f06680e2590 con 0x7f067c103d90 2024-05-08T08:30:45.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.298+0000 7f067aa00700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06600b2a70 0x7f06600b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:45.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.298+0000 7f067aa00700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06600b2a70 0x7f06600b4f30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f067c19cb00 tx=0x7f066c005960 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:45.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.302+0000 7f0673400700 1 -- 172.21.15.70:0/3771099044 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0668014030 con 0x7f067c103d90 2024-05-08T08:30:45.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.587+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f067c1a8960 con 0x7f067c103d90 2024-05-08T08:30:45.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.589+0000 7f0673400700 1 -- 172.21.15.70:0/3771099044 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f06680a9af0 con 0x7f067c103d90 2024-05-08T08:30:45.582 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:30:45.582 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:30:45.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06600b2a70 msgr2=0x7f06600b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:45.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06600b2a70 0x7f06600b4f30 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f067c19cb00 tx=0x7f066c005960 comp rx=0 tx=0).stop 2024-05-08T08:30:45.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c103d90 msgr2=0x7f067c1a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c103d90 0x7f067c1a1d40 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f066800c920 tx=0x7f066800cc30 comp rx=0 tx=0).stop 2024-05-08T08:30:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 shutdown_connections 2024-05-08T08:30:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06600b2a70 0x7f06600b4f30 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f067c109460 0x7f067c19b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f067c1033d0 0x7f067c1a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 --2- 172.21.15.70:0/3771099044 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f067c103d90 0x7f067c1a1d40 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 >> 172.21.15.70:0/3771099044 conn(0x7f067c0fef20 msgr2=0x7f067c10eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.592+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 shutdown_connections 2024-05-08T08:30:45.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:45.593+0000 7f067be00700 1 -- 172.21.15.70:0/3771099044 wait complete. 2024-05-08T08:30:45.587 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:30:46.474 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 1c3948e2 --release --await' 2024-05-08T08:30:46.474 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 1c3948e2 --release --await 2024-05-08T08:30:46.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:46 smithi070 ceph-mon[29591]: pgmap v3320: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 101 KiB/s wr, 14 op/s 2024-05-08T08:30:46.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:46 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3771099044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:30:46.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:46 smithi172 ceph-mon[33377]: pgmap v3320: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 101 KiB/s wr, 14 op/s 2024-05-08T08:30:46.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:46 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3771099044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:30:46.927 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:30:47.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:46 smithi194 ceph-mon[33679]: pgmap v3320: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 101 KiB/s wr, 14 op/s 2024-05-08T08:30:47.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:46 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3771099044' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:30:48.781 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:48 smithi070 ceph-mon[29591]: pgmap v3321: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:30:48.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:48 smithi172 ceph-mon[33377]: pgmap v3321: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:30:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:48 smithi194 ceph-mon[33679]: pgmap v3321: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:30:49.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.310+0000 7f4bb8600700 1 -- 172.21.15.70:0/537860573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0109600 msgr2=0x7f4bb01099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:49.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.310+0000 7f4bb8600700 1 --2- 172.21.15.70:0/537860573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0109600 0x7f4bb01099e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009990 tx=0x7f4ba4009ca0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.310+0000 7f4bb8600700 1 -- 172.21.15.70:0/537860573 shutdown_connections 2024-05-08T08:30:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.310+0000 7f4bb8600700 1 --2- 172.21.15.70:0/537860573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bb0103eb0 0x7f4bb0110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.310+0000 7f4bb8600700 1 --2- 172.21.15.70:0/537860573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0109600 0x7f4bb01099e0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.310+0000 7f4bb8600700 1 --2- 172.21.15.70:0/537860573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bb01034f0 0x7f4bb0103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.310+0000 7f4bb8600700 1 -- 172.21.15.70:0/537860573 >> 172.21.15.70:0/537860573 conn(0x7f4bb007a650 msgr2=0x7f4bb007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.310+0000 7f4bb8600700 1 -- 172.21.15.70:0/537860573 shutdown_connections 2024-05-08T08:30:49.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.310+0000 7f4bb8600700 1 -- 172.21.15.70:0/537860573 wait complete. 2024-05-08T08:30:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.311+0000 7f4bb8600700 1 Processor -- start 2024-05-08T08:30:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.311+0000 7f4bb8600700 1 -- start start 2024-05-08T08:30:49.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.312+0000 7f4bb8600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bb01034f0 0x7f4bb01a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.312+0000 7f4bb8600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0103eb0 0x7f4bb01a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.312+0000 7f4bb8600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bb0109600 0x7f4bb019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.312+0000 7f4bb8600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb0113520 con 0x7f4bb0103eb0 2024-05-08T08:30:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.312+0000 7f4bb8600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01133a0 con 0x7f4bb0109600 2024-05-08T08:30:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.312+0000 7f4bb8600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01136a0 con 0x7f4bb01034f0 2024-05-08T08:30:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.312+0000 7f4bb5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0103eb0 0x7f4bb01a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.312+0000 7f4bb5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0103eb0 0x7f4bb01a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33764/0 (socket says 172.21.15.70:33764) 2024-05-08T08:30:49.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.312+0000 7f4bb5200700 1 -- 172.21.15.70:0/1126574003 learned_addr learned my addr 172.21.15.70:0/1126574003 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:49.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.313+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bb01034f0 0x7f4bb01a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.313+0000 7f4bb6600700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bb0109600 0x7f4bb019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.313+0000 7f4bb5200700 1 -- 172.21.15.70:0/1126574003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bb01034f0 msgr2=0x7f4bb01a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:49.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.313+0000 7f4bb5200700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bb01034f0 0x7f4bb01a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.313+0000 7f4bb5200700 1 -- 172.21.15.70:0/1126574003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bb0109600 msgr2=0x7f4bb019ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:49.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.313+0000 7f4bb5200700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bb0109600 0x7f4bb019ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.313+0000 7f4bb5200700 1 -- 172.21.15.70:0/1126574003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb019c170 con 0x7f4bb0103eb0 2024-05-08T08:30:49.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.313+0000 7f4bb5200700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0103eb0 0x7f4bb01a1d90 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c920 tx=0x7f4b9c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:49.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.313+0000 7f4bae000700 1 -- 172.21.15.70:0/1126574003 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c007b00 con 0x7f4bb0103eb0 2024-05-08T08:30:49.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.314+0000 7f4bae000700 1 -- 172.21.15.70:0/1126574003 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b9c004cc0 con 0x7f4bb0103eb0 2024-05-08T08:30:49.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.314+0000 7f4bb8600700 1 -- 172.21.15.70:0/1126574003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb019c460 con 0x7f4bb0103eb0 2024-05-08T08:30:49.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.314+0000 7f4bae000700 1 -- 172.21.15.70:0/1126574003 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0054f0 con 0x7f4bb0103eb0 2024-05-08T08:30:49.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.314+0000 7f4bb8600700 1 -- 172.21.15.70:0/1126574003 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb01a8720 con 0x7f4bb0103eb0 2024-05-08T08:30:49.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.317+0000 7f4bae000700 1 -- 172.21.15.70:0/1126574003 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4b9c007ca0 con 0x7f4bb0103eb0 2024-05-08T08:30:49.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.319+0000 7f4bae000700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b980b29f0 0x7f4b980b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.319+0000 7f4bae000700 1 -- 172.21.15.70:0/1126574003 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(285..285 src has 1..285) ==== 9583+0+0 (secure 0 0 0) 0x7f4b9c0e26e0 con 0x7f4bb0103eb0 2024-05-08T08:30:49.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.319+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b980b29f0 0x7f4b980b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.320+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b980b29f0 0x7f4b980b4eb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4006010 tx=0x7f4ba401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:49.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.336+0000 7f4bc2fd5b80 1 Processor -- start 2024-05-08T08:30:49.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.336+0000 7f4bc2fd5b80 1 -- start start 2024-05-08T08:30:49.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfd02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ca2bf1cb20 con 0x55ca2bfcae50 2024-05-08T08:30:49.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ca2beba860 con 0x55ca2bfcfec0 2024-05-08T08:30:49.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ca2bf18ae0 con 0x55ca2bfca490 2024-05-08T08:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bb6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bb6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33766/0 (socket says 172.21.15.70:33766) 2024-05-08T08:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bb6600700 1 -- 172.21.15.70:0/3903396235 learned_addr learned my addr 172.21.15.70:0/3903396235 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.337+0000 7f4bb5200700 1 --2- 172.21.15.70:0/3903396235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.338+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/3903396235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfd02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.338+0000 7f4bb6600700 1 -- 172.21.15.70:0/3903396235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 msgr2=0x55ca2bfca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.338+0000 7f4bb6600700 1 --2- 172.21.15.70:0/3903396235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.338+0000 7f4bb6600700 1 -- 172.21.15.70:0/3903396235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 msgr2=0x55ca2bfd02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.338+0000 7f4bb6600700 1 --2- 172.21.15.70:0/3903396235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfd02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.338+0000 7f4bb6600700 1 -- 172.21.15.70:0/3903396235 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2be699d0 con 0x55ca2bfcae50 2024-05-08T08:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.338+0000 7f4bb6600700 1 --2- 172.21.15.70:0/3903396235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd6c80 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80085a0 tx=0x7f4ba80088b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bbe8b866686839 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.339+0000 7f4ba2a00700 1 -- 172.21.15.70:0/3903396235 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8003c00 con 0x55ca2bfcae50 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.339+0000 7f4ba2a00700 1 -- 172.21.15.70:0/3903396235 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ba8003da0 con 0x55ca2bfcae50 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.339+0000 7f4ba2a00700 1 -- 172.21.15.70:0/3903396235 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8012760 con 0x55ca2bfcae50 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.339+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/3903396235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 msgr2=0x55ca2bfd6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.339+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/3903396235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd6c80 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80085a0 tx=0x7f4ba80088b0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.340+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/3903396235 shutdown_connections 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.340+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/3903396235 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd6c80 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.340+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/3903396235 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfd02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.340+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/3903396235 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.340+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/3903396235 >> 172.21.15.70:0/3903396235 conn(0x55ca2bef8c60 msgr2=0x55ca2bfc4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.340+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/3903396235 shutdown_connections 2024-05-08T08:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.340+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/3903396235 wait complete. 2024-05-08T08:30:49.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.340+0000 7f4bc2fd5b80 1 -- start start 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.341+0000 7f4bc2fd5b80 1 Processor -- start 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.341+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfd6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.341+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.341+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfd41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.341+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ca2bfd7280 con 0x55ca2bfcae50 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.341+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ca2be82c20 con 0x55ca2bfcfec0 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.341+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ca2bfd7400 con 0x55ca2bfca490 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.341+0000 7f4bc2fd5b80 10 client.0 _ll_register_callbacks cb 0x55ca2bec3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33768/0 (socket says 172.21.15.70:33768) 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb5200700 1 -- 172.21.15.70:0/1149416289 learned_addr learned my addr 172.21.15.70:0/1149416289 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb6600700 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfd41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfd6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb5200700 1 -- 172.21.15.70:0/1149416289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 msgr2=0x55ca2bfd6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:49.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb5200700 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfd6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb5200700 1 -- 172.21.15.70:0/1149416289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 msgr2=0x55ca2bfd41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb5200700 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfd41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.342+0000 7f4bb5200700 1 -- 172.21.15.70:0/1149416289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca2bee2520 con 0x55ca2bfcae50 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.343+0000 7f4bb5200700 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd3ca0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0a67b0 tx=0x7f4b9c005980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cea94d5c5faa24d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.343+0000 7f4b97400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.343+0000 7f4b97400700 1 -- 172.21.15.70:0/1149416289 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c01d040 con 0x55ca2bfcae50 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.343+0000 7f4b97400700 1 -- 172.21.15.70:0/1149416289 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(285..285 src has 1..285) ==== 9583+0+0 (secure 0 0 0) 0x7f4b9c0b2120 con 0x55ca2bfcae50 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.343+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1149416289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba8003da0 con 0x55ca2bfcae50 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.343+0000 7f4b97400700 1 -- 172.21.15.70:0/1149416289 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4b9c0ad8f0 con 0x55ca2bfcae50 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.343+0000 7f4bc2fd5b80 10 client.18180 fetch_fsmap learned FSMap version 42 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.343+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1149416289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ca2bfe1af0 con 0x55ca2bfcae50 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.343+0000 7f4b97400700 1 -- 172.21.15.70:0/1149416289 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ba8003da0 con 0x55ca2bfcae50 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.344+0000 7f4b97400700 1 -- 172.21.15.70:0/1149416289 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4b9c0a4eb0 con 0x55ca2bfcae50 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.344+0000 7f4bc2fd5b80 10 client.18180 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.344+0000 7f4bc2fd5b80 10 client.18180 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:30:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.344+0000 7f4bc2fd5b80 20 client.18180 populate_metadata read hostname 'smithi070' 2024-05-08T08:30:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.344+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ca2bfe4130 0x55ca2bfe6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.344+0000 7f4bc2fd5b80 4 client.18180 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:30:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.344+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1149416289 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca2bf971a0 con 0x55ca2bfe4130 2024-05-08T08:30:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.345+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ca2bfe4130 0x55ca2bfe6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.346+0000 7f4b97400700 10 client.18180 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:30:49.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.346+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ca2bfe4130 0x55ca2bfe6550 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6be291da205ca42 server_cookie=3e633da5513c45a2 in_seq=0 out_seq=0 2024-05-08T08:30:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4b97400700 1 -- 172.21.15.70:0/1149416289 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ca2bf971a0 con 0x55ca2bfe4130 2024-05-08T08:30:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4b97400700 10 client.18180 handle_command_reply: tid=0 2024-05-08T08:30:49.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 client.18180 shutdown 2024-05-08T08:30:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1149416289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 msgr2=0x55ca2bfd3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd3ca0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0a67b0 tx=0x7f4b9c005980 comp rx=0 tx=0).stop 2024-05-08T08:30:49.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1149416289 shutdown_connections 2024-05-08T08:30:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ca2bfe4130 0x55ca2bfe6550 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfd41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfd6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1149416289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd3ca0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4b97400700 0 client.18180 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:30:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1149416289 >> 172.21.15.70:0/1149416289 conn(0x55ca2bef8c60 msgr2=0x55ca2bfbf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1149416289 shutdown_connections 2024-05-08T08:30:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1149416289 wait complete. 2024-05-08T08:30:49.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.348+0000 7f4bc2fd5b80 20 client.18180 trim_cache size 0 max 16384 2024-05-08T08:30:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.370+0000 7f4bc2fd5b80 1 Processor -- start 2024-05-08T08:30:49.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.370+0000 7f4bc2fd5b80 1 -- start start 2024-05-08T08:30:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfe0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcae50 0x55ca2bfbefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfbf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b4090 con 0x55ca2bfcfec0 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b1920 con 0x55ca2bfcae50 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01af790 con 0x55ca2bfca490 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bb6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfbf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bb6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfbf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33784/0 (socket says 172.21.15.70:33784) 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bb6600700 1 -- 172.21.15.70:0/1878734201 learned_addr learned my addr 172.21.15.70:0/1878734201 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/1878734201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfe0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bb5200700 1 --2- 172.21.15.70:0/1878734201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcae50 0x55ca2bfbefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bb6600700 1 -- 172.21.15.70:0/1878734201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 msgr2=0x55ca2bfe0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bb6600700 1 --2- 172.21.15.70:0/1878734201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfe0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bb6600700 1 -- 172.21.15.70:0/1878734201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcae50 msgr2=0x55ca2bfbefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.371+0000 7f4bb6600700 1 --2- 172.21.15.70:0/1878734201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcae50 0x55ca2bfbefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.372+0000 7f4bb6600700 1 -- 172.21.15.70:0/1878734201 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca2bfe6bb0 con 0x55ca2bfcfec0 2024-05-08T08:30:49.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.372+0000 7f4bb6600700 1 --2- 172.21.15.70:0/1878734201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfbf500 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80076a0 tx=0x7f4ba8007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b5c5bdf8de24 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:49.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.372+0000 7f4ba2000700 1 -- 172.21.15.70:0/1878734201 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba8022030 con 0x55ca2bfcfec0 2024-05-08T08:30:49.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.372+0000 7f4ba2000700 1 -- 172.21.15.70:0/1878734201 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ba8003a00 con 0x55ca2bfcfec0 2024-05-08T08:30:49.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.372+0000 7f4ba2000700 1 -- 172.21.15.70:0/1878734201 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba80045f0 con 0x55ca2bfcfec0 2024-05-08T08:30:49.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.373+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1878734201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcfec0 msgr2=0x55ca2bfbf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:49.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.373+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1878734201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfbf500 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80076a0 tx=0x7f4ba8007790 comp rx=0 tx=0).stop 2024-05-08T08:30:49.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.373+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1878734201 shutdown_connections 2024-05-08T08:30:49.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.373+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1878734201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfbf500 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.373+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1878734201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfca490 0x55ca2bfe0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.373+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/1878734201 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcae50 0x55ca2bfbefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.373+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1878734201 >> 172.21.15.70:0/1878734201 conn(0x55ca2bef8c60 msgr2=0x55ca2bfc9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:49.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.373+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1878734201 shutdown_connections 2024-05-08T08:30:49.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.373+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/1878734201 wait complete. 2024-05-08T08:30:49.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.374+0000 7f4bc2fd5b80 1 -- start start 2024-05-08T08:30:49.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.374+0000 7f4bc2fd5b80 1 Processor -- start 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfca490 0x55ca2bfd9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bc2fd5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfda0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01afde0 con 0x55ca2bfca490 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b1250 con 0x55ca2bfcfec0 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bc2fd5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb01b04b0 con 0x55ca2bfcae50 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bc2fd5b80 10 client.0 _ll_register_callbacks cb 0x55ca2bec3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfca490 0x55ca2bfd9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfca490 0x55ca2bfd9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33792/0 (socket says 172.21.15.70:33792) 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb5c00700 1 -- 172.21.15.70:0/2048215728 learned_addr learned my addr 172.21.15.70:0/2048215728 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb5200700 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb6600700 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfda0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb5c00700 1 -- 172.21.15.70:0/2048215728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfcae50 msgr2=0x55ca2bfd9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:49.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb5c00700 1 -- 172.21.15.70:0/2048215728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 msgr2=0x55ca2bfda0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:30:49.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfda0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:49.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.375+0000 7f4bb5c00700 1 -- 172.21.15.70:0/2048215728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca2c04e9a0 con 0x55ca2bfca490 2024-05-08T08:30:49.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.376+0000 7f4bb5c00700 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfca490 0x55ca2bfd9660 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009750 tx=0x7f4ba4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f470c0f7db5a7c8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:30:49.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.376+0000 7f4b97400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:30:49.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.376+0000 7f4b97400700 1 -- 172.21.15.70:0/2048215728 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4039060 con 0x55ca2bfca490 2024-05-08T08:30:49.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.376+0000 7f4b97400700 1 -- 172.21.15.70:0/2048215728 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(285..285 src has 1..285) ==== 9583+0+0 (secure 0 0 0) 0x7f4ba400bbe0 con 0x55ca2bfca490 2024-05-08T08:30:49.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.376+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/2048215728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ba8003a00 con 0x55ca2bfca490 2024-05-08T08:30:49.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.376+0000 7f4b97400700 1 -- 172.21.15.70:0/2048215728 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4ba4040050 con 0x55ca2bfca490 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.376+0000 7f4bc2fd5b80 10 client.18186 fetch_fsmap learned FSMap version 42 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.376+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/2048215728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ca2c04fcf0 con 0x55ca2bfca490 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.377+0000 7f4b97400700 1 -- 172.21.15.70:0/2048215728 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ba8003a00 con 0x55ca2bfca490 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.377+0000 7f4b97400700 1 -- 172.21.15.70:0/2048215728 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4ba4022070 con 0x55ca2bfca490 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.377+0000 7f4bc2fd5b80 10 client.18186 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.377+0000 7f4bc2fd5b80 10 client.18186 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.377+0000 7f4bc2fd5b80 20 client.18186 populate_metadata read hostname 'smithi070' 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.377+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ca2c0503b0 0x55ca2c0527d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.377+0000 7f4bc2fd5b80 4 client.18186 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1c3948e2", "release": true, "await": true}] 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.377+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/2048215728 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1c3948e2", "release": true, "await": true}) -- 0x55ca2bfc52e0 con 0x55ca2c0503b0 2024-05-08T08:30:49.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.378+0000 7f4bb5200700 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ca2c0503b0 0x55ca2c0527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:30:49.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.379+0000 7f4b97400700 10 client.18186 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:30:49.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:49.379+0000 7f4bb5200700 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ca2c0503b0 0x55ca2c0527d0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80731d3b093df35b server_cookie=c0b4947a9c30f111 in_seq=0 out_seq=0 2024-05-08T08:30:50.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:50 smithi070 ceph-mon[29591]: pgmap v3322: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-05-08T08:30:50.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:50 smithi172 ceph-mon[33377]: pgmap v3322: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-05-08T08:30:51.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:50 smithi194 ceph-mon[33679]: pgmap v3322: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 KiB/s wr, 8 op/s 2024-05-08T08:30:52.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:52 smithi070 ceph-mon[29591]: pgmap v3323: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2024-05-08T08:30:52.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:52 smithi172 ceph-mon[33377]: pgmap v3323: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2024-05-08T08:30:53.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:52 smithi194 ceph-mon[33679]: pgmap v3323: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2024-05-08T08:30:53.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.914+0000 7f4b97400700 1 -- 172.21.15.70:0/2048215728 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55ca2bfc52e0 con 0x55ca2c0503b0 2024-05-08T08:30:53.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.914+0000 7f4b97400700 10 client.18186 handle_command_reply: tid=0 2024-05-08T08:30:53.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.914+0000 7f4bc2fd5b80 1 client.18186 shutdown 2024-05-08T08:30:53.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.915+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/2048215728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfca490 msgr2=0x55ca2bfd9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:53.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.915+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfca490 0x55ca2bfd9660 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4009750 tx=0x7f4ba4009310 comp rx=0 tx=0).stop 2024-05-08T08:30:53.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.916+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/2048215728 shutdown_connections 2024-05-08T08:30:53.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.916+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ca2c0503b0 0x55ca2c0527d0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:53.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.916+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ca2bfcfec0 0x55ca2bfda0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:53.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.916+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ca2bfca490 0x55ca2bfd9660 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:53.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.916+0000 7f4bc2fd5b80 1 --2- 172.21.15.70:0/2048215728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ca2bfcae50 0x55ca2bfd9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:53.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.916+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/2048215728 >> 172.21.15.70:0/2048215728 conn(0x55ca2bef8c60 msgr2=0x55ca2bfd52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:53.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.916+0000 7f4b97400700 0 client.18186 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:30:53.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.916+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/2048215728 shutdown_connections 2024-05-08T08:30:53.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.917+0000 7f4bc2fd5b80 1 -- 172.21.15.70:0/2048215728 wait complete. 2024-05-08T08:30:53.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.917+0000 7f4bc2fd5b80 20 client.18186 trim_cache size 0 max 16384 2024-05-08T08:30:53.911 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:30:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:30:53.911 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 236, 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "1c3948e2": { 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 236, 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 76.2, 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:30:53.912 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:30:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:30:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:30:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:30:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:53.913 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:30:53.913 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 -- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b980b29f0 msgr2=0x7f4b980b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b980b29f0 0x7f4b980b4eb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4006010 tx=0x7f4ba401a040 comp rx=0 tx=0).stop 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 -- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0103eb0 msgr2=0x7f4bb01a1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0103eb0 0x7f4bb01a1d90 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00c920 tx=0x7f4b9c00cce0 comp rx=0 tx=0).stop 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 -- 172.21.15.70:0/1126574003 shutdown_connections 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b980b29f0 0x7f4b980b4eb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4bb0109600 0x7f4bb019ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4bb01034f0 0x7f4bb01a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 --2- 172.21.15.70:0/1126574003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4bb0103eb0 0x7f4bb01a1d90 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 -- 172.21.15.70:0/1126574003 >> 172.21.15.70:0/1126574003 conn(0x7f4bb007a650 msgr2=0x7f4bb0101f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.919+0000 7f4bb8600700 1 -- 172.21.15.70:0/1126574003 shutdown_connections 2024-05-08T08:30:53.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:30:53.920+0000 7f4bb8600700 1 -- 172.21.15.70:0/1126574003 wait complete. 2024-05-08T08:30:54.034 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/file.o 2024-05-08T08:30:54.586 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:54 smithi070 ceph-mon[29591]: pgmap v3324: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2024-05-08T08:30:54.776 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1c3948e2', seconds elapsed: 64.7 2024-05-08T08:30:54.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:54 smithi172 ceph-mon[33377]: pgmap v3324: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2024-05-08T08:30:55.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:54 smithi194 ceph-mon[33679]: pgmap v3324: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 36 KiB/s wr, 5 op/s 2024-05-08T08:30:55.654 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/tbdata.o 2024-05-08T08:30:56.733 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/route.o 2024-05-08T08:30:56.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:56 smithi070 ceph-mon[29591]: pgmap v3325: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-05-08T08:30:56.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:56 smithi172 ceph-mon[33377]: pgmap v3325: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-05-08T08:30:56.988 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/clnt.o 2024-05-08T08:30:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:56 smithi194 ceph-mon[33679]: pgmap v3325: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 8 op/s 2024-05-08T08:30:57.129 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_input.o 2024-05-08T08:30:57.194 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_generic_token.o 2024-05-08T08:30:57.267 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_output.o 2024-05-08T08:30:57.344 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_nat_ftp.o 2024-05-08T08:30:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:30:58 smithi070 ceph-mon[29591]: pgmap v3326: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-05-08T08:30:58.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:30:58 smithi172 ceph-mon[33377]: pgmap v3326: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-05-08T08:30:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:30:58 smithi194 ceph-mon[33679]: pgmap v3326: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.9 KiB/s wr, 5 op/s 2024-05-08T08:31:00.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:00 smithi070 ceph-mon[29591]: pgmap v3327: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 321 KiB/s wr, 17 op/s 2024-05-08T08:31:00.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:00 smithi172 ceph-mon[33377]: pgmap v3327: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 321 KiB/s wr, 17 op/s 2024-05-08T08:31:01.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:00 smithi194 ceph-mon[33679]: pgmap v3327: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 321 KiB/s wr, 17 op/s 2024-05-08T08:31:02.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:02 smithi070 ceph-mon[29591]: pgmap v3328: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 321 KiB/s wr, 15 op/s 2024-05-08T08:31:02.874 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/tbfadt.o 2024-05-08T08:31:02.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:02 smithi172 ceph-mon[33377]: pgmap v3328: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 321 KiB/s wr, 15 op/s 2024-05-08T08:31:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:02 smithi194 ceph-mon[33679]: pgmap v3328: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 321 KiB/s wr, 15 op/s 2024-05-08T08:31:04.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:04 smithi070 ceph-mon[29591]: pgmap v3329: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 321 KiB/s wr, 15 op/s 2024-05-08T08:31:04.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:04 smithi172 ceph-mon[33377]: pgmap v3329: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 321 KiB/s wr, 15 op/s 2024-05-08T08:31:05.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:04 smithi194 ceph-mon[33679]: pgmap v3329: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 321 KiB/s wr, 15 op/s 2024-05-08T08:31:06.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:06 smithi070 ceph-mon[29591]: pgmap v3330: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 488 KiB/s wr, 39 op/s 2024-05-08T08:31:06.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:06 smithi172 ceph-mon[33377]: pgmap v3330: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 488 KiB/s wr, 39 op/s 2024-05-08T08:31:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:06 smithi194 ceph-mon[33679]: pgmap v3330: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 488 KiB/s wr, 39 op/s 2024-05-08T08:31:07.028 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/filesystems.o 2024-05-08T08:31:07.610 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_mech_switch.o 2024-05-08T08:31:08.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:08 smithi070 ceph-mon[29591]: pgmap v3331: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 483 KiB/s wr, 37 op/s 2024-05-08T08:31:08.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:08 smithi172 ceph-mon[33377]: pgmap v3331: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 483 KiB/s wr, 37 op/s 2024-05-08T08:31:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:08 smithi194 ceph-mon[33679]: pgmap v3331: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 483 KiB/s wr, 37 op/s 2024-05-08T08:31:10.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:10 smithi172 ceph-mon[33377]: pgmap v3332: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 832 KiB/s wr, 50 op/s 2024-05-08T08:31:10.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:10 smithi172 ceph-mon[33377]: osdmap e286: 12 total, 12 up, 12 in 2024-05-08T08:31:11.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:10 smithi194 ceph-mon[33679]: pgmap v3332: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 832 KiB/s wr, 50 op/s 2024-05-08T08:31:11.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:10 smithi194 ceph-mon[33679]: osdmap e286: 12 total, 12 up, 12 in 2024-05-08T08:31:11.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:10 smithi070 ceph-mon[29591]: pgmap v3332: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 832 KiB/s wr, 50 op/s 2024-05-08T08:31:11.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:10 smithi070 ceph-mon[29591]: osdmap e286: 12 total, 12 up, 12 in 2024-05-08T08:31:11.477 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/tbfind.o 2024-05-08T08:31:12.152 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/svcauth_gss.o 2024-05-08T08:31:12.886 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_nat_irc.o 2024-05-08T08:31:12.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:12 smithi172 ceph-mon[33377]: pgmap v3334: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 619 KiB/s wr, 45 op/s 2024-05-08T08:31:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:12 smithi194 ceph-mon[33679]: pgmap v3334: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 619 KiB/s wr, 45 op/s 2024-05-08T08:31:13.040 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/namespace.o 2024-05-08T08:31:13.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:12 smithi070 ceph-mon[29591]: pgmap v3334: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 619 KiB/s wr, 45 op/s 2024-05-08T08:31:13.411 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_timer.o 2024-05-08T08:31:13.942 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ip6_fib.o 2024-05-08T08:31:14.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:14 smithi172 ceph-mon[33377]: pgmap v3335: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 619 KiB/s wr, 45 op/s 2024-05-08T08:31:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:14 smithi194 ceph-mon[33679]: pgmap v3335: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 619 KiB/s wr, 45 op/s 2024-05-08T08:31:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:14 smithi070 ceph-mon[29591]: pgmap v3335: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 619 KiB/s wr, 45 op/s 2024-05-08T08:31:16.696 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/core.o 2024-05-08T08:31:16.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:16 smithi172 ceph-mon[33377]: pgmap v3336: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 907 KiB/s wr, 39 op/s 2024-05-08T08:31:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:16 smithi194 ceph-mon[33679]: pgmap v3336: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 907 KiB/s wr, 39 op/s 2024-05-08T08:31:17.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:16 smithi070 ceph-mon[29591]: pgmap v3336: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 907 KiB/s wr, 39 op/s 2024-05-08T08:31:17.561 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/tbinstal.o 2024-05-08T08:31:18.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:18 smithi172 ceph-mon[33377]: pgmap v3337: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 907 KiB/s wr, 39 op/s 2024-05-08T08:31:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:18 smithi194 ceph-mon[33679]: pgmap v3337: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 907 KiB/s wr, 39 op/s 2024-05-08T08:31:19.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:18 smithi070 ceph-mon[29591]: pgmap v3337: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 995 KiB/s rd, 907 KiB/s wr, 39 op/s 2024-05-08T08:31:20.314 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/main.o 2024-05-08T08:31:20.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:20 smithi172 ceph-mon[33377]: osdmap e287: 12 total, 12 up, 12 in 2024-05-08T08:31:20.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:20 smithi172 ceph-mon[33377]: pgmap v3339: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 766 KiB/s wr, 34 op/s 2024-05-08T08:31:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:20 smithi194 ceph-mon[33679]: osdmap e287: 12 total, 12 up, 12 in 2024-05-08T08:31:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:20 smithi194 ceph-mon[33679]: pgmap v3339: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 766 KiB/s wr, 34 op/s 2024-05-08T08:31:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:20 smithi070 ceph-mon[29591]: osdmap e287: 12 total, 12 up, 12 in 2024-05-08T08:31:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:20 smithi070 ceph-mon[29591]: pgmap v3339: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 766 KiB/s wr, 34 op/s 2024-05-08T08:31:22.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:22 smithi070 ceph-mon[29591]: pgmap v3340: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 757 KiB/s wr, 33 op/s 2024-05-08T08:31:22.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:22 smithi172 ceph-mon[33377]: pgmap v3340: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 757 KiB/s wr, 33 op/s 2024-05-08T08:31:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:22 smithi194 ceph-mon[33679]: pgmap v3340: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 757 KiB/s wr, 33 op/s 2024-05-08T08:31:23.912 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/tbprint.o 2024-05-08T08:31:24.862 INFO:tasks.quiescer.fs.[cephfs]:Total duration (36.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:31:24.862 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.0 2024-05-08T08:31:24.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:31:24.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:24 smithi070 ceph-mon[29591]: pgmap v3341: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 757 KiB/s wr, 33 op/s 2024-05-08T08:31:24.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:24 smithi172 ceph-mon[33377]: pgmap v3341: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 757 KiB/s wr, 33 op/s 2024-05-08T08:31:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:24 smithi194 ceph-mon[33679]: pgmap v3341: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 757 KiB/s wr, 33 op/s 2024-05-08T08:31:25.116 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/seq_file.o 2024-05-08T08:31:25.875 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_rpc_upcall.o 2024-05-08T08:31:26.112 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/nf_nat_sip.o 2024-05-08T08:31:26.733 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_ipv4.o 2024-05-08T08:31:26.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:26 smithi070 ceph-mon[29591]: pgmap v3342: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 580 KiB/s wr, 25 op/s 2024-05-08T08:31:26.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:26 smithi172 ceph-mon[33377]: pgmap v3342: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 580 KiB/s wr, 25 op/s 2024-05-08T08:31:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:26 smithi194 ceph-mon[33679]: pgmap v3342: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 580 KiB/s wr, 25 op/s 2024-05-08T08:31:27.227 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ipv6_sockglue.o 2024-05-08T08:31:27.782 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:31:28.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:28 smithi070 ceph-mon[29591]: pgmap v3343: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 580 KiB/s wr, 25 op/s 2024-05-08T08:31:28.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:28 smithi172 ceph-mon[33377]: pgmap v3343: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 580 KiB/s wr, 25 op/s 2024-05-08T08:31:29.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:28 smithi194 ceph-mon[33679]: pgmap v3343: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 580 KiB/s wr, 25 op/s 2024-05-08T08:31:30.692 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/sysfs.o 2024-05-08T08:31:30.812 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:30 smithi070 ceph-mon[29591]: pgmap v3344: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 577 KiB/s wr, 56 op/s 2024-05-08T08:31:30.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:30 smithi172 ceph-mon[33377]: pgmap v3344: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 577 KiB/s wr, 56 op/s 2024-05-08T08:31:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:30 smithi194 ceph-mon[33679]: pgmap v3344: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 577 KiB/s wr, 56 op/s 2024-05-08T08:31:31.140 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/tbutils.o 2024-05-08T08:31:32.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.345+0000 7efe02400700 1 -- 172.21.15.70:0/2228047844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 msgr2=0x7efdfc06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:32.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.345+0000 7efe02400700 1 --2- 172.21.15.70:0/2228047844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 0x7efdfc06b600 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7efde8009990 tx=0x7efde8009ca0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.345+0000 7efe02400700 1 -- 172.21.15.70:0/2228047844 shutdown_connections 2024-05-08T08:31:32.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.345+0000 7efe02400700 1 --2- 172.21.15.70:0/2228047844 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdfc06bb40 0x7efdfc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.345+0000 7efe02400700 1 --2- 172.21.15.70:0/2228047844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc109510 0x7efdfc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.345+0000 7efe02400700 1 --2- 172.21.15.70:0/2228047844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 0x7efdfc06b600 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.345+0000 7efe02400700 1 -- 172.21.15.70:0/2228047844 >> 172.21.15.70:0/2228047844 conn(0x7efdfc079350 msgr2=0x7efdfc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:31:32.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.345+0000 7efe02400700 1 -- 172.21.15.70:0/2228047844 shutdown_connections 2024-05-08T08:31:32.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.345+0000 7efe02400700 1 -- 172.21.15.70:0/2228047844 wait complete. 2024-05-08T08:31:32.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.347+0000 7efe02400700 1 Processor -- start 2024-05-08T08:31:32.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.347+0000 7efe02400700 1 -- start start 2024-05-08T08:31:32.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.347+0000 7efe02400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 0x7efdfc110120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:32.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efe02400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdfc06bb40 0x7efdfc10e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:32.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efe02400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc109510 0x7efdfc10e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efe02400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc1113d0 con 0x7efdfc06b180 2024-05-08T08:31:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efe02400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc111250 con 0x7efdfc06bb40 2024-05-08T08:31:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efe02400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc111550 con 0x7efdfc109510 2024-05-08T08:31:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efdfb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 0x7efdfc110120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:32.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efdfb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 0x7efdfc110120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46642/0 (socket says 172.21.15.70:46642) 2024-05-08T08:31:32.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efdfb400700 1 -- 172.21.15.70:0/3693479863 learned_addr learned my addr 172.21.15.70:0/3693479863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:31:32.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efdfaa00700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdfc06bb40 0x7efdfc10e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:32.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.348+0000 7efdfbe00700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc109510 0x7efdfc10e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:32.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.349+0000 7efdfb400700 1 -- 172.21.15.70:0/3693479863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc109510 msgr2=0x7efdfc10e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:32.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.349+0000 7efdfb400700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc109510 0x7efdfc10e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.349+0000 7efdfb400700 1 -- 172.21.15.70:0/3693479863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdfc06bb40 msgr2=0x7efdfc10e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:32.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.349+0000 7efdfb400700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdfc06bb40 0x7efdfc10e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.349+0000 7efdfb400700 1 -- 172.21.15.70:0/3693479863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc1ac510 con 0x7efdfc06b180 2024-05-08T08:31:32.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.350+0000 7efdfb400700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 0x7efdfc110120 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7efdec00d950 tx=0x7efdec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:31:32.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.350+0000 7efdf3e00700 1 -- 172.21.15.70:0/3693479863 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec016070 con 0x7efdfc06b180 2024-05-08T08:31:32.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.350+0000 7efdf3e00700 1 -- 172.21.15.70:0/3693479863 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efdec00fd20 con 0x7efdfc06b180 2024-05-08T08:31:32.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.350+0000 7efdf3e00700 1 -- 172.21.15.70:0/3693479863 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdec00e3b0 con 0x7efdfc06b180 2024-05-08T08:31:32.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.351+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc1ac6e0 con 0x7efdfc06b180 2024-05-08T08:31:32.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.351+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc1acb40 con 0x7efdfc06b180 2024-05-08T08:31:32.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.352+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdfc104bd0 con 0x7efdfc06b180 2024-05-08T08:31:32.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.358+0000 7efdf3e00700 1 -- 172.21.15.70:0/3693479863 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7efdec019070 con 0x7efdfc06b180 2024-05-08T08:31:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.360+0000 7efdf3e00700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efde00b2b20 0x7efde00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:32.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.360+0000 7efdf3e00700 1 -- 172.21.15.70:0/3693479863 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(287..287 src has 1..287) ==== 9583+0+0 (secure 0 0 0) 0x7efdec0e2510 con 0x7efdfc06b180 2024-05-08T08:31:32.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.361+0000 7efdfaa00700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efde00b2b20 0x7efde00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:32.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.362+0000 7efdfaa00700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efde00b2b20 0x7efde00b4fe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efdfc1071d0 tx=0x7efde8005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:31:32.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.366+0000 7efdf3e00700 1 -- 172.21.15.70:0/3693479863 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efdec0a9a70 con 0x7efdfc06b180 2024-05-08T08:31:32.589 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:32 smithi070 ceph-mon[29591]: pgmap v3345: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 485 KiB/s wr, 47 op/s 2024-05-08T08:31:32.589 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:31:32.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.867+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdfc1ace60 con 0x7efdfc06b180 2024-05-08T08:31:32.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.868+0000 7efdf3e00700 1 -- 172.21.15.70:0/3693479863 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7efdec0a9370 con 0x7efdfc06b180 2024-05-08T08:31:32.862 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:31:32.862 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:31:32.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.872+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efde00b2b20 msgr2=0x7efde00b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:32.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.872+0000 7efe02400700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efde00b2b20 0x7efde00b4fe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efdfc1071d0 tx=0x7efde8005fb0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.872+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 msgr2=0x7efdfc110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:32.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.872+0000 7efe02400700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 0x7efdfc110120 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7efdec00d950 tx=0x7efdec00dc60 comp rx=0 tx=0).stop 2024-05-08T08:31:32.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.873+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 shutdown_connections 2024-05-08T08:31:32.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.873+0000 7efe02400700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efde00b2b20 0x7efde00b4fe0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.873+0000 7efe02400700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdfc109510 0x7efdfc10e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.873+0000 7efe02400700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efdfc06b180 0x7efdfc110120 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.873+0000 7efe02400700 1 --2- 172.21.15.70:0/3693479863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efdfc06bb40 0x7efdfc10e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:32.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.873+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 >> 172.21.15.70:0/3693479863 conn(0x7efdfc079350 msgr2=0x7efdfc100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:31:32.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.873+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 shutdown_connections 2024-05-08T08:31:32.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:32.873+0000 7efe02400700 1 -- 172.21.15.70:0/3693479863 wait complete. 2024-05-08T08:31:32.869 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:31:32.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:32 smithi172 ceph-mon[33377]: pgmap v3345: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 485 KiB/s wr, 47 op/s 2024-05-08T08:31:32.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:31:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:32 smithi194 ceph-mon[33679]: pgmap v3345: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 485 KiB/s wr, 47 op/s 2024-05-08T08:31:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:31:33.822 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 78.0 --await-for 42.0' 2024-05-08T08:31:33.822 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 78.0 --await-for 42.0 2024-05-08T08:31:33.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:33 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3693479863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:31:33.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:33 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3693479863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:31:34.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:33 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3693479863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:31:34.420 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:31:34.460 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/xattr.o 2024-05-08T08:31:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:34 smithi070 ceph-mon[29591]: pgmap v3346: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 485 KiB/s wr, 47 op/s 2024-05-08T08:31:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:31:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:31:34.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:31:34.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:34 smithi172 ceph-mon[33377]: pgmap v3346: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 485 KiB/s wr, 47 op/s 2024-05-08T08:31:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:31:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:31:34.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:31:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:34 smithi194 ceph-mon[33679]: pgmap v3346: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 485 KiB/s wr, 47 op/s 2024-05-08T08:31:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:31:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:31:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:31:35.368 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/status.o 2024-05-08T08:31:36.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:36 smithi070 ceph-mon[29591]: pgmap v3347: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 714 KiB/s wr, 57 op/s 2024-05-08T08:31:36.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:36 smithi172 ceph-mon[33377]: pgmap v3347: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 714 KiB/s wr, 57 op/s 2024-05-08T08:31:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:36 smithi194 ceph-mon[33679]: pgmap v3347: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 714 KiB/s wr, 57 op/s 2024-05-08T08:31:38.167 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/tbxface.o 2024-05-08T08:31:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.653+0000 7f8574e00700 1 -- 172.21.15.70:0/2508303133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85701146d0 msgr2=0x7f8570116ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.653+0000 7f8574e00700 1 --2- 172.21.15.70:0/2508303133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85701146d0 0x7f8570116ac0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f856800b0a0 tx=0x7f856800b3b0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.653+0000 7f8574e00700 1 -- 172.21.15.70:0/2508303133 shutdown_connections 2024-05-08T08:31:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.653+0000 7f8574e00700 1 --2- 172.21.15.70:0/2508303133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85701146d0 0x7f8570116ac0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.653+0000 7f8574e00700 1 --2- 172.21.15.70:0/2508303133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85700756d0 0x7f8570075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.653+0000 7f8574e00700 1 --2- 172.21.15.70:0/2508303133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8570075ff0 0x7f8570114190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.653+0000 7f8574e00700 1 -- 172.21.15.70:0/2508303133 >> 172.21.15.70:0/2508303133 conn(0x7f857007a650 msgr2=0x7f857007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:31:38.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.655+0000 7f8574e00700 1 -- 172.21.15.70:0/2508303133 shutdown_connections 2024-05-08T08:31:38.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.655+0000 7f8574e00700 1 -- 172.21.15.70:0/2508303133 wait complete. 2024-05-08T08:31:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.656+0000 7f8574e00700 1 Processor -- start 2024-05-08T08:31:38.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.657+0000 7f8574e00700 1 -- start start 2024-05-08T08:31:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.658+0000 7f8574e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85700756d0 0x7f8570074c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.658+0000 7f8574e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8570075ff0 0x7f857006dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.658+0000 7f8574e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85701146d0 0x7f857006e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.658+0000 7f8574e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8570119bf0 con 0x7f8570075ff0 2024-05-08T08:31:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.658+0000 7f8574e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8570119a70 con 0x7f85700756d0 2024-05-08T08:31:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.658+0000 7f856d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8570075ff0 0x7f857006dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.658+0000 7f8574e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8570119d70 con 0x7f85701146d0 2024-05-08T08:31:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.658+0000 7f856d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8570075ff0 0x7f857006dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47264/0 (socket says 172.21.15.70:47264) 2024-05-08T08:31:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.658+0000 7f856d400700 1 -- 172.21.15.70:0/1945646847 learned_addr learned my addr 172.21.15.70:0/1945646847 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:31:38.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.659+0000 7f856e800700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85701146d0 0x7f857006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.659+0000 7f856de00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85700756d0 0x7f8570074c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.659+0000 7f856d400700 1 -- 172.21.15.70:0/1945646847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85701146d0 msgr2=0x7f857006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.659+0000 7f856d400700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85701146d0 0x7f857006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.659+0000 7f856d400700 1 -- 172.21.15.70:0/1945646847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85700756d0 msgr2=0x7f8570074c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.659+0000 7f856d400700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85700756d0 0x7f8570074c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.659+0000 7f856d400700 1 -- 172.21.15.70:0/1945646847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857006e820 con 0x7f8570075ff0 2024-05-08T08:31:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.660+0000 7f856de00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85700756d0 0x7f8570074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:31:38.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.661+0000 7f856d400700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8570075ff0 0x7f857006dcf0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f855c00e9f0 tx=0x7f855c00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:31:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.661+0000 7f8566a00700 1 -- 172.21.15.70:0/1945646847 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00cbd0 con 0x7f8570075ff0 2024-05-08T08:31:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.661+0000 7f8566a00700 1 -- 172.21.15.70:0/1945646847 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f855c00cd70 con 0x7f8570075ff0 2024-05-08T08:31:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.661+0000 7f8566a00700 1 -- 172.21.15.70:0/1945646847 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0055b0 con 0x7f8570075ff0 2024-05-08T08:31:38.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.661+0000 7f8574e00700 1 -- 172.21.15.70:0/1945646847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857006eb10 con 0x7f8570075ff0 2024-05-08T08:31:38.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.662+0000 7f8574e00700 1 -- 172.21.15.70:0/1945646847 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8570072ab0 con 0x7f8570075ff0 2024-05-08T08:31:38.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.667+0000 7f8566a00700 1 -- 172.21.15.70:0/1945646847 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f855c004750 con 0x7f8570075ff0 2024-05-08T08:31:38.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.669+0000 7f8566a00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85540b2b20 0x7f85540b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.669+0000 7f8566a00700 1 -- 172.21.15.70:0/1945646847 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(287..287 src has 1..287) ==== 9583+0+0 (secure 0 0 0) 0x7f855c0e2c80 con 0x7f8570075ff0 2024-05-08T08:31:38.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.669+0000 7f856de00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85540b2b20 0x7f85540b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.671+0000 7f856de00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85540b2b20 0x7f85540b4fe0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8560009be0 tx=0x7f8560009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:31:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.684+0000 7f857f755b80 1 Processor -- start 2024-05-08T08:31:38.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.684+0000 7f857f755b80 1 -- start start 2024-05-08T08:31:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.685+0000 7f857f755b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75f240 0x55681b75f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.685+0000 7f857f755b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b759c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.685+0000 7f857f755b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75a1d0 0x55681b766000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.685+0000 7f857f755b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55681b6abbb0 con 0x55681b75f240 2024-05-08T08:31:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.685+0000 7f857f755b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55681b6498f0 con 0x55681b75a1d0 2024-05-08T08:31:38.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.685+0000 7f857f755b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55681b6a7b70 con 0x55681b759810 2024-05-08T08:31:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.685+0000 7f856de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75f240 0x55681b75f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.686+0000 7f856de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75f240 0x55681b75f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47274/0 (socket says 172.21.15.70:47274) 2024-05-08T08:31:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.686+0000 7f856de00700 1 -- 172.21.15.70:0/3019183515 learned_addr learned my addr 172.21.15.70:0/3019183515 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:31:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.686+0000 7f856e800700 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75a1d0 0x55681b766000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.686+0000 7f856d400700 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b759c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.686+0000 7f856de00700 1 -- 172.21.15.70:0/3019183515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 msgr2=0x55681b759c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:31:38.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.686+0000 7f856de00700 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b759c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.686+0000 7f856de00700 1 -- 172.21.15.70:0/3019183515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75a1d0 msgr2=0x55681b766000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:31:38.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.686+0000 7f856de00700 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75a1d0 0x55681b766000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.686+0000 7f856de00700 1 -- 172.21.15.70:0/3019183515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681b5f8a60 con 0x55681b75f240 2024-05-08T08:31:38.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.687+0000 7f856e800700 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75a1d0 0x55681b766000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:31:38.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.687+0000 7f856d400700 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b759c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:31:38.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.687+0000 7f856de00700 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75f240 0x55681b75f620 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8560010d00 tx=0x7f8560013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb6c1d1100351c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:31:38.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.687+0000 7f855b400700 1 -- 172.21.15.70:0/3019183515 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560023070 con 0x55681b75f240 2024-05-08T08:31:38.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.688+0000 7f855b400700 1 -- 172.21.15.70:0/3019183515 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f856001f450 con 0x55681b75f240 2024-05-08T08:31:38.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.688+0000 7f855b400700 1 -- 172.21.15.70:0/3019183515 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856001e610 con 0x55681b75f240 2024-05-08T08:31:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.689+0000 7f857f755b80 1 -- 172.21.15.70:0/3019183515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75f240 msgr2=0x55681b75f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.689+0000 7f857f755b80 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75f240 0x55681b75f620 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f8560010d00 tx=0x7f8560013000 comp rx=0 tx=0).stop 2024-05-08T08:31:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.689+0000 7f857f755b80 1 -- 172.21.15.70:0/3019183515 shutdown_connections 2024-05-08T08:31:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.689+0000 7f857f755b80 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75a1d0 0x55681b766000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.689+0000 7f857f755b80 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75f240 0x55681b75f620 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.689+0000 7f857f755b80 1 --2- 172.21.15.70:0/3019183515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b759c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.689+0000 7f857f755b80 1 -- 172.21.15.70:0/3019183515 >> 172.21.15.70:0/3019183515 conn(0x55681b6d1860 msgr2=0x55681b754100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:31:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.690+0000 7f857f755b80 1 -- 172.21.15.70:0/3019183515 shutdown_connections 2024-05-08T08:31:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.690+0000 7f857f755b80 1 -- 172.21.15.70:0/3019183515 wait complete. 2024-05-08T08:31:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.690+0000 7f857f755b80 1 -- start start 2024-05-08T08:31:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.691+0000 7f857f755b80 1 Processor -- start 2024-05-08T08:31:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.691+0000 7f857f755b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b765c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.691+0000 7f857f755b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b763020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.691+0000 7f857f755b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b763560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.691+0000 7f857f755b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55681b766600 con 0x55681b75a1d0 2024-05-08T08:31:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.691+0000 7f857f755b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55681b611cb0 con 0x55681b75f240 2024-05-08T08:31:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.691+0000 7f857f755b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55681b766780 con 0x55681b759810 2024-05-08T08:31:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.691+0000 7f857f755b80 10 client.0 _ll_register_callbacks cb 0x55681b652e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:31:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b763020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b763020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47282/0 (socket says 172.21.15.70:47282) 2024-05-08T08:31:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856d400700 1 -- 172.21.15.70:0/287130862 learned_addr learned my addr 172.21.15.70:0/287130862 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:31:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856de00700 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b765c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856e800700 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b763560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856d400700 1 -- 172.21.15.70:0/287130862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 msgr2=0x55681b765c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:31:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856d400700 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b765c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856d400700 1 -- 172.21.15.70:0/287130862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 msgr2=0x55681b763560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:31:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856d400700 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b763560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856d400700 1 -- 172.21.15.70:0/287130862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681b6715b0 con 0x55681b75a1d0 2024-05-08T08:31:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856e800700 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b763560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:31:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.692+0000 7f856de00700 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b765c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:31:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.693+0000 7f856d400700 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b763020 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f855c009230 tx=0x7f855c0aa150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182862ad262ba916 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:31:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.693+0000 7f854fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:31:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.693+0000 7f854fe00700 1 -- 172.21.15.70:0/287130862 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0c3060 con 0x55681b75a1d0 2024-05-08T08:31:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.694+0000 7f854fe00700 1 -- 172.21.15.70:0/287130862 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(287..287 src has 1..287) ==== 9583+0+0 (secure 0 0 0) 0x7f855c0a8da0 con 0x55681b75a1d0 2024-05-08T08:31:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.694+0000 7f857f755b80 1 -- 172.21.15.70:0/287130862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f856001f450 con 0x55681b75a1d0 2024-05-08T08:31:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.694+0000 7f854fe00700 1 -- 172.21.15.70:0/287130862 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f855c0a52d0 con 0x55681b75a1d0 2024-05-08T08:31:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.694+0000 7f857f755b80 10 client.18204 fetch_fsmap learned FSMap version 42 2024-05-08T08:31:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.694+0000 7f857f755b80 1 -- 172.21.15.70:0/287130862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55681b770df0 con 0x55681b75a1d0 2024-05-08T08:31:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.695+0000 7f854fe00700 1 -- 172.21.15.70:0/287130862 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f856001f450 con 0x55681b75a1d0 2024-05-08T08:31:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.695+0000 7f854fe00700 1 -- 172.21.15.70:0/287130862 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f855c004a40 con 0x55681b75a1d0 2024-05-08T08:31:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.695+0000 7f857f755b80 10 client.18204 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:31:38.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.695+0000 7f857f755b80 10 client.18204 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:31:38.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.696+0000 7f857f755b80 20 client.18204 populate_metadata read hostname 'smithi070' 2024-05-08T08:31:38.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.696+0000 7f857f755b80 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55681b773380 0x55681b775770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.696+0000 7f857f755b80 4 client.18204 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:31:38.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.696+0000 7f857f755b80 1 -- 172.21.15.70:0/287130862 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55681b7262d0 con 0x55681b773380 2024-05-08T08:31:38.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.696+0000 7f856de00700 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55681b773380 0x55681b775770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.697+0000 7f854fe00700 10 client.18204 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:31:38.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.697+0000 7f856de00700 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55681b773380 0x55681b775770 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af374f57739976b6 server_cookie=3597ffd845dc785b in_seq=0 out_seq=0 2024-05-08T08:31:38.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f854fe00700 1 -- 172.21.15.70:0/287130862 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55681b7262d0 con 0x55681b773380 2024-05-08T08:31:38.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f854fe00700 10 client.18204 handle_command_reply: tid=0 2024-05-08T08:31:38.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f857f755b80 1 client.18204 shutdown 2024-05-08T08:31:38.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f857f755b80 1 -- 172.21.15.70:0/287130862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 msgr2=0x55681b763020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:38.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f857f755b80 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b763020 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f855c009230 tx=0x7f855c0aa150 comp rx=0 tx=0).stop 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f857f755b80 1 -- 172.21.15.70:0/287130862 shutdown_connections 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f857f755b80 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55681b773380 0x55681b775770 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f857f755b80 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b763560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f857f755b80 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b765c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f857f755b80 1 --2- 172.21.15.70:0/287130862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b763020 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f857f755b80 1 -- 172.21.15.70:0/287130862 >> 172.21.15.70:0/287130862 conn(0x55681b6d1860 msgr2=0x55681b74ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.700+0000 7f854fe00700 0 client.18204 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.701+0000 7f857f755b80 1 -- 172.21.15.70:0/287130862 shutdown_connections 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.701+0000 7f857f755b80 1 -- 172.21.15.70:0/287130862 wait complete. 2024-05-08T08:31:38.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.701+0000 7f857f755b80 20 client.18204 trim_cache size 0 max 16384 2024-05-08T08:31:38.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.734+0000 7f857f755b80 1 Processor -- start 2024-05-08T08:31:38.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.734+0000 7f857f755b80 1 -- start start 2024-05-08T08:31:38.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.734+0000 7f857f755b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b759810 0x55681b75e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.734+0000 7f857f755b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b76f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.735+0000 7f857f755b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b75f240 0x55681b761fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.735+0000 7f857f755b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85701c0d00 con 0x55681b75a1d0 2024-05-08T08:31:38.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.735+0000 7f857f755b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85701be590 con 0x55681b759810 2024-05-08T08:31:38.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.735+0000 7f857f755b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f85701bc400 con 0x55681b75f240 2024-05-08T08:31:38.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.735+0000 7f856de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b759810 0x55681b75e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.735+0000 7f856d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b76f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.735+0000 7f856de00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b759810 0x55681b75e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:51788/0 (socket says 172.21.15.70:51788) 2024-05-08T08:31:38.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.735+0000 7f856d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b76f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47290/0 (socket says 172.21.15.70:47290) 2024-05-08T08:31:38.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.735+0000 7f856de00700 1 -- 172.21.15.70:0/4160952293 learned_addr learned my addr 172.21.15.70:0/4160952293 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.736+0000 7f856e800700 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b75f240 0x55681b761fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.736+0000 7f856de00700 1 -- 172.21.15.70:0/4160952293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b75f240 msgr2=0x55681b761fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.736+0000 7f856de00700 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b75f240 0x55681b761fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.736+0000 7f856de00700 1 -- 172.21.15.70:0/4160952293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 msgr2=0x55681b76f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.736+0000 7f856de00700 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b76f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.736+0000 7f856de00700 1 -- 172.21.15.70:0/4160952293 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55681b775da0 con 0x55681b759810 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.736+0000 7f856e800700 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b75f240 0x55681b761fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.736+0000 7f856d400700 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b76f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.737+0000 7f856de00700 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b759810 0x55681b75e890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8560010700 tx=0x7f8560009950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=814c65e7f83d3b96 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:31:38.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.737+0000 7f855aa00700 1 -- 172.21.15.70:0/4160952293 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856003a070 con 0x55681b759810 2024-05-08T08:31:38.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.737+0000 7f855aa00700 1 -- 172.21.15.70:0/4160952293 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8560035e50 con 0x55681b759810 2024-05-08T08:31:38.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.737+0000 7f855aa00700 1 -- 172.21.15.70:0/4160952293 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560023040 con 0x55681b759810 2024-05-08T08:31:38.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.738+0000 7f857f755b80 1 -- 172.21.15.70:0/4160952293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b759810 msgr2=0x55681b75e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:31:38.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.738+0000 7f857f755b80 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b759810 0x55681b75e890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8560010700 tx=0x7f8560009950 comp rx=0 tx=0).stop 2024-05-08T08:31:38.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.738+0000 7f857f755b80 1 -- 172.21.15.70:0/4160952293 shutdown_connections 2024-05-08T08:31:38.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.738+0000 7f857f755b80 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b75f240 0x55681b761fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.738+0000 7f857f755b80 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b759810 0x55681b75e890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.738+0000 7f857f755b80 1 --2- 172.21.15.70:0/4160952293 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b76f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.738+0000 7f857f755b80 1 -- 172.21.15.70:0/4160952293 >> 172.21.15.70:0/4160952293 conn(0x55681b6d1860 msgr2=0x55681b759090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:31:38.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.738+0000 7f857f755b80 1 -- 172.21.15.70:0/4160952293 shutdown_connections 2024-05-08T08:31:38.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.739+0000 7f857f755b80 1 -- 172.21.15.70:0/4160952293 wait complete. 2024-05-08T08:31:38.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.739+0000 7f857f755b80 1 -- start start 2024-05-08T08:31:38.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.739+0000 7f857f755b80 1 Processor -- start 2024-05-08T08:31:38.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.740+0000 7f857f755b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b7689e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.740+0000 7f857f755b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b768f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.740+0000 7f857f755b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b769460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.740+0000 7f857f755b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85701bca50 con 0x55681b75a1d0 2024-05-08T08:31:38.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.740+0000 7f857f755b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f85701bdec0 con 0x55681b75f240 2024-05-08T08:31:38.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.740+0000 7f857f755b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f85701bd120 con 0x55681b759810 2024-05-08T08:31:38.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.740+0000 7f857f755b80 10 client.0 _ll_register_callbacks cb 0x55681b652e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:31:38.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.740+0000 7f856de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b7689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b7689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:34100/0 (socket says 172.21.15.70:34100) 2024-05-08T08:31:38.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856de00700 1 -- 172.21.15.70:0/3322456129 learned_addr learned my addr 172.21.15.70:0/3322456129 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856d400700 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b768f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856e800700 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b769460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856de00700 1 -- 172.21.15.70:0/3322456129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 msgr2=0x55681b769460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856de00700 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b769460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856de00700 1 -- 172.21.15.70:0/3322456129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 msgr2=0x55681b768f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856de00700 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b768f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856de00700 1 -- 172.21.15.70:0/3322456129 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55681b766430 con 0x55681b759810 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856e800700 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b769460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.741+0000 7f856d400700 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b768f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.742+0000 7f856de00700 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b7689e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85600127b0 tx=0x7f8560012890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f908a6496c1902 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:31:38.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.742+0000 7f854fe00700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T08:31:38.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.742+0000 7f854fe00700 1 -- 172.21.15.70:0/3322456129 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560042060 con 0x55681b759810 2024-05-08T08:31:38.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.743+0000 7f854fe00700 1 -- 172.21.15.70:0/3322456129 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(287..287 src has 1..287) ==== 9583+0+0 (secure 0 0 0) 0x7f85600052c0 con 0x55681b759810 2024-05-08T08:31:38.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.743+0000 7f857f755b80 1 -- 172.21.15.70:0/3322456129 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8560035e50 con 0x55681b759810 2024-05-08T08:31:38.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.743+0000 7f854fe00700 1 -- 172.21.15.70:0/3322456129 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8560049050 con 0x55681b759810 2024-05-08T08:31:38.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.743+0000 7f857f755b80 10 client.27139 fetch_fsmap learned FSMap version 42 2024-05-08T08:31:38.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.743+0000 7f857f755b80 1 -- 172.21.15.70:0/3322456129 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55681b7dec00 con 0x55681b759810 2024-05-08T08:31:38.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.744+0000 7f854fe00700 1 -- 172.21.15.70:0/3322456129 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8560035e50 con 0x55681b759810 2024-05-08T08:31:38.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.744+0000 7f854fe00700 1 -- 172.21.15.70:0/3322456129 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f856000f040 con 0x55681b759810 2024-05-08T08:31:38.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.745+0000 7f857f755b80 10 client.27139 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:31:38.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.745+0000 7f857f755b80 10 client.27139 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:31:38.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.745+0000 7f857f755b80 20 client.27139 populate_metadata read hostname 'smithi070' 2024-05-08T08:31:38.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.745+0000 7f857f755b80 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55681b7df0a0 0x55681b7e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:31:38.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.745+0000 7f857f755b80 4 client.27139 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.0, "await_for": 42.0}] 2024-05-08T08:31:38.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.745+0000 7f857f755b80 1 -- 172.21.15.70:0/3322456129 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.0, "await_for": 42.0}) -- 0x55681b6b9590 con 0x55681b7df0a0 2024-05-08T08:31:38.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.746+0000 7f856d400700 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55681b7df0a0 0x55681b7e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:31:38.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.746+0000 7f854fe00700 10 client.27139 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:31:38.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:31:38.746+0000 7f856d400700 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55681b7df0a0 0x55681b7e14c0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20f364b412e3dd21 server_cookie=aab768eab3b70f96 in_seq=0 out_seq=0 2024-05-08T08:31:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:38 smithi070 ceph-mon[29591]: pgmap v3348: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 455 KiB/s wr, 45 op/s 2024-05-08T08:31:38.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:38 smithi172 ceph-mon[33377]: pgmap v3348: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 455 KiB/s wr, 45 op/s 2024-05-08T08:31:39.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:38 smithi194 ceph-mon[33679]: pgmap v3348: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 455 KiB/s wr, 45 op/s 2024-05-08T08:31:40.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:40 smithi070 ceph-mon[29591]: pgmap v3349: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 737 KiB/s wr, 61 op/s 2024-05-08T08:31:40.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:40 smithi172 ceph-mon[33377]: pgmap v3349: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 737 KiB/s wr, 61 op/s 2024-05-08T08:31:41.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:40 smithi194 ceph-mon[33679]: pgmap v3349: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 737 KiB/s wr, 61 op/s 2024-05-08T08:31:42.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:42 smithi070 ceph-mon[29591]: pgmap v3350: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 511 KiB/s wr, 25 op/s 2024-05-08T08:31:42.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:42 smithi172 ceph-mon[33377]: pgmap v3350: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 511 KiB/s wr, 25 op/s 2024-05-08T08:31:43.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:42 smithi194 ceph-mon[33679]: pgmap v3350: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 511 KiB/s wr, 25 op/s 2024-05-08T08:31:44.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:44 smithi172 ceph-mon[33377]: pgmap v3351: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 511 KiB/s wr, 25 op/s 2024-05-08T08:31:45.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:44 smithi194 ceph-mon[33679]: pgmap v3351: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 511 KiB/s wr, 25 op/s 2024-05-08T08:31:45.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:44 smithi070 ceph-mon[29591]: pgmap v3351: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 511 KiB/s wr, 25 op/s 2024-05-08T08:31:46.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:46 smithi172 ceph-mon[33377]: pgmap v3352: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 530 KiB/s wr, 30 op/s 2024-05-08T08:31:47.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:46 smithi194 ceph-mon[33679]: pgmap v3352: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 530 KiB/s wr, 30 op/s 2024-05-08T08:31:47.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:46 smithi070 ceph-mon[29591]: pgmap v3352: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 530 KiB/s wr, 30 op/s 2024-05-08T08:31:48.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:48 smithi172 ceph-mon[33377]: pgmap v3353: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 301 KiB/s wr, 20 op/s 2024-05-08T08:31:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:48 smithi194 ceph-mon[33679]: pgmap v3353: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 301 KiB/s wr, 20 op/s 2024-05-08T08:31:49.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:48 smithi070 ceph-mon[29591]: pgmap v3353: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 301 KiB/s wr, 20 op/s 2024-05-08T08:31:50.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:50 smithi172 ceph-mon[33377]: pgmap v3354: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 458 KiB/s wr, 25 op/s 2024-05-08T08:31:51.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:50 smithi194 ceph-mon[33679]: pgmap v3354: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 458 KiB/s wr, 25 op/s 2024-05-08T08:31:51.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:50 smithi070 ceph-mon[29591]: pgmap v3354: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 458 KiB/s wr, 25 op/s 2024-05-08T08:31:52.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:52 smithi172 ceph-mon[33377]: pgmap v3355: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T08:31:53.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:52 smithi194 ceph-mon[33679]: pgmap v3355: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T08:31:53.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:52 smithi070 ceph-mon[29591]: pgmap v3355: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T08:31:54.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:54 smithi172 ceph-mon[33377]: pgmap v3356: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T08:31:55.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:54 smithi194 ceph-mon[33679]: pgmap v3356: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T08:31:55.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:54 smithi070 ceph-mon[29591]: pgmap v3356: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T08:31:56.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:56 smithi172 ceph-mon[33377]: pgmap v3357: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-08T08:31:56.925 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:56 smithi070 ceph-mon[29591]: pgmap v3357: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-08T08:31:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:56 smithi194 ceph-mon[33679]: pgmap v3357: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-08T08:31:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:31:58 smithi194 ceph-mon[33679]: pgmap v3358: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 157 KiB/s wr, 7 op/s 2024-05-08T08:31:59.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:31:58 smithi070 ceph-mon[29591]: pgmap v3358: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 157 KiB/s wr, 7 op/s 2024-05-08T08:31:59.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:31:58 smithi172 ceph-mon[33377]: pgmap v3358: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 157 KiB/s wr, 7 op/s 2024-05-08T08:32:01.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:00 smithi194 ceph-mon[33679]: pgmap v3359: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 232 KiB/s wr, 11 op/s 2024-05-08T08:32:01.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:00 smithi070 ceph-mon[29591]: pgmap v3359: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 232 KiB/s wr, 11 op/s 2024-05-08T08:32:01.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:00 smithi172 ceph-mon[33377]: pgmap v3359: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 232 KiB/s wr, 11 op/s 2024-05-08T08:32:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.874+0000 7f854fe00700 1 -- 172.21.15.70:0/3322456129 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55681b6b9590 con 0x55681b7df0a0 2024-05-08T08:32:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.874+0000 7f854fe00700 10 client.27139 handle_command_reply: tid=0 2024-05-08T08:32:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.874+0000 7f857f755b80 1 client.27139 shutdown 2024-05-08T08:32:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.874+0000 7f857f755b80 1 -- 172.21.15.70:0/3322456129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 msgr2=0x55681b7689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.874+0000 7f857f755b80 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b7689e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85600127b0 tx=0x7f8560012890 comp rx=0 tx=0).stop 2024-05-08T08:32:01.871 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:32:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:32:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:32:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 238, 2024-05-08T08:32:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:32:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "92a409df": { 2024-05-08T08:32:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 238, 2024-05-08T08:32:01.871 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.0, 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:01.872 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:01.873 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:01.873 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:32:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f857f755b80 1 -- 172.21.15.70:0/3322456129 shutdown_connections 2024-05-08T08:32:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f857f755b80 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55681b7df0a0 0x55681b7e14c0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f857f755b80 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55681b75f240 0x55681b769460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f857f755b80 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55681b759810 0x55681b7689e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f857f755b80 1 --2- 172.21.15.70:0/3322456129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55681b75a1d0 0x55681b768f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f857f755b80 1 -- 172.21.15.70:0/3322456129 >> 172.21.15.70:0/3322456129 conn(0x55681b6d1860 msgr2=0x55681b7645d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f854fe00700 0 client.27139 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f857f755b80 1 -- 172.21.15.70:0/3322456129 shutdown_connections 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f857f755b80 1 -- 172.21.15.70:0/3322456129 wait complete. 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.875+0000 7f857f755b80 20 client.27139 trim_cache size 0 max 16384 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 -- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85540b2b20 msgr2=0x7f85540b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85540b2b20 0x7f85540b4fe0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8560009be0 tx=0x7f8560009260 comp rx=0 tx=0).stop 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 -- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8570075ff0 msgr2=0x7f857006dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8570075ff0 0x7f857006dcf0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f855c00e9f0 tx=0x7f855c00edb0 comp rx=0 tx=0).stop 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 -- 172.21.15.70:0/1945646847 shutdown_connections 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f85540b2b20 0x7f85540b4fe0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85701146d0 0x7f857006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:01.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f85700756d0 0x7f8570074c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:01.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 --2- 172.21.15.70:0/1945646847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8570075ff0 0x7f857006dcf0 secure :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f855c00e9f0 tx=0x7f855c00edb0 comp rx=0 tx=0).stop 2024-05-08T08:32:01.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.877+0000 7f8574e00700 1 -- 172.21.15.70:0/1945646847 >> 172.21.15.70:0/1945646847 conn(0x7f857007a650 msgr2=0x7f8570113490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:01.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.879+0000 7f8574e00700 1 -- 172.21.15.70:0/1945646847 shutdown_connections 2024-05-08T08:32:01.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:01.879+0000 7f8574e00700 1 -- 172.21.15.70:0/1945646847 wait complete. 2024-05-08T08:32:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:02 smithi194 ceph-mon[33679]: pgmap v3360: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2024-05-08T08:32:03.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:02 smithi070 ceph-mon[29591]: pgmap v3360: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2024-05-08T08:32:03.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:02 smithi172 ceph-mon[33377]: pgmap v3360: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2024-05-08T08:32:03.691 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '92a409df', quiesce took 38.8 seconds. Will release after: 18.0 2024-05-08T08:32:05.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:04 smithi194 ceph-mon[33679]: pgmap v3361: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2024-05-08T08:32:05.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:04 smithi070 ceph-mon[29591]: pgmap v3361: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2024-05-08T08:32:05.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:04 smithi172 ceph-mon[33377]: pgmap v3361: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 6 op/s 2024-05-08T08:32:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:06 smithi194 ceph-mon[33679]: pgmap v3362: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 127 KiB/s wr, 43 op/s 2024-05-08T08:32:07.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:06 smithi070 ceph-mon[29591]: pgmap v3362: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 127 KiB/s wr, 43 op/s 2024-05-08T08:32:07.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:06 smithi172 ceph-mon[33377]: pgmap v3362: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 127 KiB/s wr, 43 op/s 2024-05-08T08:32:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:08 smithi194 ceph-mon[33679]: pgmap v3363: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 127 KiB/s wr, 40 op/s 2024-05-08T08:32:09.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:08 smithi070 ceph-mon[29591]: pgmap v3363: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 127 KiB/s wr, 40 op/s 2024-05-08T08:32:09.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:08 smithi172 ceph-mon[33377]: pgmap v3363: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 127 KiB/s wr, 40 op/s 2024-05-08T08:32:11.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:10 smithi194 ceph-mon[33679]: pgmap v3364: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 224 KiB/s wr, 44 op/s 2024-05-08T08:32:11.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:10 smithi070 ceph-mon[29591]: pgmap v3364: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 224 KiB/s wr, 44 op/s 2024-05-08T08:32:11.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:10 smithi172 ceph-mon[33377]: pgmap v3364: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 224 KiB/s wr, 44 op/s 2024-05-08T08:32:12.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:11 smithi194 ceph-mon[33679]: osdmap e288: 12 total, 12 up, 12 in 2024-05-08T08:32:12.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:11 smithi070 ceph-mon[29591]: osdmap e288: 12 total, 12 up, 12 in 2024-05-08T08:32:12.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:11 smithi172 ceph-mon[33377]: osdmap e288: 12 total, 12 up, 12 in 2024-05-08T08:32:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:12 smithi194 ceph-mon[33679]: pgmap v3366: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 178 KiB/s wr, 49 op/s 2024-05-08T08:32:13.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:12 smithi070 ceph-mon[29591]: pgmap v3366: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 178 KiB/s wr, 49 op/s 2024-05-08T08:32:13.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:12 smithi172 ceph-mon[33377]: pgmap v3366: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 178 KiB/s wr, 49 op/s 2024-05-08T08:32:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:14 smithi194 ceph-mon[33679]: pgmap v3367: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 178 KiB/s wr, 49 op/s 2024-05-08T08:32:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:14 smithi070 ceph-mon[29591]: pgmap v3367: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 178 KiB/s wr, 49 op/s 2024-05-08T08:32:15.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:14 smithi172 ceph-mon[33377]: pgmap v3367: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 178 KiB/s wr, 49 op/s 2024-05-08T08:32:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:16 smithi194 ceph-mon[33679]: pgmap v3368: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T08:32:17.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:16 smithi070 ceph-mon[29591]: pgmap v3368: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T08:32:17.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:16 smithi172 ceph-mon[33377]: pgmap v3368: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T08:32:19.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:18 smithi070 ceph-mon[29591]: pgmap v3369: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T08:32:19.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:18 smithi172 ceph-mon[33377]: pgmap v3369: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T08:32:19.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:18 smithi194 ceph-mon[33679]: pgmap v3369: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T08:32:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:20 smithi194 ceph-mon[33679]: osdmap e289: 12 total, 12 up, 12 in 2024-05-08T08:32:20.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:20 smithi194 ceph-mon[33679]: pgmap v3371: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T08:32:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:20 smithi070 ceph-mon[29591]: osdmap e289: 12 total, 12 up, 12 in 2024-05-08T08:32:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:20 smithi070 ceph-mon[29591]: pgmap v3371: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T08:32:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:20 smithi172 ceph-mon[33377]: osdmap e289: 12 total, 12 up, 12 in 2024-05-08T08:32:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:20 smithi172 ceph-mon[33377]: pgmap v3371: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T08:32:21.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:32:22.152 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:32:22.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:22 smithi070 ceph-mon[29591]: pgmap v3372: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2024-05-08T08:32:22.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:22 smithi172 ceph-mon[33377]: pgmap v3372: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2024-05-08T08:32:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:22 smithi194 ceph-mon[33679]: pgmap v3372: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2024-05-08T08:32:24.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.578+0000 7f54a9c00700 1 -- 172.21.15.70:0/2401526997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 msgr2=0x7f54a410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.578+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2401526997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 0x7f54a410baa0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f5494009990 tx=0x7f5494009ca0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.578+0000 7f54a9c00700 1 -- 172.21.15.70:0/2401526997 shutdown_connections 2024-05-08T08:32:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.578+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2401526997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a4106080 0x7f54a4112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.578+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2401526997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 0x7f54a410baa0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.578+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2401526997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54a41056c0 0x7f54a4105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.578+0000 7f54a9c00700 1 -- 172.21.15.70:0/2401526997 >> 172.21.15.70:0/2401526997 conn(0x7f54a41011b0 msgr2=0x7f54a41035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.578+0000 7f54a9c00700 1 -- 172.21.15.70:0/2401526997 shutdown_connections 2024-05-08T08:32:24.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.578+0000 7f54a9c00700 1 -- 172.21.15.70:0/2401526997 wait complete. 2024-05-08T08:32:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.579+0000 7f54a9c00700 1 Processor -- start 2024-05-08T08:32:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a9c00700 1 -- start start 2024-05-08T08:32:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a9c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54a41056c0 0x7f54a41a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a9c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a4106080 0x7f54a41a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:24.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a9c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 0x7f54a419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a9c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54a4115750 con 0x7f54a410b6c0 2024-05-08T08:32:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a9c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54a41155d0 con 0x7f54a41056c0 2024-05-08T08:32:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a9c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f54a41158d0 con 0x7f54a4106080 2024-05-08T08:32:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 0x7f54a419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 0x7f54a419bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37568/0 (socket says 172.21.15.70:37568) 2024-05-08T08:32:24.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.580+0000 7f54a3400700 1 -- 172.21.15.70:0/2279424257 learned_addr learned my addr 172.21.15.70:0/2279424257 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f54a3400700 1 -- 172.21.15.70:0/2279424257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a4106080 msgr2=0x7f54a41a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f549be00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a4106080 0x7f54a41a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f54a2a00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54a41056c0 0x7f54a41a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f54a3400700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a4106080 0x7f54a41a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f54a3400700 1 -- 172.21.15.70:0/2279424257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54a41056c0 msgr2=0x7f54a41a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f54a3400700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54a41056c0 0x7f54a41a18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f54a3400700 1 -- 172.21.15.70:0/2279424257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a419c210 con 0x7f54a410b6c0 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f54a3400700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 0x7f54a419bab0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f549c007ee0 tx=0x7f549c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f549b400700 1 -- 172.21.15.70:0/2279424257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c00dbd0 con 0x7f54a410b6c0 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f549b400700 1 -- 172.21.15.70:0/2279424257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f549c00dd70 con 0x7f54a410b6c0 2024-05-08T08:32:24.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a419c500 con 0x7f54a410b6c0 2024-05-08T08:32:24.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.581+0000 7f549b400700 1 -- 172.21.15.70:0/2279424257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c0058d0 con 0x7f54a410b6c0 2024-05-08T08:32:24.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.582+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a41a87c0 con 0x7f54a410b6c0 2024-05-08T08:32:24.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.583+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a406a190 con 0x7f54a410b6c0 2024-05-08T08:32:24.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.585+0000 7f549b400700 1 -- 172.21.15.70:0/2279424257 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f549c01a020 con 0x7f54a410b6c0 2024-05-08T08:32:24.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.587+0000 7f549b400700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54880b29f0 0x7f54880b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:24.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.587+0000 7f549b400700 1 -- 172.21.15.70:0/2279424257 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(289..289 src has 1..289) ==== 9583+0+0 (secure 0 0 0) 0x7f549c0e2530 con 0x7f54a410b6c0 2024-05-08T08:32:24.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.587+0000 7f54a2a00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54880b29f0 0x7f54880b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:24.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.588+0000 7f54a2a00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54880b29f0 0x7f54880b4eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f549400b5c0 tx=0x7f5494005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:24.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.589+0000 7f549b400700 1 -- 172.21.15.70:0/2279424257 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f549c010070 con 0x7f54a410b6c0 2024-05-08T08:32:24.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.866+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54a402e510 con 0x7f54a410b6c0 2024-05-08T08:32:24.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:24 smithi070 ceph-mon[29591]: pgmap v3373: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2024-05-08T08:32:24.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.867+0000 7f549b400700 1 -- 172.21.15.70:0/2279424257 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f549c0a9a90 con 0x7f54a410b6c0 2024-05-08T08:32:24.861 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:32:24.861 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:32:24.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.870+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54880b29f0 msgr2=0x7f54880b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:24.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.870+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54880b29f0 0x7f54880b4eb0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f549400b5c0 tx=0x7f5494005fb0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.870+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 msgr2=0x7f54a419bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:24.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.870+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 0x7f54a419bab0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f549c007ee0 tx=0x7f549c00d3b0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.871+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 shutdown_connections 2024-05-08T08:32:24.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.871+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54880b29f0 0x7f54880b4eb0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.871+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54a410b6c0 0x7f54a419bab0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.871+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f54a41056c0 0x7f54a41a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.871+0000 7f54a9c00700 1 --2- 172.21.15.70:0/2279424257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a4106080 0x7f54a41a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:24.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.871+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 >> 172.21.15.70:0/2279424257 conn(0x7f54a41011b0 msgr2=0x7f54a4101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:24.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.871+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 shutdown_connections 2024-05-08T08:32:24.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:24.871+0000 7f54a9c00700 1 -- 172.21.15.70:0/2279424257 wait complete. 2024-05-08T08:32:24.865 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:32:24.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:24 smithi172 ceph-mon[33377]: pgmap v3373: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2024-05-08T08:32:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:24 smithi194 ceph-mon[33679]: pgmap v3373: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 41 KiB/s wr, 6 op/s 2024-05-08T08:32:25.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:25 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2279424257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:32:25.891 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 92a409df --release --await' 2024-05-08T08:32:25.892 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 92a409df --release --await 2024-05-08T08:32:25.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:25 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2279424257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:32:26.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:25 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2279424257' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:32:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:32:26.691 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:26 smithi070 ceph-mon[29591]: pgmap v3374: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2024-05-08T08:32:26.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:26 smithi172 ceph-mon[33377]: pgmap v3374: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2024-05-08T08:32:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:26 smithi194 ceph-mon[33679]: pgmap v3374: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2024-05-08T08:32:28.841 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:28 smithi070 ceph-mon[29591]: pgmap v3375: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2024-05-08T08:32:28.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:28 smithi172 ceph-mon[33377]: pgmap v3375: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2024-05-08T08:32:29.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:28 smithi194 ceph-mon[33679]: pgmap v3375: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 30 KiB/s wr, 6 op/s 2024-05-08T08:32:29.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.116+0000 7f915d200700 1 -- 172.21.15.70:0/4060685588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806bb40 msgr2=0x7f9158110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:29.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.116+0000 7f915d200700 1 --2- 172.21.15.70:0/4060685588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806bb40 0x7f9158110330 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f915000b0a0 tx=0x7f915000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.116+0000 7f915d200700 1 -- 172.21.15.70:0/4060685588 shutdown_connections 2024-05-08T08:32:29.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.116+0000 7f915d200700 1 --2- 172.21.15.70:0/4060685588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806bb40 0x7f9158110330 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.116+0000 7f915d200700 1 --2- 172.21.15.70:0/4060685588 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9158109510 0x7f91581098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.116+0000 7f915d200700 1 --2- 172.21.15.70:0/4060685588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f915806b180 0x7f915806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.116+0000 7f915d200700 1 -- 172.21.15.70:0/4060685588 >> 172.21.15.70:0/4060685588 conn(0x7f9158079350 msgr2=0x7f9158079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:29.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.116+0000 7f915d200700 1 -- 172.21.15.70:0/4060685588 shutdown_connections 2024-05-08T08:32:29.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.116+0000 7f915d200700 1 -- 172.21.15.70:0/4060685588 wait complete. 2024-05-08T08:32:29.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.118+0000 7f915d200700 1 Processor -- start 2024-05-08T08:32:29.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.118+0000 7f915d200700 1 -- start start 2024-05-08T08:32:29.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.118+0000 7f915d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806b180 0x7f915819f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.118+0000 7f915d200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f915806bb40 0x7f915819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.118+0000 7f915d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9158109510 0x7f91581997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.118+0000 7f915d200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91581134d0 con 0x7f915806b180 2024-05-08T08:32:29.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.118+0000 7f915d200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9158113350 con 0x7f9158109510 2024-05-08T08:32:29.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.118+0000 7f915d200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9158113650 con 0x7f915806bb40 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9155e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806b180 0x7f915819f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9155e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806b180 0x7f915819f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57522/0 (socket says 172.21.15.70:57522) 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9155e00700 1 -- 172.21.15.70:0/3989445580 learned_addr learned my addr 172.21.15.70:0/3989445580 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9155400700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f915806bb40 0x7f915819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9156800700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9158109510 0x7f91581997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9155e00700 1 -- 172.21.15.70:0/3989445580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f915806bb40 msgr2=0x7f915819fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9155e00700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f915806bb40 0x7f915819fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9155e00700 1 -- 172.21.15.70:0/3989445580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9158109510 msgr2=0x7f91581997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9155e00700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9158109510 0x7f91581997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.119+0000 7f9155e00700 1 -- 172.21.15.70:0/3989445580 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9158199f90 con 0x7f915806b180 2024-05-08T08:32:29.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.120+0000 7f9155e00700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806b180 0x7f915819f630 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f914800c9b0 tx=0x7f914800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:29.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.120+0000 7f914ea00700 1 -- 172.21.15.70:0/3989445580 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148007b00 con 0x7f915806b180 2024-05-08T08:32:29.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.120+0000 7f914ea00700 1 -- 172.21.15.70:0/3989445580 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9148007ca0 con 0x7f915806b180 2024-05-08T08:32:29.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.120+0000 7f914ea00700 1 -- 172.21.15.70:0/3989445580 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148018660 con 0x7f915806b180 2024-05-08T08:32:29.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.120+0000 7f915d200700 1 -- 172.21.15.70:0/3989445580 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f915819a280 con 0x7f915806b180 2024-05-08T08:32:29.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.120+0000 7f915d200700 1 -- 172.21.15.70:0/3989445580 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91581a6490 con 0x7f915806b180 2024-05-08T08:32:29.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.123+0000 7f914ea00700 1 -- 172.21.15.70:0/3989445580 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f914800f450 con 0x7f915806b180 2024-05-08T08:32:29.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.125+0000 7f914ea00700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f913c0b29f0 0x7f913c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.125+0000 7f914ea00700 1 -- 172.21.15.70:0/3989445580 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(289..289 src has 1..289) ==== 9583+0+0 (secure 0 0 0) 0x7f91480e2ae0 con 0x7f915806b180 2024-05-08T08:32:29.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.125+0000 7f9155400700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f913c0b29f0 0x7f913c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.126+0000 7f9155400700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f913c0b29f0 0x7f913c0b4eb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9144005950 tx=0x7f91440058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:29.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.138+0000 7f9167b37b80 1 Processor -- start 2024-05-08T08:32:29.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.139+0000 7f9167b37b80 1 -- start start 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.139+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc3ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.139+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3f3a0 0x564f9fc42e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.139+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc43390 0x564f9fc437d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.139+0000 7f9167b37b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564f9fb8cb20 con 0x564f9fc3f3a0 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.139+0000 7f9167b37b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564f9fb2a860 con 0x564f9fc43390 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.139+0000 7f9167b37b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564f9fb88ae0 con 0x564f9fc3ea80 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9155400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3f3a0 0x564f9fc42e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9155400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3f3a0 0x564f9fc42e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57530/0 (socket says 172.21.15.70:57530) 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9155400700 1 -- 172.21.15.70:0/1798667355 learned_addr learned my addr 172.21.15.70:0/1798667355 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9155e00700 1 --2- 172.21.15.70:0/1798667355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc3ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9156800700 1 --2- 172.21.15.70:0/1798667355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc43390 0x564f9fc437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9155400700 1 -- 172.21.15.70:0/1798667355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 msgr2=0x564f9fc3ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:29.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9155400700 1 --2- 172.21.15.70:0/1798667355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc3ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9155400700 1 -- 172.21.15.70:0/1798667355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc43390 msgr2=0x564f9fc437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:29.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9155400700 1 --2- 172.21.15.70:0/1798667355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc43390 0x564f9fc437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.140+0000 7f9155400700 1 -- 172.21.15.70:0/1798667355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f9fad99d0 con 0x564f9fc3f3a0 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.141+0000 7f9155400700 1 --2- 172.21.15.70:0/1798667355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3f3a0 0x564f9fc42e50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f914400fd40 tx=0x7f9144012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d90f1b5b7ce89a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.141+0000 7f9143400700 1 -- 172.21.15.70:0/1798667355 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144022070 con 0x564f9fc3f3a0 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.141+0000 7f9143400700 1 -- 172.21.15.70:0/1798667355 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9144011c60 con 0x564f9fc3f3a0 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.141+0000 7f9143400700 1 -- 172.21.15.70:0/1798667355 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914401d610 con 0x564f9fc3f3a0 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.142+0000 7f9167b37b80 1 -- 172.21.15.70:0/1798667355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3f3a0 msgr2=0x564f9fc42e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.142+0000 7f9167b37b80 1 --2- 172.21.15.70:0/1798667355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3f3a0 0x564f9fc42e50 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f914400fd40 tx=0x7f9144012000 comp rx=0 tx=0).stop 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.142+0000 7f9167b37b80 1 -- 172.21.15.70:0/1798667355 shutdown_connections 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.142+0000 7f9167b37b80 1 --2- 172.21.15.70:0/1798667355 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc43390 0x564f9fc437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.142+0000 7f9167b37b80 1 --2- 172.21.15.70:0/1798667355 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc3ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.142+0000 7f9167b37b80 1 --2- 172.21.15.70:0/1798667355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3f3a0 0x564f9fc42e50 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.142+0000 7f9167b37b80 1 -- 172.21.15.70:0/1798667355 >> 172.21.15.70:0/1798667355 conn(0x564f9fb68c60 msgr2=0x564f9fc34d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:29.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.142+0000 7f9167b37b80 1 -- 172.21.15.70:0/1798667355 shutdown_connections 2024-05-08T08:32:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.142+0000 7f9167b37b80 1 -- 172.21.15.70:0/1798667355 wait complete. 2024-05-08T08:32:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.143+0000 7f9167b37b80 1 -- start start 2024-05-08T08:32:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.143+0000 7f9167b37b80 1 Processor -- start 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc4a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 0x564f9fc47cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc48200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9167b37b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564f9fc4b5c0 con 0x564f9fc43390 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9167b37b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564f9faf2c20 con 0x564f9fc3f3a0 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9167b37b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564f9fc4b740 con 0x564f9fc3ea80 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9167b37b80 10 client.0 _ll_register_callbacks cb 0x564f9fb33d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9156800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc48200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9156800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc48200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57532/0 (socket says 172.21.15.70:57532) 2024-05-08T08:32:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9156800700 1 -- 172.21.15.70:0/3689352642 learned_addr learned my addr 172.21.15.70:0/3689352642 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:29.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9155e00700 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc4a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.144+0000 7f9155400700 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 0x564f9fc47cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9156800700 1 -- 172.21.15.70:0/3689352642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 msgr2=0x564f9fc4a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9156800700 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc4a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9156800700 1 -- 172.21.15.70:0/3689352642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 msgr2=0x564f9fc47cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9156800700 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 0x564f9fc47cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9156800700 1 -- 172.21.15.70:0/3689352642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f9fb52520 con 0x564f9fc43390 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9156800700 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc48200 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9150015000 tx=0x7f91500095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de21ba01f7f23eeb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9137e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9137e00700 1 -- 172.21.15.70:0/3689352642 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91500078f0 con 0x564f9fc43390 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9137e00700 1 -- 172.21.15.70:0/3689352642 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(289..289 src has 1..289) ==== 9583+0+0 (secure 0 0 0) 0x7f9150007a90 con 0x564f9fc43390 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.145+0000 7f9167b37b80 1 -- 172.21.15.70:0/3689352642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9144011c60 con 0x564f9fc43390 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.146+0000 7f9137e00700 1 -- 172.21.15.70:0/3689352642 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f915002e050 con 0x564f9fc43390 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.146+0000 7f9167b37b80 10 client.18228 fetch_fsmap learned FSMap version 42 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.146+0000 7f9167b37b80 1 -- 172.21.15.70:0/3689352642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x564f9fc55f40 con 0x564f9fc43390 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.146+0000 7f9137e00700 1 -- 172.21.15.70:0/3689352642 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9144011c60 con 0x564f9fc43390 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.146+0000 7f9137e00700 1 -- 172.21.15.70:0/3689352642 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9150011070 con 0x564f9fc43390 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.146+0000 7f9167b37b80 10 client.18228 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.146+0000 7f9167b37b80 10 client.18228 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:32:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.146+0000 7f9167b37b80 20 client.18228 populate_metadata read hostname 'smithi070' 2024-05-08T08:32:29.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.147+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564f9fc58520 0x564f9fc5a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.147+0000 7f9167b37b80 4 client.18228 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:32:29.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.147+0000 7f9167b37b80 1 -- 172.21.15.70:0/3689352642 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f9fc071a0 con 0x564f9fc58520 2024-05-08T08:32:29.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.147+0000 7f9155e00700 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564f9fc58520 0x564f9fc5a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.148+0000 7f9155e00700 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564f9fc58520 0x564f9fc5a940 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6185465f63c55a4 server_cookie=97c0054da03a981a in_seq=0 out_seq=0 2024-05-08T08:32:29.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.148+0000 7f9137e00700 10 client.18228 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:32:29.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.150+0000 7f9137e00700 1 -- 172.21.15.70:0/3689352642 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f9fc071a0 con 0x564f9fc58520 2024-05-08T08:32:29.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.150+0000 7f9137e00700 10 client.18228 handle_command_reply: tid=0 2024-05-08T08:32:29.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.150+0000 7f9167b37b80 1 client.18228 shutdown 2024-05-08T08:32:29.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 -- 172.21.15.70:0/3689352642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 msgr2=0x564f9fc48200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:29.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc48200 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9150015000 tx=0x7f91500095d0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 -- 172.21.15.70:0/3689352642 shutdown_connections 2024-05-08T08:32:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564f9fc58520 0x564f9fc5a940 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc48200 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc4a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3689352642 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 0x564f9fc47cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9137e00700 0 client.18228 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:32:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 -- 172.21.15.70:0/3689352642 >> 172.21.15.70:0/3689352642 conn(0x564f9fb68c60 msgr2=0x564f9fc34d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 -- 172.21.15.70:0/3689352642 shutdown_connections 2024-05-08T08:32:29.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 1 -- 172.21.15.70:0/3689352642 wait complete. 2024-05-08T08:32:29.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.151+0000 7f9167b37b80 20 client.18228 trim_cache size 0 max 16384 2024-05-08T08:32:29.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.193+0000 7f9167b37b80 1 Processor -- start 2024-05-08T08:32:29.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.193+0000 7f9167b37b80 1 -- start start 2024-05-08T08:32:29.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.194+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc54680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.194+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 0x564f9fc429b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.194+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc60210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.194+0000 7f9167b37b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91581afbe0 con 0x564f9fc43390 2024-05-08T08:32:29.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.194+0000 7f9167b37b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91581ad470 con 0x564f9fc3f3a0 2024-05-08T08:32:29.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.194+0000 7f9167b37b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f91581ab2e0 con 0x564f9fc3ea80 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.194+0000 7f9156800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc60210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.194+0000 7f9156800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc60210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57534/0 (socket says 172.21.15.70:57534) 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.194+0000 7f9156800700 1 -- 172.21.15.70:0/3135905568 learned_addr learned my addr 172.21.15.70:0/3135905568 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.195+0000 7f9155e00700 1 --2- 172.21.15.70:0/3135905568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc54680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.195+0000 7f9155400700 1 --2- 172.21.15.70:0/3135905568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 0x564f9fc429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.195+0000 7f9156800700 1 -- 172.21.15.70:0/3135905568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 msgr2=0x564f9fc54680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.195+0000 7f9156800700 1 --2- 172.21.15.70:0/3135905568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc54680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.195+0000 7f9156800700 1 -- 172.21.15.70:0/3135905568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 msgr2=0x564f9fc429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.195+0000 7f9156800700 1 --2- 172.21.15.70:0/3135905568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 0x564f9fc429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.195+0000 7f9156800700 1 -- 172.21.15.70:0/3135905568 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f9fc2f690 con 0x564f9fc43390 2024-05-08T08:32:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.196+0000 7f9156800700 1 --2- 172.21.15.70:0/3135905568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc60210 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f9150002230 tx=0x7f9150009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53909168a233de05 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.196+0000 7f9142a00700 1 -- 172.21.15.70:0/3135905568 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9150004de0 con 0x564f9fc43390 2024-05-08T08:32:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.196+0000 7f9142a00700 1 -- 172.21.15.70:0/3135905568 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9150005c60 con 0x564f9fc43390 2024-05-08T08:32:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.196+0000 7f9142a00700 1 -- 172.21.15.70:0/3135905568 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91500054a0 con 0x564f9fc43390 2024-05-08T08:32:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.197+0000 7f9167b37b80 1 -- 172.21.15.70:0/3135905568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 msgr2=0x564f9fc60210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.197+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3135905568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc60210 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f9150002230 tx=0x7f9150009800 comp rx=0 tx=0).stop 2024-05-08T08:32:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.197+0000 7f9167b37b80 1 -- 172.21.15.70:0/3135905568 shutdown_connections 2024-05-08T08:32:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.197+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3135905568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc43390 0x564f9fc60210 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.197+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3135905568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3ea80 0x564f9fc54680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.197+0000 7f9167b37b80 1 --2- 172.21.15.70:0/3135905568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc3f3a0 0x564f9fc429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.197+0000 7f9167b37b80 1 -- 172.21.15.70:0/3135905568 >> 172.21.15.70:0/3135905568 conn(0x564f9fb68c60 msgr2=0x564f9fc422a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.197+0000 7f9167b37b80 1 -- 172.21.15.70:0/3135905568 shutdown_connections 2024-05-08T08:32:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.197+0000 7f9167b37b80 1 -- 172.21.15.70:0/3135905568 wait complete. 2024-05-08T08:32:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.198+0000 7f9167b37b80 1 -- start start 2024-05-08T08:32:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.198+0000 7f9167b37b80 1 Processor -- start 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3ea80 0x564f9fc50c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3f3a0 0x564f9fc4b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9167b37b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc43390 0x564f9fc4bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9167b37b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91581ab930 con 0x564f9fc3ea80 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9167b37b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91581acda0 con 0x564f9fc43390 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9167b37b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f91581ac000 con 0x564f9fc3f3a0 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9167b37b80 10 client.0 _ll_register_callbacks cb 0x564f9fb33d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9155e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3ea80 0x564f9fc50c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9155e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3ea80 0x564f9fc50c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57544/0 (socket says 172.21.15.70:57544) 2024-05-08T08:32:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9155e00700 1 -- 172.21.15.70:0/2118839380 learned_addr learned my addr 172.21.15.70:0/2118839380 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.199+0000 7f9155400700 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3f3a0 0x564f9fc4b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9155e00700 1 -- 172.21.15.70:0/2118839380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3f3a0 msgr2=0x564f9fc4b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9155e00700 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3f3a0 0x564f9fc4b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9155e00700 1 -- 172.21.15.70:0/2118839380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc43390 msgr2=0x564f9fc4bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9155e00700 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc43390 0x564f9fc4bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9155e00700 1 -- 172.21.15.70:0/2118839380 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f9fc4c440 con 0x564f9fc3ea80 2024-05-08T08:32:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9155e00700 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3ea80 0x564f9fc50c60 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f914800a530 tx=0x7f91480a9500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cc23d98b5e6b53 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9137e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9137e00700 1 -- 172.21.15.70:0/2118839380 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f914808fe60 con 0x564f9fc3ea80 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9137e00700 1 -- 172.21.15.70:0/2118839380 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(289..289 src has 1..289) ==== 9583+0+0 (secure 0 0 0) 0x7f91480e0030 con 0x564f9fc3ea80 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.200+0000 7f9167b37b80 1 -- 172.21.15.70:0/2118839380 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9150005c60 con 0x564f9fc3ea80 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9137e00700 1 -- 172.21.15.70:0/2118839380 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f91480a9940 con 0x564f9fc3ea80 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9167b37b80 10 client.18234 fetch_fsmap learned FSMap version 42 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9167b37b80 1 -- 172.21.15.70:0/2118839380 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x564f9fcc8300 con 0x564f9fc3ea80 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9137e00700 1 -- 172.21.15.70:0/2118839380 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9150005c60 con 0x564f9fc3ea80 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9137e00700 1 -- 172.21.15.70:0/2118839380 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f91480cc0b0 con 0x564f9fc3ea80 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9167b37b80 10 client.18234 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9167b37b80 10 client.18234 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9167b37b80 20 client.18234 populate_metadata read hostname 'smithi070' 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9167b37b80 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564f9fcc8a10 0x564f9fccae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9167b37b80 4 client.18234 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "92a409df", "release": true, "await": true}] 2024-05-08T08:32:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.201+0000 7f9167b37b80 1 -- 172.21.15.70:0/2118839380 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "92a409df", "release": true, "await": true}) -- 0x564f9fb9a500 con 0x564f9fcc8a10 2024-05-08T08:32:29.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.202+0000 7f9155400700 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564f9fcc8a10 0x564f9fccae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:29.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.203+0000 7f9155400700 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564f9fcc8a10 0x564f9fccae30 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=720a0931199c7862 server_cookie=c4e7b312fb9fd6f5 in_seq=0 out_seq=0 2024-05-08T08:32:29.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:29.203+0000 7f9137e00700 10 client.18234 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:32:30.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:30 smithi172 ceph-mon[33377]: pgmap v3376: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:32:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:30 smithi194 ceph-mon[33679]: pgmap v3376: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:32:31.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:30 smithi070 ceph-mon[29591]: pgmap v3376: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:32:32.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:32 smithi172 ceph-mon[33377]: pgmap v3377: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:32:33.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:32 smithi194 ceph-mon[33679]: pgmap v3377: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:32:33.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:32 smithi070 ceph-mon[29591]: pgmap v3377: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:32:33.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.650+0000 7f9137e00700 1 -- 172.21.15.70:0/2118839380 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x564f9fb9a500 con 0x564f9fcc8a10 2024-05-08T08:32:33.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.650+0000 7f9137e00700 10 client.18234 handle_command_reply: tid=0 2024-05-08T08:32:33.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.650+0000 7f9167b37b80 1 client.18234 shutdown 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.651+0000 7f9167b37b80 1 -- 172.21.15.70:0/2118839380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3ea80 msgr2=0x564f9fc50c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.651+0000 7f9167b37b80 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3ea80 0x564f9fc50c60 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f914800a530 tx=0x7f91480a9500 comp rx=0 tx=0).stop 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.651+0000 7f9167b37b80 1 -- 172.21.15.70:0/2118839380 shutdown_connections 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.651+0000 7f9167b37b80 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564f9fcc8a10 0x564f9fccae30 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.651+0000 7f9167b37b80 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564f9fc43390 0x564f9fc4bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.651+0000 7f9167b37b80 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564f9fc3ea80 0x564f9fc50c60 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.651+0000 7f9167b37b80 1 --2- 172.21.15.70:0/2118839380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564f9fc3f3a0 0x564f9fc4b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.651+0000 7f9167b37b80 1 -- 172.21.15.70:0/2118839380 >> 172.21.15.70:0/2118839380 conn(0x564f9fb68c60 msgr2=0x564f9fc47240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.651+0000 7f9137e00700 0 client.18234 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.652+0000 7f9167b37b80 1 -- 172.21.15.70:0/2118839380 shutdown_connections 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.652+0000 7f9167b37b80 1 -- 172.21.15.70:0/2118839380 wait complete. 2024-05-08T08:32:33.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.652+0000 7f9167b37b80 20 client.18234 trim_cache size 0 max 16384 2024-05-08T08:32:33.647 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:32:33.647 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:32:33.647 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:32:33.647 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 240, 2024-05-08T08:32:33.647 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:32:33.647 INFO:teuthology.orchestra.run.smithi070.stdout: "92a409df": { 2024-05-08T08:32:33.647 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 240, 2024-05-08T08:32:33.647 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.0, 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:33.648 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:33.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:33.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:33.649 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:32:33.649 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:32:33.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 -- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f913c0b29f0 msgr2=0x7f913c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:33.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f913c0b29f0 0x7f913c0b4eb0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9144005950 tx=0x7f91440058e0 comp rx=0 tx=0).stop 2024-05-08T08:32:33.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 -- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806b180 msgr2=0x7f915819f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:33.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806b180 0x7f915819f630 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f914800c9b0 tx=0x7f914800cd70 comp rx=0 tx=0).stop 2024-05-08T08:32:33.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 -- 172.21.15.70:0/3989445580 shutdown_connections 2024-05-08T08:32:33.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f913c0b29f0 0x7f913c0b4eb0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:33.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9158109510 0x7f91581997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:33.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f915806b180 0x7f915819f630 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:33.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 --2- 172.21.15.70:0/3989445580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f915806bb40 0x7f915819fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:33.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.654+0000 7f915d200700 1 -- 172.21.15.70:0/3989445580 >> 172.21.15.70:0/3989445580 conn(0x7f9158079350 msgr2=0x7f9158101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:33.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.655+0000 7f915d200700 1 -- 172.21.15.70:0/3989445580 shutdown_connections 2024-05-08T08:32:33.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:33.655+0000 7f915d200700 1 -- 172.21.15.70:0/3989445580 wait complete. 2024-05-08T08:32:34.021 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_rpc_xdr.o 2024-05-08T08:32:34.601 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '92a409df', seconds elapsed: 69.7 2024-05-08T08:32:34.601 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.0 2024-05-08T08:32:34.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:32:34.638 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:34 smithi070 ceph-mon[29591]: pgmap v3378: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:32:34.673 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/x_tables.o 2024-05-08T08:32:34.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:34 smithi172 ceph-mon[33377]: pgmap v3378: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:32:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:34 smithi194 ceph-mon[33679]: pgmap v3378: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:32:35.201 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:32:35.802 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/tbxfload.o 2024-05-08T08:32:35.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:32:36.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:32:36.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:32:36.440 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/libfs.o 2024-05-08T08:32:36.722 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/radiotap.o 2024-05-08T08:32:36.726 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/driver-ops.o 2024-05-08T08:32:36.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:36 smithi172 ceph-mon[33377]: pgmap v3379: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 105 KiB/s wr, 11 op/s 2024-05-08T08:32:37.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:36 smithi194 ceph-mon[33679]: pgmap v3379: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 105 KiB/s wr, 11 op/s 2024-05-08T08:32:37.024 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:36 smithi070 ceph-mon[29591]: pgmap v3379: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 105 KiB/s wr, 11 op/s 2024-05-08T08:32:37.141 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_minisocks.o 2024-05-08T08:32:37.207 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ndisc.o 2024-05-08T08:32:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.691+0000 7f3f09000700 1 -- 172.21.15.70:0/2190305603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f04109510 msgr2=0x7f3f041098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.691+0000 7f3f09000700 1 --2- 172.21.15.70:0/2190305603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f04109510 0x7f3f041098f0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009990 tx=0x7f3ef4009ca0 comp rx=0 tx=0).stop 2024-05-08T08:32:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.692+0000 7f3f09000700 1 -- 172.21.15.70:0/2190305603 shutdown_connections 2024-05-08T08:32:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.692+0000 7f3f09000700 1 --2- 172.21.15.70:0/2190305603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0406bb40 0x7f3f04110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.692+0000 7f3f09000700 1 --2- 172.21.15.70:0/2190305603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f04109510 0x7f3f041098f0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.692+0000 7f3f09000700 1 --2- 172.21.15.70:0/2190305603 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0406b180 0x7f3f0406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.692+0000 7f3f09000700 1 -- 172.21.15.70:0/2190305603 >> 172.21.15.70:0/2190305603 conn(0x7f3f04079350 msgr2=0x7f3f04079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.692+0000 7f3f09000700 1 -- 172.21.15.70:0/2190305603 shutdown_connections 2024-05-08T08:32:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.692+0000 7f3f09000700 1 -- 172.21.15.70:0/2190305603 wait complete. 2024-05-08T08:32:37.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.693+0000 7f3f09000700 1 Processor -- start 2024-05-08T08:32:37.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.693+0000 7f3f09000700 1 -- start start 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f09000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0406b180 0x7f3f041a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f09000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0406bb40 0x7f3f041a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f09000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f04109510 0x7f3f0410e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f09000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f04113520 con 0x7f3f0406b180 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f09000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f041133a0 con 0x7f3f0406bb40 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f09000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f041136a0 con 0x7f3f04109510 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f01e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0406b180 0x7f3f041a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f01e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0406b180 0x7f3f041a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53560/0 (socket says 172.21.15.70:53560) 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f01e00700 1 -- 172.21.15.70:0/2801066687 learned_addr learned my addr 172.21.15.70:0/2801066687 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.694+0000 7f3f02800700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f04109510 0x7f3f0410e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.695+0000 7f3f01e00700 1 -- 172.21.15.70:0/2801066687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f04109510 msgr2=0x7f3f0410e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.695+0000 7f3f01e00700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f04109510 0x7f3f0410e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.695+0000 7f3f01e00700 1 -- 172.21.15.70:0/2801066687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0406bb40 msgr2=0x7f3f041a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.695+0000 7f3f01e00700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0406bb40 0x7f3f041a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.695+0000 7f3f01e00700 1 -- 172.21.15.70:0/2801066687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0410edd0 con 0x7f3f0406b180 2024-05-08T08:32:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.696+0000 7f3f01e00700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0406b180 0x7f3f041a0740 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400b5c0 tx=0x7f3ef40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.696+0000 7f3efaa00700 1 -- 172.21.15.70:0/2801066687 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4027070 con 0x7f3f0406b180 2024-05-08T08:32:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.696+0000 7f3efaa00700 1 -- 172.21.15.70:0/2801066687 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ef400fcc0 con 0x7f3f0406b180 2024-05-08T08:32:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.696+0000 7f3efaa00700 1 -- 172.21.15.70:0/2801066687 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4022c20 con 0x7f3f0406b180 2024-05-08T08:32:37.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.697+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f0410f060 con 0x7f3f0406b180 2024-05-08T08:32:37.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.698+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f0419c2f0 con 0x7f3f0406b180 2024-05-08T08:32:37.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.699+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f04104bd0 con 0x7f3f0406b180 2024-05-08T08:32:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.702+0000 7f3efaa00700 1 -- 172.21.15.70:0/2801066687 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3ef402a070 con 0x7f3f0406b180 2024-05-08T08:32:37.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.704+0000 7f3efaa00700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ee80b2af0 0x7f3ee80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:37.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.704+0000 7f3efaa00700 1 -- 172.21.15.70:0/2801066687 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(289..289 src has 1..289) ==== 9583+0+0 (secure 0 0 0) 0x7f3ef40e37b0 con 0x7f3f0406b180 2024-05-08T08:32:37.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.705+0000 7f3f01400700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ee80b2af0 0x7f3ee80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:37.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.706+0000 7f3f01400700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ee80b2af0 0x7f3ee80b4fb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0005950 tx=0x7f3ef00058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:37.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:37.712+0000 7f3efaa00700 1 -- 172.21.15.70:0/2801066687 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3ef4013070 con 0x7f3f0406b180 2024-05-08T08:32:38.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.179+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f0406a190 con 0x7f3f0406b180 2024-05-08T08:32:38.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.181+0000 7f3efaa00700 1 -- 172.21.15.70:0/2801066687 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f3ef40aada0 con 0x7f3f0406b180 2024-05-08T08:32:38.176 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:32:38.176 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:32:38.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.185+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ee80b2af0 msgr2=0x7f3ee80b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:38.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.185+0000 7f3f09000700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ee80b2af0 0x7f3ee80b4fb0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0005950 tx=0x7f3ef00058e0 comp rx=0 tx=0).stop 2024-05-08T08:32:38.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.185+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0406b180 msgr2=0x7f3f041a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:38.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.185+0000 7f3f09000700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0406b180 0x7f3f041a0740 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400b5c0 tx=0x7f3ef40057c0 comp rx=0 tx=0).stop 2024-05-08T08:32:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.186+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 shutdown_connections 2024-05-08T08:32:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.186+0000 7f3f09000700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ee80b2af0 0x7f3ee80b4fb0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.186+0000 7f3f09000700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f04109510 0x7f3f0410e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.186+0000 7f3f09000700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f0406b180 0x7f3f041a0740 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.186+0000 7f3f09000700 1 --2- 172.21.15.70:0/2801066687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f0406bb40 0x7f3f041a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.186+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 >> 172.21.15.70:0/2801066687 conn(0x7f3f04079350 msgr2=0x7f3f04102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.186+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 shutdown_connections 2024-05-08T08:32:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:38.186+0000 7f3f09000700 1 -- 172.21.15.70:0/2801066687 wait complete. 2024-05-08T08:32:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:32:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:38 smithi070 ceph-mon[29591]: pgmap v3380: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 105 KiB/s wr, 8 op/s 2024-05-08T08:32:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:38.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:38 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2801066687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:32:39.134 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 78.0 --await-for 42.0' 2024-05-08T08:32:39.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 78.0 --await-for 42.0 2024-05-08T08:32:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:38 smithi172 ceph-mon[33377]: pgmap v3380: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 105 KiB/s wr, 8 op/s 2024-05-08T08:32:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:38 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2801066687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:32:39.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:38 smithi194 ceph-mon[33679]: pgmap v3380: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 105 KiB/s wr, 8 op/s 2024-05-08T08:32:39.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:39.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:39.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:38 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2801066687' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:32:39.758 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:32:40.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:40.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:40.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:39 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:32:40.104 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:39 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:32:40.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:40.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:40.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:39 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:32:40.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:39 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:32:40.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:40.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:40.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:40.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:39 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:32:40.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:39 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:32:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:40 smithi070 ceph-mon[29591]: pgmap v3381: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 336 KiB/s wr, 18 op/s 2024-05-08T08:32:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:40 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:40 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:32:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:40 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:32:41.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:40 smithi172 ceph-mon[33377]: pgmap v3381: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 336 KiB/s wr, 18 op/s 2024-05-08T08:32:41.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:40 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:40 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:32:41.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:40 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:32:41.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:40 smithi194 ceph-mon[33679]: pgmap v3381: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 336 KiB/s wr, 18 op/s 2024-05-08T08:32:41.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:40 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:41.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:40 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:32:41.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:40 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:32:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.117+0000 7f06d7200700 1 -- 172.21.15.70:0/2963035979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8109a40 msgr2=0x7f06d81103e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.117+0000 7f06d7200700 1 --2- 172.21.15.70:0/2963035979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8109a40 0x7f06d81103e0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f06d000b0a0 tx=0x7f06d000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.118+0000 7f06d7200700 1 -- 172.21.15.70:0/2963035979 shutdown_connections 2024-05-08T08:32:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.118+0000 7f06d7200700 1 --2- 172.21.15.70:0/2963035979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8109a40 0x7f06d81103e0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.118+0000 7f06d7200700 1 --2- 172.21.15.70:0/2963035979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d8104540 0x7f06d8104920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.118+0000 7f06d7200700 1 --2- 172.21.15.70:0/2963035979 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d8104ef0 0x7f06d8109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.118+0000 7f06d7200700 1 -- 172.21.15.70:0/2963035979 >> 172.21.15.70:0/2963035979 conn(0x7f06d80fdcf0 msgr2=0x7f06d8100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.118+0000 7f06d7200700 1 -- 172.21.15.70:0/2963035979 shutdown_connections 2024-05-08T08:32:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.119+0000 7f06d7200700 1 -- 172.21.15.70:0/2963035979 wait complete. 2024-05-08T08:32:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.120+0000 7f06d7200700 1 Processor -- start 2024-05-08T08:32:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.120+0000 7f06d7200700 1 -- start start 2024-05-08T08:32:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.121+0000 7f06d7200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8104540 0x7f06d81a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.121+0000 7f06d7200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d8104ef0 0x7f06d81a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.121+0000 7f06d7200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d8109a40 0x7f06d819b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.121+0000 7f06d7200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81156c0 con 0x7f06d8104540 2024-05-08T08:32:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.121+0000 7f06d7200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8115540 con 0x7f06d8104ef0 2024-05-08T08:32:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.121+0000 7f06d7200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f06d8115840 con 0x7f06d8109a40 2024-05-08T08:32:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.121+0000 7f06d5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8104540 0x7f06d81a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.121+0000 7f06d5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8104540 0x7f06d81a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53588/0 (socket says 172.21.15.70:53588) 2024-05-08T08:32:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.121+0000 7f06d5e00700 1 -- 172.21.15.70:0/3313412934 learned_addr learned my addr 172.21.15.70:0/3313412934 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.122+0000 7f06d6800700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d8109a40 0x7f06d819b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.122+0000 7f06d5400700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d8104ef0 0x7f06d81a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.122+0000 7f06d5e00700 1 -- 172.21.15.70:0/3313412934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d8109a40 msgr2=0x7f06d819b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.122+0000 7f06d5e00700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d8109a40 0x7f06d819b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.122+0000 7f06d5e00700 1 -- 172.21.15.70:0/3313412934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d8104ef0 msgr2=0x7f06d81a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.122+0000 7f06d5e00700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d8104ef0 0x7f06d81a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.122+0000 7f06d5e00700 1 -- 172.21.15.70:0/3313412934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d819c040 con 0x7f06d8104540 2024-05-08T08:32:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.123+0000 7f06d5400700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d8104ef0 0x7f06d81a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:32:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.123+0000 7f06d5e00700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8104540 0x7f06d81a1720 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f06c800d950 tx=0x7f06c800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.124+0000 7f06cea00700 1 -- 172.21.15.70:0/3313412934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8016070 con 0x7f06d8104540 2024-05-08T08:32:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.124+0000 7f06cea00700 1 -- 172.21.15.70:0/3313412934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06c8010460 con 0x7f06d8104540 2024-05-08T08:32:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.124+0000 7f06cea00700 1 -- 172.21.15.70:0/3313412934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c800f620 con 0x7f06d8104540 2024-05-08T08:32:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.124+0000 7f06d7200700 1 -- 172.21.15.70:0/3313412934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d819c2d0 con 0x7f06d8104540 2024-05-08T08:32:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.124+0000 7f06d7200700 1 -- 172.21.15.70:0/3313412934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d8110920 con 0x7f06d8104540 2024-05-08T08:32:42.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.131+0000 7f06cea00700 1 -- 172.21.15.70:0/3313412934 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f06c8019070 con 0x7f06d8104540 2024-05-08T08:32:42.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.131+0000 7f06e7348b80 1 Processor -- start 2024-05-08T08:32:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.131+0000 7f06e7348b80 1 -- start start 2024-05-08T08:32:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.132+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b316c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.132+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b2b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.132+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b2c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.133+0000 7f06e7348b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557ce9a7dbb0 con 0x557ce9b312e0 2024-05-08T08:32:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.133+0000 7f06e7348b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ce9a1b8f0 con 0x557ce9b31c00 2024-05-08T08:32:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.134+0000 7f06e7348b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557ce9a79b70 con 0x557ce9b2be30 2024-05-08T08:32:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.133+0000 7f06d6800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.133+0000 7f06d5e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b2b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.134+0000 7f06cea00700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06bc0b2be0 0x7f06bc0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.134+0000 7f06d5e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b2b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36652/0 (socket says 172.21.15.70:36652) 2024-05-08T08:32:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.134+0000 7f06d5e00700 1 -- 172.21.15.70:0/4000998538 learned_addr learned my addr 172.21.15.70:0/4000998538 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.134+0000 7f06d5400700 1 --2- 172.21.15.70:0/4000998538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b2c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.134+0000 7f06cea00700 1 -- 172.21.15.70:0/3313412934 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(289..289 src has 1..289) ==== 9583+0+0 (secure 0 0 0) 0x7f06c80e25b0 con 0x7f06d8104540 2024-05-08T08:32:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.135+0000 7f06d6800700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06bc0b2be0 0x7f06bc0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.135+0000 7f06d5e00700 1 -- 172.21.15.70:0/4000998538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 msgr2=0x557ce9b2c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.136+0000 7f06d5e00700 1 --2- 172.21.15.70:0/4000998538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b2c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.136+0000 7f06d5e00700 1 -- 172.21.15.70:0/4000998538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 msgr2=0x557ce9b316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.136+0000 7f06d5e00700 1 --2- 172.21.15.70:0/4000998538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b316c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.136+0000 7f06d5e00700 1 -- 172.21.15.70:0/4000998538 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce99caa60 con 0x557ce9b31c00 2024-05-08T08:32:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.136+0000 7f06d5400700 1 --2- 172.21.15.70:0/4000998538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b2c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:32:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.137+0000 7f06d5e00700 1 --2- 172.21.15.70:0/4000998538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b2b810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06c80df7f0 tx=0x7f06c8000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67c172aafb9a591a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:42.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.138+0000 7f06d6800700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06bc0b2be0 0x7f06bc0b50a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f06d000b070 tx=0x7f06d000b3b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:42.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.138+0000 7f06c3400700 1 -- 172.21.15.70:0/4000998538 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c8020070 con 0x557ce9b31c00 2024-05-08T08:32:42.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.138+0000 7f06c3400700 1 -- 172.21.15.70:0/4000998538 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06c80a9410 con 0x557ce9b31c00 2024-05-08T08:32:42.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.138+0000 7f06c3400700 1 -- 172.21.15.70:0/4000998538 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80e2380 con 0x557ce9b31c00 2024-05-08T08:32:42.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.139+0000 7f06e7348b80 1 -- 172.21.15.70:0/4000998538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 msgr2=0x557ce9b2b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:42.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.139+0000 7f06e7348b80 1 --2- 172.21.15.70:0/4000998538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b2b810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f06c80df7f0 tx=0x7f06c8000bc0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.140+0000 7f06e7348b80 1 -- 172.21.15.70:0/4000998538 shutdown_connections 2024-05-08T08:32:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.140+0000 7f06e7348b80 1 --2- 172.21.15.70:0/4000998538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b2c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.140+0000 7f06e7348b80 1 --2- 172.21.15.70:0/4000998538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.140+0000 7f06e7348b80 1 --2- 172.21.15.70:0/4000998538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b2b810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.140+0000 7f06e7348b80 1 -- 172.21.15.70:0/4000998538 >> 172.21.15.70:0/4000998538 conn(0x557ce9aa3860 msgr2=0x557ce9b26370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.140+0000 7f06e7348b80 1 -- 172.21.15.70:0/4000998538 shutdown_connections 2024-05-08T08:32:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.140+0000 7f06e7348b80 1 -- 172.21.15.70:0/4000998538 wait complete. 2024-05-08T08:32:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.141+0000 7f06e7348b80 1 -- start start 2024-05-08T08:32:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.141+0000 7f06e7348b80 1 Processor -- start 2024-05-08T08:32:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.142+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b37870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.142+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b34c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.142+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b35150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.142+0000 7f06e7348b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557ce9b38710 con 0x557ce9b312e0 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.142+0000 7f06e7348b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557ce99e3cb0 con 0x557ce9b31c00 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.142+0000 7f06e7348b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557ce9b38890 con 0x557ce9b2be30 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.142+0000 7f06e7348b80 10 client.0 _ll_register_callbacks cb 0x557ce9a24e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.143+0000 7f06d5400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b34c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.143+0000 7f06d5400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b34c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53610/0 (socket says 172.21.15.70:53610) 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.143+0000 7f06d5400700 1 -- 172.21.15.70:0/2401122177 learned_addr learned my addr 172.21.15.70:0/2401122177 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.143+0000 7f06d6800700 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b35150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.143+0000 7f06d5e00700 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b37870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.144+0000 7f06d5400700 1 -- 172.21.15.70:0/2401122177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 msgr2=0x557ce9b37870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.144+0000 7f06d5400700 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b37870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.144+0000 7f06d5400700 1 -- 172.21.15.70:0/2401122177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 msgr2=0x557ce9b35150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.144+0000 7f06d5400700 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b35150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.144+0000 7f06d5400700 1 -- 172.21.15.70:0/2401122177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ce9a435b0 con 0x557ce9b312e0 2024-05-08T08:32:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.145+0000 7f06d5400700 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b34c10 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f06c4010620 tx=0x7f06c4010930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1c310d4b416e26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.145+0000 7f06b7e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:32:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.145+0000 7f06b7e00700 1 -- 172.21.15.70:0/2401122177 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4016070 con 0x557ce9b312e0 2024-05-08T08:32:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.146+0000 7f06e7348b80 1 -- 172.21.15.70:0/2401122177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06c80a9410 con 0x557ce9b312e0 2024-05-08T08:32:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.146+0000 7f06b7e00700 1 -- 172.21.15.70:0/2401122177 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(289..289 src has 1..289) ==== 9583+0+0 (secure 0 0 0) 0x7f06c4004220 con 0x557ce9b312e0 2024-05-08T08:32:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.146+0000 7f06b7e00700 1 -- 172.21.15.70:0/2401122177 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f06c4023050 con 0x557ce9b312e0 2024-05-08T08:32:42.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.146+0000 7f06e7348b80 10 client.18252 fetch_fsmap learned FSMap version 42 2024-05-08T08:32:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.146+0000 7f06e7348b80 1 -- 172.21.15.70:0/2401122177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557ce9b42f40 con 0x557ce9b312e0 2024-05-08T08:32:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.147+0000 7f06b7e00700 1 -- 172.21.15.70:0/2401122177 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06c80a9410 con 0x557ce9b312e0 2024-05-08T08:32:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.147+0000 7f06b7e00700 1 -- 172.21.15.70:0/2401122177 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f06c400f040 con 0x557ce9b312e0 2024-05-08T08:32:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.147+0000 7f06e7348b80 10 client.18252 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:32:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.147+0000 7f06e7348b80 10 client.18252 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:32:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.147+0000 7f06e7348b80 20 client.18252 populate_metadata read hostname 'smithi070' 2024-05-08T08:32:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.147+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ce9b454d0 0x557ce9b478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.147+0000 7f06e7348b80 4 client.18252 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:32:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.147+0000 7f06e7348b80 1 -- 172.21.15.70:0/2401122177 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ce9af82d0 con 0x557ce9b454d0 2024-05-08T08:32:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.148+0000 7f06d5e00700 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ce9b454d0 0x557ce9b478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.150+0000 7f06d5e00700 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ce9b454d0 0x557ce9b478c0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e39b02db9d48e18d server_cookie=efab42caeab2f7a8 in_seq=0 out_seq=0 2024-05-08T08:32:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.150+0000 7f06b7e00700 10 client.18252 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:32:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.152+0000 7f06b7e00700 1 -- 172.21.15.70:0/2401122177 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557ce9af82d0 con 0x557ce9b454d0 2024-05-08T08:32:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.152+0000 7f06b7e00700 10 client.18252 handle_command_reply: tid=0 2024-05-08T08:32:42.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.152+0000 7f06e7348b80 1 client.18252 shutdown 2024-05-08T08:32:42.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.152+0000 7f06e7348b80 1 -- 172.21.15.70:0/2401122177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 msgr2=0x557ce9b34c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:42.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.152+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b34c10 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f06c4010620 tx=0x7f06c4010930 comp rx=0 tx=0).stop 2024-05-08T08:32:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06e7348b80 1 -- 172.21.15.70:0/2401122177 shutdown_connections 2024-05-08T08:32:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ce9b454d0 0x557ce9b478c0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b31c00 0x557ce9b35150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b37870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2401122177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b312e0 0x557ce9b34c10 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06e7348b80 1 -- 172.21.15.70:0/2401122177 >> 172.21.15.70:0/2401122177 conn(0x557ce9aa3860 msgr2=0x557ce9b2a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:42.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06b7e00700 0 client.18252 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:32:42.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06e7348b80 1 -- 172.21.15.70:0/2401122177 shutdown_connections 2024-05-08T08:32:42.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06e7348b80 1 -- 172.21.15.70:0/2401122177 wait complete. 2024-05-08T08:32:42.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.153+0000 7f06e7348b80 20 client.18252 trim_cache size 0 max 16384 2024-05-08T08:32:42.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.186+0000 7f06e7348b80 1 Processor -- start 2024-05-08T08:32:42.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.186+0000 7f06e7348b80 1 -- start start 2024-05-08T08:32:42.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.186+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b2be30 0x557ce9b33500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.186+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b31c00 0x557ce9b33a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.186+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b4d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.186+0000 7f06e7348b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81b82d0 con 0x557ce9b2be30 2024-05-08T08:32:42.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.186+0000 7f06e7348b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81b5b60 con 0x557ce9b20730 2024-05-08T08:32:42.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.186+0000 7f06e7348b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81b39f0 con 0x557ce9b31c00 2024-05-08T08:32:42.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.187+0000 7f06d6800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b4d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.187+0000 7f06d5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b2be30 0x557ce9b33500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.187+0000 7f06d6800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b4d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36666/0 (socket says 172.21.15.70:36666) 2024-05-08T08:32:42.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.187+0000 7f06d6800700 1 -- 172.21.15.70:0/2014071331 learned_addr learned my addr 172.21.15.70:0/2014071331 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:42.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.187+0000 7f06d5400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b31c00 0x557ce9b33a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.188+0000 7f06d6800700 1 -- 172.21.15.70:0/2014071331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b31c00 msgr2=0x557ce9b33a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:42.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.188+0000 7f06d6800700 1 --2- 172.21.15.70:0/2014071331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b31c00 0x557ce9b33a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.188+0000 7f06d6800700 1 -- 172.21.15.70:0/2014071331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b2be30 msgr2=0x557ce9b33500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:42.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.189+0000 7f06d6800700 1 --2- 172.21.15.70:0/2014071331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b2be30 0x557ce9b33500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.189+0000 7f06d6800700 1 -- 172.21.15.70:0/2014071331 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ce9b349e0 con 0x557ce9b20730 2024-05-08T08:32:42.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.189+0000 7f06d5e00700 1 --2- 172.21.15.70:0/2014071331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b2be30 0x557ce9b33500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:32:42.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.189+0000 7f06d5400700 1 --2- 172.21.15.70:0/2014071331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b31c00 0x557ce9b33a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:32:42.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.190+0000 7f06d6800700 1 --2- 172.21.15.70:0/2014071331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b4d1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06d0015000 tx=0x7f06d0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c36ab8b0198128c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:42.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.190+0000 7f06c2a00700 1 -- 172.21.15.70:0/2014071331 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0007930 con 0x557ce9b20730 2024-05-08T08:32:42.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.190+0000 7f06c2a00700 1 -- 172.21.15.70:0/2014071331 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06d0024040 con 0x557ce9b20730 2024-05-08T08:32:42.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.190+0000 7f06c2a00700 1 -- 172.21.15.70:0/2014071331 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0020450 con 0x557ce9b20730 2024-05-08T08:32:42.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.191+0000 7f06e7348b80 1 -- 172.21.15.70:0/2014071331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 msgr2=0x557ce9b4d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:32:42.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.191+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2014071331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b4d1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06d0015000 tx=0x7f06d0009780 comp rx=0 tx=0).stop 2024-05-08T08:32:42.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.192+0000 7f06e7348b80 1 -- 172.21.15.70:0/2014071331 shutdown_connections 2024-05-08T08:32:42.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.192+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2014071331 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b4d1d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.192+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2014071331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b2be30 0x557ce9b33500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.192+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2014071331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b31c00 0x557ce9b33a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.192+0000 7f06e7348b80 1 -- 172.21.15.70:0/2014071331 >> 172.21.15.70:0/2014071331 conn(0x557ce9aa3860 msgr2=0x557ce9b2ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:32:42.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.192+0000 7f06e7348b80 1 -- 172.21.15.70:0/2014071331 shutdown_connections 2024-05-08T08:32:42.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.192+0000 7f06e7348b80 1 -- 172.21.15.70:0/2014071331 wait complete. 2024-05-08T08:32:42.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.193+0000 7f06e7348b80 1 -- start start 2024-05-08T08:32:42.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.193+0000 7f06e7348b80 1 Processor -- start 2024-05-08T08:32:42.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b3aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b3b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06e7348b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b31c00 0x557ce9bafd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06e7348b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81b4040 con 0x557ce9b31c00 2024-05-08T08:32:42.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06e7348b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81b5490 con 0x557ce9b20730 2024-05-08T08:32:42.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06e7348b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f06d81b46f0 con 0x557ce9b2be30 2024-05-08T08:32:42.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06e7348b80 10 client.0 _ll_register_callbacks cb 0x557ce9a24e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:32:42.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06d5400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b3b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06d5400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b3b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:49364/0 (socket says 172.21.15.70:49364) 2024-05-08T08:32:42.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.194+0000 7f06d5400700 1 -- 172.21.15.70:0/2378297450 learned_addr learned my addr 172.21.15.70:0/2378297450 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:32:42.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.195+0000 7f06d5e00700 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b3aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.195+0000 7f06d6800700 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b31c00 0x557ce9bafd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.195+0000 7f06d5400700 1 -- 172.21.15.70:0/2378297450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 msgr2=0x557ce9b3aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:42.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.195+0000 7f06d5400700 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b3aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.195+0000 7f06d5400700 1 -- 172.21.15.70:0/2378297450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b31c00 msgr2=0x557ce9bafd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:32:42.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.195+0000 7f06d5400700 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b31c00 0x557ce9bafd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:32:42.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.195+0000 7f06d5400700 1 -- 172.21.15.70:0/2378297450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ce9bb02d0 con 0x557ce9b2be30 2024-05-08T08:32:42.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.196+0000 7f06d5400700 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b3b030 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f06c4012a70 tx=0x7f06c4012e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a89e94086399de1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:32:42.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.196+0000 7f06b7e00700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T08:32:42.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.197+0000 7f06b7e00700 1 -- 172.21.15.70:0/2378297450 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c4016070 con 0x557ce9b2be30 2024-05-08T08:32:42.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.197+0000 7f06b7e00700 1 -- 172.21.15.70:0/2378297450 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(289..289 src has 1..289) ==== 9583+0+0 (secure 0 0 0) 0x7f06c4005280 con 0x557ce9b2be30 2024-05-08T08:32:42.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.197+0000 7f06e7348b80 1 -- 172.21.15.70:0/2378297450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06d0024040 con 0x557ce9b2be30 2024-05-08T08:32:42.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.198+0000 7f06b7e00700 1 -- 172.21.15.70:0/2378297450 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f06c402b020 con 0x557ce9b2be30 2024-05-08T08:32:42.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.198+0000 7f06e7348b80 10 client.27181 fetch_fsmap learned FSMap version 42 2024-05-08T08:32:42.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.198+0000 7f06e7348b80 1 -- 172.21.15.70:0/2378297450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557ce9bb1470 con 0x557ce9b2be30 2024-05-08T08:32:42.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.199+0000 7f06b7e00700 1 -- 172.21.15.70:0/2378297450 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06d0024040 con 0x557ce9b2be30 2024-05-08T08:32:42.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.199+0000 7f06b7e00700 1 -- 172.21.15.70:0/2378297450 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f06c4004ba0 con 0x557ce9b2be30 2024-05-08T08:32:42.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.199+0000 7f06e7348b80 10 client.27181 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:32:42.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.199+0000 7f06e7348b80 10 client.27181 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:32:42.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.199+0000 7f06e7348b80 20 client.27181 populate_metadata read hostname 'smithi070' 2024-05-08T08:32:42.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.199+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ce9bb1c70 0x557ce9bb4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:32:42.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.199+0000 7f06e7348b80 4 client.27181 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.0, "await_for": 42.0}] 2024-05-08T08:32:42.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.199+0000 7f06e7348b80 1 -- 172.21.15.70:0/2378297450 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.0, "await_for": 42.0}) -- 0x557ce9a8b590 con 0x557ce9bb1c70 2024-05-08T08:32:42.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.200+0000 7f06d5e00700 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ce9bb1c70 0x557ce9bb4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:32:42.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.201+0000 7f06d5e00700 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ce9bb1c70 0x557ce9bb4060 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=955ed2a8b337c49d server_cookie=e1339550fe55558d in_seq=0 out_seq=0 2024-05-08T08:32:42.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:32:42.201+0000 7f06b7e00700 10 client.27181 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:32:42.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:42.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:42.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:42.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:42.735 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/tbxfroot.o 2024-05-08T08:32:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:42.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:43 smithi070 ceph-mon[29591]: pgmap v3382: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 336 KiB/s wr, 16 op/s 2024-05-08T08:32:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:32:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:32:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:43.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:43 smithi172 ceph-mon[33377]: pgmap v3382: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 336 KiB/s wr, 16 op/s 2024-05-08T08:32:43.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:32:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:32:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:43.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:43 smithi194 ceph-mon[33679]: pgmap v3382: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 336 KiB/s wr, 16 op/s 2024-05-08T08:32:43.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:32:43.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:32:43.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:32:43.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:32:44.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:44 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:32:44.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:44 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:32:44.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:44 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:32:44.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:44 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:32:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:44 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:32:44.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:44 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:32:45.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:45 smithi070 ceph-mon[29591]: pgmap v3383: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 336 KiB/s wr, 16 op/s 2024-05-08T08:32:45.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:45 smithi172 ceph-mon[33377]: pgmap v3383: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 336 KiB/s wr, 16 op/s 2024-05-08T08:32:45.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:45 smithi194 ceph-mon[33679]: pgmap v3383: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 297 KiB/s rd, 336 KiB/s wr, 16 op/s 2024-05-08T08:32:46.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:46 smithi070 ceph-mon[29591]: pgmap v3384: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 506 KiB/s wr, 23 op/s 2024-05-08T08:32:46.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:46 smithi172 ceph-mon[33377]: pgmap v3384: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 506 KiB/s wr, 23 op/s 2024-05-08T08:32:46.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:46 smithi194 ceph-mon[33679]: pgmap v3384: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 506 KiB/s wr, 23 op/s 2024-05-08T08:32:48.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:48 smithi070 ceph-mon[29591]: pgmap v3385: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 401 KiB/s wr, 17 op/s 2024-05-08T08:32:48.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:48 smithi172 ceph-mon[33377]: pgmap v3385: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 401 KiB/s wr, 17 op/s 2024-05-08T08:32:49.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:48 smithi194 ceph-mon[33679]: pgmap v3385: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 401 KiB/s wr, 17 op/s 2024-05-08T08:32:50.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:50 smithi070 ceph-mon[29591]: pgmap v3386: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 439 KiB/s wr, 21 op/s 2024-05-08T08:32:50.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:50 smithi172 ceph-mon[33377]: pgmap v3386: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 439 KiB/s wr, 21 op/s 2024-05-08T08:32:51.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:50 smithi194 ceph-mon[33679]: pgmap v3386: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 439 KiB/s wr, 21 op/s 2024-05-08T08:32:52.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:52 smithi070 ceph-mon[29591]: pgmap v3387: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 207 KiB/s wr, 10 op/s 2024-05-08T08:32:52.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:52 smithi172 ceph-mon[33377]: pgmap v3387: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 207 KiB/s wr, 10 op/s 2024-05-08T08:32:53.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:52 smithi194 ceph-mon[33679]: pgmap v3387: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 207 KiB/s wr, 10 op/s 2024-05-08T08:32:54.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:54 smithi070 ceph-mon[29591]: pgmap v3388: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 207 KiB/s wr, 10 op/s 2024-05-08T08:32:54.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:54 smithi172 ceph-mon[33377]: pgmap v3388: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 207 KiB/s wr, 10 op/s 2024-05-08T08:32:55.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:54 smithi194 ceph-mon[33679]: pgmap v3388: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 207 KiB/s wr, 10 op/s 2024-05-08T08:32:56.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:56 smithi172 ceph-mon[33377]: pgmap v3389: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 207 KiB/s wr, 13 op/s 2024-05-08T08:32:57.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:56 smithi194 ceph-mon[33679]: pgmap v3389: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 207 KiB/s wr, 13 op/s 2024-05-08T08:32:57.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:56 smithi070 ceph-mon[29591]: pgmap v3389: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 207 KiB/s wr, 13 op/s 2024-05-08T08:32:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:32:58 smithi070 ceph-mon[29591]: pgmap v3390: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-05-08T08:32:58.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:32:58 smithi172 ceph-mon[33377]: pgmap v3390: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-05-08T08:32:59.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:32:58 smithi194 ceph-mon[33679]: pgmap v3390: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 38 KiB/s wr, 7 op/s 2024-05-08T08:33:00.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:00 smithi172 ceph-mon[33377]: pgmap v3391: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 110 KiB/s wr, 12 op/s 2024-05-08T08:33:01.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:00 smithi194 ceph-mon[33679]: pgmap v3391: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 110 KiB/s wr, 12 op/s 2024-05-08T08:33:01.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:00 smithi070 ceph-mon[29591]: pgmap v3391: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 110 KiB/s wr, 12 op/s 2024-05-08T08:33:02.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:02 smithi172 ceph-mon[33377]: pgmap v3392: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 72 KiB/s wr, 8 op/s 2024-05-08T08:33:03.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:02 smithi194 ceph-mon[33679]: pgmap v3392: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 72 KiB/s wr, 8 op/s 2024-05-08T08:33:03.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:02 smithi070 ceph-mon[29591]: pgmap v3392: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 72 KiB/s wr, 8 op/s 2024-05-08T08:33:04.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:04 smithi172 ceph-mon[33377]: pgmap v3393: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 72 KiB/s wr, 8 op/s 2024-05-08T08:33:05.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:04 smithi194 ceph-mon[33679]: pgmap v3393: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 72 KiB/s wr, 8 op/s 2024-05-08T08:33:05.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:04 smithi070 ceph-mon[29591]: pgmap v3393: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 72 KiB/s wr, 8 op/s 2024-05-08T08:33:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06b7e00700 1 -- 172.21.15.70:0/2378297450 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x557ce9a8b590 con 0x557ce9bb1c70 2024-05-08T08:33:05.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06b7e00700 10 client.27181 handle_command_reply: tid=0 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06e7348b80 1 client.27181 shutdown 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06e7348b80 1 -- 172.21.15.70:0/2378297450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 msgr2=0x557ce9b3b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b3b030 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f06c4012a70 tx=0x7f06c4012e20 comp rx=0 tx=0).stop 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06e7348b80 1 -- 172.21.15.70:0/2378297450 shutdown_connections 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557ce9bb1c70 0x557ce9bb4060 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557ce9b31c00 0x557ce9bafd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557ce9b20730 0x557ce9b3aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06e7348b80 1 --2- 172.21.15.70:0/2378297450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557ce9b2be30 0x557ce9b3b030 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06e7348b80 1 -- 172.21.15.70:0/2378297450 >> 172.21.15.70:0/2378297450 conn(0x557ce9aa3860 msgr2=0x557ce9b334c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.337+0000 7f06b7e00700 0 client.27181 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.338+0000 7f06e7348b80 1 -- 172.21.15.70:0/2378297450 shutdown_connections 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.338+0000 7f06e7348b80 1 -- 172.21.15.70:0/2378297450 wait complete. 2024-05-08T08:33:05.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.338+0000 7f06e7348b80 20 client.27181 trim_cache size 0 max 16384 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 242, 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "a526a930": { 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 242, 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:33:05.333 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.0, 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:05.334 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 -- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06bc0b2be0 msgr2=0x7f06bc0b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06bc0b2be0 0x7f06bc0b50a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f06d000b070 tx=0x7f06d000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 -- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8104540 msgr2=0x7f06d81a1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8104540 0x7f06d81a1720 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f06c800d950 tx=0x7f06c800dd10 comp rx=0 tx=0).stop 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 -- 172.21.15.70:0/3313412934 shutdown_connections 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f06bc0b2be0 0x7f06bc0b50a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f06d8109a40 0x7f06d819b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f06d8104540 0x7f06d81a1720 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 --2- 172.21.15.70:0/3313412934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f06d8104ef0 0x7f06d81a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:05.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 -- 172.21.15.70:0/3313412934 >> 172.21.15.70:0/3313412934 conn(0x7f06d80fdcf0 msgr2=0x7f06d80ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 -- 172.21.15.70:0/3313412934 shutdown_connections 2024-05-08T08:33:05.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:05.339+0000 7f06d7200700 1 -- 172.21.15.70:0/3313412934 wait complete. 2024-05-08T08:33:06.865 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a526a930', quiesce took 32.3 seconds. Will release after: 18.0 2024-05-08T08:33:06.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:06 smithi172 ceph-mon[33377]: pgmap v3394: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-05-08T08:33:07.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:06 smithi194 ceph-mon[33679]: pgmap v3394: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-05-08T08:33:07.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:06 smithi070 ceph-mon[29591]: pgmap v3394: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 72 KiB/s wr, 11 op/s 2024-05-08T08:33:08.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:08 smithi172 ceph-mon[33377]: pgmap v3395: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 72 KiB/s wr, 8 op/s 2024-05-08T08:33:09.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:08 smithi194 ceph-mon[33679]: pgmap v3395: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 72 KiB/s wr, 8 op/s 2024-05-08T08:33:09.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:08 smithi070 ceph-mon[29591]: pgmap v3395: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 72 KiB/s wr, 8 op/s 2024-05-08T08:33:10.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:10 smithi172 ceph-mon[33377]: pgmap v3396: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 154 KiB/s wr, 28 op/s 2024-05-08T08:33:11.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:10 smithi194 ceph-mon[33679]: pgmap v3396: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 154 KiB/s wr, 28 op/s 2024-05-08T08:33:11.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:10 smithi070 ceph-mon[29591]: pgmap v3396: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 154 KiB/s wr, 28 op/s 2024-05-08T08:33:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:12 smithi194 ceph-mon[33679]: pgmap v3397: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 81 KiB/s wr, 23 op/s 2024-05-08T08:33:13.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:12 smithi070 ceph-mon[29591]: pgmap v3397: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 81 KiB/s wr, 23 op/s 2024-05-08T08:33:13.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:12 smithi172 ceph-mon[33377]: pgmap v3397: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 81 KiB/s wr, 23 op/s 2024-05-08T08:33:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:14 smithi194 ceph-mon[33679]: pgmap v3398: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 81 KiB/s wr, 23 op/s 2024-05-08T08:33:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:14 smithi070 ceph-mon[29591]: pgmap v3398: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 81 KiB/s wr, 23 op/s 2024-05-08T08:33:15.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:14 smithi172 ceph-mon[33377]: pgmap v3398: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 81 KiB/s wr, 23 op/s 2024-05-08T08:33:16.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:15 smithi194 ceph-mon[33679]: osdmap e290: 12 total, 12 up, 12 in 2024-05-08T08:33:16.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:15 smithi070 ceph-mon[29591]: osdmap e290: 12 total, 12 up, 12 in 2024-05-08T08:33:16.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:15 smithi172 ceph-mon[33377]: osdmap e290: 12 total, 12 up, 12 in 2024-05-08T08:33:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:16 smithi194 ceph-mon[33679]: pgmap v3400: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 168 KiB/s wr, 27 op/s 2024-05-08T08:33:17.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:16 smithi070 ceph-mon[29591]: pgmap v3400: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 168 KiB/s wr, 27 op/s 2024-05-08T08:33:17.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:16 smithi172 ceph-mon[33377]: pgmap v3400: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 168 KiB/s wr, 27 op/s 2024-05-08T08:33:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:18 smithi194 ceph-mon[33679]: pgmap v3401: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 168 KiB/s wr, 27 op/s 2024-05-08T08:33:19.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:18 smithi070 ceph-mon[29591]: pgmap v3401: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 168 KiB/s wr, 27 op/s 2024-05-08T08:33:19.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:18 smithi172 ceph-mon[33377]: pgmap v3401: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 168 KiB/s wr, 27 op/s 2024-05-08T08:33:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:20 smithi194 ceph-mon[33679]: pgmap v3402: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T08:33:21.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:20 smithi070 ceph-mon[29591]: pgmap v3402: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T08:33:21.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:20 smithi172 ceph-mon[33377]: pgmap v3402: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T08:33:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:22 smithi194 ceph-mon[33679]: pgmap v3403: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T08:33:23.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:22 smithi070 ceph-mon[29591]: pgmap v3403: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T08:33:23.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:22 smithi172 ceph-mon[33377]: pgmap v3403: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T08:33:24.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:33:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:24 smithi194 ceph-mon[33679]: pgmap v3404: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T08:33:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:24 smithi194 ceph-mon[33679]: osdmap e291: 12 total, 12 up, 12 in 2024-05-08T08:33:25.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:24 smithi070 ceph-mon[29591]: pgmap v3404: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T08:33:25.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:24 smithi070 ceph-mon[29591]: osdmap e291: 12 total, 12 up, 12 in 2024-05-08T08:33:25.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:24 smithi172 ceph-mon[33377]: pgmap v3404: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 71 KiB/s wr, 6 op/s 2024-05-08T08:33:25.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:24 smithi172 ceph-mon[33377]: osdmap e291: 12 total, 12 up, 12 in 2024-05-08T08:33:25.330 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:33:26.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:26 smithi070 ceph-mon[29591]: pgmap v3406: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T08:33:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:26 smithi194 ceph-mon[33679]: pgmap v3406: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T08:33:27.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:26 smithi172 ceph-mon[33377]: pgmap v3406: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T08:33:27.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.847+0000 7f56ab400700 1 -- 172.21.15.70:0/2933970288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4108850 msgr2=0x7f56a41103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.847+0000 7f56ab400700 1 --2- 172.21.15.70:0/2933970288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4108850 0x7f56a41103d0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f569c00b0d0 tx=0x7f569c00b3e0 comp rx=0 tx=0).stop 2024-05-08T08:33:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.847+0000 7f56ab400700 1 -- 172.21.15.70:0/2933970288 shutdown_connections 2024-05-08T08:33:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.847+0000 7f56ab400700 1 --2- 172.21.15.70:0/2933970288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4108850 0x7f56a41103d0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.847+0000 7f56ab400700 1 --2- 172.21.15.70:0/2933970288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a4103750 0x7f56a4103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.847+0000 7f56ab400700 1 --2- 172.21.15.70:0/2933970288 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a4104100 0x7f56a4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.847+0000 7f56ab400700 1 -- 172.21.15.70:0/2933970288 >> 172.21.15.70:0/2933970288 conn(0x7f56a407a600 msgr2=0x7f56a407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.847+0000 7f56ab400700 1 -- 172.21.15.70:0/2933970288 shutdown_connections 2024-05-08T08:33:27.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.847+0000 7f56ab400700 1 -- 172.21.15.70:0/2933970288 wait complete. 2024-05-08T08:33:27.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.849+0000 7f56ab400700 1 Processor -- start 2024-05-08T08:33:27.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.849+0000 7f56ab400700 1 -- start start 2024-05-08T08:33:27.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.849+0000 7f56ab400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a4103750 0x7f56a419f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:27.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.849+0000 7f56ab400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4104100 0x7f56a419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:27.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.849+0000 7f56ab400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a4108850 0x7f56a41998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:27.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.849+0000 7f56ab400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56a41135a0 con 0x7f56a4104100 2024-05-08T08:33:27.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.849+0000 7f56ab400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56a4113420 con 0x7f56a4103750 2024-05-08T08:33:27.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.849+0000 7f56ab400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f56a4113720 con 0x7f56a4108850 2024-05-08T08:33:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4104100 0x7f56a419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4104100 0x7f56a419fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43088/0 (socket says 172.21.15.70:43088) 2024-05-08T08:33:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a3e00700 1 -- 172.21.15.70:0/3763407428 learned_addr learned my addr 172.21.15.70:0/3763407428 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:33:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a8a00700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a4103750 0x7f56a419f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a9400700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a4108850 0x7f56a41998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a3e00700 1 -- 172.21.15.70:0/3763407428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a4108850 msgr2=0x7f56a41998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:27.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a3e00700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a4108850 0x7f56a41998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a3e00700 1 -- 172.21.15.70:0/3763407428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a4103750 msgr2=0x7f56a419f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a3e00700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a4103750 0x7f56a419f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a3e00700 1 -- 172.21.15.70:0/3763407428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56a419a000 con 0x7f56a4104100 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.850+0000 7f56a8a00700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a4103750 0x7f56a419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.851+0000 7f56a3e00700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4104100 0x7f56a419fc20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f569000d950 tx=0x7f569000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.851+0000 7f56a1600700 1 -- 172.21.15.70:0/3763407428 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5690016070 con 0x7f56a4104100 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.851+0000 7f56a1600700 1 -- 172.21.15.70:0/3763407428 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5690010460 con 0x7f56a4104100 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.851+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56a419a2f0 con 0x7f56a4104100 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.851+0000 7f56a1600700 1 -- 172.21.15.70:0/3763407428 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569000f620 con 0x7f56a4104100 2024-05-08T08:33:27.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.851+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56a41a65b0 con 0x7f56a4104100 2024-05-08T08:33:27.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.852+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56a406a190 con 0x7f56a4104100 2024-05-08T08:33:27.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.854+0000 7f56a1600700 1 -- 172.21.15.70:0/3763407428 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5690019070 con 0x7f56a4104100 2024-05-08T08:33:27.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.856+0000 7f56a1600700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f568c0b2a70 0x7f568c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:27.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.856+0000 7f56a1600700 1 -- 172.21.15.70:0/3763407428 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(291..291 src has 1..291) ==== 9583+0+0 (secure 0 0 0) 0x7f56900e29f0 con 0x7f56a4104100 2024-05-08T08:33:27.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.856+0000 7f56a8a00700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f568c0b2a70 0x7f568c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:27.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.857+0000 7f56a8a00700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f568c0b2a70 0x7f568c0b4f30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f56a419a9e0 tx=0x7f5698008040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:33:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:27.861+0000 7f56a1600700 1 -- 172.21.15.70:0/3763407428 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f56900a9f50 con 0x7f56a4104100 2024-05-08T08:33:28.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.143+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56a402e510 con 0x7f56a4104100 2024-05-08T08:33:28.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.145+0000 7f56a1600700 1 -- 172.21.15.70:0/3763407428 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f56900a9850 con 0x7f56a4104100 2024-05-08T08:33:28.138 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:33:28.139 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:33:28.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f568c0b2a70 msgr2=0x7f568c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:28.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f568c0b2a70 0x7f568c0b4f30 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f56a419a9e0 tx=0x7f5698008040 comp rx=0 tx=0).stop 2024-05-08T08:33:28.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4104100 msgr2=0x7f56a419fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:28.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4104100 0x7f56a419fc20 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f569000d950 tx=0x7f569000dd10 comp rx=0 tx=0).stop 2024-05-08T08:33:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 shutdown_connections 2024-05-08T08:33:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f568c0b2a70 0x7f568c0b4f30 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56a4108850 0x7f56a41998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56a4103750 0x7f56a419f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 --2- 172.21.15.70:0/3763407428 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56a4104100 0x7f56a419fc20 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 >> 172.21.15.70:0/3763407428 conn(0x7f56a407a600 msgr2=0x7f56a41018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.148+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 shutdown_connections 2024-05-08T08:33:28.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:28.149+0000 7f56ab400700 1 -- 172.21.15.70:0/3763407428 wait complete. 2024-05-08T08:33:28.143 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:33:28.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:28 smithi070 ceph-mon[29591]: pgmap v3407: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T08:33:28.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:28 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3763407428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:33:28.992 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id a526a930 --release --await' 2024-05-08T08:33:28.992 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id a526a930 --release --await 2024-05-08T08:33:29.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:28 smithi172 ceph-mon[33377]: pgmap v3407: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T08:33:29.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:28 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3763407428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:33:29.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:28 smithi194 ceph-mon[33679]: pgmap v3407: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T08:33:29.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:28 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3763407428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:33:29.449 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:33:31.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:30 smithi070 ceph-mon[29591]: pgmap v3408: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:33:31.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:30 smithi172 ceph-mon[33377]: pgmap v3408: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:33:31.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:30 smithi194 ceph-mon[33679]: pgmap v3408: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:33:31.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.737+0000 7f5362000700 1 -- 172.21.15.70:0/1110339988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06bb70 msgr2=0x7f535c06bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:31.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.737+0000 7f5362000700 1 --2- 172.21.15.70:0/1110339988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06bb70 0x7f535c06bff0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f5348009990 tx=0x7f5348009ca0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.737+0000 7f5362000700 1 -- 172.21.15.70:0/1110339988 shutdown_connections 2024-05-08T08:33:31.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.737+0000 7f5362000700 1 --2- 172.21.15.70:0/1110339988 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c06c530 0x7f535c110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.737+0000 7f5362000700 1 --2- 172.21.15.70:0/1110339988 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f535c109530 0x7f535c109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.737+0000 7f5362000700 1 --2- 172.21.15.70:0/1110339988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06bb70 0x7f535c06bff0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.737+0000 7f5362000700 1 -- 172.21.15.70:0/1110339988 >> 172.21.15.70:0/1110339988 conn(0x7f535c079350 msgr2=0x7f535c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:31.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.737+0000 7f5362000700 1 -- 172.21.15.70:0/1110339988 shutdown_connections 2024-05-08T08:33:31.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.737+0000 7f5362000700 1 -- 172.21.15.70:0/1110339988 wait complete. 2024-05-08T08:33:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.738+0000 7f5362000700 1 Processor -- start 2024-05-08T08:33:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.738+0000 7f5362000700 1 -- start start 2024-05-08T08:33:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f5362000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f535c06bb70 0x7f535c1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f5362000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06c530 0x7f535c1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f5362000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c109530 0x7f535c19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f5362000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f535c113510 con 0x7f535c06c530 2024-05-08T08:33:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f5362000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f535c113390 con 0x7f535c109530 2024-05-08T08:33:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f5362000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f535c113690 con 0x7f535c06bb70 2024-05-08T08:33:31.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f535aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06c530 0x7f535c1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f535aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06c530 0x7f535c1a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43098/0 (socket says 172.21.15.70:43098) 2024-05-08T08:33:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f535aa00700 1 -- 172.21.15.70:0/1814918740 learned_addr learned my addr 172.21.15.70:0/1814918740 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:33:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.739+0000 7f535b400700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f535c06bb70 0x7f535c1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f535be00700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c109530 0x7f535c19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f535aa00700 1 -- 172.21.15.70:0/1814918740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f535c06bb70 msgr2=0x7f535c1a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f535aa00700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f535c06bb70 0x7f535c1a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f535aa00700 1 -- 172.21.15.70:0/1814918740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c109530 msgr2=0x7f535c19ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f535aa00700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c109530 0x7f535c19ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f535aa00700 1 -- 172.21.15.70:0/1814918740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c19c1d0 con 0x7f535c06c530 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f535be00700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c109530 0x7f535c19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f535aa00700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06c530 0x7f535c1a1df0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f53480057c0 tx=0x7f5348009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f5353e00700 1 -- 172.21.15.70:0/1814918740 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348027070 con 0x7f535c06c530 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f5362000700 1 -- 172.21.15.70:0/1814918740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535c19c460 con 0x7f535c06c530 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f5353e00700 1 -- 172.21.15.70:0/1814918740 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f534800fda0 con 0x7f535c06c530 2024-05-08T08:33:31.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.740+0000 7f5353e00700 1 -- 172.21.15.70:0/1814918740 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5348022ca0 con 0x7f535c06c530 2024-05-08T08:33:31.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.741+0000 7f5362000700 1 -- 172.21.15.70:0/1814918740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535c1a8780 con 0x7f535c06c530 2024-05-08T08:33:31.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.744+0000 7f5353e00700 1 -- 172.21.15.70:0/1814918740 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f534802a070 con 0x7f535c06c530 2024-05-08T08:33:31.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.746+0000 7f5353e00700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53400b29f0 0x7f53400b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.746+0000 7f5353e00700 1 -- 172.21.15.70:0/1814918740 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(291..291 src has 1..291) ==== 9583+0+0 (secure 0 0 0) 0x7f53480e3910 con 0x7f535c06c530 2024-05-08T08:33:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.746+0000 7f535b400700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53400b29f0 0x7f53400b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.747+0000 7f535b400700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53400b29f0 0x7f53400b4eb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f534c005e10 tx=0x7f534c005d40 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:33:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.758+0000 7f536c9d5b80 1 Processor -- start 2024-05-08T08:33:31.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.758+0000 7f536c9d5b80 1 -- start start 2024-05-08T08:33:31.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.758+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a00c1b0 0x55837a00c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.758+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 0x55837a006c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.758+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a012f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.758+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558379f58b20 con 0x55837a007140 2024-05-08T08:33:31.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.758+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558379ef6860 con 0x55837a00c1b0 2024-05-08T08:33:31.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.758+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558379f54ae0 con 0x55837a006780 2024-05-08T08:33:31.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a012f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a012f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43112/0 (socket says 172.21.15.70:43112) 2024-05-08T08:33:31.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535be00700 1 -- 172.21.15.70:0/3420276335 learned_addr learned my addr 172.21.15.70:0/3420276335 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:33:31.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535b400700 1 --2- 172.21.15.70:0/3420276335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a00c1b0 0x55837a00c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535aa00700 1 --2- 172.21.15.70:0/3420276335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 0x55837a006c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535be00700 1 -- 172.21.15.70:0/3420276335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 msgr2=0x55837a006c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:33:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535be00700 1 --2- 172.21.15.70:0/3420276335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 0x55837a006c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535be00700 1 -- 172.21.15.70:0/3420276335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a00c1b0 msgr2=0x55837a00c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:33:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535be00700 1 --2- 172.21.15.70:0/3420276335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a00c1b0 0x55837a00c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.759+0000 7f535be00700 1 -- 172.21.15.70:0/3420276335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558379ea59d0 con 0x55837a007140 2024-05-08T08:33:31.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.760+0000 7f535be00700 1 --2- 172.21.15.70:0/3420276335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a012f70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f5354009d50 tx=0x7f53540077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750905187238c2e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.760+0000 7f5350c00700 1 -- 172.21.15.70:0/3420276335 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354019070 con 0x55837a007140 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.760+0000 7f5350c00700 1 -- 172.21.15.70:0/3420276335 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5354014a90 con 0x55837a007140 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.760+0000 7f5350c00700 1 -- 172.21.15.70:0/3420276335 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354013800 con 0x55837a007140 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.761+0000 7f536c9d5b80 1 -- 172.21.15.70:0/3420276335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 msgr2=0x55837a012f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.761+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/3420276335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a012f70 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f5354009d50 tx=0x7f53540077e0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.761+0000 7f536c9d5b80 1 -- 172.21.15.70:0/3420276335 shutdown_connections 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.761+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/3420276335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a012f70 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.761+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/3420276335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a00c1b0 0x55837a00c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.761+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/3420276335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 0x55837a006c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.761+0000 7f536c9d5b80 1 -- 172.21.15.70:0/3420276335 >> 172.21.15.70:0/3420276335 conn(0x558379f7e7d0 msgr2=0x55837a001070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:31.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.761+0000 7f536c9d5b80 1 -- 172.21.15.70:0/3420276335 shutdown_connections 2024-05-08T08:33:31.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.761+0000 7f536c9d5b80 1 -- 172.21.15.70:0/3420276335 wait complete. 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.762+0000 7f536c9d5b80 1 -- start start 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.762+0000 7f536c9d5b80 1 Processor -- start 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.762+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 0x55837a012ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.762+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a00ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.762+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a00c1b0 0x55837a010480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.762+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55837a013570 con 0x55837a007140 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.762+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558379ebec20 con 0x55837a006780 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.762+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55837a0136f0 con 0x55837a00c1b0 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f536c9d5b80 10 client.0 _ll_register_callbacks cb 0x558379effd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a00ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a00ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43128/0 (socket says 172.21.15.70:43128) 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535aa00700 1 -- 172.21.15.70:0/1127961270 learned_addr learned my addr 172.21.15.70:0/1127961270 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:33:31.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535b400700 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 0x55837a012ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535be00700 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a00c1b0 0x55837a010480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535aa00700 1 -- 172.21.15.70:0/1127961270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a00c1b0 msgr2=0x55837a010480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535aa00700 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a00c1b0 0x55837a010480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535aa00700 1 -- 172.21.15.70:0/1127961270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 msgr2=0x55837a012ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535aa00700 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 0x55837a012ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535aa00700 1 -- 172.21.15.70:0/1127961270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558379f1e520 con 0x55837a007140 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.763+0000 7f535be00700 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a00c1b0 0x55837a010480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.764+0000 7f535aa00700 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a00ff40 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f53480e0c40 tx=0x7f53480aad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a12340479e20541 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.764+0000 7f5345600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.764+0000 7f5345600700 1 -- 172.21.15.70:0/1127961270 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53480a9f70 con 0x55837a007140 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.764+0000 7f5345600700 1 -- 172.21.15.70:0/1127961270 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(291..291 src has 1..291) ==== 9583+0+0 (secure 0 0 0) 0x7f53480b10b0 con 0x55837a007140 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.764+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1127961270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5354014a90 con 0x55837a007140 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.764+0000 7f5345600700 1 -- 172.21.15.70:0/1127961270 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f53480cd0b0 con 0x55837a007140 2024-05-08T08:33:31.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.764+0000 7f536c9d5b80 10 client.18276 fetch_fsmap learned FSMap version 42 2024-05-08T08:33:31.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.764+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1127961270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55837a01dd30 con 0x55837a007140 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.764+0000 7f5345600700 1 -- 172.21.15.70:0/1127961270 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5354014a90 con 0x55837a007140 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.765+0000 7f5345600700 1 -- 172.21.15.70:0/1127961270 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f53480bfbc0 con 0x55837a007140 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.765+0000 7f536c9d5b80 10 client.18276 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.765+0000 7f536c9d5b80 10 client.18276 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.765+0000 7f536c9d5b80 20 client.18276 populate_metadata read hostname 'smithi070' 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.765+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55837a020250 0x55837a022670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.765+0000 7f536c9d5b80 4 client.18276 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.765+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1127961270 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558379fd3240 con 0x55837a020250 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.766+0000 7f535b400700 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55837a020250 0x55837a022670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.767+0000 7f535b400700 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55837a020250 0x55837a022670 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d37194dc3e1b12c server_cookie=680f0c2c4795bbb3 in_seq=0 out_seq=0 2024-05-08T08:33:31.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.767+0000 7f5345600700 10 client.18276 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:33:31.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f5345600700 1 -- 172.21.15.70:0/1127961270 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558379fd3240 con 0x55837a020250 2024-05-08T08:33:31.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f5345600700 10 client.18276 handle_command_reply: tid=0 2024-05-08T08:33:31.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f536c9d5b80 1 client.18276 shutdown 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1127961270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 msgr2=0x55837a00ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a00ff40 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f53480e0c40 tx=0x7f53480aad40 comp rx=0 tx=0).stop 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1127961270 shutdown_connections 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55837a020250 0x55837a022670 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a00c1b0 0x55837a010480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 0x55837a012ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1127961270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a007140 0x55837a00ff40 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1127961270 >> 172.21.15.70:0/1127961270 conn(0x558379f7e7d0 msgr2=0x558379ffbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.769+0000 7f5345600700 0 client.18276 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.770+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1127961270 shutdown_connections 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.770+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1127961270 wait complete. 2024-05-08T08:33:31.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.770+0000 7f536c9d5b80 20 client.18276 trim_cache size 0 max 16384 2024-05-08T08:33:31.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.792+0000 7f536c9d5b80 1 Processor -- start 2024-05-08T08:33:31.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.792+0000 7f536c9d5b80 1 -- start start 2024-05-08T08:33:31.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 0x55837a01c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a007140 0x55837a005e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a027f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f535c1b4030 con 0x55837a00c1b0 2024-05-08T08:33:31.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f535c1b18c0 con 0x55837a007140 2024-05-08T08:33:31.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f535c1af730 con 0x55837a006780 2024-05-08T08:33:31.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f535be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a027f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f535be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a027f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43132/0 (socket says 172.21.15.70:43132) 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f535be00700 1 -- 172.21.15.70:0/2713118730 learned_addr learned my addr 172.21.15.70:0/2713118730 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f535b400700 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 0x55837a01c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.793+0000 7f535aa00700 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a007140 0x55837a005e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f535be00700 1 -- 172.21.15.70:0/2713118730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 msgr2=0x55837a01c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f535be00700 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 0x55837a01c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f535be00700 1 -- 172.21.15.70:0/2713118730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a007140 msgr2=0x55837a005e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f535be00700 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a007140 0x55837a005e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f535be00700 1 -- 172.21.15.70:0/2713118730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558379ffdc70 con 0x55837a00c1b0 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f535b400700 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 0x55837a01c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f535be00700 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a027f40 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5354016000 tx=0x7f53540098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bb7e7d7bed6fb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f5347e00700 1 -- 172.21.15.70:0/2713118730 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354019040 con 0x55837a00c1b0 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f5347e00700 1 -- 172.21.15.70:0/2713118730 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5354024070 con 0x55837a00c1b0 2024-05-08T08:33:31.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.794+0000 7f5347e00700 1 -- 172.21.15.70:0/2713118730 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535401f6a0 con 0x55837a00c1b0 2024-05-08T08:33:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.795+0000 7f536c9d5b80 1 -- 172.21.15.70:0/2713118730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 msgr2=0x55837a027f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.795+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a027f40 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f5354016000 tx=0x7f53540098a0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.795+0000 7f536c9d5b80 1 -- 172.21.15.70:0/2713118730 shutdown_connections 2024-05-08T08:33:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.795+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a027f40 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.795+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a006780 0x55837a01c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.795+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/2713118730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a007140 0x55837a005e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.795+0000 7f536c9d5b80 1 -- 172.21.15.70:0/2713118730 >> 172.21.15.70:0/2713118730 conn(0x558379f7e7d0 msgr2=0x55837a005770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.795+0000 7f536c9d5b80 1 -- 172.21.15.70:0/2713118730 shutdown_connections 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.796+0000 7f536c9d5b80 1 -- 172.21.15.70:0/2713118730 wait complete. 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.796+0000 7f536c9d5b80 1 -- start start 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.796+0000 7f536c9d5b80 1 Processor -- start 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 0x55837a015910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a007140 0x55837a015e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f536c9d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a016390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f535c1afd80 con 0x55837a00c1b0 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f535c1b11f0 con 0x55837a006780 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f536c9d5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f535c1b0450 con 0x55837a007140 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f536c9d5b80 10 client.0 _ll_register_callbacks cb 0x558379effd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:33:31.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f535be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a016390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f535be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a016390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43138/0 (socket says 172.21.15.70:43138) 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f535be00700 1 -- 172.21.15.70:0/1487934377 learned_addr learned my addr 172.21.15.70:0/1487934377 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f535aa00700 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a007140 0x55837a015e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f535b400700 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 0x55837a015910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f535be00700 1 -- 172.21.15.70:0/1487934377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a007140 msgr2=0x55837a015e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f535be00700 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a007140 0x55837a015e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f535be00700 1 -- 172.21.15.70:0/1487934377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 msgr2=0x55837a015910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.797+0000 7f535be00700 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 0x55837a015910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.798+0000 7f535be00700 1 -- 172.21.15.70:0/1487934377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837a08ab50 con 0x55837a00c1b0 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.798+0000 7f535be00700 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a016390 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5354004f80 tx=0x7f5354009160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c46ba47bddb4e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.798+0000 7f5345600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.798+0000 7f5345600700 1 -- 172.21.15.70:0/1487934377 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5354019040 con 0x55837a00c1b0 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.798+0000 7f5345600700 1 -- 172.21.15.70:0/1487934377 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(291..291 src has 1..291) ==== 9583+0+0 (secure 0 0 0) 0x7f5354005680 con 0x55837a00c1b0 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.798+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1487934377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5354024070 con 0x55837a00c1b0 2024-05-08T08:33:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.798+0000 7f5345600700 1 -- 172.21.15.70:0/1487934377 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f5354005880 con 0x55837a00c1b0 2024-05-08T08:33:31.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.798+0000 7f536c9d5b80 10 client.18282 fetch_fsmap learned FSMap version 42 2024-05-08T08:33:31.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.799+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1487934377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55837a08be90 con 0x55837a00c1b0 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.799+0000 7f5345600700 1 -- 172.21.15.70:0/1487934377 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5354024070 con 0x55837a00c1b0 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.799+0000 7f5345600700 1 -- 172.21.15.70:0/1487934377 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f535401c030 con 0x55837a00c1b0 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.799+0000 7f536c9d5b80 10 client.18282 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.799+0000 7f536c9d5b80 10 client.18282 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.799+0000 7f536c9d5b80 20 client.18282 populate_metadata read hostname 'smithi070' 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.799+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55837a08c3c0 0x55837a08e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.799+0000 7f536c9d5b80 4 client.18282 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a526a930", "release": true, "await": true}] 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.799+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1487934377 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a526a930", "release": true, "await": true}) -- 0x558379f66500 con 0x55837a08c3c0 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.800+0000 7f535b400700 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55837a08c3c0 0x55837a08e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.801+0000 7f535b400700 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55837a08c3c0 0x55837a08e7e0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36c400de211b190 server_cookie=4ceac95a60eaa4c in_seq=0 out_seq=0 2024-05-08T08:33:31.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:31.801+0000 7f5345600700 10 client.18282 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:33:33.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:32 smithi070 ceph-mon[29591]: pgmap v3409: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:33:33.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:32 smithi172 ceph-mon[33377]: pgmap v3409: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:33:33.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:32 smithi194 ceph-mon[33679]: pgmap v3409: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:33:35.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:34 smithi070 ceph-mon[29591]: pgmap v3410: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:33:35.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:34 smithi172 ceph-mon[33377]: pgmap v3410: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:33:35.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:34 smithi194 ceph-mon[33679]: pgmap v3410: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:33:36.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.282+0000 7f5345600700 1 -- 172.21.15.70:0/1487934377 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x558379f66500 con 0x55837a08c3c0 2024-05-08T08:33:36.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.282+0000 7f5345600700 10 client.18282 handle_command_reply: tid=0 2024-05-08T08:33:36.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.282+0000 7f536c9d5b80 1 client.18282 shutdown 2024-05-08T08:33:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.282+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1487934377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 msgr2=0x55837a016390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.282+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a016390 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f5354004f80 tx=0x7f5354009160 comp rx=0 tx=0).stop 2024-05-08T08:33:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1487934377 shutdown_connections 2024-05-08T08:33:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55837a08c3c0 0x55837a08e7e0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a00c1b0 0x55837a016390 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:36.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55837a006780 0x55837a015910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f536c9d5b80 1 --2- 172.21.15.70:0/1487934377 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55837a007140 0x55837a015e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f5345600700 0 client.18282 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:33:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1487934377 >> 172.21.15.70:0/1487934377 conn(0x558379f7e7d0 msgr2=0x55837a006000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1487934377 shutdown_connections 2024-05-08T08:33:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f536c9d5b80 1 -- 172.21.15.70:0/1487934377 wait complete. 2024-05-08T08:33:36.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.283+0000 7f536c9d5b80 20 client.18282 trim_cache size 0 max 16384 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 244, 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "a526a930": { 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 244, 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:33:36.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.0, 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:33:36.279 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 -- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53400b29f0 msgr2=0x7f53400b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53400b29f0 0x7f53400b4eb0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f534c005e10 tx=0x7f534c005d40 comp rx=0 tx=0).stop 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 -- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06c530 msgr2=0x7f535c1a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06c530 0x7f535c1a1df0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f53480057c0 tx=0x7f5348009f90 comp rx=0 tx=0).stop 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 -- 172.21.15.70:0/1814918740 shutdown_connections 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f53400b29f0 0x7f53400b4eb0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f535c109530 0x7f535c19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f535c06bb70 0x7f535c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 --2- 172.21.15.70:0/1814918740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f535c06c530 0x7f535c1a1df0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 -- 172.21.15.70:0/1814918740 >> 172.21.15.70:0/1814918740 conn(0x7f535c079350 msgr2=0x7f535c10e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:33:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 -- 172.21.15.70:0/1814918740 shutdown_connections 2024-05-08T08:33:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:33:36.285+0000 7f5362000700 1 -- 172.21.15.70:0/1814918740 wait complete. 2024-05-08T08:33:37.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:36 smithi070 ceph-mon[29591]: pgmap v3411: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-08T08:33:37.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:36 smithi172 ceph-mon[33377]: pgmap v3411: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-08T08:33:37.221 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a526a930', seconds elapsed: 62.6 2024-05-08T08:33:37.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:36 smithi194 ceph-mon[33679]: pgmap v3411: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-08T08:33:38.169 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utaddress.o 2024-05-08T08:33:38.917 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fs-writeback.o 2024-05-08T08:33:39.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:38 smithi070 ceph-mon[29591]: pgmap v3412: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-08T08:33:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:38 smithi172 ceph-mon[33377]: pgmap v3412: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-08T08:33:39.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:38 smithi194 ceph-mon[33679]: pgmap v3412: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-08T08:33:39.315 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/util.o 2024-05-08T08:33:39.450 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/sta_info.o 2024-05-08T08:33:39.638 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/udp.o 2024-05-08T08:33:39.638 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/trace.o 2024-05-08T08:33:39.720 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_cong.o 2024-05-08T08:33:39.739 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/xt_tcpudp.o 2024-05-08T08:33:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:40 smithi070 ceph-mon[29591]: pgmap v3413: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 176 KiB/s wr, 15 op/s 2024-05-08T08:33:41.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:40 smithi172 ceph-mon[33377]: pgmap v3413: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 176 KiB/s wr, 15 op/s 2024-05-08T08:33:41.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:40 smithi194 ceph-mon[33679]: pgmap v3413: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 176 KiB/s wr, 15 op/s 2024-05-08T08:33:43.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:42 smithi070 ceph-mon[29591]: pgmap v3414: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-08T08:33:43.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:42 smithi172 ceph-mon[33377]: pgmap v3414: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-08T08:33:43.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:42 smithi194 ceph-mon[33679]: pgmap v3414: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-08T08:33:44.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:33:44.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:33:44.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:33:44.468 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utalloc.o 2024-05-08T08:33:45.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:44 smithi070 ceph-mon[29591]: pgmap v3415: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-08T08:33:45.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:33:45.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:33:45.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:33:45.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:44 smithi172 ceph-mon[33377]: pgmap v3415: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-08T08:33:45.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:33:45.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:33:45.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:33:45.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:44 smithi194 ceph-mon[33679]: pgmap v3415: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 176 KiB/s wr, 12 op/s 2024-05-08T08:33:45.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:33:45.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:33:45.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:33:47.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:46 smithi070 ceph-mon[29591]: pgmap v3416: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 376 KiB/s wr, 25 op/s 2024-05-08T08:33:47.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:46 smithi172 ceph-mon[33377]: pgmap v3416: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 376 KiB/s wr, 25 op/s 2024-05-08T08:33:47.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:46 smithi194 ceph-mon[33679]: pgmap v3416: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 376 KiB/s wr, 25 op/s 2024-05-08T08:33:49.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:48 smithi070 ceph-mon[29591]: pgmap v3417: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 375 KiB/s wr, 22 op/s 2024-05-08T08:33:49.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:48 smithi172 ceph-mon[33377]: pgmap v3417: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 375 KiB/s wr, 22 op/s 2024-05-08T08:33:49.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:48 smithi194 ceph-mon[33679]: pgmap v3417: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 375 KiB/s wr, 22 op/s 2024-05-08T08:33:50.503 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utascii.o 2024-05-08T08:33:50.729 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/pnode.o 2024-05-08T08:33:51.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:50 smithi070 ceph-mon[29591]: pgmap v3418: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 568 KiB/s wr, 29 op/s 2024-05-08T08:33:51.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:50 smithi172 ceph-mon[33377]: pgmap v3418: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 568 KiB/s wr, 29 op/s 2024-05-08T08:33:51.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:50 smithi194 ceph-mon[33679]: pgmap v3418: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 568 KiB/s wr, 29 op/s 2024-05-08T08:33:52.206 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/wep.o 2024-05-08T08:33:53.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:52 smithi070 ceph-mon[29591]: pgmap v3419: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 393 KiB/s wr, 19 op/s 2024-05-08T08:33:53.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:52 smithi172 ceph-mon[33377]: pgmap v3419: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 393 KiB/s wr, 19 op/s 2024-05-08T08:33:53.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:52 smithi194 ceph-mon[33679]: pgmap v3419: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 393 KiB/s wr, 19 op/s 2024-05-08T08:33:53.594 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/reg.o 2024-05-08T08:33:53.840 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_krb5_mech.o 2024-05-08T08:33:54.755 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/udplite.o 2024-05-08T08:33:55.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:54 smithi070 ceph-mon[29591]: pgmap v3420: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 393 KiB/s wr, 19 op/s 2024-05-08T08:33:55.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:54 smithi172 ceph-mon[33377]: pgmap v3420: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 393 KiB/s wr, 19 op/s 2024-05-08T08:33:55.176 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_metrics.o 2024-05-08T08:33:55.250 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/xt_CONNSECMARK.o 2024-05-08T08:33:55.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:54 smithi194 ceph-mon[33679]: pgmap v3420: 129 pgs: 129 active+clean; 2.0 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 393 KiB/s wr, 19 op/s 2024-05-08T08:33:56.378 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utbuffer.o 2024-05-08T08:33:57.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:56 smithi070 ceph-mon[29591]: pgmap v3421: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 747 KiB/s wr, 37 op/s 2024-05-08T08:33:57.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:56 smithi172 ceph-mon[33377]: pgmap v3421: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 747 KiB/s wr, 37 op/s 2024-05-08T08:33:57.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:56 smithi194 ceph-mon[33679]: pgmap v3421: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 747 KiB/s wr, 37 op/s 2024-05-08T08:33:57.954 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/splice.o 2024-05-08T08:33:59.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:33:58 smithi070 ceph-mon[29591]: pgmap v3422: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 548 KiB/s wr, 25 op/s 2024-05-08T08:33:59.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:33:58 smithi172 ceph-mon[33377]: pgmap v3422: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 548 KiB/s wr, 25 op/s 2024-05-08T08:33:59.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:33:58 smithi194 ceph-mon[33679]: pgmap v3422: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 548 KiB/s wr, 25 op/s 2024-05-08T08:34:01.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:00 smithi070 ceph-mon[29591]: pgmap v3423: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 722 KiB/s wr, 34 op/s 2024-05-08T08:34:01.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:00 smithi172 ceph-mon[33377]: pgmap v3423: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 722 KiB/s wr, 34 op/s 2024-05-08T08:34:01.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:00 smithi194 ceph-mon[33679]: pgmap v3423: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 722 KiB/s wr, 34 op/s 2024-05-08T08:34:03.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:02 smithi070 ceph-mon[29591]: pgmap v3424: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 529 KiB/s wr, 27 op/s 2024-05-08T08:34:03.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:02 smithi172 ceph-mon[33377]: pgmap v3424: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 529 KiB/s wr, 27 op/s 2024-05-08T08:34:03.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:02 smithi194 ceph-mon[33679]: pgmap v3424: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 529 KiB/s wr, 27 op/s 2024-05-08T08:34:03.513 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utcksum.o 2024-05-08T08:34:04.650 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/aead_api.o 2024-05-08T08:34:04.941 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_krb5_seal.o 2024-05-08T08:34:05.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:04 smithi070 ceph-mon[29591]: pgmap v3425: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 529 KiB/s wr, 27 op/s 2024-05-08T08:34:05.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:04 smithi172 ceph-mon[33377]: pgmap v3425: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 529 KiB/s wr, 27 op/s 2024-05-08T08:34:05.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:04 smithi194 ceph-mon[33679]: pgmap v3425: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 529 KiB/s wr, 27 op/s 2024-05-08T08:34:07.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:06 smithi070 ceph-mon[29591]: pgmap v3426: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 856 KiB/s wr, 53 op/s 2024-05-08T08:34:07.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:06 smithi172 ceph-mon[33377]: pgmap v3426: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 856 KiB/s wr, 53 op/s 2024-05-08T08:34:07.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:06 smithi194 ceph-mon[33679]: pgmap v3426: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 856 KiB/s wr, 53 op/s 2024-05-08T08:34:07.340 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/scan.o 2024-05-08T08:34:07.484 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/raw.o 2024-05-08T08:34:08.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:07 smithi172 ceph-mon[33377]: osdmap e292: 12 total, 12 up, 12 in 2024-05-08T08:34:08.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:07 smithi194 ceph-mon[33679]: osdmap e292: 12 total, 12 up, 12 in 2024-05-08T08:34:08.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:07 smithi070 ceph-mon[29591]: osdmap e292: 12 total, 12 up, 12 in 2024-05-08T08:34:09.148 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/sync.o 2024-05-08T08:34:09.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:08 smithi172 ceph-mon[33377]: pgmap v3428: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 602 KiB/s wr, 41 op/s 2024-05-08T08:34:09.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:08 smithi194 ceph-mon[33679]: pgmap v3428: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 602 KiB/s wr, 41 op/s 2024-05-08T08:34:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:08 smithi070 ceph-mon[29591]: pgmap v3428: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 602 KiB/s wr, 41 op/s 2024-05-08T08:34:10.374 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utcopy.o 2024-05-08T08:34:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:10 smithi194 ceph-mon[33679]: pgmap v3429: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 676 KiB/s wr, 51 op/s 2024-05-08T08:34:10.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:10 smithi070 ceph-mon[29591]: pgmap v3429: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 676 KiB/s wr, 51 op/s 2024-05-08T08:34:10.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:10 smithi172 ceph-mon[33377]: pgmap v3429: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 676 KiB/s wr, 51 op/s 2024-05-08T08:34:11.550 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_fastopen.o 2024-05-08T08:34:11.702 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/xt_NFLOG.o 2024-05-08T08:34:11.766 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/wpa.o 2024-05-08T08:34:12.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:12 smithi172 ceph-mon[33377]: pgmap v3430: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 676 KiB/s wr, 51 op/s 2024-05-08T08:34:13.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:12 smithi194 ceph-mon[33679]: pgmap v3430: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 676 KiB/s wr, 51 op/s 2024-05-08T08:34:13.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:12 smithi070 ceph-mon[29591]: pgmap v3430: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 676 KiB/s wr, 51 op/s 2024-05-08T08:34:14.535 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_krb5_unseal.o 2024-05-08T08:34:14.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:14 smithi172 ceph-mon[33377]: pgmap v3431: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 676 KiB/s wr, 51 op/s 2024-05-08T08:34:14.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:14 smithi172 ceph-mon[33377]: osdmap e293: 12 total, 12 up, 12 in 2024-05-08T08:34:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:14 smithi194 ceph-mon[33679]: pgmap v3431: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 676 KiB/s wr, 51 op/s 2024-05-08T08:34:15.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:14 smithi194 ceph-mon[33679]: osdmap e293: 12 total, 12 up, 12 in 2024-05-08T08:34:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:14 smithi070 ceph-mon[29591]: pgmap v3431: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 676 KiB/s wr, 51 op/s 2024-05-08T08:34:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:14 smithi070 ceph-mon[29591]: osdmap e293: 12 total, 12 up, 12 in 2024-05-08T08:34:16.444 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utexcep.o 2024-05-08T08:34:16.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:16 smithi172 ceph-mon[33377]: pgmap v3433: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 777 KiB/s wr, 48 op/s 2024-05-08T08:34:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:16 smithi194 ceph-mon[33679]: pgmap v3433: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 777 KiB/s wr, 48 op/s 2024-05-08T08:34:17.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:16 smithi070 ceph-mon[29591]: pgmap v3433: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 777 KiB/s wr, 48 op/s 2024-05-08T08:34:18.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:18 smithi172 ceph-mon[33377]: pgmap v3434: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 677 KiB/s wr, 42 op/s 2024-05-08T08:34:19.000 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/utimes.o 2024-05-08T08:34:19.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:18 smithi194 ceph-mon[33679]: pgmap v3434: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 677 KiB/s wr, 42 op/s 2024-05-08T08:34:19.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:18 smithi070 ceph-mon[29591]: pgmap v3434: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 595 KiB/s rd, 677 KiB/s wr, 42 op/s 2024-05-08T08:34:19.562 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/nl80211.o 2024-05-08T08:34:20.422 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/icmp.o 2024-05-08T08:34:20.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:20 smithi172 ceph-mon[33377]: pgmap v3435: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 661 KiB/s wr, 33 op/s 2024-05-08T08:34:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:20 smithi194 ceph-mon[33679]: pgmap v3435: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 661 KiB/s wr, 33 op/s 2024-05-08T08:34:21.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:20 smithi070 ceph-mon[29591]: pgmap v3435: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 661 KiB/s wr, 33 op/s 2024-05-08T08:34:22.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:22 smithi172 ceph-mon[33377]: pgmap v3436: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 661 KiB/s wr, 33 op/s 2024-05-08T08:34:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:22 smithi194 ceph-mon[33679]: pgmap v3436: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 661 KiB/s wr, 33 op/s 2024-05-08T08:34:23.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:22 smithi070 ceph-mon[29591]: pgmap v3436: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 661 KiB/s wr, 33 op/s 2024-05-08T08:34:23.612 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utdebug.o 2024-05-08T08:34:24.644 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/xt_SECMARK.o 2024-05-08T08:34:24.653 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/scan.o 2024-05-08T08:34:24.667 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_rate.o 2024-05-08T08:34:24.669 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_krb5_seqnum.o 2024-05-08T08:34:24.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:24 smithi172 ceph-mon[33377]: pgmap v3437: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 661 KiB/s wr, 33 op/s 2024-05-08T08:34:25.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:24 smithi194 ceph-mon[33679]: pgmap v3437: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 661 KiB/s wr, 33 op/s 2024-05-08T08:34:25.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:24 smithi070 ceph-mon[29591]: pgmap v3437: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 661 KiB/s wr, 33 op/s 2024-05-08T08:34:26.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:26 smithi172 ceph-mon[33377]: pgmap v3438: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 744 KiB/s wr, 29 op/s 2024-05-08T08:34:26.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:26 smithi070 ceph-mon[29591]: pgmap v3438: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 744 KiB/s wr, 29 op/s 2024-05-08T08:34:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:26 smithi194 ceph-mon[33679]: pgmap v3438: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 744 KiB/s wr, 29 op/s 2024-05-08T08:34:28.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:28 smithi172 ceph-mon[33377]: pgmap v3439: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 688 KiB/s wr, 26 op/s 2024-05-08T08:34:29.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:28 smithi194 ceph-mon[33679]: pgmap v3439: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 688 KiB/s wr, 26 op/s 2024-05-08T08:34:29.025 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/d_path.o 2024-05-08T08:34:29.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:28 smithi070 ceph-mon[29591]: pgmap v3439: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 688 KiB/s wr, 26 op/s 2024-05-08T08:34:29.857 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utdecode.o 2024-05-08T08:34:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:30 smithi194 ceph-mon[33679]: pgmap v3440: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 918 KiB/s wr, 40 op/s 2024-05-08T08:34:31.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:30 smithi070 ceph-mon[29591]: pgmap v3440: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 918 KiB/s wr, 40 op/s 2024-05-08T08:34:31.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:30 smithi172 ceph-mon[33377]: pgmap v3440: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 918 KiB/s wr, 40 op/s 2024-05-08T08:34:32.704 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/mcast.o 2024-05-08T08:34:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:32 smithi194 ceph-mon[33679]: pgmap v3441: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 695 KiB/s wr, 29 op/s 2024-05-08T08:34:33.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:32 smithi070 ceph-mon[29591]: pgmap v3441: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 695 KiB/s wr, 29 op/s 2024-05-08T08:34:33.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:32 smithi172 ceph-mon[33377]: pgmap v3441: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 695 KiB/s wr, 29 op/s 2024-05-08T08:34:34.386 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_krb5_wrap.o 2024-05-08T08:34:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:34 smithi194 ceph-mon[33679]: pgmap v3442: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 695 KiB/s wr, 29 op/s 2024-05-08T08:34:35.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:34 smithi070 ceph-mon[29591]: pgmap v3442: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 695 KiB/s wr, 29 op/s 2024-05-08T08:34:35.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:34 smithi172 ceph-mon[33377]: pgmap v3442: 129 pgs: 129 active+clean; 2.0 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 695 KiB/s wr, 29 op/s 2024-05-08T08:34:35.178 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/xt_TCPMSS.o 2024-05-08T08:34:36.035 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utdelete.o 2024-05-08T08:34:36.938 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/offchannel.o 2024-05-08T08:34:36.950 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_recovery.o 2024-05-08T08:34:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:36 smithi194 ceph-mon[33679]: pgmap v3443: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 987 KiB/s wr, 40 op/s 2024-05-08T08:34:37.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:36 smithi070 ceph-mon[29591]: pgmap v3443: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 987 KiB/s wr, 40 op/s 2024-05-08T08:34:37.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:36 smithi172 ceph-mon[33377]: pgmap v3443: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 970 KiB/s rd, 987 KiB/s wr, 40 op/s 2024-05-08T08:34:38.628 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/stack.o 2024-05-08T08:34:38.933 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/mlme.o 2024-05-08T08:34:39.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:38 smithi194 ceph-mon[33679]: pgmap v3444: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 521 KiB/s wr, 23 op/s 2024-05-08T08:34:39.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:38 smithi070 ceph-mon[29591]: pgmap v3444: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 521 KiB/s wr, 23 op/s 2024-05-08T08:34:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:38 smithi172 ceph-mon[33377]: pgmap v3444: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 521 KiB/s wr, 23 op/s 2024-05-08T08:34:41.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:40 smithi194 ceph-mon[33679]: pgmap v3445: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 807 KiB/s wr, 34 op/s 2024-05-08T08:34:41.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:40 smithi070 ceph-mon[29591]: pgmap v3445: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 807 KiB/s wr, 34 op/s 2024-05-08T08:34:41.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:40 smithi172 ceph-mon[33377]: pgmap v3445: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 807 KiB/s wr, 34 op/s 2024-05-08T08:34:42.132 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/uterror.o 2024-05-08T08:34:43.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:42 smithi194 ceph-mon[33679]: pgmap v3446: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 578 KiB/s wr, 21 op/s 2024-05-08T08:34:43.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:42 smithi070 ceph-mon[29591]: pgmap v3446: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 578 KiB/s wr, 21 op/s 2024-05-08T08:34:43.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:42 smithi172 ceph-mon[33377]: pgmap v3446: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 578 KiB/s wr, 21 op/s 2024-05-08T08:34:44.080 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:34:44.080 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T08:34:44.081 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:34:44.482 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_krb5_crypto.o 2024-05-08T08:34:44.735 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:34:44.989 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:44 smithi070 ceph-mon[29591]: pgmap v3447: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 578 KiB/s wr, 21 op/s 2024-05-08T08:34:45.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:44 smithi194 ceph-mon[33679]: pgmap v3447: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 578 KiB/s wr, 21 op/s 2024-05-08T08:34:45.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:44 smithi172 ceph-mon[33377]: pgmap v3447: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 578 KiB/s wr, 21 op/s 2024-05-08T08:34:45.817 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fs_struct.o 2024-05-08T08:34:46.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:34:46.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:34:46.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:34:46.646 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/reassembly.o 2024-05-08T08:34:46.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:46 smithi070 ceph-mon[29591]: pgmap v3448: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 816 KiB/s wr, 33 op/s 2024-05-08T08:34:47.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:46 smithi194 ceph-mon[33679]: pgmap v3448: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 816 KiB/s wr, 33 op/s 2024-05-08T08:34:47.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:46 smithi172 ceph-mon[33377]: pgmap v3448: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 816 KiB/s wr, 33 op/s 2024-05-08T08:34:48.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:34:48.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:34:48.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:34:48.065 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:34:48.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:34:48.066 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:34:48.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:34:48.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:34:48.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:34:48.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.402+0000 7f256b600700 1 -- 172.21.15.70:0/2692911568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103ef0 msgr2=0x7f25641103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:34:48.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.402+0000 7f256b600700 1 --2- 172.21.15.70:0/2692911568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103ef0 0x7f25641103d0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f255c00b0a0 tx=0x7f255c00b3b0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.403+0000 7f256b600700 1 -- 172.21.15.70:0/2692911568 shutdown_connections 2024-05-08T08:34:48.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.403+0000 7f256b600700 1 --2- 172.21.15.70:0/2692911568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103ef0 0x7f25641103d0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.403+0000 7f256b600700 1 --2- 172.21.15.70:0/2692911568 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2564108460 0x7f2564108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.403+0000 7f256b600700 1 --2- 172.21.15.70:0/2692911568 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2564103550 0x7f25641039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.403+0000 7f256b600700 1 -- 172.21.15.70:0/2692911568 >> 172.21.15.70:0/2692911568 conn(0x7f256407a600 msgr2=0x7f256407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:34:48.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.403+0000 7f256b600700 1 -- 172.21.15.70:0/2692911568 shutdown_connections 2024-05-08T08:34:48.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.404+0000 7f256b600700 1 -- 172.21.15.70:0/2692911568 wait complete. 2024-05-08T08:34:48.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.405+0000 7f256b600700 1 Processor -- start 2024-05-08T08:34:48.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.405+0000 7f256b600700 1 -- start start 2024-05-08T08:34:48.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f256b600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103550 0x7f25641167f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:34:48.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f256b600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2564103ef0 0x7f2564112ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:34:48.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f256b600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2564108460 0x7f2564113050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:34:48.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f256b600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f25640761d0 con 0x7f2564103550 2024-05-08T08:34:48.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f2568c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103550 0x7f25641167f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:34:48.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f2568c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103550 0x7f25641167f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54608/0 (socket says 172.21.15.70:54608) 2024-05-08T08:34:48.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f2568c00700 1 -- 172.21.15.70:0/913365405 learned_addr learned my addr 172.21.15.70:0/913365405 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:34:48.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2564076050 con 0x7f2564108460 2024-05-08T08:34:48.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2564076350 con 0x7f2564103ef0 2024-05-08T08:34:48.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.406+0000 7f2563e00700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2564103ef0 0x7f2564112ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:34:48.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.407+0000 7f2569600700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2564108460 0x7f2564113050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:34:48.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.407+0000 7f2568c00700 1 -- 172.21.15.70:0/913365405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2564103ef0 msgr2=0x7f2564112ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:34:48.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.407+0000 7f2568c00700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2564103ef0 0x7f2564112ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.407+0000 7f2568c00700 1 -- 172.21.15.70:0/913365405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2564108460 msgr2=0x7f2564113050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:34:48.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.407+0000 7f2568c00700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2564108460 0x7f2564113050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.407+0000 7f2568c00700 1 -- 172.21.15.70:0/913365405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f256419bbd0 con 0x7f2564103550 2024-05-08T08:34:48.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.408+0000 7f2568c00700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103550 0x7f25641167f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f255400d980 tx=0x7f255400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:34:48.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.409+0000 7f2561600700 1 -- 172.21.15.70:0/913365405 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554017070 con 0x7f2564103550 2024-05-08T08:34:48.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.409+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f256419be60 con 0x7f2564103550 2024-05-08T08:34:48.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.409+0000 7f2561600700 1 -- 172.21.15.70:0/913365405 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f255400fd20 con 0x7f2564103550 2024-05-08T08:34:48.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.409+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f256419c3a0 con 0x7f2564103550 2024-05-08T08:34:48.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.410+0000 7f2561600700 1 -- 172.21.15.70:0/913365405 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2554017070 con 0x7f2564103550 2024-05-08T08:34:48.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.411+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2548005360 con 0x7f2564103550 2024-05-08T08:34:48.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.413+0000 7f2561600700 1 -- 172.21.15.70:0/913365405 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2554010c60 con 0x7f2564103550 2024-05-08T08:34:48.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.415+0000 7f2561600700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f254c0b2c70 0x7f254c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:34:48.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.416+0000 7f2561600700 1 -- 172.21.15.70:0/913365405 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(293..293 src has 1..293) ==== 9583+0+0 (secure 0 0 0) 0x7f25540e1fa0 con 0x7f2564103550 2024-05-08T08:34:48.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.416+0000 7f2563e00700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f254c0b2c70 0x7f254c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:34:48.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.417+0000 7f2563e00700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f254c0b2c70 0x7f254c0b5130 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f256407afe0 tx=0x7f25580073d0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:34:48.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.422+0000 7f2561600700 1 -- 172.21.15.70:0/913365405 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f25540a9500 con 0x7f2564103550 2024-05-08T08:34:48.729 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:48 smithi070 ceph-mon[29591]: pgmap v3449: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 524 KiB/s wr, 23 op/s 2024-05-08T08:34:48.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.989+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2548005920 con 0x7f2564103550 2024-05-08T08:34:48.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.991+0000 7f2561600700 1 -- 172.21.15.70:0/913365405 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f25540a8e00 con 0x7f2564103550 2024-05-08T08:34:48.984 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:34:48.984 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:34:48.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f254c0b2c70 msgr2=0x7f254c0b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:34:48.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f254c0b2c70 0x7f254c0b5130 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f256407afe0 tx=0x7f25580073d0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103550 msgr2=0x7f25641167f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:34:48.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103550 0x7f25641167f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f255400d980 tx=0x7f255400dc90 comp rx=0 tx=0).stop 2024-05-08T08:34:48.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 shutdown_connections 2024-05-08T08:34:48.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f254c0b2c70 0x7f254c0b5130 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2564108460 0x7f2564113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2564103550 0x7f25641167f0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 --2- 172.21.15.70:0/913365405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2564103ef0 0x7f2564112ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:34:48.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.996+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 >> 172.21.15.70:0/913365405 conn(0x7f256407a600 msgr2=0x7f25641070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:34:48.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.997+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 shutdown_connections 2024-05-08T08:34:48.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:34:48.997+0000 7f256b600700 1 -- 172.21.15.70:0/913365405 wait complete. 2024-05-08T08:34:48.992 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:34:49.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:48 smithi194 ceph-mon[33679]: pgmap v3449: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 524 KiB/s wr, 23 op/s 2024-05-08T08:34:49.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:48 smithi172 ceph-mon[33377]: pgmap v3449: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 524 KiB/s wr, 23 op/s 2024-05-08T08:34:49.320 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/uteval.o 2024-05-08T08:34:49.667 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/xt_conntrack.o 2024-05-08T08:34:49.782 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/ht.o 2024-05-08T08:34:49.912 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T08:34:49.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T08:34:49.990 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:49 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/913365405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:34:50.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:49 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/913365405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:34:50.074 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:49 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/913365405' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:34:50.494 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:34:50.631 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_ulp.o 2024-05-08T08:34:51.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:50 smithi194 ceph-mon[33679]: pgmap v3450: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 819 KiB/s wr, 37 op/s 2024-05-08T08:34:51.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:50 smithi070 ceph-mon[29591]: pgmap v3450: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 819 KiB/s wr, 37 op/s 2024-05-08T08:34:51.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:50 smithi172 ceph-mon[33377]: pgmap v3450: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 819 KiB/s wr, 37 op/s 2024-05-08T08:34:52.329 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/ibss.o 2024-05-08T08:34:53.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:52 smithi194 ceph-mon[33679]: pgmap v3451: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 532 KiB/s wr, 26 op/s 2024-05-08T08:34:53.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:52 smithi070 ceph-mon[29591]: pgmap v3451: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 532 KiB/s wr, 26 op/s 2024-05-08T08:34:53.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:52 smithi172 ceph-mon[33377]: pgmap v3451: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 532 KiB/s wr, 26 op/s 2024-05-08T08:34:54.625 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/statfs.o 2024-05-08T08:34:55.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:54 smithi070 ceph-mon[29591]: pgmap v3452: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 532 KiB/s wr, 26 op/s 2024-05-08T08:34:55.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:54 smithi172 ceph-mon[33377]: pgmap v3452: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 532 KiB/s wr, 26 op/s 2024-05-08T08:34:55.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:54 smithi194 ceph-mon[33679]: pgmap v3452: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 532 KiB/s wr, 26 op/s 2024-05-08T08:34:57.056 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:56 smithi194 ceph-mon[33679]: pgmap v3453: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 811 KiB/s wr, 40 op/s 2024-05-08T08:34:57.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:56 smithi070 ceph-mon[29591]: pgmap v3453: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 811 KiB/s wr, 40 op/s 2024-05-08T08:34:57.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:56 smithi172 ceph-mon[33377]: pgmap v3453: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 762 KiB/s rd, 811 KiB/s wr, 40 op/s 2024-05-08T08:34:59.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:34:58 smithi070 ceph-mon[29591]: pgmap v3454: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 573 KiB/s wr, 27 op/s 2024-05-08T08:34:59.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:34:58 smithi172 ceph-mon[33377]: pgmap v3454: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 573 KiB/s wr, 27 op/s 2024-05-08T08:34:59.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:34:58 smithi194 ceph-mon[33679]: pgmap v3454: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 573 KiB/s wr, 27 op/s 2024-05-08T08:34:59.398 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utglobal.o 2024-05-08T08:35:01.010 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:00 smithi070 ceph-mon[29591]: pgmap v3455: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 825 KiB/s wr, 37 op/s 2024-05-08T08:35:01.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:00 smithi172 ceph-mon[33377]: pgmap v3455: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 825 KiB/s wr, 37 op/s 2024-05-08T08:35:01.205 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_gss/gss_krb5_keys.o 2024-05-08T08:35:01.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:00 smithi194 ceph-mon[33679]: pgmap v3455: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 825 KiB/s wr, 37 op/s 2024-05-08T08:35:01.496 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/tcp_ipv6.o 2024-05-08T08:35:02.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.282+0000 7fde40200700 1 -- 172.21.15.70:0/426772778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde3810fed0 msgr2=0x7fde381122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:02.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.282+0000 7fde40200700 1 --2- 172.21.15.70:0/426772778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde3810fed0 0x7fde381122c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fde3000b0a0 tx=0x7fde3000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.282+0000 7fde40200700 1 -- 172.21.15.70:0/426772778 shutdown_connections 2024-05-08T08:35:02.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.282+0000 7fde40200700 1 --2- 172.21.15.70:0/426772778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde3810fed0 0x7fde381122c0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.282+0000 7fde40200700 1 --2- 172.21.15.70:0/426772778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde380756d0 0x7fde38075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.282+0000 7fde40200700 1 --2- 172.21.15.70:0/426772778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde38075ff0 0x7fde3810f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.282+0000 7fde40200700 1 -- 172.21.15.70:0/426772778 >> 172.21.15.70:0/426772778 conn(0x7fde3807a650 msgr2=0x7fde3807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:35:02.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.283+0000 7fde40200700 1 -- 172.21.15.70:0/426772778 shutdown_connections 2024-05-08T08:35:02.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.283+0000 7fde40200700 1 -- 172.21.15.70:0/426772778 wait complete. 2024-05-08T08:35:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.284+0000 7fde40200700 1 Processor -- start 2024-05-08T08:35:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.284+0000 7fde40200700 1 -- start start 2024-05-08T08:35:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.285+0000 7fde40200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde380756d0 0x7fde3810f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.285+0000 7fde40200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde38075ff0 0x7fde3810c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.285+0000 7fde40200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde3810fed0 0x7fde3810cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.285+0000 7fde40200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde38115810 con 0x7fde38075ff0 2024-05-08T08:35:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.285+0000 7fde40200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde38115690 con 0x7fde380756d0 2024-05-08T08:35:02.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.285+0000 7fde40200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fde38115990 con 0x7fde3810fed0 2024-05-08T08:35:02.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.285+0000 7fde3ce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde38075ff0 0x7fde3810c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.285+0000 7fde3ce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde38075ff0 0x7fde3810c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50442/0 (socket says 172.21.15.70:50442) 2024-05-08T08:35:02.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.285+0000 7fde3ce00700 1 -- 172.21.15.70:0/4061165295 learned_addr learned my addr 172.21.15.70:0/4061165295 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:35:02.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.286+0000 7fde3e200700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde3810fed0 0x7fde3810cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.286+0000 7fde3ce00700 1 -- 172.21.15.70:0/4061165295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde3810fed0 msgr2=0x7fde3810cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.286+0000 7fde3ce00700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde3810fed0 0x7fde3810cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.286+0000 7fde3ce00700 1 -- 172.21.15.70:0/4061165295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde380756d0 msgr2=0x7fde3810f840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T08:35:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.286+0000 7fde3ce00700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde380756d0 0x7fde3810f840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.286+0000 7fde3ce00700 1 -- 172.21.15.70:0/4061165295 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde381ac4f0 con 0x7fde38075ff0 2024-05-08T08:35:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.286+0000 7fde3e200700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde3810fed0 0x7fde3810cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:35:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.286+0000 7fde3ce00700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde38075ff0 0x7fde3810c940 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fde2400e9a0 tx=0x7fde2400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:35:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.287+0000 7fde36000700 1 -- 172.21.15.70:0/4061165295 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2400cbd0 con 0x7fde38075ff0 2024-05-08T08:35:02.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.287+0000 7fde40200700 1 -- 172.21.15.70:0/4061165295 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde381ac6c0 con 0x7fde38075ff0 2024-05-08T08:35:02.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.287+0000 7fde40200700 1 -- 172.21.15.70:0/4061165295 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde381acbc0 con 0x7fde38075ff0 2024-05-08T08:35:02.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.287+0000 7fde36000700 1 -- 172.21.15.70:0/4061165295 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde2400cd70 con 0x7fde38075ff0 2024-05-08T08:35:02.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.287+0000 7fde36000700 1 -- 172.21.15.70:0/4061165295 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24018680 con 0x7fde38075ff0 2024-05-08T08:35:02.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.292+0000 7fde36000700 1 -- 172.21.15.70:0/4061165295 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fde24018820 con 0x7fde38075ff0 2024-05-08T08:35:02.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.293+0000 7fde36000700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde200b2b20 0x7fde200b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.294+0000 7fde36000700 1 -- 172.21.15.70:0/4061165295 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(294..294 src has 1..294) ==== 9671+0+0 (secure 0 0 0) 0x7fde240e2c30 con 0x7fde38075ff0 2024-05-08T08:35:02.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.294+0000 7fde3d800700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde200b2b20 0x7fde200b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.295+0000 7fde3d800700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde200b2b20 0x7fde200b4fe0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00ba10 tx=0x7fde2c00b3f0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:35:02.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.321+0000 7fde4ac15b80 1 Processor -- start 2024-05-08T08:35:02.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.321+0000 7fde4ac15b80 1 -- start start 2024-05-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.321+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297f240 0x55cf8297f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.322+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 0x55cf82979c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.322+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82986000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.322+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cf828cbbb0 con 0x55cf8297a1d0 2024-05-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.322+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cf828698f0 con 0x55cf82979810 2024-05-08T08:35:02.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.322+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cf828c7b70 con 0x55cf8297f240 2024-05-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.322+0000 7fde3e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82986000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.322+0000 7fde3d800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297f240 0x55cf8297f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.322+0000 7fde3e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82986000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50448/0 (socket says 172.21.15.70:50448) 2024-05-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.322+0000 7fde3e200700 1 -- 172.21.15.70:0/2255976937 learned_addr learned my addr 172.21.15.70:0/2255976937 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.323+0000 7fde3ce00700 1 --2- 172.21.15.70:0/2255976937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 0x55cf82979c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.323+0000 7fde3e200700 1 -- 172.21.15.70:0/2255976937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297f240 msgr2=0x55cf8297f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:35:02.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.323+0000 7fde3e200700 1 --2- 172.21.15.70:0/2255976937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297f240 0x55cf8297f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.323+0000 7fde3e200700 1 -- 172.21.15.70:0/2255976937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 msgr2=0x55cf82979c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.323+0000 7fde3e200700 1 --2- 172.21.15.70:0/2255976937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 0x55cf82979c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.323+0000 7fde3e200700 1 -- 172.21.15.70:0/2255976937 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf82818a60 con 0x55cf8297a1d0 2024-05-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.323+0000 7fde3e200700 1 --2- 172.21.15.70:0/2255976937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82986000 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fde3806abe0 tx=0x7fde30009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2644d4f7c8e0e098 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.324+0000 7fde2aa00700 1 -- 172.21.15.70:0/2255976937 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3000bcb0 con 0x55cf8297a1d0 2024-05-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.324+0000 7fde2aa00700 1 -- 172.21.15.70:0/2255976937 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde3000be50 con 0x55cf8297a1d0 2024-05-08T08:35:02.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.324+0000 7fde2aa00700 1 -- 172.21.15.70:0/2255976937 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3000bcb0 con 0x55cf8297a1d0 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.325+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2255976937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 msgr2=0x55cf82986000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.325+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2255976937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82986000 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fde3806abe0 tx=0x7fde30009350 comp rx=0 tx=0).stop 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.325+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2255976937 shutdown_connections 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.325+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2255976937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82986000 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.325+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2255976937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297f240 0x55cf8297f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.325+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2255976937 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 0x55cf82979c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.325+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2255976937 >> 172.21.15.70:0/2255976937 conn(0x55cf828f1860 msgr2=0x55cf82974100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.325+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2255976937 shutdown_connections 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.325+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2255976937 wait complete. 2024-05-08T08:35:02.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.326+0000 7fde4ac15b80 1 -- start start 2024-05-08T08:35:02.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.327+0000 7fde4ac15b80 1 Processor -- start 2024-05-08T08:35:02.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.327+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 0x55cf82985b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.327+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82982f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.327+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297f240 0x55cf82983480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.327+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cf829865a0 con 0x55cf8297a1d0 2024-05-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.327+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cf82831cb0 con 0x55cf8297f240 2024-05-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.327+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cf82986720 con 0x55cf82979810 2024-05-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.328+0000 7fde4ac15b80 10 client.0 _ll_register_callbacks cb 0x55cf82872e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.328+0000 7fde3ce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82982f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.328+0000 7fde3ce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82982f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50460/0 (socket says 172.21.15.70:50460) 2024-05-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.328+0000 7fde3ce00700 1 -- 172.21.15.70:0/2222195975 learned_addr learned my addr 172.21.15.70:0/2222195975 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.328+0000 7fde3d800700 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 0x55cf82985b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.328+0000 7fde3e200700 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297f240 0x55cf82983480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.329+0000 7fde3ce00700 1 -- 172.21.15.70:0/2222195975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 msgr2=0x55cf82985b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.329+0000 7fde3ce00700 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 0x55cf82985b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.329+0000 7fde3ce00700 1 -- 172.21.15.70:0/2222195975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297f240 msgr2=0x55cf82983480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.329+0000 7fde3ce00700 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297f240 0x55cf82983480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.329+0000 7fde3ce00700 1 -- 172.21.15.70:0/2222195975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf828915b0 con 0x55cf8297a1d0 2024-05-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.329+0000 7fde3ce00700 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82982f40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fde2400cfd0 tx=0x7fde240a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8469c45666d03d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.329+0000 7fde1f400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.329+0000 7fde1f400700 1 -- 172.21.15.70:0/2222195975 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240b21d0 con 0x55cf8297a1d0 2024-05-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.330+0000 7fde1f400700 1 -- 172.21.15.70:0/2222195975 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(294..294 src has 1..294) ==== 9671+0+0 (secure 0 0 0) 0x7fde240cc2d0 con 0x55cf8297a1d0 2024-05-08T08:35:02.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.330+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2222195975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde3000be50 con 0x55cf8297a1d0 2024-05-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.330+0000 7fde1f400700 1 -- 172.21.15.70:0/2222195975 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fde240a9540 con 0x55cf8297a1d0 2024-05-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.330+0000 7fde4ac15b80 10 client.18300 fetch_fsmap learned FSMap version 42 2024-05-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.330+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2222195975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55cf82990db0 con 0x55cf8297a1d0 2024-05-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.331+0000 7fde1f400700 1 -- 172.21.15.70:0/2222195975 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde3000be50 con 0x55cf8297a1d0 2024-05-08T08:35:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.331+0000 7fde1f400700 1 -- 172.21.15.70:0/2222195975 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fde240cace0 con 0x55cf8297a1d0 2024-05-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.331+0000 7fde4ac15b80 10 client.18300 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.331+0000 7fde4ac15b80 10 client.18300 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.331+0000 7fde4ac15b80 20 client.18300 populate_metadata read hostname 'smithi070' 2024-05-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.331+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf829933f0 0x55cf829957e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.331+0000 7fde4ac15b80 4 client.18300 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.331+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2222195975 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf829462d0 con 0x55cf829933f0 2024-05-08T08:35:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.332+0000 7fde3d800700 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf829933f0 0x55cf829957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.333+0000 7fde3d800700 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf829933f0 0x55cf829957e0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5111c3338639a5f server_cookie=6d6cb355c1324fb3 in_seq=0 out_seq=0 2024-05-08T08:35:02.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.333+0000 7fde1f400700 10 client.18300 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:35:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.335+0000 7fde1f400700 1 -- 172.21.15.70:0/2222195975 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cf829462d0 con 0x55cf829933f0 2024-05-08T08:35:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.335+0000 7fde1f400700 10 client.18300 handle_command_reply: tid=0 2024-05-08T08:35:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.335+0000 7fde4ac15b80 1 client.18300 shutdown 2024-05-08T08:35:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.336+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2222195975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 msgr2=0x55cf82982f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.336+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82982f40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fde2400cfd0 tx=0x7fde240a9f70 comp rx=0 tx=0).stop 2024-05-08T08:35:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.337+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2222195975 shutdown_connections 2024-05-08T08:35:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.337+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf829933f0 0x55cf829957e0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.337+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297f240 0x55cf82983480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.337+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 0x55cf82985b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.337+0000 7fde1f400700 0 client.18300 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:35:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.337+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2222195975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297a1d0 0x55cf82982f40 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.337+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2222195975 >> 172.21.15.70:0/2222195975 conn(0x55cf828f1860 msgr2=0x55cf8296ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:35:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.338+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2222195975 shutdown_connections 2024-05-08T08:35:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.338+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2222195975 wait complete. 2024-05-08T08:35:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.338+0000 7fde4ac15b80 20 client.18300 trim_cache size 0 max 16384 2024-05-08T08:35:02.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.376+0000 7fde4ac15b80 1 Processor -- start 2024-05-08T08:35:02.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.376+0000 7fde4ac15b80 1 -- start start 2024-05-08T08:35:02.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 0x55cf8298f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297a1d0 0x55cf8296e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf8296e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde18011920 con 0x55cf8297f240 2024-05-08T08:35:02.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde1800f1b0 con 0x55cf8297a1d0 2024-05-08T08:35:02.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fde1800d020 con 0x55cf82979810 2024-05-08T08:35:02.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde3e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf8296e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde3e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf8296e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50462/0 (socket says 172.21.15.70:50462) 2024-05-08T08:35:02.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde3e200700 1 -- 172.21.15.70:0/2344851346 learned_addr learned my addr 172.21.15.70:0/2344851346 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:35:02.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.377+0000 7fde3ce00700 1 --2- 172.21.15.70:0/2344851346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297a1d0 0x55cf8296e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.378+0000 7fde3d800700 1 --2- 172.21.15.70:0/2344851346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 0x55cf8298f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.378+0000 7fde3e200700 1 -- 172.21.15.70:0/2344851346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 msgr2=0x55cf8298f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:35:02.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.378+0000 7fde3e200700 1 --2- 172.21.15.70:0/2344851346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 0x55cf8298f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.378+0000 7fde3e200700 1 -- 172.21.15.70:0/2344851346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297a1d0 msgr2=0x55cf8296e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:35:02.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.378+0000 7fde3e200700 1 --2- 172.21.15.70:0/2344851346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297a1d0 0x55cf8296e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.378+0000 7fde3e200700 1 -- 172.21.15.70:0/2344851346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf82995e10 con 0x55cf8297f240 2024-05-08T08:35:02.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.379+0000 7fde3e200700 1 --2- 172.21.15.70:0/2344851346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf8296e880 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fde3806abe0 tx=0x7fde3000bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fd9a114f26e7a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:35:02.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.379+0000 7fde2a000700 1 -- 172.21.15.70:0/2344851346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30004c50 con 0x55cf8297f240 2024-05-08T08:35:02.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.380+0000 7fde2a000700 1 -- 172.21.15.70:0/2344851346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde30004df0 con 0x55cf8297f240 2024-05-08T08:35:02.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.380+0000 7fde2a000700 1 -- 172.21.15.70:0/2344851346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3001c7c0 con 0x55cf8297f240 2024-05-08T08:35:02.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.380+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2344851346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 msgr2=0x55cf8296e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:02.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.380+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2344851346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf8296e880 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fde3806abe0 tx=0x7fde3000bc40 comp rx=0 tx=0).stop 2024-05-08T08:35:02.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.381+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2344851346 shutdown_connections 2024-05-08T08:35:02.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.381+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2344851346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf8296e880 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.381+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2344851346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf82979810 0x55cf8298f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.381+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/2344851346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf8297a1d0 0x55cf8296e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.381+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2344851346 >> 172.21.15.70:0/2344851346 conn(0x55cf828f1860 msgr2=0x55cf8297e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:35:02.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.381+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2344851346 shutdown_connections 2024-05-08T08:35:02.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.382+0000 7fde4ac15b80 1 -- 172.21.15.70:0/2344851346 wait complete. 2024-05-08T08:35:02.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.382+0000 7fde4ac15b80 1 -- start start 2024-05-08T08:35:02.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.382+0000 7fde4ac15b80 1 Processor -- start 2024-05-08T08:35:02.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.383+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 0x55cf8298c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.383+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297a1d0 0x55cf82988a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.383+0000 7fde4ac15b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf82989150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.383+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde1800d670 con 0x55cf8297f240 2024-05-08T08:35:02.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.383+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fde1800eae0 con 0x55cf82979810 2024-05-08T08:35:02.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.383+0000 7fde4ac15b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fde1800dd40 con 0x55cf8297a1d0 2024-05-08T08:35:02.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.383+0000 7fde4ac15b80 10 client.0 _ll_register_callbacks cb 0x55cf82872e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:35:02.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.384+0000 7fde3e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf82989150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.384+0000 7fde3ce00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297a1d0 0x55cf82988a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.384+0000 7fde3ce00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297a1d0 0x55cf82988a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:35884/0 (socket says 172.21.15.70:35884) 2024-05-08T08:35:02.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.384+0000 7fde3ce00700 1 -- 172.21.15.70:0/1911661903 learned_addr learned my addr 172.21.15.70:0/1911661903 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:35:02.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.384+0000 7fde3d800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 0x55cf8298c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.384+0000 7fde3e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf82989150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50476/0 (socket says 172.21.15.70:50476) 2024-05-08T08:35:02.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.385+0000 7fde3d800700 1 -- 172.21.15.70:0/1911661903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297a1d0 msgr2=0x55cf82988a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:35:02.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.385+0000 7fde3d800700 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297a1d0 0x55cf82988a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.385+0000 7fde3d800700 1 -- 172.21.15.70:0/1911661903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 msgr2=0x55cf82989150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:35:02.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.385+0000 7fde3d800700 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf82989150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:02.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.385+0000 7fde3d800700 1 -- 172.21.15.70:0/1911661903 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf82970d00 con 0x55cf82979810 2024-05-08T08:35:02.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.385+0000 7fde3ce00700 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297a1d0 0x55cf82988a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:35:02.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.386+0000 7fde3e200700 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf82989150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:35:02.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.386+0000 7fde3d800700 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 0x55cf8298c130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55cf82986870 tx=0x7fde2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4d8167dd9fcc7b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:35:02.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.386+0000 7fde1f400700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:35:02.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.387+0000 7fde1f400700 1 -- 172.21.15.70:0/1911661903 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2c00de70 con 0x55cf82979810 2024-05-08T08:35:02.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.387+0000 7fde4ac15b80 1 -- 172.21.15.70:0/1911661903 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde30004df0 con 0x55cf82979810 2024-05-08T08:35:02.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.387+0000 7fde1f400700 1 -- 172.21.15.70:0/1911661903 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(294..294 src has 1..294) ==== 9671+0+0 (secure 0 0 0) 0x7fde2c0272c0 con 0x55cf82979810 2024-05-08T08:35:02.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.388+0000 7fde1f400700 1 -- 172.21.15.70:0/1911661903 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fde2c039050 con 0x55cf82979810 2024-05-08T08:35:02.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.388+0000 7fde4ac15b80 10 client.37109 fetch_fsmap learned FSMap version 42 2024-05-08T08:35:02.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.388+0000 7fde4ac15b80 1 -- 172.21.15.70:0/1911661903 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55cf82a0fd10 con 0x55cf82979810 2024-05-08T08:35:02.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.389+0000 7fde1f400700 1 -- 172.21.15.70:0/1911661903 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde30004df0 con 0x55cf82979810 2024-05-08T08:35:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.389+0000 7fde1f400700 1 -- 172.21.15.70:0/1911661903 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fde2c030810 con 0x55cf82979810 2024-05-08T08:35:02.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.390+0000 7fde4ac15b80 10 client.37109 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:35:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.390+0000 7fde4ac15b80 10 client.37109 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:35:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.390+0000 7fde4ac15b80 20 client.37109 populate_metadata read hostname 'smithi070' 2024-05-08T08:35:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.390+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf82a10410 0x55cf82a12830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.390+0000 7fde4ac15b80 4 client.37109 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T08:35:02.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.390+0000 7fde4ac15b80 1 -- 172.21.15.70:0/1911661903 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55cf828d9590 con 0x55cf82a10410 2024-05-08T08:35:02.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.391+0000 7fde3ce00700 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf82a10410 0x55cf82a12830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:02.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.392+0000 7fde3ce00700 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf82a10410 0x55cf82a12830 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d01b15ad03ef30f6 server_cookie=9039b1423664628f in_seq=0 out_seq=0 2024-05-08T08:35:02.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:02.392+0000 7fde1f400700 10 client.37109 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:35:03.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:02 smithi070 ceph-mon[29591]: pgmap v3456: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 531 KiB/s wr, 23 op/s 2024-05-08T08:35:03.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:02 smithi070 ceph-mon[29591]: osdmap e294: 12 total, 12 up, 12 in 2024-05-08T08:35:03.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:02 smithi172 ceph-mon[33377]: pgmap v3456: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 531 KiB/s wr, 23 op/s 2024-05-08T08:35:03.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:02 smithi172 ceph-mon[33377]: osdmap e294: 12 total, 12 up, 12 in 2024-05-08T08:35:03.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:02 smithi194 ceph-mon[33679]: pgmap v3456: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 531 KiB/s wr, 23 op/s 2024-05-08T08:35:03.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:02 smithi194 ceph-mon[33679]: osdmap e294: 12 total, 12 up, 12 in 2024-05-08T08:35:03.379 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/agg-tx.o 2024-05-08T08:35:05.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:04 smithi070 ceph-mon[29591]: pgmap v3458: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 637 KiB/s wr, 27 op/s 2024-05-08T08:35:05.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:04 smithi172 ceph-mon[33377]: pgmap v3458: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 637 KiB/s wr, 27 op/s 2024-05-08T08:35:05.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:04 smithi194 ceph-mon[33679]: pgmap v3458: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 599 KiB/s rd, 637 KiB/s wr, 27 op/s 2024-05-08T08:35:07.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:06 smithi070 ceph-mon[29591]: pgmap v3459: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 562 KiB/s wr, 47 op/s 2024-05-08T08:35:07.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:06 smithi172 ceph-mon[33377]: pgmap v3459: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 562 KiB/s wr, 47 op/s 2024-05-08T08:35:07.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:06 smithi194 ceph-mon[33679]: pgmap v3459: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 562 KiB/s wr, 47 op/s 2024-05-08T08:35:09.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:08 smithi070 ceph-mon[29591]: pgmap v3460: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 562 KiB/s wr, 47 op/s 2024-05-08T08:35:09.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:08 smithi172 ceph-mon[33377]: pgmap v3460: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 562 KiB/s wr, 47 op/s 2024-05-08T08:35:09.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:08 smithi194 ceph-mon[33679]: pgmap v3460: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 562 KiB/s wr, 47 op/s 2024-05-08T08:35:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:10 smithi194 ceph-mon[33679]: osdmap e295: 12 total, 12 up, 12 in 2024-05-08T08:35:10.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:10 smithi194 ceph-mon[33679]: pgmap v3462: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 556 KiB/s wr, 52 op/s 2024-05-08T08:35:10.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:10 smithi070 ceph-mon[29591]: osdmap e295: 12 total, 12 up, 12 in 2024-05-08T08:35:10.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:10 smithi070 ceph-mon[29591]: pgmap v3462: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 556 KiB/s wr, 52 op/s 2024-05-08T08:35:10.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:10 smithi172 ceph-mon[33377]: osdmap e295: 12 total, 12 up, 12 in 2024-05-08T08:35:10.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:10 smithi172 ceph-mon[33377]: pgmap v3462: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 556 KiB/s wr, 52 op/s 2024-05-08T08:35:12.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:12 smithi172 ceph-mon[33377]: pgmap v3463: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 453 KiB/s wr, 42 op/s 2024-05-08T08:35:13.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:12 smithi194 ceph-mon[33679]: pgmap v3463: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 453 KiB/s wr, 42 op/s 2024-05-08T08:35:13.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:12 smithi070 ceph-mon[29591]: pgmap v3463: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 453 KiB/s wr, 42 op/s 2024-05-08T08:35:14.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:14 smithi172 ceph-mon[33377]: pgmap v3464: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 445 KiB/s wr, 41 op/s 2024-05-08T08:35:15.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:14 smithi194 ceph-mon[33679]: pgmap v3464: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 445 KiB/s wr, 41 op/s 2024-05-08T08:35:15.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:14 smithi070 ceph-mon[29591]: pgmap v3464: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 445 KiB/s wr, 41 op/s 2024-05-08T08:35:16.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:16 smithi172 ceph-mon[33377]: pgmap v3465: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 200 KiB/s wr, 10 op/s 2024-05-08T08:35:17.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:16 smithi194 ceph-mon[33679]: pgmap v3465: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 200 KiB/s wr, 10 op/s 2024-05-08T08:35:17.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:16 smithi070 ceph-mon[29591]: pgmap v3465: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 200 KiB/s wr, 10 op/s 2024-05-08T08:35:19.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:18 smithi194 ceph-mon[33679]: pgmap v3466: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 200 KiB/s wr, 10 op/s 2024-05-08T08:35:19.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:18 smithi070 ceph-mon[29591]: pgmap v3466: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 200 KiB/s wr, 10 op/s 2024-05-08T08:35:19.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:18 smithi172 ceph-mon[33377]: pgmap v3466: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 200 KiB/s wr, 10 op/s 2024-05-08T08:35:20.975 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:20 smithi172 ceph-mon[33377]: pgmap v3467: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 154 KiB/s wr, 9 op/s 2024-05-08T08:35:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:20 smithi194 ceph-mon[33679]: pgmap v3467: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 154 KiB/s wr, 9 op/s 2024-05-08T08:35:21.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:20 smithi070 ceph-mon[29591]: pgmap v3467: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 154 KiB/s wr, 9 op/s 2024-05-08T08:35:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:22 smithi194 ceph-mon[33679]: pgmap v3468: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T08:35:23.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:22 smithi070 ceph-mon[29591]: pgmap v3468: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T08:35:23.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:22 smithi172 ceph-mon[33377]: pgmap v3468: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T08:35:25.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:24 smithi194 ceph-mon[33679]: pgmap v3469: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T08:35:25.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.049+0000 7fde1f400700 1 -- 172.21.15.70:0/1911661903 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55cf828d9590 con 0x55cf82a10410 2024-05-08T08:35:25.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.049+0000 7fde1f400700 10 client.37109 handle_command_reply: tid=0 2024-05-08T08:35:25.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.049+0000 7fde4ac15b80 1 client.37109 shutdown 2024-05-08T08:35:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.049+0000 7fde4ac15b80 1 -- 172.21.15.70:0/1911661903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 msgr2=0x55cf8298c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.049+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 0x55cf8298c130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55cf82986870 tx=0x7fde2c004750 comp rx=0 tx=0).stop 2024-05-08T08:35:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.050+0000 7fde4ac15b80 1 -- 172.21.15.70:0/1911661903 shutdown_connections 2024-05-08T08:35:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.050+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf82a10410 0x55cf82a12830 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:25.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.050+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf8297f240 0x55cf82989150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.050+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf82979810 0x55cf8298c130 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.050+0000 7fde4ac15b80 1 --2- 172.21.15.70:0/1911661903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf8297a1d0 0x55cf82988a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.050+0000 7fde4ac15b80 1 -- 172.21.15.70:0/1911661903 >> 172.21.15.70:0/1911661903 conn(0x55cf828f1860 msgr2=0x55cf82978800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:35:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.050+0000 7fde1f400700 0 client.37109 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:35:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.051+0000 7fde4ac15b80 1 -- 172.21.15.70:0/1911661903 shutdown_connections 2024-05-08T08:35:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.051+0000 7fde4ac15b80 1 -- 172.21.15.70:0/1911661903 wait complete. 2024-05-08T08:35:25.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.051+0000 7fde4ac15b80 20 client.37109 trim_cache size 0 max 16384 2024-05-08T08:35:25.045 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:24 smithi070 ceph-mon[29591]: pgmap v3469: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T08:35:25.045 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:35:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:35:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:35:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 246, 2024-05-08T08:35:25.045 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "1f3cda5b": { 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 246, 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:35:25.046 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:35:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:35:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:35:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:35:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:35:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:35:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:35:25.047 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:35:25.047 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 -- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde200b2b20 msgr2=0x7fde200b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde200b2b20 0x7fde200b4fe0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fde2c00ba10 tx=0x7fde2c00b3f0 comp rx=0 tx=0).stop 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 -- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde38075ff0 msgr2=0x7fde3810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde38075ff0 0x7fde3810c940 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fde2400e9a0 tx=0x7fde2400ed60 comp rx=0 tx=0).stop 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 -- 172.21.15.70:0/4061165295 shutdown_connections 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fde200b2b20 0x7fde200b4fe0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde3810fed0 0x7fde3810cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fde380756d0 0x7fde3810f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 --2- 172.21.15.70:0/4061165295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde38075ff0 0x7fde3810c940 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.053+0000 7fde40200700 1 -- 172.21.15.70:0/4061165295 >> 172.21.15.70:0/4061165295 conn(0x7fde3807a650 msgr2=0x7fde38101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.054+0000 7fde40200700 1 -- 172.21.15.70:0/4061165295 shutdown_connections 2024-05-08T08:35:25.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:25.054+0000 7fde40200700 1 -- 172.21.15.70:0/4061165295 wait complete. 2024-05-08T08:35:25.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:24 smithi172 ceph-mon[33377]: pgmap v3469: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T08:35:26.039 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1f3cda5b', quiesce took 42.0 seconds. Will release after: 30.0 2024-05-08T08:35:27.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:26 smithi194 ceph-mon[33679]: pgmap v3470: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 170 KiB/s wr, 11 op/s 2024-05-08T08:35:27.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:26 smithi070 ceph-mon[29591]: pgmap v3470: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 170 KiB/s wr, 11 op/s 2024-05-08T08:35:27.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:26 smithi172 ceph-mon[33377]: pgmap v3470: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 170 KiB/s wr, 11 op/s 2024-05-08T08:35:29.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:28 smithi194 ceph-mon[33679]: pgmap v3471: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 158 KiB/s wr, 7 op/s 2024-05-08T08:35:29.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:28 smithi070 ceph-mon[29591]: pgmap v3471: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 158 KiB/s wr, 7 op/s 2024-05-08T08:35:29.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:28 smithi172 ceph-mon[33377]: pgmap v3471: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 158 KiB/s wr, 7 op/s 2024-05-08T08:35:31.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:30 smithi194 ceph-mon[33679]: pgmap v3472: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 16 op/s 2024-05-08T08:35:31.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:30 smithi070 ceph-mon[29591]: pgmap v3472: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 16 op/s 2024-05-08T08:35:31.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:30 smithi172 ceph-mon[33377]: pgmap v3472: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 215 KiB/s wr, 16 op/s 2024-05-08T08:35:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:32 smithi194 ceph-mon[33679]: pgmap v3473: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 12 op/s 2024-05-08T08:35:33.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:32 smithi070 ceph-mon[29591]: pgmap v3473: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 12 op/s 2024-05-08T08:35:33.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:32 smithi172 ceph-mon[33377]: pgmap v3473: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 12 op/s 2024-05-08T08:35:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:34 smithi194 ceph-mon[33679]: pgmap v3474: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 12 op/s 2024-05-08T08:35:35.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:34 smithi070 ceph-mon[29591]: pgmap v3474: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 12 op/s 2024-05-08T08:35:35.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:34 smithi172 ceph-mon[33377]: pgmap v3474: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 97 KiB/s wr, 12 op/s 2024-05-08T08:35:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:36 smithi194 ceph-mon[33679]: pgmap v3475: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 17 op/s 2024-05-08T08:35:37.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:36 smithi070 ceph-mon[29591]: pgmap v3475: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 17 op/s 2024-05-08T08:35:37.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:36 smithi172 ceph-mon[33377]: pgmap v3475: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 165 KiB/s wr, 17 op/s 2024-05-08T08:35:39.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:38 smithi194 ceph-mon[33679]: pgmap v3476: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 124 KiB/s wr, 13 op/s 2024-05-08T08:35:39.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:38 smithi070 ceph-mon[29591]: pgmap v3476: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 124 KiB/s wr, 13 op/s 2024-05-08T08:35:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:38 smithi172 ceph-mon[33377]: pgmap v3476: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 124 KiB/s wr, 13 op/s 2024-05-08T08:35:41.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:40 smithi194 ceph-mon[33679]: pgmap v3477: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 130 KiB/s wr, 17 op/s 2024-05-08T08:35:41.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:40 smithi070 ceph-mon[29591]: pgmap v3477: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 130 KiB/s wr, 17 op/s 2024-05-08T08:35:41.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:40 smithi172 ceph-mon[33377]: pgmap v3477: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 130 KiB/s wr, 17 op/s 2024-05-08T08:35:43.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:42 smithi194 ceph-mon[33679]: pgmap v3478: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 8 op/s 2024-05-08T08:35:43.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:42 smithi070 ceph-mon[29591]: pgmap v3478: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 8 op/s 2024-05-08T08:35:43.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:42 smithi172 ceph-mon[33377]: pgmap v3478: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 8 op/s 2024-05-08T08:35:45.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:44 smithi070 ceph-mon[29591]: pgmap v3479: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 8 op/s 2024-05-08T08:35:45.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:44 smithi172 ceph-mon[33377]: pgmap v3479: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 8 op/s 2024-05-08T08:35:45.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:44 smithi194 ceph-mon[33679]: pgmap v3479: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 74 KiB/s wr, 8 op/s 2024-05-08T08:35:47.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:46 smithi070 ceph-mon[29591]: pgmap v3480: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 11 op/s 2024-05-08T08:35:47.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:46 smithi172 ceph-mon[33377]: pgmap v3480: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 11 op/s 2024-05-08T08:35:47.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:46 smithi194 ceph-mon[33679]: pgmap v3480: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 11 op/s 2024-05-08T08:35:49.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:48 smithi070 ceph-mon[29591]: pgmap v3481: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T08:35:49.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:35:49.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:48 smithi172 ceph-mon[33377]: pgmap v3481: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T08:35:49.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:35:49.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:48 smithi194 ceph-mon[33679]: pgmap v3481: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T08:35:49.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:35:50.074 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:35:50.075 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:35:50.075 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:35:50.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:35:50.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:35:50.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:35:50.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:35:50.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:35:50.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:35:51.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:51 smithi194 ceph-mon[33679]: pgmap v3482: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-05-08T08:35:51.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:51 smithi070 ceph-mon[29591]: pgmap v3482: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-05-08T08:35:51.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:51 smithi172 ceph-mon[33377]: pgmap v3482: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 50 KiB/s wr, 9 op/s 2024-05-08T08:35:53.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:53 smithi194 ceph-mon[33679]: pgmap v3483: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-05-08T08:35:53.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:53 smithi070 ceph-mon[29591]: pgmap v3483: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-05-08T08:35:53.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:53 smithi172 ceph-mon[33377]: pgmap v3483: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-05-08T08:35:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:55 smithi194 ceph-mon[33679]: pgmap v3484: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-05-08T08:35:55.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:55 smithi070 ceph-mon[29591]: pgmap v3484: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-05-08T08:35:55.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:55 smithi172 ceph-mon[33377]: pgmap v3484: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-05-08T08:35:56.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:35:56.483 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:35:57.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:57 smithi194 ceph-mon[33679]: pgmap v3485: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 8 op/s 2024-05-08T08:35:57.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:57 smithi070 ceph-mon[29591]: pgmap v3485: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 8 op/s 2024-05-08T08:35:57.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:57 smithi172 ceph-mon[33377]: pgmap v3485: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 8 op/s 2024-05-08T08:35:59.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:35:59 smithi070 ceph-mon[29591]: pgmap v3486: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2024-05-08T08:35:59.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:35:59 smithi194 ceph-mon[33679]: pgmap v3486: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2024-05-08T08:35:59.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:35:59 smithi172 ceph-mon[33377]: pgmap v3486: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2024-05-08T08:35:59.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.717+0000 7fc775a00700 1 -- 172.21.15.70:0/708455407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103550 msgr2=0x7fc7701039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:59.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.717+0000 7fc775a00700 1 --2- 172.21.15.70:0/708455407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103550 0x7fc7701039b0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009990 tx=0x7fc75c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:35:59.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.717+0000 7fc775a00700 1 -- 172.21.15.70:0/708455407 shutdown_connections 2024-05-08T08:35:59.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.717+0000 7fc775a00700 1 --2- 172.21.15.70:0/708455407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc770103ef0 0x7fc7701103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:59.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.717+0000 7fc775a00700 1 --2- 172.21.15.70:0/708455407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc770108460 0x7fc770108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:59.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.717+0000 7fc775a00700 1 --2- 172.21.15.70:0/708455407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103550 0x7fc7701039b0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:59.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.717+0000 7fc775a00700 1 -- 172.21.15.70:0/708455407 >> 172.21.15.70:0/708455407 conn(0x7fc77007a600 msgr2=0x7fc77007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:35:59.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.717+0000 7fc775a00700 1 -- 172.21.15.70:0/708455407 shutdown_connections 2024-05-08T08:35:59.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.717+0000 7fc775a00700 1 -- 172.21.15.70:0/708455407 wait complete. 2024-05-08T08:35:59.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.719+0000 7fc775a00700 1 Processor -- start 2024-05-08T08:35:59.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.719+0000 7fc775a00700 1 -- start start 2024-05-08T08:35:59.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.719+0000 7fc775a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc770103550 0x7fc77019f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:59.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.719+0000 7fc775a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103ef0 0x7fc77019fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:59.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.719+0000 7fc775a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc770108460 0x7fc770199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:59.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.719+0000 7fc775a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc7701135b0 con 0x7fc770103ef0 2024-05-08T08:35:59.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.719+0000 7fc775a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc770113430 con 0x7fc770108460 2024-05-08T08:35:59.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.719+0000 7fc775a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc770113730 con 0x7fc770103550 2024-05-08T08:35:59.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103ef0 0x7fc77019fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103ef0 0x7fc77019fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60210/0 (socket says 172.21.15.70:60210) 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76e000700 1 -- 172.21.15.70:0/1145503139 learned_addr learned my addr 172.21.15.70:0/1145503139 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76ea00700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc770103550 0x7fc77019f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76f400700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc770108460 0x7fc770199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76e000700 1 -- 172.21.15.70:0/1145503139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc770103550 msgr2=0x7fc77019f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76e000700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc770103550 0x7fc77019f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76e000700 1 -- 172.21.15.70:0/1145503139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc770108460 msgr2=0x7fc770199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76e000700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc770108460 0x7fc770199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.720+0000 7fc76e000700 1 -- 172.21.15.70:0/1145503139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77019a090 con 0x7fc770103ef0 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.721+0000 7fc76f400700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc770108460 0x7fc770199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:35:59.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.721+0000 7fc76e000700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103ef0 0x7fc77019fcb0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc75c000c00 tx=0x7fc75c0057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:35:59.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.721+0000 7fc767400700 1 -- 172.21.15.70:0/1145503139 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c027070 con 0x7fc770103ef0 2024-05-08T08:35:59.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.721+0000 7fc767400700 1 -- 172.21.15.70:0/1145503139 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc75c00fb00 con 0x7fc770103ef0 2024-05-08T08:35:59.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.721+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc77019a320 con 0x7fc770103ef0 2024-05-08T08:35:59.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.721+0000 7fc767400700 1 -- 172.21.15.70:0/1145503139 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75c022b70 con 0x7fc770103ef0 2024-05-08T08:35:59.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.722+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7701a6640 con 0x7fc770103ef0 2024-05-08T08:35:59.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.723+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc77010ba90 con 0x7fc770103ef0 2024-05-08T08:35:59.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.725+0000 7fc767400700 1 -- 172.21.15.70:0/1145503139 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc75c022d10 con 0x7fc770103ef0 2024-05-08T08:35:59.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.728+0000 7fc767400700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7540b29f0 0x7fc7540b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:35:59.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.728+0000 7fc767400700 1 -- 172.21.15.70:0/1145503139 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(295..295 src has 1..295) ==== 9583+0+0 (secure 0 0 0) 0x7fc75c0e3ae0 con 0x7fc770103ef0 2024-05-08T08:35:59.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.728+0000 7fc76ea00700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7540b29f0 0x7fc7540b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:35:59.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.729+0000 7fc76ea00700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7540b29f0 0x7fc7540b4eb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc77019aa70 tx=0x7fc76000b410 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:35:59.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:35:59.732+0000 7fc767400700 1 -- 172.21.15.70:0/1145503139 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc75c013070 con 0x7fc770103ef0 2024-05-08T08:36:00.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.016+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc77006a190 con 0x7fc770103ef0 2024-05-08T08:36:00.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.017+0000 7fc767400700 1 -- 172.21.15.70:0/1145503139 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fc75c0ab0d0 con 0x7fc770103ef0 2024-05-08T08:36:00.010 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:36:00.010 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:36:00.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7540b29f0 msgr2=0x7fc7540b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7540b29f0 0x7fc7540b4eb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc77019aa70 tx=0x7fc76000b410 comp rx=0 tx=0).stop 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103ef0 msgr2=0x7fc77019fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103ef0 0x7fc77019fcb0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc75c000c00 tx=0x7fc75c0057a0 comp rx=0 tx=0).stop 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 shutdown_connections 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc7540b29f0 0x7fc7540b4eb0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc770108460 0x7fc770199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc770103550 0x7fc77019f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 --2- 172.21.15.70:0/1145503139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc770103ef0 0x7fc77019fcb0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 >> 172.21.15.70:0/1145503139 conn(0x7fc77007a600 msgr2=0x7fc770101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 shutdown_connections 2024-05-08T08:36:00.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:00.020+0000 7fc775a00700 1 -- 172.21.15.70:0/1145503139 wait complete. 2024-05-08T08:36:00.014 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:36:00.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:00 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1145503139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:36:00.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:00 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1145503139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:36:00.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:00 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1145503139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:36:00.816 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 1f3cda5b --release --await' 2024-05-08T08:36:00.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 1f3cda5b --release --await 2024-05-08T08:36:01.260 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:36:01.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:01 smithi194 ceph-mon[33679]: pgmap v3487: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T08:36:01.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:01 smithi070 ceph-mon[29591]: pgmap v3487: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T08:36:01.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:01 smithi172 ceph-mon[33377]: pgmap v3487: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T08:36:03.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:03 smithi194 ceph-mon[33679]: pgmap v3488: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2024-05-08T08:36:03.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:03 smithi070 ceph-mon[29591]: pgmap v3488: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2024-05-08T08:36:03.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:03 smithi172 ceph-mon[33377]: pgmap v3488: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2024-05-08T08:36:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.403+0000 7f2c5d000700 1 -- 172.21.15.70:0/2266037262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 msgr2=0x7f2c58109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.403+0000 7f2c5d000700 1 --2- 172.21.15.70:0/2266037262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 0x7f2c58109f50 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009990 tx=0x7f2c44009ca0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.403+0000 7f2c5d000700 1 -- 172.21.15.70:0/2266037262 shutdown_connections 2024-05-08T08:36:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.403+0000 7f2c5d000700 1 --2- 172.21.15.70:0/2266037262 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c5810a490 0x7f2c581169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.403+0000 7f2c5d000700 1 --2- 172.21.15.70:0/2266037262 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c5810fb60 0x7f2c5810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.403+0000 7f2c5d000700 1 --2- 172.21.15.70:0/2266037262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 0x7f2c58109f50 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.403+0000 7f2c5d000700 1 -- 172.21.15.70:0/2266037262 >> 172.21.15.70:0/2266037262 conn(0x7f2c58076c70 msgr2=0x7f2c581082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.403+0000 7f2c5d000700 1 -- 172.21.15.70:0/2266037262 shutdown_connections 2024-05-08T08:36:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.403+0000 7f2c5d000700 1 -- 172.21.15.70:0/2266037262 wait complete. 2024-05-08T08:36:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.404+0000 7f2c5d000700 1 Processor -- start 2024-05-08T08:36:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.404+0000 7f2c5d000700 1 -- start start 2024-05-08T08:36:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c5d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 0x7f2c581a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c5d000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c5810a490 0x7f2c581a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c5d000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c5810fb60 0x7f2c581a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c5d000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58119c10 con 0x7f2c58109ad0 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c5d000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58119a90 con 0x7f2c5810a490 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c5d000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2c58119d90 con 0x7f2c5810fb60 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c55e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 0x7f2c581a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c55e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 0x7f2c581a0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60222/0 (socket says 172.21.15.70:60222) 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c55e00700 1 -- 172.21.15.70:0/4087536922 learned_addr learned my addr 172.21.15.70:0/4087536922 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c55400700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c5810a490 0x7f2c581a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.405+0000 7f2c56800700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c5810fb60 0x7f2c581a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c55e00700 1 -- 172.21.15.70:0/4087536922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c5810fb60 msgr2=0x7f2c581a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c55e00700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c5810fb60 0x7f2c581a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c55e00700 1 -- 172.21.15.70:0/4087536922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c5810a490 msgr2=0x7f2c581a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c55e00700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c5810a490 0x7f2c581a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c55e00700 1 -- 172.21.15.70:0/4087536922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c581a5130 con 0x7f2c58109ad0 2024-05-08T08:36:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c55400700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c5810a490 0x7f2c581a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:36:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c55e00700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 0x7f2c581a0120 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800d980 tx=0x7f2c4800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c4ea00700 1 -- 172.21.15.70:0/4087536922 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c48017070 con 0x7f2c58109ad0 2024-05-08T08:36:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c4ea00700 1 -- 172.21.15.70:0/4087536922 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c48004830 con 0x7f2c58109ad0 2024-05-08T08:36:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.406+0000 7f2c5d000700 1 -- 172.21.15.70:0/4087536922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c581a5420 con 0x7f2c58109ad0 2024-05-08T08:36:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.407+0000 7f2c4ea00700 1 -- 172.21.15.70:0/4087536922 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480053a0 con 0x7f2c58109ad0 2024-05-08T08:36:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.407+0000 7f2c5d000700 1 -- 172.21.15.70:0/4087536922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c581acca0 con 0x7f2c58109ad0 2024-05-08T08:36:04.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.410+0000 7f2c4ea00700 1 -- 172.21.15.70:0/4087536922 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2c480049e0 con 0x7f2c58109ad0 2024-05-08T08:36:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.411+0000 7f2c4ea00700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c3c0b2a70 0x7f2c3c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.412+0000 7f2c4ea00700 1 -- 172.21.15.70:0/4087536922 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(295..295 src has 1..295) ==== 9583+0+0 (secure 0 0 0) 0x7f2c480e2920 con 0x7f2c58109ad0 2024-05-08T08:36:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.412+0000 7f2c55400700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c3c0b2a70 0x7f2c3c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.412+0000 7f2c55400700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c3c0b2a70 0x7f2c3c0b4f30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2c44006010 tx=0x7f2c4401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:04.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.432+0000 7f2c6795db80 1 Processor -- start 2024-05-08T08:36:04.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.432+0000 7f2c6795db80 1 -- start start 2024-05-08T08:36:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.432+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e3fa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.432+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 0x558a9e3f4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.432+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4e50 0x558a9e400c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.432+0000 7f2c6795db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558a9e346b20 con 0x558a9e3f4e50 2024-05-08T08:36:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.432+0000 7f2c6795db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558a9e2e4860 con 0x558a9e3f9ec0 2024-05-08T08:36:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.432+0000 7f2c6795db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558a9e342ae0 con 0x558a9e3f4490 2024-05-08T08:36:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c56800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4e50 0x558a9e400c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c56800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4e50 0x558a9e400c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60230/0 (socket says 172.21.15.70:60230) 2024-05-08T08:36:04.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c56800700 1 -- 172.21.15.70:0/2589882678 learned_addr learned my addr 172.21.15.70:0/2589882678 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:04.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c55e00700 1 --2- 172.21.15.70:0/2589882678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e3fa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c55400700 1 --2- 172.21.15.70:0/2589882678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 0x558a9e3f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c56800700 1 -- 172.21.15.70:0/2589882678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 msgr2=0x558a9e3f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:04.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c56800700 1 --2- 172.21.15.70:0/2589882678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 0x558a9e3f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c56800700 1 -- 172.21.15.70:0/2589882678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 msgr2=0x558a9e3fa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:04.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c56800700 1 --2- 172.21.15.70:0/2589882678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e3fa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.433+0000 7f2c56800700 1 -- 172.21.15.70:0/2589882678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a9e2939d0 con 0x558a9e3f4e50 2024-05-08T08:36:04.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.434+0000 7f2c56800700 1 --2- 172.21.15.70:0/2589882678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4e50 0x558a9e400c80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009dc0 tx=0x7f2c500077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bcf5d8d270c51 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:04.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.434+0000 7f2c43400700 1 -- 172.21.15.70:0/2589882678 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50014610 con 0x558a9e3f4e50 2024-05-08T08:36:04.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.434+0000 7f2c43400700 1 -- 172.21.15.70:0/2589882678 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c50019070 con 0x558a9e3f4e50 2024-05-08T08:36:04.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.434+0000 7f2c43400700 1 -- 172.21.15.70:0/2589882678 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50013870 con 0x558a9e3f4e50 2024-05-08T08:36:04.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.435+0000 7f2c6795db80 1 -- 172.21.15.70:0/2589882678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4e50 msgr2=0x558a9e400c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:04.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.435+0000 7f2c6795db80 1 --2- 172.21.15.70:0/2589882678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4e50 0x558a9e400c80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2c50009dc0 tx=0x7f2c500077e0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.435+0000 7f2c6795db80 1 -- 172.21.15.70:0/2589882678 shutdown_connections 2024-05-08T08:36:04.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.435+0000 7f2c6795db80 1 --2- 172.21.15.70:0/2589882678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4e50 0x558a9e400c80 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.435+0000 7f2c6795db80 1 --2- 172.21.15.70:0/2589882678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e3fa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.435+0000 7f2c6795db80 1 --2- 172.21.15.70:0/2589882678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 0x558a9e3f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.435+0000 7f2c6795db80 1 -- 172.21.15.70:0/2589882678 >> 172.21.15.70:0/2589882678 conn(0x558a9e322c60 msgr2=0x558a9e3eed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:04.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.435+0000 7f2c6795db80 1 -- 172.21.15.70:0/2589882678 shutdown_connections 2024-05-08T08:36:04.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.435+0000 7f2c6795db80 1 -- 172.21.15.70:0/2589882678 wait complete. 2024-05-08T08:36:04.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.436+0000 7f2c6795db80 1 -- start start 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.436+0000 7f2c6795db80 1 Processor -- start 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e400890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 0x558a9e3fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e3fe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c6795db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558a9e401280 con 0x558a9e3f4490 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c6795db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558a9e2acc20 con 0x558a9e3f9ec0 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c6795db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558a9e401400 con 0x558a9e3f4e50 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c6795db80 10 client.0 _ll_register_callbacks cb 0x558a9e2edd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c55e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e400890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c55e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e400890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60238/0 (socket says 172.21.15.70:60238) 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c55e00700 1 -- 172.21.15.70:0/3916781601 learned_addr learned my addr 172.21.15.70:0/3916781601 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.437+0000 7f2c55400700 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 0x558a9e3fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c56800700 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e3fe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c55e00700 1 -- 172.21.15.70:0/3916781601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 msgr2=0x558a9e3fdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:04.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c55e00700 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 0x558a9e3fdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c55e00700 1 -- 172.21.15.70:0/3916781601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 msgr2=0x558a9e3fe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c55e00700 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e3fe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c55e00700 1 -- 172.21.15.70:0/3916781601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a9e30c520 con 0x558a9e3f4490 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c55e00700 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e400890 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2c480a5800 tx=0x7f2c480cc0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3401a2e4ded4fdd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c37e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c37e00700 1 -- 172.21.15.70:0/3916781601 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480a9780 con 0x558a9e3f4490 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c37e00700 1 -- 172.21.15.70:0/3916781601 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(295..295 src has 1..295) ==== 9583+0+0 (secure 0 0 0) 0x7f2c480a9bf0 con 0x558a9e3f4490 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.438+0000 7f2c6795db80 1 -- 172.21.15.70:0/3916781601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c50019070 con 0x558a9e3f4490 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c37e00700 1 -- 172.21.15.70:0/3916781601 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2c480c7020 con 0x558a9e3f4490 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c6795db80 10 client.18324 fetch_fsmap learned FSMap version 42 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c6795db80 1 -- 172.21.15.70:0/3916781601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558a9e40bae0 con 0x558a9e3f4490 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c37e00700 1 -- 172.21.15.70:0/3916781601 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c50019070 con 0x558a9e3f4490 2024-05-08T08:36:04.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c37e00700 1 -- 172.21.15.70:0/3916781601 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2c480b2150 con 0x558a9e3f4490 2024-05-08T08:36:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c6795db80 10 client.18324 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:36:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c6795db80 10 client.18324 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:36:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c6795db80 20 client.18324 populate_metadata read hostname 'smithi070' 2024-05-08T08:36:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c6795db80 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558a9e40e120 0x558a9e410510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c6795db80 4 client.18324 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:36:04.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.439+0000 7f2c6795db80 1 -- 172.21.15.70:0/3916781601 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a9e3c11a0 con 0x558a9e40e120 2024-05-08T08:36:04.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.440+0000 7f2c55400700 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558a9e40e120 0x558a9e410510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.441+0000 7f2c55400700 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558a9e40e120 0x558a9e410510 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f87bb4d72162514 server_cookie=cf2697212080f783 in_seq=0 out_seq=0 2024-05-08T08:36:04.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.441+0000 7f2c37e00700 10 client.18324 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:36:04.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.443+0000 7f2c37e00700 1 -- 172.21.15.70:0/3916781601 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558a9e3c11a0 con 0x558a9e40e120 2024-05-08T08:36:04.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.443+0000 7f2c37e00700 10 client.18324 handle_command_reply: tid=0 2024-05-08T08:36:04.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.443+0000 7f2c6795db80 1 client.18324 shutdown 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.443+0000 7f2c6795db80 1 -- 172.21.15.70:0/3916781601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 msgr2=0x558a9e400890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.443+0000 7f2c6795db80 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e400890 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2c480a5800 tx=0x7f2c480cc0b0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c6795db80 1 -- 172.21.15.70:0/3916781601 shutdown_connections 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c6795db80 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558a9e40e120 0x558a9e410510 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c6795db80 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e3fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c6795db80 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e400890 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c6795db80 1 --2- 172.21.15.70:0/3916781601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 0x558a9e3fdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c6795db80 1 -- 172.21.15.70:0/3916781601 >> 172.21.15.70:0/3916781601 conn(0x558a9e322c60 msgr2=0x558a9e3e9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c37e00700 0 client.18324 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c6795db80 1 -- 172.21.15.70:0/3916781601 shutdown_connections 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c6795db80 1 -- 172.21.15.70:0/3916781601 wait complete. 2024-05-08T08:36:04.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.444+0000 7f2c6795db80 20 client.18324 trim_cache size 0 max 16384 2024-05-08T08:36:04.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.466+0000 7f2c6795db80 1 Processor -- start 2024-05-08T08:36:04.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.466+0000 7f2c6795db80 1 -- start start 2024-05-08T08:36:04.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.466+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e40a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.466+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 0x558a9e3f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.466+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e415d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.466+0000 7f2c6795db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581b85e0 con 0x558a9e3f4490 2024-05-08T08:36:04.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.466+0000 7f2c6795db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581b5e70 con 0x558a9e3f9ec0 2024-05-08T08:36:04.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.466+0000 7f2c6795db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581b3ce0 con 0x558a9e3f4e50 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e40a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e40a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60248/0 (socket says 172.21.15.70:60248) 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55e00700 1 -- 172.21.15.70:0/1173257295 learned_addr learned my addr 172.21.15.70:0/1173257295 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55400700 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 0x558a9e3f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c56800700 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e415d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55e00700 1 -- 172.21.15.70:0/1173257295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 msgr2=0x558a9e3f7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55e00700 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 0x558a9e3f7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55e00700 1 -- 172.21.15.70:0/1173257295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 msgr2=0x558a9e415d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55e00700 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e415d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55e00700 1 -- 172.21.15.70:0/1173257295 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a9e3f0ee0 con 0x558a9e3f4490 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c56800700 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e415d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.467+0000 7f2c55400700 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 0x558a9e3f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:36:04.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.468+0000 7f2c55e00700 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e40a310 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f2c480cc010 tx=0x7f2c480a8fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8765de9f44600d63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:04.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.468+0000 7f2c42a00700 1 -- 172.21.15.70:0/1173257295 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480b25e0 con 0x558a9e3f4490 2024-05-08T08:36:04.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.468+0000 7f2c42a00700 1 -- 172.21.15.70:0/1173257295 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c48015070 con 0x558a9e3f4490 2024-05-08T08:36:04.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.468+0000 7f2c42a00700 1 -- 172.21.15.70:0/1173257295 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c480bee30 con 0x558a9e3f4490 2024-05-08T08:36:04.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 -- 172.21.15.70:0/1173257295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 msgr2=0x558a9e40a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e40a310 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f2c480cc010 tx=0x7f2c480a8fb0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 -- 172.21.15.70:0/1173257295 shutdown_connections 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f9ec0 0x558a9e415d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f4490 0x558a9e40a310 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1173257295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4e50 0x558a9e3f7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 -- 172.21.15.70:0/1173257295 >> 172.21.15.70:0/1173257295 conn(0x558a9e322c60 msgr2=0x558a9e3f3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 -- 172.21.15.70:0/1173257295 shutdown_connections 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 -- 172.21.15.70:0/1173257295 wait complete. 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 -- start start 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.469+0000 7f2c6795db80 1 Processor -- start 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 0x558a9e4067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f4e50 0x558a9e406cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c6795db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f9ec0 0x558a9e403d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c6795db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581b4330 con 0x558a9e3f9ec0 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c6795db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581b57a0 con 0x558a9e3f4e50 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c6795db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2c581b4a00 con 0x558a9e3f4490 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c6795db80 10 client.0 _ll_register_callbacks cb 0x558a9e2edd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c56800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f9ec0 0x558a9e403d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c56800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f9ec0 0x558a9e403d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60254/0 (socket says 172.21.15.70:60254) 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.470+0000 7f2c56800700 1 -- 172.21.15.70:0/1348880737 learned_addr learned my addr 172.21.15.70:0/1348880737 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c55e00700 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 0x558a9e4067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c55400700 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f4e50 0x558a9e406cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c56800700 1 -- 172.21.15.70:0/1348880737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 msgr2=0x558a9e4067b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c56800700 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 0x558a9e4067b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c56800700 1 -- 172.21.15.70:0/1348880737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f4e50 msgr2=0x558a9e406cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c56800700 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f4e50 0x558a9e406cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c56800700 1 -- 172.21.15.70:0/1348880737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a9e404550 con 0x558a9e3f9ec0 2024-05-08T08:36:04.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c55400700 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f4e50 0x558a9e406cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c56800700 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f9ec0 0x558a9e403d10 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f2c50007f50 tx=0x7f2c50004f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c231f9f7b822c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.471+0000 7f2c37e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.472+0000 7f2c37e00700 1 -- 172.21.15.70:0/1348880737 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c50014820 con 0x558a9e3f9ec0 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.472+0000 7f2c37e00700 1 -- 172.21.15.70:0/1348880737 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(295..295 src has 1..295) ==== 9583+0+0 (secure 0 0 0) 0x7f2c500149c0 con 0x558a9e3f9ec0 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.472+0000 7f2c6795db80 1 -- 172.21.15.70:0/1348880737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c48015070 con 0x558a9e3f9ec0 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.472+0000 7f2c37e00700 1 -- 172.21.15.70:0/1348880737 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2c50030050 con 0x558a9e3f9ec0 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.472+0000 7f2c6795db80 10 client.18330 fetch_fsmap learned FSMap version 42 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.472+0000 7f2c6795db80 1 -- 172.21.15.70:0/1348880737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558a9e47a510 con 0x558a9e3f9ec0 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.472+0000 7f2c37e00700 1 -- 172.21.15.70:0/1348880737 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c48015070 con 0x558a9e3f9ec0 2024-05-08T08:36:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.472+0000 7f2c37e00700 1 -- 172.21.15.70:0/1348880737 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2c50025020 con 0x558a9e3f9ec0 2024-05-08T08:36:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.473+0000 7f2c6795db80 10 client.18330 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:36:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.473+0000 7f2c6795db80 10 client.18330 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:36:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.473+0000 7f2c6795db80 20 client.18330 populate_metadata read hostname 'smithi070' 2024-05-08T08:36:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.473+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558a9e47a960 0x558a9e47cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.473+0000 7f2c6795db80 4 client.18330 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1f3cda5b", "release": true, "await": true}] 2024-05-08T08:36:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.473+0000 7f2c6795db80 1 -- 172.21.15.70:0/1348880737 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1f3cda5b", "release": true, "await": true}) -- 0x558a9e354500 con 0x558a9e47a960 2024-05-08T08:36:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.473+0000 7f2c55e00700 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558a9e47a960 0x558a9e47cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.474+0000 7f2c55e00700 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558a9e47a960 0x558a9e47cd80 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2a0d8d65176e3dd server_cookie=6df3d97790c6bc12 in_seq=0 out_seq=0 2024-05-08T08:36:04.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:04.474+0000 7f2c37e00700 10 client.18330 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:36:05.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:05 smithi194 ceph-mon[33679]: pgmap v3489: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2024-05-08T08:36:05.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:05 smithi070 ceph-mon[29591]: pgmap v3489: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2024-05-08T08:36:05.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:05 smithi172 ceph-mon[33377]: pgmap v3489: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 35 KiB/s wr, 5 op/s 2024-05-08T08:36:07.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:07 smithi070 ceph-mon[29591]: pgmap v3490: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 102 KiB/s wr, 25 op/s 2024-05-08T08:36:07.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:07 smithi172 ceph-mon[33377]: pgmap v3490: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 102 KiB/s wr, 25 op/s 2024-05-08T08:36:07.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:07 smithi194 ceph-mon[33679]: pgmap v3490: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 102 KiB/s wr, 25 op/s 2024-05-08T08:36:08.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.924+0000 7f2c37e00700 1 -- 172.21.15.70:0/1348880737 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x558a9e354500 con 0x558a9e47a960 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.924+0000 7f2c37e00700 10 client.18330 handle_command_reply: tid=0 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.924+0000 7f2c6795db80 1 client.18330 shutdown 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.925+0000 7f2c6795db80 1 -- 172.21.15.70:0/1348880737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f9ec0 msgr2=0x558a9e403d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.925+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f9ec0 0x558a9e403d10 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f2c50007f50 tx=0x7f2c50004f30 comp rx=0 tx=0).stop 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.926+0000 7f2c6795db80 1 -- 172.21.15.70:0/1348880737 shutdown_connections 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.926+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558a9e47a960 0x558a9e47cd80 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.926+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558a9e3f9ec0 0x558a9e403d10 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.926+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558a9e3f4490 0x558a9e4067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.926+0000 7f2c6795db80 1 --2- 172.21.15.70:0/1348880737 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558a9e3f4e50 0x558a9e406cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.926+0000 7f2c37e00700 0 client.18330 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:36:08.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.926+0000 7f2c6795db80 1 -- 172.21.15.70:0/1348880737 >> 172.21.15.70:0/1348880737 conn(0x558a9e322c60 msgr2=0x558a9e3e8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:08.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.927+0000 7f2c6795db80 1 -- 172.21.15.70:0/1348880737 shutdown_connections 2024-05-08T08:36:08.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.927+0000 7f2c6795db80 1 -- 172.21.15.70:0/1348880737 wait complete. 2024-05-08T08:36:08.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.928+0000 7f2c6795db80 20 client.18330 trim_cache size 0 max 16384 2024-05-08T08:36:08.921 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:36:08.921 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:36:08.921 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:36:08.921 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 248, 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "1f3cda5b": { 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 248, 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:36:08.922 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:36:08.923 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:36:08.923 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:36:08.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:08.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:08.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:08.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:08.923 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:08.923 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.929+0000 7f2c5d000700 1 -- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c3c0b2a70 msgr2=0x7f2c3c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.929+0000 7f2c5d000700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c3c0b2a70 0x7f2c3c0b4f30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2c44006010 tx=0x7f2c4401a040 comp rx=0 tx=0).stop 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.929+0000 7f2c5d000700 1 -- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 msgr2=0x7f2c581a0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.929+0000 7f2c5d000700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 0x7f2c581a0120 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800d980 tx=0x7f2c4800dd40 comp rx=0 tx=0).stop 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.930+0000 7f2c5d000700 1 -- 172.21.15.70:0/4087536922 shutdown_connections 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.930+0000 7f2c5d000700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2c3c0b2a70 0x7f2c3c0b4f30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.930+0000 7f2c5d000700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c5810fb60 0x7f2c581a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.930+0000 7f2c5d000700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c58109ad0 0x7f2c581a0120 secure :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2c4800d980 tx=0x7f2c4800dd40 comp rx=0 tx=0).stop 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.930+0000 7f2c5d000700 1 --2- 172.21.15.70:0/4087536922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2c5810a490 0x7f2c581a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.930+0000 7f2c5d000700 1 -- 172.21.15.70:0/4087536922 >> 172.21.15.70:0/4087536922 conn(0x7f2c58076c70 msgr2=0x7f2c580772f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.930+0000 7f2c5d000700 1 -- 172.21.15.70:0/4087536922 shutdown_connections 2024-05-08T08:36:08.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:08.930+0000 7f2c5d000700 1 -- 172.21.15.70:0/4087536922 wait complete. 2024-05-08T08:36:09.070 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_offload.o 2024-05-08T08:36:09.175 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/xt_policy.o 2024-05-08T08:36:09.264 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:09 smithi070 ceph-mon[29591]: pgmap v3491: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 67 KiB/s wr, 22 op/s 2024-05-08T08:36:09.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:09 smithi172 ceph-mon[33377]: pgmap v3491: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 67 KiB/s wr, 22 op/s 2024-05-08T08:36:09.751 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1f3cda5b', seconds elapsed: 85.7 2024-05-08T08:36:09.751 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T08:36:09.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:36:09.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:09 smithi194 ceph-mon[33679]: pgmap v3491: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 67 KiB/s wr, 22 op/s 2024-05-08T08:36:10.316 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:36:10.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:10 smithi070 ceph-mon[29591]: osdmap e296: 12 total, 12 up, 12 in 2024-05-08T08:36:10.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:10 smithi172 ceph-mon[33377]: osdmap e296: 12 total, 12 up, 12 in 2024-05-08T08:36:10.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:10 smithi194 ceph-mon[33679]: osdmap e296: 12 total, 12 up, 12 in 2024-05-08T08:36:10.865 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/uthex.o 2024-05-08T08:36:10.936 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/sme.o 2024-05-08T08:36:11.090 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fs_pin.o 2024-05-08T08:36:11.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:11 smithi070 ceph-mon[29591]: pgmap v3493: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 87 KiB/s wr, 27 op/s 2024-05-08T08:36:11.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:11 smithi172 ceph-mon[33377]: pgmap v3493: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 87 KiB/s wr, 27 op/s 2024-05-08T08:36:11.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:11 smithi194 ceph-mon[33679]: pgmap v3493: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 87 KiB/s wr, 27 op/s 2024-05-08T08:36:11.777 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/agg-rx.o 2024-05-08T08:36:11.830 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/sunrpc/auth_gss/built-in.a 2024-05-08T08:36:12.029 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ping.o 2024-05-08T08:36:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.576+0000 7f20b5e00700 1 -- 172.21.15.70:0/1522887027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00779d0 msgr2=0x7f20b0077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.576+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1522887027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00779d0 0x7f20b0077db0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f20a000b0a0 tx=0x7f20a000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:36:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.576+0000 7f20b5e00700 1 -- 172.21.15.70:0/1522887027 shutdown_connections 2024-05-08T08:36:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.576+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1522887027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20b0114350 0x7f20b0116740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.576+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1522887027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00779d0 0x7f20b0077db0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.576+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1522887027 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20b00782f0 0x7f20b0113e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.576+0000 7f20b5e00700 1 -- 172.21.15.70:0/1522887027 >> 172.21.15.70:0/1522887027 conn(0x7f20b01011a0 msgr2=0x7f20b01035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.577+0000 7f20b5e00700 1 -- 172.21.15.70:0/1522887027 shutdown_connections 2024-05-08T08:36:12.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.577+0000 7f20b5e00700 1 -- 172.21.15.70:0/1522887027 wait complete. 2024-05-08T08:36:12.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.578+0000 7f20b5e00700 1 Processor -- start 2024-05-08T08:36:12.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.578+0000 7f20b5e00700 1 -- start start 2024-05-08T08:36:12.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.579+0000 7f20b5e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00782f0 0x7f20b01a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:12.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.579+0000 7f20b5e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20b0114350 0x7f20b01a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:12.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.579+0000 7f20b5e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20b01a4c40 0x7f20b01a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:12.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.579+0000 7f20b5e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0119bd0 con 0x7f20b00782f0 2024-05-08T08:36:12.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.579+0000 7f20b5e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0119a50 con 0x7f20b01a4c40 2024-05-08T08:36:12.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.579+0000 7f20b5e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f20b0119d50 con 0x7f20b0114350 2024-05-08T08:36:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.580+0000 7f20aea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00782f0 0x7f20b01a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.580+0000 7f20a6000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20b0114350 0x7f20b01a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.580+0000 7f20aea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00782f0 0x7f20b01a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45030/0 (socket says 172.21.15.70:45030) 2024-05-08T08:36:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.580+0000 7f20aea00700 1 -- 172.21.15.70:0/1890004828 learned_addr learned my addr 172.21.15.70:0/1890004828 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:12.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.580+0000 7f20aea00700 1 -- 172.21.15.70:0/1890004828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20b0114350 msgr2=0x7f20b01a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.580+0000 7f20aea00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20b0114350 0x7f20b01a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.580+0000 7f20aea00700 1 -- 172.21.15.70:0/1890004828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20b01a4c40 msgr2=0x7f20b01a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.580+0000 7f20aea00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20b01a4c40 0x7f20b01a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.580+0000 7f20aea00700 1 -- 172.21.15.70:0/1890004828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b01a5760 con 0x7f20b00782f0 2024-05-08T08:36:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.581+0000 7f20aea00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00782f0 0x7f20b01a0370 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f20a0000f80 tx=0x7f20a0007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:12.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.581+0000 7f20b4a00700 1 -- 172.21.15.70:0/1890004828 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0021030 con 0x7f20b00782f0 2024-05-08T08:36:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.581+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20b01a59f0 con 0x7f20b00782f0 2024-05-08T08:36:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.582+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20b01ad170 con 0x7f20b00782f0 2024-05-08T08:36:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.582+0000 7f20b4a00700 1 -- 172.21.15.70:0/1890004828 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20a0009c70 con 0x7f20b00782f0 2024-05-08T08:36:12.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.582+0000 7f20b4a00700 1 -- 172.21.15.70:0/1890004828 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0004240 con 0x7f20b00782f0 2024-05-08T08:36:12.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.584+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f208c005330 con 0x7f20b00782f0 2024-05-08T08:36:12.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.586+0000 7f20b4a00700 1 -- 172.21.15.70:0/1890004828 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f20a0024070 con 0x7f20b00782f0 2024-05-08T08:36:12.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.589+0000 7f20b4a00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f20940b29f0 0x7f20940b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:12.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.589+0000 7f20b4a00700 1 -- 172.21.15.70:0/1890004828 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(296..296 src has 1..296) ==== 9671+0+0 (secure 0 0 0) 0x7f20a000f020 con 0x7f20b00782f0 2024-05-08T08:36:12.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.589+0000 7f20a6000700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f20940b29f0 0x7f20940b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:12.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.590+0000 7f20a6000700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f20940b29f0 0x7f20940b4eb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2098005950 tx=0x7f20980058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:12.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:12.596+0000 7f20b4a00700 1 -- 172.21.15.70:0/1890004828 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f20a002b020 con 0x7f20b00782f0 2024-05-08T08:36:12.923 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/xprt.o 2024-05-08T08:36:13.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.070+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f208c0058f0 con 0x7f20b00782f0 2024-05-08T08:36:13.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.072+0000 7f20b4a00700 1 -- 172.21.15.70:0/1890004828 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f20a00aaae0 con 0x7f20b00782f0 2024-05-08T08:36:13.065 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:36:13.065 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:36:13.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f20940b29f0 msgr2=0x7f20940b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:13.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f20940b29f0 0x7f20940b4eb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2098005950 tx=0x7f20980058e0 comp rx=0 tx=0).stop 2024-05-08T08:36:13.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00782f0 msgr2=0x7f20b01a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:13.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00782f0 0x7f20b01a0370 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f20a0000f80 tx=0x7f20a0007820 comp rx=0 tx=0).stop 2024-05-08T08:36:13.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 shutdown_connections 2024-05-08T08:36:13.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f20940b29f0 0x7f20940b4eb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:13.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f20b01a4c40 0x7f20b01a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:13.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f20b00782f0 0x7f20b01a0370 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:13.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 --2- 172.21.15.70:0/1890004828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20b0114350 0x7f20b01a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:13.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 >> 172.21.15.70:0/1890004828 conn(0x7f20b01011a0 msgr2=0x7f20b0103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:13.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 shutdown_connections 2024-05-08T08:36:13.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:13.076+0000 7f20b5e00700 1 -- 172.21.15.70:0/1890004828 wait complete. 2024-05-08T08:36:13.071 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:36:13.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:13 smithi070 ceph-mon[29591]: pgmap v3494: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 87 KiB/s wr, 27 op/s 2024-05-08T08:36:13.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1890004828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:36:13.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:13 smithi172 ceph-mon[33377]: pgmap v3494: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 87 KiB/s wr, 27 op/s 2024-05-08T08:36:13.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:13 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1890004828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:36:13.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:13 smithi194 ceph-mon[33679]: pgmap v3494: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 87 KiB/s wr, 27 op/s 2024-05-08T08:36:13.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:13 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1890004828' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:36:13.918 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T08:36:13.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T08:36:14.496 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:36:15.300 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:15 smithi070 ceph-mon[29591]: pgmap v3495: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 87 KiB/s wr, 27 op/s 2024-05-08T08:36:15.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:15 smithi172 ceph-mon[33377]: pgmap v3495: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 87 KiB/s wr, 27 op/s 2024-05-08T08:36:15.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:15 smithi194 ceph-mon[33679]: pgmap v3495: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 87 KiB/s wr, 27 op/s 2024-05-08T08:36:17.191 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utids.o 2024-05-08T08:36:17.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.431+0000 7f5966400700 1 -- 172.21.15.70:0/1457312379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5960104ef0 msgr2=0x7f5960109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:17.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.431+0000 7f5966400700 1 --2- 172.21.15.70:0/1457312379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5960104ef0 0x7f5960109330 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f59500099c0 tx=0x7f5950009cd0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.432+0000 7f5966400700 1 -- 172.21.15.70:0/1457312379 shutdown_connections 2024-05-08T08:36:17.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.432+0000 7f5966400700 1 --2- 172.21.15.70:0/1457312379 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5960109a40 0x7f59601103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.432+0000 7f5966400700 1 --2- 172.21.15.70:0/1457312379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5960104540 0x7f5960104920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.432+0000 7f5966400700 1 --2- 172.21.15.70:0/1457312379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5960104ef0 0x7f5960109330 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.432+0000 7f5966400700 1 -- 172.21.15.70:0/1457312379 >> 172.21.15.70:0/1457312379 conn(0x7f59600fdcf0 msgr2=0x7f5960100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:17.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.432+0000 7f5966400700 1 -- 172.21.15.70:0/1457312379 shutdown_connections 2024-05-08T08:36:17.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.432+0000 7f5966400700 1 -- 172.21.15.70:0/1457312379 wait complete. 2024-05-08T08:36:17.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.433+0000 7f5966400700 1 Processor -- start 2024-05-08T08:36:17.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.433+0000 7f5966400700 1 -- start start 2024-05-08T08:36:17.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.434+0000 7f5966400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5960104540 0x7f596019d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.434+0000 7f5966400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5960104ef0 0x7f596019d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.434+0000 7f5966400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5960109a40 0x7f59601975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.434+0000 7f5966400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5960111390 con 0x7f5960104ef0 2024-05-08T08:36:17.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.434+0000 7f5966400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5960111210 con 0x7f5960104540 2024-05-08T08:36:17.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.434+0000 7f5966400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5960111510 con 0x7f5960109a40 2024-05-08T08:36:17.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.434+0000 7f5965000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5960104540 0x7f596019d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.435+0000 7f5965000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5960104540 0x7f596019d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:39552/0 (socket says 172.21.15.70:39552) 2024-05-08T08:36:17.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.435+0000 7f5965000700 1 -- 172.21.15.70:0/4117800008 learned_addr learned my addr 172.21.15.70:0/4117800008 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:17.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.435+0000 7f595fe00700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5960104ef0 0x7f596019d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.435+0000 7f5965a00700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5960109a40 0x7f59601975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.435+0000 7f595fe00700 1 -- 172.21.15.70:0/4117800008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5960109a40 msgr2=0x7f59601975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:17.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.435+0000 7f595fe00700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5960109a40 0x7f59601975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.435+0000 7f595fe00700 1 -- 172.21.15.70:0/4117800008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5960104540 msgr2=0x7f596019d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:17.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.435+0000 7f595fe00700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5960104540 0x7f596019d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.435+0000 7f595fe00700 1 -- 172.21.15.70:0/4117800008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5960197d10 con 0x7f5960104ef0 2024-05-08T08:36:17.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.436+0000 7f595fe00700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5960104ef0 0x7f596019d930 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f59500098e0 tx=0x7f59500057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:17.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.436+0000 7f595d600700 1 -- 172.21.15.70:0/4117800008 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950027070 con 0x7f5960104ef0 2024-05-08T08:36:17.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.436+0000 7f5966400700 1 -- 172.21.15.70:0/4117800008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5960197fa0 con 0x7f5960104ef0 2024-05-08T08:36:17.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.436+0000 7f5966400700 1 -- 172.21.15.70:0/4117800008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59601a42c0 con 0x7f5960104ef0 2024-05-08T08:36:17.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.436+0000 7f595d600700 1 -- 172.21.15.70:0/4117800008 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f595000fd30 con 0x7f5960104ef0 2024-05-08T08:36:17.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.436+0000 7f595d600700 1 -- 172.21.15.70:0/4117800008 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950022e20 con 0x7f5960104ef0 2024-05-08T08:36:17.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.442+0000 7f595d600700 1 -- 172.21.15.70:0/4117800008 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f595002a070 con 0x7f5960104ef0 2024-05-08T08:36:17.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.444+0000 7f597246db80 1 Processor -- start 2024-05-08T08:36:17.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.444+0000 7f597246db80 1 -- start start 2024-05-08T08:36:17.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.445+0000 7f597246db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 0x562c892156c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.445+0000 7f597246db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c8920f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.445+0000 7f597246db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c8920fe30 0x562c89210290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.445+0000 7f597246db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562c89161bb0 con 0x562c89215c00 2024-05-08T08:36:17.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.445+0000 7f597246db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562c890ff8f0 con 0x562c892152e0 2024-05-08T08:36:17.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.445+0000 7f597246db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562c8915db70 con 0x562c8920fe30 2024-05-08T08:36:17.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.445+0000 7f595d600700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59480b6eb0 0x7f59480b9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.445+0000 7f595d600700 1 -- 172.21.15.70:0/4117800008 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(296..296 src has 1..296) ==== 9671+0+0 (secure 0 0 0) 0x7f59500e36c0 con 0x7f5960104ef0 2024-05-08T08:36:17.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.446+0000 7f5965a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 0x562c892156c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.446+0000 7f5965a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 0x562c892156c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:39568/0 (socket says 172.21.15.70:39568) 2024-05-08T08:36:17.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.446+0000 7f5965a00700 1 -- 172.21.15.70:0/445681226 learned_addr learned my addr 172.21.15.70:0/445681226 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:17.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.446+0000 7f595fe00700 1 --2- 172.21.15.70:0/445681226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c8920fe30 0x562c89210290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.446+0000 7f5965000700 1 --2- 172.21.15.70:0/445681226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c8920f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.446+0000 7f5965a00700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59480b6eb0 0x7f59480b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.446+0000 7f595fe00700 1 -- 172.21.15.70:0/445681226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 msgr2=0x562c892156c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:17.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.446+0000 7f595fe00700 1 --2- 172.21.15.70:0/445681226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 0x562c892156c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.447+0000 7f595fe00700 1 -- 172.21.15.70:0/445681226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 msgr2=0x562c8920f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:17.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.447+0000 7f595fe00700 1 --2- 172.21.15.70:0/445681226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c8920f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.447+0000 7f595fe00700 1 -- 172.21.15.70:0/445681226 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c890aea60 con 0x562c8920fe30 2024-05-08T08:36:17.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.447+0000 7f595fe00700 1 --2- 172.21.15.70:0/445681226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c8920fe30 0x562c89210290 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59500e0990 tx=0x7f5950009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea9711a19db47ff3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:17.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.447+0000 7f5965a00700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59480b6eb0 0x7f59480b9370 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5958009fd0 tx=0x7f5958006040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:17.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.448+0000 7f594e000700 1 -- 172.21.15.70:0/445681226 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59500aa0c0 con 0x562c8920fe30 2024-05-08T08:36:17.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.448+0000 7f594e000700 1 -- 172.21.15.70:0/445681226 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59500e3030 con 0x562c8920fe30 2024-05-08T08:36:17.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.448+0000 7f594e000700 1 -- 172.21.15.70:0/445681226 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59500aa810 con 0x562c8920fe30 2024-05-08T08:36:17.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.449+0000 7f597246db80 1 -- 172.21.15.70:0/445681226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c8920fe30 msgr2=0x562c89210290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:17.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.449+0000 7f597246db80 1 --2- 172.21.15.70:0/445681226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c8920fe30 0x562c89210290 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59500e0990 tx=0x7f5950009310 comp rx=0 tx=0).stop 2024-05-08T08:36:17.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.449+0000 7f597246db80 1 -- 172.21.15.70:0/445681226 shutdown_connections 2024-05-08T08:36:17.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.449+0000 7f597246db80 1 --2- 172.21.15.70:0/445681226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c8920fe30 0x562c89210290 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.449+0000 7f597246db80 1 --2- 172.21.15.70:0/445681226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 0x562c892156c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.449+0000 7f597246db80 1 --2- 172.21.15.70:0/445681226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c8920f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.449+0000 7f597246db80 1 -- 172.21.15.70:0/445681226 >> 172.21.15.70:0/445681226 conn(0x562c89187860 msgr2=0x562c8920a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:17.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.449+0000 7f597246db80 1 -- 172.21.15.70:0/445681226 shutdown_connections 2024-05-08T08:36:17.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.449+0000 7f597246db80 1 -- 172.21.15.70:0/445681226 wait complete. 2024-05-08T08:36:17.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.450+0000 7f597246db80 1 -- start start 2024-05-08T08:36:17.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.450+0000 7f597246db80 1 Processor -- start 2024-05-08T08:36:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f597246db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920fe30 0x562c8921b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f597246db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c892152e0 0x562c89218d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f597246db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c89215c00 0x562c89219240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f597246db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562c8921c4e0 con 0x562c8920fe30 2024-05-08T08:36:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f597246db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562c890c7cb0 con 0x562c89215c00 2024-05-08T08:36:17.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f597246db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562c8921c660 con 0x562c892152e0 2024-05-08T08:36:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f597246db80 10 client.0 _ll_register_callbacks cb 0x562c89108e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:36:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f5965000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920fe30 0x562c8921b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f5965000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920fe30 0x562c8921b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48828/0 (socket says 172.21.15.70:48828) 2024-05-08T08:36:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.451+0000 7f5965000700 1 -- 172.21.15.70:0/2327329662 learned_addr learned my addr 172.21.15.70:0/2327329662 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.452+0000 7f5965a00700 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c89215c00 0x562c89219240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.452+0000 7f5965000700 1 -- 172.21.15.70:0/2327329662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c892152e0 msgr2=0x562c89218d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T08:36:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.452+0000 7f5965000700 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c892152e0 0x562c89218d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.452+0000 7f5965000700 1 -- 172.21.15.70:0/2327329662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c89215c00 msgr2=0x562c89219240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:17.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.452+0000 7f5965000700 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c89215c00 0x562c89219240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.452+0000 7f5965000700 1 -- 172.21.15.70:0/2327329662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c891275b0 con 0x562c8920fe30 2024-05-08T08:36:17.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.453+0000 7f5965000700 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920fe30 0x562c8921b8f0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f59540116f0 tx=0x7f5954011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5434d34f5f9cb27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:17.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.453+0000 7f5942a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:36:17.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.453+0000 7f5942a00700 1 -- 172.21.15.70:0/2327329662 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5954010640 con 0x562c8920fe30 2024-05-08T08:36:17.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.453+0000 7f5942a00700 1 -- 172.21.15.70:0/2327329662 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(296..296 src has 1..296) ==== 9671+0+0 (secure 0 0 0) 0x7f59540107e0 con 0x562c8920fe30 2024-05-08T08:36:17.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.454+0000 7f597246db80 1 -- 172.21.15.70:0/2327329662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59500e3030 con 0x562c8920fe30 2024-05-08T08:36:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.454+0000 7f5942a00700 1 -- 172.21.15.70:0/2327329662 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f59540109e0 con 0x562c8920fe30 2024-05-08T08:36:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.454+0000 7f597246db80 10 client.18348 fetch_fsmap learned FSMap version 42 2024-05-08T08:36:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.454+0000 7f597246db80 1 -- 172.21.15.70:0/2327329662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562c89226dd0 con 0x562c8920fe30 2024-05-08T08:36:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.455+0000 7f5942a00700 1 -- 172.21.15.70:0/2327329662 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59500e3030 con 0x562c8920fe30 2024-05-08T08:36:17.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.455+0000 7f5942a00700 1 -- 172.21.15.70:0/2327329662 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f595401b420 con 0x562c8920fe30 2024-05-08T08:36:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.455+0000 7f597246db80 10 client.18348 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:36:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.455+0000 7f597246db80 10 client.18348 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:36:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.455+0000 7f597246db80 20 client.18348 populate_metadata read hostname 'smithi070' 2024-05-08T08:36:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.455+0000 7f597246db80 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562c89229360 0x562c8922b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.455+0000 7f597246db80 4 client.18348 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:36:17.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.455+0000 7f597246db80 1 -- 172.21.15.70:0/2327329662 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c891dc2d0 con 0x562c89229360 2024-05-08T08:36:17.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.456+0000 7f595fe00700 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562c89229360 0x562c8922b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.457+0000 7f595fe00700 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562c89229360 0x562c8922b790 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=898d188cf65b9865 server_cookie=6938e675886272a4 in_seq=0 out_seq=0 2024-05-08T08:36:17.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.457+0000 7f5942a00700 10 client.18348 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:36:17.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.459+0000 7f5942a00700 1 -- 172.21.15.70:0/2327329662 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562c891dc2d0 con 0x562c89229360 2024-05-08T08:36:17.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.459+0000 7f5942a00700 10 client.18348 handle_command_reply: tid=0 2024-05-08T08:36:17.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f597246db80 1 client.18348 shutdown 2024-05-08T08:36:17.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f597246db80 1 -- 172.21.15.70:0/2327329662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920fe30 msgr2=0x562c8921b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:17.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f597246db80 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920fe30 0x562c8921b8f0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f59540116f0 tx=0x7f5954011ab0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f597246db80 1 -- 172.21.15.70:0/2327329662 shutdown_connections 2024-05-08T08:36:17.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f597246db80 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562c89229360 0x562c8922b790 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f597246db80 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c89215c00 0x562c89219240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f597246db80 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920fe30 0x562c8921b8f0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f597246db80 1 --2- 172.21.15.70:0/2327329662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c892152e0 0x562c89218d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f597246db80 1 -- 172.21.15.70:0/2327329662 >> 172.21.15.70:0/2327329662 conn(0x562c89187860 msgr2=0x562c8920e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:17.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.460+0000 7f5942a00700 0 client.18348 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:36:17.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.461+0000 7f597246db80 1 -- 172.21.15.70:0/2327329662 shutdown_connections 2024-05-08T08:36:17.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.461+0000 7f597246db80 1 -- 172.21.15.70:0/2327329662 wait complete. 2024-05-08T08:36:17.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.461+0000 7f597246db80 20 client.18348 trim_cache size 0 max 16384 2024-05-08T08:36:17.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.491+0000 7f597246db80 1 Processor -- start 2024-05-08T08:36:17.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.491+0000 7f597246db80 1 -- start start 2024-05-08T08:36:17.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.492+0000 7f597246db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 0x562c89213470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.492+0000 7f597246db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c89215c00 0x562c89225530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.492+0000 7f597246db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920a600 0x562c89231060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.492+0000 7f597246db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59601afc30 con 0x562c8920a600 2024-05-08T08:36:17.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.492+0000 7f597246db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59601ad4c0 con 0x562c892152e0 2024-05-08T08:36:17.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.492+0000 7f597246db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f59601ab330 con 0x562c89215c00 2024-05-08T08:36:17.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.492+0000 7f5965a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920a600 0x562c89231060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.492+0000 7f5965a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920a600 0x562c89231060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48830/0 (socket says 172.21.15.70:48830) 2024-05-08T08:36:17.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.492+0000 7f5965a00700 1 -- 172.21.15.70:0/3860980683 learned_addr learned my addr 172.21.15.70:0/3860980683 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:17.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.493+0000 7f5965000700 1 --2- 172.21.15.70:0/3860980683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 0x562c89213470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.493+0000 7f595fe00700 1 --2- 172.21.15.70:0/3860980683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c89215c00 0x562c89225530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.493+0000 7f5965a00700 1 -- 172.21.15.70:0/3860980683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c89215c00 msgr2=0x562c89225530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:17.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.493+0000 7f5965a00700 1 --2- 172.21.15.70:0/3860980683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c89215c00 0x562c89225530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.493+0000 7f5965a00700 1 -- 172.21.15.70:0/3860980683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 msgr2=0x562c89213470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:17.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.493+0000 7f5965a00700 1 --2- 172.21.15.70:0/3860980683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 0x562c89213470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.493+0000 7f5965a00700 1 -- 172.21.15.70:0/3860980683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c89217270 con 0x562c8920a600 2024-05-08T08:36:17.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.494+0000 7f5965a00700 1 --2- 172.21.15.70:0/3860980683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920a600 0x562c89231060 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5958018c60 tx=0x7f59580092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719c2e7b42f05efb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:17.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.494+0000 7f594d600700 1 -- 172.21.15.70:0/3860980683 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595801aa90 con 0x562c8920a600 2024-05-08T08:36:17.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.494+0000 7f594d600700 1 -- 172.21.15.70:0/3860980683 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f595802a070 con 0x562c8920a600 2024-05-08T08:36:17.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.494+0000 7f594d600700 1 -- 172.21.15.70:0/3860980683 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958025d50 con 0x562c8920a600 2024-05-08T08:36:17.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.495+0000 7f597246db80 1 -- 172.21.15.70:0/3860980683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920a600 msgr2=0x562c89231060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:17.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.495+0000 7f597246db80 1 --2- 172.21.15.70:0/3860980683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920a600 0x562c89231060 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f5958018c60 tx=0x7f59580092c0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.495+0000 7f597246db80 1 -- 172.21.15.70:0/3860980683 shutdown_connections 2024-05-08T08:36:17.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.495+0000 7f597246db80 1 --2- 172.21.15.70:0/3860980683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c8920a600 0x562c89231060 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.495+0000 7f597246db80 1 --2- 172.21.15.70:0/3860980683 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c892152e0 0x562c89213470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.495+0000 7f597246db80 1 --2- 172.21.15.70:0/3860980683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c89215c00 0x562c89225530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.495+0000 7f597246db80 1 -- 172.21.15.70:0/3860980683 >> 172.21.15.70:0/3860980683 conn(0x562c89187860 msgr2=0x562c89212d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:17.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.496+0000 7f597246db80 1 -- 172.21.15.70:0/3860980683 shutdown_connections 2024-05-08T08:36:17.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.496+0000 7f597246db80 1 -- 172.21.15.70:0/3860980683 wait complete. 2024-05-08T08:36:17.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.496+0000 7f597246db80 1 -- start start 2024-05-08T08:36:17.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.496+0000 7f597246db80 1 Processor -- start 2024-05-08T08:36:17.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.497+0000 7f597246db80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c8920a600 0x562c89230ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.497+0000 7f597246db80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c892152e0 0x562c89231010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.497+0000 7f597246db80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c89231550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.497+0000 7f597246db80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59601ab980 con 0x562c89215c00 2024-05-08T08:36:17.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.497+0000 7f597246db80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f59601acdf0 con 0x562c8920a600 2024-05-08T08:36:17.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.497+0000 7f597246db80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f59601ac050 con 0x562c892152e0 2024-05-08T08:36:17.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.497+0000 7f597246db80 10 client.0 _ll_register_callbacks cb 0x562c89108e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:36:17.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.498+0000 7f5965a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c89231550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.498+0000 7f5965a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c89231550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48846/0 (socket says 172.21.15.70:48846) 2024-05-08T08:36:17.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.498+0000 7f5965a00700 1 -- 172.21.15.70:0/3651148444 learned_addr learned my addr 172.21.15.70:0/3651148444 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:36:17.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.498+0000 7f5965000700 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c8920a600 0x562c89230ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.498+0000 7f595fe00700 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c892152e0 0x562c89231010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.498+0000 7f5965a00700 1 -- 172.21.15.70:0/3651148444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c892152e0 msgr2=0x562c89231010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:17.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.498+0000 7f5965a00700 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c892152e0 0x562c89231010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.498+0000 7f5965a00700 1 -- 172.21.15.70:0/3651148444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c8920a600 msgr2=0x562c89230ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:36:17.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.499+0000 7f5965a00700 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c8920a600 0x562c89230ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:17.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.499+0000 7f5965a00700 1 -- 172.21.15.70:0/3651148444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c89292f10 con 0x562c89215c00 2024-05-08T08:36:17.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.499+0000 7f5965a00700 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c89231550 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5958009550 tx=0x7f595801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96fde15d8ff465b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:36:17.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.499+0000 7f5942a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:36:17.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.500+0000 7f5942a00700 1 -- 172.21.15.70:0/3651148444 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958034020 con 0x562c89215c00 2024-05-08T08:36:17.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.500+0000 7f5942a00700 1 -- 172.21.15.70:0/3651148444 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(296..296 src has 1..296) ==== 9671+0+0 (secure 0 0 0) 0x7f5958025990 con 0x562c89215c00 2024-05-08T08:36:17.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.501+0000 7f597246db80 1 -- 172.21.15.70:0/3651148444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f595802a070 con 0x562c89215c00 2024-05-08T08:36:17.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.501+0000 7f5942a00700 1 -- 172.21.15.70:0/3651148444 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f595801ae30 con 0x562c89215c00 2024-05-08T08:36:17.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.501+0000 7f597246db80 10 client.18354 fetch_fsmap learned FSMap version 42 2024-05-08T08:36:17.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.501+0000 7f597246db80 1 -- 172.21.15.70:0/3651148444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562c89294170 con 0x562c89215c00 2024-05-08T08:36:17.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.502+0000 7f5942a00700 1 -- 172.21.15.70:0/3651148444 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f595802a070 con 0x562c89215c00 2024-05-08T08:36:17.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.502+0000 7f5942a00700 1 -- 172.21.15.70:0/3651148444 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f5958030b50 con 0x562c89215c00 2024-05-08T08:36:17.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.502+0000 7f597246db80 10 client.18354 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:36:17.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.502+0000 7f597246db80 10 client.18354 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:36:17.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.502+0000 7f597246db80 20 client.18354 populate_metadata read hostname 'smithi070' 2024-05-08T08:36:17.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.502+0000 7f597246db80 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562c892a5830 0x562c892a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:36:17.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.502+0000 7f597246db80 4 client.18354 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T08:36:17.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.502+0000 7f597246db80 1 -- 172.21.15.70:0/3651148444 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x562c8916f590 con 0x562c892a5830 2024-05-08T08:36:17.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.503+0000 7f5965000700 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562c892a5830 0x562c892a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:36:17.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.504+0000 7f5965000700 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562c892a5830 0x562c892a7c20 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed49db36e28a486f server_cookie=fb5da5fb1505812d in_seq=0 out_seq=0 2024-05-08T08:36:17.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:17.504+0000 7f5942a00700 10 client.18354 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:36:17.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:17 smithi070 ceph-mon[29591]: pgmap v3496: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 425 KiB/s wr, 22 op/s 2024-05-08T08:36:17.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:17 smithi172 ceph-mon[33377]: pgmap v3496: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 425 KiB/s wr, 22 op/s 2024-05-08T08:36:17.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:17 smithi194 ceph-mon[33679]: pgmap v3496: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 425 KiB/s wr, 22 op/s 2024-05-08T08:36:18.299 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/nsfs.o 2024-05-08T08:36:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:19 smithi070 ceph-mon[29591]: pgmap v3497: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 425 KiB/s wr, 22 op/s 2024-05-08T08:36:19.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:19 smithi172 ceph-mon[33377]: pgmap v3497: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 425 KiB/s wr, 22 op/s 2024-05-08T08:36:19.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:19 smithi194 ceph-mon[33679]: pgmap v3497: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 425 KiB/s wr, 22 op/s 2024-05-08T08:36:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:20 smithi070 ceph-mon[29591]: osdmap e297: 12 total, 12 up, 12 in 2024-05-08T08:36:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:20 smithi070 ceph-mon[29591]: pgmap v3499: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 570 KiB/s wr, 28 op/s 2024-05-08T08:36:20.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:20 smithi172 ceph-mon[33377]: osdmap e297: 12 total, 12 up, 12 in 2024-05-08T08:36:20.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:20 smithi172 ceph-mon[33377]: pgmap v3499: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 570 KiB/s wr, 28 op/s 2024-05-08T08:36:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:20 smithi194 ceph-mon[33679]: osdmap e297: 12 total, 12 up, 12 in 2024-05-08T08:36:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:20 smithi194 ceph-mon[33679]: pgmap v3499: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 570 KiB/s wr, 28 op/s 2024-05-08T08:36:23.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:22 smithi194 ceph-mon[33679]: pgmap v3500: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 570 KiB/s wr, 28 op/s 2024-05-08T08:36:23.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:22 smithi070 ceph-mon[29591]: pgmap v3500: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 570 KiB/s wr, 28 op/s 2024-05-08T08:36:23.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:22 smithi172 ceph-mon[33377]: pgmap v3500: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 570 KiB/s wr, 28 op/s 2024-05-08T08:36:25.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:24 smithi194 ceph-mon[33679]: pgmap v3501: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 570 KiB/s wr, 28 op/s 2024-05-08T08:36:25.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:24 smithi070 ceph-mon[29591]: pgmap v3501: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 570 KiB/s wr, 28 op/s 2024-05-08T08:36:25.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:24 smithi172 ceph-mon[33377]: pgmap v3501: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 570 KiB/s wr, 28 op/s 2024-05-08T08:36:27.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:26 smithi194 ceph-mon[33679]: pgmap v3502: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 341 KiB/s wr, 15 op/s 2024-05-08T08:36:27.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:26 smithi070 ceph-mon[29591]: pgmap v3502: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 341 KiB/s wr, 15 op/s 2024-05-08T08:36:27.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:26 smithi172 ceph-mon[33377]: pgmap v3502: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 341 KiB/s wr, 15 op/s 2024-05-08T08:36:29.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:28 smithi194 ceph-mon[33679]: pgmap v3503: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 341 KiB/s wr, 15 op/s 2024-05-08T08:36:29.037 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:28 smithi070 ceph-mon[29591]: pgmap v3503: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 341 KiB/s wr, 15 op/s 2024-05-08T08:36:29.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:28 smithi172 ceph-mon[33377]: pgmap v3503: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 341 KiB/s wr, 15 op/s 2024-05-08T08:36:31.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:30 smithi194 ceph-mon[33679]: pgmap v3504: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 188 KiB/s wr, 9 op/s 2024-05-08T08:36:31.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:30 smithi070 ceph-mon[29591]: pgmap v3504: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 188 KiB/s wr, 9 op/s 2024-05-08T08:36:31.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:30 smithi172 ceph-mon[33377]: pgmap v3504: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 188 KiB/s wr, 9 op/s 2024-05-08T08:36:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:32 smithi194 ceph-mon[33679]: pgmap v3505: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 158 KiB/s wr, 8 op/s 2024-05-08T08:36:33.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:32 smithi070 ceph-mon[29591]: pgmap v3505: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 158 KiB/s wr, 8 op/s 2024-05-08T08:36:33.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:32 smithi172 ceph-mon[33377]: pgmap v3505: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 158 KiB/s wr, 8 op/s 2024-05-08T08:36:35.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:34 smithi194 ceph-mon[33679]: pgmap v3506: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 158 KiB/s wr, 8 op/s 2024-05-08T08:36:35.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:34 smithi070 ceph-mon[29591]: pgmap v3506: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 158 KiB/s wr, 8 op/s 2024-05-08T08:36:35.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:34 smithi172 ceph-mon[33377]: pgmap v3506: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 158 KiB/s wr, 8 op/s 2024-05-08T08:36:37.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:36 smithi194 ceph-mon[33679]: pgmap v3507: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 234 KiB/s wr, 11 op/s 2024-05-08T08:36:37.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:36 smithi070 ceph-mon[29591]: pgmap v3507: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 234 KiB/s wr, 11 op/s 2024-05-08T08:36:37.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:36 smithi172 ceph-mon[33377]: pgmap v3507: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 234 KiB/s wr, 11 op/s 2024-05-08T08:36:39.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:38 smithi194 ceph-mon[33679]: pgmap v3508: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 6 op/s 2024-05-08T08:36:39.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:38 smithi070 ceph-mon[29591]: pgmap v3508: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 6 op/s 2024-05-08T08:36:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:38 smithi172 ceph-mon[33377]: pgmap v3508: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 76 KiB/s wr, 6 op/s 2024-05-08T08:36:40.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.115+0000 7f5942a00700 1 -- 172.21.15.70:0/3651148444 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562c8916f590 con 0x562c892a5830 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.115+0000 7f5942a00700 10 client.18354 handle_command_reply: tid=0 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.116+0000 7f597246db80 1 client.18354 shutdown 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.116+0000 7f597246db80 1 -- 172.21.15.70:0/3651148444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 msgr2=0x562c89231550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.116+0000 7f597246db80 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c89231550 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f5958009550 tx=0x7f595801acc0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.117+0000 7f597246db80 1 -- 172.21.15.70:0/3651148444 shutdown_connections 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.117+0000 7f597246db80 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562c892a5830 0x562c892a7c20 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.117+0000 7f597246db80 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562c89215c00 0x562c89231550 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.117+0000 7f5942a00700 0 client.18354 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.117+0000 7f597246db80 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562c8920a600 0x562c89230ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.117+0000 7f597246db80 1 --2- 172.21.15.70:0/3651148444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562c892152e0 0x562c89231010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.117+0000 7f597246db80 1 -- 172.21.15.70:0/3651148444 >> 172.21.15.70:0/3651148444 conn(0x562c89187860 msgr2=0x562c89215fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.117+0000 7f597246db80 1 -- 172.21.15.70:0/3651148444 shutdown_connections 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.117+0000 7f597246db80 1 -- 172.21.15.70:0/3651148444 wait complete. 2024-05-08T08:36:40.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.118+0000 7f597246db80 20 client.18354 trim_cache size 0 max 16384 2024-05-08T08:36:40.113 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:36:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:36:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:36:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 250, 2024-05-08T08:36:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:36:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "f3ca024b": { 2024-05-08T08:36:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 250, 2024-05-08T08:36:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:36:40.113 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:40.114 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:40.115 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:36:40.115 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:36:40.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 -- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59480b6eb0 msgr2=0x7f59480b9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:40.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59480b6eb0 0x7f59480b9370 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5958009fd0 tx=0x7f5958006040 comp rx=0 tx=0).stop 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 -- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5960104ef0 msgr2=0x7f596019d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5960104ef0 0x7f596019d930 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f59500098e0 tx=0x7f59500057c0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 -- 172.21.15.70:0/4117800008 shutdown_connections 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59480b6eb0 0x7f59480b9370 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5960109a40 0x7f59601975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5960104540 0x7f596019d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 --2- 172.21.15.70:0/4117800008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5960104ef0 0x7f596019d930 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.120+0000 7f5966400700 1 -- 172.21.15.70:0/4117800008 >> 172.21.15.70:0/4117800008 conn(0x7f59600fdcf0 msgr2=0x7f59600ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.121+0000 7f5966400700 1 -- 172.21.15.70:0/4117800008 shutdown_connections 2024-05-08T08:36:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:36:40.121+0000 7f5966400700 1 -- 172.21.15.70:0/4117800008 wait complete. 2024-05-08T08:36:40.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:40 smithi070 ceph-mon[29591]: pgmap v3509: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 113 KiB/s wr, 8 op/s 2024-05-08T08:36:41.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:40 smithi194 ceph-mon[33679]: pgmap v3509: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 113 KiB/s wr, 8 op/s 2024-05-08T08:36:41.079 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f3ca024b', quiesce took 31.3 seconds. Will release after: 30.0 2024-05-08T08:36:41.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:40 smithi172 ceph-mon[33377]: pgmap v3509: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 113 KiB/s wr, 8 op/s 2024-05-08T08:36:43.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:42 smithi194 ceph-mon[33679]: pgmap v3510: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 5 op/s 2024-05-08T08:36:43.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:42 smithi070 ceph-mon[29591]: pgmap v3510: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 5 op/s 2024-05-08T08:36:43.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:42 smithi172 ceph-mon[33377]: pgmap v3510: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 5 op/s 2024-05-08T08:36:45.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:44 smithi070 ceph-mon[29591]: pgmap v3511: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 5 op/s 2024-05-08T08:36:45.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:44 smithi172 ceph-mon[33377]: pgmap v3511: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 5 op/s 2024-05-08T08:36:45.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:44 smithi194 ceph-mon[33679]: pgmap v3511: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 113 KiB/s wr, 5 op/s 2024-05-08T08:36:47.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:46 smithi070 ceph-mon[29591]: pgmap v3512: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 9 op/s 2024-05-08T08:36:47.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:46 smithi172 ceph-mon[33377]: pgmap v3512: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 9 op/s 2024-05-08T08:36:47.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:46 smithi194 ceph-mon[33679]: pgmap v3512: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 9 op/s 2024-05-08T08:36:49.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:48 smithi070 ceph-mon[29591]: pgmap v3513: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 6 op/s 2024-05-08T08:36:49.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:48 smithi172 ceph-mon[33377]: pgmap v3513: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 6 op/s 2024-05-08T08:36:49.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:48 smithi194 ceph-mon[33679]: pgmap v3513: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 6 op/s 2024-05-08T08:36:50.074 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:36:50.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:36:50.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:36:51.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:50 smithi070 ceph-mon[29591]: pgmap v3514: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 113 KiB/s wr, 26 op/s 2024-05-08T08:36:51.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:50 smithi172 ceph-mon[33377]: pgmap v3514: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 113 KiB/s wr, 26 op/s 2024-05-08T08:36:51.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:50 smithi194 ceph-mon[33679]: pgmap v3514: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 113 KiB/s wr, 26 op/s 2024-05-08T08:36:52.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:36:52.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:36:52.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:36:52.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:36:52.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:36:52.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:36:52.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:36:52.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:36:52.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:36:53.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:53 smithi070 ceph-mon[29591]: pgmap v3515: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 76 KiB/s wr, 23 op/s 2024-05-08T08:36:53.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:53 smithi172 ceph-mon[33377]: pgmap v3515: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 76 KiB/s wr, 23 op/s 2024-05-08T08:36:53.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:53 smithi194 ceph-mon[33679]: pgmap v3515: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 76 KiB/s wr, 23 op/s 2024-05-08T08:36:55.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:55 smithi070 ceph-mon[29591]: pgmap v3516: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 76 KiB/s wr, 23 op/s 2024-05-08T08:36:55.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:55 smithi172 ceph-mon[33377]: pgmap v3516: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 76 KiB/s wr, 23 op/s 2024-05-08T08:36:55.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:55 smithi194 ceph-mon[33679]: pgmap v3516: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 76 KiB/s wr, 23 op/s 2024-05-08T08:36:57.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:57 smithi070 ceph-mon[29591]: pgmap v3517: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 81 KiB/s wr, 26 op/s 2024-05-08T08:36:57.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:57 smithi172 ceph-mon[33377]: pgmap v3517: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 81 KiB/s wr, 26 op/s 2024-05-08T08:36:57.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:57 smithi194 ceph-mon[33679]: pgmap v3517: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 81 KiB/s wr, 26 op/s 2024-05-08T08:36:59.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:36:59 smithi070 ceph-mon[29591]: pgmap v3518: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-05-08T08:36:59.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:36:59 smithi172 ceph-mon[33377]: pgmap v3518: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-05-08T08:36:59.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:36:59 smithi194 ceph-mon[33679]: pgmap v3518: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 42 KiB/s wr, 22 op/s 2024-05-08T08:37:01.306 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:01 smithi194 ceph-mon[33679]: pgmap v3519: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 25 op/s 2024-05-08T08:37:01.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:01 smithi070 ceph-mon[29591]: pgmap v3519: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 25 op/s 2024-05-08T08:37:01.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:01 smithi172 ceph-mon[33377]: pgmap v3519: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 42 KiB/s wr, 25 op/s 2024-05-08T08:37:03.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:03 smithi070 ceph-mon[29591]: pgmap v3520: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-08T08:37:03.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:03 smithi172 ceph-mon[33377]: pgmap v3520: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-08T08:37:03.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:03 smithi194 ceph-mon[33679]: pgmap v3520: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-08T08:37:05.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:05 smithi070 ceph-mon[29591]: pgmap v3521: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-08T08:37:05.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:05 smithi172 ceph-mon[33377]: pgmap v3521: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-08T08:37:05.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:05 smithi194 ceph-mon[33679]: pgmap v3521: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-05-08T08:37:07.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:07 smithi070 ceph-mon[29591]: pgmap v3522: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 49 KiB/s wr, 25 op/s 2024-05-08T08:37:07.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:07 smithi172 ceph-mon[33377]: pgmap v3522: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 49 KiB/s wr, 25 op/s 2024-05-08T08:37:07.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:07 smithi194 ceph-mon[33679]: pgmap v3522: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 49 KiB/s wr, 25 op/s 2024-05-08T08:37:09.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:09 smithi070 ceph-mon[29591]: pgmap v3523: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T08:37:09.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:09 smithi172 ceph-mon[33377]: pgmap v3523: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T08:37:09.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:09 smithi194 ceph-mon[33679]: pgmap v3523: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T08:37:11.081 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:37:11.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:11 smithi070 ceph-mon[29591]: pgmap v3524: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-05-08T08:37:11.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:11 smithi070 ceph-mon[29591]: osdmap e298: 12 total, 12 up, 12 in 2024-05-08T08:37:11.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:11 smithi172 ceph-mon[33377]: pgmap v3524: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-05-08T08:37:11.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:11 smithi172 ceph-mon[33377]: osdmap e298: 12 total, 12 up, 12 in 2024-05-08T08:37:11.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:11 smithi194 ceph-mon[33679]: pgmap v3524: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-05-08T08:37:11.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:11 smithi194 ceph-mon[33679]: osdmap e298: 12 total, 12 up, 12 in 2024-05-08T08:37:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:37:13.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:13 smithi070 ceph-mon[29591]: pgmap v3526: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:37:13.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:13 smithi172 ceph-mon[33377]: pgmap v3526: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:37:13.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:13 smithi194 ceph-mon[33679]: pgmap v3526: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:37:14.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.789+0000 7f0884000700 1 -- 172.21.15.70:0/39945548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c10b6c0 msgr2=0x7f087c10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.789+0000 7f0884000700 1 --2- 172.21.15.70:0/39945548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c10b6c0 0x7f087c10baa0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f0870009990 tx=0x7f0870009ca0 comp rx=0 tx=0).stop 2024-05-08T08:37:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.789+0000 7f0884000700 1 -- 172.21.15.70:0/39945548 shutdown_connections 2024-05-08T08:37:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.789+0000 7f0884000700 1 --2- 172.21.15.70:0/39945548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f087c106080 0x7f087c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.789+0000 7f0884000700 1 --2- 172.21.15.70:0/39945548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c10b6c0 0x7f087c10baa0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.789+0000 7f0884000700 1 --2- 172.21.15.70:0/39945548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c1056c0 0x7f087c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.789+0000 7f0884000700 1 -- 172.21.15.70:0/39945548 >> 172.21.15.70:0/39945548 conn(0x7f087c1011b0 msgr2=0x7f087c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:37:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.790+0000 7f0884000700 1 -- 172.21.15.70:0/39945548 shutdown_connections 2024-05-08T08:37:14.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.790+0000 7f0884000700 1 -- 172.21.15.70:0/39945548 wait complete. 2024-05-08T08:37:14.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.791+0000 7f0884000700 1 Processor -- start 2024-05-08T08:37:14.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.791+0000 7f0884000700 1 -- start start 2024-05-08T08:37:14.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0884000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c1056c0 0x7f087c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0884000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c106080 0x7f087c1a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0884000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f087c10b6c0 0x7f087c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0884000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f087c1157b0 con 0x7f087c106080 2024-05-08T08:37:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0884000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f087c115630 con 0x7f087c1056c0 2024-05-08T08:37:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0884000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f087c115930 con 0x7f087c10b6c0 2024-05-08T08:37:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0880c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c106080 0x7f087c1a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0880c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c106080 0x7f087c1a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41882/0 (socket says 172.21.15.70:41882) 2024-05-08T08:37:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0880c00700 1 -- 172.21.15.70:0/3332327240 learned_addr learned my addr 172.21.15.70:0/3332327240 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:37:14.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0881600700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c1056c0 0x7f087c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:14.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.792+0000 7f0882000700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f087c10b6c0 0x7f087c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:14.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f0880c00700 1 -- 172.21.15.70:0/3332327240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f087c10b6c0 msgr2=0x7f087c19b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:14.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f0880c00700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f087c10b6c0 0x7f087c19b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:14.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f0880c00700 1 -- 172.21.15.70:0/3332327240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c1056c0 msgr2=0x7f087c1a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:14.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f0880c00700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c1056c0 0x7f087c1a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:14.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f0880c00700 1 -- 172.21.15.70:0/3332327240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f087c19c130 con 0x7f087c106080 2024-05-08T08:37:14.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f0880c00700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c106080 0x7f087c1a1d50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f086800c9b0 tx=0x7f086800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:37:14.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f087a000700 1 -- 172.21.15.70:0/3332327240 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0868007b00 con 0x7f087c106080 2024-05-08T08:37:14.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f087a000700 1 -- 172.21.15.70:0/3332327240 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0868007ca0 con 0x7f087c106080 2024-05-08T08:37:14.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f087c19c420 con 0x7f087c106080 2024-05-08T08:37:14.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.793+0000 7f087a000700 1 -- 172.21.15.70:0/3332327240 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0868018660 con 0x7f087c106080 2024-05-08T08:37:14.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.794+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f087c1a86e0 con 0x7f087c106080 2024-05-08T08:37:14.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.795+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f087c06a190 con 0x7f087c106080 2024-05-08T08:37:14.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.797+0000 7f087a000700 1 -- 172.21.15.70:0/3332327240 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f086800f450 con 0x7f087c106080 2024-05-08T08:37:14.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.799+0000 7f087a000700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08640b29f0 0x7f08640b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:14.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.799+0000 7f087a000700 1 -- 172.21.15.70:0/3332327240 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(298..298 src has 1..298) ==== 9671+0+0 (secure 0 0 0) 0x7f08680e2bb0 con 0x7f087c106080 2024-05-08T08:37:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.799+0000 7f0881600700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08640b29f0 0x7f08640b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.800+0000 7f0881600700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08640b29f0 0x7f08640b4eb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f087000b5c0 tx=0x7f087001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:37:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:14.803+0000 7f087a000700 1 -- 172.21.15.70:0/3332327240 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0868014030 con 0x7f087c106080 2024-05-08T08:37:15.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.082+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f087c02e510 con 0x7f087c106080 2024-05-08T08:37:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.084+0000 7f087a000700 1 -- 172.21.15.70:0/3332327240 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f08680aa0b0 con 0x7f087c106080 2024-05-08T08:37:15.077 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:37:15.077 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:37:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.087+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08640b29f0 msgr2=0x7f08640b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:15.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.087+0000 7f0884000700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08640b29f0 0x7f08640b4eb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f087000b5c0 tx=0x7f087001a040 comp rx=0 tx=0).stop 2024-05-08T08:37:15.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.087+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c106080 msgr2=0x7f087c1a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:15.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.087+0000 7f0884000700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c106080 0x7f087c1a1d50 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f086800c9b0 tx=0x7f086800cd70 comp rx=0 tx=0).stop 2024-05-08T08:37:15.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.087+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 shutdown_connections 2024-05-08T08:37:15.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.087+0000 7f0884000700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08640b29f0 0x7f08640b4eb0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.087+0000 7f0884000700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f087c10b6c0 0x7f087c19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.087+0000 7f0884000700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f087c1056c0 0x7f087c1a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.088+0000 7f0884000700 1 --2- 172.21.15.70:0/3332327240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f087c106080 0x7f087c1a1d50 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.088+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 >> 172.21.15.70:0/3332327240 conn(0x7f087c1011b0 msgr2=0x7f087c1016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:37:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.088+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 shutdown_connections 2024-05-08T08:37:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:15.088+0000 7f0884000700 1 -- 172.21.15.70:0/3332327240 wait complete. 2024-05-08T08:37:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:37:15.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:15 smithi070 ceph-mon[29591]: pgmap v3527: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:37:15.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:15 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3332327240' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:37:15.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:15 smithi172 ceph-mon[33377]: pgmap v3527: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:37:15.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:15 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3332327240' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:37:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:15 smithi194 ceph-mon[33679]: pgmap v3527: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:37:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:15 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3332327240' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:37:15.982 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id f3ca024b --release --await' 2024-05-08T08:37:15.982 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id f3ca024b --release --await 2024-05-08T08:37:16.454 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:37:17.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:17 smithi070 ceph-mon[29591]: pgmap v3528: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:17.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:17 smithi172 ceph-mon[33377]: pgmap v3528: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:17.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:17 smithi194 ceph-mon[33679]: pgmap v3528: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:19.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.102+0000 7f23ce400700 1 -- 172.21.15.70:0/1633772424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8101a90 msgr2=0x7f23c8101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:19.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.102+0000 7f23ce400700 1 --2- 172.21.15.70:0/1633772424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8101a90 0x7f23c8101f10 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009990 tx=0x7f23b0009ca0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.102+0000 7f23ce400700 1 -- 172.21.15.70:0/1633772424 shutdown_connections 2024-05-08T08:37:19.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.102+0000 7f23ce400700 1 --2- 172.21.15.70:0/1633772424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c8102450 0x7f23c8110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.103+0000 7f23ce400700 1 --2- 172.21.15.70:0/1633772424 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23c8109520 0x7f23c8109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.103+0000 7f23ce400700 1 --2- 172.21.15.70:0/1633772424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8101a90 0x7f23c8101f10 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.103+0000 7f23ce400700 1 -- 172.21.15.70:0/1633772424 >> 172.21.15.70:0/1633772424 conn(0x7f23c8078a10 msgr2=0x7f23c80ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:37:19.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.103+0000 7f23ce400700 1 -- 172.21.15.70:0/1633772424 shutdown_connections 2024-05-08T08:37:19.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.103+0000 7f23ce400700 1 -- 172.21.15.70:0/1633772424 wait complete. 2024-05-08T08:37:19.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.104+0000 7f23ce400700 1 Processor -- start 2024-05-08T08:37:19.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.104+0000 7f23ce400700 1 -- start start 2024-05-08T08:37:19.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.104+0000 7f23ce400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23c8101a90 0x7f23c819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.104+0000 7f23ce400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8102450 0x7f23c819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.104+0000 7f23ce400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c8109520 0x7f23c81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.104+0000 7f23ce400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23c8113550 con 0x7f23c8102450 2024-05-08T08:37:19.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.104+0000 7f23ce400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f23c81133d0 con 0x7f23c8101a90 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.104+0000 7f23ce400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f23c81136d0 con 0x7f23c8109520 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23bea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8102450 0x7f23c819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23bea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8102450 0x7f23c819fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53110/0 (socket says 172.21.15.70:53110) 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23bea00700 1 -- 172.21.15.70:0/63205896 learned_addr learned my addr 172.21.15.70:0/63205896 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23c7400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23c8101a90 0x7f23c819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23c7e00700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c8109520 0x7f23c81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23bea00700 1 -- 172.21.15.70:0/63205896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c8109520 msgr2=0x7f23c81998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23bea00700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c8109520 0x7f23c81998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23bea00700 1 -- 172.21.15.70:0/63205896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23c8101a90 msgr2=0x7f23c819f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23bea00700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23c8101a90 0x7f23c819f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23bea00700 1 -- 172.21.15.70:0/63205896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c819a050 con 0x7f23c8102450 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23c7e00700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c8109520 0x7f23c81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.105+0000 7f23c7400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23c8101a90 0x7f23c819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:37:19.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.106+0000 7f23bea00700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8102450 0x7f23c819fc70 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f23b0000c00 tx=0x7f23b00036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:37:19.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.106+0000 7f23c4c00700 1 -- 172.21.15.70:0/63205896 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0027070 con 0x7f23c8102450 2024-05-08T08:37:19.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.106+0000 7f23c4c00700 1 -- 172.21.15.70:0/63205896 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b000fc80 con 0x7f23c8102450 2024-05-08T08:37:19.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.106+0000 7f23ce400700 1 -- 172.21.15.70:0/63205896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c819a2e0 con 0x7f23c8102450 2024-05-08T08:37:19.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.106+0000 7f23c4c00700 1 -- 172.21.15.70:0/63205896 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0022d60 con 0x7f23c8102450 2024-05-08T08:37:19.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.106+0000 7f23ce400700 1 -- 172.21.15.70:0/63205896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c81a6600 con 0x7f23c8102450 2024-05-08T08:37:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.110+0000 7f23c4c00700 1 -- 172.21.15.70:0/63205896 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f23b002a070 con 0x7f23c8102450 2024-05-08T08:37:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.111+0000 7f23c4c00700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f23ac0b29f0 0x7f23ac0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.111+0000 7f23c4c00700 1 -- 172.21.15.70:0/63205896 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(298..298 src has 1..298) ==== 9671+0+0 (secure 0 0 0) 0x7f23b00e3830 con 0x7f23c8102450 2024-05-08T08:37:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.112+0000 7f23c7400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f23ac0b29f0 0x7f23ac0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.112+0000 7f23c7400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f23ac0b29f0 0x7f23ac0b4eb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f23b8005ea0 tx=0x7f23b8005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:37:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.132+0000 7f23d8dc0b80 1 Processor -- start 2024-05-08T08:37:19.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.132+0000 7f23d8dc0b80 1 -- start start 2024-05-08T08:37:19.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.132+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 0x5599dd3aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.132+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3a5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.132+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.132+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599dd2f2b20 con 0x5599dd3a5550 2024-05-08T08:37:19.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.132+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599dd290860 con 0x5599dd3aa5c0 2024-05-08T08:37:19.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.132+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5599dd2eeae0 con 0x5599dd3a4b90 2024-05-08T08:37:19.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.133+0000 7f23c7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.133+0000 7f23c7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53114/0 (socket says 172.21.15.70:53114) 2024-05-08T08:37:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.133+0000 7f23c7e00700 1 -- 172.21.15.70:0/3762408429 learned_addr learned my addr 172.21.15.70:0/3762408429 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:37:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.133+0000 7f23c7400700 1 --2- 172.21.15.70:0/3762408429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 0x5599dd3aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.133+0000 7f23c7e00700 1 -- 172.21.15.70:0/3762408429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 msgr2=0x5599dd3a5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:37:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.133+0000 7f23c7e00700 1 --2- 172.21.15.70:0/3762408429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.133+0000 7f23c7e00700 1 -- 172.21.15.70:0/3762408429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 msgr2=0x5599dd3aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:37:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.133+0000 7f23c7e00700 1 --2- 172.21.15.70:0/3762408429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 0x5599dd3aa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.133+0000 7f23c7e00700 1 -- 172.21.15.70:0/3762408429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dd23f9d0 con 0x5599dd3a5550 2024-05-08T08:37:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.134+0000 7f23c7e00700 1 --2- 172.21.15.70:0/3762408429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3b1380 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f23c00084f0 tx=0x7f23c0008800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315813c4d5943bdc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:37:19.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.134+0000 7f23bcc00700 1 -- 172.21.15.70:0/3762408429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c0018070 con 0x5599dd3a5550 2024-05-08T08:37:19.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.134+0000 7f23bcc00700 1 -- 172.21.15.70:0/3762408429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23c0011ba0 con 0x5599dd3a5550 2024-05-08T08:37:19.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.134+0000 7f23bcc00700 1 -- 172.21.15.70:0/3762408429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c0013ad0 con 0x5599dd3a5550 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.135+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3762408429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 msgr2=0x5599dd3b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.135+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3762408429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3b1380 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f23c00084f0 tx=0x7f23c0008800 comp rx=0 tx=0).stop 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.135+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3762408429 shutdown_connections 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.135+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3762408429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3b1380 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.135+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3762408429 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 0x5599dd3aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.135+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3762408429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.135+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3762408429 >> 172.21.15.70:0/3762408429 conn(0x5599dd3187d0 msgr2=0x5599dd39b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.135+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3762408429 shutdown_connections 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.135+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3762408429 wait complete. 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.136+0000 7f23d8dc0b80 1 -- start start 2024-05-08T08:37:19.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.136+0000 7f23d8dc0b80 1 Processor -- start 2024-05-08T08:37:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.136+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.136+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a5550 0x5599dd3ae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.136+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3aa5c0 0x5599dd3ae950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5599dd3b1980 con 0x5599dd3aa5c0 2024-05-08T08:37:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5599dd258c20 con 0x5599dd3a5550 2024-05-08T08:37:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5599dd3b1b00 con 0x5599dd3a4b90 2024-05-08T08:37:19.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23d8dc0b80 10 client.0 _ll_register_callbacks cb 0x5599dd299d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3aa5c0 0x5599dd3ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3aa5c0 0x5599dd3ae950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53130/0 (socket says 172.21.15.70:53130) 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7e00700 1 -- 172.21.15.70:0/1155316576 learned_addr learned my addr 172.21.15.70:0/1155316576 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7400700 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23bea00700 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a5550 0x5599dd3ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7e00700 1 -- 172.21.15.70:0/1155316576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 msgr2=0x5599dd3b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7e00700 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7e00700 1 -- 172.21.15.70:0/1155316576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a5550 msgr2=0x5599dd3ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7e00700 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a5550 0x5599dd3ae410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7e00700 1 -- 172.21.15.70:0/1155316576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dd2b8520 con 0x5599dd3aa5c0 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.137+0000 7f23c7400700 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.138+0000 7f23c7e00700 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3aa5c0 0x5599dd3ae950 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f23c0016040 tx=0x7f23c0007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3717f779b091b314 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.138+0000 7f23b5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.138+0000 7f23b5600700 1 -- 172.21.15.70:0/1155316576 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c0021070 con 0x5599dd3aa5c0 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.138+0000 7f23b5600700 1 -- 172.21.15.70:0/1155316576 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(298..298 src has 1..298) ==== 9671+0+0 (secure 0 0 0) 0x7f23c00136b0 con 0x5599dd3aa5c0 2024-05-08T08:37:19.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.138+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/1155316576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23c0011ba0 con 0x5599dd3aa5c0 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.138+0000 7f23b5600700 1 -- 172.21.15.70:0/1155316576 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f23c002d050 con 0x5599dd3aa5c0 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.138+0000 7f23d8dc0b80 10 client.18372 fetch_fsmap learned FSMap version 42 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.138+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/1155316576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5599dd3bc260 con 0x5599dd3aa5c0 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.139+0000 7f23b5600700 1 -- 172.21.15.70:0/1155316576 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23c0011ba0 con 0x5599dd3aa5c0 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.139+0000 7f23b5600700 1 -- 172.21.15.70:0/1155316576 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f23c001d9b0 con 0x5599dd3aa5c0 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.139+0000 7f23d8dc0b80 10 client.18372 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.139+0000 7f23d8dc0b80 10 client.18372 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.139+0000 7f23d8dc0b80 20 client.18372 populate_metadata read hostname 'smithi070' 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.139+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599dd3be730 0x5599dd3c0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.139+0000 7f23d8dc0b80 4 client.18372 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:37:19.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.139+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/1155316576 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599dd36d240 con 0x5599dd3be730 2024-05-08T08:37:19.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.140+0000 7f23c7400700 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599dd3be730 0x5599dd3c0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.141+0000 7f23c7400700 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599dd3be730 0x5599dd3c0b20 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b32905f9c7ed6d3b server_cookie=469052ac400738b2 in_seq=0 out_seq=0 2024-05-08T08:37:19.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.141+0000 7f23b5600700 10 client.18372 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:37:19.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23b5600700 1 -- 172.21.15.70:0/1155316576 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5599dd36d240 con 0x5599dd3be730 2024-05-08T08:37:19.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23b5600700 10 client.18372 handle_command_reply: tid=0 2024-05-08T08:37:19.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 client.18372 shutdown 2024-05-08T08:37:19.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/1155316576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3aa5c0 msgr2=0x5599dd3ae950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:19.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3aa5c0 0x5599dd3ae950 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f23c0016040 tx=0x7f23c0007650 comp rx=0 tx=0).stop 2024-05-08T08:37:19.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/1155316576 shutdown_connections 2024-05-08T08:37:19.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599dd3be730 0x5599dd3c0b20 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3aa5c0 0x5599dd3ae950 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/1155316576 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a5550 0x5599dd3ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/1155316576 >> 172.21.15.70:0/1155316576 conn(0x5599dd3187d0 msgr2=0x5599dd395b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:37:19.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23b5600700 0 client.18372 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:37:19.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.143+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/1155316576 shutdown_connections 2024-05-08T08:37:19.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.144+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/1155316576 wait complete. 2024-05-08T08:37:19.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.144+0000 7f23d8dc0b80 20 client.18372 trim_cache size 0 max 16384 2024-05-08T08:37:19.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.165+0000 7f23d8dc0b80 1 Processor -- start 2024-05-08T08:37:19.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.165+0000 7f23d8dc0b80 1 -- start start 2024-05-08T08:37:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a4b90 0x5599dd3ba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3952b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3aa5c0 0x5599dd3957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23c81afcc0 con 0x5599dd3a5550 2024-05-08T08:37:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f23c81ad550 con 0x5599dd3a4b90 2024-05-08T08:37:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f23c81ab3c0 con 0x5599dd3aa5c0 2024-05-08T08:37:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23bea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23c7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a4b90 0x5599dd3ba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23c7e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3aa5c0 0x5599dd3957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23bea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3952b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53134/0 (socket says 172.21.15.70:53134) 2024-05-08T08:37:19.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.167+0000 7f23bea00700 1 -- 172.21.15.70:0/3914590833 learned_addr learned my addr 172.21.15.70:0/3914590833 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:37:19.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.166+0000 7f23c7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a4b90 0x5599dd3ba9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36280/0 (socket says 172.21.15.70:36280) 2024-05-08T08:37:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.167+0000 7f23bea00700 1 -- 172.21.15.70:0/3914590833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3aa5c0 msgr2=0x5599dd3957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:37:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.167+0000 7f23bea00700 1 --2- 172.21.15.70:0/3914590833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3aa5c0 0x5599dd3957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.167+0000 7f23bea00700 1 -- 172.21.15.70:0/3914590833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a4b90 msgr2=0x5599dd3ba9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:37:19.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.167+0000 7f23bea00700 1 --2- 172.21.15.70:0/3914590833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a4b90 0x5599dd3ba9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.167+0000 7f23bea00700 1 -- 172.21.15.70:0/3914590833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599dd3b1850 con 0x5599dd3a5550 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.167+0000 7f23c7e00700 1 --2- 172.21.15.70:0/3914590833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3aa5c0 0x5599dd3957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.167+0000 7f23c7400700 1 --2- 172.21.15.70:0/3914590833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a4b90 0x5599dd3ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.167+0000 7f23bea00700 1 --2- 172.21.15.70:0/3914590833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3952b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f23b00aa650 tx=0x7f23b0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a70759130abcd55 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.168+0000 7f23b7e00700 1 -- 172.21.15.70:0/3914590833 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b00aa1d0 con 0x5599dd3a5550 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.168+0000 7f23b7e00700 1 -- 172.21.15.70:0/3914590833 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b00aadc0 con 0x5599dd3a5550 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.168+0000 7f23b7e00700 1 -- 172.21.15.70:0/3914590833 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b0090be0 con 0x5599dd3a5550 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.168+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3914590833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 msgr2=0x5599dd3952b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.168+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3914590833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3952b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f23b00aa650 tx=0x7f23b0009ca0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.169+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3914590833 shutdown_connections 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.169+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3914590833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3aa5c0 0x5599dd3957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.169+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3914590833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3a4b90 0x5599dd3ba9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.169+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3914590833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3a5550 0x5599dd3952b0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.169+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3914590833 >> 172.21.15.70:0/3914590833 conn(0x5599dd3187d0 msgr2=0x5599dd3a4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:37:19.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.169+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3914590833 shutdown_connections 2024-05-08T08:37:19.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.169+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3914590833 wait complete. 2024-05-08T08:37:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.169+0000 7f23d8dc0b80 1 -- start start 2024-05-08T08:37:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.169+0000 7f23d8dc0b80 1 Processor -- start 2024-05-08T08:37:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 0x5599dd3b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23d8dc0b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3b47a0 0x5599dd428e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f23c81aba10 con 0x5599dd3b47a0 2024-05-08T08:37:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f23c81ace80 con 0x5599dd3aa5c0 2024-05-08T08:37:19.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23d8dc0b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f23c81ac0e0 con 0x5599dd3a4b90 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23d8dc0b80 10 client.0 _ll_register_callbacks cb 0x5599dd299d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23c7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3b47a0 0x5599dd428e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23c7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3b47a0 0x5599dd428e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53146/0 (socket says 172.21.15.70:53146) 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.170+0000 7f23c7e00700 1 -- 172.21.15.70:0/3405578211 learned_addr learned my addr 172.21.15.70:0/3405578211 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23bea00700 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 0x5599dd3b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23c7400700 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23c7e00700 1 -- 172.21.15.70:0/3405578211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 msgr2=0x5599dd3b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23c7e00700 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3b3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23c7e00700 1 -- 172.21.15.70:0/3405578211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 msgr2=0x5599dd3b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23c7e00700 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 0x5599dd3b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23c7e00700 1 -- 172.21.15.70:0/3405578211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599dd397c70 con 0x5599dd3b47a0 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23c7e00700 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3b47a0 0x5599dd428e50 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f23c00079c0 tx=0x7f23c0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a47850151fd86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:37:19.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23b5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.171+0000 7f23b5600700 1 -- 172.21.15.70:0/3405578211 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c0021070 con 0x5599dd3b47a0 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3405578211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23b00aadc0 con 0x5599dd3b47a0 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23b5600700 1 -- 172.21.15.70:0/3405578211 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(298..298 src has 1..298) ==== 9671+0+0 (secure 0 0 0) 0x7f23c001d480 con 0x5599dd3b47a0 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23b5600700 1 -- 172.21.15.70:0/3405578211 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f23c003a050 con 0x5599dd3b47a0 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23d8dc0b80 10 client.18378 fetch_fsmap learned FSMap version 42 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3405578211 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5599dd42a660 con 0x5599dd3b47a0 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23b5600700 1 -- 172.21.15.70:0/3405578211 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23b00aadc0 con 0x5599dd3b47a0 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23b5600700 1 -- 172.21.15.70:0/3405578211 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f23c0013af0 con 0x5599dd3b47a0 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23d8dc0b80 10 client.18378 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23d8dc0b80 10 client.18378 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23d8dc0b80 20 client.18378 populate_metadata read hostname 'smithi070' 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599dd42ac50 0x5599dd42d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23d8dc0b80 4 client.18378 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f3ca024b", "release": true, "await": true}] 2024-05-08T08:37:19.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.172+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3405578211 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f3ca024b", "release": true, "await": true}) -- 0x5599dd300500 con 0x5599dd42ac50 2024-05-08T08:37:19.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.173+0000 7f23c7400700 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599dd42ac50 0x5599dd42d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:37:19.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.174+0000 7f23c7400700 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599dd42ac50 0x5599dd42d070 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdbe975b608f695d server_cookie=d7967d19d387e525 in_seq=0 out_seq=0 2024-05-08T08:37:19.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:19.174+0000 7f23b5600700 10 client.18378 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:37:19.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:19 smithi070 ceph-mon[29591]: pgmap v3529: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:19.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:19 smithi172 ceph-mon[33377]: pgmap v3529: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:19.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:19 smithi194 ceph-mon[33679]: pgmap v3529: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:20 smithi070 ceph-mon[29591]: osdmap e299: 12 total, 12 up, 12 in 2024-05-08T08:37:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:20 smithi070 ceph-mon[29591]: pgmap v3531: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2024-05-08T08:37:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:20 smithi172 ceph-mon[33377]: osdmap e299: 12 total, 12 up, 12 in 2024-05-08T08:37:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:20 smithi172 ceph-mon[33377]: pgmap v3531: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2024-05-08T08:37:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:20 smithi194 ceph-mon[33679]: osdmap e299: 12 total, 12 up, 12 in 2024-05-08T08:37:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:20 smithi194 ceph-mon[33679]: pgmap v3531: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 213 B/s wr, 6 op/s 2024-05-08T08:37:23.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:22 smithi194 ceph-mon[33679]: pgmap v3532: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:23.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:22 smithi070 ceph-mon[29591]: pgmap v3532: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:23.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:22 smithi172 ceph-mon[33377]: pgmap v3532: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:23.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.547+0000 7f23b5600700 1 -- 172.21.15.70:0/3405578211 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5599dd300500 con 0x5599dd42ac50 2024-05-08T08:37:23.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.547+0000 7f23b5600700 10 client.18378 handle_command_reply: tid=0 2024-05-08T08:37:23.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.547+0000 7f23d8dc0b80 1 client.18378 shutdown 2024-05-08T08:37:23.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.547+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3405578211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3b47a0 msgr2=0x5599dd428e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:23.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.547+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3b47a0 0x5599dd428e50 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f23c00079c0 tx=0x7f23c0011c40 comp rx=0 tx=0).stop 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.548+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3405578211 shutdown_connections 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.548+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5599dd42ac50 0x5599dd42d070 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.548+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5599dd3b47a0 0x5599dd428e50 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.548+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5599dd3a4b90 0x5599dd3b3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.548+0000 7f23d8dc0b80 1 --2- 172.21.15.70:0/3405578211 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5599dd3aa5c0 0x5599dd3b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.548+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3405578211 >> 172.21.15.70:0/3405578211 conn(0x5599dd3187d0 msgr2=0x5599dd3a8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.548+0000 7f23b5600700 0 client.18378 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.548+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3405578211 shutdown_connections 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.548+0000 7f23d8dc0b80 1 -- 172.21.15.70:0/3405578211 wait complete. 2024-05-08T08:37:23.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.549+0000 7f23d8dc0b80 20 client.18378 trim_cache size 0 max 16384 2024-05-08T08:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 252, 2024-05-08T08:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "f3ca024b": { 2024-05-08T08:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 252, 2024-05-08T08:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:37:23.543 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:37:23.544 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:37:23.545 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:37:23.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 -- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f23ac0b29f0 msgr2=0x7f23ac0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f23ac0b29f0 0x7f23ac0b4eb0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f23b8005ea0 tx=0x7f23b8005e30 comp rx=0 tx=0).stop 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 -- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8102450 msgr2=0x7f23c819fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8102450 0x7f23c819fc70 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f23b0000c00 tx=0x7f23b00036f0 comp rx=0 tx=0).stop 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 -- 172.21.15.70:0/63205896 shutdown_connections 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f23ac0b29f0 0x7f23ac0b4eb0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23c8109520 0x7f23c81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f23c8101a90 0x7f23c819f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 --2- 172.21.15.70:0/63205896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f23c8102450 0x7f23c819fc70 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.551+0000 7f23ce400700 1 -- 172.21.15.70:0/63205896 >> 172.21.15.70:0/63205896 conn(0x7f23c8078a10 msgr2=0x7f23c81001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.552+0000 7f23ce400700 1 -- 172.21.15.70:0/63205896 shutdown_connections 2024-05-08T08:37:23.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:37:23.553+0000 7f23ce400700 1 -- 172.21.15.70:0/63205896 wait complete. 2024-05-08T08:37:24.519 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f3ca024b', seconds elapsed: 74.8 2024-05-08T08:37:25.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:24 smithi194 ceph-mon[33679]: pgmap v3533: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:25.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:24 smithi070 ceph-mon[29591]: pgmap v3533: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:25.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:24 smithi172 ceph-mon[33377]: pgmap v3533: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:37:25.484 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utinit.o 2024-05-08T08:37:25.919 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fs_types.o 2024-05-08T08:37:26.541 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/vht.o 2024-05-08T08:37:26.546 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/chan.o 2024-05-08T08:37:26.687 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/exthdrs.o 2024-05-08T08:37:26.731 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_plb.o 2024-05-08T08:37:26.878 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netfilter/xt_state.o 2024-05-08T08:37:26.892 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/socklib.o 2024-05-08T08:37:27.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:26 smithi194 ceph-mon[33679]: pgmap v3534: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 211 KiB/s wr, 13 op/s 2024-05-08T08:37:27.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:26 smithi070 ceph-mon[29591]: pgmap v3534: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 211 KiB/s wr, 13 op/s 2024-05-08T08:37:27.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:26 smithi172 ceph-mon[33377]: pgmap v3534: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 211 KiB/s wr, 13 op/s 2024-05-08T08:37:29.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:28 smithi194 ceph-mon[33679]: pgmap v3535: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 211 KiB/s wr, 13 op/s 2024-05-08T08:37:29.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:28 smithi070 ceph-mon[29591]: pgmap v3535: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 211 KiB/s wr, 13 op/s 2024-05-08T08:37:29.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:28 smithi172 ceph-mon[33377]: pgmap v3535: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 211 KiB/s wr, 13 op/s 2024-05-08T08:37:30.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:30 smithi070 ceph-mon[29591]: pgmap v3536: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 492 KiB/s wr, 16 op/s 2024-05-08T08:37:31.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:30 smithi194 ceph-mon[33679]: pgmap v3536: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 492 KiB/s wr, 16 op/s 2024-05-08T08:37:31.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:30 smithi172 ceph-mon[33377]: pgmap v3536: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 492 KiB/s wr, 16 op/s 2024-05-08T08:37:31.775 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utlock.o 2024-05-08T08:37:33.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:32 smithi194 ceph-mon[33679]: pgmap v3537: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 415 KiB/s wr, 14 op/s 2024-05-08T08:37:33.026 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fs_context.o 2024-05-08T08:37:33.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:32 smithi070 ceph-mon[29591]: pgmap v3537: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 415 KiB/s wr, 14 op/s 2024-05-08T08:37:33.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:32 smithi172 ceph-mon[33377]: pgmap v3537: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 415 KiB/s wr, 14 op/s 2024-05-08T08:37:35.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:34 smithi194 ceph-mon[33679]: pgmap v3538: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 415 KiB/s wr, 14 op/s 2024-05-08T08:37:35.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:34 smithi070 ceph-mon[29591]: pgmap v3538: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 415 KiB/s wr, 14 op/s 2024-05-08T08:37:35.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:34 smithi172 ceph-mon[33377]: pgmap v3538: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 323 KiB/s rd, 415 KiB/s wr, 14 op/s 2024-05-08T08:37:37.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:36 smithi194 ceph-mon[33679]: pgmap v3539: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 650 KiB/s wr, 27 op/s 2024-05-08T08:37:37.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:36 smithi070 ceph-mon[29591]: pgmap v3539: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 650 KiB/s wr, 27 op/s 2024-05-08T08:37:37.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:36 smithi172 ceph-mon[33377]: pgmap v3539: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 650 KiB/s wr, 27 op/s 2024-05-08T08:37:38.615 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utmath.o 2024-05-08T08:37:38.936 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/xprtsock.o 2024-05-08T08:37:39.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:38 smithi070 ceph-mon[29591]: pgmap v3540: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 474 KiB/s wr, 18 op/s 2024-05-08T08:37:39.157 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/he.o 2024-05-08T08:37:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:38 smithi172 ceph-mon[33377]: pgmap v3540: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 474 KiB/s wr, 18 op/s 2024-05-08T08:37:39.246 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/ethtool.o 2024-05-08T08:37:39.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:38 smithi194 ceph-mon[33679]: pgmap v3540: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 474 KiB/s wr, 18 op/s 2024-05-08T08:37:39.920 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/datagram.o 2024-05-08T08:37:40.140 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/nf_log_syslog.o 2024-05-08T08:37:40.167 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/datagram.o 2024-05-08T08:37:41.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:40 smithi070 ceph-mon[29591]: pgmap v3541: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 714 KiB/s wr, 49 op/s 2024-05-08T08:37:41.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:40 smithi172 ceph-mon[33377]: pgmap v3541: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 714 KiB/s wr, 49 op/s 2024-05-08T08:37:41.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:40 smithi194 ceph-mon[33679]: pgmap v3541: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 714 KiB/s wr, 49 op/s 2024-05-08T08:37:43.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:42 smithi070 ceph-mon[29591]: pgmap v3542: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 475 KiB/s wr, 43 op/s 2024-05-08T08:37:43.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:42 smithi172 ceph-mon[33377]: pgmap v3542: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 475 KiB/s wr, 43 op/s 2024-05-08T08:37:43.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:42 smithi194 ceph-mon[33679]: pgmap v3542: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 475 KiB/s wr, 43 op/s 2024-05-08T08:37:43.431 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fs_parser.o 2024-05-08T08:37:44.727 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utmisc.o 2024-05-08T08:37:45.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:44 smithi070 ceph-mon[29591]: pgmap v3543: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 475 KiB/s wr, 43 op/s 2024-05-08T08:37:45.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:44 smithi172 ceph-mon[33377]: pgmap v3543: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 475 KiB/s wr, 43 op/s 2024-05-08T08:37:45.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:44 smithi194 ceph-mon[33679]: pgmap v3543: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 475 KiB/s wr, 43 op/s 2024-05-08T08:37:47.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:46 smithi070 ceph-mon[29591]: pgmap v3544: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 725 KiB/s wr, 51 op/s 2024-05-08T08:37:47.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:46 smithi172 ceph-mon[33377]: pgmap v3544: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 725 KiB/s wr, 51 op/s 2024-05-08T08:37:47.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:46 smithi194 ceph-mon[33679]: pgmap v3544: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 579 KiB/s rd, 725 KiB/s wr, 51 op/s 2024-05-08T08:37:49.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:48 smithi070 ceph-mon[29591]: pgmap v3545: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 489 KiB/s wr, 38 op/s 2024-05-08T08:37:49.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:48 smithi172 ceph-mon[33377]: pgmap v3545: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 489 KiB/s wr, 38 op/s 2024-05-08T08:37:49.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:48 smithi194 ceph-mon[33679]: pgmap v3545: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 489 KiB/s wr, 38 op/s 2024-05-08T08:37:50.876 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utmutex.o 2024-05-08T08:37:51.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:50 smithi070 ceph-mon[29591]: pgmap v3546: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 727 KiB/s wr, 50 op/s 2024-05-08T08:37:51.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:50 smithi172 ceph-mon[33377]: pgmap v3546: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 727 KiB/s wr, 50 op/s 2024-05-08T08:37:51.242 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/s1g.o 2024-05-08T08:37:51.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:50 smithi194 ceph-mon[33679]: pgmap v3546: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 727 KiB/s wr, 50 op/s 2024-05-08T08:37:51.276 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fsopen.o 2024-05-08T08:37:51.323 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/mesh.o 2024-05-08T08:37:52.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:37:52.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:37:52.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:37:52.961 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/raw.o 2024-05-08T08:37:53.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:52 smithi070 ceph-mon[29591]: pgmap v3547: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 488 KiB/s wr, 20 op/s 2024-05-08T08:37:53.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:52 smithi172 ceph-mon[33377]: pgmap v3547: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 488 KiB/s wr, 20 op/s 2024-05-08T08:37:53.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:52 smithi194 ceph-mon[33679]: pgmap v3547: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 488 KiB/s wr, 20 op/s 2024-05-08T08:37:53.638 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ip6_flowlabel.o 2024-05-08T08:37:53.858 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/sched.o 2024-05-08T08:37:54.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:37:54.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:37:54.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:37:54.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:37:54.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:37:54.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:37:54.249 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_mark.o 2024-05-08T08:37:54.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:37:54.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:37:54.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:37:55.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:55 smithi070 ceph-mon[29591]: pgmap v3548: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 488 KiB/s wr, 20 op/s 2024-05-08T08:37:55.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:55 smithi172 ceph-mon[33377]: pgmap v3548: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 488 KiB/s wr, 20 op/s 2024-05-08T08:37:55.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:55 smithi194 ceph-mon[33679]: pgmap v3548: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 488 KiB/s wr, 20 op/s 2024-05-08T08:37:57.296 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utnonansi.o 2024-05-08T08:37:57.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:57 smithi070 ceph-mon[29591]: pgmap v3549: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 761 KiB/s wr, 35 op/s 2024-05-08T08:37:57.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:57 smithi172 ceph-mon[33377]: pgmap v3549: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 761 KiB/s wr, 35 op/s 2024-05-08T08:37:57.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:57 smithi194 ceph-mon[33679]: pgmap v3549: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 779 KiB/s rd, 761 KiB/s wr, 35 op/s 2024-05-08T08:37:59.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:37:59 smithi070 ceph-mon[29591]: pgmap v3550: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 511 KiB/s wr, 27 op/s 2024-05-08T08:37:59.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:37:59 smithi172 ceph-mon[33377]: pgmap v3550: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 511 KiB/s wr, 27 op/s 2024-05-08T08:37:59.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:37:59 smithi194 ceph-mon[33679]: pgmap v3550: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 511 KiB/s wr, 27 op/s 2024-05-08T08:38:01.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:01 smithi070 ceph-mon[29591]: pgmap v3551: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 907 KiB/s wr, 37 op/s 2024-05-08T08:38:01.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:01 smithi172 ceph-mon[33377]: pgmap v3551: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 907 KiB/s wr, 37 op/s 2024-05-08T08:38:01.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:01 smithi194 ceph-mon[33679]: pgmap v3551: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 991 KiB/s rd, 907 KiB/s wr, 37 op/s 2024-05-08T08:38:01.907 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/init.o 2024-05-08T08:38:03.306 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:03 smithi194 ceph-mon[33679]: pgmap v3552: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 669 KiB/s wr, 25 op/s 2024-05-08T08:38:03.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:03 smithi070 ceph-mon[29591]: pgmap v3552: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 669 KiB/s wr, 25 op/s 2024-05-08T08:38:03.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:03 smithi172 ceph-mon[33377]: pgmap v3552: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 669 KiB/s wr, 25 op/s 2024-05-08T08:38:04.401 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/ap.o 2024-05-08T08:38:04.460 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/ibss.o 2024-05-08T08:38:05.177 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utobject.o 2024-05-08T08:38:05.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:05 smithi070 ceph-mon[29591]: pgmap v3553: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 669 KiB/s wr, 25 op/s 2024-05-08T08:38:05.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:05 smithi172 ceph-mon[33377]: pgmap v3553: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 669 KiB/s wr, 25 op/s 2024-05-08T08:38:05.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:05 smithi194 ceph-mon[33679]: pgmap v3553: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 669 KiB/s wr, 25 op/s 2024-05-08T08:38:06.816 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_nat.o 2024-05-08T08:38:07.079 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/inet6_connection_sock.o 2024-05-08T08:38:07.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:07 smithi070 ceph-mon[29591]: pgmap v3554: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 949 KiB/s wr, 50 op/s 2024-05-08T08:38:07.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:07 smithi172 ceph-mon[33377]: pgmap v3554: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 949 KiB/s wr, 50 op/s 2024-05-08T08:38:07.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:07 smithi194 ceph-mon[33679]: pgmap v3554: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 853 KiB/s rd, 949 KiB/s wr, 50 op/s 2024-05-08T08:38:07.632 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/udp.o 2024-05-08T08:38:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:09 smithi070 ceph-mon[29591]: pgmap v3555: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 675 KiB/s wr, 35 op/s 2024-05-08T08:38:09.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:09 smithi172 ceph-mon[33377]: pgmap v3555: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 675 KiB/s wr, 35 op/s 2024-05-08T08:38:09.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:09 smithi194 ceph-mon[33679]: pgmap v3555: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 675 KiB/s wr, 35 op/s 2024-05-08T08:38:09.686 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/kernel_read_file.o 2024-05-08T08:38:10.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:10 smithi070 ceph-mon[29591]: osdmap e300: 12 total, 12 up, 12 in 2024-05-08T08:38:10.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:10 smithi172 ceph-mon[33377]: osdmap e300: 12 total, 12 up, 12 in 2024-05-08T08:38:10.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:10 smithi194 ceph-mon[33679]: osdmap e300: 12 total, 12 up, 12 in 2024-05-08T08:38:11.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:11 smithi070 ceph-mon[29591]: pgmap v3557: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 655 KiB/s wr, 49 op/s 2024-05-08T08:38:11.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:11 smithi172 ceph-mon[33377]: pgmap v3557: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 655 KiB/s wr, 49 op/s 2024-05-08T08:38:11.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:11 smithi194 ceph-mon[33679]: pgmap v3557: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 655 KiB/s wr, 49 op/s 2024-05-08T08:38:11.521 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utosi.o 2024-05-08T08:38:11.738 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth.o 2024-05-08T08:38:13.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:13 smithi070 ceph-mon[29591]: pgmap v3558: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 655 KiB/s wr, 49 op/s 2024-05-08T08:38:13.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:13 smithi172 ceph-mon[33377]: pgmap v3558: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 655 KiB/s wr, 49 op/s 2024-05-08T08:38:13.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:13 smithi194 ceph-mon[33679]: pgmap v3558: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 655 KiB/s wr, 49 op/s 2024-05-08T08:38:15.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:15 smithi070 ceph-mon[29591]: pgmap v3559: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 655 KiB/s wr, 49 op/s 2024-05-08T08:38:15.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:15 smithi172 ceph-mon[33377]: pgmap v3559: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 655 KiB/s wr, 49 op/s 2024-05-08T08:38:15.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:15 smithi194 ceph-mon[33679]: pgmap v3559: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 655 KiB/s wr, 49 op/s 2024-05-08T08:38:16.276 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/trace.o 2024-05-08T08:38:16.920 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/iface.o 2024-05-08T08:38:17.140 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/mnt_idmapping.o 2024-05-08T08:38:17.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:17 smithi070 ceph-mon[29591]: pgmap v3560: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 665 KiB/s wr, 31 op/s 2024-05-08T08:38:17.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:17 smithi172 ceph-mon[33377]: pgmap v3560: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 665 KiB/s wr, 31 op/s 2024-05-08T08:38:17.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:17 smithi194 ceph-mon[33679]: pgmap v3560: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 665 KiB/s wr, 31 op/s 2024-05-08T08:38:17.619 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utownerid.o 2024-05-08T08:38:19.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:19 smithi070 ceph-mon[29591]: pgmap v3561: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 665 KiB/s wr, 31 op/s 2024-05-08T08:38:19.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:19 smithi172 ceph-mon[33377]: pgmap v3561: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 665 KiB/s wr, 31 op/s 2024-05-08T08:38:19.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:19 smithi194 ceph-mon[33679]: pgmap v3561: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 665 KiB/s wr, 31 op/s 2024-05-08T08:38:19.636 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_LOG.o 2024-05-08T08:38:19.691 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/udp_offload.o 2024-05-08T08:38:20.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:20 smithi070 ceph-mon[29591]: osdmap e301: 12 total, 12 up, 12 in 2024-05-08T08:38:20.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:20 smithi070 ceph-mon[29591]: pgmap v3563: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 728 KiB/s wr, 25 op/s 2024-05-08T08:38:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:20 smithi172 ceph-mon[33377]: osdmap e301: 12 total, 12 up, 12 in 2024-05-08T08:38:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:20 smithi172 ceph-mon[33377]: pgmap v3563: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 728 KiB/s wr, 25 op/s 2024-05-08T08:38:21.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:20 smithi194 ceph-mon[33679]: osdmap e301: 12 total, 12 up, 12 in 2024-05-08T08:38:21.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:20 smithi194 ceph-mon[33679]: pgmap v3563: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 728 KiB/s wr, 25 op/s 2024-05-08T08:38:22.865 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/udplite.o 2024-05-08T08:38:23.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:22 smithi194 ceph-mon[33679]: pgmap v3564: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 728 KiB/s wr, 25 op/s 2024-05-08T08:38:23.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:22 smithi070 ceph-mon[29591]: pgmap v3564: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 728 KiB/s wr, 25 op/s 2024-05-08T08:38:23.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:22 smithi172 ceph-mon[33377]: pgmap v3564: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 728 KiB/s wr, 25 op/s 2024-05-08T08:38:25.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:24 smithi194 ceph-mon[33679]: pgmap v3565: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 728 KiB/s wr, 25 op/s 2024-05-08T08:38:25.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:24 smithi070 ceph-mon[29591]: pgmap v3565: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 728 KiB/s wr, 25 op/s 2024-05-08T08:38:25.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:24 smithi172 ceph-mon[33377]: pgmap v3565: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 728 KiB/s wr, 25 op/s 2024-05-08T08:38:27.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:26 smithi194 ceph-mon[33679]: pgmap v3566: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 738 KiB/s wr, 26 op/s 2024-05-08T08:38:27.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:26 smithi070 ceph-mon[29591]: pgmap v3566: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 738 KiB/s wr, 26 op/s 2024-05-08T08:38:27.153 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_null.o 2024-05-08T08:38:27.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:26 smithi172 ceph-mon[33377]: pgmap v3566: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 738 KiB/s wr, 26 op/s 2024-05-08T08:38:27.192 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utpredef.o 2024-05-08T08:38:27.331 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/remap_range.o 2024-05-08T08:38:29.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:28 smithi194 ceph-mon[33679]: pgmap v3567: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 738 KiB/s wr, 26 op/s 2024-05-08T08:38:29.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:28 smithi070 ceph-mon[29591]: pgmap v3567: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 738 KiB/s wr, 26 op/s 2024-05-08T08:38:29.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:28 smithi172 ceph-mon[33377]: pgmap v3567: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 738 KiB/s wr, 26 op/s 2024-05-08T08:38:29.196 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/link.o 2024-05-08T08:38:31.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:30 smithi194 ceph-mon[33679]: pgmap v3568: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 663 KiB/s wr, 21 op/s 2024-05-08T08:38:31.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:30 smithi070 ceph-mon[29591]: pgmap v3568: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 663 KiB/s wr, 21 op/s 2024-05-08T08:38:31.173 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:30 smithi172 ceph-mon[33377]: pgmap v3568: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 663 KiB/s wr, 21 op/s 2024-05-08T08:38:31.237 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/seg6.o 2024-05-08T08:38:32.520 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_MASQUERADE.o 2024-05-08T08:38:33.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:32 smithi070 ceph-mon[29591]: pgmap v3569: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 559 KiB/s wr, 18 op/s 2024-05-08T08:38:33.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:32 smithi172 ceph-mon[33377]: pgmap v3569: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 559 KiB/s wr, 18 op/s 2024-05-08T08:38:33.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:32 smithi194 ceph-mon[33679]: pgmap v3569: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 559 KiB/s wr, 18 op/s 2024-05-08T08:38:33.442 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utresdecode.o 2024-05-08T08:38:33.925 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/udp_offload.o 2024-05-08T08:38:34.186 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/ocb.o 2024-05-08T08:38:35.056 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:34 smithi194 ceph-mon[33679]: pgmap v3570: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 559 KiB/s wr, 18 op/s 2024-05-08T08:38:35.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:34 smithi070 ceph-mon[29591]: pgmap v3570: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 559 KiB/s wr, 18 op/s 2024-05-08T08:38:35.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:34 smithi172 ceph-mon[33377]: pgmap v3570: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 390 KiB/s rd, 559 KiB/s wr, 18 op/s 2024-05-08T08:38:37.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:36 smithi070 ceph-mon[29591]: pgmap v3571: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 951 KiB/s wr, 33 op/s 2024-05-08T08:38:37.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:36 smithi172 ceph-mon[33377]: pgmap v3571: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 951 KiB/s wr, 33 op/s 2024-05-08T08:38:37.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:36 smithi194 ceph-mon[33679]: pgmap v3571: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 951 KiB/s wr, 33 op/s 2024-05-08T08:38:37.495 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/buffer.o 2024-05-08T08:38:38.704 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_tls.o 2024-05-08T08:38:39.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:38 smithi070 ceph-mon[29591]: pgmap v3572: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 655 KiB/s wr, 22 op/s 2024-05-08T08:38:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:38 smithi172 ceph-mon[33377]: pgmap v3572: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 655 KiB/s wr, 22 op/s 2024-05-08T08:38:39.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:38 smithi194 ceph-mon[33679]: pgmap v3572: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 655 KiB/s wr, 22 op/s 2024-05-08T08:38:39.418 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utresrc.o 2024-05-08T08:38:41.066 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/rate.o 2024-05-08T08:38:41.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:40 smithi070 ceph-mon[29591]: pgmap v3573: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 924 KiB/s wr, 34 op/s 2024-05-08T08:38:41.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:40 smithi172 ceph-mon[33377]: pgmap v3573: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 924 KiB/s wr, 34 op/s 2024-05-08T08:38:41.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:40 smithi194 ceph-mon[33679]: pgmap v3573: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 924 KiB/s wr, 34 op/s 2024-05-08T08:38:42.879 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/fib6_notifier.o 2024-05-08T08:38:43.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:42 smithi070 ceph-mon[29591]: pgmap v3574: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 662 KiB/s wr, 26 op/s 2024-05-08T08:38:43.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:42 smithi172 ceph-mon[33377]: pgmap v3574: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 662 KiB/s wr, 26 op/s 2024-05-08T08:38:43.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:42 smithi194 ceph-mon[33679]: pgmap v3574: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 662 KiB/s wr, 26 op/s 2024-05-08T08:38:45.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:44 smithi070 ceph-mon[29591]: pgmap v3575: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 662 KiB/s wr, 26 op/s 2024-05-08T08:38:45.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:44 smithi172 ceph-mon[33377]: pgmap v3575: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 662 KiB/s wr, 26 op/s 2024-05-08T08:38:45.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:44 smithi194 ceph-mon[33679]: pgmap v3575: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 662 KiB/s wr, 26 op/s 2024-05-08T08:38:45.474 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_addrtype.o 2024-05-08T08:38:45.726 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utstate.o 2024-05-08T08:38:46.173 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/pmsr.o 2024-05-08T08:38:46.195 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/arp.o 2024-05-08T08:38:47.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:46 smithi070 ceph-mon[29591]: pgmap v3576: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 959 KiB/s wr, 36 op/s 2024-05-08T08:38:47.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:46 smithi172 ceph-mon[33377]: pgmap v3576: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 959 KiB/s wr, 36 op/s 2024-05-08T08:38:47.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:46 smithi194 ceph-mon[33679]: pgmap v3576: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 959 KiB/s wr, 36 op/s 2024-05-08T08:38:49.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:48 smithi070 ceph-mon[29591]: pgmap v3577: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 566 KiB/s wr, 21 op/s 2024-05-08T08:38:49.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:48 smithi172 ceph-mon[33377]: pgmap v3577: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 566 KiB/s wr, 21 op/s 2024-05-08T08:38:49.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:48 smithi194 ceph-mon[33679]: pgmap v3577: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 566 KiB/s wr, 21 op/s 2024-05-08T08:38:49.375 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/mpage.o 2024-05-08T08:38:50.388 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/auth_unix.o 2024-05-08T08:38:51.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:50 smithi070 ceph-mon[29591]: pgmap v3578: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 830 KiB/s wr, 32 op/s 2024-05-08T08:38:51.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:50 smithi172 ceph-mon[33377]: pgmap v3578: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 830 KiB/s wr, 32 op/s 2024-05-08T08:38:51.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:50 smithi194 ceph-mon[33679]: pgmap v3578: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 830 KiB/s wr, 32 op/s 2024-05-08T08:38:51.755 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utstring.o 2024-05-08T08:38:53.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:52 smithi070 ceph-mon[29591]: pgmap v3579: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 561 KiB/s wr, 20 op/s 2024-05-08T08:38:53.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:52 smithi172 ceph-mon[33377]: pgmap v3579: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 561 KiB/s wr, 20 op/s 2024-05-08T08:38:53.207 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/michael.o 2024-05-08T08:38:53.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:52 smithi194 ceph-mon[33679]: pgmap v3579: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 561 KiB/s wr, 20 op/s 2024-05-08T08:38:54.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:38:54.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:38:54.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:38:54.508 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/rpl.o 2024-05-08T08:38:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:55 smithi194 ceph-mon[33679]: pgmap v3580: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 561 KiB/s wr, 20 op/s 2024-05-08T08:38:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:55 smithi070 ceph-mon[29591]: pgmap v3580: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 561 KiB/s wr, 20 op/s 2024-05-08T08:38:55.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:55 smithi172 ceph-mon[33377]: pgmap v3580: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 561 KiB/s wr, 20 op/s 2024-05-08T08:38:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:56.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:38:56.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:38:56.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:56.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:38:56.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:38:56.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:56.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:38:56.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:38:56.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:38:57.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:57 smithi194 ceph-mon[33679]: pgmap v3581: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 844 KiB/s wr, 33 op/s 2024-05-08T08:38:57.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:57 smithi070 ceph-mon[29591]: pgmap v3581: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 844 KiB/s wr, 33 op/s 2024-05-08T08:38:57.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:57 smithi172 ceph-mon[33377]: pgmap v3581: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 883 KiB/s rd, 844 KiB/s wr, 33 op/s 2024-05-08T08:38:58.139 INFO:tasks.workunit.client.0.smithi070.stdout: GEN net/wireless/shipped-certs.c 2024-05-08T08:38:58.269 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/wireless/shipped-certs.o 2024-05-08T08:38:58.927 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/netfilter/built-in.a 2024-05-08T08:38:59.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:38:59 smithi194 ceph-mon[33679]: pgmap v3582: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 547 KiB/s wr, 23 op/s 2024-05-08T08:38:59.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:38:59 smithi070 ceph-mon[29591]: pgmap v3582: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 547 KiB/s wr, 23 op/s 2024-05-08T08:38:59.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:38:59 smithi172 ceph-mon[33377]: pgmap v3582: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 547 KiB/s wr, 23 op/s 2024-05-08T08:39:00.130 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/tkip.o 2024-05-08T08:39:01.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:01 smithi194 ceph-mon[33679]: pgmap v3583: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 824 KiB/s wr, 37 op/s 2024-05-08T08:39:01.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:01 smithi070 ceph-mon[29591]: pgmap v3583: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 824 KiB/s wr, 37 op/s 2024-05-08T08:39:01.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:01 smithi172 ceph-mon[33377]: pgmap v3583: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 786 KiB/s rd, 824 KiB/s wr, 37 op/s 2024-05-08T08:39:03.245 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utstrsuppt.o 2024-05-08T08:39:03.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:03 smithi194 ceph-mon[33679]: pgmap v3584: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 559 KiB/s wr, 26 op/s 2024-05-08T08:39:03.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:03 smithi070 ceph-mon[29591]: pgmap v3584: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 559 KiB/s wr, 26 op/s 2024-05-08T08:39:03.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:03 smithi172 ceph-mon[33377]: pgmap v3584: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 559 KiB/s wr, 26 op/s 2024-05-08T08:39:03.709 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/proc_namespace.o 2024-05-08T08:39:04.133 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/svc.o 2024-05-08T08:39:04.318 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/icmp.o 2024-05-08T08:39:05.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:05 smithi194 ceph-mon[33679]: pgmap v3585: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 559 KiB/s wr, 26 op/s 2024-05-08T08:39:05.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:05 smithi070 ceph-mon[29591]: pgmap v3585: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 559 KiB/s wr, 26 op/s 2024-05-08T08:39:05.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:05 smithi172 ceph-mon[33377]: pgmap v3585: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 577 KiB/s rd, 559 KiB/s wr, 26 op/s 2024-05-08T08:39:06.147 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/direct-io.o 2024-05-08T08:39:07.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:07 smithi194 ceph-mon[33679]: pgmap v3586: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 956 KiB/s wr, 52 op/s 2024-05-08T08:39:07.543 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ioam6.o 2024-05-08T08:39:07.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:07 smithi070 ceph-mon[29591]: pgmap v3586: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 956 KiB/s wr, 52 op/s 2024-05-08T08:39:07.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:07 smithi172 ceph-mon[33377]: pgmap v3586: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 966 KiB/s rd, 956 KiB/s wr, 52 op/s 2024-05-08T08:39:09.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:09 smithi194 ceph-mon[33679]: pgmap v3587: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 673 KiB/s wr, 39 op/s 2024-05-08T08:39:09.607 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utstrtoul64.o 2024-05-08T08:39:09.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:09 smithi070 ceph-mon[29591]: pgmap v3587: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 673 KiB/s wr, 39 op/s 2024-05-08T08:39:09.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:09 smithi172 ceph-mon[33377]: pgmap v3587: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 673 KiB/s wr, 39 op/s 2024-05-08T08:39:09.700 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/wireless/built-in.a 2024-05-08T08:39:10.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:10 smithi194 ceph-mon[33679]: osdmap e302: 12 total, 12 up, 12 in 2024-05-08T08:39:10.529 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/devinet.o 2024-05-08T08:39:10.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:10 smithi070 ceph-mon[29591]: osdmap e302: 12 total, 12 up, 12 in 2024-05-08T08:39:10.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:10 smithi172 ceph-mon[33377]: osdmap e302: 12 total, 12 up, 12 in 2024-05-08T08:39:11.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:11 smithi070 ceph-mon[29591]: pgmap v3589: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 797 KiB/s wr, 40 op/s 2024-05-08T08:39:11.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:11 smithi172 ceph-mon[33377]: pgmap v3589: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 797 KiB/s wr, 40 op/s 2024-05-08T08:39:11.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:11 smithi194 ceph-mon[33679]: pgmap v3589: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 797 KiB/s wr, 40 op/s 2024-05-08T08:39:11.756 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/eventpoll.o 2024-05-08T08:39:13.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:13 smithi070 ceph-mon[29591]: pgmap v3590: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 797 KiB/s wr, 40 op/s 2024-05-08T08:39:13.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:13 smithi172 ceph-mon[33377]: pgmap v3590: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 797 KiB/s wr, 40 op/s 2024-05-08T08:39:13.696 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/aes_cmac.o 2024-05-08T08:39:13.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:13 smithi194 ceph-mon[33679]: pgmap v3590: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 797 KiB/s wr, 40 op/s 2024-05-08T08:39:14.762 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/af_inet.o 2024-05-08T08:39:15.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:15 smithi070 ceph-mon[29591]: pgmap v3591: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 797 KiB/s wr, 40 op/s 2024-05-08T08:39:15.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:15 smithi172 ceph-mon[33377]: pgmap v3591: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 797 KiB/s wr, 40 op/s 2024-05-08T08:39:15.726 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utxface.o 2024-05-08T08:39:15.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:15 smithi194 ceph-mon[33679]: pgmap v3591: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 776 KiB/s rd, 797 KiB/s wr, 40 op/s 2024-05-08T08:39:15.948 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.0 2024-05-08T08:39:15.949 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:39:16.515 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:39:17.410 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/svcsock.o 2024-05-08T08:39:17.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:17 smithi070 ceph-mon[29591]: pgmap v3592: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 690 KiB/s wr, 24 op/s 2024-05-08T08:39:17.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:17 smithi172 ceph-mon[33377]: pgmap v3592: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 690 KiB/s wr, 24 op/s 2024-05-08T08:39:17.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:17 smithi194 ceph-mon[33679]: pgmap v3592: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 690 KiB/s wr, 24 op/s 2024-05-08T08:39:18.608 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utxfinit.o 2024-05-08T08:39:19.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.145+0000 7fafaee00700 1 -- 172.21.15.70:0/3071427801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 msgr2=0x7fafa8116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:19.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.145+0000 7fafaee00700 1 --2- 172.21.15.70:0/3071427801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 0x7fafa8116a60 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b0a0 tx=0x7fafa000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.146+0000 7fafaee00700 1 -- 172.21.15.70:0/3071427801 shutdown_connections 2024-05-08T08:39:19.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.146+0000 7fafaee00700 1 --2- 172.21.15.70:0/3071427801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 0x7fafa8116a60 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.146+0000 7fafaee00700 1 --2- 172.21.15.70:0/3071427801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa80756d0 0x7fafa8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.146+0000 7fafaee00700 1 --2- 172.21.15.70:0/3071427801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa8075ff0 0x7fafa8114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.146+0000 7fafaee00700 1 -- 172.21.15.70:0/3071427801 >> 172.21.15.70:0/3071427801 conn(0x7fafa807a650 msgr2=0x7fafa807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:39:19.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.146+0000 7fafaee00700 1 -- 172.21.15.70:0/3071427801 shutdown_connections 2024-05-08T08:39:19.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.147+0000 7fafaee00700 1 -- 172.21.15.70:0/3071427801 wait complete. 2024-05-08T08:39:19.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.148+0000 7fafaee00700 1 Processor -- start 2024-05-08T08:39:19.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.148+0000 7fafaee00700 1 -- start start 2024-05-08T08:39:19.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7fafaee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa80756d0 0x7fafa81a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7fafaee00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa8075ff0 0x7fafa81a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7fafaee00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 0x7fafa81a4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7fafaee00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fafa8119b60 con 0x7fafa8114670 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7fafaee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fafa81199e0 con 0x7fafa80756d0 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7fafaee00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fafa8119ce0 con 0x7fafa8075ff0 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7faface00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 0x7fafa81a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7faface00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 0x7fafa81a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59222/0 (socket says 172.21.15.70:59222) 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7faface00700 1 -- 172.21.15.70:0/3569497412 learned_addr learned my addr 172.21.15.70:0/3569497412 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7fafa7e00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa80756d0 0x7fafa81a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.149+0000 7fafa7400700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa8075ff0 0x7fafa81a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.150+0000 7faface00700 1 -- 172.21.15.70:0/3569497412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa8075ff0 msgr2=0x7fafa81a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:19.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.150+0000 7faface00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa8075ff0 0x7fafa81a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.150+0000 7faface00700 1 -- 172.21.15.70:0/3569497412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa80756d0 msgr2=0x7fafa81a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.150+0000 7faface00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa80756d0 0x7fafa81a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.150+0000 7faface00700 1 -- 172.21.15.70:0/3569497412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa81a50a0 con 0x7fafa8114670 2024-05-08T08:39:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.150+0000 7faface00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 0x7fafa81a4960 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b070 tx=0x7fafa0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:39:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.150+0000 7fafa4c00700 1 -- 172.21.15.70:0/3569497412 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0021070 con 0x7fafa8114670 2024-05-08T08:39:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.151+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa81a5330 con 0x7fafa8114670 2024-05-08T08:39:19.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.151+0000 7fafa4c00700 1 -- 172.21.15.70:0/3569497412 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fafa0007b80 con 0x7fafa8114670 2024-05-08T08:39:19.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.151+0000 7fafa4c00700 1 -- 172.21.15.70:0/3569497412 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0004770 con 0x7fafa8114670 2024-05-08T08:39:19.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.151+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa81acc10 con 0x7fafa8114670 2024-05-08T08:39:19.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.153+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa806a190 con 0x7fafa8114670 2024-05-08T08:39:19.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.155+0000 7fafa4c00700 1 -- 172.21.15.70:0/3569497412 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fafa0003f20 con 0x7fafa8114670 2024-05-08T08:39:19.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.157+0000 7fafa4c00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf8c0b2af0 0x7faf8c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:19.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.157+0000 7fafa4c00700 1 -- 172.21.15.70:0/3569497412 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(302..302 src has 1..302) ==== 9671+0+0 (secure 0 0 0) 0x7fafa000f020 con 0x7fafa8114670 2024-05-08T08:39:19.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.157+0000 7fafa7e00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf8c0b2af0 0x7faf8c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:19.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.158+0000 7fafa7e00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf8c0b2af0 0x7faf8c0b4fb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faf98009c40 tx=0x7faf98009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:39:19.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.164+0000 7fafa4c00700 1 -- 172.21.15.70:0/3569497412 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fafa002a020 con 0x7fafa8114670 2024-05-08T08:39:19.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:19 smithi070 ceph-mon[29591]: pgmap v3593: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 690 KiB/s wr, 24 op/s 2024-05-08T08:39:19.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.631+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fafa81acde0 con 0x7fafa8114670 2024-05-08T08:39:19.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.632+0000 7fafa4c00700 1 -- 172.21.15.70:0/3569497412 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fafa00aadf0 con 0x7fafa8114670 2024-05-08T08:39:19.626 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:39:19.626 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:39:19.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf8c0b2af0 msgr2=0x7faf8c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:19.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf8c0b2af0 0x7faf8c0b4fb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faf98009c40 tx=0x7faf98009260 comp rx=0 tx=0).stop 2024-05-08T08:39:19.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 msgr2=0x7fafa81a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:19.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 0x7fafa81a4960 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b070 tx=0x7fafa0004d10 comp rx=0 tx=0).stop 2024-05-08T08:39:19.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 shutdown_connections 2024-05-08T08:39:19.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faf8c0b2af0 0x7faf8c0b4fb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fafa8114670 0x7fafa81a4960 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fafa80756d0 0x7fafa81a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 --2- 172.21.15.70:0/3569497412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fafa8075ff0 0x7fafa81a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:19.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 >> 172.21.15.70:0/3569497412 conn(0x7fafa807a650 msgr2=0x7fafa81134a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:39:19.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.636+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 shutdown_connections 2024-05-08T08:39:19.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:19.637+0000 7fafaee00700 1 -- 172.21.15.70:0/3569497412 wait complete. 2024-05-08T08:39:19.632 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:39:19.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:19 smithi172 ceph-mon[33377]: pgmap v3593: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 690 KiB/s wr, 24 op/s 2024-05-08T08:39:19.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:19 smithi194 ceph-mon[33679]: pgmap v3593: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 690 KiB/s wr, 24 op/s 2024-05-08T08:39:20.376 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/sysctl_net_ipv6.o 2024-05-08T08:39:20.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:20 smithi070 ceph-mon[29591]: osdmap e303: 12 total, 12 up, 12 in 2024-05-08T08:39:20.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:20 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3569497412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:39:20.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:20 smithi070 ceph-mon[29591]: pgmap v3595: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 940 KiB/s wr, 33 op/s 2024-05-08T08:39:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:20 smithi172 ceph-mon[33377]: osdmap e303: 12 total, 12 up, 12 in 2024-05-08T08:39:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:20 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3569497412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:39:20.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:20 smithi172 ceph-mon[33377]: pgmap v3595: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 940 KiB/s wr, 33 op/s 2024-05-08T08:39:21.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:20 smithi194 ceph-mon[33679]: osdmap e303: 12 total, 12 up, 12 in 2024-05-08T08:39:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:20 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3569497412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:39:21.004 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:20 smithi194 ceph-mon[33679]: pgmap v3595: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 940 KiB/s wr, 33 op/s 2024-05-08T08:39:23.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:22 smithi194 ceph-mon[33679]: pgmap v3596: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 940 KiB/s wr, 33 op/s 2024-05-08T08:39:23.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:22 smithi070 ceph-mon[29591]: pgmap v3596: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 940 KiB/s wr, 33 op/s 2024-05-08T08:39:23.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:22 smithi172 ceph-mon[33377]: pgmap v3596: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 940 KiB/s wr, 33 op/s 2024-05-08T08:39:23.699 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/aes_gmac.o 2024-05-08T08:39:24.530 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 87.0 --await-for 42.0' 2024-05-08T08:39:24.530 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 87.0 --await-for 42.0 2024-05-08T08:39:25.040 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:24 smithi070 ceph-mon[29591]: pgmap v3597: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 940 KiB/s wr, 33 op/s 2024-05-08T08:39:25.101 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:39:25.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:24 smithi172 ceph-mon[33377]: pgmap v3597: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 940 KiB/s wr, 33 op/s 2024-05-08T08:39:25.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:24 smithi194 ceph-mon[33679]: pgmap v3597: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 940 KiB/s wr, 33 op/s 2024-05-08T08:39:25.858 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utxferror.o 2024-05-08T08:39:26.012 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlabel/netlabel_user.o 2024-05-08T08:39:26.096 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/anon_inodes.o 2024-05-08T08:39:26.746 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/signalfd.o 2024-05-08T08:39:27.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:26 smithi070 ceph-mon[29591]: pgmap v3598: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 963 KiB/s wr, 33 op/s 2024-05-08T08:39:27.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:26 smithi172 ceph-mon[33377]: pgmap v3598: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 963 KiB/s wr, 33 op/s 2024-05-08T08:39:27.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:26 smithi194 ceph-mon[33679]: pgmap v3598: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 963 KiB/s wr, 33 op/s 2024-05-08T08:39:29.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:28 smithi070 ceph-mon[29591]: pgmap v3599: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 963 KiB/s wr, 33 op/s 2024-05-08T08:39:29.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.148+0000 7f22eec00700 1 -- 172.21.15.70:0/2968558406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8102970 msgr2=0x7f22e8107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:29.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.148+0000 7f22eec00700 1 --2- 172.21.15.70:0/2968558406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8102970 0x7f22e8107110 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009990 tx=0x7f22d4009ca0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.149+0000 7f22eec00700 1 -- 172.21.15.70:0/2968558406 shutdown_connections 2024-05-08T08:39:29.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.149+0000 7f22eec00700 1 --2- 172.21.15.70:0/2968558406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22e8107650 0x7f22e8107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.149+0000 7f22eec00700 1 --2- 172.21.15.70:0/2968558406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e8102050 0x7f22e8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.149+0000 7f22eec00700 1 --2- 172.21.15.70:0/2968558406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8102970 0x7f22e8107110 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.149+0000 7f22eec00700 1 -- 172.21.15.70:0/2968558406 >> 172.21.15.70:0/2968558406 conn(0x7f22e80fdcf0 msgr2=0x7f22e8100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:39:29.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.149+0000 7f22eec00700 1 -- 172.21.15.70:0/2968558406 shutdown_connections 2024-05-08T08:39:29.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.149+0000 7f22eec00700 1 -- 172.21.15.70:0/2968558406 wait complete. 2024-05-08T08:39:29.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.151+0000 7f22eec00700 1 Processor -- start 2024-05-08T08:39:29.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.151+0000 7f22eec00700 1 -- start start 2024-05-08T08:39:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22eec00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e8102050 0x7f22e81a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22eec00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8107650 0x7f22e81a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22eec00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22e81a4a60 0x7f22e81a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22eec00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8119b30 con 0x7f22e8107650 2024-05-08T08:39:29.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22eec00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81199b0 con 0x7f22e81a4a60 2024-05-08T08:39:29.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22eec00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8119cb0 con 0x7f22e8102050 2024-05-08T08:39:29.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22ece00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8107650 0x7f22e81a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22ece00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8107650 0x7f22e81a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35014/0 (socket says 172.21.15.70:35014) 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22ece00700 1 -- 172.21.15.70:0/1044373763 learned_addr learned my addr 172.21.15.70:0/1044373763 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.152+0000 7f22ed800700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e8102050 0x7f22e81a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.153+0000 7f22ee200700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22e81a4a60 0x7f22e81a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.153+0000 7f22ece00700 1 -- 172.21.15.70:0/1044373763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e8102050 msgr2=0x7f22e81a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.153+0000 7f22ece00700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e8102050 0x7f22e81a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.153+0000 7f22ece00700 1 -- 172.21.15.70:0/1044373763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22e81a4a60 msgr2=0x7f22e81a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.153+0000 7f22ece00700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22e81a4a60 0x7f22e81a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.153+0000 7f22ece00700 1 -- 172.21.15.70:0/1044373763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e81a5580 con 0x7f22e8107650 2024-05-08T08:39:29.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.153+0000 7f22ee200700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22e81a4a60 0x7f22e81a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:39:29.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.153+0000 7f22ece00700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8107650 0x7f22e81a06d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f22d40098e0 tx=0x7f22d4005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:39:29.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.154+0000 7f22e6000700 1 -- 172.21.15.70:0/1044373763 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4026070 con 0x7f22e8107650 2024-05-08T08:39:29.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.154+0000 7f22e6000700 1 -- 172.21.15.70:0/1044373763 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22d4021410 con 0x7f22e8107650 2024-05-08T08:39:29.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.154+0000 7f22e6000700 1 -- 172.21.15.70:0/1044373763 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4017650 con 0x7f22e8107650 2024-05-08T08:39:29.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.154+0000 7f22eec00700 1 -- 172.21.15.70:0/1044373763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e81a5810 con 0x7f22e8107650 2024-05-08T08:39:29.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.154+0000 7f22eec00700 1 -- 172.21.15.70:0/1044373763 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e81acee0 con 0x7f22e8107650 2024-05-08T08:39:29.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.159+0000 7f22e6000700 1 -- 172.21.15.70:0/1044373763 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f22d4029070 con 0x7f22e8107650 2024-05-08T08:39:29.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.162+0000 7f22e6000700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22d00b2bf0 0x7f22d00b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.162+0000 7f22e6000700 1 -- 172.21.15.70:0/1044373763 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(303..303 src has 1..303) ==== 9583+0+0 (secure 0 0 0) 0x7f22d40e35c0 con 0x7f22e8107650 2024-05-08T08:39:29.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.162+0000 7f22ed800700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22d00b2bf0 0x7f22d00b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.163+0000 7f22ed800700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22d00b2bf0 0x7f22d00b50b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009680 tx=0x7f22dc009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:39:29.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:28 smithi172 ceph-mon[33377]: pgmap v3599: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 963 KiB/s wr, 33 op/s 2024-05-08T08:39:29.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.186+0000 7f22fabc5b80 1 Processor -- start 2024-05-08T08:39:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.187+0000 7f22fabc5b80 1 -- start start 2024-05-08T08:39:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.187+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.187+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06df9e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.187+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06df9eb40 0x55f06df9efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.187+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f06def0bb0 con 0x55f06dfa3ff0 2024-05-08T08:39:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.187+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f06de8e8f0 con 0x55f06dfa4910 2024-05-08T08:39:29.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.187+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f06deecb70 con 0x55f06df9eb40 2024-05-08T08:39:29.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.188+0000 7f22ed800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.188+0000 7f22ed800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35028/0 (socket says 172.21.15.70:35028) 2024-05-08T08:39:29.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.188+0000 7f22ed800700 1 -- 172.21.15.70:0/1306830480 learned_addr learned my addr 172.21.15.70:0/1306830480 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:39:29.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.188+0000 7f22ece00700 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06df9e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.189+0000 7f22ee200700 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06df9eb40 0x55f06df9efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.189+0000 7f22ed800700 1 -- 172.21.15.70:0/1306830480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06df9eb40 msgr2=0x55f06df9efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:39:29.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.189+0000 7f22ed800700 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06df9eb40 0x55f06df9efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.189+0000 7f22ed800700 1 -- 172.21.15.70:0/1306830480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 msgr2=0x55f06df9e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:39:29.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.189+0000 7f22ed800700 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06df9e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.189+0000 7f22ed800700 1 -- 172.21.15.70:0/1306830480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f06de3da60 con 0x55f06dfa3ff0 2024-05-08T08:39:29.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.189+0000 7f22ece00700 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06df9e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:39:29.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.190+0000 7f22ed800700 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa43d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f22dc011e50 tx=0x7f22dc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e108b47082a1cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:39:29.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.191+0000 7f22daa00700 1 -- 172.21.15.70:0/1306830480 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc012d40 con 0x55f06dfa3ff0 2024-05-08T08:39:29.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.191+0000 7f22daa00700 1 -- 172.21.15.70:0/1306830480 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22dc004cc0 con 0x55f06dfa3ff0 2024-05-08T08:39:29.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.191+0000 7f22daa00700 1 -- 172.21.15.70:0/1306830480 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc01f420 con 0x55f06dfa3ff0 2024-05-08T08:39:29.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.192+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1306830480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 msgr2=0x55f06dfa43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:29.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.192+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa43d0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f22dc011e50 tx=0x7f22dc014000 comp rx=0 tx=0).stop 2024-05-08T08:39:29.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.192+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1306830480 shutdown_connections 2024-05-08T08:39:29.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.192+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06df9eb40 0x55f06df9efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.192+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa43d0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.192+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1306830480 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06df9e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.192+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1306830480 >> 172.21.15.70:0/1306830480 conn(0x55f06decccf0 msgr2=0x55f06df99080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:39:29.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.193+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1306830480 shutdown_connections 2024-05-08T08:39:29.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.193+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1306830480 wait complete. 2024-05-08T08:39:29.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.194+0000 7f22fabc5b80 1 -- start start 2024-05-08T08:39:29.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.194+0000 7f22fabc5b80 1 Processor -- start 2024-05-08T08:39:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.195+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfaa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.195+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.195+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06dfa8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.196+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f06dfab430 con 0x55f06df9eb40 2024-05-08T08:39:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.196+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f06de56cb0 con 0x55f06dfa4910 2024-05-08T08:39:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.196+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f06dfab5b0 con 0x55f06dfa3ff0 2024-05-08T08:39:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.196+0000 7f22fabc5b80 10 client.0 _ll_register_callbacks cb 0x55f06de97e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:39:29.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.196+0000 7f22ece00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.196+0000 7f22ece00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:47496/0 (socket says 172.21.15.70:47496) 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.196+0000 7f22ece00700 1 -- 172.21.15.70:0/856879567 learned_addr learned my addr 172.21.15.70:0/856879567 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.196+0000 7f22ed800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfaa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.196+0000 7f22ee200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06dfa8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.197+0000 7f22ece00700 1 -- 172.21.15.70:0/856879567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 msgr2=0x55f06dfa8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.197+0000 7f22ece00700 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06dfa8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.197+0000 7f22ece00700 1 -- 172.21.15.70:0/856879567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 msgr2=0x55f06dfaa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.197+0000 7f22ece00700 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfaa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.197+0000 7f22ece00700 1 -- 172.21.15.70:0/856879567 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f06deb65b0 con 0x55f06dfa3ff0 2024-05-08T08:39:29.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.197+0000 7f22ed800700 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfaa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:39:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.197+0000 7f22ece00700 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa7ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f22d40e08f0 tx=0x7f22d40aa110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce862c7fdb91c155 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:39:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.197+0000 7f22cf400700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T08:39:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.198+0000 7f22cf400700 1 -- 172.21.15.70:0/856879567 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d40c4060 con 0x55f06dfa3ff0 2024-05-08T08:39:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.198+0000 7f22fabc5b80 1 -- 172.21.15.70:0/856879567 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22dc004cc0 con 0x55f06dfa3ff0 2024-05-08T08:39:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.198+0000 7f22cf400700 1 -- 172.21.15.70:0/856879567 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(303..303 src has 1..303) ==== 9583+0+0 (secure 0 0 0) 0x7f22d40e3150 con 0x55f06dfa3ff0 2024-05-08T08:39:29.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.198+0000 7f22cf400700 1 -- 172.21.15.70:0/856879567 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f22d40e0d20 con 0x55f06dfa3ff0 2024-05-08T08:39:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.198+0000 7f22fabc5b80 10 client.27292 fetch_fsmap learned FSMap version 42 2024-05-08T08:39:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.198+0000 7f22fabc5b80 1 -- 172.21.15.70:0/856879567 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f06dfab490 con 0x55f06dfa3ff0 2024-05-08T08:39:29.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.199+0000 7f22cf400700 1 -- 172.21.15.70:0/856879567 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22dc004cc0 con 0x55f06dfa3ff0 2024-05-08T08:39:29.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.200+0000 7f22cf400700 1 -- 172.21.15.70:0/856879567 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f22d40aa780 con 0x55f06dfa3ff0 2024-05-08T08:39:29.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.200+0000 7f22fabc5b80 10 client.27292 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:39:29.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.200+0000 7f22fabc5b80 10 client.27292 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:39:29.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.201+0000 7f22fabc5b80 20 client.27292 populate_metadata read hostname 'smithi070' 2024-05-08T08:39:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.201+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f06dfb82b0 0x55f06dfba6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.201+0000 7f22fabc5b80 4 client.27292 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:39:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.201+0000 7f22fabc5b80 1 -- 172.21.15.70:0/856879567 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f06df6b230 con 0x55f06dfb82b0 2024-05-08T08:39:29.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.201+0000 7f22ed800700 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f06dfb82b0 0x55f06dfba6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.203+0000 7f22ed800700 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f06dfb82b0 0x55f06dfba6f0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37bcd5363db141ba server_cookie=ceb01d5f5df3c09b in_seq=0 out_seq=0 2024-05-08T08:39:29.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.203+0000 7f22cf400700 10 client.27292 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:39:29.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.205+0000 7f22cf400700 1 -- 172.21.15.70:0/856879567 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f06df6b230 con 0x55f06dfb82b0 2024-05-08T08:39:29.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.205+0000 7f22cf400700 10 client.27292 handle_command_reply: tid=0 2024-05-08T08:39:29.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.205+0000 7f22fabc5b80 1 client.27292 shutdown 2024-05-08T08:39:29.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.206+0000 7f22fabc5b80 1 -- 172.21.15.70:0/856879567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 msgr2=0x55f06dfa7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:29.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.206+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa7ad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f22d40e08f0 tx=0x7f22d40aa110 comp rx=0 tx=0).stop 2024-05-08T08:39:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.206+0000 7f22fabc5b80 1 -- 172.21.15.70:0/856879567 shutdown_connections 2024-05-08T08:39:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.206+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f06dfb82b0 0x55f06dfba6f0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.206+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06dfa8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.206+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfaa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.206+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/856879567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa7ad0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.206+0000 7f22fabc5b80 1 -- 172.21.15.70:0/856879567 >> 172.21.15.70:0/856879567 conn(0x55f06decccf0 msgr2=0x55f06df9d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:39:29.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.206+0000 7f22cf400700 0 client.27292 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:39:29.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.207+0000 7f22fabc5b80 1 -- 172.21.15.70:0/856879567 shutdown_connections 2024-05-08T08:39:29.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.207+0000 7f22fabc5b80 1 -- 172.21.15.70:0/856879567 wait complete. 2024-05-08T08:39:29.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.207+0000 7f22fabc5b80 20 client.27292 trim_cache size 0 max 16384 2024-05-08T08:39:29.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.246+0000 7f22fabc5b80 1 Processor -- start 2024-05-08T08:39:29.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.246+0000 7f22fabc5b80 1 -- start start 2024-05-08T08:39:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.247+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06df9eb40 0x55f06df99240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.247+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.247+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa4910 0x55f06dfa6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.247+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81b8700 con 0x55f06dfa3ff0 2024-05-08T08:39:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.247+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81b5f90 con 0x55f06df9eb40 2024-05-08T08:39:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.247+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81b3e00 con 0x55f06dfa4910 2024-05-08T08:39:29.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.248+0000 7f22ece00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.248+0000 7f22ed800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06df9eb40 0x55f06df99240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.248+0000 7f22ece00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35040/0 (socket says 172.21.15.70:35040) 2024-05-08T08:39:29.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.248+0000 7f22ece00700 1 -- 172.21.15.70:0/1561008125 learned_addr learned my addr 172.21.15.70:0/1561008125 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:39:29.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.248+0000 7f22ee200700 1 --2- 172.21.15.70:0/1561008125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa4910 0x55f06dfa6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.248+0000 7f22ed800700 1 -- 172.21.15.70:0/1561008125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa4910 msgr2=0x55f06dfa6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:39:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.248+0000 7f22ed800700 1 --2- 172.21.15.70:0/1561008125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa4910 0x55f06dfa6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.248+0000 7f22ed800700 1 -- 172.21.15.70:0/1561008125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 msgr2=0x55f06dfa63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:39:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.249+0000 7f22ed800700 1 --2- 172.21.15.70:0/1561008125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.249+0000 7f22ed800700 1 -- 172.21.15.70:0/1561008125 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f06df91450 con 0x55f06df9eb40 2024-05-08T08:39:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.249+0000 7f22ece00700 1 --2- 172.21.15.70:0/1561008125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:39:29.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.250+0000 7f22ed800700 1 --2- 172.21.15.70:0/1561008125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06df9eb40 0x55f06df99240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009650 tx=0x7f22dc011ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf47f9b5bf997412 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:39:29.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.250+0000 7f22da000700 1 -- 172.21.15.70:0/1561008125 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc039070 con 0x55f06df9eb40 2024-05-08T08:39:29.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.250+0000 7f22da000700 1 -- 172.21.15.70:0/1561008125 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22dc034e50 con 0x55f06df9eb40 2024-05-08T08:39:29.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.250+0000 7f22da000700 1 -- 172.21.15.70:0/1561008125 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc004970 con 0x55f06df9eb40 2024-05-08T08:39:29.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.251+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1561008125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06df9eb40 msgr2=0x55f06df99240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:29.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.251+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1561008125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06df9eb40 0x55f06df99240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009650 tx=0x7f22dc011ee0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.252+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1561008125 shutdown_connections 2024-05-08T08:39:29.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.252+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1561008125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa4910 0x55f06dfa6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.252+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1561008125 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06df9eb40 0x55f06df99240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.252+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1561008125 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06dfa3ff0 0x55f06dfa63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.252+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1561008125 >> 172.21.15.70:0/1561008125 conn(0x55f06decccf0 msgr2=0x55f06dfa7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:39:29.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.252+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1561008125 shutdown_connections 2024-05-08T08:39:29.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.252+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1561008125 wait complete. 2024-05-08T08:39:29.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.253+0000 7f22fabc5b80 1 -- start start 2024-05-08T08:39:29.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.253+0000 7f22fabc5b80 1 Processor -- start 2024-05-08T08:39:29.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.254+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfad810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.254+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfadd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.254+0000 7f22fabc5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06dfae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.254+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81b4450 con 0x55f06df9eb40 2024-05-08T08:39:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.254+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81b58c0 con 0x55f06dfa4910 2024-05-08T08:39:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.254+0000 7f22fabc5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f22e81b4b20 con 0x55f06dfa3ff0 2024-05-08T08:39:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.254+0000 7f22fabc5b80 10 client.0 _ll_register_callbacks cb 0x55f06de97e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:39:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.254+0000 7f22ed800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.255+0000 7f22ed800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfad810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35046/0 (socket says 172.21.15.70:35046) 2024-05-08T08:39:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.255+0000 7f22ed800700 1 -- 172.21.15.70:0/1859832270 learned_addr learned my addr 172.21.15.70:0/1859832270 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:39:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.255+0000 7f22ee200700 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06dfae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.254+0000 7f22ece00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfadd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.255+0000 7f22ed800700 1 -- 172.21.15.70:0/1859832270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 msgr2=0x55f06dfadd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:39:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.255+0000 7f22ed800700 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfadd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.255+0000 7f22ed800700 1 -- 172.21.15.70:0/1859832270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 msgr2=0x55f06dfae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:39:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.255+0000 7f22ed800700 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06dfae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.255+0000 7f22ed800700 1 -- 172.21.15.70:0/1859832270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f06dfb4a40 con 0x55f06df9eb40 2024-05-08T08:39:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.256+0000 7f22ee200700 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06dfae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:39:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.256+0000 7f22ed800700 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfad810 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009ac0 tx=0x7f22dc0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bd18444a162775 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:39:29.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.256+0000 7f22cf400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:39:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.256+0000 7f22cf400700 1 -- 172.21.15.70:0/1859832270 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22dc039070 con 0x55f06df9eb40 2024-05-08T08:39:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.256+0000 7f22cf400700 1 -- 172.21.15.70:0/1859832270 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(303..303 src has 1..303) ==== 9583+0+0 (secure 0 0 0) 0x7f22dc012c10 con 0x55f06df9eb40 2024-05-08T08:39:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.257+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1859832270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22dc034e50 con 0x55f06df9eb40 2024-05-08T08:39:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.257+0000 7f22cf400700 1 -- 172.21.15.70:0/1859832270 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f22dc011860 con 0x55f06df9eb40 2024-05-08T08:39:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.257+0000 7f22fabc5b80 10 client.18402 fetch_fsmap learned FSMap version 42 2024-05-08T08:39:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.257+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1859832270 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f06df959b0 con 0x55f06df9eb40 2024-05-08T08:39:29.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.258+0000 7f22cf400700 1 -- 172.21.15.70:0/1859832270 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22dc034e50 con 0x55f06df9eb40 2024-05-08T08:39:29.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.258+0000 7f22cf400700 1 -- 172.21.15.70:0/1859832270 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f22dc027600 con 0x55f06df9eb40 2024-05-08T08:39:29.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.258+0000 7f22fabc5b80 10 client.18402 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:39:29.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.258+0000 7f22fabc5b80 10 client.18402 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:39:29.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.258+0000 7f22fabc5b80 20 client.18402 populate_metadata read hostname 'smithi070' 2024-05-08T08:39:29.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.258+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f06e024150 0x55f06e026570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:39:29.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.258+0000 7f22fabc5b80 4 client.18402 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.0, "await_for": 42.0}] 2024-05-08T08:39:29.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.258+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1859832270 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.0, "await_for": 42.0}) -- 0x55f06defe590 con 0x55f06e024150 2024-05-08T08:39:29.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.259+0000 7f22ece00700 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f06e024150 0x55f06e026570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:39:29.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.260+0000 7f22ece00700 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f06e024150 0x55f06e026570 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d04ad839024b119f server_cookie=d60c9d1b540de880 in_seq=0 out_seq=0 2024-05-08T08:39:29.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:29.260+0000 7f22cf400700 10 client.18402 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:39:29.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:28 smithi194 ceph-mon[33679]: pgmap v3599: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 963 KiB/s wr, 33 op/s 2024-05-08T08:39:29.877 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/igmp.o 2024-05-08T08:39:31.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:30 smithi070 ceph-mon[29591]: pgmap v3600: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 731 KiB/s wr, 30 op/s 2024-05-08T08:39:31.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:30 smithi172 ceph-mon[33377]: pgmap v3600: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 731 KiB/s wr, 30 op/s 2024-05-08T08:39:31.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:30 smithi194 ceph-mon[33679]: pgmap v3600: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 489 KiB/s rd, 731 KiB/s wr, 30 op/s 2024-05-08T08:39:33.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:32 smithi070 ceph-mon[29591]: pgmap v3601: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T08:39:33.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:32 smithi172 ceph-mon[33377]: pgmap v3601: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T08:39:33.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:32 smithi194 ceph-mon[33679]: pgmap v3601: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T08:39:35.056 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:34 smithi194 ceph-mon[33679]: pgmap v3602: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T08:39:35.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:34 smithi070 ceph-mon[29591]: pgmap v3602: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T08:39:35.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:34 smithi172 ceph-mon[33377]: pgmap v3602: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T08:39:37.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:36 smithi070 ceph-mon[29591]: pgmap v3603: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 800 KiB/s wr, 33 op/s 2024-05-08T08:39:37.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:36 smithi172 ceph-mon[33377]: pgmap v3603: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 800 KiB/s wr, 33 op/s 2024-05-08T08:39:37.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:36 smithi194 ceph-mon[33679]: pgmap v3603: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 800 KiB/s wr, 33 op/s 2024-05-08T08:39:39.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:38 smithi070 ceph-mon[29591]: pgmap v3604: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 475 KiB/s wr, 19 op/s 2024-05-08T08:39:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:38 smithi172 ceph-mon[33377]: pgmap v3604: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 475 KiB/s wr, 19 op/s 2024-05-08T08:39:39.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:38 smithi194 ceph-mon[33679]: pgmap v3604: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 475 KiB/s wr, 19 op/s 2024-05-08T08:39:41.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:40 smithi070 ceph-mon[29591]: pgmap v3605: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 489 KiB/s wr, 29 op/s 2024-05-08T08:39:41.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:40 smithi172 ceph-mon[33377]: pgmap v3605: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 489 KiB/s wr, 29 op/s 2024-05-08T08:39:41.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:40 smithi194 ceph-mon[33679]: pgmap v3605: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 489 KiB/s wr, 29 op/s 2024-05-08T08:39:43.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:42 smithi070 ceph-mon[29591]: pgmap v3606: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 199 KiB/s wr, 17 op/s 2024-05-08T08:39:43.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:42 smithi172 ceph-mon[33377]: pgmap v3606: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 199 KiB/s wr, 17 op/s 2024-05-08T08:39:43.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:42 smithi194 ceph-mon[33679]: pgmap v3606: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 199 KiB/s wr, 17 op/s 2024-05-08T08:39:45.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:44 smithi070 ceph-mon[29591]: pgmap v3607: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 199 KiB/s wr, 17 op/s 2024-05-08T08:39:45.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:44 smithi172 ceph-mon[33377]: pgmap v3607: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 199 KiB/s wr, 17 op/s 2024-05-08T08:39:45.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:44 smithi194 ceph-mon[33679]: pgmap v3607: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 199 KiB/s wr, 17 op/s 2024-05-08T08:39:47.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:46 smithi070 ceph-mon[29591]: pgmap v3608: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 274 KiB/s wr, 21 op/s 2024-05-08T08:39:47.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:46 smithi172 ceph-mon[33377]: pgmap v3608: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 274 KiB/s wr, 21 op/s 2024-05-08T08:39:47.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:46 smithi194 ceph-mon[33679]: pgmap v3608: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 274 KiB/s wr, 21 op/s 2024-05-08T08:39:49.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:48 smithi070 ceph-mon[29591]: pgmap v3609: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 90 KiB/s wr, 13 op/s 2024-05-08T08:39:49.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:48 smithi172 ceph-mon[33377]: pgmap v3609: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 90 KiB/s wr, 13 op/s 2024-05-08T08:39:49.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:48 smithi194 ceph-mon[33679]: pgmap v3609: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 90 KiB/s wr, 13 op/s 2024-05-08T08:39:51.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:50 smithi070 ceph-mon[29591]: pgmap v3610: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 94 KiB/s wr, 17 op/s 2024-05-08T08:39:51.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:50 smithi172 ceph-mon[33377]: pgmap v3610: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 94 KiB/s wr, 17 op/s 2024-05-08T08:39:51.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:50 smithi194 ceph-mon[33679]: pgmap v3610: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 94 KiB/s wr, 17 op/s 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.677+0000 7f22cf400700 1 -- 172.21.15.70:0/1859832270 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55f06defe590 con 0x55f06e024150 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.677+0000 7f22cf400700 10 client.18402 handle_command_reply: tid=0 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.678+0000 7f22fabc5b80 1 client.18402 shutdown 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.678+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1859832270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 msgr2=0x55f06dfad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.678+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfad810 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009ac0 tx=0x7f22dc0055f0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.679+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1859832270 shutdown_connections 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.679+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f06e024150 0x55f06e026570 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.679+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f06dfa4910 0x55f06dfae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.679+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f06df9eb40 0x55f06dfad810 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.679+0000 7f22fabc5b80 1 --2- 172.21.15.70:0/1859832270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f06dfa3ff0 0x55f06dfadd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.679+0000 7f22cf400700 0 client.18402 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:39:52.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.679+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1859832270 >> 172.21.15.70:0/1859832270 conn(0x55f06decccf0 msgr2=0x55f06dfa6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:39:52.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.680+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1859832270 shutdown_connections 2024-05-08T08:39:52.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.680+0000 7f22fabc5b80 1 -- 172.21.15.70:0/1859832270 wait complete. 2024-05-08T08:39:52.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.680+0000 7f22fabc5b80 20 client.18402 trim_cache size 0 max 16384 2024-05-08T08:39:52.674 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:39:52.674 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 254, 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "ef78b669": { 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 254, 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.0, 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:39:52.675 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:39:52.676 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:39:52.676 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:39:52.676 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:39:52.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:39:52.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:39:52.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:39:52.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:39:52.676 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:39:52.676 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.682+0000 7f22eec00700 1 -- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22d00b2bf0 msgr2=0x7f22d00b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.682+0000 7f22eec00700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22d00b2bf0 0x7f22d00b50b0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f22dc009680 tx=0x7f22dc009260 comp rx=0 tx=0).stop 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.682+0000 7f22eec00700 1 -- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8107650 msgr2=0x7f22e81a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.682+0000 7f22eec00700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8107650 0x7f22e81a06d0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f22d40098e0 tx=0x7f22d4005af0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.682+0000 7f22eec00700 1 -- 172.21.15.70:0/1044373763 shutdown_connections 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.682+0000 7f22eec00700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22d00b2bf0 0x7f22d00b50b0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.683+0000 7f22eec00700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f22e81a4a60 0x7f22e81a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.683+0000 7f22eec00700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22e8102050 0x7f22e81a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.683+0000 7f22eec00700 1 --2- 172.21.15.70:0/1044373763 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22e8107650 0x7f22e81a06d0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.683+0000 7f22eec00700 1 -- 172.21.15.70:0/1044373763 >> 172.21.15.70:0/1044373763 conn(0x7f22e80fdcf0 msgr2=0x7f22e80ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:39:52.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.684+0000 7f22eec00700 1 -- 172.21.15.70:0/1044373763 shutdown_connections 2024-05-08T08:39:52.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:39:52.684+0000 7f22eec00700 1 -- 172.21.15.70:0/1044373763 wait complete. 2024-05-08T08:39:53.115 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:52 smithi070 ceph-mon[29591]: pgmap v3611: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:39:53.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:52 smithi172 ceph-mon[33377]: pgmap v3611: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:39:53.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:52 smithi194 ceph-mon[33679]: pgmap v3611: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:39:53.640 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ef78b669', quiesce took 37.7 seconds. Will release after: 27.0 2024-05-08T08:39:55.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:54 smithi070 ceph-mon[29591]: pgmap v3612: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:39:55.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:54 smithi172 ceph-mon[33377]: pgmap v3612: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:39:55.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:54 smithi194 ceph-mon[33679]: pgmap v3612: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 79 KiB/s wr, 7 op/s 2024-05-08T08:39:57.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:56 smithi070 ceph-mon[29591]: pgmap v3613: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 11 op/s 2024-05-08T08:39:57.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:39:57.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:56 smithi172 ceph-mon[33377]: pgmap v3613: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 11 op/s 2024-05-08T08:39:57.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:39:57.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:56 smithi194 ceph-mon[33679]: pgmap v3613: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 140 KiB/s wr, 11 op/s 2024-05-08T08:39:57.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:39:58.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:39:58.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:39:58.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:39:58.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:39:58.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:39:58.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:39:58.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:39:58.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:39:58.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:39:59.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:39:58 smithi070 ceph-mon[29591]: pgmap v3614: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 7 op/s 2024-05-08T08:39:59.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:39:58 smithi172 ceph-mon[33377]: pgmap v3614: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 7 op/s 2024-05-08T08:39:59.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:39:58 smithi194 ceph-mon[33679]: pgmap v3614: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 64 KiB/s wr, 7 op/s 2024-05-08T08:40:01.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:00 smithi070 ceph-mon[29591]: pgmap v3615: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 177 KiB/s wr, 12 op/s 2024-05-08T08:40:01.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T08:40:01.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:00 smithi172 ceph-mon[33377]: pgmap v3615: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 177 KiB/s wr, 12 op/s 2024-05-08T08:40:01.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T08:40:01.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:00 smithi194 ceph-mon[33679]: pgmap v3615: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 177 KiB/s wr, 12 op/s 2024-05-08T08:40:01.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T08:40:03.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:02 smithi070 ceph-mon[29591]: pgmap v3616: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2024-05-08T08:40:03.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:02 smithi172 ceph-mon[33377]: pgmap v3616: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2024-05-08T08:40:03.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:02 smithi194 ceph-mon[33679]: pgmap v3616: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2024-05-08T08:40:05.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:04 smithi070 ceph-mon[29591]: pgmap v3617: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2024-05-08T08:40:05.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:04 smithi172 ceph-mon[33377]: pgmap v3617: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2024-05-08T08:40:05.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:04 smithi194 ceph-mon[33679]: pgmap v3617: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 8 op/s 2024-05-08T08:40:07.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:06 smithi172 ceph-mon[33377]: pgmap v3618: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 223 KiB/s wr, 29 op/s 2024-05-08T08:40:07.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:06 smithi194 ceph-mon[33679]: pgmap v3618: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 223 KiB/s wr, 29 op/s 2024-05-08T08:40:07.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:06 smithi070 ceph-mon[29591]: pgmap v3618: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 223 KiB/s wr, 29 op/s 2024-05-08T08:40:08.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:07 smithi172 ceph-mon[33377]: osdmap e304: 12 total, 12 up, 12 in 2024-05-08T08:40:08.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:07 smithi194 ceph-mon[33679]: osdmap e304: 12 total, 12 up, 12 in 2024-05-08T08:40:08.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:07 smithi070 ceph-mon[29591]: osdmap e304: 12 total, 12 up, 12 in 2024-05-08T08:40:09.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:08 smithi172 ceph-mon[33377]: pgmap v3620: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 195 KiB/s wr, 30 op/s 2024-05-08T08:40:09.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:08 smithi194 ceph-mon[33679]: pgmap v3620: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 195 KiB/s wr, 30 op/s 2024-05-08T08:40:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:08 smithi070 ceph-mon[29591]: pgmap v3620: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 195 KiB/s wr, 30 op/s 2024-05-08T08:40:11.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:10 smithi172 ceph-mon[33377]: pgmap v3621: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-05-08T08:40:11.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:10 smithi194 ceph-mon[33679]: pgmap v3621: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-05-08T08:40:11.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:10 smithi070 ceph-mon[29591]: pgmap v3621: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-05-08T08:40:13.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:12 smithi194 ceph-mon[33679]: pgmap v3622: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-05-08T08:40:13.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:12 smithi070 ceph-mon[29591]: pgmap v3622: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-05-08T08:40:13.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:12 smithi172 ceph-mon[33377]: pgmap v3622: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-05-08T08:40:15.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:14 smithi194 ceph-mon[33679]: pgmap v3623: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-05-08T08:40:15.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:14 smithi194 ceph-mon[33679]: osdmap e305: 12 total, 12 up, 12 in 2024-05-08T08:40:15.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:14 smithi070 ceph-mon[29591]: pgmap v3623: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-05-08T08:40:15.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:14 smithi070 ceph-mon[29591]: osdmap e305: 12 total, 12 up, 12 in 2024-05-08T08:40:15.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:14 smithi172 ceph-mon[33377]: pgmap v3623: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 108 KiB/s wr, 29 op/s 2024-05-08T08:40:15.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:14 smithi172 ceph-mon[33377]: osdmap e305: 12 total, 12 up, 12 in 2024-05-08T08:40:17.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:16 smithi194 ceph-mon[33679]: pgmap v3625: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 8 op/s 2024-05-08T08:40:17.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:16 smithi070 ceph-mon[29591]: pgmap v3625: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 8 op/s 2024-05-08T08:40:17.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:16 smithi172 ceph-mon[33377]: pgmap v3625: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 54 KiB/s wr, 8 op/s 2024-05-08T08:40:19.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:18 smithi194 ceph-mon[33679]: pgmap v3626: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 7 op/s 2024-05-08T08:40:19.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:18 smithi070 ceph-mon[29591]: pgmap v3626: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 7 op/s 2024-05-08T08:40:19.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:18 smithi172 ceph-mon[33377]: pgmap v3626: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 7 op/s 2024-05-08T08:40:20.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:40:21.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:20 smithi070 ceph-mon[29591]: pgmap v3627: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:40:21.123 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:40:21.225 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:20 smithi172 ceph-mon[33377]: pgmap v3627: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:40:21.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:20 smithi194 ceph-mon[33679]: pgmap v3627: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:40:23.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:22 smithi070 ceph-mon[29591]: pgmap v3628: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:40:23.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:22 smithi194 ceph-mon[33679]: pgmap v3628: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:40:23.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:22 smithi172 ceph-mon[33377]: pgmap v3628: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:40:23.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.531+0000 7f230be00700 1 -- 172.21.15.70:0/475618664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c105f90 msgr2=0x7f230c112450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:23.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.531+0000 7f230be00700 1 --2- 172.21.15.70:0/475618664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c105f90 0x7f230c112450 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f230400b0d0 tx=0x7f230400b3e0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.531+0000 7f230be00700 1 -- 172.21.15.70:0/475618664 shutdown_connections 2024-05-08T08:40:23.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.531+0000 7f230be00700 1 --2- 172.21.15.70:0/475618664 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c105f90 0x7f230c112450 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.531+0000 7f230be00700 1 --2- 172.21.15.70:0/475618664 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f230c10b680 0x7f230c10ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.531+0000 7f230be00700 1 --2- 172.21.15.70:0/475618664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f230c1055d0 0x7f230c105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.531+0000 7f230be00700 1 -- 172.21.15.70:0/475618664 >> 172.21.15.70:0/475618664 conn(0x7f230c101080 msgr2=0x7f230c1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:40:23.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.531+0000 7f230be00700 1 -- 172.21.15.70:0/475618664 shutdown_connections 2024-05-08T08:40:23.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.531+0000 7f230be00700 1 -- 172.21.15.70:0/475618664 wait complete. 2024-05-08T08:40:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.532+0000 7f230be00700 1 Processor -- start 2024-05-08T08:40:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.532+0000 7f230be00700 1 -- start start 2024-05-08T08:40:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c1055d0 0x7f230c1a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f230c105f90 0x7f230c1a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f230c10b680 0x7f230c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:23.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230be00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f230c1156e0 con 0x7f230c1055d0 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230be00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f230c115560 con 0x7f230c10b680 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230be00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f230c115860 con 0x7f230c105f90 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c1055d0 0x7f230c1a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c1055d0 0x7f230c1a1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52244/0 (socket says 172.21.15.70:52244) 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230aa00700 1 -- 172.21.15.70:0/1260305089 learned_addr learned my addr 172.21.15.70:0/1260305089 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230a000700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f230c105f90 0x7f230c1a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230aa00700 1 -- 172.21.15.70:0/1260305089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f230c105f90 msgr2=0x7f230c1a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230aa00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f230c105f90 0x7f230c1a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230aa00700 1 -- 172.21.15.70:0/1260305089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f230c10b680 msgr2=0x7f230c19b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.533+0000 7f230aa00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f230c10b680 0x7f230c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.534+0000 7f230aa00700 1 -- 172.21.15.70:0/1260305089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f230c19c0a0 con 0x7f230c1055d0 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.534+0000 7f230a000700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f230c105f90 0x7f230c1a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:40:23.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.534+0000 7f230aa00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c1055d0 0x7f230c1a1780 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00d950 tx=0x7f22fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:40:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.534+0000 7f2310a00700 1 -- 172.21.15.70:0/1260305089 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc016070 con 0x7f230c1055d0 2024-05-08T08:40:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.534+0000 7f2310a00700 1 -- 172.21.15.70:0/1260305089 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f22fc010460 con 0x7f230c1055d0 2024-05-08T08:40:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.534+0000 7f2310a00700 1 -- 172.21.15.70:0/1260305089 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22fc00f620 con 0x7f230c1055d0 2024-05-08T08:40:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.534+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f230c19c390 con 0x7f230c1055d0 2024-05-08T08:40:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.534+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f230c1a8650 con 0x7f230c1055d0 2024-05-08T08:40:23.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.536+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f230c06a190 con 0x7f230c1055d0 2024-05-08T08:40:23.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.538+0000 7f2310a00700 1 -- 172.21.15.70:0/1260305089 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f22fc019070 con 0x7f230c1055d0 2024-05-08T08:40:23.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.539+0000 7f2310a00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22f00b2a70 0x7f22f00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:23.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.540+0000 7f2310a00700 1 -- 172.21.15.70:0/1260305089 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(305..305 src has 1..305) ==== 9583+0+0 (secure 0 0 0) 0x7f22fc0e2660 con 0x7f230c1055d0 2024-05-08T08:40:23.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.540+0000 7f230a000700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22f00b2a70 0x7f22f00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:23.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.541+0000 7f230a000700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22f00b2a70 0x7f22f00b4f30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f22f8005fd0 tx=0x7f22f8005dc0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:40:23.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.542+0000 7f2310a00700 1 -- 172.21.15.70:0/1260305089 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f22fc0a9bc0 con 0x7f230c1055d0 2024-05-08T08:40:23.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.825+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f230c02e510 con 0x7f230c1055d0 2024-05-08T08:40:23.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.827+0000 7f2310a00700 1 -- 172.21.15.70:0/1260305089 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f22fc0a94c0 con 0x7f230c1055d0 2024-05-08T08:40:23.820 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:40:23.821 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:40:23.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22f00b2a70 msgr2=0x7f22f00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:23.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22f00b2a70 0x7f22f00b4f30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f22f8005fd0 tx=0x7f22f8005dc0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c1055d0 msgr2=0x7f230c1a1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:23.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c1055d0 0x7f230c1a1780 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00d950 tx=0x7f22fc00dd10 comp rx=0 tx=0).stop 2024-05-08T08:40:23.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 shutdown_connections 2024-05-08T08:40:23.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f22f00b2a70 0x7f22f00b4f30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f230c10b680 0x7f230c19b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f230c1055d0 0x7f230c1a1780 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 --2- 172.21.15.70:0/1260305089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f230c105f90 0x7f230c1a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:23.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.830+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 >> 172.21.15.70:0/1260305089 conn(0x7f230c101080 msgr2=0x7f230c102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:40:23.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.831+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 shutdown_connections 2024-05-08T08:40:23.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:23.831+0000 7f230be00700 1 -- 172.21.15.70:0/1260305089 wait complete. 2024-05-08T08:40:23.826 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:40:24.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:23 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1260305089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:40:24.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:23 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1260305089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:40:24.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:23 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1260305089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:40:24.623 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id ef78b669 --release --await' 2024-05-08T08:40:24.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id ef78b669 --release --await 2024-05-08T08:40:25.099 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:40:25.250 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:24 smithi070 ceph-mon[29591]: pgmap v3629: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:40:25.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:24 smithi194 ceph-mon[33679]: pgmap v3629: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:40:25.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:24 smithi172 ceph-mon[33377]: pgmap v3629: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 6 op/s 2024-05-08T08:40:27.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:26 smithi070 ceph-mon[29591]: pgmap v3630: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:40:27.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:26 smithi194 ceph-mon[33679]: pgmap v3630: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:40:27.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:26 smithi172 ceph-mon[33377]: pgmap v3630: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 5 op/s 2024-05-08T08:40:27.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.760+0000 7f15a2000700 1 -- 172.21.15.70:0/1936710000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c1055d0 msgr2=0x7f159c105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:27.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.760+0000 7f15a2000700 1 --2- 172.21.15.70:0/1936710000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c1055d0 0x7f159c105a50 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f1588009990 tx=0x7f1588009ca0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.760+0000 7f15a2000700 1 -- 172.21.15.70:0/1936710000 shutdown_connections 2024-05-08T08:40:27.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.760+0000 7f15a2000700 1 --2- 172.21.15.70:0/1936710000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c105f90 0x7f159c1124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.760+0000 7f15a2000700 1 --2- 172.21.15.70:0/1936710000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f159c10b660 0x7f159c10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.760+0000 7f15a2000700 1 --2- 172.21.15.70:0/1936710000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c1055d0 0x7f159c105a50 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.760+0000 7f15a2000700 1 -- 172.21.15.70:0/1936710000 >> 172.21.15.70:0/1936710000 conn(0x7f159c1010c0 msgr2=0x7f159c1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:40:27.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.760+0000 7f15a2000700 1 -- 172.21.15.70:0/1936710000 shutdown_connections 2024-05-08T08:40:27.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.760+0000 7f15a2000700 1 -- 172.21.15.70:0/1936710000 wait complete. 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.761+0000 7f15a2000700 1 Processor -- start 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.761+0000 7f15a2000700 1 -- start start 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.761+0000 7f15a2000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f159c1055d0 0x7f159c1a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.761+0000 7f15a2000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c105f90 0x7f159c1a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.761+0000 7f15a2000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c10b660 0x7f159c19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a2000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f159c1156d0 con 0x7f159c10b660 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a2000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f159c115550 con 0x7f159c1055d0 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a2000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f159c115850 con 0x7f159c105f90 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c10b660 0x7f159c19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c10b660 0x7f159c19b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34262/0 (socket says 172.21.15.70:34262) 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a1600700 1 -- 172.21.15.70:0/508275573 learned_addr learned my addr 172.21.15.70:0/508275573 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f159be00700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c105f90 0x7f159c1a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a0c00700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f159c1055d0 0x7f159c1a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a1600700 1 -- 172.21.15.70:0/508275573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c105f90 msgr2=0x7f159c1a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a1600700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c105f90 0x7f159c1a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a1600700 1 -- 172.21.15.70:0/508275573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f159c1055d0 msgr2=0x7f159c1a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a1600700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f159c1055d0 0x7f159c1a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.762+0000 7f15a1600700 1 -- 172.21.15.70:0/508275573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159c19c070 con 0x7f159c10b660 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.763+0000 7f159be00700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c105f90 0x7f159c1a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:40:27.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.763+0000 7f15a0c00700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f159c1055d0 0x7f159c1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:40:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.763+0000 7f15a1600700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c10b660 0x7f159c19b910 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f159400ada0 tx=0x7f159400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:40:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.763+0000 7f1599600700 1 -- 172.21.15.70:0/508275573 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594017020 con 0x7f159c10b660 2024-05-08T08:40:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.763+0000 7f1599600700 1 -- 172.21.15.70:0/508275573 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f159400ce10 con 0x7f159c10b660 2024-05-08T08:40:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.763+0000 7f1599600700 1 -- 172.21.15.70:0/508275573 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1594005440 con 0x7f159c10b660 2024-05-08T08:40:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.763+0000 7f15a2000700 1 -- 172.21.15.70:0/508275573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159c19c360 con 0x7f159c10b660 2024-05-08T08:40:27.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.763+0000 7f15a2000700 1 -- 172.21.15.70:0/508275573 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f159c1a8620 con 0x7f159c10b660 2024-05-08T08:40:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.767+0000 7f1599600700 1 -- 172.21.15.70:0/508275573 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1594004ad0 con 0x7f159c10b660 2024-05-08T08:40:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.768+0000 7f1599600700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15840b2a70 0x7f15840b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.769+0000 7f1599600700 1 -- 172.21.15.70:0/508275573 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(305..305 src has 1..305) ==== 9583+0+0 (secure 0 0 0) 0x7f15940e2240 con 0x7f159c10b660 2024-05-08T08:40:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.769+0000 7f15a0c00700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15840b2a70 0x7f15840b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.769+0000 7f15a0c00700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15840b2a70 0x7f15840b4f30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1590005fd0 tx=0x7f1590005e60 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:40:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.789+0000 7f15ae05eb80 1 Processor -- start 2024-05-08T08:40:27.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.789+0000 7f15ae05eb80 1 -- start start 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.789+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc8f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.789+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dc89490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.789+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc89f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.789+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd6dbdbb20 con 0x55fd6dc8f880 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.789+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fd6db79860 con 0x55fd6dc89ab0 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.789+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fd6dbd7ae0 con 0x55fd6dc8ef60 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f159be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dc89490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f159be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dc89490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34278/0 (socket says 172.21.15.70:34278) 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f159be00700 1 -- 172.21.15.70:0/3778807 learned_addr learned my addr 172.21.15.70:0/3778807 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f15a0c00700 1 --2- 172.21.15.70:0/3778807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc8f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f15a1600700 1 --2- 172.21.15.70:0/3778807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc89f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f159be00700 1 -- 172.21.15.70:0/3778807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8ef60 msgr2=0x55fd6dc8f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:40:27.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f159be00700 1 --2- 172.21.15.70:0/3778807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc8f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f159be00700 1 -- 172.21.15.70:0/3778807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc89ab0 msgr2=0x55fd6dc89f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:40:27.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f159be00700 1 --2- 172.21.15.70:0/3778807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc89f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.790+0000 7f159be00700 1 -- 172.21.15.70:0/3778807 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd6db289d0 con 0x55fd6dc8f880 2024-05-08T08:40:27.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.791+0000 7f159be00700 1 --2- 172.21.15.70:0/3778807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dc89490 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f15880096d0 tx=0x7f1588009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a749e8edad9195f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:40:27.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.791+0000 7f158e000700 1 -- 172.21.15.70:0/3778807 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588026070 con 0x55fd6dc8f880 2024-05-08T08:40:27.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.791+0000 7f158e000700 1 -- 172.21.15.70:0/3778807 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1588005630 con 0x55fd6dc8f880 2024-05-08T08:40:27.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.791+0000 7f158e000700 1 -- 172.21.15.70:0/3778807 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158800ba30 con 0x55fd6dc8f880 2024-05-08T08:40:27.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.792+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3778807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 msgr2=0x55fd6dc89490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:27.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.792+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3778807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dc89490 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f15880096d0 tx=0x7f1588009700 comp rx=0 tx=0).stop 2024-05-08T08:40:27.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.792+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3778807 shutdown_connections 2024-05-08T08:40:27.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.792+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3778807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc89f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.792+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3778807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc8f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.792+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3778807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dc89490 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.792+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3778807 >> 172.21.15.70:0/3778807 conn(0x55fd6dbb7c60 msgr2=0x55fd6dc83ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:40:27.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.792+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3778807 shutdown_connections 2024-05-08T08:40:27.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.792+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3778807 wait complete. 2024-05-08T08:40:27.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.793+0000 7f15ae05eb80 1 -- start start 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.793+0000 7f15ae05eb80 1 Processor -- start 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc955c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc92960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 0x55fd6dc92ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd6dc96340 con 0x55fd6dc89ab0 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fd6db41c20 con 0x55fd6dc8ef60 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fd6dc964c0 con 0x55fd6dc8f880 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15ae05eb80 10 client.0 _ll_register_callbacks cb 0x55fd6db82d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15a0c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc955c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15a0c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc955c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34280/0 (socket says 172.21.15.70:34280) 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.794+0000 7f15a0c00700 1 -- 172.21.15.70:0/1860663565 learned_addr learned my addr 172.21.15.70:0/1860663565 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.795+0000 7f15a1600700 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 0x55fd6dc92ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.795+0000 7f159be00700 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc92960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.795+0000 7f15a0c00700 1 -- 172.21.15.70:0/1860663565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 msgr2=0x55fd6dc92ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:40:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.795+0000 7f15a0c00700 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 0x55fd6dc92ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.795+0000 7f15a0c00700 1 -- 172.21.15.70:0/1860663565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 msgr2=0x55fd6dc92960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:40:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.795+0000 7f15a0c00700 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc92960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.795+0000 7f15a0c00700 1 -- 172.21.15.70:0/1860663565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd6dba1520 con 0x55fd6dc89ab0 2024-05-08T08:40:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.795+0000 7f15a0c00700 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc955c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f159000f770 tx=0x7f1590004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1bd2932acc68a32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:40:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.795+0000 7f1582a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:40:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.796+0000 7f1582a00700 1 -- 172.21.15.70:0/1860663565 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590004220 con 0x55fd6dc89ab0 2024-05-08T08:40:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.796+0000 7f1582a00700 1 -- 172.21.15.70:0/1860663565 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(305..305 src has 1..305) ==== 9583+0+0 (secure 0 0 0) 0x7f15900043c0 con 0x55fd6dc89ab0 2024-05-08T08:40:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.796+0000 7f15ae05eb80 1 -- 172.21.15.70:0/1860663565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1588005630 con 0x55fd6dc89ab0 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.796+0000 7f1582a00700 1 -- 172.21.15.70:0/1860663565 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f159002d050 con 0x55fd6dc89ab0 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.796+0000 7f15ae05eb80 10 client.18420 fetch_fsmap learned FSMap version 42 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.796+0000 7f15ae05eb80 1 -- 172.21.15.70:0/1860663565 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fd6dca0c30 con 0x55fd6dc89ab0 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.796+0000 7f1582a00700 1 -- 172.21.15.70:0/1860663565 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1588005630 con 0x55fd6dc89ab0 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.797+0000 7f1582a00700 1 -- 172.21.15.70:0/1860663565 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f159001d5f0 con 0x55fd6dc89ab0 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.797+0000 7f15ae05eb80 10 client.18420 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.797+0000 7f15ae05eb80 10 client.18420 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.797+0000 7f15ae05eb80 20 client.18420 populate_metadata read hostname 'smithi070' 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.797+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd6dca32c0 0x55fd6dca56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.797+0000 7f15ae05eb80 4 client.18420 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.797+0000 7f15ae05eb80 1 -- 172.21.15.70:0/1860663565 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd6dc561a0 con 0x55fd6dca32c0 2024-05-08T08:40:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.798+0000 7f159be00700 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd6dca32c0 0x55fd6dca56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.799+0000 7f159be00700 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd6dca32c0 0x55fd6dca56b0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8932b2f91a3f7f40 server_cookie=8e3b2375e03fff8c in_seq=0 out_seq=0 2024-05-08T08:40:27.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.799+0000 7f1582a00700 10 client.18420 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:40:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.800+0000 7f1582a00700 1 -- 172.21.15.70:0/1860663565 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fd6dc561a0 con 0x55fd6dca32c0 2024-05-08T08:40:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.800+0000 7f1582a00700 10 client.18420 handle_command_reply: tid=0 2024-05-08T08:40:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.800+0000 7f15ae05eb80 1 client.18420 shutdown 2024-05-08T08:40:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 -- 172.21.15.70:0/1860663565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 msgr2=0x55fd6dc955c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc955c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f159000f770 tx=0x7f1590004750 comp rx=0 tx=0).stop 2024-05-08T08:40:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 -- 172.21.15.70:0/1860663565 shutdown_connections 2024-05-08T08:40:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd6dca32c0 0x55fd6dca56b0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 0x55fd6dc92ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc955c0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/1860663565 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc92960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f1582a00700 0 client.18420 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:40:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 -- 172.21.15.70:0/1860663565 >> 172.21.15.70:0/1860663565 conn(0x55fd6dbb7c60 msgr2=0x55fd6dc88480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:40:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 -- 172.21.15.70:0/1860663565 shutdown_connections 2024-05-08T08:40:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 1 -- 172.21.15.70:0/1860663565 wait complete. 2024-05-08T08:40:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.801+0000 7f15ae05eb80 20 client.18420 trim_cache size 0 max 16384 2024-05-08T08:40:27.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.823+0000 7f15ae05eb80 1 Processor -- start 2024-05-08T08:40:27.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.823+0000 7f15ae05eb80 1 -- start start 2024-05-08T08:40:27.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.823+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.823+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dcaafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.823+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dcab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.823+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f159c1b3e70 con 0x55fd6dc8f880 2024-05-08T08:40:27.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.823+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f159c1b1700 con 0x55fd6dc8ef60 2024-05-08T08:40:27.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.823+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f159c1af570 con 0x55fd6dc89ab0 2024-05-08T08:40:27.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f15a1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dcab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f15a1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dcab500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34292/0 (socket says 172.21.15.70:34292) 2024-05-08T08:40:27.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f15a1600700 1 -- 172.21.15.70:0/3971247884 learned_addr learned my addr 172.21.15.70:0/3971247884 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:40:27.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f159be00700 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dcaafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f15a0c00700 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f15a1600700 1 -- 172.21.15.70:0/3971247884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc89ab0 msgr2=0x55fd6dc9f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f15a1600700 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f15a1600700 1 -- 172.21.15.70:0/3971247884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 msgr2=0x55fd6dcaafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f15a1600700 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dcaafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f15a1600700 1 -- 172.21.15.70:0/3971247884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd6dc7e2c0 con 0x55fd6dc8f880 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.824+0000 7f159be00700 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dcaafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.825+0000 7f15a1600700 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dcab500 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f159400ad70 tx=0x7f15940a8c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c106dde6cf8c6e9d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.825+0000 7f158d600700 1 -- 172.21.15.70:0/3971247884 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940c3070 con 0x55fd6dc8f880 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.825+0000 7f158d600700 1 -- 172.21.15.70:0/3971247884 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15940ad4e0 con 0x55fd6dc8f880 2024-05-08T08:40:27.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.825+0000 7f158d600700 1 -- 172.21.15.70:0/3971247884 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15940a95f0 con 0x55fd6dc8f880 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3971247884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 msgr2=0x55fd6dcab500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dcab500 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f159400ad70 tx=0x7f15940a8c40 comp rx=0 tx=0).stop 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3971247884 shutdown_connections 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc8f880 0x55fd6dcab500 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3971247884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dcaafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3971247884 >> 172.21.15.70:0/3971247884 conn(0x55fd6dbb7c60 msgr2=0x55fd6dc91270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3971247884 shutdown_connections 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3971247884 wait complete. 2024-05-08T08:40:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 -- start start 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.826+0000 7f15ae05eb80 1 Processor -- start 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc98720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15ae05eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 0x55fd6dc98c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f159c1afbc0 con 0x55fd6dc89ab0 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f159c1b1030 con 0x55fd6dc8ef60 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15ae05eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f159c1b0290 con 0x55fd6dc8f880 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15ae05eb80 10 client.0 _ll_register_callbacks cb 0x55fd6db82d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15a0c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15a0c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34308/0 (socket says 172.21.15.70:34308) 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.827+0000 7f15a0c00700 1 -- 172.21.15.70:0/3424174271 learned_addr learned my addr 172.21.15.70:0/3424174271 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f15a1600700 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 0x55fd6dc98c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f15a0c00700 1 -- 172.21.15.70:0/3424174271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 msgr2=0x55fd6dc98c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f15a0c00700 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 0x55fd6dc98c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f15a0c00700 1 -- 172.21.15.70:0/3424174271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 msgr2=0x55fd6dc98720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f15a0c00700 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc98720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f15a0c00700 1 -- 172.21.15.70:0/3424174271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd6dc99450 con 0x55fd6dc89ab0 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f15a1600700 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 0x55fd6dc98c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f15a0c00700 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9bc20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f159000d6a0 tx=0x7f159001dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5355848ad98ccd42 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f1582a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f1582a00700 1 -- 172.21.15.70:0/3424174271 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590004030 con 0x55fd6dc89ab0 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f1582a00700 1 -- 172.21.15.70:0/3424174271 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(305..305 src has 1..305) ==== 9583+0+0 (secure 0 0 0) 0x7f15900041d0 con 0x55fd6dc89ab0 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.828+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3424174271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15940ad4e0 con 0x55fd6dc89ab0 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f1582a00700 1 -- 172.21.15.70:0/3424174271 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f15900043d0 con 0x55fd6dc89ab0 2024-05-08T08:40:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f15ae05eb80 10 client.18426 fetch_fsmap learned FSMap version 42 2024-05-08T08:40:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3424174271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fd6dd17370 con 0x55fd6dc89ab0 2024-05-08T08:40:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f1582a00700 1 -- 172.21.15.70:0/3424174271 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15940ad4e0 con 0x55fd6dc89ab0 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f1582a00700 1 -- 172.21.15.70:0/3424174271 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f159003a410 con 0x55fd6dc89ab0 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f15ae05eb80 10 client.18426 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f15ae05eb80 10 client.18426 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f15ae05eb80 20 client.18426 populate_metadata read hostname 'smithi070' 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd6dd17ab0 0x55fd6dd19ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f15ae05eb80 4 client.18426 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ef78b669", "release": true, "await": true}] 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.829+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3424174271 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ef78b669", "release": true, "await": true}) -- 0x55fd6dbe9500 con 0x55fd6dd17ab0 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.830+0000 7f159be00700 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd6dd17ab0 0x55fd6dd19ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.831+0000 7f159be00700 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd6dd17ab0 0x55fd6dd19ed0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a665c4022cba6673 server_cookie=a349a731e3db5d7d in_seq=0 out_seq=0 2024-05-08T08:40:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:27.831+0000 7f1582a00700 10 client.18426 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:40:29.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:28 smithi194 ceph-mon[33679]: pgmap v3631: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 5 op/s 2024-05-08T08:40:29.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:28 smithi070 ceph-mon[29591]: pgmap v3631: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 5 op/s 2024-05-08T08:40:29.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:28 smithi172 ceph-mon[33377]: pgmap v3631: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 5 op/s 2024-05-08T08:40:31.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:30 smithi194 ceph-mon[33679]: pgmap v3632: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-05-08T08:40:31.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:30 smithi070 ceph-mon[29591]: pgmap v3632: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-05-08T08:40:31.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:30 smithi172 ceph-mon[33377]: pgmap v3632: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 33 KiB/s wr, 8 op/s 2024-05-08T08:40:32.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.390+0000 7f1582a00700 1 -- 172.21.15.70:0/3424174271 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55fd6dbe9500 con 0x55fd6dd17ab0 2024-05-08T08:40:32.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.390+0000 7f1582a00700 10 client.18426 handle_command_reply: tid=0 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.392+0000 7f15ae05eb80 1 client.18426 shutdown 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.393+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3424174271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 msgr2=0x55fd6dc9bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.393+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9bc20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f159000d6a0 tx=0x7f159001dc30 comp rx=0 tx=0).stop 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.393+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3424174271 shutdown_connections 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.393+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fd6dd17ab0 0x55fd6dd19ed0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.393+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fd6dc8f880 0x55fd6dc98c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.393+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd6dc89ab0 0x55fd6dc9bc20 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.393+0000 7f15ae05eb80 1 --2- 172.21.15.70:0/3424174271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fd6dc8ef60 0x55fd6dc98720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.393+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3424174271 >> 172.21.15.70:0/3424174271 conn(0x55fd6dbb7c60 msgr2=0x55fd6dc8fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:40:32.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.394+0000 7f1582a00700 0 client.18426 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:40:32.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.395+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3424174271 shutdown_connections 2024-05-08T08:40:32.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.396+0000 7f15ae05eb80 1 -- 172.21.15.70:0/3424174271 wait complete. 2024-05-08T08:40:32.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.397+0000 7f15ae05eb80 20 client.18426 trim_cache size 0 max 16384 2024-05-08T08:40:32.394 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 256, 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "ef78b669": { 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 256, 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:40:32.395 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.0, 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:40:32.396 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.402+0000 7f15a2000700 1 -- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15840b2a70 msgr2=0x7f15840b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.403+0000 7f15a2000700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15840b2a70 0x7f15840b4f30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1590005fd0 tx=0x7f1590005e60 comp rx=0 tx=0).stop 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.403+0000 7f15a2000700 1 -- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c10b660 msgr2=0x7f159c19b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.403+0000 7f15a2000700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c10b660 0x7f159c19b910 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f159400ada0 tx=0x7f159400c330 comp rx=0 tx=0).stop 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.403+0000 7f15a2000700 1 -- 172.21.15.70:0/508275573 shutdown_connections 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.403+0000 7f15a2000700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15840b2a70 0x7f15840b4f30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.403+0000 7f15a2000700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f159c10b660 0x7f159c19b910 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.403+0000 7f15a2000700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f159c1055d0 0x7f159c1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.403+0000 7f15a2000700 1 --2- 172.21.15.70:0/508275573 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f159c105f90 0x7f159c1a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:40:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.403+0000 7f15a2000700 1 -- 172.21.15.70:0/508275573 >> 172.21.15.70:0/508275573 conn(0x7f159c1010c0 msgr2=0x7f159c1026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:40:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.404+0000 7f15a2000700 1 -- 172.21.15.70:0/508275573 shutdown_connections 2024-05-08T08:40:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:40:32.404+0000 7f15a2000700 1 -- 172.21.15.70:0/508275573 wait complete. 2024-05-08T08:40:32.992 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:33 smithi070 ceph-mon[29591]: pgmap v3633: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 5 op/s 2024-05-08T08:40:33.237 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ef78b669', seconds elapsed: 77.3 2024-05-08T08:40:33.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:33 smithi194 ceph-mon[33679]: pgmap v3633: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 5 op/s 2024-05-08T08:40:33.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:33 smithi172 ceph-mon[33377]: pgmap v3633: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 5 op/s 2024-05-08T08:40:33.888 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpica/utxfmutex.o 2024-05-08T08:40:34.148 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/svcauth.o 2024-05-08T08:40:34.280 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/xfrm6_policy.o 2024-05-08T08:40:34.732 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/fib_frontend.o 2024-05-08T08:40:35.120 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/timerfd.o 2024-05-08T08:40:35.246 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/fils_aead.o 2024-05-08T08:40:35.300 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:35 smithi194 ceph-mon[33679]: pgmap v3634: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 5 op/s 2024-05-08T08:40:35.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:35 smithi070 ceph-mon[29591]: pgmap v3634: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 5 op/s 2024-05-08T08:40:35.376 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlabel/netlabel_kapi.o 2024-05-08T08:40:35.408 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlabel/netlabel_domainhash.o 2024-05-08T08:40:35.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:35 smithi172 ceph-mon[33377]: pgmap v3634: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 5 op/s 2024-05-08T08:40:37.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:37 smithi194 ceph-mon[33679]: pgmap v3635: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 127 KiB/s wr, 13 op/s 2024-05-08T08:40:37.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:37 smithi070 ceph-mon[29591]: pgmap v3635: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 127 KiB/s wr, 13 op/s 2024-05-08T08:40:37.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:37 smithi172 ceph-mon[33377]: pgmap v3635: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 127 KiB/s wr, 13 op/s 2024-05-08T08:40:39.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:39 smithi070 ceph-mon[29591]: pgmap v3636: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 127 KiB/s wr, 11 op/s 2024-05-08T08:40:39.421 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:39 smithi172 ceph-mon[33377]: pgmap v3636: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 127 KiB/s wr, 11 op/s 2024-05-08T08:40:39.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:39 smithi194 ceph-mon[33679]: pgmap v3636: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 127 KiB/s wr, 11 op/s 2024-05-08T08:40:40.517 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/acpi/acpica/built-in.a 2024-05-08T08:40:41.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:41 smithi070 ceph-mon[29591]: pgmap v3637: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 400 KiB/s wr, 18 op/s 2024-05-08T08:40:41.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:41 smithi172 ceph-mon[33377]: pgmap v3637: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 400 KiB/s wr, 18 op/s 2024-05-08T08:40:41.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:41 smithi194 ceph-mon[33679]: pgmap v3637: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 400 KiB/s wr, 18 op/s 2024-05-08T08:40:43.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:43 smithi194 ceph-mon[33679]: pgmap v3638: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 390 KiB/s wr, 15 op/s 2024-05-08T08:40:43.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:43 smithi070 ceph-mon[29591]: pgmap v3638: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 390 KiB/s wr, 15 op/s 2024-05-08T08:40:43.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:43 smithi172 ceph-mon[33377]: pgmap v3638: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 390 KiB/s wr, 15 op/s 2024-05-08T08:40:44.373 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/eventfd.o 2024-05-08T08:40:45.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:45 smithi070 ceph-mon[29591]: pgmap v3639: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 390 KiB/s wr, 15 op/s 2024-05-08T08:40:45.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:45 smithi172 ceph-mon[33377]: pgmap v3639: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 390 KiB/s wr, 15 op/s 2024-05-08T08:40:45.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:45 smithi194 ceph-mon[33679]: pgmap v3639: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 390 KiB/s wr, 15 op/s 2024-05-08T08:40:46.915 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/xfrm6_state.o 2024-05-08T08:40:46.979 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/cfg.o 2024-05-08T08:40:47.101 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/svcauth_unix.o 2024-05-08T08:40:47.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:47 smithi070 ceph-mon[29591]: pgmap v3640: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 634 KiB/s wr, 27 op/s 2024-05-08T08:40:47.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:47 smithi172 ceph-mon[33377]: pgmap v3640: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 634 KiB/s wr, 27 op/s 2024-05-08T08:40:47.478 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/xfrm6_input.o 2024-05-08T08:40:47.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:47 smithi194 ceph-mon[33679]: pgmap v3640: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 634 KiB/s wr, 27 op/s 2024-05-08T08:40:48.011 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlabel/netlabel_addrlist.o 2024-05-08T08:40:48.383 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/fib_semantics.o 2024-05-08T08:40:49.351 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/tables.o 2024-05-08T08:40:49.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:49 smithi070 ceph-mon[29591]: pgmap v3641: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 517 KiB/s wr, 19 op/s 2024-05-08T08:40:49.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:49 smithi172 ceph-mon[33377]: pgmap v3641: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 517 KiB/s wr, 19 op/s 2024-05-08T08:40:49.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:49 smithi194 ceph-mon[33679]: pgmap v3641: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 487 KiB/s rd, 517 KiB/s wr, 19 op/s 2024-05-08T08:40:51.003 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:50 smithi194 ceph-mon[33679]: pgmap v3642: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 860 KiB/s wr, 36 op/s 2024-05-08T08:40:51.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:50 smithi070 ceph-mon[29591]: pgmap v3642: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 860 KiB/s wr, 36 op/s 2024-05-08T08:40:51.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:50 smithi172 ceph-mon[33377]: pgmap v3642: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 860 KiB/s wr, 36 op/s 2024-05-08T08:40:53.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:52 smithi070 ceph-mon[29591]: pgmap v3643: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 588 KiB/s wr, 29 op/s 2024-05-08T08:40:53.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:52 smithi172 ceph-mon[33377]: pgmap v3643: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 588 KiB/s wr, 29 op/s 2024-05-08T08:40:53.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:52 smithi194 ceph-mon[33679]: pgmap v3643: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 588 KiB/s wr, 29 op/s 2024-05-08T08:40:53.875 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/aio.o 2024-05-08T08:40:55.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:54 smithi070 ceph-mon[29591]: pgmap v3644: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 588 KiB/s wr, 29 op/s 2024-05-08T08:40:55.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:54 smithi172 ceph-mon[33377]: pgmap v3644: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 588 KiB/s wr, 29 op/s 2024-05-08T08:40:55.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:54 smithi194 ceph-mon[33679]: pgmap v3644: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 588 KiB/s wr, 29 op/s 2024-05-08T08:40:57.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:56 smithi070 ceph-mon[29591]: pgmap v3645: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 779 KiB/s wr, 41 op/s 2024-05-08T08:40:57.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:56 smithi172 ceph-mon[33377]: pgmap v3645: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 779 KiB/s wr, 41 op/s 2024-05-08T08:40:57.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:56 smithi194 ceph-mon[33679]: pgmap v3645: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 779 KiB/s wr, 41 op/s 2024-05-08T08:40:59.024 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/rfkill/core.o 2024-05-08T08:40:59.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:58 smithi070 ceph-mon[29591]: pgmap v3646: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 535 KiB/s wr, 29 op/s 2024-05-08T08:40:59.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:40:59.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:58 smithi172 ceph-mon[33377]: pgmap v3646: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 535 KiB/s wr, 29 op/s 2024-05-08T08:40:59.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:40:59.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:58 smithi194 ceph-mon[33679]: pgmap v3646: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 535 KiB/s wr, 29 op/s 2024-05-08T08:40:59.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:41:00.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:41:00.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:41:00.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:40:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:41:00.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:41:00.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:41:00.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:40:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:41:00.173 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/addr.o 2024-05-08T08:41:00.205 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlabel/netlabel_mgmt.o 2024-05-08T08:41:00.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:41:00.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:41:00.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:40:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:41:00.455 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/blacklist.o 2024-05-08T08:41:00.573 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/ethtool.o 2024-05-08T08:41:00.651 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/xfrm6_output.o 2024-05-08T08:41:01.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:00 smithi070 ceph-mon[29591]: pgmap v3647: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 892 KiB/s wr, 38 op/s 2024-05-08T08:41:01.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:00 smithi172 ceph-mon[33377]: pgmap v3647: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 892 KiB/s wr, 38 op/s 2024-05-08T08:41:01.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:00 smithi194 ceph-mon[33679]: pgmap v3647: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 892 KiB/s wr, 38 op/s 2024-05-08T08:41:03.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:02 smithi070 ceph-mon[29591]: pgmap v3648: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 548 KiB/s wr, 20 op/s 2024-05-08T08:41:03.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:02 smithi172 ceph-mon[33377]: pgmap v3648: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 548 KiB/s wr, 20 op/s 2024-05-08T08:41:03.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:02 smithi194 ceph-mon[33679]: pgmap v3648: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 548 KiB/s wr, 20 op/s 2024-05-08T08:41:05.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:04 smithi070 ceph-mon[29591]: pgmap v3649: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 549 KiB/s wr, 20 op/s 2024-05-08T08:41:05.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:04 smithi172 ceph-mon[33377]: pgmap v3649: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 549 KiB/s wr, 20 op/s 2024-05-08T08:41:05.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:04 smithi194 ceph-mon[33679]: pgmap v3649: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 549 KiB/s wr, 20 op/s 2024-05-08T08:41:05.595 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/fib_trie.o 2024-05-08T08:41:06.111 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/locks.o 2024-05-08T08:41:07.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:06 smithi070 ceph-mon[29591]: pgmap v3650: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 862 KiB/s wr, 50 op/s 2024-05-08T08:41:07.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:06 smithi172 ceph-mon[33377]: pgmap v3650: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 862 KiB/s wr, 50 op/s 2024-05-08T08:41:07.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:06 smithi194 ceph-mon[33679]: pgmap v3650: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 862 KiB/s wr, 50 op/s 2024-05-08T08:41:08.176 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/rfkill/input.o 2024-05-08T08:41:08.523 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/osi.o 2024-05-08T08:41:09.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:08 smithi070 ceph-mon[29591]: pgmap v3651: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 671 KiB/s wr, 39 op/s 2024-05-08T08:41:09.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:08 smithi070 ceph-mon[29591]: osdmap e306: 12 total, 12 up, 12 in 2024-05-08T08:41:09.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:08 smithi172 ceph-mon[33377]: pgmap v3651: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 671 KiB/s wr, 39 op/s 2024-05-08T08:41:09.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:08 smithi172 ceph-mon[33377]: osdmap e306: 12 total, 12 up, 12 in 2024-05-08T08:41:09.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:08 smithi194 ceph-mon[33679]: pgmap v3651: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 671 KiB/s wr, 39 op/s 2024-05-08T08:41:09.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:08 smithi194 ceph-mon[33679]: osdmap e306: 12 total, 12 up, 12 in 2024-05-08T08:41:11.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:10 smithi070 ceph-mon[29591]: pgmap v3653: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 656 KiB/s wr, 52 op/s 2024-05-08T08:41:11.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:10 smithi070 ceph-mon[29591]: osdmap e307: 12 total, 12 up, 12 in 2024-05-08T08:41:11.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:10 smithi172 ceph-mon[33377]: pgmap v3653: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 656 KiB/s wr, 52 op/s 2024-05-08T08:41:11.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:10 smithi172 ceph-mon[33377]: osdmap e307: 12 total, 12 up, 12 in 2024-05-08T08:41:11.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:10 smithi194 ceph-mon[33679]: pgmap v3653: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 656 KiB/s wr, 52 op/s 2024-05-08T08:41:11.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:10 smithi194 ceph-mon[33679]: osdmap e307: 12 total, 12 up, 12 in 2024-05-08T08:41:12.734 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/rpcb_clnt.o 2024-05-08T08:41:13.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:12 smithi070 ceph-mon[29591]: pgmap v3655: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 821 KiB/s wr, 65 op/s 2024-05-08T08:41:13.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:12 smithi172 ceph-mon[33377]: pgmap v3655: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 821 KiB/s wr, 65 op/s 2024-05-08T08:41:13.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:12 smithi194 ceph-mon[33679]: pgmap v3655: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 821 KiB/s wr, 65 op/s 2024-05-08T08:41:13.384 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/rx.o 2024-05-08T08:41:13.452 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlabel/netlabel_unlabeled.o 2024-05-08T08:41:14.602 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/xfrm6_protocol.o 2024-05-08T08:41:15.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:14 smithi070 ceph-mon[29591]: pgmap v3656: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 350 KiB/s wr, 20 op/s 2024-05-08T08:41:15.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:14 smithi172 ceph-mon[33377]: pgmap v3656: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 350 KiB/s wr, 20 op/s 2024-05-08T08:41:15.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:14 smithi194 ceph-mon[33679]: pgmap v3656: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 350 KiB/s wr, 20 op/s 2024-05-08T08:41:15.952 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/osl.o 2024-05-08T08:41:16.206 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/rfkill/built-in.a 2024-05-08T08:41:16.517 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/netfilter.o 2024-05-08T08:41:16.863 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/binfmt_misc.o 2024-05-08T08:41:17.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:16 smithi070 ceph-mon[29591]: pgmap v3657: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 768 KiB/s wr, 31 op/s 2024-05-08T08:41:17.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:16 smithi172 ceph-mon[33377]: pgmap v3657: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 768 KiB/s wr, 31 op/s 2024-05-08T08:41:17.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:16 smithi194 ceph-mon[33679]: pgmap v3657: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 768 KiB/s wr, 31 op/s 2024-05-08T08:41:19.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:18 smithi070 ceph-mon[29591]: pgmap v3658: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 620 KiB/s wr, 25 op/s 2024-05-08T08:41:19.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:18 smithi172 ceph-mon[33377]: pgmap v3658: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 620 KiB/s wr, 25 op/s 2024-05-08T08:41:19.205 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/fib_notifier.o 2024-05-08T08:41:19.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:18 smithi194 ceph-mon[33679]: pgmap v3658: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 620 KiB/s wr, 25 op/s 2024-05-08T08:41:21.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:20 smithi070 ceph-mon[29591]: pgmap v3659: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 695 KiB/s wr, 23 op/s 2024-05-08T08:41:21.175 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:20 smithi172 ceph-mon[33377]: pgmap v3659: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 695 KiB/s wr, 23 op/s 2024-05-08T08:41:21.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:20 smithi194 ceph-mon[33679]: pgmap v3659: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 695 KiB/s wr, 23 op/s 2024-05-08T08:41:23.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:22 smithi172 ceph-mon[33377]: pgmap v3660: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 626 KiB/s wr, 20 op/s 2024-05-08T08:41:23.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:22 smithi194 ceph-mon[33679]: pgmap v3660: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 626 KiB/s wr, 20 op/s 2024-05-08T08:41:23.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:22 smithi070 ceph-mon[29591]: pgmap v3660: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 626 KiB/s wr, 20 op/s 2024-05-08T08:41:23.381 INFO:tasks.quiescer.fs.[cephfs]:Total duration (50.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:41:23.381 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.15 2024-05-08T08:41:23.381 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:41:23.990 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:41:25.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:24 smithi172 ceph-mon[33377]: pgmap v3661: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 579 KiB/s wr, 19 op/s 2024-05-08T08:41:25.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:24 smithi194 ceph-mon[33679]: pgmap v3661: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 579 KiB/s wr, 19 op/s 2024-05-08T08:41:25.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:24 smithi070 ceph-mon[29591]: pgmap v3661: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 579 KiB/s wr, 19 op/s 2024-05-08T08:41:25.568 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/timer.o 2024-05-08T08:41:26.001 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlabel/netlabel_cipso_v4.o 2024-05-08T08:41:26.156 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/utils.o 2024-05-08T08:41:27.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:26 smithi172 ceph-mon[33377]: pgmap v3662: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 859 KiB/s wr, 33 op/s 2024-05-08T08:41:27.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:26 smithi194 ceph-mon[33679]: pgmap v3662: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 859 KiB/s wr, 33 op/s 2024-05-08T08:41:27.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:26 smithi070 ceph-mon[29591]: pgmap v3662: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 859 KiB/s wr, 33 op/s 2024-05-08T08:41:29.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:28 smithi172 ceph-mon[33377]: pgmap v3663: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 580 KiB/s wr, 26 op/s 2024-05-08T08:41:29.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:28 smithi194 ceph-mon[33679]: pgmap v3663: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 580 KiB/s wr, 26 op/s 2024-05-08T08:41:29.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:28 smithi070 ceph-mon[29591]: pgmap v3663: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 580 KiB/s wr, 26 op/s 2024-05-08T08:41:31.086 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/binfmt_script.o 2024-05-08T08:41:31.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:30 smithi172 ceph-mon[33377]: pgmap v3664: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 868 KiB/s wr, 40 op/s 2024-05-08T08:41:31.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:30 smithi194 ceph-mon[33679]: pgmap v3664: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 868 KiB/s wr, 40 op/s 2024-05-08T08:41:31.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:30 smithi070 ceph-mon[29591]: pgmap v3664: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 868 KiB/s wr, 40 op/s 2024-05-08T08:41:31.438 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/inet_fragment.o 2024-05-08T08:41:31.452 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/spectmgmt.o 2024-05-08T08:41:31.542 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/netlabel/netlabel_calipso.o 2024-05-08T08:41:31.729 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/proc.o 2024-05-08T08:41:33.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:32 smithi172 ceph-mon[33377]: pgmap v3665: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 567 KiB/s wr, 28 op/s 2024-05-08T08:41:33.214 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/reboot.o 2024-05-08T08:41:33.233 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:32 smithi070 ceph-mon[29591]: pgmap v3665: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 567 KiB/s wr, 28 op/s 2024-05-08T08:41:33.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:32 smithi194 ceph-mon[33679]: pgmap v3665: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 567 KiB/s wr, 28 op/s 2024-05-08T08:41:34.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.831+0000 7ff898e00700 1 -- 172.21.15.70:0/2006240065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8940779d0 msgr2=0x7ff894077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:34.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.831+0000 7ff898e00700 1 --2- 172.21.15.70:0/2006240065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8940779d0 0x7ff894077db0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7ff8840099e0 tx=0x7ff884009cf0 comp rx=0 tx=0).stop 2024-05-08T08:41:34.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.833+0000 7ff898e00700 1 -- 172.21.15.70:0/2006240065 shutdown_connections 2024-05-08T08:41:34.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.833+0000 7ff898e00700 1 --2- 172.21.15.70:0/2006240065 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff894114360 0x7ff894116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:34.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.833+0000 7ff898e00700 1 --2- 172.21.15.70:0/2006240065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8940779d0 0x7ff894077db0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:34.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.833+0000 7ff898e00700 1 --2- 172.21.15.70:0/2006240065 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8940782f0 0x7ff894113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:34.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.833+0000 7ff898e00700 1 -- 172.21.15.70:0/2006240065 >> 172.21.15.70:0/2006240065 conn(0x7ff8941011d0 msgr2=0x7ff8941035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:41:34.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.833+0000 7ff898e00700 1 -- 172.21.15.70:0/2006240065 shutdown_connections 2024-05-08T08:41:34.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.833+0000 7ff898e00700 1 -- 172.21.15.70:0/2006240065 wait complete. 2024-05-08T08:41:34.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.834+0000 7ff898e00700 1 Processor -- start 2024-05-08T08:41:34.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.835+0000 7ff898e00700 1 -- start start 2024-05-08T08:41:34.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.836+0000 7ff898e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8940779d0 0x7ff8941a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:34.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.836+0000 7ff898e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8940782f0 0x7ff8941a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:34.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.837+0000 7ff898e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff894114360 0x7ff8941a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:34.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.837+0000 7ff898e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff894119d00 con 0x7ff8940779d0 2024-05-08T08:41:34.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.837+0000 7ff898e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff894119b80 con 0x7ff8940782f0 2024-05-08T08:41:34.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.837+0000 7ff898e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff894119e80 con 0x7ff894114360 2024-05-08T08:41:34.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.837+0000 7ff891e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8940779d0 0x7ff8941a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:34.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.837+0000 7ff891400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8940782f0 0x7ff8941a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:34.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.837+0000 7ff891400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8940782f0 0x7ff8941a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36402/0 (socket says 172.21.15.70:36402) 2024-05-08T08:41:34.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.837+0000 7ff891400700 1 -- 172.21.15.70:0/962273339 learned_addr learned my addr 172.21.15.70:0/962273339 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:41:34.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.838+0000 7ff891400700 1 -- 172.21.15.70:0/962273339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff894114360 msgr2=0x7ff8941a4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:34.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.838+0000 7ff892800700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff894114360 0x7ff8941a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:34.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.838+0000 7ff891400700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff894114360 0x7ff8941a4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:34.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.838+0000 7ff891400700 1 -- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8940779d0 msgr2=0x7ff8941a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:34.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.838+0000 7ff891400700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8940779d0 0x7ff8941a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:34.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.838+0000 7ff891400700 1 -- 172.21.15.70:0/962273339 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8941a52c0 con 0x7ff8940782f0 2024-05-08T08:41:34.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.838+0000 7ff891e00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8940779d0 0x7ff8941a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:41:34.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.838+0000 7ff892800700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff894114360 0x7ff8941a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:41:34.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.839+0000 7ff891400700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8940782f0 0x7ff8941a07f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff88000b530 tx=0x7ff88000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:41:34.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.840+0000 7ff88aa00700 1 -- 172.21.15.70:0/962273339 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880015020 con 0x7ff8940782f0 2024-05-08T08:41:34.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.840+0000 7ff88aa00700 1 -- 172.21.15.70:0/962273339 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff880011cc0 con 0x7ff8940782f0 2024-05-08T08:41:34.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.840+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8941a55b0 con 0x7ff8940782f0 2024-05-08T08:41:34.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.840+0000 7ff88aa00700 1 -- 172.21.15.70:0/962273339 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880010d30 con 0x7ff8940782f0 2024-05-08T08:41:34.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.841+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8941ace30 con 0x7ff8940782f0 2024-05-08T08:41:34.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.843+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89406a190 con 0x7ff8940782f0 2024-05-08T08:41:34.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.848+0000 7ff88aa00700 1 -- 172.21.15.70:0/962273339 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff880047d10 con 0x7ff8940782f0 2024-05-08T08:41:34.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.851+0000 7ff88aa00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff8780b2a70 0x7ff8780b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:34.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.851+0000 7ff88aa00700 1 -- 172.21.15.70:0/962273339 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(307..307 src has 1..307) ==== 9583+0+0 (secure 0 0 0) 0x7ff8800e2630 con 0x7ff8940782f0 2024-05-08T08:41:34.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.851+0000 7ff891e00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff8780b2a70 0x7ff8780b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:34.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.853+0000 7ff88aa00700 1 -- 172.21.15.70:0/962273339 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff88001f020 con 0x7ff8940782f0 2024-05-08T08:41:34.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:34.853+0000 7ff891e00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff8780b2a70 0x7ff8780b4f30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff884006010 tx=0x7ff88400b580 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:41:35.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:34 smithi172 ceph-mon[33377]: pgmap v3666: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 567 KiB/s wr, 28 op/s 2024-05-08T08:41:35.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:34 smithi194 ceph-mon[33679]: pgmap v3666: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 567 KiB/s wr, 28 op/s 2024-05-08T08:41:35.308 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:34 smithi070 ceph-mon[29591]: pgmap v3666: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 604 KiB/s rd, 567 KiB/s wr, 28 op/s 2024-05-08T08:41:35.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.344+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff89402e510 con 0x7ff8940782f0 2024-05-08T08:41:35.340 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:41:35.340 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:41:35.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.347+0000 7ff88aa00700 1 -- 172.21.15.70:0/962273339 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7ff8800a9d00 con 0x7ff8940782f0 2024-05-08T08:41:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.350+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff8780b2a70 msgr2=0x7ff8780b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.350+0000 7ff898e00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff8780b2a70 0x7ff8780b4f30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff884006010 tx=0x7ff88400b580 comp rx=0 tx=0).stop 2024-05-08T08:41:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8940782f0 msgr2=0x7ff8941a07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8940782f0 0x7ff8941a07f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff88000b530 tx=0x7ff88000b8f0 comp rx=0 tx=0).stop 2024-05-08T08:41:35.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 shutdown_connections 2024-05-08T08:41:35.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff8780b2a70 0x7ff8780b4f30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:35.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff894114360 0x7ff8941a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:35.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8940779d0 0x7ff8941a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:35.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 --2- 172.21.15.70:0/962273339 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff8940782f0 0x7ff8941a07f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:35.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 >> 172.21.15.70:0/962273339 conn(0x7ff8941011d0 msgr2=0x7ff8941035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:41:35.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 shutdown_connections 2024-05-08T08:41:35.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:35.351+0000 7ff898e00700 1 -- 172.21.15.70:0/962273339 wait complete. 2024-05-08T08:41:35.345 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:41:36.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:35 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/962273339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:41:36.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:35 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/962273339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:41:36.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:35 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/962273339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:41:37.036 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/xdr.o 2024-05-08T08:41:37.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:36 smithi172 ceph-mon[33377]: pgmap v3667: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 834 KiB/s wr, 35 op/s 2024-05-08T08:41:37.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:36 smithi070 ceph-mon[29591]: pgmap v3667: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 834 KiB/s wr, 35 op/s 2024-05-08T08:41:37.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:36 smithi194 ceph-mon[33679]: pgmap v3667: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 834 KiB/s wr, 35 op/s 2024-05-08T08:41:37.493 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/sunrpc_syms.o 2024-05-08T08:41:38.030 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 85.15 --await-for 42.0' 2024-05-08T08:41:38.030 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 85.15 --await-for 42.0 2024-05-08T08:41:38.643 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:41:39.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:38 smithi070 ceph-mon[29591]: pgmap v3668: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 555 KiB/s wr, 21 op/s 2024-05-08T08:41:39.172 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:38 smithi172 ceph-mon[33377]: pgmap v3668: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 555 KiB/s wr, 21 op/s 2024-05-08T08:41:39.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:38 smithi194 ceph-mon[33679]: pgmap v3668: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 555 KiB/s wr, 21 op/s 2024-05-08T08:41:39.554 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/binfmt_elf.o 2024-05-08T08:41:41.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:40 smithi194 ceph-mon[33679]: pgmap v3669: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 852 KiB/s wr, 36 op/s 2024-05-08T08:41:41.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:40 smithi070 ceph-mon[29591]: pgmap v3669: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 852 KiB/s wr, 36 op/s 2024-05-08T08:41:41.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:40 smithi172 ceph-mon[33377]: pgmap v3669: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 852 KiB/s wr, 36 op/s 2024-05-08T08:41:42.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.709+0000 7f6b97200700 1 -- 172.21.15.70:0/586422885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b98106160 msgr2=0x7f6b981070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.709+0000 7f6b97200700 1 --2- 172.21.15.70:0/586422885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b98106160 0x7f6b981070e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009990 tx=0x7f6b84009ca0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.709+0000 7f6b97200700 1 -- 172.21.15.70:0/586422885 shutdown_connections 2024-05-08T08:41:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.709+0000 7f6b97200700 1 --2- 172.21.15.70:0/586422885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b98107810 0x7f6b981124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.709+0000 7f6b97200700 1 --2- 172.21.15.70:0/586422885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b98105840 0x7f6b98105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.709+0000 7f6b97200700 1 --2- 172.21.15.70:0/586422885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b98106160 0x7f6b981070e0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.709+0000 7f6b97200700 1 -- 172.21.15.70:0/586422885 >> 172.21.15.70:0/586422885 conn(0x7f6b98100fb0 msgr2=0x7f6b981033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:41:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.710+0000 7f6b97200700 1 -- 172.21.15.70:0/586422885 shutdown_connections 2024-05-08T08:41:42.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.710+0000 7f6b97200700 1 -- 172.21.15.70:0/586422885 wait complete. 2024-05-08T08:41:42.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.712+0000 7f6b97200700 1 Processor -- start 2024-05-08T08:41:42.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.712+0000 7f6b97200700 1 -- start start 2024-05-08T08:41:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.712+0000 7f6b97200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b98105840 0x7f6b981a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.712+0000 7f6b97200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b98106160 0x7f6b981a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.712+0000 7f6b97200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b98107810 0x7f6b9819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.713+0000 7f6b97200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b981156d0 con 0x7f6b98106160 2024-05-08T08:41:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.713+0000 7f6b97200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b98115550 con 0x7f6b98107810 2024-05-08T08:41:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.713+0000 7f6b97200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6b98115850 con 0x7f6b98105840 2024-05-08T08:41:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.713+0000 7f6b95400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b98106160 0x7f6b981a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.713+0000 7f6b95e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b98105840 0x7f6b981a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.713+0000 7f6b95e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b98105840 0x7f6b981a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:47344/0 (socket says 172.21.15.70:47344) 2024-05-08T08:41:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.713+0000 7f6b95e00700 1 -- 172.21.15.70:0/2448339085 learned_addr learned my addr 172.21.15.70:0/2448339085 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:41:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.713+0000 7f6b96800700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b98107810 0x7f6b9819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.714+0000 7f6b95e00700 1 -- 172.21.15.70:0/2448339085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b98107810 msgr2=0x7f6b9819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.714+0000 7f6b95e00700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b98107810 0x7f6b9819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.714+0000 7f6b95e00700 1 -- 172.21.15.70:0/2448339085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b98106160 msgr2=0x7f6b981a1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.714+0000 7f6b95e00700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b98106160 0x7f6b981a1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.714+0000 7f6b95e00700 1 -- 172.21.15.70:0/2448339085 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9819c130 con 0x7f6b98105840 2024-05-08T08:41:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.714+0000 7f6b96800700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b98107810 0x7f6b9819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:41:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.715+0000 7f6b95e00700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b98105840 0x7f6b981a17c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800d980 tx=0x7f6b8800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:41:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.715+0000 7f6b8ea00700 1 -- 172.21.15.70:0/2448339085 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88016070 con 0x7f6b98105840 2024-05-08T08:41:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.715+0000 7f6b97200700 1 -- 172.21.15.70:0/2448339085 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9819c420 con 0x7f6b98105840 2024-05-08T08:41:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.715+0000 7f6b8ea00700 1 -- 172.21.15.70:0/2448339085 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b88004830 con 0x7f6b98105840 2024-05-08T08:41:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.715+0000 7f6b8ea00700 1 -- 172.21.15.70:0/2448339085 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880054c0 con 0x7f6b98105840 2024-05-08T08:41:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.716+0000 7f6b97200700 1 -- 172.21.15.70:0/2448339085 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b981a8690 con 0x7f6b98105840 2024-05-08T08:41:42.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.721+0000 7f6b8ea00700 1 -- 172.21.15.70:0/2448339085 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6b88004220 con 0x7f6b98105840 2024-05-08T08:41:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.723+0000 7f6b8ea00700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6b7c0b2b20 0x7f6b7c0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.724+0000 7f6b8ea00700 1 -- 172.21.15.70:0/2448339085 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(307..307 src has 1..307) ==== 9583+0+0 (secure 0 0 0) 0x7f6b880e27a0 con 0x7f6b98105840 2024-05-08T08:41:42.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.724+0000 7f6b95400700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6b7c0b2b20 0x7f6b7c0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.725+0000 7f6b95400700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6b7c0b2b20 0x7f6b7c0b4fe0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6b9810be90 tx=0x7f6b8400b560 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:41:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.739+0000 7f6ba797bb80 1 Processor -- start 2024-05-08T08:41:42.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.740+0000 7f6ba797bb80 1 -- start start 2024-05-08T08:41:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.740+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 0x560923cb2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.740+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cacd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.740+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 0x560923cad790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.740+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560923bf6bb0 con 0x560923cb3120 2024-05-08T08:41:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.740+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560923b948f0 con 0x560923cb2800 2024-05-08T08:41:42.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.740+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560923bf2b70 con 0x560923cad350 2024-05-08T08:41:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.741+0000 7f6b95400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cacd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.741+0000 7f6b95e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 0x560923cb2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.741+0000 7f6b95400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cacd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60608/0 (socket says 172.21.15.70:60608) 2024-05-08T08:41:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.741+0000 7f6b95400700 1 -- 172.21.15.70:0/783679261 learned_addr learned my addr 172.21.15.70:0/783679261 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:41:42.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.741+0000 7f6b96800700 1 --2- 172.21.15.70:0/783679261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 0x560923cad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.742+0000 7f6b95400700 1 -- 172.21.15.70:0/783679261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 msgr2=0x560923cad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:41:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.742+0000 7f6b95400700 1 --2- 172.21.15.70:0/783679261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 0x560923cad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.742+0000 7f6b95400700 1 -- 172.21.15.70:0/783679261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 msgr2=0x560923cb2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:41:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.742+0000 7f6b95400700 1 --2- 172.21.15.70:0/783679261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 0x560923cb2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.742+0000 7f6b95400700 1 -- 172.21.15.70:0/783679261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560923b43a60 con 0x560923cb3120 2024-05-08T08:41:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.742+0000 7f6b95400700 1 --2- 172.21.15.70:0/783679261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cacd30 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009990 tx=0x7f6b8401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97b7229091e711 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:41:42.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.743+0000 7f6b83400700 1 -- 172.21.15.70:0/783679261 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840056a0 con 0x560923cb3120 2024-05-08T08:41:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.743+0000 7f6b83400700 1 -- 172.21.15.70:0/783679261 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b84003c20 con 0x560923cb3120 2024-05-08T08:41:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.743+0000 7f6b83400700 1 -- 172.21.15.70:0/783679261 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840056a0 con 0x560923cb3120 2024-05-08T08:41:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.744+0000 7f6ba797bb80 1 -- 172.21.15.70:0/783679261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 msgr2=0x560923cacd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.744+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/783679261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cacd30 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f6b84009990 tx=0x7f6b8401f000 comp rx=0 tx=0).stop 2024-05-08T08:41:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.744+0000 7f6ba797bb80 1 -- 172.21.15.70:0/783679261 shutdown_connections 2024-05-08T08:41:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.744+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/783679261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 0x560923cad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.744+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/783679261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 0x560923cb2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.744+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/783679261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cacd30 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.744+0000 7f6ba797bb80 1 -- 172.21.15.70:0/783679261 >> 172.21.15.70:0/783679261 conn(0x560923bd2cf0 msgr2=0x560923c9f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:41:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.744+0000 7f6ba797bb80 1 -- 172.21.15.70:0/783679261 shutdown_connections 2024-05-08T08:41:42.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.744+0000 7f6ba797bb80 1 -- 172.21.15.70:0/783679261 wait complete. 2024-05-08T08:41:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.745+0000 7f6ba797bb80 1 -- start start 2024-05-08T08:41:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.745+0000 7f6ba797bb80 1 Processor -- start 2024-05-08T08:41:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.746+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 0x560923cb8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.746+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 0x560923cb6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.746+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.746+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560923cb9bd0 con 0x560923cb3120 2024-05-08T08:41:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.746+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560923b5ccb0 con 0x560923cb2800 2024-05-08T08:41:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.746+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560923cb9d50 con 0x560923cad350 2024-05-08T08:41:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.746+0000 7f6ba797bb80 10 client.0 _ll_register_callbacks cb 0x560923b9de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:41:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.746+0000 7f6b95400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 0x560923cb6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.747+0000 7f6b96800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.747+0000 7f6b95e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 0x560923cb8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.747+0000 7f6b95400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 0x560923cb6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:52400/0 (socket says 172.21.15.70:52400) 2024-05-08T08:41:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.747+0000 7f6b95400700 1 -- 172.21.15.70:0/2038858174 learned_addr learned my addr 172.21.15.70:0/2038858174 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:41:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.747+0000 7f6b96800700 1 -- 172.21.15.70:0/2038858174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 msgr2=0x560923cb8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:41:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.747+0000 7f6b96800700 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 0x560923cb8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.747+0000 7f6b96800700 1 -- 172.21.15.70:0/2038858174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 msgr2=0x560923cb6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:41:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.747+0000 7f6b96800700 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 0x560923cb6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.747+0000 7f6b96800700 1 -- 172.21.15.70:0/2038858174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560923bbc5b0 con 0x560923cb3120 2024-05-08T08:41:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.748+0000 7f6b96800700 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb65d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f6b90004660 tx=0x7f6b90004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a04dfc2e3ebd07c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:41:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.748+0000 7f6b77e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:41:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.748+0000 7f6b77e00700 1 -- 172.21.15.70:0/2038858174 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9001a020 con 0x560923cb3120 2024-05-08T08:41:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.748+0000 7f6b77e00700 1 -- 172.21.15.70:0/2038858174 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(307..307 src has 1..307) ==== 9583+0+0 (secure 0 0 0) 0x7f6b90007ae0 con 0x560923cb3120 2024-05-08T08:41:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.748+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2038858174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b84003c20 con 0x560923cb3120 2024-05-08T08:41:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.748+0000 7f6b77e00700 1 -- 172.21.15.70:0/2038858174 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6b90025050 con 0x560923cb3120 2024-05-08T08:41:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.748+0000 7f6ba797bb80 10 client.18444 fetch_fsmap learned FSMap version 42 2024-05-08T08:41:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.748+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2038858174 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560923cc43b0 con 0x560923cb3120 2024-05-08T08:41:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.749+0000 7f6b77e00700 1 -- 172.21.15.70:0/2038858174 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b84003c20 con 0x560923cb3120 2024-05-08T08:41:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.749+0000 7f6b77e00700 1 -- 172.21.15.70:0/2038858174 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f6b900153c0 con 0x560923cb3120 2024-05-08T08:41:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.749+0000 7f6ba797bb80 10 client.18444 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:41:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.749+0000 7f6ba797bb80 10 client.18444 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:41:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.749+0000 7f6ba797bb80 20 client.18444 populate_metadata read hostname 'smithi070' 2024-05-08T08:41:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.749+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560923cc6e70 0x560923cc92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.749+0000 7f6ba797bb80 4 client.18444 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:41:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.749+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2038858174 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560923c71230 con 0x560923cc6e70 2024-05-08T08:41:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.750+0000 7f6b95e00700 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560923cc6e70 0x560923cc92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.751+0000 7f6b95e00700 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560923cc6e70 0x560923cc92f0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c16ef682b23b6020 server_cookie=b866bb89dfac9e3b in_seq=0 out_seq=0 2024-05-08T08:41:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.751+0000 7f6b77e00700 10 client.18444 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:41:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.753+0000 7f6b77e00700 1 -- 172.21.15.70:0/2038858174 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560923c71230 con 0x560923cc6e70 2024-05-08T08:41:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.753+0000 7f6b77e00700 10 client.18444 handle_command_reply: tid=0 2024-05-08T08:41:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.753+0000 7f6ba797bb80 1 client.18444 shutdown 2024-05-08T08:41:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2038858174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 msgr2=0x560923cb65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb65d0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f6b90004660 tx=0x7f6b90004970 comp rx=0 tx=0).stop 2024-05-08T08:41:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2038858174 shutdown_connections 2024-05-08T08:41:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560923cc6e70 0x560923cc92f0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb65d0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cad350 0x560923cb8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2038858174 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cb2800 0x560923cb6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6b77e00700 0 client.18444 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:41:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2038858174 >> 172.21.15.70:0/2038858174 conn(0x560923bd2cf0 msgr2=0x560923ca3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:41:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2038858174 shutdown_connections 2024-05-08T08:41:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2038858174 wait complete. 2024-05-08T08:41:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.754+0000 7f6ba797bb80 20 client.18444 trim_cache size 0 max 16384 2024-05-08T08:41:42.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.788+0000 7f6ba797bb80 1 Processor -- start 2024-05-08T08:41:42.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.789+0000 7f6ba797bb80 1 -- start start 2024-05-08T08:41:42.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.789+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 0x560923cb0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.789+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cb07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.789+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.789+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b981af9c0 con 0x560923cb3120 2024-05-08T08:41:42.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.789+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b981ad250 con 0x560923cad350 2024-05-08T08:41:42.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.789+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6b981ab0c0 con 0x560923cb2800 2024-05-08T08:41:42.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.790+0000 7f6b95e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 0x560923cb0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.790+0000 7f6b95400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cb07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.790+0000 7f6b95400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cb07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:47366/0 (socket says 172.21.15.70:47366) 2024-05-08T08:41:42.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.790+0000 7f6b95400700 1 -- 172.21.15.70:0/2450638088 learned_addr learned my addr 172.21.15.70:0/2450638088 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:41:42.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.790+0000 7f6b96800700 1 --2- 172.21.15.70:0/2450638088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.791+0000 7f6b95400700 1 -- 172.21.15.70:0/2450638088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 msgr2=0x560923cb0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:41:42.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.791+0000 7f6b95400700 1 --2- 172.21.15.70:0/2450638088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 0x560923cb0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.791+0000 7f6b95400700 1 -- 172.21.15.70:0/2450638088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 msgr2=0x560923cb49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:41:42.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.791+0000 7f6b95400700 1 --2- 172.21.15.70:0/2450638088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.791+0000 7f6b95400700 1 -- 172.21.15.70:0/2450638088 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560923c9b9b0 con 0x560923cb2800 2024-05-08T08:41:42.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.791+0000 7f6b96800700 1 --2- 172.21.15.70:0/2450638088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:41:42.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.792+0000 7f6b95400700 1 --2- 172.21.15.70:0/2450638088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cb07c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b840098e0 tx=0x7f6b84005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c09ff263876e03b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:41:42.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.792+0000 7f6b82a00700 1 -- 172.21.15.70:0/2450638088 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840056a0 con 0x560923cb2800 2024-05-08T08:41:42.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.792+0000 7f6b82a00700 1 -- 172.21.15.70:0/2450638088 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b8400bb80 con 0x560923cb2800 2024-05-08T08:41:42.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.792+0000 7f6b82a00700 1 -- 172.21.15.70:0/2450638088 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84037aa0 con 0x560923cb2800 2024-05-08T08:41:42.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.793+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2450638088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 msgr2=0x560923cb07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:41:42.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.793+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2450638088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cb07c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6b840098e0 tx=0x7f6b84005a90 comp rx=0 tx=0).stop 2024-05-08T08:41:42.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.793+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2450638088 shutdown_connections 2024-05-08T08:41:42.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.793+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2450638088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cb49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.793+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2450638088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 0x560923cb0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.793+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/2450638088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cb07c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.793+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2450638088 >> 172.21.15.70:0/2450638088 conn(0x560923bd2cf0 msgr2=0x560923cb63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:41:42.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.794+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2450638088 shutdown_connections 2024-05-08T08:41:42.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.794+0000 7f6ba797bb80 1 -- 172.21.15.70:0/2450638088 wait complete. 2024-05-08T08:41:42.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.794+0000 7f6ba797bb80 1 -- start start 2024-05-08T08:41:42.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.795+0000 7f6ba797bb80 1 Processor -- start 2024-05-08T08:41:42.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.795+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 0x560923cbf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cbc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6ba797bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cbc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b981ab710 con 0x560923cb3120 2024-05-08T08:41:42.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6b981acb80 con 0x560923cad350 2024-05-08T08:41:42.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6ba797bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6b981abde0 con 0x560923cb2800 2024-05-08T08:41:42.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6b96800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cbc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6ba797bb80 10 client.0 _ll_register_callbacks cb 0x560923b9de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:41:42.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6b95e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 0x560923cbf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6b96800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cbc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60630/0 (socket says 172.21.15.70:60630) 2024-05-08T08:41:42.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.796+0000 7f6b96800700 1 -- 172.21.15.70:0/3292153121 learned_addr learned my addr 172.21.15.70:0/3292153121 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:41:42.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.797+0000 7f6b95400700 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cbc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.797+0000 7f6b96800700 1 -- 172.21.15.70:0/3292153121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 msgr2=0x560923cbc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:41:42.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.797+0000 7f6b96800700 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cbc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.797+0000 7f6b96800700 1 -- 172.21.15.70:0/3292153121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 msgr2=0x560923cbf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:41:42.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.797+0000 7f6b96800700 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 0x560923cbf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:41:42.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.797+0000 7f6b96800700 1 -- 172.21.15.70:0/3292153121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560923cbcd60 con 0x560923cb3120 2024-05-08T08:41:42.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.798+0000 7f6b96800700 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cbc540 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f6b90002230 tx=0x7f6b900155f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a890101071f9339 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:41:42.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.798+0000 7f6b77e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:41:42.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.798+0000 7f6b77e00700 1 -- 172.21.15.70:0/3292153121 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9001a050 con 0x560923cb3120 2024-05-08T08:41:42.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.798+0000 7f6b77e00700 1 -- 172.21.15.70:0/3292153121 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(307..307 src has 1..307) ==== 9583+0+0 (secure 0 0 0) 0x7f6b90005e70 con 0x560923cb3120 2024-05-08T08:41:42.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.799+0000 7f6ba797bb80 1 -- 172.21.15.70:0/3292153121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b8400bb80 con 0x560923cb3120 2024-05-08T08:41:42.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.799+0000 7f6b77e00700 1 -- 172.21.15.70:0/3292153121 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6b90037050 con 0x560923cb3120 2024-05-08T08:41:42.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.799+0000 7f6ba797bb80 10 client.18450 fetch_fsmap learned FSMap version 42 2024-05-08T08:41:42.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.799+0000 7f6ba797bb80 1 -- 172.21.15.70:0/3292153121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560923d32750 con 0x560923cb3120 2024-05-08T08:41:42.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.800+0000 7f6b77e00700 1 -- 172.21.15.70:0/3292153121 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b8400bb80 con 0x560923cb3120 2024-05-08T08:41:42.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.800+0000 7f6b77e00700 1 -- 172.21.15.70:0/3292153121 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f6b90015b60 con 0x560923cb3120 2024-05-08T08:41:42.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.800+0000 7f6ba797bb80 10 client.18450 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:41:42.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.800+0000 7f6ba797bb80 10 client.18450 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:41:42.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.800+0000 7f6ba797bb80 20 client.18450 populate_metadata read hostname 'smithi070' 2024-05-08T08:41:42.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.800+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560923d32f00 0x560923d35320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:41:42.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.800+0000 7f6ba797bb80 4 client.18450 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.15, "await_for": 42.0}] 2024-05-08T08:41:42.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.800+0000 7f6ba797bb80 1 -- 172.21.15.70:0/3292153121 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.15, "await_for": 42.0}) -- 0x560923c04590 con 0x560923d32f00 2024-05-08T08:41:42.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.801+0000 7f6b95e00700 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560923d32f00 0x560923d35320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:41:42.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.802+0000 7f6b95e00700 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560923d32f00 0x560923d35320 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a51f3a9eb62c691 server_cookie=b2f00be70f7d6a82 in_seq=0 out_seq=0 2024-05-08T08:41:42.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:41:42.802+0000 7f6b77e00700 10 client.18450 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:41:43.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:42 smithi070 ceph-mon[29591]: pgmap v3670: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 565 KiB/s wr, 22 op/s 2024-05-08T08:41:43.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:42 smithi194 ceph-mon[33679]: pgmap v3670: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 565 KiB/s wr, 22 op/s 2024-05-08T08:41:43.416 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/nvs.o 2024-05-08T08:41:43.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:42 smithi172 ceph-mon[33377]: pgmap v3670: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 565 KiB/s wr, 22 op/s 2024-05-08T08:41:44.135 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/tx.o 2024-05-08T08:41:44.440 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/netlabel/built-in.a 2024-05-08T08:41:45.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:44 smithi194 ceph-mon[33679]: pgmap v3671: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 565 KiB/s wr, 22 op/s 2024-05-08T08:41:45.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:44 smithi070 ceph-mon[29591]: pgmap v3671: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 565 KiB/s wr, 22 op/s 2024-05-08T08:41:45.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:44 smithi172 ceph-mon[33377]: pgmap v3671: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 565 KiB/s wr, 22 op/s 2024-05-08T08:41:47.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:46 smithi194 ceph-mon[33679]: pgmap v3672: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 812 KiB/s wr, 35 op/s 2024-05-08T08:41:47.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:46 smithi070 ceph-mon[29591]: pgmap v3672: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 812 KiB/s wr, 35 op/s 2024-05-08T08:41:47.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:46 smithi172 ceph-mon[33377]: pgmap v3672: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 812 KiB/s wr, 35 op/s 2024-05-08T08:41:49.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:48 smithi194 ceph-mon[33679]: pgmap v3673: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 544 KiB/s wr, 28 op/s 2024-05-08T08:41:49.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:48 smithi070 ceph-mon[29591]: pgmap v3673: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 544 KiB/s wr, 28 op/s 2024-05-08T08:41:49.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:48 smithi172 ceph-mon[33377]: pgmap v3673: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 544 KiB/s wr, 28 op/s 2024-05-08T08:41:51.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:50 smithi070 ceph-mon[29591]: pgmap v3674: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 698 KiB/s wr, 32 op/s 2024-05-08T08:41:51.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:50 smithi194 ceph-mon[33679]: pgmap v3674: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 698 KiB/s wr, 32 op/s 2024-05-08T08:41:51.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:50 smithi172 ceph-mon[33377]: pgmap v3674: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 698 KiB/s wr, 32 op/s 2024-05-08T08:41:53.224 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:52 smithi172 ceph-mon[33377]: pgmap v3675: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 400 KiB/s wr, 17 op/s 2024-05-08T08:41:53.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:52 smithi194 ceph-mon[33679]: pgmap v3675: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 400 KiB/s wr, 17 op/s 2024-05-08T08:41:53.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:52 smithi070 ceph-mon[29591]: pgmap v3675: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 400 KiB/s wr, 17 op/s 2024-05-08T08:41:55.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:54 smithi194 ceph-mon[33679]: pgmap v3676: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 400 KiB/s wr, 17 op/s 2024-05-08T08:41:55.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:54 smithi070 ceph-mon[29591]: pgmap v3676: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 400 KiB/s wr, 17 op/s 2024-05-08T08:41:55.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:54 smithi172 ceph-mon[33377]: pgmap v3676: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 400 KiB/s wr, 17 op/s 2024-05-08T08:41:57.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:56 smithi194 ceph-mon[33679]: pgmap v3677: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 438 KiB/s wr, 22 op/s 2024-05-08T08:41:57.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:56 smithi070 ceph-mon[29591]: pgmap v3677: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 438 KiB/s wr, 22 op/s 2024-05-08T08:41:57.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:56 smithi172 ceph-mon[33377]: pgmap v3677: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 438 KiB/s wr, 22 op/s 2024-05-08T08:41:59.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:41:58 smithi194 ceph-mon[33679]: pgmap v3678: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 192 KiB/s wr, 10 op/s 2024-05-08T08:41:59.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:41:58 smithi070 ceph-mon[29591]: pgmap v3678: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 192 KiB/s wr, 10 op/s 2024-05-08T08:41:59.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:41:58 smithi172 ceph-mon[33377]: pgmap v3678: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 192 KiB/s wr, 10 op/s 2024-05-08T08:42:01.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:00 smithi194 ceph-mon[33679]: pgmap v3679: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 263 KiB/s wr, 17 op/s 2024-05-08T08:42:01.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:42:01.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:00 smithi070 ceph-mon[29591]: pgmap v3679: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 263 KiB/s wr, 17 op/s 2024-05-08T08:42:01.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:42:01.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:00 smithi172 ceph-mon[33377]: pgmap v3679: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 263 KiB/s wr, 17 op/s 2024-05-08T08:42:01.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:42:03.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:03 smithi194 ceph-mon[33679]: pgmap v3680: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 109 KiB/s wr, 13 op/s 2024-05-08T08:42:03.366 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:03 smithi070 ceph-mon[29591]: pgmap v3680: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 109 KiB/s wr, 13 op/s 2024-05-08T08:42:03.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:03 smithi172 ceph-mon[33377]: pgmap v3680: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 109 KiB/s wr, 13 op/s 2024-05-08T08:42:05.253 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:05 smithi194 ceph-mon[33679]: pgmap v3681: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 109 KiB/s wr, 13 op/s 2024-05-08T08:42:05.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:05 smithi070 ceph-mon[29591]: pgmap v3681: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 109 KiB/s wr, 13 op/s 2024-05-08T08:42:05.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:05 smithi172 ceph-mon[33377]: pgmap v3681: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 109 KiB/s wr, 13 op/s 2024-05-08T08:42:06.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.637+0000 7f6b77e00700 1 -- 172.21.15.70:0/3292153121 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x560923c04590 con 0x560923d32f00 2024-05-08T08:42:06.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.637+0000 7f6b77e00700 10 client.18450 handle_command_reply: tid=0 2024-05-08T08:42:06.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.637+0000 7f6ba797bb80 1 client.18450 shutdown 2024-05-08T08:42:06.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6ba797bb80 1 -- 172.21.15.70:0/3292153121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 msgr2=0x560923cbc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cbc540 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f6b90002230 tx=0x7f6b900155f0 comp rx=0 tx=0).stop 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6ba797bb80 1 -- 172.21.15.70:0/3292153121 shutdown_connections 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560923d32f00 0x560923d35320 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560923cb3120 0x560923cbc540 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560923cad350 0x560923cbf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6ba797bb80 1 --2- 172.21.15.70:0/3292153121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560923cb2800 0x560923cbc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6ba797bb80 1 -- 172.21.15.70:0/3292153121 >> 172.21.15.70:0/3292153121 conn(0x560923bd2cf0 msgr2=0x560923cb0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6b77e00700 0 client.18450 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.638+0000 7f6ba797bb80 1 -- 172.21.15.70:0/3292153121 shutdown_connections 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.639+0000 7f6ba797bb80 1 -- 172.21.15.70:0/3292153121 wait complete. 2024-05-08T08:42:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.639+0000 7f6ba797bb80 20 client.18450 trim_cache size 0 max 16384 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 258, 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout: "cbc78c63": { 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 258, 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:42:06.633 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.2, 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:06.634 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:06.635 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:42:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.640+0000 7f6b97200700 1 -- 172.21.15.70:0/2448339085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6b7c0b2b20 msgr2=0x7f6b7c0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.640+0000 7f6b97200700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6b7c0b2b20 0x7f6b7c0b4fe0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6b9810be90 tx=0x7f6b8400b560 comp rx=0 tx=0).stop 2024-05-08T08:42:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.640+0000 7f6b97200700 1 -- 172.21.15.70:0/2448339085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b98105840 msgr2=0x7f6b981a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.640+0000 7f6b97200700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b98105840 0x7f6b981a17c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800d980 tx=0x7f6b8800dc90 comp rx=0 tx=0).stop 2024-05-08T08:42:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.642+0000 7f6b97200700 1 -- 172.21.15.70:0/2448339085 shutdown_connections 2024-05-08T08:42:06.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.642+0000 7f6b97200700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6b7c0b2b20 0x7f6b7c0b4fe0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.642+0000 7f6b97200700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6b98107810 0x7f6b9819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.642+0000 7f6b97200700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b98105840 0x7f6b981a17c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.642+0000 7f6b97200700 1 --2- 172.21.15.70:0/2448339085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b98106160 0x7f6b981a1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.642+0000 7f6b97200700 1 -- 172.21.15.70:0/2448339085 >> 172.21.15.70:0/2448339085 conn(0x7f6b98100fb0 msgr2=0x7f6b98102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.642+0000 7f6b97200700 1 -- 172.21.15.70:0/2448339085 shutdown_connections 2024-05-08T08:42:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:06.642+0000 7f6b97200700 1 -- 172.21.15.70:0/2448339085 wait complete. 2024-05-08T08:42:07.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:07 smithi070 ceph-mon[29591]: pgmap v3682: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 186 KiB/s wr, 18 op/s 2024-05-08T08:42:07.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:07 smithi172 ceph-mon[33377]: pgmap v3682: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 186 KiB/s wr, 18 op/s 2024-05-08T08:42:07.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:07 smithi194 ceph-mon[33679]: pgmap v3682: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 186 KiB/s wr, 18 op/s 2024-05-08T08:42:09.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:09 smithi070 ceph-mon[29591]: pgmap v3683: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 148 KiB/s wr, 13 op/s 2024-05-08T08:42:09.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:09 smithi172 ceph-mon[33377]: pgmap v3683: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 148 KiB/s wr, 13 op/s 2024-05-08T08:42:09.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:09 smithi194 ceph-mon[33679]: pgmap v3683: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 148 KiB/s wr, 13 op/s 2024-05-08T08:42:09.694 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'cbc78c63', quiesce took 46.3 seconds. Will release after: 25.15 2024-05-08T08:42:11.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:11 smithi070 ceph-mon[29591]: pgmap v3684: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 268 KiB/s wr, 32 op/s 2024-05-08T08:42:11.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:11 smithi172 ceph-mon[33377]: pgmap v3684: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 268 KiB/s wr, 32 op/s 2024-05-08T08:42:11.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:11 smithi194 ceph-mon[33679]: pgmap v3684: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 268 KiB/s wr, 32 op/s 2024-05-08T08:42:13.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:13 smithi172 ceph-mon[33377]: pgmap v3685: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 197 KiB/s wr, 24 op/s 2024-05-08T08:42:13.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:13.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:13.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:13 smithi194 ceph-mon[33679]: pgmap v3685: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 197 KiB/s wr, 24 op/s 2024-05-08T08:42:13.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:13.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:13.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:13 smithi070 ceph-mon[29591]: pgmap v3685: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 197 KiB/s wr, 24 op/s 2024-05-08T08:42:13.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:13.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:15.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:15 smithi194 ceph-mon[33679]: pgmap v3686: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 197 KiB/s wr, 24 op/s 2024-05-08T08:42:15.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:15 smithi070 ceph-mon[29591]: pgmap v3686: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 197 KiB/s wr, 24 op/s 2024-05-08T08:42:15.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:15 smithi172 ceph-mon[33377]: pgmap v3686: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 197 KiB/s wr, 24 op/s 2024-05-08T08:42:16.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:16 smithi194 ceph-mon[33679]: osdmap e308: 12 total, 12 up, 12 in 2024-05-08T08:42:16.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:16 smithi070 ceph-mon[29591]: osdmap e308: 12 total, 12 up, 12 in 2024-05-08T08:42:16.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:16 smithi172 ceph-mon[33377]: osdmap e308: 12 total, 12 up, 12 in 2024-05-08T08:42:17.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:17 smithi194 ceph-mon[33679]: pgmap v3688: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 248 KiB/s wr, 27 op/s 2024-05-08T08:42:17.576 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:17 smithi172 ceph-mon[33377]: pgmap v3688: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 248 KiB/s wr, 27 op/s 2024-05-08T08:42:17.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:17 smithi070 ceph-mon[29591]: pgmap v3688: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 248 KiB/s wr, 27 op/s 2024-05-08T08:42:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:19 smithi194 ceph-mon[33679]: pgmap v3689: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 248 KiB/s wr, 27 op/s 2024-05-08T08:42:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:42:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:42:19.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:19.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:19 smithi172 ceph-mon[33377]: pgmap v3689: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 248 KiB/s wr, 27 op/s 2024-05-08T08:42:19.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:19.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:19.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:42:19.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:42:19.532 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:19 smithi070 ceph-mon[29591]: pgmap v3689: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 248 KiB/s wr, 27 op/s 2024-05-08T08:42:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:42:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:42:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:42:21.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:21 smithi194 ceph-mon[33679]: pgmap v3690: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 9 op/s 2024-05-08T08:42:21.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:21 smithi194 ceph-mon[33679]: osdmap e309: 12 total, 12 up, 12 in 2024-05-08T08:42:21.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:21 smithi070 ceph-mon[29591]: pgmap v3690: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 9 op/s 2024-05-08T08:42:21.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:21 smithi070 ceph-mon[29591]: osdmap e309: 12 total, 12 up, 12 in 2024-05-08T08:42:21.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:21 smithi172 ceph-mon[33377]: pgmap v3690: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 162 KiB/s wr, 9 op/s 2024-05-08T08:42:21.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:21 smithi172 ceph-mon[33377]: osdmap e309: 12 total, 12 up, 12 in 2024-05-08T08:42:23.493 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:23 smithi172 ceph-mon[33377]: pgmap v3692: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 202 KiB/s wr, 11 op/s 2024-05-08T08:42:23.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:23 smithi194 ceph-mon[33679]: pgmap v3692: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 202 KiB/s wr, 11 op/s 2024-05-08T08:42:23.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:23 smithi070 ceph-mon[29591]: pgmap v3692: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 202 KiB/s wr, 11 op/s 2024-05-08T08:42:25.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:25 smithi194 ceph-mon[33679]: pgmap v3693: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 5 op/s 2024-05-08T08:42:25.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:25 smithi070 ceph-mon[29591]: pgmap v3693: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 5 op/s 2024-05-08T08:42:25.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:25 smithi172 ceph-mon[33377]: pgmap v3693: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 67 KiB/s wr, 5 op/s 2024-05-08T08:42:27.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:27 smithi070 ceph-mon[29591]: pgmap v3694: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:42:27.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:27 smithi172 ceph-mon[33377]: pgmap v3694: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:42:27.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:27 smithi194 ceph-mon[33679]: pgmap v3694: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:42:29.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:29 smithi070 ceph-mon[29591]: pgmap v3695: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:42:29.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:29 smithi172 ceph-mon[33377]: pgmap v3695: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:42:29.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:29 smithi194 ceph-mon[33679]: pgmap v3695: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 62 KiB/s wr, 8 op/s 2024-05-08T08:42:31.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:31 smithi070 ceph-mon[29591]: pgmap v3696: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-05-08T08:42:31.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:31 smithi172 ceph-mon[33377]: pgmap v3696: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-05-08T08:42:31.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:31 smithi194 ceph-mon[33679]: pgmap v3696: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 4.1 KiB/s wr, 6 op/s 2024-05-08T08:42:33.555 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:33 smithi172 ceph-mon[33377]: pgmap v3697: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-05-08T08:42:33.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:33 smithi070 ceph-mon[29591]: pgmap v3697: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-05-08T08:42:33.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:33 smithi194 ceph-mon[33679]: pgmap v3697: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.7 KiB/s wr, 5 op/s 2024-05-08T08:42:34.846 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:42:35.347 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:42:35.556 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:35 smithi194 ceph-mon[33679]: pgmap v3698: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 KiB/s wr, 5 op/s 2024-05-08T08:42:35.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:35 smithi070 ceph-mon[29591]: pgmap v3698: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 KiB/s wr, 5 op/s 2024-05-08T08:42:35.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:35 smithi172 ceph-mon[33377]: pgmap v3698: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.4 KiB/s wr, 5 op/s 2024-05-08T08:42:37.543 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:37 smithi070 ceph-mon[29591]: pgmap v3699: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-05-08T08:42:37.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:37 smithi172 ceph-mon[33377]: pgmap v3699: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-05-08T08:42:37.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:37 smithi194 ceph-mon[33679]: pgmap v3699: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-05-08T08:42:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.902+0000 7fd72f800700 1 -- 172.21.15.70:0/1381637927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd728109ad0 msgr2=0x7fd728109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.902+0000 7fd72f800700 1 --2- 172.21.15.70:0/1381637927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd728109ad0 0x7fd728109f50 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fd714009990 tx=0x7fd714009ca0 comp rx=0 tx=0).stop 2024-05-08T08:42:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.902+0000 7fd72f800700 1 -- 172.21.15.70:0/1381637927 shutdown_connections 2024-05-08T08:42:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.902+0000 7fd72f800700 1 --2- 172.21.15.70:0/1381637927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72810a490 0x7fd7281169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.902+0000 7fd72f800700 1 --2- 172.21.15.70:0/1381637927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd72810fb60 0x7fd72810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.902+0000 7fd72f800700 1 --2- 172.21.15.70:0/1381637927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd728109ad0 0x7fd728109f50 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.902+0000 7fd72f800700 1 -- 172.21.15.70:0/1381637927 >> 172.21.15.70:0/1381637927 conn(0x7fd728076c70 msgr2=0x7fd7281082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.902+0000 7fd72f800700 1 -- 172.21.15.70:0/1381637927 shutdown_connections 2024-05-08T08:42:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.902+0000 7fd72f800700 1 -- 172.21.15.70:0/1381637927 wait complete. 2024-05-08T08:42:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.903+0000 7fd72f800700 1 Processor -- start 2024-05-08T08:42:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.903+0000 7fd72f800700 1 -- start start 2024-05-08T08:42:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.904+0000 7fd72f800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd728109ad0 0x7fd7281a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.904+0000 7fd72f800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72810a490 0x7fd7281a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.904+0000 7fd72f800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72810fb60 0x7fd7281a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.904+0000 7fd72f800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd728119ba0 con 0x7fd72810fb60 2024-05-08T08:42:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.904+0000 7fd72f800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd728119a20 con 0x7fd72810a490 2024-05-08T08:42:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.904+0000 7fd72f800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd728119d20 con 0x7fd728109ad0 2024-05-08T08:42:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.904+0000 7fd72d800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72810fb60 0x7fd7281a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.904+0000 7fd72d800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72810fb60 0x7fd7281a49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54986/0 (socket says 172.21.15.70:54986) 2024-05-08T08:42:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.905+0000 7fd72d800700 1 -- 172.21.15.70:0/1006091505 learned_addr learned my addr 172.21.15.70:0/1006091505 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.905+0000 7fd72ce00700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd728109ad0 0x7fd7281a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.905+0000 7fd727e00700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72810a490 0x7fd7281a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.905+0000 7fd72d800700 1 -- 172.21.15.70:0/1006091505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd728109ad0 msgr2=0x7fd7281a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.905+0000 7fd72d800700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd728109ad0 0x7fd7281a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.905+0000 7fd72d800700 1 -- 172.21.15.70:0/1006091505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72810a490 msgr2=0x7fd7281a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.905+0000 7fd72d800700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72810a490 0x7fd7281a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.905+0000 7fd72d800700 1 -- 172.21.15.70:0/1006091505 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7281a5130 con 0x7fd72810fb60 2024-05-08T08:42:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.906+0000 7fd72d800700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72810fb60 0x7fd7281a49f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fd720007ee0 tx=0x7fd72000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.906+0000 7fd725600700 1 -- 172.21.15.70:0/1006091505 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720004bb0 con 0x7fd72810fb60 2024-05-08T08:42:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.906+0000 7fd725600700 1 -- 172.21.15.70:0/1006091505 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd720004d50 con 0x7fd72810fb60 2024-05-08T08:42:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.906+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7281a5420 con 0x7fd72810fb60 2024-05-08T08:42:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.906+0000 7fd725600700 1 -- 172.21.15.70:0/1006091505 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7200058b0 con 0x7fd72810fb60 2024-05-08T08:42:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.906+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7281acca0 con 0x7fd72810fb60 2024-05-08T08:42:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.908+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72806a190 con 0x7fd72810fb60 2024-05-08T08:42:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.910+0000 7fd725600700 1 -- 172.21.15.70:0/1006091505 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd72001a020 con 0x7fd72810fb60 2024-05-08T08:42:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.912+0000 7fd725600700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7100b2a70 0x7fd7100b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.912+0000 7fd725600700 1 -- 172.21.15.70:0/1006091505 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(309..309 src has 1..309) ==== 9583+0+0 (secure 0 0 0) 0x7fd7200e2760 con 0x7fd72810fb60 2024-05-08T08:42:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.912+0000 7fd72ce00700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7100b2a70 0x7fd7100b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.913+0000 7fd72ce00700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7100b2a70 0x7fd7100b4f30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd71c005950 tx=0x7fd71c00b410 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:37.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:37.915+0000 7fd725600700 1 -- 172.21.15.70:0/1006091505 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd720010070 con 0x7fd72810fb60 2024-05-08T08:42:38.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.202+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd72802e510 con 0x7fd72810fb60 2024-05-08T08:42:38.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.203+0000 7fd725600700 1 -- 172.21.15.70:0/1006091505 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fd7200a9cc0 con 0x7fd72810fb60 2024-05-08T08:42:38.196 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:42:38.196 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:42:38.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.206+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7100b2a70 msgr2=0x7fd7100b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:38.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7100b2a70 0x7fd7100b4f30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fd71c005950 tx=0x7fd71c00b410 comp rx=0 tx=0).stop 2024-05-08T08:42:38.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72810fb60 msgr2=0x7fd7281a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:38.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72810fb60 0x7fd7281a49f0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fd720007ee0 tx=0x7fd72000d3b0 comp rx=0 tx=0).stop 2024-05-08T08:42:38.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 shutdown_connections 2024-05-08T08:42:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7100b2a70 0x7fd7100b4f30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72810fb60 0x7fd7281a49f0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd728109ad0 0x7fd7281a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 --2- 172.21.15.70:0/1006091505 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72810a490 0x7fd7281a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 >> 172.21.15.70:0/1006091505 conn(0x7fd728076c70 msgr2=0x7fd728077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 shutdown_connections 2024-05-08T08:42:38.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:38.207+0000 7fd72f800700 1 -- 172.21.15.70:0/1006091505 wait complete. 2024-05-08T08:42:38.200 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:42:38.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:38 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1006091505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:42:38.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:38 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1006091505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:42:38.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:38 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1006091505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:42:39.156 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id cbc78c63 --release --await' 2024-05-08T08:42:39.156 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id cbc78c63 --release --await 2024-05-08T08:42:39.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:39 smithi070 ceph-mon[29591]: pgmap v3700: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:42:39.608 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:42:39.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:39 smithi172 ceph-mon[33377]: pgmap v3700: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:42:39.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:39 smithi194 ceph-mon[33679]: pgmap v3700: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:42:41.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:41 smithi070 ceph-mon[29591]: pgmap v3701: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:42:41.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:41 smithi172 ceph-mon[33377]: pgmap v3701: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:42:41.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:41 smithi194 ceph-mon[33679]: pgmap v3701: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T08:42:41.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.865+0000 7f42c0c00700 1 -- 172.21.15.70:0/1674926252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc0756d0 msgr2=0x7f42bc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:41.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.865+0000 7f42c0c00700 1 --2- 172.21.15.70:0/1674926252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc0756d0 0x7f42bc075ab0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00b0a0 tx=0x7f42ac00b3b0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.865+0000 7f42c0c00700 1 -- 172.21.15.70:0/1674926252 shutdown_connections 2024-05-08T08:42:41.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.865+0000 7f42c0c00700 1 --2- 172.21.15.70:0/1674926252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42bc1146d0 0x7f42bc116ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.865+0000 7f42c0c00700 1 --2- 172.21.15.70:0/1674926252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc0756d0 0x7f42bc075ab0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.865+0000 7f42c0c00700 1 --2- 172.21.15.70:0/1674926252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42bc075ff0 0x7f42bc114190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.865+0000 7f42c0c00700 1 -- 172.21.15.70:0/1674926252 >> 172.21.15.70:0/1674926252 conn(0x7f42bc07a5f0 msgr2=0x7f42bc07aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:41.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.865+0000 7f42c0c00700 1 -- 172.21.15.70:0/1674926252 shutdown_connections 2024-05-08T08:42:41.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.866+0000 7f42c0c00700 1 -- 172.21.15.70:0/1674926252 wait complete. 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.866+0000 7f42c0c00700 1 Processor -- start 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.867+0000 7f42c0c00700 1 -- start start 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.867+0000 7f42c0c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42bc0756d0 0x7f42bc1a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.867+0000 7f42c0c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc075ff0 0x7f42bc1a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.867+0000 7f42c0c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42bc1146d0 0x7f42bc1a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.867+0000 7f42c0c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc119c50 con 0x7f42bc075ff0 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.867+0000 7f42c0c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc119ad0 con 0x7f42bc1146d0 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.867+0000 7f42c0c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc119dd0 con 0x7f42bc0756d0 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.867+0000 7f42b1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc075ff0 0x7f42bc1a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.868+0000 7f42b1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc075ff0 0x7f42bc1a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55002/0 (socket says 172.21.15.70:55002) 2024-05-08T08:42:41.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.868+0000 7f42b1400700 1 -- 172.21.15.70:0/4211858798 learned_addr learned my addr 172.21.15.70:0/4211858798 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:41.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.868+0000 7f42b1400700 1 -- 172.21.15.70:0/4211858798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42bc0756d0 msgr2=0x7f42bc1a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.868+0000 7f42b1400700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42bc0756d0 0x7f42bc1a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.868+0000 7f42b1400700 1 -- 172.21.15.70:0/4211858798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42bc1146d0 msgr2=0x7f42bc1a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.868+0000 7f42b1400700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42bc1146d0 0x7f42bc1a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.868+0000 7f42b1400700 1 -- 172.21.15.70:0/4211858798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc1a5190 con 0x7f42bc075ff0 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.868+0000 7f42b1400700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc075ff0 0x7f42bc1a06c0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f42a400b530 tx=0x7f42a400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.869+0000 7f42b3400700 1 -- 172.21.15.70:0/4211858798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4015020 con 0x7f42bc075ff0 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.869+0000 7f42b3400700 1 -- 172.21.15.70:0/4211858798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42a4011cc0 con 0x7f42bc075ff0 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.869+0000 7f42c0c00700 1 -- 172.21.15.70:0/4211858798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42bc1a5480 con 0x7f42bc075ff0 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.869+0000 7f42b3400700 1 -- 172.21.15.70:0/4211858798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4010d30 con 0x7f42bc075ff0 2024-05-08T08:42:41.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.869+0000 7f42c0c00700 1 -- 172.21.15.70:0/4211858798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42bc1acd00 con 0x7f42bc075ff0 2024-05-08T08:42:41.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.873+0000 7f42b3400700 1 -- 172.21.15.70:0/4211858798 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f42a4018020 con 0x7f42bc075ff0 2024-05-08T08:42:41.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.874+0000 7f42b3400700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42a00b29f0 0x7f42a00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.874+0000 7f42b3400700 1 -- 172.21.15.70:0/4211858798 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(309..309 src has 1..309) ==== 9583+0+0 (secure 0 0 0) 0x7f42a40e2220 con 0x7f42bc075ff0 2024-05-08T08:42:41.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.874+0000 7f42b9e00700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42a00b29f0 0x7f42a00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.875+0000 7f42b9e00700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42a00b29f0 0x7f42a00b4eb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009e60 tx=0x7f42ac00b7b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:41.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.892+0000 7f42cb59eb80 1 Processor -- start 2024-05-08T08:42:41.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.892+0000 7f42cb59eb80 1 -- start start 2024-05-08T08:42:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.892+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c513b1b0 0x55e5c513b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.892+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 0x55e5c5135c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.893+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 0x55e5c5141f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.893+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5c5087b20 con 0x55e5c513b1b0 2024-05-08T08:42:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.893+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e5c5025860 con 0x55e5c5135780 2024-05-08T08:42:41.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.893+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e5c5083ae0 con 0x55e5c5136140 2024-05-08T08:42:41.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.893+0000 7f42b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c513b1b0 0x55e5c513b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.893+0000 7f42b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c513b1b0 0x55e5c513b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55008/0 (socket says 172.21.15.70:55008) 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.893+0000 7f42b9e00700 1 -- 172.21.15.70:0/364869532 learned_addr learned my addr 172.21.15.70:0/364869532 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.893+0000 7f42ba800700 1 --2- 172.21.15.70:0/364869532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 0x55e5c5141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.893+0000 7f42b1400700 1 --2- 172.21.15.70:0/364869532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 0x55e5c5135c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.894+0000 7f42b9e00700 1 -- 172.21.15.70:0/364869532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 msgr2=0x55e5c5141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.894+0000 7f42b9e00700 1 --2- 172.21.15.70:0/364869532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 0x55e5c5141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.894+0000 7f42b9e00700 1 -- 172.21.15.70:0/364869532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 msgr2=0x55e5c5135c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.894+0000 7f42b9e00700 1 --2- 172.21.15.70:0/364869532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 0x55e5c5135c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.894+0000 7f42b9e00700 1 -- 172.21.15.70:0/364869532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c4fd49d0 con 0x55e5c513b1b0 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.894+0000 7f42b9e00700 1 --2- 172.21.15.70:0/364869532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c513b1b0 0x55e5c513b590 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009500 tx=0x7f42ac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4702c215f01eabcc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.894+0000 7f42ab400700 1 -- 172.21.15.70:0/364869532 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac02d070 con 0x55e5c513b1b0 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.894+0000 7f42ab400700 1 -- 172.21.15.70:0/364869532 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42ac024040 con 0x55e5c513b1b0 2024-05-08T08:42:41.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.894+0000 7f42ab400700 1 -- 172.21.15.70:0/364869532 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac01d810 con 0x55e5c513b1b0 2024-05-08T08:42:41.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.895+0000 7f42cb59eb80 1 -- 172.21.15.70:0/364869532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c513b1b0 msgr2=0x55e5c513b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:41.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.895+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/364869532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c513b1b0 0x55e5c513b590 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009500 tx=0x7f42ac01a000 comp rx=0 tx=0).stop 2024-05-08T08:42:41.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.895+0000 7f42cb59eb80 1 -- 172.21.15.70:0/364869532 shutdown_connections 2024-05-08T08:42:41.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.895+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/364869532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 0x55e5c5141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.895+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/364869532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c513b1b0 0x55e5c513b590 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.895+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/364869532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 0x55e5c5135c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.895+0000 7f42cb59eb80 1 -- 172.21.15.70:0/364869532 >> 172.21.15.70:0/364869532 conn(0x55e5c50ad7d0 msgr2=0x55e5c5130070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:41.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.896+0000 7f42cb59eb80 1 -- 172.21.15.70:0/364869532 shutdown_connections 2024-05-08T08:42:41.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.896+0000 7f42cb59eb80 1 -- 172.21.15.70:0/364869532 wait complete. 2024-05-08T08:42:41.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.896+0000 7f42cb59eb80 1 -- start start 2024-05-08T08:42:41.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.897+0000 7f42cb59eb80 1 Processor -- start 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.897+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5135780 0x55e5c5141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.897+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 0x55e5c513ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.897+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c513b1b0 0x55e5c513f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.897+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e5c5142510 con 0x55e5c5135780 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.897+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e5c4fedc20 con 0x55e5c513b1b0 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.897+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e5c5142690 con 0x55e5c5136140 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.897+0000 7f42cb59eb80 10 client.0 _ll_register_callbacks cb 0x55e5c502ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5135780 0x55e5c5141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5135780 0x55e5c5141ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55016/0 (socket says 172.21.15.70:55016) 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b9e00700 1 -- 172.21.15.70:0/3811354718 learned_addr learned my addr 172.21.15.70:0/3811354718 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b1400700 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 0x55e5c513ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42ba800700 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c513b1b0 0x55e5c513f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b9e00700 1 -- 172.21.15.70:0/3811354718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 msgr2=0x55e5c513ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:41.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b9e00700 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 0x55e5c513ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b9e00700 1 -- 172.21.15.70:0/3811354718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c513b1b0 msgr2=0x55e5c513f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:41.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b9e00700 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c513b1b0 0x55e5c513f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b9e00700 1 -- 172.21.15.70:0/3811354718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c504d520 con 0x55e5c5135780 2024-05-08T08:42:41.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f42b9e00700 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5135780 0x55e5c5141ba0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00b000 tx=0x7f42ac007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3c56af73ce9586 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:41.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.898+0000 7f429fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:42:41.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.899+0000 7f429fe00700 1 -- 172.21.15.70:0/3811354718 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac035020 con 0x55e5c5135780 2024-05-08T08:42:41.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.899+0000 7f429fe00700 1 -- 172.21.15.70:0/3811354718 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(309..309 src has 1..309) ==== 9583+0+0 (secure 0 0 0) 0x7f42ac01d670 con 0x55e5c5135780 2024-05-08T08:42:41.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.899+0000 7f42cb59eb80 1 -- 172.21.15.70:0/3811354718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42ac024040 con 0x55e5c5135780 2024-05-08T08:42:41.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.899+0000 7f429fe00700 1 -- 172.21.15.70:0/3811354718 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f42ac040050 con 0x55e5c5135780 2024-05-08T08:42:41.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.899+0000 7f42cb59eb80 10 client.18468 fetch_fsmap learned FSMap version 42 2024-05-08T08:42:41.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.899+0000 7f42cb59eb80 1 -- 172.21.15.70:0/3811354718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e5c514cd30 con 0x55e5c5135780 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.899+0000 7f429fe00700 1 -- 172.21.15.70:0/3811354718 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42ac024040 con 0x55e5c5135780 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.900+0000 7f429fe00700 1 -- 172.21.15.70:0/3811354718 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f42ac030030 con 0x55e5c5135780 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.900+0000 7f42cb59eb80 10 client.18468 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.900+0000 7f42cb59eb80 10 client.18468 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.900+0000 7f42cb59eb80 20 client.18468 populate_metadata read hostname 'smithi070' 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.900+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e5c514f200 0x55e5c51515f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.900+0000 7f42cb59eb80 4 client.18468 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.900+0000 7f42cb59eb80 1 -- 172.21.15.70:0/3811354718 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5c5102240 con 0x55e5c514f200 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.900+0000 7f42b1400700 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e5c514f200 0x55e5c51515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.901+0000 7f42b1400700 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e5c514f200 0x55e5c51515f0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17d1dde24735650f server_cookie=61adcbf42b9c7cf8 in_seq=0 out_seq=0 2024-05-08T08:42:41.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.901+0000 7f429fe00700 10 client.18468 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:42:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.903+0000 7f429fe00700 1 -- 172.21.15.70:0/3811354718 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e5c5102240 con 0x55e5c514f200 2024-05-08T08:42:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.903+0000 7f429fe00700 10 client.18468 handle_command_reply: tid=0 2024-05-08T08:42:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.903+0000 7f42cb59eb80 1 client.18468 shutdown 2024-05-08T08:42:41.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 -- 172.21.15.70:0/3811354718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5135780 msgr2=0x55e5c5141ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5135780 0x55e5c5141ba0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00b000 tx=0x7f42ac007c20 comp rx=0 tx=0).stop 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 -- 172.21.15.70:0/3811354718 shutdown_connections 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e5c514f200 0x55e5c51515f0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c513b1b0 0x55e5c513f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5135780 0x55e5c5141ba0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/3811354718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5136140 0x55e5c513ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 -- 172.21.15.70:0/3811354718 >> 172.21.15.70:0/3811354718 conn(0x55e5c50ad7d0 msgr2=0x55e5c512ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f429fe00700 0 client.18468 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 -- 172.21.15.70:0/3811354718 shutdown_connections 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 1 -- 172.21.15.70:0/3811354718 wait complete. 2024-05-08T08:42:41.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.904+0000 7f42cb59eb80 20 client.18468 trim_cache size 0 max 16384 2024-05-08T08:42:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.926+0000 7f42cb59eb80 1 Processor -- start 2024-05-08T08:42:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.926+0000 7f42cb59eb80 1 -- start start 2024-05-08T08:42:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.926+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 0x55e5c5140d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.926+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5154230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.926+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c513b1b0 0x55e5c5154770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.926+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc1b8500 con 0x55e5c5136140 2024-05-08T08:42:41.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.926+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc1b5d90 con 0x55e5c5135780 2024-05-08T08:42:41.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.926+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc1b3c00 con 0x55e5c513b1b0 2024-05-08T08:42:41.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.927+0000 7f42b1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.927+0000 7f42b1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5154230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55028/0 (socket says 172.21.15.70:55028) 2024-05-08T08:42:41.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.927+0000 7f42b1400700 1 -- 172.21.15.70:0/1366376593 learned_addr learned my addr 172.21.15.70:0/1366376593 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:41.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.927+0000 7f42ba800700 1 --2- 172.21.15.70:0/1366376593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c513b1b0 0x55e5c5154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42b9e00700 1 --2- 172.21.15.70:0/1366376593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 0x55e5c5140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42b1400700 1 -- 172.21.15.70:0/1366376593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c513b1b0 msgr2=0x55e5c5154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:41.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42b1400700 1 --2- 172.21.15.70:0/1366376593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c513b1b0 0x55e5c5154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42b1400700 1 -- 172.21.15.70:0/1366376593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 msgr2=0x55e5c5140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:41.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42b1400700 1 --2- 172.21.15.70:0/1366376593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 0x55e5c5140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42b1400700 1 -- 172.21.15.70:0/1366376593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5c512cc70 con 0x55e5c5136140 2024-05-08T08:42:41.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42b1400700 1 --2- 172.21.15.70:0/1366376593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5154230 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f42a400b500 tx=0x7f42a40a8f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df71d667d7a2a7c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:41.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42aaa00700 1 -- 172.21.15.70:0/1366376593 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a40ad540 con 0x55e5c5136140 2024-05-08T08:42:41.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42aaa00700 1 -- 172.21.15.70:0/1366376593 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42a40b1ff0 con 0x55e5c5136140 2024-05-08T08:42:41.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.928+0000 7f42aaa00700 1 -- 172.21.15.70:0/1366376593 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a40df900 con 0x55e5c5136140 2024-05-08T08:42:41.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.929+0000 7f42cb59eb80 1 -- 172.21.15.70:0/1366376593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 msgr2=0x55e5c5154230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:41.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.929+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/1366376593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5154230 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f42a400b500 tx=0x7f42a40a8f60 comp rx=0 tx=0).stop 2024-05-08T08:42:41.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.929+0000 7f42cb59eb80 1 -- 172.21.15.70:0/1366376593 shutdown_connections 2024-05-08T08:42:41.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.929+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/1366376593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c513b1b0 0x55e5c5154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.929+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/1366376593 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c5135780 0x55e5c5140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.929+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/1366376593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5154230 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.929+0000 7f42cb59eb80 1 -- 172.21.15.70:0/1366376593 >> 172.21.15.70:0/1366376593 conn(0x55e5c50ad7d0 msgr2=0x55e5c51405f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:41.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.929+0000 7f42cb59eb80 1 -- 172.21.15.70:0/1366376593 shutdown_connections 2024-05-08T08:42:41.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.929+0000 7f42cb59eb80 1 -- 172.21.15.70:0/1366376593 wait complete. 2024-05-08T08:42:41.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.930+0000 7f42cb59eb80 1 -- start start 2024-05-08T08:42:41.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.930+0000 7f42cb59eb80 1 Processor -- start 2024-05-08T08:42:41.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5135780 0x55e5c5154670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5152a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42cb59eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c513b1b0 0x55e5c5152f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc1b4250 con 0x55e5c5136140 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc1b56c0 con 0x55e5c513b1b0 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42cb59eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc1b4920 con 0x55e5c5135780 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42cb59eb80 10 client.0 _ll_register_callbacks cb 0x55e5c502ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42b1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42b1400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5152a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55030/0 (socket says 172.21.15.70:55030) 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42b1400700 1 -- 172.21.15.70:0/606247825 learned_addr learned my addr 172.21.15.70:0/606247825 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42b9e00700 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5135780 0x55e5c5154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42b1400700 1 -- 172.21.15.70:0/606247825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5135780 msgr2=0x55e5c5154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42b1400700 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5135780 0x55e5c5154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42b1400700 1 -- 172.21.15.70:0/606247825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c513b1b0 msgr2=0x55e5c5152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:41.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.931+0000 7f42b1400700 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c513b1b0 0x55e5c5152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:41.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.932+0000 7f42b1400700 1 -- 172.21.15.70:0/606247825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5c51536b0 con 0x55e5c5136140 2024-05-08T08:42:41.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.932+0000 7f42b1400700 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5152a20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f42a40a8e40 tx=0x7f42a40a8a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6503354e57360267 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:41.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.932+0000 7f429fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:42:41.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.932+0000 7f429fe00700 1 -- 172.21.15.70:0/606247825 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a40c2070 con 0x55e5c5136140 2024-05-08T08:42:41.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.932+0000 7f429fe00700 1 -- 172.21.15.70:0/606247825 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(309..309 src has 1..309) ==== 9583+0+0 (secure 0 0 0) 0x7f42a40ad140 con 0x55e5c5136140 2024-05-08T08:42:41.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.932+0000 7f42cb59eb80 1 -- 172.21.15.70:0/606247825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42a40b1ff0 con 0x55e5c5136140 2024-05-08T08:42:41.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.932+0000 7f429fe00700 1 -- 172.21.15.70:0/606247825 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f42a40ad340 con 0x55e5c5136140 2024-05-08T08:42:41.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.932+0000 7f42cb59eb80 10 client.18474 fetch_fsmap learned FSMap version 42 2024-05-08T08:42:41.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.932+0000 7f42cb59eb80 1 -- 172.21.15.70:0/606247825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e5c51ba6f0 con 0x55e5c5136140 2024-05-08T08:42:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.933+0000 7f429fe00700 1 -- 172.21.15.70:0/606247825 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42a40b1ff0 con 0x55e5c5136140 2024-05-08T08:42:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.933+0000 7f429fe00700 1 -- 172.21.15.70:0/606247825 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f42a40b1b60 con 0x55e5c5136140 2024-05-08T08:42:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.933+0000 7f42cb59eb80 10 client.18474 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:42:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.933+0000 7f42cb59eb80 10 client.18474 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:42:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.933+0000 7f42cb59eb80 20 client.18474 populate_metadata read hostname 'smithi070' 2024-05-08T08:42:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.933+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e5c51bae30 0x55e5c51bd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.933+0000 7f42cb59eb80 4 client.18474 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "cbc78c63", "release": true, "await": true}] 2024-05-08T08:42:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.933+0000 7f42cb59eb80 1 -- 172.21.15.70:0/606247825 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "cbc78c63", "release": true, "await": true}) -- 0x55e5c5095500 con 0x55e5c51bae30 2024-05-08T08:42:41.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.934+0000 7f42b9e00700 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e5c51bae30 0x55e5c51bd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.936+0000 7f42b9e00700 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e5c51bae30 0x55e5c51bd250 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee2d15a6eb207db8 server_cookie=185f854becd2c69f in_seq=0 out_seq=0 2024-05-08T08:42:41.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:41.936+0000 7f429fe00700 10 client.18474 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:42:43.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:43 smithi070 ceph-mon[29591]: pgmap v3702: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:42:43.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:43 smithi172 ceph-mon[33377]: pgmap v3702: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:42:43.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:43 smithi194 ceph-mon[33679]: pgmap v3702: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:42:45.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:45 smithi070 ceph-mon[29591]: pgmap v3703: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:42:45.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:45 smithi172 ceph-mon[33377]: pgmap v3703: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:42:45.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:45 smithi194 ceph-mon[33679]: pgmap v3703: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:42:46.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.589+0000 7f429fe00700 1 -- 172.21.15.70:0/606247825 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55e5c5095500 con 0x55e5c51bae30 2024-05-08T08:42:46.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.589+0000 7f429fe00700 10 client.18474 handle_command_reply: tid=0 2024-05-08T08:42:46.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.589+0000 7f42cb59eb80 1 client.18474 shutdown 2024-05-08T08:42:46.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.589+0000 7f42cb59eb80 1 -- 172.21.15.70:0/606247825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 msgr2=0x55e5c5152a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:46.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.589+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5152a20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f42a40a8e40 tx=0x7f42a40a8a00 comp rx=0 tx=0).stop 2024-05-08T08:42:46.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.590+0000 7f42cb59eb80 1 -- 172.21.15.70:0/606247825 shutdown_connections 2024-05-08T08:42:46.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.590+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e5c51bae30 0x55e5c51bd250 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.590+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e5c513b1b0 0x55e5c5152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.590+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e5c5135780 0x55e5c5154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.590+0000 7f42cb59eb80 1 --2- 172.21.15.70:0/606247825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e5c5136140 0x55e5c5152a20 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.590+0000 7f42cb59eb80 1 -- 172.21.15.70:0/606247825 >> 172.21.15.70:0/606247825 conn(0x55e5c50ad7d0 msgr2=0x55e5c512ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:46.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.590+0000 7f429fe00700 0 client.18474 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:42:46.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.591+0000 7f42cb59eb80 1 -- 172.21.15.70:0/606247825 shutdown_connections 2024-05-08T08:42:46.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.591+0000 7f42cb59eb80 1 -- 172.21.15.70:0/606247825 wait complete. 2024-05-08T08:42:46.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.591+0000 7f42cb59eb80 20 client.18474 trim_cache size 0 max 16384 2024-05-08T08:42:46.584 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 260, 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "cbc78c63": { 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 260, 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:42:46.585 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.2, 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:42:46.586 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:42:46.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 -- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42a00b29f0 msgr2=0x7f42a00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:46.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42a00b29f0 0x7f42a00b4eb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009e60 tx=0x7f42ac00b7b0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 -- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc075ff0 msgr2=0x7f42bc1a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:46.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc075ff0 0x7f42bc1a06c0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f42a400b530 tx=0x7f42a400b8f0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 -- 172.21.15.70:0/4211858798 shutdown_connections 2024-05-08T08:42:46.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42a00b29f0 0x7f42a00b4eb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42bc1146d0 0x7f42bc1a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42bc0756d0 0x7f42bc1a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 --2- 172.21.15.70:0/4211858798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42bc075ff0 0x7f42bc1a06c0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:46.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.593+0000 7f42c0c00700 1 -- 172.21.15.70:0/4211858798 >> 172.21.15.70:0/4211858798 conn(0x7f42bc07a5f0 msgr2=0x7f42bc113500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:46.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.594+0000 7f42c0c00700 1 -- 172.21.15.70:0/4211858798 shutdown_connections 2024-05-08T08:42:46.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:46.594+0000 7f42c0c00700 1 -- 172.21.15.70:0/4211858798 wait complete. 2024-05-08T08:42:46.648 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ping.o 2024-05-08T08:42:46.934 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/9p/mod.o 2024-05-08T08:42:47.417 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:47 smithi070 ceph-mon[29591]: pgmap v3704: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T08:42:47.558 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'cbc78c63', seconds elapsed: 84.2 2024-05-08T08:42:47.558 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.15 2024-05-08T08:42:47.558 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:42:47.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:47 smithi172 ceph-mon[33377]: pgmap v3704: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T08:42:47.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:47 smithi194 ceph-mon[33679]: pgmap v3704: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T08:42:48.005 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/syncookies.o 2024-05-08T08:42:48.117 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:42:49.125 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/wakeup.o 2024-05-08T08:42:49.311 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/compat_binfmt_elf.o 2024-05-08T08:42:49.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:49 smithi070 ceph-mon[29591]: pgmap v3705: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 5 op/s 2024-05-08T08:42:49.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:49 smithi172 ceph-mon[33377]: pgmap v3705: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 5 op/s 2024-05-08T08:42:49.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:49 smithi194 ceph-mon[33679]: pgmap v3705: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 5 op/s 2024-05-08T08:42:49.789 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/key.o 2024-05-08T08:42:49.810 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/mbcache.o 2024-05-08T08:42:49.850 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/cache.o 2024-05-08T08:42:50.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.615+0000 7fe0f3200700 1 -- 172.21.15.70:0/2606156319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4102ee0 msgr2=0x7fe0f4106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:50.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.615+0000 7fe0f3200700 1 --2- 172.21.15.70:0/2606156319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4102ee0 0x7fe0f4106f30 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0009920 tx=0x7fe0e0009c30 comp rx=0 tx=0).stop 2024-05-08T08:42:50.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.615+0000 7fe0f3200700 1 -- 172.21.15.70:0/2606156319 shutdown_connections 2024-05-08T08:42:50.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.615+0000 7fe0f3200700 1 --2- 172.21.15.70:0/2606156319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f4107610 0x7fe0f410f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:50.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.615+0000 7fe0f3200700 1 --2- 172.21.15.70:0/2606156319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0f4102530 0x7fe0f4102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:50.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.615+0000 7fe0f3200700 1 --2- 172.21.15.70:0/2606156319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4102ee0 0x7fe0f4106f30 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:50.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.615+0000 7fe0f3200700 1 -- 172.21.15.70:0/2606156319 >> 172.21.15.70:0/2606156319 conn(0x7fe0f40fddc0 msgr2=0x7fe0f41001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:50.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.615+0000 7fe0f3200700 1 -- 172.21.15.70:0/2606156319 shutdown_connections 2024-05-08T08:42:50.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.615+0000 7fe0f3200700 1 -- 172.21.15.70:0/2606156319 wait complete. 2024-05-08T08:42:50.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.617+0000 7fe0f3200700 1 Processor -- start 2024-05-08T08:42:50.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.617+0000 7fe0f3200700 1 -- start start 2024-05-08T08:42:50.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.617+0000 7fe0f3200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0f4102530 0x7fe0f419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:50.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.617+0000 7fe0f3200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f4102ee0 0x7fe0f419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:50.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f3200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4107610 0x7fe0f41a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:50.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f3200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f4113480 con 0x7fe0f4107610 2024-05-08T08:42:50.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f3200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f4113300 con 0x7fe0f4102ee0 2024-05-08T08:42:50.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f3200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f4113600 con 0x7fe0f4102530 2024-05-08T08:42:50.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4107610 0x7fe0f41a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:50.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4107610 0x7fe0f41a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55524/0 (socket says 172.21.15.70:55524) 2024-05-08T08:42:50.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f2800700 1 -- 172.21.15.70:0/3810789120 learned_addr learned my addr 172.21.15.70:0/3810789120 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:50.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f1400700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f4102ee0 0x7fe0f419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:50.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f1e00700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0f4102530 0x7fe0f419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f2800700 1 -- 172.21.15.70:0/3810789120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0f4102530 msgr2=0x7fe0f419bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.618+0000 7fe0f2800700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0f4102530 0x7fe0f419bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.619+0000 7fe0f2800700 1 -- 172.21.15.70:0/3810789120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f4102ee0 msgr2=0x7fe0f419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.619+0000 7fe0f2800700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f4102ee0 0x7fe0f419c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.619+0000 7fe0f2800700 1 -- 172.21.15.70:0/3810789120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f41a0ca0 con 0x7fe0f4107610 2024-05-08T08:42:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.619+0000 7fe0f1400700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f4102ee0 0x7fe0f419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:42:50.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.619+0000 7fe0f2800700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4107610 0x7fe0f41a0560 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00e3c0 tx=0x7fe0ec00e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:50.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.619+0000 7fe0eaa00700 1 -- 172.21.15.70:0/3810789120 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0092d0 con 0x7fe0f4107610 2024-05-08T08:42:50.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.620+0000 7fe0eaa00700 1 -- 172.21.15.70:0/3810789120 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0ec0075c0 con 0x7fe0f4107610 2024-05-08T08:42:50.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.620+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f41a0f90 con 0x7fe0f4107610 2024-05-08T08:42:50.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.620+0000 7fe0eaa00700 1 -- 172.21.15.70:0/3810789120 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec004270 con 0x7fe0f4107610 2024-05-08T08:42:50.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.620+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f41a8810 con 0x7fe0f4107610 2024-05-08T08:42:50.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.622+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f406a190 con 0x7fe0f4107610 2024-05-08T08:42:50.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.625+0000 7fe0eaa00700 1 -- 172.21.15.70:0/3810789120 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe0ec012050 con 0x7fe0f4107610 2024-05-08T08:42:50.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.626+0000 7fe0eaa00700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d80b2af0 0x7fe0d80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:50.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.627+0000 7fe0eaa00700 1 -- 172.21.15.70:0/3810789120 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(309..309 src has 1..309) ==== 9583+0+0 (secure 0 0 0) 0x7fe0ec0e2550 con 0x7fe0f4107610 2024-05-08T08:42:50.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.628+0000 7fe0f1e00700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d80b2af0 0x7fe0d80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:50.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.630+0000 7fe0f1e00700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d80b2af0 0x7fe0d80b4fb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009bf0 tx=0x7fe0e4009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:50.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:50.635+0000 7fe0eaa00700 1 -- 172.21.15.70:0/3810789120 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe0ec022060 con 0x7fe0f4107610 2024-05-08T08:42:51.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.110+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0f41a89e0 con 0x7fe0f4107610 2024-05-08T08:42:51.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.112+0000 7fe0eaa00700 1 -- 172.21.15.70:0/3810789120 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fe0ec010040 con 0x7fe0f4107610 2024-05-08T08:42:51.104 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:42:51.104 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:42:51.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d80b2af0 msgr2=0x7fe0d80b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:51.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d80b2af0 0x7fe0d80b4fb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009bf0 tx=0x7fe0e4009260 comp rx=0 tx=0).stop 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4107610 msgr2=0x7fe0f41a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4107610 0x7fe0f41a0560 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00e3c0 tx=0x7fe0ec00e780 comp rx=0 tx=0).stop 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 shutdown_connections 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0d80b2af0 0x7fe0d80b4fb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0f4107610 0x7fe0f41a0560 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0f4102530 0x7fe0f419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 --2- 172.21.15.70:0/3810789120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0f4102ee0 0x7fe0f419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.115+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 >> 172.21.15.70:0/3810789120 conn(0x7fe0f40fddc0 msgr2=0x7fe0f40ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.116+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 shutdown_connections 2024-05-08T08:42:51.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:51.116+0000 7fe0f3200700 1 -- 172.21.15.70:0/3810789120 wait complete. 2024-05-08T08:42:51.110 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:42:51.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:51 smithi070 ceph-mon[29591]: pgmap v3706: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 174 KiB/s wr, 14 op/s 2024-05-08T08:42:51.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:51 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3810789120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:42:51.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:51 smithi172 ceph-mon[33377]: pgmap v3706: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 174 KiB/s wr, 14 op/s 2024-05-08T08:42:51.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:51 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3810789120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:42:51.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:51 smithi194 ceph-mon[33679]: pgmap v3706: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 174 KiB/s wr, 14 op/s 2024-05-08T08:42:51.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:51 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3810789120' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:42:51.930 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 85.15 --await-for 42.0' 2024-05-08T08:42:51.930 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 85.15 --await-for 42.0 2024-05-08T08:42:52.502 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:42:53.342 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:53 smithi070 ceph-mon[29591]: pgmap v3707: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 12 op/s 2024-05-08T08:42:53.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:53 smithi172 ceph-mon[33377]: pgmap v3707: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 12 op/s 2024-05-08T08:42:53.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:53 smithi194 ceph-mon[33679]: pgmap v3707: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 12 op/s 2024-05-08T08:42:55.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.047+0000 7f9d4b200700 1 -- 172.21.15.70:0/1781835119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d44075ff0 msgr2=0x7f9d4410f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:55.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.047+0000 7f9d4b200700 1 --2- 172.21.15.70:0/1781835119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d44075ff0 0x7f9d4410f9c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009990 tx=0x7f9d30009ca0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.047+0000 7f9d4b200700 1 -- 172.21.15.70:0/1781835119 shutdown_connections 2024-05-08T08:42:55.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.047+0000 7f9d4b200700 1 --2- 172.21.15.70:0/1781835119 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d4410ff00 0x7f9d441122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.047+0000 7f9d4b200700 1 --2- 172.21.15.70:0/1781835119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d440756d0 0x7f9d44075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.047+0000 7f9d4b200700 1 --2- 172.21.15.70:0/1781835119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d44075ff0 0x7f9d4410f9c0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.047+0000 7f9d4b200700 1 -- 172.21.15.70:0/1781835119 >> 172.21.15.70:0/1781835119 conn(0x7f9d4407a600 msgr2=0x7f9d4407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:55.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.048+0000 7f9d4b200700 1 -- 172.21.15.70:0/1781835119 shutdown_connections 2024-05-08T08:42:55.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.048+0000 7f9d4b200700 1 -- 172.21.15.70:0/1781835119 wait complete. 2024-05-08T08:42:55.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.050+0000 7f9d4b200700 1 Processor -- start 2024-05-08T08:42:55.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.050+0000 7f9d4b200700 1 -- start start 2024-05-08T08:42:55.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.050+0000 7f9d4b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d440756d0 0x7f9d4410ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.050+0000 7f9d4b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d44075ff0 0x7f9d4410f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.050+0000 7f9d4b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d4410ff00 0x7f9d441a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.050+0000 7f9d4b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d44104f80 con 0x7f9d44075ff0 2024-05-08T08:42:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.050+0000 7f9d4b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d44104e00 con 0x7f9d440756d0 2024-05-08T08:42:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.050+0000 7f9d4b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9d44105100 con 0x7f9d4410ff00 2024-05-08T08:42:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.051+0000 7f9d43e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d440756d0 0x7f9d4410ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.051+0000 7f9d43e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d440756d0 0x7f9d4410ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:59280/0 (socket says 172.21.15.70:59280) 2024-05-08T08:42:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.051+0000 7f9d43e00700 1 -- 172.21.15.70:0/4130909014 learned_addr learned my addr 172.21.15.70:0/4130909014 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:55.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.051+0000 7f9d43400700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d44075ff0 0x7f9d4410f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.052+0000 7f9d43e00700 1 -- 172.21.15.70:0/4130909014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d4410ff00 msgr2=0x7f9d441a4930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T08:42:55.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.052+0000 7f9d43e00700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d4410ff00 0x7f9d441a4930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.052+0000 7f9d43e00700 1 -- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d44075ff0 msgr2=0x7f9d4410f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:55.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.052+0000 7f9d43e00700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d44075ff0 0x7f9d4410f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.052+0000 7f9d43e00700 1 -- 172.21.15.70:0/4130909014 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d441a5040 con 0x7f9d440756d0 2024-05-08T08:42:55.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.053+0000 7f9d43e00700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d440756d0 0x7f9d4410ec40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b530 tx=0x7f9d3400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:55.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.053+0000 7f9d40c00700 1 -- 172.21.15.70:0/4130909014 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34015020 con 0x7f9d440756d0 2024-05-08T08:42:55.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.053+0000 7f9d40c00700 1 -- 172.21.15.70:0/4130909014 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d34011cc0 con 0x7f9d440756d0 2024-05-08T08:42:55.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.053+0000 7f9d40c00700 1 -- 172.21.15.70:0/4130909014 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d34010dc0 con 0x7f9d440756d0 2024-05-08T08:42:55.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.053+0000 7f9d4b200700 1 -- 172.21.15.70:0/4130909014 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d441a5330 con 0x7f9d440756d0 2024-05-08T08:42:55.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.054+0000 7f9d4b200700 1 -- 172.21.15.70:0/4130909014 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d441acbc0 con 0x7f9d440756d0 2024-05-08T08:42:55.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.059+0000 7f9d55bc4b80 1 Processor -- start 2024-05-08T08:42:55.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.060+0000 7f9d55bc4b80 1 -- start start 2024-05-08T08:42:55.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.061+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c9f50 0x5612b41ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.061+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c4520 0x5612b41c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.061+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.061+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5612b4116bb0 con 0x5612b41c4520 2024-05-08T08:42:55.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.061+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5612b40b48f0 con 0x5612b41c4ee0 2024-05-08T08:42:55.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.061+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5612b4112b70 con 0x5612b41c9f50 2024-05-08T08:42:55.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.062+0000 7f9d49200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c9f50 0x5612b41ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.062+0000 7f9d49200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c9f50 0x5612b41ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:46356/0 (socket says 172.21.15.70:46356) 2024-05-08T08:42:55.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.062+0000 7f9d49200700 1 -- 172.21.15.70:0/1369941728 learned_addr learned my addr 172.21.15.70:0/1369941728 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:55.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.062+0000 7f9d43400700 1 --2- 172.21.15.70:0/1369941728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.062+0000 7f9d40c00700 1 -- 172.21.15.70:0/4130909014 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9d34018020 con 0x7f9d440756d0 2024-05-08T08:42:55.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.062+0000 7f9d43e00700 1 --2- 172.21.15.70:0/1369941728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c4520 0x5612b41c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.063+0000 7f9d49200700 1 -- 172.21.15.70:0/1369941728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 msgr2=0x5612b41d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:55.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.063+0000 7f9d49200700 1 --2- 172.21.15.70:0/1369941728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.063+0000 7f9d49200700 1 -- 172.21.15.70:0/1369941728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c4520 msgr2=0x5612b41c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:55.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.063+0000 7f9d49200700 1 --2- 172.21.15.70:0/1369941728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c4520 0x5612b41c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.063+0000 7f9d49200700 1 -- 172.21.15.70:0/1369941728 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612b4063a60 con 0x5612b41c9f50 2024-05-08T08:42:55.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.064+0000 7f9d49200700 1 --2- 172.21.15.70:0/1369941728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c9f50 0x5612b41ca330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009d00 tx=0x7f9d3c0077e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16db8c72745589b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:55.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.064+0000 7f9d39600700 1 -- 172.21.15.70:0/1369941728 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c004bb0 con 0x5612b41c9f50 2024-05-08T08:42:55.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.065+0000 7f9d39600700 1 -- 172.21.15.70:0/1369941728 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d3c004d50 con 0x5612b41c9f50 2024-05-08T08:42:55.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.065+0000 7f9d39600700 1 -- 172.21.15.70:0/1369941728 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c013650 con 0x5612b41c9f50 2024-05-08T08:42:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.066+0000 7f9d40c00700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9d280b2bf0 0x7f9d280b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.066+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1369941728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c9f50 msgr2=0x5612b41ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.066+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1369941728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c9f50 0x5612b41ca330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c009d00 tx=0x7f9d3c0077e0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.066+0000 7f9d40c00700 1 -- 172.21.15.70:0/4130909014 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(309..309 src has 1..309) ==== 9583+0+0 (secure 0 0 0) 0x7f9d340e2150 con 0x7f9d440756d0 2024-05-08T08:42:55.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.067+0000 7f9d43e00700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9d280b2bf0 0x7f9d280b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.067+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1369941728 shutdown_connections 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.067+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1369941728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.067+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1369941728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c9f50 0x5612b41ca330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.067+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1369941728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c4520 0x5612b41c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.067+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1369941728 >> 172.21.15.70:0/1369941728 conn(0x5612b40f2cf0 msgr2=0x5612b41bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.067+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1369941728 shutdown_connections 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.067+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1369941728 wait complete. 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.068+0000 7f9d55bc4b80 1 -- start start 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.068+0000 7f9d43e00700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9d280b2bf0 0x7f9d280b50b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9d340a5140 tx=0x7f9d34004750 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.068+0000 7f9d55bc4b80 1 Processor -- start 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.069+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4520 0x5612b41d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.069+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.069+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.069+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5612b41d1310 con 0x5612b41c9f50 2024-05-08T08:42:55.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.069+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5612b407ccb0 con 0x5612b41c4ee0 2024-05-08T08:42:55.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.069+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5612b41d1490 con 0x5612b41c4520 2024-05-08T08:42:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.069+0000 7f9d55bc4b80 10 client.0 _ll_register_callbacks cb 0x5612b40bde00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:42:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.070+0000 7f9d43400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.070+0000 7f9d49200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4520 0x5612b41d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.070+0000 7f9d43400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:59306/0 (socket says 172.21.15.70:59306) 2024-05-08T08:42:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.070+0000 7f9d43400700 1 -- 172.21.15.70:0/1040720662 learned_addr learned my addr 172.21.15.70:0/1040720662 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.071+0000 7f9d49200700 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.072+0000 7f9d43400700 1 -- 172.21.15.70:0/1040720662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4520 msgr2=0x5612b41d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:55.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.072+0000 7f9d43400700 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4520 0x5612b41d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.072+0000 7f9d43400700 1 -- 172.21.15.70:0/1040720662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 msgr2=0x5612b41ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:55.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.072+0000 7f9d43400700 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.072+0000 7f9d43400700 1 -- 172.21.15.70:0/1040720662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612b40dc5b0 con 0x5612b41c4ee0 2024-05-08T08:42:55.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.072+0000 7f9d49200700 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:42:55.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.073+0000 7f9d43400700 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41cdcc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009990 tx=0x7f9d30005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=329d895c3ed4c175 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:55.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.073+0000 7f9d2e000700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:42:55.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.073+0000 7f9d2e000700 1 -- 172.21.15.70:0/1040720662 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30028060 con 0x5612b41c4ee0 2024-05-08T08:42:55.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.073+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1040720662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d3c004d50 con 0x5612b41c4ee0 2024-05-08T08:42:55.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.073+0000 7f9d2e000700 1 -- 172.21.15.70:0/1040720662 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(309..309 src has 1..309) ==== 9583+0+0 (secure 0 0 0) 0x7f9d30005450 con 0x5612b41c4ee0 2024-05-08T08:42:55.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.074+0000 7f9d2e000700 1 -- 172.21.15.70:0/1040720662 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9d30005670 con 0x5612b41c4ee0 2024-05-08T08:42:55.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.074+0000 7f9d55bc4b80 10 client.37250 fetch_fsmap learned FSMap version 42 2024-05-08T08:42:55.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.074+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1040720662 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5612b41dbb90 con 0x5612b41c4ee0 2024-05-08T08:42:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.074+0000 7f9d2e000700 1 -- 172.21.15.70:0/1040720662 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d3c004d50 con 0x5612b41c4ee0 2024-05-08T08:42:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.075+0000 7f9d2e000700 1 -- 172.21.15.70:0/1040720662 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9d3000f560 con 0x5612b41c4ee0 2024-05-08T08:42:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.075+0000 7f9d55bc4b80 10 client.37250 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:42:55.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.075+0000 7f9d55bc4b80 10 client.37250 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:42:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.075+0000 7f9d55bc4b80 20 client.37250 populate_metadata read hostname 'smithi070' 2024-05-08T08:42:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.075+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5612b41de120 0x5612b41e0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.075+0000 7f9d55bc4b80 4 client.37250 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:42:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.075+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1040720662 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612b4191230 con 0x5612b41de120 2024-05-08T08:42:55.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.076+0000 7f9d49200700 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5612b41de120 0x5612b41e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.077+0000 7f9d49200700 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5612b41de120 0x5612b41e0540 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34d2e7ebb1a587b4 server_cookie=62a1814927d96784 in_seq=0 out_seq=0 2024-05-08T08:42:55.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.077+0000 7f9d2e000700 10 client.37250 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:42:55.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.080+0000 7f9d2e000700 1 -- 172.21.15.70:0/1040720662 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5612b4191230 con 0x5612b41de120 2024-05-08T08:42:55.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.080+0000 7f9d2e000700 10 client.37250 handle_command_reply: tid=0 2024-05-08T08:42:55.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.080+0000 7f9d55bc4b80 1 client.37250 shutdown 2024-05-08T08:42:55.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.080+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1040720662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 msgr2=0x5612b41cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:55.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.080+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41cdcc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009990 tx=0x7f9d30005900 comp rx=0 tx=0).stop 2024-05-08T08:42:55.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1040720662 shutdown_connections 2024-05-08T08:42:55.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5612b41de120 0x5612b41e0540 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4520 0x5612b41d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d2e000700 0 client.37250 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:42:55.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/1040720662 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4ee0 0x5612b41cdcc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1040720662 >> 172.21.15.70:0/1040720662 conn(0x5612b40f2cf0 msgr2=0x5612b41b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:55.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1040720662 shutdown_connections 2024-05-08T08:42:55.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/1040720662 wait complete. 2024-05-08T08:42:55.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.081+0000 7f9d55bc4b80 20 client.37250 trim_cache size 0 max 16384 2024-05-08T08:42:55.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.115+0000 7f9d55bc4b80 1 Processor -- start 2024-05-08T08:42:55.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.116+0000 7f9d55bc4b80 1 -- start start 2024-05-08T08:42:55.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.116+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 0x5612b41ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.116+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 0x5612b41da3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.116+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.116+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441b8530 con 0x5612b41c9f50 2024-05-08T08:42:55.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.116+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441b5dc0 con 0x5612b41c4520 2024-05-08T08:42:55.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.116+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441b3c30 con 0x5612b41c4ee0 2024-05-08T08:42:55.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.117+0000 7f9d49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.117+0000 7f9d49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55568/0 (socket says 172.21.15.70:55568) 2024-05-08T08:42:55.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.117+0000 7f9d49200700 1 -- 172.21.15.70:0/3322294143 learned_addr learned my addr 172.21.15.70:0/3322294143 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:55.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.117+0000 7f9d43400700 1 --2- 172.21.15.70:0/3322294143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 0x5612b41da3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.117+0000 7f9d49200700 1 --2- 172.21.15.70:0/3322294143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 0x5612b41ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.118+0000 7f9d49200700 1 -- 172.21.15.70:0/3322294143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 msgr2=0x5612b41da3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:55.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.118+0000 7f9d49200700 1 --2- 172.21.15.70:0/3322294143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 0x5612b41da3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.118+0000 7f9d49200700 1 -- 172.21.15.70:0/3322294143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 msgr2=0x5612b41ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:55.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.118+0000 7f9d49200700 1 --2- 172.21.15.70:0/3322294143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 0x5612b41ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.118+0000 7f9d49200700 1 -- 172.21.15.70:0/3322294143 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612b41c3da0 con 0x5612b41c9f50 2024-05-08T08:42:55.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.118+0000 7f9d49200700 1 --2- 172.21.15.70:0/3322294143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41c80e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c005bd0 tx=0x7f9d3c0090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc46ab65b625dddd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.118+0000 7f9d38c00700 1 -- 172.21.15.70:0/3322294143 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c003a00 con 0x5612b41c9f50 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.119+0000 7f9d38c00700 1 -- 172.21.15.70:0/3322294143 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d3c005470 con 0x5612b41c9f50 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.119+0000 7f9d38c00700 1 -- 172.21.15.70:0/3322294143 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c004280 con 0x5612b41c9f50 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.120+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/3322294143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 msgr2=0x5612b41c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.120+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/3322294143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41c80e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c005bd0 tx=0x7f9d3c0090e0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.120+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/3322294143 shutdown_connections 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.120+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/3322294143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41c80e0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.120+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/3322294143 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 0x5612b41ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.120+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/3322294143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 0x5612b41da3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.120+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/3322294143 >> 172.21.15.70:0/3322294143 conn(0x5612b40f2cf0 msgr2=0x5612b41c79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:42:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.120+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/3322294143 shutdown_connections 2024-05-08T08:42:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.120+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/3322294143 wait complete. 2024-05-08T08:42:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.121+0000 7f9d55bc4b80 1 -- start start 2024-05-08T08:42:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.121+0000 7f9d55bc4b80 1 Processor -- start 2024-05-08T08:42:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.122+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 0x5612b41d3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.122+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 0x5612b41d3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.122+0000 7f9d55bc4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41d41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.122+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441b4280 con 0x5612b41c9f50 2024-05-08T08:42:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.122+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441b56f0 con 0x5612b41c4520 2024-05-08T08:42:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.122+0000 7f9d55bc4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9d441b4950 con 0x5612b41c4ee0 2024-05-08T08:42:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.122+0000 7f9d55bc4b80 10 client.0 _ll_register_callbacks cb 0x5612b40bde00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:42:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.122+0000 7f9d49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41d41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.123+0000 7f9d49200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41d41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55570/0 (socket says 172.21.15.70:55570) 2024-05-08T08:42:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.123+0000 7f9d49200700 1 -- 172.21.15.70:0/603277399 learned_addr learned my addr 172.21.15.70:0/603277399 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:42:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.123+0000 7f9d49200700 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 0x5612b41d3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.123+0000 7f9d43400700 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 0x5612b41d3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.123+0000 7f9d49200700 1 -- 172.21.15.70:0/603277399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 msgr2=0x5612b41d3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.123+0000 7f9d49200700 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 0x5612b41d3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.123+0000 7f9d49200700 1 -- 172.21.15.70:0/603277399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 msgr2=0x5612b41d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:42:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.124+0000 7f9d49200700 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 0x5612b41d3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:42:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.124+0000 7f9d49200700 1 -- 172.21.15.70:0/603277399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612b42489e0 con 0x5612b41c9f50 2024-05-08T08:42:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.124+0000 7f9d49200700 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41d41a0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c005780 tx=0x7f9d3c005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c68022a6f2cbe93 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:42:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.124+0000 7f9d2e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:42:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.125+0000 7f9d2e000700 1 -- 172.21.15.70:0/603277399 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c003a00 con 0x5612b41c9f50 2024-05-08T08:42:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.125+0000 7f9d2e000700 1 -- 172.21.15.70:0/603277399 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(309..309 src has 1..309) ==== 9583+0+0 (secure 0 0 0) 0x7f9d3c003ba0 con 0x5612b41c9f50 2024-05-08T08:42:55.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.125+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/603277399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d3c005470 con 0x5612b41c9f50 2024-05-08T08:42:55.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.125+0000 7f9d2e000700 1 -- 172.21.15.70:0/603277399 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9d3c043050 con 0x5612b41c9f50 2024-05-08T08:42:55.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.125+0000 7f9d55bc4b80 10 client.18495 fetch_fsmap learned FSMap version 42 2024-05-08T08:42:55.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.125+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/603277399 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5612b4249b80 con 0x5612b41c9f50 2024-05-08T08:42:55.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.126+0000 7f9d2e000700 1 -- 172.21.15.70:0/603277399 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d3c005470 con 0x5612b41c9f50 2024-05-08T08:42:55.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.126+0000 7f9d2e000700 1 -- 172.21.15.70:0/603277399 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9d3c02e070 con 0x5612b41c9f50 2024-05-08T08:42:55.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.126+0000 7f9d55bc4b80 10 client.18495 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:42:55.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.126+0000 7f9d55bc4b80 10 client.18495 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:42:55.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.126+0000 7f9d55bc4b80 20 client.18495 populate_metadata read hostname 'smithi070' 2024-05-08T08:42:55.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.126+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5612b424a050 0x5612b424c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:42:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.126+0000 7f9d55bc4b80 4 client.18495 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.15, "await_for": 42.0}] 2024-05-08T08:42:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.126+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/603277399 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.15, "await_for": 42.0}) -- 0x5612b4124590 con 0x5612b424a050 2024-05-08T08:42:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.127+0000 7f9d43400700 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5612b424a050 0x5612b424c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:42:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.128+0000 7f9d43400700 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5612b424a050 0x5612b424c440 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da959fffc023b0b4 server_cookie=25447c0ed147f137 in_seq=0 out_seq=0 2024-05-08T08:42:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:42:55.128+0000 7f9d2e000700 10 client.18495 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:42:55.125 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/9p/client.o 2024-05-08T08:42:55.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:55 smithi070 ceph-mon[29591]: pgmap v3708: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 12 op/s 2024-05-08T08:42:55.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:55 smithi172 ceph-mon[33377]: pgmap v3708: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 12 op/s 2024-05-08T08:42:55.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:55 smithi194 ceph-mon[33679]: pgmap v3708: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 174 KiB/s wr, 12 op/s 2024-05-08T08:42:56.213 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/sleep.o 2024-05-08T08:42:57.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:57 smithi070 ceph-mon[29591]: pgmap v3709: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 452 KiB/s wr, 22 op/s 2024-05-08T08:42:57.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:57 smithi172 ceph-mon[33377]: pgmap v3709: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 452 KiB/s wr, 22 op/s 2024-05-08T08:42:57.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:57 smithi194 ceph-mon[33679]: pgmap v3709: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 452 KiB/s wr, 22 op/s 2024-05-08T08:42:59.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:42:59 smithi070 ceph-mon[29591]: pgmap v3710: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 433 KiB/s wr, 19 op/s 2024-05-08T08:42:59.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:42:59 smithi172 ceph-mon[33377]: pgmap v3710: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 433 KiB/s wr, 19 op/s 2024-05-08T08:42:59.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:42:59 smithi194 ceph-mon[33679]: pgmap v3710: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 445 KiB/s rd, 433 KiB/s wr, 19 op/s 2024-05-08T08:43:01.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:01 smithi070 ceph-mon[29591]: pgmap v3711: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 653 KiB/s wr, 27 op/s 2024-05-08T08:43:01.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:01 smithi172 ceph-mon[33377]: pgmap v3711: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 653 KiB/s wr, 27 op/s 2024-05-08T08:43:01.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:01 smithi194 ceph-mon[33679]: pgmap v3711: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 653 KiB/s wr, 27 op/s 2024-05-08T08:43:03.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:03 smithi070 ceph-mon[29591]: pgmap v3712: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 497 KiB/s wr, 17 op/s 2024-05-08T08:43:03.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:03 smithi172 ceph-mon[33377]: pgmap v3712: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 497 KiB/s wr, 17 op/s 2024-05-08T08:43:03.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:03 smithi194 ceph-mon[33679]: pgmap v3712: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 497 KiB/s wr, 17 op/s 2024-05-08T08:43:05.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:05 smithi172 ceph-mon[33377]: pgmap v3713: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 497 KiB/s wr, 17 op/s 2024-05-08T08:43:05.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:05 smithi194 ceph-mon[33679]: pgmap v3713: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 497 KiB/s wr, 17 op/s 2024-05-08T08:43:05.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:05 smithi070 ceph-mon[29591]: pgmap v3713: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 497 KiB/s wr, 17 op/s 2024-05-08T08:43:07.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:07 smithi172 ceph-mon[33377]: pgmap v3714: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 616 KiB/s wr, 23 op/s 2024-05-08T08:43:07.753 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:07 smithi194 ceph-mon[33679]: pgmap v3714: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 616 KiB/s wr, 23 op/s 2024-05-08T08:43:07.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:07 smithi070 ceph-mon[29591]: pgmap v3714: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 616 KiB/s wr, 23 op/s 2024-05-08T08:43:09.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:09 smithi172 ceph-mon[33377]: pgmap v3715: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 339 KiB/s wr, 13 op/s 2024-05-08T08:43:09.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:09 smithi194 ceph-mon[33679]: pgmap v3715: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 339 KiB/s wr, 13 op/s 2024-05-08T08:43:09.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:09 smithi070 ceph-mon[29591]: pgmap v3715: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 333 KiB/s rd, 339 KiB/s wr, 13 op/s 2024-05-08T08:43:11.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:11 smithi172 ceph-mon[33377]: pgmap v3716: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 339 KiB/s wr, 21 op/s 2024-05-08T08:43:11.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:11 smithi194 ceph-mon[33679]: pgmap v3716: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 339 KiB/s wr, 21 op/s 2024-05-08T08:43:11.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:11 smithi070 ceph-mon[29591]: pgmap v3716: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 335 KiB/s rd, 339 KiB/s wr, 21 op/s 2024-05-08T08:43:13.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:13 smithi172 ceph-mon[33377]: pgmap v3717: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-05-08T08:43:13.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:13 smithi194 ceph-mon[33679]: pgmap v3717: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-05-08T08:43:13.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:13 smithi070 ceph-mon[29591]: pgmap v3717: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-05-08T08:43:15.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:15 smithi172 ceph-mon[33377]: pgmap v3718: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-05-08T08:43:15.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:15 smithi194 ceph-mon[33679]: pgmap v3718: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-05-08T08:43:15.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:15 smithi070 ceph-mon[29591]: pgmap v3718: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 120 KiB/s wr, 13 op/s 2024-05-08T08:43:17.672 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:17 smithi172 ceph-mon[33377]: pgmap v3719: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 182 KiB/s wr, 30 op/s 2024-05-08T08:43:17.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:17 smithi194 ceph-mon[33679]: pgmap v3719: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 182 KiB/s wr, 30 op/s 2024-05-08T08:43:17.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:17 smithi070 ceph-mon[29591]: pgmap v3719: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 182 KiB/s wr, 30 op/s 2024-05-08T08:43:18.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.634+0000 7f9d2e000700 1 -- 172.21.15.70:0/603277399 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5612b4124590 con 0x5612b424a050 2024-05-08T08:43:18.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.634+0000 7f9d2e000700 10 client.18495 handle_command_reply: tid=0 2024-05-08T08:43:18.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.634+0000 7f9d55bc4b80 1 client.18495 shutdown 2024-05-08T08:43:18.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.634+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/603277399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 msgr2=0x5612b41d41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:18.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.634+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41d41a0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c005780 tx=0x7f9d3c005810 comp rx=0 tx=0).stop 2024-05-08T08:43:18.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/603277399 shutdown_connections 2024-05-08T08:43:18.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5612b424a050 0x5612b424c440 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:18.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b41c9f50 0x5612b41d41a0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:18.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5612b41c4520 0x5612b41d3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:18.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d2e000700 0 client.18495 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:43:18.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d55bc4b80 1 --2- 172.21.15.70:0/603277399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5612b41c4ee0 0x5612b41d3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:18.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/603277399 >> 172.21.15.70:0/603277399 conn(0x5612b40f2cf0 msgr2=0x5612b41c8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:18.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/603277399 shutdown_connections 2024-05-08T08:43:18.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d55bc4b80 1 -- 172.21.15.70:0/603277399 wait complete. 2024-05-08T08:43:18.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.635+0000 7f9d55bc4b80 20 client.18495 trim_cache size 0 max 16384 2024-05-08T08:43:18.630 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:43:18.630 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 262, 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "48d7d3c5": { 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 262, 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.2, 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:43:18.631 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:18.632 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 -- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9d280b2bf0 msgr2=0x7f9d280b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9d280b2bf0 0x7f9d280b50b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9d340a5140 tx=0x7f9d34004750 comp rx=0 tx=0).stop 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 -- 172.21.15.70:0/4130909014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d440756d0 msgr2=0x7f9d4410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d440756d0 0x7f9d4410ec40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400b530 tx=0x7f9d3400b840 comp rx=0 tx=0).stop 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 -- 172.21.15.70:0/4130909014 shutdown_connections 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9d280b2bf0 0x7f9d280b50b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d4410ff00 0x7f9d441a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9d440756d0 0x7f9d4410ec40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 --2- 172.21.15.70:0/4130909014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d44075ff0 0x7f9d4410f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.637+0000 7f9d4b200700 1 -- 172.21.15.70:0/4130909014 >> 172.21.15.70:0/4130909014 conn(0x7f9d4407a600 msgr2=0x7f9d44100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.638+0000 7f9d4b200700 1 -- 172.21.15.70:0/4130909014 shutdown_connections 2024-05-08T08:43:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:18.638+0000 7f9d4b200700 1 -- 172.21.15.70:0/4130909014 wait complete. 2024-05-08T08:43:19.422 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:19 smithi070 ceph-mon[29591]: pgmap v3720: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 KiB/s wr, 25 op/s 2024-05-08T08:43:19.422 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:43:19.609 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '48d7d3c5', quiesce took 32.1 seconds. Will release after: 25.15 2024-05-08T08:43:19.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:19 smithi172 ceph-mon[33377]: pgmap v3720: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 KiB/s wr, 25 op/s 2024-05-08T08:43:19.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:43:19.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:19 smithi194 ceph-mon[33679]: pgmap v3720: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 KiB/s wr, 25 op/s 2024-05-08T08:43:19.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:43:21.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:21 smithi194 ceph-mon[33679]: pgmap v3721: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 124 KiB/s wr, 30 op/s 2024-05-08T08:43:21.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:21 smithi070 ceph-mon[29591]: pgmap v3721: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 124 KiB/s wr, 30 op/s 2024-05-08T08:43:21.922 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:21 smithi172 ceph-mon[33377]: pgmap v3721: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 124 KiB/s wr, 30 op/s 2024-05-08T08:43:23.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:23 smithi172 ceph-mon[33377]: pgmap v3722: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 124 KiB/s wr, 22 op/s 2024-05-08T08:43:23.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:23.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:23.503 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:23 smithi194 ceph-mon[33679]: pgmap v3722: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 124 KiB/s wr, 22 op/s 2024-05-08T08:43:23.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:23.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:23.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:23 smithi070 ceph-mon[29591]: pgmap v3722: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 124 KiB/s wr, 22 op/s 2024-05-08T08:43:23.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:23.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:25 smithi194 ceph-mon[33679]: pgmap v3723: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 124 KiB/s wr, 22 op/s 2024-05-08T08:43:25.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.254 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:25 smithi070 ceph-mon[29591]: pgmap v3723: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 124 KiB/s wr, 22 op/s 2024-05-08T08:43:25.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:25 smithi172 ceph-mon[33377]: pgmap v3723: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 124 KiB/s wr, 22 op/s 2024-05-08T08:43:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:25.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:26.361 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.361 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.361 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.361 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.361 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:43:26.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:43:26.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.362 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:43:26.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:43:26.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:26.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:43:27.104 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:43:27.104 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:27.104 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:27.104 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:27.104 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:27.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:27 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:43:27.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:27 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:43:27.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:27 smithi070 ceph-mon[29591]: pgmap v3724: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 186 KiB/s wr, 26 op/s 2024-05-08T08:43:27.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:27 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:43:27.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:27 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:43:27.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:27 smithi172 ceph-mon[33377]: pgmap v3724: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 186 KiB/s wr, 26 op/s 2024-05-08T08:43:27.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:27 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:43:27.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:27 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:43:27.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:27 smithi194 ceph-mon[33679]: pgmap v3724: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 186 KiB/s wr, 26 op/s 2024-05-08T08:43:29.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: pgmap v3725: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 123 KiB/s wr, 9 op/s 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: osdmap e310: 12 total, 12 up, 12 in 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:43:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: pgmap v3725: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 123 KiB/s wr, 9 op/s 2024-05-08T08:43:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: osdmap e310: 12 total, 12 up, 12 in 2024-05-08T08:43:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:43:29.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:43:29.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:29.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: pgmap v3725: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 123 KiB/s wr, 9 op/s 2024-05-08T08:43:29.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: osdmap e310: 12 total, 12 up, 12 in 2024-05-08T08:43:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:43:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:43:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:43:29.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:43:30.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:30 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:43:30.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:30 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:43:30.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:30 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:43:30.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:30 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:43:30.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:30 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:43:30.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:30 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:43:31.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:31 smithi172 ceph-mon[33377]: pgmap v3727: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-05-08T08:43:31.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:31 smithi194 ceph-mon[33679]: pgmap v3727: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-05-08T08:43:31.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:31 smithi070 ceph-mon[29591]: pgmap v3727: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-05-08T08:43:33.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:33 smithi172 ceph-mon[33377]: pgmap v3728: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-05-08T08:43:33.425 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:33 smithi070 ceph-mon[29591]: pgmap v3728: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-05-08T08:43:33.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:33 smithi194 ceph-mon[33679]: pgmap v3728: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-05-08T08:43:35.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:35 smithi172 ceph-mon[33377]: pgmap v3729: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-05-08T08:43:35.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:35 smithi194 ceph-mon[33679]: pgmap v3729: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-05-08T08:43:35.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:35 smithi070 ceph-mon[29591]: pgmap v3729: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 8 op/s 2024-05-08T08:43:37.422 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:37 smithi172 ceph-mon[33377]: pgmap v3730: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:43:37.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:37 smithi194 ceph-mon[33679]: pgmap v3730: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:43:37.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:37 smithi070 ceph-mon[29591]: pgmap v3730: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:43:39.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:39 smithi172 ceph-mon[33377]: pgmap v3731: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:43:39.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:39 smithi194 ceph-mon[33679]: pgmap v3731: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:43:39.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:39 smithi070 ceph-mon[29591]: pgmap v3731: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:43:41.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:41 smithi172 ceph-mon[33377]: pgmap v3732: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T08:43:41.423 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:41 smithi172 ceph-mon[33377]: osdmap e311: 12 total, 12 up, 12 in 2024-05-08T08:43:41.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:41 smithi194 ceph-mon[33679]: pgmap v3732: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T08:43:41.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:41 smithi194 ceph-mon[33679]: osdmap e311: 12 total, 12 up, 12 in 2024-05-08T08:43:41.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:41 smithi070 ceph-mon[29591]: pgmap v3732: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 8 op/s 2024-05-08T08:43:41.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:41 smithi070 ceph-mon[29591]: osdmap e311: 12 total, 12 up, 12 in 2024-05-08T08:43:43.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:43 smithi194 ceph-mon[33679]: pgmap v3734: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:43:43.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:43 smithi070 ceph-mon[29591]: pgmap v3734: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:43:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:43 smithi172 ceph-mon[33377]: pgmap v3734: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:43:44.761 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:43:45.213 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:43:45.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:45 smithi194 ceph-mon[33679]: pgmap v3735: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:43:45.548 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:45 smithi070 ceph-mon[29591]: pgmap v3735: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:43:45.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:45 smithi172 ceph-mon[33377]: pgmap v3735: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:43:47.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.451+0000 7f6d5e000700 1 -- 172.21.15.70:0/3403555949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810fb60 msgr2=0x7f6d5810ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:47.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.451+0000 7f6d5e000700 1 --2- 172.21.15.70:0/3403555949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810fb60 0x7f6d5810ff40 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009990 tx=0x7f6d48009ca0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.451+0000 7f6d5e000700 1 -- 172.21.15.70:0/3403555949 shutdown_connections 2024-05-08T08:43:47.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.451+0000 7f6d5e000700 1 --2- 172.21.15.70:0/3403555949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5810a490 0x7f6d581169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.451+0000 7f6d5e000700 1 --2- 172.21.15.70:0/3403555949 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810fb60 0x7f6d5810ff40 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.451+0000 7f6d5e000700 1 --2- 172.21.15.70:0/3403555949 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58109ad0 0x7f6d58109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.451+0000 7f6d5e000700 1 -- 172.21.15.70:0/3403555949 >> 172.21.15.70:0/3403555949 conn(0x7f6d58076c70 msgr2=0x7f6d581082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:47.446 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:47 smithi070 ceph-mon[29591]: pgmap v3736: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:43:47.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.452+0000 7f6d5e000700 1 -- 172.21.15.70:0/3403555949 shutdown_connections 2024-05-08T08:43:47.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.452+0000 7f6d5e000700 1 -- 172.21.15.70:0/3403555949 wait complete. 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.453+0000 7f6d5e000700 1 Processor -- start 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.453+0000 7f6d5e000700 1 -- start start 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d5e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58109ad0 0x7f6d581a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d5e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810a490 0x7f6d581a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d5e000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5810fb60 0x7f6d581a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d5e000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58119b70 con 0x7f6d5810a490 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d5e000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581199f0 con 0x7f6d58109ad0 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d5e000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58119cf0 con 0x7f6d5810fb60 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d56a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810a490 0x7f6d581a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d56a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810a490 0x7f6d581a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46686/0 (socket says 172.21.15.70:46686) 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d56a00700 1 -- 172.21.15.70:0/399756474 learned_addr learned my addr 172.21.15.70:0/399756474 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d57400700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58109ad0 0x7f6d581a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:47.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d57e00700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5810fb60 0x7f6d581a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d56a00700 1 -- 172.21.15.70:0/399756474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5810fb60 msgr2=0x7f6d581a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.454+0000 7f6d56a00700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5810fb60 0x7f6d581a49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.455+0000 7f6d56a00700 1 -- 172.21.15.70:0/399756474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58109ad0 msgr2=0x7f6d581a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.455+0000 7f6d56a00700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58109ad0 0x7f6d581a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.455+0000 7f6d56a00700 1 -- 172.21.15.70:0/399756474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d581a5110 con 0x7f6d5810a490 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.455+0000 7f6d56a00700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810a490 0x7f6d581a0640 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400d980 tx=0x7f6d4400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.455+0000 7f6d4fe00700 1 -- 172.21.15.70:0/399756474 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44016070 con 0x7f6d5810a490 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.455+0000 7f6d4fe00700 1 -- 172.21.15.70:0/399756474 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d44004020 con 0x7f6d5810a490 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.455+0000 7f6d4fe00700 1 -- 172.21.15.70:0/399756474 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44004bb0 con 0x7f6d5810a490 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.455+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d581a5400 con 0x7f6d5810a490 2024-05-08T08:43:47.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.455+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d581acc80 con 0x7f6d5810a490 2024-05-08T08:43:47.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.456+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5806a190 con 0x7f6d5810a490 2024-05-08T08:43:47.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.462+0000 7f6d4fe00700 1 -- 172.21.15.70:0/399756474 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6d4400bb60 con 0x7f6d5810a490 2024-05-08T08:43:47.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.463+0000 7f6d4fe00700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:47.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.463+0000 7f6d4fe00700 1 -- 172.21.15.70:0/399756474 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 9583+0+0 (secure 0 0 0) 0x7f6d440e2db0 con 0x7f6d5810a490 2024-05-08T08:43:47.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.464+0000 7f6d57400700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:47.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.465+0000 7f6d57400700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800b5c0 tx=0x7f6d4801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:43:47.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.466+0000 7f6d4fe00700 1 -- 172.21.15.70:0/399756474 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6d4401f020 con 0x7f6d5810a490 2024-05-08T08:43:47.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:47 smithi194 ceph-mon[33679]: pgmap v3736: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:43:47.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:47 smithi172 ceph-mon[33377]: pgmap v3736: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:43:47.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.744+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d5802e510 con 0x7f6d5810a490 2024-05-08T08:43:47.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.745+0000 7f6d4fe00700 1 -- 172.21.15.70:0/399756474 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f6d440aa310 con 0x7f6d5810a490 2024-05-08T08:43:47.739 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:43:47.739 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:43:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 msgr2=0x7f6d3c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800b5c0 tx=0x7f6d4801a040 comp rx=0 tx=0).stop 2024-05-08T08:43:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810a490 msgr2=0x7f6d581a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810a490 0x7f6d581a0640 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400d980 tx=0x7f6d4400dd40 comp rx=0 tx=0).stop 2024-05-08T08:43:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 shutdown_connections 2024-05-08T08:43:47.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d5810fb60 0x7f6d581a49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58109ad0 0x7f6d581a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 --2- 172.21.15.70:0/399756474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5810a490 0x7f6d581a0640 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 >> 172.21.15.70:0/399756474 conn(0x7f6d58076c70 msgr2=0x7f6d58077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 shutdown_connections 2024-05-08T08:43:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:47.750+0000 7f6d5e000700 1 -- 172.21.15.70:0/399756474 wait complete. 2024-05-08T08:43:47.744 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:43:48.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:48 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/399756474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:43:48.521 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:48 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/399756474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:43:48.591 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 48d7d3c5 --release --await' 2024-05-08T08:43:48.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 48d7d3c5 --release --await 2024-05-08T08:43:48.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:48 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/399756474' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:43:49.052 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:43:49.452 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:49 smithi070 ceph-mon[29591]: pgmap v3737: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:43:49.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:49 smithi194 ceph-mon[33679]: pgmap v3737: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:43:49.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:49 smithi172 ceph-mon[33377]: pgmap v3737: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:43:51.460 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:51 smithi070 ceph-mon[29591]: pgmap v3738: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:43:51.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:51 smithi194 ceph-mon[33679]: pgmap v3738: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:43:51.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.521+0000 7f756d400700 1 -- 172.21.15.70:0/4088179719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 msgr2=0x7f7568103970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.521+0000 7f756d400700 1 --2- 172.21.15.70:0/4088179719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 0x7f7568103970 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f7554009990 tx=0x7f7554009ca0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.521+0000 7f756d400700 1 -- 172.21.15.70:0/4088179719 shutdown_connections 2024-05-08T08:43:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.521+0000 7f756d400700 1 --2- 172.21.15.70:0/4088179719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7568103eb0 0x7f7568110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.521+0000 7f756d400700 1 --2- 172.21.15.70:0/4088179719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7568109600 0x7f75681099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.521+0000 7f756d400700 1 --2- 172.21.15.70:0/4088179719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 0x7f7568103970 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.521+0000 7f756d400700 1 -- 172.21.15.70:0/4088179719 >> 172.21.15.70:0/4088179719 conn(0x7f756807a650 msgr2=0x7f756807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.521+0000 7f756d400700 1 -- 172.21.15.70:0/4088179719 shutdown_connections 2024-05-08T08:43:51.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.521+0000 7f756d400700 1 -- 172.21.15.70:0/4088179719 wait complete. 2024-05-08T08:43:51.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.522+0000 7f756d400700 1 Processor -- start 2024-05-08T08:43:51.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f756d400700 1 -- start start 2024-05-08T08:43:51.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f756d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 0x7f756819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f756d400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7568103eb0 0x7f756819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f756d400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7568109600 0x7f7568199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f756d400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7568113500 con 0x7f75681034f0 2024-05-08T08:43:51.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f756d400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7568113380 con 0x7f7568109600 2024-05-08T08:43:51.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f756d400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7568113680 con 0x7f7568103eb0 2024-05-08T08:43:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f7566800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 0x7f756819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f7566800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 0x7f756819f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46708/0 (socket says 172.21.15.70:46708) 2024-05-08T08:43:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.523+0000 7f7566800700 1 -- 172.21.15.70:0/1024259834 learned_addr learned my addr 172.21.15.70:0/1024259834 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:43:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.524+0000 7f7565e00700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7568103eb0 0x7f756819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.524+0000 7f7567200700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7568109600 0x7f7568199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.524+0000 7f7566800700 1 -- 172.21.15.70:0/1024259834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7568103eb0 msgr2=0x7f756819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:51.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.524+0000 7f7566800700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7568103eb0 0x7f756819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.524+0000 7f7566800700 1 -- 172.21.15.70:0/1024259834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7568109600 msgr2=0x7f7568199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:51.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.524+0000 7f7566800700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7568109600 0x7f7568199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.524+0000 7f7566800700 1 -- 172.21.15.70:0/1024259834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756819a020 con 0x7f75681034f0 2024-05-08T08:43:51.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.524+0000 7f7566800700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 0x7f756819f6c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f755800d950 tx=0x7f755800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:43:51.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.525+0000 7f755f400700 1 -- 172.21.15.70:0/1024259834 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558016070 con 0x7f75681034f0 2024-05-08T08:43:51.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.525+0000 7f755f400700 1 -- 172.21.15.70:0/1024259834 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7558009dd0 con 0x7f75681034f0 2024-05-08T08:43:51.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.525+0000 7f756d400700 1 -- 172.21.15.70:0/1024259834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756819a310 con 0x7f75681034f0 2024-05-08T08:43:51.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.525+0000 7f755f400700 1 -- 172.21.15.70:0/1024259834 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755800f3c0 con 0x7f75681034f0 2024-05-08T08:43:51.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.525+0000 7f756d400700 1 -- 172.21.15.70:0/1024259834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75681a6520 con 0x7f75681034f0 2024-05-08T08:43:51.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.531+0000 7f755f400700 1 -- 172.21.15.70:0/1024259834 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7558019070 con 0x7f75681034f0 2024-05-08T08:43:51.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.532+0000 7f755f400700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f754c0b29f0 0x7f754c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.532+0000 7f755f400700 1 -- 172.21.15.70:0/1024259834 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(311..311 src has 1..311) ==== 9583+0+0 (secure 0 0 0) 0x7f75580e2a60 con 0x7f75681034f0 2024-05-08T08:43:51.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.533+0000 7f7565e00700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f754c0b29f0 0x7f754c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.533+0000 7f7565e00700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f754c0b29f0 0x7f754c0b4eb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f75540098e0 tx=0x7f7554005960 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:43:51.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.543+0000 7f7577e12b80 1 Processor -- start 2024-05-08T08:43:51.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.543+0000 7f7577e12b80 1 -- start start 2024-05-08T08:43:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.543+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fde20 0x55809d4fe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.543+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 0x55809d4fa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.543+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fae50 0x55809d50f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7577e12b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55809d44cb20 con 0x55809d4fde20 2024-05-08T08:43:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7577e12b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55809d3ea860 con 0x55809d4fae50 2024-05-08T08:43:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7577e12b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55809d448ae0 con 0x55809d4fa490 2024-05-08T08:43:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7566800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fde20 0x55809d4fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7566800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fde20 0x55809d4fe200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46722/0 (socket says 172.21.15.70:46722) 2024-05-08T08:43:51.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7566800700 1 -- 172.21.15.70:0/3543257546 learned_addr learned my addr 172.21.15.70:0/3543257546 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:43:51.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7565e00700 1 --2- 172.21.15.70:0/3543257546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 0x55809d4fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7566800700 1 -- 172.21.15.70:0/3543257546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 msgr2=0x55809d4fa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:43:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7566800700 1 --2- 172.21.15.70:0/3543257546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 0x55809d4fa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7566800700 1 -- 172.21.15.70:0/3543257546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fae50 msgr2=0x55809d50f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:43:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7566800700 1 --2- 172.21.15.70:0/3543257546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fae50 0x55809d50f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7566800700 1 -- 172.21.15.70:0/3543257546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55809d3999d0 con 0x55809d4fde20 2024-05-08T08:43:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.544+0000 7f7565e00700 1 --2- 172.21.15.70:0/3543257546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 0x55809d4fa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:43:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.545+0000 7f7566800700 1 --2- 172.21.15.70:0/3543257546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fde20 0x55809d4fe200 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f7558010a20 tx=0x7f75580a9500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af44da7e65b8a50a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:43:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.545+0000 7f7553e00700 1 -- 172.21.15.70:0/3543257546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558020070 con 0x55809d4fde20 2024-05-08T08:43:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.545+0000 7f7553e00700 1 -- 172.21.15.70:0/3543257546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75580adc70 con 0x55809d4fde20 2024-05-08T08:43:51.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.545+0000 7f7553e00700 1 -- 172.21.15.70:0/3543257546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75580a9b20 con 0x55809d4fde20 2024-05-08T08:43:51.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.546+0000 7f7577e12b80 1 -- 172.21.15.70:0/3543257546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fde20 msgr2=0x55809d4fe200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:51.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.546+0000 7f7577e12b80 1 --2- 172.21.15.70:0/3543257546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fde20 0x55809d4fe200 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f7558010a20 tx=0x7f75580a9500 comp rx=0 tx=0).stop 2024-05-08T08:43:51.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.546+0000 7f7577e12b80 1 -- 172.21.15.70:0/3543257546 shutdown_connections 2024-05-08T08:43:51.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.546+0000 7f7577e12b80 1 --2- 172.21.15.70:0/3543257546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fae50 0x55809d50f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.546+0000 7f7577e12b80 1 --2- 172.21.15.70:0/3543257546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fde20 0x55809d4fe200 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.546+0000 7f7577e12b80 1 --2- 172.21.15.70:0/3543257546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 0x55809d4fa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.546+0000 7f7577e12b80 1 -- 172.21.15.70:0/3543257546 >> 172.21.15.70:0/3543257546 conn(0x55809d428c60 msgr2=0x55809d4f4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.546+0000 7f7577e12b80 1 -- 172.21.15.70:0/3543257546 shutdown_connections 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.546+0000 7f7577e12b80 1 -- 172.21.15.70:0/3543257546 wait complete. 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.547+0000 7f7577e12b80 1 -- start start 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.547+0000 7f7577e12b80 1 Processor -- start 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.547+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 0x55809d50ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.547+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d50c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.547+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 0x55809d50c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.547+0000 7f7577e12b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55809d50f960 con 0x55809d4fae50 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.547+0000 7f7577e12b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55809d3b2c20 con 0x55809d4fa490 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.547+0000 7f7577e12b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55809d50fae0 con 0x55809d4fde20 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7577e12b80 10 client.0 _ll_register_callbacks cb 0x55809d3f3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7565e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d50c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7565e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d50c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46738/0 (socket says 172.21.15.70:46738) 2024-05-08T08:43:51.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7565e00700 1 -- 172.21.15.70:0/2858800970 learned_addr learned my addr 172.21.15.70:0/2858800970 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:43:51.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7566800700 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 0x55809d50ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7567200700 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 0x55809d50c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7565e00700 1 -- 172.21.15.70:0/2858800970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 msgr2=0x55809d50c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:43:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7565e00700 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 0x55809d50c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7565e00700 1 -- 172.21.15.70:0/2858800970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 msgr2=0x55809d50ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7565e00700 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 0x55809d50ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7565e00700 1 -- 172.21.15.70:0/2858800970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55809d412520 con 0x55809d4fae50 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.548+0000 7f7567200700 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 0x55809d50c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.549+0000 7f7565e00700 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d50c1b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f7554009990 tx=0x7f7554009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd04604be0a41a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.549+0000 7f7550c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.549+0000 7f7550c00700 1 -- 172.21.15.70:0/2858800970 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755400ba60 con 0x55809d4fae50 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.549+0000 7f7550c00700 1 -- 172.21.15.70:0/2858800970 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(311..311 src has 1..311) ==== 9583+0+0 (secure 0 0 0) 0x7f755400bc00 con 0x55809d4fae50 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.549+0000 7f7577e12b80 1 -- 172.21.15.70:0/2858800970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75580adc70 con 0x55809d4fae50 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.549+0000 7f7550c00700 1 -- 172.21.15.70:0/2858800970 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7554038050 con 0x55809d4fae50 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.549+0000 7f7577e12b80 10 client.18513 fetch_fsmap learned FSMap version 42 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.549+0000 7f7577e12b80 1 -- 172.21.15.70:0/2858800970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55809d51a200 con 0x55809d4fae50 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.550+0000 7f7550c00700 1 -- 172.21.15.70:0/2858800970 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75580adc70 con 0x55809d4fae50 2024-05-08T08:43:51.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.550+0000 7f7550c00700 1 -- 172.21.15.70:0/2858800970 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f7554022410 con 0x55809d4fae50 2024-05-08T08:43:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.550+0000 7f7577e12b80 10 client.18513 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:43:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.550+0000 7f7577e12b80 10 client.18513 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:43:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.550+0000 7f7577e12b80 20 client.18513 populate_metadata read hostname 'smithi070' 2024-05-08T08:43:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.550+0000 7f7577e12b80 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55809d51c890 0x55809d51ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.550+0000 7f7577e12b80 4 client.18513 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:43:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.550+0000 7f7577e12b80 1 -- 172.21.15.70:0/2858800970 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55809d4c71a0 con 0x55809d51c890 2024-05-08T08:43:51.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.551+0000 7f7566800700 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55809d51c890 0x55809d51ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.552+0000 7f7566800700 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55809d51c890 0x55809d51ecd0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be58b9dc6ccf669 server_cookie=35a4ea6a65a0fc9c in_seq=0 out_seq=0 2024-05-08T08:43:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.552+0000 7f7550c00700 10 client.18513 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:43:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7550c00700 1 -- 172.21.15.70:0/2858800970 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55809d4c71a0 con 0x55809d51c890 2024-05-08T08:43:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7550c00700 10 client.18513 handle_command_reply: tid=0 2024-05-08T08:43:51.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 client.18513 shutdown 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 -- 172.21.15.70:0/2858800970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 msgr2=0x55809d50c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d50c1b0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f7554009990 tx=0x7f7554009310 comp rx=0 tx=0).stop 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 -- 172.21.15.70:0/2858800970 shutdown_connections 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55809d51c890 0x55809d51ecd0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 0x55809d50c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 0x55809d50ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 --2- 172.21.15.70:0/2858800970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d50c1b0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 -- 172.21.15.70:0/2858800970 >> 172.21.15.70:0/2858800970 conn(0x55809d428c60 msgr2=0x55809d4ef850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7550c00700 0 client.18513 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 -- 172.21.15.70:0/2858800970 shutdown_connections 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 1 -- 172.21.15.70:0/2858800970 wait complete. 2024-05-08T08:43:51.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.554+0000 7f7577e12b80 20 client.18513 trim_cache size 0 max 16384 2024-05-08T08:43:51.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.576+0000 7f7577e12b80 1 Processor -- start 2024-05-08T08:43:51.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.576+0000 7f7577e12b80 1 -- start start 2024-05-08T08:43:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.576+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 0x55809d518a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.576+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d4ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.576+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 0x55809d5245a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.576+0000 7f7577e12b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f75681afcd0 con 0x55809d4fae50 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.576+0000 7f7577e12b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75681ad560 con 0x55809d4fa490 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.576+0000 7f7577e12b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f75681ab3d0 con 0x55809d4fde20 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.577+0000 7f7565e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d4ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.577+0000 7f7565e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d4ef6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46748/0 (socket says 172.21.15.70:46748) 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.577+0000 7f7565e00700 1 -- 172.21.15.70:0/4163194195 learned_addr learned my addr 172.21.15.70:0/4163194195 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.577+0000 7f7566800700 1 --2- 172.21.15.70:0/4163194195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 0x55809d518a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.577+0000 7f7565e00700 1 -- 172.21.15.70:0/4163194195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 msgr2=0x55809d5245a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.577+0000 7f7565e00700 1 --2- 172.21.15.70:0/4163194195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 0x55809d5245a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.577+0000 7f7565e00700 1 -- 172.21.15.70:0/4163194195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 msgr2=0x55809d518a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.577+0000 7f7565e00700 1 --2- 172.21.15.70:0/4163194195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 0x55809d518a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.577+0000 7f7565e00700 1 -- 172.21.15.70:0/4163194195 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55809d4f1980 con 0x55809d4fae50 2024-05-08T08:43:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.578+0000 7f7565e00700 1 --2- 172.21.15.70:0/4163194195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d4ef6d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7554006010 tx=0x7f7554022c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fef3ac20652fde server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:43:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.578+0000 7f7553400700 1 -- 172.21.15.70:0/4163194195 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75540223f0 con 0x55809d4fae50 2024-05-08T08:43:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.578+0000 7f7553400700 1 -- 172.21.15.70:0/4163194195 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7554022590 con 0x55809d4fae50 2024-05-08T08:43:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.578+0000 7f7553400700 1 -- 172.21.15.70:0/4163194195 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755400fc70 con 0x55809d4fae50 2024-05-08T08:43:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.579+0000 7f7577e12b80 1 -- 172.21.15.70:0/4163194195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 msgr2=0x55809d4ef6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.579+0000 7f7577e12b80 1 --2- 172.21.15.70:0/4163194195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d4ef6d0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7554006010 tx=0x7f7554022c30 comp rx=0 tx=0).stop 2024-05-08T08:43:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.579+0000 7f7577e12b80 1 -- 172.21.15.70:0/4163194195 shutdown_connections 2024-05-08T08:43:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.579+0000 7f7577e12b80 1 --2- 172.21.15.70:0/4163194195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fde20 0x55809d5245a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.579+0000 7f7577e12b80 1 --2- 172.21.15.70:0/4163194195 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fa490 0x55809d518a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.579+0000 7f7577e12b80 1 --2- 172.21.15.70:0/4163194195 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d4ef6d0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.579+0000 7f7577e12b80 1 -- 172.21.15.70:0/4163194195 >> 172.21.15.70:0/4163194195 conn(0x55809d428c60 msgr2=0x55809d4eefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.579+0000 7f7577e12b80 1 -- 172.21.15.70:0/4163194195 shutdown_connections 2024-05-08T08:43:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.579+0000 7f7577e12b80 1 -- 172.21.15.70:0/4163194195 wait complete. 2024-05-08T08:43:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.580+0000 7f7577e12b80 1 -- start start 2024-05-08T08:43:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.580+0000 7f7577e12b80 1 Processor -- start 2024-05-08T08:43:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.580+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 0x55809d5118c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.580+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d511e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.580+0000 7f7577e12b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fde20 0x55809d512340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.580+0000 7f7577e12b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f75681aba20 con 0x55809d4fae50 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.580+0000 7f7577e12b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f75681ace90 con 0x55809d4fde20 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.580+0000 7f7577e12b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f75681ac0f0 con 0x55809d4fa490 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.580+0000 7f7577e12b80 10 client.0 _ll_register_callbacks cb 0x55809d3f3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7565e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d511e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7565e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d511e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46750/0 (socket says 172.21.15.70:46750) 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7565e00700 1 -- 172.21.15.70:0/1635971193 learned_addr learned my addr 172.21.15.70:0/1635971193 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7566800700 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 0x55809d5118c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7567200700 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fde20 0x55809d512340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7565e00700 1 -- 172.21.15.70:0/1635971193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 msgr2=0x55809d5118c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7565e00700 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 0x55809d5118c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7565e00700 1 -- 172.21.15.70:0/1635971193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fde20 msgr2=0x55809d512340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7565e00700 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fde20 0x55809d512340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.581+0000 7f7565e00700 1 -- 172.21.15.70:0/1635971193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55809d587160 con 0x55809d4fae50 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.582+0000 7f7565e00700 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d511e00 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f755400bc90 tx=0x7f755400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8785cbb423ec5496 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.582+0000 7f7550c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.582+0000 7f7550c00700 1 -- 172.21.15.70:0/1635971193 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554043070 con 0x55809d4fae50 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.582+0000 7f7550c00700 1 -- 172.21.15.70:0/1635971193 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(311..311 src has 1..311) ==== 9583+0+0 (secure 0 0 0) 0x7f755400f670 con 0x55809d4fae50 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.582+0000 7f7577e12b80 1 -- 172.21.15.70:0/1635971193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7554022590 con 0x55809d4fae50 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.582+0000 7f7550c00700 1 -- 172.21.15.70:0/1635971193 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7554022a50 con 0x55809d4fae50 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.582+0000 7f7577e12b80 10 client.18519 fetch_fsmap learned FSMap version 42 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.582+0000 7f7577e12b80 1 -- 172.21.15.70:0/1635971193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55809d588420 con 0x55809d4fae50 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.583+0000 7f7550c00700 1 -- 172.21.15.70:0/1635971193 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7554022590 con 0x55809d4fae50 2024-05-08T08:43:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.583+0000 7f7550c00700 1 -- 172.21.15.70:0/1635971193 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f755403d9f0 con 0x55809d4fae50 2024-05-08T08:43:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.583+0000 7f7577e12b80 10 client.18519 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:43:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.583+0000 7f7577e12b80 10 client.18519 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:43:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.583+0000 7f7577e12b80 20 client.18519 populate_metadata read hostname 'smithi070' 2024-05-08T08:43:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.583+0000 7f7577e12b80 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55809d588a20 0x55809d58ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:43:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.583+0000 7f7577e12b80 4 client.18519 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "48d7d3c5", "release": true, "await": true}] 2024-05-08T08:43:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.583+0000 7f7577e12b80 1 -- 172.21.15.70:0/1635971193 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "48d7d3c5", "release": true, "await": true}) -- 0x55809d45a500 con 0x55809d588a20 2024-05-08T08:43:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.584+0000 7f7566800700 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55809d588a20 0x55809d58ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:43:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.585+0000 7f7566800700 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55809d588a20 0x55809d58ae40 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b4d498b70fb0913 server_cookie=51ac1925ac9ecfb6 in_seq=0 out_seq=0 2024-05-08T08:43:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:51.585+0000 7f7550c00700 10 client.18519 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:43:51.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:51 smithi172 ceph-mon[33377]: pgmap v3738: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T08:43:53.475 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:53 smithi172 ceph-mon[33377]: pgmap v3739: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T08:43:53.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:53 smithi194 ceph-mon[33679]: pgmap v3739: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T08:43:53.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:53 smithi070 ceph-mon[29591]: pgmap v3739: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T08:43:55.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:55 smithi194 ceph-mon[33679]: pgmap v3740: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:43:55.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:55 smithi070 ceph-mon[29591]: pgmap v3740: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:43:55.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:55 smithi172 ceph-mon[33377]: pgmap v3740: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:43:56.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.069+0000 7f7550c00700 1 -- 172.21.15.70:0/1635971193 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55809d45a500 con 0x55809d588a20 2024-05-08T08:43:56.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.069+0000 7f7550c00700 10 client.18519 handle_command_reply: tid=0 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.069+0000 7f7577e12b80 1 client.18519 shutdown 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.070+0000 7f7577e12b80 1 -- 172.21.15.70:0/1635971193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 msgr2=0x55809d511e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.070+0000 7f7577e12b80 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d511e00 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f755400bc90 tx=0x7f755400bd70 comp rx=0 tx=0).stop 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.070+0000 7f7577e12b80 1 -- 172.21.15.70:0/1635971193 shutdown_connections 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.070+0000 7f7577e12b80 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55809d588a20 0x55809d58ae40 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.070+0000 7f7577e12b80 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55809d4fde20 0x55809d512340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.070+0000 7f7577e12b80 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55809d4fa490 0x55809d5118c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.070+0000 7f7577e12b80 1 --2- 172.21.15.70:0/1635971193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55809d4fae50 0x55809d511e00 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.070+0000 7f7577e12b80 1 -- 172.21.15.70:0/1635971193 >> 172.21.15.70:0/1635971193 conn(0x55809d428c60 msgr2=0x55809d4ef850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.071+0000 7f7550c00700 0 client.18519 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.071+0000 7f7577e12b80 1 -- 172.21.15.70:0/1635971193 shutdown_connections 2024-05-08T08:43:56.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.071+0000 7f7577e12b80 1 -- 172.21.15.70:0/1635971193 wait complete. 2024-05-08T08:43:56.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.071+0000 7f7577e12b80 20 client.18519 trim_cache size 0 max 16384 2024-05-08T08:43:56.066 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:43:56.066 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:43:56.066 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:43:56.066 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 264, 2024-05-08T08:43:56.066 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:43:56.066 INFO:teuthology.orchestra.run.smithi070.stdout: "48d7d3c5": { 2024-05-08T08:43:56.066 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 264, 2024-05-08T08:43:56.066 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.2, 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:56.067 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:56.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:43:56.068 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:43:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 -- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f754c0b29f0 msgr2=0x7f754c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f754c0b29f0 0x7f754c0b4eb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f75540098e0 tx=0x7f7554005960 comp rx=0 tx=0).stop 2024-05-08T08:43:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 -- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 msgr2=0x7f756819f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:43:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 0x7f756819f6c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f755800d950 tx=0x7f755800dc60 comp rx=0 tx=0).stop 2024-05-08T08:43:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 -- 172.21.15.70:0/1024259834 shutdown_connections 2024-05-08T08:43:56.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f754c0b29f0 0x7f754c0b4eb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7568109600 0x7f7568199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f75681034f0 0x7f756819f6c0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 --2- 172.21.15.70:0/1024259834 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7568103eb0 0x7f756819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:43:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.073+0000 7f756d400700 1 -- 172.21.15.70:0/1024259834 >> 172.21.15.70:0/1024259834 conn(0x7f756807a650 msgr2=0x7f75681021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:43:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.074+0000 7f756d400700 1 -- 172.21.15.70:0/1024259834 shutdown_connections 2024-05-08T08:43:56.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:43:56.074+0000 7f756d400700 1 -- 172.21.15.70:0/1024259834 wait complete. 2024-05-08T08:43:56.497 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/rpc_pipe.o 2024-05-08T08:43:56.940 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '48d7d3c5', seconds elapsed: 69.4 2024-05-08T08:43:57.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:57 smithi194 ceph-mon[33679]: pgmap v3741: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-08T08:43:57.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:57 smithi070 ceph-mon[29591]: pgmap v3741: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-08T08:43:57.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:57 smithi172 ceph-mon[33377]: pgmap v3741: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-08T08:43:58.815 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/9p/error.o 2024-05-08T08:43:58.905 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/posix_acl.o 2024-05-08T08:43:59.021 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/device_sysfs.o 2024-05-08T08:43:59.191 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/util.o 2024-05-08T08:43:59.342 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ip_tunnel_core.o 2024-05-08T08:43:59.360 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/calipso.o 2024-05-08T08:43:59.374 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/9p/protocol.o 2024-05-08T08:43:59.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:43:59 smithi194 ceph-mon[33679]: pgmap v3742: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-05-08T08:43:59.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:43:59 smithi070 ceph-mon[29591]: pgmap v3742: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-05-08T08:43:59.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:43:59 smithi172 ceph-mon[33377]: pgmap v3742: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-05-08T08:44:01.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:01 smithi194 ceph-mon[33679]: pgmap v3743: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 221 KiB/s wr, 15 op/s 2024-05-08T08:44:01.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:01 smithi070 ceph-mon[29591]: pgmap v3743: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 221 KiB/s wr, 15 op/s 2024-05-08T08:44:01.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:01 smithi172 ceph-mon[33377]: pgmap v3743: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 221 KiB/s wr, 15 op/s 2024-05-08T08:44:03.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:03 smithi194 ceph-mon[33679]: pgmap v3744: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 221 KiB/s wr, 12 op/s 2024-05-08T08:44:03.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:03 smithi070 ceph-mon[29591]: pgmap v3744: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 221 KiB/s wr, 12 op/s 2024-05-08T08:44:03.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:03 smithi172 ceph-mon[33377]: pgmap v3744: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 221 KiB/s wr, 12 op/s 2024-05-08T08:44:05.504 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:05 smithi194 ceph-mon[33679]: pgmap v3745: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 221 KiB/s wr, 13 op/s 2024-05-08T08:44:05.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:05 smithi070 ceph-mon[29591]: pgmap v3745: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 221 KiB/s wr, 13 op/s 2024-05-08T08:44:05.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:05 smithi172 ceph-mon[33377]: pgmap v3745: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 221 KiB/s wr, 13 op/s 2024-05-08T08:44:06.295 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/dns_resolver/dns_key.o 2024-05-08T08:44:07.468 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/device_pm.o 2024-05-08T08:44:07.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:07 smithi070 ceph-mon[29591]: pgmap v3746: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 401 KiB/s wr, 43 op/s 2024-05-08T08:44:07.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:07 smithi070 ceph-mon[29591]: osdmap e312: 12 total, 12 up, 12 in 2024-05-08T08:44:07.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:07 smithi172 ceph-mon[33377]: pgmap v3746: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 401 KiB/s wr, 43 op/s 2024-05-08T08:44:07.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:07 smithi172 ceph-mon[33377]: osdmap e312: 12 total, 12 up, 12 in 2024-05-08T08:44:07.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:07 smithi194 ceph-mon[33679]: pgmap v3746: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 320 KiB/s rd, 401 KiB/s wr, 43 op/s 2024-05-08T08:44:07.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:07 smithi194 ceph-mon[33679]: osdmap e312: 12 total, 12 up, 12 in 2024-05-08T08:44:07.772 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/9p/trans_common.o 2024-05-08T08:44:08.418 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/coredump.o 2024-05-08T08:44:09.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:09 smithi070 ceph-mon[29591]: pgmap v3748: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 479 KiB/s wr, 48 op/s 2024-05-08T08:44:09.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:09 smithi172 ceph-mon[33377]: pgmap v3748: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 479 KiB/s wr, 48 op/s 2024-05-08T08:44:09.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:09 smithi194 ceph-mon[33679]: pgmap v3748: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 479 KiB/s wr, 48 op/s 2024-05-08T08:44:10.728 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/sysfs.o 2024-05-08T08:44:11.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:11 smithi070 ceph-mon[29591]: pgmap v3749: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 535 KiB/s wr, 47 op/s 2024-05-08T08:44:11.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:11 smithi070 ceph-mon[29591]: osdmap e313: 12 total, 12 up, 12 in 2024-05-08T08:44:11.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:11 smithi172 ceph-mon[33377]: pgmap v3749: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 535 KiB/s wr, 47 op/s 2024-05-08T08:44:11.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:11 smithi172 ceph-mon[33377]: osdmap e313: 12 total, 12 up, 12 in 2024-05-08T08:44:11.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:11 smithi194 ceph-mon[33679]: pgmap v3749: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 535 KiB/s wr, 47 op/s 2024-05-08T08:44:11.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:11 smithi194 ceph-mon[33679]: osdmap e313: 12 total, 12 up, 12 in 2024-05-08T08:44:13.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:13 smithi070 ceph-mon[29591]: pgmap v3751: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 669 KiB/s wr, 58 op/s 2024-05-08T08:44:13.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:13 smithi172 ceph-mon[33377]: pgmap v3751: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 669 KiB/s wr, 58 op/s 2024-05-08T08:44:13.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:13 smithi194 ceph-mon[33679]: pgmap v3751: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 669 KiB/s wr, 58 op/s 2024-05-08T08:44:14.020 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ah6.o 2024-05-08T08:44:14.047 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/gre_offload.o 2024-05-08T08:44:14.405 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/wme.o 2024-05-08T08:44:14.567 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/dns_resolver/dns_query.o 2024-05-08T08:44:15.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:15 smithi070 ceph-mon[29591]: pgmap v3752: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 399 KiB/s wr, 13 op/s 2024-05-08T08:44:15.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:15 smithi172 ceph-mon[33377]: pgmap v3752: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 399 KiB/s wr, 13 op/s 2024-05-08T08:44:15.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:15 smithi194 ceph-mon[33679]: pgmap v3752: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 399 KiB/s wr, 13 op/s 2024-05-08T08:44:15.850 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/9p/trans_fd.o 2024-05-08T08:44:17.536 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/proc.o 2024-05-08T08:44:17.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:17 smithi070 ceph-mon[29591]: pgmap v3753: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 624 KiB/s wr, 23 op/s 2024-05-08T08:44:17.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:17 smithi172 ceph-mon[33377]: pgmap v3753: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 624 KiB/s wr, 23 op/s 2024-05-08T08:44:17.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:17 smithi194 ceph-mon[33679]: pgmap v3753: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 624 KiB/s wr, 23 op/s 2024-05-08T08:44:19.474 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/drop_caches.o 2024-05-08T08:44:19.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:19 smithi070 ceph-mon[29591]: pgmap v3754: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 596 KiB/s wr, 22 op/s 2024-05-08T08:44:19.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:19 smithi172 ceph-mon[33377]: pgmap v3754: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 596 KiB/s wr, 22 op/s 2024-05-08T08:44:19.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:19 smithi194 ceph-mon[33679]: pgmap v3754: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 596 KiB/s wr, 22 op/s 2024-05-08T08:44:21.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:21 smithi070 ceph-mon[29591]: pgmap v3755: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 538 KiB/s wr, 26 op/s 2024-05-08T08:44:21.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:21 smithi172 ceph-mon[33377]: pgmap v3755: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 538 KiB/s wr, 26 op/s 2024-05-08T08:44:21.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:21 smithi194 ceph-mon[33679]: pgmap v3755: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 538 KiB/s wr, 26 op/s 2024-05-08T08:44:22.489 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/svc_xprt.o 2024-05-08T08:44:23.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:23 smithi070 ceph-mon[29591]: pgmap v3756: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 483 KiB/s wr, 24 op/s 2024-05-08T08:44:23.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:23 smithi172 ceph-mon[33377]: pgmap v3756: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 483 KiB/s wr, 24 op/s 2024-05-08T08:44:23.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:23 smithi194 ceph-mon[33679]: pgmap v3756: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 483 KiB/s wr, 24 op/s 2024-05-08T08:44:23.978 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/dns_resolver/built-in.a 2024-05-08T08:44:24.223 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/9p/trans_virtio.o 2024-05-08T08:44:25.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:25 smithi070 ceph-mon[29591]: pgmap v3757: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 448 KiB/s wr, 22 op/s 2024-05-08T08:44:25.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:25 smithi172 ceph-mon[33377]: pgmap v3757: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 448 KiB/s wr, 22 op/s 2024-05-08T08:44:25.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:25 smithi194 ceph-mon[33679]: pgmap v3757: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 448 KiB/s wr, 22 op/s 2024-05-08T08:44:26.627 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/metrics.o 2024-05-08T08:44:26.634 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/esp6.o 2024-05-08T08:44:27.245 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/chan.o 2024-05-08T08:44:27.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:27 smithi070 ceph-mon[29591]: pgmap v3758: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 782 KiB/s wr, 31 op/s 2024-05-08T08:44:27.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:27 smithi172 ceph-mon[33377]: pgmap v3758: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 782 KiB/s wr, 31 op/s 2024-05-08T08:44:27.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:27 smithi194 ceph-mon[33679]: pgmap v3758: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 782 KiB/s wr, 31 op/s 2024-05-08T08:44:27.976 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/bus.o 2024-05-08T08:44:28.793 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/sysctls.o 2024-05-08T08:44:29.460 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/trace.o 2024-05-08T08:44:29.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:29 smithi070 ceph-mon[29591]: pgmap v3759: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 551 KiB/s wr, 22 op/s 2024-05-08T08:44:29.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:44:29.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:29 smithi172 ceph-mon[33377]: pgmap v3759: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 551 KiB/s wr, 22 op/s 2024-05-08T08:44:29.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:44:29.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:29 smithi194 ceph-mon[33679]: pgmap v3759: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 551 KiB/s wr, 22 op/s 2024-05-08T08:44:29.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:44:31.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:31 smithi070 ceph-mon[29591]: pgmap v3760: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 788 KiB/s wr, 39 op/s 2024-05-08T08:44:31.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:31 smithi172 ceph-mon[33377]: pgmap v3760: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 788 KiB/s wr, 39 op/s 2024-05-08T08:44:31.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:31 smithi194 ceph-mon[33679]: pgmap v3760: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 788 KiB/s wr, 39 op/s 2024-05-08T08:44:32.688 INFO:tasks.workunit.client.0.smithi070.stdout: CC fs/fhandle.o 2024-05-08T08:44:33.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:33 smithi070 ceph-mon[29591]: pgmap v3761: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 571 KiB/s wr, 27 op/s 2024-05-08T08:44:33.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:33 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:44:33.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:33 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:44:33.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:33 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:44:33.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:33 smithi172 ceph-mon[33377]: pgmap v3761: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 571 KiB/s wr, 27 op/s 2024-05-08T08:44:33.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:33 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:44:33.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:33 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:44:33.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:33 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:44:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:33 smithi194 ceph-mon[33679]: pgmap v3761: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 571 KiB/s wr, 27 op/s 2024-05-08T08:44:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:33 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:44:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:33 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:44:33.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:33 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:44:35.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:35 smithi070 ceph-mon[29591]: pgmap v3762: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 571 KiB/s wr, 27 op/s 2024-05-08T08:44:35.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:35 smithi172 ceph-mon[33377]: pgmap v3762: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 571 KiB/s wr, 27 op/s 2024-05-08T08:44:35.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:35 smithi194 ceph-mon[33679]: pgmap v3762: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 571 KiB/s wr, 27 op/s 2024-05-08T08:44:36.669 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/xprtmultipath.o 2024-05-08T08:44:37.452 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/9p/built-in.a 2024-05-08T08:44:37.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:37 smithi070 ceph-mon[29591]: pgmap v3763: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 834 KiB/s wr, 35 op/s 2024-05-08T08:44:37.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:37 smithi172 ceph-mon[33377]: pgmap v3763: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 834 KiB/s wr, 35 op/s 2024-05-08T08:44:37.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:37 smithi194 ceph-mon[33679]: pgmap v3763: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 845 KiB/s rd, 834 KiB/s wr, 35 op/s 2024-05-08T08:44:37.918 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/stats.o 2024-05-08T08:44:38.944 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/glue.o 2024-05-08T08:44:39.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:39 smithi070 ceph-mon[29591]: pgmap v3764: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 500 KiB/s wr, 26 op/s 2024-05-08T08:44:39.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:39 smithi172 ceph-mon[33377]: pgmap v3764: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 500 KiB/s wr, 26 op/s 2024-05-08T08:44:39.754 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:39 smithi194 ceph-mon[33679]: pgmap v3764: 129 pgs: 129 active+clean; 2.0 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 500 KiB/s wr, 26 op/s 2024-05-08T08:44:40.569 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/netlink.o 2024-05-08T08:44:40.583 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/nexthop.o 2024-05-08T08:44:41.388 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/sit.o 2024-05-08T08:44:41.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:41 smithi070 ceph-mon[29591]: pgmap v3765: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 925 KiB/s wr, 38 op/s 2024-05-08T08:44:41.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:41 smithi172 ceph-mon[33377]: pgmap v3765: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 925 KiB/s wr, 38 op/s 2024-05-08T08:44:41.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:41 smithi194 ceph-mon[33679]: pgmap v3765: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 924 KiB/s rd, 925 KiB/s wr, 38 op/s 2024-05-08T08:44:43.348 INFO:tasks.workunit.client.0.smithi070.stdout: AR fs/built-in.a 2024-05-08T08:44:43.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:43 smithi070 ceph-mon[29591]: pgmap v3766: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 687 KiB/s wr, 20 op/s 2024-05-08T08:44:43.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:43 smithi172 ceph-mon[33377]: pgmap v3766: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 687 KiB/s wr, 20 op/s 2024-05-08T08:44:43.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:43 smithi194 ceph-mon[33679]: pgmap v3766: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 687 KiB/s wr, 20 op/s 2024-05-08T08:44:45.622 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:45 smithi070 ceph-mon[29591]: pgmap v3767: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 693 KiB/s wr, 23 op/s 2024-05-08T08:44:45.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:45 smithi172 ceph-mon[33377]: pgmap v3767: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 693 KiB/s wr, 23 op/s 2024-05-08T08:44:45.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:45 smithi194 ceph-mon[33679]: pgmap v3767: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 693 KiB/s wr, 23 op/s 2024-05-08T08:44:46.303 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/mlme.o 2024-05-08T08:44:47.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:47 smithi070 ceph-mon[29591]: pgmap v3768: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 964 KiB/s wr, 53 op/s 2024-05-08T08:44:47.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:47 smithi172 ceph-mon[33377]: pgmap v3768: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 964 KiB/s wr, 53 op/s 2024-05-08T08:44:47.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:47 smithi194 ceph-mon[33679]: pgmap v3768: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 941 KiB/s rd, 964 KiB/s wr, 53 op/s 2024-05-08T08:44:48.216 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/scan.o 2024-05-08T08:44:48.801 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/tdls.o 2024-05-08T08:44:49.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:49 smithi172 ceph-mon[33377]: pgmap v3769: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 701 KiB/s wr, 45 op/s 2024-05-08T08:44:49.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:49 smithi194 ceph-mon[33679]: pgmap v3769: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 701 KiB/s wr, 45 op/s 2024-05-08T08:44:49.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:49 smithi070 ceph-mon[29591]: pgmap v3769: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 701 KiB/s wr, 45 op/s 2024-05-08T08:44:50.528 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sunrpc/sysctl.o 2024-05-08T08:44:51.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:51 smithi172 ceph-mon[33377]: pgmap v3770: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-05-08T08:44:51.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:51 smithi194 ceph-mon[33679]: pgmap v3770: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-05-08T08:44:51.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:51 smithi070 ceph-mon[29591]: pgmap v3770: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 64 op/s 2024-05-08T08:44:52.162 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/addrconf_core.o 2024-05-08T08:44:52.736 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/handshake/genl.o 2024-05-08T08:44:53.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:53 smithi172 ceph-mon[33377]: pgmap v3771: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 720 KiB/s wr, 52 op/s 2024-05-08T08:44:53.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:53 smithi194 ceph-mon[33679]: pgmap v3771: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 720 KiB/s wr, 52 op/s 2024-05-08T08:44:53.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:53 smithi070 ceph-mon[29591]: pgmap v3771: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 720 KiB/s wr, 52 op/s 2024-05-08T08:44:54.115 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/udp_tunnel_stub.o 2024-05-08T08:44:54.909 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ip_tunnel.o 2024-05-08T08:44:55.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:55 smithi172 ceph-mon[33377]: pgmap v3772: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 722 KiB/s wr, 52 op/s 2024-05-08T08:44:55.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:55 smithi194 ceph-mon[33679]: pgmap v3772: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 722 KiB/s wr, 52 op/s 2024-05-08T08:44:55.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:55 smithi070 ceph-mon[29591]: pgmap v3772: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 722 KiB/s wr, 52 op/s 2024-05-08T08:44:57.674 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:57 smithi172 ceph-mon[33377]: pgmap v3773: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 1006 KiB/s wr, 60 op/s 2024-05-08T08:44:57.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:57 smithi194 ceph-mon[33679]: pgmap v3773: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 1006 KiB/s wr, 60 op/s 2024-05-08T08:44:57.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:57 smithi070 ceph-mon[29591]: pgmap v3773: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 1006 KiB/s wr, 60 op/s 2024-05-08T08:44:58.459 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/resource.o 2024-05-08T08:44:59.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:44:59 smithi172 ceph-mon[33377]: pgmap v3774: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 735 KiB/s wr, 29 op/s 2024-05-08T08:44:59.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:44:59 smithi194 ceph-mon[33679]: pgmap v3774: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 735 KiB/s wr, 29 op/s 2024-05-08T08:44:59.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:44:59 smithi070 ceph-mon[29591]: pgmap v3774: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 735 KiB/s wr, 29 op/s 2024-05-08T08:45:01.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:01 smithi172 ceph-mon[33377]: pgmap v3775: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1.1 MiB/s wr, 37 op/s 2024-05-08T08:45:01.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:01 smithi194 ceph-mon[33679]: pgmap v3775: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1.1 MiB/s wr, 37 op/s 2024-05-08T08:45:01.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:01 smithi070 ceph-mon[29591]: pgmap v3775: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1.1 MiB/s wr, 37 op/s 2024-05-08T08:45:02.081 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/handshake/netlink.o 2024-05-08T08:45:03.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:03 smithi172 ceph-mon[33377]: pgmap v3776: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 672 KiB/s wr, 18 op/s 2024-05-08T08:45:03.675 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:03 smithi070 ceph-mon[29591]: pgmap v3776: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 672 KiB/s wr, 18 op/s 2024-05-08T08:45:03.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:03 smithi194 ceph-mon[33679]: pgmap v3776: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 672 KiB/s wr, 18 op/s 2024-05-08T08:45:04.169 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/sysctl_net_ipv4.o 2024-05-08T08:45:04.233 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/sunrpc/built-in.a 2024-05-08T08:45:04.338 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/ocb.o 2024-05-08T08:45:05.370 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/exthdrs_core.o 2024-05-08T08:45:05.673 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:05 smithi172 ceph-mon[33377]: pgmap v3777: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 672 KiB/s wr, 18 op/s 2024-05-08T08:45:05.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:05 smithi194 ceph-mon[33679]: pgmap v3777: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 672 KiB/s wr, 18 op/s 2024-05-08T08:45:05.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:05 smithi070 ceph-mon[29591]: pgmap v3777: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 672 KiB/s wr, 18 op/s 2024-05-08T08:45:05.969 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/handshake/request.o 2024-05-08T08:45:07.149 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_processor.o 2024-05-08T08:45:07.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:07 smithi194 ceph-mon[33679]: pgmap v3778: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 902 KiB/s wr, 49 op/s 2024-05-08T08:45:07.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:07 smithi194 ceph-mon[33679]: osdmap e314: 12 total, 12 up, 12 in 2024-05-08T08:45:07.806 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/handshake/tlshd.o 2024-05-08T08:45:07.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:07 smithi070 ceph-mon[29591]: pgmap v3778: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 902 KiB/s wr, 49 op/s 2024-05-08T08:45:07.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:07 smithi070 ceph-mon[29591]: osdmap e314: 12 total, 12 up, 12 in 2024-05-08T08:45:07.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:07 smithi172 ceph-mon[33377]: pgmap v3778: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 902 KiB/s wr, 49 op/s 2024-05-08T08:45:07.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:07 smithi172 ceph-mon[33377]: osdmap e314: 12 total, 12 up, 12 in 2024-05-08T08:45:09.497 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio.o 2024-05-08T08:45:09.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:09 smithi194 ceph-mon[33679]: pgmap v3780: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 734 KiB/s wr, 47 op/s 2024-05-08T08:45:09.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:09 smithi070 ceph-mon[29591]: pgmap v3780: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 734 KiB/s wr, 47 op/s 2024-05-08T08:45:09.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:09 smithi172 ceph-mon[33377]: pgmap v3780: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 734 KiB/s wr, 47 op/s 2024-05-08T08:45:11.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:11 smithi194 ceph-mon[33679]: pgmap v3781: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 616 KiB/s wr, 53 op/s 2024-05-08T08:45:11.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:11 smithi070 ceph-mon[29591]: pgmap v3781: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 616 KiB/s wr, 53 op/s 2024-05-08T08:45:11.923 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:11 smithi172 ceph-mon[33377]: pgmap v3781: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 616 KiB/s wr, 53 op/s 2024-05-08T08:45:13.566 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio_ring.o 2024-05-08T08:45:13.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:13 smithi194 ceph-mon[33679]: pgmap v3782: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 616 KiB/s wr, 53 op/s 2024-05-08T08:45:13.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:13 smithi070 ceph-mon[29591]: pgmap v3782: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 616 KiB/s wr, 53 op/s 2024-05-08T08:45:13.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:13 smithi172 ceph-mon[33377]: pgmap v3782: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 616 KiB/s wr, 53 op/s 2024-05-08T08:45:14.755 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:14 smithi194 ceph-mon[33679]: pgmap v3783: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 622 KiB/s wr, 52 op/s 2024-05-08T08:45:14.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:14 smithi070 ceph-mon[29591]: pgmap v3783: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 622 KiB/s wr, 52 op/s 2024-05-08T08:45:14.924 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:14 smithi172 ceph-mon[33377]: pgmap v3783: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 622 KiB/s wr, 52 op/s 2024-05-08T08:45:16.415 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/airtime.o 2024-05-08T08:45:16.464 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/processor_core.o 2024-05-08T08:45:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:16 smithi194 ceph-mon[33679]: osdmap e315: 12 total, 12 up, 12 in 2024-05-08T08:45:17.005 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:16 smithi194 ceph-mon[33679]: pgmap v3785: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 742 KiB/s wr, 28 op/s 2024-05-08T08:45:17.079 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ip6_checksum.o 2024-05-08T08:45:17.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:16 smithi070 ceph-mon[29591]: osdmap e315: 12 total, 12 up, 12 in 2024-05-08T08:45:17.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:16 smithi070 ceph-mon[29591]: pgmap v3785: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 742 KiB/s wr, 28 op/s 2024-05-08T08:45:17.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:16 smithi172 ceph-mon[33377]: osdmap e315: 12 total, 12 up, 12 in 2024-05-08T08:45:17.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:16 smithi172 ceph-mon[33377]: pgmap v3785: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 742 KiB/s wr, 28 op/s 2024-05-08T08:45:17.314 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/proc.o 2024-05-08T08:45:17.978 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/fib_rules.o 2024-05-08T08:45:18.073 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio_anchor.o 2024-05-08T08:45:19.149 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/handshake/trace.o 2024-05-08T08:45:19.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:18 smithi172 ceph-mon[33377]: pgmap v3786: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 698 KiB/s wr, 26 op/s 2024-05-08T08:45:19.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:18 smithi194 ceph-mon[33679]: pgmap v3786: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 698 KiB/s wr, 26 op/s 2024-05-08T08:45:19.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:18 smithi070 ceph-mon[29591]: pgmap v3786: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 698 KiB/s wr, 26 op/s 2024-05-08T08:45:21.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:20 smithi172 ceph-mon[33377]: pgmap v3787: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 704 KiB/s wr, 28 op/s 2024-05-08T08:45:21.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:20 smithi194 ceph-mon[33679]: pgmap v3787: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 704 KiB/s wr, 28 op/s 2024-05-08T08:45:21.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:20 smithi070 ceph-mon[29591]: pgmap v3787: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 704 KiB/s wr, 28 op/s 2024-05-08T08:45:22.631 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/eht.o 2024-05-08T08:45:23.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:22 smithi172 ceph-mon[33377]: pgmap v3788: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 706 KiB/s wr, 28 op/s 2024-05-08T08:45:23.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:22 smithi194 ceph-mon[33679]: pgmap v3788: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 706 KiB/s wr, 28 op/s 2024-05-08T08:45:23.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:22 smithi070 ceph-mon[29591]: pgmap v3788: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 706 KiB/s wr, 28 op/s 2024-05-08T08:45:23.923 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/processor_pdc.o 2024-05-08T08:45:25.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:24 smithi172 ceph-mon[33377]: pgmap v3789: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 706 KiB/s wr, 28 op/s 2024-05-08T08:45:25.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:24 smithi194 ceph-mon[33679]: pgmap v3789: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 706 KiB/s wr, 28 op/s 2024-05-08T08:45:25.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:24 smithi070 ceph-mon[29591]: pgmap v3789: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 706 KiB/s wr, 28 op/s 2024-05-08T08:45:25.899 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio_pci_modern_dev.o 2024-05-08T08:45:27.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:26 smithi172 ceph-mon[33377]: pgmap v3790: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 631 KiB/s wr, 31 op/s 2024-05-08T08:45:27.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:26 smithi194 ceph-mon[33679]: pgmap v3790: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 631 KiB/s wr, 31 op/s 2024-05-08T08:45:27.411 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:26 smithi070 ceph-mon[29591]: pgmap v3790: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 631 KiB/s wr, 31 op/s 2024-05-08T08:45:28.078 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/ec.o 2024-05-08T08:45:28.904 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ip6_icmp.o 2024-05-08T08:45:29.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:28 smithi172 ceph-mon[33377]: pgmap v3791: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 533 KiB/s wr, 26 op/s 2024-05-08T08:45:29.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:28 smithi194 ceph-mon[33679]: pgmap v3791: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 533 KiB/s wr, 26 op/s 2024-05-08T08:45:29.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:28 smithi070 ceph-mon[29591]: pgmap v3791: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 569 KiB/s rd, 533 KiB/s wr, 26 op/s 2024-05-08T08:45:30.325 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio_pci_legacy_dev.o 2024-05-08T08:45:30.355 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:45:30.355 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.05 2024-05-08T08:45:30.356 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:45:30.386 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ipmr.o 2024-05-08T08:45:30.928 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:45:30.966 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/handshake/built-in.a 2024-05-08T08:45:31.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:30 smithi172 ceph-mon[33377]: pgmap v3792: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 845 KiB/s wr, 40 op/s 2024-05-08T08:45:31.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:30 smithi194 ceph-mon[33679]: pgmap v3792: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 845 KiB/s wr, 40 op/s 2024-05-08T08:45:31.256 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:30 smithi070 ceph-mon[29591]: pgmap v3792: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 845 KiB/s wr, 40 op/s 2024-05-08T08:45:31.265 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ipmr_base.o 2024-05-08T08:45:31.993 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/devres.o 2024-05-08T08:45:33.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:32 smithi070 ceph-mon[29591]: pgmap v3793: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 557 KiB/s wr, 26 op/s 2024-05-08T08:45:33.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:45:33.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:32 smithi194 ceph-mon[33679]: pgmap v3793: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 557 KiB/s wr, 26 op/s 2024-05-08T08:45:33.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:45:33.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:32 smithi172 ceph-mon[33377]: pgmap v3793: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 557 KiB/s wr, 26 op/s 2024-05-08T08:45:33.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:45:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.510+0000 7f8e66a00700 1 -- 172.21.15.70:0/3738572308 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e58003b50 con 0x7f8e68102d60 2024-05-08T08:45:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.511+0000 7f8e6ec00700 1 -- 172.21.15.70:0/3738572308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68102d60 msgr2=0x7f8e6810f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.511+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/3738572308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68102d60 0x7f8e6810f250 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f8e5801a9a0 tx=0x7f8e5801acb0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.512+0000 7f8e6ec00700 1 -- 172.21.15.70:0/3738572308 shutdown_connections 2024-05-08T08:45:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.512+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/3738572308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68102d60 0x7f8e6810f250 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.512+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/3738572308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68108410 0x7f8e681087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.512+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/3738572308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e681023a0 0x7f8e68102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.512+0000 7f8e6ec00700 1 -- 172.21.15.70:0/3738572308 >> 172.21.15.70:0/3738572308 conn(0x7f8e68079350 msgr2=0x7f8e68079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:45:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.512+0000 7f8e6ec00700 1 -- 172.21.15.70:0/3738572308 shutdown_connections 2024-05-08T08:45:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.512+0000 7f8e6ec00700 1 -- 172.21.15.70:0/3738572308 wait complete. 2024-05-08T08:45:33.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.514+0000 7f8e6ec00700 1 Processor -- start 2024-05-08T08:45:33.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.514+0000 7f8e6ec00700 1 -- start start 2024-05-08T08:45:33.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.515+0000 7f8e6ec00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e681023a0 0x7f8e68109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:33.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.515+0000 7f8e6ec00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68102d60 0x7f8e6810a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:33.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.515+0000 7f8e6ec00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68108410 0x7f8e6819d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:33.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.515+0000 7f8e6ec00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e680727c0 con 0x7f8e68102d60 2024-05-08T08:45:33.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.515+0000 7f8e6ec00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68072640 con 0x7f8e68108410 2024-05-08T08:45:33.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.515+0000 7f8e6ec00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8e68072940 con 0x7f8e681023a0 2024-05-08T08:45:33.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.515+0000 7f8e67e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e681023a0 0x7f8e68109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:33.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.515+0000 7f8e67e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e681023a0 0x7f8e68109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:44192/0 (socket says 172.21.15.70:44192) 2024-05-08T08:45:33.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.515+0000 7f8e67e00700 1 -- 172.21.15.70:0/1878020910 learned_addr learned my addr 172.21.15.70:0/1878020910 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:45:33.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.516+0000 7f8e6cc00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68108410 0x7f8e6819d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:33.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.516+0000 7f8e67e00700 1 -- 172.21.15.70:0/1878020910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68108410 msgr2=0x7f8e6819d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:33.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.516+0000 7f8e67e00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68108410 0x7f8e6819d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.516+0000 7f8e67e00700 1 -- 172.21.15.70:0/1878020910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68102d60 msgr2=0x7f8e6810a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:33.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.516+0000 7f8e67e00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68102d60 0x7f8e6810a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.516+0000 7f8e67e00700 1 -- 172.21.15.70:0/1878020910 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6819db00 con 0x7f8e681023a0 2024-05-08T08:45:33.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.517+0000 7f8e67e00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e681023a0 0x7f8e68109c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000ada0 tx=0x7f8e6000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:45:33.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.517+0000 7f8e64c00700 1 -- 172.21.15.70:0/1878020910 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60017020 con 0x7f8e681023a0 2024-05-08T08:45:33.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.517+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6819ddf0 con 0x7f8e681023a0 2024-05-08T08:45:33.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.517+0000 7f8e64c00700 1 -- 172.21.15.70:0/1878020910 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e6000ce10 con 0x7f8e681023a0 2024-05-08T08:45:33.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.517+0000 7f8e64c00700 1 -- 172.21.15.70:0/1878020910 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e600053e0 con 0x7f8e681023a0 2024-05-08T08:45:33.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.517+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e681a44e0 con 0x7f8e681023a0 2024-05-08T08:45:33.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.519+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e44005330 con 0x7f8e681023a0 2024-05-08T08:45:33.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.524+0000 7f8e64c00700 1 -- 172.21.15.70:0/1878020910 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8e60004ad0 con 0x7f8e681023a0 2024-05-08T08:45:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.527+0000 7f8e64c00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e480b2b20 0x7f8e480b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.527+0000 7f8e64c00700 1 -- 172.21.15.70:0/1878020910 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(315..315 src has 1..315) ==== 9583+0+0 (secure 0 0 0) 0x7f8e600e2630 con 0x7f8e681023a0 2024-05-08T08:45:33.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.528+0000 7f8e64c00700 1 -- 172.21.15.70:0/1878020910 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8e60021020 con 0x7f8e681023a0 2024-05-08T08:45:33.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.528+0000 7f8e67400700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e480b2b20 0x7f8e480b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:33.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.531+0000 7f8e67400700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e480b2b20 0x7f8e480b4fe0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8e50005950 tx=0x7f8e500058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:45:33.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.959+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e44005620 con 0x7f8e681023a0 2024-05-08T08:45:33.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.961+0000 7f8e64c00700 1 -- 172.21.15.70:0/1878020910 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f8e600a9c20 con 0x7f8e681023a0 2024-05-08T08:45:33.956 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:45:33.956 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:45:33.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.964+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e480b2b20 msgr2=0x7f8e480b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:33.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.964+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e480b2b20 0x7f8e480b4fe0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8e50005950 tx=0x7f8e500058e0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.964+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e681023a0 msgr2=0x7f8e68109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:33.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.964+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e681023a0 0x7f8e68109c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e6000ada0 tx=0x7f8e6000c330 comp rx=0 tx=0).stop 2024-05-08T08:45:33.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.965+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 shutdown_connections 2024-05-08T08:45:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.965+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e480b2b20 0x7f8e480b4fe0 secure :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8e50005950 tx=0x7f8e500058e0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.965+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e68108410 0x7f8e6819d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.965+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e681023a0 0x7f8e68109c80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.965+0000 7f8e6ec00700 1 --2- 172.21.15.70:0/1878020910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e68102d60 0x7f8e6810a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.965+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 >> 172.21.15.70:0/1878020910 conn(0x7f8e68079350 msgr2=0x7f8e68103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:45:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.965+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 shutdown_connections 2024-05-08T08:45:33.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:33.965+0000 7f8e6ec00700 1 -- 172.21.15.70:0/1878020910 wait complete. 2024-05-08T08:45:33.961 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:45:34.751 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/led.o 2024-05-08T08:45:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:34 smithi194 ceph-mon[33679]: pgmap v3794: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 562 KiB/s wr, 27 op/s 2024-05-08T08:45:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1878020910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:45:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:45:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:45:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:45:35.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:34 smithi070 ceph-mon[29591]: pgmap v3794: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 562 KiB/s wr, 27 op/s 2024-05-08T08:45:35.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1878020910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:45:35.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:45:35.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:45:35.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:45:35.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:34 smithi172 ceph-mon[33377]: pgmap v3794: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 562 KiB/s wr, 27 op/s 2024-05-08T08:45:35.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1878020910' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:45:35.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:45:35.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:45:35.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:45:37.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:36 smithi194 ceph-mon[33679]: pgmap v3795: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 870 KiB/s wr, 34 op/s 2024-05-08T08:45:37.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:36 smithi070 ceph-mon[29591]: pgmap v3795: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 870 KiB/s wr, 34 op/s 2024-05-08T08:45:37.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:36 smithi172 ceph-mon[33377]: pgmap v3795: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 870 KiB/s wr, 34 op/s 2024-05-08T08:45:39.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:38 smithi194 ceph-mon[33679]: pgmap v3796: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 631 KiB/s wr, 22 op/s 2024-05-08T08:45:39.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:38 smithi070 ceph-mon[29591]: pgmap v3796: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 631 KiB/s wr, 22 op/s 2024-05-08T08:45:39.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:38 smithi172 ceph-mon[33377]: pgmap v3796: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 631 KiB/s wr, 22 op/s 2024-05-08T08:45:40.862 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/syncookies.o 2024-05-08T08:45:40.889 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio_pci_modern.o 2024-05-08T08:45:41.107 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/dock.o 2024-05-08T08:45:41.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:40 smithi194 ceph-mon[33679]: pgmap v3797: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 910 KiB/s wr, 35 op/s 2024-05-08T08:45:41.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:40 smithi070 ceph-mon[29591]: pgmap v3797: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 910 KiB/s wr, 35 op/s 2024-05-08T08:45:41.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:40 smithi172 ceph-mon[33377]: pgmap v3797: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 910 KiB/s wr, 35 op/s 2024-05-08T08:45:42.503 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/output_core.o 2024-05-08T08:45:42.549 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.05 --await-for 42.0' 2024-05-08T08:45:42.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.05 --await-for 42.0 2024-05-08T08:45:43.169 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:45:43.219 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:42 smithi070 ceph-mon[29591]: pgmap v3798: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 598 KiB/s wr, 21 op/s 2024-05-08T08:45:43.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:42 smithi194 ceph-mon[33679]: pgmap v3798: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 598 KiB/s wr, 21 op/s 2024-05-08T08:45:43.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:42 smithi172 ceph-mon[33377]: pgmap v3798: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 598 KiB/s wr, 21 op/s 2024-05-08T08:45:44.055 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/protocol.o 2024-05-08T08:45:44.182 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/ip6_offload.o 2024-05-08T08:45:45.105 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/tcpv6_offload.o 2024-05-08T08:45:45.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:44 smithi070 ceph-mon[29591]: pgmap v3799: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 599 KiB/s wr, 22 op/s 2024-05-08T08:45:45.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:44 smithi194 ceph-mon[33679]: pgmap v3799: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 599 KiB/s wr, 22 op/s 2024-05-08T08:45:45.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:44 smithi172 ceph-mon[33377]: pgmap v3799: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 599 KiB/s wr, 22 op/s 2024-05-08T08:45:46.463 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/pm.o 2024-05-08T08:45:47.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:46 smithi194 ceph-mon[33679]: pgmap v3800: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 889 KiB/s wr, 33 op/s 2024-05-08T08:45:47.337 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:46 smithi070 ceph-mon[29591]: pgmap v3800: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 889 KiB/s wr, 33 op/s 2024-05-08T08:45:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:46 smithi172 ceph-mon[33377]: pgmap v3800: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 889 KiB/s wr, 33 op/s 2024-05-08T08:45:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.835+0000 7eff6d200700 1 -- 172.21.15.70:0/1101606572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff68102600 msgr2=0x7eff681029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.835+0000 7eff6d200700 1 --2- 172.21.15.70:0/1101606572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff68102600 0x7eff681029e0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7eff58009a40 tx=0x7eff58009d50 comp rx=0 tx=0).stop 2024-05-08T08:45:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.836+0000 7eff6d200700 1 -- 172.21.15.70:0/1101606572 shutdown_connections 2024-05-08T08:45:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.836+0000 7eff6d200700 1 --2- 172.21.15.70:0/1101606572 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff681076d0 0x7eff6810f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.836+0000 7eff6d200700 1 --2- 172.21.15.70:0/1101606572 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff68102600 0x7eff681029e0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.836+0000 7eff6d200700 1 --2- 172.21.15.70:0/1101606572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68102fb0 0x7eff68106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.836+0000 7eff6d200700 1 -- 172.21.15.70:0/1101606572 >> 172.21.15.70:0/1101606572 conn(0x7eff68079340 msgr2=0x7eff68079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:45:47.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.836+0000 7eff6d200700 1 -- 172.21.15.70:0/1101606572 shutdown_connections 2024-05-08T08:45:47.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.836+0000 7eff6d200700 1 -- 172.21.15.70:0/1101606572 wait complete. 2024-05-08T08:45:47.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.838+0000 7eff6d200700 1 Processor -- start 2024-05-08T08:45:47.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.838+0000 7eff6d200700 1 -- start start 2024-05-08T08:45:47.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.838+0000 7eff6d200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff68102fb0 0x7eff68074e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.838+0000 7eff6d200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff681076d0 0x7eff6806df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.838+0000 7eff6d200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff6806e440 0x7eff6806e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.839+0000 7eff6d200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff681113c0 con 0x7eff681076d0 2024-05-08T08:45:47.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.839+0000 7eff6d200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff68111240 con 0x7eff68102fb0 2024-05-08T08:45:47.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.839+0000 7eff6d200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7eff68111540 con 0x7eff6806e440 2024-05-08T08:45:47.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.839+0000 7eff65e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff68102fb0 0x7eff68074e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.839+0000 7eff65e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff68102fb0 0x7eff68074e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:47168/0 (socket says 172.21.15.70:47168) 2024-05-08T08:45:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.839+0000 7eff65e00700 1 -- 172.21.15.70:0/503787071 learned_addr learned my addr 172.21.15.70:0/503787071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:45:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.839+0000 7eff65400700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff681076d0 0x7eff6806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.840+0000 7eff66800700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff6806e440 0x7eff6806e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.840+0000 7eff65e00700 1 -- 172.21.15.70:0/503787071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff6806e440 msgr2=0x7eff6806e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.840+0000 7eff65e00700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff6806e440 0x7eff6806e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.840+0000 7eff65e00700 1 -- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff681076d0 msgr2=0x7eff6806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.840+0000 7eff65e00700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff681076d0 0x7eff6806df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.840+0000 7eff65e00700 1 -- 172.21.15.70:0/503787071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff68072a50 con 0x7eff68102fb0 2024-05-08T08:45:47.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.840+0000 7eff65400700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff681076d0 0x7eff6806df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:45:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.840+0000 7eff65e00700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff68102fb0 0x7eff68074e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff58000c00 tx=0x7eff58004000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:45:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.841+0000 7eff5ea00700 1 -- 172.21.15.70:0/503787071 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58023070 con 0x7eff68102fb0 2024-05-08T08:45:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.841+0000 7eff5ea00700 1 -- 172.21.15.70:0/503787071 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff58005020 con 0x7eff68102fb0 2024-05-08T08:45:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.841+0000 7eff6d200700 1 -- 172.21.15.70:0/503787071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff68072ce0 con 0x7eff68102fb0 2024-05-08T08:45:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.841+0000 7eff5ea00700 1 -- 172.21.15.70:0/503787071 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff58004a10 con 0x7eff68102fb0 2024-05-08T08:45:47.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.841+0000 7eff6d200700 1 -- 172.21.15.70:0/503787071 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff68073110 con 0x7eff68102fb0 2024-05-08T08:45:47.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.848+0000 7eff5ea00700 1 -- 172.21.15.70:0/503787071 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7eff580054d0 con 0x7eff68102fb0 2024-05-08T08:45:47.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.851+0000 7eff5ea00700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7eff4c0b2bf0 0x7eff4c0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.851+0000 7eff5ea00700 1 -- 172.21.15.70:0/503787071 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(315..315 src has 1..315) ==== 9583+0+0 (secure 0 0 0) 0x7eff580e40f0 con 0x7eff68102fb0 2024-05-08T08:45:47.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.852+0000 7eff65400700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7eff4c0b2bf0 0x7eff4c0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.853+0000 7eff65400700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7eff4c0b2bf0 0x7eff4c0b50b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7eff6806f670 tx=0x7eff5400b410 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:45:47.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.867+0000 7eff77bd9b80 1 Processor -- start 2024-05-08T08:45:47.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.867+0000 7eff77bd9b80 1 -- start start 2024-05-08T08:45:47.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.868+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa100330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.868+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fa520 0x562cfa0fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.868+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0faee0 0x562cfa106d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.868+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562cfa04cbb0 con 0x562cfa0faee0 2024-05-08T08:45:47.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.868+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562cf9fea8f0 con 0x562cfa0fa520 2024-05-08T08:45:47.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.868+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562cfa048b70 con 0x562cfa0fff50 2024-05-08T08:45:47.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.869+0000 7eff65e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa100330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.869+0000 7eff65e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa100330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:38854/0 (socket says 172.21.15.70:38854) 2024-05-08T08:45:47.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.869+0000 7eff65400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fa520 0x562cfa0fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.869+0000 7eff65e00700 1 -- 172.21.15.70:0/497594471 learned_addr learned my addr 172.21.15.70:0/497594471 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:45:47.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.869+0000 7eff66800700 1 --2- 172.21.15.70:0/497594471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0faee0 0x562cfa106d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.870+0000 7eff66800700 1 -- 172.21.15.70:0/497594471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 msgr2=0x562cfa100330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:45:47.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.870+0000 7eff66800700 1 --2- 172.21.15.70:0/497594471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa100330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.870+0000 7eff66800700 1 -- 172.21.15.70:0/497594471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fa520 msgr2=0x562cfa0fa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:45:47.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.870+0000 7eff66800700 1 --2- 172.21.15.70:0/497594471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fa520 0x562cfa0fa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.870+0000 7eff66800700 1 -- 172.21.15.70:0/497594471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cf9f99a60 con 0x562cfa0faee0 2024-05-08T08:45:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.871+0000 7eff66800700 1 --2- 172.21.15.70:0/497594471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0faee0 0x562cfa106d10 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7eff60009bb0 tx=0x7eff600094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20dd245c29883b9a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:45:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.871+0000 7eff53400700 1 -- 172.21.15.70:0/497594471 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60019070 con 0x562cfa0faee0 2024-05-08T08:45:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.871+0000 7eff53400700 1 -- 172.21.15.70:0/497594471 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff60007da0 con 0x562cfa0faee0 2024-05-08T08:45:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.872+0000 7eff53400700 1 -- 172.21.15.70:0/497594471 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60013720 con 0x562cfa0faee0 2024-05-08T08:45:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.873+0000 7eff77bd9b80 1 -- 172.21.15.70:0/497594471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0faee0 msgr2=0x562cfa106d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.873+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/497594471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0faee0 0x562cfa106d10 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7eff60009bb0 tx=0x7eff600094b0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.873+0000 7eff77bd9b80 1 -- 172.21.15.70:0/497594471 shutdown_connections 2024-05-08T08:45:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.873+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/497594471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0faee0 0x562cfa106d10 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.873+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/497594471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.873+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/497594471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fa520 0x562cfa0fa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.873+0000 7eff77bd9b80 1 -- 172.21.15.70:0/497594471 >> 172.21.15.70:0/497594471 conn(0x562cfa028cf0 msgr2=0x562cfa0f4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:45:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.873+0000 7eff77bd9b80 1 -- 172.21.15.70:0/497594471 shutdown_connections 2024-05-08T08:45:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.873+0000 7eff77bd9b80 1 -- 172.21.15.70:0/497594471 wait complete. 2024-05-08T08:45:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.874+0000 7eff77bd9b80 1 -- start start 2024-05-08T08:45:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.874+0000 7eff77bd9b80 1 Processor -- start 2024-05-08T08:45:47.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa106950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 0x562cfa103cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa104230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562cfa107310 con 0x562cfa0fa520 2024-05-08T08:45:47.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562cf9fb2cb0 con 0x562cfa0faee0 2024-05-08T08:45:47.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562cfa107490 con 0x562cfa0fff50 2024-05-08T08:45:47.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff77bd9b80 10 client.0 _ll_register_callbacks cb 0x562cf9ff3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:45:47.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff65e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa106950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff65e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa106950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54312/0 (socket says 172.21.15.70:54312) 2024-05-08T08:45:47.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff65e00700 1 -- 172.21.15.70:0/2155961075 learned_addr learned my addr 172.21.15.70:0/2155961075 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:45:47.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.875+0000 7eff65400700 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 0x562cfa103cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff65e00700 1 -- 172.21.15.70:0/2155961075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 msgr2=0x562cfa104230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:45:47.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff66800700 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa104230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff65e00700 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa104230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff65e00700 1 -- 172.21.15.70:0/2155961075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 msgr2=0x562cfa103cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff65e00700 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 0x562cfa103cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff65e00700 1 -- 172.21.15.70:0/2155961075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cfa0125b0 con 0x562cfa0fa520 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff66800700 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff65e00700 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa106950 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7eff58005cb0 tx=0x7eff580e1920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddaaad686a160d92 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff47e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff47e00700 1 -- 172.21.15.70:0/2155961075 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580c5060 con 0x562cfa0fa520 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff47e00700 1 -- 172.21.15.70:0/2155961075 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(315..315 src has 1..315) ==== 9583+0+0 (secure 0 0 0) 0x7eff580b3c40 con 0x562cfa0fa520 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.876+0000 7eff77bd9b80 1 -- 172.21.15.70:0/2155961075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff60007da0 con 0x562cfa0fa520 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.877+0000 7eff47e00700 1 -- 172.21.15.70:0/2155961075 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7eff580cc050 con 0x562cfa0fa520 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.877+0000 7eff77bd9b80 10 client.18534 fetch_fsmap learned FSMap version 42 2024-05-08T08:45:47.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.877+0000 7eff77bd9b80 1 -- 172.21.15.70:0/2155961075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562cfa107310 con 0x562cfa0fa520 2024-05-08T08:45:47.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.877+0000 7eff47e00700 1 -- 172.21.15.70:0/2155961075 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff60007da0 con 0x562cfa0fa520 2024-05-08T08:45:47.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.877+0000 7eff47e00700 1 -- 172.21.15.70:0/2155961075 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7eff58004bb0 con 0x562cfa0fa520 2024-05-08T08:45:47.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.878+0000 7eff77bd9b80 10 client.18534 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:45:47.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.878+0000 7eff77bd9b80 10 client.18534 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:45:47.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.878+0000 7eff77bd9b80 20 client.18534 populate_metadata read hostname 'smithi070' 2024-05-08T08:45:47.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.878+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562cfa1140c0 0x562cfa1164e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.878+0000 7eff77bd9b80 4 client.18534 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:45:47.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.878+0000 7eff77bd9b80 1 -- 172.21.15.70:0/2155961075 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cfa0c7230 con 0x562cfa1140c0 2024-05-08T08:45:47.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.878+0000 7eff65400700 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562cfa1140c0 0x562cfa1164e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.880+0000 7eff65400700 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562cfa1140c0 0x562cfa1164e0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd882fc319d1faae server_cookie=e4baa1a81eaf6f51 in_seq=0 out_seq=0 2024-05-08T08:45:47.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.880+0000 7eff47e00700 10 client.18534 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:45:47.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.882+0000 7eff47e00700 1 -- 172.21.15.70:0/2155961075 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562cfa0c7230 con 0x562cfa1140c0 2024-05-08T08:45:47.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.882+0000 7eff47e00700 10 client.18534 handle_command_reply: tid=0 2024-05-08T08:45:47.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.882+0000 7eff77bd9b80 1 client.18534 shutdown 2024-05-08T08:45:47.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff77bd9b80 1 -- 172.21.15.70:0/2155961075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 msgr2=0x562cfa106950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:47.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa106950 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7eff58005cb0 tx=0x7eff580e1920 comp rx=0 tx=0).stop 2024-05-08T08:45:47.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff77bd9b80 1 -- 172.21.15.70:0/2155961075 shutdown_connections 2024-05-08T08:45:47.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562cfa1140c0 0x562cfa1164e0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0fff50 0x562cfa104230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa106950 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/2155961075 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 0x562cfa103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff77bd9b80 1 -- 172.21.15.70:0/2155961075 >> 172.21.15.70:0/2155961075 conn(0x562cfa028cf0 msgr2=0x562cfa0ef8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:45:47.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff47e00700 0 client.18534 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:45:47.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.883+0000 7eff77bd9b80 1 -- 172.21.15.70:0/2155961075 shutdown_connections 2024-05-08T08:45:47.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.884+0000 7eff77bd9b80 1 -- 172.21.15.70:0/2155961075 wait complete. 2024-05-08T08:45:47.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.884+0000 7eff77bd9b80 20 client.18534 trim_cache size 0 max 16384 2024-05-08T08:45:47.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.918+0000 7eff77bd9b80 1 Processor -- start 2024-05-08T08:45:47.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.918+0000 7eff77bd9b80 1 -- start start 2024-05-08T08:45:47.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.918+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.918+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0faee0 0x562cfa110360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.918+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fff50 0x562cfa0ff530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.918+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff681c1240 con 0x562cfa0fa520 2024-05-08T08:45:47.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.918+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff681bead0 con 0x562cfa0fff50 2024-05-08T08:45:47.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.918+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7eff681bc940 con 0x562cfa0faee0 2024-05-08T08:45:47.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff65e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff65e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa102cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54318/0 (socket says 172.21.15.70:54318) 2024-05-08T08:45:47.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff65e00700 1 -- 172.21.15.70:0/3062500540 learned_addr learned my addr 172.21.15.70:0/3062500540 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:45:47.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff65400700 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0faee0 0x562cfa110360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff65e00700 1 -- 172.21.15.70:0/3062500540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0faee0 msgr2=0x562cfa110360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:45:47.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff66800700 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fff50 0x562cfa0ff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff65e00700 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0faee0 0x562cfa110360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff65e00700 1 -- 172.21.15.70:0/3062500540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fff50 msgr2=0x562cfa0ff530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:45:47.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff65e00700 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fff50 0x562cfa0ff530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff65e00700 1 -- 172.21.15.70:0/3062500540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cfa106cc0 con 0x562cfa0fa520 2024-05-08T08:45:47.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.919+0000 7eff66800700 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fff50 0x562cfa0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:45:47.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.920+0000 7eff65e00700 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa102cd0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7eff58009960 tx=0x7eff58009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4020f15b65089dae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:45:47.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.920+0000 7eff52a00700 1 -- 172.21.15.70:0/3062500540 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580af170 con 0x562cfa0fa520 2024-05-08T08:45:47.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.920+0000 7eff52a00700 1 -- 172.21.15.70:0/3062500540 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff580af4a0 con 0x562cfa0fa520 2024-05-08T08:45:47.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.920+0000 7eff52a00700 1 -- 172.21.15.70:0/3062500540 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580af170 con 0x562cfa0fa520 2024-05-08T08:45:47.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.921+0000 7eff77bd9b80 1 -- 172.21.15.70:0/3062500540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 msgr2=0x562cfa102cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:45:47.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.921+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa102cd0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7eff58009960 tx=0x7eff58009d50 comp rx=0 tx=0).stop 2024-05-08T08:45:47.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.922+0000 7eff77bd9b80 1 -- 172.21.15.70:0/3062500540 shutdown_connections 2024-05-08T08:45:47.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.922+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0fff50 0x562cfa0ff530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.922+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fa520 0x562cfa102cd0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.922+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/3062500540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa0faee0 0x562cfa110360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.922+0000 7eff77bd9b80 1 -- 172.21.15.70:0/3062500540 >> 172.21.15.70:0/3062500540 conn(0x562cfa028cf0 msgr2=0x562cfa0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:45:47.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.922+0000 7eff77bd9b80 1 -- 172.21.15.70:0/3062500540 shutdown_connections 2024-05-08T08:45:47.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.922+0000 7eff77bd9b80 1 -- 172.21.15.70:0/3062500540 wait complete. 2024-05-08T08:45:47.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.922+0000 7eff77bd9b80 1 -- start start 2024-05-08T08:45:47.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.923+0000 7eff77bd9b80 1 Processor -- start 2024-05-08T08:45:47.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.923+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 0x562cfa10c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.923+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fff50 0x562cfa10cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.923+0000 7eff77bd9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa1096b0 0x562cfa109b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.923+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff681bcf90 con 0x562cfa0fff50 2024-05-08T08:45:47.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.923+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7eff681be400 con 0x562cfa0faee0 2024-05-08T08:45:47.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.923+0000 7eff77bd9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7eff681bd660 con 0x562cfa1096b0 2024-05-08T08:45:47.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.923+0000 7eff77bd9b80 10 client.0 _ll_register_callbacks cb 0x562cf9ff3e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:45:47.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.924+0000 7eff65400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fff50 0x562cfa10cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.924+0000 7eff65400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fff50 0x562cfa10cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54322/0 (socket says 172.21.15.70:54322) 2024-05-08T08:45:47.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.924+0000 7eff65400700 1 -- 172.21.15.70:0/438775295 learned_addr learned my addr 172.21.15.70:0/438775295 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:45:47.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.924+0000 7eff65e00700 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 0x562cfa10c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.924+0000 7eff66800700 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa1096b0 0x562cfa109b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.924+0000 7eff65e00700 1 -- 172.21.15.70:0/438775295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa1096b0 msgr2=0x562cfa109b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:45:47.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.924+0000 7eff65e00700 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa1096b0 0x562cfa109b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.924+0000 7eff65e00700 1 -- 172.21.15.70:0/438775295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fff50 msgr2=0x562cfa10cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:45:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.925+0000 7eff65e00700 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fff50 0x562cfa10cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:45:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.925+0000 7eff65e00700 1 -- 172.21.15.70:0/438775295 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cfa10a070 con 0x562cfa0faee0 2024-05-08T08:45:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.925+0000 7eff65400700 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fff50 0x562cfa10cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:45:47.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.925+0000 7eff65e00700 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 0x562cfa10c6e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff58005e50 tx=0x7eff580aacb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=897e66976d0b86df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:45:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.925+0000 7eff47e00700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:45:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.926+0000 7eff47e00700 1 -- 172.21.15.70:0/438775295 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580b3ec0 con 0x562cfa0faee0 2024-05-08T08:45:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.926+0000 7eff77bd9b80 1 -- 172.21.15.70:0/438775295 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff580af4a0 con 0x562cfa0faee0 2024-05-08T08:45:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.926+0000 7eff47e00700 1 -- 172.21.15.70:0/438775295 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(315..315 src has 1..315) ==== 9583+0+0 (secure 0 0 0) 0x7eff580aa5d0 con 0x562cfa0faee0 2024-05-08T08:45:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.926+0000 7eff47e00700 1 -- 172.21.15.70:0/438775295 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7eff58089050 con 0x562cfa0faee0 2024-05-08T08:45:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.926+0000 7eff77bd9b80 10 client.37289 fetch_fsmap learned FSMap version 42 2024-05-08T08:45:47.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.926+0000 7eff77bd9b80 1 -- 172.21.15.70:0/438775295 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562cfa10a070 con 0x562cfa0faee0 2024-05-08T08:45:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.927+0000 7eff47e00700 1 -- 172.21.15.70:0/438775295 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff580af4a0 con 0x562cfa0faee0 2024-05-08T08:45:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.927+0000 7eff47e00700 1 -- 172.21.15.70:0/438775295 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7eff580a9dc0 con 0x562cfa0faee0 2024-05-08T08:45:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.927+0000 7eff77bd9b80 10 client.37289 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:45:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.927+0000 7eff77bd9b80 10 client.37289 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:45:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.927+0000 7eff77bd9b80 20 client.37289 populate_metadata read hostname 'smithi070' 2024-05-08T08:45:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.927+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562cfa17f710 0x562cfa181b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:45:47.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.927+0000 7eff77bd9b80 4 client.37289 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.05, "await_for": 42.0}] 2024-05-08T08:45:47.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.927+0000 7eff77bd9b80 1 -- 172.21.15.70:0/438775295 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.05, "await_for": 42.0}) -- 0x562cfa05a590 con 0x562cfa17f710 2024-05-08T08:45:47.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.928+0000 7eff65400700 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562cfa17f710 0x562cfa181b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:45:47.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.929+0000 7eff47e00700 10 client.37289 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:45:47.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:45:47.929+0000 7eff65400700 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562cfa17f710 0x562cfa181b00 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6c6705be0df5ddc server_cookie=526a9dda6199cbcc in_seq=0 out_seq=0 2024-05-08T08:45:49.040 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/pci_root.o 2024-05-08T08:45:49.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:48 smithi194 ceph-mon[33679]: pgmap v3801: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 576 KiB/s wr, 25 op/s 2024-05-08T08:45:49.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:48 smithi070 ceph-mon[29591]: pgmap v3801: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 576 KiB/s wr, 25 op/s 2024-05-08T08:45:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:48 smithi172 ceph-mon[33377]: pgmap v3801: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 576 KiB/s wr, 25 op/s 2024-05-08T08:45:51.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:50 smithi194 ceph-mon[33679]: pgmap v3802: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 986 KiB/s wr, 37 op/s 2024-05-08T08:45:51.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:50 smithi070 ceph-mon[29591]: pgmap v3802: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 986 KiB/s wr, 37 op/s 2024-05-08T08:45:51.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:50 smithi172 ceph-mon[33377]: pgmap v3802: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 986 KiB/s wr, 37 op/s 2024-05-08T08:45:53.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:52 smithi194 ceph-mon[33679]: pgmap v3803: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 711 KiB/s wr, 24 op/s 2024-05-08T08:45:53.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:52 smithi070 ceph-mon[29591]: pgmap v3803: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 711 KiB/s wr, 24 op/s 2024-05-08T08:45:53.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:52 smithi172 ceph-mon[33377]: pgmap v3803: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 711 KiB/s wr, 24 op/s 2024-05-08T08:45:55.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:54 smithi070 ceph-mon[29591]: pgmap v3804: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 711 KiB/s wr, 24 op/s 2024-05-08T08:45:55.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:54 smithi194 ceph-mon[33679]: pgmap v3804: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 711 KiB/s wr, 24 op/s 2024-05-08T08:45:55.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:54 smithi172 ceph-mon[33377]: pgmap v3804: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 711 KiB/s wr, 24 op/s 2024-05-08T08:45:57.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:56 smithi194 ceph-mon[33679]: pgmap v3805: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 713 KiB/s wr, 28 op/s 2024-05-08T08:45:57.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:56 smithi070 ceph-mon[29591]: pgmap v3805: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 713 KiB/s wr, 28 op/s 2024-05-08T08:45:57.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:56 smithi172 ceph-mon[33377]: pgmap v3805: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 713 KiB/s wr, 28 op/s 2024-05-08T08:45:59.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:45:59 smithi194 ceph-mon[33679]: pgmap v3806: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 417 KiB/s wr, 17 op/s 2024-05-08T08:45:59.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:45:59 smithi070 ceph-mon[29591]: pgmap v3806: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 417 KiB/s wr, 17 op/s 2024-05-08T08:45:59.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:45:59 smithi172 ceph-mon[33377]: pgmap v3806: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 389 KiB/s rd, 417 KiB/s wr, 17 op/s 2024-05-08T08:46:01.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:01 smithi194 ceph-mon[33679]: pgmap v3807: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 506 KiB/s wr, 21 op/s 2024-05-08T08:46:01.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:01 smithi070 ceph-mon[29591]: pgmap v3807: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 506 KiB/s wr, 21 op/s 2024-05-08T08:46:01.630 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:01 smithi172 ceph-mon[33377]: pgmap v3807: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 506 KiB/s wr, 21 op/s 2024-05-08T08:46:03.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:03 smithi070 ceph-mon[29591]: pgmap v3808: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 95 KiB/s wr, 8 op/s 2024-05-08T08:46:03.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:03 smithi172 ceph-mon[33377]: pgmap v3808: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 95 KiB/s wr, 8 op/s 2024-05-08T08:46:03.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:03 smithi194 ceph-mon[33679]: pgmap v3808: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 95 KiB/s wr, 8 op/s 2024-05-08T08:46:05.275 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:05 smithi070 ceph-mon[29591]: pgmap v3809: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 92 KiB/s wr, 8 op/s 2024-05-08T08:46:05.308 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:05 smithi194 ceph-mon[33679]: pgmap v3809: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 92 KiB/s wr, 8 op/s 2024-05-08T08:46:05.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:05 smithi172 ceph-mon[33377]: pgmap v3809: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 92 KiB/s wr, 8 op/s 2024-05-08T08:46:07.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:07 smithi070 ceph-mon[29591]: pgmap v3810: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 99 KiB/s wr, 13 op/s 2024-05-08T08:46:07.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:07 smithi172 ceph-mon[33377]: pgmap v3810: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 99 KiB/s wr, 13 op/s 2024-05-08T08:46:07.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:07 smithi194 ceph-mon[33679]: pgmap v3810: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 99 KiB/s wr, 13 op/s 2024-05-08T08:46:09.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:09 smithi070 ceph-mon[29591]: pgmap v3811: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 9 op/s 2024-05-08T08:46:09.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:09 smithi172 ceph-mon[33377]: pgmap v3811: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 9 op/s 2024-05-08T08:46:09.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:09 smithi194 ceph-mon[33679]: pgmap v3811: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 9 op/s 2024-05-08T08:46:11.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.209+0000 7eff47e00700 1 -- 172.21.15.70:0/438775295 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562cfa05a590 con 0x562cfa17f710 2024-05-08T08:46:11.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.209+0000 7eff47e00700 10 client.37289 handle_command_reply: tid=0 2024-05-08T08:46:11.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.209+0000 7eff77bd9b80 1 client.37289 shutdown 2024-05-08T08:46:11.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.210+0000 7eff77bd9b80 1 -- 172.21.15.70:0/438775295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 msgr2=0x562cfa10c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:11.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.210+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 0x562cfa10c6e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7eff58005e50 tx=0x7eff580aacb0 comp rx=0 tx=0).stop 2024-05-08T08:46:11.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.210+0000 7eff77bd9b80 1 -- 172.21.15.70:0/438775295 shutdown_connections 2024-05-08T08:46:11.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.210+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562cfa17f710 0x562cfa181b00 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:11.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.210+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562cfa1096b0 0x562cfa109b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:11.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.210+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562cfa0faee0 0x562cfa10c6e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:11.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.210+0000 7eff77bd9b80 1 --2- 172.21.15.70:0/438775295 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562cfa0fff50 0x562cfa10cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:11.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.210+0000 7eff77bd9b80 1 -- 172.21.15.70:0/438775295 >> 172.21.15.70:0/438775295 conn(0x562cfa028cf0 msgr2=0x562cfa0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:11.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.210+0000 7eff47e00700 0 client.37289 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:46:11.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.211+0000 7eff77bd9b80 1 -- 172.21.15.70:0/438775295 shutdown_connections 2024-05-08T08:46:11.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.211+0000 7eff77bd9b80 1 -- 172.21.15.70:0/438775295 wait complete. 2024-05-08T08:46:11.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.212+0000 7eff77bd9b80 20 client.37289 trim_cache size 0 max 16384 2024-05-08T08:46:11.208 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:46:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:46:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:46:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 266, 2024-05-08T08:46:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:46:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "e51c9f2e": { 2024-05-08T08:46:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 266, 2024-05-08T08:46:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.0, 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:11.210 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:46:11.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.213+0000 7eff6d200700 1 -- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7eff4c0b2bf0 msgr2=0x7eff4c0b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.213+0000 7eff6d200700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7eff4c0b2bf0 0x7eff4c0b50b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7eff6806f670 tx=0x7eff5400b410 comp rx=0 tx=0).stop 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.213+0000 7eff6d200700 1 -- 172.21.15.70:0/503787071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff68102fb0 msgr2=0x7eff68074e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.213+0000 7eff6d200700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff68102fb0 0x7eff68074e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff58000c00 tx=0x7eff58004000 comp rx=0 tx=0).stop 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.214+0000 7eff6d200700 1 -- 172.21.15.70:0/503787071 shutdown_connections 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.214+0000 7eff6d200700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7eff4c0b2bf0 0x7eff4c0b50b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.214+0000 7eff6d200700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff6806e440 0x7eff6806e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.214+0000 7eff6d200700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7eff68102fb0 0x7eff68074e20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.214+0000 7eff6d200700 1 --2- 172.21.15.70:0/503787071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff681076d0 0x7eff6806df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.214+0000 7eff6d200700 1 -- 172.21.15.70:0/503787071 >> 172.21.15.70:0/503787071 conn(0x7eff68079340 msgr2=0x7eff68100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.214+0000 7eff6d200700 1 -- 172.21.15.70:0/503787071 shutdown_connections 2024-05-08T08:46:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:11.215+0000 7eff6d200700 1 -- 172.21.15.70:0/503787071 wait complete. 2024-05-08T08:46:11.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:11 smithi070 ceph-mon[29591]: pgmap v3812: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 225 KiB/s wr, 26 op/s 2024-05-08T08:46:11.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:11 smithi172 ceph-mon[33377]: pgmap v3812: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 225 KiB/s wr, 26 op/s 2024-05-08T08:46:11.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:11 smithi194 ceph-mon[33679]: pgmap v3812: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 225 KiB/s wr, 26 op/s 2024-05-08T08:46:12.056 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e51c9f2e', quiesce took 41.7 seconds. Will release after: 19.05 2024-05-08T08:46:13.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:13 smithi070 ceph-mon[29591]: pgmap v3813: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 136 KiB/s wr, 22 op/s 2024-05-08T08:46:13.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:13 smithi070 ceph-mon[29591]: osdmap e316: 12 total, 12 up, 12 in 2024-05-08T08:46:13.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:13 smithi172 ceph-mon[33377]: pgmap v3813: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 136 KiB/s wr, 22 op/s 2024-05-08T08:46:13.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:13 smithi172 ceph-mon[33377]: osdmap e316: 12 total, 12 up, 12 in 2024-05-08T08:46:13.505 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:13 smithi194 ceph-mon[33679]: pgmap v3813: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 136 KiB/s wr, 22 op/s 2024-05-08T08:46:13.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:13 smithi194 ceph-mon[33679]: osdmap e316: 12 total, 12 up, 12 in 2024-05-08T08:46:15.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:15 smithi070 ceph-mon[29591]: pgmap v3815: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 163 KiB/s wr, 27 op/s 2024-05-08T08:46:15.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:15 smithi172 ceph-mon[33377]: pgmap v3815: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 163 KiB/s wr, 27 op/s 2024-05-08T08:46:15.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:15 smithi194 ceph-mon[33679]: pgmap v3815: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 163 KiB/s wr, 27 op/s 2024-05-08T08:46:17.006 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:16 smithi194 ceph-mon[33679]: pgmap v3816: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:46:17.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:16 smithi070 ceph-mon[29591]: pgmap v3816: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:46:17.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:16 smithi172 ceph-mon[33377]: pgmap v3816: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:46:19.174 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:18 smithi172 ceph-mon[33377]: pgmap v3817: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:46:19.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:18 smithi194 ceph-mon[33679]: pgmap v3817: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:46:19.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:18 smithi070 ceph-mon[29591]: pgmap v3817: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 265 KiB/s wr, 28 op/s 2024-05-08T08:46:21.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:20 smithi194 ceph-mon[33679]: pgmap v3818: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 235 KiB/s wr, 11 op/s 2024-05-08T08:46:21.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:20 smithi194 ceph-mon[33679]: osdmap e317: 12 total, 12 up, 12 in 2024-05-08T08:46:21.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:20 smithi070 ceph-mon[29591]: pgmap v3818: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 235 KiB/s wr, 11 op/s 2024-05-08T08:46:21.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:20 smithi070 ceph-mon[29591]: osdmap e317: 12 total, 12 up, 12 in 2024-05-08T08:46:21.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:20 smithi172 ceph-mon[33377]: pgmap v3818: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 235 KiB/s wr, 11 op/s 2024-05-08T08:46:21.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:20 smithi172 ceph-mon[33377]: osdmap e317: 12 total, 12 up, 12 in 2024-05-08T08:46:23.189 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:22 smithi070 ceph-mon[29591]: pgmap v3820: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 239 KiB/s wr, 11 op/s 2024-05-08T08:46:23.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:22 smithi194 ceph-mon[33679]: pgmap v3820: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 239 KiB/s wr, 11 op/s 2024-05-08T08:46:23.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:22 smithi172 ceph-mon[33377]: pgmap v3820: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 239 KiB/s wr, 11 op/s 2024-05-08T08:46:25.227 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:24 smithi172 ceph-mon[33377]: pgmap v3821: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 234 KiB/s wr, 11 op/s 2024-05-08T08:46:25.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:24 smithi194 ceph-mon[33679]: pgmap v3821: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 234 KiB/s wr, 11 op/s 2024-05-08T08:46:25.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:24 smithi070 ceph-mon[29591]: pgmap v3821: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 234 KiB/s wr, 11 op/s 2024-05-08T08:46:27.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:26 smithi194 ceph-mon[33679]: pgmap v3822: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 7 op/s 2024-05-08T08:46:27.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:26 smithi070 ceph-mon[29591]: pgmap v3822: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 7 op/s 2024-05-08T08:46:27.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:26 smithi172 ceph-mon[33377]: pgmap v3822: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 7 op/s 2024-05-08T08:46:29.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:28 smithi194 ceph-mon[33679]: pgmap v3823: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 7 op/s 2024-05-08T08:46:29.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:28 smithi070 ceph-mon[29591]: pgmap v3823: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 7 op/s 2024-05-08T08:46:29.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:28 smithi172 ceph-mon[33377]: pgmap v3823: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 127 KiB/s wr, 7 op/s 2024-05-08T08:46:31.108 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:46:31.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:30 smithi194 ceph-mon[33679]: pgmap v3824: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.3 KiB/s wr, 6 op/s 2024-05-08T08:46:31.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:30 smithi070 ceph-mon[29591]: pgmap v3824: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.3 KiB/s wr, 6 op/s 2024-05-08T08:46:31.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:30 smithi172 ceph-mon[33377]: pgmap v3824: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.3 KiB/s wr, 6 op/s 2024-05-08T08:46:31.611 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:46:33.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:32 smithi194 ceph-mon[33679]: pgmap v3825: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-05-08T08:46:33.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:32 smithi070 ceph-mon[29591]: pgmap v3825: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-05-08T08:46:33.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:32 smithi172 ceph-mon[33377]: pgmap v3825: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2024-05-08T08:46:34.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.048+0000 7feafd800700 1 -- 172.21.15.70:0/615767433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8103750 msgr2=0x7feaf8103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:34.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.048+0000 7feafd800700 1 --2- 172.21.15.70:0/615767433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8103750 0x7feaf8103b30 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7feae80099c0 tx=0x7feae8009cd0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.048+0000 7feafd800700 1 -- 172.21.15.70:0/615767433 shutdown_connections 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.048+0000 7feafd800700 1 --2- 172.21.15.70:0/615767433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf8108850 0x7feaf81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.048+0000 7feafd800700 1 --2- 172.21.15.70:0/615767433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8103750 0x7feaf8103b30 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.048+0000 7feafd800700 1 --2- 172.21.15.70:0/615767433 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf8104100 0x7feaf8108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.048+0000 7feafd800700 1 -- 172.21.15.70:0/615767433 >> 172.21.15.70:0/615767433 conn(0x7feaf807a600 msgr2=0x7feaf807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.049+0000 7feafd800700 1 -- 172.21.15.70:0/615767433 shutdown_connections 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.049+0000 7feafd800700 1 -- 172.21.15.70:0/615767433 wait complete. 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.050+0000 7feafd800700 1 Processor -- start 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.050+0000 7feafd800700 1 -- start start 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.050+0000 7feafd800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf8103750 0x7feaf81a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:34.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.050+0000 7feafd800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf8104100 0x7feaf81a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.050+0000 7feafd800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8108850 0x7feaf819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.050+0000 7feafd800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feaf81134d0 con 0x7feaf8108850 2024-05-08T08:46:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.050+0000 7feafd800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8113350 con 0x7feaf8104100 2024-05-08T08:46:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.050+0000 7feafd800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8113650 con 0x7feaf8103750 2024-05-08T08:46:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8108850 0x7feaf819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8108850 0x7feaf819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41264/0 (socket says 172.21.15.70:41264) 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf7400700 1 -- 172.21.15.70:0/2882690934 learned_addr learned my addr 172.21.15.70:0/2882690934 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf6a00700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf8103750 0x7feaf81a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaee000700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf8104100 0x7feaf81a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf7400700 1 -- 172.21.15.70:0/2882690934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf8103750 msgr2=0x7feaf81a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf7400700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf8103750 0x7feaf81a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf7400700 1 -- 172.21.15.70:0/2882690934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf8104100 msgr2=0x7feaf81a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf7400700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf8104100 0x7feaf81a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf7400700 1 -- 172.21.15.70:0/2882690934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf819c120 con 0x7feaf8108850 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.051+0000 7feaf7400700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8108850 0x7feaf819b9c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7feaf0007d70 tx=0x7feaf000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.052+0000 7feaefe00700 1 -- 172.21.15.70:0/2882690934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf0016020 con 0x7feaf8108850 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.052+0000 7feaefe00700 1 -- 172.21.15.70:0/2882690934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feaf000ad40 con 0x7feaf8108850 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.052+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf819c410 con 0x7feaf8108850 2024-05-08T08:46:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.052+0000 7feaefe00700 1 -- 172.21.15.70:0/2882690934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf00115e0 con 0x7feaf8108850 2024-05-08T08:46:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.052+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf81a8680 con 0x7feaf8108850 2024-05-08T08:46:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.053+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf806a190 con 0x7feaf8108850 2024-05-08T08:46:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.055+0000 7feaefe00700 1 -- 172.21.15.70:0/2882690934 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7feaf0019020 con 0x7feaf8108850 2024-05-08T08:46:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.057+0000 7feaefe00700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feadc0b29f0 0x7feadc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.057+0000 7feaefe00700 1 -- 172.21.15.70:0/2882690934 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(317..317 src has 1..317) ==== 9583+0+0 (secure 0 0 0) 0x7feaf00e2dc0 con 0x7feaf8108850 2024-05-08T08:46:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.057+0000 7feaf6a00700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feadc0b29f0 0x7feadc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:34.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.058+0000 7feaf6a00700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feadc0b29f0 0x7feadc0b4eb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7feae8009990 tx=0x7feae801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:34.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.059+0000 7feaefe00700 1 -- 172.21.15.70:0/2882690934 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feaf0020020 con 0x7feaf8108850 2024-05-08T08:46:34.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.340+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feaf81a8910 con 0x7feaf8108850 2024-05-08T08:46:34.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.341+0000 7feaefe00700 1 -- 172.21.15.70:0/2882690934 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7feaf00aa430 con 0x7feaf8108850 2024-05-08T08:46:34.336 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:46:34.336 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:46:34.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feadc0b29f0 msgr2=0x7feadc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:34.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feadc0b29f0 0x7feadc0b4eb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7feae8009990 tx=0x7feae801a040 comp rx=0 tx=0).stop 2024-05-08T08:46:34.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8108850 msgr2=0x7feaf819b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:34.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8108850 0x7feaf819b9c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7feaf0007d70 tx=0x7feaf000a340 comp rx=0 tx=0).stop 2024-05-08T08:46:34.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 shutdown_connections 2024-05-08T08:46:34.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feadc0b29f0 0x7feadc0b4eb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feaf8108850 0x7feaf819b9c0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaf8103750 0x7feaf81a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 --2- 172.21.15.70:0/2882690934 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feaf8104100 0x7feaf81a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:34.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.344+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 >> 172.21.15.70:0/2882690934 conn(0x7feaf807a600 msgr2=0x7feaf8102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:34.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.345+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 shutdown_connections 2024-05-08T08:46:34.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:34.345+0000 7feafd800700 1 -- 172.21.15.70:0/2882690934 wait complete. 2024-05-08T08:46:34.340 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:46:35.093 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:34 smithi070 ceph-mon[29591]: pgmap v3826: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T08:46:35.093 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2882690934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:46:35.142 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id e51c9f2e --release --await' 2024-05-08T08:46:35.142 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id e51c9f2e --release --await 2024-05-08T08:46:35.255 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:34 smithi194 ceph-mon[33679]: pgmap v3826: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T08:46:35.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2882690934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:46:35.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:34 smithi172 ceph-mon[33377]: pgmap v3826: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T08:46:35.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2882690934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:46:35.578 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:46:36.056 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:46:36.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:46:36.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:46:37.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:36 smithi194 ceph-mon[33679]: pgmap v3827: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T08:46:37.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:46:37.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:46:37.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:46:37.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:36 smithi070 ceph-mon[29591]: pgmap v3827: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T08:46:37.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:46:37.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:46:37.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:46:37.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:36 smithi172 ceph-mon[33377]: pgmap v3827: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-05-08T08:46:37.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:46:37.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:46:37.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:46:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.896+0000 7f3af8e00700 1 -- 172.21.15.70:0/663120983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103fd0 msgr2=0x7f3af4108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.896+0000 7f3af8e00700 1 --2- 172.21.15.70:0/663120983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103fd0 0x7f3af4108020 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00099c0 tx=0x7f3ae0009cd0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.896+0000 7f3af8e00700 1 -- 172.21.15.70:0/663120983 shutdown_connections 2024-05-08T08:46:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.896+0000 7f3af8e00700 1 --2- 172.21.15.70:0/663120983 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4108700 0x7f3af41102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.896+0000 7f3af8e00700 1 --2- 172.21.15.70:0/663120983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af4103620 0x7f3af4103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.896+0000 7f3af8e00700 1 --2- 172.21.15.70:0/663120983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103fd0 0x7f3af4108020 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.896+0000 7f3af8e00700 1 -- 172.21.15.70:0/663120983 >> 172.21.15.70:0/663120983 conn(0x7f3af40feeb0 msgr2=0x7f3af41012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.896+0000 7f3af8e00700 1 -- 172.21.15.70:0/663120983 shutdown_connections 2024-05-08T08:46:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.896+0000 7f3af8e00700 1 -- 172.21.15.70:0/663120983 wait complete. 2024-05-08T08:46:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.898+0000 7f3af8e00700 1 Processor -- start 2024-05-08T08:46:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.898+0000 7f3af8e00700 1 -- start start 2024-05-08T08:46:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.898+0000 7f3af8e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103620 0x7f3af40757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.898+0000 7f3af8e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4103fd0 0x7f3af4075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.898+0000 7f3af8e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af4108700 0x7f3af4076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.898+0000 7f3af8e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3af4113440 con 0x7f3af4103620 2024-05-08T08:46:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.898+0000 7f3af8e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41132c0 con 0x7f3af4103fd0 2024-05-08T08:46:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.898+0000 7f3af8e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41135c0 con 0x7f3af4108700 2024-05-08T08:46:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103620 0x7f3af40757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103620 0x7f3af40757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51726/0 (socket says 172.21.15.70:51726) 2024-05-08T08:46:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3400700 1 -- 172.21.15.70:0/410454922 learned_addr learned my addr 172.21.15.70:0/410454922 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af2a00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4103fd0 0x7f3af4075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3e00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af4108700 0x7f3af4076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3400700 1 -- 172.21.15.70:0/410454922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af4108700 msgr2=0x7f3af4076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3400700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af4108700 0x7f3af4076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3400700 1 -- 172.21.15.70:0/410454922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4103fd0 msgr2=0x7f3af4075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3400700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4103fd0 0x7f3af4075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3400700 1 -- 172.21.15.70:0/410454922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af41a7f60 con 0x7f3af4103620 2024-05-08T08:46:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.899+0000 7f3af3e00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af4108700 0x7f3af4076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:46:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.900+0000 7f3af3400700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103620 0x7f3af40757a0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400d980 tx=0x7f3ae400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.900+0000 7f3aebe00700 1 -- 172.21.15.70:0/410454922 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4017070 con 0x7f3af4103620 2024-05-08T08:46:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.900+0000 7f3aebe00700 1 -- 172.21.15.70:0/410454922 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ae4004830 con 0x7f3af4103620 2024-05-08T08:46:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.900+0000 7f3af8e00700 1 -- 172.21.15.70:0/410454922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af41a8250 con 0x7f3af4103620 2024-05-08T08:46:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.900+0000 7f3aebe00700 1 -- 172.21.15.70:0/410454922 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40053a0 con 0x7f3af4103620 2024-05-08T08:46:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.900+0000 7f3af8e00700 1 -- 172.21.15.70:0/410454922 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af41a8740 con 0x7f3af4103620 2024-05-08T08:46:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.903+0000 7f3aebe00700 1 -- 172.21.15.70:0/410454922 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3ae40049e0 con 0x7f3af4103620 2024-05-08T08:46:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.905+0000 7f3aebe00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ad80b29f0 0x7f3ad80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.905+0000 7f3aebe00700 1 -- 172.21.15.70:0/410454922 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(317..317 src has 1..317) ==== 9583+0+0 (secure 0 0 0) 0x7f3ae40e2a40 con 0x7f3af4103620 2024-05-08T08:46:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.905+0000 7f3af2a00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ad80b29f0 0x7f3ad80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.906+0000 7f3af2a00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ad80b29f0 0x7f3ad80b4eb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0000c00 tx=0x7f3ae0009f10 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:37.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.922+0000 7f3b04e07b80 1 Processor -- start 2024-05-08T08:46:37.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.922+0000 7f3b04e07b80 1 -- start start 2024-05-08T08:46:37.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.923+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dc7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.923+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.923+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dc1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.923+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555991d13b20 con 0x555991dc7880 2024-05-08T08:46:37.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.923+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555991cb1860 con 0x555991dc6f60 2024-05-08T08:46:37.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.923+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555991d0fae0 con 0x555991dc1ab0 2024-05-08T08:46:37.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.923+0000 7f3af2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.923+0000 7f3af2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51728/0 (socket says 172.21.15.70:51728) 2024-05-08T08:46:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.923+0000 7f3af2a00700 1 -- 172.21.15.70:0/4216887344 learned_addr learned my addr 172.21.15.70:0/4216887344 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.924+0000 7f3af3e00700 1 --2- 172.21.15.70:0/4216887344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dc1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.924+0000 7f3af3400700 1 --2- 172.21.15.70:0/4216887344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dc7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.924+0000 7f3af2a00700 1 -- 172.21.15.70:0/4216887344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 msgr2=0x555991dc1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.924+0000 7f3af2a00700 1 --2- 172.21.15.70:0/4216887344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dc1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.924+0000 7f3af2a00700 1 -- 172.21.15.70:0/4216887344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 msgr2=0x555991dc7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.924+0000 7f3af2a00700 1 --2- 172.21.15.70:0/4216887344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dc7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.924+0000 7f3af2a00700 1 -- 172.21.15.70:0/4216887344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555991c609d0 con 0x555991dc7880 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.924+0000 7f3af2a00700 1 --2- 172.21.15.70:0/4216887344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc1490 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3af406cb00 tx=0x7f3ae0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e89534459554c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.925+0000 7f3ae8c00700 1 -- 172.21.15.70:0/4216887344 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae000bbf0 con 0x555991dc7880 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.925+0000 7f3ae8c00700 1 -- 172.21.15.70:0/4216887344 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ae002b030 con 0x555991dc7880 2024-05-08T08:46:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.925+0000 7f3ae8c00700 1 -- 172.21.15.70:0/4216887344 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae000f660 con 0x555991dc7880 2024-05-08T08:46:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.925+0000 7f3b04e07b80 1 -- 172.21.15.70:0/4216887344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 msgr2=0x555991dc1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.925+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/4216887344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc1490 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f3af406cb00 tx=0x7f3ae0020000 comp rx=0 tx=0).stop 2024-05-08T08:46:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.926+0000 7f3b04e07b80 1 -- 172.21.15.70:0/4216887344 shutdown_connections 2024-05-08T08:46:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.926+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/4216887344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dc1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.926+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/4216887344 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dc7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.926+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/4216887344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc1490 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.926+0000 7f3b04e07b80 1 -- 172.21.15.70:0/4216887344 >> 172.21.15.70:0/4216887344 conn(0x555991cefc60 msgr2=0x555991dbbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.926+0000 7f3b04e07b80 1 -- 172.21.15.70:0/4216887344 shutdown_connections 2024-05-08T08:46:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.926+0000 7f3b04e07b80 1 -- 172.21.15.70:0/4216887344 wait complete. 2024-05-08T08:46:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.926+0000 7f3b04e07b80 1 -- start start 2024-05-08T08:46:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.926+0000 7f3b04e07b80 1 Processor -- start 2024-05-08T08:46:37.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dcd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dcadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555991dce340 con 0x555991dc7880 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555991c79c20 con 0x555991dc6f60 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555991dce4c0 con 0x555991dc1ab0 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3b04e07b80 10 client.0 _ll_register_callbacks cb 0x555991cbad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3af3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dcadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3af3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dcadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51734/0 (socket says 172.21.15.70:51734) 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.927+0000 7f3af3e00700 1 -- 172.21.15.70:0/1028820329 learned_addr learned my addr 172.21.15.70:0/1028820329 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.928+0000 7f3af3400700 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dcd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.928+0000 7f3af2a00700 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.928+0000 7f3af3e00700 1 -- 172.21.15.70:0/1028820329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 msgr2=0x555991dcd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.928+0000 7f3af3e00700 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dcd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.928+0000 7f3af3e00700 1 -- 172.21.15.70:0/1028820329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 msgr2=0x555991dca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.928+0000 7f3af3e00700 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.928+0000 7f3af3e00700 1 -- 172.21.15.70:0/1028820329 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555991cd9520 con 0x555991dc7880 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.928+0000 7f3af3e00700 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dcadc0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f3aec008c40 tx=0x7f3aec008f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce083983c3d72db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.928+0000 7f3add600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.929+0000 7f3add600700 1 -- 172.21.15.70:0/1028820329 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec00fa30 con 0x555991dc7880 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.929+0000 7f3add600700 1 -- 172.21.15.70:0/1028820329 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(317..317 src has 1..317) ==== 9583+0+0 (secure 0 0 0) 0x7f3aec00fbd0 con 0x555991dc7880 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.929+0000 7f3b04e07b80 1 -- 172.21.15.70:0/1028820329 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ae002b030 con 0x555991dc7880 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.929+0000 7f3add600700 1 -- 172.21.15.70:0/1028820329 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3aec023050 con 0x555991dc7880 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.929+0000 7f3b04e07b80 10 client.18558 fetch_fsmap learned FSMap version 42 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.929+0000 7f3b04e07b80 1 -- 172.21.15.70:0/1028820329 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555991dd8ba0 con 0x555991dc7880 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.929+0000 7f3add600700 1 -- 172.21.15.70:0/1028820329 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3ae002b030 con 0x555991dc7880 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.929+0000 7f3add600700 1 -- 172.21.15.70:0/1028820329 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3aec0143e0 con 0x555991dc7880 2024-05-08T08:46:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.930+0000 7f3b04e07b80 10 client.18558 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:46:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.930+0000 7f3b04e07b80 10 client.18558 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:46:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.930+0000 7f3b04e07b80 20 client.18558 populate_metadata read hostname 'smithi070' 2024-05-08T08:46:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.930+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555991ddb1e0 0x555991ddd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.930+0000 7f3b04e07b80 4 client.18558 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:46:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.930+0000 7f3b04e07b80 1 -- 172.21.15.70:0/1028820329 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555991d8e1a0 con 0x555991ddb1e0 2024-05-08T08:46:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.930+0000 7f3af3400700 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555991ddb1e0 0x555991ddd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.931+0000 7f3add600700 10 client.18558 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:46:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.931+0000 7f3af3400700 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555991ddb1e0 0x555991ddd600 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dd6e558b77c4dfe server_cookie=555b006e3d87c80 in_seq=0 out_seq=0 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.933+0000 7f3add600700 1 -- 172.21.15.70:0/1028820329 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555991d8e1a0 con 0x555991ddb1e0 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.933+0000 7f3add600700 10 client.18558 handle_command_reply: tid=0 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.933+0000 7f3b04e07b80 1 client.18558 shutdown 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.933+0000 7f3b04e07b80 1 -- 172.21.15.70:0/1028820329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 msgr2=0x555991dcadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.933+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dcadc0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f3aec008c40 tx=0x7f3aec008f50 comp rx=0 tx=0).stop 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3b04e07b80 1 -- 172.21.15.70:0/1028820329 shutdown_connections 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555991ddb1e0 0x555991ddd600 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dcadc0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dcd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/1028820329 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3add600700 0 client.18558 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:46:37.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3b04e07b80 1 -- 172.21.15.70:0/1028820329 >> 172.21.15.70:0/1028820329 conn(0x555991cefc60 msgr2=0x555991dc0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:37.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3b04e07b80 1 -- 172.21.15.70:0/1028820329 shutdown_connections 2024-05-08T08:46:37.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3b04e07b80 1 -- 172.21.15.70:0/1028820329 wait complete. 2024-05-08T08:46:37.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.934+0000 7f3b04e07b80 20 client.18558 trim_cache size 0 max 16384 2024-05-08T08:46:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.956+0000 7f3b04e07b80 1 Processor -- start 2024-05-08T08:46:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.956+0000 7f3b04e07b80 1 -- start start 2024-05-08T08:46:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.956+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dc49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.956+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dc4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.956+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.956+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41b3f20 con 0x555991dc7880 2024-05-08T08:46:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.956+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41b17b0 con 0x555991dc6f60 2024-05-08T08:46:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.956+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41af620 con 0x555991dc1ab0 2024-05-08T08:46:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dc49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dc49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:33658/0 (socket says 172.21.15.70:33658) 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51740/0 (socket says 172.21.15.70:51740) 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3400700 1 -- 172.21.15.70:0/2023019393 learned_addr learned my addr 172.21.15.70:0/2023019393 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af2a00700 1 --2- 172.21.15.70:0/2023019393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dc4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3e00700 1 -- 172.21.15.70:0/2023019393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 msgr2=0x555991dc49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3e00700 1 --2- 172.21.15.70:0/2023019393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dc49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3e00700 1 -- 172.21.15.70:0/2023019393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 msgr2=0x555991dc4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3e00700 1 --2- 172.21.15.70:0/2023019393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dc4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.957+0000 7f3af3e00700 1 -- 172.21.15.70:0/2023019393 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555991dddc60 con 0x555991dc7880 2024-05-08T08:46:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.958+0000 7f3af3e00700 1 --2- 172.21.15.70:0/2023019393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc0dd0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f3aec008c10 tx=0x7f3aec00f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175fc232420e53ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.958+0000 7f3adfe00700 1 -- 172.21.15.70:0/2023019393 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec007a00 con 0x555991dc7880 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.958+0000 7f3adfe00700 1 -- 172.21.15.70:0/2023019393 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3aec01a070 con 0x555991dc7880 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.958+0000 7f3adfe00700 1 -- 172.21.15.70:0/2023019393 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aec014a20 con 0x555991dc7880 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.959+0000 7f3b04e07b80 1 -- 172.21.15.70:0/2023019393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 msgr2=0x555991dc0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.959+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/2023019393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc0dd0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f3aec008c10 tx=0x7f3aec00f630 comp rx=0 tx=0).stop 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.959+0000 7f3b04e07b80 1 -- 172.21.15.70:0/2023019393 shutdown_connections 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.959+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/2023019393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc7880 0x555991dc0dd0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.959+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/2023019393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc1ab0 0x555991dc49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.959+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/2023019393 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc6f60 0x555991dc4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.959+0000 7f3b04e07b80 1 -- 172.21.15.70:0/2023019393 >> 172.21.15.70:0/2023019393 conn(0x555991cefc60 msgr2=0x555991dc1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.959+0000 7f3b04e07b80 1 -- 172.21.15.70:0/2023019393 shutdown_connections 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.959+0000 7f3b04e07b80 1 -- 172.21.15.70:0/2023019393 wait complete. 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.960+0000 7f3b04e07b80 1 -- start start 2024-05-08T08:46:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.960+0000 7f3b04e07b80 1 Processor -- start 2024-05-08T08:46:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.960+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc1ab0 0x555991dd3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.960+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc6f60 0x555991dd0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.960+0000 7f3b04e07b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc7880 0x555991dd0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.960+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41afc70 con 0x555991dc6f60 2024-05-08T08:46:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.960+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41b10e0 con 0x555991dc1ab0 2024-05-08T08:46:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.960+0000 7f3b04e07b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3af41b0340 con 0x555991dc7880 2024-05-08T08:46:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.960+0000 7f3b04e07b80 10 client.0 _ll_register_callbacks cb 0x555991cbad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:46:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc6f60 0x555991dd0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc6f60 0x555991dd0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51754/0 (socket says 172.21.15.70:51754) 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af2a00700 1 -- 172.21.15.70:0/198674749 learned_addr learned my addr 172.21.15.70:0/198674749 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af3e00700 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc7880 0x555991dd0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af3400700 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc1ab0 0x555991dd3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af2a00700 1 -- 172.21.15.70:0/198674749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc7880 msgr2=0x555991dd0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af2a00700 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc7880 0x555991dd0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af2a00700 1 -- 172.21.15.70:0/198674749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc1ab0 msgr2=0x555991dd3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af2a00700 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc1ab0 0x555991dd3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af2a00700 1 -- 172.21.15.70:0/198674749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555991dd14b0 con 0x555991dc6f60 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.961+0000 7f3af3e00700 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc7880 0x555991dd0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.962+0000 7f3af2a00700 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc6f60 0x555991dd0750 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009990 tx=0x7f3ae0005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747b6867521ae425 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.962+0000 7f3add600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:46:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.962+0000 7f3add600700 1 -- 172.21.15.70:0/198674749 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0040060 con 0x555991dc6f60 2024-05-08T08:46:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.962+0000 7f3add600700 1 -- 172.21.15.70:0/198674749 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(317..317 src has 1..317) ==== 9583+0+0 (secure 0 0 0) 0x7f3ae0003970 con 0x555991dc6f60 2024-05-08T08:46:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.962+0000 7f3b04e07b80 1 -- 172.21.15.70:0/198674749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aec01a070 con 0x555991dc6f60 2024-05-08T08:46:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.962+0000 7f3add600700 1 -- 172.21.15.70:0/198674749 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3ae0047050 con 0x555991dc6f60 2024-05-08T08:46:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.962+0000 7f3b04e07b80 10 client.18564 fetch_fsmap learned FSMap version 42 2024-05-08T08:46:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.962+0000 7f3b04e07b80 1 -- 172.21.15.70:0/198674749 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555991e4f300 con 0x555991dc6f60 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.963+0000 7f3add600700 1 -- 172.21.15.70:0/198674749 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3aec01a070 con 0x555991dc6f60 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.963+0000 7f3add600700 1 -- 172.21.15.70:0/198674749 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3ae003bc30 con 0x555991dc6f60 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.963+0000 7f3b04e07b80 10 client.18564 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.963+0000 7f3b04e07b80 10 client.18564 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.963+0000 7f3b04e07b80 20 client.18564 populate_metadata read hostname 'smithi070' 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.963+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555991e4f580 0x555991e51970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.963+0000 7f3b04e07b80 4 client.18564 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e51c9f2e", "release": true, "await": true}] 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.963+0000 7f3b04e07b80 1 -- 172.21.15.70:0/198674749 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e51c9f2e", "release": true, "await": true}) -- 0x555991d21500 con 0x555991e4f580 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.964+0000 7f3af3400700 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555991e4f580 0x555991e51970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.965+0000 7f3af3400700 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555991e4f580 0x555991e51970 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb61910c977168c0 server_cookie=10efd5a99fa9d285 in_seq=0 out_seq=0 2024-05-08T08:46:37.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:37.965+0000 7f3add600700 10 client.18564 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:46:39.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:38 smithi194 ceph-mon[33679]: pgmap v3828: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-05-08T08:46:39.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:38 smithi070 ceph-mon[29591]: pgmap v3828: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-05-08T08:46:39.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:38 smithi172 ceph-mon[33377]: pgmap v3828: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-05-08T08:46:41.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:41 smithi194 ceph-mon[33679]: pgmap v3829: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T08:46:41.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:41 smithi070 ceph-mon[29591]: pgmap v3829: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T08:46:41.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:41 smithi172 ceph-mon[33377]: pgmap v3829: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-05-08T08:46:42.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.500+0000 7f3add600700 1 -- 172.21.15.70:0/198674749 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x555991d21500 con 0x555991e4f580 2024-05-08T08:46:42.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.501+0000 7f3add600700 10 client.18564 handle_command_reply: tid=0 2024-05-08T08:46:42.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.501+0000 7f3b04e07b80 1 client.18564 shutdown 2024-05-08T08:46:42.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.501+0000 7f3b04e07b80 1 -- 172.21.15.70:0/198674749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc6f60 msgr2=0x555991dd0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:42.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.501+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc6f60 0x555991dd0750 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009990 tx=0x7f3ae0005ae0 comp rx=0 tx=0).stop 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.502+0000 7f3b04e07b80 1 -- 172.21.15.70:0/198674749 shutdown_connections 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.502+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555991e4f580 0x555991e51970 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.502+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555991dc7880 0x555991dd0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.502+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555991dc1ab0 0x555991dd3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.502+0000 7f3b04e07b80 1 --2- 172.21.15.70:0/198674749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555991dc6f60 0x555991dd0750 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.502+0000 7f3b04e07b80 1 -- 172.21.15.70:0/198674749 >> 172.21.15.70:0/198674749 conn(0x555991cefc60 msgr2=0x555991dc49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.502+0000 7f3add600700 0 client.18564 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.502+0000 7f3b04e07b80 1 -- 172.21.15.70:0/198674749 shutdown_connections 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.502+0000 7f3b04e07b80 1 -- 172.21.15.70:0/198674749 wait complete. 2024-05-08T08:46:42.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.503+0000 7f3b04e07b80 20 client.18564 trim_cache size 0 max 16384 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 268, 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "e51c9f2e": { 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 268, 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:46:42.499 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.0, 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:46:42.500 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:46:42.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 -- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ad80b29f0 msgr2=0x7f3ad80b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:42.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ad80b29f0 0x7f3ad80b4eb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0000c00 tx=0x7f3ae0009f10 comp rx=0 tx=0).stop 2024-05-08T08:46:42.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 -- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103620 msgr2=0x7f3af40757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:42.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103620 0x7f3af40757a0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400d980 tx=0x7f3ae400dd40 comp rx=0 tx=0).stop 2024-05-08T08:46:42.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 -- 172.21.15.70:0/410454922 shutdown_connections 2024-05-08T08:46:42.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3ad80b29f0 0x7f3ad80b4eb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:42.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af4108700 0x7f3af4076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:42.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3af4103620 0x7f3af40757a0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:42.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 --2- 172.21.15.70:0/410454922 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3af4103fd0 0x7f3af4075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:42.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.504+0000 7f3af8e00700 1 -- 172.21.15.70:0/410454922 >> 172.21.15.70:0/410454922 conn(0x7f3af40feeb0 msgr2=0x7f3af4100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:42.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.505+0000 7f3af8e00700 1 -- 172.21.15.70:0/410454922 shutdown_connections 2024-05-08T08:46:42.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:42.505+0000 7f3af8e00700 1 -- 172.21.15.70:0/410454922 wait complete. 2024-05-08T08:46:43.256 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:43 smithi194 ceph-mon[33679]: pgmap v3830: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-05-08T08:46:43.357 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:43 smithi070 ceph-mon[29591]: pgmap v3830: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-05-08T08:46:43.416 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e51c9f2e', seconds elapsed: 73.1 2024-05-08T08:46:43.416 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.05 2024-05-08T08:46:43.416 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:46:43.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:43 smithi172 ceph-mon[33377]: pgmap v3830: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-05-08T08:46:43.666 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio_pci_common.o 2024-05-08T08:46:43.983 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:46:45.323 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/pci_link.o 2024-05-08T08:46:45.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:45 smithi070 ceph-mon[29591]: pgmap v3831: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 170 KiB/s wr, 14 op/s 2024-05-08T08:46:45.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:45 smithi172 ceph-mon[33377]: pgmap v3831: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 170 KiB/s wr, 14 op/s 2024-05-08T08:46:45.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:45 smithi194 ceph-mon[33679]: pgmap v3831: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 170 KiB/s wr, 14 op/s 2024-05-08T08:46:45.632 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/mac80211/rc80211_minstrel_ht.o 2024-05-08T08:46:45.805 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/exthdrs_offload.o 2024-05-08T08:46:45.926 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/socket.o 2024-05-08T08:46:46.014 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tunnel4.o 2024-05-08T08:46:46.055 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/compat.o 2024-05-08T08:46:46.124 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio_pci_legacy.o 2024-05-08T08:46:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.501+0000 7f14daa00700 1 -- 172.21.15.70:0/1099954050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00bab0 con 0x7f14dc075840 2024-05-08T08:46:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.502+0000 7f14e1600700 1 -- 172.21.15.70:0/1099954050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc075840 msgr2=0x7f14dc075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.502+0000 7f14e1600700 1 --2- 172.21.15.70:0/1099954050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc075840 0x7f14dc075c20 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f14cc009990 tx=0x7f14cc009ca0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.502+0000 7f14e1600700 1 -- 172.21.15.70:0/1099954050 shutdown_connections 2024-05-08T08:46:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.502+0000 7f14e1600700 1 --2- 172.21.15.70:0/1099954050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc1143e0 0x7f14dc1167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.502+0000 7f14e1600700 1 --2- 172.21.15.70:0/1099954050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc075840 0x7f14dc075c20 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.502+0000 7f14e1600700 1 --2- 172.21.15.70:0/1099954050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc076160 0x7f14dc113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.502+0000 7f14e1600700 1 -- 172.21.15.70:0/1099954050 >> 172.21.15.70:0/1099954050 conn(0x7f14dc0fef20 msgr2=0x7f14dc101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:46.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.503+0000 7f14e1600700 1 -- 172.21.15.70:0/1099954050 shutdown_connections 2024-05-08T08:46:46.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.503+0000 7f14e1600700 1 -- 172.21.15.70:0/1099954050 wait complete. 2024-05-08T08:46:46.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.504+0000 7f14e1600700 1 Processor -- start 2024-05-08T08:46:46.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.504+0000 7f14e1600700 1 -- start start 2024-05-08T08:46:46.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.505+0000 7f14e1600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc075840 0x7f14dc1a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:46.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.505+0000 7f14e1600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc076160 0x7f14dc1a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:46.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.505+0000 7f14e1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc1143e0 0x7f14dc1a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:46.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.505+0000 7f14e1600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc119b20 con 0x7f14dc1143e0 2024-05-08T08:46:46.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.505+0000 7f14e1600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc1199a0 con 0x7f14dc075840 2024-05-08T08:46:46.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.505+0000 7f14e1600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f14dc119ca0 con 0x7f14dc076160 2024-05-08T08:46:46.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.505+0000 7f14e0c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc1143e0 0x7f14dc1a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:46.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.506+0000 7f14e0c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc1143e0 0x7f14dc1a48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51770/0 (socket says 172.21.15.70:51770) 2024-05-08T08:46:46.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.506+0000 7f14e0c00700 1 -- 172.21.15.70:0/1131965475 learned_addr learned my addr 172.21.15.70:0/1131965475 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:46.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.506+0000 7f14dbe00700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc075840 0x7f14dc1a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:46.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.506+0000 7f14e0c00700 1 -- 172.21.15.70:0/1131965475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc076160 msgr2=0x7f14dc1a0560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T08:46:46.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.506+0000 7f14e0c00700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc076160 0x7f14dc1a0560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.506+0000 7f14e0c00700 1 -- 172.21.15.70:0/1131965475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc075840 msgr2=0x7f14dc1a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:46.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.506+0000 7f14e0c00700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc075840 0x7f14dc1a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.506+0000 7f14e0c00700 1 -- 172.21.15.70:0/1131965475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14dc1a4fe0 con 0x7f14dc1143e0 2024-05-08T08:46:46.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.507+0000 7f14e0c00700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc1143e0 0x7f14dc1a48a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f14d400ef90 tx=0x7f14d400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.507+0000 7f14d8c00700 1 -- 172.21.15.70:0/1131965475 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d40092e0 con 0x7f14dc1143e0 2024-05-08T08:46:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.507+0000 7f14d8c00700 1 -- 172.21.15.70:0/1131965475 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14d4004bb0 con 0x7f14dc1143e0 2024-05-08T08:46:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.507+0000 7f14d8c00700 1 -- 172.21.15.70:0/1131965475 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d4004040 con 0x7f14dc1143e0 2024-05-08T08:46:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.507+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14dc1a5270 con 0x7f14dc1143e0 2024-05-08T08:46:46.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.507+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14dc1acb50 con 0x7f14dc1143e0 2024-05-08T08:46:46.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.509+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14dc06a190 con 0x7f14dc1143e0 2024-05-08T08:46:46.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.516+0000 7f14d8c00700 1 -- 172.21.15.70:0/1131965475 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f14d401b030 con 0x7f14dc1143e0 2024-05-08T08:46:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.518+0000 7f14d8c00700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14c00b2bc0 0x7f14c00b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.518+0000 7f14d8c00700 1 -- 172.21.15.70:0/1131965475 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(317..317 src has 1..317) ==== 9583+0+0 (secure 0 0 0) 0x7f14d40e2f60 con 0x7f14dc1143e0 2024-05-08T08:46:46.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.519+0000 7f14dbe00700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14c00b2bc0 0x7f14c00b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:46.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.521+0000 7f14dbe00700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14c00b2bc0 0x7f14c00b5080 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00b2e0 tx=0x7f14cc005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:46.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.521+0000 7f14d8c00700 1 -- 172.21.15.70:0/1131965475 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f14d4022020 con 0x7f14dc1143e0 2024-05-08T08:46:46.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.988+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14dc02e510 con 0x7f14dc1143e0 2024-05-08T08:46:46.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.989+0000 7f14d8c00700 1 -- 172.21.15.70:0/1131965475 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f14d4010040 con 0x7f14dc1143e0 2024-05-08T08:46:46.984 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:46:46.985 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:46:46.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.992+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14c00b2bc0 msgr2=0x7f14c00b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.992+0000 7f14e1600700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14c00b2bc0 0x7f14c00b5080 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00b2e0 tx=0x7f14cc005fb0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.992+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc1143e0 msgr2=0x7f14dc1a48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.992+0000 7f14e1600700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc1143e0 0x7f14dc1a48a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f14d400ef90 tx=0x7f14d400c3a0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.993+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 shutdown_connections 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.993+0000 7f14e1600700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14c00b2bc0 0x7f14c00b5080 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.993+0000 7f14e1600700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14dc1143e0 0x7f14dc1a48a0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.993+0000 7f14e1600700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14dc075840 0x7f14dc1a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.993+0000 7f14e1600700 1 --2- 172.21.15.70:0/1131965475 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14dc076160 0x7f14dc1a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.993+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 >> 172.21.15.70:0/1131965475 conn(0x7f14dc0fef20 msgr2=0x7f14dc100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:46.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.993+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 shutdown_connections 2024-05-08T08:46:46.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:46.993+0000 7f14e1600700 1 -- 172.21.15.70:0/1131965475 wait complete. 2024-05-08T08:46:46.989 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:46:47.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:47 smithi070 ceph-mon[29591]: pgmap v3832: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 170 KiB/s wr, 12 op/s 2024-05-08T08:46:47.371 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:47 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1131965475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:46:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:47 smithi172 ceph-mon[33377]: pgmap v3832: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 170 KiB/s wr, 12 op/s 2024-05-08T08:46:47.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:47 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1131965475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:46:47.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:47 smithi194 ceph-mon[33679]: pgmap v3832: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 170 KiB/s wr, 12 op/s 2024-05-08T08:46:47.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:47 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1131965475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:46:47.951 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.05 --await-for 42.0' 2024-05-08T08:46:47.951 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.05 --await-for 42.0 2024-05-08T08:46:48.526 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:46:49.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:49 smithi070 ceph-mon[29591]: pgmap v3833: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 170 KiB/s wr, 12 op/s 2024-05-08T08:46:49.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:49 smithi172 ceph-mon[33377]: pgmap v3833: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 170 KiB/s wr, 12 op/s 2024-05-08T08:46:49.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:49 smithi194 ceph-mon[33679]: pgmap v3833: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 170 KiB/s wr, 12 op/s 2024-05-08T08:46:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.863+0000 7f02ea200700 1 -- 172.21.15.70:0/1259784403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4105840 msgr2=0x7f02e4105c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.863+0000 7f02ea200700 1 --2- 172.21.15.70:0/1259784403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4105840 0x7f02e4105c20 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f02d800b0a0 tx=0x7f02d800b3b0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.863+0000 7f02ea200700 1 -- 172.21.15.70:0/1259784403 shutdown_connections 2024-05-08T08:46:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.863+0000 7f02ea200700 1 --2- 172.21.15.70:0/1259784403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e4107810 0x7f02e41124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.863+0000 7f02ea200700 1 --2- 172.21.15.70:0/1259784403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4105840 0x7f02e4105c20 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.863+0000 7f02ea200700 1 --2- 172.21.15.70:0/1259784403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e4106160 0x7f02e41070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.863+0000 7f02ea200700 1 -- 172.21.15.70:0/1259784403 >> 172.21.15.70:0/1259784403 conn(0x7f02e4100fb0 msgr2=0x7f02e41033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.863+0000 7f02ea200700 1 -- 172.21.15.70:0/1259784403 shutdown_connections 2024-05-08T08:46:50.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.864+0000 7f02ea200700 1 -- 172.21.15.70:0/1259784403 wait complete. 2024-05-08T08:46:50.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.865+0000 7f02ea200700 1 Processor -- start 2024-05-08T08:46:50.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.866+0000 7f02ea200700 1 -- start start 2024-05-08T08:46:50.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.866+0000 7f02ea200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e4105840 0x7f02e41a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.866+0000 7f02ea200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4106160 0x7f02e41a1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.866+0000 7f02ea200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e4107810 0x7f02e419b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.866+0000 7f02ea200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f02e41156c0 con 0x7f02e4106160 2024-05-08T08:46:50.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.866+0000 7f02ea200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4115540 con 0x7f02e4107810 2024-05-08T08:46:50.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.866+0000 7f02ea200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4115840 con 0x7f02e4105840 2024-05-08T08:46:50.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4106160 0x7f02e41a1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e3e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4106160 0x7f02e41a1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58504/0 (socket says 172.21.15.70:58504) 2024-05-08T08:46:50.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e3e00700 1 -- 172.21.15.70:0/2462343575 learned_addr learned my addr 172.21.15.70:0/2462343575 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:50.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e8e00700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e4105840 0x7f02e41a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e9800700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e4107810 0x7f02e419b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e3e00700 1 -- 172.21.15.70:0/2462343575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e4105840 msgr2=0x7f02e41a17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:50.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e3e00700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e4105840 0x7f02e41a17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e3e00700 1 -- 172.21.15.70:0/2462343575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e4107810 msgr2=0x7f02e419b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:50.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e3e00700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e4107810 0x7f02e419b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.867+0000 7f02e3e00700 1 -- 172.21.15.70:0/2462343575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e419c0e0 con 0x7f02e4106160 2024-05-08T08:46:50.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.868+0000 7f02e3e00700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4106160 0x7f02e41a1d00 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f02d000d980 tx=0x7f02d000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:50.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.869+0000 7f02e1600700 1 -- 172.21.15.70:0/2462343575 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0017070 con 0x7f02e4106160 2024-05-08T08:46:50.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.869+0000 7f02e1600700 1 -- 172.21.15.70:0/2462343575 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02d0009dc0 con 0x7f02e4106160 2024-05-08T08:46:50.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.869+0000 7f02e1600700 1 -- 172.21.15.70:0/2462343575 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d0010d60 con 0x7f02e4106160 2024-05-08T08:46:50.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.869+0000 7f02ea200700 1 -- 172.21.15.70:0/2462343575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e419c370 con 0x7f02e4106160 2024-05-08T08:46:50.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.869+0000 7f02ea200700 1 -- 172.21.15.70:0/2462343575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e41a8690 con 0x7f02e4106160 2024-05-08T08:46:50.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.874+0000 7f02f624bb80 1 Processor -- start 2024-05-08T08:46:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.874+0000 7f02f624bb80 1 -- start start 2024-05-08T08:46:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.875+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6410 0x55bc884c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.875+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884c0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.875+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 0x55bc884c1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.875+0000 7f02f624bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bc88401bb0 con 0x55bc884c6410 2024-05-08T08:46:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.875+0000 7f02f624bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc8839f8f0 con 0x55bc884c6d30 2024-05-08T08:46:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.875+0000 7f02f624bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bc883fdb70 con 0x55bc884c0db0 2024-05-08T08:46:50.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.875+0000 7f02e1600700 1 -- 172.21.15.70:0/2462343575 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f02d000f3c0 con 0x7f02e4106160 2024-05-08T08:46:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.875+0000 7f02e9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6410 0x55bc884c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.876+0000 7f02e9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6410 0x55bc884c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58518/0 (socket says 172.21.15.70:58518) 2024-05-08T08:46:50.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.876+0000 7f02e9800700 1 -- 172.21.15.70:0/1607735951 learned_addr learned my addr 172.21.15.70:0/1607735951 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.876+0000 7f02e3e00700 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 0x55bc884c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.876+0000 7f02e8e00700 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.876+0000 7f02e8e00700 1 -- 172.21.15.70:0/1607735951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 msgr2=0x55bc884c1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.876+0000 7f02e8e00700 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 0x55bc884c1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.877+0000 7f02e8e00700 1 -- 172.21.15.70:0/1607735951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6410 msgr2=0x55bc884c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.877+0000 7f02e8e00700 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6410 0x55bc884c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.877+0000 7f02e8e00700 1 -- 172.21.15.70:0/1607735951 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc8834ea60 con 0x55bc884c6d30 2024-05-08T08:46:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.877+0000 7f02e3e00700 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 0x55bc884c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:46:50.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.877+0000 7f02e8e00700 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884c0820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02d800b830 tx=0x7f02d8009200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2af9f75c55d6859f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:50.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.878+0000 7f02e1600700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f02cc0bb330 0x7f02cc0bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.878+0000 7f02e1600700 1 -- 172.21.15.70:0/2462343575 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(317..317 src has 1..317) ==== 9583+0+0 (secure 0 0 0) 0x7f02d00e24e0 con 0x7f02e4106160 2024-05-08T08:46:50.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.878+0000 7f02d6000700 1 -- 172.21.15.70:0/1607735951 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8020070 con 0x55bc884c6d30 2024-05-08T08:46:50.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.878+0000 7f02d6000700 1 -- 172.21.15.70:0/1607735951 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02d80074e0 con 0x55bc884c6d30 2024-05-08T08:46:50.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.878+0000 7f02d6000700 1 -- 172.21.15.70:0/1607735951 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8005260 con 0x55bc884c6d30 2024-05-08T08:46:50.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.879+0000 7f02e9800700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f02cc0bb330 0x7f02cc0bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.880+0000 7f02f624bb80 1 -- 172.21.15.70:0/1607735951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 msgr2=0x55bc884c0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:50.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.880+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884c0820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f02d800b830 tx=0x7f02d8009200 comp rx=0 tx=0).stop 2024-05-08T08:46:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.880+0000 7f02f624bb80 1 -- 172.21.15.70:0/1607735951 shutdown_connections 2024-05-08T08:46:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.880+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 0x55bc884c1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.880+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6410 0x55bc884c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.880+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1607735951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884c0820 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.880+0000 7f02f624bb80 1 -- 172.21.15.70:0/1607735951 >> 172.21.15.70:0/1607735951 conn(0x55bc88427860 msgr2=0x55bc884aa370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.881+0000 7f02f624bb80 1 -- 172.21.15.70:0/1607735951 shutdown_connections 2024-05-08T08:46:50.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.881+0000 7f02f624bb80 1 -- 172.21.15.70:0/1607735951 wait complete. 2024-05-08T08:46:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.881+0000 7f02f624bb80 1 -- start start 2024-05-08T08:46:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.882+0000 7f02f624bb80 1 Processor -- start 2024-05-08T08:46:50.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.882+0000 7f02e9800700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f02cc0bb330 0x7f02cc0bd7f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f02dc005c50 tx=0x7f02dc007320 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c0db0 0x55bc884cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02f624bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bc884cd6f0 con 0x55bc884c6d30 2024-05-08T08:46:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02f624bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bc88367cb0 con 0x55bc884c0db0 2024-05-08T08:46:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02f624bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bc884cd870 con 0x55bc884c6410 2024-05-08T08:46:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02f624bb80 10 client.0 _ll_register_callbacks cb 0x55bc883a8e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:46:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02e8e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c0db0 0x55bc884cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02e9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02e3e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02e8e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c0db0 0x55bc884cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:37718/0 (socket says 172.21.15.70:37718) 2024-05-08T08:46:50.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.883+0000 7f02e8e00700 1 -- 172.21.15.70:0/1511484747 learned_addr learned my addr 172.21.15.70:0/1511484747 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.884+0000 7f02e8e00700 1 -- 172.21.15.70:0/1511484747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 msgr2=0x55bc884c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.884+0000 7f02e8e00700 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.884+0000 7f02e8e00700 1 -- 172.21.15.70:0/1511484747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 msgr2=0x55bc884ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.884+0000 7f02e8e00700 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.884+0000 7f02e8e00700 1 -- 172.21.15.70:0/1511484747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc883c75b0 con 0x55bc884c0db0 2024-05-08T08:46:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.884+0000 7f02e9800700 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:46:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.885+0000 7f02e8e00700 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c0db0 0x55bc884cca70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f02d800b070 tx=0x7f02d80078c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa8611000577bd1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:50.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.885+0000 7f02caa00700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:46:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.885+0000 7f02caa00700 1 -- 172.21.15.70:0/1511484747 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8020040 con 0x55bc884c0db0 2024-05-08T08:46:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.885+0000 7f02f624bb80 1 -- 172.21.15.70:0/1511484747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02d80074e0 con 0x55bc884c0db0 2024-05-08T08:46:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.885+0000 7f02caa00700 1 -- 172.21.15.70:0/1511484747 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(317..317 src has 1..317) ==== 9583+0+0 (secure 0 0 0) 0x7f02d8003c10 con 0x55bc884c0db0 2024-05-08T08:46:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.886+0000 7f02caa00700 1 -- 172.21.15.70:0/1511484747 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f02d8005040 con 0x55bc884c0db0 2024-05-08T08:46:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.886+0000 7f02f624bb80 10 client.37322 fetch_fsmap learned FSMap version 42 2024-05-08T08:46:50.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.886+0000 7f02f624bb80 1 -- 172.21.15.70:0/1511484747 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bc884d8040 con 0x55bc884c0db0 2024-05-08T08:46:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.886+0000 7f02caa00700 1 -- 172.21.15.70:0/1511484747 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02d80074e0 con 0x55bc884c0db0 2024-05-08T08:46:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.887+0000 7f02caa00700 1 -- 172.21.15.70:0/1511484747 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f02d8011070 con 0x55bc884c0db0 2024-05-08T08:46:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.887+0000 7f02f624bb80 10 client.37322 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:46:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.887+0000 7f02f624bb80 10 client.37322 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:46:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.887+0000 7f02f624bb80 20 client.37322 populate_metadata read hostname 'smithi070' 2024-05-08T08:46:50.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.887+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bc884da510 0x55bc884dc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.887+0000 7f02f624bb80 4 client.37322 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:46:50.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.887+0000 7f02f624bb80 1 -- 172.21.15.70:0/1511484747 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc8847c2d0 con 0x55bc884da510 2024-05-08T08:46:50.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.888+0000 7f02e3e00700 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bc884da510 0x55bc884dc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.889+0000 7f02e3e00700 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bc884da510 0x55bc884dc900 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baa102cbd6fbff98 server_cookie=82c831ba3f5427c in_seq=0 out_seq=0 2024-05-08T08:46:50.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.889+0000 7f02caa00700 10 client.37322 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:46:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.892+0000 7f02caa00700 1 -- 172.21.15.70:0/1511484747 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bc8847c2d0 con 0x55bc884da510 2024-05-08T08:46:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.892+0000 7f02caa00700 10 client.37322 handle_command_reply: tid=0 2024-05-08T08:46:50.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.892+0000 7f02f624bb80 1 client.37322 shutdown 2024-05-08T08:46:50.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 -- 172.21.15.70:0/1511484747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c0db0 msgr2=0x55bc884cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:50.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c0db0 0x55bc884cca70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f02d800b070 tx=0x7f02d80078c0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 -- 172.21.15.70:0/1511484747 shutdown_connections 2024-05-08T08:46:50.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bc884da510 0x55bc884dc900 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c0db0 0x55bc884cca70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 --2- 172.21.15.70:0/1511484747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02caa00700 0 client.37322 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:46:50.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 -- 172.21.15.70:0/1511484747 >> 172.21.15.70:0/1511484747 conn(0x55bc88427860 msgr2=0x55bc884ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:50.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 -- 172.21.15.70:0/1511484747 shutdown_connections 2024-05-08T08:46:50.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.893+0000 7f02f624bb80 1 -- 172.21.15.70:0/1511484747 wait complete. 2024-05-08T08:46:50.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.894+0000 7f02f624bb80 20 client.37322 trim_cache size 0 max 16384 2024-05-08T08:46:50.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.931+0000 7f02f624bb80 1 Processor -- start 2024-05-08T08:46:50.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.931+0000 7f02f624bb80 1 -- start start 2024-05-08T08:46:50.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.931+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 0x55bc884c7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.931+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6410 0x55bc884df930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.931+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884dfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.931+0000 7f02f624bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f02e40740d0 con 0x55bc884c6d30 2024-05-08T08:46:50.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.931+0000 7f02f624bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4071960 con 0x55bc884c6410 2024-05-08T08:46:50.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.931+0000 7f02f624bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f02e406f7d0 con 0x55bc884c0db0 2024-05-08T08:46:50.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.932+0000 7f02e9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884dfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.932+0000 7f02e9800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884dfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58546/0 (socket says 172.21.15.70:58546) 2024-05-08T08:46:50.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.932+0000 7f02e9800700 1 -- 172.21.15.70:0/2976380872 learned_addr learned my addr 172.21.15.70:0/2976380872 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:50.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.932+0000 7f02e3e00700 1 --2- 172.21.15.70:0/2976380872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6410 0x55bc884df930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.932+0000 7f02e8e00700 1 --2- 172.21.15.70:0/2976380872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 0x55bc884c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.932+0000 7f02e9800700 1 -- 172.21.15.70:0/2976380872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 msgr2=0x55bc884c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.932+0000 7f02e9800700 1 --2- 172.21.15.70:0/2976380872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 0x55bc884c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.933+0000 7f02e9800700 1 -- 172.21.15.70:0/2976380872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6410 msgr2=0x55bc884df930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.933+0000 7f02e9800700 1 --2- 172.21.15.70:0/2976380872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6410 0x55bc884df930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.933+0000 7f02e9800700 1 -- 172.21.15.70:0/2976380872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc884e03b0 con 0x55bc884c6d30 2024-05-08T08:46:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.933+0000 7f02e9800700 1 --2- 172.21.15.70:0/2976380872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884dfe70 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f02dc011fe0 tx=0x7f02dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fd2328502b3ff5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.934+0000 7f02d5600700 1 -- 172.21.15.70:0/2976380872 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc01ecd0 con 0x55bc884c6d30 2024-05-08T08:46:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.934+0000 7f02d5600700 1 -- 172.21.15.70:0/2976380872 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02dc029910 con 0x55bc884c6d30 2024-05-08T08:46:50.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.934+0000 7f02d5600700 1 -- 172.21.15.70:0/2976380872 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc01c740 con 0x55bc884c6d30 2024-05-08T08:46:50.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.935+0000 7f02f624bb80 1 -- 172.21.15.70:0/2976380872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 msgr2=0x55bc884dfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:46:50.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.935+0000 7f02f624bb80 1 --2- 172.21.15.70:0/2976380872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884dfe70 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f02dc011fe0 tx=0x7f02dc019000 comp rx=0 tx=0).stop 2024-05-08T08:46:50.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.935+0000 7f02f624bb80 1 -- 172.21.15.70:0/2976380872 shutdown_connections 2024-05-08T08:46:50.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.935+0000 7f02f624bb80 1 --2- 172.21.15.70:0/2976380872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c6d30 0x55bc884dfe70 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.935+0000 7f02f624bb80 1 --2- 172.21.15.70:0/2976380872 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c0db0 0x55bc884c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.935+0000 7f02f624bb80 1 --2- 172.21.15.70:0/2976380872 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6410 0x55bc884df930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.935+0000 7f02f624bb80 1 -- 172.21.15.70:0/2976380872 >> 172.21.15.70:0/2976380872 conn(0x55bc88427860 msgr2=0x55bc884c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:46:50.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.936+0000 7f02f624bb80 1 -- 172.21.15.70:0/2976380872 shutdown_connections 2024-05-08T08:46:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.936+0000 7f02f624bb80 1 -- 172.21.15.70:0/2976380872 wait complete. 2024-05-08T08:46:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.936+0000 7f02f624bb80 1 -- start start 2024-05-08T08:46:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.937+0000 7f02f624bb80 1 Processor -- start 2024-05-08T08:46:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.937+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c0db0 0x55bc884dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.937+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884ddf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.937+0000 7f02f624bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884de450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.937+0000 7f02f624bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f02e406fe20 con 0x55bc884c0db0 2024-05-08T08:46:50.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.937+0000 7f02f624bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4071290 con 0x55bc884c6d30 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.937+0000 7f02f624bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f02e40704f0 con 0x55bc884c6410 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.937+0000 7f02f624bb80 10 client.0 _ll_register_callbacks cb 0x55bc884c49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.938+0000 7f02e3e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884ddf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.938+0000 7f02e3e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884ddf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:60270/0 (socket says 172.21.15.70:60270) 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.938+0000 7f02e3e00700 1 -- 172.21.15.70:0/920441812 learned_addr learned my addr 172.21.15.70:0/920441812 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.938+0000 7f02e8e00700 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c0db0 0x55bc884dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.939+0000 7f02e9800700 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884de450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.939+0000 7f02e3e00700 1 -- 172.21.15.70:0/920441812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 msgr2=0x55bc884de450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.939+0000 7f02e3e00700 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884de450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.939+0000 7f02e3e00700 1 -- 172.21.15.70:0/920441812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c0db0 msgr2=0x55bc884dfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.939+0000 7f02e3e00700 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c0db0 0x55bc884dfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.939+0000 7f02e3e00700 1 -- 172.21.15.70:0/920441812 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc884deb20 con 0x55bc884c6410 2024-05-08T08:46:50.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.939+0000 7f02e9800700 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884de450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:46:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.940+0000 7f02e3e00700 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884ddf10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02d00a65b0 tx=0x7f02d00a5320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23ec89a6ecd0a5c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:46:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.940+0000 7f02caa00700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T08:46:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.940+0000 7f02caa00700 1 -- 172.21.15.70:0/920441812 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d00a8e50 con 0x55bc884c6410 2024-05-08T08:46:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.940+0000 7f02f624bb80 1 -- 172.21.15.70:0/920441812 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02dc029910 con 0x55bc884c6410 2024-05-08T08:46:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.940+0000 7f02caa00700 1 -- 172.21.15.70:0/920441812 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(317..317 src has 1..317) ==== 9583+0+0 (secure 0 0 0) 0x7f02d00a95a0 con 0x55bc884c6410 2024-05-08T08:46:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.941+0000 7f02caa00700 1 -- 172.21.15.70:0/920441812 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f02d00a9a40 con 0x55bc884c6410 2024-05-08T08:46:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.941+0000 7f02f624bb80 10 client.27433 fetch_fsmap learned FSMap version 42 2024-05-08T08:46:50.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.941+0000 7f02f624bb80 1 -- 172.21.15.70:0/920441812 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bc88545910 con 0x55bc884c6410 2024-05-08T08:46:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.941+0000 7f02caa00700 1 -- 172.21.15.70:0/920441812 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02dc029910 con 0x55bc884c6410 2024-05-08T08:46:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.942+0000 7f02caa00700 1 -- 172.21.15.70:0/920441812 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f02d00b1d10 con 0x55bc884c6410 2024-05-08T08:46:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.942+0000 7f02f624bb80 10 client.27433 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:46:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.942+0000 7f02f624bb80 10 client.27433 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:46:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.942+0000 7f02f624bb80 20 client.27433 populate_metadata read hostname 'smithi070' 2024-05-08T08:46:50.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.942+0000 7f02f624bb80 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bc885460c0 0x55bc885484e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:46:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.942+0000 7f02f624bb80 4 client.27433 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.05, "await_for": 42.0}] 2024-05-08T08:46:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.942+0000 7f02f624bb80 1 -- 172.21.15.70:0/920441812 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.05, "await_for": 42.0}) -- 0x55bc8840f590 con 0x55bc885460c0 2024-05-08T08:46:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.942+0000 7f02e8e00700 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bc885460c0 0x55bc885484e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:46:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.943+0000 7f02caa00700 10 client.27433 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:46:50.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:46:50.943+0000 7f02e8e00700 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bc885460c0 0x55bc885484e0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e74eaa611df0a270 server_cookie=95030fb9a3f0dc83 in_seq=0 out_seq=0 2024-05-08T08:46:51.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:51 smithi070 ceph-mon[29591]: pgmap v3834: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 423 KiB/s wr, 18 op/s 2024-05-08T08:46:51.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:51 smithi172 ceph-mon[33377]: pgmap v3834: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 423 KiB/s wr, 18 op/s 2024-05-08T08:46:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:51 smithi194 ceph-mon[33679]: pgmap v3834: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 423 KiB/s wr, 18 op/s 2024-05-08T08:46:53.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:53 smithi070 ceph-mon[29591]: pgmap v3835: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 423 KiB/s wr, 15 op/s 2024-05-08T08:46:53.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:53 smithi172 ceph-mon[33377]: pgmap v3835: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 423 KiB/s wr, 15 op/s 2024-05-08T08:46:53.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:53 smithi194 ceph-mon[33679]: pgmap v3835: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 423 KiB/s wr, 15 op/s 2024-05-08T08:46:55.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:55 smithi070 ceph-mon[29591]: pgmap v3836: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 582 KiB/s wr, 23 op/s 2024-05-08T08:46:55.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:55 smithi172 ceph-mon[33377]: pgmap v3836: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 582 KiB/s wr, 23 op/s 2024-05-08T08:46:55.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:55 smithi194 ceph-mon[33679]: pgmap v3836: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 559 KiB/s rd, 582 KiB/s wr, 23 op/s 2024-05-08T08:46:57.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:57 smithi070 ceph-mon[29591]: pgmap v3837: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 412 KiB/s wr, 14 op/s 2024-05-08T08:46:57.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:57 smithi172 ceph-mon[33377]: pgmap v3837: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 412 KiB/s wr, 14 op/s 2024-05-08T08:46:57.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:57 smithi194 ceph-mon[33679]: pgmap v3837: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 412 KiB/s wr, 14 op/s 2024-05-08T08:46:59.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:46:59 smithi070 ceph-mon[29591]: pgmap v3838: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 412 KiB/s wr, 14 op/s 2024-05-08T08:46:59.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:46:59 smithi172 ceph-mon[33377]: pgmap v3838: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 412 KiB/s wr, 14 op/s 2024-05-08T08:46:59.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:46:59 smithi194 ceph-mon[33679]: pgmap v3838: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 412 KiB/s wr, 14 op/s 2024-05-08T08:47:01.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:01 smithi070 ceph-mon[29591]: pgmap v3839: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 463 KiB/s wr, 17 op/s 2024-05-08T08:47:01.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:01 smithi172 ceph-mon[33377]: pgmap v3839: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 463 KiB/s wr, 17 op/s 2024-05-08T08:47:01.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:01 smithi194 ceph-mon[33679]: pgmap v3839: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 463 KiB/s wr, 17 op/s 2024-05-08T08:47:03.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:03 smithi070 ceph-mon[29591]: pgmap v3840: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 211 KiB/s wr, 11 op/s 2024-05-08T08:47:03.424 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:03 smithi172 ceph-mon[33377]: pgmap v3840: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 211 KiB/s wr, 11 op/s 2024-05-08T08:47:03.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:03 smithi194 ceph-mon[33679]: pgmap v3840: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 211 KiB/s wr, 11 op/s 2024-05-08T08:47:05.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:05 smithi070 ceph-mon[29591]: pgmap v3841: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 211 KiB/s wr, 16 op/s 2024-05-08T08:47:05.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:05 smithi172 ceph-mon[33377]: pgmap v3841: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 211 KiB/s wr, 16 op/s 2024-05-08T08:47:05.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:05 smithi194 ceph-mon[33679]: pgmap v3841: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 211 KiB/s wr, 16 op/s 2024-05-08T08:47:07.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:07 smithi070 ceph-mon[29591]: pgmap v3842: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T08:47:07.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:07 smithi172 ceph-mon[33377]: pgmap v3842: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T08:47:07.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:07 smithi194 ceph-mon[33679]: pgmap v3842: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T08:47:09.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:09 smithi070 ceph-mon[29591]: pgmap v3843: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T08:47:09.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:09 smithi172 ceph-mon[33377]: pgmap v3843: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T08:47:09.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:09 smithi194 ceph-mon[33679]: pgmap v3843: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T08:47:11.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:11 smithi070 ceph-mon[29591]: pgmap v3844: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 93 KiB/s wr, 11 op/s 2024-05-08T08:47:11.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:11 smithi172 ceph-mon[33377]: pgmap v3844: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 93 KiB/s wr, 11 op/s 2024-05-08T08:47:11.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:11 smithi194 ceph-mon[33679]: pgmap v3844: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 93 KiB/s wr, 11 op/s 2024-05-08T08:47:13.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:13 smithi070 ceph-mon[29591]: pgmap v3845: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-05-08T08:47:13.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:13 smithi172 ceph-mon[33377]: pgmap v3845: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-05-08T08:47:13.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:13 smithi194 ceph-mon[33679]: pgmap v3845: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 KiB/s wr, 7 op/s 2024-05-08T08:47:14.856 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:47:14.856 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 270, 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "8864594c": { 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 270, 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.0, 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:47:14.857 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:47:14.858 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:47:14.858 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:47:14.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:47:14.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:14.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:14.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:14.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:14.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:14.858 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.856+0000 7f02caa00700 1 -- 172.21.15.70:0/920441812 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55bc8840f590 con 0x55bc885460c0 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.856+0000 7f02caa00700 10 client.27433 handle_command_reply: tid=0 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.856+0000 7f02f624bb80 1 client.27433 shutdown 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.856+0000 7f02f624bb80 1 -- 172.21.15.70:0/920441812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 msgr2=0x55bc884ddf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.856+0000 7f02f624bb80 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884ddf10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02d00a65b0 tx=0x7f02d00a5320 comp rx=0 tx=0).stop 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02f624bb80 1 -- 172.21.15.70:0/920441812 shutdown_connections 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02f624bb80 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bc885460c0 0x55bc885484e0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02f624bb80 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bc884c6d30 0x55bc884de450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02f624bb80 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bc884c0db0 0x55bc884dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02f624bb80 1 --2- 172.21.15.70:0/920441812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bc884c6410 0x55bc884ddf10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02f624bb80 1 -- 172.21.15.70:0/920441812 >> 172.21.15.70:0/920441812 conn(0x55bc88427860 msgr2=0x55bc884c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02caa00700 0 client.27433 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:47:14.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02f624bb80 1 -- 172.21.15.70:0/920441812 shutdown_connections 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02f624bb80 1 -- 172.21.15.70:0/920441812 wait complete. 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.857+0000 7f02f624bb80 20 client.27433 trim_cache size 0 max 16384 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.859+0000 7f02ea200700 1 -- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f02cc0bb330 msgr2=0x7f02cc0bd7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.859+0000 7f02ea200700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f02cc0bb330 0x7f02cc0bd7f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f02dc005c50 tx=0x7f02dc007320 comp rx=0 tx=0).stop 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.859+0000 7f02ea200700 1 -- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4106160 msgr2=0x7f02e41a1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.859+0000 7f02ea200700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4106160 0x7f02e41a1d00 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f02d000d980 tx=0x7f02d000dc90 comp rx=0 tx=0).stop 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.860+0000 7f02ea200700 1 -- 172.21.15.70:0/2462343575 shutdown_connections 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.860+0000 7f02ea200700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f02cc0bb330 0x7f02cc0bd7f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.860+0000 7f02ea200700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f02e4107810 0x7f02e419b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.860+0000 7f02ea200700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02e4105840 0x7f02e41a17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.860+0000 7f02ea200700 1 --2- 172.21.15.70:0/2462343575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f02e4106160 0x7f02e41a1d00 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.860+0000 7f02ea200700 1 -- 172.21.15.70:0/2462343575 >> 172.21.15.70:0/2462343575 conn(0x7f02e4100fb0 msgr2=0x7f02e4102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.860+0000 7f02ea200700 1 -- 172.21.15.70:0/2462343575 shutdown_connections 2024-05-08T08:47:14.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:14.860+0000 7f02ea200700 1 -- 172.21.15.70:0/2462343575 wait complete. 2024-05-08T08:47:15.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:15 smithi070 ceph-mon[29591]: pgmap v3846: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 64 KiB/s wr, 23 op/s 2024-05-08T08:47:15.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:15 smithi172 ceph-mon[33377]: pgmap v3846: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 64 KiB/s wr, 23 op/s 2024-05-08T08:47:15.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:15 smithi194 ceph-mon[33679]: pgmap v3846: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 64 KiB/s wr, 23 op/s 2024-05-08T08:47:15.895 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8864594c', quiesce took 32.5 seconds. Will release after: 19.05 2024-05-08T08:47:17.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:17 smithi070 ceph-mon[29591]: pgmap v3847: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 64 KiB/s wr, 19 op/s 2024-05-08T08:47:17.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:17 smithi172 ceph-mon[33377]: pgmap v3847: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 64 KiB/s wr, 19 op/s 2024-05-08T08:47:17.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:17 smithi194 ceph-mon[33679]: pgmap v3847: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 64 KiB/s wr, 19 op/s 2024-05-08T08:47:19.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:19 smithi070 ceph-mon[29591]: pgmap v3848: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 64 KiB/s wr, 19 op/s 2024-05-08T08:47:19.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:19 smithi172 ceph-mon[33377]: pgmap v3848: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 64 KiB/s wr, 19 op/s 2024-05-08T08:47:19.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:19 smithi194 ceph-mon[33679]: pgmap v3848: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 64 KiB/s wr, 19 op/s 2024-05-08T08:47:21.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:21 smithi070 ceph-mon[29591]: pgmap v3849: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 87 KiB/s wr, 25 op/s 2024-05-08T08:47:21.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:21 smithi172 ceph-mon[33377]: pgmap v3849: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 87 KiB/s wr, 25 op/s 2024-05-08T08:47:21.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:21 smithi194 ceph-mon[33679]: pgmap v3849: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 87 KiB/s wr, 25 op/s 2024-05-08T08:47:23.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:23 smithi070 ceph-mon[29591]: pgmap v3850: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T08:47:23.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:23 smithi172 ceph-mon[33377]: pgmap v3850: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T08:47:23.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:23 smithi194 ceph-mon[33679]: pgmap v3850: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T08:47:25.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:25 smithi172 ceph-mon[33377]: pgmap v3851: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 70 KiB/s wr, 25 op/s 2024-05-08T08:47:25.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:25 smithi172 ceph-mon[33377]: osdmap e318: 12 total, 12 up, 12 in 2024-05-08T08:47:25.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:25 smithi194 ceph-mon[33679]: pgmap v3851: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 70 KiB/s wr, 25 op/s 2024-05-08T08:47:25.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:25 smithi194 ceph-mon[33679]: osdmap e318: 12 total, 12 up, 12 in 2024-05-08T08:47:25.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:25 smithi070 ceph-mon[29591]: pgmap v3851: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 70 KiB/s wr, 25 op/s 2024-05-08T08:47:25.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:25 smithi070 ceph-mon[29591]: osdmap e318: 12 total, 12 up, 12 in 2024-05-08T08:47:27.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:27 smithi172 ceph-mon[33377]: pgmap v3853: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-05-08T08:47:27.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:27 smithi194 ceph-mon[33679]: pgmap v3853: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-05-08T08:47:27.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:27 smithi070 ceph-mon[29591]: pgmap v3853: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-05-08T08:47:29.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:29 smithi172 ceph-mon[33377]: pgmap v3854: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-05-08T08:47:29.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:29 smithi194 ceph-mon[33679]: pgmap v3854: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-05-08T08:47:29.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:29 smithi070 ceph-mon[29591]: pgmap v3854: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 58 KiB/s wr, 10 op/s 2024-05-08T08:47:31.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:31 smithi172 ceph-mon[33377]: pgmap v3855: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:47:31.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:31 smithi172 ceph-mon[33377]: osdmap e319: 12 total, 12 up, 12 in 2024-05-08T08:47:31.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:31 smithi194 ceph-mon[33679]: pgmap v3855: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:47:31.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:31 smithi194 ceph-mon[33679]: osdmap e319: 12 total, 12 up, 12 in 2024-05-08T08:47:31.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:31 smithi070 ceph-mon[29591]: pgmap v3855: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:47:31.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:31 smithi070 ceph-mon[29591]: osdmap e319: 12 total, 12 up, 12 in 2024-05-08T08:47:33.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:33 smithi172 ceph-mon[33377]: pgmap v3857: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-08T08:47:33.427 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:33 smithi070 ceph-mon[29591]: pgmap v3857: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-08T08:47:33.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:33 smithi194 ceph-mon[33679]: pgmap v3857: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-05-08T08:47:34.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:47:35.374 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:35 smithi070 ceph-mon[29591]: pgmap v3858: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T08:47:35.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:35 smithi172 ceph-mon[33377]: pgmap v3858: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T08:47:35.433 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:47:35.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:35 smithi194 ceph-mon[33679]: pgmap v3858: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T08:47:37.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:37 smithi172 ceph-mon[33377]: pgmap v3859: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T08:47:37.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:37 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:47:37.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:37 smithi070 ceph-mon[29591]: pgmap v3859: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T08:47:37.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:37 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:47:37.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:37 smithi194 ceph-mon[33679]: pgmap v3859: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T08:47:37.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:37 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:47:38.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.593+0000 7ff7a5600700 1 -- 172.21.15.70:0/1555359884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a01099e0 msgr2=0x7ff7a0109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:38.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.593+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1555359884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a01099e0 0x7ff7a0109e60 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009990 tx=0x7ff78c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.593+0000 7ff7a5600700 1 -- 172.21.15.70:0/1555359884 shutdown_connections 2024-05-08T08:47:38.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.593+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1555359884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7a010a3a0 0x7ff7a0116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.593+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1555359884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7a010e8b0 0x7ff7a010ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.593+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1555359884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a01099e0 0x7ff7a0109e60 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.593+0000 7ff7a5600700 1 -- 172.21.15.70:0/1555359884 >> 172.21.15.70:0/1555359884 conn(0x7ff7a0079230 msgr2=0x7ff7a01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:38.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.593+0000 7ff7a5600700 1 -- 172.21.15.70:0/1555359884 shutdown_connections 2024-05-08T08:47:38.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.593+0000 7ff7a5600700 1 -- 172.21.15.70:0/1555359884 wait complete. 2024-05-08T08:47:38.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.594+0000 7ff7a5600700 1 Processor -- start 2024-05-08T08:47:38.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.594+0000 7ff7a5600700 1 -- start start 2024-05-08T08:47:38.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff7a5600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7a01099e0 0x7ff7a01a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:38.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff7a5600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7a010a3a0 0x7ff7a01a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:38.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff7a5600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a010e8b0 0x7ff7a01a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff7a5600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a0119b70 con 0x7ff7a010e8b0 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff7a5600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a01199f0 con 0x7ff7a010a3a0 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff7a5600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a0119cf0 con 0x7ff7a01099e0 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff7a4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a010e8b0 0x7ff7a01a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff7a4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a010e8b0 0x7ff7a01a49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33946/0 (socket says 172.21.15.70:33946) 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff7a4c00700 1 -- 172.21.15.70:0/1552622702 learned_addr learned my addr 172.21.15.70:0/1552622702 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.595+0000 7ff79fe00700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7a01099e0 0x7ff7a01a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.596+0000 7ff79f400700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7a010a3a0 0x7ff7a01a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.596+0000 7ff7a4c00700 1 -- 172.21.15.70:0/1552622702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7a01099e0 msgr2=0x7ff7a01a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.596+0000 7ff7a4c00700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7a01099e0 0x7ff7a01a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.596+0000 7ff7a4c00700 1 -- 172.21.15.70:0/1552622702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7a010a3a0 msgr2=0x7ff7a01a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.596+0000 7ff7a4c00700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7a010a3a0 0x7ff7a01a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.596+0000 7ff7a4c00700 1 -- 172.21.15.70:0/1552622702 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a01a5130 con 0x7ff7a010e8b0 2024-05-08T08:47:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.596+0000 7ff7a4c00700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a010e8b0 0x7ff7a01a49f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff79800b970 tx=0x7ff79800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:47:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.597+0000 7ff79cc00700 1 -- 172.21.15.70:0/1552622702 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79800d860 con 0x7ff7a010e8b0 2024-05-08T08:47:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.597+0000 7ff79cc00700 1 -- 172.21.15.70:0/1552622702 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff79800e430 con 0x7ff7a010e8b0 2024-05-08T08:47:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.597+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a01a5420 con 0x7ff7a010e8b0 2024-05-08T08:47:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.597+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a01acca0 con 0x7ff7a010e8b0 2024-05-08T08:47:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.597+0000 7ff79cc00700 1 -- 172.21.15.70:0/1552622702 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798017660 con 0x7ff7a010e8b0 2024-05-08T08:47:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.598+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff780005330 con 0x7ff7a010e8b0 2024-05-08T08:47:38.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.602+0000 7ff79cc00700 1 -- 172.21.15.70:0/1552622702 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff79800da00 con 0x7ff7a010e8b0 2024-05-08T08:47:38.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.604+0000 7ff79cc00700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7840b2a70 0x7ff7840b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:38.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.604+0000 7ff79cc00700 1 -- 172.21.15.70:0/1552622702 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(319..319 src has 1..319) ==== 9583+0+0 (secure 0 0 0) 0x7ff7980e2470 con 0x7ff7a010e8b0 2024-05-08T08:47:38.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.604+0000 7ff79fe00700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7840b2a70 0x7ff7840b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:38.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.605+0000 7ff79fe00700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7840b2a70 0x7ff7840b4f30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff790009a10 tx=0x7ff790009190 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:47:38.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.609+0000 7ff79cc00700 1 -- 172.21.15.70:0/1552622702 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff798013030 con 0x7ff7a010e8b0 2024-05-08T08:47:38.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.905+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7800058f0 con 0x7ff7a010e8b0 2024-05-08T08:47:38.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.908+0000 7ff79cc00700 1 -- 172.21.15.70:0/1552622702 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7ff7980a99d0 con 0x7ff7a010e8b0 2024-05-08T08:47:38.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:47:38.903 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:47:38.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7840b2a70 msgr2=0x7ff7840b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:38.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7840b2a70 0x7ff7840b4f30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff790009a10 tx=0x7ff790009190 comp rx=0 tx=0).stop 2024-05-08T08:47:38.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a010e8b0 msgr2=0x7ff7a01a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:38.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a010e8b0 0x7ff7a01a49f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff79800b970 tx=0x7ff79800bc80 comp rx=0 tx=0).stop 2024-05-08T08:47:38.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 shutdown_connections 2024-05-08T08:47:38.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff7840b2a70 0x7ff7840b4f30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff7a010e8b0 0x7ff7a01a49f0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7a01099e0 0x7ff7a01a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 --2- 172.21.15.70:0/1552622702 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff7a010a3a0 0x7ff7a01a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:38.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 >> 172.21.15.70:0/1552622702 conn(0x7ff7a0079230 msgr2=0x7ff7a0079950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:38.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.911+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 shutdown_connections 2024-05-08T08:47:38.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:38.912+0000 7ff7a5600700 1 -- 172.21.15.70:0/1552622702 wait complete. 2024-05-08T08:47:38.907 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:47:39.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:39 smithi194 ceph-mon[33679]: pgmap v3860: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T08:47:39.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:47:39.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:47:39.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:47:39.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1552622702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:47:39.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:39 smithi070 ceph-mon[29591]: pgmap v3860: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T08:47:39.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:47:39.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:47:39.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:47:39.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1552622702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:47:39.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:39 smithi172 ceph-mon[33377]: pgmap v3860: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T08:47:39.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:47:39.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:47:39.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:47:39.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1552622702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:47:39.814 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 8864594c --release --await' 2024-05-08T08:47:39.814 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 8864594c --release --await 2024-05-08T08:47:40.273 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:47:41.463 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:41 smithi070 ceph-mon[29591]: pgmap v3861: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:47:41.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:41 smithi194 ceph-mon[33679]: pgmap v3861: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:47:41.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:41 smithi172 ceph-mon[33377]: pgmap v3861: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.579+0000 7f4b86600700 1 -- 172.21.15.70:0/3342111592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 msgr2=0x7f4b80105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.579+0000 7f4b86600700 1 --2- 172.21.15.70:0/3342111592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 0x7f4b80105b40 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009990 tx=0x7f4b6c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.579+0000 7f4b86600700 1 -- 172.21.15.70:0/3342111592 shutdown_connections 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.579+0000 7f4b86600700 1 --2- 172.21.15.70:0/3342111592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b80106080 0x7f4b80112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.579+0000 7f4b86600700 1 --2- 172.21.15.70:0/3342111592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8010b6c0 0x7f4b8010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.579+0000 7f4b86600700 1 --2- 172.21.15.70:0/3342111592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 0x7f4b80105b40 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.579+0000 7f4b86600700 1 -- 172.21.15.70:0/3342111592 >> 172.21.15.70:0/3342111592 conn(0x7f4b801011b0 msgr2=0x7f4b801035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.580+0000 7f4b86600700 1 -- 172.21.15.70:0/3342111592 shutdown_connections 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.580+0000 7f4b86600700 1 -- 172.21.15.70:0/3342111592 wait complete. 2024-05-08T08:47:42.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.581+0000 7f4b86600700 1 Processor -- start 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.581+0000 7f4b86600700 1 -- start start 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.581+0000 7f4b86600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 0x7f4b801a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.581+0000 7f4b86600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b80106080 0x7f4b801a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.581+0000 7f4b86600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8010b6c0 0x7f4b8019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.581+0000 7f4b86600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801157c0 con 0x7f4b801056c0 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.581+0000 7f4b86600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80115640 con 0x7f4b8010b6c0 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.581+0000 7f4b86600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4b80115940 con 0x7f4b80106080 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 0x7f4b801a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 0x7f4b801a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33964/0 (socket says 172.21.15.70:33964) 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7f400700 1 -- 172.21.15.70:0/2186351966 learned_addr learned my addr 172.21.15.70:0/2186351966 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:47:42.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7fe00700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8010b6c0 0x7f4b8019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b80106080 0x7f4b801a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7f400700 1 -- 172.21.15.70:0/2186351966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b80106080 msgr2=0x7f4b801a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7f400700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b80106080 0x7f4b801a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7f400700 1 -- 172.21.15.70:0/2186351966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8010b6c0 msgr2=0x7f4b8019bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7f400700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8010b6c0 0x7f4b8019bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.582+0000 7f4b7f400700 1 -- 172.21.15.70:0/2186351966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8019c220 con 0x7f4b801056c0 2024-05-08T08:47:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.583+0000 7f4b7f400700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 0x7f4b801a1900 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000d950 tx=0x7f4b7000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:47:42.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.583+0000 7f4b77e00700 1 -- 172.21.15.70:0/2186351966 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70016070 con 0x7f4b801056c0 2024-05-08T08:47:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.583+0000 7f4b77e00700 1 -- 172.21.15.70:0/2186351966 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b70010460 con 0x7f4b801056c0 2024-05-08T08:47:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.583+0000 7f4b86600700 1 -- 172.21.15.70:0/2186351966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8019c510 con 0x7f4b801056c0 2024-05-08T08:47:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.583+0000 7f4b77e00700 1 -- 172.21.15.70:0/2186351966 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7000f620 con 0x7f4b801056c0 2024-05-08T08:47:42.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.583+0000 7f4b86600700 1 -- 172.21.15.70:0/2186351966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b801a87d0 con 0x7f4b801056c0 2024-05-08T08:47:42.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.586+0000 7f4b77e00700 1 -- 172.21.15.70:0/2186351966 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4b70019070 con 0x7f4b801056c0 2024-05-08T08:47:42.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.588+0000 7f4b77e00700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b640b29f0 0x7f4b640b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.588+0000 7f4b77e00700 1 -- 172.21.15.70:0/2186351966 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(319..319 src has 1..319) ==== 9583+0+0 (secure 0 0 0) 0x7f4b700e2650 con 0x7f4b801056c0 2024-05-08T08:47:42.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.588+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b640b29f0 0x7f4b640b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.589+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b640b29f0 0x7f4b640b4eb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00b5c0 tx=0x7f4b6c01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:47:42.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.607+0000 7f4b90fa6b80 1 Processor -- start 2024-05-08T08:47:42.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.607+0000 7f4b90fa6b80 1 -- start start 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.608+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 0x563e6789f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.608+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e67899c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.608+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789a140 0x563e678a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.608+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e677ebb20 con 0x563e67899780 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.608+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563e67789860 con 0x563e6789a140 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.608+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563e677e7ae0 con 0x563e6789f1b0 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.608+0000 7f4b7ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e67899c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.608+0000 7f4b7ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e67899c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33970/0 (socket says 172.21.15.70:33970) 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.608+0000 7f4b7ea00700 1 -- 172.21.15.70:0/315487833 learned_addr learned my addr 172.21.15.70:0/315487833 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.609+0000 7f4b7f400700 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 0x563e6789f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.609+0000 7f4b7fe00700 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789a140 0x563e678a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.609+0000 7f4b7ea00700 1 -- 172.21.15.70:0/315487833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 msgr2=0x563e6789f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:47:42.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.609+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 0x563e6789f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.609+0000 7f4b7ea00700 1 -- 172.21.15.70:0/315487833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789a140 msgr2=0x563e678a5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:47:42.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.609+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789a140 0x563e678a5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.609+0000 7f4b7ea00700 1 -- 172.21.15.70:0/315487833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e677389d0 con 0x563e67899780 2024-05-08T08:47:42.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.609+0000 7f4b7fe00700 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789a140 0x563e678a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:47:42.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.609+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e67899c00 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00ba60 tx=0x7f4b6c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c4c34fa6d3e279 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:47:42.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.610+0000 7f4b74c00700 1 -- 172.21.15.70:0/315487833 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00f8f0 con 0x563e67899780 2024-05-08T08:47:42.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.610+0000 7f4b74c00700 1 -- 172.21.15.70:0/315487833 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b6c032070 con 0x563e67899780 2024-05-08T08:47:42.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.610+0000 7f4b74c00700 1 -- 172.21.15.70:0/315487833 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c023b90 con 0x563e67899780 2024-05-08T08:47:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/315487833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 msgr2=0x563e67899c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e67899c00 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00ba60 tx=0x7f4b6c01e000 comp rx=0 tx=0).stop 2024-05-08T08:47:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/315487833 shutdown_connections 2024-05-08T08:47:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789a140 0x563e678a5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 0x563e6789f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/315487833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e67899c00 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/315487833 >> 172.21.15.70:0/315487833 conn(0x563e678117d0 msgr2=0x563e67894070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/315487833 shutdown_connections 2024-05-08T08:47:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/315487833 wait complete. 2024-05-08T08:47:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.611+0000 7f4b90fa6b80 1 -- start start 2024-05-08T08:47:42.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.612+0000 7f4b90fa6b80 1 Processor -- start 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.612+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 0x563e678a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.612+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 0x563e678a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.612+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789f1b0 0x563e678a3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.612+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e678a6510 con 0x563e6789f1b0 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.612+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563e67751c20 con 0x563e67899780 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.612+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563e678a6690 con 0x563e6789a140 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.612+0000 7f4b90fa6b80 10 client.0 _ll_register_callbacks cb 0x563e67792d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789f1b0 0x563e678a3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789f1b0 0x563e678a3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33980/0 (socket says 172.21.15.70:33980) 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7fe00700 1 -- 172.21.15.70:0/2462142870 learned_addr learned my addr 172.21.15.70:0/2462142870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 0x563e678a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7f400700 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 0x563e678a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7fe00700 1 -- 172.21.15.70:0/2462142870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 msgr2=0x563e678a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7fe00700 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 0x563e678a2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7fe00700 1 -- 172.21.15.70:0/2462142870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 msgr2=0x563e678a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7fe00700 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 0x563e678a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.613+0000 7f4b7fe00700 1 -- 172.21.15.70:0/2462142870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e677b1520 con 0x563e6789f1b0 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.614+0000 7f4b7fe00700 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789f1b0 0x563e678a3470 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f4b78007a80 tx=0x7f4b78007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4406f01939e467 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.614+0000 7f4b69600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.614+0000 7f4b69600700 1 -- 172.21.15.70:0/2462142870 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7801a020 con 0x563e6789f1b0 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.614+0000 7f4b69600700 1 -- 172.21.15.70:0/2462142870 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(319..319 src has 1..319) ==== 9583+0+0 (secure 0 0 0) 0x7f4b780118d0 con 0x563e6789f1b0 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.614+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2462142870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b6c032070 con 0x563e6789f1b0 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.614+0000 7f4b69600700 1 -- 172.21.15.70:0/2462142870 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4b78025050 con 0x563e6789f1b0 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.614+0000 7f4b90fa6b80 10 client.18606 fetch_fsmap learned FSMap version 42 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.614+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2462142870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563e678b0de0 con 0x563e6789f1b0 2024-05-08T08:47:42.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.615+0000 7f4b69600700 1 -- 172.21.15.70:0/2462142870 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b6c032070 con 0x563e6789f1b0 2024-05-08T08:47:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.615+0000 7f4b69600700 1 -- 172.21.15.70:0/2462142870 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4b78016b90 con 0x563e6789f1b0 2024-05-08T08:47:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.615+0000 7f4b90fa6b80 10 client.18606 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:47:42.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.615+0000 7f4b90fa6b80 10 client.18606 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:47:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.615+0000 7f4b90fa6b80 20 client.18606 populate_metadata read hostname 'smithi070' 2024-05-08T08:47:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.615+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e678b3470 0x563e678b5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.615+0000 7f4b90fa6b80 4 client.18606 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:47:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.615+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2462142870 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e67866240 con 0x563e678b3470 2024-05-08T08:47:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.616+0000 7f4b7f400700 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e678b3470 0x563e678b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.617+0000 7f4b7f400700 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e678b3470 0x563e678b5860 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db5b14c483f7ffcb server_cookie=2ede729b60f366d3 in_seq=0 out_seq=0 2024-05-08T08:47:42.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.617+0000 7f4b69600700 10 client.18606 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:47:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b69600700 1 -- 172.21.15.70:0/2462142870 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563e67866240 con 0x563e678b3470 2024-05-08T08:47:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b69600700 10 client.18606 handle_command_reply: tid=0 2024-05-08T08:47:42.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b90fa6b80 1 client.18606 shutdown 2024-05-08T08:47:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2462142870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789f1b0 msgr2=0x563e678a3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789f1b0 0x563e678a3470 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f4b78007a80 tx=0x7f4b78007e40 comp rx=0 tx=0).stop 2024-05-08T08:47:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2462142870 shutdown_connections 2024-05-08T08:47:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e678b3470 0x563e678b5860 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789f1b0 0x563e678a3470 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 0x563e678a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2462142870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 0x563e678a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b69600700 0 client.18606 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:47:42.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.619+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2462142870 >> 172.21.15.70:0/2462142870 conn(0x563e678117d0 msgr2=0x563e6788eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:42.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.620+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2462142870 shutdown_connections 2024-05-08T08:47:42.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.620+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2462142870 wait complete. 2024-05-08T08:47:42.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.620+0000 7f4b90fa6b80 20 client.18606 trim_cache size 0 max 16384 2024-05-08T08:47:42.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.642+0000 7f4b90fa6b80 1 Processor -- start 2024-05-08T08:47:42.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.642+0000 7f4b90fa6b80 1 -- start start 2024-05-08T08:47:42.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.642+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 0x563e678af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.642+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789a140 0x563e6789e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.642+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 0x563e678bb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.642+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801b3fe0 con 0x563e6789a140 2024-05-08T08:47:42.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.642+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801b1870 con 0x563e67899780 2024-05-08T08:47:42.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.642+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801af6e0 con 0x563e6789f1b0 2024-05-08T08:47:42.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.642+0000 7f4b7ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789a140 0x563e6789e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.643+0000 7f4b7ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789a140 0x563e6789e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33996/0 (socket says 172.21.15.70:33996) 2024-05-08T08:47:42.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.643+0000 7f4b7ea00700 1 -- 172.21.15.70:0/44024687 learned_addr learned my addr 172.21.15.70:0/44024687 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:47:42.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.643+0000 7f4b7fe00700 1 --2- 172.21.15.70:0/44024687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 0x563e678bb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.643+0000 7f4b7f400700 1 --2- 172.21.15.70:0/44024687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 0x563e678af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.643+0000 7f4b7ea00700 1 -- 172.21.15.70:0/44024687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 msgr2=0x563e678bb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:47:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.643+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/44024687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 0x563e678bb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.643+0000 7f4b7ea00700 1 -- 172.21.15.70:0/44024687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 msgr2=0x563e678af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:47:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.643+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/44024687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 0x563e678af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.643+0000 7f4b7ea00700 1 -- 172.21.15.70:0/44024687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e67899f60 con 0x563e6789a140 2024-05-08T08:47:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.644+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/44024687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789a140 0x563e6789e790 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0098e0 tx=0x7f4b6c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a551a9de138a6af0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:47:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.644+0000 7f4b6be00700 1 -- 172.21.15.70:0/44024687 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c00f8f0 con 0x563e6789a140 2024-05-08T08:47:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.644+0000 7f4b6be00700 1 -- 172.21.15.70:0/44024687 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b6c032040 con 0x563e6789a140 2024-05-08T08:47:42.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.644+0000 7f4b6be00700 1 -- 172.21.15.70:0/44024687 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c023cd0 con 0x563e6789a140 2024-05-08T08:47:42.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.645+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/44024687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789a140 msgr2=0x563e6789e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:42.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.645+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/44024687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789a140 0x563e6789e790 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0098e0 tx=0x7f4b6c005b00 comp rx=0 tx=0).stop 2024-05-08T08:47:42.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.645+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/44024687 shutdown_connections 2024-05-08T08:47:42.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.645+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/44024687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789f1b0 0x563e678bb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.645+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/44024687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e67899780 0x563e678af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.645+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/44024687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e6789a140 0x563e6789e790 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.645+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/44024687 >> 172.21.15.70:0/44024687 conn(0x563e678117d0 msgr2=0x563e67899000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:42.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.645+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/44024687 shutdown_connections 2024-05-08T08:47:42.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.645+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/44024687 wait complete. 2024-05-08T08:47:42.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.646+0000 7f4b90fa6b80 1 -- start start 2024-05-08T08:47:42.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.646+0000 7f4b90fa6b80 1 Processor -- start 2024-05-08T08:47:42.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.646+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e678a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.646+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 0x563e678a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.646+0000 7f4b90fa6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789f1b0 0x563e6791dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.646+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801afd30 con 0x563e67899780 2024-05-08T08:47:42.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.646+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801b11a0 con 0x563e6789f1b0 2024-05-08T08:47:42.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.646+0000 7f4b90fa6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4b801b0400 con 0x563e6789a140 2024-05-08T08:47:42.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b90fa6b80 10 client.0 _ll_register_callbacks cb 0x563e67792d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:47:42.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e678a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e678a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34004/0 (socket says 172.21.15.70:34004) 2024-05-08T08:47:42.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7f400700 1 -- 172.21.15.70:0/2682458911 learned_addr learned my addr 172.21.15.70:0/2682458911 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:47:42.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 0x563e678a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7fe00700 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789f1b0 0x563e6791dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7f400700 1 -- 172.21.15.70:0/2682458911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 msgr2=0x563e678a6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7f400700 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 0x563e678a6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7f400700 1 -- 172.21.15.70:0/2682458911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789f1b0 msgr2=0x563e6791dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7f400700 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789f1b0 0x563e6791dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7f400700 1 -- 172.21.15.70:0/2682458911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e6791e240 con 0x563e67899780 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.647+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 0x563e678a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.648+0000 7f4b7f400700 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e678a68e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f4b700a93f0 tx=0x7f4b70010840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5627fc45608588 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.648+0000 7f4b69600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.648+0000 7f4b69600700 1 -- 172.21.15.70:0/2682458911 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70014020 con 0x563e67899780 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.648+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2682458911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b6c032040 con 0x563e67899780 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.648+0000 7f4b69600700 1 -- 172.21.15.70:0/2682458911 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(319..319 src has 1..319) ==== 9583+0+0 (secure 0 0 0) 0x7f4b700b0be0 con 0x563e67899780 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.648+0000 7f4b69600700 1 -- 172.21.15.70:0/2682458911 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4b70020070 con 0x563e67899780 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.648+0000 7f4b90fa6b80 10 client.18612 fetch_fsmap learned FSMap version 42 2024-05-08T08:47:42.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.648+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2682458911 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563e6791f3f0 con 0x563e67899780 2024-05-08T08:47:42.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.649+0000 7f4b69600700 1 -- 172.21.15.70:0/2682458911 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b6c032040 con 0x563e67899780 2024-05-08T08:47:42.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.649+0000 7f4b69600700 1 -- 172.21.15.70:0/2682458911 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4b700a3bd0 con 0x563e67899780 2024-05-08T08:47:42.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.649+0000 7f4b90fa6b80 10 client.18612 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:47:42.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.649+0000 7f4b90fa6b80 10 client.18612 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:47:42.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.649+0000 7f4b90fa6b80 20 client.18612 populate_metadata read hostname 'smithi070' 2024-05-08T08:47:42.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.649+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e6791fb00 0x563e67921f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:47:42.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.649+0000 7f4b90fa6b80 4 client.18612 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8864594c", "release": true, "await": true}] 2024-05-08T08:47:42.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.649+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2682458911 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8864594c", "release": true, "await": true}) -- 0x563e677f9500 con 0x563e6791fb00 2024-05-08T08:47:42.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.650+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e6791fb00 0x563e67921f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:47:42.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.651+0000 7f4b69600700 10 client.18612 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:47:42.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:42.651+0000 7f4b7ea00700 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e6791fb00 0x563e67921f20 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=add551f5e89d529c server_cookie=b0d9e3eb1e9fe586 in_seq=0 out_seq=0 2024-05-08T08:47:43.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:43 smithi194 ceph-mon[33679]: pgmap v3862: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T08:47:43.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:43 smithi070 ceph-mon[29591]: pgmap v3862: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T08:47:43.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:43 smithi172 ceph-mon[33377]: pgmap v3862: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T08:47:45.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:45 smithi194 ceph-mon[33679]: pgmap v3863: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T08:47:45.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:45 smithi070 ceph-mon[29591]: pgmap v3863: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T08:47:45.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:45 smithi172 ceph-mon[33377]: pgmap v3863: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T08:47:47.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.210+0000 7f4b69600700 1 -- 172.21.15.70:0/2682458911 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x563e677f9500 con 0x563e6791fb00 2024-05-08T08:47:47.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.210+0000 7f4b69600700 10 client.18612 handle_command_reply: tid=0 2024-05-08T08:47:47.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.210+0000 7f4b90fa6b80 1 client.18612 shutdown 2024-05-08T08:47:47.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.211+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2682458911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 msgr2=0x563e678a68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.211+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e678a68e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f4b700a93f0 tx=0x7f4b70010840 comp rx=0 tx=0).stop 2024-05-08T08:47:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.211+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2682458911 shutdown_connections 2024-05-08T08:47:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.211+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e6791fb00 0x563e67921f20 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.211+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e6789f1b0 0x563e6791dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.211+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e67899780 0x563e678a68e0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.211+0000 7f4b90fa6b80 1 --2- 172.21.15.70:0/2682458911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e6789a140 0x563e678a6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.211+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2682458911 >> 172.21.15.70:0/2682458911 conn(0x563e678117d0 msgr2=0x563e67899000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:47.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.211+0000 7f4b69600700 0 client.18612 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:47:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.213+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2682458911 shutdown_connections 2024-05-08T08:47:47.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.213+0000 7f4b90fa6b80 1 -- 172.21.15.70:0/2682458911 wait complete. 2024-05-08T08:47:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.213+0000 7f4b90fa6b80 20 client.18612 trim_cache size 0 max 16384 2024-05-08T08:47:47.209 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:47:47.209 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:47:47.209 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 272, 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "8864594c": { 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 272, 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.0, 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:47:47.210 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:47:47.211 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.214+0000 7f4b86600700 1 -- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b640b29f0 msgr2=0x7f4b640b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.214+0000 7f4b86600700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b640b29f0 0x7f4b640b4eb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c00b5c0 tx=0x7f4b6c01a040 comp rx=0 tx=0).stop 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.214+0000 7f4b86600700 1 -- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 msgr2=0x7f4b801a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.215+0000 7f4b86600700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 0x7f4b801a1900 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f4b7000d950 tx=0x7f4b7000dd10 comp rx=0 tx=0).stop 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.215+0000 7f4b86600700 1 -- 172.21.15.70:0/2186351966 shutdown_connections 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.215+0000 7f4b86600700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4b640b29f0 0x7f4b640b4eb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.215+0000 7f4b86600700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4b8010b6c0 0x7f4b8019bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.215+0000 7f4b86600700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801056c0 0x7f4b801a1900 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.215+0000 7f4b86600700 1 --2- 172.21.15.70:0/2186351966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b80106080 0x7f4b801a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:47:47.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.215+0000 7f4b86600700 1 -- 172.21.15.70:0/2186351966 >> 172.21.15.70:0/2186351966 conn(0x7f4b801011b0 msgr2=0x7f4b80101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:47:47.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.215+0000 7f4b86600700 1 -- 172.21.15.70:0/2186351966 shutdown_connections 2024-05-08T08:47:47.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:47:47.216+0000 7f4b86600700 1 -- 172.21.15.70:0/2186351966 wait complete. 2024-05-08T08:47:47.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:47 smithi194 ceph-mon[33679]: pgmap v3864: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:47:47.595 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:47 smithi070 ceph-mon[29591]: pgmap v3864: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:47:47.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:47 smithi172 ceph-mon[33377]: pgmap v3864: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:47:48.392 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8864594c', seconds elapsed: 65.0 2024-05-08T08:47:49.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:49 smithi194 ceph-mon[33679]: pgmap v3865: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:47:49.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:49 smithi070 ceph-mon[29591]: pgmap v3865: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:47:49.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:49 smithi172 ceph-mon[33377]: pgmap v3865: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:47:49.843 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/inet6_hashtables.o 2024-05-08T08:47:49.895 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio_input.o 2024-05-08T08:47:49.994 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/pci_irq.o 2024-05-08T08:47:50.543 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/mac80211/built-in.a 2024-05-08T08:47:50.565 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_lpss.o 2024-05-08T08:47:50.645 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/ipconfig.o 2024-05-08T08:47:50.982 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/sysctl_net.o 2024-05-08T08:47:51.178 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_apd.o 2024-05-08T08:47:51.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:51 smithi194 ceph-mon[33679]: pgmap v3866: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 185 KiB/s wr, 16 op/s 2024-05-08T08:47:51.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:51 smithi070 ceph-mon[29591]: pgmap v3866: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 185 KiB/s wr, 16 op/s 2024-05-08T08:47:51.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:51 smithi172 ceph-mon[33377]: pgmap v3866: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 185 KiB/s wr, 16 op/s 2024-05-08T08:47:52.389 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_platform.o 2024-05-08T08:47:53.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:53 smithi194 ceph-mon[33679]: pgmap v3867: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 185 KiB/s wr, 14 op/s 2024-05-08T08:47:53.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:53 smithi070 ceph-mon[29591]: pgmap v3867: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 185 KiB/s wr, 14 op/s 2024-05-08T08:47:53.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:53 smithi172 ceph-mon[33377]: pgmap v3867: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 185 KiB/s wr, 14 op/s 2024-05-08T08:47:55.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:55 smithi194 ceph-mon[33679]: pgmap v3868: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 592 KiB/s wr, 30 op/s 2024-05-08T08:47:55.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:55 smithi070 ceph-mon[29591]: pgmap v3868: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 592 KiB/s wr, 30 op/s 2024-05-08T08:47:55.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:55 smithi172 ceph-mon[33377]: pgmap v3868: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 524 KiB/s rd, 592 KiB/s wr, 30 op/s 2024-05-08T08:47:57.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:57 smithi194 ceph-mon[33679]: pgmap v3869: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 592 KiB/s wr, 27 op/s 2024-05-08T08:47:57.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:57 smithi070 ceph-mon[29591]: pgmap v3869: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 592 KiB/s wr, 27 op/s 2024-05-08T08:47:57.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:57 smithi172 ceph-mon[33377]: pgmap v3869: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 592 KiB/s wr, 27 op/s 2024-05-08T08:47:59.082 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/virtio/virtio_dma_buf.o 2024-05-08T08:47:59.402 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/vt/vt_ioctl.o 2024-05-08T08:47:59.506 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:47:59 smithi194 ceph-mon[33679]: pgmap v3870: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 592 KiB/s wr, 27 op/s 2024-05-08T08:47:59.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:47:59 smithi070 ceph-mon[29591]: pgmap v3870: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 592 KiB/s wr, 27 op/s 2024-05-08T08:47:59.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:47:59 smithi172 ceph-mon[33377]: pgmap v3870: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 592 KiB/s wr, 27 op/s 2024-05-08T08:47:59.848 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/vt/vc_screen.o 2024-05-08T08:48:01.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:01 smithi194 ceph-mon[33679]: pgmap v3871: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 777 KiB/s wr, 36 op/s 2024-05-08T08:48:01.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:01 smithi070 ceph-mon[29591]: pgmap v3871: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 777 KiB/s wr, 36 op/s 2024-05-08T08:48:01.665 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/hvc/hvc_console.o 2024-05-08T08:48:01.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:01 smithi172 ceph-mon[33377]: pgmap v3871: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 777 KiB/s wr, 36 op/s 2024-05-08T08:48:02.474 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_pnp.o 2024-05-08T08:48:03.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:03 smithi070 ceph-mon[29591]: pgmap v3872: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 592 KiB/s wr, 24 op/s 2024-05-08T08:48:03.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:03 smithi172 ceph-mon[33377]: pgmap v3872: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 592 KiB/s wr, 24 op/s 2024-05-08T08:48:03.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:03 smithi194 ceph-mon[33679]: pgmap v3872: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 592 KiB/s wr, 24 op/s 2024-05-08T08:48:04.315 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv6/mcast_snoop.o 2024-05-08T08:48:04.487 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/vt/selection.o 2024-05-08T08:48:05.402 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/netfilter.o 2024-05-08T08:48:05.560 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:05 smithi194 ceph-mon[33679]: pgmap v3873: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 955 KiB/s wr, 58 op/s 2024-05-08T08:48:05.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:05 smithi070 ceph-mon[29591]: pgmap v3873: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 955 KiB/s wr, 58 op/s 2024-05-08T08:48:05.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:05 smithi172 ceph-mon[33377]: pgmap v3873: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 955 KiB/s wr, 58 op/s 2024-05-08T08:48:07.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:07 smithi070 ceph-mon[29591]: pgmap v3874: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 548 KiB/s wr, 42 op/s 2024-05-08T08:48:07.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:07 smithi172 ceph-mon[33377]: pgmap v3874: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 548 KiB/s wr, 42 op/s 2024-05-08T08:48:07.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:07 smithi194 ceph-mon[33679]: pgmap v3874: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 548 KiB/s wr, 42 op/s 2024-05-08T08:48:08.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:08 smithi070 ceph-mon[29591]: osdmap e320: 12 total, 12 up, 12 in 2024-05-08T08:48:08.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:08 smithi172 ceph-mon[33377]: osdmap e320: 12 total, 12 up, 12 in 2024-05-08T08:48:08.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:08 smithi194 ceph-mon[33679]: osdmap e320: 12 total, 12 up, 12 in 2024-05-08T08:48:09.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:09 smithi070 ceph-mon[29591]: pgmap v3876: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 658 KiB/s wr, 50 op/s 2024-05-08T08:48:09.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:09 smithi172 ceph-mon[33377]: pgmap v3876: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 658 KiB/s wr, 50 op/s 2024-05-08T08:48:09.695 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/power.o 2024-05-08T08:48:09.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:09 smithi194 ceph-mon[33679]: pgmap v3876: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 658 KiB/s wr, 50 op/s 2024-05-08T08:48:09.857 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/virtio/built-in.a 2024-05-08T08:48:10.343 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/hw_random/core.o 2024-05-08T08:48:10.445 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/agp/backend.o 2024-05-08T08:48:11.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:11 smithi070 ceph-mon[29591]: pgmap v3877: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 872 KiB/s wr, 51 op/s 2024-05-08T08:48:11.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:11 smithi070 ceph-mon[29591]: osdmap e321: 12 total, 12 up, 12 in 2024-05-08T08:48:11.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:11 smithi172 ceph-mon[33377]: pgmap v3877: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 872 KiB/s wr, 51 op/s 2024-05-08T08:48:11.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:11 smithi172 ceph-mon[33377]: osdmap e321: 12 total, 12 up, 12 in 2024-05-08T08:48:11.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:11 smithi194 ceph-mon[33679]: pgmap v3877: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 872 KiB/s wr, 51 op/s 2024-05-08T08:48:11.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:11 smithi194 ceph-mon[33679]: osdmap e321: 12 total, 12 up, 12 in 2024-05-08T08:48:13.342 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/tty/hvc/built-in.a 2024-05-08T08:48:13.527 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/vt/keyboard.o 2024-05-08T08:48:13.545 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/mem.o 2024-05-08T08:48:13.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:13 smithi070 ceph-mon[29591]: pgmap v3879: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 546 KiB/s wr, 13 op/s 2024-05-08T08:48:13.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:13 smithi172 ceph-mon[33377]: pgmap v3879: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 546 KiB/s wr, 13 op/s 2024-05-08T08:48:13.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:13 smithi194 ceph-mon[33679]: pgmap v3879: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 546 KiB/s wr, 13 op/s 2024-05-08T08:48:13.757 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/amd/iommu.o 2024-05-08T08:48:15.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:15 smithi070 ceph-mon[29591]: pgmap v3880: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 929 KiB/s wr, 74 op/s 2024-05-08T08:48:15.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:15 smithi172 ceph-mon[33377]: pgmap v3880: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 929 KiB/s wr, 74 op/s 2024-05-08T08:48:15.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:15 smithi194 ceph-mon[33679]: pgmap v3880: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 929 KiB/s wr, 74 op/s 2024-05-08T08:48:16.051 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/ipv6/built-in.a 2024-05-08T08:48:16.926 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/event.o 2024-05-08T08:48:17.441 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/tcp_cubic.o 2024-05-08T08:48:17.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:17 smithi070 ceph-mon[29591]: pgmap v3881: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 861 KiB/s wr, 68 op/s 2024-05-08T08:48:17.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:17 smithi172 ceph-mon[33377]: pgmap v3881: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 861 KiB/s wr, 68 op/s 2024-05-08T08:48:17.756 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:17 smithi194 ceph-mon[33679]: pgmap v3881: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 861 KiB/s wr, 68 op/s 2024-05-08T08:48:18.346 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/hw_random/via-rng.o 2024-05-08T08:48:18.531 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/cipso_ipv4.o 2024-05-08T08:48:19.181 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/agp/generic.o 2024-05-08T08:48:19.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:19 smithi070 ceph-mon[29591]: pgmap v3882: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 743 KiB/s wr, 59 op/s 2024-05-08T08:48:19.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:19 smithi172 ceph-mon[33377]: pgmap v3882: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 743 KiB/s wr, 59 op/s 2024-05-08T08:48:19.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:19 smithi194 ceph-mon[33679]: pgmap v3882: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 743 KiB/s wr, 59 op/s 2024-05-08T08:48:21.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:21 smithi070 ceph-mon[29591]: pgmap v3883: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 691 KiB/s wr, 63 op/s 2024-05-08T08:48:21.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:21 smithi172 ceph-mon[33377]: pgmap v3883: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 691 KiB/s wr, 63 op/s 2024-05-08T08:48:21.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:21 smithi194 ceph-mon[33679]: pgmap v3883: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 691 KiB/s wr, 63 op/s 2024-05-08T08:48:23.363 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/vt/consolemap.o 2024-05-08T08:48:23.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:23 smithi070 ceph-mon[29591]: pgmap v3884: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 621 KiB/s wr, 57 op/s 2024-05-08T08:48:23.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:23 smithi172 ceph-mon[33377]: pgmap v3884: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 621 KiB/s wr, 57 op/s 2024-05-08T08:48:23.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:23 smithi194 ceph-mon[33679]: pgmap v3884: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 621 KiB/s wr, 57 op/s 2024-05-08T08:48:23.854 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_core.o 2024-05-08T08:48:24.055 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/amd/init.o 2024-05-08T08:48:24.886 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/char/hw_random/built-in.a 2024-05-08T08:48:25.153 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/amd/quirks.o 2024-05-08T08:48:25.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:25 smithi070 ceph-mon[29591]: pgmap v3885: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 810 KiB/s wr, 70 op/s 2024-05-08T08:48:25.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:25 smithi172 ceph-mon[33377]: pgmap v3885: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 810 KiB/s wr, 70 op/s 2024-05-08T08:48:25.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:25 smithi194 ceph-mon[33679]: pgmap v3885: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 810 KiB/s wr, 70 op/s 2024-05-08T08:48:27.326 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/evged.o 2024-05-08T08:48:27.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:27 smithi070 ceph-mon[29591]: pgmap v3886: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 554 KiB/s wr, 29 op/s 2024-05-08T08:48:27.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:27 smithi172 ceph-mon[33377]: pgmap v3886: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 554 KiB/s wr, 29 op/s 2024-05-08T08:48:27.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:27 smithi194 ceph-mon[33679]: pgmap v3886: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 554 KiB/s wr, 29 op/s 2024-05-08T08:48:27.969 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/agp/isoch.o 2024-05-08T08:48:29.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:29 smithi070 ceph-mon[29591]: pgmap v3887: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 554 KiB/s wr, 29 op/s 2024-05-08T08:48:29.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:29 smithi172 ceph-mon[33377]: pgmap v3887: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 554 KiB/s wr, 29 op/s 2024-05-08T08:48:29.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:29 smithi194 ceph-mon[33679]: pgmap v3887: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 554 KiB/s wr, 29 op/s 2024-05-08T08:48:29.960 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/agp/amd64-agp.o 2024-05-08T08:48:31.484 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/xfrm4_policy.o 2024-05-08T08:48:31.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:31 smithi070 ceph-mon[29591]: pgmap v3888: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 791 KiB/s wr, 40 op/s 2024-05-08T08:48:31.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:31 smithi172 ceph-mon[33377]: pgmap v3888: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 791 KiB/s wr, 40 op/s 2024-05-08T08:48:31.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:31 smithi194 ceph-mon[33679]: pgmap v3888: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 791 KiB/s wr, 40 op/s 2024-05-08T08:48:32.435 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC drivers/tty/vt/conmakehash 2024-05-08T08:48:32.982 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/vt/vt.o 2024-05-08T08:48:33.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:33 smithi070 ceph-mon[29591]: pgmap v3889: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 471 KiB/s wr, 27 op/s 2024-05-08T08:48:33.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:33 smithi172 ceph-mon[33377]: pgmap v3889: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 471 KiB/s wr, 27 op/s 2024-05-08T08:48:33.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:33 smithi194 ceph-mon[33679]: pgmap v3889: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 471 KiB/s wr, 27 op/s 2024-05-08T08:48:33.875 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_pnp.o 2024-05-08T08:48:33.963 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/serial_core.o 2024-05-08T08:48:34.960 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/amd/io_pgtable.o 2024-05-08T08:48:35.008 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/sysfs.o 2024-05-08T08:48:35.624 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:35 smithi070 ceph-mon[29591]: pgmap v3890: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 862 KiB/s wr, 49 op/s 2024-05-08T08:48:35.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:35 smithi172 ceph-mon[33377]: pgmap v3890: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 862 KiB/s wr, 49 op/s 2024-05-08T08:48:35.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:35 smithi194 ceph-mon[33679]: pgmap v3890: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 852 KiB/s rd, 862 KiB/s wr, 49 op/s 2024-05-08T08:48:36.601 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/property.o 2024-05-08T08:48:37.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:37 smithi070 ceph-mon[29591]: pgmap v3891: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 628 KiB/s wr, 32 op/s 2024-05-08T08:48:37.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:37 smithi172 ceph-mon[33377]: pgmap v3891: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 628 KiB/s wr, 32 op/s 2024-05-08T08:48:37.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:37 smithi194 ceph-mon[33679]: pgmap v3891: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 628 KiB/s wr, 32 op/s 2024-05-08T08:48:38.685 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/agp/intel-agp.o 2024-05-08T08:48:39.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:39 smithi070 ceph-mon[29591]: pgmap v3892: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 628 KiB/s wr, 32 op/s 2024-05-08T08:48:39.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:48:39.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:39 smithi172 ceph-mon[33377]: pgmap v3892: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 628 KiB/s wr, 32 op/s 2024-05-08T08:48:39.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:48:39.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:39 smithi194 ceph-mon[33679]: pgmap v3892: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 628 KiB/s wr, 32 op/s 2024-05-08T08:48:39.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:48:41.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:41 smithi172 ceph-mon[33377]: pgmap v3893: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 905 KiB/s wr, 40 op/s 2024-05-08T08:48:41.675 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:41.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:41.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:41 smithi194 ceph-mon[33679]: pgmap v3893: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 905 KiB/s wr, 40 op/s 2024-05-08T08:48:41.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:41.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:41.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:41 smithi070 ceph-mon[29591]: pgmap v3893: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 905 KiB/s wr, 40 op/s 2024-05-08T08:48:41.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:41.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:42.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:42.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:42.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:48:42.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:48:42.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:42.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:42.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:42.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:48:42.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:48:42.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:42.763 INFO:tasks.workunit.client.0.smithi070.stdout: COPY drivers/tty/vt/defkeymap.c 2024-05-08T08:48:42.840 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/serial_base_bus.o 2024-05-08T08:48:42.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:42.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:42.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:48:42.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:48:42.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:48:43.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:43 smithi194 ceph-mon[33679]: pgmap v3894: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 668 KiB/s wr, 30 op/s 2024-05-08T08:48:43.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:43 smithi070 ceph-mon[29591]: pgmap v3894: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 668 KiB/s wr, 30 op/s 2024-05-08T08:48:43.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:43 smithi172 ceph-mon[33377]: pgmap v3894: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 668 KiB/s wr, 30 op/s 2024-05-08T08:48:44.139 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_port.o 2024-05-08T08:48:44.350 INFO:tasks.workunit.client.0.smithi070.stdout: CONMK drivers/tty/vt/consolemap_deftbl.c 2024-05-08T08:48:44.397 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/vt/defkeymap.o 2024-05-08T08:48:44.469 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/xfrm4_state.o 2024-05-08T08:48:44.491 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/amd/io_pgtable_v2.o 2024-05-08T08:48:44.551 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/xfrm4_input.o 2024-05-08T08:48:44.719 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_cmos_rtc.o 2024-05-08T08:48:45.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:45 smithi194 ceph-mon[33679]: pgmap v3895: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 1002 KiB/s wr, 46 op/s 2024-05-08T08:48:45.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:45 smithi070 ceph-mon[29591]: pgmap v3895: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 1002 KiB/s wr, 46 op/s 2024-05-08T08:48:45.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:45 smithi172 ceph-mon[33377]: pgmap v3895: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 927 KiB/s rd, 1002 KiB/s wr, 46 op/s 2024-05-08T08:48:47.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:47 smithi194 ceph-mon[33679]: pgmap v3896: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 615 KiB/s wr, 25 op/s 2024-05-08T08:48:47.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:47 smithi070 ceph-mon[29591]: pgmap v3896: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 615 KiB/s wr, 25 op/s 2024-05-08T08:48:47.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:47 smithi172 ceph-mon[33377]: pgmap v3896: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 615 KiB/s wr, 25 op/s 2024-05-08T08:48:49.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:49 smithi194 ceph-mon[33679]: pgmap v3897: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 615 KiB/s wr, 25 op/s 2024-05-08T08:48:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:49 smithi070 ceph-mon[29591]: pgmap v3897: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 615 KiB/s wr, 25 op/s 2024-05-08T08:48:49.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:49 smithi172 ceph-mon[33377]: pgmap v3897: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 615 KiB/s wr, 25 op/s 2024-05-08T08:48:51.128 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/agp/intel-gtt.o 2024-05-08T08:48:51.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:51 smithi194 ceph-mon[33679]: pgmap v3898: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 866 KiB/s wr, 37 op/s 2024-05-08T08:48:51.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:51 smithi070 ceph-mon[29591]: pgmap v3898: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 866 KiB/s wr, 37 op/s 2024-05-08T08:48:51.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:51 smithi172 ceph-mon[33377]: pgmap v3898: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 866 KiB/s wr, 37 op/s 2024-05-08T08:48:52.601 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/x86/apple.o 2024-05-08T08:48:52.770 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/vt/consolemap_deftbl.o 2024-05-08T08:48:53.282 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/tty/vt/built-in.a 2024-05-08T08:48:53.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:53 smithi194 ceph-mon[33679]: pgmap v3899: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 588 KiB/s wr, 29 op/s 2024-05-08T08:48:53.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:53 smithi070 ceph-mon[29591]: pgmap v3899: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 588 KiB/s wr, 29 op/s 2024-05-08T08:48:53.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:53 smithi172 ceph-mon[33377]: pgmap v3899: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 588 KiB/s wr, 29 op/s 2024-05-08T08:48:54.044 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/host1x/built-in.a 2024-05-08T08:48:54.864 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/tests/built-in.a 2024-05-08T08:48:55.072 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/arm/built-in.a 2024-05-08T08:48:55.322 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/display/drm_display_helper_mod.o 2024-05-08T08:48:55.729 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:55 smithi172 ceph-mon[33377]: pgmap v3900: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 876 KiB/s wr, 38 op/s 2024-05-08T08:48:55.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:55 smithi194 ceph-mon[33679]: pgmap v3900: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 876 KiB/s wr, 38 op/s 2024-05-08T08:48:55.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:55 smithi070 ceph-mon[29591]: pgmap v3900: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 876 KiB/s wr, 38 op/s 2024-05-08T08:48:57.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:57 smithi194 ceph-mon[33679]: pgmap v3901: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 548 KiB/s wr, 25 op/s 2024-05-08T08:48:57.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:57 smithi070 ceph-mon[29591]: pgmap v3901: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 548 KiB/s wr, 25 op/s 2024-05-08T08:48:57.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:57 smithi172 ceph-mon[33377]: pgmap v3901: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 548 KiB/s wr, 25 op/s 2024-05-08T08:48:58.018 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/iommu/amd/built-in.a 2024-05-08T08:48:58.063 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_tt.o 2024-05-08T08:48:58.537 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/intel/dmar.o 2024-05-08T08:48:59.111 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_dma.o 2024-05-08T08:48:59.150 INFO:tasks.quiescer.fs.[cephfs]:Total duration (57.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:48:59.151 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.75 2024-05-08T08:48:59.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:48:59.724 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:48:59.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:48:59 smithi194 ceph-mon[33679]: pgmap v3902: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 545 KiB/s wr, 25 op/s 2024-05-08T08:48:59.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:48:59 smithi070 ceph-mon[29591]: pgmap v3902: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 545 KiB/s wr, 25 op/s 2024-05-08T08:48:59.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:48:59 smithi172 ceph-mon[33377]: pgmap v3902: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 545 KiB/s wr, 25 op/s 2024-05-08T08:49:00.173 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/x86/utils.o 2024-05-08T08:49:00.521 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/char/agp/built-in.a 2024-05-08T08:49:01.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:01 smithi194 ceph-mon[33679]: pgmap v3903: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 790 KiB/s wr, 40 op/s 2024-05-08T08:49:01.767 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:01 smithi070 ceph-mon[29591]: pgmap v3903: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 790 KiB/s wr, 40 op/s 2024-05-08T08:49:01.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:01 smithi172 ceph-mon[33377]: pgmap v3903: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 790 KiB/s wr, 40 op/s 2024-05-08T08:49:01.934 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/random.o 2024-05-08T08:49:02.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.180+0000 7f42b1e00700 1 -- 172.21.15.70:0/3454934733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac0756d0 msgr2=0x7f42ac075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:02.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.180+0000 7f42b1e00700 1 --2- 172.21.15.70:0/3454934733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac0756d0 0x7f42ac075ab0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f429c009990 tx=0x7f429c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.180+0000 7f42b1e00700 1 -- 172.21.15.70:0/3454934733 shutdown_connections 2024-05-08T08:49:02.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.180+0000 7f42b1e00700 1 --2- 172.21.15.70:0/3454934733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42ac10fea0 0x7f42ac112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.180+0000 7f42b1e00700 1 --2- 172.21.15.70:0/3454934733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac0756d0 0x7f42ac075ab0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.180+0000 7f42b1e00700 1 --2- 172.21.15.70:0/3454934733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ac075ff0 0x7f42ac10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.180+0000 7f42b1e00700 1 -- 172.21.15.70:0/3454934733 >> 172.21.15.70:0/3454934733 conn(0x7f42ac07a600 msgr2=0x7f42ac07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:49:02.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.181+0000 7f42b1e00700 1 -- 172.21.15.70:0/3454934733 shutdown_connections 2024-05-08T08:49:02.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.181+0000 7f42b1e00700 1 -- 172.21.15.70:0/3454934733 wait complete. 2024-05-08T08:49:02.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.182+0000 7f42b1e00700 1 Processor -- start 2024-05-08T08:49:02.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.183+0000 7f42b1e00700 1 -- start start 2024-05-08T08:49:02.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.183+0000 7f42b1e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ac0756d0 0x7f42ac1035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:02.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.183+0000 7f42b1e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42ac075ff0 0x7f42ac103b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:02.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.183+0000 7f42b1e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac10fea0 0x7f42ac104040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:02.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.183+0000 7f42b1e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac115790 con 0x7f42ac10fea0 2024-05-08T08:49:02.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.183+0000 7f42b1e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac115610 con 0x7f42ac075ff0 2024-05-08T08:49:02.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.183+0000 7f42b1e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac115910 con 0x7f42ac0756d0 2024-05-08T08:49:02.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.184+0000 7f42ab400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac10fea0 0x7f42ac104040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:02.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.184+0000 7f42ab400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac10fea0 0x7f42ac104040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58566/0 (socket says 172.21.15.70:58566) 2024-05-08T08:49:02.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.184+0000 7f42ab400700 1 -- 172.21.15.70:0/599837000 learned_addr learned my addr 172.21.15.70:0/599837000 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:49:02.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.184+0000 7f42aaa00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ac0756d0 0x7f42ac1035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:02.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.184+0000 7f42aa000700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42ac075ff0 0x7f42ac103b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:02.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.184+0000 7f42ab400700 1 -- 172.21.15.70:0/599837000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ac0756d0 msgr2=0x7f42ac1035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:02.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.184+0000 7f42ab400700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ac0756d0 0x7f42ac1035c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.185+0000 7f42ab400700 1 -- 172.21.15.70:0/599837000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42ac075ff0 msgr2=0x7f42ac103b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:02.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.185+0000 7f42ab400700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42ac075ff0 0x7f42ac103b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.185+0000 7f42ab400700 1 -- 172.21.15.70:0/599837000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac1ac400 con 0x7f42ac10fea0 2024-05-08T08:49:02.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.185+0000 7f42aa000700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42ac075ff0 0x7f42ac103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:49:02.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.185+0000 7f42ab400700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac10fea0 0x7f42ac104040 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f42a4007ee0 tx=0x7f42a400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:49:02.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.186+0000 7f42b0a00700 1 -- 172.21.15.70:0/599837000 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a400ddd0 con 0x7f42ac10fea0 2024-05-08T08:49:02.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.186+0000 7f42b0a00700 1 -- 172.21.15.70:0/599837000 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42a4004020 con 0x7f42ac10fea0 2024-05-08T08:49:02.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.186+0000 7f42b0a00700 1 -- 172.21.15.70:0/599837000 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a4015660 con 0x7f42ac10fea0 2024-05-08T08:49:02.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.186+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac1ac6f0 con 0x7f42ac10fea0 2024-05-08T08:49:02.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.186+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac1acbe0 con 0x7f42ac10fea0 2024-05-08T08:49:02.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.188+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ac076dc0 con 0x7f42ac10fea0 2024-05-08T08:49:02.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.191+0000 7f42b0a00700 1 -- 172.21.15.70:0/599837000 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f42a40041d0 con 0x7f42ac10fea0 2024-05-08T08:49:02.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.193+0000 7f42b0a00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42900b2aa0 0x7f42900b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:02.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.193+0000 7f42b0a00700 1 -- 172.21.15.70:0/599837000 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(321..321 src has 1..321) ==== 9583+0+0 (secure 0 0 0) 0x7f42a40e24b0 con 0x7f42ac10fea0 2024-05-08T08:49:02.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.193+0000 7f42aaa00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42900b2aa0 0x7f42900b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:02.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.195+0000 7f42aaa00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42900b2aa0 0x7f42900b4f60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f429c00b5c0 tx=0x7f429c009630 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:49:02.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.199+0000 7f42b0a00700 1 -- 172.21.15.70:0/599837000 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f42a4010070 con 0x7f42ac10fea0 2024-05-08T08:49:02.405 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/vga/built-in.a 2024-05-08T08:49:02.575 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/misc.o 2024-05-08T08:49:02.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.678+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42ac02e510 con 0x7f42ac10fea0 2024-05-08T08:49:02.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.679+0000 7f42b0a00700 1 -- 172.21.15.70:0/599837000 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f42a40a9a10 con 0x7f42ac10fea0 2024-05-08T08:49:02.676 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:49:02.676 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:49:02.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42900b2aa0 msgr2=0x7f42900b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:02.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42900b2aa0 0x7f42900b4f60 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f429c00b5c0 tx=0x7f429c009630 comp rx=0 tx=0).stop 2024-05-08T08:49:02.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac10fea0 msgr2=0x7f42ac104040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:02.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac10fea0 0x7f42ac104040 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f42a4007ee0 tx=0x7f42a400d3b0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 shutdown_connections 2024-05-08T08:49:02.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42900b2aa0 0x7f42900b4f60 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42ac10fea0 0x7f42ac104040 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ac0756d0 0x7f42ac1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 --2- 172.21.15.70:0/599837000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f42ac075ff0 0x7f42ac103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:02.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 >> 172.21.15.70:0/599837000 conn(0x7f42ac07a600 msgr2=0x7f42ac1007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:49:02.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 shutdown_connections 2024-05-08T08:49:02.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:02.683+0000 7f42b1e00700 1 -- 172.21.15.70:0/599837000 wait complete. 2024-05-08T08:49:02.681 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:49:02.751 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/xfrm4_output.o 2024-05-08T08:49:02.781 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/display/drm_dp_dual_mode_helper.o 2024-05-08T08:49:02.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:02 smithi070 ceph-mon[29591]: pgmap v3904: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 540 KiB/s wr, 27 op/s 2024-05-08T08:49:02.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:02 smithi070 ceph-mon[29591]: osdmap e322: 12 total, 12 up, 12 in 2024-05-08T08:49:02.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:02 smithi172 ceph-mon[33377]: pgmap v3904: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 540 KiB/s wr, 27 op/s 2024-05-08T08:49:02.925 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:02 smithi172 ceph-mon[33377]: osdmap e322: 12 total, 12 up, 12 in 2024-05-08T08:49:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:02 smithi194 ceph-mon[33679]: pgmap v3904: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 540 KiB/s wr, 27 op/s 2024-05-08T08:49:03.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:02 smithi194 ceph-mon[33679]: osdmap e322: 12 total, 12 up, 12 in 2024-05-08T08:49:03.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:03 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/599837000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:49:03.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:03 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/599837000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:49:04.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:03 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/599837000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:49:04.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:04 smithi070 ceph-mon[29591]: pgmap v3906: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 709 KiB/s wr, 53 op/s 2024-05-08T08:49:04.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:04 smithi172 ceph-mon[33377]: pgmap v3906: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 709 KiB/s wr, 53 op/s 2024-05-08T08:49:05.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:04 smithi194 ceph-mon[33679]: pgmap v3906: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 709 KiB/s wr, 53 op/s 2024-05-08T08:49:07.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:06 smithi194 ceph-mon[33679]: pgmap v3907: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 709 KiB/s wr, 51 op/s 2024-05-08T08:49:07.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:06 smithi070 ceph-mon[29591]: pgmap v3907: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 709 KiB/s wr, 51 op/s 2024-05-08T08:49:07.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:06 smithi172 ceph-mon[33377]: pgmap v3907: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 709 KiB/s wr, 51 op/s 2024-05-08T08:49:08.579 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 88.75 --await-for 42.0' 2024-05-08T08:49:08.579 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 88.75 --await-for 42.0 2024-05-08T08:49:09.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:08 smithi194 ceph-mon[33679]: pgmap v3908: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 709 KiB/s wr, 51 op/s 2024-05-08T08:49:09.307 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:49:09.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:08 smithi070 ceph-mon[29591]: pgmap v3908: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 709 KiB/s wr, 51 op/s 2024-05-08T08:49:09.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:08 smithi172 ceph-mon[33377]: pgmap v3908: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 637 KiB/s rd, 709 KiB/s wr, 51 op/s 2024-05-08T08:49:09.900 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/x86/s2idle.o 2024-05-08T08:49:10.329 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_bo.o 2024-05-08T08:49:10.553 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_dwlib.o 2024-05-08T08:49:11.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:11 smithi070 ceph-mon[29591]: pgmap v3909: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 697 KiB/s wr, 49 op/s 2024-05-08T08:49:11.125 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:11 smithi070 ceph-mon[29591]: osdmap e323: 12 total, 12 up, 12 in 2024-05-08T08:49:11.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:11 smithi194 ceph-mon[33679]: pgmap v3909: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 697 KiB/s wr, 49 op/s 2024-05-08T08:49:11.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:11 smithi194 ceph-mon[33679]: osdmap e323: 12 total, 12 up, 12 in 2024-05-08T08:49:11.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:11 smithi172 ceph-mon[33377]: pgmap v3909: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 697 KiB/s wr, 49 op/s 2024-05-08T08:49:11.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:11 smithi172 ceph-mon[33377]: osdmap e323: 12 total, 12 up, 12 in 2024-05-08T08:49:11.943 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/intel/iommu.o 2024-05-08T08:49:12.244 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/display/drm_dp_helper.o 2024-05-08T08:49:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:12.999+0000 7f78d1200700 1 -- 172.21.15.70:0/3808058200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 msgr2=0x7f78cc1124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:12.999+0000 7f78d1200700 1 --2- 172.21.15.70:0/3808058200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 0x7f78cc1124a0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f78c400b0a0 tx=0x7f78c400b3b0 comp rx=0 tx=0).stop 2024-05-08T08:49:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:12.999+0000 7f78d1200700 1 -- 172.21.15.70:0/3808058200 shutdown_connections 2024-05-08T08:49:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:12.999+0000 7f78d1200700 1 --2- 172.21.15.70:0/3808058200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 0x7f78cc1124a0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:12.999+0000 7f78d1200700 1 --2- 172.21.15.70:0/3808058200 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78cc105840 0x7f78cc105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:12.999+0000 7f78d1200700 1 --2- 172.21.15.70:0/3808058200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78cc106160 0x7f78cc1070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:12.999+0000 7f78d1200700 1 -- 172.21.15.70:0/3808058200 >> 172.21.15.70:0/3808058200 conn(0x7f78cc100fb0 msgr2=0x7f78cc1033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:49:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:12.999+0000 7f78d1200700 1 -- 172.21.15.70:0/3808058200 shutdown_connections 2024-05-08T08:49:12.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.000+0000 7f78d1200700 1 -- 172.21.15.70:0/3808058200 wait complete. 2024-05-08T08:49:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.001+0000 7f78d1200700 1 Processor -- start 2024-05-08T08:49:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.001+0000 7f78d1200700 1 -- start start 2024-05-08T08:49:12.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.001+0000 7f78d1200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78cc105840 0x7f78cc1a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:12.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.001+0000 7f78d1200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78cc106160 0x7f78cc1a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:12.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.001+0000 7f78d1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 0x7f78cc19b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:12.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.001+0000 7f78d1200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc1156e0 con 0x7f78cc107810 2024-05-08T08:49:12.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.001+0000 7f78d1200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc115560 con 0x7f78cc105840 2024-05-08T08:49:12.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.001+0000 7f78d1200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78cc115860 con 0x7f78cc106160 2024-05-08T08:49:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.002+0000 7f78cbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 0x7f78cc19b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.002+0000 7f78cb400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78cc105840 0x7f78cc1a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.002+0000 7f78cbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 0x7f78cc19b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39964/0 (socket says 172.21.15.70:39964) 2024-05-08T08:49:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.002+0000 7f78cbe00700 1 -- 172.21.15.70:0/2321804376 learned_addr learned my addr 172.21.15.70:0/2321804376 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:49:12.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.002+0000 7f78caa00700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78cc106160 0x7f78cc1a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.003+0000 7f78cbe00700 1 -- 172.21.15.70:0/2321804376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78cc106160 msgr2=0x7f78cc1a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.003+0000 7f78cbe00700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78cc106160 0x7f78cc1a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.003+0000 7f78cbe00700 1 -- 172.21.15.70:0/2321804376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78cc105840 msgr2=0x7f78cc1a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.003+0000 7f78cbe00700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78cc105840 0x7f78cc1a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.003+0000 7f78cbe00700 1 -- 172.21.15.70:0/2321804376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78cc19c060 con 0x7f78cc107810 2024-05-08T08:49:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.003+0000 7f78cbe00700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 0x7f78cc19b900 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f78c400b070 tx=0x7f78c4004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:49:13.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.004+0000 7f78c3e00700 1 -- 172.21.15.70:0/2321804376 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c4021070 con 0x7f78cc107810 2024-05-08T08:49:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.004+0000 7f78d1200700 1 -- 172.21.15.70:0/2321804376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78cc19c2f0 con 0x7f78cc107810 2024-05-08T08:49:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.004+0000 7f78d1200700 1 -- 172.21.15.70:0/2321804376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78cc0778e0 con 0x7f78cc107810 2024-05-08T08:49:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.004+0000 7f78c3e00700 1 -- 172.21.15.70:0/2321804376 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78c4007b80 con 0x7f78cc107810 2024-05-08T08:49:13.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.004+0000 7f78c3e00700 1 -- 172.21.15.70:0/2321804376 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c401dd60 con 0x7f78cc107810 2024-05-08T08:49:13.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.014+0000 7f78c3e00700 1 -- 172.21.15.70:0/2321804376 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f78c4005040 con 0x7f78cc107810 2024-05-08T08:49:13.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.016+0000 7f78c3e00700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b00b2b20 0x7f78b00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.016+0000 7f78c3e00700 1 -- 172.21.15.70:0/2321804376 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(323..323 src has 1..323) ==== 9583+0+0 (secure 0 0 0) 0x7f78c40e4450 con 0x7f78cc107810 2024-05-08T08:49:13.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.017+0000 7f78cb400700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b00b2b20 0x7f78b00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.027+0000 7f78cb400700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b00b2b20 0x7f78b00b4fe0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f78cc19ca40 tx=0x7f78bc009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:49:13.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.030+0000 7f78dd156b80 1 Processor -- start 2024-05-08T08:49:13.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.030+0000 7f78dd156b80 1 -- start start 2024-05-08T08:49:13.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.030+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c5785133d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.030+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 0x55c57850d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.031+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c57850dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.031+0000 7f78dd156b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c57845fbb0 con 0x55c578512ff0 2024-05-08T08:49:13.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.031+0000 7f78dd156b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c5783fd8f0 con 0x55c57850db40 2024-05-08T08:49:13.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.031+0000 7f78dd156b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c57845bb70 con 0x55c578513910 2024-05-08T08:49:13.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.031+0000 7f78cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c5785133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.031+0000 7f78cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c5785133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39970/0 (socket says 172.21.15.70:39970) 2024-05-08T08:49:13.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.031+0000 7f78cb400700 1 -- 172.21.15.70:0/1060797124 learned_addr learned my addr 172.21.15.70:0/1060797124 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:49:13.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.031+0000 7f78caa00700 1 --2- 172.21.15.70:0/1060797124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 0x55c57850d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.031+0000 7f78cbe00700 1 --2- 172.21.15.70:0/1060797124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c57850dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.032+0000 7f78cb400700 1 -- 172.21.15.70:0/1060797124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 msgr2=0x55c57850d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:49:13.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.032+0000 7f78cb400700 1 --2- 172.21.15.70:0/1060797124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 0x55c57850d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.032+0000 7f78cb400700 1 -- 172.21.15.70:0/1060797124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 msgr2=0x55c57850dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:49:13.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.032+0000 7f78cb400700 1 --2- 172.21.15.70:0/1060797124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c57850dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.032+0000 7f78cb400700 1 -- 172.21.15.70:0/1060797124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5783aca60 con 0x55c578512ff0 2024-05-08T08:49:13.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.033+0000 7f78cb400700 1 --2- 172.21.15.70:0/1060797124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c5785133d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f78bc011d50 tx=0x7f78bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f096191bda405f03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:49:13.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.033+0000 7f78c0c00700 1 -- 172.21.15.70:0/1060797124 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc00eb20 con 0x55c578512ff0 2024-05-08T08:49:13.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.033+0000 7f78c0c00700 1 -- 172.21.15.70:0/1060797124 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78bc0044b0 con 0x55c578512ff0 2024-05-08T08:49:13.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.034+0000 7f78c0c00700 1 -- 172.21.15.70:0/1060797124 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc003e00 con 0x55c578512ff0 2024-05-08T08:49:13.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.035+0000 7f78dd156b80 1 -- 172.21.15.70:0/1060797124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 msgr2=0x55c5785133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:13.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.035+0000 7f78dd156b80 1 --2- 172.21.15.70:0/1060797124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c5785133d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f78bc011d50 tx=0x7f78bc014000 comp rx=0 tx=0).stop 2024-05-08T08:49:13.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.035+0000 7f78dd156b80 1 -- 172.21.15.70:0/1060797124 shutdown_connections 2024-05-08T08:49:13.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.035+0000 7f78dd156b80 1 --2- 172.21.15.70:0/1060797124 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c57850dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.035+0000 7f78dd156b80 1 --2- 172.21.15.70:0/1060797124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c5785133d0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.035+0000 7f78dd156b80 1 --2- 172.21.15.70:0/1060797124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 0x55c57850d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.035+0000 7f78dd156b80 1 -- 172.21.15.70:0/1060797124 >> 172.21.15.70:0/1060797124 conn(0x55c57843bcf0 msgr2=0x55c578508080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:49:13.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.035+0000 7f78dd156b80 1 -- 172.21.15.70:0/1060797124 shutdown_connections 2024-05-08T08:49:13.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.036+0000 7f78dd156b80 1 -- 172.21.15.70:0/1060797124 wait complete. 2024-05-08T08:49:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.036+0000 7f78dd156b80 1 -- start start 2024-05-08T08:49:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.036+0000 7f78dd156b80 1 Processor -- start 2024-05-08T08:49:13.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.037+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c578519560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.037+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 0x55c578516900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.037+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578513910 0x55c578516e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.037+0000 7f78dd156b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c57851a430 con 0x55c578513910 2024-05-08T08:49:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.037+0000 7f78dd156b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c5783c5cb0 con 0x55c57850db40 2024-05-08T08:49:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.037+0000 7f78dd156b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c57851a5b0 con 0x55c578512ff0 2024-05-08T08:49:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.037+0000 7f78dd156b80 10 client.0 _ll_register_callbacks cb 0x55c578406e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:49:13.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.038+0000 7f78cb400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c578519560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.038+0000 7f78cbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578513910 0x55c578516e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.038+0000 7f78cbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578513910 0x55c578516e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39982/0 (socket says 172.21.15.70:39982) 2024-05-08T08:49:13.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.038+0000 7f78cbe00700 1 -- 172.21.15.70:0/2330256206 learned_addr learned my addr 172.21.15.70:0/2330256206 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:49:13.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.038+0000 7f78caa00700 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 0x55c578516900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.039+0000 7f78cbe00700 1 -- 172.21.15.70:0/2330256206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 msgr2=0x55c578516900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:49:13.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.039+0000 7f78cbe00700 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 0x55c578516900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.039+0000 7f78cbe00700 1 -- 172.21.15.70:0/2330256206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 msgr2=0x55c578519560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:49:13.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.039+0000 7f78cbe00700 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c578519560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.039+0000 7f78cbe00700 1 -- 172.21.15.70:0/2330256206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5784255b0 con 0x55c578513910 2024-05-08T08:49:13.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.039+0000 7f78cbe00700 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578513910 0x55c578516e40 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f78c4004f70 tx=0x7f78c4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5174771c24dca7e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:49:13.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.039+0000 7f78b5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:49:13.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.040+0000 7f78b5600700 1 -- 172.21.15.70:0/2330256206 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78c40ab340 con 0x55c578513910 2024-05-08T08:49:13.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.040+0000 7f78b5600700 1 -- 172.21.15.70:0/2330256206 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(323..323 src has 1..323) ==== 9583+0+0 (secure 0 0 0) 0x7f78c40a75d0 con 0x55c578513910 2024-05-08T08:49:13.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.040+0000 7f78dd156b80 1 -- 172.21.15.70:0/2330256206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78bc0044b0 con 0x55c578513910 2024-05-08T08:49:13.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.040+0000 7f78b5600700 1 -- 172.21.15.70:0/2330256206 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f78c40af6f0 con 0x55c578513910 2024-05-08T08:49:13.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.040+0000 7f78dd156b80 10 client.18630 fetch_fsmap learned FSMap version 42 2024-05-08T08:49:13.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.040+0000 7f78dd156b80 1 -- 172.21.15.70:0/2330256206 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55c578524c20 con 0x55c578513910 2024-05-08T08:49:13.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.041+0000 7f78b5600700 1 -- 172.21.15.70:0/2330256206 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78bc0044b0 con 0x55c578513910 2024-05-08T08:49:13.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.041+0000 7f78b5600700 1 -- 172.21.15.70:0/2330256206 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f78c4011070 con 0x55c578513910 2024-05-08T08:49:13.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.041+0000 7f78dd156b80 10 client.18630 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:49:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.041+0000 7f78dd156b80 10 client.18630 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:49:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.041+0000 7f78dd156b80 20 client.18630 populate_metadata read hostname 'smithi070' 2024-05-08T08:49:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.041+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c578527240 0x55c578529680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.041+0000 7f78dd156b80 4 client.18630 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:49:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.041+0000 7f78dd156b80 1 -- 172.21.15.70:0/2330256206 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5784da230 con 0x55c578527240 2024-05-08T08:49:13.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.042+0000 7f78cb400700 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c578527240 0x55c578529680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.043+0000 7f78b5600700 10 client.18630 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:49:13.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.043+0000 7f78cb400700 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c578527240 0x55c578529680 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b19f4ee9dd87e22 server_cookie=e350fad8a5c90763 in_seq=0 out_seq=0 2024-05-08T08:49:13.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.045+0000 7f78b5600700 1 -- 172.21.15.70:0/2330256206 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c5784da230 con 0x55c578527240 2024-05-08T08:49:13.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.045+0000 7f78b5600700 10 client.18630 handle_command_reply: tid=0 2024-05-08T08:49:13.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 client.18630 shutdown 2024-05-08T08:49:13.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 -- 172.21.15.70:0/2330256206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578513910 msgr2=0x55c578516e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578513910 0x55c578516e40 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f78c4004f70 tx=0x7f78c4007d30 comp rx=0 tx=0).stop 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 -- 172.21.15.70:0/2330256206 shutdown_connections 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c578527240 0x55c578529680 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578513910 0x55c578516e40 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c578519560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2330256206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 0x55c578516900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 -- 172.21.15.70:0/2330256206 >> 172.21.15.70:0/2330256206 conn(0x55c57843bcf0 msgr2=0x55c57850c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78b5600700 0 client.18630 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 -- 172.21.15.70:0/2330256206 shutdown_connections 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.046+0000 7f78dd156b80 1 -- 172.21.15.70:0/2330256206 wait complete. 2024-05-08T08:49:13.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.047+0000 7f78dd156b80 20 client.18630 trim_cache size 0 max 16384 2024-05-08T08:49:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.083+0000 7f78dd156b80 1 Processor -- start 2024-05-08T08:49:13.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.084+0000 7f78dd156b80 1 -- start start 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.084+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c5785151f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.084+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c578515730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.084+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 0x55c57852ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.084+0000 7f78dd156b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac011800 con 0x55c578512ff0 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.084+0000 7f78dd156b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac00f090 con 0x55c57850db40 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.084+0000 7f78dd156b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac00cf00 con 0x55c578513910 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.084+0000 7f78caa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c578515730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.084+0000 7f78caa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c578515730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39986/0 (socket says 172.21.15.70:39986) 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.085+0000 7f78caa00700 1 -- 172.21.15.70:0/2286618585 learned_addr learned my addr 172.21.15.70:0/2286618585 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:49:13.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.085+0000 7f78cb400700 1 --2- 172.21.15.70:0/2286618585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c5785151f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.085+0000 7f78cbe00700 1 --2- 172.21.15.70:0/2286618585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 0x55c57852ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.085+0000 7f78caa00700 1 -- 172.21.15.70:0/2286618585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 msgr2=0x55c57852ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:49:13.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.085+0000 7f78caa00700 1 --2- 172.21.15.70:0/2286618585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 0x55c57852ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.085+0000 7f78caa00700 1 -- 172.21.15.70:0/2286618585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 msgr2=0x55c5785151f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:49:13.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.085+0000 7f78caa00700 1 --2- 172.21.15.70:0/2286618585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c5785151f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.085+0000 7f78caa00700 1 -- 172.21.15.70:0/2286618585 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5785166d0 con 0x55c578512ff0 2024-05-08T08:49:13.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.086+0000 7f78caa00700 1 --2- 172.21.15.70:0/2286618585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c578515730 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009e10 tx=0x7f78b8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681e258905eda7a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:49:13.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.086+0000 7f78b7e00700 1 -- 172.21.15.70:0/2286618585 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8022070 con 0x55c578512ff0 2024-05-08T08:49:13.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.086+0000 7f78b7e00700 1 -- 172.21.15.70:0/2286618585 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78b80044e0 con 0x55c578512ff0 2024-05-08T08:49:13.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.086+0000 7f78b7e00700 1 -- 172.21.15.70:0/2286618585 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b8003ae0 con 0x55c578512ff0 2024-05-08T08:49:13.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.087+0000 7f78dd156b80 1 -- 172.21.15.70:0/2286618585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 msgr2=0x55c578515730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:13.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.087+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2286618585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c578515730 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009e10 tx=0x7f78b8009260 comp rx=0 tx=0).stop 2024-05-08T08:49:13.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.087+0000 7f78dd156b80 1 -- 172.21.15.70:0/2286618585 shutdown_connections 2024-05-08T08:49:13.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.088+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2286618585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578513910 0x55c57852ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.088+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2286618585 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c57850db40 0x55c5785151f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.088+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2286618585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c578512ff0 0x55c578515730 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.088+0000 7f78dd156b80 1 -- 172.21.15.70:0/2286618585 >> 172.21.15.70:0/2286618585 conn(0x55c57843bcf0 msgr2=0x55c578510a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:49:13.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.088+0000 7f78dd156b80 1 -- 172.21.15.70:0/2286618585 shutdown_connections 2024-05-08T08:49:13.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.088+0000 7f78dd156b80 1 -- 172.21.15.70:0/2286618585 wait complete. 2024-05-08T08:49:13.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.088+0000 7f78dd156b80 1 -- start start 2024-05-08T08:49:13.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.089+0000 7f78dd156b80 1 Processor -- start 2024-05-08T08:49:13.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.089+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c57850db40 0x55c57851c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.089+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 0x55c57851cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.089+0000 7f78dd156b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c578513910 0x55c57851d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.089+0000 7f78dd156b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac00d550 con 0x55c57850db40 2024-05-08T08:49:13.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.089+0000 7f78dd156b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac00e9c0 con 0x55c578513910 2024-05-08T08:49:13.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.089+0000 7f78dd156b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac00dc20 con 0x55c578512ff0 2024-05-08T08:49:13.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.089+0000 7f78dd156b80 10 client.0 _ll_register_callbacks cb 0x55c578406e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:49:13.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c57850db40 0x55c57851c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78cb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c57850db40 0x55c57851c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39992/0 (socket says 172.21.15.70:39992) 2024-05-08T08:49:13.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78cb400700 1 -- 172.21.15.70:0/2458579575 learned_addr learned my addr 172.21.15.70:0/2458579575 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:49:13.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78caa00700 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 0x55c57851cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78cbe00700 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c578513910 0x55c57851d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78cb400700 1 -- 172.21.15.70:0/2458579575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 msgr2=0x55c57851cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78cb400700 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 0x55c57851cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78cb400700 1 -- 172.21.15.70:0/2458579575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c578513910 msgr2=0x55c57851d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78cb400700 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c578513910 0x55c57851d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.090+0000 7f78cb400700 1 -- 172.21.15.70:0/2458579575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c578591d50 con 0x55c57850db40 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.091+0000 7f78cb400700 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c57850db40 0x55c57851c8a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f78bc000c00 tx=0x7f78bc00ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9068df8ae8b71eda server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.091+0000 7f78b5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.091+0000 7f78b5600700 1 -- 172.21.15.70:0/2458579575 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78bc037060 con 0x55c57850db40 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.091+0000 7f78b5600700 1 -- 172.21.15.70:0/2458579575 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(323..323 src has 1..323) ==== 9583+0+0 (secure 0 0 0) 0x7f78bc003680 con 0x55c57850db40 2024-05-08T08:49:13.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.091+0000 7f78dd156b80 1 -- 172.21.15.70:0/2458579575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78b80044e0 con 0x55c57850db40 2024-05-08T08:49:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.092+0000 7f78b5600700 1 -- 172.21.15.70:0/2458579575 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f78bc03e050 con 0x55c57850db40 2024-05-08T08:49:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.092+0000 7f78dd156b80 10 client.18636 fetch_fsmap learned FSMap version 42 2024-05-08T08:49:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.092+0000 7f78dd156b80 1 -- 172.21.15.70:0/2458579575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55c578592ff0 con 0x55c57850db40 2024-05-08T08:49:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.092+0000 7f78b5600700 1 -- 172.21.15.70:0/2458579575 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78b80044e0 con 0x55c57850db40 2024-05-08T08:49:13.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.093+0000 7f78b5600700 1 -- 172.21.15.70:0/2458579575 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f78bc026480 con 0x55c57850db40 2024-05-08T08:49:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.093+0000 7f78dd156b80 10 client.18636 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:49:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.093+0000 7f78dd156b80 10 client.18636 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:49:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.093+0000 7f78dd156b80 20 client.18636 populate_metadata read hostname 'smithi070' 2024-05-08T08:49:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.093+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c578593460 0x55c578595880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:49:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.093+0000 7f78dd156b80 4 client.18636 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.75, "await_for": 42.0}] 2024-05-08T08:49:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.093+0000 7f78dd156b80 1 -- 172.21.15.70:0/2458579575 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.75, "await_for": 42.0}) -- 0x55c57846d590 con 0x55c578593460 2024-05-08T08:49:13.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.094+0000 7f78caa00700 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c578593460 0x55c578595880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:49:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.095+0000 7f78b5600700 10 client.18636 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:49:13.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:13.095+0000 7f78caa00700 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c578593460 0x55c578595880 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=382c1119c97dfc6f server_cookie=18a6bb11f1eca424 in_seq=0 out_seq=0 2024-05-08T08:49:13.257 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:13 smithi194 ceph-mon[33679]: pgmap v3911: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 739 KiB/s wr, 52 op/s 2024-05-08T08:49:13.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:13 smithi070 ceph-mon[29591]: pgmap v3911: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 739 KiB/s wr, 52 op/s 2024-05-08T08:49:13.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:13 smithi172 ceph-mon[33377]: pgmap v3911: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 739 KiB/s wr, 52 op/s 2024-05-08T08:49:13.959 INFO:tasks.workunit.client.0.smithi070.stdout: CC net/ipv4/xfrm4_protocol.o 2024-05-08T08:49:14.032 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/virtio_console.o 2024-05-08T08:49:15.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:15 smithi070 ceph-mon[29591]: pgmap v3912: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 609 KiB/s wr, 30 op/s 2024-05-08T08:49:15.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:15 smithi172 ceph-mon[33377]: pgmap v3912: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 609 KiB/s wr, 30 op/s 2024-05-08T08:49:15.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:15 smithi194 ceph-mon[33679]: pgmap v3912: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 609 KiB/s wr, 30 op/s 2024-05-08T08:49:17.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:17 smithi070 ceph-mon[29591]: pgmap v3913: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 614 KiB/s wr, 31 op/s 2024-05-08T08:49:17.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:17 smithi172 ceph-mon[33377]: pgmap v3913: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 614 KiB/s wr, 31 op/s 2024-05-08T08:49:17.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:17 smithi194 ceph-mon[33679]: pgmap v3913: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 614 KiB/s wr, 31 op/s 2024-05-08T08:49:19.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:19 smithi070 ceph-mon[29591]: pgmap v3914: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 614 KiB/s wr, 31 op/s 2024-05-08T08:49:19.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:19 smithi172 ceph-mon[33377]: pgmap v3914: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 614 KiB/s wr, 31 op/s 2024-05-08T08:49:19.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:19 smithi194 ceph-mon[33679]: pgmap v3914: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 614 KiB/s wr, 31 op/s 2024-05-08T08:49:21.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:21 smithi070 ceph-mon[29591]: pgmap v3915: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 553 KiB/s wr, 24 op/s 2024-05-08T08:49:21.425 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:21 smithi172 ceph-mon[33377]: pgmap v3915: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 553 KiB/s wr, 24 op/s 2024-05-08T08:49:21.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:21 smithi194 ceph-mon[33679]: pgmap v3915: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 553 KiB/s wr, 24 op/s 2024-05-08T08:49:23.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:23 smithi070 ceph-mon[29591]: pgmap v3916: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 496 KiB/s wr, 22 op/s 2024-05-08T08:49:23.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:23 smithi172 ceph-mon[33377]: pgmap v3916: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 496 KiB/s wr, 22 op/s 2024-05-08T08:49:23.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:23 smithi194 ceph-mon[33679]: pgmap v3916: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 526 KiB/s rd, 496 KiB/s wr, 22 op/s 2024-05-08T08:49:25.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:25 smithi070 ceph-mon[29591]: pgmap v3917: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 530 KiB/s wr, 24 op/s 2024-05-08T08:49:25.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:25 smithi172 ceph-mon[33377]: pgmap v3917: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 530 KiB/s wr, 24 op/s 2024-05-08T08:49:25.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:25 smithi194 ceph-mon[33679]: pgmap v3917: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 530 KiB/s wr, 24 op/s 2024-05-08T08:49:27.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:27 smithi070 ceph-mon[29591]: pgmap v3918: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 264 KiB/s wr, 14 op/s 2024-05-08T08:49:27.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:27 smithi172 ceph-mon[33377]: pgmap v3918: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 264 KiB/s wr, 14 op/s 2024-05-08T08:49:27.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:27 smithi194 ceph-mon[33679]: pgmap v3918: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 264 KiB/s wr, 14 op/s 2024-05-08T08:49:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:29 smithi070 ceph-mon[29591]: pgmap v3919: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 254 KiB/s wr, 12 op/s 2024-05-08T08:49:29.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:29 smithi172 ceph-mon[33377]: pgmap v3919: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 254 KiB/s wr, 12 op/s 2024-05-08T08:49:29.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:29 smithi194 ceph-mon[33679]: pgmap v3919: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 254 KiB/s wr, 12 op/s 2024-05-08T08:49:31.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:31 smithi070 ceph-mon[29591]: pgmap v3920: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 296 KiB/s wr, 15 op/s 2024-05-08T08:49:31.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:31 smithi172 ceph-mon[33377]: pgmap v3920: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 296 KiB/s wr, 15 op/s 2024-05-08T08:49:31.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:31 smithi194 ceph-mon[33679]: pgmap v3920: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 296 KiB/s wr, 15 op/s 2024-05-08T08:49:33.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:33 smithi070 ceph-mon[29591]: pgmap v3921: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-05-08T08:49:33.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:33 smithi172 ceph-mon[33377]: pgmap v3921: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-05-08T08:49:33.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:33 smithi194 ceph-mon[33679]: pgmap v3921: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-05-08T08:49:35.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:35 smithi070 ceph-mon[29591]: pgmap v3922: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 165 KiB/s wr, 10 op/s 2024-05-08T08:49:35.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:35 smithi172 ceph-mon[33377]: pgmap v3922: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 165 KiB/s wr, 10 op/s 2024-05-08T08:49:35.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:35 smithi194 ceph-mon[33679]: pgmap v3922: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 165 KiB/s wr, 10 op/s 2024-05-08T08:49:37.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.219+0000 7f78b5600700 1 -- 172.21.15.70:0/2458579575 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55c57846d590 con 0x55c578593460 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.219+0000 7f78b5600700 10 client.18636 handle_command_reply: tid=0 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.219+0000 7f78dd156b80 1 client.18636 shutdown 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.220+0000 7f78dd156b80 1 -- 172.21.15.70:0/2458579575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c57850db40 msgr2=0x55c57851c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.220+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c57850db40 0x55c57851c8a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f78bc000c00 tx=0x7f78bc00ea20 comp rx=0 tx=0).stop 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.220+0000 7f78dd156b80 1 -- 172.21.15.70:0/2458579575 shutdown_connections 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.220+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c578593460 0x55c578595880 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.220+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c578513910 0x55c57851d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.220+0000 7f78b5600700 0 client.18636 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.220+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c57850db40 0x55c57851c8a0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.221+0000 7f78dd156b80 1 --2- 172.21.15.70:0/2458579575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c578512ff0 0x55c57851cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.221+0000 7f78dd156b80 1 -- 172.21.15.70:0/2458579575 >> 172.21.15.70:0/2458579575 conn(0x55c57843bcf0 msgr2=0x55c5785151b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:49:37.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.221+0000 7f78dd156b80 1 -- 172.21.15.70:0/2458579575 shutdown_connections 2024-05-08T08:49:37.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.221+0000 7f78dd156b80 1 -- 172.21.15.70:0/2458579575 wait complete. 2024-05-08T08:49:37.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.222+0000 7f78dd156b80 20 client.18636 trim_cache size 0 max 16384 2024-05-08T08:49:37.220 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:49:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:49:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:49:37.220 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 274, 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "1de10762": { 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 274, 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.8, 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:49:37.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:49:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:49:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:49:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:49:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:49:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:49:37.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:49:37.222 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:49:37.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.223+0000 7f78d1200700 1 -- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b00b2b20 msgr2=0x7f78b00b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.223+0000 7f78d1200700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b00b2b20 0x7f78b00b4fe0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f78cc19ca40 tx=0x7f78bc009260 comp rx=0 tx=0).stop 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.223+0000 7f78d1200700 1 -- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 msgr2=0x7f78cc19b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.223+0000 7f78d1200700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 0x7f78cc19b900 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f78c400b070 tx=0x7f78c4004c60 comp rx=0 tx=0).stop 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.224+0000 7f78d1200700 1 -- 172.21.15.70:0/2321804376 shutdown_connections 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.224+0000 7f78d1200700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78b00b2b20 0x7f78b00b4fe0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.224+0000 7f78d1200700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78cc107810 0x7f78cc19b900 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.224+0000 7f78d1200700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78cc105840 0x7f78cc1a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.224+0000 7f78d1200700 1 --2- 172.21.15.70:0/2321804376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78cc106160 0x7f78cc1a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.224+0000 7f78d1200700 1 -- 172.21.15.70:0/2321804376 >> 172.21.15.70:0/2321804376 conn(0x7f78cc100fb0 msgr2=0x7f78cc102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.224+0000 7f78d1200700 1 -- 172.21.15.70:0/2321804376 shutdown_connections 2024-05-08T08:49:37.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:49:37.224+0000 7f78d1200700 1 -- 172.21.15.70:0/2321804376 wait complete. 2024-05-08T08:49:37.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:37 smithi070 ceph-mon[29591]: pgmap v3923: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 7 op/s 2024-05-08T08:49:37.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:37 smithi172 ceph-mon[33377]: pgmap v3923: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 7 op/s 2024-05-08T08:49:37.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:37 smithi194 ceph-mon[33679]: pgmap v3923: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 7 op/s 2024-05-08T08:49:38.091 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1de10762', quiesce took 38.9 seconds. Will release after: 28.75 2024-05-08T08:49:39.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:39 smithi070 ceph-mon[29591]: pgmap v3924: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2024-05-08T08:49:39.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:39 smithi172 ceph-mon[33377]: pgmap v3924: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2024-05-08T08:49:39.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:39 smithi194 ceph-mon[33679]: pgmap v3924: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2024-05-08T08:49:41.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:41 smithi070 ceph-mon[29591]: pgmap v3925: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 305 KiB/s wr, 16 op/s 2024-05-08T08:49:41.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:41 smithi172 ceph-mon[33377]: pgmap v3925: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 305 KiB/s wr, 16 op/s 2024-05-08T08:49:41.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:41 smithi194 ceph-mon[33679]: pgmap v3925: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 305 KiB/s wr, 16 op/s 2024-05-08T08:49:42.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:49:42.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:49:42.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:49:43.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:43 smithi070 ceph-mon[29591]: pgmap v3926: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 262 KiB/s wr, 13 op/s 2024-05-08T08:49:43.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:43 smithi172 ceph-mon[33377]: pgmap v3926: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 262 KiB/s wr, 13 op/s 2024-05-08T08:49:43.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:43 smithi194 ceph-mon[33679]: pgmap v3926: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 262 KiB/s wr, 13 op/s 2024-05-08T08:49:43.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:43.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:44.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:44.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:44.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:44.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:44.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:44.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:45.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:45 smithi172 ceph-mon[33377]: pgmap v3927: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 329 KiB/s wr, 18 op/s 2024-05-08T08:49:45.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:45 smithi194 ceph-mon[33679]: pgmap v3927: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 329 KiB/s wr, 18 op/s 2024-05-08T08:49:45.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:45 smithi070 ceph-mon[29591]: pgmap v3927: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 329 KiB/s wr, 18 op/s 2024-05-08T08:49:46.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:46.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:46.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:49:46.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:49:46.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:46.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:46.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:46.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:49:46.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:49:46.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:46.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:46.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:46.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:49:46.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:49:46.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:49:47.757 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:47 smithi194 ceph-mon[33679]: pgmap v3928: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 276 KiB/s wr, 16 op/s 2024-05-08T08:49:47.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:47 smithi070 ceph-mon[29591]: pgmap v3928: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 276 KiB/s wr, 16 op/s 2024-05-08T08:49:47.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:47 smithi172 ceph-mon[33377]: pgmap v3928: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 276 KiB/s wr, 16 op/s 2024-05-08T08:49:48.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:48 smithi070 ceph-mon[29591]: pgmap v3929: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 276 KiB/s wr, 16 op/s 2024-05-08T08:49:48.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:48 smithi172 ceph-mon[33377]: pgmap v3929: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 276 KiB/s wr, 16 op/s 2024-05-08T08:49:49.007 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:48 smithi194 ceph-mon[33679]: pgmap v3929: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 276 KiB/s wr, 16 op/s 2024-05-08T08:49:51.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:51 smithi070 ceph-mon[29591]: pgmap v3930: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 332 KiB/s wr, 20 op/s 2024-05-08T08:49:51.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:51 smithi172 ceph-mon[33377]: pgmap v3930: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 332 KiB/s wr, 20 op/s 2024-05-08T08:49:51.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:51 smithi194 ceph-mon[33679]: pgmap v3930: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 332 KiB/s wr, 20 op/s 2024-05-08T08:49:53.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:53 smithi070 ceph-mon[29591]: pgmap v3931: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-05-08T08:49:53.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:53 smithi172 ceph-mon[33377]: pgmap v3931: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-05-08T08:49:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:53 smithi194 ceph-mon[33679]: pgmap v3931: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-05-08T08:49:55.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:55 smithi070 ceph-mon[29591]: pgmap v3932: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 122 KiB/s wr, 13 op/s 2024-05-08T08:49:55.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:55 smithi172 ceph-mon[33377]: pgmap v3932: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 122 KiB/s wr, 13 op/s 2024-05-08T08:49:55.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:55 smithi194 ceph-mon[33679]: pgmap v3932: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 122 KiB/s wr, 13 op/s 2024-05-08T08:49:57.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:57 smithi070 ceph-mon[29591]: pgmap v3933: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T08:49:57.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:57 smithi172 ceph-mon[33377]: pgmap v3933: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T08:49:57.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:57 smithi194 ceph-mon[33679]: pgmap v3933: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 56 KiB/s wr, 8 op/s 2024-05-08T08:49:59.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:49:59 smithi070 ceph-mon[29591]: pgmap v3934: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 56 KiB/s wr, 6 op/s 2024-05-08T08:49:59.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:49:59 smithi172 ceph-mon[33377]: pgmap v3934: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 56 KiB/s wr, 6 op/s 2024-05-08T08:49:59.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:49:59 smithi194 ceph-mon[33679]: pgmap v3934: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 56 KiB/s wr, 6 op/s 2024-05-08T08:50:00.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T08:50:00.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T08:50:00.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T08:50:01.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:01 smithi070 ceph-mon[29591]: pgmap v3935: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 96 KiB/s wr, 9 op/s 2024-05-08T08:50:01.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:01 smithi172 ceph-mon[33377]: pgmap v3935: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 96 KiB/s wr, 9 op/s 2024-05-08T08:50:01.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:01 smithi194 ceph-mon[33679]: pgmap v3935: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 96 KiB/s wr, 9 op/s 2024-05-08T08:50:03.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:03 smithi070 ceph-mon[29591]: pgmap v3936: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 40 KiB/s wr, 5 op/s 2024-05-08T08:50:03.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:03 smithi172 ceph-mon[33377]: pgmap v3936: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 40 KiB/s wr, 5 op/s 2024-05-08T08:50:03.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:03 smithi194 ceph-mon[33679]: pgmap v3936: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 40 KiB/s wr, 5 op/s 2024-05-08T08:50:05.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:05 smithi070 ceph-mon[29591]: pgmap v3937: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 85 KiB/s wr, 24 op/s 2024-05-08T08:50:05.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:05 smithi172 ceph-mon[33377]: pgmap v3937: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 85 KiB/s wr, 24 op/s 2024-05-08T08:50:05.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:05 smithi194 ceph-mon[33679]: pgmap v3937: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 85 KiB/s wr, 24 op/s 2024-05-08T08:50:06.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:50:07.297 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:50:07.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:07 smithi070 ceph-mon[29591]: pgmap v3938: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 85 KiB/s wr, 22 op/s 2024-05-08T08:50:07.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:07 smithi172 ceph-mon[33377]: pgmap v3938: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 85 KiB/s wr, 22 op/s 2024-05-08T08:50:07.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:07 smithi194 ceph-mon[33679]: pgmap v3938: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 85 KiB/s wr, 22 op/s 2024-05-08T08:50:09.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:09 smithi070 ceph-mon[29591]: pgmap v3939: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 85 KiB/s wr, 22 op/s 2024-05-08T08:50:09.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:09 smithi172 ceph-mon[33377]: pgmap v3939: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 85 KiB/s wr, 22 op/s 2024-05-08T08:50:09.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:09 smithi194 ceph-mon[33679]: pgmap v3939: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 85 KiB/s wr, 22 op/s 2024-05-08T08:50:09.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.598+0000 7f8e79e00700 1 -- 172.21.15.70:0/786441406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e741055d0 msgr2=0x7f8e74105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:09.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.598+0000 7f8e79e00700 1 --2- 172.21.15.70:0/786441406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e741055d0 0x7f8e74105a50 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f8e600099c0 tx=0x7f8e60009cd0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.598+0000 7f8e79e00700 1 -- 172.21.15.70:0/786441406 shutdown_connections 2024-05-08T08:50:09.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.598+0000 7f8e79e00700 1 --2- 172.21.15.70:0/786441406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e74105f90 0x7f8e74112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.598+0000 7f8e79e00700 1 --2- 172.21.15.70:0/786441406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e7410b680 0x7f8e7410ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.598+0000 7f8e79e00700 1 --2- 172.21.15.70:0/786441406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e741055d0 0x7f8e74105a50 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.598+0000 7f8e79e00700 1 -- 172.21.15.70:0/786441406 >> 172.21.15.70:0/786441406 conn(0x7f8e741010e0 msgr2=0x7f8e74103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:09.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.598+0000 7f8e79e00700 1 -- 172.21.15.70:0/786441406 shutdown_connections 2024-05-08T08:50:09.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.598+0000 7f8e79e00700 1 -- 172.21.15.70:0/786441406 wait complete. 2024-05-08T08:50:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.600+0000 7f8e79e00700 1 Processor -- start 2024-05-08T08:50:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.600+0000 7f8e79e00700 1 -- start start 2024-05-08T08:50:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e79e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e741055d0 0x7f8e741a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e79e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e74105f90 0x7f8e741a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e79e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7410b680 0x7f8e7419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e79e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74115680 con 0x7f8e74105f90 2024-05-08T08:50:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e79e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74115500 con 0x7f8e7410b680 2024-05-08T08:50:09.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e79e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74115800 con 0x7f8e741055d0 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e73e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e74105f90 0x7f8e741a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e73e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e74105f90 0x7f8e741a1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45426/0 (socket says 172.21.15.70:45426) 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e73e00700 1 -- 172.21.15.70:0/3080593220 learned_addr learned my addr 172.21.15.70:0/3080593220 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e79400700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7410b680 0x7f8e7419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e78a00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e741055d0 0x7f8e741a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e73e00700 1 -- 172.21.15.70:0/3080593220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e741055d0 msgr2=0x7f8e741a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e73e00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e741055d0 0x7f8e741a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e73e00700 1 -- 172.21.15.70:0/3080593220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7410b680 msgr2=0x7f8e7419b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.601+0000 7f8e73e00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7410b680 0x7f8e7419b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.602+0000 7f8e73e00700 1 -- 172.21.15.70:0/3080593220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7419c100 con 0x7f8e74105f90 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.602+0000 7f8e78a00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e741055d0 0x7f8e741a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:50:09.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.602+0000 7f8e79400700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7410b680 0x7f8e7419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:50:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.602+0000 7f8e73e00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e74105f90 0x7f8e741a1d20 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f8e60000c00 tx=0x7f8e6000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.602+0000 7f8e71600700 1 -- 172.21.15.70:0/3080593220 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60027070 con 0x7f8e74105f90 2024-05-08T08:50:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.602+0000 7f8e71600700 1 -- 172.21.15.70:0/3080593220 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e6000fe50 con 0x7f8e74105f90 2024-05-08T08:50:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.602+0000 7f8e71600700 1 -- 172.21.15.70:0/3080593220 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e600173f0 con 0x7f8e74105f90 2024-05-08T08:50:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.602+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7419c390 con 0x7f8e74105f90 2024-05-08T08:50:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.603+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e741a86b0 con 0x7f8e74105f90 2024-05-08T08:50:09.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.604+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7406a190 con 0x7f8e74105f90 2024-05-08T08:50:09.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.608+0000 7f8e71600700 1 -- 172.21.15.70:0/3080593220 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8e6002a070 con 0x7f8e74105f90 2024-05-08T08:50:09.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.609+0000 7f8e71600700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e5c0b29f0 0x7f8e5c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:09.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.609+0000 7f8e71600700 1 -- 172.21.15.70:0/3080593220 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(324..324 src has 1..324) ==== 9671+0+0 (secure 0 0 0) 0x7f8e600e3b70 con 0x7f8e74105f90 2024-05-08T08:50:09.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.610+0000 7f8e78a00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e5c0b29f0 0x7f8e5c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:09.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.610+0000 7f8e78a00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e5c0b29f0 0x7f8e5c0b4eb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8e68005fd0 tx=0x7f8e68005f00 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:09.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.612+0000 7f8e71600700 1 -- 172.21.15.70:0/3080593220 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8e60013070 con 0x7f8e74105f90 2024-05-08T08:50:09.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.899+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e7402e510 con 0x7f8e74105f90 2024-05-08T08:50:09.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.900+0000 7f8e71600700 1 -- 172.21.15.70:0/3080593220 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f8e600ab100 con 0x7f8e74105f90 2024-05-08T08:50:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:50:09.898 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:50:09.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.904+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e5c0b29f0 msgr2=0x7f8e5c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:09.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.904+0000 7f8e79e00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e5c0b29f0 0x7f8e5c0b4eb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8e68005fd0 tx=0x7f8e68005f00 comp rx=0 tx=0).stop 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.904+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e74105f90 msgr2=0x7f8e741a1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.904+0000 7f8e79e00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e74105f90 0x7f8e741a1d20 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f8e60000c00 tx=0x7f8e6000f510 comp rx=0 tx=0).stop 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.905+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 shutdown_connections 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.905+0000 7f8e79e00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8e5c0b29f0 0x7f8e5c0b4eb0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.905+0000 7f8e79e00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8e7410b680 0x7f8e7419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.905+0000 7f8e79e00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e741055d0 0x7f8e741a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.905+0000 7f8e79e00700 1 --2- 172.21.15.70:0/3080593220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e74105f90 0x7f8e741a1d20 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.905+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 >> 172.21.15.70:0/3080593220 conn(0x7f8e741010e0 msgr2=0x7f8e741028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.905+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 shutdown_connections 2024-05-08T08:50:09.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:09.905+0000 7f8e79e00700 1 -- 172.21.15.70:0/3080593220 wait complete. 2024-05-08T08:50:09.903 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:50:10.294 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:10 smithi070 ceph-mon[29591]: osdmap e324: 12 total, 12 up, 12 in 2024-05-08T08:50:10.294 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:10 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3080593220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:50:10.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:10 smithi172 ceph-mon[33377]: osdmap e324: 12 total, 12 up, 12 in 2024-05-08T08:50:10.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:10 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3080593220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:50:10.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:10 smithi194 ceph-mon[33679]: osdmap e324: 12 total, 12 up, 12 in 2024-05-08T08:50:10.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:10 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3080593220' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:50:10.714 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 1de10762 --release --await' 2024-05-08T08:50:10.714 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 1de10762 --release --await 2024-05-08T08:50:11.157 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:50:11.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:11 smithi070 ceph-mon[29591]: pgmap v3941: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T08:50:11.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:11 smithi172 ceph-mon[33377]: pgmap v3941: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T08:50:11.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:11 smithi194 ceph-mon[33679]: pgmap v3941: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T08:50:13.238 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:13 smithi070 ceph-mon[29591]: pgmap v3942: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T08:50:13.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.425+0000 7f622aa00700 1 -- 172.21.15.70:0/2431220589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 msgr2=0x7f622410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:13.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.425+0000 7f622aa00700 1 --2- 172.21.15.70:0/2431220589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 0x7f622410baa0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f6214009990 tx=0x7f6214009ca0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.425+0000 7f622aa00700 1 -- 172.21.15.70:0/2431220589 shutdown_connections 2024-05-08T08:50:13.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.425+0000 7f622aa00700 1 --2- 172.21.15.70:0/2431220589 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6224106080 0x7f6224112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.425+0000 7f622aa00700 1 --2- 172.21.15.70:0/2431220589 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 0x7f622410baa0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.425+0000 7f622aa00700 1 --2- 172.21.15.70:0/2431220589 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62241056c0 0x7f6224105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.425+0000 7f622aa00700 1 -- 172.21.15.70:0/2431220589 >> 172.21.15.70:0/2431220589 conn(0x7f62241011b0 msgr2=0x7f62241035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:13.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.426+0000 7f622aa00700 1 -- 172.21.15.70:0/2431220589 shutdown_connections 2024-05-08T08:50:13.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.426+0000 7f622aa00700 1 -- 172.21.15.70:0/2431220589 wait complete. 2024-05-08T08:50:13.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.427+0000 7f622aa00700 1 Processor -- start 2024-05-08T08:50:13.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.427+0000 7f622aa00700 1 -- start start 2024-05-08T08:50:13.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.427+0000 7f622aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62241056c0 0x7f62241a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.427+0000 7f622aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6224106080 0x7f62241a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.427+0000 7f622aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 0x7f622419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.427+0000 7f622aa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f62241157b0 con 0x7f622410b6c0 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.427+0000 7f622aa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6224115630 con 0x7f62241056c0 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.427+0000 7f622aa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6224115930 con 0x7f6224106080 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.427+0000 7f6228a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 0x7f622419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6228a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 0x7f622419ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45442/0 (socket says 172.21.15.70:45442) 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6228a00700 1 -- 172.21.15.70:0/3316817409 learned_addr learned my addr 172.21.15.70:0/3316817409 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6223e00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62241056c0 0x7f62241a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6223400700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6224106080 0x7f62241a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6228a00700 1 -- 172.21.15.70:0/3316817409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6224106080 msgr2=0x7f62241a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6228a00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6224106080 0x7f62241a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6228a00700 1 -- 172.21.15.70:0/3316817409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62241056c0 msgr2=0x7f62241a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:13.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6228a00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62241056c0 0x7f62241a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6228a00700 1 -- 172.21.15.70:0/3316817409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622419c170 con 0x7f622410b6c0 2024-05-08T08:50:13.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.428+0000 7f6228a00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 0x7f622419ba10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f621c007d70 tx=0x7f621c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:13.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.429+0000 7f6220c00700 1 -- 172.21.15.70:0/3316817409 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c016020 con 0x7f622410b6c0 2024-05-08T08:50:13.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.429+0000 7f6220c00700 1 -- 172.21.15.70:0/3316817409 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f621c00ad40 con 0x7f622410b6c0 2024-05-08T08:50:13.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.429+0000 7f6220c00700 1 -- 172.21.15.70:0/3316817409 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c0115e0 con 0x7f622410b6c0 2024-05-08T08:50:13.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.429+0000 7f622aa00700 1 -- 172.21.15.70:0/3316817409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622419c460 con 0x7f622410b6c0 2024-05-08T08:50:13.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:13 smithi172 ceph-mon[33377]: pgmap v3942: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T08:50:13.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.429+0000 7f622aa00700 1 -- 172.21.15.70:0/3316817409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62241a8720 con 0x7f622410b6c0 2024-05-08T08:50:13.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.433+0000 7f6220c00700 1 -- 172.21.15.70:0/3316817409 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f621c019020 con 0x7f622410b6c0 2024-05-08T08:50:13.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.434+0000 7f6220c00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f62080b2a70 0x7f62080b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.434+0000 7f6220c00700 1 -- 172.21.15.70:0/3316817409 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(324..324 src has 1..324) ==== 9671+0+0 (secure 0 0 0) 0x7f621c0e2950 con 0x7f622410b6c0 2024-05-08T08:50:13.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.434+0000 7f6223e00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f62080b2a70 0x7f62080b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.435+0000 7f6223e00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f62080b2a70 0x7f62080b4f30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f621400b5c0 tx=0x7f621401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:13.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.448+0000 7f6235432b80 1 Processor -- start 2024-05-08T08:50:13.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.448+0000 7f6235432b80 1 -- start start 2024-05-08T08:50:13.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6235432b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ec3ec0 0x562221ec42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6235432b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 0x562221ebe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6235432b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebee50 0x562221ecac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6235432b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562221e10b20 con 0x562221ec3ec0 2024-05-08T08:50:13.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6235432b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562221dae860 con 0x562221ebee50 2024-05-08T08:50:13.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6235432b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562221e0cae0 con 0x562221ebe490 2024-05-08T08:50:13.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6223e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ec3ec0 0x562221ec42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6223e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ec3ec0 0x562221ec42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45456/0 (socket says 172.21.15.70:45456) 2024-05-08T08:50:13.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6223e00700 1 -- 172.21.15.70:0/1841571059 learned_addr learned my addr 172.21.15.70:0/1841571059 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:13.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.449+0000 7f6223400700 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 0x562221ebe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.450+0000 7f6228a00700 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebee50 0x562221ecac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.450+0000 7f6223e00700 1 -- 172.21.15.70:0/1841571059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 msgr2=0x562221ebe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:13.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.450+0000 7f6223e00700 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 0x562221ebe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.450+0000 7f6223e00700 1 -- 172.21.15.70:0/1841571059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebee50 msgr2=0x562221ecac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:13.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.450+0000 7f6223e00700 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebee50 0x562221ecac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.450+0000 7f6223e00700 1 -- 172.21.15.70:0/1841571059 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562221d5d9d0 con 0x562221ec3ec0 2024-05-08T08:50:13.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.450+0000 7f6228a00700 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebee50 0x562221ecac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:50:13.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.450+0000 7f6223e00700 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ec3ec0 0x562221ec42a0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f6214015000 tx=0x7f621401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43ac2ff8ac7d201 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:13.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.451+0000 7f6219600700 1 -- 172.21.15.70:0/1841571059 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6214003bd0 con 0x562221ec3ec0 2024-05-08T08:50:13.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.451+0000 7f6219600700 1 -- 172.21.15.70:0/1841571059 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6214003d70 con 0x562221ec3ec0 2024-05-08T08:50:13.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.451+0000 7f6219600700 1 -- 172.21.15.70:0/1841571059 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621400f810 con 0x562221ec3ec0 2024-05-08T08:50:13.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.451+0000 7f6235432b80 1 -- 172.21.15.70:0/1841571059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ec3ec0 msgr2=0x562221ec42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:13.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.451+0000 7f6235432b80 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ec3ec0 0x562221ec42a0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f6214015000 tx=0x7f621401e000 comp rx=0 tx=0).stop 2024-05-08T08:50:13.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.452+0000 7f6235432b80 1 -- 172.21.15.70:0/1841571059 shutdown_connections 2024-05-08T08:50:13.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.452+0000 7f6235432b80 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebee50 0x562221ecac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.452+0000 7f6235432b80 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ec3ec0 0x562221ec42a0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.452+0000 7f6235432b80 1 --2- 172.21.15.70:0/1841571059 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 0x562221ebe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.452+0000 7f6235432b80 1 -- 172.21.15.70:0/1841571059 >> 172.21.15.70:0/1841571059 conn(0x562221decc60 msgr2=0x562221eb8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:13.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.452+0000 7f6235432b80 1 -- 172.21.15.70:0/1841571059 shutdown_connections 2024-05-08T08:50:13.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.452+0000 7f6235432b80 1 -- 172.21.15.70:0/1841571059 wait complete. 2024-05-08T08:50:13.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.452+0000 7f6235432b80 1 -- start start 2024-05-08T08:50:13.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.453+0000 7f6235432b80 1 Processor -- start 2024-05-08T08:50:13.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.453+0000 7f6235432b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 0x562221eca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.453+0000 7f6235432b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.453+0000 7f6235432b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ec3ec0 0x562221ec80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.453+0000 7f6235432b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562221ecb1c0 con 0x562221ebee50 2024-05-08T08:50:13.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.453+0000 7f6235432b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562221d76c20 con 0x562221ec3ec0 2024-05-08T08:50:13.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.453+0000 7f6235432b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562221ecb340 con 0x562221ebe490 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.453+0000 7f6235432b80 10 client.0 _ll_register_callbacks cb 0x562221db7d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.453+0000 7f6223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45460/0 (socket says 172.21.15.70:45460) 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223400700 1 -- 172.21.15.70:0/4014791342 learned_addr learned my addr 172.21.15.70:0/4014791342 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223e00700 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 0x562221eca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6228a00700 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ec3ec0 0x562221ec80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223400700 1 -- 172.21.15.70:0/4014791342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 msgr2=0x562221eca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223400700 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 0x562221eca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223400700 1 -- 172.21.15.70:0/4014791342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ec3ec0 msgr2=0x562221ec80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223400700 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ec3ec0 0x562221ec80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223400700 1 -- 172.21.15.70:0/4014791342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562221dd6520 con 0x562221ebee50 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223e00700 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 0x562221eca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f6223400700 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec7ba0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6210011800 tx=0x7f6210011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0514ee7f2e4fda5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:13.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.454+0000 7f620e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.455+0000 7f620e000700 1 -- 172.21.15.70:0/4014791342 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210004220 con 0x562221ebee50 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.455+0000 7f620e000700 1 -- 172.21.15.70:0/4014791342 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(324..324 src has 1..324) ==== 9671+0+0 (secure 0 0 0) 0x7f62100043c0 con 0x562221ebee50 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.455+0000 7f6235432b80 1 -- 172.21.15.70:0/4014791342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6214003d70 con 0x562221ebee50 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.455+0000 7f620e000700 1 -- 172.21.15.70:0/4014791342 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f621000f900 con 0x562221ebee50 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.455+0000 7f6235432b80 10 client.18654 fetch_fsmap learned FSMap version 42 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.455+0000 7f6235432b80 1 -- 172.21.15.70:0/4014791342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562221ed59a0 con 0x562221ebee50 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.455+0000 7f620e000700 1 -- 172.21.15.70:0/4014791342 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6214003d70 con 0x562221ebee50 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.456+0000 7f620e000700 1 -- 172.21.15.70:0/4014791342 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f6210018030 con 0x562221ebee50 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.456+0000 7f6235432b80 10 client.18654 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.456+0000 7f6235432b80 10 client.18654 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.456+0000 7f6235432b80 20 client.18654 populate_metadata read hostname 'smithi070' 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.456+0000 7f6235432b80 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562221ed7fe0 0x562221eda450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.456+0000 7f6235432b80 4 client.18654 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:50:13.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.456+0000 7f6235432b80 1 -- 172.21.15.70:0/4014791342 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562221e8b1a0 con 0x562221ed7fe0 2024-05-08T08:50:13.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.457+0000 7f6223e00700 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562221ed7fe0 0x562221eda450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.457+0000 7f6223e00700 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562221ed7fe0 0x562221eda450 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06909ccde63d077 server_cookie=27deeca49989413f in_seq=0 out_seq=0 2024-05-08T08:50:13.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.457+0000 7f620e000700 10 client.18654 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:50:13.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.459+0000 7f620e000700 1 -- 172.21.15.70:0/4014791342 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562221e8b1a0 con 0x562221ed7fe0 2024-05-08T08:50:13.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.459+0000 7f620e000700 10 client.18654 handle_command_reply: tid=0 2024-05-08T08:50:13.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 client.18654 shutdown 2024-05-08T08:50:13.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 -- 172.21.15.70:0/4014791342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 msgr2=0x562221ec7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:13.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec7ba0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6210011800 tx=0x7f6210011bc0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 -- 172.21.15.70:0/4014791342 shutdown_connections 2024-05-08T08:50:13.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562221ed7fe0 0x562221eda450 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ec3ec0 0x562221ec80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebe490 0x562221eca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 --2- 172.21.15.70:0/4014791342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec7ba0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f620e000700 0 client.18654 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:50:13.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 -- 172.21.15.70:0/4014791342 >> 172.21.15.70:0/4014791342 conn(0x562221decc60 msgr2=0x562221eb3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:13.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 -- 172.21.15.70:0/4014791342 shutdown_connections 2024-05-08T08:50:13.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 1 -- 172.21.15.70:0/4014791342 wait complete. 2024-05-08T08:50:13.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.460+0000 7f6235432b80 20 client.18654 trim_cache size 0 max 16384 2024-05-08T08:50:13.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.482+0000 7f6235432b80 1 Processor -- start 2024-05-08T08:50:13.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.482+0000 7f6235432b80 1 -- start start 2024-05-08T08:50:13.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.482+0000 7f6235432b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebe490 0x562221ed4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.482+0000 7f6235432b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.482+0000 7f6235432b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ec3ec0 0x562221ec2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.482+0000 7f6235432b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f62241b4140 con 0x562221ebee50 2024-05-08T08:50:13.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.482+0000 7f6235432b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62241b19d0 con 0x562221ebe490 2024-05-08T08:50:13.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.482+0000 7f6235432b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f62241af840 con 0x562221ec3ec0 2024-05-08T08:50:13.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.482+0000 7f6223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.483+0000 7f6223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45464/0 (socket says 172.21.15.70:45464) 2024-05-08T08:50:13.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.483+0000 7f6223400700 1 -- 172.21.15.70:0/2590039866 learned_addr learned my addr 172.21.15.70:0/2590039866 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:13.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.483+0000 7f6223400700 1 -- 172.21.15.70:0/2590039866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ec3ec0 msgr2=0x562221ec2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:13.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.483+0000 7f6223400700 1 --2- 172.21.15.70:0/2590039866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ec3ec0 0x562221ec2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.483+0000 7f6223400700 1 -- 172.21.15.70:0/2590039866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebe490 msgr2=0x562221ed4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:13.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.483+0000 7f6223400700 1 --2- 172.21.15.70:0/2590039866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebe490 0x562221ed4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.483+0000 7f6223400700 1 -- 172.21.15.70:0/2590039866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562221eb5980 con 0x562221ebee50 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.483+0000 7f6223400700 1 --2- 172.21.15.70:0/2590039866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec6d40 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f6210005260 tx=0x7f6210005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736747a1358417ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.483+0000 7f6218c00700 1 -- 172.21.15.70:0/2590039866 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621000faa0 con 0x562221ebee50 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6218c00700 1 -- 172.21.15.70:0/2590039866 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f621000fc40 con 0x562221ebee50 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6218c00700 1 -- 172.21.15.70:0/2590039866 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210028680 con 0x562221ebee50 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6235432b80 1 -- 172.21.15.70:0/2590039866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 msgr2=0x562221ec6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6235432b80 1 --2- 172.21.15.70:0/2590039866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec6d40 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f6210005260 tx=0x7f6210005470 comp rx=0 tx=0).stop 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6235432b80 1 -- 172.21.15.70:0/2590039866 shutdown_connections 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6235432b80 1 --2- 172.21.15.70:0/2590039866 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ec3ec0 0x562221ec2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6235432b80 1 --2- 172.21.15.70:0/2590039866 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ebe490 0x562221ed4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6235432b80 1 --2- 172.21.15.70:0/2590039866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebee50 0x562221ec6d40 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6235432b80 1 -- 172.21.15.70:0/2590039866 >> 172.21.15.70:0/2590039866 conn(0x562221decc60 msgr2=0x562221ec1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6235432b80 1 -- 172.21.15.70:0/2590039866 shutdown_connections 2024-05-08T08:50:13.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.484+0000 7f6235432b80 1 -- 172.21.15.70:0/2590039866 wait complete. 2024-05-08T08:50:13.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.485+0000 7f6235432b80 1 -- start start 2024-05-08T08:50:13.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.485+0000 7f6235432b80 1 Processor -- start 2024-05-08T08:50:13.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.485+0000 7f6235432b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebe490 0x562221ed0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6235432b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebee50 0x562221ecd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6235432b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ec3ec0 0x562221ecdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6235432b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f62241afe90 con 0x562221ebe490 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6235432b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62241b1300 con 0x562221ec3ec0 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6235432b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f62241b0560 con 0x562221ebee50 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6235432b80 10 client.0 _ll_register_callbacks cb 0x562221db7d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6223e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebe490 0x562221ed0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6223e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebe490 0x562221ed0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45476/0 (socket says 172.21.15.70:45476) 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6223e00700 1 -- 172.21.15.70:0/242302420 learned_addr learned my addr 172.21.15.70:0/242302420 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6223e00700 1 -- 172.21.15.70:0/242302420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebee50 msgr2=0x562221ecd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6223e00700 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebee50 0x562221ecd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6223e00700 1 -- 172.21.15.70:0/242302420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ec3ec0 msgr2=0x562221ecdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6223e00700 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ec3ec0 0x562221ecdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:13.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.486+0000 7f6223e00700 1 -- 172.21.15.70:0/242302420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562221ece2b0 con 0x562221ebe490 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.487+0000 7f6223e00700 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebe490 0x562221ed0b10 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f6214009750 tx=0x7f6214005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44d6e2c1dc51271 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.487+0000 7f620e000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.487+0000 7f620e000700 1 -- 172.21.15.70:0/242302420 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621403c030 con 0x562221ebe490 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.487+0000 7f6235432b80 1 -- 172.21.15.70:0/242302420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f621000fc40 con 0x562221ebe490 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.487+0000 7f620e000700 1 -- 172.21.15.70:0/242302420 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(324..324 src has 1..324) ==== 9671+0+0 (secure 0 0 0) 0x7f621402b040 con 0x562221ebe490 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.487+0000 7f620e000700 1 -- 172.21.15.70:0/242302420 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f621400b9e0 con 0x562221ebe490 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.487+0000 7f6235432b80 10 client.18660 fetch_fsmap learned FSMap version 42 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.487+0000 7f6235432b80 1 -- 172.21.15.70:0/242302420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562221f43930 con 0x562221ebe490 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.487+0000 7f620e000700 1 -- 172.21.15.70:0/242302420 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f621000fc40 con 0x562221ebe490 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.488+0000 7f620e000700 1 -- 172.21.15.70:0/242302420 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f6214044030 con 0x562221ebe490 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.488+0000 7f6235432b80 10 client.18660 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.488+0000 7f6235432b80 10 client.18660 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.488+0000 7f6235432b80 20 client.18660 populate_metadata read hostname 'smithi070' 2024-05-08T08:50:13.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.488+0000 7f6235432b80 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562221f43c10 0x562221f46000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:13.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.488+0000 7f6235432b80 4 client.18660 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1de10762", "release": true, "await": true}] 2024-05-08T08:50:13.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.488+0000 7f6235432b80 1 -- 172.21.15.70:0/242302420 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1de10762", "release": true, "await": true}) -- 0x562221e1e500 con 0x562221f43c10 2024-05-08T08:50:13.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.488+0000 7f6223400700 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562221f43c10 0x562221f46000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:13.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.490+0000 7f6223400700 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562221f43c10 0x562221f46000 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32884e525b7b927b server_cookie=b149e4bd8f6bda52 in_seq=0 out_seq=0 2024-05-08T08:50:13.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:13.490+0000 7f620e000700 10 client.18660 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:50:13.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:13 smithi194 ceph-mon[33679]: pgmap v3942: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T08:50:15.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:15 smithi070 ceph-mon[29591]: pgmap v3943: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:50:15.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:15 smithi172 ceph-mon[33377]: pgmap v3943: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:50:15.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:15 smithi194 ceph-mon[33679]: pgmap v3943: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:50:17.375 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:17 smithi070 ceph-mon[29591]: pgmap v3944: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:50:17.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:17 smithi172 ceph-mon[33377]: pgmap v3944: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:50:17.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:17 smithi194 ceph-mon[33679]: pgmap v3944: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:50:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.943+0000 7f620e000700 1 -- 172.21.15.70:0/242302420 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562221e1e500 con 0x562221f43c10 2024-05-08T08:50:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.943+0000 7f620e000700 10 client.18660 handle_command_reply: tid=0 2024-05-08T08:50:17.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.943+0000 7f6235432b80 1 client.18660 shutdown 2024-05-08T08:50:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.947+0000 7f6235432b80 1 -- 172.21.15.70:0/242302420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebe490 msgr2=0x562221ed0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.947+0000 7f6235432b80 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebe490 0x562221ed0b10 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f6214009750 tx=0x7f6214005a10 comp rx=0 tx=0).stop 2024-05-08T08:50:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.948+0000 7f6235432b80 1 -- 172.21.15.70:0/242302420 shutdown_connections 2024-05-08T08:50:17.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.948+0000 7f6235432b80 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562221f43c10 0x562221f46000 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.948+0000 7f6235432b80 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562221ec3ec0 0x562221ecdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.948+0000 7f6235432b80 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562221ebe490 0x562221ed0b10 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.948+0000 7f6235432b80 1 --2- 172.21.15.70:0/242302420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562221ebee50 0x562221ecd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.948+0000 7f6235432b80 1 -- 172.21.15.70:0/242302420 >> 172.21.15.70:0/242302420 conn(0x562221decc60 msgr2=0x562221ec21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.948+0000 7f620e000700 0 client.18660 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:50:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.948+0000 7f6235432b80 1 -- 172.21.15.70:0/242302420 shutdown_connections 2024-05-08T08:50:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.949+0000 7f6235432b80 1 -- 172.21.15.70:0/242302420 wait complete. 2024-05-08T08:50:17.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.950+0000 7f6235432b80 20 client.18660 trim_cache size 0 max 16384 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 276, 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout: "1de10762": { 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 276, 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:50:17.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.8, 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:17.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:17.950 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:50:17.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.954+0000 7f622aa00700 1 -- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f62080b2a70 msgr2=0x7f62080b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.954+0000 7f622aa00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f62080b2a70 0x7f62080b4f30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f621400b5c0 tx=0x7f621401a040 comp rx=0 tx=0).stop 2024-05-08T08:50:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.954+0000 7f622aa00700 1 -- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 msgr2=0x7f622419ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.954+0000 7f622aa00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 0x7f622419ba10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f621c007d70 tx=0x7f621c00a340 comp rx=0 tx=0).stop 2024-05-08T08:50:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.954+0000 7f622aa00700 1 -- 172.21.15.70:0/3316817409 shutdown_connections 2024-05-08T08:50:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.954+0000 7f622aa00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f62080b2a70 0x7f62080b4f30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.954+0000 7f622aa00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f622410b6c0 0x7f622419ba10 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.955+0000 7f622aa00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f62241056c0 0x7f62241a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.955+0000 7f622aa00700 1 --2- 172.21.15.70:0/3316817409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6224106080 0x7f62241a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:17.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.955+0000 7f622aa00700 1 -- 172.21.15.70:0/3316817409 >> 172.21.15.70:0/3316817409 conn(0x7f62241011b0 msgr2=0x7f62241016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:17.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.959+0000 7f622aa00700 1 -- 172.21.15.70:0/3316817409 shutdown_connections 2024-05-08T08:50:17.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:17.959+0000 7f622aa00700 1 -- 172.21.15.70:0/3316817409 wait complete. 2024-05-08T08:50:18.684 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/debugfs.o 2024-05-08T08:50:18.836 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1de10762', seconds elapsed: 79.7 2024-05-08T08:50:18.836 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.75 2024-05-08T08:50:18.836 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:50:19.403 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:50:19.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:19 smithi172 ceph-mon[33377]: pgmap v3945: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:50:19.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:19 smithi194 ceph-mon[33679]: pgmap v3945: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:50:19.562 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:19 smithi070 ceph-mon[29591]: pgmap v3945: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T08:50:20.524 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_bo_util.o 2024-05-08T08:50:20.537 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/hpet.o 2024-05-08T08:50:20.575 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_pcilib.o 2024-05-08T08:50:20.638 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/char/nvram.o 2024-05-08T08:50:20.917 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/display/drm_dp_mst_topology.o 2024-05-08T08:50:20.984 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/intel/pasid.o 2024-05-08T08:50:21.407 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:21 smithi070 ceph-mon[29591]: pgmap v3946: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 206 KiB/s wr, 17 op/s 2024-05-08T08:50:21.407 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:21 smithi070 ceph-mon[29591]: osdmap e325: 12 total, 12 up, 12 in 2024-05-08T08:50:21.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:21 smithi172 ceph-mon[33377]: pgmap v3946: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 206 KiB/s wr, 17 op/s 2024-05-08T08:50:21.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:21 smithi172 ceph-mon[33377]: osdmap e325: 12 total, 12 up, 12 in 2024-05-08T08:50:21.434 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/ipv4/built-in.a 2024-05-08T08:50:21.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:21 smithi194 ceph-mon[33679]: pgmap v3946: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 206 KiB/s wr, 17 op/s 2024-05-08T08:50:21.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:21 smithi194 ceph-mon[33679]: osdmap e325: 12 total, 12 up, 12 in 2024-05-08T08:50:21.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.778+0000 7f7939800700 1 -- 172.21.15.70:0/3645468978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7934075870 msgr2=0x7f7934075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:21.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.778+0000 7f7939800700 1 --2- 172.21.15.70:0/3645468978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7934075870 0x7f7934075c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7924009990 tx=0x7f7924009ca0 comp rx=0 tx=0).stop 2024-05-08T08:50:21.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.778+0000 7f7939800700 1 -- 172.21.15.70:0/3645468978 shutdown_connections 2024-05-08T08:50:21.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.778+0000 7f7939800700 1 --2- 172.21.15.70:0/3645468978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f793410fc70 0x7f7934112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:21.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.778+0000 7f7939800700 1 --2- 172.21.15.70:0/3645468978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7934075870 0x7f7934075c50 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7924009990 tx=0x7f7924009ca0 comp rx=0 tx=0).stop 2024-05-08T08:50:21.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.778+0000 7f7939800700 1 --2- 172.21.15.70:0/3645468978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7934076190 0x7f793410f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:21.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.778+0000 7f7939800700 1 -- 172.21.15.70:0/3645468978 >> 172.21.15.70:0/3645468978 conn(0x7f79340fef20 msgr2=0x7f7934101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:21.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.778+0000 7f7939800700 1 -- 172.21.15.70:0/3645468978 shutdown_connections 2024-05-08T08:50:21.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.778+0000 7f7939800700 1 -- 172.21.15.70:0/3645468978 wait complete. 2024-05-08T08:50:21.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.780+0000 7f7939800700 1 Processor -- start 2024-05-08T08:50:21.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.780+0000 7f7939800700 1 -- start start 2024-05-08T08:50:21.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.780+0000 7f7939800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7934076190 0x7f793410c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:21.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.780+0000 7f7939800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793410fc70 0x7f793410cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:21.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.780+0000 7f7939800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f793410d420 0x7f79341ac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:21.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.780+0000 7f7939800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7934115660 con 0x7f7934076190 2024-05-08T08:50:21.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.780+0000 7f7939800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79341154e0 con 0x7f793410fc70 2024-05-08T08:50:21.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.780+0000 7f7939800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f79341157e0 con 0x7f793410d420 2024-05-08T08:50:21.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.781+0000 7f7938e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f793410d420 0x7f79341ac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:21.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.781+0000 7f7933400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793410fc70 0x7f793410cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:21.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.781+0000 7f7933400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793410fc70 0x7f793410cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:34326/0 (socket says 172.21.15.70:34326) 2024-05-08T08:50:21.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.781+0000 7f7933400700 1 -- 172.21.15.70:0/469624609 learned_addr learned my addr 172.21.15.70:0/469624609 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:21.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.782+0000 7f7938e00700 1 -- 172.21.15.70:0/469624609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793410fc70 msgr2=0x7f793410cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:21.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.782+0000 7f7938e00700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793410fc70 0x7f793410cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:21.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.782+0000 7f7938e00700 1 -- 172.21.15.70:0/469624609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7934076190 msgr2=0x7f793410c9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T08:50:21.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.782+0000 7f7938e00700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7934076190 0x7f793410c9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:21.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.782+0000 7f7938e00700 1 -- 172.21.15.70:0/469624609 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79341ac910 con 0x7f793410d420 2024-05-08T08:50:21.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.782+0000 7f7938e00700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f793410d420 0x7f79341ac3a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f793406bdb0 tx=0x7f792c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:21.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.783+0000 7f7930c00700 1 -- 172.21.15.70:0/469624609 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c00ca50 con 0x7f793410d420 2024-05-08T08:50:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.783+0000 7f7930c00700 1 -- 172.21.15.70:0/469624609 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f792c00cbf0 con 0x7f793410d420 2024-05-08T08:50:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.783+0000 7f7930c00700 1 -- 172.21.15.70:0/469624609 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c004730 con 0x7f793410d420 2024-05-08T08:50:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.783+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79341acba0 con 0x7f793410d420 2024-05-08T08:50:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.784+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79341ad0d0 con 0x7f793410d420 2024-05-08T08:50:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.785+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7934076f20 con 0x7f793410d420 2024-05-08T08:50:21.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.790+0000 7f7930c00700 1 -- 172.21.15.70:0/469624609 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f792c012050 con 0x7f793410d420 2024-05-08T08:50:21.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.792+0000 7f7930c00700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79180b2a70 0x7f79180b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:21.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.793+0000 7f7930c00700 1 -- 172.21.15.70:0/469624609 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(325..325 src has 1..325) ==== 9583+0+0 (secure 0 0 0) 0x7f792c0e3090 con 0x7f793410d420 2024-05-08T08:50:21.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.793+0000 7f7933e00700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79180b2a70 0x7f79180b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:21.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.794+0000 7f7933e00700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79180b2a70 0x7f79180b4f30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7924006010 tx=0x7f792400b610 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:21.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:21.803+0000 7f7930c00700 1 -- 172.21.15.70:0/469624609 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f792c010040 con 0x7f793410d420 2024-05-08T08:50:22.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.273+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f793410df00 con 0x7f793410d420 2024-05-08T08:50:22.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.275+0000 7f7930c00700 1 -- 172.21.15.70:0/469624609 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f793410df00 con 0x7f793410d420 2024-05-08T08:50:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:50:22.272 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:50:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.278+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79180b2a70 msgr2=0x7f79180b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.278+0000 7f7939800700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79180b2a70 0x7f79180b4f30 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7924006010 tx=0x7f792400b610 comp rx=0 tx=0).stop 2024-05-08T08:50:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.278+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f793410d420 msgr2=0x7f79341ac3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.278+0000 7f7939800700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f793410d420 0x7f79341ac3a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f793406bdb0 tx=0x7f792c00c3a0 comp rx=0 tx=0).stop 2024-05-08T08:50:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.279+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 shutdown_connections 2024-05-08T08:50:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.279+0000 7f7939800700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79180b2a70 0x7f79180b4f30 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.279+0000 7f7939800700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f793410d420 0x7f79341ac3a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.279+0000 7f7939800700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7934076190 0x7f793410c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:22.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.279+0000 7f7939800700 1 --2- 172.21.15.70:0/469624609 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f793410fc70 0x7f793410cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:22.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.279+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 >> 172.21.15.70:0/469624609 conn(0x7f79340fef20 msgr2=0x7f7934100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:22.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.279+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 shutdown_connections 2024-05-08T08:50:22.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:22.279+0000 7f7939800700 1 -- 172.21.15.70:0/469624609 wait complete. 2024-05-08T08:50:22.279 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:50:23.133 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 88.75 --await-for 42.0' 2024-05-08T08:50:23.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 88.75 --await-for 42.0 2024-05-08T08:50:23.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:23 smithi070 ceph-mon[29591]: pgmap v3948: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 223 KiB/s wr, 18 op/s 2024-05-08T08:50:23.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:23 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/469624609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:50:23.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:23 smithi172 ceph-mon[33377]: pgmap v3948: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 223 KiB/s wr, 18 op/s 2024-05-08T08:50:23.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:23 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/469624609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:50:23.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:23 smithi194 ceph-mon[33679]: pgmap v3948: 129 pgs: 129 active+clean; 2.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 223 KiB/s wr, 18 op/s 2024-05-08T08:50:23.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:23 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/469624609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:50:23.691 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:50:24.366 INFO:tasks.workunit.client.0.smithi070.stdout: AR net/built-in.a 2024-05-08T08:50:25.362 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:25 smithi070 ceph-mon[29591]: pgmap v3949: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 540 KiB/s wr, 31 op/s 2024-05-08T08:50:25.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:25 smithi172 ceph-mon[33377]: pgmap v3949: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 540 KiB/s wr, 31 op/s 2024-05-08T08:50:25.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:25 smithi194 ceph-mon[33679]: pgmap v3949: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 540 KiB/s wr, 31 op/s 2024-05-08T08:50:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.786+0000 7f703fe00700 1 -- 172.21.15.70:0/3463064445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7040105900 msgr2=0x7f70401102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.786+0000 7f703fe00700 1 --2- 172.21.15.70:0/3463064445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7040105900 0x7f70401102e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f703800b0d0 tx=0x7f703800b3e0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.786+0000 7f703fe00700 1 -- 172.21.15.70:0/3463064445 shutdown_connections 2024-05-08T08:50:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.786+0000 7f703fe00700 1 --2- 172.21.15.70:0/3463064445 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7040105900 0x7f70401102e0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.786+0000 7f703fe00700 1 --2- 172.21.15.70:0/3463064445 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7040103650 0x7f7040103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.786+0000 7f703fe00700 1 --2- 172.21.15.70:0/3463064445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7040104f40 0x7f70401053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.786+0000 7f703fe00700 1 -- 172.21.15.70:0/3463064445 >> 172.21.15.70:0/3463064445 conn(0x7f70400fee00 msgr2=0x7f7040101220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:26.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.786+0000 7f703fe00700 1 -- 172.21.15.70:0/3463064445 shutdown_connections 2024-05-08T08:50:26.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.786+0000 7f703fe00700 1 -- 172.21.15.70:0/3463064445 wait complete. 2024-05-08T08:50:26.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.787+0000 7f703fe00700 1 Processor -- start 2024-05-08T08:50:26.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.788+0000 7f703fe00700 1 -- start start 2024-05-08T08:50:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.788+0000 7f703fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7040103650 0x7f70400757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.788+0000 7f703fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7040104f40 0x7f7040075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.788+0000 7f703fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7040105900 0x7f7040076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.788+0000 7f703fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70401134e0 con 0x7f7040104f40 2024-05-08T08:50:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.788+0000 7f703fe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7040113360 con 0x7f7040103650 2024-05-08T08:50:26.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.788+0000 7f703fe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7040113660 con 0x7f7040105900 2024-05-08T08:50:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.789+0000 7f703ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7040103650 0x7f70400757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.789+0000 7f703e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7040104f40 0x7f7040075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.789+0000 7f703ea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7040103650 0x7f70400757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:34336/0 (socket says 172.21.15.70:34336) 2024-05-08T08:50:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.789+0000 7f703ea00700 1 -- 172.21.15.70:0/1506559315 learned_addr learned my addr 172.21.15.70:0/1506559315 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:26.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.789+0000 7f703f400700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7040105900 0x7f7040076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.790+0000 7f703f400700 1 -- 172.21.15.70:0/1506559315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7040103650 msgr2=0x7f70400757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.790+0000 7f703f400700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7040103650 0x7f70400757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.790+0000 7f703f400700 1 -- 172.21.15.70:0/1506559315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7040104f40 msgr2=0x7f7040075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.790+0000 7f703f400700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7040104f40 0x7f7040075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.790+0000 7f703f400700 1 -- 172.21.15.70:0/1506559315 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70401a7e20 con 0x7f7040105900 2024-05-08T08:50:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.790+0000 7f703ea00700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7040103650 0x7f70400757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:50:26.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.790+0000 7f703f400700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7040105900 0x7f7040076220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f703800b770 tx=0x7f7038007980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.791+0000 7f7037400700 1 -- 172.21.15.70:0/1506559315 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703801f020 con 0x7f7040105900 2024-05-08T08:50:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.791+0000 7f703fe00700 1 -- 172.21.15.70:0/1506559315 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70401a80b0 con 0x7f7040105900 2024-05-08T08:50:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.791+0000 7f703fe00700 1 -- 172.21.15.70:0/1506559315 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70401a8560 con 0x7f7040105900 2024-05-08T08:50:26.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.792+0000 7f7037400700 1 -- 172.21.15.70:0/1506559315 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7038005070 con 0x7f7040105900 2024-05-08T08:50:26.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.792+0000 7f7037400700 1 -- 172.21.15.70:0/1506559315 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70380074e0 con 0x7f7040105900 2024-05-08T08:50:26.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.798+0000 7f7037400700 1 -- 172.21.15.70:0/1506559315 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7038022020 con 0x7f7040105900 2024-05-08T08:50:26.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.800+0000 7f7037400700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70240b2af0 0x7f70240b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.801+0000 7f7037400700 1 -- 172.21.15.70:0/1506559315 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(325..325 src has 1..325) ==== 9583+0+0 (secure 0 0 0) 0x7f703800f020 con 0x7f7040105900 2024-05-08T08:50:26.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.801+0000 7f703ea00700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70240b2af0 0x7f70240b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.811+0000 7f703ea00700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70240b2af0 0x7f70240b4fb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7030011550 tx=0x7f7030009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.814+0000 7f7050367b80 1 Processor -- start 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.814+0000 7f7050367b80 1 -- start start 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f7050367b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 0x558e3d0bd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f7050367b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5500 0x558e3d0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f7050367b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f7050367b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e3d00abb0 con 0x558e3d0b5ec0 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f7050367b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558e3cfa88f0 con 0x558e3d0b5500 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f7050367b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558e3d006b70 con 0x558e3d0bd130 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f703f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f703f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39556/0 (socket says 172.21.15.70:39556) 2024-05-08T08:50:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f703f400700 1 -- 172.21.15.70:0/1416295034 learned_addr learned my addr 172.21.15.70:0/1416295034 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.815+0000 7f703ea00700 1 --2- 172.21.15.70:0/1416295034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 0x558e3d0bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.816+0000 7f703e000700 1 --2- 172.21.15.70:0/1416295034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5500 0x558e3d0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.816+0000 7f703f400700 1 -- 172.21.15.70:0/1416295034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 msgr2=0x558e3d0bd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.816+0000 7f703f400700 1 --2- 172.21.15.70:0/1416295034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 0x558e3d0bd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.816+0000 7f703f400700 1 -- 172.21.15.70:0/1416295034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5500 msgr2=0x558e3d0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:26.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.816+0000 7f703f400700 1 --2- 172.21.15.70:0/1416295034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5500 0x558e3d0b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.816+0000 7f703f400700 1 -- 172.21.15.70:0/1416295034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3cf57a60 con 0x558e3d0b5ec0 2024-05-08T08:50:26.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.817+0000 7f703f400700 1 --2- 172.21.15.70:0/1416295034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d5d60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f703800b0d0 tx=0x7f70380aad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806649287502eccf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.818+0000 7f702be00700 1 -- 172.21.15.70:0/1416295034 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70380e4170 con 0x558e3d0b5ec0 2024-05-08T08:50:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.818+0000 7f702be00700 1 -- 172.21.15.70:0/1416295034 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70380af630 con 0x558e3d0b5ec0 2024-05-08T08:50:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.818+0000 7f702be00700 1 -- 172.21.15.70:0/1416295034 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70380b3e20 con 0x558e3d0b5ec0 2024-05-08T08:50:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.819+0000 7f7050367b80 1 -- 172.21.15.70:0/1416295034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 msgr2=0x558e3d0d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:26.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.819+0000 7f7050367b80 1 --2- 172.21.15.70:0/1416295034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d5d60 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f703800b0d0 tx=0x7f70380aad90 comp rx=0 tx=0).stop 2024-05-08T08:50:26.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.819+0000 7f7050367b80 1 -- 172.21.15.70:0/1416295034 shutdown_connections 2024-05-08T08:50:26.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.819+0000 7f7050367b80 1 --2- 172.21.15.70:0/1416295034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d5d60 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.819+0000 7f7050367b80 1 --2- 172.21.15.70:0/1416295034 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 0x558e3d0bd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.819+0000 7f7050367b80 1 --2- 172.21.15.70:0/1416295034 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5500 0x558e3d0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.819+0000 7f7050367b80 1 -- 172.21.15.70:0/1416295034 >> 172.21.15.70:0/1416295034 conn(0x558e3cfe6cf0 msgr2=0x558e3d0b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:26.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.819+0000 7f7050367b80 1 -- 172.21.15.70:0/1416295034 shutdown_connections 2024-05-08T08:50:26.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.819+0000 7f7050367b80 1 -- 172.21.15.70:0/1416295034 wait complete. 2024-05-08T08:50:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.820+0000 7f7050367b80 1 -- start start 2024-05-08T08:50:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.820+0000 7f7050367b80 1 Processor -- start 2024-05-08T08:50:26.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.821+0000 7f7050367b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.821+0000 7f7050367b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.821+0000 7f7050367b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0bd130 0x558e3d0d3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.821+0000 7f7050367b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e3d00abb0 con 0x558e3d0bd130 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.821+0000 7f7050367b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558e3cf70cb0 con 0x558e3d0b5ec0 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.821+0000 7f7050367b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558e3d0d62a0 con 0x558e3d0b5500 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.821+0000 7f7050367b80 10 client.0 _ll_register_callbacks cb 0x558e3cfb1e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.822+0000 7f703ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.822+0000 7f703e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.822+0000 7f703f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0bd130 0x558e3d0d3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.822+0000 7f703ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:59406/0 (socket says 172.21.15.70:59406) 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.822+0000 7f703e000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:34346/0 (socket says 172.21.15.70:34346) 2024-05-08T08:50:26.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.822+0000 7f703ea00700 1 -- 172.21.15.70:0/428548153 learned_addr learned my addr 172.21.15.70:0/428548153 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:26.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.823+0000 7f703f400700 1 -- 172.21.15.70:0/428548153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 msgr2=0x558e3d0d5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:26.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.823+0000 7f703f400700 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.823+0000 7f703f400700 1 -- 172.21.15.70:0/428548153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 msgr2=0x558e3d0d2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.823+0000 7f703f400700 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.823+0000 7f703f400700 1 -- 172.21.15.70:0/428548153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3cfd05b0 con 0x558e3d0bd130 2024-05-08T08:50:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.823+0000 7f703ea00700 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:50:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.823+0000 7f703f400700 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0bd130 0x558e3d0d3330 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f70380b4210 tx=0x7f70380a7270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5a753a1a25a3e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.823+0000 7f7028c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:50:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.824+0000 7f7028c00700 1 -- 172.21.15.70:0/428548153 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70380c4020 con 0x558e3d0bd130 2024-05-08T08:50:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.824+0000 7f7028c00700 1 -- 172.21.15.70:0/428548153 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(325..325 src has 1..325) ==== 9583+0+0 (secure 0 0 0) 0x7f70380af330 con 0x558e3d0bd130 2024-05-08T08:50:26.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.824+0000 7f7050367b80 1 -- 172.21.15.70:0/428548153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70380af630 con 0x558e3d0bd130 2024-05-08T08:50:26.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.825+0000 7f7028c00700 1 -- 172.21.15.70:0/428548153 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f70380e4170 con 0x558e3d0bd130 2024-05-08T08:50:26.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.825+0000 7f7050367b80 10 client.18675 fetch_fsmap learned FSMap version 42 2024-05-08T08:50:26.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.825+0000 7f7050367b80 1 -- 172.21.15.70:0/428548153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558e3d0e08f0 con 0x558e3d0bd130 2024-05-08T08:50:26.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.825+0000 7f7028c00700 1 -- 172.21.15.70:0/428548153 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f70380af630 con 0x558e3d0bd130 2024-05-08T08:50:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.826+0000 7f7028c00700 1 -- 172.21.15.70:0/428548153 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f703802c060 con 0x558e3d0bd130 2024-05-08T08:50:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.826+0000 7f7050367b80 10 client.18675 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:50:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.826+0000 7f7050367b80 10 client.18675 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:50:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.826+0000 7f7050367b80 20 client.18675 populate_metadata read hostname 'smithi070' 2024-05-08T08:50:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.826+0000 7f7050367b80 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558e3d0e2ce0 0x558e3d0e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.826+0000 7f7050367b80 4 client.18675 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:50:26.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.826+0000 7f7050367b80 1 -- 172.21.15.70:0/428548153 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e3d085230 con 0x558e3d0e2ce0 2024-05-08T08:50:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.827+0000 7f703ea00700 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558e3d0e2ce0 0x558e3d0e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.828+0000 7f703ea00700 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558e3d0e2ce0 0x558e3d0e50d0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb77ce999f5da611 server_cookie=499d3ca23d7bbeef in_seq=0 out_seq=0 2024-05-08T08:50:26.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.828+0000 7f7028c00700 10 client.18675 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:50:26.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7028c00700 1 -- 172.21.15.70:0/428548153 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558e3d085230 con 0x558e3d0e2ce0 2024-05-08T08:50:26.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7028c00700 10 client.18675 handle_command_reply: tid=0 2024-05-08T08:50:26.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7050367b80 1 client.18675 shutdown 2024-05-08T08:50:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7050367b80 1 -- 172.21.15.70:0/428548153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0bd130 msgr2=0x558e3d0d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7050367b80 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0bd130 0x558e3d0d3330 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f70380b4210 tx=0x7f70380a7270 comp rx=0 tx=0).stop 2024-05-08T08:50:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7050367b80 1 -- 172.21.15.70:0/428548153 shutdown_connections 2024-05-08T08:50:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7050367b80 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558e3d0e2ce0 0x558e3d0e50d0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7050367b80 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0bd130 0x558e3d0d3330 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7050367b80 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7050367b80 1 --2- 172.21.15.70:0/428548153 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.830+0000 7f7050367b80 1 -- 172.21.15.70:0/428548153 >> 172.21.15.70:0/428548153 conn(0x558e3cfe6cf0 msgr2=0x558e3d0bdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.831+0000 7f7028c00700 0 client.18675 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:50:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.831+0000 7f7050367b80 1 -- 172.21.15.70:0/428548153 shutdown_connections 2024-05-08T08:50:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.831+0000 7f7050367b80 1 -- 172.21.15.70:0/428548153 wait complete. 2024-05-08T08:50:26.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.831+0000 7f7050367b80 20 client.18675 trim_cache size 0 max 16384 2024-05-08T08:50:26.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.867+0000 7f7050367b80 1 Processor -- start 2024-05-08T08:50:26.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.867+0000 7f7050367b80 1 -- start start 2024-05-08T08:50:26.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f7050367b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5500 0x558e3d0d26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f7050367b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f7050367b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 0x558e3d0d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f7050367b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70200117b0 con 0x558e3d0b5500 2024-05-08T08:50:26.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f7050367b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f702000f040 con 0x558e3d0b5ec0 2024-05-08T08:50:26.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f7050367b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f702000ceb0 con 0x558e3d0bd130 2024-05-08T08:50:26.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f703ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5500 0x558e3d0d26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f703ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5500 0x558e3d0d26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39576/0 (socket says 172.21.15.70:39576) 2024-05-08T08:50:26.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f703ea00700 1 -- 172.21.15.70:0/3677438516 learned_addr learned my addr 172.21.15.70:0/3677438516 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:26.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.868+0000 7f703e000700 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.869+0000 7f703f400700 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 0x558e3d0d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.869+0000 7f703e000700 1 -- 172.21.15.70:0/3677438516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 msgr2=0x558e3d0d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.869+0000 7f703e000700 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 0x558e3d0d32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.869+0000 7f703e000700 1 -- 172.21.15.70:0/3677438516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5500 msgr2=0x558e3d0d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.869+0000 7f703e000700 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5500 0x558e3d0d26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.869+0000 7f703e000700 1 -- 172.21.15.70:0/3677438516 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e3d0dfbe0 con 0x558e3d0b5ec0 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.869+0000 7f703ea00700 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5500 0x558e3d0d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.870+0000 7f703e000700 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x558e3d0d43c0 tx=0x7f702c009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f36443902992036b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.870+0000 7f702b400700 1 -- 172.21.15.70:0/3677438516 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c004a30 con 0x558e3d0b5ec0 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.870+0000 7f702b400700 1 -- 172.21.15.70:0/3677438516 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702c0054b0 con 0x558e3d0b5ec0 2024-05-08T08:50:26.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.870+0000 7f702b400700 1 -- 172.21.15.70:0/3677438516 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c003a50 con 0x558e3d0b5ec0 2024-05-08T08:50:26.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 -- 172.21.15.70:0/3677438516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 msgr2=0x558e3d0d2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2db0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x558e3d0d43c0 tx=0x7f702c009ba0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 -- 172.21.15.70:0/3677438516 shutdown_connections 2024-05-08T08:50:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0bd130 0x558e3d0d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5500 0x558e3d0d26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 --2- 172.21.15.70:0/3677438516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d2db0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 -- 172.21.15.70:0/3677438516 >> 172.21.15.70:0/3677438516 conn(0x558e3cfe6cf0 msgr2=0x558e3d0b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 -- 172.21.15.70:0/3677438516 shutdown_connections 2024-05-08T08:50:26.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 -- 172.21.15.70:0/3677438516 wait complete. 2024-05-08T08:50:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.872+0000 7f7050367b80 1 -- start start 2024-05-08T08:50:26.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.873+0000 7f7050367b80 1 Processor -- start 2024-05-08T08:50:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.874+0000 7f7050367b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.874+0000 7f7050367b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.874+0000 7f7050367b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0bd130 0x558e3d14c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.875+0000 7f703ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.875+0000 7f7050367b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f702000d500 con 0x558e3d0b5ec0 2024-05-08T08:50:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.875+0000 7f7050367b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f702000e970 con 0x558e3d0bd130 2024-05-08T08:50:26.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.875+0000 7f7050367b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f702000dbd0 con 0x558e3d0b5500 2024-05-08T08:50:26.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.875+0000 7f7050367b80 10 client.0 _ll_register_callbacks cb 0x558e3cfb1e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:50:26.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.875+0000 7f703f400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0bd130 0x558e3d14c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.875+0000 7f703ea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:59412/0 (socket says 172.21.15.70:59412) 2024-05-08T08:50:26.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.875+0000 7f703ea00700 1 -- 172.21.15.70:0/2562069539 learned_addr learned my addr 172.21.15.70:0/2562069539 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:50:26.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.876+0000 7f703e000700 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.876+0000 7f703f400700 1 -- 172.21.15.70:0/2562069539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 msgr2=0x558e3d0d7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:26.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.876+0000 7f703f400700 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.876+0000 7f703f400700 1 -- 172.21.15.70:0/2562069539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 msgr2=0x558e3d0d7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:50:26.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.877+0000 7f703f400700 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:26.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.877+0000 7f703f400700 1 -- 172.21.15.70:0/2562069539 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e3d14ca90 con 0x558e3d0bd130 2024-05-08T08:50:26.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.877+0000 7f703e000700 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:50:26.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.877+0000 7f703f400700 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0bd130 0x558e3d14c550 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70380a6fb0 tx=0x7f70380af560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dfdac83fa9dd7d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:50:26.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.877+0000 7f7028c00700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:50:26.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.878+0000 7f7028c00700 1 -- 172.21.15.70:0/2562069539 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70380c4070 con 0x558e3d0bd130 2024-05-08T08:50:26.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.878+0000 7f7028c00700 1 -- 172.21.15.70:0/2562069539 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(325..325 src has 1..325) ==== 9583+0+0 (secure 0 0 0) 0x7f70380aa4e0 con 0x558e3d0bd130 2024-05-08T08:50:26.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.878+0000 7f7050367b80 1 -- 172.21.15.70:0/2562069539 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f702c0054b0 con 0x558e3d0bd130 2024-05-08T08:50:26.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.878+0000 7f7028c00700 1 -- 172.21.15.70:0/2562069539 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f70380b4050 con 0x558e3d0bd130 2024-05-08T08:50:26.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.879+0000 7f7050367b80 10 client.37400 fetch_fsmap learned FSMap version 42 2024-05-08T08:50:26.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.879+0000 7f7050367b80 1 -- 172.21.15.70:0/2562069539 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558e3d14ca90 con 0x558e3d0bd130 2024-05-08T08:50:26.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.879+0000 7f7028c00700 1 -- 172.21.15.70:0/2562069539 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702c0054b0 con 0x558e3d0bd130 2024-05-08T08:50:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.880+0000 7f7028c00700 1 -- 172.21.15.70:0/2562069539 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f7038011070 con 0x558e3d0bd130 2024-05-08T08:50:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.880+0000 7f7050367b80 10 client.37400 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:50:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.880+0000 7f7050367b80 10 client.37400 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:50:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.880+0000 7f7050367b80 20 client.37400 populate_metadata read hostname 'smithi070' 2024-05-08T08:50:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.880+0000 7f7050367b80 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558e3d14dee0 0x558e3d1502d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:50:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.881+0000 7f7050367b80 4 client.37400 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.75, "await_for": 42.0}] 2024-05-08T08:50:26.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.881+0000 7f7050367b80 1 -- 172.21.15.70:0/2562069539 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.75, "await_for": 42.0}) -- 0x558e3d018590 con 0x558e3d14dee0 2024-05-08T08:50:26.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.881+0000 7f703ea00700 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558e3d14dee0 0x558e3d1502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:50:26.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.882+0000 7f703ea00700 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558e3d14dee0 0x558e3d1502d0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97f792581d75bcdc server_cookie=dbe226ad492d68b0 in_seq=0 out_seq=0 2024-05-08T08:50:26.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:26.882+0000 7f7028c00700 10 client.37400 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:50:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:27 smithi172 ceph-mon[33377]: pgmap v3950: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 540 KiB/s wr, 33 op/s 2024-05-08T08:50:27.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:27 smithi194 ceph-mon[33679]: pgmap v3950: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 540 KiB/s wr, 33 op/s 2024-05-08T08:50:27.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:27 smithi070 ceph-mon[29591]: pgmap v3950: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 540 KiB/s wr, 33 op/s 2024-05-08T08:50:27.912 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_lpat.o 2024-05-08T08:50:29.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:29 smithi172 ceph-mon[33377]: pgmap v3951: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 540 KiB/s wr, 33 op/s 2024-05-08T08:50:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:29 smithi194 ceph-mon[33679]: pgmap v3951: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 540 KiB/s wr, 33 op/s 2024-05-08T08:50:29.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:29 smithi070 ceph-mon[29591]: pgmap v3951: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 551 KiB/s rd, 540 KiB/s wr, 33 op/s 2024-05-08T08:50:31.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:31 smithi172 ceph-mon[33377]: pgmap v3952: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 660 KiB/s wr, 34 op/s 2024-05-08T08:50:31.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:31 smithi194 ceph-mon[33679]: pgmap v3952: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 660 KiB/s wr, 34 op/s 2024-05-08T08:50:31.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:31 smithi070 ceph-mon[29591]: pgmap v3952: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 660 KiB/s wr, 34 op/s 2024-05-08T08:50:33.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:33 smithi172 ceph-mon[33377]: pgmap v3953: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 592 KiB/s wr, 31 op/s 2024-05-08T08:50:33.429 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:33 smithi070 ceph-mon[29591]: pgmap v3953: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 592 KiB/s wr, 31 op/s 2024-05-08T08:50:33.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:33 smithi194 ceph-mon[33679]: pgmap v3953: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 592 KiB/s wr, 31 op/s 2024-05-08T08:50:35.426 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:35 smithi172 ceph-mon[33377]: pgmap v3954: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 607 KiB/s wr, 32 op/s 2024-05-08T08:50:35.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:35 smithi194 ceph-mon[33679]: pgmap v3954: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 607 KiB/s wr, 32 op/s 2024-05-08T08:50:35.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:35 smithi070 ceph-mon[29591]: pgmap v3954: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 607 KiB/s wr, 32 op/s 2024-05-08T08:50:37.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:37 smithi194 ceph-mon[33679]: pgmap v3955: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 344 KiB/s wr, 21 op/s 2024-05-08T08:50:37.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:37 smithi070 ceph-mon[29591]: pgmap v3955: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 344 KiB/s wr, 21 op/s 2024-05-08T08:50:37.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:37 smithi172 ceph-mon[33377]: pgmap v3955: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 344 KiB/s wr, 21 op/s 2024-05-08T08:50:39.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:39 smithi194 ceph-mon[33679]: pgmap v3956: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 344 KiB/s wr, 18 op/s 2024-05-08T08:50:39.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:39 smithi070 ceph-mon[29591]: pgmap v3956: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 344 KiB/s wr, 18 op/s 2024-05-08T08:50:39.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:39 smithi172 ceph-mon[33377]: pgmap v3956: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 344 KiB/s wr, 18 op/s 2024-05-08T08:50:41.507 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:41 smithi194 ceph-mon[33679]: pgmap v3957: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 352 KiB/s wr, 22 op/s 2024-05-08T08:50:41.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:41 smithi070 ceph-mon[29591]: pgmap v3957: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 352 KiB/s wr, 22 op/s 2024-05-08T08:50:41.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:41 smithi172 ceph-mon[33377]: pgmap v3957: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 352 KiB/s wr, 22 op/s 2024-05-08T08:50:43.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:43 smithi194 ceph-mon[33679]: pgmap v3958: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 66 KiB/s wr, 8 op/s 2024-05-08T08:50:43.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:43 smithi070 ceph-mon[29591]: pgmap v3958: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 66 KiB/s wr, 8 op/s 2024-05-08T08:50:43.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:43 smithi172 ceph-mon[33377]: pgmap v3958: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 66 KiB/s wr, 8 op/s 2024-05-08T08:50:45.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:45 smithi194 ceph-mon[33679]: pgmap v3959: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 139 KiB/s wr, 15 op/s 2024-05-08T08:50:45.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:45 smithi070 ceph-mon[29591]: pgmap v3959: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 139 KiB/s wr, 15 op/s 2024-05-08T08:50:45.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:45 smithi172 ceph-mon[33377]: pgmap v3959: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 139 KiB/s wr, 15 op/s 2024-05-08T08:50:46.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:46 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:50:46.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:46 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:50:46.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:46 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:50:47.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:47 smithi194 ceph-mon[33679]: pgmap v3960: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 82 KiB/s wr, 12 op/s 2024-05-08T08:50:47.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:47 smithi070 ceph-mon[29591]: pgmap v3960: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 82 KiB/s wr, 12 op/s 2024-05-08T08:50:47.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:47 smithi172 ceph-mon[33377]: pgmap v3960: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 82 KiB/s wr, 12 op/s 2024-05-08T08:50:48.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:50:48.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:50:48.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:50:48.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:50:48.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:50:48.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:50:48.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:50:48.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:50:48.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:50:49.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:49 smithi194 ceph-mon[33679]: pgmap v3961: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 82 KiB/s wr, 11 op/s 2024-05-08T08:50:49.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:49 smithi070 ceph-mon[29591]: pgmap v3961: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 82 KiB/s wr, 11 op/s 2024-05-08T08:50:49.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:49 smithi172 ceph-mon[33377]: pgmap v3961: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 82 KiB/s wr, 11 op/s 2024-05-08T08:50:50.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.827+0000 7f7028c00700 1 -- 172.21.15.70:0/2562069539 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x558e3d018590 con 0x558e3d14dee0 2024-05-08T08:50:50.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.827+0000 7f7028c00700 10 client.37400 handle_command_reply: tid=0 2024-05-08T08:50:50.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.827+0000 7f7050367b80 1 client.37400 shutdown 2024-05-08T08:50:50.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.828+0000 7f7050367b80 1 -- 172.21.15.70:0/2562069539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0bd130 msgr2=0x558e3d14c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.828+0000 7f7050367b80 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0bd130 0x558e3d14c550 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70380a6fb0 tx=0x7f70380af560 comp rx=0 tx=0).stop 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.828+0000 7f7050367b80 1 -- 172.21.15.70:0/2562069539 shutdown_connections 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.828+0000 7f7050367b80 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558e3d14dee0 0x558e3d1502d0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.828+0000 7f7050367b80 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558e3d0bd130 0x558e3d14c550 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.828+0000 7f7050367b80 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558e3d0b5500 0x558e3d0d7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.828+0000 7f7050367b80 1 --2- 172.21.15.70:0/2562069539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e3d0b5ec0 0x558e3d0d7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.828+0000 7f7050367b80 1 -- 172.21.15.70:0/2562069539 >> 172.21.15.70:0/2562069539 conn(0x558e3cfe6cf0 msgr2=0x558e3d0d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.828+0000 7f7028c00700 0 client.37400 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.829+0000 7f7050367b80 1 -- 172.21.15.70:0/2562069539 shutdown_connections 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.829+0000 7f7050367b80 1 -- 172.21.15.70:0/2562069539 wait complete. 2024-05-08T08:50:50.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.829+0000 7f7050367b80 20 client.37400 trim_cache size 0 max 16384 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 278, 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "f554ec2b": { 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 278, 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:50:50.828 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.8, 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:50:50.829 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:50:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.831+0000 7f703fe00700 1 -- 172.21.15.70:0/1506559315 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70240b2af0 msgr2=0x7f70240b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.831+0000 7f703fe00700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70240b2af0 0x7f70240b4fb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7030011550 tx=0x7f7030009260 comp rx=0 tx=0).stop 2024-05-08T08:50:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.831+0000 7f703fe00700 1 -- 172.21.15.70:0/1506559315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7040105900 msgr2=0x7f7040076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:50:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.831+0000 7f703fe00700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7040105900 0x7f7040076220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f703800b770 tx=0x7f7038007980 comp rx=0 tx=0).stop 2024-05-08T08:50:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.832+0000 7f703fe00700 1 -- 172.21.15.70:0/1506559315 shutdown_connections 2024-05-08T08:50:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.832+0000 7f703fe00700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f70240b2af0 0x7f70240b4fb0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:50.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.832+0000 7f703fe00700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7040105900 0x7f7040076220 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.832+0000 7f703fe00700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7040103650 0x7f70400757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.832+0000 7f703fe00700 1 --2- 172.21.15.70:0/1506559315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7040104f40 0x7f7040075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:50:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.832+0000 7f703fe00700 1 -- 172.21.15.70:0/1506559315 >> 172.21.15.70:0/1506559315 conn(0x7f70400fee00 msgr2=0x7f70400ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:50:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.833+0000 7f703fe00700 1 -- 172.21.15.70:0/1506559315 shutdown_connections 2024-05-08T08:50:50.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:50:50.833+0000 7f703fe00700 1 -- 172.21.15.70:0/1506559315 wait complete. 2024-05-08T08:50:51.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:51 smithi194 ceph-mon[33679]: pgmap v3962: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 125 KiB/s wr, 14 op/s 2024-05-08T08:50:51.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:51 smithi070 ceph-mon[29591]: pgmap v3962: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 125 KiB/s wr, 14 op/s 2024-05-08T08:50:51.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:51 smithi172 ceph-mon[33377]: pgmap v3962: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 125 KiB/s wr, 14 op/s 2024-05-08T08:50:51.822 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f554ec2b', quiesce took 33.0 seconds. Will release after: 28.75 2024-05-08T08:50:53.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:53 smithi194 ceph-mon[33679]: pgmap v3963: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 10 op/s 2024-05-08T08:50:53.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:53 smithi070 ceph-mon[29591]: pgmap v3963: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 10 op/s 2024-05-08T08:50:53.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:53 smithi172 ceph-mon[33377]: pgmap v3963: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 10 op/s 2024-05-08T08:50:55.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:55 smithi194 ceph-mon[33679]: pgmap v3964: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 176 KiB/s wr, 15 op/s 2024-05-08T08:50:55.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:55 smithi070 ceph-mon[29591]: pgmap v3964: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 176 KiB/s wr, 15 op/s 2024-05-08T08:50:55.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:55 smithi172 ceph-mon[33377]: pgmap v3964: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 176 KiB/s wr, 15 op/s 2024-05-08T08:50:57.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:57 smithi194 ceph-mon[33679]: pgmap v3965: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 104 KiB/s wr, 9 op/s 2024-05-08T08:50:57.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:57 smithi070 ceph-mon[29591]: pgmap v3965: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 104 KiB/s wr, 9 op/s 2024-05-08T08:50:57.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:57 smithi172 ceph-mon[33377]: pgmap v3965: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 104 KiB/s wr, 9 op/s 2024-05-08T08:50:59.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:50:59 smithi194 ceph-mon[33679]: pgmap v3966: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 103 KiB/s wr, 8 op/s 2024-05-08T08:50:59.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:50:59 smithi070 ceph-mon[29591]: pgmap v3966: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 103 KiB/s wr, 8 op/s 2024-05-08T08:50:59.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:50:59 smithi172 ceph-mon[33377]: pgmap v3966: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 103 KiB/s wr, 8 op/s 2024-05-08T08:51:01.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:01 smithi070 ceph-mon[29591]: pgmap v3967: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 141 KiB/s wr, 12 op/s 2024-05-08T08:51:01.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:01 smithi172 ceph-mon[33377]: pgmap v3967: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 141 KiB/s wr, 12 op/s 2024-05-08T08:51:01.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:01 smithi194 ceph-mon[33679]: pgmap v3967: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 141 KiB/s wr, 12 op/s 2024-05-08T08:51:03.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:03 smithi070 ceph-mon[29591]: pgmap v3968: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 97 KiB/s wr, 9 op/s 2024-05-08T08:51:03.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:03 smithi172 ceph-mon[33377]: pgmap v3968: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 97 KiB/s wr, 9 op/s 2024-05-08T08:51:03.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:03 smithi194 ceph-mon[33679]: pgmap v3968: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 97 KiB/s wr, 9 op/s 2024-05-08T08:51:05.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:05 smithi070 ceph-mon[29591]: pgmap v3969: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 203 KiB/s wr, 28 op/s 2024-05-08T08:51:05.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:05 smithi172 ceph-mon[33377]: pgmap v3969: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 203 KiB/s wr, 28 op/s 2024-05-08T08:51:05.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:05 smithi194 ceph-mon[33679]: pgmap v3969: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 203 KiB/s wr, 28 op/s 2024-05-08T08:51:07.561 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:07 smithi194 ceph-mon[33679]: pgmap v3970: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 144 KiB/s wr, 24 op/s 2024-05-08T08:51:07.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:07 smithi070 ceph-mon[29591]: pgmap v3970: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 144 KiB/s wr, 24 op/s 2024-05-08T08:51:07.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:07 smithi172 ceph-mon[33377]: pgmap v3970: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 144 KiB/s wr, 24 op/s 2024-05-08T08:51:09.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:09 smithi070 ceph-mon[29591]: pgmap v3971: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 144 KiB/s wr, 23 op/s 2024-05-08T08:51:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:09 smithi172 ceph-mon[33377]: pgmap v3971: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 144 KiB/s wr, 23 op/s 2024-05-08T08:51:09.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:09 smithi194 ceph-mon[33679]: pgmap v3971: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 144 KiB/s wr, 23 op/s 2024-05-08T08:51:11.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:11 smithi070 ceph-mon[29591]: pgmap v3972: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 144 KiB/s wr, 26 op/s 2024-05-08T08:51:11.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:11 smithi070 ceph-mon[29591]: osdmap e326: 12 total, 12 up, 12 in 2024-05-08T08:51:11.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:11 smithi172 ceph-mon[33377]: pgmap v3972: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 144 KiB/s wr, 26 op/s 2024-05-08T08:51:11.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:11 smithi172 ceph-mon[33377]: osdmap e326: 12 total, 12 up, 12 in 2024-05-08T08:51:11.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:11 smithi194 ceph-mon[33679]: pgmap v3972: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 144 KiB/s wr, 26 op/s 2024-05-08T08:51:11.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:11 smithi194 ceph-mon[33679]: osdmap e326: 12 total, 12 up, 12 in 2024-05-08T08:51:13.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:13 smithi070 ceph-mon[29591]: pgmap v3974: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 127 KiB/s wr, 27 op/s 2024-05-08T08:51:13.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:13 smithi172 ceph-mon[33377]: pgmap v3974: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 127 KiB/s wr, 27 op/s 2024-05-08T08:51:13.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:13 smithi194 ceph-mon[33679]: pgmap v3974: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 127 KiB/s wr, 27 op/s 2024-05-08T08:51:15.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:15 smithi070 ceph-mon[29591]: pgmap v3975: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:15.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:15 smithi172 ceph-mon[33377]: pgmap v3975: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:15.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:15 smithi194 ceph-mon[33679]: pgmap v3975: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:17.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:17 smithi070 ceph-mon[29591]: pgmap v3976: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:17.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:17 smithi172 ceph-mon[33377]: pgmap v3976: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:17.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:17 smithi194 ceph-mon[33679]: pgmap v3976: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:19.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:19 smithi070 ceph-mon[29591]: pgmap v3977: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:19 smithi172 ceph-mon[33377]: pgmap v3977: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:19.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:19 smithi194 ceph-mon[33679]: pgmap v3977: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:20.574 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:51:21.060 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:51:21.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:21 smithi070 ceph-mon[29591]: pgmap v3978: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:21.471 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:21 smithi070 ceph-mon[29591]: osdmap e327: 12 total, 12 up, 12 in 2024-05-08T08:51:21.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:21 smithi172 ceph-mon[33377]: pgmap v3978: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:21.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:21 smithi172 ceph-mon[33377]: osdmap e327: 12 total, 12 up, 12 in 2024-05-08T08:51:21.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:21 smithi194 ceph-mon[33679]: pgmap v3978: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:21.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:21 smithi194 ceph-mon[33679]: osdmap e327: 12 total, 12 up, 12 in 2024-05-08T08:51:23.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.489+0000 7fc5f8c00700 1 -- 172.21.15.70:0/89240740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4104100 msgr2=0x7fc5f4108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:23.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.489+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/89240740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4104100 0x7fc5f4108120 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fc5e00099c0 tx=0x7fc5e0009cd0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.489+0000 7fc5f8c00700 1 -- 172.21.15.70:0/89240740 shutdown_connections 2024-05-08T08:51:23.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.489+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/89240740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f4108850 0x7fc5f41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.489+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/89240740 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4103750 0x7fc5f4103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.489+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/89240740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4104100 0x7fc5f4108120 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.489+0000 7fc5f8c00700 1 -- 172.21.15.70:0/89240740 >> 172.21.15.70:0/89240740 conn(0x7fc5f407a600 msgr2=0x7fc5f407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.489+0000 7fc5f8c00700 1 -- 172.21.15.70:0/89240740 shutdown_connections 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.489+0000 7fc5f8c00700 1 -- 172.21.15.70:0/89240740 wait complete. 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.490+0000 7fc5f8c00700 1 Processor -- start 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.490+0000 7fc5f8c00700 1 -- start start 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.491+0000 7fc5f8c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4103750 0x7fc5f419f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.491+0000 7fc5f8c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f4104100 0x7fc5f419fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.491+0000 7fc5f8c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4108850 0x7fc5f41997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.491+0000 7fc5f8c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4113510 con 0x7fc5f4108850 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.491+0000 7fc5f8c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4113390 con 0x7fc5f4103750 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.491+0000 7fc5f8c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4113690 con 0x7fc5f4104100 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.491+0000 7fc5f2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4108850 0x7fc5f41997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:23.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.491+0000 7fc5f2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4108850 0x7fc5f41997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54202/0 (socket says 172.21.15.70:54202) 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.491+0000 7fc5f2800700 1 -- 172.21.15.70:0/3411156619 learned_addr learned my addr 172.21.15.70:0/3411156619 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.492+0000 7fc5f1400700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f4104100 0x7fc5f419fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.492+0000 7fc5f1e00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4103750 0x7fc5f419f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.492+0000 7fc5f2800700 1 -- 172.21.15.70:0/3411156619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f4104100 msgr2=0x7fc5f419fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.492+0000 7fc5f2800700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f4104100 0x7fc5f419fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.492+0000 7fc5f2800700 1 -- 172.21.15.70:0/3411156619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4103750 msgr2=0x7fc5f419f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.492+0000 7fc5f2800700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4103750 0x7fc5f419f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.492+0000 7fc5f2800700 1 -- 172.21.15.70:0/3411156619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f4199fb0 con 0x7fc5f4108850 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.492+0000 7fc5f2800700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4108850 0x7fc5f41997d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec007d70 tx=0x7fc5ec00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.492+0000 7fc5eaa00700 1 -- 172.21.15.70:0/3411156619 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec016020 con 0x7fc5f4108850 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.493+0000 7fc5eaa00700 1 -- 172.21.15.70:0/3411156619 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc5ec00ad40 con 0x7fc5f4108850 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.493+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f419a2a0 con 0x7fc5f4108850 2024-05-08T08:51:23.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.493+0000 7fc5eaa00700 1 -- 172.21.15.70:0/3411156619 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec0115e0 con 0x7fc5f4108850 2024-05-08T08:51:23.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.493+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f41a6460 con 0x7fc5f4108850 2024-05-08T08:51:23.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.494+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f4104be0 con 0x7fc5f4108850 2024-05-08T08:51:23.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.496+0000 7fc5eaa00700 1 -- 172.21.15.70:0/3411156619 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc5ec019020 con 0x7fc5f4108850 2024-05-08T08:51:23.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.497+0000 7fc5eaa00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc5d80b29f0 0x7fc5d80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:23.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.498+0000 7fc5eaa00700 1 -- 172.21.15.70:0/3411156619 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(327..327 src has 1..327) ==== 9583+0+0 (secure 0 0 0) 0x7fc5ec0e2930 con 0x7fc5f4108850 2024-05-08T08:51:23.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.498+0000 7fc5f1e00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc5d80b29f0 0x7fc5d80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:23.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.499+0000 7fc5f1e00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc5d80b29f0 0x7fc5d80b4eb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4005ea0 tx=0x7fc5e4005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:51:23.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.503+0000 7fc5eaa00700 1 -- 172.21.15.70:0/3411156619 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc5ec020020 con 0x7fc5f4108850 2024-05-08T08:51:23.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:23 smithi070 ceph-mon[29591]: pgmap v3980: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:23.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:23 smithi172 ceph-mon[33377]: pgmap v3980: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:23.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:23 smithi194 ceph-mon[33679]: pgmap v3980: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 43 KiB/s wr, 6 op/s 2024-05-08T08:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.792+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5f402e510 con 0x7fc5f4108850 2024-05-08T08:51:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.793+0000 7fc5eaa00700 1 -- 172.21.15.70:0/3411156619 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fc5ec0a9fa0 con 0x7fc5f4108850 2024-05-08T08:51:23.790 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:51:23.790 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:51:23.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc5d80b29f0 msgr2=0x7fc5d80b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:23.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc5d80b29f0 0x7fc5d80b4eb0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4005ea0 tx=0x7fc5e4005e30 comp rx=0 tx=0).stop 2024-05-08T08:51:23.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4108850 msgr2=0x7fc5f41997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:23.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4108850 0x7fc5f41997d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec007d70 tx=0x7fc5ec00a340 comp rx=0 tx=0).stop 2024-05-08T08:51:23.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 shutdown_connections 2024-05-08T08:51:23.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc5d80b29f0 0x7fc5d80b4eb0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5f4108850 0x7fc5f41997d0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc5f4103750 0x7fc5f419f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 --2- 172.21.15.70:0/3411156619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5f4104100 0x7fc5f419fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:23.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 >> 172.21.15.70:0/3411156619 conn(0x7fc5f407a600 msgr2=0x7fc5f41099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:51:23.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 shutdown_connections 2024-05-08T08:51:23.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:23.796+0000 7fc5f8c00700 1 -- 172.21.15.70:0/3411156619 wait complete. 2024-05-08T08:51:23.794 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:51:24.572 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:24 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3411156619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:51:24.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:24 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3411156619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:51:24.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:24 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3411156619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:51:25.053 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id f554ec2b --release --await' 2024-05-08T08:51:25.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id f554ec2b --release --await 2024-05-08T08:51:25.526 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:51:25.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:25 smithi070 ceph-mon[29591]: pgmap v3981: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:51:25.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:25 smithi172 ceph-mon[33377]: pgmap v3981: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:51:25.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:25 smithi194 ceph-mon[33679]: pgmap v3981: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:51:27.439 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:27 smithi070 ceph-mon[29591]: pgmap v3982: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:51:27.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:27 smithi172 ceph-mon[33377]: pgmap v3982: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:51:27.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:27 smithi194 ceph-mon[33679]: pgmap v3982: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:51:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.761+0000 7f72c4c00700 1 -- 172.21.15.70:0/2310576969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102ee0 msgr2=0x7f72c0106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.761+0000 7f72c4c00700 1 --2- 172.21.15.70:0/2310576969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102ee0 0x7f72c0106f30 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f72a80099c0 tx=0x7f72a8009cd0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.761+0000 7f72c4c00700 1 -- 172.21.15.70:0/2310576969 shutdown_connections 2024-05-08T08:51:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.761+0000 7f72c4c00700 1 --2- 172.21.15.70:0/2310576969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c0107610 0x7f72c010f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.761+0000 7f72c4c00700 1 --2- 172.21.15.70:0/2310576969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c0102530 0x7f72c0102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.761+0000 7f72c4c00700 1 --2- 172.21.15.70:0/2310576969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102ee0 0x7f72c0106f30 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.761+0000 7f72c4c00700 1 -- 172.21.15.70:0/2310576969 >> 172.21.15.70:0/2310576969 conn(0x7f72c00fddc0 msgr2=0x7f72c01001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:51:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.762+0000 7f72c4c00700 1 -- 172.21.15.70:0/2310576969 shutdown_connections 2024-05-08T08:51:27.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.762+0000 7f72c4c00700 1 -- 172.21.15.70:0/2310576969 wait complete. 2024-05-08T08:51:27.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.763+0000 7f72c4c00700 1 Processor -- start 2024-05-08T08:51:27.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.763+0000 7f72c4c00700 1 -- start start 2024-05-08T08:51:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72c4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102530 0x7f72c019f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72c4c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c0102ee0 0x7f72c019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72c4c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c0107610 0x7f72c0199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72c4c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01123b0 con 0x7f72c0102530 2024-05-08T08:51:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72c4c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0112230 con 0x7f72c0107610 2024-05-08T08:51:27.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72c4c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0112530 con 0x7f72c0102ee0 2024-05-08T08:51:27.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72bf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102530 0x7f72c019f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72bf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102530 0x7f72c019f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59524/0 (socket says 172.21.15.70:59524) 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72bf400700 1 -- 172.21.15.70:0/3878376427 learned_addr learned my addr 172.21.15.70:0/3878376427 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72b6a00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c0102ee0 0x7f72c019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.764+0000 7f72bfe00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c0107610 0x7f72c0199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72bf400700 1 -- 172.21.15.70:0/3878376427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c0102ee0 msgr2=0x7f72c019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72bf400700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c0102ee0 0x7f72c019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72bf400700 1 -- 172.21.15.70:0/3878376427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c0107610 msgr2=0x7f72c0199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72bf400700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c0107610 0x7f72c0199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72bf400700 1 -- 172.21.15.70:0/3878376427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c019a020 con 0x7f72c0102530 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72bf400700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102530 0x7f72c019f6c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f72b00060b0 tx=0x7f72b0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72bcc00700 1 -- 172.21.15.70:0/3878376427 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b001a070 con 0x7f72c0102530 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72bcc00700 1 -- 172.21.15.70:0/3878376427 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72b000de20 con 0x7f72c0102530 2024-05-08T08:51:27.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72c4c00700 1 -- 172.21.15.70:0/3878376427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c019a310 con 0x7f72c0102530 2024-05-08T08:51:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.765+0000 7f72bcc00700 1 -- 172.21.15.70:0/3878376427 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0014690 con 0x7f72c0102530 2024-05-08T08:51:27.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.766+0000 7f72c4c00700 1 -- 172.21.15.70:0/3878376427 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c01a6520 con 0x7f72c0102530 2024-05-08T08:51:27.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.769+0000 7f72bcc00700 1 -- 172.21.15.70:0/3878376427 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f72b001d070 con 0x7f72c0102530 2024-05-08T08:51:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.770+0000 7f72bcc00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2a70 0x7f72a40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.771+0000 7f72bcc00700 1 -- 172.21.15.70:0/3878376427 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(327..327 src has 1..327) ==== 9583+0+0 (secure 0 0 0) 0x7f72b00e2310 con 0x7f72c0102530 2024-05-08T08:51:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.771+0000 7f72b6a00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2a70 0x7f72a40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.771+0000 7f72b6a00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2a70 0x7f72a40b4f30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009990 tx=0x7f72a801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:51:27.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.790+0000 7f72d0aa3b80 1 Processor -- start 2024-05-08T08:51:27.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.790+0000 7f72d0aa3b80 1 -- start start 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.790+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.790+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 0x55e3b14be780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.790+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 0x55e3b14bf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.790+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e3b1410b20 con 0x55e3b14c4250 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.790+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e3b13ae860 con 0x55e3b14c4b70 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.790+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e3b140cae0 con 0x55e3b14beda0 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.790+0000 7f72bf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59534/0 (socket says 172.21.15.70:59534) 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bf400700 1 -- 172.21.15.70:0/3767144092 learned_addr learned my addr 172.21.15.70:0/3767144092 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bfe00700 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 0x55e3b14bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72b6a00700 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 0x55e3b14be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bf400700 1 -- 172.21.15.70:0/3767144092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 msgr2=0x55e3b14bf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:51:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bf400700 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 0x55e3b14bf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bf400700 1 -- 172.21.15.70:0/3767144092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 msgr2=0x55e3b14be780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:51:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bf400700 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 0x55e3b14be780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bf400700 1 -- 172.21.15.70:0/3767144092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b135d9d0 con 0x55e3b14c4250 2024-05-08T08:51:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bfe00700 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 0x55e3b14bf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:51:27.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72b6a00700 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 0x55e3b14be780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:51:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72bf400700 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c4630 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f72b00a9100 tx=0x7f72b00a9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64577a9bc508b29e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:51:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.791+0000 7f72b4c00700 1 -- 172.21.15.70:0/3767144092 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b00ad520 con 0x55e3b14c4250 2024-05-08T08:51:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.792+0000 7f72b4c00700 1 -- 172.21.15.70:0/3767144092 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72b00b1fd0 con 0x55e3b14c4250 2024-05-08T08:51:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.792+0000 7f72b4c00700 1 -- 172.21.15.70:0/3767144092 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b00a9630 con 0x55e3b14c4250 2024-05-08T08:51:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.792+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/3767144092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 msgr2=0x55e3b14c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:27.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.792+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c4630 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f72b00a9100 tx=0x7f72b00a9070 comp rx=0 tx=0).stop 2024-05-08T08:51:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.793+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/3767144092 shutdown_connections 2024-05-08T08:51:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.793+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 0x55e3b14bf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.793+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c4630 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.793+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/3767144092 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 0x55e3b14be780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.793+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/3767144092 >> 172.21.15.70:0/3767144092 conn(0x55e3b14367d0 msgr2=0x55e3b14b92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:51:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.793+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/3767144092 shutdown_connections 2024-05-08T08:51:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.793+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/3767144092 wait complete. 2024-05-08T08:51:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.793+0000 7f72d0aa3b80 1 -- start start 2024-05-08T08:51:27.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.794+0000 7f72d0aa3b80 1 Processor -- start 2024-05-08T08:51:27.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.794+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14beda0 0x55e3b14ca810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.794+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14c4250 0x55e3b14c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.794+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4b70 0x55e3b14c8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.794+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e3b14cb690 con 0x55e3b14c4b70 2024-05-08T08:51:27.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.794+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e3b1376c20 con 0x55e3b14beda0 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.794+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e3b14cb810 con 0x55e3b14c4250 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.794+0000 7f72d0aa3b80 10 client.0 _ll_register_callbacks cb 0x55e3b13b7d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.794+0000 7f72bfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4b70 0x55e3b14c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.795+0000 7f72bfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4b70 0x55e3b14c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59550/0 (socket says 172.21.15.70:59550) 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.795+0000 7f72bfe00700 1 -- 172.21.15.70:0/2794071094 learned_addr learned my addr 172.21.15.70:0/2794071094 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.795+0000 7f72bfe00700 1 -- 172.21.15.70:0/2794071094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14c4250 msgr2=0x55e3b14c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.795+0000 7f72bfe00700 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14c4250 0x55e3b14c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.795+0000 7f72bfe00700 1 -- 172.21.15.70:0/2794071094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14beda0 msgr2=0x55e3b14ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.795+0000 7f72bfe00700 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14beda0 0x55e3b14ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.795+0000 7f72bfe00700 1 -- 172.21.15.70:0/2794071094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b13d6520 con 0x55e3b14c4b70 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.795+0000 7f72bfe00700 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4b70 0x55e3b14c8160 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009fd0 tx=0x7f72b800e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13258139ba2c6cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:51:27.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.795+0000 7f72ad600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:51:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.796+0000 7f72ad600700 1 -- 172.21.15.70:0/2794071094 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b8017020 con 0x55e3b14c4b70 2024-05-08T08:51:27.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.796+0000 7f72ad600700 1 -- 172.21.15.70:0/2794071094 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(327..327 src has 1..327) ==== 9583+0+0 (secure 0 0 0) 0x7f72b800ee30 con 0x55e3b14c4b70 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.796+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/2794071094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72b00b1fd0 con 0x55e3b14c4b70 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.796+0000 7f72ad600700 1 -- 172.21.15.70:0/2794071094 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f72b8022050 con 0x55e3b14c4b70 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.796+0000 7f72d0aa3b80 10 client.18699 fetch_fsmap learned FSMap version 42 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.796+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/2794071094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e3b14d5ee0 con 0x55e3b14c4b70 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.796+0000 7f72ad600700 1 -- 172.21.15.70:0/2794071094 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72b00b1fd0 con 0x55e3b14c4b70 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.797+0000 7f72ad600700 1 -- 172.21.15.70:0/2794071094 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f72b8012050 con 0x55e3b14c4b70 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.797+0000 7f72d0aa3b80 10 client.18699 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.797+0000 7f72d0aa3b80 10 client.18699 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.797+0000 7f72d0aa3b80 20 client.18699 populate_metadata read hostname 'smithi070' 2024-05-08T08:51:27.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.797+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e3b14d8520 0x55e3b14da9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.797+0000 7f72d0aa3b80 4 client.18699 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:51:27.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.797+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/2794071094 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3b148b240 con 0x55e3b14d8520 2024-05-08T08:51:27.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.798+0000 7f72bf400700 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e3b14d8520 0x55e3b14da9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.799+0000 7f72bf400700 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e3b14d8520 0x55e3b14da9a0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da18e701c98d932 server_cookie=94715e90ec2becb9 in_seq=0 out_seq=0 2024-05-08T08:51:27.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.799+0000 7f72ad600700 10 client.18699 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:51:27.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.801+0000 7f72ad600700 1 -- 172.21.15.70:0/2794071094 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e3b148b240 con 0x55e3b14d8520 2024-05-08T08:51:27.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72ad600700 10 client.18699 handle_command_reply: tid=0 2024-05-08T08:51:27.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 client.18699 shutdown 2024-05-08T08:51:27.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/2794071094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4b70 msgr2=0x55e3b14c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:27.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4b70 0x55e3b14c8160 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009fd0 tx=0x7f72b800e500 comp rx=0 tx=0).stop 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/2794071094 shutdown_connections 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e3b14d8520 0x55e3b14da9a0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4b70 0x55e3b14c8160 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14beda0 0x55e3b14ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/2794071094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14c4250 0x55e3b14c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72ad600700 0 client.18699 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/2794071094 >> 172.21.15.70:0/2794071094 conn(0x55e3b14367d0 msgr2=0x55e3b14bd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/2794071094 shutdown_connections 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.802+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/2794071094 wait complete. 2024-05-08T08:51:27.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.803+0000 7f72d0aa3b80 20 client.18699 trim_cache size 0 max 16384 2024-05-08T08:51:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.824+0000 7f72d0aa3b80 1 Processor -- start 2024-05-08T08:51:27.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.824+0000 7f72d0aa3b80 1 -- start start 2024-05-08T08:51:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14beda0 0x55e3b14c23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14c4b70 0x55e3b14e0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01b1db0 con 0x55e3b14c4250 2024-05-08T08:51:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01af640 con 0x55e3b14beda0 2024-05-08T08:51:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01ad4b0 con 0x55e3b14c4b70 2024-05-08T08:51:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72b6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72b6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59566/0 (socket says 172.21.15.70:59566) 2024-05-08T08:51:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72b6a00700 1 -- 172.21.15.70:0/1193796923 learned_addr learned my addr 172.21.15.70:0/1193796923 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:51:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72bf400700 1 --2- 172.21.15.70:0/1193796923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14beda0 0x55e3b14c23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.825+0000 7f72bfe00700 1 --2- 172.21.15.70:0/1193796923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14c4b70 0x55e3b14e0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.826+0000 7f72b6a00700 1 -- 172.21.15.70:0/1193796923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14c4b70 msgr2=0x55e3b14e0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:51:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.826+0000 7f72b6a00700 1 --2- 172.21.15.70:0/1193796923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14c4b70 0x55e3b14e0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.826+0000 7f72b6a00700 1 -- 172.21.15.70:0/1193796923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14beda0 msgr2=0x55e3b14c23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:51:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.826+0000 7f72b6a00700 1 --2- 172.21.15.70:0/1193796923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14beda0 0x55e3b14c23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.826+0000 7f72b6a00700 1 -- 172.21.15.70:0/1193796923 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3b14ca450 con 0x55e3b14c4250 2024-05-08T08:51:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.826+0000 7f72b6a00700 1 --2- 172.21.15.70:0/1193796923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c81b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f72c006ada0 tx=0x7f72a8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98532c9117db7cb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:51:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.827+0000 7f72afe00700 1 -- 172.21.15.70:0/1193796923 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a800f7c0 con 0x55e3b14c4250 2024-05-08T08:51:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.827+0000 7f72afe00700 1 -- 172.21.15.70:0/1193796923 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72a8032070 con 0x55e3b14c4250 2024-05-08T08:51:27.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.827+0000 7f72afe00700 1 -- 172.21.15.70:0/1193796923 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8023c40 con 0x55e3b14c4250 2024-05-08T08:51:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/1193796923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 msgr2=0x55e3b14c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/1193796923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c81b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f72c006ada0 tx=0x7f72a8009cd0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/1193796923 shutdown_connections 2024-05-08T08:51:27.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/1193796923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14c4b70 0x55e3b14e0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/1193796923 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14beda0 0x55e3b14c23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/1193796923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14c81b0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/1193796923 >> 172.21.15.70:0/1193796923 conn(0x55e3b14367d0 msgr2=0x55e3b14c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:51:27.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/1193796923 shutdown_connections 2024-05-08T08:51:27.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/1193796923 wait complete. 2024-05-08T08:51:27.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.828+0000 7f72d0aa3b80 1 -- start start 2024-05-08T08:51:27.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.829+0000 7f72d0aa3b80 1 Processor -- start 2024-05-08T08:51:27.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.829+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 0x55e3b14cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.829+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.829+0000 7f72d0aa3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 0x55e3b14ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.829+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01adb00 con 0x55e3b14c4250 2024-05-08T08:51:27.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.829+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01aef70 con 0x55e3b14c4b70 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.829+0000 7f72d0aa3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01ae1d0 con 0x55e3b14beda0 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.829+0000 7f72d0aa3b80 10 client.0 _ll_register_callbacks cb 0x55e3b13b7d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72b6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72bf400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 0x55e3b14cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72b6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59576/0 (socket says 172.21.15.70:59576) 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72b6a00700 1 -- 172.21.15.70:0/750796833 learned_addr learned my addr 172.21.15.70:0/750796833 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72bfe00700 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 0x55e3b14ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72b6a00700 1 -- 172.21.15.70:0/750796833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 msgr2=0x55e3b14cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72b6a00700 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 0x55e3b14cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72b6a00700 1 -- 172.21.15.70:0/750796833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 msgr2=0x55e3b14ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72b6a00700 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 0x55e3b14ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:27.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.830+0000 7f72b6a00700 1 -- 172.21.15.70:0/750796833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3b1543110 con 0x55e3b14c4250 2024-05-08T08:51:27.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.831+0000 7f72b6a00700 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14ce010 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f72a8005f50 tx=0x7f72a8009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc6a30094d77332 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.831+0000 7f72ad600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.831+0000 7f72ad600700 1 -- 172.21.15.70:0/750796833 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a803c020 con 0x55e3b14c4250 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.831+0000 7f72ad600700 1 -- 172.21.15.70:0/750796833 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(327..327 src has 1..327) ==== 9583+0+0 (secure 0 0 0) 0x7f72a800f7c0 con 0x55e3b14c4250 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.831+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/750796833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72a8032070 con 0x55e3b14c4250 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.831+0000 7f72ad600700 1 -- 172.21.15.70:0/750796833 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f72a8047050 con 0x55e3b14c4250 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.831+0000 7f72d0aa3b80 10 client.18705 fetch_fsmap learned FSMap version 42 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.831+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/750796833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e3b1544430 con 0x55e3b14c4250 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.832+0000 7f72ad600700 1 -- 172.21.15.70:0/750796833 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72a8032070 con 0x55e3b14c4250 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.832+0000 7f72ad600700 1 -- 172.21.15.70:0/750796833 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f72a80389d0 con 0x55e3b14c4250 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.832+0000 7f72d0aa3b80 10 client.18705 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.832+0000 7f72d0aa3b80 10 client.18705 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.832+0000 7f72d0aa3b80 20 client.18705 populate_metadata read hostname 'smithi070' 2024-05-08T08:51:27.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.832+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e3b1544a80 0x55e3b1546ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:51:27.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.832+0000 7f72d0aa3b80 4 client.18705 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f554ec2b", "release": true, "await": true}] 2024-05-08T08:51:27.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.832+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/750796833 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f554ec2b", "release": true, "await": true}) -- 0x55e3b141e500 con 0x55e3b1544a80 2024-05-08T08:51:27.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.833+0000 7f72bf400700 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e3b1544a80 0x55e3b1546ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:51:27.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.834+0000 7f72bf400700 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e3b1544a80 0x55e3b1546ea0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f479d6db0443421 server_cookie=bbf67b54765eb1eb in_seq=0 out_seq=0 2024-05-08T08:51:27.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:27.834+0000 7f72ad600700 10 client.18705 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:51:29.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:29 smithi070 ceph-mon[29591]: pgmap v3983: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:51:29.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:29 smithi172 ceph-mon[33377]: pgmap v3983: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:51:29.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:29 smithi194 ceph-mon[33679]: pgmap v3983: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 6 op/s 2024-05-08T08:51:31.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:31 smithi172 ceph-mon[33377]: pgmap v3984: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 5 op/s 2024-05-08T08:51:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:31 smithi194 ceph-mon[33679]: pgmap v3984: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 5 op/s 2024-05-08T08:51:31.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:31 smithi070 ceph-mon[29591]: pgmap v3984: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 5 op/s 2024-05-08T08:51:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.326+0000 7f72ad600700 1 -- 172.21.15.70:0/750796833 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55e3b141e500 con 0x55e3b1544a80 2024-05-08T08:51:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.326+0000 7f72ad600700 10 client.18705 handle_command_reply: tid=0 2024-05-08T08:51:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.327+0000 7f72d0aa3b80 1 client.18705 shutdown 2024-05-08T08:51:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.328+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/750796833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 msgr2=0x55e3b14ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:32.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.328+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14ce010 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f72a8005f50 tx=0x7f72a8009fd0 comp rx=0 tx=0).stop 2024-05-08T08:51:32.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.329+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/750796833 shutdown_connections 2024-05-08T08:51:32.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.329+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e3b1544a80 0x55e3b1546ea0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:32.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.329+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e3b14c4b70 0x55e3b14ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:32.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.329+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e3b14beda0 0x55e3b14cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:32.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.329+0000 7f72d0aa3b80 1 --2- 172.21.15.70:0/750796833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e3b14c4250 0x55e3b14ce010 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:32.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.329+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/750796833 >> 172.21.15.70:0/750796833 conn(0x55e3b14367d0 msgr2=0x55e3b14c60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:51:32.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.330+0000 7f72ad600700 0 client.18705 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:51:32.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.330+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/750796833 shutdown_connections 2024-05-08T08:51:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.330+0000 7f72d0aa3b80 1 -- 172.21.15.70:0/750796833 wait complete. 2024-05-08T08:51:32.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.331+0000 7f72d0aa3b80 20 client.18705 trim_cache size 0 max 16384 2024-05-08T08:51:32.329 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:51:32.329 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:51:32.329 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:51:32.330 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 280, 2024-05-08T08:51:32.330 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:51:32.330 INFO:teuthology.orchestra.run.smithi070.stdout: "f554ec2b": { 2024-05-08T08:51:32.330 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 280, 2024-05-08T08:51:32.330 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:51:32.330 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:51:32.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:51:32.330 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:51:32.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.8, 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:51:32.331 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:51:32.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.333+0000 7f72c4c00700 1 -- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2a70 msgr2=0x7f72a40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:32.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.333+0000 7f72c4c00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2a70 0x7f72a40b4f30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009990 tx=0x7f72a801a040 comp rx=0 tx=0).stop 2024-05-08T08:51:32.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.333+0000 7f72c4c00700 1 -- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102530 msgr2=0x7f72c019f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:51:32.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.333+0000 7f72c4c00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102530 0x7f72c019f6c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f72b00060b0 tx=0x7f72b0007f90 comp rx=0 tx=0).stop 2024-05-08T08:51:32.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.333+0000 7f72c4c00700 1 -- 172.21.15.70:0/3878376427 shutdown_connections 2024-05-08T08:51:32.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.334+0000 7f72c4c00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f72a40b2a70 0x7f72a40b4f30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:32.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.334+0000 7f72c4c00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f72c0107610 0x7f72c0199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:32.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.334+0000 7f72c4c00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72c0102530 0x7f72c019f6c0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:32.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.334+0000 7f72c4c00700 1 --2- 172.21.15.70:0/3878376427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72c0102ee0 0x7f72c019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:51:32.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.334+0000 7f72c4c00700 1 -- 172.21.15.70:0/3878376427 >> 172.21.15.70:0/3878376427 conn(0x7f72c00fddc0 msgr2=0x7f72c006b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:51:32.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.334+0000 7f72c4c00700 1 -- 172.21.15.70:0/3878376427 shutdown_connections 2024-05-08T08:51:32.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:51:32.335+0000 7f72c4c00700 1 -- 172.21.15.70:0/3878376427 wait complete. 2024-05-08T08:51:33.300 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f554ec2b', seconds elapsed: 74.5 2024-05-08T08:51:33.359 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/display/drm_dsc_helper.o 2024-05-08T08:51:33.530 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_bo_vm.o 2024-05-08T08:51:33.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:33 smithi172 ceph-mon[33377]: pgmap v3985: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-05-08T08:51:33.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:33 smithi194 ceph-mon[33679]: pgmap v3985: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-05-08T08:51:33.762 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_pci.o 2024-05-08T08:51:33.867 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/char/built-in.a 2024-05-08T08:51:33.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:33 smithi070 ceph-mon[29591]: pgmap v3985: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 28 KiB/s wr, 5 op/s 2024-05-08T08:51:34.593 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_lpit.o 2024-05-08T08:51:34.706 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/prmt.o 2024-05-08T08:51:35.162 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_exar.o 2024-05-08T08:51:35.285 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/intel/trace.o 2024-05-08T08:51:35.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:35 smithi172 ceph-mon[33377]: pgmap v3986: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 230 KiB/s wr, 12 op/s 2024-05-08T08:51:35.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:35 smithi194 ceph-mon[33679]: pgmap v3986: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 230 KiB/s wr, 12 op/s 2024-05-08T08:51:35.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:35 smithi070 ceph-mon[29591]: pgmap v3986: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 230 KiB/s wr, 12 op/s 2024-05-08T08:51:36.661 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_driver.o 2024-05-08T08:51:37.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:37 smithi172 ceph-mon[33377]: pgmap v3987: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 212 KiB/s wr, 11 op/s 2024-05-08T08:51:37.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:37 smithi194 ceph-mon[33679]: pgmap v3987: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 212 KiB/s wr, 11 op/s 2024-05-08T08:51:37.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:37 smithi070 ceph-mon[29591]: pgmap v3987: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 212 KiB/s wr, 11 op/s 2024-05-08T08:51:39.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:39 smithi172 ceph-mon[33377]: pgmap v3988: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 212 KiB/s wr, 11 op/s 2024-05-08T08:51:39.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:39 smithi194 ceph-mon[33679]: pgmap v3988: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 212 KiB/s wr, 11 op/s 2024-05-08T08:51:39.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:39 smithi070 ceph-mon[29591]: pgmap v3988: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 212 KiB/s wr, 11 op/s 2024-05-08T08:51:41.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:41 smithi172 ceph-mon[33377]: pgmap v3989: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 401 KiB/s wr, 19 op/s 2024-05-08T08:51:41.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:41 smithi194 ceph-mon[33679]: pgmap v3989: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 401 KiB/s wr, 19 op/s 2024-05-08T08:51:41.768 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_drm_client.o 2024-05-08T08:51:41.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:41 smithi070 ceph-mon[29591]: pgmap v3989: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 401 KiB/s wr, 19 op/s 2024-05-08T08:51:42.370 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_module.o 2024-05-08T08:51:43.462 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/display/drm_hdcp_helper.o 2024-05-08T08:51:43.667 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_execbuf_util.o 2024-05-08T08:51:43.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:43 smithi172 ceph-mon[33377]: pgmap v3990: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 401 KiB/s wr, 16 op/s 2024-05-08T08:51:43.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:43 smithi194 ceph-mon[33679]: pgmap v3990: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 401 KiB/s wr, 16 op/s 2024-05-08T08:51:43.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:43 smithi070 ceph-mon[29591]: pgmap v3990: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 401 KiB/s wr, 16 op/s 2024-05-08T08:51:45.560 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_early.o 2024-05-08T08:51:45.571 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_pcc.o 2024-05-08T08:51:45.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:45 smithi172 ceph-mon[33377]: pgmap v3991: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 685 KiB/s wr, 31 op/s 2024-05-08T08:51:45.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:45 smithi194 ceph-mon[33679]: pgmap v3991: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 685 KiB/s wr, 31 op/s 2024-05-08T08:51:45.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:45 smithi070 ceph-mon[29591]: pgmap v3991: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 691 KiB/s rd, 685 KiB/s wr, 31 op/s 2024-05-08T08:51:46.391 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/intel/cap_audit.o 2024-05-08T08:51:47.676 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:47 smithi172 ceph-mon[33377]: pgmap v3992: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 486 KiB/s wr, 26 op/s 2024-05-08T08:51:47.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:47 smithi194 ceph-mon[33679]: pgmap v3992: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 486 KiB/s wr, 26 op/s 2024-05-08T08:51:47.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:47 smithi070 ceph-mon[29591]: pgmap v3992: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 486 KiB/s wr, 26 op/s 2024-05-08T08:51:48.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:51:48.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:51:48.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:51:49.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:49 smithi194 ceph-mon[33679]: pgmap v3993: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 479 KiB/s wr, 25 op/s 2024-05-08T08:51:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:49 smithi070 ceph-mon[29591]: pgmap v3993: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 479 KiB/s wr, 25 op/s 2024-05-08T08:51:49.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:49 smithi172 ceph-mon[33377]: pgmap v3993: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 479 KiB/s wr, 25 op/s 2024-05-08T08:51:50.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:51:50.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:51:50.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:51:50.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:51:50.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:51:50.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:51:50.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:51:50.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:51:50.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:51:51.075 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/display/drm_hdmi_helper.o 2024-05-08T08:51:51.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:51 smithi194 ceph-mon[33679]: pgmap v3994: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 696 KiB/s wr, 49 op/s 2024-05-08T08:51:51.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:51 smithi070 ceph-mon[29591]: pgmap v3994: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 696 KiB/s wr, 49 op/s 2024-05-08T08:51:51.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:51 smithi172 ceph-mon[33377]: pgmap v3994: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 836 KiB/s rd, 696 KiB/s wr, 49 op/s 2024-05-08T08:51:53.005 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_range_manager.o 2024-05-08T08:51:53.217 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/ac.o 2024-05-08T08:51:53.257 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/tty/ipwireless/built-in.a 2024-05-08T08:51:53.482 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/omapdrm/built-in.a 2024-05-08T08:51:53.547 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/renesas/rcar-du/built-in.a 2024-05-08T08:51:53.685 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/tilcdc/built-in.a 2024-05-08T08:51:53.685 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/renesas/built-in.a 2024-05-08T08:51:53.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:53 smithi194 ceph-mon[33679]: pgmap v3995: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 507 KiB/s wr, 41 op/s 2024-05-08T08:51:53.819 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/intel/perfmon.o 2024-05-08T08:51:53.820 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/display/drm_scdc_helper.o 2024-05-08T08:51:53.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:53 smithi070 ceph-mon[29591]: pgmap v3995: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 507 KiB/s wr, 41 op/s 2024-05-08T08:51:53.926 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:53 smithi172 ceph-mon[33377]: pgmap v3995: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 507 KiB/s wr, 41 op/s 2024-05-08T08:51:54.981 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_lpss.o 2024-05-08T08:51:55.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:55 smithi172 ceph-mon[33377]: pgmap v3996: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 875 KiB/s wr, 54 op/s 2024-05-08T08:51:55.748 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_config.o 2024-05-08T08:51:55.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:55 smithi194 ceph-mon[33679]: pgmap v3996: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 875 KiB/s wr, 54 op/s 2024-05-08T08:51:55.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:55 smithi070 ceph-mon[29591]: pgmap v3996: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 887 KiB/s rd, 875 KiB/s wr, 54 op/s 2024-05-08T08:51:57.108 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_getparam.o 2024-05-08T08:51:57.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:57 smithi194 ceph-mon[33679]: pgmap v3997: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 606 KiB/s wr, 43 op/s 2024-05-08T08:51:57.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:57 smithi070 ceph-mon[29591]: pgmap v3997: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 606 KiB/s wr, 43 op/s 2024-05-08T08:51:57.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:57 smithi172 ceph-mon[33377]: pgmap v3997: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 606 KiB/s wr, 43 op/s 2024-05-08T08:51:59.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:51:59 smithi194 ceph-mon[33679]: pgmap v3998: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 601 KiB/s wr, 40 op/s 2024-05-08T08:51:59.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:51:59 smithi070 ceph-mon[29591]: pgmap v3998: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 601 KiB/s wr, 40 op/s 2024-05-08T08:51:59.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:51:59 smithi172 ceph-mon[33377]: pgmap v3998: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 582 KiB/s rd, 601 KiB/s wr, 40 op/s 2024-05-08T08:52:00.165 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/serial_ctrl.o 2024-05-08T08:52:01.724 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/button.o 2024-05-08T08:52:01.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:01 smithi194 ceph-mon[33679]: pgmap v3999: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 785 KiB/s wr, 49 op/s 2024-05-08T08:52:01.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:01 smithi070 ceph-mon[29591]: pgmap v3999: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 785 KiB/s wr, 49 op/s 2024-05-08T08:52:01.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:01 smithi172 ceph-mon[33377]: pgmap v3999: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 838 KiB/s rd, 785 KiB/s wr, 49 op/s 2024-05-08T08:52:02.386 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/iommu/arm/arm-smmu/built-in.a 2024-05-08T08:52:02.577 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/iommu/arm/arm-smmu-v3/built-in.a 2024-05-08T08:52:02.592 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_resource.o 2024-05-08T08:52:02.714 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/iommu/arm/built-in.a 2024-05-08T08:52:02.951 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_pool.o 2024-05-08T08:52:03.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:03 smithi194 ceph-mon[33679]: pgmap v4000: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 567 KiB/s wr, 25 op/s 2024-05-08T08:52:03.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:03 smithi070 ceph-mon[29591]: pgmap v4000: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 567 KiB/s wr, 25 op/s 2024-05-08T08:52:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:03 smithi172 ceph-mon[33377]: pgmap v4000: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 567 KiB/s wr, 25 op/s 2024-05-08T08:52:05.733 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/display/built-in.a 2024-05-08T08:52:05.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:05 smithi194 ceph-mon[33679]: pgmap v4001: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 900 KiB/s wr, 56 op/s 2024-05-08T08:52:05.845 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_mid.o 2024-05-08T08:52:05.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:05 smithi070 ceph-mon[29591]: pgmap v4001: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 900 KiB/s wr, 56 op/s 2024-05-08T08:52:05.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:05 smithi172 ceph-mon[33377]: pgmap v4001: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 900 KiB/s wr, 56 op/s 2024-05-08T08:52:05.941 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/iommu/intel/built-in.a 2024-05-08T08:52:06.659 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/iommu/iommufd/built-in.a 2024-05-08T08:52:06.770 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/iommu.o 2024-05-08T08:52:06.856 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_drv.o 2024-05-08T08:52:07.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:07 smithi070 ceph-mon[29591]: pgmap v4002: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 545 KiB/s wr, 49 op/s 2024-05-08T08:52:07.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:07 smithi172 ceph-mon[33377]: pgmap v4002: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 545 KiB/s wr, 49 op/s 2024-05-08T08:52:08.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:07 smithi194 ceph-mon[33679]: pgmap v4002: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 545 KiB/s wr, 49 op/s 2024-05-08T08:52:08.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:08 smithi070 ceph-mon[29591]: osdmap e328: 12 total, 12 up, 12 in 2024-05-08T08:52:08.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:08 smithi172 ceph-mon[33377]: osdmap e328: 12 total, 12 up, 12 in 2024-05-08T08:52:09.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:08 smithi194 ceph-mon[33679]: osdmap e328: 12 total, 12 up, 12 in 2024-05-08T08:52:09.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:09 smithi070 ceph-mon[29591]: pgmap v4004: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 635 KiB/s wr, 54 op/s 2024-05-08T08:52:09.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:09 smithi172 ceph-mon[33377]: pgmap v4004: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 635 KiB/s wr, 54 op/s 2024-05-08T08:52:10.008 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:09 smithi194 ceph-mon[33679]: pgmap v4004: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 635 KiB/s wr, 54 op/s 2024-05-08T08:52:10.473 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/iommu-traces.o 2024-05-08T08:52:10.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:10 smithi070 ceph-mon[29591]: pgmap v4005: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 701 KiB/s wr, 60 op/s 2024-05-08T08:52:10.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:10 smithi172 ceph-mon[33377]: pgmap v4005: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 701 KiB/s wr, 60 op/s 2024-05-08T08:52:10.980 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/fan_core.o 2024-05-08T08:52:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:10 smithi194 ceph-mon[33679]: pgmap v4005: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 701 KiB/s wr, 60 op/s 2024-05-08T08:52:11.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_ioctl.o 2024-05-08T08:52:11.924 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/fan_attr.o 2024-05-08T08:52:12.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:11 smithi070 ceph-mon[29591]: osdmap e329: 12 total, 12 up, 12 in 2024-05-08T08:52:12.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:11 smithi172 ceph-mon[33377]: osdmap e329: 12 total, 12 up, 12 in 2024-05-08T08:52:12.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:11 smithi194 ceph-mon[33679]: osdmap e329: 12 total, 12 up, 12 in 2024-05-08T08:52:12.391 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_device.o 2024-05-08T08:52:13.126 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:12 smithi070 ceph-mon[29591]: pgmap v4007: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 376 KiB/s wr, 28 op/s 2024-05-08T08:52:13.177 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:12 smithi172 ceph-mon[33377]: pgmap v4007: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 376 KiB/s wr, 28 op/s 2024-05-08T08:52:13.258 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:12 smithi194 ceph-mon[33679]: pgmap v4007: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 376 KiB/s wr, 28 op/s 2024-05-08T08:52:15.311 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/8250/8250_pericom.o 2024-05-08T08:52:15.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:15 smithi070 ceph-mon[29591]: pgmap v4008: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 827 KiB/s wr, 30 op/s 2024-05-08T08:52:15.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:15 smithi172 ceph-mon[33377]: pgmap v4008: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 827 KiB/s wr, 30 op/s 2024-05-08T08:52:15.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:15 smithi194 ceph-mon[33679]: pgmap v4008: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 827 KiB/s wr, 30 op/s 2024-05-08T08:52:17.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:17 smithi070 ceph-mon[29591]: pgmap v4009: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 796 KiB/s wr, 31 op/s 2024-05-08T08:52:17.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:17 smithi172 ceph-mon[33377]: pgmap v4009: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 796 KiB/s wr, 31 op/s 2024-05-08T08:52:17.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:17 smithi194 ceph-mon[33679]: pgmap v4009: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 796 KiB/s wr, 31 op/s 2024-05-08T08:52:17.853 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_kms.o 2024-05-08T08:52:17.875 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_irq.o 2024-05-08T08:52:19.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:19 smithi070 ceph-mon[29591]: pgmap v4010: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 676 KiB/s wr, 26 op/s 2024-05-08T08:52:19.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:19 smithi172 ceph-mon[33377]: pgmap v4010: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 676 KiB/s wr, 26 op/s 2024-05-08T08:52:19.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:19 smithi194 ceph-mon[33679]: pgmap v4010: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 676 KiB/s wr, 26 op/s 2024-05-08T08:52:21.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:21 smithi070 ceph-mon[29591]: pgmap v4011: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 722 KiB/s wr, 24 op/s 2024-05-08T08:52:21.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:21 smithi172 ceph-mon[33377]: pgmap v4011: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 722 KiB/s wr, 24 op/s 2024-05-08T08:52:21.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:21 smithi194 ceph-mon[33679]: pgmap v4011: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 697 KiB/s rd, 722 KiB/s wr, 24 op/s 2024-05-08T08:52:22.442 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_mitigations.o 2024-05-08T08:52:22.652 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_video.o 2024-05-08T08:52:22.723 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_sys_manager.o 2024-05-08T08:52:22.915 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/iommu-sysfs.o 2024-05-08T08:52:23.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:23 smithi070 ceph-mon[29591]: pgmap v4012: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 647 KiB/s wr, 22 op/s 2024-05-08T08:52:23.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:23 smithi172 ceph-mon[33377]: pgmap v4012: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 647 KiB/s wr, 22 op/s 2024-05-08T08:52:23.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:23 smithi194 ceph-mon[33679]: pgmap v4012: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 647 KiB/s wr, 22 op/s 2024-05-08T08:52:24.259 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/tty/serial/8250/built-in.a 2024-05-08T08:52:24.399 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/ttm/ttm_agp_backend.o 2024-05-08T08:52:25.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:25 smithi070 ceph-mon[29591]: pgmap v4013: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 792 KiB/s wr, 30 op/s 2024-05-08T08:52:25.388 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/serial_port.o 2024-05-08T08:52:25.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:25 smithi172 ceph-mon[33377]: pgmap v4013: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 792 KiB/s wr, 30 op/s 2024-05-08T08:52:25.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:25 smithi194 ceph-mon[33679]: pgmap v4013: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 775 KiB/s rd, 792 KiB/s wr, 30 op/s 2024-05-08T08:52:26.439 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_gem.o 2024-05-08T08:52:27.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:27 smithi070 ceph-mon[29591]: pgmap v4014: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 27 op/s 2024-05-08T08:52:27.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:27 smithi172 ceph-mon[33377]: pgmap v4014: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 27 op/s 2024-05-08T08:52:27.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:27 smithi194 ceph-mon[33679]: pgmap v4014: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 585 KiB/s wr, 27 op/s 2024-05-08T08:52:29.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:29 smithi070 ceph-mon[29591]: pgmap v4015: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 572 KiB/s wr, 25 op/s 2024-05-08T08:52:29.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:29 smithi172 ceph-mon[33377]: pgmap v4015: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 572 KiB/s wr, 25 op/s 2024-05-08T08:52:29.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:29 smithi194 ceph-mon[33679]: pgmap v4015: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 572 KiB/s wr, 25 op/s 2024-05-08T08:52:30.991 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_vram.o 2024-05-08T08:52:31.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:31 smithi070 ceph-mon[29591]: pgmap v4016: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 983 KiB/s wr, 40 op/s 2024-05-08T08:52:31.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:31 smithi172 ceph-mon[33377]: pgmap v4016: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 983 KiB/s wr, 40 op/s 2024-05-08T08:52:31.468 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/dma-iommu.o 2024-05-08T08:52:31.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:31 smithi194 ceph-mon[33679]: pgmap v4016: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 983 KiB/s wr, 40 op/s 2024-05-08T08:52:31.549 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_module.o 2024-05-08T08:52:33.345 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/ttm/built-in.a 2024-05-08T08:52:33.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:33 smithi070 ceph-mon[29591]: pgmap v4017: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 707 KiB/s wr, 29 op/s 2024-05-08T08:52:33.394 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/video_detect.o 2024-05-08T08:52:33.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:33 smithi172 ceph-mon[33377]: pgmap v4017: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 707 KiB/s wr, 29 op/s 2024-05-08T08:52:33.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:33 smithi194 ceph-mon[33679]: pgmap v4017: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 707 KiB/s wr, 29 op/s 2024-05-08T08:52:33.768 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/serial/earlycon.o 2024-05-08T08:52:34.543 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_params.o 2024-05-08T08:52:34.865 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/imx/built-in.a 2024-05-08T08:52:34.982 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/processor_driver.o 2024-05-08T08:52:35.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:35 smithi070 ceph-mon[29591]: pgmap v4018: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 39 op/s 2024-05-08T08:52:35.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:35 smithi172 ceph-mon[33377]: pgmap v4018: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 39 op/s 2024-05-08T08:52:35.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:35 smithi194 ceph-mon[33679]: pgmap v4018: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 39 op/s 2024-05-08T08:52:36.819 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_pci.o 2024-05-08T08:52:37.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:37 smithi070 ceph-mon[29591]: pgmap v4019: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 915 KiB/s wr, 31 op/s 2024-05-08T08:52:37.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:37 smithi172 ceph-mon[33377]: pgmap v4019: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 915 KiB/s wr, 31 op/s 2024-05-08T08:52:37.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:37 smithi194 ceph-mon[33679]: pgmap v4019: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 881 KiB/s rd, 915 KiB/s wr, 31 op/s 2024-05-08T08:52:39.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:39 smithi172 ceph-mon[33377]: pgmap v4020: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 809 KiB/s wr, 27 op/s 2024-05-08T08:52:39.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:39 smithi194 ceph-mon[33679]: pgmap v4020: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 809 KiB/s wr, 27 op/s 2024-05-08T08:52:39.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:39 smithi070 ceph-mon[29591]: pgmap v4020: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 809 KiB/s wr, 27 op/s 2024-05-08T08:52:41.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:41 smithi172 ceph-mon[33377]: pgmap v4021: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 43 op/s 2024-05-08T08:52:41.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:41 smithi194 ceph-mon[33679]: pgmap v4021: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 43 op/s 2024-05-08T08:52:41.544 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_display.o 2024-05-08T08:52:41.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:41 smithi070 ceph-mon[29591]: pgmap v4021: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 43 op/s 2024-05-08T08:52:42.820 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_vq.o 2024-05-08T08:52:42.892 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/io-pgtable.o 2024-05-08T08:52:43.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:43 smithi172 ceph-mon[33377]: pgmap v4022: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 726 KiB/s wr, 28 op/s 2024-05-08T08:52:43.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:43 smithi194 ceph-mon[33679]: pgmap v4022: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 726 KiB/s wr, 28 op/s 2024-05-08T08:52:43.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:43 smithi070 ceph-mon[29591]: pgmap v4022: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 726 KiB/s wr, 28 op/s 2024-05-08T08:52:43.675 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/tty/serial/built-in.a 2024-05-08T08:52:44.109 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/processor_thermal.o 2024-05-08T08:52:44.907 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_io.o 2024-05-08T08:52:45.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:45 smithi172 ceph-mon[33377]: pgmap v4023: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 43 op/s 2024-05-08T08:52:45.446 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_fence.o 2024-05-08T08:52:45.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:45 smithi194 ceph-mon[33679]: pgmap v4023: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 43 op/s 2024-05-08T08:52:45.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:45 smithi070 ceph-mon[29591]: pgmap v4023: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 43 op/s 2024-05-08T08:52:47.394 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/n_tty.o 2024-05-08T08:52:47.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:47 smithi172 ceph-mon[33377]: pgmap v4024: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 704 KiB/s wr, 36 op/s 2024-05-08T08:52:47.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:47 smithi194 ceph-mon[33679]: pgmap v4024: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 704 KiB/s wr, 36 op/s 2024-05-08T08:52:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:47 smithi070 ceph-mon[29591]: pgmap v4024: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 704 KiB/s wr, 36 op/s 2024-05-08T08:52:49.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:49 smithi172 ceph-mon[33377]: pgmap v4025: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 692 KiB/s wr, 33 op/s 2024-05-08T08:52:49.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:49 smithi194 ceph-mon[33679]: pgmap v4025: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 692 KiB/s wr, 33 op/s 2024-05-08T08:52:49.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:49 smithi070 ceph-mon[29591]: pgmap v4025: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 678 KiB/s rd, 692 KiB/s wr, 33 op/s 2024-05-08T08:52:49.707 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_scatterlist.o 2024-05-08T08:52:51.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:51 smithi172 ceph-mon[33377]: pgmap v4026: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 995 KiB/s wr, 49 op/s 2024-05-08T08:52:51.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:52:51.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:51 smithi194 ceph-mon[33679]: pgmap v4026: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 995 KiB/s wr, 49 op/s 2024-05-08T08:52:51.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:52:51.613 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/iommu/iova.o 2024-05-08T08:52:51.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:51 smithi070 ceph-mon[29591]: pgmap v4026: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 995 KiB/s wr, 49 op/s 2024-05-08T08:52:51.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:52:51.838 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_suspend.o 2024-05-08T08:52:52.206 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/processor_idle.o 2024-05-08T08:52:53.144 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/i2c/built-in.a 2024-05-08T08:52:53.261 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/processor_throttling.o 2024-05-08T08:52:53.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:53 smithi172 ceph-mon[33377]: pgmap v4027: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 667 KiB/s wr, 33 op/s 2024-05-08T08:52:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:52:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:52:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:52:53.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:53 smithi194 ceph-mon[33679]: pgmap v4027: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 667 KiB/s wr, 33 op/s 2024-05-08T08:52:53.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:52:53.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:52:53.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:52:53.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:53 smithi070 ceph-mon[29591]: pgmap v4027: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 667 KiB/s wr, 33 op/s 2024-05-08T08:52:53.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:52:53.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:52:53.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:52:55.406 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_object.o 2024-05-08T08:52:55.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:55 smithi172 ceph-mon[33377]: pgmap v4028: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 45 op/s 2024-05-08T08:52:55.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:55 smithi194 ceph-mon[33679]: pgmap v4028: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 45 op/s 2024-05-08T08:52:55.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:55 smithi070 ceph-mon[29591]: pgmap v4028: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 45 op/s 2024-05-08T08:52:56.096 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/panel/built-in.a 2024-05-08T08:52:56.342 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_debugfs.o 2024-05-08T08:52:57.305 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_ioctl.o 2024-05-08T08:52:57.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:57 smithi172 ceph-mon[33377]: pgmap v4029: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 731 KiB/s wr, 34 op/s 2024-05-08T08:52:57.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:57 smithi194 ceph-mon[33679]: pgmap v4029: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 731 KiB/s wr, 34 op/s 2024-05-08T08:52:57.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:57 smithi070 ceph-mon[29591]: pgmap v4029: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 731 KiB/s wr, 34 op/s 2024-05-08T08:52:59.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:52:59 smithi172 ceph-mon[33377]: pgmap v4030: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 711 KiB/s wr, 31 op/s 2024-05-08T08:52:59.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:52:59 smithi194 ceph-mon[33679]: pgmap v4030: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 711 KiB/s wr, 31 op/s 2024-05-08T08:52:59.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:52:59 smithi070 ceph-mon[29591]: pgmap v4030: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 711 KiB/s wr, 31 op/s 2024-05-08T08:53:01.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:01 smithi194 ceph-mon[33679]: pgmap v4031: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 992 KiB/s wr, 41 op/s 2024-05-08T08:53:01.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:01 smithi070 ceph-mon[29591]: pgmap v4031: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 992 KiB/s wr, 41 op/s 2024-05-08T08:53:01.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:01 smithi172 ceph-mon[33377]: pgmap v4031: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 992 KiB/s wr, 41 op/s 2024-05-08T08:53:02.043 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_ldisc.o 2024-05-08T08:53:02.616 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/iommu/built-in.a 2024-05-08T08:53:02.675 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_switcheroo.o 2024-05-08T08:53:03.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:03 smithi194 ceph-mon[33679]: pgmap v4032: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 689 KiB/s wr, 26 op/s 2024-05-08T08:53:03.587 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_plane.o 2024-05-08T08:53:03.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:03 smithi070 ceph-mon[29591]: pgmap v4032: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 689 KiB/s wr, 26 op/s 2024-05-08T08:53:03.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:03 smithi172 ceph-mon[33377]: pgmap v4032: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 689 KiB/s wr, 26 op/s 2024-05-08T08:53:04.567 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/processor_perflib.o 2024-05-08T08:53:05.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:05 smithi194 ceph-mon[33679]: pgmap v4033: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-05-08T08:53:05.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:05 smithi070 ceph-mon[29591]: pgmap v4033: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-05-08T08:53:05.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:05 smithi172 ceph-mon[33377]: pgmap v4033: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-05-08T08:53:06.908 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/container.o 2024-05-08T08:53:06.956 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_sysfs.o 2024-05-08T08:53:07.377 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/thermal.o 2024-05-08T08:53:07.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:07 smithi194 ceph-mon[33679]: pgmap v4034: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 773 KiB/s wr, 44 op/s 2024-05-08T08:53:07.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:07 smithi070 ceph-mon[29591]: pgmap v4034: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 773 KiB/s wr, 44 op/s 2024-05-08T08:53:07.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:07 smithi172 ceph-mon[33377]: pgmap v4034: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 773 KiB/s wr, 44 op/s 2024-05-08T08:53:07.827 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_ioctl.o 2024-05-08T08:53:09.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:09 smithi194 ceph-mon[33679]: pgmap v4035: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 760 KiB/s wr, 40 op/s 2024-05-08T08:53:09.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:09 smithi194 ceph-mon[33679]: osdmap e330: 12 total, 12 up, 12 in 2024-05-08T08:53:09.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:09 smithi070 ceph-mon[29591]: pgmap v4035: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 760 KiB/s wr, 40 op/s 2024-05-08T08:53:09.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:09 smithi070 ceph-mon[29591]: osdmap e330: 12 total, 12 up, 12 in 2024-05-08T08:53:09.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:09 smithi172 ceph-mon[33377]: pgmap v4035: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 760 KiB/s wr, 40 op/s 2024-05-08T08:53:09.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:09 smithi172 ceph-mon[33377]: osdmap e330: 12 total, 12 up, 12 in 2024-05-08T08:53:11.441 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_buffer.o 2024-05-08T08:53:11.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:11 smithi194 ceph-mon[33679]: pgmap v4037: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 944 KiB/s wr, 49 op/s 2024-05-08T08:53:11.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:11 smithi194 ceph-mon[33679]: osdmap e331: 12 total, 12 up, 12 in 2024-05-08T08:53:11.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:11 smithi070 ceph-mon[29591]: pgmap v4037: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 944 KiB/s wr, 49 op/s 2024-05-08T08:53:11.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:11 smithi070 ceph-mon[29591]: osdmap e331: 12 total, 12 up, 12 in 2024-05-08T08:53:11.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:11 smithi172 ceph-mon[33377]: pgmap v4037: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 792 KiB/s rd, 944 KiB/s wr, 49 op/s 2024-05-08T08:53:11.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:11 smithi172 ceph-mon[33377]: osdmap e331: 12 total, 12 up, 12 in 2024-05-08T08:53:12.482 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_port.o 2024-05-08T08:53:13.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:13 smithi194 ceph-mon[33679]: pgmap v4039: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 477 KiB/s wr, 20 op/s 2024-05-08T08:53:13.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:13 smithi070 ceph-mon[29591]: pgmap v4039: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 477 KiB/s wr, 20 op/s 2024-05-08T08:53:13.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:13 smithi172 ceph-mon[33377]: pgmap v4039: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 477 KiB/s wr, 20 op/s 2024-05-08T08:53:13.756 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/bridge/analogix/built-in.a 2024-05-08T08:53:13.960 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/bridge/cadence/built-in.a 2024-05-08T08:53:14.189 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/bridge/imx/built-in.a 2024-05-08T08:53:14.421 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/bridge/synopsys/built-in.a 2024-05-08T08:53:14.575 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/bridge/built-in.a 2024-05-08T08:53:14.707 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/acpi_memhotplug.o 2024-05-08T08:53:14.885 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/hisilicon/built-in.a 2024-05-08T08:53:15.005 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/ioapic.o 2024-05-08T08:53:15.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:15 smithi194 ceph-mon[33679]: pgmap v4040: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 889 KiB/s wr, 29 op/s 2024-05-08T08:53:15.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:15 smithi070 ceph-mon[29591]: pgmap v4040: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 889 KiB/s wr, 29 op/s 2024-05-08T08:53:15.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:15 smithi172 ceph-mon[33377]: pgmap v4040: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 889 KiB/s wr, 29 op/s 2024-05-08T08:53:15.805 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/connector/cn_queue.o 2024-05-08T08:53:16.816 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/battery.o 2024-05-08T08:53:17.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:17 smithi194 ceph-mon[33679]: pgmap v4041: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 911 KiB/s wr, 34 op/s 2024-05-08T08:53:17.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:17 smithi070 ceph-mon[29591]: pgmap v4041: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 911 KiB/s wr, 34 op/s 2024-05-08T08:53:17.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:17 smithi172 ceph-mon[33377]: pgmap v4041: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 911 KiB/s wr, 34 op/s 2024-05-08T08:53:17.988 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_prime.o 2024-05-08T08:53:19.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:19 smithi194 ceph-mon[33679]: pgmap v4042: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 741 KiB/s wr, 27 op/s 2024-05-08T08:53:19.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:19 smithi070 ceph-mon[29591]: pgmap v4042: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 741 KiB/s wr, 27 op/s 2024-05-08T08:53:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:19 smithi172 ceph-mon[33377]: pgmap v4042: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 741 KiB/s wr, 27 op/s 2024-05-08T08:53:20.087 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.3 2024-05-08T08:53:20.088 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:53:20.649 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:53:20.683 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_utils.o 2024-05-08T08:53:20.826 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_trace_points.o 2024-05-08T08:53:21.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:21 smithi194 ceph-mon[33679]: pgmap v4043: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 846 KiB/s wr, 36 op/s 2024-05-08T08:53:21.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:21 smithi070 ceph-mon[29591]: pgmap v4043: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 846 KiB/s wr, 36 op/s 2024-05-08T08:53:21.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:21 smithi172 ceph-mon[33377]: pgmap v4043: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 846 KiB/s wr, 36 op/s 2024-05-08T08:53:21.985 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_mutex.o 2024-05-08T08:53:22.531 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_clock_gating.o 2024-05-08T08:53:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.430+0000 7ffaf4400700 1 -- 172.21.15.70:0/3997943320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06bb40 msgr2=0x7ffaec110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.430+0000 7ffaf4400700 1 --2- 172.21.15.70:0/3997943320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06bb40 0x7ffaec110330 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7ffae400b0a0 tx=0x7ffae400b3b0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.430+0000 7ffaf4400700 1 -- 172.21.15.70:0/3997943320 shutdown_connections 2024-05-08T08:53:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.430+0000 7ffaf4400700 1 --2- 172.21.15.70:0/3997943320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06bb40 0x7ffaec110330 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.430+0000 7ffaf4400700 1 --2- 172.21.15.70:0/3997943320 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec109510 0x7ffaec1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.430+0000 7ffaf4400700 1 --2- 172.21.15.70:0/3997943320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec06b180 0x7ffaec06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.430+0000 7ffaf4400700 1 -- 172.21.15.70:0/3997943320 >> 172.21.15.70:0/3997943320 conn(0x7ffaec079350 msgr2=0x7ffaec079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:53:23.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.430+0000 7ffaf4400700 1 -- 172.21.15.70:0/3997943320 shutdown_connections 2024-05-08T08:53:23.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.430+0000 7ffaf4400700 1 -- 172.21.15.70:0/3997943320 wait complete. 2024-05-08T08:53:23.429 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:23 smithi070 ceph-mon[29591]: pgmap v4044: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 758 KiB/s wr, 32 op/s 2024-05-08T08:53:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.432+0000 7ffaf4400700 1 Processor -- start 2024-05-08T08:53:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.432+0000 7ffaf4400700 1 -- start start 2024-05-08T08:53:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.432+0000 7ffaf4400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06b180 0x7ffaec10e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.432+0000 7ffaf4400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec06bb40 0x7ffaec10ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.432+0000 7ffaf4400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec109510 0x7ffaec1a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.433+0000 7ffaf4400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec113540 con 0x7ffaec06b180 2024-05-08T08:53:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.433+0000 7ffaf4400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1133c0 con 0x7ffaec06bb40 2024-05-08T08:53:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.433+0000 7ffaf4400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec1136c0 con 0x7ffaec109510 2024-05-08T08:53:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.433+0000 7ffaf1a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06b180 0x7ffaec10e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.433+0000 7ffaf1a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06b180 0x7ffaec10e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37718/0 (socket says 172.21.15.70:37718) 2024-05-08T08:53:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.433+0000 7ffaf1a00700 1 -- 172.21.15.70:0/2869887863 learned_addr learned my addr 172.21.15.70:0/2869887863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:53:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.433+0000 7ffaf1000700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec06bb40 0x7ffaec10ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:23.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.433+0000 7ffaf2400700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec109510 0x7ffaec1a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:23.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.434+0000 7ffaf1a00700 1 -- 172.21.15.70:0/2869887863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec109510 msgr2=0x7ffaec1a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:23.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.434+0000 7ffaf1a00700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec109510 0x7ffaec1a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.434+0000 7ffaf1a00700 1 -- 172.21.15.70:0/2869887863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec06bb40 msgr2=0x7ffaec10ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:23.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.434+0000 7ffaf1a00700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec06bb40 0x7ffaec10ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.434+0000 7ffaf1a00700 1 -- 172.21.15.70:0/2869887863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec1a5080 con 0x7ffaec06b180 2024-05-08T08:53:23.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.434+0000 7ffaf1a00700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06b180 0x7ffaec10e4c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7ffae000d950 tx=0x7ffae000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:53:23.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.435+0000 7ffaea000700 1 -- 172.21.15.70:0/2869887863 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae0016070 con 0x7ffaec06b180 2024-05-08T08:53:23.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.435+0000 7ffaea000700 1 -- 172.21.15.70:0/2869887863 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffae000fd20 con 0x7ffaec06b180 2024-05-08T08:53:23.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.435+0000 7ffaea000700 1 -- 172.21.15.70:0/2869887863 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae000e3b0 con 0x7ffaec06b180 2024-05-08T08:53:23.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.436+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaec1a5310 con 0x7ffaec06b180 2024-05-08T08:53:23.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.436+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaec1acbf0 con 0x7ffaec06b180 2024-05-08T08:53:23.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.437+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaec104bd0 con 0x7ffaec06b180 2024-05-08T08:53:23.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.441+0000 7ffaea000700 1 -- 172.21.15.70:0/2869887863 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ffae0019070 con 0x7ffaec06b180 2024-05-08T08:53:23.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.443+0000 7ffaea000700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad40b2a70 0x7ffad40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:23.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.444+0000 7ffaea000700 1 -- 172.21.15.70:0/2869887863 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(331..331 src has 1..331) ==== 9583+0+0 (secure 0 0 0) 0x7ffae00e29e0 con 0x7ffaec06b180 2024-05-08T08:53:23.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.444+0000 7ffaf1000700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad40b2a70 0x7ffad40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.445+0000 7ffaf1000700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad40b2a70 0x7ffad40b4f30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffaec1044b0 tx=0x7ffad800b3c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:53:23.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.447+0000 7ffaea000700 1 -- 172.21.15.70:0/2869887863 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffae0020070 con 0x7ffaec06b180 2024-05-08T08:53:23.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:23 smithi194 ceph-mon[33679]: pgmap v4044: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 758 KiB/s wr, 32 op/s 2024-05-08T08:53:23.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:23 smithi172 ceph-mon[33377]: pgmap v4044: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 758 KiB/s wr, 32 op/s 2024-05-08T08:53:23.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.919+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffaec06a190 con 0x7ffaec06b180 2024-05-08T08:53:23.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.921+0000 7ffaea000700 1 -- 172.21.15.70:0/2869887863 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7ffae00a9f40 con 0x7ffaec06b180 2024-05-08T08:53:23.919 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:53:23.919 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:53:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.924+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad40b2a70 msgr2=0x7ffad40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.924+0000 7ffaf4400700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad40b2a70 0x7ffad40b4f30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ffaec1044b0 tx=0x7ffad800b3c0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.924+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06b180 msgr2=0x7ffaec10e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:23.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.924+0000 7ffaf4400700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06b180 0x7ffaec10e4c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7ffae000d950 tx=0x7ffae000dc60 comp rx=0 tx=0).stop 2024-05-08T08:53:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.925+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 shutdown_connections 2024-05-08T08:53:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.925+0000 7ffaf4400700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad40b2a70 0x7ffad40b4f30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.925+0000 7ffaf4400700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec109510 0x7ffaec1a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.925+0000 7ffaf4400700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec06b180 0x7ffaec10e4c0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.925+0000 7ffaf4400700 1 --2- 172.21.15.70:0/2869887863 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec06bb40 0x7ffaec10ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.925+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 >> 172.21.15.70:0/2869887863 conn(0x7ffaec079350 msgr2=0x7ffaec102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:53:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.925+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 shutdown_connections 2024-05-08T08:53:23.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:23.925+0000 7ffaf4400700 1 -- 172.21.15.70:0/2869887863 wait complete. 2024-05-08T08:53:23.924 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:53:24.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:24 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2869887863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:53:24.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:24 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2869887863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:53:24.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:24 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2869887863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:53:24.994 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_device_info.o 2024-05-08T08:53:25.385 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 80.3 --await-for 42.0' 2024-05-08T08:53:25.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 80.3 --await-for 42.0 2024-05-08T08:53:25.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:25 smithi194 ceph-mon[33679]: pgmap v4045: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 999 KiB/s wr, 37 op/s 2024-05-08T08:53:25.579 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:25 smithi172 ceph-mon[33377]: pgmap v4045: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 999 KiB/s wr, 37 op/s 2024-05-08T08:53:25.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:25 smithi070 ceph-mon[29591]: pgmap v4045: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 999 KiB/s wr, 37 op/s 2024-05-08T08:53:26.038 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:53:27.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:27 smithi070 ceph-mon[29591]: pgmap v4046: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 726 KiB/s wr, 30 op/s 2024-05-08T08:53:27.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:27 smithi172 ceph-mon[33377]: pgmap v4046: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 726 KiB/s wr, 30 op/s 2024-05-08T08:53:27.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:27 smithi194 ceph-mon[33679]: pgmap v4046: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 726 KiB/s wr, 30 op/s 2024-05-08T08:53:27.817 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/bgrt.o 2024-05-08T08:53:28.338 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/connector/connector.o 2024-05-08T08:53:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.374+0000 7f8db8600700 1 -- 172.21.15.70:0/1673516383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8db0106440 msgr2=0x7f8db01068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.374+0000 7f8db8600700 1 --2- 172.21.15.70:0/1673516383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8db0106440 0x7f8db01068c0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f8da40098f0 tx=0x7f8da4009c00 comp rx=0 tx=0).stop 2024-05-08T08:53:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.375+0000 7f8db8600700 1 -- 172.21.15.70:0/1673516383 shutdown_connections 2024-05-08T08:53:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.375+0000 7f8db8600700 1 --2- 172.21.15.70:0/1673516383 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db006b1a0 0x7f8db006b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.375+0000 7f8db8600700 1 --2- 172.21.15.70:0/1673516383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8db0108450 0x7f8db0105f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.375+0000 7f8db8600700 1 --2- 172.21.15.70:0/1673516383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8db0106440 0x7f8db01068c0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.375+0000 7f8db8600700 1 -- 172.21.15.70:0/1673516383 >> 172.21.15.70:0/1673516383 conn(0x7f8db0079340 msgr2=0x7f8db0079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:53:28.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.375+0000 7f8db8600700 1 -- 172.21.15.70:0/1673516383 shutdown_connections 2024-05-08T08:53:28.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.375+0000 7f8db8600700 1 -- 172.21.15.70:0/1673516383 wait complete. 2024-05-08T08:53:28.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.376+0000 7f8db8600700 1 Processor -- start 2024-05-08T08:53:28.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.377+0000 7f8db8600700 1 -- start start 2024-05-08T08:53:28.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.377+0000 7f8db8600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db006b1a0 0x7f8db01a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.377+0000 7f8db8600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8db0106440 0x7f8db01a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.377+0000 7f8db8600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8db0108450 0x7f8db01a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.377+0000 7f8db8600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0119b40 con 0x7f8db0106440 2024-05-08T08:53:28.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.377+0000 7f8db8600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01199c0 con 0x7f8db006b1a0 2024-05-08T08:53:28.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.377+0000 7f8db8600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0119cc0 con 0x7f8db0108450 2024-05-08T08:53:28.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.378+0000 7f8db6600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8db0108450 0x7f8db01a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.378+0000 7f8db6600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8db0108450 0x7f8db01a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:56212/0 (socket says 172.21.15.70:56212) 2024-05-08T08:53:28.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.378+0000 7f8db6600700 1 -- 172.21.15.70:0/947688396 learned_addr learned my addr 172.21.15.70:0/947688396 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:53:28.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.378+0000 7f8db5200700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8db0106440 0x7f8db01a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.379+0000 7f8db6600700 1 -- 172.21.15.70:0/947688396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db006b1a0 msgr2=0x7f8db01a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:28.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.379+0000 7f8db6600700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db006b1a0 0x7f8db01a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.379+0000 7f8db6600700 1 -- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8db0106440 msgr2=0x7f8db01a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:28.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.379+0000 7f8db6600700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8db0106440 0x7f8db01a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.379+0000 7f8db6600700 1 -- 172.21.15.70:0/947688396 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db01a5040 con 0x7f8db0108450 2024-05-08T08:53:28.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.380+0000 7f8db6600700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8db0108450 0x7f8db01a4900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8da800ef30 tx=0x7f8da800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:53:28.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.381+0000 7f8dae000700 1 -- 172.21.15.70:0/947688396 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da80092e0 con 0x7f8db0108450 2024-05-08T08:53:28.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.381+0000 7f8dae000700 1 -- 172.21.15.70:0/947688396 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8da8004bb0 con 0x7f8db0108450 2024-05-08T08:53:28.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.381+0000 7f8db8600700 1 -- 172.21.15.70:0/947688396 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db01a52d0 con 0x7f8db0108450 2024-05-08T08:53:28.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.381+0000 7f8dae000700 1 -- 172.21.15.70:0/947688396 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8004020 con 0x7f8db0108450 2024-05-08T08:53:28.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.381+0000 7f8db8600700 1 -- 172.21.15.70:0/947688396 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db01acbb0 con 0x7f8db0108450 2024-05-08T08:53:28.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.387+0000 7f8dae000700 1 -- 172.21.15.70:0/947688396 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8da801b030 con 0x7f8db0108450 2024-05-08T08:53:28.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.388+0000 7f8dae000700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8d980b2aa0 0x7f8d980b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.388+0000 7f8dae000700 1 -- 172.21.15.70:0/947688396 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(331..331 src has 1..331) ==== 9583+0+0 (secure 0 0 0) 0x7f8da80e2600 con 0x7f8db0108450 2024-05-08T08:53:28.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.389+0000 7f8db5c00700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8d980b2aa0 0x7f8d980b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.390+0000 7f8db5c00700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8d980b2aa0 0x7f8d980b4f60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8da0005fd0 tx=0x7f8da0009690 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:53:28.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.405+0000 7f8dc2f22b80 1 Processor -- start 2024-05-08T08:53:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.405+0000 7f8dc2f22b80 1 -- start start 2024-05-08T08:53:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.406+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c933293620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.406+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c93328dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.406+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328e1d0 0x55c93329a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.406+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c9331dfbb0 con 0x55c933293240 2024-05-08T08:53:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.406+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c93317d8f0 con 0x55c93328e1d0 2024-05-08T08:53:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.406+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c9331dbb70 con 0x55c93328d810 2024-05-08T08:53:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db5200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c93328dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c933293620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db6600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328e1d0 0x55c93329a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c933293620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59992/0 (socket says 172.21.15.70:59992) 2024-05-08T08:53:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db5c00700 1 -- 172.21.15.70:0/2458297083 learned_addr learned my addr 172.21.15.70:0/2458297083 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:53:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db5200700 1 -- 172.21.15.70:0/2458297083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328e1d0 msgr2=0x55c93329a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:53:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db5200700 1 --2- 172.21.15.70:0/2458297083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328e1d0 0x55c93329a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db5200700 1 -- 172.21.15.70:0/2458297083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 msgr2=0x55c933293620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:53:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db5200700 1 --2- 172.21.15.70:0/2458297083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c933293620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.407+0000 7f8db5200700 1 -- 172.21.15.70:0/2458297083 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c93312ca60 con 0x55c93328d810 2024-05-08T08:53:28.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.408+0000 7f8db5c00700 1 --2- 172.21.15.70:0/2458297083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c933293620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:53:28.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.409+0000 7f8db5200700 1 --2- 172.21.15.70:0/2458297083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c93328dc90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009fd0 tx=0x7f8da400bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f72a68b025f51cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:53:28.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.410+0000 7f8d9ea00700 1 -- 172.21.15.70:0/2458297083 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da400fdc0 con 0x55c93328d810 2024-05-08T08:53:28.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.410+0000 7f8d9ea00700 1 -- 172.21.15.70:0/2458297083 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8da400f8f0 con 0x55c93328d810 2024-05-08T08:53:28.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.410+0000 7f8d9ea00700 1 -- 172.21.15.70:0/2458297083 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4003680 con 0x55c93328d810 2024-05-08T08:53:28.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.411+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2458297083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 msgr2=0x55c93328dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.411+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2458297083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c93328dc90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009fd0 tx=0x7f8da400bf40 comp rx=0 tx=0).stop 2024-05-08T08:53:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.411+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2458297083 shutdown_connections 2024-05-08T08:53:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.411+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2458297083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328e1d0 0x55c93329a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.411+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2458297083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c933293620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.411+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2458297083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c93328dc90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.411+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2458297083 >> 172.21.15.70:0/2458297083 conn(0x55c933205860 msgr2=0x55c933288100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:53:28.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.412+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2458297083 shutdown_connections 2024-05-08T08:53:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.412+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2458297083 wait complete. 2024-05-08T08:53:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.413+0000 7f8dc2f22b80 1 -- start start 2024-05-08T08:53:28.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.413+0000 7f8dc2f22b80 1 Processor -- start 2024-05-08T08:53:28.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.414+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c933299bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.414+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933296f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.414+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c933293240 0x55c9332974d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.414+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c93329a5a0 con 0x55c93328e1d0 2024-05-08T08:53:28.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.414+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c933145cb0 con 0x55c933293240 2024-05-08T08:53:28.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.414+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c93329a720 con 0x55c93328d810 2024-05-08T08:53:28.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.414+0000 7f8dc2f22b80 10 client.0 _ll_register_callbacks cb 0x55c933186e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:53:28.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.415+0000 7f8db6600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c933293240 0x55c9332974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.415+0000 7f8db5c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c933299bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.415+0000 7f8db5c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c933299bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:56232/0 (socket says 172.21.15.70:56232) 2024-05-08T08:53:28.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.415+0000 7f8db5c00700 1 -- 172.21.15.70:0/1691926042 learned_addr learned my addr 172.21.15.70:0/1691926042 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:53:28.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.415+0000 7f8db5200700 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933296f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.416+0000 7f8db5c00700 1 -- 172.21.15.70:0/1691926042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c933293240 msgr2=0x55c9332974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:53:28.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.416+0000 7f8db5c00700 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c933293240 0x55c9332974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.416+0000 7f8db5c00700 1 -- 172.21.15.70:0/1691926042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 msgr2=0x55c933296f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:53:28.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.416+0000 7f8db5c00700 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933296f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.416+0000 7f8db5c00700 1 -- 172.21.15.70:0/1691926042 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9331a55b0 con 0x55c93328d810 2024-05-08T08:53:28.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.416+0000 7f8db5200700 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933296f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:53:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.416+0000 7f8db6600700 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c933293240 0x55c9332974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:53:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.416+0000 7f8db5c00700 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c933299bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8da001d4e0 tx=0x7f8da0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a600d65c6b640f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:53:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.417+0000 7f8d93400700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T08:53:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.417+0000 7f8d93400700 1 -- 172.21.15.70:0/1691926042 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da002a060 con 0x55c93328d810 2024-05-08T08:53:28.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.417+0000 7f8d93400700 1 -- 172.21.15.70:0/1691926042 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(331..331 src has 1..331) ==== 9583+0+0 (secure 0 0 0) 0x7f8da0010840 con 0x55c93328d810 2024-05-08T08:53:28.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.418+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1691926042 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da400f8f0 con 0x55c93328d810 2024-05-08T08:53:28.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.419+0000 7f8d93400700 1 -- 172.21.15.70:0/1691926042 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8da0010a40 con 0x55c93328d810 2024-05-08T08:53:28.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.419+0000 7f8dc2f22b80 10 client.27541 fetch_fsmap learned FSMap version 42 2024-05-08T08:53:28.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.419+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1691926042 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55c9332a4e50 con 0x55c93328d810 2024-05-08T08:53:28.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.420+0000 7f8d93400700 1 -- 172.21.15.70:0/1691926042 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8da400f8f0 con 0x55c93328d810 2024-05-08T08:53:28.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.420+0000 7f8d93400700 1 -- 172.21.15.70:0/1691926042 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f8da0024030 con 0x55c93328d810 2024-05-08T08:53:28.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.420+0000 7f8dc2f22b80 10 client.27541 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:53:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.420+0000 7f8dc2f22b80 10 client.27541 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:53:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.420+0000 7f8dc2f22b80 20 client.27541 populate_metadata read hostname 'smithi070' 2024-05-08T08:53:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.420+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9332a73e0 0x55c9332a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.420+0000 7f8dc2f22b80 4 client.27541 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:53:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.420+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1691926042 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c93325a2d0 con 0x55c9332a73e0 2024-05-08T08:53:28.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.421+0000 7f8db5200700 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9332a73e0 0x55c9332a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.422+0000 7f8db5200700 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9332a73e0 0x55c9332a97d0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ea2f293fd3c9e54 server_cookie=191818bd95a07aab in_seq=0 out_seq=0 2024-05-08T08:53:28.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.422+0000 7f8d93400700 10 client.27541 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:53:28.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.424+0000 7f8d93400700 1 -- 172.21.15.70:0/1691926042 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c93325a2d0 con 0x55c9332a73e0 2024-05-08T08:53:28.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.424+0000 7f8d93400700 10 client.27541 handle_command_reply: tid=0 2024-05-08T08:53:28.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.424+0000 7f8dc2f22b80 1 client.27541 shutdown 2024-05-08T08:53:28.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.425+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1691926042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 msgr2=0x55c933299bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:28.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.425+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c933299bf0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8da001d4e0 tx=0x7f8da0004750 comp rx=0 tx=0).stop 2024-05-08T08:53:28.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1691926042 shutdown_connections 2024-05-08T08:53:28.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9332a73e0 0x55c9332a97d0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c933293240 0x55c9332974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328d810 0x55c933299bf0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1691926042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933296f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1691926042 >> 172.21.15.70:0/1691926042 conn(0x55c933205860 msgr2=0x55c933282bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:53:28.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8d93400700 0 client.27541 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:53:28.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1691926042 shutdown_connections 2024-05-08T08:53:28.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1691926042 wait complete. 2024-05-08T08:53:28.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.426+0000 7f8dc2f22b80 20 client.27541 trim_cache size 0 max 16384 2024-05-08T08:53:28.425 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_memory_region.o 2024-05-08T08:53:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.460+0000 7f8dc2f22b80 1 Processor -- start 2024-05-08T08:53:28.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.460+0000 7f8dc2f22b80 1 -- start start 2024-05-08T08:53:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.461+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c9332a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.461+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933282a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.461+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c933293240 0x55c93328fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.461+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b83d0 con 0x55c93328e1d0 2024-05-08T08:53:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.461+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b5c60 con 0x55c93328d810 2024-05-08T08:53:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.461+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b3ad0 con 0x55c933293240 2024-05-08T08:53:28.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.461+0000 7f8db5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933282a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.462+0000 7f8db5c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c9332a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.462+0000 7f8db5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933282a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60012/0 (socket says 172.21.15.70:60012) 2024-05-08T08:53:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.462+0000 7f8db5200700 1 -- 172.21.15.70:0/1635303406 learned_addr learned my addr 172.21.15.70:0/1635303406 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:53:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.462+0000 7f8db6600700 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c933293240 0x55c93328fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.462+0000 7f8db5200700 1 -- 172.21.15.70:0/1635303406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c933293240 msgr2=0x55c93328fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:53:28.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.463+0000 7f8db5200700 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c933293240 0x55c93328fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.463+0000 7f8db5200700 1 -- 172.21.15.70:0/1635303406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 msgr2=0x55c9332a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:53:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.463+0000 7f8db5200700 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c9332a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.463+0000 7f8db5200700 1 -- 172.21.15.70:0/1635303406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c933284d00 con 0x55c93328e1d0 2024-05-08T08:53:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.463+0000 7f8db6600700 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c933293240 0x55c93328fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:53:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.463+0000 7f8db5c00700 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c9332a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:53:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.463+0000 7f8db5200700 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933282a50 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009c40 tx=0x7f8da4019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1566240777c617 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:53:28.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.464+0000 7f8d9e000700 1 -- 172.21.15.70:0/1635303406 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da400f8a0 con 0x55c93328e1d0 2024-05-08T08:53:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.464+0000 7f8d9e000700 1 -- 172.21.15.70:0/1635303406 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8da40055a0 con 0x55c93328e1d0 2024-05-08T08:53:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.464+0000 7f8d9e000700 1 -- 172.21.15.70:0/1635303406 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4003680 con 0x55c93328e1d0 2024-05-08T08:53:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.465+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1635303406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 msgr2=0x55c933282a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.465+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933282a50 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009c40 tx=0x7f8da4019040 comp rx=0 tx=0).stop 2024-05-08T08:53:28.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.465+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1635303406 shutdown_connections 2024-05-08T08:53:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.465+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c933293240 0x55c93328fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.465+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c9332a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.465+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/1635303406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c93328e1d0 0x55c933282a50 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.465+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1635303406 >> 172.21.15.70:0/1635303406 conn(0x55c933205860 msgr2=0x55c933282340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:53:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.465+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1635303406 shutdown_connections 2024-05-08T08:53:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.465+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/1635303406 wait complete. 2024-05-08T08:53:28.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.466+0000 7f8dc2f22b80 1 -- start start 2024-05-08T08:53:28.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.466+0000 7f8dc2f22b80 1 Processor -- start 2024-05-08T08:53:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.467+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c93329fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.467+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328e1d0 0x55c93329a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.467+0000 7f8dc2f22b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c93329ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.467+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b4120 con 0x55c933293240 2024-05-08T08:53:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.467+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b5590 con 0x55c93328d810 2024-05-08T08:53:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.467+0000 7f8dc2f22b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8db01b47f0 con 0x55c93328e1d0 2024-05-08T08:53:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.467+0000 7f8dc2f22b80 10 client.0 _ll_register_callbacks cb 0x55c933186e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:53:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.468+0000 7f8db5c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c93329fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.468+0000 7f8db5c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c93329fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:49120/0 (socket says 172.21.15.70:49120) 2024-05-08T08:53:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.468+0000 7f8db5c00700 1 -- 172.21.15.70:0/2575345335 learned_addr learned my addr 172.21.15.70:0/2575345335 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:53:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.468+0000 7f8db5200700 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328e1d0 0x55c93329a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.469+0000 7f8db6600700 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c93329ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.469+0000 7f8db5c00700 1 -- 172.21.15.70:0/2575345335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328e1d0 msgr2=0x55c93329a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:53:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.469+0000 7f8db5c00700 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328e1d0 0x55c93329a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.469+0000 7f8db5c00700 1 -- 172.21.15.70:0/2575345335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 msgr2=0x55c93329ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:53:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.469+0000 7f8db5c00700 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c93329ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:28.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.469+0000 7f8db5c00700 1 -- 172.21.15.70:0/2575345335 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c93329b6a0 con 0x55c93328d810 2024-05-08T08:53:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.470+0000 7f8db5c00700 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c93329fe70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8da0025d80 tx=0x7f8da001dad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d1d2354f3816725 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:53:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.470+0000 7f8d93400700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:53:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.470+0000 7f8d93400700 1 -- 172.21.15.70:0/2575345335 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da003d060 con 0x55c93328d810 2024-05-08T08:53:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.470+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2575345335 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8da40055a0 con 0x55c93328d810 2024-05-08T08:53:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.470+0000 7f8d93400700 1 -- 172.21.15.70:0/2575345335 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(331..331 src has 1..331) ==== 9583+0+0 (secure 0 0 0) 0x7f8da0010de0 con 0x55c93328d810 2024-05-08T08:53:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.471+0000 7f8d93400700 1 -- 172.21.15.70:0/2575345335 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8da0044050 con 0x55c93328d810 2024-05-08T08:53:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.471+0000 7f8dc2f22b80 10 client.37433 fetch_fsmap learned FSMap version 42 2024-05-08T08:53:28.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.471+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2575345335 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55c933312bb0 con 0x55c93328d810 2024-05-08T08:53:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.472+0000 7f8d93400700 1 -- 172.21.15.70:0/2575345335 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8da40055a0 con 0x55c93328d810 2024-05-08T08:53:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.472+0000 7f8d93400700 1 -- 172.21.15.70:0/2575345335 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f8da0024040 con 0x55c93328d810 2024-05-08T08:53:28.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.472+0000 7f8dc2f22b80 10 client.37433 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:53:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.472+0000 7f8dc2f22b80 10 client.37433 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:53:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.472+0000 7f8dc2f22b80 20 client.37433 populate_metadata read hostname 'smithi070' 2024-05-08T08:53:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.472+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9333132d0 0x55c9333156f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:53:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.472+0000 7f8dc2f22b80 4 client.37433 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.3, "await_for": 42.0}] 2024-05-08T08:53:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.472+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2575345335 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.3, "await_for": 42.0}) -- 0x55c9331ed590 con 0x55c9333132d0 2024-05-08T08:53:28.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.473+0000 7f8db5200700 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9333132d0 0x55c9333156f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:53:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.474+0000 7f8db5200700 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9333132d0 0x55c9333156f0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b2a5371e2f0c8a7 server_cookie=f8d4b5eb4697e9f3 in_seq=0 out_seq=0 2024-05-08T08:53:28.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:28.474+0000 7f8d93400700 10 client.37433 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:53:29.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:29 smithi070 ceph-mon[29591]: pgmap v4047: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 712 KiB/s wr, 27 op/s 2024-05-08T08:53:29.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:29 smithi172 ceph-mon[33377]: pgmap v4047: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 712 KiB/s wr, 27 op/s 2024-05-08T08:53:29.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:29 smithi194 ceph-mon[33679]: pgmap v4047: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 712 KiB/s wr, 27 op/s 2024-05-08T08:53:31.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:31 smithi070 ceph-mon[29591]: pgmap v4048: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.0 MiB/s wr, 38 op/s 2024-05-08T08:53:31.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:31 smithi172 ceph-mon[33377]: pgmap v4048: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.0 MiB/s wr, 38 op/s 2024-05-08T08:53:31.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:31 smithi194 ceph-mon[33679]: pgmap v4048: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 1.0 MiB/s wr, 38 op/s 2024-05-08T08:53:33.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:33 smithi070 ceph-mon[29591]: pgmap v4049: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 646 KiB/s wr, 20 op/s 2024-05-08T08:53:33.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:33 smithi172 ceph-mon[33377]: pgmap v4049: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 646 KiB/s wr, 20 op/s 2024-05-08T08:53:33.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:33 smithi194 ceph-mon[33679]: pgmap v4049: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 646 KiB/s wr, 20 op/s 2024-05-08T08:53:35.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:35 smithi070 ceph-mon[29591]: pgmap v4050: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 679 KiB/s wr, 23 op/s 2024-05-08T08:53:35.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:35 smithi172 ceph-mon[33377]: pgmap v4050: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 679 KiB/s wr, 23 op/s 2024-05-08T08:53:35.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:35 smithi194 ceph-mon[33679]: pgmap v4050: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 635 KiB/s rd, 679 KiB/s wr, 23 op/s 2024-05-08T08:53:37.562 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:37 smithi194 ceph-mon[33679]: pgmap v4051: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 386 KiB/s wr, 16 op/s 2024-05-08T08:53:37.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:37 smithi070 ceph-mon[29591]: pgmap v4051: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 386 KiB/s wr, 16 op/s 2024-05-08T08:53:37.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:37 smithi172 ceph-mon[33377]: pgmap v4051: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 352 KiB/s rd, 386 KiB/s wr, 16 op/s 2024-05-08T08:53:39.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:39 smithi070 ceph-mon[29591]: pgmap v4052: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 373 KiB/s wr, 14 op/s 2024-05-08T08:53:39.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:39 smithi172 ceph-mon[33377]: pgmap v4052: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 373 KiB/s wr, 14 op/s 2024-05-08T08:53:39.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:39 smithi194 ceph-mon[33679]: pgmap v4052: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 373 KiB/s wr, 14 op/s 2024-05-08T08:53:41.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:41 smithi070 ceph-mon[29591]: pgmap v4053: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 440 KiB/s wr, 18 op/s 2024-05-08T08:53:41.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:41 smithi172 ceph-mon[33377]: pgmap v4053: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 440 KiB/s wr, 18 op/s 2024-05-08T08:53:41.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:41 smithi194 ceph-mon[33679]: pgmap v4053: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 440 KiB/s wr, 18 op/s 2024-05-08T08:53:43.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:43 smithi070 ceph-mon[29591]: pgmap v4054: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 100 KiB/s wr, 7 op/s 2024-05-08T08:53:43.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:43 smithi172 ceph-mon[33377]: pgmap v4054: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 100 KiB/s wr, 7 op/s 2024-05-08T08:53:43.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:43 smithi194 ceph-mon[33679]: pgmap v4054: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 100 KiB/s wr, 7 op/s 2024-05-08T08:53:45.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:45 smithi070 ceph-mon[29591]: pgmap v4055: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 11 op/s 2024-05-08T08:53:45.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:45 smithi172 ceph-mon[33377]: pgmap v4055: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 11 op/s 2024-05-08T08:53:45.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:45 smithi194 ceph-mon[33679]: pgmap v4055: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 102 KiB/s wr, 11 op/s 2024-05-08T08:53:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:47 smithi070 ceph-mon[29591]: pgmap v4056: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 10 op/s 2024-05-08T08:53:47.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:47 smithi172 ceph-mon[33377]: pgmap v4056: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 10 op/s 2024-05-08T08:53:47.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:47 smithi194 ceph-mon[33679]: pgmap v4056: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 10 op/s 2024-05-08T08:53:49.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:49 smithi070 ceph-mon[29591]: pgmap v4057: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 9 op/s 2024-05-08T08:53:49.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:49 smithi172 ceph-mon[33377]: pgmap v4057: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 9 op/s 2024-05-08T08:53:49.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:49 smithi194 ceph-mon[33679]: pgmap v4057: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 118 KiB/s wr, 9 op/s 2024-05-08T08:53:51.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:51 smithi070 ceph-mon[29591]: pgmap v4058: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 14 op/s 2024-05-08T08:53:51.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:51 smithi172 ceph-mon[33377]: pgmap v4058: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 14 op/s 2024-05-08T08:53:51.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.735+0000 7f8d93400700 1 -- 172.21.15.70:0/2575345335 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55c9331ed590 con 0x55c9333132d0 2024-05-08T08:53:51.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.735+0000 7f8d93400700 10 client.37433 handle_command_reply: tid=0 2024-05-08T08:53:51.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.735+0000 7f8dc2f22b80 1 client.37433 shutdown 2024-05-08T08:53:51.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.735+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2575345335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 msgr2=0x55c93329fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:51.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.735+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c93329fe70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8da0025d80 tx=0x7f8da001dad0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.736+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2575345335 shutdown_connections 2024-05-08T08:53:51.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.736+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c9333132d0 0x55c9333156f0 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.736+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c933293240 0x55c93329ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.736+0000 7f8d93400700 0 client.37433 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:53:51.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.736+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c93328d810 0x55c93329fe70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.736+0000 7f8dc2f22b80 1 --2- 172.21.15.70:0/2575345335 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c93328e1d0 0x55c93329a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.736+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2575345335 >> 172.21.15.70:0/2575345335 conn(0x55c933205860 msgr2=0x55c933282bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:53:51.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.736+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2575345335 shutdown_connections 2024-05-08T08:53:51.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.736+0000 7f8dc2f22b80 1 -- 172.21.15.70:0/2575345335 wait complete. 2024-05-08T08:53:51.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.737+0000 7f8dc2f22b80 20 client.37433 trim_cache size 0 max 16384 2024-05-08T08:53:51.734 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:53:51.734 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:53:51.734 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 282, 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "3e0a07fc": { 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 282, 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:53:51.735 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.3, 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:53:51.736 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:53:51.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 -- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8d980b2aa0 msgr2=0x7f8d980b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:51.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8d980b2aa0 0x7f8d980b4f60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8da0005fd0 tx=0x7f8da0009690 comp rx=0 tx=0).stop 2024-05-08T08:53:51.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 -- 172.21.15.70:0/947688396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8db0108450 msgr2=0x7f8db01a4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:53:51.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8db0108450 0x7f8db01a4900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8da800ef30 tx=0x7f8da800c3a0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 -- 172.21.15.70:0/947688396 shutdown_connections 2024-05-08T08:53:51.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8d980b2aa0 0x7f8d980b4f60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8db0108450 0x7f8db01a4900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8db006b1a0 0x7f8db01a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 --2- 172.21.15.70:0/947688396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8db0106440 0x7f8db01a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:53:51.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.738+0000 7f8db8600700 1 -- 172.21.15.70:0/947688396 >> 172.21.15.70:0/947688396 conn(0x7f8db0079340 msgr2=0x7f8db0100210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:53:51.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.739+0000 7f8db8600700 1 -- 172.21.15.70:0/947688396 shutdown_connections 2024-05-08T08:53:51.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:53:51.739+0000 7f8db8600700 1 -- 172.21.15.70:0/947688396 wait complete. 2024-05-08T08:53:51.758 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:51 smithi194 ceph-mon[33679]: pgmap v4058: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 155 KiB/s wr, 14 op/s 2024-05-08T08:53:52.606 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '3e0a07fc', quiesce took 32.5 seconds. Will release after: 20.3 2024-05-08T08:53:53.616 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:53 smithi172 ceph-mon[33377]: pgmap v4059: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 11 op/s 2024-05-08T08:53:53.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:53 smithi070 ceph-mon[29591]: pgmap v4059: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 11 op/s 2024-05-08T08:53:53.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:53 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:53:53.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:53 smithi194 ceph-mon[33679]: pgmap v4059: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 11 op/s 2024-05-08T08:53:53.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:53 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:53:53.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:53 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:53:55.620 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:55 smithi070 ceph-mon[29591]: pgmap v4060: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 13 op/s 2024-05-08T08:53:55.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:55 smithi172 ceph-mon[33377]: pgmap v4060: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 13 op/s 2024-05-08T08:53:55.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:55 smithi194 ceph-mon[33679]: pgmap v4060: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 88 KiB/s wr, 13 op/s 2024-05-08T08:53:56.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:56.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:56.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:56.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:56.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:56.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:57 smithi172 ceph-mon[33377]: pgmap v4061: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 171 KiB/s wr, 10 op/s 2024-05-08T08:53:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:57 smithi070 ceph-mon[29591]: pgmap v4061: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 171 KiB/s wr, 10 op/s 2024-05-08T08:53:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:57 smithi194 ceph-mon[33679]: pgmap v4061: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 171 KiB/s wr, 10 op/s 2024-05-08T08:53:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:58.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:58 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:53:58.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:58 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:53:58.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:58 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:53:58.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:58 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:53:58.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:58.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:59.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:58 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T08:53:59.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:58 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T08:53:59.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:59.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:59.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:59.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:53:59.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:59 smithi070 ceph-mon[29591]: pgmap v4062: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 123 KiB/s wr, 8 op/s 2024-05-08T08:53:59.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:59 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:53:59.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:59 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:53:59.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:59.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:53:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:59 smithi172 ceph-mon[33377]: pgmap v4062: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 123 KiB/s wr, 8 op/s 2024-05-08T08:53:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:59 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:53:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:59 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:53:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:53:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:53:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:54:00.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:59 smithi194 ceph-mon[33679]: pgmap v4062: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 123 KiB/s wr, 8 op/s 2024-05-08T08:54:00.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:59 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T08:54:00.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:59 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T08:54:00.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:54:00.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:53:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:54:00.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:00.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:00.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:00.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:00.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:54:00.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:54:00.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:54:00.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:00.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:00.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:00.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:00.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:54:00.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:54:00.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:54:01.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:01.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:01.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:01.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T08:54:01.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:54:01.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:54:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:54:01.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:01 smithi070 ceph-mon[29591]: pgmap v4063: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 205 KiB/s wr, 14 op/s 2024-05-08T08:54:01.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:01 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:54:01.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:01 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:54:01.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:01 smithi172 ceph-mon[33377]: pgmap v4063: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 205 KiB/s wr, 14 op/s 2024-05-08T08:54:01.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:01 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:54:01.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:01 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:54:02.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:01 smithi194 ceph-mon[33679]: pgmap v4063: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 205 KiB/s wr, 14 op/s 2024-05-08T08:54:02.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:01 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T08:54:02.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:01 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T08:54:03.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:03 smithi070 ceph-mon[29591]: pgmap v4064: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 168 KiB/s wr, 9 op/s 2024-05-08T08:54:03.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:03 smithi172 ceph-mon[33377]: pgmap v4064: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 168 KiB/s wr, 9 op/s 2024-05-08T08:54:04.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:03 smithi194 ceph-mon[33679]: pgmap v4064: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 168 KiB/s wr, 9 op/s 2024-05-08T08:54:04.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:04 smithi070 ceph-mon[29591]: pgmap v4065: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 212 KiB/s wr, 28 op/s 2024-05-08T08:54:04.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:04 smithi172 ceph-mon[33377]: pgmap v4065: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 212 KiB/s wr, 28 op/s 2024-05-08T08:54:05.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:04 smithi194 ceph-mon[33679]: pgmap v4065: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 212 KiB/s wr, 28 op/s 2024-05-08T08:54:07.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:07 smithi070 ceph-mon[29591]: pgmap v4066: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 283 KiB/s wr, 27 op/s 2024-05-08T08:54:07.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:07 smithi172 ceph-mon[33377]: pgmap v4066: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 283 KiB/s wr, 27 op/s 2024-05-08T08:54:07.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:07 smithi194 ceph-mon[33679]: pgmap v4066: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 283 KiB/s wr, 27 op/s 2024-05-08T08:54:09.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:09 smithi070 ceph-mon[29591]: pgmap v4067: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 198 KiB/s wr, 26 op/s 2024-05-08T08:54:09.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:09 smithi172 ceph-mon[33377]: pgmap v4067: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 198 KiB/s wr, 26 op/s 2024-05-08T08:54:09.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:09 smithi194 ceph-mon[33679]: pgmap v4067: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 198 KiB/s wr, 26 op/s 2024-05-08T08:54:11.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:11 smithi172 ceph-mon[33377]: pgmap v4068: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 218 KiB/s wr, 32 op/s 2024-05-08T08:54:11.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:11 smithi172 ceph-mon[33377]: osdmap e332: 12 total, 12 up, 12 in 2024-05-08T08:54:11.508 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:11 smithi194 ceph-mon[33679]: pgmap v4068: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 218 KiB/s wr, 32 op/s 2024-05-08T08:54:11.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:11 smithi194 ceph-mon[33679]: osdmap e332: 12 total, 12 up, 12 in 2024-05-08T08:54:11.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:11 smithi070 ceph-mon[29591]: pgmap v4068: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 218 KiB/s wr, 32 op/s 2024-05-08T08:54:11.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:11 smithi070 ceph-mon[29591]: osdmap e332: 12 total, 12 up, 12 in 2024-05-08T08:54:12.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:54:13.367 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:54:13.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:13 smithi070 ceph-mon[29591]: pgmap v4070: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 163 KiB/s wr, 31 op/s 2024-05-08T08:54:13.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:13 smithi172 ceph-mon[33377]: pgmap v4070: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 163 KiB/s wr, 31 op/s 2024-05-08T08:54:13.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:13 smithi194 ceph-mon[33679]: pgmap v4070: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 163 KiB/s wr, 31 op/s 2024-05-08T08:54:15.392 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:15 smithi070 ceph-mon[29591]: pgmap v4071: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 110 KiB/s wr, 10 op/s 2024-05-08T08:54:15.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:15 smithi172 ceph-mon[33377]: pgmap v4071: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 110 KiB/s wr, 10 op/s 2024-05-08T08:54:15.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:15 smithi194 ceph-mon[33679]: pgmap v4071: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 110 KiB/s wr, 10 op/s 2024-05-08T08:54:15.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.711+0000 7fd174c00700 1 -- 172.21.15.70:0/1002573928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 msgr2=0x7fd17010ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:15.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.711+0000 7fd174c00700 1 --2- 172.21.15.70:0/1002573928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 0x7fd17010ff40 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fd160009990 tx=0x7fd160009ca0 comp rx=0 tx=0).stop 2024-05-08T08:54:15.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.711+0000 7fd174c00700 1 -- 172.21.15.70:0/1002573928 shutdown_connections 2024-05-08T08:54:15.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.711+0000 7fd174c00700 1 --2- 172.21.15.70:0/1002573928 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17010a490 0x7fd1701169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:15.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.711+0000 7fd174c00700 1 --2- 172.21.15.70:0/1002573928 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 0x7fd17010ff40 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:15.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.711+0000 7fd174c00700 1 --2- 172.21.15.70:0/1002573928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd170109ad0 0x7fd170109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:15.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.711+0000 7fd174c00700 1 -- 172.21.15.70:0/1002573928 >> 172.21.15.70:0/1002573928 conn(0x7fd170076c70 msgr2=0x7fd1701082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:54:15.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.711+0000 7fd174c00700 1 -- 172.21.15.70:0/1002573928 shutdown_connections 2024-05-08T08:54:15.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.711+0000 7fd174c00700 1 -- 172.21.15.70:0/1002573928 wait complete. 2024-05-08T08:54:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.713+0000 7fd174c00700 1 Processor -- start 2024-05-08T08:54:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.713+0000 7fd174c00700 1 -- start start 2024-05-08T08:54:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.713+0000 7fd174c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd170109ad0 0x7fd1701a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.713+0000 7fd174c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17010a490 0x7fd1701a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.713+0000 7fd174c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 0x7fd1701a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.713+0000 7fd174c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd170119bb0 con 0x7fd17010fb60 2024-05-08T08:54:15.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.713+0000 7fd174c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd170119a30 con 0x7fd17010a490 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.713+0000 7fd174c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd170119d30 con 0x7fd170109ad0 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 0x7fd1701a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 0x7fd1701a49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60784/0 (socket says 172.21.15.70:60784) 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16e800700 1 -- 172.21.15.70:0/3986787463 learned_addr learned my addr 172.21.15.70:0/3986787463 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16d400700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17010a490 0x7fd1701a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16de00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd170109ad0 0x7fd1701a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16e800700 1 -- 172.21.15.70:0/3986787463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd170109ad0 msgr2=0x7fd1701a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16e800700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd170109ad0 0x7fd1701a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16e800700 1 -- 172.21.15.70:0/3986787463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17010a490 msgr2=0x7fd1701a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16e800700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17010a490 0x7fd1701a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.714+0000 7fd16e800700 1 -- 172.21.15.70:0/3986787463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1701a5110 con 0x7fd17010fb60 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.715+0000 7fd16e800700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 0x7fd1701a49d0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fd168007ee0 tx=0x7fd16800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.715+0000 7fd166a00700 1 -- 172.21.15.70:0/3986787463 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16800dbd0 con 0x7fd17010fb60 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.715+0000 7fd166a00700 1 -- 172.21.15.70:0/3986787463 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd16800dd70 con 0x7fd17010fb60 2024-05-08T08:54:15.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.715+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1701a5400 con 0x7fd17010fb60 2024-05-08T08:54:15.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.715+0000 7fd166a00700 1 -- 172.21.15.70:0/3986787463 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1680058d0 con 0x7fd17010fb60 2024-05-08T08:54:15.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.715+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1701acc80 con 0x7fd17010fb60 2024-05-08T08:54:15.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.716+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17006a190 con 0x7fd17010fb60 2024-05-08T08:54:15.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.719+0000 7fd166a00700 1 -- 172.21.15.70:0/3986787463 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd16801a020 con 0x7fd17010fb60 2024-05-08T08:54:15.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.720+0000 7fd166a00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd1540b29f0 0x7fd1540b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:15.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.720+0000 7fd166a00700 1 -- 172.21.15.70:0/3986787463 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(332..332 src has 1..332) ==== 9671+0+0 (secure 0 0 0) 0x7fd1680e2980 con 0x7fd17010fb60 2024-05-08T08:54:15.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.720+0000 7fd16de00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd1540b29f0 0x7fd1540b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:15.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.721+0000 7fd16de00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd1540b29f0 0x7fd1540b4eb0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd16000b5c0 tx=0x7fd16001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:54:15.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:15.723+0000 7fd166a00700 1 -- 172.21.15.70:0/3986787463 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd168010070 con 0x7fd17010fb60 2024-05-08T08:54:16.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.003+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd17002e510 con 0x7fd17010fb60 2024-05-08T08:54:16.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.004+0000 7fd166a00700 1 -- 172.21.15.70:0/3986787463 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fd1680a9e80 con 0x7fd17010fb60 2024-05-08T08:54:16.003 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:54:16.003 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd1540b29f0 msgr2=0x7fd1540b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd1540b29f0 0x7fd1540b4eb0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fd16000b5c0 tx=0x7fd16001a040 comp rx=0 tx=0).stop 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 msgr2=0x7fd1701a49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 0x7fd1701a49d0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fd168007ee0 tx=0x7fd16800d3b0 comp rx=0 tx=0).stop 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 shutdown_connections 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd1540b29f0 0x7fd1540b4eb0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd17010fb60 0x7fd1701a49d0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd170109ad0 0x7fd1701a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 --2- 172.21.15.70:0/3986787463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd17010a490 0x7fd1701a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 >> 172.21.15.70:0/3986787463 conn(0x7fd170076c70 msgr2=0x7fd170077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:54:16.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 shutdown_connections 2024-05-08T08:54:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:16.008+0000 7fd174c00700 1 -- 172.21.15.70:0/3986787463 wait complete. 2024-05-08T08:54:16.007 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:54:16.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:16 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3986787463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:54:16.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:16 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3986787463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:54:16.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:16 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3986787463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:54:16.863 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 3e0a07fc --release --await' 2024-05-08T08:54:16.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 3e0a07fc --release --await 2024-05-08T08:54:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:54:17.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:17 smithi172 ceph-mon[33377]: pgmap v4072: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 9 op/s 2024-05-08T08:54:17.459 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:17 smithi070 ceph-mon[29591]: pgmap v4072: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 9 op/s 2024-05-08T08:54:17.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:17 smithi194 ceph-mon[33679]: pgmap v4072: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 9 op/s 2024-05-08T08:54:19.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:19 smithi070 ceph-mon[29591]: pgmap v4073: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 9 op/s 2024-05-08T08:54:19.427 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:19 smithi172 ceph-mon[33377]: pgmap v4073: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 9 op/s 2024-05-08T08:54:19.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.508+0000 7f2f77200700 1 -- 172.21.15.70:0/832100105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f7810d9f0 msgr2=0x7f2f7810fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:19.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.508+0000 7f2f77200700 1 --2- 172.21.15.70:0/832100105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f7810d9f0 0x7f2f7810fe70 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000b0a0 tx=0x7f2f7000b3b0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.508+0000 7f2f77200700 1 -- 172.21.15.70:0/832100105 shutdown_connections 2024-05-08T08:54:19.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.508+0000 7f2f77200700 1 --2- 172.21.15.70:0/832100105 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f7810d9f0 0x7f2f7810fe70 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.508+0000 7f2f77200700 1 --2- 172.21.15.70:0/832100105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f78104610 0x7f2f781049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.508+0000 7f2f77200700 1 --2- 172.21.15.70:0/832100105 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f78104f30 0x7f2f7810d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.508+0000 7f2f77200700 1 -- 172.21.15.70:0/832100105 >> 172.21.15.70:0/832100105 conn(0x7f2f780fddc0 msgr2=0x7f2f781001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:54:19.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.508+0000 7f2f77200700 1 -- 172.21.15.70:0/832100105 shutdown_connections 2024-05-08T08:54:19.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.508+0000 7f2f77200700 1 -- 172.21.15.70:0/832100105 wait complete. 2024-05-08T08:54:19.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.509+0000 7f2f77200700 1 Processor -- start 2024-05-08T08:54:19.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.509+0000 7f2f77200700 1 -- start start 2024-05-08T08:54:19.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f77200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f78104610 0x7f2f78102270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f77200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f78104f30 0x7f2f781027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f77200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f7810d9f0 0x7f2f78102cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f77200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f781134b0 con 0x7f2f78104610 2024-05-08T08:54:19.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f77200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f78113330 con 0x7f2f7810d9f0 2024-05-08T08:54:19.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f77200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2f78113630 con 0x7f2f78104f30 2024-05-08T08:54:19.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f75e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f78104610 0x7f2f78102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f75e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f78104610 0x7f2f78102270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53538/0 (socket says 172.21.15.70:53538) 2024-05-08T08:54:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f75e00700 1 -- 172.21.15.70:0/3442343601 learned_addr learned my addr 172.21.15.70:0/3442343601 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:54:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f75400700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f78104f30 0x7f2f781027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.510+0000 7f2f76800700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f7810d9f0 0x7f2f78102cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f75e00700 1 -- 172.21.15.70:0/3442343601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f78104f30 msgr2=0x7f2f781027b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f75e00700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f78104f30 0x7f2f781027b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f75e00700 1 -- 172.21.15.70:0/3442343601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f7810d9f0 msgr2=0x7f2f78102cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f75e00700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f7810d9f0 0x7f2f78102cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f75e00700 1 -- 172.21.15.70:0/3442343601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f781a7f10 con 0x7f2f78104610 2024-05-08T08:54:19.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f75400700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f78104f30 0x7f2f781027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:54:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:19 smithi194 ceph-mon[33679]: pgmap v4073: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 9 op/s 2024-05-08T08:54:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f75e00700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f78104610 0x7f2f78102270 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800eb30 tx=0x7f2f6800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:54:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f6ea00700 1 -- 172.21.15.70:0/3442343601 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800cd40 con 0x7f2f78104610 2024-05-08T08:54:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f6ea00700 1 -- 172.21.15.70:0/3442343601 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f680044b0 con 0x7f2f78104610 2024-05-08T08:54:19.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f6ea00700 1 -- 172.21.15.70:0/3442343601 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68010430 con 0x7f2f78104610 2024-05-08T08:54:19.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.511+0000 7f2f77200700 1 -- 172.21.15.70:0/3442343601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f781a8200 con 0x7f2f78104610 2024-05-08T08:54:19.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.512+0000 7f2f77200700 1 -- 172.21.15.70:0/3442343601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f781a8790 con 0x7f2f78104610 2024-05-08T08:54:19.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.515+0000 7f2f6ea00700 1 -- 172.21.15.70:0/3442343601 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2f68003f10 con 0x7f2f78104610 2024-05-08T08:54:19.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.517+0000 7f2f6ea00700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f5c0b2a70 0x7f2f5c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.517+0000 7f2f6ea00700 1 -- 172.21.15.70:0/3442343601 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(332..332 src has 1..332) ==== 9671+0+0 (secure 0 0 0) 0x7f2f680e2da0 con 0x7f2f78104610 2024-05-08T08:54:19.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.517+0000 7f2f75400700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f5c0b2a70 0x7f2f5c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.518+0000 7f2f75400700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f5c0b2a70 0x7f2f5c0b4f30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2f7810ee80 tx=0x7f2f64009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:54:19.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.534+0000 7f2f874d5b80 1 Processor -- start 2024-05-08T08:54:19.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.535+0000 7f2f874d5b80 1 -- start start 2024-05-08T08:54:19.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.535+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82b3f60 0x55bdd82b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.535+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.535+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82aeab0 0x55bdd82aef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.535+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bdd8200b20 con 0x55bdd82b4880 2024-05-08T08:54:19.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.535+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bdd819e860 con 0x55bdd82b3f60 2024-05-08T08:54:19.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.535+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bdd81fcae0 con 0x55bdd82aeab0 2024-05-08T08:54:19.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82ae490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53540/0 (socket says 172.21.15.70:53540) 2024-05-08T08:54:19.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75400700 1 -- 172.21.15.70:0/142967653 learned_addr learned my addr 172.21.15.70:0/142967653 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:54:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f76800700 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82aeab0 0x55bdd82aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75e00700 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82b3f60 0x55bdd82b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75400700 1 -- 172.21.15.70:0/142967653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82aeab0 msgr2=0x55bdd82aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:54:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75400700 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82aeab0 0x55bdd82aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75400700 1 -- 172.21.15.70:0/142967653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82b3f60 msgr2=0x55bdd82b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:54:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75400700 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82b3f60 0x55bdd82b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75400700 1 -- 172.21.15.70:0/142967653 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd814d9d0 con 0x55bdd82b4880 2024-05-08T08:54:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.536+0000 7f2f75e00700 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82b3f60 0x55bdd82b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:54:19.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.537+0000 7f2f75400700 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82ae490 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f2f64010f70 tx=0x7f2f64013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b6e34d073070fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:54:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.537+0000 7f2f63400700 1 -- 172.21.15.70:0/142967653 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64011db0 con 0x55bdd82b4880 2024-05-08T08:54:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.537+0000 7f2f63400700 1 -- 172.21.15.70:0/142967653 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f64009e50 con 0x55bdd82b4880 2024-05-08T08:54:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.537+0000 7f2f63400700 1 -- 172.21.15.70:0/142967653 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6401c5b0 con 0x55bdd82b4880 2024-05-08T08:54:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.538+0000 7f2f874d5b80 1 -- 172.21.15.70:0/142967653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 msgr2=0x55bdd82ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.538+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82ae490 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f2f64010f70 tx=0x7f2f64013000 comp rx=0 tx=0).stop 2024-05-08T08:54:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.538+0000 7f2f874d5b80 1 -- 172.21.15.70:0/142967653 shutdown_connections 2024-05-08T08:54:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.538+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82aeab0 0x55bdd82aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.538+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82b3f60 0x55bdd82b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.538+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/142967653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82ae490 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.538+0000 7f2f874d5b80 1 -- 172.21.15.70:0/142967653 >> 172.21.15.70:0/142967653 conn(0x55bdd81dcc60 msgr2=0x55bdd82a8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:54:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.538+0000 7f2f874d5b80 1 -- 172.21.15.70:0/142967653 shutdown_connections 2024-05-08T08:54:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.538+0000 7f2f874d5b80 1 -- 172.21.15.70:0/142967653 wait complete. 2024-05-08T08:54:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.539+0000 7f2f874d5b80 1 -- start start 2024-05-08T08:54:19.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.539+0000 7f2f874d5b80 1 Processor -- start 2024-05-08T08:54:19.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.540+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82ba570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.540+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 0x55bdd82b7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.540+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.540+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bdd82bb3a0 con 0x55bdd82b4880 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.540+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bdd8166c20 con 0x55bdd82aeab0 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.540+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bdd82bb520 con 0x55bdd82b3f60 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.540+0000 7f2f874d5b80 10 client.0 _ll_register_callbacks cb 0x55bdd81a7d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f76800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f75e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82ba570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f75400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 0x55bdd82b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f75e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82ba570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:45722/0 (socket says 172.21.15.70:45722) 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f76800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82b7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53556/0 (socket says 172.21.15.70:53556) 2024-05-08T08:54:19.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f75e00700 1 -- 172.21.15.70:0/2859392106 learned_addr learned my addr 172.21.15.70:0/2859392106 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f76800700 1 -- 172.21.15.70:0/2859392106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 msgr2=0x55bdd82b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f76800700 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 0x55bdd82b7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f76800700 1 -- 172.21.15.70:0/2859392106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 msgr2=0x55bdd82ba570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f76800700 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82ba570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f76800700 1 -- 172.21.15.70:0/2859392106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd81c6520 con 0x55bdd82b4880 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.541+0000 7f2f76800700 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82b7e50 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000b780 tx=0x7f2f7000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6374aa85f2fd8aff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.542+0000 7f2f57e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.542+0000 7f2f57e00700 1 -- 172.21.15.70:0/2859392106 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70004e60 con 0x55bdd82b4880 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.542+0000 7f2f57e00700 1 -- 172.21.15.70:0/2859392106 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(332..332 src has 1..332) ==== 9671+0+0 (secure 0 0 0) 0x7f2f700074e0 con 0x55bdd82b4880 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.542+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2859392106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f64009e50 con 0x55bdd82b4880 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.542+0000 7f2f57e00700 1 -- 172.21.15.70:0/2859392106 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2f700076e0 con 0x55bdd82b4880 2024-05-08T08:54:19.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.542+0000 7f2f874d5b80 10 client.18747 fetch_fsmap learned FSMap version 42 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.542+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2859392106 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bdd82c5bd0 con 0x55bdd82b4880 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.543+0000 7f2f57e00700 1 -- 172.21.15.70:0/2859392106 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f64009e50 con 0x55bdd82b4880 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.543+0000 7f2f57e00700 1 -- 172.21.15.70:0/2859392106 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2f70011070 con 0x55bdd82b4880 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.543+0000 7f2f874d5b80 10 client.18747 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.543+0000 7f2f874d5b80 10 client.18747 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.543+0000 7f2f874d5b80 20 client.18747 populate_metadata read hostname 'smithi070' 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.543+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdd82c81b0 0x55bdd82ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.543+0000 7f2f874d5b80 4 client.18747 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.543+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2859392106 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdd827b1a0 con 0x55bdd82c81b0 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.544+0000 7f2f75e00700 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdd82c81b0 0x55bdd82ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.545+0000 7f2f57e00700 10 client.18747 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:54:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.545+0000 7f2f75e00700 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdd82c81b0 0x55bdd82ca5a0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d2f5fe16dc3e456 server_cookie=afcef7d93aaa7140 in_seq=0 out_seq=0 2024-05-08T08:54:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f57e00700 1 -- 172.21.15.70:0/2859392106 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bdd827b1a0 con 0x55bdd82c81b0 2024-05-08T08:54:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f57e00700 10 client.18747 handle_command_reply: tid=0 2024-05-08T08:54:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 client.18747 shutdown 2024-05-08T08:54:19.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2859392106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 msgr2=0x55bdd82b7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:19.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82b7e50 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000b780 tx=0x7f2f7000bce0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2859392106 shutdown_connections 2024-05-08T08:54:19.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdd82c81b0 0x55bdd82ca5a0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82b7e50 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82ba570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2859392106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 0x55bdd82b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f57e00700 0 client.18747 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:54:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2859392106 >> 172.21.15.70:0/2859392106 conn(0x55bdd81dcc60 msgr2=0x55bdd82ad480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:54:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2859392106 shutdown_connections 2024-05-08T08:54:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2859392106 wait complete. 2024-05-08T08:54:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.547+0000 7f2f874d5b80 20 client.18747 trim_cache size 0 max 16384 2024-05-08T08:54:19.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.569+0000 7f2f874d5b80 1 Processor -- start 2024-05-08T08:54:19.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.569+0000 7f2f874d5b80 1 -- start start 2024-05-08T08:54:19.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b3f60 0x55bdd82cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b4880 0x55bdd82d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f781b4100 con 0x55bdd82b3f60 2024-05-08T08:54:19.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f781b1990 con 0x55bdd82aeab0 2024-05-08T08:54:19.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2f781af800 con 0x55bdd82b4880 2024-05-08T08:54:19.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b3f60 0x55bdd82cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f75400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b3f60 0x55bdd82cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53564/0 (socket says 172.21.15.70:53564) 2024-05-08T08:54:19.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f75400700 1 -- 172.21.15.70:0/2581242648 learned_addr learned my addr 172.21.15.70:0/2581242648 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:54:19.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.570+0000 7f2f76800700 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b4880 0x55bdd82d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f75e00700 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f75400700 1 -- 172.21.15.70:0/2581242648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b4880 msgr2=0x55bdd82d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:54:19.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f75400700 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b4880 0x55bdd82d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f75400700 1 -- 172.21.15.70:0/2581242648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 msgr2=0x55bdd82c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f75400700 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f75400700 1 -- 172.21.15.70:0/2581242648 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdd82b76e0 con 0x55bdd82b3f60 2024-05-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f75e00700 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f75400700 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b3f60 0x55bdd82cfe50 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f2f64011010 tx=0x7f2f64005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd65c6efd454c5b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f62a00700 1 -- 172.21.15.70:0/2581242648 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64036070 con 0x55bdd82b3f60 2024-05-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f62a00700 1 -- 172.21.15.70:0/2581242648 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f64031910 con 0x55bdd82b3f60 2024-05-08T08:54:19.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.571+0000 7f2f62a00700 1 -- 172.21.15.70:0/2581242648 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6401e7f0 con 0x55bdd82b3f60 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.572+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2581242648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b3f60 msgr2=0x55bdd82cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.572+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b3f60 0x55bdd82cfe50 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f2f64011010 tx=0x7f2f64005d20 comp rx=0 tx=0).stop 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.572+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2581242648 shutdown_connections 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.572+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b4880 0x55bdd82d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.572+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.572+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/2581242648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b3f60 0x55bdd82cfe50 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.572+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2581242648 >> 172.21.15.70:0/2581242648 conn(0x55bdd81dcc60 msgr2=0x55bdd82b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.572+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2581242648 shutdown_connections 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.573+0000 7f2f874d5b80 1 -- 172.21.15.70:0/2581242648 wait complete. 2024-05-08T08:54:19.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.573+0000 7f2f874d5b80 1 -- start start 2024-05-08T08:54:19.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.573+0000 7f2f874d5b80 1 Processor -- start 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 0x55bdd82c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f874d5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f781afe50 con 0x55bdd82b4880 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f781b12c0 con 0x55bdd82aeab0 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f874d5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2f781b0520 con 0x55bdd82b3f60 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f874d5b80 10 client.0 _ll_register_callbacks cb 0x55bdd81a7d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f76800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f76800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82bdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53572/0 (socket says 172.21.15.70:53572) 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f76800700 1 -- 172.21.15.70:0/3518301647 learned_addr learned my addr 172.21.15.70:0/3518301647 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:54:19.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f75e00700 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.574+0000 7f2f75400700 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 0x55bdd82c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.575+0000 7f2f76800700 1 -- 172.21.15.70:0/3518301647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 msgr2=0x55bdd82c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.575+0000 7f2f76800700 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 0x55bdd82c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.575+0000 7f2f76800700 1 -- 172.21.15.70:0/3518301647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 msgr2=0x55bdd82c09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.575+0000 7f2f76800700 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82c09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.575+0000 7f2f76800700 1 -- 172.21.15.70:0/3518301647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdd82be7b0 con 0x55bdd82b4880 2024-05-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.575+0000 7f2f76800700 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82bdf70 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f2f70005670 tx=0x7f2f700074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5750679d6285ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:54:19.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.575+0000 7f2f57e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.576+0000 7f2f57e00700 1 -- 172.21.15.70:0/3518301647 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70039060 con 0x55bdd82b4880 2024-05-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.576+0000 7f2f874d5b80 1 -- 172.21.15.70:0/3518301647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f64031910 con 0x55bdd82b4880 2024-05-08T08:54:19.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.576+0000 7f2f57e00700 1 -- 172.21.15.70:0/3518301647 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(332..332 src has 1..332) ==== 9671+0+0 (secure 0 0 0) 0x7f2f7000f020 con 0x55bdd82b4880 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.576+0000 7f2f57e00700 1 -- 172.21.15.70:0/3518301647 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2f70040050 con 0x55bdd82b4880 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.576+0000 7f2f874d5b80 10 client.18753 fetch_fsmap learned FSMap version 42 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.576+0000 7f2f874d5b80 1 -- 172.21.15.70:0/3518301647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bdd8334680 con 0x55bdd82b4880 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.576+0000 7f2f57e00700 1 -- 172.21.15.70:0/3518301647 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f64031910 con 0x55bdd82b4880 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.577+0000 7f2f57e00700 1 -- 172.21.15.70:0/3518301647 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2f70011040 con 0x55bdd82b4880 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.577+0000 7f2f874d5b80 10 client.18753 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.577+0000 7f2f874d5b80 10 client.18753 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.577+0000 7f2f874d5b80 20 client.18753 populate_metadata read hostname 'smithi070' 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.577+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdd8334d60 0x55bdd8337150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.577+0000 7f2f874d5b80 4 client.18753 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "3e0a07fc", "release": true, "await": true}] 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.577+0000 7f2f874d5b80 1 -- 172.21.15.70:0/3518301647 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "3e0a07fc", "release": true, "await": true}) -- 0x55bdd820e500 con 0x55bdd8334d60 2024-05-08T08:54:19.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.578+0000 7f2f75e00700 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdd8334d60 0x55bdd8337150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.578+0000 7f2f75e00700 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdd8334d60 0x55bdd8337150 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af6c23458b5183b8 server_cookie=fd401627ffe0b578 in_seq=0 out_seq=0 2024-05-08T08:54:19.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:19.578+0000 7f2f57e00700 10 client.18753 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:54:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:21 smithi194 ceph-mon[33679]: pgmap v4074: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:54:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:21 smithi194 ceph-mon[33679]: osdmap e333: 12 total, 12 up, 12 in 2024-05-08T08:54:21.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:21 smithi070 ceph-mon[29591]: pgmap v4074: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:54:21.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:21 smithi070 ceph-mon[29591]: osdmap e333: 12 total, 12 up, 12 in 2024-05-08T08:54:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:21 smithi172 ceph-mon[33377]: pgmap v4074: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:54:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:21 smithi172 ceph-mon[33377]: osdmap e333: 12 total, 12 up, 12 in 2024-05-08T08:54:23.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:23 smithi194 ceph-mon[33679]: pgmap v4076: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:54:23.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:23 smithi070 ceph-mon[29591]: pgmap v4076: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:54:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:23 smithi172 ceph-mon[33377]: pgmap v4076: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T08:54:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.608+0000 7f2f57e00700 1 -- 172.21.15.70:0/3518301647 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x7f2f680c3260 con 0x55bdd8334d60 2024-05-08T08:54:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.608+0000 7f2f57e00700 10 client.18753 handle_command_reply: tid=0 2024-05-08T08:54:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.608+0000 7f2f874d5b80 1 client.18753 shutdown 2024-05-08T08:54:24.609 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:54:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:54:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:54:24.609 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 284, 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "3e0a07fc": { 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 284, 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.3, 2024-05-08T08:54:24.610 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:54:24.611 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:54:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.609+0000 7f2f874d5b80 1 -- 172.21.15.70:0/3518301647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 msgr2=0x55bdd82bdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.609+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82bdf70 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f2f70005670 tx=0x7f2f700074a0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.610+0000 7f2f874d5b80 1 -- 172.21.15.70:0/3518301647 shutdown_connections 2024-05-08T08:54:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.610+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bdd8334d60 0x55bdd8337150 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.610+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bdd82b4880 0x55bdd82bdf70 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.610+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bdd82aeab0 0x55bdd82c09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.610+0000 7f2f874d5b80 1 --2- 172.21.15.70:0/3518301647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bdd82b3f60 0x55bdd82c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.610+0000 7f2f874d5b80 1 -- 172.21.15.70:0/3518301647 >> 172.21.15.70:0/3518301647 conn(0x55bdd81dcc60 msgr2=0x55bdd82b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.610+0000 7f2f57e00700 0 client.18753 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.611+0000 7f2f874d5b80 1 -- 172.21.15.70:0/3518301647 shutdown_connections 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.611+0000 7f2f874d5b80 1 -- 172.21.15.70:0/3518301647 wait complete. 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.611+0000 7f2f874d5b80 20 client.18753 trim_cache size 0 max 16384 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 -- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f5c0b2a70 msgr2=0x7f2f5c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f5c0b2a70 0x7f2f5c0b4f30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f2f7810ee80 tx=0x7f2f64009260 comp rx=0 tx=0).stop 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 -- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f78104610 msgr2=0x7f2f78102270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f78104610 0x7f2f78102270 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f2f6800eb30 tx=0x7f2f6800eef0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 -- 172.21.15.70:0/3442343601 shutdown_connections 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f5c0b2a70 0x7f2f5c0b4f30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f7810d9f0 0x7f2f78102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f78104610 0x7f2f78102270 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 --2- 172.21.15.70:0/3442343601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f78104f30 0x7f2f781027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:54:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.613+0000 7f2f77200700 1 -- 172.21.15.70:0/3442343601 >> 172.21.15.70:0/3442343601 conn(0x7f2f780fddc0 msgr2=0x7f2f780feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:54:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.614+0000 7f2f77200700 1 -- 172.21.15.70:0/3442343601 shutdown_connections 2024-05-08T08:54:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:54:24.614+0000 7f2f77200700 1 -- 172.21.15.70:0/3442343601 wait complete. 2024-05-08T08:54:25.376 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:25 smithi070 ceph-mon[29591]: pgmap v4077: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T08:54:25.481 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:25 smithi172 ceph-mon[33377]: pgmap v4077: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T08:54:25.500 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '3e0a07fc', seconds elapsed: 65.4 2024-05-08T08:54:25.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:25 smithi194 ceph-mon[33679]: pgmap v4077: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 KiB/s wr, 7 op/s 2024-05-08T08:54:26.756 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/cppc_acpi.o 2024-05-08T08:54:27.091 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_ldsem.o 2024-05-08T08:54:27.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:27 smithi194 ceph-mon[33679]: pgmap v4078: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T08:54:27.522 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/virtio/virtgpu_submit.o 2024-05-08T08:54:27.588 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/connector/cn_proc.o 2024-05-08T08:54:27.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:27 smithi070 ceph-mon[29591]: pgmap v4078: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T08:54:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:27 smithi172 ceph-mon[33377]: pgmap v4078: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T08:54:28.086 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_baudrate.o 2024-05-08T08:54:28.102 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_jobctrl.o 2024-05-08T08:54:28.114 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/n_null.o 2024-05-08T08:54:28.414 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_pcode.o 2024-05-08T08:54:29.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:29 smithi194 ceph-mon[33679]: pgmap v4079: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T08:54:29.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:29 smithi070 ceph-mon[29591]: pgmap v4079: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T08:54:29.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:29 smithi172 ceph-mon[33377]: pgmap v4079: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T08:54:31.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:31 smithi194 ceph-mon[33679]: pgmap v4080: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 573 KiB/s wr, 22 op/s 2024-05-08T08:54:31.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:31 smithi070 ceph-mon[29591]: pgmap v4080: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 573 KiB/s wr, 22 op/s 2024-05-08T08:54:31.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:31 smithi172 ceph-mon[33377]: pgmap v4080: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 530 KiB/s rd, 573 KiB/s wr, 22 op/s 2024-05-08T08:54:33.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:33 smithi194 ceph-mon[33679]: pgmap v4081: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 514 KiB/s wr, 20 op/s 2024-05-08T08:54:33.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:33 smithi070 ceph-mon[29591]: pgmap v4081: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 514 KiB/s wr, 20 op/s 2024-05-08T08:54:33.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:33 smithi172 ceph-mon[33377]: pgmap v4081: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 514 KiB/s wr, 20 op/s 2024-05-08T08:54:34.294 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/acpi/spcr.o 2024-05-08T08:54:35.225 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/pty.o 2024-05-08T08:54:35.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:35 smithi194 ceph-mon[33679]: pgmap v4082: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 766 KiB/s wr, 28 op/s 2024-05-08T08:54:35.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:35 smithi070 ceph-mon[29591]: pgmap v4082: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 766 KiB/s wr, 28 op/s 2024-05-08T08:54:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:35 smithi172 ceph-mon[33377]: pgmap v4082: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 766 KiB/s wr, 28 op/s 2024-05-08T08:54:36.507 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/virtio/built-in.a 2024-05-08T08:54:37.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:37 smithi194 ceph-mon[33679]: pgmap v4083: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 763 KiB/s wr, 29 op/s 2024-05-08T08:54:37.548 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/mxsfb/built-in.a 2024-05-08T08:54:37.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:37 smithi070 ceph-mon[29591]: pgmap v4083: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 763 KiB/s wr, 29 op/s 2024-05-08T08:54:37.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:37 smithi172 ceph-mon[33377]: pgmap v4083: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 763 KiB/s wr, 29 op/s 2024-05-08T08:54:37.751 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/tty_audit.o 2024-05-08T08:54:37.774 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/tty/sysrq.o 2024-05-08T08:54:39.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:39 smithi194 ceph-mon[33679]: pgmap v4084: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 758 KiB/s wr, 27 op/s 2024-05-08T08:54:39.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:39 smithi070 ceph-mon[29591]: pgmap v4084: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 758 KiB/s wr, 27 op/s 2024-05-08T08:54:39.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:39 smithi172 ceph-mon[33377]: pgmap v4084: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 758 KiB/s wr, 27 op/s 2024-05-08T08:54:40.361 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/connector/built-in.a 2024-05-08T08:54:40.473 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_region_ttm.o 2024-05-08T08:54:40.597 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_runtime_pm.o 2024-05-08T08:54:40.615 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_sbi.o 2024-05-08T08:54:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:41 smithi194 ceph-mon[33679]: pgmap v4085: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 1019 KiB/s wr, 38 op/s 2024-05-08T08:54:41.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:41 smithi070 ceph-mon[29591]: pgmap v4085: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 1019 KiB/s wr, 38 op/s 2024-05-08T08:54:41.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:41 smithi172 ceph-mon[33377]: pgmap v4085: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 960 KiB/s rd, 1019 KiB/s wr, 38 op/s 2024-05-08T08:54:43.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:43 smithi194 ceph-mon[33679]: pgmap v4086: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 550 KiB/s wr, 22 op/s 2024-05-08T08:54:43.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:43 smithi070 ceph-mon[29591]: pgmap v4086: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 550 KiB/s wr, 22 op/s 2024-05-08T08:54:43.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:43 smithi172 ceph-mon[33377]: pgmap v4086: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 550 KiB/s wr, 22 op/s 2024-05-08T08:54:44.715 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_step.o 2024-05-08T08:54:45.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:45 smithi194 ceph-mon[33679]: pgmap v4087: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 699 KiB/s wr, 31 op/s 2024-05-08T08:54:45.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:45 smithi070 ceph-mon[29591]: pgmap v4087: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 699 KiB/s wr, 31 op/s 2024-05-08T08:54:45.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:45 smithi172 ceph-mon[33377]: pgmap v4087: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 699 KiB/s wr, 31 op/s 2024-05-08T08:54:47.029 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_uncore.o 2024-05-08T08:54:47.169 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/acpi/built-in.a 2024-05-08T08:54:47.176 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/tiny/built-in.a 2024-05-08T08:54:47.400 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/xlnx/built-in.a 2024-05-08T08:54:47.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:47 smithi194 ceph-mon[33679]: pgmap v4088: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 415 KiB/s wr, 24 op/s 2024-05-08T08:54:47.510 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/intel_wakeref.o 2024-05-08T08:54:47.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:47 smithi070 ceph-mon[29591]: pgmap v4088: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 415 KiB/s wr, 24 op/s 2024-05-08T08:54:47.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:47 smithi172 ceph-mon[33377]: pgmap v4088: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 456 KiB/s rd, 415 KiB/s wr, 24 op/s 2024-05-08T08:54:49.011 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/tty/built-in.a 2024-05-08T08:54:49.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:49 smithi194 ceph-mon[33679]: pgmap v4089: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 415 KiB/s wr, 22 op/s 2024-05-08T08:54:49.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:49 smithi070 ceph-mon[29591]: pgmap v4089: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 415 KiB/s wr, 22 op/s 2024-05-08T08:54:49.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:49 smithi172 ceph-mon[33377]: pgmap v4089: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 415 KiB/s wr, 22 op/s 2024-05-08T08:54:51.398 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/sysfs.o 2024-05-08T08:54:51.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:51 smithi194 ceph-mon[33679]: pgmap v4090: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 794 KiB/s wr, 35 op/s 2024-05-08T08:54:51.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:51 smithi070 ceph-mon[29591]: pgmap v4090: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 794 KiB/s wr, 35 op/s 2024-05-08T08:54:51.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:51 smithi172 ceph-mon[33377]: pgmap v4090: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 811 KiB/s rd, 794 KiB/s wr, 35 op/s 2024-05-08T08:54:53.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:53 smithi194 ceph-mon[33679]: pgmap v4091: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 533 KiB/s wr, 24 op/s 2024-05-08T08:54:53.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:53 smithi070 ceph-mon[29591]: pgmap v4091: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 533 KiB/s wr, 24 op/s 2024-05-08T08:54:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:53 smithi172 ceph-mon[33377]: pgmap v4091: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 495 KiB/s rd, 533 KiB/s wr, 24 op/s 2024-05-08T08:54:53.882 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/firmware_loader/builtin/main.o 2024-05-08T08:54:53.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/regmap/regmap.o 2024-05-08T08:54:53.942 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/vlv_sideband.o 2024-05-08T08:54:55.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:55 smithi070 ceph-mon[29591]: pgmap v4092: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 863 KiB/s wr, 37 op/s 2024-05-08T08:54:55.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:55 smithi172 ceph-mon[33377]: pgmap v4092: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 863 KiB/s wr, 37 op/s 2024-05-08T08:54:55.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:55 smithi194 ceph-mon[33679]: pgmap v4092: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 863 KiB/s wr, 37 op/s 2024-05-08T08:54:57.219 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/regmap/regcache.o 2024-05-08T08:54:57.365 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/firmware_loader/main.o 2024-05-08T08:54:57.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:57 smithi070 ceph-mon[29591]: pgmap v4093: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 718 KiB/s wr, 31 op/s 2024-05-08T08:54:57.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:57 smithi172 ceph-mon[33377]: pgmap v4093: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 718 KiB/s wr, 31 op/s 2024-05-08T08:54:57.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:57 smithi194 ceph-mon[33679]: pgmap v4093: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 718 KiB/s wr, 31 op/s 2024-05-08T08:54:57.986 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/generic_ops.o 2024-05-08T08:54:58.692 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/base/firmware_loader/builtin/built-in.a 2024-05-08T08:54:58.917 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/vlv_suspend.o 2024-05-08T08:54:59.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:54:59 smithi070 ceph-mon[29591]: pgmap v4094: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 713 KiB/s wr, 28 op/s 2024-05-08T08:54:59.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:54:59 smithi172 ceph-mon[33377]: pgmap v4094: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 713 KiB/s wr, 28 op/s 2024-05-08T08:54:59.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:54:59 smithi194 ceph-mon[33679]: pgmap v4094: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 713 KiB/s wr, 28 op/s 2024-05-08T08:55:00.105 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/common.o 2024-05-08T08:55:01.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:01 smithi070 ceph-mon[29591]: pgmap v4095: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1.1 MiB/s wr, 40 op/s 2024-05-08T08:55:01.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:01 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:55:01.662 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/gud/built-in.a 2024-05-08T08:55:01.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:01 smithi172 ceph-mon[33377]: pgmap v4095: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1.1 MiB/s wr, 40 op/s 2024-05-08T08:55:01.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:01 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:55:01.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:01 smithi194 ceph-mon[33679]: pgmap v4095: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 1.1 MiB/s wr, 40 op/s 2024-05-08T08:55:01.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:01 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:55:01.979 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/solomon/built-in.a 2024-05-08T08:55:02.094 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/soc/intel_dram.o 2024-05-08T08:55:02.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:55:02.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:55:02.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:55:02.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:55:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:55:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:55:02.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:55:02.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:55:02.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:55:03.201 INFO:tasks.quiescer.fs.[cephfs]:Total duration (36.3) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T08:55:03.201 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.15 2024-05-08T08:55:03.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:55:03.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:03 smithi070 ceph-mon[29591]: pgmap v4096: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 745 KiB/s wr, 27 op/s 2024-05-08T08:55:03.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:03 smithi172 ceph-mon[33377]: pgmap v4096: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 745 KiB/s wr, 27 op/s 2024-05-08T08:55:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:03 smithi194 ceph-mon[33679]: pgmap v4096: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 745 KiB/s wr, 27 op/s 2024-05-08T08:55:03.784 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:55:05.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:05 smithi070 ceph-mon[29591]: pgmap v4097: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 803 KiB/s wr, 53 op/s 2024-05-08T08:55:05.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:05 smithi172 ceph-mon[33377]: pgmap v4097: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 803 KiB/s wr, 53 op/s 2024-05-08T08:55:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:05 smithi194 ceph-mon[33679]: pgmap v4097: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 711 KiB/s rd, 803 KiB/s wr, 53 op/s 2024-05-08T08:55:06.197 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/block/loop.o 2024-05-08T08:55:06.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:06 smithi070 ceph-mon[29591]: osdmap e334: 12 total, 12 up, 12 in 2024-05-08T08:55:06.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:06 smithi172 ceph-mon[33377]: osdmap e334: 12 total, 12 up, 12 in 2024-05-08T08:55:06.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:06 smithi194 ceph-mon[33679]: osdmap e334: 12 total, 12 up, 12 in 2024-05-08T08:55:06.927 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/misc/eeprom/built-in.a 2024-05-08T08:55:07.132 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/misc/cb710/built-in.a 2024-05-08T08:55:07.320 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/misc/ti-st/built-in.a 2024-05-08T08:55:07.527 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/misc/lis3lv02d/built-in.a 2024-05-08T08:55:07.562 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/regmap/regcache-rbtree.o 2024-05-08T08:55:07.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:07 smithi070 ceph-mon[29591]: pgmap v4099: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 861 KiB/s wr, 50 op/s 2024-05-08T08:55:07.661 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:07 smithi194 ceph-mon[33679]: pgmap v4099: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 861 KiB/s wr, 50 op/s 2024-05-08T08:55:07.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:07 smithi172 ceph-mon[33377]: pgmap v4099: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 861 KiB/s wr, 50 op/s 2024-05-08T08:55:07.729 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/misc/cardreader/built-in.a 2024-05-08T08:55:07.858 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/misc/built-in.a 2024-05-08T08:55:08.121 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_aperture.o 2024-05-08T08:55:09.104 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/base/firmware_loader/built-in.a 2024-05-08T08:55:09.396 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_atomic.o 2024-05-08T08:55:09.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:09 smithi070 ceph-mon[29591]: pgmap v4100: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 861 KiB/s wr, 50 op/s 2024-05-08T08:55:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:09 smithi172 ceph-mon[33377]: pgmap v4100: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 861 KiB/s wr, 50 op/s 2024-05-08T08:55:09.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:09 smithi194 ceph-mon[33679]: pgmap v4100: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 689 KiB/s rd, 861 KiB/s wr, 50 op/s 2024-05-08T08:55:10.134 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/qos.o 2024-05-08T08:55:11.449 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/runtime.o 2024-05-08T08:55:11.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:11 smithi070 ceph-mon[29591]: pgmap v4101: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 630 KiB/s wr, 53 op/s 2024-05-08T08:55:11.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:11 smithi070 ceph-mon[29591]: osdmap e335: 12 total, 12 up, 12 in 2024-05-08T08:55:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:11 smithi172 ceph-mon[33377]: pgmap v4101: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 630 KiB/s wr, 53 op/s 2024-05-08T08:55:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:11 smithi172 ceph-mon[33377]: osdmap e335: 12 total, 12 up, 12 in 2024-05-08T08:55:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:11 smithi194 ceph-mon[33679]: pgmap v4101: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 625 KiB/s rd, 630 KiB/s wr, 53 op/s 2024-05-08T08:55:11.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:11 smithi194 ceph-mon[33679]: osdmap e335: 12 total, 12 up, 12 in 2024-05-08T08:55:13.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:13 smithi070 ceph-mon[29591]: pgmap v4103: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 701 KiB/s wr, 28 op/s 2024-05-08T08:55:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:13 smithi172 ceph-mon[33377]: pgmap v4103: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 701 KiB/s wr, 28 op/s 2024-05-08T08:55:13.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:13 smithi194 ceph-mon[33679]: pgmap v4103: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 701 KiB/s wr, 28 op/s 2024-05-08T08:55:15.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.343+0000 7f293e800700 1 -- 172.21.15.70:0/454737032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f293806b6f0 msgr2=0x7f293806bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:15.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.343+0000 7f293e800700 1 --2- 172.21.15.70:0/454737032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f293806b6f0 0x7f293806bb50 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f2924009990 tx=0x7f2924009ca0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.343+0000 7f293e800700 1 -- 172.21.15.70:0/454737032 shutdown_connections 2024-05-08T08:55:15.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.344+0000 7f293e800700 1 --2- 172.21.15.70:0/454737032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2938105ee0 0x7f2938106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.344+0000 7f293e800700 1 --2- 172.21.15.70:0/454737032 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f29381083d0 0x7f293806b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.344+0000 7f293e800700 1 --2- 172.21.15.70:0/454737032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f293806b6f0 0x7f293806bb50 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.344+0000 7f293e800700 1 -- 172.21.15.70:0/454737032 >> 172.21.15.70:0/454737032 conn(0x7f2938079350 msgr2=0x7f2938079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:55:15.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.344+0000 7f293e800700 1 -- 172.21.15.70:0/454737032 shutdown_connections 2024-05-08T08:55:15.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.344+0000 7f293e800700 1 -- 172.21.15.70:0/454737032 wait complete. 2024-05-08T08:55:15.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.345+0000 7f293e800700 1 Processor -- start 2024-05-08T08:55:15.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.346+0000 7f293e800700 1 -- start start 2024-05-08T08:55:15.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.346+0000 7f293e800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293806b6f0 0x7f29381a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:15.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.346+0000 7f293e800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2938105ee0 0x7f29381a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:15.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.346+0000 7f293e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29381083d0 0x7f29381a48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:15.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.346+0000 7f293e800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2938119b30 con 0x7f29381083d0 2024-05-08T08:55:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.346+0000 7f293e800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f29381199b0 con 0x7f293806b6f0 2024-05-08T08:55:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.346+0000 7f293e800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2938119cb0 con 0x7f2938105ee0 2024-05-08T08:55:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.347+0000 7f2937400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293806b6f0 0x7f29381a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.347+0000 7f2937e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29381083d0 0x7f29381a48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.347+0000 7f2937400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293806b6f0 0x7f29381a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:48370/0 (socket says 172.21.15.70:48370) 2024-05-08T08:55:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.347+0000 7f2936a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2938105ee0 0x7f29381a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.347+0000 7f2937400700 1 -- 172.21.15.70:0/1718731085 learned_addr learned my addr 172.21.15.70:0/1718731085 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:55:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.348+0000 7f2937e00700 1 -- 172.21.15.70:0/1718731085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2938105ee0 msgr2=0x7f29381a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:15.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.348+0000 7f2937e00700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2938105ee0 0x7f29381a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.348+0000 7f2937e00700 1 -- 172.21.15.70:0/1718731085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293806b6f0 msgr2=0x7f29381a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.348+0000 7f2937e00700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293806b6f0 0x7f29381a0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.348+0000 7f2937e00700 1 -- 172.21.15.70:0/1718731085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29381a5010 con 0x7f29381083d0 2024-05-08T08:55:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.348+0000 7f2937400700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293806b6f0 0x7f29381a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:55:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.348+0000 7f2937e00700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29381083d0 0x7f29381a48d0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f2930007f10 tx=0x7f293000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:55:15.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.349+0000 7f292fe00700 1 -- 172.21.15.70:0/1718731085 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930004db0 con 0x7f29381083d0 2024-05-08T08:55:15.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.349+0000 7f292fe00700 1 -- 172.21.15.70:0/1718731085 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2930009e20 con 0x7f29381083d0 2024-05-08T08:55:15.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.349+0000 7f292fe00700 1 -- 172.21.15.70:0/1718731085 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2930015400 con 0x7f29381083d0 2024-05-08T08:55:15.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.349+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29381a5300 con 0x7f29381083d0 2024-05-08T08:55:15.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.349+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29381acb80 con 0x7f29381083d0 2024-05-08T08:55:15.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.352+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f293806a190 con 0x7f29381083d0 2024-05-08T08:55:15.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.355+0000 7f292fe00700 1 -- 172.21.15.70:0/1718731085 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2930005240 con 0x7f29381083d0 2024-05-08T08:55:15.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.357+0000 7f292fe00700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f291c0b2b40 0x7f291c0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:15.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.358+0000 7f292fe00700 1 -- 172.21.15.70:0/1718731085 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(335..335 src has 1..335) ==== 9583+0+0 (secure 0 0 0) 0x7f29300e22f0 con 0x7f29381083d0 2024-05-08T08:55:15.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.359+0000 7f2937400700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f291c0b2b40 0x7f291c0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:15.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.360+0000 7f2937400700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f291c0b2b40 0x7f291c0b5000 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f292800f4d0 tx=0x7f2928005f90 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:55:15.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.363+0000 7f292fe00700 1 -- 172.21.15.70:0/1718731085 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2930010070 con 0x7f29381083d0 2024-05-08T08:55:15.417 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/wakeirq.o 2024-05-08T08:55:15.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:15 smithi070 ceph-mon[29591]: pgmap v4104: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 683 KiB/s wr, 31 op/s 2024-05-08T08:55:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:15 smithi172 ceph-mon[33377]: pgmap v4104: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 683 KiB/s wr, 31 op/s 2024-05-08T08:55:15.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:15 smithi194 ceph-mon[33679]: pgmap v4104: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 683 KiB/s wr, 31 op/s 2024-05-08T08:55:15.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.833+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f29381acdb0 con 0x7f29381083d0 2024-05-08T08:55:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.834+0000 7f292fe00700 1 -- 172.21.15.70:0/1718731085 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f29300a9850 con 0x7f29381083d0 2024-05-08T08:55:15.833 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:55:15.833 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:55:15.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.838+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f291c0b2b40 msgr2=0x7f291c0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:15.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.838+0000 7f293e800700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f291c0b2b40 0x7f291c0b5000 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f292800f4d0 tx=0x7f2928005f90 comp rx=0 tx=0).stop 2024-05-08T08:55:15.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.838+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29381083d0 msgr2=0x7f29381a48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:15.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.838+0000 7f293e800700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29381083d0 0x7f29381a48d0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f2930007f10 tx=0x7f293000d3b0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.839+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 shutdown_connections 2024-05-08T08:55:15.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.839+0000 7f293e800700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f291c0b2b40 0x7f291c0b5000 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.839+0000 7f293e800700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f29381083d0 0x7f29381a48d0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.839+0000 7f293e800700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f293806b6f0 0x7f29381a0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.839+0000 7f293e800700 1 --2- 172.21.15.70:0/1718731085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2938105ee0 0x7f29381a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:15.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.839+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 >> 172.21.15.70:0/1718731085 conn(0x7f2938079350 msgr2=0x7f2938104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:55:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.839+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 shutdown_connections 2024-05-08T08:55:15.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:15.839+0000 7f293e800700 1 -- 172.21.15.70:0/1718731085 wait complete. 2024-05-08T08:55:15.839 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:55:16.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:16 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1718731085' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:55:16.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:16 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1718731085' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:55:16.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:16 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1718731085' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:55:16.780 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 78.15 --await-for 42.0' 2024-05-08T08:55:16.780 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 78.15 --await-for 42.0 2024-05-08T08:55:17.338 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/regmap/regcache-flat.o 2024-05-08T08:55:17.372 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:55:17.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/soc/intel_gmch.o 2024-05-08T08:55:17.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:17 smithi070 ceph-mon[29591]: pgmap v4105: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 608 KiB/s wr, 30 op/s 2024-05-08T08:55:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:17 smithi172 ceph-mon[33377]: pgmap v4105: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 608 KiB/s wr, 30 op/s 2024-05-08T08:55:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:17 smithi194 ceph-mon[33679]: pgmap v4105: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 608 KiB/s wr, 30 op/s 2024-05-08T08:55:17.766 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_atomic_uapi.o 2024-05-08T08:55:18.261 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/block/virtio_blk.o 2024-05-08T08:55:19.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:19 smithi070 ceph-mon[29591]: pgmap v4106: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 608 KiB/s wr, 30 op/s 2024-05-08T08:55:19.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:19 smithi172 ceph-mon[33377]: pgmap v4106: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 608 KiB/s wr, 30 op/s 2024-05-08T08:55:19.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:19 smithi194 ceph-mon[33679]: pgmap v4106: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 589 KiB/s rd, 608 KiB/s wr, 30 op/s 2024-05-08T08:55:20.289 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_auth.o 2024-05-08T08:55:21.172 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/main.o 2024-05-08T08:55:21.189 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/soc/intel_pch.o 2024-05-08T08:55:21.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.231+0000 7f967be00700 1 -- 172.21.15.70:0/332442076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9674103550 msgr2=0x7f96741039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:21.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.231+0000 7f967be00700 1 --2- 172.21.15.70:0/332442076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9674103550 0x7f96741039b0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f9660009990 tx=0x7f9660009ca0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.231+0000 7f967be00700 1 -- 172.21.15.70:0/332442076 shutdown_connections 2024-05-08T08:55:21.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.231+0000 7f967be00700 1 --2- 172.21.15.70:0/332442076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9674103ef0 0x7f96741103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.231+0000 7f967be00700 1 --2- 172.21.15.70:0/332442076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9674108460 0x7f9674108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.231+0000 7f967be00700 1 --2- 172.21.15.70:0/332442076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9674103550 0x7f96741039b0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.231+0000 7f967be00700 1 -- 172.21.15.70:0/332442076 >> 172.21.15.70:0/332442076 conn(0x7f967407a600 msgr2=0x7f967407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:55:21.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.232+0000 7f967be00700 1 -- 172.21.15.70:0/332442076 shutdown_connections 2024-05-08T08:55:21.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.232+0000 7f967be00700 1 -- 172.21.15.70:0/332442076 wait complete. 2024-05-08T08:55:21.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.234+0000 7f967be00700 1 Processor -- start 2024-05-08T08:55:21.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.234+0000 7f967be00700 1 -- start start 2024-05-08T08:55:21.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.235+0000 7f967be00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9674103ef0 0x7f967419be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.235+0000 7f967be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9674108460 0x7f967419c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.235+0000 7f967be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96741a0760 0x7f96741a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.235+0000 7f967be00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9674113590 con 0x7f9674108460 2024-05-08T08:55:21.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.235+0000 7f967be00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9674113410 con 0x7f96741a0760 2024-05-08T08:55:21.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.235+0000 7f967be00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9674113710 con 0x7f9674103ef0 2024-05-08T08:55:21.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9679400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9674103ef0 0x7f967419be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9679400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9674103ef0 0x7f967419be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:44684/0 (socket says 172.21.15.70:44684) 2024-05-08T08:55:21.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9679400700 1 -- 172.21.15.70:0/2939241999 learned_addr learned my addr 172.21.15.70:0/2939241999 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:55:21.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9678a00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9674108460 0x7f967419c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9679e00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96741a0760 0x7f96741a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9679400700 1 -- 172.21.15.70:0/2939241999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96741a0760 msgr2=0x7f96741a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9679400700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96741a0760 0x7f96741a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9679400700 1 -- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9674108460 msgr2=0x7f967419c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9679400700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9674108460 0x7f967419c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9679400700 1 -- 172.21.15.70:0/2939241999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96741a1280 con 0x7f9674103ef0 2024-05-08T08:55:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.236+0000 7f9678a00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9674108460 0x7f967419c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:55:21.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.237+0000 7f9679400700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9674103ef0 0x7f967419be90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f966800d980 tx=0x7f966800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:55:21.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.237+0000 7f9672000700 1 -- 172.21.15.70:0/2939241999 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668016070 con 0x7f9674103ef0 2024-05-08T08:55:21.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.238+0000 7f9672000700 1 -- 172.21.15.70:0/2939241999 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f966800fd20 con 0x7f9674103ef0 2024-05-08T08:55:21.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.238+0000 7f967be00700 1 -- 172.21.15.70:0/2939241999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96741a1570 con 0x7f9674103ef0 2024-05-08T08:55:21.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.238+0000 7f9672000700 1 -- 172.21.15.70:0/2939241999 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668010e30 con 0x7f9674103ef0 2024-05-08T08:55:21.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.238+0000 7f967be00700 1 -- 172.21.15.70:0/2939241999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96741a8da0 con 0x7f9674103ef0 2024-05-08T08:55:21.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.243+0000 7f9672000700 1 -- 172.21.15.70:0/2939241999 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9668019070 con 0x7f9674103ef0 2024-05-08T08:55:21.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.247+0000 7f9672000700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f965c0b2b20 0x7f965c0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.247+0000 7f9672000700 1 -- 172.21.15.70:0/2939241999 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(335..335 src has 1..335) ==== 9583+0+0 (secure 0 0 0) 0x7f96680e23e0 con 0x7f9674103ef0 2024-05-08T08:55:21.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.247+0000 7f9678a00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f965c0b2b20 0x7f965c0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.249+0000 7f9678a00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f965c0b2b20 0x7f965c0b4fe0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f96600098e0 tx=0x7f9660005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:55:21.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.437+0000 7f9686690b80 1 Processor -- start 2024-05-08T08:55:21.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.438+0000 7f9686690b80 1 -- start start 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.438+0000 7f9686690b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b13330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.438+0000 7f9686690b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 0x563320b0d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.438+0000 7f9686690b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0dee0 0x563320b19d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.438+0000 7f9686690b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563320a5fbb0 con 0x563320b12f50 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.438+0000 7f9686690b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5633209fd8f0 con 0x563320b0dee0 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.438+0000 7f9686690b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563320a5bb70 con 0x563320b0d520 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b13330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b13330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36914/0 (socket says 172.21.15.70:36914) 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679400700 1 -- 172.21.15.70:0/2520385210 learned_addr learned my addr 172.21.15.70:0/2520385210 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9678a00700 1 --2- 172.21.15.70:0/2520385210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 0x563320b0d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679e00700 1 --2- 172.21.15.70:0/2520385210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0dee0 0x563320b19d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679400700 1 -- 172.21.15.70:0/2520385210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 msgr2=0x563320b0d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:55:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679400700 1 --2- 172.21.15.70:0/2520385210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 0x563320b0d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679400700 1 -- 172.21.15.70:0/2520385210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0dee0 msgr2=0x563320b19d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:55:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679400700 1 --2- 172.21.15.70:0/2520385210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0dee0 0x563320b19d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679400700 1 -- 172.21.15.70:0/2520385210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633209aca60 con 0x563320b12f50 2024-05-08T08:55:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.439+0000 7f9679400700 1 --2- 172.21.15.70:0/2520385210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b13330 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f96680108e0 tx=0x7f966800ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede782a03cc7686a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:55:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.440+0000 7f9666a00700 1 -- 172.21.15.70:0/2520385210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668020040 con 0x563320b12f50 2024-05-08T08:55:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.440+0000 7f9666a00700 1 -- 172.21.15.70:0/2520385210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96680a9240 con 0x563320b12f50 2024-05-08T08:55:21.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.440+0000 7f9666a00700 1 -- 172.21.15.70:0/2520385210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96680a9700 con 0x563320b12f50 2024-05-08T08:55:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.441+0000 7f9686690b80 1 -- 172.21.15.70:0/2520385210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 msgr2=0x563320b13330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.441+0000 7f9686690b80 1 --2- 172.21.15.70:0/2520385210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b13330 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f96680108e0 tx=0x7f966800ffd0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.441+0000 7f9686690b80 1 -- 172.21.15.70:0/2520385210 shutdown_connections 2024-05-08T08:55:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.441+0000 7f9686690b80 1 --2- 172.21.15.70:0/2520385210 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0dee0 0x563320b19d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.441+0000 7f9686690b80 1 --2- 172.21.15.70:0/2520385210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b13330 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.441+0000 7f9686690b80 1 --2- 172.21.15.70:0/2520385210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 0x563320b0d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.441+0000 7f9686690b80 1 -- 172.21.15.70:0/2520385210 >> 172.21.15.70:0/2520385210 conn(0x563320a3bcf0 msgr2=0x563320b07e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:55:21.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.441+0000 7f9686690b80 1 -- 172.21.15.70:0/2520385210 shutdown_connections 2024-05-08T08:55:21.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.441+0000 7f9686690b80 1 -- 172.21.15.70:0/2520385210 wait complete. 2024-05-08T08:55:21.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.442+0000 7f9686690b80 1 -- start start 2024-05-08T08:55:21.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.442+0000 7f9686690b80 1 Processor -- start 2024-05-08T08:55:21.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9686690b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 0x563320b19990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9686690b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b16d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9686690b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b17270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9686690b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563320b1a310 con 0x563320b12f50 2024-05-08T08:55:21.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9686690b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5633209c5cb0 con 0x563320b0d520 2024-05-08T08:55:21.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9686690b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563320b1a490 con 0x563320b0dee0 2024-05-08T08:55:21.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9686690b80 10 client.0 _ll_register_callbacks cb 0x563320a06e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9679e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b17270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9679e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b17270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36926/0 (socket says 172.21.15.70:36926) 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9679e00700 1 -- 172.21.15.70:0/218169865 learned_addr learned my addr 172.21.15.70:0/218169865 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9679400700 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 0x563320b19990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9678a00700 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b16d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9679e00700 1 -- 172.21.15.70:0/218169865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 msgr2=0x563320b16d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9679e00700 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b16d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9679e00700 1 -- 172.21.15.70:0/218169865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 msgr2=0x563320b19990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9679e00700 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 0x563320b19990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9679e00700 1 -- 172.21.15.70:0/218169865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563320a255b0 con 0x563320b12f50 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.443+0000 7f9678a00700 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b16d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.444+0000 7f9679e00700 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b17270 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f966c007b30 tx=0x7f966c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e185b2909b2b226 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.444+0000 7f965b400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:55:21.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.444+0000 7f965b400700 1 -- 172.21.15.70:0/218169865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c01a030 con 0x563320b12f50 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.444+0000 7f965b400700 1 -- 172.21.15.70:0/218169865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(335..335 src has 1..335) ==== 9583+0+0 (secure 0 0 0) 0x7f966c003a00 con 0x563320b12f50 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.444+0000 7f9686690b80 1 -- 172.21.15.70:0/218169865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96680a9240 con 0x563320b12f50 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.444+0000 7f965b400700 1 -- 172.21.15.70:0/218169865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f966c024050 con 0x563320b12f50 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.444+0000 7f9686690b80 10 client.18771 fetch_fsmap learned FSMap version 42 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.444+0000 7f9686690b80 1 -- 172.21.15.70:0/218169865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563320b24be0 con 0x563320b12f50 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.445+0000 7f965b400700 1 -- 172.21.15.70:0/218169865 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96680a9240 con 0x563320b12f50 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.445+0000 7f965b400700 1 -- 172.21.15.70:0/218169865 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f966c016c10 con 0x563320b12f50 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.445+0000 7f9686690b80 10 client.18771 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.445+0000 7f9686690b80 10 client.18771 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.445+0000 7f9686690b80 20 client.18771 populate_metadata read hostname 'smithi070' 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.445+0000 7f9686690b80 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563320b27270 0x563320b29660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.445+0000 7f9686690b80 4 client.18771 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:55:21.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.445+0000 7f9686690b80 1 -- 172.21.15.70:0/218169865 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563320ada230 con 0x563320b27270 2024-05-08T08:55:21.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.619+0000 7f9679400700 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563320b27270 0x563320b29660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:21 smithi070 ceph-mon[29591]: pgmap v4107: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 515 KiB/s wr, 28 op/s 2024-05-08T08:55:21.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.621+0000 7f9679400700 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563320b27270 0x563320b29660 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d167483661e5e98 server_cookie=e41b56c96d53ad37 in_seq=0 out_seq=0 2024-05-08T08:55:21.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.621+0000 7f965b400700 10 client.18771 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:55:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.624+0000 7f965b400700 1 -- 172.21.15.70:0/218169865 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563320ada230 con 0x563320b27270 2024-05-08T08:55:21.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.624+0000 7f965b400700 10 client.18771 handle_command_reply: tid=0 2024-05-08T08:55:21.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.624+0000 7f9686690b80 1 client.18771 shutdown 2024-05-08T08:55:21.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.626+0000 7f9686690b80 1 -- 172.21.15.70:0/218169865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 msgr2=0x563320b17270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:21.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.626+0000 7f9686690b80 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b17270 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f966c007b30 tx=0x7f966c007ef0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.626+0000 7f9686690b80 1 -- 172.21.15.70:0/218169865 shutdown_connections 2024-05-08T08:55:21.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.626+0000 7f9686690b80 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563320b27270 0x563320b29660 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.626+0000 7f9686690b80 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b17270 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.626+0000 7f9686690b80 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 0x563320b19990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.626+0000 7f9686690b80 1 --2- 172.21.15.70:0/218169865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b16d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.626+0000 7f9686690b80 1 -- 172.21.15.70:0/218169865 >> 172.21.15.70:0/218169865 conn(0x563320a3bcf0 msgr2=0x563320b028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:55:21.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.626+0000 7f965b400700 0 client.18771 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:55:21.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.627+0000 7f9686690b80 1 -- 172.21.15.70:0/218169865 shutdown_connections 2024-05-08T08:55:21.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.627+0000 7f9686690b80 1 -- 172.21.15.70:0/218169865 wait complete. 2024-05-08T08:55:21.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.627+0000 7f9686690b80 20 client.18771 trim_cache size 0 max 16384 2024-05-08T08:55:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.669+0000 7f9686690b80 1 Processor -- start 2024-05-08T08:55:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.669+0000 7f9686690b80 1 -- start start 2024-05-08T08:55:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.670+0000 7f9686690b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 0x563320b0cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.670+0000 7f9686690b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b172a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.670+0000 7f9686690b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b23360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.670+0000 7f9686690b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96741b47a0 con 0x563320b12f50 2024-05-08T08:55:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.670+0000 7f9686690b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96741b2030 con 0x563320b0d520 2024-05-08T08:55:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.670+0000 7f9686690b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f96741afea0 con 0x563320b0dee0 2024-05-08T08:55:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.670+0000 7f9679e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b23360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.670+0000 7f9679e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b23360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36936/0 (socket says 172.21.15.70:36936) 2024-05-08T08:55:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.670+0000 7f9679e00700 1 -- 172.21.15.70:0/1342953091 learned_addr learned my addr 172.21.15.70:0/1342953091 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:55:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.671+0000 7f9678a00700 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b172a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.671+0000 7f9679400700 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 0x563320b0cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.671+0000 7f9679e00700 1 -- 172.21.15.70:0/1342953091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 msgr2=0x563320b172a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:55:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.671+0000 7f9679e00700 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b172a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.671+0000 7f9679e00700 1 -- 172.21.15.70:0/1342953091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 msgr2=0x563320b0cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:55:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.671+0000 7f9679e00700 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 0x563320b0cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.671+0000 7f9679e00700 1 -- 172.21.15.70:0/1342953091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563320b04a10 con 0x563320b12f50 2024-05-08T08:55:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.671+0000 7f9678a00700 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b172a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.672+0000 7f9679e00700 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b23360 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f966c022040 tx=0x7f966c009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d30fb47e0e99d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.672+0000 7f9666000700 1 -- 172.21.15.70:0/1342953091 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c01a040 con 0x563320b12f50 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.672+0000 7f9666000700 1 -- 172.21.15.70:0/1342953091 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f966c005e60 con 0x563320b12f50 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.672+0000 7f9666000700 1 -- 172.21.15.70:0/1342953091 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c01fae0 con 0x563320b12f50 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.673+0000 7f9686690b80 1 -- 172.21.15.70:0/1342953091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 msgr2=0x563320b23360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.673+0000 7f9686690b80 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b23360 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f966c022040 tx=0x7f966c009ce0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.673+0000 7f9686690b80 1 -- 172.21.15.70:0/1342953091 shutdown_connections 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.673+0000 7f9686690b80 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b12f50 0x563320b23360 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.673+0000 7f9686690b80 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b0d520 0x563320b0cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.673+0000 7f9686690b80 1 --2- 172.21.15.70:0/1342953091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0dee0 0x563320b172a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.673+0000 7f9686690b80 1 -- 172.21.15.70:0/1342953091 >> 172.21.15.70:0/1342953091 conn(0x563320a3bcf0 msgr2=0x563320b11260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:55:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.673+0000 7f9686690b80 1 -- 172.21.15.70:0/1342953091 shutdown_connections 2024-05-08T08:55:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.673+0000 7f9686690b80 1 -- 172.21.15.70:0/1342953091 wait complete. 2024-05-08T08:55:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.674+0000 7f9686690b80 1 -- start start 2024-05-08T08:55:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.674+0000 7f9686690b80 1 Processor -- start 2024-05-08T08:55:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.675+0000 7f9686690b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 0x563320b1c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.675+0000 7f9686690b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b0dee0 0x563320b1cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.675+0000 7f9686690b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b12f50 0x563320b1d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.675+0000 7f9686690b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96741b04f0 con 0x563320b0dee0 2024-05-08T08:55:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.675+0000 7f9686690b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96741b1960 con 0x563320b12f50 2024-05-08T08:55:21.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.675+0000 7f9686690b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f96741b0bc0 con 0x563320b0d520 2024-05-08T08:55:21.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.675+0000 7f9686690b80 10 client.0 _ll_register_callbacks cb 0x563320a06e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:55:21.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.676+0000 7f9679400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 0x563320b1c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.676+0000 7f9679400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 0x563320b1c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:44730/0 (socket says 172.21.15.70:44730) 2024-05-08T08:55:21.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.676+0000 7f9679400700 1 -- 172.21.15.70:0/1468429885 learned_addr learned my addr 172.21.15.70:0/1468429885 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:55:21.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.676+0000 7f9678a00700 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b0dee0 0x563320b1cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.676+0000 7f9679e00700 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b12f50 0x563320b1d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.677+0000 7f9678a00700 1 -- 172.21.15.70:0/1468429885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 msgr2=0x563320b1c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:55:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.677+0000 7f9678a00700 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 0x563320b1c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.677+0000 7f9678a00700 1 -- 172.21.15.70:0/1468429885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b12f50 msgr2=0x563320b1d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:55:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.677+0000 7f9678a00700 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b12f50 0x563320b1d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.677+0000 7f9678a00700 1 -- 172.21.15.70:0/1468429885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563320b04630 con 0x563320b0dee0 2024-05-08T08:55:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.677+0000 7f9679e00700 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b12f50 0x563320b1d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:55:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.677+0000 7f9678a00700 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b0dee0 0x563320b1cbf0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9660008000 tx=0x7f9660009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ddf1f418f97f51 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:55:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.677+0000 7f965b400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:55:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.678+0000 7f965b400700 1 -- 172.21.15.70:0/1468429885 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660033060 con 0x563320b0dee0 2024-05-08T08:55:21.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.678+0000 7f965b400700 1 -- 172.21.15.70:0/1468429885 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(335..335 src has 1..335) ==== 9583+0+0 (secure 0 0 0) 0x7f966000f670 con 0x563320b0dee0 2024-05-08T08:55:21.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.678+0000 7f9686690b80 1 -- 172.21.15.70:0/1468429885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f966c005e60 con 0x563320b0dee0 2024-05-08T08:55:21.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.678+0000 7f965b400700 1 -- 172.21.15.70:0/1468429885 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f966003a050 con 0x563320b0dee0 2024-05-08T08:55:21.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.679+0000 7f9686690b80 10 client.18777 fetch_fsmap learned FSMap version 42 2024-05-08T08:55:21.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.679+0000 7f9686690b80 1 -- 172.21.15.70:0/1468429885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563320b9b4f0 con 0x563320b0dee0 2024-05-08T08:55:21.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.679+0000 7f965b400700 1 -- 172.21.15.70:0/1468429885 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f966c005e60 con 0x563320b0dee0 2024-05-08T08:55:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:21 smithi172 ceph-mon[33377]: pgmap v4107: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 515 KiB/s wr, 28 op/s 2024-05-08T08:55:21.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.680+0000 7f965b400700 1 -- 172.21.15.70:0/1468429885 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f966002e540 con 0x563320b0dee0 2024-05-08T08:55:21.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.680+0000 7f9686690b80 10 client.18777 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:55:21.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.680+0000 7f9686690b80 10 client.18777 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:55:21.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.680+0000 7f9686690b80 20 client.18777 populate_metadata read hostname 'smithi070' 2024-05-08T08:55:21.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.680+0000 7f9686690b80 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563320b9bca0 0x563320b9e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:55:21.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.680+0000 7f9686690b80 4 client.18777 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.15, "await_for": 42.0}] 2024-05-08T08:55:21.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.680+0000 7f9686690b80 1 -- 172.21.15.70:0/1468429885 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.15, "await_for": 42.0}) -- 0x563320a6d590 con 0x563320b9bca0 2024-05-08T08:55:21.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.681+0000 7f9679400700 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563320b9bca0 0x563320b9e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:55:21.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.682+0000 7f9679400700 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563320b9bca0 0x563320b9e0c0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2479cf24e0377f1 server_cookie=2378a742fe784a0d in_seq=0 out_seq=0 2024-05-08T08:55:21.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:21.682+0000 7f965b400700 10 client.18777 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:55:21.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:21 smithi194 ceph-mon[33679]: pgmap v4107: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 515 KiB/s wr, 28 op/s 2024-05-08T08:55:23.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:23 smithi070 ceph-mon[29591]: pgmap v4108: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 462 KiB/s wr, 25 op/s 2024-05-08T08:55:23.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:23 smithi172 ceph-mon[33377]: pgmap v4108: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 462 KiB/s wr, 25 op/s 2024-05-08T08:55:23.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:23 smithi194 ceph-mon[33679]: pgmap v4108: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 462 KiB/s wr, 25 op/s 2024-05-08T08:55:25.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:25 smithi070 ceph-mon[29591]: pgmap v4109: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 696 KiB/s wr, 32 op/s 2024-05-08T08:55:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:25 smithi172 ceph-mon[33377]: pgmap v4109: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 696 KiB/s wr, 32 op/s 2024-05-08T08:55:25.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:25 smithi194 ceph-mon[33679]: pgmap v4109: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 696 KiB/s wr, 32 op/s 2024-05-08T08:55:27.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:27 smithi070 ceph-mon[29591]: pgmap v4110: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 416 KiB/s wr, 25 op/s 2024-05-08T08:55:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:27 smithi172 ceph-mon[33377]: pgmap v4110: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 416 KiB/s wr, 25 op/s 2024-05-08T08:55:27.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:27 smithi194 ceph-mon[33679]: pgmap v4110: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 416 KiB/s wr, 25 op/s 2024-05-08T08:55:29.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:29 smithi172 ceph-mon[33377]: pgmap v4111: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 23 op/s 2024-05-08T08:55:29.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:29 smithi194 ceph-mon[33679]: pgmap v4111: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 23 op/s 2024-05-08T08:55:29.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:29 smithi070 ceph-mon[29591]: pgmap v4111: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 410 KiB/s wr, 23 op/s 2024-05-08T08:55:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:31 smithi172 ceph-mon[33377]: pgmap v4112: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 664 KiB/s wr, 27 op/s 2024-05-08T08:55:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:31 smithi194 ceph-mon[33679]: pgmap v4112: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 664 KiB/s wr, 27 op/s 2024-05-08T08:55:31.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:31 smithi070 ceph-mon[29591]: pgmap v4112: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 668 KiB/s rd, 664 KiB/s wr, 27 op/s 2024-05-08T08:55:33.677 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:33 smithi172 ceph-mon[33377]: pgmap v4113: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 522 KiB/s wr, 15 op/s 2024-05-08T08:55:33.679 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:33 smithi070 ceph-mon[29591]: pgmap v4113: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 522 KiB/s wr, 15 op/s 2024-05-08T08:55:33.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:33 smithi194 ceph-mon[33679]: pgmap v4113: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 522 KiB/s wr, 15 op/s 2024-05-08T08:55:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:35 smithi172 ceph-mon[33377]: pgmap v4114: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 565 KiB/s wr, 18 op/s 2024-05-08T08:55:35.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:35 smithi194 ceph-mon[33679]: pgmap v4114: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 565 KiB/s wr, 18 op/s 2024-05-08T08:55:35.810 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:35 smithi070 ceph-mon[29591]: pgmap v4114: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 565 KiB/s wr, 18 op/s 2024-05-08T08:55:37.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:37 smithi070 ceph-mon[29591]: pgmap v4115: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 302 KiB/s wr, 10 op/s 2024-05-08T08:55:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:37 smithi172 ceph-mon[33377]: pgmap v4115: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 302 KiB/s wr, 10 op/s 2024-05-08T08:55:37.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:37 smithi194 ceph-mon[33679]: pgmap v4115: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 302 KiB/s wr, 10 op/s 2024-05-08T08:55:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:39 smithi172 ceph-mon[33377]: pgmap v4116: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 300 KiB/s wr, 7 op/s 2024-05-08T08:55:39.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:39 smithi194 ceph-mon[33679]: pgmap v4116: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 300 KiB/s wr, 7 op/s 2024-05-08T08:55:39.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:39 smithi070 ceph-mon[29591]: pgmap v4116: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 300 KiB/s wr, 7 op/s 2024-05-08T08:55:41.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:41 smithi194 ceph-mon[33679]: pgmap v4117: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 345 KiB/s wr, 13 op/s 2024-05-08T08:55:41.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:41 smithi070 ceph-mon[29591]: pgmap v4117: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 345 KiB/s wr, 13 op/s 2024-05-08T08:55:41.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:41 smithi172 ceph-mon[33377]: pgmap v4117: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 345 KiB/s wr, 13 op/s 2024-05-08T08:55:43.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:43 smithi194 ceph-mon[33679]: pgmap v4118: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 91 KiB/s wr, 9 op/s 2024-05-08T08:55:43.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:43 smithi070 ceph-mon[29591]: pgmap v4118: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 91 KiB/s wr, 9 op/s 2024-05-08T08:55:43.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:43 smithi172 ceph-mon[33377]: pgmap v4118: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 91 KiB/s wr, 9 op/s 2024-05-08T08:55:45.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:45 smithi194 ceph-mon[33679]: pgmap v4119: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 140 KiB/s wr, 11 op/s 2024-05-08T08:55:45.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:45 smithi070 ceph-mon[29591]: pgmap v4119: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 140 KiB/s wr, 11 op/s 2024-05-08T08:55:45.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:45 smithi172 ceph-mon[33377]: pgmap v4119: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 140 KiB/s wr, 11 op/s 2024-05-08T08:55:46.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.120+0000 7f965b400700 1 -- 172.21.15.70:0/1468429885 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x563320a6d590 con 0x563320b9bca0 2024-05-08T08:55:46.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.120+0000 7f965b400700 10 client.18777 handle_command_reply: tid=0 2024-05-08T08:55:46.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.120+0000 7f9686690b80 1 client.18777 shutdown 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.121+0000 7f9686690b80 1 -- 172.21.15.70:0/1468429885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b0dee0 msgr2=0x563320b1cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.121+0000 7f9686690b80 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b0dee0 0x563320b1cbf0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f9660008000 tx=0x7f9660009ca0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.121+0000 7f9686690b80 1 -- 172.21.15.70:0/1468429885 shutdown_connections 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.121+0000 7f9686690b80 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563320b9bca0 0x563320b9e0c0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.121+0000 7f9686690b80 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563320b12f50 0x563320b1d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.121+0000 7f9686690b80 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563320b0d520 0x563320b1c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.121+0000 7f9686690b80 1 --2- 172.21.15.70:0/1468429885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563320b0dee0 0x563320b1cbf0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.121+0000 7f9686690b80 1 -- 172.21.15.70:0/1468429885 >> 172.21.15.70:0/1468429885 conn(0x563320a3bcf0 msgr2=0x563320b02050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.121+0000 7f965b400700 0 client.18777 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:55:46.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.122+0000 7f9686690b80 1 -- 172.21.15.70:0/1468429885 shutdown_connections 2024-05-08T08:55:46.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.122+0000 7f9686690b80 1 -- 172.21.15.70:0/1468429885 wait complete. 2024-05-08T08:55:46.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.122+0000 7f9686690b80 20 client.18777 trim_cache size 0 max 16384 2024-05-08T08:55:46.123 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:55:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:55:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:55:46.123 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 286, 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "b2e19b9b": { 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 286, 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.2, 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:55:46.124 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:55:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:55:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:55:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:55:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:55:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:55:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:55:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:55:46.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:55:46.125 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:55:46.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 -- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f965c0b2b20 msgr2=0x7f965c0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:46.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f965c0b2b20 0x7f965c0b4fe0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f96600098e0 tx=0x7f9660005fb0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 -- 172.21.15.70:0/2939241999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9674103ef0 msgr2=0x7f967419be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:55:46.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9674103ef0 0x7f967419be90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f966800d980 tx=0x7f966800dc90 comp rx=0 tx=0).stop 2024-05-08T08:55:46.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 -- 172.21.15.70:0/2939241999 shutdown_connections 2024-05-08T08:55:46.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f965c0b2b20 0x7f965c0b4fe0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96741a0760 0x7f96741a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9674103ef0 0x7f967419be90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 --2- 172.21.15.70:0/2939241999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9674108460 0x7f967419c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:55:46.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 -- 172.21.15.70:0/2939241999 >> 172.21.15.70:0/2939241999 conn(0x7f967407a600 msgr2=0x7f96741013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:55:46.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.124+0000 7f967be00700 1 -- 172.21.15.70:0/2939241999 shutdown_connections 2024-05-08T08:55:46.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:55:46.125+0000 7f967be00700 1 -- 172.21.15.70:0/2939241999 wait complete. 2024-05-08T08:55:47.261 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b2e19b9b', quiesce took 44.1 seconds. Will release after: 18.15 2024-05-08T08:55:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:47 smithi070 ceph-mon[29591]: pgmap v4120: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 97 KiB/s wr, 9 op/s 2024-05-08T08:55:47.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:47 smithi194 ceph-mon[33679]: pgmap v4120: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 97 KiB/s wr, 9 op/s 2024-05-08T08:55:48.023 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:47 smithi172 ceph-mon[33377]: pgmap v4120: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 97 KiB/s wr, 9 op/s 2024-05-08T08:55:49.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:49 smithi070 ceph-mon[29591]: pgmap v4121: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 8 op/s 2024-05-08T08:55:49.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:49 smithi194 ceph-mon[33679]: pgmap v4121: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 8 op/s 2024-05-08T08:55:49.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:49 smithi172 ceph-mon[33377]: pgmap v4121: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 94 KiB/s wr, 8 op/s 2024-05-08T08:55:51.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:51 smithi194 ceph-mon[33679]: pgmap v4122: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 138 KiB/s wr, 12 op/s 2024-05-08T08:55:51.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:51 smithi070 ceph-mon[29591]: pgmap v4122: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 138 KiB/s wr, 12 op/s 2024-05-08T08:55:51.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:51 smithi172 ceph-mon[33377]: pgmap v4122: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 138 KiB/s wr, 12 op/s 2024-05-08T08:55:53.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:53 smithi194 ceph-mon[33679]: pgmap v4123: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 93 KiB/s wr, 6 op/s 2024-05-08T08:55:53.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:53 smithi070 ceph-mon[29591]: pgmap v4123: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 93 KiB/s wr, 6 op/s 2024-05-08T08:55:53.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:53 smithi172 ceph-mon[33377]: pgmap v4123: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 93 KiB/s wr, 6 op/s 2024-05-08T08:55:55.731 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:55 smithi172 ceph-mon[33377]: pgmap v4124: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 186 KiB/s wr, 10 op/s 2024-05-08T08:55:55.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:55 smithi194 ceph-mon[33679]: pgmap v4124: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 186 KiB/s wr, 10 op/s 2024-05-08T08:55:55.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:55 smithi070 ceph-mon[29591]: pgmap v4124: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 186 KiB/s wr, 10 op/s 2024-05-08T08:55:57.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:57 smithi194 ceph-mon[33679]: pgmap v4125: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 136 KiB/s wr, 8 op/s 2024-05-08T08:55:57.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:57 smithi070 ceph-mon[29591]: pgmap v4125: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 136 KiB/s wr, 8 op/s 2024-05-08T08:55:57.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:57 smithi172 ceph-mon[33377]: pgmap v4125: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 136 KiB/s wr, 8 op/s 2024-05-08T08:55:59.757 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:55:59 smithi070 ceph-mon[29591]: pgmap v4126: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 136 KiB/s wr, 7 op/s 2024-05-08T08:55:59.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:55:59 smithi194 ceph-mon[33679]: pgmap v4126: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 136 KiB/s wr, 7 op/s 2024-05-08T08:55:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:55:59 smithi172 ceph-mon[33377]: pgmap v4126: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 136 KiB/s wr, 7 op/s 2024-05-08T08:56:01.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:01 smithi194 ceph-mon[33679]: pgmap v4127: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 179 KiB/s wr, 10 op/s 2024-05-08T08:56:01.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:01 smithi070 ceph-mon[29591]: pgmap v4127: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 179 KiB/s wr, 10 op/s 2024-05-08T08:56:01.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:01 smithi172 ceph-mon[33377]: pgmap v4127: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 179 KiB/s wr, 10 op/s 2024-05-08T08:56:02.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:56:02.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:56:02.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:56:03.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:03 smithi194 ceph-mon[33679]: pgmap v4128: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 6 op/s 2024-05-08T08:56:03.779 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:03 smithi070 ceph-mon[29591]: pgmap v4128: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 6 op/s 2024-05-08T08:56:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:03 smithi172 ceph-mon[33377]: pgmap v4128: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 135 KiB/s wr, 6 op/s 2024-05-08T08:56:04.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:56:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:56:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:56:04.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:56:04.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:56:04.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:56:04.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:56:04.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:56:04.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:56:05.413 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:56:05.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:05 smithi194 ceph-mon[33679]: pgmap v4129: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 180 KiB/s wr, 25 op/s 2024-05-08T08:56:05.858 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:56:05.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:05 smithi070 ceph-mon[29591]: pgmap v4129: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 180 KiB/s wr, 25 op/s 2024-05-08T08:56:05.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:05 smithi172 ceph-mon[33377]: pgmap v4129: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 180 KiB/s wr, 25 op/s 2024-05-08T08:56:07.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:07 smithi070 ceph-mon[29591]: pgmap v4130: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 87 KiB/s wr, 22 op/s 2024-05-08T08:56:07.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:07 smithi172 ceph-mon[33377]: pgmap v4130: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 87 KiB/s wr, 22 op/s 2024-05-08T08:56:08.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:07 smithi194 ceph-mon[33679]: pgmap v4130: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 87 KiB/s wr, 22 op/s 2024-05-08T08:56:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.206+0000 7fa75b400700 1 -- 172.21.15.70:0/2517091974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754108850 msgr2=0x7fa7541103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.206+0000 7fa75b400700 1 --2- 172.21.15.70:0/2517091974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754108850 0x7fa7541103d0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b0d0 tx=0x7fa74c00b3e0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.206+0000 7fa75b400700 1 -- 172.21.15.70:0/2517091974 shutdown_connections 2024-05-08T08:56:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.206+0000 7fa75b400700 1 --2- 172.21.15.70:0/2517091974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754108850 0x7fa7541103d0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.206+0000 7fa75b400700 1 --2- 172.21.15.70:0/2517091974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa754103750 0x7fa754103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.206+0000 7fa75b400700 1 --2- 172.21.15.70:0/2517091974 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa754104100 0x7fa754108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.206+0000 7fa75b400700 1 -- 172.21.15.70:0/2517091974 >> 172.21.15.70:0/2517091974 conn(0x7fa75407a600 msgr2=0x7fa75407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.206+0000 7fa75b400700 1 -- 172.21.15.70:0/2517091974 shutdown_connections 2024-05-08T08:56:08.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.206+0000 7fa75b400700 1 -- 172.21.15.70:0/2517091974 wait complete. 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.207+0000 7fa75b400700 1 Processor -- start 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.207+0000 7fa75b400700 1 -- start start 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa75b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa754103750 0x7fa7541a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa75b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754104100 0x7fa7541a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa75b400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa754108850 0x7fa75419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa75b400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa754113540 con 0x7fa754104100 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa75b400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541133c0 con 0x7fa754103750 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa75b400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541136c0 con 0x7fa754108850 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa753e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754104100 0x7fa7541a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa753e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754104100 0x7fa7541a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39868/0 (socket says 172.21.15.70:39868) 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa753e00700 1 -- 172.21.15.70:0/3740886963 learned_addr learned my addr 172.21.15.70:0/3740886963 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa758a00700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa754103750 0x7fa7541a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:08.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.208+0000 7fa759400700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa754108850 0x7fa75419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:08.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa753e00700 1 -- 172.21.15.70:0/3740886963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa754108850 msgr2=0x7fa75419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:08.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa753e00700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa754108850 0x7fa75419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa753e00700 1 -- 172.21.15.70:0/3740886963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa754103750 msgr2=0x7fa7541a1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:08.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa753e00700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa754103750 0x7fa7541a1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa753e00700 1 -- 172.21.15.70:0/3740886963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75419c160 con 0x7fa754104100 2024-05-08T08:56:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa753e00700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754104100 0x7fa7541a1d80 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c920 tx=0x7fa74000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa751600700 1 -- 172.21.15.70:0/3740886963 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa740007b00 con 0x7fa754104100 2024-05-08T08:56:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa751600700 1 -- 172.21.15.70:0/3740886963 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa740004cc0 con 0x7fa754104100 2024-05-08T08:56:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75419c450 con 0x7fa754104100 2024-05-08T08:56:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa751600700 1 -- 172.21.15.70:0/3740886963 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7400054f0 con 0x7fa754104100 2024-05-08T08:56:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.209+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7541a8710 con 0x7fa754104100 2024-05-08T08:56:08.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.211+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75406a190 con 0x7fa754104100 2024-05-08T08:56:08.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.213+0000 7fa751600700 1 -- 172.21.15.70:0/3740886963 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa740007ca0 con 0x7fa754104100 2024-05-08T08:56:08.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.214+0000 7fa751600700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa73c0b29f0 0x7fa73c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.214+0000 7fa751600700 1 -- 172.21.15.70:0/3740886963 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(335..335 src has 1..335) ==== 9583+0+0 (secure 0 0 0) 0x7fa7400e26e0 con 0x7fa754104100 2024-05-08T08:56:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.215+0000 7fa758a00700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa73c0b29f0 0x7fa73c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:08.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.215+0000 7fa758a00700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa73c0b29f0 0x7fa73c0b4eb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa748005950 tx=0x7fa748005eb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:08.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.219+0000 7fa751600700 1 -- 172.21.15.70:0/3740886963 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa740014030 con 0x7fa754104100 2024-05-08T08:56:08.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.504+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7541a89a0 con 0x7fa754104100 2024-05-08T08:56:08.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.505+0000 7fa751600700 1 -- 172.21.15.70:0/3740886963 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fa7400a9c40 con 0x7fa754104100 2024-05-08T08:56:08.503 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:56:08.503 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa73c0b29f0 msgr2=0x7fa73c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa73c0b29f0 0x7fa73c0b4eb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa748005950 tx=0x7fa748005eb0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754104100 msgr2=0x7fa7541a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754104100 0x7fa7541a1d80 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c920 tx=0x7fa74000cce0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 shutdown_connections 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa73c0b29f0 0x7fa73c0b4eb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa754108850 0x7fa75419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa754103750 0x7fa7541a1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 --2- 172.21.15.70:0/3740886963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa754104100 0x7fa7541a1d80 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 >> 172.21.15.70:0/3740886963 conn(0x7fa75407a600 msgr2=0x7fa754101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:08.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 shutdown_connections 2024-05-08T08:56:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:08.508+0000 7fa75b400700 1 -- 172.21.15.70:0/3740886963 wait complete. 2024-05-08T08:56:08.507 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:56:08.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3740886963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:56:08.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3740886963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:56:09.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3740886963' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:56:09.331 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id b2e19b9b --release --await' 2024-05-08T08:56:09.331 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id b2e19b9b --release --await 2024-05-08T08:56:09.783 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:56:09.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:09 smithi070 ceph-mon[29591]: pgmap v4131: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 87 KiB/s wr, 22 op/s 2024-05-08T08:56:09.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:09 smithi172 ceph-mon[33377]: pgmap v4131: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 87 KiB/s wr, 22 op/s 2024-05-08T08:56:10.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:09 smithi194 ceph-mon[33679]: pgmap v4131: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 87 KiB/s wr, 22 op/s 2024-05-08T08:56:11.735 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:11 smithi070 ceph-mon[29591]: pgmap v4132: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 87 KiB/s wr, 24 op/s 2024-05-08T08:56:11.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.920+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3040488004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd78109ad0 msgr2=0x7fcd78109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:11.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.920+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3040488004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd78109ad0 0x7fcd78109f50 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fcd64009990 tx=0x7fcd64009ca0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.920+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3040488004 shutdown_connections 2024-05-08T08:56:11.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.920+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3040488004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd7810a490 0x7fcd781169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.920+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3040488004 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd7810fb60 0x7fcd7810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.920+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3040488004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd78109ad0 0x7fcd78109f50 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.920+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3040488004 >> 172.21.15.70:0/3040488004 conn(0x7fcd78076c70 msgr2=0x7fcd781082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:11.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.920+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3040488004 shutdown_connections 2024-05-08T08:56:11.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.920+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3040488004 wait complete. 2024-05-08T08:56:11.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.922+0000 7fcd7fe00700 1 Processor -- start 2024-05-08T08:56:11.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.922+0000 7fcd7fe00700 1 -- start start 2024-05-08T08:56:11.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.922+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78109ad0 0x7fcd781a0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.922+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd7810a490 0x7fcd781a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.922+0000 7fcd7fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd7810fb60 0x7fcd781a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.922+0000 7fcd7fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78119b80 con 0x7fcd7810fb60 2024-05-08T08:56:11.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.922+0000 7fcd7fe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78119a00 con 0x7fcd78109ad0 2024-05-08T08:56:11.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.922+0000 7fcd7fe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcd78119d00 con 0x7fcd7810a490 2024-05-08T08:56:11.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd7810fb60 0x7fcd781a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd7810fb60 0x7fcd781a48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39896/0 (socket says 172.21.15.70:39896) 2024-05-08T08:56:11.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7de00700 1 -- 172.21.15.70:0/3491244721 learned_addr learned my addr 172.21.15.70:0/3491244721 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:11.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7d400700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78109ad0 0x7fcd781a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7ca00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd7810a490 0x7fcd781a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7de00700 1 -- 172.21.15.70:0/3491244721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd7810a490 msgr2=0x7fcd781a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7de00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd7810a490 0x7fcd781a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7de00700 1 -- 172.21.15.70:0/3491244721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78109ad0 msgr2=0x7fcd781a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7de00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78109ad0 0x7fcd781a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7de00700 1 -- 172.21.15.70:0/3491244721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd781a4ff0 con 0x7fcd7810fb60 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.923+0000 7fcd7ca00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd7810a490 0x7fcd781a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.924+0000 7fcd7de00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd7810fb60 0x7fcd781a48b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fcd70007ee0 tx=0x7fcd7000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.924+0000 7fcd76000700 1 -- 172.21.15.70:0/3491244721 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd7000dbd0 con 0x7fcd7810fb60 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.924+0000 7fcd76000700 1 -- 172.21.15.70:0/3491244721 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd7000dd70 con 0x7fcd7810fb60 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.924+0000 7fcd76000700 1 -- 172.21.15.70:0/3491244721 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700058d0 con 0x7fcd7810fb60 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.924+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3491244721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd781a52e0 con 0x7fcd7810fb60 2024-05-08T08:56:11.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.924+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3491244721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd781acb60 con 0x7fcd7810fb60 2024-05-08T08:56:11.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.927+0000 7fcd76000700 1 -- 172.21.15.70:0/3491244721 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fcd7001a020 con 0x7fcd7810fb60 2024-05-08T08:56:11.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.929+0000 7fcd76000700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd600b2a70 0x7fcd600b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.929+0000 7fcd76000700 1 -- 172.21.15.70:0/3491244721 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(336..336 src has 1..336) ==== 9671+0+0 (secure 0 0 0) 0x7fcd700e22d0 con 0x7fcd7810fb60 2024-05-08T08:56:11.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.929+0000 7fcd7d400700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd600b2a70 0x7fcd600b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.930+0000 7fcd7d400700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd600b2a70 0x7fcd600b4f30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c005fd0 tx=0x7fcd6c00af20 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:11.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:11 smithi172 ceph-mon[33377]: pgmap v4132: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 87 KiB/s wr, 24 op/s 2024-05-08T08:56:11.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.943+0000 7fcd8a74cb80 1 Processor -- start 2024-05-08T08:56:11.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.943+0000 7fcd8a74cb80 1 -- start start 2024-05-08T08:56:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb81ec0 0x56149fb822a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 0x56149fb7c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7ce50 0x56149fb88c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56149faceb20 con 0x56149fb7ce50 2024-05-08T08:56:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56149fa6c860 con 0x56149fb81ec0 2024-05-08T08:56:11.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56149facaae0 con 0x56149fb7c490 2024-05-08T08:56:11.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd7de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7ce50 0x56149fb88c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd7de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7ce50 0x56149fb88c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39898/0 (socket says 172.21.15.70:39898) 2024-05-08T08:56:11.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd7de00700 1 -- 172.21.15.70:0/3406711805 learned_addr learned my addr 172.21.15.70:0/3406711805 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.944+0000 7fcd7ca00700 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 0x56149fb7c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd7d400700 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb81ec0 0x56149fb822a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd7de00700 1 -- 172.21.15.70:0/3406711805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 msgr2=0x56149fb7c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd7de00700 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 0x56149fb7c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd7de00700 1 -- 172.21.15.70:0/3406711805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb81ec0 msgr2=0x56149fb822a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd7de00700 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb81ec0 0x56149fb822a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd7de00700 1 -- 172.21.15.70:0/3406711805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149fa1b9d0 con 0x56149fb7ce50 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd7d400700 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb81ec0 0x56149fb822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd7de00700 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7ce50 0x56149fb88c80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000dfd0 tx=0x7fcd70005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facaf7a45b689670 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd6aa00700 1 -- 172.21.15.70:0/3406711805 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700a90d0 con 0x56149fb7ce50 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd6aa00700 1 -- 172.21.15.70:0/3406711805 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd700ad480 con 0x56149fb7ce50 2024-05-08T08:56:11.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.945+0000 7fcd6aa00700 1 -- 172.21.15.70:0/3406711805 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700a9330 con 0x56149fb7ce50 2024-05-08T08:56:11.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.946+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/3406711805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7ce50 msgr2=0x56149fb88c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:11.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.946+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7ce50 0x56149fb88c80 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fcd7000dfd0 tx=0x7fcd70005ab0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.946+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/3406711805 shutdown_connections 2024-05-08T08:56:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.946+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7ce50 0x56149fb88c80 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.946+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb81ec0 0x56149fb822a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.946+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/3406711805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 0x56149fb7c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.946+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/3406711805 >> 172.21.15.70:0/3406711805 conn(0x56149faaac60 msgr2=0x56149fb76d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.946+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/3406711805 shutdown_connections 2024-05-08T08:56:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.946+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/3406711805 wait complete. 2024-05-08T08:56:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.947+0000 7fcd8a74cb80 1 -- start start 2024-05-08T08:56:11.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.947+0000 7fcd8a74cb80 1 Processor -- start 2024-05-08T08:56:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7c490 0x56149fb88910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7ce50 0x56149fb85d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb86240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56149fb89220 con 0x56149fb81ec0 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56149fa34c20 con 0x56149fb7c490 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56149fb893a0 con 0x56149fb7ce50 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd8a74cb80 10 client.0 _ll_register_callbacks cb 0x56149fa75d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd7de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb86240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd7de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb86240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39908/0 (socket says 172.21.15.70:39908) 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd7de00700 1 -- 172.21.15.70:0/1666087057 learned_addr learned my addr 172.21.15.70:0/1666087057 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd7ca00700 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7ce50 0x56149fb85d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.948+0000 7fcd7d400700 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7c490 0x56149fb88910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd7de00700 1 -- 172.21.15.70:0/1666087057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7ce50 msgr2=0x56149fb85d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd7de00700 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7ce50 0x56149fb85d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd7de00700 1 -- 172.21.15.70:0/1666087057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7c490 msgr2=0x56149fb88910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd7de00700 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7c490 0x56149fb88910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd7de00700 1 -- 172.21.15.70:0/1666087057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149fa94520 con 0x56149fb81ec0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd7d400700 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7c490 0x56149fb88910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd7de00700 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb86240 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fcd700a6340 tx=0x7fcd700a9830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225e15299407010c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd5f400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd5f400700 1 -- 172.21.15.70:0/1666087057 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700c2020 con 0x56149fb81ec0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd5f400700 1 -- 172.21.15.70:0/1666087057 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(336..336 src has 1..336) ==== 9671+0+0 (secure 0 0 0) 0x7fcd700a9540 con 0x56149fb81ec0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1666087057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd700ad480 con 0x56149fb81ec0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd5f400700 1 -- 172.21.15.70:0/1666087057 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcd700a90d0 con 0x56149fb81ec0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd8a74cb80 10 client.18795 fetch_fsmap learned FSMap version 42 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.949+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1666087057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56149fb93a10 con 0x56149fb81ec0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.950+0000 7fcd5f400700 1 -- 172.21.15.70:0/1666087057 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd700ad480 con 0x56149fb81ec0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.950+0000 7fcd5f400700 1 -- 172.21.15.70:0/1666087057 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fcd700a4a40 con 0x56149fb81ec0 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.950+0000 7fcd8a74cb80 10 client.18795 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.950+0000 7fcd8a74cb80 10 client.18795 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.950+0000 7fcd8a74cb80 20 client.18795 populate_metadata read hostname 'smithi070' 2024-05-08T08:56:11.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.950+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56149fb95ee0 0x56149fb982d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.950+0000 7fcd8a74cb80 4 client.18795 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:56:11.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.950+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1666087057 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56149fb491a0 con 0x56149fb95ee0 2024-05-08T08:56:11.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.951+0000 7fcd7d400700 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56149fb95ee0 0x56149fb982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.952+0000 7fcd7d400700 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56149fb95ee0 0x56149fb982d0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57211b8520a8636a server_cookie=4e10dc7a31b37ff0 in_seq=0 out_seq=0 2024-05-08T08:56:11.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.952+0000 7fcd5f400700 10 client.18795 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:56:11.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.954+0000 7fcd5f400700 1 -- 172.21.15.70:0/1666087057 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56149fb491a0 con 0x56149fb95ee0 2024-05-08T08:56:11.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.954+0000 7fcd5f400700 10 client.18795 handle_command_reply: tid=0 2024-05-08T08:56:11.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.954+0000 7fcd8a74cb80 1 client.18795 shutdown 2024-05-08T08:56:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.954+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1666087057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 msgr2=0x56149fb86240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.954+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb86240 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fcd700a6340 tx=0x7fcd700a9830 comp rx=0 tx=0).stop 2024-05-08T08:56:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.954+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1666087057 shutdown_connections 2024-05-08T08:56:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.954+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56149fb95ee0 0x56149fb982d0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.955+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb86240 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.955+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7c490 0x56149fb88910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.955+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1666087057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7ce50 0x56149fb85d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.955+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1666087057 >> 172.21.15.70:0/1666087057 conn(0x56149faaac60 msgr2=0x56149fb71850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:11.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.955+0000 7fcd5f400700 0 client.18795 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:56:11.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.955+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1666087057 shutdown_connections 2024-05-08T08:56:11.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.955+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1666087057 wait complete. 2024-05-08T08:56:11.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.955+0000 7fcd8a74cb80 20 client.18795 trim_cache size 0 max 16384 2024-05-08T08:56:11.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.977+0000 7fcd8a74cb80 1 Processor -- start 2024-05-08T08:56:11.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.977+0000 7fcd8a74cb80 1 -- start start 2024-05-08T08:56:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.977+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7c490 0x56149fb70fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.977+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7ce50 0x56149fb71500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.977+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb81ec0 0x56149fb71a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.977+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781b8660 con 0x56149fb7c490 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.977+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781b5ef0 con 0x56149fb7ce50 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.977+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781b3d60 con 0x56149fb81ec0 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7c490 0x56149fb70fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7c490 0x56149fb70fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39922/0 (socket says 172.21.15.70:39922) 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7d400700 1 -- 172.21.15.70:0/472924090 learned_addr learned my addr 172.21.15.70:0/472924090 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7de00700 1 --2- 172.21.15.70:0/472924090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb81ec0 0x56149fb71a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7d400700 1 -- 172.21.15.70:0/472924090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb81ec0 msgr2=0x56149fb71a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7d400700 1 --2- 172.21.15.70:0/472924090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb81ec0 0x56149fb71a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7d400700 1 -- 172.21.15.70:0/472924090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7ce50 msgr2=0x56149fb71500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7d400700 1 --2- 172.21.15.70:0/472924090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7ce50 0x56149fb71500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7d400700 1 -- 172.21.15.70:0/472924090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149fb73980 con 0x56149fb7c490 2024-05-08T08:56:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.978+0000 7fcd7d400700 1 --2- 172.21.15.70:0/472924090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7c490 0x56149fb70fc0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00e920 tx=0x7fcd6c00af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ba3576e930b3d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd6a000700 1 -- 172.21.15.70:0/472924090 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c010c50 con 0x56149fb7c490 2024-05-08T08:56:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd6a000700 1 -- 172.21.15.70:0/472924090 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd6c02c070 con 0x56149fb7c490 2024-05-08T08:56:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd6a000700 1 -- 172.21.15.70:0/472924090 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c01d8e0 con 0x56149fb7c490 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/472924090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7c490 msgr2=0x56149fb70fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/472924090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7c490 0x56149fb70fc0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c00e920 tx=0x7fcd6c00af90 comp rx=0 tx=0).stop 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/472924090 shutdown_connections 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/472924090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb81ec0 0x56149fb71a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/472924090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb7c490 0x56149fb70fc0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/472924090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7ce50 0x56149fb71500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/472924090 >> 172.21.15.70:0/472924090 conn(0x56149faaac60 msgr2=0x56149fb7bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/472924090 shutdown_connections 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.979+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/472924090 wait complete. 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.980+0000 7fcd8a74cb80 1 -- start start 2024-05-08T08:56:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.980+0000 7fcd8a74cb80 1 Processor -- start 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.980+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 0x56149fb9b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.980+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7ce50 0x56149fb99560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd8a74cb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb99aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781b43b0 con 0x56149fb81ec0 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781b5820 con 0x56149fb7ce50 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd8a74cb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcd781b4a80 con 0x56149fb7c490 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd8a74cb80 10 client.0 _ll_register_callbacks cb 0x56149fa75d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb99aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb99aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39928/0 (socket says 172.21.15.70:39928) 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7de00700 1 -- 172.21.15.70:0/1022680599 learned_addr learned my addr 172.21.15.70:0/1022680599 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7d400700 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 0x56149fb9b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7ca00700 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7ce50 0x56149fb99560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7de00700 1 -- 172.21.15.70:0/1022680599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 msgr2=0x56149fb9b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7de00700 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 0x56149fb9b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7de00700 1 -- 172.21.15.70:0/1022680599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7ce50 msgr2=0x56149fb99560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7de00700 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7ce50 0x56149fb99560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.981+0000 7fcd7de00700 1 -- 172.21.15.70:0/1022680599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149fb99fe0 con 0x56149fb81ec0 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.982+0000 7fcd7de00700 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb99aa0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcd700df5a0 tx=0x7fcd700a50c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40c25f722f313dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.982+0000 7fcd5f400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.982+0000 7fcd5f400700 1 -- 172.21.15.70:0/1022680599 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd700c2040 con 0x56149fb81ec0 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.982+0000 7fcd5f400700 1 -- 172.21.15.70:0/1022680599 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(336..336 src has 1..336) ==== 9671+0+0 (secure 0 0 0) 0x7fcd700ca0d0 con 0x56149fb81ec0 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.982+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1022680599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd6c02c070 con 0x56149fb81ec0 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.982+0000 7fcd5f400700 1 -- 172.21.15.70:0/1022680599 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fcd700a8560 con 0x56149fb81ec0 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.982+0000 7fcd8a74cb80 10 client.18801 fetch_fsmap learned FSMap version 42 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.982+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1022680599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56149fc011c0 con 0x56149fb81ec0 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.982+0000 7fcd5f400700 1 -- 172.21.15.70:0/1022680599 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd6c02c070 con 0x56149fb81ec0 2024-05-08T08:56:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.983+0000 7fcd5f400700 1 -- 172.21.15.70:0/1022680599 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fcd700a7e10 con 0x56149fb81ec0 2024-05-08T08:56:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.983+0000 7fcd8a74cb80 10 client.18801 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:56:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.983+0000 7fcd8a74cb80 10 client.18801 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:56:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.983+0000 7fcd8a74cb80 20 client.18801 populate_metadata read hostname 'smithi070' 2024-05-08T08:56:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.983+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56149fc01620 0x56149fc03a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.983+0000 7fcd8a74cb80 4 client.18801 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b2e19b9b", "release": true, "await": true}] 2024-05-08T08:56:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.983+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1022680599 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b2e19b9b", "release": true, "await": true}) -- 0x56149fadc500 con 0x56149fc01620 2024-05-08T08:56:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.984+0000 7fcd7d400700 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56149fc01620 0x56149fc03a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.984+0000 7fcd7d400700 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56149fc01620 0x56149fc03a10 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa048e399a1c9d5c server_cookie=d80edff910ec9716 in_seq=0 out_seq=0 2024-05-08T08:56:11.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:11.984+0000 7fcd5f400700 10 client.18801 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:56:12.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:11 smithi194 ceph-mon[33679]: pgmap v4132: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 87 KiB/s wr, 24 op/s 2024-05-08T08:56:12.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:12 smithi070 ceph-mon[29591]: osdmap e336: 12 total, 12 up, 12 in 2024-05-08T08:56:12.927 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:12 smithi172 ceph-mon[33377]: osdmap e336: 12 total, 12 up, 12 in 2024-05-08T08:56:13.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:12 smithi194 ceph-mon[33679]: osdmap e336: 12 total, 12 up, 12 in 2024-05-08T08:56:13.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:13 smithi070 ceph-mon[29591]: pgmap v4134: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:56:13.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:13 smithi172 ceph-mon[33377]: pgmap v4134: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:56:14.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:13 smithi194 ceph-mon[33679]: pgmap v4134: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T08:56:14.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:14 smithi070 ceph-mon[29591]: pgmap v4135: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-05-08T08:56:14.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:14 smithi172 ceph-mon[33377]: pgmap v4135: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-05-08T08:56:15.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:14 smithi194 ceph-mon[33679]: pgmap v4135: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 6 op/s 2024-05-08T08:56:16.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.518+0000 7fcd5f400700 1 -- 172.21.15.70:0/1022680599 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x56149fadc500 con 0x56149fc01620 2024-05-08T08:56:16.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.518+0000 7fcd5f400700 10 client.18801 handle_command_reply: tid=0 2024-05-08T08:56:16.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.519+0000 7fcd8a74cb80 1 client.18801 shutdown 2024-05-08T08:56:16.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.519+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1022680599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 msgr2=0x56149fb99aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:16.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.519+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb99aa0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fcd700df5a0 tx=0x7fcd700a50c0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.519+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1022680599 shutdown_connections 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.519+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56149fc01620 0x56149fc03a10 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.520+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56149fb81ec0 0x56149fb99aa0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.520+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56149fb7c490 0x56149fb9b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.520+0000 7fcd8a74cb80 1 --2- 172.21.15.70:0/1022680599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56149fb7ce50 0x56149fb99560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.520+0000 7fcd5f400700 0 client.18801 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.520+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1022680599 >> 172.21.15.70:0/1022680599 conn(0x56149faaac60 msgr2=0x56149fb844c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.520+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1022680599 shutdown_connections 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.520+0000 7fcd8a74cb80 1 -- 172.21.15.70:0/1022680599 wait complete. 2024-05-08T08:56:16.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.520+0000 7fcd8a74cb80 20 client.18801 trim_cache size 0 max 16384 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 288, 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "b2e19b9b": { 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 288, 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.2, 2024-05-08T08:56:16.520 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:16.521 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.522+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd600b2a70 msgr2=0x7fcd600b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.522+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd600b2a70 0x7fcd600b4f30 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c005fd0 tx=0x7fcd6c00af20 comp rx=0 tx=0).stop 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.522+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd7810fb60 msgr2=0x7fcd781a48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.522+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd7810fb60 0x7fcd781a48b0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fcd70007ee0 tx=0x7fcd7000d3b0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.523+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3491244721 shutdown_connections 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.523+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd600b2a70 0x7fcd600b4f30 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.523+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd7810fb60 0x7fcd781a48b0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.523+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd78109ad0 0x7fcd781a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.523+0000 7fcd7fe00700 1 --2- 172.21.15.70:0/3491244721 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd7810a490 0x7fcd781a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:16.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.523+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3491244721 >> 172.21.15.70:0/3491244721 conn(0x7fcd78076c70 msgr2=0x7fcd78077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:16.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.523+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3491244721 shutdown_connections 2024-05-08T08:56:16.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:16.523+0000 7fcd7fe00700 1 -- 172.21.15.70:0/3491244721 wait complete. 2024-05-08T08:56:16.605 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_memcpy.o 2024-05-08T08:56:17.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:17 smithi070 ceph-mon[29591]: pgmap v4136: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-05-08T08:56:17.384 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b2e19b9b', seconds elapsed: 74.2 2024-05-08T08:56:17.384 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.15 2024-05-08T08:56:17.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:56:17.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:17 smithi172 ceph-mon[33377]: pgmap v4136: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-05-08T08:56:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:17 smithi194 ceph-mon[33679]: pgmap v4136: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-05-08T08:56:17.877 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:56:19.239 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:19 smithi070 ceph-mon[29591]: pgmap v4137: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-05-08T08:56:19.276 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/regmap/regcache-maple.o 2024-05-08T08:56:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:19 smithi172 ceph-mon[33377]: pgmap v4137: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-05-08T08:56:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:19 smithi194 ceph-mon[33679]: pgmap v4137: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2024-05-08T08:56:19.518 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/block/built-in.a 2024-05-08T08:56:19.603 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_mm.o 2024-05-08T08:56:19.684 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_sw_fence.o 2024-05-08T08:56:19.706 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/wakeup.o 2024-05-08T08:56:19.809 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_blend.o 2024-05-08T08:56:20.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.337+0000 7fe026400700 1 -- 172.21.15.70:0/849343189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 msgr2=0x7fe020110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:20.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.337+0000 7fe026400700 1 --2- 172.21.15.70:0/849343189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 0x7fe020110330 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b0a0 tx=0x7fe01800b3b0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.338+0000 7fe026400700 1 -- 172.21.15.70:0/849343189 shutdown_connections 2024-05-08T08:56:20.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.338+0000 7fe026400700 1 --2- 172.21.15.70:0/849343189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 0x7fe020110330 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.338+0000 7fe026400700 1 --2- 172.21.15.70:0/849343189 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe020109510 0x7fe0201098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.338+0000 7fe026400700 1 --2- 172.21.15.70:0/849343189 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe02006b180 0x7fe02006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.338+0000 7fe026400700 1 -- 172.21.15.70:0/849343189 >> 172.21.15.70:0/849343189 conn(0x7fe020079350 msgr2=0x7fe020079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:20.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.338+0000 7fe026400700 1 -- 172.21.15.70:0/849343189 shutdown_connections 2024-05-08T08:56:20.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.339+0000 7fe026400700 1 -- 172.21.15.70:0/849343189 wait complete. 2024-05-08T08:56:20.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.340+0000 7fe026400700 1 Processor -- start 2024-05-08T08:56:20.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.340+0000 7fe026400700 1 -- start start 2024-05-08T08:56:20.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.341+0000 7fe026400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe02006b180 0x7fe02019f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:20.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.341+0000 7fe026400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 0x7fe02019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:20.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.341+0000 7fe026400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe020109510 0x7fe020199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:20.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.341+0000 7fe026400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe020113520 con 0x7fe02006bb40 2024-05-08T08:56:20.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.341+0000 7fe026400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0201133a0 con 0x7fe020109510 2024-05-08T08:56:20.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.341+0000 7fe026400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0201136a0 con 0x7fe02006b180 2024-05-08T08:56:20.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.342+0000 7fe01ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 0x7fe02019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:20.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.342+0000 7fe01fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe020109510 0x7fe020199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:20.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.342+0000 7fe01fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe020109510 0x7fe020199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:37164/0 (socket says 172.21.15.70:37164) 2024-05-08T08:56:20.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.342+0000 7fe01fe00700 1 -- 172.21.15.70:0/478666982 learned_addr learned my addr 172.21.15.70:0/478666982 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:20.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.342+0000 7fe01ea00700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 0x7fe02019fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49012/0 (socket says 172.21.15.70:49012) 2024-05-08T08:56:20.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.342+0000 7fe01f400700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe02006b180 0x7fe02019f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:20.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.343+0000 7fe01fe00700 1 -- 172.21.15.70:0/478666982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe02006b180 msgr2=0x7fe02019f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:20.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.343+0000 7fe01fe00700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe02006b180 0x7fe02019f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.343+0000 7fe01fe00700 1 -- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 msgr2=0x7fe02019fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:20.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.343+0000 7fe01fe00700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 0x7fe02019fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.343+0000 7fe01fe00700 1 -- 172.21.15.70:0/478666982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02019a000 con 0x7fe020109510 2024-05-08T08:56:20.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.343+0000 7fe01ea00700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 0x7fe02019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:56:20.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.344+0000 7fe01fe00700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe020109510 0x7fe020199820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b070 tx=0x7fe01800cfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:20.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.345+0000 7fe017e00700 1 -- 172.21.15.70:0/478666982 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018022070 con 0x7fe020109510 2024-05-08T08:56:20.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.345+0000 7fe017e00700 1 -- 172.21.15.70:0/478666982 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe018007b80 con 0x7fe020109510 2024-05-08T08:56:20.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.345+0000 7fe017e00700 1 -- 172.21.15.70:0/478666982 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01801ce50 con 0x7fe020109510 2024-05-08T08:56:20.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.345+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02019a290 con 0x7fe020109510 2024-05-08T08:56:20.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.346+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0201023a0 con 0x7fe020109510 2024-05-08T08:56:20.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.348+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe020104bd0 con 0x7fe020109510 2024-05-08T08:56:20.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.355+0000 7fe017e00700 1 -- 172.21.15.70:0/478666982 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe018003a00 con 0x7fe020109510 2024-05-08T08:56:20.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.357+0000 7fe017e00700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0040b2c10 0x7fe0040b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:20.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.357+0000 7fe017e00700 1 -- 172.21.15.70:0/478666982 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(336..336 src has 1..336) ==== 9671+0+0 (secure 0 0 0) 0x7fe0180e78a0 con 0x7fe020109510 2024-05-08T08:56:20.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.358+0000 7fe01f400700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0040b2c10 0x7fe0040b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:20.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.359+0000 7fe01f400700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0040b2c10 0x7fe0040b50d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe010005fd0 tx=0x7fe01000af20 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:20.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.365+0000 7fe017e00700 1 -- 172.21.15.70:0/478666982 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe0180af010 con 0x7fe020109510 2024-05-08T08:56:20.470 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/base/test/built-in.a 2024-05-08T08:56:20.477 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/mfd/built-in.a 2024-05-08T08:56:20.656 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_bridge.o 2024-05-08T08:56:20.668 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_cache.o 2024-05-08T08:56:20.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.802+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe02002e510 con 0x7fe020109510 2024-05-08T08:56:20.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.803+0000 7fe017e00700 1 -- 172.21.15.70:0/478666982 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fe0180074e0 con 0x7fe020109510 2024-05-08T08:56:20.802 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:56:20.803 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:56:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0040b2c10 msgr2=0x7fe0040b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0040b2c10 0x7fe0040b50d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe010005fd0 tx=0x7fe01000af20 comp rx=0 tx=0).stop 2024-05-08T08:56:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe020109510 msgr2=0x7fe020199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe020109510 0x7fe020199820 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe01800b070 tx=0x7fe01800cfb0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 shutdown_connections 2024-05-08T08:56:20.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0040b2c10 0x7fe0040b50d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe020109510 0x7fe020199820 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe02006b180 0x7fe02019f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 --2- 172.21.15.70:0/478666982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe02006bb40 0x7fe02019fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.807+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 >> 172.21.15.70:0/478666982 conn(0x7fe020079350 msgr2=0x7fe0201010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.808+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 shutdown_connections 2024-05-08T08:56:20.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:20.808+0000 7fe026400700 1 -- 172.21.15.70:0/478666982 wait complete. 2024-05-08T08:56:20.808 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:56:20.857 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_client.o 2024-05-08T08:56:21.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:21 smithi194 ceph-mon[33679]: pgmap v4138: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 176 KiB/s wr, 18 op/s 2024-05-08T08:56:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:21 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/478666982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:56:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:21 smithi194 ceph-mon[33679]: osdmap e337: 12 total, 12 up, 12 in 2024-05-08T08:56:21.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:21 smithi070 ceph-mon[29591]: pgmap v4138: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 176 KiB/s wr, 18 op/s 2024-05-08T08:56:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:21 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/478666982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:56:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:21 smithi070 ceph-mon[29591]: osdmap e337: 12 total, 12 up, 12 in 2024-05-08T08:56:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:21 smithi172 ceph-mon[33377]: pgmap v4138: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 176 KiB/s wr, 18 op/s 2024-05-08T08:56:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:21 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/478666982' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:56:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:21 smithi172 ceph-mon[33377]: osdmap e337: 12 total, 12 up, 12 in 2024-05-08T08:56:21.732 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 78.15 --await-for 42.0' 2024-05-08T08:56:21.733 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 78.15 --await-for 42.0 2024-05-08T08:56:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:56:23.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:23 smithi070 ceph-mon[29591]: pgmap v4140: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 176 KiB/s wr, 18 op/s 2024-05-08T08:56:23.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:23 smithi194 ceph-mon[33679]: pgmap v4140: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 176 KiB/s wr, 18 op/s 2024-05-08T08:56:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:23 smithi172 ceph-mon[33377]: pgmap v4140: 129 pgs: 129 active+clean; 2.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 176 KiB/s wr, 18 op/s 2024-05-08T08:56:25.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:25 smithi194 ceph-mon[33679]: pgmap v4141: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 471 KiB/s wr, 23 op/s 2024-05-08T08:56:25.583 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:25 smithi172 ceph-mon[33377]: pgmap v4141: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 471 KiB/s wr, 23 op/s 2024-05-08T08:56:25.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:25 smithi070 ceph-mon[29591]: pgmap v4141: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 471 KiB/s wr, 23 op/s 2024-05-08T08:56:27.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:27 smithi194 ceph-mon[33679]: pgmap v4142: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 481 KiB/s wr, 26 op/s 2024-05-08T08:56:27.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:27 smithi070 ceph-mon[29591]: pgmap v4142: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 481 KiB/s wr, 26 op/s 2024-05-08T08:56:27.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:27 smithi172 ceph-mon[33377]: pgmap v4142: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 481 KiB/s wr, 26 op/s 2024-05-08T08:56:27.965 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_sw_fence_work.o 2024-05-08T08:56:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.496+0000 7f5923e00700 1 -- 172.21.15.70:0/4073049529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103550 msgr2=0x7f591c1039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.496+0000 7f5923e00700 1 --2- 172.21.15.70:0/4073049529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103550 0x7f591c1039b0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f5908009990 tx=0x7f5908009ca0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.497+0000 7f5923e00700 1 -- 172.21.15.70:0/4073049529 shutdown_connections 2024-05-08T08:56:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.497+0000 7f5923e00700 1 --2- 172.21.15.70:0/4073049529 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c103ef0 0x7f591c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.497+0000 7f5923e00700 1 --2- 172.21.15.70:0/4073049529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f591c108460 0x7f591c108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.497+0000 7f5923e00700 1 --2- 172.21.15.70:0/4073049529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103550 0x7f591c1039b0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.497+0000 7f5923e00700 1 -- 172.21.15.70:0/4073049529 >> 172.21.15.70:0/4073049529 conn(0x7f591c07a600 msgr2=0x7f591c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:28.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.497+0000 7f5923e00700 1 -- 172.21.15.70:0/4073049529 shutdown_connections 2024-05-08T08:56:28.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.499+0000 7f5923e00700 1 -- 172.21.15.70:0/4073049529 wait complete. 2024-05-08T08:56:28.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.500+0000 7f5923e00700 1 Processor -- start 2024-05-08T08:56:28.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.501+0000 7f5923e00700 1 -- start start 2024-05-08T08:56:28.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.501+0000 7f5923e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f591c103550 0x7f591c110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.501+0000 7f5923e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103ef0 0x7f591c10e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.501+0000 7f5923e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c108460 0x7f591c10e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.501+0000 7f5923e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f591c111400 con 0x7f591c103ef0 2024-05-08T08:56:28.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.501+0000 7f5923e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f591c111280 con 0x7f591c108460 2024-05-08T08:56:28.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.502+0000 7f5923e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f591c111580 con 0x7f591c103550 2024-05-08T08:56:28.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.502+0000 7f5920a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103ef0 0x7f591c10e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.502+0000 7f5921400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f591c103550 0x7f591c110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.502+0000 7f5920a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103ef0 0x7f591c10e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39502/0 (socket says 172.21.15.70:39502) 2024-05-08T08:56:28.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.503+0000 7f5920a00700 1 -- 172.21.15.70:0/1256462985 learned_addr learned my addr 172.21.15.70:0/1256462985 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:28.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.502+0000 7f5921400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f591c103550 0x7f591c110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:59898/0 (socket says 172.21.15.70:59898) 2024-05-08T08:56:28.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.502+0000 7f5921e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c108460 0x7f591c10e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.504+0000 7f5920a00700 1 -- 172.21.15.70:0/1256462985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f591c103550 msgr2=0x7f591c110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:28.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.504+0000 7f5920a00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f591c103550 0x7f591c110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.504+0000 7f5920a00700 1 -- 172.21.15.70:0/1256462985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c108460 msgr2=0x7f591c10e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:28.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.504+0000 7f5920a00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c108460 0x7f591c10e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.504+0000 7f5920a00700 1 -- 172.21.15.70:0/1256462985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591c1ac430 con 0x7f591c103ef0 2024-05-08T08:56:28.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.505+0000 7f5921e00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c108460 0x7f591c10e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:56:28.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.505+0000 7f5920a00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103ef0 0x7f591c10e370 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f590800b5c0 tx=0x7f5908003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:28.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.506+0000 7f591a000700 1 -- 172.21.15.70:0/1256462985 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908027070 con 0x7f591c103ef0 2024-05-08T08:56:28.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.507+0000 7f591a000700 1 -- 172.21.15.70:0/1256462985 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59080040f0 con 0x7f591c103ef0 2024-05-08T08:56:28.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.507+0000 7f591a000700 1 -- 172.21.15.70:0/1256462985 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5908022c00 con 0x7f591c103ef0 2024-05-08T08:56:28.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.508+0000 7f5923e00700 1 -- 172.21.15.70:0/1256462985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591c1ac600 con 0x7f591c103ef0 2024-05-08T08:56:28.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.508+0000 7f5923e00700 1 -- 172.21.15.70:0/1256462985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591c1aca00 con 0x7f591c103ef0 2024-05-08T08:56:28.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.514+0000 7f591a000700 1 -- 172.21.15.70:0/1256462985 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5908003c60 con 0x7f591c103ef0 2024-05-08T08:56:28.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.516+0000 7f591a000700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59040b2c30 0x7f59040b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.517+0000 7f591a000700 1 -- 172.21.15.70:0/1256462985 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(337..337 src has 1..337) ==== 9583+0+0 (secure 0 0 0) 0x7f59080e3860 con 0x7f591c103ef0 2024-05-08T08:56:28.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.517+0000 7f5921400700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59040b2c30 0x7f59040b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.518+0000 7f5921400700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59040b2c30 0x7f59040b50f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f591c104730 tx=0x7f591000a380 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:28.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.548+0000 7f592e6b9b80 1 Processor -- start 2024-05-08T08:56:28.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.548+0000 7f592e6b9b80 1 -- start start 2024-05-08T08:56:28.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.549+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557bb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.550+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.550+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 0x5619557c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.550+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561955707bb0 con 0x5619557bb240 2024-05-08T08:56:28.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.550+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5619556a58f0 con 0x5619557b5810 2024-05-08T08:56:28.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.550+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561955703b70 con 0x5619557b61d0 2024-05-08T08:56:28.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.550+0000 7f5921400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557bb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.551+0000 7f5921400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557bb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39514/0 (socket says 172.21.15.70:39514) 2024-05-08T08:56:28.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.551+0000 7f5921400700 1 -- 172.21.15.70:0/2319697279 learned_addr learned my addr 172.21.15.70:0/2319697279 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:28.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.551+0000 7f5920a00700 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.551+0000 7f5921e00700 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 0x5619557c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.552+0000 7f5921e00700 1 -- 172.21.15.70:0/2319697279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 msgr2=0x5619557b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.552+0000 7f5921e00700 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.552+0000 7f5921e00700 1 -- 172.21.15.70:0/2319697279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 msgr2=0x5619557bb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:28.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.552+0000 7f5921e00700 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557bb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.552+0000 7f5921e00700 1 -- 172.21.15.70:0/2319697279 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561955654a60 con 0x5619557b61d0 2024-05-08T08:56:28.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.552+0000 7f5921400700 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557bb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:56:28.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.553+0000 7f5921e00700 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 0x5619557c2000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5914009d00 tx=0x7f59140077e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c6814f0d8cfbc3b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:28.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.553+0000 7f590ea00700 1 -- 172.21.15.70:0/2319697279 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914015470 con 0x5619557b61d0 2024-05-08T08:56:28.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.554+0000 7f590ea00700 1 -- 172.21.15.70:0/2319697279 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f591401a070 con 0x5619557b61d0 2024-05-08T08:56:28.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.554+0000 7f590ea00700 1 -- 172.21.15.70:0/2319697279 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59140147c0 con 0x5619557b61d0 2024-05-08T08:56:28.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.556+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2319697279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 msgr2=0x5619557c2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:28.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.556+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 0x5619557c2000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5914009d00 tx=0x7f59140077e0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.557+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2319697279 shutdown_connections 2024-05-08T08:56:28.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.557+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 0x5619557c2000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.557+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557bb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.557+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2319697279 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.557+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2319697279 >> 172.21.15.70:0/2319697279 conn(0x56195572d860 msgr2=0x5619557b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:28.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.558+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2319697279 shutdown_connections 2024-05-08T08:56:28.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.558+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2319697279 wait complete. 2024-05-08T08:56:28.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.559+0000 7f592e6b9b80 1 -- start start 2024-05-08T08:56:28.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.559+0000 7f592e6b9b80 1 Processor -- start 2024-05-08T08:56:28.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557bef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 0x5619557bf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5619557c2600 con 0x5619557b61d0 2024-05-08T08:56:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56195566dcb0 con 0x5619557b5810 2024-05-08T08:56:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5619557c2780 con 0x5619557bb240 2024-05-08T08:56:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f592e6b9b80 10 client.0 _ll_register_callbacks cb 0x5619556aee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:56:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f5920a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f5920a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557bef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39526/0 (socket says 172.21.15.70:39526) 2024-05-08T08:56:28.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.560+0000 7f5920a00700 1 -- 172.21.15.70:0/2920803144 learned_addr learned my addr 172.21.15.70:0/2920803144 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:28.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.561+0000 7f5920a00700 1 -- 172.21.15.70:0/2920803144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 msgr2=0x5619557bf490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T08:56:28.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.561+0000 7f5920a00700 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 0x5619557bf490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.561+0000 7f5920a00700 1 -- 172.21.15.70:0/2920803144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 msgr2=0x5619557c1b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T08:56:28.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.561+0000 7f5920a00700 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557c1b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.561+0000 7f5920a00700 1 -- 172.21.15.70:0/2920803144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619556cd5b0 con 0x5619557b61d0 2024-05-08T08:56:28.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.561+0000 7f5920a00700 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557bef50 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f59080aa450 tx=0x7f5908004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3437f55dbd8e5f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:28.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.562+0000 7f5903400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:56:28.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.562+0000 7f5903400700 1 -- 172.21.15.70:0/2920803144 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59080aa260 con 0x5619557b61d0 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.562+0000 7f5903400700 1 -- 172.21.15.70:0/2920803144 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(337..337 src has 1..337) ==== 9583+0+0 (secure 0 0 0) 0x7f59080aabc0 con 0x5619557b61d0 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.562+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2920803144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f591401a070 con 0x5619557b61d0 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f5903400700 1 -- 172.21.15.70:0/2920803144 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f59080aae50 con 0x5619557b61d0 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f592e6b9b80 10 client.18819 fetch_fsmap learned FSMap version 42 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2920803144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5619557ccdc0 con 0x5619557b61d0 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f5903400700 1 -- 172.21.15.70:0/2920803144 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f591401a070 con 0x5619557b61d0 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f5903400700 1 -- 172.21.15.70:0/2920803144 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f59080e3380 con 0x5619557b61d0 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f592e6b9b80 10 client.18819 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f592e6b9b80 10 client.18819 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:56:28.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f592e6b9b80 20 client.18819 populate_metadata read hostname 'smithi070' 2024-05-08T08:56:28.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5619557cf370 0x5619557d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f592e6b9b80 4 client.18819 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:56:28.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.563+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2920803144 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619557822d0 con 0x5619557cf370 2024-05-08T08:56:28.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.564+0000 7f5921400700 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5619557cf370 0x5619557d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.565+0000 7f5903400700 10 client.18819 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:56:28.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.566+0000 7f5921400700 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5619557cf370 0x5619557d17b0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6dbcb7274a47e0ba server_cookie=e466236749a7ad30 in_seq=0 out_seq=0 2024-05-08T08:56:28.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.568+0000 7f5903400700 1 -- 172.21.15.70:0/2920803144 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5619557822d0 con 0x5619557cf370 2024-05-08T08:56:28.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.568+0000 7f5903400700 10 client.18819 handle_command_reply: tid=0 2024-05-08T08:56:28.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.568+0000 7f592e6b9b80 1 client.18819 shutdown 2024-05-08T08:56:28.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.568+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2920803144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 msgr2=0x5619557bef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:28.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.568+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557bef50 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f59080aa450 tx=0x7f5908004080 comp rx=0 tx=0).stop 2024-05-08T08:56:28.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.569+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2920803144 shutdown_connections 2024-05-08T08:56:28.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.569+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5619557cf370 0x5619557d17b0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.569+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 0x5619557bf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.569+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.569+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/2920803144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557bef50 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.569+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2920803144 >> 172.21.15.70:0/2920803144 conn(0x56195572d860 msgr2=0x5619557aabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:28.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.569+0000 7f5903400700 0 client.18819 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:56:28.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.569+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2920803144 shutdown_connections 2024-05-08T08:56:28.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.569+0000 7f592e6b9b80 1 -- 172.21.15.70:0/2920803144 wait complete. 2024-05-08T08:56:28.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.570+0000 7f592e6b9b80 20 client.18819 trim_cache size 0 max 16384 2024-05-08T08:56:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.614+0000 7f592e6b9b80 1 Processor -- start 2024-05-08T08:56:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.615+0000 7f592e6b9b80 1 -- start start 2024-05-08T08:56:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.615+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.615+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.615+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 0x5619557d70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.616+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1b8320 con 0x5619557b61d0 2024-05-08T08:56:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.616+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1b5bb0 con 0x5619557b5810 2024-05-08T08:56:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.616+0000 7f5920a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.616+0000 7f5920a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39542/0 (socket says 172.21.15.70:39542) 2024-05-08T08:56:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.616+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1b3a20 con 0x5619557bb240 2024-05-08T08:56:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.616+0000 7f5920a00700 1 -- 172.21.15.70:0/977870796 learned_addr learned my addr 172.21.15.70:0/977870796 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.616+0000 7f5921400700 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.616+0000 7f5921e00700 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 0x5619557d70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.617+0000 7f5920a00700 1 -- 172.21.15.70:0/977870796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 msgr2=0x5619557d70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.617+0000 7f5920a00700 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 0x5619557d70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.617+0000 7f5920a00700 1 -- 172.21.15.70:0/977870796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 msgr2=0x5619557cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.617+0000 7f5920a00700 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.617+0000 7f5920a00700 1 -- 172.21.15.70:0/977870796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619557c2480 con 0x5619557b61d0 2024-05-08T08:56:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.617+0000 7f5921e00700 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 0x5619557d70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:56:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.618+0000 7f5920a00700 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557b4f10 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f59080e36f0 tx=0x7f59080bfb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e765c29df6396e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.618+0000 7f590e000700 1 -- 172.21.15.70:0/977870796 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59080aa260 con 0x5619557b61d0 2024-05-08T08:56:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.618+0000 7f590e000700 1 -- 172.21.15.70:0/977870796 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59080aa750 con 0x5619557b61d0 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.618+0000 7f590e000700 1 -- 172.21.15.70:0/977870796 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59080e34d0 con 0x5619557b61d0 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.619+0000 7f592e6b9b80 1 -- 172.21.15.70:0/977870796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 msgr2=0x5619557b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.619+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557b4f10 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f59080e36f0 tx=0x7f59080bfb10 comp rx=0 tx=0).stop 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.620+0000 7f592e6b9b80 1 -- 172.21.15.70:0/977870796 shutdown_connections 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.620+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557bb240 0x5619557d70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.620+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.620+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/977870796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557b61d0 0x5619557b4f10 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.620+0000 7f592e6b9b80 1 -- 172.21.15.70:0/977870796 >> 172.21.15.70:0/977870796 conn(0x56195572d860 msgr2=0x5619557b4800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.620+0000 7f592e6b9b80 1 -- 172.21.15.70:0/977870796 shutdown_connections 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.620+0000 7f592e6b9b80 1 -- 172.21.15.70:0/977870796 wait complete. 2024-05-08T08:56:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.621+0000 7f592e6b9b80 1 -- start start 2024-05-08T08:56:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.621+0000 7f592e6b9b80 1 Processor -- start 2024-05-08T08:56:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.622+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.622+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 0x5619557c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.622+0000 7f592e6b9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557c5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.622+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1b4070 con 0x5619557bb240 2024-05-08T08:56:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.622+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1b54e0 con 0x5619557b5810 2024-05-08T08:56:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.622+0000 7f592e6b9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1b4740 con 0x5619557b61d0 2024-05-08T08:56:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.622+0000 7f592e6b9b80 10 client.0 _ll_register_callbacks cb 0x5619557bad20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:56:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.623+0000 7f5921400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.623+0000 7f5921400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:51976/0 (socket says 172.21.15.70:51976) 2024-05-08T08:56:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.623+0000 7f5921400700 1 -- 172.21.15.70:0/736719353 learned_addr learned my addr 172.21.15.70:0/736719353 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:56:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.624+0000 7f5920a00700 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 0x5619557c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.624+0000 7f5921e00700 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.624+0000 7f5921400700 1 -- 172.21.15.70:0/736719353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 msgr2=0x5619557c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.624+0000 7f5921400700 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 0x5619557c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.624+0000 7f5921400700 1 -- 172.21.15.70:0/736719353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 msgr2=0x5619557c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:56:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.624+0000 7f5921400700 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.624+0000 7f5921400700 1 -- 172.21.15.70:0/736719353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619557acd00 con 0x5619557b5810 2024-05-08T08:56:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.626+0000 7f5921400700 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557c49e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f591000a5d0 tx=0x7f59100047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a6c054789eed293 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:56:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.626+0000 7f5903400700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T08:56:28.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.627+0000 7f5903400700 1 -- 172.21.15.70:0/736719353 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910016070 con 0x5619557b5810 2024-05-08T08:56:28.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.627+0000 7f592e6b9b80 1 -- 172.21.15.70:0/736719353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59080aa750 con 0x5619557b5810 2024-05-08T08:56:28.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.627+0000 7f5903400700 1 -- 172.21.15.70:0/736719353 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(337..337 src has 1..337) ==== 9583+0+0 (secure 0 0 0) 0x7f5910010dd0 con 0x5619557b5810 2024-05-08T08:56:28.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.628+0000 7f5903400700 1 -- 172.21.15.70:0/736719353 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f5910034050 con 0x5619557b5810 2024-05-08T08:56:28.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.628+0000 7f592e6b9b80 10 client.37496 fetch_fsmap learned FSMap version 42 2024-05-08T08:56:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.628+0000 7f592e6b9b80 1 -- 172.21.15.70:0/736719353 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5619557b0cd0 con 0x5619557b5810 2024-05-08T08:56:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.628+0000 7f5903400700 1 -- 172.21.15.70:0/736719353 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59080aa750 con 0x5619557b5810 2024-05-08T08:56:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.629+0000 7f5903400700 1 -- 172.21.15.70:0/736719353 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f5910025ce0 con 0x5619557b5810 2024-05-08T08:56:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.629+0000 7f592e6b9b80 10 client.37496 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:56:28.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.629+0000 7f592e6b9b80 10 client.37496 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:56:28.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.629+0000 7f592e6b9b80 20 client.37496 populate_metadata read hostname 'smithi070' 2024-05-08T08:56:28.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.629+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56195583b5a0 0x56195583d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:56:28.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.629+0000 7f592e6b9b80 4 client.37496 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.15, "await_for": 42.0}] 2024-05-08T08:56:28.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.629+0000 7f592e6b9b80 1 -- 172.21.15.70:0/736719353 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.15, "await_for": 42.0}) -- 0x561955715590 con 0x56195583b5a0 2024-05-08T08:56:28.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.631+0000 7f5920a00700 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56195583b5a0 0x56195583d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:56:28.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.633+0000 7f5920a00700 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56195583b5a0 0x56195583d9c0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa158e9f5264365 server_cookie=e984c5f6f1b26011 in_seq=0 out_seq=0 2024-05-08T08:56:28.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:28.633+0000 7f5903400700 10 client.37496 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:56:28.664 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/regmap/regmap-debugfs.o 2024-05-08T08:56:29.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:29 smithi194 ceph-mon[33679]: pgmap v4143: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 481 KiB/s wr, 26 op/s 2024-05-08T08:56:29.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:29 smithi070 ceph-mon[29591]: pgmap v4143: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 481 KiB/s wr, 26 op/s 2024-05-08T08:56:29.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:29 smithi172 ceph-mon[33377]: pgmap v4143: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 481 KiB/s wr, 26 op/s 2024-05-08T08:56:29.783 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/component.o 2024-05-08T08:56:30.398 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/wakeup_stats.o 2024-05-08T08:56:31.410 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/nfc/built-in.a 2024-05-08T08:56:31.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:31 smithi194 ceph-mon[33679]: pgmap v4144: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 467 KiB/s wr, 25 op/s 2024-05-08T08:56:31.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:31 smithi070 ceph-mon[29591]: pgmap v4144: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 467 KiB/s wr, 25 op/s 2024-05-08T08:56:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:31 smithi172 ceph-mon[33377]: pgmap v4144: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 467 KiB/s wr, 25 op/s 2024-05-08T08:56:32.027 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dax/hmem/built-in.a 2024-05-08T08:56:32.148 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dax/built-in.a 2024-05-08T08:56:33.464 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:33 smithi070 ceph-mon[29591]: pgmap v4145: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 418 KiB/s wr, 23 op/s 2024-05-08T08:56:33.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:33 smithi194 ceph-mon[33679]: pgmap v4145: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 418 KiB/s wr, 23 op/s 2024-05-08T08:56:33.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:33 smithi172 ceph-mon[33377]: pgmap v4145: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 418 KiB/s wr, 23 op/s 2024-05-08T08:56:35.484 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:35 smithi070 ceph-mon[29591]: pgmap v4146: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 640 KiB/s wr, 28 op/s 2024-05-08T08:56:35.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:35 smithi194 ceph-mon[33679]: pgmap v4146: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 640 KiB/s wr, 28 op/s 2024-05-08T08:56:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:35 smithi172 ceph-mon[33377]: pgmap v4146: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 584 KiB/s rd, 640 KiB/s wr, 28 op/s 2024-05-08T08:56:37.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:37 smithi194 ceph-mon[33679]: pgmap v4147: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 397 KiB/s wr, 22 op/s 2024-05-08T08:56:37.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:37 smithi070 ceph-mon[29591]: pgmap v4147: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 397 KiB/s wr, 22 op/s 2024-05-08T08:56:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:37 smithi172 ceph-mon[33377]: pgmap v4147: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 397 KiB/s wr, 22 op/s 2024-05-08T08:56:39.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:39 smithi194 ceph-mon[33679]: pgmap v4148: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 387 KiB/s wr, 19 op/s 2024-05-08T08:56:39.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:39 smithi070 ceph-mon[29591]: pgmap v4148: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 387 KiB/s wr, 19 op/s 2024-05-08T08:56:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:39 smithi172 ceph-mon[33377]: pgmap v4148: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 387 KiB/s wr, 19 op/s 2024-05-08T08:56:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:41 smithi194 ceph-mon[33679]: pgmap v4149: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 402 KiB/s wr, 23 op/s 2024-05-08T08:56:41.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:41 smithi070 ceph-mon[29591]: pgmap v4149: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 402 KiB/s wr, 23 op/s 2024-05-08T08:56:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:41 smithi172 ceph-mon[33377]: pgmap v4149: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 402 KiB/s wr, 23 op/s 2024-05-08T08:56:43.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:43 smithi194 ceph-mon[33679]: pgmap v4150: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 273 KiB/s wr, 12 op/s 2024-05-08T08:56:43.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:43 smithi070 ceph-mon[29591]: pgmap v4150: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 273 KiB/s wr, 12 op/s 2024-05-08T08:56:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:43 smithi172 ceph-mon[33377]: pgmap v4150: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 273 KiB/s wr, 12 op/s 2024-05-08T08:56:45.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:45 smithi194 ceph-mon[33679]: pgmap v4151: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 364 KiB/s wr, 17 op/s 2024-05-08T08:56:45.620 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:45 smithi070 ceph-mon[29591]: pgmap v4151: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 364 KiB/s wr, 17 op/s 2024-05-08T08:56:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:45 smithi172 ceph-mon[33377]: pgmap v4151: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 364 KiB/s wr, 17 op/s 2024-05-08T08:56:47.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:47 smithi194 ceph-mon[33679]: pgmap v4152: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 113 KiB/s wr, 12 op/s 2024-05-08T08:56:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:47 smithi070 ceph-mon[29591]: pgmap v4152: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 113 KiB/s wr, 12 op/s 2024-05-08T08:56:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:47 smithi172 ceph-mon[33377]: pgmap v4152: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 113 KiB/s wr, 12 op/s 2024-05-08T08:56:49.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:49 smithi070 ceph-mon[29591]: pgmap v4153: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 107 KiB/s wr, 11 op/s 2024-05-08T08:56:49.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:49 smithi172 ceph-mon[33377]: pgmap v4153: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 107 KiB/s wr, 11 op/s 2024-05-08T08:56:49.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:49 smithi194 ceph-mon[33679]: pgmap v4153: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 107 KiB/s wr, 11 op/s 2024-05-08T08:56:51.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:51 smithi070 ceph-mon[29591]: pgmap v4154: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 193 KiB/s wr, 15 op/s 2024-05-08T08:56:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:51 smithi172 ceph-mon[33377]: pgmap v4154: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 193 KiB/s wr, 15 op/s 2024-05-08T08:56:51.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:51 smithi194 ceph-mon[33679]: pgmap v4154: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 193 KiB/s wr, 15 op/s 2024-05-08T08:56:52.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.738+0000 7f5903400700 1 -- 172.21.15.70:0/736719353 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x561955715590 con 0x56195583b5a0 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.738+0000 7f5903400700 10 client.37496 handle_command_reply: tid=0 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.738+0000 7f592e6b9b80 1 client.37496 shutdown 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.739+0000 7f592e6b9b80 1 -- 172.21.15.70:0/736719353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 msgr2=0x5619557c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.739+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557c49e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f591000a5d0 tx=0x7f59100047c0 comp rx=0 tx=0).stop 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.739+0000 7f592e6b9b80 1 -- 172.21.15.70:0/736719353 shutdown_connections 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.739+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56195583b5a0 0x56195583d9c0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.739+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5619557bb240 0x5619557c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.739+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5619557b5810 0x5619557c49e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.739+0000 7f592e6b9b80 1 --2- 172.21.15.70:0/736719353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5619557b61d0 0x5619557c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.739+0000 7f5903400700 0 client.37496 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.739+0000 7f592e6b9b80 1 -- 172.21.15.70:0/736719353 >> 172.21.15.70:0/736719353 conn(0x56195572d860 msgr2=0x5619557bc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:52.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.740+0000 7f592e6b9b80 1 -- 172.21.15.70:0/736719353 shutdown_connections 2024-05-08T08:56:52.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.740+0000 7f592e6b9b80 1 -- 172.21.15.70:0/736719353 wait complete. 2024-05-08T08:56:52.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.740+0000 7f592e6b9b80 20 client.37496 trim_cache size 0 max 16384 2024-05-08T08:56:52.741 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:56:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:56:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:56:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 290, 2024-05-08T08:56:52.741 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "168e0698": { 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 290, 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.2, 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:56:52.742 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:56:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:56:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:52.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:56:52.743 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.741+0000 7f5923e00700 1 -- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59040b2c30 msgr2=0x7f59040b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.741+0000 7f5923e00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59040b2c30 0x7f59040b50f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f591c104730 tx=0x7f591000a380 comp rx=0 tx=0).stop 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 -- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103ef0 msgr2=0x7f591c10e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103ef0 0x7f591c10e370 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f590800b5c0 tx=0x7f5908003a80 comp rx=0 tx=0).stop 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 -- 172.21.15.70:0/1256462985 shutdown_connections 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f59040b2c30 0x7f59040b50f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f591c108460 0x7f591c10e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f591c103550 0x7f591c110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 --2- 172.21.15.70:0/1256462985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f591c103ef0 0x7f591c10e370 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 -- 172.21.15.70:0/1256462985 >> 172.21.15.70:0/1256462985 conn(0x7f591c07a600 msgr2=0x7f591c101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 -- 172.21.15.70:0/1256462985 shutdown_connections 2024-05-08T08:56:52.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:56:52.742+0000 7f5923e00700 1 -- 172.21.15.70:0/1256462985 wait complete. 2024-05-08T08:56:53.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:53 smithi070 ceph-mon[29591]: pgmap v4155: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 178 KiB/s wr, 10 op/s 2024-05-08T08:56:53.669 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '168e0698', quiesce took 36.3 seconds. Will release after: 18.15 2024-05-08T08:56:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:53 smithi172 ceph-mon[33377]: pgmap v4155: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 178 KiB/s wr, 10 op/s 2024-05-08T08:56:53.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:53 smithi194 ceph-mon[33679]: pgmap v4155: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 178 KiB/s wr, 10 op/s 2024-05-08T08:56:55.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:55 smithi070 ceph-mon[29591]: pgmap v4156: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 404 KiB/s wr, 14 op/s 2024-05-08T08:56:55.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:55 smithi172 ceph-mon[33377]: pgmap v4156: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 404 KiB/s wr, 14 op/s 2024-05-08T08:56:55.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:55 smithi194 ceph-mon[33679]: pgmap v4156: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 404 KiB/s wr, 14 op/s 2024-05-08T08:56:57.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:57 smithi070 ceph-mon[29591]: pgmap v4157: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 312 KiB/s wr, 9 op/s 2024-05-08T08:56:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:57 smithi172 ceph-mon[33377]: pgmap v4157: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 312 KiB/s wr, 9 op/s 2024-05-08T08:56:57.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:57 smithi194 ceph-mon[33679]: pgmap v4157: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 312 KiB/s wr, 9 op/s 2024-05-08T08:56:58.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:56:58 smithi172 ceph-mon[33377]: pgmap v4158: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 312 KiB/s wr, 8 op/s 2024-05-08T08:56:59.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:56:58 smithi194 ceph-mon[33679]: pgmap v4158: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 312 KiB/s wr, 8 op/s 2024-05-08T08:56:59.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:56:58 smithi070 ceph-mon[29591]: pgmap v4158: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 312 KiB/s wr, 8 op/s 2024-05-08T08:57:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:01 smithi194 ceph-mon[33679]: pgmap v4159: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 413 KiB/s wr, 14 op/s 2024-05-08T08:57:01.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:01 smithi070 ceph-mon[29591]: pgmap v4159: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 413 KiB/s wr, 14 op/s 2024-05-08T08:57:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:01 smithi172 ceph-mon[33377]: pgmap v4159: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 413 KiB/s wr, 14 op/s 2024-05-08T08:57:03.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:03 smithi194 ceph-mon[33679]: pgmap v4160: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 327 KiB/s wr, 11 op/s 2024-05-08T08:57:03.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:03 smithi070 ceph-mon[29591]: pgmap v4160: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 327 KiB/s wr, 11 op/s 2024-05-08T08:57:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:03 smithi172 ceph-mon[33377]: pgmap v4160: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 327 KiB/s wr, 11 op/s 2024-05-08T08:57:05.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:05 smithi194 ceph-mon[33679]: pgmap v4161: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 462 KiB/s wr, 30 op/s 2024-05-08T08:57:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:57:05.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:05 smithi070 ceph-mon[29591]: pgmap v4161: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 462 KiB/s wr, 30 op/s 2024-05-08T08:57:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:57:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:05 smithi172 ceph-mon[33377]: pgmap v4161: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 525 KiB/s rd, 462 KiB/s wr, 30 op/s 2024-05-08T08:57:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:57:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:07 smithi194 ceph-mon[33679]: pgmap v4162: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 236 KiB/s wr, 27 op/s 2024-05-08T08:57:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:57:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:57:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:57:07.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:07 smithi070 ceph-mon[29591]: pgmap v4162: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 236 KiB/s wr, 27 op/s 2024-05-08T08:57:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:57:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:57:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:57:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:07 smithi172 ceph-mon[33377]: pgmap v4162: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 236 KiB/s wr, 27 op/s 2024-05-08T08:57:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:57:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:57:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:57:08.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:08 smithi070 ceph-mon[29591]: osdmap e338: 12 total, 12 up, 12 in 2024-05-08T08:57:08.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:08 smithi172 ceph-mon[33377]: osdmap e338: 12 total, 12 up, 12 in 2024-05-08T08:57:09.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:08 smithi194 ceph-mon[33679]: osdmap e338: 12 total, 12 up, 12 in 2024-05-08T08:57:09.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:09 smithi070 ceph-mon[29591]: pgmap v4164: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 283 KiB/s wr, 31 op/s 2024-05-08T08:57:09.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:09 smithi172 ceph-mon[33377]: pgmap v4164: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 283 KiB/s wr, 31 op/s 2024-05-08T08:57:10.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:09 smithi194 ceph-mon[33679]: pgmap v4164: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 283 KiB/s wr, 31 op/s 2024-05-08T08:57:11.820 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:57:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:11 smithi070 ceph-mon[29591]: pgmap v4165: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 162 KiB/s wr, 27 op/s 2024-05-08T08:57:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:11 smithi070 ceph-mon[29591]: osdmap e339: 12 total, 12 up, 12 in 2024-05-08T08:57:11.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:11 smithi172 ceph-mon[33377]: pgmap v4165: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 162 KiB/s wr, 27 op/s 2024-05-08T08:57:11.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:11 smithi172 ceph-mon[33377]: osdmap e339: 12 total, 12 up, 12 in 2024-05-08T08:57:12.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:11 smithi194 ceph-mon[33679]: pgmap v4165: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 162 KiB/s wr, 27 op/s 2024-05-08T08:57:12.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:11 smithi194 ceph-mon[33679]: osdmap e339: 12 total, 12 up, 12 in 2024-05-08T08:57:12.273 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:57:13.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:13 smithi070 ceph-mon[29591]: pgmap v4167: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:57:13.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:13 smithi172 ceph-mon[33377]: pgmap v4167: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:57:14.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:13 smithi194 ceph-mon[33679]: pgmap v4167: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T08:57:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.570+0000 7f094bc00700 1 -- 172.21.15.70:0/3924488980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406bb40 msgr2=0x7f0944110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.570+0000 7f094bc00700 1 --2- 172.21.15.70:0/3924488980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406bb40 0x7f0944110330 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b0a0 tx=0x7f093c00b3b0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.570+0000 7f094bc00700 1 -- 172.21.15.70:0/3924488980 shutdown_connections 2024-05-08T08:57:14.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.570+0000 7f094bc00700 1 --2- 172.21.15.70:0/3924488980 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406bb40 0x7f0944110330 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.570+0000 7f094bc00700 1 --2- 172.21.15.70:0/3924488980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0944109510 0x7f09441098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.570+0000 7f094bc00700 1 --2- 172.21.15.70:0/3924488980 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f094406b180 0x7f094406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.570+0000 7f094bc00700 1 -- 172.21.15.70:0/3924488980 >> 172.21.15.70:0/3924488980 conn(0x7f0944079350 msgr2=0x7f0944079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:57:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.570+0000 7f094bc00700 1 -- 172.21.15.70:0/3924488980 shutdown_connections 2024-05-08T08:57:14.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.570+0000 7f094bc00700 1 -- 172.21.15.70:0/3924488980 wait complete. 2024-05-08T08:57:14.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.571+0000 7f094bc00700 1 Processor -- start 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f094bc00700 1 -- start start 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f094bc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406b180 0x7f09441a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f094bc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094406bb40 0x7f09441a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f094bc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0944109510 0x7f094419bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f094bc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09441135a0 con 0x7f094406b180 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f094bc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f0944113420 con 0x7f0944109510 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f094bc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f0944113720 con 0x7f094406bb40 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f0949200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406b180 0x7f09441a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f0949200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406b180 0x7f09441a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54926/0 (socket says 172.21.15.70:54926) 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.572+0000 7f0949200700 1 -- 172.21.15.70:0/4020301499 learned_addr learned my addr 172.21.15.70:0/4020301499 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.573+0000 7f093be00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094406bb40 0x7f09441a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.573+0000 7f0949c00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0944109510 0x7f094419bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:14.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.573+0000 7f0949200700 1 -- 172.21.15.70:0/4020301499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094406bb40 msgr2=0x7f09441a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:14.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.573+0000 7f0949200700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094406bb40 0x7f09441a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.573+0000 7f0949200700 1 -- 172.21.15.70:0/4020301499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0944109510 msgr2=0x7f094419bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:14.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.573+0000 7f0949200700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0944109510 0x7f094419bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.573+0000 7f0949200700 1 -- 172.21.15.70:0/4020301499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094419c260 con 0x7f094406b180 2024-05-08T08:57:14.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.573+0000 7f0949c00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0944109510 0x7f094419bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:57:14.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.573+0000 7f0949200700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406b180 0x7f09441a1940 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f093400c9b0 tx=0x7f093400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:57:14.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.574+0000 7f0942000700 1 -- 172.21.15.70:0/4020301499 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934007b00 con 0x7f094406b180 2024-05-08T08:57:14.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.574+0000 7f0942000700 1 -- 172.21.15.70:0/4020301499 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0934007ca0 con 0x7f094406b180 2024-05-08T08:57:14.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.574+0000 7f0942000700 1 -- 172.21.15.70:0/4020301499 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934018660 con 0x7f094406b180 2024-05-08T08:57:14.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.574+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094419c4f0 con 0x7f094406b180 2024-05-08T08:57:14.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.574+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09441a8810 con 0x7f094406b180 2024-05-08T08:57:14.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.575+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094406a190 con 0x7f094406b180 2024-05-08T08:57:14.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.577+0000 7f0942000700 1 -- 172.21.15.70:0/4020301499 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f093400f450 con 0x7f094406b180 2024-05-08T08:57:14.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.579+0000 7f0942000700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09280b2a70 0x7f09280b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:14.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.579+0000 7f0942000700 1 -- 172.21.15.70:0/4020301499 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(339..339 src has 1..339) ==== 9583+0+0 (secure 0 0 0) 0x7f09340e2d70 con 0x7f094406b180 2024-05-08T08:57:14.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.579+0000 7f093be00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09280b2a70 0x7f09280b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:14.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.580+0000 7f093be00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09280b2a70 0x7f09280b4f30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f092c006fd0 tx=0x7f092c008040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:57:14.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.581+0000 7f0942000700 1 -- 172.21.15.70:0/4020301499 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0934014030 con 0x7f094406b180 2024-05-08T08:57:14.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.870+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09441a89e0 con 0x7f094406b180 2024-05-08T08:57:14.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.872+0000 7f0942000700 1 -- 172.21.15.70:0/4020301499 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f09340aa3e0 con 0x7f094406b180 2024-05-08T08:57:14.871 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:57:14.871 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:57:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09280b2a70 msgr2=0x7f09280b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:14.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09280b2a70 0x7f09280b4f30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f092c006fd0 tx=0x7f092c008040 comp rx=0 tx=0).stop 2024-05-08T08:57:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406b180 msgr2=0x7f09441a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406b180 0x7f09441a1940 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f093400c9b0 tx=0x7f093400cd70 comp rx=0 tx=0).stop 2024-05-08T08:57:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 shutdown_connections 2024-05-08T08:57:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f09280b2a70 0x7f09280b4f30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f0944109510 0x7f094419bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f094406b180 0x7f09441a1940 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 --2- 172.21.15.70:0/4020301499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094406bb40 0x7f09441a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:14.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 >> 172.21.15.70:0/4020301499 conn(0x7f0944079350 msgr2=0x7f094410e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:57:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.875+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 shutdown_connections 2024-05-08T08:57:14.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:14.876+0000 7f094bc00700 1 -- 172.21.15.70:0/4020301499 wait complete. 2024-05-08T08:57:14.876 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:57:15.699 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 168e0698 --release --await' 2024-05-08T08:57:15.699 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 168e0698 --release --await 2024-05-08T08:57:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:15 smithi070 ceph-mon[29591]: pgmap v4168: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-05-08T08:57:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:15 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4020301499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:57:15.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:15 smithi172 ceph-mon[33377]: pgmap v4168: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-05-08T08:57:15.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:15 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4020301499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:57:16.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:15 smithi194 ceph-mon[33679]: pgmap v4168: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 127 B/s wr, 7 op/s 2024-05-08T08:57:16.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:15 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4020301499' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:57:16.143 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:57:17.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:17 smithi070 ceph-mon[29591]: pgmap v4169: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 7 op/s 2024-05-08T08:57:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:17 smithi172 ceph-mon[33377]: pgmap v4169: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 7 op/s 2024-05-08T08:57:18.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:17 smithi194 ceph-mon[33679]: pgmap v4169: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 118 B/s wr, 7 op/s 2024-05-08T08:57:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.626+0000 7ffb20400700 1 -- 172.21.15.70:0/2484050788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb18103550 msgr2=0x7ffb181039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.626+0000 7ffb20400700 1 --2- 172.21.15.70:0/2484050788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb18103550 0x7ffb181039d0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7ffb040099c0 tx=0x7ffb04009cd0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.626+0000 7ffb20400700 1 -- 172.21.15.70:0/2484050788 shutdown_connections 2024-05-08T08:57:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.626+0000 7ffb20400700 1 --2- 172.21.15.70:0/2484050788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb18103f10 0x7ffb181103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.626+0000 7ffb20400700 1 --2- 172.21.15.70:0/2484050788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb181095d0 0x7ffb181099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.626+0000 7ffb20400700 1 --2- 172.21.15.70:0/2484050788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb18103550 0x7ffb181039d0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.626+0000 7ffb20400700 1 -- 172.21.15.70:0/2484050788 >> 172.21.15.70:0/2484050788 conn(0x7ffb1807a5f0 msgr2=0x7ffb1807aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:57:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.626+0000 7ffb20400700 1 -- 172.21.15.70:0/2484050788 shutdown_connections 2024-05-08T08:57:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.626+0000 7ffb20400700 1 -- 172.21.15.70:0/2484050788 wait complete. 2024-05-08T08:57:18.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.627+0000 7ffb20400700 1 Processor -- start 2024-05-08T08:57:18.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.627+0000 7ffb20400700 1 -- start start 2024-05-08T08:57:18.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.628+0000 7ffb20400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb18103550 0x7ffb1819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.628+0000 7ffb20400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb18103f10 0x7ffb1819c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.628+0000 7ffb20400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb181095d0 0x7ffb181a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.628+0000 7ffb20400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb18113650 con 0x7ffb181095d0 2024-05-08T08:57:18.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.628+0000 7ffb20400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181134d0 con 0x7ffb18103550 2024-05-08T08:57:18.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.628+0000 7ffb20400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181137d0 con 0x7ffb18103f10 2024-05-08T08:57:18.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.628+0000 7ffb1e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb181095d0 0x7ffb181a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.628+0000 7ffb1e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb181095d0 0x7ffb181a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34514/0 (socket says 172.21.15.70:34514) 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.629+0000 7ffb1e400700 1 -- 172.21.15.70:0/2826046234 learned_addr learned my addr 172.21.15.70:0/2826046234 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.629+0000 7ffb1d000700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb18103f10 0x7ffb1819c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.629+0000 7ffb1da00700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb18103550 0x7ffb1819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.629+0000 7ffb1e400700 1 -- 172.21.15.70:0/2826046234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb18103f10 msgr2=0x7ffb1819c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.629+0000 7ffb1e400700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb18103f10 0x7ffb1819c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.629+0000 7ffb1e400700 1 -- 172.21.15.70:0/2826046234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb18103550 msgr2=0x7ffb1819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.629+0000 7ffb1e400700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb18103550 0x7ffb1819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.629+0000 7ffb1e400700 1 -- 172.21.15.70:0/2826046234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb181a0d80 con 0x7ffb181095d0 2024-05-08T08:57:18.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.629+0000 7ffb1e400700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb181095d0 0x7ffb181a0640 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000c970 tx=0x7ffb1000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:57:18.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.630+0000 7ffb16000700 1 -- 172.21.15.70:0/2826046234 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10004a30 con 0x7ffb181095d0 2024-05-08T08:57:18.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.630+0000 7ffb16000700 1 -- 172.21.15.70:0/2826046234 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb100054b0 con 0x7ffb181095d0 2024-05-08T08:57:18.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.630+0000 7ffb16000700 1 -- 172.21.15.70:0/2826046234 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1000eac0 con 0x7ffb181095d0 2024-05-08T08:57:18.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.630+0000 7ffb20400700 1 -- 172.21.15.70:0/2826046234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb181a1070 con 0x7ffb181095d0 2024-05-08T08:57:18.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.630+0000 7ffb20400700 1 -- 172.21.15.70:0/2826046234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb181a88f0 con 0x7ffb181095d0 2024-05-08T08:57:18.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.633+0000 7ffb16000700 1 -- 172.21.15.70:0/2826046234 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ffb1000eca0 con 0x7ffb181095d0 2024-05-08T08:57:18.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.635+0000 7ffb16000700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffb000b2a70 0x7ffb000b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.635+0000 7ffb16000700 1 -- 172.21.15.70:0/2826046234 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(339..339 src has 1..339) ==== 9583+0+0 (secure 0 0 0) 0x7ffb100e24b0 con 0x7ffb181095d0 2024-05-08T08:57:18.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.635+0000 7ffb1da00700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffb000b2a70 0x7ffb000b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.636+0000 7ffb1da00700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffb000b2a70 0x7ffb000b4f30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00a400 tx=0x7ffb0c00d040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:57:18.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.653+0000 7ffb2ae49b80 1 Processor -- start 2024-05-08T08:57:18.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.653+0000 7ffb2ae49b80 1 -- start start 2024-05-08T08:57:18.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.654+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61392a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.654+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133490 0x55abc6133910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.654+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133e50 0x55abc613fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.654+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55abc6085b20 con 0x55abc6138ec0 2024-05-08T08:57:18.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.654+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55abc6023860 con 0x55abc6133490 2024-05-08T08:57:18.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.654+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55abc6081ae0 con 0x55abc6133e50 2024-05-08T08:57:18.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.654+0000 7ffb1da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.654+0000 7ffb1da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61392a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34530/0 (socket says 172.21.15.70:34530) 2024-05-08T08:57:18.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.654+0000 7ffb1da00700 1 -- 172.21.15.70:0/396708810 learned_addr learned my addr 172.21.15.70:0/396708810 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:57:18.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.655+0000 7ffb1e400700 1 --2- 172.21.15.70:0/396708810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133e50 0x55abc613fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.655+0000 7ffb1d000700 1 --2- 172.21.15.70:0/396708810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133490 0x55abc6133910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.655+0000 7ffb1da00700 1 -- 172.21.15.70:0/396708810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133e50 msgr2=0x55abc613fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:57:18.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.655+0000 7ffb1da00700 1 --2- 172.21.15.70:0/396708810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133e50 0x55abc613fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.655+0000 7ffb1da00700 1 -- 172.21.15.70:0/396708810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133490 msgr2=0x55abc6133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:57:18.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.655+0000 7ffb1da00700 1 --2- 172.21.15.70:0/396708810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133490 0x55abc6133910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.655+0000 7ffb1da00700 1 -- 172.21.15.70:0/396708810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc5fd29d0 con 0x55abc6138ec0 2024-05-08T08:57:18.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.655+0000 7ffb1da00700 1 --2- 172.21.15.70:0/396708810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61392a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c016730 tx=0x7ffb0c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9c7f156e48318c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:57:18.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.655+0000 7ffb0aa00700 1 -- 172.21.15.70:0/396708810 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c015780 con 0x55abc6138ec0 2024-05-08T08:57:18.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.656+0000 7ffb0aa00700 1 -- 172.21.15.70:0/396708810 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb0c025070 con 0x55abc6138ec0 2024-05-08T08:57:18.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.656+0000 7ffb0aa00700 1 -- 172.21.15.70:0/396708810 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0209d0 con 0x55abc6138ec0 2024-05-08T08:57:18.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.656+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/396708810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 msgr2=0x55abc61392a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:18.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.656+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/396708810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61392a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c016730 tx=0x7ffb0c011000 comp rx=0 tx=0).stop 2024-05-08T08:57:18.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.656+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/396708810 shutdown_connections 2024-05-08T08:57:18.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.656+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/396708810 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133e50 0x55abc613fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.656+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/396708810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61392a0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.656+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/396708810 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133490 0x55abc6133910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.657+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/396708810 >> 172.21.15.70:0/396708810 conn(0x55abc6061c60 msgr2=0x55abc612dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:57:18.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.657+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/396708810 shutdown_connections 2024-05-08T08:57:18.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.657+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/396708810 wait complete. 2024-05-08T08:57:18.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.657+0000 7ffb2ae49b80 1 -- start start 2024-05-08T08:57:18.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.657+0000 7ffb2ae49b80 1 Processor -- start 2024-05-08T08:57:18.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 0x55abc613f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc613cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc613d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55abc6140220 con 0x55abc6138ec0 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55abc5febc20 con 0x55abc6133e50 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55abc61403a0 con 0x55abc6133490 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb2ae49b80 10 client.0 _ll_register_callbacks cb 0x55abc602cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb1e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc613d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb1e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc613d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34540/0 (socket says 172.21.15.70:34540) 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.658+0000 7ffb1e400700 1 -- 172.21.15.70:0/3525319899 learned_addr learned my addr 172.21.15.70:0/3525319899 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffb1da00700 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 0x55abc613f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffb1d000700 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc613cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffb1e400700 1 -- 172.21.15.70:0/3525319899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 msgr2=0x55abc613f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffb1e400700 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 0x55abc613f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffb1e400700 1 -- 172.21.15.70:0/3525319899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 msgr2=0x55abc613cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:57:18.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffb1e400700 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc613cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffb1e400700 1 -- 172.21.15.70:0/3525319899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc604b520 con 0x55abc6138ec0 2024-05-08T08:57:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffb1da00700 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 0x55abc613f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:57:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffb1e400700 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc613d110 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ffb100a6580 tx=0x7ffb10005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d4553dab01d59e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:57:18.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.659+0000 7ffaff400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:57:18.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.660+0000 7ffaff400700 1 -- 172.21.15.70:0/3525319899 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb100c3060 con 0x55abc6138ec0 2024-05-08T08:57:18.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.660+0000 7ffaff400700 1 -- 172.21.15.70:0/3525319899 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(339..339 src has 1..339) ==== 9583+0+0 (secure 0 0 0) 0x7ffb100b1ce0 con 0x55abc6138ec0 2024-05-08T08:57:18.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.660+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/3525319899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb0c025070 con 0x55abc6138ec0 2024-05-08T08:57:18.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.660+0000 7ffaff400700 1 -- 172.21.15.70:0/3525319899 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ffb1001d040 con 0x55abc6138ec0 2024-05-08T08:57:18.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.660+0000 7ffb2ae49b80 10 client.18843 fetch_fsmap learned FSMap version 42 2024-05-08T08:57:18.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.660+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/3525319899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55abc614aa20 con 0x55abc6138ec0 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.660+0000 7ffaff400700 1 -- 172.21.15.70:0/3525319899 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb0c025070 con 0x55abc6138ec0 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.661+0000 7ffaff400700 1 -- 172.21.15.70:0/3525319899 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ffb100a8570 con 0x55abc6138ec0 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.661+0000 7ffb2ae49b80 10 client.18843 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.661+0000 7ffb2ae49b80 10 client.18843 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.661+0000 7ffb2ae49b80 20 client.18843 populate_metadata read hostname 'smithi070' 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.661+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55abc614cfb0 0x55abc614f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.661+0000 7ffb2ae49b80 4 client.18843 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.661+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/3525319899 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55abc61001a0 con 0x55abc614cfb0 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.662+0000 7ffb1da00700 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55abc614cfb0 0x55abc614f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.663+0000 7ffb1da00700 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55abc614cfb0 0x55abc614f3a0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c33db2490215438 server_cookie=4e83a4ae0f53fb6e in_seq=0 out_seq=0 2024-05-08T08:57:18.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.663+0000 7ffaff400700 10 client.18843 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:57:18.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffaff400700 1 -- 172.21.15.70:0/3525319899 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55abc61001a0 con 0x55abc614cfb0 2024-05-08T08:57:18.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffaff400700 10 client.18843 handle_command_reply: tid=0 2024-05-08T08:57:18.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 client.18843 shutdown 2024-05-08T08:57:18.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/3525319899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 msgr2=0x55abc613d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:18.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc613d110 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7ffb100a6580 tx=0x7ffb10005710 comp rx=0 tx=0).stop 2024-05-08T08:57:18.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/3525319899 shutdown_connections 2024-05-08T08:57:18.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55abc614cfb0 0x55abc614f3a0 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc613d110 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 0x55abc613f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/3525319899 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc613cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/3525319899 >> 172.21.15.70:0/3525319899 conn(0x55abc6061c60 msgr2=0x55abc6128850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:57:18.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffaff400700 0 client.18843 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:57:18.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.665+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/3525319899 shutdown_connections 2024-05-08T08:57:18.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.666+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/3525319899 wait complete. 2024-05-08T08:57:18.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.666+0000 7ffb2ae49b80 20 client.18843 trim_cache size 0 max 16384 2024-05-08T08:57:18.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.687+0000 7ffb2ae49b80 1 Processor -- start 2024-05-08T08:57:18.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.687+0000 7ffb2ae49b80 1 -- start start 2024-05-08T08:57:18.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.688+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6133490 0x55abc61492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.688+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6137050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.688+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6138ec0 0x55abc6154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.688+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181b4140 con 0x55abc6133490 2024-05-08T08:57:18.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.688+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181b19d0 con 0x55abc6133e50 2024-05-08T08:57:18.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.688+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181af840 con 0x55abc6138ec0 2024-05-08T08:57:18.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.688+0000 7ffb1da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6133490 0x55abc61492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.688+0000 7ffb1da00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6133490 0x55abc61492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34546/0 (socket says 172.21.15.70:34546) 2024-05-08T08:57:18.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.688+0000 7ffb1da00700 1 -- 172.21.15.70:0/2270304961 learned_addr learned my addr 172.21.15.70:0/2270304961 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:57:18.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb1e400700 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6138ec0 0x55abc6154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb1d000700 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6137050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb1da00700 1 -- 172.21.15.70:0/2270304961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6138ec0 msgr2=0x55abc6154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:57:18.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb1da00700 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6138ec0 0x55abc6154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb1da00700 1 -- 172.21.15.70:0/2270304961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 msgr2=0x55abc6137050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:57:18.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb1da00700 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6137050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb1da00700 1 -- 172.21.15.70:0/2270304961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc612a980 con 0x55abc6133490 2024-05-08T08:57:18.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb1d000700 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6137050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:57:18.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb1da00700 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6133490 0x55abc61492b0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00ab50 tx=0x7ffb0c00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2156b07b02d3d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:57:18.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.689+0000 7ffb0a000700 1 -- 172.21.15.70:0/2270304961 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c030070 con 0x55abc6133490 2024-05-08T08:57:18.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.690+0000 7ffb0a000700 1 -- 172.21.15.70:0/2270304961 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb0c025040 con 0x55abc6133490 2024-05-08T08:57:18.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.690+0000 7ffb0a000700 1 -- 172.21.15.70:0/2270304961 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c030670 con 0x55abc6133490 2024-05-08T08:57:18.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.690+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/2270304961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6133490 msgr2=0x55abc61492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:18.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.690+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6133490 0x55abc61492b0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00ab50 tx=0x7ffb0c00c040 comp rx=0 tx=0).stop 2024-05-08T08:57:18.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.691+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/2270304961 shutdown_connections 2024-05-08T08:57:18.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.691+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6138ec0 0x55abc6154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.691+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6133490 0x55abc61492b0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.691+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/2270304961 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6137050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.691+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/2270304961 >> 172.21.15.70:0/2270304961 conn(0x55abc6061c60 msgr2=0x55abc6136940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:57:18.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.691+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/2270304961 shutdown_connections 2024-05-08T08:57:18.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.691+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/2270304961 wait complete. 2024-05-08T08:57:18.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.691+0000 7ffb2ae49b80 1 -- start start 2024-05-08T08:57:18.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.691+0000 7ffb2ae49b80 1 Processor -- start 2024-05-08T08:57:18.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 0x55abc6142600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6142b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb2ae49b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61bff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181afe90 con 0x55abc6138ec0 2024-05-08T08:57:18.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181b1300 con 0x55abc6133e50 2024-05-08T08:57:18.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb2ae49b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffb181b0560 con 0x55abc6133490 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb2ae49b80 10 client.0 _ll_register_callbacks cb 0x55abc602cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb1e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb1e400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61bff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34556/0 (socket says 172.21.15.70:34556) 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.692+0000 7ffb1e400700 1 -- 172.21.15.70:0/8064700 learned_addr learned my addr 172.21.15.70:0/8064700 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffb1da00700 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 0x55abc6142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffb1d000700 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffb1e400700 1 -- 172.21.15.70:0/8064700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 msgr2=0x55abc6142600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffb1e400700 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 0x55abc6142600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffb1e400700 1 -- 172.21.15.70:0/8064700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 msgr2=0x55abc6142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffb1e400700 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffb1e400700 1 -- 172.21.15.70:0/8064700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc61c04c0 con 0x55abc6138ec0 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffb1d000700 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffb1e400700 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61bff80 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ffb10091050 tx=0x7ffb100e2360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc4d19ec82abd30 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.693+0000 7ffaff400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.694+0000 7ffaff400700 1 -- 172.21.15.70:0/8064700 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb100a90e0 con 0x55abc6138ec0 2024-05-08T08:57:18.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.694+0000 7ffaff400700 1 -- 172.21.15.70:0/8064700 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(339..339 src has 1..339) ==== 9583+0+0 (secure 0 0 0) 0x7ffb100a5900 con 0x55abc6138ec0 2024-05-08T08:57:18.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.694+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/8064700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb0c025040 con 0x55abc6138ec0 2024-05-08T08:57:18.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.694+0000 7ffaff400700 1 -- 172.21.15.70:0/8064700 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ffb100ad6c0 con 0x55abc6138ec0 2024-05-08T08:57:18.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.694+0000 7ffb2ae49b80 10 client.18849 fetch_fsmap learned FSMap version 42 2024-05-08T08:57:18.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.694+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/8064700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55abc61c1600 con 0x55abc6138ec0 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.694+0000 7ffaff400700 1 -- 172.21.15.70:0/8064700 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffb0c025040 con 0x55abc6138ec0 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.695+0000 7ffaff400700 1 -- 172.21.15.70:0/8064700 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ffb100a4c80 con 0x55abc6138ec0 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.695+0000 7ffb2ae49b80 10 client.18849 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.695+0000 7ffb2ae49b80 10 client.18849 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.695+0000 7ffb2ae49b80 20 client.18849 populate_metadata read hostname 'smithi070' 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.695+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55abc61c1d10 0x55abc61c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.695+0000 7ffb2ae49b80 4 client.18849 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "168e0698", "release": true, "await": true}] 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.695+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/8064700 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "168e0698", "release": true, "await": true}) -- 0x55abc6093500 con 0x55abc61c1d10 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.695+0000 7ffb1da00700 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55abc61c1d10 0x55abc61c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.696+0000 7ffb1da00700 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55abc61c1d10 0x55abc61c4130 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca5943222b2b2de0 server_cookie=f5603ee82e06f68a in_seq=0 out_seq=0 2024-05-08T08:57:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:18.696+0000 7ffaff400700 10 client.18849 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:57:19.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:19 smithi070 ceph-mon[29591]: pgmap v4170: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:57:19.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:19 smithi172 ceph-mon[33377]: pgmap v4170: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:57:20.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:19 smithi194 ceph-mon[33679]: pgmap v4170: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:57:21.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:21 smithi070 ceph-mon[29591]: pgmap v4171: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:57:21.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:21 smithi172 ceph-mon[33377]: pgmap v4171: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:57:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:21 smithi194 ceph-mon[33679]: pgmap v4171: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T08:57:23.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.212+0000 7ffaff400700 1 -- 172.21.15.70:0/8064700 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55abc6093500 con 0x55abc61c1d10 2024-05-08T08:57:23.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.212+0000 7ffaff400700 10 client.18849 handle_command_reply: tid=0 2024-05-08T08:57:23.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.212+0000 7ffb2ae49b80 1 client.18849 shutdown 2024-05-08T08:57:23.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.212+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/8064700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 msgr2=0x55abc61bff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:23.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.212+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61bff80 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7ffb10091050 tx=0x7ffb100e2360 comp rx=0 tx=0).stop 2024-05-08T08:57:23.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.213+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/8064700 shutdown_connections 2024-05-08T08:57:23.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.213+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55abc61c1d10 0x55abc61c4130 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:23.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.213+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55abc6138ec0 0x55abc61bff80 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:23.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.213+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55abc6133490 0x55abc6142600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:23.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.213+0000 7ffb2ae49b80 1 --2- 172.21.15.70:0/8064700 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55abc6133e50 0x55abc6142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:23.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.213+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/8064700 >> 172.21.15.70:0/8064700 conn(0x55abc6061c60 msgr2=0x55abc61371d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:57:23.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.213+0000 7ffaff400700 0 client.18849 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:57:23.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.213+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/8064700 shutdown_connections 2024-05-08T08:57:23.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.214+0000 7ffb2ae49b80 1 -- 172.21.15.70:0/8064700 wait complete. 2024-05-08T08:57:23.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.214+0000 7ffb2ae49b80 20 client.18849 trim_cache size 0 max 16384 2024-05-08T08:57:23.213 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 292, 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "168e0698": { 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 292, 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:57:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.2, 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:57:23.215 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.215+0000 7ffb20400700 1 -- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffb000b2a70 msgr2=0x7ffb000b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.215+0000 7ffb20400700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffb000b2a70 0x7ffb000b4f30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00a400 tx=0x7ffb0c00d040 comp rx=0 tx=0).stop 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.215+0000 7ffb20400700 1 -- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb181095d0 msgr2=0x7ffb181a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.215+0000 7ffb20400700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb181095d0 0x7ffb181a0640 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000c970 tx=0x7ffb1000cc80 comp rx=0 tx=0).stop 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.216+0000 7ffb20400700 1 -- 172.21.15.70:0/2826046234 shutdown_connections 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.216+0000 7ffb20400700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffb000b2a70 0x7ffb000b4f30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.216+0000 7ffb20400700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb181095d0 0x7ffb181a0640 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.216+0000 7ffb20400700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffb18103550 0x7ffb1819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.216+0000 7ffb20400700 1 --2- 172.21.15.70:0/2826046234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb18103f10 0x7ffb1819c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.216+0000 7ffb20400700 1 -- 172.21.15.70:0/2826046234 >> 172.21.15.70:0/2826046234 conn(0x7ffb1807a5f0 msgr2=0x7ffb1810e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:57:23.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.217+0000 7ffb20400700 1 -- 172.21.15.70:0/2826046234 shutdown_connections 2024-05-08T08:57:23.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:57:23.217+0000 7ffb20400700 1 -- 172.21.15.70:0/2826046234 wait complete. 2024-05-08T08:57:23.307 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_client_modeset.o 2024-05-08T08:57:23.534 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_color_mgmt.o 2024-05-08T08:57:23.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:23 smithi070 ceph-mon[29591]: pgmap v4172: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T08:57:23.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:23 smithi172 ceph-mon[33377]: pgmap v4172: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T08:57:24.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:23 smithi194 ceph-mon[33679]: pgmap v4172: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T08:57:24.069 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '168e0698', seconds elapsed: 66.7 2024-05-08T08:57:24.138 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma-buf/dma-buf.o 2024-05-08T08:57:24.952 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma-buf/dma-fence.o 2024-05-08T08:57:25.146 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/power/trace.o 2024-05-08T08:57:25.372 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma-buf/dma-fence-array.o 2024-05-08T08:57:25.517 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/base/regmap/built-in.a 2024-05-08T08:57:25.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:25 smithi070 ceph-mon[29591]: pgmap v4173: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 108 KiB/s wr, 10 op/s 2024-05-08T08:57:25.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:25 smithi172 ceph-mon[33377]: pgmap v4173: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 108 KiB/s wr, 10 op/s 2024-05-08T08:57:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:25 smithi194 ceph-mon[33679]: pgmap v4173: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 108 KiB/s wr, 10 op/s 2024-05-08T08:57:26.036 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_syncmap.o 2024-05-08T08:57:26.649 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/core.o 2024-05-08T08:57:27.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:27 smithi070 ceph-mon[29591]: pgmap v4174: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 112 KiB/s wr, 9 op/s 2024-05-08T08:57:27.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:27 smithi172 ceph-mon[33377]: pgmap v4174: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 112 KiB/s wr, 9 op/s 2024-05-08T08:57:28.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:27 smithi194 ceph-mon[33679]: pgmap v4174: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 112 KiB/s wr, 9 op/s 2024-05-08T08:57:29.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:29 smithi070 ceph-mon[29591]: pgmap v4175: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 112 KiB/s wr, 9 op/s 2024-05-08T08:57:29.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:29 smithi172 ceph-mon[33377]: pgmap v4175: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 112 KiB/s wr, 9 op/s 2024-05-08T08:57:30.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:29 smithi194 ceph-mon[33679]: pgmap v4175: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 112 KiB/s wr, 9 op/s 2024-05-08T08:57:31.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:31 smithi070 ceph-mon[29591]: pgmap v4176: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 377 KiB/s wr, 17 op/s 2024-05-08T08:57:31.904 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_user_extensions.o 2024-05-08T08:57:31.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:31 smithi172 ceph-mon[33377]: pgmap v4176: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 377 KiB/s wr, 17 op/s 2024-05-08T08:57:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:31 smithi194 ceph-mon[33679]: pgmap v4176: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 377 KiB/s wr, 17 op/s 2024-05-08T08:57:32.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma-buf/dma-fence-chain.o 2024-05-08T08:57:32.837 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma-buf/dma-fence-unwrap.o 2024-05-08T08:57:33.350 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_ioc32.o 2024-05-08T08:57:33.405 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/bus.o 2024-05-08T08:57:33.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:33 smithi070 ceph-mon[29591]: pgmap v4177: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 377 KiB/s wr, 15 op/s 2024-05-08T08:57:33.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:33 smithi172 ceph-mon[33377]: pgmap v4177: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 377 KiB/s wr, 15 op/s 2024-05-08T08:57:34.009 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:33 smithi194 ceph-mon[33679]: pgmap v4177: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 377 KiB/s wr, 15 op/s 2024-05-08T08:57:34.850 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/base/power/built-in.a 2024-05-08T08:57:34.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:34 smithi172 ceph-mon[33377]: pgmap v4178: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 561 KiB/s wr, 27 op/s 2024-05-08T08:57:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:34 smithi194 ceph-mon[33679]: pgmap v4178: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 561 KiB/s wr, 27 op/s 2024-05-08T08:57:35.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:34 smithi070 ceph-mon[29591]: pgmap v4178: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 523 KiB/s rd, 561 KiB/s wr, 27 op/s 2024-05-08T08:57:35.295 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma-buf/dma-resv.o 2024-05-08T08:57:35.863 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_connector.o 2024-05-08T08:57:37.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:37 smithi194 ceph-mon[33679]: pgmap v4179: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 583 KiB/s wr, 26 op/s 2024-05-08T08:57:37.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:37 smithi070 ceph-mon[29591]: pgmap v4179: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 583 KiB/s wr, 26 op/s 2024-05-08T08:57:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:37 smithi172 ceph-mon[33377]: pgmap v4179: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 583 KiB/s wr, 26 op/s 2024-05-08T08:57:38.938 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/dma-buf/sync_file.o 2024-05-08T08:57:39.206 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/dd.o 2024-05-08T08:57:39.431 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_debugfs.o 2024-05-08T08:57:39.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:39 smithi194 ceph-mon[33679]: pgmap v4180: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 579 KiB/s wr, 25 op/s 2024-05-08T08:57:39.564 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_debugfs_params.o 2024-05-08T08:57:39.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:39 smithi070 ceph-mon[29591]: pgmap v4180: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 579 KiB/s wr, 25 op/s 2024-05-08T08:57:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:39 smithi172 ceph-mon[33377]: pgmap v4180: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 579 KiB/s wr, 25 op/s 2024-05-08T08:57:40.856 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_debugfs.o 2024-05-08T08:57:41.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:41 smithi194 ceph-mon[33679]: pgmap v4181: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 798 KiB/s wr, 36 op/s 2024-05-08T08:57:41.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:41 smithi070 ceph-mon[29591]: pgmap v4181: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 798 KiB/s wr, 36 op/s 2024-05-08T08:57:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:41 smithi172 ceph-mon[33377]: pgmap v4181: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 840 KiB/s rd, 798 KiB/s wr, 36 op/s 2024-05-08T08:57:43.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:43 smithi194 ceph-mon[33679]: pgmap v4182: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 533 KiB/s wr, 27 op/s 2024-05-08T08:57:43.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:43 smithi070 ceph-mon[29591]: pgmap v4182: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 533 KiB/s wr, 27 op/s 2024-05-08T08:57:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:43 smithi172 ceph-mon[33377]: pgmap v4182: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 533 KiB/s wr, 27 op/s 2024-05-08T08:57:43.940 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/syscore.o 2024-05-08T08:57:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:45 smithi194 ceph-mon[33679]: pgmap v4183: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 747 KiB/s wr, 36 op/s 2024-05-08T08:57:45.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:45 smithi070 ceph-mon[29591]: pgmap v4183: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 747 KiB/s wr, 36 op/s 2024-05-08T08:57:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:45 smithi172 ceph-mon[33377]: pgmap v4183: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 747 KiB/s wr, 36 op/s 2024-05-08T08:57:46.601 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/cxl/core/built-in.a 2024-05-08T08:57:46.715 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/cxl/built-in.a 2024-05-08T08:57:46.767 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/dma-buf/built-in.a 2024-05-08T08:57:46.823 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_pipe_crc.o 2024-05-08T08:57:47.208 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_pmu.o 2024-05-08T08:57:47.482 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_crtc.o 2024-05-08T08:57:47.509 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:47 smithi194 ceph-mon[33679]: pgmap v4184: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 603 KiB/s wr, 27 op/s 2024-05-08T08:57:47.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:47 smithi070 ceph-mon[29591]: pgmap v4184: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 603 KiB/s wr, 27 op/s 2024-05-08T08:57:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:47 smithi172 ceph-mon[33377]: pgmap v4184: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 603 KiB/s wr, 27 op/s 2024-05-08T08:57:47.869 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_displayid.o 2024-05-08T08:57:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:49 smithi194 ceph-mon[33679]: pgmap v4185: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 473 KiB/s wr, 22 op/s 2024-05-08T08:57:49.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:49 smithi070 ceph-mon[29591]: pgmap v4185: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 473 KiB/s wr, 22 op/s 2024-05-08T08:57:49.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:49 smithi172 ceph-mon[33377]: pgmap v4185: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 473 KiB/s wr, 22 op/s 2024-05-08T08:57:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:51 smithi194 ceph-mon[33679]: pgmap v4186: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 799 KiB/s wr, 38 op/s 2024-05-08T08:57:51.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:51 smithi070 ceph-mon[29591]: pgmap v4186: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 799 KiB/s wr, 38 op/s 2024-05-08T08:57:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:51 smithi172 ceph-mon[33377]: pgmap v4186: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 799 KiB/s wr, 38 op/s 2024-05-08T08:57:52.458 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_drv.o 2024-05-08T08:57:53.020 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_dumb_buffers.o 2024-05-08T08:57:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:53 smithi194 ceph-mon[33679]: pgmap v4187: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 579 KiB/s wr, 27 op/s 2024-05-08T08:57:53.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:53 smithi070 ceph-mon[29591]: pgmap v4187: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 579 KiB/s wr, 27 op/s 2024-05-08T08:57:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:53 smithi172 ceph-mon[33377]: pgmap v4187: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 535 KiB/s rd, 579 KiB/s wr, 27 op/s 2024-05-08T08:57:53.893 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/driver.o 2024-05-08T08:57:55.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:55 smithi070 ceph-mon[29591]: pgmap v4188: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 813 KiB/s wr, 38 op/s 2024-05-08T08:57:55.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:55 smithi172 ceph-mon[33377]: pgmap v4188: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 813 KiB/s wr, 38 op/s 2024-05-08T08:57:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:55 smithi194 ceph-mon[33679]: pgmap v4188: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 813 KiB/s wr, 38 op/s 2024-05-08T08:57:55.996 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/macintosh/mac_hid.o 2024-05-08T08:57:56.298 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen2_engine_cs.o 2024-05-08T08:57:57.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:57 smithi070 ceph-mon[29591]: pgmap v4189: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 611 KiB/s wr, 34 op/s 2024-05-08T08:57:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:57 smithi172 ceph-mon[33377]: pgmap v4189: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 611 KiB/s wr, 34 op/s 2024-05-08T08:57:57.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:57 smithi194 ceph-mon[33679]: pgmap v4189: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 611 KiB/s wr, 34 op/s 2024-05-08T08:57:58.089 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/class.o 2024-05-08T08:57:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:57:59 smithi070 ceph-mon[29591]: pgmap v4190: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 572 KiB/s wr, 31 op/s 2024-05-08T08:57:59.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:57:59 smithi172 ceph-mon[33377]: pgmap v4190: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 572 KiB/s wr, 31 op/s 2024-05-08T08:57:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:57:59 smithi194 ceph-mon[33679]: pgmap v4190: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 518 KiB/s rd, 572 KiB/s wr, 31 op/s 2024-05-08T08:58:01.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:01 smithi070 ceph-mon[29591]: pgmap v4191: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 864 KiB/s wr, 40 op/s 2024-05-08T08:58:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:01 smithi172 ceph-mon[33377]: pgmap v4191: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 864 KiB/s wr, 40 op/s 2024-05-08T08:58:01.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:01 smithi194 ceph-mon[33679]: pgmap v4191: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 784 KiB/s rd, 864 KiB/s wr, 40 op/s 2024-05-08T08:58:02.016 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/scsi/pcmcia/built-in.a 2024-05-08T08:58:02.213 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi.o 2024-05-08T08:58:02.459 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/hosts.o 2024-05-08T08:58:02.922 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_ioctl.o 2024-05-08T08:58:03.355 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_edid.o 2024-05-08T08:58:03.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:03 smithi070 ceph-mon[29591]: pgmap v4192: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 538 KiB/s wr, 24 op/s 2024-05-08T08:58:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:03 smithi172 ceph-mon[33377]: pgmap v4192: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 538 KiB/s wr, 24 op/s 2024-05-08T08:58:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:03 smithi194 ceph-mon[33679]: pgmap v4192: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 538 KiB/s wr, 24 op/s 2024-05-08T08:58:03.839 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen6_engine_cs.o 2024-05-08T08:58:04.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:04 smithi070 ceph-mon[29591]: osdmap e340: 12 total, 12 up, 12 in 2024-05-08T08:58:04.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:04 smithi172 ceph-mon[33377]: osdmap e340: 12 total, 12 up, 12 in 2024-05-08T08:58:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:04 smithi194 ceph-mon[33679]: osdmap e340: 12 total, 12 up, 12 in 2024-05-08T08:58:05.293 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/macintosh/built-in.a 2024-05-08T08:58:05.484 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen6_ppgtt.o 2024-05-08T08:58:05.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:05 smithi070 ceph-mon[29591]: pgmap v4194: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 791 KiB/s wr, 47 op/s 2024-05-08T08:58:05.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:05 smithi172 ceph-mon[33377]: pgmap v4194: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 791 KiB/s wr, 47 op/s 2024-05-08T08:58:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:05 smithi194 ceph-mon[33679]: pgmap v4194: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 791 KiB/s wr, 47 op/s 2024-05-08T08:58:07.562 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:07 smithi194 ceph-mon[33679]: pgmap v4195: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 793 KiB/s wr, 45 op/s 2024-05-08T08:58:07.563 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:58:07.602 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/platform.o 2024-05-08T08:58:07.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:07 smithi070 ceph-mon[29591]: pgmap v4195: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 793 KiB/s wr, 45 op/s 2024-05-08T08:58:07.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:58:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:07 smithi172 ceph-mon[33377]: pgmap v4195: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 793 KiB/s wr, 45 op/s 2024-05-08T08:58:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:58:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:09 smithi070 ceph-mon[29591]: pgmap v4196: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 793 KiB/s wr, 45 op/s 2024-05-08T08:58:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:58:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:58:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:58:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:09 smithi172 ceph-mon[33377]: pgmap v4196: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 793 KiB/s wr, 45 op/s 2024-05-08T08:58:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:58:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:58:09.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:58:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:09 smithi194 ceph-mon[33679]: pgmap v4196: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 793 KiB/s wr, 45 op/s 2024-05-08T08:58:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:58:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:58:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:58:10.516 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_encoder.o 2024-05-08T08:58:11.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:11 smithi070 ceph-mon[29591]: pgmap v4197: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 765 KiB/s wr, 48 op/s 2024-05-08T08:58:11.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:11 smithi070 ceph-mon[29591]: osdmap e341: 12 total, 12 up, 12 in 2024-05-08T08:58:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:11 smithi172 ceph-mon[33377]: pgmap v4197: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 765 KiB/s wr, 48 op/s 2024-05-08T08:58:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:11 smithi172 ceph-mon[33377]: osdmap e341: 12 total, 12 up, 12 in 2024-05-08T08:58:11.732 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_file.o 2024-05-08T08:58:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:11 smithi194 ceph-mon[33679]: pgmap v4197: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 765 KiB/s wr, 48 op/s 2024-05-08T08:58:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:11 smithi194 ceph-mon[33679]: osdmap e341: 12 total, 12 up, 12 in 2024-05-08T08:58:12.579 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_fourcc.o 2024-05-08T08:58:13.214 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsicam.o 2024-05-08T08:58:13.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:13 smithi070 ceph-mon[29591]: pgmap v4199: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 863 KiB/s wr, 54 op/s 2024-05-08T08:58:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:13 smithi172 ceph-mon[33377]: pgmap v4199: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 863 KiB/s wr, 54 op/s 2024-05-08T08:58:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:13 smithi194 ceph-mon[33679]: pgmap v4199: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 863 KiB/s wr, 54 op/s 2024-05-08T08:58:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:15 smithi070 ceph-mon[29591]: pgmap v4200: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 557 KiB/s wr, 29 op/s 2024-05-08T08:58:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:15 smithi172 ceph-mon[33377]: pgmap v4200: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 557 KiB/s wr, 29 op/s 2024-05-08T08:58:15.719 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_error.o 2024-05-08T08:58:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:15 smithi194 ceph-mon[33679]: pgmap v4200: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 557 KiB/s wr, 29 op/s 2024-05-08T08:58:16.284 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_lib.o 2024-05-08T08:58:17.291 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/cpu.o 2024-05-08T08:58:17.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:17 smithi070 ceph-mon[29591]: pgmap v4201: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 814 KiB/s wr, 29 op/s 2024-05-08T08:58:17.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:17 smithi172 ceph-mon[33377]: pgmap v4201: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 814 KiB/s wr, 29 op/s 2024-05-08T08:58:17.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:17 smithi194 ceph-mon[33679]: pgmap v4201: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 814 KiB/s wr, 29 op/s 2024-05-08T08:58:18.799 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/constants.o 2024-05-08T08:58:18.817 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen7_renderclear.o 2024-05-08T08:58:19.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:19 smithi070 ceph-mon[29591]: pgmap v4202: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 814 KiB/s wr, 29 op/s 2024-05-08T08:58:19.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:19 smithi172 ceph-mon[33377]: pgmap v4202: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 814 KiB/s wr, 29 op/s 2024-05-08T08:58:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:19 smithi194 ceph-mon[33679]: pgmap v4202: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 814 KiB/s wr, 29 op/s 2024-05-08T08:58:19.804 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen8_engine_cs.o 2024-05-08T08:58:21.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:21 smithi070 ceph-mon[29591]: pgmap v4203: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 821 KiB/s wr, 31 op/s 2024-05-08T08:58:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:21 smithi172 ceph-mon[33377]: pgmap v4203: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 821 KiB/s wr, 31 op/s 2024-05-08T08:58:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:21 smithi194 ceph-mon[33679]: pgmap v4203: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 821 KiB/s wr, 31 op/s 2024-05-08T08:58:21.798 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen8_ppgtt.o 2024-05-08T08:58:21.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_lib_dma.o 2024-05-08T08:58:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:23 smithi070 ceph-mon[29591]: pgmap v4204: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 735 KiB/s wr, 28 op/s 2024-05-08T08:58:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:23 smithi172 ceph-mon[33377]: pgmap v4204: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 735 KiB/s wr, 28 op/s 2024-05-08T08:58:23.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:23 smithi194 ceph-mon[33679]: pgmap v4204: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 735 KiB/s wr, 28 op/s 2024-05-08T08:58:25.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:25 smithi070 ceph-mon[29591]: pgmap v4205: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 974 KiB/s wr, 33 op/s 2024-05-08T08:58:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:25 smithi172 ceph-mon[33377]: pgmap v4205: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 974 KiB/s wr, 33 op/s 2024-05-08T08:58:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:25 smithi194 ceph-mon[33679]: pgmap v4205: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 974 KiB/s wr, 33 op/s 2024-05-08T08:58:26.431 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_framebuffer.o 2024-05-08T08:58:26.562 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/firmware.o 2024-05-08T08:58:26.595 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/nvme/host/built-in.a 2024-05-08T08:58:26.873 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/nvme/target/built-in.a 2024-05-08T08:58:27.006 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/nvme/built-in.a 2024-05-08T08:58:27.138 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_scan.o 2024-05-08T08:58:27.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:27 smithi070 ceph-mon[29591]: pgmap v4206: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 803 KiB/s wr, 24 op/s 2024-05-08T08:58:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:27 smithi172 ceph-mon[33377]: pgmap v4206: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 803 KiB/s wr, 24 op/s 2024-05-08T08:58:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:27 smithi194 ceph-mon[33679]: pgmap v4206: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 803 KiB/s wr, 24 op/s 2024-05-08T08:58:28.155 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_gem.o 2024-05-08T08:58:29.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:29 smithi070 ceph-mon[29591]: pgmap v4207: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 575 KiB/s wr, 21 op/s 2024-05-08T08:58:29.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:29 smithi172 ceph-mon[33377]: pgmap v4207: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 575 KiB/s wr, 21 op/s 2024-05-08T08:58:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:29 smithi194 ceph-mon[33679]: pgmap v4207: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 575 KiB/s wr, 21 op/s 2024-05-08T08:58:31.485 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 15.0 2024-05-08T08:58:31.486 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:58:31.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:31 smithi070 ceph-mon[29591]: pgmap v4208: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 886 KiB/s wr, 35 op/s 2024-05-08T08:58:31.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:31 smithi172 ceph-mon[33377]: pgmap v4208: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 886 KiB/s wr, 35 op/s 2024-05-08T08:58:31.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:31 smithi194 ceph-mon[33679]: pgmap v4208: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 886 KiB/s wr, 35 op/s 2024-05-08T08:58:31.784 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_ioctl.o 2024-05-08T08:58:33.012 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-core.o 2024-05-08T08:58:33.051 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:58:33.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:33 smithi070 ceph-mon[29591]: pgmap v4209: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 612 KiB/s wr, 22 op/s 2024-05-08T08:58:33.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:33 smithi172 ceph-mon[33377]: pgmap v4209: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 612 KiB/s wr, 22 op/s 2024-05-08T08:58:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:33 smithi194 ceph-mon[33679]: pgmap v4209: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 612 KiB/s wr, 22 op/s 2024-05-08T08:58:33.973 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/init.o 2024-05-08T08:58:35.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:35 smithi172 ceph-mon[33377]: pgmap v4210: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 951 KiB/s wr, 34 op/s 2024-05-08T08:58:35.679 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/mdio-boardinfo.o 2024-05-08T08:58:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:35 smithi194 ceph-mon[33679]: pgmap v4210: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 951 KiB/s wr, 34 op/s 2024-05-08T08:58:35.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:35 smithi070 ceph-mon[29591]: pgmap v4210: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 951 KiB/s wr, 34 op/s 2024-05-08T08:58:37.672 INFO:tasks.workunit.client.0.smithi070.stdout: GEN drivers/scsi/scsi_devinfo_tbl.c 2024-05-08T08:58:37.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:37 smithi172 ceph-mon[33377]: pgmap v4211: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 661 KiB/s wr, 28 op/s 2024-05-08T08:58:37.722 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_devinfo.o 2024-05-08T08:58:37.730 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/pse-pd/built-in.a 2024-05-08T08:58:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:37 smithi194 ceph-mon[33679]: pgmap v4211: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 661 KiB/s wr, 28 op/s 2024-05-08T08:58:37.863 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_sysctl.o 2024-05-08T08:58:37.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:37 smithi070 ceph-mon[29591]: pgmap v4211: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 661 KiB/s wr, 28 op/s 2024-05-08T08:58:38.277 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_breadcrumbs.o 2024-05-08T08:58:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:39 smithi172 ceph-mon[33377]: pgmap v4212: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 650 KiB/s wr, 26 op/s 2024-05-08T08:58:39.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:39 smithi070 ceph-mon[29591]: pgmap v4212: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 650 KiB/s wr, 26 op/s 2024-05-08T08:58:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:39 smithi194 ceph-mon[33679]: pgmap v4212: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 650 KiB/s wr, 26 op/s 2024-05-08T08:58:40.145 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/mdio_devres.o 2024-05-08T08:58:40.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.942+0000 7f4705800700 1 -- 172.21.15.70:0/3398456131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 msgr2=0x7f4700105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:40.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.942+0000 7f4705800700 1 --2- 172.21.15.70:0/3398456131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 0x7f4700105b60 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f46ec009990 tx=0x7f46ec009ca0 comp rx=0 tx=0).stop 2024-05-08T08:58:40.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.942+0000 7f4705800700 1 -- 172.21.15.70:0/3398456131 shutdown_connections 2024-05-08T08:58:40.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.942+0000 7f4705800700 1 --2- 172.21.15.70:0/3398456131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47001060a0 0x7f47001125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:40.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.942+0000 7f4705800700 1 --2- 172.21.15.70:0/3398456131 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470010b6e0 0x7f470010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:40.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.942+0000 7f4705800700 1 --2- 172.21.15.70:0/3398456131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 0x7f4700105b60 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:40.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.942+0000 7f4705800700 1 -- 172.21.15.70:0/3398456131 >> 172.21.15.70:0/3398456131 conn(0x7f47001011d0 msgr2=0x7f47001035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:58:40.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.943+0000 7f4705800700 1 -- 172.21.15.70:0/3398456131 shutdown_connections 2024-05-08T08:58:40.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.943+0000 7f4705800700 1 -- 172.21.15.70:0/3398456131 wait complete. 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.944+0000 7f4705800700 1 Processor -- start 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.944+0000 7f4705800700 1 -- start start 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f4705800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 0x7f47001124c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f4705800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47001060a0 0x7f470010f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f4705800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470010b6e0 0x7f470010fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f4705800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47001157e0 con 0x7f47001056e0 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f4705800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4700115660 con 0x7f470010b6e0 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f4705800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4700115960 con 0x7f47001060a0 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f46fea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 0x7f47001124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f46fea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 0x7f47001124c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33814/0 (socket says 172.21.15.70:33814) 2024-05-08T08:58:40.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f46fea00700 1 -- 172.21.15.70:0/1209301907 learned_addr learned my addr 172.21.15.70:0/1209301907 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:58:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f46fe000700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47001060a0 0x7f470010f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:40.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.945+0000 7f46ff400700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470010b6e0 0x7f470010fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f46fea00700 1 -- 172.21.15.70:0/1209301907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47001060a0 msgr2=0x7f470010f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f46fea00700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47001060a0 0x7f470010f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f46fea00700 1 -- 172.21.15.70:0/1209301907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470010b6e0 msgr2=0x7f470010fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f46fea00700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470010b6e0 0x7f470010fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f46fea00700 1 -- 172.21.15.70:0/1209301907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47001ac4e0 con 0x7f47001056e0 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f46fea00700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 0x7f47001124c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f46f000c920 tx=0x7f46f000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f46f7400700 1 -- 172.21.15.70:0/1209301907 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0007b00 con 0x7f47001056e0 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f46f7400700 1 -- 172.21.15.70:0/1209301907 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46f0004cc0 con 0x7f47001056e0 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47001ac6b0 con 0x7f47001056e0 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.946+0000 7f46f7400700 1 -- 172.21.15.70:0/1209301907 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00054f0 con 0x7f47001056e0 2024-05-08T08:58:40.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.947+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47001acbc0 con 0x7f47001056e0 2024-05-08T08:58:40.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.948+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4700106e20 con 0x7f47001056e0 2024-05-08T08:58:40.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.951+0000 7f46f7400700 1 -- 172.21.15.70:0/1209301907 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f46f0007ca0 con 0x7f47001056e0 2024-05-08T08:58:40.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.952+0000 7f46f7400700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f46e40b29f0 0x7f46e40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:40.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.953+0000 7f46f7400700 1 -- 172.21.15.70:0/1209301907 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(341..341 src has 1..341) ==== 9583+0+0 (secure 0 0 0) 0x7f46f00e2a50 con 0x7f47001056e0 2024-05-08T08:58:40.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.953+0000 7f46fe000700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f46e40b29f0 0x7f46e40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:40.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.954+0000 7f46fe000700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f46e40b29f0 0x7f46e40b4eb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4700110d30 tx=0x7f46ec01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:58:40.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:40.957+0000 7f46f7400700 1 -- 172.21.15.70:0/1209301907 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f46f0014030 con 0x7f47001056e0 2024-05-08T08:58:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.451+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f470002e510 con 0x7f47001056e0 2024-05-08T08:58:41.451 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:58:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.452+0000 7f46f7400700 1 -- 172.21.15.70:0/1209301907 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f46f00a9fb0 con 0x7f47001056e0 2024-05-08T08:58:41.452 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:58:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f46e40b29f0 msgr2=0x7f46e40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f46e40b29f0 0x7f46e40b4eb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4700110d30 tx=0x7f46ec01a040 comp rx=0 tx=0).stop 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 msgr2=0x7f47001124c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 0x7f47001124c0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f46f000c920 tx=0x7f46f000cce0 comp rx=0 tx=0).stop 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 shutdown_connections 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f46e40b29f0 0x7f46e40b4eb0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f470010b6e0 0x7f470010fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47001056e0 0x7f47001124c0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 --2- 172.21.15.70:0/1209301907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47001060a0 0x7f470010f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 >> 172.21.15.70:0/1209301907 conn(0x7f47001011d0 msgr2=0x7f47001018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 shutdown_connections 2024-05-08T08:58:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:41.456+0000 7f4705800700 1 -- 172.21.15.70:0/1209301907 wait complete. 2024-05-08T08:58:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:58:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:41 smithi172 ceph-mon[33377]: pgmap v4213: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 915 KiB/s wr, 40 op/s 2024-05-08T08:58:41.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:41 smithi194 ceph-mon[33679]: pgmap v4213: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 915 KiB/s wr, 40 op/s 2024-05-08T08:58:41.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:41 smithi070 ceph-mon[29591]: pgmap v4213: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 915 KiB/s wr, 40 op/s 2024-05-08T08:58:42.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:42 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1209301907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:58:42.758 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:42 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1209301907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:58:42.759 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:42 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1209301907' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:58:42.815 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 75.0 --await-for 42.0' 2024-05-08T08:58:42.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 75.0 --await-for 42.0 2024-05-08T08:58:43.381 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:58:43.485 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/phy.o 2024-05-08T08:58:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:43 smithi172 ceph-mon[33377]: pgmap v4214: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 604 KiB/s wr, 26 op/s 2024-05-08T08:58:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:43 smithi194 ceph-mon[33679]: pgmap v4214: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 604 KiB/s wr, 26 op/s 2024-05-08T08:58:43.817 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/map.o 2024-05-08T08:58:43.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:43 smithi070 ceph-mon[29591]: pgmap v4214: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 742 KiB/s rd, 604 KiB/s wr, 26 op/s 2024-05-08T08:58:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:45 smithi172 ceph-mon[33377]: pgmap v4215: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 926 KiB/s wr, 34 op/s 2024-05-08T08:58:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:45 smithi194 ceph-mon[33679]: pgmap v4215: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 926 KiB/s wr, 34 op/s 2024-05-08T08:58:45.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:45 smithi070 ceph-mon[29591]: pgmap v4215: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 926 KiB/s wr, 34 op/s 2024-05-08T08:58:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.813+0000 7fa571c00700 1 -- 172.21.15.70:0/1119107903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56c1060a0 msgr2=0x7fa56c1125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.813+0000 7fa571c00700 1 --2- 172.21.15.70:0/1119107903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56c1060a0 0x7fa56c1125b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fa564009f90 tx=0x7fa56400b330 comp rx=0 tx=0).stop 2024-05-08T08:58:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.813+0000 7fa571c00700 1 -- 172.21.15.70:0/1119107903 shutdown_connections 2024-05-08T08:58:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.813+0000 7fa571c00700 1 --2- 172.21.15.70:0/1119107903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56c1060a0 0x7fa56c1125b0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.813+0000 7fa571c00700 1 --2- 172.21.15.70:0/1119107903 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa56c10b6e0 0x7fa56c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.813+0000 7fa571c00700 1 --2- 172.21.15.70:0/1119107903 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa56c1056e0 0x7fa56c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.813+0000 7fa571c00700 1 -- 172.21.15.70:0/1119107903 >> 172.21.15.70:0/1119107903 conn(0x7fa56c1011d0 msgr2=0x7fa56c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:58:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.813+0000 7fa571c00700 1 -- 172.21.15.70:0/1119107903 shutdown_connections 2024-05-08T08:58:46.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.813+0000 7fa571c00700 1 -- 172.21.15.70:0/1119107903 wait complete. 2024-05-08T08:58:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.815+0000 7fa571c00700 1 Processor -- start 2024-05-08T08:58:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.815+0000 7fa571c00700 1 -- start start 2024-05-08T08:58:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.815+0000 7fa571c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa56c1056e0 0x7fa56c1a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.815+0000 7fa571c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa56c1060a0 0x7fa56c1a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.815+0000 7fa571c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56c10b6e0 0x7fa56c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.815+0000 7fa571c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1157d0 con 0x7fa56c10b6e0 2024-05-08T08:58:46.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.815+0000 7fa571c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c115650 con 0x7fa56c1060a0 2024-05-08T08:58:46.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.815+0000 7fa571c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c115950 con 0x7fa56c1056e0 2024-05-08T08:58:46.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.816+0000 7fa56aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa56c1056e0 0x7fa56c1a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.816+0000 7fa56a000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa56c1060a0 0x7fa56c1a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.816+0000 7fa56aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa56c1056e0 0x7fa56c1a17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:50522/0 (socket says 172.21.15.70:50522) 2024-05-08T08:58:46.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.816+0000 7fa56aa00700 1 -- 172.21.15.70:0/83426492 learned_addr learned my addr 172.21.15.70:0/83426492 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:58:46.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.816+0000 7fa56b400700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56c10b6e0 0x7fa56c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.817+0000 7fa56b400700 1 -- 172.21.15.70:0/83426492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa56c1056e0 msgr2=0x7fa56c1a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.817+0000 7fa56b400700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa56c1056e0 0x7fa56c1a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.817+0000 7fa56b400700 1 -- 172.21.15.70:0/83426492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa56c1060a0 msgr2=0x7fa56c1a1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.817+0000 7fa56b400700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa56c1060a0 0x7fa56c1a1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.817+0000 7fa56b400700 1 -- 172.21.15.70:0/83426492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c19c110 con 0x7fa56c10b6e0 2024-05-08T08:58:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.817+0000 7fa56aa00700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa56c1056e0 0x7fa56c1a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:58:46.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.817+0000 7fa56b400700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56c10b6e0 0x7fa56c19b9b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fa56400b6c0 tx=0x7fa56400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:58:46.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.818+0000 7fa563400700 1 -- 172.21.15.70:0/83426492 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564021070 con 0x7fa56c10b6e0 2024-05-08T08:58:46.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.818+0000 7fa563400700 1 -- 172.21.15.70:0/83426492 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa564007ac0 con 0x7fa56c10b6e0 2024-05-08T08:58:46.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.818+0000 7fa563400700 1 -- 172.21.15.70:0/83426492 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564005040 con 0x7fa56c10b6e0 2024-05-08T08:58:46.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.818+0000 7fa571c00700 1 -- 172.21.15.70:0/83426492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c19c3a0 con 0x7fa56c10b6e0 2024-05-08T08:58:46.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.818+0000 7fa571c00700 1 -- 172.21.15.70:0/83426492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c1a86c0 con 0x7fa56c10b6e0 2024-05-08T08:58:46.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.823+0000 7fa563400700 1 -- 172.21.15.70:0/83426492 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa564024070 con 0x7fa56c10b6e0 2024-05-08T08:58:46.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.825+0000 7fa563400700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5500b2ba0 0x7fa5500b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.826+0000 7fa563400700 1 -- 172.21.15.70:0/83426492 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(341..341 src has 1..341) ==== 9583+0+0 (secure 0 0 0) 0x7fa56400f020 con 0x7fa56c10b6e0 2024-05-08T08:58:46.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.826+0000 7fa56aa00700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5500b2ba0 0x7fa5500b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.827+0000 7fa56aa00700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5500b2ba0 0x7fa5500b5060 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa56c19caf0 tx=0x7fa55c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:58:46.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.850+0000 7fa57c4c4b80 1 Processor -- start 2024-05-08T08:58:46.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.850+0000 7fa57c4c4b80 1 -- start start 2024-05-08T08:58:46.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec3c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec369a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec42d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ed9eb88bb0 con 0x55ed9ec3bf50 2024-05-08T08:58:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ed9eb268f0 con 0x55ed9ec36ee0 2024-05-08T08:58:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ed9eb84b70 con 0x55ed9ec36520 2024-05-08T08:58:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa56aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec3c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa56aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec3c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33840/0 (socket says 172.21.15.70:33840) 2024-05-08T08:58:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa56aa00700 1 -- 172.21.15.70:0/4292801471 learned_addr learned my addr 172.21.15.70:0/4292801471 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:58:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.851+0000 7fa56b400700 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec42d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.852+0000 7fa56a000700 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.852+0000 7fa56a000700 1 -- 172.21.15.70:0/4292801471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 msgr2=0x55ed9ec42d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:58:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.852+0000 7fa56a000700 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec42d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.852+0000 7fa56a000700 1 -- 172.21.15.70:0/4292801471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 msgr2=0x55ed9ec3c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:58:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.852+0000 7fa56a000700 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec3c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.852+0000 7fa56a000700 1 -- 172.21.15.70:0/4292801471 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed9ead5a60 con 0x55ed9ec36520 2024-05-08T08:58:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.852+0000 7fa56aa00700 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec3c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:58:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.853+0000 7fa56a000700 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec369a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa558005fd0 tx=0x7fa558011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb69ac7ddfd3b790 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:58:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.853+0000 7fa557e00700 1 -- 172.21.15.70:0/4292801471 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558011cc0 con 0x55ed9ec36520 2024-05-08T08:58:46.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.853+0000 7fa557e00700 1 -- 172.21.15.70:0/4292801471 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5580044e0 con 0x55ed9ec36520 2024-05-08T08:58:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.853+0000 7fa557e00700 1 -- 172.21.15.70:0/4292801471 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa558005280 con 0x55ed9ec36520 2024-05-08T08:58:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.854+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/4292801471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 msgr2=0x55ed9ec369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:46.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.854+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec369a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa558005fd0 tx=0x7fa558011440 comp rx=0 tx=0).stop 2024-05-08T08:58:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.855+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/4292801471 shutdown_connections 2024-05-08T08:58:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.855+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec42d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.855+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec3c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.855+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/4292801471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec369a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.855+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/4292801471 >> 172.21.15.70:0/4292801471 conn(0x55ed9eb64cf0 msgr2=0x55ed9ec30e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:58:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.855+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/4292801471 shutdown_connections 2024-05-08T08:58:46.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.855+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/4292801471 wait complete. 2024-05-08T08:58:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.856+0000 7fa57c4c4b80 1 -- start start 2024-05-08T08:58:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.856+0000 7fa57c4c4b80 1 Processor -- start 2024-05-08T08:58:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.856+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec36520 0x55ed9ec428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.856+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec3fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.856+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec40220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.857+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ed9ec43310 con 0x55ed9ec36520 2024-05-08T08:58:46.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.857+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ed9eaeecb0 con 0x55ed9ec3bf50 2024-05-08T08:58:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.857+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ed9ec43490 con 0x55ed9ec36ee0 2024-05-08T08:58:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.857+0000 7fa57c4c4b80 10 client.0 _ll_register_callbacks cb 0x55ed9eb2fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:58:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.857+0000 7fa56aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec36520 0x55ed9ec428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.857+0000 7fa56aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec36520 0x55ed9ec428f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33850/0 (socket says 172.21.15.70:33850) 2024-05-08T08:58:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.857+0000 7fa56aa00700 1 -- 172.21.15.70:0/1174681546 learned_addr learned my addr 172.21.15.70:0/1174681546 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:58:46.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.857+0000 7fa56b400700 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec40220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.858+0000 7fa56aa00700 1 -- 172.21.15.70:0/1174681546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36ee0 msgr2=0x55ed9ec3fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:58:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.858+0000 7fa56aa00700 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec3fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.858+0000 7fa56aa00700 1 -- 172.21.15.70:0/1174681546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec3bf50 msgr2=0x55ed9ec40220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:58:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.858+0000 7fa56aa00700 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec40220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.858+0000 7fa56aa00700 1 -- 172.21.15.70:0/1174681546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed9eb4e5b0 con 0x55ed9ec36520 2024-05-08T08:58:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.858+0000 7fa56aa00700 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec36520 0x55ed9ec428f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fa55c003b50 tx=0x7fa55c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b580fb2377ea7dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:58:46.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.858+0000 7fa554c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:58:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.859+0000 7fa554c00700 1 -- 172.21.15.70:0/1174681546 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa55c011e60 con 0x55ed9ec36520 2024-05-08T08:58:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.859+0000 7fa554c00700 1 -- 172.21.15.70:0/1174681546 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(341..341 src has 1..341) ==== 9583+0+0 (secure 0 0 0) 0x7fa55c01fad0 con 0x55ed9ec36520 2024-05-08T08:58:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.859+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/1174681546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5580044e0 con 0x55ed9ec36520 2024-05-08T08:58:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.859+0000 7fa554c00700 1 -- 172.21.15.70:0/1174681546 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa55c01fd10 con 0x55ed9ec36520 2024-05-08T08:58:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.859+0000 7fa57c4c4b80 10 client.18867 fetch_fsmap learned FSMap version 42 2024-05-08T08:58:46.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.859+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/1174681546 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ed9ec4dba0 con 0x55ed9ec36520 2024-05-08T08:58:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.860+0000 7fa554c00700 1 -- 172.21.15.70:0/1174681546 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5580044e0 con 0x55ed9ec36520 2024-05-08T08:58:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.860+0000 7fa554c00700 1 -- 172.21.15.70:0/1174681546 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa55c026070 con 0x55ed9ec36520 2024-05-08T08:58:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.860+0000 7fa57c4c4b80 10 client.18867 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:58:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.860+0000 7fa57c4c4b80 10 client.18867 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:58:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.860+0000 7fa57c4c4b80 20 client.18867 populate_metadata read hostname 'smithi070' 2024-05-08T08:58:46.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.860+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ed9ec50280 0x55ed9ec526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.860+0000 7fa57c4c4b80 4 client.18867 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:58:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.860+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/1174681546 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed9ec03230 con 0x55ed9ec50280 2024-05-08T08:58:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.861+0000 7fa56a000700 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ed9ec50280 0x55ed9ec526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.862+0000 7fa56a000700 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ed9ec50280 0x55ed9ec526f0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7d3642a4f608421 server_cookie=de6789de457e2a70 in_seq=0 out_seq=0 2024-05-08T08:58:46.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.862+0000 7fa554c00700 10 client.18867 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:58:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.864+0000 7fa554c00700 1 -- 172.21.15.70:0/1174681546 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ed9ec03230 con 0x55ed9ec50280 2024-05-08T08:58:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.864+0000 7fa554c00700 10 client.18867 handle_command_reply: tid=0 2024-05-08T08:58:46.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 client.18867 shutdown 2024-05-08T08:58:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/1174681546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec36520 msgr2=0x55ed9ec428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec36520 0x55ed9ec428f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fa55c003b50 tx=0x7fa55c0047c0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/1174681546 shutdown_connections 2024-05-08T08:58:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ed9ec50280 0x55ed9ec526f0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec40220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec36520 0x55ed9ec428f0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/1174681546 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec3fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa554c00700 0 client.18867 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:58:46.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/1174681546 >> 172.21.15.70:0/1174681546 conn(0x55ed9eb64cf0 msgr2=0x55ed9ec2b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:58:46.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/1174681546 shutdown_connections 2024-05-08T08:58:46.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.865+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/1174681546 wait complete. 2024-05-08T08:58:46.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.866+0000 7fa57c4c4b80 20 client.18867 trim_cache size 0 max 16384 2024-05-08T08:58:46.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.899+0000 7fa57c4c4b80 1 Processor -- start 2024-05-08T08:58:46.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.900+0000 7fa57c4c4b80 1 -- start start 2024-05-08T08:58:46.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.900+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36520 0x55ed9ec4c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.900+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec2b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.900+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec58000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.900+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1b3ee0 con 0x55ed9ec3bf50 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.900+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1b1770 con 0x55ed9ec36520 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.900+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1af5e0 con 0x55ed9ec36ee0 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.900+0000 7fa56b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec58000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.901+0000 7fa56b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec58000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33864/0 (socket says 172.21.15.70:33864) 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.901+0000 7fa56b400700 1 -- 172.21.15.70:0/3287108348 learned_addr learned my addr 172.21.15.70:0/3287108348 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.901+0000 7fa56aa00700 1 --2- 172.21.15.70:0/3287108348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36520 0x55ed9ec4c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.901+0000 7fa56a000700 1 --2- 172.21.15.70:0/3287108348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec2b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.901+0000 7fa56b400700 1 -- 172.21.15.70:0/3287108348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36ee0 msgr2=0x55ed9ec2b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:58:46.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.901+0000 7fa56b400700 1 --2- 172.21.15.70:0/3287108348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec2b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.901+0000 7fa56b400700 1 -- 172.21.15.70:0/3287108348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36520 msgr2=0x55ed9ec4c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:58:46.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.901+0000 7fa56b400700 1 --2- 172.21.15.70:0/3287108348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36520 0x55ed9ec4c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.901+0000 7fa56b400700 1 -- 172.21.15.70:0/3287108348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed9ec2da10 con 0x55ed9ec3bf50 2024-05-08T08:58:46.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.902+0000 7fa56b400700 1 --2- 172.21.15.70:0/3287108348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec58000 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fa5640a69e0 tx=0x7fa564009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23834c00740e79f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:58:46.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.903+0000 7fa557400700 1 -- 172.21.15.70:0/3287108348 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640aa470 con 0x55ed9ec3bf50 2024-05-08T08:58:46.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.903+0000 7fa557400700 1 -- 172.21.15.70:0/3287108348 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5640ab060 con 0x55ed9ec3bf50 2024-05-08T08:58:46.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.903+0000 7fa557400700 1 -- 172.21.15.70:0/3287108348 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640b10c0 con 0x55ed9ec3bf50 2024-05-08T08:58:46.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.903+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/3287108348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 msgr2=0x55ed9ec58000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:58:46.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.903+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/3287108348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec58000 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fa5640a69e0 tx=0x7fa564009040 comp rx=0 tx=0).stop 2024-05-08T08:58:46.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.904+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/3287108348 shutdown_connections 2024-05-08T08:58:46.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.904+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/3287108348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec58000 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.904+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/3287108348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36520 0x55ed9ec4c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.904+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/3287108348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec2b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.904+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/3287108348 >> 172.21.15.70:0/3287108348 conn(0x55ed9eb64cf0 msgr2=0x55ed9ec2b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:58:46.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.904+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/3287108348 shutdown_connections 2024-05-08T08:58:46.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.905+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/3287108348 wait complete. 2024-05-08T08:58:46.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.905+0000 7fa57c4c4b80 1 -- start start 2024-05-08T08:58:46.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.905+0000 7fa57c4c4b80 1 Processor -- start 2024-05-08T08:58:46.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.906+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec436a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.906+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec43be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.906+0000 7fa57c4c4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec44120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.906+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1afc30 con 0x55ed9ec3bf50 2024-05-08T08:58:46.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.906+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1b10a0 con 0x55ed9ec36ee0 2024-05-08T08:58:46.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.906+0000 7fa57c4c4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c1b0300 con 0x55ed9ec36520 2024-05-08T08:58:46.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.906+0000 7fa57c4c4b80 10 client.0 _ll_register_callbacks cb 0x55ed9eb2fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:58:46.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec44120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56a000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec43be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56a000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec43be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:33030/0 (socket says 172.21.15.70:33030) 2024-05-08T08:58:46.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56a000700 1 -- 172.21.15.70:0/147886164 learned_addr learned my addr 172.21.15.70:0/147886164 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56b400700 1 -- 172.21.15.70:0/147886164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 msgr2=0x55ed9ec436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56b400700 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56b400700 1 -- 172.21.15.70:0/147886164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 msgr2=0x55ed9ec43be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56b400700 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec43be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.907+0000 7fa56b400700 1 -- 172.21.15.70:0/147886164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed9ecc3540 con 0x55ed9ec3bf50 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.908+0000 7fa56aa00700 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.908+0000 7fa56a000700 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec43be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.908+0000 7fa56b400700 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec44120 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fa5640a69e0 tx=0x7fa5640cd300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e8965bae2f962 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.908+0000 7fa554c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:58:46.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.908+0000 7fa554c00700 1 -- 172.21.15.70:0/147886164 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5640b1260 con 0x55ed9ec3bf50 2024-05-08T08:58:46.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.908+0000 7fa554c00700 1 -- 172.21.15.70:0/147886164 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(341..341 src has 1..341) ==== 9583+0+0 (secure 0 0 0) 0x7fa5640a6f50 con 0x55ed9ec3bf50 2024-05-08T08:58:46.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.908+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/147886164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5640ab060 con 0x55ed9ec3bf50 2024-05-08T08:58:46.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.909+0000 7fa554c00700 1 -- 172.21.15.70:0/147886164 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa5640aed10 con 0x55ed9ec3bf50 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.909+0000 7fa57c4c4b80 10 client.18873 fetch_fsmap learned FSMap version 42 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.909+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/147886164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ed9ecc47e0 con 0x55ed9ec3bf50 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.909+0000 7fa554c00700 1 -- 172.21.15.70:0/147886164 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5640ab060 con 0x55ed9ec3bf50 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.909+0000 7fa554c00700 1 -- 172.21.15.70:0/147886164 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa564011070 con 0x55ed9ec3bf50 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.910+0000 7fa57c4c4b80 10 client.18873 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.910+0000 7fa57c4c4b80 10 client.18873 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.910+0000 7fa57c4c4b80 20 client.18873 populate_metadata read hostname 'smithi070' 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.910+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ed9ecc4e40 0x55ed9ecc7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.910+0000 7fa57c4c4b80 4 client.18873 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.0, "await_for": 42.0}] 2024-05-08T08:58:46.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.910+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/147886164 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 75.0, "await_for": 42.0}) -- 0x55ed9eb96590 con 0x55ed9ecc4e40 2024-05-08T08:58:46.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.911+0000 7fa56aa00700 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ed9ecc4e40 0x55ed9ecc7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:58:46.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.912+0000 7fa56aa00700 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ed9ecc4e40 0x55ed9ecc7260 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df6c45c47d032df7 server_cookie=e01607978c447049 in_seq=0 out_seq=0 2024-05-08T08:58:46.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:58:46.912+0000 7fa554c00700 10 client.18873 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:58:47.291 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_proc.o 2024-05-08T08:58:47.459 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_debugfs.o 2024-05-08T08:58:47.570 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-scsi.o 2024-05-08T08:58:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:47 smithi194 ceph-mon[33679]: pgmap v4216: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 591 KiB/s wr, 24 op/s 2024-05-08T08:58:47.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:47 smithi070 ceph-mon[29591]: pgmap v4216: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 591 KiB/s wr, 24 op/s 2024-05-08T08:58:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:47 smithi172 ceph-mon[33377]: pgmap v4216: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 591 KiB/s wr, 24 op/s 2024-05-08T08:58:48.265 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/phy-c45.o 2024-05-08T08:58:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:49 smithi194 ceph-mon[33679]: pgmap v4217: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 590 KiB/s wr, 23 op/s 2024-05-08T08:58:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:49 smithi070 ceph-mon[29591]: pgmap v4217: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 590 KiB/s wr, 23 op/s 2024-05-08T08:58:49.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:49 smithi172 ceph-mon[33377]: pgmap v4217: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 590 KiB/s wr, 23 op/s 2024-05-08T08:58:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:51 smithi194 ceph-mon[33679]: pgmap v4218: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 40 op/s 2024-05-08T08:58:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:51 smithi070 ceph-mon[29591]: pgmap v4218: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 40 op/s 2024-05-08T08:58:51.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:51 smithi172 ceph-mon[33377]: pgmap v4218: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 40 op/s 2024-05-08T08:58:53.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:53 smithi194 ceph-mon[33679]: pgmap v4219: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 852 KiB/s wr, 26 op/s 2024-05-08T08:58:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:53 smithi070 ceph-mon[29591]: pgmap v4219: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 852 KiB/s wr, 26 op/s 2024-05-08T08:58:53.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:53 smithi172 ceph-mon[33377]: pgmap v4219: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 852 KiB/s wr, 26 op/s 2024-05-08T08:58:55.730 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:55 smithi172 ceph-mon[33377]: pgmap v4220: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 916 KiB/s wr, 30 op/s 2024-05-08T08:58:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:55 smithi194 ceph-mon[33679]: pgmap v4220: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 916 KiB/s wr, 30 op/s 2024-05-08T08:58:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:55 smithi070 ceph-mon[29591]: pgmap v4220: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 916 KiB/s wr, 30 op/s 2024-05-08T08:58:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:57 smithi194 ceph-mon[33679]: pgmap v4221: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 594 KiB/s wr, 22 op/s 2024-05-08T08:58:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:57 smithi070 ceph-mon[29591]: pgmap v4221: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 594 KiB/s wr, 22 op/s 2024-05-08T08:58:57.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:57 smithi172 ceph-mon[33377]: pgmap v4221: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 594 KiB/s wr, 22 op/s 2024-05-08T08:58:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:58:59 smithi194 ceph-mon[33679]: pgmap v4222: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 590 KiB/s wr, 21 op/s 2024-05-08T08:58:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:58:59 smithi070 ceph-mon[29591]: pgmap v4222: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 590 KiB/s wr, 21 op/s 2024-05-08T08:58:59.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:58:59 smithi172 ceph-mon[33377]: pgmap v4222: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 549 KiB/s rd, 590 KiB/s wr, 21 op/s 2024-05-08T08:59:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:01 smithi194 ceph-mon[33679]: pgmap v4223: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 593 KiB/s wr, 25 op/s 2024-05-08T08:59:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:01 smithi070 ceph-mon[29591]: pgmap v4223: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 593 KiB/s wr, 25 op/s 2024-05-08T08:59:01.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:01 smithi172 ceph-mon[33377]: pgmap v4223: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 593 KiB/s wr, 25 op/s 2024-05-08T08:59:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:03 smithi194 ceph-mon[33679]: pgmap v4224: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 68 KiB/s wr, 8 op/s 2024-05-08T08:59:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:03 smithi070 ceph-mon[29591]: pgmap v4224: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 68 KiB/s wr, 8 op/s 2024-05-08T08:59:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:03 smithi172 ceph-mon[33377]: pgmap v4224: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 68 KiB/s wr, 8 op/s 2024-05-08T08:59:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:05 smithi194 ceph-mon[33679]: pgmap v4225: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 17 op/s 2024-05-08T08:59:05.799 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:05 smithi070 ceph-mon[29591]: pgmap v4225: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 17 op/s 2024-05-08T08:59:05.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:05 smithi172 ceph-mon[33377]: pgmap v4225: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 197 KiB/s wr, 17 op/s 2024-05-08T08:59:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:07 smithi194 ceph-mon[33679]: pgmap v4226: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 132 KiB/s wr, 14 op/s 2024-05-08T08:59:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:07 smithi070 ceph-mon[29591]: pgmap v4226: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 132 KiB/s wr, 14 op/s 2024-05-08T08:59:07.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:07 smithi172 ceph-mon[33377]: pgmap v4226: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 132 KiB/s wr, 14 op/s 2024-05-08T08:59:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:09 smithi194 ceph-mon[33679]: pgmap v4227: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 132 KiB/s wr, 13 op/s 2024-05-08T08:59:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:09 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:59:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:09 smithi070 ceph-mon[29591]: pgmap v4227: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 132 KiB/s wr, 13 op/s 2024-05-08T08:59:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:09 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:59:09.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:09 smithi172 ceph-mon[33377]: pgmap v4227: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 132 KiB/s wr, 13 op/s 2024-05-08T08:59:09.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:09 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T08:59:10.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.136+0000 7fa554c00700 1 -- 172.21.15.70:0/147886164 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55ed9eb96590 con 0x55ed9ecc4e40 2024-05-08T08:59:10.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.136+0000 7fa554c00700 10 client.18873 handle_command_reply: tid=0 2024-05-08T08:59:10.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.136+0000 7fa57c4c4b80 1 client.18873 shutdown 2024-05-08T08:59:10.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.137+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/147886164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 msgr2=0x55ed9ec44120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:10.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.137+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec44120 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fa5640a69e0 tx=0x7fa5640cd300 comp rx=0 tx=0).stop 2024-05-08T08:59:10.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.138+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/147886164 shutdown_connections 2024-05-08T08:59:10.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.138+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ed9ecc4e40 0x55ed9ecc7260 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:10.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.138+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed9ec3bf50 0x55ed9ec44120 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:10.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.138+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ed9ec36520 0x55ed9ec436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:10.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.138+0000 7fa57c4c4b80 1 --2- 172.21.15.70:0/147886164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ed9ec36ee0 0x55ed9ec43be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:10.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.138+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/147886164 >> 172.21.15.70:0/147886164 conn(0x55ed9eb64cf0 msgr2=0x55ed9ec2b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:10.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.138+0000 7fa554c00700 0 client.18873 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:59:10.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.138+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/147886164 shutdown_connections 2024-05-08T08:59:10.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.138+0000 7fa57c4c4b80 1 -- 172.21.15.70:0/147886164 wait complete. 2024-05-08T08:59:10.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.139+0000 7fa57c4c4b80 20 client.18873 trim_cache size 0 max 16384 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 294, 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "72f1f569": { 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 294, 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:59:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:59:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:59:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:59:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:59:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 75.0, 2024-05-08T08:59:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:59:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:59:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:59:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:59:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T08:59:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:59:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:10.141 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:59:10.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.140+0000 7fa571c00700 1 -- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5500b2ba0 msgr2=0x7fa5500b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:10.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.140+0000 7fa571c00700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5500b2ba0 0x7fa5500b5060 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa56c19caf0 tx=0x7fa55c009260 comp rx=0 tx=0).stop 2024-05-08T08:59:10.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.140+0000 7fa571c00700 1 -- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56c10b6e0 msgr2=0x7fa56c19b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:10.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.140+0000 7fa571c00700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56c10b6e0 0x7fa56c19b9b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7fa56400b6c0 tx=0x7fa56400cc30 comp rx=0 tx=0).stop 2024-05-08T08:59:10.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.142+0000 7fa571c00700 1 -- 172.21.15.70:0/83426492 shutdown_connections 2024-05-08T08:59:10.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.142+0000 7fa571c00700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa5500b2ba0 0x7fa5500b5060 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:10.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.142+0000 7fa571c00700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa56c10b6e0 0x7fa56c19b9b0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:10.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.142+0000 7fa571c00700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa56c1056e0 0x7fa56c1a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:10.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.142+0000 7fa571c00700 1 --2- 172.21.15.70:0/83426492 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa56c1060a0 0x7fa56c1a1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:10.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.142+0000 7fa571c00700 1 -- 172.21.15.70:0/83426492 >> 172.21.15.70:0/83426492 conn(0x7fa56c1011d0 msgr2=0x7fa56c1016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:10.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.143+0000 7fa571c00700 1 -- 172.21.15.70:0/83426492 shutdown_connections 2024-05-08T08:59:10.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:10.143+0000 7fa571c00700 1 -- 172.21.15.70:0/83426492 wait complete. 2024-05-08T08:59:11.105 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '72f1f569', quiesce took 39.6 seconds. Will release after: 15.0 2024-05-08T08:59:11.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:11 smithi070 ceph-mon[29591]: pgmap v4228: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 223 KiB/s wr, 33 op/s 2024-05-08T08:59:11.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:11 smithi172 ceph-mon[33377]: pgmap v4228: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 223 KiB/s wr, 33 op/s 2024-05-08T08:59:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:11 smithi194 ceph-mon[33679]: pgmap v4228: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 223 KiB/s wr, 33 op/s 2024-05-08T08:59:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:59:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:59:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:59:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:59:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:59:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:59:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T08:59:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T08:59:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T08:59:13.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:13 smithi070 ceph-mon[29591]: pgmap v4229: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 220 KiB/s wr, 28 op/s 2024-05-08T08:59:13.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:13 smithi172 ceph-mon[33377]: pgmap v4229: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 220 KiB/s wr, 28 op/s 2024-05-08T08:59:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:13 smithi194 ceph-mon[33679]: pgmap v4229: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 220 KiB/s wr, 28 op/s 2024-05-08T08:59:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:15 smithi070 ceph-mon[29591]: pgmap v4230: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 315 KiB/s wr, 32 op/s 2024-05-08T08:59:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:15 smithi070 ceph-mon[29591]: osdmap e342: 12 total, 12 up, 12 in 2024-05-08T08:59:15.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:15 smithi172 ceph-mon[33377]: pgmap v4230: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 315 KiB/s wr, 32 op/s 2024-05-08T08:59:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:15 smithi172 ceph-mon[33377]: osdmap e342: 12 total, 12 up, 12 in 2024-05-08T08:59:16.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:15 smithi194 ceph-mon[33679]: pgmap v4230: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 315 KiB/s wr, 32 op/s 2024-05-08T08:59:16.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:15 smithi194 ceph-mon[33679]: osdmap e342: 12 total, 12 up, 12 in 2024-05-08T08:59:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:17 smithi070 ceph-mon[29591]: pgmap v4232: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 224 KiB/s wr, 28 op/s 2024-05-08T08:59:17.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:17 smithi172 ceph-mon[33377]: pgmap v4232: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 224 KiB/s wr, 28 op/s 2024-05-08T08:59:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:17 smithi194 ceph-mon[33679]: pgmap v4232: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 224 KiB/s wr, 28 op/s 2024-05-08T08:59:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:19 smithi070 ceph-mon[29591]: pgmap v4233: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 224 KiB/s wr, 28 op/s 2024-05-08T08:59:19.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:19 smithi172 ceph-mon[33377]: pgmap v4233: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 224 KiB/s wr, 28 op/s 2024-05-08T08:59:20.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:19 smithi194 ceph-mon[33679]: pgmap v4233: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 224 KiB/s wr, 28 op/s 2024-05-08T08:59:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:21 smithi070 ceph-mon[29591]: pgmap v4234: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 9 op/s 2024-05-08T08:59:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:21 smithi070 ceph-mon[29591]: osdmap e343: 12 total, 12 up, 12 in 2024-05-08T08:59:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:21 smithi172 ceph-mon[33377]: pgmap v4234: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 9 op/s 2024-05-08T08:59:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:21 smithi172 ceph-mon[33377]: osdmap e343: 12 total, 12 up, 12 in 2024-05-08T08:59:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:21 smithi194 ceph-mon[33679]: pgmap v4234: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 187 KiB/s rd, 185 KiB/s wr, 9 op/s 2024-05-08T08:59:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:21 smithi194 ceph-mon[33679]: osdmap e343: 12 total, 12 up, 12 in 2024-05-08T08:59:23.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:23 smithi070 ceph-mon[29591]: pgmap v4236: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2024-05-08T08:59:23.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:23 smithi172 ceph-mon[33377]: pgmap v4236: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2024-05-08T08:59:24.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:23 smithi194 ceph-mon[33679]: pgmap v4236: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 88 KiB/s wr, 6 op/s 2024-05-08T08:59:25.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:25 smithi070 ceph-mon[29591]: pgmap v4237: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 153 KiB/s wr, 7 op/s 2024-05-08T08:59:25.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:25 smithi172 ceph-mon[33377]: pgmap v4237: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 153 KiB/s wr, 7 op/s 2024-05-08T08:59:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:25 smithi194 ceph-mon[33679]: pgmap v4237: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 153 KiB/s wr, 7 op/s 2024-05-08T08:59:26.106 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T08:59:26.554 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:59:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:27 smithi070 ceph-mon[29591]: pgmap v4238: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 7 op/s 2024-05-08T08:59:27.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:27 smithi172 ceph-mon[33377]: pgmap v4238: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 7 op/s 2024-05-08T08:59:28.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:27 smithi194 ceph-mon[33679]: pgmap v4238: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 7 op/s 2024-05-08T08:59:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.925+0000 7f715ac00700 1 -- 172.21.15.70:0/3703007130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7154103d90 msgr2=0x7f71541102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.925+0000 7f715ac00700 1 --2- 172.21.15.70:0/3703007130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7154103d90 0x7f71541102a0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f714c00b0a0 tx=0x7f714c00b3b0 comp rx=0 tx=0).stop 2024-05-08T08:59:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.926+0000 7f715ac00700 1 -- 172.21.15.70:0/3703007130 shutdown_connections 2024-05-08T08:59:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.926+0000 7f715ac00700 1 --2- 172.21.15.70:0/3703007130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7154103d90 0x7f71541102a0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:28.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.926+0000 7f715ac00700 1 --2- 172.21.15.70:0/3703007130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7154109460 0x7f7154109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:28.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.926+0000 7f715ac00700 1 --2- 172.21.15.70:0/3703007130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f71541033d0 0x7f7154103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:28.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.926+0000 7f715ac00700 1 -- 172.21.15.70:0/3703007130 >> 172.21.15.70:0/3703007130 conn(0x7f71540fef20 msgr2=0x7f7154101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:28.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.926+0000 7f715ac00700 1 -- 172.21.15.70:0/3703007130 shutdown_connections 2024-05-08T08:59:28.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.926+0000 7f715ac00700 1 -- 172.21.15.70:0/3703007130 wait complete. 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.927+0000 7f715ac00700 1 Processor -- start 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.927+0000 7f715ac00700 1 -- start start 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.927+0000 7f715ac00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71541033d0 0x7f71541a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.927+0000 7f715ac00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7154103d90 0x7f71541a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.927+0000 7f715ac00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7154109460 0x7f715419b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.927+0000 7f715ac00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7154113470 con 0x7f71541033d0 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.927+0000 7f715ac00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f71541132f0 con 0x7f7154109460 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.927+0000 7f715ac00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f71541135f0 con 0x7f7154103d90 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7159800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71541033d0 0x7f71541a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7159800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71541033d0 0x7f71541a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39844/0 (socket says 172.21.15.70:39844) 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7159800700 1 -- 172.21.15.70:0/3241224385 learned_addr learned my addr 172.21.15.70:0/3241224385 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:59:28.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7159800700 1 -- 172.21.15.70:0/3241224385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7154103d90 msgr2=0x7f71541a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7158e00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7154103d90 0x7f71541a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f715a200700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7154109460 0x7f715419b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7159800700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7154103d90 0x7f71541a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7159800700 1 -- 172.21.15.70:0/3241224385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7154109460 msgr2=0x7f715419b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7159800700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7154109460 0x7f715419b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7159800700 1 -- 172.21.15.70:0/3241224385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715419c0f0 con 0x7f71541033d0 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.928+0000 7f7158e00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7154103d90 0x7f71541a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.929+0000 7f7159800700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71541033d0 0x7f71541a17d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f714800c920 tx=0x7f714800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.929+0000 7f7152000700 1 -- 172.21.15.70:0/3241224385 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148007b00 con 0x7f71541033d0 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.929+0000 7f7152000700 1 -- 172.21.15.70:0/3241224385 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7148004cc0 con 0x7f71541033d0 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.929+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715419c380 con 0x7f71541033d0 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.929+0000 7f7152000700 1 -- 172.21.15.70:0/3241224385 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71480054f0 con 0x7f71541033d0 2024-05-08T08:59:28.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.929+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541a86a0 con 0x7f71541033d0 2024-05-08T08:59:28.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.930+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715406a190 con 0x7f71541033d0 2024-05-08T08:59:28.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.933+0000 7f7152000700 1 -- 172.21.15.70:0/3241224385 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7148007ca0 con 0x7f71541033d0 2024-05-08T08:59:28.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.934+0000 7f7152000700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f713c0b29f0 0x7f713c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:28.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.934+0000 7f7152000700 1 -- 172.21.15.70:0/3241224385 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(343..343 src has 1..343) ==== 9583+0+0 (secure 0 0 0) 0x7f71480e2660 con 0x7f71541033d0 2024-05-08T08:59:28.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.934+0000 7f7158e00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f713c0b29f0 0x7f713c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:28.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.935+0000 7f7158e00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f713c0b29f0 0x7f713c0b4eb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7140005fd0 tx=0x7f7140005ee0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:59:28.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:28.939+0000 7f7152000700 1 -- 172.21.15.70:0/3241224385 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7148014030 con 0x7f71541033d0 2024-05-08T08:59:29.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.221+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71541a88d0 con 0x7f71541033d0 2024-05-08T08:59:29.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.223+0000 7f7152000700 1 -- 172.21.15.70:0/3241224385 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f71480a9bc0 con 0x7f71541033d0 2024-05-08T08:59:29.223 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T08:59:29.223 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T08:59:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f713c0b29f0 msgr2=0x7f713c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f713c0b29f0 0x7f713c0b4eb0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7140005fd0 tx=0x7f7140005ee0 comp rx=0 tx=0).stop 2024-05-08T08:59:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71541033d0 msgr2=0x7f71541a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71541033d0 0x7f71541a17d0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f714800c920 tx=0x7f714800cce0 comp rx=0 tx=0).stop 2024-05-08T08:59:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 shutdown_connections 2024-05-08T08:59:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f713c0b29f0 0x7f713c0b4eb0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7154109460 0x7f715419b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:29.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f71541033d0 0x7f71541a17d0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:29.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 --2- 172.21.15.70:0/3241224385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7154103d90 0x7f71541a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:29.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 >> 172.21.15.70:0/3241224385 conn(0x7f71540fef20 msgr2=0x7f715410eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:29.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 shutdown_connections 2024-05-08T08:59:29.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:29.227+0000 7f715ac00700 1 -- 172.21.15.70:0/3241224385 wait complete. 2024-05-08T08:59:29.228 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T08:59:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:29 smithi070 ceph-mon[29591]: pgmap v4239: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 7 op/s 2024-05-08T08:59:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:29 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3241224385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:59:29.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:29 smithi172 ceph-mon[33377]: pgmap v4239: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 7 op/s 2024-05-08T08:59:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:29 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3241224385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:59:30.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:29 smithi194 ceph-mon[33679]: pgmap v4239: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 150 KiB/s rd, 147 KiB/s wr, 7 op/s 2024-05-08T08:59:30.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:29 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3241224385' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T08:59:30.065 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 72f1f569 --release --await' 2024-05-08T08:59:30.066 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 72f1f569 --release --await 2024-05-08T08:59:30.513 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T08:59:31.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:31 smithi070 ceph-mon[29591]: pgmap v4240: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 6 op/s 2024-05-08T08:59:31.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:31 smithi172 ceph-mon[33377]: pgmap v4240: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 6 op/s 2024-05-08T08:59:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:31 smithi194 ceph-mon[33679]: pgmap v4240: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 6 op/s 2024-05-08T08:59:32.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.926+0000 7f91a6200700 1 -- 172.21.15.70:0/1931862019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a01055d0 msgr2=0x7f91a0105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:32.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.926+0000 7f91a6200700 1 --2- 172.21.15.70:0/1931862019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a01055d0 0x7f91a0105a50 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f918c009990 tx=0x7f918c009ca0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.926+0000 7f91a6200700 1 -- 172.21.15.70:0/1931862019 shutdown_connections 2024-05-08T08:59:32.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.926+0000 7f91a6200700 1 --2- 172.21.15.70:0/1931862019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91a0105f90 0x7f91a01124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.926+0000 7f91a6200700 1 --2- 172.21.15.70:0/1931862019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a010b660 0x7f91a010ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.926+0000 7f91a6200700 1 --2- 172.21.15.70:0/1931862019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a01055d0 0x7f91a0105a50 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.926+0000 7f91a6200700 1 -- 172.21.15.70:0/1931862019 >> 172.21.15.70:0/1931862019 conn(0x7f91a01010c0 msgr2=0x7f91a01034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:32.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.926+0000 7f91a6200700 1 -- 172.21.15.70:0/1931862019 shutdown_connections 2024-05-08T08:59:32.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.926+0000 7f91a6200700 1 -- 172.21.15.70:0/1931862019 wait complete. 2024-05-08T08:59:32.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.928+0000 7f91a6200700 1 Processor -- start 2024-05-08T08:59:32.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.928+0000 7f91a6200700 1 -- start start 2024-05-08T08:59:32.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.928+0000 7f91a6200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91a01055d0 0x7f91a01a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.928+0000 7f91a6200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a0105f90 0x7f91a01a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.928+0000 7f91a6200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a010b660 0x7f91a019b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.928+0000 7f91a6200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01156c0 con 0x7f91a010b660 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.928+0000 7f91a6200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91a0115540 con 0x7f91a01055d0 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f91a6200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f91a0115840 con 0x7f91a0105f90 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f91a5800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a010b660 0x7f91a019b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f91a5800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a010b660 0x7f91a019b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39856/0 (socket says 172.21.15.70:39856) 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f91a5800700 1 -- 172.21.15.70:0/2847185055 learned_addr learned my addr 172.21.15.70:0/2847185055 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f91a4e00700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91a01055d0 0x7f91a01a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f919fe00700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a0105f90 0x7f91a01a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f91a5800700 1 -- 172.21.15.70:0/2847185055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a0105f90 msgr2=0x7f91a01a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f91a5800700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a0105f90 0x7f91a01a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f91a5800700 1 -- 172.21.15.70:0/2847185055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91a01055d0 msgr2=0x7f91a01a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.929+0000 7f91a5800700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91a01055d0 0x7f91a01a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.930+0000 7f91a5800700 1 -- 172.21.15.70:0/2847185055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a019c0c0 con 0x7f91a010b660 2024-05-08T08:59:32.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.930+0000 7f91a5800700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a010b660 0x7f91a019b960 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f919800b970 tx=0x7f919800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:59:32.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.930+0000 7f919d600700 1 -- 172.21.15.70:0/2847185055 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198019070 con 0x7f91a010b660 2024-05-08T08:59:32.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.930+0000 7f919d600700 1 -- 172.21.15.70:0/2847185055 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f919800cdc0 con 0x7f91a010b660 2024-05-08T08:59:32.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.930+0000 7f91a6200700 1 -- 172.21.15.70:0/2847185055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a019c3b0 con 0x7f91a010b660 2024-05-08T08:59:32.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.930+0000 7f919d600700 1 -- 172.21.15.70:0/2847185055 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9198014e30 con 0x7f91a010b660 2024-05-08T08:59:32.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.930+0000 7f91a6200700 1 -- 172.21.15.70:0/2847185055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a01a8620 con 0x7f91a010b660 2024-05-08T08:59:32.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.934+0000 7f919d600700 1 -- 172.21.15.70:0/2847185055 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f919801c070 con 0x7f91a010b660 2024-05-08T08:59:32.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.935+0000 7f919d600700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91880b29f0 0x7f91880b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.935+0000 7f919d600700 1 -- 172.21.15.70:0/2847185055 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(343..343 src has 1..343) ==== 9583+0+0 (secure 0 0 0) 0x7f91980e1d40 con 0x7f91a010b660 2024-05-08T08:59:32.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.936+0000 7f91a4e00700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91880b29f0 0x7f91880b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.936+0000 7f91a4e00700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91880b29f0 0x7f91880b4eb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f91a010a8d0 tx=0x7f919400a3b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:59:32.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.956+0000 7f91b2109b80 1 Processor -- start 2024-05-08T08:59:32.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f91b2109b80 1 -- start start 2024-05-08T08:59:32.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812cf60 0x56528812d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288127490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 0x565288127f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f91b2109b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x565288079b20 con 0x56528812d880 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f91b2109b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x565288017860 con 0x565288127ab0 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f91b2109b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x565288075ae0 con 0x56528812cf60 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f919fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288127490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f919fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288127490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39860/0 (socket says 172.21.15.70:39860) 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.957+0000 7f919fe00700 1 -- 172.21.15.70:0/130760773 learned_addr learned my addr 172.21.15.70:0/130760773 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.958+0000 7f91a4e00700 1 --2- 172.21.15.70:0/130760773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812cf60 0x56528812d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.958+0000 7f919fe00700 1 -- 172.21.15.70:0/130760773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812cf60 msgr2=0x56528812d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.958+0000 7f919fe00700 1 --2- 172.21.15.70:0/130760773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812cf60 0x56528812d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.958+0000 7f91a5800700 1 --2- 172.21.15.70:0/130760773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 0x565288127f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.958+0000 7f919fe00700 1 -- 172.21.15.70:0/130760773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 msgr2=0x565288127f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:59:32.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.958+0000 7f919fe00700 1 --2- 172.21.15.70:0/130760773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 0x565288127f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.958+0000 7f919fe00700 1 -- 172.21.15.70:0/130760773 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565287fc69d0 con 0x56528812d880 2024-05-08T08:59:32.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.958+0000 7f919fe00700 1 --2- 172.21.15.70:0/130760773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288127490 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f918c015000 tx=0x7f918c005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c5730220ef9749 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:59:32.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.959+0000 7f9192000700 1 -- 172.21.15.70:0/130760773 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c027070 con 0x56528812d880 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.959+0000 7f9192000700 1 -- 172.21.15.70:0/130760773 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f918c005070 con 0x56528812d880 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.959+0000 7f9192000700 1 -- 172.21.15.70:0/130760773 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c003b40 con 0x56528812d880 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 -- 172.21.15.70:0/130760773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 msgr2=0x565288127490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 --2- 172.21.15.70:0/130760773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288127490 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f918c015000 tx=0x7f918c005c80 comp rx=0 tx=0).stop 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 -- 172.21.15.70:0/130760773 shutdown_connections 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 --2- 172.21.15.70:0/130760773 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 0x565288127f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 --2- 172.21.15.70:0/130760773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812cf60 0x56528812d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 --2- 172.21.15.70:0/130760773 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288127490 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 -- 172.21.15.70:0/130760773 >> 172.21.15.70:0/130760773 conn(0x565288055c60 msgr2=0x565288121ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 -- 172.21.15.70:0/130760773 shutdown_connections 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 -- 172.21.15.70:0/130760773 wait complete. 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.960+0000 7f91b2109b80 1 -- start start 2024-05-08T08:59:32.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.961+0000 7f91b2109b80 1 Processor -- start 2024-05-08T08:59:32.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.961+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565288127ab0 0x565288133580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.961+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 0x565288130920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.961+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288130e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.961+0000 7f91b2109b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x565288134340 con 0x56528812d880 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.961+0000 7f91b2109b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x565287fdfc20 con 0x56528812cf60 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.961+0000 7f91b2109b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5652881344c0 con 0x565288127ab0 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.961+0000 7f91b2109b80 10 client.0 _ll_register_callbacks cb 0x565288020d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a5800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288130e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a5800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288130e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39866/0 (socket says 172.21.15.70:39866) 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a5800700 1 -- 172.21.15.70:0/2652378522 learned_addr learned my addr 172.21.15.70:0/2652378522 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f919fe00700 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 0x565288130920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a4e00700 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565288127ab0 0x565288133580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a5800700 1 -- 172.21.15.70:0/2652378522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565288127ab0 msgr2=0x565288133580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a5800700 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565288127ab0 0x565288133580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a5800700 1 -- 172.21.15.70:0/2652378522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 msgr2=0x565288130920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a5800700 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 0x565288130920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a5800700 1 -- 172.21.15.70:0/2652378522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56528803f520 con 0x56528812d880 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f91a5800700 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288130e60 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f919800b940 tx=0x7f91980148b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f9c1e18068c3c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.962+0000 7f9186a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.963+0000 7f9186a00700 1 -- 172.21.15.70:0/2652378522 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91980a93b0 con 0x56528812d880 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.963+0000 7f9186a00700 1 -- 172.21.15.70:0/2652378522 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(343..343 src has 1..343) ==== 9583+0+0 (secure 0 0 0) 0x7f91980a52a0 con 0x56528812d880 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.963+0000 7f91b2109b80 1 -- 172.21.15.70:0/2652378522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f918c005070 con 0x56528812d880 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.963+0000 7f9186a00700 1 -- 172.21.15.70:0/2652378522 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f91980a8cb0 con 0x56528812d880 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.963+0000 7f91b2109b80 10 client.18891 fetch_fsmap learned FSMap version 42 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.963+0000 7f91b2109b80 1 -- 172.21.15.70:0/2652378522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56528813eb70 con 0x56528812d880 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.963+0000 7f9186a00700 1 -- 172.21.15.70:0/2652378522 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f918c005070 con 0x56528812d880 2024-05-08T08:59:32.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.963+0000 7f9186a00700 1 -- 172.21.15.70:0/2652378522 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f91980a7f10 con 0x56528812d880 2024-05-08T08:59:32.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.964+0000 7f91b2109b80 10 client.18891 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:59:32.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.964+0000 7f91b2109b80 10 client.18891 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:59:32.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.964+0000 7f91b2109b80 20 client.18891 populate_metadata read hostname 'smithi070' 2024-05-08T08:59:32.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.964+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x565288141100 0x565288143510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.964+0000 7f91b2109b80 4 client.18891 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T08:59:32.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.964+0000 7f91b2109b80 1 -- 172.21.15.70:0/2652378522 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652880f41a0 con 0x565288141100 2024-05-08T08:59:32.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.964+0000 7f91a4e00700 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x565288141100 0x565288143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.965+0000 7f91a4e00700 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x565288141100 0x565288143510 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d592e06d655053b7 server_cookie=eb10d671109d92eb in_seq=0 out_seq=0 2024-05-08T08:59:32.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.965+0000 7f9186a00700 10 client.18891 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:59:32.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f9186a00700 1 -- 172.21.15.70:0/2652378522 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5652880f41a0 con 0x565288141100 2024-05-08T08:59:32.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f9186a00700 10 client.18891 handle_command_reply: tid=0 2024-05-08T08:59:32.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 client.18891 shutdown 2024-05-08T08:59:32.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 -- 172.21.15.70:0/2652378522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 msgr2=0x565288130e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:32.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288130e60 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f919800b940 tx=0x7f91980148b0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 -- 172.21.15.70:0/2652378522 shutdown_connections 2024-05-08T08:59:32.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x565288141100 0x565288143510 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812d880 0x565288130e60 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x565288127ab0 0x565288133580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2652378522 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 0x565288130920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 -- 172.21.15.70:0/2652378522 >> 172.21.15.70:0/2652378522 conn(0x565288055c60 msgr2=0x565288126480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:32.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f9186a00700 0 client.18891 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:59:32.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 -- 172.21.15.70:0/2652378522 shutdown_connections 2024-05-08T08:59:32.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 1 -- 172.21.15.70:0/2652378522 wait complete. 2024-05-08T08:59:32.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.968+0000 7f91b2109b80 20 client.18891 trim_cache size 0 max 16384 2024-05-08T08:59:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.990+0000 7f91b2109b80 1 Processor -- start 2024-05-08T08:59:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.990+0000 7f91b2109b80 1 -- start start 2024-05-08T08:59:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.990+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 0x565288148de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.990+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812cf60 0x565288149320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.990+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 0x56528812dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.990+0000 7f91b2109b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01b3e00 con 0x56528812cf60 2024-05-08T08:59:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.990+0000 7f91b2109b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01b1690 con 0x565288127ab0 2024-05-08T08:59:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.990+0000 7f91b2109b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01af500 con 0x56528812d880 2024-05-08T08:59:32.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.990+0000 7f919fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812cf60 0x565288149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.991+0000 7f919fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812cf60 0x565288149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39870/0 (socket says 172.21.15.70:39870) 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.991+0000 7f919fe00700 1 -- 172.21.15.70:0/2931135216 learned_addr learned my addr 172.21.15.70:0/2931135216 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.991+0000 7f91a4e00700 1 --2- 172.21.15.70:0/2931135216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 0x565288148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.991+0000 7f91a5800700 1 --2- 172.21.15.70:0/2931135216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 0x56528812dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.991+0000 7f919fe00700 1 -- 172.21.15.70:0/2931135216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 msgr2=0x56528812dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.991+0000 7f919fe00700 1 --2- 172.21.15.70:0/2931135216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 0x56528812dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.991+0000 7f919fe00700 1 -- 172.21.15.70:0/2931135216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 msgr2=0x565288148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.991+0000 7f919fe00700 1 --2- 172.21.15.70:0/2931135216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 0x565288148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.991+0000 7f919fe00700 1 -- 172.21.15.70:0/2931135216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652881306f0 con 0x56528812cf60 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.992+0000 7f919fe00700 1 --2- 172.21.15.70:0/2931135216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812cf60 0x565288149320 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f918c015000 tx=0x7f918c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2fcaed38a9fbdc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:59:32.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.992+0000 7f9191600700 1 -- 172.21.15.70:0/2931135216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c030070 con 0x56528812cf60 2024-05-08T08:59:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.992+0000 7f9191600700 1 -- 172.21.15.70:0/2931135216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f918c00bce0 con 0x56528812cf60 2024-05-08T08:59:32.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.992+0000 7f9191600700 1 -- 172.21.15.70:0/2931135216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c027040 con 0x56528812cf60 2024-05-08T08:59:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 -- 172.21.15.70:0/2931135216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812cf60 msgr2=0x565288149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:32.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2931135216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812cf60 0x565288149320 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f918c015000 tx=0x7f918c009310 comp rx=0 tx=0).stop 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 -- 172.21.15.70:0/2931135216 shutdown_connections 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2931135216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 0x56528812dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2931135216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x565288127ab0 0x565288148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 --2- 172.21.15.70:0/2931135216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56528812cf60 0x565288149320 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 -- 172.21.15.70:0/2931135216 >> 172.21.15.70:0/2931135216 conn(0x565288055c60 msgr2=0x56528812a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 -- 172.21.15.70:0/2931135216 shutdown_connections 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 -- 172.21.15.70:0/2931135216 wait complete. 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 -- start start 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.993+0000 7f91b2109b80 1 Processor -- start 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565288127ab0 0x565288136750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 0x565288136c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91b2109b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 0x5652881ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91b2109b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01afb50 con 0x565288127ab0 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91b2109b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01b0fc0 con 0x56528812cf60 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91b2109b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f91a01b0220 con 0x56528812d880 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91b2109b80 10 client.0 _ll_register_callbacks cb 0x565288020d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91a4e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565288127ab0 0x565288136750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91a4e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565288127ab0 0x565288136750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39886/0 (socket says 172.21.15.70:39886) 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.994+0000 7f91a4e00700 1 -- 172.21.15.70:0/3708350133 learned_addr learned my addr 172.21.15.70:0/3708350133 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.995+0000 7f919fe00700 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 0x565288136c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.995+0000 7f91a5800700 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 0x5652881ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.995+0000 7f91a4e00700 1 -- 172.21.15.70:0/3708350133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 msgr2=0x5652881ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.995+0000 7f91a4e00700 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 0x5652881ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.995+0000 7f91a4e00700 1 -- 172.21.15.70:0/3708350133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 msgr2=0x565288136c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T08:59:32.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.995+0000 7f91a4e00700 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 0x565288136c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:32.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.995+0000 7f91a4e00700 1 -- 172.21.15.70:0/3708350133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565288137580 con 0x565288127ab0 2024-05-08T08:59:32.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.995+0000 7f91a4e00700 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565288127ab0 0x565288136750 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f9194010780 tx=0x7f91940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab82dc058a80e63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T08:59:32.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.995+0000 7f9186a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T08:59:32.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.996+0000 7f9186a00700 1 -- 172.21.15.70:0/3708350133 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919402a070 con 0x565288127ab0 2024-05-08T08:59:32.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.996+0000 7f91b2109b80 1 -- 172.21.15.70:0/3708350133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f918c00bce0 con 0x565288127ab0 2024-05-08T08:59:32.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.996+0000 7f9186a00700 1 -- 172.21.15.70:0/3708350133 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(343..343 src has 1..343) ==== 9583+0+0 (secure 0 0 0) 0x7f9194004220 con 0x565288127ab0 2024-05-08T08:59:32.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.996+0000 7f9186a00700 1 -- 172.21.15.70:0/3708350133 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9194037050 con 0x565288127ab0 2024-05-08T08:59:32.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.996+0000 7f91b2109b80 10 client.18897 fetch_fsmap learned FSMap version 42 2024-05-08T08:59:32.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.996+0000 7f91b2109b80 1 -- 172.21.15.70:0/3708350133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5652881ad030 con 0x565288127ab0 2024-05-08T08:59:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.996+0000 7f9186a00700 1 -- 172.21.15.70:0/3708350133 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f918c00bce0 con 0x565288127ab0 2024-05-08T08:59:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.997+0000 7f9186a00700 1 -- 172.21.15.70:0/3708350133 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9194003680 con 0x565288127ab0 2024-05-08T08:59:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.997+0000 7f91b2109b80 10 client.18897 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T08:59:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.997+0000 7f91b2109b80 10 client.18897 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T08:59:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.997+0000 7f91b2109b80 20 client.18897 populate_metadata read hostname 'smithi070' 2024-05-08T08:59:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.997+0000 7f91b2109b80 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5652881ad720 0x5652881afb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T08:59:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.997+0000 7f91b2109b80 4 client.18897 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "72f1f569", "release": true, "await": true}] 2024-05-08T08:59:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.997+0000 7f91b2109b80 1 -- 172.21.15.70:0/3708350133 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "72f1f569", "release": true, "await": true}) -- 0x565288087500 con 0x5652881ad720 2024-05-08T08:59:32.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.997+0000 7f919fe00700 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5652881ad720 0x5652881afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T08:59:32.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.998+0000 7f9186a00700 10 client.18897 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T08:59:32.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:32.998+0000 7f919fe00700 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5652881ad720 0x5652881afb40 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ada02f81289f7d93 server_cookie=c1b0d8c5fc0f5267 in_seq=0 out_seq=0 2024-05-08T08:59:33.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:33 smithi070 ceph-mon[29591]: pgmap v4241: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 5 op/s 2024-05-08T08:59:33.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:33 smithi172 ceph-mon[33377]: pgmap v4241: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 5 op/s 2024-05-08T08:59:34.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:33 smithi194 ceph-mon[33679]: pgmap v4241: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 69 KiB/s wr, 5 op/s 2024-05-08T08:59:35.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:35 smithi070 ceph-mon[29591]: pgmap v4242: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:59:35.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:35 smithi172 ceph-mon[33377]: pgmap v4242: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:59:36.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:35 smithi194 ceph-mon[33679]: pgmap v4242: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T08:59:37.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.614+0000 7f9186a00700 1 -- 172.21.15.70:0/3708350133 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x565288087500 con 0x5652881ad720 2024-05-08T08:59:37.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.614+0000 7f9186a00700 10 client.18897 handle_command_reply: tid=0 2024-05-08T08:59:37.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.615+0000 7f91b2109b80 1 client.18897 shutdown 2024-05-08T08:59:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.618+0000 7f91b2109b80 1 -- 172.21.15.70:0/3708350133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565288127ab0 msgr2=0x565288136750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.618+0000 7f91b2109b80 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565288127ab0 0x565288136750 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f9194010780 tx=0x7f91940047c0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.619+0000 7f91b2109b80 1 -- 172.21.15.70:0/3708350133 shutdown_connections 2024-05-08T08:59:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.619+0000 7f91b2109b80 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5652881ad720 0x5652881afb40 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.619+0000 7f91b2109b80 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56528812d880 0x5652881ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.619+0000 7f91b2109b80 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x565288127ab0 0x565288136750 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.619+0000 7f91b2109b80 1 --2- 172.21.15.70:0/3708350133 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56528812cf60 0x565288136c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.619+0000 7f91b2109b80 1 -- 172.21.15.70:0/3708350133 >> 172.21.15.70:0/3708350133 conn(0x565288055c60 msgr2=0x56528812dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.619+0000 7f9186a00700 0 client.18897 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T08:59:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.620+0000 7f91b2109b80 1 -- 172.21.15.70:0/3708350133 shutdown_connections 2024-05-08T08:59:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.620+0000 7f91b2109b80 1 -- 172.21.15.70:0/3708350133 wait complete. 2024-05-08T08:59:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.620+0000 7f91b2109b80 20 client.18897 trim_cache size 0 max 16384 2024-05-08T08:59:37.620 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T08:59:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T08:59:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T08:59:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 296, 2024-05-08T08:59:37.620 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "72f1f569": { 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 296, 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 75.0, 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T08:59:37.621 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T08:59:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:37.622 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T08:59:37.622 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.622+0000 7f91a6200700 1 -- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91880b29f0 msgr2=0x7f91880b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.622+0000 7f91a6200700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91880b29f0 0x7f91880b4eb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f91a010a8d0 tx=0x7f919400a3b0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.622+0000 7f91a6200700 1 -- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a010b660 msgr2=0x7f91a019b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.622+0000 7f91a6200700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a010b660 0x7f91a019b960 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f919800b970 tx=0x7f919800bc80 comp rx=0 tx=0).stop 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.623+0000 7f91a6200700 1 -- 172.21.15.70:0/2847185055 shutdown_connections 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.623+0000 7f91a6200700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f91880b29f0 0x7f91880b4eb0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.623+0000 7f91a6200700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91a010b660 0x7f91a019b960 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.623+0000 7f91a6200700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f91a01055d0 0x7f91a01a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.623+0000 7f91a6200700 1 --2- 172.21.15.70:0/2847185055 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a0105f90 0x7f91a01a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T08:59:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.623+0000 7f91a6200700 1 -- 172.21.15.70:0/2847185055 >> 172.21.15.70:0/2847185055 conn(0x7f91a01010c0 msgr2=0x7f91a01026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T08:59:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.624+0000 7f91a6200700 1 -- 172.21.15.70:0/2847185055 shutdown_connections 2024-05-08T08:59:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T08:59:37.624+0000 7f91a6200700 1 -- 172.21.15.70:0/2847185055 wait complete. 2024-05-08T08:59:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:37 smithi070 ceph-mon[29591]: pgmap v4243: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-05-08T08:59:37.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:37 smithi172 ceph-mon[33377]: pgmap v4243: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-05-08T08:59:38.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:37 smithi194 ceph-mon[33679]: pgmap v4243: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-05-08T08:59:38.445 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '72f1f569', seconds elapsed: 67.0 2024-05-08T08:59:38.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:38 smithi070 ceph-mon[29591]: pgmap v4244: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-05-08T08:59:38.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:38 smithi172 ceph-mon[33377]: pgmap v4244: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-05-08T08:59:39.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:38 smithi194 ceph-mon[33679]: pgmap v4244: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 5 op/s 2024-05-08T08:59:39.388 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/devres.o 2024-05-08T08:59:39.811 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-eh.o 2024-05-08T08:59:40.075 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/attribute_container.o 2024-05-08T08:59:40.103 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_trace.o 2024-05-08T08:59:40.194 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/transport_class.o 2024-05-08T08:59:40.326 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/topology.o 2024-05-08T08:59:40.562 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/phy-core.o 2024-05-08T08:59:41.071 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_context.o 2024-05-08T08:59:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:41 smithi194 ceph-mon[33679]: pgmap v4245: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 18 op/s 2024-05-08T08:59:41.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:41 smithi070 ceph-mon[29591]: pgmap v4245: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 18 op/s 2024-05-08T08:59:41.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:41 smithi172 ceph-mon[33377]: pgmap v4245: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 142 KiB/s wr, 18 op/s 2024-05-08T08:59:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:43 smithi194 ceph-mon[33679]: pgmap v4246: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 15 op/s 2024-05-08T08:59:43.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:43 smithi070 ceph-mon[29591]: pgmap v4246: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 15 op/s 2024-05-08T08:59:43.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:43 smithi172 ceph-mon[33377]: pgmap v4246: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 142 KiB/s wr, 15 op/s 2024-05-08T08:59:45.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:45 smithi070 ceph-mon[29591]: pgmap v4247: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 443 KiB/s wr, 26 op/s 2024-05-08T08:59:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:45 smithi172 ceph-mon[33377]: pgmap v4247: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 443 KiB/s wr, 26 op/s 2024-05-08T08:59:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:45 smithi194 ceph-mon[33679]: pgmap v4247: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 443 KiB/s wr, 26 op/s 2024-05-08T08:59:46.267 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/phy_device.o 2024-05-08T08:59:46.668 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/linkmode.o 2024-05-08T08:59:46.680 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/mdio_bus.o 2024-05-08T08:59:47.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:47 smithi070 ceph-mon[29591]: pgmap v4248: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 436 KiB/s wr, 26 op/s 2024-05-08T08:59:47.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:47 smithi172 ceph-mon[33377]: pgmap v4248: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 436 KiB/s wr, 26 op/s 2024-05-08T08:59:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:47 smithi194 ceph-mon[33679]: pgmap v4248: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 436 KiB/s wr, 26 op/s 2024-05-08T08:59:48.234 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/container.o 2024-05-08T08:59:48.997 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_logging.o 2024-05-08T08:59:49.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:49 smithi070 ceph-mon[29591]: pgmap v4249: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 436 KiB/s wr, 25 op/s 2024-05-08T08:59:49.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:49 smithi172 ceph-mon[33377]: pgmap v4249: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 436 KiB/s wr, 25 op/s 2024-05-08T08:59:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:49 smithi194 ceph-mon[33679]: pgmap v4249: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 436 KiB/s wr, 25 op/s 2024-05-08T08:59:50.436 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_pm.o 2024-05-08T08:59:50.823 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-transport.o 2024-05-08T08:59:51.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:51 smithi070 ceph-mon[29591]: pgmap v4250: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 691 KiB/s wr, 35 op/s 2024-05-08T08:59:51.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:51 smithi172 ceph-mon[33377]: pgmap v4250: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 691 KiB/s wr, 35 op/s 2024-05-08T08:59:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:51 smithi194 ceph-mon[33679]: pgmap v4250: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 691 KiB/s wr, 35 op/s 2024-05-08T08:59:53.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:53 smithi070 ceph-mon[29591]: pgmap v4251: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 561 KiB/s wr, 22 op/s 2024-05-08T08:59:53.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:53 smithi172 ceph-mon[33377]: pgmap v4251: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 561 KiB/s wr, 22 op/s 2024-05-08T08:59:53.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:53 smithi194 ceph-mon[33679]: pgmap v4251: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 514 KiB/s rd, 561 KiB/s wr, 22 op/s 2024-05-08T08:59:54.980 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/property.o 2024-05-08T08:59:55.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:55 smithi070 ceph-mon[29591]: pgmap v4252: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 811 KiB/s wr, 31 op/s 2024-05-08T08:59:55.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:55 smithi172 ceph-mon[33377]: pgmap v4252: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 811 KiB/s wr, 31 op/s 2024-05-08T08:59:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:55 smithi194 ceph-mon[33679]: pgmap v4252: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 811 KiB/s wr, 31 op/s 2024-05-08T08:59:56.080 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/cacheinfo.o 2024-05-08T08:59:56.190 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_context_sseu.o 2024-05-08T08:59:57.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:57 smithi070 ceph-mon[29591]: pgmap v4253: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 511 KiB/s wr, 21 op/s 2024-05-08T08:59:57.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:57 smithi172 ceph-mon[33377]: pgmap v4253: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 511 KiB/s wr, 21 op/s 2024-05-08T08:59:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:57 smithi194 ceph-mon[33679]: pgmap v4253: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 511 KiB/s wr, 21 op/s 2024-05-08T08:59:57.826 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_cs.o 2024-05-08T08:59:58.785 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firewire/init_ohci1394_dma.o 2024-05-08T08:59:59.385 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/mdio_device.o 2024-05-08T08:59:59.467 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_bsg.o 2024-05-08T08:59:59.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 08:59:59 smithi070 ceph-mon[29591]: pgmap v4254: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 506 KiB/s wr, 19 op/s 2024-05-08T08:59:59.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 08:59:59 smithi172 ceph-mon[33377]: pgmap v4254: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 506 KiB/s wr, 19 op/s 2024-05-08T08:59:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 08:59:59 smithi194 ceph-mon[33679]: pgmap v4254: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 506 KiB/s wr, 19 op/s 2024-05-08T09:00:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T09:00:00.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T09:00:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T09:00:01.481 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-trace.o 2024-05-08T09:00:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:01 smithi070 ceph-mon[29591]: pgmap v4255: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 805 KiB/s wr, 32 op/s 2024-05-08T09:00:01.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:01 smithi172 ceph-mon[33377]: pgmap v4255: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 805 KiB/s wr, 32 op/s 2024-05-08T09:00:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:01 smithi194 ceph-mon[33679]: pgmap v4255: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 805 KiB/s wr, 32 op/s 2024-05-08T09:00:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:03 smithi070 ceph-mon[29591]: pgmap v4256: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 549 KiB/s wr, 22 op/s 2024-05-08T09:00:03.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:03 smithi172 ceph-mon[33377]: pgmap v4256: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 549 KiB/s wr, 22 op/s 2024-05-08T09:00:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:03 smithi194 ceph-mon[33679]: pgmap v4256: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 549 KiB/s wr, 22 op/s 2024-05-08T09:00:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:04 smithi070 ceph-mon[29591]: osdmap e344: 12 total, 12 up, 12 in 2024-05-08T09:00:04.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:04 smithi172 ceph-mon[33377]: osdmap e344: 12 total, 12 up, 12 in 2024-05-08T09:00:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:04 smithi194 ceph-mon[33679]: osdmap e344: 12 total, 12 up, 12 in 2024-05-08T09:00:04.846 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_common.o 2024-05-08T09:00:05.344 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:05 smithi070 ceph-mon[29591]: pgmap v4258: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 767 KiB/s wr, 46 op/s 2024-05-08T09:00:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:05 smithi172 ceph-mon[33377]: pgmap v4258: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 767 KiB/s wr, 46 op/s 2024-05-08T09:00:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:05 smithi194 ceph-mon[33679]: pgmap v4258: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 767 KiB/s wr, 46 op/s 2024-05-08T09:00:06.304 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T09:00:06.304 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.9 2024-05-08T09:00:06.305 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:00:06.943 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:00:07.002 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/swnode.o 2024-05-08T09:00:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:07 smithi070 ceph-mon[29591]: pgmap v4259: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 767 KiB/s wr, 47 op/s 2024-05-08T09:00:07.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:07 smithi172 ceph-mon[33377]: pgmap v4259: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 767 KiB/s wr, 47 op/s 2024-05-08T09:00:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:07 smithi194 ceph-mon[33679]: pgmap v4259: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 767 KiB/s wr, 47 op/s 2024-05-08T09:00:08.818 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firewire/built-in.a 2024-05-08T09:00:09.063 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_transport_spi.o 2024-05-08T09:00:09.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:09 smithi070 ceph-mon[29591]: pgmap v4260: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 767 KiB/s wr, 47 op/s 2024-05-08T09:00:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:09 smithi172 ceph-mon[33377]: pgmap v4260: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 767 KiB/s wr, 47 op/s 2024-05-08T09:00:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:09 smithi194 ceph-mon[33679]: pgmap v4260: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 767 KiB/s wr, 47 op/s 2024-05-08T09:00:10.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.158+0000 7f5787e00700 1 -- 172.21.15.70:0/2304298623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578810fd30 msgr2=0x7f5788112120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:10.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.158+0000 7f5787e00700 1 --2- 172.21.15.70:0/2304298623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578810fd30 0x7f5788112120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f578000b0a0 tx=0x7f578000b3b0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.158+0000 7f5787e00700 1 -- 172.21.15.70:0/2304298623 shutdown_connections 2024-05-08T09:00:10.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.158+0000 7f5787e00700 1 --2- 172.21.15.70:0/2304298623 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578810fd30 0x7f5788112120 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.158+0000 7f5787e00700 1 --2- 172.21.15.70:0/2304298623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5788102180 0x7f5788102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.158+0000 7f5787e00700 1 --2- 172.21.15.70:0/2304298623 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788102b30 0x7f578810f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.158+0000 7f5787e00700 1 -- 172.21.15.70:0/2304298623 >> 172.21.15.70:0/2304298623 conn(0x7f57880fddc0 msgr2=0x7f57881001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:00:10.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.158+0000 7f5787e00700 1 -- 172.21.15.70:0/2304298623 shutdown_connections 2024-05-08T09:00:10.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.158+0000 7f5787e00700 1 -- 172.21.15.70:0/2304298623 wait complete. 2024-05-08T09:00:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.160+0000 7f5787e00700 1 Processor -- start 2024-05-08T09:00:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.160+0000 7f5787e00700 1 -- start start 2024-05-08T09:00:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.160+0000 7f5787e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788102180 0x7f57881a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.160+0000 7f5787e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5788102b30 0x7f57881a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:10.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5787e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578810fd30 0x7f578819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:10.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5787e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5788115650 con 0x7f5788102b30 2024-05-08T09:00:10.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5787e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f57881154d0 con 0x7f578810fd30 2024-05-08T09:00:10.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5787e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f57881157d0 con 0x7f5788102180 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5786000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5788102b30 0x7f57881a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5787400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578810fd30 0x7f578819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5786a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788102180 0x7f57881a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5786a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788102180 0x7f57881a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:36574/0 (socket says 172.21.15.70:36574) 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5787400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578810fd30 0x7f578819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:42986/0 (socket says 172.21.15.70:42986) 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.161+0000 7f5786a00700 1 -- 172.21.15.70:0/2477826472 learned_addr learned my addr 172.21.15.70:0/2477826472 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.162+0000 7f5786000700 1 -- 172.21.15.70:0/2477826472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788102180 msgr2=0x7f57881a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.162+0000 7f5786000700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788102180 0x7f57881a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.162+0000 7f5786000700 1 -- 172.21.15.70:0/2477826472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578810fd30 msgr2=0x7f578819b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.162+0000 7f5786000700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578810fd30 0x7f578819b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.162+0000 7f5786000700 1 -- 172.21.15.70:0/2477826472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578819c0f0 con 0x7f5788102b30 2024-05-08T09:00:10.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.163+0000 7f5786000700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5788102b30 0x7f57881a1d10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f577400e9f0 tx=0x7f577400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:00:10.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.163+0000 7f577f400700 1 -- 172.21.15.70:0/2477826472 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577400c9c0 con 0x7f5788102b30 2024-05-08T09:00:10.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.163+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578819c380 con 0x7f5788102b30 2024-05-08T09:00:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.163+0000 7f577f400700 1 -- 172.21.15.70:0/2477826472 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5774010430 con 0x7f5788102b30 2024-05-08T09:00:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.163+0000 7f577f400700 1 -- 172.21.15.70:0/2477826472 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5774018680 con 0x7f5788102b30 2024-05-08T09:00:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.163+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57881a86a0 con 0x7f5788102b30 2024-05-08T09:00:10.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.165+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578806a190 con 0x7f5788102b30 2024-05-08T09:00:10.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.170+0000 7f577f400700 1 -- 172.21.15.70:0/2477826472 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f577400cb60 con 0x7f5788102b30 2024-05-08T09:00:10.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.173+0000 7f577f400700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f576c0b2a70 0x7f576c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:10.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.173+0000 7f577f400700 1 -- 172.21.15.70:0/2477826472 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(344..344 src has 1..344) ==== 9671+0+0 (secure 0 0 0) 0x7f57740e2d60 con 0x7f5788102b30 2024-05-08T09:00:10.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.174+0000 7f5786a00700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f576c0b2a70 0x7f576c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.176+0000 7f5786a00700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f576c0b2a70 0x7f576c0b4f30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f578819cad0 tx=0x7f5778009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:00:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.176+0000 7f577f400700 1 -- 172.21.15.70:0/2477826472 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f57740aa260 con 0x7f5788102b30 2024-05-08T09:00:10.186 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cdrom/cdrom.o 2024-05-08T09:00:10.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.658+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f578819cec0 con 0x7f5788102b30 2024-05-08T09:00:10.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.659+0000 7f577f400700 1 -- 172.21.15.70:0/2477826472 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f57740a9b60 con 0x7f5788102b30 2024-05-08T09:00:10.657 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:00:10.658 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:00:10.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f576c0b2a70 msgr2=0x7f576c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:10.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f576c0b2a70 0x7f576c0b4f30 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f578819cad0 tx=0x7f5778009260 comp rx=0 tx=0).stop 2024-05-08T09:00:10.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5788102b30 msgr2=0x7f57881a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:10.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5788102b30 0x7f57881a1d10 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f577400e9f0 tx=0x7f577400ed00 comp rx=0 tx=0).stop 2024-05-08T09:00:10.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 shutdown_connections 2024-05-08T09:00:10.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f576c0b2a70 0x7f576c0b4f30 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f578810fd30 0x7f578819b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5788102180 0x7f57881a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 --2- 172.21.15.70:0/2477826472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5788102b30 0x7f57881a1d10 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:10.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.663+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 >> 172.21.15.70:0/2477826472 conn(0x7f57880fddc0 msgr2=0x7f57881001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:00:10.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.664+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 shutdown_connections 2024-05-08T09:00:10.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:10.664+0000 7f5787e00700 1 -- 172.21.15.70:0/2477826472 wait complete. 2024-05-08T09:00:10.664 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:00:10.929 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/swphy.o 2024-05-08T09:00:11.079 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-sata.o 2024-05-08T09:00:11.574 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 87.9 --await-for 42.0' 2024-05-08T09:00:11.574 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 87.9 --await-for 42.0 2024-05-08T09:00:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:11 smithi070 ceph-mon[29591]: pgmap v4261: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 796 KiB/s wr, 47 op/s 2024-05-08T09:00:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:11 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2477826472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:00:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:11 smithi070 ceph-mon[29591]: osdmap e345: 12 total, 12 up, 12 in 2024-05-08T09:00:11.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:11 smithi172 ceph-mon[33377]: pgmap v4261: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 796 KiB/s wr, 47 op/s 2024-05-08T09:00:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:11 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2477826472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:00:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:11 smithi172 ceph-mon[33377]: osdmap e345: 12 total, 12 up, 12 in 2024-05-08T09:00:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:11 smithi194 ceph-mon[33679]: pgmap v4261: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 796 KiB/s wr, 47 op/s 2024-05-08T09:00:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:11 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2477826472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:00:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:11 smithi194 ceph-mon[33679]: osdmap e345: 12 total, 12 up, 12 in 2024-05-08T09:00:12.098 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-sff.o 2024-05-08T09:00:12.112 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-pmp.o 2024-05-08T09:00:12.147 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:00:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:13 smithi194 ceph-mon[33679]: pgmap v4263: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 896 KiB/s wr, 53 op/s 2024-05-08T09:00:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:00:13.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:13 smithi070 ceph-mon[29591]: pgmap v4263: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 896 KiB/s wr, 53 op/s 2024-05-08T09:00:13.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:00:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:13 smithi172 ceph-mon[33377]: pgmap v4263: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 896 KiB/s wr, 53 op/s 2024-05-08T09:00:13.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:00:14.051 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_heartbeat.o 2024-05-08T09:00:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.763 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.764 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.764 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.764 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:14.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:15.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:15 smithi172 ceph-mon[33377]: pgmap v4264: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 821 KiB/s wr, 29 op/s 2024-05-08T09:00:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:15 smithi194 ceph-mon[33679]: pgmap v4264: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 821 KiB/s wr, 29 op/s 2024-05-08T09:00:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:15 smithi070 ceph-mon[29591]: pgmap v4264: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 821 KiB/s wr, 29 op/s 2024-05-08T09:00:16.673 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/auxiliary.o 2024-05-08T09:00:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:17 smithi194 ceph-mon[33679]: pgmap v4265: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 820 KiB/s wr, 28 op/s 2024-05-08T09:00:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:17 smithi070 ceph-mon[29591]: pgmap v4265: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 820 KiB/s wr, 28 op/s 2024-05-08T09:00:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:17 smithi172 ceph-mon[33377]: pgmap v4265: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 820 KiB/s wr, 28 op/s 2024-05-08T09:00:19.589 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:19 smithi070 ceph-mon[29591]: pgmap v4266: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 820 KiB/s wr, 28 op/s 2024-05-08T09:00:19.589 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:19.589 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:19 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:19 smithi194 ceph-mon[33679]: pgmap v4266: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 820 KiB/s wr, 28 op/s 2024-05-08T09:00:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:19 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:19 smithi172 ceph-mon[33377]: pgmap v4266: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 820 KiB/s wr, 28 op/s 2024-05-08T09:00:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:19 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:20.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.010+0000 7f4c93000700 1 -- 172.21.15.70:0/2848026506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c8c10a4a0 msgr2=0x7f4c8c10a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.010+0000 7f4c93000700 1 --2- 172.21.15.70:0/2848026506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c8c10a4a0 0x7f4c8c10a880 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0099c0 tx=0x7f4c7c009cd0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.010+0000 7f4c93000700 1 -- 172.21.15.70:0/2848026506 shutdown_connections 2024-05-08T09:00:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.010+0000 7f4c93000700 1 --2- 172.21.15.70:0/2848026506 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8c1189e0 0x7f4c8c11add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.010+0000 7f4c93000700 1 --2- 172.21.15.70:0/2848026506 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c8c10a4a0 0x7f4c8c10a880 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.010+0000 7f4c93000700 1 --2- 172.21.15.70:0/2848026506 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c10adc0 0x7f4c8c1184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.010+0000 7f4c93000700 1 -- 172.21.15.70:0/2848026506 >> 172.21.15.70:0/2848026506 conn(0x7f4c8c06e610 msgr2=0x7f4c8c06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:00:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.011+0000 7f4c93000700 1 -- 172.21.15.70:0/2848026506 shutdown_connections 2024-05-08T09:00:20.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.011+0000 7f4c93000700 1 -- 172.21.15.70:0/2848026506 wait complete. 2024-05-08T09:00:20.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.012+0000 7f4c93000700 1 Processor -- start 2024-05-08T09:00:20.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.013+0000 7f4c93000700 1 -- start start 2024-05-08T09:00:20.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.013+0000 7f4c93000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c8c10adc0 0x7f4c8c1156a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.013+0000 7f4c93000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8c1189e0 0x7f4c8c115be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.013+0000 7f4c93000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c116120 0x7f4c8c1b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.013+0000 7f4c93000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c11df50 con 0x7f4c8c10adc0 2024-05-08T09:00:20.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.013+0000 7f4c93000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c11ddd0 con 0x7f4c8c1189e0 2024-05-08T09:00:20.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.013+0000 7f4c93000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c11e0d0 con 0x7f4c8c116120 2024-05-08T09:00:20.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.014+0000 7f4c8be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c8c10adc0 0x7f4c8c1156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.014+0000 7f4c8b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8c1189e0 0x7f4c8c115be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.014+0000 7f4c8b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8c1189e0 0x7f4c8c115be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:47024/0 (socket says 172.21.15.70:47024) 2024-05-08T09:00:20.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.014+0000 7f4c8b400700 1 -- 172.21.15.70:0/2528503395 learned_addr learned my addr 172.21.15.70:0/2528503395 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:00:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.014+0000 7f4c91000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c116120 0x7f4c8c1b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.015+0000 7f4c91000700 1 -- 172.21.15.70:0/2528503395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8c1189e0 msgr2=0x7f4c8c115be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.015+0000 7f4c91000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8c1189e0 0x7f4c8c115be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.015+0000 7f4c91000700 1 -- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c8c10adc0 msgr2=0x7f4c8c1156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:20.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.015+0000 7f4c91000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c8c10adc0 0x7f4c8c1156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.015+0000 7f4c91000700 1 -- 172.21.15.70:0/2528503395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8c1b51d0 con 0x7f4c8c116120 2024-05-08T09:00:20.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.016+0000 7f4c8be00700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c8c10adc0 0x7f4c8c1156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:00:20.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.016+0000 7f4c91000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c116120 0x7f4c8c1b4c90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400cc50 tx=0x7f4c8400cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:00:20.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.016+0000 7f4c88c00700 1 -- 172.21.15.70:0/2528503395 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c84016020 con 0x7f4c8c116120 2024-05-08T09:00:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.017+0000 7f4c93000700 1 -- 172.21.15.70:0/2528503395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c8c1b5400 con 0x7f4c8c116120 2024-05-08T09:00:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.017+0000 7f4c93000700 1 -- 172.21.15.70:0/2528503395 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c8c1b5960 con 0x7f4c8c116120 2024-05-08T09:00:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.017+0000 7f4c88c00700 1 -- 172.21.15.70:0/2528503395 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c84012420 con 0x7f4c8c116120 2024-05-08T09:00:20.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.017+0000 7f4c88c00700 1 -- 172.21.15.70:0/2528503395 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c840115e0 con 0x7f4c8c116120 2024-05-08T09:00:20.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.023+0000 7f4c88c00700 1 -- 172.21.15.70:0/2528503395 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4c84019020 con 0x7f4c8c116120 2024-05-08T09:00:20.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.026+0000 7f4c88c00700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c700b2b20 0x7f4c700b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.026+0000 7f4c88c00700 1 -- 172.21.15.70:0/2528503395 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(345..345 src has 1..345) ==== 9583+0+0 (secure 0 0 0) 0x7f4c840e26f0 con 0x7f4c8c116120 2024-05-08T09:00:20.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.027+0000 7f4c8be00700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c700b2b20 0x7f4c700b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.028+0000 7f4c8be00700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c700b2b20 0x7f4c700b4fe0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0098e0 tx=0x7f4c7c01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:00:20.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.039+0000 7f4c9da87b80 1 Processor -- start 2024-05-08T09:00:20.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.040+0000 7f4c9da87b80 1 -- start start 2024-05-08T09:00:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.041+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172432f50 0x55e172433330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.041+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e17242d520 0x55e17242d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.041+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e172439d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.041+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e17237fbb0 con 0x55e172432f50 2024-05-08T09:00:20.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.041+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e17231d8f0 con 0x55e17242dee0 2024-05-08T09:00:20.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.041+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e17237bb70 con 0x55e17242d520 2024-05-08T09:00:20.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.042+0000 7f4c8b400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e17242d520 0x55e17242d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.042+0000 7f4c8b400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e17242d520 0x55e17242d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:41028/0 (socket says 172.21.15.70:41028) 2024-05-08T09:00:20.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.042+0000 7f4c8b400700 1 -- 172.21.15.70:0/4125242516 learned_addr learned my addr 172.21.15.70:0/4125242516 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:00:20.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.042+0000 7f4c8be00700 1 --2- 172.21.15.70:0/4125242516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172432f50 0x55e172433330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.042+0000 7f4c8b400700 1 -- 172.21.15.70:0/4125242516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 msgr2=0x55e172439d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T09:00:20.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.042+0000 7f4c8b400700 1 --2- 172.21.15.70:0/4125242516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e172439d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.042+0000 7f4c8b400700 1 -- 172.21.15.70:0/4125242516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172432f50 msgr2=0x55e172433330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:00:20.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.042+0000 7f4c8b400700 1 --2- 172.21.15.70:0/4125242516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172432f50 0x55e172433330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.042+0000 7f4c8b400700 1 -- 172.21.15.70:0/4125242516 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1722cca60 con 0x55e17242d520 2024-05-08T09:00:20.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.043+0000 7f4c8b400700 1 --2- 172.21.15.70:0/4125242516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e17242d520 0x55e17242d9a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800be20 tx=0x7f4c780106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e69a563b22c0dcbb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:00:20.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.043+0000 7f4c81600700 1 -- 172.21.15.70:0/4125242516 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78004030 con 0x55e17242d520 2024-05-08T09:00:20.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.044+0000 7f4c81600700 1 -- 172.21.15.70:0/4125242516 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c78003680 con 0x55e17242d520 2024-05-08T09:00:20.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.044+0000 7f4c81600700 1 -- 172.21.15.70:0/4125242516 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011680 con 0x55e17242d520 2024-05-08T09:00:20.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.045+0000 7f4c9da87b80 1 -- 172.21.15.70:0/4125242516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e17242d520 msgr2=0x55e17242d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:20.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.045+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/4125242516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e17242d520 0x55e17242d9a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c7800be20 tx=0x7f4c780106b0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.047+0000 7f4c9da87b80 1 -- 172.21.15.70:0/4125242516 shutdown_connections 2024-05-08T09:00:20.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.047+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/4125242516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e172439d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.047+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/4125242516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172432f50 0x55e172433330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.047+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/4125242516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e17242d520 0x55e17242d9a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.047+0000 7f4c9da87b80 1 -- 172.21.15.70:0/4125242516 >> 172.21.15.70:0/4125242516 conn(0x55e17235bcf0 msgr2=0x55e172427e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:00:20.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.047+0000 7f4c9da87b80 1 -- 172.21.15.70:0/4125242516 shutdown_connections 2024-05-08T09:00:20.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.047+0000 7f4c9da87b80 1 -- 172.21.15.70:0/4125242516 wait complete. 2024-05-08T09:00:20.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.047+0000 7f4c9da87b80 1 -- start start 2024-05-08T09:00:20.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.048+0000 7f4c9da87b80 1 Processor -- start 2024-05-08T09:00:20.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.048+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242d520 0x55e172439930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.048+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e172436cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.048+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e172437210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.048+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e17243a310 con 0x55e17242d520 2024-05-08T09:00:20.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.048+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55e1722e5cb0 con 0x55e17242dee0 2024-05-08T09:00:20.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.048+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55e17243a490 con 0x55e172432f50 2024-05-08T09:00:20.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.048+0000 7f4c9da87b80 10 client.0 _ll_register_callbacks cb 0x55e172326e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:00:20.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.049+0000 7f4c8be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242d520 0x55e172439930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.049+0000 7f4c8be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242d520 0x55e172439930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44746/0 (socket says 172.21.15.70:44746) 2024-05-08T09:00:20.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.049+0000 7f4c8be00700 1 -- 172.21.15.70:0/816624651 learned_addr learned my addr 172.21.15.70:0/816624651 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:00:20.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.049+0000 7f4c8b400700 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e172436cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.049+0000 7f4c91000700 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e172437210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.050+0000 7f4c8be00700 1 -- 172.21.15.70:0/816624651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 msgr2=0x55e172437210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:00:20.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.050+0000 7f4c8be00700 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e172437210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.050+0000 7f4c8be00700 1 -- 172.21.15.70:0/816624651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 msgr2=0x55e172436cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:00:20.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.050+0000 7f4c8be00700 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e172436cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.050+0000 7f4c8be00700 1 -- 172.21.15.70:0/816624651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1723455b0 con 0x55e17242d520 2024-05-08T09:00:20.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.050+0000 7f4c8b400700 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e172436cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:00:20.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.051+0000 7f4c8be00700 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242d520 0x55e172439930 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0099c0 tx=0x7f4c7c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8c6df392de721a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:00:20.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.051+0000 7f4c76000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:00:20.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.051+0000 7f4c76000700 1 -- 172.21.15.70:0/816624651 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c023410 con 0x55e17242d520 2024-05-08T09:00:20.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.051+0000 7f4c76000700 1 -- 172.21.15.70:0/816624651 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(345..345 src has 1..345) ==== 9583+0+0 (secure 0 0 0) 0x7f4c7c0235b0 con 0x55e17242d520 2024-05-08T09:00:20.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.052+0000 7f4c9da87b80 1 -- 172.21.15.70:0/816624651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c78003680 con 0x55e17242d520 2024-05-08T09:00:20.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.052+0000 7f4c76000700 1 -- 172.21.15.70:0/816624651 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4c7c03b050 con 0x55e17242d520 2024-05-08T09:00:20.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.052+0000 7f4c9da87b80 10 client.18912 fetch_fsmap learned FSMap version 42 2024-05-08T09:00:20.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.052+0000 7f4c9da87b80 1 -- 172.21.15.70:0/816624651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e172444b30 con 0x55e17242d520 2024-05-08T09:00:20.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.053+0000 7f4c76000700 1 -- 172.21.15.70:0/816624651 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c78003680 con 0x55e17242d520 2024-05-08T09:00:20.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.053+0000 7f4c76000700 1 -- 172.21.15.70:0/816624651 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4c7c02d590 con 0x55e17242d520 2024-05-08T09:00:20.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.054+0000 7f4c9da87b80 10 client.18912 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:00:20.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.054+0000 7f4c9da87b80 10 client.18912 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:00:20.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.054+0000 7f4c9da87b80 20 client.18912 populate_metadata read hostname 'smithi070' 2024-05-08T09:00:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.054+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e172447170 0x55e172449590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.054+0000 7f4c9da87b80 4 client.18912 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:00:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.054+0000 7f4c9da87b80 1 -- 172.21.15.70:0/816624651 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1723fa230 con 0x55e172447170 2024-05-08T09:00:20.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.054+0000 7f4c8b400700 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e172447170 0x55e172449590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.056+0000 7f4c8b400700 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e172447170 0x55e172449590 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c076ba2e63aeb1d server_cookie=ec07bb092ef56fd8 in_seq=0 out_seq=0 2024-05-08T09:00:20.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.056+0000 7f4c76000700 10 client.18912 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:00:20.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.058+0000 7f4c76000700 1 -- 172.21.15.70:0/816624651 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e1723fa230 con 0x55e172447170 2024-05-08T09:00:20.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.058+0000 7f4c76000700 10 client.18912 handle_command_reply: tid=0 2024-05-08T09:00:20.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c9da87b80 1 client.18912 shutdown 2024-05-08T09:00:20.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c9da87b80 1 -- 172.21.15.70:0/816624651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242d520 msgr2=0x55e172439930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:20.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242d520 0x55e172439930 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0099c0 tx=0x7f4c7c009310 comp rx=0 tx=0).stop 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c9da87b80 1 -- 172.21.15.70:0/816624651 shutdown_connections 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e172447170 0x55e172449590 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e172437210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242d520 0x55e172439930 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/816624651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e172436cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c76000700 0 client.18912 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.059+0000 7f4c9da87b80 1 -- 172.21.15.70:0/816624651 >> 172.21.15.70:0/816624651 conn(0x55e17235bcf0 msgr2=0x55e1724228e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.060+0000 7f4c9da87b80 1 -- 172.21.15.70:0/816624651 shutdown_connections 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.060+0000 7f4c9da87b80 1 -- 172.21.15.70:0/816624651 wait complete. 2024-05-08T09:00:20.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.060+0000 7f4c9da87b80 20 client.18912 trim_cache size 0 max 16384 2024-05-08T09:00:20.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.096+0000 7f4c9da87b80 1 Processor -- start 2024-05-08T09:00:20.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.096+0000 7f4c9da87b80 1 -- start start 2024-05-08T09:00:20.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.097+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242dee0 0x55e1724433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.097+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e172432f50 0x55e172422760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.097+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172428140 0x55e17242f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.097+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1c1310 con 0x55e17242dee0 2024-05-08T09:00:20.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.097+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1beba0 con 0x55e172432f50 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.097+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1bca10 con 0x55e172428140 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.097+0000 7f4c8be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242dee0 0x55e1724433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.098+0000 7f4c8b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e172432f50 0x55e172422760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.098+0000 7f4c8b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e172432f50 0x55e172422760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:47050/0 (socket says 172.21.15.70:47050) 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.098+0000 7f4c8b400700 1 -- 172.21.15.70:0/1665709108 learned_addr learned my addr 172.21.15.70:0/1665709108 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.098+0000 7f4c91000700 1 --2- 172.21.15.70:0/1665709108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172428140 0x55e17242f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.098+0000 7f4c8b400700 1 -- 172.21.15.70:0/1665709108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172428140 msgr2=0x55e17242f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.098+0000 7f4c8b400700 1 --2- 172.21.15.70:0/1665709108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172428140 0x55e17242f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.098+0000 7f4c8b400700 1 -- 172.21.15.70:0/1665709108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242dee0 msgr2=0x55e1724433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.099+0000 7f4c8b400700 1 --2- 172.21.15.70:0/1665709108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242dee0 0x55e1724433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.099+0000 7f4c8b400700 1 -- 172.21.15.70:0/1665709108 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e172424a10 con 0x55e172432f50 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.099+0000 7f4c8be00700 1 --2- 172.21.15.70:0/1665709108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242dee0 0x55e1724433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:00:20.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.099+0000 7f4c8b400700 1 --2- 172.21.15.70:0/1665709108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e172432f50 0x55e172422760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c78005c20 tx=0x7f4c7800bd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd7b28128b1ec22b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:00:20.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.100+0000 7f4c80c00700 1 -- 172.21.15.70:0/1665709108 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c78003bf0 con 0x55e172432f50 2024-05-08T09:00:20.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.100+0000 7f4c80c00700 1 -- 172.21.15.70:0/1665709108 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c78005560 con 0x55e172432f50 2024-05-08T09:00:20.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.100+0000 7f4c80c00700 1 -- 172.21.15.70:0/1665709108 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7802a990 con 0x55e172432f50 2024-05-08T09:00:20.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.101+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1665709108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e172432f50 msgr2=0x55e172422760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:20.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.101+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1665709108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e172432f50 0x55e172422760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4c78005c20 tx=0x7f4c7800bd20 comp rx=0 tx=0).stop 2024-05-08T09:00:20.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.101+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1665709108 shutdown_connections 2024-05-08T09:00:20.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.101+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1665709108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172428140 0x55e17242f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.101+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1665709108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e17242dee0 0x55e1724433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.101+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1665709108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e172432f50 0x55e172422760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.101+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1665709108 >> 172.21.15.70:0/1665709108 conn(0x55e17235bcf0 msgr2=0x55e172422050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:00:20.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.102+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1665709108 shutdown_connections 2024-05-08T09:00:20.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.102+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1665709108 wait complete. 2024-05-08T09:00:20.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.103+0000 7f4c9da87b80 1 -- start start 2024-05-08T09:00:20.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.103+0000 7f4c9da87b80 1 Processor -- start 2024-05-08T09:00:20.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.103+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172428140 0x55e17243a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.104+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e17243ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.104+0000 7f4c9da87b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e17243b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.104+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1bd060 con 0x55e172428140 2024-05-08T09:00:20.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.104+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1be4d0 con 0x55e17242dee0 2024-05-08T09:00:20.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.104+0000 7f4c9da87b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8c1bd730 con 0x55e172432f50 2024-05-08T09:00:20.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.104+0000 7f4c9da87b80 10 client.0 _ll_register_callbacks cb 0x55e172326e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:00:20.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.104+0000 7f4c8be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172428140 0x55e17243a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.104+0000 7f4c91000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e17243b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.105+0000 7f4c91000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e17243b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:41060/0 (socket says 172.21.15.70:41060) 2024-05-08T09:00:20.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.105+0000 7f4c91000700 1 -- 172.21.15.70:0/1931579018 learned_addr learned my addr 172.21.15.70:0/1931579018 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:00:20.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.105+0000 7f4c8b400700 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e17243ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.105+0000 7f4c91000700 1 -- 172.21.15.70:0/1931579018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 msgr2=0x55e17243ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:00:20.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.105+0000 7f4c91000700 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e17243ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.105+0000 7f4c91000700 1 -- 172.21.15.70:0/1931579018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172428140 msgr2=0x55e17243a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:00:20.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.105+0000 7f4c91000700 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172428140 0x55e17243a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:20.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.105+0000 7f4c91000700 1 -- 172.21.15.70:0/1931579018 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1724b1a10 con 0x55e172432f50 2024-05-08T09:00:20.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.106+0000 7f4c91000700 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e17243b160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4c840a56e0 tx=0x7f4c840dfef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6ef277cc25929f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:00:20.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.106+0000 7f4c76000700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T09:00:20.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.107+0000 7f4c76000700 1 -- 172.21.15.70:0/1931579018 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c840a9660 con 0x55e172432f50 2024-05-08T09:00:20.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.107+0000 7f4c76000700 1 -- 172.21.15.70:0/1931579018 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(345..345 src has 1..345) ==== 9583+0+0 (secure 0 0 0) 0x7f4c840a98c0 con 0x55e172432f50 2024-05-08T09:00:20.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.107+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1931579018 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c78005560 con 0x55e172432f50 2024-05-08T09:00:20.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.107+0000 7f4c76000700 1 -- 172.21.15.70:0/1931579018 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4c840ada10 con 0x55e172432f50 2024-05-08T09:00:20.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.107+0000 7f4c9da87b80 10 client.27694 fetch_fsmap learned FSMap version 42 2024-05-08T09:00:20.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.107+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1931579018 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e1724b2c10 con 0x55e172432f50 2024-05-08T09:00:20.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.108+0000 7f4c76000700 1 -- 172.21.15.70:0/1931579018 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c78005560 con 0x55e172432f50 2024-05-08T09:00:20.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.108+0000 7f4c76000700 1 -- 172.21.15.70:0/1931579018 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4c840e2220 con 0x55e172432f50 2024-05-08T09:00:20.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.109+0000 7f4c9da87b80 10 client.27694 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:00:20.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.109+0000 7f4c9da87b80 10 client.27694 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:00:20.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.109+0000 7f4c9da87b80 20 client.27694 populate_metadata read hostname 'smithi070' 2024-05-08T09:00:20.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.109+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e1724b3380 0x55e1724b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:00:20.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.109+0000 7f4c9da87b80 4 client.27694 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.9, "await_for": 42.0}] 2024-05-08T09:00:20.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.109+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1931579018 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.9, "await_for": 42.0}) -- 0x55e17238d590 con 0x55e1724b3380 2024-05-08T09:00:20.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.356+0000 7f4c8be00700 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e1724b3380 0x55e1724b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:00:20.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.357+0000 7f4c8be00700 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e1724b3380 0x55e1724b57a0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fe969104a3c84b7 server_cookie=5df14b5ba151438e in_seq=0 out_seq=0 2024-05-08T09:00:20.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:20.357+0000 7f4c76000700 10 client.27694 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:00:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:00:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:00:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:20.639 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/virtio_scsi.o 2024-05-08T09:00:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:00:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:00:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:20.906 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/cdrom/built-in.a 2024-05-08T09:00:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:00:20.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:00:20.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:00:21.141 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-acpi.o 2024-05-08T09:00:21.390 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/fixed_phy.o 2024-05-08T09:00:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:21 smithi194 ceph-mon[33679]: pgmap v4267: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 781 KiB/s wr, 25 op/s 2024-05-08T09:00:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:21 smithi070 ceph-mon[29591]: pgmap v4267: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 781 KiB/s wr, 25 op/s 2024-05-08T09:00:21.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:21 smithi172 ceph-mon[33377]: pgmap v4267: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 781 KiB/s wr, 25 op/s 2024-05-08T09:00:22.458 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/phy/realtek.o 2024-05-08T09:00:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:23 smithi194 ceph-mon[33679]: pgmap v4268: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 699 KiB/s wr, 23 op/s 2024-05-08T09:00:23.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:23 smithi070 ceph-mon[29591]: pgmap v4268: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 699 KiB/s wr, 23 op/s 2024-05-08T09:00:23.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:23 smithi172 ceph-mon[33377]: pgmap v4268: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 699 KiB/s wr, 23 op/s 2024-05-08T09:00:25.731 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:25 smithi172 ceph-mon[33377]: pgmap v4269: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 867 KiB/s wr, 33 op/s 2024-05-08T09:00:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:25 smithi194 ceph-mon[33679]: pgmap v4269: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 867 KiB/s wr, 33 op/s 2024-05-08T09:00:25.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:25 smithi070 ceph-mon[29591]: pgmap v4269: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 833 KiB/s rd, 867 KiB/s wr, 33 op/s 2024-05-08T09:00:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:27 smithi194 ceph-mon[33679]: pgmap v4270: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 513 KiB/s wr, 24 op/s 2024-05-08T09:00:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:27 smithi070 ceph-mon[29591]: pgmap v4270: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 513 KiB/s wr, 24 op/s 2024-05-08T09:00:27.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:27 smithi172 ceph-mon[33377]: pgmap v4270: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 513 KiB/s wr, 24 op/s 2024-05-08T09:00:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:29 smithi194 ceph-mon[33679]: pgmap v4271: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 513 KiB/s wr, 23 op/s 2024-05-08T09:00:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:29 smithi070 ceph-mon[29591]: pgmap v4271: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 513 KiB/s wr, 23 op/s 2024-05-08T09:00:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:29 smithi172 ceph-mon[33377]: pgmap v4271: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 465 KiB/s rd, 513 KiB/s wr, 23 op/s 2024-05-08T09:00:31.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:31 smithi194 ceph-mon[33679]: pgmap v4272: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 585 KiB/s wr, 28 op/s 2024-05-08T09:00:31.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:31 smithi070 ceph-mon[29591]: pgmap v4272: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 585 KiB/s wr, 28 op/s 2024-05-08T09:00:31.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:31 smithi172 ceph-mon[33377]: pgmap v4272: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 585 KiB/s wr, 28 op/s 2024-05-08T09:00:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:33 smithi194 ceph-mon[33679]: pgmap v4273: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 295 KiB/s wr, 18 op/s 2024-05-08T09:00:33.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:33 smithi070 ceph-mon[29591]: pgmap v4273: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 295 KiB/s wr, 18 op/s 2024-05-08T09:00:33.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:33 smithi172 ceph-mon[33377]: pgmap v4273: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 295 KiB/s wr, 18 op/s 2024-05-08T09:00:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:35 smithi070 ceph-mon[29591]: pgmap v4274: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 347 KiB/s wr, 22 op/s 2024-05-08T09:00:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:35 smithi194 ceph-mon[33679]: pgmap v4274: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 347 KiB/s wr, 22 op/s 2024-05-08T09:00:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:35 smithi172 ceph-mon[33377]: pgmap v4274: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 347 KiB/s wr, 22 op/s 2024-05-08T09:00:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:37 smithi194 ceph-mon[33679]: pgmap v4275: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 132 KiB/s wr, 10 op/s 2024-05-08T09:00:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:37 smithi070 ceph-mon[29591]: pgmap v4275: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 132 KiB/s wr, 10 op/s 2024-05-08T09:00:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:37 smithi172 ceph-mon[33377]: pgmap v4275: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 132 KiB/s wr, 10 op/s 2024-05-08T09:00:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:39 smithi194 ceph-mon[33679]: pgmap v4276: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 9 op/s 2024-05-08T09:00:39.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:39 smithi070 ceph-mon[29591]: pgmap v4276: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 9 op/s 2024-05-08T09:00:39.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:39 smithi172 ceph-mon[33377]: pgmap v4276: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 125 KiB/s wr, 9 op/s 2024-05-08T09:00:41.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:41 smithi070 ceph-mon[29591]: pgmap v4277: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 13 op/s 2024-05-08T09:00:41.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:41 smithi172 ceph-mon[33377]: pgmap v4277: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 13 op/s 2024-05-08T09:00:42.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:41 smithi194 ceph-mon[33679]: pgmap v4277: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 172 KiB/s wr, 13 op/s 2024-05-08T09:00:43.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:43 smithi070 ceph-mon[29591]: pgmap v4278: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 7 op/s 2024-05-08T09:00:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:43 smithi172 ceph-mon[33377]: pgmap v4278: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 7 op/s 2024-05-08T09:00:44.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:43 smithi194 ceph-mon[33679]: pgmap v4278: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 99 KiB/s wr, 7 op/s 2024-05-08T09:00:44.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.889+0000 7f4c76000700 1 -- 172.21.15.70:0/1931579018 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55e17238d590 con 0x55e1724b3380 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.889+0000 7f4c76000700 10 client.27694 handle_command_reply: tid=0 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.889+0000 7f4c9da87b80 1 client.27694 shutdown 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.889+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1931579018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 msgr2=0x55e17243b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.889+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e17243b160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4c840a56e0 tx=0x7f4c840dfef0 comp rx=0 tx=0).stop 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.890+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1931579018 shutdown_connections 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.890+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55e1724b3380 0x55e1724b57a0 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.890+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55e172432f50 0x55e17243b160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.890+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e172428140 0x55e17243a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.890+0000 7f4c9da87b80 1 --2- 172.21.15.70:0/1931579018 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55e17242dee0 0x55e17243ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.890+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1931579018 >> 172.21.15.70:0/1931579018 conn(0x55e17235bcf0 msgr2=0x55e1724228e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.890+0000 7f4c76000700 0 client.27694 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:00:44.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.890+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1931579018 shutdown_connections 2024-05-08T09:00:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.890+0000 7f4c9da87b80 1 -- 172.21.15.70:0/1931579018 wait complete. 2024-05-08T09:00:44.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.891+0000 7f4c9da87b80 20 client.27694 trim_cache size 0 max 16384 2024-05-08T09:00:44.891 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:00:44.891 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:00:44.891 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:00:44.891 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 298, 2024-05-08T09:00:44.891 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:00:44.891 INFO:teuthology.orchestra.run.smithi070.stdout: "890a1b5a": { 2024-05-08T09:00:44.891 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 298, 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.9, 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:00:44.892 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:00:44.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:00:44.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:00:44.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:00:44.893 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:00:44.893 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:00:44.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 -- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c700b2b20 msgr2=0x7f4c700b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c700b2b20 0x7f4c700b4fe0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c0098e0 tx=0x7f4c7c01a040 comp rx=0 tx=0).stop 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 -- 172.21.15.70:0/2528503395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c116120 msgr2=0x7f4c8c1b4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c116120 0x7f4c8c1b4c90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400cc50 tx=0x7f4c8400cf60 comp rx=0 tx=0).stop 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 -- 172.21.15.70:0/2528503395 shutdown_connections 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c700b2b20 0x7f4c700b4fe0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c8c116120 0x7f4c8c1b4c90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c8c10adc0 0x7f4c8c1156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 --2- 172.21.15.70:0/2528503395 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c8c1189e0 0x7f4c8c115be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.892+0000 7f4c93000700 1 -- 172.21.15.70:0/2528503395 >> 172.21.15.70:0/2528503395 conn(0x7f4c8c06e610 msgr2=0x7f4c8c119040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.893+0000 7f4c93000700 1 -- 172.21.15.70:0/2528503395 shutdown_connections 2024-05-08T09:00:44.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:00:44.893+0000 7f4c93000700 1 -- 172.21.15.70:0/2528503395 wait complete. 2024-05-08T09:00:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:45 smithi070 ceph-mon[29591]: pgmap v4279: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 176 KiB/s wr, 10 op/s 2024-05-08T09:00:45.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:45 smithi172 ceph-mon[33377]: pgmap v4279: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 176 KiB/s wr, 10 op/s 2024-05-08T09:00:46.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:45 smithi194 ceph-mon[33679]: pgmap v4279: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 176 KiB/s wr, 10 op/s 2024-05-08T09:00:46.021 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '890a1b5a', quiesce took 39.7 seconds. Will release after: 27.9 2024-05-08T09:00:47.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:47 smithi070 ceph-mon[29591]: pgmap v4280: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 124 KiB/s wr, 7 op/s 2024-05-08T09:00:47.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:47 smithi172 ceph-mon[33377]: pgmap v4280: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 124 KiB/s wr, 7 op/s 2024-05-08T09:00:48.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:47 smithi194 ceph-mon[33679]: pgmap v4280: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 124 KiB/s wr, 7 op/s 2024-05-08T09:00:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:49 smithi070 ceph-mon[29591]: pgmap v4281: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 124 KiB/s wr, 6 op/s 2024-05-08T09:00:49.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:49 smithi172 ceph-mon[33377]: pgmap v4281: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 124 KiB/s wr, 6 op/s 2024-05-08T09:00:50.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:49 smithi194 ceph-mon[33679]: pgmap v4281: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 124 KiB/s wr, 6 op/s 2024-05-08T09:00:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:51 smithi070 ceph-mon[29591]: pgmap v4282: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 174 KiB/s wr, 11 op/s 2024-05-08T09:00:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:51 smithi172 ceph-mon[33377]: pgmap v4282: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 174 KiB/s wr, 11 op/s 2024-05-08T09:00:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:51 smithi194 ceph-mon[33679]: pgmap v4282: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 174 KiB/s wr, 11 op/s 2024-05-08T09:00:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:53 smithi070 ceph-mon[29591]: pgmap v4283: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 127 KiB/s wr, 7 op/s 2024-05-08T09:00:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:53 smithi172 ceph-mon[33377]: pgmap v4283: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 127 KiB/s wr, 7 op/s 2024-05-08T09:00:54.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:53 smithi194 ceph-mon[33679]: pgmap v4283: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 127 KiB/s wr, 7 op/s 2024-05-08T09:00:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:55 smithi070 ceph-mon[29591]: pgmap v4284: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 144 KiB/s wr, 10 op/s 2024-05-08T09:00:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:55 smithi172 ceph-mon[33377]: pgmap v4284: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 144 KiB/s wr, 10 op/s 2024-05-08T09:00:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:55 smithi194 ceph-mon[33679]: pgmap v4284: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 144 KiB/s wr, 10 op/s 2024-05-08T09:00:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:57 smithi070 ceph-mon[29591]: pgmap v4285: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 66 KiB/s wr, 8 op/s 2024-05-08T09:00:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:57 smithi172 ceph-mon[33377]: pgmap v4285: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 66 KiB/s wr, 8 op/s 2024-05-08T09:00:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:57 smithi194 ceph-mon[33679]: pgmap v4285: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 66 KiB/s wr, 8 op/s 2024-05-08T09:00:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:00:59 smithi070 ceph-mon[29591]: pgmap v4286: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 66 KiB/s wr, 7 op/s 2024-05-08T09:00:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:00:59 smithi172 ceph-mon[33377]: pgmap v4286: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 66 KiB/s wr, 7 op/s 2024-05-08T09:01:00.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:00:59 smithi194 ceph-mon[33679]: pgmap v4286: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 66 KiB/s wr, 7 op/s 2024-05-08T09:01:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:01 smithi070 ceph-mon[29591]: pgmap v4287: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 66 KiB/s wr, 10 op/s 2024-05-08T09:01:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:01 smithi172 ceph-mon[33377]: pgmap v4287: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 66 KiB/s wr, 10 op/s 2024-05-08T09:01:02.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:01 smithi194 ceph-mon[33679]: pgmap v4287: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 66 KiB/s wr, 10 op/s 2024-05-08T09:01:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:03 smithi070 ceph-mon[29591]: pgmap v4288: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-05-08T09:01:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:03 smithi172 ceph-mon[33377]: pgmap v4288: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-05-08T09:01:04.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:03 smithi194 ceph-mon[33679]: pgmap v4288: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 16 KiB/s wr, 5 op/s 2024-05-08T09:01:05.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:05 smithi070 ceph-mon[29591]: pgmap v4289: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 61 KiB/s wr, 25 op/s 2024-05-08T09:01:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:05 smithi172 ceph-mon[33377]: pgmap v4289: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 61 KiB/s wr, 25 op/s 2024-05-08T09:01:06.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:05 smithi194 ceph-mon[33679]: pgmap v4289: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 61 KiB/s wr, 25 op/s 2024-05-08T09:01:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:07 smithi070 ceph-mon[29591]: pgmap v4290: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:01:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:07 smithi172 ceph-mon[33377]: pgmap v4290: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:01:08.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:07 smithi194 ceph-mon[33679]: pgmap v4290: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:01:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:09 smithi070 ceph-mon[29591]: pgmap v4291: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:01:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:09 smithi172 ceph-mon[33377]: pgmap v4291: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:01:10.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:09 smithi194 ceph-mon[33679]: pgmap v4291: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:01:10.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:10 smithi070 ceph-mon[29591]: osdmap e346: 12 total, 12 up, 12 in 2024-05-08T09:01:10.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:10 smithi172 ceph-mon[33377]: osdmap e346: 12 total, 12 up, 12 in 2024-05-08T09:01:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:10 smithi194 ceph-mon[33679]: osdmap e346: 12 total, 12 up, 12 in 2024-05-08T09:01:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:11 smithi070 ceph-mon[29591]: pgmap v4293: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:01:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:11 smithi172 ceph-mon[33377]: pgmap v4293: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:01:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:11 smithi194 ceph-mon[33679]: pgmap v4293: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:01:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:12 smithi172 ceph-mon[33377]: pgmap v4294: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:01:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:12 smithi194 ceph-mon[33679]: pgmap v4294: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:01:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:12 smithi070 ceph-mon[29591]: pgmap v4294: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:01:13.922 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:01:14.444 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:01:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:15 smithi070 ceph-mon[29591]: pgmap v4295: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:01:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:15 smithi172 ceph-mon[33377]: pgmap v4295: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:01:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:15 smithi194 ceph-mon[33679]: pgmap v4295: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:01:16.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.908+0000 7fe695e00700 1 -- 172.21.15.70:0/356575753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 msgr2=0x7fe690105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:16.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.908+0000 7fe695e00700 1 --2- 172.21.15.70:0/356575753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 0x7fe690105b40 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009990 tx=0x7fe67c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:01:16.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.909+0000 7fe695e00700 1 -- 172.21.15.70:0/356575753 shutdown_connections 2024-05-08T09:01:16.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.909+0000 7fe695e00700 1 --2- 172.21.15.70:0/356575753 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe690106080 0x7fe690112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:16.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.909+0000 7fe695e00700 1 --2- 172.21.15.70:0/356575753 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe69010b6c0 0x7fe69010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:16.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.909+0000 7fe695e00700 1 --2- 172.21.15.70:0/356575753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 0x7fe690105b40 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:16.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.909+0000 7fe695e00700 1 -- 172.21.15.70:0/356575753 >> 172.21.15.70:0/356575753 conn(0x7fe6901011b0 msgr2=0x7fe6901035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:16.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.909+0000 7fe695e00700 1 -- 172.21.15.70:0/356575753 shutdown_connections 2024-05-08T09:01:16.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.909+0000 7fe695e00700 1 -- 172.21.15.70:0/356575753 wait complete. 2024-05-08T09:01:16.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.910+0000 7fe695e00700 1 Processor -- start 2024-05-08T09:01:16.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.910+0000 7fe695e00700 1 -- start start 2024-05-08T09:01:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.910+0000 7fe695e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 0x7fe6901a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.910+0000 7fe695e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe690106080 0x7fe6901a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe695e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe69010b6c0 0x7fe69019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe695e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe690115770 con 0x7fe6901056c0 2024-05-08T09:01:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe695e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901155f0 con 0x7fe690106080 2024-05-08T09:01:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe695e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe6901158f0 con 0x7fe69010b6c0 2024-05-08T09:01:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe68ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 0x7fe6901a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe68ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 0x7fe6901a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49064/0 (socket says 172.21.15.70:49064) 2024-05-08T09:01:16.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe68ea00700 1 -- 172.21.15.70:0/2274333091 learned_addr learned my addr 172.21.15.70:0/2274333091 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:16.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe68ea00700 1 -- 172.21.15.70:0/2274333091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe69010b6c0 msgr2=0x7fe69019bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:16.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe68e000700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe690106080 0x7fe6901a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:16.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe68ea00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe69010b6c0 0x7fe69019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe68ea00700 1 -- 172.21.15.70:0/2274333091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe690106080 msgr2=0x7fe6901a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe68ea00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe690106080 0x7fe6901a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.911+0000 7fe68ea00700 1 -- 172.21.15.70:0/2274333091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69019c230 con 0x7fe6901056c0 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.912+0000 7fe68ea00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 0x7fe6901a1910 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe68000d950 tx=0x7fe68000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.912+0000 7fe694a00700 1 -- 172.21.15.70:0/2274333091 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe680016070 con 0x7fe6901056c0 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.912+0000 7fe694a00700 1 -- 172.21.15.70:0/2274333091 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe680010460 con 0x7fe6901056c0 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.912+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe69019c520 con 0x7fe6901056c0 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.912+0000 7fe694a00700 1 -- 172.21.15.70:0/2274333091 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe68000f620 con 0x7fe6901056c0 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.912+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6901a87e0 con 0x7fe6901056c0 2024-05-08T09:01:16.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.914+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe69006a190 con 0x7fe6901056c0 2024-05-08T09:01:16.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.916+0000 7fe694a00700 1 -- 172.21.15.70:0/2274333091 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe680019070 con 0x7fe6901056c0 2024-05-08T09:01:16.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.917+0000 7fe694a00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6740b2a70 0x7fe6740b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:16.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.917+0000 7fe694a00700 1 -- 172.21.15.70:0/2274333091 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(346..346 src has 1..346) ==== 9671+0+0 (secure 0 0 0) 0x7fe6800e2610 con 0x7fe6901056c0 2024-05-08T09:01:16.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.917+0000 7fe68e000700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6740b2a70 0x7fe6740b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:16.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.918+0000 7fe68e000700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6740b2a70 0x7fe6740b4f30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00b5c0 tx=0x7fe67c005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:16.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:16.932+0000 7fe694a00700 1 -- 172.21.15.70:0/2274333091 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe6800a9b10 con 0x7fe6901056c0 2024-05-08T09:01:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.215+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe69002e6d0 con 0x7fe6901056c0 2024-05-08T09:01:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.216+0000 7fe694a00700 1 -- 172.21.15.70:0/2274333091 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fe6800a9410 con 0x7fe6901056c0 2024-05-08T09:01:17.215 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:01:17.215 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:01:17.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6740b2a70 msgr2=0x7fe6740b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:17.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6740b2a70 0x7fe6740b4f30 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00b5c0 tx=0x7fe67c005fb0 comp rx=0 tx=0).stop 2024-05-08T09:01:17.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 msgr2=0x7fe6901a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:17.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 0x7fe6901a1910 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe68000d950 tx=0x7fe68000dd10 comp rx=0 tx=0).stop 2024-05-08T09:01:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 shutdown_connections 2024-05-08T09:01:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe6740b2a70 0x7fe6740b4f30 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe69010b6c0 0x7fe69019bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe6901056c0 0x7fe6901a1910 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 --2- 172.21.15.70:0/2274333091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe690106080 0x7fe6901a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.219+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 >> 172.21.15.70:0/2274333091 conn(0x7fe6901011b0 msgr2=0x7fe6901018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.220+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 shutdown_connections 2024-05-08T09:01:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:17.220+0000 7fe695e00700 1 -- 172.21.15.70:0/2274333091 wait complete. 2024-05-08T09:01:17.219 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:01:17.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:17 smithi070 ceph-mon[29591]: pgmap v4296: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:01:17.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:17 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2274333091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:01:17.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:17 smithi172 ceph-mon[33377]: pgmap v4296: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:01:17.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:17 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2274333091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:01:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:17 smithi194 ceph-mon[33679]: pgmap v4296: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:01:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:17 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2274333091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:01:18.175 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 890a1b5a --release --await' 2024-05-08T09:01:18.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 890a1b5a --release --await 2024-05-08T09:01:18.624 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:01:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:19 smithi070 ceph-mon[29591]: pgmap v4297: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:01:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:19 smithi172 ceph-mon[33377]: pgmap v4297: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:01:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:19 smithi194 ceph-mon[33679]: pgmap v4297: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:01:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.068+0000 7fa86fe00700 1 -- 172.21.15.70:0/2547337036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa868075ff0 msgr2=0x7fa86810f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.068+0000 7fa86fe00700 1 --2- 172.21.15.70:0/2547337036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa868075ff0 0x7fa86810f990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa8540098f0 tx=0x7fa854009c00 comp rx=0 tx=0).stop 2024-05-08T09:01:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.068+0000 7fa86fe00700 1 -- 172.21.15.70:0/2547337036 shutdown_connections 2024-05-08T09:01:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.068+0000 7fa86fe00700 1 --2- 172.21.15.70:0/2547337036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa86810fed0 0x7fa8681122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.068+0000 7fa86fe00700 1 --2- 172.21.15.70:0/2547337036 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8680756d0 0x7fa868075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.068+0000 7fa86fe00700 1 --2- 172.21.15.70:0/2547337036 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa868075ff0 0x7fa86810f990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.068+0000 7fa86fe00700 1 -- 172.21.15.70:0/2547337036 >> 172.21.15.70:0/2547337036 conn(0x7fa86807a650 msgr2=0x7fa86807aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.068+0000 7fa86fe00700 1 -- 172.21.15.70:0/2547337036 shutdown_connections 2024-05-08T09:01:21.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.068+0000 7fa86fe00700 1 -- 172.21.15.70:0/2547337036 wait complete. 2024-05-08T09:01:21.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.069+0000 7fa86fe00700 1 Processor -- start 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.069+0000 7fa86fe00700 1 -- start start 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680756d0 0x7fa86819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa868075ff0 0x7fa86819c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa86810fed0 0x7fa8681a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681157a0 con 0x7fa8680756d0 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86fe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa868115620 con 0x7fa868075ff0 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86fe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa868115920 con 0x7fa86810fed0 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680756d0 0x7fa86819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680756d0 0x7fa86819bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50458/0 (socket says 172.21.15.70:50458) 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86d400700 1 -- 172.21.15.70:0/531816699 learned_addr learned my addr 172.21.15.70:0/531816699 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:21.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.070+0000 7fa86ca00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa868075ff0 0x7fa86819c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.071+0000 7fa86de00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa86810fed0 0x7fa8681a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.071+0000 7fa86ca00700 1 -- 172.21.15.70:0/531816699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa86810fed0 msgr2=0x7fa8681a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.071+0000 7fa86ca00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa86810fed0 0x7fa8681a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.071+0000 7fa86ca00700 1 -- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680756d0 msgr2=0x7fa86819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.071+0000 7fa86ca00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680756d0 0x7fa86819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.071+0000 7fa86ca00700 1 -- 172.21.15.70:0/531816699 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8681a0d70 con 0x7fa868075ff0 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.071+0000 7fa86d400700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680756d0 0x7fa86819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.071+0000 7fa86ca00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa868075ff0 0x7fa86819c2a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa854000c00 tx=0x7fa85400f990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.072+0000 7fa866000700 1 -- 172.21.15.70:0/531816699 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85400b560 con 0x7fa868075ff0 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.072+0000 7fa86fe00700 1 -- 172.21.15.70:0/531816699 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8681a1000 con 0x7fa868075ff0 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.072+0000 7fa866000700 1 -- 172.21.15.70:0/531816699 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa85400bb90 con 0x7fa868075ff0 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.072+0000 7fa866000700 1 -- 172.21.15.70:0/531816699 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8540038e0 con 0x7fa868075ff0 2024-05-08T09:01:21.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.072+0000 7fa86fe00700 1 -- 172.21.15.70:0/531816699 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8681a88e0 con 0x7fa868075ff0 2024-05-08T09:01:21.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.078+0000 7fa866000700 1 -- 172.21.15.70:0/531816699 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa8540052d0 con 0x7fa868075ff0 2024-05-08T09:01:21.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.080+0000 7fa866000700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa8500b2a70 0x7fa8500b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.080+0000 7fa866000700 1 -- 172.21.15.70:0/531816699 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(347..347 src has 1..347) ==== 9583+0+0 (secure 0 0 0) 0x7fa8540e3910 con 0x7fa868075ff0 2024-05-08T09:01:21.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.080+0000 7fa86d400700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa8500b2a70 0x7fa8500b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.081+0000 7fa86d400700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa8500b2a70 0x7fa8500b4f30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa85c011590 tx=0x7fa85c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:21.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.090+0000 7fa87a856b80 1 Processor -- start 2024-05-08T09:01:21.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.090+0000 7fa87a856b80 1 -- start start 2024-05-08T09:01:21.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5cd1b0 0x563e8d5cd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d5d3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa87a856b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e8d519b20 con 0x563e8d5cd1b0 2024-05-08T09:01:21.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa87a856b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563e8d4b7860 con 0x563e8d5c7780 2024-05-08T09:01:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa87a856b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563e8d515ae0 con 0x563e8d5c8140 2024-05-08T09:01:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa86d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5cd1b0 0x563e8d5cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa86d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5cd1b0 0x563e8d5cd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50474/0 (socket says 172.21.15.70:50474) 2024-05-08T09:01:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa86d400700 1 -- 172.21.15.70:0/1007040214 learned_addr learned my addr 172.21.15.70:0/1007040214 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa86ca00700 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.091+0000 7fa86de00700 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d5d3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.092+0000 7fa86d400700 1 -- 172.21.15.70:0/1007040214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 msgr2=0x563e8d5d3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.092+0000 7fa86d400700 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d5d3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.092+0000 7fa86d400700 1 -- 172.21.15.70:0/1007040214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 msgr2=0x563e8d5c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.092+0000 7fa86d400700 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.092+0000 7fa86d400700 1 -- 172.21.15.70:0/1007040214 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e8d4669d0 con 0x563e8d5cd1b0 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.092+0000 7fa86ca00700 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.092+0000 7fa86d400700 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5cd1b0 0x563e8d5cd590 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa85c01c620 tx=0x7fa85c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d456cdebced86b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.093+0000 7fa85aa00700 1 -- 172.21.15.70:0/1007040214 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c026430 con 0x563e8d5cd1b0 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.093+0000 7fa85aa00700 1 -- 172.21.15.70:0/1007040214 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa85c01d8a0 con 0x563e8d5cd1b0 2024-05-08T09:01:21.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.093+0000 7fa85aa00700 1 -- 172.21.15.70:0/1007040214 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c025980 con 0x563e8d5cd1b0 2024-05-08T09:01:21.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.093+0000 7fa87a856b80 1 -- 172.21.15.70:0/1007040214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5cd1b0 msgr2=0x563e8d5cd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.093+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5cd1b0 0x563e8d5cd590 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa85c01c620 tx=0x7fa85c014000 comp rx=0 tx=0).stop 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.094+0000 7fa87a856b80 1 -- 172.21.15.70:0/1007040214 shutdown_connections 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.094+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d5d3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.094+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5cd1b0 0x563e8d5cd590 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.094+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1007040214 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.094+0000 7fa87a856b80 1 -- 172.21.15.70:0/1007040214 >> 172.21.15.70:0/1007040214 conn(0x563e8d53f7d0 msgr2=0x563e8d5c2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.094+0000 7fa87a856b80 1 -- 172.21.15.70:0/1007040214 shutdown_connections 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.094+0000 7fa87a856b80 1 -- 172.21.15.70:0/1007040214 wait complete. 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.094+0000 7fa87a856b80 1 -- start start 2024-05-08T09:01:21.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.095+0000 7fa87a856b80 1 Processor -- start 2024-05-08T09:01:21.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.095+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.095+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c8140 0x563e8d5d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.095+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 0x563e8d5d1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.095+0000 7fa87a856b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563e8d5d4570 con 0x563e8d5c8140 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.095+0000 7fa87a856b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563e8d47fc20 con 0x563e8d5c7780 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.095+0000 7fa87a856b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563e8d5d46f0 con 0x563e8d5cd1b0 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.095+0000 7fa87a856b80 10 client.0 _ll_register_callbacks cb 0x563e8d4c0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86d400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c8140 0x563e8d5d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86d400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5d3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:49086/0 (socket says 172.21.15.70:49086) 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86d400700 1 -- 172.21.15.70:0/3976312013 learned_addr learned my addr 172.21.15.70:0/3976312013 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86de00700 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 0x563e8d5d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86ca00700 1 -- 172.21.15.70:0/3976312013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 msgr2=0x563e8d5d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:21.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86ca00700 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 0x563e8d5d1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86ca00700 1 -- 172.21.15.70:0/3976312013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 msgr2=0x563e8d5d3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:21.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86ca00700 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5d3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86ca00700 1 -- 172.21.15.70:0/3976312013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e8d4df520 con 0x563e8d5c8140 2024-05-08T09:01:21.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.096+0000 7fa86d400700 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:01:21.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.097+0000 7fa86ca00700 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c8140 0x563e8d5d0f20 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa8540e0be0 tx=0x7fa8540a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcff13eba927fb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:21.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.097+0000 7fa84f400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:01:21.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.097+0000 7fa84f400700 1 -- 172.21.15.70:0/3976312013 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8540aaf00 con 0x563e8d5c8140 2024-05-08T09:01:21.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.097+0000 7fa84f400700 1 -- 172.21.15.70:0/3976312013 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(347..347 src has 1..347) ==== 9583+0+0 (secure 0 0 0) 0x7fa8540e0e60 con 0x563e8d5c8140 2024-05-08T09:01:21.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.097+0000 7fa87a856b80 1 -- 172.21.15.70:0/3976312013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa85c01d8a0 con 0x563e8d5c8140 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.097+0000 7fa84f400700 1 -- 172.21.15.70:0/3976312013 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa8540aa800 con 0x563e8d5c8140 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.097+0000 7fa87a856b80 10 client.18936 fetch_fsmap learned FSMap version 42 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.097+0000 7fa87a856b80 1 -- 172.21.15.70:0/3976312013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563e8d5ded70 con 0x563e8d5c8140 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.098+0000 7fa84f400700 1 -- 172.21.15.70:0/3976312013 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa85c01d8a0 con 0x563e8d5c8140 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.098+0000 7fa84f400700 1 -- 172.21.15.70:0/3976312013 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa8540aaaf0 con 0x563e8d5c8140 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.098+0000 7fa87a856b80 10 client.18936 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.098+0000 7fa87a856b80 10 client.18936 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.098+0000 7fa87a856b80 20 client.18936 populate_metadata read hostname 'smithi070' 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.098+0000 7fa87a856b80 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e8d5e12e0 0x563e8d5e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.098+0000 7fa87a856b80 4 client.18936 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.098+0000 7fa87a856b80 1 -- 172.21.15.70:0/3976312013 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e8d594240 con 0x563e8d5e12e0 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.099+0000 7fa86d400700 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e8d5e12e0 0x563e8d5e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.099+0000 7fa84f400700 10 client.18936 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:01:21.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.099+0000 7fa86d400700 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e8d5e12e0 0x563e8d5e36d0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2258b82f53e5f11d server_cookie=2759d10955eeb343 in_seq=0 out_seq=0 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa84f400700 1 -- 172.21.15.70:0/3976312013 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563e8d594240 con 0x563e8d5e12e0 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa84f400700 10 client.18936 handle_command_reply: tid=0 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 client.18936 shutdown 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 -- 172.21.15.70:0/3976312013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c8140 msgr2=0x563e8d5d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c8140 0x563e8d5d0f20 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa8540e0be0 tx=0x7fa8540a9f70 comp rx=0 tx=0).stop 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 -- 172.21.15.70:0/3976312013 shutdown_connections 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e8d5e12e0 0x563e8d5e36d0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 0x563e8d5d1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c7780 0x563e8d5d3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 --2- 172.21.15.70:0/3976312013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c8140 0x563e8d5d0f20 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 -- 172.21.15.70:0/3976312013 >> 172.21.15.70:0/3976312013 conn(0x563e8d53f7d0 msgr2=0x563e8d5bcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa84f400700 0 client.18936 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.101+0000 7fa87a856b80 1 -- 172.21.15.70:0/3976312013 shutdown_connections 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.102+0000 7fa87a856b80 1 -- 172.21.15.70:0/3976312013 wait complete. 2024-05-08T09:01:21.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.102+0000 7fa87a856b80 20 client.18936 trim_cache size 0 max 16384 2024-05-08T09:01:21.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.137+0000 7fa87a856b80 1 Processor -- start 2024-05-08T09:01:21.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.137+0000 7fa87a856b80 1 -- start start 2024-05-08T09:01:21.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.137+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 0x563e8d5dd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.137+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c8140 0x563e8d5e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.137+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 0x563e8d5e9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.137+0000 7fa87a856b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b3fc0 con 0x563e8d5c7780 2024-05-08T09:01:21.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.137+0000 7fa87a856b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b1850 con 0x563e8d5c8140 2024-05-08T09:01:21.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.138+0000 7fa87a856b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681af6c0 con 0x563e8d5cd1b0 2024-05-08T09:01:21.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.138+0000 7fa86ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c8140 0x563e8d5e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.138+0000 7fa86ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c8140 0x563e8d5e8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:49102/0 (socket says 172.21.15.70:49102) 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.138+0000 7fa86ca00700 1 -- 172.21.15.70:0/900198539 learned_addr learned my addr 172.21.15.70:0/900198539 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.138+0000 7fa86de00700 1 --2- 172.21.15.70:0/900198539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 0x563e8d5e9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.138+0000 7fa86d400700 1 --2- 172.21.15.70:0/900198539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 0x563e8d5dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.139+0000 7fa86ca00700 1 -- 172.21.15.70:0/900198539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 msgr2=0x563e8d5e9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.139+0000 7fa86ca00700 1 --2- 172.21.15.70:0/900198539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 0x563e8d5e9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.139+0000 7fa86ca00700 1 -- 172.21.15.70:0/900198539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 msgr2=0x563e8d5dd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.139+0000 7fa86ca00700 1 --2- 172.21.15.70:0/900198539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 0x563e8d5dd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.139+0000 7fa86ca00700 1 -- 172.21.15.70:0/900198539 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e8d5e3d30 con 0x563e8d5c8140 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.139+0000 7fa86ca00700 1 --2- 172.21.15.70:0/900198539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c8140 0x563e8d5e8fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa854009680 tx=0x7fa8540b32d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa02b983a9bbfebe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.140+0000 7fa85a000700 1 -- 172.21.15.70:0/900198539 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8540aaf00 con 0x563e8d5c8140 2024-05-08T09:01:21.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.140+0000 7fa85a000700 1 -- 172.21.15.70:0/900198539 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8540aebb0 con 0x563e8d5c8140 2024-05-08T09:01:21.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.140+0000 7fa85a000700 1 -- 172.21.15.70:0/900198539 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8540a6a90 con 0x563e8d5c8140 2024-05-08T09:01:21.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.141+0000 7fa87a856b80 1 -- 172.21.15.70:0/900198539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c8140 msgr2=0x563e8d5e8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:21.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.141+0000 7fa87a856b80 1 --2- 172.21.15.70:0/900198539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c8140 0x563e8d5e8fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa854009680 tx=0x7fa8540b32d0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.141+0000 7fa87a856b80 1 -- 172.21.15.70:0/900198539 shutdown_connections 2024-05-08T09:01:21.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.141+0000 7fa87a856b80 1 --2- 172.21.15.70:0/900198539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5cd1b0 0x563e8d5e9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.141+0000 7fa87a856b80 1 --2- 172.21.15.70:0/900198539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 0x563e8d5dd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.141+0000 7fa87a856b80 1 --2- 172.21.15.70:0/900198539 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5c8140 0x563e8d5e8fc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.141+0000 7fa87a856b80 1 -- 172.21.15.70:0/900198539 >> 172.21.15.70:0/900198539 conn(0x563e8d53f7d0 msgr2=0x563e8d5c7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:21.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.141+0000 7fa87a856b80 1 -- 172.21.15.70:0/900198539 shutdown_connections 2024-05-08T09:01:21.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.141+0000 7fa87a856b80 1 -- 172.21.15.70:0/900198539 wait complete. 2024-05-08T09:01:21.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.142+0000 7fa87a856b80 1 -- start start 2024-05-08T09:01:21.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.142+0000 7fa87a856b80 1 Processor -- start 2024-05-08T09:01:21.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 0x563e8d64fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d64e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa87a856b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5cd1b0 0x563e8d64e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa87a856b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681afd10 con 0x563e8d5c7780 2024-05-08T09:01:21.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa87a856b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b1180 con 0x563e8d5cd1b0 2024-05-08T09:01:21.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa87a856b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa8681b03e0 con 0x563e8d5c8140 2024-05-08T09:01:21.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa87a856b80 10 client.0 _ll_register_callbacks cb 0x563e8d4c0d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:01:21.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa86ca00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d64e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa86ca00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d64e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:33144/0 (socket says 172.21.15.70:33144) 2024-05-08T09:01:21.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.143+0000 7fa86ca00700 1 -- 172.21.15.70:0/1169390669 learned_addr learned my addr 172.21.15.70:0/1169390669 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:21.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.144+0000 7fa86d400700 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 0x563e8d64fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.144+0000 7fa86de00700 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5cd1b0 0x563e8d64e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.144+0000 7fa86ca00700 1 -- 172.21.15.70:0/1169390669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5cd1b0 msgr2=0x563e8d64e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:21.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.144+0000 7fa86ca00700 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5cd1b0 0x563e8d64e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.144+0000 7fa86ca00700 1 -- 172.21.15.70:0/1169390669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 msgr2=0x563e8d64fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.144+0000 7fa86ca00700 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 0x563e8d64fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.144+0000 7fa86ca00700 1 -- 172.21.15.70:0/1169390669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e8d64f0d0 con 0x563e8d5c8140 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.144+0000 7fa86d400700 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 0x563e8d64fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.145+0000 7fa86ca00700 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d64e350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa8540b3160 tx=0x7fa854009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f29cf56675cb64 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.145+0000 7fa84f400700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.145+0000 7fa84f400700 1 -- 172.21.15.70:0/1169390669 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8540aaf00 con 0x563e8d5c8140 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.145+0000 7fa87a856b80 1 -- 172.21.15.70:0/1169390669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8540aebb0 con 0x563e8d5c8140 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.145+0000 7fa84f400700 1 -- 172.21.15.70:0/1169390669 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(347..347 src has 1..347) ==== 9583+0+0 (secure 0 0 0) 0x7fa8540bfbc0 con 0x563e8d5c8140 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.146+0000 7fa84f400700 1 -- 172.21.15.70:0/1169390669 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa8540aac70 con 0x563e8d5c8140 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.146+0000 7fa87a856b80 10 client.27715 fetch_fsmap learned FSMap version 42 2024-05-08T09:01:21.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.146+0000 7fa87a856b80 1 -- 172.21.15.70:0/1169390669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563e8d64f0d0 con 0x563e8d5c8140 2024-05-08T09:01:21.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.146+0000 7fa84f400700 1 -- 172.21.15.70:0/1169390669 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8540aebb0 con 0x563e8d5c8140 2024-05-08T09:01:21.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.146+0000 7fa84f400700 1 -- 172.21.15.70:0/1169390669 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa8540920b0 con 0x563e8d5c8140 2024-05-08T09:01:21.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.146+0000 7fa87a856b80 10 client.27715 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:01:21.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.146+0000 7fa87a856b80 10 client.27715 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:01:21.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.146+0000 7fa87a856b80 20 client.27715 populate_metadata read hostname 'smithi070' 2024-05-08T09:01:21.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.146+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e8d5d9b00 0x563e8d5d9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:21.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.147+0000 7fa87a856b80 4 client.27715 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "890a1b5a", "release": true, "await": true}] 2024-05-08T09:01:21.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.147+0000 7fa87a856b80 1 -- 172.21.15.70:0/1169390669 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "890a1b5a", "release": true, "await": true}) -- 0x563e8d527500 con 0x563e8d5d9b00 2024-05-08T09:01:21.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.147+0000 7fa86d400700 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e8d5d9b00 0x563e8d5d9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:21.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.149+0000 7fa86d400700 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e8d5d9b00 0x563e8d5d9f10 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3ede165fd1dc35c server_cookie=3f76bdcc1b734703 in_seq=0 out_seq=0 2024-05-08T09:01:21.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:21.149+0000 7fa84f400700 10 client.27715 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:01:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:21 smithi070 ceph-mon[29591]: pgmap v4298: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 96 B/s wr, 5 op/s 2024-05-08T09:01:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:01:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:21 smithi070 ceph-mon[29591]: osdmap e347: 12 total, 12 up, 12 in 2024-05-08T09:01:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:21 smithi172 ceph-mon[33377]: pgmap v4298: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 96 B/s wr, 5 op/s 2024-05-08T09:01:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:01:21.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:21 smithi172 ceph-mon[33377]: osdmap e347: 12 total, 12 up, 12 in 2024-05-08T09:01:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:21 smithi194 ceph-mon[33679]: pgmap v4298: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 96 B/s wr, 5 op/s 2024-05-08T09:01:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:01:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:21 smithi194 ceph-mon[33679]: osdmap e347: 12 total, 12 up, 12 in 2024-05-08T09:01:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:23 smithi070 ceph-mon[29591]: pgmap v4300: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:01:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:01:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:01:23.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:01:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:23 smithi172 ceph-mon[33377]: pgmap v4300: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:01:23.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:01:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:01:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:01:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:23 smithi194 ceph-mon[33679]: pgmap v4300: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:01:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:01:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:01:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:01:25.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:25 smithi070 ceph-mon[29591]: pgmap v4301: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 KiB/s wr, 6 op/s 2024-05-08T09:01:25.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:25 smithi172 ceph-mon[33377]: pgmap v4301: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 KiB/s wr, 6 op/s 2024-05-08T09:01:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:25 smithi194 ceph-mon[33679]: pgmap v4301: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 KiB/s wr, 6 op/s 2024-05-08T09:01:25.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.866+0000 7fa84f400700 1 -- 172.21.15.70:0/1169390669 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x563e8d527500 con 0x563e8d5d9b00 2024-05-08T09:01:25.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.867+0000 7fa84f400700 10 client.27715 handle_command_reply: tid=0 2024-05-08T09:01:25.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.867+0000 7fa87a856b80 1 client.27715 shutdown 2024-05-08T09:01:25.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.867+0000 7fa87a856b80 1 -- 172.21.15.70:0/1169390669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 msgr2=0x563e8d64e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:25.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.867+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d64e350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa8540b3160 tx=0x7fa854009c00 comp rx=0 tx=0).stop 2024-05-08T09:01:25.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.868+0000 7fa87a856b80 1 -- 172.21.15.70:0/1169390669 shutdown_connections 2024-05-08T09:01:25.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.868+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563e8d5d9b00 0x563e8d5d9f10 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.868+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563e8d5cd1b0 0x563e8d64e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.868+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563e8d5c7780 0x563e8d64fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.868+0000 7fa87a856b80 1 --2- 172.21.15.70:0/1169390669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563e8d5c8140 0x563e8d64e350 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.868+0000 7fa87a856b80 1 -- 172.21.15.70:0/1169390669 >> 172.21.15.70:0/1169390669 conn(0x563e8d53f7d0 msgr2=0x563e8d5cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.868+0000 7fa84f400700 0 client.27715 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:01:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.869+0000 7fa87a856b80 1 -- 172.21.15.70:0/1169390669 shutdown_connections 2024-05-08T09:01:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.869+0000 7fa87a856b80 1 -- 172.21.15.70:0/1169390669 wait complete. 2024-05-08T09:01:25.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.869+0000 7fa87a856b80 20 client.27715 trim_cache size 0 max 16384 2024-05-08T09:01:25.869 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 300, 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "890a1b5a": { 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 300, 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:01:25.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.9, 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:01:25.871 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:01:25.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.871+0000 7fa86fe00700 1 -- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa8500b2a70 msgr2=0x7fa8500b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:25.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.871+0000 7fa86fe00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa8500b2a70 0x7fa8500b4f30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa85c011590 tx=0x7fa85c009260 comp rx=0 tx=0).stop 2024-05-08T09:01:25.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.871+0000 7fa86fe00700 1 -- 172.21.15.70:0/531816699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa868075ff0 msgr2=0x7fa86819c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:25.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.871+0000 7fa86fe00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa868075ff0 0x7fa86819c2a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa854000c00 tx=0x7fa85400f990 comp rx=0 tx=0).stop 2024-05-08T09:01:25.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.872+0000 7fa86fe00700 1 -- 172.21.15.70:0/531816699 shutdown_connections 2024-05-08T09:01:25.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.872+0000 7fa86fe00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa8500b2a70 0x7fa8500b4f30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:25.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.872+0000 7fa86fe00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa86810fed0 0x7fa8681a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:25.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.872+0000 7fa86fe00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa8680756d0 0x7fa86819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:25.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.872+0000 7fa86fe00700 1 --2- 172.21.15.70:0/531816699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa868075ff0 0x7fa86819c2a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:25.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.872+0000 7fa86fe00700 1 -- 172.21.15.70:0/531816699 >> 172.21.15.70:0/531816699 conn(0x7fa86807a650 msgr2=0x7fa8681007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:25.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.875+0000 7fa86fe00700 1 -- 172.21.15.70:0/531816699 shutdown_connections 2024-05-08T09:01:25.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:25.876+0000 7fa86fe00700 1 -- 172.21.15.70:0/531816699 wait complete. 2024-05-08T09:01:27.426 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '890a1b5a', seconds elapsed: 81.1 2024-05-08T09:01:27.426 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.9 2024-05-08T09:01:27.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:01:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:27 smithi070 ceph-mon[29591]: pgmap v4302: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 KiB/s wr, 6 op/s 2024-05-08T09:01:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:27 smithi172 ceph-mon[33377]: pgmap v4302: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 KiB/s wr, 6 op/s 2024-05-08T09:01:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:27 smithi194 ceph-mon[33679]: pgmap v4302: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 KiB/s wr, 6 op/s 2024-05-08T09:01:27.961 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libata-pata-timings.o 2024-05-08T09:01:28.068 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:01:28.168 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/devtmpfs.o 2024-05-08T09:01:28.201 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/ahci.o 2024-05-08T09:01:28.818 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/sd.o 2024-05-08T09:01:28.846 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/sr.o 2024-05-08T09:01:28.872 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_pm.o 2024-05-08T09:01:29.089 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/phy/built-in.a 2024-05-08T09:01:29.467 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:29 smithi070 ceph-mon[29591]: pgmap v4303: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 KiB/s wr, 6 op/s 2024-05-08T09:01:29.539 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/node.o 2024-05-08T09:01:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:29 smithi172 ceph-mon[33377]: pgmap v4303: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 KiB/s wr, 6 op/s 2024-05-08T09:01:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:29 smithi194 ceph-mon[33679]: pgmap v4303: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 39 KiB/s wr, 6 op/s 2024-05-08T09:01:30.023 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/mdio/acpi_mdio.o 2024-05-08T09:01:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.403+0000 7fb109400700 1 -- 172.21.15.70:0/2210023960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10410b680 msgr2=0x7fb10410ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.403+0000 7fb109400700 1 --2- 172.21.15.70:0/2210023960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10410b680 0x7fb10410ba60 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009a10 tx=0x7fb0f4009d20 comp rx=0 tx=0).stop 2024-05-08T09:01:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.403+0000 7fb109400700 1 -- 172.21.15.70:0/2210023960 shutdown_connections 2024-05-08T09:01:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.403+0000 7fb109400700 1 --2- 172.21.15.70:0/2210023960 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb104105f90 0x7fb104112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.403+0000 7fb109400700 1 --2- 172.21.15.70:0/2210023960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb10410b680 0x7fb10410ba60 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.403+0000 7fb109400700 1 --2- 172.21.15.70:0/2210023960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1041055d0 0x7fb104105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.403+0000 7fb109400700 1 -- 172.21.15.70:0/2210023960 >> 172.21.15.70:0/2210023960 conn(0x7fb104101080 msgr2=0x7fb1041034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.403+0000 7fb109400700 1 -- 172.21.15.70:0/2210023960 shutdown_connections 2024-05-08T09:01:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.403+0000 7fb109400700 1 -- 172.21.15.70:0/2210023960 wait complete. 2024-05-08T09:01:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.404+0000 7fb109400700 1 Processor -- start 2024-05-08T09:01:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.405+0000 7fb109400700 1 -- start start 2024-05-08T09:01:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.405+0000 7fb109400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1041055d0 0x7fb1041106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.405+0000 7fb109400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb104105f90 0x7fb104110c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.405+0000 7fb109400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb10410b680 0x7fb104111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.405+0000 7fb109400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb1040783e0 con 0x7fb104105f90 2024-05-08T09:01:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.405+0000 7fb109400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb104078260 con 0x7fb1041055d0 2024-05-08T09:01:30.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.405+0000 7fb109400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb104078560 con 0x7fb10410b680 2024-05-08T09:01:30.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb103400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb104105f90 0x7fb104110c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:30.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb103e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1041055d0 0x7fb1041106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:30.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb103400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb104105f90 0x7fb104110c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50758/0 (socket says 172.21.15.70:50758) 2024-05-08T09:01:30.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb103400700 1 -- 172.21.15.70:0/1666594879 learned_addr learned my addr 172.21.15.70:0/1666594879 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:30.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb108a00700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb10410b680 0x7fb104111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:30.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb103400700 1 -- 172.21.15.70:0/1666594879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb10410b680 msgr2=0x7fb104111150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:30.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb103400700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb10410b680 0x7fb104111150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb103400700 1 -- 172.21.15.70:0/1666594879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1041055d0 msgr2=0x7fb1041106d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:30.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb103400700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1041055d0 0x7fb1041106d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.406+0000 7fb103400700 1 -- 172.21.15.70:0/1666594879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb104114ca0 con 0x7fb104105f90 2024-05-08T09:01:30.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.407+0000 7fb108a00700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb10410b680 0x7fb104111150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:01:30.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.407+0000 7fb103400700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb104105f90 0x7fb104110c10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000e9c0 tx=0x7fb0f000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:30.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.407+0000 7fb100c00700 1 -- 172.21.15.70:0/1666594879 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f000cbd0 con 0x7fb104105f90 2024-05-08T09:01:30.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.408+0000 7fb100c00700 1 -- 172.21.15.70:0/1666594879 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0f000cd70 con 0x7fb104105f90 2024-05-08T09:01:30.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.408+0000 7fb100c00700 1 -- 172.21.15.70:0/1666594879 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f0005570 con 0x7fb104105f90 2024-05-08T09:01:30.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.408+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb104114f90 con 0x7fb104105f90 2024-05-08T09:01:30.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.408+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb104115480 con 0x7fb104105f90 2024-05-08T09:01:30.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.410+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e4005330 con 0x7fb104105f90 2024-05-08T09:01:30.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.415+0000 7fb100c00700 1 -- 172.21.15.70:0/1666594879 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb0f0004750 con 0x7fb104105f90 2024-05-08T09:01:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.417+0000 7fb100c00700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0e80b2b40 0x7fb0e80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.417+0000 7fb100c00700 1 -- 172.21.15.70:0/1666594879 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(347..347 src has 1..347) ==== 9583+0+0 (secure 0 0 0) 0x7fb0f00e2d40 con 0x7fb104105f90 2024-05-08T09:01:30.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.418+0000 7fb103e00700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0e80b2b40 0x7fb0e80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:30.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.419+0000 7fb103e00700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0e80b2b40 0x7fb0e80b5000 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40099e0 tx=0x7fb0f4005ad0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:30.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.419+0000 7fb100c00700 1 -- 172.21.15.70:0/1666594879 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb0f0054df0 con 0x7fb104105f90 2024-05-08T09:01:30.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.875+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0e4005620 con 0x7fb104105f90 2024-05-08T09:01:30.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.875+0000 7fb100c00700 1 -- 172.21.15.70:0/1666594879 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fb0f00aa320 con 0x7fb104105f90 2024-05-08T09:01:30.875 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:01:30.875 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0e80b2b40 msgr2=0x7fb0e80b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0e80b2b40 0x7fb0e80b5000 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb0f40099e0 tx=0x7fb0f4005ad0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb104105f90 msgr2=0x7fb104110c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb104105f90 0x7fb104110c10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000e9c0 tx=0x7fb0f000ecd0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 shutdown_connections 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb0e80b2b40 0x7fb0e80b5000 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb10410b680 0x7fb104111150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb1041055d0 0x7fb1041106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 --2- 172.21.15.70:0/1666594879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb104105f90 0x7fb104110c10 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 >> 172.21.15.70:0/1666594879 conn(0x7fb104101080 msgr2=0x7fb104102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:30.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 shutdown_connections 2024-05-08T09:01:30.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:30.878+0000 7fb109400700 1 -- 172.21.15.70:0/1666594879 wait complete. 2024-05-08T09:01:30.879 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:01:31.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:31 smithi070 ceph-mon[29591]: pgmap v4304: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 193 KiB/s wr, 17 op/s 2024-05-08T09:01:31.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:31 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1666594879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:01:31.676 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 87.9 --await-for 42.0' 2024-05-08T09:01:31.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 87.9 --await-for 42.0 2024-05-08T09:01:31.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:31 smithi172 ceph-mon[33377]: pgmap v4304: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 193 KiB/s wr, 17 op/s 2024-05-08T09:01:31.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:31 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1666594879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:01:31.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:31 smithi194 ceph-mon[33679]: pgmap v4304: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 193 KiB/s wr, 17 op/s 2024-05-08T09:01:31.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:31 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1666594879' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:01:32.261 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:01:33.344 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:33 smithi070 ceph-mon[29591]: pgmap v4305: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 172 KiB/s wr, 15 op/s 2024-05-08T09:01:33.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:33 smithi172 ceph-mon[33377]: pgmap v4305: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 172 KiB/s wr, 15 op/s 2024-05-08T09:01:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:33 smithi194 ceph-mon[33679]: pgmap v4305: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 172 KiB/s wr, 15 op/s 2024-05-08T09:01:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:35 smithi070 ceph-mon[29591]: pgmap v4306: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 426 KiB/s wr, 25 op/s 2024-05-08T09:01:35.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:35 smithi172 ceph-mon[33377]: pgmap v4306: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 426 KiB/s wr, 25 op/s 2024-05-08T09:01:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:35 smithi194 ceph-mon[33679]: pgmap v4306: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 426 KiB/s wr, 25 op/s 2024-05-08T09:01:37.359 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:37 smithi070 ceph-mon[29591]: pgmap v4307: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 393 KiB/s wr, 23 op/s 2024-05-08T09:01:37.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.574+0000 7f832b600700 1 -- 172.21.15.70:0/1016318774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 msgr2=0x7f832410f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:37.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.574+0000 7f832b600700 1 --2- 172.21.15.70:0/1016318774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 0x7f832410f1e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f831c00b3e0 tx=0x7f831c00b6f0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.575+0000 7f832b600700 1 -- 172.21.15.70:0/1016318774 shutdown_connections 2024-05-08T09:01:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.575+0000 7f832b600700 1 --2- 172.21.15.70:0/1016318774 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 0x7f832410f1e0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.575+0000 7f832b600700 1 --2- 172.21.15.70:0/1016318774 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83241084c0 0x7f83241088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.575+0000 7f832b600700 1 --2- 172.21.15.70:0/1016318774 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8324102780 0x7f8324102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.575+0000 7f832b600700 1 -- 172.21.15.70:0/1016318774 >> 172.21.15.70:0/1016318774 conn(0x7f8324079350 msgr2=0x7f8324079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.575+0000 7f832b600700 1 -- 172.21.15.70:0/1016318774 shutdown_connections 2024-05-08T09:01:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.575+0000 7f832b600700 1 -- 172.21.15.70:0/1016318774 wait complete. 2024-05-08T09:01:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.577+0000 7f832b600700 1 Processor -- start 2024-05-08T09:01:37.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.577+0000 7f832b600700 1 -- start start 2024-05-08T09:01:37.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.577+0000 7f832b600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8324102780 0x7f83241a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.577+0000 7f832b600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 0x7f83241a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.577+0000 7f832b600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83241084c0 0x7f832419ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.578+0000 7f832b600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8324113670 con 0x7f8324103140 2024-05-08T09:01:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.578+0000 7f832b600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83241134f0 con 0x7f83241084c0 2024-05-08T09:01:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.578+0000 7f832b600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83241137f0 con 0x7f8324102780 2024-05-08T09:01:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.578+0000 7f8323e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 0x7f83241a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.578+0000 7f8323e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 0x7f83241a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60846/0 (socket says 172.21.15.70:60846) 2024-05-08T09:01:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.578+0000 7f8323e00700 1 -- 172.21.15.70:0/889735108 learned_addr learned my addr 172.21.15.70:0/889735108 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.578+0000 7f8328c00700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8324102780 0x7f83241a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.579+0000 7f8329600700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83241084c0 0x7f832419ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.579+0000 7f8328c00700 1 -- 172.21.15.70:0/889735108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83241084c0 msgr2=0x7f832419ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.579+0000 7f8328c00700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83241084c0 0x7f832419ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.579+0000 7f8328c00700 1 -- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 msgr2=0x7f83241a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.579+0000 7f8328c00700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 0x7f83241a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.579+0000 7f8328c00700 1 -- 172.21.15.70:0/889735108 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832419c1b0 con 0x7f8324102780 2024-05-08T09:01:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.579+0000 7f8323e00700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 0x7f83241a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:01:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.579+0000 7f8329600700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83241084c0 0x7f832419ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:01:37.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.580+0000 7f8328c00700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8324102780 0x7f83241a1890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f831800e9f0 tx=0x7f831800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.581+0000 7f8321600700 1 -- 172.21.15.70:0/889735108 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831800cbd0 con 0x7f8324102780 2024-05-08T09:01:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.581+0000 7f8321600700 1 -- 172.21.15.70:0/889735108 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f83180044b0 con 0x7f8324102780 2024-05-08T09:01:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.581+0000 7f8321600700 1 -- 172.21.15.70:0/889735108 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8318005020 con 0x7f8324102780 2024-05-08T09:01:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.581+0000 7f832b600700 1 -- 172.21.15.70:0/889735108 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832419c440 con 0x7f8324102780 2024-05-08T09:01:37.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.581+0000 7f832b600700 1 -- 172.21.15.70:0/889735108 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83241a8760 con 0x7f8324102780 2024-05-08T09:01:37.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.588+0000 7f8321600700 1 -- 172.21.15.70:0/889735108 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f83180051c0 con 0x7f8324102780 2024-05-08T09:01:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.591+0000 7f8321600700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f830c0b2b20 0x7f830c0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.591+0000 7f8321600700 1 -- 172.21.15.70:0/889735108 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(347..347 src has 1..347) ==== 9583+0+0 (secure 0 0 0) 0x7f83180e2930 con 0x7f8324102780 2024-05-08T09:01:37.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.592+0000 7f8323e00700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f830c0b2b20 0x7f830c0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.594+0000 7f8323e00700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f830c0b2b20 0x7f830c0b4fe0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8324079c00 tx=0x7f8310007480 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:37.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.612+0000 7f833605fb80 1 Processor -- start 2024-05-08T09:01:37.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.613+0000 7f833605fb80 1 -- start start 2024-05-08T09:01:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.614+0000 7f833605fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 0x55f618374330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.614+0000 7f833605fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836e520 0x55f61836e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.614+0000 7f833605fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f61837ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.614+0000 7f833605fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f6182c0bb0 con 0x55f61836e520 2024-05-08T09:01:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.614+0000 7f833605fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f61825e8f0 con 0x55f618373f50 2024-05-08T09:01:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.614+0000 7f833605fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f6182bcb70 con 0x55f61836eee0 2024-05-08T09:01:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.616+0000 7f8323e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836e520 0x55f61836e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.616+0000 7f8323e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836e520 0x55f61836e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60860/0 (socket says 172.21.15.70:60860) 2024-05-08T09:01:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.616+0000 7f8323e00700 1 -- 172.21.15.70:0/1926566992 learned_addr learned my addr 172.21.15.70:0/1926566992 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.616+0000 7f8328c00700 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 0x55f618374330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.616+0000 7f8323e00700 1 -- 172.21.15.70:0/1926566992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 msgr2=0x55f61837ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.616+0000 7f8329600700 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f61837ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.616+0000 7f8323e00700 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f61837ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.617+0000 7f8323e00700 1 -- 172.21.15.70:0/1926566992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 msgr2=0x55f618374330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.617+0000 7f8323e00700 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 0x55f618374330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.617+0000 7f8323e00700 1 -- 172.21.15.70:0/1926566992 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f61820da60 con 0x55f61836e520 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.617+0000 7f8328c00700 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 0x55f618374330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.617+0000 7f8323e00700 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836e520 0x55f61836e9a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f8310011810 tx=0x7f8310013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39ecf9e302bb6f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.618+0000 7f8316000700 1 -- 172.21.15.70:0/1926566992 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831001e620 con 0x55f61836e520 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.618+0000 7f8316000700 1 -- 172.21.15.70:0/1926566992 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f831001ec50 con 0x55f61836e520 2024-05-08T09:01:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.618+0000 7f8316000700 1 -- 172.21.15.70:0/1926566992 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831001ccd0 con 0x55f61836e520 2024-05-08T09:01:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.619+0000 7f833605fb80 1 -- 172.21.15.70:0/1926566992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836e520 msgr2=0x55f61836e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.619+0000 7f833605fb80 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836e520 0x55f61836e9a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f8310011810 tx=0x7f8310013000 comp rx=0 tx=0).stop 2024-05-08T09:01:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.620+0000 7f833605fb80 1 -- 172.21.15.70:0/1926566992 shutdown_connections 2024-05-08T09:01:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.620+0000 7f833605fb80 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f61837ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.620+0000 7f833605fb80 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 0x55f618374330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.620+0000 7f833605fb80 1 --2- 172.21.15.70:0/1926566992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836e520 0x55f61836e9a0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.620+0000 7f833605fb80 1 -- 172.21.15.70:0/1926566992 >> 172.21.15.70:0/1926566992 conn(0x55f61829ccf0 msgr2=0x55f618368e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.620+0000 7f833605fb80 1 -- 172.21.15.70:0/1926566992 shutdown_connections 2024-05-08T09:01:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.621+0000 7f833605fb80 1 -- 172.21.15.70:0/1926566992 wait complete. 2024-05-08T09:01:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.621+0000 7f833605fb80 1 -- start start 2024-05-08T09:01:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.622+0000 7f833605fb80 1 Processor -- start 2024-05-08T09:01:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.622+0000 7f833605fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836e520 0x55f61837a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.622+0000 7f833605fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836eee0 0x55f618377d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.622+0000 7f833605fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f618378270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.622+0000 7f833605fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f618383b20 con 0x55f618373f50 2024-05-08T09:01:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.622+0000 7f833605fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f618226cb0 con 0x55f61836eee0 2024-05-08T09:01:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.622+0000 7f833605fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f618383ca0 con 0x55f61836e520 2024-05-08T09:01:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.622+0000 7f833605fb80 10 client.0 _ll_register_callbacks cb 0x55f618267e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:01:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.623+0000 7f8329600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f618378270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.623+0000 7f8329600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f618378270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60868/0 (socket says 172.21.15.70:60868) 2024-05-08T09:01:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.623+0000 7f8329600700 1 -- 172.21.15.70:0/759085088 learned_addr learned my addr 172.21.15.70:0/759085088 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.623+0000 7f8328c00700 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836e520 0x55f61837a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.624+0000 7f8323e00700 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836eee0 0x55f618377d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.624+0000 7f8329600700 1 -- 172.21.15.70:0/759085088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836e520 msgr2=0x55f61837a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.624+0000 7f8329600700 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836e520 0x55f61837a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.624+0000 7f8329600700 1 -- 172.21.15.70:0/759085088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836eee0 msgr2=0x55f618377d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.624+0000 7f8329600700 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836eee0 0x55f618377d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.624+0000 7f8329600700 1 -- 172.21.15.70:0/759085088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6182865b0 con 0x55f618373f50 2024-05-08T09:01:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.624+0000 7f8323e00700 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836eee0 0x55f618377d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:01:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.625+0000 7f8329600700 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f618378270 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f831c00bac0 tx=0x7f831c009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4e0bc29c95a823 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:37.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.626+0000 7f830aa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:01:37.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.626+0000 7f830aa00700 1 -- 172.21.15.70:0/759085088 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831c020070 con 0x55f618373f50 2024-05-08T09:01:37.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.627+0000 7f830aa00700 1 -- 172.21.15.70:0/759085088 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(347..347 src has 1..347) ==== 9583+0+0 (secure 0 0 0) 0x7f831c0074e0 con 0x55f618373f50 2024-05-08T09:01:37.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.627+0000 7f833605fb80 1 -- 172.21.15.70:0/759085088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f831001ec50 con 0x55f618373f50 2024-05-08T09:01:37.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.628+0000 7f830aa00700 1 -- 172.21.15.70:0/759085088 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f831c02c050 con 0x55f618373f50 2024-05-08T09:01:37.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.628+0000 7f833605fb80 10 client.18960 fetch_fsmap learned FSMap version 42 2024-05-08T09:01:37.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.628+0000 7f833605fb80 1 -- 172.21.15.70:0/759085088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f61838e390 con 0x55f618373f50 2024-05-08T09:01:37.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.629+0000 7f830aa00700 1 -- 172.21.15.70:0/759085088 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f831001ec50 con 0x55f618373f50 2024-05-08T09:01:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.630+0000 7f830aa00700 1 -- 172.21.15.70:0/759085088 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f831c011070 con 0x55f618373f50 2024-05-08T09:01:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.631+0000 7f833605fb80 10 client.18960 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:01:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.631+0000 7f833605fb80 10 client.18960 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:01:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.631+0000 7f833605fb80 20 client.18960 populate_metadata read hostname 'smithi070' 2024-05-08T09:01:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.631+0000 7f833605fb80 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f6183909d0 0x55f618392dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.631+0000 7f833605fb80 4 client.18960 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:01:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.631+0000 7f833605fb80 1 -- 172.21.15.70:0/759085088 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f61833b230 con 0x55f6183909d0 2024-05-08T09:01:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.631+0000 7f8328c00700 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f6183909d0 0x55f618392dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.632+0000 7f8328c00700 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f6183909d0 0x55f618392dc0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0cabdee79cf070a server_cookie=c10794fc2d715b55 in_seq=0 out_seq=0 2024-05-08T09:01:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.632+0000 7f830aa00700 10 client.18960 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:01:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.635+0000 7f830aa00700 1 -- 172.21.15.70:0/759085088 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f8318083e50 con 0x55f6183909d0 2024-05-08T09:01:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.635+0000 7f830aa00700 10 client.18960 handle_command_reply: tid=0 2024-05-08T09:01:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.635+0000 7f833605fb80 1 client.18960 shutdown 2024-05-08T09:01:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.635+0000 7f833605fb80 1 -- 172.21.15.70:0/759085088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 msgr2=0x55f618378270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.635+0000 7f833605fb80 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f618378270 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f831c00bac0 tx=0x7f831c009e10 comp rx=0 tx=0).stop 2024-05-08T09:01:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f833605fb80 1 -- 172.21.15.70:0/759085088 shutdown_connections 2024-05-08T09:01:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f833605fb80 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f6183909d0 0x55f618392dc0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f833605fb80 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f618378270 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f833605fb80 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836e520 0x55f61837a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f833605fb80 1 --2- 172.21.15.70:0/759085088 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836eee0 0x55f618377d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f833605fb80 1 -- 172.21.15.70:0/759085088 >> 172.21.15.70:0/759085088 conn(0x55f61829ccf0 msgr2=0x55f6183638e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f830aa00700 0 client.18960 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:01:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f833605fb80 1 -- 172.21.15.70:0/759085088 shutdown_connections 2024-05-08T09:01:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f833605fb80 1 -- 172.21.15.70:0/759085088 wait complete. 2024-05-08T09:01:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.636+0000 7f833605fb80 20 client.18960 trim_cache size 0 max 16384 2024-05-08T09:01:37.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.674+0000 7f833605fb80 1 Processor -- start 2024-05-08T09:01:37.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.675+0000 7f833605fb80 1 -- start start 2024-05-08T09:01:37.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.675+0000 7f833605fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836e520 0x55f61838cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.675+0000 7f833605fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836eee0 0x55f618363760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.675+0000 7f833605fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 0x55f618398650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.675+0000 7f833605fb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83241afcc0 con 0x55f61836eee0 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.675+0000 7f833605fb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83241ad550 con 0x55f618373f50 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.675+0000 7f833605fb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83241ab3c0 con 0x55f61836e520 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.676+0000 7f8323e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836eee0 0x55f618363760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.676+0000 7f8323e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836eee0 0x55f618363760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60872/0 (socket says 172.21.15.70:60872) 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.676+0000 7f8323e00700 1 -- 172.21.15.70:0/2485938500 learned_addr learned my addr 172.21.15.70:0/2485938500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.676+0000 7f8329600700 1 --2- 172.21.15.70:0/2485938500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 0x55f618398650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.677+0000 7f8323e00700 1 -- 172.21.15.70:0/2485938500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836e520 msgr2=0x55f61838cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.677+0000 7f8323e00700 1 --2- 172.21.15.70:0/2485938500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836e520 0x55f61838cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.677+0000 7f8323e00700 1 -- 172.21.15.70:0/2485938500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 msgr2=0x55f618398650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:37.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.677+0000 7f8323e00700 1 --2- 172.21.15.70:0/2485938500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 0x55f618398650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.677+0000 7f8323e00700 1 -- 172.21.15.70:0/2485938500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f618393420 con 0x55f61836eee0 2024-05-08T09:01:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:37 smithi172 ceph-mon[33377]: pgmap v4307: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 393 KiB/s wr, 23 op/s 2024-05-08T09:01:37.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.678+0000 7f8323e00700 1 --2- 172.21.15.70:0/2485938500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836eee0 0x55f618363760 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f83100117b0 tx=0x7f8310005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978170c1081fc1bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:37.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.680+0000 7f8315600700 1 -- 172.21.15.70:0/2485938500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310005640 con 0x55f61836eee0 2024-05-08T09:01:37.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.680+0000 7f8315600700 1 -- 172.21.15.70:0/2485938500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8310034070 con 0x55f61836eee0 2024-05-08T09:01:37.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.681+0000 7f833605fb80 1 -- 172.21.15.70:0/2485938500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836eee0 msgr2=0x55f618363760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:01:37.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.681+0000 7f8315600700 1 -- 172.21.15.70:0/2485938500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310005640 con 0x55f61836eee0 2024-05-08T09:01:37.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.681+0000 7f833605fb80 1 --2- 172.21.15.70:0/2485938500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836eee0 0x55f618363760 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f83100117b0 tx=0x7f8310005250 comp rx=0 tx=0).stop 2024-05-08T09:01:37.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.681+0000 7f833605fb80 1 -- 172.21.15.70:0/2485938500 shutdown_connections 2024-05-08T09:01:37.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.681+0000 7f833605fb80 1 --2- 172.21.15.70:0/2485938500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f618373f50 0x55f618398650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.681+0000 7f833605fb80 1 --2- 172.21.15.70:0/2485938500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836e520 0x55f61838cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.681+0000 7f833605fb80 1 --2- 172.21.15.70:0/2485938500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f61836eee0 0x55f618363760 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.681+0000 7f833605fb80 1 -- 172.21.15.70:0/2485938500 >> 172.21.15.70:0/2485938500 conn(0x55f61829ccf0 msgr2=0x55f618363050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:01:37.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.682+0000 7f833605fb80 1 -- 172.21.15.70:0/2485938500 shutdown_connections 2024-05-08T09:01:37.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.682+0000 7f833605fb80 1 -- 172.21.15.70:0/2485938500 wait complete. 2024-05-08T09:01:37.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.682+0000 7f833605fb80 1 -- start start 2024-05-08T09:01:37.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.683+0000 7f833605fb80 1 Processor -- start 2024-05-08T09:01:37.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.684+0000 7f833605fb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836e520 0x55f618383eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.684+0000 7f833605fb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f6183843f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.684+0000 7f833605fb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f6183fb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.685+0000 7f8323e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f6183843f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.685+0000 7f8328c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836e520 0x55f618383eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.685+0000 7f8323e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f6183843f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:36510/0 (socket says 172.21.15.70:36510) 2024-05-08T09:01:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.685+0000 7f8323e00700 1 -- 172.21.15.70:0/2014079963 learned_addr learned my addr 172.21.15.70:0/2014079963 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:01:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.685+0000 7f8329600700 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f6183fb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.685+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83241aba10 con 0x55f618373f50 2024-05-08T09:01:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.685+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83241ace80 con 0x55f61836e520 2024-05-08T09:01:37.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.685+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83241ac0e0 con 0x55f61836eee0 2024-05-08T09:01:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.685+0000 7f833605fb80 10 client.0 _ll_register_callbacks cb 0x55f618267e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:01:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.686+0000 7f8323e00700 1 -- 172.21.15.70:0/2014079963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836e520 msgr2=0x55f618383eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:37.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.686+0000 7f8323e00700 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836e520 0x55f618383eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.687+0000 7f8323e00700 1 -- 172.21.15.70:0/2014079963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 msgr2=0x55f6183fb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:01:37.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.687+0000 7f8323e00700 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f6183fb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:01:37.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.687+0000 7f8323e00700 1 -- 172.21.15.70:0/2014079963 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f618365a10 con 0x55f61836eee0 2024-05-08T09:01:37.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.687+0000 7f8329600700 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f6183fb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:01:37.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.687+0000 7f8328c00700 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836e520 0x55f618383eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:01:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.688+0000 7f8323e00700 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f6183843f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8310011e00 tx=0x7f83100049a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aeedc3303bb239d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:01:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.688+0000 7f830aa00700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T09:01:37.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.689+0000 7f830aa00700 1 -- 172.21.15.70:0/2014079963 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831003c070 con 0x55f61836eee0 2024-05-08T09:01:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.689+0000 7f830aa00700 1 -- 172.21.15.70:0/2014079963 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(347..347 src has 1..347) ==== 9583+0+0 (secure 0 0 0) 0x7f8310004fa0 con 0x55f61836eee0 2024-05-08T09:01:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.689+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8310034070 con 0x55f61836eee0 2024-05-08T09:01:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.690+0000 7f830aa00700 1 -- 172.21.15.70:0/2014079963 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8310046050 con 0x55f61836eee0 2024-05-08T09:01:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.690+0000 7f833605fb80 10 client.27733 fetch_fsmap learned FSMap version 42 2024-05-08T09:01:37.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.690+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f6183fc790 con 0x55f61836eee0 2024-05-08T09:01:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.692+0000 7f830aa00700 1 -- 172.21.15.70:0/2014079963 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8310034070 con 0x55f61836eee0 2024-05-08T09:01:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.692+0000 7f830aa00700 1 -- 172.21.15.70:0/2014079963 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f831001e4c0 con 0x55f61836eee0 2024-05-08T09:01:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.693+0000 7f833605fb80 10 client.27733 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:01:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.693+0000 7f833605fb80 10 client.27733 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:01:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.693+0000 7f833605fb80 20 client.27733 populate_metadata read hostname 'smithi070' 2024-05-08T09:01:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.693+0000 7f833605fb80 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f6183fcc70 0x55f6183ff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:01:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.693+0000 7f833605fb80 4 client.27733 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.9, "await_for": 42.0}] 2024-05-08T09:01:37.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.693+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 87.9, "await_for": 42.0}) -- 0x55f6182ce590 con 0x55f6183fcc70 2024-05-08T09:01:37.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.694+0000 7f8328c00700 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f6183fcc70 0x55f6183ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:01:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.696+0000 7f8328c00700 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f6183fcc70 0x55f6183ff090 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b60e00674a43dc5a server_cookie=ed1ba71430814d21 in_seq=0 out_seq=0 2024-05-08T09:01:37.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:01:37.696+0000 7f830aa00700 10 client.27733 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:01:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:37 smithi194 ceph-mon[33679]: pgmap v4307: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 393 KiB/s wr, 23 op/s 2024-05-08T09:01:38.685 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/pcs/built-in.a 2024-05-08T09:01:38.864 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/mdio/fwnode_mdio.o 2024-05-08T09:01:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:39 smithi070 ceph-mon[29591]: pgmap v4308: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 393 KiB/s wr, 22 op/s 2024-05-08T09:01:39.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:39 smithi172 ceph-mon[33377]: pgmap v4308: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 393 KiB/s wr, 22 op/s 2024-05-08T09:01:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:39 smithi194 ceph-mon[33679]: pgmap v4308: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 444 KiB/s rd, 393 KiB/s wr, 22 op/s 2024-05-08T09:01:41.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:41 smithi070 ceph-mon[29591]: pgmap v4309: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 925 KiB/s wr, 42 op/s 2024-05-08T09:01:41.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:41 smithi172 ceph-mon[33377]: pgmap v4309: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 925 KiB/s wr, 42 op/s 2024-05-08T09:01:41.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:41 smithi194 ceph-mon[33679]: pgmap v4309: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 925 KiB/s wr, 42 op/s 2024-05-08T09:01:43.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:43 smithi070 ceph-mon[29591]: pgmap v4310: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 797 KiB/s wr, 31 op/s 2024-05-08T09:01:43.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:43 smithi172 ceph-mon[33377]: pgmap v4310: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 797 KiB/s wr, 31 op/s 2024-05-08T09:01:43.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:43 smithi194 ceph-mon[33679]: pgmap v4310: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 797 KiB/s wr, 31 op/s 2024-05-08T09:01:45.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:45 smithi172 ceph-mon[33377]: pgmap v4311: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 866 KiB/s wr, 37 op/s 2024-05-08T09:01:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:45 smithi194 ceph-mon[33679]: pgmap v4311: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 866 KiB/s wr, 37 op/s 2024-05-08T09:01:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:45 smithi070 ceph-mon[29591]: pgmap v4311: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 866 KiB/s wr, 37 op/s 2024-05-08T09:01:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:47 smithi070 ceph-mon[29591]: pgmap v4312: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 601 KiB/s wr, 25 op/s 2024-05-08T09:01:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:47 smithi172 ceph-mon[33377]: pgmap v4312: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 601 KiB/s wr, 25 op/s 2024-05-08T09:01:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:47 smithi194 ceph-mon[33679]: pgmap v4312: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 601 KiB/s wr, 25 op/s 2024-05-08T09:01:49.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:49 smithi070 ceph-mon[29591]: pgmap v4313: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 601 KiB/s wr, 25 op/s 2024-05-08T09:01:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:49 smithi172 ceph-mon[33377]: pgmap v4313: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 601 KiB/s wr, 25 op/s 2024-05-08T09:01:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:49 smithi194 ceph-mon[33679]: pgmap v4313: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 601 KiB/s wr, 25 op/s 2024-05-08T09:01:51.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:51 smithi070 ceph-mon[29591]: pgmap v4314: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 664 KiB/s wr, 29 op/s 2024-05-08T09:01:51.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:51 smithi172 ceph-mon[33377]: pgmap v4314: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 664 KiB/s wr, 29 op/s 2024-05-08T09:01:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:51 smithi194 ceph-mon[33679]: pgmap v4314: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 664 KiB/s wr, 29 op/s 2024-05-08T09:01:53.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:53 smithi070 ceph-mon[29591]: pgmap v4315: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 132 KiB/s wr, 9 op/s 2024-05-08T09:01:53.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:53 smithi172 ceph-mon[33377]: pgmap v4315: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 132 KiB/s wr, 9 op/s 2024-05-08T09:01:53.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:53 smithi194 ceph-mon[33679]: pgmap v4315: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 132 KiB/s wr, 9 op/s 2024-05-08T09:01:55.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:55 smithi070 ceph-mon[29591]: pgmap v4316: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 132 KiB/s wr, 11 op/s 2024-05-08T09:01:55.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:55 smithi172 ceph-mon[33377]: pgmap v4316: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 132 KiB/s wr, 11 op/s 2024-05-08T09:01:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:55 smithi194 ceph-mon[33679]: pgmap v4316: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 132 KiB/s wr, 11 op/s 2024-05-08T09:01:57.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:57 smithi070 ceph-mon[29591]: pgmap v4317: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T09:01:57.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:57 smithi172 ceph-mon[33377]: pgmap v4317: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T09:01:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:57 smithi194 ceph-mon[33679]: pgmap v4317: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T09:01:59.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:01:59 smithi070 ceph-mon[29591]: pgmap v4318: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T09:01:59.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:01:59 smithi172 ceph-mon[33377]: pgmap v4318: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T09:01:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:01:59 smithi194 ceph-mon[33679]: pgmap v4318: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 64 KiB/s wr, 6 op/s 2024-05-08T09:02:01.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:01 smithi070 ceph-mon[29591]: pgmap v4319: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 155 KiB/s wr, 9 op/s 2024-05-08T09:02:01.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:01 smithi172 ceph-mon[33377]: pgmap v4319: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 155 KiB/s wr, 9 op/s 2024-05-08T09:02:01.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.699+0000 7f830aa00700 1 -- 172.21.15.70:0/2014079963 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55f6182ce590 con 0x55f6183fcc70 2024-05-08T09:02:01.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.699+0000 7f830aa00700 10 client.27733 handle_command_reply: tid=0 2024-05-08T09:02:01.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.699+0000 7f833605fb80 1 client.27733 shutdown 2024-05-08T09:02:01.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 msgr2=0x55f6183843f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:01.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f6183843f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8310011e00 tx=0x7f83100049a0 comp rx=0 tx=0).stop 2024-05-08T09:02:01.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 shutdown_connections 2024-05-08T09:02:01.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f6183fcc70 0x55f6183ff090 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:01.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618373f50 0x55f6183fb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:01.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f61836e520 0x55f618383eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:01.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 --2- 172.21.15.70:0/2014079963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f61836eee0 0x55f6183843f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:01.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 >> 172.21.15.70:0/2014079963 conn(0x55f61829ccf0 msgr2=0x55f6183638e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:01.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f830aa00700 0 client.27733 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:02:01.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 shutdown_connections 2024-05-08T09:02:01.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.700+0000 7f833605fb80 1 -- 172.21.15.70:0/2014079963 wait complete. 2024-05-08T09:02:01.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.701+0000 7f833605fb80 20 client.27733 trim_cache size 0 max 16384 2024-05-08T09:02:01.704 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:02:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:02:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:02:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 302, 2024-05-08T09:02:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:02:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "56a259b2": { 2024-05-08T09:02:01.705 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 302, 2024-05-08T09:02:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:02:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:02:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:02:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:02:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:02:01.706 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:02:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.9, 2024-05-08T09:02:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:02:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:02:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:02:01.707 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:02:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:02:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:02:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:01.708 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:01.709 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:02:01.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 -- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f830c0b2b20 msgr2=0x7f830c0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:01.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f830c0b2b20 0x7f830c0b4fe0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8324079c00 tx=0x7f8310007480 comp rx=0 tx=0).stop 2024-05-08T09:02:01.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 -- 172.21.15.70:0/889735108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8324102780 msgr2=0x7f83241a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:01.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8324102780 0x7f83241a1890 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f831800e9f0 tx=0x7f831800ed00 comp rx=0 tx=0).stop 2024-05-08T09:02:01.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 -- 172.21.15.70:0/889735108 shutdown_connections 2024-05-08T09:02:01.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f830c0b2b20 0x7f830c0b4fe0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:01.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f83241084c0 0x7f832419ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:01.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8324102780 0x7f83241a1890 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:01.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 --2- 172.21.15.70:0/889735108 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8324103140 0x7f83241a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:01.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.702+0000 7f832b600700 1 -- 172.21.15.70:0/889735108 >> 172.21.15.70:0/889735108 conn(0x7f8324079350 msgr2=0x7f832410d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:01.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.703+0000 7f832b600700 1 -- 172.21.15.70:0/889735108 shutdown_connections 2024-05-08T09:02:01.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:01.703+0000 7f832b600700 1 -- 172.21.15.70:0/889735108 wait complete. 2024-05-08T09:02:01.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:01 smithi194 ceph-mon[33679]: pgmap v4319: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 155 KiB/s wr, 9 op/s 2024-05-08T09:02:02.617 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '56a259b2', quiesce took 35.2 seconds. Will release after: 27.9 2024-05-08T09:02:03.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:03 smithi070 ceph-mon[29591]: pgmap v4320: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 91 KiB/s wr, 5 op/s 2024-05-08T09:02:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:03 smithi172 ceph-mon[33377]: pgmap v4320: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 91 KiB/s wr, 5 op/s 2024-05-08T09:02:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:03 smithi194 ceph-mon[33679]: pgmap v4320: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 91 KiB/s wr, 5 op/s 2024-05-08T09:02:05.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:05 smithi070 ceph-mon[29591]: pgmap v4321: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 166 KiB/s wr, 29 op/s 2024-05-08T09:02:05.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:05 smithi172 ceph-mon[33377]: pgmap v4321: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 166 KiB/s wr, 29 op/s 2024-05-08T09:02:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:05 smithi194 ceph-mon[33679]: pgmap v4321: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 166 KiB/s wr, 29 op/s 2024-05-08T09:02:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:07 smithi070 ceph-mon[29591]: pgmap v4322: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 165 KiB/s wr, 27 op/s 2024-05-08T09:02:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:07 smithi172 ceph-mon[33377]: pgmap v4322: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 165 KiB/s wr, 27 op/s 2024-05-08T09:02:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:07 smithi194 ceph-mon[33679]: pgmap v4322: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 165 KiB/s wr, 27 op/s 2024-05-08T09:02:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:09 smithi172 ceph-mon[33377]: pgmap v4323: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 165 KiB/s wr, 27 op/s 2024-05-08T09:02:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:09 smithi172 ceph-mon[33377]: osdmap e348: 12 total, 12 up, 12 in 2024-05-08T09:02:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:09 smithi194 ceph-mon[33679]: pgmap v4323: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 165 KiB/s wr, 27 op/s 2024-05-08T09:02:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:09 smithi194 ceph-mon[33679]: osdmap e348: 12 total, 12 up, 12 in 2024-05-08T09:02:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:09 smithi070 ceph-mon[29591]: pgmap v4323: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 165 KiB/s wr, 27 op/s 2024-05-08T09:02:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:09 smithi070 ceph-mon[29591]: osdmap e348: 12 total, 12 up, 12 in 2024-05-08T09:02:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:11 smithi172 ceph-mon[33377]: pgmap v4325: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 115 KiB/s wr, 34 op/s 2024-05-08T09:02:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:11 smithi172 ceph-mon[33377]: osdmap e349: 12 total, 12 up, 12 in 2024-05-08T09:02:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:11 smithi194 ceph-mon[33679]: pgmap v4325: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 115 KiB/s wr, 34 op/s 2024-05-08T09:02:11.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:11 smithi194 ceph-mon[33679]: osdmap e349: 12 total, 12 up, 12 in 2024-05-08T09:02:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:11 smithi070 ceph-mon[29591]: pgmap v4325: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 115 KiB/s wr, 34 op/s 2024-05-08T09:02:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:11 smithi070 ceph-mon[29591]: osdmap e349: 12 total, 12 up, 12 in 2024-05-08T09:02:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:13 smithi172 ceph-mon[33377]: pgmap v4327: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 KiB/s wr, 6 op/s 2024-05-08T09:02:13.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:13 smithi194 ceph-mon[33679]: pgmap v4327: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 KiB/s wr, 6 op/s 2024-05-08T09:02:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:13 smithi070 ceph-mon[29591]: pgmap v4327: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 KiB/s wr, 6 op/s 2024-05-08T09:02:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:15 smithi172 ceph-mon[33377]: pgmap v4328: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 50 KiB/s wr, 12 op/s 2024-05-08T09:02:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:15 smithi194 ceph-mon[33679]: pgmap v4328: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 50 KiB/s wr, 12 op/s 2024-05-08T09:02:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:15 smithi070 ceph-mon[29591]: pgmap v4328: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 50 KiB/s wr, 12 op/s 2024-05-08T09:02:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:17 smithi070 ceph-mon[29591]: osdmap e350: 12 total, 12 up, 12 in 2024-05-08T09:02:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:17 smithi070 ceph-mon[29591]: pgmap v4330: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 51 KiB/s wr, 12 op/s 2024-05-08T09:02:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:17 smithi172 ceph-mon[33377]: osdmap e350: 12 total, 12 up, 12 in 2024-05-08T09:02:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:17 smithi172 ceph-mon[33377]: pgmap v4330: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 51 KiB/s wr, 12 op/s 2024-05-08T09:02:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:17 smithi194 ceph-mon[33679]: osdmap e350: 12 total, 12 up, 12 in 2024-05-08T09:02:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:17 smithi194 ceph-mon[33679]: pgmap v4330: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 51 KiB/s wr, 12 op/s 2024-05-08T09:02:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:19 smithi070 ceph-mon[29591]: pgmap v4331: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T09:02:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:19 smithi172 ceph-mon[33377]: pgmap v4331: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T09:02:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:19 smithi194 ceph-mon[33679]: pgmap v4331: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 17 KiB/s wr, 6 op/s 2024-05-08T09:02:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:21 smithi070 ceph-mon[29591]: pgmap v4332: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-05-08T09:02:21.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:21 smithi172 ceph-mon[33377]: pgmap v4332: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-05-08T09:02:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:21 smithi194 ceph-mon[33679]: pgmap v4332: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-05-08T09:02:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:23 smithi070 ceph-mon[29591]: pgmap v4333: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-08T09:02:23.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:02:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:23 smithi172 ceph-mon[33377]: pgmap v4333: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-08T09:02:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:02:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:23 smithi194 ceph-mon[33679]: pgmap v4333: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 14 KiB/s wr, 8 op/s 2024-05-08T09:02:23.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:02:25.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:25 smithi070 ceph-mon[29591]: pgmap v4334: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7 op/s 2024-05-08T09:02:25.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:02:25.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:02:25.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:02:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:25 smithi172 ceph-mon[33377]: pgmap v4334: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7 op/s 2024-05-08T09:02:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:02:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:02:25.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:02:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:25 smithi194 ceph-mon[33679]: pgmap v4334: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7 op/s 2024-05-08T09:02:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:02:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:02:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:02:27.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:27 smithi070 ceph-mon[29591]: pgmap v4335: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6 op/s 2024-05-08T09:02:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:27 smithi172 ceph-mon[33377]: pgmap v4335: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6 op/s 2024-05-08T09:02:27.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:27 smithi194 ceph-mon[33679]: pgmap v4335: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6 op/s 2024-05-08T09:02:29.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:29 smithi070 ceph-mon[29591]: pgmap v4336: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5 op/s 2024-05-08T09:02:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:29 smithi172 ceph-mon[33377]: pgmap v4336: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5 op/s 2024-05-08T09:02:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:29 smithi194 ceph-mon[33679]: pgmap v4336: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5 op/s 2024-05-08T09:02:30.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:02:30.982 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:02:31.392 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:31 smithi070 ceph-mon[29591]: pgmap v4337: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8 op/s 2024-05-08T09:02:31.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:31 smithi172 ceph-mon[33377]: pgmap v4337: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8 op/s 2024-05-08T09:02:31.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:31 smithi194 ceph-mon[33679]: pgmap v4337: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8 op/s 2024-05-08T09:02:33.623 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:33 smithi070 ceph-mon[29591]: pgmap v4338: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:33.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.665+0000 7f9eb5800700 1 -- 172.21.15.70:0/1803104513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 msgr2=0x7f9eb01087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:33.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.665+0000 7f9eb5800700 1 --2- 172.21.15.70:0/1803104513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 0x7f9eb01087f0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009990 tx=0x7f9ea0009ca0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.666+0000 7f9eb5800700 1 -- 172.21.15.70:0/1803104513 shutdown_connections 2024-05-08T09:02:33.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.666+0000 7f9eb5800700 1 --2- 172.21.15.70:0/1803104513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9eb0102d60 0x7f9eb010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.666+0000 7f9eb5800700 1 --2- 172.21.15.70:0/1803104513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 0x7f9eb01087f0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.666+0000 7f9eb5800700 1 --2- 172.21.15.70:0/1803104513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eb01023a0 0x7f9eb0102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.666+0000 7f9eb5800700 1 -- 172.21.15.70:0/1803104513 >> 172.21.15.70:0/1803104513 conn(0x7f9eb0079350 msgr2=0x7f9eb0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:33.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.666+0000 7f9eb5800700 1 -- 172.21.15.70:0/1803104513 shutdown_connections 2024-05-08T09:02:33.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.666+0000 7f9eb5800700 1 -- 172.21.15.70:0/1803104513 wait complete. 2024-05-08T09:02:33.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.667+0000 7f9eb5800700 1 Processor -- start 2024-05-08T09:02:33.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.667+0000 7f9eb5800700 1 -- start start 2024-05-08T09:02:33.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eb5800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eb01023a0 0x7f9eb01a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:33.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eb5800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9eb0102d60 0x7f9eb01a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:33.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eb5800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 0x7f9eb019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:33.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eb5800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb0112430 con 0x7f9eb0108410 2024-05-08T09:02:33.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eb5800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb01122b0 con 0x7f9eb0102d60 2024-05-08T09:02:33.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eb5800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb01125b0 con 0x7f9eb01023a0 2024-05-08T09:02:33.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eaf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 0x7f9eb019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:33.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eaf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 0x7f9eb019ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43650/0 (socket says 172.21.15.70:43650) 2024-05-08T09:02:33.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eaf400700 1 -- 172.21.15.70:0/397338026 learned_addr learned my addr 172.21.15.70:0/397338026 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:02:33.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eaea00700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eb01023a0 0x7f9eb01a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:33.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.668+0000 7f9eae000700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9eb0102d60 0x7f9eb01a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:33.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eaf400700 1 -- 172.21.15.70:0/397338026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eb01023a0 msgr2=0x7f9eb01a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:33.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eaf400700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eb01023a0 0x7f9eb01a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eaf400700 1 -- 172.21.15.70:0/397338026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9eb0102d60 msgr2=0x7f9eb01a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:33.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eaf400700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9eb0102d60 0x7f9eb01a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eaf400700 1 -- 172.21.15.70:0/397338026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb019c180 con 0x7f9eb0108410 2024-05-08T09:02:33.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eaea00700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eb01023a0 0x7f9eb01a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:02:33.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eae000700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9eb0102d60 0x7f9eb01a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:02:33.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eaf400700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 0x7f9eb019ba20 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007d70 tx=0x7f9ea800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:02:33.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9ea7400700 1 -- 172.21.15.70:0/397338026 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8016020 con 0x7f9eb0108410 2024-05-08T09:02:33.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9ea7400700 1 -- 172.21.15.70:0/397338026 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ea800ad40 con 0x7f9eb0108410 2024-05-08T09:02:33.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb019c470 con 0x7f9eb0108410 2024-05-08T09:02:33.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9ea7400700 1 -- 172.21.15.70:0/397338026 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80115e0 con 0x7f9eb0108410 2024-05-08T09:02:33.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.669+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb01a8730 con 0x7f9eb0108410 2024-05-08T09:02:33.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.671+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb006a190 con 0x7f9eb0108410 2024-05-08T09:02:33.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.673+0000 7f9ea7400700 1 -- 172.21.15.70:0/397338026 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9ea8019020 con 0x7f9eb0108410 2024-05-08T09:02:33.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.676+0000 7f9ea7400700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9e940b2a70 0x7f9e940b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:33.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.676+0000 7f9ea7400700 1 -- 172.21.15.70:0/397338026 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(350..350 src has 1..350) ==== 9523+0+0 (secure 0 0 0) 0x7f9ea80e2cc0 con 0x7f9eb0108410 2024-05-08T09:02:33.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.676+0000 7f9eaea00700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9e940b2a70 0x7f9e940b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:33.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.677+0000 7f9eaea00700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9e940b2a70 0x7f9e940b4f30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0005850 tx=0x7f9ea001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:02:33.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.679+0000 7f9ea7400700 1 -- 172.21.15.70:0/397338026 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9ea8020020 con 0x7f9eb0108410 2024-05-08T09:02:33.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:33 smithi172 ceph-mon[33377]: pgmap v4338: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:33.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:33 smithi194 ceph-mon[33679]: pgmap v4338: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:33.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.990+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9eb01a89c0 con 0x7f9eb0108410 2024-05-08T09:02:33.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.992+0000 7f9ea7400700 1 -- 172.21.15.70:0/397338026 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f9ea80aa360 con 0x7f9eb0108410 2024-05-08T09:02:33.992 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:02:33.992 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:02:33.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9e940b2a70 msgr2=0x7f9e940b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9e940b2a70 0x7f9e940b4f30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0005850 tx=0x7f9ea001a040 comp rx=0 tx=0).stop 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 msgr2=0x7f9eb019ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 0x7f9eb019ba20 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007d70 tx=0x7f9ea800a340 comp rx=0 tx=0).stop 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 shutdown_connections 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9e940b2a70 0x7f9e940b4f30 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9eb0108410 0x7f9eb019ba20 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9eb01023a0 0x7f9eb01a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 --2- 172.21.15.70:0/397338026 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9eb0102d60 0x7f9eb01a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 >> 172.21.15.70:0/397338026 conn(0x7f9eb0079350 msgr2=0x7f9eb006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 shutdown_connections 2024-05-08T09:02:33.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:33.995+0000 7f9eb5800700 1 -- 172.21.15.70:0/397338026 wait complete. 2024-05-08T09:02:33.996 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:02:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/397338026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:02:34.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/397338026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:02:34.766 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/397338026' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:02:35.449 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 56a259b2 --release --await' 2024-05-08T09:02:35.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 56a259b2 --release --await 2024-05-08T09:02:35.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:35 smithi070 ceph-mon[29591]: pgmap v4339: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:02:35.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:35 smithi172 ceph-mon[33377]: pgmap v4339: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:02:35.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:35 smithi194 ceph-mon[33679]: pgmap v4339: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:02:35.874 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:02:37.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:37 smithi070 ceph-mon[29591]: pgmap v4340: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:37 smithi172 ceph-mon[33377]: pgmap v4340: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:37.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:37 smithi194 ceph-mon[33679]: pgmap v4340: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:38.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.206+0000 7fca57400700 1 -- 172.21.15.70:0/2259801803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 msgr2=0x7fca50110360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:38.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.206+0000 7fca57400700 1 --2- 172.21.15.70:0/2259801803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 0x7fca50110360 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fca4800b0a0 tx=0x7fca4800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.206+0000 7fca57400700 1 -- 172.21.15.70:0/2259801803 shutdown_connections 2024-05-08T09:02:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.206+0000 7fca57400700 1 --2- 172.21.15.70:0/2259801803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 0x7fca50110360 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.206+0000 7fca57400700 1 --2- 172.21.15.70:0/2259801803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca50109590 0x7fca50109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.206+0000 7fca57400700 1 --2- 172.21.15.70:0/2259801803 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca5006bb80 0x7fca5006c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.206+0000 7fca57400700 1 -- 172.21.15.70:0/2259801803 >> 172.21.15.70:0/2259801803 conn(0x7fca50079200 msgr2=0x7fca50079610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.207+0000 7fca57400700 1 -- 172.21.15.70:0/2259801803 shutdown_connections 2024-05-08T09:02:38.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.207+0000 7fca57400700 1 -- 172.21.15.70:0/2259801803 wait complete. 2024-05-08T09:02:38.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.208+0000 7fca57400700 1 Processor -- start 2024-05-08T09:02:38.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.208+0000 7fca57400700 1 -- start start 2024-05-08T09:02:38.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.208+0000 7fca57400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca5006bb80 0x7fca5019f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.208+0000 7fca57400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 0x7fca5019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.208+0000 7fca57400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca50109590 0x7fca501998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.208+0000 7fca57400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca50113560 con 0x7fca5006c540 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.208+0000 7fca57400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca501133e0 con 0x7fca5006bb80 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.208+0000 7fca57400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fca501136e0 con 0x7fca50109590 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca4fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 0x7fca5019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca4fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 0x7fca5019fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40410/0 (socket says 172.21.15.70:40410) 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca4fe00700 1 -- 172.21.15.70:0/2450436599 learned_addr learned my addr 172.21.15.70:0/2450436599 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca54a00700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca5006bb80 0x7fca5019f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca55400700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca50109590 0x7fca501998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca4fe00700 1 -- 172.21.15.70:0/2450436599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca50109590 msgr2=0x7fca501998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca4fe00700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca50109590 0x7fca501998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca4fe00700 1 -- 172.21.15.70:0/2450436599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca5006bb80 msgr2=0x7fca5019f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca4fe00700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca5006bb80 0x7fca5019f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca4fe00700 1 -- 172.21.15.70:0/2450436599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5019a040 con 0x7fca5006c540 2024-05-08T09:02:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.209+0000 7fca4fe00700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 0x7fca5019fc10 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00d950 tx=0x7fca3c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:02:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.210+0000 7fca4d600700 1 -- 172.21.15.70:0/2450436599 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c016070 con 0x7fca5006c540 2024-05-08T09:02:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.210+0000 7fca4d600700 1 -- 172.21.15.70:0/2450436599 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca3c010460 con 0x7fca5006c540 2024-05-08T09:02:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.210+0000 7fca57400700 1 -- 172.21.15.70:0/2450436599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5019a330 con 0x7fca5006c540 2024-05-08T09:02:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.210+0000 7fca4d600700 1 -- 172.21.15.70:0/2450436599 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c00f620 con 0x7fca5006c540 2024-05-08T09:02:38.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.210+0000 7fca57400700 1 -- 172.21.15.70:0/2450436599 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca501a65a0 con 0x7fca5006c540 2024-05-08T09:02:38.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.214+0000 7fca4d600700 1 -- 172.21.15.70:0/2450436599 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fca3c019070 con 0x7fca5006c540 2024-05-08T09:02:38.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.215+0000 7fca4d600700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca380b29f0 0x7fca380b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.215+0000 7fca4d600700 1 -- 172.21.15.70:0/2450436599 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(350..350 src has 1..350) ==== 9523+0+0 (secure 0 0 0) 0x7fca3c0e26b0 con 0x7fca5006c540 2024-05-08T09:02:38.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.215+0000 7fca54a00700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca380b29f0 0x7fca380b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.216+0000 7fca54a00700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca380b29f0 0x7fca380b4eb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca44005fd0 tx=0x7fca44005db0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:02:38.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.222+0000 7fca61dceb80 1 Processor -- start 2024-05-08T09:02:38.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.222+0000 7fca61dceb80 1 -- start start 2024-05-08T09:02:38.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.222+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092846d70 0x563092847150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.222+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092847690 0x56309284b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.222+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x56309284bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.222+0000 7fca61dceb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563092794b20 con 0x563092846d70 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.222+0000 7fca61dceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563092732860 con 0x56309284b680 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.222+0000 7fca61dceb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563092790ae0 con 0x563092847690 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca54a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092846d70 0x563092847150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca54a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092846d70 0x563092847150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40412/0 (socket says 172.21.15.70:40412) 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca54a00700 1 -- 172.21.15.70:0/3513006434 learned_addr learned my addr 172.21.15.70:0/3513006434 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca55400700 1 --2- 172.21.15.70:0/3513006434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x56309284bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca54a00700 1 -- 172.21.15.70:0/3513006434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092847690 msgr2=0x56309284b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca54a00700 1 --2- 172.21.15.70:0/3513006434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092847690 0x56309284b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca54a00700 1 -- 172.21.15.70:0/3513006434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 msgr2=0x56309284bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca54a00700 1 --2- 172.21.15.70:0/3513006434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x56309284bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca54a00700 1 -- 172.21.15.70:0/3513006434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630926e19d0 con 0x563092846d70 2024-05-08T09:02:38.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.223+0000 7fca55400700 1 --2- 172.21.15.70:0/3513006434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x56309284bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.224+0000 7fca54a00700 1 --2- 172.21.15.70:0/3513006434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092846d70 0x563092847150 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fca4400ebb0 tx=0x7fca4400af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f6b0020b61a6cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.224+0000 7fca42000700 1 -- 172.21.15.70:0/3513006434 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44021070 con 0x563092846d70 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.224+0000 7fca42000700 1 -- 172.21.15.70:0/3513006434 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca44010cd0 con 0x563092846d70 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.224+0000 7fca42000700 1 -- 172.21.15.70:0/3513006434 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4400f620 con 0x563092846d70 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 -- 172.21.15.70:0/3513006434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092846d70 msgr2=0x563092847150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 --2- 172.21.15.70:0/3513006434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092846d70 0x563092847150 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fca4400ebb0 tx=0x7fca4400af90 comp rx=0 tx=0).stop 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 -- 172.21.15.70:0/3513006434 shutdown_connections 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 --2- 172.21.15.70:0/3513006434 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x56309284bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 --2- 172.21.15.70:0/3513006434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092846d70 0x563092847150 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 --2- 172.21.15.70:0/3513006434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092847690 0x56309284b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 -- 172.21.15.70:0/3513006434 >> 172.21.15.70:0/3513006434 conn(0x5630927ba7d0 msgr2=0x56309283d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:38.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 -- 172.21.15.70:0/3513006434 shutdown_connections 2024-05-08T09:02:38.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 -- 172.21.15.70:0/3513006434 wait complete. 2024-05-08T09:02:38.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.225+0000 7fca61dceb80 1 -- start start 2024-05-08T09:02:38.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.226+0000 7fca61dceb80 1 Processor -- start 2024-05-08T09:02:38.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.226+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092846d70 0x563092852bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.226+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x56309284ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.226+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56309284b680 0x5630928504b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.226+0000 7fca61dceb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563092853920 con 0x563092847690 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.226+0000 7fca61dceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5630926fac20 con 0x563092846d70 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.226+0000 7fca61dceb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563092853aa0 con 0x56309284b680 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.226+0000 7fca61dceb80 10 client.0 _ll_register_callbacks cb 0x56309273bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca4fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x56309284ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca4fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x56309284ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40414/0 (socket says 172.21.15.70:40414) 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca4fe00700 1 -- 172.21.15.70:0/887712719 learned_addr learned my addr 172.21.15.70:0/887712719 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca54a00700 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092846d70 0x563092852bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca4fe00700 1 -- 172.21.15.70:0/887712719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56309284b680 msgr2=0x5630928504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca55400700 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56309284b680 0x5630928504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca4fe00700 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56309284b680 0x5630928504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca4fe00700 1 -- 172.21.15.70:0/887712719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092846d70 msgr2=0x563092852bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:02:38.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca4fe00700 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092846d70 0x563092852bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca4fe00700 1 -- 172.21.15.70:0/887712719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56309275a520 con 0x563092847690 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca4fe00700 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x56309284ff70 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0a55c0 tx=0x7fca3c0a8d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402438a513761716 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.227+0000 7fca36a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.228+0000 7fca36a00700 1 -- 172.21.15.70:0/887712719 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c020070 con 0x563092847690 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.228+0000 7fca36a00700 1 -- 172.21.15.70:0/887712719 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(350..350 src has 1..350) ==== 9523+0+0 (secure 0 0 0) 0x7fca3c0910b0 con 0x563092847690 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.228+0000 7fca61dceb80 1 -- 172.21.15.70:0/887712719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca44010cd0 con 0x563092847690 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.228+0000 7fca36a00700 1 -- 172.21.15.70:0/887712719 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fca3c0a9540 con 0x563092847690 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.228+0000 7fca61dceb80 10 client.18984 fetch_fsmap learned FSMap version 42 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.228+0000 7fca61dceb80 1 -- 172.21.15.70:0/887712719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56309285e240 con 0x563092847690 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.228+0000 7fca36a00700 1 -- 172.21.15.70:0/887712719 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca44010cd0 con 0x563092847690 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.228+0000 7fca36a00700 1 -- 172.21.15.70:0/887712719 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fca3c0e2200 con 0x563092847690 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.229+0000 7fca61dceb80 10 client.18984 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.229+0000 7fca61dceb80 10 client.18984 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:02:38.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.229+0000 7fca61dceb80 20 client.18984 populate_metadata read hostname 'smithi070' 2024-05-08T09:02:38.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.229+0000 7fca61dceb80 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563092860880 0x563092862c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.229+0000 7fca61dceb80 4 client.18984 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:02:38.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.229+0000 7fca61dceb80 1 -- 172.21.15.70:0/887712719 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56309280f240 con 0x563092860880 2024-05-08T09:02:38.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.229+0000 7fca54a00700 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563092860880 0x563092862c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.230+0000 7fca54a00700 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563092860880 0x563092862c70 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de459563db92cf64 server_cookie=871941a579e70076 in_seq=0 out_seq=0 2024-05-08T09:02:38.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.230+0000 7fca36a00700 10 client.18984 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:02:38.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.232+0000 7fca36a00700 1 -- 172.21.15.70:0/887712719 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56309280f240 con 0x563092860880 2024-05-08T09:02:38.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.232+0000 7fca36a00700 10 client.18984 handle_command_reply: tid=0 2024-05-08T09:02:38.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.232+0000 7fca61dceb80 1 client.18984 shutdown 2024-05-08T09:02:38.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 -- 172.21.15.70:0/887712719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 msgr2=0x56309284ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x56309284ff70 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0a55c0 tx=0x7fca3c0a8d60 comp rx=0 tx=0).stop 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 -- 172.21.15.70:0/887712719 shutdown_connections 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x563092860880 0x563092862c70 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56309284b680 0x5630928504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092846d70 0x563092852bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 --2- 172.21.15.70:0/887712719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x56309284ff70 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 -- 172.21.15.70:0/887712719 >> 172.21.15.70:0/887712719 conn(0x5630927ba7d0 msgr2=0x563092837b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca36a00700 0 client.18984 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 -- 172.21.15.70:0/887712719 shutdown_connections 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 1 -- 172.21.15.70:0/887712719 wait complete. 2024-05-08T09:02:38.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.233+0000 7fca61dceb80 20 client.18984 trim_cache size 0 max 16384 2024-05-08T09:02:38.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.255+0000 7fca61dceb80 1 Processor -- start 2024-05-08T09:02:38.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.255+0000 7fca61dceb80 1 -- start start 2024-05-08T09:02:38.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.255+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092846d70 0x56309285c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x5630928379c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x5630928683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca61dceb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca501afba0 con 0x563092847690 2024-05-08T09:02:38.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca61dceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ad430 con 0x56309284b680 2024-05-08T09:02:38.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca61dceb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ab280 con 0x563092846d70 2024-05-08T09:02:38.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca4fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x5630928379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca4fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x5630928379c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40428/0 (socket says 172.21.15.70:40428) 2024-05-08T09:02:38.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca4fe00700 1 -- 172.21.15.70:0/1026818208 learned_addr learned my addr 172.21.15.70:0/1026818208 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:02:38.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca55400700 1 --2- 172.21.15.70:0/1026818208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x5630928683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca4fe00700 1 -- 172.21.15.70:0/1026818208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092846d70 msgr2=0x56309285c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:02:38.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca4fe00700 1 --2- 172.21.15.70:0/1026818208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092846d70 0x56309285c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca4fe00700 1 -- 172.21.15.70:0/1026818208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 msgr2=0x5630928683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.256+0000 7fca4fe00700 1 --2- 172.21.15.70:0/1026818208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x5630928683e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.257+0000 7fca4fe00700 1 -- 172.21.15.70:0/1026818208 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56309284e500 con 0x563092847690 2024-05-08T09:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.257+0000 7fca55400700 1 --2- 172.21.15.70:0/1026818208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x5630928683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.257+0000 7fca4fe00700 1 --2- 172.21.15.70:0/1026818208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x5630928379c0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0e25a0 tx=0x7fca3c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7fd42e9288845e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.257+0000 7fca41600700 1 -- 172.21.15.70:0/1026818208 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c020070 con 0x563092847690 2024-05-08T09:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.257+0000 7fca41600700 1 -- 172.21.15.70:0/1026818208 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca3c0a8ac0 con 0x563092847690 2024-05-08T09:02:38.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.257+0000 7fca41600700 1 -- 172.21.15.70:0/1026818208 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0e2200 con 0x563092847690 2024-05-08T09:02:38.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.258+0000 7fca61dceb80 1 -- 172.21.15.70:0/1026818208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 msgr2=0x5630928379c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:38.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.258+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1026818208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x5630928379c0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0e25a0 tx=0x7fca3c000bc0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.258+0000 7fca61dceb80 1 -- 172.21.15.70:0/1026818208 shutdown_connections 2024-05-08T09:02:38.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.258+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1026818208 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56309284b680 0x5630928683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.258+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1026818208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092846d70 0x56309285c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.258+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1026818208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563092847690 0x5630928379c0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.258+0000 7fca61dceb80 1 -- 172.21.15.70:0/1026818208 >> 172.21.15.70:0/1026818208 conn(0x5630927ba7d0 msgr2=0x5630928372b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:38.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.258+0000 7fca61dceb80 1 -- 172.21.15.70:0/1026818208 shutdown_connections 2024-05-08T09:02:38.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.258+0000 7fca61dceb80 1 -- 172.21.15.70:0/1026818208 wait complete. 2024-05-08T09:02:38.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.259+0000 7fca61dceb80 1 -- start start 2024-05-08T09:02:38.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.259+0000 7fca61dceb80 1 Processor -- start 2024-05-08T09:02:38.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092846d70 0x563092855d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092847690 0x563092856270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca61dceb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56309284b680 0x5630928567b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca61dceb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca501ab8f0 con 0x56309284b680 2024-05-08T09:02:38.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca61dceb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca501acd60 con 0x563092847690 2024-05-08T09:02:38.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca61dceb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fca501abfc0 con 0x563092846d70 2024-05-08T09:02:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca61dceb80 10 client.0 _ll_register_callbacks cb 0x56309273bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:02:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56309284b680 0x5630928567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca55400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56309284b680 0x5630928567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40434/0 (socket says 172.21.15.70:40434) 2024-05-08T09:02:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca55400700 1 -- 172.21.15.70:0/1245343173 learned_addr learned my addr 172.21.15.70:0/1245343173 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:02:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca4fe00700 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092847690 0x563092856270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.260+0000 7fca54a00700 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092846d70 0x563092855d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca55400700 1 -- 172.21.15.70:0/1245343173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092846d70 msgr2=0x563092855d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:02:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca55400700 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092846d70 0x563092855d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca55400700 1 -- 172.21.15.70:0/1245343173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092847690 msgr2=0x563092856270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:02:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca55400700 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092847690 0x563092856270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca55400700 1 -- 172.21.15.70:0/1245343173 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630928cb070 con 0x56309284b680 2024-05-08T09:02:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca55400700 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56309284b680 0x5630928567b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fca48004c80 tx=0x7fca48004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b3141c0b118cb5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:02:38.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca36a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:02:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca36a00700 1 -- 172.21.15.70:0/1245343173 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480074e0 con 0x56309284b680 2024-05-08T09:02:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca36a00700 1 -- 172.21.15.70:0/1245343173 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(350..350 src has 1..350) ==== 9523+0+0 (secure 0 0 0) 0x7fca48007680 con 0x56309284b680 2024-05-08T09:02:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.261+0000 7fca61dceb80 1 -- 172.21.15.70:0/1245343173 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca3c0a8ac0 con 0x56309284b680 2024-05-08T09:02:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca36a00700 1 -- 172.21.15.70:0/1245343173 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fca48007880 con 0x56309284b680 2024-05-08T09:02:38.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca61dceb80 10 client.18990 fetch_fsmap learned FSMap version 42 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca61dceb80 1 -- 172.21.15.70:0/1245343173 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5630928cc2e0 con 0x56309284b680 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca36a00700 1 -- 172.21.15.70:0/1245343173 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca3c0a8ac0 con 0x56309284b680 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca36a00700 1 -- 172.21.15.70:0/1245343173 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fca48011070 con 0x56309284b680 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca61dceb80 10 client.18990 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca61dceb80 10 client.18990 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca61dceb80 20 client.18990 populate_metadata read hostname 'smithi070' 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5630928cca40 0x5630928cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca61dceb80 4 client.18990 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "56a259b2", "release": true, "await": true}] 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.262+0000 7fca61dceb80 1 -- 172.21.15.70:0/1245343173 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "56a259b2", "release": true, "await": true}) -- 0x56309283d5d0 con 0x5630928cca40 2024-05-08T09:02:38.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.263+0000 7fca54a00700 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5630928cca40 0x5630928cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:02:38.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.264+0000 7fca54a00700 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5630928cca40 0x5630928cee60 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6055af1db35e22 server_cookie=f26a0203d1b06bf3 in_seq=0 out_seq=0 2024-05-08T09:02:38.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:38.264+0000 7fca36a00700 10 client.18990 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:02:39.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:39 smithi172 ceph-mon[33377]: pgmap v4341: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:39 smithi194 ceph-mon[33679]: pgmap v4341: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:39.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:39 smithi070 ceph-mon[29591]: pgmap v4341: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:41.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:41 smithi172 ceph-mon[33377]: pgmap v4342: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:02:41.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:41 smithi194 ceph-mon[33679]: pgmap v4342: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:02:41.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:41 smithi070 ceph-mon[29591]: pgmap v4342: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:02:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.705+0000 7fca36a00700 1 -- 172.21.15.70:0/1245343173 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x56309283d5d0 con 0x5630928cca40 2024-05-08T09:02:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.705+0000 7fca36a00700 10 client.18990 handle_command_reply: tid=0 2024-05-08T09:02:42.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.705+0000 7fca61dceb80 1 client.18990 shutdown 2024-05-08T09:02:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.706+0000 7fca61dceb80 1 -- 172.21.15.70:0/1245343173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56309284b680 msgr2=0x5630928567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:42.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.706+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56309284b680 0x5630928567b0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fca48004c80 tx=0x7fca48004d60 comp rx=0 tx=0).stop 2024-05-08T09:02:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.707+0000 7fca61dceb80 1 -- 172.21.15.70:0/1245343173 shutdown_connections 2024-05-08T09:02:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.707+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5630928cca40 0x5630928cee60 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.707+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56309284b680 0x5630928567b0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.707+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x563092846d70 0x563092855d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.707+0000 7fca61dceb80 1 --2- 172.21.15.70:0/1245343173 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x563092847690 0x563092856270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.707+0000 7fca61dceb80 1 -- 172.21.15.70:0/1245343173 >> 172.21.15.70:0/1245343173 conn(0x5630927ba7d0 msgr2=0x563092837b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:42.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.708+0000 7fca36a00700 0 client.18990 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:02:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.708+0000 7fca61dceb80 1 -- 172.21.15.70:0/1245343173 shutdown_connections 2024-05-08T09:02:42.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.708+0000 7fca61dceb80 1 -- 172.21.15.70:0/1245343173 wait complete. 2024-05-08T09:02:42.709 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:02:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:02:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:02:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 304, 2024-05-08T09:02:42.709 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "56a259b2": { 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 304, 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 87.9, 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:02:42.710 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:02:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:02:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:42.711 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:02:42.711 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:02:42.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.709+0000 7fca61dceb80 20 client.18990 trim_cache size 0 max 16384 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 -- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca380b29f0 msgr2=0x7fca380b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca380b29f0 0x7fca380b4eb0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca44005fd0 tx=0x7fca44005db0 comp rx=0 tx=0).stop 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 -- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 msgr2=0x7fca5019fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 0x7fca5019fc10 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00d950 tx=0x7fca3c00dd10 comp rx=0 tx=0).stop 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 -- 172.21.15.70:0/2450436599 shutdown_connections 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca380b29f0 0x7fca380b4eb0 secure :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca44005fd0 tx=0x7fca44005db0 comp rx=0 tx=0).stop 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca50109590 0x7fca501998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca5006bb80 0x7fca5019f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 --2- 172.21.15.70:0/2450436599 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca5006c540 0x7fca5019fc10 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 -- 172.21.15.70:0/2450436599 >> 172.21.15.70:0/2450436599 conn(0x7fca50079200 msgr2=0x7fca50101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.711+0000 7fca57400700 1 -- 172.21.15.70:0/2450436599 shutdown_connections 2024-05-08T09:02:42.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:02:42.712+0000 7fca57400700 1 -- 172.21.15.70:0/2450436599 wait complete. 2024-05-08T09:02:42.899 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_engine_user.o 2024-05-08T09:02:42.907 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/libahci.o 2024-05-08T09:02:43.216 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/module.o 2024-05-08T09:02:43.340 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/sr_ioctl.o 2024-05-08T09:02:43.524 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:43 smithi070 ceph-mon[29591]: pgmap v4343: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:43.576 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '56a259b2', seconds elapsed: 76.1 2024-05-08T09:02:43.606 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/sr_vendor.o 2024-05-08T09:02:43.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:43 smithi172 ceph-mon[33377]: pgmap v4343: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:43.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:43 smithi194 ceph-mon[33679]: pgmap v4343: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:02:44.660 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/ata_piix.o 2024-05-08T09:02:45.225 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/mdio/built-in.a 2024-05-08T09:02:45.670 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/3com/built-in.a 2024-05-08T09:02:45.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:45 smithi172 ceph-mon[33377]: pgmap v4344: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 119 KiB/s wr, 11 op/s 2024-05-08T09:02:45.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:45 smithi194 ceph-mon[33679]: pgmap v4344: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 119 KiB/s wr, 11 op/s 2024-05-08T09:02:45.762 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:45 smithi070 ceph-mon[29591]: pgmap v4344: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 119 KiB/s wr, 11 op/s 2024-05-08T09:02:45.902 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/8390/built-in.a 2024-05-08T09:02:46.116 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/adaptec/built-in.a 2024-05-08T09:02:46.317 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/agere/built-in.a 2024-05-08T09:02:46.504 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/alacritech/built-in.a 2024-05-08T09:02:46.568 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/alteon/built-in.a 2024-05-08T09:02:46.665 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/sg.o 2024-05-08T09:02:46.712 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/amazon/built-in.a 2024-05-08T09:02:46.903 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/amd/built-in.a 2024-05-08T09:02:47.103 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/aquantia/built-in.a 2024-05-08T09:02:47.275 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/arc/built-in.a 2024-05-08T09:02:47.517 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/asix/built-in.a 2024-05-08T09:02:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:47 smithi172 ceph-mon[33377]: pgmap v4345: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 119 KiB/s wr, 8 op/s 2024-05-08T09:02:47.698 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/atheros/built-in.a 2024-05-08T09:02:47.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:47 smithi194 ceph-mon[33679]: pgmap v4345: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 119 KiB/s wr, 8 op/s 2024-05-08T09:02:47.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:47 smithi070 ceph-mon[29591]: pgmap v4345: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 119 KiB/s wr, 8 op/s 2024-05-08T09:02:47.898 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/cadence/built-in.a 2024-05-08T09:02:48.135 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/broadcom/tg3.o 2024-05-08T09:02:49.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:49 smithi172 ceph-mon[33377]: pgmap v4346: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 119 KiB/s wr, 8 op/s 2024-05-08T09:02:49.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:49 smithi194 ceph-mon[33679]: pgmap v4346: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 119 KiB/s wr, 8 op/s 2024-05-08T09:02:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:49 smithi070 ceph-mon[29591]: pgmap v4346: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 119 KiB/s wr, 8 op/s 2024-05-08T09:02:50.187 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/platform-msi.o 2024-05-08T09:02:51.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:51 smithi172 ceph-mon[33377]: pgmap v4347: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 427 KiB/s wr, 27 op/s 2024-05-08T09:02:51.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:51 smithi194 ceph-mon[33679]: pgmap v4347: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 427 KiB/s wr, 27 op/s 2024-05-08T09:02:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:51 smithi070 ceph-mon[29591]: pgmap v4347: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 427 KiB/s wr, 27 op/s 2024-05-08T09:02:52.942 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/brocade/built-in.a 2024-05-08T09:02:53.634 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/auxdisplay/built-in.a 2024-05-08T09:02:53.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:53 smithi194 ceph-mon[33679]: pgmap v4348: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 427 KiB/s wr, 24 op/s 2024-05-08T09:02:53.778 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_execlists_submission.o 2024-05-08T09:02:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:53 smithi070 ceph-mon[29591]: pgmap v4348: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 427 KiB/s wr, 24 op/s 2024-05-08T09:02:53.890 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/cs.o 2024-05-08T09:02:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:53 smithi172 ceph-mon[33377]: pgmap v4348: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 454 KiB/s rd, 427 KiB/s wr, 24 op/s 2024-05-08T09:02:54.569 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/common/common.o 2024-05-08T09:02:55.579 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/pata_amd.o 2024-05-08T09:02:55.731 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:55 smithi172 ceph-mon[33377]: pgmap v4349: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 726 KiB/s wr, 36 op/s 2024-05-08T09:02:55.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:55 smithi194 ceph-mon[33679]: pgmap v4349: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 726 KiB/s wr, 36 op/s 2024-05-08T09:02:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:55 smithi070 ceph-mon[29591]: pgmap v4349: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 726 KiB/s wr, 36 op/s 2024-05-08T09:02:56.969 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/common/debug.o 2024-05-08T09:02:57.355 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/scsi/scsi_sysfs.o 2024-05-08T09:02:57.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:57 smithi194 ceph-mon[33679]: pgmap v4350: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 607 KiB/s wr, 30 op/s 2024-05-08T09:02:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:57 smithi070 ceph-mon[29591]: pgmap v4350: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 607 KiB/s wr, 30 op/s 2024-05-08T09:02:57.900 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:57 smithi172 ceph-mon[33377]: pgmap v4350: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 607 KiB/s wr, 30 op/s 2024-05-08T09:02:58.913 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/pata_oldpiix.o 2024-05-08T09:02:59.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:02:59 smithi194 ceph-mon[33679]: pgmap v4351: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 607 KiB/s wr, 30 op/s 2024-05-08T09:02:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:02:59 smithi070 ceph-mon[29591]: pgmap v4351: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 607 KiB/s wr, 30 op/s 2024-05-08T09:02:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:02:59 smithi172 ceph-mon[33377]: pgmap v4351: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 607 KiB/s wr, 30 op/s 2024-05-08T09:02:59.974 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/physical_location.o 2024-05-08T09:03:01.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:01 smithi194 ceph-mon[33679]: pgmap v4352: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 975 KiB/s wr, 46 op/s 2024-05-08T09:03:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:01 smithi070 ceph-mon[29591]: pgmap v4352: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 975 KiB/s wr, 46 op/s 2024-05-08T09:03:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:01 smithi172 ceph-mon[33377]: pgmap v4352: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 967 KiB/s rd, 975 KiB/s wr, 46 op/s 2024-05-08T09:03:03.416 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/socket_sysfs.o 2024-05-08T09:03:03.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:03 smithi194 ceph-mon[33679]: pgmap v4353: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 668 KiB/s wr, 26 op/s 2024-05-08T09:03:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:03 smithi070 ceph-mon[29591]: pgmap v4353: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 668 KiB/s wr, 26 op/s 2024-05-08T09:03:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:03 smithi172 ceph-mon[33377]: pgmap v4353: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 631 KiB/s rd, 668 KiB/s wr, 26 op/s 2024-05-08T09:03:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:04 smithi194 ceph-mon[33679]: osdmap e351: 12 total, 12 up, 12 in 2024-05-08T09:03:04.810 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/common/built-in.a 2024-05-08T09:03:04.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:04 smithi070 ceph-mon[29591]: osdmap e351: 12 total, 12 up, 12 in 2024-05-08T09:03:04.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:04 smithi172 ceph-mon[33377]: osdmap e351: 12 total, 12 up, 12 in 2024-05-08T09:03:05.359 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/usb.o 2024-05-08T09:03:05.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:05 smithi194 ceph-mon[33679]: pgmap v4355: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 875 KiB/s wr, 52 op/s 2024-05-08T09:03:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:05 smithi070 ceph-mon[29591]: pgmap v4355: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 875 KiB/s wr, 52 op/s 2024-05-08T09:03:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:05 smithi172 ceph-mon[33377]: pgmap v4355: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 875 KiB/s wr, 52 op/s 2024-05-08T09:03:06.399 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/hub.o 2024-05-08T09:03:07.671 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/broadcom/built-in.a 2024-05-08T09:03:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:07 smithi194 ceph-mon[33679]: pgmap v4356: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 875 KiB/s wr, 52 op/s 2024-05-08T09:03:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:07 smithi070 ceph-mon[29591]: pgmap v4356: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 875 KiB/s wr, 52 op/s 2024-05-08T09:03:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:07 smithi172 ceph-mon[33377]: pgmap v4356: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 875 KiB/s wr, 52 op/s 2024-05-08T09:03:08.033 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/scsi/built-in.a 2024-05-08T09:03:08.269 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/cavium/common/built-in.a 2024-05-08T09:03:08.516 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/cavium/thunder/built-in.a 2024-05-08T09:03:08.604 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/base/trace.o 2024-05-08T09:03:08.759 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/cavium/liquidio/built-in.a 2024-05-08T09:03:08.978 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/cavium/octeon/built-in.a 2024-05-08T09:03:09.045 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_ggtt.o 2024-05-08T09:03:09.118 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/cavium/built-in.a 2024-05-08T09:03:09.394 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/chelsio/built-in.a 2024-05-08T09:03:09.469 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/cisco/built-in.a 2024-05-08T09:03:09.505 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_lease.o 2024-05-08T09:03:09.647 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ata/pata_sch.o 2024-05-08T09:03:09.691 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/cortina/built-in.a 2024-05-08T09:03:09.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:09 smithi194 ceph-mon[33679]: pgmap v4357: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 875 KiB/s wr, 52 op/s 2024-05-08T09:03:09.763 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:09 smithi172 ceph-mon[33377]: pgmap v4357: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 875 KiB/s wr, 52 op/s 2024-05-08T09:03:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:09 smithi070 ceph-mon[29591]: pgmap v4357: 129 pgs: 5 active+clean+snaptrim_wait, 124 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 875 KiB/s wr, 52 op/s 2024-05-08T09:03:09.976 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/dec/tulip/built-in.a 2024-05-08T09:03:10.102 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/dec/built-in.a 2024-05-08T09:03:10.293 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/dlink/built-in.a 2024-05-08T09:03:10.482 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/emulex/built-in.a 2024-05-08T09:03:10.679 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/engleder/built-in.a 2024-05-08T09:03:10.874 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/ezchip/built-in.a 2024-05-08T09:03:11.073 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/fujitsu/built-in.a 2024-05-08T09:03:11.281 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/fungible/built-in.a 2024-05-08T09:03:11.524 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/google/built-in.a 2024-05-08T09:03:11.708 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/huawei/built-in.a 2024-05-08T09:03:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:11 smithi070 ceph-mon[29591]: pgmap v4358: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 902 KiB/s wr, 56 op/s 2024-05-08T09:03:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:11 smithi070 ceph-mon[29591]: osdmap e352: 12 total, 12 up, 12 in 2024-05-08T09:03:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:11 smithi172 ceph-mon[33377]: pgmap v4358: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 902 KiB/s wr, 56 op/s 2024-05-08T09:03:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:11 smithi172 ceph-mon[33377]: osdmap e352: 12 total, 12 up, 12 in 2024-05-08T09:03:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:11 smithi194 ceph-mon[33679]: pgmap v4358: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 902 KiB/s wr, 56 op/s 2024-05-08T09:03:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:11 smithi194 ceph-mon[33679]: osdmap e352: 12 total, 12 up, 12 in 2024-05-08T09:03:12.068 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000/e1000_main.o 2024-05-08T09:03:12.818 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/cardbus.o 2024-05-08T09:03:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:13 smithi070 ceph-mon[29591]: pgmap v4360: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 1023 KiB/s wr, 63 op/s 2024-05-08T09:03:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:13 smithi172 ceph-mon[33377]: pgmap v4360: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 1023 KiB/s wr, 63 op/s 2024-05-08T09:03:14.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:13 smithi194 ceph-mon[33679]: pgmap v4360: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 940 KiB/s rd, 1023 KiB/s wr, 63 op/s 2024-05-08T09:03:15.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:15 smithi070 ceph-mon[29591]: pgmap v4361: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 881 KiB/s wr, 45 op/s 2024-05-08T09:03:15.919 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/serio/serio.o 2024-05-08T09:03:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:15 smithi172 ceph-mon[33377]: pgmap v4361: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 881 KiB/s wr, 45 op/s 2024-05-08T09:03:16.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:15 smithi194 ceph-mon[33679]: pgmap v4361: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 937 KiB/s rd, 881 KiB/s wr, 45 op/s 2024-05-08T09:03:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:17 smithi070 ceph-mon[29591]: pgmap v4362: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 881 KiB/s wr, 45 op/s 2024-05-08T09:03:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:17 smithi172 ceph-mon[33377]: pgmap v4362: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 881 KiB/s wr, 45 op/s 2024-05-08T09:03:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:17 smithi194 ceph-mon[33679]: pgmap v4362: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 881 KiB/s wr, 45 op/s 2024-05-08T09:03:18.686 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/base/built-in.a 2024-05-08T09:03:19.064 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/hcd.o 2024-05-08T09:03:19.322 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/urb.o 2024-05-08T09:03:19.520 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/ata/built-in.a 2024-05-08T09:03:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:19 smithi070 ceph-mon[29591]: pgmap v4363: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 881 KiB/s wr, 45 op/s 2024-05-08T09:03:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:19 smithi172 ceph-mon[33377]: pgmap v4363: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 881 KiB/s wr, 45 op/s 2024-05-08T09:03:20.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:19 smithi194 ceph-mon[33679]: pgmap v4363: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 881 KiB/s wr, 45 op/s 2024-05-08T09:03:20.245 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_ggtt_fencing.o 2024-05-08T09:03:20.921 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/admtek/built-in.a 2024-05-08T09:03:21.130 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/ath/built-in.a 2024-05-08T09:03:21.408 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/atmel/built-in.a 2024-05-08T09:03:21.603 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/broadcom/built-in.a 2024-05-08T09:03:21.735 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/ds.o 2024-05-08T09:03:21.853 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/cisco/built-in.a 2024-05-08T09:03:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:21 smithi070 ceph-mon[29591]: pgmap v4364: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 808 KiB/s wr, 40 op/s 2024-05-08T09:03:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:21 smithi172 ceph-mon[33377]: pgmap v4364: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 808 KiB/s wr, 40 op/s 2024-05-08T09:03:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:21 smithi194 ceph-mon[33679]: pgmap v4364: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 854 KiB/s rd, 808 KiB/s wr, 40 op/s 2024-05-08T09:03:22.067 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/intel/built-in.a 2024-05-08T09:03:22.268 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/intersil/built-in.a 2024-05-08T09:03:22.471 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/marvell/built-in.a 2024-05-08T09:03:22.692 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/mediatek/built-in.a 2024-05-08T09:03:22.897 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/microchip/built-in.a 2024-05-08T09:03:23.115 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/serio/i8042.o 2024-05-08T09:03:23.207 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/82571.o 2024-05-08T09:03:23.232 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/purelifi/built-in.a 2024-05-08T09:03:23.487 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/quantenna/built-in.a 2024-05-08T09:03:23.662 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/ralink/built-in.a 2024-05-08T09:03:23.844 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/realtek/built-in.a 2024-05-08T09:03:23.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:23 smithi070 ceph-mon[29591]: pgmap v4365: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 722 KiB/s wr, 35 op/s 2024-05-08T09:03:23.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:23 smithi172 ceph-mon[33377]: pgmap v4365: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 722 KiB/s wr, 35 op/s 2024-05-08T09:03:24.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:23 smithi194 ceph-mon[33679]: pgmap v4365: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 722 KiB/s wr, 35 op/s 2024-05-08T09:03:24.020 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/rsi/built-in.a 2024-05-08T09:03:24.213 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/silabs/built-in.a 2024-05-08T09:03:24.427 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/st/built-in.a 2024-05-08T09:03:24.642 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/ti/built-in.a 2024-05-08T09:03:25.258 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/zydas/built-in.a 2024-05-08T09:03:25.480 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/legacy/built-in.a 2024-05-08T09:03:25.724 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/virtual/built-in.a 2024-05-08T09:03:25.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:25 smithi070 ceph-mon[29591]: pgmap v4366: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-05-08T09:03:25.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:03:25.923 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/wireless/built-in.a 2024-05-08T09:03:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:25 smithi172 ceph-mon[33377]: pgmap v4366: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-05-08T09:03:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:03:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:25 smithi194 ceph-mon[33679]: pgmap v4366: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-05-08T09:03:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:03:26.261 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000/e1000_hw.o 2024-05-08T09:03:26.407 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/serio/serport.o 2024-05-08T09:03:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:27 smithi070 ceph-mon[29591]: pgmap v4367: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 760 KiB/s wr, 42 op/s 2024-05-08T09:03:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:03:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:03:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:03:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:27 smithi172 ceph-mon[33377]: pgmap v4367: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 760 KiB/s wr, 42 op/s 2024-05-08T09:03:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:03:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:03:27.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:03:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:27 smithi194 ceph-mon[33679]: pgmap v4367: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 760 KiB/s wr, 42 op/s 2024-05-08T09:03:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:03:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:03:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:03:28.637 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/serio/libps2.o 2024-05-08T09:03:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:29 smithi070 ceph-mon[29591]: pgmap v4368: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 760 KiB/s wr, 42 op/s 2024-05-08T09:03:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:29 smithi172 ceph-mon[33377]: pgmap v4368: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 760 KiB/s wr, 42 op/s 2024-05-08T09:03:30.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:29 smithi194 ceph-mon[33679]: pgmap v4368: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 765 KiB/s rd, 760 KiB/s wr, 42 op/s 2024-05-08T09:03:30.512 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/message.o 2024-05-08T09:03:31.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:31 smithi070 ceph-mon[29591]: pgmap v4369: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-05-08T09:03:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:31 smithi172 ceph-mon[33377]: pgmap v4369: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-05-08T09:03:32.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:31 smithi194 ceph-mon[33679]: pgmap v4369: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 58 op/s 2024-05-08T09:03:32.158 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/pcmcia_resource.o 2024-05-08T09:03:33.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:33 smithi070 ceph-mon[29591]: pgmap v4370: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 781 KiB/s wr, 45 op/s 2024-05-08T09:03:33.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:33 smithi172 ceph-mon[33377]: pgmap v4370: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 781 KiB/s wr, 45 op/s 2024-05-08T09:03:33.978 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/cistpl.o 2024-05-08T09:03:34.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:33 smithi194 ceph-mon[33679]: pgmap v4370: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 781 KiB/s wr, 45 op/s 2024-05-08T09:03:35.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:35 smithi070 ceph-mon[29591]: pgmap v4371: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-05-08T09:03:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:35 smithi172 ceph-mon[33377]: pgmap v4371: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-05-08T09:03:36.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:35 smithi194 ceph-mon[33679]: pgmap v4371: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1019 KiB/s rd, 1.1 MiB/s wr, 62 op/s 2024-05-08T09:03:37.422 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/pcmcia_cis.o 2024-05-08T09:03:37.727 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/input/serio/built-in.a 2024-05-08T09:03:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:37 smithi070 ceph-mon[29591]: pgmap v4372: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 700 KiB/s wr, 33 op/s 2024-05-08T09:03:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:37 smithi172 ceph-mon[33377]: pgmap v4372: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 700 KiB/s wr, 33 op/s 2024-05-08T09:03:38.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:37 smithi194 ceph-mon[33679]: pgmap v4372: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 700 KiB/s wr, 33 op/s 2024-05-08T09:03:38.206 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/ich8lan.o 2024-05-08T09:03:38.257 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/i825xx/built-in.a 2024-05-08T09:03:38.279 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt.o 2024-05-08T09:03:38.483 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/phy/built-in.a 2024-05-08T09:03:38.682 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/microsoft/built-in.a 2024-05-08T09:03:39.072 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/keyboard/atkbd.o 2024-05-08T09:03:39.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:39 smithi070 ceph-mon[29591]: pgmap v4373: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 701 KiB/s wr, 33 op/s 2024-05-08T09:03:39.887 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000/e1000_ethtool.o 2024-05-08T09:03:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:39 smithi172 ceph-mon[33377]: pgmap v4373: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 701 KiB/s wr, 33 op/s 2024-05-08T09:03:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:39 smithi194 ceph-mon[33679]: pgmap v4373: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 701 KiB/s wr, 33 op/s 2024-05-08T09:03:40.296 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/driver.o 2024-05-08T09:03:41.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:41 smithi070 ceph-mon[29591]: pgmap v4374: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 47 op/s 2024-05-08T09:03:41.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:41 smithi172 ceph-mon[33377]: pgmap v4374: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 47 op/s 2024-05-08T09:03:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:41 smithi194 ceph-mon[33679]: pgmap v4374: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 47 op/s 2024-05-08T09:03:42.706 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000/e1000_param.o 2024-05-08T09:03:42.815 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/psmouse-base.o 2024-05-08T09:03:43.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:43 smithi070 ceph-mon[29591]: pgmap v4375: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 824 KiB/s wr, 30 op/s 2024-05-08T09:03:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:43 smithi172 ceph-mon[33377]: pgmap v4375: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 824 KiB/s wr, 30 op/s 2024-05-08T09:03:44.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:43 smithi194 ceph-mon[33679]: pgmap v4375: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 824 KiB/s wr, 30 op/s 2024-05-08T09:03:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:45 smithi070 ceph-mon[29591]: pgmap v4376: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 41 op/s 2024-05-08T09:03:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:45 smithi172 ceph-mon[33377]: pgmap v4376: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 41 op/s 2024-05-08T09:03:46.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:45 smithi194 ceph-mon[33679]: pgmap v4376: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 41 op/s 2024-05-08T09:03:47.728 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/input/keyboard/built-in.a 2024-05-08T09:03:47.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:47 smithi070 ceph-mon[29591]: pgmap v4377: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 773 KiB/s wr, 24 op/s 2024-05-08T09:03:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:47 smithi172 ceph-mon[33377]: pgmap v4377: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 773 KiB/s wr, 24 op/s 2024-05-08T09:03:48.000 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/synaptics.o 2024-05-08T09:03:48.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:47 smithi194 ceph-mon[33679]: pgmap v4377: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 773 KiB/s wr, 24 op/s 2024-05-08T09:03:48.289 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/rsrc_mgr.o 2024-05-08T09:03:49.129 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/config.o 2024-05-08T09:03:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:49 smithi070 ceph-mon[29591]: pgmap v4378: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 773 KiB/s wr, 24 op/s 2024-05-08T09:03:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:49 smithi172 ceph-mon[33377]: pgmap v4378: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 773 KiB/s wr, 24 op/s 2024-05-08T09:03:50.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:49 smithi194 ceph-mon[33679]: pgmap v4378: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 773 KiB/s wr, 24 op/s 2024-05-08T09:03:51.249 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/80003es2lan.o 2024-05-08T09:03:51.588 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/mon/mon_main.o 2024-05-08T09:03:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:51 smithi070 ceph-mon[29591]: pgmap v4379: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 986 KiB/s wr, 40 op/s 2024-05-08T09:03:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:51 smithi172 ceph-mon[33377]: pgmap v4379: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 986 KiB/s wr, 40 op/s 2024-05-08T09:03:52.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:51 smithi194 ceph-mon[33679]: pgmap v4379: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 986 KiB/s wr, 40 op/s 2024-05-08T09:03:52.131 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_buffer_pool.o 2024-05-08T09:03:52.513 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_clock_utils.o 2024-05-08T09:03:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:53 smithi070 ceph-mon[29591]: pgmap v4380: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 511 KiB/s wr, 26 op/s 2024-05-08T09:03:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:53 smithi172 ceph-mon[33377]: pgmap v4380: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 511 KiB/s wr, 26 op/s 2024-05-08T09:03:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:53 smithi194 ceph-mon[33679]: pgmap v4380: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 511 KiB/s wr, 26 op/s 2024-05-08T09:03:55.002 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/intel/e1000/built-in.a 2024-05-08T09:03:55.539 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/focaltech.o 2024-05-08T09:03:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:55 smithi070 ceph-mon[29591]: pgmap v4381: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 910 KiB/s wr, 45 op/s 2024-05-08T09:03:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:55 smithi172 ceph-mon[33377]: pgmap v4381: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 910 KiB/s wr, 45 op/s 2024-05-08T09:03:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:55 smithi194 ceph-mon[33679]: pgmap v4381: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 910 KiB/s wr, 45 op/s 2024-05-08T09:03:57.232 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/rsrc_nonstatic.o 2024-05-08T09:03:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:57 smithi070 ceph-mon[29591]: pgmap v4382: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 611 KiB/s wr, 34 op/s 2024-05-08T09:03:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:57 smithi172 ceph-mon[33377]: pgmap v4382: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 611 KiB/s wr, 34 op/s 2024-05-08T09:03:58.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:57 smithi194 ceph-mon[33679]: pgmap v4382: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 611 KiB/s wr, 34 op/s 2024-05-08T09:03:58.618 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pcmcia/yenta_socket.o 2024-05-08T09:03:58.658 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/file.o 2024-05-08T09:03:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:03:59 smithi070 ceph-mon[29591]: pgmap v4383: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 611 KiB/s wr, 34 op/s 2024-05-08T09:03:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:03:59 smithi172 ceph-mon[33377]: pgmap v4383: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 611 KiB/s wr, 34 op/s 2024-05-08T09:04:00.009 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/mon/mon_stat.o 2024-05-08T09:04:00.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:03:59 smithi194 ceph-mon[33679]: pgmap v4383: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 611 KiB/s wr, 34 op/s 2024-05-08T09:04:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:01 smithi172 ceph-mon[33377]: pgmap v4384: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 924 KiB/s wr, 45 op/s 2024-05-08T09:04:02.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:01 smithi194 ceph-mon[33679]: pgmap v4384: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 924 KiB/s wr, 45 op/s 2024-05-08T09:04:02.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:01 smithi070 ceph-mon[29591]: pgmap v4384: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 924 KiB/s wr, 45 op/s 2024-05-08T09:04:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:03 smithi172 ceph-mon[33377]: pgmap v4385: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 711 KiB/s wr, 30 op/s 2024-05-08T09:04:03.930 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:03 smithi070 ceph-mon[29591]: pgmap v4385: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 711 KiB/s wr, 30 op/s 2024-05-08T09:04:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:03 smithi194 ceph-mon[33679]: pgmap v4385: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 650 KiB/s rd, 711 KiB/s wr, 30 op/s 2024-05-08T09:04:04.748 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/alps.o 2024-05-08T09:04:04.866 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/mac.o 2024-05-08T09:04:04.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:04 smithi172 ceph-mon[33377]: osdmap e353: 12 total, 12 up, 12 in 2024-05-08T09:04:05.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:04 smithi194 ceph-mon[33679]: osdmap e353: 12 total, 12 up, 12 in 2024-05-08T09:04:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:04 smithi070 ceph-mon[29591]: osdmap e353: 12 total, 12 up, 12 in 2024-05-08T09:04:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:05 smithi172 ceph-mon[33377]: pgmap v4387: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 759 KiB/s wr, 48 op/s 2024-05-08T09:04:06.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:05 smithi194 ceph-mon[33679]: pgmap v4387: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 759 KiB/s wr, 48 op/s 2024-05-08T09:04:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:05 smithi070 ceph-mon[29591]: pgmap v4387: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 759 KiB/s wr, 48 op/s 2024-05-08T09:04:06.585 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/manage.o 2024-05-08T09:04:06.854 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_debugfs.o 2024-05-08T09:04:06.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:06 smithi172 ceph-mon[33377]: pgmap v4388: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 759 KiB/s wr, 48 op/s 2024-05-08T09:04:07.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:06 smithi194 ceph-mon[33679]: pgmap v4388: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 759 KiB/s wr, 48 op/s 2024-05-08T09:04:07.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:06 smithi070 ceph-mon[29591]: pgmap v4388: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 759 KiB/s wr, 48 op/s 2024-05-08T09:04:07.336 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_engines_debugfs.o 2024-05-08T09:04:08.521 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/buffer.o 2024-05-08T09:04:08.978 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pcmcia/built-in.a 2024-05-08T09:04:09.255 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/mon/mon_text.o 2024-05-08T09:04:09.538 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/sysfs.o 2024-05-08T09:04:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:09 smithi070 ceph-mon[29591]: pgmap v4389: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 759 KiB/s wr, 48 op/s 2024-05-08T09:04:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:09 smithi172 ceph-mon[33377]: pgmap v4389: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 759 KiB/s wr, 48 op/s 2024-05-08T09:04:09.714 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:09 smithi194 ceph-mon[33679]: pgmap v4389: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 759 KiB/s wr, 48 op/s 2024-05-08T09:04:11.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:11 smithi070 ceph-mon[29591]: pgmap v4390: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 768 KiB/s wr, 54 op/s 2024-05-08T09:04:11.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:11 smithi070 ceph-mon[29591]: osdmap e354: 12 total, 12 up, 12 in 2024-05-08T09:04:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:11 smithi172 ceph-mon[33377]: pgmap v4390: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 768 KiB/s wr, 54 op/s 2024-05-08T09:04:11.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:11 smithi172 ceph-mon[33377]: osdmap e354: 12 total, 12 up, 12 in 2024-05-08T09:04:11.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:11 smithi194 ceph-mon[33679]: pgmap v4390: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 768 KiB/s wr, 54 op/s 2024-05-08T09:04:11.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:11 smithi194 ceph-mon[33679]: osdmap e354: 12 total, 12 up, 12 in 2024-05-08T09:04:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:13 smithi070 ceph-mon[29591]: pgmap v4392: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 888 KiB/s wr, 62 op/s 2024-05-08T09:04:13.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:13 smithi172 ceph-mon[33377]: pgmap v4392: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 888 KiB/s wr, 62 op/s 2024-05-08T09:04:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:13 smithi194 ceph-mon[33679]: pgmap v4392: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 888 KiB/s wr, 62 op/s 2024-05-08T09:04:14.064 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/byd.o 2024-05-08T09:04:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:15 smithi070 ceph-mon[29591]: pgmap v4393: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 620 KiB/s wr, 31 op/s 2024-05-08T09:04:15.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:15 smithi172 ceph-mon[33377]: pgmap v4393: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 620 KiB/s wr, 31 op/s 2024-05-08T09:04:15.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:15 smithi194 ceph-mon[33679]: pgmap v4393: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 620 KiB/s wr, 31 op/s 2024-05-08T09:04:17.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:17 smithi172 ceph-mon[33377]: pgmap v4394: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 620 KiB/s wr, 31 op/s 2024-05-08T09:04:17.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:17 smithi194 ceph-mon[33679]: pgmap v4394: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 620 KiB/s wr, 31 op/s 2024-05-08T09:04:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:17 smithi070 ceph-mon[29591]: pgmap v4394: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 620 KiB/s wr, 31 op/s 2024-05-08T09:04:17.993 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/mon/mon_bin.o 2024-05-08T09:04:18.249 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/endpoint.o 2024-05-08T09:04:18.841 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_managed.o 2024-05-08T09:04:19.666 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/litex/built-in.a 2024-05-08T09:04:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:19 smithi172 ceph-mon[33377]: pgmap v4395: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 620 KiB/s wr, 31 op/s 2024-05-08T09:04:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:19 smithi194 ceph-mon[33679]: pgmap v4395: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 620 KiB/s wr, 31 op/s 2024-05-08T09:04:19.812 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e100.o 2024-05-08T09:04:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:19 smithi070 ceph-mon[29591]: pgmap v4395: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 620 KiB/s wr, 31 op/s 2024-05-08T09:04:19.922 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/nvm.o 2024-05-08T09:04:21.079 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/rtc/lib.o 2024-05-08T09:04:21.240 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_irq.o 2024-05-08T09:04:21.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:21 smithi172 ceph-mon[33377]: pgmap v4396: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 609 KiB/s wr, 26 op/s 2024-05-08T09:04:21.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:21 smithi194 ceph-mon[33679]: pgmap v4396: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 609 KiB/s wr, 26 op/s 2024-05-08T09:04:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:21 smithi070 ceph-mon[29591]: pgmap v4396: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 609 KiB/s wr, 26 op/s 2024-05-08T09:04:22.532 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/logips2pp.o 2024-05-08T09:04:23.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:23 smithi172 ceph-mon[33377]: pgmap v4397: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 544 KiB/s wr, 23 op/s 2024-05-08T09:04:23.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:23 smithi194 ceph-mon[33679]: pgmap v4397: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 544 KiB/s wr, 23 op/s 2024-05-08T09:04:23.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:23 smithi070 ceph-mon[29591]: pgmap v4397: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 544 KiB/s wr, 23 op/s 2024-05-08T09:04:25.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:25 smithi172 ceph-mon[33377]: pgmap v4398: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 812 KiB/s wr, 35 op/s 2024-05-08T09:04:25.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:25 smithi194 ceph-mon[33679]: pgmap v4398: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 812 KiB/s wr, 35 op/s 2024-05-08T09:04:25.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:25 smithi070 ceph-mon[29591]: pgmap v4398: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 812 KiB/s wr, 35 op/s 2024-05-08T09:04:27.206 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.9 2024-05-08T09:04:27.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:04:27.359 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/devio.o 2024-05-08T09:04:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:27 smithi070 ceph-mon[29591]: pgmap v4399: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T09:04:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:27 smithi172 ceph-mon[33377]: pgmap v4399: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T09:04:27.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:27 smithi194 ceph-mon[33679]: pgmap v4399: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T09:04:27.784 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:04:28.045 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/mon/built-in.a 2024-05-08T09:04:28.505 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/rtc/class.o 2024-05-08T09:04:28.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:04:28.654 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_mcr.o 2024-05-08T09:04:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:04:28.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:04:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:29 smithi172 ceph-mon[33377]: pgmap v4400: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T09:04:29.708 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:29 smithi070 ceph-mon[29591]: pgmap v4400: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T09:04:29.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:29 smithi194 ceph-mon[33679]: pgmap v4400: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 616 KiB/s wr, 25 op/s 2024-05-08T09:04:30.014 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/input/joystick/built-in.a 2024-05-08T09:04:30.226 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/phy.o 2024-05-08T09:04:30.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.302+0000 7f7956c00700 1 -- 172.21.15.70:0/1194206177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103ef0 msgr2=0x7f79501103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:30.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.302+0000 7f7956c00700 1 --2- 172.21.15.70:0/1194206177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103ef0 0x7f79501103d0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f794800b0a0 tx=0x7f794800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.303+0000 7f7956c00700 1 -- 172.21.15.70:0/1194206177 shutdown_connections 2024-05-08T09:04:30.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.303+0000 7f7956c00700 1 --2- 172.21.15.70:0/1194206177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103ef0 0x7f79501103d0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.303+0000 7f7956c00700 1 --2- 172.21.15.70:0/1194206177 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950108460 0x7f7950108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.303+0000 7f7956c00700 1 --2- 172.21.15.70:0/1194206177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7950103550 0x7f79501039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.303+0000 7f7956c00700 1 -- 172.21.15.70:0/1194206177 >> 172.21.15.70:0/1194206177 conn(0x7f795007a600 msgr2=0x7f795007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:04:30.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.305+0000 7f7956c00700 1 -- 172.21.15.70:0/1194206177 shutdown_connections 2024-05-08T09:04:30.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.305+0000 7f7956c00700 1 -- 172.21.15.70:0/1194206177 wait complete. 2024-05-08T09:04:30.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.306+0000 7f7956c00700 1 Processor -- start 2024-05-08T09:04:30.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.307+0000 7f7956c00700 1 -- start start 2024-05-08T09:04:30.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.307+0000 7f7956c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103550 0x7f795019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:30.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.307+0000 7f7956c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950103ef0 0x7f795019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.307+0000 7f7956c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7950108460 0x7f7950199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.307+0000 7f7956c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7950113570 con 0x7f7950103550 2024-05-08T09:04:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.307+0000 7f7956c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f79501133f0 con 0x7f7950103ef0 2024-05-08T09:04:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.307+0000 7f7956c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f79501136f0 con 0x7f7950108460 2024-05-08T09:04:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.308+0000 7f794fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103550 0x7f795019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.308+0000 7f794fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103550 0x7f795019f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54262/0 (socket says 172.21.15.70:54262) 2024-05-08T09:04:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.308+0000 7f794fe00700 1 -- 172.21.15.70:0/2827193771 learned_addr learned my addr 172.21.15.70:0/2827193771 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:04:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.308+0000 7f794f400700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950103ef0 0x7f795019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:30.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.308+0000 7f7954c00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7950108460 0x7f7950199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.309+0000 7f794fe00700 1 -- 172.21.15.70:0/2827193771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7950108460 msgr2=0x7f7950199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.309+0000 7f794fe00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7950108460 0x7f7950199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.309+0000 7f794fe00700 1 -- 172.21.15.70:0/2827193771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950103ef0 msgr2=0x7f795019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.309+0000 7f794fe00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950103ef0 0x7f795019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.309+0000 7f794fe00700 1 -- 172.21.15.70:0/2827193771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795019a010 con 0x7f7950103550 2024-05-08T09:04:30.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.309+0000 7f794fe00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103550 0x7f795019f6b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f794000d980 tx=0x7f794000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:04:30.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.310+0000 7f794cc00700 1 -- 172.21.15.70:0/2827193771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940017030 con 0x7f7950103550 2024-05-08T09:04:30.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.310+0000 7f794cc00700 1 -- 172.21.15.70:0/2827193771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79400044b0 con 0x7f7950103550 2024-05-08T09:04:30.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.310+0000 7f794cc00700 1 -- 172.21.15.70:0/2827193771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79400038e0 con 0x7f7950103550 2024-05-08T09:04:30.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.310+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795019a300 con 0x7f7950103550 2024-05-08T09:04:30.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.311+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79500756d0 con 0x7f7950103550 2024-05-08T09:04:30.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.312+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795010ba70 con 0x7f7950103550 2024-05-08T09:04:30.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.316+0000 7f794cc00700 1 -- 172.21.15.70:0/2827193771 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f794001a070 con 0x7f7950103550 2024-05-08T09:04:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.317+0000 7f794cc00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79340b6e80 0x7f79340b9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.317+0000 7f794cc00700 1 -- 172.21.15.70:0/2827193771 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(354..354 src has 1..354) ==== 9583+0+0 (secure 0 0 0) 0x7f79400e1cd0 con 0x7f7950103550 2024-05-08T09:04:30.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.318+0000 7f794f400700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79340b6e80 0x7f79340b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:30.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.319+0000 7f794f400700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79340b6e80 0x7f79340b9340 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f795007ace0 tx=0x7f793c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:04:30.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.324+0000 7f794cc00700 1 -- 172.21.15.70:0/2827193771 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f79400a9230 con 0x7f7950103550 2024-05-08T09:04:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.789+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7950104c10 con 0x7f7950103550 2024-05-08T09:04:30.790 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:04:30.790 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:04:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.790+0000 7f794cc00700 1 -- 172.21.15.70:0/2827193771 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f79400a8b30 con 0x7f7950103550 2024-05-08T09:04:30.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79340b6e80 msgr2=0x7f79340b9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79340b6e80 0x7f79340b9340 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f795007ace0 tx=0x7f793c009260 comp rx=0 tx=0).stop 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103550 msgr2=0x7f795019f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103550 0x7f795019f6b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f794000d980 tx=0x7f794000dc90 comp rx=0 tx=0).stop 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 shutdown_connections 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f79340b6e80 0x7f79340b9340 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7950108460 0x7f7950199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7950103550 0x7f795019f6b0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 --2- 172.21.15.70:0/2827193771 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7950103ef0 0x7f795019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 >> 172.21.15.70:0/2827193771 conn(0x7f795007a600 msgr2=0x7f79501016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:04:30.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 shutdown_connections 2024-05-08T09:04:30.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:30.795+0000 7f7956c00700 1 -- 172.21.15.70:0/2827193771 wait complete. 2024-05-08T09:04:30.796 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:04:31.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:31 smithi070 ceph-mon[29591]: pgmap v4401: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 960 KiB/s wr, 39 op/s 2024-05-08T09:04:31.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:31 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2827193771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:04:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:31.913 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/lifebook.o 2024-05-08T09:04:31.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:31 smithi172 ceph-mon[33377]: pgmap v4401: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 960 KiB/s wr, 39 op/s 2024-05-08T09:04:31.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:31.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:31.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:31 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2827193771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:04:31.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:31.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:31 smithi194 ceph-mon[33679]: pgmap v4401: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 857 KiB/s rd, 960 KiB/s wr, 39 op/s 2024-05-08T09:04:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:31 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2827193771' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:04:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:32.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:32.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:33.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:33.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:33.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:33.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:33.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:33.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:33.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:33.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:33.042 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/input/tablet/built-in.a 2024-05-08T09:04:33.185 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/trackpoint.o 2024-05-08T09:04:33.193 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/param.o 2024-05-08T09:04:33.533 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.9 --await-for 42.0' 2024-05-08T09:04:33.534 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.9 --await-for 42.0 2024-05-08T09:04:33.786 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:33 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:04:33.787 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:33 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:04:33.787 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:33 smithi070 ceph-mon[29591]: pgmap v4402: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 649 KiB/s wr, 27 op/s 2024-05-08T09:04:33.787 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:33 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:04:33.787 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:33 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:04:33.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:33 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:04:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:33 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:04:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:33 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:04:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:33 smithi194 ceph-mon[33679]: pgmap v4402: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 649 KiB/s wr, 27 op/s 2024-05-08T09:04:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:33 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:04:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:33 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:04:34.127 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:04:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:35 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:04:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:35 smithi172 ceph-mon[33377]: pgmap v4402: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 649 KiB/s wr, 27 op/s 2024-05-08T09:04:35.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:35 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:04:35.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:35 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:04:35.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:35 smithi172 ceph-mon[33377]: pgmap v4403: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 946 KiB/s wr, 39 op/s 2024-05-08T09:04:35.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:35 smithi194 ceph-mon[33679]: pgmap v4403: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 946 KiB/s wr, 39 op/s 2024-05-08T09:04:35.533 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:35 smithi070 ceph-mon[29591]: pgmap v4403: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 946 KiB/s wr, 39 op/s 2024-05-08T09:04:35.891 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/ethtool.o 2024-05-08T09:04:37.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:37 smithi070 ceph-mon[29591]: pgmap v4404: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 642 KiB/s wr, 25 op/s 2024-05-08T09:04:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:37 smithi172 ceph-mon[33377]: pgmap v4404: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 642 KiB/s wr, 25 op/s 2024-05-08T09:04:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:37 smithi194 ceph-mon[33679]: pgmap v4404: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 642 KiB/s wr, 25 op/s 2024-05-08T09:04:39.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:39 smithi172 ceph-mon[33377]: pgmap v4405: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 642 KiB/s wr, 25 op/s 2024-05-08T09:04:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:39 smithi194 ceph-mon[33679]: pgmap v4405: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 642 KiB/s wr, 25 op/s 2024-05-08T09:04:39.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:39 smithi070 ceph-mon[29591]: pgmap v4405: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 642 KiB/s wr, 25 op/s 2024-05-08T09:04:40.098 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/notify.o 2024-05-08T09:04:41.410 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:41 smithi070 ceph-mon[29591]: pgmap v4406: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 919 KiB/s wr, 37 op/s 2024-05-08T09:04:41.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:41 smithi172 ceph-mon[33377]: pgmap v4406: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 919 KiB/s wr, 37 op/s 2024-05-08T09:04:41.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:41 smithi194 ceph-mon[33679]: pgmap v4406: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 889 KiB/s rd, 919 KiB/s wr, 37 op/s 2024-05-08T09:04:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.026+0000 7fa18e200700 1 -- 172.21.15.70:0/278809815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa188102600 msgr2=0x7fa1881029e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.027+0000 7fa18e200700 1 --2- 172.21.15.70:0/278809815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa188102600 0x7fa1881029e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa17800b0a0 tx=0x7fa17800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.027+0000 7fa18e200700 1 -- 172.21.15.70:0/278809815 shutdown_connections 2024-05-08T09:04:42.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.027+0000 7fa18e200700 1 --2- 172.21.15.70:0/278809815 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa1881076d0 0x7fa18806b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.027+0000 7fa18e200700 1 --2- 172.21.15.70:0/278809815 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa188102600 0x7fa1881029e0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.027+0000 7fa18e200700 1 --2- 172.21.15.70:0/278809815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa188102fb0 0x7fa188106ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.027+0000 7fa18e200700 1 -- 172.21.15.70:0/278809815 >> 172.21.15.70:0/278809815 conn(0x7fa188079340 msgr2=0x7fa188079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:04:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.028+0000 7fa18e200700 1 -- 172.21.15.70:0/278809815 shutdown_connections 2024-05-08T09:04:42.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.028+0000 7fa18e200700 1 -- 172.21.15.70:0/278809815 wait complete. 2024-05-08T09:04:42.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.030+0000 7fa18e200700 1 Processor -- start 2024-05-08T09:04:42.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.030+0000 7fa18e200700 1 -- start start 2024-05-08T09:04:42.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.031+0000 7fa18e200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa188102600 0x7fa18810e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.031+0000 7fa18e200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa188102fb0 0x7fa18810ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.031+0000 7fa18e200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1881076d0 0x7fa1881a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.031+0000 7fa18e200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881158c0 con 0x7fa188102fb0 2024-05-08T09:04:42.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.031+0000 7fa18e200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa18810b1f0 con 0x7fa188102600 2024-05-08T09:04:42.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.031+0000 7fa18e200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa188115a40 con 0x7fa1881076d0 2024-05-08T09:04:42.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa187e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1881076d0 0x7fa1881a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa187400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa188102600 0x7fa18810e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa187e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1881076d0 0x7fa1881a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:46688/0 (socket says 172.21.15.70:46688) 2024-05-08T09:04:42.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa187e00700 1 -- 172.21.15.70:0/2329766894 learned_addr learned my addr 172.21.15.70:0/2329766894 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:04:42.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa17ea00700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa188102fb0 0x7fa18810ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa187e00700 1 -- 172.21.15.70:0/2329766894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa188102600 msgr2=0x7fa18810e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:42.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa187e00700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa188102600 0x7fa18810e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa187e00700 1 -- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa188102fb0 msgr2=0x7fa18810ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:42.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa187e00700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa188102fb0 0x7fa18810ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.032+0000 7fa187e00700 1 -- 172.21.15.70:0/2329766894 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1881a2340 con 0x7fa1881076d0 2024-05-08T09:04:42.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.033+0000 7fa187e00700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1881076d0 0x7fa1881a1a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa18000e940 tx=0x7fa18000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:04:42.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.034+0000 7fa184c00700 1 -- 172.21.15.70:0/2329766894 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa180004a30 con 0x7fa1881076d0 2024-05-08T09:04:42.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.034+0000 7fa184c00700 1 -- 172.21.15.70:0/2329766894 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1800054b0 con 0x7fa1881076d0 2024-05-08T09:04:42.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.034+0000 7fa184c00700 1 -- 172.21.15.70:0/2329766894 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18000cbe0 con 0x7fa1881076d0 2024-05-08T09:04:42.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.035+0000 7fa18e200700 1 -- 172.21.15.70:0/2329766894 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1881a25d0 con 0x7fa1881076d0 2024-05-08T09:04:42.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.035+0000 7fa18e200700 1 -- 172.21.15.70:0/2329766894 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1881147e0 con 0x7fa1881076d0 2024-05-08T09:04:42.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.040+0000 7fa184c00700 1 -- 172.21.15.70:0/2329766894 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa180005020 con 0x7fa1881076d0 2024-05-08T09:04:42.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.043+0000 7fa184c00700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa16c0b2be0 0x7fa16c0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.044+0000 7fa184c00700 1 -- 172.21.15.70:0/2329766894 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(354..354 src has 1..354) ==== 9583+0+0 (secure 0 0 0) 0x7fa1800e2ae0 con 0x7fa1881076d0 2024-05-08T09:04:42.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.044+0000 7fa187400700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa16c0b2be0 0x7fa16c0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.045+0000 7fa187400700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa16c0b2be0 0x7fa16c0b50a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa178009fd0 tx=0x7fa178006210 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:04:42.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.054+0000 7fa198c86b80 1 Processor -- start 2024-05-08T09:04:42.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.055+0000 7fa198c86b80 1 -- start start 2024-05-08T09:04:42.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.055+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f43330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.055+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f3d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.055+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f49d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.055+0000 7fa198c86b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555969e8fbb0 con 0x555969f3dee0 2024-05-08T09:04:42.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.055+0000 7fa198c86b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555969e2d8f0 con 0x555969f3d520 2024-05-08T09:04:42.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.055+0000 7fa198c86b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555969e8bb70 con 0x555969f42f50 2024-05-08T09:04:42.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.056+0000 7fa187400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f43330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.056+0000 7fa187400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f43330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:46700/0 (socket says 172.21.15.70:46700) 2024-05-08T09:04:42.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.056+0000 7fa187400700 1 -- 172.21.15.70:0/373222521 learned_addr learned my addr 172.21.15.70:0/373222521 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:04:42.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.056+0000 7fa17ea00700 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f3d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.057+0000 7fa187e00700 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f49d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.057+0000 7fa187400700 1 -- 172.21.15.70:0/373222521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 msgr2=0x555969f3d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:04:42.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.057+0000 7fa187400700 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f3d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.057+0000 7fa187400700 1 -- 172.21.15.70:0/373222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 msgr2=0x555969f49d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:04:42.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.057+0000 7fa187400700 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f49d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.057+0000 7fa187400700 1 -- 172.21.15.70:0/373222521 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555969ddca60 con 0x555969f42f50 2024-05-08T09:04:42.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.058+0000 7fa187e00700 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f49d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:04:42.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.058+0000 7fa187400700 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f43330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa178015000 tx=0x7fa17801d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73fd97b5cbf1bbd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:04:42.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.058+0000 7fa17cc00700 1 -- 172.21.15.70:0/373222521 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178007760 con 0x555969f42f50 2024-05-08T09:04:42.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa17cc00700 1 -- 172.21.15.70:0/373222521 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa17802e070 con 0x555969f42f50 2024-05-08T09:04:42.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa17cc00700 1 -- 172.21.15.70:0/373222521 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178029d10 con 0x555969f42f50 2024-05-08T09:04:42.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa198c86b80 1 -- 172.21.15.70:0/373222521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 msgr2=0x555969f43330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:42.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa198c86b80 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f43330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa178015000 tx=0x7fa17801d000 comp rx=0 tx=0).stop 2024-05-08T09:04:42.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa198c86b80 1 -- 172.21.15.70:0/373222521 shutdown_connections 2024-05-08T09:04:42.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa198c86b80 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f49d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa198c86b80 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f43330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa198c86b80 1 --2- 172.21.15.70:0/373222521 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f3d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa198c86b80 1 -- 172.21.15.70:0/373222521 >> 172.21.15.70:0/373222521 conn(0x555969e6bcf0 msgr2=0x555969f37e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:04:42.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa198c86b80 1 -- 172.21.15.70:0/373222521 shutdown_connections 2024-05-08T09:04:42.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.060+0000 7fa198c86b80 1 -- 172.21.15.70:0/373222521 wait complete. 2024-05-08T09:04:42.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.061+0000 7fa198c86b80 1 -- start start 2024-05-08T09:04:42.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.062+0000 7fa198c86b80 1 Processor -- start 2024-05-08T09:04:42.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.062+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f49990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.062+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f46d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.062+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f47270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.062+0000 7fa198c86b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555969f4a2b0 con 0x555969f3dee0 2024-05-08T09:04:42.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.062+0000 7fa198c86b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x555969df5cb0 con 0x555969f3d520 2024-05-08T09:04:42.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.062+0000 7fa198c86b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x555969f4a430 con 0x555969f42f50 2024-05-08T09:04:42.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.062+0000 7fa198c86b80 10 client.0 _ll_register_callbacks cb 0x555969e36e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:04:42.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.063+0000 7fa187400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f49990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.063+0000 7fa187400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f49990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:35708/0 (socket says 172.21.15.70:35708) 2024-05-08T09:04:42.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.063+0000 7fa17ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f46d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.063+0000 7fa187400700 1 -- 172.21.15.70:0/971996084 learned_addr learned my addr 172.21.15.70:0/971996084 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:04:42.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.063+0000 7fa187e00700 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f47270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.064+0000 7fa187400700 1 -- 172.21.15.70:0/971996084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 msgr2=0x555969f47270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:04:42.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.064+0000 7fa187400700 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f47270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.064+0000 7fa187400700 1 -- 172.21.15.70:0/971996084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 msgr2=0x555969f46d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:04:42.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.064+0000 7fa187400700 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f46d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.064+0000 7fa187400700 1 -- 172.21.15.70:0/971996084 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555969e555b0 con 0x555969f3d520 2024-05-08T09:04:42.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.064+0000 7fa17ea00700 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f46d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:04:42.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.065+0000 7fa175600700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T09:04:42.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.065+0000 7fa187400700 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f49990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa178000f80 tx=0x7fa17802ae90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ba743ce961d901 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:04:42.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.065+0000 7fa175600700 1 -- 172.21.15.70:0/971996084 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178007760 con 0x555969f3d520 2024-05-08T09:04:42.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.066+0000 7fa198c86b80 1 -- 172.21.15.70:0/971996084 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa17802e070 con 0x555969f3d520 2024-05-08T09:04:42.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.066+0000 7fa175600700 1 -- 172.21.15.70:0/971996084 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(354..354 src has 1..354) ==== 9583+0+0 (secure 0 0 0) 0x7fa178007900 con 0x555969f3d520 2024-05-08T09:04:42.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.066+0000 7fa175600700 1 -- 172.21.15.70:0/971996084 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa178007b00 con 0x555969f3d520 2024-05-08T09:04:42.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.066+0000 7fa198c86b80 10 client.37637 fetch_fsmap learned FSMap version 42 2024-05-08T09:04:42.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.066+0000 7fa198c86b80 1 -- 172.21.15.70:0/971996084 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555969f54b20 con 0x555969f3d520 2024-05-08T09:04:42.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.067+0000 7fa175600700 1 -- 172.21.15.70:0/971996084 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa17802e070 con 0x555969f3d520 2024-05-08T09:04:42.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.068+0000 7fa175600700 1 -- 172.21.15.70:0/971996084 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa178011070 con 0x555969f3d520 2024-05-08T09:04:42.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.068+0000 7fa198c86b80 10 client.37637 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:04:42.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.068+0000 7fa198c86b80 10 client.37637 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:04:42.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.068+0000 7fa198c86b80 20 client.37637 populate_metadata read hostname 'smithi070' 2024-05-08T09:04:42.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.068+0000 7fa198c86b80 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555969f56ff0 0x555969f593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.068+0000 7fa198c86b80 4 client.37637 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:04:42.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.068+0000 7fa198c86b80 1 -- 172.21.15.70:0/971996084 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555969f0a230 con 0x555969f56ff0 2024-05-08T09:04:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.069+0000 7fa17ea00700 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555969f56ff0 0x555969f593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.070+0000 7fa17ea00700 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555969f56ff0 0x555969f593e0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a1256f06bcb9602 server_cookie=b12ff878c40680eb in_seq=0 out_seq=0 2024-05-08T09:04:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.070+0000 7fa175600700 10 client.37637 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:04:42.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.072+0000 7fa175600700 1 -- 172.21.15.70:0/971996084 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555969f0a230 con 0x555969f56ff0 2024-05-08T09:04:42.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.072+0000 7fa175600700 10 client.37637 handle_command_reply: tid=0 2024-05-08T09:04:42.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.072+0000 7fa198c86b80 1 client.37637 shutdown 2024-05-08T09:04:42.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.073+0000 7fa198c86b80 1 -- 172.21.15.70:0/971996084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 msgr2=0x555969f49990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:42.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.073+0000 7fa198c86b80 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f49990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa178000f80 tx=0x7fa17802ae90 comp rx=0 tx=0).stop 2024-05-08T09:04:42.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.074+0000 7fa198c86b80 1 -- 172.21.15.70:0/971996084 shutdown_connections 2024-05-08T09:04:42.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.074+0000 7fa198c86b80 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555969f56ff0 0x555969f593e0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.074+0000 7fa198c86b80 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f47270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.074+0000 7fa198c86b80 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f49990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.074+0000 7fa198c86b80 1 --2- 172.21.15.70:0/971996084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f46d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.074+0000 7fa198c86b80 1 -- 172.21.15.70:0/971996084 >> 172.21.15.70:0/971996084 conn(0x555969e6bcf0 msgr2=0x555969f328e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:04:42.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.074+0000 7fa175600700 0 client.37637 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:04:42.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.074+0000 7fa198c86b80 1 -- 172.21.15.70:0/971996084 shutdown_connections 2024-05-08T09:04:42.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.074+0000 7fa198c86b80 1 -- 172.21.15.70:0/971996084 wait complete. 2024-05-08T09:04:42.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.075+0000 7fa198c86b80 20 client.37637 trim_cache size 0 max 16384 2024-05-08T09:04:42.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.120+0000 7fa198c86b80 1 Processor -- start 2024-05-08T09:04:42.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.120+0000 7fa198c86b80 1 -- start start 2024-05-08T09:04:42.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.121+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f46000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.121+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f409d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.121+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f40f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.121+0000 7fa198c86b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881c0b70 con 0x555969f3dee0 2024-05-08T09:04:42.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.121+0000 7fa198c86b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881be400 con 0x555969f3d520 2024-05-08T09:04:42.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.121+0000 7fa198c86b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881bc270 con 0x555969f42f50 2024-05-08T09:04:42.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.122+0000 7fa187400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f46000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.122+0000 7fa17ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.122+0000 7fa187400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f46000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:35724/0 (socket says 172.21.15.70:35724) 2024-05-08T09:04:42.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.122+0000 7fa187400700 1 -- 172.21.15.70:0/3055187800 learned_addr learned my addr 172.21.15.70:0/3055187800 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:04:42.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.122+0000 7fa187e00700 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f40f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.122+0000 7fa187400700 1 -- 172.21.15.70:0/3055187800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 msgr2=0x555969f40f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:04:42.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.123+0000 7fa187400700 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f40f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.123+0000 7fa187400700 1 -- 172.21.15.70:0/3055187800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 msgr2=0x555969f409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:04:42.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.123+0000 7fa187400700 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.123+0000 7fa187400700 1 -- 172.21.15.70:0/3055187800 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555969f53690 con 0x555969f3d520 2024-05-08T09:04:42.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.123+0000 7fa187e00700 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f40f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:04:42.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.123+0000 7fa17ea00700 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:04:42.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.124+0000 7fa187400700 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f46000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa178009e60 tx=0x7fa178005b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13912e4bf2a89bb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:04:42.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.124+0000 7fa177e00700 1 -- 172.21.15.70:0/3055187800 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178020070 con 0x555969f3d520 2024-05-08T09:04:42.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.125+0000 7fa177e00700 1 -- 172.21.15.70:0/3055187800 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa17802e070 con 0x555969f3d520 2024-05-08T09:04:42.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.125+0000 7fa177e00700 1 -- 172.21.15.70:0/3055187800 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1780128f0 con 0x555969f3d520 2024-05-08T09:04:42.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.126+0000 7fa198c86b80 1 -- 172.21.15.70:0/3055187800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 msgr2=0x555969f46000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:04:42.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.126+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f46000 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa178009e60 tx=0x7fa178005b80 comp rx=0 tx=0).stop 2024-05-08T09:04:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.126+0000 7fa198c86b80 1 -- 172.21.15.70:0/3055187800 shutdown_connections 2024-05-08T09:04:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.126+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f42f50 0x555969f40f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.126+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f3d520 0x555969f46000 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.126+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3055187800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3dee0 0x555969f409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.126+0000 7fa198c86b80 1 -- 172.21.15.70:0/3055187800 >> 172.21.15.70:0/3055187800 conn(0x555969e6bcf0 msgr2=0x555969f3cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:04:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.126+0000 7fa198c86b80 1 -- 172.21.15.70:0/3055187800 shutdown_connections 2024-05-08T09:04:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.126+0000 7fa198c86b80 1 -- 172.21.15.70:0/3055187800 wait complete. 2024-05-08T09:04:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.127+0000 7fa198c86b80 1 -- start start 2024-05-08T09:04:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.127+0000 7fa198c86b80 1 Processor -- start 2024-05-08T09:04:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.128+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3d520 0x555969f5be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.128+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f3dee0 0x555969f5c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.128+0000 7fa198c86b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f42f50 0x555969f5a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.128+0000 7fa198c86b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881bc8c0 con 0x555969f3d520 2024-05-08T09:04:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.128+0000 7fa198c86b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881bdd30 con 0x555969f42f50 2024-05-08T09:04:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.128+0000 7fa198c86b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa1881bcf90 con 0x555969f3dee0 2024-05-08T09:04:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.128+0000 7fa198c86b80 10 client.0 _ll_register_callbacks cb 0x555969e36e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:04:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.128+0000 7fa187400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3d520 0x555969f5be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.129+0000 7fa187400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3d520 0x555969f5be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57750/0 (socket says 172.21.15.70:57750) 2024-05-08T09:04:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.129+0000 7fa187400700 1 -- 172.21.15.70:0/3642341619 learned_addr learned my addr 172.21.15.70:0/3642341619 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.129+0000 7fa187400700 1 -- 172.21.15.70:0/3642341619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f3dee0 msgr2=0x555969f5c3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.129+0000 7fa17ea00700 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f3dee0 0x555969f5c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.129+0000 7fa187400700 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f3dee0 0x555969f5c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.129+0000 7fa187400700 1 -- 172.21.15.70:0/3642341619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f42f50 msgr2=0x555969f5a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.130+0000 7fa187e00700 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f42f50 0x555969f5a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.130+0000 7fa187400700 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f42f50 0x555969f5a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.130+0000 7fa187400700 1 -- 172.21.15.70:0/3642341619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555969f5ab40 con 0x555969f3d520 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.130+0000 7fa187e00700 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f42f50 0x555969f5a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.130+0000 7fa187400700 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3d520 0x555969f5be80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa178005970 tx=0x7fa178007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ed1f1def7ad1ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:04:42.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.130+0000 7fa175600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:04:42.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.131+0000 7fa175600700 1 -- 172.21.15.70:0/3642341619 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178020050 con 0x555969f3d520 2024-05-08T09:04:42.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.131+0000 7fa175600700 1 -- 172.21.15.70:0/3642341619 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(354..354 src has 1..354) ==== 9583+0+0 (secure 0 0 0) 0x7fa1780298a0 con 0x555969f3d520 2024-05-08T09:04:42.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.131+0000 7fa198c86b80 1 -- 172.21.15.70:0/3642341619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa17802e070 con 0x555969f3d520 2024-05-08T09:04:42.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.132+0000 7fa175600700 1 -- 172.21.15.70:0/3642341619 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fa178029ae0 con 0x555969f3d520 2024-05-08T09:04:42.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.132+0000 7fa198c86b80 10 client.19014 fetch_fsmap learned FSMap version 42 2024-05-08T09:04:42.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.132+0000 7fa198c86b80 1 -- 172.21.15.70:0/3642341619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x555969fc1e90 con 0x555969f3d520 2024-05-08T09:04:42.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.133+0000 7fa175600700 1 -- 172.21.15.70:0/3642341619 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa17802e070 con 0x555969f3d520 2024-05-08T09:04:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.133+0000 7fa175600700 1 -- 172.21.15.70:0/3642341619 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fa178011070 con 0x555969f3d520 2024-05-08T09:04:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.133+0000 7fa198c86b80 10 client.19014 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:04:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.133+0000 7fa198c86b80 10 client.19014 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:04:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.133+0000 7fa198c86b80 20 client.19014 populate_metadata read hostname 'smithi070' 2024-05-08T09:04:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.133+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555969fc2540 0x555969fc4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:04:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.133+0000 7fa198c86b80 4 client.19014 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.9, "await_for": 42.0}] 2024-05-08T09:04:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.133+0000 7fa198c86b80 1 -- 172.21.15.70:0/3642341619 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.9, "await_for": 42.0}) -- 0x555969e9d590 con 0x555969fc2540 2024-05-08T09:04:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.134+0000 7fa17ea00700 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555969fc2540 0x555969fc4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:04:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.136+0000 7fa17ea00700 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555969fc2540 0x555969fc4960 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fc64446244138b8 server_cookie=33dada2c7ae88eda in_seq=0 out_seq=0 2024-05-08T09:04:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:04:42.136+0000 7fa175600700 10 client.19014 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:04:42.320 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/rtc/interface.o 2024-05-08T09:04:42.576 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/pci-quirks.o 2024-05-08T09:04:42.636 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/cypress_ps2.o 2024-05-08T09:04:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:42.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:42.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:43.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:43.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:43.622 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_pm.o 2024-05-08T09:04:43.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:43 smithi070 ceph-mon[29591]: pgmap v4407: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 575 KiB/s wr, 24 op/s 2024-05-08T09:04:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:04:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:04:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:43.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:43 smithi172 ceph-mon[33377]: pgmap v4407: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 575 KiB/s wr, 24 op/s 2024-05-08T09:04:43.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:43.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:43.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:43.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:43.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:04:43.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:04:43.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:43 smithi194 ceph-mon[33679]: pgmap v4407: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 575 KiB/s wr, 24 op/s 2024-05-08T09:04:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:04:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:04:44.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:04:44.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:04:44.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:44 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:04:44.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:44 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:04:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:44 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:04:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:44 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:04:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:44 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:04:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:44 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:04:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:45 smithi070 ceph-mon[29591]: pgmap v4408: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 862 KiB/s wr, 37 op/s 2024-05-08T09:04:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:45 smithi172 ceph-mon[33377]: pgmap v4408: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 862 KiB/s wr, 37 op/s 2024-05-08T09:04:46.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:45 smithi194 ceph-mon[33679]: pgmap v4408: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 862 KiB/s wr, 37 op/s 2024-05-08T09:04:47.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:47 smithi070 ceph-mon[29591]: pgmap v4409: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 564 KiB/s wr, 24 op/s 2024-05-08T09:04:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:47 smithi172 ceph-mon[33377]: pgmap v4409: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 564 KiB/s wr, 24 op/s 2024-05-08T09:04:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:47 smithi194 ceph-mon[33679]: pgmap v4409: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 564 KiB/s wr, 24 op/s 2024-05-08T09:04:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:49 smithi070 ceph-mon[29591]: pgmap v4410: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 564 KiB/s wr, 24 op/s 2024-05-08T09:04:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:49 smithi172 ceph-mon[33377]: pgmap v4410: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 564 KiB/s wr, 24 op/s 2024-05-08T09:04:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:49 smithi194 ceph-mon[33679]: pgmap v4410: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 564 KiB/s wr, 24 op/s 2024-05-08T09:04:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:51 smithi070 ceph-mon[29591]: pgmap v4411: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 636 KiB/s wr, 32 op/s 2024-05-08T09:04:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:51 smithi172 ceph-mon[33377]: pgmap v4411: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 636 KiB/s wr, 32 op/s 2024-05-08T09:04:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:51 smithi194 ceph-mon[33679]: pgmap v4411: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 727 KiB/s rd, 636 KiB/s wr, 32 op/s 2024-05-08T09:04:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:53 smithi070 ceph-mon[29591]: pgmap v4412: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 359 KiB/s wr, 20 op/s 2024-05-08T09:04:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:53 smithi172 ceph-mon[33377]: pgmap v4412: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 359 KiB/s wr, 20 op/s 2024-05-08T09:04:54.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:53 smithi194 ceph-mon[33679]: pgmap v4412: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 332 KiB/s rd, 359 KiB/s wr, 20 op/s 2024-05-08T09:04:55.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:55 smithi070 ceph-mon[29591]: pgmap v4413: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 372 KiB/s wr, 24 op/s 2024-05-08T09:04:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:55 smithi172 ceph-mon[33377]: pgmap v4413: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 372 KiB/s wr, 24 op/s 2024-05-08T09:04:56.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:55 smithi194 ceph-mon[33679]: pgmap v4413: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 372 KiB/s wr, 24 op/s 2024-05-08T09:04:57.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:57 smithi070 ceph-mon[29591]: pgmap v4414: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 85 KiB/s wr, 11 op/s 2024-05-08T09:04:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:57 smithi172 ceph-mon[33377]: pgmap v4414: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 85 KiB/s wr, 11 op/s 2024-05-08T09:04:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:57 smithi194 ceph-mon[33679]: pgmap v4414: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 85 KiB/s wr, 11 op/s 2024-05-08T09:04:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:04:59 smithi070 ceph-mon[29591]: pgmap v4415: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 85 KiB/s wr, 11 op/s 2024-05-08T09:04:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:04:59 smithi172 ceph-mon[33377]: pgmap v4415: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 85 KiB/s wr, 11 op/s 2024-05-08T09:05:00.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:04:59 smithi194 ceph-mon[33679]: pgmap v4415: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 85 KiB/s wr, 11 op/s 2024-05-08T09:05:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:01 smithi070 ceph-mon[29591]: pgmap v4416: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 174 KiB/s wr, 14 op/s 2024-05-08T09:05:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:01 smithi172 ceph-mon[33377]: pgmap v4416: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 174 KiB/s wr, 14 op/s 2024-05-08T09:05:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:01 smithi194 ceph-mon[33679]: pgmap v4416: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 174 KiB/s wr, 14 op/s 2024-05-08T09:05:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:03 smithi070 ceph-mon[29591]: pgmap v4417: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 101 KiB/s wr, 7 op/s 2024-05-08T09:05:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:03 smithi172 ceph-mon[33377]: pgmap v4417: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 101 KiB/s wr, 7 op/s 2024-05-08T09:05:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:03 smithi194 ceph-mon[33679]: pgmap v4417: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 101 KiB/s wr, 7 op/s 2024-05-08T09:05:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:05 smithi070 ceph-mon[29591]: pgmap v4418: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 170 KiB/s wr, 25 op/s 2024-05-08T09:05:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:05 smithi172 ceph-mon[33377]: pgmap v4418: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 170 KiB/s wr, 25 op/s 2024-05-08T09:05:06.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:05 smithi194 ceph-mon[33679]: pgmap v4418: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 170 KiB/s wr, 25 op/s 2024-05-08T09:05:06.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.382+0000 7fa175600700 1 -- 172.21.15.70:0/3642341619 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x555969e9d590 con 0x555969fc2540 2024-05-08T09:05:06.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.382+0000 7fa175600700 10 client.19014 handle_command_reply: tid=0 2024-05-08T09:05:06.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.382+0000 7fa198c86b80 1 client.19014 shutdown 2024-05-08T09:05:06.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.383+0000 7fa198c86b80 1 -- 172.21.15.70:0/3642341619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3d520 msgr2=0x555969f5be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:06.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.383+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3d520 0x555969f5be80 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa178005970 tx=0x7fa178007eb0 comp rx=0 tx=0).stop 2024-05-08T09:05:06.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.383+0000 7fa198c86b80 1 -- 172.21.15.70:0/3642341619 shutdown_connections 2024-05-08T09:05:06.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.383+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x555969fc2540 0x555969fc4960 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:06.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.384+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x555969f42f50 0x555969f5a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:06.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.384+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555969f3d520 0x555969f5be80 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:06.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.384+0000 7fa198c86b80 1 --2- 172.21.15.70:0/3642341619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x555969f3dee0 0x555969f5c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:06.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.384+0000 7fa175600700 0 client.19014 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:05:06.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.384+0000 7fa198c86b80 1 -- 172.21.15.70:0/3642341619 >> 172.21.15.70:0/3642341619 conn(0x555969e6bcf0 msgr2=0x555969f409d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:06.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.384+0000 7fa198c86b80 1 -- 172.21.15.70:0/3642341619 shutdown_connections 2024-05-08T09:05:06.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.384+0000 7fa198c86b80 1 -- 172.21.15.70:0/3642341619 wait complete. 2024-05-08T09:05:06.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.385+0000 7fa198c86b80 20 client.19014 trim_cache size 0 max 16384 2024-05-08T09:05:06.387 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:05:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:05:06.387 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 306, 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "8cddb052": { 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 306, 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.9, 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:05:06.388 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:05:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:05:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:05:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:06.389 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:06.389 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:05:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.386+0000 7fa18e200700 1 -- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa16c0b2be0 msgr2=0x7fa16c0b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.386+0000 7fa18e200700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa16c0b2be0 0x7fa16c0b50a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa178009fd0 tx=0x7fa178006210 comp rx=0 tx=0).stop 2024-05-08T09:05:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.386+0000 7fa18e200700 1 -- 172.21.15.70:0/2329766894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1881076d0 msgr2=0x7fa1881a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.386+0000 7fa18e200700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1881076d0 0x7fa1881a1a40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa18000e940 tx=0x7fa18000ec50 comp rx=0 tx=0).stop 2024-05-08T09:05:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.387+0000 7fa18e200700 1 -- 172.21.15.70:0/2329766894 shutdown_connections 2024-05-08T09:05:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.387+0000 7fa18e200700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa16c0b2be0 0x7fa16c0b50a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.387+0000 7fa18e200700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1881076d0 0x7fa1881a1a40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.387+0000 7fa18e200700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa188102600 0x7fa18810e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.387+0000 7fa18e200700 1 --2- 172.21.15.70:0/2329766894 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa188102fb0 0x7fa18810ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.387+0000 7fa18e200700 1 -- 172.21.15.70:0/2329766894 >> 172.21.15.70:0/2329766894 conn(0x7fa188079340 msgr2=0x7fa188105fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.388+0000 7fa18e200700 1 -- 172.21.15.70:0/2329766894 shutdown_connections 2024-05-08T09:05:06.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:06.388+0000 7fa18e200700 1 -- 172.21.15.70:0/2329766894 wait complete. 2024-05-08T09:05:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:07 smithi070 ceph-mon[29591]: pgmap v4419: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 157 KiB/s wr, 21 op/s 2024-05-08T09:05:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:07 smithi172 ceph-mon[33377]: pgmap v4419: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 157 KiB/s wr, 21 op/s 2024-05-08T09:05:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:07 smithi194 ceph-mon[33679]: pgmap v4419: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 157 KiB/s wr, 21 op/s 2024-05-08T09:05:08.230 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8cddb052', quiesce took 41.0 seconds. Will release after: 19.9 2024-05-08T09:05:09.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:09 smithi070 ceph-mon[29591]: pgmap v4420: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 157 KiB/s wr, 21 op/s 2024-05-08T09:05:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:09 smithi172 ceph-mon[33377]: pgmap v4420: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 157 KiB/s wr, 21 op/s 2024-05-08T09:05:10.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:09 smithi194 ceph-mon[33679]: pgmap v4420: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 157 KiB/s wr, 21 op/s 2024-05-08T09:05:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:11 smithi070 ceph-mon[29591]: pgmap v4421: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 284 KiB/s wr, 25 op/s 2024-05-08T09:05:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:11 smithi172 ceph-mon[33377]: pgmap v4421: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 284 KiB/s wr, 25 op/s 2024-05-08T09:05:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:11 smithi194 ceph-mon[33679]: pgmap v4421: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 284 KiB/s wr, 25 op/s 2024-05-08T09:05:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:13 smithi070 ceph-mon[29591]: pgmap v4422: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 196 KiB/s wr, 21 op/s 2024-05-08T09:05:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:13 smithi172 ceph-mon[33377]: pgmap v4422: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 196 KiB/s wr, 21 op/s 2024-05-08T09:05:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:13 smithi194 ceph-mon[33679]: pgmap v4422: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 196 KiB/s wr, 21 op/s 2024-05-08T09:05:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:15 smithi172 ceph-mon[33377]: pgmap v4423: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 350 KiB/s wr, 29 op/s 2024-05-08T09:05:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:15 smithi194 ceph-mon[33679]: pgmap v4423: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 350 KiB/s wr, 29 op/s 2024-05-08T09:05:16.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:15 smithi070 ceph-mon[29591]: pgmap v4423: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 340 KiB/s rd, 350 KiB/s wr, 29 op/s 2024-05-08T09:05:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:17 smithi172 ceph-mon[33377]: pgmap v4424: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 282 KiB/s wr, 12 op/s 2024-05-08T09:05:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:17 smithi194 ceph-mon[33679]: pgmap v4424: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 282 KiB/s wr, 12 op/s 2024-05-08T09:05:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:17 smithi070 ceph-mon[29591]: pgmap v4424: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 282 KiB/s wr, 12 op/s 2024-05-08T09:05:19.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:19 smithi172 ceph-mon[33377]: pgmap v4425: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 282 KiB/s wr, 12 op/s 2024-05-08T09:05:20.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:19 smithi070 ceph-mon[29591]: pgmap v4425: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 282 KiB/s wr, 12 op/s 2024-05-08T09:05:20.190 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:19 smithi194 ceph-mon[33679]: pgmap v4425: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 282 KiB/s wr, 12 op/s 2024-05-08T09:05:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:21 smithi172 ceph-mon[33377]: pgmap v4426: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 324 KiB/s wr, 16 op/s 2024-05-08T09:05:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:21 smithi194 ceph-mon[33679]: pgmap v4426: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 324 KiB/s wr, 16 op/s 2024-05-08T09:05:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:21 smithi070 ceph-mon[29591]: pgmap v4426: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 324 KiB/s wr, 16 op/s 2024-05-08T09:05:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:23 smithi172 ceph-mon[33377]: pgmap v4427: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 196 KiB/s wr, 12 op/s 2024-05-08T09:05:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:23 smithi194 ceph-mon[33679]: pgmap v4427: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 196 KiB/s wr, 12 op/s 2024-05-08T09:05:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:23 smithi070 ceph-mon[29591]: pgmap v4427: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 196 KiB/s wr, 12 op/s 2024-05-08T09:05:25.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:24 smithi194 ceph-mon[33679]: pgmap v4428: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 207 KiB/s wr, 15 op/s 2024-05-08T09:05:25.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:24 smithi070 ceph-mon[29591]: pgmap v4428: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 207 KiB/s wr, 15 op/s 2024-05-08T09:05:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:24 smithi172 ceph-mon[33377]: pgmap v4428: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 207 KiB/s wr, 15 op/s 2024-05-08T09:05:27.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:27 smithi172 ceph-mon[33377]: pgmap v4429: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T09:05:27.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:27 smithi194 ceph-mon[33679]: pgmap v4429: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T09:05:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:27 smithi070 ceph-mon[29591]: pgmap v4429: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T09:05:28.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:05:28.626 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:05:29.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:29 smithi070 ceph-mon[29591]: pgmap v4430: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T09:05:29.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:29 smithi172 ceph-mon[33377]: pgmap v4430: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T09:05:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:29 smithi194 ceph-mon[33679]: pgmap v4430: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 52 KiB/s wr, 7 op/s 2024-05-08T09:05:30.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.917+0000 7f81c8400700 1 -- 172.21.15.70:0/1617652887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01060a0 msgr2=0x7f81c01125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:30.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.917+0000 7f81c8400700 1 --2- 172.21.15.70:0/1617652887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01060a0 0x7f81c01125b0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f81b800b0a0 tx=0x7f81b800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:05:30.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.917+0000 7f81c8400700 1 -- 172.21.15.70:0/1617652887 shutdown_connections 2024-05-08T09:05:30.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.917+0000 7f81c8400700 1 --2- 172.21.15.70:0/1617652887 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01060a0 0x7f81c01125b0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:30.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.917+0000 7f81c8400700 1 --2- 172.21.15.70:0/1617652887 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81c010b6e0 0x7f81c010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:30.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.917+0000 7f81c8400700 1 --2- 172.21.15.70:0/1617652887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c01056e0 0x7f81c0105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:30.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.917+0000 7f81c8400700 1 -- 172.21.15.70:0/1617652887 >> 172.21.15.70:0/1617652887 conn(0x7f81c01011d0 msgr2=0x7f81c01035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:30.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.917+0000 7f81c8400700 1 -- 172.21.15.70:0/1617652887 shutdown_connections 2024-05-08T09:05:30.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.917+0000 7f81c8400700 1 -- 172.21.15.70:0/1617652887 wait complete. 2024-05-08T09:05:30.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.919+0000 7f81c8400700 1 Processor -- start 2024-05-08T09:05:30.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.919+0000 7f81c8400700 1 -- start start 2024-05-08T09:05:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c8400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01056e0 0x7f81c0112420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c8400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c01060a0 0x7f81c010f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c8400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81c010b6e0 0x7f81c010fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c8400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f81c0115820 con 0x7f81c01056e0 2024-05-08T09:05:30.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c8400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01156a0 con 0x7f81c010b6e0 2024-05-08T09:05:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c8400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f81c01159a0 con 0x7f81c01060a0 2024-05-08T09:05:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c5a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01056e0 0x7f81c0112420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c5a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01056e0 0x7f81c0112420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40358/0 (socket says 172.21.15.70:40358) 2024-05-08T09:05:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c5a00700 1 -- 172.21.15.70:0/2797926738 learned_addr learned my addr 172.21.15.70:0/2797926738 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:05:30.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c6400700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81c010b6e0 0x7f81c010fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:30.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.920+0000 7f81c5000700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c01060a0 0x7f81c010f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:30.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.921+0000 7f81c5a00700 1 -- 172.21.15.70:0/2797926738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c01060a0 msgr2=0x7f81c010f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:30.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.921+0000 7f81c5a00700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c01060a0 0x7f81c010f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:30.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.921+0000 7f81c5a00700 1 -- 172.21.15.70:0/2797926738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81c010b6e0 msgr2=0x7f81c010fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:30.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.921+0000 7f81c5a00700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81c010b6e0 0x7f81c010fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:30.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.921+0000 7f81c5a00700 1 -- 172.21.15.70:0/2797926738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c0110360 con 0x7f81c01056e0 2024-05-08T09:05:30.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.921+0000 7f81c5000700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c01060a0 0x7f81c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:05:30.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.921+0000 7f81c5a00700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01056e0 0x7f81c0112420 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f81b400d950 tx=0x7f81b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:05:30.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.922+0000 7f81be000700 1 -- 172.21.15.70:0/2797926738 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4016070 con 0x7f81c01056e0 2024-05-08T09:05:30.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.922+0000 7f81be000700 1 -- 172.21.15.70:0/2797926738 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81b4009dd0 con 0x7f81c01056e0 2024-05-08T09:05:30.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.922+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c01ac5c0 con 0x7f81c01056e0 2024-05-08T09:05:30.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.922+0000 7f81be000700 1 -- 172.21.15.70:0/2797926738 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b400f3c0 con 0x7f81c01056e0 2024-05-08T09:05:30.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.922+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c01acb20 con 0x7f81c01056e0 2024-05-08T09:05:30.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.923+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c0106e20 con 0x7f81c01056e0 2024-05-08T09:05:30.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.927+0000 7f81be000700 1 -- 172.21.15.70:0/2797926738 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f81b4019070 con 0x7f81c01056e0 2024-05-08T09:05:30.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.929+0000 7f81be000700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81a80b2a70 0x7f81a80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:30.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.929+0000 7f81be000700 1 -- 172.21.15.70:0/2797926738 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(354..354 src has 1..354) ==== 9583+0+0 (secure 0 0 0) 0x7f81b40e2580 con 0x7f81c01056e0 2024-05-08T09:05:30.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.929+0000 7f81c5000700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81a80b2a70 0x7f81a80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:30.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.930+0000 7f81c5000700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81a80b2a70 0x7f81a80b4f30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f81ac005950 tx=0x7f81ac0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:05:30.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:30.938+0000 7f81be000700 1 -- 172.21.15.70:0/2797926738 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f81b40a9b40 con 0x7f81c01056e0 2024-05-08T09:05:31.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.222+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81c002e6d0 con 0x7f81c01056e0 2024-05-08T09:05:31.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.224+0000 7f81be000700 1 -- 172.21.15.70:0/2797926738 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f81b40a9440 con 0x7f81c01056e0 2024-05-08T09:05:31.225 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:05:31.225 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:05:31.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81a80b2a70 msgr2=0x7f81a80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:31.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81a80b2a70 0x7f81a80b4f30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f81ac005950 tx=0x7f81ac0058e0 comp rx=0 tx=0).stop 2024-05-08T09:05:31.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01056e0 msgr2=0x7f81c0112420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:31.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01056e0 0x7f81c0112420 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f81b400d950 tx=0x7f81b400dc60 comp rx=0 tx=0).stop 2024-05-08T09:05:31.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 shutdown_connections 2024-05-08T09:05:31.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81a80b2a70 0x7f81a80b4f30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:31.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f81c010b6e0 0x7f81c010fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:31.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81c01056e0 0x7f81c0112420 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:31.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 --2- 172.21.15.70:0/2797926738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c01060a0 0x7f81c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:31.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 >> 172.21.15.70:0/2797926738 conn(0x7f81c01011d0 msgr2=0x7f81c01018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:31.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 shutdown_connections 2024-05-08T09:05:31.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:31.228+0000 7f81c8400700 1 -- 172.21.15.70:0/2797926738 wait complete. 2024-05-08T09:05:31.229 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:05:31.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:31 smithi070 ceph-mon[29591]: pgmap v4431: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 10 op/s 2024-05-08T09:05:31.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:31 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2797926738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:05:31.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:31 smithi172 ceph-mon[33377]: pgmap v4431: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 10 op/s 2024-05-08T09:05:31.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:31 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2797926738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:05:31.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:31 smithi194 ceph-mon[33679]: pgmap v4431: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 86 KiB/s wr, 10 op/s 2024-05-08T09:05:31.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:31 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2797926738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:05:32.071 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 8cddb052 --release --await' 2024-05-08T09:05:32.071 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 8cddb052 --release --await 2024-05-08T09:05:32.519 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:05:33.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:33 smithi172 ceph-mon[33377]: pgmap v4432: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-05-08T09:05:33.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:33 smithi070 ceph-mon[29591]: pgmap v4432: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-05-08T09:05:33.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:33 smithi194 ceph-mon[33679]: pgmap v4432: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 5 op/s 2024-05-08T09:05:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.103+0000 7f3c73c00700 1 -- 172.21.15.70:0/3599416764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 msgr2=0x7f3c6c113e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.103+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3599416764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 0x7f3c6c113e20 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3c58009990 tx=0x7f3c58009ca0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.103+0000 7f3c73c00700 1 -- 172.21.15.70:0/3599416764 shutdown_connections 2024-05-08T09:05:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.103+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3599416764 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c6c114360 0x7f3c6c116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.103+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3599416764 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c0779d0 0x7f3c6c077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.103+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3599416764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 0x7f3c6c113e20 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.103+0000 7f3c73c00700 1 -- 172.21.15.70:0/3599416764 >> 172.21.15.70:0/3599416764 conn(0x7f3c6c1011d0 msgr2=0x7f3c6c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.103+0000 7f3c73c00700 1 -- 172.21.15.70:0/3599416764 shutdown_connections 2024-05-08T09:05:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.103+0000 7f3c73c00700 1 -- 172.21.15.70:0/3599416764 wait complete. 2024-05-08T09:05:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.104+0000 7f3c73c00700 1 Processor -- start 2024-05-08T09:05:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c73c00700 1 -- start start 2024-05-08T09:05:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c73c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c0779d0 0x7f3c6c1a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c73c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 0x7f3c6c1a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c73c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c6c114360 0x7f3c6c1a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c73c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c119ba0 con 0x7f3c6c0782f0 2024-05-08T09:05:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c73c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c119a20 con 0x7f3c6c0779d0 2024-05-08T09:05:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c73c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c119d20 con 0x7f3c6c114360 2024-05-08T09:05:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c6be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 0x7f3c6c1a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c6be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 0x7f3c6c1a05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40370/0 (socket says 172.21.15.70:40370) 2024-05-08T09:05:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c6be00700 1 -- 172.21.15.70:0/3503794160 learned_addr learned my addr 172.21.15.70:0/3503794160 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:05:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.105+0000 7f3c71200700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c0779d0 0x7f3c6c1a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c71c00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c6c114360 0x7f3c6c1a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c6be00700 1 -- 172.21.15.70:0/3503794160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c6c114360 msgr2=0x7f3c6c1a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c6be00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c6c114360 0x7f3c6c1a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c6be00700 1 -- 172.21.15.70:0/3503794160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c0779d0 msgr2=0x7f3c6c1a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c6be00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c0779d0 0x7f3c6c1a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c6be00700 1 -- 172.21.15.70:0/3503794160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c1a5050 con 0x7f3c6c0782f0 2024-05-08T09:05:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c6be00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 0x7f3c6c1a05d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c58009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:05:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c69600700 1 -- 172.21.15.70:0/3503794160 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58027070 con 0x7f3c6c0782f0 2024-05-08T09:05:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c69600700 1 -- 172.21.15.70:0/3503794160 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c5800fc70 con 0x7f3c6c0782f0 2024-05-08T09:05:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.106+0000 7f3c73c00700 1 -- 172.21.15.70:0/3503794160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6c1a52e0 con 0x7f3c6c0782f0 2024-05-08T09:05:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.107+0000 7f3c69600700 1 -- 172.21.15.70:0/3503794160 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58022d40 con 0x7f3c6c0782f0 2024-05-08T09:05:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.107+0000 7f3c73c00700 1 -- 172.21.15.70:0/3503794160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6c1acbc0 con 0x7f3c6c0782f0 2024-05-08T09:05:35.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.110+0000 7f3c69600700 1 -- 172.21.15.70:0/3503794160 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3c5802a070 con 0x7f3c6c0782f0 2024-05-08T09:05:35.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.111+0000 7f3c69600700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3c540b2a70 0x7f3c540b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.112+0000 7f3c69600700 1 -- 172.21.15.70:0/3503794160 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(354..354 src has 1..354) ==== 9583+0+0 (secure 0 0 0) 0x7f3c580e37d0 con 0x7f3c6c0782f0 2024-05-08T09:05:35.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.112+0000 7f3c71200700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3c540b2a70 0x7f3c540b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.112+0000 7f3c71200700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3c540b2a70 0x7f3c540b4f30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3c60005ea0 tx=0x7f3c60005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:05:35.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.123+0000 7f3c7e682b80 1 Processor -- start 2024-05-08T09:05:35.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c7e682b80 1 -- start start 2024-05-08T09:05:35.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 0x55fdb9dbdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdb9d0fb20 con 0x55fdb9dbe140 2024-05-08T09:05:35.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fdb9cad860 con 0x55fdb9dbd780 2024-05-08T09:05:35.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fdb9d0bae0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c71c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c71c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40372/0 (socket says 172.21.15.70:40372) 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.124+0000 7f3c71c00700 1 -- 172.21.15.70:0/2286859022 learned_addr learned my addr 172.21.15.70:0/2286859022 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.125+0000 7f3c71200700 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.125+0000 7f3c6be00700 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 0x55fdb9dbdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.125+0000 7f3c71c00700 1 -- 172.21.15.70:0/2286859022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 msgr2=0x55fdb9dc3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.125+0000 7f3c71c00700 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.125+0000 7f3c71c00700 1 -- 172.21.15.70:0/2286859022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 msgr2=0x55fdb9dbdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.125+0000 7f3c71c00700 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 0x55fdb9dbdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.125+0000 7f3c71c00700 1 -- 172.21.15.70:0/2286859022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb9c5c9d0 con 0x55fdb9dbe140 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.125+0000 7f3c6be00700 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 0x55fdb9dbdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.125+0000 7f3c71c00700 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc9f70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009cb0 tx=0x7f3c64007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366ed565f33d9c9e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.126+0000 7f3c5e000700 1 -- 172.21.15.70:0/2286859022 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64007d30 con 0x55fdb9dbe140 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.126+0000 7f3c5e000700 1 -- 172.21.15.70:0/2286859022 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c64004bb0 con 0x55fdb9dbe140 2024-05-08T09:05:35.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.126+0000 7f3c5e000700 1 -- 172.21.15.70:0/2286859022 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64014610 con 0x55fdb9dbe140 2024-05-08T09:05:35.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.126+0000 7f3c7e682b80 1 -- 172.21.15.70:0/2286859022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbe140 msgr2=0x55fdb9dc9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:35.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.126+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc9f70 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009cb0 tx=0x7f3c64007500 comp rx=0 tx=0).stop 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.127+0000 7f3c7e682b80 1 -- 172.21.15.70:0/2286859022 shutdown_connections 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.127+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc9f70 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.127+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.127+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/2286859022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 0x55fdb9dbdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.127+0000 7f3c7e682b80 1 -- 172.21.15.70:0/2286859022 >> 172.21.15.70:0/2286859022 conn(0x55fdb9d357d0 msgr2=0x55fdb9db8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.127+0000 7f3c7e682b80 1 -- 172.21.15.70:0/2286859022 shutdown_connections 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.127+0000 7f3c7e682b80 1 -- 172.21.15.70:0/2286859022 wait complete. 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.127+0000 7f3c7e682b80 1 -- start start 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.128+0000 7f3c7e682b80 1 Processor -- start 2024-05-08T09:05:35.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.128+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.128+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.128+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.128+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fdb9dca570 con 0x55fdb9dc31b0 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.128+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55fdb9c75c20 con 0x55fdb9dbd780 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.128+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55fdb9dca6f0 con 0x55fdb9dbe140 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.128+0000 7f3c7e682b80 10 client.0 _ll_register_callbacks cb 0x55fdb9cb6d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.128+0000 7f3c71c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c71c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40382/0 (socket says 172.21.15.70:40382) 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c71c00700 1 -- 172.21.15.70:0/3911147620 learned_addr learned my addr 172.21.15.70:0/3911147620 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:05:35.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c71200700 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c6be00700 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c71c00700 1 -- 172.21.15.70:0/3911147620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dbe140 msgr2=0x55fdb9dc6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c71c00700 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c71c00700 1 -- 172.21.15.70:0/3911147620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 msgr2=0x55fdb9dc9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c71c00700 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c71c00700 1 -- 172.21.15.70:0/3911147620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb9cd5520 con 0x55fdb9dc31b0 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c71c00700 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc73c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f3c64004ed0 tx=0x7f3c64005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e488962f745974c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.129+0000 7f3c52a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.130+0000 7f3c52a00700 1 -- 172.21.15.70:0/3911147620 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64022070 con 0x55fdb9dc31b0 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.130+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3911147620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c64004bb0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.130+0000 7f3c52a00700 1 -- 172.21.15.70:0/3911147620 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(354..354 src has 1..354) ==== 9583+0+0 (secure 0 0 0) 0x7f3c640054e0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.130+0000 7f3c52a00700 1 -- 172.21.15.70:0/3911147620 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3c6402e050 con 0x55fdb9dc31b0 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.130+0000 7f3c7e682b80 10 client.19032 fetch_fsmap learned FSMap version 42 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.130+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3911147620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fdb9dd4cf0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.130+0000 7f3c52a00700 1 -- 172.21.15.70:0/3911147620 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c64004bb0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.131+0000 7f3c52a00700 1 -- 172.21.15.70:0/3911147620 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3c64014410 con 0x55fdb9dc31b0 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.131+0000 7f3c7e682b80 10 client.19032 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.131+0000 7f3c7e682b80 10 client.19032 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.131+0000 7f3c7e682b80 20 client.19032 populate_metadata read hostname 'smithi070' 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.131+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fdb9dd7220 0x55fdb9dd9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.131+0000 7f3c7e682b80 4 client.19032 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.131+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3911147620 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fdb9d8a240 con 0x55fdb9dd7220 2024-05-08T09:05:35.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.132+0000 7f3c71200700 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fdb9dd7220 0x55fdb9dd9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.133+0000 7f3c71200700 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fdb9dd7220 0x55fdb9dd9610 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7e2dba53dfbf827 server_cookie=ecce8f16a6f1a50b in_seq=0 out_seq=0 2024-05-08T09:05:35.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.133+0000 7f3c52a00700 10 client.19032 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:05:35.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c52a00700 1 -- 172.21.15.70:0/3911147620 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fdb9d8a240 con 0x55fdb9dd7220 2024-05-08T09:05:35.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c52a00700 10 client.19032 handle_command_reply: tid=0 2024-05-08T09:05:35.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 client.19032 shutdown 2024-05-08T09:05:35.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3911147620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 msgr2=0x55fdb9dc73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc73c0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f3c64004ed0 tx=0x7f3c64005000 comp rx=0 tx=0).stop 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3911147620 shutdown_connections 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fdb9dd7220 0x55fdb9dd9610 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dc73c0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3911147620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dbe140 0x55fdb9dc6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3911147620 >> 172.21.15.70:0/3911147620 conn(0x55fdb9d357d0 msgr2=0x55fdb9db2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c52a00700 0 client.19032 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.135+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3911147620 shutdown_connections 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.136+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3911147620 wait complete. 2024-05-08T09:05:35.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.136+0000 7f3c7e682b80 20 client.19032 trim_cache size 0 max 16384 2024-05-08T09:05:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.157+0000 7f3c7e682b80 1 Processor -- start 2024-05-08T09:05:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c7e682b80 1 -- start start 2024-05-08T09:05:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 0x55fdb9db22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 0x55fdb9db27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c1b83a0 con 0x55fdb9dbd780 2024-05-08T09:05:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c1b5c30 con 0x55fdb9dbe140 2024-05-08T09:05:35.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c1b3aa0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c71200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c71200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40384/0 (socket says 172.21.15.70:40384) 2024-05-08T09:05:35.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.158+0000 7f3c71200700 1 -- 172.21.15.70:0/634842166 learned_addr learned my addr 172.21.15.70:0/634842166 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:05:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c71c00700 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 0x55fdb9db27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c6be00700 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 0x55fdb9db22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c71200700 1 -- 172.21.15.70:0/634842166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 msgr2=0x55fdb9db27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:05:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c71200700 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 0x55fdb9db27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c71200700 1 -- 172.21.15.70:0/634842166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 msgr2=0x55fdb9db22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c71200700 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 0x55fdb9db22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c71200700 1 -- 172.21.15.70:0/634842166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fdb9dba230 con 0x55fdb9dbd780 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c6be00700 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 0x55fdb9db22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c71200700 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc73f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000e6e0 tx=0x7f3c6000af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1943dd7b07f4521f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.159+0000 7f3c5d600700 1 -- 172.21.15.70:0/634842166 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6002d070 con 0x55fdb9dbd780 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.160+0000 7f3c5d600700 1 -- 172.21.15.70:0/634842166 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c600200d0 con 0x55fdb9dbd780 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.160+0000 7f3c5d600700 1 -- 172.21.15.70:0/634842166 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c600279e0 con 0x55fdb9dbd780 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.160+0000 7f3c7e682b80 1 -- 172.21.15.70:0/634842166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbd780 msgr2=0x55fdb9dc73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.160+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc73f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000e6e0 tx=0x7f3c6000af90 comp rx=0 tx=0).stop 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.160+0000 7f3c7e682b80 1 -- 172.21.15.70:0/634842166 shutdown_connections 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.160+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9dc31b0 0x55fdb9db27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.160+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dbd780 0x55fdb9dc73f0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.160+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/634842166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 0x55fdb9db22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.160+0000 7f3c7e682b80 1 -- 172.21.15.70:0/634842166 >> 172.21.15.70:0/634842166 conn(0x55fdb9d357d0 msgr2=0x55fdb9dc14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:35.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.161+0000 7f3c7e682b80 1 -- 172.21.15.70:0/634842166 shutdown_connections 2024-05-08T09:05:35.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.161+0000 7f3c7e682b80 1 -- 172.21.15.70:0/634842166 wait complete. 2024-05-08T09:05:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.161+0000 7f3c7e682b80 1 -- start start 2024-05-08T09:05:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.161+0000 7f3c7e682b80 1 Processor -- start 2024-05-08T09:05:35.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 0x55fdb9dda4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dda9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c7e682b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9ddaf80 0x55fdb9e40740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c1b40f0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c1b5560 con 0x55fdb9dbe140 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c7e682b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c1b47c0 con 0x55fdb9ddaf80 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c7e682b80 10 client.0 _ll_register_callbacks cb 0x55fdb9cb6d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c6be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dda9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c6be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dda9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40390/0 (socket says 172.21.15.70:40390) 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.162+0000 7f3c6be00700 1 -- 172.21.15.70:0/3532407387 learned_addr learned my addr 172.21.15.70:0/3532407387 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.163+0000 7f3c71c00700 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9ddaf80 0x55fdb9e40740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.163+0000 7f3c71200700 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 0x55fdb9dda4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.163+0000 7f3c6be00700 1 -- 172.21.15.70:0/3532407387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9ddaf80 msgr2=0x55fdb9e40740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:05:35.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.163+0000 7f3c6be00700 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9ddaf80 0x55fdb9e40740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.163+0000 7f3c6be00700 1 -- 172.21.15.70:0/3532407387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 msgr2=0x55fdb9dda4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.163+0000 7f3c6be00700 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 0x55fdb9dda4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.163+0000 7f3c6be00700 1 -- 172.21.15.70:0/3532407387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fdb9e40e90 con 0x55fdb9dc31b0 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.163+0000 7f3c6be00700 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dda9f0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f3c580aa650 tx=0x7f3c58092330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734012f99a3ce715 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.163+0000 7f3c52a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.164+0000 7f3c52a00700 1 -- 172.21.15.70:0/3532407387 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c580aa1d0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.164+0000 7f3c52a00700 1 -- 172.21.15.70:0/3532407387 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(354..354 src has 1..354) ==== 9583+0+0 (secure 0 0 0) 0x7f3c580aab30 con 0x55fdb9dc31b0 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.164+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3532407387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c600200d0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.164+0000 7f3c52a00700 1 -- 172.21.15.70:0/3532407387 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3c5800fe20 con 0x55fdb9dc31b0 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.164+0000 7f3c7e682b80 10 client.19038 fetch_fsmap learned FSMap version 42 2024-05-08T09:05:35.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.164+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3532407387 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55fdb9e421a0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.164+0000 7f3c52a00700 1 -- 172.21.15.70:0/3532407387 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c600200d0 con 0x55fdb9dc31b0 2024-05-08T09:05:35.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.165+0000 7f3c52a00700 1 -- 172.21.15.70:0/3532407387 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3c580b3000 con 0x55fdb9dc31b0 2024-05-08T09:05:35.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.165+0000 7f3c7e682b80 10 client.19038 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:05:35.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.165+0000 7f3c7e682b80 10 client.19038 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:05:35.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.165+0000 7f3c7e682b80 20 client.19038 populate_metadata read hostname 'smithi070' 2024-05-08T09:05:35.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.165+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fdb9e428b0 0x55fdb9e44cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:05:35.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.165+0000 7f3c7e682b80 4 client.19038 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8cddb052", "release": true, "await": true}] 2024-05-08T09:05:35.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.165+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3532407387 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8cddb052", "release": true, "await": true}) -- 0x55fdb9d1d500 con 0x55fdb9e428b0 2024-05-08T09:05:35.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.165+0000 7f3c71200700 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fdb9e428b0 0x55fdb9e44cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:05:35.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.166+0000 7f3c71200700 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fdb9e428b0 0x55fdb9e44cd0 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39b55eef7e02be39 server_cookie=205a3eaa88280145 in_seq=0 out_seq=0 2024-05-08T09:05:35.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:35.166+0000 7f3c52a00700 10 client.19038 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:05:35.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:35 smithi070 ceph-mon[29591]: pgmap v4433: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T09:05:35.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:35 smithi172 ceph-mon[33377]: pgmap v4433: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T09:05:35.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:35 smithi194 ceph-mon[33679]: pgmap v4433: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T09:05:37.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:37 smithi172 ceph-mon[33377]: pgmap v4434: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 5 op/s 2024-05-08T09:05:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:37 smithi194 ceph-mon[33679]: pgmap v4434: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 5 op/s 2024-05-08T09:05:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:37 smithi070 ceph-mon[29591]: pgmap v4434: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 5 op/s 2024-05-08T09:05:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:39 smithi194 ceph-mon[33679]: pgmap v4435: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 5 op/s 2024-05-08T09:05:39.794 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:39 smithi070 ceph-mon[29591]: pgmap v4435: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 5 op/s 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.792+0000 7f3c52a00700 1 -- 172.21.15.70:0/3532407387 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55fdb9d1d500 con 0x55fdb9e428b0 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.792+0000 7f3c52a00700 10 client.19038 handle_command_reply: tid=0 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.792+0000 7f3c7e682b80 1 client.19038 shutdown 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.792+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3532407387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 msgr2=0x55fdb9dda9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.792+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dda9f0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f3c580aa650 tx=0x7f3c58092330 comp rx=0 tx=0).stop 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.793+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3532407387 shutdown_connections 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.793+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55fdb9e428b0 0x55fdb9e44cd0 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.793+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55fdb9ddaf80 0x55fdb9e40740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.793+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55fdb9dbe140 0x55fdb9dda4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.793+0000 7f3c7e682b80 1 --2- 172.21.15.70:0/3532407387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fdb9dc31b0 0x55fdb9dda9f0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:39.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.793+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3532407387 >> 172.21.15.70:0/3532407387 conn(0x55fdb9d357d0 msgr2=0x55fdb9db22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:39.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.795+0000 7f3c52a00700 0 client.19038 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:05:39.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.797+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3532407387 shutdown_connections 2024-05-08T09:05:39.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.797+0000 7f3c7e682b80 1 -- 172.21.15.70:0/3532407387 wait complete. 2024-05-08T09:05:39.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.798+0000 7f3c7e682b80 20 client.19038 trim_cache size 0 max 16384 2024-05-08T09:05:39.803 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:05:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:05:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:05:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 308, 2024-05-08T09:05:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:05:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "8cddb052": { 2024-05-08T09:05:39.803 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 308, 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.9, 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:05:39.804 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:05:39.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.804+0000 7f3c73c00700 1 -- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3c540b2a70 msgr2=0x7f3c540b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:39.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.804+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3c540b2a70 0x7f3c540b4f30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3c60005ea0 tx=0x7f3c60005e30 comp rx=0 tx=0).stop 2024-05-08T09:05:39.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.804+0000 7f3c73c00700 1 -- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 msgr2=0x7f3c6c1a05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:05:39.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.804+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 0x7f3c6c1a05d0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f3c58000c00 tx=0x7f3c58009f90 comp rx=0 tx=0).stop 2024-05-08T09:05:39.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.806+0000 7f3c73c00700 1 -- 172.21.15.70:0/3503794160 shutdown_connections 2024-05-08T09:05:39.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.806+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3c540b2a70 0x7f3c540b4f30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:39.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.806+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c6c114360 0x7f3c6c1a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:39.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.806+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3c6c0779d0 0x7f3c6c1a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:39.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.806+0000 7f3c73c00700 1 --2- 172.21.15.70:0/3503794160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3c6c0782f0 0x7f3c6c1a05d0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:05:39.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.806+0000 7f3c73c00700 1 -- 172.21.15.70:0/3503794160 >> 172.21.15.70:0/3503794160 conn(0x7f3c6c1011d0 msgr2=0x7f3c6c1035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:05:39.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.809+0000 7f3c73c00700 1 -- 172.21.15.70:0/3503794160 shutdown_connections 2024-05-08T09:05:39.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:05:39.809+0000 7f3c73c00700 1 -- 172.21.15.70:0/3503794160 wait complete. 2024-05-08T09:05:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:39 smithi172 ceph-mon[33377]: pgmap v4435: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 34 KiB/s wr, 5 op/s 2024-05-08T09:05:40.648 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_pm_debugfs.o 2024-05-08T09:05:40.661 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8cddb052', seconds elapsed: 73.5 2024-05-08T09:05:41.694 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:41 smithi070 ceph-mon[29591]: pgmap v4436: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 147 KiB/s wr, 8 op/s 2024-05-08T09:05:41.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:41 smithi194 ceph-mon[33679]: pgmap v4436: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 147 KiB/s wr, 8 op/s 2024-05-08T09:05:41.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:41 smithi172 ceph-mon[33377]: pgmap v4436: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 147 KiB/s wr, 8 op/s 2024-05-08T09:05:42.182 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/mouse/psmouse-smbus.o 2024-05-08T09:05:42.246 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/generic.o 2024-05-08T09:05:42.316 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/ehci-hcd.o 2024-05-08T09:05:42.378 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/rtc/nvmem.o 2024-05-08T09:05:42.894 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/rtc/dev.o 2024-05-08T09:05:42.912 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/netdev.o 2024-05-08T09:05:43.167 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/ehci-pci.o 2024-05-08T09:05:43.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:43 smithi194 ceph-mon[33679]: pgmap v4437: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 113 KiB/s wr, 5 op/s 2024-05-08T09:05:43.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:43 smithi070 ceph-mon[29591]: pgmap v4437: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 113 KiB/s wr, 5 op/s 2024-05-08T09:05:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:43 smithi172 ceph-mon[33377]: pgmap v4437: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 113 KiB/s wr, 5 op/s 2024-05-08T09:05:44.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:05:44.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:05:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:05:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:45 smithi194 ceph-mon[33679]: pgmap v4438: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 390 KiB/s wr, 22 op/s 2024-05-08T09:05:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:05:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:05:45.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:05:45.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:45 smithi070 ceph-mon[29591]: pgmap v4438: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 390 KiB/s wr, 22 op/s 2024-05-08T09:05:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:05:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:05:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:05:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:45 smithi172 ceph-mon[33377]: pgmap v4438: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 348 KiB/s rd, 390 KiB/s wr, 22 op/s 2024-05-08T09:05:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:05:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:05:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:05:47.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:47 smithi194 ceph-mon[33679]: pgmap v4439: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 390 KiB/s wr, 19 op/s 2024-05-08T09:05:47.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:47 smithi070 ceph-mon[29591]: pgmap v4439: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 390 KiB/s wr, 19 op/s 2024-05-08T09:05:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:47 smithi172 ceph-mon[33377]: pgmap v4439: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 390 KiB/s wr, 19 op/s 2024-05-08T09:05:49.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:49 smithi194 ceph-mon[33679]: pgmap v4440: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 390 KiB/s wr, 19 op/s 2024-05-08T09:05:49.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:49 smithi070 ceph-mon[29591]: pgmap v4440: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 390 KiB/s wr, 19 op/s 2024-05-08T09:05:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:49 smithi172 ceph-mon[33377]: pgmap v4440: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 390 KiB/s wr, 19 op/s 2024-05-08T09:05:50.773 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/input/touchscreen/built-in.a 2024-05-08T09:05:50.949 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/ohci-hcd.o 2024-05-08T09:05:51.429 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/quirks.o 2024-05-08T09:05:51.735 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:51 smithi070 ceph-mon[29591]: pgmap v4441: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 529 KiB/s wr, 32 op/s 2024-05-08T09:05:51.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:51 smithi194 ceph-mon[33679]: pgmap v4441: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 529 KiB/s wr, 32 op/s 2024-05-08T09:05:51.881 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/rtc/proc.o 2024-05-08T09:05:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:51 smithi172 ceph-mon[33377]: pgmap v4441: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 529 KiB/s wr, 32 op/s 2024-05-08T09:05:51.954 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/devices.o 2024-05-08T09:05:52.023 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/input/mouse/built-in.a 2024-05-08T09:05:52.886 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/input/misc/built-in.a 2024-05-08T09:05:52.991 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/input.o 2024-05-08T09:05:53.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:53 smithi194 ceph-mon[33679]: pgmap v4442: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 417 KiB/s wr, 29 op/s 2024-05-08T09:05:53.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:53 smithi070 ceph-mon[29591]: pgmap v4442: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 417 KiB/s wr, 29 op/s 2024-05-08T09:05:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:53 smithi172 ceph-mon[33377]: pgmap v4442: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 417 KiB/s wr, 29 op/s 2024-05-08T09:05:53.999 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/rtc/sysfs.o 2024-05-08T09:05:55.164 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_pm_irq.o 2024-05-08T09:05:55.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:55 smithi194 ceph-mon[33679]: pgmap v4443: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 830 KiB/s wr, 49 op/s 2024-05-08T09:05:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:55 smithi070 ceph-mon[29591]: pgmap v4443: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 830 KiB/s wr, 49 op/s 2024-05-08T09:05:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:55 smithi172 ceph-mon[33377]: pgmap v4443: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 830 KiB/s wr, 49 op/s 2024-05-08T09:05:57.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:57 smithi194 ceph-mon[33679]: pgmap v4444: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 552 KiB/s wr, 33 op/s 2024-05-08T09:05:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:57 smithi070 ceph-mon[29591]: pgmap v4444: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 552 KiB/s wr, 33 op/s 2024-05-08T09:05:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:57 smithi172 ceph-mon[33377]: pgmap v4444: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 552 KiB/s wr, 33 op/s 2024-05-08T09:05:59.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:05:59 smithi194 ceph-mon[33679]: pgmap v4445: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 552 KiB/s wr, 33 op/s 2024-05-08T09:05:59.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:05:59 smithi070 ceph-mon[29591]: pgmap v4445: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 552 KiB/s wr, 33 op/s 2024-05-08T09:05:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:05:59 smithi172 ceph-mon[33377]: pgmap v4445: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 552 KiB/s wr, 33 op/s 2024-05-08T09:06:00.143 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/intel/e1000e/ptp.o 2024-05-08T09:06:00.172 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/class/usblp.o 2024-05-08T09:06:01.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:01 smithi194 ceph-mon[33679]: pgmap v4446: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 668 KiB/s wr, 42 op/s 2024-05-08T09:06:01.844 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/marvell/octeon_ep/built-in.a 2024-05-08T09:06:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:01 smithi070 ceph-mon[29591]: pgmap v4446: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 668 KiB/s wr, 42 op/s 2024-05-08T09:06:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:01 smithi172 ceph-mon[33377]: pgmap v4446: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 668 KiB/s wr, 42 op/s 2024-05-08T09:06:02.074 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/marvell/octeontx2/built-in.a 2024-05-08T09:06:02.546 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/marvell/prestera/built-in.a 2024-05-08T09:06:02.613 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/phy.o 2024-05-08T09:06:02.732 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/marvell/sky2.o 2024-05-08T09:06:03.381 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/rtc/rtc-mc146818-lib.o 2024-05-08T09:06:03.421 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/input-compat.o 2024-05-08T09:06:03.701 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/ohci-pci.o 2024-05-08T09:06:03.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:03 smithi194 ceph-mon[33679]: pgmap v4447: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 529 KiB/s wr, 29 op/s 2024-05-08T09:06:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:03 smithi070 ceph-mon[29591]: pgmap v4447: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 529 KiB/s wr, 29 op/s 2024-05-08T09:06:03.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:03 smithi172 ceph-mon[33377]: pgmap v4447: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 529 KiB/s wr, 29 op/s 2024-05-08T09:06:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:05 smithi070 ceph-mon[29591]: pgmap v4448: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2024-05-08T09:06:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:05 smithi172 ceph-mon[33377]: pgmap v4448: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2024-05-08T09:06:06.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:05 smithi194 ceph-mon[33679]: pgmap v4448: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 872 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2024-05-08T09:06:06.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:06 smithi070 ceph-mon[29591]: osdmap e355: 12 total, 12 up, 12 in 2024-05-08T09:06:06.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:06 smithi172 ceph-mon[33377]: osdmap e355: 12 total, 12 up, 12 in 2024-05-08T09:06:07.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:06 smithi194 ceph-mon[33679]: osdmap e355: 12 total, 12 up, 12 in 2024-05-08T09:06:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:07 smithi070 ceph-mon[29591]: pgmap v4450: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 751 KiB/s wr, 56 op/s 2024-05-08T09:06:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:07 smithi172 ceph-mon[33377]: pgmap v4450: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 751 KiB/s wr, 56 op/s 2024-05-08T09:06:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:07 smithi194 ceph-mon[33679]: pgmap v4450: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 751 KiB/s wr, 56 op/s 2024-05-08T09:06:09.540 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:09 smithi070 ceph-mon[29591]: pgmap v4451: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 751 KiB/s wr, 56 op/s 2024-05-08T09:06:09.814 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:09 smithi194 ceph-mon[33679]: pgmap v4451: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 751 KiB/s wr, 56 op/s 2024-05-08T09:06:09.925 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_requests.o 2024-05-08T09:06:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:09 smithi172 ceph-mon[33377]: pgmap v4451: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 751 KiB/s wr, 56 op/s 2024-05-08T09:06:10.451 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/class/built-in.a 2024-05-08T09:06:10.697 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/rtc/rtc-cmos.o 2024-05-08T09:06:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:11 smithi070 ceph-mon[29591]: pgmap v4452: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 831 KiB/s wr, 57 op/s 2024-05-08T09:06:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:11 smithi070 ceph-mon[29591]: osdmap e356: 12 total, 12 up, 12 in 2024-05-08T09:06:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:11 smithi172 ceph-mon[33377]: pgmap v4452: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 831 KiB/s wr, 57 op/s 2024-05-08T09:06:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:11 smithi172 ceph-mon[33377]: osdmap e356: 12 total, 12 up, 12 in 2024-05-08T09:06:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:11 smithi194 ceph-mon[33679]: pgmap v4452: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 831 KiB/s wr, 57 op/s 2024-05-08T09:06:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:11 smithi194 ceph-mon[33679]: osdmap e356: 12 total, 12 up, 12 in 2024-05-08T09:06:12.662 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/input-mt.o 2024-05-08T09:06:12.678 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/port.o 2024-05-08T09:06:13.391 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/uhci-hcd.o 2024-05-08T09:06:13.489 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/storage/scsiglue.o 2024-05-08T09:06:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:13 smithi070 ceph-mon[29591]: pgmap v4454: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 273 KiB/s wr, 14 op/s 2024-05-08T09:06:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:13 smithi172 ceph-mon[33377]: pgmap v4454: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 273 KiB/s wr, 14 op/s 2024-05-08T09:06:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:13 smithi194 ceph-mon[33679]: pgmap v4454: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 273 KiB/s wr, 14 op/s 2024-05-08T09:06:14.646 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/intel/e1000e/built-in.a 2024-05-08T09:06:15.725 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/intel/built-in.a 2024-05-08T09:06:15.882 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:15 smithi070 ceph-mon[29591]: pgmap v4455: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 870 KiB/s wr, 48 op/s 2024-05-08T09:06:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:15 smithi172 ceph-mon[33377]: pgmap v4455: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 870 KiB/s wr, 48 op/s 2024-05-08T09:06:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:15 smithi194 ceph-mon[33679]: pgmap v4455: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 870 KiB/s wr, 48 op/s 2024-05-08T09:06:17.337 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/marvell/built-in.a 2024-05-08T09:06:17.361 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/misc/built-in.a 2024-05-08T09:06:17.477 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/xhci.o 2024-05-08T09:06:17.582 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/mellanox/built-in.a 2024-05-08T09:06:17.620 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.2 2024-05-08T09:06:17.621 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:06:17.786 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/micrel/built-in.a 2024-05-08T09:06:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:17 smithi070 ceph-mon[29591]: pgmap v4456: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 769 KiB/s wr, 42 op/s 2024-05-08T09:06:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:17 smithi172 ceph-mon[33377]: pgmap v4456: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 769 KiB/s wr, 42 op/s 2024-05-08T09:06:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:17 smithi194 ceph-mon[33679]: pgmap v4456: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 769 KiB/s wr, 42 op/s 2024-05-08T09:06:18.085 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/microchip/built-in.a 2024-05-08T09:06:18.244 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:06:18.294 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/mscc/built-in.a 2024-05-08T09:06:18.509 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/myricom/built-in.a 2024-05-08T09:06:18.732 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/natsemi/built-in.a 2024-05-08T09:06:18.927 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/neterion/built-in.a 2024-05-08T09:06:19.147 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/netronome/built-in.a 2024-05-08T09:06:19.357 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/ni/built-in.a 2024-05-08T09:06:19.564 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/nvidia/forcedeth.o 2024-05-08T09:06:19.851 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:19 smithi070 ceph-mon[29591]: pgmap v4457: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 769 KiB/s wr, 42 op/s 2024-05-08T09:06:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:19 smithi172 ceph-mon[33377]: pgmap v4457: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 769 KiB/s wr, 42 op/s 2024-05-08T09:06:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:19 smithi194 ceph-mon[33679]: pgmap v4457: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 805 KiB/s rd, 769 KiB/s wr, 42 op/s 2024-05-08T09:06:20.549 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/rtc/built-in.a 2024-05-08T09:06:20.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.741+0000 7fd320e00700 1 -- 172.21.15.70:0/726308371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c075710 msgr2=0x7fd31c075af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:20.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.741+0000 7fd320e00700 1 --2- 172.21.15.70:0/726308371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c075710 0x7fd31c075af0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009990 tx=0x7fd30c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:06:20.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.741+0000 7fd320e00700 1 -- 172.21.15.70:0/726308371 shutdown_connections 2024-05-08T09:06:20.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.741+0000 7fd320e00700 1 --2- 172.21.15.70:0/726308371 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c114670 0x7fd31c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:20.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.741+0000 7fd320e00700 1 --2- 172.21.15.70:0/726308371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c075710 0x7fd31c075af0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:20.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.741+0000 7fd320e00700 1 --2- 172.21.15.70:0/726308371 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31c076030 0x7fd31c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:20.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.741+0000 7fd320e00700 1 -- 172.21.15.70:0/726308371 >> 172.21.15.70:0/726308371 conn(0x7fd31c07a690 msgr2=0x7fd31c07aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:06:20.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.742+0000 7fd320e00700 1 -- 172.21.15.70:0/726308371 shutdown_connections 2024-05-08T09:06:20.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.742+0000 7fd320e00700 1 -- 172.21.15.70:0/726308371 wait complete. 2024-05-08T09:06:20.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.744+0000 7fd320e00700 1 Processor -- start 2024-05-08T09:06:20.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.744+0000 7fd320e00700 1 -- start start 2024-05-08T09:06:20.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.744+0000 7fd320e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c075710 0x7fd31c1a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:20.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.744+0000 7fd320e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c076030 0x7fd31c1a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:20.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.745+0000 7fd320e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31c114670 0x7fd31c1a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:20.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.745+0000 7fd320e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c119c00 con 0x7fd31c075710 2024-05-08T09:06:20.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.745+0000 7fd320e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c119a80 con 0x7fd31c076030 2024-05-08T09:06:20.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.745+0000 7fd320e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c119d80 con 0x7fd31c114670 2024-05-08T09:06:20.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.745+0000 7fd319e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c075710 0x7fd31c1a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:20.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.745+0000 7fd319e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c075710 0x7fd31c1a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33058/0 (socket says 172.21.15.70:33058) 2024-05-08T09:06:20.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.745+0000 7fd319e00700 1 -- 172.21.15.70:0/796171367 learned_addr learned my addr 172.21.15.70:0/796171367 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:06:20.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.745+0000 7fd319400700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c076030 0x7fd31c1a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:20.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.746+0000 7fd31a800700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31c114670 0x7fd31c1a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:20.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.746+0000 7fd319400700 1 -- 172.21.15.70:0/796171367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31c114670 msgr2=0x7fd31c1a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:20.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.746+0000 7fd319400700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31c114670 0x7fd31c1a4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:20.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.746+0000 7fd319400700 1 -- 172.21.15.70:0/796171367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c075710 msgr2=0x7fd31c1a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:20.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.746+0000 7fd319400700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c075710 0x7fd31c1a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:20.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.746+0000 7fd319400700 1 -- 172.21.15.70:0/796171367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c1a51a0 con 0x7fd31c076030 2024-05-08T09:06:20.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.747+0000 7fd319400700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c076030 0x7fd31c1a06d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd30800d950 tx=0x7fd30800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:06:20.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.747+0000 7fd312a00700 1 -- 172.21.15.70:0/796171367 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308016070 con 0x7fd31c076030 2024-05-08T09:06:20.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.748+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c1a5490 con 0x7fd31c076030 2024-05-08T09:06:20.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.748+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c1acd10 con 0x7fd31c076030 2024-05-08T09:06:20.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.748+0000 7fd312a00700 1 -- 172.21.15.70:0/796171367 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd30800fd20 con 0x7fd31c076030 2024-05-08T09:06:20.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.748+0000 7fd312a00700 1 -- 172.21.15.70:0/796171367 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30800e3b0 con 0x7fd31c076030 2024-05-08T09:06:20.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.750+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2fc005330 con 0x7fd31c076030 2024-05-08T09:06:20.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.756+0000 7fd312a00700 1 -- 172.21.15.70:0/796171367 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd308019070 con 0x7fd31c076030 2024-05-08T09:06:20.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.758+0000 7fd312a00700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3000b2a70 0x7fd3000b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:20.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.758+0000 7fd312a00700 1 -- 172.21.15.70:0/796171367 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(356..356 src has 1..356) ==== 9583+0+0 (secure 0 0 0) 0x7fd3080e2760 con 0x7fd31c076030 2024-05-08T09:06:20.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.758+0000 7fd319e00700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3000b2a70 0x7fd3000b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:20.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.760+0000 7fd319e00700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3000b2a70 0x7fd3000b4f30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd30c006010 tx=0x7fd30c00b260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:06:20.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:20.773+0000 7fd312a00700 1 -- 172.21.15.70:0/796171367 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd3080a9d20 con 0x7fd31c076030 2024-05-08T09:06:21.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.229+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2fc005620 con 0x7fd31c076030 2024-05-08T09:06:21.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.231+0000 7fd312a00700 1 -- 172.21.15.70:0/796171367 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fd3080a9620 con 0x7fd31c076030 2024-05-08T09:06:21.231 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:06:21.231 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:06:21.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3000b2a70 msgr2=0x7fd3000b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3000b2a70 0x7fd3000b4f30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd30c006010 tx=0x7fd30c00b260 comp rx=0 tx=0).stop 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c076030 msgr2=0x7fd31c1a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c076030 0x7fd31c1a06d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd30800d950 tx=0x7fd30800dc60 comp rx=0 tx=0).stop 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 shutdown_connections 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd3000b2a70 0x7fd3000b4f30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31c114670 0x7fd31c1a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd31c075710 0x7fd31c1a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 --2- 172.21.15.70:0/796171367 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd31c076030 0x7fd31c1a06d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.234+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 >> 172.21.15.70:0/796171367 conn(0x7fd31c07a690 msgr2=0x7fd31c113600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.235+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 shutdown_connections 2024-05-08T09:06:21.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:21.235+0000 7fd320e00700 1 -- 172.21.15.70:0/796171367 wait complete. 2024-05-08T09:06:21.236 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:06:21.488 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/input-poller.o 2024-05-08T09:06:21.570 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_sysfs.o 2024-05-08T09:06:21.671 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/hcd-pci.o 2024-05-08T09:06:21.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:21 smithi070 ceph-mon[29591]: pgmap v4458: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-05-08T09:06:21.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:21 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/796171367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:06:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:21 smithi172 ceph-mon[33377]: pgmap v4458: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-05-08T09:06:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:21 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/796171367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:06:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:21 smithi194 ceph-mon[33679]: pgmap v4458: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 904 KiB/s rd, 1.0 MiB/s wr, 55 op/s 2024-05-08T09:06:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:21 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/796171367' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:06:22.164 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 85.2 --await-for 42.0' 2024-05-08T09:06:22.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 85.2 --await-for 42.0 2024-05-08T09:06:22.735 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:06:23.306 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/storage/protocol.o 2024-05-08T09:06:23.713 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gt_sysfs_pm.o 2024-05-08T09:06:23.828 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:23 smithi070 ceph-mon[29591]: pgmap v4459: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 928 KiB/s wr, 49 op/s 2024-05-08T09:06:23.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/i2c/algos/i2c-algo-bit.o 2024-05-08T09:06:23.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:23 smithi172 ceph-mon[33377]: pgmap v4459: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 928 KiB/s wr, 49 op/s 2024-05-08T09:06:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:23 smithi194 ceph-mon[33679]: pgmap v4459: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 807 KiB/s rd, 928 KiB/s wr, 49 op/s 2024-05-08T09:06:25.813 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:25 smithi070 ceph-mon[29591]: pgmap v4460: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-05-08T09:06:25.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:25 smithi172 ceph-mon[33377]: pgmap v4460: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-05-08T09:06:26.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:25 smithi194 ceph-mon[33679]: pgmap v4460: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 61 op/s 2024-05-08T09:06:26.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.438+0000 7f5c4b200700 1 -- 172.21.15.70:0/459498319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4c109920 msgr2=0x7f5c4c109da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:26.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.438+0000 7f5c4b200700 1 --2- 172.21.15.70:0/459498319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4c109920 0x7f5c4c109da0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009990 tx=0x7f5c38009ca0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.438+0000 7f5c4b200700 1 -- 172.21.15.70:0/459498319 shutdown_connections 2024-05-08T09:06:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.438+0000 7f5c4b200700 1 --2- 172.21.15.70:0/459498319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c10a2e0 0x7f5c4c116780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.438+0000 7f5c4b200700 1 --2- 172.21.15.70:0/459498319 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c4c10e7f0 0x7f5c4c10ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.438+0000 7f5c4b200700 1 --2- 172.21.15.70:0/459498319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4c109920 0x7f5c4c109da0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.438+0000 7f5c4b200700 1 -- 172.21.15.70:0/459498319 >> 172.21.15.70:0/459498319 conn(0x7f5c4c079170 msgr2=0x7f5c4c07b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:06:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.438+0000 7f5c4b200700 1 -- 172.21.15.70:0/459498319 shutdown_connections 2024-05-08T09:06:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.438+0000 7f5c4b200700 1 -- 172.21.15.70:0/459498319 wait complete. 2024-05-08T09:06:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.440+0000 7f5c4b200700 1 Processor -- start 2024-05-08T09:06:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.440+0000 7f5c4b200700 1 -- start start 2024-05-08T09:06:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c4b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c4c109920 0x7f5c4c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c4b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c10a2e0 0x7f5c4c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c4b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4c10e7f0 0x7f5c4c1a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c4b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c119960 con 0x7f5c4c10e7f0 2024-05-08T09:06:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c4b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1197e0 con 0x7f5c4c109920 2024-05-08T09:06:26.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c4b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c119ae0 con 0x7f5c4c10a2e0 2024-05-08T09:06:26.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c4c109920 0x7f5c4c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c4a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4c10e7f0 0x7f5c4c1a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c4c109920 0x7f5c4c19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:46176/0 (socket says 172.21.15.70:46176) 2024-05-08T09:06:26.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c49e00700 1 -- 172.21.15.70:0/1760975110 learned_addr learned my addr 172.21.15.70:0/1760975110 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.441+0000 7f5c49400700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c10a2e0 0x7f5c4c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.442+0000 7f5c49e00700 1 -- 172.21.15.70:0/1760975110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c10a2e0 msgr2=0x7f5c4c1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.442+0000 7f5c49e00700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c10a2e0 0x7f5c4c1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.442+0000 7f5c49e00700 1 -- 172.21.15.70:0/1760975110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4c10e7f0 msgr2=0x7f5c4c1a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.442+0000 7f5c49e00700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4c10e7f0 0x7f5c4c1a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.442+0000 7f5c49e00700 1 -- 172.21.15.70:0/1760975110 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c1a4de0 con 0x7f5c4c109920 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.442+0000 7f5c49e00700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c4c109920 0x7f5c4c19fdd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00d950 tx=0x7f5c3c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.443+0000 7f5c42a00700 1 -- 172.21.15.70:0/1760975110 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c016070 con 0x7f5c4c109920 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.443+0000 7f5c42a00700 1 -- 172.21.15.70:0/1760975110 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c3c009dd0 con 0x7f5c4c109920 2024-05-08T09:06:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.443+0000 7f5c42a00700 1 -- 172.21.15.70:0/1760975110 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00f3c0 con 0x7f5c4c109920 2024-05-08T09:06:26.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.443+0000 7f5c4b200700 1 -- 172.21.15.70:0/1760975110 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c1a50d0 con 0x7f5c4c109920 2024-05-08T09:06:26.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.443+0000 7f5c4b200700 1 -- 172.21.15.70:0/1760975110 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c4c1ac950 con 0x7f5c4c109920 2024-05-08T09:06:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.448+0000 7f5c42a00700 1 -- 172.21.15.70:0/1760975110 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5c3c019070 con 0x7f5c4c109920 2024-05-08T09:06:26.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.450+0000 7f5c42a00700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5c300b2b20 0x7f5c300b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.452+0000 7f5c42a00700 1 -- 172.21.15.70:0/1760975110 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(356..356 src has 1..356) ==== 9583+0+0 (secure 0 0 0) 0x7f5c3c0e2570 con 0x7f5c4c109920 2024-05-08T09:06:26.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.452+0000 7f5c49400700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5c300b2b20 0x7f5c300b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.453+0000 7f5c49400700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5c300b2b20 0x7f5c300b4fe0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5c38005850 tx=0x7f5c3801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:06:26.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.463+0000 7f5c5b4bab80 1 Processor -- start 2024-05-08T09:06:26.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.463+0000 7f5c5b4bab80 1 -- start start 2024-05-08T09:06:26.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.463+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.463+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf86810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.463+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf87290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.463+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cb7bed8bb0 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.463+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cb7be768f0 con 0x55cb7bf86e30 2024-05-08T09:06:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.463+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cb7bed4b70 con 0x55cb7bf8cc00 2024-05-08T09:06:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.464+0000 7f5c4a800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf87290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.464+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.464+0000 7f5c49400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf86810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.464+0000 7f5c49400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf86810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:34192/0 (socket says 172.21.15.70:34192) 2024-05-08T09:06:26.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.464+0000 7f5c49400700 1 -- 172.21.15.70:0/1690970076 learned_addr learned my addr 172.21.15.70:0/1690970076 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:06:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.465+0000 7f5c49e00700 1 -- 172.21.15.70:0/1690970076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 msgr2=0x55cb7bf86810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:06:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.465+0000 7f5c49e00700 1 --2- 172.21.15.70:0/1690970076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf86810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.465+0000 7f5c49e00700 1 -- 172.21.15.70:0/1690970076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 msgr2=0x55cb7bf87290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:06:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.465+0000 7f5c49e00700 1 --2- 172.21.15.70:0/1690970076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf87290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.465+0000 7f5c49e00700 1 -- 172.21.15.70:0/1690970076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7be25a60 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.465+0000 7f5c49400700 1 --2- 172.21.15.70:0/1690970076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf86810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:06:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.466+0000 7f5c49e00700 1 --2- 172.21.15.70:0/1690970076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8c6c0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0df8e0 tx=0x7f5c3c0a9b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3e7c4dd7af9f10 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:06:26.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.467+0000 7f5c37400700 1 -- 172.21.15.70:0/1690970076 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c020070 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.467+0000 7f5c37400700 1 -- 172.21.15.70:0/1690970076 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c3c0ad820 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.467+0000 7f5c37400700 1 -- 172.21.15.70:0/1690970076 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0b1e40 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.468+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/1690970076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 msgr2=0x55cb7bf8c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.468+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/1690970076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8c6c0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0df8e0 tx=0x7f5c3c0a9b70 comp rx=0 tx=0).stop 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.469+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/1690970076 shutdown_connections 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.469+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/1690970076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf87290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.469+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/1690970076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8c6c0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.469+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/1690970076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf86810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.469+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/1690970076 >> 172.21.15.70:0/1690970076 conn(0x55cb7befe860 msgr2=0x55cb7bf81370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.469+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/1690970076 shutdown_connections 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.469+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/1690970076 wait complete. 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.470+0000 7f5c5b4bab80 1 -- start start 2024-05-08T09:06:26.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.470+0000 7f5c5b4bab80 1 Processor -- start 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.471+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf86e30 0x55cb7bf92aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.472+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.472+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf90380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.472+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cb7bf93720 con 0x55cb7bf86e30 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.472+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cb7be3ecb0 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.472+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cb7bf938a0 con 0x55cb7bf8cc00 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.472+0000 7f5c5b4bab80 10 client.0 _ll_register_callbacks cb 0x55cb7be7fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.472+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf86e30 0x55cb7bf92aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.473+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf86e30 0x55cb7bf92aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33108/0 (socket says 172.21.15.70:33108) 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.473+0000 7f5c49e00700 1 -- 172.21.15.70:0/3359755113 learned_addr learned my addr 172.21.15.70:0/3359755113 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.473+0000 7f5c49400700 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.473+0000 7f5c4a800700 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf90380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.474+0000 7f5c4a800700 1 -- 172.21.15.70:0/3359755113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf8c2e0 msgr2=0x55cb7bf8fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:06:26.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.474+0000 7f5c4a800700 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.474+0000 7f5c4a800700 1 -- 172.21.15.70:0/3359755113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf86e30 msgr2=0x55cb7bf92aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:06:26.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.474+0000 7f5c4a800700 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf86e30 0x55cb7bf92aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.474+0000 7f5c4a800700 1 -- 172.21.15.70:0/3359755113 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb7be9e5b0 con 0x55cb7bf8cc00 2024-05-08T09:06:26.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.474+0000 7f5c49e00700 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf86e30 0x55cb7bf92aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:06:26.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.474+0000 7f5c49400700 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.475+0000 7f5c4a800700 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf90380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009fb0 tx=0x7f5c44004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6b847943de8c91b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.475+0000 7f5c2be00700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.475+0000 7f5c2be00700 1 -- 172.21.15.70:0/3359755113 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c4401a070 con 0x55cb7bf8cc00 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.476+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3359755113 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c3c0ad820 con 0x55cb7bf8cc00 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.476+0000 7f5c2be00700 1 -- 172.21.15.70:0/3359755113 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(356..356 src has 1..356) ==== 9583+0+0 (secure 0 0 0) 0x7f5c44004db0 con 0x55cb7bf8cc00 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.476+0000 7f5c2be00700 1 -- 172.21.15.70:0/3359755113 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f5c44025050 con 0x55cb7bf8cc00 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.476+0000 7f5c5b4bab80 10 client.27799 fetch_fsmap learned FSMap version 42 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.476+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3359755113 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55cb7bf9e180 con 0x55cb7bf8cc00 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.477+0000 7f5c2be00700 1 -- 172.21.15.70:0/3359755113 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c3c0ad820 con 0x55cb7bf8cc00 2024-05-08T09:06:26.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.477+0000 7f5c2be00700 1 -- 172.21.15.70:0/3359755113 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f5c440164c0 con 0x55cb7bf8cc00 2024-05-08T09:06:26.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.479+0000 7f5c5b4bab80 10 client.27799 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:06:26.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.479+0000 7f5c5b4bab80 10 client.27799 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:06:26.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.479+0000 7f5c5b4bab80 20 client.27799 populate_metadata read hostname 'smithi070' 2024-05-08T09:06:26.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.479+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cb7bfa0710 0x55cb7bfa2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.479+0000 7f5c5b4bab80 4 client.27799 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:06:26.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.479+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3359755113 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb7bf532d0 con 0x55cb7bfa0710 2024-05-08T09:06:26.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.479+0000 7f5c49e00700 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cb7bfa0710 0x55cb7bfa2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.480+0000 7f5c2be00700 10 client.27799 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:06:26.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.480+0000 7f5c49e00700 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cb7bfa0710 0x55cb7bfa2b00 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9cc1440235da7eb server_cookie=3a4f51577191e1b in_seq=0 out_seq=0 2024-05-08T09:06:26.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.482+0000 7f5c2be00700 1 -- 172.21.15.70:0/3359755113 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cb7bf532d0 con 0x55cb7bfa0710 2024-05-08T09:06:26.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.482+0000 7f5c2be00700 10 client.27799 handle_command_reply: tid=0 2024-05-08T09:06:26.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.482+0000 7f5c5b4bab80 1 client.27799 shutdown 2024-05-08T09:06:26.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.483+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3359755113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 msgr2=0x55cb7bf90380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:26.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.483+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf90380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009fb0 tx=0x7f5c44004040 comp rx=0 tx=0).stop 2024-05-08T09:06:26.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.483+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3359755113 shutdown_connections 2024-05-08T09:06:26.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.483+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cb7bfa0710 0x55cb7bfa2b00 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.483+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf90380 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.483+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf86e30 0x55cb7bf92aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.483+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3359755113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf8fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.483+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3359755113 >> 172.21.15.70:0/3359755113 conn(0x55cb7befe860 msgr2=0x55cb7bf85800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:06:26.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.483+0000 7f5c2be00700 0 client.27799 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:06:26.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.484+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3359755113 shutdown_connections 2024-05-08T09:06:26.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.484+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3359755113 wait complete. 2024-05-08T09:06:26.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.484+0000 7f5c5b4bab80 20 client.27799 trim_cache size 0 max 16384 2024-05-08T09:06:26.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.515+0000 7f5c5b4bab80 1 Processor -- start 2024-05-08T09:06:26.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.515+0000 7f5c5b4bab80 1 -- start start 2024-05-08T09:06:26.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.515+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf9c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.515+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bfa8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.515+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bfa88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.515+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1b82e0 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.515+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1b5b70 con 0x55cb7bf86e30 2024-05-08T09:06:26.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.515+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1b39e0 con 0x55cb7bf8cc00 2024-05-08T09:06:26.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.516+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf9c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.516+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf9c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:46204/0 (socket says 172.21.15.70:46204) 2024-05-08T09:06:26.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.516+0000 7f5c49e00700 1 -- 172.21.15.70:0/3505453491 learned_addr learned my addr 172.21.15.70:0/3505453491 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:06:26.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.516+0000 7f5c49400700 1 --2- 172.21.15.70:0/3505453491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bfa8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.516+0000 7f5c4a800700 1 --2- 172.21.15.70:0/3505453491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bfa88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.516+0000 7f5c49e00700 1 -- 172.21.15.70:0/3505453491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 msgr2=0x55cb7bfa88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:06:26.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.516+0000 7f5c49e00700 1 --2- 172.21.15.70:0/3505453491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bfa88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.517+0000 7f5c49e00700 1 -- 172.21.15.70:0/3505453491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 msgr2=0x55cb7bfa8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:06:26.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.517+0000 7f5c49e00700 1 --2- 172.21.15.70:0/3505453491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bfa8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.517+0000 7f5c49e00700 1 -- 172.21.15.70:0/3505453491 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb7bfa3160 con 0x55cb7bf86e30 2024-05-08T09:06:26.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.517+0000 7f5c49e00700 1 --2- 172.21.15.70:0/3505453491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf9c7b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0a9400 tx=0x7f5c3c0a9ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53bef928eeb55d5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.518+0000 7f5c36a00700 1 -- 172.21.15.70:0/3505453491 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c020040 con 0x55cb7bf86e30 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.518+0000 7f5c36a00700 1 -- 172.21.15.70:0/3505453491 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c3c0c3070 con 0x55cb7bf86e30 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.518+0000 7f5c36a00700 1 -- 172.21.15.70:0/3505453491 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0b1e40 con 0x55cb7bf86e30 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.519+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3505453491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 msgr2=0x55cb7bf9c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.519+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3505453491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf9c7b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0a9400 tx=0x7f5c3c0a9ce0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.519+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3505453491 shutdown_connections 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.519+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3505453491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bfa88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.519+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3505453491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf9c7b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.519+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/3505453491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bfa8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.519+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3505453491 >> 172.21.15.70:0/3505453491 conn(0x55cb7befe860 msgr2=0x55cb7bf8e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.519+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3505453491 shutdown_connections 2024-05-08T09:06:26.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.519+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/3505453491 wait complete. 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.520+0000 7f5c5b4bab80 1 -- start start 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.520+0000 7f5c5b4bab80 1 Processor -- start 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.521+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf95710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.521+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf95c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.521+0000 7f5c5b4bab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf96190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.521+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1b4030 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.521+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1b54a0 con 0x55cb7bf86e30 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.521+0000 7f5c5b4bab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5c4c1b4700 con 0x55cb7bf8cc00 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.521+0000 7f5c5b4bab80 10 client.0 _ll_register_callbacks cb 0x55cb7be7fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.521+0000 7f5c49400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf95c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.521+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf95710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.522+0000 7f5c49e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf95710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:46206/0 (socket says 172.21.15.70:46206) 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.522+0000 7f5c49e00700 1 -- 172.21.15.70:0/4140959442 learned_addr learned my addr 172.21.15.70:0/4140959442 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:06:26.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.522+0000 7f5c4a800700 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf96190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.522+0000 7f5c49400700 1 -- 172.21.15.70:0/4140959442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 msgr2=0x55cb7bf96190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.522+0000 7f5c49400700 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf96190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.522+0000 7f5c49400700 1 -- 172.21.15.70:0/4140959442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 msgr2=0x55cb7bf95710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.522+0000 7f5c49400700 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf95710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.522+0000 7f5c49400700 1 -- 172.21.15.70:0/4140959442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb7bf79740 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.523+0000 7f5c49400700 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf95c50 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800b5c0 tx=0x7f5c38009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80fdbe95221de95 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.523+0000 7f5c2be00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.524+0000 7f5c2be00700 1 -- 172.21.15.70:0/4140959442 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38034070 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.524+0000 7f5c2be00700 1 -- 172.21.15.70:0/4140959442 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(356..356 src has 1..356) ==== 9583+0+0 (secure 0 0 0) 0x7f5c38030630 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.524+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/4140959442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c3c0c3070 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.524+0000 7f5c2be00700 1 -- 172.21.15.70:0/4140959442 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f5c38040050 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.524+0000 7f5c5b4bab80 10 client.19062 fetch_fsmap learned FSMap version 42 2024-05-08T09:06:26.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.524+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/4140959442 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55cb7c00c0e0 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.525+0000 7f5c2be00700 1 -- 172.21.15.70:0/4140959442 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c3c0c3070 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.525+0000 7f5c2be00700 1 -- 172.21.15.70:0/4140959442 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f5c38023a00 con 0x55cb7bf8c2e0 2024-05-08T09:06:26.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.525+0000 7f5c5b4bab80 10 client.19062 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:06:26.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.525+0000 7f5c5b4bab80 10 client.19062 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:06:26.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.525+0000 7f5c5b4bab80 20 client.19062 populate_metadata read hostname 'smithi070' 2024-05-08T09:06:26.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.525+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cb7c00c890 0x55cb7c00ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:06:26.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.525+0000 7f5c5b4bab80 4 client.19062 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.2, "await_for": 42.0}] 2024-05-08T09:06:26.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.525+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/4140959442 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 85.2, "await_for": 42.0}) -- 0x55cb7bee6590 con 0x55cb7c00c890 2024-05-08T09:06:26.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.526+0000 7f5c49e00700 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cb7c00c890 0x55cb7c00ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:06:26.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.527+0000 7f5c49e00700 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cb7c00c890 0x55cb7c00ecb0 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab98a2e4b593103 server_cookie=60f97a35b1a85fae in_seq=0 out_seq=0 2024-05-08T09:06:26.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:26.527+0000 7f5c2be00700 10 client.19062 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:06:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:27 smithi070 ceph-mon[29591]: pgmap v4461: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 665 KiB/s wr, 36 op/s 2024-05-08T09:06:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:27 smithi172 ceph-mon[33377]: pgmap v4461: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 665 KiB/s wr, 36 op/s 2024-05-08T09:06:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:27 smithi194 ceph-mon[33679]: pgmap v4461: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 665 KiB/s wr, 36 op/s 2024-05-08T09:06:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:29 smithi070 ceph-mon[29591]: pgmap v4462: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 665 KiB/s wr, 36 op/s 2024-05-08T09:06:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:29 smithi172 ceph-mon[33377]: pgmap v4462: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 665 KiB/s wr, 36 op/s 2024-05-08T09:06:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:29 smithi194 ceph-mon[33679]: pgmap v4462: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 665 KiB/s wr, 36 op/s 2024-05-08T09:06:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:31 smithi070 ceph-mon[29591]: pgmap v4463: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 970 KiB/s wr, 43 op/s 2024-05-08T09:06:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:31 smithi172 ceph-mon[33377]: pgmap v4463: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 970 KiB/s wr, 43 op/s 2024-05-08T09:06:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:31 smithi194 ceph-mon[33679]: pgmap v4463: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 970 KiB/s wr, 43 op/s 2024-05-08T09:06:33.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:33 smithi070 ceph-mon[29591]: pgmap v4464: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 563 KiB/s wr, 23 op/s 2024-05-08T09:06:33.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:33 smithi172 ceph-mon[33377]: pgmap v4464: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 563 KiB/s wr, 23 op/s 2024-05-08T09:06:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:33 smithi194 ceph-mon[33679]: pgmap v4464: 129 pgs: 129 active+clean; 2.0 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 563 KiB/s wr, 23 op/s 2024-05-08T09:06:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:35 smithi070 ceph-mon[29591]: pgmap v4465: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 619 KiB/s wr, 28 op/s 2024-05-08T09:06:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:35 smithi172 ceph-mon[33377]: pgmap v4465: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 619 KiB/s wr, 28 op/s 2024-05-08T09:06:36.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:35 smithi194 ceph-mon[33679]: pgmap v4465: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 804 KiB/s rd, 619 KiB/s wr, 28 op/s 2024-05-08T09:06:37.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:37 smithi070 ceph-mon[29591]: pgmap v4466: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 361 KiB/s wr, 12 op/s 2024-05-08T09:06:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:37 smithi172 ceph-mon[33377]: pgmap v4466: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 361 KiB/s wr, 12 op/s 2024-05-08T09:06:38.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:37 smithi194 ceph-mon[33679]: pgmap v4466: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 361 KiB/s wr, 12 op/s 2024-05-08T09:06:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:39 smithi070 ceph-mon[29591]: pgmap v4467: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 361 KiB/s wr, 12 op/s 2024-05-08T09:06:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:39 smithi172 ceph-mon[33377]: pgmap v4467: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 361 KiB/s wr, 12 op/s 2024-05-08T09:06:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:39 smithi194 ceph-mon[33679]: pgmap v4467: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 361 KiB/s wr, 12 op/s 2024-05-08T09:06:41.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:41 smithi172 ceph-mon[33377]: pgmap v4468: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 372 KiB/s wr, 16 op/s 2024-05-08T09:06:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:41 smithi194 ceph-mon[33679]: pgmap v4468: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 372 KiB/s wr, 16 op/s 2024-05-08T09:06:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:41 smithi070 ceph-mon[29591]: pgmap v4468: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 372 KiB/s wr, 16 op/s 2024-05-08T09:06:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:43 smithi172 ceph-mon[33377]: pgmap v4469: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 67 KiB/s wr, 8 op/s 2024-05-08T09:06:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:43 smithi194 ceph-mon[33679]: pgmap v4469: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 67 KiB/s wr, 8 op/s 2024-05-08T09:06:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:43 smithi070 ceph-mon[29591]: pgmap v4469: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 67 KiB/s wr, 8 op/s 2024-05-08T09:06:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:45 smithi172 ceph-mon[33377]: pgmap v4470: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 185 KiB/s wr, 12 op/s 2024-05-08T09:06:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:06:46.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:45 smithi194 ceph-mon[33679]: pgmap v4470: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 185 KiB/s wr, 12 op/s 2024-05-08T09:06:46.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:06:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:45 smithi070 ceph-mon[29591]: pgmap v4470: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 185 KiB/s wr, 12 op/s 2024-05-08T09:06:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:06:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:47 smithi172 ceph-mon[33377]: pgmap v4471: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T09:06:47.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:06:47.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:06:47.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:06:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:47 smithi194 ceph-mon[33679]: pgmap v4471: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T09:06:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:06:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:06:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:06:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:47 smithi070 ceph-mon[29591]: pgmap v4471: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T09:06:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:06:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:06:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:06:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:49 smithi172 ceph-mon[33377]: pgmap v4472: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T09:06:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:49 smithi194 ceph-mon[33679]: pgmap v4472: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T09:06:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:49 smithi070 ceph-mon[29591]: pgmap v4472: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T09:06:50.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.188+0000 7f5c2be00700 1 -- 172.21.15.70:0/4140959442 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55cb7bee6590 con 0x55cb7c00c890 2024-05-08T09:06:50.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.188+0000 7f5c2be00700 10 client.19062 handle_command_reply: tid=0 2024-05-08T09:06:50.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.188+0000 7f5c5b4bab80 1 client.19062 shutdown 2024-05-08T09:06:50.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.189+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/4140959442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 msgr2=0x55cb7bf95c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:50.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.189+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf95c50 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f5c3800b5c0 tx=0x7f5c38009ca0 comp rx=0 tx=0).stop 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.189+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/4140959442 shutdown_connections 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.189+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cb7c00c890 0x55cb7c00ecb0 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.189+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cb7bf8cc00 0x55cb7bf96190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.189+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cb7bf86e30 0x55cb7bf95710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.189+0000 7f5c5b4bab80 1 --2- 172.21.15.70:0/4140959442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb7bf8c2e0 0x55cb7bf95c50 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.189+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/4140959442 >> 172.21.15.70:0/4140959442 conn(0x55cb7befe860 msgr2=0x55cb7bf8af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.189+0000 7f5c2be00700 0 client.19062 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.190+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/4140959442 shutdown_connections 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.190+0000 7f5c5b4bab80 1 -- 172.21.15.70:0/4140959442 wait complete. 2024-05-08T09:06:50.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.190+0000 7f5c5b4bab80 20 client.19062 trim_cache size 0 max 16384 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 310, 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "ba3a2590": { 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 310, 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:06:50.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.2, 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:06:50.193 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:06:50.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 -- 172.21.15.70:0/1760975110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5c300b2b20 msgr2=0x7f5c300b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:50.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5c300b2b20 0x7f5c300b4fe0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f5c38005850 tx=0x7f5c3801a040 comp rx=0 tx=0).stop 2024-05-08T09:06:50.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 -- 172.21.15.70:0/1760975110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c4c109920 msgr2=0x7f5c4c19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:06:50.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c4c109920 0x7f5c4c19fdd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00d950 tx=0x7f5c3c00dc60 comp rx=0 tx=0).stop 2024-05-08T09:06:50.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 -- 172.21.15.70:0/1760975110 shutdown_connections 2024-05-08T09:06:50.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5c300b2b20 0x7f5c300b4fe0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:50.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5c4c10e7f0 0x7f5c4c1a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:50.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5c4c109920 0x7f5c4c19fdd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:50.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 --2- 172.21.15.70:0/1760975110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c4c10a2e0 0x7f5c4c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:06:50.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 -- 172.21.15.70:0/1760975110 >> 172.21.15.70:0/1760975110 conn(0x7f5c4c079170 msgr2=0x7f5c4c0798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:06:50.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.192+0000 7f5c4b200700 1 -- 172.21.15.70:0/1760975110 shutdown_connections 2024-05-08T09:06:50.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:06:50.193+0000 7f5c4b200700 1 -- 172.21.15.70:0/1760975110 wait complete. 2024-05-08T09:06:51.259 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ba3a2590', quiesce took 33.6 seconds. Will release after: 25.2 2024-05-08T09:06:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:51 smithi172 ceph-mon[33377]: pgmap v4473: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T09:06:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:51 smithi194 ceph-mon[33679]: pgmap v4473: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T09:06:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:51 smithi070 ceph-mon[29591]: pgmap v4473: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T09:06:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:53 smithi172 ceph-mon[33377]: pgmap v4474: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 165 KiB/s wr, 6 op/s 2024-05-08T09:06:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:53 smithi194 ceph-mon[33679]: pgmap v4474: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 165 KiB/s wr, 6 op/s 2024-05-08T09:06:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:53 smithi070 ceph-mon[29591]: pgmap v4474: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 165 KiB/s wr, 6 op/s 2024-05-08T09:06:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:55 smithi194 ceph-mon[33679]: pgmap v4475: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 239 KiB/s wr, 10 op/s 2024-05-08T09:06:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:55 smithi070 ceph-mon[29591]: pgmap v4475: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 239 KiB/s wr, 10 op/s 2024-05-08T09:06:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:55 smithi172 ceph-mon[33377]: pgmap v4475: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 239 KiB/s wr, 10 op/s 2024-05-08T09:06:57.982 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:57 smithi172 ceph-mon[33377]: pgmap v4476: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2024-05-08T09:06:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:57 smithi194 ceph-mon[33679]: pgmap v4476: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2024-05-08T09:06:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:57 smithi070 ceph-mon[29591]: pgmap v4476: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2024-05-08T09:06:59.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:06:58 smithi194 ceph-mon[33679]: pgmap v4477: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2024-05-08T09:06:59.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:06:58 smithi070 ceph-mon[29591]: pgmap v4477: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2024-05-08T09:06:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:06:58 smithi172 ceph-mon[33377]: pgmap v4477: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 121 KiB/s wr, 6 op/s 2024-05-08T09:07:01.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:01 smithi194 ceph-mon[33679]: pgmap v4478: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 10 op/s 2024-05-08T09:07:01.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:01 smithi070 ceph-mon[29591]: pgmap v4478: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 10 op/s 2024-05-08T09:07:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:01 smithi172 ceph-mon[33377]: pgmap v4478: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 185 KiB/s wr, 10 op/s 2024-05-08T09:07:03.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:03 smithi070 ceph-mon[29591]: pgmap v4479: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 7 op/s 2024-05-08T09:07:03.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:03 smithi194 ceph-mon[33679]: pgmap v4479: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 7 op/s 2024-05-08T09:07:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:03 smithi172 ceph-mon[33377]: pgmap v4479: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 7 op/s 2024-05-08T09:07:05.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:05 smithi194 ceph-mon[33679]: pgmap v4480: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 184 KiB/s wr, 27 op/s 2024-05-08T09:07:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:05 smithi070 ceph-mon[29591]: pgmap v4480: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 184 KiB/s wr, 27 op/s 2024-05-08T09:07:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:05 smithi172 ceph-mon[33377]: pgmap v4480: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 184 KiB/s wr, 27 op/s 2024-05-08T09:07:07.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:07 smithi194 ceph-mon[33679]: pgmap v4481: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 109 KiB/s wr, 22 op/s 2024-05-08T09:07:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:07 smithi070 ceph-mon[29591]: pgmap v4481: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 109 KiB/s wr, 22 op/s 2024-05-08T09:07:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:07 smithi172 ceph-mon[33377]: pgmap v4481: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 109 KiB/s wr, 22 op/s 2024-05-08T09:07:08.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:08 smithi194 ceph-mon[33679]: osdmap e357: 12 total, 12 up, 12 in 2024-05-08T09:07:08.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:08 smithi070 ceph-mon[29591]: osdmap e357: 12 total, 12 up, 12 in 2024-05-08T09:07:08.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:08 smithi172 ceph-mon[33377]: osdmap e357: 12 total, 12 up, 12 in 2024-05-08T09:07:09.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:09 smithi194 ceph-mon[33679]: pgmap v4483: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 131 KiB/s wr, 27 op/s 2024-05-08T09:07:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:09 smithi070 ceph-mon[29591]: pgmap v4483: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 131 KiB/s wr, 27 op/s 2024-05-08T09:07:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:09 smithi172 ceph-mon[33377]: pgmap v4483: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 131 KiB/s wr, 27 op/s 2024-05-08T09:07:11.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:11 smithi194 ceph-mon[33679]: pgmap v4484: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 89 KiB/s wr, 32 op/s 2024-05-08T09:07:11.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:11 smithi194 ceph-mon[33679]: osdmap e358: 12 total, 12 up, 12 in 2024-05-08T09:07:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:11 smithi070 ceph-mon[29591]: pgmap v4484: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 89 KiB/s wr, 32 op/s 2024-05-08T09:07:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:11 smithi070 ceph-mon[29591]: osdmap e358: 12 total, 12 up, 12 in 2024-05-08T09:07:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:11 smithi172 ceph-mon[33377]: pgmap v4484: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 89 KiB/s wr, 32 op/s 2024-05-08T09:07:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:11 smithi172 ceph-mon[33377]: osdmap e358: 12 total, 12 up, 12 in 2024-05-08T09:07:13.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:13 smithi194 ceph-mon[33679]: pgmap v4486: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-05-08T09:07:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:13 smithi070 ceph-mon[29591]: pgmap v4486: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-05-08T09:07:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:13 smithi172 ceph-mon[33377]: pgmap v4486: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 KiB/s wr, 11 op/s 2024-05-08T09:07:15.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:15 smithi194 ceph-mon[33679]: pgmap v4487: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-05-08T09:07:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:15 smithi070 ceph-mon[29591]: pgmap v4487: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-05-08T09:07:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:15 smithi172 ceph-mon[33377]: pgmap v4487: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 15 op/s 2024-05-08T09:07:16.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:07:16.915 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:07:17.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:17 smithi194 ceph-mon[33679]: pgmap v4488: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-05-08T09:07:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:17 smithi070 ceph-mon[29591]: pgmap v4488: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-05-08T09:07:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:17 smithi172 ceph-mon[33377]: pgmap v4488: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 14 op/s 2024-05-08T09:07:19.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.368+0000 7fb52b200700 1 -- 172.21.15.70:0/689126003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c105f90 msgr2=0x7fb52c1124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:19.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.368+0000 7fb52b200700 1 --2- 172.21.15.70:0/689126003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c105f90 0x7fb52c1124a0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fb52400b0a0 tx=0x7fb52400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.368+0000 7fb52b200700 1 -- 172.21.15.70:0/689126003 shutdown_connections 2024-05-08T09:07:19.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.368+0000 7fb52b200700 1 --2- 172.21.15.70:0/689126003 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c105f90 0x7fb52c1124a0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.368+0000 7fb52b200700 1 --2- 172.21.15.70:0/689126003 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52c10b660 0x7fb52c10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.368+0000 7fb52b200700 1 --2- 172.21.15.70:0/689126003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb52c1055d0 0x7fb52c105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.368+0000 7fb52b200700 1 -- 172.21.15.70:0/689126003 >> 172.21.15.70:0/689126003 conn(0x7fb52c1010c0 msgr2=0x7fb52c1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:07:19.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.368+0000 7fb52b200700 1 -- 172.21.15.70:0/689126003 shutdown_connections 2024-05-08T09:07:19.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.368+0000 7fb52b200700 1 -- 172.21.15.70:0/689126003 wait complete. 2024-05-08T09:07:19.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.369+0000 7fb52b200700 1 Processor -- start 2024-05-08T09:07:19.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.369+0000 7fb52b200700 1 -- start start 2024-05-08T09:07:19.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb52b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52c1055d0 0x7fb52c1a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb52b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb52c105f90 0x7fb52c1a1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb52b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c10b660 0x7fb52c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb52b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c1156d0 con 0x7fb52c10b660 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb52b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c115550 con 0x7fb52c1055d0 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb52b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb52c115850 con 0x7fb52c105f90 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb52a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c10b660 0x7fb52c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb52a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c10b660 0x7fb52c19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41112/0 (socket says 172.21.15.70:41112) 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb52a800700 1 -- 172.21.15.70:0/2567768978 learned_addr learned my addr 172.21.15.70:0/2567768978 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb529400700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb52c105f90 0x7fb52c1a1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.370+0000 7fb529e00700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52c1055d0 0x7fb52c1a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb52a800700 1 -- 172.21.15.70:0/2567768978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb52c105f90 msgr2=0x7fb52c1a1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb52a800700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb52c105f90 0x7fb52c1a1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb52a800700 1 -- 172.21.15.70:0/2567768978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52c1055d0 msgr2=0x7fb52c1a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:19.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb52a800700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52c1055d0 0x7fb52c1a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb52a800700 1 -- 172.21.15.70:0/2567768978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c19c0b0 con 0x7fb52c10b660 2024-05-08T09:07:19.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb52a800700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c10b660 0x7fb52c19b950 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb524004dc0 tx=0x7fb524004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:07:19.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb522a00700 1 -- 172.21.15.70:0/2567768978 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524021020 con 0x7fb52c10b660 2024-05-08T09:07:19.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb522a00700 1 -- 172.21.15.70:0/2567768978 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb524007cf0 con 0x7fb52c10b660 2024-05-08T09:07:19.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb52c19c340 con 0x7fb52c10b660 2024-05-08T09:07:19.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb522a00700 1 -- 172.21.15.70:0/2567768978 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb524005370 con 0x7fb52c10b660 2024-05-08T09:07:19.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.371+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb52c1a8610 con 0x7fb52c10b660 2024-05-08T09:07:19.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.373+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb52c06a190 con 0x7fb52c10b660 2024-05-08T09:07:19.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.375+0000 7fb522a00700 1 -- 172.21.15.70:0/2567768978 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb524024020 con 0x7fb52c10b660 2024-05-08T09:07:19.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.376+0000 7fb522a00700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb5100b29f0 0x7fb5100b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:19.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.376+0000 7fb522a00700 1 -- 172.21.15.70:0/2567768978 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(358..358 src has 1..358) ==== 9583+0+0 (secure 0 0 0) 0x7fb5240e3f70 con 0x7fb52c10b660 2024-05-08T09:07:19.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.376+0000 7fb529e00700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb5100b29f0 0x7fb5100b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:19.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.377+0000 7fb529e00700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb5100b29f0 0x7fb5100b4eb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb51c005fd0 tx=0x7fb51c005dd0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:07:19.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.381+0000 7fb522a00700 1 -- 172.21.15.70:0/2567768978 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb52402b020 con 0x7fb52c10b660 2024-05-08T09:07:19.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:19 smithi070 ceph-mon[29591]: pgmap v4489: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-05-08T09:07:19.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.656+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb52c02e510 con 0x7fb52c10b660 2024-05-08T09:07:19.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.657+0000 7fb522a00700 1 -- 172.21.15.70:0/2567768978 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fb5240074e0 con 0x7fb52c10b660 2024-05-08T09:07:19.657 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:07:19.657 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:07:19.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb5100b29f0 msgr2=0x7fb5100b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:19.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb5100b29f0 0x7fb5100b4eb0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fb51c005fd0 tx=0x7fb51c005dd0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c10b660 msgr2=0x7fb52c19b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:19.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c10b660 0x7fb52c19b950 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb524004dc0 tx=0x7fb524004ea0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 shutdown_connections 2024-05-08T09:07:19.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb5100b29f0 0x7fb5100b4eb0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb52c10b660 0x7fb52c19b950 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb52c1055d0 0x7fb52c1a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 --2- 172.21.15.70:0/2567768978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb52c105f90 0x7fb52c1a1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:19.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 >> 172.21.15.70:0/2567768978 conn(0x7fb52c1010c0 msgr2=0x7fb52c1027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:07:19.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 shutdown_connections 2024-05-08T09:07:19.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:19.660+0000 7fb52b200700 1 -- 172.21.15.70:0/2567768978 wait complete. 2024-05-08T09:07:19.662 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:07:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:19 smithi194 ceph-mon[33679]: pgmap v4489: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-05-08T09:07:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:19 smithi172 ceph-mon[33377]: pgmap v4489: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 12 op/s 2024-05-08T09:07:20.506 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id ba3a2590 --release --await' 2024-05-08T09:07:20.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id ba3a2590 --release --await 2024-05-08T09:07:20.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:20 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2567768978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:07:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:20 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2567768978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:07:20.952 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:07:21.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:20 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2567768978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:07:21.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:21 smithi070 ceph-mon[29591]: pgmap v4490: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T09:07:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:21 smithi172 ceph-mon[33377]: pgmap v4490: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T09:07:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:21 smithi194 ceph-mon[33679]: pgmap v4490: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T09:07:23.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.439+0000 7fc825400700 1 -- 172.21.15.70:0/1821560732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc820109ad0 msgr2=0x7fc820109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:23.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.439+0000 7fc825400700 1 --2- 172.21.15.70:0/1821560732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc820109ad0 0x7fc820109f50 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009990 tx=0x7fc80c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.439+0000 7fc825400700 1 -- 172.21.15.70:0/1821560732 shutdown_connections 2024-05-08T09:07:23.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.439+0000 7fc825400700 1 --2- 172.21.15.70:0/1821560732 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc82010a490 0x7fc8201169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.439+0000 7fc825400700 1 --2- 172.21.15.70:0/1821560732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc82010fb60 0x7fc82010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.439+0000 7fc825400700 1 --2- 172.21.15.70:0/1821560732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc820109ad0 0x7fc820109f50 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.439+0000 7fc825400700 1 -- 172.21.15.70:0/1821560732 >> 172.21.15.70:0/1821560732 conn(0x7fc820076c70 msgr2=0x7fc8201082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:07:23.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.440+0000 7fc825400700 1 -- 172.21.15.70:0/1821560732 shutdown_connections 2024-05-08T09:07:23.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.440+0000 7fc825400700 1 -- 172.21.15.70:0/1821560732 wait complete. 2024-05-08T09:07:23.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.441+0000 7fc825400700 1 Processor -- start 2024-05-08T09:07:23.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.441+0000 7fc825400700 1 -- start start 2024-05-08T09:07:23.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.441+0000 7fc825400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc820109ad0 0x7fc8201a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.441+0000 7fc825400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc82010a490 0x7fc8201a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.441+0000 7fc825400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc82010fb60 0x7fc8201a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.442+0000 7fc825400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc820119b80 con 0x7fc82010a490 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.442+0000 7fc825400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc820119a00 con 0x7fc82010fb60 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.442+0000 7fc825400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc820119d00 con 0x7fc820109ad0 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.442+0000 7fc81de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc82010a490 0x7fc8201a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.442+0000 7fc81de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc82010a490 0x7fc8201a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41124/0 (socket says 172.21.15.70:41124) 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.442+0000 7fc81de00700 1 -- 172.21.15.70:0/86231495 learned_addr learned my addr 172.21.15.70:0/86231495 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.442+0000 7fc81e800700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc820109ad0 0x7fc8201a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.442+0000 7fc81f200700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc82010fb60 0x7fc8201a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.442+0000 7fc81de00700 1 -- 172.21.15.70:0/86231495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc820109ad0 msgr2=0x7fc8201a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc81de00700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc820109ad0 0x7fc8201a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc81de00700 1 -- 172.21.15.70:0/86231495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc82010fb60 msgr2=0x7fc8201a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc81de00700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc82010fb60 0x7fc8201a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc81de00700 1 -- 172.21.15.70:0/86231495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8201a50c0 con 0x7fc82010a490 2024-05-08T09:07:23.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc81e800700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc820109ad0 0x7fc8201a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:07:23.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc81de00700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc82010a490 0x7fc8201a05f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fc80c000c00 tx=0x7fc80c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:07:23.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc817400700 1 -- 172.21.15.70:0/86231495 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c027070 con 0x7fc82010a490 2024-05-08T09:07:23.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc817400700 1 -- 172.21.15.70:0/86231495 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc80c00fc70 con 0x7fc82010a490 2024-05-08T09:07:23.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc825400700 1 -- 172.21.15.70:0/86231495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8201a5350 con 0x7fc82010a490 2024-05-08T09:07:23.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc817400700 1 -- 172.21.15.70:0/86231495 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c022d40 con 0x7fc82010a490 2024-05-08T09:07:23.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.443+0000 7fc825400700 1 -- 172.21.15.70:0/86231495 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8201acc30 con 0x7fc82010a490 2024-05-08T09:07:23.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.447+0000 7fc817400700 1 -- 172.21.15.70:0/86231495 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc80c02a070 con 0x7fc82010a490 2024-05-08T09:07:23.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.448+0000 7fc817400700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc8040b29f0 0x7fc8040b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.449+0000 7fc817400700 1 -- 172.21.15.70:0/86231495 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(358..358 src has 1..358) ==== 9583+0+0 (secure 0 0 0) 0x7fc80c0e3880 con 0x7fc82010a490 2024-05-08T09:07:23.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.449+0000 7fc81e800700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc8040b29f0 0x7fc8040b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.449+0000 7fc81e800700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc8040b29f0 0x7fc8040b4eb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc810005e10 tx=0x7fc810005d60 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:07:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.474+0000 7fc82fdd1b80 1 Processor -- start 2024-05-08T09:07:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.474+0000 7fc82fdd1b80 1 -- start start 2024-05-08T09:07:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.475+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 0x55f8598ac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.475+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.475+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a7140 0x55f8598b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.475+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f8597f8b20 con 0x55f8598a7140 2024-05-08T09:07:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.475+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f859796860 con 0x55f8598ac1b0 2024-05-08T09:07:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.475+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f8597f4ae0 con 0x55f8598a6780 2024-05-08T09:07:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.475+0000 7fc81f200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a7140 0x55f8598b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.475+0000 7fc81de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81f200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a7140 0x55f8598b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41134/0 (socket says 172.21.15.70:41134) 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:59788/0 (socket says 172.21.15.70:59788) 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81f200700 1 -- 172.21.15.70:0/140356687 learned_addr learned my addr 172.21.15.70:0/140356687 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81e800700 1 --2- 172.21.15.70:0/140356687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 0x55f8598ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81f200700 1 -- 172.21.15.70:0/140356687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 msgr2=0x55f8598a6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81f200700 1 --2- 172.21.15.70:0/140356687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598a6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81f200700 1 -- 172.21.15.70:0/140356687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 msgr2=0x55f8598ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81f200700 1 --2- 172.21.15.70:0/140356687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 0x55f8598ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81f200700 1 -- 172.21.15.70:0/140356687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8597459d0 con 0x55f8598a7140 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.476+0000 7fc81de00700 1 --2- 172.21.15.70:0/140356687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:07:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.477+0000 7fc81f200700 1 --2- 172.21.15.70:0/140356687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a7140 0x55f8598b2f70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fc818009dc0 tx=0x7fc8180077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30cbb256d724c780 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.477+0000 7fc80be00700 1 -- 172.21.15.70:0/140356687 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818014610 con 0x55f8598a7140 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.477+0000 7fc80be00700 1 -- 172.21.15.70:0/140356687 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc818019070 con 0x55f8598a7140 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.477+0000 7fc80be00700 1 -- 172.21.15.70:0/140356687 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818013870 con 0x55f8598a7140 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.478+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/140356687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a7140 msgr2=0x55f8598b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.478+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/140356687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a7140 0x55f8598b2f70 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fc818009dc0 tx=0x7fc8180077e0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.478+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/140356687 shutdown_connections 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.478+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/140356687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a7140 0x55f8598b2f70 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.478+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/140356687 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 0x55f8598ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.478+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/140356687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598a6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.478+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/140356687 >> 172.21.15.70:0/140356687 conn(0x55f85981e7d0 msgr2=0x55f8598a1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:07:23.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.478+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/140356687 shutdown_connections 2024-05-08T09:07:23.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.478+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/140356687 wait complete. 2024-05-08T09:07:23.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.479+0000 7fc82fdd1b80 1 -- start start 2024-05-08T09:07:23.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.479+0000 7fc82fdd1b80 1 Processor -- start 2024-05-08T09:07:23.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a6780 0x55f8598b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 0x55f8598aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 0x55f8598b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f8598b3570 con 0x55f8598a6780 2024-05-08T09:07:23.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55f85975ec20 con 0x55f8598ac1b0 2024-05-08T09:07:23.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55f8598b36f0 con 0x55f8598a7140 2024-05-08T09:07:23.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc82fdd1b80 10 client.0 _ll_register_callbacks cb 0x55f85979fd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:07:23.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc81e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a6780 0x55f8598b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc81e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a6780 0x55f8598b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41138/0 (socket says 172.21.15.70:41138) 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc81e800700 1 -- 172.21.15.70:0/315270390 learned_addr learned my addr 172.21.15.70:0/315270390 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.480+0000 7fc81de00700 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 0x55f8598aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc81f200700 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 0x55f8598b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc81e800700 1 -- 172.21.15.70:0/315270390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 msgr2=0x55f8598aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc81e800700 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 0x55f8598aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc81e800700 1 -- 172.21.15.70:0/315270390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 msgr2=0x55f8598b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc81e800700 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 0x55f8598b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc81e800700 1 -- 172.21.15.70:0/315270390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8597be520 con 0x55f8598a6780 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc81de00700 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 0x55f8598aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc81e800700 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a6780 0x55f8598b2b60 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fc81000fb80 tx=0x7fc810004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e478d32fdf0216b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc808c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc808c00700 1 -- 172.21.15.70:0/315270390 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810024070 con 0x55f8598a6780 2024-05-08T09:07:23.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc808c00700 1 -- 172.21.15.70:0/315270390 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(358..358 src has 1..358) ==== 9583+0+0 (secure 0 0 0) 0x7fc810003a90 con 0x55f8598a6780 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.481+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/315270390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc818019070 con 0x55f8598a6780 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.482+0000 7fc808c00700 1 -- 172.21.15.70:0/315270390 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc810030050 con 0x55f8598a6780 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.482+0000 7fc82fdd1b80 10 client.19080 fetch_fsmap learned FSMap version 42 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.482+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/315270390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f8598bddd0 con 0x55f8598a6780 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.482+0000 7fc808c00700 1 -- 172.21.15.70:0/315270390 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc818019070 con 0x55f8598a6780 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.482+0000 7fc808c00700 1 -- 172.21.15.70:0/315270390 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fc810020410 con 0x55f8598a6780 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.482+0000 7fc82fdd1b80 10 client.19080 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.482+0000 7fc82fdd1b80 10 client.19080 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.482+0000 7fc82fdd1b80 20 client.19080 populate_metadata read hostname 'smithi070' 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.483+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f8598c0360 0x55f8598c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.483+0000 7fc82fdd1b80 4 client.19080 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.483+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/315270390 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f859873240 con 0x55f8598c0360 2024-05-08T09:07:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.483+0000 7fc81de00700 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f8598c0360 0x55f8598c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.484+0000 7fc81de00700 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f8598c0360 0x55f8598c27b0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a02dc949bb3f7d3d server_cookie=38e47cc15de3d217 in_seq=0 out_seq=0 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.484+0000 7fc808c00700 10 client.19080 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.486+0000 7fc808c00700 1 -- 172.21.15.70:0/315270390 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f859873240 con 0x55f8598c0360 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.486+0000 7fc808c00700 10 client.19080 handle_command_reply: tid=0 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.486+0000 7fc82fdd1b80 1 client.19080 shutdown 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.486+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/315270390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a6780 msgr2=0x55f8598b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.486+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a6780 0x55f8598b2b60 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fc81000fb80 tx=0x7fc810004750 comp rx=0 tx=0).stop 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.486+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/315270390 shutdown_connections 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.486+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f8598c0360 0x55f8598c27b0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.487+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598ac1b0 0x55f8598b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.487+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598a6780 0x55f8598b2b60 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.487+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/315270390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 0x55f8598aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.487+0000 7fc808c00700 0 client.19080 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:07:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.487+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/315270390 >> 172.21.15.70:0/315270390 conn(0x55f85981e7d0 msgr2=0x55f85989bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:07:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.487+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/315270390 shutdown_connections 2024-05-08T09:07:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.487+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/315270390 wait complete. 2024-05-08T09:07:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.487+0000 7fc82fdd1b80 20 client.19080 trim_cache size 0 max 16384 2024-05-08T09:07:23.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.509+0000 7fc82fdd1b80 1 Processor -- start 2024-05-08T09:07:23.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.509+0000 7fc82fdd1b80 1 -- start start 2024-05-08T09:07:23.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.509+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598bc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.509+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a7140 0x55f8598aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.509+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.509+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201b8450 con 0x55f8598ac1b0 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.509+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201b5ce0 con 0x55f8598a7140 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.509+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201b3b50 con 0x55f8598a6780 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.509+0000 7fc81f200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.510+0000 7fc81f200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41140/0 (socket says 172.21.15.70:41140) 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.510+0000 7fc81f200700 1 -- 172.21.15.70:0/3847505997 learned_addr learned my addr 172.21.15.70:0/3847505997 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.510+0000 7fc81e800700 1 --2- 172.21.15.70:0/3847505997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598bc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.510+0000 7fc81de00700 1 --2- 172.21.15.70:0/3847505997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a7140 0x55f8598aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.510+0000 7fc81f200700 1 -- 172.21.15.70:0/3847505997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 msgr2=0x55f8598bc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:07:23.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.510+0000 7fc81f200700 1 --2- 172.21.15.70:0/3847505997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598bc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.510+0000 7fc81f200700 1 -- 172.21.15.70:0/3847505997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a7140 msgr2=0x55f8598aa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:07:23.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.510+0000 7fc81f200700 1 --2- 172.21.15.70:0/3847505997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a7140 0x55f8598aa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.510+0000 7fc81f200700 1 -- 172.21.15.70:0/3847505997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f85989dc70 con 0x55f8598ac1b0 2024-05-08T09:07:23.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.511+0000 7fc81f200700 1 --2- 172.21.15.70:0/3847505997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598c8080 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fc8180093a0 tx=0x7fc818004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc170b5b6982732 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:07:23.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.511+0000 7fc80b400700 1 -- 172.21.15.70:0/3847505997 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818014410 con 0x55f8598ac1b0 2024-05-08T09:07:23.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.511+0000 7fc80b400700 1 -- 172.21.15.70:0/3847505997 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc818019070 con 0x55f8598ac1b0 2024-05-08T09:07:23.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.511+0000 7fc80b400700 1 -- 172.21.15.70:0/3847505997 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8180266a0 con 0x55f8598ac1b0 2024-05-08T09:07:23.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.512+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/3847505997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 msgr2=0x55f8598c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:23.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.512+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/3847505997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598c8080 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fc8180093a0 tx=0x7fc818004be0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.512+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/3847505997 shutdown_connections 2024-05-08T09:07:23.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.512+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/3847505997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598c8080 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.512+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/3847505997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a6780 0x55f8598bc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.512+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/3847505997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a7140 0x55f8598aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.512+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/3847505997 >> 172.21.15.70:0/3847505997 conn(0x55f85981e7d0 msgr2=0x55f8598a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:07:23.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.512+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/3847505997 shutdown_connections 2024-05-08T09:07:23.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.512+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/3847505997 wait complete. 2024-05-08T09:07:23.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.513+0000 7fc82fdd1b80 1 -- start start 2024-05-08T09:07:23.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.513+0000 7fc82fdd1b80 1 Processor -- start 2024-05-08T09:07:23.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a6780 0x55f8598b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 0x55f8598b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc82fdd1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201b41a0 con 0x55f8598ac1b0 2024-05-08T09:07:23.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201b5610 con 0x55f8598a6780 2024-05-08T09:07:23.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc82fdd1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc8201b4870 con 0x55f8598a7140 2024-05-08T09:07:23.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc82fdd1b80 10 client.0 _ll_register_callbacks cb 0x55f85979fd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:07:23.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc81f200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc81f200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598b5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41142/0 (socket says 172.21.15.70:41142) 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc81f200700 1 -- 172.21.15.70:0/470456074 learned_addr learned my addr 172.21.15.70:0/470456074 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.514+0000 7fc81de00700 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 0x55f8598b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc81e800700 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a6780 0x55f8598b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc81f200700 1 -- 172.21.15.70:0/470456074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 msgr2=0x55f8598b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc81f200700 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 0x55f8598b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc81f200700 1 -- 172.21.15.70:0/470456074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a6780 msgr2=0x55f8598b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc81f200700 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a6780 0x55f8598b8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc81f200700 1 -- 172.21.15.70:0/470456074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8598b6590 con 0x55f8598ac1b0 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc81e800700 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a6780 0x55f8598b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc81f200700 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598b5e90 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fc818007820 tx=0x7fc818014b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd673b7b534ad7cb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc808c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc808c00700 1 -- 172.21.15.70:0/470456074 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818026640 con 0x55f8598ac1b0 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/470456074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc818019070 con 0x55f8598ac1b0 2024-05-08T09:07:23.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.515+0000 7fc808c00700 1 -- 172.21.15.70:0/470456074 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(358..358 src has 1..358) ==== 9583+0+0 (secure 0 0 0) 0x7fc8180267e0 con 0x55f8598ac1b0 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc808c00700 1 -- 172.21.15.70:0/470456074 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc8180097e0 con 0x55f8598ac1b0 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc82fdd1b80 10 client.19086 fetch_fsmap learned FSMap version 42 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/470456074 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55f85992bb70 con 0x55f8598ac1b0 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc808c00700 1 -- 172.21.15.70:0/470456074 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc818019070 con 0x55f8598ac1b0 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc808c00700 1 -- 172.21.15.70:0/470456074 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fc818024020 con 0x55f8598ac1b0 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc82fdd1b80 10 client.19086 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc82fdd1b80 10 client.19086 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc82fdd1b80 20 client.19086 populate_metadata read hostname 'smithi070' 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f85992bf40 0x55f85992e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc82fdd1b80 4 client.19086 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ba3a2590", "release": true, "await": true}] 2024-05-08T09:07:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.516+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/470456074 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ba3a2590", "release": true, "await": true}) -- 0x55f8598a15d0 con 0x55f85992bf40 2024-05-08T09:07:23.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.517+0000 7fc81e800700 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f85992bf40 0x55f85992e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:07:23.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.518+0000 7fc81e800700 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f85992bf40 0x55f85992e360 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9384cdc419b12984 server_cookie=4786efec39c86e2f in_seq=0 out_seq=0 2024-05-08T09:07:23.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:23.518+0000 7fc808c00700 10 client.19086 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:07:23.848 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:23 smithi070 ceph-mon[29591]: pgmap v4491: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-05-08T09:07:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:23 smithi172 ceph-mon[33377]: pgmap v4491: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-05-08T09:07:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:23 smithi194 ceph-mon[33679]: pgmap v4491: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 6 op/s 2024-05-08T09:07:25.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:25 smithi070 ceph-mon[29591]: pgmap v4492: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:07:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:25 smithi172 ceph-mon[33377]: pgmap v4492: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:07:26.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:25 smithi194 ceph-mon[33679]: pgmap v4492: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:07:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:27 smithi070 ceph-mon[29591]: pgmap v4493: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:07:27.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:27 smithi172 ceph-mon[33377]: pgmap v4493: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:07:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:27 smithi194 ceph-mon[33679]: pgmap v4493: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:07:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.254+0000 7fc808c00700 1 -- 172.21.15.70:0/470456074 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55f8598a15d0 con 0x55f85992bf40 2024-05-08T09:07:28.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.254+0000 7fc808c00700 10 client.19086 handle_command_reply: tid=0 2024-05-08T09:07:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.254+0000 7fc82fdd1b80 1 client.19086 shutdown 2024-05-08T09:07:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/470456074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 msgr2=0x55f8598b5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598b5e90 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fc818007820 tx=0x7fc818014b20 comp rx=0 tx=0).stop 2024-05-08T09:07:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/470456074 shutdown_connections 2024-05-08T09:07:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55f85992bf40 0x55f85992e360 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:28.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f8598ac1b0 0x55f8598b5e90 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55f8598a6780 0x55f8598b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc82fdd1b80 1 --2- 172.21.15.70:0/470456074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55f8598a7140 0x55f8598b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/470456074 >> 172.21.15.70:0/470456074 conn(0x55f85981e7d0 msgr2=0x55f85989bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:07:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc808c00700 0 client.19086 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:07:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.255+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/470456074 shutdown_connections 2024-05-08T09:07:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.256+0000 7fc82fdd1b80 1 -- 172.21.15.70:0/470456074 wait complete. 2024-05-08T09:07:28.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.256+0000 7fc82fdd1b80 20 client.19086 trim_cache size 0 max 16384 2024-05-08T09:07:28.259 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:07:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:07:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:07:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 312, 2024-05-08T09:07:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:07:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "ba3a2590": { 2024-05-08T09:07:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 312, 2024-05-08T09:07:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:07:28.259 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 85.2, 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:07:28.260 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:07:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:07:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:07:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:07:28.261 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:07:28.261 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:07:28.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 -- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc8040b29f0 msgr2=0x7fc8040b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:28.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc8040b29f0 0x7fc8040b4eb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc810005e10 tx=0x7fc810005d60 comp rx=0 tx=0).stop 2024-05-08T09:07:28.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 -- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc82010a490 msgr2=0x7fc8201a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:07:28.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc82010a490 0x7fc8201a05f0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fc80c000c00 tx=0x7fc80c009f90 comp rx=0 tx=0).stop 2024-05-08T09:07:28.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 -- 172.21.15.70:0/86231495 shutdown_connections 2024-05-08T09:07:28.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc8040b29f0 0x7fc8040b4eb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:28.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc82010fb60 0x7fc8201a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:28.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc820109ad0 0x7fc8201a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:28.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 --2- 172.21.15.70:0/86231495 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc82010a490 0x7fc8201a05f0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:07:28.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 -- 172.21.15.70:0/86231495 >> 172.21.15.70:0/86231495 conn(0x7fc820076c70 msgr2=0x7fc820077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:07:28.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 -- 172.21.15.70:0/86231495 shutdown_connections 2024-05-08T09:07:28.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:07:28.258+0000 7fc825400700 1 -- 172.21.15.70:0/86231495 wait complete. 2024-05-08T09:07:29.181 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ba3a2590', seconds elapsed: 71.6 2024-05-08T09:07:29.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:29 smithi070 ceph-mon[29591]: pgmap v4494: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:07:29.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:29 smithi172 ceph-mon[33377]: pgmap v4494: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:07:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:29 smithi194 ceph-mon[33679]: pgmap v4494: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:07:30.720 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/ff-core.o 2024-05-08T09:07:30.914 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/storage/transport.o 2024-05-08T09:07:30.974 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/core/usb-acpi.o 2024-05-08T09:07:31.111 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/i2c/algos/built-in.a 2024-05-08T09:07:31.116 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/xhci-mem.o 2024-05-08T09:07:31.784 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/nvidia/built-in.a 2024-05-08T09:07:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:31 smithi070 ceph-mon[29591]: pgmap v4495: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 191 KiB/s wr, 14 op/s 2024-05-08T09:07:31.894 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/i2c/busses/i2c-i801.o 2024-05-08T09:07:31.901 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/i2c/muxes/built-in.a 2024-05-08T09:07:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:31 smithi172 ceph-mon[33377]: pgmap v4495: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 191 KiB/s wr, 14 op/s 2024-05-08T09:07:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:31 smithi194 ceph-mon[33679]: pgmap v4495: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 191 KiB/s wr, 14 op/s 2024-05-08T09:07:32.034 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/touchscreen.o 2024-05-08T09:07:32.093 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/oki-semi/built-in.a 2024-05-08T09:07:32.292 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/packetengines/built-in.a 2024-05-08T09:07:32.492 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/qlogic/built-in.a 2024-05-08T09:07:32.787 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/qualcomm/emac/built-in.a 2024-05-08T09:07:32.934 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/qualcomm/built-in.a 2024-05-08T09:07:33.175 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/realtek/8139too.o 2024-05-08T09:07:33.313 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gtt.o 2024-05-08T09:07:33.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:33 smithi070 ceph-mon[29591]: pgmap v4496: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 191 KiB/s wr, 11 op/s 2024-05-08T09:07:33.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:33 smithi172 ceph-mon[33377]: pgmap v4496: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 191 KiB/s wr, 11 op/s 2024-05-08T09:07:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:33 smithi194 ceph-mon[33679]: pgmap v4496: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 191 KiB/s wr, 11 op/s 2024-05-08T09:07:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:35 smithi070 ceph-mon[29591]: pgmap v4497: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 508 KiB/s wr, 25 op/s 2024-05-08T09:07:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:35 smithi172 ceph-mon[33377]: pgmap v4497: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 508 KiB/s wr, 25 op/s 2024-05-08T09:07:36.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:35 smithi194 ceph-mon[33679]: pgmap v4497: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 508 KiB/s wr, 25 op/s 2024-05-08T09:07:37.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:37 smithi070 ceph-mon[29591]: pgmap v4498: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 508 KiB/s wr, 22 op/s 2024-05-08T09:07:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:37 smithi172 ceph-mon[33377]: pgmap v4498: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 508 KiB/s wr, 22 op/s 2024-05-08T09:07:38.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:37 smithi194 ceph-mon[33679]: pgmap v4498: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 508 KiB/s wr, 22 op/s 2024-05-08T09:07:38.805 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_llc.o 2024-05-08T09:07:39.753 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/ff-memless.o 2024-05-08T09:07:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:39 smithi070 ceph-mon[29591]: pgmap v4499: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 509 KiB/s wr, 22 op/s 2024-05-08T09:07:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:39 smithi172 ceph-mon[33377]: pgmap v4499: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 509 KiB/s wr, 22 op/s 2024-05-08T09:07:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:39 smithi194 ceph-mon[33679]: pgmap v4499: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 509 KiB/s wr, 22 op/s 2024-05-08T09:07:40.591 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/core/built-in.a 2024-05-08T09:07:40.714 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/storage/usb.o 2024-05-08T09:07:41.794 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/xhci-ext-caps.o 2024-05-08T09:07:41.877 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/realtek/r8169_main.o 2024-05-08T09:07:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:41 smithi070 ceph-mon[29591]: pgmap v4500: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 724 KiB/s wr, 31 op/s 2024-05-08T09:07:41.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:41 smithi172 ceph-mon[33377]: pgmap v4500: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 724 KiB/s wr, 31 op/s 2024-05-08T09:07:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:41 smithi194 ceph-mon[33679]: pgmap v4500: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 663 KiB/s rd, 724 KiB/s wr, 31 op/s 2024-05-08T09:07:42.095 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/i2c/busses/built-in.a 2024-05-08T09:07:42.273 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/i2c/i2c-boardinfo.o 2024-05-08T09:07:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:43 smithi070 ceph-mon[29591]: pgmap v4501: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 533 KiB/s wr, 22 op/s 2024-05-08T09:07:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:43 smithi172 ceph-mon[33377]: pgmap v4501: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 533 KiB/s wr, 22 op/s 2024-05-08T09:07:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:43 smithi194 ceph-mon[33679]: pgmap v4501: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 503 KiB/s rd, 533 KiB/s wr, 22 op/s 2024-05-08T09:07:44.413 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/i2c/i2c-core-base.o 2024-05-08T09:07:45.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:45 smithi070 ceph-mon[29591]: pgmap v4502: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 1.0 MiB/s wr, 40 op/s 2024-05-08T09:07:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:45 smithi172 ceph-mon[33377]: pgmap v4502: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 1.0 MiB/s wr, 40 op/s 2024-05-08T09:07:46.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:45 smithi194 ceph-mon[33679]: pgmap v4502: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 932 KiB/s rd, 1.0 MiB/s wr, 40 op/s 2024-05-08T09:07:46.739 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/i2c/i2c-core-smbus.o 2024-05-08T09:07:47.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:47 smithi070 ceph-mon[29591]: pgmap v4503: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 754 KiB/s wr, 27 op/s 2024-05-08T09:07:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:47 smithi172 ceph-mon[33377]: pgmap v4503: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 754 KiB/s wr, 27 op/s 2024-05-08T09:07:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:47 smithi194 ceph-mon[33679]: pgmap v4503: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 754 KiB/s wr, 27 op/s 2024-05-08T09:07:48.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:07:48.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:07:49.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:07:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:49 smithi070 ceph-mon[29591]: pgmap v4504: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 754 KiB/s wr, 27 op/s 2024-05-08T09:07:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:49 smithi172 ceph-mon[33377]: pgmap v4504: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 754 KiB/s wr, 27 op/s 2024-05-08T09:07:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:49 smithi194 ceph-mon[33679]: pgmap v4504: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 634 KiB/s rd, 754 KiB/s wr, 27 op/s 2024-05-08T09:07:50.569 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/storage/initializers.o 2024-05-08T09:07:50.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:07:50.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:07:50.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:07:50.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:07:50.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:07:50.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:07:50.992 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/sparse-keymap.o 2024-05-08T09:07:51.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:07:51.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:07:51.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:07:51.127 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/xhci-ring.o 2024-05-08T09:07:51.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:51 smithi070 ceph-mon[29591]: pgmap v4505: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.0 MiB/s wr, 41 op/s 2024-05-08T09:07:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:51 smithi172 ceph-mon[33377]: pgmap v4505: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.0 MiB/s wr, 41 op/s 2024-05-08T09:07:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:51 smithi194 ceph-mon[33679]: pgmap v4505: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 954 KiB/s rd, 1.0 MiB/s wr, 41 op/s 2024-05-08T09:07:52.237 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_mm.o 2024-05-08T09:07:52.357 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_lrc.o 2024-05-08T09:07:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:53 smithi070 ceph-mon[29591]: pgmap v4506: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 837 KiB/s wr, 32 op/s 2024-05-08T09:07:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:53 smithi172 ceph-mon[33377]: pgmap v4506: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 837 KiB/s wr, 32 op/s 2024-05-08T09:07:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:53 smithi194 ceph-mon[33679]: pgmap v4506: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 749 KiB/s rd, 837 KiB/s wr, 32 op/s 2024-05-08T09:07:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:55 smithi070 ceph-mon[29591]: pgmap v4507: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 56 op/s 2024-05-08T09:07:55.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:55 smithi172 ceph-mon[33377]: pgmap v4507: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 56 op/s 2024-05-08T09:07:56.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:55 smithi194 ceph-mon[33679]: pgmap v4507: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 56 op/s 2024-05-08T09:07:56.177 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/realtek/r8169_firmware.o 2024-05-08T09:07:56.526 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/xhci-hub.o 2024-05-08T09:07:57.785 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/i2c/i2c-core-acpi.o 2024-05-08T09:07:57.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:57 smithi070 ceph-mon[29591]: pgmap v4508: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 694 KiB/s wr, 38 op/s 2024-05-08T09:07:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:57 smithi172 ceph-mon[33377]: pgmap v4508: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 694 KiB/s wr, 38 op/s 2024-05-08T09:07:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:57 smithi194 ceph-mon[33679]: pgmap v4508: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 694 KiB/s wr, 38 op/s 2024-05-08T09:07:59.143 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/vivaldi-fmap.o 2024-05-08T09:07:59.654 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/storage/sierra_ms.o 2024-05-08T09:07:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:07:59 smithi172 ceph-mon[33377]: pgmap v4509: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 694 KiB/s wr, 38 op/s 2024-05-08T09:08:00.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:07:59 smithi194 ceph-mon[33679]: pgmap v4509: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 694 KiB/s wr, 38 op/s 2024-05-08T09:08:00.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:07:59 smithi070 ceph-mon[29591]: pgmap v4509: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 694 KiB/s wr, 38 op/s 2024-05-08T09:08:00.515 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/xhci-dbg.o 2024-05-08T09:08:01.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:01 smithi172 ceph-mon[33377]: pgmap v4510: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 48 op/s 2024-05-08T09:08:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:01 smithi194 ceph-mon[33679]: pgmap v4510: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 48 op/s 2024-05-08T09:08:02.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:01 smithi070 ceph-mon[29591]: pgmap v4510: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 48 op/s 2024-05-08T09:08:02.252 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/i2c/i2c-smbus.o 2024-05-08T09:08:03.635 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/ethernet/realtek/r8169_phy_config.o 2024-05-08T09:08:03.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:03 smithi172 ceph-mon[33377]: pgmap v4511: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 737 KiB/s wr, 34 op/s 2024-05-08T09:08:03.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:03 smithi070 ceph-mon[29591]: pgmap v4511: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 737 KiB/s wr, 34 op/s 2024-05-08T09:08:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:03 smithi194 ceph-mon[33679]: pgmap v4511: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 737 KiB/s wr, 34 op/s 2024-05-08T09:08:05.908 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:05 smithi070 ceph-mon[29591]: pgmap v4512: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.0 MiB/s wr, 61 op/s 2024-05-08T09:08:05.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:05 smithi172 ceph-mon[33377]: pgmap v4512: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.0 MiB/s wr, 61 op/s 2024-05-08T09:08:06.002 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/input-leds.o 2024-05-08T09:08:06.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:05 smithi194 ceph-mon[33679]: pgmap v4512: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 1.0 MiB/s wr, 61 op/s 2024-05-08T09:08:06.388 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_migrate.o 2024-05-08T09:08:07.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:07 smithi172 ceph-mon[33377]: pgmap v4513: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 680 KiB/s wr, 37 op/s 2024-05-08T09:08:08.005 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/input/evdev.o 2024-05-08T09:08:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:07 smithi194 ceph-mon[33679]: pgmap v4513: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 680 KiB/s wr, 37 op/s 2024-05-08T09:08:08.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:07 smithi070 ceph-mon[29591]: pgmap v4513: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 680 KiB/s wr, 37 op/s 2024-05-08T09:08:09.395 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/i3c/built-in.a 2024-05-08T09:08:09.897 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/i2c/built-in.a 2024-05-08T09:08:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:09 smithi172 ceph-mon[33377]: pgmap v4514: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 680 KiB/s wr, 37 op/s 2024-05-08T09:08:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:09 smithi172 ceph-mon[33377]: osdmap e359: 12 total, 12 up, 12 in 2024-05-08T09:08:10.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:09 smithi194 ceph-mon[33679]: pgmap v4514: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 680 KiB/s wr, 37 op/s 2024-05-08T09:08:10.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:09 smithi194 ceph-mon[33679]: osdmap e359: 12 total, 12 up, 12 in 2024-05-08T09:08:10.103 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/tuners/built-in.a 2024-05-08T09:08:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:09 smithi070 ceph-mon[29591]: pgmap v4514: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 688 KiB/s rd, 680 KiB/s wr, 37 op/s 2024-05-08T09:08:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:09 smithi070 ceph-mon[29591]: osdmap e359: 12 total, 12 up, 12 in 2024-05-08T09:08:10.444 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/rc/keymaps/built-in.a 2024-05-08T09:08:10.537 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/storage/option_ms.o 2024-05-08T09:08:10.574 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/rc/built-in.a 2024-05-08T09:08:10.581 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/xhci-trace.o 2024-05-08T09:08:10.871 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/common/b2c2/built-in.a 2024-05-08T09:08:11.179 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/common/saa7146/built-in.a 2024-05-08T09:08:11.370 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/common/siano/built-in.a 2024-05-08T09:08:11.833 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/common/v4l2-tpg/built-in.a 2024-05-08T09:08:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:11 smithi172 ceph-mon[33377]: pgmap v4516: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 814 KiB/s wr, 49 op/s 2024-05-08T09:08:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:11 smithi172 ceph-mon[33377]: osdmap e360: 12 total, 12 up, 12 in 2024-05-08T09:08:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:11 smithi194 ceph-mon[33679]: pgmap v4516: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 814 KiB/s wr, 49 op/s 2024-05-08T09:08:12.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:11 smithi194 ceph-mon[33679]: osdmap e360: 12 total, 12 up, 12 in 2024-05-08T09:08:12.042 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/common/videobuf2/built-in.a 2024-05-08T09:08:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:11 smithi070 ceph-mon[29591]: pgmap v4516: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 814 KiB/s wr, 49 op/s 2024-05-08T09:08:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:11 smithi070 ceph-mon[29591]: osdmap e360: 12 total, 12 up, 12 in 2024-05-08T09:08:12.170 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/common/built-in.a 2024-05-08T09:08:12.531 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/allegro-dvt/built-in.a 2024-05-08T09:08:12.622 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/i2c/built-in.a 2024-05-08T09:08:12.839 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/amlogic/meson-ge2d/built-in.a 2024-05-08T09:08:12.966 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/amlogic/built-in.a 2024-05-08T09:08:13.144 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/early/ehci-dbgp.o 2024-05-08T09:08:13.174 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/amphion/built-in.a 2024-05-08T09:08:13.370 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/aspeed/built-in.a 2024-05-08T09:08:13.572 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/atmel/built-in.a 2024-05-08T09:08:13.803 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/cadence/built-in.a 2024-05-08T09:08:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:13 smithi194 ceph-mon[33679]: pgmap v4518: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 512 KiB/s wr, 21 op/s 2024-05-08T09:08:14.019 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/chips-media/built-in.a 2024-05-08T09:08:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:13 smithi070 ceph-mon[29591]: pgmap v4518: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 512 KiB/s wr, 21 op/s 2024-05-08T09:08:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:13 smithi172 ceph-mon[33377]: pgmap v4518: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 512 KiB/s wr, 21 op/s 2024-05-08T09:08:14.226 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/intel/built-in.a 2024-05-08T09:08:14.431 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/marvell/built-in.a 2024-05-08T09:08:14.730 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/mediatek/jpeg/built-in.a 2024-05-08T09:08:14.865 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_mocs.o 2024-05-08T09:08:14.904 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/mediatek/mdp/built-in.a 2024-05-08T09:08:14.935 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/realtek/built-in.a 2024-05-08T09:08:15.125 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/mediatek/vcodec/built-in.a 2024-05-08T09:08:15.405 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/mediatek/vpu/built-in.a 2024-05-08T09:08:15.443 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/renesas/built-in.a 2024-05-08T09:08:15.630 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/mediatek/mdp3/built-in.a 2024-05-08T09:08:15.658 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/rdc/built-in.a 2024-05-08T09:08:15.782 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/mediatek/built-in.a 2024-05-08T09:08:15.888 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/rocker/built-in.a 2024-05-08T09:08:15.982 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T09:08:15.982 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.9 2024-05-08T09:08:15.983 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:08:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:15 smithi194 ceph-mon[33679]: pgmap v4519: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-05-08T09:08:16.055 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/microchip/built-in.a 2024-05-08T09:08:16.057 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:15 smithi070 ceph-mon[29591]: pgmap v4519: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-05-08T09:08:16.082 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/samsung/built-in.a 2024-05-08T09:08:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:15 smithi172 ceph-mon[33377]: pgmap v4519: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-05-08T09:08:16.278 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/seeq/built-in.a 2024-05-08T09:08:16.349 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/nvidia/tegra-vde/built-in.a 2024-05-08T09:08:16.733 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/nvidia/built-in.a 2024-05-08T09:08:16.774 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/silan/built-in.a 2024-05-08T09:08:16.958 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/sis/built-in.a 2024-05-08T09:08:16.989 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/nxp/dw100/built-in.a 2024-05-08T09:08:17.188 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/sfc/built-in.a 2024-05-08T09:08:17.190 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/nxp/imx-jpeg/built-in.a 2024-05-08T09:08:17.373 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/nxp/imx8-isi/built-in.a 2024-05-08T09:08:17.474 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/smsc/built-in.a 2024-05-08T09:08:17.519 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/nxp/built-in.a 2024-05-08T09:08:17.668 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/socionext/built-in.a 2024-05-08T09:08:17.832 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/qcom/camss/built-in.a 2024-05-08T09:08:17.870 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/stmicro/built-in.a 2024-05-08T09:08:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:17 smithi194 ceph-mon[33679]: pgmap v4520: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-05-08T09:08:18.090 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/sun/built-in.a 2024-05-08T09:08:18.106 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/qcom/venus/built-in.a 2024-05-08T09:08:18.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:17 smithi070 ceph-mon[29591]: pgmap v4520: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-05-08T09:08:18.150 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:08:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:17 smithi172 ceph-mon[33377]: pgmap v4520: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 1.1 MiB/s wr, 63 op/s 2024-05-08T09:08:18.282 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/tehuti/built-in.a 2024-05-08T09:08:18.289 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/qcom/built-in.a 2024-05-08T09:08:18.440 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/ti/built-in.a 2024-05-08T09:08:18.521 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/renesas/rcar-vin/built-in.a 2024-05-08T09:08:18.596 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/vertexcom/built-in.a 2024-05-08T09:08:18.677 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/renesas/rzg2l-cru/built-in.a 2024-05-08T09:08:18.752 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/via/built-in.a 2024-05-08T09:08:18.839 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/renesas/vsp1/built-in.a 2024-05-08T09:08:18.914 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/wangxun/built-in.a 2024-05-08T09:08:18.974 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/renesas/built-in.a 2024-05-08T09:08:19.067 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/wiznet/built-in.a 2024-05-08T09:08:19.397 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/rockchip/rga/built-in.a 2024-05-08T09:08:19.574 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/rockchip/rkisp1/built-in.a 2024-05-08T09:08:19.583 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/xilinx/built-in.a 2024-05-08T09:08:19.736 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/rockchip/built-in.a 2024-05-08T09:08:19.839 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/xircom/built-in.a 2024-05-08T09:08:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:19 smithi194 ceph-mon[33679]: pgmap v4521: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 897 KiB/s wr, 52 op/s 2024-05-08T09:08:20.068 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/synopsys/built-in.a 2024-05-08T09:08:20.079 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/samsung/exynos-gsc/built-in.a 2024-05-08T09:08:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:19 smithi070 ceph-mon[29591]: pgmap v4521: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 897 KiB/s wr, 52 op/s 2024-05-08T09:08:20.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:19 smithi172 ceph-mon[33377]: pgmap v4521: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 897 KiB/s wr, 52 op/s 2024-05-08T09:08:20.358 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/samsung/exynos4-is/built-in.a 2024-05-08T09:08:20.375 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/pensando/built-in.a 2024-05-08T09:08:20.599 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/samsung/s3c-camif/built-in.a 2024-05-08T09:08:20.840 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/samsung/s5p-g2d/built-in.a 2024-05-08T09:08:21.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:20 smithi194 ceph-mon[33679]: pgmap v4522: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 945 KiB/s wr, 73 op/s 2024-05-08T09:08:21.093 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/samsung/s5p-jpeg/built-in.a 2024-05-08T09:08:21.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:20 smithi070 ceph-mon[29591]: pgmap v4522: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 945 KiB/s wr, 73 op/s 2024-05-08T09:08:21.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:20 smithi172 ceph-mon[33377]: pgmap v4522: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 851 KiB/s rd, 945 KiB/s wr, 73 op/s 2024-05-08T09:08:21.277 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/ethernet/built-in.a 2024-05-08T09:08:21.377 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/samsung/s5p-mfc/built-in.a 2024-05-08T09:08:21.417 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/storage/usual-tables.o 2024-05-08T09:08:21.538 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/samsung/built-in.a 2024-05-08T09:08:21.679 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/input/built-in.a 2024-05-08T09:08:21.937 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/st/sti/bdisp/built-in.a 2024-05-08T09:08:22.210 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/st/sti/c8sectpfe/built-in.a 2024-05-08T09:08:22.378 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_ppgtt.o 2024-05-08T09:08:22.387 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/st/sti/delta/built-in.a 2024-05-08T09:08:22.635 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/st/sti/hva/built-in.a 2024-05-08T09:08:22.862 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/st/stm32/built-in.a 2024-05-08T09:08:23.015 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/xhci-debugfs.o 2024-05-08T09:08:23.041 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/st/built-in.a 2024-05-08T09:08:23.096 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/usb/host/xhci-pci.o 2024-05-08T09:08:23.402 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/sunxi/sun4i-csi/built-in.a 2024-05-08T09:08:23.619 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/sunxi/sun6i-csi/built-in.a 2024-05-08T09:08:23.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:23 smithi194 ceph-mon[33679]: pgmap v4523: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 843 KiB/s wr, 65 op/s 2024-05-08T09:08:23.786 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/early/built-in.a 2024-05-08T09:08:23.828 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:23 smithi070 ceph-mon[29591]: pgmap v4523: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 843 KiB/s wr, 65 op/s 2024-05-08T09:08:23.852 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/sunxi/sun6i-mipi-csi2/built-in.a 2024-05-08T09:08:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:23 smithi172 ceph-mon[33377]: pgmap v4523: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 843 KiB/s wr, 65 op/s 2024-05-08T09:08:24.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.196+0000 7f8180c00700 1 -- 172.21.15.70:0/3295517042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f817c075ff0 msgr2=0x7f817c10f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:24.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.197+0000 7f8180c00700 1 --2- 172.21.15.70:0/3295517042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f817c075ff0 0x7f817c10f960 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8164009990 tx=0x7f8164009ca0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.197+0000 7f8180c00700 1 -- 172.21.15.70:0/3295517042 shutdown_connections 2024-05-08T09:08:24.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.197+0000 7f8180c00700 1 --2- 172.21.15.70:0/3295517042 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f817c10fea0 0x7f817c112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.197+0000 7f8180c00700 1 --2- 172.21.15.70:0/3295517042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f817c0756d0 0x7f817c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.197+0000 7f8180c00700 1 --2- 172.21.15.70:0/3295517042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f817c075ff0 0x7f817c10f960 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.197+0000 7f8180c00700 1 -- 172.21.15.70:0/3295517042 >> 172.21.15.70:0/3295517042 conn(0x7f817c07a600 msgr2=0x7f817c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:08:24.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.197+0000 7f8180c00700 1 -- 172.21.15.70:0/3295517042 shutdown_connections 2024-05-08T09:08:24.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.197+0000 7f8180c00700 1 -- 172.21.15.70:0/3295517042 wait complete. 2024-05-08T09:08:24.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.199+0000 7f8180c00700 1 Processor -- start 2024-05-08T09:08:24.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.199+0000 7f8180c00700 1 -- start start 2024-05-08T09:08:24.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.200+0000 7f8180c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f817c0756d0 0x7f817c10f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:24.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.200+0000 7f8180c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f817c075ff0 0x7f817c10c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:24.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.200+0000 7f8180c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f817c10fea0 0x7f817c10cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:24.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.201+0000 7f8180c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f817c115760 con 0x7f817c10fea0 2024-05-08T09:08:24.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.201+0000 7f8179e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f817c0756d0 0x7f817c10f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:24.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.201+0000 7f8179e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f817c0756d0 0x7f817c10f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:42034/0 (socket says 172.21.15.70:42034) 2024-05-08T09:08:24.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.201+0000 7f8179e00700 1 -- 172.21.15.70:0/3739109070 learned_addr learned my addr 172.21.15.70:0/3739109070 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:08:24.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.201+0000 7f8179400700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f817c075ff0 0x7f817c10c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:24.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.201+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1155e0 con 0x7f817c0756d0 2024-05-08T09:08:24.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.201+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f817c1158e0 con 0x7f817c075ff0 2024-05-08T09:08:24.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.201+0000 7f817a800700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f817c10fea0 0x7f817c10cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:24.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.202+0000 7f817a800700 1 -- 172.21.15.70:0/3739109070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f817c075ff0 msgr2=0x7f817c10c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:24.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.202+0000 7f817a800700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f817c075ff0 0x7f817c10c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.202+0000 7f817a800700 1 -- 172.21.15.70:0/3739109070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f817c0756d0 msgr2=0x7f817c10f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:24.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.202+0000 7f817a800700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f817c0756d0 0x7f817c10f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.202+0000 7f817a800700 1 -- 172.21.15.70:0/3739109070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817c1ac4a0 con 0x7f817c10fea0 2024-05-08T09:08:24.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.203+0000 7f8179e00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f817c0756d0 0x7f817c10f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:08:24.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.203+0000 7f8179400700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f817c075ff0 0x7f817c10c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:08:24.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.203+0000 7f817a800700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f817c10fea0 0x7f817c10cf80 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f8174007ee0 tx=0x7f817400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:08:24.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.204+0000 7f8172a00700 1 -- 172.21.15.70:0/3739109070 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f817400ddd0 con 0x7f817c10fea0 2024-05-08T09:08:24.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.204+0000 7f8172a00700 1 -- 172.21.15.70:0/3739109070 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8174004bb0 con 0x7f817c10fea0 2024-05-08T09:08:24.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.204+0000 7f8172a00700 1 -- 172.21.15.70:0/3739109070 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8174015400 con 0x7f817c10fea0 2024-05-08T09:08:24.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.205+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817c1ac670 con 0x7f817c10fea0 2024-05-08T09:08:24.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.205+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f817c1acb60 con 0x7f817c10fea0 2024-05-08T09:08:24.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.206+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f817c076dc0 con 0x7f817c10fea0 2024-05-08T09:08:24.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.210+0000 7f8172a00700 1 -- 172.21.15.70:0/3739109070 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8174005000 con 0x7f817c10fea0 2024-05-08T09:08:24.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.213+0000 7f8172a00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81600b2bc0 0x7f81600b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:24.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.213+0000 7f8172a00700 1 -- 172.21.15.70:0/3739109070 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(360..360 src has 1..360) ==== 9583+0+0 (secure 0 0 0) 0x7f81740e2c20 con 0x7f817c10fea0 2024-05-08T09:08:24.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.214+0000 7f8179e00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81600b2bc0 0x7f81600b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:24.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.215+0000 7f8179e00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81600b2bc0 0x7f81600b5080 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f816c005950 tx=0x7f816c0092a0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:08:24.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.216+0000 7f8172a00700 1 -- 172.21.15.70:0/3739109070 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8174010070 con 0x7f817c10fea0 2024-05-08T09:08:24.314 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/sunxi/sun8i-a83t-mipi-csi2/built-in.a 2024-05-08T09:08:24.333 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/sunxi/sun8i-di/built-in.a 2024-05-08T09:08:24.449 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_rc6.o 2024-05-08T09:08:24.575 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/sunxi/sun8i-rotate/built-in.a 2024-05-08T09:08:24.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.665+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f817c1ace80 con 0x7f817c10fea0 2024-05-08T09:08:24.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.666+0000 7f8172a00700 1 -- 172.21.15.70:0/3739109070 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f81740aa200 con 0x7f817c10fea0 2024-05-08T09:08:24.667 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:08:24.668 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:08:24.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81600b2bc0 msgr2=0x7f81600b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81600b2bc0 0x7f81600b5080 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f816c005950 tx=0x7f816c0092a0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f817c10fea0 msgr2=0x7f817c10cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f817c10fea0 0x7f817c10cf80 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f8174007ee0 tx=0x7f817400d3b0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 shutdown_connections 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f81600b2bc0 0x7f81600b5080 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f817c10fea0 0x7f817c10cf80 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f817c0756d0 0x7f817c10f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 --2- 172.21.15.70:0/3739109070 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f817c075ff0 0x7f817c10c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 >> 172.21.15.70:0/3739109070 conn(0x7f817c07a600 msgr2=0x7f817c1018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.669+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 shutdown_connections 2024-05-08T09:08:24.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:24.670+0000 7f8180c00700 1 -- 172.21.15.70:0/3739109070 wait complete. 2024-05-08T09:08:24.671 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:08:24.715 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/usb/built-in.a 2024-05-08T09:08:24.740 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/sunxi/built-in.a 2024-05-08T09:08:24.819 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/mii.o 2024-05-08T09:08:25.118 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/ti/am437x/built-in.a 2024-05-08T09:08:25.355 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/ti/cal/built-in.a 2024-05-08T09:08:25.761 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/ti/vpe/built-in.a 2024-05-08T09:08:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:25 smithi194 ceph-mon[33679]: pgmap v4524: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 89 op/s 2024-05-08T09:08:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:25 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3739109070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:08:25.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:25 smithi070 ceph-mon[29591]: pgmap v4524: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 89 op/s 2024-05-08T09:08:25.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:25 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3739109070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:08:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:25 smithi172 ceph-mon[33377]: pgmap v4524: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 89 op/s 2024-05-08T09:08:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:25 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3739109070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:08:25.944 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/ti/davinci/built-in.a 2024-05-08T09:08:26.160 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/ti/omap/built-in.a 2024-05-08T09:08:26.394 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/ti/omap3isp/built-in.a 2024-05-08T09:08:26.531 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/ti/built-in.a 2024-05-08T09:08:26.624 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.9 --await-for 42.0' 2024-05-08T09:08:26.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.9 --await-for 42.0 2024-05-08T09:08:26.921 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/verisilicon/built-in.a 2024-05-08T09:08:27.139 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/via/built-in.a 2024-05-08T09:08:27.229 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:08:27.380 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/xilinx/built-in.a 2024-05-08T09:08:27.594 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/platform/built-in.a 2024-05-08T09:08:27.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:27 smithi070 ceph-mon[29591]: pgmap v4525: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 889 KiB/s wr, 61 op/s 2024-05-08T09:08:27.732 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:27 smithi172 ceph-mon[33377]: pgmap v4525: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 889 KiB/s wr, 61 op/s 2024-05-08T09:08:27.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:27 smithi194 ceph-mon[33679]: pgmap v4525: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 889 KiB/s wr, 61 op/s 2024-05-08T09:08:28.480 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/ttpci/built-in.a 2024-05-08T09:08:28.694 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/b2c2/built-in.a 2024-05-08T09:08:28.904 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/pluto2/built-in.a 2024-05-08T09:08:29.180 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/dm1105/built-in.a 2024-05-08T09:08:29.382 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/pt1/built-in.a 2024-05-08T09:08:29.566 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/pt3/built-in.a 2024-05-08T09:08:29.635 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/usb/b2c2/built-in.a 2024-05-08T09:08:29.735 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:29 smithi070 ceph-mon[29591]: pgmap v4526: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 889 KiB/s wr, 61 op/s 2024-05-08T09:08:29.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:29 smithi194 ceph-mon[33679]: pgmap v4526: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 889 KiB/s wr, 61 op/s 2024-05-08T09:08:29.803 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/mantis/built-in.a 2024-05-08T09:08:29.891 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/usb/dvb-usb/built-in.a 2024-05-08T09:08:29.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:29 smithi172 ceph-mon[33377]: pgmap v4526: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 809 KiB/s rd, 889 KiB/s wr, 61 op/s 2024-05-08T09:08:30.043 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/ngene/built-in.a 2024-05-08T09:08:30.126 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/usb/dvb-usb-v2/built-in.a 2024-05-08T09:08:30.287 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/ddbridge/built-in.a 2024-05-08T09:08:30.370 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/usb/s2255/built-in.a 2024-05-08T09:08:30.523 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/saa7146/built-in.a 2024-05-08T09:08:30.618 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/usb/siano/built-in.a 2024-05-08T09:08:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.368+0000 7fe14d000700 1 -- 172.21.15.70:0/1569938733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe148075ff0 msgr2=0x7fe14810f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.368+0000 7fe14d000700 1 --2- 172.21.15.70:0/1569938733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe148075ff0 0x7fe14810f9c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe1340098f0 tx=0x7fe134009c00 comp rx=0 tx=0).stop 2024-05-08T09:08:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.368+0000 7fe14d000700 1 -- 172.21.15.70:0/1569938733 shutdown_connections 2024-05-08T09:08:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.368+0000 7fe14d000700 1 --2- 172.21.15.70:0/1569938733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe14810ff00 0x7fe1481122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.368+0000 7fe14d000700 1 --2- 172.21.15.70:0/1569938733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe1480756d0 0x7fe148075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.368+0000 7fe14d000700 1 --2- 172.21.15.70:0/1569938733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe148075ff0 0x7fe14810f9c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.368+0000 7fe14d000700 1 -- 172.21.15.70:0/1569938733 >> 172.21.15.70:0/1569938733 conn(0x7fe14807a600 msgr2=0x7fe14807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:08:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.368+0000 7fe14d000700 1 -- 172.21.15.70:0/1569938733 shutdown_connections 2024-05-08T09:08:30.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.368+0000 7fe14d000700 1 -- 172.21.15.70:0/1569938733 wait complete. 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.369+0000 7fe14d000700 1 Processor -- start 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.370+0000 7fe14d000700 1 -- start start 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.370+0000 7fe14d000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1480756d0 0x7fe148103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.370+0000 7fe14d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148075ff0 0x7fe148103b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.370+0000 7fe14d000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe14810ff00 0x7fe1481040a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.370+0000 7fe14d000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481157b0 con 0x7fe148075ff0 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.370+0000 7fe14d000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe148115630 con 0x7fe1480756d0 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.370+0000 7fe14d000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe148115930 con 0x7fe14810ff00 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.371+0000 7fe145400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148075ff0 0x7fe148103b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.371+0000 7fe145400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148075ff0 0x7fe148103b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49338/0 (socket says 172.21.15.70:49338) 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.371+0000 7fe145400700 1 -- 172.21.15.70:0/3572804193 learned_addr learned my addr 172.21.15.70:0/3572804193 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:08:30.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.371+0000 7fe146800700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe14810ff00 0x7fe1481040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.371+0000 7fe145400700 1 -- 172.21.15.70:0/3572804193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe14810ff00 msgr2=0x7fe1481040a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.371+0000 7fe145400700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe14810ff00 0x7fe1481040a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.371+0000 7fe145400700 1 -- 172.21.15.70:0/3572804193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1480756d0 msgr2=0x7fe148103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.371+0000 7fe145400700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1480756d0 0x7fe148103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.371+0000 7fe145400700 1 -- 172.21.15.70:0/3572804193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1481ac2f0 con 0x7fe148075ff0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.372+0000 7fe145400700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148075ff0 0x7fe148103b60 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fe134009230 tx=0x7fe134010fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.372+0000 7fe13ea00700 1 -- 172.21.15.70:0/3572804193 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134025070 con 0x7fe148075ff0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.372+0000 7fe14d000700 1 -- 172.21.15.70:0/3572804193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1481ac580 con 0x7fe148075ff0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.373+0000 7fe13ea00700 1 -- 172.21.15.70:0/3572804193 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe1340054d0 con 0x7fe148075ff0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.373+0000 7fe13ea00700 1 -- 172.21.15.70:0/3572804193 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe134003b50 con 0x7fe148075ff0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.373+0000 7fe14d000700 1 -- 172.21.15.70:0/3572804193 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1481aca30 con 0x7fe148075ff0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.378+0000 7fe13ea00700 1 -- 172.21.15.70:0/3572804193 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe134028070 con 0x7fe148075ff0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.379+0000 7fe13ea00700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe12c0b2b50 0x7fe12c0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.379+0000 7fe13ea00700 1 -- 172.21.15.70:0/3572804193 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(360..360 src has 1..360) ==== 9583+0+0 (secure 0 0 0) 0x7fe1340e4060 con 0x7fe148075ff0 2024-05-08T09:08:30.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.380+0000 7fe145e00700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe12c0b2b50 0x7fe12c0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.673+0000 7fe145e00700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe12c0b2b50 0x7fe12c0b5010 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe138005e50 tx=0x7fe138005da0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:08:30.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.676+0000 7fe1578c6b80 1 Processor -- start 2024-05-08T09:08:30.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.677+0000 7fe1578c6b80 1 -- start start 2024-05-08T09:08:30.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.677+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf15c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.677+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf156520 0x5579cf1569a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.677+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156ee0 0x5579cf162d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.677+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5579cf0a8bb0 con 0x5579cf15bf50 2024-05-08T09:08:30.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.677+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5579cf0468f0 con 0x5579cf156ee0 2024-05-08T09:08:30.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.677+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5579cf0a4b70 con 0x5579cf156520 2024-05-08T09:08:30.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe145e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf15c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe145e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf15c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49342/0 (socket says 172.21.15.70:49342) 2024-05-08T09:08:30.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe145e00700 1 -- 172.21.15.70:0/1524544673 learned_addr learned my addr 172.21.15.70:0/1524544673 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:08:30.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe145400700 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf156520 0x5579cf1569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe146800700 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156ee0 0x5579cf162d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe145e00700 1 -- 172.21.15.70:0/1524544673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf156520 msgr2=0x5579cf1569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:08:30.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe145e00700 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf156520 0x5579cf1569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe145e00700 1 -- 172.21.15.70:0/1524544673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156ee0 msgr2=0x5579cf162d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:08:30.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe145e00700 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156ee0 0x5579cf162d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.678+0000 7fe145e00700 1 -- 172.21.15.70:0/1524544673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579ceff5a60 con 0x5579cf15bf50 2024-05-08T09:08:30.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.679+0000 7fe145400700 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf156520 0x5579cf1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:08:30.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.679+0000 7fe145e00700 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf15c330 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fe1380044c0 tx=0x7fe138011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9f7ac17fec4b96 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:08:30.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.679+0000 7fe133400700 1 -- 172.21.15.70:0/1524544673 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138021070 con 0x5579cf15bf50 2024-05-08T09:08:30.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.679+0000 7fe133400700 1 -- 172.21.15.70:0/1524544673 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe13800ee50 con 0x5579cf15bf50 2024-05-08T09:08:30.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.679+0000 7fe133400700 1 -- 172.21.15.70:0/1524544673 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1380056c0 con 0x5579cf15bf50 2024-05-08T09:08:30.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.680+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1524544673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 msgr2=0x5579cf15c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:30.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.680+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf15c330 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fe1380044c0 tx=0x7fe138011000 comp rx=0 tx=0).stop 2024-05-08T09:08:30.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.681+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1524544673 shutdown_connections 2024-05-08T09:08:30.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.681+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156ee0 0x5579cf162d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.681+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf15c330 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.681+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1524544673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf156520 0x5579cf1569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.681+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1524544673 >> 172.21.15.70:0/1524544673 conn(0x5579cf084cf0 msgr2=0x5579cf150e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:08:30.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.681+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1524544673 shutdown_connections 2024-05-08T09:08:30.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.681+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1524544673 wait complete. 2024-05-08T09:08:30.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.681+0000 7fe1578c6b80 1 -- start start 2024-05-08T09:08:30.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.682+0000 7fe1578c6b80 1 Processor -- start 2024-05-08T09:08:30.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.682+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 0x5579cf162910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.682+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156ee0 0x5579cf15fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf15bf50 0x5579cf1601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5579cf163310 con 0x5579cf156ee0 2024-05-08T09:08:30.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5579cf00ecb0 con 0x5579cf156520 2024-05-08T09:08:30.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5579cf163490 con 0x5579cf15bf50 2024-05-08T09:08:30.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe1578c6b80 10 client.0 _ll_register_callbacks cb 0x5579cf04fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:08:30.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe145400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156ee0 0x5579cf15fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe145400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156ee0 0x5579cf15fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49358/0 (socket says 172.21.15.70:49358) 2024-05-08T09:08:30.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe145400700 1 -- 172.21.15.70:0/1619504040 learned_addr learned my addr 172.21.15.70:0/1619504040 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:08:30.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe145e00700 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 0x5579cf162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe145400700 1 -- 172.21.15.70:0/1619504040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf15bf50 msgr2=0x5579cf1601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:08:30.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe146800700 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf15bf50 0x5579cf1601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe145400700 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf15bf50 0x5579cf1601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe145400700 1 -- 172.21.15.70:0/1619504040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 msgr2=0x5579cf162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:08:30.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe145400700 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 0x5579cf162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.683+0000 7fe145400700 1 -- 172.21.15.70:0/1619504040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579cf06e5b0 con 0x5579cf156ee0 2024-05-08T09:08:30.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.684+0000 7fe146800700 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf15bf50 0x5579cf1601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:08:30.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.684+0000 7fe145400700 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156ee0 0x5579cf15fcb0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe1340aaee0 tx=0x7fe134009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea1877083032cdf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:08:30.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.684+0000 7fe127e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:08:30.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.684+0000 7fe127e00700 1 -- 172.21.15.70:0/1619504040 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1340cd040 con 0x5579cf156ee0 2024-05-08T09:08:30.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.684+0000 7fe127e00700 1 -- 172.21.15.70:0/1619504040 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(360..360 src has 1..360) ==== 9583+0+0 (secure 0 0 0) 0x7fe1340ab3c0 con 0x5579cf156ee0 2024-05-08T09:08:30.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.685+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1619504040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe13800ee50 con 0x5579cf156ee0 2024-05-08T09:08:30.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.685+0000 7fe127e00700 1 -- 172.21.15.70:0/1619504040 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe1340ca050 con 0x5579cf156ee0 2024-05-08T09:08:30.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.685+0000 7fe1578c6b80 10 client.19104 fetch_fsmap learned FSMap version 42 2024-05-08T09:08:30.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.685+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1619504040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5579cf16da80 con 0x5579cf156ee0 2024-05-08T09:08:30.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.685+0000 7fe127e00700 1 -- 172.21.15.70:0/1619504040 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe13800ee50 con 0x5579cf156ee0 2024-05-08T09:08:30.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.686+0000 7fe127e00700 1 -- 172.21.15.70:0/1619504040 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe13401f030 con 0x5579cf156ee0 2024-05-08T09:08:30.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.686+0000 7fe1578c6b80 10 client.19104 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:08:30.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.686+0000 7fe1578c6b80 10 client.19104 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:08:30.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.686+0000 7fe1578c6b80 20 client.19104 populate_metadata read hostname 'smithi070' 2024-05-08T09:08:30.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.686+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5579cf16ff50 0x5579cf172340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.686+0000 7fe1578c6b80 4 client.19104 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:08:30.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.686+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1619504040 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579cf123230 con 0x5579cf16ff50 2024-05-08T09:08:30.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.687+0000 7fe145e00700 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5579cf16ff50 0x5579cf172340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.688+0000 7fe145e00700 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5579cf16ff50 0x5579cf172340 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6340bec252561821 server_cookie=83c3202e6fe129fe in_seq=0 out_seq=0 2024-05-08T09:08:30.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.688+0000 7fe127e00700 10 client.19104 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:08:30.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.690+0000 7fe127e00700 1 -- 172.21.15.70:0/1619504040 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5579cf123230 con 0x5579cf16ff50 2024-05-08T09:08:30.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.690+0000 7fe127e00700 10 client.19104 handle_command_reply: tid=0 2024-05-08T09:08:30.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.691+0000 7fe1578c6b80 1 client.19104 shutdown 2024-05-08T09:08:30.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.691+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1619504040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156ee0 msgr2=0x5579cf15fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:30.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.691+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156ee0 0x5579cf15fcb0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe1340aaee0 tx=0x7fe134009260 comp rx=0 tx=0).stop 2024-05-08T09:08:30.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.692+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1619504040 shutdown_connections 2024-05-08T09:08:30.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.692+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5579cf16ff50 0x5579cf172340 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.692+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf15bf50 0x5579cf1601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.692+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 0x5579cf162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.692+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1619504040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156ee0 0x5579cf15fcb0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.692+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1619504040 >> 172.21.15.70:0/1619504040 conn(0x5579cf084cf0 msgr2=0x5579cf14b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:08:30.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.692+0000 7fe127e00700 0 client.19104 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:08:30.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.693+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1619504040 shutdown_connections 2024-05-08T09:08:30.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.693+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1619504040 wait complete. 2024-05-08T09:08:30.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.693+0000 7fe1578c6b80 20 client.19104 trim_cache size 0 max 16384 2024-05-08T09:08:30.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.728+0000 7fe1578c6b80 1 Processor -- start 2024-05-08T09:08:30.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.729+0000 7fe1578c6b80 1 -- start start 2024-05-08T09:08:30.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.729+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156520 0x5579cf16c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.729+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf15bf50 0x5579cf155510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.729+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 0x5579cf155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.729+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b83a0 con 0x5579cf156520 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.729+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b5c30 con 0x5579cf15bf50 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.729+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b3aa0 con 0x5579cf155a50 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.730+0000 7fe146800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 0x5579cf155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.730+0000 7fe146800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 0x5579cf155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:37146/0 (socket says 172.21.15.70:37146) 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.730+0000 7fe145400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf15bf50 0x5579cf155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.730+0000 7fe146800700 1 -- 172.21.15.70:0/1301972407 learned_addr learned my addr 172.21.15.70:0/1301972407 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:08:30.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.730+0000 7fe145e00700 1 --2- 172.21.15.70:0/1301972407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156520 0x5579cf16c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.730+0000 7fe145e00700 1 -- 172.21.15.70:0/1301972407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 msgr2=0x5579cf155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:08:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.730+0000 7fe145e00700 1 --2- 172.21.15.70:0/1301972407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 0x5579cf155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.731+0000 7fe145e00700 1 -- 172.21.15.70:0/1301972407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf15bf50 msgr2=0x5579cf155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:08:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.731+0000 7fe145e00700 1 --2- 172.21.15.70:0/1301972407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf15bf50 0x5579cf155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.731+0000 7fe145e00700 1 -- 172.21.15.70:0/1301972407 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579cf162550 con 0x5579cf156520 2024-05-08T09:08:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.731+0000 7fe145e00700 1 --2- 172.21.15.70:0/1301972407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156520 0x5579cf16c360 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe138009350 tx=0x7fe138005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95ed8e79e6c3666 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:08:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.732+0000 7fe132a00700 1 -- 172.21.15.70:0/1301972407 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138021040 con 0x5579cf156520 2024-05-08T09:08:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.732+0000 7fe132a00700 1 -- 172.21.15.70:0/1301972407 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe138033e50 con 0x5579cf156520 2024-05-08T09:08:30.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.732+0000 7fe132a00700 1 -- 172.21.15.70:0/1301972407 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe138004830 con 0x5579cf156520 2024-05-08T09:08:30.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.733+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1301972407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156520 msgr2=0x5579cf16c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:30.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.733+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1301972407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156520 0x5579cf16c360 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fe138009350 tx=0x7fe138005fb0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.733+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1301972407 shutdown_connections 2024-05-08T09:08:30.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.733+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1301972407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 0x5579cf155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.733+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1301972407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf156520 0x5579cf16c360 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.733+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1301972407 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf15bf50 0x5579cf155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.733+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1301972407 >> 172.21.15.70:0/1301972407 conn(0x5579cf084cf0 msgr2=0x5579cf15ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:08:30.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.734+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1301972407 shutdown_connections 2024-05-08T09:08:30.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.734+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1301972407 wait complete. 2024-05-08T09:08:30.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.735+0000 7fe1578c6b80 1 -- start start 2024-05-08T09:08:30.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.735+0000 7fe1578c6b80 1 Processor -- start 2024-05-08T09:08:30.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.736+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 0x5579cf168e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.736+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 0x5579cf1656b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.736+0000 7fe1578c6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf165df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.736+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b40f0 con 0x5579cf15bf50 2024-05-08T09:08:30.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.736+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b5560 con 0x5579cf156520 2024-05-08T09:08:30.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.736+0000 7fe1578c6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe1481b47c0 con 0x5579cf155a50 2024-05-08T09:08:30.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.736+0000 7fe1578c6b80 10 client.0 _ll_register_callbacks cb 0x5579cf04fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:08:30.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe146800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf165df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe146800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf165df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49390/0 (socket says 172.21.15.70:49390) 2024-05-08T09:08:30.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe146800700 1 -- 172.21.15.70:0/1222062709 learned_addr learned my addr 172.21.15.70:0/1222062709 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:08:30.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe145400700 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 0x5579cf1656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe145e00700 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 0x5579cf168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe146800700 1 -- 172.21.15.70:0/1222062709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 msgr2=0x5579cf168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:08:30.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe146800700 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 0x5579cf168e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe146800700 1 -- 172.21.15.70:0/1222062709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 msgr2=0x5579cf1656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:08:30.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe146800700 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 0x5579cf1656b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:30.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe146800700 1 -- 172.21.15.70:0/1222062709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579cf1da810 con 0x5579cf15bf50 2024-05-08T09:08:30.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.737+0000 7fe145400700 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 0x5579cf1656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:08:30.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.738+0000 7fe146800700 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf165df0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fe140007f00 tx=0x7fe140009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409e8d8a5043d0c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:08:30.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.738+0000 7fe127e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:08:30.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.738+0000 7fe127e00700 1 -- 172.21.15.70:0/1222062709 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14001b070 con 0x5579cf15bf50 2024-05-08T09:08:30.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.738+0000 7fe127e00700 1 -- 172.21.15.70:0/1222062709 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(360..360 src has 1..360) ==== 9583+0+0 (secure 0 0 0) 0x7fe140015bb0 con 0x5579cf15bf50 2024-05-08T09:08:30.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.739+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1222062709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe138033e50 con 0x5579cf15bf50 2024-05-08T09:08:30.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.739+0000 7fe127e00700 1 -- 172.21.15.70:0/1222062709 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fe140015db0 con 0x5579cf15bf50 2024-05-08T09:08:30.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.739+0000 7fe1578c6b80 10 client.19110 fetch_fsmap learned FSMap version 42 2024-05-08T09:08:30.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.739+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1222062709 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5579cf1dba60 con 0x5579cf15bf50 2024-05-08T09:08:30.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.740+0000 7fe127e00700 1 -- 172.21.15.70:0/1222062709 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe138033e50 con 0x5579cf15bf50 2024-05-08T09:08:30.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.740+0000 7fe127e00700 1 -- 172.21.15.70:0/1222062709 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fe140017410 con 0x5579cf15bf50 2024-05-08T09:08:30.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.740+0000 7fe1578c6b80 10 client.19110 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:08:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.740+0000 7fe1578c6b80 10 client.19110 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:08:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.740+0000 7fe1578c6b80 20 client.19110 populate_metadata read hostname 'smithi070' 2024-05-08T09:08:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.740+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5579cf1dc190 0x5579cf1de5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:08:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.740+0000 7fe1578c6b80 4 client.19110 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.9, "await_for": 42.0}] 2024-05-08T09:08:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.740+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1222062709 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.9, "await_for": 42.0}) -- 0x5579cf0b6590 con 0x5579cf1dc190 2024-05-08T09:08:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.741+0000 7fe145e00700 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5579cf1dc190 0x5579cf1de5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:08:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.742+0000 7fe127e00700 10 client.19110 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:08:30.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:30.742+0000 7fe145e00700 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5579cf1dc190 0x5579cf1de5b0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e992a22f915ae8 server_cookie=40f976fef001ea4f in_seq=0 out_seq=0 2024-05-08T09:08:30.829 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/smipcie/built-in.a 2024-05-08T09:08:30.989 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/storage/built-in.a 2024-05-08T09:08:31.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:31 smithi194 ceph-mon[33679]: pgmap v4527: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 85 op/s 2024-05-08T09:08:31.767 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/usb/ttusb-budget/built-in.a 2024-05-08T09:08:31.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:31 smithi070 ceph-mon[29591]: pgmap v4527: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 85 op/s 2024-05-08T09:08:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:31 smithi172 ceph-mon[33377]: pgmap v4527: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 85 op/s 2024-05-08T09:08:33.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:33 smithi194 ceph-mon[33679]: pgmap v4528: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 806 KiB/s wr, 51 op/s 2024-05-08T09:08:33.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:33 smithi070 ceph-mon[29591]: pgmap v4528: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 806 KiB/s wr, 51 op/s 2024-05-08T09:08:33.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:33 smithi172 ceph-mon[33377]: pgmap v4528: 129 pgs: 129 active+clean; 2.0 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 806 KiB/s wr, 51 op/s 2024-05-08T09:08:35.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:35 smithi194 ceph-mon[33679]: pgmap v4529: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 74 op/s 2024-05-08T09:08:35.824 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:35 smithi070 ceph-mon[29591]: pgmap v4529: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 74 op/s 2024-05-08T09:08:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:35 smithi172 ceph-mon[33377]: pgmap v4529: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 74 op/s 2024-05-08T09:08:37.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:37 smithi194 ceph-mon[33679]: pgmap v4530: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 652 KiB/s wr, 46 op/s 2024-05-08T09:08:37.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:37 smithi070 ceph-mon[29591]: pgmap v4530: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 652 KiB/s wr, 46 op/s 2024-05-08T09:08:37.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:37 smithi172 ceph-mon[33377]: pgmap v4530: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 652 KiB/s wr, 46 op/s 2024-05-08T09:08:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:39 smithi194 ceph-mon[33679]: pgmap v4531: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 652 KiB/s wr, 46 op/s 2024-05-08T09:08:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:39 smithi070 ceph-mon[29591]: pgmap v4531: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 652 KiB/s wr, 46 op/s 2024-05-08T09:08:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:39 smithi172 ceph-mon[33377]: pgmap v4531: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 652 KiB/s wr, 46 op/s 2024-05-08T09:08:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:41 smithi070 ceph-mon[29591]: pgmap v4532: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 667 KiB/s wr, 54 op/s 2024-05-08T09:08:41.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:41 smithi172 ceph-mon[33377]: pgmap v4532: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 667 KiB/s wr, 54 op/s 2024-05-08T09:08:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:41 smithi194 ceph-mon[33679]: pgmap v4532: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 667 KiB/s wr, 54 op/s 2024-05-08T09:08:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:43 smithi070 ceph-mon[29591]: pgmap v4533: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 350 KiB/s wr, 31 op/s 2024-05-08T09:08:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:43 smithi172 ceph-mon[33377]: pgmap v4533: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 350 KiB/s wr, 31 op/s 2024-05-08T09:08:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:43 smithi194 ceph-mon[33679]: pgmap v4533: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 350 KiB/s wr, 31 op/s 2024-05-08T09:08:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:45 smithi070 ceph-mon[29591]: pgmap v4534: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 415 KiB/s wr, 36 op/s 2024-05-08T09:08:45.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:45 smithi172 ceph-mon[33377]: pgmap v4534: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 415 KiB/s wr, 36 op/s 2024-05-08T09:08:46.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:45 smithi194 ceph-mon[33679]: pgmap v4534: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 395 KiB/s rd, 415 KiB/s wr, 36 op/s 2024-05-08T09:08:47.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:47 smithi070 ceph-mon[29591]: pgmap v4535: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 81 KiB/s wr, 13 op/s 2024-05-08T09:08:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:47 smithi172 ceph-mon[33377]: pgmap v4535: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 81 KiB/s wr, 13 op/s 2024-05-08T09:08:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:47 smithi194 ceph-mon[33679]: pgmap v4535: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 81 KiB/s wr, 13 op/s 2024-05-08T09:08:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:49 smithi070 ceph-mon[29591]: pgmap v4536: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 81 KiB/s wr, 13 op/s 2024-05-08T09:08:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:49 smithi172 ceph-mon[33377]: pgmap v4536: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 81 KiB/s wr, 13 op/s 2024-05-08T09:08:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:49 smithi194 ceph-mon[33679]: pgmap v4536: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 81 KiB/s wr, 13 op/s 2024-05-08T09:08:50.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:08:50.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:08:51.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:08:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:51 smithi070 ceph-mon[29591]: pgmap v4537: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 184 KiB/s wr, 18 op/s 2024-05-08T09:08:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:08:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:08:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:08:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:51 smithi172 ceph-mon[33377]: pgmap v4537: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 184 KiB/s wr, 18 op/s 2024-05-08T09:08:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:08:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:08:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:08:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:51 smithi194 ceph-mon[33679]: pgmap v4537: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 184 KiB/s wr, 18 op/s 2024-05-08T09:08:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:08:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:08:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:08:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:53 smithi070 ceph-mon[29591]: pgmap v4538: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 169 KiB/s wr, 9 op/s 2024-05-08T09:08:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:53 smithi172 ceph-mon[33377]: pgmap v4538: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 169 KiB/s wr, 9 op/s 2024-05-08T09:08:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:53 smithi194 ceph-mon[33679]: pgmap v4538: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 169 KiB/s wr, 9 op/s 2024-05-08T09:08:54.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.880+0000 7fe127e00700 1 -- 172.21.15.70:0/1222062709 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5579cf0b6590 con 0x5579cf1dc190 2024-05-08T09:08:54.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.880+0000 7fe127e00700 10 client.19110 handle_command_reply: tid=0 2024-05-08T09:08:54.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.880+0000 7fe1578c6b80 1 client.19110 shutdown 2024-05-08T09:08:54.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.881+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1222062709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 msgr2=0x5579cf165df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:54.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.881+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf165df0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fe140007f00 tx=0x7fe140009280 comp rx=0 tx=0).stop 2024-05-08T09:08:54.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.881+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1222062709 shutdown_connections 2024-05-08T09:08:54.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.881+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5579cf1dc190 0x5579cf1de5b0 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.881+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5579cf15bf50 0x5579cf165df0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.881+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5579cf155a50 0x5579cf168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.881+0000 7fe1578c6b80 1 --2- 172.21.15.70:0/1222062709 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5579cf156520 0x5579cf1656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.882+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1222062709 >> 172.21.15.70:0/1222062709 conn(0x5579cf084cf0 msgr2=0x5579cf1599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:08:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.882+0000 7fe127e00700 0 client.19110 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:08:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.882+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1222062709 shutdown_connections 2024-05-08T09:08:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.882+0000 7fe1578c6b80 1 -- 172.21.15.70:0/1222062709 wait complete. 2024-05-08T09:08:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.883+0000 7fe1578c6b80 20 client.19110 trim_cache size 0 max 16384 2024-05-08T09:08:54.884 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:08:54.884 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:08:54.884 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:08:54.884 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 314, 2024-05-08T09:08:54.884 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:08:54.884 INFO:teuthology.orchestra.run.smithi070.stdout: "ba418f5b": { 2024-05-08T09:08:54.884 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 314, 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.9, 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:08:54.885 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:08:54.886 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:08:54.886 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:08:54.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:08:54.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:08:54.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:08:54.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:08:54.886 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:08:54.886 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:08:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.884+0000 7fe14d000700 1 -- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe12c0b2b50 msgr2=0x7fe12c0b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.884+0000 7fe14d000700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe12c0b2b50 0x7fe12c0b5010 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe138005e50 tx=0x7fe138005da0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.884+0000 7fe14d000700 1 -- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148075ff0 msgr2=0x7fe148103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:08:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.884+0000 7fe14d000700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148075ff0 0x7fe148103b60 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fe134009230 tx=0x7fe134010fe0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.885+0000 7fe14d000700 1 -- 172.21.15.70:0/3572804193 shutdown_connections 2024-05-08T09:08:54.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.885+0000 7fe14d000700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe12c0b2b50 0x7fe12c0b5010 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.885+0000 7fe14d000700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe14810ff00 0x7fe1481040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.885+0000 7fe14d000700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe1480756d0 0x7fe148103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.885+0000 7fe14d000700 1 --2- 172.21.15.70:0/3572804193 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe148075ff0 0x7fe148103b60 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:08:54.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.885+0000 7fe14d000700 1 -- 172.21.15.70:0/3572804193 >> 172.21.15.70:0/3572804193 conn(0x7fe14807a600 msgr2=0x7fe1481006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:08:54.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.885+0000 7fe14d000700 1 -- 172.21.15.70:0/3572804193 shutdown_connections 2024-05-08T09:08:54.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:08:54.886+0000 7fe14d000700 1 -- 172.21.15.70:0/3572804193 wait complete. 2024-05-08T09:08:54.971 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/mmc/siano/built-in.a 2024-05-08T09:08:55.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:55 smithi070 ceph-mon[29591]: pgmap v4539: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 296 KiB/s wr, 17 op/s 2024-05-08T09:08:55.778 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ba418f5b', quiesce took 39.8 seconds. Will release after: 19.9 2024-05-08T09:08:55.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:55 smithi172 ceph-mon[33377]: pgmap v4539: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 296 KiB/s wr, 17 op/s 2024-05-08T09:08:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:55 smithi194 ceph-mon[33679]: pgmap v4539: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 296 KiB/s wr, 17 op/s 2024-05-08T09:08:57.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:57 smithi070 ceph-mon[29591]: pgmap v4540: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 230 KiB/s wr, 11 op/s 2024-05-08T09:08:57.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:57 smithi172 ceph-mon[33377]: pgmap v4540: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 230 KiB/s wr, 11 op/s 2024-05-08T09:08:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:57 smithi194 ceph-mon[33679]: pgmap v4540: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 230 KiB/s wr, 11 op/s 2024-05-08T09:08:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:08:59 smithi070 ceph-mon[29591]: pgmap v4541: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 230 KiB/s wr, 11 op/s 2024-05-08T09:08:59.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:08:59 smithi172 ceph-mon[33377]: pgmap v4541: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 230 KiB/s wr, 11 op/s 2024-05-08T09:09:00.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:08:59 smithi194 ceph-mon[33679]: pgmap v4541: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 230 KiB/s wr, 11 op/s 2024-05-08T09:09:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:01 smithi070 ceph-mon[29591]: pgmap v4542: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 316 KiB/s wr, 16 op/s 2024-05-08T09:09:01.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:01 smithi172 ceph-mon[33377]: pgmap v4542: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 316 KiB/s wr, 16 op/s 2024-05-08T09:09:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:01 smithi194 ceph-mon[33679]: pgmap v4542: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 316 KiB/s wr, 16 op/s 2024-05-08T09:09:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:03 smithi070 ceph-mon[29591]: pgmap v4543: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 212 KiB/s wr, 12 op/s 2024-05-08T09:09:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:03 smithi172 ceph-mon[33377]: pgmap v4543: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 212 KiB/s wr, 12 op/s 2024-05-08T09:09:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:03 smithi194 ceph-mon[33679]: pgmap v4543: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 212 KiB/s wr, 12 op/s 2024-05-08T09:09:05.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:05 smithi070 ceph-mon[29591]: pgmap v4544: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 292 KiB/s wr, 32 op/s 2024-05-08T09:09:05.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:05 smithi172 ceph-mon[33377]: pgmap v4544: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 292 KiB/s wr, 32 op/s 2024-05-08T09:09:06.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:05 smithi194 ceph-mon[33679]: pgmap v4544: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 292 KiB/s wr, 32 op/s 2024-05-08T09:09:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:07 smithi070 ceph-mon[29591]: pgmap v4545: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 166 KiB/s wr, 25 op/s 2024-05-08T09:09:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:07 smithi172 ceph-mon[33377]: pgmap v4545: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 166 KiB/s wr, 25 op/s 2024-05-08T09:09:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:07 smithi194 ceph-mon[33679]: pgmap v4545: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 166 KiB/s wr, 25 op/s 2024-05-08T09:09:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:09 smithi070 ceph-mon[29591]: pgmap v4546: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 166 KiB/s wr, 25 op/s 2024-05-08T09:09:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:09 smithi070 ceph-mon[29591]: osdmap e361: 12 total, 12 up, 12 in 2024-05-08T09:09:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:09 smithi172 ceph-mon[33377]: pgmap v4546: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 166 KiB/s wr, 25 op/s 2024-05-08T09:09:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:09 smithi172 ceph-mon[33377]: osdmap e361: 12 total, 12 up, 12 in 2024-05-08T09:09:10.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:09 smithi194 ceph-mon[33679]: pgmap v4546: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 166 KiB/s wr, 25 op/s 2024-05-08T09:09:10.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:09 smithi194 ceph-mon[33679]: osdmap e361: 12 total, 12 up, 12 in 2024-05-08T09:09:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:11 smithi070 ceph-mon[29591]: pgmap v4548: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 118 KiB/s wr, 27 op/s 2024-05-08T09:09:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:11 smithi172 ceph-mon[33377]: pgmap v4548: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 118 KiB/s wr, 27 op/s 2024-05-08T09:09:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:11 smithi194 ceph-mon[33679]: pgmap v4548: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 118 KiB/s wr, 27 op/s 2024-05-08T09:09:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:13 smithi172 ceph-mon[33377]: pgmap v4549: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 118 KiB/s wr, 27 op/s 2024-05-08T09:09:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:13 smithi194 ceph-mon[33679]: pgmap v4549: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 118 KiB/s wr, 27 op/s 2024-05-08T09:09:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:13 smithi070 ceph-mon[29591]: pgmap v4549: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 118 KiB/s wr, 27 op/s 2024-05-08T09:09:15.680 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:09:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:15 smithi172 ceph-mon[33377]: pgmap v4550: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T09:09:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:15 smithi194 ceph-mon[33679]: pgmap v4550: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T09:09:16.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:15 smithi070 ceph-mon[29591]: pgmap v4550: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T09:09:16.133 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:09:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:17 smithi194 ceph-mon[33679]: osdmap e362: 12 total, 12 up, 12 in 2024-05-08T09:09:17.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:17 smithi194 ceph-mon[33679]: pgmap v4552: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-05-08T09:09:17.617 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:17 smithi070 ceph-mon[29591]: osdmap e362: 12 total, 12 up, 12 in 2024-05-08T09:09:17.618 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:17 smithi070 ceph-mon[29591]: pgmap v4552: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-05-08T09:09:17.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:17 smithi172 ceph-mon[33377]: osdmap e362: 12 total, 12 up, 12 in 2024-05-08T09:09:17.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:17 smithi172 ceph-mon[33377]: pgmap v4552: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 28 KiB/s wr, 7 op/s 2024-05-08T09:09:18.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.442+0000 7f1ced600700 1 -- 172.21.15.70:0/3173259170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce8106080 msgr2=0x7f1ce8112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.442+0000 7f1ced600700 1 --2- 172.21.15.70:0/3173259170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce8106080 0x7f1ce8112590 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f1ce000b0a0 tx=0x7f1ce000b3b0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.442+0000 7f1ced600700 1 -- 172.21.15.70:0/3173259170 shutdown_connections 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.442+0000 7f1ced600700 1 --2- 172.21.15.70:0/3173259170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce8106080 0x7f1ce8112590 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.442+0000 7f1ced600700 1 --2- 172.21.15.70:0/3173259170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce810b6c0 0x7f1ce810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.442+0000 7f1ced600700 1 --2- 172.21.15.70:0/3173259170 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce81056c0 0x7f1ce8105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.442+0000 7f1ced600700 1 -- 172.21.15.70:0/3173259170 >> 172.21.15.70:0/3173259170 conn(0x7f1ce81011b0 msgr2=0x7f1ce81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.443+0000 7f1ced600700 1 -- 172.21.15.70:0/3173259170 shutdown_connections 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.443+0000 7f1ced600700 1 -- 172.21.15.70:0/3173259170 wait complete. 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.443+0000 7f1ced600700 1 Processor -- start 2024-05-08T09:09:18.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ced600700 1 -- start start 2024-05-08T09:09:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ced600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce81056c0 0x7f1ce81a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ced600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce8106080 0x7f1ce81a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:18.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ced600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce810b6c0 0x7f1ce819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ced600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8115800 con 0x7f1ce81056c0 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ced600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8115680 con 0x7f1ce8106080 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ced600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce8115980 con 0x7f1ce810b6c0 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ce6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce81056c0 0x7f1ce81a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ce6a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce81056c0 0x7f1ce81a1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54702/0 (socket says 172.21.15.70:54702) 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.444+0000 7f1ce6a00700 1 -- 172.21.15.70:0/96600425 learned_addr learned my addr 172.21.15.70:0/96600425 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce6000700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce8106080 0x7f1ce81a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce7400700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce810b6c0 0x7f1ce819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce6a00700 1 -- 172.21.15.70:0/96600425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce810b6c0 msgr2=0x7f1ce819ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce6a00700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce810b6c0 0x7f1ce819ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce6a00700 1 -- 172.21.15.70:0/96600425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce8106080 msgr2=0x7f1ce81a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce6a00700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce8106080 0x7f1ce81a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce6a00700 1 -- 172.21.15.70:0/96600425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce819c1a0 con 0x7f1ce81056c0 2024-05-08T09:09:18.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce7400700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce810b6c0 0x7f1ce819ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:09:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce6000700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce8106080 0x7f1ce81a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:09:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.445+0000 7f1ce6a00700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce81056c0 0x7f1ce81a1880 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800d980 tx=0x7f1cd800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.446+0000 7f1cdf400700 1 -- 172.21.15.70:0/96600425 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8017070 con 0x7f1ce81056c0 2024-05-08T09:09:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.446+0000 7f1cdf400700 1 -- 172.21.15.70:0/96600425 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1cd8004830 con 0x7f1ce81056c0 2024-05-08T09:09:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.446+0000 7f1cdf400700 1 -- 172.21.15.70:0/96600425 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80053a0 con 0x7f1ce81056c0 2024-05-08T09:09:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.446+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce819c490 con 0x7f1ce81056c0 2024-05-08T09:09:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.446+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce81a8750 con 0x7f1ce81056c0 2024-05-08T09:09:18.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.447+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce806a190 con 0x7f1ce81056c0 2024-05-08T09:09:18.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.450+0000 7f1cdf400700 1 -- 172.21.15.70:0/96600425 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1cd80049e0 con 0x7f1ce81056c0 2024-05-08T09:09:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.451+0000 7f1cdf400700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ccc0b29f0 0x7f1ccc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.451+0000 7f1cdf400700 1 -- 172.21.15.70:0/96600425 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(362..362 src has 1..362) ==== 9583+0+0 (secure 0 0 0) 0x7f1cd80e2df0 con 0x7f1ce81056c0 2024-05-08T09:09:18.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.451+0000 7f1ce6000700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ccc0b29f0 0x7f1ccc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:18.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.452+0000 7f1ce6000700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ccc0b29f0 0x7f1ccc0b4eb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4005fd0 tx=0x7f1cd4005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:18.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.454+0000 7f1cdf400700 1 -- 172.21.15.70:0/96600425 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1cd8020020 con 0x7f1ce81056c0 2024-05-08T09:09:18.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.737+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ce802e510 con 0x7f1ce81056c0 2024-05-08T09:09:18.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.738+0000 7f1cdf400700 1 -- 172.21.15.70:0/96600425 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f1cd80aa350 con 0x7f1ce81056c0 2024-05-08T09:09:18.739 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:09:18.739 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:09:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ccc0b29f0 msgr2=0x7f1ccc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ccc0b29f0 0x7f1ccc0b4eb0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4005fd0 tx=0x7f1cd4005e30 comp rx=0 tx=0).stop 2024-05-08T09:09:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce81056c0 msgr2=0x7f1ce81a1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce81056c0 0x7f1ce81a1880 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800d980 tx=0x7f1cd800dd40 comp rx=0 tx=0).stop 2024-05-08T09:09:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 shutdown_connections 2024-05-08T09:09:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1ccc0b29f0 0x7f1ccc0b4eb0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ce810b6c0 0x7f1ce819ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ce81056c0 0x7f1ce81a1880 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 --2- 172.21.15.70:0/96600425 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1ce8106080 0x7f1ce81a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 >> 172.21.15.70:0/96600425 conn(0x7f1ce81011b0 msgr2=0x7f1ce81016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 shutdown_connections 2024-05-08T09:09:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:18.742+0000 7f1ced600700 1 -- 172.21.15.70:0/96600425 wait complete. 2024-05-08T09:09:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:09:19.619 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id ba418f5b --release --await' 2024-05-08T09:09:19.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id ba418f5b --release --await 2024-05-08T09:09:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:19 smithi194 ceph-mon[33679]: pgmap v4553: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T09:09:19.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:19 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/96600425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:09:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:19 smithi070 ceph-mon[29591]: pgmap v4553: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T09:09:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:19 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/96600425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:09:19.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:19 smithi172 ceph-mon[33377]: pgmap v4553: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 23 KiB/s wr, 6 op/s 2024-05-08T09:09:19.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:19 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/96600425' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:09:20.067 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:09:21.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:21 smithi194 ceph-mon[33679]: pgmap v4554: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:09:21.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:21 smithi070 ceph-mon[29591]: pgmap v4554: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:09:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:21 smithi172 ceph-mon[33377]: pgmap v4554: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:09:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.501+0000 7f544a800700 1 -- 172.21.15.70:0/1167285731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544406c4f0 msgr2=0x7f544410fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.501+0000 7f544a800700 1 --2- 172.21.15.70:0/1167285731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544406c4f0 0x7f544410fa40 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f542c009990 tx=0x7f542c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.501+0000 7f544a800700 1 -- 172.21.15.70:0/1167285731 shutdown_connections 2024-05-08T09:09:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.501+0000 7f544a800700 1 --2- 172.21.15.70:0/1167285731 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544410ff80 0x7f5444112370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.501+0000 7f544a800700 1 --2- 172.21.15.70:0/1167285731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f544406bbd0 0x7f544406bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.501+0000 7f544a800700 1 --2- 172.21.15.70:0/1167285731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544406c4f0 0x7f544410fa40 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.501+0000 7f544a800700 1 -- 172.21.15.70:0/1167285731 >> 172.21.15.70:0/1167285731 conn(0x7f5444079350 msgr2=0x7f5444079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.501+0000 7f544a800700 1 -- 172.21.15.70:0/1167285731 shutdown_connections 2024-05-08T09:09:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.501+0000 7f544a800700 1 -- 172.21.15.70:0/1167285731 wait complete. 2024-05-08T09:09:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.502+0000 7f544a800700 1 Processor -- start 2024-05-08T09:09:22.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.502+0000 7f544a800700 1 -- start start 2024-05-08T09:09:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f544a800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f544406bbd0 0x7f54441a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f544a800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544406c4f0 0x7f54441a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f544a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544410ff80 0x7f544419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f544a800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5444115760 con 0x7f544410ff80 2024-05-08T09:09:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f544a800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54441155e0 con 0x7f544406c4f0 2024-05-08T09:09:22.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f544a800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f54441158e0 con 0x7f544406bbd0 2024-05-08T09:09:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f5443e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544410ff80 0x7f544419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f5443e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544410ff80 0x7f544419ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54722/0 (socket says 172.21.15.70:54722) 2024-05-08T09:09:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f5443e00700 1 -- 172.21.15.70:0/2383663962 learned_addr learned my addr 172.21.15.70:0/2383663962 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f5443e00700 1 -- 172.21.15.70:0/2383663962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f544406bbd0 msgr2=0x7f54441a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f5443e00700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f544406bbd0 0x7f54441a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.503+0000 7f5443e00700 1 -- 172.21.15.70:0/2383663962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544406c4f0 msgr2=0x7f54441a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.504+0000 7f5443e00700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544406c4f0 0x7f54441a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.504+0000 7f5443e00700 1 -- 172.21.15.70:0/2383663962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544419c1a0 con 0x7f544410ff80 2024-05-08T09:09:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.504+0000 7f5443e00700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544410ff80 0x7f544419ba40 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f543c007d40 tx=0x7f543c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.504+0000 7f5440c00700 1 -- 172.21.15.70:0/2383663962 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c016020 con 0x7f544410ff80 2024-05-08T09:09:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.504+0000 7f5440c00700 1 -- 172.21.15.70:0/2383663962 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f543c00ad40 con 0x7f544410ff80 2024-05-08T09:09:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.504+0000 7f544a800700 1 -- 172.21.15.70:0/2383663962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f544419c490 con 0x7f544410ff80 2024-05-08T09:09:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.504+0000 7f5440c00700 1 -- 172.21.15.70:0/2383663962 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c0115e0 con 0x7f544410ff80 2024-05-08T09:09:22.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.504+0000 7f544a800700 1 -- 172.21.15.70:0/2383663962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54441a8750 con 0x7f544410ff80 2024-05-08T09:09:22.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.508+0000 7f5440c00700 1 -- 172.21.15.70:0/2383663962 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f543c019020 con 0x7f544410ff80 2024-05-08T09:09:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.509+0000 7f5440c00700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54280b2a70 0x7f54280b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.509+0000 7f5440c00700 1 -- 172.21.15.70:0/2383663962 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(362..362 src has 1..362) ==== 9583+0+0 (secure 0 0 0) 0x7f543c0e28a0 con 0x7f544410ff80 2024-05-08T09:09:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.510+0000 7f5443400700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54280b2a70 0x7f54280b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.510+0000 7f5443400700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54280b2a70 0x7f54280b4f30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5434005fd0 tx=0x7f5434005d00 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.532+0000 7f54551dcb80 1 Processor -- start 2024-05-08T09:09:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.532+0000 7f54551dcb80 1 -- start start 2024-05-08T09:09:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f2342a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f22e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f23ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f54551dcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55982f180b20 con 0x55982f22e490 2024-05-08T09:09:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f54551dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55982f11e860 con 0x55982f22ee50 2024-05-08T09:09:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f54551dcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55982f17cae0 con 0x55982f233ec0 2024-05-08T09:09:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f543be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f22e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f543be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f22e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54738/0 (socket says 172.21.15.70:54738) 2024-05-08T09:09:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f543be00700 1 -- 172.21.15.70:0/1092593984 learned_addr learned my addr 172.21.15.70:0/1092593984 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f5443400700 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f2342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.533+0000 7f5443e00700 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f23ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.534+0000 7f543be00700 1 -- 172.21.15.70:0/1092593984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 msgr2=0x55982f2342a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.534+0000 7f543be00700 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f2342a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.534+0000 7f543be00700 1 -- 172.21.15.70:0/1092593984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 msgr2=0x55982f23ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.534+0000 7f543be00700 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f23ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.534+0000 7f543be00700 1 -- 172.21.15.70:0/1092593984 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55982f0cd9d0 con 0x55982f22e490 2024-05-08T09:09:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.534+0000 7f5443e00700 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f23ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:09:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.534+0000 7f543be00700 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f22e910 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f542c00b5c0 tx=0x7f542c0096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e64c556fa1e49a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.535+0000 7f5438c00700 1 -- 172.21.15.70:0/1092593984 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c0050c0 con 0x55982f22e490 2024-05-08T09:09:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.535+0000 7f5438c00700 1 -- 172.21.15.70:0/1092593984 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f542c0037c0 con 0x55982f22e490 2024-05-08T09:09:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.535+0000 7f5438c00700 1 -- 172.21.15.70:0/1092593984 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c00b9d0 con 0x55982f22e490 2024-05-08T09:09:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.535+0000 7f54551dcb80 1 -- 172.21.15.70:0/1092593984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 msgr2=0x55982f22e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.535+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f22e910 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f542c00b5c0 tx=0x7f542c0096a0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.536+0000 7f54551dcb80 1 -- 172.21.15.70:0/1092593984 shutdown_connections 2024-05-08T09:09:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.536+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f23ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.536+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f2342a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.536+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1092593984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f22e910 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.536+0000 7f54551dcb80 1 -- 172.21.15.70:0/1092593984 >> 172.21.15.70:0/1092593984 conn(0x55982f15cc60 msgr2=0x55982f228d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:22.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.536+0000 7f54551dcb80 1 -- 172.21.15.70:0/1092593984 shutdown_connections 2024-05-08T09:09:22.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.536+0000 7f54551dcb80 1 -- 172.21.15.70:0/1092593984 wait complete. 2024-05-08T09:09:22.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.536+0000 7f54551dcb80 1 -- start start 2024-05-08T09:09:22.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f54551dcb80 1 Processor -- start 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f23a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f237ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f2380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f54551dcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55982f23b220 con 0x55982f22e490 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f54551dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55982f0e6c20 con 0x55982f22ee50 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f54551dcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55982f23b3a0 con 0x55982f233ec0 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f54551dcb80 10 client.0 _ll_register_callbacks cb 0x55982f127d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f5443400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f23a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f5443400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f23a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54742/0 (socket says 172.21.15.70:54742) 2024-05-08T09:09:22.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.537+0000 7f5443400700 1 -- 172.21.15.70:0/1043259997 learned_addr learned my addr 172.21.15.70:0/1043259997 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f5443e00700 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f2380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f543be00700 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f237ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f5443400700 1 -- 172.21.15.70:0/1043259997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 msgr2=0x55982f2380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f5443400700 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f2380e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f5443400700 1 -- 172.21.15.70:0/1043259997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 msgr2=0x55982f237ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f5443400700 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f237ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f5443400700 1 -- 172.21.15.70:0/1043259997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55982f146520 con 0x55982f22e490 2024-05-08T09:09:22.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f543be00700 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f237ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:09:22.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f5443400700 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f23a800 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f543400f7f0 tx=0x7f5434004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d26860b83de548 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.538+0000 7f5431600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:09:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.539+0000 7f5431600700 1 -- 172.21.15.70:0/1043259997 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5434022030 con 0x55982f22e490 2024-05-08T09:09:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.539+0000 7f5431600700 1 -- 172.21.15.70:0/1043259997 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(362..362 src has 1..362) ==== 9583+0+0 (secure 0 0 0) 0x7f5434004830 con 0x55982f22e490 2024-05-08T09:09:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.539+0000 7f54551dcb80 1 -- 172.21.15.70:0/1043259997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f542c0037c0 con 0x55982f22e490 2024-05-08T09:09:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.539+0000 7f5431600700 1 -- 172.21.15.70:0/1043259997 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f543402e050 con 0x55982f22e490 2024-05-08T09:09:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.539+0000 7f54551dcb80 10 client.19128 fetch_fsmap learned FSMap version 42 2024-05-08T09:09:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.539+0000 7f54551dcb80 1 -- 172.21.15.70:0/1043259997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55982f2459a0 con 0x55982f22e490 2024-05-08T09:09:22.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.539+0000 7f5431600700 1 -- 172.21.15.70:0/1043259997 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f542c0037c0 con 0x55982f22e490 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.540+0000 7f5431600700 1 -- 172.21.15.70:0/1043259997 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f543401b050 con 0x55982f22e490 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.540+0000 7f54551dcb80 10 client.19128 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.540+0000 7f54551dcb80 10 client.19128 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.540+0000 7f54551dcb80 20 client.19128 populate_metadata read hostname 'smithi070' 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.540+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55982f247f80 0x55982f24a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.540+0000 7f54551dcb80 4 client.19128 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.540+0000 7f54551dcb80 1 -- 172.21.15.70:0/1043259997 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55982f1fb1a0 con 0x55982f247f80 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.541+0000 7f543be00700 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55982f247f80 0x55982f24a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.541+0000 7f543be00700 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55982f247f80 0x55982f24a3d0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be67e80035c42225 server_cookie=4b8fb33e60441fac in_seq=0 out_seq=0 2024-05-08T09:09:22.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.541+0000 7f5431600700 10 client.19128 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:09:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.543+0000 7f5431600700 1 -- 172.21.15.70:0/1043259997 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55982f1fb1a0 con 0x55982f247f80 2024-05-08T09:09:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.543+0000 7f5431600700 10 client.19128 handle_command_reply: tid=0 2024-05-08T09:09:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 client.19128 shutdown 2024-05-08T09:09:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 -- 172.21.15.70:0/1043259997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 msgr2=0x55982f23a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:22.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f23a800 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f543400f7f0 tx=0x7f5434004750 comp rx=0 tx=0).stop 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 -- 172.21.15.70:0/1043259997 shutdown_connections 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55982f247f80 0x55982f24a3d0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f2380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22e490 0x55982f23a800 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1043259997 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22ee50 0x55982f237ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 -- 172.21.15.70:0/1043259997 >> 172.21.15.70:0/1043259997 conn(0x55982f15cc60 msgr2=0x55982f223850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f5431600700 0 client.19128 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 -- 172.21.15.70:0/1043259997 shutdown_connections 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 1 -- 172.21.15.70:0/1043259997 wait complete. 2024-05-08T09:09:22.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.544+0000 7f54551dcb80 20 client.19128 trim_cache size 0 max 16384 2024-05-08T09:09:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.566+0000 7f54551dcb80 1 Processor -- start 2024-05-08T09:09:22.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.566+0000 7f54551dcb80 1 -- start start 2024-05-08T09:09:22.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 0x55982f236a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f237450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f237990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f54551dcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54441b3f60 con 0x55982f22ee50 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f54551dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54441b17f0 con 0x55982f22e490 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f54551dcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f54441af660 con 0x55982f233ec0 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f543be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f237450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f543be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f237450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54752/0 (socket says 172.21.15.70:54752) 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f543be00700 1 -- 172.21.15.70:0/1883637673 learned_addr learned my addr 172.21.15.70:0/1883637673 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.567+0000 7f5443e00700 1 --2- 172.21.15.70:0/1883637673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f237990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.568+0000 7f543be00700 1 -- 172.21.15.70:0/1883637673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 msgr2=0x55982f237990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.568+0000 7f543be00700 1 --2- 172.21.15.70:0/1883637673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f237990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.568+0000 7f543be00700 1 -- 172.21.15.70:0/1883637673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 msgr2=0x55982f236a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.568+0000 7f543be00700 1 --2- 172.21.15.70:0/1883637673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 0x55982f236a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.568+0000 7f543be00700 1 -- 172.21.15.70:0/1883637673 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55982f233430 con 0x55982f22ee50 2024-05-08T09:09:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.568+0000 7f543be00700 1 --2- 172.21.15.70:0/1883637673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f237450 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f542c0098e0 tx=0x7f542c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13b709065cbe261 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.568+0000 7f5433e00700 1 -- 172.21.15.70:0/1883637673 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c027040 con 0x55982f22ee50 2024-05-08T09:09:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.568+0000 7f5433e00700 1 -- 172.21.15.70:0/1883637673 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f542c005550 con 0x55982f22ee50 2024-05-08T09:09:22.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.568+0000 7f5433e00700 1 -- 172.21.15.70:0/1883637673 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c00bbc0 con 0x55982f22ee50 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.569+0000 7f54551dcb80 1 -- 172.21.15.70:0/1883637673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 msgr2=0x55982f237450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.569+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1883637673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f237450 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f542c0098e0 tx=0x7f542c01a040 comp rx=0 tx=0).stop 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.569+0000 7f54551dcb80 1 -- 172.21.15.70:0/1883637673 shutdown_connections 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.569+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1883637673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f237990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.569+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1883637673 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 0x55982f236a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.569+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1883637673 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f237450 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.569+0000 7f54551dcb80 1 -- 172.21.15.70:0/1883637673 >> 172.21.15.70:0/1883637673 conn(0x55982f15cc60 msgr2=0x55982f236360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.569+0000 7f54551dcb80 1 -- 172.21.15.70:0/1883637673 shutdown_connections 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.570+0000 7f54551dcb80 1 -- 172.21.15.70:0/1883637673 wait complete. 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.570+0000 7f54551dcb80 1 -- start start 2024-05-08T09:09:22.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.570+0000 7f54551dcb80 1 Processor -- start 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 0x55982f240820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f23b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f54551dcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f23bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f54551dcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54441afcb0 con 0x55982f22ee50 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f54551dcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f54441b1120 con 0x55982f22e490 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f54551dcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f54441b0380 con 0x55982f233ec0 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f54551dcb80 10 client.0 _ll_register_callbacks cb 0x55982f127d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f543be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f23b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f543be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f23b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54766/0 (socket says 172.21.15.70:54766) 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f543be00700 1 -- 172.21.15.70:0/1157604665 learned_addr learned my addr 172.21.15.70:0/1157604665 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.571+0000 7f5443400700 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 0x55982f240820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f543be00700 1 -- 172.21.15.70:0/1157604665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 msgr2=0x55982f23bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f5443e00700 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f23bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f543be00700 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f23bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f543be00700 1 -- 172.21.15.70:0/1157604665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 msgr2=0x55982f240820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f543be00700 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 0x55982f240820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f543be00700 1 -- 172.21.15.70:0/1157604665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55982f23c070 con 0x55982f22ee50 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f5443400700 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 0x55982f240820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f5443e00700 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f23bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f543be00700 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f23b5f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f542c0039c0 tx=0x7f542c003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa078ce8238b12f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.572+0000 7f5431600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.573+0000 7f5431600700 1 -- 172.21.15.70:0/1157604665 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c005050 con 0x55982f22ee50 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.573+0000 7f5431600700 1 -- 172.21.15.70:0/1157604665 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(362..362 src has 1..362) ==== 9583+0+0 (secure 0 0 0) 0x7f542c01e050 con 0x55982f22ee50 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.573+0000 7f54551dcb80 1 -- 172.21.15.70:0/1157604665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f542c005550 con 0x55982f22ee50 2024-05-08T09:09:22.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.573+0000 7f5431600700 1 -- 172.21.15.70:0/1157604665 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f542c0051f0 con 0x55982f22ee50 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.573+0000 7f54551dcb80 10 client.19134 fetch_fsmap learned FSMap version 42 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.573+0000 7f54551dcb80 1 -- 172.21.15.70:0/1157604665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55982f2b3450 con 0x55982f22ee50 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.573+0000 7f5431600700 1 -- 172.21.15.70:0/1157604665 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f542c005550 con 0x55982f22ee50 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.574+0000 7f5431600700 1 -- 172.21.15.70:0/1157604665 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f542c02e120 con 0x55982f22ee50 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.574+0000 7f54551dcb80 10 client.19134 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.574+0000 7f54551dcb80 10 client.19134 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.574+0000 7f54551dcb80 20 client.19134 populate_metadata read hostname 'smithi070' 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.574+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55982f2b36d0 0x55982f2b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.574+0000 7f54551dcb80 4 client.19134 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ba418f5b", "release": true, "await": true}] 2024-05-08T09:09:22.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.574+0000 7f54551dcb80 1 -- 172.21.15.70:0/1157604665 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ba418f5b", "release": true, "await": true}) -- 0x55982f18e500 con 0x55982f2b36d0 2024-05-08T09:09:22.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.575+0000 7f5443400700 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55982f2b36d0 0x55982f2b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:22.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.575+0000 7f5443400700 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55982f2b36d0 0x55982f2b5ac0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5bd0a08c4e19f4 server_cookie=a571fb93a6b1ea08 in_seq=0 out_seq=0 2024-05-08T09:09:22.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:22.575+0000 7f5431600700 10 client.19134 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:09:23.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:23 smithi194 ceph-mon[33679]: pgmap v4555: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:09:23.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:23 smithi070 ceph-mon[29591]: pgmap v4555: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:09:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:23 smithi172 ceph-mon[33377]: pgmap v4555: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:09:25.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:25 smithi194 ceph-mon[33679]: pgmap v4556: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-05-08T09:09:25.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:25 smithi070 ceph-mon[29591]: pgmap v4556: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-05-08T09:09:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:25 smithi172 ceph-mon[33377]: pgmap v4556: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-05-08T09:09:27.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.040+0000 7f5431600700 1 -- 172.21.15.70:0/1157604665 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55982f18e500 con 0x55982f2b36d0 2024-05-08T09:09:27.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.040+0000 7f5431600700 10 client.19134 handle_command_reply: tid=0 2024-05-08T09:09:27.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.040+0000 7f54551dcb80 1 client.19134 shutdown 2024-05-08T09:09:27.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.040+0000 7f54551dcb80 1 -- 172.21.15.70:0/1157604665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 msgr2=0x55982f23b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:27.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.041+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f23b5f0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f542c0039c0 tx=0x7f542c003bc0 comp rx=0 tx=0).stop 2024-05-08T09:09:27.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.041+0000 7f54551dcb80 1 -- 172.21.15.70:0/1157604665 shutdown_connections 2024-05-08T09:09:27.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.041+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55982f2b36d0 0x55982f2b5ac0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:27.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.041+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55982f233ec0 0x55982f23bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:27.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.041+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55982f22e490 0x55982f240820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:27.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.041+0000 7f5431600700 0 client.19134 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:09:27.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.041+0000 7f54551dcb80 1 --2- 172.21.15.70:0/1157604665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982f22ee50 0x55982f23b5f0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:27.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.041+0000 7f54551dcb80 1 -- 172.21.15.70:0/1157604665 >> 172.21.15.70:0/1157604665 conn(0x55982f15cc60 msgr2=0x55982f223850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:27.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.042+0000 7f54551dcb80 1 -- 172.21.15.70:0/1157604665 shutdown_connections 2024-05-08T09:09:27.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.042+0000 7f54551dcb80 1 -- 172.21.15.70:0/1157604665 wait complete. 2024-05-08T09:09:27.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.043+0000 7f54551dcb80 20 client.19134 trim_cache size 0 max 16384 2024-05-08T09:09:27.043 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:09:27.043 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:09:27.043 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:09:27.043 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 316, 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "ba418f5b": { 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 316, 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.9, 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:09:27.044 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:09:27.045 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:09:27.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:09:27.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:09:27.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:09:27.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:09:27.045 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:09:27.045 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:09:27.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.044+0000 7f544a800700 1 -- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54280b2a70 msgr2=0x7f54280b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.044+0000 7f544a800700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54280b2a70 0x7f54280b4f30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5434005fd0 tx=0x7f5434005d00 comp rx=0 tx=0).stop 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.044+0000 7f544a800700 1 -- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544410ff80 msgr2=0x7f544419ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.044+0000 7f544a800700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544410ff80 0x7f544419ba40 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f543c007d40 tx=0x7f543c00a340 comp rx=0 tx=0).stop 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.045+0000 7f544a800700 1 -- 172.21.15.70:0/2383663962 shutdown_connections 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.045+0000 7f544a800700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f54280b2a70 0x7f54280b4f30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.045+0000 7f544a800700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f544410ff80 0x7f544419ba40 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.045+0000 7f544a800700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f544406bbd0 0x7f54441a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.045+0000 7f544a800700 1 --2- 172.21.15.70:0/2383663962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f544406c4f0 0x7f54441a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.045+0000 7f544a800700 1 -- 172.21.15.70:0/2383663962 >> 172.21.15.70:0/2383663962 conn(0x7f5444079350 msgr2=0x7f54441113d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:27.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.045+0000 7f544a800700 1 -- 172.21.15.70:0/2383663962 shutdown_connections 2024-05-08T09:09:27.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:27.046+0000 7f544a800700 1 -- 172.21.15.70:0/2383663962 wait complete. 2024-05-08T09:09:27.132 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/mmc/built-in.a 2024-05-08T09:09:27.172 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/netup_unidvb/built-in.a 2024-05-08T09:09:27.282 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/usb/ttusb-dec/built-in.a 2024-05-08T09:09:27.299 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_region_lmem.o 2024-05-08T09:09:27.333 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_renderstate.o 2024-05-08T09:09:27.375 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/intel/ipu3/built-in.a 2024-05-08T09:09:27.457 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/usb/built-in.a 2024-05-08T09:09:27.514 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/intel/built-in.a 2024-05-08T09:09:27.650 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/pci/built-in.a 2024-05-08T09:09:27.721 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_reset.o 2024-05-08T09:09:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:27 smithi070 ceph-mon[29591]: pgmap v4557: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-05-08T09:09:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:27 smithi172 ceph-mon[33377]: pgmap v4557: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-05-08T09:09:27.933 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ba418f5b', seconds elapsed: 72.0 2024-05-08T09:09:27.933 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.9 2024-05-08T09:09:27.933 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:09:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:27 smithi194 ceph-mon[33679]: pgmap v4557: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.2 KiB/s wr, 6 op/s 2024-05-08T09:09:28.014 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/firewire/built-in.a 2024-05-08T09:09:28.255 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/spi/built-in.a 2024-05-08T09:09:28.499 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/test-drivers/built-in.a 2024-05-08T09:09:28.504 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:09:28.670 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/media/built-in.a 2024-05-08T09:09:29.305 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pps/clients/built-in.a 2024-05-08T09:09:29.540 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pps/generators/built-in.a 2024-05-08T09:09:29.670 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pps/pps.o 2024-05-08T09:09:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:29 smithi070 ceph-mon[29591]: pgmap v4558: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-05-08T09:09:29.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:29 smithi172 ceph-mon[33377]: pgmap v4558: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-05-08T09:09:30.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:29 smithi194 ceph-mon[33679]: pgmap v4558: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-05-08T09:09:30.164 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/loopback.o 2024-05-08T09:09:30.194 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/host/built-in.a 2024-05-08T09:09:30.754 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/netconsole.o 2024-05-08T09:09:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.169+0000 7f2e98400700 1 -- 172.21.15.70:0/3364500380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e90103eb0 msgr2=0x7f2e90110390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.169+0000 7f2e98400700 1 --2- 172.21.15.70:0/3364500380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e90103eb0 0x7f2e90110390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800b0a0 tx=0x7f2e8800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.169+0000 7f2e98400700 1 -- 172.21.15.70:0/3364500380 shutdown_connections 2024-05-08T09:09:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.169+0000 7f2e98400700 1 --2- 172.21.15.70:0/3364500380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e90103eb0 0x7f2e90110390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.169+0000 7f2e98400700 1 --2- 172.21.15.70:0/3364500380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e90109600 0x7f2e901099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.169+0000 7f2e98400700 1 --2- 172.21.15.70:0/3364500380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e901034f0 0x7f2e90103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.169+0000 7f2e98400700 1 -- 172.21.15.70:0/3364500380 >> 172.21.15.70:0/3364500380 conn(0x7f2e9007a650 msgr2=0x7f2e9007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.170+0000 7f2e98400700 1 -- 172.21.15.70:0/3364500380 shutdown_connections 2024-05-08T09:09:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.170+0000 7f2e98400700 1 -- 172.21.15.70:0/3364500380 wait complete. 2024-05-08T09:09:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.171+0000 7f2e98400700 1 Processor -- start 2024-05-08T09:09:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.172+0000 7f2e98400700 1 -- start start 2024-05-08T09:09:31.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e98400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e901034f0 0x7f2e90113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:31.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e98400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e90103eb0 0x7f2e90113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:31.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e98400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e90109600 0x7f2e901b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:31.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e98400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90075ba0 con 0x7f2e90103eb0 2024-05-08T09:09:31.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e98400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90075a20 con 0x7f2e901034f0 2024-05-08T09:09:31.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e98400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90075d20 con 0x7f2e90109600 2024-05-08T09:09:31.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e95a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e901034f0 0x7f2e90113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:31.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e95a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e901034f0 0x7f2e90113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:34166/0 (socket says 172.21.15.70:34166) 2024-05-08T09:09:31.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e95a00700 1 -- 172.21.15.70:0/2456723619 learned_addr learned my addr 172.21.15.70:0/2456723619 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:31.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e96400700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e90109600 0x7f2e901b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:31.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.173+0000 7f2e95000700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e90103eb0 0x7f2e90113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:31.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.174+0000 7f2e95a00700 1 -- 172.21.15.70:0/2456723619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e90109600 msgr2=0x7f2e901b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:31.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.174+0000 7f2e95a00700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e90109600 0x7f2e901b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.174+0000 7f2e95a00700 1 -- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e90103eb0 msgr2=0x7f2e90113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:31.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.174+0000 7f2e95a00700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e90103eb0 0x7f2e90113790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.174+0000 7f2e95a00700 1 -- 172.21.15.70:0/2456723619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e901b4870 con 0x7f2e901034f0 2024-05-08T09:09:31.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.175+0000 7f2e95000700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e90103eb0 0x7f2e90113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:09:31.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.175+0000 7f2e95a00700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e901034f0 0x7f2e90113250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400e9a0 tx=0x7f2e8400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:31.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.176+0000 7f2e8e000700 1 -- 172.21.15.70:0/2456723619 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400ca10 con 0x7f2e901034f0 2024-05-08T09:09:31.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.176+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e901b4b00 con 0x7f2e901034f0 2024-05-08T09:09:31.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.176+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e901b5090 con 0x7f2e901034f0 2024-05-08T09:09:31.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.177+0000 7f2e8e000700 1 -- 172.21.15.70:0/2456723619 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e8400cbb0 con 0x7f2e901034f0 2024-05-08T09:09:31.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.177+0000 7f2e8e000700 1 -- 172.21.15.70:0/2456723619 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400ca10 con 0x7f2e901034f0 2024-05-08T09:09:31.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.179+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e70005330 con 0x7f2e901034f0 2024-05-08T09:09:31.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.185+0000 7f2e8e000700 1 -- 172.21.15.70:0/2456723619 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2e84004020 con 0x7f2e901034f0 2024-05-08T09:09:31.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.188+0000 7f2e8e000700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2e780b2cf0 0x7f2e780b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:31.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.188+0000 7f2e8e000700 1 -- 172.21.15.70:0/2456723619 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(362..362 src has 1..362) ==== 9583+0+0 (secure 0 0 0) 0x7f2e840e25b0 con 0x7f2e901034f0 2024-05-08T09:09:31.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.188+0000 7f2e95000700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2e780b2cf0 0x7f2e780b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:31.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.189+0000 7f2e95000700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2e780b2cf0 0x7f2e780b51b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2e9007ac30 tx=0x7f2e7c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:31.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.201+0000 7f2e8e000700 1 -- 172.21.15.70:0/2456723619 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2e840a9b10 con 0x7f2e901034f0 2024-05-08T09:09:31.428 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/usb/built-in.a 2024-05-08T09:09:31.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.688+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e70005620 con 0x7f2e901034f0 2024-05-08T09:09:31.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.690+0000 7f2e8e000700 1 -- 172.21.15.70:0/2456723619 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f2e840a9410 con 0x7f2e901034f0 2024-05-08T09:09:31.691 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:09:31.691 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:09:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.694+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2e780b2cf0 msgr2=0x7f2e780b51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.694+0000 7f2e98400700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2e780b2cf0 0x7f2e780b51b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2e9007ac30 tx=0x7f2e7c009260 comp rx=0 tx=0).stop 2024-05-08T09:09:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e901034f0 msgr2=0x7f2e90113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e901034f0 0x7f2e90113250 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400e9a0 tx=0x7f2e8400ecb0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 shutdown_connections 2024-05-08T09:09:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2e780b2cf0 0x7f2e780b51b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e90109600 0x7f2e901b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2e901034f0 0x7f2e90113250 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 --2- 172.21.15.70:0/2456723619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2e90103eb0 0x7f2e90113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 >> 172.21.15.70:0/2456723619 conn(0x7f2e9007a650 msgr2=0x7f2e90101dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 shutdown_connections 2024-05-08T09:09:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:31.695+0000 7f2e98400700 1 -- 172.21.15.70:0/2456723619 wait complete. 2024-05-08T09:09:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:09:31.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:31 smithi070 ceph-mon[29591]: pgmap v4559: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 276 KiB/s wr, 21 op/s 2024-05-08T09:09:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:31 smithi172 ceph-mon[33377]: pgmap v4559: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 276 KiB/s wr, 21 op/s 2024-05-08T09:09:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:31 smithi194 ceph-mon[33679]: pgmap v4559: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 269 KiB/s rd, 276 KiB/s wr, 21 op/s 2024-05-08T09:09:32.443 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ptp/ptp_clock.o 2024-05-08T09:09:32.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:32 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2456723619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:09:32.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:32 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2456723619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:09:33.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:32 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2456723619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:09:33.401 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 79.9 --await-for 42.0' 2024-05-08T09:09:33.401 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 79.9 --await-for 42.0 2024-05-08T09:09:33.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:33 smithi070 ceph-mon[29591]: pgmap v4560: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 276 KiB/s wr, 18 op/s 2024-05-08T09:09:33.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:33 smithi172 ceph-mon[33377]: pgmap v4560: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 276 KiB/s wr, 18 op/s 2024-05-08T09:09:34.001 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:09:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:33 smithi194 ceph-mon[33679]: pgmap v4560: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 276 KiB/s wr, 18 op/s 2024-05-08T09:09:34.364 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ptp/ptp_chardev.o 2024-05-08T09:09:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:35 smithi070 ceph-mon[29591]: pgmap v4561: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 644 KiB/s wr, 37 op/s 2024-05-08T09:09:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:35 smithi172 ceph-mon[33377]: pgmap v4561: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 644 KiB/s wr, 37 op/s 2024-05-08T09:09:36.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:35 smithi194 ceph-mon[33679]: pgmap v4561: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 660 KiB/s rd, 644 KiB/s wr, 37 op/s 2024-05-08T09:09:37.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:37 smithi194 ceph-mon[33679]: pgmap v4562: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 642 KiB/s wr, 34 op/s 2024-05-08T09:09:37.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:37 smithi070 ceph-mon[29591]: pgmap v4562: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 642 KiB/s wr, 34 op/s 2024-05-08T09:09:37.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:37 smithi172 ceph-mon[33377]: pgmap v4562: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 642 KiB/s wr, 34 op/s 2024-05-08T09:09:39.623 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pps/kapi.o 2024-05-08T09:09:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:39 smithi194 ceph-mon[33679]: pgmap v4563: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 642 KiB/s wr, 34 op/s 2024-05-08T09:09:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:39 smithi070 ceph-mon[29591]: pgmap v4563: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 642 KiB/s wr, 34 op/s 2024-05-08T09:09:39.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.899+0000 7f1593400700 1 -- 172.21.15.70:0/1924572532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 msgr2=0x7f158c105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:39.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.899+0000 7f1593400700 1 --2- 172.21.15.70:0/1924572532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 0x7f158c105b40 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f1578009990 tx=0x7f1578009ca0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.899+0000 7f1593400700 1 -- 172.21.15.70:0/1924572532 shutdown_connections 2024-05-08T09:09:39.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.899+0000 7f1593400700 1 --2- 172.21.15.70:0/1924572532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f158c106080 0x7f158c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.899+0000 7f1593400700 1 --2- 172.21.15.70:0/1924572532 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c10b6c0 0x7f158c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.899+0000 7f1593400700 1 --2- 172.21.15.70:0/1924572532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 0x7f158c105b40 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.899+0000 7f1593400700 1 -- 172.21.15.70:0/1924572532 >> 172.21.15.70:0/1924572532 conn(0x7f158c1011b0 msgr2=0x7f158c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.900+0000 7f1593400700 1 -- 172.21.15.70:0/1924572532 shutdown_connections 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.900+0000 7f1593400700 1 -- 172.21.15.70:0/1924572532 wait complete. 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.901+0000 7f1593400700 1 Processor -- start 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.901+0000 7f1593400700 1 -- start start 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f1593400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 0x7f158c0779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f1593400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c106080 0x7f158c077ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f1593400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f158c10b6c0 0x7f158c078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f1593400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f158c115850 con 0x7f158c1056c0 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f1593400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1156d0 con 0x7f158c106080 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f1593400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f158c1159d0 con 0x7f158c10b6c0 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f1590a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 0x7f158c0779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f1590a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 0x7f158c0779b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45992/0 (socket says 172.21.15.70:45992) 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f1590a00700 1 -- 172.21.15.70:0/1852752117 learned_addr learned my addr 172.21.15.70:0/1852752117 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.902+0000 7f158be00700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c106080 0x7f158c077ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.903+0000 7f1591400700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f158c10b6c0 0x7f158c078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.903+0000 7f1590a00700 1 -- 172.21.15.70:0/1852752117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f158c10b6c0 msgr2=0x7f158c078430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.903+0000 7f1590a00700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f158c10b6c0 0x7f158c078430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.903+0000 7f1590a00700 1 -- 172.21.15.70:0/1852752117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c106080 msgr2=0x7f158c077ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.903+0000 7f1590a00700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c106080 0x7f158c077ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.903+0000 7f1590a00700 1 -- 172.21.15.70:0/1852752117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158c1ac2b0 con 0x7f158c1056c0 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.903+0000 7f1591400700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f158c10b6c0 0x7f158c078430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.903+0000 7f1590a00700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 0x7f158c0779b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f158000ef40 tx=0x7f158000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.904+0000 7f1589600700 1 -- 172.21.15.70:0/1852752117 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158000c9f0 con 0x7f158c1056c0 2024-05-08T09:09:39.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.904+0000 7f1593400700 1 -- 172.21.15.70:0/1852752117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158c1ac540 con 0x7f158c1056c0 2024-05-08T09:09:39.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.904+0000 7f1593400700 1 -- 172.21.15.70:0/1852752117 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f158c1acaa0 con 0x7f158c1056c0 2024-05-08T09:09:39.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.904+0000 7f1589600700 1 -- 172.21.15.70:0/1852752117 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1580019070 con 0x7f158c1056c0 2024-05-08T09:09:39.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.904+0000 7f1589600700 1 -- 172.21.15.70:0/1852752117 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1580007d70 con 0x7f158c1056c0 2024-05-08T09:09:39.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.909+0000 7f1589600700 1 -- 172.21.15.70:0/1852752117 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1580012050 con 0x7f158c1056c0 2024-05-08T09:09:39.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.912+0000 7f1589600700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15740b2ba0 0x7f15740b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.913+0000 7f1589600700 1 -- 172.21.15.70:0/1852752117 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(362..362 src has 1..362) ==== 9583+0+0 (secure 0 0 0) 0x7f15800e28c0 con 0x7f158c1056c0 2024-05-08T09:09:39.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.913+0000 7f158be00700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15740b2ba0 0x7f15740b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.914+0000 7f158be00700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15740b2ba0 0x7f15740b5060 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f157800b2e0 tx=0x7f1578009570 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:39 smithi172 ceph-mon[33377]: pgmap v4563: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 642 KiB/s wr, 34 op/s 2024-05-08T09:09:39.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.986+0000 7f159dcaeb80 1 Processor -- start 2024-05-08T09:09:39.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.986+0000 7f159dcaeb80 1 -- start start 2024-05-08T09:09:39.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.987+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56293341a240 0x56293341a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.987+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933414810 0x562933414c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.987+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x562933421000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.987+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562933366bb0 con 0x56293341a240 2024-05-08T09:09:39.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.987+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5629333048f0 con 0x5629334151d0 2024-05-08T09:09:39.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.987+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562933362b70 con 0x562933414810 2024-05-08T09:09:39.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.987+0000 7f1590a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56293341a240 0x56293341a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.987+0000 7f1590a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56293341a240 0x56293341a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46002/0 (socket says 172.21.15.70:46002) 2024-05-08T09:09:39.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.987+0000 7f1590a00700 1 -- 172.21.15.70:0/14620864 learned_addr learned my addr 172.21.15.70:0/14620864 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:39.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.988+0000 7f158be00700 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933414810 0x562933414c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.988+0000 7f1591400700 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x562933421000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.988+0000 7f1590a00700 1 -- 172.21.15.70:0/14620864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933414810 msgr2=0x562933414c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.988+0000 7f1590a00700 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933414810 0x562933414c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.988+0000 7f1590a00700 1 -- 172.21.15.70:0/14620864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 msgr2=0x562933421000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.988+0000 7f1590a00700 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x562933421000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.988+0000 7f1590a00700 1 -- 172.21.15.70:0/14620864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629332b3a60 con 0x56293341a240 2024-05-08T09:09:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.988+0000 7f1591400700 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x562933421000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:09:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.988+0000 7f1590a00700 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56293341a240 0x56293341a620 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1580009f20 tx=0x7f15800a8e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe690f91cd5a0d4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:39.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.989+0000 7f157e000700 1 -- 172.21.15.70:0/14620864 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15800a9720 con 0x56293341a240 2024-05-08T09:09:39.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.989+0000 7f157e000700 1 -- 172.21.15.70:0/14620864 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15800b0e50 con 0x56293341a240 2024-05-08T09:09:39.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.989+0000 7f157e000700 1 -- 172.21.15.70:0/14620864 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15800a9980 con 0x56293341a240 2024-05-08T09:09:39.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.990+0000 7f159dcaeb80 1 -- 172.21.15.70:0/14620864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56293341a240 msgr2=0x56293341a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:39.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.990+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56293341a240 0x56293341a620 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f1580009f20 tx=0x7f15800a8e90 comp rx=0 tx=0).stop 2024-05-08T09:09:39.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.990+0000 7f159dcaeb80 1 -- 172.21.15.70:0/14620864 shutdown_connections 2024-05-08T09:09:39.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.990+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x562933421000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.990+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56293341a240 0x56293341a620 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.990+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/14620864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933414810 0x562933414c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.990+0000 7f159dcaeb80 1 -- 172.21.15.70:0/14620864 >> 172.21.15.70:0/14620864 conn(0x56293338c860 msgr2=0x56293340f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:39.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.990+0000 7f159dcaeb80 1 -- 172.21.15.70:0/14620864 shutdown_connections 2024-05-08T09:09:39.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.990+0000 7f159dcaeb80 1 -- 172.21.15.70:0/14620864 wait complete. 2024-05-08T09:09:39.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.991+0000 7f159dcaeb80 1 -- start start 2024-05-08T09:09:39.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.991+0000 7f159dcaeb80 1 Processor -- start 2024-05-08T09:09:39.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.992+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x562933420ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.992+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x56293341df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.992+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293341a240 0x56293341e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.992+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562933421600 con 0x562933414810 2024-05-08T09:09:39.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.992+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5629332cccb0 con 0x5629334151d0 2024-05-08T09:09:39.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.992+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562933421780 con 0x56293341a240 2024-05-08T09:09:39.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.992+0000 7f159dcaeb80 10 client.0 _ll_register_callbacks cb 0x56293330de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:09:39.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.993+0000 7f158be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x56293341df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.993+0000 7f1590a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x562933420ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.993+0000 7f158be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x56293341df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:48272/0 (socket says 172.21.15.70:48272) 2024-05-08T09:09:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.993+0000 7f158be00700 1 -- 172.21.15.70:0/257392735 learned_addr learned my addr 172.21.15.70:0/257392735 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:39.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.994+0000 7f1591400700 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293341a240 0x56293341e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:39.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.995+0000 7f158be00700 1 -- 172.21.15.70:0/257392735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293341a240 msgr2=0x56293341e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:39.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.995+0000 7f158be00700 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293341a240 0x56293341e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.995+0000 7f158be00700 1 -- 172.21.15.70:0/257392735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 msgr2=0x562933420ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:39.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.995+0000 7f158be00700 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x562933420ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:39.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.995+0000 7f158be00700 1 -- 172.21.15.70:0/257392735 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56293332c5b0 con 0x5629334151d0 2024-05-08T09:09:39.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.995+0000 7f1590a00700 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x562933420ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:09:39.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.996+0000 7f158be00700 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x56293341df40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1578009990 tx=0x7f1578009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d25dc45acab98ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:39.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.996+0000 7f1572a00700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T09:09:39.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.996+0000 7f1572a00700 1 -- 172.21.15.70:0/257392735 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578033060 con 0x5629334151d0 2024-05-08T09:09:39.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.997+0000 7f1572a00700 1 -- 172.21.15.70:0/257392735 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(362..362 src has 1..362) ==== 9583+0+0 (secure 0 0 0) 0x7f157800bc90 con 0x5629334151d0 2024-05-08T09:09:39.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.997+0000 7f159dcaeb80 1 -- 172.21.15.70:0/257392735 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15800b0e50 con 0x5629334151d0 2024-05-08T09:09:39.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.997+0000 7f1572a00700 1 -- 172.21.15.70:0/257392735 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f157800be90 con 0x5629334151d0 2024-05-08T09:09:39.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.997+0000 7f159dcaeb80 10 client.37745 fetch_fsmap learned FSMap version 42 2024-05-08T09:09:39.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.997+0000 7f159dcaeb80 1 -- 172.21.15.70:0/257392735 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56293343ce10 con 0x5629334151d0 2024-05-08T09:09:39.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.998+0000 7f1572a00700 1 -- 172.21.15.70:0/257392735 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15800b0e50 con 0x5629334151d0 2024-05-08T09:09:39.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.998+0000 7f1572a00700 1 -- 172.21.15.70:0/257392735 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f157802d070 con 0x5629334151d0 2024-05-08T09:09:39.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.998+0000 7f159dcaeb80 10 client.37745 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:09:39.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.998+0000 7f159dcaeb80 10 client.37745 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:09:39.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.998+0000 7f159dcaeb80 20 client.37745 populate_metadata read hostname 'smithi070' 2024-05-08T09:09:39.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.998+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56293343f3f0 0x562933441870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:39.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.998+0000 7f159dcaeb80 4 client.37745 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:09:39.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.998+0000 7f159dcaeb80 1 -- 172.21.15.70:0/257392735 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629333e12d0 con 0x56293343f3f0 2024-05-08T09:09:39.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:39.999+0000 7f1590a00700 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56293343f3f0 0x562933441870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:40.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.001+0000 7f1590a00700 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56293343f3f0 0x562933441870 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=609ccc87a9fe2103 server_cookie=f8f77276171d499f in_seq=0 out_seq=0 2024-05-08T09:09:40.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.001+0000 7f1572a00700 10 client.37745 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:09:40.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.002+0000 7f1572a00700 1 -- 172.21.15.70:0/257392735 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5629333e12d0 con 0x56293343f3f0 2024-05-08T09:09:40.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.002+0000 7f1572a00700 10 client.37745 handle_command_reply: tid=0 2024-05-08T09:09:40.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.002+0000 7f159dcaeb80 1 client.37745 shutdown 2024-05-08T09:09:40.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 -- 172.21.15.70:0/257392735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 msgr2=0x56293341df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:40.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x56293341df40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1578009990 tx=0x7f1578009310 comp rx=0 tx=0).stop 2024-05-08T09:09:40.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 -- 172.21.15.70:0/257392735 shutdown_connections 2024-05-08T09:09:40.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56293343f3f0 0x562933441870 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56293341a240 0x56293341e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x562933420ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/257392735 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5629334151d0 0x56293341df40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 -- 172.21.15.70:0/257392735 >> 172.21.15.70:0/257392735 conn(0x56293338c860 msgr2=0x562933409bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:40.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f1572a00700 0 client.37745 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:09:40.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 -- 172.21.15.70:0/257392735 shutdown_connections 2024-05-08T09:09:40.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 1 -- 172.21.15.70:0/257392735 wait complete. 2024-05-08T09:09:40.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.003+0000 7f159dcaeb80 20 client.37745 trim_cache size 0 max 16384 2024-05-08T09:09:40.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.038+0000 7f159dcaeb80 1 Processor -- start 2024-05-08T09:09:40.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f159dcaeb80 1 -- start start 2024-05-08T09:09:40.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x56293341fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:40.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5629334151d0 0x5629334471d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:40.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 0x562933447710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:40.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f156c011850 con 0x562933414810 2024-05-08T09:09:40.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f156c00f0e0 con 0x56293341a240 2024-05-08T09:09:40.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f156c00cf50 con 0x5629334151d0 2024-05-08T09:09:40.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f1590a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x56293341fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:40.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f1590a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x56293341fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46010/0 (socket says 172.21.15.70:46010) 2024-05-08T09:09:40.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.039+0000 7f1590a00700 1 -- 172.21.15.70:0/367431348 learned_addr learned my addr 172.21.15.70:0/367431348 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.040+0000 7f158be00700 1 --2- 172.21.15.70:0/367431348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5629334151d0 0x5629334471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.040+0000 7f1590a00700 1 -- 172.21.15.70:0/367431348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5629334151d0 msgr2=0x5629334471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.040+0000 7f1590a00700 1 --2- 172.21.15.70:0/367431348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5629334151d0 0x5629334471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.040+0000 7f1590a00700 1 -- 172.21.15.70:0/367431348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 msgr2=0x562933447710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.040+0000 7f1590a00700 1 --2- 172.21.15.70:0/367431348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 0x562933447710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.040+0000 7f1590a00700 1 -- 172.21.15.70:0/367431348 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56293340bd00 con 0x562933414810 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.040+0000 7f1590a00700 1 --2- 172.21.15.70:0/367431348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x56293341fd00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f15800a9420 tx=0x7f15800cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f910c90295ba33d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.041+0000 7f157d600700 1 -- 172.21.15.70:0/367431348 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15800a9720 con 0x562933414810 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.041+0000 7f157d600700 1 -- 172.21.15.70:0/367431348 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15800b0e50 con 0x562933414810 2024-05-08T09:09:40.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.041+0000 7f157d600700 1 -- 172.21.15.70:0/367431348 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15800b20f0 con 0x562933414810 2024-05-08T09:09:40.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.042+0000 7f159dcaeb80 1 -- 172.21.15.70:0/367431348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 msgr2=0x56293341fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:09:40.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.042+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/367431348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x56293341fd00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f15800a9420 tx=0x7f15800cc040 comp rx=0 tx=0).stop 2024-05-08T09:09:40.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.042+0000 7f159dcaeb80 1 -- 172.21.15.70:0/367431348 shutdown_connections 2024-05-08T09:09:40.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.042+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/367431348 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 0x562933447710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.042+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/367431348 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562933414810 0x56293341fd00 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.042+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/367431348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5629334151d0 0x5629334471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.042+0000 7f159dcaeb80 1 -- 172.21.15.70:0/367431348 >> 172.21.15.70:0/367431348 conn(0x56293338c860 msgr2=0x56293341f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:09:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.043+0000 7f159dcaeb80 1 -- 172.21.15.70:0/367431348 shutdown_connections 2024-05-08T09:09:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.043+0000 7f159dcaeb80 1 -- 172.21.15.70:0/367431348 wait complete. 2024-05-08T09:09:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.043+0000 7f159dcaeb80 1 -- start start 2024-05-08T09:09:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.043+0000 7f159dcaeb80 1 Processor -- start 2024-05-08T09:09:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.044+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629334151d0 0x562933423a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:40.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.044+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 0x562933423f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.044+0000 7f159dcaeb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933424490 0x5629334a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.044+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f156c00d5a0 con 0x5629334151d0 2024-05-08T09:09:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.044+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f156c00ea10 con 0x56293341a240 2024-05-08T09:09:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.044+0000 7f159dcaeb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f156c00dc70 con 0x562933424490 2024-05-08T09:09:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.044+0000 7f159dcaeb80 10 client.0 _ll_register_callbacks cb 0x56293330de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:09:40.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.045+0000 7f1590a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629334151d0 0x562933423a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.045+0000 7f158be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 0x562933423f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.045+0000 7f158be00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 0x562933423f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:48288/0 (socket says 172.21.15.70:48288) 2024-05-08T09:09:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.045+0000 7f158be00700 1 -- 172.21.15.70:0/2852781168 learned_addr learned my addr 172.21.15.70:0/2852781168 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:09:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.046+0000 7f1590a00700 1 -- 172.21.15.70:0/2852781168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933424490 msgr2=0x5629334a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.046+0000 7f1591400700 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933424490 0x5629334a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:40.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.046+0000 7f1590a00700 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933424490 0x5629334a9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.046+0000 7f1590a00700 1 -- 172.21.15.70:0/2852781168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 msgr2=0x562933423f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:09:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.046+0000 7f1590a00700 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 0x562933423f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:09:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.046+0000 7f1590a00700 1 -- 172.21.15.70:0/2852781168 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629334aa2d0 con 0x5629334151d0 2024-05-08T09:09:40.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.047+0000 7f1591400700 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933424490 0x5629334a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:09:40.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.047+0000 7f158be00700 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 0x562933423f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:09:40.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.047+0000 7f1590a00700 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629334151d0 0x562933423a10 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f15800a9420 tx=0x7f1580091410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f5b076d4545a19 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:09:40.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.047+0000 7f1572a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:09:40.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.048+0000 7f1572a00700 1 -- 172.21.15.70:0/2852781168 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15800c9020 con 0x5629334151d0 2024-05-08T09:09:40.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.048+0000 7f1572a00700 1 -- 172.21.15.70:0/2852781168 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(362..362 src has 1..362) ==== 9583+0+0 (secure 0 0 0) 0x7f15800a9980 con 0x5629334151d0 2024-05-08T09:09:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.049+0000 7f159dcaeb80 1 -- 172.21.15.70:0/2852781168 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15800b0e50 con 0x5629334151d0 2024-05-08T09:09:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.049+0000 7f1572a00700 1 -- 172.21.15.70:0/2852781168 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f15800b2580 con 0x5629334151d0 2024-05-08T09:09:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.049+0000 7f159dcaeb80 10 client.19158 fetch_fsmap learned FSMap version 42 2024-05-08T09:09:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.049+0000 7f159dcaeb80 1 -- 172.21.15.70:0/2852781168 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5629334ab4d0 con 0x5629334151d0 2024-05-08T09:09:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.049+0000 7f1572a00700 1 -- 172.21.15.70:0/2852781168 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15800b0e50 con 0x5629334151d0 2024-05-08T09:09:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.050+0000 7f1572a00700 1 -- 172.21.15.70:0/2852781168 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f15800e2420 con 0x5629334151d0 2024-05-08T09:09:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.050+0000 7f159dcaeb80 10 client.19158 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:09:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.050+0000 7f159dcaeb80 10 client.19158 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:09:40.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.050+0000 7f159dcaeb80 20 client.19158 populate_metadata read hostname 'smithi070' 2024-05-08T09:09:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.050+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5629334ab4d0 0x5629334ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:09:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.050+0000 7f159dcaeb80 4 client.19158 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.9, "await_for": 42.0}] 2024-05-08T09:09:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.050+0000 7f159dcaeb80 1 -- 172.21.15.70:0/2852781168 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 79.9, "await_for": 42.0}) -- 0x562933374590 con 0x5629334ab4d0 2024-05-08T09:09:40.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.051+0000 7f158be00700 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5629334ab4d0 0x5629334ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:09:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.052+0000 7f158be00700 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5629334ab4d0 0x5629334ad8c0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=223342e91e0f38bb server_cookie=4cc613af8d55d494 in_seq=0 out_seq=0 2024-05-08T09:09:40.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:09:40.052+0000 7f1572a00700 10 client.19158 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:09:41.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:41 smithi194 ceph-mon[33679]: pgmap v4564: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 987 KiB/s wr, 46 op/s 2024-05-08T09:09:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:41 smithi070 ceph-mon[29591]: pgmap v4564: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 987 KiB/s wr, 46 op/s 2024-05-08T09:09:41.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:41 smithi172 ceph-mon[33377]: pgmap v4564: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 987 KiB/s wr, 46 op/s 2024-05-08T09:09:43.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:43 smithi194 ceph-mon[33679]: pgmap v4565: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 712 KiB/s wr, 31 op/s 2024-05-08T09:09:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:43 smithi070 ceph-mon[29591]: pgmap v4565: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 712 KiB/s wr, 31 op/s 2024-05-08T09:09:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:43 smithi172 ceph-mon[33377]: pgmap v4565: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 712 KiB/s wr, 31 op/s 2024-05-08T09:09:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:45 smithi070 ceph-mon[29591]: pgmap v4566: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 892 KiB/s wr, 39 op/s 2024-05-08T09:09:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:45 smithi172 ceph-mon[33377]: pgmap v4566: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 892 KiB/s wr, 39 op/s 2024-05-08T09:09:46.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:45 smithi194 ceph-mon[33679]: pgmap v4566: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 892 KiB/s wr, 39 op/s 2024-05-08T09:09:47.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:47 smithi070 ceph-mon[29591]: pgmap v4567: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 524 KiB/s wr, 20 op/s 2024-05-08T09:09:47.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:47 smithi172 ceph-mon[33377]: pgmap v4567: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 524 KiB/s wr, 20 op/s 2024-05-08T09:09:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:47 smithi194 ceph-mon[33679]: pgmap v4567: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 524 KiB/s wr, 20 op/s 2024-05-08T09:09:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:49 smithi070 ceph-mon[29591]: pgmap v4568: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 524 KiB/s wr, 20 op/s 2024-05-08T09:09:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:49 smithi172 ceph-mon[33377]: pgmap v4568: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 524 KiB/s wr, 20 op/s 2024-05-08T09:09:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:49 smithi194 ceph-mon[33679]: pgmap v4568: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 524 KiB/s wr, 20 op/s 2024-05-08T09:09:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:51 smithi070 ceph-mon[29591]: pgmap v4569: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 547 KiB/s wr, 24 op/s 2024-05-08T09:09:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:51 smithi172 ceph-mon[33377]: pgmap v4569: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 547 KiB/s wr, 24 op/s 2024-05-08T09:09:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:51 smithi194 ceph-mon[33679]: pgmap v4569: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 547 KiB/s wr, 24 op/s 2024-05-08T09:09:52.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:09:52.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:09:53.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:09:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:53 smithi070 ceph-mon[29591]: pgmap v4570: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 202 KiB/s wr, 12 op/s 2024-05-08T09:09:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:53 smithi172 ceph-mon[33377]: pgmap v4570: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 202 KiB/s wr, 12 op/s 2024-05-08T09:09:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:53 smithi194 ceph-mon[33679]: pgmap v4570: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 202 KiB/s wr, 12 op/s 2024-05-08T09:09:54.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:09:54.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:09:54.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:09:54.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:09:54.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:09:54.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:09:55.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:09:55.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:09:55.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:09:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:55 smithi070 ceph-mon[29591]: pgmap v4571: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 253 KiB/s wr, 15 op/s 2024-05-08T09:09:55.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:55 smithi172 ceph-mon[33377]: pgmap v4571: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 253 KiB/s wr, 15 op/s 2024-05-08T09:09:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:55 smithi194 ceph-mon[33679]: pgmap v4571: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 253 KiB/s wr, 15 op/s 2024-05-08T09:09:57.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:57 smithi070 ceph-mon[29591]: pgmap v4572: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 KiB/s wr, 7 op/s 2024-05-08T09:09:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:57 smithi172 ceph-mon[33377]: pgmap v4572: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 KiB/s wr, 7 op/s 2024-05-08T09:09:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:57 smithi194 ceph-mon[33679]: pgmap v4572: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 KiB/s wr, 7 op/s 2024-05-08T09:09:59.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:09:59 smithi070 ceph-mon[29591]: pgmap v4573: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 KiB/s wr, 7 op/s 2024-05-08T09:09:59.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:09:59 smithi172 ceph-mon[33377]: pgmap v4573: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 KiB/s wr, 7 op/s 2024-05-08T09:10:00.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:09:59 smithi194 ceph-mon[33679]: pgmap v4573: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 73 KiB/s wr, 7 op/s 2024-05-08T09:10:00.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T09:10:00.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T09:10:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T09:10:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:01 smithi070 ceph-mon[29591]: pgmap v4574: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 75 KiB/s wr, 10 op/s 2024-05-08T09:10:01.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:01 smithi172 ceph-mon[33377]: pgmap v4574: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 75 KiB/s wr, 10 op/s 2024-05-08T09:10:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:01 smithi194 ceph-mon[33679]: pgmap v4574: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 75 KiB/s wr, 10 op/s 2024-05-08T09:10:02.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.943+0000 7f1572a00700 1 -- 172.21.15.70:0/2852781168 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562933374590 con 0x5629334ab4d0 2024-05-08T09:10:02.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.943+0000 7f1572a00700 10 client.19158 handle_command_reply: tid=0 2024-05-08T09:10:02.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.943+0000 7f159dcaeb80 1 client.19158 shutdown 2024-05-08T09:10:02.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.944+0000 7f159dcaeb80 1 -- 172.21.15.70:0/2852781168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629334151d0 msgr2=0x562933423a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:02.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.944+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629334151d0 0x562933423a10 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f15800a9420 tx=0x7f1580091410 comp rx=0 tx=0).stop 2024-05-08T09:10:02.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.944+0000 7f159dcaeb80 1 -- 172.21.15.70:0/2852781168 shutdown_connections 2024-05-08T09:10:02.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.944+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5629334ab4d0 0x5629334ad8c0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:02.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.944+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562933424490 0x5629334a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:02.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.944+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5629334151d0 0x562933423a10 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:02.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.944+0000 7f159dcaeb80 1 --2- 172.21.15.70:0/2852781168 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56293341a240 0x562933423f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:02.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.945+0000 7f159dcaeb80 1 -- 172.21.15.70:0/2852781168 >> 172.21.15.70:0/2852781168 conn(0x56293338c860 msgr2=0x562933409bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:02.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.945+0000 7f1572a00700 0 client.19158 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:10:02.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.946+0000 7f159dcaeb80 1 -- 172.21.15.70:0/2852781168 shutdown_connections 2024-05-08T09:10:02.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.946+0000 7f159dcaeb80 1 -- 172.21.15.70:0/2852781168 wait complete. 2024-05-08T09:10:02.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.946+0000 7f159dcaeb80 20 client.19158 trim_cache size 0 max 16384 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 318, 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "d1e316d1": { 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 318, 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:10:02.948 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.9, 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:02.949 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:10:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 -- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15740b2ba0 msgr2=0x7f15740b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15740b2ba0 0x7f15740b5060 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f157800b2e0 tx=0x7f1578009570 comp rx=0 tx=0).stop 2024-05-08T09:10:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 -- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 msgr2=0x7f158c0779b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 0x7f158c0779b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f158000ef40 tx=0x7f158000c3a0 comp rx=0 tx=0).stop 2024-05-08T09:10:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 -- 172.21.15.70:0/1852752117 shutdown_connections 2024-05-08T09:10:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15740b2ba0 0x7f15740b5060 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f158c10b6c0 0x7f158c078430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:02.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f158c1056c0 0x7f158c0779b0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 --2- 172.21.15.70:0/1852752117 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f158c106080 0x7f158c077ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.948+0000 7f1593400700 1 -- 172.21.15.70:0/1852752117 >> 172.21.15.70:0/1852752117 conn(0x7f158c1011b0 msgr2=0x7f158c101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.949+0000 7f1593400700 1 -- 172.21.15.70:0/1852752117 shutdown_connections 2024-05-08T09:10:02.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:02.949+0000 7f1593400700 1 -- 172.21.15.70:0/1852752117 wait complete. 2024-05-08T09:10:03.790 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:03 smithi070 ceph-mon[29591]: pgmap v4575: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 53 KiB/s wr, 6 op/s 2024-05-08T09:10:03.844 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd1e316d1', quiesce took 35.9 seconds. Will release after: 19.9 2024-05-08T09:10:03.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:03 smithi172 ceph-mon[33377]: pgmap v4575: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 53 KiB/s wr, 6 op/s 2024-05-08T09:10:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:03 smithi194 ceph-mon[33679]: pgmap v4575: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 53 KiB/s wr, 6 op/s 2024-05-08T09:10:05.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:05 smithi070 ceph-mon[29591]: pgmap v4576: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 194 KiB/s wr, 29 op/s 2024-05-08T09:10:05.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:05 smithi172 ceph-mon[33377]: pgmap v4576: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 194 KiB/s wr, 29 op/s 2024-05-08T09:10:06.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:05 smithi194 ceph-mon[33679]: pgmap v4576: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 194 KiB/s wr, 29 op/s 2024-05-08T09:10:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:07 smithi070 ceph-mon[29591]: pgmap v4577: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 143 KiB/s wr, 26 op/s 2024-05-08T09:10:07.934 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:07 smithi172 ceph-mon[33377]: pgmap v4577: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 143 KiB/s wr, 26 op/s 2024-05-08T09:10:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:07 smithi194 ceph-mon[33679]: pgmap v4577: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 143 KiB/s wr, 26 op/s 2024-05-08T09:10:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:09 smithi070 ceph-mon[29591]: pgmap v4578: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 143 KiB/s wr, 26 op/s 2024-05-08T09:10:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:09 smithi070 ceph-mon[29591]: osdmap e363: 12 total, 12 up, 12 in 2024-05-08T09:10:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:09 smithi172 ceph-mon[33377]: pgmap v4578: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 143 KiB/s wr, 26 op/s 2024-05-08T09:10:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:09 smithi172 ceph-mon[33377]: osdmap e363: 12 total, 12 up, 12 in 2024-05-08T09:10:10.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:09 smithi194 ceph-mon[33679]: pgmap v4578: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 143 KiB/s wr, 26 op/s 2024-05-08T09:10:10.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:09 smithi194 ceph-mon[33679]: osdmap e363: 12 total, 12 up, 12 in 2024-05-08T09:10:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:11 smithi070 ceph-mon[29591]: pgmap v4580: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 220 KiB/s wr, 33 op/s 2024-05-08T09:10:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:11 smithi172 ceph-mon[33377]: pgmap v4580: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 220 KiB/s wr, 33 op/s 2024-05-08T09:10:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:11 smithi194 ceph-mon[33679]: pgmap v4580: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 220 KiB/s wr, 33 op/s 2024-05-08T09:10:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:13 smithi070 ceph-mon[29591]: pgmap v4581: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 220 KiB/s wr, 33 op/s 2024-05-08T09:10:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:13 smithi172 ceph-mon[33377]: pgmap v4581: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 220 KiB/s wr, 33 op/s 2024-05-08T09:10:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:13 smithi194 ceph-mon[33679]: pgmap v4581: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 220 KiB/s wr, 33 op/s 2024-05-08T09:10:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:15 smithi172 ceph-mon[33377]: pgmap v4582: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 8 op/s 2024-05-08T09:10:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:15 smithi194 ceph-mon[33679]: pgmap v4582: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 8 op/s 2024-05-08T09:10:16.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:15 smithi070 ceph-mon[29591]: pgmap v4582: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 110 KiB/s wr, 8 op/s 2024-05-08T09:10:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:17 smithi194 ceph-mon[33679]: osdmap e364: 12 total, 12 up, 12 in 2024-05-08T09:10:17.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:17 smithi194 ceph-mon[33679]: pgmap v4584: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 11 op/s 2024-05-08T09:10:17.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:17 smithi070 ceph-mon[29591]: osdmap e364: 12 total, 12 up, 12 in 2024-05-08T09:10:17.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:17 smithi070 ceph-mon[29591]: pgmap v4584: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 11 op/s 2024-05-08T09:10:17.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:17 smithi172 ceph-mon[33377]: osdmap e364: 12 total, 12 up, 12 in 2024-05-08T09:10:17.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:17 smithi172 ceph-mon[33377]: pgmap v4584: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 137 KiB/s wr, 11 op/s 2024-05-08T09:10:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:19 smithi070 ceph-mon[29591]: pgmap v4585: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 9 op/s 2024-05-08T09:10:19.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:19 smithi172 ceph-mon[33377]: pgmap v4585: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 9 op/s 2024-05-08T09:10:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:19 smithi194 ceph-mon[33679]: pgmap v4585: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 111 KiB/s wr, 9 op/s 2024-05-08T09:10:21.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:21 smithi070 ceph-mon[29591]: pgmap v4586: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2024-05-08T09:10:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:21 smithi172 ceph-mon[33377]: pgmap v4586: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2024-05-08T09:10:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:21 smithi194 ceph-mon[33679]: pgmap v4586: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2024-05-08T09:10:23.745 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:10:23.830 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:23 smithi070 ceph-mon[29591]: pgmap v4587: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2024-05-08T09:10:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:23 smithi172 ceph-mon[33377]: pgmap v4587: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2024-05-08T09:10:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:23 smithi194 ceph-mon[33679]: pgmap v4587: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 6 op/s 2024-05-08T09:10:24.230 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:10:25.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:25 smithi070 ceph-mon[29591]: pgmap v4588: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T09:10:25.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:25 smithi172 ceph-mon[33377]: pgmap v4588: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T09:10:26.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:25 smithi194 ceph-mon[33679]: pgmap v4588: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T09:10:26.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.563+0000 7f3069800700 1 -- 172.21.15.70:0/3336854649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3064075ff0 msgr2=0x7f306410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:26.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.563+0000 7f3069800700 1 --2- 172.21.15.70:0/3336854649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3064075ff0 0x7f306410f960 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f304c009990 tx=0x7f304c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.564+0000 7f3069800700 1 -- 172.21.15.70:0/3336854649 shutdown_connections 2024-05-08T09:10:26.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.564+0000 7f3069800700 1 --2- 172.21.15.70:0/3336854649 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f306410fea0 0x7f3064112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.564+0000 7f3069800700 1 --2- 172.21.15.70:0/3336854649 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30640756d0 0x7f3064075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.564+0000 7f3069800700 1 --2- 172.21.15.70:0/3336854649 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3064075ff0 0x7f306410f960 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.564+0000 7f3069800700 1 -- 172.21.15.70:0/3336854649 >> 172.21.15.70:0/3336854649 conn(0x7f306407a600 msgr2=0x7f306407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:26.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.564+0000 7f3069800700 1 -- 172.21.15.70:0/3336854649 shutdown_connections 2024-05-08T09:10:26.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.564+0000 7f3069800700 1 -- 172.21.15.70:0/3336854649 wait complete. 2024-05-08T09:10:26.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.565+0000 7f3069800700 1 Processor -- start 2024-05-08T09:10:26.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.565+0000 7f3069800700 1 -- start start 2024-05-08T09:10:26.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3069800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30640756d0 0x7f30641a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:26.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3069800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3064075ff0 0x7f30641a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:26.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3069800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f306410fea0 0x7f306419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:26.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3069800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3064115710 con 0x7f306410fea0 2024-05-08T09:10:26.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3069800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3064115590 con 0x7f30640756d0 2024-05-08T09:10:26.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3069800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3064115890 con 0x7f3064075ff0 2024-05-08T09:10:26.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3063400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f306410fea0 0x7f306419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:26.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3063400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f306410fea0 0x7f306419ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44548/0 (socket says 172.21.15.70:44548) 2024-05-08T09:10:26.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3063400700 1 -- 172.21.15.70:0/2428367921 learned_addr learned my addr 172.21.15.70:0/2428367921 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:10:26.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f3062a00700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30640756d0 0x7f30641a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.566+0000 7f305a000700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3064075ff0 0x7f30641a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f3063400700 1 -- 172.21.15.70:0/2428367921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3064075ff0 msgr2=0x7f30641a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f3063400700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3064075ff0 0x7f30641a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f3063400700 1 -- 172.21.15.70:0/2428367921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30640756d0 msgr2=0x7f30641a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f3063400700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30640756d0 0x7f30641a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f3063400700 1 -- 172.21.15.70:0/2428367921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306419c1d0 con 0x7f306410fea0 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f3063400700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f306410fea0 0x7f306419ba70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f305c00c8d0 tx=0x7f305c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f305be00700 1 -- 172.21.15.70:0/2428367921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c004460 con 0x7f306410fea0 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f305be00700 1 -- 172.21.15.70:0/2428367921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f305c003b10 con 0x7f306410fea0 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306419c4c0 con 0x7f306410fea0 2024-05-08T09:10:26.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.567+0000 7f305be00700 1 -- 172.21.15.70:0/2428367921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f305c007bd0 con 0x7f306410fea0 2024-05-08T09:10:26.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.568+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30641a8730 con 0x7f306410fea0 2024-05-08T09:10:26.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.569+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306406a190 con 0x7f306410fea0 2024-05-08T09:10:26.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.571+0000 7f305be00700 1 -- 172.21.15.70:0/2428367921 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f305c003cc0 con 0x7f306410fea0 2024-05-08T09:10:26.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.573+0000 7f305be00700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30480b2a70 0x7f30480b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:26.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.573+0000 7f305be00700 1 -- 172.21.15.70:0/2428367921 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(364..364 src has 1..364) ==== 9583+0+0 (secure 0 0 0) 0x7f305c0e2a10 con 0x7f306410fea0 2024-05-08T09:10:26.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.573+0000 7f3062a00700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30480b2a70 0x7f30480b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:26.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.574+0000 7f3062a00700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30480b2a70 0x7f30480b4f30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3054009550 tx=0x7f30540091b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:10:26.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.575+0000 7f305be00700 1 -- 172.21.15.70:0/2428367921 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f305c013030 con 0x7f306410fea0 2024-05-08T09:10:26.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.856+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f306419cf50 con 0x7f306410fea0 2024-05-08T09:10:26.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.858+0000 7f305be00700 1 -- 172.21.15.70:0/2428367921 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f305c0aa000 con 0x7f306410fea0 2024-05-08T09:10:26.859 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:10:26.859 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:10:26.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.861+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30480b2a70 msgr2=0x7f30480b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:26.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.861+0000 7f3069800700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30480b2a70 0x7f30480b4f30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3054009550 tx=0x7f30540091b0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.861+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f306410fea0 msgr2=0x7f306419ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:26.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.861+0000 7f3069800700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f306410fea0 0x7f306419ba70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f305c00c8d0 tx=0x7f305c00cbe0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.862+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 shutdown_connections 2024-05-08T09:10:26.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.862+0000 7f3069800700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f30480b2a70 0x7f30480b4f30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.862+0000 7f3069800700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f306410fea0 0x7f306419ba70 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.862+0000 7f3069800700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f30640756d0 0x7f30641a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.862+0000 7f3069800700 1 --2- 172.21.15.70:0/2428367921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3064075ff0 0x7f30641a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:26.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.862+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 >> 172.21.15.70:0/2428367921 conn(0x7f306407a600 msgr2=0x7f3064100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:26.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.862+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 shutdown_connections 2024-05-08T09:10:26.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:26.862+0000 7f3069800700 1 -- 172.21.15.70:0/2428367921 wait complete. 2024-05-08T09:10:26.864 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:10:27.688 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id d1e316d1 --release --await' 2024-05-08T09:10:27.688 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id d1e316d1 --release --await 2024-05-08T09:10:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:27 smithi070 ceph-mon[29591]: pgmap v4589: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-08T09:10:27.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:27 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2428367921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:10:27.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:27 smithi172 ceph-mon[33377]: pgmap v4589: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-08T09:10:27.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:27 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2428367921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:10:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:27 smithi194 ceph-mon[33679]: pgmap v4589: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-05-08T09:10:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:27 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2428367921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:10:28.130 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:10:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:29 smithi070 ceph-mon[29591]: pgmap v4590: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:10:29.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:29 smithi172 ceph-mon[33377]: pgmap v4590: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:10:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:29 smithi194 ceph-mon[33679]: pgmap v4590: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:10:30.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.584+0000 7f2d81800700 1 -- 172.21.15.70:0/937017514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 msgr2=0x7f2d7c1124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:30.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.584+0000 7f2d81800700 1 --2- 172.21.15.70:0/937017514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 0x7f2d7c1124a0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400b0a0 tx=0x7f2d7400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.584+0000 7f2d81800700 1 -- 172.21.15.70:0/937017514 shutdown_connections 2024-05-08T09:10:30.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.584+0000 7f2d81800700 1 --2- 172.21.15.70:0/937017514 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 0x7f2d7c1124a0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.584+0000 7f2d81800700 1 --2- 172.21.15.70:0/937017514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c10b660 0x7f2d7c10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.584+0000 7f2d81800700 1 --2- 172.21.15.70:0/937017514 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c1055d0 0x7f2d7c105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.584+0000 7f2d81800700 1 -- 172.21.15.70:0/937017514 >> 172.21.15.70:0/937017514 conn(0x7f2d7c1010c0 msgr2=0x7f2d7c1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:30.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.584+0000 7f2d81800700 1 -- 172.21.15.70:0/937017514 shutdown_connections 2024-05-08T09:10:30.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.584+0000 7f2d81800700 1 -- 172.21.15.70:0/937017514 wait complete. 2024-05-08T09:10:30.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.585+0000 7f2d81800700 1 Processor -- start 2024-05-08T09:10:30.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.585+0000 7f2d81800700 1 -- start start 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d81800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c1055d0 0x7f2d7c1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d81800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 0x7f2d7c1a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d81800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c10b660 0x7f2d7c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d81800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c115680 con 0x7f2d7c105f90 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d81800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c115500 con 0x7f2d7c1055d0 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d81800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c115800 con 0x7f2d7c10b660 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d7b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 0x7f2d7c1a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d7b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 0x7f2d7c1a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47362/0 (socket says 172.21.15.70:47362) 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d7b400700 1 -- 172.21.15.70:0/3892859014 learned_addr learned my addr 172.21.15.70:0/3892859014 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d7be00700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c1055d0 0x7f2d7c1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d80e00700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c10b660 0x7f2d7c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.586+0000 7f2d7b400700 1 -- 172.21.15.70:0/3892859014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c10b660 msgr2=0x7f2d7c19b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:30.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d7b400700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c10b660 0x7f2d7c19b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d7b400700 1 -- 172.21.15.70:0/3892859014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c1055d0 msgr2=0x7f2d7c1a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:30.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d7b400700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c1055d0 0x7f2d7c1a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d7b400700 1 -- 172.21.15.70:0/3892859014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7c19c020 con 0x7f2d7c105f90 2024-05-08T09:10:30.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d7b400700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 0x7f2d7c1a1c00 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c9b0 tx=0x7f2d6800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:10:30.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d78c00700 1 -- 172.21.15.70:0/3892859014 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68007b00 con 0x7f2d7c105f90 2024-05-08T09:10:30.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d78c00700 1 -- 172.21.15.70:0/3892859014 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d68007ca0 con 0x7f2d7c105f90 2024-05-08T09:10:30.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d81800700 1 -- 172.21.15.70:0/3892859014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7c19c310 con 0x7f2d7c105f90 2024-05-08T09:10:30.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d78c00700 1 -- 172.21.15.70:0/3892859014 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68018660 con 0x7f2d7c105f90 2024-05-08T09:10:30.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.587+0000 7f2d81800700 1 -- 172.21.15.70:0/3892859014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7c1a8520 con 0x7f2d7c105f90 2024-05-08T09:10:30.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.592+0000 7f2d78c00700 1 -- 172.21.15.70:0/3892859014 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2d6800f450 con 0x7f2d7c105f90 2024-05-08T09:10:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.593+0000 7f2d78c00700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d600b29f0 0x7f2d600b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.593+0000 7f2d78c00700 1 -- 172.21.15.70:0/3892859014 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(364..364 src has 1..364) ==== 9583+0+0 (secure 0 0 0) 0x7f2d680e2b50 con 0x7f2d7c105f90 2024-05-08T09:10:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.594+0000 7f2d7be00700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d600b29f0 0x7f2d600b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.594+0000 7f2d7be00700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d600b29f0 0x7f2d600b4eb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c005950 tx=0x7f2d6c0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:10:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.608+0000 7f2d8d7fab80 1 Processor -- start 2024-05-08T09:10:30.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.608+0000 7f2d8d7fab80 1 -- start start 2024-05-08T09:10:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.608+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049a250 0x55dc0049a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.608+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc00494780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.608+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 0x55dc00495200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.608+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dc003e6b20 con 0x55dc0049ab70 2024-05-08T09:10:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.608+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dc00384860 con 0x55dc00494da0 2024-05-08T09:10:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.608+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dc003e2ae0 con 0x55dc0049a250 2024-05-08T09:10:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d7b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc00494780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d7b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc00494780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47368/0 (socket says 172.21.15.70:47368) 2024-05-08T09:10:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d7b400700 1 -- 172.21.15.70:0/1787024639 learned_addr learned my addr 172.21.15.70:0/1787024639 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:10:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d7be00700 1 --2- 172.21.15.70:0/1787024639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049a250 0x55dc0049a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d80e00700 1 --2- 172.21.15.70:0/1787024639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 0x55dc00495200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d7b400700 1 -- 172.21.15.70:0/1787024639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049a250 msgr2=0x55dc0049a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:10:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d7b400700 1 --2- 172.21.15.70:0/1787024639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049a250 0x55dc0049a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d7b400700 1 -- 172.21.15.70:0/1787024639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 msgr2=0x55dc00495200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:10:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d7b400700 1 --2- 172.21.15.70:0/1787024639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 0x55dc00495200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.609+0000 7f2d7b400700 1 -- 172.21.15.70:0/1787024639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc003339d0 con 0x55dc0049ab70 2024-05-08T09:10:30.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.610+0000 7f2d7b400700 1 --2- 172.21.15.70:0/1787024639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc00494780 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800fcf0 tx=0x7f2d680a94c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b3a8b049437bac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.610+0000 7f2d71600700 1 -- 172.21.15.70:0/1787024639 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680add60 con 0x55dc0049ab70 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.610+0000 7f2d71600700 1 -- 172.21.15.70:0/1787024639 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d680b2810 con 0x55dc0049ab70 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.610+0000 7f2d71600700 1 -- 172.21.15.70:0/1787024639 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680cc0d0 con 0x55dc0049ab70 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.611+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/1787024639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 msgr2=0x55dc00494780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.611+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/1787024639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc00494780 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800fcf0 tx=0x7f2d680a94c0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.611+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/1787024639 shutdown_connections 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.611+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/1787024639 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 0x55dc00495200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.611+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/1787024639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049a250 0x55dc0049a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.611+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/1787024639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc00494780 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.611+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/1787024639 >> 172.21.15.70:0/1787024639 conn(0x55dc0040c7d0 msgr2=0x55dc0048f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.611+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/1787024639 shutdown_connections 2024-05-08T09:10:30.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.611+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/1787024639 wait complete. 2024-05-08T09:10:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.612+0000 7f2d8d7fab80 1 -- start start 2024-05-08T09:10:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.612+0000 7f2d8d7fab80 1 Processor -- start 2024-05-08T09:10:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.612+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc00494da0 0x55dc004a0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.612+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 0x55dc0049dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc0049e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dc004a1630 con 0x55dc0049ab70 2024-05-08T09:10:30.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55dc0034cc20 con 0x55dc0049a250 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55dc004a17b0 con 0x55dc00494da0 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d8d7fab80 10 client.0 _ll_register_callbacks cb 0x55dc0038dd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d80e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc0049e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d80e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc0049e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47370/0 (socket says 172.21.15.70:47370) 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d80e00700 1 -- 172.21.15.70:0/90139611 learned_addr learned my addr 172.21.15.70:0/90139611 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d7be00700 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc00494da0 0x55dc004a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d7b400700 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 0x55dc0049dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d80e00700 1 -- 172.21.15.70:0/90139611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc00494da0 msgr2=0x55dc004a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d80e00700 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc00494da0 0x55dc004a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d80e00700 1 -- 172.21.15.70:0/90139611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 msgr2=0x55dc0049dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d80e00700 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 0x55dc0049dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.613+0000 7f2d80e00700 1 -- 172.21.15.70:0/90139611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc003ac520 con 0x55dc0049ab70 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.614+0000 7f2d80e00700 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc0049e1c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009e50 tx=0x7f2d740095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ffaf9ce0c67de2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.614+0000 7f2d66000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:10:30.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.614+0000 7f2d66000700 1 -- 172.21.15.70:0/90139611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740076e0 con 0x55dc0049ab70 2024-05-08T09:10:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.614+0000 7f2d66000700 1 -- 172.21.15.70:0/90139611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(364..364 src has 1..364) ==== 9583+0+0 (secure 0 0 0) 0x7f2d74007880 con 0x55dc0049ab70 2024-05-08T09:10:30.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.614+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/90139611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d680b2810 con 0x55dc0049ab70 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d66000700 1 -- 172.21.15.70:0/90139611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2d7402f050 con 0x55dc0049ab70 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d8d7fab80 10 client.19176 fetch_fsmap learned FSMap version 42 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/90139611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55dc004abeb0 con 0x55dc0049ab70 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d66000700 1 -- 172.21.15.70:0/90139611 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d680b2810 con 0x55dc0049ab70 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d66000700 1 -- 172.21.15.70:0/90139611 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2d74011070 con 0x55dc0049ab70 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d8d7fab80 10 client.19176 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d8d7fab80 10 client.19176 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d8d7fab80 20 client.19176 populate_metadata read hostname 'smithi070' 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dc004ae4f0 0x55dc004b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d8d7fab80 4 client.19176 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.615+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/90139611 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc00461240 con 0x55dc004ae4f0 2024-05-08T09:10:30.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.616+0000 7f2d7be00700 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dc004ae4f0 0x55dc004b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.617+0000 7f2d7be00700 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dc004ae4f0 0x55dc004b08e0 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64327a774b43fa6b server_cookie=e88a6ef70ed03910 in_seq=0 out_seq=0 2024-05-08T09:10:30.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.617+0000 7f2d66000700 10 client.19176 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:10:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.619+0000 7f2d66000700 1 -- 172.21.15.70:0/90139611 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dc00461240 con 0x55dc004ae4f0 2024-05-08T09:10:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.619+0000 7f2d66000700 10 client.19176 handle_command_reply: tid=0 2024-05-08T09:10:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.619+0000 7f2d8d7fab80 1 client.19176 shutdown 2024-05-08T09:10:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.619+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/90139611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 msgr2=0x55dc0049e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:30.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.619+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc0049e1c0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009e50 tx=0x7f2d740095d0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/90139611 shutdown_connections 2024-05-08T09:10:30.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dc004ae4f0 0x55dc004b08e0 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049ab70 0x55dc0049e1c0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc00494da0 0x55dc004a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/90139611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 0x55dc0049dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/90139611 >> 172.21.15.70:0/90139611 conn(0x55dc0040c7d0 msgr2=0x55dc00493770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:30.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d66000700 0 client.19176 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:10:30.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/90139611 shutdown_connections 2024-05-08T09:10:30.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/90139611 wait complete. 2024-05-08T09:10:30.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.620+0000 7f2d8d7fab80 20 client.19176 trim_cache size 0 max 16384 2024-05-08T09:10:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.641+0000 7f2d8d7fab80 1 Processor -- start 2024-05-08T09:10:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.641+0000 7f2d8d7fab80 1 -- start start 2024-05-08T09:10:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.642+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 0x55dc0049b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.642+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049a250 0x55dc004b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.642+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 0x55dc004b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.642+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c1b3d80 con 0x55dc0049a250 2024-05-08T09:10:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.642+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c1b1610 con 0x55dc00494da0 2024-05-08T09:10:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.642+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c1af480 con 0x55dc0049ab70 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.642+0000 7f2d7b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049a250 0x55dc004b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.642+0000 7f2d7b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049a250 0x55dc004b6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47378/0 (socket says 172.21.15.70:47378) 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.642+0000 7f2d7b400700 1 -- 172.21.15.70:0/2649383770 learned_addr learned my addr 172.21.15.70:0/2649383770 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d80e00700 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 0x55dc004b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d7be00700 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 0x55dc0049b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d7b400700 1 -- 172.21.15.70:0/2649383770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 msgr2=0x55dc004b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d7b400700 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 0x55dc004b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d7b400700 1 -- 172.21.15.70:0/2649383770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 msgr2=0x55dc0049b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d7b400700 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 0x55dc0049b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d7b400700 1 -- 172.21.15.70:0/2649383770 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc0048bc20 con 0x55dc0049a250 2024-05-08T09:10:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d80e00700 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 0x55dc004b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:10:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d7b400700 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049a250 0x55dc004b6160 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f2d680a6c20 tx=0x7f2d6800fc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8774813a45d05f40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:10:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.643+0000 7f2d70c00700 1 -- 172.21.15.70:0/2649383770 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6806e070 con 0x55dc0049a250 2024-05-08T09:10:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d70c00700 1 -- 172.21.15.70:0/2649383770 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d680b2810 con 0x55dc0049a250 2024-05-08T09:10:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d70c00700 1 -- 172.21.15.70:0/2649383770 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d680a5c40 con 0x55dc0049a250 2024-05-08T09:10:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2649383770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049a250 msgr2=0x55dc004b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049a250 0x55dc004b6160 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f2d680a6c20 tx=0x7f2d6800fc40 comp rx=0 tx=0).stop 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2649383770 shutdown_connections 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 0x55dc004b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc00494da0 0x55dc0049b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2649383770 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc0049a250 0x55dc004b6160 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2649383770 >> 172.21.15.70:0/2649383770 conn(0x55dc0040c7d0 msgr2=0x55dc0049b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2649383770 shutdown_connections 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.644+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2649383770 wait complete. 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.645+0000 7f2d8d7fab80 1 -- start start 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.645+0000 7f2d8d7fab80 1 Processor -- start 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.645+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc00494da0 0x55dc004a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.645+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 0x55dc004a6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d8d7fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 0x55dc00521540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c1afad0 con 0x55dc00494da0 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c1b0f40 con 0x55dc0049a250 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d8d7fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7c1b01a0 con 0x55dc0049ab70 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d8d7fab80 10 client.0 _ll_register_callbacks cb 0x55dc0038dd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc00494da0 0x55dc004a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc00494da0 0x55dc004a5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47382/0 (socket says 172.21.15.70:47382) 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7be00700 1 -- 172.21.15.70:0/2138956800 learned_addr learned my addr 172.21.15.70:0/2138956800 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d80e00700 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 0x55dc00521540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7b400700 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 0x55dc004a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7be00700 1 -- 172.21.15.70:0/2138956800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 msgr2=0x55dc00521540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7be00700 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 0x55dc00521540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7be00700 1 -- 172.21.15.70:0/2138956800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 msgr2=0x55dc004a6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7be00700 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 0x55dc004a6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7be00700 1 -- 172.21.15.70:0/2138956800 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc0049bc60 con 0x55dc00494da0 2024-05-08T09:10:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.646+0000 7f2d7b400700 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 0x55dc004a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:10:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.647+0000 7f2d7be00700 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc00494da0 0x55dc004a5ce0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x55dc004b1100 tx=0x7f2d6c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82848e528f27acc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:10:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.647+0000 7f2d66000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.647+0000 7f2d66000700 1 -- 172.21.15.70:0/2138956800 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c020db0 con 0x55dc00494da0 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.647+0000 7f2d66000700 1 -- 172.21.15.70:0/2138956800 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(364..364 src has 1..364) ==== 9583+0+0 (secure 0 0 0) 0x7f2d6c029330 con 0x55dc00494da0 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.647+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2138956800 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d680b2810 con 0x55dc00494da0 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.647+0000 7f2d66000700 1 -- 172.21.15.70:0/2138956800 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2d6c039050 con 0x55dc00494da0 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d8d7fab80 10 client.19182 fetch_fsmap learned FSMap version 42 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2138956800 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55dc00522c80 con 0x55dc00494da0 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d66000700 1 -- 172.21.15.70:0/2138956800 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d680b2810 con 0x55dc00494da0 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d66000700 1 -- 172.21.15.70:0/2138956800 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2d6c011970 con 0x55dc00494da0 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d8d7fab80 10 client.19182 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d8d7fab80 10 client.19182 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d8d7fab80 20 client.19182 populate_metadata read hostname 'smithi070' 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dc005233e0 0x55dc00525800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:10:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d8d7fab80 4 client.19182 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d1e316d1", "release": true, "await": true}] 2024-05-08T09:10:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.648+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2138956800 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d1e316d1", "release": true, "await": true}) -- 0x55dc003f4500 con 0x55dc005233e0 2024-05-08T09:10:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.649+0000 7f2d7b400700 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dc005233e0 0x55dc00525800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:10:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.650+0000 7f2d7b400700 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dc005233e0 0x55dc00525800 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e71f8631f37268 server_cookie=513fb6d116f9255a in_seq=0 out_seq=0 2024-05-08T09:10:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:30.650+0000 7f2d66000700 10 client.19182 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:10:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:31 smithi070 ceph-mon[29591]: pgmap v4591: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:10:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:31 smithi172 ceph-mon[33377]: pgmap v4591: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:10:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:31 smithi194 ceph-mon[33679]: pgmap v4591: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:10:33.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:33 smithi070 ceph-mon[29591]: pgmap v4592: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:10:33.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:33 smithi172 ceph-mon[33377]: pgmap v4592: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:10:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:33 smithi194 ceph-mon[33679]: pgmap v4592: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:10:35.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.241+0000 7f2d66000700 1 -- 172.21.15.70:0/2138956800 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55dc003f4500 con 0x55dc005233e0 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.241+0000 7f2d66000700 10 client.19182 handle_command_reply: tid=0 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.241+0000 7f2d8d7fab80 1 client.19182 shutdown 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2138956800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc00494da0 msgr2=0x55dc004a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc00494da0 0x55dc004a5ce0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x55dc004b1100 tx=0x7f2d6c0047c0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2138956800 shutdown_connections 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55dc005233e0 0x55dc00525800 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55dc0049ab70 0x55dc00521540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dc00494da0 0x55dc004a5ce0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d8d7fab80 1 --2- 172.21.15.70:0/2138956800 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55dc0049a250 0x55dc004a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2138956800 >> 172.21.15.70:0/2138956800 conn(0x55dc0040c7d0 msgr2=0x55dc00498dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d66000700 0 client.19182 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:10:35.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.242+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2138956800 shutdown_connections 2024-05-08T09:10:35.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.243+0000 7f2d8d7fab80 1 -- 172.21.15.70:0/2138956800 wait complete. 2024-05-08T09:10:35.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.243+0000 7f2d8d7fab80 20 client.19182 trim_cache size 0 max 16384 2024-05-08T09:10:35.243 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 320, 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "d1e316d1": { 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 320, 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:10:35.244 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 79.9, 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:10:35.245 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:10:35.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 -- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d600b29f0 msgr2=0x7f2d600b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:35.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d600b29f0 0x7f2d600b4eb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c005950 tx=0x7f2d6c0058e0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 -- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 msgr2=0x7f2d7c1a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:10:35.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 0x7f2d7c1a1c00 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800c9b0 tx=0x7f2d6800cd70 comp rx=0 tx=0).stop 2024-05-08T09:10:35.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 -- 172.21.15.70:0/3892859014 shutdown_connections 2024-05-08T09:10:35.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d600b29f0 0x7f2d600b4eb0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d7c10b660 0x7f2d7c19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d7c1055d0 0x7f2d7c1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 --2- 172.21.15.70:0/3892859014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d7c105f90 0x7f2d7c1a1c00 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:10:35.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.244+0000 7f2d81800700 1 -- 172.21.15.70:0/3892859014 >> 172.21.15.70:0/3892859014 conn(0x7f2d7c1010c0 msgr2=0x7f2d7c102600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:10:35.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.245+0000 7f2d81800700 1 -- 172.21.15.70:0/3892859014 shutdown_connections 2024-05-08T09:10:35.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:10:35.245+0000 7f2d81800700 1 -- 172.21.15.70:0/3892859014 wait complete. 2024-05-08T09:10:35.703 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:35 smithi070 ceph-mon[29591]: pgmap v4593: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5.7 KiB/s wr, 7 op/s 2024-05-08T09:10:35.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:35 smithi172 ceph-mon[33377]: pgmap v4593: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5.7 KiB/s wr, 7 op/s 2024-05-08T09:10:36.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:35 smithi194 ceph-mon[33679]: pgmap v4593: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 5.7 KiB/s wr, 7 op/s 2024-05-08T09:10:36.286 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd1e316d1', seconds elapsed: 68.4 2024-05-08T09:10:36.453 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_ring.o 2024-05-08T09:10:36.461 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/pps/sysfs.o 2024-05-08T09:10:36.809 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_ring_submission.o 2024-05-08T09:10:37.631 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_rps.o 2024-05-08T09:10:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:37 smithi070 ceph-mon[29591]: pgmap v4594: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-05-08T09:10:37.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:37 smithi172 ceph-mon[33377]: pgmap v4594: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-05-08T09:10:38.003 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ptp/ptp_sysfs.o 2024-05-08T09:10:38.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:37 smithi194 ceph-mon[33679]: pgmap v4594: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-05-08T09:10:38.153 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ptp/ptp_vclock.o 2024-05-08T09:10:38.391 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/virtio_net.o 2024-05-08T09:10:38.847 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ptp/ptp_kvm_x86.o 2024-05-08T09:10:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:39 smithi070 ceph-mon[29591]: pgmap v4595: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-05-08T09:10:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:39 smithi172 ceph-mon[33377]: pgmap v4595: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-05-08T09:10:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:39 smithi194 ceph-mon[33679]: pgmap v4595: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-05-08T09:10:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:41 smithi070 ceph-mon[29591]: pgmap v4596: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 332 KiB/s wr, 17 op/s 2024-05-08T09:10:41.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:41 smithi172 ceph-mon[33377]: pgmap v4596: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 332 KiB/s wr, 17 op/s 2024-05-08T09:10:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:41 smithi194 ceph-mon[33679]: pgmap v4596: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 332 KiB/s wr, 17 op/s 2024-05-08T09:10:42.932 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/pps/built-in.a 2024-05-08T09:10:43.179 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_sa_media.o 2024-05-08T09:10:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:43 smithi070 ceph-mon[29591]: pgmap v4597: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 332 KiB/s wr, 14 op/s 2024-05-08T09:10:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:43 smithi172 ceph-mon[33377]: pgmap v4597: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 332 KiB/s wr, 14 op/s 2024-05-08T09:10:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:43 smithi194 ceph-mon[33679]: pgmap v4597: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 332 KiB/s wr, 14 op/s 2024-05-08T09:10:45.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:45 smithi070 ceph-mon[29591]: pgmap v4598: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 602 KiB/s wr, 24 op/s 2024-05-08T09:10:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:45 smithi172 ceph-mon[33377]: pgmap v4598: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 602 KiB/s wr, 24 op/s 2024-05-08T09:10:46.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:45 smithi194 ceph-mon[33679]: pgmap v4598: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 600 KiB/s rd, 602 KiB/s wr, 24 op/s 2024-05-08T09:10:47.015 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_mode_config.o 2024-05-08T09:10:47.223 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/power/supply/power_supply_core.o 2024-05-08T09:10:47.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:47 smithi070 ceph-mon[29591]: pgmap v4599: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 597 KiB/s wr, 20 op/s 2024-05-08T09:10:47.880 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/ptp/ptp_kvm_common.o 2024-05-08T09:10:47.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:47 smithi172 ceph-mon[33377]: pgmap v4599: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 597 KiB/s wr, 20 op/s 2024-05-08T09:10:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:47 smithi194 ceph-mon[33679]: pgmap v4599: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 597 KiB/s wr, 20 op/s 2024-05-08T09:10:49.040 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_mode_object.o 2024-05-08T09:10:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:49 smithi070 ceph-mon[29591]: pgmap v4600: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 597 KiB/s wr, 20 op/s 2024-05-08T09:10:49.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:49 smithi172 ceph-mon[33377]: pgmap v4600: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 597 KiB/s wr, 20 op/s 2024-05-08T09:10:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:49 smithi194 ceph-mon[33679]: pgmap v4600: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 597 KiB/s wr, 20 op/s 2024-05-08T09:10:50.956 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_modes.o 2024-05-08T09:10:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:51 smithi070 ceph-mon[29591]: pgmap v4601: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 724 KiB/s wr, 34 op/s 2024-05-08T09:10:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:51 smithi172 ceph-mon[33377]: pgmap v4601: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 724 KiB/s wr, 34 op/s 2024-05-08T09:10:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:51 smithi194 ceph-mon[33679]: pgmap v4601: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 724 KiB/s wr, 34 op/s 2024-05-08T09:10:52.202 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/net/net_failover.o 2024-05-08T09:10:53.004 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/power/supply/power_supply_sysfs.o 2024-05-08T09:10:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:53 smithi070 ceph-mon[29591]: pgmap v4602: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 398 KiB/s wr, 22 op/s 2024-05-08T09:10:53.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:53 smithi172 ceph-mon[33377]: pgmap v4602: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 398 KiB/s wr, 22 op/s 2024-05-08T09:10:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:53 smithi194 ceph-mon[33679]: pgmap v4602: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 398 KiB/s wr, 22 op/s 2024-05-08T09:10:54.871 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_modeset_lock.o 2024-05-08T09:10:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:55 smithi070 ceph-mon[29591]: pgmap v4603: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 932 KiB/s wr, 34 op/s 2024-05-08T09:10:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:10:55.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:55 smithi172 ceph-mon[33377]: pgmap v4603: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 932 KiB/s wr, 34 op/s 2024-05-08T09:10:55.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:10:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:55 smithi194 ceph-mon[33679]: pgmap v4603: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 932 KiB/s wr, 34 op/s 2024-05-08T09:10:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:10:56.671 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_sseu.o 2024-05-08T09:10:57.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:57.390 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_sseu_debugfs.o 2024-05-08T09:10:57.946 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/ptp/built-in.a 2024-05-08T09:10:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:57 smithi194 ceph-mon[33679]: pgmap v4604: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 662 KiB/s wr, 25 op/s 2024-05-08T09:10:58.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:10:58.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:10:58.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:57 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:58.082 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:57 smithi172 ceph-mon[33377]: pgmap v4604: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 662 KiB/s wr, 25 op/s 2024-05-08T09:10:58.082 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:10:58.082 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:10:58.082 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:57 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:57 smithi070 ceph-mon[29591]: pgmap v4604: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 662 KiB/s wr, 25 op/s 2024-05-08T09:10:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:10:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:10:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:57 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:10:58.504 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hwmon/hwmon.o 2024-05-08T09:10:59.323 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_plane.o 2024-05-08T09:11:00.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:10:59 smithi194 ceph-mon[33679]: pgmap v4605: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 662 KiB/s wr, 25 op/s 2024-05-08T09:11:00.037 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/power/supply/power_supply_leds.o 2024-05-08T09:11:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:10:59 smithi070 ceph-mon[29591]: pgmap v4605: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 662 KiB/s wr, 25 op/s 2024-05-08T09:11:00.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:10:59 smithi172 ceph-mon[33377]: pgmap v4605: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 662 KiB/s wr, 25 op/s 2024-05-08T09:11:01.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:00 smithi070 ceph-mon[29591]: pgmap v4606: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 990 KiB/s wr, 36 op/s 2024-05-08T09:11:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:00 smithi172 ceph-mon[33377]: pgmap v4606: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 990 KiB/s wr, 36 op/s 2024-05-08T09:11:01.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:00 smithi194 ceph-mon[33679]: pgmap v4606: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 990 KiB/s wr, 36 op/s 2024-05-08T09:11:03.228 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/power/supply/power_supply_hwmon.o 2024-05-08T09:11:03.831 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:03 smithi070 ceph-mon[29591]: pgmap v4607: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 862 KiB/s wr, 22 op/s 2024-05-08T09:11:03.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:03 smithi172 ceph-mon[33377]: pgmap v4607: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 862 KiB/s wr, 22 op/s 2024-05-08T09:11:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:03 smithi194 ceph-mon[33679]: pgmap v4607: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 862 KiB/s wr, 22 op/s 2024-05-08T09:11:05.361 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/net/built-in.a 2024-05-08T09:11:05.581 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/thermal/broadcom/built-in.a 2024-05-08T09:11:05.781 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/thermal/samsung/built-in.a 2024-05-08T09:11:05.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:05 smithi070 ceph-mon[29591]: pgmap v4608: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-05-08T09:11:05.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:05 smithi172 ceph-mon[33377]: pgmap v4608: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-05-08T09:11:06.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:05 smithi194 ceph-mon[33679]: pgmap v4608: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-05-08T09:11:06.030 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/thermal/intel/intel_tcc.o 2024-05-08T09:11:07.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:07 smithi070 ceph-mon[29591]: pgmap v4609: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 574 KiB/s wr, 43 op/s 2024-05-08T09:11:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:07 smithi172 ceph-mon[33377]: pgmap v4609: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 574 KiB/s wr, 43 op/s 2024-05-08T09:11:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:07 smithi194 ceph-mon[33679]: pgmap v4609: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 574 KiB/s wr, 43 op/s 2024-05-08T09:11:08.051 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/thermal/intel/therm_throt.o 2024-05-08T09:11:08.058 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] drivers/thermal/intel/x86_pkg_temp_thermal.o 2024-05-08T09:11:08.675 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/thermal/st/built-in.a 2024-05-08T09:11:08.939 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/watchdog/built-in.a 2024-05-08T09:11:09.254 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/thermal/qcom/built-in.a 2024-05-08T09:11:09.620 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/md.o 2024-05-08T09:11:09.814 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:09 smithi194 ceph-mon[33679]: pgmap v4610: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 574 KiB/s wr, 43 op/s 2024-05-08T09:11:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:09 smithi070 ceph-mon[29591]: pgmap v4610: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 574 KiB/s wr, 43 op/s 2024-05-08T09:11:09.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:09 smithi172 ceph-mon[33377]: pgmap v4610: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 574 KiB/s wr, 43 op/s 2024-05-08T09:11:10.336 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/hwmon/built-in.a 2024-05-08T09:11:10.442 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/power/supply/built-in.a 2024-05-08T09:11:10.494 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/md-bitmap.o 2024-05-08T09:11:10.656 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpufreq/cpufreq.o 2024-05-08T09:11:10.863 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/power/built-in.a 2024-05-08T09:11:11.429 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpuidle/governors/menu.o 2024-05-08T09:11:11.609 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/mmc/built-in.a 2024-05-08T09:11:11.730 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_timeline.o 2024-05-08T09:11:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:11 smithi070 ceph-mon[29591]: pgmap v4611: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1020 KiB/s wr, 57 op/s 2024-05-08T09:11:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:11 smithi070 ceph-mon[29591]: osdmap e365: 12 total, 12 up, 12 in 2024-05-08T09:11:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:11 smithi172 ceph-mon[33377]: pgmap v4611: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1020 KiB/s wr, 57 op/s 2024-05-08T09:11:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:11 smithi172 ceph-mon[33377]: osdmap e365: 12 total, 12 up, 12 in 2024-05-08T09:11:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:11 smithi194 ceph-mon[33679]: pgmap v4611: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1020 KiB/s wr, 57 op/s 2024-05-08T09:11:12.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:11 smithi194 ceph-mon[33679]: osdmap e365: 12 total, 12 up, 12 in 2024-05-08T09:11:12.045 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpuidle/governors/haltpoll.o 2024-05-08T09:11:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:13 smithi070 ceph-mon[29591]: pgmap v4613: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 830 KiB/s wr, 55 op/s 2024-05-08T09:11:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:13 smithi172 ceph-mon[33377]: pgmap v4613: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 830 KiB/s wr, 55 op/s 2024-05-08T09:11:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:13 smithi194 ceph-mon[33679]: pgmap v4613: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 830 KiB/s wr, 55 op/s 2024-05-08T09:11:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:15 smithi070 ceph-mon[29591]: pgmap v4614: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 869 KiB/s wr, 36 op/s 2024-05-08T09:11:15.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:15 smithi172 ceph-mon[33377]: pgmap v4614: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 869 KiB/s wr, 36 op/s 2024-05-08T09:11:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:15 smithi194 ceph-mon[33679]: pgmap v4614: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 869 KiB/s wr, 36 op/s 2024-05-08T09:11:17.434 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpuidle/cpuidle.o 2024-05-08T09:11:17.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:17 smithi070 ceph-mon[29591]: osdmap e366: 12 total, 12 up, 12 in 2024-05-08T09:11:17.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:17 smithi070 ceph-mon[29591]: pgmap v4616: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 46 op/s 2024-05-08T09:11:17.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:17 smithi172 ceph-mon[33377]: osdmap e366: 12 total, 12 up, 12 in 2024-05-08T09:11:17.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:17 smithi172 ceph-mon[33377]: pgmap v4616: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 46 op/s 2024-05-08T09:11:17.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:17 smithi194 ceph-mon[33679]: osdmap e366: 12 total, 12 up, 12 in 2024-05-08T09:11:17.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:17 smithi194 ceph-mon[33679]: pgmap v4616: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 46 op/s 2024-05-08T09:11:18.162 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpuidle/driver.o 2024-05-08T09:11:18.589 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/thermal/intel/built-in.a 2024-05-08T09:11:18.923 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/thermal/tegra/built-in.a 2024-05-08T09:11:19.105 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/thermal/mediatek/built-in.a 2024-05-08T09:11:19.222 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/thermal/thermal_core.o 2024-05-08T09:11:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:19 smithi070 ceph-mon[29591]: pgmap v4617: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 417 KiB/s wr, 25 op/s 2024-05-08T09:11:19.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:19 smithi172 ceph-mon[33377]: pgmap v4617: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 417 KiB/s wr, 25 op/s 2024-05-08T09:11:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:19 smithi194 ceph-mon[33679]: pgmap v4617: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 417 KiB/s wr, 25 op/s 2024-05-08T09:11:21.190 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/ufs/built-in.a 2024-05-08T09:11:21.357 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/thermal/thermal_sysfs.o 2024-05-08T09:11:21.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:21 smithi070 ceph-mon[29591]: pgmap v4618: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 722 KiB/s wr, 35 op/s 2024-05-08T09:11:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:21 smithi172 ceph-mon[33377]: pgmap v4618: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 722 KiB/s wr, 35 op/s 2024-05-08T09:11:21.968 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpufreq/freq_table.o 2024-05-08T09:11:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:21 smithi194 ceph-mon[33679]: pgmap v4618: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 722 KiB/s wr, 35 op/s 2024-05-08T09:11:22.104 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/cpuidle/governors/built-in.a 2024-05-08T09:11:22.378 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpufreq/cpufreq_performance.o 2024-05-08T09:11:23.121 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/md-autodetect.o 2024-05-08T09:11:23.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:23 smithi070 ceph-mon[29591]: pgmap v4619: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 716 KiB/s wr, 34 op/s 2024-05-08T09:11:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:23 smithi172 ceph-mon[33377]: pgmap v4619: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 716 KiB/s wr, 34 op/s 2024-05-08T09:11:24.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:23 smithi194 ceph-mon[33679]: pgmap v4619: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 716 KiB/s wr, 34 op/s 2024-05-08T09:11:25.047 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_wopcm.o 2024-05-08T09:11:25.312 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_workarounds.o 2024-05-08T09:11:25.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:25 smithi070 ceph-mon[29591]: pgmap v4620: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 754 KiB/s wr, 33 op/s 2024-05-08T09:11:25.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:25 smithi172 ceph-mon[33377]: pgmap v4620: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 754 KiB/s wr, 33 op/s 2024-05-08T09:11:26.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:25 smithi194 ceph-mon[33679]: pgmap v4620: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 754 KiB/s wr, 33 op/s 2024-05-08T09:11:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:27 smithi070 ceph-mon[29591]: pgmap v4621: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 738 KiB/s wr, 33 op/s 2024-05-08T09:11:27.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:27 smithi172 ceph-mon[33377]: pgmap v4621: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 738 KiB/s wr, 33 op/s 2024-05-08T09:11:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:27 smithi194 ceph-mon[33679]: pgmap v4621: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 738 KiB/s wr, 33 op/s 2024-05-08T09:11:28.226 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpuidle/governor.o 2024-05-08T09:11:28.508 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/thermal/thermal_trip.o 2024-05-08T09:11:28.915 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/thermal/thermal_helpers.o 2024-05-08T09:11:29.209 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpufreq/cpufreq_userspace.o 2024-05-08T09:11:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:29 smithi070 ceph-mon[29591]: pgmap v4622: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 628 KiB/s wr, 28 op/s 2024-05-08T09:11:29.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:29 smithi172 ceph-mon[33377]: pgmap v4622: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 628 KiB/s wr, 28 op/s 2024-05-08T09:11:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:29 smithi194 ceph-mon[33679]: pgmap v4622: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 628 KiB/s wr, 28 op/s 2024-05-08T09:11:30.184 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpuidle/sysfs.o 2024-05-08T09:11:31.592 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm.o 2024-05-08T09:11:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:31 smithi070 ceph-mon[29591]: pgmap v4623: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 962 KiB/s wr, 47 op/s 2024-05-08T09:11:31.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:31 smithi172 ceph-mon[33377]: pgmap v4623: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 962 KiB/s wr, 47 op/s 2024-05-08T09:11:32.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:31 smithi194 ceph-mon[33679]: pgmap v4623: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 848 KiB/s rd, 962 KiB/s wr, 47 op/s 2024-05-08T09:11:33.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:33 smithi070 ceph-mon[29591]: pgmap v4624: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 644 KiB/s wr, 35 op/s 2024-05-08T09:11:33.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:33 smithi172 ceph-mon[33377]: pgmap v4624: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 644 KiB/s wr, 35 op/s 2024-05-08T09:11:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:33 smithi194 ceph-mon[33679]: pgmap v4624: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 644 KiB/s wr, 35 op/s 2024-05-08T09:11:34.781 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-table.o 2024-05-08T09:11:35.390 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpuidle/poll_state.o 2024-05-08T09:11:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:35 smithi070 ceph-mon[29591]: pgmap v4625: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 910 KiB/s wr, 47 op/s 2024-05-08T09:11:35.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:35 smithi172 ceph-mon[33377]: pgmap v4625: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 910 KiB/s wr, 47 op/s 2024-05-08T09:11:35.977 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpufreq/cpufreq_ondemand.o 2024-05-08T09:11:35.983 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/thermal/thermal_hwmon.o 2024-05-08T09:11:36.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:35 smithi194 ceph-mon[33679]: pgmap v4625: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 910 KiB/s wr, 47 op/s 2024-05-08T09:11:36.937 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpufreq/cpufreq_governor.o 2024-05-08T09:11:37.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:37 smithi070 ceph-mon[29591]: pgmap v4626: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 600 KiB/s wr, 31 op/s 2024-05-08T09:11:37.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:37 smithi172 ceph-mon[33377]: pgmap v4626: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 600 KiB/s wr, 31 op/s 2024-05-08T09:11:37.952 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/thermal/gov_step_wise.o 2024-05-08T09:11:38.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:37 smithi194 ceph-mon[33679]: pgmap v4626: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 600 KiB/s wr, 31 op/s 2024-05-08T09:11:39.412 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/shmem_utils.o 2024-05-08T09:11:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:39 smithi070 ceph-mon[29591]: pgmap v4627: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 600 KiB/s wr, 31 op/s 2024-05-08T09:11:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:39 smithi172 ceph-mon[33377]: pgmap v4627: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 600 KiB/s wr, 31 op/s 2024-05-08T09:11:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:39 smithi194 ceph-mon[33679]: pgmap v4627: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 600 KiB/s wr, 31 op/s 2024-05-08T09:11:40.457 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpuidle/cpuidle-haltpoll.o 2024-05-08T09:11:41.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:41 smithi070 ceph-mon[29591]: pgmap v4628: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 762 KiB/s wr, 48 op/s 2024-05-08T09:11:41.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:41 smithi172 ceph-mon[33377]: pgmap v4628: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 762 KiB/s wr, 48 op/s 2024-05-08T09:11:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:41 smithi194 ceph-mon[33679]: pgmap v4628: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 762 KiB/s wr, 48 op/s 2024-05-08T09:11:42.400 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/sysfs_engines.o 2024-05-08T09:11:43.346 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_ggtt_gmch.o 2024-05-08T09:11:43.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:43 smithi070 ceph-mon[29591]: pgmap v4629: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 428 KiB/s wr, 29 op/s 2024-05-08T09:11:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:43 smithi172 ceph-mon[33377]: pgmap v4629: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 428 KiB/s wr, 29 op/s 2024-05-08T09:11:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:43 smithi194 ceph-mon[33679]: pgmap v4629: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 428 KiB/s wr, 29 op/s 2024-05-08T09:11:44.505 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-target.o 2024-05-08T09:11:45.297 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpufreq/cpufreq_governor_attr_set.o 2024-05-08T09:11:45.359 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/thermal/gov_user_space.o 2024-05-08T09:11:45.409 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_prime.o 2024-05-08T09:11:45.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:45 smithi070 ceph-mon[29591]: pgmap v4630: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.0 MiB/s wr, 49 op/s 2024-05-08T09:11:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:45 smithi172 ceph-mon[33377]: pgmap v4630: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.0 MiB/s wr, 49 op/s 2024-05-08T09:11:46.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:45 smithi194 ceph-mon[33679]: pgmap v4630: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 972 KiB/s rd, 1.0 MiB/s wr, 49 op/s 2024-05-08T09:11:47.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:47 smithi070 ceph-mon[29591]: pgmap v4631: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 775 KiB/s wr, 36 op/s 2024-05-08T09:11:47.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:47 smithi172 ceph-mon[33377]: pgmap v4631: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 775 KiB/s wr, 36 op/s 2024-05-08T09:11:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:47 smithi194 ceph-mon[33679]: pgmap v4631: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 775 KiB/s wr, 36 op/s 2024-05-08T09:11:48.029 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/cpuidle/built-in.a 2024-05-08T09:11:48.665 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-linear.o 2024-05-08T09:11:49.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:49 smithi070 ceph-mon[29591]: pgmap v4632: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 775 KiB/s wr, 36 op/s 2024-05-08T09:11:49.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:49 smithi172 ceph-mon[33377]: pgmap v4632: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 775 KiB/s wr, 36 op/s 2024-05-08T09:11:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:49 smithi194 ceph-mon[33679]: pgmap v4632: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 775 KiB/s wr, 36 op/s 2024-05-08T09:11:50.201 INFO:tasks.quiescer.fs.[cephfs]:Total duration (56.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T09:11:50.201 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.3 2024-05-08T09:11:50.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:11:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:11:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:51 smithi070 ceph-mon[29591]: pgmap v4633: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 53 op/s 2024-05-08T09:11:51.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:51 smithi172 ceph-mon[33377]: pgmap v4633: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 53 op/s 2024-05-08T09:11:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:51 smithi194 ceph-mon[33679]: pgmap v4633: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 1.0 MiB/s wr, 53 op/s 2024-05-08T09:11:52.511 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/thermal/built-in.a 2024-05-08T09:11:53.001 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_print.o 2024-05-08T09:11:53.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:53 smithi070 ceph-mon[29591]: pgmap v4634: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 887 KiB/s wr, 36 op/s 2024-05-08T09:11:53.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:53 smithi172 ceph-mon[33377]: pgmap v4634: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 887 KiB/s wr, 36 op/s 2024-05-08T09:11:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:53 smithi194 ceph-mon[33679]: pgmap v4634: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 830 KiB/s rd, 887 KiB/s wr, 36 op/s 2024-05-08T09:11:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:55 smithi070 ceph-mon[29591]: pgmap v4635: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-05-08T09:11:55.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:55 smithi172 ceph-mon[33377]: pgmap v4635: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-05-08T09:11:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:55 smithi194 ceph-mon[33679]: pgmap v4635: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 55 op/s 2024-05-08T09:11:57.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:57 smithi172 ceph-mon[33377]: pgmap v4636: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 537 KiB/s wr, 35 op/s 2024-05-08T09:11:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:57 smithi194 ceph-mon[33679]: pgmap v4636: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 537 KiB/s wr, 35 op/s 2024-05-08T09:11:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:57 smithi070 ceph-mon[29591]: pgmap v4636: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 537 KiB/s wr, 35 op/s 2024-05-08T09:11:58.298 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpufreq/acpi-cpufreq.o 2024-05-08T09:11:58.905 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:58 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:11:58.911 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_property.o 2024-05-08T09:11:58.923 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/cpufreq/intel_pstate.o 2024-05-08T09:11:58.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:58 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:11:58.938 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-stripe.o 2024-05-08T09:11:59.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:58 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:11:59.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.276+0000 7fcda2800700 1 -- 172.21.15.70:0/2216499523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd9c0756d0 msgr2=0x7fcd9c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:11:59.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.276+0000 7fcda2800700 1 --2- 172.21.15.70:0/2216499523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd9c0756d0 0x7fcd9c075ab0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c009990 tx=0x7fcd8c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.276+0000 7fcda2800700 1 -- 172.21.15.70:0/2216499523 shutdown_connections 2024-05-08T09:11:59.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.276+0000 7fcda2800700 1 --2- 172.21.15.70:0/2216499523 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd9c10fea0 0x7fcd9c112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.276+0000 7fcda2800700 1 --2- 172.21.15.70:0/2216499523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd9c0756d0 0x7fcd9c075ab0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.276+0000 7fcda2800700 1 --2- 172.21.15.70:0/2216499523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd9c075ff0 0x7fcd9c10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.276+0000 7fcda2800700 1 -- 172.21.15.70:0/2216499523 >> 172.21.15.70:0/2216499523 conn(0x7fcd9c07a600 msgr2=0x7fcd9c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:11:59.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.276+0000 7fcda2800700 1 -- 172.21.15.70:0/2216499523 shutdown_connections 2024-05-08T09:11:59.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.277+0000 7fcda2800700 1 -- 172.21.15.70:0/2216499523 wait complete. 2024-05-08T09:11:59.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.279+0000 7fcda2800700 1 Processor -- start 2024-05-08T09:11:59.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.279+0000 7fcda2800700 1 -- start start 2024-05-08T09:11:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcda2800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd9c0756d0 0x7fcd9c1035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:11:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcda2800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd9c075ff0 0x7fcd9c103b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:11:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcda2800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd9c10fea0 0x7fcd9c104040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:11:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcda2800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c1157c0 con 0x7fcd9c075ff0 2024-05-08T09:11:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcda2800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c115640 con 0x7fcd9c0756d0 2024-05-08T09:11:59.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcda2800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9c115940 con 0x7fcd9c10fea0 2024-05-08T09:11:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcd9aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd9c075ff0 0x7fcd9c103b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:11:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcd9b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd9c0756d0 0x7fcd9c1035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:11:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcd9aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd9c075ff0 0x7fcd9c103b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51284/0 (socket says 172.21.15.70:51284) 2024-05-08T09:11:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcd9b400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd9c0756d0 0x7fcd9c1035c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:40138/0 (socket says 172.21.15.70:40138) 2024-05-08T09:11:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcd9aa00700 1 -- 172.21.15.70:0/2002131671 learned_addr learned my addr 172.21.15.70:0/2002131671 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:11:59.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.280+0000 7fcd9be00700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd9c10fea0 0x7fcd9c104040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:11:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.281+0000 7fcd9b400700 1 -- 172.21.15.70:0/2002131671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd9c10fea0 msgr2=0x7fcd9c104040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:11:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.281+0000 7fcd9b400700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd9c10fea0 0x7fcd9c104040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.281+0000 7fcd9b400700 1 -- 172.21.15.70:0/2002131671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd9c075ff0 msgr2=0x7fcd9c103b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:11:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.281+0000 7fcd9b400700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd9c075ff0 0x7fcd9c103b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.281+0000 7fcd9b400700 1 -- 172.21.15.70:0/2002131671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd9c1ac400 con 0x7fcd9c0756d0 2024-05-08T09:11:59.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.282+0000 7fcd9b400700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd9c0756d0 0x7fcd9c1035c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0098e0 tx=0x7fcd8c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:11:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.283+0000 7fcd93e00700 1 -- 172.21.15.70:0/2002131671 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c027070 con 0x7fcd9c0756d0 2024-05-08T09:11:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.283+0000 7fcd93e00700 1 -- 172.21.15.70:0/2002131671 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd8c00fb00 con 0x7fcd9c0756d0 2024-05-08T09:11:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.283+0000 7fcd93e00700 1 -- 172.21.15.70:0/2002131671 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c022a20 con 0x7fcd9c0756d0 2024-05-08T09:11:59.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.283+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd9c1ac690 con 0x7fcd9c0756d0 2024-05-08T09:11:59.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.283+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd9c1aca90 con 0x7fcd9c0756d0 2024-05-08T09:11:59.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.285+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd9c076dc0 con 0x7fcd9c0756d0 2024-05-08T09:11:59.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.289+0000 7fcd93e00700 1 -- 172.21.15.70:0/2002131671 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fcd8c02a070 con 0x7fcd9c0756d0 2024-05-08T09:11:59.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.292+0000 7fcd93e00700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd800b2a70 0x7fcd800b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:11:59.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.293+0000 7fcd93e00700 1 -- 172.21.15.70:0/2002131671 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(366..366 src has 1..366) ==== 9583+0+0 (secure 0 0 0) 0x7fcd8c0e3700 con 0x7fcd9c0756d0 2024-05-08T09:11:59.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.293+0000 7fcd9aa00700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd800b2a70 0x7fcd800b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:11:59.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.294+0000 7fcd9aa00700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd800b2a70 0x7fcd800b4f30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c104d80 tx=0x7fcd8800b480 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:11:59.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.308+0000 7fcd93e00700 1 -- 172.21.15.70:0/2002131671 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcd8c05fdf0 con 0x7fcd9c0756d0 2024-05-08T09:11:59.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.774+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcd9c02e510 con 0x7fcd9c0756d0 2024-05-08T09:11:59.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.775+0000 7fcd93e00700 1 -- 172.21.15.70:0/2002131671 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fcd8c013070 con 0x7fcd9c0756d0 2024-05-08T09:11:59.776 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:11:59.776 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:11:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd800b2a70 msgr2=0x7fcd800b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:11:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd800b2a70 0x7fcd800b4f30 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c104d80 tx=0x7fcd8800b480 comp rx=0 tx=0).stop 2024-05-08T09:11:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd9c0756d0 msgr2=0x7fcd9c1035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:11:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd9c0756d0 0x7fcd9c1035c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0098e0 tx=0x7fcd8c0057c0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 shutdown_connections 2024-05-08T09:11:59.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcd800b2a70 0x7fcd800b4f30 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd9c10fea0 0x7fcd9c104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcd9c0756d0 0x7fcd9c1035c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 --2- 172.21.15.70:0/2002131671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcd9c075ff0 0x7fcd9c103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:11:59.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 >> 172.21.15.70:0/2002131671 conn(0x7fcd9c07a600 msgr2=0x7fcd9c100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:11:59.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 shutdown_connections 2024-05-08T09:11:59.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:11:59.779+0000 7fcda2800700 1 -- 172.21.15.70:0/2002131671 wait complete. 2024-05-08T09:11:59.781 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:11:59.886 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen6_renderstate.o 2024-05-08T09:11:59.902 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen7_renderstate.o 2024-05-08T09:11:59.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:59 smithi172 ceph-mon[33377]: pgmap v4637: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 537 KiB/s wr, 35 op/s 2024-05-08T09:11:59.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:11:59.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:11:59.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:11:59 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:12:00.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:59 smithi194 ceph-mon[33679]: pgmap v4637: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 537 KiB/s wr, 35 op/s 2024-05-08T09:12:00.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:12:00.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:12:00.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:11:59 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:12:00.053 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/leds/trigger/built-in.a 2024-05-08T09:12:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:59 smithi070 ceph-mon[29591]: pgmap v4637: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 537 KiB/s wr, 35 op/s 2024-05-08T09:12:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:12:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:12:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:11:59 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:12:00.567 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 88.3 --await-for 42.0' 2024-05-08T09:12:00.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 88.3 --await-for 42.0 2024-05-08T09:12:00.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:00 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2002131671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:12:00.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:00 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2002131671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:12:01.002 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:12:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:00 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2002131671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:12:01.222 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/leds/blink/built-in.a 2024-05-08T09:12:01.431 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/leds/simple/built-in.a 2024-05-08T09:12:01.550 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/leds/led-core.o 2024-05-08T09:12:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:01 smithi070 ceph-mon[29591]: pgmap v4638: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 776 KiB/s wr, 52 op/s 2024-05-08T09:12:01.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:01 smithi172 ceph-mon[33377]: pgmap v4638: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 776 KiB/s wr, 52 op/s 2024-05-08T09:12:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:01 smithi194 ceph-mon[33679]: pgmap v4638: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 776 KiB/s wr, 52 op/s 2024-05-08T09:12:03.591 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen8_renderstate.o 2024-05-08T09:12:04.161 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:03 smithi070 ceph-mon[29591]: pgmap v4639: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 502 KiB/s wr, 36 op/s 2024-05-08T09:12:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:03 smithi172 ceph-mon[33377]: pgmap v4639: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 502 KiB/s wr, 36 op/s 2024-05-08T09:12:04.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:03 smithi194 ceph-mon[33679]: pgmap v4639: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 502 KiB/s wr, 36 op/s 2024-05-08T09:12:05.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:04 smithi070 ceph-mon[29591]: pgmap v4640: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 866 KiB/s wr, 63 op/s 2024-05-08T09:12:05.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:04 smithi172 ceph-mon[33377]: pgmap v4640: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 866 KiB/s wr, 63 op/s 2024-05-08T09:12:05.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:04 smithi194 ceph-mon[33679]: pgmap v4640: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 755 KiB/s rd, 866 KiB/s wr, 63 op/s 2024-05-08T09:12:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.759+0000 7fd734800700 1 -- 172.21.15.70:0/2627407750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10dc40 msgr2=0x7fd72c10a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:12:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.759+0000 7fd734800700 1 --2- 172.21.15.70:0/2627407750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10dc40 0x7fd72c10a4a0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b0a0 tx=0x7fd72800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.760+0000 7fd734800700 1 -- 172.21.15.70:0/2627407750 shutdown_connections 2024-05-08T09:12:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.760+0000 7fd734800700 1 --2- 172.21.15.70:0/2627407750 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72c1185d0 0x7fd72c11a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.760+0000 7fd734800700 1 --2- 172.21.15.70:0/2627407750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10dc40 0x7fd72c10a4a0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.760+0000 7fd734800700 1 --2- 172.21.15.70:0/2627407750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd72c10aa70 0x7fd72c10aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.760+0000 7fd734800700 1 -- 172.21.15.70:0/2627407750 >> 172.21.15.70:0/2627407750 conn(0x7fd72c06ea90 msgr2=0x7fd72c06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:12:06.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.760+0000 7fd734800700 1 -- 172.21.15.70:0/2627407750 shutdown_connections 2024-05-08T09:12:06.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.760+0000 7fd734800700 1 -- 172.21.15.70:0/2627407750 wait complete. 2024-05-08T09:12:06.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.762+0000 7fd734800700 1 Processor -- start 2024-05-08T09:12:06.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.762+0000 7fd734800700 1 -- start start 2024-05-08T09:12:06.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd734800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10aa70 0x7fd72c1115d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd734800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72c10dc40 0x7fd72c111b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd734800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd72c1185d0 0x7fd72c1aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd734800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c11dfc0 con 0x7fd72c10aa70 2024-05-08T09:12:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd734800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c11de40 con 0x7fd72c10dc40 2024-05-08T09:12:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd734800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c11e140 con 0x7fd72c1185d0 2024-05-08T09:12:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd731e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10aa70 0x7fd72c1115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd731400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72c10dc40 0x7fd72c111b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd731400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72c10dc40 0x7fd72c111b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:40166/0 (socket says 172.21.15.70:40166) 2024-05-08T09:12:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.763+0000 7fd731400700 1 -- 172.21.15.70:0/353945624 learned_addr learned my addr 172.21.15.70:0/353945624 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:12:06.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.764+0000 7fd732800700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd72c1185d0 0x7fd72c1aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.764+0000 7fd731400700 1 -- 172.21.15.70:0/353945624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd72c1185d0 msgr2=0x7fd72c1aa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:12:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.764+0000 7fd731400700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd72c1185d0 0x7fd72c1aa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.764+0000 7fd731400700 1 -- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10aa70 msgr2=0x7fd72c1115d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:12:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.764+0000 7fd731400700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10aa70 0x7fd72c1115d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.764+0000 7fd731400700 1 -- 172.21.15.70:0/353945624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c1aac90 con 0x7fd72c10dc40 2024-05-08T09:12:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.764+0000 7fd732800700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd72c1185d0 0x7fd72c1aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:12:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.764+0000 7fd731e00700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10aa70 0x7fd72c1115d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:12:06.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.765+0000 7fd731400700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72c10dc40 0x7fd72c111b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00d980 tx=0x7fd71c00dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:12:06.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.766+0000 7fd726a00700 1 -- 172.21.15.70:0/353945624 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c017030 con 0x7fd72c10dc40 2024-05-08T09:12:06.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.766+0000 7fd726a00700 1 -- 172.21.15.70:0/353945624 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd71c0044b0 con 0x7fd72c10dc40 2024-05-08T09:12:06.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.766+0000 7fd726a00700 1 -- 172.21.15.70:0/353945624 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c003970 con 0x7fd72c10dc40 2024-05-08T09:12:06.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.766+0000 7fd734800700 1 -- 172.21.15.70:0/353945624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72c1aaf80 con 0x7fd72c10dc40 2024-05-08T09:12:06.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.766+0000 7fd734800700 1 -- 172.21.15.70:0/353945624 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72c1174c0 con 0x7fd72c10dc40 2024-05-08T09:12:06.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.773+0000 7fd726a00700 1 -- 172.21.15.70:0/353945624 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd71c01a070 con 0x7fd72c10dc40 2024-05-08T09:12:06.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.775+0000 7fd726a00700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7140b2b20 0x7fd7140b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.776+0000 7fd726a00700 1 -- 172.21.15.70:0/353945624 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(367..367 src has 1..367) ==== 9671+0+0 (secure 0 0 0) 0x7fd71c0e2440 con 0x7fd72c10dc40 2024-05-08T09:12:06.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.776+0000 7fd731e00700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7140b2b20 0x7fd7140b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.777+0000 7fd731e00700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7140b2b20 0x7fd7140b4fe0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd728009e60 tx=0x7fd72800b720 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:12:06.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.786+0000 7fd73f23bb80 1 Processor -- start 2024-05-08T09:12:06.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.787+0000 7fd73f23bb80 1 -- start start 2024-05-08T09:12:06.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.787+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1e7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.787+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e1810 0x55a1bb1e1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.787+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1ee000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.787+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1bb133bb0 con 0x55a1bb1e21d0 2024-05-08T09:12:06.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.787+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a1bb0d18f0 con 0x55a1bb1e7240 2024-05-08T09:12:06.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.787+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a1bb12fb70 con 0x55a1bb1e1810 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.788+0000 7fd732800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.788+0000 7fd731e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1e7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.788+0000 7fd732800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1ee000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51320/0 (socket says 172.21.15.70:51320) 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.788+0000 7fd732800700 1 -- 172.21.15.70:0/3899401259 learned_addr learned my addr 172.21.15.70:0/3899401259 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.788+0000 7fd731400700 1 --2- 172.21.15.70:0/3899401259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e1810 0x55a1bb1e1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.789+0000 7fd731e00700 1 -- 172.21.15.70:0/3899401259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e1810 msgr2=0x55a1bb1e1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.789+0000 7fd731e00700 1 --2- 172.21.15.70:0/3899401259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e1810 0x55a1bb1e1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.789+0000 7fd731e00700 1 -- 172.21.15.70:0/3899401259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 msgr2=0x55a1bb1ee000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.789+0000 7fd731e00700 1 --2- 172.21.15.70:0/3899401259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1ee000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.789+0000 7fd731e00700 1 -- 172.21.15.70:0/3899401259 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1bb080a60 con 0x55a1bb1e7240 2024-05-08T09:12:06.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.789+0000 7fd732800700 1 --2- 172.21.15.70:0/3899401259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1ee000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:12:06.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.789+0000 7fd731e00700 1 --2- 172.21.15.70:0/3899401259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1e7620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd728009fd0 tx=0x7fd72801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d85d11742d3ec1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:12:06.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.790+0000 7fd71b400700 1 -- 172.21.15.70:0/3899401259 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd728004d30 con 0x55a1bb1e7240 2024-05-08T09:12:06.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.790+0000 7fd71b400700 1 -- 172.21.15.70:0/3899401259 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd72802e070 con 0x55a1bb1e7240 2024-05-08T09:12:06.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.790+0000 7fd71b400700 1 -- 172.21.15.70:0/3899401259 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72801cb60 con 0x55a1bb1e7240 2024-05-08T09:12:06.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.791+0000 7fd73f23bb80 1 -- 172.21.15.70:0/3899401259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 msgr2=0x55a1bb1e7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:12:06.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.791+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/3899401259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1e7620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd728009fd0 tx=0x7fd72801c000 comp rx=0 tx=0).stop 2024-05-08T09:12:06.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.791+0000 7fd73f23bb80 1 -- 172.21.15.70:0/3899401259 shutdown_connections 2024-05-08T09:12:06.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.791+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/3899401259 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1ee000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.791+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/3899401259 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1e7620 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.791+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/3899401259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e1810 0x55a1bb1e1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.791+0000 7fd73f23bb80 1 -- 172.21.15.70:0/3899401259 >> 172.21.15.70:0/3899401259 conn(0x55a1bb159860 msgr2=0x55a1bb1dc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:12:06.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.791+0000 7fd73f23bb80 1 -- 172.21.15.70:0/3899401259 shutdown_connections 2024-05-08T09:12:06.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.791+0000 7fd73f23bb80 1 -- 172.21.15.70:0/3899401259 wait complete. 2024-05-08T09:12:06.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.792+0000 7fd73f23bb80 1 -- start start 2024-05-08T09:12:06.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.793+0000 7fd73f23bb80 1 Processor -- start 2024-05-08T09:12:06.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.793+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e1810 0x55a1bb1edc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.793+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1eafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.793+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 0x55a1bb1eb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.793+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1bb1ee540 con 0x55a1bb1e21d0 2024-05-08T09:12:06.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.793+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a1bb099cb0 con 0x55a1bb1e1810 2024-05-08T09:12:06.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.793+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a1bb1ee6c0 con 0x55a1bb1e7240 2024-05-08T09:12:06.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.793+0000 7fd73f23bb80 10 client.0 _ll_register_callbacks cb 0x55a1bb0dae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:12:06.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd731400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1eafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd731400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1eafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51332/0 (socket says 172.21.15.70:51332) 2024-05-08T09:12:06.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd731400700 1 -- 172.21.15.70:0/1266143271 learned_addr learned my addr 172.21.15.70:0/1266143271 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:12:06.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd731e00700 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e1810 0x55a1bb1edc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd732800700 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 0x55a1bb1eb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd731400700 1 -- 172.21.15.70:0/1266143271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 msgr2=0x55a1bb1eb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:12:06.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd731400700 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 0x55a1bb1eb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd731400700 1 -- 172.21.15.70:0/1266143271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e1810 msgr2=0x55a1bb1edc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:12:06.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd731400700 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e1810 0x55a1bb1edc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.794+0000 7fd731400700 1 -- 172.21.15.70:0/1266143271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1bb0f95b0 con 0x55a1bb1e21d0 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.795+0000 7fd731400700 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1eafb0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0df770 tx=0x7fd71c0a8e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf91d94fa267d80 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.795+0000 7fd70fe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.795+0000 7fd70fe00700 1 -- 172.21.15.70:0/1266143271 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0c3060 con 0x55a1bb1e21d0 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.795+0000 7fd70fe00700 1 -- 172.21.15.70:0/1266143271 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(367..367 src has 1..367) ==== 9671+0+0 (secure 0 0 0) 0x7fd71c0a9500 con 0x55a1bb1e21d0 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.795+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1266143271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd72802e070 con 0x55a1bb1e21d0 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.796+0000 7fd70fe00700 1 -- 172.21.15.70:0/1266143271 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fd71c0c8050 con 0x55a1bb1e21d0 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.796+0000 7fd73f23bb80 10 client.19200 fetch_fsmap learned FSMap version 42 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.796+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1266143271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a1bb1f8d40 con 0x55a1bb1e21d0 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.796+0000 7fd70fe00700 1 -- 172.21.15.70:0/1266143271 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd72802e070 con 0x55a1bb1e21d0 2024-05-08T09:12:06.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.797+0000 7fd70fe00700 1 -- 172.21.15.70:0/1266143271 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fd71c024060 con 0x55a1bb1e21d0 2024-05-08T09:12:06.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.798+0000 7fd73f23bb80 10 client.19200 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:12:06.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.798+0000 7fd73f23bb80 10 client.19200 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:12:06.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.798+0000 7fd73f23bb80 20 client.19200 populate_metadata read hostname 'smithi070' 2024-05-08T09:12:06.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.798+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1bb1fb380 0x55a1bb1fd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.798+0000 7fd73f23bb80 4 client.19200 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:12:06.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.798+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1266143271 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1bb1ae2d0 con 0x55a1bb1fb380 2024-05-08T09:12:06.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.799+0000 7fd731e00700 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1bb1fb380 0x55a1bb1fd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.800+0000 7fd731e00700 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1bb1fb380 0x55a1bb1fd770 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db29d995c47418a8 server_cookie=3b81425c58548ce in_seq=0 out_seq=0 2024-05-08T09:12:06.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.800+0000 7fd70fe00700 10 client.19200 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:12:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.802+0000 7fd70fe00700 1 -- 172.21.15.70:0/1266143271 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a1bb1ae2d0 con 0x55a1bb1fb380 2024-05-08T09:12:06.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.802+0000 7fd70fe00700 10 client.19200 handle_command_reply: tid=0 2024-05-08T09:12:06.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.802+0000 7fd73f23bb80 1 client.19200 shutdown 2024-05-08T09:12:06.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.803+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1266143271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 msgr2=0x55a1bb1eafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:12:06.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.803+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1eafb0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fd71c0df770 tx=0x7fd71c0a8e20 comp rx=0 tx=0).stop 2024-05-08T09:12:06.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.803+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1266143271 shutdown_connections 2024-05-08T09:12:06.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.803+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1bb1fb380 0x55a1bb1fd770 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.803+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 0x55a1bb1eb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.803+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e1810 0x55a1bb1edc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.803+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1266143271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e21d0 0x55a1bb1eafb0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.803+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1266143271 >> 172.21.15.70:0/1266143271 conn(0x55a1bb159860 msgr2=0x55a1bb1d6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:12:06.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.803+0000 7fd70fe00700 0 client.19200 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:12:06.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.804+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1266143271 shutdown_connections 2024-05-08T09:12:06.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.804+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1266143271 wait complete. 2024-05-08T09:12:06.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.804+0000 7fd73f23bb80 20 client.19200 trim_cache size 0 max 16384 2024-05-08T09:12:06.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.841+0000 7fd73f23bb80 1 Processor -- start 2024-05-08T09:12:06.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.842+0000 7fd73f23bb80 1 -- start start 2024-05-08T09:12:06.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.842+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.842+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 0x55a1bb1e9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.842+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb202fa0 0x55a1bb203420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.842+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1c96e0 con 0x55a1bb1e1810 2024-05-08T09:12:06.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.842+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1c6f70 con 0x55a1bb202fa0 2024-05-08T09:12:06.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.842+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1c4de0 con 0x55a1bb1e7240 2024-05-08T09:12:06.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.843+0000 7fd732800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb202fa0 0x55a1bb203420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.843+0000 7fd731e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.843+0000 7fd731e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51340/0 (socket says 172.21.15.70:51340) 2024-05-08T09:12:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.843+0000 7fd731e00700 1 -- 172.21.15.70:0/1921887141 learned_addr learned my addr 172.21.15.70:0/1921887141 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:12:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.843+0000 7fd731400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 0x55a1bb1e9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.844+0000 7fd732800700 1 -- 172.21.15.70:0/1921887141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 msgr2=0x55a1bb1e9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:12:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.844+0000 7fd732800700 1 --2- 172.21.15.70:0/1921887141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 0x55a1bb1e9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.844+0000 7fd732800700 1 -- 172.21.15.70:0/1921887141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 msgr2=0x55a1bb1f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:12:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.844+0000 7fd732800700 1 --2- 172.21.15.70:0/1921887141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.844+0000 7fd732800700 1 -- 172.21.15.70:0/1921887141 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1bb1e6e80 con 0x55a1bb202fa0 2024-05-08T09:12:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.844+0000 7fd732800700 1 --2- 172.21.15.70:0/1921887141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb202fa0 0x55a1bb203420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd720009bd0 tx=0x7fd720009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=450bd4e2835cbe65 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:12:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.845+0000 7fd71aa00700 1 -- 172.21.15.70:0/1921887141 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72001f020 con 0x55a1bb202fa0 2024-05-08T09:12:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.845+0000 7fd71aa00700 1 -- 172.21.15.70:0/1921887141 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd720004830 con 0x55a1bb202fa0 2024-05-08T09:12:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.845+0000 7fd71aa00700 1 -- 172.21.15.70:0/1921887141 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720005300 con 0x55a1bb202fa0 2024-05-08T09:12:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.846+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1921887141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb202fa0 msgr2=0x55a1bb203420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:12:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.846+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1921887141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb202fa0 0x55a1bb203420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd720009bd0 tx=0x7fd720009ee0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.846+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1921887141 shutdown_connections 2024-05-08T09:12:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.846+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1921887141 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb202fa0 0x55a1bb203420 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.846+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1921887141 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.846+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/1921887141 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb1e7240 0x55a1bb1e9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.846+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1921887141 >> 172.21.15.70:0/1921887141 conn(0x55a1bb159860 msgr2=0x55a1bb1e1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:12:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.846+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1921887141 shutdown_connections 2024-05-08T09:12:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.847+0000 7fd73f23bb80 1 -- 172.21.15.70:0/1921887141 wait complete. 2024-05-08T09:12:06.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.847+0000 7fd73f23bb80 1 -- start start 2024-05-08T09:12:06.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.848+0000 7fd73f23bb80 1 Processor -- start 2024-05-08T09:12:06.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.849+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.849+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.849+0000 7fd73f23bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb202fa0 0x55a1bb1f1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.849+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1c5430 con 0x55a1bb1e1810 2024-05-08T09:12:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.849+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1c68a0 con 0x55a1bb1e7240 2024-05-08T09:12:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.849+0000 7fd73f23bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c1c5b00 con 0x55a1bb202fa0 2024-05-08T09:12:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.850+0000 7fd73f23bb80 10 client.0 _ll_register_callbacks cb 0x55a1bb0dae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:12:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.850+0000 7fd732800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb202fa0 0x55a1bb1f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.850+0000 7fd731400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.850+0000 7fd731400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1f0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:40194/0 (socket says 172.21.15.70:40194) 2024-05-08T09:12:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.850+0000 7fd731400700 1 -- 172.21.15.70:0/2145704420 learned_addr learned my addr 172.21.15.70:0/2145704420 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:12:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.850+0000 7fd732800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb202fa0 0x55a1bb1f1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:43628/0 (socket says 172.21.15.70:43628) 2024-05-08T09:12:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.850+0000 7fd731e00700 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.851+0000 7fd732800700 1 -- 172.21.15.70:0/2145704420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 msgr2=0x55a1bb1f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:12:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.851+0000 7fd732800700 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.851+0000 7fd732800700 1 -- 172.21.15.70:0/2145704420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 msgr2=0x55a1bb1f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:12:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.851+0000 7fd732800700 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.851+0000 7fd732800700 1 -- 172.21.15.70:0/2145704420 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1bb1f1980 con 0x55a1bb202fa0 2024-05-08T09:12:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.851+0000 7fd731e00700 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:12:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.851+0000 7fd732800700 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb202fa0 0x55a1bb1f1440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd720000c00 tx=0x7fd720012a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e7f42cccff98d60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:12:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.852+0000 7fd70fe00700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T09:12:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.852+0000 7fd70fe00700 1 -- 172.21.15.70:0/2145704420 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720029020 con 0x55a1bb202fa0 2024-05-08T09:12:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.852+0000 7fd73f23bb80 1 -- 172.21.15.70:0/2145704420 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd720004830 con 0x55a1bb202fa0 2024-05-08T09:12:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.852+0000 7fd70fe00700 1 -- 172.21.15.70:0/2145704420 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(367..367 src has 1..367) ==== 9671+0+0 (secure 0 0 0) 0x7fd720005200 con 0x55a1bb202fa0 2024-05-08T09:12:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.853+0000 7fd70fe00700 1 -- 172.21.15.70:0/2145704420 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fd72001f040 con 0x55a1bb202fa0 2024-05-08T09:12:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.853+0000 7fd73f23bb80 10 client.27913 fetch_fsmap learned FSMap version 42 2024-05-08T09:12:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.853+0000 7fd73f23bb80 1 -- 172.21.15.70:0/2145704420 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a1bb267860 con 0x55a1bb202fa0 2024-05-08T09:12:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.853+0000 7fd70fe00700 1 -- 172.21.15.70:0/2145704420 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd720004830 con 0x55a1bb202fa0 2024-05-08T09:12:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.854+0000 7fd70fe00700 1 -- 172.21.15.70:0/2145704420 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fd72001a070 con 0x55a1bb202fa0 2024-05-08T09:12:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.854+0000 7fd73f23bb80 10 client.27913 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:12:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.854+0000 7fd73f23bb80 10 client.27913 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:12:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.854+0000 7fd73f23bb80 20 client.27913 populate_metadata read hostname 'smithi070' 2024-05-08T09:12:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.854+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1bb267fe0 0x55a1bb26a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:12:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.854+0000 7fd73f23bb80 4 client.27913 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.3, "await_for": 42.0}] 2024-05-08T09:12:06.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.854+0000 7fd73f23bb80 1 -- 172.21.15.70:0/2145704420 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.3, "await_for": 42.0}) -- 0x55a1bb141590 con 0x55a1bb267fe0 2024-05-08T09:12:06.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.855+0000 7fd731e00700 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1bb267fe0 0x55a1bb26a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:12:06.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.856+0000 7fd70fe00700 10 client.27913 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:12:06.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:06.856+0000 7fd731e00700 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1bb267fe0 0x55a1bb26a3d0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3814795fb007f293 server_cookie=fe8c017d393f7e04 in_seq=0 out_seq=0 2024-05-08T09:12:07.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:06 smithi070 ceph-mon[29591]: osdmap e367: 12 total, 12 up, 12 in 2024-05-08T09:12:07.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:06 smithi070 ceph-mon[29591]: pgmap v4642: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 723 KiB/s wr, 53 op/s 2024-05-08T09:12:07.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:06 smithi172 ceph-mon[33377]: osdmap e367: 12 total, 12 up, 12 in 2024-05-08T09:12:07.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:06 smithi172 ceph-mon[33377]: pgmap v4642: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 723 KiB/s wr, 53 op/s 2024-05-08T09:12:07.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:06 smithi194 ceph-mon[33679]: osdmap e367: 12 total, 12 up, 12 in 2024-05-08T09:12:07.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:06 smithi194 ceph-mon[33679]: pgmap v4642: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 723 KiB/s wr, 53 op/s 2024-05-08T09:12:08.155 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_syncobj.o 2024-05-08T09:12:08.187 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/gen9_renderstate.o 2024-05-08T09:12:08.557 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_busy.o 2024-05-08T09:12:09.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:09 smithi070 ceph-mon[29591]: pgmap v4643: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 723 KiB/s wr, 53 op/s 2024-05-08T09:12:09.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:09 smithi172 ceph-mon[33377]: pgmap v4643: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 723 KiB/s wr, 53 op/s 2024-05-08T09:12:09.966 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:09 smithi194 ceph-mon[33679]: pgmap v4643: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 626 KiB/s rd, 723 KiB/s wr, 53 op/s 2024-05-08T09:12:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:11 smithi070 ceph-mon[29591]: pgmap v4644: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 623 KiB/s wr, 50 op/s 2024-05-08T09:12:11.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:11 smithi070 ceph-mon[29591]: osdmap e368: 12 total, 12 up, 12 in 2024-05-08T09:12:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:11 smithi172 ceph-mon[33377]: pgmap v4644: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 623 KiB/s wr, 50 op/s 2024-05-08T09:12:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:11 smithi172 ceph-mon[33377]: osdmap e368: 12 total, 12 up, 12 in 2024-05-08T09:12:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:11 smithi194 ceph-mon[33679]: pgmap v4644: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 623 KiB/s wr, 50 op/s 2024-05-08T09:12:12.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:11 smithi194 ceph-mon[33679]: osdmap e368: 12 total, 12 up, 12 in 2024-05-08T09:12:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:13 smithi070 ceph-mon[29591]: pgmap v4646: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 234 KiB/s wr, 22 op/s 2024-05-08T09:12:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:13 smithi172 ceph-mon[33377]: pgmap v4646: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 234 KiB/s wr, 22 op/s 2024-05-08T09:12:14.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:13 smithi194 ceph-mon[33679]: pgmap v4646: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 234 KiB/s wr, 22 op/s 2024-05-08T09:12:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:15 smithi070 ceph-mon[29591]: pgmap v4647: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 513 KiB/s wr, 26 op/s 2024-05-08T09:12:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:15 smithi172 ceph-mon[33377]: pgmap v4647: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 513 KiB/s wr, 26 op/s 2024-05-08T09:12:16.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:15 smithi194 ceph-mon[33679]: pgmap v4647: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 513 KiB/s wr, 26 op/s 2024-05-08T09:12:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:17 smithi070 ceph-mon[29591]: pgmap v4648: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 440 KiB/s wr, 22 op/s 2024-05-08T09:12:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:17 smithi172 ceph-mon[33377]: pgmap v4648: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 440 KiB/s wr, 22 op/s 2024-05-08T09:12:18.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:17 smithi194 ceph-mon[33679]: pgmap v4648: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 440 KiB/s wr, 22 op/s 2024-05-08T09:12:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:19 smithi070 ceph-mon[29591]: pgmap v4649: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 440 KiB/s wr, 22 op/s 2024-05-08T09:12:19.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:19 smithi172 ceph-mon[33377]: pgmap v4649: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 440 KiB/s wr, 22 op/s 2024-05-08T09:12:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:19 smithi194 ceph-mon[33679]: pgmap v4649: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 440 KiB/s wr, 22 op/s 2024-05-08T09:12:21.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:21 smithi070 ceph-mon[29591]: pgmap v4650: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 348 KiB/s wr, 12 op/s 2024-05-08T09:12:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:21 smithi172 ceph-mon[33377]: pgmap v4650: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 348 KiB/s wr, 12 op/s 2024-05-08T09:12:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:21 smithi194 ceph-mon[33679]: pgmap v4650: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 348 KiB/s wr, 12 op/s 2024-05-08T09:12:23.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:23 smithi070 ceph-mon[29591]: pgmap v4651: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 310 KiB/s wr, 10 op/s 2024-05-08T09:12:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:23 smithi172 ceph-mon[33377]: pgmap v4651: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 310 KiB/s wr, 10 op/s 2024-05-08T09:12:24.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:23 smithi194 ceph-mon[33679]: pgmap v4651: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 310 KiB/s wr, 10 op/s 2024-05-08T09:12:25.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:25 smithi070 ceph-mon[29591]: pgmap v4652: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 290 KiB/s wr, 13 op/s 2024-05-08T09:12:25.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:25 smithi172 ceph-mon[33377]: pgmap v4652: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 290 KiB/s wr, 13 op/s 2024-05-08T09:12:26.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:25 smithi194 ceph-mon[33679]: pgmap v4652: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 288 KiB/s rd, 290 KiB/s wr, 13 op/s 2024-05-08T09:12:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:27 smithi070 ceph-mon[29591]: pgmap v4653: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 79 KiB/s wr, 9 op/s 2024-05-08T09:12:27.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:27 smithi172 ceph-mon[33377]: pgmap v4653: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 79 KiB/s wr, 9 op/s 2024-05-08T09:12:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:27 smithi194 ceph-mon[33679]: pgmap v4653: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 79 KiB/s wr, 9 op/s 2024-05-08T09:12:29.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:29 smithi070 ceph-mon[29591]: pgmap v4654: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 79 KiB/s wr, 9 op/s 2024-05-08T09:12:29.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:29 smithi172 ceph-mon[33377]: pgmap v4654: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 79 KiB/s wr, 9 op/s 2024-05-08T09:12:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:29 smithi194 ceph-mon[33679]: pgmap v4654: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 79 KiB/s wr, 9 op/s 2024-05-08T09:12:31.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.772+0000 7fd70fe00700 1 -- 172.21.15.70:0/2145704420 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55a1bb141590 con 0x55a1bb267fe0 2024-05-08T09:12:31.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.772+0000 7fd70fe00700 10 client.27913 handle_command_reply: tid=0 2024-05-08T09:12:31.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.772+0000 7fd73f23bb80 1 client.27913 shutdown 2024-05-08T09:12:31.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd73f23bb80 1 -- 172.21.15.70:0/2145704420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb202fa0 msgr2=0x55a1bb1f1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:12:31.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb202fa0 0x55a1bb1f1440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd720000c00 tx=0x7fd720012a20 comp rx=0 tx=0).stop 2024-05-08T09:12:31.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd73f23bb80 1 -- 172.21.15.70:0/2145704420 shutdown_connections 2024-05-08T09:12:31.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a1bb267fe0 0x55a1bb26a3d0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:31.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a1bb202fa0 0x55a1bb1f1440 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:31.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a1bb1e1810 0x55a1bb1f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:31.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd73f23bb80 1 --2- 172.21.15.70:0/2145704420 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a1bb1e7240 0x55a1bb1f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:31.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd73f23bb80 1 -- 172.21.15.70:0/2145704420 >> 172.21.15.70:0/2145704420 conn(0x55a1bb159860 msgr2=0x55a1bb1e1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:12:31.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd70fe00700 0 client.27913 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:12:31.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.773+0000 7fd73f23bb80 1 -- 172.21.15.70:0/2145704420 shutdown_connections 2024-05-08T09:12:31.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.774+0000 7fd73f23bb80 1 -- 172.21.15.70:0/2145704420 wait complete. 2024-05-08T09:12:31.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.774+0000 7fd73f23bb80 20 client.27913 trim_cache size 0 max 16384 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 322, 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "a268aa16": { 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 322, 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:12:31.776 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.3, 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:12:31.777 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:12:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 -- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7140b2b20 msgr2=0x7fd7140b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:12:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7140b2b20 0x7fd7140b4fe0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd728009e60 tx=0x7fd72800b720 comp rx=0 tx=0).stop 2024-05-08T09:12:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 -- 172.21.15.70:0/353945624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72c10dc40 msgr2=0x7fd72c111b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:12:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72c10dc40 0x7fd72c111b10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd71c00d980 tx=0x7fd71c00dd40 comp rx=0 tx=0).stop 2024-05-08T09:12:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 -- 172.21.15.70:0/353945624 shutdown_connections 2024-05-08T09:12:31.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd7140b2b20 0x7fd7140b4fe0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd72c1185d0 0x7fd72c1aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd72c10aa70 0x7fd72c1115d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 --2- 172.21.15.70:0/353945624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd72c10dc40 0x7fd72c111b10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:12:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.776+0000 7fd734800700 1 -- 172.21.15.70:0/353945624 >> 172.21.15.70:0/353945624 conn(0x7fd72c06ea90 msgr2=0x7fd72c1189b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:12:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.777+0000 7fd734800700 1 -- 172.21.15.70:0/353945624 shutdown_connections 2024-05-08T09:12:31.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:12:31.777+0000 7fd734800700 1 -- 172.21.15.70:0/353945624 wait complete. 2024-05-08T09:12:31.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:31 smithi070 ceph-mon[29591]: pgmap v4655: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 151 KiB/s wr, 13 op/s 2024-05-08T09:12:31.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:31 smithi172 ceph-mon[33377]: pgmap v4655: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 151 KiB/s wr, 13 op/s 2024-05-08T09:12:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:31 smithi194 ceph-mon[33679]: pgmap v4655: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 151 KiB/s wr, 13 op/s 2024-05-08T09:12:32.755 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a268aa16', quiesce took 42.6 seconds. Will release after: 28.3 2024-05-08T09:12:33.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:33 smithi070 ceph-mon[29591]: pgmap v4656: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 72 KiB/s wr, 7 op/s 2024-05-08T09:12:33.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:33 smithi172 ceph-mon[33377]: pgmap v4656: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 72 KiB/s wr, 7 op/s 2024-05-08T09:12:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:33 smithi194 ceph-mon[33679]: pgmap v4656: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 72 KiB/s wr, 7 op/s 2024-05-08T09:12:35.923 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:35 smithi070 ceph-mon[29591]: pgmap v4657: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 11 op/s 2024-05-08T09:12:35.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:35 smithi172 ceph-mon[33377]: pgmap v4657: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 11 op/s 2024-05-08T09:12:36.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:35 smithi194 ceph-mon[33679]: pgmap v4657: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 73 KiB/s wr, 11 op/s 2024-05-08T09:12:37.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:37 smithi172 ceph-mon[33377]: pgmap v4658: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 8 op/s 2024-05-08T09:12:38.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:37 smithi194 ceph-mon[33679]: pgmap v4658: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 8 op/s 2024-05-08T09:12:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:37 smithi070 ceph-mon[29591]: pgmap v4658: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 8 op/s 2024-05-08T09:12:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:39 smithi172 ceph-mon[33377]: pgmap v4659: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 8 op/s 2024-05-08T09:12:40.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:39 smithi194 ceph-mon[33679]: pgmap v4659: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 8 op/s 2024-05-08T09:12:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:39 smithi070 ceph-mon[29591]: pgmap v4659: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 73 KiB/s wr, 8 op/s 2024-05-08T09:12:41.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:41 smithi172 ceph-mon[33377]: pgmap v4660: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 12 op/s 2024-05-08T09:12:42.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:41 smithi194 ceph-mon[33679]: pgmap v4660: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 12 op/s 2024-05-08T09:12:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:41 smithi070 ceph-mon[29591]: pgmap v4660: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 182 KiB/s wr, 12 op/s 2024-05-08T09:12:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:43 smithi172 ceph-mon[33377]: pgmap v4661: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 111 KiB/s wr, 9 op/s 2024-05-08T09:12:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:43 smithi194 ceph-mon[33679]: pgmap v4661: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 111 KiB/s wr, 9 op/s 2024-05-08T09:12:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:43 smithi070 ceph-mon[29591]: pgmap v4661: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 111 KiB/s wr, 9 op/s 2024-05-08T09:12:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:45 smithi172 ceph-mon[33377]: pgmap v4662: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 11 op/s 2024-05-08T09:12:46.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:45 smithi194 ceph-mon[33679]: pgmap v4662: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 11 op/s 2024-05-08T09:12:46.032 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:45 smithi070 ceph-mon[29591]: pgmap v4662: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 118 KiB/s wr, 11 op/s 2024-05-08T09:12:47.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:47 smithi172 ceph-mon[33377]: pgmap v4663: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 7 op/s 2024-05-08T09:12:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:47 smithi194 ceph-mon[33679]: pgmap v4663: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 7 op/s 2024-05-08T09:12:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:47 smithi070 ceph-mon[29591]: pgmap v4663: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 7 op/s 2024-05-08T09:12:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:49 smithi194 ceph-mon[33679]: pgmap v4664: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 7 op/s 2024-05-08T09:12:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:49 smithi070 ceph-mon[29591]: pgmap v4664: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 7 op/s 2024-05-08T09:12:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:49 smithi172 ceph-mon[33377]: pgmap v4664: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 7 op/s 2024-05-08T09:12:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:51 smithi194 ceph-mon[33679]: pgmap v4665: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 10 op/s 2024-05-08T09:12:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:51 smithi070 ceph-mon[29591]: pgmap v4665: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 10 op/s 2024-05-08T09:12:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:51 smithi172 ceph-mon[33377]: pgmap v4665: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 173 KiB/s wr, 10 op/s 2024-05-08T09:12:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:53 smithi194 ceph-mon[33679]: pgmap v4666: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 5 op/s 2024-05-08T09:12:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:53 smithi070 ceph-mon[29591]: pgmap v4666: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 5 op/s 2024-05-08T09:12:54.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:53 smithi172 ceph-mon[33377]: pgmap v4666: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 63 KiB/s wr, 5 op/s 2024-05-08T09:12:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:55 smithi194 ceph-mon[33679]: pgmap v4667: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 8 op/s 2024-05-08T09:12:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:55 smithi070 ceph-mon[29591]: pgmap v4667: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 8 op/s 2024-05-08T09:12:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:55 smithi172 ceph-mon[33377]: pgmap v4667: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 63 KiB/s wr, 8 op/s 2024-05-08T09:12:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:57 smithi194 ceph-mon[33679]: pgmap v4668: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:12:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:57 smithi070 ceph-mon[29591]: pgmap v4668: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:12:58.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:57 smithi172 ceph-mon[33377]: pgmap v4668: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:12:59.982 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:12:59 smithi172 ceph-mon[33377]: pgmap v4669: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:13:00.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:12:59 smithi194 ceph-mon[33679]: pgmap v4669: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:13:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:12:59 smithi070 ceph-mon[29591]: pgmap v4669: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:13:01.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:00 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:13:01.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:13:01.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:00 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:13:01.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:00 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:13:01.675 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:13:02.006 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:01 smithi070 ceph-mon[29591]: pgmap v4670: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 8 op/s 2024-05-08T09:13:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:01 smithi194 ceph-mon[33679]: pgmap v4670: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 8 op/s 2024-05-08T09:13:02.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:01 smithi172 ceph-mon[33377]: pgmap v4670: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 104 KiB/s wr, 8 op/s 2024-05-08T09:13:04.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:03 smithi194 ceph-mon[33679]: pgmap v4671: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 5 op/s 2024-05-08T09:13:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:03 smithi070 ceph-mon[29591]: pgmap v4671: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 5 op/s 2024-05-08T09:13:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:03 smithi172 ceph-mon[33377]: pgmap v4671: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 KiB/s wr, 5 op/s 2024-05-08T09:13:06.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:05 smithi194 ceph-mon[33679]: pgmap v4672: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 93 KiB/s wr, 26 op/s 2024-05-08T09:13:06.107 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:05 smithi070 ceph-mon[29591]: pgmap v4672: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 93 KiB/s wr, 26 op/s 2024-05-08T09:13:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:05 smithi172 ceph-mon[33377]: pgmap v4672: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 93 KiB/s wr, 26 op/s 2024-05-08T09:13:06.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.482+0000 7f1407200700 1 -- 172.21.15.70:0/3391298631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400103750 msgr2=0x7f1400103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:06.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.482+0000 7f1407200700 1 --2- 172.21.15.70:0/3391298631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400103750 0x7f1400103b30 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f13f00099c0 tx=0x7f13f0009cd0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.483+0000 7f1407200700 1 -- 172.21.15.70:0/3391298631 shutdown_connections 2024-05-08T09:13:06.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.483+0000 7f1407200700 1 --2- 172.21.15.70:0/3391298631 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1400108850 0x7f14001103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.483+0000 7f1407200700 1 --2- 172.21.15.70:0/3391298631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400103750 0x7f1400103b30 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.483+0000 7f1407200700 1 --2- 172.21.15.70:0/3391298631 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1400104100 0x7f1400108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.483+0000 7f1407200700 1 -- 172.21.15.70:0/3391298631 >> 172.21.15.70:0/3391298631 conn(0x7f140007a600 msgr2=0x7f140007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:06.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.483+0000 7f1407200700 1 -- 172.21.15.70:0/3391298631 shutdown_connections 2024-05-08T09:13:06.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.483+0000 7f1407200700 1 -- 172.21.15.70:0/3391298631 wait complete. 2024-05-08T09:13:06.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.484+0000 7f1407200700 1 Processor -- start 2024-05-08T09:13:06.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.484+0000 7f1407200700 1 -- start start 2024-05-08T09:13:06.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.484+0000 7f1407200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1400103750 0x7f14001a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:06.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.484+0000 7f1407200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400104100 0x7f14001a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:06.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.484+0000 7f1407200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1400108850 0x7f140019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:06.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.484+0000 7f1407200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1400113520 con 0x7f1400104100 2024-05-08T09:13:06.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.484+0000 7f1407200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14001133a0 con 0x7f1400103750 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.484+0000 7f1407200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f14001136a0 con 0x7f1400108850 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.484+0000 7f13f7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400104100 0x7f14001a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f13f7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400104100 0x7f14001a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56774/0 (socket says 172.21.15.70:56774) 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f13f7e00700 1 -- 172.21.15.70:0/318194381 learned_addr learned my addr 172.21.15.70:0/318194381 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f13ffe00700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1400103750 0x7f14001a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f1405200700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1400108850 0x7f140019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f13f7e00700 1 -- 172.21.15.70:0/318194381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1400108850 msgr2=0x7f140019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f13f7e00700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1400108850 0x7f140019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f13f7e00700 1 -- 172.21.15.70:0/318194381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1400103750 msgr2=0x7f14001a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f13f7e00700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1400103750 0x7f14001a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f13f7e00700 1 -- 172.21.15.70:0/318194381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140019c180 con 0x7f1400104100 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.485+0000 7f13f7e00700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400104100 0x7f14001a1da0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c9b0 tx=0x7f13e800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:06.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.486+0000 7f13fd600700 1 -- 172.21.15.70:0/318194381 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8007b00 con 0x7f1400104100 2024-05-08T09:13:06.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.486+0000 7f13fd600700 1 -- 172.21.15.70:0/318194381 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13e8007ca0 con 0x7f1400104100 2024-05-08T09:13:06.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.486+0000 7f13fd600700 1 -- 172.21.15.70:0/318194381 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e8018660 con 0x7f1400104100 2024-05-08T09:13:06.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.486+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f140019c470 con 0x7f1400104100 2024-05-08T09:13:06.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.486+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14001a8730 con 0x7f1400104100 2024-05-08T09:13:06.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.487+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f140006a190 con 0x7f1400104100 2024-05-08T09:13:06.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.489+0000 7f13fd600700 1 -- 172.21.15.70:0/318194381 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f13e800f450 con 0x7f1400104100 2024-05-08T09:13:06.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.491+0000 7f13fd600700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:06.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.492+0000 7f13fd600700 1 -- 172.21.15.70:0/318194381 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(368..368 src has 1..368) ==== 9583+0+0 (secure 0 0 0) 0x7f13e80e2a80 con 0x7f1400104100 2024-05-08T09:13:06.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.493+0000 7f13ffe00700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:06.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.494+0000 7f13ffe00700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009990 tx=0x7f13f0005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:06.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.496+0000 7f13fd600700 1 -- 172.21.15.70:0/318194381 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f13e80e4e20 con 0x7f1400104100 2024-05-08T09:13:06.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.860+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14001a89c0 con 0x7f1400104100 2024-05-08T09:13:06.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.861+0000 7f13fd600700 1 -- 172.21.15.70:0/318194381 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f13e8014030 con 0x7f1400104100 2024-05-08T09:13:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:13:06.861 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:13:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 msgr2=0x7f13e40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009990 tx=0x7f13f0005fb0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400104100 msgr2=0x7f14001a1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400104100 0x7f14001a1da0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f13e800c9b0 tx=0x7f13e800ccc0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 shutdown_connections 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f13e40b29f0 0x7f13e40b4eb0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1400108850 0x7f140019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1400103750 0x7f14001a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 --2- 172.21.15.70:0/318194381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1400104100 0x7f14001a1da0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.865+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 >> 172.21.15.70:0/318194381 conn(0x7f140007a600 msgr2=0x7f14001099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.866+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 shutdown_connections 2024-05-08T09:13:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:06.866+0000 7f1407200700 1 -- 172.21.15.70:0/318194381 wait complete. 2024-05-08T09:13:06.867 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:13:08.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:07 smithi194 ceph-mon[33679]: pgmap v4673: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 93 KiB/s wr, 23 op/s 2024-05-08T09:13:08.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:07 smithi194 ceph-mon[33679]: osdmap e369: 12 total, 12 up, 12 in 2024-05-08T09:13:08.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:07 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/318194381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:13:08.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:07 smithi070 ceph-mon[29591]: pgmap v4673: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 93 KiB/s wr, 23 op/s 2024-05-08T09:13:08.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:07 smithi070 ceph-mon[29591]: osdmap e369: 12 total, 12 up, 12 in 2024-05-08T09:13:08.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:07 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/318194381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:13:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:07 smithi172 ceph-mon[33377]: pgmap v4673: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 93 KiB/s wr, 23 op/s 2024-05-08T09:13:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:07 smithi172 ceph-mon[33377]: osdmap e369: 12 total, 12 up, 12 in 2024-05-08T09:13:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:07 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/318194381' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:13:08.411 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id a268aa16 --release --await' 2024-05-08T09:13:08.412 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id a268aa16 --release --await 2024-05-08T09:13:08.859 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:13:09.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:09.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:09.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:08 smithi194 ceph-mon[33679]: pgmap v4675: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 112 KiB/s wr, 28 op/s 2024-05-08T09:13:09.301 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:09.301 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:09.301 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:08 smithi070 ceph-mon[29591]: pgmap v4675: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 112 KiB/s wr, 28 op/s 2024-05-08T09:13:09.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:09.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:09.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:08 smithi172 ceph-mon[33377]: pgmap v4675: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 112 KiB/s wr, 28 op/s 2024-05-08T09:13:11.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.609+0000 7f4ab8600700 1 -- 172.21.15.70:0/1122055079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103ef0 msgr2=0x7f4ab01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:11.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.609+0000 7f4ab8600700 1 --2- 172.21.15.70:0/1122055079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103ef0 0x7f4ab01103d0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800b0a0 tx=0x7f4aa800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.609+0000 7f4ab8600700 1 -- 172.21.15.70:0/1122055079 shutdown_connections 2024-05-08T09:13:11.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.609+0000 7f4ab8600700 1 --2- 172.21.15.70:0/1122055079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103ef0 0x7f4ab01103d0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.609+0000 7f4ab8600700 1 --2- 172.21.15.70:0/1122055079 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0108460 0x7f4ab0108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.609+0000 7f4ab8600700 1 --2- 172.21.15.70:0/1122055079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0103550 0x7f4ab01039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.609+0000 7f4ab8600700 1 -- 172.21.15.70:0/1122055079 >> 172.21.15.70:0/1122055079 conn(0x7f4ab007a600 msgr2=0x7f4ab007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:11.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.609+0000 7f4ab8600700 1 -- 172.21.15.70:0/1122055079 shutdown_connections 2024-05-08T09:13:11.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.609+0000 7f4ab8600700 1 -- 172.21.15.70:0/1122055079 wait complete. 2024-05-08T09:13:11.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.610+0000 7f4ab8600700 1 Processor -- start 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.611+0000 7f4ab8600700 1 -- start start 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.611+0000 7f4ab8600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103550 0x7f4ab01a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.611+0000 7f4ab8600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103ef0 0x7f4ab01a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.611+0000 7f4ab8600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0108460 0x7f4ab019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.611+0000 7f4ab8600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0113550 con 0x7f4ab0103550 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.611+0000 7f4ab8600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01133d0 con 0x7f4ab0103ef0 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.611+0000 7f4ab8600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01136d0 con 0x7f4ab0108460 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103550 0x7f4ab01a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103550 0x7f4ab01a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38160/0 (socket says 172.21.15.70:38160) 2024-05-08T09:13:11.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5c00700 1 -- 172.21.15.70:0/4149615384 learned_addr learned my addr 172.21.15.70:0/4149615384 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5200700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103ef0 0x7f4ab01a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab6600700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0108460 0x7f4ab019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5c00700 1 -- 172.21.15.70:0/4149615384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0108460 msgr2=0x7f4ab019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0108460 0x7f4ab019bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5c00700 1 -- 172.21.15.70:0/4149615384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103ef0 msgr2=0x7f4ab01a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103ef0 0x7f4ab01a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5c00700 1 -- 172.21.15.70:0/4149615384 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab019c210 con 0x7f4ab0103550 2024-05-08T09:13:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab6600700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0108460 0x7f4ab019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:13:11.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.612+0000 7f4ab5200700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103ef0 0x7f4ab01a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:13:11.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.613+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103550 0x7f4ab01a18a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400d980 tx=0x7f4aa400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:11.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.613+0000 7f4aae000700 1 -- 172.21.15.70:0/4149615384 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4017030 con 0x7f4ab0103550 2024-05-08T09:13:11.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.613+0000 7f4aae000700 1 -- 172.21.15.70:0/4149615384 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa40044b0 con 0x7f4ab0103550 2024-05-08T09:13:11.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.613+0000 7f4aae000700 1 -- 172.21.15.70:0/4149615384 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4003970 con 0x7f4ab0103550 2024-05-08T09:13:11.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.613+0000 7f4ab8600700 1 -- 172.21.15.70:0/4149615384 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab019c500 con 0x7f4ab0103550 2024-05-08T09:13:11.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.613+0000 7f4ab8600700 1 -- 172.21.15.70:0/4149615384 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab01a8770 con 0x7f4ab0103550 2024-05-08T09:13:11.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.617+0000 7f4aae000700 1 -- 172.21.15.70:0/4149615384 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4aa401a070 con 0x7f4ab0103550 2024-05-08T09:13:11.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.618+0000 7f4aae000700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.618+0000 7f4aae000700 1 -- 172.21.15.70:0/4149615384 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(370..370 src has 1..370) ==== 9583+0+0 (secure 0 0 0) 0x7f4aa40e2380 con 0x7f4ab0103550 2024-05-08T09:13:11.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.619+0000 7f4ab5200700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.619+0000 7f4ab5200700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0110810 tx=0x7f4a9c00b2c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:11.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.637+0000 7f4ac3062b80 1 Processor -- start 2024-05-08T09:13:11.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.637+0000 7f4ac3062b80 1 -- start start 2024-05-08T09:13:11.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.638+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273beec0 0x5639273bf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.638+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9490 0x5639273b9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.638+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9e50 0x5639273c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.638+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56392730bb20 con 0x5639273beec0 2024-05-08T09:13:11.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.638+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5639272a9860 con 0x5639273b9e50 2024-05-08T09:13:11.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.638+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x563927307ae0 con 0x5639273b9490 2024-05-08T09:13:11.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.638+0000 7f4ab5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273beec0 0x5639273bf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.638+0000 7f4ab5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273beec0 0x5639273bf2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38176/0 (socket says 172.21.15.70:38176) 2024-05-08T09:13:11.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.638+0000 7f4ab5c00700 1 -- 172.21.15.70:0/34601382 learned_addr learned my addr 172.21.15.70:0/34601382 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.639+0000 7f4ab5200700 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9490 0x5639273b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.639+0000 7f4ab6600700 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9e50 0x5639273c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.639+0000 7f4ab5c00700 1 -- 172.21.15.70:0/34601382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9490 msgr2=0x5639273b9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.639+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9490 0x5639273b9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.639+0000 7f4ab5c00700 1 -- 172.21.15.70:0/34601382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9e50 msgr2=0x5639273c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.639+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9e50 0x5639273c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.639+0000 7f4ab5c00700 1 -- 172.21.15.70:0/34601382 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639272589d0 con 0x5639273beec0 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.639+0000 7f4ab6600700 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9e50 0x5639273c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.639+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273beec0 0x5639273bf2a0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4005e10 tx=0x7f4aa40a8df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ac66760646c8ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:11.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.640+0000 7f4aa2a00700 1 -- 172.21.15.70:0/34601382 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40e2170 con 0x5639273beec0 2024-05-08T09:13:11.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.640+0000 7f4aa2a00700 1 -- 172.21.15.70:0/34601382 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa40ad590 con 0x5639273beec0 2024-05-08T09:13:11.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.640+0000 7f4aa2a00700 1 -- 172.21.15.70:0/34601382 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40a96a0 con 0x5639273beec0 2024-05-08T09:13:11.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.640+0000 7f4ac3062b80 1 -- 172.21.15.70:0/34601382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273beec0 msgr2=0x5639273bf2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:11.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.640+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273beec0 0x5639273bf2a0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4005e10 tx=0x7f4aa40a8df0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.641+0000 7f4ac3062b80 1 -- 172.21.15.70:0/34601382 shutdown_connections 2024-05-08T09:13:11.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.641+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9e50 0x5639273c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.641+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273beec0 0x5639273bf2a0 secure :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f4aa4005e10 tx=0x7f4aa40a8df0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.641+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/34601382 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9490 0x5639273b9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.641+0000 7f4ac3062b80 1 -- 172.21.15.70:0/34601382 >> 172.21.15.70:0/34601382 conn(0x5639272e7c60 msgr2=0x5639273b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.641+0000 7f4ac3062b80 1 -- 172.21.15.70:0/34601382 shutdown_connections 2024-05-08T09:13:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.641+0000 7f4ac3062b80 1 -- 172.21.15.70:0/34601382 wait complete. 2024-05-08T09:13:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.641+0000 7f4ac3062b80 1 -- start start 2024-05-08T09:13:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.642+0000 7f4ac3062b80 1 Processor -- start 2024-05-08T09:13:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.642+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.642+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.642+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 0x5639273c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.642+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5639273c6220 con 0x5639273b9490 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.642+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x563927271c20 con 0x5639273c3430 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.642+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5639273c63a0 con 0x5639273b9e50 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.642+0000 7f4ac3062b80 10 client.0 _ll_register_callbacks cb 0x5639272b2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38186/0 (socket says 172.21.15.70:38186) 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab5c00700 1 -- 172.21.15.70:0/1372023226 learned_addr learned my addr 172.21.15.70:0/1372023226 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab6600700 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 0x5639273c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab5c00700 1 -- 172.21.15.70:0/1372023226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 msgr2=0x5639273c2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:11.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab5c00700 1 -- 172.21.15.70:0/1372023226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 msgr2=0x5639273c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 0x5639273c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab5c00700 1 -- 172.21.15.70:0/1372023226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639272d1520 con 0x5639273b9490 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c5b30 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40a5260 tx=0x7f4aa40ad3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccf72039b52848e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.643+0000 7f4a97400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.644+0000 7f4a97400700 1 -- 172.21.15.70:0/1372023226 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40c3070 con 0x5639273b9490 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.644+0000 7f4a97400700 1 -- 172.21.15.70:0/1372023226 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(370..370 src has 1..370) ==== 9583+0+0 (secure 0 0 0) 0x7f4aa40a9650 con 0x5639273b9490 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.644+0000 7f4ac3062b80 1 -- 172.21.15.70:0/1372023226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa40ad590 con 0x5639273b9490 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.644+0000 7f4a97400700 1 -- 172.21.15.70:0/1372023226 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4aa40e2170 con 0x5639273b9490 2024-05-08T09:13:11.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.644+0000 7f4ac3062b80 10 client.19221 fetch_fsmap learned FSMap version 42 2024-05-08T09:13:11.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.644+0000 7f4ac3062b80 1 -- 172.21.15.70:0/1372023226 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5639273c6220 con 0x5639273b9490 2024-05-08T09:13:11.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.644+0000 7f4a97400700 1 -- 172.21.15.70:0/1372023226 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa40ad590 con 0x5639273b9490 2024-05-08T09:13:11.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.645+0000 7f4a97400700 1 -- 172.21.15.70:0/1372023226 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4aa4024060 con 0x5639273b9490 2024-05-08T09:13:11.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.645+0000 7f4ac3062b80 10 client.19221 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:13:11.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.645+0000 7f4ac3062b80 10 client.19221 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:13:11.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.645+0000 7f4ac3062b80 20 client.19221 populate_metadata read hostname 'smithi070' 2024-05-08T09:13:11.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.645+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5639273d33a0 0x5639273d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.645+0000 7f4ac3062b80 4 client.19221 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:13:11.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.645+0000 7f4ac3062b80 1 -- 172.21.15.70:0/1372023226 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639273861a0 con 0x5639273d33a0 2024-05-08T09:13:11.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.646+0000 7f4ab5200700 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5639273d33a0 0x5639273d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.647+0000 7f4ab5200700 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5639273d33a0 0x5639273d5790 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5210cb0fd0c53d67 server_cookie=caac910de41f786e in_seq=0 out_seq=0 2024-05-08T09:13:11.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.647+0000 7f4a97400700 10 client.19221 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:13:11.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.648+0000 7f4a97400700 1 -- 172.21.15.70:0/1372023226 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5639273861a0 con 0x5639273d33a0 2024-05-08T09:13:11.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.648+0000 7f4a97400700 10 client.19221 handle_command_reply: tid=0 2024-05-08T09:13:11.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 client.19221 shutdown 2024-05-08T09:13:11.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 -- 172.21.15.70:0/1372023226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 msgr2=0x5639273c5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:11.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c5b30 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40a5260 tx=0x7f4aa40ad3d0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 -- 172.21.15.70:0/1372023226 shutdown_connections 2024-05-08T09:13:11.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5639273d33a0 0x5639273d5790 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 0x5639273c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c5b30 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/1372023226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 -- 172.21.15.70:0/1372023226 >> 172.21.15.70:0/1372023226 conn(0x5639272e7c60 msgr2=0x5639273ae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:11.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4a97400700 0 client.19221 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:13:11.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 -- 172.21.15.70:0/1372023226 shutdown_connections 2024-05-08T09:13:11.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 1 -- 172.21.15.70:0/1372023226 wait complete. 2024-05-08T09:13:11.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.649+0000 7f4ac3062b80 20 client.19221 trim_cache size 0 max 16384 2024-05-08T09:13:11.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:11 smithi070 ceph-mon[29591]: pgmap v4676: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-05-08T09:13:11.652 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:11 smithi070 ceph-mon[29591]: osdmap e370: 12 total, 12 up, 12 in 2024-05-08T09:13:11.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.675+0000 7f4ac3062b80 1 Processor -- start 2024-05-08T09:13:11.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.675+0000 7f4ac3062b80 1 -- start start 2024-05-08T09:13:11.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.675+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9490 0x5639273cf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.675+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.675+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273c3430 0x5639273c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.675+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b4160 con 0x5639273c3430 2024-05-08T09:13:11.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.675+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b19f0 con 0x5639273b9490 2024-05-08T09:13:11.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.675+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01af860 con 0x5639273b9e50 2024-05-08T09:13:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.675+0000 7f4ab6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273c3430 0x5639273c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.676+0000 7f4ab6600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273c3430 0x5639273c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38190/0 (socket says 172.21.15.70:38190) 2024-05-08T09:13:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.676+0000 7f4ab6600700 1 -- 172.21.15.70:0/2640520651 learned_addr learned my addr 172.21.15.70:0/2640520651 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.676+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/2640520651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9490 0x5639273cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.676+0000 7f4ab5200700 1 --2- 172.21.15.70:0/2640520651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.676+0000 7f4ab6600700 1 -- 172.21.15.70:0/2640520651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 msgr2=0x5639273c0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.676+0000 7f4ab6600700 1 --2- 172.21.15.70:0/2640520651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.676+0000 7f4ab6600700 1 -- 172.21.15.70:0/2640520651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9490 msgr2=0x5639273cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:11.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.676+0000 7f4ab6600700 1 --2- 172.21.15.70:0/2640520651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9490 0x5639273cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.676+0000 7f4ab6600700 1 -- 172.21.15.70:0/2640520651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639273c1430 con 0x5639273c3430 2024-05-08T09:13:11.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.677+0000 7f4ab6600700 1 --2- 172.21.15.70:0/2640520651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273c3430 0x5639273c4de0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8015000 tx=0x7f4aa80090d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb2838cceee913e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:11.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.677+0000 7f4aa2000700 1 -- 172.21.15.70:0/2640520651 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa80092f0 con 0x5639273c3430 2024-05-08T09:13:11.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.677+0000 7f4aa2000700 1 -- 172.21.15.70:0/2640520651 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa8009490 con 0x5639273c3430 2024-05-08T09:13:11.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.677+0000 7f4aa2000700 1 -- 172.21.15.70:0/2640520651 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8005040 con 0x5639273c3430 2024-05-08T09:13:11.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.678+0000 7f4ac3062b80 1 -- 172.21.15.70:0/2640520651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273c3430 msgr2=0x5639273c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:11.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.678+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/2640520651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273c3430 0x5639273c4de0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8015000 tx=0x7f4aa80090d0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.678+0000 7f4ac3062b80 1 -- 172.21.15.70:0/2640520651 shutdown_connections 2024-05-08T09:13:11.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.678+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/2640520651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273c3430 0x5639273c4de0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.678+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/2640520651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273b9490 0x5639273cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.678+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/2640520651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.678+0000 7f4ac3062b80 1 -- 172.21.15.70:0/2640520651 >> 172.21.15.70:0/2640520651 conn(0x5639272e7c60 msgr2=0x5639273c46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:11.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.678+0000 7f4ac3062b80 1 -- 172.21.15.70:0/2640520651 shutdown_connections 2024-05-08T09:13:11.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.678+0000 7f4ac3062b80 1 -- 172.21.15.70:0/2640520651 wait complete. 2024-05-08T09:13:11.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.679+0000 7f4ac3062b80 1 -- start start 2024-05-08T09:13:11.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.679+0000 7f4ac3062b80 1 Processor -- start 2024-05-08T09:13:11.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.679+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.679+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ac3062b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 0x5639274378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01afeb0 con 0x5639273b9490 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b1320 con 0x5639273c3430 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ac3062b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01b0580 con 0x5639273b9e50 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ac3062b80 10 client.0 _ll_register_callbacks cb 0x5639272b2d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ab5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ab5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38192/0 (socket says 172.21.15.70:38192) 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ab5c00700 1 -- 172.21.15.70:0/3215895742 learned_addr learned my addr 172.21.15.70:0/3215895742 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ab6600700 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 0x5639274378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ab5c00700 1 -- 172.21.15.70:0/3215895742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 msgr2=0x5639273c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ab5c00700 1 -- 172.21.15.70:0/3215895742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 msgr2=0x5639274378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 0x5639274378e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.680+0000 7f4ab5c00700 1 -- 172.21.15.70:0/3215895742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563927437f50 con 0x5639273b9490 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.681+0000 7f4ab5c00700 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c6b30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40a5260 tx=0x7f4aa40a4d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a2c9354e085810 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.681+0000 7f4a97400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.681+0000 7f4a97400700 1 -- 172.21.15.70:0/3215895742 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40e2170 con 0x5639273b9490 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.681+0000 7f4a97400700 1 -- 172.21.15.70:0/3215895742 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(370..370 src has 1..370) ==== 9583+0+0 (secure 0 0 0) 0x7f4aa40a8440 con 0x5639273b9490 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.681+0000 7f4ac3062b80 1 -- 172.21.15.70:0/3215895742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4aa8009490 con 0x5639273b9490 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.681+0000 7f4a97400700 1 -- 172.21.15.70:0/3215895742 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4aa408d050 con 0x5639273b9490 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4ac3062b80 10 client.19227 fetch_fsmap learned FSMap version 42 2024-05-08T09:13:11.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4ac3062b80 1 -- 172.21.15.70:0/3215895742 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563927437f50 con 0x5639273b9490 2024-05-08T09:13:11.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4a97400700 1 -- 172.21.15.70:0/3215895742 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa8009490 con 0x5639273b9490 2024-05-08T09:13:11.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4a97400700 1 -- 172.21.15.70:0/3215895742 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4aa408f2a0 con 0x5639273b9490 2024-05-08T09:13:11.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4ac3062b80 10 client.19227 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:13:11.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4ac3062b80 10 client.19227 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:13:11.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4ac3062b80 20 client.19227 populate_metadata read hostname 'smithi070' 2024-05-08T09:13:11.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56392743f6d0 0x563927441b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:11.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4ac3062b80 4 client.19227 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a268aa16", "release": true, "await": true}] 2024-05-08T09:13:11.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.682+0000 7f4ac3062b80 1 -- 172.21.15.70:0/3215895742 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a268aa16", "release": true, "await": true}) -- 0x563927319500 con 0x56392743f6d0 2024-05-08T09:13:11.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.683+0000 7f4ab5200700 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56392743f6d0 0x563927441b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:11.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.684+0000 7f4ab5200700 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56392743f6d0 0x563927441b30 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fdbc9176d70f2b0 server_cookie=43f3a656d28da4cd in_seq=0 out_seq=0 2024-05-08T09:13:11.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:11.684+0000 7f4a97400700 10 client.19227 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:13:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:11 smithi172 ceph-mon[33377]: pgmap v4676: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-05-08T09:13:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:11 smithi172 ceph-mon[33377]: osdmap e370: 12 total, 12 up, 12 in 2024-05-08T09:13:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:11 smithi194 ceph-mon[33679]: pgmap v4676: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 28 op/s 2024-05-08T09:13:12.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:11 smithi194 ceph-mon[33679]: osdmap e370: 12 total, 12 up, 12 in 2024-05-08T09:13:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:13 smithi070 ceph-mon[29591]: pgmap v4678: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T09:13:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:13:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:13:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:13 smithi172 ceph-mon[33377]: pgmap v4678: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T09:13:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:13:13.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:13:13.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:13 smithi194 ceph-mon[33679]: pgmap v4678: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T09:13:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:13:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:13:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:13:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:15 smithi070 ceph-mon[29591]: pgmap v4679: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-05-08T09:13:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:15 smithi172 ceph-mon[33377]: pgmap v4679: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-05-08T09:13:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:15 smithi194 ceph-mon[33679]: pgmap v4679: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 4.7 KiB/s wr, 8 op/s 2024-05-08T09:13:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.287+0000 7f4a97400700 1 -- 172.21.15.70:0/3215895742 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x563927319500 con 0x56392743f6d0 2024-05-08T09:13:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.287+0000 7f4a97400700 10 client.19227 handle_command_reply: tid=0 2024-05-08T09:13:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.287+0000 7f4ac3062b80 1 client.19227 shutdown 2024-05-08T09:13:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.288+0000 7f4ac3062b80 1 -- 172.21.15.70:0/3215895742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 msgr2=0x5639273c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:16.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.288+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c6b30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40a5260 tx=0x7f4aa40a4d70 comp rx=0 tx=0).stop 2024-05-08T09:13:16.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.289+0000 7f4ac3062b80 1 -- 172.21.15.70:0/3215895742 shutdown_connections 2024-05-08T09:13:16.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.289+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56392743f6d0 0x563927441b30 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:16.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.289+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5639273c3430 0x5639274378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:16.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.289+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5639273b9490 0x5639273c6b30 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:16.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.289+0000 7f4ac3062b80 1 --2- 172.21.15.70:0/3215895742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5639273b9e50 0x5639273c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:16.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.289+0000 7f4ac3062b80 1 -- 172.21.15.70:0/3215895742 >> 172.21.15.70:0/3215895742 conn(0x5639272e7c60 msgr2=0x5639273c2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:16.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.289+0000 7f4a97400700 0 client.19227 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:13:16.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.289+0000 7f4ac3062b80 1 -- 172.21.15.70:0/3215895742 shutdown_connections 2024-05-08T09:13:16.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.290+0000 7f4ac3062b80 1 -- 172.21.15.70:0/3215895742 wait complete. 2024-05-08T09:13:16.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.290+0000 7f4ac3062b80 20 client.19227 trim_cache size 0 max 16384 2024-05-08T09:13:16.295 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:13:16.295 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:13:16.295 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:13:16.295 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 324, 2024-05-08T09:13:16.295 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:13:16.295 INFO:teuthology.orchestra.run.smithi070.stdout: "a268aa16": { 2024-05-08T09:13:16.295 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 324, 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.3, 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:13:16.296 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:13:16.297 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:13:16.297 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:13:16.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:16.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:16.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:16.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:16.297 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:16.297 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:13:16.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 -- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 msgr2=0x7f4a980b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:16.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0110810 tx=0x7f4a9c00b2c0 comp rx=0 tx=0).stop 2024-05-08T09:13:16.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 -- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103550 msgr2=0x7f4ab01a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:16.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103550 0x7f4ab01a18a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f4aa400d980 tx=0x7f4aa400dd40 comp rx=0 tx=0).stop 2024-05-08T09:13:16.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 -- 172.21.15.70:0/4149615384 shutdown_connections 2024-05-08T09:13:16.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:16.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0108460 0x7f4ab019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:16.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103550 0x7f4ab01a18a0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:16.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 --2- 172.21.15.70:0/4149615384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103ef0 0x7f4ab01a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:16.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 -- 172.21.15.70:0/4149615384 >> 172.21.15.70:0/4149615384 conn(0x7f4ab007a600 msgr2=0x7f4ab01013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:16.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 -- 172.21.15.70:0/4149615384 shutdown_connections 2024-05-08T09:13:16.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:16.292+0000 7f4ab8600700 1 -- 172.21.15.70:0/4149615384 wait complete. 2024-05-08T09:13:16.617 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/leds/led-class.o 2024-05-08T09:13:16.630 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-ioctl.o 2024-05-08T09:13:17.118 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a268aa16', seconds elapsed: 86.9 2024-05-08T09:13:17.118 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.3 2024-05-08T09:13:17.118 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:13:17.681 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:13:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:17 smithi070 ceph-mon[29591]: pgmap v4680: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-05-08T09:13:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:17 smithi172 ceph-mon[33377]: pgmap v4680: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-05-08T09:13:18.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:17 smithi194 ceph-mon[33679]: pgmap v4680: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 3.9 KiB/s wr, 7 op/s 2024-05-08T09:13:18.281 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_clflush.o 2024-05-08T09:13:18.305 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/leds/led-triggers.o 2024-05-08T09:13:18.398 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_context.o 2024-05-08T09:13:18.894 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_create.o 2024-05-08T09:13:19.112 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/cpufreq/built-in.a 2024-05-08T09:13:19.702 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_sysfs.o 2024-05-08T09:13:19.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:19 smithi070 ceph-mon[29591]: pgmap v4681: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.8 KiB/s wr, 6 op/s 2024-05-08T09:13:19.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.926+0000 7fefc3000700 1 -- 172.21.15.70:0/2660072402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102ad0 msgr2=0x7fefbc10f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:19.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.926+0000 7fefc3000700 1 --2- 172.21.15.70:0/2660072402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102ad0 0x7fefbc10f790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009990 tx=0x7fefa8009ca0 comp rx=0 tx=0).stop 2024-05-08T09:13:19.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.926+0000 7fefc3000700 1 -- 172.21.15.70:0/2660072402 shutdown_connections 2024-05-08T09:13:19.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.926+0000 7fefc3000700 1 --2- 172.21.15.70:0/2660072402 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefbc10fcd0 0x7fefbc1120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:19.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.926+0000 7fefc3000700 1 --2- 172.21.15.70:0/2660072402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc102120 0x7fefbc102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:19.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.926+0000 7fefc3000700 1 --2- 172.21.15.70:0/2660072402 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102ad0 0x7fefbc10f790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:19.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.926+0000 7fefc3000700 1 -- 172.21.15.70:0/2660072402 >> 172.21.15.70:0/2660072402 conn(0x7fefbc0fddc0 msgr2=0x7fefbc1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:19.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.926+0000 7fefc3000700 1 -- 172.21.15.70:0/2660072402 shutdown_connections 2024-05-08T09:13:19.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.926+0000 7fefc3000700 1 -- 172.21.15.70:0/2660072402 wait complete. 2024-05-08T09:13:19.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.927+0000 7fefc3000700 1 Processor -- start 2024-05-08T09:13:19.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.928+0000 7fefc3000700 1 -- start start 2024-05-08T09:13:19.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.928+0000 7fefc3000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102120 0x7fefbc074d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:19.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.928+0000 7fefc3000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefbc102ad0 0x7fefbc06de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:19.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.928+0000 7fefc3000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc10fcd0 0x7fefbc06e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:19.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.928+0000 7fefc3000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc1156e0 con 0x7fefbc102ad0 2024-05-08T09:13:19.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.928+0000 7fefc3000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc115560 con 0x7fefbc102120 2024-05-08T09:13:19.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.928+0000 7fefc3000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fefbc115860 con 0x7fefbc10fcd0 2024-05-08T09:13:19.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.929+0000 7fefc1c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102120 0x7fefbc074d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:19.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.929+0000 7fefc1c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102120 0x7fefbc074d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:41462/0 (socket says 172.21.15.70:41462) 2024-05-08T09:13:19.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.929+0000 7fefc1c00700 1 -- 172.21.15.70:0/1759374798 learned_addr learned my addr 172.21.15.70:0/1759374798 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:19.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.929+0000 7fefc2600700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc10fcd0 0x7fefbc06e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:19.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.929+0000 7fefc1c00700 1 -- 172.21.15.70:0/1759374798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc10fcd0 msgr2=0x7fefbc06e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:19.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.929+0000 7fefc1c00700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc10fcd0 0x7fefbc06e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:19.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.929+0000 7fefc1c00700 1 -- 172.21.15.70:0/1759374798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefbc102ad0 msgr2=0x7fefbc06de20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T09:13:19.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:19 smithi172 ceph-mon[33377]: pgmap v4681: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.8 KiB/s wr, 6 op/s 2024-05-08T09:13:19.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.929+0000 7fefc1c00700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefbc102ad0 0x7fefbc06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:19.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.929+0000 7fefc1c00700 1 -- 172.21.15.70:0/1759374798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefbc06ea90 con 0x7fefbc102120 2024-05-08T09:13:19.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.930+0000 7fefc1c00700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102120 0x7fefbc074d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefb000e9c0 tx=0x7fefb000ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:19.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.930+0000 7fefba000700 1 -- 172.21.15.70:0/1759374798 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb000cbd0 con 0x7fefbc102120 2024-05-08T09:13:19.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.930+0000 7fefba000700 1 -- 172.21.15.70:0/1759374798 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefb000cd70 con 0x7fefbc102120 2024-05-08T09:13:19.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.931+0000 7fefba000700 1 -- 172.21.15.70:0/1759374798 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0005610 con 0x7fefbc102120 2024-05-08T09:13:19.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.931+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefbc072870 con 0x7fefbc102120 2024-05-08T09:13:19.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.931+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefbc072d60 con 0x7fefbc102120 2024-05-08T09:13:19.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.933+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefbc06ba60 con 0x7fefbc102120 2024-05-08T09:13:19.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.937+0000 7fefba000700 1 -- 172.21.15.70:0/1759374798 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fefb0004750 con 0x7fefbc102120 2024-05-08T09:13:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.939+0000 7fefba000700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fefa40b29f0 0x7fefa40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.939+0000 7fefba000700 1 -- 172.21.15.70:0/1759374798 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(370..370 src has 1..370) ==== 9583+0+0 (secure 0 0 0) 0x7fefb00e30d0 con 0x7fefbc102120 2024-05-08T09:13:19.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.940+0000 7fefc1200700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fefa40b29f0 0x7fefa40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:19.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.941+0000 7fefc1200700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fefa40b29f0 0x7fefa40b4eb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fefa80098e0 tx=0x7fefa800b610 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:19.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:19.951+0000 7fefba000700 1 -- 172.21.15.70:0/1759374798 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fefb0054df0 con 0x7fefbc102120 2024-05-08T09:13:20.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:19 smithi194 ceph-mon[33679]: pgmap v4681: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.8 KiB/s wr, 6 op/s 2024-05-08T09:13:20.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.427+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefbc06f300 con 0x7fefbc102120 2024-05-08T09:13:20.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.429+0000 7fefba000700 1 -- 172.21.15.70:0/1759374798 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fefb00aa630 con 0x7fefbc102120 2024-05-08T09:13:20.430 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:13:20.430 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fefa40b29f0 msgr2=0x7fefa40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fefa40b29f0 0x7fefa40b4eb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fefa80098e0 tx=0x7fefa800b610 comp rx=0 tx=0).stop 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102120 msgr2=0x7fefbc074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102120 0x7fefbc074d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fefb000e9c0 tx=0x7fefb000ed80 comp rx=0 tx=0).stop 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 shutdown_connections 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fefa40b29f0 0x7fefa40b4eb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefbc10fcd0 0x7fefbc06e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fefbc102120 0x7fefbc074d40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 --2- 172.21.15.70:0/1759374798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefbc102ad0 0x7fefbc06de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:20.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 >> 172.21.15.70:0/1759374798 conn(0x7fefbc0fddc0 msgr2=0x7fefbc1001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:20.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.433+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 shutdown_connections 2024-05-08T09:13:20.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:20.434+0000 7fefc3000700 1 -- 172.21.15.70:0/1759374798 wait complete. 2024-05-08T09:13:20.436 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:13:20.816 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:20 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1759374798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:13:20.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:20 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1759374798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:13:21.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:20 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1759374798' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:13:21.221 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 88.3 --await-for 42.0' 2024-05-08T09:13:21.221 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 88.3 --await-for 42.0 2024-05-08T09:13:21.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:21 smithi070 ceph-mon[29591]: pgmap v4682: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 190 KiB/s wr, 12 op/s 2024-05-08T09:13:21.912 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:13:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:21 smithi172 ceph-mon[33377]: pgmap v4682: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 190 KiB/s wr, 12 op/s 2024-05-08T09:13:22.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:21 smithi194 ceph-mon[33679]: pgmap v4682: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 190 KiB/s wr, 12 op/s 2024-05-08T09:13:22.540 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_trace_points.o 2024-05-08T09:13:23.768 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_vblank.o 2024-05-08T09:13:23.794 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:23 smithi070 ceph-mon[29591]: pgmap v4683: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 169 KiB/s wr, 10 op/s 2024-05-08T09:13:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:23 smithi172 ceph-mon[33377]: pgmap v4683: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 169 KiB/s wr, 10 op/s 2024-05-08T09:13:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:23 smithi194 ceph-mon[33679]: pgmap v4683: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 169 KiB/s wr, 10 op/s 2024-05-08T09:13:24.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.757+0000 7f3f72800700 1 -- 172.21.15.70:0/2309453406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c11cb30 msgr2=0x7f3f6c11ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:24.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.757+0000 7f3f72800700 1 --2- 172.21.15.70:0/2309453406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c11cb30 0x7f3f6c11ef20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b0a0 tx=0x7f3f6400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.758+0000 7f3f72800700 1 -- 172.21.15.70:0/2309453406 shutdown_connections 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.758+0000 7f3f72800700 1 --2- 172.21.15.70:0/2309453406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c11cb30 0x7f3f6c11ef20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.758+0000 7f3f72800700 1 --2- 172.21.15.70:0/2309453406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f6c06ec80 0x7f3f6c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.758+0000 7f3f72800700 1 --2- 172.21.15.70:0/2309453406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f6c06f5a0 0x7f3f6c11c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.758+0000 7f3f72800700 1 -- 172.21.15.70:0/2309453406 >> 172.21.15.70:0/2309453406 conn(0x7f3f6c06e380 msgr2=0x7f3f6c10c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.758+0000 7f3f72800700 1 -- 172.21.15.70:0/2309453406 shutdown_connections 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.758+0000 7f3f72800700 1 -- 172.21.15.70:0/2309453406 wait complete. 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.759+0000 7f3f72800700 1 Processor -- start 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.759+0000 7f3f72800700 1 -- start start 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.760+0000 7f3f72800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c06ec80 0x7f3f6c1a85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.760+0000 7f3f72800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f6c06f5a0 0x7f3f6c1a8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.760+0000 7f3f72800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f6c11cb30 0x7f3f6c1acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.760+0000 7f3f72800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c1221a0 con 0x7f3f6c11cb30 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.760+0000 7f3f72800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c122020 con 0x7f3f6c06f5a0 2024-05-08T09:13:24.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.760+0000 7f3f72800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c122320 con 0x7f3f6c06ec80 2024-05-08T09:13:24.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.761+0000 7f3f71400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c06ec80 0x7f3f6c1a85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.761+0000 7f3f70a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f6c06f5a0 0x7f3f6c1a8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.761+0000 7f3f71e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f6c11cb30 0x7f3f6c1acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.761+0000 7f3f71400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c06ec80 0x7f3f6c1a85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:55588/0 (socket says 172.21.15.70:55588) 2024-05-08T09:13:24.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.761+0000 7f3f71400700 1 -- 172.21.15.70:0/1763503907 learned_addr learned my addr 172.21.15.70:0/1763503907 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:24.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.762+0000 7f3f71400700 1 -- 172.21.15.70:0/1763503907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f6c06f5a0 msgr2=0x7f3f6c1a8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:24.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.762+0000 7f3f71400700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f6c06f5a0 0x7f3f6c1a8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.762+0000 7f3f71400700 1 -- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f6c11cb30 msgr2=0x7f3f6c1acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:24.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.762+0000 7f3f71400700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f6c11cb30 0x7f3f6c1acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.762+0000 7f3f71400700 1 -- 172.21.15.70:0/1763503907 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6c1ad5e0 con 0x7f3f6c06ec80 2024-05-08T09:13:24.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.762+0000 7f3f71e00700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f6c11cb30 0x7f3f6c1acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:13:24.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.763+0000 7f3f71400700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c06ec80 0x7f3f6c1a85d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000e9a0 tx=0x7f3f6000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:24.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.763+0000 7f3f6a000700 1 -- 172.21.15.70:0/1763503907 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6000ca10 con 0x7f3f6c06ec80 2024-05-08T09:13:24.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.763+0000 7f3f72800700 1 -- 172.21.15.70:0/1763503907 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6c1ad870 con 0x7f3f6c06ec80 2024-05-08T09:13:24.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.763+0000 7f3f6a000700 1 -- 172.21.15.70:0/1763503907 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f6000cbb0 con 0x7f3f6c06ec80 2024-05-08T09:13:24.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.763+0000 7f3f72800700 1 -- 172.21.15.70:0/1763503907 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6c1b5150 con 0x7f3f6c06ec80 2024-05-08T09:13:24.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.764+0000 7f3f6a000700 1 -- 172.21.15.70:0/1763503907 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f60018680 con 0x7f3f6c06ec80 2024-05-08T09:13:24.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.769+0000 7f3f6a000700 1 -- 172.21.15.70:0/1763503907 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3f60010430 con 0x7f3f6c06ec80 2024-05-08T09:13:24.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.771+0000 7f3f6a000700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f540b2b20 0x7f3f540b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.771+0000 7f3f6a000700 1 -- 172.21.15.70:0/1763503907 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(370..370 src has 1..370) ==== 9583+0+0 (secure 0 0 0) 0x7f3f600e2b90 con 0x7f3f6c06ec80 2024-05-08T09:13:24.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.772+0000 7f3f70a00700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f540b2b20 0x7f3f540b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.773+0000 7f3f70a00700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f540b2b20 0x7f3f540b4fe0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009680 tx=0x7f3f58009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:24.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.785+0000 7f3f7e76eb80 1 Processor -- start 2024-05-08T09:13:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.785+0000 7f3f7e76eb80 1 -- start start 2024-05-08T09:13:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.786+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567f2e0 0x55757567f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.786+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567fc00 0x557575679810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.786+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 0x55757567a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.786+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5575755cbbb0 con 0x55757567fc00 2024-05-08T09:13:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.786+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5575755698f0 con 0x55757567f2e0 2024-05-08T09:13:24.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.786+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5575755c7b70 con 0x557575679e30 2024-05-08T09:13:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.786+0000 7f3f70a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567fc00 0x557575679810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.787+0000 7f3f71400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567f2e0 0x55757567f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.787+0000 7f3f70a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567fc00 0x557575679810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56992/0 (socket says 172.21.15.70:56992) 2024-05-08T09:13:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.787+0000 7f3f70a00700 1 -- 172.21.15.70:0/3599192066 learned_addr learned my addr 172.21.15.70:0/3599192066 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:24.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.787+0000 7f3f71e00700 1 --2- 172.21.15.70:0/3599192066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 0x55757567a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.787+0000 7f3f70a00700 1 -- 172.21.15.70:0/3599192066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 msgr2=0x55757567a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.787+0000 7f3f70a00700 1 --2- 172.21.15.70:0/3599192066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 0x55757567a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.787+0000 7f3f70a00700 1 -- 172.21.15.70:0/3599192066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567f2e0 msgr2=0x55757567f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.787+0000 7f3f70a00700 1 --2- 172.21.15.70:0/3599192066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567f2e0 0x55757567f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.787+0000 7f3f70a00700 1 -- 172.21.15.70:0/3599192066 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557575518a60 con 0x55757567fc00 2024-05-08T09:13:24.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.788+0000 7f3f70a00700 1 --2- 172.21.15.70:0/3599192066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567fc00 0x557575679810 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f3f58011d30 tx=0x7f3f58014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983df64136ef1b24 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:24.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.788+0000 7f3f5ea00700 1 -- 172.21.15.70:0/3599192066 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011d60 con 0x55757567fc00 2024-05-08T09:13:24.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.788+0000 7f3f5ea00700 1 -- 172.21.15.70:0/3599192066 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f58004020 con 0x55757567fc00 2024-05-08T09:13:24.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.788+0000 7f3f5ea00700 1 -- 172.21.15.70:0/3599192066 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58003cc0 con 0x55757567fc00 2024-05-08T09:13:24.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.789+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3599192066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567fc00 msgr2=0x557575679810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:24.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.789+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/3599192066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567fc00 0x557575679810 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f3f58011d30 tx=0x7f3f58014000 comp rx=0 tx=0).stop 2024-05-08T09:13:24.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.789+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3599192066 shutdown_connections 2024-05-08T09:13:24.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.789+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/3599192066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 0x55757567a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.790+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/3599192066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567f2e0 0x55757567f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.790+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/3599192066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567fc00 0x557575679810 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.790+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3599192066 >> 172.21.15.70:0/3599192066 conn(0x5575755f1860 msgr2=0x557575674370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:24.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.790+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3599192066 shutdown_connections 2024-05-08T09:13:24.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.790+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3599192066 wait complete. 2024-05-08T09:13:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.790+0000 7f3f7e76eb80 1 -- start start 2024-05-08T09:13:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.791+0000 7f3f7e76eb80 1 Processor -- start 2024-05-08T09:13:24.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.791+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 0x557575685920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.791+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567f2e0 0x557575682cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.791+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567fc00 0x557575683200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.791+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557575686720 con 0x55757567f2e0 2024-05-08T09:13:24.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.791+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557575531cb0 con 0x55757567fc00 2024-05-08T09:13:24.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.791+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5575756868a0 con 0x557575679e30 2024-05-08T09:13:24.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.791+0000 7f3f7e76eb80 10 client.0 _ll_register_callbacks cb 0x557575572e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:13:24.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.792+0000 7f3f71400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 0x557575685920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.792+0000 7f3f70a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567f2e0 0x557575682cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.792+0000 7f3f70a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567f2e0 0x557575682cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57006/0 (socket says 172.21.15.70:57006) 2024-05-08T09:13:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.792+0000 7f3f70a00700 1 -- 172.21.15.70:0/2920746888 learned_addr learned my addr 172.21.15.70:0/2920746888 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.792+0000 7f3f71e00700 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567fc00 0x557575683200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.793+0000 7f3f70a00700 1 -- 172.21.15.70:0/2920746888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 msgr2=0x557575685920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.793+0000 7f3f70a00700 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 0x557575685920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.793+0000 7f3f70a00700 1 -- 172.21.15.70:0/2920746888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567fc00 msgr2=0x557575683200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.793+0000 7f3f70a00700 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567fc00 0x557575683200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.793+0000 7f3f70a00700 1 -- 172.21.15.70:0/2920746888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575755915b0 con 0x55757567f2e0 2024-05-08T09:13:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.793+0000 7f3f71400700 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 0x557575685920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:13:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.793+0000 7f3f70a00700 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567f2e0 0x557575682cc0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f3f58005490 tx=0x7f3f580054c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a712dce0f27db49b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.793+0000 7f3f53400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:13:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.794+0000 7f3f53400700 1 -- 172.21.15.70:0/2920746888 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f58003a30 con 0x55757567f2e0 2024-05-08T09:13:24.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.794+0000 7f3f53400700 1 -- 172.21.15.70:0/2920746888 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(370..370 src has 1..370) ==== 9583+0+0 (secure 0 0 0) 0x7f3f58003bd0 con 0x55757567f2e0 2024-05-08T09:13:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.794+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/2920746888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f58004020 con 0x55757567f2e0 2024-05-08T09:13:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.794+0000 7f3f53400700 1 -- 172.21.15.70:0/2920746888 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3f58003dd0 con 0x55757567f2e0 2024-05-08T09:13:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.795+0000 7f3f7e76eb80 10 client.19242 fetch_fsmap learned FSMap version 42 2024-05-08T09:13:24.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.795+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/2920746888 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557575690fd0 con 0x55757567f2e0 2024-05-08T09:13:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.795+0000 7f3f53400700 1 -- 172.21.15.70:0/2920746888 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f58004020 con 0x55757567f2e0 2024-05-08T09:13:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.795+0000 7f3f53400700 1 -- 172.21.15.70:0/2920746888 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3f5803c020 con 0x55757567f2e0 2024-05-08T09:13:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.796+0000 7f3f7e76eb80 10 client.19242 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:13:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.796+0000 7f3f7e76eb80 10 client.19242 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:13:24.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.796+0000 7f3f7e76eb80 20 client.19242 populate_metadata read hostname 'smithi070' 2024-05-08T09:13:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.796+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575756934a0 0x557575695890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.796+0000 7f3f7e76eb80 4 client.19242 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:13:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.796+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/2920746888 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575756462d0 con 0x5575756934a0 2024-05-08T09:13:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.796+0000 7f3f71400700 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575756934a0 0x557575695890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.797+0000 7f3f71400700 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575756934a0 0x557575695890 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d144591ef760071b server_cookie=19e735e0cd681243 in_seq=0 out_seq=0 2024-05-08T09:13:24.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.797+0000 7f3f53400700 10 client.19242 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:13:24.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f53400700 1 -- 172.21.15.70:0/2920746888 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5575756462d0 con 0x5575756934a0 2024-05-08T09:13:24.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f53400700 10 client.19242 handle_command_reply: tid=0 2024-05-08T09:13:24.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f7e76eb80 1 client.19242 shutdown 2024-05-08T09:13:24.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/2920746888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567f2e0 msgr2=0x557575682cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:24.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567f2e0 0x557575682cc0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f3f58005490 tx=0x7f3f580054c0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/2920746888 shutdown_connections 2024-05-08T09:13:24.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575756934a0 0x557575695890 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757567fc00 0x557575683200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557575679e30 0x557575685920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/2920746888 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757567f2e0 0x557575682cc0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f53400700 0 client.19242 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:13:24.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.800+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/2920746888 >> 172.21.15.70:0/2920746888 conn(0x5575755f1860 msgr2=0x557575678800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:24.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.801+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/2920746888 shutdown_connections 2024-05-08T09:13:24.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.801+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/2920746888 wait complete. 2024-05-08T09:13:24.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.801+0000 7f3f7e76eb80 20 client.19242 trim_cache size 0 max 16384 2024-05-08T09:13:24.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.824+0000 7f3f7e76eb80 1 Processor -- start 2024-05-08T09:13:24.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.824+0000 7f3f7e76eb80 1 -- start start 2024-05-08T09:13:24.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.825+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557575679e30 0x557575683250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.825+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 0x5575756798a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.825+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757568f840 0x55757569afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.825+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c011810 con 0x55757568f840 2024-05-08T09:13:24.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.825+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c00f0a0 con 0x557575679e30 2024-05-08T09:13:24.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.825+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c00cf10 con 0x55757567fc00 2024-05-08T09:13:24.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.825+0000 7f3f71e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757568f840 0x55757569afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.825+0000 7f3f71400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557575679e30 0x557575683250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.826+0000 7f3f71e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757568f840 0x55757569afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57016/0 (socket says 172.21.15.70:57016) 2024-05-08T09:13:24.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.826+0000 7f3f71e00700 1 -- 172.21.15.70:0/3868321154 learned_addr learned my addr 172.21.15.70:0/3868321154 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:24.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.826+0000 7f3f70a00700 1 --2- 172.21.15.70:0/3868321154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 0x5575756798a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.826+0000 7f3f71e00700 1 -- 172.21.15.70:0/3868321154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 msgr2=0x5575756798a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:24.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.826+0000 7f3f71e00700 1 --2- 172.21.15.70:0/3868321154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 0x5575756798a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.826+0000 7f3f71e00700 1 -- 172.21.15.70:0/3868321154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557575679e30 msgr2=0x557575683250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:24.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.826+0000 7f3f71e00700 1 --2- 172.21.15.70:0/3868321154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557575679e30 0x557575683250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.826+0000 7f3f71e00700 1 -- 172.21.15.70:0/3868321154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557575681250 con 0x55757568f840 2024-05-08T09:13:24.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.827+0000 7f3f71e00700 1 --2- 172.21.15.70:0/3868321154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757568f840 0x55757569afb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b0a0 tx=0x7f3f64009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209570ade3dbff5f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:24.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.827+0000 7f3f5e000700 1 -- 172.21.15.70:0/3868321154 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64029070 con 0x55757568f840 2024-05-08T09:13:24.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.827+0000 7f3f5e000700 1 -- 172.21.15.70:0/3868321154 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f64009ca0 con 0x55757568f840 2024-05-08T09:13:24.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.827+0000 7f3f5e000700 1 -- 172.21.15.70:0/3868321154 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64005040 con 0x55757568f840 2024-05-08T09:13:24.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.828+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3868321154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757568f840 msgr2=0x55757569afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:24.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.828+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/3868321154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757568f840 0x55757569afb0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b0a0 tx=0x7f3f64009470 comp rx=0 tx=0).stop 2024-05-08T09:13:24.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.828+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3868321154 shutdown_connections 2024-05-08T09:13:24.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.828+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/3868321154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55757568f840 0x55757569afb0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.828+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/3868321154 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557575679e30 0x557575683250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.828+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/3868321154 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 0x5575756798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.828+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3868321154 >> 172.21.15.70:0/3868321154 conn(0x5575755f1860 msgr2=0x557575679190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:24.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.828+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3868321154 shutdown_connections 2024-05-08T09:13:24.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.829+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/3868321154 wait complete. 2024-05-08T09:13:24.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.829+0000 7f3f7e76eb80 1 -- start start 2024-05-08T09:13:24.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.830+0000 7f3f7e76eb80 1 Processor -- start 2024-05-08T09:13:24.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.830+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557575679e30 0x55757568bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.830+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 0x557575688b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f7e76eb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757568f840 0x5575756890d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c00d560 con 0x557575679e30 2024-05-08T09:13:24.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c00e9d0 con 0x55757568f840 2024-05-08T09:13:24.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f7e76eb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c00dc30 con 0x55757567fc00 2024-05-08T09:13:24.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f7e76eb80 10 client.0 _ll_register_callbacks cb 0x557575572e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:13:24.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f71400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557575679e30 0x55757568bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f71400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557575679e30 0x55757568bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57030/0 (socket says 172.21.15.70:57030) 2024-05-08T09:13:24.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f71400700 1 -- 172.21.15.70:0/1883751553 learned_addr learned my addr 172.21.15.70:0/1883751553 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:13:24.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f70a00700 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 0x557575688b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.831+0000 7f3f71e00700 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757568f840 0x5575756890d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.832+0000 7f3f71400700 1 -- 172.21.15.70:0/1883751553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 msgr2=0x557575688b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:24.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.832+0000 7f3f71400700 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 0x557575688b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.832+0000 7f3f71400700 1 -- 172.21.15.70:0/1883751553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757568f840 msgr2=0x5575756890d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:13:24.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.832+0000 7f3f71400700 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757568f840 0x5575756890d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:24.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.832+0000 7f3f71400700 1 -- 172.21.15.70:0/1883751553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557575689690 con 0x557575679e30 2024-05-08T09:13:24.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.832+0000 7f3f70a00700 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 0x557575688b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:13:24.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.832+0000 7f3f71400700 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557575679e30 0x55757568bea0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000c2d0 tx=0x7f3f600e2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d494715068e85d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:13:24.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.832+0000 7f3f53400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:13:24.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.834+0000 7f3f53400700 1 -- 172.21.15.70:0/1883751553 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f600a99f0 con 0x557575679e30 2024-05-08T09:13:24.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.834+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/1883751553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f64009ca0 con 0x557575679e30 2024-05-08T09:13:24.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.834+0000 7f3f53400700 1 -- 172.21.15.70:0/1883751553 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(370..370 src has 1..370) ==== 9583+0+0 (secure 0 0 0) 0x7f3f600cc0b0 con 0x557575679e30 2024-05-08T09:13:24.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.834+0000 7f3f53400700 1 -- 172.21.15.70:0/1883751553 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3f600adda0 con 0x557575679e30 2024-05-08T09:13:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.834+0000 7f3f7e76eb80 10 client.19248 fetch_fsmap learned FSMap version 42 2024-05-08T09:13:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.834+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/1883751553 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5575756fe9a0 con 0x557575679e30 2024-05-08T09:13:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.835+0000 7f3f53400700 1 -- 172.21.15.70:0/1883751553 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f64009ca0 con 0x557575679e30 2024-05-08T09:13:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.835+0000 7f3f53400700 1 -- 172.21.15.70:0/1883751553 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3f600a5360 con 0x557575679e30 2024-05-08T09:13:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.835+0000 7f3f7e76eb80 10 client.19248 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:13:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.835+0000 7f3f7e76eb80 10 client.19248 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:13:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.835+0000 7f3f7e76eb80 20 client.19248 populate_metadata read hostname 'smithi070' 2024-05-08T09:13:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.835+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575756ff0a0 0x5575757014e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:13:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.835+0000 7f3f7e76eb80 4 client.19248 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.3, "await_for": 42.0}] 2024-05-08T09:13:24.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.835+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/1883751553 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.3, "await_for": 42.0}) -- 0x5575755d9590 con 0x5575756ff0a0 2024-05-08T09:13:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.836+0000 7f3f70a00700 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575756ff0a0 0x5575757014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:13:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.838+0000 7f3f53400700 10 client.19248 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:13:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:24.838+0000 7f3f70a00700 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575756ff0a0 0x5575757014e0 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9157fe598a99b300 server_cookie=f4f54210cfb79951 in_seq=0 out_seq=0 2024-05-08T09:13:25.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:25 smithi172 ceph-mon[33377]: pgmap v4684: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 436 KiB/s wr, 28 op/s 2024-05-08T09:13:26.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:25 smithi194 ceph-mon[33679]: pgmap v4684: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 436 KiB/s wr, 28 op/s 2024-05-08T09:13:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:25 smithi070 ceph-mon[29591]: pgmap v4684: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 393 KiB/s rd, 436 KiB/s wr, 28 op/s 2024-05-08T09:13:27.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:27 smithi172 ceph-mon[33377]: pgmap v4685: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 433 KiB/s wr, 25 op/s 2024-05-08T09:13:28.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:27 smithi194 ceph-mon[33679]: pgmap v4685: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 433 KiB/s wr, 25 op/s 2024-05-08T09:13:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:27 smithi070 ceph-mon[29591]: pgmap v4685: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 433 KiB/s wr, 25 op/s 2024-05-08T09:13:29.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:29 smithi172 ceph-mon[33377]: pgmap v4686: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 433 KiB/s wr, 25 op/s 2024-05-08T09:13:30.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:29 smithi194 ceph-mon[33679]: pgmap v4686: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 433 KiB/s wr, 25 op/s 2024-05-08T09:13:30.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:29 smithi070 ceph-mon[29591]: pgmap v4686: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 433 KiB/s wr, 25 op/s 2024-05-08T09:13:31.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:31 smithi172 ceph-mon[33377]: pgmap v4687: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 749 KiB/s wr, 32 op/s 2024-05-08T09:13:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:31 smithi194 ceph-mon[33679]: pgmap v4687: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 749 KiB/s wr, 32 op/s 2024-05-08T09:13:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:31 smithi070 ceph-mon[29591]: pgmap v4687: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 749 KiB/s wr, 32 op/s 2024-05-08T09:13:33.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:33 smithi172 ceph-mon[33377]: pgmap v4688: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 594 KiB/s wr, 24 op/s 2024-05-08T09:13:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:33 smithi194 ceph-mon[33679]: pgmap v4688: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 594 KiB/s wr, 24 op/s 2024-05-08T09:13:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:33 smithi070 ceph-mon[29591]: pgmap v4688: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 594 KiB/s wr, 24 op/s 2024-05-08T09:13:35.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:35 smithi172 ceph-mon[33377]: pgmap v4689: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 647 KiB/s wr, 35 op/s 2024-05-08T09:13:35.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:35 smithi070 ceph-mon[29591]: pgmap v4689: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 647 KiB/s wr, 35 op/s 2024-05-08T09:13:36.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:35 smithi194 ceph-mon[33679]: pgmap v4689: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 621 KiB/s rd, 647 KiB/s wr, 35 op/s 2024-05-08T09:13:37.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:37 smithi070 ceph-mon[29591]: pgmap v4690: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 370 KiB/s wr, 17 op/s 2024-05-08T09:13:37.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:37 smithi172 ceph-mon[33377]: pgmap v4690: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 370 KiB/s wr, 17 op/s 2024-05-08T09:13:38.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:37 smithi194 ceph-mon[33679]: pgmap v4690: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 370 KiB/s wr, 17 op/s 2024-05-08T09:13:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:39 smithi194 ceph-mon[33679]: pgmap v4691: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 370 KiB/s wr, 17 op/s 2024-05-08T09:13:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:39 smithi070 ceph-mon[29591]: pgmap v4691: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 370 KiB/s wr, 17 op/s 2024-05-08T09:13:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:39 smithi172 ceph-mon[33377]: pgmap v4691: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 370 KiB/s wr, 17 op/s 2024-05-08T09:13:42.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:41 smithi194 ceph-mon[33679]: pgmap v4692: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 372 KiB/s wr, 21 op/s 2024-05-08T09:13:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:41 smithi070 ceph-mon[29591]: pgmap v4692: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 372 KiB/s wr, 21 op/s 2024-05-08T09:13:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:41 smithi172 ceph-mon[33377]: pgmap v4692: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 372 KiB/s wr, 21 op/s 2024-05-08T09:13:44.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:43 smithi194 ceph-mon[33679]: pgmap v4693: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 56 KiB/s wr, 14 op/s 2024-05-08T09:13:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:43 smithi070 ceph-mon[29591]: pgmap v4693: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 56 KiB/s wr, 14 op/s 2024-05-08T09:13:44.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:43 smithi172 ceph-mon[33377]: pgmap v4693: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 56 KiB/s wr, 14 op/s 2024-05-08T09:13:46.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:45 smithi194 ceph-mon[33679]: pgmap v4694: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 105 KiB/s wr, 17 op/s 2024-05-08T09:13:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:45 smithi070 ceph-mon[29591]: pgmap v4694: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 105 KiB/s wr, 17 op/s 2024-05-08T09:13:46.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:45 smithi172 ceph-mon[33377]: pgmap v4694: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 105 KiB/s wr, 17 op/s 2024-05-08T09:13:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:47 smithi194 ceph-mon[33679]: pgmap v4695: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-05-08T09:13:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:47 smithi070 ceph-mon[29591]: pgmap v4695: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-05-08T09:13:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:47 smithi172 ceph-mon[33377]: pgmap v4695: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-05-08T09:13:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.582+0000 7f3f53400700 1 -- 172.21.15.70:0/1883751553 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5575755d9590 con 0x5575756ff0a0 2024-05-08T09:13:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.582+0000 7f3f53400700 10 client.19248 handle_command_reply: tid=0 2024-05-08T09:13:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.582+0000 7f3f7e76eb80 1 client.19248 shutdown 2024-05-08T09:13:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.583+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/1883751553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557575679e30 msgr2=0x55757568bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.583+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557575679e30 0x55757568bea0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000c2d0 tx=0x7f3f600e2040 comp rx=0 tx=0).stop 2024-05-08T09:13:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.583+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/1883751553 shutdown_connections 2024-05-08T09:13:48.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.583+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575756ff0a0 0x5575757014e0 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.583+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55757568f840 0x5575756890d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.583+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557575679e30 0x55757568bea0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.583+0000 7f3f7e76eb80 1 --2- 172.21.15.70:0/1883751553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55757567fc00 0x557575688b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.583+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/1883751553 >> 172.21.15.70:0/1883751553 conn(0x5575755f1860 msgr2=0x5575756790b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.583+0000 7f3f53400700 0 client.19248 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:13:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.584+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/1883751553 shutdown_connections 2024-05-08T09:13:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.584+0000 7f3f7e76eb80 1 -- 172.21.15.70:0/1883751553 wait complete. 2024-05-08T09:13:48.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.584+0000 7f3f7e76eb80 20 client.19248 trim_cache size 0 max 16384 2024-05-08T09:13:48.586 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:13:48.586 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:13:48.586 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 326, 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "19743f71": { 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 326, 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.3, 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:13:48.587 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:13:48.588 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:13:48.588 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:13:48.588 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:13:48.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:48.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:48.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:48.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:48.588 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:13:48.588 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 -- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f540b2b20 msgr2=0x7f3f540b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f540b2b20 0x7f3f540b4fe0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009680 tx=0x7f3f58009260 comp rx=0 tx=0).stop 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 -- 172.21.15.70:0/1763503907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c06ec80 msgr2=0x7f3f6c1a85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c06ec80 0x7f3f6c1a85d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3f6000e9a0 tx=0x7f3f6000ecb0 comp rx=0 tx=0).stop 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 -- 172.21.15.70:0/1763503907 shutdown_connections 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f540b2b20 0x7f3f540b4fe0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f6c11cb30 0x7f3f6c1acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6c06ec80 0x7f3f6c1a85d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 --2- 172.21.15.70:0/1763503907 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f6c06f5a0 0x7f3f6c1a8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.586+0000 7f3f72800700 1 -- 172.21.15.70:0/1763503907 >> 172.21.15.70:0/1763503907 conn(0x7f3f6c06e380 msgr2=0x7f3f6c11de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:13:48.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.587+0000 7f3f72800700 1 -- 172.21.15.70:0/1763503907 shutdown_connections 2024-05-08T09:13:48.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:13:48.587+0000 7f3f72800700 1 -- 172.21.15.70:0/1763503907 wait complete. 2024-05-08T09:13:49.546 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '19743f71', quiesce took 32.4 seconds. Will release after: 28.3 2024-05-08T09:13:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:49 smithi194 ceph-mon[33679]: pgmap v4696: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-05-08T09:13:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:49 smithi070 ceph-mon[29591]: pgmap v4696: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-05-08T09:13:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:49 smithi172 ceph-mon[33377]: pgmap v4696: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 51 KiB/s wr, 6 op/s 2024-05-08T09:13:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:51 smithi194 ceph-mon[33679]: pgmap v4697: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 9 op/s 2024-05-08T09:13:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:51 smithi070 ceph-mon[29591]: pgmap v4697: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 9 op/s 2024-05-08T09:13:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:51 smithi172 ceph-mon[33377]: pgmap v4697: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 100 KiB/s wr, 9 op/s 2024-05-08T09:13:54.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:53 smithi194 ceph-mon[33679]: pgmap v4698: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 5 op/s 2024-05-08T09:13:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:53 smithi070 ceph-mon[29591]: pgmap v4698: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 5 op/s 2024-05-08T09:13:54.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:53 smithi172 ceph-mon[33377]: pgmap v4698: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 98 KiB/s wr, 5 op/s 2024-05-08T09:13:56.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:55 smithi194 ceph-mon[33679]: pgmap v4699: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 10 op/s 2024-05-08T09:13:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:55 smithi070 ceph-mon[29591]: pgmap v4699: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 10 op/s 2024-05-08T09:13:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:55 smithi172 ceph-mon[33377]: pgmap v4699: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 150 KiB/s wr, 10 op/s 2024-05-08T09:13:58.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:57 smithi194 ceph-mon[33679]: pgmap v4700: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 7 op/s 2024-05-08T09:13:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:57 smithi070 ceph-mon[29591]: pgmap v4700: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 7 op/s 2024-05-08T09:13:58.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:57 smithi172 ceph-mon[33377]: pgmap v4700: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 7 op/s 2024-05-08T09:14:00.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:13:59 smithi194 ceph-mon[33679]: pgmap v4701: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 7 op/s 2024-05-08T09:14:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:13:59 smithi070 ceph-mon[29591]: pgmap v4701: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 7 op/s 2024-05-08T09:14:00.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:13:59 smithi172 ceph-mon[33377]: pgmap v4701: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 101 KiB/s wr, 7 op/s 2024-05-08T09:14:02.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:01 smithi194 ceph-mon[33679]: pgmap v4702: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 10 op/s 2024-05-08T09:14:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:01 smithi070 ceph-mon[29591]: pgmap v4702: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 10 op/s 2024-05-08T09:14:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:01 smithi172 ceph-mon[33377]: pgmap v4702: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 103 KiB/s wr, 10 op/s 2024-05-08T09:14:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:03 smithi194 ceph-mon[33679]: pgmap v4703: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2024-05-08T09:14:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:03 smithi070 ceph-mon[29591]: pgmap v4703: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2024-05-08T09:14:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:03 smithi172 ceph-mon[33377]: pgmap v4703: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 7 op/s 2024-05-08T09:14:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:05 smithi070 ceph-mon[29591]: pgmap v4704: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 99 KiB/s wr, 26 op/s 2024-05-08T09:14:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:05 smithi172 ceph-mon[33377]: pgmap v4704: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 99 KiB/s wr, 26 op/s 2024-05-08T09:14:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:05 smithi194 ceph-mon[33679]: pgmap v4704: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 99 KiB/s wr, 26 op/s 2024-05-08T09:14:07.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:06 smithi070 ceph-mon[29591]: pgmap v4705: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 22 op/s 2024-05-08T09:14:07.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:06 smithi172 ceph-mon[33377]: pgmap v4705: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 22 op/s 2024-05-08T09:14:07.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:06 smithi194 ceph-mon[33679]: pgmap v4705: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 47 KiB/s wr, 22 op/s 2024-05-08T09:14:09.064 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:08 smithi194 ceph-mon[33679]: osdmap e371: 12 total, 12 up, 12 in 2024-05-08T09:14:09.064 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:08 smithi194 ceph-mon[33679]: pgmap v4707: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 56 KiB/s wr, 26 op/s 2024-05-08T09:14:09.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:08 smithi070 ceph-mon[29591]: osdmap e371: 12 total, 12 up, 12 in 2024-05-08T09:14:09.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:08 smithi070 ceph-mon[29591]: pgmap v4707: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 56 KiB/s wr, 26 op/s 2024-05-08T09:14:09.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:08 smithi172 ceph-mon[33377]: osdmap e371: 12 total, 12 up, 12 in 2024-05-08T09:14:09.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:08 smithi172 ceph-mon[33377]: pgmap v4707: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 56 KiB/s wr, 26 op/s 2024-05-08T09:14:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:11 smithi070 ceph-mon[29591]: pgmap v4708: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:14:11.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:11 smithi070 ceph-mon[29591]: osdmap e372: 12 total, 12 up, 12 in 2024-05-08T09:14:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:11 smithi172 ceph-mon[33377]: pgmap v4708: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:14:11.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:11 smithi172 ceph-mon[33377]: osdmap e372: 12 total, 12 up, 12 in 2024-05-08T09:14:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:11 smithi194 ceph-mon[33679]: pgmap v4708: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:14:12.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:11 smithi194 ceph-mon[33679]: osdmap e372: 12 total, 12 up, 12 in 2024-05-08T09:14:13.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:13 smithi070 ceph-mon[29591]: pgmap v4710: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T09:14:13.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:14:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:13 smithi172 ceph-mon[33377]: pgmap v4710: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T09:14:13.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:14:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:13 smithi194 ceph-mon[33679]: pgmap v4710: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T09:14:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:14:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:15 smithi070 ceph-mon[29591]: pgmap v4711: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T09:14:15.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:15 smithi172 ceph-mon[33377]: pgmap v4711: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T09:14:15.983 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:15 smithi194 ceph-mon[33679]: pgmap v4711: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T09:14:17.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:17 smithi194 ceph-mon[33679]: pgmap v4712: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 349 B/s wr, 7 op/s 2024-05-08T09:14:17.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:14:17.926 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:17 smithi070 ceph-mon[29591]: pgmap v4712: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 349 B/s wr, 7 op/s 2024-05-08T09:14:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:17 smithi172 ceph-mon[33377]: pgmap v4712: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 349 B/s wr, 7 op/s 2024-05-08T09:14:18.297 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:14:19.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:19 smithi070 ceph-mon[29591]: pgmap v4713: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:14:19.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:19 smithi172 ceph-mon[33377]: pgmap v4713: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:14:20.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:19 smithi194 ceph-mon[33679]: pgmap v4713: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:14:20.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.905+0000 7fa35d000700 1 -- 172.21.15.70:0/525849068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103550 msgr2=0x7fa3581039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:20.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.905+0000 7fa35d000700 1 --2- 172.21.15.70:0/525849068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103550 0x7fa3581039b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fa344009990 tx=0x7fa344009ca0 comp rx=0 tx=0).stop 2024-05-08T09:14:20.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.905+0000 7fa35d000700 1 -- 172.21.15.70:0/525849068 shutdown_connections 2024-05-08T09:14:20.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.905+0000 7fa35d000700 1 --2- 172.21.15.70:0/525849068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa358103ef0 0x7fa3581103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:20.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.905+0000 7fa35d000700 1 --2- 172.21.15.70:0/525849068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa358108460 0x7fa358108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:20.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.905+0000 7fa35d000700 1 --2- 172.21.15.70:0/525849068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103550 0x7fa3581039b0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:20.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.905+0000 7fa35d000700 1 -- 172.21.15.70:0/525849068 >> 172.21.15.70:0/525849068 conn(0x7fa35807a600 msgr2=0x7fa35807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:14:20.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.905+0000 7fa35d000700 1 -- 172.21.15.70:0/525849068 shutdown_connections 2024-05-08T09:14:20.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.905+0000 7fa35d000700 1 -- 172.21.15.70:0/525849068 wait complete. 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.907+0000 7fa35d000700 1 Processor -- start 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.907+0000 7fa35d000700 1 -- start start 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.907+0000 7fa35d000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa358103550 0x7fa35819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.907+0000 7fa35d000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103ef0 0x7fa35819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.907+0000 7fa35d000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa358108460 0x7fa3581a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.907+0000 7fa35d000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa3581136b0 con 0x7fa358103ef0 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.907+0000 7fa35d000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa358113530 con 0x7fa358108460 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.907+0000 7fa35d000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa358113830 con 0x7fa358103550 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103ef0 0x7fa35819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:20.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103ef0 0x7fa35819c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52454/0 (socket says 172.21.15.70:52454) 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355400700 1 -- 172.21.15.70:0/2020540081 learned_addr learned my addr 172.21.15.70:0/2020540081 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa356800700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa358108460 0x7fa3581a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355400700 1 -- 172.21.15.70:0/2020540081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa358103550 msgr2=0x7fa35819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355e00700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa358103550 0x7fa35819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355400700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa358103550 0x7fa35819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355400700 1 -- 172.21.15.70:0/2020540081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa358108460 msgr2=0x7fa3581a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355400700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa358108460 0x7fa3581a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355400700 1 -- 172.21.15.70:0/2020540081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3581a0e70 con 0x7fa358103ef0 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.908+0000 7fa355e00700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa358103550 0x7fa35819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.909+0000 7fa355400700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103ef0 0x7fa35819c3a0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fa344005910 tx=0x7fa344009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.909+0000 7fa34ea00700 1 -- 172.21.15.70:0/2020540081 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa344027070 con 0x7fa358103ef0 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.909+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3581a1100 con 0x7fa358103ef0 2024-05-08T09:14:20.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.909+0000 7fa34ea00700 1 -- 172.21.15.70:0/2020540081 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa34400fce0 con 0x7fa358103ef0 2024-05-08T09:14:20.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.909+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3581a89e0 con 0x7fa358103ef0 2024-05-08T09:14:20.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.909+0000 7fa34ea00700 1 -- 172.21.15.70:0/2020540081 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa344022e40 con 0x7fa358103ef0 2024-05-08T09:14:20.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.910+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa35806a190 con 0x7fa358103ef0 2024-05-08T09:14:20.915 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.914+0000 7fa34ea00700 1 -- 172.21.15.70:0/2020540081 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa34402a070 con 0x7fa358103ef0 2024-05-08T09:14:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.916+0000 7fa34ea00700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa33c0b29f0 0x7fa33c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.916+0000 7fa34ea00700 1 -- 172.21.15.70:0/2020540081 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(372..372 src has 1..372) ==== 9583+0+0 (secure 0 0 0) 0x7fa3440e3bc0 con 0x7fa358103ef0 2024-05-08T09:14:20.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.916+0000 7fa355e00700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa33c0b29f0 0x7fa33c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:20.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.917+0000 7fa355e00700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa33c0b29f0 0x7fa33c0b4eb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa358104730 tx=0x7fa348008040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:14:20.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:20.918+0000 7fa34ea00700 1 -- 172.21.15.70:0/2020540081 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa344032080 con 0x7fa358103ef0 2024-05-08T09:14:21.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.205+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa35819d1c0 con 0x7fa358103ef0 2024-05-08T09:14:21.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.206+0000 7fa34ea00700 1 -- 172.21.15.70:0/2020540081 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fa344013070 con 0x7fa358103ef0 2024-05-08T09:14:21.207 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:14:21.207 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:14:21.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa33c0b29f0 msgr2=0x7fa33c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:21.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa33c0b29f0 0x7fa33c0b4eb0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa358104730 tx=0x7fa348008040 comp rx=0 tx=0).stop 2024-05-08T09:14:21.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103ef0 msgr2=0x7fa35819c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:21.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103ef0 0x7fa35819c3a0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fa344005910 tx=0x7fa344009f90 comp rx=0 tx=0).stop 2024-05-08T09:14:21.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 shutdown_connections 2024-05-08T09:14:21.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa33c0b29f0 0x7fa33c0b4eb0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:21.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa358108460 0x7fa3581a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:21.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa358103550 0x7fa35819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:21.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 --2- 172.21.15.70:0/2020540081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa358103ef0 0x7fa35819c3a0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:21.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 >> 172.21.15.70:0/2020540081 conn(0x7fa35807a600 msgr2=0x7fa3581013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:14:21.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 shutdown_connections 2024-05-08T09:14:21.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:21.210+0000 7fa35d000700 1 -- 172.21.15.70:0/2020540081 wait complete. 2024-05-08T09:14:21.212 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:14:21.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:14:21.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:14:21.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:14:21.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:14:21.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:14:21.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:21 smithi194 ceph-mon[33679]: pgmap v4714: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:14:21.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:21 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2020540081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:14:21.542 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:14:21.542 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:14:21.542 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:14:21.542 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:14:21.542 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:14:21.542 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:21 smithi070 ceph-mon[29591]: pgmap v4714: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:14:21.542 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:21 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2020540081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:14:21.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:14:21.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:14:21.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:14:21.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:14:21.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:14:21.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:21 smithi172 ceph-mon[33377]: pgmap v4714: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:14:21.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:21 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2020540081' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:14:22.672 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 19743f71 --release --await' 2024-05-08T09:14:22.672 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 19743f71 --release --await 2024-05-08T09:14:23.095 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:14:23.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:23 smithi070 ceph-mon[29591]: pgmap v4715: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 182 B/s wr, 5 op/s 2024-05-08T09:14:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:23 smithi172 ceph-mon[33377]: pgmap v4715: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 182 B/s wr, 5 op/s 2024-05-08T09:14:24.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:23 smithi194 ceph-mon[33679]: pgmap v4715: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 182 B/s wr, 5 op/s 2024-05-08T09:14:25.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.293+0000 7fc285e00700 1 -- 172.21.15.70:0/1404498891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 msgr2=0x7fc2801099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:25.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.293+0000 7fc285e00700 1 --2- 172.21.15.70:0/1404498891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 0x7fc2801099b0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fc2700099c0 tx=0x7fc270009cd0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.294+0000 7fc285e00700 1 -- 172.21.15.70:0/1404498891 shutdown_connections 2024-05-08T09:14:25.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.294+0000 7fc285e00700 1 --2- 172.21.15.70:0/1404498891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc280103f10 0x7fc2801103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.294+0000 7fc285e00700 1 --2- 172.21.15.70:0/1404498891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 0x7fc2801099b0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.294+0000 7fc285e00700 1 --2- 172.21.15.70:0/1404498891 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc280103550 0x7fc2801039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.294+0000 7fc285e00700 1 -- 172.21.15.70:0/1404498891 >> 172.21.15.70:0/1404498891 conn(0x7fc28007a5f0 msgr2=0x7fc28007aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:14:25.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.294+0000 7fc285e00700 1 -- 172.21.15.70:0/1404498891 shutdown_connections 2024-05-08T09:14:25.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.294+0000 7fc285e00700 1 -- 172.21.15.70:0/1404498891 wait complete. 2024-05-08T09:14:25.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.295+0000 7fc285e00700 1 Processor -- start 2024-05-08T09:14:25.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.295+0000 7fc285e00700 1 -- start start 2024-05-08T09:14:25.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.296+0000 7fc285e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc280103550 0x7fc2801a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.296+0000 7fc285e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc280103f10 0x7fc2801a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.296+0000 7fc285e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 0x7fc28019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.296+0000 7fc285e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc280113630 con 0x7fc2801095d0 2024-05-08T09:14:25.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.296+0000 7fc285e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801134b0 con 0x7fc280103f10 2024-05-08T09:14:25.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.296+0000 7fc285e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801137b0 con 0x7fc280103550 2024-05-08T09:14:25.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.296+0000 7fc27f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 0x7fc28019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.296+0000 7fc27f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 0x7fc28019bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52460/0 (socket says 172.21.15.70:52460) 2024-05-08T09:14:25.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.296+0000 7fc27f400700 1 -- 172.21.15.70:0/1391105678 learned_addr learned my addr 172.21.15.70:0/1391105678 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:14:25.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc27ea00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc280103550 0x7fc2801a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc276000700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc280103f10 0x7fc2801a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc27f400700 1 -- 172.21.15.70:0/1391105678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc280103550 msgr2=0x7fc2801a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:25.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc27f400700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc280103550 0x7fc2801a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc27f400700 1 -- 172.21.15.70:0/1391105678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc280103f10 msgr2=0x7fc2801a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:25.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc27f400700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc280103f10 0x7fc2801a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc27f400700 1 -- 172.21.15.70:0/1391105678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28019c230 con 0x7fc2801095d0 2024-05-08T09:14:25.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc276000700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc280103f10 0x7fc2801a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:14:25.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc27f400700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 0x7fc28019bad0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc27800b970 tx=0x7fc27800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:14:25.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc284a00700 1 -- 172.21.15.70:0/1391105678 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278019070 con 0x7fc2801095d0 2024-05-08T09:14:25.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc284a00700 1 -- 172.21.15.70:0/1391105678 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc27800ce40 con 0x7fc2801095d0 2024-05-08T09:14:25.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.297+0000 7fc285e00700 1 -- 172.21.15.70:0/1391105678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc28019c520 con 0x7fc2801095d0 2024-05-08T09:14:25.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.298+0000 7fc284a00700 1 -- 172.21.15.70:0/1391105678 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc278007370 con 0x7fc2801095d0 2024-05-08T09:14:25.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.298+0000 7fc285e00700 1 -- 172.21.15.70:0/1391105678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2801a87e0 con 0x7fc2801095d0 2024-05-08T09:14:25.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.301+0000 7fc284a00700 1 -- 172.21.15.70:0/1391105678 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc27801c070 con 0x7fc2801095d0 2024-05-08T09:14:25.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.302+0000 7fc284a00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2640b29f0 0x7fc2640b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.303+0000 7fc284a00700 1 -- 172.21.15.70:0/1391105678 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(372..372 src has 1..372) ==== 9583+0+0 (secure 0 0 0) 0x7fc2780e1ff0 con 0x7fc2801095d0 2024-05-08T09:14:25.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.303+0000 7fc27ea00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2640b29f0 0x7fc2640b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.303+0000 7fc27ea00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2640b29f0 0x7fc2640b4eb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc270000c00 tx=0x7fc27001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:14:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.321+0000 7fc2907a2b80 1 Processor -- start 2024-05-08T09:14:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.321+0000 7fc2907a2b80 1 -- start start 2024-05-08T09:14:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.321+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83dcb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.321+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5490 0x559b83dc5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.321+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5e50 0x559b83dd1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.321+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559b83d17b20 con 0x559b83dcaec0 2024-05-08T09:14:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.321+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559b83cb5860 con 0x559b83dc5e50 2024-05-08T09:14:25.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.321+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559b83d13ae0 con 0x559b83dc5490 2024-05-08T09:14:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc27ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83dcb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc27ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83dcb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52462/0 (socket says 172.21.15.70:52462) 2024-05-08T09:14:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc27ea00700 1 -- 172.21.15.70:0/2992324501 learned_addr learned my addr 172.21.15.70:0/2992324501 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:14:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc276000700 1 --2- 172.21.15.70:0/2992324501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5490 0x559b83dc5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc27f400700 1 --2- 172.21.15.70:0/2992324501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5e50 0x559b83dd1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc27ea00700 1 -- 172.21.15.70:0/2992324501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5490 msgr2=0x559b83dc5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:14:25.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc27ea00700 1 --2- 172.21.15.70:0/2992324501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5490 0x559b83dc5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc27ea00700 1 -- 172.21.15.70:0/2992324501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5e50 msgr2=0x559b83dd1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:14:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc27ea00700 1 --2- 172.21.15.70:0/2992324501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5e50 0x559b83dd1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.322+0000 7fc27ea00700 1 -- 172.21.15.70:0/2992324501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b83c649d0 con 0x559b83dcaec0 2024-05-08T09:14:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.323+0000 7fc27ea00700 1 --2- 172.21.15.70:0/2992324501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83dcb2a0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc2700099c0 tx=0x7fc27001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d99066b9c8cce4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:14:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.323+0000 7fc274c00700 1 -- 172.21.15.70:0/2992324501 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270004690 con 0x559b83dcaec0 2024-05-08T09:14:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.323+0000 7fc274c00700 1 -- 172.21.15.70:0/2992324501 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc270004cc0 con 0x559b83dcaec0 2024-05-08T09:14:25.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.323+0000 7fc274c00700 1 -- 172.21.15.70:0/2992324501 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27000fc30 con 0x559b83dcaec0 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.324+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2992324501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 msgr2=0x559b83dcb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.324+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2992324501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83dcb2a0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc2700099c0 tx=0x7fc27001e000 comp rx=0 tx=0).stop 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.324+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2992324501 shutdown_connections 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.324+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2992324501 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5e50 0x559b83dd1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.324+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2992324501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83dcb2a0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.324+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2992324501 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5490 0x559b83dc5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.324+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2992324501 >> 172.21.15.70:0/2992324501 conn(0x559b83cf3c60 msgr2=0x559b83dbfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.324+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2992324501 shutdown_connections 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.324+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2992324501 wait complete. 2024-05-08T09:14:25.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.325+0000 7fc2907a2b80 1 -- start start 2024-05-08T09:14:25.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.325+0000 7fc2907a2b80 1 Processor -- start 2024-05-08T09:14:25.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.325+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dd1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.325+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dcec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.325+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 0x559b83dcf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.325+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559b83dd2220 con 0x559b83dc5e50 2024-05-08T09:14:25.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.325+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559b83c7dc20 con 0x559b83dc5490 2024-05-08T09:14:25.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.325+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559b83dd23a0 con 0x559b83dcaec0 2024-05-08T09:14:25.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc2907a2b80 10 client.0 _ll_register_callbacks cb 0x559b83cbed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:14:25.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc276000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dcec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc276000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dcec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52468/0 (socket says 172.21.15.70:52468) 2024-05-08T09:14:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc276000700 1 -- 172.21.15.70:0/2960388858 learned_addr learned my addr 172.21.15.70:0/2960388858 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:14:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc27f400700 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 0x559b83dcf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc27ea00700 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dd1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc276000700 1 -- 172.21.15.70:0/2960388858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 msgr2=0x559b83dcf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:14:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc276000700 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 0x559b83dcf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc276000700 1 -- 172.21.15.70:0/2960388858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 msgr2=0x559b83dd1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:14:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc276000700 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dd1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.326+0000 7fc276000700 1 -- 172.21.15.70:0/2960388858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b83cdd520 con 0x559b83dc5e50 2024-05-08T09:14:25.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.327+0000 7fc27f400700 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 0x559b83dcf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:14:25.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.327+0000 7fc276000700 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dcec00 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc268010860 tx=0x7fc268010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f18f234412848d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:14:25.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.327+0000 7fc26d600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:14:25.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.327+0000 7fc26d600700 1 -- 172.21.15.70:0/2960388858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26801e060 con 0x559b83dc5e50 2024-05-08T09:14:25.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.327+0000 7fc26d600700 1 -- 172.21.15.70:0/2960388858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(372..372 src has 1..372) ==== 9583+0+0 (secure 0 0 0) 0x7fc26800ec50 con 0x559b83dc5e50 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.327+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2960388858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc270004cc0 con 0x559b83dc5e50 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc26d600700 1 -- 172.21.15.70:0/2960388858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc268025050 con 0x559b83dc5e50 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc2907a2b80 10 client.19266 fetch_fsmap learned FSMap version 42 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2960388858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559b83ddca90 con 0x559b83dc5e50 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc26d600700 1 -- 172.21.15.70:0/2960388858 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc270004cc0 con 0x559b83dc5e50 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc26d600700 1 -- 172.21.15.70:0/2960388858 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fc268017340 con 0x559b83dc5e50 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc2907a2b80 10 client.19266 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc2907a2b80 10 client.19266 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc2907a2b80 20 client.19266 populate_metadata read hostname 'smithi070' 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559b83ddf120 0x559b83de1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc2907a2b80 4 client.19266 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.328+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2960388858 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b83d921a0 con 0x559b83ddf120 2024-05-08T09:14:25.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.329+0000 7fc27ea00700 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559b83ddf120 0x559b83de1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.330+0000 7fc27ea00700 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559b83ddf120 0x559b83de1510 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c072d744655d5b8c server_cookie=d379160b974bab3b in_seq=0 out_seq=0 2024-05-08T09:14:25.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.330+0000 7fc26d600700 10 client.19266 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:14:25.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.332+0000 7fc26d600700 1 -- 172.21.15.70:0/2960388858 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559b83d921a0 con 0x559b83ddf120 2024-05-08T09:14:25.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.332+0000 7fc26d600700 10 client.19266 handle_command_reply: tid=0 2024-05-08T09:14:25.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.332+0000 7fc2907a2b80 1 client.19266 shutdown 2024-05-08T09:14:25.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.332+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2960388858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 msgr2=0x559b83dcec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:25.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.332+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dcec00 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fc268010860 tx=0x7fc268010c20 comp rx=0 tx=0).stop 2024-05-08T09:14:25.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2960388858 shutdown_connections 2024-05-08T09:14:25.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559b83ddf120 0x559b83de1510 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 0x559b83dcf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dd1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/2960388858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dcec00 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2960388858 >> 172.21.15.70:0/2960388858 conn(0x559b83cf3c60 msgr2=0x559b83dba850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:14:25.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc26d600700 0 client.19266 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:14:25.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2960388858 shutdown_connections 2024-05-08T09:14:25.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc2907a2b80 1 -- 172.21.15.70:0/2960388858 wait complete. 2024-05-08T09:14:25.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.333+0000 7fc2907a2b80 20 client.19266 trim_cache size 0 max 16384 2024-05-08T09:14:25.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.355+0000 7fc2907a2b80 1 Processor -- start 2024-05-08T09:14:25.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.355+0000 7fc2907a2b80 1 -- start start 2024-05-08T09:14:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dcded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5e50 0x559b83ddb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83db9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801b40b0 con 0x559b83dcaec0 2024-05-08T09:14:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801b1940 con 0x559b83dc5490 2024-05-08T09:14:25.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801af7b0 con 0x559b83dc5e50 2024-05-08T09:14:25.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc27f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83db9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc27f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83db9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52474/0 (socket says 172.21.15.70:52474) 2024-05-08T09:14:25.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc27f400700 1 -- 172.21.15.70:0/3350112994 learned_addr learned my addr 172.21.15.70:0/3350112994 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:14:25.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc276000700 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5e50 0x559b83ddb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.356+0000 7fc27ea00700 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dcded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc27f400700 1 -- 172.21.15.70:0/3350112994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5e50 msgr2=0x559b83ddb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc27f400700 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5e50 0x559b83ddb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc27f400700 1 -- 172.21.15.70:0/3350112994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 msgr2=0x559b83dcded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc27f400700 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dcded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc27f400700 1 -- 172.21.15.70:0/3350112994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b83dbc5a0 con 0x559b83dcaec0 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc27ea00700 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dcded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc27f400700 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83db9fc0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc2780a61f0 tx=0x7fc2780a8b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc73666e27033c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc26fe00700 1 -- 172.21.15.70:0/3350112994 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2780ad330 con 0x559b83dcaec0 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc26fe00700 1 -- 172.21.15.70:0/3350112994 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2780b1de0 con 0x559b83dcaec0 2024-05-08T09:14:25.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.357+0000 7fc26fe00700 1 -- 172.21.15.70:0/3350112994 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2780b1bb0 con 0x559b83dcaec0 2024-05-08T09:14:25.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.358+0000 7fc2907a2b80 1 -- 172.21.15.70:0/3350112994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 msgr2=0x559b83db9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:25.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.358+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83db9fc0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fc2780a61f0 tx=0x7fc2780a8b60 comp rx=0 tx=0).stop 2024-05-08T09:14:25.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.358+0000 7fc2907a2b80 1 -- 172.21.15.70:0/3350112994 shutdown_connections 2024-05-08T09:14:25.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.358+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dcaec0 0x559b83db9fc0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.358+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dcded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.358+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/3350112994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dc5e50 0x559b83ddb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.358+0000 7fc2907a2b80 1 -- 172.21.15.70:0/3350112994 >> 172.21.15.70:0/3350112994 conn(0x559b83cf3c60 msgr2=0x559b83dc4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:14:25.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.358+0000 7fc2907a2b80 1 -- 172.21.15.70:0/3350112994 shutdown_connections 2024-05-08T09:14:25.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.358+0000 7fc2907a2b80 1 -- 172.21.15.70:0/3350112994 wait complete. 2024-05-08T09:14:25.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.359+0000 7fc2907a2b80 1 -- start start 2024-05-08T09:14:25.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.359+0000 7fc2907a2b80 1 Processor -- start 2024-05-08T09:14:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dd7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dd4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc2907a2b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 0x559b83dd4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801afe00 con 0x559b83dc5e50 2024-05-08T09:14:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801b1270 con 0x559b83dc5490 2024-05-08T09:14:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc2907a2b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc2801b04d0 con 0x559b83dcaec0 2024-05-08T09:14:25.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc2907a2b80 10 client.0 _ll_register_callbacks cb 0x559b83cbed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc276000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dd4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc276000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dd4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52486/0 (socket says 172.21.15.70:52486) 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc276000700 1 -- 172.21.15.70:0/330440946 learned_addr learned my addr 172.21.15.70:0/330440946 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc27f400700 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 0x559b83dd4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc27ea00700 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dd7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.360+0000 7fc276000700 1 -- 172.21.15.70:0/330440946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 msgr2=0x559b83dd4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc276000700 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 0x559b83dd4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc276000700 1 -- 172.21.15.70:0/330440946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 msgr2=0x559b83dd7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc276000700 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dd7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc276000700 1 -- 172.21.15.70:0/330440946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b83dd5430 con 0x559b83dc5e50 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc27ea00700 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dd7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc276000700 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dd4630 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc268000c00 tx=0x7fc268010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4782ba5092ad06 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:14:25.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc26d600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc26d600700 1 -- 172.21.15.70:0/330440946 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26800ee60 con 0x559b83dc5e50 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc26d600700 1 -- 172.21.15.70:0/330440946 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(372..372 src has 1..372) ==== 9583+0+0 (secure 0 0 0) 0x7fc268017980 con 0x559b83dc5e50 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.361+0000 7fc2907a2b80 1 -- 172.21.15.70:0/330440946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2780b1de0 con 0x559b83dc5e50 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc26d600700 1 -- 172.21.15.70:0/330440946 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fc268039050 con 0x559b83dc5e50 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc2907a2b80 10 client.19272 fetch_fsmap learned FSMap version 42 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc2907a2b80 1 -- 172.21.15.70:0/330440946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559b83e53330 con 0x559b83dc5e50 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc26d600700 1 -- 172.21.15.70:0/330440946 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2780b1de0 con 0x559b83dc5e50 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc26d600700 1 -- 172.21.15.70:0/330440946 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fc2680046f0 con 0x559b83dc5e50 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc2907a2b80 10 client.19272 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc2907a2b80 10 client.19272 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:14:25.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc2907a2b80 20 client.19272 populate_metadata read hostname 'smithi070' 2024-05-08T09:14:25.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559b83e53a10 0x559b83e55e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:14:25.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc2907a2b80 4 client.19272 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "19743f71", "release": true, "await": true}] 2024-05-08T09:14:25.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.362+0000 7fc2907a2b80 1 -- 172.21.15.70:0/330440946 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "19743f71", "release": true, "await": true}) -- 0x559b83d25500 con 0x559b83e53a10 2024-05-08T09:14:25.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.363+0000 7fc27ea00700 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559b83e53a10 0x559b83e55e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:14:25.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.364+0000 7fc27ea00700 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559b83e53a10 0x559b83e55e30 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6096d2661944aece server_cookie=720c8f3564eb8332 in_seq=0 out_seq=0 2024-05-08T09:14:25.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:25.364+0000 7fc26d600700 10 client.19272 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:14:25.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:25 smithi070 ceph-mon[29591]: pgmap v4716: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T09:14:25.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:25 smithi172 ceph-mon[33377]: pgmap v4716: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T09:14:26.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:25 smithi194 ceph-mon[33679]: pgmap v4716: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T09:14:27.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:27 smithi172 ceph-mon[33377]: pgmap v4717: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:14:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:27 smithi194 ceph-mon[33679]: pgmap v4717: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:14:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:27 smithi070 ceph-mon[29591]: pgmap v4717: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:14:29.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:29 smithi172 ceph-mon[33377]: pgmap v4718: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:14:30.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:29 smithi194 ceph-mon[33679]: pgmap v4718: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:14:30.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:29 smithi070 ceph-mon[29591]: pgmap v4718: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:14:30.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.410+0000 7fc26d600700 1 -- 172.21.15.70:0/330440946 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x559b83d25500 con 0x559b83e53a10 2024-05-08T09:14:30.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.410+0000 7fc26d600700 10 client.19272 handle_command_reply: tid=0 2024-05-08T09:14:30.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.410+0000 7fc2907a2b80 1 client.19272 shutdown 2024-05-08T09:14:30.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.411+0000 7fc2907a2b80 1 -- 172.21.15.70:0/330440946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 msgr2=0x559b83dd4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:30.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.411+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dd4630 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fc268000c00 tx=0x7fc268010f10 comp rx=0 tx=0).stop 2024-05-08T09:14:30.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.411+0000 7fc2907a2b80 1 -- 172.21.15.70:0/330440946 shutdown_connections 2024-05-08T09:14:30.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.411+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559b83e53a10 0x559b83e55e30 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:30.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.411+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559b83dcaec0 0x559b83dd4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:30.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.411+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559b83dc5490 0x559b83dd7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:30.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.411+0000 7fc2907a2b80 1 --2- 172.21.15.70:0/330440946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559b83dc5e50 0x559b83dd4630 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:30.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.411+0000 7fc2907a2b80 1 -- 172.21.15.70:0/330440946 >> 172.21.15.70:0/330440946 conn(0x559b83cf3c60 msgr2=0x559b83dc8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:14:30.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.411+0000 7fc26d600700 0 client.19272 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:14:30.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.412+0000 7fc2907a2b80 1 -- 172.21.15.70:0/330440946 shutdown_connections 2024-05-08T09:14:30.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.412+0000 7fc2907a2b80 1 -- 172.21.15.70:0/330440946 wait complete. 2024-05-08T09:14:30.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.412+0000 7fc2907a2b80 20 client.19272 trim_cache size 0 max 16384 2024-05-08T09:14:30.413 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:14:30.413 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:14:30.413 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:14:30.413 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 328, 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "19743f71": { 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 328, 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.3, 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:14:30.414 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:14:30.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:14:30.415 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:14:30.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:14:30.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:14:30.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:14:30.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:14:30.415 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:14:30.415 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 -- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2640b29f0 msgr2=0x7fc2640b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2640b29f0 0x7fc2640b4eb0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fc270000c00 tx=0x7fc27001a040 comp rx=0 tx=0).stop 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 -- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 msgr2=0x7fc28019bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 0x7fc28019bad0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fc27800b970 tx=0x7fc27800bd30 comp rx=0 tx=0).stop 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 -- 172.21.15.70:0/1391105678 shutdown_connections 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2640b29f0 0x7fc2640b4eb0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc2801095d0 0x7fc28019bad0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc280103550 0x7fc2801a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 --2- 172.21.15.70:0/1391105678 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc280103f10 0x7fc2801a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 -- 172.21.15.70:0/1391105678 >> 172.21.15.70:0/1391105678 conn(0x7fc28007a5f0 msgr2=0x7fc28010e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:14:30.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 -- 172.21.15.70:0/1391105678 shutdown_connections 2024-05-08T09:14:30.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:14:30.414+0000 7fc285e00700 1 -- 172.21.15.70:0/1391105678 wait complete. 2024-05-08T09:14:30.774 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/leds/built-in.a 2024-05-08T09:14:31.006 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-io.o 2024-05-08T09:14:31.402 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '19743f71', seconds elapsed: 74.3 2024-05-08T09:14:31.926 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/arm_ffa/built-in.a 2024-05-08T09:14:31.931 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:31 smithi172 ceph-mon[33377]: pgmap v4719: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-05-08T09:14:32.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:31 smithi194 ceph-mon[33679]: pgmap v4719: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-05-08T09:14:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:31 smithi070 ceph-mon[29591]: pgmap v4719: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-05-08T09:14:32.151 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/arm_scmi/built-in.a 2024-05-08T09:14:32.370 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/broadcom/built-in.a 2024-05-08T09:14:32.571 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/cirrus/built-in.a 2024-05-08T09:14:32.807 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/meson/built-in.a 2024-05-08T09:14:33.483 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/efi-bgrt.o 2024-05-08T09:14:33.556 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/efi.o 2024-05-08T09:14:33.804 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/vars.o 2024-05-08T09:14:33.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:33 smithi172 ceph-mon[33377]: pgmap v4720: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-05-08T09:14:33.999 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/efi-stub-helper.o 2024-05-08T09:14:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:33 smithi194 ceph-mon[33679]: pgmap v4720: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-05-08T09:14:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:33 smithi070 ceph-mon[29591]: pgmap v4720: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-05-08T09:14:34.202 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/reboot.o 2024-05-08T09:14:34.372 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/gop.o 2024-05-08T09:14:34.969 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_dmabuf.o 2024-05-08T09:14:35.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:35 smithi172 ceph-mon[33377]: pgmap v4721: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 358 KiB/s wr, 19 op/s 2024-05-08T09:14:35.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:35 smithi070 ceph-mon[29591]: pgmap v4721: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 358 KiB/s wr, 19 op/s 2024-05-08T09:14:36.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:35 smithi194 ceph-mon[33679]: pgmap v4721: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 251 KiB/s rd, 358 KiB/s wr, 19 op/s 2024-05-08T09:14:37.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:37 smithi070 ceph-mon[29591]: pgmap v4722: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 358 KiB/s wr, 16 op/s 2024-05-08T09:14:37.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:37 smithi172 ceph-mon[33377]: pgmap v4722: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 358 KiB/s wr, 16 op/s 2024-05-08T09:14:38.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:37 smithi194 ceph-mon[33679]: pgmap v4722: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 358 KiB/s wr, 16 op/s 2024-05-08T09:14:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:39 smithi172 ceph-mon[33377]: pgmap v4723: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 358 KiB/s wr, 16 op/s 2024-05-08T09:14:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:39 smithi194 ceph-mon[33679]: pgmap v4723: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 358 KiB/s wr, 16 op/s 2024-05-08T09:14:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:39 smithi070 ceph-mon[29591]: pgmap v4723: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 358 KiB/s wr, 16 op/s 2024-05-08T09:14:41.013 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-kcopyd.o 2024-05-08T09:14:41.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:41 smithi172 ceph-mon[33377]: pgmap v4724: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 574 KiB/s wr, 27 op/s 2024-05-08T09:14:42.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:41 smithi194 ceph-mon[33679]: pgmap v4724: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 574 KiB/s wr, 27 op/s 2024-05-08T09:14:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:41 smithi070 ceph-mon[29591]: pgmap v4724: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 477 KiB/s rd, 574 KiB/s wr, 27 op/s 2024-05-08T09:14:42.311 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-sysfs.o 2024-05-08T09:14:42.482 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-stats.o 2024-05-08T09:14:42.655 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_domain.o 2024-05-08T09:14:43.537 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/memattr.o 2024-05-08T09:14:43.861 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/secureboot.o 2024-05-08T09:14:43.923 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-rq.o 2024-05-08T09:14:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:43 smithi172 ceph-mon[33377]: pgmap v4725: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 572 KiB/s wr, 24 op/s 2024-05-08T09:14:44.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:43 smithi194 ceph-mon[33679]: pgmap v4725: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 572 KiB/s wr, 24 op/s 2024-05-08T09:14:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:43 smithi070 ceph-mon[29591]: pgmap v4725: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 476 KiB/s rd, 572 KiB/s wr, 24 op/s 2024-05-08T09:14:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:45 smithi172 ceph-mon[33377]: pgmap v4726: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 912 KiB/s wr, 37 op/s 2024-05-08T09:14:46.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:45 smithi194 ceph-mon[33679]: pgmap v4726: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 912 KiB/s wr, 37 op/s 2024-05-08T09:14:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:45 smithi070 ceph-mon[29591]: pgmap v4726: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 748 KiB/s rd, 912 KiB/s wr, 37 op/s 2024-05-08T09:14:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:47 smithi194 ceph-mon[33679]: pgmap v4727: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 556 KiB/s wr, 22 op/s 2024-05-08T09:14:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:47 smithi070 ceph-mon[29591]: pgmap v4727: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 556 KiB/s wr, 22 op/s 2024-05-08T09:14:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:47 smithi172 ceph-mon[33377]: pgmap v4727: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 556 KiB/s wr, 22 op/s 2024-05-08T09:14:49.067 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/tpm.o 2024-05-08T09:14:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:49 smithi194 ceph-mon[33679]: pgmap v4728: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 556 KiB/s wr, 22 op/s 2024-05-08T09:14:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:49 smithi070 ceph-mon[29591]: pgmap v4728: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 556 KiB/s wr, 22 op/s 2024-05-08T09:14:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:49 smithi172 ceph-mon[33377]: pgmap v4728: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 556 KiB/s wr, 22 op/s 2024-05-08T09:14:51.258 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/crypto/stm32/built-in.a 2024-05-08T09:14:51.533 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/crypto/xilinx/built-in.a 2024-05-08T09:14:51.742 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/crypto/hisilicon/built-in.a 2024-05-08T09:14:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:51 smithi194 ceph-mon[33679]: pgmap v4729: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 697 KiB/s wr, 33 op/s 2024-05-08T09:14:52.020 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/crypto/intel/keembay/built-in.a 2024-05-08T09:14:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:51 smithi070 ceph-mon[29591]: pgmap v4729: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 697 KiB/s wr, 33 op/s 2024-05-08T09:14:52.154 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-io-rewind.o 2024-05-08T09:14:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:51 smithi172 ceph-mon[33377]: pgmap v4729: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 725 KiB/s rd, 697 KiB/s wr, 33 op/s 2024-05-08T09:14:52.270 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/crypto/intel/ixp4xx/built-in.a 2024-05-08T09:14:52.406 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/crypto/intel/built-in.a 2024-05-08T09:14:52.641 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/crypto/starfive/built-in.a 2024-05-08T09:14:52.728 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/clocksource/acpi_pm.o 2024-05-08T09:14:52.756 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/tpm.o 2024-05-08T09:14:52.788 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/crypto/built-in.a 2024-05-08T09:14:52.978 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/clocksource/i8253.o 2024-05-08T09:14:53.028 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_execbuffer.o 2024-05-08T09:14:53.765 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_internal.o 2024-05-08T09:14:54.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:53 smithi194 ceph-mon[33679]: pgmap v4730: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 481 KiB/s wr, 23 op/s 2024-05-08T09:14:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:53 smithi070 ceph-mon[29591]: pgmap v4730: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 481 KiB/s wr, 23 op/s 2024-05-08T09:14:54.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:53 smithi172 ceph-mon[33377]: pgmap v4730: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 498 KiB/s rd, 481 KiB/s wr, 23 op/s 2024-05-08T09:14:56.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:55 smithi194 ceph-mon[33679]: pgmap v4731: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.0 MiB/s wr, 43 op/s 2024-05-08T09:14:56.075 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-builtin.o 2024-05-08T09:14:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:55 smithi070 ceph-mon[29591]: pgmap v4731: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.0 MiB/s wr, 43 op/s 2024-05-08T09:14:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:55 smithi172 ceph-mon[33377]: pgmap v4731: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 1.0 MiB/s wr, 43 op/s 2024-05-08T09:14:58.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:57 smithi194 ceph-mon[33679]: pgmap v4732: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 697 KiB/s wr, 31 op/s 2024-05-08T09:14:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:57 smithi070 ceph-mon[29591]: pgmap v4732: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 697 KiB/s wr, 31 op/s 2024-05-08T09:14:58.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:57 smithi172 ceph-mon[33377]: pgmap v4732: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 697 KiB/s wr, 31 op/s 2024-05-08T09:14:58.776 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/file.o 2024-05-08T09:14:59.392 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/memmap.o 2024-05-08T09:14:59.983 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:14:59 smithi172 ceph-mon[33377]: pgmap v4733: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 697 KiB/s wr, 31 op/s 2024-05-08T09:15:00.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:14:59 smithi194 ceph-mon[33679]: pgmap v4733: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 697 KiB/s wr, 31 op/s 2024-05-08T09:15:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:14:59 smithi070 ceph-mon[29591]: pgmap v4733: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 684 KiB/s rd, 697 KiB/s wr, 31 op/s 2024-05-08T09:15:02.014 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:01 smithi194 ceph-mon[33679]: pgmap v4734: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 770 KiB/s wr, 42 op/s 2024-05-08T09:15:02.093 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/clocksource/built-in.a 2024-05-08T09:15:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:01 smithi070 ceph-mon[29591]: pgmap v4734: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 770 KiB/s wr, 42 op/s 2024-05-08T09:15:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:01 smithi172 ceph-mon[33377]: pgmap v4734: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 770 KiB/s wr, 42 op/s 2024-05-08T09:15:02.388 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/esrt.o 2024-05-08T09:15:02.817 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/usbhid/hid-core.o 2024-05-08T09:15:03.274 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/platform/x86/amd/built-in.a 2024-05-08T09:15:03.488 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/platform/x86/intel/built-in.a 2024-05-08T09:15:03.584 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/platform/x86/wmi.o 2024-05-08T09:15:04.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:03 smithi194 ceph-mon[33679]: pgmap v4735: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 629 KiB/s wr, 31 op/s 2024-05-08T09:15:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:03 smithi070 ceph-mon[29591]: pgmap v4735: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 629 KiB/s wr, 31 op/s 2024-05-08T09:15:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:03 smithi172 ceph-mon[33377]: pgmap v4735: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 592 KiB/s rd, 629 KiB/s wr, 31 op/s 2024-05-08T09:15:06.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:05 smithi194 ceph-mon[33679]: pgmap v4736: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 74 op/s 2024-05-08T09:15:06.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:05 smithi070 ceph-mon[29591]: pgmap v4736: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 74 op/s 2024-05-08T09:15:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:05 smithi172 ceph-mon[33377]: pgmap v4736: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 74 op/s 2024-05-08T09:15:06.363 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-raid1.o 2024-05-08T09:15:07.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:06 smithi194 ceph-mon[33679]: osdmap e373: 12 total, 12 up, 12 in 2024-05-08T09:15:07.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:06 smithi070 ceph-mon[29591]: osdmap e373: 12 total, 12 up, 12 in 2024-05-08T09:15:07.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:06 smithi172 ceph-mon[33377]: osdmap e373: 12 total, 12 up, 12 in 2024-05-08T09:15:07.536 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/platform/surface/built-in.a 2024-05-08T09:15:07.781 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/imx/built-in.a 2024-05-08T09:15:07.909 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/usbhid/hiddev.o 2024-05-08T09:15:08.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:07 smithi194 ceph-mon[33679]: pgmap v4738: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1014 KiB/s wr, 64 op/s 2024-05-08T09:15:08.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:07 smithi070 ceph-mon[29591]: pgmap v4738: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1014 KiB/s wr, 64 op/s 2024-05-08T09:15:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:07 smithi172 ceph-mon[33377]: pgmap v4738: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1014 KiB/s wr, 64 op/s 2024-05-08T09:15:08.886 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_object.o 2024-05-08T09:15:09.640 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/mem.o 2024-05-08T09:15:10.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:09 smithi194 ceph-mon[33679]: pgmap v4739: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1014 KiB/s wr, 64 op/s 2024-05-08T09:15:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:09 smithi070 ceph-mon[29591]: pgmap v4739: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1014 KiB/s wr, 64 op/s 2024-05-08T09:15:10.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:09 smithi172 ceph-mon[33377]: pgmap v4739: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1014 KiB/s wr, 64 op/s 2024-05-08T09:15:10.934 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/usbhid/hid-pidff.o 2024-05-08T09:15:11.633 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/random.o 2024-05-08T09:15:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:11 smithi070 ceph-mon[29591]: pgmap v4740: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-05-08T09:15:12.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:11 smithi070 ceph-mon[29591]: osdmap e374: 12 total, 12 up, 12 in 2024-05-08T09:15:12.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:11 smithi172 ceph-mon[33377]: pgmap v4740: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-05-08T09:15:12.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:11 smithi172 ceph-mon[33377]: osdmap e374: 12 total, 12 up, 12 in 2024-05-08T09:15:12.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:11 smithi194 ceph-mon[33679]: pgmap v4740: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 65 op/s 2024-05-08T09:15:12.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:11 smithi194 ceph-mon[33679]: osdmap e374: 12 total, 12 up, 12 in 2024-05-08T09:15:13.591 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/platform/x86/wmi-bmof.o 2024-05-08T09:15:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:13 smithi070 ceph-mon[29591]: pgmap v4742: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 563 KiB/s wr, 17 op/s 2024-05-08T09:15:14.194 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:13 smithi172 ceph-mon[33377]: pgmap v4742: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 563 KiB/s wr, 17 op/s 2024-05-08T09:15:14.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:13 smithi194 ceph-mon[33679]: pgmap v4742: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 563 KiB/s wr, 17 op/s 2024-05-08T09:15:14.279 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/randomalloc.o 2024-05-08T09:15:16.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:15 smithi070 ceph-mon[29591]: pgmap v4743: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 839 KiB/s wr, 37 op/s 2024-05-08T09:15:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:15 smithi172 ceph-mon[33377]: pgmap v4743: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 839 KiB/s wr, 37 op/s 2024-05-08T09:15:16.248 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-log.o 2024-05-08T09:15:16.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:15 smithi194 ceph-mon[33679]: pgmap v4743: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 769 KiB/s rd, 839 KiB/s wr, 37 op/s 2024-05-08T09:15:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:16 smithi070 ceph-mon[29591]: pgmap v4744: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 742 KiB/s wr, 33 op/s 2024-05-08T09:15:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:16 smithi172 ceph-mon[33377]: pgmap v4744: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 742 KiB/s wr, 33 op/s 2024-05-08T09:15:17.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:16 smithi194 ceph-mon[33679]: pgmap v4744: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 742 KiB/s wr, 33 op/s 2024-05-08T09:15:19.048 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-region-hash.o 2024-05-08T09:15:19.333 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/pci.o 2024-05-08T09:15:19.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:19 smithi172 ceph-mon[33377]: pgmap v4745: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 742 KiB/s wr, 33 op/s 2024-05-08T09:15:19.939 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:19 smithi070 ceph-mon[29591]: pgmap v4745: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 742 KiB/s wr, 33 op/s 2024-05-08T09:15:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:19 smithi194 ceph-mon[33679]: pgmap v4745: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 742 KiB/s wr, 33 op/s 2024-05-08T09:15:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:21 smithi172 ceph-mon[33377]: pgmap v4746: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 580 KiB/s wr, 36 op/s 2024-05-08T09:15:21.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:15:22.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:21 smithi194 ceph-mon[33679]: pgmap v4746: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 580 KiB/s wr, 36 op/s 2024-05-08T09:15:22.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:15:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:21 smithi070 ceph-mon[29591]: pgmap v4746: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 580 KiB/s wr, 36 op/s 2024-05-08T09:15:22.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:15:23.639 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/platform/x86/eeepc-laptop.o 2024-05-08T09:15:23.788 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/hid/usbhid/built-in.a 2024-05-08T09:15:23.810 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/platform/x86/p2sb.o 2024-05-08T09:15:23.875 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/skip_spaces.o 2024-05-08T09:15:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:23 smithi172 ceph-mon[33377]: pgmap v4747: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 517 KiB/s wr, 32 op/s 2024-05-08T09:15:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:23.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:24.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:23 smithi194 ceph-mon[33679]: pgmap v4747: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 517 KiB/s wr, 32 op/s 2024-05-08T09:15:24.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:24.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:24.113 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-core.o 2024-05-08T09:15:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:23 smithi070 ceph-mon[29591]: pgmap v4747: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 521 KiB/s rd, 517 KiB/s wr, 32 op/s 2024-05-08T09:15:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:24.426 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_lmem.o 2024-05-08T09:15:25.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:25.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:25.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:25 smithi172 ceph-mon[33377]: pgmap v4748: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 834 KiB/s wr, 42 op/s 2024-05-08T09:15:25.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:25 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:15:25.432 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:25 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:15:25.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:25.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:25.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:25 smithi194 ceph-mon[33679]: pgmap v4748: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 834 KiB/s wr, 42 op/s 2024-05-08T09:15:25.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:25 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:15:25.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:25 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:15:25.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:25.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:25.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:25 smithi070 ceph-mon[29591]: pgmap v4748: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 834 KiB/s wr, 42 op/s 2024-05-08T09:15:25.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:25.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:25 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:15:25.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:25 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:15:25.965 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-input.o 2024-05-08T09:15:26.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:26 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:15:26.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:26 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:15:26.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:26 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:15:26.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:26 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:15:26.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:26.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:26 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:15:26.681 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:26 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:15:27.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:27 smithi194 ceph-mon[33679]: pgmap v4749: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 591 KiB/s wr, 26 op/s 2024-05-08T09:15:27.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:27 smithi070 ceph-mon[29591]: pgmap v4749: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 591 KiB/s wr, 26 op/s 2024-05-08T09:15:27.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:27 smithi172 ceph-mon[33377]: pgmap v4749: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 591 KiB/s wr, 26 op/s 2024-05-08T09:15:27.838 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_mman.o 2024-05-08T09:15:28.018 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/md/dm-zero.o 2024-05-08T09:15:28.150 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/lib-cmdline.o 2024-05-08T09:15:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:28 smithi172 ceph-mon[33377]: pgmap v4750: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 591 KiB/s wr, 26 op/s 2024-05-08T09:15:29.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:29.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:29.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:28 smithi194 ceph-mon[33679]: pgmap v4750: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 591 KiB/s wr, 26 op/s 2024-05-08T09:15:29.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:29.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:29.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:28 smithi070 ceph-mon[29591]: pgmap v4750: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 591 KiB/s wr, 26 op/s 2024-05-08T09:15:29.993 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/lib-ctype.o 2024-05-08T09:15:30.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:29 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:15:30.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:29 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:15:30.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:15:30.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:15:30.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:30.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:29 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:15:30.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:29 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:15:30.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:15:30.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:15:30.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:30.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:15:30.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:29 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:15:30.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:29 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:15:30.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:15:30.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:15:30.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:15:30.589 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/alignedmem.o 2024-05-08T09:15:31.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:30 smithi172 ceph-mon[33377]: pgmap v4751: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 900 KiB/s wr, 43 op/s 2024-05-08T09:15:31.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:30 smithi194 ceph-mon[33679]: pgmap v4751: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 900 KiB/s wr, 43 op/s 2024-05-08T09:15:31.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:30 smithi070 ceph-mon[29591]: pgmap v4751: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 900 KiB/s wr, 43 op/s 2024-05-08T09:15:32.352 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-quirks.o 2024-05-08T09:15:33.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:33 smithi172 ceph-mon[33377]: pgmap v4752: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 659 KiB/s wr, 28 op/s 2024-05-08T09:15:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:33 smithi194 ceph-mon[33679]: pgmap v4752: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 659 KiB/s wr, 28 op/s 2024-05-08T09:15:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:33 smithi070 ceph-mon[29591]: pgmap v4752: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 659 KiB/s wr, 28 op/s 2024-05-08T09:15:34.330 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_pages.o 2024-05-08T09:15:34.402 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/platform/x86/built-in.a 2024-05-08T09:15:34.831 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/platform/built-in.a 2024-05-08T09:15:35.231 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-debug.o 2024-05-08T09:15:35.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:35 smithi172 ceph-mon[33377]: pgmap v4753: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.0 MiB/s wr, 42 op/s 2024-05-08T09:15:35.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:35 smithi070 ceph-mon[29591]: pgmap v4753: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.0 MiB/s wr, 42 op/s 2024-05-08T09:15:36.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:35 smithi194 ceph-mon[33679]: pgmap v4753: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 994 KiB/s rd, 1.0 MiB/s wr, 42 op/s 2024-05-08T09:15:36.367 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/md/built-in.a 2024-05-08T09:15:36.731 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/runtime-wrappers.o 2024-05-08T09:15:37.235 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hidraw.o 2024-05-08T09:15:37.342 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-generic.o 2024-05-08T09:15:37.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:37 smithi172 ceph-mon[33377]: pgmap v4754: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 700 KiB/s wr, 30 op/s 2024-05-08T09:15:38.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:37 smithi194 ceph-mon[33679]: pgmap v4754: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 700 KiB/s wr, 30 op/s 2024-05-08T09:15:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:37 smithi070 ceph-mon[29591]: pgmap v4754: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 700 KiB/s wr, 30 op/s 2024-05-08T09:15:39.555 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/relocate.o 2024-05-08T09:15:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:39 smithi172 ceph-mon[33377]: pgmap v4755: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 700 KiB/s wr, 30 op/s 2024-05-08T09:15:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:39 smithi194 ceph-mon[33679]: pgmap v4755: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 700 KiB/s wr, 30 op/s 2024-05-08T09:15:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:39 smithi070 ceph-mon[29591]: pgmap v4755: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 665 KiB/s rd, 700 KiB/s wr, 30 op/s 2024-05-08T09:15:41.644 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-a4tech.o 2024-05-08T09:15:41.670 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/earlycon.o 2024-05-08T09:15:41.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:41 smithi172 ceph-mon[33377]: pgmap v4756: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1.1 MiB/s wr, 47 op/s 2024-05-08T09:15:42.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:41 smithi194 ceph-mon[33679]: pgmap v4756: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1.1 MiB/s wr, 47 op/s 2024-05-08T09:15:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:41 smithi070 ceph-mon[29591]: pgmap v4756: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1002 KiB/s rd, 1.1 MiB/s wr, 47 op/s 2024-05-08T09:15:43.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:43 smithi172 ceph-mon[33377]: pgmap v4757: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 780 KiB/s wr, 30 op/s 2024-05-08T09:15:44.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:43 smithi194 ceph-mon[33679]: pgmap v4757: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 780 KiB/s wr, 30 op/s 2024-05-08T09:15:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:43 smithi070 ceph-mon[29591]: pgmap v4757: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 780 KiB/s wr, 30 op/s 2024-05-08T09:15:44.715 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/printk.o 2024-05-08T09:15:45.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:45 smithi172 ceph-mon[33377]: pgmap v4758: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.1 MiB/s wr, 39 op/s 2024-05-08T09:15:46.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:45 smithi194 ceph-mon[33679]: pgmap v4758: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.1 MiB/s wr, 39 op/s 2024-05-08T09:15:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:45 smithi070 ceph-mon[29591]: pgmap v4758: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 1.1 MiB/s wr, 39 op/s 2024-05-08T09:15:46.550 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-apple.o 2024-05-08T09:15:47.617 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/mailbox/mailbox.o 2024-05-08T09:15:47.721 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_phys.o 2024-05-08T09:15:47.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:47 smithi172 ceph-mon[33377]: pgmap v4759: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 727 KiB/s wr, 25 op/s 2024-05-08T09:15:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:47 smithi194 ceph-mon[33679]: pgmap v4759: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 727 KiB/s wr, 25 op/s 2024-05-08T09:15:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:47 smithi070 ceph-mon[29591]: pgmap v4759: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 727 KiB/s wr, 25 op/s 2024-05-08T09:15:48.424 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/mailbox/pcc.o 2024-05-08T09:15:49.272 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/perf/built-in.a 2024-05-08T09:15:49.434 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_vblank_work.o 2024-05-08T09:15:50.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:49 smithi194 ceph-mon[33679]: pgmap v4760: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 727 KiB/s wr, 25 op/s 2024-05-08T09:15:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:49 smithi070 ceph-mon[29591]: pgmap v4760: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 727 KiB/s wr, 25 op/s 2024-05-08T09:15:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:49 smithi172 ceph-mon[33377]: pgmap v4760: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 727 KiB/s wr, 25 op/s 2024-05-08T09:15:51.796 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_pm.o 2024-05-08T09:15:51.820 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_region.o 2024-05-08T09:15:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:51 smithi194 ceph-mon[33679]: pgmap v4761: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 942 KiB/s wr, 37 op/s 2024-05-08T09:15:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:51 smithi070 ceph-mon[29591]: pgmap v4761: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 942 KiB/s wr, 37 op/s 2024-05-08T09:15:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:51 smithi172 ceph-mon[33377]: pgmap v4761: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 942 KiB/s wr, 37 op/s 2024-05-08T09:15:54.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:53 smithi194 ceph-mon[33679]: pgmap v4762: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 554 KiB/s wr, 20 op/s 2024-05-08T09:15:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:53 smithi070 ceph-mon[29591]: pgmap v4762: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 554 KiB/s wr, 20 op/s 2024-05-08T09:15:54.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:53 smithi172 ceph-mon[33377]: pgmap v4762: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 537 KiB/s rd, 554 KiB/s wr, 20 op/s 2024-05-08T09:15:54.378 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/vsprintf.o 2024-05-08T09:15:54.955 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/efi/libstub/x86-stub.o 2024-05-08T09:15:56.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:55 smithi194 ceph-mon[33679]: pgmap v4763: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 888 KiB/s wr, 32 op/s 2024-05-08T09:15:56.108 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-belkin.o 2024-05-08T09:15:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:55 smithi070 ceph-mon[29591]: pgmap v4763: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 888 KiB/s wr, 32 op/s 2024-05-08T09:15:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:55 smithi172 ceph-mon[33377]: pgmap v4763: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 858 KiB/s rd, 888 KiB/s wr, 32 op/s 2024-05-08T09:15:56.344 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/mailbox/built-in.a 2024-05-08T09:15:56.517 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/alignedmem.stub.o 2024-05-08T09:15:56.613 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/efi/built-in.a 2024-05-08T09:15:56.816 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/hwtracing/intel_th/built-in.a 2024-05-08T09:15:56.952 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_shmem.o 2024-05-08T09:15:57.266 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/android/built-in.a 2024-05-08T09:15:57.366 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_shrinker.o 2024-05-08T09:15:58.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:57 smithi194 ceph-mon[33679]: pgmap v4764: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 550 KiB/s wr, 23 op/s 2024-05-08T09:15:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:57 smithi070 ceph-mon[29591]: pgmap v4764: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 550 KiB/s wr, 23 op/s 2024-05-08T09:15:58.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:57 smithi172 ceph-mon[33377]: pgmap v4764: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 550 KiB/s wr, 23 op/s 2024-05-08T09:15:59.036 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_stolen.o 2024-05-08T09:15:59.983 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:15:59 smithi172 ceph-mon[33377]: pgmap v4765: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 550 KiB/s wr, 23 op/s 2024-05-08T09:16:00.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:15:59 smithi194 ceph-mon[33679]: pgmap v4765: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 550 KiB/s wr, 23 op/s 2024-05-08T09:16:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:15:59 smithi070 ceph-mon[29591]: pgmap v4765: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 550 KiB/s wr, 23 op/s 2024-05-08T09:16:02.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:01 smithi194 ceph-mon[33679]: pgmap v4766: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 952 KiB/s wr, 40 op/s 2024-05-08T09:16:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:01 smithi070 ceph-mon[29591]: pgmap v4766: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 952 KiB/s wr, 40 op/s 2024-05-08T09:16:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:01 smithi172 ceph-mon[33377]: pgmap v4766: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 952 KiB/s wr, 40 op/s 2024-05-08T09:16:04.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:03 smithi194 ceph-mon[33679]: pgmap v4767: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 736 KiB/s wr, 28 op/s 2024-05-08T09:16:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:03 smithi070 ceph-mon[29591]: pgmap v4767: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 736 KiB/s wr, 28 op/s 2024-05-08T09:16:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:03 smithi172 ceph-mon[33377]: pgmap v4767: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 736 KiB/s wr, 28 op/s 2024-05-08T09:16:05.868 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-cherry.o 2024-05-08T09:16:06.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:05 smithi194 ceph-mon[33679]: pgmap v4768: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 979 KiB/s wr, 53 op/s 2024-05-08T09:16:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:05 smithi070 ceph-mon[29591]: pgmap v4768: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 979 KiB/s wr, 53 op/s 2024-05-08T09:16:06.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:05 smithi172 ceph-mon[33377]: pgmap v4768: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 946 KiB/s rd, 979 KiB/s wr, 53 op/s 2024-05-08T09:16:07.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:06 smithi194 ceph-mon[33679]: osdmap e375: 12 total, 12 up, 12 in 2024-05-08T09:16:07.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:06 smithi070 ceph-mon[29591]: osdmap e375: 12 total, 12 up, 12 in 2024-05-08T09:16:07.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:06 smithi172 ceph-mon[33377]: osdmap e375: 12 total, 12 up, 12 in 2024-05-08T09:16:08.005 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_vma_manager.o 2024-05-08T09:16:08.014 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:07 smithi194 ceph-mon[33679]: pgmap v4770: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 774 KiB/s wr, 49 op/s 2024-05-08T09:16:08.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:07 smithi070 ceph-mon[29591]: pgmap v4770: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 774 KiB/s wr, 49 op/s 2024-05-08T09:16:08.154 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/efi-stub-helper.stub.o 2024-05-08T09:16:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:07 smithi172 ceph-mon[33377]: pgmap v4770: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 774 KiB/s wr, 49 op/s 2024-05-08T09:16:08.295 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/file.stub.o 2024-05-08T09:16:08.431 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/gop.stub.o 2024-05-08T09:16:08.607 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/lib-cmdline.stub.o 2024-05-08T09:16:08.734 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/lib-ctype.stub.o 2024-05-08T09:16:08.743 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/mem.stub.o 2024-05-08T09:16:08.752 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_throttle.o 2024-05-08T09:16:08.881 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_tiling.o 2024-05-08T09:16:08.905 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/pci.stub.o 2024-05-08T09:16:09.035 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/printk.stub.o 2024-05-08T09:16:09.176 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/random.stub.o 2024-05-08T09:16:09.307 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/randomalloc.stub.o 2024-05-08T09:16:09.444 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/relocate.stub.o 2024-05-08T09:16:09.583 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/secureboot.stub.o 2024-05-08T09:16:09.726 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/skip_spaces.stub.o 2024-05-08T09:16:09.861 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/tpm.stub.o 2024-05-08T09:16:10.004 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/vsprintf.stub.o 2024-05-08T09:16:10.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:09 smithi194 ceph-mon[33679]: pgmap v4771: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 774 KiB/s wr, 49 op/s 2024-05-08T09:16:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:09 smithi070 ceph-mon[29591]: pgmap v4771: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 774 KiB/s wr, 49 op/s 2024-05-08T09:16:10.152 INFO:tasks.workunit.client.0.smithi070.stdout: STUBCPY drivers/firmware/efi/libstub/x86-stub.stub.o 2024-05-08T09:16:10.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:09 smithi172 ceph-mon[33377]: pgmap v4771: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 774 KiB/s wr, 49 op/s 2024-05-08T09:16:10.358 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/efi/libstub/lib.a 2024-05-08T09:16:11.819 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/nvmem/layouts/built-in.a 2024-05-08T09:16:11.958 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/nvmem/core.o 2024-05-08T09:16:12.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:11 smithi194 ceph-mon[33679]: pgmap v4772: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 748 KiB/s wr, 52 op/s 2024-05-08T09:16:12.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:11 smithi194 ceph-mon[33679]: osdmap e376: 12 total, 12 up, 12 in 2024-05-08T09:16:12.069 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_ttm.o 2024-05-08T09:16:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:11 smithi070 ceph-mon[29591]: pgmap v4772: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 748 KiB/s wr, 52 op/s 2024-05-08T09:16:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:11 smithi070 ceph-mon[29591]: osdmap e376: 12 total, 12 up, 12 in 2024-05-08T09:16:12.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:11 smithi172 ceph-mon[33377]: pgmap v4772: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 748 KiB/s wr, 52 op/s 2024-05-08T09:16:12.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:11 smithi172 ceph-mon[33377]: osdmap e376: 12 total, 12 up, 12 in 2024-05-08T09:16:12.290 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/psci/built-in.a 2024-05-08T09:16:12.489 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/smccc/built-in.a 2024-05-08T09:16:12.672 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/tegra/built-in.a 2024-05-08T09:16:12.878 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/xilinx/built-in.a 2024-05-08T09:16:13.017 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/dmi_scan.o 2024-05-08T09:16:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:13 smithi194 ceph-mon[33679]: pgmap v4774: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 571 KiB/s wr, 27 op/s 2024-05-08T09:16:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:13 smithi070 ceph-mon[29591]: pgmap v4774: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 571 KiB/s wr, 27 op/s 2024-05-08T09:16:14.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:13 smithi172 ceph-mon[33377]: pgmap v4774: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 510 KiB/s rd, 571 KiB/s wr, 27 op/s 2024-05-08T09:16:14.304 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/dmi-id.o 2024-05-08T09:16:15.895 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-chicony.o 2024-05-08T09:16:16.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:15 smithi070 ceph-mon[29591]: pgmap v4775: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-05-08T09:16:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:15 smithi172 ceph-mon[33377]: pgmap v4775: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-05-08T09:16:16.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:15 smithi194 ceph-mon[33679]: pgmap v4775: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1005 KiB/s rd, 1.1 MiB/s wr, 53 op/s 2024-05-08T09:16:16.518 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-08T09:16:16.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:16:16.742 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-cypress.o 2024-05-08T09:16:17.080 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:16:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:17 smithi070 ceph-mon[29591]: pgmap v4776: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 969 KiB/s wr, 47 op/s 2024-05-08T09:16:18.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:17 smithi172 ceph-mon[33377]: pgmap v4776: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 969 KiB/s wr, 47 op/s 2024-05-08T09:16:18.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:17 smithi194 ceph-mon[33679]: pgmap v4776: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 969 KiB/s wr, 47 op/s 2024-05-08T09:16:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:19 smithi070 ceph-mon[29591]: pgmap v4777: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 969 KiB/s wr, 47 op/s 2024-05-08T09:16:20.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:19 smithi172 ceph-mon[33377]: pgmap v4777: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 969 KiB/s wr, 47 op/s 2024-05-08T09:16:20.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:19 smithi194 ceph-mon[33679]: pgmap v4777: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 969 KiB/s wr, 47 op/s 2024-05-08T09:16:20.865 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/nvmem/built-in.a 2024-05-08T09:16:21.070 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-ezkey.o 2024-05-08T09:16:21.778 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_writeback.o 2024-05-08T09:16:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.931+0000 7f2d25200700 1 -- 172.21.15.70:0/2089430313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 msgr2=0x7f2d201049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.931+0000 7f2d25200700 1 --2- 172.21.15.70:0/2089430313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 0x7f2d201049d0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000b0a0 tx=0x7f2d1000b3b0 comp rx=0 tx=0).stop 2024-05-08T09:16:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.931+0000 7f2d25200700 1 -- 172.21.15.70:0/2089430313 shutdown_connections 2024-05-08T09:16:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.931+0000 7f2d25200700 1 --2- 172.21.15.70:0/2089430313 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2010d9d0 0x7f2d2010fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.931+0000 7f2d25200700 1 --2- 172.21.15.70:0/2089430313 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 0x7f2d201049d0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.931+0000 7f2d25200700 1 --2- 172.21.15.70:0/2089430313 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d20104f10 0x7f2d2010d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:21.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.931+0000 7f2d25200700 1 -- 172.21.15.70:0/2089430313 >> 172.21.15.70:0/2089430313 conn(0x7f2d200fddc0 msgr2=0x7f2d201001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:16:21.932 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:21 smithi070 ceph-mon[29591]: pgmap v4778: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 44 op/s 2024-05-08T09:16:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.932+0000 7f2d25200700 1 -- 172.21.15.70:0/2089430313 shutdown_connections 2024-05-08T09:16:21.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.932+0000 7f2d25200700 1 -- 172.21.15.70:0/2089430313 wait complete. 2024-05-08T09:16:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.933+0000 7f2d25200700 1 Processor -- start 2024-05-08T09:16:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.933+0000 7f2d25200700 1 -- start start 2024-05-08T09:16:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.934+0000 7f2d25200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 0x7f2d2010ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.934+0000 7f2d25200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d20104f10 0x7f2d2010d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.934+0000 7f2d25200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2010d9d0 0x7f2d2010a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.934+0000 7f2d25200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d20103730 con 0x7f2d201045f0 2024-05-08T09:16:21.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.934+0000 7f2d25200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201035b0 con 0x7f2d2010d9d0 2024-05-08T09:16:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.934+0000 7f2d25200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2d201038b0 con 0x7f2d20104f10 2024-05-08T09:16:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.934+0000 7f2d1f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 0x7f2d2010ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.934+0000 7f2d1f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 0x7f2d2010ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46436/0 (socket says 172.21.15.70:46436) 2024-05-08T09:16:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.934+0000 7f2d1f400700 1 -- 172.21.15.70:0/3369824619 learned_addr learned my addr 172.21.15.70:0/3369824619 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:16:21.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.935+0000 7f2d1ea00700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d20104f10 0x7f2d2010d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.935+0000 7f2d1fe00700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2010d9d0 0x7f2d2010a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.935+0000 7f2d1f400700 1 -- 172.21.15.70:0/3369824619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d20104f10 msgr2=0x7f2d2010d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.935+0000 7f2d1f400700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d20104f10 0x7f2d2010d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.935+0000 7f2d1f400700 1 -- 172.21.15.70:0/3369824619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2010d9d0 msgr2=0x7f2d2010a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.935+0000 7f2d1f400700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2010d9d0 0x7f2d2010a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.935+0000 7f2d1f400700 1 -- 172.21.15.70:0/3369824619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2010aa50 con 0x7f2d201045f0 2024-05-08T09:16:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.935+0000 7f2d1ea00700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d20104f10 0x7f2d2010d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:16:21.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.935+0000 7f2d1f400700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 0x7f2d2010ce70 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2d100062a0 tx=0x7f2d10004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:16:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.936+0000 7f2d17e00700 1 -- 172.21.15.70:0/3369824619 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10021070 con 0x7f2d201045f0 2024-05-08T09:16:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.936+0000 7f2d17e00700 1 -- 172.21.15.70:0/3369824619 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2d10007d40 con 0x7f2d201045f0 2024-05-08T09:16:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.936+0000 7f2d17e00700 1 -- 172.21.15.70:0/3369824619 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d100052a0 con 0x7f2d201045f0 2024-05-08T09:16:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.936+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2010ace0 con 0x7f2d201045f0 2024-05-08T09:16:21.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.936+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d201aca00 con 0x7f2d201045f0 2024-05-08T09:16:21.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.938+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2006ba00 con 0x7f2d201045f0 2024-05-08T09:16:21.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.942+0000 7f2d17e00700 1 -- 172.21.15.70:0/3369824619 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2d10024070 con 0x7f2d201045f0 2024-05-08T09:16:21.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.944+0000 7f2d17e00700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d040b2af0 0x7f2d040b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:21.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.944+0000 7f2d17e00700 1 -- 172.21.15.70:0/3369824619 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(376..376 src has 1..376) ==== 9583+0+0 (secure 0 0 0) 0x7f2d1000f020 con 0x7f2d201045f0 2024-05-08T09:16:21.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.945+0000 7f2d1ea00700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d040b2af0 0x7f2d040b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:21.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.947+0000 7f2d1ea00700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d040b2af0 0x7f2d040b4fb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2d2010b6e0 tx=0x7f2d0c00b5f0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:16:21.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:21.948+0000 7f2d17e00700 1 -- 172.21.15.70:0/3369824619 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2d1002b020 con 0x7f2d201045f0 2024-05-08T09:16:22.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:21 smithi172 ceph-mon[33377]: pgmap v4778: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 44 op/s 2024-05-08T09:16:22.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:21 smithi194 ceph-mon[33679]: pgmap v4778: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 44 op/s 2024-05-08T09:16:22.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.434+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d2006a190 con 0x7f2d201045f0 2024-05-08T09:16:22.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.435+0000 7f2d17e00700 1 -- 172.21.15.70:0/3369824619 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f2d2006a190 con 0x7f2d201045f0 2024-05-08T09:16:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:16:22.436 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:16:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.439+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d040b2af0 msgr2=0x7f2d040b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.439+0000 7f2d25200700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d040b2af0 0x7f2d040b4fb0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2d2010b6e0 tx=0x7f2d0c00b5f0 comp rx=0 tx=0).stop 2024-05-08T09:16:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.439+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 msgr2=0x7f2d2010ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.439+0000 7f2d25200700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 0x7f2d2010ce70 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2d100062a0 tx=0x7f2d10004db0 comp rx=0 tx=0).stop 2024-05-08T09:16:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.439+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 shutdown_connections 2024-05-08T09:16:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.439+0000 7f2d25200700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2d040b2af0 0x7f2d040b4fb0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.439+0000 7f2d25200700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2d2010d9d0 0x7f2d2010a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.439+0000 7f2d25200700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d201045f0 0x7f2d2010ce70 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.439+0000 7f2d25200700 1 --2- 172.21.15.70:0/3369824619 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d20104f10 0x7f2d2010d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.440+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 >> 172.21.15.70:0/3369824619 conn(0x7f2d200fddc0 msgr2=0x7f2d2010f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:16:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.440+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 shutdown_connections 2024-05-08T09:16:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:22.441+0000 7f2d25200700 1 -- 172.21.15.70:0/3369824619 wait complete. 2024-05-08T09:16:22.442 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:16:22.912 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/firmware/memmap.o 2024-05-08T09:16:23.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:22 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3369824619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:16:23.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:22 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3369824619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:16:23.256 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-gyration.o 2024-05-08T09:16:23.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:22 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3369824619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:16:23.266 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-ite.o 2024-05-08T09:16:23.411 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-05-08T09:16:23.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-05-08T09:16:24.023 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:16:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:23 smithi070 ceph-mon[29591]: pgmap v4779: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 970 KiB/s wr, 39 op/s 2024-05-08T09:16:24.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:23 smithi172 ceph-mon[33377]: pgmap v4779: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 970 KiB/s wr, 39 op/s 2024-05-08T09:16:24.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:23 smithi194 ceph-mon[33679]: pgmap v4779: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 918 KiB/s rd, 970 KiB/s wr, 39 op/s 2024-05-08T09:16:24.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:24 smithi070 ceph-mon[29591]: pgmap v4780: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 51 op/s 2024-05-08T09:16:25.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:24 smithi172 ceph-mon[33377]: pgmap v4780: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 51 op/s 2024-05-08T09:16:25.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:24 smithi194 ceph-mon[33679]: pgmap v4780: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 51 op/s 2024-05-08T09:16:26.306 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_ttm_move.o 2024-05-08T09:16:26.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.410+0000 7f827ca00700 1 -- 172.21.15.70:0/989689066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f827810b6e0 msgr2=0x7f827810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:26.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.410+0000 7f827ca00700 1 --2- 172.21.15.70:0/989689066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f827810b6e0 0x7f827810bac0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f82680098f0 tx=0x7f8268009c00 comp rx=0 tx=0).stop 2024-05-08T09:16:26.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.411+0000 7f827ca00700 1 -- 172.21.15.70:0/989689066 shutdown_connections 2024-05-08T09:16:26.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.411+0000 7f827ca00700 1 --2- 172.21.15.70:0/989689066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f82781060a0 0x7f82781125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.411+0000 7f827ca00700 1 --2- 172.21.15.70:0/989689066 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f827810b6e0 0x7f827810bac0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.411+0000 7f827ca00700 1 --2- 172.21.15.70:0/989689066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82781056e0 0x7f8278105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.411+0000 7f827ca00700 1 -- 172.21.15.70:0/989689066 >> 172.21.15.70:0/989689066 conn(0x7f82781011d0 msgr2=0x7f82781035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:16:26.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.411+0000 7f827ca00700 1 -- 172.21.15.70:0/989689066 shutdown_connections 2024-05-08T09:16:26.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.411+0000 7f827ca00700 1 -- 172.21.15.70:0/989689066 wait complete. 2024-05-08T09:16:26.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.413+0000 7f827ca00700 1 Processor -- start 2024-05-08T09:16:26.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.413+0000 7f827ca00700 1 -- start start 2024-05-08T09:16:26.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.413+0000 7f827ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82781056e0 0x7f8278112210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.413+0000 7f827ca00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82781060a0 0x7f8278110320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.413+0000 7f827ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f827810b6e0 0x7f8278110860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.413+0000 7f827ca00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8278077eb0 con 0x7f827810b6e0 2024-05-08T09:16:26.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.413+0000 7f827ca00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8278077d30 con 0x7f82781056e0 2024-05-08T09:16:26.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.413+0000 7f827ca00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8278078030 con 0x7f82781060a0 2024-05-08T09:16:26.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.414+0000 7f8275e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82781056e0 0x7f8278112210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.414+0000 7f8276800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f827810b6e0 0x7f8278110860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.414+0000 7f8275e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82781056e0 0x7f8278112210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:57580/0 (socket says 172.21.15.70:57580) 2024-05-08T09:16:26.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.414+0000 7f8275e00700 1 -- 172.21.15.70:0/593076918 learned_addr learned my addr 172.21.15.70:0/593076918 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:16:26.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.414+0000 7f8275400700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82781060a0 0x7f8278110320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.415+0000 7f8275e00700 1 -- 172.21.15.70:0/593076918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82781060a0 msgr2=0x7f8278110320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:26.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.415+0000 7f8275e00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82781060a0 0x7f8278110320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.415+0000 7f8275e00700 1 -- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f827810b6e0 msgr2=0x7f8278110860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:26.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.415+0000 7f8275e00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f827810b6e0 0x7f8278110860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.415+0000 7f8275e00700 1 -- 172.21.15.70:0/593076918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8278110ff0 con 0x7f82781056e0 2024-05-08T09:16:26.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.415+0000 7f8276800700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f827810b6e0 0x7f8278110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:16:26.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.416+0000 7f8275e00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82781056e0 0x7f8278112210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8268005950 tx=0x7f826800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:16:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.416+0000 7f826ea00700 1 -- 172.21.15.70:0/593076918 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826800b6a0 con 0x7f82781056e0 2024-05-08T09:16:26.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.417+0000 7f827ca00700 1 -- 172.21.15.70:0/593076918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82781ac790 con 0x7f82781056e0 2024-05-08T09:16:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.417+0000 7f826ea00700 1 -- 172.21.15.70:0/593076918 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8268005040 con 0x7f82781056e0 2024-05-08T09:16:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.417+0000 7f826ea00700 1 -- 172.21.15.70:0/593076918 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268003970 con 0x7f82781056e0 2024-05-08T09:16:26.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.417+0000 7f827ca00700 1 -- 172.21.15.70:0/593076918 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82781acb90 con 0x7f82781056e0 2024-05-08T09:16:26.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.423+0000 7f826ea00700 1 -- 172.21.15.70:0/593076918 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f82680051f0 con 0x7f82781056e0 2024-05-08T09:16:26.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.425+0000 7f826ea00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f825c0b2b20 0x7f825c0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.426+0000 7f826ea00700 1 -- 172.21.15.70:0/593076918 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(376..376 src has 1..376) ==== 9583+0+0 (secure 0 0 0) 0x7f82680e3840 con 0x7f82781056e0 2024-05-08T09:16:26.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.426+0000 7f8275400700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f825c0b2b20 0x7f825c0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.427+0000 7f8275400700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f825c0b2b20 0x7f825c0b4fe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f827810ade0 tx=0x7f8264009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:16:26.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.437+0000 7f82873bcb80 1 Processor -- start 2024-05-08T09:16:26.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.437+0000 7f82873bcb80 1 -- start start 2024-05-08T09:16:26.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.437+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517f1f50 0x558c517f2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.437+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ec520 0x558c517ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.437+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ecee0 0x558c517f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.438+0000 7f82873bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c5173ebb0 con 0x558c517f1f50 2024-05-08T09:16:26.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.438+0000 7f82873bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c516dc8f0 con 0x558c517ecee0 2024-05-08T09:16:26.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.438+0000 7f82873bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558c5173ab70 con 0x558c517ec520 2024-05-08T09:16:26.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.438+0000 7f8276800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ecee0 0x558c517f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.438+0000 7f8275e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517f1f50 0x558c517f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.438+0000 7f8276800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ecee0 0x558c517f8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:57590/0 (socket says 172.21.15.70:57590) 2024-05-08T09:16:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.438+0000 7f8275e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517f1f50 0x558c517f2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46472/0 (socket says 172.21.15.70:46472) 2024-05-08T09:16:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.438+0000 7f8276800700 1 -- 172.21.15.70:0/3147593580 learned_addr learned my addr 172.21.15.70:0/3147593580 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:16:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.439+0000 7f8275400700 1 --2- 172.21.15.70:0/3147593580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ec520 0x558c517ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.439+0000 7f8276800700 1 -- 172.21.15.70:0/3147593580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ec520 msgr2=0x558c517ec9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:16:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.439+0000 7f8276800700 1 --2- 172.21.15.70:0/3147593580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ec520 0x558c517ec9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.439+0000 7f8276800700 1 -- 172.21.15.70:0/3147593580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517f1f50 msgr2=0x558c517f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:16:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.439+0000 7f8276800700 1 --2- 172.21.15.70:0/3147593580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517f1f50 0x558c517f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.439+0000 7f8276800700 1 -- 172.21.15.70:0/3147593580 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c5168ba60 con 0x558c517ecee0 2024-05-08T09:16:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.440+0000 7f8276800700 1 --2- 172.21.15.70:0/3147593580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ecee0 0x558c517f8d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f827000e980 tx=0x7f82700099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5072e05c8a05895b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:16:26.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.441+0000 7f8263400700 1 -- 172.21.15.70:0/3147593580 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8270019070 con 0x558c517ecee0 2024-05-08T09:16:26.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.441+0000 7f8263400700 1 -- 172.21.15.70:0/3147593580 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8270007a50 con 0x558c517ecee0 2024-05-08T09:16:26.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.441+0000 7f8263400700 1 -- 172.21.15.70:0/3147593580 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8270015a20 con 0x558c517ecee0 2024-05-08T09:16:26.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.442+0000 7f82873bcb80 1 -- 172.21.15.70:0/3147593580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ecee0 msgr2=0x558c517f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.442+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3147593580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ecee0 0x558c517f8d10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f827000e980 tx=0x7f82700099e0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.442+0000 7f82873bcb80 1 -- 172.21.15.70:0/3147593580 shutdown_connections 2024-05-08T09:16:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.443+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3147593580 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ecee0 0x558c517f8d10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.443+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3147593580 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517f1f50 0x558c517f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.443+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3147593580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ec520 0x558c517ec9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.443+0000 7f82873bcb80 1 -- 172.21.15.70:0/3147593580 >> 172.21.15.70:0/3147593580 conn(0x558c5171acf0 msgr2=0x558c517e6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:16:26.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.443+0000 7f82873bcb80 1 -- 172.21.15.70:0/3147593580 shutdown_connections 2024-05-08T09:16:26.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.444+0000 7f82873bcb80 1 -- 172.21.15.70:0/3147593580 wait complete. 2024-05-08T09:16:26.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.444+0000 7f82873bcb80 1 -- start start 2024-05-08T09:16:26.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.445+0000 7f82873bcb80 1 Processor -- start 2024-05-08T09:16:26.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.445+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.445+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c517f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.445+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 0x558c517f6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.445+0000 7f82873bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558c517f9250 con 0x558c517ecee0 2024-05-08T09:16:26.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.445+0000 7f82873bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x558c516a4cb0 con 0x558c517ec520 2024-05-08T09:16:26.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.445+0000 7f82873bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x558c517f93d0 con 0x558c517f1f50 2024-05-08T09:16:26.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.446+0000 7f82873bcb80 10 client.0 _ll_register_callbacks cb 0x558c516e5e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:16:26.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.446+0000 7f8275e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.446+0000 7f8275e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:57604/0 (socket says 172.21.15.70:57604) 2024-05-08T09:16:26.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.446+0000 7f8275e00700 1 -- 172.21.15.70:0/3529834884 learned_addr learned my addr 172.21.15.70:0/3529834884 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:16:26.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.446+0000 7f8276800700 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 0x558c517f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.447+0000 7f8275400700 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c517f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.447+0000 7f8275e00700 1 -- 172.21.15.70:0/3529834884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 msgr2=0x558c517f6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:16:26.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.447+0000 7f8275e00700 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 0x558c517f6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.447+0000 7f8275e00700 1 -- 172.21.15.70:0/3529834884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 msgr2=0x558c517f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:16:26.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.447+0000 7f8275e00700 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c517f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.447+0000 7f8275e00700 1 -- 172.21.15.70:0/3529834884 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c517045b0 con 0x558c517ec520 2024-05-08T09:16:26.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.448+0000 7f8275400700 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c517f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:16:26.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.448+0000 7f8275e00700 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f88b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f82680aa490 tx=0x7f82680a6650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa3b16ca11c1c733 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:16:26.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.448+0000 7f8257e00700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T09:16:26.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.449+0000 7f8257e00700 1 -- 172.21.15.70:0/3529834884 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82680aa2a0 con 0x558c517ec520 2024-05-08T09:16:26.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.449+0000 7f8257e00700 1 -- 172.21.15.70:0/3529834884 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(376..376 src has 1..376) ==== 9583+0+0 (secure 0 0 0) 0x7f8268003b10 con 0x558c517ec520 2024-05-08T09:16:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.449+0000 7f82873bcb80 1 -- 172.21.15.70:0/3529834884 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8270007a50 con 0x558c517ec520 2024-05-08T09:16:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.450+0000 7f8257e00700 1 -- 172.21.15.70:0/3529834884 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f82680aae90 con 0x558c517ec520 2024-05-08T09:16:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.450+0000 7f82873bcb80 10 client.37856 fetch_fsmap learned FSMap version 42 2024-05-08T09:16:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.450+0000 7f82873bcb80 1 -- 172.21.15.70:0/3529834884 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558c51814a80 con 0x558c517ec520 2024-05-08T09:16:26.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.450+0000 7f8257e00700 1 -- 172.21.15.70:0/3529834884 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8270007a50 con 0x558c517ec520 2024-05-08T09:16:26.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.451+0000 7f8257e00700 1 -- 172.21.15.70:0/3529834884 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f826800e3e0 con 0x558c517ec520 2024-05-08T09:16:26.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.451+0000 7f82873bcb80 10 client.37856 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:16:26.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.451+0000 7f82873bcb80 10 client.37856 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:16:26.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.451+0000 7f82873bcb80 20 client.37856 populate_metadata read hostname 'smithi070' 2024-05-08T09:16:26.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.451+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c51817090 0x558c518194e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.451+0000 7f82873bcb80 4 client.37856 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:16:26.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.451+0000 7f82873bcb80 1 -- 172.21.15.70:0/3529834884 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c517b9230 con 0x558c51817090 2024-05-08T09:16:26.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.452+0000 7f8275400700 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c51817090 0x558c518194e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.453+0000 7f8275400700 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c51817090 0x558c518194e0 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5257e4b2c7710fce server_cookie=937f71b5da096373 in_seq=0 out_seq=0 2024-05-08T09:16:26.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.453+0000 7f8257e00700 10 client.37856 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:16:26.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.455+0000 7f8257e00700 1 -- 172.21.15.70:0/3529834884 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558c517b9230 con 0x558c51817090 2024-05-08T09:16:26.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.455+0000 7f8257e00700 10 client.37856 handle_command_reply: tid=0 2024-05-08T09:16:26.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.455+0000 7f82873bcb80 1 client.37856 shutdown 2024-05-08T09:16:26.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.455+0000 7f82873bcb80 1 -- 172.21.15.70:0/3529834884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 msgr2=0x558c517f88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:26.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.455+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f88b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f82680aa490 tx=0x7f82680a6650 comp rx=0 tx=0).stop 2024-05-08T09:16:26.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.455+0000 7f82873bcb80 1 -- 172.21.15.70:0/3529834884 shutdown_connections 2024-05-08T09:16:26.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.456+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c51817090 0x558c518194e0 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.456+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 0x558c517f6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.456+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f88b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.456+0000 7f82873bcb80 1 --2- 172.21.15.70:0/3529834884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c517f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.456+0000 7f8257e00700 0 client.37856 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:16:26.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.456+0000 7f82873bcb80 1 -- 172.21.15.70:0/3529834884 >> 172.21.15.70:0/3529834884 conn(0x558c5171acf0 msgr2=0x558c517e18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:16:26.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.456+0000 7f82873bcb80 1 -- 172.21.15.70:0/3529834884 shutdown_connections 2024-05-08T09:16:26.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.456+0000 7f82873bcb80 1 -- 172.21.15.70:0/3529834884 wait complete. 2024-05-08T09:16:26.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.456+0000 7f82873bcb80 20 client.37856 trim_cache size 0 max 16384 2024-05-08T09:16:26.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.491+0000 7f82873bcb80 1 Processor -- start 2024-05-08T09:16:26.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.491+0000 7f82873bcb80 1 -- start start 2024-05-08T09:16:26.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.492+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.492+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c5181edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.492+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 0x558c5181f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.492+0000 7f82873bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82781afbc0 con 0x558c517ecee0 2024-05-08T09:16:26.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.492+0000 7f82873bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82781ad450 con 0x558c517ec520 2024-05-08T09:16:26.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.492+0000 7f82873bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8278073ba0 con 0x558c517f1f50 2024-05-08T09:16:26.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.493+0000 7f8275e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.492+0000 7f8275400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c5181edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.493+0000 7f8275e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:57620/0 (socket says 172.21.15.70:57620) 2024-05-08T09:16:26.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.493+0000 7f8275e00700 1 -- 172.21.15.70:0/2459961856 learned_addr learned my addr 172.21.15.70:0/2459961856 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:16:26.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.493+0000 7f8276800700 1 --2- 172.21.15.70:0/2459961856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 0x558c5181f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.493+0000 7f8275400700 1 -- 172.21.15.70:0/2459961856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 msgr2=0x558c5181f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:16:26.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.494+0000 7f8275400700 1 --2- 172.21.15.70:0/2459961856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 0x558c5181f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.494+0000 7f8275400700 1 -- 172.21.15.70:0/2459961856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 msgr2=0x558c517f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:16:26.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.494+0000 7f8275400700 1 --2- 172.21.15.70:0/2459961856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.494+0000 7f8275400700 1 -- 172.21.15.70:0/2459961856 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c51819b60 con 0x558c517ecee0 2024-05-08T09:16:26.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.494+0000 7f8275e00700 1 --2- 172.21.15.70:0/2459961856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:16:26.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.494+0000 7f8275400700 1 --2- 172.21.15.70:0/2459961856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c5181edf0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x558c51819d30 tx=0x7f8264014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57edd870208382d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:16:26.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.494+0000 7f8262a00700 1 -- 172.21.15.70:0/2459961856 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826402d070 con 0x558c517ecee0 2024-05-08T09:16:26.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.494+0000 7f8262a00700 1 -- 172.21.15.70:0/2459961856 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8264004050 con 0x558c517ecee0 2024-05-08T09:16:26.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.494+0000 7f8262a00700 1 -- 172.21.15.70:0/2459961856 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8264027460 con 0x558c517ecee0 2024-05-08T09:16:26.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.496+0000 7f82873bcb80 1 -- 172.21.15.70:0/2459961856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 msgr2=0x558c5181edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:26.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.496+0000 7f82873bcb80 1 --2- 172.21.15.70:0/2459961856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c5181edf0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x558c51819d30 tx=0x7f8264014000 comp rx=0 tx=0).stop 2024-05-08T09:16:26.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.496+0000 7f82873bcb80 1 -- 172.21.15.70:0/2459961856 shutdown_connections 2024-05-08T09:16:26.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.496+0000 7f82873bcb80 1 --2- 172.21.15.70:0/2459961856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517f1f50 0x558c5181f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.496+0000 7f82873bcb80 1 --2- 172.21.15.70:0/2459961856 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517ec520 0x558c517f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.496+0000 7f82873bcb80 1 --2- 172.21.15.70:0/2459961856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ecee0 0x558c5181edf0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.496+0000 7f82873bcb80 1 -- 172.21.15.70:0/2459961856 >> 172.21.15.70:0/2459961856 conn(0x558c5171acf0 msgr2=0x558c517ebda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:16:26.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.496+0000 7f82873bcb80 1 -- 172.21.15.70:0/2459961856 shutdown_connections 2024-05-08T09:16:26.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.496+0000 7f82873bcb80 1 -- 172.21.15.70:0/2459961856 wait complete. 2024-05-08T09:16:26.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.497+0000 7f82873bcb80 1 -- start start 2024-05-08T09:16:26.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.497+0000 7f82873bcb80 1 Processor -- start 2024-05-08T09:16:26.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.497+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ec520 0x558c517fe740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.497+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ecee0 0x558c517fec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.497+0000 7f82873bcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517f1f50 0x558c517fbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.497+0000 7f82873bcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f82780741f0 con 0x558c517ec520 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.497+0000 7f82873bcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f82781acdf0 con 0x558c517f1f50 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.497+0000 7f82873bcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f82780748c0 con 0x558c517ecee0 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.497+0000 7f82873bcb80 10 client.0 _ll_register_callbacks cb 0x558c516e5e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ec520 0x558c517fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ec520 0x558c517fe740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46500/0 (socket says 172.21.15.70:46500) 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275e00700 1 -- 172.21.15.70:0/551344950 learned_addr learned my addr 172.21.15.70:0/551344950 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275e00700 1 -- 172.21.15.70:0/551344950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ecee0 msgr2=0x558c517fec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275400700 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ecee0 0x558c517fec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8276800700 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517f1f50 0x558c517fbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275e00700 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ecee0 0x558c517fec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275e00700 1 -- 172.21.15.70:0/551344950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517f1f50 msgr2=0x558c517fbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:16:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275e00700 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517f1f50 0x558c517fbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275e00700 1 -- 172.21.15.70:0/551344950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c517e3a10 con 0x558c517ec520 2024-05-08T09:16:26.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.498+0000 7f8275400700 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ecee0 0x558c517fec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.499+0000 7f8275e00700 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ec520 0x558c517fe740 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f82680aa490 tx=0x7f8268005560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413dd89001b39325 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.499+0000 7f8257e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.499+0000 7f8257e00700 1 -- 172.21.15.70:0/551344950 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82680aa0e0 con 0x558c517ec520 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.499+0000 7f8257e00700 1 -- 172.21.15.70:0/551344950 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(376..376 src has 1..376) ==== 9583+0+0 (secure 0 0 0) 0x7f8268003b10 con 0x558c517ec520 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.499+0000 7f82873bcb80 1 -- 172.21.15.70:0/551344950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8264004050 con 0x558c517ec520 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.499+0000 7f8257e00700 1 -- 172.21.15.70:0/551344950 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f82680aa2a0 con 0x558c517ec520 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.499+0000 7f82873bcb80 10 client.19293 fetch_fsmap learned FSMap version 42 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.499+0000 7f82873bcb80 1 -- 172.21.15.70:0/551344950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558c517e79e0 con 0x558c517ec520 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.500+0000 7f8257e00700 1 -- 172.21.15.70:0/551344950 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8264004050 con 0x558c517ec520 2024-05-08T09:16:26.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.500+0000 7f8257e00700 1 -- 172.21.15.70:0/551344950 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f82680b30d0 con 0x558c517ec520 2024-05-08T09:16:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.500+0000 7f82873bcb80 10 client.19293 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:16:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.500+0000 7f82873bcb80 10 client.19293 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:16:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.500+0000 7f82873bcb80 20 client.19293 populate_metadata read hostname 'smithi070' 2024-05-08T09:16:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.500+0000 7f82873bcb80 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c518835c0 0x558c518859e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:16:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.500+0000 7f82873bcb80 4 client.19293 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-05-08T09:16:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.500+0000 7f82873bcb80 1 -- 172.21.15.70:0/551344950 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x558c5174c590 con 0x558c518835c0 2024-05-08T09:16:26.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.501+0000 7f8275400700 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c518835c0 0x558c518859e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:16:26.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.503+0000 7f8275400700 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c518835c0 0x558c518859e0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4253762ae199326a server_cookie=9a19d958c5b3c857 in_seq=0 out_seq=0 2024-05-08T09:16:26.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:26.503+0000 7f8257e00700 10 client.19293 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:16:27.112 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_ioc32.o 2024-05-08T09:16:27.236 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_ttm_pm.o 2024-05-08T09:16:27.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:27 smithi172 ceph-mon[33377]: pgmap v4781: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 792 KiB/s wr, 30 op/s 2024-05-08T09:16:28.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:27 smithi194 ceph-mon[33679]: pgmap v4781: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 792 KiB/s wr, 30 op/s 2024-05-08T09:16:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:27 smithi070 ceph-mon[29591]: pgmap v4781: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 792 KiB/s wr, 30 op/s 2024-05-08T09:16:29.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:29 smithi172 ceph-mon[33377]: pgmap v4782: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 793 KiB/s wr, 30 op/s 2024-05-08T09:16:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:29 smithi194 ceph-mon[33679]: pgmap v4782: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 793 KiB/s wr, 30 op/s 2024-05-08T09:16:30.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:29 smithi070 ceph-mon[29591]: pgmap v4782: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 793 KiB/s wr, 30 op/s 2024-05-08T09:16:30.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:16:31.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:16:31.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:16:31.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:31 smithi172 ceph-mon[33377]: pgmap v4783: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 42 op/s 2024-05-08T09:16:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:31 smithi194 ceph-mon[33679]: pgmap v4783: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 42 op/s 2024-05-08T09:16:32.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:31 smithi070 ceph-mon[29591]: pgmap v4783: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 42 op/s 2024-05-08T09:16:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:33 smithi194 ceph-mon[33679]: pgmap v4784: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 638 KiB/s wr, 26 op/s 2024-05-08T09:16:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:33 smithi070 ceph-mon[29591]: pgmap v4784: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 638 KiB/s wr, 26 op/s 2024-05-08T09:16:34.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:33 smithi172 ceph-mon[33377]: pgmap v4784: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 638 KiB/s wr, 26 op/s 2024-05-08T09:16:34.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:16:34.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:16:34.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:16:35.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:16:35.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:16:35.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:16:35.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:16:35.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:16:35.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:16:36.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:35 smithi194 ceph-mon[33679]: pgmap v4785: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 834 KiB/s wr, 29 op/s 2024-05-08T09:16:36.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:35 smithi070 ceph-mon[29591]: pgmap v4785: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 834 KiB/s wr, 29 op/s 2024-05-08T09:16:36.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:35 smithi172 ceph-mon[33377]: pgmap v4785: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 834 KiB/s wr, 29 op/s 2024-05-08T09:16:37.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:37 smithi070 ceph-mon[29591]: pgmap v4786: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 522 KiB/s wr, 15 op/s 2024-05-08T09:16:38.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:37 smithi194 ceph-mon[33679]: pgmap v4786: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 522 KiB/s wr, 15 op/s 2024-05-08T09:16:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:37 smithi172 ceph-mon[33377]: pgmap v4786: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 522 KiB/s wr, 15 op/s 2024-05-08T09:16:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:39 smithi194 ceph-mon[33679]: pgmap v4787: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 522 KiB/s wr, 15 op/s 2024-05-08T09:16:40.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:39 smithi070 ceph-mon[29591]: pgmap v4787: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 522 KiB/s wr, 15 op/s 2024-05-08T09:16:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:39 smithi172 ceph-mon[33377]: pgmap v4787: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 522 KiB/s wr, 15 op/s 2024-05-08T09:16:42.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:41 smithi194 ceph-mon[33679]: pgmap v4788: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 590 KiB/s wr, 19 op/s 2024-05-08T09:16:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:41 smithi070 ceph-mon[29591]: pgmap v4788: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 590 KiB/s wr, 19 op/s 2024-05-08T09:16:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:41 smithi172 ceph-mon[33377]: pgmap v4788: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 590 KiB/s wr, 19 op/s 2024-05-08T09:16:44.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:43 smithi194 ceph-mon[33679]: pgmap v4789: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 264 KiB/s wr, 7 op/s 2024-05-08T09:16:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:43 smithi070 ceph-mon[29591]: pgmap v4789: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 264 KiB/s wr, 7 op/s 2024-05-08T09:16:44.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:43 smithi172 ceph-mon[33377]: pgmap v4789: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 264 KiB/s wr, 7 op/s 2024-05-08T09:16:46.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:45 smithi194 ceph-mon[33679]: pgmap v4790: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 286 KiB/s wr, 10 op/s 2024-05-08T09:16:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:45 smithi070 ceph-mon[29591]: pgmap v4790: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 286 KiB/s wr, 10 op/s 2024-05-08T09:16:46.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:45 smithi172 ceph-mon[33377]: pgmap v4790: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 286 KiB/s wr, 10 op/s 2024-05-08T09:16:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:47 smithi194 ceph-mon[33679]: pgmap v4791: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T09:16:48.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:47 smithi070 ceph-mon[29591]: pgmap v4791: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T09:16:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:47 smithi172 ceph-mon[33377]: pgmap v4791: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T09:16:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:49 smithi194 ceph-mon[33679]: pgmap v4792: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T09:16:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:49 smithi070 ceph-mon[29591]: pgmap v4792: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T09:16:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:49 smithi172 ceph-mon[33377]: pgmap v4792: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 90 KiB/s wr, 7 op/s 2024-05-08T09:16:51.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.920+0000 7f8257e00700 1 -- 172.21.15.70:0/551344950 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x558c5174c590 con 0x558c518835c0 2024-05-08T09:16:51.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.920+0000 7f8257e00700 10 client.19293 handle_command_reply: tid=0 2024-05-08T09:16:51.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.920+0000 7f82873bcb80 1 client.19293 shutdown 2024-05-08T09:16:51.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.921+0000 7f82873bcb80 1 -- 172.21.15.70:0/551344950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ec520 msgr2=0x558c517fe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:51.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.921+0000 7f82873bcb80 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ec520 0x558c517fe740 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f82680aa490 tx=0x7f8268005560 comp rx=0 tx=0).stop 2024-05-08T09:16:51.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.922+0000 7f82873bcb80 1 -- 172.21.15.70:0/551344950 shutdown_connections 2024-05-08T09:16:51.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.922+0000 7f82873bcb80 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x558c518835c0 0x558c518859e0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:51.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.922+0000 7f82873bcb80 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x558c517f1f50 0x558c517fbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:51.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.922+0000 7f82873bcb80 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558c517ec520 0x558c517fe740 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:51.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.922+0000 7f82873bcb80 1 --2- 172.21.15.70:0/551344950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x558c517ecee0 0x558c517fec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:51.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.922+0000 7f82873bcb80 1 -- 172.21.15.70:0/551344950 >> 172.21.15.70:0/551344950 conn(0x558c5171acf0 msgr2=0x558c517e1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:16:51.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.922+0000 7f8257e00700 0 client.19293 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.922+0000 7f82873bcb80 1 -- 172.21.15.70:0/551344950 shutdown_connections 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.922+0000 7f82873bcb80 1 -- 172.21.15.70:0/551344950 wait complete. 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.923+0000 7f82873bcb80 20 client.19293 trim_cache size 0 max 16384 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 330, 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "527f8b26": { 2024-05-08T09:16:51.924 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 330, 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:16:51.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:16:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:16:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:16:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:16:51.926 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:16:51.926 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.924+0000 7f827ca00700 1 -- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f825c0b2b20 msgr2=0x7f825c0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.924+0000 7f827ca00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f825c0b2b20 0x7f825c0b4fe0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f827810ade0 tx=0x7f8264009260 comp rx=0 tx=0).stop 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.924+0000 7f827ca00700 1 -- 172.21.15.70:0/593076918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82781056e0 msgr2=0x7f8278112210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.924+0000 7f827ca00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82781056e0 0x7f8278112210 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8268005950 tx=0x7f826800fa00 comp rx=0 tx=0).stop 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.925+0000 7f827ca00700 1 -- 172.21.15.70:0/593076918 shutdown_connections 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.925+0000 7f827ca00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f825c0b2b20 0x7f825c0b4fe0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.925+0000 7f827ca00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f827810b6e0 0x7f8278110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.925+0000 7f827ca00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f82781056e0 0x7f8278112210 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.925+0000 7f827ca00700 1 --2- 172.21.15.70:0/593076918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82781060a0 0x7f8278110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.925+0000 7f827ca00700 1 -- 172.21.15.70:0/593076918 >> 172.21.15.70:0/593076918 conn(0x7f82781011d0 msgr2=0x7f82781019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.925+0000 7f827ca00700 1 -- 172.21.15.70:0/593076918 shutdown_connections 2024-05-08T09:16:51.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:16:51.926+0000 7f827ca00700 1 -- 172.21.15.70:0/593076918 wait complete. 2024-05-08T09:16:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:51 smithi194 ceph-mon[33679]: pgmap v4793: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 16 op/s 2024-05-08T09:16:52.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:51 smithi070 ceph-mon[29591]: pgmap v4793: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 16 op/s 2024-05-08T09:16:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:51 smithi172 ceph-mon[33377]: pgmap v4793: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 173 KiB/s wr, 16 op/s 2024-05-08T09:16:52.823 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '527f8b26', quiesce took 36.3 seconds. Will release after: 10 2024-05-08T09:16:54.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:53 smithi194 ceph-mon[33679]: pgmap v4794: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 105 KiB/s wr, 12 op/s 2024-05-08T09:16:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:53 smithi070 ceph-mon[29591]: pgmap v4794: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 105 KiB/s wr, 12 op/s 2024-05-08T09:16:54.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:53 smithi172 ceph-mon[33377]: pgmap v4794: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 105 KiB/s wr, 12 op/s 2024-05-08T09:16:56.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:55 smithi194 ceph-mon[33679]: pgmap v4795: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 180 KiB/s wr, 16 op/s 2024-05-08T09:16:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:55 smithi070 ceph-mon[29591]: pgmap v4795: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 180 KiB/s wr, 16 op/s 2024-05-08T09:16:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:55 smithi172 ceph-mon[33377]: pgmap v4795: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 180 KiB/s wr, 16 op/s 2024-05-08T09:16:58.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:57 smithi194 ceph-mon[33679]: pgmap v4796: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 158 KiB/s wr, 12 op/s 2024-05-08T09:16:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:57 smithi070 ceph-mon[29591]: pgmap v4796: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 158 KiB/s wr, 12 op/s 2024-05-08T09:16:58.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:57 smithi172 ceph-mon[33377]: pgmap v4796: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 158 KiB/s wr, 12 op/s 2024-05-08T09:17:00.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:16:59 smithi194 ceph-mon[33679]: pgmap v4797: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 158 KiB/s wr, 12 op/s 2024-05-08T09:17:00.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:16:59 smithi070 ceph-mon[29591]: pgmap v4797: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 158 KiB/s wr, 12 op/s 2024-05-08T09:17:00.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:16:59 smithi172 ceph-mon[33377]: pgmap v4797: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 158 KiB/s wr, 12 op/s 2024-05-08T09:17:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:01 smithi070 ceph-mon[29591]: pgmap v4798: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 208 KiB/s wr, 17 op/s 2024-05-08T09:17:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:01 smithi172 ceph-mon[33377]: pgmap v4798: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 208 KiB/s wr, 17 op/s 2024-05-08T09:17:02.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:01 smithi194 ceph-mon[33679]: pgmap v4798: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 209 KiB/s rd, 208 KiB/s wr, 17 op/s 2024-05-08T09:17:02.825 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:17:03.337 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:17:04.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:03 smithi070 ceph-mon[29591]: pgmap v4799: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T09:17:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:03 smithi172 ceph-mon[33377]: pgmap v4799: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T09:17:04.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:03 smithi194 ceph-mon[33679]: pgmap v4799: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 126 KiB/s wr, 8 op/s 2024-05-08T09:17:06.064 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:05 smithi070 ceph-mon[29591]: pgmap v4800: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 253 KiB/s wr, 29 op/s 2024-05-08T09:17:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:05 smithi172 ceph-mon[33377]: pgmap v4800: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 253 KiB/s wr, 29 op/s 2024-05-08T09:17:06.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:05 smithi194 ceph-mon[33679]: pgmap v4800: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 253 KiB/s wr, 29 op/s 2024-05-08T09:17:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.363+0000 7f4171000700 1 -- 172.21.15.70:0/434302512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103550 msgr2=0x7f416c1039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.363+0000 7f4171000700 1 --2- 172.21.15.70:0/434302512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103550 0x7f416c1039b0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f4158009990 tx=0x7f4158009ca0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.363+0000 7f4171000700 1 -- 172.21.15.70:0/434302512 shutdown_connections 2024-05-08T09:17:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.363+0000 7f4171000700 1 --2- 172.21.15.70:0/434302512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f416c103ef0 0x7f416c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.363+0000 7f4171000700 1 --2- 172.21.15.70:0/434302512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f416c108460 0x7f416c108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.363+0000 7f4171000700 1 --2- 172.21.15.70:0/434302512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103550 0x7f416c1039b0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.363+0000 7f4171000700 1 -- 172.21.15.70:0/434302512 >> 172.21.15.70:0/434302512 conn(0x7f416c07a600 msgr2=0x7f416c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.363+0000 7f4171000700 1 -- 172.21.15.70:0/434302512 shutdown_connections 2024-05-08T09:17:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.364+0000 7f4171000700 1 -- 172.21.15.70:0/434302512 wait complete. 2024-05-08T09:17:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.365+0000 7f4171000700 1 Processor -- start 2024-05-08T09:17:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.365+0000 7f4171000700 1 -- start start 2024-05-08T09:17:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.365+0000 7f4171000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f416c103550 0x7f416c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.365+0000 7f4171000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103ef0 0x7f416c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.365+0000 7f4171000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f416c108460 0x7f416c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.365+0000 7f4171000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f416c113540 con 0x7f416c103ef0 2024-05-08T09:17:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.365+0000 7f4171000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1133c0 con 0x7f416c108460 2024-05-08T09:17:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.365+0000 7f4171000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f416c1136c0 con 0x7f416c103550 2024-05-08T09:17:06.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.365+0000 7f4169400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103ef0 0x7f416c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f4169400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103ef0 0x7f416c19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59342/0 (socket says 172.21.15.70:59342) 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f4169400700 1 -- 172.21.15.70:0/1619775978 learned_addr learned my addr 172.21.15.70:0/1619775978 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f416a800700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f416c108460 0x7f416c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f4169e00700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f416c103550 0x7f416c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f4169400700 1 -- 172.21.15.70:0/1619775978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f416c103550 msgr2=0x7f416c19f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f4169400700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f416c103550 0x7f416c19f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f4169400700 1 -- 172.21.15.70:0/1619775978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f416c108460 msgr2=0x7f416c1998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f4169400700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f416c108460 0x7f416c1998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f4169400700 1 -- 172.21.15.70:0/1619775978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c19a020 con 0x7f416c103ef0 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.366+0000 7f4169400700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103ef0 0x7f416c19fc40 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f4158006010 tx=0x7f415800bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.367+0000 7f4162a00700 1 -- 172.21.15.70:0/1619775978 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415800fb30 con 0x7f416c103ef0 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.367+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c19a2b0 con 0x7f416c103ef0 2024-05-08T09:17:06.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.367+0000 7f4162a00700 1 -- 172.21.15.70:0/1619775978 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f415800fcd0 con 0x7f416c103ef0 2024-05-08T09:17:06.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.367+0000 7f4162a00700 1 -- 172.21.15.70:0/1619775978 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4158017650 con 0x7f416c103ef0 2024-05-08T09:17:06.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.367+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c0756d0 con 0x7f416c103ef0 2024-05-08T09:17:06.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.368+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c06a190 con 0x7f416c103ef0 2024-05-08T09:17:06.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.370+0000 7f4162a00700 1 -- 172.21.15.70:0/1619775978 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4158009d10 con 0x7f416c103ef0 2024-05-08T09:17:06.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.372+0000 7f4162a00700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41500b2a70 0x7f41500b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:06.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.372+0000 7f4162a00700 1 -- 172.21.15.70:0/1619775978 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(376..376 src has 1..376) ==== 9583+0+0 (secure 0 0 0) 0x7f41580e7cf0 con 0x7f416c103ef0 2024-05-08T09:17:06.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.372+0000 7f4169e00700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41500b2a70 0x7f41500b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:06.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.373+0000 7f4169e00700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41500b2a70 0x7f41500b4f30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f416c19aa00 tx=0x7f415c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:06.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.375+0000 7f4162a00700 1 -- 172.21.15.70:0/1619775978 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4158013070 con 0x7f416c103ef0 2024-05-08T09:17:06.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.657+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f416c19adf0 con 0x7f416c103ef0 2024-05-08T09:17:06.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.659+0000 7f4162a00700 1 -- 172.21.15.70:0/1619775978 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f41580af480 con 0x7f416c103ef0 2024-05-08T09:17:06.660 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:17:06.660 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41500b2a70 msgr2=0x7f41500b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41500b2a70 0x7f41500b4f30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f416c19aa00 tx=0x7f415c009260 comp rx=0 tx=0).stop 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103ef0 msgr2=0x7f416c19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103ef0 0x7f416c19fc40 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f4158006010 tx=0x7f415800bfc0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 shutdown_connections 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f41500b2a70 0x7f41500b4f30 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f416c108460 0x7f416c1998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f416c103550 0x7f416c19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 --2- 172.21.15.70:0/1619775978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f416c103ef0 0x7f416c19fc40 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 >> 172.21.15.70:0/1619775978 conn(0x7f416c07a600 msgr2=0x7f416c1016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 shutdown_connections 2024-05-08T09:17:06.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:06.662+0000 7f4171000700 1 -- 172.21.15.70:0/1619775978 wait complete. 2024-05-08T09:17:06.664 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:17:07.027 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:06 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1619775978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:17:07.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:06 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1619775978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:17:07.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:06 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1619775978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:17:07.455 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 527f8b26 --release --await' 2024-05-08T09:17:07.456 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 527f8b26 --release --await 2024-05-08T09:17:07.897 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:17:08.047 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:07 smithi070 ceph-mon[29591]: pgmap v4801: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 177 KiB/s wr, 25 op/s 2024-05-08T09:17:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:07 smithi172 ceph-mon[33377]: pgmap v4801: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 177 KiB/s wr, 25 op/s 2024-05-08T09:17:08.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:07 smithi194 ceph-mon[33679]: pgmap v4801: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 177 KiB/s wr, 25 op/s 2024-05-08T09:17:09.094 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:08 smithi070 ceph-mon[29591]: pgmap v4802: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 177 KiB/s wr, 25 op/s 2024-05-08T09:17:09.164 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:08 smithi194 ceph-mon[33679]: pgmap v4802: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 177 KiB/s wr, 25 op/s 2024-05-08T09:17:09.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:08 smithi172 ceph-mon[33377]: pgmap v4802: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 177 KiB/s wr, 25 op/s 2024-05-08T09:17:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.130+0000 7f9fca800700 1 -- 172.21.15.70:0/2660882207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102ee0 msgr2=0x7f9fc4106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.130+0000 7f9fca800700 1 --2- 172.21.15.70:0/2660882207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102ee0 0x7f9fc4106f30 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00099c0 tx=0x7f9fb0009cd0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.130+0000 7f9fca800700 1 -- 172.21.15.70:0/2660882207 shutdown_connections 2024-05-08T09:17:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.130+0000 7f9fca800700 1 --2- 172.21.15.70:0/2660882207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fc4107610 0x7f9fc410f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.130+0000 7f9fca800700 1 --2- 172.21.15.70:0/2660882207 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4102530 0x7f9fc4102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.130+0000 7f9fca800700 1 --2- 172.21.15.70:0/2660882207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102ee0 0x7f9fc4106f30 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.130+0000 7f9fca800700 1 -- 172.21.15.70:0/2660882207 >> 172.21.15.70:0/2660882207 conn(0x7f9fc40fddc0 msgr2=0x7f9fc41001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.130+0000 7f9fca800700 1 -- 172.21.15.70:0/2660882207 shutdown_connections 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.130+0000 7f9fca800700 1 -- 172.21.15.70:0/2660882207 wait complete. 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.132+0000 7f9fca800700 1 Processor -- start 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.132+0000 7f9fca800700 1 -- start start 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.132+0000 7f9fca800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102530 0x7f9fc419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.132+0000 7f9fca800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fc4102ee0 0x7f9fc419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.132+0000 7f9fca800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4107610 0x7f9fc4199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.132+0000 7f9fca800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc4112350 con 0x7f9fc4102530 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.132+0000 7f9fca800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41121d0 con 0x7f9fc4107610 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.132+0000 7f9fca800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41124d0 con 0x7f9fc4102ee0 2024-05-08T09:17:10.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102530 0x7f9fc419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102530 0x7f9fc419f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37646/0 (socket says 172.21.15.70:37646) 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9400700 1 -- 172.21.15.70:0/3086044245 learned_addr learned my addr 172.21.15.70:0/3086044245 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fc4102ee0 0x7f9fc419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9e00700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4107610 0x7f9fc4199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9400700 1 -- 172.21.15.70:0/3086044245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fc4102ee0 msgr2=0x7f9fc419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9400700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fc4102ee0 0x7f9fc419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9400700 1 -- 172.21.15.70:0/3086044245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4107610 msgr2=0x7f9fc4199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9400700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4107610 0x7f9fc4199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9400700 1 -- 172.21.15.70:0/3086044245 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc419a040 con 0x7f9fc4102530 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.133+0000 7f9fc9e00700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4107610 0x7f9fc4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:17:10.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.134+0000 7f9fc9400700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102530 0x7f9fc419f640 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800c9b0 tx=0x7f9fb800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.134+0000 7f9fc2000700 1 -- 172.21.15.70:0/3086044245 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8007b00 con 0x7f9fc4102530 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.134+0000 7f9fc2000700 1 -- 172.21.15.70:0/3086044245 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fb8007ca0 con 0x7f9fc4102530 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.134+0000 7f9fc2000700 1 -- 172.21.15.70:0/3086044245 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb8018660 con 0x7f9fc4102530 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.134+0000 7f9fca800700 1 -- 172.21.15.70:0/3086044245 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc419a330 con 0x7f9fc4102530 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.134+0000 7f9fca800700 1 -- 172.21.15.70:0/3086044245 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc41a65c0 con 0x7f9fc4102530 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.137+0000 7f9fc2000700 1 -- 172.21.15.70:0/3086044245 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9fb800f450 con 0x7f9fc4102530 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.139+0000 7f9fc2000700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9fac0b29f0 0x7f9fac0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.139+0000 7f9fc2000700 1 -- 172.21.15.70:0/3086044245 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(376..376 src has 1..376) ==== 9583+0+0 (secure 0 0 0) 0x7f9fb80e2b50 con 0x7f9fc4102530 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.139+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9fac0b29f0 0x7f9fac0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.140+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9fac0b29f0 0x7f9fac0b4eb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009990 tx=0x7f9fb001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.484+0000 7f9fd67afb80 1 Processor -- start 2024-05-08T09:17:10.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.485+0000 7f9fd67afb80 1 -- start start 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.485+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 0x55787044da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.485+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870447b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.485+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 0x557870448610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.485+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557870395b20 con 0x55787044df80 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.485+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557870333860 con 0x55787044d660 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.485+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557870391ae0 con 0x5578704481b0 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870447b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870447b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37660/0 (socket says 172.21.15.70:37660) 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc8a00700 1 -- 172.21.15.70:0/2988213630 learned_addr learned my addr 172.21.15.70:0/2988213630 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc9400700 1 --2- 172.21.15.70:0/2988213630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 0x55787044da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc9e00700 1 --2- 172.21.15.70:0/2988213630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 0x557870448610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc8a00700 1 -- 172.21.15.70:0/2988213630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 msgr2=0x557870448610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/2988213630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 0x557870448610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc8a00700 1 -- 172.21.15.70:0/2988213630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 msgr2=0x55787044da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/2988213630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 0x55787044da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.486+0000 7f9fc8a00700 1 -- 172.21.15.70:0/2988213630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578702e29d0 con 0x55787044df80 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.487+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/2988213630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870447b90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000a010 tx=0x7f9fb001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be27eaa1649d476d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.487+0000 7f9fb6a00700 1 -- 172.21.15.70:0/2988213630 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0004690 con 0x55787044df80 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.487+0000 7f9fb6a00700 1 -- 172.21.15.70:0/2988213630 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fb0004cc0 con 0x55787044df80 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.487+0000 7f9fb6a00700 1 -- 172.21.15.70:0/2988213630 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb002fc80 con 0x55787044df80 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.488+0000 7f9fd67afb80 1 -- 172.21.15.70:0/2988213630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 msgr2=0x557870447b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.488+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/2988213630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870447b90 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000a010 tx=0x7f9fb001e000 comp rx=0 tx=0).stop 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.488+0000 7f9fd67afb80 1 -- 172.21.15.70:0/2988213630 shutdown_connections 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.488+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/2988213630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 0x557870448610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.488+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/2988213630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 0x55787044da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.488+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/2988213630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870447b90 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.488+0000 7f9fd67afb80 1 -- 172.21.15.70:0/2988213630 >> 172.21.15.70:0/2988213630 conn(0x5578703bb7d0 msgr2=0x55787043e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.489+0000 7f9fd67afb80 1 -- 172.21.15.70:0/2988213630 shutdown_connections 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.489+0000 7f9fd67afb80 1 -- 172.21.15.70:0/2988213630 wait complete. 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.489+0000 7f9fd67afb80 1 -- start start 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.489+0000 7f9fd67afb80 1 Processor -- start 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.490+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 0x557870453c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.490+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 0x557870450fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.490+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870451510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.490+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557870454a40 con 0x55787044df80 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.490+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5578702fbc20 con 0x55787044d660 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.490+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557870454bc0 con 0x5578704481b0 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.490+0000 7f9fd67afb80 10 client.0 _ll_register_callbacks cb 0x55787033cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:17:10.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870451510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870451510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37662/0 (socket says 172.21.15.70:37662) 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 0x557870453c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc9e00700 1 -- 172.21.15.70:0/895337144 learned_addr learned my addr 172.21.15.70:0/895337144 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 0x557870450fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc9e00700 1 -- 172.21.15.70:0/895337144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 msgr2=0x557870453c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc9e00700 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 0x557870453c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc9e00700 1 -- 172.21.15.70:0/895337144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 msgr2=0x557870450fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc9e00700 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 0x557870450fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.491+0000 7f9fc9e00700 1 -- 172.21.15.70:0/895337144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55787035b520 con 0x55787044df80 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.492+0000 7f9fc9e00700 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870451510 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc008f00 tx=0x7f9fbc0104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0ea6d08f9b4707 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.492+0000 7f9fab400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:17:10.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.492+0000 7f9fab400700 1 -- 172.21.15.70:0/895337144 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fbc019020 con 0x55787044df80 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.492+0000 7f9fab400700 1 -- 172.21.15.70:0/895337144 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(376..376 src has 1..376) ==== 9583+0+0 (secure 0 0 0) 0x7f9fbc010ac0 con 0x55787044df80 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.492+0000 7f9fd67afb80 1 -- 172.21.15.70:0/895337144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fb0004cc0 con 0x55787044df80 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.493+0000 7f9fab400700 1 -- 172.21.15.70:0/895337144 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9fbc024050 con 0x55787044df80 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.493+0000 7f9fd67afb80 10 client.19311 fetch_fsmap learned FSMap version 42 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.493+0000 7f9fd67afb80 1 -- 172.21.15.70:0/895337144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55787045f290 con 0x55787044df80 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.493+0000 7f9fab400700 1 -- 172.21.15.70:0/895337144 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fb0004cc0 con 0x55787044df80 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.493+0000 7f9fab400700 1 -- 172.21.15.70:0/895337144 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9fbc0143d0 con 0x55787044df80 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.494+0000 7f9fd67afb80 10 client.19311 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.494+0000 7f9fd67afb80 10 client.19311 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.494+0000 7f9fd67afb80 20 client.19311 populate_metadata read hostname 'smithi070' 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.494+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557870461920 0x557870463d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.494+0000 7f9fd67afb80 4 client.19311 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.494+0000 7f9fd67afb80 1 -- 172.21.15.70:0/895337144 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557870410240 con 0x557870461920 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.494+0000 7f9fc9400700 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557870461920 0x557870463d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.495+0000 7f9fc9400700 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557870461920 0x557870463d10 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad5279d6ce32fc20 server_cookie=fa4f96be15289fd0 in_seq=0 out_seq=0 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.495+0000 7f9fab400700 10 client.19311 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.497+0000 7f9fab400700 1 -- 172.21.15.70:0/895337144 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557870410240 con 0x557870461920 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.497+0000 7f9fab400700 10 client.19311 handle_command_reply: tid=0 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 client.19311 shutdown 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 -- 172.21.15.70:0/895337144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 msgr2=0x557870451510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870451510 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f9fbc008f00 tx=0x7f9fbc0104b0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 -- 172.21.15.70:0/895337144 shutdown_connections 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557870461920 0x557870463d10 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044df80 0x557870451510 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5578704481b0 0x557870453c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/895337144 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55787044d660 0x557870450fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 -- 172.21.15.70:0/895337144 >> 172.21.15.70:0/895337144 conn(0x5578703bb7d0 msgr2=0x557870446b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:10.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fab400700 0 client.19311 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:17:10.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 -- 172.21.15.70:0/895337144 shutdown_connections 2024-05-08T09:17:10.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 1 -- 172.21.15.70:0/895337144 wait complete. 2024-05-08T09:17:10.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.498+0000 7f9fd67afb80 20 client.19311 trim_cache size 0 max 16384 2024-05-08T09:17:10.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.521+0000 7f9fd67afb80 1 Processor -- start 2024-05-08T09:17:10.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.521+0000 7f9fd67afb80 1 -- start start 2024-05-08T09:17:10.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.521+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 0x55787045db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.521+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870451540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.521+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 0x557870447570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.521+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41afab0 con 0x55787044d660 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.521+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41ad340 con 0x5578704481b0 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.521+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41ab1b0 con 0x55787044df80 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870451540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc9400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 0x55787045db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870451540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37664/0 (socket says 172.21.15.70:37664) 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc8a00700 1 -- 172.21.15.70:0/735366421 learned_addr learned my addr 172.21.15.70:0/735366421 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc9e00700 1 --2- 172.21.15.70:0/735366421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 0x557870447570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc8a00700 1 -- 172.21.15.70:0/735366421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 msgr2=0x557870447570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:10.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/735366421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 0x557870447570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc8a00700 1 -- 172.21.15.70:0/735366421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 msgr2=0x55787045db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/735366421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 0x55787045db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.522+0000 7f9fc8a00700 1 -- 172.21.15.70:0/735366421 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55787044f540 con 0x55787044d660 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.523+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/735366421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870451540 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00099c0 tx=0x7f9fb0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcb6372d0b0511c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.523+0000 7f9fb6000700 1 -- 172.21.15.70:0/735366421 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb003e070 con 0x55787044d660 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.523+0000 7f9fb6000700 1 -- 172.21.15.70:0/735366421 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fb0004d20 con 0x55787044d660 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.523+0000 7f9fb6000700 1 -- 172.21.15.70:0/735366421 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb002f990 con 0x55787044d660 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.524+0000 7f9fd67afb80 1 -- 172.21.15.70:0/735366421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 msgr2=0x557870451540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.524+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/735366421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870451540 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f9fb00099c0 tx=0x7f9fb0009cd0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.524+0000 7f9fd67afb80 1 -- 172.21.15.70:0/735366421 shutdown_connections 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.524+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/735366421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 0x557870447570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.524+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/735366421 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 0x55787045db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.524+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/735366421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870451540 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.524+0000 7f9fd67afb80 1 -- 172.21.15.70:0/735366421 >> 172.21.15.70:0/735366421 conn(0x5578703bb7d0 msgr2=0x55787043e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.524+0000 7f9fd67afb80 1 -- 172.21.15.70:0/735366421 shutdown_connections 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.524+0000 7f9fd67afb80 1 -- 172.21.15.70:0/735366421 wait complete. 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.525+0000 7f9fd67afb80 1 -- start start 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.525+0000 7f9fd67afb80 1 Processor -- start 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.525+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 0x55787045a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.525+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870456e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.525+0000 7f9fd67afb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 0x557870457390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.525+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41ab800 con 0x55787044d660 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.525+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41acc70 con 0x5578704481b0 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.525+0000 7f9fd67afb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc41abed0 con 0x55787044df80 2024-05-08T09:17:10.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fd67afb80 10 client.0 _ll_register_callbacks cb 0x55787033cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870456e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc8a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870456e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37672/0 (socket says 172.21.15.70:37672) 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc8a00700 1 -- 172.21.15.70:0/1488392651 learned_addr learned my addr 172.21.15.70:0/1488392651 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc9400700 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 0x55787045a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc9e00700 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 0x557870457390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc8a00700 1 -- 172.21.15.70:0/1488392651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 msgr2=0x557870457390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 0x557870457390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc8a00700 1 -- 172.21.15.70:0/1488392651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 msgr2=0x55787045a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 0x55787045a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.526+0000 7f9fc8a00700 1 -- 172.21.15.70:0/1488392651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557870457980 con 0x55787044d660 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.527+0000 7f9fc8a00700 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870456e50 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f9fb003c040 tx=0x7f9fb002f4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f06d543774fe1d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.527+0000 7f9fab400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:17:10.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.527+0000 7f9fab400700 1 -- 172.21.15.70:0/1488392651 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb003e040 con 0x55787044d660 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.527+0000 7f9fd67afb80 1 -- 172.21.15.70:0/1488392651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fb0004d20 con 0x55787044d660 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.527+0000 7f9fab400700 1 -- 172.21.15.70:0/1488392651 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(376..376 src has 1..376) ==== 9583+0+0 (secure 0 0 0) 0x7f9fb002f790 con 0x55787044d660 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.527+0000 7f9fab400700 1 -- 172.21.15.70:0/1488392651 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9fb0005c00 con 0x55787044d660 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fd67afb80 10 client.19317 fetch_fsmap learned FSMap version 42 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fd67afb80 1 -- 172.21.15.70:0/1488392651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5578704cd000 con 0x55787044d660 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fab400700 1 -- 172.21.15.70:0/1488392651 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9fb0004d20 con 0x55787044d660 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fab400700 1 -- 172.21.15.70:0/1488392651 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9fb0022070 con 0x55787044d660 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fd67afb80 10 client.19317 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fd67afb80 10 client.19317 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fd67afb80 20 client.19317 populate_metadata read hostname 'smithi070' 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5578704cd290 0x5578704cf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fd67afb80 4 client.19317 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "527f8b26", "release": true, "await": true}] 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.528+0000 7f9fd67afb80 1 -- 172.21.15.70:0/1488392651 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "527f8b26", "release": true, "await": true}) -- 0x5578703a3500 con 0x5578704cd290 2024-05-08T09:17:10.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.529+0000 7f9fc9400700 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5578704cd290 0x5578704cf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:10.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.530+0000 7f9fc9400700 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5578704cd290 0x5578704cf680 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c79c8d74cfa6de6a server_cookie=79a58694ddb8eb18 in_seq=0 out_seq=0 2024-05-08T09:17:10.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:10.530+0000 7f9fab400700 10 client.19317 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:17:12.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:11 smithi194 ceph-mon[33679]: pgmap v4803: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 182 KiB/s wr, 28 op/s 2024-05-08T09:17:12.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:11 smithi070 ceph-mon[29591]: pgmap v4803: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 182 KiB/s wr, 28 op/s 2024-05-08T09:17:12.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:11 smithi172 ceph-mon[33377]: pgmap v4803: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 182 KiB/s wr, 28 op/s 2024-05-08T09:17:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:13 smithi194 ceph-mon[33679]: pgmap v4804: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 132 KiB/s wr, 24 op/s 2024-05-08T09:17:14.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:13 smithi070 ceph-mon[29591]: pgmap v4804: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 132 KiB/s wr, 24 op/s 2024-05-08T09:17:14.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:13 smithi172 ceph-mon[33377]: pgmap v4804: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 132 KiB/s wr, 24 op/s 2024-05-08T09:17:15.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.060+0000 7f9fab400700 1 -- 172.21.15.70:0/1488392651 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5578703a3500 con 0x5578704cd290 2024-05-08T09:17:15.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.060+0000 7f9fab400700 10 client.19317 handle_command_reply: tid=0 2024-05-08T09:17:15.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.060+0000 7f9fd67afb80 1 client.19317 shutdown 2024-05-08T09:17:15.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.061+0000 7f9fd67afb80 1 -- 172.21.15.70:0/1488392651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 msgr2=0x557870456e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.061+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870456e50 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f9fb003c040 tx=0x7f9fb002f4f0 comp rx=0 tx=0).stop 2024-05-08T09:17:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.064+0000 7f9fd67afb80 1 -- 172.21.15.70:0/1488392651 shutdown_connections 2024-05-08T09:17:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.064+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5578704cd290 0x5578704cf680 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.064+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55787044df80 0x557870457390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.064+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5578704481b0 0x55787045a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.064+0000 7f9fd67afb80 1 --2- 172.21.15.70:0/1488392651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55787044d660 0x557870456e50 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.064+0000 7f9fd67afb80 1 -- 172.21.15.70:0/1488392651 >> 172.21.15.70:0/1488392651 conn(0x5578703bb7d0 msgr2=0x557870447510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:15.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.064+0000 7f9fab400700 0 client.19317 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:17:15.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.066+0000 7f9fd67afb80 1 -- 172.21.15.70:0/1488392651 shutdown_connections 2024-05-08T09:17:15.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.066+0000 7f9fd67afb80 1 -- 172.21.15.70:0/1488392651 wait complete. 2024-05-08T09:17:15.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.066+0000 7f9fd67afb80 20 client.19317 trim_cache size 0 max 16384 2024-05-08T09:17:15.068 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 332, 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "527f8b26": { 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 332, 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T09:17:15.069 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:17:15.070 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:17:15.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 -- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9fac0b29f0 msgr2=0x7f9fac0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:15.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9fac0b29f0 0x7f9fac0b4eb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0009990 tx=0x7f9fb001a040 comp rx=0 tx=0).stop 2024-05-08T09:17:15.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 -- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102530 msgr2=0x7f9fc419f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:15.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102530 0x7f9fc419f640 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f9fb800c9b0 tx=0x7f9fb800cd70 comp rx=0 tx=0).stop 2024-05-08T09:17:15.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 -- 172.21.15.70:0/3086044245 shutdown_connections 2024-05-08T09:17:15.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9fac0b29f0 0x7f9fac0b4eb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:15.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9fc4107610 0x7f9fc4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:15.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9fc4102530 0x7f9fc419f640 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:15.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 --2- 172.21.15.70:0/3086044245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fc4102ee0 0x7f9fc419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:15.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 -- 172.21.15.70:0/3086044245 >> 172.21.15.70:0/3086044245 conn(0x7f9fc40fddc0 msgr2=0x7f9fc406b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:15.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.069+0000 7f9fca800700 1 -- 172.21.15.70:0/3086044245 shutdown_connections 2024-05-08T09:17:15.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:15.070+0000 7f9fca800700 1 -- 172.21.15.70:0/3086044245 wait complete. 2024-05-08T09:17:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:15 smithi070 ceph-mon[29591]: pgmap v4805: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 185 KiB/s wr, 26 op/s 2024-05-08T09:17:15.967 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '527f8b26', seconds elapsed: 59.4 2024-05-08T09:17:16.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:15 smithi194 ceph-mon[33679]: pgmap v4805: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 185 KiB/s wr, 26 op/s 2024-05-08T09:17:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:15 smithi172 ceph-mon[33377]: pgmap v4805: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 185 KiB/s wr, 26 op/s 2024-05-08T09:17:17.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:16 smithi194 ceph-mon[33679]: osdmap e377: 12 total, 12 up, 12 in 2024-05-08T09:17:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:16 smithi070 ceph-mon[29591]: osdmap e377: 12 total, 12 up, 12 in 2024-05-08T09:17:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:16 smithi172 ceph-mon[33377]: osdmap e377: 12 total, 12 up, 12 in 2024-05-08T09:17:17.393 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/firmware/built-in.a 2024-05-08T09:17:17.674 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_userptr.o 2024-05-08T09:17:17.680 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gem_wait.o 2024-05-08T09:17:17.689 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-kensington.o 2024-05-08T09:17:17.803 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-lg.o 2024-05-08T09:17:17.938 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gem/i915_gemfs.o 2024-05-08T09:17:18.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:17 smithi194 ceph-mon[33679]: pgmap v4807: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 69 KiB/s wr, 6 op/s 2024-05-08T09:17:18.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:17 smithi070 ceph-mon[29591]: pgmap v4807: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 69 KiB/s wr, 6 op/s 2024-05-08T09:17:18.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:17 smithi172 ceph-mon[33377]: pgmap v4807: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 69 KiB/s wr, 6 op/s 2024-05-08T09:17:18.310 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_active.o 2024-05-08T09:17:18.349 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-lgff.o 2024-05-08T09:17:18.362 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-lg4ff.o 2024-05-08T09:17:20.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:19 smithi194 ceph-mon[33679]: pgmap v4808: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 69 KiB/s wr, 6 op/s 2024-05-08T09:17:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:19 smithi070 ceph-mon[29591]: pgmap v4808: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 69 KiB/s wr, 6 op/s 2024-05-08T09:17:20.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:19 smithi172 ceph-mon[33377]: pgmap v4808: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 69 KiB/s wr, 6 op/s 2024-05-08T09:17:22.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:21 smithi194 ceph-mon[33679]: pgmap v4809: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 403 KiB/s wr, 20 op/s 2024-05-08T09:17:22.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:21 smithi194 ceph-mon[33679]: osdmap e378: 12 total, 12 up, 12 in 2024-05-08T09:17:22.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:21 smithi070 ceph-mon[29591]: pgmap v4809: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 403 KiB/s wr, 20 op/s 2024-05-08T09:17:22.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:21 smithi070 ceph-mon[29591]: osdmap e378: 12 total, 12 up, 12 in 2024-05-08T09:17:22.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:21 smithi172 ceph-mon[33377]: pgmap v4809: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 403 KiB/s wr, 20 op/s 2024-05-08T09:17:22.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:21 smithi172 ceph-mon[33377]: osdmap e378: 12 total, 12 up, 12 in 2024-05-08T09:17:24.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:23 smithi194 ceph-mon[33679]: pgmap v4811: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 423 KiB/s wr, 21 op/s 2024-05-08T09:17:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:23 smithi070 ceph-mon[29591]: pgmap v4811: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 423 KiB/s wr, 21 op/s 2024-05-08T09:17:24.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:23 smithi172 ceph-mon[33377]: pgmap v4811: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 423 KiB/s wr, 21 op/s 2024-05-08T09:17:26.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:25 smithi194 ceph-mon[33679]: pgmap v4812: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 536 KiB/s wr, 28 op/s 2024-05-08T09:17:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:25 smithi070 ceph-mon[29591]: pgmap v4812: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 536 KiB/s wr, 28 op/s 2024-05-08T09:17:26.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:25 smithi172 ceph-mon[33377]: pgmap v4812: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 536 KiB/s wr, 28 op/s 2024-05-08T09:17:26.543 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_cmd_parser.o 2024-05-08T09:17:27.169 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_panel.o 2024-05-08T09:17:27.353 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-lg-g15.o 2024-05-08T09:17:27.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:27 smithi172 ceph-mon[33377]: pgmap v4813: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 478 KiB/s wr, 25 op/s 2024-05-08T09:17:27.728 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_pci.o 2024-05-08T09:17:27.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:27 smithi194 ceph-mon[33679]: pgmap v4813: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 478 KiB/s wr, 25 op/s 2024-05-08T09:17:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:27 smithi070 ceph-mon[29591]: pgmap v4813: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 478 KiB/s wr, 25 op/s 2024-05-08T09:17:29.955 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_debugfs.o 2024-05-08T09:17:30.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:29 smithi194 ceph-mon[33679]: pgmap v4814: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 478 KiB/s wr, 25 op/s 2024-05-08T09:17:30.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:29 smithi070 ceph-mon[29591]: pgmap v4814: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 478 KiB/s wr, 25 op/s 2024-05-08T09:17:30.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:29 smithi172 ceph-mon[33377]: pgmap v4814: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 478 KiB/s wr, 25 op/s 2024-05-08T09:17:30.535 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-microsoft.o 2024-05-08T09:17:31.107 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_debugfs_crc.o 2024-05-08T09:17:31.375 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_panel_orientation_quirks.o 2024-05-08T09:17:32.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:31 smithi194 ceph-mon[33679]: pgmap v4815: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 610 KiB/s wr, 29 op/s 2024-05-08T09:17:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:31 smithi070 ceph-mon[29591]: pgmap v4815: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 610 KiB/s wr, 29 op/s 2024-05-08T09:17:32.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:31 smithi172 ceph-mon[33377]: pgmap v4815: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 610 KiB/s wr, 29 op/s 2024-05-08T09:17:34.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:33 smithi194 ceph-mon[33679]: pgmap v4816: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 543 KiB/s wr, 26 op/s 2024-05-08T09:17:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:33 smithi070 ceph-mon[29591]: pgmap v4816: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 543 KiB/s wr, 26 op/s 2024-05-08T09:17:34.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:33 smithi172 ceph-mon[33377]: pgmap v4816: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 543 KiB/s wr, 26 op/s 2024-05-08T09:17:34.540 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 33.8 2024-05-08T09:17:34.540 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:17:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:17:35.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:35 smithi070 ceph-mon[29591]: pgmap v4817: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 759 KiB/s wr, 33 op/s 2024-05-08T09:17:35.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:35 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:17:36.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:35 smithi194 ceph-mon[33679]: pgmap v4817: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 759 KiB/s wr, 33 op/s 2024-05-08T09:17:36.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:35 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:17:36.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:35 smithi172 ceph-mon[33377]: pgmap v4817: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 759 KiB/s wr, 33 op/s 2024-05-08T09:17:36.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:35 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:17:37.421 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-monterey.o 2024-05-08T09:17:37.877 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-ntrig.o 2024-05-08T09:17:38.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:37 smithi194 ceph-mon[33679]: pgmap v4818: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 642 KiB/s wr, 26 op/s 2024-05-08T09:17:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:37 smithi070 ceph-mon[29591]: pgmap v4818: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 642 KiB/s wr, 26 op/s 2024-05-08T09:17:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:37 smithi172 ceph-mon[33377]: pgmap v4818: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 642 KiB/s wr, 26 op/s 2024-05-08T09:17:38.686 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-pl.o 2024-05-08T09:17:40.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:39 smithi194 ceph-mon[33679]: pgmap v4819: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 642 KiB/s wr, 26 op/s 2024-05-08T09:17:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:39 smithi070 ceph-mon[29591]: pgmap v4819: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 642 KiB/s wr, 26 op/s 2024-05-08T09:17:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:39 smithi172 ceph-mon[33377]: pgmap v4819: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 642 KiB/s wr, 26 op/s 2024-05-08T09:17:42.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:41 smithi194 ceph-mon[33679]: pgmap v4820: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 861 KiB/s wr, 43 op/s 2024-05-08T09:17:42.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:17:42.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:17:42.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:41 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:17:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:41 smithi070 ceph-mon[29591]: pgmap v4820: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 861 KiB/s wr, 43 op/s 2024-05-08T09:17:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:17:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:17:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:41 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:17:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:41 smithi172 ceph-mon[33377]: pgmap v4820: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 810 KiB/s rd, 861 KiB/s wr, 43 op/s 2024-05-08T09:17:42.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:17:42.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:17:42.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:41 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:17:42.592 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_buddy.o 2024-05-08T09:17:42.737 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-petalynx.o 2024-05-08T09:17:42.752 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_deps.o 2024-05-08T09:17:42.882 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_gem_evict.o 2024-05-08T09:17:43.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.468+0000 7fb25ca00700 1 -- 172.21.15.70:0/373868556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25810ac00 msgr2=0x7fb25810afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:43.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.468+0000 7fb25ca00700 1 --2- 172.21.15.70:0/373868556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25810ac00 0x7fb25810afe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb2500098f0 tx=0x7fb250009c00 comp rx=0 tx=0).stop 2024-05-08T09:17:43.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.468+0000 7fb25ca00700 1 -- 172.21.15.70:0/373868556 shutdown_connections 2024-05-08T09:17:43.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.468+0000 7fb25ca00700 1 --2- 172.21.15.70:0/373868556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25810c160 0x7fb25810c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.468+0000 7fb25ca00700 1 --2- 172.21.15.70:0/373868556 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25810ac00 0x7fb25810afe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.468+0000 7fb25ca00700 1 --2- 172.21.15.70:0/373868556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25810b5b0 0x7fb25810ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.468+0000 7fb25ca00700 1 -- 172.21.15.70:0/373868556 >> 172.21.15.70:0/373868556 conn(0x7fb25806e610 msgr2=0x7fb25806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:43.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.469+0000 7fb25ca00700 1 -- 172.21.15.70:0/373868556 shutdown_connections 2024-05-08T09:17:43.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.469+0000 7fb25ca00700 1 -- 172.21.15.70:0/373868556 wait complete. 2024-05-08T09:17:43.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.470+0000 7fb25ca00700 1 Processor -- start 2024-05-08T09:17:43.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.471+0000 7fb25ca00700 1 -- start start 2024-05-08T09:17:43.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.471+0000 7fb25ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25810ac00 0x7fb258116e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.471+0000 7fb25ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25810b5b0 0x7fb258117340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb25ca00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25810c160 0x7fb258117880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb25ca00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb258119bd0 con 0x7fb25810ac00 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb25ca00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb258119a50 con 0x7fb25810b5b0 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb25ca00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb258119d50 con 0x7fb25810c160 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb255e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25810ac00 0x7fb258116e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb255e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25810ac00 0x7fb258116e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36874/0 (socket says 172.21.15.70:36874) 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb255e00700 1 -- 172.21.15.70:0/2536908110 learned_addr learned my addr 172.21.15.70:0/2536908110 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb256800700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25810c160 0x7fb258117880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:43.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb255e00700 1 -- 172.21.15.70:0/2536908110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25810c160 msgr2=0x7fb258117880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:43.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb255e00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25810c160 0x7fb258117880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb255e00700 1 -- 172.21.15.70:0/2536908110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25810b5b0 msgr2=0x7fb258117340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T09:17:43.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb255e00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25810b5b0 0x7fb258117340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.472+0000 7fb255e00700 1 -- 172.21.15.70:0/2536908110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2581b4c30 con 0x7fb25810ac00 2024-05-08T09:17:43.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.473+0000 7fb255e00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25810ac00 0x7fb258116e00 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb250005950 tx=0x7fb25000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:43.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.474+0000 7fb24ea00700 1 -- 172.21.15.70:0/2536908110 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25000b8c0 con 0x7fb25810ac00 2024-05-08T09:17:43.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.474+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2581b4ec0 con 0x7fb25810ac00 2024-05-08T09:17:43.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.474+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2581b5310 con 0x7fb25810ac00 2024-05-08T09:17:43.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.474+0000 7fb24ea00700 1 -- 172.21.15.70:0/2536908110 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb2500094f0 con 0x7fb25810ac00 2024-05-08T09:17:43.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.474+0000 7fb24ea00700 1 -- 172.21.15.70:0/2536908110 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2500038e0 con 0x7fb25810ac00 2024-05-08T09:17:43.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.476+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb234005330 con 0x7fb25810ac00 2024-05-08T09:17:43.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.482+0000 7fb24ea00700 1 -- 172.21.15.70:0/2536908110 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb250005160 con 0x7fb25810ac00 2024-05-08T09:17:43.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.484+0000 7fb24ea00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb23c0b2af0 0x7fb23c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:43.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.484+0000 7fb24ea00700 1 -- 172.21.15.70:0/2536908110 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(378..378 src has 1..378) ==== 9583+0+0 (secure 0 0 0) 0x7fb2500e4230 con 0x7fb25810ac00 2024-05-08T09:17:43.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.485+0000 7fb255400700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb23c0b2af0 0x7fb23c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:43.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.486+0000 7fb24ea00700 1 -- 172.21.15.70:0/2536908110 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb250013030 con 0x7fb25810ac00 2024-05-08T09:17:43.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.486+0000 7fb255400700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb23c0b2af0 0x7fb23c0b4fb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb248009550 tx=0x7fb2480092e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:43.585 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-redragon.o 2024-05-08T09:17:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.944+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb234005620 con 0x7fb25810ac00 2024-05-08T09:17:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.946+0000 7fb24ea00700 1 -- 172.21.15.70:0/2536908110 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fb2500ab820 con 0x7fb25810ac00 2024-05-08T09:17:43.946 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:17:43.947 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:17:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.949+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb23c0b2af0 msgr2=0x7fb23c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.949+0000 7fb25ca00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb23c0b2af0 0x7fb23c0b4fb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fb248009550 tx=0x7fb2480092e0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.949+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25810ac00 msgr2=0x7fb258116e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.949+0000 7fb25ca00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25810ac00 0x7fb258116e00 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb250005950 tx=0x7fb25000b560 comp rx=0 tx=0).stop 2024-05-08T09:17:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.949+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 shutdown_connections 2024-05-08T09:17:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.949+0000 7fb25ca00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb23c0b2af0 0x7fb23c0b4fb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.949+0000 7fb25ca00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb25810c160 0x7fb258117880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.949+0000 7fb25ca00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb25810ac00 0x7fb258116e00 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.949+0000 7fb25ca00700 1 --2- 172.21.15.70:0/2536908110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb25810b5b0 0x7fb258117340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.950+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 >> 172.21.15.70:0/2536908110 conn(0x7fb25806e610 msgr2=0x7fb25811c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.950+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 shutdown_connections 2024-05-08T09:17:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:43.950+0000 7fb25ca00700 1 -- 172.21.15.70:0/2536908110 wait complete. 2024-05-08T09:17:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:17:44.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:43 smithi194 ceph-mon[33679]: pgmap v4821: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 469 KiB/s wr, 25 op/s 2024-05-08T09:17:44.068 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:43 smithi070 ceph-mon[29591]: pgmap v4821: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 469 KiB/s wr, 25 op/s 2024-05-08T09:17:44.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:43 smithi172 ceph-mon[33377]: pgmap v4821: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 469 KiB/s wr, 25 op/s 2024-05-08T09:17:44.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:44 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2536908110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:17:45.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:44 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2536908110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:17:45.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:44 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2536908110' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:17:45.780 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 93.8 --await-for 42.0' 2024-05-08T09:17:45.780 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 93.8 --await-for 42.0 2024-05-08T09:17:46.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:45 smithi194 ceph-mon[33679]: pgmap v4822: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 772 KiB/s wr, 32 op/s 2024-05-08T09:17:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:45 smithi070 ceph-mon[29591]: pgmap v4822: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 772 KiB/s wr, 32 op/s 2024-05-08T09:17:46.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:45 smithi172 ceph-mon[33377]: pgmap v4822: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 703 KiB/s rd, 772 KiB/s wr, 32 op/s 2024-05-08T09:17:46.343 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:17:47.819 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_gem_gtt.o 2024-05-08T09:17:48.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:47 smithi194 ceph-mon[33679]: pgmap v4823: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 521 KiB/s wr, 23 op/s 2024-05-08T09:17:48.060 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:47 smithi070 ceph-mon[29591]: pgmap v4823: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 521 KiB/s wr, 23 op/s 2024-05-08T09:17:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:47 smithi172 ceph-mon[33377]: pgmap v4823: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 521 KiB/s wr, 23 op/s 2024-05-08T09:17:48.612 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_gem_ww.o 2024-05-08T09:17:49.267 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_gem.o 2024-05-08T09:17:50.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:49 smithi194 ceph-mon[33679]: pgmap v4824: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 521 KiB/s wr, 23 op/s 2024-05-08T09:17:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:49 smithi070 ceph-mon[29591]: pgmap v4824: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 521 KiB/s wr, 23 op/s 2024-05-08T09:17:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:49 smithi172 ceph-mon[33377]: pgmap v4824: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 474 KiB/s rd, 521 KiB/s wr, 23 op/s 2024-05-08T09:17:50.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.654+0000 7f56dde00700 1 -- 172.21.15.70:0/1690060689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d81189e0 msgr2=0x7f56d811add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:50.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.654+0000 7f56dde00700 1 --2- 172.21.15.70:0/1690060689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d81189e0 0x7f56d811add0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b0d0 tx=0x7f56d000b3e0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.654+0000 7f56dde00700 1 -- 172.21.15.70:0/1690060689 shutdown_connections 2024-05-08T09:17:50.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.654+0000 7f56dde00700 1 --2- 172.21.15.70:0/1690060689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d81189e0 0x7f56d811add0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.654+0000 7f56dde00700 1 --2- 172.21.15.70:0/1690060689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d810a4a0 0x7f56d810a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.654+0000 7f56dde00700 1 --2- 172.21.15.70:0/1690060689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d810adc0 0x7f56d81184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.654+0000 7f56dde00700 1 -- 172.21.15.70:0/1690060689 >> 172.21.15.70:0/1690060689 conn(0x7f56d806e610 msgr2=0x7f56d806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:50.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.654+0000 7f56dde00700 1 -- 172.21.15.70:0/1690060689 shutdown_connections 2024-05-08T09:17:50.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.654+0000 7f56dde00700 1 -- 172.21.15.70:0/1690060689 wait complete. 2024-05-08T09:17:50.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.656+0000 7f56dde00700 1 Processor -- start 2024-05-08T09:17:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.657+0000 7f56dde00700 1 -- start start 2024-05-08T09:17:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.657+0000 7f56dde00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d810a4a0 0x7f56d81a4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.657+0000 7f56dde00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d810adc0 0x7f56d81a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.657+0000 7f56dde00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d81189e0 0x7f56d81a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.657+0000 7f56dde00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56d811df40 con 0x7f56d810a4a0 2024-05-08T09:17:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.657+0000 7f56dde00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56d811ddc0 con 0x7f56d810adc0 2024-05-08T09:17:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.657+0000 7f56dde00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f56d811e0c0 con 0x7f56d81189e0 2024-05-08T09:17:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.658+0000 7f56d6000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d810adc0 0x7f56d81a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.658+0000 7f56d6000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d810adc0 0x7f56d81a4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:52168/0 (socket says 172.21.15.70:52168) 2024-05-08T09:17:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.658+0000 7f56d6000700 1 -- 172.21.15.70:0/3474919884 learned_addr learned my addr 172.21.15.70:0/3474919884 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.658+0000 7f56d6a00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d810a4a0 0x7f56d81a4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.659+0000 7f56d6a00700 1 -- 172.21.15.70:0/3474919884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d81189e0 msgr2=0x7f56d81a8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.659+0000 7f56d6a00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d81189e0 0x7f56d81a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.659+0000 7f56d6a00700 1 -- 172.21.15.70:0/3474919884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d810adc0 msgr2=0x7f56d81a4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.659+0000 7f56d6a00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d810adc0 0x7f56d81a4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.659+0000 7f56d6a00700 1 -- 172.21.15.70:0/3474919884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56d81a9320 con 0x7f56d810a4a0 2024-05-08T09:17:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.659+0000 7f56d6a00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d810a4a0 0x7f56d81a4310 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f56c800e9f0 tx=0x7f56c800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.660+0000 7f56dca00700 1 -- 172.21.15.70:0/3474919884 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c800cbd0 con 0x7f56d810a4a0 2024-05-08T09:17:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.660+0000 7f56dca00700 1 -- 172.21.15.70:0/3474919884 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56c800cd70 con 0x7f56d810a4a0 2024-05-08T09:17:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.660+0000 7f56dde00700 1 -- 172.21.15.70:0/3474919884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56d81a9610 con 0x7f56d810a4a0 2024-05-08T09:17:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.660+0000 7f56dca00700 1 -- 172.21.15.70:0/3474919884 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c8018680 con 0x7f56d810a4a0 2024-05-08T09:17:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.660+0000 7f56dde00700 1 -- 172.21.15.70:0/3474919884 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56d81b0e90 con 0x7f56d810a4a0 2024-05-08T09:17:50.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.665+0000 7f56dca00700 1 -- 172.21.15.70:0/3474919884 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f56c8010430 con 0x7f56d810a4a0 2024-05-08T09:17:50.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.668+0000 7f56dca00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f56bc0b2b20 0x7f56bc0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.668+0000 7f56dca00700 1 -- 172.21.15.70:0/3474919884 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(378..378 src has 1..378) ==== 9583+0+0 (secure 0 0 0) 0x7f56c80e2b90 con 0x7f56d810a4a0 2024-05-08T09:17:50.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.669+0000 7f56d6000700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f56bc0b2b20 0x7f56bc0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.670+0000 7f56d6000700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f56bc0b2b20 0x7f56bc0b4fe0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f56d811aca0 tx=0x7f56c4005f90 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:50.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.692+0000 7f56e87f1b80 1 Processor -- start 2024-05-08T09:17:50.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.692+0000 7f56e87f1b80 1 -- start start 2024-05-08T09:17:50.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.693+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a65240 0x55c187a65620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.693+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a5f810 0x55c187a5fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.693+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a601d0 0x55c187a6c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.693+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c1879b1bb0 con 0x55c187a5f810 2024-05-08T09:17:50.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.693+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c18794f8f0 con 0x55c187a601d0 2024-05-08T09:17:50.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.693+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c1879adb70 con 0x55c187a65240 2024-05-08T09:17:50.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.694+0000 7f56d6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a5f810 0x55c187a5fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.694+0000 7f56d7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a601d0 0x55c187a6c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.694+0000 7f56d6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a5f810 0x55c187a5fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41906/0 (socket says 172.21.15.70:41906) 2024-05-08T09:17:50.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.694+0000 7f56d6000700 1 -- 172.21.15.70:0/3011923431 learned_addr learned my addr 172.21.15.70:0/3011923431 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:50.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.694+0000 7f56d7400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a601d0 0x55c187a6c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:52170/0 (socket says 172.21.15.70:52170) 2024-05-08T09:17:50.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.694+0000 7f56d6a00700 1 --2- 172.21.15.70:0/3011923431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a65240 0x55c187a65620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.694+0000 7f56d6a00700 1 -- 172.21.15.70:0/3011923431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a601d0 msgr2=0x55c187a6c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:50.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.694+0000 7f56d6a00700 1 --2- 172.21.15.70:0/3011923431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a601d0 0x55c187a6c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.694+0000 7f56d6a00700 1 -- 172.21.15.70:0/3011923431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a5f810 msgr2=0x55c187a5fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:50.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.695+0000 7f56d6a00700 1 --2- 172.21.15.70:0/3011923431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a5f810 0x55c187a5fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.695+0000 7f56d6a00700 1 -- 172.21.15.70:0/3011923431 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1878fea60 con 0x55c187a65240 2024-05-08T09:17:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.695+0000 7f56d6000700 1 --2- 172.21.15.70:0/3011923431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a5f810 0x55c187a5fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:17:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.695+0000 7f56d6a00700 1 --2- 172.21.15.70:0/3011923431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a65240 0x55c187a65620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56c80dfe60 tx=0x7f56c80a91e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f500c82b38abec86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:50.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.696+0000 7f56ccc00700 1 -- 172.21.15.70:0/3011923431 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80a9500 con 0x55c187a65240 2024-05-08T09:17:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.696+0000 7f56ccc00700 1 -- 172.21.15.70:0/3011923431 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56c80aa0f0 con 0x55c187a65240 2024-05-08T09:17:50.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.696+0000 7f56ccc00700 1 -- 172.21.15.70:0/3011923431 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80a9eb0 con 0x55c187a65240 2024-05-08T09:17:50.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.697+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3011923431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a65240 msgr2=0x55c187a65620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:50.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.697+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/3011923431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a65240 0x55c187a65620 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f56c80dfe60 tx=0x7f56c80a91e0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.698+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3011923431 shutdown_connections 2024-05-08T09:17:50.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.698+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/3011923431 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a601d0 0x55c187a6c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.698+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/3011923431 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a65240 0x55c187a65620 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.698+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/3011923431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a5f810 0x55c187a5fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.698+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3011923431 >> 172.21.15.70:0/3011923431 conn(0x55c1879d7860 msgr2=0x55c187a5a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:50.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.699+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3011923431 shutdown_connections 2024-05-08T09:17:50.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.699+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3011923431 wait complete. 2024-05-08T09:17:50.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.699+0000 7f56e87f1b80 1 -- start start 2024-05-08T09:17:50.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.700+0000 7f56e87f1b80 1 Processor -- start 2024-05-08T09:17:50.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.701+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a5f810 0x55c187a6bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.701+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a601d0 0x55c187a69000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.701+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a65240 0x55c187a69540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.701+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c187a6c540 con 0x55c187a601d0 2024-05-08T09:17:50.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.701+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55c187917cb0 con 0x55c187a65240 2024-05-08T09:17:50.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.701+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55c187a6c6c0 con 0x55c187a5f810 2024-05-08T09:17:50.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.701+0000 7f56e87f1b80 10 client.0 _ll_register_callbacks cb 0x55c187958e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:17:50.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.702+0000 7f56d6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a601d0 0x55c187a69000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.702+0000 7f56d6a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a5f810 0x55c187a6bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.702+0000 7f56d6a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a5f810 0x55c187a6bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:36312/0 (socket says 172.21.15.70:36312) 2024-05-08T09:17:50.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.702+0000 7f56d6a00700 1 -- 172.21.15.70:0/372470516 learned_addr learned my addr 172.21.15.70:0/372470516 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:50.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.702+0000 7f56d6a00700 1 -- 172.21.15.70:0/372470516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a65240 msgr2=0x55c187a69540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T09:17:50.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.702+0000 7f56d6a00700 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a65240 0x55c187a69540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.702+0000 7f56d6a00700 1 -- 172.21.15.70:0/372470516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a601d0 msgr2=0x55c187a69000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:50.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.703+0000 7f56d6a00700 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a601d0 0x55c187a69000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.703+0000 7f56d6a00700 1 -- 172.21.15.70:0/372470516 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1879775b0 con 0x55c187a5f810 2024-05-08T09:17:50.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.703+0000 7f56d6000700 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a601d0 0x55c187a69000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:17:50.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.704+0000 7f56d6a00700 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a5f810 0x55c187a6bc60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f56c80a6c60 tx=0x7f56c80b25f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55e16addacd9dcdd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:50.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.704+0000 7f56c1600700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T09:17:50.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.704+0000 7f56c1600700 1 -- 172.21.15.70:0/372470516 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56c80a9500 con 0x55c187a5f810 2024-05-08T09:17:50.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.704+0000 7f56c1600700 1 -- 172.21.15.70:0/372470516 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(378..378 src has 1..378) ==== 9583+0+0 (secure 0 0 0) 0x7f56c8010930 con 0x55c187a5f810 2024-05-08T09:17:50.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.705+0000 7f56e87f1b80 1 -- 172.21.15.70:0/372470516 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56c80aa0f0 con 0x55c187a5f810 2024-05-08T09:17:50.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.705+0000 7f56c1600700 1 -- 172.21.15.70:0/372470516 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f56c80adda0 con 0x55c187a5f810 2024-05-08T09:17:50.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.705+0000 7f56e87f1b80 10 client.28018 fetch_fsmap learned FSMap version 42 2024-05-08T09:17:50.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.705+0000 7f56e87f1b80 1 -- 172.21.15.70:0/372470516 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55c187a6c540 con 0x55c187a5f810 2024-05-08T09:17:50.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.706+0000 7f56c1600700 1 -- 172.21.15.70:0/372470516 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56c8087020 con 0x55c187a5f810 2024-05-08T09:17:50.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.707+0000 7f56c1600700 1 -- 172.21.15.70:0/372470516 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f56c80a54f0 con 0x55c187a5f810 2024-05-08T09:17:50.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.707+0000 7f56e87f1b80 10 client.28018 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:17:50.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.707+0000 7f56e87f1b80 10 client.28018 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:17:50.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.707+0000 7f56e87f1b80 20 client.28018 populate_metadata read hostname 'smithi070' 2024-05-08T09:17:50.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.707+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c187a790a0 0x55c187a7b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.707+0000 7f56e87f1b80 4 client.28018 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:17:50.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.707+0000 7f56e87f1b80 1 -- 172.21.15.70:0/372470516 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c187a2c2d0 con 0x55c187a790a0 2024-05-08T09:17:50.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.707+0000 7f56d6000700 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c187a790a0 0x55c187a7b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.709+0000 7f56c1600700 10 client.28018 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:17:50.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.709+0000 7f56d6000700 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c187a790a0 0x55c187a7b490 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=153df7da59becc1a server_cookie=75f414457eef2dd3 in_seq=0 out_seq=0 2024-05-08T09:17:50.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.710+0000 7f56c1600700 1 -- 172.21.15.70:0/372470516 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c187a2c2d0 con 0x55c187a790a0 2024-05-08T09:17:50.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.711+0000 7f56c1600700 10 client.28018 handle_command_reply: tid=0 2024-05-08T09:17:50.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.711+0000 7f56e87f1b80 1 client.28018 shutdown 2024-05-08T09:17:50.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.711+0000 7f56e87f1b80 1 -- 172.21.15.70:0/372470516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a5f810 msgr2=0x55c187a6bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:50.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.711+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a5f810 0x55c187a6bc60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f56c80a6c60 tx=0x7f56c80b25f0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.711+0000 7f56e87f1b80 1 -- 172.21.15.70:0/372470516 shutdown_connections 2024-05-08T09:17:50.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.711+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c187a790a0 0x55c187a7b490 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.711+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a65240 0x55c187a69540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.711+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a5f810 0x55c187a6bc60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.712+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/372470516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a601d0 0x55c187a69000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.712+0000 7f56e87f1b80 1 -- 172.21.15.70:0/372470516 >> 172.21.15.70:0/372470516 conn(0x55c1879d7860 msgr2=0x55c187a54bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:50.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.712+0000 7f56c1600700 0 client.28018 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:17:50.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.712+0000 7f56e87f1b80 1 -- 172.21.15.70:0/372470516 shutdown_connections 2024-05-08T09:17:50.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.712+0000 7f56e87f1b80 1 -- 172.21.15.70:0/372470516 wait complete. 2024-05-08T09:17:50.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.712+0000 7f56e87f1b80 20 client.28018 trim_cache size 0 max 16384 2024-05-08T09:17:50.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.745+0000 7f56e87f1b80 1 Processor -- start 2024-05-08T09:17:50.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.746+0000 7f56e87f1b80 1 -- start start 2024-05-08T09:17:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.746+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 0x55c187a755d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.746+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 0x55c187a633d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.746+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a80af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.746+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81bc870 con 0x55c187a65240 2024-05-08T09:17:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.746+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81ba100 con 0x55c187a5f810 2024-05-08T09:17:50.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.746+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81b7f70 con 0x55c187a601d0 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a80af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d6000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 0x55c187a633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d6000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 0x55c187a633d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:36328/0 (socket says 172.21.15.70:36328) 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d6000700 1 -- 172.21.15.70:0/3113598715 learned_addr learned my addr 172.21.15.70:0/3113598715 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d6a00700 1 --2- 172.21.15.70:0/3113598715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 0x55c187a755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d7400700 1 -- 172.21.15.70:0/3113598715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 msgr2=0x55c187a633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d7400700 1 --2- 172.21.15.70:0/3113598715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 0x55c187a633d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d7400700 1 -- 172.21.15.70:0/3113598715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 msgr2=0x55c187a755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d7400700 1 --2- 172.21.15.70:0/3113598715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 0x55c187a755d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.747+0000 7f56d7400700 1 -- 172.21.15.70:0/3113598715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c187a5acb0 con 0x55c187a65240 2024-05-08T09:17:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.748+0000 7f56d7400700 1 --2- 172.21.15.70:0/3113598715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a80af0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b0d0 tx=0x7f56d0009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372c91d0418093aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.749+0000 7f56c3e00700 1 -- 172.21.15.70:0/3113598715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0020070 con 0x55c187a65240 2024-05-08T09:17:50.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.749+0000 7f56c3e00700 1 -- 172.21.15.70:0/3113598715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56d0003a00 con 0x55c187a65240 2024-05-08T09:17:50.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.749+0000 7f56c3e00700 1 -- 172.21.15.70:0/3113598715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d0007ae0 con 0x55c187a65240 2024-05-08T09:17:50.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.750+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3113598715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 msgr2=0x55c187a80af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:17:50.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.750+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/3113598715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a80af0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b0d0 tx=0x7f56d0009d10 comp rx=0 tx=0).stop 2024-05-08T09:17:50.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.750+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3113598715 shutdown_connections 2024-05-08T09:17:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.750+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/3113598715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a80af0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.750+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/3113598715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 0x55c187a755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.750+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/3113598715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 0x55c187a633d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.750+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3113598715 >> 172.21.15.70:0/3113598715 conn(0x55c1879d7860 msgr2=0x55c187a62cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:17:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.750+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3113598715 shutdown_connections 2024-05-08T09:17:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.750+0000 7f56e87f1b80 1 -- 172.21.15.70:0/3113598715 wait complete. 2024-05-08T09:17:50.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.751+0000 7f56e87f1b80 1 -- start start 2024-05-08T09:17:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.751+0000 7f56e87f1b80 1 Processor -- start 2024-05-08T09:17:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 0x55c187a71e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 0x55c187a6e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56e87f1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a6ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81b85c0 con 0x55c187a65240 2024-05-08T09:17:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81b9a30 con 0x55c187a5f810 2024-05-08T09:17:50.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56e87f1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f56d81b8c90 con 0x55c187a601d0 2024-05-08T09:17:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56e87f1b80 10 client.0 _ll_register_callbacks cb 0x55c187958e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:17:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a6ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a6ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41940/0 (socket says 172.21.15.70:41940) 2024-05-08T09:17:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.752+0000 7f56d7400700 1 -- 172.21.15.70:0/2456573728 learned_addr learned my addr 172.21.15.70:0/2456573728 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:17:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.753+0000 7f56d6a00700 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 0x55c187a71e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.753+0000 7f56d6000700 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 0x55c187a6e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.753+0000 7f56d7400700 1 -- 172.21.15.70:0/2456573728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 msgr2=0x55c187a6e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:50.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.753+0000 7f56d7400700 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 0x55c187a6e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.753+0000 7f56d7400700 1 -- 172.21.15.70:0/2456573728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 msgr2=0x55c187a71e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:17:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.753+0000 7f56d7400700 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 0x55c187a71e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:17:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.753+0000 7f56d7400700 1 -- 172.21.15.70:0/2456573728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c187a6f6a0 con 0x55c187a65240 2024-05-08T09:17:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.754+0000 7f56d6a00700 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 0x55c187a71e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:17:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.754+0000 7f56d7400700 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a6ee60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f56d0005bd0 tx=0x7f56d000cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffc06f3566a5800 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:17:50.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.754+0000 7f56c1600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:17:50.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.756+0000 7f56c1600700 1 -- 172.21.15.70:0/2456573728 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d002c020 con 0x55c187a65240 2024-05-08T09:17:50.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.756+0000 7f56c1600700 1 -- 172.21.15.70:0/2456573728 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(378..378 src has 1..378) ==== 9583+0+0 (secure 0 0 0) 0x7f56d00077e0 con 0x55c187a65240 2024-05-08T09:17:50.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.756+0000 7f56e87f1b80 1 -- 172.21.15.70:0/2456573728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56d0003a00 con 0x55c187a65240 2024-05-08T09:17:50.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.756+0000 7f56c1600700 1 -- 172.21.15.70:0/2456573728 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f56d0020040 con 0x55c187a65240 2024-05-08T09:17:50.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56e87f1b80 10 client.19341 fetch_fsmap learned FSMap version 42 2024-05-08T09:17:50.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56e87f1b80 1 -- 172.21.15.70:0/2456573728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55c187ae4640 con 0x55c187a65240 2024-05-08T09:17:50.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56c1600700 1 -- 172.21.15.70:0/2456573728 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56d0003a00 con 0x55c187a65240 2024-05-08T09:17:50.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56c1600700 1 -- 172.21.15.70:0/2456573728 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f56d0011070 con 0x55c187a65240 2024-05-08T09:17:50.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56e87f1b80 10 client.19341 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:17:50.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56e87f1b80 10 client.19341 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:17:50.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56e87f1b80 20 client.19341 populate_metadata read hostname 'smithi070' 2024-05-08T09:17:50.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c187ae4c80 0x55c187ae70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:17:50.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56e87f1b80 4 client.19341 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 93.8, "await_for": 42.0}] 2024-05-08T09:17:50.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.757+0000 7f56e87f1b80 1 -- 172.21.15.70:0/2456573728 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 93.8, "await_for": 42.0}) -- 0x55c1879bf590 con 0x55c187ae4c80 2024-05-08T09:17:50.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.758+0000 7f56d6a00700 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c187ae4c80 0x55c187ae70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:17:50.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.759+0000 7f56c1600700 10 client.19341 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:17:50.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:17:50.759+0000 7f56d6a00700 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c187ae4c80 0x55c187ae70a0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66e66444a3e9bb18 server_cookie=921de2770788bcd2 in_seq=0 out_seq=0 2024-05-08T09:17:51.927 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_query.o 2024-05-08T09:17:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:51 smithi194 ceph-mon[33679]: pgmap v4825: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 912 KiB/s wr, 36 op/s 2024-05-08T09:17:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:51 smithi070 ceph-mon[29591]: pgmap v4825: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 912 KiB/s wr, 36 op/s 2024-05-08T09:17:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:51 smithi172 ceph-mon[33377]: pgmap v4825: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 878 KiB/s rd, 912 KiB/s wr, 36 op/s 2024-05-08T09:17:52.366 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_gem_shmem_helper.o 2024-05-08T09:17:54.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:53 smithi194 ceph-mon[33679]: pgmap v4826: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 694 KiB/s wr, 19 op/s 2024-05-08T09:17:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:53 smithi070 ceph-mon[29591]: pgmap v4826: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 694 KiB/s wr, 19 op/s 2024-05-08T09:17:54.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:53 smithi172 ceph-mon[33377]: pgmap v4826: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 694 KiB/s rd, 694 KiB/s wr, 19 op/s 2024-05-08T09:17:56.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:55 smithi070 ceph-mon[29591]: pgmap v4827: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2024-05-08T09:17:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:55 smithi172 ceph-mon[33377]: pgmap v4827: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2024-05-08T09:17:56.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:55 smithi194 ceph-mon[33679]: pgmap v4827: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1013 KiB/s rd, 1.0 MiB/s wr, 28 op/s 2024-05-08T09:17:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:57 smithi070 ceph-mon[29591]: pgmap v4828: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 771 KiB/s wr, 21 op/s 2024-05-08T09:17:58.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:57 smithi172 ceph-mon[33377]: pgmap v4828: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 771 KiB/s wr, 21 op/s 2024-05-08T09:17:58.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:57 smithi194 ceph-mon[33679]: pgmap v4828: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 771 KiB/s wr, 21 op/s 2024-05-08T09:18:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:17:59 smithi070 ceph-mon[29591]: pgmap v4829: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 771 KiB/s wr, 21 op/s 2024-05-08T09:18:00.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:17:59 smithi172 ceph-mon[33377]: pgmap v4829: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 771 KiB/s wr, 21 op/s 2024-05-08T09:18:00.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:17:59 smithi194 ceph-mon[33679]: pgmap v4829: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 723 KiB/s rd, 771 KiB/s wr, 21 op/s 2024-05-08T09:18:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:01 smithi070 ceph-mon[29591]: pgmap v4830: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 841 KiB/s wr, 25 op/s 2024-05-08T09:18:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:01 smithi172 ceph-mon[33377]: pgmap v4830: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 841 KiB/s wr, 25 op/s 2024-05-08T09:18:02.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:01 smithi194 ceph-mon[33679]: pgmap v4830: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 841 KiB/s wr, 25 op/s 2024-05-08T09:18:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:03 smithi070 ceph-mon[29591]: pgmap v4831: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 450 KiB/s wr, 13 op/s 2024-05-08T09:18:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:03 smithi172 ceph-mon[33377]: pgmap v4831: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 450 KiB/s wr, 13 op/s 2024-05-08T09:18:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:03 smithi194 ceph-mon[33679]: pgmap v4831: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 450 KiB/s wr, 13 op/s 2024-05-08T09:18:05.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:04 smithi070 ceph-mon[29591]: pgmap v4832: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 461 KiB/s wr, 19 op/s 2024-05-08T09:18:05.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:04 smithi172 ceph-mon[33377]: pgmap v4832: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 461 KiB/s wr, 19 op/s 2024-05-08T09:18:05.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:04 smithi194 ceph-mon[33679]: pgmap v4832: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 455 KiB/s rd, 461 KiB/s wr, 19 op/s 2024-05-08T09:18:08.009 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:07 smithi070 ceph-mon[29591]: pgmap v4833: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 81 KiB/s wr, 10 op/s 2024-05-08T09:18:08.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:07 smithi194 ceph-mon[33679]: pgmap v4833: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 81 KiB/s wr, 10 op/s 2024-05-08T09:18:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:07 smithi172 ceph-mon[33377]: pgmap v4833: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 81 KiB/s wr, 10 op/s 2024-05-08T09:18:10.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:09 smithi194 ceph-mon[33679]: pgmap v4834: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 81 KiB/s wr, 10 op/s 2024-05-08T09:18:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:09 smithi070 ceph-mon[29591]: pgmap v4834: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 81 KiB/s wr, 10 op/s 2024-05-08T09:18:10.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:09 smithi172 ceph-mon[33377]: pgmap v4834: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 81 KiB/s wr, 10 op/s 2024-05-08T09:18:12.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:11 smithi194 ceph-mon[33679]: pgmap v4835: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 186 KiB/s wr, 14 op/s 2024-05-08T09:18:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:11 smithi070 ceph-mon[29591]: pgmap v4835: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 186 KiB/s wr, 14 op/s 2024-05-08T09:18:12.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:11 smithi172 ceph-mon[33377]: pgmap v4835: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 186 KiB/s wr, 14 op/s 2024-05-08T09:18:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:13 smithi194 ceph-mon[33679]: pgmap v4836: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 10 op/s 2024-05-08T09:18:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:13 smithi070 ceph-mon[29591]: pgmap v4836: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 10 op/s 2024-05-08T09:18:14.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:13 smithi172 ceph-mon[33377]: pgmap v4836: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 116 KiB/s wr, 10 op/s 2024-05-08T09:18:14.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.893+0000 7f56c1600700 1 -- 172.21.15.70:0/2456573728 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55c1879bf590 con 0x55c187ae4c80 2024-05-08T09:18:14.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.893+0000 7f56c1600700 10 client.19341 handle_command_reply: tid=0 2024-05-08T09:18:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.893+0000 7f56e87f1b80 1 client.19341 shutdown 2024-05-08T09:18:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.894+0000 7f56e87f1b80 1 -- 172.21.15.70:0/2456573728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 msgr2=0x55c187a6ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.894+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a6ee60 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f56d0005bd0 tx=0x7f56d000cf70 comp rx=0 tx=0).stop 2024-05-08T09:18:14.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.894+0000 7f56e87f1b80 1 -- 172.21.15.70:0/2456573728 shutdown_connections 2024-05-08T09:18:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.894+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55c187ae4c80 0x55c187ae70a0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.894+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c187a65240 0x55c187a6ee60 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.894+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55c187a5f810 0x55c187a71e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.894+0000 7f56e87f1b80 1 --2- 172.21.15.70:0/2456573728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55c187a601d0 0x55c187a6e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.894+0000 7f56e87f1b80 1 -- 172.21.15.70:0/2456573728 >> 172.21.15.70:0/2456573728 conn(0x55c1879d7860 msgr2=0x55c187a63550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:18:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.895+0000 7f56c1600700 0 client.19341 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:18:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.895+0000 7f56e87f1b80 1 -- 172.21.15.70:0/2456573728 shutdown_connections 2024-05-08T09:18:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.895+0000 7f56e87f1b80 1 -- 172.21.15.70:0/2456573728 wait complete. 2024-05-08T09:18:14.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.896+0000 7f56e87f1b80 20 client.19341 trim_cache size 0 max 16384 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 334, 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout: "4abd2449": { 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 334, 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:18:14.898 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 93.8, 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:18:14.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:18:14.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:18:14.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:18:14.900 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:18:14.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.898+0000 7f56dde00700 1 -- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f56bc0b2b20 msgr2=0x7f56bc0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.898+0000 7f56dde00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f56bc0b2b20 0x7f56bc0b4fe0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f56d811aca0 tx=0x7f56c4005f90 comp rx=0 tx=0).stop 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.898+0000 7f56dde00700 1 -- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d810a4a0 msgr2=0x7f56d81a4310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.898+0000 7f56dde00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d810a4a0 0x7f56d81a4310 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f56c800e9f0 tx=0x7f56c800ed00 comp rx=0 tx=0).stop 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.899+0000 7f56dde00700 1 -- 172.21.15.70:0/3474919884 shutdown_connections 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.899+0000 7f56dde00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f56bc0b2b20 0x7f56bc0b4fe0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.899+0000 7f56dde00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56d81189e0 0x7f56d81a8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.899+0000 7f56dde00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56d810a4a0 0x7f56d81a4310 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.899+0000 7f56dde00700 1 --2- 172.21.15.70:0/3474919884 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f56d810adc0 0x7f56d81a4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.899+0000 7f56dde00700 1 -- 172.21.15.70:0/3474919884 >> 172.21.15.70:0/3474919884 conn(0x7f56d806e610 msgr2=0x7f56d8118e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.899+0000 7f56dde00700 1 -- 172.21.15.70:0/3474919884 shutdown_connections 2024-05-08T09:18:14.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:14.899+0000 7f56dde00700 1 -- 172.21.15.70:0/3474919884 wait complete. 2024-05-08T09:18:15.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:15 smithi070 ceph-mon[29591]: pgmap v4837: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 213 KiB/s wr, 28 op/s 2024-05-08T09:18:16.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:15 smithi194 ceph-mon[33679]: pgmap v4837: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 213 KiB/s wr, 28 op/s 2024-05-08T09:18:16.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:15 smithi172 ceph-mon[33377]: pgmap v4837: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 213 KiB/s wr, 28 op/s 2024-05-08T09:18:16.746 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '4abd2449', quiesce took 42.2 seconds. Will release after: 33.8 2024-05-08T09:18:18.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:17 smithi194 ceph-mon[33679]: pgmap v4838: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 202 KiB/s wr, 22 op/s 2024-05-08T09:18:18.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:17 smithi070 ceph-mon[29591]: pgmap v4838: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 202 KiB/s wr, 22 op/s 2024-05-08T09:18:18.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:17 smithi172 ceph-mon[33377]: pgmap v4838: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 202 KiB/s wr, 22 op/s 2024-05-08T09:18:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:19 smithi194 ceph-mon[33679]: pgmap v4839: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 202 KiB/s wr, 22 op/s 2024-05-08T09:18:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:19 smithi070 ceph-mon[29591]: pgmap v4839: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 202 KiB/s wr, 22 op/s 2024-05-08T09:18:20.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:19 smithi172 ceph-mon[33377]: pgmap v4839: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 202 KiB/s wr, 22 op/s 2024-05-08T09:18:22.014 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:21 smithi194 ceph-mon[33679]: pgmap v4840: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 236 KiB/s wr, 27 op/s 2024-05-08T09:18:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:21 smithi070 ceph-mon[29591]: pgmap v4840: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 236 KiB/s wr, 27 op/s 2024-05-08T09:18:22.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:21 smithi172 ceph-mon[33377]: pgmap v4840: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 236 KiB/s wr, 27 op/s 2024-05-08T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:23 smithi194 ceph-mon[33679]: osdmap e379: 12 total, 12 up, 12 in 2024-05-08T09:18:23.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:23 smithi194 ceph-mon[33679]: pgmap v4842: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 158 KiB/s wr, 27 op/s 2024-05-08T09:18:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:23 smithi070 ceph-mon[29591]: osdmap e379: 12 total, 12 up, 12 in 2024-05-08T09:18:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:23 smithi070 ceph-mon[29591]: pgmap v4842: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 158 KiB/s wr, 27 op/s 2024-05-08T09:18:23.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:23 smithi172 ceph-mon[33377]: osdmap e379: 12 total, 12 up, 12 in 2024-05-08T09:18:23.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:23 smithi172 ceph-mon[33377]: pgmap v4842: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 158 KiB/s wr, 27 op/s 2024-05-08T09:18:26.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:25 smithi194 ceph-mon[33679]: pgmap v4843: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 109 KiB/s wr, 15 op/s 2024-05-08T09:18:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:25 smithi070 ceph-mon[29591]: pgmap v4843: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 109 KiB/s wr, 15 op/s 2024-05-08T09:18:26.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:25 smithi172 ceph-mon[33377]: pgmap v4843: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 109 KiB/s wr, 15 op/s 2024-05-08T09:18:27.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:27 smithi172 ceph-mon[33377]: osdmap e380: 12 total, 12 up, 12 in 2024-05-08T09:18:27.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:27 smithi172 ceph-mon[33377]: pgmap v4845: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 136 KiB/s wr, 19 op/s 2024-05-08T09:18:27.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:27 smithi194 ceph-mon[33679]: osdmap e380: 12 total, 12 up, 12 in 2024-05-08T09:18:27.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:27 smithi194 ceph-mon[33679]: pgmap v4845: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 136 KiB/s wr, 19 op/s 2024-05-08T09:18:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:27 smithi070 ceph-mon[29591]: osdmap e380: 12 total, 12 up, 12 in 2024-05-08T09:18:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:27 smithi070 ceph-mon[29591]: pgmap v4845: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 136 KiB/s wr, 19 op/s 2024-05-08T09:18:30.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:29 smithi194 ceph-mon[33679]: pgmap v4846: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 84 KiB/s wr, 13 op/s 2024-05-08T09:18:30.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:29 smithi070 ceph-mon[29591]: pgmap v4846: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 84 KiB/s wr, 13 op/s 2024-05-08T09:18:30.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:29 smithi172 ceph-mon[33377]: pgmap v4846: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 84 KiB/s wr, 13 op/s 2024-05-08T09:18:31.983 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:31 smithi172 ceph-mon[33377]: pgmap v4847: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 88 KiB/s wr, 16 op/s 2024-05-08T09:18:32.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:31 smithi194 ceph-mon[33679]: pgmap v4847: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 88 KiB/s wr, 16 op/s 2024-05-08T09:18:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:31 smithi070 ceph-mon[29591]: pgmap v4847: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 88 KiB/s wr, 16 op/s 2024-05-08T09:18:34.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:33 smithi194 ceph-mon[33679]: pgmap v4848: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 14 op/s 2024-05-08T09:18:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:33 smithi070 ceph-mon[29591]: pgmap v4848: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 14 op/s 2024-05-08T09:18:34.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:33 smithi172 ceph-mon[33377]: pgmap v4848: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 76 KiB/s wr, 14 op/s 2024-05-08T09:18:36.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:35 smithi194 ceph-mon[33679]: pgmap v4849: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T09:18:36.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:35 smithi070 ceph-mon[29591]: pgmap v4849: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T09:18:36.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:35 smithi172 ceph-mon[33377]: pgmap v4849: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 KiB/s wr, 7 op/s 2024-05-08T09:18:38.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:37 smithi194 ceph-mon[33679]: pgmap v4850: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T09:18:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:37 smithi070 ceph-mon[29591]: pgmap v4850: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T09:18:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:37 smithi172 ceph-mon[33377]: pgmap v4850: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-05-08T09:18:40.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:39 smithi194 ceph-mon[33679]: pgmap v4851: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-05-08T09:18:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:39 smithi070 ceph-mon[29591]: pgmap v4851: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-05-08T09:18:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:39 smithi172 ceph-mon[33377]: pgmap v4851: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 KiB/s wr, 6 op/s 2024-05-08T09:18:42.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:41 smithi194 ceph-mon[33679]: pgmap v4852: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-05-08T09:18:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:41 smithi070 ceph-mon[29591]: pgmap v4852: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-05-08T09:18:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:41 smithi172 ceph-mon[33377]: pgmap v4852: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 9 op/s 2024-05-08T09:18:43.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:42 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:18:43.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:42 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:18:43.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:42 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:18:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:43 smithi070 ceph-mon[29591]: pgmap v4853: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T09:18:44.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:43 smithi172 ceph-mon[33377]: pgmap v4853: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T09:18:44.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:43 smithi194 ceph-mon[33679]: pgmap v4853: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 5 op/s 2024-05-08T09:18:45.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:18:45.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:18:45.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:44 smithi194 ceph-mon[33679]: pgmap v4854: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-05-08T09:18:45.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:18:45.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:18:45.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:44 smithi070 ceph-mon[29591]: pgmap v4854: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-05-08T09:18:45.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:18:45.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:18:45.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:18:45.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:44 smithi172 ceph-mon[33377]: pgmap v4854: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-05-08T09:18:48.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:47 smithi194 ceph-mon[33679]: pgmap v4855: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:47 smithi070 ceph-mon[29591]: pgmap v4855: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:47 smithi172 ceph-mon[33377]: pgmap v4855: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:50.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:49 smithi194 ceph-mon[33679]: pgmap v4856: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:49 smithi070 ceph-mon[29591]: pgmap v4856: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:49 smithi172 ceph-mon[33377]: pgmap v4856: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:50.548 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:18:51.004 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:18:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:51 smithi194 ceph-mon[33679]: pgmap v4857: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:18:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:51 smithi070 ceph-mon[29591]: pgmap v4857: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:18:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:51 smithi172 ceph-mon[33377]: pgmap v4857: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:18:53.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.773+0000 7f9b2b600700 1 -- 172.21.15.70:0/2716724611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2410b6c0 msgr2=0x7f9b2410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:53.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.773+0000 7f9b2b600700 1 --2- 172.21.15.70:0/2716724611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2410b6c0 0x7f9b2410baa0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009990 tx=0x7f9b18009ca0 comp rx=0 tx=0).stop 2024-05-08T09:18:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.773+0000 7f9b2b600700 1 -- 172.21.15.70:0/2716724611 shutdown_connections 2024-05-08T09:18:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.773+0000 7f9b2b600700 1 --2- 172.21.15.70:0/2716724611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b24106080 0x7f9b24112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.773+0000 7f9b2b600700 1 --2- 172.21.15.70:0/2716724611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b2410b6c0 0x7f9b2410baa0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.773+0000 7f9b2b600700 1 --2- 172.21.15.70:0/2716724611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b241056c0 0x7f9b24105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.773+0000 7f9b2b600700 1 -- 172.21.15.70:0/2716724611 >> 172.21.15.70:0/2716724611 conn(0x7f9b241011b0 msgr2=0x7f9b241035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:18:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.773+0000 7f9b2b600700 1 -- 172.21.15.70:0/2716724611 shutdown_connections 2024-05-08T09:18:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.773+0000 7f9b2b600700 1 -- 172.21.15.70:0/2716724611 wait complete. 2024-05-08T09:18:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.774+0000 7f9b2b600700 1 Processor -- start 2024-05-08T09:18:53.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.774+0000 7f9b2b600700 1 -- start start 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b2b600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b241056c0 0x7f9b241a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b2b600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b24106080 0x7f9b241a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b2b600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2410b6c0 0x7f9b2419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b2b600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b241157b0 con 0x7f9b24106080 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b2b600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9b24115630 con 0x7f9b241056c0 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b2b600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9b24115930 con 0x7f9b2410b6c0 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b23e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b24106080 0x7f9b241a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b23e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b24106080 0x7f9b241a1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60142/0 (socket says 172.21.15.70:60142) 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b23e00700 1 -- 172.21.15.70:0/3743096962 learned_addr learned my addr 172.21.15.70:0/3743096962 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b29600700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2410b6c0 0x7f9b2419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b23e00700 1 -- 172.21.15.70:0/3743096962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2410b6c0 msgr2=0x7f9b2419bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b23e00700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2410b6c0 0x7f9b2419bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b23e00700 1 -- 172.21.15.70:0/3743096962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b241056c0 msgr2=0x7f9b241a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b23e00700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b241056c0 0x7f9b241a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.775+0000 7f9b23e00700 1 -- 172.21.15.70:0/3743096962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2419c230 con 0x7f9b24106080 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.776+0000 7f9b23e00700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b24106080 0x7f9b241a1e50 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000c920 tx=0x7f9b1000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.776+0000 7f9b21600700 1 -- 172.21.15.70:0/3743096962 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10007b00 con 0x7f9b24106080 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.776+0000 7f9b21600700 1 -- 172.21.15.70:0/3743096962 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9b10004cc0 con 0x7f9b24106080 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.776+0000 7f9b21600700 1 -- 172.21.15.70:0/3743096962 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b100054f0 con 0x7f9b24106080 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.776+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b2419c520 con 0x7f9b24106080 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.776+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b241a87e0 con 0x7f9b24106080 2024-05-08T09:18:53.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.778+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b2406a190 con 0x7f9b24106080 2024-05-08T09:18:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.780+0000 7f9b21600700 1 -- 172.21.15.70:0/3743096962 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9b10007ca0 con 0x7f9b24106080 2024-05-08T09:18:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.781+0000 7f9b21600700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b0c0b29f0 0x7f9b0c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.782+0000 7f9b21600700 1 -- 172.21.15.70:0/3743096962 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(380..380 src has 1..380) ==== 9583+0+0 (secure 0 0 0) 0x7f9b100e26e0 con 0x7f9b24106080 2024-05-08T09:18:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.782+0000 7f9b28c00700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b0c0b29f0 0x7f9b0c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:53.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.782+0000 7f9b28c00700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b0c0b29f0 0x7f9b0c0b4eb0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9b180098e0 tx=0x7f9b18005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:18:53.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:53.786+0000 7f9b21600700 1 -- 172.21.15.70:0/3743096962 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9b10014030 con 0x7f9b24106080 2024-05-08T09:18:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:53 smithi194 ceph-mon[33679]: pgmap v4858: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:54.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.071+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b2402e510 con 0x7f9b24106080 2024-05-08T09:18:54.071 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:53 smithi070 ceph-mon[29591]: pgmap v4858: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:54.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.072+0000 7f9b21600700 1 -- 172.21.15.70:0/3743096962 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f9b100a9c40 con 0x7f9b24106080 2024-05-08T09:18:54.073 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:18:54.073 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:18:54.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b0c0b29f0 msgr2=0x7f9b0c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b0c0b29f0 0x7f9b0c0b4eb0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9b180098e0 tx=0x7f9b18005fb0 comp rx=0 tx=0).stop 2024-05-08T09:18:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b24106080 msgr2=0x7f9b241a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b24106080 0x7f9b241a1e50 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000c920 tx=0x7f9b1000cce0 comp rx=0 tx=0).stop 2024-05-08T09:18:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 shutdown_connections 2024-05-08T09:18:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9b0c0b29f0 0x7f9b0c0b4eb0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b2410b6c0 0x7f9b2419bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:54.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9b241056c0 0x7f9b241a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 --2- 172.21.15.70:0/3743096962 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b24106080 0x7f9b241a1e50 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.075+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 >> 172.21.15.70:0/3743096962 conn(0x7f9b241011b0 msgr2=0x7f9b24101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:18:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.076+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 shutdown_connections 2024-05-08T09:18:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:54.076+0000 7f9b2b600700 1 -- 172.21.15.70:0/3743096962 wait complete. 2024-05-08T09:18:54.077 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:18:54.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:53 smithi172 ceph-mon[33377]: pgmap v4858: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:55.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:54 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3743096962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:18:55.090 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:54 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3743096962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:18:55.163 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 4abd2449 --release --await' 2024-05-08T09:18:55.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 4abd2449 --release --await 2024-05-08T09:18:55.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:54 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3743096962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:18:55.621 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:18:56.001 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:55 smithi070 ceph-mon[29591]: pgmap v4859: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:18:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:55 smithi194 ceph-mon[33679]: pgmap v4859: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:18:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:55 smithi172 ceph-mon[33377]: pgmap v4859: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:18:57.822 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:57 smithi070 ceph-mon[29591]: pgmap v4860: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:58.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:57 smithi172 ceph-mon[33377]: pgmap v4860: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:18:58.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.182+0000 7f4a8ea00700 1 -- 172.21.15.70:0/3805182893 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a7c003b40 con 0x7f4a90109ad0 2024-05-08T09:18:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.182+0000 7f4a96c00700 1 -- 172.21.15.70:0/3805182893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a90109ad0 msgr2=0x7f4a90109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.182+0000 7f4a96c00700 1 --2- 172.21.15.70:0/3805182893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a90109ad0 0x7f4a90109f50 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009990 tx=0x7f4a7c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.182+0000 7f4a96c00700 1 -- 172.21.15.70:0/3805182893 shutdown_connections 2024-05-08T09:18:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.182+0000 7f4a96c00700 1 --2- 172.21.15.70:0/3805182893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9010a490 0x7f4a901169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.182+0000 7f4a96c00700 1 --2- 172.21.15.70:0/3805182893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a9010fb60 0x7f4a9010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.182+0000 7f4a96c00700 1 --2- 172.21.15.70:0/3805182893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a90109ad0 0x7f4a90109f50 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.182+0000 7f4a96c00700 1 -- 172.21.15.70:0/3805182893 >> 172.21.15.70:0/3805182893 conn(0x7f4a90076c70 msgr2=0x7f4a901082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:18:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.183+0000 7f4a96c00700 1 -- 172.21.15.70:0/3805182893 shutdown_connections 2024-05-08T09:18:58.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.183+0000 7f4a96c00700 1 -- 172.21.15.70:0/3805182893 wait complete. 2024-05-08T09:18:58.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.184+0000 7f4a96c00700 1 Processor -- start 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.184+0000 7f4a96c00700 1 -- start start 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.184+0000 7f4a96c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a90109ad0 0x7f4a901a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.184+0000 7f4a96c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9010a490 0x7f4a901a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.184+0000 7f4a96c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a9010fb60 0x7f4a901a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.184+0000 7f4a96c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a90119bc0 con 0x7f4a9010fb60 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.184+0000 7f4a96c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a90119a40 con 0x7f4a9010a490 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.184+0000 7f4a96c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4a90119d40 con 0x7f4a90109ad0 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.185+0000 7f4a94c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a9010fb60 0x7f4a901a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.185+0000 7f4a94c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a9010fb60 0x7f4a901a4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35844/0 (socket says 172.21.15.70:35844) 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.185+0000 7f4a94c00700 1 -- 172.21.15.70:0/488295076 learned_addr learned my addr 172.21.15.70:0/488295076 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.185+0000 7f4a8f400700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9010a490 0x7f4a901a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.185+0000 7f4a94c00700 1 -- 172.21.15.70:0/488295076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a90109ad0 msgr2=0x7f4a901a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:58.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.185+0000 7f4a94c00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a90109ad0 0x7f4a901a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.185+0000 7f4a94c00700 1 -- 172.21.15.70:0/488295076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9010a490 msgr2=0x7f4a901a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:58.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.185+0000 7f4a94c00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9010a490 0x7f4a901a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.185+0000 7f4a94c00700 1 -- 172.21.15.70:0/488295076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a901a5050 con 0x7f4a9010fb60 2024-05-08T09:18:58.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.186+0000 7f4a94c00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a9010fb60 0x7f4a901a4910 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800b970 tx=0x7f4a8800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:18:58.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.186+0000 7f4a8cc00700 1 -- 172.21.15.70:0/488295076 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88019070 con 0x7f4a9010fb60 2024-05-08T09:18:58.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.186+0000 7f4a8cc00700 1 -- 172.21.15.70:0/488295076 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a8800cdc0 con 0x7f4a9010fb60 2024-05-08T09:18:58.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.186+0000 7f4a96c00700 1 -- 172.21.15.70:0/488295076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a901a5340 con 0x7f4a9010fb60 2024-05-08T09:18:58.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.186+0000 7f4a8cc00700 1 -- 172.21.15.70:0/488295076 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a88014e30 con 0x7f4a9010fb60 2024-05-08T09:18:58.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.186+0000 7f4a96c00700 1 -- 172.21.15.70:0/488295076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a901acbc0 con 0x7f4a9010fb60 2024-05-08T09:18:58.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.189+0000 7f4a8cc00700 1 -- 172.21.15.70:0/488295076 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4a8801c070 con 0x7f4a9010fb60 2024-05-08T09:18:58.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.191+0000 7f4a8cc00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a740b2a70 0x7f4a740b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.191+0000 7f4a8cc00700 1 -- 172.21.15.70:0/488295076 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(380..380 src has 1..380) ==== 9583+0+0 (secure 0 0 0) 0x7f4a880e1cd0 con 0x7f4a9010fb60 2024-05-08T09:18:58.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.191+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a740b2a70 0x7f4a740b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.192+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a740b2a70 0x7f4a740b4f30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4a80005fd0 tx=0x7f4a80005d00 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:18:58.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.210+0000 7f4aa1572b80 1 Processor -- start 2024-05-08T09:18:58.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.210+0000 7f4aa1572b80 1 -- start start 2024-05-08T09:18:58.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.210+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24dea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.210+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 0x561a24de4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.210+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24df0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.210+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a24d36b20 con 0x561a24de9ec0 2024-05-08T09:18:58.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.210+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a24cd4860 con 0x561a24de4e50 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.210+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561a24d32ae0 con 0x561a24de4490 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a8fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24dea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a8fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24dea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35852/0 (socket says 172.21.15.70:35852) 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a8fe00700 1 -- 172.21.15.70:0/3934606574 learned_addr learned my addr 172.21.15.70:0/3934606574 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a8f400700 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 0x561a24de4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a94c00700 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24df0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a8fe00700 1 -- 172.21.15.70:0/3934606574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 msgr2=0x561a24de4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 0x561a24de4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a8fe00700 1 -- 172.21.15.70:0/3934606574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 msgr2=0x561a24df0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24df0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a8fe00700 1 -- 172.21.15.70:0/3934606574 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a24c839d0 con 0x561a24de9ec0 2024-05-08T09:18:58.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.211+0000 7f4a94c00700 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24df0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:18:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.212+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24dea2a0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000cbf0 tx=0x7f4a8000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0d91f763a094b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:18:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.212+0000 7f4a85600700 1 -- 172.21.15.70:0/3934606574 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80020070 con 0x561a24de9ec0 2024-05-08T09:18:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.212+0000 7f4a85600700 1 -- 172.21.15.70:0/3934606574 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a80016070 con 0x561a24de9ec0 2024-05-08T09:18:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.212+0000 7f4a85600700 1 -- 172.21.15.70:0/3934606574 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8000e3b0 con 0x561a24de9ec0 2024-05-08T09:18:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.213+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3934606574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 msgr2=0x561a24dea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.213+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24dea2a0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000cbf0 tx=0x7f4a8000f000 comp rx=0 tx=0).stop 2024-05-08T09:18:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.213+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3934606574 shutdown_connections 2024-05-08T09:18:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.213+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24df0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.213+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24dea2a0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.213+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3934606574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 0x561a24de4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.213+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3934606574 >> 172.21.15.70:0/3934606574 conn(0x561a24d12c60 msgr2=0x561a24dded80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:18:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.213+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3934606574 shutdown_connections 2024-05-08T09:18:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.213+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3934606574 wait complete. 2024-05-08T09:18:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.214+0000 7f4aa1572b80 1 -- start start 2024-05-08T09:18:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.214+0000 7f4aa1572b80 1 Processor -- start 2024-05-08T09:18:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.214+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.214+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24dedbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.214+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de9ec0 0x561a24dee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.214+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a24df1220 con 0x561a24de4490 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.214+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561a24c9cc20 con 0x561a24de4e50 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.214+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561a24df13a0 con 0x561a24de9ec0 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4aa1572b80 10 client.0 _ll_register_callbacks cb 0x561a24cddd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a8fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a8fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35864/0 (socket says 172.21.15.70:35864) 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a8fe00700 1 -- 172.21.15.70:0/3750166389 learned_addr learned my addr 172.21.15.70:0/3750166389 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a94c00700 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de9ec0 0x561a24dee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a8f400700 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24dedbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a8fe00700 1 -- 172.21.15.70:0/3750166389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de9ec0 msgr2=0x561a24dee100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de9ec0 0x561a24dee100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a8fe00700 1 -- 172.21.15.70:0/3750166389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 msgr2=0x561a24dedbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:18:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24dedbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.215+0000 7f4a8fe00700 1 -- 172.21.15.70:0/3750166389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a24cfc520 con 0x561a24de4490 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.216+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df0820 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000cbc0 tx=0x7f4a8000fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c443586631b7194a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.216+0000 7f4a7a000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.216+0000 7f4a7a000700 1 -- 172.21.15.70:0/3750166389 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80020040 con 0x561a24de4490 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.216+0000 7f4a7a000700 1 -- 172.21.15.70:0/3750166389 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(380..380 src has 1..380) ==== 9583+0+0 (secure 0 0 0) 0x7f4a80004220 con 0x561a24de4490 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.216+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3750166389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a80016070 con 0x561a24de4490 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.216+0000 7f4a7a000700 1 -- 172.21.15.70:0/3750166389 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4a8003a050 con 0x561a24de4490 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.216+0000 7f4aa1572b80 10 client.19359 fetch_fsmap learned FSMap version 42 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.216+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3750166389 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x561a24dfb9c0 con 0x561a24de4490 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.217+0000 7f4a7a000700 1 -- 172.21.15.70:0/3750166389 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a80016070 con 0x561a24de4490 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.217+0000 7f4a7a000700 1 -- 172.21.15.70:0/3750166389 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4a8001b070 con 0x561a24de4490 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.217+0000 7f4aa1572b80 10 client.19359 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.217+0000 7f4aa1572b80 10 client.19359 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:18:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.217+0000 7f4aa1572b80 20 client.19359 populate_metadata read hostname 'smithi070' 2024-05-08T09:18:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.217+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a24dfdee0 0x561a24e002d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.217+0000 7f4aa1572b80 4 client.19359 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:18:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.217+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3750166389 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a24db11a0 con 0x561a24dfdee0 2024-05-08T09:18:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.218+0000 7f4a8f400700 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a24dfdee0 0x561a24e002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.219+0000 7f4a8f400700 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a24dfdee0 0x561a24e002d0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dea60f44d5d42dd1 server_cookie=b378ddb73a67c2d4 in_seq=0 out_seq=0 2024-05-08T09:18:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.219+0000 7f4a7a000700 10 client.19359 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4a7a000700 1 -- 172.21.15.70:0/3750166389 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561a24db11a0 con 0x561a24dfdee0 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4a7a000700 10 client.19359 handle_command_reply: tid=0 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4aa1572b80 1 client.19359 shutdown 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3750166389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 msgr2=0x561a24df0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df0820 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f4a8000cbc0 tx=0x7f4a8000fdd0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3750166389 shutdown_connections 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a24dfdee0 0x561a24e002d0 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de9ec0 0x561a24dee100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df0820 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/3750166389 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24dedbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3750166389 >> 172.21.15.70:0/3750166389 conn(0x561a24d12c60 msgr2=0x561a24dd9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:18:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.221+0000 7f4a7a000700 0 client.19359 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:18:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.222+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3750166389 shutdown_connections 2024-05-08T09:18:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.222+0000 7f4aa1572b80 1 -- 172.21.15.70:0/3750166389 wait complete. 2024-05-08T09:18:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.222+0000 7f4aa1572b80 20 client.19359 trim_cache size 0 max 16384 2024-05-08T09:18:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.244+0000 7f4aa1572b80 1 Processor -- start 2024-05-08T09:18:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.244+0000 7f4aa1572b80 1 -- start start 2024-05-08T09:18:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.244+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 0x561a24dfa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.244+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24de7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.244+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24e059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.244+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a901b8490 con 0x561a24de9ec0 2024-05-08T09:18:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.244+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a901b5d20 con 0x561a24de4e50 2024-05-08T09:18:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.244+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4a901b3b90 con 0x561a24de4490 2024-05-08T09:18:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a8fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 0x561a24dfa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a94c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24e059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a8f400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24de7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a8fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 0x561a24dfa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:49374/0 (socket says 172.21.15.70:49374) 2024-05-08T09:18:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a8f400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24de7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:42382/0 (socket says 172.21.15.70:42382) 2024-05-08T09:18:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a8fe00700 1 -- 172.21.15.70:0/1628343276 learned_addr learned my addr 172.21.15.70:0/1628343276 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a94c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24e059f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35866/0 (socket says 172.21.15.70:35866) 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a94c00700 1 -- 172.21.15.70:0/1628343276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 msgr2=0x561a24dfa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a94c00700 1 --2- 172.21.15.70:0/1628343276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 0x561a24dfa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a94c00700 1 -- 172.21.15.70:0/1628343276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 msgr2=0x561a24de7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a94c00700 1 --2- 172.21.15.70:0/1628343276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24de7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.245+0000 7f4a94c00700 1 -- 172.21.15.70:0/1628343276 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a24df0460 con 0x561a24de9ec0 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.246+0000 7f4a94c00700 1 --2- 172.21.15.70:0/1628343276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24e059f0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f4a880df0b0 tx=0x7f4a88004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1c34fd45466dd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.246+0000 7f4a84c00700 1 -- 172.21.15.70:0/1628343276 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a880a9340 con 0x561a24de9ec0 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.246+0000 7f4a84c00700 1 -- 172.21.15.70:0/1628343276 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a880a8c40 con 0x561a24de9ec0 2024-05-08T09:18:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.246+0000 7f4a84c00700 1 -- 172.21.15.70:0/1628343276 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a880b1610 con 0x561a24de9ec0 2024-05-08T09:18:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 -- 172.21.15.70:0/1628343276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 msgr2=0x561a24e059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:18:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/1628343276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24e059f0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f4a880df0b0 tx=0x7f4a88004ad0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 -- 172.21.15.70:0/1628343276 shutdown_connections 2024-05-08T09:18:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/1628343276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de9ec0 0x561a24e059f0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/1628343276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4490 0x561a24dfa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/1628343276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de4e50 0x561a24de7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 -- 172.21.15.70:0/1628343276 >> 172.21.15.70:0/1628343276 conn(0x561a24d12c60 msgr2=0x561a24de3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:18:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 -- 172.21.15.70:0/1628343276 shutdown_connections 2024-05-08T09:18:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 -- 172.21.15.70:0/1628343276 wait complete. 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.247+0000 7f4aa1572b80 1 -- start start 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.248+0000 7f4aa1572b80 1 Processor -- start 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.248+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.248+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4e50 0x561a24df6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.248+0000 7f4aa1572b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de9ec0 0x561a24df39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.248+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a901b41e0 con 0x561a24de4490 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.248+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4a901b5650 con 0x561a24de9ec0 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.248+0000 7f4aa1572b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4a901b48b0 con 0x561a24de4e50 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.248+0000 7f4aa1572b80 10 client.0 _ll_register_callbacks cb 0x561a24cddd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35878/0 (socket says 172.21.15.70:35878) 2024-05-08T09:18:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8fe00700 1 -- 172.21.15.70:0/246745186 learned_addr learned my addr 172.21.15.70:0/246745186 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a94c00700 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de9ec0 0x561a24df39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8f400700 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4e50 0x561a24df6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8fe00700 1 -- 172.21.15.70:0/246745186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4e50 msgr2=0x561a24df6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4e50 0x561a24df6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8fe00700 1 -- 172.21.15.70:0/246745186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de9ec0 msgr2=0x561a24df39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de9ec0 0x561a24df39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8fe00700 1 -- 172.21.15.70:0/246745186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a24df40c0 con 0x561a24de4490 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a94c00700 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de9ec0 0x561a24df39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a8fe00700 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df63f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f4a80003bd0 tx=0x7f4a8000c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21015b1b3c03cbf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.249+0000 7f4a7a000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.250+0000 7f4a7a000700 1 -- 172.21.15.70:0/246745186 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a80013020 con 0x561a24de4490 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.250+0000 7f4a7a000700 1 -- 172.21.15.70:0/246745186 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(380..380 src has 1..380) ==== 9583+0+0 (secure 0 0 0) 0x7f4a8001c800 con 0x561a24de4490 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.250+0000 7f4aa1572b80 1 -- 172.21.15.70:0/246745186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a880a8c40 con 0x561a24de4490 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.250+0000 7f4a7a000700 1 -- 172.21.15.70:0/246745186 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4a80020070 con 0x561a24de4490 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.250+0000 7f4aa1572b80 10 client.19365 fetch_fsmap learned FSMap version 42 2024-05-08T09:18:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.250+0000 7f4aa1572b80 1 -- 172.21.15.70:0/246745186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x561a24e6a070 con 0x561a24de4490 2024-05-08T09:18:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.250+0000 7f4a7a000700 1 -- 172.21.15.70:0/246745186 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a880a8c40 con 0x561a24de4490 2024-05-08T09:18:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.250+0000 7f4a7a000700 1 -- 172.21.15.70:0/246745186 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4a8001b040 con 0x561a24de4490 2024-05-08T09:18:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.251+0000 7f4aa1572b80 10 client.19365 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:18:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.251+0000 7f4aa1572b80 10 client.19365 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:18:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.251+0000 7f4aa1572b80 20 client.19365 populate_metadata read hostname 'smithi070' 2024-05-08T09:18:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.251+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a24e6a6c0 0x561a24e6cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:18:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.251+0000 7f4aa1572b80 4 client.19365 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "4abd2449", "release": true, "await": true}] 2024-05-08T09:18:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.251+0000 7f4aa1572b80 1 -- 172.21.15.70:0/246745186 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "4abd2449", "release": true, "await": true}) -- 0x561a24d44500 con 0x561a24e6a6c0 2024-05-08T09:18:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.251+0000 7f4a8f400700 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a24e6a6c0 0x561a24e6cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:18:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.252+0000 7f4a8f400700 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a24e6a6c0 0x561a24e6cab0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fa4be2af2ef5b8a server_cookie=2f129d63a1ec1cd8 in_seq=0 out_seq=0 2024-05-08T09:18:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:18:58.252+0000 7f4a7a000700 10 client.19365 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:18:58.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:57 smithi194 ceph-mon[33679]: pgmap v4860: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:19:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:18:59 smithi070 ceph-mon[29591]: pgmap v4861: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:19:00.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:18:59 smithi172 ceph-mon[33377]: pgmap v4861: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:19:00.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:18:59 smithi194 ceph-mon[33679]: pgmap v4861: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:19:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:01 smithi070 ceph-mon[29591]: pgmap v4862: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:19:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:01 smithi172 ceph-mon[33377]: pgmap v4862: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:19:02.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:01 smithi194 ceph-mon[33679]: pgmap v4862: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:19:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.837+0000 7f4a7a000700 1 -- 172.21.15.70:0/246745186 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x561a24d44500 con 0x561a24e6a6c0 2024-05-08T09:19:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.837+0000 7f4a7a000700 10 client.19365 handle_command_reply: tid=0 2024-05-08T09:19:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.837+0000 7f4aa1572b80 1 client.19365 shutdown 2024-05-08T09:19:02.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.838+0000 7f4aa1572b80 1 -- 172.21.15.70:0/246745186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 msgr2=0x561a24df63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:19:02.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.838+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df63f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f4a80003bd0 tx=0x7f4a8000c690 comp rx=0 tx=0).stop 2024-05-08T09:19:02.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.839+0000 7f4aa1572b80 1 -- 172.21.15.70:0/246745186 shutdown_connections 2024-05-08T09:19:02.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.839+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561a24e6a6c0 0x561a24e6cab0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:19:02.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.839+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561a24de9ec0 0x561a24df39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:19:02.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.839+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a24de4490 0x561a24df63f0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:19:02.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.839+0000 7f4aa1572b80 1 --2- 172.21.15.70:0/246745186 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561a24de4e50 0x561a24df6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:19:02.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.839+0000 7f4aa1572b80 1 -- 172.21.15.70:0/246745186 >> 172.21.15.70:0/246745186 conn(0x561a24d12c60 msgr2=0x561a24dd8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:19:02.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.839+0000 7f4a7a000700 0 client.19365 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:19:02.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.839+0000 7f4aa1572b80 1 -- 172.21.15.70:0/246745186 shutdown_connections 2024-05-08T09:19:02.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.839+0000 7f4aa1572b80 1 -- 172.21.15.70:0/246745186 wait complete. 2024-05-08T09:19:02.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.840+0000 7f4aa1572b80 20 client.19365 trim_cache size 0 max 16384 2024-05-08T09:19:02.840 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 336, 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "4abd2449": { 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 336, 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:19:02.841 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 93.8, 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:19:02.842 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:19:02.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 -- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a740b2a70 msgr2=0x7f4a740b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:19:02.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a740b2a70 0x7f4a740b4f30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4a80005fd0 tx=0x7f4a80005d00 comp rx=0 tx=0).stop 2024-05-08T09:19:02.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 -- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a9010fb60 msgr2=0x7f4a901a4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:19:02.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a9010fb60 0x7f4a901a4910 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800b970 tx=0x7f4a8800bc80 comp rx=0 tx=0).stop 2024-05-08T09:19:02.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 -- 172.21.15.70:0/488295076 shutdown_connections 2024-05-08T09:19:02.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a740b2a70 0x7f4a740b4f30 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:19:02.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a9010fb60 0x7f4a901a4910 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:19:02.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a90109ad0 0x7f4a901a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:19:02.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 --2- 172.21.15.70:0/488295076 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4a9010a490 0x7f4a901a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:19:02.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.841+0000 7f4a96c00700 1 -- 172.21.15.70:0/488295076 >> 172.21.15.70:0/488295076 conn(0x7f4a90076c70 msgr2=0x7f4a90077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:19:02.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.842+0000 7f4a96c00700 1 -- 172.21.15.70:0/488295076 shutdown_connections 2024-05-08T09:19:02.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:19:02.842+0000 7f4a96c00700 1 -- 172.21.15.70:0/488295076 wait complete. 2024-05-08T09:19:03.699 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '4abd2449', seconds elapsed: 89.2 2024-05-08T09:19:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:03 smithi070 ceph-mon[29591]: pgmap v4863: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:19:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:03 smithi172 ceph-mon[33377]: pgmap v4863: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:19:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:03 smithi194 ceph-mon[33679]: pgmap v4863: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:19:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:05 smithi070 ceph-mon[29591]: pgmap v4864: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-05-08T09:19:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:05 smithi172 ceph-mon[33377]: pgmap v4864: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-05-08T09:19:06.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:05 smithi194 ceph-mon[33679]: pgmap v4864: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 57 KiB/s wr, 10 op/s 2024-05-08T09:19:08.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:07 smithi070 ceph-mon[29591]: pgmap v4865: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T09:19:08.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:07 smithi172 ceph-mon[33377]: pgmap v4865: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T09:19:08.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:07 smithi194 ceph-mon[33679]: pgmap v4865: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T09:19:09.238 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_request.o 2024-05-08T09:19:09.353 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-samsung.o 2024-05-08T09:19:10.064 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:09 smithi194 ceph-mon[33679]: pgmap v4866: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T09:19:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:09 smithi070 ceph-mon[29591]: pgmap v4866: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T09:19:10.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:09 smithi172 ceph-mon[33377]: pgmap v4866: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T09:19:11.375 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-sony.o 2024-05-08T09:19:11.708 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-sunplus.o 2024-05-08T09:19:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:11 smithi070 ceph-mon[29591]: pgmap v4867: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 226 KiB/s wr, 26 op/s 2024-05-08T09:19:12.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:11 smithi172 ceph-mon[33377]: pgmap v4867: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 226 KiB/s wr, 26 op/s 2024-05-08T09:19:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:11 smithi194 ceph-mon[33679]: pgmap v4867: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 192 KiB/s rd, 226 KiB/s wr, 26 op/s 2024-05-08T09:19:12.267 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/hid/hid-topseed.o 2024-05-08T09:19:12.287 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_atomic_helper.o 2024-05-08T09:19:12.293 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_atomic_state_helper.o 2024-05-08T09:19:12.297 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_scheduler.o 2024-05-08T09:19:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:13 smithi070 ceph-mon[29591]: pgmap v4868: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 226 KiB/s wr, 23 op/s 2024-05-08T09:19:14.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:13 smithi172 ceph-mon[33377]: pgmap v4868: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 226 KiB/s wr, 23 op/s 2024-05-08T09:19:14.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:13 smithi194 ceph-mon[33679]: pgmap v4868: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 226 KiB/s wr, 23 op/s 2024-05-08T09:19:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:14 smithi070 ceph-mon[29591]: osdmap e381: 12 total, 12 up, 12 in 2024-05-08T09:19:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:14 smithi070 ceph-mon[29591]: pgmap v4870: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 569 KiB/s wr, 46 op/s 2024-05-08T09:19:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:14 smithi172 ceph-mon[33377]: osdmap e381: 12 total, 12 up, 12 in 2024-05-08T09:19:15.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:14 smithi172 ceph-mon[33377]: pgmap v4870: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 569 KiB/s wr, 46 op/s 2024-05-08T09:19:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:14 smithi194 ceph-mon[33679]: osdmap e381: 12 total, 12 up, 12 in 2024-05-08T09:19:15.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:14 smithi194 ceph-mon[33679]: pgmap v4870: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 569 KiB/s wr, 46 op/s 2024-05-08T09:19:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:17 smithi194 ceph-mon[33679]: pgmap v4871: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 570 KiB/s wr, 46 op/s 2024-05-08T09:19:18.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:17 smithi070 ceph-mon[29591]: pgmap v4871: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 570 KiB/s wr, 46 op/s 2024-05-08T09:19:18.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:17 smithi172 ceph-mon[33377]: pgmap v4871: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 570 KiB/s wr, 46 op/s 2024-05-08T09:19:19.019 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_trace_points.o 2024-05-08T09:19:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:19 smithi194 ceph-mon[33679]: pgmap v4872: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 570 KiB/s wr, 46 op/s 2024-05-08T09:19:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:19 smithi070 ceph-mon[29591]: pgmap v4872: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 570 KiB/s wr, 46 op/s 2024-05-08T09:19:20.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:19 smithi172 ceph-mon[33377]: pgmap v4872: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 494 KiB/s rd, 570 KiB/s wr, 46 op/s 2024-05-08T09:19:21.315 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_ttm_buddy_manager.o 2024-05-08T09:19:21.570 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_bridge_connector.o 2024-05-08T09:19:21.822 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_crtc_helper.o 2024-05-08T09:19:21.875 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/hid/built-in.a 2024-05-08T09:19:22.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:21 smithi194 ceph-mon[33679]: pgmap v4873: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 544 KiB/s wr, 31 op/s 2024-05-08T09:19:22.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:21 smithi194 ceph-mon[33679]: osdmap e382: 12 total, 12 up, 12 in 2024-05-08T09:19:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:21 smithi070 ceph-mon[29591]: pgmap v4873: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 544 KiB/s wr, 31 op/s 2024-05-08T09:19:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:21 smithi070 ceph-mon[29591]: osdmap e382: 12 total, 12 up, 12 in 2024-05-08T09:19:22.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:21 smithi172 ceph-mon[33377]: pgmap v4873: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 544 KiB/s wr, 31 op/s 2024-05-08T09:19:22.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:21 smithi172 ceph-mon[33377]: osdmap e382: 12 total, 12 up, 12 in 2024-05-08T09:19:22.884 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_damage_helper.o 2024-05-08T09:19:23.252 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_encoder_slave.o 2024-05-08T09:19:23.424 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_flip_work.o 2024-05-08T09:19:24.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:23 smithi194 ceph-mon[33679]: pgmap v4875: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 200 KiB/s wr, 8 op/s 2024-05-08T09:19:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:23 smithi070 ceph-mon[29591]: pgmap v4875: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 200 KiB/s wr, 8 op/s 2024-05-08T09:19:24.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:23 smithi172 ceph-mon[33377]: pgmap v4875: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 200 KiB/s wr, 8 op/s 2024-05-08T09:19:25.670 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_vma.o 2024-05-08T09:19:26.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:25 smithi194 ceph-mon[33679]: pgmap v4876: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 671 KiB/s wr, 23 op/s 2024-05-08T09:19:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:25 smithi070 ceph-mon[29591]: pgmap v4876: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 671 KiB/s wr, 23 op/s 2024-05-08T09:19:26.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:25 smithi172 ceph-mon[33377]: pgmap v4876: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 671 KiB/s wr, 23 op/s 2024-05-08T09:19:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:27 smithi194 ceph-mon[33679]: pgmap v4877: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 671 KiB/s wr, 23 op/s 2024-05-08T09:19:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:27 smithi070 ceph-mon[29591]: pgmap v4877: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 671 KiB/s wr, 23 op/s 2024-05-08T09:19:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:27 smithi172 ceph-mon[33377]: pgmap v4877: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 671 KiB/s wr, 23 op/s 2024-05-08T09:19:30.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:29 smithi070 ceph-mon[29591]: pgmap v4878: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 671 KiB/s wr, 23 op/s 2024-05-08T09:19:30.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:29 smithi172 ceph-mon[33377]: pgmap v4878: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 671 KiB/s wr, 23 op/s 2024-05-08T09:19:30.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:29 smithi194 ceph-mon[33679]: pgmap v4878: 129 pgs: 129 active+clean; 2.0 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 602 KiB/s rd, 671 KiB/s wr, 23 op/s 2024-05-08T09:19:31.066 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_vma_resource.o 2024-05-08T09:19:31.225 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_gsc_fw.o 2024-05-08T09:19:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:31 smithi070 ceph-mon[29591]: pgmap v4879: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 901 KiB/s wr, 45 op/s 2024-05-08T09:19:32.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:31 smithi172 ceph-mon[33377]: pgmap v4879: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 901 KiB/s wr, 45 op/s 2024-05-08T09:19:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:31 smithi194 ceph-mon[33679]: pgmap v4879: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 901 KiB/s wr, 45 op/s 2024-05-08T09:19:32.274 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_gsc_proxy.o 2024-05-08T09:19:32.618 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_gsc_uc.o 2024-05-08T09:19:32.959 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_gsc_uc_heci_cmd_submit.o 2024-05-08T09:19:33.523 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_format_helper.o 2024-05-08T09:19:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:33 smithi070 ceph-mon[29591]: pgmap v4880: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 801 KiB/s wr, 40 op/s 2024-05-08T09:19:34.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:33 smithi172 ceph-mon[33377]: pgmap v4880: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 801 KiB/s wr, 40 op/s 2024-05-08T09:19:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:33 smithi194 ceph-mon[33679]: pgmap v4880: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 735 KiB/s rd, 801 KiB/s wr, 40 op/s 2024-05-08T09:19:34.278 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc.o 2024-05-08T09:19:36.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:35 smithi070 ceph-mon[29591]: pgmap v4881: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 49 op/s 2024-05-08T09:19:36.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:35 smithi172 ceph-mon[33377]: pgmap v4881: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 49 op/s 2024-05-08T09:19:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:35 smithi194 ceph-mon[33679]: pgmap v4881: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 49 op/s 2024-05-08T09:19:38.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:37 smithi070 ceph-mon[29591]: pgmap v4882: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 762 KiB/s wr, 36 op/s 2024-05-08T09:19:38.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:37 smithi172 ceph-mon[33377]: pgmap v4882: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 762 KiB/s wr, 36 op/s 2024-05-08T09:19:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:37 smithi194 ceph-mon[33679]: pgmap v4882: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 762 KiB/s wr, 36 op/s 2024-05-08T09:19:39.433 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_gem_atomic_helper.o 2024-05-08T09:19:40.064 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:39 smithi194 ceph-mon[33679]: pgmap v4883: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 762 KiB/s wr, 36 op/s 2024-05-08T09:19:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:39 smithi070 ceph-mon[29591]: pgmap v4883: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 762 KiB/s wr, 36 op/s 2024-05-08T09:19:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:39 smithi172 ceph-mon[33377]: pgmap v4883: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 762 KiB/s wr, 36 op/s 2024-05-08T09:19:41.760 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_gem_framebuffer_helper.o 2024-05-08T09:19:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:41 smithi070 ceph-mon[29591]: pgmap v4884: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 47 op/s 2024-05-08T09:19:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:41 smithi172 ceph-mon[33377]: pgmap v4884: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 47 op/s 2024-05-08T09:19:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:41 smithi194 ceph-mon[33679]: pgmap v4884: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 47 op/s 2024-05-08T09:19:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:43 smithi070 ceph-mon[29591]: pgmap v4885: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 724 KiB/s wr, 22 op/s 2024-05-08T09:19:44.145 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_kms_helper_common.o 2024-05-08T09:19:44.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:43 smithi172 ceph-mon[33377]: pgmap v4885: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 724 KiB/s wr, 22 op/s 2024-05-08T09:19:44.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:43 smithi194 ceph-mon[33679]: pgmap v4885: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 849 KiB/s rd, 724 KiB/s wr, 22 op/s 2024-05-08T09:19:44.406 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_modeset_helper.o 2024-05-08T09:19:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:19:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:19:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:19:45.651 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_ads.o 2024-05-08T09:19:45.868 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_plane_helper.o 2024-05-08T09:19:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:45 smithi070 ceph-mon[29591]: pgmap v4886: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1019 KiB/s wr, 38 op/s 2024-05-08T09:19:46.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:45 smithi172 ceph-mon[33377]: pgmap v4886: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1019 KiB/s wr, 38 op/s 2024-05-08T09:19:46.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:45 smithi194 ceph-mon[33679]: pgmap v4886: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1019 KiB/s wr, 38 op/s 2024-05-08T09:19:46.311 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_probe_helper.o 2024-05-08T09:19:47.787 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_capture.o 2024-05-08T09:19:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:47 smithi070 ceph-mon[29591]: pgmap v4887: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 596 KiB/s wr, 26 op/s 2024-05-08T09:19:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:19:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:19:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:19:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:19:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:19:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:47 smithi172 ceph-mon[33377]: pgmap v4887: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 596 KiB/s wr, 26 op/s 2024-05-08T09:19:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:19:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:19:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:19:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:19:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:19:48.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:47 smithi194 ceph-mon[33679]: pgmap v4887: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 596 KiB/s wr, 26 op/s 2024-05-08T09:19:48.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:19:48.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:19:48.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:19:48.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:19:48.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:19:49.477 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_ct.o 2024-05-08T09:19:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:49 smithi070 ceph-mon[29591]: pgmap v4888: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 596 KiB/s wr, 26 op/s 2024-05-08T09:19:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:49 smithi172 ceph-mon[33377]: pgmap v4888: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 596 KiB/s wr, 26 op/s 2024-05-08T09:19:50.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:49 smithi194 ceph-mon[33679]: pgmap v4888: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 596 KiB/s wr, 26 op/s 2024-05-08T09:19:51.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:50 smithi070 ceph-mon[29591]: pgmap v4889: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 999 KiB/s wr, 40 op/s 2024-05-08T09:19:51.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:50 smithi172 ceph-mon[33377]: pgmap v4889: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 999 KiB/s wr, 40 op/s 2024-05-08T09:19:51.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:50 smithi194 ceph-mon[33679]: pgmap v4889: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 999 KiB/s wr, 40 op/s 2024-05-08T09:19:51.850 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_debugfs.o 2024-05-08T09:19:53.154 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_fw.o 2024-05-08T09:19:54.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:53 smithi194 ceph-mon[33679]: pgmap v4890: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 699 KiB/s wr, 29 op/s 2024-05-08T09:19:54.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:53 smithi070 ceph-mon[29591]: pgmap v4890: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 699 KiB/s wr, 29 op/s 2024-05-08T09:19:54.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:53 smithi172 ceph-mon[33377]: pgmap v4890: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 547 KiB/s rd, 699 KiB/s wr, 29 op/s 2024-05-08T09:19:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:55 smithi194 ceph-mon[33679]: pgmap v4891: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 894 KiB/s wr, 56 op/s 2024-05-08T09:19:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:55 smithi070 ceph-mon[29591]: pgmap v4891: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 894 KiB/s wr, 56 op/s 2024-05-08T09:19:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:55 smithi172 ceph-mon[33377]: pgmap v4891: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 894 KiB/s wr, 56 op/s 2024-05-08T09:19:56.289 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_hwconfig.o 2024-05-08T09:19:56.324 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_log.o 2024-05-08T09:19:56.330 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_rect.o 2024-05-08T09:19:58.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:57 smithi194 ceph-mon[33679]: pgmap v4892: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 598 KiB/s wr, 40 op/s 2024-05-08T09:19:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:57 smithi070 ceph-mon[29591]: pgmap v4892: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 598 KiB/s wr, 40 op/s 2024-05-08T09:19:58.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:57 smithi172 ceph-mon[33377]: pgmap v4892: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 598 KiB/s wr, 40 op/s 2024-05-08T09:20:00.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:19:59 smithi194 ceph-mon[33679]: pgmap v4893: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 598 KiB/s wr, 40 op/s 2024-05-08T09:20:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:19:59 smithi070 ceph-mon[29591]: pgmap v4893: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 598 KiB/s wr, 40 op/s 2024-05-08T09:20:00.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:19:59 smithi172 ceph-mon[33377]: pgmap v4893: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 598 KiB/s wr, 40 op/s 2024-05-08T09:20:01.082 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T09:20:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T09:20:01.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T09:20:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:01 smithi070 ceph-mon[29591]: pgmap v4894: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 960 KiB/s wr, 49 op/s 2024-05-08T09:20:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:01 smithi172 ceph-mon[33377]: pgmap v4894: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 960 KiB/s wr, 49 op/s 2024-05-08T09:20:02.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:01 smithi194 ceph-mon[33679]: pgmap v4894: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 960 KiB/s wr, 49 op/s 2024-05-08T09:20:02.911 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_self_refresh_helper.o 2024-05-08T09:20:03.020 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_simple_kms_helper.o 2024-05-08T09:20:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:03 smithi070 ceph-mon[29591]: pgmap v4895: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 556 KiB/s wr, 35 op/s 2024-05-08T09:20:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:03 smithi172 ceph-mon[33377]: pgmap v4895: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 556 KiB/s wr, 35 op/s 2024-05-08T09:20:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:03 smithi194 ceph-mon[33679]: pgmap v4895: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 556 KiB/s wr, 35 op/s 2024-05-08T09:20:04.469 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/bridge/panel.o 2024-05-08T09:20:05.172 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_log_debugfs.o 2024-05-08T09:20:05.691 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/drm_mipi_dsi.o 2024-05-08T09:20:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:05 smithi070 ceph-mon[29591]: pgmap v4896: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 822 KiB/s wr, 67 op/s 2024-05-08T09:20:06.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:05 smithi172 ceph-mon[33377]: pgmap v4896: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 822 KiB/s wr, 67 op/s 2024-05-08T09:20:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:05 smithi194 ceph-mon[33679]: pgmap v4896: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 890 KiB/s rd, 822 KiB/s wr, 67 op/s 2024-05-08T09:20:06.471 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T09:20:06.471 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T09:20:06.472 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:20:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:20:07.931 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_rc.o 2024-05-08T09:20:08.089 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:07 smithi070 ceph-mon[29591]: pgmap v4897: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 627 KiB/s wr, 39 op/s 2024-05-08T09:20:08.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:07 smithi172 ceph-mon[33377]: pgmap v4897: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 627 KiB/s wr, 39 op/s 2024-05-08T09:20:08.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:07 smithi194 ceph-mon[33679]: pgmap v4897: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 627 KiB/s wr, 39 op/s 2024-05-08T09:20:10.064 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:09 smithi194 ceph-mon[33679]: pgmap v4898: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 627 KiB/s wr, 39 op/s 2024-05-08T09:20:10.065 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:09 smithi194 ceph-mon[33679]: osdmap e383: 12 total, 12 up, 12 in 2024-05-08T09:20:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:09 smithi070 ceph-mon[29591]: pgmap v4898: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 627 KiB/s wr, 39 op/s 2024-05-08T09:20:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:09 smithi070 ceph-mon[29591]: osdmap e383: 12 total, 12 up, 12 in 2024-05-08T09:20:10.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:09 smithi172 ceph-mon[33377]: pgmap v4898: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 627 KiB/s wr, 39 op/s 2024-05-08T09:20:10.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:09 smithi172 ceph-mon[33377]: osdmap e383: 12 total, 12 up, 12 in 2024-05-08T09:20:10.269 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_slpc.o 2024-05-08T09:20:10.400 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_guc_submission.o 2024-05-08T09:20:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:11 smithi070 ceph-mon[29591]: pgmap v4900: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 741 KiB/s wr, 49 op/s 2024-05-08T09:20:12.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:11 smithi172 ceph-mon[33377]: pgmap v4900: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 741 KiB/s wr, 49 op/s 2024-05-08T09:20:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:11 smithi194 ceph-mon[33679]: pgmap v4900: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 741 KiB/s wr, 49 op/s 2024-05-08T09:20:12.458 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_huc.o 2024-05-08T09:20:13.016 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_huc_debugfs.o 2024-05-08T09:20:13.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.366+0000 7f31b7000700 1 -- 172.21.15.70:0/2125722653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 msgr2=0x7f31b0109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:13.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.366+0000 7f31b7000700 1 --2- 172.21.15.70:0/2125722653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 0x7f31b0109920 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009990 tx=0x7f31a0009ca0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.366+0000 7f31b7000700 1 -- 172.21.15.70:0/2125722653 shutdown_connections 2024-05-08T09:20:13.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.366+0000 7f31b7000700 1 --2- 172.21.15.70:0/2125722653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b0103f20 0x7f31b0110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.366+0000 7f31b7000700 1 --2- 172.21.15.70:0/2125722653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 0x7f31b0109920 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.366+0000 7f31b7000700 1 --2- 172.21.15.70:0/2125722653 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103560 0x7f31b01039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.366+0000 7f31b7000700 1 -- 172.21.15.70:0/2125722653 >> 172.21.15.70:0/2125722653 conn(0x7f31b007a660 msgr2=0x7f31b007aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:20:13.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.367+0000 7f31b7000700 1 -- 172.21.15.70:0/2125722653 shutdown_connections 2024-05-08T09:20:13.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.367+0000 7f31b7000700 1 -- 172.21.15.70:0/2125722653 wait complete. 2024-05-08T09:20:13.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.369+0000 7f31b7000700 1 Processor -- start 2024-05-08T09:20:13.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.369+0000 7f31b7000700 1 -- start start 2024-05-08T09:20:13.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31b7000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b0103560 0x7f31b00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:13.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31b7000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103f20 0x7f31b0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:13.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31b7000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 0x7f31b0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:13.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31b7000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f31b0113520 con 0x7f31b0103560 2024-05-08T09:20:13.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31b7000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f31b01133a0 con 0x7f31b0103f20 2024-05-08T09:20:13.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31b7000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f31b01136a0 con 0x7f31b0109540 2024-05-08T09:20:13.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31b5000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 0x7f31b0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:13.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31af400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103f20 0x7f31b0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:13.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31b5000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 0x7f31b0076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:56098/0 (socket says 172.21.15.70:56098) 2024-05-08T09:20:13.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.370+0000 7f31b5000700 1 -- 172.21.15.70:0/1205366671 learned_addr learned my addr 172.21.15.70:0/1205366671 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:20:13.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.371+0000 7f31af400700 1 -- 172.21.15.70:0/1205366671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 msgr2=0x7f31b0076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:13.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.371+0000 7f31afe00700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b0103560 0x7f31b00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:13.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.371+0000 7f31af400700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 0x7f31b0076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.371+0000 7f31af400700 1 -- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b0103560 msgr2=0x7f31b00757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:13.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.371+0000 7f31af400700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b0103560 0x7f31b00757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.371+0000 7f31af400700 1 -- 172.21.15.70:0/1205366671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b01a7f40 con 0x7f31b0103f20 2024-05-08T09:20:13.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.371+0000 7f31b5000700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 0x7f31b0076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:20:13.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.371+0000 7f31afe00700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b0103560 0x7f31b00757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:20:13.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.372+0000 7f31af400700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103f20 0x7f31b0075ce0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f319c00e9f0 tx=0x7f319c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:20:13.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.372+0000 7f31acc00700 1 -- 172.21.15.70:0/1205366671 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c00cb70 con 0x7f31b0103f20 2024-05-08T09:20:13.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.372+0000 7f31acc00700 1 -- 172.21.15.70:0/1205366671 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f319c0044b0 con 0x7f31b0103f20 2024-05-08T09:20:13.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.372+0000 7f31acc00700 1 -- 172.21.15.70:0/1205366671 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f319c003cf0 con 0x7f31b0103f20 2024-05-08T09:20:13.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.372+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b01a8230 con 0x7f31b0103f20 2024-05-08T09:20:13.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.372+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b01a87c0 con 0x7f31b0103f20 2024-05-08T09:20:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.375+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b006a190 con 0x7f31b0103f20 2024-05-08T09:20:13.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.378+0000 7f31acc00700 1 -- 172.21.15.70:0/1205366671 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f319c003eb0 con 0x7f31b0103f20 2024-05-08T09:20:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.381+0000 7f31acc00700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31940b2a70 0x7f31940b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.381+0000 7f31acc00700 1 -- 172.21.15.70:0/1205366671 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(383..383 src has 1..383) ==== 9671+0+0 (secure 0 0 0) 0x7f319c0e2d40 con 0x7f31b0103f20 2024-05-08T09:20:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.381+0000 7f31afe00700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31940b2a70 0x7f31940b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.382+0000 7f31afe00700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31940b2a70 0x7f31940b4f30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f31a0006010 tx=0x7f31a0005e80 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:20:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.385+0000 7f31acc00700 1 -- 172.21.15.70:0/1205366671 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f319c0aa240 con 0x7f31b0103f20 2024-05-08T09:20:13.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.867+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31b002e510 con 0x7f31b0103f20 2024-05-08T09:20:13.870 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:20:13.870 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:20:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.870+0000 7f31acc00700 1 -- 172.21.15.70:0/1205366671 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f319c0a9b40 con 0x7f31b0103f20 2024-05-08T09:20:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31940b2a70 msgr2=0x7f31940b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31940b2a70 0x7f31940b4f30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f31a0006010 tx=0x7f31a0005e80 comp rx=0 tx=0).stop 2024-05-08T09:20:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103f20 msgr2=0x7f31b0075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103f20 0x7f31b0075ce0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f319c00e9f0 tx=0x7f319c00ed00 comp rx=0 tx=0).stop 2024-05-08T09:20:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 shutdown_connections 2024-05-08T09:20:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f31940b2a70 0x7f31940b4f30 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31b0109540 0x7f31b0076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f31b0103560 0x7f31b00757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 --2- 172.21.15.70:0/1205366671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f31b0103f20 0x7f31b0075ce0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.874+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 >> 172.21.15.70:0/1205366671 conn(0x7f31b007a660 msgr2=0x7f31b0102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:20:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.875+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 shutdown_connections 2024-05-08T09:20:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:13.875+0000 7f31b7000700 1 -- 172.21.15.70:0/1205366671 wait complete. 2024-05-08T09:20:13.876 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:20:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:13 smithi070 ceph-mon[29591]: pgmap v4901: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 741 KiB/s wr, 49 op/s 2024-05-08T09:20:14.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:13 smithi172 ceph-mon[33377]: pgmap v4901: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 741 KiB/s wr, 49 op/s 2024-05-08T09:20:14.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:13 smithi194 ceph-mon[33679]: pgmap v4901: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 741 KiB/s wr, 49 op/s 2024-05-08T09:20:15.033 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_huc_fw.o 2024-05-08T09:20:15.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:14 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1205366671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:20:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:14 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1205366671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:20:15.188 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_uc.o 2024-05-08T09:20:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:14 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1205366671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:20:15.547 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T09:20:15.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T09:20:15.828 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:15 smithi070 ceph-mon[29591]: pgmap v4902: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 735 KiB/s wr, 36 op/s 2024-05-08T09:20:16.119 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:20:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:15 smithi172 ceph-mon[33377]: pgmap v4902: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 735 KiB/s wr, 36 op/s 2024-05-08T09:20:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:15 smithi194 ceph-mon[33679]: pgmap v4902: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 680 KiB/s rd, 735 KiB/s wr, 36 op/s 2024-05-08T09:20:17.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:17 smithi194 ceph-mon[33679]: osdmap e384: 12 total, 12 up, 12 in 2024-05-08T09:20:17.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:17 smithi194 ceph-mon[33679]: pgmap v4904: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 919 KiB/s wr, 45 op/s 2024-05-08T09:20:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:17 smithi070 ceph-mon[29591]: osdmap e384: 12 total, 12 up, 12 in 2024-05-08T09:20:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:17 smithi070 ceph-mon[29591]: pgmap v4904: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 919 KiB/s wr, 45 op/s 2024-05-08T09:20:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:17 smithi172 ceph-mon[33377]: osdmap e384: 12 total, 12 up, 12 in 2024-05-08T09:20:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:17 smithi172 ceph-mon[33377]: pgmap v4904: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 919 KiB/s wr, 45 op/s 2024-05-08T09:20:18.151 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_uc_debugfs.o 2024-05-08T09:20:19.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.506+0000 7f48c2400700 1 -- 172.21.15.70:0/4089618970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 msgr2=0x7f48bc1189e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.506+0000 7f48c2400700 1 --2- 172.21.15.70:0/4089618970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 0x7f48bc1189e0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098f0 tx=0x7f48b4009c00 comp rx=0 tx=0).stop 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.507+0000 7f48c2400700 1 -- 172.21.15.70:0/4089618970 shutdown_connections 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.507+0000 7f48c2400700 1 --2- 172.21.15.70:0/4089618970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 0x7f48bc1189e0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.507+0000 7f48c2400700 1 --2- 172.21.15.70:0/4089618970 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48bc10a4a0 0x7f48bc10a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.507+0000 7f48c2400700 1 --2- 172.21.15.70:0/4089618970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48bc10adc0 0x7f48bc1160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.507+0000 7f48c2400700 1 -- 172.21.15.70:0/4089618970 >> 172.21.15.70:0/4089618970 conn(0x7f48bc06e610 msgr2=0x7f48bc06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.507+0000 7f48c2400700 1 -- 172.21.15.70:0/4089618970 shutdown_connections 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.508+0000 7f48c2400700 1 -- 172.21.15.70:0/4089618970 wait complete. 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.509+0000 7f48c2400700 1 Processor -- start 2024-05-08T09:20:19.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.509+0000 7f48c2400700 1 -- start start 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.510+0000 7f48c2400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48bc10a4a0 0x7f48bc1a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.510+0000 7f48c2400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48bc10adc0 0x7f48bc1a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.510+0000 7f48c2400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 0x7f48bc1a8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.510+0000 7f48c2400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc11bd40 con 0x7f48bc1165f0 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.510+0000 7f48c2400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc11bbc0 con 0x7f48bc10adc0 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.510+0000 7f48c2400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc11bec0 con 0x7f48bc10a4a0 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 0x7f48bc1a8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48bb400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48bc10a4a0 0x7f48bc1a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 0x7f48bc1a8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40618/0 (socket says 172.21.15.70:40618) 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48bbe00700 1 -- 172.21.15.70:0/2609093761 learned_addr learned my addr 172.21.15.70:0/2609093761 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48baa00700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48bc10adc0 0x7f48bc1a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48bbe00700 1 -- 172.21.15.70:0/2609093761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48bc10a4a0 msgr2=0x7f48bc1a4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48bbe00700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48bc10a4a0 0x7f48bc1a4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48bbe00700 1 -- 172.21.15.70:0/2609093761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48bc10adc0 msgr2=0x7f48bc1a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48bbe00700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48bc10adc0 0x7f48bc1a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.511+0000 7f48bbe00700 1 -- 172.21.15.70:0/2609093761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48bc1a9410 con 0x7f48bc1165f0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.512+0000 7f48bbe00700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 0x7f48bc1a8cd0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009230 tx=0x7f48b400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.513+0000 7f48b3e00700 1 -- 172.21.15.70:0/2609093761 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b400bb80 con 0x7f48bc1165f0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.513+0000 7f48b3e00700 1 -- 172.21.15.70:0/2609093761 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48b40054d0 con 0x7f48bc1165f0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.513+0000 7f48c2400700 1 -- 172.21.15.70:0/2609093761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48bc1a96a0 con 0x7f48bc1165f0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.513+0000 7f48b3e00700 1 -- 172.21.15.70:0/2609093761 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b4017400 con 0x7f48bc1165f0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.513+0000 7f48c2400700 1 -- 172.21.15.70:0/2609093761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48bc1b0f80 con 0x7f48bc1165f0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.518+0000 7f48b3e00700 1 -- 172.21.15.70:0/2609093761 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f48b40175a0 con 0x7f48bc1165f0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.520+0000 7f48b3e00700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48a00b2b20 0x7f48a00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.520+0000 7f48b3e00700 1 -- 172.21.15.70:0/2609093761 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(384..384 src has 1..384) ==== 9583+0+0 (secure 0 0 0) 0x7f48b40e4780 con 0x7f48bc1165f0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.521+0000 7f48bb400700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48a00b2b20 0x7f48a00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.647+0000 7f48bb400700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48a00b2b20 0x7f48a00b4fe0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009c60 tx=0x7f48a8009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.650+0000 7f48ccd01b80 1 Processor -- start 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.650+0000 7f48ccd01b80 1 -- start start 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.651+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 0x55ad81e79b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.651+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e741b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.651+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e80520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.651+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ad81dbdbb0 con 0x55ad81e746f0 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.651+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad81d5b8f0 con 0x55ad81e73d30 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.651+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ad81db9b70 con 0x55ad81e79760 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.651+0000 7f48bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e80520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e80520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40632/0 (socket says 172.21.15.70:40632) 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48bbe00700 1 -- 172.21.15.70:0/3003548123 learned_addr learned my addr 172.21.15.70:0/3003548123 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48baa00700 1 --2- 172.21.15.70:0/3003548123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48bb400700 1 --2- 172.21.15.70:0/3003548123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 0x55ad81e79b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48bbe00700 1 -- 172.21.15.70:0/3003548123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 msgr2=0x55ad81e79b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48bbe00700 1 --2- 172.21.15.70:0/3003548123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 0x55ad81e79b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48bbe00700 1 -- 172.21.15.70:0/3003548123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 msgr2=0x55ad81e741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48bbe00700 1 --2- 172.21.15.70:0/3003548123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e741b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48bbe00700 1 -- 172.21.15.70:0/3003548123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad81d0aa60 con 0x55ad81e746f0 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.652+0000 7f48bbe00700 1 --2- 172.21.15.70:0/3003548123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e80520 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f48b400c010 tx=0x7f48b40ab510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b722fec7d899652 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.653+0000 7f48b0c00700 1 -- 172.21.15.70:0/3003548123 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b40ab180 con 0x55ad81e746f0 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.653+0000 7f48b0c00700 1 -- 172.21.15.70:0/3003548123 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48b40abd70 con 0x55ad81e746f0 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.653+0000 7f48b0c00700 1 -- 172.21.15.70:0/3003548123 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b40a7900 con 0x55ad81e746f0 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 -- 172.21.15.70:0/3003548123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 msgr2=0x55ad81e80520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/3003548123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e80520 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f48b400c010 tx=0x7f48b40ab510 comp rx=0 tx=0).stop 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 -- 172.21.15.70:0/3003548123 shutdown_connections 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/3003548123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e80520 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/3003548123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 0x55ad81e79b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/3003548123 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 -- 172.21.15.70:0/3003548123 >> 172.21.15.70:0/3003548123 conn(0x55ad81d99cf0 msgr2=0x55ad81e65e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 -- 172.21.15.70:0/3003548123 shutdown_connections 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 -- 172.21.15.70:0/3003548123 wait complete. 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.654+0000 7f48ccd01b80 1 -- start start 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.655+0000 7f48ccd01b80 1 Processor -- start 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e73d30 0x55ad81e801f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e746f0 0x55ad81e7d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e7dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ad81dbdbb0 con 0x55ad81e79760 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55ad81d23cb0 con 0x55ad81e746f0 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55ad81e7a270 con 0x55ad81e73d30 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48ccd01b80 10 client.0 _ll_register_callbacks cb 0x55ad81d64e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48bb400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e73d30 0x55ad81e801f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e7dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e7dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40638/0 (socket says 172.21.15.70:40638) 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.656+0000 7f48bbe00700 1 -- 172.21.15.70:0/1399405718 learned_addr learned my addr 172.21.15.70:0/1399405718 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.657+0000 7f48baa00700 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e746f0 0x55ad81e7d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.657+0000 7f48bbe00700 1 -- 172.21.15.70:0/1399405718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e73d30 msgr2=0x55ad81e801f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.657+0000 7f48bbe00700 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e73d30 0x55ad81e801f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.657+0000 7f48bbe00700 1 -- 172.21.15.70:0/1399405718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e746f0 msgr2=0x55ad81e7d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.657+0000 7f48bbe00700 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e746f0 0x55ad81e7d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.657+0000 7f48bbe00700 1 -- 172.21.15.70:0/1399405718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad81d835b0 con 0x55ad81e79760 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.658+0000 7f48bbe00700 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e7dad0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f48b400c010 tx=0x7f48b40037c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4927b43276b13fbc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.658+0000 7f48a5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.658+0000 7f48a5600700 1 -- 172.21.15.70:0/1399405718 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b40ab670 con 0x55ad81e79760 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.658+0000 7f48a5600700 1 -- 172.21.15.70:0/1399405718 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(384..384 src has 1..384) ==== 9583+0+0 (secure 0 0 0) 0x7f48b40a7c60 con 0x55ad81e79760 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.658+0000 7f48ccd01b80 1 -- 172.21.15.70:0/1399405718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48b40abd70 con 0x55ad81e79760 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.658+0000 7f48a5600700 1 -- 172.21.15.70:0/1399405718 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f48b40ab670 con 0x55ad81e79760 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.658+0000 7f48ccd01b80 10 client.19380 fetch_fsmap learned FSMap version 42 2024-05-08T09:20:19.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.658+0000 7f48ccd01b80 1 -- 172.21.15.70:0/1399405718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ad81e8afa0 con 0x55ad81e79760 2024-05-08T09:20:19.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.659+0000 7f48a5600700 1 -- 172.21.15.70:0/1399405718 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48b40abd70 con 0x55ad81e79760 2024-05-08T09:20:19.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.659+0000 7f48a5600700 1 -- 172.21.15.70:0/1399405718 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f48b401f070 con 0x55ad81e79760 2024-05-08T09:20:19.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.659+0000 7f48ccd01b80 10 client.19380 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:20:19.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.659+0000 7f48ccd01b80 10 client.19380 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:20:19.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.659+0000 7f48ccd01b80 20 client.19380 populate_metadata read hostname 'smithi070' 2024-05-08T09:20:19.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.659+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ad81e8d340 0x55ad81e8f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.659+0000 7f48ccd01b80 4 client.19380 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:20:19.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.659+0000 7f48ccd01b80 1 -- 172.21.15.70:0/1399405718 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad81e38230 con 0x55ad81e8d340 2024-05-08T09:20:19.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.660+0000 7f48bb400700 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ad81e8d340 0x55ad81e8f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.772 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:19 smithi070 ceph-mon[29591]: pgmap v4905: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 317 KiB/s wr, 24 op/s 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.661+0000 7f48bb400700 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ad81e8d340 0x55ad81e8f730 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0179e0adcb6c688 server_cookie=feeff2627a684f9c in_seq=0 out_seq=0 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.661+0000 7f48a5600700 10 client.19380 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.662+0000 7f48a5600700 1 -- 172.21.15.70:0/1399405718 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ad81e38230 con 0x55ad81e8d340 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.662+0000 7f48a5600700 10 client.19380 handle_command_reply: tid=0 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.662+0000 7f48ccd01b80 1 client.19380 shutdown 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.663+0000 7f48ccd01b80 1 -- 172.21.15.70:0/1399405718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 msgr2=0x55ad81e7dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.663+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e7dad0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f48b400c010 tx=0x7f48b40037c0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.663+0000 7f48ccd01b80 1 -- 172.21.15.70:0/1399405718 shutdown_connections 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.663+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ad81e8d340 0x55ad81e8f730 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.663+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e7dad0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.663+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e73d30 0x55ad81e801f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.663+0000 7f48a5600700 0 client.19380 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.663+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/1399405718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e746f0 0x55ad81e7d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.663+0000 7f48ccd01b80 1 -- 172.21.15.70:0/1399405718 >> 172.21.15.70:0/1399405718 conn(0x55ad81d99cf0 msgr2=0x55ad81e608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.664+0000 7f48ccd01b80 1 -- 172.21.15.70:0/1399405718 shutdown_connections 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.664+0000 7f48ccd01b80 1 -- 172.21.15.70:0/1399405718 wait complete. 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.664+0000 7f48ccd01b80 20 client.19380 trim_cache size 0 max 16384 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.700+0000 7f48ccd01b80 1 Processor -- start 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.700+0000 7f48ccd01b80 1 -- start start 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.700+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e78fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.700+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e746f0 0x55ad81e7c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.700+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e896b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.700+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b8360 con 0x55ad81e79760 2024-05-08T09:20:19.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.700+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b5bf0 con 0x55ad81e73d30 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.700+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b3aa0 con 0x55ad81e746f0 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e896b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48bbe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e896b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40646/0 (socket says 172.21.15.70:40646) 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48bbe00700 1 -- 172.21.15.70:0/4122634237 learned_addr learned my addr 172.21.15.70:0/4122634237 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48bb400700 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e78fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48baa00700 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e746f0 0x55ad81e7c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48bbe00700 1 -- 172.21.15.70:0/4122634237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e746f0 msgr2=0x55ad81e7c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48bbe00700 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e746f0 0x55ad81e7c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48bbe00700 1 -- 172.21.15.70:0/4122634237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 msgr2=0x55ad81e78fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48bbe00700 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e78fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.701+0000 7f48bbe00700 1 -- 172.21.15.70:0/4122634237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad81e80560 con 0x55ad81e79760 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.702+0000 7f48baa00700 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e746f0 0x55ad81e7c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.702+0000 7f48bb400700 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e78fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:20:19.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.702+0000 7f48bbe00700 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e896b0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f48b40058b0 tx=0x7f48b4005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb918500ef50892 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.702+0000 7f48a7e00700 1 -- 172.21.15.70:0/4122634237 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b40abd70 con 0x55ad81e79760 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.703+0000 7f48a7e00700 1 -- 172.21.15.70:0/4122634237 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48b40afa20 con 0x55ad81e79760 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.703+0000 7f48a7e00700 1 -- 172.21.15.70:0/4122634237 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b40e1cd0 con 0x55ad81e79760 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.703+0000 7f48ccd01b80 1 -- 172.21.15.70:0/4122634237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 msgr2=0x55ad81e896b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.703+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e896b0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f48b40058b0 tx=0x7f48b4005d60 comp rx=0 tx=0).stop 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.704+0000 7f48ccd01b80 1 -- 172.21.15.70:0/4122634237 shutdown_connections 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.704+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e79760 0x55ad81e896b0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.704+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e78fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.704+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/4122634237 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e746f0 0x55ad81e7c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.704+0000 7f48ccd01b80 1 -- 172.21.15.70:0/4122634237 >> 172.21.15.70:0/4122634237 conn(0x55ad81d99cf0 msgr2=0x55ad81e72d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.704+0000 7f48ccd01b80 1 -- 172.21.15.70:0/4122634237 shutdown_connections 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.704+0000 7f48ccd01b80 1 -- 172.21.15.70:0/4122634237 wait complete. 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.705+0000 7f48ccd01b80 1 -- start start 2024-05-08T09:20:19.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.705+0000 7f48ccd01b80 1 Processor -- start 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e85a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e85f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48ccd01b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 0x55ad81e829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b40f0 con 0x55ad81e746f0 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b5520 con 0x55ad81e73d30 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48ccd01b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f48bc1b4780 con 0x55ad81e79760 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48ccd01b80 10 client.0 _ll_register_callbacks cb 0x55ad81d64e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48baa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e85f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48baa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e85f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40656/0 (socket says 172.21.15.70:40656) 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.706+0000 7f48baa00700 1 -- 172.21.15.70:0/378487904 learned_addr learned my addr 172.21.15.70:0/378487904 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.707+0000 7f48bb400700 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e85a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.707+0000 7f48bbe00700 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 0x55ad81e829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.707+0000 7f48baa00700 1 -- 172.21.15.70:0/378487904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 msgr2=0x55ad81e829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:20:19.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.707+0000 7f48baa00700 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 0x55ad81e829e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.707+0000 7f48baa00700 1 -- 172.21.15.70:0/378487904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 msgr2=0x55ad81e85a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.707+0000 7f48baa00700 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e85a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.707+0000 7f48baa00700 1 -- 172.21.15.70:0/378487904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad81e82f20 con 0x55ad81e746f0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.707+0000 7f48bbe00700 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 0x55ad81e829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.708+0000 7f48baa00700 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e85f50 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007b20 tx=0x7f48ac007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc33c9fa27570446 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.708+0000 7f48a5600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.708+0000 7f48a5600700 1 -- 172.21.15.70:0/378487904 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac003e10 con 0x55ad81e746f0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.709+0000 7f48a5600700 1 -- 172.21.15.70:0/378487904 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(384..384 src has 1..384) ==== 9583+0+0 (secure 0 0 0) 0x7f48ac004030 con 0x55ad81e746f0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.709+0000 7f48ccd01b80 1 -- 172.21.15.70:0/378487904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48b40afa20 con 0x55ad81e746f0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.709+0000 7f48a5600700 1 -- 172.21.15.70:0/378487904 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f48ac004230 con 0x55ad81e746f0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.709+0000 7f48ccd01b80 10 client.19386 fetch_fsmap learned FSMap version 42 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.709+0000 7f48ccd01b80 1 -- 172.21.15.70:0/378487904 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55ad81ef83b0 con 0x55ad81e746f0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.710+0000 7f48a5600700 1 -- 172.21.15.70:0/378487904 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48b40afa20 con 0x55ad81e746f0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.710+0000 7f48a5600700 1 -- 172.21.15.70:0/378487904 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f48ac016cb0 con 0x55ad81e746f0 2024-05-08T09:20:19.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.711+0000 7f48ccd01b80 10 client.19386 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:20:19.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.711+0000 7f48ccd01b80 10 client.19386 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:20:19.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.711+0000 7f48ccd01b80 20 client.19386 populate_metadata read hostname 'smithi070' 2024-05-08T09:20:19.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.711+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ad81ef8b40 0x55ad81efaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:20:19.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.711+0000 7f48ccd01b80 4 client.19386 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T09:20:19.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.711+0000 7f48ccd01b80 1 -- 172.21.15.70:0/378487904 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55ad81dcb590 con 0x55ad81ef8b40 2024-05-08T09:20:19.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.711+0000 7f48bb400700 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ad81ef8b40 0x55ad81efaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:20:19.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.712+0000 7f48bb400700 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ad81ef8b40 0x55ad81efaf60 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d47e472f0af10b0a server_cookie=993c2342116f5fcd in_seq=0 out_seq=0 2024-05-08T09:20:19.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:19.712+0000 7f48a5600700 10 client.19386 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:20:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:19 smithi194 ceph-mon[33679]: pgmap v4905: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 317 KiB/s wr, 24 op/s 2024-05-08T09:20:20.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:19 smithi172 ceph-mon[33377]: pgmap v4905: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 317 KiB/s wr, 24 op/s 2024-05-08T09:20:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:21 smithi194 ceph-mon[33679]: pgmap v4906: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 689 KiB/s wr, 44 op/s 2024-05-08T09:20:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:21 smithi070 ceph-mon[29591]: pgmap v4906: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 689 KiB/s wr, 44 op/s 2024-05-08T09:20:22.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:21 smithi172 ceph-mon[33377]: pgmap v4906: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 689 KiB/s wr, 44 op/s 2024-05-08T09:20:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:23 smithi070 ceph-mon[29591]: pgmap v4907: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 689 KiB/s wr, 44 op/s 2024-05-08T09:20:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:23 smithi172 ceph-mon[33377]: pgmap v4907: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 689 KiB/s wr, 44 op/s 2024-05-08T09:20:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:23 smithi194 ceph-mon[33679]: pgmap v4907: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 689 KiB/s wr, 44 op/s 2024-05-08T09:20:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:25 smithi070 ceph-mon[29591]: pgmap v4908: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 670 KiB/s wr, 28 op/s 2024-05-08T09:20:26.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:25 smithi172 ceph-mon[33377]: pgmap v4908: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 670 KiB/s wr, 28 op/s 2024-05-08T09:20:26.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:25 smithi194 ceph-mon[33679]: pgmap v4908: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 670 KiB/s wr, 28 op/s 2024-05-08T09:20:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:27 smithi070 ceph-mon[29591]: pgmap v4909: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 654 KiB/s wr, 28 op/s 2024-05-08T09:20:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:27 smithi172 ceph-mon[33377]: pgmap v4909: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 654 KiB/s wr, 28 op/s 2024-05-08T09:20:28.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:27 smithi194 ceph-mon[33679]: pgmap v4909: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 654 KiB/s wr, 28 op/s 2024-05-08T09:20:30.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:29 smithi070 ceph-mon[29591]: pgmap v4910: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 559 KiB/s wr, 24 op/s 2024-05-08T09:20:30.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:29 smithi172 ceph-mon[33377]: pgmap v4910: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 559 KiB/s wr, 24 op/s 2024-05-08T09:20:30.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:29 smithi194 ceph-mon[33679]: pgmap v4910: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 552 KiB/s rd, 559 KiB/s wr, 24 op/s 2024-05-08T09:20:32.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:31 smithi070 ceph-mon[29591]: pgmap v4911: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 680 KiB/s wr, 27 op/s 2024-05-08T09:20:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:31 smithi172 ceph-mon[33377]: pgmap v4911: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 680 KiB/s wr, 27 op/s 2024-05-08T09:20:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:31 smithi194 ceph-mon[33679]: pgmap v4911: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 680 KiB/s wr, 27 op/s 2024-05-08T09:20:34.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:33 smithi070 ceph-mon[29591]: pgmap v4912: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 366 KiB/s wr, 11 op/s 2024-05-08T09:20:34.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:33 smithi172 ceph-mon[33377]: pgmap v4912: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 366 KiB/s wr, 11 op/s 2024-05-08T09:20:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:33 smithi194 ceph-mon[33679]: pgmap v4912: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 366 KiB/s wr, 11 op/s 2024-05-08T09:20:36.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:35 smithi070 ceph-mon[29591]: pgmap v4913: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 428 KiB/s wr, 25 op/s 2024-05-08T09:20:36.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:35 smithi172 ceph-mon[33377]: pgmap v4913: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 428 KiB/s wr, 25 op/s 2024-05-08T09:20:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:35 smithi194 ceph-mon[33679]: pgmap v4913: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 428 KiB/s wr, 25 op/s 2024-05-08T09:20:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:37 smithi070 ceph-mon[29591]: pgmap v4914: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 182 KiB/s wr, 18 op/s 2024-05-08T09:20:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:37 smithi172 ceph-mon[33377]: pgmap v4914: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 182 KiB/s wr, 18 op/s 2024-05-08T09:20:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:37 smithi194 ceph-mon[33679]: pgmap v4914: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 182 KiB/s wr, 18 op/s 2024-05-08T09:20:40.065 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:39 smithi194 ceph-mon[33679]: pgmap v4915: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 182 KiB/s wr, 18 op/s 2024-05-08T09:20:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:39 smithi070 ceph-mon[29591]: pgmap v4915: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 182 KiB/s wr, 18 op/s 2024-05-08T09:20:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:39 smithi172 ceph-mon[33377]: pgmap v4915: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 182 KiB/s wr, 18 op/s 2024-05-08T09:20:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:41 smithi070 ceph-mon[29591]: pgmap v4916: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 241 KiB/s wr, 21 op/s 2024-05-08T09:20:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:41 smithi172 ceph-mon[33377]: pgmap v4916: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 241 KiB/s wr, 21 op/s 2024-05-08T09:20:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:41 smithi194 ceph-mon[33679]: pgmap v4916: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 241 KiB/s wr, 21 op/s 2024-05-08T09:20:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:43 smithi070 ceph-mon[29591]: pgmap v4917: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 120 KiB/s wr, 18 op/s 2024-05-08T09:20:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:43 smithi172 ceph-mon[33377]: pgmap v4917: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 120 KiB/s wr, 18 op/s 2024-05-08T09:20:44.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:43 smithi194 ceph-mon[33679]: pgmap v4917: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 120 KiB/s wr, 18 op/s 2024-05-08T09:20:44.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.402+0000 7f48a5600700 1 -- 172.21.15.70:0/378487904 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55ad81dcb590 con 0x55ad81ef8b40 2024-05-08T09:20:44.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.402+0000 7f48a5600700 10 client.19386 handle_command_reply: tid=0 2024-05-08T09:20:44.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.402+0000 7f48ccd01b80 1 client.19386 shutdown 2024-05-08T09:20:44.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.403+0000 7f48ccd01b80 1 -- 172.21.15.70:0/378487904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 msgr2=0x55ad81e85f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:44.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.403+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e85f50 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f48ac007b20 tx=0x7f48ac007b50 comp rx=0 tx=0).stop 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.404+0000 7f48ccd01b80 1 -- 172.21.15.70:0/378487904 shutdown_connections 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.404+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55ad81ef8b40 0x55ad81efaf60 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.404+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55ad81e79760 0x55ad81e829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.404+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55ad81e73d30 0x55ad81e85a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.404+0000 7f48ccd01b80 1 --2- 172.21.15.70:0/378487904 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ad81e746f0 0x55ad81e85f50 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.404+0000 7f48ccd01b80 1 -- 172.21.15.70:0/378487904 >> 172.21.15.70:0/378487904 conn(0x55ad81d99cf0 msgr2=0x55ad81e735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.404+0000 7f48a5600700 0 client.19386 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.404+0000 7f48ccd01b80 1 -- 172.21.15.70:0/378487904 shutdown_connections 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.404+0000 7f48ccd01b80 1 -- 172.21.15.70:0/378487904 wait complete. 2024-05-08T09:20:44.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.405+0000 7f48ccd01b80 20 client.19386 trim_cache size 0 max 16384 2024-05-08T09:20:44.408 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:20:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:20:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:20:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 338, 2024-05-08T09:20:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:20:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "7e10021f": { 2024-05-08T09:20:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 338, 2024-05-08T09:20:44.408 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:20:44.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:20:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:20:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:20:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:20:44.410 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:20:44.410 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.406+0000 7f48c2400700 1 -- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48a00b2b20 msgr2=0x7f48a00b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.406+0000 7f48c2400700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48a00b2b20 0x7f48a00b4fe0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009c60 tx=0x7f48a8009260 comp rx=0 tx=0).stop 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.406+0000 7f48c2400700 1 -- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 msgr2=0x7f48bc1a8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.406+0000 7f48c2400700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 0x7f48bc1a8cd0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009230 tx=0x7f48b400b790 comp rx=0 tx=0).stop 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.407+0000 7f48c2400700 1 -- 172.21.15.70:0/2609093761 shutdown_connections 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.407+0000 7f48c2400700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f48a00b2b20 0x7f48a00b4fe0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.407+0000 7f48c2400700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48bc1165f0 0x7f48bc1a8cd0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.407+0000 7f48c2400700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48bc10a4a0 0x7f48bc1a4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.407+0000 7f48c2400700 1 --2- 172.21.15.70:0/2609093761 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f48bc10adc0 0x7f48bc1a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.407+0000 7f48c2400700 1 -- 172.21.15.70:0/2609093761 >> 172.21.15.70:0/2609093761 conn(0x7f48bc06e610 msgr2=0x7f48bc10be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:20:44.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.407+0000 7f48c2400700 1 -- 172.21.15.70:0/2609093761 shutdown_connections 2024-05-08T09:20:44.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:20:44.407+0000 7f48c2400700 1 -- 172.21.15.70:0/2609093761 wait complete. 2024-05-08T09:20:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:44 smithi070 ceph-mon[29591]: pgmap v4918: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 128 KiB/s wr, 20 op/s 2024-05-08T09:20:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:44 smithi172 ceph-mon[33377]: pgmap v4918: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 128 KiB/s wr, 20 op/s 2024-05-08T09:20:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:44 smithi194 ceph-mon[33679]: pgmap v4918: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 128 KiB/s wr, 20 op/s 2024-05-08T09:20:45.825 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7e10021f', quiesce took 39.4 seconds. Will release after: 30.0 2024-05-08T09:20:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:47 smithi070 ceph-mon[29591]: pgmap v4919: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2024-05-08T09:20:48.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:47 smithi172 ceph-mon[33377]: pgmap v4919: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2024-05-08T09:20:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:47 smithi194 ceph-mon[33679]: pgmap v4919: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2024-05-08T09:20:49.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:20:49.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:20:49.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:20:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:49 smithi070 ceph-mon[29591]: pgmap v4920: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2024-05-08T09:20:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:20:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:20:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:20:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:49 smithi172 ceph-mon[33377]: pgmap v4920: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2024-05-08T09:20:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:20:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:20:50.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:20:50.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:49 smithi194 ceph-mon[33679]: pgmap v4920: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 6 op/s 2024-05-08T09:20:50.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:20:50.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:20:50.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:20:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:51 smithi070 ceph-mon[29591]: pgmap v4921: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2024-05-08T09:20:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:51 smithi172 ceph-mon[33377]: pgmap v4921: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2024-05-08T09:20:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:51 smithi194 ceph-mon[33679]: pgmap v4921: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 10 op/s 2024-05-08T09:20:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:53 smithi070 ceph-mon[29591]: pgmap v4922: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 67 KiB/s wr, 6 op/s 2024-05-08T09:20:54.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:53 smithi172 ceph-mon[33377]: pgmap v4922: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 67 KiB/s wr, 6 op/s 2024-05-08T09:20:54.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:53 smithi194 ceph-mon[33679]: pgmap v4922: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 67 KiB/s wr, 6 op/s 2024-05-08T09:20:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:55 smithi070 ceph-mon[29591]: pgmap v4923: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 149 KiB/s wr, 9 op/s 2024-05-08T09:20:56.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:55 smithi172 ceph-mon[33377]: pgmap v4923: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 149 KiB/s wr, 9 op/s 2024-05-08T09:20:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:55 smithi194 ceph-mon[33679]: pgmap v4923: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 149 KiB/s wr, 9 op/s 2024-05-08T09:20:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:57 smithi070 ceph-mon[29591]: pgmap v4924: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 142 KiB/s wr, 6 op/s 2024-05-08T09:20:58.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:57 smithi172 ceph-mon[33377]: pgmap v4924: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 142 KiB/s wr, 6 op/s 2024-05-08T09:20:58.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:57 smithi194 ceph-mon[33679]: pgmap v4924: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 142 KiB/s wr, 6 op/s 2024-05-08T09:21:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:20:59 smithi070 ceph-mon[29591]: pgmap v4925: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 142 KiB/s wr, 6 op/s 2024-05-08T09:21:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:20:59 smithi172 ceph-mon[33377]: pgmap v4925: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 142 KiB/s wr, 6 op/s 2024-05-08T09:21:00.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:20:59 smithi194 ceph-mon[33679]: pgmap v4925: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 142 KiB/s wr, 6 op/s 2024-05-08T09:21:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:01 smithi070 ceph-mon[29591]: pgmap v4926: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 9 op/s 2024-05-08T09:21:02.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:01 smithi172 ceph-mon[33377]: pgmap v4926: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 9 op/s 2024-05-08T09:21:02.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:01 smithi194 ceph-mon[33679]: pgmap v4926: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 186 KiB/s wr, 9 op/s 2024-05-08T09:21:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:03 smithi070 ceph-mon[29591]: pgmap v4927: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 5 op/s 2024-05-08T09:21:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:03 smithi172 ceph-mon[33377]: pgmap v4927: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 5 op/s 2024-05-08T09:21:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:03 smithi194 ceph-mon[33679]: pgmap v4927: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 126 KiB/s wr, 5 op/s 2024-05-08T09:21:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:05 smithi070 ceph-mon[29591]: pgmap v4928: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 171 KiB/s wr, 25 op/s 2024-05-08T09:21:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:05 smithi172 ceph-mon[33377]: pgmap v4928: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 171 KiB/s wr, 25 op/s 2024-05-08T09:21:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:05 smithi194 ceph-mon[33679]: pgmap v4928: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 171 KiB/s wr, 25 op/s 2024-05-08T09:21:07.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:06 smithi070 ceph-mon[29591]: pgmap v4929: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 22 op/s 2024-05-08T09:21:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:06 smithi172 ceph-mon[33377]: pgmap v4929: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 22 op/s 2024-05-08T09:21:07.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:06 smithi194 ceph-mon[33679]: pgmap v4929: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 22 op/s 2024-05-08T09:21:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:09 smithi070 ceph-mon[29591]: pgmap v4930: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 22 op/s 2024-05-08T09:21:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:09 smithi172 ceph-mon[33377]: pgmap v4930: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 22 op/s 2024-05-08T09:21:10.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:09 smithi194 ceph-mon[33679]: pgmap v4930: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 89 KiB/s wr, 22 op/s 2024-05-08T09:21:11.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:10 smithi070 ceph-mon[29591]: osdmap e385: 12 total, 12 up, 12 in 2024-05-08T09:21:11.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:10 smithi194 ceph-mon[33679]: osdmap e385: 12 total, 12 up, 12 in 2024-05-08T09:21:11.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:10 smithi172 ceph-mon[33377]: osdmap e385: 12 total, 12 up, 12 in 2024-05-08T09:21:12.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:11 smithi070 ceph-mon[29591]: pgmap v4932: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:21:12.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:11 smithi172 ceph-mon[33377]: pgmap v4932: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:21:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:11 smithi194 ceph-mon[33679]: pgmap v4932: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:21:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:13 smithi070 ceph-mon[29591]: pgmap v4933: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:21:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:13 smithi172 ceph-mon[33377]: pgmap v4933: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:21:14.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:13 smithi194 ceph-mon[33679]: pgmap v4933: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:21:15.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:21:16.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:15 smithi070 ceph-mon[29591]: pgmap v4934: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:21:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:15 smithi172 ceph-mon[33377]: pgmap v4934: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:21:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:15 smithi194 ceph-mon[33679]: pgmap v4934: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:21:16.653 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:21:17.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:17 smithi194 ceph-mon[33679]: osdmap e386: 12 total, 12 up, 12 in 2024-05-08T09:21:17.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:17 smithi194 ceph-mon[33679]: pgmap v4936: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-08T09:21:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:17 smithi070 ceph-mon[29591]: osdmap e386: 12 total, 12 up, 12 in 2024-05-08T09:21:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:17 smithi070 ceph-mon[29591]: pgmap v4936: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-08T09:21:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:17 smithi172 ceph-mon[33377]: osdmap e386: 12 total, 12 up, 12 in 2024-05-08T09:21:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:17 smithi172 ceph-mon[33377]: pgmap v4936: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-08T09:21:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.542+0000 7f7d41600700 1 -- 172.21.15.70:0/1014427423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c1055d0 msgr2=0x7f7d3c105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.542+0000 7f7d41600700 1 --2- 172.21.15.70:0/1014427423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c1055d0 0x7f7d3c105a50 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009990 tx=0x7f7d28009ca0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.542+0000 7f7d41600700 1 -- 172.21.15.70:0/1014427423 shutdown_connections 2024-05-08T09:21:19.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.542+0000 7f7d41600700 1 --2- 172.21.15.70:0/1014427423 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d3c105f90 0x7f7d3c1124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.542+0000 7f7d41600700 1 --2- 172.21.15.70:0/1014427423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d3c10b660 0x7f7d3c10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.542+0000 7f7d41600700 1 --2- 172.21.15.70:0/1014427423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c1055d0 0x7f7d3c105a50 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.542+0000 7f7d41600700 1 -- 172.21.15.70:0/1014427423 >> 172.21.15.70:0/1014427423 conn(0x7f7d3c1010c0 msgr2=0x7f7d3c1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.543+0000 7f7d41600700 1 -- 172.21.15.70:0/1014427423 shutdown_connections 2024-05-08T09:21:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.543+0000 7f7d41600700 1 -- 172.21.15.70:0/1014427423 wait complete. 2024-05-08T09:21:19.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.544+0000 7f7d41600700 1 Processor -- start 2024-05-08T09:21:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.544+0000 7f7d41600700 1 -- start start 2024-05-08T09:21:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.544+0000 7f7d41600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d3c1055d0 0x7f7d3c1a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.544+0000 7f7d41600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c105f90 0x7f7d3c1a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.544+0000 7f7d41600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d3c10b660 0x7f7d3c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.544+0000 7f7d41600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c1156d0 con 0x7f7d3c105f90 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.544+0000 7f7d41600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c115550 con 0x7f7d3c10b660 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.544+0000 7f7d41600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3c115850 con 0x7f7d3c1055d0 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c105f90 0x7f7d3c1a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c105f90 0x7f7d3c1a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34566/0 (socket says 172.21.15.70:34566) 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3b400700 1 -- 172.21.15.70:0/618865316 learned_addr learned my addr 172.21.15.70:0/618865316 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3be00700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d3c1055d0 0x7f7d3c1a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d40c00700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d3c10b660 0x7f7d3c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3b400700 1 -- 172.21.15.70:0/618865316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d3c1055d0 msgr2=0x7f7d3c1a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3b400700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d3c1055d0 0x7f7d3c1a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3b400700 1 -- 172.21.15.70:0/618865316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d3c10b660 msgr2=0x7f7d3c19b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3b400700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d3c10b660 0x7f7d3c19b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3b400700 1 -- 172.21.15.70:0/618865316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3c19c130 con 0x7f7d3c105f90 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d3be00700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d3c1055d0 0x7f7d3c1a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:21:19.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.545+0000 7f7d40c00700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d3c10b660 0x7f7d3c19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:21:19.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.546+0000 7f7d3b400700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c105f90 0x7f7d3c1a1d50 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7d28005910 tx=0x7f7d280047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:19.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.546+0000 7f7d38c00700 1 -- 172.21.15.70:0/618865316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28027070 con 0x7f7d3c105f90 2024-05-08T09:21:19.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.546+0000 7f7d38c00700 1 -- 172.21.15.70:0/618865316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d2800fc00 con 0x7f7d3c105f90 2024-05-08T09:21:19.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.546+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3c19c3c0 con 0x7f7d3c105f90 2024-05-08T09:21:19.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.546+0000 7f7d38c00700 1 -- 172.21.15.70:0/618865316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d28022d40 con 0x7f7d3c105f90 2024-05-08T09:21:19.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.546+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d3c1a86e0 con 0x7f7d3c105f90 2024-05-08T09:21:19.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.548+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d3c106d10 con 0x7f7d3c105f90 2024-05-08T09:21:19.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.550+0000 7f7d38c00700 1 -- 172.21.15.70:0/618865316 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7d2802a070 con 0x7f7d3c105f90 2024-05-08T09:21:19.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.551+0000 7f7d38c00700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7d200b2a70 0x7f7d200b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.552+0000 7f7d38c00700 1 -- 172.21.15.70:0/618865316 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(386..386 src has 1..386) ==== 9583+0+0 (secure 0 0 0) 0x7f7d280e3840 con 0x7f7d3c105f90 2024-05-08T09:21:19.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.552+0000 7f7d3be00700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7d200b2a70 0x7f7d200b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.552+0000 7f7d3be00700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7d200b2a70 0x7f7d200b4f30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c005950 tx=0x7f7d2c0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:19.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.556+0000 7f7d38c00700 1 -- 172.21.15.70:0/618865316 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7d2805fdf0 con 0x7f7d3c105f90 2024-05-08T09:21:19.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.840+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d3c19cf00 con 0x7f7d3c105f90 2024-05-08T09:21:19.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.842+0000 7f7d38c00700 1 -- 172.21.15.70:0/618865316 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f7d28013070 con 0x7f7d3c105f90 2024-05-08T09:21:19.843 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:21:19.843 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:21:19.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.845+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7d200b2a70 msgr2=0x7f7d200b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7d200b2a70 0x7f7d200b4f30 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c005950 tx=0x7f7d2c0058e0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c105f90 msgr2=0x7f7d3c1a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c105f90 0x7f7d3c1a1d50 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f7d28005910 tx=0x7f7d280047b0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 shutdown_connections 2024-05-08T09:21:19.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7d200b2a70 0x7f7d200b4f30 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7d3c10b660 0x7f7d3c19b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d3c1055d0 0x7f7d3c1a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 --2- 172.21.15.70:0/618865316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7d3c105f90 0x7f7d3c1a1d50 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 >> 172.21.15.70:0/618865316 conn(0x7f7d3c1010c0 msgr2=0x7f7d3c1029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:19.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 shutdown_connections 2024-05-08T09:21:19.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:19.846+0000 7f7d41600700 1 -- 172.21.15.70:0/618865316 wait complete. 2024-05-08T09:21:19.847 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:21:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:19 smithi070 ceph-mon[29591]: pgmap v4937: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-05-08T09:21:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:19 smithi172 ceph-mon[33377]: pgmap v4937: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-05-08T09:21:20.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:19 smithi194 ceph-mon[33679]: pgmap v4937: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-05-08T09:21:20.688 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 7e10021f --release --await' 2024-05-08T09:21:20.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 7e10021f --release --await 2024-05-08T09:21:20.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:20 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/618865316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:21:21.165 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:21:21.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:20 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/618865316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:21:21.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:20 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/618865316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:21:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:21 smithi070 ceph-mon[29591]: pgmap v4938: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:21:22.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:21 smithi172 ceph-mon[33377]: pgmap v4938: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:21:22.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:21 smithi194 ceph-mon[33679]: pgmap v4938: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:21:23.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.427+0000 7f334b200700 1 -- 172.21.15.70:0/1937772022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33441033d0 msgr2=0x7f3344103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.427+0000 7f334b200700 1 --2- 172.21.15.70:0/1937772022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33441033d0 0x7f3344103850 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3334009990 tx=0x7f3334009ca0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.427+0000 7f334b200700 1 -- 172.21.15.70:0/1937772022 shutdown_connections 2024-05-08T09:21:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.427+0000 7f334b200700 1 --2- 172.21.15.70:0/1937772022 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3344103d90 0x7f33441102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.427+0000 7f334b200700 1 --2- 172.21.15.70:0/1937772022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3344109460 0x7f3344109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.427+0000 7f334b200700 1 --2- 172.21.15.70:0/1937772022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33441033d0 0x7f3344103850 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.427+0000 7f334b200700 1 -- 172.21.15.70:0/1937772022 >> 172.21.15.70:0/1937772022 conn(0x7f33440fef20 msgr2=0x7f3344101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.427+0000 7f334b200700 1 -- 172.21.15.70:0/1937772022 shutdown_connections 2024-05-08T09:21:23.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.427+0000 7f334b200700 1 -- 172.21.15.70:0/1937772022 wait complete. 2024-05-08T09:21:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.428+0000 7f334b200700 1 Processor -- start 2024-05-08T09:21:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.428+0000 7f334b200700 1 -- start start 2024-05-08T09:21:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f334b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33441033d0 0x7f334419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f334b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3344103d90 0x7f334419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f334b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3344109460 0x7f33441997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f334b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33441134e0 con 0x7f3344103d90 2024-05-08T09:21:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f334b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3344113360 con 0x7f33441033d0 2024-05-08T09:21:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f334b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3344113660 con 0x7f3344109460 2024-05-08T09:21:23.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f3349400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3344103d90 0x7f334419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f3349400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3344103d90 0x7f334419fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34582/0 (socket says 172.21.15.70:34582) 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f3349400700 1 -- 172.21.15.70:0/3103879459 learned_addr learned my addr 172.21.15.70:0/3103879459 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f334a800700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3344109460 0x7f33441997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f3349e00700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33441033d0 0x7f334419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f3349400700 1 -- 172.21.15.70:0/3103879459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3344109460 msgr2=0x7f33441997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f3349400700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3344109460 0x7f33441997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f3349400700 1 -- 172.21.15.70:0/3103879459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33441033d0 msgr2=0x7f334419f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f3349400700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33441033d0 0x7f334419f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.429+0000 7f3349400700 1 -- 172.21.15.70:0/3103879459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3344199f80 con 0x7f3344103d90 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.430+0000 7f3349e00700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33441033d0 0x7f334419f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.430+0000 7f3349400700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3344103d90 0x7f334419fb60 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f3334000c00 tx=0x7f3334009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.430+0000 7f333ea00700 1 -- 172.21.15.70:0/3103879459 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334026070 con 0x7f3344103d90 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.430+0000 7f333ea00700 1 -- 172.21.15.70:0/3103879459 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f333400fb80 con 0x7f3344103d90 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.430+0000 7f334b200700 1 -- 172.21.15.70:0/3103879459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334419a210 con 0x7f3344103d90 2024-05-08T09:21:23.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.430+0000 7f333ea00700 1 -- 172.21.15.70:0/3103879459 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334021bd0 con 0x7f3344103d90 2024-05-08T09:21:23.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.430+0000 7f334b200700 1 -- 172.21.15.70:0/3103879459 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33441a6480 con 0x7f3344103d90 2024-05-08T09:21:23.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.434+0000 7f333ea00700 1 -- 172.21.15.70:0/3103879459 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3334029070 con 0x7f3344103d90 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.435+0000 7f333ea00700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f332c0b2aa0 0x7f332c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.435+0000 7f333ea00700 1 -- 172.21.15.70:0/3103879459 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(386..386 src has 1..386) ==== 9583+0+0 (secure 0 0 0) 0x7f33340e36f0 con 0x7f3344103d90 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.435+0000 7f3349e00700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f332c0b2aa0 0x7f332c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.436+0000 7f3349e00700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f332c0b2aa0 0x7f332c0b4f60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3338009b50 tx=0x7f3338009550 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.451+0000 7f33570a5b80 1 Processor -- start 2024-05-08T09:21:23.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.452+0000 7f33570a5b80 1 -- start start 2024-05-08T09:21:23.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.452+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 0x560c8554fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.452+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 0x560c85549b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.452+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8554a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.452+0000 7f33570a5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c85497b20 con 0x560c8554a1b0 2024-05-08T09:21:23.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.452+0000 7f33570a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560c85435860 con 0x560c8554ff80 2024-05-08T09:21:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.452+0000 7f33570a5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560c85493ae0 con 0x560c8554f660 2024-05-08T09:21:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.452+0000 7f334a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8554a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.453+0000 7f334a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8554a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34586/0 (socket says 172.21.15.70:34586) 2024-05-08T09:21:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.453+0000 7f334a800700 1 -- 172.21.15.70:0/3755408608 learned_addr learned my addr 172.21.15.70:0/3755408608 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.453+0000 7f3349e00700 1 --2- 172.21.15.70:0/3755408608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 0x560c8554fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.453+0000 7f3349400700 1 --2- 172.21.15.70:0/3755408608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 0x560c85549b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.453+0000 7f334a800700 1 -- 172.21.15.70:0/3755408608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 msgr2=0x560c8554fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.453+0000 7f334a800700 1 --2- 172.21.15.70:0/3755408608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 0x560c8554fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.453+0000 7f334a800700 1 -- 172.21.15.70:0/3755408608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 msgr2=0x560c85549b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.453+0000 7f334a800700 1 --2- 172.21.15.70:0/3755408608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 0x560c85549b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.453+0000 7f334a800700 1 -- 172.21.15.70:0/3755408608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c853e49d0 con 0x560c8554a1b0 2024-05-08T09:21:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.454+0000 7f334a800700 1 --2- 172.21.15.70:0/3755408608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8554a610 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f334000d250 tx=0x7f334000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3058ade15c250 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.454+0000 7f3333400700 1 -- 172.21.15.70:0/3755408608 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340016020 con 0x560c8554a1b0 2024-05-08T09:21:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.454+0000 7f3333400700 1 -- 172.21.15.70:0/3755408608 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3340012880 con 0x560c8554a1b0 2024-05-08T09:21:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.454+0000 7f3333400700 1 -- 172.21.15.70:0/3755408608 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33400117b0 con 0x560c8554a1b0 2024-05-08T09:21:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.455+0000 7f33570a5b80 1 -- 172.21.15.70:0/3755408608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 msgr2=0x560c8554a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.455+0000 7f33570a5b80 1 --2- 172.21.15.70:0/3755408608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8554a610 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f334000d250 tx=0x7f334000d560 comp rx=0 tx=0).stop 2024-05-08T09:21:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.455+0000 7f33570a5b80 1 -- 172.21.15.70:0/3755408608 shutdown_connections 2024-05-08T09:21:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.455+0000 7f33570a5b80 1 --2- 172.21.15.70:0/3755408608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8554a610 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.455+0000 7f33570a5b80 1 --2- 172.21.15.70:0/3755408608 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 0x560c8554fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.455+0000 7f33570a5b80 1 --2- 172.21.15.70:0/3755408608 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 0x560c85549b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.455+0000 7f33570a5b80 1 -- 172.21.15.70:0/3755408608 >> 172.21.15.70:0/3755408608 conn(0x560c854bd7d0 msgr2=0x560c855402e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.455+0000 7f33570a5b80 1 -- 172.21.15.70:0/3755408608 shutdown_connections 2024-05-08T09:21:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.455+0000 7f33570a5b80 1 -- 172.21.15.70:0/3755408608 wait complete. 2024-05-08T09:21:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.456+0000 7f33570a5b80 1 -- start start 2024-05-08T09:21:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.456+0000 7f33570a5b80 1 Processor -- start 2024-05-08T09:21:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.456+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c85555cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.456+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 0x560c85553100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.456+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c85553640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.456+0000 7f33570a5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560c85556aa0 con 0x560c8554ff80 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.456+0000 7f33570a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560c853fdc20 con 0x560c8554f660 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.456+0000 7f33570a5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560c85556c20 con 0x560c8554a1b0 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f33570a5b80 10 client.0 _ll_register_callbacks cb 0x560c8543ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f334a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c85553640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f334a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c85553640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34592/0 (socket says 172.21.15.70:34592) 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f334a800700 1 -- 172.21.15.70:0/283803033 learned_addr learned my addr 172.21.15.70:0/283803033 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f3349400700 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 0x560c85553100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f3349e00700 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c85555cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f334a800700 1 -- 172.21.15.70:0/283803033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 msgr2=0x560c85555cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f334a800700 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c85555cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f334a800700 1 -- 172.21.15.70:0/283803033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 msgr2=0x560c85553100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f334a800700 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 0x560c85553100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f334a800700 1 -- 172.21.15.70:0/283803033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8545d520 con 0x560c8554ff80 2024-05-08T09:21:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.457+0000 7f3349e00700 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c85555cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:21:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.458+0000 7f334a800700 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c85553640 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f334000e010 tx=0x7f3340012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6019f561108039 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.458+0000 7f3327e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:21:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.458+0000 7f3327e00700 1 -- 172.21.15.70:0/283803033 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340029060 con 0x560c8554ff80 2024-05-08T09:21:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.458+0000 7f3327e00700 1 -- 172.21.15.70:0/283803033 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(386..386 src has 1..386) ==== 9583+0+0 (secure 0 0 0) 0x7f3340005040 con 0x560c8554ff80 2024-05-08T09:21:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.458+0000 7f33570a5b80 1 -- 172.21.15.70:0/283803033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3340012880 con 0x560c8554ff80 2024-05-08T09:21:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.458+0000 7f3327e00700 1 -- 172.21.15.70:0/283803033 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3340016070 con 0x560c8554ff80 2024-05-08T09:21:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.459+0000 7f33570a5b80 10 client.19404 fetch_fsmap learned FSMap version 42 2024-05-08T09:21:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.459+0000 7f33570a5b80 1 -- 172.21.15.70:0/283803033 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560c85561390 con 0x560c8554ff80 2024-05-08T09:21:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.459+0000 7f3327e00700 1 -- 172.21.15.70:0/283803033 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3340012880 con 0x560c8554ff80 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.459+0000 7f3327e00700 1 -- 172.21.15.70:0/283803033 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3340023030 con 0x560c8554ff80 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.460+0000 7f33570a5b80 10 client.19404 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.460+0000 7f33570a5b80 10 client.19404 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.460+0000 7f33570a5b80 20 client.19404 populate_metadata read hostname 'smithi070' 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.460+0000 7f33570a5b80 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c85563860 0x560c85565c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.460+0000 7f33570a5b80 4 client.19404 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.460+0000 7f33570a5b80 1 -- 172.21.15.70:0/283803033 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c85512240 con 0x560c85563860 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.460+0000 7f3349e00700 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c85563860 0x560c85565c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.461+0000 7f3349e00700 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c85563860 0x560c85565c50 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=234c4abbbe4c3434 server_cookie=62415453d50bce5 in_seq=0 out_seq=0 2024-05-08T09:21:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.461+0000 7f3327e00700 10 client.19404 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:21:23.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.463+0000 7f3327e00700 1 -- 172.21.15.70:0/283803033 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560c85512240 con 0x560c85563860 2024-05-08T09:21:23.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.463+0000 7f3327e00700 10 client.19404 handle_command_reply: tid=0 2024-05-08T09:21:23.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.463+0000 7f33570a5b80 1 client.19404 shutdown 2024-05-08T09:21:23.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 -- 172.21.15.70:0/283803033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 msgr2=0x560c85553640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c85553640 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f334000e010 tx=0x7f3340012a30 comp rx=0 tx=0).stop 2024-05-08T09:21:23.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 -- 172.21.15.70:0/283803033 shutdown_connections 2024-05-08T09:21:23.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c85563860 0x560c85565c50 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c85553640 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c85555cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 --2- 172.21.15.70:0/283803033 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 0x560c85553100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 -- 172.21.15.70:0/283803033 >> 172.21.15.70:0/283803033 conn(0x560c854bd7d0 msgr2=0x560c855401f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f3327e00700 0 client.19404 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:21:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 -- 172.21.15.70:0/283803033 shutdown_connections 2024-05-08T09:21:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 1 -- 172.21.15.70:0/283803033 wait complete. 2024-05-08T09:21:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.464+0000 7f33570a5b80 20 client.19404 trim_cache size 0 max 16384 2024-05-08T09:21:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.485+0000 7f33570a5b80 1 Processor -- start 2024-05-08T09:21:23.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f33570a5b80 1 -- start start 2024-05-08T09:21:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c8555fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 0x560c8554e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c8556b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f33570a5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33441af970 con 0x560c8554ff80 2024-05-08T09:21:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f33570a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ad200 con 0x560c8554f660 2024-05-08T09:21:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f33570a5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ab070 con 0x560c8554a1b0 2024-05-08T09:21:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f334a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c8556b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f334a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c8556b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34596/0 (socket says 172.21.15.70:34596) 2024-05-08T09:21:23.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.486+0000 7f334a800700 1 -- 172.21.15.70:0/3508643452 learned_addr learned my addr 172.21.15.70:0/3508643452 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:23.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f3349400700 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 0x560c8554e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f3349e00700 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c8555fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f334a800700 1 -- 172.21.15.70:0/3508643452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 msgr2=0x560c8555fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f334a800700 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c8555fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f334a800700 1 -- 172.21.15.70:0/3508643452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 msgr2=0x560c8554e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f334a800700 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 0x560c8554e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f334a800700 1 -- 172.21.15.70:0/3508643452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c85554020 con 0x560c8554ff80 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f3349e00700 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c8555fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f334a800700 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c8556b2e0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f334000d170 tx=0x7f334001b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3894bfa97913e0d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f3332a00700 1 -- 172.21.15.70:0/3508643452 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340029050 con 0x560c8554ff80 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.487+0000 7f3332a00700 1 -- 172.21.15.70:0/3508643452 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3340013e50 con 0x560c8554ff80 2024-05-08T09:21:23.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.488+0000 7f3332a00700 1 -- 172.21.15.70:0/3508643452 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3340030030 con 0x560c8554ff80 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.488+0000 7f33570a5b80 1 -- 172.21.15.70:0/3508643452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 msgr2=0x560c8556b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.488+0000 7f33570a5b80 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c8556b2e0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f334000d170 tx=0x7f334001b660 comp rx=0 tx=0).stop 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.488+0000 7f33570a5b80 1 -- 172.21.15.70:0/3508643452 shutdown_connections 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.488+0000 7f33570a5b80 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554ff80 0x560c8556b2e0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.488+0000 7f33570a5b80 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554a1b0 0x560c8555fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.488+0000 7f33570a5b80 1 --2- 172.21.15.70:0/3508643452 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554f660 0x560c8554e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.488+0000 7f33570a5b80 1 -- 172.21.15.70:0/3508643452 >> 172.21.15.70:0/3508643452 conn(0x560c854bd7d0 msgr2=0x560c8554e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.488+0000 7f33570a5b80 1 -- 172.21.15.70:0/3508643452 shutdown_connections 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.489+0000 7f33570a5b80 1 -- 172.21.15.70:0/3508643452 wait complete. 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.489+0000 7f33570a5b80 1 -- start start 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.489+0000 7f33570a5b80 1 Processor -- start 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8555c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 0x560c8555a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f33570a5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 0x560c8555ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f33570a5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33441ab6c0 con 0x560c8554a1b0 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f33570a5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33441acb30 con 0x560c8554ff80 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f33570a5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f33441abd90 con 0x560c8554f660 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f33570a5b80 10 client.0 _ll_register_callbacks cb 0x560c8543ed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f3349e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8555c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f3349e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8555c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34600/0 (socket says 172.21.15.70:34600) 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f3349e00700 1 -- 172.21.15.70:0/4281078041 learned_addr learned my addr 172.21.15.70:0/4281078041 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.490+0000 7f3349400700 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 0x560c8555a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.491+0000 7f334a800700 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 0x560c8555ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.491+0000 7f3349e00700 1 -- 172.21.15.70:0/4281078041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 msgr2=0x560c8555a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.491+0000 7f3349e00700 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 0x560c8555a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.491+0000 7f3349e00700 1 -- 172.21.15.70:0/4281078041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 msgr2=0x560c8555ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.491+0000 7f3349e00700 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 0x560c8555ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.491+0000 7f3349e00700 1 -- 172.21.15.70:0/4281078041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c8555b2a0 con 0x560c8554a1b0 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.491+0000 7f3349e00700 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8555c2a0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x560c85566250 tx=0x7f33380047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1647c7eb2c481cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.491+0000 7f3327e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.491+0000 7f3327e00700 1 -- 172.21.15.70:0/4281078041 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338011e60 con 0x560c8554a1b0 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.492+0000 7f3327e00700 1 -- 172.21.15.70:0/4281078041 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(386..386 src has 1..386) ==== 9583+0+0 (secure 0 0 0) 0x7f3338027250 con 0x560c8554a1b0 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.492+0000 7f33570a5b80 1 -- 172.21.15.70:0/4281078041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3340013e50 con 0x560c8554a1b0 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.492+0000 7f3327e00700 1 -- 172.21.15.70:0/4281078041 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3338036050 con 0x560c8554a1b0 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.492+0000 7f33570a5b80 10 client.19410 fetch_fsmap learned FSMap version 42 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.492+0000 7f33570a5b80 1 -- 172.21.15.70:0/4281078041 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560c855ceda0 con 0x560c8554a1b0 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.492+0000 7f3327e00700 1 -- 172.21.15.70:0/4281078041 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3340013e50 con 0x560c8554a1b0 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.492+0000 7f3327e00700 1 -- 172.21.15.70:0/4281078041 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3338027ce0 con 0x560c8554a1b0 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.493+0000 7f33570a5b80 10 client.19410 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.493+0000 7f33570a5b80 10 client.19410 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.493+0000 7f33570a5b80 20 client.19410 populate_metadata read hostname 'smithi070' 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.493+0000 7f33570a5b80 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c855cf4b0 0x560c855d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.493+0000 7f33570a5b80 4 client.19410 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7e10021f", "release": true, "await": true}] 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.493+0000 7f33570a5b80 1 -- 172.21.15.70:0/4281078041 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7e10021f", "release": true, "await": true}) -- 0x560c8554da90 con 0x560c855cf4b0 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.493+0000 7f3349400700 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c855cf4b0 0x560c855d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.494+0000 7f3349400700 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c855cf4b0 0x560c855d18d0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66c1f80ef60312fc server_cookie=7c3319bb8cf22a57 in_seq=0 out_seq=0 2024-05-08T09:21:23.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:23.494+0000 7f3327e00700 10 client.19410 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:21:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:23 smithi070 ceph-mon[29591]: pgmap v4939: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:21:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:23 smithi172 ceph-mon[33377]: pgmap v4939: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:21:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:23 smithi194 ceph-mon[33679]: pgmap v4939: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:21:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:25 smithi070 ceph-mon[29591]: pgmap v4940: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:21:26.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:25 smithi172 ceph-mon[33377]: pgmap v4940: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:21:26.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:25 smithi194 ceph-mon[33679]: pgmap v4940: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:21:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:27 smithi070 ceph-mon[29591]: pgmap v4941: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 199 B/s wr, 6 op/s 2024-05-08T09:21:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:27 smithi172 ceph-mon[33377]: pgmap v4941: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 199 B/s wr, 6 op/s 2024-05-08T09:21:28.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:27 smithi194 ceph-mon[33679]: pgmap v4941: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 199 B/s wr, 6 op/s 2024-05-08T09:21:28.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.356+0000 7f3327e00700 1 -- 172.21.15.70:0/4281078041 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x560c8554da90 con 0x560c855cf4b0 2024-05-08T09:21:28.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.356+0000 7f3327e00700 10 client.19410 handle_command_reply: tid=0 2024-05-08T09:21:28.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.356+0000 7f33570a5b80 1 client.19410 shutdown 2024-05-08T09:21:28.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.357+0000 7f33570a5b80 1 -- 172.21.15.70:0/4281078041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 msgr2=0x560c8555c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:28.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.357+0000 7f33570a5b80 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8555c2a0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x560c85566250 tx=0x7f33380047c0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.357+0000 7f33570a5b80 1 -- 172.21.15.70:0/4281078041 shutdown_connections 2024-05-08T09:21:28.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.357+0000 7f33570a5b80 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560c855cf4b0 0x560c855d18d0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.357+0000 7f33570a5b80 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560c8554ff80 0x560c8555ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.357+0000 7f33570a5b80 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560c8554a1b0 0x560c8555c2a0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.357+0000 7f33570a5b80 1 --2- 172.21.15.70:0/4281078041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560c8554f660 0x560c8555a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.357+0000 7f33570a5b80 1 -- 172.21.15.70:0/4281078041 >> 172.21.15.70:0/4281078041 conn(0x560c854bd7d0 msgr2=0x560c8554eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:28.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.357+0000 7f3327e00700 0 client.19410 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:21:28.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.358+0000 7f33570a5b80 1 -- 172.21.15.70:0/4281078041 shutdown_connections 2024-05-08T09:21:28.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.358+0000 7f33570a5b80 1 -- 172.21.15.70:0/4281078041 wait complete. 2024-05-08T09:21:28.359 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:21:28.359 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:21:28.359 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 340, 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "7e10021f": { 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 340, 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:21:28.360 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.358+0000 7f33570a5b80 20 client.19410 trim_cache size 0 max 16384 2024-05-08T09:21:28.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 -- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f332c0b2aa0 msgr2=0x7f332c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:28.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f332c0b2aa0 0x7f332c0b4f60 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3338009b50 tx=0x7f3338009550 comp rx=0 tx=0).stop 2024-05-08T09:21:28.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 -- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3344103d90 msgr2=0x7f334419fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:28.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3344103d90 0x7f334419fb60 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f3334000c00 tx=0x7f3334009580 comp rx=0 tx=0).stop 2024-05-08T09:21:28.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 -- 172.21.15.70:0/3103879459 shutdown_connections 2024-05-08T09:21:28.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f332c0b2aa0 0x7f332c0b4f60 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3344109460 0x7f33441997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33441033d0 0x7f334419f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 --2- 172.21.15.70:0/3103879459 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3344103d90 0x7f334419fb60 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.361+0000 7f334b200700 1 -- 172.21.15.70:0/3103879459 >> 172.21.15.70:0/3103879459 conn(0x7f33440fef20 msgr2=0x7f33440ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:28.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.364+0000 7f334b200700 1 -- 172.21.15.70:0/3103879459 shutdown_connections 2024-05-08T09:21:28.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:28.364+0000 7f334b200700 1 -- 172.21.15.70:0/3103879459 wait complete. 2024-05-08T09:21:28.452 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/uc/intel_uc_fw.o 2024-05-08T09:21:29.321 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7e10021f', seconds elapsed: 82.9 2024-05-08T09:21:29.321 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-08T09:21:29.322 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:21:29.891 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:21:30.089 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:29 smithi070 ceph-mon[29591]: pgmap v4942: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T09:21:30.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:29 smithi172 ceph-mon[33377]: pgmap v4942: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T09:21:30.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:29 smithi194 ceph-mon[33679]: pgmap v4942: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T09:21:31.654 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/gt/intel_gsc.o 2024-05-08T09:21:31.701 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_hwmon.o 2024-05-08T09:21:31.827 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:31 smithi070 ceph-mon[29591]: pgmap v4943: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-08T09:21:31.852 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/hsw_ips.o 2024-05-08T09:21:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.051+0000 7efd01400700 1 -- 172.21.15.70:0/3761060951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 msgr2=0x7efcfc116640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.051+0000 7efd01400700 1 --2- 172.21.15.70:0/3761060951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 0x7efcfc116640 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7efcf400b0a0 tx=0x7efcf400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.051+0000 7efd01400700 1 -- 172.21.15.70:0/3761060951 shutdown_connections 2024-05-08T09:21:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.051+0000 7efd01400700 1 --2- 172.21.15.70:0/3761060951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 0x7efcfc116640 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.051+0000 7efd01400700 1 --2- 172.21.15.70:0/3761060951 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0779d0 0x7efcfc077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.051+0000 7efd01400700 1 --2- 172.21.15.70:0/3761060951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcfc0782f0 0x7efcfc113d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.051+0000 7efd01400700 1 -- 172.21.15.70:0/3761060951 >> 172.21.15.70:0/3761060951 conn(0x7efcfc101080 msgr2=0x7efcfc1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.051+0000 7efd01400700 1 -- 172.21.15.70:0/3761060951 shutdown_connections 2024-05-08T09:21:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.051+0000 7efd01400700 1 -- 172.21.15.70:0/3761060951 wait complete. 2024-05-08T09:21:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.052+0000 7efd01400700 1 Processor -- start 2024-05-08T09:21:32.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.053+0000 7efd01400700 1 -- start start 2024-05-08T09:21:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.053+0000 7efd01400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcfc0779d0 0x7efcfc19fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.053+0000 7efd01400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0782f0 0x7efcfc1a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.053+0000 7efd01400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 0x7efcfc1a48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.053+0000 7efd01400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc119aa0 con 0x7efcfc114250 2024-05-08T09:21:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.053+0000 7efd01400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc119920 con 0x7efcfc0782f0 2024-05-08T09:21:32.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.053+0000 7efd01400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc119c20 con 0x7efcfc0779d0 2024-05-08T09:21:32.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efd00a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 0x7efcfc1a48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efd00a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 0x7efcfc1a48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35410/0 (socket says 172.21.15.70:35410) 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efd00a00700 1 -- 172.21.15.70:0/3025154019 learned_addr learned my addr 172.21.15.70:0/3025154019 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efcfb400700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0782f0 0x7efcfc1a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efcfbe00700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcfc0779d0 0x7efcfc19fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efd00a00700 1 -- 172.21.15.70:0/3025154019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcfc0779d0 msgr2=0x7efcfc19fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efd00a00700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcfc0779d0 0x7efcfc19fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efd00a00700 1 -- 172.21.15.70:0/3025154019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0782f0 msgr2=0x7efcfc1a0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efd00a00700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0782f0 0x7efcfc1a0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efd00a00700 1 -- 172.21.15.70:0/3025154019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc1a5000 con 0x7efcfc114250 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.054+0000 7efcfbe00700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcfc0779d0 0x7efcfc19fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:21:32.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.055+0000 7efd00a00700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 0x7efcfc1a48c0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7efcf400b070 tx=0x7efcf4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.055+0000 7efcf8c00700 1 -- 172.21.15.70:0/3025154019 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4021070 con 0x7efcfc114250 2024-05-08T09:21:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.056+0000 7efcf8c00700 1 -- 172.21.15.70:0/3025154019 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efcf4007b80 con 0x7efcfc114250 2024-05-08T09:21:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.056+0000 7efcf8c00700 1 -- 172.21.15.70:0/3025154019 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf40052a0 con 0x7efcfc114250 2024-05-08T09:21:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.056+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcfc1a5290 con 0x7efcfc114250 2024-05-08T09:21:32.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.056+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcfc1acb70 con 0x7efcfc114250 2024-05-08T09:21:32.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.058+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcfc06a190 con 0x7efcfc114250 2024-05-08T09:21:32.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.060+0000 7efcf8c00700 1 -- 172.21.15.70:0/3025154019 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7efcf4024070 con 0x7efcfc114250 2024-05-08T09:21:32.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.063+0000 7efcf8c00700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efce00b2a70 0x7efce00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:32.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.063+0000 7efcf8c00700 1 -- 172.21.15.70:0/3025154019 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(386..386 src has 1..386) ==== 9583+0+0 (secure 0 0 0) 0x7efcf400f020 con 0x7efcfc114250 2024-05-08T09:21:32.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.063+0000 7efcfbe00700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efce00b2a70 0x7efce00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:32.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.065+0000 7efcfbe00700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efce00b2a70 0x7efce00b4f30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7efcec005d90 tx=0x7efcec005d00 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:32.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.069+0000 7efcf8c00700 1 -- 172.21.15.70:0/3025154019 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efcf402b020 con 0x7efcfc114250 2024-05-08T09:21:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:31 smithi172 ceph-mon[33377]: pgmap v4943: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-08T09:21:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:31 smithi194 ceph-mon[33679]: pgmap v4943: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-08T09:21:32.410 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_atomic.o 2024-05-08T09:21:32.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.556+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efcfc02e510 con 0x7efcfc114250 2024-05-08T09:21:32.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.557+0000 7efcf8c00700 1 -- 172.21.15.70:0/3025154019 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7efcf40ab510 con 0x7efcfc114250 2024-05-08T09:21:32.556 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:21:32.557 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:21:32.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efce00b2a70 msgr2=0x7efce00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:32.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efce00b2a70 0x7efce00b4f30 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7efcec005d90 tx=0x7efcec005d00 comp rx=0 tx=0).stop 2024-05-08T09:21:32.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 msgr2=0x7efcfc1a48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:32.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 0x7efcfc1a48c0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7efcf400b070 tx=0x7efcf4004c80 comp rx=0 tx=0).stop 2024-05-08T09:21:32.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 shutdown_connections 2024-05-08T09:21:32.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efce00b2a70 0x7efce00b4f30 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efcfc114250 0x7efcfc1a48c0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efcfc0779d0 0x7efcfc19fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 --2- 172.21.15.70:0/3025154019 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efcfc0782f0 0x7efcfc1a0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:32.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.561+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 >> 172.21.15.70:0/3025154019 conn(0x7efcfc101080 msgr2=0x7efcfc103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:32.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.562+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 shutdown_connections 2024-05-08T09:21:32.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:32.562+0000 7efd01400700 1 -- 172.21.15.70:0/3025154019 wait complete. 2024-05-08T09:21:32.563 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:21:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:32 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3025154019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:21:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:32 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3025154019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:21:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:32 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3025154019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:21:33.460 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0' 2024-05-08T09:21:33.460 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 90.0 --await-for 42.0 2024-05-08T09:21:34.016 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:21:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:33 smithi070 ceph-mon[29591]: pgmap v4944: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-05-08T09:21:34.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:33 smithi172 ceph-mon[33377]: pgmap v4944: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-05-08T09:21:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:33 smithi194 ceph-mon[33679]: pgmap v4944: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 26 KiB/s wr, 6 op/s 2024-05-08T09:21:34.674 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_atomic_plane.o 2024-05-08T09:21:34.807 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_audio.o 2024-05-08T09:21:34.853 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:34 smithi070 ceph-mon[29591]: pgmap v4945: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 368 KiB/s wr, 16 op/s 2024-05-08T09:21:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:34 smithi172 ceph-mon[33377]: pgmap v4945: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 368 KiB/s wr, 16 op/s 2024-05-08T09:21:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:34 smithi194 ceph-mon[33679]: pgmap v4945: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 368 KiB/s wr, 16 op/s 2024-05-08T09:21:35.417 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_bios.o 2024-05-08T09:21:36.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.351+0000 7f8359a00700 1 -- 172.21.15.70:0/1524485689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f835406b3e0 msgr2=0x7f835406b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:36.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.351+0000 7f8359a00700 1 --2- 172.21.15.70:0/1524485689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f835406b3e0 0x7f835406b7c0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f83440099c0 tx=0x7f8344009cd0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.351+0000 7f8359a00700 1 -- 172.21.15.70:0/1524485689 shutdown_connections 2024-05-08T09:21:36.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.351+0000 7f8359a00700 1 --2- 172.21.15.70:0/1524485689 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8354108860 0x7f83541103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.351+0000 7f8359a00700 1 --2- 172.21.15.70:0/1524485689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f835406b3e0 0x7f835406b7c0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.351+0000 7f8359a00700 1 --2- 172.21.15.70:0/1524485689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835406bd90 0x7f8354108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.351+0000 7f8359a00700 1 -- 172.21.15.70:0/1524485689 >> 172.21.15.70:0/1524485689 conn(0x7f8354079340 msgr2=0x7f8354079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:36.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.351+0000 7f8359a00700 1 -- 172.21.15.70:0/1524485689 shutdown_connections 2024-05-08T09:21:36.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.351+0000 7f8359a00700 1 -- 172.21.15.70:0/1524485689 wait complete. 2024-05-08T09:21:36.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.353+0000 7f8359a00700 1 Processor -- start 2024-05-08T09:21:36.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.354+0000 7f8359a00700 1 -- start start 2024-05-08T09:21:36.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.354+0000 7f8359a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835406b3e0 0x7f835419ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.354+0000 7f8359a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835406bd90 0x7f83541a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.354+0000 7f8359a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8354108860 0x7f83541a4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.355+0000 7f8352000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835406bd90 0x7f83541a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.355+0000 7f8352000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835406bd90 0x7f83541a04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:42970/0 (socket says 172.21.15.70:42970) 2024-05-08T09:21:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.355+0000 7f8352000700 1 -- 172.21.15.70:0/3570210893 learned_addr learned my addr 172.21.15.70:0/3570210893 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:36.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.355+0000 7f8353400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8354108860 0x7f83541a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.356+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83541113b0 con 0x7f8354108860 2024-05-08T09:21:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.356+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8354111230 con 0x7f835406bd90 2024-05-08T09:21:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.356+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8354111530 con 0x7f835406b3e0 2024-05-08T09:21:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.356+0000 7f8352a00700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835406b3e0 0x7f835419ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.357+0000 7f8353400700 1 -- 172.21.15.70:0/3570210893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835406b3e0 msgr2=0x7f835419ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:36.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.357+0000 7f8353400700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835406b3e0 0x7f835419ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.357+0000 7f8353400700 1 -- 172.21.15.70:0/3570210893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835406bd90 msgr2=0x7f83541a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:36.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.357+0000 7f8353400700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835406bd90 0x7f83541a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.357+0000 7f8353400700 1 -- 172.21.15.70:0/3570210893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83541a4fa0 con 0x7f8354108860 2024-05-08T09:21:36.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.357+0000 7f8353400700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8354108860 0x7f83541a4860 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c370 tx=0x7f834c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.358+0000 7f834b400700 1 -- 172.21.15.70:0/3570210893 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c00ccc0 con 0x7f8354108860 2024-05-08T09:21:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.358+0000 7f834b400700 1 -- 172.21.15.70:0/3570210893 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f834c004bb0 con 0x7f8354108860 2024-05-08T09:21:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.358+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83541a5230 con 0x7f8354108860 2024-05-08T09:21:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.358+0000 7f834b400700 1 -- 172.21.15.70:0/3570210893 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c004280 con 0x7f8354108860 2024-05-08T09:21:36.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.358+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83541acb10 con 0x7f8354108860 2024-05-08T09:21:36.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.365+0000 7f834b400700 1 -- 172.21.15.70:0/3570210893 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f834c01b030 con 0x7f8354108860 2024-05-08T09:21:36.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.366+0000 7f8364412b80 1 Processor -- start 2024-05-08T09:21:36.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.367+0000 7f8364412b80 1 -- start start 2024-05-08T09:21:36.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.367+0000 7f8364412b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf39e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.367+0000 7f8364412b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 0x55bbcf3989a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.367+0000 7f8364412b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.367+0000 7f8364412b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bbcf2eabb0 con 0x55bbcf398ee0 2024-05-08T09:21:36.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.367+0000 7f8364412b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bbcf2888f0 con 0x55bbcf39df50 2024-05-08T09:21:36.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.367+0000 7f8364412b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bbcf2e6b70 con 0x55bbcf398520 2024-05-08T09:21:36.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.368+0000 7f8352000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf39e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.368+0000 7f8352000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf39e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:42982/0 (socket says 172.21.15.70:42982) 2024-05-08T09:21:36.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.368+0000 7f8352000700 1 -- 172.21.15.70:0/338597612 learned_addr learned my addr 172.21.15.70:0/338597612 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:36.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.368+0000 7f8352000700 1 --2- 172.21.15.70:0/338597612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.368+0000 7f834b400700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83380b2b10 0x7f83380b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.369+0000 7f8352a00700 1 --2- 172.21.15.70:0/338597612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 0x55bbcf3989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.369+0000 7f834b400700 1 -- 172.21.15.70:0/3570210893 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(386..386 src has 1..386) ==== 9583+0+0 (secure 0 0 0) 0x7f834c0e2620 con 0x7f8354108860 2024-05-08T09:21:36.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.369+0000 7f8352000700 1 -- 172.21.15.70:0/338597612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 msgr2=0x55bbcf3989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:36.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.369+0000 7f8352000700 1 --2- 172.21.15.70:0/338597612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 0x55bbcf3989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.369+0000 7f8352000700 1 -- 172.21.15.70:0/338597612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398ee0 msgr2=0x55bbcf3a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.369+0000 7f8352000700 1 --2- 172.21.15.70:0/338597612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.369+0000 7f8352000700 1 -- 172.21.15.70:0/338597612 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbcf237a60 con 0x55bbcf39df50 2024-05-08T09:21:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.370+0000 7f8352000700 1 --2- 172.21.15.70:0/338597612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf39e330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83400046c0 tx=0x7f834000b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afde87cdb5ee120 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.370+0000 7f8353400700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83380b2b10 0x7f83380b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.370+0000 7f833fe00700 1 -- 172.21.15.70:0/338597612 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340004830 con 0x55bbcf39df50 2024-05-08T09:21:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.371+0000 7f833fe00700 1 -- 172.21.15.70:0/338597612 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8340005020 con 0x55bbcf39df50 2024-05-08T09:21:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.371+0000 7f833fe00700 1 -- 172.21.15.70:0/338597612 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340004e60 con 0x55bbcf39df50 2024-05-08T09:21:36.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.371+0000 7f8364412b80 1 -- 172.21.15.70:0/338597612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 msgr2=0x55bbcf39e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.371+0000 7f8364412b80 1 --2- 172.21.15.70:0/338597612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf39e330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f83400046c0 tx=0x7f834000b5d0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.371+0000 7f8353400700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83380b2b10 0x7f83380b4fd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f834c0dfa00 tx=0x7f834c0a5430 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.372+0000 7f8364412b80 1 -- 172.21.15.70:0/338597612 shutdown_connections 2024-05-08T09:21:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.372+0000 7f8364412b80 1 --2- 172.21.15.70:0/338597612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.372+0000 7f8364412b80 1 --2- 172.21.15.70:0/338597612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf39e330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.372+0000 7f8364412b80 1 --2- 172.21.15.70:0/338597612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 0x55bbcf3989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.372+0000 7f8364412b80 1 -- 172.21.15.70:0/338597612 >> 172.21.15.70:0/338597612 conn(0x55bbcf2c6cf0 msgr2=0x55bbcf392e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:36.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.372+0000 7f8364412b80 1 -- 172.21.15.70:0/338597612 shutdown_connections 2024-05-08T09:21:36.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.372+0000 7f8364412b80 1 -- 172.21.15.70:0/338597612 wait complete. 2024-05-08T09:21:36.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.373+0000 7f8364412b80 1 -- start start 2024-05-08T09:21:36.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.373+0000 7f8364412b80 1 Processor -- start 2024-05-08T09:21:36.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.374+0000 7f8364412b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.374+0000 7f8364412b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.374+0000 7f8364412b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf3a2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.374+0000 7f8364412b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bbcf3a5250 con 0x55bbcf398520 2024-05-08T09:21:36.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.375+0000 7f8364412b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55bbcf250cb0 con 0x55bbcf39df50 2024-05-08T09:21:36.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.375+0000 7f8364412b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55bbcf3a53d0 con 0x55bbcf398ee0 2024-05-08T09:21:36.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.375+0000 7f8364412b80 10 client.0 _ll_register_callbacks cb 0x55bbcf291e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:21:36.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.375+0000 7f8352000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.375+0000 7f8352000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35462/0 (socket says 172.21.15.70:35462) 2024-05-08T09:21:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.375+0000 7f8352000700 1 -- 172.21.15.70:0/1904516633 learned_addr learned my addr 172.21.15.70:0/1904516633 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.376+0000 7f8352000700 1 -- 172.21.15.70:0/1904516633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 msgr2=0x55bbcf3a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.376+0000 7f8352000700 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.376+0000 7f8352000700 1 -- 172.21.15.70:0/1904516633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 msgr2=0x55bbcf3a2250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T09:21:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.376+0000 7f8352000700 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf3a2250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.376+0000 7f8352000700 1 -- 172.21.15.70:0/1904516633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbcf2b05b0 con 0x55bbcf398520 2024-05-08T09:21:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.377+0000 7f8352000700 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a4970 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f834000bf70 tx=0x7f83400056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac47c38285ff0aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.377+0000 7f833cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:21:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.377+0000 7f833cc00700 1 -- 172.21.15.70:0/1904516633 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834002c060 con 0x55bbcf398520 2024-05-08T09:21:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.377+0000 7f833cc00700 1 -- 172.21.15.70:0/1904516633 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(386..386 src has 1..386) ==== 9583+0+0 (secure 0 0 0) 0x7f83400048d0 con 0x55bbcf398520 2024-05-08T09:21:36.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.377+0000 7f8364412b80 1 -- 172.21.15.70:0/1904516633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8340005020 con 0x55bbcf398520 2024-05-08T09:21:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.378+0000 7f833cc00700 1 -- 172.21.15.70:0/1904516633 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f8340033050 con 0x55bbcf398520 2024-05-08T09:21:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.378+0000 7f8364412b80 10 client.19428 fetch_fsmap learned FSMap version 42 2024-05-08T09:21:36.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.378+0000 7f8364412b80 1 -- 172.21.15.70:0/1904516633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bbcf3af8a0 con 0x55bbcf398520 2024-05-08T09:21:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.379+0000 7f833cc00700 1 -- 172.21.15.70:0/1904516633 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8340005020 con 0x55bbcf398520 2024-05-08T09:21:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.379+0000 7f833cc00700 1 -- 172.21.15.70:0/1904516633 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f8340012450 con 0x55bbcf398520 2024-05-08T09:21:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.379+0000 7f8364412b80 10 client.19428 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:21:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.379+0000 7f8364412b80 10 client.19428 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:21:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.379+0000 7f8364412b80 20 client.19428 populate_metadata read hostname 'smithi070' 2024-05-08T09:21:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.379+0000 7f8364412b80 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bbcf3b1d70 0x55bbcf3b4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.379+0000 7f8364412b80 4 client.19428 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:21:36.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.379+0000 7f8364412b80 1 -- 172.21.15.70:0/1904516633 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbcf365230 con 0x55bbcf3b1d70 2024-05-08T09:21:36.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.381+0000 7f8352a00700 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bbcf3b1d70 0x55bbcf3b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.382+0000 7f8352a00700 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bbcf3b1d70 0x55bbcf3b4160 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=454f09eb7aedae44 server_cookie=1df2e61d73f7fd66 in_seq=0 out_seq=0 2024-05-08T09:21:36.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.382+0000 7f833cc00700 10 client.19428 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:21:36.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.384+0000 7f833cc00700 1 -- 172.21.15.70:0/1904516633 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bbcf365230 con 0x55bbcf3b1d70 2024-05-08T09:21:36.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.384+0000 7f833cc00700 10 client.19428 handle_command_reply: tid=0 2024-05-08T09:21:36.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.384+0000 7f8364412b80 1 client.19428 shutdown 2024-05-08T09:21:36.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 -- 172.21.15.70:0/1904516633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 msgr2=0x55bbcf3a4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a4970 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f834000bf70 tx=0x7f83400056c0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 -- 172.21.15.70:0/1904516633 shutdown_connections 2024-05-08T09:21:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bbcf3b1d70 0x55bbcf3b4160 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf3a2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a4970 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 --2- 172.21.15.70:0/1904516633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 -- 172.21.15.70:0/1904516633 >> 172.21.15.70:0/1904516633 conn(0x55bbcf2c6cf0 msgr2=0x55bbcf38d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f833cc00700 0 client.19428 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:21:36.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 -- 172.21.15.70:0/1904516633 shutdown_connections 2024-05-08T09:21:36.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.385+0000 7f8364412b80 1 -- 172.21.15.70:0/1904516633 wait complete. 2024-05-08T09:21:36.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.386+0000 7f8364412b80 20 client.19428 trim_cache size 0 max 16384 2024-05-08T09:21:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.421+0000 7f8364412b80 1 Processor -- start 2024-05-08T09:21:36.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.422+0000 7f8364412b80 1 -- start start 2024-05-08T09:21:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.422+0000 7f8364412b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.422+0000 7f8364412b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 0x55bbcf3ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.422+0000 7f8364412b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf3b98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.422+0000 7f8364412b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83541b8440 con 0x55bbcf398520 2024-05-08T09:21:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.422+0000 7f8364412b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83541b5cd0 con 0x55bbcf39df50 2024-05-08T09:21:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.422+0000 7f8364412b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83541b3b40 con 0x55bbcf398ee0 2024-05-08T09:21:36.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.423+0000 7f8352000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf3b98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.423+0000 7f8352000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.423+0000 7f8352a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 0x55bbcf3ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.423+0000 7f8352a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 0x55bbcf3ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:40520/0 (socket says 172.21.15.70:40520) 2024-05-08T09:21:36.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.423+0000 7f8352a00700 1 -- 172.21.15.70:0/1652886000 learned_addr learned my addr 172.21.15.70:0/1652886000 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.424+0000 7f8352000700 1 -- 172.21.15.70:0/1652886000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 msgr2=0x55bbcf3ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.424+0000 7f8352000700 1 --2- 172.21.15.70:0/1652886000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 0x55bbcf3ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.424+0000 7f8352000700 1 -- 172.21.15.70:0/1652886000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 msgr2=0x55bbcf3b98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.424+0000 7f8352000700 1 --2- 172.21.15.70:0/1652886000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf3b98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.424+0000 7f8352000700 1 -- 172.21.15.70:0/1652886000 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbcf38fa10 con 0x55bbcf398520 2024-05-08T09:21:36.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.425+0000 7f8352000700 1 --2- 172.21.15.70:0/1652886000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a41b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8340012850 tx=0x7f8340014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d20d89b7a57f80b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:36.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.425+0000 7f833f400700 1 -- 172.21.15.70:0/1652886000 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834002c030 con 0x55bbcf398520 2024-05-08T09:21:36.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.426+0000 7f833f400700 1 -- 172.21.15.70:0/1652886000 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f834000b720 con 0x55bbcf398520 2024-05-08T09:21:36.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.426+0000 7f833f400700 1 -- 172.21.15.70:0/1652886000 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83400038e0 con 0x55bbcf398520 2024-05-08T09:21:36.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.427+0000 7f8364412b80 1 -- 172.21.15.70:0/1652886000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 msgr2=0x55bbcf3a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:36.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.427+0000 7f8364412b80 1 --2- 172.21.15.70:0/1652886000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a41b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f8340012850 tx=0x7f8340014740 comp rx=0 tx=0).stop 2024-05-08T09:21:36.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.427+0000 7f8364412b80 1 -- 172.21.15.70:0/1652886000 shutdown_connections 2024-05-08T09:21:36.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.428+0000 7f8364412b80 1 --2- 172.21.15.70:0/1652886000 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf39df50 0x55bbcf3b98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.428+0000 7f8364412b80 1 --2- 172.21.15.70:0/1652886000 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf398520 0x55bbcf3a41b0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.428+0000 7f8364412b80 1 --2- 172.21.15.70:0/1652886000 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398ee0 0x55bbcf3ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.428+0000 7f8364412b80 1 -- 172.21.15.70:0/1652886000 >> 172.21.15.70:0/1652886000 conn(0x55bbcf2c6cf0 msgr2=0x55bbcf397da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:36.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.428+0000 7f8364412b80 1 -- 172.21.15.70:0/1652886000 shutdown_connections 2024-05-08T09:21:36.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.428+0000 7f8364412b80 1 -- 172.21.15.70:0/1652886000 wait complete. 2024-05-08T09:21:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.429+0000 7f8364412b80 1 -- start start 2024-05-08T09:21:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.429+0000 7f8364412b80 1 Processor -- start 2024-05-08T09:21:36.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.430+0000 7f8364412b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 0x55bbcf3a75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.430+0000 7f8364412b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.430+0000 7f8364412b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf39df50 0x55bbcf3a8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.430+0000 7f8364412b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f83541b4190 con 0x55bbcf39df50 2024-05-08T09:21:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.430+0000 7f8364412b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f83541b5600 con 0x55bbcf398ee0 2024-05-08T09:21:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.430+0000 7f8364412b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f83541b4860 con 0x55bbcf398520 2024-05-08T09:21:36.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.430+0000 7f8364412b80 10 client.0 _ll_register_callbacks cb 0x55bbcf291e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:21:36.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.430+0000 7f8352000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf39df50 0x55bbcf3a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.431+0000 7f8352000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf39df50 0x55bbcf3a8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35490/0 (socket says 172.21.15.70:35490) 2024-05-08T09:21:36.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.431+0000 7f8352000700 1 -- 172.21.15.70:0/54989487 learned_addr learned my addr 172.21.15.70:0/54989487 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:21:36.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.431+0000 7f8352a00700 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.431+0000 7f8352000700 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 0x55bbcf3a75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.431+0000 7f8352000700 1 -- 172.21.15.70:0/54989487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 msgr2=0x55bbcf3a75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:36.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.432+0000 7f8352000700 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 0x55bbcf3a75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.432+0000 7f8352000700 1 -- 172.21.15.70:0/54989487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf398ee0 msgr2=0x55bbcf3a7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:36.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.432+0000 7f8352000700 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:36.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.432+0000 7f8352000700 1 -- 172.21.15.70:0/54989487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbcf41c4b0 con 0x55bbcf39df50 2024-05-08T09:21:36.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.432+0000 7f8352000700 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf39df50 0x55bbcf3a8070 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f834000b6d0 tx=0x7f8340021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7c72d52abd338f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:36.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.432+0000 7f833cc00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:21:36.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.433+0000 7f833cc00700 1 -- 172.21.15.70:0/54989487 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8340040020 con 0x55bbcf39df50 2024-05-08T09:21:36.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.433+0000 7f833cc00700 1 -- 172.21.15.70:0/54989487 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(386..386 src has 1..386) ==== 9583+0+0 (secure 0 0 0) 0x7f834000f840 con 0x55bbcf39df50 2024-05-08T09:21:36.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.433+0000 7f8364412b80 1 -- 172.21.15.70:0/54989487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f834000b720 con 0x55bbcf39df50 2024-05-08T09:21:36.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.434+0000 7f833cc00700 1 -- 172.21.15.70:0/54989487 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f834002c070 con 0x55bbcf39df50 2024-05-08T09:21:36.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.434+0000 7f8364412b80 10 client.19434 fetch_fsmap learned FSMap version 42 2024-05-08T09:21:36.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.434+0000 7f8364412b80 1 -- 172.21.15.70:0/54989487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55bbcf41d6d0 con 0x55bbcf39df50 2024-05-08T09:21:36.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.434+0000 7f833cc00700 1 -- 172.21.15.70:0/54989487 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f834000b720 con 0x55bbcf39df50 2024-05-08T09:21:36.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.434+0000 7f833cc00700 1 -- 172.21.15.70:0/54989487 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f8340036070 con 0x55bbcf39df50 2024-05-08T09:21:36.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.435+0000 7f8364412b80 10 client.19434 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:21:36.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.435+0000 7f8364412b80 10 client.19434 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:21:36.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.435+0000 7f8364412b80 20 client.19434 populate_metadata read hostname 'smithi070' 2024-05-08T09:21:36.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.435+0000 7f8364412b80 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bbcf41da90 0x55bbcf41feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:36.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.435+0000 7f8364412b80 4 client.19434 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}] 2024-05-08T09:21:36.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.435+0000 7f8364412b80 1 -- 172.21.15.70:0/54989487 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 90.0, "await_for": 42.0}) -- 0x55bbcf393370 con 0x55bbcf41da90 2024-05-08T09:21:36.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.436+0000 7f8352a00700 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bbcf41da90 0x55bbcf41feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:36.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.437+0000 7f8352a00700 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bbcf41da90 0x55bbcf41feb0 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78f200dfcc68a50e server_cookie=6b8af964b3cc3b1b in_seq=0 out_seq=0 2024-05-08T09:21:36.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:21:36.437+0000 7f833cc00700 10 client.19434 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:21:38.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:37 smithi070 ceph-mon[29591]: pgmap v4946: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 368 KiB/s wr, 14 op/s 2024-05-08T09:21:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:37 smithi172 ceph-mon[33377]: pgmap v4946: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 368 KiB/s wr, 14 op/s 2024-05-08T09:21:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:37 smithi194 ceph-mon[33679]: pgmap v4946: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 368 KiB/s wr, 14 op/s 2024-05-08T09:21:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:39 smithi070 ceph-mon[29591]: pgmap v4947: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 368 KiB/s wr, 14 op/s 2024-05-08T09:21:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:39 smithi172 ceph-mon[33377]: pgmap v4947: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 368 KiB/s wr, 14 op/s 2024-05-08T09:21:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:39 smithi194 ceph-mon[33679]: pgmap v4947: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 368 KiB/s wr, 14 op/s 2024-05-08T09:21:42.064 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:41 smithi194 ceph-mon[33679]: pgmap v4948: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 620 KiB/s wr, 26 op/s 2024-05-08T09:21:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:41 smithi070 ceph-mon[29591]: pgmap v4948: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 620 KiB/s wr, 26 op/s 2024-05-08T09:21:42.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:41 smithi172 ceph-mon[33377]: pgmap v4948: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 620 KiB/s wr, 26 op/s 2024-05-08T09:21:44.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:43 smithi070 ceph-mon[29591]: pgmap v4949: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 594 KiB/s wr, 21 op/s 2024-05-08T09:21:44.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:43 smithi172 ceph-mon[33377]: pgmap v4949: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 594 KiB/s wr, 21 op/s 2024-05-08T09:21:44.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:43 smithi194 ceph-mon[33679]: pgmap v4949: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 594 KiB/s wr, 21 op/s 2024-05-08T09:21:46.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:45 smithi070 ceph-mon[29591]: pgmap v4950: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 594 KiB/s wr, 25 op/s 2024-05-08T09:21:46.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:45 smithi172 ceph-mon[33377]: pgmap v4950: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 594 KiB/s wr, 25 op/s 2024-05-08T09:21:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:45 smithi194 ceph-mon[33679]: pgmap v4950: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 594 KiB/s wr, 25 op/s 2024-05-08T09:21:48.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:47 smithi070 ceph-mon[29591]: pgmap v4951: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 252 KiB/s wr, 15 op/s 2024-05-08T09:21:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:47 smithi172 ceph-mon[33377]: pgmap v4951: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 252 KiB/s wr, 15 op/s 2024-05-08T09:21:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:47 smithi194 ceph-mon[33679]: pgmap v4951: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 252 KiB/s wr, 15 op/s 2024-05-08T09:21:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:49 smithi070 ceph-mon[29591]: pgmap v4952: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 252 KiB/s wr, 15 op/s 2024-05-08T09:21:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:21:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:49 smithi172 ceph-mon[33377]: pgmap v4952: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 252 KiB/s wr, 15 op/s 2024-05-08T09:21:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:21:50.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:49 smithi194 ceph-mon[33679]: pgmap v4952: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 252 KiB/s wr, 15 op/s 2024-05-08T09:21:50.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:21:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:51.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:51 smithi070 ceph-mon[29591]: pgmap v4953: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 313 KiB/s wr, 19 op/s 2024-05-08T09:21:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:51.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:51 smithi172 ceph-mon[33377]: pgmap v4953: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 313 KiB/s wr, 19 op/s 2024-05-08T09:21:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:52.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:21:52.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:51 smithi194 ceph-mon[33679]: pgmap v4953: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 313 KiB/s wr, 19 op/s 2024-05-08T09:21:54.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:53 smithi194 ceph-mon[33679]: pgmap v4954: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 7 op/s 2024-05-08T09:21:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:53 smithi070 ceph-mon[29591]: pgmap v4954: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 7 op/s 2024-05-08T09:21:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:53 smithi172 ceph-mon[33377]: pgmap v4954: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 KiB/s wr, 7 op/s 2024-05-08T09:21:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:55 smithi070 ceph-mon[29591]: pgmap v4955: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 117 KiB/s wr, 10 op/s 2024-05-08T09:21:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:55 smithi172 ceph-mon[33377]: pgmap v4955: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 117 KiB/s wr, 10 op/s 2024-05-08T09:21:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:55 smithi194 ceph-mon[33679]: pgmap v4955: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 117 KiB/s wr, 10 op/s 2024-05-08T09:21:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:57 smithi070 ceph-mon[29591]: pgmap v4956: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 6 op/s 2024-05-08T09:21:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:57 smithi172 ceph-mon[33377]: pgmap v4956: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 6 op/s 2024-05-08T09:21:58.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:57 smithi194 ceph-mon[33679]: pgmap v4956: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 6 op/s 2024-05-08T09:22:00.031 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:21:59 smithi070 ceph-mon[29591]: pgmap v4957: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 6 op/s 2024-05-08T09:22:00.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.029+0000 7f833cc00700 1 -- 172.21.15.70:0/54989487 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55bbcf393370 con 0x55bbcf41da90 2024-05-08T09:22:00.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.029+0000 7f833cc00700 10 client.19434 handle_command_reply: tid=0 2024-05-08T09:22:00.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.030+0000 7f8364412b80 1 client.19434 shutdown 2024-05-08T09:22:00.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.030+0000 7f8364412b80 1 -- 172.21.15.70:0/54989487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf39df50 msgr2=0x55bbcf3a8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:00.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.030+0000 7f8364412b80 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf39df50 0x55bbcf3a8070 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f834000b6d0 tx=0x7f8340021040 comp rx=0 tx=0).stop 2024-05-08T09:22:00.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.030+0000 7f8364412b80 1 -- 172.21.15.70:0/54989487 shutdown_connections 2024-05-08T09:22:00.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.030+0000 7f8364412b80 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55bbcf41da90 0x55bbcf41feb0 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:00.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.030+0000 7f8364412b80 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbcf39df50 0x55bbcf3a8070 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:00.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.030+0000 7f8364412b80 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55bbcf398520 0x55bbcf3a75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:00.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.030+0000 7f8364412b80 1 --2- 172.21.15.70:0/54989487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55bbcf398ee0 0x55bbcf3a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:00.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.031+0000 7f8364412b80 1 -- 172.21.15.70:0/54989487 >> 172.21.15.70:0/54989487 conn(0x55bbcf2c6cf0 msgr2=0x55bbcf39b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:00.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.031+0000 7f833cc00700 0 client.19434 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:22:00.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.031+0000 7f8364412b80 1 -- 172.21.15.70:0/54989487 shutdown_connections 2024-05-08T09:22:00.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.032+0000 7f8364412b80 1 -- 172.21.15.70:0/54989487 wait complete. 2024-05-08T09:22:00.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.032+0000 7f8364412b80 20 client.19434 trim_cache size 0 max 16384 2024-05-08T09:22:00.033 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:22:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:22:00.033 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 342, 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "822f75e3": { 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 342, 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T09:22:00.034 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:00.035 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.034+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83380b2b10 msgr2=0x7f83380b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.034+0000 7f8359a00700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83380b2b10 0x7f83380b4fd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f834c0dfa00 tx=0x7f834c0a5430 comp rx=0 tx=0).stop 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.034+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8354108860 msgr2=0x7f83541a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.034+0000 7f8359a00700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8354108860 0x7f83541a4860 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f834c00c370 tx=0x7f834c00c730 comp rx=0 tx=0).stop 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.035+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 shutdown_connections 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.035+0000 7f8359a00700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f83380b2b10 0x7f83380b4fd0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.035+0000 7f8359a00700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8354108860 0x7f83541a4860 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.035+0000 7f8359a00700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f835406b3e0 0x7f835419ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.035+0000 7f8359a00700 1 --2- 172.21.15.70:0/3570210893 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f835406bd90 0x7f83541a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:00.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.035+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 >> 172.21.15.70:0/3570210893 conn(0x7f8354079340 msgr2=0x7f83541004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:00.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.036+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 shutdown_connections 2024-05-08T09:22:00.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:00.036+0000 7f8359a00700 1 -- 172.21.15.70:0/3570210893 wait complete. 2024-05-08T09:22:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:21:59 smithi172 ceph-mon[33377]: pgmap v4957: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 6 op/s 2024-05-08T09:22:00.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:21:59 smithi194 ceph-mon[33679]: pgmap v4957: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 117 KiB/s wr, 6 op/s 2024-05-08T09:22:01.063 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '822f75e3', quiesce took 31.7 seconds. Will release after: 30.0 2024-05-08T09:22:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:01 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:22:01.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:01 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:22:01.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:01 smithi070 ceph-mon[29591]: pgmap v4958: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 117 KiB/s wr, 9 op/s 2024-05-08T09:22:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:01 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:22:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:01 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:22:01.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:01 smithi172 ceph-mon[33377]: pgmap v4958: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 117 KiB/s wr, 9 op/s 2024-05-08T09:22:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:01 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:22:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:01 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:22:02.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:01 smithi194 ceph-mon[33679]: pgmap v4958: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 117 KiB/s wr, 9 op/s 2024-05-08T09:22:02.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:22:02.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:22:02.871 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:22:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:22:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:22:02.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:22:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:22:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:22:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:22:03.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:03 smithi070 ceph-mon[29591]: pgmap v4959: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 5 op/s 2024-05-08T09:22:03.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:03 smithi172 ceph-mon[33377]: pgmap v4959: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 5 op/s 2024-05-08T09:22:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:03 smithi194 ceph-mon[33679]: pgmap v4959: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 5 op/s 2024-05-08T09:22:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:05 smithi070 ceph-mon[29591]: pgmap v4960: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 112 KiB/s wr, 26 op/s 2024-05-08T09:22:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:05 smithi172 ceph-mon[33377]: pgmap v4960: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 112 KiB/s wr, 26 op/s 2024-05-08T09:22:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:05 smithi194 ceph-mon[33679]: pgmap v4960: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 112 KiB/s wr, 26 op/s 2024-05-08T09:22:08.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:07 smithi070 ceph-mon[29591]: pgmap v4961: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-05-08T09:22:08.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:07 smithi172 ceph-mon[33377]: pgmap v4961: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-05-08T09:22:08.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:07 smithi194 ceph-mon[33679]: pgmap v4961: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-05-08T09:22:10.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:09 smithi070 ceph-mon[29591]: pgmap v4962: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-05-08T09:22:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:09 smithi172 ceph-mon[33377]: pgmap v4962: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-05-08T09:22:10.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:09 smithi194 ceph-mon[33679]: pgmap v4962: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 55 KiB/s wr, 23 op/s 2024-05-08T09:22:11.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:10 smithi070 ceph-mon[29591]: osdmap e387: 12 total, 12 up, 12 in 2024-05-08T09:22:11.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:10 smithi172 ceph-mon[33377]: osdmap e387: 12 total, 12 up, 12 in 2024-05-08T09:22:11.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:10 smithi194 ceph-mon[33679]: osdmap e387: 12 total, 12 up, 12 in 2024-05-08T09:22:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:11 smithi070 ceph-mon[29591]: pgmap v4964: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 95 KiB/s wr, 34 op/s 2024-05-08T09:22:12.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:11 smithi194 ceph-mon[33679]: pgmap v4964: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 95 KiB/s wr, 34 op/s 2024-05-08T09:22:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:11 smithi172 ceph-mon[33377]: pgmap v4964: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 95 KiB/s wr, 34 op/s 2024-05-08T09:22:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:13 smithi070 ceph-mon[29591]: pgmap v4965: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 95 KiB/s wr, 34 op/s 2024-05-08T09:22:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:13 smithi172 ceph-mon[33377]: pgmap v4965: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 95 KiB/s wr, 34 op/s 2024-05-08T09:22:14.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:13 smithi194 ceph-mon[33679]: pgmap v4965: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 95 KiB/s wr, 34 op/s 2024-05-08T09:22:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:14 smithi070 ceph-mon[29591]: pgmap v4966: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-08T09:22:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:14 smithi172 ceph-mon[33377]: pgmap v4966: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-08T09:22:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:14 smithi194 ceph-mon[33679]: pgmap v4966: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-08T09:22:17.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:17 smithi194 ceph-mon[33679]: osdmap e388: 12 total, 12 up, 12 in 2024-05-08T09:22:17.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:17 smithi194 ceph-mon[33679]: pgmap v4968: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-05-08T09:22:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:17 smithi070 ceph-mon[29591]: osdmap e388: 12 total, 12 up, 12 in 2024-05-08T09:22:17.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:17 smithi070 ceph-mon[29591]: pgmap v4968: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-05-08T09:22:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:17 smithi172 ceph-mon[33377]: osdmap e388: 12 total, 12 up, 12 in 2024-05-08T09:22:17.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:17 smithi172 ceph-mon[33377]: pgmap v4968: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 15 op/s 2024-05-08T09:22:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:19 smithi070 ceph-mon[29591]: pgmap v4969: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.2 KiB/s wr, 3 op/s 2024-05-08T09:22:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:19 smithi172 ceph-mon[33377]: pgmap v4969: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.2 KiB/s wr, 3 op/s 2024-05-08T09:22:20.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:19 smithi194 ceph-mon[33679]: pgmap v4969: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 7.2 KiB/s wr, 3 op/s 2024-05-08T09:22:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:21 smithi070 ceph-mon[29591]: pgmap v4970: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2024-05-08T09:22:22.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:21 smithi172 ceph-mon[33377]: pgmap v4970: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2024-05-08T09:22:22.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:21 smithi194 ceph-mon[33679]: pgmap v4970: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2024-05-08T09:22:24.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:23 smithi070 ceph-mon[29591]: pgmap v4971: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2024-05-08T09:22:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:23 smithi172 ceph-mon[33377]: pgmap v4971: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2024-05-08T09:22:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:23 smithi194 ceph-mon[33679]: pgmap v4971: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 KiB/s wr, 6 op/s 2024-05-08T09:22:26.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:25 smithi070 ceph-mon[29591]: pgmap v4972: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:22:26.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:25 smithi172 ceph-mon[33377]: pgmap v4972: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:22:26.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:25 smithi194 ceph-mon[33679]: pgmap v4972: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:22:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:27 smithi070 ceph-mon[29591]: pgmap v4973: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:22:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:27 smithi172 ceph-mon[33377]: pgmap v4973: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:22:28.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:27 smithi194 ceph-mon[33679]: pgmap v4973: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:22:30.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:29 smithi070 ceph-mon[29591]: pgmap v4974: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:22:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:29 smithi172 ceph-mon[33377]: pgmap v4974: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:22:30.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:29 smithi194 ceph-mon[33679]: pgmap v4974: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:22:31.064 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:22:31.554 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:22:32.068 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:31 smithi070 ceph-mon[29591]: pgmap v4975: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:22:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:31 smithi172 ceph-mon[33377]: pgmap v4975: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:22:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:31 smithi194 ceph-mon[33679]: pgmap v4975: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:22:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:32 smithi172 ceph-mon[33377]: pgmap v4976: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:32 smithi194 ceph-mon[33679]: pgmap v4976: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:33.372 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:32 smithi070 ceph-mon[29591]: pgmap v4976: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:34.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.030+0000 7f5207200700 1 -- 172.21.15.70:0/1443963612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006bb70 msgr2=0x7f520006bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:34.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.031+0000 7f5207200700 1 --2- 172.21.15.70:0/1443963612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006bb70 0x7f520006bff0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009990 tx=0x7f51ec009ca0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.031+0000 7f5207200700 1 -- 172.21.15.70:0/1443963612 shutdown_connections 2024-05-08T09:22:34.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.031+0000 7f5207200700 1 --2- 172.21.15.70:0/1443963612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520006c530 0x7f5200110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.031+0000 7f5207200700 1 --2- 172.21.15.70:0/1443963612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5200109530 0x7f5200109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.031+0000 7f5207200700 1 --2- 172.21.15.70:0/1443963612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006bb70 0x7f520006bff0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.031+0000 7f5207200700 1 -- 172.21.15.70:0/1443963612 >> 172.21.15.70:0/1443963612 conn(0x7f5200079350 msgr2=0x7f5200079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:34.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.031+0000 7f5207200700 1 -- 172.21.15.70:0/1443963612 shutdown_connections 2024-05-08T09:22:34.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.031+0000 7f5207200700 1 -- 172.21.15.70:0/1443963612 wait complete. 2024-05-08T09:22:34.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.032+0000 7f5207200700 1 Processor -- start 2024-05-08T09:22:34.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.032+0000 7f5207200700 1 -- start start 2024-05-08T09:22:34.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.032+0000 7f5207200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520006bb70 0x7f52001a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:34.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.032+0000 7f5207200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006c530 0x7f52001a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:34.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.032+0000 7f5207200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5200109530 0x7f520019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f5207200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52001134f0 con 0x7f520006c530 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f5207200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5200113370 con 0x7f5200109530 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f5207200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5200113670 con 0x7f520006bb70 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f51ff400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006c530 0x7f52001a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f51ff400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006c530 0x7f52001a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45622/0 (socket says 172.21.15.70:45622) 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f51ff400700 1 -- 172.21.15.70:0/1544040912 learned_addr learned my addr 172.21.15.70:0/1544040912 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f51ffe00700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520006bb70 0x7f52001a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f5205200700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5200109530 0x7f520019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f51ff400700 1 -- 172.21.15.70:0/1544040912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520006bb70 msgr2=0x7f52001a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f51ff400700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520006bb70 0x7f52001a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f51ff400700 1 -- 172.21.15.70:0/1544040912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5200109530 msgr2=0x7f520019ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f51ff400700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5200109530 0x7f520019ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.033+0000 7f51ff400700 1 -- 172.21.15.70:0/1544040912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520019c1d0 con 0x7f520006c530 2024-05-08T09:22:34.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.034+0000 7f51ff400700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006c530 0x7f52001a1df0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f51ec000c00 tx=0x7f51ec009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:34.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.034+0000 7f51fcc00700 1 -- 172.21.15.70:0/1544040912 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec027070 con 0x7f520006c530 2024-05-08T09:22:34.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.034+0000 7f51fcc00700 1 -- 172.21.15.70:0/1544040912 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51ec00fc70 con 0x7f520006c530 2024-05-08T09:22:34.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.034+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520019c460 con 0x7f520006c530 2024-05-08T09:22:34.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.034+0000 7f51fcc00700 1 -- 172.21.15.70:0/1544040912 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ec022d40 con 0x7f520006c530 2024-05-08T09:22:34.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.034+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52001a8780 con 0x7f520006c530 2024-05-08T09:22:34.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.036+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5200104bf0 con 0x7f520006c530 2024-05-08T09:22:34.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.038+0000 7f51fcc00700 1 -- 172.21.15.70:0/1544040912 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f51ec02a070 con 0x7f520006c530 2024-05-08T09:22:34.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.039+0000 7f51fcc00700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f51e40b29f0 0x7f51e40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:34.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.039+0000 7f51fcc00700 1 -- 172.21.15.70:0/1544040912 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(388..388 src has 1..388) ==== 9583+0+0 (secure 0 0 0) 0x7f51ec0e3880 con 0x7f520006c530 2024-05-08T09:22:34.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.040+0000 7f51ffe00700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f51e40b29f0 0x7f51e40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:34.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.040+0000 7f51ffe00700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f51e40b29f0 0x7f51e40b4eb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f520019cbb0 tx=0x7f51f000b4d0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:34.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.044+0000 7f51fcc00700 1 -- 172.21.15.70:0/1544040912 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f51ec05fdf0 con 0x7f520006c530 2024-05-08T09:22:34.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.322+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52001a8950 con 0x7f520006c530 2024-05-08T09:22:34.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.323+0000 7f51fcc00700 1 -- 172.21.15.70:0/1544040912 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f51ec013070 con 0x7f520006c530 2024-05-08T09:22:34.324 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:22:34.324 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:22:34.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f51e40b29f0 msgr2=0x7f51e40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:34.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f51e40b29f0 0x7f51e40b4eb0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f520019cbb0 tx=0x7f51f000b4d0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006c530 msgr2=0x7f52001a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:34.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006c530 0x7f52001a1df0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f51ec000c00 tx=0x7f51ec009f90 comp rx=0 tx=0).stop 2024-05-08T09:22:34.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 shutdown_connections 2024-05-08T09:22:34.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f51e40b29f0 0x7f51e40b4eb0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5200109530 0x7f520019ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f520006bb70 0x7f52001a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 --2- 172.21.15.70:0/1544040912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f520006c530 0x7f52001a1df0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:34.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 >> 172.21.15.70:0/1544040912 conn(0x7f5200079350 msgr2=0x7f520010e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:34.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 shutdown_connections 2024-05-08T09:22:34.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:34.327+0000 7f5207200700 1 -- 172.21.15.70:0/1544040912 wait complete. 2024-05-08T09:22:34.328 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:22:34.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1544040912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:22:34.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1544040912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:22:34.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1544040912' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:22:35.502 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 822f75e3 --release --await' 2024-05-08T09:22:35.503 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 822f75e3 --release --await 2024-05-08T09:22:35.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:35 smithi172 ceph-mon[33377]: pgmap v4977: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:22:35.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:35 smithi194 ceph-mon[33679]: pgmap v4977: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:22:35.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:35 smithi070 ceph-mon[29591]: pgmap v4977: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:22:35.984 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:22:37.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:37 smithi070 ceph-mon[29591]: pgmap v4978: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:38.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:37 smithi172 ceph-mon[33377]: pgmap v4978: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:38.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:37 smithi194 ceph-mon[33679]: pgmap v4978: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:38.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.494+0000 7fcaa4600700 1 -- 172.21.15.70:0/1502938159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c10b6c0 msgr2=0x7fca9c10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:38.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.494+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1502938159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c10b6c0 0x7fca9c10baa0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fca90009990 tx=0x7fca90009ca0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.494+0000 7fcaa4600700 1 -- 172.21.15.70:0/1502938159 shutdown_connections 2024-05-08T09:22:38.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.494+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1502938159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca9c106080 0x7fca9c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.494+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1502938159 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c10b6c0 0x7fca9c10baa0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.494+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1502938159 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c1056c0 0x7fca9c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.494+0000 7fcaa4600700 1 -- 172.21.15.70:0/1502938159 >> 172.21.15.70:0/1502938159 conn(0x7fca9c1011b0 msgr2=0x7fca9c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:38.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.494+0000 7fcaa4600700 1 -- 172.21.15.70:0/1502938159 shutdown_connections 2024-05-08T09:22:38.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.494+0000 7fcaa4600700 1 -- 172.21.15.70:0/1502938159 wait complete. 2024-05-08T09:22:38.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.496+0000 7fcaa4600700 1 Processor -- start 2024-05-08T09:22:38.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.496+0000 7fcaa4600700 1 -- start start 2024-05-08T09:22:38.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.497+0000 7fcaa4600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c1056c0 0x7fca9c1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.497+0000 7fcaa4600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c106080 0x7fca9c1a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.497+0000 7fcaa4600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca9c10b6c0 0x7fca9c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.497+0000 7fcaa4600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1157c0 con 0x7fca9c106080 2024-05-08T09:22:38.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.497+0000 7fcaa4600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c115640 con 0x7fca9c1056c0 2024-05-08T09:22:38.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.497+0000 7fcaa4600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c115940 con 0x7fca9c10b6c0 2024-05-08T09:22:38.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c106080 0x7fca9c1a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c106080 0x7fca9c1a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52946/0 (socket says 172.21.15.70:52946) 2024-05-08T09:22:38.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa1200700 1 -- 172.21.15.70:0/1296197759 learned_addr learned my addr 172.21.15.70:0/1296197759 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:22:38.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c1056c0 0x7fca9c1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa2600700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca9c10b6c0 0x7fca9c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa1200700 1 -- 172.21.15.70:0/1296197759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca9c10b6c0 msgr2=0x7fca9c19bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:38.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa1200700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca9c10b6c0 0x7fca9c19bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa1200700 1 -- 172.21.15.70:0/1296197759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c1056c0 msgr2=0x7fca9c1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:38.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa1200700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c1056c0 0x7fca9c1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa1200700 1 -- 172.21.15.70:0/1296197759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c19c260 con 0x7fca9c106080 2024-05-08T09:22:38.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.498+0000 7fcaa2600700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca9c10b6c0 0x7fca9c19bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:22:38.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.499+0000 7fcaa1200700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c106080 0x7fca9c1a1e80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d950 tx=0x7fca8800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:38.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.499+0000 7fca9a000700 1 -- 172.21.15.70:0/1296197759 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca88016070 con 0x7fca9c106080 2024-05-08T09:22:38.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.499+0000 7fca9a000700 1 -- 172.21.15.70:0/1296197759 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca88009dd0 con 0x7fca9c106080 2024-05-08T09:22:38.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.499+0000 7fcaa4600700 1 -- 172.21.15.70:0/1296197759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9c19c550 con 0x7fca9c106080 2024-05-08T09:22:38.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.499+0000 7fca9a000700 1 -- 172.21.15.70:0/1296197759 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8800f3c0 con 0x7fca9c106080 2024-05-08T09:22:38.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.499+0000 7fcaa4600700 1 -- 172.21.15.70:0/1296197759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9c1a8810 con 0x7fca9c106080 2024-05-08T09:22:38.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.503+0000 7fca9a000700 1 -- 172.21.15.70:0/1296197759 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fca88019070 con 0x7fca9c106080 2024-05-08T09:22:38.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.505+0000 7fca9a000700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca840b29f0 0x7fca840b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.505+0000 7fca9a000700 1 -- 172.21.15.70:0/1296197759 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(388..388 src has 1..388) ==== 9583+0+0 (secure 0 0 0) 0x7fca880e3460 con 0x7fca9c106080 2024-05-08T09:22:38.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.505+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca840b29f0 0x7fca840b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.541+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca840b29f0 0x7fca840b4eb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fca90006010 tx=0x7fca9000b540 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:38.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.543+0000 7fcaaeee9b80 1 Processor -- start 2024-05-08T09:22:38.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.543+0000 7fcaaeee9b80 1 -- start start 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec00590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ebfac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 0x56507ec06f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56507eb4cb20 con 0x56507ec001b0 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56507eaea860 con 0x56507ebfb140 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56507eb48ae0 con 0x56507ebfa780 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaa1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec00590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaa1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec00590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52948/0 (socket says 172.21.15.70:52948) 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaa1c00700 1 -- 172.21.15.70:0/865026560 learned_addr learned my addr 172.21.15.70:0/865026560 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaa2600700 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 0x56507ec06f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.544+0000 7fcaa1200700 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ebfac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.545+0000 7fcaa1c00700 1 -- 172.21.15.70:0/865026560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 msgr2=0x56507ebfac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:22:38.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.545+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ebfac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.545+0000 7fcaa1c00700 1 -- 172.21.15.70:0/865026560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 msgr2=0x56507ec06f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:22:38.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.545+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 0x56507ec06f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.545+0000 7fcaa1c00700 1 -- 172.21.15.70:0/865026560 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507ea999d0 con 0x56507ec001b0 2024-05-08T09:22:38.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.545+0000 7fcaa1200700 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ebfac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:22:38.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.545+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec00590 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fca9000ba60 tx=0x7fca9001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e59bafc30a1b076 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:38.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.546+0000 7fca8ea00700 1 -- 172.21.15.70:0/865026560 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90034070 con 0x56507ec001b0 2024-05-08T09:22:38.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.546+0000 7fca8ea00700 1 -- 172.21.15.70:0/865026560 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca9000f8f0 con 0x56507ec001b0 2024-05-08T09:22:38.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.546+0000 7fca8ea00700 1 -- 172.21.15.70:0/865026560 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9002f7a0 con 0x56507ec001b0 2024-05-08T09:22:38.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.547+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/865026560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 msgr2=0x56507ec00590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:38.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.547+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec00590 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fca9000ba60 tx=0x7fca9001f000 comp rx=0 tx=0).stop 2024-05-08T09:22:38.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.547+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/865026560 shutdown_connections 2024-05-08T09:22:38.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.547+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 0x56507ec06f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.547+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec00590 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.547+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/865026560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ebfac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.547+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/865026560 >> 172.21.15.70:0/865026560 conn(0x56507eb727d0 msgr2=0x56507ebf5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:38.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.547+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/865026560 shutdown_connections 2024-05-08T09:22:38.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.547+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/865026560 wait complete. 2024-05-08T09:22:38.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.548+0000 7fcaaeee9b80 1 -- start start 2024-05-08T09:22:38.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.548+0000 7fcaaeee9b80 1 Processor -- start 2024-05-08T09:22:38.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.548+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ec06b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.548+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec03f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.548+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ec001b0 0x56507ec04480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.548+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56507ec07510 con 0x56507ebfb140 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.548+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56507eab2c20 con 0x56507ec001b0 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.548+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56507ec07690 con 0x56507ebfa780 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.548+0000 7fcaaeee9b80 10 client.0 _ll_register_callbacks cb 0x56507eaf3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec03f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec03f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52964/0 (socket says 172.21.15.70:52964) 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1200700 1 -- 172.21.15.70:0/42966896 learned_addr learned my addr 172.21.15.70:0/42966896 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ec06b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa2600700 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ec001b0 0x56507ec04480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1200700 1 -- 172.21.15.70:0/42966896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 msgr2=0x56507ec06b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:22:38.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1200700 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ec06b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1200700 1 -- 172.21.15.70:0/42966896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ec001b0 msgr2=0x56507ec04480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1200700 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ec001b0 0x56507ec04480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1200700 1 -- 172.21.15.70:0/42966896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56507eb12520 con 0x56507ebfb140 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ec06b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fcaa1200700 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec03f40 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fca880aa2b0 tx=0x7fca880aab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786ed66d87c5c7ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.549+0000 7fca83400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.550+0000 7fca83400700 1 -- 172.21.15.70:0/42966896 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca88020040 con 0x56507ebfb140 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.550+0000 7fca83400700 1 -- 172.21.15.70:0/42966896 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(388..388 src has 1..388) ==== 9583+0+0 (secure 0 0 0) 0x7fca880aa580 con 0x56507ebfb140 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.550+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/42966896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca9000f8f0 con 0x56507ebfb140 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.550+0000 7fca83400700 1 -- 172.21.15.70:0/42966896 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fca880aa780 con 0x56507ebfb140 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.550+0000 7fcaaeee9b80 10 client.19452 fetch_fsmap learned FSMap version 42 2024-05-08T09:22:38.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.550+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/42966896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56507ec11d70 con 0x56507ebfb140 2024-05-08T09:22:38.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.550+0000 7fca83400700 1 -- 172.21.15.70:0/42966896 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca9000f8f0 con 0x56507ebfb140 2024-05-08T09:22:38.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.551+0000 7fca83400700 1 -- 172.21.15.70:0/42966896 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fca880a9580 con 0x56507ebfb140 2024-05-08T09:22:38.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.551+0000 7fcaaeee9b80 10 client.19452 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:22:38.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.551+0000 7fcaaeee9b80 10 client.19452 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:22:38.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.551+0000 7fcaaeee9b80 20 client.19452 populate_metadata read hostname 'smithi070' 2024-05-08T09:22:38.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.551+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56507ec14240 0x56507ec16630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.551+0000 7fcaaeee9b80 4 client.19452 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:22:38.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.551+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/42966896 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56507ebc7240 con 0x56507ec14240 2024-05-08T09:22:38.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.552+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56507ec14240 0x56507ec16630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.553+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56507ec14240 0x56507ec16630 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685a095c3cd27be0 server_cookie=6dde12e065de9fe in_seq=0 out_seq=0 2024-05-08T09:22:38.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.553+0000 7fca83400700 10 client.19452 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:22:38.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.554+0000 7fca83400700 1 -- 172.21.15.70:0/42966896 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56507ebc7240 con 0x56507ec14240 2024-05-08T09:22:38.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.554+0000 7fca83400700 10 client.19452 handle_command_reply: tid=0 2024-05-08T09:22:38.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 client.19452 shutdown 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/42966896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 msgr2=0x56507ec03f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec03f40 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fca880aa2b0 tx=0x7fca880aab50 comp rx=0 tx=0).stop 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/42966896 shutdown_connections 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56507ec14240 0x56507ec16630 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ec001b0 0x56507ec04480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ec06b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/42966896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec03f40 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/42966896 >> 172.21.15.70:0/42966896 conn(0x56507eb727d0 msgr2=0x56507ebefb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fca83400700 0 client.19452 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/42966896 shutdown_connections 2024-05-08T09:22:38.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/42966896 wait complete. 2024-05-08T09:22:38.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.555+0000 7fcaaeee9b80 20 client.19452 trim_cache size 0 max 16384 2024-05-08T09:22:38.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.577+0000 7fcaaeee9b80 1 Processor -- start 2024-05-08T09:22:38.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.577+0000 7fcaaeee9b80 1 -- start start 2024-05-08T09:22:38.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.577+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ec105d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.577+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 0x56507ebff7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.577+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec1bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.577+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1b4050 con 0x56507ec001b0 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.577+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1b18e0 con 0x56507ebfb140 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.577+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1af750 con 0x56507ebfa780 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa2600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec1bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa2600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec1bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52968/0 (socket says 172.21.15.70:52968) 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa2600700 1 -- 172.21.15.70:0/1160060284 learned_addr learned my addr 172.21.15.70:0/1160060284 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa1200700 1 --2- 172.21.15.70:0/1160060284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 0x56507ebff7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/1160060284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ec105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa2600700 1 -- 172.21.15.70:0/1160060284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 msgr2=0x56507ec105d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:22:38.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa2600700 1 --2- 172.21.15.70:0/1160060284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ec105d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa2600700 1 -- 172.21.15.70:0/1160060284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 msgr2=0x56507ebff7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:22:38.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa2600700 1 --2- 172.21.15.70:0/1160060284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 0x56507ebff7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa2600700 1 -- 172.21.15.70:0/1160060284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56507ebf1c70 con 0x56507ec001b0 2024-05-08T09:22:38.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.578+0000 7fcaa2600700 1 --2- 172.21.15.70:0/1160060284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec1bf00 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fca94007f40 tx=0x7fca94007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fe4ea2bfc19042 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:38.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.579+0000 7fca8e000700 1 -- 172.21.15.70:0/1160060284 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94019020 con 0x56507ec001b0 2024-05-08T09:22:38.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.579+0000 7fca8e000700 1 -- 172.21.15.70:0/1160060284 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca94008cb0 con 0x56507ec001b0 2024-05-08T09:22:38.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.579+0000 7fca8e000700 1 -- 172.21.15.70:0/1160060284 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca940145c0 con 0x56507ec001b0 2024-05-08T09:22:38.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/1160060284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 msgr2=0x56507ec1bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:38.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/1160060284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec1bf00 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fca94007f40 tx=0x7fca94007960 comp rx=0 tx=0).stop 2024-05-08T09:22:38.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/1160060284 shutdown_connections 2024-05-08T09:22:38.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/1160060284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ec001b0 0x56507ec1bf00 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/1160060284 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ebfa780 0x56507ec105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/1160060284 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfb140 0x56507ebff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/1160060284 >> 172.21.15.70:0/1160060284 conn(0x56507eb727d0 msgr2=0x56507ebfa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:38.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/1160060284 shutdown_connections 2024-05-08T09:22:38.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/1160060284 wait complete. 2024-05-08T09:22:38.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.580+0000 7fcaaeee9b80 1 -- start start 2024-05-08T09:22:38.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.581+0000 7fcaaeee9b80 1 Processor -- start 2024-05-08T09:22:38.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.581+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfa780 0x56507ec09920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.581+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec09e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.581+0000 7fcaaeee9b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ec001b0 0x56507ec0a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.581+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1afda0 con 0x56507ebfb140 2024-05-08T09:22:38.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.581+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1b1210 con 0x56507ebfa780 2024-05-08T09:22:38.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.581+0000 7fcaaeee9b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c1b0470 con 0x56507ec001b0 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.581+0000 7fcaaeee9b80 10 client.0 _ll_register_callbacks cb 0x56507eaf3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec09e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec09e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52982/0 (socket says 172.21.15.70:52982) 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1200700 1 -- 172.21.15.70:0/790799037 learned_addr learned my addr 172.21.15.70:0/790799037 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfa780 0x56507ec09920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1200700 1 -- 172.21.15.70:0/790799037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ec001b0 msgr2=0x56507ec0a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa2600700 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ec001b0 0x56507ec0a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1200700 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ec001b0 0x56507ec0a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1200700 1 -- 172.21.15.70:0/790799037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfa780 msgr2=0x56507ec09920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1200700 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfa780 0x56507ec09920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1200700 1 -- 172.21.15.70:0/790799037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56507ec7eaf0 con 0x56507ebfb140 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfa780 0x56507ec09920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fcaa1200700 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec09e60 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fca880a9a20 tx=0x7fca880b2f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da31996cf3dc90cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.582+0000 7fca83400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:22:38.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.583+0000 7fca83400700 1 -- 172.21.15.70:0/790799037 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca88020070 con 0x56507ebfb140 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.583+0000 7fca83400700 1 -- 172.21.15.70:0/790799037 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(388..388 src has 1..388) ==== 9583+0+0 (secure 0 0 0) 0x7fca880a6910 con 0x56507ebfb140 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.583+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/790799037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca94008cb0 con 0x56507ebfb140 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.583+0000 7fca83400700 1 -- 172.21.15.70:0/790799037 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fca880a9a90 con 0x56507ebfb140 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.583+0000 7fcaaeee9b80 10 client.19458 fetch_fsmap learned FSMap version 42 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.583+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/790799037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56507ec7fe10 con 0x56507ebfb140 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.583+0000 7fca83400700 1 -- 172.21.15.70:0/790799037 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fca94008cb0 con 0x56507ebfb140 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.584+0000 7fca83400700 1 -- 172.21.15.70:0/790799037 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fca880a5db0 con 0x56507ebfb140 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.584+0000 7fcaaeee9b80 10 client.19458 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.584+0000 7fcaaeee9b80 10 client.19458 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.584+0000 7fcaaeee9b80 20 client.19458 populate_metadata read hostname 'smithi070' 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.584+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56507ec804e0 0x56507ec82900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.584+0000 7fcaaeee9b80 4 client.19458 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "822f75e3", "release": true, "await": true}] 2024-05-08T09:22:38.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.584+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/790799037 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "822f75e3", "release": true, "await": true}) -- 0x56507eb5a500 con 0x56507ec804e0 2024-05-08T09:22:38.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.584+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56507ec804e0 0x56507ec82900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:38.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.585+0000 7fcaa1c00700 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56507ec804e0 0x56507ec82900 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e40433be0fb4eaf2 server_cookie=92cce1c646c43901 in_seq=0 out_seq=0 2024-05-08T09:22:38.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:38.585+0000 7fca83400700 10 client.19458 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:22:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:39 smithi070 ceph-mon[29591]: pgmap v4979: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:39 smithi172 ceph-mon[33377]: pgmap v4979: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:39 smithi194 ceph-mon[33679]: pgmap v4979: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:42.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:41 smithi070 ceph-mon[29591]: pgmap v4980: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:22:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:41 smithi172 ceph-mon[33377]: pgmap v4980: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:22:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:41 smithi194 ceph-mon[33679]: pgmap v4980: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:22:43.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.207+0000 7fca83400700 1 -- 172.21.15.70:0/790799037 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x56507eb5a500 con 0x56507ec804e0 2024-05-08T09:22:43.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.207+0000 7fca83400700 10 client.19458 handle_command_reply: tid=0 2024-05-08T09:22:43.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.207+0000 7fcaaeee9b80 1 client.19458 shutdown 2024-05-08T09:22:43.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/790799037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 msgr2=0x56507ec09e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:43.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec09e60 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fca880a9a20 tx=0x7fca880b2f20 comp rx=0 tx=0).stop 2024-05-08T09:22:43.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/790799037 shutdown_connections 2024-05-08T09:22:43.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56507ec804e0 0x56507ec82900 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:43.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56507ec001b0 0x56507ec0a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:43.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56507ebfa780 0x56507ec09920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:43.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fca83400700 0 client.19458 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:22:43.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 --2- 172.21.15.70:0/790799037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56507ebfb140 0x56507ec09e60 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:43.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/790799037 >> 172.21.15.70:0/790799037 conn(0x56507eb727d0 msgr2=0x56507ebfa000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:43.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/790799037 shutdown_connections 2024-05-08T09:22:43.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.208+0000 7fcaaeee9b80 1 -- 172.21.15.70:0/790799037 wait complete. 2024-05-08T09:22:43.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.209+0000 7fcaaeee9b80 20 client.19458 trim_cache size 0 max 16384 2024-05-08T09:22:43.209 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:22:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:22:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:22:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 344, 2024-05-08T09:22:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:22:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "822f75e3": { 2024-05-08T09:22:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 344, 2024-05-08T09:22:43.209 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 90.0, 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:22:43.210 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:22:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:43.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:22:43.211 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 -- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca840b29f0 msgr2=0x7fca840b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca840b29f0 0x7fca840b4eb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fca90006010 tx=0x7fca9000b540 comp rx=0 tx=0).stop 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 -- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c106080 msgr2=0x7fca9c1a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c106080 0x7fca9c1a1e80 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fca8800d950 tx=0x7fca8800dc60 comp rx=0 tx=0).stop 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 -- 172.21.15.70:0/1296197759 shutdown_connections 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fca840b29f0 0x7fca840b4eb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca9c10b6c0 0x7fca9c19bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fca9c1056c0 0x7fca9c1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 --2- 172.21.15.70:0/1296197759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca9c106080 0x7fca9c1a1e80 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.210+0000 7fcaa4600700 1 -- 172.21.15.70:0/1296197759 >> 172.21.15.70:0/1296197759 conn(0x7fca9c1011b0 msgr2=0x7fca9c1019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:43.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.211+0000 7fcaa4600700 1 -- 172.21.15.70:0/1296197759 shutdown_connections 2024-05-08T09:22:43.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:22:43.211+0000 7fcaa4600700 1 -- 172.21.15.70:0/1296197759 wait complete. 2024-05-08T09:22:43.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:43 smithi070 ceph-mon[29591]: pgmap v4981: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:44.077 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '822f75e3', seconds elapsed: 74.8 2024-05-08T09:22:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:43 smithi172 ceph-mon[33377]: pgmap v4981: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:44.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:43 smithi194 ceph-mon[33679]: pgmap v4981: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:22:46.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:45 smithi070 ceph-mon[29591]: pgmap v4982: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 61 KiB/s wr, 8 op/s 2024-05-08T09:22:46.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:45 smithi172 ceph-mon[33377]: pgmap v4982: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 61 KiB/s wr, 8 op/s 2024-05-08T09:22:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:45 smithi194 ceph-mon[33679]: pgmap v4982: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 61 KiB/s wr, 8 op/s 2024-05-08T09:22:46.276 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_bw.o 2024-05-08T09:22:48.109 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_cdclk.o 2024-05-08T09:22:48.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:47 smithi070 ceph-mon[29591]: pgmap v4983: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 61 KiB/s wr, 5 op/s 2024-05-08T09:22:48.142 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_color.o 2024-05-08T09:22:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:47 smithi172 ceph-mon[33377]: pgmap v4983: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 61 KiB/s wr, 5 op/s 2024-05-08T09:22:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:47 smithi194 ceph-mon[33679]: pgmap v4983: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 61 KiB/s wr, 5 op/s 2024-05-08T09:22:49.583 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_combo_phy.o 2024-05-08T09:22:49.837 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_connector.o 2024-05-08T09:22:49.922 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_crtc.o 2024-05-08T09:22:49.933 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_crtc_state_dump.o 2024-05-08T09:22:50.077 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_cursor.o 2024-05-08T09:22:50.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:49 smithi070 ceph-mon[29591]: pgmap v4984: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 63 KiB/s wr, 7 op/s 2024-05-08T09:22:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:49 smithi172 ceph-mon[33377]: pgmap v4984: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 63 KiB/s wr, 7 op/s 2024-05-08T09:22:50.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:49 smithi194 ceph-mon[33679]: pgmap v4984: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 63 KiB/s wr, 7 op/s 2024-05-08T09:22:52.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:51 smithi070 ceph-mon[29591]: pgmap v4985: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 435 KiB/s wr, 20 op/s 2024-05-08T09:22:52.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:51 smithi172 ceph-mon[33377]: pgmap v4985: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 435 KiB/s wr, 20 op/s 2024-05-08T09:22:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:51 smithi194 ceph-mon[33679]: pgmap v4985: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 435 KiB/s wr, 20 op/s 2024-05-08T09:22:53.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:52 smithi070 ceph-mon[29591]: pgmap v4986: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 435 KiB/s wr, 18 op/s 2024-05-08T09:22:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:52 smithi172 ceph-mon[33377]: pgmap v4986: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 435 KiB/s wr, 18 op/s 2024-05-08T09:22:53.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:52 smithi194 ceph-mon[33679]: pgmap v4986: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 435 KiB/s wr, 18 op/s 2024-05-08T09:22:56.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:55 smithi070 ceph-mon[29591]: pgmap v4987: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 743 KiB/s wr, 25 op/s 2024-05-08T09:22:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:55 smithi172 ceph-mon[33377]: pgmap v4987: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 743 KiB/s wr, 25 op/s 2024-05-08T09:22:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:55 smithi194 ceph-mon[33679]: pgmap v4987: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 743 KiB/s wr, 25 op/s 2024-05-08T09:22:58.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:57 smithi070 ceph-mon[29591]: pgmap v4988: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 682 KiB/s wr, 22 op/s 2024-05-08T09:22:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:57 smithi172 ceph-mon[33377]: pgmap v4988: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 682 KiB/s wr, 22 op/s 2024-05-08T09:22:58.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:57 smithi194 ceph-mon[33679]: pgmap v4988: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 682 KiB/s wr, 22 op/s 2024-05-08T09:23:00.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:22:59 smithi070 ceph-mon[29591]: pgmap v4989: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 948 KiB/s wr, 26 op/s 2024-05-08T09:23:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:22:59 smithi172 ceph-mon[33377]: pgmap v4989: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 948 KiB/s wr, 26 op/s 2024-05-08T09:23:00.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:22:59 smithi194 ceph-mon[33679]: pgmap v4989: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 948 KiB/s wr, 26 op/s 2024-05-08T09:23:02.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:01 smithi070 ceph-mon[29591]: pgmap v4990: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 968 KiB/s wr, 31 op/s 2024-05-08T09:23:02.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:01 smithi172 ceph-mon[33377]: pgmap v4990: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 968 KiB/s wr, 31 op/s 2024-05-08T09:23:02.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:01 smithi194 ceph-mon[33679]: pgmap v4990: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 968 KiB/s wr, 31 op/s 2024-05-08T09:23:02.553 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display.o 2024-05-08T09:23:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:02 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:23:03.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:02 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:23:03.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:02 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:23:04.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:03 smithi070 ceph-mon[29591]: pgmap v4991: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 596 KiB/s wr, 18 op/s 2024-05-08T09:23:04.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:23:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:23:04.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:03 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:23:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:03 smithi172 ceph-mon[33377]: pgmap v4991: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 596 KiB/s wr, 18 op/s 2024-05-08T09:23:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:23:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:23:04.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:03 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:23:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:03 smithi194 ceph-mon[33679]: pgmap v4991: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 929 KiB/s rd, 596 KiB/s wr, 18 op/s 2024-05-08T09:23:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:23:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:23:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:03 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:23:06.104 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_driver.o 2024-05-08T09:23:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:05 smithi070 ceph-mon[29591]: pgmap v4992: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 976 KiB/s wr, 48 op/s 2024-05-08T09:23:06.146 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_irq.o 2024-05-08T09:23:06.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:05 smithi172 ceph-mon[33377]: pgmap v4992: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 976 KiB/s wr, 48 op/s 2024-05-08T09:23:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:05 smithi194 ceph-mon[33679]: pgmap v4992: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 976 KiB/s wr, 48 op/s 2024-05-08T09:23:06.417 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_power.o 2024-05-08T09:23:06.472 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_power_map.o 2024-05-08T09:23:06.501 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_power_well.o 2024-05-08T09:23:06.880 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_reset.o 2024-05-08T09:23:07.105 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_rps.o 2024-05-08T09:23:07.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:06 smithi070 ceph-mon[29591]: pgmap v4993: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 668 KiB/s wr, 40 op/s 2024-05-08T09:23:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:06 smithi172 ceph-mon[33377]: pgmap v4993: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 668 KiB/s wr, 40 op/s 2024-05-08T09:23:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:06 smithi194 ceph-mon[33679]: pgmap v4993: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 910 KiB/s rd, 668 KiB/s wr, 40 op/s 2024-05-08T09:23:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:09 smithi070 ceph-mon[29591]: osdmap e389: 12 total, 12 up, 12 in 2024-05-08T09:23:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:09 smithi070 ceph-mon[29591]: pgmap v4995: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 555 KiB/s wr, 49 op/s 2024-05-08T09:23:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:09 smithi172 ceph-mon[33377]: osdmap e389: 12 total, 12 up, 12 in 2024-05-08T09:23:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:09 smithi172 ceph-mon[33377]: pgmap v4995: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 555 KiB/s wr, 49 op/s 2024-05-08T09:23:09.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:09 smithi194 ceph-mon[33679]: osdmap e389: 12 total, 12 up, 12 in 2024-05-08T09:23:09.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:09 smithi194 ceph-mon[33679]: pgmap v4995: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 555 KiB/s wr, 49 op/s 2024-05-08T09:23:12.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:11 smithi070 ceph-mon[29591]: pgmap v4996: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 711 KiB/s wr, 47 op/s 2024-05-08T09:23:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:11 smithi070 ceph-mon[29591]: osdmap e390: 12 total, 12 up, 12 in 2024-05-08T09:23:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:11 smithi172 ceph-mon[33377]: pgmap v4996: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 711 KiB/s wr, 47 op/s 2024-05-08T09:23:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:11 smithi172 ceph-mon[33377]: osdmap e390: 12 total, 12 up, 12 in 2024-05-08T09:23:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:11 smithi194 ceph-mon[33679]: pgmap v4996: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 711 KiB/s wr, 47 op/s 2024-05-08T09:23:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:11 smithi194 ceph-mon[33679]: osdmap e390: 12 total, 12 up, 12 in 2024-05-08T09:23:14.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:13 smithi070 ceph-mon[29591]: pgmap v4998: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 319 KiB/s wr, 14 op/s 2024-05-08T09:23:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:13 smithi172 ceph-mon[33377]: pgmap v4998: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 319 KiB/s wr, 14 op/s 2024-05-08T09:23:14.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:13 smithi194 ceph-mon[33679]: pgmap v4998: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 319 KiB/s wr, 14 op/s 2024-05-08T09:23:16.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:15 smithi070 ceph-mon[29591]: pgmap v4999: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 676 KiB/s wr, 23 op/s 2024-05-08T09:23:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:15 smithi172 ceph-mon[33377]: pgmap v4999: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 676 KiB/s wr, 23 op/s 2024-05-08T09:23:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:15 smithi194 ceph-mon[33679]: pgmap v4999: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 676 KiB/s wr, 23 op/s 2024-05-08T09:23:18.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:17 smithi070 ceph-mon[29591]: pgmap v5000: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 635 KiB/s wr, 22 op/s 2024-05-08T09:23:18.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:17 smithi172 ceph-mon[33377]: pgmap v5000: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 635 KiB/s wr, 22 op/s 2024-05-08T09:23:18.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:17 smithi194 ceph-mon[33679]: pgmap v5000: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 635 KiB/s wr, 22 op/s 2024-05-08T09:23:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:19 smithi070 ceph-mon[29591]: pgmap v5001: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 572 KiB/s wr, 19 op/s 2024-05-08T09:23:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:19 smithi172 ceph-mon[33377]: pgmap v5001: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 572 KiB/s wr, 19 op/s 2024-05-08T09:23:20.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:19 smithi194 ceph-mon[33679]: pgmap v5001: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 554 KiB/s rd, 572 KiB/s wr, 19 op/s 2024-05-08T09:23:21.378 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dmc.o 2024-05-08T09:23:21.457 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dpio_phy.o 2024-05-08T09:23:21.878 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dpll.o 2024-05-08T09:23:21.955 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dpll_mgr.o 2024-05-08T09:23:22.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:21 smithi070 ceph-mon[29591]: pgmap v5002: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 443 KiB/s wr, 25 op/s 2024-05-08T09:23:22.132 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dpt.o 2024-05-08T09:23:22.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:21 smithi172 ceph-mon[33377]: pgmap v5002: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 443 KiB/s wr, 25 op/s 2024-05-08T09:23:22.182 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_drrs.o 2024-05-08T09:23:22.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:21 smithi194 ceph-mon[33679]: pgmap v5002: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 443 KiB/s wr, 25 op/s 2024-05-08T09:23:22.284 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dsb.o 2024-05-08T09:23:22.339 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_fb.o 2024-05-08T09:23:24.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:23 smithi070 ceph-mon[29591]: pgmap v5003: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 393 KiB/s wr, 22 op/s 2024-05-08T09:23:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:23 smithi172 ceph-mon[33377]: pgmap v5003: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 393 KiB/s wr, 22 op/s 2024-05-08T09:23:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:23 smithi194 ceph-mon[33679]: pgmap v5003: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 393 KiB/s wr, 22 op/s 2024-05-08T09:23:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:24 smithi070 ceph-mon[29591]: pgmap v5004: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 699 KiB/s wr, 27 op/s 2024-05-08T09:23:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:24 smithi172 ceph-mon[33377]: pgmap v5004: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 699 KiB/s wr, 27 op/s 2024-05-08T09:23:25.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:24 smithi194 ceph-mon[33679]: pgmap v5004: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 699 KiB/s wr, 27 op/s 2024-05-08T09:23:28.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:27 smithi070 ceph-mon[29591]: pgmap v5005: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 461 KiB/s wr, 21 op/s 2024-05-08T09:23:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:27 smithi172 ceph-mon[33377]: pgmap v5005: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 461 KiB/s wr, 21 op/s 2024-05-08T09:23:28.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:27 smithi194 ceph-mon[33679]: pgmap v5005: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 461 KiB/s wr, 21 op/s 2024-05-08T09:23:30.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:29 smithi070 ceph-mon[29591]: pgmap v5006: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 518 KiB/s wr, 27 op/s 2024-05-08T09:23:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:29 smithi172 ceph-mon[33377]: pgmap v5006: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 518 KiB/s wr, 27 op/s 2024-05-08T09:23:30.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:29 smithi194 ceph-mon[33679]: pgmap v5006: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 458 KiB/s rd, 518 KiB/s wr, 27 op/s 2024-05-08T09:23:32.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:31 smithi070 ceph-mon[29591]: pgmap v5007: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 487 KiB/s wr, 29 op/s 2024-05-08T09:23:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:31 smithi172 ceph-mon[33377]: pgmap v5007: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 487 KiB/s wr, 29 op/s 2024-05-08T09:23:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:31 smithi194 ceph-mon[33679]: pgmap v5007: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 487 KiB/s wr, 29 op/s 2024-05-08T09:23:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:33 smithi070 ceph-mon[29591]: pgmap v5008: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 442 KiB/s wr, 19 op/s 2024-05-08T09:23:34.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:33 smithi172 ceph-mon[33377]: pgmap v5008: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 442 KiB/s wr, 19 op/s 2024-05-08T09:23:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:33 smithi194 ceph-mon[33679]: pgmap v5008: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 436 KiB/s rd, 442 KiB/s wr, 19 op/s 2024-05-08T09:23:34.328 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_fb_pin.o 2024-05-08T09:23:35.920 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_fbc.o 2024-05-08T09:23:36.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:35 smithi070 ceph-mon[29591]: pgmap v5009: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 719 KiB/s wr, 26 op/s 2024-05-08T09:23:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:35 smithi172 ceph-mon[33377]: pgmap v5009: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 719 KiB/s wr, 26 op/s 2024-05-08T09:23:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:35 smithi194 ceph-mon[33679]: pgmap v5009: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 719 KiB/s wr, 26 op/s 2024-05-08T09:23:37.012 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_fdi.o 2024-05-08T09:23:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:36 smithi172 ceph-mon[33377]: pgmap v5010: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 390 KiB/s wr, 19 op/s 2024-05-08T09:23:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:36 smithi194 ceph-mon[33679]: pgmap v5010: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 390 KiB/s wr, 19 op/s 2024-05-08T09:23:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:36 smithi070 ceph-mon[29591]: pgmap v5010: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 390 KiB/s wr, 19 op/s 2024-05-08T09:23:38.106 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_fifo_underrun.o 2024-05-08T09:23:38.119 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_frontbuffer.o 2024-05-08T09:23:38.127 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_global_state.o 2024-05-08T09:23:38.131 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_hdcp.o 2024-05-08T09:23:38.387 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_hdcp_gsc.o 2024-05-08T09:23:40.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:39 smithi070 ceph-mon[29591]: pgmap v5011: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 449 KiB/s wr, 25 op/s 2024-05-08T09:23:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:39 smithi172 ceph-mon[33377]: pgmap v5011: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 449 KiB/s wr, 25 op/s 2024-05-08T09:23:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:39 smithi194 ceph-mon[33679]: pgmap v5011: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 449 KiB/s wr, 25 op/s 2024-05-08T09:23:42.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:41 smithi070 ceph-mon[29591]: pgmap v5012: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 702 KiB/s wr, 25 op/s 2024-05-08T09:23:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:41 smithi172 ceph-mon[33377]: pgmap v5012: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 702 KiB/s wr, 25 op/s 2024-05-08T09:23:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:41 smithi194 ceph-mon[33679]: pgmap v5012: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 702 KiB/s wr, 25 op/s 2024-05-08T09:23:44.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:43 smithi070 ceph-mon[29591]: pgmap v5013: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 646 KiB/s wr, 18 op/s 2024-05-08T09:23:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:43 smithi172 ceph-mon[33377]: pgmap v5013: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 646 KiB/s wr, 18 op/s 2024-05-08T09:23:44.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:43 smithi194 ceph-mon[33679]: pgmap v5013: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 578 KiB/s rd, 646 KiB/s wr, 18 op/s 2024-05-08T09:23:46.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:45 smithi070 ceph-mon[29591]: pgmap v5014: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 959 KiB/s wr, 27 op/s 2024-05-08T09:23:46.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:45 smithi172 ceph-mon[33377]: pgmap v5014: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 959 KiB/s wr, 27 op/s 2024-05-08T09:23:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:45 smithi194 ceph-mon[33679]: pgmap v5014: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 959 KiB/s wr, 27 op/s 2024-05-08T09:23:48.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:47 smithi070 ceph-mon[29591]: pgmap v5015: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 681 KiB/s wr, 21 op/s 2024-05-08T09:23:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:47 smithi172 ceph-mon[33377]: pgmap v5015: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 681 KiB/s wr, 21 op/s 2024-05-08T09:23:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:47 smithi194 ceph-mon[33679]: pgmap v5015: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 681 KiB/s wr, 21 op/s 2024-05-08T09:23:48.876 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_hotplug.o 2024-05-08T09:23:49.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:48 smithi172 ceph-mon[33377]: pgmap v5016: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 791 KiB/s wr, 24 op/s 2024-05-08T09:23:49.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:48 smithi194 ceph-mon[33679]: pgmap v5016: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 791 KiB/s wr, 24 op/s 2024-05-08T09:23:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:48 smithi070 ceph-mon[29591]: pgmap v5016: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 758 KiB/s rd, 791 KiB/s wr, 24 op/s 2024-05-08T09:23:51.362 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_hotplug_irq.o 2024-05-08T09:23:51.649 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_hti.o 2024-05-08T09:23:52.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:51 smithi070 ceph-mon[29591]: pgmap v5017: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 838 KiB/s wr, 21 op/s 2024-05-08T09:23:52.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:51 smithi172 ceph-mon[33377]: pgmap v5017: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 838 KiB/s wr, 21 op/s 2024-05-08T09:23:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:51 smithi194 ceph-mon[33679]: pgmap v5017: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 838 KiB/s wr, 21 op/s 2024-05-08T09:23:52.295 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_load_detect.o 2024-05-08T09:23:52.546 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_lpe_audio.o 2024-05-08T09:23:52.699 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_modeset_lock.o 2024-05-08T09:23:52.792 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_modeset_verify.o 2024-05-08T09:23:53.271 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_modeset_setup.o 2024-05-08T09:23:54.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:53 smithi070 ceph-mon[29591]: pgmap v5018: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 529 KiB/s wr, 16 op/s 2024-05-08T09:23:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:53 smithi172 ceph-mon[33377]: pgmap v5018: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 529 KiB/s wr, 16 op/s 2024-05-08T09:23:54.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:53 smithi194 ceph-mon[33679]: pgmap v5018: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 450 KiB/s rd, 529 KiB/s wr, 16 op/s 2024-05-08T09:23:56.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:55 smithi070 ceph-mon[29591]: pgmap v5019: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 931 KiB/s wr, 31 op/s 2024-05-08T09:23:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:55 smithi172 ceph-mon[33377]: pgmap v5019: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 931 KiB/s wr, 31 op/s 2024-05-08T09:23:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:55 smithi194 ceph-mon[33679]: pgmap v5019: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 931 KiB/s wr, 31 op/s 2024-05-08T09:23:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:57 smithi070 ceph-mon[29591]: pgmap v5020: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 619 KiB/s wr, 21 op/s 2024-05-08T09:23:58.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:57 smithi172 ceph-mon[33377]: pgmap v5020: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 619 KiB/s wr, 21 op/s 2024-05-08T09:23:58.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:57 smithi194 ceph-mon[33679]: pgmap v5020: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 698 KiB/s rd, 619 KiB/s wr, 21 op/s 2024-05-08T09:24:00.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:23:59 smithi070 ceph-mon[29591]: pgmap v5021: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 619 KiB/s wr, 25 op/s 2024-05-08T09:24:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:23:59 smithi172 ceph-mon[33377]: pgmap v5021: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 619 KiB/s wr, 25 op/s 2024-05-08T09:24:00.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:23:59 smithi194 ceph-mon[33679]: pgmap v5021: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 619 KiB/s wr, 25 op/s 2024-05-08T09:24:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:00 smithi172 ceph-mon[33377]: pgmap v5022: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 805 KiB/s wr, 26 op/s 2024-05-08T09:24:01.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:00 smithi194 ceph-mon[33679]: pgmap v5022: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 805 KiB/s wr, 26 op/s 2024-05-08T09:24:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:00 smithi070 ceph-mon[29591]: pgmap v5022: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 805 KiB/s wr, 26 op/s 2024-05-08T09:24:04.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:03 smithi070 ceph-mon[29591]: pgmap v5023: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 698 KiB/s wr, 23 op/s 2024-05-08T09:24:04.157 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_overlay.o 2024-05-08T09:24:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:03 smithi172 ceph-mon[33377]: pgmap v5023: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 698 KiB/s wr, 23 op/s 2024-05-08T09:24:04.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:03 smithi194 ceph-mon[33679]: pgmap v5023: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 698 KiB/s wr, 23 op/s 2024-05-08T09:24:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:04 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:24:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:04 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:24:05.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:04 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:24:05.716 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_pch_display.o 2024-05-08T09:24:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:05 smithi070 ceph-mon[29591]: pgmap v5024: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 1.1 MiB/s wr, 50 op/s 2024-05-08T09:24:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:24:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:24:06.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:05 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:24:06.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:05 smithi172 ceph-mon[33377]: pgmap v5024: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 1.1 MiB/s wr, 50 op/s 2024-05-08T09:24:06.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:24:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:24:06.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:05 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:24:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:05 smithi194 ceph-mon[33679]: pgmap v5024: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 1.1 MiB/s wr, 50 op/s 2024-05-08T09:24:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:24:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:24:06.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:05 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:24:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:06 smithi172 ceph-mon[33377]: pgmap v5025: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 695 KiB/s wr, 35 op/s 2024-05-08T09:24:07.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:06 smithi194 ceph-mon[33679]: pgmap v5025: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 695 KiB/s wr, 35 op/s 2024-05-08T09:24:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:06 smithi070 ceph-mon[29591]: pgmap v5025: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 695 KiB/s wr, 35 op/s 2024-05-08T09:24:07.568 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_pch_refclk.o 2024-05-08T09:24:07.740 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_plane_initial.o 2024-05-08T09:24:07.871 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_pmdemand.o 2024-05-08T09:24:08.242 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_psr.o 2024-05-08T09:24:08.424 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_quirks.o 2024-05-08T09:24:09.629 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_sprite.o 2024-05-08T09:24:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:09 smithi070 ceph-mon[29591]: osdmap e391: 12 total, 12 up, 12 in 2024-05-08T09:24:09.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:09 smithi070 ceph-mon[29591]: pgmap v5027: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 858 KiB/s wr, 43 op/s 2024-05-08T09:24:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:09 smithi172 ceph-mon[33377]: osdmap e391: 12 total, 12 up, 12 in 2024-05-08T09:24:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:09 smithi172 ceph-mon[33377]: pgmap v5027: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 858 KiB/s wr, 43 op/s 2024-05-08T09:24:09.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:09 smithi194 ceph-mon[33679]: osdmap e391: 12 total, 12 up, 12 in 2024-05-08T09:24:09.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:09 smithi194 ceph-mon[33679]: pgmap v5027: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 858 KiB/s wr, 43 op/s 2024-05-08T09:24:12.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:11 smithi070 ceph-mon[29591]: pgmap v5028: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 827 KiB/s wr, 44 op/s 2024-05-08T09:24:12.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:11 smithi070 ceph-mon[29591]: osdmap e392: 12 total, 12 up, 12 in 2024-05-08T09:24:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:11 smithi172 ceph-mon[33377]: pgmap v5028: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 827 KiB/s wr, 44 op/s 2024-05-08T09:24:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:11 smithi172 ceph-mon[33377]: osdmap e392: 12 total, 12 up, 12 in 2024-05-08T09:24:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:11 smithi194 ceph-mon[33679]: pgmap v5028: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 536 KiB/s rd, 827 KiB/s wr, 44 op/s 2024-05-08T09:24:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:11 smithi194 ceph-mon[33679]: osdmap e392: 12 total, 12 up, 12 in 2024-05-08T09:24:14.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:13 smithi070 ceph-mon[29591]: pgmap v5030: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 433 KiB/s wr, 14 op/s 2024-05-08T09:24:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:13 smithi172 ceph-mon[33377]: pgmap v5030: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 433 KiB/s wr, 14 op/s 2024-05-08T09:24:14.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:13 smithi194 ceph-mon[33679]: pgmap v5030: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 433 KiB/s wr, 14 op/s 2024-05-08T09:24:16.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:15 smithi070 ceph-mon[29591]: pgmap v5031: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 904 KiB/s wr, 26 op/s 2024-05-08T09:24:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:15 smithi172 ceph-mon[33377]: pgmap v5031: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 904 KiB/s wr, 26 op/s 2024-05-08T09:24:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:15 smithi194 ceph-mon[33679]: pgmap v5031: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 904 KiB/s wr, 26 op/s 2024-05-08T09:24:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:17 smithi070 ceph-mon[29591]: pgmap v5032: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 849 KiB/s wr, 24 op/s 2024-05-08T09:24:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:17 smithi172 ceph-mon[33377]: pgmap v5032: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 849 KiB/s wr, 24 op/s 2024-05-08T09:24:18.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:17 smithi194 ceph-mon[33679]: pgmap v5032: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 849 KiB/s wr, 24 op/s 2024-05-08T09:24:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:18 smithi172 ceph-mon[33377]: pgmap v5033: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 872 KiB/s wr, 20 op/s 2024-05-08T09:24:19.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:18 smithi194 ceph-mon[33679]: pgmap v5033: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 872 KiB/s wr, 20 op/s 2024-05-08T09:24:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:18 smithi070 ceph-mon[29591]: pgmap v5033: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 872 KiB/s wr, 20 op/s 2024-05-08T09:24:19.849 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_sprite_uapi.o 2024-05-08T09:24:20.970 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_tc.o 2024-05-08T09:24:22.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:21 smithi070 ceph-mon[29591]: pgmap v5034: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 680 KiB/s wr, 17 op/s 2024-05-08T09:24:22.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:21 smithi172 ceph-mon[33377]: pgmap v5034: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 680 KiB/s wr, 17 op/s 2024-05-08T09:24:22.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:21 smithi194 ceph-mon[33679]: pgmap v5034: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 945 KiB/s rd, 680 KiB/s wr, 17 op/s 2024-05-08T09:24:23.343 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_vblank.o 2024-05-08T09:24:23.480 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_vga.o 2024-05-08T09:24:23.954 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_wm.o 2024-05-08T09:24:24.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:23 smithi070 ceph-mon[29591]: pgmap v5035: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 603 KiB/s wr, 15 op/s 2024-05-08T09:24:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:23 smithi172 ceph-mon[33377]: pgmap v5035: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 603 KiB/s wr, 15 op/s 2024-05-08T09:24:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:23 smithi194 ceph-mon[33679]: pgmap v5035: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 603 KiB/s wr, 15 op/s 2024-05-08T09:24:24.369 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/i9xx_plane.o 2024-05-08T09:24:25.125 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/i9xx_wm.o 2024-05-08T09:24:25.807 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/skl_scaler.o 2024-05-08T09:24:26.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:25 smithi070 ceph-mon[29591]: pgmap v5036: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 962 KiB/s wr, 26 op/s 2024-05-08T09:24:26.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:25 smithi172 ceph-mon[33377]: pgmap v5036: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 962 KiB/s wr, 26 op/s 2024-05-08T09:24:26.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:25 smithi194 ceph-mon[33679]: pgmap v5036: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 962 KiB/s wr, 26 op/s 2024-05-08T09:24:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:26 smithi172 ceph-mon[33377]: pgmap v5037: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 647 KiB/s wr, 18 op/s 2024-05-08T09:24:27.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:26 smithi194 ceph-mon[33679]: pgmap v5037: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 647 KiB/s wr, 18 op/s 2024-05-08T09:24:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:26 smithi070 ceph-mon[29591]: pgmap v5037: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 647 KiB/s wr, 18 op/s 2024-05-08T09:24:30.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:29 smithi070 ceph-mon[29591]: pgmap v5038: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 886 KiB/s wr, 23 op/s 2024-05-08T09:24:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:29 smithi172 ceph-mon[33377]: pgmap v5038: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 886 KiB/s wr, 23 op/s 2024-05-08T09:24:30.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:29 smithi194 ceph-mon[33679]: pgmap v5038: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 886 KiB/s wr, 23 op/s 2024-05-08T09:24:32.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:31 smithi070 ceph-mon[29591]: pgmap v5039: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 748 KiB/s wr, 21 op/s 2024-05-08T09:24:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:31 smithi172 ceph-mon[33377]: pgmap v5039: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 748 KiB/s wr, 21 op/s 2024-05-08T09:24:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:31 smithi194 ceph-mon[33679]: pgmap v5039: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 748 KiB/s wr, 21 op/s 2024-05-08T09:24:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:33 smithi070 ceph-mon[29591]: pgmap v5040: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 640 KiB/s wr, 17 op/s 2024-05-08T09:24:34.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:33 smithi172 ceph-mon[33377]: pgmap v5040: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 640 KiB/s wr, 17 op/s 2024-05-08T09:24:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:33 smithi194 ceph-mon[33679]: pgmap v5040: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 627 KiB/s rd, 640 KiB/s wr, 17 op/s 2024-05-08T09:24:34.586 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/skl_universal_plane.o 2024-05-08T09:24:35.506 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.9 2024-05-08T09:24:35.507 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:24:36.094 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:24:36.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:35 smithi070 ceph-mon[29591]: pgmap v5041: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2024-05-08T09:24:36.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:35 smithi172 ceph-mon[33377]: pgmap v5041: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2024-05-08T09:24:36.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:35 smithi194 ceph-mon[33679]: pgmap v5041: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 30 op/s 2024-05-08T09:24:36.748 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/skl_watermark.o 2024-05-08T09:24:36.965 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_acpi.o 2024-05-08T09:24:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:36 smithi070 ceph-mon[29591]: pgmap v5042: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 797 KiB/s wr, 19 op/s 2024-05-08T09:24:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:36 smithi172 ceph-mon[33377]: pgmap v5042: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 797 KiB/s wr, 19 op/s 2024-05-08T09:24:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:36 smithi194 ceph-mon[33679]: pgmap v5042: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 846 KiB/s rd, 797 KiB/s wr, 19 op/s 2024-05-08T09:24:38.782 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_opregion.o 2024-05-08T09:24:38.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.908+0000 7f6d5d800700 1 -- 172.21.15.70:0/3570974341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103f20 msgr2=0x7f6d58110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:38.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.908+0000 7f6d5d800700 1 --2- 172.21.15.70:0/3570974341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103f20 0x7f6d58110310 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f6d480099c0 tx=0x7f6d48009cd0 comp rx=0 tx=0).stop 2024-05-08T09:24:38.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.908+0000 7f6d5d800700 1 -- 172.21.15.70:0/3570974341 shutdown_connections 2024-05-08T09:24:38.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.908+0000 7f6d5d800700 1 --2- 172.21.15.70:0/3570974341 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103f20 0x7f6d58110310 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:38.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.908+0000 7f6d5d800700 1 --2- 172.21.15.70:0/3570974341 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58109540 0x7f6d58109920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:38.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.908+0000 7f6d5d800700 1 --2- 172.21.15.70:0/3570974341 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d58103560 0x7f6d581039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:38.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.908+0000 7f6d5d800700 1 -- 172.21.15.70:0/3570974341 >> 172.21.15.70:0/3570974341 conn(0x7f6d5807a660 msgr2=0x7f6d5807aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:38.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.908+0000 7f6d5d800700 1 -- 172.21.15.70:0/3570974341 shutdown_connections 2024-05-08T09:24:38.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.908+0000 7f6d5d800700 1 -- 172.21.15.70:0/3570974341 wait complete. 2024-05-08T09:24:38.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.910+0000 7f6d5d800700 1 Processor -- start 2024-05-08T09:24:38.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.910+0000 7f6d5d800700 1 -- start start 2024-05-08T09:24:38.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d5d800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103560 0x7f6d581a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:38.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d5d800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58103f20 0x7f6d581a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:38.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d5d800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d58109540 0x7f6d5810f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:38.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d5d800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d58113520 con 0x7f6d58103560 2024-05-08T09:24:38.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d5d800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581133a0 con 0x7f6d58103f20 2024-05-08T09:24:38.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d5d800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6d581136a0 con 0x7f6d58109540 2024-05-08T09:24:38.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d56a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103560 0x7f6d581a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:38.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d56a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103560 0x7f6d581a5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41430/0 (socket says 172.21.15.70:41430) 2024-05-08T09:24:38.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d56a00700 1 -- 172.21.15.70:0/4086719248 learned_addr learned my addr 172.21.15.70:0/4086719248 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:24:38.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.911+0000 7f6d56000700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58103f20 0x7f6d581a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:38.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.912+0000 7f6d57400700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d58109540 0x7f6d5810f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:38.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.912+0000 7f6d56a00700 1 -- 172.21.15.70:0/4086719248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d58109540 msgr2=0x7f6d5810f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:38.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.912+0000 7f6d56a00700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d58109540 0x7f6d5810f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:38.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.912+0000 7f6d56a00700 1 -- 172.21.15.70:0/4086719248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58103f20 msgr2=0x7f6d581a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:38.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.912+0000 7f6d56a00700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58103f20 0x7f6d581a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:38.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.912+0000 7f6d56a00700 1 -- 172.21.15.70:0/4086719248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5810fe80 con 0x7f6d58103560 2024-05-08T09:24:38.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.913+0000 7f6d56a00700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103560 0x7f6d581a5d80 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f6d500060b0 tx=0x7f6d5000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:38.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.913+0000 7f6d4f400700 1 -- 172.21.15.70:0/4086719248 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5001a070 con 0x7f6d58103560 2024-05-08T09:24:38.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.913+0000 7f6d4f400700 1 -- 172.21.15.70:0/4086719248 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d5000dd20 con 0x7f6d58103560 2024-05-08T09:24:38.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.913+0000 7f6d4f400700 1 -- 172.21.15.70:0/4086719248 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d50014600 con 0x7f6d58103560 2024-05-08T09:24:38.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.913+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d58110110 con 0x7f6d58103560 2024-05-08T09:24:38.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.913+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d581acd40 con 0x7f6d58103560 2024-05-08T09:24:38.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.915+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d58104bb0 con 0x7f6d58103560 2024-05-08T09:24:38.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.919+0000 7f6d4f400700 1 -- 172.21.15.70:0/4086719248 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6d5001d070 con 0x7f6d58103560 2024-05-08T09:24:38.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.921+0000 7f6d4f400700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:38.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.921+0000 7f6d4f400700 1 -- 172.21.15.70:0/4086719248 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(392..392 src has 1..392) ==== 9583+0+0 (secure 0 0 0) 0x7f6d500e2310 con 0x7f6d58103560 2024-05-08T09:24:38.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.922+0000 7f6d56000700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:38.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.923+0000 7f6d56000700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6d581a1220 tx=0x7f6d4400b410 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:38.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:38.926+0000 7f6d4f400700 1 -- 172.21.15.70:0/4086719248 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6d50010070 con 0x7f6d58103560 2024-05-08T09:24:39.301 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/dvo_ch7017.o 2024-05-08T09:24:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.381+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d5802e510 con 0x7f6d58103560 2024-05-08T09:24:39.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.383+0000 7f6d4f400700 1 -- 172.21.15.70:0/4086719248 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f6d500a9280 con 0x7f6d58103560 2024-05-08T09:24:39.383 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:24:39.383 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:24:39.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.386+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 msgr2=0x7f6d3c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:39.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.386+0000 7f6d5d800700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6d581a1220 tx=0x7f6d4400b410 comp rx=0 tx=0).stop 2024-05-08T09:24:39.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.386+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103560 msgr2=0x7f6d581a5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:39.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.386+0000 7f6d5d800700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103560 0x7f6d581a5d80 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f6d500060b0 tx=0x7f6d5000d3b0 comp rx=0 tx=0).stop 2024-05-08T09:24:39.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.386+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 shutdown_connections 2024-05-08T09:24:39.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.386+0000 7f6d5d800700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:39.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.386+0000 7f6d5d800700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d58109540 0x7f6d5810f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:39.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.386+0000 7f6d5d800700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d58103560 0x7f6d581a5d80 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:39.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.386+0000 7f6d5d800700 1 --2- 172.21.15.70:0/4086719248 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d58103f20 0x7f6d581a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:39.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.387+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 >> 172.21.15.70:0/4086719248 conn(0x7f6d5807a660 msgr2=0x7f6d58075eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:39.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.387+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 shutdown_connections 2024-05-08T09:24:39.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:39.387+0000 7f6d5d800700 1 -- 172.21.15.70:0/4086719248 wait complete. 2024-05-08T09:24:39.388 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:24:39.705 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/dvo_ch7xxx.o 2024-05-08T09:24:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:39 smithi070 ceph-mon[29591]: pgmap v5043: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 33 op/s 2024-05-08T09:24:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4086719248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:24:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:39 smithi172 ceph-mon[33377]: pgmap v5043: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 33 op/s 2024-05-08T09:24:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4086719248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:24:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:39 smithi194 ceph-mon[33679]: pgmap v5043: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 33 op/s 2024-05-08T09:24:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4086719248' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:24:40.805 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/dvo_ivch.o 2024-05-08T09:24:41.189 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 92.9 --await-for 42.0' 2024-05-08T09:24:41.189 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 92.9 --await-for 42.0 2024-05-08T09:24:41.569 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/dvo_ns2501.o 2024-05-08T09:24:41.951 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:24:42.117 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:41 smithi070 ceph-mon[29591]: pgmap v5044: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 867 KiB/s wr, 30 op/s 2024-05-08T09:24:42.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:41 smithi172 ceph-mon[33377]: pgmap v5044: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 867 KiB/s wr, 30 op/s 2024-05-08T09:24:42.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:41 smithi194 ceph-mon[33679]: pgmap v5044: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 934 KiB/s rd, 867 KiB/s wr, 30 op/s 2024-05-08T09:24:44.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:43 smithi070 ceph-mon[29591]: pgmap v5045: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 861 KiB/s wr, 29 op/s 2024-05-08T09:24:44.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:43 smithi172 ceph-mon[33377]: pgmap v5045: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 861 KiB/s wr, 29 op/s 2024-05-08T09:24:44.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:43 smithi194 ceph-mon[33679]: pgmap v5045: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 931 KiB/s rd, 861 KiB/s wr, 29 op/s 2024-05-08T09:24:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:44 smithi172 ceph-mon[33377]: pgmap v5046: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 38 op/s 2024-05-08T09:24:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:44 smithi194 ceph-mon[33679]: pgmap v5046: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 38 op/s 2024-05-08T09:24:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:44 smithi070 ceph-mon[29591]: pgmap v5046: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 38 op/s 2024-05-08T09:24:48.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:47 smithi070 ceph-mon[29591]: pgmap v5047: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 677 KiB/s wr, 25 op/s 2024-05-08T09:24:48.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:47 smithi172 ceph-mon[33377]: pgmap v5047: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 677 KiB/s wr, 25 op/s 2024-05-08T09:24:48.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:47 smithi194 ceph-mon[33679]: pgmap v5047: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 782 KiB/s rd, 677 KiB/s wr, 25 op/s 2024-05-08T09:24:50.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:49 smithi070 ceph-mon[29591]: pgmap v5048: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 862 KiB/s wr, 31 op/s 2024-05-08T09:24:50.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:49 smithi172 ceph-mon[33377]: pgmap v5048: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 862 KiB/s wr, 31 op/s 2024-05-08T09:24:50.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:49 smithi194 ceph-mon[33679]: pgmap v5048: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 862 KiB/s wr, 31 op/s 2024-05-08T09:24:51.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.115+0000 7fd0be000700 1 -- 172.21.15.70:0/4228396736 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8009480 con 0x7fd0c010fb80 2024-05-08T09:24:51.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:50 smithi070 ceph-mon[29591]: pgmap v5049: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 556 KiB/s wr, 16 op/s 2024-05-08T09:24:51.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.116+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4228396736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c010fb80 msgr2=0x7fd0c0111f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.116+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4228396736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c010fb80 0x7fd0c0111f90 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800b0a0 tx=0x7fd0b800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.117+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4228396736 shutdown_connections 2024-05-08T09:24:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.117+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4228396736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c010fb80 0x7fd0c0111f90 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.117+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4228396736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0c0075870 0x7fd0c0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.117+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4228396736 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c0076190 0x7fd0c010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.117+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4228396736 >> 172.21.15.70:0/4228396736 conn(0x7fd0c00fee50 msgr2=0x7fd0c0101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.118+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4228396736 shutdown_connections 2024-05-08T09:24:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.119+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4228396736 wait complete. 2024-05-08T09:24:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.120+0000 7fd0c4c00700 1 Processor -- start 2024-05-08T09:24:51.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.121+0000 7fd0c4c00700 1 -- start start 2024-05-08T09:24:51.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.121+0000 7fd0c4c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c0075870 0x7fd0c01a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.121+0000 7fd0c4c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0c0076190 0x7fd0c01a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.121+0000 7fd0c4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c010fb80 0x7fd0c010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.121+0000 7fd0c4c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c0104730 con 0x7fd0c010fb80 2024-05-08T09:24:51.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.121+0000 7fd0c4c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01045b0 con 0x7fd0c0075870 2024-05-08T09:24:51.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.121+0000 7fd0c4c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01048b0 con 0x7fd0c0076190 2024-05-08T09:24:51.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.122+0000 7fd0bf400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c0075870 0x7fd0c01a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.122+0000 7fd0bf400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c0075870 0x7fd0c01a5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:44054/0 (socket says 172.21.15.70:44054) 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.122+0000 7fd0bf400700 1 -- 172.21.15.70:0/4260654160 learned_addr learned my addr 172.21.15.70:0/4260654160 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.122+0000 7fd0bea00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0c0076190 0x7fd0c01a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.123+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c010fb80 0x7fd0c010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.123+0000 7fd0bf400700 1 -- 172.21.15.70:0/4260654160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0c0076190 msgr2=0x7fd0c01a60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.123+0000 7fd0bf400700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0c0076190 0x7fd0c01a60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.123+0000 7fd0bf400700 1 -- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c010fb80 msgr2=0x7fd0c010e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.123+0000 7fd0bf400700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c010fb80 0x7fd0c010e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.123+0000 7fd0bf400700 1 -- 172.21.15.70:0/4260654160 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c010ea90 con 0x7fd0c0075870 2024-05-08T09:24:51.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.123+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c010fb80 0x7fd0c010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:24:51.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.124+0000 7fd0bf400700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c0075870 0x7fd0c01a5b90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c920 tx=0x7fd0a800cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:51.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.124+0000 7fd0b7e00700 1 -- 172.21.15.70:0/4260654160 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8007b00 con 0x7fd0c0075870 2024-05-08T09:24:51.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.124+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4260654160 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c010ed20 con 0x7fd0c0075870 2024-05-08T09:24:51.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.124+0000 7fd0b7e00700 1 -- 172.21.15.70:0/4260654160 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0a8004cc0 con 0x7fd0c0075870 2024-05-08T09:24:51.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.124+0000 7fd0b7e00700 1 -- 172.21.15.70:0/4260654160 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a80053f0 con 0x7fd0c0075870 2024-05-08T09:24:51.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.125+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4260654160 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c01ac9f0 con 0x7fd0c0075870 2024-05-08T09:24:51.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.132+0000 7fd0b7e00700 1 -- 172.21.15.70:0/4260654160 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd0a8004750 con 0x7fd0c0075870 2024-05-08T09:24:51.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.135+0000 7fd0b7e00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd0a40b2b20 0x7fd0a40b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.135+0000 7fd0b7e00700 1 -- 172.21.15.70:0/4260654160 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(392..392 src has 1..392) ==== 9583+0+0 (secure 0 0 0) 0x7fd0a80e2520 con 0x7fd0c0075870 2024-05-08T09:24:51.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.135+0000 7fd0bea00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd0a40b2b20 0x7fd0a40b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.136+0000 7fd0bea00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd0a40b2b20 0x7fd0a40b4fe0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd0c01028e0 tx=0x7fd0b0009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:51.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.146+0000 7fd0d0af4b80 1 Processor -- start 2024-05-08T09:24:51.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.146+0000 7fd0d0af4b80 1 -- start start 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.146+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x56196789f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.146+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 0x561967899520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.146+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x561967899fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.146+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5619677ebbb0 con 0x561967899b40 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.146+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5619677898f0 con 0x56196789f910 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.146+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5619677e7b70 con 0x56196789eff0 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x561967899fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x561967899fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45220/0 (socket says 172.21.15.70:45220) 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bfe00700 1 -- 172.21.15.70:0/1556222976 learned_addr learned my addr 172.21.15.70:0/1556222976 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bf400700 1 --2- 172.21.15.70:0/1556222976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x56196789f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bea00700 1 --2- 172.21.15.70:0/1556222976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 0x561967899520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bfe00700 1 -- 172.21.15.70:0/1556222976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 msgr2=0x56196789f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:24:51.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/1556222976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x56196789f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bfe00700 1 -- 172.21.15.70:0/1556222976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 msgr2=0x561967899520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:24:51.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/1556222976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 0x561967899520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.147+0000 7fd0bfe00700 1 -- 172.21.15.70:0/1556222976 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561967738a60 con 0x561967899b40 2024-05-08T09:24:51.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.148+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/1556222976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x561967899fa0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800b070 tx=0x7fd0b8009df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a12c77e658faf2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.148+0000 7fd0b4c00700 1 -- 172.21.15.70:0/1556222976 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8021070 con 0x561967899b40 2024-05-08T09:24:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.148+0000 7fd0b4c00700 1 -- 172.21.15.70:0/1556222976 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0b800bcb0 con 0x561967899b40 2024-05-08T09:24:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.148+0000 7fd0b4c00700 1 -- 172.21.15.70:0/1556222976 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8007c70 con 0x561967899b40 2024-05-08T09:24:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.149+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/1556222976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 msgr2=0x561967899fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.149+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/1556222976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x561967899fa0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800b070 tx=0x7fd0b8009df0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.149+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/1556222976 shutdown_connections 2024-05-08T09:24:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.149+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/1556222976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x561967899fa0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.149+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/1556222976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x56196789f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.149+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/1556222976 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 0x561967899520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.149+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/1556222976 >> 172.21.15.70:0/1556222976 conn(0x5619677c7cf0 msgr2=0x561967894080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.149+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/1556222976 shutdown_connections 2024-05-08T09:24:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.149+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/1556222976 wait complete. 2024-05-08T09:24:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.150+0000 7fd0d0af4b80 1 -- start start 2024-05-08T09:24:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.150+0000 7fd0d0af4b80 1 Processor -- start 2024-05-08T09:24:51.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.150+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 0x5619678a5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.150+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x5619678a2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.150+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789f910 0x5619678a2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.150+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5619678a63d0 con 0x56196789f910 2024-05-08T09:24:51.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.150+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561967751cb0 con 0x561967899b40 2024-05-08T09:24:51.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.150+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5619678a6550 con 0x56196789eff0 2024-05-08T09:24:51.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0d0af4b80 10 client.0 _ll_register_callbacks cb 0x561967792e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789f910 0x5619678a2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789f910 0x5619678a2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45234/0 (socket says 172.21.15.70:45234) 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bfe00700 1 -- 172.21.15.70:0/263201635 learned_addr learned my addr 172.21.15.70:0/263201635 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bea00700 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x5619678a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bfe00700 1 -- 172.21.15.70:0/263201635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 msgr2=0x5619678a2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x5619678a2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bf400700 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 0x5619678a5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bfe00700 1 -- 172.21.15.70:0/263201635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 msgr2=0x5619678a5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 0x5619678a5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bfe00700 1 -- 172.21.15.70:0/263201635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619677b15b0 con 0x56196789f910 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.151+0000 7fd0bf400700 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 0x5619678a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.152+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789f910 0x5619678a2e50 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009a20 tx=0x7fd0b8004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7edce08bb2fa7fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.152+0000 7fd0ad600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:24:51.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.152+0000 7fd0ad600700 1 -- 172.21.15.70:0/263201635 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b802b070 con 0x56196789f910 2024-05-08T09:24:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.152+0000 7fd0ad600700 1 -- 172.21.15.70:0/263201635 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(392..392 src has 1..392) ==== 9583+0+0 (secure 0 0 0) 0x7fd0b8007ac0 con 0x56196789f910 2024-05-08T09:24:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.152+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/263201635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0b800bcb0 con 0x56196789f910 2024-05-08T09:24:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.152+0000 7fd0ad600700 1 -- 172.21.15.70:0/263201635 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fd0b8021050 con 0x56196789f910 2024-05-08T09:24:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.152+0000 7fd0d0af4b80 10 client.19473 fetch_fsmap learned FSMap version 42 2024-05-08T09:24:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.152+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/263201635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5619678b0af0 con 0x56196789f910 2024-05-08T09:24:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.153+0000 7fd0ad600700 1 -- 172.21.15.70:0/263201635 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0b800bcb0 con 0x56196789f910 2024-05-08T09:24:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.153+0000 7fd0ad600700 1 -- 172.21.15.70:0/263201635 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fd0b8011070 con 0x56196789f910 2024-05-08T09:24:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.153+0000 7fd0d0af4b80 10 client.19473 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:24:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.153+0000 7fd0d0af4b80 10 client.19473 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:24:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.153+0000 7fd0d0af4b80 20 client.19473 populate_metadata read hostname 'smithi070' 2024-05-08T09:24:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.153+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5619678b2fc0 0x5619678b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.153+0000 7fd0d0af4b80 4 client.19473 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:24:51.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.153+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/263201635 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561967866230 con 0x5619678b2fc0 2024-05-08T09:24:51.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.154+0000 7fd0bf400700 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5619678b2fc0 0x5619678b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.155+0000 7fd0bf400700 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5619678b2fc0 0x5619678b53b0 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b8a32ed4e02af77 server_cookie=6db16cb5ffec475f in_seq=0 out_seq=0 2024-05-08T09:24:51.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.155+0000 7fd0ad600700 10 client.19473 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:24:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0ad600700 1 -- 172.21.15.70:0/263201635 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561967866230 con 0x5619678b2fc0 2024-05-08T09:24:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0ad600700 10 client.19473 handle_command_reply: tid=0 2024-05-08T09:24:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 client.19473 shutdown 2024-05-08T09:24:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/263201635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789f910 msgr2=0x5619678a2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789f910 0x5619678a2e50 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009a20 tx=0x7fd0b8004db0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/263201635 shutdown_connections 2024-05-08T09:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5619678b2fc0 0x5619678b53b0 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789f910 0x5619678a2e50 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 0x5619678a5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/263201635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x5619678a2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/263201635 >> 172.21.15.70:0/263201635 conn(0x5619677c7cf0 msgr2=0x561967893f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0ad600700 0 client.19473 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/263201635 shutdown_connections 2024-05-08T09:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.157+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/263201635 wait complete. 2024-05-08T09:24:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.158+0000 7fd0d0af4b80 20 client.19473 trim_cache size 0 max 16384 2024-05-08T09:24:51.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:50 smithi172 ceph-mon[33377]: pgmap v5049: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 556 KiB/s wr, 16 op/s 2024-05-08T09:24:51.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.191+0000 7fd0d0af4b80 1 Processor -- start 2024-05-08T09:24:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.191+0000 7fd0d0af4b80 1 -- start start 2024-05-08T09:24:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.192+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 0x561967899520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.192+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789eff0 0x5619678a1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.192+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789f910 0x5619678a1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.192+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01b81b0 con 0x56196789eff0 2024-05-08T09:24:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.192+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01b5a40 con 0x561967899b40 2024-05-08T09:24:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.192+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01b38b0 con 0x56196789f910 2024-05-08T09:24:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.193+0000 7fd0bfe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789f910 0x5619678a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.193+0000 7fd0bea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789eff0 0x5619678a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.193+0000 7fd0bfe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789f910 0x5619678a1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:54242/0 (socket says 172.21.15.70:54242) 2024-05-08T09:24:51.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.193+0000 7fd0bfe00700 1 -- 172.21.15.70:0/4186773996 learned_addr learned my addr 172.21.15.70:0/4186773996 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:24:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.193+0000 7fd0bf400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 0x561967899520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.194+0000 7fd0bfe00700 1 -- 172.21.15.70:0/4186773996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 msgr2=0x561967899520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:24:51.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.194+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/4186773996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 0x561967899520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.194+0000 7fd0bfe00700 1 -- 172.21.15.70:0/4186773996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789eff0 msgr2=0x5619678a1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:24:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.194+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/4186773996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789eff0 0x5619678a1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.194+0000 7fd0bfe00700 1 -- 172.21.15.70:0/4186773996 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619678909b0 con 0x56196789f910 2024-05-08T09:24:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.194+0000 7fd0bea00700 1 --2- 172.21.15.70:0/4186773996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789eff0 0x5619678a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:24:51.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.195+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/4186773996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789f910 0x5619678a1740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8007880 tx=0x7fd0b8000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=157f7842f1636412 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:51.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.195+0000 7fd0afe00700 1 -- 172.21.15.70:0/4186773996 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b802b070 con 0x56196789f910 2024-05-08T09:24:51.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.195+0000 7fd0afe00700 1 -- 172.21.15.70:0/4186773996 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0b802eae0 con 0x56196789f910 2024-05-08T09:24:51.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.195+0000 7fd0afe00700 1 -- 172.21.15.70:0/4186773996 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0b802e360 con 0x56196789f910 2024-05-08T09:24:51.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.197+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/4186773996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789f910 msgr2=0x5619678a1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:51.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.197+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/4186773996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789f910 0x5619678a1740 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8007880 tx=0x7fd0b8000f40 comp rx=0 tx=0).stop 2024-05-08T09:24:51.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.197+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/4186773996 shutdown_connections 2024-05-08T09:24:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.197+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/4186773996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789f910 0x5619678a1740 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.197+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/4186773996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561967899b40 0x561967899520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.197+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/4186773996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56196789eff0 0x5619678a1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.197+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/4186773996 >> 172.21.15.70:0/4186773996 conn(0x5619677c7cf0 msgr2=0x5619678a28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.197+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/4186773996 shutdown_connections 2024-05-08T09:24:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.197+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/4186773996 wait complete. 2024-05-08T09:24:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.198+0000 7fd0d0af4b80 1 -- start start 2024-05-08T09:24:51.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.198+0000 7fd0d0af4b80 1 Processor -- start 2024-05-08T09:24:51.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.199+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x5619678b7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.199+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x5619678b7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.199+0000 7fd0d0af4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 0x56196791d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.199+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01b3f00 con 0x561967899b40 2024-05-08T09:24:51.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.199+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01b5370 con 0x56196789f910 2024-05-08T09:24:51.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.199+0000 7fd0d0af4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c01b45d0 con 0x56196789eff0 2024-05-08T09:24:51.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.200+0000 7fd0d0af4b80 10 client.0 _ll_register_callbacks cb 0x561967792e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:24:51.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.200+0000 7fd0bf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x5619678b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.200+0000 7fd0bf400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x5619678b7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45250/0 (socket says 172.21.15.70:45250) 2024-05-08T09:24:51.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.200+0000 7fd0bf400700 1 -- 172.21.15.70:0/830989152 learned_addr learned my addr 172.21.15.70:0/830989152 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:24:51.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.200+0000 7fd0bea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x5619678b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.201+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 0x56196791d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.201+0000 7fd0bf400700 1 -- 172.21.15.70:0/830989152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 msgr2=0x5619678b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:24:51.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.201+0000 7fd0bf400700 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x5619678b7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.201+0000 7fd0bf400700 1 -- 172.21.15.70:0/830989152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 msgr2=0x56196791d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:24:51.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.201+0000 7fd0bf400700 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 0x56196791d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:51.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.201+0000 7fd0bf400700 1 -- 172.21.15.70:0/830989152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619678b8170 con 0x561967899b40 2024-05-08T09:24:51.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0bea00700 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x5619678b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:24:51.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0bfe00700 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 0x56196791d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:24:51.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0bf400700 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x5619678b7330 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80a90e0 tx=0x7fd0a8091040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800499445bc46883 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:51.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0ad600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:24:51.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0ad600700 1 -- 172.21.15.70:0/830989152 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a80c2070 con 0x561967899b40 2024-05-08T09:24:51.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/830989152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0b802eae0 con 0x561967899b40 2024-05-08T09:24:51.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0ad600700 1 -- 172.21.15.70:0/830989152 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(392..392 src has 1..392) ==== 9583+0+0 (secure 0 0 0) 0x7fd0a80a5670 con 0x561967899b40 2024-05-08T09:24:51.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0ad600700 1 -- 172.21.15.70:0/830989152 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fd0a801d040 con 0x561967899b40 2024-05-08T09:24:51.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0d0af4b80 10 client.19479 fetch_fsmap learned FSMap version 42 2024-05-08T09:24:51.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.202+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/830989152 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56196791ebf0 con 0x561967899b40 2024-05-08T09:24:51.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.203+0000 7fd0ad600700 1 -- 172.21.15.70:0/830989152 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0b802eae0 con 0x561967899b40 2024-05-08T09:24:51.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.203+0000 7fd0ad600700 1 -- 172.21.15.70:0/830989152 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fd0a80a96b0 con 0x561967899b40 2024-05-08T09:24:51.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.203+0000 7fd0d0af4b80 10 client.19479 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:24:51.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.203+0000 7fd0d0af4b80 10 client.19479 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:24:51.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.203+0000 7fd0d0af4b80 20 client.19479 populate_metadata read hostname 'smithi070' 2024-05-08T09:24:51.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.203+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56196791f2c0 0x5619679216e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:51.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.203+0000 7fd0d0af4b80 4 client.19479 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 92.9, "await_for": 42.0}] 2024-05-08T09:24:51.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.203+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/830989152 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 92.9, "await_for": 42.0}) -- 0x5619677f9590 con 0x56196791f2c0 2024-05-08T09:24:51.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.204+0000 7fd0bea00700 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56196791f2c0 0x5619679216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:51.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.205+0000 7fd0bea00700 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56196791f2c0 0x5619679216e0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b355dec8c7d7903 server_cookie=eb3717b22f10b2dc in_seq=0 out_seq=0 2024-05-08T09:24:51.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:24:51.205+0000 7fd0ad600700 10 client.19479 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:24:51.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:50 smithi194 ceph-mon[33679]: pgmap v5049: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 556 KiB/s wr, 16 op/s 2024-05-08T09:24:52.315 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/dvo_sil164.o 2024-05-08T09:24:54.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:53 smithi070 ceph-mon[29591]: pgmap v5050: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 553 KiB/s wr, 14 op/s 2024-05-08T09:24:54.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:53 smithi172 ceph-mon[33377]: pgmap v5050: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 553 KiB/s wr, 14 op/s 2024-05-08T09:24:54.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:53 smithi194 ceph-mon[33679]: pgmap v5050: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 553 KiB/s wr, 14 op/s 2024-05-08T09:24:56.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:55 smithi070 ceph-mon[29591]: pgmap v5051: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 656 KiB/s wr, 29 op/s 2024-05-08T09:24:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:55 smithi172 ceph-mon[33377]: pgmap v5051: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 656 KiB/s wr, 29 op/s 2024-05-08T09:24:56.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:55 smithi194 ceph-mon[33679]: pgmap v5051: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 656 KiB/s wr, 29 op/s 2024-05-08T09:24:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:56 smithi172 ceph-mon[33377]: pgmap v5052: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 288 KiB/s wr, 19 op/s 2024-05-08T09:24:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:56 smithi194 ceph-mon[33679]: pgmap v5052: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 288 KiB/s wr, 19 op/s 2024-05-08T09:24:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:56 smithi070 ceph-mon[29591]: pgmap v5052: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 249 KiB/s rd, 288 KiB/s wr, 19 op/s 2024-05-08T09:25:00.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:24:59 smithi070 ceph-mon[29591]: pgmap v5053: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 499 KiB/s wr, 23 op/s 2024-05-08T09:25:00.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:24:59 smithi172 ceph-mon[33377]: pgmap v5053: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 499 KiB/s wr, 23 op/s 2024-05-08T09:25:00.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:24:59 smithi194 ceph-mon[33679]: pgmap v5053: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 499 KiB/s wr, 23 op/s 2024-05-08T09:25:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:00 smithi172 ceph-mon[33377]: pgmap v5054: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 321 KiB/s wr, 18 op/s 2024-05-08T09:25:01.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:00 smithi194 ceph-mon[33679]: pgmap v5054: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 321 KiB/s wr, 18 op/s 2024-05-08T09:25:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:00 smithi070 ceph-mon[29591]: pgmap v5054: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 321 KiB/s wr, 18 op/s 2024-05-08T09:25:04.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:03 smithi070 ceph-mon[29591]: pgmap v5055: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 321 KiB/s wr, 18 op/s 2024-05-08T09:25:04.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:03 smithi172 ceph-mon[33377]: pgmap v5055: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 321 KiB/s wr, 18 op/s 2024-05-08T09:25:04.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:03 smithi194 ceph-mon[33679]: pgmap v5055: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 321 KiB/s wr, 18 op/s 2024-05-08T09:25:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:04 smithi172 ceph-mon[33377]: pgmap v5056: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 380 KiB/s wr, 22 op/s 2024-05-08T09:25:05.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:04 smithi194 ceph-mon[33679]: pgmap v5056: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 380 KiB/s wr, 22 op/s 2024-05-08T09:25:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:04 smithi070 ceph-mon[29591]: pgmap v5056: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 380 KiB/s wr, 22 op/s 2024-05-08T09:25:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:25:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:25:06.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:25:07.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:07 smithi070 ceph-mon[29591]: pgmap v5057: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 277 KiB/s wr, 8 op/s 2024-05-08T09:25:07.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:07 smithi172 ceph-mon[33377]: pgmap v5057: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 277 KiB/s wr, 8 op/s 2024-05-08T09:25:07.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:07 smithi194 ceph-mon[33679]: pgmap v5057: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 262 KiB/s rd, 277 KiB/s wr, 8 op/s 2024-05-08T09:25:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:25:08.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:25:08.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:08 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:25:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:25:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:25:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:08 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:25:08.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:25:08.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:25:08.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:08 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:25:09.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:09 smithi070 ceph-mon[29591]: pgmap v5058: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 338 KiB/s wr, 13 op/s 2024-05-08T09:25:09.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:09 smithi172 ceph-mon[33377]: pgmap v5058: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 338 KiB/s wr, 13 op/s 2024-05-08T09:25:09.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:09 smithi194 ceph-mon[33679]: pgmap v5058: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 338 KiB/s wr, 13 op/s 2024-05-08T09:25:12.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:11 smithi070 ceph-mon[29591]: pgmap v5059: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 127 KiB/s wr, 9 op/s 2024-05-08T09:25:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:11 smithi172 ceph-mon[33377]: pgmap v5059: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 127 KiB/s wr, 9 op/s 2024-05-08T09:25:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:11 smithi194 ceph-mon[33679]: pgmap v5059: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 127 KiB/s wr, 9 op/s 2024-05-08T09:25:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:12 smithi172 ceph-mon[33377]: pgmap v5060: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 9 op/s 2024-05-08T09:25:13.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:12 smithi194 ceph-mon[33679]: pgmap v5060: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 9 op/s 2024-05-08T09:25:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:12 smithi070 ceph-mon[29591]: pgmap v5060: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 120 KiB/s wr, 9 op/s 2024-05-08T09:25:14.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.634+0000 7fd0ad600700 1 -- 172.21.15.70:0/830989152 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5619677f9590 con 0x56196791f2c0 2024-05-08T09:25:14.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.634+0000 7fd0ad600700 10 client.19479 handle_command_reply: tid=0 2024-05-08T09:25:14.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.634+0000 7fd0d0af4b80 1 client.19479 shutdown 2024-05-08T09:25:14.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.634+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/830989152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 msgr2=0x5619678b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.634+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x5619678b7330 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80a90e0 tx=0x7fd0a8091040 comp rx=0 tx=0).stop 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/830989152 shutdown_connections 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56196791f2c0 0x5619679216e0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56196789f910 0x56196791d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561967899b40 0x5619678b7330 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0d0af4b80 1 --2- 172.21.15.70:0/830989152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56196789eff0 0x5619678b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/830989152 >> 172.21.15.70:0/830989152 conn(0x5619677c7cf0 msgr2=0x5619678a1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0ad600700 0 client.19479 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/830989152 shutdown_connections 2024-05-08T09:25:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0d0af4b80 1 -- 172.21.15.70:0/830989152 wait complete. 2024-05-08T09:25:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.635+0000 7fd0d0af4b80 20 client.19479 trim_cache size 0 max 16384 2024-05-08T09:25:14.639 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:25:14.639 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:25:14.639 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:25:14.639 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 346, 2024-05-08T09:25:14.639 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "f2668c40": { 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 346, 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 92.9, 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:25:14.640 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:25:14.641 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:25:14.641 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:25:14.641 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:25:14.641 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:25:14.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:14.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:14.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:14.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:14.641 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:14.642 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:25:14.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.637+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd0a40b2b20 msgr2=0x7fd0a40b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:14.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.637+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd0a40b2b20 0x7fd0a40b4fe0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd0c01028e0 tx=0x7fd0b0009260 comp rx=0 tx=0).stop 2024-05-08T09:25:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.637+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4260654160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c0075870 msgr2=0x7fd0c01a5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.637+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c0075870 0x7fd0c01a5b90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800c920 tx=0x7fd0a800cc30 comp rx=0 tx=0).stop 2024-05-08T09:25:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.638+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4260654160 shutdown_connections 2024-05-08T09:25:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.638+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd0a40b2b20 0x7fd0a40b4fe0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.638+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0c010fb80 0x7fd0c010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.638+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd0c0075870 0x7fd0c01a5b90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.638+0000 7fd0c4c00700 1 --2- 172.21.15.70:0/4260654160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0c0076190 0x7fd0c01a60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.638+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4260654160 >> 172.21.15.70:0/4260654160 conn(0x7fd0c00fee50 msgr2=0x7fd0c00ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.638+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4260654160 shutdown_connections 2024-05-08T09:25:14.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:14.638+0000 7fd0c4c00700 1 -- 172.21.15.70:0/4260654160 wait complete. 2024-05-08T09:25:15.565 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f2668c40', quiesce took 40.1 seconds. Will release after: 32.9 2024-05-08T09:25:16.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:15 smithi070 ceph-mon[29591]: pgmap v5061: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 208 KiB/s wr, 26 op/s 2024-05-08T09:25:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:15 smithi172 ceph-mon[33377]: pgmap v5061: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 208 KiB/s wr, 26 op/s 2024-05-08T09:25:16.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:15 smithi194 ceph-mon[33679]: pgmap v5061: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 208 KiB/s wr, 26 op/s 2024-05-08T09:25:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:17 smithi070 ceph-mon[29591]: pgmap v5062: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 149 KiB/s wr, 22 op/s 2024-05-08T09:25:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:17 smithi172 ceph-mon[33377]: pgmap v5062: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 149 KiB/s wr, 22 op/s 2024-05-08T09:25:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:17 smithi194 ceph-mon[33679]: pgmap v5062: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 149 KiB/s wr, 22 op/s 2024-05-08T09:25:20.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:19 smithi070 ceph-mon[29591]: pgmap v5063: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 172 KiB/s wr, 28 op/s 2024-05-08T09:25:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:19 smithi172 ceph-mon[33377]: pgmap v5063: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 172 KiB/s wr, 28 op/s 2024-05-08T09:25:20.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:19 smithi194 ceph-mon[33679]: pgmap v5063: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 172 KiB/s wr, 28 op/s 2024-05-08T09:25:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:20 smithi172 ceph-mon[33377]: osdmap e393: 12 total, 12 up, 12 in 2024-05-08T09:25:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:20 smithi172 ceph-mon[33377]: pgmap v5065: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 133 KiB/s wr, 28 op/s 2024-05-08T09:25:21.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:20 smithi194 ceph-mon[33679]: osdmap e393: 12 total, 12 up, 12 in 2024-05-08T09:25:21.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:20 smithi194 ceph-mon[33679]: pgmap v5065: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 133 KiB/s wr, 28 op/s 2024-05-08T09:25:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:20 smithi070 ceph-mon[29591]: osdmap e393: 12 total, 12 up, 12 in 2024-05-08T09:25:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:20 smithi070 ceph-mon[29591]: pgmap v5065: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 133 KiB/s wr, 28 op/s 2024-05-08T09:25:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:22 smithi172 ceph-mon[33377]: pgmap v5066: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 133 KiB/s wr, 28 op/s 2024-05-08T09:25:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:22 smithi194 ceph-mon[33679]: pgmap v5066: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 133 KiB/s wr, 28 op/s 2024-05-08T09:25:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:22 smithi070 ceph-mon[29591]: pgmap v5066: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 133 KiB/s wr, 28 op/s 2024-05-08T09:25:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:24 smithi172 ceph-mon[33377]: pgmap v5067: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 167 KiB/s wr, 12 op/s 2024-05-08T09:25:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:24 smithi194 ceph-mon[33679]: pgmap v5067: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 167 KiB/s wr, 12 op/s 2024-05-08T09:25:25.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:24 smithi070 ceph-mon[29591]: pgmap v5067: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 167 KiB/s wr, 12 op/s 2024-05-08T09:25:27.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:27 smithi070 ceph-mon[29591]: osdmap e394: 12 total, 12 up, 12 in 2024-05-08T09:25:27.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:27 smithi070 ceph-mon[29591]: pgmap v5069: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 174 KiB/s wr, 6 op/s 2024-05-08T09:25:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:27 smithi172 ceph-mon[33377]: osdmap e394: 12 total, 12 up, 12 in 2024-05-08T09:25:27.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:27 smithi172 ceph-mon[33377]: pgmap v5069: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 174 KiB/s wr, 6 op/s 2024-05-08T09:25:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:27 smithi194 ceph-mon[33679]: osdmap e394: 12 total, 12 up, 12 in 2024-05-08T09:25:28.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:27 smithi194 ceph-mon[33679]: pgmap v5069: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 174 KiB/s wr, 6 op/s 2024-05-08T09:25:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:28 smithi172 ceph-mon[33377]: pgmap v5070: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 10 op/s 2024-05-08T09:25:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:28 smithi194 ceph-mon[33679]: pgmap v5070: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 10 op/s 2024-05-08T09:25:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:28 smithi070 ceph-mon[29591]: pgmap v5070: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 177 KiB/s wr, 10 op/s 2024-05-08T09:25:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:30 smithi172 ceph-mon[33377]: pgmap v5071: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2024-05-08T09:25:31.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:30 smithi194 ceph-mon[33679]: pgmap v5071: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2024-05-08T09:25:31.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:30 smithi070 ceph-mon[29591]: pgmap v5071: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2024-05-08T09:25:33.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:32 smithi194 ceph-mon[33679]: pgmap v5072: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2024-05-08T09:25:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:32 smithi070 ceph-mon[29591]: pgmap v5072: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2024-05-08T09:25:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:32 smithi172 ceph-mon[33377]: pgmap v5072: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 158 KiB/s wr, 9 op/s 2024-05-08T09:25:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:34 smithi172 ceph-mon[33377]: pgmap v5073: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 7 op/s 2024-05-08T09:25:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:34 smithi194 ceph-mon[33679]: pgmap v5073: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 7 op/s 2024-05-08T09:25:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:34 smithi070 ceph-mon[29591]: pgmap v5073: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 78 KiB/s wr, 7 op/s 2024-05-08T09:25:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:36 smithi194 ceph-mon[33679]: pgmap v5074: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T09:25:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:36 smithi070 ceph-mon[29591]: pgmap v5074: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T09:25:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:36 smithi172 ceph-mon[33377]: pgmap v5074: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 76 KiB/s wr, 7 op/s 2024-05-08T09:25:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:38 smithi194 ceph-mon[33679]: pgmap v5075: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 8 op/s 2024-05-08T09:25:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:38 smithi070 ceph-mon[29591]: pgmap v5075: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 8 op/s 2024-05-08T09:25:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:38 smithi172 ceph-mon[33377]: pgmap v5075: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 65 KiB/s wr, 8 op/s 2024-05-08T09:25:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:40 smithi194 ceph-mon[33679]: pgmap v5076: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 5 op/s 2024-05-08T09:25:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:40 smithi070 ceph-mon[29591]: pgmap v5076: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 5 op/s 2024-05-08T09:25:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:40 smithi172 ceph-mon[33377]: pgmap v5076: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 5 op/s 2024-05-08T09:25:43.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:42 smithi194 ceph-mon[33679]: pgmap v5077: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 5 op/s 2024-05-08T09:25:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:42 smithi070 ceph-mon[29591]: pgmap v5077: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 5 op/s 2024-05-08T09:25:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:42 smithi172 ceph-mon[33377]: pgmap v5077: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 49 KiB/s wr, 5 op/s 2024-05-08T09:25:45.181 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:44 smithi070 ceph-mon[29591]: pgmap v5078: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 8 op/s 2024-05-08T09:25:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:44 smithi194 ceph-mon[33679]: pgmap v5078: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 8 op/s 2024-05-08T09:25:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:44 smithi172 ceph-mon[33377]: pgmap v5078: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 77 KiB/s wr, 8 op/s 2024-05-08T09:25:47.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:46 smithi194 ceph-mon[33679]: pgmap v5079: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-05-08T09:25:47.346 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:46 smithi070 ceph-mon[29591]: pgmap v5079: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-05-08T09:25:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:46 smithi172 ceph-mon[33377]: pgmap v5079: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-05-08T09:25:48.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:25:48.923 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:25:49.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:48 smithi194 ceph-mon[33679]: pgmap v5080: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-05-08T09:25:49.264 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:48 smithi070 ceph-mon[29591]: pgmap v5080: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-05-08T09:25:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:48 smithi172 ceph-mon[33377]: pgmap v5080: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 7 op/s 2024-05-08T09:25:50.997 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:50 smithi070 ceph-mon[29591]: pgmap v5081: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-05-08T09:25:51.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:50 smithi194 ceph-mon[33679]: pgmap v5081: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-05-08T09:25:51.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.293+0000 7fa08ac00700 1 -- 172.21.15.70:0/3034503786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa08410b660 msgr2=0x7fa08410ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:51.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.293+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3034503786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa08410b660 0x7fa08410ba40 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fa078009990 tx=0x7fa078009ca0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.293+0000 7fa08ac00700 1 -- 172.21.15.70:0/3034503786 shutdown_connections 2024-05-08T09:25:51.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.293+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3034503786 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa084105f90 0x7fa0841124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.293+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3034503786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa08410b660 0x7fa08410ba40 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.293+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3034503786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0841055d0 0x7fa084105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.293+0000 7fa08ac00700 1 -- 172.21.15.70:0/3034503786 >> 172.21.15.70:0/3034503786 conn(0x7fa0841010c0 msgr2=0x7fa0841034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:51.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.294+0000 7fa08ac00700 1 -- 172.21.15.70:0/3034503786 shutdown_connections 2024-05-08T09:25:51.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.294+0000 7fa08ac00700 1 -- 172.21.15.70:0/3034503786 wait complete. 2024-05-08T09:25:51.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.295+0000 7fa08ac00700 1 Processor -- start 2024-05-08T09:25:51.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.295+0000 7fa08ac00700 1 -- start start 2024-05-08T09:25:51.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.295+0000 7fa08ac00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0841055d0 0x7fa0841a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:51.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.295+0000 7fa08ac00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084105f90 0x7fa0841a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:51.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.295+0000 7fa08ac00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa08410b660 0x7fa08419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:51.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.295+0000 7fa08ac00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa0841156d0 con 0x7fa0841055d0 2024-05-08T09:25:51.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.295+0000 7fa08ac00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fa084115550 con 0x7fa08410b660 2024-05-08T09:25:51.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.295+0000 7fa08ac00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fa084115850 con 0x7fa084105f90 2024-05-08T09:25:51.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa089800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0841055d0 0x7fa0841a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:51.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa089800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0841055d0 0x7fa0841a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48600/0 (socket says 172.21.15.70:48600) 2024-05-08T09:25:51.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa089800700 1 -- 172.21.15.70:0/3411274180 learned_addr learned my addr 172.21.15.70:0/3411274180 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:25:51.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa088e00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084105f90 0x7fa0841a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:51.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa08a200700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa08410b660 0x7fa08419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa089800700 1 -- 172.21.15.70:0/3411274180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084105f90 msgr2=0x7fa0841a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa089800700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084105f90 0x7fa0841a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa089800700 1 -- 172.21.15.70:0/3411274180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa08410b660 msgr2=0x7fa08419b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa089800700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa08410b660 0x7fa08419b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa089800700 1 -- 172.21.15.70:0/3411274180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08419c150 con 0x7fa0841055d0 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.296+0000 7fa088e00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084105f90 0x7fa0841a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.297+0000 7fa089800700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0841055d0 0x7fa0841a17e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fa0780098e0 tx=0x7fa078009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.297+0000 7fa082000700 1 -- 172.21.15.70:0/3411274180 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078027070 con 0x7fa0841055d0 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.297+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08419c3e0 con 0x7fa0841055d0 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.297+0000 7fa082000700 1 -- 172.21.15.70:0/3411274180 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa078022470 con 0x7fa0841055d0 2024-05-08T09:25:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.297+0000 7fa082000700 1 -- 172.21.15.70:0/3411274180 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa078017650 con 0x7fa0841055d0 2024-05-08T09:25:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.297+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0841a86b0 con 0x7fa0841055d0 2024-05-08T09:25:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.298+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08406a190 con 0x7fa0841055d0 2024-05-08T09:25:51.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.301+0000 7fa082000700 1 -- 172.21.15.70:0/3411274180 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa07802a070 con 0x7fa0841055d0 2024-05-08T09:25:51.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.302+0000 7fa082000700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa06c0b29f0 0x7fa06c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:51.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.302+0000 7fa082000700 1 -- 172.21.15.70:0/3411274180 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(394..394 src has 1..394) ==== 9583+0+0 (secure 0 0 0) 0x7fa0780e3d20 con 0x7fa0841055d0 2024-05-08T09:25:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.303+0000 7fa088e00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa06c0b29f0 0x7fa06c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.303+0000 7fa088e00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa06c0b29f0 0x7fa06c0b4eb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa08410ad70 tx=0x7fa07000b2c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.305+0000 7fa082000700 1 -- 172.21.15.70:0/3411274180 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa078031080 con 0x7fa0841055d0 2024-05-08T09:25:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:50 smithi172 ceph-mon[33377]: pgmap v5081: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-05-08T09:25:51.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.587+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa08402e510 con 0x7fa0841055d0 2024-05-08T09:25:51.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.589+0000 7fa082000700 1 -- 172.21.15.70:0/3411274180 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fa078013070 con 0x7fa0841055d0 2024-05-08T09:25:51.589 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:25:51.589 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:25:51.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa06c0b29f0 msgr2=0x7fa06c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:51.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa06c0b29f0 0x7fa06c0b4eb0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fa08410ad70 tx=0x7fa07000b2c0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0841055d0 msgr2=0x7fa0841a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:51.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0841055d0 0x7fa0841a17e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7fa0780098e0 tx=0x7fa078009550 comp rx=0 tx=0).stop 2024-05-08T09:25:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 shutdown_connections 2024-05-08T09:25:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fa06c0b29f0 0x7fa06c0b4eb0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fa08410b660 0x7fa08419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa0841055d0 0x7fa0841a17e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 --2- 172.21.15.70:0/3411274180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa084105f90 0x7fa0841a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 >> 172.21.15.70:0/3411274180 conn(0x7fa0841010c0 msgr2=0x7fa0841028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 shutdown_connections 2024-05-08T09:25:51.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:51.593+0000 7fa08ac00700 1 -- 172.21.15.70:0/3411274180 wait complete. 2024-05-08T09:25:51.594 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:25:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:51 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3411274180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:25:52.312 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:51 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3411274180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:25:52.367 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id f2668c40 --release --await' 2024-05-08T09:25:52.367 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id f2668c40 --release --await 2024-05-08T09:25:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:51 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3411274180' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:25:52.816 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:25:53.223 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:52 smithi070 ceph-mon[29591]: pgmap v5082: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-05-08T09:25:53.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:52 smithi194 ceph-mon[33679]: pgmap v5082: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-05-08T09:25:53.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:52 smithi172 ceph-mon[33377]: pgmap v5082: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 5 op/s 2024-05-08T09:25:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.139+0000 7fd5afa00700 1 -- 172.21.15.70:0/1046292491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a80779d0 msgr2=0x7fd5a8077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.139+0000 7fd5afa00700 1 --2- 172.21.15.70:0/1046292491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a80779d0 0x7fd5a8077db0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00b0a0 tx=0x7fd59c00b3b0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.139+0000 7fd5afa00700 1 -- 172.21.15.70:0/1046292491 shutdown_connections 2024-05-08T09:25:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.140+0000 7fd5afa00700 1 --2- 172.21.15.70:0/1046292491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5a81143a0 0x7fd5a8116790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.140+0000 7fd5afa00700 1 --2- 172.21.15.70:0/1046292491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a80779d0 0x7fd5a8077db0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.140+0000 7fd5afa00700 1 --2- 172.21.15.70:0/1046292491 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a80782f0 0x7fd5a8113e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.140+0000 7fd5afa00700 1 -- 172.21.15.70:0/1046292491 >> 172.21.15.70:0/1046292491 conn(0x7fd5a8101210 msgr2=0x7fd5a8103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.140+0000 7fd5afa00700 1 -- 172.21.15.70:0/1046292491 shutdown_connections 2024-05-08T09:25:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.140+0000 7fd5afa00700 1 -- 172.21.15.70:0/1046292491 wait complete. 2024-05-08T09:25:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.141+0000 7fd5afa00700 1 Processor -- start 2024-05-08T09:25:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.141+0000 7fd5afa00700 1 -- start start 2024-05-08T09:25:55.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5afa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a80779d0 0x7fd5a81a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5afa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5a80782f0 0x7fd5a81a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5afa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a81143a0 0x7fd5a81a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5afa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a8119bf0 con 0x7fd5a81143a0 2024-05-08T09:25:55.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5afa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a8119a70 con 0x7fd5a80779d0 2024-05-08T09:25:55.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5afa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a8119d70 con 0x7fd5a80782f0 2024-05-08T09:25:55.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5ada00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a81143a0 0x7fd5a81a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5ada00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a81143a0 0x7fd5a81a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48610/0 (socket says 172.21.15.70:48610) 2024-05-08T09:25:55.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5ada00700 1 -- 172.21.15.70:0/2183332841 learned_addr learned my addr 172.21.15.70:0/2183332841 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:25:55.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5a7e00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5a80782f0 0x7fd5a81a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.142+0000 7fd5ad000700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a80779d0 0x7fd5a81a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.143+0000 7fd5ada00700 1 -- 172.21.15.70:0/2183332841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5a80782f0 msgr2=0x7fd5a81a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:55.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.143+0000 7fd5ada00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5a80782f0 0x7fd5a81a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.143+0000 7fd5ada00700 1 -- 172.21.15.70:0/2183332841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a80779d0 msgr2=0x7fd5a81a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:55.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.143+0000 7fd5ada00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a80779d0 0x7fd5a81a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.143+0000 7fd5ada00700 1 -- 172.21.15.70:0/2183332841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a81a5170 con 0x7fd5a81143a0 2024-05-08T09:25:55.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.143+0000 7fd5ada00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a81143a0 0x7fd5a81a4a30 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000d720 tx=0x7fd5a000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:55.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.144+0000 7fd5a5600700 1 -- 172.21.15.70:0/2183332841 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0017070 con 0x7fd5a81143a0 2024-05-08T09:25:55.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.144+0000 7fd5a5600700 1 -- 172.21.15.70:0/2183332841 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5a0005020 con 0x7fd5a81143a0 2024-05-08T09:25:55.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.144+0000 7fd5a5600700 1 -- 172.21.15.70:0/2183332841 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a000fa50 con 0x7fd5a81143a0 2024-05-08T09:25:55.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.144+0000 7fd5afa00700 1 -- 172.21.15.70:0/2183332841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a81a5460 con 0x7fd5a81143a0 2024-05-08T09:25:55.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.144+0000 7fd5afa00700 1 -- 172.21.15.70:0/2183332841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a81acce0 con 0x7fd5a81143a0 2024-05-08T09:25:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.148+0000 7fd5a5600700 1 -- 172.21.15.70:0/2183332841 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd5a000fbf0 con 0x7fd5a81143a0 2024-05-08T09:25:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.149+0000 7fd5ba3d3b80 1 Processor -- start 2024-05-08T09:25:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.149+0000 7fd5ba3d3b80 1 -- start start 2024-05-08T09:25:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.149+0000 7fd5a5600700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd5900b2b40 0x7fd5900b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5a5600700 1 -- 172.21.15.70:0/2183332841 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(394..394 src has 1..394) ==== 9583+0+0 (secure 0 0 0) 0x7fd5a00e2470 con 0x7fd5a81143a0 2024-05-08T09:25:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bfe1b0 0x5638d7bfe590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf8780 0x5638d7bf8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf9140 0x5638d7c04f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5638d7b4ab20 con 0x5638d7bf9140 2024-05-08T09:25:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5638d7ae8860 con 0x5638d7bfe1b0 2024-05-08T09:25:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5638d7b46ae0 con 0x5638d7bf8780 2024-05-08T09:25:55.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5a7e00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd5900b2b40 0x7fd5900b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5ada00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf9140 0x5638d7c04f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5ada00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf9140 0x5638d7c04f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48614/0 (socket says 172.21.15.70:48614) 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.150+0000 7fd5ada00700 1 -- 172.21.15.70:0/3761537147 learned_addr learned my addr 172.21.15.70:0/3761537147 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd5a7e00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd5900b2b40 0x7fd5900b5000 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd594005950 tx=0x7fd5940058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd5ada00700 1 -- 172.21.15.70:0/3761537147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf8780 msgr2=0x5638d7bf8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd5ada00700 1 --2- 172.21.15.70:0/3761537147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf8780 0x5638d7bf8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd5ada00700 1 -- 172.21.15.70:0/3761537147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bfe1b0 msgr2=0x5638d7bfe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd5ada00700 1 --2- 172.21.15.70:0/3761537147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bfe1b0 0x5638d7bfe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd5ada00700 1 -- 172.21.15.70:0/3761537147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d7a979d0 con 0x5638d7bf9140 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd5ada00700 1 --2- 172.21.15.70:0/3761537147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf9140 0x5638d7c04f70 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000dee0 tx=0x7fd5a00a8b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c1070958675852 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd59a000700 1 -- 172.21.15.70:0/3761537147 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0020040 con 0x5638d7bf9140 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd59a000700 1 -- 172.21.15.70:0/3761537147 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5a00a92d0 con 0x5638d7bf9140 2024-05-08T09:25:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.151+0000 7fd59a000700 1 -- 172.21.15.70:0/3761537147 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00a9530 con 0x5638d7bf9140 2024-05-08T09:25:55.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.152+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3761537147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf9140 msgr2=0x5638d7c04f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:55.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.152+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3761537147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf9140 0x5638d7c04f70 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000dee0 tx=0x7fd5a00a8b10 comp rx=0 tx=0).stop 2024-05-08T09:25:55.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.152+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3761537147 shutdown_connections 2024-05-08T09:25:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.152+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3761537147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf9140 0x5638d7c04f70 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.152+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3761537147 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bfe1b0 0x5638d7bfe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.152+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3761537147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf8780 0x5638d7bf8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.152+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3761537147 >> 172.21.15.70:0/3761537147 conn(0x5638d7b707d0 msgr2=0x5638d7bf3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.152+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3761537147 shutdown_connections 2024-05-08T09:25:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.152+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3761537147 wait complete. 2024-05-08T09:25:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.153+0000 7fd5ba3d3b80 1 -- start start 2024-05-08T09:25:55.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.153+0000 7fd5ba3d3b80 1 Processor -- start 2024-05-08T09:25:55.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.153+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf8780 0x5638d7c04c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 0x5638d7c02020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bfe1b0 0x5638d7c02560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5638d7c05570 con 0x5638d7bf8780 2024-05-08T09:25:55.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5638d7ab0c20 con 0x5638d7bf9140 2024-05-08T09:25:55.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5638d7c056f0 con 0x5638d7bfe1b0 2024-05-08T09:25:55.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ba3d3b80 10 client.0 _ll_register_callbacks cb 0x5638d7af1d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ad000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf8780 0x5638d7c04c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ad000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf8780 0x5638d7c04c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48626/0 (socket says 172.21.15.70:48626) 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ad000700 1 -- 172.21.15.70:0/3427088676 learned_addr learned my addr 172.21.15.70:0/3427088676 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5a7e00700 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 0x5638d7c02020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ada00700 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bfe1b0 0x5638d7c02560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ad000700 1 -- 172.21.15.70:0/3427088676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bfe1b0 msgr2=0x5638d7c02560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ad000700 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bfe1b0 0x5638d7c02560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ad000700 1 -- 172.21.15.70:0/3427088676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 msgr2=0x5638d7c02020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ad000700 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 0x5638d7c02020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.154+0000 7fd5ad000700 1 -- 172.21.15.70:0/3427088676 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d7b10520 con 0x5638d7bf8780 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.155+0000 7fd5a7e00700 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 0x5638d7c02020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.155+0000 7fd5ad000700 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf8780 0x5638d7c04c80 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fd59c015000 tx=0x7fd59c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd18e318e593058 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.155+0000 7fd58ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.155+0000 7fd58ea00700 1 -- 172.21.15.70:0/3427088676 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c022070 con 0x5638d7bf8780 2024-05-08T09:25:55.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.155+0000 7fd58ea00700 1 -- 172.21.15.70:0/3427088676 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(394..394 src has 1..394) ==== 9583+0+0 (secure 0 0 0) 0x7fd59c0076e0 con 0x5638d7bf8780 2024-05-08T09:25:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.155+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3427088676 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5a00a92d0 con 0x5638d7bf8780 2024-05-08T09:25:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd58ea00700 1 -- 172.21.15.70:0/3427088676 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fd59c02e050 con 0x5638d7bf8780 2024-05-08T09:25:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd5ba3d3b80 10 client.19497 fetch_fsmap learned FSMap version 42 2024-05-08T09:25:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3427088676 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5638d7c0fe70 con 0x5638d7bf8780 2024-05-08T09:25:55.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd58ea00700 1 -- 172.21.15.70:0/3427088676 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5a00a92d0 con 0x5638d7bf8780 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd58ea00700 1 -- 172.21.15.70:0/3427088676 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fd59c011070 con 0x5638d7bf8780 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd5ba3d3b80 10 client.19497 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd5ba3d3b80 10 client.19497 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd5ba3d3b80 20 client.19497 populate_metadata read hostname 'smithi070' 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5638d7c12400 0x5638d7c14830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd5ba3d3b80 4 client.19497 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.156+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3427088676 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638d7bc5240 con 0x5638d7c12400 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.157+0000 7fd5a7e00700 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5638d7c12400 0x5638d7c14830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.158+0000 7fd5a7e00700 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5638d7c12400 0x5638d7c14830 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3bb2880f9d721f6 server_cookie=5b89bcb871645b53 in_seq=0 out_seq=0 2024-05-08T09:25:55.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.158+0000 7fd58ea00700 10 client.19497 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:25:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.160+0000 7fd58ea00700 1 -- 172.21.15.70:0/3427088676 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5638d7bc5240 con 0x5638d7c12400 2024-05-08T09:25:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.160+0000 7fd58ea00700 10 client.19497 handle_command_reply: tid=0 2024-05-08T09:25:55.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.160+0000 7fd5ba3d3b80 1 client.19497 shutdown 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3427088676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf8780 msgr2=0x5638d7c04c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf8780 0x5638d7c04c80 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fd59c015000 tx=0x7fd59c009580 comp rx=0 tx=0).stop 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3427088676 shutdown_connections 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5638d7c12400 0x5638d7c14830 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bfe1b0 0x5638d7c02560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bf8780 0x5638d7c04c80 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3427088676 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 0x5638d7c02020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3427088676 >> 172.21.15.70:0/3427088676 conn(0x5638d7b707d0 msgr2=0x5638d7bedb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd58ea00700 0 client.19497 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3427088676 shutdown_connections 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3427088676 wait complete. 2024-05-08T09:25:55.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.161+0000 7fd5ba3d3b80 20 client.19497 trim_cache size 0 max 16384 2024-05-08T09:25:55.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.183+0000 7fd5ba3d3b80 1 Processor -- start 2024-05-08T09:25:55.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.183+0000 7fd5ba3d3b80 1 -- start start 2024-05-08T09:25:55.183 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:54 smithi070 ceph-mon[29591]: pgmap v5083: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T09:25:55.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.183+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf8780 0x5638d7c00fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.183+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf9140 0x5638d7bed920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.183+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c0e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.183+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a81b8490 con 0x5638d7bfe1b0 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.183+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a81b5d20 con 0x5638d7bf8780 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.183+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a81b3b90 con 0x5638d7bf9140 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ada00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c0e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ada00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c0e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48628/0 (socket says 172.21.15.70:48628) 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ada00700 1 -- 172.21.15.70:0/3524998477 learned_addr learned my addr 172.21.15.70:0/3524998477 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5a7e00700 1 --2- 172.21.15.70:0/3524998477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf9140 0x5638d7bed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ad000700 1 --2- 172.21.15.70:0/3524998477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf8780 0x5638d7c00fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ada00700 1 -- 172.21.15.70:0/3524998477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf9140 msgr2=0x5638d7bed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ada00700 1 --2- 172.21.15.70:0/3524998477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf9140 0x5638d7bed920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ada00700 1 -- 172.21.15.70:0/3524998477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf8780 msgr2=0x5638d7c00fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:25:55.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ada00700 1 --2- 172.21.15.70:0/3524998477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf8780 0x5638d7c00fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ada00700 1 -- 172.21.15.70:0/3524998477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638d7befc70 con 0x5638d7bfe1b0 2024-05-08T09:25:55.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.184+0000 7fd5ada00700 1 --2- 172.21.15.70:0/3524998477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c0e5c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00a8fd0 tx=0x7fd5a00a9b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e243daf4241615 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.185+0000 7fd599600700 1 -- 172.21.15.70:0/3524998477 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0020040 con 0x5638d7bfe1b0 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.185+0000 7fd599600700 1 -- 172.21.15.70:0/3524998477 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5a00c8070 con 0x5638d7bfe1b0 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.185+0000 7fd599600700 1 -- 172.21.15.70:0/3524998477 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00a5560 con 0x5638d7bfe1b0 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3524998477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 msgr2=0x5638d7c0e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3524998477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c0e5c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00a8fd0 tx=0x7fd5a00a9b10 comp rx=0 tx=0).stop 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3524998477 shutdown_connections 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3524998477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c0e5c0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3524998477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf8780 0x5638d7c00fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/3524998477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf9140 0x5638d7bed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3524998477 >> 172.21.15.70:0/3524998477 conn(0x5638d7b707d0 msgr2=0x5638d7bfc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:55.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3524998477 shutdown_connections 2024-05-08T09:25:55.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/3524998477 wait complete. 2024-05-08T09:25:55.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.186+0000 7fd5ba3d3b80 1 -- start start 2024-05-08T09:25:55.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.187+0000 7fd5ba3d3b80 1 Processor -- start 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.187+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf8780 0x5638d7c07c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.187+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 0x5638d7c08170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.187+0000 7fd5ba3d3b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c7ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.187+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a81b41e0 con 0x5638d7bfe1b0 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.187+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a81b5650 con 0x5638d7bf9140 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.187+0000 7fd5ba3d3b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a81b48b0 con 0x5638d7bf8780 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.187+0000 7fd5ba3d3b80 10 client.0 _ll_register_callbacks cb 0x5638d7af1d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.188+0000 7fd5ada00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c7ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.188+0000 7fd5ada00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c7ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48632/0 (socket says 172.21.15.70:48632) 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.188+0000 7fd5ada00700 1 -- 172.21.15.70:0/1945070097 learned_addr learned my addr 172.21.15.70:0/1945070097 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:25:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.188+0000 7fd5ad000700 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf8780 0x5638d7c07c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.188+0000 7fd5ada00700 1 -- 172.21.15.70:0/1945070097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf8780 msgr2=0x5638d7c07c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:25:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.188+0000 7fd5ada00700 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf8780 0x5638d7c07c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.188+0000 7fd5ada00700 1 -- 172.21.15.70:0/1945070097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 msgr2=0x5638d7c08170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:25:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.188+0000 7fd5ada00700 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 0x5638d7c08170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.188+0000 7fd5ada00700 1 -- 172.21.15.70:0/1945070097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638d7c7d200 con 0x5638d7bfe1b0 2024-05-08T09:25:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.189+0000 7fd5ada00700 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c7ccc0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00a5300 tx=0x7fd5a00b2130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc68330bc846db8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:55.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.189+0000 7fd58ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:25:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.189+0000 7fd58ea00700 1 -- 172.21.15.70:0/1945070097 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a00b7020 con 0x5638d7bfe1b0 2024-05-08T09:25:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.189+0000 7fd58ea00700 1 -- 172.21.15.70:0/1945070097 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(394..394 src has 1..394) ==== 9583+0+0 (secure 0 0 0) 0x7fd5a00a5560 con 0x5638d7bfe1b0 2024-05-08T09:25:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.189+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/1945070097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5a00c8070 con 0x5638d7bfe1b0 2024-05-08T09:25:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.189+0000 7fd58ea00700 1 -- 172.21.15.70:0/1945070097 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fd5a0020050 con 0x5638d7bfe1b0 2024-05-08T09:25:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.189+0000 7fd5ba3d3b80 10 client.19503 fetch_fsmap learned FSMap version 42 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.189+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/1945070097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5638d7c7e510 con 0x5638d7bfe1b0 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.190+0000 7fd58ea00700 1 -- 172.21.15.70:0/1945070097 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5a00c8070 con 0x5638d7bfe1b0 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.190+0000 7fd58ea00700 1 -- 172.21.15.70:0/1945070097 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fd5a00b1d30 con 0x5638d7bfe1b0 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.190+0000 7fd5ba3d3b80 10 client.19503 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.190+0000 7fd5ba3d3b80 10 client.19503 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.190+0000 7fd5ba3d3b80 20 client.19503 populate_metadata read hostname 'smithi070' 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.190+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5638d7c7e740 0x5638d7c80b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.190+0000 7fd5ba3d3b80 4 client.19503 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f2668c40", "release": true, "await": true}] 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.190+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/1945070097 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f2668c40", "release": true, "await": true}) -- 0x5638d7b58500 con 0x5638d7c7e740 2024-05-08T09:25:55.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.191+0000 7fd5ad000700 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5638d7c7e740 0x5638d7c80b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:55.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.192+0000 7fd5ad000700 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5638d7c7e740 0x5638d7c80b30 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a490ea3939c19578 server_cookie=410a7028a46a6e85 in_seq=0 out_seq=0 2024-05-08T09:25:55.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:55.192+0000 7fd58ea00700 10 client.19503 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:25:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:54 smithi194 ceph-mon[33679]: pgmap v5083: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T09:25:55.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:54 smithi172 ceph-mon[33377]: pgmap v5083: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 35 KiB/s wr, 7 op/s 2024-05-08T09:25:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:56 smithi194 ceph-mon[33679]: pgmap v5084: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 5 op/s 2024-05-08T09:25:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:56 smithi070 ceph-mon[29591]: pgmap v5084: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 5 op/s 2024-05-08T09:25:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:56 smithi172 ceph-mon[33377]: pgmap v5084: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 KiB/s wr, 5 op/s 2024-05-08T09:25:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:25:58 smithi194 ceph-mon[33679]: pgmap v5085: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 55 KiB/s wr, 8 op/s 2024-05-08T09:25:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:25:58 smithi070 ceph-mon[29591]: pgmap v5085: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 55 KiB/s wr, 8 op/s 2024-05-08T09:25:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:25:58 smithi172 ceph-mon[33377]: pgmap v5085: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 55 KiB/s wr, 8 op/s 2024-05-08T09:25:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.853+0000 7fd58ea00700 1 -- 172.21.15.70:0/1945070097 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5638d7b58500 con 0x5638d7c7e740 2024-05-08T09:25:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.853+0000 7fd58ea00700 10 client.19503 handle_command_reply: tid=0 2024-05-08T09:25:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.854+0000 7fd5ba3d3b80 1 client.19503 shutdown 2024-05-08T09:25:59.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.854+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/1945070097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 msgr2=0x5638d7c7ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.854+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c7ccc0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00a5300 tx=0x7fd5a00b2130 comp rx=0 tx=0).stop 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.855+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/1945070097 shutdown_connections 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.855+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5638d7c7e740 0x5638d7c80b30 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.855+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638d7bfe1b0 0x5638d7c7ccc0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.855+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5638d7bf8780 0x5638d7c07c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.855+0000 7fd5ba3d3b80 1 --2- 172.21.15.70:0/1945070097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5638d7bf9140 0x5638d7c08170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.855+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/1945070097 >> 172.21.15.70:0/1945070097 conn(0x5638d7b707d0 msgr2=0x5638d7c03eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.855+0000 7fd58ea00700 0 client.19503 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.855+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/1945070097 shutdown_connections 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.855+0000 7fd5ba3d3b80 1 -- 172.21.15.70:0/1945070097 wait complete. 2024-05-08T09:25:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.856+0000 7fd5ba3d3b80 20 client.19503 trim_cache size 0 max 16384 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 348, 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "f2668c40": { 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 348, 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:25:59.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 92.9, 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:25:59.858 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:25:59.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 -- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd5900b2b40 msgr2=0x7fd5900b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:59.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd5900b2b40 0x7fd5900b5000 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd594005950 tx=0x7fd5940058e0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 -- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a81143a0 msgr2=0x7fd5a81a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:59.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a81143a0 0x7fd5a81a4a30 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fd5a000d720 tx=0x7fd5a000dae0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 -- 172.21.15.70:0/2183332841 shutdown_connections 2024-05-08T09:25:59.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fd5900b2b40 0x7fd5900b5000 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5a81143a0 0x7fd5a81a4a30 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fd5a80779d0 0x7fd5a81a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 --2- 172.21.15.70:0/2183332841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5a80782f0 0x7fd5a81a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:59.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.858+0000 7fd5afa00700 1 -- 172.21.15.70:0/2183332841 >> 172.21.15.70:0/2183332841 conn(0x7fd5a8101210 msgr2=0x7fd5a8103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:59.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.859+0000 7fd5afa00700 1 -- 172.21.15.70:0/2183332841 shutdown_connections 2024-05-08T09:25:59.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:25:59.859+0000 7fd5afa00700 1 -- 172.21.15.70:0/2183332841 wait complete. 2024-05-08T09:25:59.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/dvo_tfp410.o 2024-05-08T09:26:00.694 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f2668c40', seconds elapsed: 85.2 2024-05-08T09:26:01.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:00 smithi194 ceph-mon[33679]: pgmap v5086: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:26:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:00 smithi070 ceph-mon[29591]: pgmap v5086: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:26:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:00 smithi172 ceph-mon[33377]: pgmap v5086: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:26:02.283 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/g4x_dp.o 2024-05-08T09:26:02.288 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/g4x_hdmi.o 2024-05-08T09:26:02.959 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/icl_dsi.o 2024-05-08T09:26:03.192 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_backlight.o 2024-05-08T09:26:03.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:02 smithi172 ceph-mon[33377]: pgmap v5087: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:26:03.244 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_crt.o 2024-05-08T09:26:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:02 smithi194 ceph-mon[33679]: pgmap v5087: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:26:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:02 smithi070 ceph-mon[29591]: pgmap v5087: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 55 KiB/s wr, 5 op/s 2024-05-08T09:26:04.059 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_cx0_phy.o 2024-05-08T09:26:05.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:04 smithi194 ceph-mon[33679]: pgmap v5088: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 209 KiB/s wr, 36 op/s 2024-05-08T09:26:05.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:04 smithi194 ceph-mon[33679]: osdmap e395: 12 total, 12 up, 12 in 2024-05-08T09:26:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:04 smithi070 ceph-mon[29591]: pgmap v5088: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 209 KiB/s wr, 36 op/s 2024-05-08T09:26:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:04 smithi070 ceph-mon[29591]: osdmap e395: 12 total, 12 up, 12 in 2024-05-08T09:26:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:04 smithi172 ceph-mon[33377]: pgmap v5088: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 209 KiB/s wr, 36 op/s 2024-05-08T09:26:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:04 smithi172 ceph-mon[33377]: osdmap e395: 12 total, 12 up, 12 in 2024-05-08T09:26:05.836 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_ddi.o 2024-05-08T09:26:07.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:06 smithi194 ceph-mon[33679]: pgmap v5090: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 242 KiB/s wr, 40 op/s 2024-05-08T09:26:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:06 smithi070 ceph-mon[29591]: pgmap v5090: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 242 KiB/s wr, 40 op/s 2024-05-08T09:26:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:06 smithi172 ceph-mon[33377]: pgmap v5090: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 355 KiB/s rd, 242 KiB/s wr, 40 op/s 2024-05-08T09:26:08.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:07 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:26:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:07 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:26:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:07 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:26:09.216 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:08 smithi194 ceph-mon[33679]: pgmap v5091: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 528 KiB/s wr, 50 op/s 2024-05-08T09:26:09.310 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:08 smithi172 ceph-mon[33377]: pgmap v5091: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 528 KiB/s wr, 50 op/s 2024-05-08T09:26:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:08 smithi070 ceph-mon[29591]: pgmap v5091: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 528 KiB/s wr, 50 op/s 2024-05-08T09:26:12.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:12.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:11 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:12.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:11 smithi070 ceph-mon[29591]: pgmap v5092: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 528 KiB/s wr, 50 op/s 2024-05-08T09:26:12.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:11 smithi070 ceph-mon[29591]: osdmap e396: 12 total, 12 up, 12 in 2024-05-08T09:26:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:11 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:11 smithi172 ceph-mon[33377]: pgmap v5092: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 528 KiB/s wr, 50 op/s 2024-05-08T09:26:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:11 smithi172 ceph-mon[33377]: osdmap e396: 12 total, 12 up, 12 in 2024-05-08T09:26:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:11 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:11 smithi194 ceph-mon[33679]: pgmap v5092: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 658 KiB/s rd, 528 KiB/s wr, 50 op/s 2024-05-08T09:26:12.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:11 smithi194 ceph-mon[33679]: osdmap e396: 12 total, 12 up, 12 in 2024-05-08T09:26:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:13.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:12 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:13.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.164 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:13.164 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:12 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:12 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:14.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:13 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:26:14.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:13 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:26:14.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:13 smithi070 ceph-mon[29591]: pgmap v5094: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 430 KiB/s wr, 17 op/s 2024-05-08T09:26:14.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:13 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:13 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:26:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:13 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:26:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:13 smithi172 ceph-mon[33377]: pgmap v5094: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 430 KiB/s wr, 17 op/s 2024-05-08T09:26:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:13 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:13 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:26:14.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:13 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:26:14.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:13 smithi194 ceph-mon[33679]: pgmap v5094: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 516 KiB/s rd, 430 KiB/s wr, 17 op/s 2024-05-08T09:26:14.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:14.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:13 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:15.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:14 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:26:15.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:14 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:26:15.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:15.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:14 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:26:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:14 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:26:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:14 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:26:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:14 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:26:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:15.591 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_ddi_buf_trans.o 2024-05-08T09:26:16.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:15 smithi070 ceph-mon[29591]: pgmap v5095: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 747 KiB/s wr, 21 op/s 2024-05-08T09:26:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:15 smithi172 ceph-mon[33377]: pgmap v5095: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 747 KiB/s wr, 21 op/s 2024-05-08T09:26:16.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:15 smithi194 ceph-mon[33679]: pgmap v5095: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 747 KiB/s wr, 21 op/s 2024-05-08T09:26:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:26:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:26:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:26:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:26:17.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:26:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:26:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:26:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:26:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:17 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:26:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:17 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:26:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:17 smithi070 ceph-mon[29591]: pgmap v5096: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 741 KiB/s wr, 21 op/s 2024-05-08T09:26:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:17 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:26:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:17 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:26:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:17 smithi172 ceph-mon[33377]: pgmap v5096: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 741 KiB/s wr, 21 op/s 2024-05-08T09:26:18.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:17 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:26:18.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:17 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:26:18.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:17 smithi194 ceph-mon[33679]: pgmap v5096: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 741 KiB/s wr, 21 op/s 2024-05-08T09:26:18.817 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_device.o 2024-05-08T09:26:19.040 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_display_trace.o 2024-05-08T09:26:20.084 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dkl_phy.o 2024-05-08T09:26:20.097 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dp.o 2024-05-08T09:26:20.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:19 smithi070 ceph-mon[29591]: pgmap v5097: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 923 KiB/s wr, 25 op/s 2024-05-08T09:26:20.154 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dp_aux.o 2024-05-08T09:26:20.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:19 smithi172 ceph-mon[33377]: pgmap v5097: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 923 KiB/s wr, 25 op/s 2024-05-08T09:26:20.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:19 smithi194 ceph-mon[33679]: pgmap v5097: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 923 KiB/s wr, 25 op/s 2024-05-08T09:26:20.947 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dp_aux_backlight.o 2024-05-08T09:26:22.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:21 smithi070 ceph-mon[29591]: pgmap v5098: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 923 KiB/s wr, 25 op/s 2024-05-08T09:26:22.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:21 smithi172 ceph-mon[33377]: pgmap v5098: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 923 KiB/s wr, 25 op/s 2024-05-08T09:26:22.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:21 smithi194 ceph-mon[33679]: pgmap v5098: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 923 KiB/s wr, 25 op/s 2024-05-08T09:26:24.069 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dp_hdcp.o 2024-05-08T09:26:24.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:23 smithi070 ceph-mon[29591]: pgmap v5099: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 819 KiB/s wr, 22 op/s 2024-05-08T09:26:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:23 smithi172 ceph-mon[33377]: pgmap v5099: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 819 KiB/s wr, 22 op/s 2024-05-08T09:26:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:23 smithi194 ceph-mon[33679]: pgmap v5099: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 798 KiB/s rd, 819 KiB/s wr, 22 op/s 2024-05-08T09:26:26.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:25 smithi070 ceph-mon[29591]: pgmap v5100: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2024-05-08T09:26:26.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:25 smithi172 ceph-mon[33377]: pgmap v5100: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2024-05-08T09:26:26.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:25 smithi194 ceph-mon[33679]: pgmap v5100: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 28 op/s 2024-05-08T09:26:28.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:27 smithi070 ceph-mon[29591]: pgmap v5101: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 773 KiB/s wr, 21 op/s 2024-05-08T09:26:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:27 smithi172 ceph-mon[33377]: pgmap v5101: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 773 KiB/s wr, 21 op/s 2024-05-08T09:26:28.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:27 smithi194 ceph-mon[33679]: pgmap v5101: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 773 KiB/s wr, 21 op/s 2024-05-08T09:26:30.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:29 smithi070 ceph-mon[29591]: pgmap v5102: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 46 op/s 2024-05-08T09:26:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:29 smithi172 ceph-mon[33377]: pgmap v5102: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 46 op/s 2024-05-08T09:26:30.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:29 smithi194 ceph-mon[33679]: pgmap v5102: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 46 op/s 2024-05-08T09:26:30.659 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dp_link_training.o 2024-05-08T09:26:31.733 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dp_mst.o 2024-05-08T09:26:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:31 smithi172 ceph-mon[33377]: pgmap v5103: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 691 KiB/s wr, 31 op/s 2024-05-08T09:26:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:31 smithi194 ceph-mon[33679]: pgmap v5103: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 691 KiB/s wr, 31 op/s 2024-05-08T09:26:32.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:31 smithi070 ceph-mon[29591]: pgmap v5103: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 691 KiB/s wr, 31 op/s 2024-05-08T09:26:32.961 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dsi.o 2024-05-08T09:26:34.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:33 smithi172 ceph-mon[33377]: pgmap v5104: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 691 KiB/s wr, 31 op/s 2024-05-08T09:26:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:33 smithi194 ceph-mon[33679]: pgmap v5104: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 691 KiB/s wr, 31 op/s 2024-05-08T09:26:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:33 smithi070 ceph-mon[29591]: pgmap v5104: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 691 KiB/s wr, 31 op/s 2024-05-08T09:26:34.856 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dsi_dcs_backlight.o 2024-05-08T09:26:34.892 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dsi_vbt.o 2024-05-08T09:26:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:34 smithi194 ceph-mon[33679]: pgmap v5105: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 41 op/s 2024-05-08T09:26:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:34 smithi070 ceph-mon[29591]: pgmap v5105: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 41 op/s 2024-05-08T09:26:35.394 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_dvo.o 2024-05-08T09:26:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:34 smithi172 ceph-mon[33377]: pgmap v5105: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 41 op/s 2024-05-08T09:26:36.304 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_gmbus.o 2024-05-08T09:26:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:36 smithi172 ceph-mon[33377]: pgmap v5106: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 753 KiB/s wr, 34 op/s 2024-05-08T09:26:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:36 smithi194 ceph-mon[33679]: pgmap v5106: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 753 KiB/s wr, 34 op/s 2024-05-08T09:26:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:36 smithi070 ceph-mon[29591]: pgmap v5106: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 753 KiB/s wr, 34 op/s 2024-05-08T09:26:38.818 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_hdmi.o 2024-05-08T09:26:39.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:38 smithi194 ceph-mon[33679]: pgmap v5107: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 43 op/s 2024-05-08T09:26:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:38 smithi070 ceph-mon[29591]: pgmap v5107: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 43 op/s 2024-05-08T09:26:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:38 smithi172 ceph-mon[33377]: pgmap v5107: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 43 op/s 2024-05-08T09:26:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:40 smithi194 ceph-mon[33679]: pgmap v5108: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 770 KiB/s wr, 18 op/s 2024-05-08T09:26:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:40 smithi070 ceph-mon[29591]: pgmap v5108: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 770 KiB/s wr, 18 op/s 2024-05-08T09:26:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:40 smithi172 ceph-mon[33377]: pgmap v5108: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 770 KiB/s wr, 18 op/s 2024-05-08T09:26:43.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:42 smithi194 ceph-mon[33679]: pgmap v5109: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 770 KiB/s wr, 18 op/s 2024-05-08T09:26:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:42 smithi070 ceph-mon[29591]: pgmap v5109: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 770 KiB/s wr, 18 op/s 2024-05-08T09:26:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:42 smithi172 ceph-mon[33377]: pgmap v5109: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 687 KiB/s rd, 770 KiB/s wr, 18 op/s 2024-05-08T09:26:45.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:44 smithi194 ceph-mon[33679]: pgmap v5110: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2024-05-08T09:26:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:44 smithi070 ceph-mon[29591]: pgmap v5110: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2024-05-08T09:26:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:44 smithi172 ceph-mon[33377]: pgmap v5110: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2024-05-08T09:26:45.903 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_lspcon.o 2024-05-08T09:26:47.230 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_lvds.o 2024-05-08T09:26:47.256 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:46 smithi172 ceph-mon[33377]: pgmap v5111: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 729 KiB/s wr, 16 op/s 2024-05-08T09:26:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:46 smithi194 ceph-mon[33679]: pgmap v5111: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 729 KiB/s wr, 16 op/s 2024-05-08T09:26:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:46 smithi070 ceph-mon[29591]: pgmap v5111: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 729 KiB/s wr, 16 op/s 2024-05-08T09:26:47.738 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_panel.o 2024-05-08T09:26:49.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:48 smithi194 ceph-mon[33679]: pgmap v5112: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 44 op/s 2024-05-08T09:26:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:48 smithi070 ceph-mon[29591]: pgmap v5112: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 44 op/s 2024-05-08T09:26:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:48 smithi172 ceph-mon[33377]: pgmap v5112: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 44 op/s 2024-05-08T09:26:49.619 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_pps.o 2024-05-08T09:26:50.449 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_qp_tables.o 2024-05-08T09:26:50.597 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_sdvo.o 2024-05-08T09:26:51.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:50 smithi194 ceph-mon[33679]: pgmap v5113: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 835 KiB/s wr, 36 op/s 2024-05-08T09:26:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:50 smithi070 ceph-mon[29591]: pgmap v5113: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 835 KiB/s wr, 36 op/s 2024-05-08T09:26:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:50 smithi172 ceph-mon[33377]: pgmap v5113: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 835 KiB/s wr, 36 op/s 2024-05-08T09:26:51.573 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_snps_phy.o 2024-05-08T09:26:53.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:52 smithi194 ceph-mon[33679]: pgmap v5114: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 835 KiB/s wr, 36 op/s 2024-05-08T09:26:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:52 smithi070 ceph-mon[29591]: pgmap v5114: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 835 KiB/s wr, 36 op/s 2024-05-08T09:26:53.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:52 smithi172 ceph-mon[33377]: pgmap v5114: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 835 KiB/s wr, 36 op/s 2024-05-08T09:26:54.381 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_tv.o 2024-05-08T09:26:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:54 smithi194 ceph-mon[33679]: pgmap v5115: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 45 op/s 2024-05-08T09:26:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:54 smithi070 ceph-mon[29591]: pgmap v5115: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 45 op/s 2024-05-08T09:26:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:54 smithi172 ceph-mon[33377]: pgmap v5115: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 45 op/s 2024-05-08T09:26:56.546 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_vdsc.o 2024-05-08T09:26:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:56 smithi194 ceph-mon[33679]: pgmap v5116: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 798 KiB/s wr, 38 op/s 2024-05-08T09:26:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:56 smithi070 ceph-mon[29591]: pgmap v5116: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 798 KiB/s wr, 38 op/s 2024-05-08T09:26:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:56 smithi172 ceph-mon[33377]: pgmap v5116: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 798 KiB/s wr, 38 op/s 2024-05-08T09:26:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:26:58 smithi194 ceph-mon[33679]: pgmap v5117: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 46 op/s 2024-05-08T09:26:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:26:58 smithi070 ceph-mon[29591]: pgmap v5117: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 46 op/s 2024-05-08T09:26:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:26:58 smithi172 ceph-mon[33377]: pgmap v5117: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.1 MiB/s wr, 46 op/s 2024-05-08T09:27:01.044 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/intel_vrr.o 2024-05-08T09:27:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:00 smithi194 ceph-mon[33679]: pgmap v5118: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 684 KiB/s wr, 17 op/s 2024-05-08T09:27:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:00 smithi070 ceph-mon[29591]: pgmap v5118: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 684 KiB/s wr, 17 op/s 2024-05-08T09:27:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:00 smithi172 ceph-mon[33377]: pgmap v5118: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 684 KiB/s wr, 17 op/s 2024-05-08T09:27:01.795 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-05-08T09:27:01.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:27:02.357 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:27:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:02 smithi070 ceph-mon[29591]: pgmap v5119: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 684 KiB/s wr, 17 op/s 2024-05-08T09:27:03.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:02 smithi172 ceph-mon[33377]: pgmap v5119: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 684 KiB/s wr, 17 op/s 2024-05-08T09:27:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:02 smithi194 ceph-mon[33679]: pgmap v5119: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 669 KiB/s rd, 684 KiB/s wr, 17 op/s 2024-05-08T09:27:03.954 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/vlv_dsi.o 2024-05-08T09:27:04.349 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/display/vlv_dsi_pll.o 2024-05-08T09:27:04.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.993+0000 7fdb76c00700 1 -- 172.21.15.70:0/517823463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 msgr2=0x7fdb70105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.993+0000 7fdb76c00700 1 --2- 172.21.15.70:0/517823463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 0x7fdb70105b60 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009990 tx=0x7fdb5c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:27:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.994+0000 7fdb76c00700 1 -- 172.21.15.70:0/517823463 shutdown_connections 2024-05-08T09:27:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.994+0000 7fdb76c00700 1 --2- 172.21.15.70:0/517823463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb701060a0 0x7fdb701125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.994+0000 7fdb76c00700 1 --2- 172.21.15.70:0/517823463 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb7010b6e0 0x7fdb7010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.994+0000 7fdb76c00700 1 --2- 172.21.15.70:0/517823463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 0x7fdb70105b60 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.994+0000 7fdb76c00700 1 -- 172.21.15.70:0/517823463 >> 172.21.15.70:0/517823463 conn(0x7fdb701011d0 msgr2=0x7fdb701035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.994+0000 7fdb76c00700 1 -- 172.21.15.70:0/517823463 shutdown_connections 2024-05-08T09:27:04.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.994+0000 7fdb76c00700 1 -- 172.21.15.70:0/517823463 wait complete. 2024-05-08T09:27:04.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.995+0000 7fdb76c00700 1 Processor -- start 2024-05-08T09:27:04.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.995+0000 7fdb76c00700 1 -- start start 2024-05-08T09:27:04.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb76c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 0x7fdb701124c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:04.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb76c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb701060a0 0x7fdb7010f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:04.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb76c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7010b6e0 0x7fdb7010fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:04.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb76c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70115810 con 0x7fdb701056e0 2024-05-08T09:27:04.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb76c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70115690 con 0x7fdb701060a0 2024-05-08T09:27:04.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb76c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70115990 con 0x7fdb7010b6e0 2024-05-08T09:27:04.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb6fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 0x7fdb701124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:04.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb6fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 0x7fdb701124c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35632/0 (socket says 172.21.15.70:35632) 2024-05-08T09:27:04.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb6fe00700 1 -- 172.21.15.70:0/3161334615 learned_addr learned my addr 172.21.15.70:0/3161334615 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:04.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.996+0000 7fdb6f400700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb701060a0 0x7fdb7010f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:04.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.997+0000 7fdb74c00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7010b6e0 0x7fdb7010fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:04.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.997+0000 7fdb6fe00700 1 -- 172.21.15.70:0/3161334615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7010b6e0 msgr2=0x7fdb7010fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:04.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.997+0000 7fdb6fe00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7010b6e0 0x7fdb7010fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:04.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.997+0000 7fdb6fe00700 1 -- 172.21.15.70:0/3161334615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb701060a0 msgr2=0x7fdb7010f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:04.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.997+0000 7fdb6fe00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb701060a0 0x7fdb7010f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:04.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.997+0000 7fdb6fe00700 1 -- 172.21.15.70:0/3161334615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb701ac510 con 0x7fdb701056e0 2024-05-08T09:27:04.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.998+0000 7fdb6fe00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 0x7fdb701124c0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c920 tx=0x7fdb6000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:04.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.998+0000 7fdb6cc00700 1 -- 172.21.15.70:0/3161334615 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60007b00 con 0x7fdb701056e0 2024-05-08T09:27:04.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.998+0000 7fdb6cc00700 1 -- 172.21.15.70:0/3161334615 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb60004cc0 con 0x7fdb701056e0 2024-05-08T09:27:04.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.998+0000 7fdb6cc00700 1 -- 172.21.15.70:0/3161334615 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60005440 con 0x7fdb701056e0 2024-05-08T09:27:04.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.998+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb701ac6e0 con 0x7fdb701056e0 2024-05-08T09:27:04.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:04.998+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701acba0 con 0x7fdb701056e0 2024-05-08T09:27:04.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.000+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb70106e20 con 0x7fdb701056e0 2024-05-08T09:27:05.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.003+0000 7fdb6cc00700 1 -- 172.21.15.70:0/3161334615 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fdb60004750 con 0x7fdb701056e0 2024-05-08T09:27:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.005+0000 7fdb6cc00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdb540b2aa0 0x7fdb540b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.006+0000 7fdb6cc00700 1 -- 172.21.15.70:0/3161334615 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(396..396 src has 1..396) ==== 9583+0+0 (secure 0 0 0) 0x7fdb600e2520 con 0x7fdb701056e0 2024-05-08T09:27:05.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.006+0000 7fdb6f400700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdb540b2aa0 0x7fdb540b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:05.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.007+0000 7fdb6f400700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdb540b2aa0 0x7fdb540b4f60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdb70110d30 tx=0x7fdb5c005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:05.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.013+0000 7fdb6cc00700 1 -- 172.21.15.70:0/3161334615 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdb60014030 con 0x7fdb701056e0 2024-05-08T09:27:05.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:04 smithi194 ceph-mon[33679]: pgmap v5120: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-05-08T09:27:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:04 smithi070 ceph-mon[29591]: pgmap v5120: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-05-08T09:27:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:04 smithi172 ceph-mon[33377]: pgmap v5120: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 47 op/s 2024-05-08T09:27:05.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.488+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb7006a190 con 0x7fdb701056e0 2024-05-08T09:27:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.489+0000 7fdb6cc00700 1 -- 172.21.15.70:0/3161334615 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fdb600a9a80 con 0x7fdb701056e0 2024-05-08T09:27:05.490 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:27:05.490 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:27:05.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.493+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdb540b2aa0 msgr2=0x7fdb540b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.493+0000 7fdb76c00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdb540b2aa0 0x7fdb540b4f60 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdb70110d30 tx=0x7fdb5c005fb0 comp rx=0 tx=0).stop 2024-05-08T09:27:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.493+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 msgr2=0x7fdb701124c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.493+0000 7fdb76c00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 0x7fdb701124c0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c920 tx=0x7fdb6000cc30 comp rx=0 tx=0).stop 2024-05-08T09:27:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.494+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 shutdown_connections 2024-05-08T09:27:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.494+0000 7fdb76c00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdb540b2aa0 0x7fdb540b4f60 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.494+0000 7fdb76c00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb7010b6e0 0x7fdb7010fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.494+0000 7fdb76c00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb701056e0 0x7fdb701124c0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:05.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.494+0000 7fdb76c00700 1 --2- 172.21.15.70:0/3161334615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdb701060a0 0x7fdb7010f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:05.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.494+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 >> 172.21.15.70:0/3161334615 conn(0x7fdb701011d0 msgr2=0x7fdb70101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:05.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.494+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 shutdown_connections 2024-05-08T09:27:05.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:05.494+0000 7fdb76c00700 1 -- 172.21.15.70:0/3161334615 wait complete. 2024-05-08T09:27:05.495 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:27:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:05 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3161334615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:27:06.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:05 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3161334615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:27:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:05 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3161334615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:27:06.980 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_perf.o 2024-05-08T09:27:07.183 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 76.6 --await-for 42.0' 2024-05-08T09:27:07.184 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 76.6 --await-for 42.0 2024-05-08T09:27:07.263 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:06 smithi070 ceph-mon[29591]: pgmap v5121: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 877 KiB/s wr, 37 op/s 2024-05-08T09:27:07.264 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:06 smithi194 ceph-mon[33679]: pgmap v5121: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 877 KiB/s wr, 37 op/s 2024-05-08T09:27:07.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:06 smithi172 ceph-mon[33377]: pgmap v5121: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 816 KiB/s rd, 877 KiB/s wr, 37 op/s 2024-05-08T09:27:07.782 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:27:08.509 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/pxp/intel_pxp.o 2024-05-08T09:27:09.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:08 smithi070 ceph-mon[29591]: pgmap v5122: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 50 op/s 2024-05-08T09:27:09.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:08 smithi194 ceph-mon[33679]: pgmap v5122: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 50 op/s 2024-05-08T09:27:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:08 smithi172 ceph-mon[33377]: pgmap v5122: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 50 op/s 2024-05-08T09:27:10.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.130+0000 7f2ff5600700 1 -- 172.21.15.70:0/2360034806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff0102ed0 msgr2=0x7f2ff01032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:10.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.130+0000 7f2ff5600700 1 --2- 172.21.15.70:0/2360034806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff0102ed0 0x7f2ff01032b0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009990 tx=0x7f2fe0009ca0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.130+0000 7f2ff5600700 1 -- 172.21.15.70:0/2360034806 shutdown_connections 2024-05-08T09:27:10.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.130+0000 7f2ff5600700 1 --2- 172.21.15.70:0/2360034806 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff010ff50 0x7f2ff0112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.130+0000 7f2ff5600700 1 --2- 172.21.15.70:0/2360034806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff0102ed0 0x7f2ff01032b0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.130+0000 7f2ff5600700 1 --2- 172.21.15.70:0/2360034806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ff01037f0 0x7f2ff010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.130+0000 7f2ff5600700 1 -- 172.21.15.70:0/2360034806 >> 172.21.15.70:0/2360034806 conn(0x7f2ff0079340 msgr2=0x7f2ff0079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:10.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.130+0000 7f2ff5600700 1 -- 172.21.15.70:0/2360034806 shutdown_connections 2024-05-08T09:27:10.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.130+0000 7f2ff5600700 1 -- 172.21.15.70:0/2360034806 wait complete. 2024-05-08T09:27:10.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.132+0000 7f2ff5600700 1 Processor -- start 2024-05-08T09:27:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.132+0000 7f2ff5600700 1 -- start start 2024-05-08T09:27:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.132+0000 7f2ff5600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ff0102ed0 0x7f2ff01a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2ff5600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff01037f0 0x7f2ff01a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2ff5600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff010ff50 0x7f2ff019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2ff5600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff0115760 con 0x7f2ff010ff50 2024-05-08T09:27:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2ff5600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01155e0 con 0x7f2ff01037f0 2024-05-08T09:27:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2ff5600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff01158e0 con 0x7f2ff0102ed0 2024-05-08T09:27:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2fef400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff010ff50 0x7f2ff019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2fef400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff010ff50 0x7f2ff019ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52106/0 (socket says 172.21.15.70:52106) 2024-05-08T09:27:10.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2fef400700 1 -- 172.21.15.70:0/3580852097 learned_addr learned my addr 172.21.15.70:0/3580852097 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:10.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2feea00700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ff0102ed0 0x7f2ff01a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.133+0000 7f2fee000700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff01037f0 0x7f2ff01a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.134+0000 7f2fef400700 1 -- 172.21.15.70:0/3580852097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ff0102ed0 msgr2=0x7f2ff01a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:10.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.134+0000 7f2fef400700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ff0102ed0 0x7f2ff01a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.134+0000 7f2fef400700 1 -- 172.21.15.70:0/3580852097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff01037f0 msgr2=0x7f2ff01a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:10.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.134+0000 7f2fef400700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff01037f0 0x7f2ff01a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.134+0000 7f2fef400700 1 -- 172.21.15.70:0/3580852097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff019c1c0 con 0x7f2ff010ff50 2024-05-08T09:27:10.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.134+0000 7f2fef400700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff010ff50 0x7f2ff019ba60 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80094f0 tx=0x7f2fe800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:10.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.135+0000 7f2fe7400700 1 -- 172.21.15.70:0/3580852097 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8004db0 con 0x7f2ff010ff50 2024-05-08T09:27:10.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.135+0000 7f2ff5600700 1 -- 172.21.15.70:0/3580852097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff019c4b0 con 0x7f2ff010ff50 2024-05-08T09:27:10.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.135+0000 7f2fe7400700 1 -- 172.21.15.70:0/3580852097 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2fe8009e20 con 0x7f2ff010ff50 2024-05-08T09:27:10.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.135+0000 7f2fe7400700 1 -- 172.21.15.70:0/3580852097 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8015400 con 0x7f2ff010ff50 2024-05-08T09:27:10.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.135+0000 7f2ff5600700 1 -- 172.21.15.70:0/3580852097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff01a8770 con 0x7f2ff010ff50 2024-05-08T09:27:10.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.141+0000 7f2fe7400700 1 -- 172.21.15.70:0/3580852097 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2fe80155a0 con 0x7f2ff010ff50 2024-05-08T09:27:10.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.144+0000 7f2fe7400700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2fd40b2aa0 0x7f2fd40b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.145+0000 7f2fe7400700 1 -- 172.21.15.70:0/3580852097 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(397..397 src has 1..397) ==== 9671+0+0 (secure 0 0 0) 0x7f2fe80e3310 con 0x7f2ff010ff50 2024-05-08T09:27:10.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.145+0000 7f2feea00700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2fd40b2aa0 0x7f2fd40b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.155+0000 7f2feea00700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2fd40b2aa0 0x7f2fd40b4f60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0000c00 tx=0x7f2fe000b540 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:10.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.158+0000 7f2ffff38b80 1 Processor -- start 2024-05-08T09:27:10.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.158+0000 7f2ffff38b80 1 -- start start 2024-05-08T09:27:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.158+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50200 0x55cf72a505e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.159+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.159+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 0x55cf72a54f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.159+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cf72999bb0 con 0x55cf72a50b20 2024-05-08T09:27:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.159+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cf729378f0 con 0x55cf72a50200 2024-05-08T09:27:10.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.159+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cf72995b70 con 0x55cf72a54b10 2024-05-08T09:27:10.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.159+0000 7f2feea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50200 0x55cf72a505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.159+0000 7f2feea00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50200 0x55cf72a505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:42028/0 (socket says 172.21.15.70:42028) 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.159+0000 7f2feea00700 1 -- 172.21.15.70:0/905885788 learned_addr learned my addr 172.21.15.70:0/905885788 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.159+0000 7f2fee000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.160+0000 7f2fef400700 1 --2- 172.21.15.70:0/905885788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 0x55cf72a54f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.160+0000 7f2feea00700 1 -- 172.21.15.70:0/905885788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 msgr2=0x55cf72a54f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.160+0000 7f2feea00700 1 --2- 172.21.15.70:0/905885788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 0x55cf72a54f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.160+0000 7f2feea00700 1 -- 172.21.15.70:0/905885788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 msgr2=0x55cf72a545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.160+0000 7f2feea00700 1 --2- 172.21.15.70:0/905885788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.160+0000 7f2feea00700 1 -- 172.21.15.70:0/905885788 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf728e6a60 con 0x55cf72a50200 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.160+0000 7f2fee000700 1 --2- 172.21.15.70:0/905885788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:27:10.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.160+0000 7f2feea00700 1 --2- 172.21.15.70:0/905885788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50200 0x55cf72a505e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0005f50 tx=0x7f2fe001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8fe2bc689e205d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:10.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.161+0000 7f2fdbe00700 1 -- 172.21.15.70:0/905885788 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe00056b0 con 0x55cf72a50200 2024-05-08T09:27:10.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.161+0000 7f2fdbe00700 1 -- 172.21.15.70:0/905885788 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2fe000bc60 con 0x55cf72a50200 2024-05-08T09:27:10.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.161+0000 7f2fdbe00700 1 -- 172.21.15.70:0/905885788 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000f840 con 0x55cf72a50200 2024-05-08T09:27:10.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.162+0000 7f2ffff38b80 1 -- 172.21.15.70:0/905885788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50200 msgr2=0x55cf72a505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:10.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.162+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/905885788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50200 0x55cf72a505e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0005f50 tx=0x7f2fe001f000 comp rx=0 tx=0).stop 2024-05-08T09:27:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.163+0000 7f2ffff38b80 1 -- 172.21.15.70:0/905885788 shutdown_connections 2024-05-08T09:27:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.163+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/905885788 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 0x55cf72a54f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.163+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/905885788 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50200 0x55cf72a505e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.163+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/905885788 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.163+0000 7f2ffff38b80 1 -- 172.21.15.70:0/905885788 >> 172.21.15.70:0/905885788 conn(0x55cf729bf860 msgr2=0x55cf72a42100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.163+0000 7f2ffff38b80 1 -- 172.21.15.70:0/905885788 shutdown_connections 2024-05-08T09:27:10.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.163+0000 7f2ffff38b80 1 -- 172.21.15.70:0/905885788 wait complete. 2024-05-08T09:27:10.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.164+0000 7f2ffff38b80 1 -- start start 2024-05-08T09:27:10.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.164+0000 7f2ffff38b80 1 Processor -- start 2024-05-08T09:27:10.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50200 0x55cf72a5bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 0x55cf72a592f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 0x55cf72a59830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2feea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50200 0x55cf72a5bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cf72a5ccf0 con 0x55cf72a50200 2024-05-08T09:27:10.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cf728ffcb0 con 0x55cf72a50b20 2024-05-08T09:27:10.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2feea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50200 0x55cf72a5bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52120/0 (socket says 172.21.15.70:52120) 2024-05-08T09:27:10.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2ffff38b80 1 -- 172.21.15.70:0/338418403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cf72a5ce70 con 0x55cf72a54b10 2024-05-08T09:27:10.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2feea00700 1 -- 172.21.15.70:0/338418403 learned_addr learned my addr 172.21.15.70:0/338418403 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:10.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2ffff38b80 10 client.0 _ll_register_callbacks cb 0x55cf72940e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:27:10.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.165+0000 7f2fee000700 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 0x55cf72a592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.166+0000 7f2fef400700 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 0x55cf72a59830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.166+0000 7f2feea00700 1 -- 172.21.15.70:0/338418403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 msgr2=0x55cf72a59830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:10.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.166+0000 7f2feea00700 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 0x55cf72a59830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.166+0000 7f2feea00700 1 -- 172.21.15.70:0/338418403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 msgr2=0x55cf72a592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:10.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.166+0000 7f2feea00700 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 0x55cf72a592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.166+0000 7f2feea00700 1 -- 172.21.15.70:0/338418403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf7295f5b0 con 0x55cf72a50200 2024-05-08T09:27:10.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.167+0000 7f2feea00700 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50200 0x55cf72a5bf50 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f2fe002f040 tx=0x7f2fe0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1d28de365acd0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:10.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.167+0000 7f2fd8c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:27:10.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.167+0000 7f2fd8c00700 1 -- 172.21.15.70:0/338418403 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe003c060 con 0x55cf72a50200 2024-05-08T09:27:10.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.167+0000 7f2fd8c00700 1 -- 172.21.15.70:0/338418403 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(397..397 src has 1..397) ==== 9671+0+0 (secure 0 0 0) 0x7f2fe000fd50 con 0x55cf72a50200 2024-05-08T09:27:10.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.167+0000 7f2ffff38b80 1 -- 172.21.15.70:0/338418403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe000bc60 con 0x55cf72a50200 2024-05-08T09:27:10.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.168+0000 7f2fd8c00700 1 -- 172.21.15.70:0/338418403 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2fe0003d30 con 0x55cf72a50200 2024-05-08T09:27:10.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.168+0000 7f2ffff38b80 10 client.19521 fetch_fsmap learned FSMap version 42 2024-05-08T09:27:10.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.168+0000 7f2ffff38b80 1 -- 172.21.15.70:0/338418403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55cf72a67540 con 0x55cf72a50200 2024-05-08T09:27:10.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.168+0000 7f2fd8c00700 1 -- 172.21.15.70:0/338418403 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2fe000bc60 con 0x55cf72a50200 2024-05-08T09:27:10.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.168+0000 7f2fd8c00700 1 -- 172.21.15.70:0/338418403 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2fe0037b30 con 0x55cf72a50200 2024-05-08T09:27:10.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.168+0000 7f2ffff38b80 10 client.19521 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:27:10.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.168+0000 7f2ffff38b80 10 client.19521 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:27:10.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.168+0000 7f2ffff38b80 20 client.19521 populate_metadata read hostname 'smithi070' 2024-05-08T09:27:10.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.169+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf72a69a10 0x55cf72a6be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.169+0000 7f2ffff38b80 4 client.19521 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:27:10.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.169+0000 7f2ffff38b80 1 -- 172.21.15.70:0/338418403 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf72a142d0 con 0x55cf72a69a10 2024-05-08T09:27:10.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.170+0000 7f2fee000700 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf72a69a10 0x55cf72a6be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.171+0000 7f2fee000700 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf72a69a10 0x55cf72a6be00 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ef24465cb0a55a8 server_cookie=34bc4ae618c211e0 in_seq=0 out_seq=0 2024-05-08T09:27:10.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.171+0000 7f2fd8c00700 10 client.19521 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:27:10.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.173+0000 7f2fd8c00700 1 -- 172.21.15.70:0/338418403 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cf72a142d0 con 0x55cf72a69a10 2024-05-08T09:27:10.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.173+0000 7f2fd8c00700 10 client.19521 handle_command_reply: tid=0 2024-05-08T09:27:10.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.173+0000 7f2ffff38b80 1 client.19521 shutdown 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2ffff38b80 1 -- 172.21.15.70:0/338418403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50200 msgr2=0x55cf72a5bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50200 0x55cf72a5bf50 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f2fe002f040 tx=0x7f2fe0003ba0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2ffff38b80 1 -- 172.21.15.70:0/338418403 shutdown_connections 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf72a69a10 0x55cf72a6be00 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a54b10 0x55cf72a59830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50200 0x55cf72a5bf50 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/338418403 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 0x55cf72a592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2fd8c00700 0 client.19521 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2ffff38b80 1 -- 172.21.15.70:0/338418403 >> 172.21.15.70:0/338418403 conn(0x55cf729bf860 msgr2=0x55cf72a3cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:10.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.174+0000 7f2ffff38b80 1 -- 172.21.15.70:0/338418403 shutdown_connections 2024-05-08T09:27:10.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.175+0000 7f2ffff38b80 1 -- 172.21.15.70:0/338418403 wait complete. 2024-05-08T09:27:10.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.175+0000 7f2ffff38b80 20 client.19521 trim_cache size 0 max 16384 2024-05-08T09:27:10.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.212+0000 7f2ffff38b80 1 Processor -- start 2024-05-08T09:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.213+0000 7f2ffff38b80 1 -- start start 2024-05-08T09:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.213+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a55f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.213+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 0x55cf72a5b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.213+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a54b10 0x55cf72a524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.213+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd0011930 con 0x55cf72a54b10 2024-05-08T09:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.213+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd000f1c0 con 0x55cf72a50b20 2024-05-08T09:27:10.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.213+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd000d030 con 0x55cf72a50200 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2fef400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a54b10 0x55cf72a524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2fef400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a54b10 0x55cf72a524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52126/0 (socket says 172.21.15.70:52126) 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2fef400700 1 -- 172.21.15.70:0/2570552618 learned_addr learned my addr 172.21.15.70:0/2570552618 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2feea00700 1 --2- 172.21.15.70:0/2570552618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a55f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2fee000700 1 --2- 172.21.15.70:0/2570552618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 0x55cf72a5b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2fef400700 1 -- 172.21.15.70:0/2570552618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 msgr2=0x55cf72a55f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2fef400700 1 --2- 172.21.15.70:0/2570552618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a55f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2fef400700 1 -- 172.21.15.70:0/2570552618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 msgr2=0x55cf72a5b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2fef400700 1 --2- 172.21.15.70:0/2570552618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 0x55cf72a5b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.214+0000 7f2fef400700 1 -- 172.21.15.70:0/2570552618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf72a578a0 con 0x55cf72a54b10 2024-05-08T09:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.215+0000 7f2fef400700 1 --2- 172.21.15.70:0/2570552618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a54b10 0x55cf72a524d0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80aa0a0 tx=0x7f2fe8005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52805fe38a6729d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.215+0000 7f2fdb400700 1 -- 172.21.15.70:0/2570552618 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80c4070 con 0x55cf72a54b10 2024-05-08T09:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.215+0000 7f2fdb400700 1 -- 172.21.15.70:0/2570552618 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2fe80ae4c0 con 0x55cf72a54b10 2024-05-08T09:27:10.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.215+0000 7f2fdb400700 1 -- 172.21.15.70:0/2570552618 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80b2ae0 con 0x55cf72a54b10 2024-05-08T09:27:10.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.216+0000 7f2ffff38b80 1 -- 172.21.15.70:0/2570552618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a54b10 msgr2=0x55cf72a524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:10.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.216+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/2570552618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a54b10 0x55cf72a524d0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80aa0a0 tx=0x7f2fe8005bf0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.217+0000 7f2ffff38b80 1 -- 172.21.15.70:0/2570552618 shutdown_connections 2024-05-08T09:27:10.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.217+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/2570552618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a54b10 0x55cf72a524d0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.217+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/2570552618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a55f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.217+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/2570552618 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a50b20 0x55cf72a5b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.217+0000 7f2ffff38b80 1 -- 172.21.15.70:0/2570552618 >> 172.21.15.70:0/2570552618 conn(0x55cf729bf860 msgr2=0x55cf72a5a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.217+0000 7f2ffff38b80 1 -- 172.21.15.70:0/2570552618 shutdown_connections 2024-05-08T09:27:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.217+0000 7f2ffff38b80 1 -- 172.21.15.70:0/2570552618 wait complete. 2024-05-08T09:27:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.218+0000 7f2ffff38b80 1 -- start start 2024-05-08T09:27:10.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.218+0000 7f2ffff38b80 1 Processor -- start 2024-05-08T09:27:10.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.219+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a6bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.219+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a6c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.219+0000 7f2ffff38b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a54b10 0x55cf72ad3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.219+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd000d680 con 0x55cf72a50b20 2024-05-08T09:27:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.219+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd000eaf0 con 0x55cf72a54b10 2024-05-08T09:27:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.219+0000 7f2ffff38b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd000dd50 con 0x55cf72a50200 2024-05-08T09:27:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.219+0000 7f2ffff38b80 10 client.0 _ll_register_callbacks cb 0x55cf72940e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:27:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.220+0000 7f2fee000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a6c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.220+0000 7f2feea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a6bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.220+0000 7f2feea00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a6bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:58442/0 (socket says 172.21.15.70:58442) 2024-05-08T09:27:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.220+0000 7f2feea00700 1 -- 172.21.15.70:0/3933154164 learned_addr learned my addr 172.21.15.70:0/3933154164 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.220+0000 7f2fef400700 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a54b10 0x55cf72ad3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.220+0000 7f2feea00700 1 -- 172.21.15.70:0/3933154164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a54b10 msgr2=0x55cf72ad3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:10.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.220+0000 7f2feea00700 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a54b10 0x55cf72ad3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.220+0000 7f2feea00700 1 -- 172.21.15.70:0/3933154164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 msgr2=0x55cf72a6c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:10.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.221+0000 7f2feea00700 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a6c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:10.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.221+0000 7f2feea00700 1 -- 172.21.15.70:0/3933154164 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf72ad4470 con 0x55cf72a50200 2024-05-08T09:27:10.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.221+0000 7f2fef400700 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a54b10 0x55cf72ad3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:27:10.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.221+0000 7f2fee000700 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a6c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:27:10.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.222+0000 7f2feea00700 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a6bd60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00223e0 tx=0x7f2fe0005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5f1a8f32152ed3e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:10.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.222+0000 7f2fd8c00700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T09:27:10.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.222+0000 7f2fd8c00700 1 -- 172.21.15.70:0/3933154164 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe003c040 con 0x55cf72a50200 2024-05-08T09:27:10.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.222+0000 7f2ffff38b80 1 -- 172.21.15.70:0/3933154164 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe80ae4c0 con 0x55cf72a50200 2024-05-08T09:27:10.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.222+0000 7f2fd8c00700 1 -- 172.21.15.70:0/3933154164 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(397..397 src has 1..397) ==== 9671+0+0 (secure 0 0 0) 0x7f2fe0046070 con 0x55cf72a50200 2024-05-08T09:27:10.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.223+0000 7f2fd8c00700 1 -- 172.21.15.70:0/3933154164 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f2fe0053050 con 0x55cf72a50200 2024-05-08T09:27:10.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.223+0000 7f2ffff38b80 10 client.28168 fetch_fsmap learned FSMap version 42 2024-05-08T09:27:10.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.223+0000 7f2ffff38b80 1 -- 172.21.15.70:0/3933154164 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55cf72ad5590 con 0x55cf72a50200 2024-05-08T09:27:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.224+0000 7f2fd8c00700 1 -- 172.21.15.70:0/3933154164 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2fe80ae4c0 con 0x55cf72a50200 2024-05-08T09:27:10.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.224+0000 7f2fd8c00700 1 -- 172.21.15.70:0/3933154164 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f2fe000f7d0 con 0x55cf72a50200 2024-05-08T09:27:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.224+0000 7f2ffff38b80 10 client.28168 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:27:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.224+0000 7f2ffff38b80 10 client.28168 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:27:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.224+0000 7f2ffff38b80 20 client.28168 populate_metadata read hostname 'smithi070' 2024-05-08T09:27:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.224+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf72ad5bf0 0x55cf72ad8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.224+0000 7f2ffff38b80 4 client.28168 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 76.6, "await_for": 42.0}] 2024-05-08T09:27:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.224+0000 7f2ffff38b80 1 -- 172.21.15.70:0/3933154164 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 76.6, "await_for": 42.0}) -- 0x55cf729a7590 con 0x55cf72ad5bf0 2024-05-08T09:27:10.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.225+0000 7f2fee000700 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf72ad5bf0 0x55cf72ad8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.226+0000 7f2fd8c00700 10 client.28168 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:27:10.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:10.226+0000 7f2fee000700 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf72ad5bf0 0x55cf72ad8010 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff4cf00aab16dc31 server_cookie=88e896619831b4a9 in_seq=0 out_seq=0 2024-05-08T09:27:10.324 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/pxp/intel_pxp_tee.o 2024-05-08T09:27:11.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:10 smithi194 ceph-mon[33679]: osdmap e397: 12 total, 12 up, 12 in 2024-05-08T09:27:11.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:10 smithi194 ceph-mon[33679]: pgmap v5124: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 926 KiB/s wr, 50 op/s 2024-05-08T09:27:11.346 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/pxp/intel_pxp_huc.o 2024-05-08T09:27:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:10 smithi070 ceph-mon[29591]: osdmap e397: 12 total, 12 up, 12 in 2024-05-08T09:27:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:10 smithi070 ceph-mon[29591]: pgmap v5124: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 926 KiB/s wr, 50 op/s 2024-05-08T09:27:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:10 smithi172 ceph-mon[33377]: osdmap e397: 12 total, 12 up, 12 in 2024-05-08T09:27:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:10 smithi172 ceph-mon[33377]: pgmap v5124: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 926 KiB/s wr, 50 op/s 2024-05-08T09:27:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:12 smithi194 ceph-mon[33679]: pgmap v5125: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 926 KiB/s wr, 50 op/s 2024-05-08T09:27:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:12 smithi070 ceph-mon[29591]: pgmap v5125: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 926 KiB/s wr, 50 op/s 2024-05-08T09:27:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:12 smithi172 ceph-mon[33377]: pgmap v5125: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 873 KiB/s rd, 926 KiB/s wr, 50 op/s 2024-05-08T09:27:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:14 smithi194 ceph-mon[33679]: pgmap v5126: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 725 KiB/s wr, 24 op/s 2024-05-08T09:27:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:14 smithi070 ceph-mon[29591]: pgmap v5126: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 725 KiB/s wr, 24 op/s 2024-05-08T09:27:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:14 smithi172 ceph-mon[33377]: pgmap v5126: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 725 KiB/s wr, 24 op/s 2024-05-08T09:27:16.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:16 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:27:16.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:16 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:27:17.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:16 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:27:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:17 smithi070 ceph-mon[29591]: osdmap e398: 12 total, 12 up, 12 in 2024-05-08T09:27:17.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:17 smithi070 ceph-mon[29591]: pgmap v5128: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 516 KiB/s wr, 11 op/s 2024-05-08T09:27:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:17 smithi172 ceph-mon[33377]: osdmap e398: 12 total, 12 up, 12 in 2024-05-08T09:27:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:17 smithi172 ceph-mon[33377]: pgmap v5128: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 516 KiB/s wr, 11 op/s 2024-05-08T09:27:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:17 smithi194 ceph-mon[33679]: osdmap e398: 12 total, 12 up, 12 in 2024-05-08T09:27:18.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:17 smithi194 ceph-mon[33679]: pgmap v5128: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 593 KiB/s rd, 516 KiB/s wr, 11 op/s 2024-05-08T09:27:18.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:27:18.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:27:18.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:27:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:27:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:27:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:27:19.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:27:19.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:27:19.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:27:19.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:19 smithi070 ceph-mon[29591]: pgmap v5129: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 593 KiB/s wr, 15 op/s 2024-05-08T09:27:19.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:19 smithi172 ceph-mon[33377]: pgmap v5129: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 593 KiB/s wr, 15 op/s 2024-05-08T09:27:20.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:19 smithi194 ceph-mon[33679]: pgmap v5129: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 593 KiB/s wr, 15 op/s 2024-05-08T09:27:21.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:20 smithi194 ceph-mon[33679]: pgmap v5130: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 529 KiB/s wr, 13 op/s 2024-05-08T09:27:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:20 smithi070 ceph-mon[29591]: pgmap v5130: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 529 KiB/s wr, 13 op/s 2024-05-08T09:27:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:20 smithi172 ceph-mon[33377]: pgmap v5130: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 529 KiB/s wr, 13 op/s 2024-05-08T09:27:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:22 smithi194 ceph-mon[33679]: pgmap v5131: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 529 KiB/s wr, 13 op/s 2024-05-08T09:27:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:22 smithi070 ceph-mon[29591]: pgmap v5131: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 529 KiB/s wr, 13 op/s 2024-05-08T09:27:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:22 smithi172 ceph-mon[33377]: pgmap v5131: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 529 KiB/s wr, 13 op/s 2024-05-08T09:27:25.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:24 smithi194 ceph-mon[33679]: pgmap v5132: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 216 KiB/s wr, 10 op/s 2024-05-08T09:27:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:24 smithi070 ceph-mon[29591]: pgmap v5132: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 216 KiB/s wr, 10 op/s 2024-05-08T09:27:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:24 smithi172 ceph-mon[33377]: pgmap v5132: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 216 KiB/s wr, 10 op/s 2024-05-08T09:27:27.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:26 smithi194 ceph-mon[33679]: pgmap v5133: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 211 KiB/s wr, 9 op/s 2024-05-08T09:27:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:26 smithi070 ceph-mon[29591]: pgmap v5133: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 211 KiB/s wr, 9 op/s 2024-05-08T09:27:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:26 smithi172 ceph-mon[33377]: pgmap v5133: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 364 KiB/s rd, 211 KiB/s wr, 9 op/s 2024-05-08T09:27:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:28 smithi194 ceph-mon[33679]: pgmap v5134: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 238 KiB/s wr, 11 op/s 2024-05-08T09:27:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:28 smithi070 ceph-mon[29591]: pgmap v5134: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 238 KiB/s wr, 11 op/s 2024-05-08T09:27:29.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:28 smithi172 ceph-mon[33377]: pgmap v5134: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 238 KiB/s wr, 11 op/s 2024-05-08T09:27:31.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:30 smithi194 ceph-mon[33679]: pgmap v5135: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 142 KiB/s wr, 7 op/s 2024-05-08T09:27:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:30 smithi070 ceph-mon[29591]: pgmap v5135: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 142 KiB/s wr, 7 op/s 2024-05-08T09:27:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:30 smithi172 ceph-mon[33377]: pgmap v5135: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 142 KiB/s wr, 7 op/s 2024-05-08T09:27:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:32 smithi194 ceph-mon[33679]: pgmap v5136: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 142 KiB/s wr, 7 op/s 2024-05-08T09:27:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:32 smithi070 ceph-mon[29591]: pgmap v5136: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 142 KiB/s wr, 7 op/s 2024-05-08T09:27:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:32 smithi172 ceph-mon[33377]: pgmap v5136: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 142 KiB/s wr, 7 op/s 2024-05-08T09:27:33.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.980+0000 7f2fd8c00700 1 -- 172.21.15.70:0/3933154164 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55cf729a7590 con 0x55cf72ad5bf0 2024-05-08T09:27:33.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.980+0000 7f2fd8c00700 10 client.28168 handle_command_reply: tid=0 2024-05-08T09:27:33.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.980+0000 7f2ffff38b80 1 client.28168 shutdown 2024-05-08T09:27:33.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.981+0000 7f2ffff38b80 1 -- 172.21.15.70:0/3933154164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 msgr2=0x55cf72a6bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.981+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a6bd60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00223e0 tx=0x7f2fe0005e80 comp rx=0 tx=0).stop 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.981+0000 7f2ffff38b80 1 -- 172.21.15.70:0/3933154164 shutdown_connections 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.981+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cf72ad5bf0 0x55cf72ad8010 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.981+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cf72a54b10 0x55cf72ad3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.981+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cf72a50200 0x55cf72a6bd60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.981+0000 7f2ffff38b80 1 --2- 172.21.15.70:0/3933154164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cf72a50b20 0x55cf72a6c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.981+0000 7f2ffff38b80 1 -- 172.21.15.70:0/3933154164 >> 172.21.15.70:0/3933154164 conn(0x55cf729bf860 msgr2=0x55cf72a3cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.981+0000 7f2fd8c00700 0 client.28168 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.982+0000 7f2ffff38b80 1 -- 172.21.15.70:0/3933154164 shutdown_connections 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.982+0000 7f2ffff38b80 1 -- 172.21.15.70:0/3933154164 wait complete. 2024-05-08T09:27:33.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.983+0000 7f2ffff38b80 20 client.28168 trim_cache size 0 max 16384 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 350, 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "abd74652": { 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 350, 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:27:33.984 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 76.6, 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:27:33.985 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:27:33.986 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:27:33.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.984+0000 7f2ff5600700 1 -- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2fd40b2aa0 msgr2=0x7f2fd40b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:33.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.984+0000 7f2ff5600700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2fd40b2aa0 0x7f2fd40b4f60 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0000c00 tx=0x7f2fe000b540 comp rx=0 tx=0).stop 2024-05-08T09:27:33.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.985+0000 7f2ff5600700 1 -- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff010ff50 msgr2=0x7f2ff019ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:33.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.985+0000 7f2ff5600700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff010ff50 0x7f2ff019ba60 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80094f0 tx=0x7f2fe800d3b0 comp rx=0 tx=0).stop 2024-05-08T09:27:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.985+0000 7f2ff5600700 1 -- 172.21.15.70:0/3580852097 shutdown_connections 2024-05-08T09:27:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.985+0000 7f2ff5600700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2fd40b2aa0 0x7f2fd40b4f60 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.985+0000 7f2ff5600700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff010ff50 0x7f2ff019ba60 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.985+0000 7f2ff5600700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ff0102ed0 0x7f2ff01a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.985+0000 7f2ff5600700 1 --2- 172.21.15.70:0/3580852097 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2ff01037f0 0x7f2ff01a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.985+0000 7f2ff5600700 1 -- 172.21.15.70:0/3580852097 >> 172.21.15.70:0/3580852097 conn(0x7f2ff0079340 msgr2=0x7f2ff0111530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.985+0000 7f2ff5600700 1 -- 172.21.15.70:0/3580852097 shutdown_connections 2024-05-08T09:27:33.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:33.986+0000 7f2ff5600700 1 -- 172.21.15.70:0/3580852097 wait complete. 2024-05-08T09:27:34.959 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'abd74652', quiesce took 33.2 seconds. Will release after: 16.6 2024-05-08T09:27:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:34 smithi194 ceph-mon[33679]: pgmap v5137: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 211 KiB/s wr, 10 op/s 2024-05-08T09:27:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:34 smithi070 ceph-mon[29591]: pgmap v5137: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 211 KiB/s wr, 10 op/s 2024-05-08T09:27:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:34 smithi172 ceph-mon[33377]: pgmap v5137: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 211 KiB/s wr, 10 op/s 2024-05-08T09:27:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:36 smithi194 ceph-mon[33679]: pgmap v5138: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 5 op/s 2024-05-08T09:27:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:36 smithi070 ceph-mon[29591]: pgmap v5138: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 5 op/s 2024-05-08T09:27:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:36 smithi172 ceph-mon[33377]: pgmap v5138: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 5 op/s 2024-05-08T09:27:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:38 smithi194 ceph-mon[33679]: pgmap v5139: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 222 KiB/s wr, 13 op/s 2024-05-08T09:27:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:38 smithi070 ceph-mon[29591]: pgmap v5139: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 222 KiB/s wr, 13 op/s 2024-05-08T09:27:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:38 smithi172 ceph-mon[33377]: pgmap v5139: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 223 KiB/s rd, 222 KiB/s wr, 13 op/s 2024-05-08T09:27:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:40 smithi194 ceph-mon[33679]: pgmap v5140: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 164 KiB/s wr, 10 op/s 2024-05-08T09:27:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:40 smithi070 ceph-mon[29591]: pgmap v5140: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 164 KiB/s wr, 10 op/s 2024-05-08T09:27:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:40 smithi172 ceph-mon[33377]: pgmap v5140: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 164 KiB/s wr, 10 op/s 2024-05-08T09:27:43.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:42 smithi194 ceph-mon[33679]: pgmap v5141: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 164 KiB/s wr, 10 op/s 2024-05-08T09:27:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:42 smithi070 ceph-mon[29591]: pgmap v5141: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 164 KiB/s wr, 10 op/s 2024-05-08T09:27:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:42 smithi172 ceph-mon[33377]: pgmap v5141: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 164 KiB/s wr, 10 op/s 2024-05-08T09:27:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:44 smithi194 ceph-mon[33679]: pgmap v5142: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 210 KiB/s wr, 14 op/s 2024-05-08T09:27:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:44 smithi070 ceph-mon[29591]: pgmap v5142: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 210 KiB/s wr, 14 op/s 2024-05-08T09:27:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:44 smithi172 ceph-mon[33377]: pgmap v5142: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 210 KiB/s wr, 14 op/s 2024-05-08T09:27:47.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:46 smithi194 ceph-mon[33679]: pgmap v5143: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 141 KiB/s wr, 11 op/s 2024-05-08T09:27:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:46 smithi070 ceph-mon[29591]: pgmap v5143: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 141 KiB/s wr, 11 op/s 2024-05-08T09:27:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:46 smithi172 ceph-mon[33377]: pgmap v5143: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 141 KiB/s wr, 11 op/s 2024-05-08T09:27:49.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:48 smithi070 ceph-mon[29591]: pgmap v5144: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 141 KiB/s wr, 13 op/s 2024-05-08T09:27:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:48 smithi194 ceph-mon[33679]: pgmap v5144: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 141 KiB/s wr, 13 op/s 2024-05-08T09:27:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:48 smithi172 ceph-mon[33377]: pgmap v5144: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 141 KiB/s wr, 13 op/s 2024-05-08T09:27:51.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:50 smithi194 ceph-mon[33679]: pgmap v5145: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2024-05-08T09:27:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:50 smithi070 ceph-mon[29591]: pgmap v5145: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2024-05-08T09:27:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:50 smithi172 ceph-mon[33377]: pgmap v5145: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2024-05-08T09:27:51.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:27:52.028 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:27:53.056 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:52 smithi070 ceph-mon[29591]: pgmap v5146: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2024-05-08T09:27:53.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:52 smithi194 ceph-mon[33679]: pgmap v5146: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2024-05-08T09:27:53.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:52 smithi172 ceph-mon[33377]: pgmap v5146: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 46 KiB/s wr, 6 op/s 2024-05-08T09:27:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.417+0000 7fc647e00700 1 -- 172.21.15.70:0/3634891308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 msgr2=0x7fc6481124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.417+0000 7fc647e00700 1 --2- 172.21.15.70:0/3634891308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 0x7fc6481124a0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fc64000b0a0 tx=0x7fc64000b3b0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.417+0000 7fc647e00700 1 -- 172.21.15.70:0/3634891308 shutdown_connections 2024-05-08T09:27:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.417+0000 7fc647e00700 1 --2- 172.21.15.70:0/3634891308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 0x7fc6481124a0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.417+0000 7fc647e00700 1 --2- 172.21.15.70:0/3634891308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc64810b660 0x7fc64810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.417+0000 7fc647e00700 1 --2- 172.21.15.70:0/3634891308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc6481055d0 0x7fc648105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.417+0000 7fc647e00700 1 -- 172.21.15.70:0/3634891308 >> 172.21.15.70:0/3634891308 conn(0x7fc6481010c0 msgr2=0x7fc6481034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.417+0000 7fc647e00700 1 -- 172.21.15.70:0/3634891308 shutdown_connections 2024-05-08T09:27:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.417+0000 7fc647e00700 1 -- 172.21.15.70:0/3634891308 wait complete. 2024-05-08T09:27:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.419+0000 7fc647e00700 1 Processor -- start 2024-05-08T09:27:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.419+0000 7fc647e00700 1 -- start start 2024-05-08T09:27:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.419+0000 7fc647e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6481055d0 0x7fc6481a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.419+0000 7fc647e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 0x7fc6481a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.419+0000 7fc647e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64810b660 0x7fc64819b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.419+0000 7fc647e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc648115680 con 0x7fc648105f90 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.419+0000 7fc647e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc648115500 con 0x7fc64810b660 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.419+0000 7fc647e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc648115800 con 0x7fc6481055d0 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 0x7fc6481a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 0x7fc6481a1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53820/0 (socket says 172.21.15.70:53820) 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646000700 1 -- 172.21.15.70:0/3465195113 learned_addr learned my addr 172.21.15.70:0/3465195113 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646a00700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6481055d0 0x7fc6481a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc647400700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64810b660 0x7fc64819b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646000700 1 -- 172.21.15.70:0/3465195113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6481055d0 msgr2=0x7fc6481a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646000700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6481055d0 0x7fc6481a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646000700 1 -- 172.21.15.70:0/3465195113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64810b660 msgr2=0x7fc64819b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646000700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64810b660 0x7fc64819b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646000700 1 -- 172.21.15.70:0/3465195113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64819c020 con 0x7fc648105f90 2024-05-08T09:27:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc647400700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64810b660 0x7fc64819b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:27:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.420+0000 7fc646000700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 0x7fc6481a1c00 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c9b0 tx=0x7fc63400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.421+0000 7fc63f400700 1 -- 172.21.15.70:0/3465195113 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634007b00 con 0x7fc648105f90 2024-05-08T09:27:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.421+0000 7fc63f400700 1 -- 172.21.15.70:0/3465195113 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc634007ca0 con 0x7fc648105f90 2024-05-08T09:27:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.421+0000 7fc63f400700 1 -- 172.21.15.70:0/3465195113 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634018660 con 0x7fc648105f90 2024-05-08T09:27:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.421+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64819c2b0 con 0x7fc648105f90 2024-05-08T09:27:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.421+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6481a8520 con 0x7fc648105f90 2024-05-08T09:27:54.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.422+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc648106d10 con 0x7fc648105f90 2024-05-08T09:27:54.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.425+0000 7fc63f400700 1 -- 172.21.15.70:0/3465195113 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc63400f450 con 0x7fc648105f90 2024-05-08T09:27:54.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.428+0000 7fc63f400700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc62c0b2a70 0x7fc62c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.428+0000 7fc63f400700 1 -- 172.21.15.70:0/3465195113 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(398..398 src has 1..398) ==== 9583+0+0 (secure 0 0 0) 0x7fc6340e2d70 con 0x7fc648105f90 2024-05-08T09:27:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.428+0000 7fc646a00700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc62c0b2a70 0x7fc62c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:54.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.429+0000 7fc646a00700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc62c0b2a70 0x7fc62c0b4f30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc638005950 tx=0x7fc6380058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:54.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.430+0000 7fc63f400700 1 -- 172.21.15.70:0/3465195113 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc634014030 con 0x7fc648105f90 2024-05-08T09:27:54.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.712+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc64819cda0 con 0x7fc648105f90 2024-05-08T09:27:54.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.713+0000 7fc63f400700 1 -- 172.21.15.70:0/3465195113 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fc64819cda0 con 0x7fc648105f90 2024-05-08T09:27:54.712 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:27:54.712 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:27:54.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc62c0b2a70 msgr2=0x7fc62c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc62c0b2a70 0x7fc62c0b4f30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc638005950 tx=0x7fc6380058e0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 msgr2=0x7fc6481a1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 0x7fc6481a1c00 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fc63400c9b0 tx=0x7fc63400cd70 comp rx=0 tx=0).stop 2024-05-08T09:27:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 shutdown_connections 2024-05-08T09:27:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc62c0b2a70 0x7fc62c0b4f30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc64810b660 0x7fc64819b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6481055d0 0x7fc6481a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 --2- 172.21.15.70:0/3465195113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc648105f90 0x7fc6481a1c00 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.717+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 >> 172.21.15.70:0/3465195113 conn(0x7fc6481010c0 msgr2=0x7fc6481026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.718+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 shutdown_connections 2024-05-08T09:27:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:54.718+0000 7fc647e00700 1 -- 172.21.15.70:0/3465195113 wait complete. 2024-05-08T09:27:54.717 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:27:55.098 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:54 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3465195113' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:27:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:54 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3465195113' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:27:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:54 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3465195113' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:27:55.551 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id abd74652 --release --await' 2024-05-08T09:27:55.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id abd74652 --release --await 2024-05-08T09:27:56.001 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:27:56.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:55 smithi070 ceph-mon[29591]: pgmap v5147: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-05-08T09:27:56.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:55 smithi172 ceph-mon[33377]: pgmap v5147: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-05-08T09:27:56.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:55 smithi194 ceph-mon[33679]: pgmap v5147: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 8 op/s 2024-05-08T09:27:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:56 smithi194 ceph-mon[33679]: pgmap v5148: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T09:27:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:56 smithi070 ceph-mon[29591]: pgmap v5148: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T09:27:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:56 smithi172 ceph-mon[33377]: pgmap v5148: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T09:27:58.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.294+0000 7f4c82c00700 1 -- 172.21.15.70:0/2646345415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c1143e0 msgr2=0x7f4c7c1167d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:58.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.294+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2646345415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c1143e0 0x7f4c7c1167d0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f4c74009990 tx=0x7f4c74009ca0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.294+0000 7f4c82c00700 1 -- 172.21.15.70:0/2646345415 shutdown_connections 2024-05-08T09:27:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.294+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2646345415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c1143e0 0x7f4c7c1167d0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.294+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2646345415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7c075840 0x7f4c7c075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.294+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2646345415 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c076160 0x7f4c7c113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.294+0000 7f4c82c00700 1 -- 172.21.15.70:0/2646345415 >> 172.21.15.70:0/2646345415 conn(0x7f4c7c0fef20 msgr2=0x7f4c7c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.294+0000 7f4c82c00700 1 -- 172.21.15.70:0/2646345415 shutdown_connections 2024-05-08T09:27:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.294+0000 7f4c82c00700 1 -- 172.21.15.70:0/2646345415 wait complete. 2024-05-08T09:27:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.295+0000 7f4c82c00700 1 Processor -- start 2024-05-08T09:27:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.295+0000 7f4c82c00700 1 -- start start 2024-05-08T09:27:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.295+0000 7f4c82c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c075840 0x7f4c7c19ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.295+0000 7f4c82c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c076160 0x7f4c7c1a0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c82c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7c1143e0 0x7f4c7c1a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c82c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c119aa0 con 0x7f4c7c076160 2024-05-08T09:27:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c82c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c119920 con 0x7f4c7c075840 2024-05-08T09:27:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c82c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c119c20 con 0x7f4c7c1143e0 2024-05-08T09:27:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c80e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c076160 0x7f4c7c1a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c80e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c076160 0x7f4c7c1a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53300/0 (socket says 172.21.15.70:53300) 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c80e00700 1 -- 172.21.15.70:0/2924764083 learned_addr learned my addr 172.21.15.70:0/2924764083 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c81800700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c075840 0x7f4c7c19ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c82200700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7c1143e0 0x7f4c7c1a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c80e00700 1 -- 172.21.15.70:0/2924764083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7c1143e0 msgr2=0x7f4c7c1a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c80e00700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7c1143e0 0x7f4c7c1a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c80e00700 1 -- 172.21.15.70:0/2924764083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c075840 msgr2=0x7f4c7c19ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c80e00700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c075840 0x7f4c7c19ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c80e00700 1 -- 172.21.15.70:0/2924764083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c1a4f40 con 0x7f4c7c076160 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.296+0000 7f4c82200700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7c1143e0 0x7f4c7c1a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.297+0000 7f4c80e00700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c076160 0x7f4c7c1a0470 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c9b0 tx=0x7f4c6800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.297+0000 7f4c7a000700 1 -- 172.21.15.70:0/2924764083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68007b00 con 0x7f4c7c076160 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.297+0000 7f4c7a000700 1 -- 172.21.15.70:0/2924764083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c68007ca0 con 0x7f4c7c076160 2024-05-08T09:27:58.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.297+0000 7f4c82c00700 1 -- 172.21.15.70:0/2924764083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c1a5230 con 0x7f4c7c076160 2024-05-08T09:27:58.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.297+0000 7f4c7a000700 1 -- 172.21.15.70:0/2924764083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c68018660 con 0x7f4c7c076160 2024-05-08T09:27:58.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.297+0000 7f4c82c00700 1 -- 172.21.15.70:0/2924764083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7c1acab0 con 0x7f4c7c076160 2024-05-08T09:27:58.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.301+0000 7f4c7a000700 1 -- 172.21.15.70:0/2924764083 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4c6800f450 con 0x7f4c7c076160 2024-05-08T09:27:58.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.302+0000 7f4c7a000700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c640b2a70 0x7f4c640b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.302+0000 7f4c7a000700 1 -- 172.21.15.70:0/2924764083 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(398..398 src has 1..398) ==== 9583+0+0 (secure 0 0 0) 0x7f4c680e2a30 con 0x7f4c7c076160 2024-05-08T09:27:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.302+0000 7f4c81800700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c640b2a70 0x7f4c640b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.303+0000 7f4c81800700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c640b2a70 0x7f4c640b4f30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009d10 tx=0x7f4c70009040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.314+0000 7f4c8ebbcb80 1 Processor -- start 2024-05-08T09:27:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.314+0000 7f4c8ebbcb80 1 -- start start 2024-05-08T09:27:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.314+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.314+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f34490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.314+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 0x564d48f34f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.314+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564d48e86b20 con 0x564d48f39f60 2024-05-08T09:27:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.314+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564d48e24860 con 0x564d48f34ab0 2024-05-08T09:27:58.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.314+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564d48e82ae0 con 0x564d48f3a880 2024-05-08T09:27:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c81800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c81800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53306/0 (socket says 172.21.15.70:53306) 2024-05-08T09:27:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c81800700 1 -- 172.21.15.70:0/2506657545 learned_addr learned my addr 172.21.15.70:0/2506657545 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c80e00700 1 --2- 172.21.15.70:0/2506657545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f34490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c82200700 1 --2- 172.21.15.70:0/2506657545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 0x564d48f34f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c81800700 1 -- 172.21.15.70:0/2506657545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 msgr2=0x564d48f34490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c81800700 1 --2- 172.21.15.70:0/2506657545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f34490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c81800700 1 -- 172.21.15.70:0/2506657545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 msgr2=0x564d48f34f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:58.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c81800700 1 --2- 172.21.15.70:0/2506657545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 0x564d48f34f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.315+0000 7f4c81800700 1 -- 172.21.15.70:0/2506657545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d48dd39d0 con 0x564d48f39f60 2024-05-08T09:27:58.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.316+0000 7f4c81800700 1 --2- 172.21.15.70:0/2506657545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3a340 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f4c700164a0 tx=0x7f4c70012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554dc0f07236351e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:58.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.316+0000 7f4c6ea00700 1 -- 172.21.15.70:0/2506657545 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70026070 con 0x564d48f39f60 2024-05-08T09:27:58.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.316+0000 7f4c6ea00700 1 -- 172.21.15.70:0/2506657545 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c70016e50 con 0x564d48f39f60 2024-05-08T09:27:58.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.316+0000 7f4c6ea00700 1 -- 172.21.15.70:0/2506657545 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70014890 con 0x564d48f39f60 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.317+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2506657545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 msgr2=0x564d48f3a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.317+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2506657545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3a340 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f4c700164a0 tx=0x7f4c70012000 comp rx=0 tx=0).stop 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.317+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2506657545 shutdown_connections 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.317+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2506657545 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 0x564d48f34f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.317+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2506657545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3a340 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.317+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2506657545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f34490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.317+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2506657545 >> 172.21.15.70:0/2506657545 conn(0x564d48e62c60 msgr2=0x564d48f2eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.317+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2506657545 shutdown_connections 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.317+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2506657545 wait complete. 2024-05-08T09:27:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.318+0000 7f4c8ebbcb80 1 -- start start 2024-05-08T09:27:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.318+0000 7f4c8ebbcb80 1 Processor -- start 2024-05-08T09:27:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.318+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 0x564d48f405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.318+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.318+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f3df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.318+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564d48f413a0 con 0x564d48f39f60 2024-05-08T09:27:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.318+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564d48decc20 con 0x564d48f34ab0 2024-05-08T09:27:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.318+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564d48f41520 con 0x564d48f3a880 2024-05-08T09:27:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.318+0000 7f4c8ebbcb80 10 client.0 _ll_register_callbacks cb 0x564d48e2dd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:27:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c80e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c80e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53308/0 (socket says 172.21.15.70:53308) 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c80e00700 1 -- 172.21.15.70:0/2885920581 learned_addr learned my addr 172.21.15.70:0/2885920581 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c81800700 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 0x564d48f405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c82200700 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f3df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c80e00700 1 -- 172.21.15.70:0/2885920581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 msgr2=0x564d48f3df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c80e00700 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f3df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c80e00700 1 -- 172.21.15.70:0/2885920581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 msgr2=0x564d48f405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c80e00700 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 0x564d48f405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.319+0000 7f4c80e00700 1 -- 172.21.15.70:0/2885920581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d48e4c520 con 0x564d48f39f60 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.320+0000 7f4c80e00700 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3d9e0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f4c680a97d0 tx=0x7f4c6800fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1488d4b97468c0d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.320+0000 7f4c63400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.320+0000 7f4c63400700 1 -- 172.21.15.70:0/2885920581 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c680adc40 con 0x564d48f39f60 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.320+0000 7f4c63400700 1 -- 172.21.15.70:0/2885920581 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(398..398 src has 1..398) ==== 9583+0+0 (secure 0 0 0) 0x7f4c680a9af0 con 0x564d48f39f60 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.320+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2885920581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c70016e50 con 0x564d48f39f60 2024-05-08T09:27:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.320+0000 7f4c63400700 1 -- 172.21.15.70:0/2885920581 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4c680b26f0 con 0x564d48f39f60 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.320+0000 7f4c8ebbcb80 10 client.19545 fetch_fsmap learned FSMap version 42 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.320+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2885920581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x564d48f4bcb0 con 0x564d48f39f60 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.320+0000 7f4c63400700 1 -- 172.21.15.70:0/2885920581 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c70016e50 con 0x564d48f39f60 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.321+0000 7f4c63400700 1 -- 172.21.15.70:0/2885920581 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4c680bece0 con 0x564d48f39f60 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.321+0000 7f4c8ebbcb80 10 client.19545 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.321+0000 7f4c8ebbcb80 10 client.19545 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.321+0000 7f4c8ebbcb80 20 client.19545 populate_metadata read hostname 'smithi070' 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.321+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564d48f4e2f0 0x564d48f506e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.321+0000 7f4c8ebbcb80 4 client.19545 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:27:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.321+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2885920581 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d48f011a0 con 0x564d48f4e2f0 2024-05-08T09:27:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.322+0000 7f4c81800700 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564d48f4e2f0 0x564d48f506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.322+0000 7f4c81800700 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564d48f4e2f0 0x564d48f506e0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea59b498a55c001a server_cookie=dbd93dca376dee09 in_seq=0 out_seq=0 2024-05-08T09:27:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.322+0000 7f4c63400700 10 client.19545 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:27:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.324+0000 7f4c63400700 1 -- 172.21.15.70:0/2885920581 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564d48f011a0 con 0x564d48f4e2f0 2024-05-08T09:27:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.324+0000 7f4c63400700 10 client.19545 handle_command_reply: tid=0 2024-05-08T09:27:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 client.19545 shutdown 2024-05-08T09:27:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2885920581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 msgr2=0x564d48f3d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3d9e0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f4c680a97d0 tx=0x7f4c6800fba0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2885920581 shutdown_connections 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564d48f4e2f0 0x564d48f506e0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f3df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f34ab0 0x564d48f405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c63400700 0 client.19545 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2885920581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f39f60 0x564d48f3d9e0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2885920581 >> 172.21.15.70:0/2885920581 conn(0x564d48e62c60 msgr2=0x564d48f33480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2885920581 shutdown_connections 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2885920581 wait complete. 2024-05-08T09:27:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.325+0000 7f4c8ebbcb80 20 client.19545 trim_cache size 0 max 16384 2024-05-08T09:27:58.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.348+0000 7f4c8ebbcb80 1 Processor -- start 2024-05-08T09:27:58.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.348+0000 7f4c8ebbcb80 1 -- start start 2024-05-08T09:27:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.348+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f34ab0 0x564d48f381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.348+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 0x564d48f4a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.348+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f55ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.348+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1b8210 con 0x564d48f34ab0 2024-05-08T09:27:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.348+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1b5aa0 con 0x564d48f39f60 2024-05-08T09:27:58.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.348+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1b3910 con 0x564d48f3a880 2024-05-08T09:27:58.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c81800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f34ab0 0x564d48f381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c81800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f34ab0 0x564d48f381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53318/0 (socket says 172.21.15.70:53318) 2024-05-08T09:27:58.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c81800700 1 -- 172.21.15.70:0/2987020720 learned_addr learned my addr 172.21.15.70:0/2987020720 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:58.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c80e00700 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 0x564d48f4a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c82200700 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f55ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c81800700 1 -- 172.21.15.70:0/2987020720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 msgr2=0x564d48f55ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c81800700 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f55ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c81800700 1 -- 172.21.15.70:0/2987020720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 msgr2=0x564d48f4a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c81800700 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 0x564d48f4a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c81800700 1 -- 172.21.15.70:0/2987020720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d48f50c70 con 0x564d48f34ab0 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c82200700 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f55ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.349+0000 7f4c81800700 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f34ab0 0x564d48f381c0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009220 tx=0x7f4c70004f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e7d3aec45986d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.350+0000 7f4c6e000700 1 -- 172.21.15.70:0/2987020720 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70039070 con 0x564d48f34ab0 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.350+0000 7f4c6e000700 1 -- 172.21.15.70:0/2987020720 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c70032070 con 0x564d48f34ab0 2024-05-08T09:27:58.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.350+0000 7f4c6e000700 1 -- 172.21.15.70:0/2987020720 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70026040 con 0x564d48f34ab0 2024-05-08T09:27:58.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.350+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2987020720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f34ab0 msgr2=0x564d48f381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:27:58.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.350+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f34ab0 0x564d48f381c0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009220 tx=0x7f4c70004f50 comp rx=0 tx=0).stop 2024-05-08T09:27:58.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.351+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2987020720 shutdown_connections 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.351+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f3a880 0x564d48f55ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.351+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f34ab0 0x564d48f381c0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.351+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/2987020720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 0x564d48f4a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.351+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2987020720 >> 172.21.15.70:0/2987020720 conn(0x564d48e62c60 msgr2=0x564d48f37ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.351+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2987020720 shutdown_connections 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.351+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/2987020720 wait complete. 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.351+0000 7f4c8ebbcb80 1 -- start start 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.351+0000 7f4c8ebbcb80 1 Processor -- start 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f34ab0 0x564d48f43a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 0x564d48f43f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c8ebbcb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f3a880 0x564d48fb8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1b3f60 con 0x564d48f3a880 2024-05-08T09:27:58.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1b53d0 con 0x564d48f39f60 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c8ebbcb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7c1b4630 con 0x564d48f34ab0 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c8ebbcb80 10 client.0 _ll_register_callbacks cb 0x564d48e2dd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c82200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f3a880 0x564d48fb8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c82200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f3a880 0x564d48fb8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53328/0 (socket says 172.21.15.70:53328) 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c82200700 1 -- 172.21.15.70:0/1490572253 learned_addr learned my addr 172.21.15.70:0/1490572253 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c81800700 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f34ab0 0x564d48f43a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.352+0000 7f4c80e00700 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 0x564d48f43f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c82200700 1 -- 172.21.15.70:0/1490572253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f34ab0 msgr2=0x564d48f43a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c82200700 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f34ab0 0x564d48f43a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c82200700 1 -- 172.21.15.70:0/1490572253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 msgr2=0x564d48f43f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c82200700 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 0x564d48f43f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c82200700 1 -- 172.21.15.70:0/1490572253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d48f2f2f0 con 0x564d48f3a880 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c82200700 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f3a880 0x564d48fb8a60 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f4c740057e0 tx=0x7f4c74005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0741c59ec150234 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:27:58.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c63400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:27:58.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c63400700 1 -- 172.21.15.70:0/1490572253 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c74009590 con 0x564d48f3a880 2024-05-08T09:27:58.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c63400700 1 -- 172.21.15.70:0/1490572253 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(398..398 src has 1..398) ==== 9583+0+0 (secure 0 0 0) 0x7f4c740039d0 con 0x564d48f3a880 2024-05-08T09:27:58.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.353+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/1490572253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c70032070 con 0x564d48f3a880 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c63400700 1 -- 172.21.15.70:0/1490572253 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4c74031050 con 0x564d48f3a880 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c8ebbcb80 10 client.19551 fetch_fsmap learned FSMap version 42 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/1490572253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x564d48fba020 con 0x564d48f3a880 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c63400700 1 -- 172.21.15.70:0/1490572253 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4c70032070 con 0x564d48f3a880 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c63400700 1 -- 172.21.15.70:0/1490572253 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4c7402c030 con 0x564d48f3a880 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c8ebbcb80 10 client.19551 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c8ebbcb80 10 client.19551 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c8ebbcb80 20 client.19551 populate_metadata read hostname 'smithi070' 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564d48fba7b0 0x564d48fbcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c8ebbcb80 4 client.19551 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "abd74652", "release": true, "await": true}] 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.354+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/1490572253 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "abd74652", "release": true, "await": true}) -- 0x564d48e94500 con 0x564d48fba7b0 2024-05-08T09:27:58.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.355+0000 7f4c81800700 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564d48fba7b0 0x564d48fbcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:27:58.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.356+0000 7f4c81800700 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564d48fba7b0 0x564d48fbcbd0 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2cec98280e7d26b server_cookie=f61fb6afdfaaad79 in_seq=0 out_seq=0 2024-05-08T09:27:58.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:27:58.356+0000 7f4c63400700 10 client.19551 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:27:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:27:58 smithi194 ceph-mon[33679]: pgmap v5149: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T09:27:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:27:58 smithi070 ceph-mon[29591]: pgmap v5149: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T09:27:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:27:58 smithi172 ceph-mon[33377]: pgmap v5149: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 14 KiB/s wr, 7 op/s 2024-05-08T09:28:01.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:00 smithi194 ceph-mon[33679]: pgmap v5150: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T09:28:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:00 smithi070 ceph-mon[29591]: pgmap v5150: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T09:28:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:00 smithi172 ceph-mon[33377]: pgmap v5150: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T09:28:02.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.988+0000 7f4c63400700 1 -- 172.21.15.70:0/1490572253 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x564d48e94500 con 0x564d48fba7b0 2024-05-08T09:28:02.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.988+0000 7f4c63400700 10 client.19551 handle_command_reply: tid=0 2024-05-08T09:28:02.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.989+0000 7f4c8ebbcb80 1 client.19551 shutdown 2024-05-08T09:28:02.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.989+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/1490572253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f3a880 msgr2=0x564d48fb8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:02.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.989+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f3a880 0x564d48fb8a60 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f4c740057e0 tx=0x7f4c74005810 comp rx=0 tx=0).stop 2024-05-08T09:28:02.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.990+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/1490572253 shutdown_connections 2024-05-08T09:28:02.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.990+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564d48fba7b0 0x564d48fbcbd0 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:02.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.990+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564d48f3a880 0x564d48fb8a60 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:02.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.990+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564d48f34ab0 0x564d48f43a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:02.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.990+0000 7f4c8ebbcb80 1 --2- 172.21.15.70:0/1490572253 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564d48f39f60 0x564d48f43f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:02.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.990+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/1490572253 >> 172.21.15.70:0/1490572253 conn(0x564d48e62c60 msgr2=0x564d48f39450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:28:02.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.990+0000 7f4c63400700 0 client.19551 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:28:02.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.990+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/1490572253 shutdown_connections 2024-05-08T09:28:02.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.991+0000 7f4c8ebbcb80 1 -- 172.21.15.70:0/1490572253 wait complete. 2024-05-08T09:28:02.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.991+0000 7f4c8ebbcb80 20 client.19551 trim_cache size 0 max 16384 2024-05-08T09:28:02.992 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:28:02.992 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:28:02.992 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:28:02.992 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 352, 2024-05-08T09:28:02.992 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:28:02.992 INFO:teuthology.orchestra.run.smithi070.stdout: "abd74652": { 2024-05-08T09:28:02.992 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 352, 2024-05-08T09:28:02.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:28:02.992 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 76.6, 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:28:02.993 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:28:02.994 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:28:02.994 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:28:02.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.992+0000 7f4c82c00700 1 -- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c640b2a70 msgr2=0x7f4c640b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:02.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c640b2a70 0x7f4c640b4f30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4c70009d10 tx=0x7f4c70009040 comp rx=0 tx=0).stop 2024-05-08T09:28:02.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 -- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c076160 msgr2=0x7f4c7c1a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:02.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c076160 0x7f4c7c1a0470 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800c9b0 tx=0x7f4c6800cd70 comp rx=0 tx=0).stop 2024-05-08T09:28:02.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 -- 172.21.15.70:0/2924764083 shutdown_connections 2024-05-08T09:28:02.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4c640b2a70 0x7f4c640b4f30 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:02.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c7c1143e0 0x7f4c7c1a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:02.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4c7c075840 0x7f4c7c19ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:02.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 --2- 172.21.15.70:0/2924764083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c7c076160 0x7f4c7c1a0470 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:02.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 -- 172.21.15.70:0/2924764083 >> 172.21.15.70:0/2924764083 conn(0x7f4c7c0fef20 msgr2=0x7f4c7c100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:28:02.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.993+0000 7f4c82c00700 1 -- 172.21.15.70:0/2924764083 shutdown_connections 2024-05-08T09:28:02.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:02.994+0000 7f4c82c00700 1 -- 172.21.15.70:0/2924764083 wait complete. 2024-05-08T09:28:03.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:02 smithi172 ceph-mon[33377]: pgmap v5151: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T09:28:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:02 smithi194 ceph-mon[33679]: pgmap v5151: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T09:28:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:02 smithi070 ceph-mon[29591]: pgmap v5151: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 5 op/s 2024-05-08T09:28:04.046 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'abd74652', seconds elapsed: 62.3 2024-05-08T09:28:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:04 smithi194 ceph-mon[33679]: pgmap v5152: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 120 KiB/s wr, 25 op/s 2024-05-08T09:28:05.363 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_gpu_error.o 2024-05-08T09:28:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:04 smithi070 ceph-mon[29591]: pgmap v5152: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 120 KiB/s wr, 25 op/s 2024-05-08T09:28:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:04 smithi172 ceph-mon[33377]: pgmap v5152: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 120 KiB/s wr, 25 op/s 2024-05-08T09:28:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:06 smithi194 ceph-mon[33679]: pgmap v5153: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 106 KiB/s wr, 22 op/s 2024-05-08T09:28:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:06 smithi070 ceph-mon[29591]: pgmap v5153: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 106 KiB/s wr, 22 op/s 2024-05-08T09:28:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:06 smithi172 ceph-mon[33377]: pgmap v5153: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 106 KiB/s wr, 22 op/s 2024-05-08T09:28:07.745 INFO:tasks.workunit.client.0.smithi070.stdout: CC drivers/gpu/drm/i915/i915_vgpu.o 2024-05-08T09:28:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:09 smithi070 ceph-mon[29591]: osdmap e399: 12 total, 12 up, 12 in 2024-05-08T09:28:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:09 smithi070 ceph-mon[29591]: pgmap v5155: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 567 KiB/s wr, 38 op/s 2024-05-08T09:28:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:09 smithi172 ceph-mon[33377]: osdmap e399: 12 total, 12 up, 12 in 2024-05-08T09:28:09.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:09 smithi172 ceph-mon[33377]: pgmap v5155: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 567 KiB/s wr, 38 op/s 2024-05-08T09:28:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:09 smithi194 ceph-mon[33679]: osdmap e399: 12 total, 12 up, 12 in 2024-05-08T09:28:09.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:09 smithi194 ceph-mon[33679]: pgmap v5155: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 567 KiB/s wr, 38 op/s 2024-05-08T09:28:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:10 smithi194 ceph-mon[33679]: pgmap v5156: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 567 KiB/s wr, 38 op/s 2024-05-08T09:28:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:10 smithi070 ceph-mon[29591]: pgmap v5156: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 567 KiB/s wr, 38 op/s 2024-05-08T09:28:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:10 smithi172 ceph-mon[33377]: pgmap v5156: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 567 KiB/s wr, 38 op/s 2024-05-08T09:28:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:12 smithi070 ceph-mon[29591]: osdmap e400: 12 total, 12 up, 12 in 2024-05-08T09:28:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:12 smithi172 ceph-mon[33377]: osdmap e400: 12 total, 12 up, 12 in 2024-05-08T09:28:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:12 smithi194 ceph-mon[33679]: osdmap e400: 12 total, 12 up, 12 in 2024-05-08T09:28:13.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:13 smithi070 ceph-mon[29591]: pgmap v5158: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 551 KiB/s wr, 18 op/s 2024-05-08T09:28:13.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:13 smithi172 ceph-mon[33377]: pgmap v5158: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 551 KiB/s wr, 18 op/s 2024-05-08T09:28:14.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:13 smithi194 ceph-mon[33679]: pgmap v5158: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 551 KiB/s wr, 18 op/s 2024-05-08T09:28:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:14 smithi194 ceph-mon[33679]: pgmap v5159: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 874 KiB/s wr, 27 op/s 2024-05-08T09:28:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:14 smithi070 ceph-mon[29591]: pgmap v5159: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 874 KiB/s wr, 27 op/s 2024-05-08T09:28:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:14 smithi172 ceph-mon[33377]: pgmap v5159: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 874 KiB/s wr, 27 op/s 2024-05-08T09:28:17.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:16 smithi194 ceph-mon[33679]: pgmap v5160: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 791 KiB/s wr, 24 op/s 2024-05-08T09:28:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:16 smithi070 ceph-mon[29591]: pgmap v5160: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 791 KiB/s wr, 24 op/s 2024-05-08T09:28:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:16 smithi172 ceph-mon[33377]: pgmap v5160: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 791 KiB/s wr, 24 op/s 2024-05-08T09:28:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:18 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:28:18.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:18 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:28:18.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:18 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:28:19.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:19 smithi070 ceph-mon[29591]: pgmap v5161: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 465 KiB/s wr, 19 op/s 2024-05-08T09:28:19.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:19 smithi172 ceph-mon[33377]: pgmap v5161: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 465 KiB/s wr, 19 op/s 2024-05-08T09:28:19.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:19 smithi194 ceph-mon[33679]: pgmap v5161: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 465 KiB/s wr, 19 op/s 2024-05-08T09:28:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:28:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:28:20.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:28:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:28:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:28:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:28:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:28:20.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:28:20.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:28:21.315 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/i915/built-in.a 2024-05-08T09:28:21.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:21 smithi070 ceph-mon[29591]: pgmap v5162: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 465 KiB/s wr, 19 op/s 2024-05-08T09:28:21.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:21 smithi172 ceph-mon[33377]: pgmap v5162: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 465 KiB/s wr, 19 op/s 2024-05-08T09:28:21.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:21 smithi194 ceph-mon[33679]: pgmap v5162: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 465 KiB/s wr, 19 op/s 2024-05-08T09:28:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:22 smithi194 ceph-mon[33679]: pgmap v5163: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 413 KiB/s wr, 17 op/s 2024-05-08T09:28:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:22 smithi070 ceph-mon[29591]: pgmap v5163: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 413 KiB/s wr, 17 op/s 2024-05-08T09:28:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:22 smithi172 ceph-mon[33377]: pgmap v5163: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 413 KiB/s wr, 17 op/s 2024-05-08T09:28:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:24 smithi194 ceph-mon[33679]: pgmap v5164: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 742 KiB/s wr, 28 op/s 2024-05-08T09:28:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:24 smithi070 ceph-mon[29591]: pgmap v5164: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 742 KiB/s wr, 28 op/s 2024-05-08T09:28:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:24 smithi172 ceph-mon[33377]: pgmap v5164: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 742 KiB/s wr, 28 op/s 2024-05-08T09:28:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:26 smithi194 ceph-mon[33679]: pgmap v5165: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 526 KiB/s wr, 22 op/s 2024-05-08T09:28:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:26 smithi070 ceph-mon[29591]: pgmap v5165: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 526 KiB/s wr, 22 op/s 2024-05-08T09:28:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:26 smithi172 ceph-mon[33377]: pgmap v5165: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 526 KiB/s wr, 22 op/s 2024-05-08T09:28:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:28 smithi194 ceph-mon[33679]: pgmap v5166: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 645 KiB/s wr, 26 op/s 2024-05-08T09:28:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:28 smithi070 ceph-mon[29591]: pgmap v5166: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 645 KiB/s wr, 26 op/s 2024-05-08T09:28:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:28 smithi172 ceph-mon[33377]: pgmap v5166: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 645 KiB/s wr, 26 op/s 2024-05-08T09:28:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:30 smithi194 ceph-mon[33679]: pgmap v5167: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 473 KiB/s wr, 16 op/s 2024-05-08T09:28:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:30 smithi070 ceph-mon[29591]: pgmap v5167: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 473 KiB/s wr, 16 op/s 2024-05-08T09:28:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:30 smithi172 ceph-mon[33377]: pgmap v5167: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 473 KiB/s wr, 16 op/s 2024-05-08T09:28:33.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:32 smithi172 ceph-mon[33377]: pgmap v5168: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 473 KiB/s wr, 16 op/s 2024-05-08T09:28:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:32 smithi194 ceph-mon[33679]: pgmap v5168: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 473 KiB/s wr, 16 op/s 2024-05-08T09:28:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:32 smithi070 ceph-mon[29591]: pgmap v5168: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 617 KiB/s rd, 473 KiB/s wr, 16 op/s 2024-05-08T09:28:34.876 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.7 2024-05-08T09:28:34.877 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:28:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:34 smithi194 ceph-mon[33679]: pgmap v5169: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 530 KiB/s wr, 19 op/s 2024-05-08T09:28:35.361 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:28:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:34 smithi070 ceph-mon[29591]: pgmap v5169: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 530 KiB/s wr, 19 op/s 2024-05-08T09:28:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:34 smithi172 ceph-mon[33377]: pgmap v5169: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 530 KiB/s wr, 19 op/s 2024-05-08T09:28:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:36 smithi194 ceph-mon[33679]: pgmap v5170: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 176 KiB/s wr, 7 op/s 2024-05-08T09:28:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:36 smithi070 ceph-mon[29591]: pgmap v5170: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 176 KiB/s wr, 7 op/s 2024-05-08T09:28:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:36 smithi172 ceph-mon[33377]: pgmap v5170: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 176 KiB/s wr, 7 op/s 2024-05-08T09:28:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.950+0000 7f9665400700 1 -- 172.21.15.70:0/478708638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 msgr2=0x7f9660105b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.950+0000 7f9665400700 1 --2- 172.21.15.70:0/478708638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 0x7f9660105b20 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f964c009990 tx=0x7f964c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:28:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.950+0000 7f9665400700 1 -- 172.21.15.70:0/478708638 shutdown_connections 2024-05-08T09:28:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.950+0000 7f9665400700 1 --2- 172.21.15.70:0/478708638 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9660106060 0x7f9660112570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.950+0000 7f9665400700 1 --2- 172.21.15.70:0/478708638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f966010b6a0 0x7f966010ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.950+0000 7f9665400700 1 --2- 172.21.15.70:0/478708638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 0x7f9660105b20 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.950+0000 7f9665400700 1 -- 172.21.15.70:0/478708638 >> 172.21.15.70:0/478708638 conn(0x7f96601011b0 msgr2=0x7f96601035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:28:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.950+0000 7f9665400700 1 -- 172.21.15.70:0/478708638 shutdown_connections 2024-05-08T09:28:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.950+0000 7f9665400700 1 -- 172.21.15.70:0/478708638 wait complete. 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.951+0000 7f9665400700 1 Processor -- start 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.952+0000 7f9665400700 1 -- start start 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.952+0000 7f9665400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 0x7f96601a1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.952+0000 7f9665400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9660106060 0x7f96601a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.952+0000 7f9665400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f966010b6a0 0x7f966019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.952+0000 7f9665400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96601157e0 con 0x7f96601056a0 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.952+0000 7f9665400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9660115660 con 0x7f9660106060 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.952+0000 7f9665400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9660115960 con 0x7f966010b6a0 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.952+0000 7f965e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 0x7f96601a1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 0x7f96601a1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40302/0 (socket says 172.21.15.70:40302) 2024-05-08T09:28:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965e800700 1 -- 172.21.15.70:0/4027624728 learned_addr learned my addr 172.21.15.70:0/4027624728 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:28:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965f200700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f966010b6a0 0x7f966019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965de00700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9660106060 0x7f96601a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965e800700 1 -- 172.21.15.70:0/4027624728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f966010b6a0 msgr2=0x7f966019ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965e800700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f966010b6a0 0x7f966019ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965e800700 1 -- 172.21.15.70:0/4027624728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9660106060 msgr2=0x7f96601a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965e800700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9660106060 0x7f96601a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965e800700 1 -- 172.21.15.70:0/4027624728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966019c160 con 0x7f96601056a0 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.953+0000 7f965f200700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f966010b6a0 0x7f966019ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.954+0000 7f965e800700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 0x7f96601a1840 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f965000c9b0 tx=0x7f965000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.954+0000 7f9657400700 1 -- 172.21.15.70:0/4027624728 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650007b00 con 0x7f96601056a0 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.954+0000 7f9657400700 1 -- 172.21.15.70:0/4027624728 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9650007ca0 con 0x7f96601056a0 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.954+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966019c450 con 0x7f96601056a0 2024-05-08T09:28:37.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.954+0000 7f9657400700 1 -- 172.21.15.70:0/4027624728 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9650018660 con 0x7f96601056a0 2024-05-08T09:28:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.954+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96601a8710 con 0x7f96601056a0 2024-05-08T09:28:37.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.956+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f966006a190 con 0x7f96601056a0 2024-05-08T09:28:37.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.958+0000 7f9657400700 1 -- 172.21.15.70:0/4027624728 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f965000f450 con 0x7f96601056a0 2024-05-08T09:28:37.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.959+0000 7f9657400700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96440b29f0 0x7f96440b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.960+0000 7f9657400700 1 -- 172.21.15.70:0/4027624728 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(400..400 src has 1..400) ==== 9583+0+0 (secure 0 0 0) 0x7f96500e2ad0 con 0x7f96601056a0 2024-05-08T09:28:37.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.960+0000 7f965de00700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96440b29f0 0x7f96440b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:37.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.961+0000 7f965de00700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96440b29f0 0x7f96440b4eb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f964c00b5c0 tx=0x7f964c01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:28:37.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:37.965+0000 7f9657400700 1 -- 172.21.15.70:0/4027624728 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9650014030 con 0x7f96601056a0 2024-05-08T09:28:38.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.277+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f966002e510 con 0x7f96601056a0 2024-05-08T09:28:38.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.278+0000 7f9657400700 1 -- 172.21.15.70:0/4027624728 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f96500aa030 con 0x7f96601056a0 2024-05-08T09:28:38.278 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:28:38.278 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:28:38.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.281+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96440b29f0 msgr2=0x7f96440b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:38.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.281+0000 7f9665400700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96440b29f0 0x7f96440b4eb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f964c00b5c0 tx=0x7f964c01a040 comp rx=0 tx=0).stop 2024-05-08T09:28:38.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.281+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 msgr2=0x7f96601a1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:38.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.281+0000 7f9665400700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 0x7f96601a1840 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f965000c9b0 tx=0x7f965000cd70 comp rx=0 tx=0).stop 2024-05-08T09:28:38.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.281+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 shutdown_connections 2024-05-08T09:28:38.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.282+0000 7f9665400700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96440b29f0 0x7f96440b4eb0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.282+0000 7f9665400700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f966010b6a0 0x7f966019ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.282+0000 7f9665400700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96601056a0 0x7f96601a1840 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.282+0000 7f9665400700 1 --2- 172.21.15.70:0/4027624728 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9660106060 0x7f96601a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.282+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 >> 172.21.15.70:0/4027624728 conn(0x7f96601011b0 msgr2=0x7f9660101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:28:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.282+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 shutdown_connections 2024-05-08T09:28:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:38.282+0000 7f9665400700 1 -- 172.21.15.70:0/4027624728 wait complete. 2024-05-08T09:28:38.282 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:28:38.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:38 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4027624728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:28:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:38 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4027624728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:28:38.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:38 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4027624728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:28:39.132 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0' 2024-05-08T09:28:39.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0 2024-05-08T09:28:39.613 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:28:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:39 smithi070 ceph-mon[29591]: pgmap v5171: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T09:28:39.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:39 smithi172 ceph-mon[33377]: pgmap v5171: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T09:28:39.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:39 smithi194 ceph-mon[33679]: pgmap v5171: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 176 KiB/s wr, 9 op/s 2024-05-08T09:28:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:40 smithi070 ceph-mon[29591]: pgmap v5172: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2024-05-08T09:28:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:40 smithi194 ceph-mon[33679]: pgmap v5172: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2024-05-08T09:28:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:40 smithi172 ceph-mon[33377]: pgmap v5172: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2024-05-08T09:28:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.134+0000 7faaae600700 1 -- 172.21.15.70:0/3630066261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8105840 msgr2=0x7faaa8105c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.134+0000 7faaae600700 1 --2- 172.21.15.70:0/3630066261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8105840 0x7faaa8105c20 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009990 tx=0x7faa9c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.134+0000 7faaae600700 1 -- 172.21.15.70:0/3630066261 shutdown_connections 2024-05-08T09:28:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.134+0000 7faaae600700 1 --2- 172.21.15.70:0/3630066261 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa8107810 0x7faaa81124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.134+0000 7faaae600700 1 --2- 172.21.15.70:0/3630066261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8105840 0x7faaa8105c20 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.134+0000 7faaae600700 1 --2- 172.21.15.70:0/3630066261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa8106160 0x7faaa81070e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.134+0000 7faaae600700 1 -- 172.21.15.70:0/3630066261 >> 172.21.15.70:0/3630066261 conn(0x7faaa8100fb0 msgr2=0x7faaa81033d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:28:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.134+0000 7faaae600700 1 -- 172.21.15.70:0/3630066261 shutdown_connections 2024-05-08T09:28:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.134+0000 7faaae600700 1 -- 172.21.15.70:0/3630066261 wait complete. 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.135+0000 7faaae600700 1 Processor -- start 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.135+0000 7faaae600700 1 -- start start 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.136+0000 7faaae600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa8105840 0x7faaa81a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.136+0000 7faaae600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa8106160 0x7faaa81a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.136+0000 7faaae600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8107810 0x7faaa819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.136+0000 7faaae600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faaa81156e0 con 0x7faaa8107810 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.136+0000 7faaae600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8115560 con 0x7faaa8105840 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.136+0000 7faaae600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8115860 con 0x7faaa8106160 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.136+0000 7faaadc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8107810 0x7faaa819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.136+0000 7faaadc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8107810 0x7faaa819b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40324/0 (socket says 172.21.15.70:40324) 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.136+0000 7faaadc00700 1 -- 172.21.15.70:0/3575475916 learned_addr learned my addr 172.21.15.70:0/3575475916 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:28:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.137+0000 7faaa7e00700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa8106160 0x7faaa81a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.137+0000 7faaad200700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa8105840 0x7faaa81a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.137+0000 7faaadc00700 1 -- 172.21.15.70:0/3575475916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa8106160 msgr2=0x7faaa81a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.137+0000 7faaadc00700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa8106160 0x7faaa81a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.137+0000 7faaadc00700 1 -- 172.21.15.70:0/3575475916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa8105840 msgr2=0x7faaa81a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.137+0000 7faaadc00700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa8105840 0x7faaa81a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.137+0000 7faaadc00700 1 -- 172.21.15.70:0/3575475916 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa819c100 con 0x7faaa8107810 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.137+0000 7faaadc00700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8107810 0x7faaa819b9a0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7faaa0007ee0 tx=0x7faaa000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.138+0000 7faaa5600700 1 -- 172.21.15.70:0/3575475916 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa0004bb0 con 0x7faaa8107810 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.138+0000 7faaa5600700 1 -- 172.21.15.70:0/3575475916 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faaa0004d50 con 0x7faaa8107810 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.138+0000 7faaa5600700 1 -- 172.21.15.70:0/3575475916 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa00058b0 con 0x7faaa8107810 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.138+0000 7faaae600700 1 -- 172.21.15.70:0/3575475916 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa819c3f0 con 0x7faaa8107810 2024-05-08T09:28:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.138+0000 7faaae600700 1 -- 172.21.15.70:0/3575475916 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa81a86b0 con 0x7faaa8107810 2024-05-08T09:28:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.142+0000 7faaa5600700 1 -- 172.21.15.70:0/3575475916 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7faaa001a020 con 0x7faaa8107810 2024-05-08T09:28:42.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.144+0000 7faaa5600700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faa900b2b20 0x7faa900b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.144+0000 7faaa5600700 1 -- 172.21.15.70:0/3575475916 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(400..400 src has 1..400) ==== 9583+0+0 (secure 0 0 0) 0x7faaa00e2070 con 0x7faaa8107810 2024-05-08T09:28:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.145+0000 7faaad200700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faa900b2b20 0x7faa900b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.145+0000 7faaad200700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faa900b2b20 0x7faa900b4fe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7faa9c003760 tx=0x7faa9c00b540 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:28:42.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.161+0000 7faaba4d1b80 1 Processor -- start 2024-05-08T09:28:42.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.162+0000 7faaba4d1b80 1 -- start start 2024-05-08T09:28:42.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.162+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c0546aff0 0x561c0546b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.162+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05465520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.162+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c05465b40 0x561c05465fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.162+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561c053b7bb0 con 0x561c0546b910 2024-05-08T09:28:42.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.162+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561c053558f0 con 0x561c05465b40 2024-05-08T09:28:42.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.162+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561c053b3b70 con 0x561c0546aff0 2024-05-08T09:28:42.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.163+0000 7faaa7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05465520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.163+0000 7faaa7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05465520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40330/0 (socket says 172.21.15.70:40330) 2024-05-08T09:28:42.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.163+0000 7faaa7e00700 1 -- 172.21.15.70:0/209250513 learned_addr learned my addr 172.21.15.70:0/209250513 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:28:42.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.163+0000 7faaa7e00700 1 -- 172.21.15.70:0/209250513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c0546aff0 msgr2=0x561c0546b3d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T09:28:42.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.163+0000 7faaa7e00700 1 --2- 172.21.15.70:0/209250513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c0546aff0 0x561c0546b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.163+0000 7faaa7e00700 1 -- 172.21.15.70:0/209250513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c05465b40 msgr2=0x561c05465fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T09:28:42.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.163+0000 7faaa7e00700 1 --2- 172.21.15.70:0/209250513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c05465b40 0x561c05465fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.163+0000 7faaa7e00700 1 -- 172.21.15.70:0/209250513 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c05304a60 con 0x561c0546b910 2024-05-08T09:28:42.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.163+0000 7faaa7e00700 1 --2- 172.21.15.70:0/209250513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05465520 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7faa940046c0 tx=0x7faa9400b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec1cdccb056dc77 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:28:42.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.164+0000 7faa9a000700 1 -- 172.21.15.70:0/209250513 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94004a30 con 0x561c0546b910 2024-05-08T09:28:42.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.164+0000 7faa9a000700 1 -- 172.21.15.70:0/209250513 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa94015070 con 0x561c0546b910 2024-05-08T09:28:42.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.164+0000 7faa9a000700 1 -- 172.21.15.70:0/209250513 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa94003a40 con 0x561c0546b910 2024-05-08T09:28:42.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.165+0000 7faaba4d1b80 1 -- 172.21.15.70:0/209250513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 msgr2=0x561c05465520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:42.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.165+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/209250513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05465520 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7faa940046c0 tx=0x7faa9400b9e0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.165+0000 7faaba4d1b80 1 -- 172.21.15.70:0/209250513 shutdown_connections 2024-05-08T09:28:42.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.165+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/209250513 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c05465b40 0x561c05465fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.165+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/209250513 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c0546aff0 0x561c0546b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.165+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/209250513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05465520 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.165+0000 7faaba4d1b80 1 -- 172.21.15.70:0/209250513 >> 172.21.15.70:0/209250513 conn(0x561c05393cf0 msgr2=0x561c05460080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:28:42.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.165+0000 7faaba4d1b80 1 -- 172.21.15.70:0/209250513 shutdown_connections 2024-05-08T09:28:42.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.165+0000 7faaba4d1b80 1 -- 172.21.15.70:0/209250513 wait complete. 2024-05-08T09:28:42.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.166+0000 7faaba4d1b80 1 -- start start 2024-05-08T09:28:42.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.166+0000 7faaba4d1b80 1 Processor -- start 2024-05-08T09:28:42.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c05465b40 0x561c05471680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 0x561c0546ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c0546b910 0x561c0546efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561c05472430 con 0x561c05465b40 2024-05-08T09:28:42.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x561c0531dcb0 con 0x561c0546aff0 2024-05-08T09:28:42.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x561c054725b0 con 0x561c0546b910 2024-05-08T09:28:42.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaba4d1b80 10 client.0 _ll_register_callbacks cb 0x561c0535ee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:28:42.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaad200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c05465b40 0x561c05471680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaad200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c05465b40 0x561c05471680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40338/0 (socket says 172.21.15.70:40338) 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaad200700 1 -- 172.21.15.70:0/3161035385 learned_addr learned my addr 172.21.15.70:0/3161035385 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.167+0000 7faaa7e00700 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 0x561c0546ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.168+0000 7faaad200700 1 -- 172.21.15.70:0/3161035385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c0546b910 msgr2=0x561c0546efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.168+0000 7faaad200700 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c0546b910 0x561c0546efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.168+0000 7faaad200700 1 -- 172.21.15.70:0/3161035385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 msgr2=0x561c0546ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.168+0000 7faaad200700 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 0x561c0546ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.168+0000 7faaad200700 1 -- 172.21.15.70:0/3161035385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c0537d5b0 con 0x561c05465b40 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.168+0000 7faaa7e00700 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 0x561c0546ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.168+0000 7faaad200700 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c05465b40 0x561c05471680 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009990 tx=0x7faa9c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93952fff80b20148 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.168+0000 7faa8ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.168+0000 7faa8ea00700 1 -- 172.21.15.70:0/3161035385 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00b9e0 con 0x561c05465b40 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.169+0000 7faa8ea00700 1 -- 172.21.15.70:0/3161035385 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(400..400 src has 1..400) ==== 9583+0+0 (secure 0 0 0) 0x7faa9c00bb80 con 0x561c05465b40 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.169+0000 7faaba4d1b80 1 -- 172.21.15.70:0/3161035385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa94015070 con 0x561c05465b40 2024-05-08T09:28:42.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.169+0000 7faa8ea00700 1 -- 172.21.15.70:0/3161035385 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7faa9c038050 con 0x561c05465b40 2024-05-08T09:28:42.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.169+0000 7faaba4d1b80 10 client.19569 fetch_fsmap learned FSMap version 42 2024-05-08T09:28:42.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.169+0000 7faaba4d1b80 1 -- 172.21.15.70:0/3161035385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x561c0547cca0 con 0x561c05465b40 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.169+0000 7faa8ea00700 1 -- 172.21.15.70:0/3161035385 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa94015070 con 0x561c05465b40 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.170+0000 7faa8ea00700 1 -- 172.21.15.70:0/3161035385 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7faa9c022410 con 0x561c05465b40 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.170+0000 7faaba4d1b80 10 client.19569 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.170+0000 7faaba4d1b80 10 client.19569 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.170+0000 7faaba4d1b80 20 client.19569 populate_metadata read hostname 'smithi070' 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.170+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c0547f330 0x561c05481780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.170+0000 7faaba4d1b80 4 client.19569 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.170+0000 7faaba4d1b80 1 -- 172.21.15.70:0/3161035385 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c05432230 con 0x561c0547f330 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.171+0000 7faaa7e00700 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c0547f330 0x561c05481780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.171+0000 7faa8ea00700 10 client.19569 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:28:42.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.171+0000 7faaa7e00700 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c0547f330 0x561c05481780 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a42a7669aee0ec94 server_cookie=555b48936287d34a in_seq=0 out_seq=0 2024-05-08T09:28:42.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.173+0000 7faa8ea00700 1 -- 172.21.15.70:0/3161035385 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561c05432230 con 0x561c0547f330 2024-05-08T09:28:42.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.173+0000 7faa8ea00700 10 client.19569 handle_command_reply: tid=0 2024-05-08T09:28:42.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.173+0000 7faaba4d1b80 1 client.19569 shutdown 2024-05-08T09:28:42.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 -- 172.21.15.70:0/3161035385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c05465b40 msgr2=0x561c05471680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c05465b40 0x561c05471680 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009990 tx=0x7faa9c009310 comp rx=0 tx=0).stop 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 -- 172.21.15.70:0/3161035385 shutdown_connections 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c0547f330 0x561c05481780 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c0546b910 0x561c0546efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c05465b40 0x561c05471680 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/3161035385 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 0x561c0546ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 -- 172.21.15.70:0/3161035385 >> 172.21.15.70:0/3161035385 conn(0x561c05393cf0 msgr2=0x561c05464510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faa8ea00700 0 client.19569 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 -- 172.21.15.70:0/3161035385 shutdown_connections 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 1 -- 172.21.15.70:0/3161035385 wait complete. 2024-05-08T09:28:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.174+0000 7faaba4d1b80 20 client.19569 trim_cache size 0 max 16384 2024-05-08T09:28:42.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.202+0000 7faaba4d1b80 1 Processor -- start 2024-05-08T09:28:42.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.203+0000 7faaba4d1b80 1 -- start start 2024-05-08T09:28:42.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.203+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c0547b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.203+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546aff0 0x561c0546c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.203+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546b910 0x561c05487050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.203+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faaa81b3eb0 con 0x561c0546aff0 2024-05-08T09:28:42.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.203+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faaa81b1740 con 0x561c0546b910 2024-05-08T09:28:42.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.203+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faaa81af5b0 con 0x561c05465b40 2024-05-08T09:28:42.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.203+0000 7faaa7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546aff0 0x561c0546c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaa7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546aff0 0x561c0546c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40352/0 (socket says 172.21.15.70:40352) 2024-05-08T09:28:42.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaa7e00700 1 -- 172.21.15.70:0/2617237265 learned_addr learned my addr 172.21.15.70:0/2617237265 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:28:42.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaad200700 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c0547b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaadc00700 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546b910 0x561c05487050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaad200700 1 -- 172.21.15.70:0/2617237265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546b910 msgr2=0x561c05487050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:28:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaad200700 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546b910 0x561c05487050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaad200700 1 -- 172.21.15.70:0/2617237265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546aff0 msgr2=0x561c0546c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:28:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaad200700 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546aff0 0x561c0546c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaad200700 1 -- 172.21.15.70:0/2617237265 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c05460380 con 0x561c05465b40 2024-05-08T09:28:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.204+0000 7faaa7e00700 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546aff0 0x561c0546c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:28:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.205+0000 7faaad200700 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c0547b4c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0229f0 tx=0x7faa9c022a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abd29a126fbabe49 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:28:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.205+0000 7faa99600700 1 -- 172.21.15.70:0/2617237265 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c041070 con 0x561c05465b40 2024-05-08T09:28:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.205+0000 7faa99600700 1 -- 172.21.15.70:0/2617237265 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa9c00be70 con 0x561c05465b40 2024-05-08T09:28:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.206+0000 7faa99600700 1 -- 172.21.15.70:0/2617237265 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00f9d0 con 0x561c05465b40 2024-05-08T09:28:42.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.206+0000 7faaba4d1b80 1 -- 172.21.15.70:0/2617237265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 msgr2=0x561c0547b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:28:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.206+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c0547b4c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0229f0 tx=0x7faa9c022a70 comp rx=0 tx=0).stop 2024-05-08T09:28:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.206+0000 7faaba4d1b80 1 -- 172.21.15.70:0/2617237265 shutdown_connections 2024-05-08T09:28:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.206+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546b910 0x561c05487050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.206+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c0547b4c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.206+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/2617237265 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546aff0 0x561c0546c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.207+0000 7faaba4d1b80 1 -- 172.21.15.70:0/2617237265 >> 172.21.15.70:0/2617237265 conn(0x561c05393cf0 msgr2=0x561c0546bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:28:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.207+0000 7faaba4d1b80 1 -- 172.21.15.70:0/2617237265 shutdown_connections 2024-05-08T09:28:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.207+0000 7faaba4d1b80 1 -- 172.21.15.70:0/2617237265 wait complete. 2024-05-08T09:28:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.207+0000 7faaba4d1b80 1 -- start start 2024-05-08T09:28:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.208+0000 7faaba4d1b80 1 Processor -- start 2024-05-08T09:28:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.208+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c05477b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.208+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 0x561c05473f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.208+0000 7faaba4d1b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05474450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.208+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7faaa81afc00 con 0x561c0546b910 2024-05-08T09:28:42.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.208+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7faaa81b1070 con 0x561c0546aff0 2024-05-08T09:28:42.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.208+0000 7faaba4d1b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7faaa81b02d0 con 0x561c05465b40 2024-05-08T09:28:42.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaba4d1b80 10 client.0 _ll_register_callbacks cb 0x561c0535ee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:28:42.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaadc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05474450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaad200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c05477b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaadc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05474450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40354/0 (socket says 172.21.15.70:40354) 2024-05-08T09:28:42.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaad200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c05477b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:41536/0 (socket says 172.21.15.70:41536) 2024-05-08T09:28:42.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaadc00700 1 -- 172.21.15.70:0/1223022043 learned_addr learned my addr 172.21.15.70:0/1223022043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:28:42.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaa7e00700 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 0x561c05473f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaadc00700 1 -- 172.21.15.70:0/1223022043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 msgr2=0x561c05477b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:28:42.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaadc00700 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c05477b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaadc00700 1 -- 172.21.15.70:0/1223022043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 msgr2=0x561c05473f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:28:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaadc00700 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 0x561c05473f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:28:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.209+0000 7faaadc00700 1 -- 172.21.15.70:0/1223022043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c05474a90 con 0x561c0546b910 2024-05-08T09:28:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.210+0000 7faaadc00700 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05474450 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7faaa000dfd0 tx=0x7faaa00a53c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d20571997ecf20d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:28:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.210+0000 7faa8ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:28:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.210+0000 7faa8ea00700 1 -- 172.21.15.70:0/1223022043 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa00a89e0 con 0x561c0546b910 2024-05-08T09:28:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.210+0000 7faa8ea00700 1 -- 172.21.15.70:0/1223022043 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(400..400 src has 1..400) ==== 9583+0+0 (secure 0 0 0) 0x7faaa00b1ab0 con 0x561c0546b910 2024-05-08T09:28:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.210+0000 7faaba4d1b80 1 -- 172.21.15.70:0/1223022043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa9c00be70 con 0x561c0546b910 2024-05-08T09:28:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.211+0000 7faa8ea00700 1 -- 172.21.15.70:0/1223022043 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7faaa00a95d0 con 0x561c0546b910 2024-05-08T09:28:42.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.211+0000 7faaba4d1b80 10 client.19575 fetch_fsmap learned FSMap version 42 2024-05-08T09:28:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.211+0000 7faaba4d1b80 1 -- 172.21.15.70:0/1223022043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x561c054eaa80 con 0x561c0546b910 2024-05-08T09:28:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.211+0000 7faa8ea00700 1 -- 172.21.15.70:0/1223022043 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa9c00be70 con 0x561c0546b910 2024-05-08T09:28:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.211+0000 7faa8ea00700 1 -- 172.21.15.70:0/1223022043 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7faaa00a8250 con 0x561c0546b910 2024-05-08T09:28:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.211+0000 7faaba4d1b80 10 client.19575 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:28:42.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.211+0000 7faaba4d1b80 10 client.19575 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:28:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.211+0000 7faaba4d1b80 20 client.19575 populate_metadata read hostname 'smithi070' 2024-05-08T09:28:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.212+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c054eb1d0 0x561c054ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:28:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.212+0000 7faaba4d1b80 4 client.19575 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}] 2024-05-08T09:28:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.212+0000 7faaba4d1b80 1 -- 172.21.15.70:0/1223022043 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}) -- 0x561c053c5590 con 0x561c054eb1d0 2024-05-08T09:28:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.212+0000 7faaad200700 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c054eb1d0 0x561c054ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:28:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.213+0000 7faaad200700 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c054eb1d0 0x561c054ed5f0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8be5cfd309c96709 server_cookie=62826aec366b5982 in_seq=0 out_seq=0 2024-05-08T09:28:42.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:28:42.213+0000 7faa8ea00700 10 client.19575 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:28:43.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:42 smithi194 ceph-mon[33679]: pgmap v5173: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2024-05-08T09:28:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:42 smithi070 ceph-mon[29591]: pgmap v5173: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2024-05-08T09:28:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:42 smithi172 ceph-mon[33377]: pgmap v5173: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 58 KiB/s wr, 5 op/s 2024-05-08T09:28:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:44 smithi194 ceph-mon[33679]: pgmap v5174: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 8 op/s 2024-05-08T09:28:45.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:44 smithi070 ceph-mon[29591]: pgmap v5174: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 8 op/s 2024-05-08T09:28:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:44 smithi172 ceph-mon[33377]: pgmap v5174: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 58 KiB/s wr, 8 op/s 2024-05-08T09:28:47.226 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:46 smithi070 ceph-mon[29591]: pgmap v5175: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:28:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:46 smithi194 ceph-mon[33679]: pgmap v5175: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:28:47.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:46 smithi172 ceph-mon[33377]: pgmap v5175: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:28:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:48 smithi194 ceph-mon[33679]: pgmap v5176: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:28:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:48 smithi070 ceph-mon[29591]: pgmap v5176: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:28:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:48 smithi172 ceph-mon[33377]: pgmap v5176: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:28:51.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:50 smithi194 ceph-mon[33679]: pgmap v5177: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:28:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:50 smithi070 ceph-mon[29591]: pgmap v5177: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:28:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:50 smithi172 ceph-mon[33377]: pgmap v5177: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:28:53.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:52 smithi194 ceph-mon[33679]: pgmap v5178: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:28:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:52 smithi070 ceph-mon[29591]: pgmap v5178: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:28:53.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:52 smithi172 ceph-mon[33377]: pgmap v5178: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:28:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:54 smithi194 ceph-mon[33679]: pgmap v5179: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 65 KiB/s wr, 31 op/s 2024-05-08T09:28:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:54 smithi070 ceph-mon[29591]: pgmap v5179: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 65 KiB/s wr, 31 op/s 2024-05-08T09:28:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:54 smithi172 ceph-mon[33377]: pgmap v5179: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 65 KiB/s wr, 31 op/s 2024-05-08T09:28:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:56 smithi194 ceph-mon[33679]: pgmap v5180: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-08T09:28:57.326 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:56 smithi070 ceph-mon[29591]: pgmap v5180: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-08T09:28:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:56 smithi172 ceph-mon[33377]: pgmap v5180: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-08T09:28:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:28:58 smithi194 ceph-mon[33679]: pgmap v5181: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-05-08T09:28:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:28:58 smithi070 ceph-mon[29591]: pgmap v5181: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-05-08T09:28:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:28:58 smithi172 ceph-mon[33377]: pgmap v5181: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-05-08T09:29:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:00 smithi194 ceph-mon[33679]: pgmap v5182: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-08T09:29:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:00 smithi070 ceph-mon[29591]: pgmap v5182: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-08T09:29:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:00 smithi172 ceph-mon[33377]: pgmap v5182: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-08T09:29:03.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:02 smithi172 ceph-mon[33377]: pgmap v5183: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-08T09:29:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:02 smithi194 ceph-mon[33679]: pgmap v5183: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-08T09:29:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:02 smithi070 ceph-mon[29591]: pgmap v5183: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 65 KiB/s wr, 29 op/s 2024-05-08T09:29:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:04 smithi194 ceph-mon[33679]: pgmap v5184: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 119 KiB/s wr, 33 op/s 2024-05-08T09:29:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:04 smithi070 ceph-mon[29591]: pgmap v5184: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 119 KiB/s wr, 33 op/s 2024-05-08T09:29:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:04 smithi172 ceph-mon[33377]: pgmap v5184: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 119 KiB/s wr, 33 op/s 2024-05-08T09:29:06.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.065+0000 7faa8ea00700 1 -- 172.21.15.70:0/1223022043 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x561c053c5590 con 0x561c054eb1d0 2024-05-08T09:29:06.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.065+0000 7faa8ea00700 10 client.19575 handle_command_reply: tid=0 2024-05-08T09:29:06.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.065+0000 7faaba4d1b80 1 client.19575 shutdown 2024-05-08T09:29:06.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.066+0000 7faaba4d1b80 1 -- 172.21.15.70:0/1223022043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 msgr2=0x561c05474450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:06.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.066+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05474450 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7faaa000dfd0 tx=0x7faaa00a53c0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.066+0000 7faaba4d1b80 1 -- 172.21.15.70:0/1223022043 shutdown_connections 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.066+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x561c054eb1d0 0x561c054ed5f0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.066+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561c0546b910 0x561c05474450 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.066+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561c05465b40 0x561c05477b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.066+0000 7faaba4d1b80 1 --2- 172.21.15.70:0/1223022043 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x561c0546aff0 0x561c05473f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.066+0000 7faa8ea00700 0 client.19575 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.066+0000 7faaba4d1b80 1 -- 172.21.15.70:0/1223022043 >> 172.21.15.70:0/1223022043 conn(0x561c05393cf0 msgr2=0x561c0546c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.067+0000 7faaba4d1b80 1 -- 172.21.15.70:0/1223022043 shutdown_connections 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.067+0000 7faaba4d1b80 1 -- 172.21.15.70:0/1223022043 wait complete. 2024-05-08T09:29:06.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.067+0000 7faaba4d1b80 20 client.19575 trim_cache size 0 max 16384 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 354, 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "c15d7972": { 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 354, 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:29:06.067 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 91.7, 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:06.068 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.068+0000 7faaae600700 1 -- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faa900b2b20 msgr2=0x7faa900b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.068+0000 7faaae600700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faa900b2b20 0x7faa900b4fe0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7faa9c003760 tx=0x7faa9c00b540 comp rx=0 tx=0).stop 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.068+0000 7faaae600700 1 -- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8107810 msgr2=0x7faaa819b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.068+0000 7faaae600700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8107810 0x7faaa819b9a0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7faaa0007ee0 tx=0x7faaa000d3b0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.068+0000 7faaae600700 1 -- 172.21.15.70:0/3575475916 shutdown_connections 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.068+0000 7faaae600700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7faa900b2b20 0x7faa900b4fe0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.068+0000 7faaae600700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7faaa8107810 0x7faaa819b9a0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.068+0000 7faaae600700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7faaa8105840 0x7faaa81a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.068+0000 7faaae600700 1 --2- 172.21.15.70:0/3575475916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faaa8106160 0x7faaa81a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.069+0000 7faaae600700 1 -- 172.21.15.70:0/3575475916 >> 172.21.15.70:0/3575475916 conn(0x7faaa8100fb0 msgr2=0x7faaa8102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:06.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.069+0000 7faaae600700 1 -- 172.21.15.70:0/3575475916 shutdown_connections 2024-05-08T09:29:06.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:06.069+0000 7faaae600700 1 -- 172.21.15.70:0/3575475916 wait complete. 2024-05-08T09:29:07.009 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c15d7972', quiesce took 32.1 seconds. Will release after: 31.7 2024-05-08T09:29:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:06 smithi194 ceph-mon[33679]: pgmap v5185: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2024-05-08T09:29:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:06 smithi070 ceph-mon[29591]: pgmap v5185: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2024-05-08T09:29:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:06 smithi172 ceph-mon[33377]: pgmap v5185: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 7 op/s 2024-05-08T09:29:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:08 smithi194 ceph-mon[33679]: pgmap v5186: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 158 KiB/s wr, 26 op/s 2024-05-08T09:29:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:08 smithi070 ceph-mon[29591]: pgmap v5186: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 158 KiB/s wr, 26 op/s 2024-05-08T09:29:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:08 smithi172 ceph-mon[33377]: pgmap v5186: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 158 KiB/s wr, 26 op/s 2024-05-08T09:29:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:11 smithi070 ceph-mon[29591]: osdmap e401: 12 total, 12 up, 12 in 2024-05-08T09:29:11.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:11 smithi070 ceph-mon[29591]: pgmap v5188: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 190 KiB/s wr, 27 op/s 2024-05-08T09:29:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:11 smithi172 ceph-mon[33377]: osdmap e401: 12 total, 12 up, 12 in 2024-05-08T09:29:11.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:11 smithi172 ceph-mon[33377]: pgmap v5188: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 190 KiB/s wr, 27 op/s 2024-05-08T09:29:12.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:11 smithi194 ceph-mon[33679]: osdmap e401: 12 total, 12 up, 12 in 2024-05-08T09:29:12.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:11 smithi194 ceph-mon[33679]: pgmap v5188: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 190 KiB/s wr, 27 op/s 2024-05-08T09:29:14.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:13 smithi194 ceph-mon[33679]: pgmap v5189: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 190 KiB/s wr, 27 op/s 2024-05-08T09:29:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:13 smithi070 ceph-mon[29591]: pgmap v5189: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 190 KiB/s wr, 27 op/s 2024-05-08T09:29:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:13 smithi172 ceph-mon[33377]: pgmap v5189: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 190 KiB/s wr, 27 op/s 2024-05-08T09:29:16.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:15 smithi194 ceph-mon[33679]: pgmap v5190: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 196 KiB/s wr, 26 op/s 2024-05-08T09:29:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:15 smithi070 ceph-mon[29591]: pgmap v5190: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 196 KiB/s wr, 26 op/s 2024-05-08T09:29:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:15 smithi172 ceph-mon[33377]: pgmap v5190: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 196 KiB/s wr, 26 op/s 2024-05-08T09:29:17.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:17 smithi172 ceph-mon[33377]: osdmap e402: 12 total, 12 up, 12 in 2024-05-08T09:29:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:17 smithi194 ceph-mon[33679]: osdmap e402: 12 total, 12 up, 12 in 2024-05-08T09:29:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:17 smithi070 ceph-mon[29591]: osdmap e402: 12 total, 12 up, 12 in 2024-05-08T09:29:18.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:18 smithi172 ceph-mon[33377]: pgmap v5192: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 4 op/s 2024-05-08T09:29:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:18 smithi194 ceph-mon[33679]: pgmap v5192: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 4 op/s 2024-05-08T09:29:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:18 smithi070 ceph-mon[29591]: pgmap v5192: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 87 KiB/s wr, 4 op/s 2024-05-08T09:29:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:20 smithi172 ceph-mon[33377]: pgmap v5193: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 8 op/s 2024-05-08T09:29:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:20 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:29:21.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:20 smithi194 ceph-mon[33679]: pgmap v5193: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 8 op/s 2024-05-08T09:29:21.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:20 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:29:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:20 smithi070 ceph-mon[29591]: pgmap v5193: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 84 KiB/s wr, 8 op/s 2024-05-08T09:29:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:20 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:29:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:29:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:29:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:29:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:29:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:29:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:29:22.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:29:22.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:29:22.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:29:22.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:22 smithi172 ceph-mon[33377]: pgmap v5194: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-05-08T09:29:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:22 smithi194 ceph-mon[33679]: pgmap v5194: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-05-08T09:29:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:22 smithi070 ceph-mon[29591]: pgmap v5194: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-05-08T09:29:24.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:24 smithi172 ceph-mon[33377]: pgmap v5195: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-05-08T09:29:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:24 smithi194 ceph-mon[33679]: pgmap v5195: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-05-08T09:29:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:24 smithi070 ceph-mon[29591]: pgmap v5195: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 70 KiB/s wr, 6 op/s 2024-05-08T09:29:27.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:26 smithi194 ceph-mon[33679]: pgmap v5196: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:29:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:26 smithi070 ceph-mon[29591]: pgmap v5196: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:29:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:26 smithi172 ceph-mon[33377]: pgmap v5196: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:29:29.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:28 smithi194 ceph-mon[33679]: pgmap v5197: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:29:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:28 smithi070 ceph-mon[29591]: pgmap v5197: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:29:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:28 smithi172 ceph-mon[33377]: pgmap v5197: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:29:31.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:30 smithi194 ceph-mon[33679]: pgmap v5198: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:29:31.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:30 smithi070 ceph-mon[29591]: pgmap v5198: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:29:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:30 smithi172 ceph-mon[33377]: pgmap v5198: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:29:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:32 smithi194 ceph-mon[33679]: pgmap v5199: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:32 smithi070 ceph-mon[29591]: pgmap v5199: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:32 smithi172 ceph-mon[33377]: pgmap v5199: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:34.982 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:34 smithi172 ceph-mon[33377]: pgmap v5200: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:34 smithi194 ceph-mon[33679]: pgmap v5200: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:34 smithi070 ceph-mon[29591]: pgmap v5200: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:37.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:36 smithi194 ceph-mon[33679]: pgmap v5201: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:36 smithi070 ceph-mon[29591]: pgmap v5201: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:36 smithi172 ceph-mon[33377]: pgmap v5201: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:38.710 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:29:39.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:38 smithi194 ceph-mon[33679]: pgmap v5202: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:38 smithi070 ceph-mon[29591]: pgmap v5202: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:38 smithi172 ceph-mon[33377]: pgmap v5202: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:29:41.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:40 smithi194 ceph-mon[33679]: pgmap v5203: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:41.044 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:40 smithi070 ceph-mon[29591]: pgmap v5203: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:40 smithi172 ceph-mon[33377]: pgmap v5203: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:41.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.606+0000 7f33f6e00700 1 -- 172.21.15.70:0/3903167754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103ef0 msgr2=0x7f33f01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:41.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.606+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3903167754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103ef0 0x7f33f01103d0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f33e800b0a0 tx=0x7f33e800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.606+0000 7f33f6e00700 1 -- 172.21.15.70:0/3903167754 shutdown_connections 2024-05-08T09:29:41.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.606+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3903167754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103ef0 0x7f33f01103d0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.606+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3903167754 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f0108460 0x7f33f0108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.606+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3903167754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f0103550 0x7f33f01039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.606+0000 7f33f6e00700 1 -- 172.21.15.70:0/3903167754 >> 172.21.15.70:0/3903167754 conn(0x7f33f007a600 msgr2=0x7f33f007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:41.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.606+0000 7f33f6e00700 1 -- 172.21.15.70:0/3903167754 shutdown_connections 2024-05-08T09:29:41.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.607+0000 7f33f6e00700 1 -- 172.21.15.70:0/3903167754 wait complete. 2024-05-08T09:29:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.607+0000 7f33f6e00700 1 Processor -- start 2024-05-08T09:29:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33f6e00700 1 -- start start 2024-05-08T09:29:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33f6e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103550 0x7f33f019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33f6e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f0103ef0 0x7f33f019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33f6e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f0108460 0x7f33f0199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:41.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33f6e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f33f0113650 con 0x7f33f0103550 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33f6e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01134d0 con 0x7f33f0103ef0 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33f6e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f33f01137d0 con 0x7f33f0108460 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33efe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103550 0x7f33f019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33efe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103550 0x7f33f019f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41530/0 (socket says 172.21.15.70:41530) 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.608+0000 7f33efe00700 1 -- 172.21.15.70:0/3423951587 learned_addr learned my addr 172.21.15.70:0/3423951587 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.609+0000 7f33efe00700 1 -- 172.21.15.70:0/3423951587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f0108460 msgr2=0x7f33f0199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.609+0000 7f33efe00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f0108460 0x7f33f0199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.609+0000 7f33efe00700 1 -- 172.21.15.70:0/3423951587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f0103ef0 msgr2=0x7f33f019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.609+0000 7f33efe00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f0103ef0 0x7f33f019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.609+0000 7f33efe00700 1 -- 172.21.15.70:0/3423951587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f019a0b0 con 0x7f33f0103550 2024-05-08T09:29:41.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.609+0000 7f33efe00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103550 0x7f33f019f790 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f33e000b500 tx=0x7f33e000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:29:41.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.610+0000 7f33ecc00700 1 -- 172.21.15.70:0/3423951587 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0015020 con 0x7f33f0103550 2024-05-08T09:29:41.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.610+0000 7f33ecc00700 1 -- 172.21.15.70:0/3423951587 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33e0011cc0 con 0x7f33f0103550 2024-05-08T09:29:41.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.610+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f019a3a0 con 0x7f33f0103550 2024-05-08T09:29:41.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.610+0000 7f33ecc00700 1 -- 172.21.15.70:0/3423951587 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0010ca0 con 0x7f33f0103550 2024-05-08T09:29:41.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.610+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f01a6660 con 0x7f33f0103550 2024-05-08T09:29:41.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.611+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f010ba90 con 0x7f33f0103550 2024-05-08T09:29:41.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.613+0000 7f33ecc00700 1 -- 172.21.15.70:0/3423951587 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f33e0018020 con 0x7f33f0103550 2024-05-08T09:29:41.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.615+0000 7f33ecc00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33d40b2a70 0x7f33d40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:41.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.615+0000 7f33ecc00700 1 -- 172.21.15.70:0/3423951587 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(402..402 src has 1..402) ==== 9583+0+0 (secure 0 0 0) 0x7f33e00e2140 con 0x7f33f0103550 2024-05-08T09:29:41.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.615+0000 7f33ef400700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33d40b2a70 0x7f33d40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:41.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.616+0000 7f33ef400700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33d40b2a70 0x7f33d40b4f30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f33dc005950 tx=0x7f33dc0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:29:41.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.619+0000 7f33ecc00700 1 -- 172.21.15.70:0/3423951587 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f33e001f020 con 0x7f33f0103550 2024-05-08T09:29:41.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.903+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33f006a190 con 0x7f33f0103550 2024-05-08T09:29:41.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.904+0000 7f33ecc00700 1 -- 172.21.15.70:0/3423951587 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f33e00a97b0 con 0x7f33f0103550 2024-05-08T09:29:41.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:29:41.903 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:29:41.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33d40b2a70 msgr2=0x7f33d40b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:41.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33d40b2a70 0x7f33d40b4f30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f33dc005950 tx=0x7f33dc0058e0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103550 msgr2=0x7f33f019f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:41.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103550 0x7f33f019f790 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f33e000b500 tx=0x7f33e000b8c0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 shutdown_connections 2024-05-08T09:29:41.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f33d40b2a70 0x7f33d40b4f30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33f0108460 0x7f33f0199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f33f0103550 0x7f33f019f790 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 --2- 172.21.15.70:0/3423951587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f33f0103ef0 0x7f33f019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:41.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 >> 172.21.15.70:0/3423951587 conn(0x7f33f007a600 msgr2=0x7f33f0101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:41.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 shutdown_connections 2024-05-08T09:29:41.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:41.908+0000 7f33f6e00700 1 -- 172.21.15.70:0/3423951587 wait complete. 2024-05-08T09:29:41.908 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:29:43.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:42 smithi194 ceph-mon[33679]: pgmap v5204: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:43.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:42 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3423951587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:29:43.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:42 smithi070 ceph-mon[29591]: pgmap v5204: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:43.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:42 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3423951587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:29:43.134 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id c15d7972 --release --await' 2024-05-08T09:29:43.135 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id c15d7972 --release --await 2024-05-08T09:29:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:42 smithi172 ceph-mon[33377]: pgmap v5204: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:42 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3423951587' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:29:43.638 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:29:45.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:44 smithi194 ceph-mon[33679]: pgmap v5205: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:44 smithi070 ceph-mon[29591]: pgmap v5205: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:44 smithi172 ceph-mon[33377]: pgmap v5205: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:45.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.973+0000 7f649d600700 1 -- 172.21.15.70:0/3814986009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6498101cf0 msgr2=0x7f64981020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:45.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.973+0000 7f649d600700 1 --2- 172.21.15.70:0/3814986009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6498101cf0 0x7f64981020d0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f6488009990 tx=0x7f6488009ca0 comp rx=0 tx=0).stop 2024-05-08T09:29:45.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.973+0000 7f649d600700 1 -- 172.21.15.70:0/3814986009 shutdown_connections 2024-05-08T09:29:45.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.973+0000 7f649d600700 1 --2- 172.21.15.70:0/3814986009 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64981140a0 0x7f6498116540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:45.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.973+0000 7f649d600700 1 --2- 172.21.15.70:0/3814986009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6498101cf0 0x7f64981020d0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:45.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.973+0000 7f649d600700 1 --2- 172.21.15.70:0/3814986009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64981026a0 0x7f64981139e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:45.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.973+0000 7f649d600700 1 -- 172.21.15.70:0/3814986009 >> 172.21.15.70:0/3814986009 conn(0x7f6498078a10 msgr2=0x7f64980ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:45.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.974+0000 7f649d600700 1 -- 172.21.15.70:0/3814986009 shutdown_connections 2024-05-08T09:29:45.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.974+0000 7f649d600700 1 -- 172.21.15.70:0/3814986009 wait complete. 2024-05-08T09:29:45.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.975+0000 7f649d600700 1 Processor -- start 2024-05-08T09:29:45.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.975+0000 7f649d600700 1 -- start start 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.975+0000 7f649d600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6498101cf0 0x7f64981a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.975+0000 7f649d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64981026a0 0x7f64981a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.975+0000 7f649d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64981140a0 0x7f64981a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.975+0000 7f649d600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6498119b10 con 0x7f64981140a0 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.975+0000 7f649d600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6498119990 con 0x7f64981026a0 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.975+0000 7f649d600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6498119c90 con 0x7f6498101cf0 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6497400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64981140a0 0x7f64981a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6497400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64981140a0 0x7f64981a48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41534/0 (socket says 172.21.15.70:41534) 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6497400700 1 -- 172.21.15.70:0/2648218782 learned_addr learned my addr 172.21.15.70:0/2648218782 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6496a00700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6498101cf0 0x7f64981a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6496000700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64981026a0 0x7f64981a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6497400700 1 -- 172.21.15.70:0/2648218782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6498101cf0 msgr2=0x7f64981a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6497400700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6498101cf0 0x7f64981a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:45.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6497400700 1 -- 172.21.15.70:0/2648218782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64981026a0 msgr2=0x7f64981a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:45.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6497400700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64981026a0 0x7f64981a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:45.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6497400700 1 -- 172.21.15.70:0/2648218782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64981a5030 con 0x7f64981140a0 2024-05-08T09:29:45.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6496a00700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6498101cf0 0x7f64981a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:29:45.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.976+0000 7f6497400700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64981140a0 0x7f64981a48f0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f6490007d70 tx=0x7f649000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:29:45.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.977+0000 7f648f400700 1 -- 172.21.15.70:0/2648218782 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490016020 con 0x7f64981140a0 2024-05-08T09:29:45.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.977+0000 7f648f400700 1 -- 172.21.15.70:0/2648218782 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f649000ad40 con 0x7f64981140a0 2024-05-08T09:29:45.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.977+0000 7f649d600700 1 -- 172.21.15.70:0/2648218782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64981a5320 con 0x7f64981140a0 2024-05-08T09:29:45.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.977+0000 7f648f400700 1 -- 172.21.15.70:0/2648218782 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900115e0 con 0x7f64981140a0 2024-05-08T09:29:45.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.977+0000 7f649d600700 1 -- 172.21.15.70:0/2648218782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64981acba0 con 0x7f64981140a0 2024-05-08T09:29:45.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.980+0000 7f648f400700 1 -- 172.21.15.70:0/2648218782 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6490019020 con 0x7f64981140a0 2024-05-08T09:29:45.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.982+0000 7f648f400700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f647c0b2a70 0x7f647c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:45.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.982+0000 7f648f400700 1 -- 172.21.15.70:0/2648218782 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(402..402 src has 1..402) ==== 9583+0+0 (secure 0 0 0) 0x7f64900e28f0 con 0x7f64981140a0 2024-05-08T09:29:45.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.982+0000 7f6496a00700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f647c0b2a70 0x7f647c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:45.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.983+0000 7f6496a00700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f647c0b2a70 0x7f647c0b4f30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6488006010 tx=0x7f648801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:29:45.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.997+0000 7f64a7ff6b80 1 Processor -- start 2024-05-08T09:29:45.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.997+0000 7f64a7ff6b80 1 -- start start 2024-05-08T09:29:45.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.997+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7840d1b0 0x562d7840d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:45.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.997+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78407780 0x562d78407c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:45.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.997+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78413f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:45.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.997+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562d78359b20 con 0x562d78408140 2024-05-08T09:29:45.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.997+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d782f7860 con 0x562d7840d1b0 2024-05-08T09:29:45.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.997+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562d78355ae0 con 0x562d78407780 2024-05-08T09:29:45.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6497400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78413f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:45.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6497400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78413f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41540/0 (socket says 172.21.15.70:41540) 2024-05-08T09:29:45.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6497400700 1 -- 172.21.15.70:0/383790269 learned_addr learned my addr 172.21.15.70:0/383790269 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:29:45.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6496000700 1 --2- 172.21.15.70:0/383790269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78407780 0x562d78407c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:45.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6496a00700 1 --2- 172.21.15.70:0/383790269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7840d1b0 0x562d7840d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6497400700 1 -- 172.21.15.70:0/383790269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78407780 msgr2=0x562d78407c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:29:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6497400700 1 --2- 172.21.15.70:0/383790269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78407780 0x562d78407c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6497400700 1 -- 172.21.15.70:0/383790269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7840d1b0 msgr2=0x562d7840d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:29:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6497400700 1 --2- 172.21.15.70:0/383790269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7840d1b0 0x562d7840d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.998+0000 7f6497400700 1 -- 172.21.15.70:0/383790269 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d782a69d0 con 0x562d78408140 2024-05-08T09:29:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.999+0000 7f6497400700 1 --2- 172.21.15.70:0/383790269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78413f70 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f64900a58e0 tx=0x7f64900a5050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb01f0fcace43f36 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:29:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.999+0000 7f6483e00700 1 -- 172.21.15.70:0/383790269 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900a9f60 con 0x562d78408140 2024-05-08T09:29:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.999+0000 7f6483e00700 1 -- 172.21.15.70:0/383790269 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64900a9860 con 0x562d78408140 2024-05-08T09:29:45.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:45.999+0000 7f6483e00700 1 -- 172.21.15.70:0/383790269 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900a9d20 con 0x562d78408140 2024-05-08T09:29:46.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.000+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/383790269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 msgr2=0x562d78413f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:46.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.000+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/383790269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78413f70 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f64900a58e0 tx=0x7f64900a5050 comp rx=0 tx=0).stop 2024-05-08T09:29:46.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.000+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/383790269 shutdown_connections 2024-05-08T09:29:46.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.000+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/383790269 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78413f70 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.000+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/383790269 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7840d1b0 0x562d7840d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.000+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/383790269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78407780 0x562d78407c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.000+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/383790269 >> 172.21.15.70:0/383790269 conn(0x562d7837f7d0 msgr2=0x562d78402070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:46.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.000+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/383790269 shutdown_connections 2024-05-08T09:29:46.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.000+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/383790269 wait complete. 2024-05-08T09:29:46.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.001+0000 7f64a7ff6b80 1 -- start start 2024-05-08T09:29:46.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.001+0000 7f64a7ff6b80 1 Processor -- start 2024-05-08T09:29:46.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 0x562d78413bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 0x562d78410f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7840d1b0 0x562d784114b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562d78414570 con 0x562d7840d1b0 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562d782bfc20 con 0x562d78407780 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562d784146f0 con 0x562d78408140 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f64a7ff6b80 10 client.0 _ll_register_callbacks cb 0x562d78300d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f6497400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7840d1b0 0x562d784114b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f6497400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7840d1b0 0x562d784114b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41548/0 (socket says 172.21.15.70:41548) 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f6497400700 1 -- 172.21.15.70:0/707448854 learned_addr learned my addr 172.21.15.70:0/707448854 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.002+0000 7f6496a00700 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 0x562d78413bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6496000700 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 0x562d78410f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6497400700 1 -- 172.21.15.70:0/707448854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 msgr2=0x562d78410f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:29:46.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6497400700 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 0x562d78410f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6497400700 1 -- 172.21.15.70:0/707448854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 msgr2=0x562d78413bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6497400700 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 0x562d78413bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6497400700 1 -- 172.21.15.70:0/707448854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d7831f520 con 0x562d7840d1b0 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6497400700 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7840d1b0 0x562d784114b0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f64900a97f0 tx=0x7f6490006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d26d91fae8e19 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6480c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6480c00700 1 -- 172.21.15.70:0/707448854 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900c9060 con 0x562d7840d1b0 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f6480c00700 1 -- 172.21.15.70:0/707448854 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(402..402 src has 1..402) ==== 9583+0+0 (secure 0 0 0) 0x7f64900a5e50 con 0x562d7840d1b0 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.003+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/707448854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64900a9860 con 0x562d7840d1b0 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f6480c00700 1 -- 172.21.15.70:0/707448854 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f64900c2030 con 0x562d7840d1b0 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f64a7ff6b80 10 client.19593 fetch_fsmap learned FSMap version 42 2024-05-08T09:29:46.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/707448854 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562d78414570 con 0x562d7840d1b0 2024-05-08T09:29:46.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f6480c00700 1 -- 172.21.15.70:0/707448854 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64900a9860 con 0x562d7840d1b0 2024-05-08T09:29:46.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f6480c00700 1 -- 172.21.15.70:0/707448854 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f64900e2450 con 0x562d7840d1b0 2024-05-08T09:29:46.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f64a7ff6b80 10 client.19593 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:29:46.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f64a7ff6b80 10 client.19593 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:29:46.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f64a7ff6b80 20 client.19593 populate_metadata read hostname 'smithi070' 2024-05-08T09:29:46.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562d784210d0 0x562d784234c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f64a7ff6b80 4 client.19593 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:29:46.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.004+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/707448854 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d783d4240 con 0x562d784210d0 2024-05-08T09:29:46.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.005+0000 7f6496a00700 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562d784210d0 0x562d784234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.006+0000 7f6496a00700 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562d784210d0 0x562d784234c0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdd997c6d994182a server_cookie=8b518dd481291760 in_seq=0 out_seq=0 2024-05-08T09:29:46.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.006+0000 7f6480c00700 10 client.19593 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:29:46.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f6480c00700 1 -- 172.21.15.70:0/707448854 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562d783d4240 con 0x562d784210d0 2024-05-08T09:29:46.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f6480c00700 10 client.19593 handle_command_reply: tid=0 2024-05-08T09:29:46.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f64a7ff6b80 1 client.19593 shutdown 2024-05-08T09:29:46.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/707448854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7840d1b0 msgr2=0x562d784114b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:46.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7840d1b0 0x562d784114b0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f64900a97f0 tx=0x7f6490006040 comp rx=0 tx=0).stop 2024-05-08T09:29:46.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/707448854 shutdown_connections 2024-05-08T09:29:46.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562d784210d0 0x562d784234c0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7840d1b0 0x562d784114b0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 0x562d78413bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/707448854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 0x562d78410f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f6480c00700 0 client.19593 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:29:46.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.008+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/707448854 >> 172.21.15.70:0/707448854 conn(0x562d7837f7d0 msgr2=0x562d783fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:46.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.009+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/707448854 shutdown_connections 2024-05-08T09:29:46.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.009+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/707448854 wait complete. 2024-05-08T09:29:46.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.009+0000 7f64a7ff6b80 20 client.19593 trim_cache size 0 max 16384 2024-05-08T09:29:46.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.031+0000 7f64a7ff6b80 1 Processor -- start 2024-05-08T09:29:46.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.031+0000 7f64a7ff6b80 1 -- start start 2024-05-08T09:29:46.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.031+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7837f7d0 0x562d7841d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.031+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78407780 0x562d78406e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.031+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78428ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.031+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64981b8500 con 0x562d78408140 2024-05-08T09:29:46.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.031+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64981b5d90 con 0x562d7837f7d0 2024-05-08T09:29:46.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.031+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64981b3c00 con 0x562d78407780 2024-05-08T09:29:46.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6497400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78428ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6497400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78428ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41554/0 (socket says 172.21.15.70:41554) 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6497400700 1 -- 172.21.15.70:0/3666020450 learned_addr learned my addr 172.21.15.70:0/3666020450 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6496a00700 1 --2- 172.21.15.70:0/3666020450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7837f7d0 0x562d7841d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6497400700 1 -- 172.21.15.70:0/3666020450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78407780 msgr2=0x562d78406e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6497400700 1 --2- 172.21.15.70:0/3666020450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78407780 0x562d78406e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6497400700 1 -- 172.21.15.70:0/3666020450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7837f7d0 msgr2=0x562d7841d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6497400700 1 --2- 172.21.15.70:0/3666020450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7837f7d0 0x562d7841d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6497400700 1 -- 172.21.15.70:0/3666020450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d783fec70 con 0x562d78408140 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6496a00700 1 --2- 172.21.15.70:0/3666020450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7837f7d0 0x562d7841d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.032+0000 7f6497400700 1 --2- 172.21.15.70:0/3666020450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78428ac0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f64900b2190 tx=0x7f64900b0f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6c406afc44c21b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f6483400700 1 -- 172.21.15.70:0/3666020450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900c9070 con 0x562d78408140 2024-05-08T09:29:46.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f6483400700 1 -- 172.21.15.70:0/3666020450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64900a9860 con 0x562d78408140 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f6483400700 1 -- 172.21.15.70:0/3666020450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64900a9cd0 con 0x562d78408140 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/3666020450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 msgr2=0x562d78428ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/3666020450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78428ac0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f64900b2190 tx=0x7f64900b0f90 comp rx=0 tx=0).stop 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/3666020450 shutdown_connections 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/3666020450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d78408140 0x562d78428ac0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/3666020450 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d7837f7d0 0x562d7841d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/3666020450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78407780 0x562d78406e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.033+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/3666020450 >> 172.21.15.70:0/3666020450 conn(0x562d7840b850 msgr2=0x562d78406770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.034+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/3666020450 shutdown_connections 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.034+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/3666020450 wait complete. 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.034+0000 7f64a7ff6b80 1 -- start start 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.034+0000 7f64a7ff6b80 1 Processor -- start 2024-05-08T09:29:46.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7837f7d0 0x562d78416cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 0x562d78417210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f64a7ff6b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 0x562d7848b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64981b4250 con 0x562d7837f7d0 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f64981b56c0 con 0x562d78407780 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f64a7ff6b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f64981b4920 con 0x562d78408140 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f64a7ff6b80 10 client.0 _ll_register_callbacks cb 0x562d78300d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7837f7d0 0x562d78416cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7837f7d0 0x562d78416cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41564/0 (socket says 172.21.15.70:41564) 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496a00700 1 -- 172.21.15.70:0/538992896 learned_addr learned my addr 172.21.15.70:0/538992896 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496000700 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 0x562d78417210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6497400700 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 0x562d7848b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496a00700 1 -- 172.21.15.70:0/538992896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 msgr2=0x562d7848b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496a00700 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 0x562d7848b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496a00700 1 -- 172.21.15.70:0/538992896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 msgr2=0x562d78417210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496a00700 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 0x562d78417210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496a00700 1 -- 172.21.15.70:0/538992896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d7848bcc0 con 0x562d7837f7d0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6496000700 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 0x562d78417210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.035+0000 7f6497400700 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 0x562d7848b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.036+0000 7f6496a00700 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7837f7d0 0x562d78416cd0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f6488000c00 tx=0x7f6488009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17551bb74bfa7fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.036+0000 7f6480c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.036+0000 7f6480c00700 1 -- 172.21.15.70:0/538992896 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648800b9d0 con 0x562d7837f7d0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.036+0000 7f6480c00700 1 -- 172.21.15.70:0/538992896 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(402..402 src has 1..402) ==== 9583+0+0 (secure 0 0 0) 0x7f648800bb70 con 0x562d7837f7d0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.036+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/538992896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64900a9860 con 0x562d7837f7d0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.036+0000 7f6480c00700 1 -- 172.21.15.70:0/538992896 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6488041050 con 0x562d7837f7d0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.036+0000 7f64a7ff6b80 10 client.19599 fetch_fsmap learned FSMap version 42 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.036+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/538992896 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562d7848cf50 con 0x562d7837f7d0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.037+0000 7f6480c00700 1 -- 172.21.15.70:0/538992896 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f64900a9860 con 0x562d7837f7d0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.037+0000 7f6480c00700 1 -- 172.21.15.70:0/538992896 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f6488022070 con 0x562d7837f7d0 2024-05-08T09:29:46.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.037+0000 7f64a7ff6b80 10 client.19599 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:29:46.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.037+0000 7f64a7ff6b80 10 client.19599 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:29:46.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.037+0000 7f64a7ff6b80 20 client.19599 populate_metadata read hostname 'smithi070' 2024-05-08T09:29:46.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.037+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562d7840d1b0 0x562d7848f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:29:46.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.037+0000 7f64a7ff6b80 4 client.19599 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c15d7972", "release": true, "await": true}] 2024-05-08T09:29:46.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.037+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/538992896 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c15d7972", "release": true, "await": true}) -- 0x562d784025d0 con 0x562d7840d1b0 2024-05-08T09:29:46.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.038+0000 7f6496000700 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562d7840d1b0 0x562d7848f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:29:46.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.039+0000 7f6496000700 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562d7840d1b0 0x562d7848f690 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d48e4796430f81 server_cookie=321b713406dd0bba in_seq=0 out_seq=0 2024-05-08T09:29:46.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:46.039+0000 7f6480c00700 10 client.19599 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:29:47.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:46 smithi194 ceph-mon[33679]: pgmap v5206: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:46 smithi070 ceph-mon[29591]: pgmap v5206: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:47.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:46 smithi172 ceph-mon[33377]: pgmap v5206: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:49.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:48 smithi194 ceph-mon[33679]: pgmap v5207: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:48 smithi070 ceph-mon[29591]: pgmap v5207: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:49.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:48 smithi172 ceph-mon[33377]: pgmap v5207: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:50.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.625+0000 7f6480c00700 1 -- 172.21.15.70:0/538992896 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562d784025d0 con 0x562d7840d1b0 2024-05-08T09:29:50.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.625+0000 7f6480c00700 10 client.19599 handle_command_reply: tid=0 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.625+0000 7f64a7ff6b80 1 client.19599 shutdown 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.625+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/538992896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7837f7d0 msgr2=0x562d78416cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.625+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7837f7d0 0x562d78416cd0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f6488000c00 tx=0x7f6488009310 comp rx=0 tx=0).stop 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.626+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/538992896 shutdown_connections 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.626+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562d7840d1b0 0x562d7848f690 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.626+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562d78408140 0x562d7848b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.626+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562d7837f7d0 0x562d78416cd0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.626+0000 7f6480c00700 0 client.19599 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.626+0000 7f64a7ff6b80 1 --2- 172.21.15.70:0/538992896 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562d78407780 0x562d78417210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:50.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.626+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/538992896 >> 172.21.15.70:0/538992896 conn(0x562d7840b850 msgr2=0x562d78407000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:50.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.626+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/538992896 shutdown_connections 2024-05-08T09:29:50.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.626+0000 7f64a7ff6b80 1 -- 172.21.15.70:0/538992896 wait complete. 2024-05-08T09:29:50.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.627+0000 7f64a7ff6b80 20 client.19599 trim_cache size 0 max 16384 2024-05-08T09:29:50.627 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:29:50.627 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 356, 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "c15d7972": { 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 356, 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 91.7, 2024-05-08T09:29:50.628 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:29:50.629 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:29:50.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 -- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f647c0b2a70 msgr2=0x7f647c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:50.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f647c0b2a70 0x7f647c0b4f30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6488006010 tx=0x7f648801a040 comp rx=0 tx=0).stop 2024-05-08T09:29:50.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 -- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64981140a0 msgr2=0x7f64981a48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:29:50.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64981140a0 0x7f64981a48f0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f6490007d70 tx=0x7f649000a340 comp rx=0 tx=0).stop 2024-05-08T09:29:50.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 -- 172.21.15.70:0/2648218782 shutdown_connections 2024-05-08T09:29:50.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f647c0b2a70 0x7f647c0b4f30 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:50.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64981140a0 0x7f64981a48f0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:50.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6498101cf0 0x7f64981a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:50.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 --2- 172.21.15.70:0/2648218782 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f64981026a0 0x7f64981a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:29:50.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.629+0000 7f649d600700 1 -- 172.21.15.70:0/2648218782 >> 172.21.15.70:0/2648218782 conn(0x7f6498078a10 msgr2=0x7f64981129d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:29:50.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.630+0000 7f649d600700 1 -- 172.21.15.70:0/2648218782 shutdown_connections 2024-05-08T09:29:50.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:29:50.630+0000 7f649d600700 1 -- 172.21.15.70:0/2648218782 wait complete. 2024-05-08T09:29:50.774 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/drm/built-in.a 2024-05-08T09:29:50.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:50 smithi070 ceph-mon[29591]: pgmap v5208: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:50 smithi194 ceph-mon[33679]: pgmap v5208: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:51.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:50 smithi172 ceph-mon[33377]: pgmap v5208: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:29:51.567 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c15d7972', seconds elapsed: 76.7 2024-05-08T09:29:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:52 smithi070 ceph-mon[29591]: pgmap v5209: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:52 smithi172 ceph-mon[33377]: pgmap v5209: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:52 smithi194 ceph-mon[33679]: pgmap v5209: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:54 smithi070 ceph-mon[29591]: pgmap v5210: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:54 smithi172 ceph-mon[33377]: pgmap v5210: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:54 smithi194 ceph-mon[33679]: pgmap v5210: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:29:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:56 smithi070 ceph-mon[29591]: pgmap v5211: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 186 KiB/s wr, 15 op/s 2024-05-08T09:29:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:56 smithi172 ceph-mon[33377]: pgmap v5211: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 186 KiB/s wr, 15 op/s 2024-05-08T09:29:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:56 smithi194 ceph-mon[33679]: pgmap v5211: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 186 KiB/s wr, 15 op/s 2024-05-08T09:29:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:29:58 smithi070 ceph-mon[29591]: pgmap v5212: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 186 KiB/s wr, 12 op/s 2024-05-08T09:29:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:29:58 smithi172 ceph-mon[33377]: pgmap v5212: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 186 KiB/s wr, 12 op/s 2024-05-08T09:29:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:29:58 smithi194 ceph-mon[33679]: pgmap v5212: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 186 KiB/s wr, 12 op/s 2024-05-08T09:30:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:00 smithi070 ceph-mon[29591]: pgmap v5213: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 186 KiB/s wr, 16 op/s 2024-05-08T09:30:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T09:30:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:00 smithi172 ceph-mon[33377]: pgmap v5213: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 186 KiB/s wr, 16 op/s 2024-05-08T09:30:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T09:30:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:00 smithi194 ceph-mon[33679]: pgmap v5213: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 186 KiB/s wr, 16 op/s 2024-05-08T09:30:01.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T09:30:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:02 smithi070 ceph-mon[29591]: pgmap v5214: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 186 KiB/s wr, 13 op/s 2024-05-08T09:30:03.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:02 smithi172 ceph-mon[33377]: pgmap v5214: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 186 KiB/s wr, 13 op/s 2024-05-08T09:30:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:02 smithi194 ceph-mon[33679]: pgmap v5214: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 186 KiB/s wr, 13 op/s 2024-05-08T09:30:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:04 smithi070 ceph-mon[29591]: pgmap v5215: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 186 KiB/s wr, 13 op/s 2024-05-08T09:30:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:04 smithi172 ceph-mon[33377]: pgmap v5215: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 186 KiB/s wr, 13 op/s 2024-05-08T09:30:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:04 smithi194 ceph-mon[33679]: pgmap v5215: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 186 KiB/s wr, 13 op/s 2024-05-08T09:30:07.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:06 smithi070 ceph-mon[29591]: pgmap v5216: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 416 KiB/s wr, 34 op/s 2024-05-08T09:30:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:06 smithi172 ceph-mon[33377]: pgmap v5216: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 416 KiB/s wr, 34 op/s 2024-05-08T09:30:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:06 smithi194 ceph-mon[33679]: pgmap v5216: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 416 KiB/s wr, 34 op/s 2024-05-08T09:30:09.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:08 smithi070 ceph-mon[29591]: pgmap v5217: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 230 KiB/s wr, 23 op/s 2024-05-08T09:30:09.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:08 smithi172 ceph-mon[33377]: pgmap v5217: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 230 KiB/s wr, 23 op/s 2024-05-08T09:30:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:08 smithi194 ceph-mon[33679]: pgmap v5217: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 230 KiB/s wr, 23 op/s 2024-05-08T09:30:10.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:10 smithi172 ceph-mon[33377]: pgmap v5218: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 230 KiB/s wr, 27 op/s 2024-05-08T09:30:11.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:10 smithi070 ceph-mon[29591]: pgmap v5218: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 230 KiB/s wr, 27 op/s 2024-05-08T09:30:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:10 smithi194 ceph-mon[33679]: pgmap v5218: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 230 KiB/s wr, 27 op/s 2024-05-08T09:30:12.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:11 smithi070 ceph-mon[29591]: osdmap e403: 12 total, 12 up, 12 in 2024-05-08T09:30:12.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:11 smithi172 ceph-mon[33377]: osdmap e403: 12 total, 12 up, 12 in 2024-05-08T09:30:12.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:11 smithi194 ceph-mon[33679]: osdmap e403: 12 total, 12 up, 12 in 2024-05-08T09:30:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:12 smithi070 ceph-mon[29591]: pgmap v5220: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 276 KiB/s wr, 28 op/s 2024-05-08T09:30:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:12 smithi172 ceph-mon[33377]: pgmap v5220: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 276 KiB/s wr, 28 op/s 2024-05-08T09:30:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:12 smithi194 ceph-mon[33679]: pgmap v5220: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 276 KiB/s wr, 28 op/s 2024-05-08T09:30:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:14 smithi070 ceph-mon[29591]: pgmap v5221: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 276 KiB/s wr, 28 op/s 2024-05-08T09:30:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:14 smithi172 ceph-mon[33377]: pgmap v5221: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 276 KiB/s wr, 28 op/s 2024-05-08T09:30:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:14 smithi194 ceph-mon[33679]: pgmap v5221: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 276 KiB/s wr, 28 op/s 2024-05-08T09:30:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:16 smithi070 ceph-mon[29591]: pgmap v5222: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-08T09:30:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:16 smithi070 ceph-mon[29591]: osdmap e404: 12 total, 12 up, 12 in 2024-05-08T09:30:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:16 smithi172 ceph-mon[33377]: pgmap v5222: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-08T09:30:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:16 smithi172 ceph-mon[33377]: osdmap e404: 12 total, 12 up, 12 in 2024-05-08T09:30:17.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:16 smithi194 ceph-mon[33679]: pgmap v5222: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-08T09:30:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:16 smithi194 ceph-mon[33679]: osdmap e404: 12 total, 12 up, 12 in 2024-05-08T09:30:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:18 smithi070 ceph-mon[29591]: pgmap v5224: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T09:30:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:18 smithi172 ceph-mon[33377]: pgmap v5224: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T09:30:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:18 smithi194 ceph-mon[33679]: pgmap v5224: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T09:30:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:20 smithi172 ceph-mon[33377]: pgmap v5225: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 378 B/s wr, 8 op/s 2024-05-08T09:30:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:20 smithi194 ceph-mon[33679]: pgmap v5225: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 378 B/s wr, 8 op/s 2024-05-08T09:30:21.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:20 smithi070 ceph-mon[29591]: pgmap v5225: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 378 B/s wr, 8 op/s 2024-05-08T09:30:21.941 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/gpu/built-in.a 2024-05-08T09:30:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:22 smithi172 ceph-mon[33377]: pgmap v5226: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:30:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:22 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:30:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:22 smithi194 ceph-mon[33679]: pgmap v5226: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:30:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:22 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:30:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:22 smithi070 ceph-mon[29591]: pgmap v5226: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:30:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:22 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:30:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:30:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:30:24.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:30:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:30:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:30:24.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:30:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:30:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:30:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:30:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:24 smithi172 ceph-mon[33377]: pgmap v5227: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:30:25.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:24 smithi194 ceph-mon[33679]: pgmap v5227: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:30:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:24 smithi070 ceph-mon[29591]: pgmap v5227: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:30:27.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:26 smithi172 ceph-mon[33377]: pgmap v5228: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 129 KiB/s wr, 11 op/s 2024-05-08T09:30:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:26 smithi194 ceph-mon[33679]: pgmap v5228: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 129 KiB/s wr, 11 op/s 2024-05-08T09:30:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:26 smithi070 ceph-mon[29591]: pgmap v5228: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 129 KiB/s wr, 11 op/s 2024-05-08T09:30:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:28 smithi172 ceph-mon[33377]: pgmap v5229: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 125 KiB/s wr, 11 op/s 2024-05-08T09:30:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:28 smithi194 ceph-mon[33679]: pgmap v5229: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 125 KiB/s wr, 11 op/s 2024-05-08T09:30:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:28 smithi070 ceph-mon[29591]: pgmap v5229: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 125 KiB/s wr, 11 op/s 2024-05-08T09:30:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:30 smithi172 ceph-mon[33377]: pgmap v5230: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 181 KiB/s wr, 13 op/s 2024-05-08T09:30:31.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:30 smithi194 ceph-mon[33679]: pgmap v5230: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 181 KiB/s wr, 13 op/s 2024-05-08T09:30:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:30 smithi070 ceph-mon[29591]: pgmap v5230: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 181 KiB/s wr, 13 op/s 2024-05-08T09:30:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:32 smithi194 ceph-mon[33679]: pgmap v5231: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 181 KiB/s wr, 10 op/s 2024-05-08T09:30:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:32 smithi070 ceph-mon[29591]: pgmap v5231: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 181 KiB/s wr, 10 op/s 2024-05-08T09:30:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:32 smithi172 ceph-mon[33377]: pgmap v5231: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 181 KiB/s wr, 10 op/s 2024-05-08T09:30:34.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:33 smithi194 ceph-mon[33679]: pgmap v5232: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 181 KiB/s wr, 10 op/s 2024-05-08T09:30:34.331 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:33 smithi172 ceph-mon[33377]: pgmap v5232: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 181 KiB/s wr, 10 op/s 2024-05-08T09:30:34.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:33 smithi070 ceph-mon[29591]: pgmap v5232: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 181 KiB/s wr, 10 op/s 2024-05-08T09:30:36.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:35 smithi194 ceph-mon[33679]: pgmap v5233: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 311 KiB/s wr, 13 op/s 2024-05-08T09:30:36.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:35 smithi070 ceph-mon[29591]: pgmap v5233: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 311 KiB/s wr, 13 op/s 2024-05-08T09:30:36.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:35 smithi172 ceph-mon[33377]: pgmap v5233: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 311 KiB/s wr, 13 op/s 2024-05-08T09:30:38.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:38 smithi194 ceph-mon[33679]: pgmap v5234: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 6 op/s 2024-05-08T09:30:38.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:37 smithi070 ceph-mon[29591]: pgmap v5234: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 6 op/s 2024-05-08T09:30:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:38 smithi172 ceph-mon[33377]: pgmap v5234: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 204 KiB/s wr, 6 op/s 2024-05-08T09:30:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:40 smithi194 ceph-mon[33679]: pgmap v5235: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 204 KiB/s wr, 8 op/s 2024-05-08T09:30:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:40 smithi070 ceph-mon[29591]: pgmap v5235: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 204 KiB/s wr, 8 op/s 2024-05-08T09:30:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:40 smithi172 ceph-mon[33377]: pgmap v5235: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 204 KiB/s wr, 8 op/s 2024-05-08T09:30:42.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:42 smithi070 ceph-mon[29591]: pgmap v5236: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 5 op/s 2024-05-08T09:30:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:42 smithi172 ceph-mon[33377]: pgmap v5236: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 5 op/s 2024-05-08T09:30:42.527 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:42 smithi194 ceph-mon[33679]: pgmap v5236: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 5 op/s 2024-05-08T09:30:44.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:44 smithi070 ceph-mon[29591]: pgmap v5237: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 5 op/s 2024-05-08T09:30:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:44 smithi172 ceph-mon[33377]: pgmap v5237: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 5 op/s 2024-05-08T09:30:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:44 smithi194 ceph-mon[33679]: pgmap v5237: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 130 KiB/s wr, 5 op/s 2024-05-08T09:30:46.313 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:46 smithi194 ceph-mon[33679]: pgmap v5238: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T09:30:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:46 smithi070 ceph-mon[29591]: pgmap v5238: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T09:30:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:46 smithi172 ceph-mon[33377]: pgmap v5238: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 130 KiB/s wr, 7 op/s 2024-05-08T09:30:47.239 INFO:tasks.workunit.client.0.smithi070.stdout: AR drivers/built-in.a 2024-05-08T09:30:48.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:48 smithi070 ceph-mon[29591]: pgmap v5239: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:30:48.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:48 smithi194 ceph-mon[33679]: pgmap v5239: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:30:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:48 smithi172 ceph-mon[33377]: pgmap v5239: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:30:50.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:50 smithi070 ceph-mon[29591]: pgmap v5240: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 68 KiB/s wr, 9 op/s 2024-05-08T09:30:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:50 smithi172 ceph-mon[33377]: pgmap v5240: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 68 KiB/s wr, 9 op/s 2024-05-08T09:30:50.440 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.7 2024-05-08T09:30:50.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:30:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:50 smithi194 ceph-mon[33679]: pgmap v5240: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 68 KiB/s wr, 9 op/s 2024-05-08T09:30:50.946 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:30:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:52 smithi070 ceph-mon[29591]: pgmap v5241: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 68 KiB/s wr, 6 op/s 2024-05-08T09:30:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:52 smithi172 ceph-mon[33377]: pgmap v5241: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 68 KiB/s wr, 6 op/s 2024-05-08T09:30:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:52 smithi194 ceph-mon[33679]: pgmap v5241: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 68 KiB/s wr, 6 op/s 2024-05-08T09:30:54.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.054+0000 7f6e51000700 1 -- 172.21.15.70:0/2979475477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c06bb40 msgr2=0x7f6e4c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:54.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.054+0000 7f6e51000700 1 --2- 172.21.15.70:0/2979475477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c06bb40 0x7f6e4c110330 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400b0a0 tx=0x7f6e4400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.054+0000 7f6e51000700 1 -- 172.21.15.70:0/2979475477 shutdown_connections 2024-05-08T09:30:54.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.054+0000 7f6e51000700 1 --2- 172.21.15.70:0/2979475477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c06bb40 0x7f6e4c110330 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.054+0000 7f6e51000700 1 --2- 172.21.15.70:0/2979475477 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e4c109510 0x7f6e4c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.054+0000 7f6e51000700 1 --2- 172.21.15.70:0/2979475477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e4c06b180 0x7f6e4c06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.054+0000 7f6e51000700 1 -- 172.21.15.70:0/2979475477 >> 172.21.15.70:0/2979475477 conn(0x7f6e4c079350 msgr2=0x7f6e4c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:30:54.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.054+0000 7f6e51000700 1 -- 172.21.15.70:0/2979475477 shutdown_connections 2024-05-08T09:30:54.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.055+0000 7f6e51000700 1 -- 172.21.15.70:0/2979475477 wait complete. 2024-05-08T09:30:54.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.056+0000 7f6e51000700 1 Processor -- start 2024-05-08T09:30:54.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.056+0000 7f6e51000700 1 -- start start 2024-05-08T09:30:54.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.057+0000 7f6e51000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e4c06b180 0x7f6e4c19f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:54.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.057+0000 7f6e51000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e4c06bb40 0x7f6e4c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:54.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.057+0000 7f6e51000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c109510 0x7f6e4c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:54.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.057+0000 7f6e51000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c113540 con 0x7f6e4c109510 2024-05-08T09:30:54.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.057+0000 7f6e51000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c1133c0 con 0x7f6e4c06b180 2024-05-08T09:30:54.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.057+0000 7f6e51000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4c1136c0 con 0x7f6e4c06bb40 2024-05-08T09:30:54.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.057+0000 7f6e4a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c109510 0x7f6e4c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:54.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.057+0000 7f6e4a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c109510 0x7f6e4c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52832/0 (socket says 172.21.15.70:52832) 2024-05-08T09:30:54.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.057+0000 7f6e4a800700 1 -- 172.21.15.70:0/2560467957 learned_addr learned my addr 172.21.15.70:0/2560467957 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:30:54.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.058+0000 7f6e49e00700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e4c06b180 0x7f6e4c19f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:54.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.058+0000 7f6e49400700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e4c06bb40 0x7f6e4c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:54.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.058+0000 7f6e4a800700 1 -- 172.21.15.70:0/2560467957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e4c06bb40 msgr2=0x7f6e4c19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:54.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.058+0000 7f6e4a800700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e4c06bb40 0x7f6e4c19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.058+0000 7f6e4a800700 1 -- 172.21.15.70:0/2560467957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e4c06b180 msgr2=0x7f6e4c19f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:54.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.058+0000 7f6e4a800700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e4c06b180 0x7f6e4c19f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.058+0000 7f6e4a800700 1 -- 172.21.15.70:0/2560467957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4c19a020 con 0x7f6e4c109510 2024-05-08T09:30:54.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.059+0000 7f6e4a800700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c109510 0x7f6e4c199840 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400b070 tx=0x7f6e44004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:30:54.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.059+0000 7f6e42a00700 1 -- 172.21.15.70:0/2560467957 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44021070 con 0x7f6e4c109510 2024-05-08T09:30:54.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.059+0000 7f6e42a00700 1 -- 172.21.15.70:0/2560467957 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6e44007b80 con 0x7f6e4c109510 2024-05-08T09:30:54.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.059+0000 7f6e42a00700 1 -- 172.21.15.70:0/2560467957 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e44004640 con 0x7f6e4c109510 2024-05-08T09:30:54.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.059+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4c19a2b0 con 0x7f6e4c109510 2024-05-08T09:30:54.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.060+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4c1a64d0 con 0x7f6e4c109510 2024-05-08T09:30:54.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.061+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4c104bd0 con 0x7f6e4c109510 2024-05-08T09:30:54.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.063+0000 7f6e42a00700 1 -- 172.21.15.70:0/2560467957 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6e44003a00 con 0x7f6e4c109510 2024-05-08T09:30:54.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.065+0000 7f6e42a00700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6e300b2a70 0x7f6e300b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.066+0000 7f6e42a00700 1 -- 172.21.15.70:0/2560467957 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(404..404 src has 1..404) ==== 9583+0+0 (secure 0 0 0) 0x7f6e4400f020 con 0x7f6e4c109510 2024-05-08T09:30:54.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.066+0000 7f6e49e00700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6e300b2a70 0x7f6e300b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:54.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.067+0000 7f6e49e00700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6e300b2a70 0x7f6e300b4f30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00abd0 tx=0x7f6e3c00a380 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:30:54.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.071+0000 7f6e42a00700 1 -- 172.21.15.70:0/2560467957 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6e4402a020 con 0x7f6e4c109510 2024-05-08T09:30:54.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.369+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e4c19ad20 con 0x7f6e4c109510 2024-05-08T09:30:54.369 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:54 smithi070 ceph-mon[29591]: pgmap v5242: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 68 KiB/s wr, 6 op/s 2024-05-08T09:30:54.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.371+0000 7f6e42a00700 1 -- 172.21.15.70:0/2560467957 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f6e440ab490 con 0x7f6e4c109510 2024-05-08T09:30:54.370 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:30:54.371 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.374+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6e300b2a70 msgr2=0x7f6e300b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.374+0000 7f6e51000700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6e300b2a70 0x7f6e300b4f30 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00abd0 tx=0x7f6e3c00a380 comp rx=0 tx=0).stop 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.374+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c109510 msgr2=0x7f6e4c199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.374+0000 7f6e51000700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c109510 0x7f6e4c199840 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f6e4400b070 tx=0x7f6e44004d50 comp rx=0 tx=0).stop 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.375+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 shutdown_connections 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.375+0000 7f6e51000700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6e300b2a70 0x7f6e300b4f30 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.375+0000 7f6e51000700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6e4c109510 0x7f6e4c199840 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.375+0000 7f6e51000700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6e4c06b180 0x7f6e4c19f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.375+0000 7f6e51000700 1 --2- 172.21.15.70:0/2560467957 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e4c06bb40 0x7f6e4c19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.375+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 >> 172.21.15.70:0/2560467957 conn(0x7f6e4c079350 msgr2=0x7f6e4c1010b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.375+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 shutdown_connections 2024-05-08T09:30:54.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:54.375+0000 7f6e51000700 1 -- 172.21.15.70:0/2560467957 wait complete. 2024-05-08T09:30:54.376 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:30:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:54 smithi172 ceph-mon[33377]: pgmap v5242: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 68 KiB/s wr, 6 op/s 2024-05-08T09:30:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:54 smithi194 ceph-mon[33679]: pgmap v5242: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 68 KiB/s wr, 6 op/s 2024-05-08T09:30:55.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:55 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2560467957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:30:55.323 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0' 2024-05-08T09:30:55.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 91.7 --await-for 42.0 2024-05-08T09:30:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:55 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2560467957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:30:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:55 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2560467957' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:30:55.820 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:30:56.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:56 smithi070 ceph-mon[29591]: pgmap v5243: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 206 KiB/s wr, 14 op/s 2024-05-08T09:30:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:56 smithi172 ceph-mon[33377]: pgmap v5243: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 206 KiB/s wr, 14 op/s 2024-05-08T09:30:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:56 smithi194 ceph-mon[33679]: pgmap v5243: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 206 KiB/s wr, 14 op/s 2024-05-08T09:30:58.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:30:58 smithi070 ceph-mon[29591]: pgmap v5244: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 206 KiB/s wr, 11 op/s 2024-05-08T09:30:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:30:58 smithi172 ceph-mon[33377]: pgmap v5244: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 206 KiB/s wr, 11 op/s 2024-05-08T09:30:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:30:58 smithi194 ceph-mon[33679]: pgmap v5244: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 211 KiB/s rd, 206 KiB/s wr, 11 op/s 2024-05-08T09:30:58.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.841+0000 7fea6b200700 1 -- 172.21.15.70:0/2625527611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 msgr2=0x7fea6410f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:58.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.841+0000 7fea6b200700 1 --2- 172.21.15.70:0/2625527611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 0x7fea6410f1d0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fea6000b0d0 tx=0x7fea6000b3e0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.841+0000 7fea6b200700 1 -- 172.21.15.70:0/2625527611 shutdown_connections 2024-05-08T09:30:58.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.841+0000 7fea6b200700 1 --2- 172.21.15.70:0/2625527611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 0x7fea6410f1d0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.841+0000 7fea6b200700 1 --2- 172.21.15.70:0/2625527611 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea64102540 0x7fea64102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.841+0000 7fea6b200700 1 --2- 172.21.15.70:0/2625527611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea64103e30 0x7fea641042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.841+0000 7fea6b200700 1 -- 172.21.15.70:0/2625527611 >> 172.21.15.70:0/2625527611 conn(0x7fea640fdcf0 msgr2=0x7fea64100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:30:58.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.841+0000 7fea6b200700 1 -- 172.21.15.70:0/2625527611 shutdown_connections 2024-05-08T09:30:58.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.841+0000 7fea6b200700 1 -- 172.21.15.70:0/2625527611 wait complete. 2024-05-08T09:30:58.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.842+0000 7fea6b200700 1 Processor -- start 2024-05-08T09:30:58.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.842+0000 7fea6b200700 1 -- start start 2024-05-08T09:30:58.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.843+0000 7fea6b200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea64102540 0x7fea641a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.843+0000 7fea6b200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea64103e30 0x7fea641a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.843+0000 7fea6b200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 0x7fea6419b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.843+0000 7fea6b200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea64113540 con 0x7fea641047f0 2024-05-08T09:30:58.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.843+0000 7fea6b200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea641133c0 con 0x7fea64103e30 2024-05-08T09:30:58.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.843+0000 7fea6b200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fea641136c0 con 0x7fea64102540 2024-05-08T09:30:58.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.843+0000 7fea6a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 0x7fea6419b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.843+0000 7fea6a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 0x7fea6419b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54906/0 (socket says 172.21.15.70:54906) 2024-05-08T09:30:58.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.843+0000 7fea6a800700 1 -- 172.21.15.70:0/279070498 learned_addr learned my addr 172.21.15.70:0/279070498 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:30:58.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.844+0000 7fea69e00700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea64102540 0x7fea641a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.844+0000 7fea69400700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea64103e30 0x7fea641a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.844+0000 7fea6a800700 1 -- 172.21.15.70:0/279070498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea64102540 msgr2=0x7fea641a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:58.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.844+0000 7fea6a800700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea64102540 0x7fea641a16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.844+0000 7fea6a800700 1 -- 172.21.15.70:0/279070498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea64103e30 msgr2=0x7fea641a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:58.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.844+0000 7fea6a800700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea64103e30 0x7fea641a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.844+0000 7fea6a800700 1 -- 172.21.15.70:0/279070498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6419c010 con 0x7fea641047f0 2024-05-08T09:30:58.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.844+0000 7fea6a800700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 0x7fea6419b8b0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fea600079a0 tx=0x7fea60007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:30:58.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.845+0000 7fea5ea00700 1 -- 172.21.15.70:0/279070498 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6001f070 con 0x7fea641047f0 2024-05-08T09:30:58.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.845+0000 7fea5ea00700 1 -- 172.21.15.70:0/279070498 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea60007d90 con 0x7fea641047f0 2024-05-08T09:30:58.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.845+0000 7fea5ea00700 1 -- 172.21.15.70:0/279070498 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6001b690 con 0x7fea641047f0 2024-05-08T09:30:58.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.845+0000 7fea6b200700 1 -- 172.21.15.70:0/279070498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6419c2a0 con 0x7fea641047f0 2024-05-08T09:30:58.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.846+0000 7fea6b200700 1 -- 172.21.15.70:0/279070498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea641a85c0 con 0x7fea641047f0 2024-05-08T09:30:58.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.850+0000 7fea5ea00700 1 -- 172.21.15.70:0/279070498 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fea60022070 con 0x7fea641047f0 2024-05-08T09:30:58.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.852+0000 7fea5ea00700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea4c0b2aa0 0x7fea4c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.853+0000 7fea5ea00700 1 -- 172.21.15.70:0/279070498 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(404..404 src has 1..404) ==== 9583+0+0 (secure 0 0 0) 0x7fea6000f020 con 0x7fea641047f0 2024-05-08T09:30:58.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.853+0000 7fea69e00700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea4c0b2aa0 0x7fea4c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.854+0000 7fea69e00700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea4c0b2aa0 0x7fea4c0b4f60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fea6419c9f0 tx=0x7fea58009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:30:58.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.864+0000 7fea7728ab80 1 Processor -- start 2024-05-08T09:30:58.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.864+0000 7fea7728ab80 1 -- start start 2024-05-08T09:30:58.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.865+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 0x562248d296c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.865+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d23810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.865+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 0x562248d24290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.865+0000 7fea7728ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562248c75bb0 con 0x562248d29c00 2024-05-08T09:30:58.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.865+0000 7fea7728ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562248c138f0 con 0x562248d23e30 2024-05-08T09:30:58.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.865+0000 7fea7728ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562248c71b70 con 0x562248d292e0 2024-05-08T09:30:58.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.865+0000 7fea69400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d23810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.865+0000 7fea69400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d23810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54920/0 (socket says 172.21.15.70:54920) 2024-05-08T09:30:58.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.865+0000 7fea69400700 1 -- 172.21.15.70:0/688519824 learned_addr learned my addr 172.21.15.70:0/688519824 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:30:58.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.866+0000 7fea69e00700 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 0x562248d296c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.866+0000 7fea6a800700 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 0x562248d24290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.866+0000 7fea69400700 1 -- 172.21.15.70:0/688519824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 msgr2=0x562248d296c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:30:58.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.866+0000 7fea69400700 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 0x562248d296c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.866+0000 7fea69400700 1 -- 172.21.15.70:0/688519824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 msgr2=0x562248d24290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:30:58.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.866+0000 7fea69400700 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 0x562248d24290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.866+0000 7fea69400700 1 -- 172.21.15.70:0/688519824 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562248bc2a60 con 0x562248d29c00 2024-05-08T09:30:58.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.866+0000 7fea6a800700 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 0x562248d24290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:30:58.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.867+0000 7fea69400700 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d23810 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fea5400dc40 tx=0x7fea5400df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427e69b168a16af7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:30:58.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.867+0000 7fea53400700 1 -- 172.21.15.70:0/688519824 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54015070 con 0x562248d29c00 2024-05-08T09:30:58.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.867+0000 7fea53400700 1 -- 172.21.15.70:0/688519824 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea54004830 con 0x562248d29c00 2024-05-08T09:30:58.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.867+0000 7fea53400700 1 -- 172.21.15.70:0/688519824 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54005540 con 0x562248d29c00 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.868+0000 7fea7728ab80 1 -- 172.21.15.70:0/688519824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 msgr2=0x562248d23810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.868+0000 7fea7728ab80 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d23810 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fea5400dc40 tx=0x7fea5400df50 comp rx=0 tx=0).stop 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.868+0000 7fea7728ab80 1 -- 172.21.15.70:0/688519824 shutdown_connections 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.868+0000 7fea7728ab80 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 0x562248d24290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.868+0000 7fea7728ab80 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 0x562248d296c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.868+0000 7fea7728ab80 1 --2- 172.21.15.70:0/688519824 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d23810 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.868+0000 7fea7728ab80 1 -- 172.21.15.70:0/688519824 >> 172.21.15.70:0/688519824 conn(0x562248c9b860 msgr2=0x562248d1e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.868+0000 7fea7728ab80 1 -- 172.21.15.70:0/688519824 shutdown_connections 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.868+0000 7fea7728ab80 1 -- 172.21.15.70:0/688519824 wait complete. 2024-05-08T09:30:58.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.869+0000 7fea7728ab80 1 -- start start 2024-05-08T09:30:58.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.869+0000 7fea7728ab80 1 Processor -- start 2024-05-08T09:30:58.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.870+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d23e30 0x562248d2f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.870+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d292e0 0x562248d2cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.870+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d29c00 0x562248d2d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.870+0000 7fea7728ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562248d30720 con 0x562248d23e30 2024-05-08T09:30:58.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.870+0000 7fea7728ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562248bdbcb0 con 0x562248d292e0 2024-05-08T09:30:58.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.870+0000 7fea7728ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562248d308a0 con 0x562248d29c00 2024-05-08T09:30:58.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.870+0000 7fea7728ab80 10 client.0 _ll_register_callbacks cb 0x562248c1ce00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:30:58.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.870+0000 7fea69e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d23e30 0x562248d2f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.870+0000 7fea69e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d23e30 0x562248d2f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54926/0 (socket says 172.21.15.70:54926) 2024-05-08T09:30:58.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.871+0000 7fea69e00700 1 -- 172.21.15.70:0/6927216 learned_addr learned my addr 172.21.15.70:0/6927216 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:30:58.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.871+0000 7fea6a800700 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d29c00 0x562248d2d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.871+0000 7fea69400700 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d292e0 0x562248d2cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.871+0000 7fea69e00700 1 -- 172.21.15.70:0/6927216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d29c00 msgr2=0x562248d2d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:30:58.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.871+0000 7fea69e00700 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d29c00 0x562248d2d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.871+0000 7fea69e00700 1 -- 172.21.15.70:0/6927216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d292e0 msgr2=0x562248d2cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:30:58.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.871+0000 7fea69e00700 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d292e0 0x562248d2cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.871+0000 7fea69e00700 1 -- 172.21.15.70:0/6927216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562248c3b5b0 con 0x562248d23e30 2024-05-08T09:30:58.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.872+0000 7fea69e00700 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d23e30 0x562248d2f890 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fea58012c40 tx=0x7fea580047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9412873d4891f3b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:30:58.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.872+0000 7fea47e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:30:58.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.872+0000 7fea47e00700 1 -- 172.21.15.70:0/6927216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea58020840 con 0x562248d23e30 2024-05-08T09:30:58.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.872+0000 7fea47e00700 1 -- 172.21.15.70:0/6927216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(404..404 src has 1..404) ==== 9583+0+0 (secure 0 0 0) 0x7fea580209e0 con 0x562248d23e30 2024-05-08T09:30:58.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.872+0000 7fea7728ab80 1 -- 172.21.15.70:0/6927216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea54004830 con 0x562248d23e30 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea47e00700 1 -- 172.21.15.70:0/6927216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fea58032050 con 0x562248d23e30 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea7728ab80 10 client.19617 fetch_fsmap learned FSMap version 42 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea7728ab80 1 -- 172.21.15.70:0/6927216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562248d3aff0 con 0x562248d23e30 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea47e00700 1 -- 172.21.15.70:0/6927216 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea54004830 con 0x562248d23e30 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea47e00700 1 -- 172.21.15.70:0/6927216 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fea5801fc60 con 0x562248d23e30 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea7728ab80 10 client.19617 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea7728ab80 10 client.19617 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea7728ab80 20 client.19617 populate_metadata read hostname 'smithi070' 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea7728ab80 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562248d3d630 0x562248d3fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.873+0000 7fea7728ab80 4 client.19617 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:30:58.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.874+0000 7fea7728ab80 1 -- 172.21.15.70:0/6927216 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562248cf02d0 con 0x562248d3d630 2024-05-08T09:30:58.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.874+0000 7fea69400700 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562248d3d630 0x562248d3fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.876+0000 7fea69400700 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562248d3d630 0x562248d3fa40 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d5f16844603c696 server_cookie=9c120db5da3e843e in_seq=0 out_seq=0 2024-05-08T09:30:58.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.876+0000 7fea47e00700 10 client.19617 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:30:58.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.877+0000 7fea47e00700 1 -- 172.21.15.70:0/6927216 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562248cf02d0 con 0x562248d3d630 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.877+0000 7fea47e00700 10 client.19617 handle_command_reply: tid=0 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 client.19617 shutdown 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 -- 172.21.15.70:0/6927216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d23e30 msgr2=0x562248d2f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d23e30 0x562248d2f890 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fea58012c40 tx=0x7fea580047c0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 -- 172.21.15.70:0/6927216 shutdown_connections 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562248d3d630 0x562248d3fa40 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d29c00 0x562248d2d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d23e30 0x562248d2f890 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 --2- 172.21.15.70:0/6927216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d292e0 0x562248d2cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 -- 172.21.15.70:0/6927216 >> 172.21.15.70:0/6927216 conn(0x562248c9b860 msgr2=0x562248d22800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea47e00700 0 client.19617 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.878+0000 7fea7728ab80 1 -- 172.21.15.70:0/6927216 shutdown_connections 2024-05-08T09:30:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.879+0000 7fea7728ab80 1 -- 172.21.15.70:0/6927216 wait complete. 2024-05-08T09:30:58.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.879+0000 7fea7728ab80 20 client.19617 trim_cache size 0 max 16384 2024-05-08T09:30:58.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.902+0000 7fea7728ab80 1 Processor -- start 2024-05-08T09:30:58.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.902+0000 7fea7728ab80 1 -- start start 2024-05-08T09:30:58.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.902+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d23e30 0x562248d2d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.902+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d292e0 0x562248d2b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.902+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d29c00 0x562248d2bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.902+0000 7fea7728ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea641b3cd0 con 0x562248d292e0 2024-05-08T09:30:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.902+0000 7fea7728ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea641b1560 con 0x562248d29c00 2024-05-08T09:30:58.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.902+0000 7fea7728ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fea641af3d0 con 0x562248d23e30 2024-05-08T09:30:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d292e0 0x562248d2b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d292e0 0x562248d2b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54930/0 (socket says 172.21.15.70:54930) 2024-05-08T09:30:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69400700 1 -- 172.21.15.70:0/585266720 learned_addr learned my addr 172.21.15.70:0/585266720 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:30:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69e00700 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d23e30 0x562248d2d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea6a800700 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d29c00 0x562248d2bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69400700 1 -- 172.21.15.70:0/585266720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d23e30 msgr2=0x562248d2d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:30:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69400700 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d23e30 0x562248d2d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69400700 1 -- 172.21.15.70:0/585266720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d29c00 msgr2=0x562248d2bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:30:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69400700 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d29c00 0x562248d2bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69400700 1 -- 172.21.15.70:0/585266720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562248d1acb0 con 0x562248d292e0 2024-05-08T09:30:58.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.903+0000 7fea69e00700 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d23e30 0x562248d2d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:30:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.904+0000 7fea69400700 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d292e0 0x562248d2b590 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fea5400dc40 tx=0x7fea540048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ca6744b77902 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:30:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.904+0000 7fea52a00700 1 -- 172.21.15.70:0/585266720 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea54015040 con 0x562248d292e0 2024-05-08T09:30:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.904+0000 7fea52a00700 1 -- 172.21.15.70:0/585266720 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea5402d020 con 0x562248d292e0 2024-05-08T09:30:58.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.904+0000 7fea52a00700 1 -- 172.21.15.70:0/585266720 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5400fc40 con 0x562248d292e0 2024-05-08T09:30:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.905+0000 7fea7728ab80 1 -- 172.21.15.70:0/585266720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d292e0 msgr2=0x562248d2b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:30:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.905+0000 7fea7728ab80 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d292e0 0x562248d2b590 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fea5400dc40 tx=0x7fea540048a0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.905+0000 7fea7728ab80 1 -- 172.21.15.70:0/585266720 shutdown_connections 2024-05-08T09:30:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.905+0000 7fea7728ab80 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d29c00 0x562248d2bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.905+0000 7fea7728ab80 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d23e30 0x562248d2d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.905+0000 7fea7728ab80 1 --2- 172.21.15.70:0/585266720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d292e0 0x562248d2b590 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.905+0000 7fea7728ab80 1 -- 172.21.15.70:0/585266720 >> 172.21.15.70:0/585266720 conn(0x562248c9b860 msgr2=0x562248d23150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.906+0000 7fea7728ab80 1 -- 172.21.15.70:0/585266720 shutdown_connections 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.906+0000 7fea7728ab80 1 -- 172.21.15.70:0/585266720 wait complete. 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.906+0000 7fea7728ab80 1 -- start start 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.906+0000 7fea7728ab80 1 Processor -- start 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.907+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 0x562248d44e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.907+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 0x562248d45370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.907+0000 7fea7728ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.907+0000 7fea7728ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea641afa20 con 0x562248d29c00 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.907+0000 7fea7728ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea641b0e90 con 0x562248d23e30 2024-05-08T09:30:58.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.907+0000 7fea7728ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fea641b00f0 con 0x562248d292e0 2024-05-08T09:30:58.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.907+0000 7fea7728ab80 10 client.0 _ll_register_callbacks cb 0x562248c1ce00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:30:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea6a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea6a800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d458b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54940/0 (socket says 172.21.15.70:54940) 2024-05-08T09:30:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea6a800700 1 -- 172.21.15.70:0/2199924455 learned_addr learned my addr 172.21.15.70:0/2199924455 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:30:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea69e00700 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 0x562248d44e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea69400700 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 0x562248d45370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea6a800700 1 -- 172.21.15.70:0/2199924455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 msgr2=0x562248d45370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea6a800700 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 0x562248d45370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea6a800700 1 -- 172.21.15.70:0/2199924455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 msgr2=0x562248d44e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea6a800700 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 0x562248d44e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.908+0000 7fea6a800700 1 -- 172.21.15.70:0/2199924455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562248dafa10 con 0x562248d29c00 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.909+0000 7fea6a800700 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d458b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fea600a6cd0 tx=0x7fea600e1530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702159e97aa83542 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.909+0000 7fea47e00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.909+0000 7fea47e00700 1 -- 172.21.15.70:0/2199924455 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea60092040 con 0x562248d29c00 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.909+0000 7fea7728ab80 1 -- 172.21.15.70:0/2199924455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea5402d020 con 0x562248d29c00 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.909+0000 7fea47e00700 1 -- 172.21.15.70:0/2199924455 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(404..404 src has 1..404) ==== 9583+0+0 (secure 0 0 0) 0x7fea600b37a0 con 0x562248d29c00 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.909+0000 7fea47e00700 1 -- 172.21.15.70:0/2199924455 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fea600aa3c0 con 0x562248d29c00 2024-05-08T09:30:58.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.909+0000 7fea7728ab80 10 client.19623 fetch_fsmap learned FSMap version 42 2024-05-08T09:30:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.909+0000 7fea7728ab80 1 -- 172.21.15.70:0/2199924455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562248db0d30 con 0x562248d29c00 2024-05-08T09:30:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.910+0000 7fea47e00700 1 -- 172.21.15.70:0/2199924455 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea5402d020 con 0x562248d29c00 2024-05-08T09:30:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.910+0000 7fea47e00700 1 -- 172.21.15.70:0/2199924455 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fea600b3040 con 0x562248d29c00 2024-05-08T09:30:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.910+0000 7fea7728ab80 10 client.19623 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:30:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.910+0000 7fea7728ab80 10 client.19623 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:30:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.910+0000 7fea7728ab80 20 client.19623 populate_metadata read hostname 'smithi070' 2024-05-08T09:30:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.910+0000 7fea7728ab80 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562248db1450 0x562248db3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:30:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.910+0000 7fea7728ab80 4 client.19623 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}] 2024-05-08T09:30:58.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.910+0000 7fea7728ab80 1 -- 172.21.15.70:0/2199924455 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 91.7, "await_for": 42.0}) -- 0x562248c83590 con 0x562248db1450 2024-05-08T09:30:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.911+0000 7fea69e00700 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562248db1450 0x562248db3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:30:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.912+0000 7fea69e00700 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562248db1450 0x562248db3870 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd99004cd964f10d server_cookie=c20e4313e475b5ad in_seq=0 out_seq=0 2024-05-08T09:30:58.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:30:58.912+0000 7fea47e00700 10 client.19623 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:31:00.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:00 smithi070 ceph-mon[29591]: pgmap v5245: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 482 KiB/s wr, 16 op/s 2024-05-08T09:31:00.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:00 smithi172 ceph-mon[33377]: pgmap v5245: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 482 KiB/s wr, 16 op/s 2024-05-08T09:31:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:00 smithi194 ceph-mon[33679]: pgmap v5245: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 528 KiB/s rd, 482 KiB/s wr, 16 op/s 2024-05-08T09:31:02.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:02 smithi070 ceph-mon[29591]: pgmap v5246: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 414 KiB/s wr, 11 op/s 2024-05-08T09:31:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:02 smithi172 ceph-mon[33377]: pgmap v5246: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 414 KiB/s wr, 11 op/s 2024-05-08T09:31:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:02 smithi194 ceph-mon[33679]: pgmap v5246: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 414 KiB/s wr, 11 op/s 2024-05-08T09:31:04.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:04 smithi070 ceph-mon[29591]: pgmap v5247: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 414 KiB/s wr, 11 op/s 2024-05-08T09:31:04.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:04 smithi172 ceph-mon[33377]: pgmap v5247: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 414 KiB/s wr, 11 op/s 2024-05-08T09:31:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:04 smithi194 ceph-mon[33679]: pgmap v5247: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 466 KiB/s rd, 414 KiB/s wr, 11 op/s 2024-05-08T09:31:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:06 smithi070 ceph-mon[29591]: pgmap v5248: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 431 KiB/s wr, 16 op/s 2024-05-08T09:31:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:06 smithi172 ceph-mon[33377]: pgmap v5248: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 431 KiB/s wr, 16 op/s 2024-05-08T09:31:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:06 smithi194 ceph-mon[33679]: pgmap v5248: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 566 KiB/s rd, 431 KiB/s wr, 16 op/s 2024-05-08T09:31:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:08 smithi070 ceph-mon[29591]: pgmap v5249: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 292 KiB/s wr, 9 op/s 2024-05-08T09:31:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:08 smithi172 ceph-mon[33377]: pgmap v5249: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 292 KiB/s wr, 9 op/s 2024-05-08T09:31:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:08 smithi194 ceph-mon[33679]: pgmap v5249: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 292 KiB/s wr, 9 op/s 2024-05-08T09:31:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:10 smithi070 ceph-mon[29591]: pgmap v5250: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 293 KiB/s wr, 12 op/s 2024-05-08T09:31:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:10 smithi172 ceph-mon[33377]: pgmap v5250: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 293 KiB/s wr, 12 op/s 2024-05-08T09:31:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:10 smithi194 ceph-mon[33679]: pgmap v5250: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 418 KiB/s rd, 293 KiB/s wr, 12 op/s 2024-05-08T09:31:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:12 smithi070 ceph-mon[29591]: pgmap v5251: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T09:31:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:12 smithi172 ceph-mon[33377]: pgmap v5251: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T09:31:12.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:12 smithi194 ceph-mon[33679]: pgmap v5251: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T09:31:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:14 smithi070 ceph-mon[29591]: pgmap v5252: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T09:31:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:14 smithi172 ceph-mon[33377]: pgmap v5252: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T09:31:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:14 smithi194 ceph-mon[33679]: pgmap v5252: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 17 KiB/s wr, 8 op/s 2024-05-08T09:31:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:16 smithi172 ceph-mon[33377]: pgmap v5253: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-05-08T09:31:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:16 smithi194 ceph-mon[33679]: pgmap v5253: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-05-08T09:31:16.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:16 smithi070 ceph-mon[29591]: pgmap v5253: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-05-08T09:31:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:18 smithi172 ceph-mon[33377]: pgmap v5254: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T09:31:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:18 smithi194 ceph-mon[33679]: pgmap v5254: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T09:31:18.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:18 smithi070 ceph-mon[29591]: pgmap v5254: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T09:31:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:20 smithi172 ceph-mon[33377]: pgmap v5255: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-05-08T09:31:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:20 smithi194 ceph-mon[33679]: pgmap v5255: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-05-08T09:31:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:20 smithi070 ceph-mon[29591]: pgmap v5255: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-05-08T09:31:22.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.121+0000 7fea47e00700 1 -- 172.21.15.70:0/2199924455 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562248c83590 con 0x562248db1450 2024-05-08T09:31:22.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.121+0000 7fea47e00700 10 client.19623 handle_command_reply: tid=0 2024-05-08T09:31:22.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.121+0000 7fea7728ab80 1 client.19623 shutdown 2024-05-08T09:31:22.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.122+0000 7fea7728ab80 1 -- 172.21.15.70:0/2199924455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 msgr2=0x562248d458b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:31:22.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.122+0000 7fea7728ab80 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d458b0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fea600a6cd0 tx=0x7fea600e1530 comp rx=0 tx=0).stop 2024-05-08T09:31:22.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.122+0000 7fea7728ab80 1 -- 172.21.15.70:0/2199924455 shutdown_connections 2024-05-08T09:31:22.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.122+0000 7fea7728ab80 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562248db1450 0x562248db3870 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.122+0000 7fea7728ab80 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562248d29c00 0x562248d458b0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.122+0000 7fea47e00700 0 client.19623 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:31:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.122+0000 7fea7728ab80 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562248d23e30 0x562248d44e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.122+0000 7fea7728ab80 1 --2- 172.21.15.70:0/2199924455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562248d292e0 0x562248d45370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.122+0000 7fea7728ab80 1 -- 172.21.15.70:0/2199924455 >> 172.21.15.70:0/2199924455 conn(0x562248c9b860 msgr2=0x562248d26d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:31:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.123+0000 7fea7728ab80 1 -- 172.21.15.70:0/2199924455 shutdown_connections 2024-05-08T09:31:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.123+0000 7fea7728ab80 1 -- 172.21.15.70:0/2199924455 wait complete. 2024-05-08T09:31:22.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.124+0000 7fea7728ab80 20 client.19623 trim_cache size 0 max 16384 2024-05-08T09:31:22.123 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 358, 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "84ec9c5d": { 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 358, 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:31:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 91.7, 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:31:22.125 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:31:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 -- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea4c0b2aa0 msgr2=0x7fea4c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:31:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea4c0b2aa0 0x7fea4c0b4f60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fea6419c9f0 tx=0x7fea58009260 comp rx=0 tx=0).stop 2024-05-08T09:31:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 -- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 msgr2=0x7fea6419b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:31:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 0x7fea6419b8b0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fea600079a0 tx=0x7fea60007a80 comp rx=0 tx=0).stop 2024-05-08T09:31:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 -- 172.21.15.70:0/279070498 shutdown_connections 2024-05-08T09:31:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea4c0b2aa0 0x7fea4c0b4f60 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea641047f0 0x7fea6419b8b0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:22.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea64102540 0x7fea641a16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 --2- 172.21.15.70:0/279070498 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea64103e30 0x7fea641a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.125+0000 7fea6b200700 1 -- 172.21.15.70:0/279070498 >> 172.21.15.70:0/279070498 conn(0x7fea640fdcf0 msgr2=0x7fea64110070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:31:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.126+0000 7fea6b200700 1 -- 172.21.15.70:0/279070498 shutdown_connections 2024-05-08T09:31:22.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:22.126+0000 7fea6b200700 1 -- 172.21.15.70:0/279070498 wait complete. 2024-05-08T09:31:22.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:22 smithi070 ceph-mon[29591]: pgmap v5256: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T09:31:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:22 smithi172 ceph-mon[33377]: pgmap v5256: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T09:31:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:22 smithi194 ceph-mon[33679]: pgmap v5256: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T09:31:23.202 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '84ec9c5d', quiesce took 32.8 seconds. Will release after: 31.7 2024-05-08T09:31:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:24 smithi070 ceph-mon[29591]: pgmap v5257: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T09:31:24.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:24 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:31:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:24 smithi172 ceph-mon[33377]: pgmap v5257: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T09:31:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:24 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:31:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:24 smithi194 ceph-mon[33679]: pgmap v5257: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-05-08T09:31:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:24 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:31:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:26 smithi172 ceph-mon[33377]: pgmap v5258: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:31:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:31:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:31:26.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:31:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:26 smithi194 ceph-mon[33679]: pgmap v5258: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:31:26.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:31:26.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:31:26.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:31:26.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:26 smithi070 ceph-mon[29591]: pgmap v5258: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:31:26.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:31:26.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:31:26.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:31:28.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:28 smithi194 ceph-mon[33679]: pgmap v5259: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T09:31:28.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:28 smithi194 ceph-mon[33679]: osdmap e405: 12 total, 12 up, 12 in 2024-05-08T09:31:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:28 smithi070 ceph-mon[29591]: pgmap v5259: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T09:31:28.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:28 smithi070 ceph-mon[29591]: osdmap e405: 12 total, 12 up, 12 in 2024-05-08T09:31:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:28 smithi172 ceph-mon[33377]: pgmap v5259: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 23 KiB/s wr, 7 op/s 2024-05-08T09:31:28.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:28 smithi172 ceph-mon[33377]: osdmap e405: 12 total, 12 up, 12 in 2024-05-08T09:31:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:30 smithi194 ceph-mon[33679]: pgmap v5261: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-08T09:31:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:30 smithi070 ceph-mon[29591]: pgmap v5261: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-08T09:31:30.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:30 smithi172 ceph-mon[33377]: pgmap v5261: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-08T09:31:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:32 smithi194 ceph-mon[33679]: pgmap v5262: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-08T09:31:33.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:32 smithi194 ceph-mon[33679]: osdmap e406: 12 total, 12 up, 12 in 2024-05-08T09:31:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:32 smithi070 ceph-mon[29591]: pgmap v5262: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-08T09:31:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:32 smithi070 ceph-mon[29591]: osdmap e406: 12 total, 12 up, 12 in 2024-05-08T09:31:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:32 smithi172 ceph-mon[33377]: pgmap v5262: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 27 KiB/s wr, 9 op/s 2024-05-08T09:31:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:32 smithi172 ceph-mon[33377]: osdmap e406: 12 total, 12 up, 12 in 2024-05-08T09:31:34.983 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:34 smithi172 ceph-mon[33377]: pgmap v5264: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-05-08T09:31:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:34 smithi194 ceph-mon[33679]: pgmap v5264: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-05-08T09:31:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:34 smithi070 ceph-mon[29591]: pgmap v5264: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-05-08T09:31:37.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:36 smithi194 ceph-mon[33679]: pgmap v5265: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 7 op/s 2024-05-08T09:31:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:36 smithi070 ceph-mon[29591]: pgmap v5265: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 7 op/s 2024-05-08T09:31:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:36 smithi172 ceph-mon[33377]: pgmap v5265: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 7 op/s 2024-05-08T09:31:39.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:38 smithi194 ceph-mon[33679]: pgmap v5266: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 313 B/s wr, 6 op/s 2024-05-08T09:31:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:38 smithi070 ceph-mon[29591]: pgmap v5266: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 313 B/s wr, 6 op/s 2024-05-08T09:31:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:38 smithi172 ceph-mon[33377]: pgmap v5266: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 313 B/s wr, 6 op/s 2024-05-08T09:31:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:40 smithi194 ceph-mon[33679]: pgmap v5267: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:31:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:40 smithi070 ceph-mon[29591]: pgmap v5267: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:31:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:40 smithi172 ceph-mon[33377]: pgmap v5267: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:31:43.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:42 smithi194 ceph-mon[33679]: pgmap v5268: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:31:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:42 smithi070 ceph-mon[29591]: pgmap v5268: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:31:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:42 smithi172 ceph-mon[33377]: pgmap v5268: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:31:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:44 smithi194 ceph-mon[33679]: pgmap v5269: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-05-08T09:31:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:44 smithi070 ceph-mon[29591]: pgmap v5269: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-05-08T09:31:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:44 smithi172 ceph-mon[33377]: pgmap v5269: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 90 B/s wr, 5 op/s 2024-05-08T09:31:47.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:46 smithi194 ceph-mon[33679]: pgmap v5270: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:31:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:46 smithi070 ceph-mon[29591]: pgmap v5270: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:31:47.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:46 smithi172 ceph-mon[33377]: pgmap v5270: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:31:49.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:48 smithi194 ceph-mon[33679]: pgmap v5271: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:31:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:48 smithi070 ceph-mon[29591]: pgmap v5271: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:31:49.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:48 smithi172 ceph-mon[33377]: pgmap v5271: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:31:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:50 smithi194 ceph-mon[33679]: pgmap v5272: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:31:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:50 smithi070 ceph-mon[29591]: pgmap v5272: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:31:51.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:50 smithi172 ceph-mon[33377]: pgmap v5272: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:31:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:52 smithi070 ceph-mon[29591]: pgmap v5273: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:31:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:52 smithi172 ceph-mon[33377]: pgmap v5273: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:31:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:52 smithi194 ceph-mon[33679]: pgmap v5273: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:31:54.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:31:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:54 smithi070 ceph-mon[29591]: pgmap v5274: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:31:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:54 smithi172 ceph-mon[33377]: pgmap v5274: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:31:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:54 smithi194 ceph-mon[33679]: pgmap v5274: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:31:55.380 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:31:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:56 smithi070 ceph-mon[29591]: pgmap v5275: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:31:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:56 smithi172 ceph-mon[33377]: pgmap v5275: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:31:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:56 smithi194 ceph-mon[33679]: pgmap v5275: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:31:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.716+0000 7ff229600700 1 -- 172.21.15.70:0/195609142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22406b180 msgr2=0x7ff22406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:31:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.716+0000 7ff229600700 1 --2- 172.21.15.70:0/195609142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22406b180 0x7ff22406b600 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7ff210009990 tx=0x7ff210009ca0 comp rx=0 tx=0).stop 2024-05-08T09:31:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.716+0000 7ff229600700 1 -- 172.21.15.70:0/195609142 shutdown_connections 2024-05-08T09:31:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.716+0000 7ff229600700 1 --2- 172.21.15.70:0/195609142 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff22406bb40 0x7ff224110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.716+0000 7ff229600700 1 --2- 172.21.15.70:0/195609142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff224109510 0x7ff2241098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.716+0000 7ff229600700 1 --2- 172.21.15.70:0/195609142 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff22406b180 0x7ff22406b600 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.716+0000 7ff229600700 1 -- 172.21.15.70:0/195609142 >> 172.21.15.70:0/195609142 conn(0x7ff224079350 msgr2=0x7ff224079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:31:57.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.716+0000 7ff229600700 1 -- 172.21.15.70:0/195609142 shutdown_connections 2024-05-08T09:31:57.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.716+0000 7ff229600700 1 -- 172.21.15.70:0/195609142 wait complete. 2024-05-08T09:31:57.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.718+0000 7ff229600700 1 Processor -- start 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.718+0000 7ff229600700 1 -- start start 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.718+0000 7ff229600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff22406b180 0x7ff22419f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.718+0000 7ff229600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff22406bb40 0x7ff22419fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.718+0000 7ff229600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff224109510 0x7ff2241998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.718+0000 7ff229600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2241134f0 con 0x7ff224109510 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.718+0000 7ff229600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff224113370 con 0x7ff22406b180 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.718+0000 7ff229600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff224113670 con 0x7ff22406bb40 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff224109510 0x7ff2241998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff223400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff224109510 0x7ff2241998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33624/0 (socket says 172.21.15.70:33624) 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff223400700 1 -- 172.21.15.70:0/400998551 learned_addr learned my addr 172.21.15.70:0/400998551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff222000700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff22406bb40 0x7ff22419fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:31:57.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff222a00700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff22406b180 0x7ff22419f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:31:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff223400700 1 -- 172.21.15.70:0/400998551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff22406bb40 msgr2=0x7ff22419fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:31:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff223400700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff22406bb40 0x7ff22419fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff223400700 1 -- 172.21.15.70:0/400998551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff22406b180 msgr2=0x7ff22419f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:31:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff223400700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff22406b180 0x7ff22419f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff223400700 1 -- 172.21.15.70:0/400998551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22419a010 con 0x7ff224109510 2024-05-08T09:31:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.719+0000 7ff222000700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff22406bb40 0x7ff22419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:31:57.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.720+0000 7ff223400700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff224109510 0x7ff2241998b0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7ff21c007ee0 tx=0x7ff21c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:31:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.720+0000 7ff21b400700 1 -- 172.21.15.70:0/400998551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00dbd0 con 0x7ff224109510 2024-05-08T09:31:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.720+0000 7ff21b400700 1 -- 172.21.15.70:0/400998551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff21c00dd70 con 0x7ff224109510 2024-05-08T09:31:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.720+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22419a300 con 0x7ff224109510 2024-05-08T09:31:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.720+0000 7ff21b400700 1 -- 172.21.15.70:0/400998551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0058d0 con 0x7ff224109510 2024-05-08T09:31:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.720+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2241023a0 con 0x7ff224109510 2024-05-08T09:31:57.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.722+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22410b9f0 con 0x7ff224109510 2024-05-08T09:31:57.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.725+0000 7ff21b400700 1 -- 172.21.15.70:0/400998551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff21c01a020 con 0x7ff224109510 2024-05-08T09:31:57.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.726+0000 7ff21b400700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2080b2a70 0x7ff2080b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:31:57.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.726+0000 7ff21b400700 1 -- 172.21.15.70:0/400998551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(406..406 src has 1..406) ==== 9583+0+0 (secure 0 0 0) 0x7ff21c0e2890 con 0x7ff224109510 2024-05-08T09:31:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.727+0000 7ff222a00700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2080b2a70 0x7ff2080b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:31:57.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.727+0000 7ff222a00700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2080b2a70 0x7ff2080b4f30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff22419a9f0 tx=0x7ff21400b3c0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:31:57.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:57.730+0000 7ff21b400700 1 -- 172.21.15.70:0/400998551 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff21c010070 con 0x7ff224109510 2024-05-08T09:31:58.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.086+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff22419ade0 con 0x7ff224109510 2024-05-08T09:31:58.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.088+0000 7ff21b400700 1 -- 172.21.15.70:0/400998551 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7ff21c0b0e20 con 0x7ff224109510 2024-05-08T09:31:58.087 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:31:58.087 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:31:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2080b2a70 msgr2=0x7ff2080b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:31:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2080b2a70 0x7ff2080b4f30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff22419a9f0 tx=0x7ff21400b3c0 comp rx=0 tx=0).stop 2024-05-08T09:31:58.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff224109510 msgr2=0x7ff2241998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:31:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff224109510 0x7ff2241998b0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7ff21c007ee0 tx=0x7ff21c00d3b0 comp rx=0 tx=0).stop 2024-05-08T09:31:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 shutdown_connections 2024-05-08T09:31:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2080b2a70 0x7ff2080b4f30 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff224109510 0x7ff2241998b0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff22406b180 0x7ff22419f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 --2- 172.21.15.70:0/400998551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff22406bb40 0x7ff22419fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:31:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 >> 172.21.15.70:0/400998551 conn(0x7ff224079350 msgr2=0x7ff2241012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:31:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 shutdown_connections 2024-05-08T09:31:58.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:31:58.092+0000 7ff229600700 1 -- 172.21.15.70:0/400998551 wait complete. 2024-05-08T09:31:58.092 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:31:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:58 smithi070 ceph-mon[29591]: pgmap v5276: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:31:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:31:58 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/400998551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:31:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:58 smithi172 ceph-mon[33377]: pgmap v5276: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:31:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:31:58 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/400998551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:31:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:58 smithi194 ceph-mon[33679]: pgmap v5276: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:31:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:31:58 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/400998551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:31:59.965 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 84ec9c5d --release --await' 2024-05-08T09:31:59.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 84ec9c5d --release --await 2024-05-08T09:32:00.437 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:32:00.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:00 smithi070 ceph-mon[29591]: pgmap v5277: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:00 smithi172 ceph-mon[33377]: pgmap v5277: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:00 smithi194 ceph-mon[33679]: pgmap v5277: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:02.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:02 smithi070 ceph-mon[29591]: pgmap v5278: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:03.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:02 smithi172 ceph-mon[33377]: pgmap v5278: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:03.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:02 smithi194 ceph-mon[33679]: pgmap v5278: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:03.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.607+0000 7f1562200700 1 -- 172.21.15.70:0/3156819838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103550 msgr2=0x7f155c1039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:32:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.607+0000 7f1562200700 1 --2- 172.21.15.70:0/3156819838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103550 0x7f155c1039d0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f15480099c0 tx=0x7f1548009cd0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.607+0000 7f1562200700 1 -- 172.21.15.70:0/3156819838 shutdown_connections 2024-05-08T09:32:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.607+0000 7f1562200700 1 --2- 172.21.15.70:0/3156819838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f155c103f10 0x7f155c1103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.607+0000 7f1562200700 1 --2- 172.21.15.70:0/3156819838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f155c1095d0 0x7f155c1099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.607+0000 7f1562200700 1 --2- 172.21.15.70:0/3156819838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103550 0x7f155c1039d0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.607+0000 7f1562200700 1 -- 172.21.15.70:0/3156819838 >> 172.21.15.70:0/3156819838 conn(0x7f155c07a5f0 msgr2=0x7f155c07aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:32:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.607+0000 7f1562200700 1 -- 172.21.15.70:0/3156819838 shutdown_connections 2024-05-08T09:32:03.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.608+0000 7f1562200700 1 -- 172.21.15.70:0/3156819838 wait complete. 2024-05-08T09:32:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.609+0000 7f1562200700 1 Processor -- start 2024-05-08T09:32:03.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.609+0000 7f1562200700 1 -- start start 2024-05-08T09:32:03.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.609+0000 7f1562200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f155c103550 0x7f155c1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f1562200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103f10 0x7f155c1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f1562200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f155c1095d0 0x7f155c19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f1562200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f155c1135d0 con 0x7f155c103f10 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f1562200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f155c113450 con 0x7f155c1095d0 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f1562200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f155c113750 con 0x7f155c103550 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f155aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103f10 0x7f155c1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f155aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103f10 0x7f155c1a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33630/0 (socket says 172.21.15.70:33630) 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f155aa00700 1 -- 172.21.15.70:0/3204054308 learned_addr learned my addr 172.21.15.70:0/3204054308 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f155b400700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f155c103550 0x7f155c1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f155be00700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f155c1095d0 0x7f155c19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.610+0000 7f155aa00700 1 -- 172.21.15.70:0/3204054308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f155c103550 msgr2=0x7f155c1a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:32:03.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f155aa00700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f155c103550 0x7f155c1a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f155aa00700 1 -- 172.21.15.70:0/3204054308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f155c1095d0 msgr2=0x7f155c19baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:32:03.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f155aa00700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f155c1095d0 0x7f155c19baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f155aa00700 1 -- 172.21.15.70:0/3204054308 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f155c19c250 con 0x7f155c103f10 2024-05-08T09:32:03.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f155be00700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f155c1095d0 0x7f155c19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:32:03.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f155b400700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f155c103550 0x7f155c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:32:03.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f155aa00700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103f10 0x7f155c1a1e70 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f154800b580 tx=0x7f154800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:32:03.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f1553e00700 1 -- 172.21.15.70:0/3204054308 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548027070 con 0x7f155c103f10 2024-05-08T09:32:03.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f1553e00700 1 -- 172.21.15.70:0/3204054308 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f154800fdd0 con 0x7f155c103f10 2024-05-08T09:32:03.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.611+0000 7f1553e00700 1 -- 172.21.15.70:0/3204054308 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15480173f0 con 0x7f155c103f10 2024-05-08T09:32:03.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.612+0000 7f1562200700 1 -- 172.21.15.70:0/3204054308 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f155c19c4e0 con 0x7f155c103f10 2024-05-08T09:32:03.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.612+0000 7f1562200700 1 -- 172.21.15.70:0/3204054308 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155c1a8800 con 0x7f155c103f10 2024-05-08T09:32:03.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.616+0000 7f1553e00700 1 -- 172.21.15.70:0/3204054308 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f154802a020 con 0x7f155c103f10 2024-05-08T09:32:03.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.618+0000 7f1553e00700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15400b29f0 0x7f15400b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.618+0000 7f1553e00700 1 -- 172.21.15.70:0/3204054308 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(406..406 src has 1..406) ==== 9583+0+0 (secure 0 0 0) 0x7f15480e3940 con 0x7f155c103f10 2024-05-08T09:32:03.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.618+0000 7f155b400700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15400b29f0 0x7f15400b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.619+0000 7f155b400700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15400b29f0 0x7f15400b4eb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f154c005950 tx=0x7f154c0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:32:03.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.632+0000 7f156cb42b80 1 Processor -- start 2024-05-08T09:32:03.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.632+0000 7f156cb42b80 1 -- start start 2024-05-08T09:32:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e24590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 0x5613d3e1ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 0x5613d3e2af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f156cb42b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613d3d70b20 con 0x5613d3e241b0 2024-05-08T09:32:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f156cb42b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5613d3d0e860 con 0x5613d3e1f140 2024-05-08T09:32:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f156cb42b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5613d3d6cae0 con 0x5613d3e1e780 2024-05-08T09:32:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f155b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e24590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f155b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e24590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33642/0 (socket says 172.21.15.70:33642) 2024-05-08T09:32:03.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f155b400700 1 -- 172.21.15.70:0/208406166 learned_addr learned my addr 172.21.15.70:0/208406166 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f155aa00700 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 0x5613d3e1ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.633+0000 7f155be00700 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 0x5613d3e2af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.634+0000 7f155b400700 1 -- 172.21.15.70:0/208406166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 msgr2=0x5613d3e1ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.634+0000 7f155b400700 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 0x5613d3e1ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.634+0000 7f155b400700 1 -- 172.21.15.70:0/208406166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 msgr2=0x5613d3e2af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.634+0000 7f155b400700 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 0x5613d3e2af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.634+0000 7f155b400700 1 -- 172.21.15.70:0/208406166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613d3cbd9d0 con 0x5613d3e241b0 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.634+0000 7f155be00700 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 0x5613d3e2af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.634+0000 7f155b400700 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e24590 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f154c00ff00 tx=0x7f154c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b94f4b7d2545a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.635+0000 7f1550c00700 1 -- 172.21.15.70:0/208406166 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c003880 con 0x5613d3e241b0 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.635+0000 7f1550c00700 1 -- 172.21.15.70:0/208406166 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f154c024070 con 0x5613d3e241b0 2024-05-08T09:32:03.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.635+0000 7f1550c00700 1 -- 172.21.15.70:0/208406166 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c01fc60 con 0x5613d3e241b0 2024-05-08T09:32:03.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 -- 172.21.15.70:0/208406166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 msgr2=0x5613d3e24590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:32:03.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e24590 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f154c00ff00 tx=0x7f154c012000 comp rx=0 tx=0).stop 2024-05-08T09:32:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 -- 172.21.15.70:0/208406166 shutdown_connections 2024-05-08T09:32:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 0x5613d3e2af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e24590 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 --2- 172.21.15.70:0/208406166 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 0x5613d3e1ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 -- 172.21.15.70:0/208406166 >> 172.21.15.70:0/208406166 conn(0x5613d3d967d0 msgr2=0x5613d3e19070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:32:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 -- 172.21.15.70:0/208406166 shutdown_connections 2024-05-08T09:32:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 -- 172.21.15.70:0/208406166 wait complete. 2024-05-08T09:32:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.636+0000 7f156cb42b80 1 -- start start 2024-05-08T09:32:03.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.637+0000 7f156cb42b80 1 Processor -- start 2024-05-08T09:32:03.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.637+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1e780 0x5613d3e2ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.637+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 0x5613d3e27ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.637+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e241b0 0x5613d3e28400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.637+0000 7f156cb42b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613d3e2b510 con 0x5613d3e1e780 2024-05-08T09:32:03.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.637+0000 7f156cb42b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5613d3cd6c20 con 0x5613d3e1f140 2024-05-08T09:32:03.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.637+0000 7f156cb42b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5613d3e2b690 con 0x5613d3e241b0 2024-05-08T09:32:03.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.637+0000 7f156cb42b80 10 client.0 _ll_register_callbacks cb 0x5613d3d17d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:32:03.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1e780 0x5613d3e2ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1e780 0x5613d3e2ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33652/0 (socket says 172.21.15.70:33652) 2024-05-08T09:32:03.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155b400700 1 -- 172.21.15.70:0/263879633 learned_addr learned my addr 172.21.15.70:0/263879633 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:32:03.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155aa00700 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 0x5613d3e27ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155be00700 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e241b0 0x5613d3e28400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155b400700 1 -- 172.21.15.70:0/263879633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e241b0 msgr2=0x5613d3e28400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:32:03.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155b400700 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e241b0 0x5613d3e28400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155b400700 1 -- 172.21.15.70:0/263879633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 msgr2=0x5613d3e27ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:32:03.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155b400700 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 0x5613d3e27ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.638+0000 7f155b400700 1 -- 172.21.15.70:0/263879633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613d3d36520 con 0x5613d3e1e780 2024-05-08T09:32:03.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.639+0000 7f155b400700 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1e780 0x5613d3e2ab20 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f154c00be70 tx=0x7f154c01f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7333597c13a41041 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:32:03.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.639+0000 7f1545600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:32:03.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.639+0000 7f1545600700 1 -- 172.21.15.70:0/263879633 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c003680 con 0x5613d3e1e780 2024-05-08T09:32:03.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.639+0000 7f1545600700 1 -- 172.21.15.70:0/263879633 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(406..406 src has 1..406) ==== 9583+0+0 (secure 0 0 0) 0x7f154c003820 con 0x5613d3e1e780 2024-05-08T09:32:03.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.639+0000 7f156cb42b80 1 -- 172.21.15.70:0/263879633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f154c024070 con 0x5613d3e1e780 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.639+0000 7f1545600700 1 -- 172.21.15.70:0/263879633 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f154c003a20 con 0x5613d3e1e780 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.639+0000 7f156cb42b80 10 client.19641 fetch_fsmap learned FSMap version 42 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.639+0000 7f156cb42b80 1 -- 172.21.15.70:0/263879633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5613d3e35cb0 con 0x5613d3e1e780 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.640+0000 7f1545600700 1 -- 172.21.15.70:0/263879633 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f154c024070 con 0x5613d3e1e780 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.640+0000 7f1545600700 1 -- 172.21.15.70:0/263879633 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f154c032070 con 0x5613d3e1e780 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.640+0000 7f156cb42b80 10 client.19641 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.640+0000 7f156cb42b80 10 client.19641 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.640+0000 7f156cb42b80 20 client.19641 populate_metadata read hostname 'smithi070' 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.640+0000 7f156cb42b80 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613d3e38240 0x5613d3e3a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.640+0000 7f156cb42b80 4 client.19641 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:32:03.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.640+0000 7f156cb42b80 1 -- 172.21.15.70:0/263879633 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613d3deb240 con 0x5613d3e38240 2024-05-08T09:32:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.641+0000 7f155aa00700 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613d3e38240 0x5613d3e3a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.642+0000 7f155aa00700 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613d3e38240 0x5613d3e3a630 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d83758bed26cd27c server_cookie=8c4ffe837e5f37fb in_seq=0 out_seq=0 2024-05-08T09:32:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.642+0000 7f1545600700 10 client.19641 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:32:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f1545600700 1 -- 172.21.15.70:0/263879633 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5613d3deb240 con 0x5613d3e38240 2024-05-08T09:32:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f1545600700 10 client.19641 handle_command_reply: tid=0 2024-05-08T09:32:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f156cb42b80 1 client.19641 shutdown 2024-05-08T09:32:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f156cb42b80 1 -- 172.21.15.70:0/263879633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1e780 msgr2=0x5613d3e2ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:32:03.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f156cb42b80 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1e780 0x5613d3e2ab20 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f154c00be70 tx=0x7f154c01f770 comp rx=0 tx=0).stop 2024-05-08T09:32:03.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f156cb42b80 1 -- 172.21.15.70:0/263879633 shutdown_connections 2024-05-08T09:32:03.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f156cb42b80 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613d3e38240 0x5613d3e3a630 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f156cb42b80 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e241b0 0x5613d3e28400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f156cb42b80 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1e780 0x5613d3e2ab20 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f156cb42b80 1 --2- 172.21.15.70:0/263879633 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1f140 0x5613d3e27ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f156cb42b80 1 -- 172.21.15.70:0/263879633 >> 172.21.15.70:0/263879633 conn(0x5613d3d967d0 msgr2=0x5613d3e13b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:32:03.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.644+0000 7f1545600700 0 client.19641 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:32:03.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.645+0000 7f156cb42b80 1 -- 172.21.15.70:0/263879633 shutdown_connections 2024-05-08T09:32:03.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.645+0000 7f156cb42b80 1 -- 172.21.15.70:0/263879633 wait complete. 2024-05-08T09:32:03.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.645+0000 7f156cb42b80 20 client.19641 trim_cache size 0 max 16384 2024-05-08T09:32:03.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.669+0000 7f156cb42b80 1 Processor -- start 2024-05-08T09:32:03.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.669+0000 7f156cb42b80 1 -- start start 2024-05-08T09:32:03.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.669+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1e780 0x5613d3e34560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1f140 0x5613d3e1de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e3fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f156cb42b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f155c1b3fa0 con 0x5613d3e241b0 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f156cb42b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f155c1b1830 con 0x5613d3e1e780 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f156cb42b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f155c1af6a0 con 0x5613d3e1f140 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f155be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e3fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f155be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e3fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33668/0 (socket says 172.21.15.70:33668) 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f155be00700 1 -- 172.21.15.70:0/1722311050 learned_addr learned my addr 172.21.15.70:0/1722311050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f155b400700 1 --2- 172.21.15.70:0/1722311050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1e780 0x5613d3e34560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.670+0000 7f155aa00700 1 --2- 172.21.15.70:0/1722311050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1f140 0x5613d3e1de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.671+0000 7f155be00700 1 -- 172.21.15.70:0/1722311050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1f140 msgr2=0x5613d3e1de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.671+0000 7f155be00700 1 --2- 172.21.15.70:0/1722311050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1f140 0x5613d3e1de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.671+0000 7f155be00700 1 -- 172.21.15.70:0/1722311050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1e780 msgr2=0x5613d3e34560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:32:03.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.671+0000 7f155be00700 1 --2- 172.21.15.70:0/1722311050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1e780 0x5613d3e34560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.671+0000 7f155be00700 1 -- 172.21.15.70:0/1722311050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613d3e15c70 con 0x5613d3e241b0 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.671+0000 7f155be00700 1 --2- 172.21.15.70:0/1722311050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e3fd50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f1554009be0 tx=0x7f1554009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99b27be0c338917 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.671+0000 7f1547e00700 1 -- 172.21.15.70:0/1722311050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155401a020 con 0x5613d3e241b0 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.671+0000 7f1547e00700 1 -- 172.21.15.70:0/1722311050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1554016400 con 0x5613d3e241b0 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.671+0000 7f1547e00700 1 -- 172.21.15.70:0/1722311050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15540155c0 con 0x5613d3e241b0 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.672+0000 7f156cb42b80 1 -- 172.21.15.70:0/1722311050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 msgr2=0x5613d3e3fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.672+0000 7f156cb42b80 1 --2- 172.21.15.70:0/1722311050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e3fd50 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f1554009be0 tx=0x7f1554009040 comp rx=0 tx=0).stop 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.672+0000 7f156cb42b80 1 -- 172.21.15.70:0/1722311050 shutdown_connections 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.672+0000 7f156cb42b80 1 --2- 172.21.15.70:0/1722311050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e241b0 0x5613d3e3fd50 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.672+0000 7f156cb42b80 1 --2- 172.21.15.70:0/1722311050 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e1e780 0x5613d3e34560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.672+0000 7f156cb42b80 1 --2- 172.21.15.70:0/1722311050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1f140 0x5613d3e1de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.672+0000 7f156cb42b80 1 -- 172.21.15.70:0/1722311050 >> 172.21.15.70:0/1722311050 conn(0x5613d3d967d0 msgr2=0x5613d3e1d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:32:03.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.672+0000 7f156cb42b80 1 -- 172.21.15.70:0/1722311050 shutdown_connections 2024-05-08T09:32:03.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.672+0000 7f156cb42b80 1 -- 172.21.15.70:0/1722311050 wait complete. 2024-05-08T09:32:03.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.673+0000 7f156cb42b80 1 -- start start 2024-05-08T09:32:03.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.673+0000 7f156cb42b80 1 Processor -- start 2024-05-08T09:32:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 0x5613d3e2d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1f140 0x5613d3e2ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f156cb42b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e241b0 0x5613d3e2e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f156cb42b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f155c1afcf0 con 0x5613d3e1f140 2024-05-08T09:32:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f156cb42b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f155c1b1160 con 0x5613d3e241b0 2024-05-08T09:32:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f156cb42b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f155c1b03c0 con 0x5613d3e1e780 2024-05-08T09:32:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f156cb42b80 10 client.0 _ll_register_callbacks cb 0x5613d3d17d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:32:03.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f155aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1f140 0x5613d3e2ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f155aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1f140 0x5613d3e2ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33682/0 (socket says 172.21.15.70:33682) 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f155aa00700 1 -- 172.21.15.70:0/690811249 learned_addr learned my addr 172.21.15.70:0/690811249 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f155b400700 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 0x5613d3e2d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f155be00700 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e241b0 0x5613d3e2e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f155aa00700 1 -- 172.21.15.70:0/690811249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 msgr2=0x5613d3e2d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.674+0000 7f155aa00700 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 0x5613d3e2d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.675+0000 7f155aa00700 1 -- 172.21.15.70:0/690811249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e241b0 msgr2=0x5613d3e2e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.675+0000 7f155aa00700 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e241b0 0x5613d3e2e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.675+0000 7f155aa00700 1 -- 172.21.15.70:0/690811249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613d3ea2910 con 0x5613d3e1f140 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.675+0000 7f155be00700 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e241b0 0x5613d3e2e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.675+0000 7f155aa00700 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1f140 0x5613d3e2ddf0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f15480a68b0 tx=0x7f15480b1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c3f0af7ccf6f35 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:32:03.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.675+0000 7f1545600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.675+0000 7f1545600700 1 -- 172.21.15.70:0/690811249 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15480aa830 con 0x5613d3e1f140 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.675+0000 7f1545600700 1 -- 172.21.15.70:0/690811249 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(406..406 src has 1..406) ==== 9583+0+0 (secure 0 0 0) 0x7f15480aaa90 con 0x5613d3e1f140 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.675+0000 7f156cb42b80 1 -- 172.21.15.70:0/690811249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1554016400 con 0x5613d3e1f140 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f1545600700 1 -- 172.21.15.70:0/690811249 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f15480aebe0 con 0x5613d3e1f140 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f156cb42b80 10 client.19647 fetch_fsmap learned FSMap version 42 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f156cb42b80 1 -- 172.21.15.70:0/690811249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5613d3ea3b70 con 0x5613d3e1f140 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f1545600700 1 -- 172.21.15.70:0/690811249 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1554016400 con 0x5613d3e1f140 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f1545600700 1 -- 172.21.15.70:0/690811249 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f1548070080 con 0x5613d3e1f140 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f156cb42b80 10 client.19647 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f156cb42b80 10 client.19647 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f156cb42b80 20 client.19647 populate_metadata read hostname 'smithi070' 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f156cb42b80 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613d3ea41e0 0x5613d3ea6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f156cb42b80 4 client.19647 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "84ec9c5d", "release": true, "await": true}] 2024-05-08T09:32:03.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.676+0000 7f156cb42b80 1 -- 172.21.15.70:0/690811249 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "84ec9c5d", "release": true, "await": true}) -- 0x5613d3d7e500 con 0x5613d3ea41e0 2024-05-08T09:32:03.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.677+0000 7f155b400700 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613d3ea41e0 0x5613d3ea6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:32:03.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.678+0000 7f1545600700 10 client.19647 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:32:03.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:03.678+0000 7f155b400700 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613d3ea41e0 0x5613d3ea6600 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7212c4f4945f475 server_cookie=4e29c08bf59aa33e in_seq=0 out_seq=0 2024-05-08T09:32:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:04 smithi070 ceph-mon[29591]: pgmap v5279: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:04 smithi172 ceph-mon[33377]: pgmap v5279: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:04 smithi194 ceph-mon[33679]: pgmap v5279: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:07.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:06 smithi070 ceph-mon[29591]: pgmap v5280: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:32:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:06 smithi172 ceph-mon[33377]: pgmap v5280: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:32:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:06 smithi194 ceph-mon[33679]: pgmap v5280: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:32:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.574+0000 7f1545600700 1 -- 172.21.15.70:0/690811249 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5613d3d7e500 con 0x5613d3ea41e0 2024-05-08T09:32:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.574+0000 7f1545600700 10 client.19647 handle_command_reply: tid=0 2024-05-08T09:32:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.574+0000 7f156cb42b80 1 client.19647 shutdown 2024-05-08T09:32:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.575+0000 7f156cb42b80 1 -- 172.21.15.70:0/690811249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1f140 msgr2=0x5613d3e2ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:32:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.575+0000 7f156cb42b80 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1f140 0x5613d3e2ddf0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f15480a68b0 tx=0x7f15480b1040 comp rx=0 tx=0).stop 2024-05-08T09:32:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.575+0000 7f156cb42b80 1 -- 172.21.15.70:0/690811249 shutdown_connections 2024-05-08T09:32:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.575+0000 7f156cb42b80 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5613d3ea41e0 0x5613d3ea6600 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.575+0000 7f156cb42b80 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5613d3e241b0 0x5613d3e2e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.575+0000 7f156cb42b80 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5613d3e1e780 0x5613d3e2d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.575+0000 7f156cb42b80 1 --2- 172.21.15.70:0/690811249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613d3e1f140 0x5613d3e2ddf0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.575+0000 7f156cb42b80 1 -- 172.21.15.70:0/690811249 >> 172.21.15.70:0/690811249 conn(0x5613d3d967d0 msgr2=0x5613d3e1e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:32:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.575+0000 7f1545600700 0 client.19647 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:32:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.576+0000 7f156cb42b80 1 -- 172.21.15.70:0/690811249 shutdown_connections 2024-05-08T09:32:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.576+0000 7f156cb42b80 1 -- 172.21.15.70:0/690811249 wait complete. 2024-05-08T09:32:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.576+0000 7f156cb42b80 20 client.19647 trim_cache size 0 max 16384 2024-05-08T09:32:08.576 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 360, 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "84ec9c5d": { 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 360, 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 91.7, 2024-05-08T09:32:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:32:08.578 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:32:08.578 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:32:08.578 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:32:08.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:32:08.578 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:32:08.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:32:08.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:32:08.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:32:08.578 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:32:08.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:32:08.579 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:32:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.577+0000 7f1562200700 1 -- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15400b29f0 msgr2=0x7f15400b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:32:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.577+0000 7f1562200700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15400b29f0 0x7f15400b4eb0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f154c005950 tx=0x7f154c0058e0 comp rx=0 tx=0).stop 2024-05-08T09:32:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.577+0000 7f1562200700 1 -- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103f10 msgr2=0x7f155c1a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:32:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.577+0000 7f1562200700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103f10 0x7f155c1a1e70 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f154800b580 tx=0x7f154800f510 comp rx=0 tx=0).stop 2024-05-08T09:32:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.578+0000 7f1562200700 1 -- 172.21.15.70:0/3204054308 shutdown_connections 2024-05-08T09:32:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.578+0000 7f1562200700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f15400b29f0 0x7f15400b4eb0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:08.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.578+0000 7f1562200700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f155c1095d0 0x7f155c19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:08.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.578+0000 7f1562200700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f155c103550 0x7f155c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:08.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.578+0000 7f1562200700 1 --2- 172.21.15.70:0/3204054308 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f155c103f10 0x7f155c1a1e70 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:32:08.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.578+0000 7f1562200700 1 -- 172.21.15.70:0/3204054308 >> 172.21.15.70:0/3204054308 conn(0x7f155c07a5f0 msgr2=0x7f155c10e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:32:08.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.578+0000 7f1562200700 1 -- 172.21.15.70:0/3204054308 shutdown_connections 2024-05-08T09:32:08.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:32:08.578+0000 7f1562200700 1 -- 172.21.15.70:0/3204054308 wait complete. 2024-05-08T09:32:08.698 INFO:tasks.workunit.client.0.smithi070.stdout: AR built-in.a 2024-05-08T09:32:08.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:08 smithi070 ceph-mon[29591]: pgmap v5281: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:32:09.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:08 smithi172 ceph-mon[33377]: pgmap v5281: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:32:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:08 smithi194 ceph-mon[33679]: pgmap v5281: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:32:09.574 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '84ec9c5d', seconds elapsed: 79.1 2024-05-08T09:32:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:10 smithi070 ceph-mon[29591]: pgmap v5282: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 121 KiB/s wr, 26 op/s 2024-05-08T09:32:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:10 smithi070 ceph-mon[29591]: osdmap e407: 12 total, 12 up, 12 in 2024-05-08T09:32:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:10 smithi172 ceph-mon[33377]: pgmap v5282: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 121 KiB/s wr, 26 op/s 2024-05-08T09:32:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:10 smithi172 ceph-mon[33377]: osdmap e407: 12 total, 12 up, 12 in 2024-05-08T09:32:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:10 smithi194 ceph-mon[33679]: pgmap v5282: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 121 KiB/s wr, 26 op/s 2024-05-08T09:32:10.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:10 smithi194 ceph-mon[33679]: osdmap e407: 12 total, 12 up, 12 in 2024-05-08T09:32:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:12 smithi070 ceph-mon[29591]: pgmap v5284: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 145 KiB/s wr, 28 op/s 2024-05-08T09:32:12.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:12 smithi172 ceph-mon[33377]: pgmap v5284: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 145 KiB/s wr, 28 op/s 2024-05-08T09:32:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:12 smithi194 ceph-mon[33679]: pgmap v5284: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 145 KiB/s wr, 28 op/s 2024-05-08T09:32:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:14 smithi070 ceph-mon[29591]: pgmap v5285: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 145 KiB/s wr, 28 op/s 2024-05-08T09:32:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:14 smithi172 ceph-mon[33377]: pgmap v5285: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 145 KiB/s wr, 28 op/s 2024-05-08T09:32:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:14 smithi194 ceph-mon[33679]: pgmap v5285: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 145 KiB/s wr, 28 op/s 2024-05-08T09:32:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:16 smithi070 ceph-mon[29591]: pgmap v5286: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 216 KiB/s wr, 13 op/s 2024-05-08T09:32:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:16 smithi172 ceph-mon[33377]: pgmap v5286: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 216 KiB/s wr, 13 op/s 2024-05-08T09:32:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:16 smithi194 ceph-mon[33679]: pgmap v5286: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 216 KiB/s wr, 13 op/s 2024-05-08T09:32:18.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:17 smithi194 ceph-mon[33679]: osdmap e408: 12 total, 12 up, 12 in 2024-05-08T09:32:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:17 smithi070 ceph-mon[29591]: osdmap e408: 12 total, 12 up, 12 in 2024-05-08T09:32:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:17 smithi172 ceph-mon[33377]: osdmap e408: 12 total, 12 up, 12 in 2024-05-08T09:32:19.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:18 smithi194 ceph-mon[33679]: pgmap v5288: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 157 KiB/s wr, 11 op/s 2024-05-08T09:32:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:18 smithi070 ceph-mon[29591]: pgmap v5288: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 157 KiB/s wr, 11 op/s 2024-05-08T09:32:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:18 smithi172 ceph-mon[33377]: pgmap v5288: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 157 KiB/s wr, 11 op/s 2024-05-08T09:32:21.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:20 smithi194 ceph-mon[33679]: pgmap v5289: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 468 KiB/s wr, 17 op/s 2024-05-08T09:32:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:20 smithi070 ceph-mon[29591]: pgmap v5289: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 468 KiB/s wr, 17 op/s 2024-05-08T09:32:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:20 smithi172 ceph-mon[33377]: pgmap v5289: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 468 KiB/s wr, 17 op/s 2024-05-08T09:32:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:22 smithi194 ceph-mon[33679]: pgmap v5290: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 466 KiB/s wr, 17 op/s 2024-05-08T09:32:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:22 smithi070 ceph-mon[29591]: pgmap v5290: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 466 KiB/s wr, 17 op/s 2024-05-08T09:32:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:22 smithi172 ceph-mon[33377]: pgmap v5290: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 466 KiB/s wr, 17 op/s 2024-05-08T09:32:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:24 smithi194 ceph-mon[33679]: pgmap v5291: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 466 KiB/s wr, 17 op/s 2024-05-08T09:32:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:24 smithi070 ceph-mon[29591]: pgmap v5291: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 466 KiB/s wr, 17 op/s 2024-05-08T09:32:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:24 smithi172 ceph-mon[33377]: pgmap v5291: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 466 KiB/s wr, 17 op/s 2024-05-08T09:32:26.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:25 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:32:26.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:25 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:32:26.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:25 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:32:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:26 smithi070 ceph-mon[29591]: pgmap v5292: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 626 KiB/s wr, 21 op/s 2024-05-08T09:32:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:26 smithi172 ceph-mon[33377]: pgmap v5292: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 626 KiB/s wr, 21 op/s 2024-05-08T09:32:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:26 smithi194 ceph-mon[33679]: pgmap v5292: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 626 KiB/s wr, 21 op/s 2024-05-08T09:32:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:27.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:28 smithi070 ceph-mon[29591]: pgmap v5293: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 608 KiB/s wr, 20 op/s 2024-05-08T09:32:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:32:29.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:32:29.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:28 smithi172 ceph-mon[33377]: pgmap v5293: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 608 KiB/s wr, 20 op/s 2024-05-08T09:32:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:32:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:32:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:28 smithi194 ceph-mon[33679]: pgmap v5293: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 608 KiB/s wr, 20 op/s 2024-05-08T09:32:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:32:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:32:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:32:31.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:30 smithi070 ceph-mon[29591]: pgmap v5294: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 586 KiB/s wr, 22 op/s 2024-05-08T09:32:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:30 smithi172 ceph-mon[33377]: pgmap v5294: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 586 KiB/s wr, 22 op/s 2024-05-08T09:32:31.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:30 smithi194 ceph-mon[33679]: pgmap v5294: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 586 KiB/s wr, 22 op/s 2024-05-08T09:32:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:32 smithi070 ceph-mon[29591]: pgmap v5295: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 302 KiB/s wr, 15 op/s 2024-05-08T09:32:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:32 smithi172 ceph-mon[33377]: pgmap v5295: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 302 KiB/s wr, 15 op/s 2024-05-08T09:32:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:32 smithi194 ceph-mon[33679]: pgmap v5295: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 302 KiB/s wr, 15 op/s 2024-05-08T09:32:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:34 smithi070 ceph-mon[29591]: pgmap v5296: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 302 KiB/s wr, 15 op/s 2024-05-08T09:32:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:34 smithi172 ceph-mon[33377]: pgmap v5296: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 302 KiB/s wr, 15 op/s 2024-05-08T09:32:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:34 smithi194 ceph-mon[33679]: pgmap v5296: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 302 KiB/s wr, 15 op/s 2024-05-08T09:32:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:36 smithi070 ceph-mon[29591]: pgmap v5297: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 302 KiB/s wr, 17 op/s 2024-05-08T09:32:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:36 smithi172 ceph-mon[33377]: pgmap v5297: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 302 KiB/s wr, 17 op/s 2024-05-08T09:32:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:36 smithi194 ceph-mon[33679]: pgmap v5297: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 401 KiB/s rd, 302 KiB/s wr, 17 op/s 2024-05-08T09:32:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:38 smithi070 ceph-mon[29591]: pgmap v5298: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 65 KiB/s wr, 7 op/s 2024-05-08T09:32:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:38 smithi172 ceph-mon[33377]: pgmap v5298: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 65 KiB/s wr, 7 op/s 2024-05-08T09:32:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:38 smithi194 ceph-mon[33679]: pgmap v5298: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 65 KiB/s wr, 7 op/s 2024-05-08T09:32:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:40 smithi070 ceph-mon[29591]: pgmap v5299: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 65 KiB/s wr, 9 op/s 2024-05-08T09:32:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:40 smithi172 ceph-mon[33377]: pgmap v5299: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 65 KiB/s wr, 9 op/s 2024-05-08T09:32:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:40 smithi194 ceph-mon[33679]: pgmap v5299: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 139 KiB/s rd, 65 KiB/s wr, 9 op/s 2024-05-08T09:32:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:42 smithi070 ceph-mon[29591]: pgmap v5300: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:42 smithi172 ceph-mon[33377]: pgmap v5300: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:42 smithi194 ceph-mon[33679]: pgmap v5300: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:44 smithi070 ceph-mon[29591]: pgmap v5301: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:44 smithi172 ceph-mon[33377]: pgmap v5301: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:44 smithi194 ceph-mon[33679]: pgmap v5301: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:46 smithi070 ceph-mon[29591]: pgmap v5302: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:47.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:46 smithi172 ceph-mon[33377]: pgmap v5302: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:46 smithi194 ceph-mon[33679]: pgmap v5302: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:48 smithi070 ceph-mon[29591]: pgmap v5303: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:49.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:48 smithi172 ceph-mon[33377]: pgmap v5303: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:48 smithi194 ceph-mon[33679]: pgmap v5303: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:50 smithi070 ceph-mon[29591]: pgmap v5304: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:51.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:50 smithi172 ceph-mon[33377]: pgmap v5304: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:50 smithi194 ceph-mon[33679]: pgmap v5304: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:52 smithi070 ceph-mon[29591]: pgmap v5305: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:52 smithi172 ceph-mon[33377]: pgmap v5305: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:52 smithi194 ceph-mon[33679]: pgmap v5305: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:54 smithi070 ceph-mon[29591]: pgmap v5306: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:54 smithi172 ceph-mon[33377]: pgmap v5306: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:54 smithi194 ceph-mon[33679]: pgmap v5306: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:56 smithi070 ceph-mon[29591]: pgmap v5307: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:56 smithi172 ceph-mon[33377]: pgmap v5307: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:56 smithi194 ceph-mon[33679]: pgmap v5307: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:32:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:32:58 smithi172 ceph-mon[33377]: pgmap v5308: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:32:58 smithi194 ceph-mon[33679]: pgmap v5308: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:32:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:32:58 smithi070 ceph-mon[29591]: pgmap v5308: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:00 smithi172 ceph-mon[33377]: pgmap v5309: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:00 smithi194 ceph-mon[33679]: pgmap v5309: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:00 smithi070 ceph-mon[29591]: pgmap v5309: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:03.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:02 smithi172 ceph-mon[33377]: pgmap v5310: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:02 smithi194 ceph-mon[33679]: pgmap v5310: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:02 smithi070 ceph-mon[29591]: pgmap v5310: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:04 smithi172 ceph-mon[33377]: pgmap v5311: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:04 smithi194 ceph-mon[33679]: pgmap v5311: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:04 smithi070 ceph-mon[29591]: pgmap v5311: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:06 smithi172 ceph-mon[33377]: pgmap v5312: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:33:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:06 smithi194 ceph-mon[33679]: pgmap v5312: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:33:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:06 smithi070 ceph-mon[29591]: pgmap v5312: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:33:08.446 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-05-08T09:33:08.447 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:33:08.953 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:33:09.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:08 smithi172 ceph-mon[33377]: pgmap v5313: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:33:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:08 smithi194 ceph-mon[33679]: pgmap v5313: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:33:09.301 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:08 smithi070 ceph-mon[29591]: pgmap v5313: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:33:10.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:09 smithi194 ceph-mon[33679]: osdmap e409: 12 total, 12 up, 12 in 2024-05-08T09:33:10.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:09 smithi070 ceph-mon[29591]: osdmap e409: 12 total, 12 up, 12 in 2024-05-08T09:33:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:09 smithi172 ceph-mon[33377]: osdmap e409: 12 total, 12 up, 12 in 2024-05-08T09:33:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:10 smithi194 ceph-mon[33679]: pgmap v5315: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:33:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:10 smithi070 ceph-mon[29591]: pgmap v5315: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:33:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:10 smithi172 ceph-mon[33377]: pgmap v5315: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:33:12.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.950+0000 7f7e5d600700 1 -- 172.21.15.70:0/1259403220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 msgr2=0x7f7e58102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:12.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.950+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1259403220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 0x7f7e58102910 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f7e480099c0 tx=0x7f7e48009cd0 comp rx=0 tx=0).stop 2024-05-08T09:33:12.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.951+0000 7f7e5d600700 1 -- 172.21.15.70:0/1259403220 shutdown_connections 2024-05-08T09:33:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.951+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1259403220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58107610 0x7f7e5810f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.951+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1259403220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 0x7f7e58102910 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.951+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1259403220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e58102ee0 0x7f7e58106f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.951+0000 7f7e5d600700 1 -- 172.21.15.70:0/1259403220 >> 172.21.15.70:0/1259403220 conn(0x7f7e580fddc0 msgr2=0x7f7e581001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.951+0000 7f7e5d600700 1 -- 172.21.15.70:0/1259403220 shutdown_connections 2024-05-08T09:33:12.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.951+0000 7f7e5d600700 1 -- 172.21.15.70:0/1259403220 wait complete. 2024-05-08T09:33:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.952+0000 7f7e5d600700 1 Processor -- start 2024-05-08T09:33:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.952+0000 7f7e5d600700 1 -- start start 2024-05-08T09:33:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.953+0000 7f7e5d600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 0x7f7e58109200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.953+0000 7f7e5d600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102ee0 0x7f7e58109740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.953+0000 7f7e5d600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e58107610 0x7f7e58109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.953+0000 7f7e5d600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7e581123c0 con 0x7f7e58102530 2024-05-08T09:33:12.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.953+0000 7f7e5d600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f7e58112240 con 0x7f7e58102ee0 2024-05-08T09:33:12.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.953+0000 7f7e5d600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7e58112540 con 0x7f7e58107610 2024-05-08T09:33:12.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.953+0000 7f7e57e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 0x7f7e58109200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:12.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.953+0000 7f7e57e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 0x7f7e58109200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58958/0 (socket says 172.21.15.70:58958) 2024-05-08T09:33:12.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.953+0000 7f7e57e00700 1 -- 172.21.15.70:0/1046860671 learned_addr learned my addr 172.21.15.70:0/1046860671 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.954+0000 7f7e57400700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102ee0 0x7f7e58109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.954+0000 7f7e57e00700 1 -- 172.21.15.70:0/1046860671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e58107610 msgr2=0x7f7e58109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.954+0000 7f7e5cc00700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e58107610 0x7f7e58109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.954+0000 7f7e57e00700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e58107610 0x7f7e58109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.954+0000 7f7e57e00700 1 -- 172.21.15.70:0/1046860671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102ee0 msgr2=0x7f7e58109740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.954+0000 7f7e57e00700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102ee0 0x7f7e58109740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.954+0000 7f7e57e00700 1 -- 172.21.15.70:0/1046860671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e581ac310 con 0x7f7e58102530 2024-05-08T09:33:12.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.954+0000 7f7e57e00700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 0x7f7e58109200 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800b580 tx=0x7f7e4800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.955+0000 7f7e54c00700 1 -- 172.21.15.70:0/1046860671 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e48027070 con 0x7f7e58102530 2024-05-08T09:33:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.955+0000 7f7e54c00700 1 -- 172.21.15.70:0/1046860671 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e4800fdd0 con 0x7f7e58102530 2024-05-08T09:33:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.955+0000 7f7e54c00700 1 -- 172.21.15.70:0/1046860671 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e480173f0 con 0x7f7e58102530 2024-05-08T09:33:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.955+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e581ac5a0 con 0x7f7e58102530 2024-05-08T09:33:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.955+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e581aca50 con 0x7f7e58102530 2024-05-08T09:33:12.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.957+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e58103a10 con 0x7f7e58102530 2024-05-08T09:33:12.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.959+0000 7f7e54c00700 1 -- 172.21.15.70:0/1046860671 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7e4802a070 con 0x7f7e58102530 2024-05-08T09:33:12.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.960+0000 7f7e54c00700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7e3c0b2a70 0x7f7e3c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.961+0000 7f7e54c00700 1 -- 172.21.15.70:0/1046860671 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(409..409 src has 1..409) ==== 9671+0+0 (secure 0 0 0) 0x7f7e480e39b0 con 0x7f7e58102530 2024-05-08T09:33:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.961+0000 7f7e57400700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7e3c0b2a70 0x7f7e3c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:12.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.962+0000 7f7e57400700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7e3c0b2a70 0x7f7e3c0b4f30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7e44005950 tx=0x7f7e440058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:12.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:12.966+0000 7f7e54c00700 1 -- 172.21.15.70:0/1046860671 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7e48013070 con 0x7f7e58102530 2024-05-08T09:33:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:12 smithi194 ceph-mon[33679]: pgmap v5316: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:33:13.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.275+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e5802e510 con 0x7f7e58102530 2024-05-08T09:33:13.274 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:12 smithi070 ceph-mon[29591]: pgmap v5316: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:33:13.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.276+0000 7f7e54c00700 1 -- 172.21.15.70:0/1046860671 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f7e480aaf40 con 0x7f7e58102530 2024-05-08T09:33:13.276 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:33:13.276 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:33:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7e3c0b2a70 msgr2=0x7f7e3c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7e3c0b2a70 0x7f7e3c0b4f30 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7e44005950 tx=0x7f7e440058e0 comp rx=0 tx=0).stop 2024-05-08T09:33:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 msgr2=0x7f7e58109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:13.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 0x7f7e58109200 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f7e4800b580 tx=0x7f7e4800f510 comp rx=0 tx=0).stop 2024-05-08T09:33:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 shutdown_connections 2024-05-08T09:33:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f7e3c0b2a70 0x7f7e3c0b4f30 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e58107610 0x7f7e58109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7e58102530 0x7f7e58109200 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 --2- 172.21.15.70:0/1046860671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7e58102ee0 0x7f7e58109740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.280+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 >> 172.21.15.70:0/1046860671 conn(0x7f7e580fddc0 msgr2=0x7f7e580ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.281+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 shutdown_connections 2024-05-08T09:33:13.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:13.281+0000 7f7e5d600700 1 -- 172.21.15.70:0/1046860671 wait complete. 2024-05-08T09:33:13.281 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:33:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:12 smithi172 ceph-mon[33377]: pgmap v5316: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:33:14.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:13 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1046860671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:33:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1046860671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:33:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:13 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1046860671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:33:14.514 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0' 2024-05-08T09:33:14.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 70 --await-for 42.0 2024-05-08T09:33:15.039 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:33:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:14 smithi070 ceph-mon[29591]: pgmap v5317: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:33:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:14 smithi194 ceph-mon[33679]: pgmap v5317: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:33:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:14 smithi172 ceph-mon[33377]: pgmap v5317: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:33:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:16 smithi194 ceph-mon[33679]: pgmap v5318: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:33:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:16 smithi194 ceph-mon[33679]: osdmap e410: 12 total, 12 up, 12 in 2024-05-08T09:33:17.324 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:16 smithi070 ceph-mon[29591]: pgmap v5318: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:33:17.324 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:16 smithi070 ceph-mon[29591]: osdmap e410: 12 total, 12 up, 12 in 2024-05-08T09:33:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:16 smithi172 ceph-mon[33377]: pgmap v5318: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:33:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:16 smithi172 ceph-mon[33377]: osdmap e410: 12 total, 12 up, 12 in 2024-05-08T09:33:18.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.261+0000 7f732ca00700 1 -- 172.21.15.70:0/213400668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328102610 msgr2=0x7f7328113c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:18.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.261+0000 7f732ca00700 1 --2- 172.21.15.70:0/213400668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328102610 0x7f7328113c40 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f7314009990 tx=0x7f7314009ca0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.262+0000 7f732ca00700 1 -- 172.21.15.70:0/213400668 shutdown_connections 2024-05-08T09:33:18.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.262+0000 7f732ca00700 1 --2- 172.21.15.70:0/213400668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7328114180 0x7f7328116570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.262+0000 7f732ca00700 1 --2- 172.21.15.70:0/213400668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7328101cf0 0x7f73281020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.262+0000 7f732ca00700 1 --2- 172.21.15.70:0/213400668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328102610 0x7f7328113c40 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.262+0000 7f732ca00700 1 -- 172.21.15.70:0/213400668 >> 172.21.15.70:0/213400668 conn(0x7f7328077580 msgr2=0x7f7328077990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:18.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.262+0000 7f732ca00700 1 -- 172.21.15.70:0/213400668 shutdown_connections 2024-05-08T09:33:18.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.262+0000 7f732ca00700 1 -- 172.21.15.70:0/213400668 wait complete. 2024-05-08T09:33:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.263+0000 7f732ca00700 1 Processor -- start 2024-05-08T09:33:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.263+0000 7f732ca00700 1 -- start start 2024-05-08T09:33:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.264+0000 7f732ca00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7328101cf0 0x7f732819fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.264+0000 7f732ca00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7328102610 0x7f73281a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.264+0000 7f732ca00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328114180 0x7f73281a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.264+0000 7f732ca00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7328119a30 con 0x7f7328114180 2024-05-08T09:33:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.264+0000 7f732ca00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73281198b0 con 0x7f7328101cf0 2024-05-08T09:33:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.264+0000 7f732ca00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f7328119bb0 con 0x7f7328102610 2024-05-08T09:33:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.264+0000 7f7327e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328114180 0x7f73281a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.264+0000 7f7327e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328114180 0x7f73281a4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55902/0 (socket says 172.21.15.70:55902) 2024-05-08T09:33:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.264+0000 7f7327e00700 1 -- 172.21.15.70:0/1503941686 learned_addr learned my addr 172.21.15.70:0/1503941686 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f7326a00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7328102610 0x7f73281a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f7327400700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7328101cf0 0x7f732819fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f7327e00700 1 -- 172.21.15.70:0/1503941686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7328102610 msgr2=0x7f73281a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f7327e00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7328102610 0x7f73281a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f7327e00700 1 -- 172.21.15.70:0/1503941686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7328101cf0 msgr2=0x7f732819fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f7327e00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7328101cf0 0x7f732819fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f7327e00700 1 -- 172.21.15.70:0/1503941686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73281a4e90 con 0x7f7328114180 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f7327e00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328114180 0x7f73281a4750 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f73200094f0 tx=0x7f7320007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f731fe00700 1 -- 172.21.15.70:0/1503941686 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320004db0 con 0x7f7328114180 2024-05-08T09:33:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f731fe00700 1 -- 172.21.15.70:0/1503941686 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7320005020 con 0x7f7328114180 2024-05-08T09:33:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f731fe00700 1 -- 172.21.15.70:0/1503941686 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7320015660 con 0x7f7328114180 2024-05-08T09:33:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.265+0000 7f732ca00700 1 -- 172.21.15.70:0/1503941686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73281a5180 con 0x7f7328114180 2024-05-08T09:33:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.266+0000 7f732ca00700 1 -- 172.21.15.70:0/1503941686 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73281aca00 con 0x7f7328114180 2024-05-08T09:33:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.269+0000 7f731fe00700 1 -- 172.21.15.70:0/1503941686 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f73200051d0 con 0x7f7328114180 2024-05-08T09:33:18.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:18 smithi070 ceph-mon[29591]: pgmap v5320: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2024-05-08T09:33:18.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.271+0000 7f731fe00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f730c0b2b20 0x7f730c0b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.271+0000 7f731fe00700 1 -- 172.21.15.70:0/1503941686 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(410..410 src has 1..410) ==== 9583+0+0 (secure 0 0 0) 0x7f73200e24d0 con 0x7f7328114180 2024-05-08T09:33:18.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.271+0000 7f7327400700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f730c0b2b20 0x7f730c0b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.272+0000 7f7327400700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f730c0b2b20 0x7f730c0b4fe0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7318005950 tx=0x7f73180058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:18.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.316+0000 7f7338968b80 1 Processor -- start 2024-05-08T09:33:18.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.316+0000 7f7338968b80 1 -- start start 2024-05-08T09:33:18.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.317+0000 7f7338968b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x5575550636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.317+0000 7f7338968b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 0x55755505d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.317+0000 7f7338968b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55755505de30 0x55755505e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.317+0000 7f7338968b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557554fafbb0 con 0x5575550632e0 2024-05-08T09:33:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.317+0000 7f7338968b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557554f4d8f0 con 0x557555063c00 2024-05-08T09:33:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.317+0000 7f7338968b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x557554fabb70 con 0x55755505de30 2024-05-08T09:33:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.317+0000 7f7327400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x5575550636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.317+0000 7f7327400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x5575550636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55914/0 (socket says 172.21.15.70:55914) 2024-05-08T09:33:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.317+0000 7f7327400700 1 -- 172.21.15.70:0/91454718 learned_addr learned my addr 172.21.15.70:0/91454718 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.318+0000 7f7326a00700 1 --2- 172.21.15.70:0/91454718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 0x55755505d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.318+0000 7f7327e00700 1 --2- 172.21.15.70:0/91454718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55755505de30 0x55755505e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.318+0000 7f7327400700 1 -- 172.21.15.70:0/91454718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55755505de30 msgr2=0x55755505e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:18.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.318+0000 7f7327400700 1 --2- 172.21.15.70:0/91454718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55755505de30 0x55755505e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.318+0000 7f7327400700 1 -- 172.21.15.70:0/91454718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 msgr2=0x55755505d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:18.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.318+0000 7f7327400700 1 --2- 172.21.15.70:0/91454718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 0x55755505d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.318+0000 7f7327400700 1 -- 172.21.15.70:0/91454718 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557554efca60 con 0x5575550632e0 2024-05-08T09:33:18.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.318+0000 7f7327400700 1 --2- 172.21.15.70:0/91454718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x5575550636c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f731800fd70 tx=0x7f7318012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d221d4828d899d41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.319+0000 7f731cc00700 1 -- 172.21.15.70:0/91454718 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318022070 con 0x5575550632e0 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.319+0000 7f731cc00700 1 -- 172.21.15.70:0/91454718 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7318011c60 con 0x5575550632e0 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.319+0000 7f731cc00700 1 -- 172.21.15.70:0/91454718 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731801d5b0 con 0x5575550632e0 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.320+0000 7f7338968b80 1 -- 172.21.15.70:0/91454718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 msgr2=0x5575550636c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.320+0000 7f7338968b80 1 --2- 172.21.15.70:0/91454718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x5575550636c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f731800fd70 tx=0x7f7318012000 comp rx=0 tx=0).stop 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.320+0000 7f7338968b80 1 -- 172.21.15.70:0/91454718 shutdown_connections 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.320+0000 7f7338968b80 1 --2- 172.21.15.70:0/91454718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55755505de30 0x55755505e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.320+0000 7f7338968b80 1 --2- 172.21.15.70:0/91454718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x5575550636c0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.320+0000 7f7338968b80 1 --2- 172.21.15.70:0/91454718 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 0x55755505d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.320+0000 7f7338968b80 1 -- 172.21.15.70:0/91454718 >> 172.21.15.70:0/91454718 conn(0x557554fd5860 msgr2=0x557555058370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:18.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.320+0000 7f7338968b80 1 -- 172.21.15.70:0/91454718 shutdown_connections 2024-05-08T09:33:18.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.320+0000 7f7338968b80 1 -- 172.21.15.70:0/91454718 wait complete. 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.321+0000 7f7338968b80 1 -- start start 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.321+0000 7f7338968b80 1 Processor -- start 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.321+0000 7f7338968b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x5575550699d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.321+0000 7f7338968b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575550632e0 0x557555066d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.321+0000 7f7338968b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 0x5575550672b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.321+0000 7f7338968b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55755506a720 con 0x55755505de30 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.321+0000 7f7338968b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x557554f15cb0 con 0x557555063c00 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.321+0000 7f7338968b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55755506a8a0 con 0x5575550632e0 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.321+0000 7f7338968b80 10 client.0 _ll_register_callbacks cb 0x557554f56e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7327400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x5575550699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7327400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x5575550699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55926/0 (socket says 172.21.15.70:55926) 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7327400700 1 -- 172.21.15.70:0/1068875726 learned_addr learned my addr 172.21.15.70:0/1068875726 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:18.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7326a00700 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575550632e0 0x557555066d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7327e00700 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 0x5575550672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7327400700 1 -- 172.21.15.70:0/1068875726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575550632e0 msgr2=0x557555066d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7327400700 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575550632e0 0x557555066d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7327400700 1 -- 172.21.15.70:0/1068875726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 msgr2=0x5575550672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7327400700 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 0x5575550672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.322+0000 7f7327400700 1 -- 172.21.15.70:0/1068875726 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557554f755b0 con 0x55755505de30 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.323+0000 7f7327400700 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x5575550699d0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f731800ffd0 tx=0x7f731801e450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee5dda38ee07289 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.323+0000 7f7311600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.323+0000 7f7311600700 1 -- 172.21.15.70:0/1068875726 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318036060 con 0x55755505de30 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.323+0000 7f7311600700 1 -- 172.21.15.70:0/1068875726 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(410..410 src has 1..410) ==== 9583+0+0 (secure 0 0 0) 0x7f731801e8b0 con 0x55755505de30 2024-05-08T09:33:18.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.323+0000 7f7338968b80 1 -- 172.21.15.70:0/1068875726 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7318011c60 con 0x55755505de30 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.323+0000 7f7311600700 1 -- 172.21.15.70:0/1068875726 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f731803d050 con 0x55755505de30 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.323+0000 7f7338968b80 10 client.19665 fetch_fsmap learned FSMap version 42 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.323+0000 7f7338968b80 1 -- 172.21.15.70:0/1068875726 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x557555074ff0 con 0x55755505de30 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.324+0000 7f7311600700 1 -- 172.21.15.70:0/1068875726 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7318011c60 con 0x55755505de30 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.324+0000 7f7311600700 1 -- 172.21.15.70:0/1068875726 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f73180103d0 con 0x55755505de30 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.324+0000 7f7338968b80 10 client.19665 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.324+0000 7f7338968b80 10 client.19665 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.324+0000 7f7338968b80 20 client.19665 populate_metadata read hostname 'smithi070' 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.324+0000 7f7338968b80 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557555077570 0x557555079960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.324+0000 7f7338968b80 4 client.19665 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:33:18.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.324+0000 7f7338968b80 1 -- 172.21.15.70:0/1068875726 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55755502a2d0 con 0x557555077570 2024-05-08T09:33:18.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.325+0000 7f7326a00700 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557555077570 0x557555079960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.326+0000 7f7326a00700 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557555077570 0x557555079960 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1539c450b26449f server_cookie=ef5519ffbaeb09fc in_seq=0 out_seq=0 2024-05-08T09:33:18.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.326+0000 7f7311600700 10 client.19665 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:33:18.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7311600700 1 -- 172.21.15.70:0/1068875726 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55755502a2d0 con 0x557555077570 2024-05-08T09:33:18.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7311600700 10 client.19665 handle_command_reply: tid=0 2024-05-08T09:33:18.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7338968b80 1 client.19665 shutdown 2024-05-08T09:33:18.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7338968b80 1 -- 172.21.15.70:0/1068875726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 msgr2=0x5575550699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:18.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7338968b80 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x5575550699d0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f731800ffd0 tx=0x7f731801e450 comp rx=0 tx=0).stop 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7338968b80 1 -- 172.21.15.70:0/1068875726 shutdown_connections 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7338968b80 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x557555077570 0x557555079960 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7338968b80 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x557555063c00 0x5575550672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7338968b80 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x5575550699d0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7338968b80 1 --2- 172.21.15.70:0/1068875726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575550632e0 0x557555066d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7338968b80 1 -- 172.21.15.70:0/1068875726 >> 172.21.15.70:0/1068875726 conn(0x557554fd5860 msgr2=0x55755505c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.328+0000 7f7311600700 0 client.19665 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.329+0000 7f7338968b80 1 -- 172.21.15.70:0/1068875726 shutdown_connections 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.329+0000 7f7338968b80 1 -- 172.21.15.70:0/1068875726 wait complete. 2024-05-08T09:33:18.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.329+0000 7f7338968b80 20 client.19665 trim_cache size 0 max 16384 2024-05-08T09:33:18.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.353+0000 7f7338968b80 1 Processor -- start 2024-05-08T09:33:18.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.353+0000 7f7338968b80 1 -- start start 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.353+0000 7f7338968b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x557555060d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.353+0000 7f7338968b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575550632e0 0x5575550612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.353+0000 7f7338968b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 0x557555063fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.353+0000 7f7338968b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73281b83c0 con 0x55755505de30 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.353+0000 7f7338968b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73281b5c50 con 0x5575550632e0 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.353+0000 7f7338968b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f73281b3ac0 con 0x557555063c00 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.353+0000 7f7327400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x557555060d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7327400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x557555060d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55942/0 (socket says 172.21.15.70:55942) 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7327400700 1 -- 172.21.15.70:0/137147098 learned_addr learned my addr 172.21.15.70:0/137147098 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7327e00700 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 0x557555063fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7327400700 1 -- 172.21.15.70:0/137147098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 msgr2=0x557555063fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:18.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7327400700 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 0x557555063fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7327400700 1 -- 172.21.15.70:0/137147098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575550632e0 msgr2=0x5575550612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:18.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7326a00700 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575550632e0 0x5575550612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7327400700 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575550632e0 0x5575550612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7327400700 1 -- 172.21.15.70:0/137147098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557555058670 con 0x55755505de30 2024-05-08T09:33:18.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7326a00700 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575550632e0 0x5575550612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.354+0000 7f7327400700 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x557555060d60 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f731801e5f0 tx=0x7f731801e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b4e474af3384f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.355+0000 7f7313e00700 1 -- 172.21.15.70:0/137147098 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318036030 con 0x55755505de30 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.355+0000 7f7313e00700 1 -- 172.21.15.70:0/137147098 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7318011b30 con 0x55755505de30 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.355+0000 7f7313e00700 1 -- 172.21.15.70:0/137147098 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318015040 con 0x55755505de30 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.356+0000 7f7338968b80 1 -- 172.21.15.70:0/137147098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 msgr2=0x557555060d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.356+0000 7f7338968b80 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x557555060d60 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f731801e5f0 tx=0x7f731801e620 comp rx=0 tx=0).stop 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.356+0000 7f7338968b80 1 -- 172.21.15.70:0/137147098 shutdown_connections 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.356+0000 7f7338968b80 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 0x557555063fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.356+0000 7f7338968b80 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55755505de30 0x557555060d60 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.356+0000 7f7338968b80 1 --2- 172.21.15.70:0/137147098 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575550632e0 0x5575550612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.356+0000 7f7338968b80 1 -- 172.21.15.70:0/137147098 >> 172.21.15.70:0/137147098 conn(0x557554fd5860 msgr2=0x55755505c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:18.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.356+0000 7f7338968b80 1 -- 172.21.15.70:0/137147098 shutdown_connections 2024-05-08T09:33:18.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.356+0000 7f7338968b80 1 -- 172.21.15.70:0/137147098 wait complete. 2024-05-08T09:33:18.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.357+0000 7f7338968b80 1 -- start start 2024-05-08T09:33:18.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.357+0000 7f7338968b80 1 Processor -- start 2024-05-08T09:33:18.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.357+0000 7f7338968b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x55755507cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.357+0000 7f7338968b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 0x55755507af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.357+0000 7f7338968b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55755507b4c0 0x55755507b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.357+0000 7f7338968b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73281b4110 con 0x5575550632e0 2024-05-08T09:33:18.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.357+0000 7f7338968b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f73281b5580 con 0x55755507b4c0 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.357+0000 7f7338968b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f73281b47e0 con 0x557555063c00 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.357+0000 7f7338968b80 10 client.0 _ll_register_callbacks cb 0x557554f56e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7327400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x55755507cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7327400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x55755507cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55948/0 (socket says 172.21.15.70:55948) 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7327400700 1 -- 172.21.15.70:0/1275453432 learned_addr learned my addr 172.21.15.70:0/1275453432 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7327e00700 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55755507b4c0 0x55755507b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7326a00700 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 0x55755507af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7327400700 1 -- 172.21.15.70:0/1275453432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 msgr2=0x55755507af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7327400700 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 0x55755507af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7327400700 1 -- 172.21.15.70:0/1275453432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55755507b4c0 msgr2=0x55755507b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7327400700 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55755507b4c0 0x55755507b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:18.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.358+0000 7f7327400700 1 -- 172.21.15.70:0/1275453432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55755505db80 con 0x5575550632e0 2024-05-08T09:33:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.359+0000 7f7327400700 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x55755507cc20 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f73180108c0 tx=0x7f73180106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e91324fa2cc601 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.359+0000 7f7311600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:33:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.359+0000 7f7311600700 1 -- 172.21.15.70:0/1275453432 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7318048070 con 0x5575550632e0 2024-05-08T09:33:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.359+0000 7f7311600700 1 -- 172.21.15.70:0/1275453432 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(410..410 src has 1..410) ==== 9583+0+0 (secure 0 0 0) 0x7f7318010d60 con 0x5575550632e0 2024-05-08T09:33:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.359+0000 7f7338968b80 1 -- 172.21.15.70:0/1275453432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7318011b30 con 0x5575550632e0 2024-05-08T09:33:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.359+0000 7f7311600700 1 -- 172.21.15.70:0/1275453432 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f7318022050 con 0x5575550632e0 2024-05-08T09:33:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.359+0000 7f7338968b80 10 client.19671 fetch_fsmap learned FSMap version 42 2024-05-08T09:33:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.359+0000 7f7338968b80 1 -- 172.21.15.70:0/1275453432 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5575550e2d60 con 0x5575550632e0 2024-05-08T09:33:18.360 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.360+0000 7f7311600700 1 -- 172.21.15.70:0/1275453432 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7318011b30 con 0x5575550632e0 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.360+0000 7f7311600700 1 -- 172.21.15.70:0/1275453432 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f7318031600 con 0x5575550632e0 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.360+0000 7f7338968b80 10 client.19671 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.360+0000 7f7338968b80 10 client.19671 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.360+0000 7f7338968b80 20 client.19671 populate_metadata read hostname 'smithi070' 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.360+0000 7f7338968b80 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575550e3230 0x5575550e5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.360+0000 7f7338968b80 4 client.19671 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}] 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.360+0000 7f7338968b80 1 -- 172.21.15.70:0/1275453432 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 70.0, "await_for": 42.0}) -- 0x557554fbd590 con 0x5575550e3230 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.361+0000 7f7326a00700 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575550e3230 0x5575550e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.362+0000 7f7326a00700 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575550e3230 0x5575550e5620 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c7c09c7b4dd9147 server_cookie=3b08ac9c00d678f2 in_seq=0 out_seq=0 2024-05-08T09:33:18.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:18.362+0000 7f7311600700 10 client.19671 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:33:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:18 smithi172 ceph-mon[33377]: pgmap v5320: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2024-05-08T09:33:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:18 smithi194 ceph-mon[33679]: pgmap v5320: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 B/s wr, 3 op/s 2024-05-08T09:33:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:20 smithi070 ceph-mon[29591]: pgmap v5321: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:33:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:20 smithi172 ceph-mon[33377]: pgmap v5321: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:33:20.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:20 smithi194 ceph-mon[33679]: pgmap v5321: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:33:22.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:22 smithi070 ceph-mon[29591]: pgmap v5322: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:33:22.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:22 smithi172 ceph-mon[33377]: pgmap v5322: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:33:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:22 smithi194 ceph-mon[33679]: pgmap v5322: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:33:24.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:24 smithi070 ceph-mon[29591]: pgmap v5323: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:33:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:24 smithi172 ceph-mon[33377]: pgmap v5323: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:33:24.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:24 smithi194 ceph-mon[33679]: pgmap v5323: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:33:26.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:26 smithi070 ceph-mon[29591]: pgmap v5324: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 409 B/s wr, 6 op/s 2024-05-08T09:33:26.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:26 smithi172 ceph-mon[33377]: pgmap v5324: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 409 B/s wr, 6 op/s 2024-05-08T09:33:26.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:26 smithi194 ceph-mon[33679]: pgmap v5324: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 409 B/s wr, 6 op/s 2024-05-08T09:33:28.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:28 smithi070 ceph-mon[29591]: pgmap v5325: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 398 B/s wr, 6 op/s 2024-05-08T09:33:28.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:28 smithi172 ceph-mon[33377]: pgmap v5325: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 398 B/s wr, 6 op/s 2024-05-08T09:33:28.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:28 smithi194 ceph-mon[33679]: pgmap v5325: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 398 B/s wr, 6 op/s 2024-05-08T09:33:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:33:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:33:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:33:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:30 smithi172 ceph-mon[33377]: pgmap v5326: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-08T09:33:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:33:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:33:30.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:33:30.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:30 smithi194 ceph-mon[33679]: pgmap v5326: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-08T09:33:30.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:33:30.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:33:30.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:33:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:30 smithi070 ceph-mon[29591]: pgmap v5326: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-08T09:33:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:33:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:33:30.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:33:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:32 smithi172 ceph-mon[33377]: pgmap v5327: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-08T09:33:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:32 smithi194 ceph-mon[33679]: pgmap v5327: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-08T09:33:32.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:32 smithi070 ceph-mon[29591]: pgmap v5327: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-08T09:33:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:34 smithi172 ceph-mon[33377]: pgmap v5328: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-08T09:33:34.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:34 smithi194 ceph-mon[33679]: pgmap v5328: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-08T09:33:34.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:34 smithi070 ceph-mon[29591]: pgmap v5328: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-05-08T09:33:36.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:36 smithi172 ceph-mon[33377]: pgmap v5329: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-08T09:33:36.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:36 smithi194 ceph-mon[33679]: pgmap v5329: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-08T09:33:36.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:36 smithi070 ceph-mon[29591]: pgmap v5329: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2024-05-08T09:33:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:38 smithi172 ceph-mon[33377]: pgmap v5330: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T09:33:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:38 smithi194 ceph-mon[33679]: pgmap v5330: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T09:33:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:38 smithi070 ceph-mon[29591]: pgmap v5330: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T09:33:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:40 smithi172 ceph-mon[33377]: pgmap v5331: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-05-08T09:33:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:40 smithi194 ceph-mon[33679]: pgmap v5331: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-05-08T09:33:40.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:40 smithi070 ceph-mon[29591]: pgmap v5331: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-05-08T09:33:40.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.975+0000 7f7311600700 1 -- 172.21.15.70:0/1275453432 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x557554fbd590 con 0x5575550e3230 2024-05-08T09:33:40.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.975+0000 7f7311600700 10 client.19671 handle_command_reply: tid=0 2024-05-08T09:33:40.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.975+0000 7f7338968b80 1 client.19671 shutdown 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.976+0000 7f7338968b80 1 -- 172.21.15.70:0/1275453432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 msgr2=0x55755507cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.976+0000 7f7338968b80 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x55755507cc20 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f73180108c0 tx=0x7f73180106b0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.976+0000 7f7338968b80 1 -- 172.21.15.70:0/1275453432 shutdown_connections 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.976+0000 7f7338968b80 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575550e3230 0x5575550e5620 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.976+0000 7f7338968b80 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55755507b4c0 0x55755507b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.976+0000 7f7338968b80 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575550632e0 0x55755507cc20 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.976+0000 7f7338968b80 1 --2- 172.21.15.70:0/1275453432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x557555063c00 0x55755507af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.976+0000 7f7338968b80 1 -- 172.21.15.70:0/1275453432 >> 172.21.15.70:0/1275453432 conn(0x557554fd5860 msgr2=0x5575550627a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.976+0000 7f7311600700 0 client.19671 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.977+0000 7f7338968b80 1 -- 172.21.15.70:0/1275453432 shutdown_connections 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.977+0000 7f7338968b80 1 -- 172.21.15.70:0/1275453432 wait complete. 2024-05-08T09:33:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.977+0000 7f7338968b80 20 client.19671 trim_cache size 0 max 16384 2024-05-08T09:33:40.977 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:33:40.977 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:33:40.977 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:33:40.977 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 362, 2024-05-08T09:33:40.977 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:33:40.977 INFO:teuthology.orchestra.run.smithi070.stdout: "ebfca337": { 2024-05-08T09:33:40.977 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 362, 2024-05-08T09:33:40.977 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:33:40.977 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:33:40.978 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.978+0000 7f732ca00700 1 -- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f730c0b2b20 msgr2=0x7f730c0b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.978+0000 7f732ca00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f730c0b2b20 0x7f730c0b4fe0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7318005950 tx=0x7f73180058e0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.978+0000 7f732ca00700 1 -- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328114180 msgr2=0x7f73281a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.978+0000 7f732ca00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328114180 0x7f73281a4750 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f73200094f0 tx=0x7f7320007f90 comp rx=0 tx=0).stop 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.978+0000 7f732ca00700 1 -- 172.21.15.70:0/1503941686 shutdown_connections 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.979+0000 7f732ca00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f730c0b2b20 0x7f730c0b4fe0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.979+0000 7f732ca00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7328114180 0x7f73281a4750 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.979+0000 7f732ca00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f7328101cf0 0x7f732819fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.979+0000 7f732ca00700 1 --2- 172.21.15.70:0/1503941686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7328102610 0x7f73281a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:40.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.979+0000 7f732ca00700 1 -- 172.21.15.70:0/1503941686 >> 172.21.15.70:0/1503941686 conn(0x7f7328077580 msgr2=0x7f7328111c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:40.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.979+0000 7f732ca00700 1 -- 172.21.15.70:0/1503941686 shutdown_connections 2024-05-08T09:33:40.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:40.979+0000 7f732ca00700 1 -- 172.21.15.70:0/1503941686 wait complete. 2024-05-08T09:33:41.989 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ebfca337', quiesce took 33.5 seconds. Will release after: 10 2024-05-08T09:33:42.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:42 smithi172 ceph-mon[33377]: pgmap v5332: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:42.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:42 smithi194 ceph-mon[33679]: pgmap v5332: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:42 smithi070 ceph-mon[29591]: pgmap v5332: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:44.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:44 smithi070 ceph-mon[29591]: pgmap v5333: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:44 smithi194 ceph-mon[33679]: pgmap v5333: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:44 smithi172 ceph-mon[33377]: pgmap v5333: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:46.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:46 smithi194 ceph-mon[33679]: pgmap v5334: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:46 smithi070 ceph-mon[29591]: pgmap v5334: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:46.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:46 smithi172 ceph-mon[33377]: pgmap v5334: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:48 smithi194 ceph-mon[33679]: pgmap v5335: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:48.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:48 smithi070 ceph-mon[29591]: pgmap v5335: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:48.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:48 smithi172 ceph-mon[33377]: pgmap v5335: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:50 smithi194 ceph-mon[33679]: pgmap v5336: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:50.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:50 smithi070 ceph-mon[29591]: pgmap v5336: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:50.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:50 smithi172 ceph-mon[33377]: pgmap v5336: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:51.991 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:33:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:52 smithi070 ceph-mon[29591]: pgmap v5337: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:52.479 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:33:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:52 smithi194 ceph-mon[33679]: pgmap v5337: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:52 smithi172 ceph-mon[33377]: pgmap v5337: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:54.458 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:54 smithi070 ceph-mon[29591]: pgmap v5338: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:54 smithi194 ceph-mon[33679]: pgmap v5338: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:54.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:54 smithi172 ceph-mon[33377]: pgmap v5338: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.860+0000 7feba5c00700 1 -- 172.21.15.70:0/238202470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba01033d0 msgr2=0x7feba0103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.860+0000 7feba5c00700 1 --2- 172.21.15.70:0/238202470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba01033d0 0x7feba0103850 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009990 tx=0x7feb8c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.860+0000 7feba5c00700 1 -- 172.21.15.70:0/238202470 shutdown_connections 2024-05-08T09:33:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.860+0000 7feba5c00700 1 --2- 172.21.15.70:0/238202470 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba0103d90 0x7feba01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.860+0000 7feba5c00700 1 --2- 172.21.15.70:0/238202470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba0109460 0x7feba0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.860+0000 7feba5c00700 1 --2- 172.21.15.70:0/238202470 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba01033d0 0x7feba0103850 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.860+0000 7feba5c00700 1 -- 172.21.15.70:0/238202470 >> 172.21.15.70:0/238202470 conn(0x7feba00fef20 msgr2=0x7feba0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.860+0000 7feba5c00700 1 -- 172.21.15.70:0/238202470 shutdown_connections 2024-05-08T09:33:55.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.861+0000 7feba5c00700 1 -- 172.21.15.70:0/238202470 wait complete. 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.862+0000 7feba5c00700 1 Processor -- start 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.862+0000 7feba5c00700 1 -- start start 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.863+0000 7feba5c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba01033d0 0x7feba00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.863+0000 7feba5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba0103d90 0x7feba0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.863+0000 7feba5c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba0109460 0x7feba0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.863+0000 7feba5c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feba0113490 con 0x7feba0103d90 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.863+0000 7feba5c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feba0113310 con 0x7feba0109460 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.863+0000 7feba5c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feba0113610 con 0x7feba01033d0 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.863+0000 7feb9f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba0103d90 0x7feba0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.863+0000 7feb9f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba0103d90 0x7feba0075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59410/0 (socket says 172.21.15.70:59410) 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.863+0000 7feb9f400700 1 -- 172.21.15.70:0/3298426476 learned_addr learned my addr 172.21.15.70:0/3298426476 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:55.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.864+0000 7feb9fe00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba01033d0 0x7feba00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.864+0000 7feba5200700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba0109460 0x7feba0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.864+0000 7feb9f400700 1 -- 172.21.15.70:0/3298426476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba01033d0 msgr2=0x7feba00757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.864+0000 7feb9f400700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba01033d0 0x7feba00757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.864+0000 7feb9f400700 1 -- 172.21.15.70:0/3298426476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba0109460 msgr2=0x7feba0076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.864+0000 7feb9f400700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba0109460 0x7feba0076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.864+0000 7feb9f400700 1 -- 172.21.15.70:0/3298426476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba01a7ec0 con 0x7feba0103d90 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.864+0000 7feb9f400700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba0103d90 0x7feba0075ce0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7feb8c005910 tx=0x7feb8c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.865+0000 7feb9cc00700 1 -- 172.21.15.70:0/3298426476 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c027070 con 0x7feba0103d90 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.865+0000 7feb9cc00700 1 -- 172.21.15.70:0/3298426476 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb8c00fc00 con 0x7feba0103d90 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.865+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feba01a8150 con 0x7feba0103d90 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.865+0000 7feb9cc00700 1 -- 172.21.15.70:0/3298426476 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c022d40 con 0x7feba0103d90 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.865+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feba01a8600 con 0x7feba0103d90 2024-05-08T09:33:55.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.866+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba006a190 con 0x7feba0103d90 2024-05-08T09:33:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.870+0000 7feb9cc00700 1 -- 172.21.15.70:0/3298426476 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7feb8c02a070 con 0x7feba0103d90 2024-05-08T09:33:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.871+0000 7feb9cc00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb840b2a70 0x7feb840b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.872+0000 7feb9cc00700 1 -- 172.21.15.70:0/3298426476 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(410..410 src has 1..410) ==== 9583+0+0 (secure 0 0 0) 0x7feb8c0e37a0 con 0x7feba0103d90 2024-05-08T09:33:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.872+0000 7feb9fe00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb840b2a70 0x7feb840b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.873+0000 7feb9fe00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb840b2a70 0x7feb840b4f30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7feb9000bbb0 tx=0x7feb9000b590 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:55.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:54.878+0000 7feb9cc00700 1 -- 172.21.15.70:0/3298426476 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7feb8c05fdf0 con 0x7feba0103d90 2024-05-08T09:33:55.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.184+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feba002e510 con 0x7feba0103d90 2024-05-08T09:33:55.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.185+0000 7feb9cc00700 1 -- 172.21.15.70:0/3298426476 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7feb8c013070 con 0x7feba0103d90 2024-05-08T09:33:55.184 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:33:55.184 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:33:55.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb840b2a70 msgr2=0x7feb840b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb840b2a70 0x7feb840b4f30 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7feb9000bbb0 tx=0x7feb9000b590 comp rx=0 tx=0).stop 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba0103d90 msgr2=0x7feba0075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba0103d90 0x7feba0075ce0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7feb8c005910 tx=0x7feb8c0047b0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 shutdown_connections 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb840b2a70 0x7feb840b4f30 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feba0109460 0x7feba0076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feba01033d0 0x7feba00757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 --2- 172.21.15.70:0/3298426476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feba0103d90 0x7feba0075ce0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.188+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 >> 172.21.15.70:0/3298426476 conn(0x7feba00fef20 msgr2=0x7feba00ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.189+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 shutdown_connections 2024-05-08T09:33:55.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:55.189+0000 7feba5c00700 1 -- 172.21.15.70:0/3298426476 wait complete. 2024-05-08T09:33:55.190 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:33:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:55 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3298426476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:33:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:55 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3298426476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:33:55.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:55 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3298426476' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:33:56.063 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id ebfca337 --release --await' 2024-05-08T09:33:56.064 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id ebfca337 --release --await 2024-05-08T09:33:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:56 smithi194 ceph-mon[33679]: pgmap v5339: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:33:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:56 smithi070 ceph-mon[29591]: pgmap v5339: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:56.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:56 smithi172 ceph-mon[33377]: pgmap v5339: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:33:58.377 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:33:58 smithi070 ceph-mon[29591]: pgmap v5340: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:33:58 smithi194 ceph-mon[33679]: pgmap v5340: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:58.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:33:58 smithi172 ceph-mon[33377]: pgmap v5340: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:33:58.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.942+0000 7fdf24a00700 1 -- 172.21.15.70:0/2283349103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 msgr2=0x7fdf2010bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:58.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.942+0000 7fdf24a00700 1 --2- 172.21.15.70:0/2283349103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 0x7fdf2010bac0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009990 tx=0x7fdf10009ca0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.942+0000 7fdf24a00700 1 -- 172.21.15.70:0/2283349103 shutdown_connections 2024-05-08T09:33:58.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.942+0000 7fdf24a00700 1 --2- 172.21.15.70:0/2283349103 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201060a0 0x7fdf201125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.942+0000 7fdf24a00700 1 --2- 172.21.15.70:0/2283349103 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 0x7fdf2010bac0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.942+0000 7fdf24a00700 1 --2- 172.21.15.70:0/2283349103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf201056e0 0x7fdf20105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.942+0000 7fdf24a00700 1 -- 172.21.15.70:0/2283349103 >> 172.21.15.70:0/2283349103 conn(0x7fdf201011d0 msgr2=0x7fdf201035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:58.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.942+0000 7fdf24a00700 1 -- 172.21.15.70:0/2283349103 shutdown_connections 2024-05-08T09:33:58.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.942+0000 7fdf24a00700 1 -- 172.21.15.70:0/2283349103 wait complete. 2024-05-08T09:33:58.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.944+0000 7fdf24a00700 1 Processor -- start 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.944+0000 7fdf24a00700 1 -- start start 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.944+0000 7fdf24a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201056e0 0x7fdf201a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.944+0000 7fdf24a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf201060a0 0x7fdf201a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.944+0000 7fdf24a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 0x7fdf2019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.944+0000 7fdf24a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201157d0 con 0x7fdf2010b6e0 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.944+0000 7fdf24a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20115650 con 0x7fdf201056e0 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.944+0000 7fdf24a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdf20115950 con 0x7fdf201060a0 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 0x7fdf2019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1e800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 0x7fdf2019baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50876/0 (socket says 172.21.15.70:50876) 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1e800700 1 -- 172.21.15.70:0/787735358 learned_addr learned my addr 172.21.15.70:0/787735358 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:58.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1de00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201056e0 0x7fdf201a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1d400700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf201060a0 0x7fdf201a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1e800700 1 -- 172.21.15.70:0/787735358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf201060a0 msgr2=0x7fdf201a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1e800700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf201060a0 0x7fdf201a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1e800700 1 -- 172.21.15.70:0/787735358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201056e0 msgr2=0x7fdf201a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1e800700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201056e0 0x7fdf201a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.945+0000 7fdf1e800700 1 -- 172.21.15.70:0/787735358 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2019c250 con 0x7fdf2010b6e0 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.946+0000 7fdf1e800700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 0x7fdf2019baf0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fdf18007ee0 tx=0x7fdf1800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.946+0000 7fdf16a00700 1 -- 172.21.15.70:0/787735358 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1800dbd0 con 0x7fdf2010b6e0 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.946+0000 7fdf24a00700 1 -- 172.21.15.70:0/787735358 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2019c540 con 0x7fdf2010b6e0 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.946+0000 7fdf16a00700 1 -- 172.21.15.70:0/787735358 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf1800dd70 con 0x7fdf2010b6e0 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.946+0000 7fdf16a00700 1 -- 172.21.15.70:0/787735358 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf180058d0 con 0x7fdf2010b6e0 2024-05-08T09:33:58.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.946+0000 7fdf24a00700 1 -- 172.21.15.70:0/787735358 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf201a8800 con 0x7fdf2010b6e0 2024-05-08T09:33:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.950+0000 7fdf16a00700 1 -- 172.21.15.70:0/787735358 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fdf1801a020 con 0x7fdf2010b6e0 2024-05-08T09:33:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.952+0000 7fdf16a00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdf040b29f0 0x7fdf040b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.952+0000 7fdf2f31bb80 1 Processor -- start 2024-05-08T09:33:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.952+0000 7fdf16a00700 1 -- 172.21.15.70:0/787735358 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(410..410 src has 1..410) ==== 9583+0+0 (secure 0 0 0) 0x7fdf180e22b0 con 0x7fdf2010b6e0 2024-05-08T09:33:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.952+0000 7fdf2f31bb80 1 -- start start 2024-05-08T09:33:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.952+0000 7fdf1de00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdf040b29f0 0x7fdf040b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b99260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 0x559287b9d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287b9dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559287ae2b20 con 0x559287b98e80 2024-05-08T09:33:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559287a80860 con 0x559287b997a0 2024-05-08T09:33:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559287adeae0 con 0x559287b9d790 2024-05-08T09:33:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf1de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b99260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf1de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b99260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50888/0 (socket says 172.21.15.70:50888) 2024-05-08T09:33:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf1de00700 1 -- 172.21.15.70:0/4087350985 learned_addr learned my addr 172.21.15.70:0/4087350985 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf1d400700 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 0x559287b9d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.953+0000 7fdf1e800700 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287b9dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.954+0000 7fdf1de00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdf040b29f0 0x7fdf040b4eb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b5c0 tx=0x7fdf10005fd0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.954+0000 7fdf1de00700 1 -- 172.21.15.70:0/4087350985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 msgr2=0x559287b9dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.954+0000 7fdf1de00700 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287b9dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.954+0000 7fdf1de00700 1 -- 172.21.15.70:0/4087350985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 msgr2=0x559287b9d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.954+0000 7fdf1de00700 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 0x559287b9d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.954+0000 7fdf1de00700 1 -- 172.21.15.70:0/4087350985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559287a2f9d0 con 0x559287b98e80 2024-05-08T09:33:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.954+0000 7fdf1e800700 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287b9dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:33:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.954+0000 7fdf1de00700 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b99260 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000ba90 tx=0x7fdf10026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb27148e5908dff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.955+0000 7fdf0b400700 1 -- 172.21.15.70:0/4087350985 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10032070 con 0x559287b98e80 2024-05-08T09:33:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.955+0000 7fdf0b400700 1 -- 172.21.15.70:0/4087350985 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf10029040 con 0x559287b98e80 2024-05-08T09:33:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.955+0000 7fdf0b400700 1 -- 172.21.15.70:0/4087350985 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1002daa0 con 0x559287b98e80 2024-05-08T09:33:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.956+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/4087350985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 msgr2=0x559287b99260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.956+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b99260 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000ba90 tx=0x7fdf10026000 comp rx=0 tx=0).stop 2024-05-08T09:33:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.956+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/4087350985 shutdown_connections 2024-05-08T09:33:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.956+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287b9dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.956+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b99260 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.956+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/4087350985 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 0x559287b9d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.956+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/4087350985 >> 172.21.15.70:0/4087350985 conn(0x559287abec60 msgr2=0x559287b8ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:58.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.956+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/4087350985 shutdown_connections 2024-05-08T09:33:58.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.956+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/4087350985 wait complete. 2024-05-08T09:33:58.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.957+0000 7fdf2f31bb80 1 -- start start 2024-05-08T09:33:58.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.957+0000 7fdf2f31bb80 1 Processor -- start 2024-05-08T09:33:58.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.957+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 0x559287ba4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.957+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.957+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287ba2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.957+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559287ba59d0 con 0x559287b997a0 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.957+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x559287a48c20 con 0x559287b98e80 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.957+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x559287ba5b50 con 0x559287b9d790 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.957+0000 7fdf2f31bb80 10 client.0 _ll_register_callbacks cb 0x559287a89d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50898/0 (socket says 172.21.15.70:50898) 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1d400700 1 -- 172.21.15.70:0/1933312630 learned_addr learned my addr 172.21.15.70:0/1933312630 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1e800700 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287ba2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1de00700 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 0x559287ba4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1d400700 1 -- 172.21.15.70:0/1933312630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 msgr2=0x559287ba2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1d400700 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287ba2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1d400700 1 -- 172.21.15.70:0/1933312630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 msgr2=0x559287ba4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1d400700 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 0x559287ba4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1d400700 1 -- 172.21.15.70:0/1933312630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559287aa8520 con 0x559287b997a0 2024-05-08T09:33:58.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.958+0000 7fdf1de00700 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 0x559287ba4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:33:58.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.959+0000 7fdf1d400700 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba1fc0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009dc0 tx=0x7fdf0c0116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394bc707d6c15e62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:58.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.959+0000 7fdeffe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:33:58.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.959+0000 7fdeffe00700 1 -- 172.21.15.70:0/1933312630 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c012650 con 0x559287b997a0 2024-05-08T09:33:58.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.959+0000 7fdeffe00700 1 -- 172.21.15.70:0/1933312630 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(410..410 src has 1..410) ==== 9583+0+0 (secure 0 0 0) 0x7fdf0c0127f0 con 0x559287b997a0 2024-05-08T09:33:58.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.959+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/1933312630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf10029040 con 0x559287b997a0 2024-05-08T09:33:58.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.959+0000 7fdeffe00700 1 -- 172.21.15.70:0/1933312630 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fdf0c025050 con 0x559287b997a0 2024-05-08T09:33:58.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.959+0000 7fdf2f31bb80 10 client.19689 fetch_fsmap learned FSMap version 42 2024-05-08T09:33:58.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.960+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/1933312630 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559287bb0300 con 0x559287b997a0 2024-05-08T09:33:58.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.960+0000 7fdeffe00700 1 -- 172.21.15.70:0/1933312630 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf10029040 con 0x559287b997a0 2024-05-08T09:33:58.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.960+0000 7fdeffe00700 1 -- 172.21.15.70:0/1933312630 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fdf0c00f040 con 0x559287b997a0 2024-05-08T09:33:58.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.960+0000 7fdf2f31bb80 10 client.19689 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:33:58.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.960+0000 7fdf2f31bb80 10 client.19689 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:33:58.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.960+0000 7fdf2f31bb80 20 client.19689 populate_metadata read hostname 'smithi070' 2024-05-08T09:33:58.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.960+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559287bb2940 0x559287bb4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.960+0000 7fdf2f31bb80 4 client.19689 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:33:58.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.960+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/1933312630 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559287b5d1a0 con 0x559287bb2940 2024-05-08T09:33:58.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.961+0000 7fdf1de00700 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559287bb2940 0x559287bb4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.962+0000 7fdf1de00700 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559287bb2940 0x559287bb4de0 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a86893fa33b8bd server_cookie=cf2a04a2e288251b in_seq=0 out_seq=0 2024-05-08T09:33:58.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.962+0000 7fdeffe00700 10 client.19689 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.964+0000 7fdeffe00700 1 -- 172.21.15.70:0/1933312630 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559287b5d1a0 con 0x559287bb2940 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.964+0000 7fdeffe00700 10 client.19689 handle_command_reply: tid=0 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.964+0000 7fdf2f31bb80 1 client.19689 shutdown 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/1933312630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 msgr2=0x559287ba1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba1fc0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009dc0 tx=0x7fdf0c0116c0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/1933312630 shutdown_connections 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559287bb2940 0x559287bb4de0 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287ba2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdeffe00700 0 client.19689 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 0x559287ba4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/1933312630 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba1fc0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/1933312630 >> 172.21.15.70:0/1933312630 conn(0x559287abec60 msgr2=0x559287b85850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:58.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/1933312630 shutdown_connections 2024-05-08T09:33:58.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/1933312630 wait complete. 2024-05-08T09:33:58.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.965+0000 7fdf2f31bb80 20 client.19689 trim_cache size 0 max 16384 2024-05-08T09:33:58.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.991+0000 7fdf2f31bb80 1 Processor -- start 2024-05-08T09:33:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.991+0000 7fdf2f31bb80 1 -- start start 2024-05-08T09:33:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.991+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b9fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 0x559287bba740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287bbac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201afc90 con 0x559287b98e80 2024-05-08T09:33:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201ad520 con 0x559287b997a0 2024-05-08T09:33:58.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201ab390 con 0x559287b9d790 2024-05-08T09:33:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf1de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b9fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf1de00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b9fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50906/0 (socket says 172.21.15.70:50906) 2024-05-08T09:33:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf1de00700 1 -- 172.21.15.70:0/2493754938 learned_addr learned my addr 172.21.15.70:0/2493754938 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:58.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf1e800700 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287bbac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.992+0000 7fdf1d400700 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 0x559287bba740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf1de00700 1 -- 172.21.15.70:0/2493754938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 msgr2=0x559287bbac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf1de00700 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287bbac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf1de00700 1 -- 172.21.15.70:0/2493754938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 msgr2=0x559287bba740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf1de00700 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 0x559287bba740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf1de00700 1 -- 172.21.15.70:0/2493754938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559287bb5460 con 0x559287b98e80 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf1d400700 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 0x559287bba740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf1de00700 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b9fb50 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdf10030040 tx=0x7fdf10009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02410253eb24b26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf0aa00700 1 -- 172.21.15.70:0/2493754938 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10032040 con 0x559287b98e80 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf0aa00700 1 -- 172.21.15.70:0/2493754938 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf10029050 con 0x559287b98e80 2024-05-08T09:33:58.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.993+0000 7fdf0aa00700 1 -- 172.21.15.70:0/2493754938 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10004c30 con 0x559287b98e80 2024-05-08T09:33:58.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.994+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2493754938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 msgr2=0x559287b9fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.994+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b9fb50 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fdf10030040 tx=0x7fdf10009310 comp rx=0 tx=0).stop 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.994+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2493754938 shutdown_connections 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.994+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287bbac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.994+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b98e80 0x559287b9fb50 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.994+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2493754938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b997a0 0x559287bba740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.994+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2493754938 >> 172.21.15.70:0/2493754938 conn(0x559287abec60 msgr2=0x559287b9f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.994+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2493754938 shutdown_connections 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.994+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2493754938 wait complete. 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.995+0000 7fdf2f31bb80 1 -- start start 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.995+0000 7fdf2f31bb80 1 Processor -- start 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 0x559287bab030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf2f31bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287ba6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201ab9e0 con 0x559287b997a0 2024-05-08T09:33:58.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201ace50 con 0x559287b98e80 2024-05-08T09:33:58.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf2f31bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fdf201ac0b0 con 0x559287b9d790 2024-05-08T09:33:58.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf2f31bb80 10 client.0 _ll_register_callbacks cb 0x559287a89d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:33:58.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf1d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf1d400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50910/0 (socket says 172.21.15.70:50910) 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.996+0000 7fdf1d400700 1 -- 172.21.15.70:0/2295370705 learned_addr learned my addr 172.21.15.70:0/2295370705 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdf1e800700 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287ba6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdf1de00700 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 0x559287bab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdf1d400700 1 -- 172.21.15.70:0/2295370705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 msgr2=0x559287ba6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdf1d400700 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287ba6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdf1d400700 1 -- 172.21.15.70:0/2295370705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 msgr2=0x559287bab030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdf1d400700 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 0x559287bab030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdf1d400700 1 -- 172.21.15.70:0/2295370705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559287ba6880 con 0x559287b997a0 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdf1d400700 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba5e00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c01abc0 tx=0x7fdf0c01af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd72ce0882a0b779 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdeffe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:33:58.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.997+0000 7fdeffe00700 1 -- 172.21.15.70:0/2295370705 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c011ac0 con 0x559287b997a0 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.998+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2295370705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf10029050 con 0x559287b997a0 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.998+0000 7fdeffe00700 1 -- 172.21.15.70:0/2295370705 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(410..410 src has 1..410) ==== 9583+0+0 (secure 0 0 0) 0x7fdf0c01a3f0 con 0x559287b997a0 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.998+0000 7fdeffe00700 1 -- 172.21.15.70:0/2295370705 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fdf0c03a050 con 0x559287b997a0 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.998+0000 7fdf2f31bb80 10 client.19695 fetch_fsmap learned FSMap version 42 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.998+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2295370705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x559287c1def0 con 0x559287b997a0 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.998+0000 7fdeffe00700 1 -- 172.21.15.70:0/2295370705 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdf10029050 con 0x559287b997a0 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.999+0000 7fdeffe00700 1 -- 172.21.15.70:0/2295370705 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fdf0c005040 con 0x559287b997a0 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.999+0000 7fdf2f31bb80 10 client.19695 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.999+0000 7fdf2f31bb80 10 client.19695 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.999+0000 7fdf2f31bb80 20 client.19695 populate_metadata read hostname 'smithi070' 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.999+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559287c1e600 0x559287c20a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.999+0000 7fdf2f31bb80 4 client.19695 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ebfca337", "release": true, "await": true}] 2024-05-08T09:33:58.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.999+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2295370705 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ebfca337", "release": true, "await": true}) -- 0x559287b8b2e0 con 0x559287c1e600 2024-05-08T09:33:59.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:58.999+0000 7fdf1de00700 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559287c1e600 0x559287c20a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:33:59.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:59.000+0000 7fdf1de00700 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559287c1e600 0x559287c20a20 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fbd16acef447dcf server_cookie=65f9bb94452f6aa in_seq=0 out_seq=0 2024-05-08T09:33:59.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:33:59.000+0000 7fdeffe00700 10 client.19695 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:34:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:00 smithi194 ceph-mon[33679]: pgmap v5341: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:34:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:00 smithi070 ceph-mon[29591]: pgmap v5341: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:34:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:00 smithi172 ceph-mon[33377]: pgmap v5341: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:34:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:02 smithi194 ceph-mon[33679]: pgmap v5342: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:34:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:02 smithi070 ceph-mon[29591]: pgmap v5342: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:34:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:02 smithi172 ceph-mon[33377]: pgmap v5342: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:34:04.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.211+0000 7fdeffe00700 1 -- 172.21.15.70:0/2295370705 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x559287b8b2e0 con 0x559287c1e600 2024-05-08T09:34:04.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.211+0000 7fdeffe00700 10 client.19695 handle_command_reply: tid=0 2024-05-08T09:34:04.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.211+0000 7fdf2f31bb80 1 client.19695 shutdown 2024-05-08T09:34:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.211+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2295370705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 msgr2=0x559287ba5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.211+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba5e00 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c01abc0 tx=0x7fdf0c01af20 comp rx=0 tx=0).stop 2024-05-08T09:34:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.212+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2295370705 shutdown_connections 2024-05-08T09:34:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.212+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x559287c1e600 0x559287c20a20 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.212+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559287b9d790 0x559287ba6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.212+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x559287b98e80 0x559287bab030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.212+0000 7fdf2f31bb80 1 --2- 172.21.15.70:0/2295370705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559287b997a0 0x559287ba5e00 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.212+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2295370705 >> 172.21.15.70:0/2295370705 conn(0x559287abec60 msgr2=0x559287b9f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.212+0000 7fdeffe00700 0 client.19695 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:34:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.212+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2295370705 shutdown_connections 2024-05-08T09:34:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.212+0000 7fdf2f31bb80 1 -- 172.21.15.70:0/2295370705 wait complete. 2024-05-08T09:34:04.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.213+0000 7fdf2f31bb80 20 client.19695 trim_cache size 0 max 16384 2024-05-08T09:34:04.212 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 364, 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "ebfca337": { 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 364, 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 70.0, 2024-05-08T09:34:04.213 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:04.214 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:34:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 -- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdf040b29f0 msgr2=0x7fdf040b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdf040b29f0 0x7fdf040b4eb0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b5c0 tx=0x7fdf10005fd0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 -- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 msgr2=0x7fdf2019baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 0x7fdf2019baf0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fdf18007ee0 tx=0x7fdf1800d3b0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 -- 172.21.15.70:0/787735358 shutdown_connections 2024-05-08T09:34:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fdf040b29f0 0x7fdf040b4eb0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdf2010b6e0 0x7fdf2019baf0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fdf201056e0 0x7fdf201a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 --2- 172.21.15.70:0/787735358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf201060a0 0x7fdf201a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 -- 172.21.15.70:0/787735358 >> 172.21.15.70:0/787735358 conn(0x7fdf201011d0 msgr2=0x7fdf20101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.214+0000 7fdf24a00700 1 -- 172.21.15.70:0/787735358 shutdown_connections 2024-05-08T09:34:04.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:04.215+0000 7fdf24a00700 1 -- 172.21.15.70:0/787735358 wait complete. 2024-05-08T09:34:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:04 smithi194 ceph-mon[33679]: pgmap v5343: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:34:04.610 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:04 smithi070 ceph-mon[29591]: pgmap v5343: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:34:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:04 smithi172 ceph-mon[33377]: pgmap v5343: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:34:05.045 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ebfca337', seconds elapsed: 56.6 2024-05-08T09:34:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:06 smithi194 ceph-mon[33679]: pgmap v5344: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T09:34:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:06 smithi070 ceph-mon[29591]: pgmap v5344: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T09:34:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:06 smithi172 ceph-mon[33377]: pgmap v5344: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T09:34:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:08 smithi070 ceph-mon[29591]: pgmap v5345: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-08T09:34:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:08 smithi172 ceph-mon[33377]: pgmap v5345: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-08T09:34:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:08 smithi194 ceph-mon[33679]: pgmap v5345: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-08T09:34:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:10 smithi070 ceph-mon[29591]: pgmap v5346: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:34:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:10 smithi172 ceph-mon[33377]: pgmap v5346: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:34:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:10 smithi194 ceph-mon[33679]: pgmap v5346: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:34:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:12 smithi070 ceph-mon[29591]: pgmap v5347: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:34:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:12 smithi172 ceph-mon[33377]: pgmap v5347: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:34:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:12 smithi194 ceph-mon[33679]: pgmap v5347: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:34:13.937 INFO:tasks.workunit.client.0.smithi070.stdout: AR vmlinux.a 2024-05-08T09:34:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:14 smithi070 ceph-mon[29591]: pgmap v5348: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:34:15.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:14 smithi172 ceph-mon[33377]: pgmap v5348: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:34:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:14 smithi194 ceph-mon[33679]: pgmap v5348: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:34:16.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:15 smithi070 ceph-mon[29591]: osdmap e411: 12 total, 12 up, 12 in 2024-05-08T09:34:16.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:15 smithi172 ceph-mon[33377]: osdmap e411: 12 total, 12 up, 12 in 2024-05-08T09:34:16.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:15 smithi194 ceph-mon[33679]: osdmap e411: 12 total, 12 up, 12 in 2024-05-08T09:34:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:16 smithi070 ceph-mon[29591]: pgmap v5350: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 182 KiB/s wr, 26 op/s 2024-05-08T09:34:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:16 smithi172 ceph-mon[33377]: pgmap v5350: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 182 KiB/s wr, 26 op/s 2024-05-08T09:34:17.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:16 smithi194 ceph-mon[33679]: pgmap v5350: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 182 KiB/s wr, 26 op/s 2024-05-08T09:34:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:18 smithi070 ceph-mon[29591]: pgmap v5351: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 182 KiB/s wr, 26 op/s 2024-05-08T09:34:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:18 smithi172 ceph-mon[33377]: pgmap v5351: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 182 KiB/s wr, 26 op/s 2024-05-08T09:34:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:18 smithi194 ceph-mon[33679]: pgmap v5351: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 182 KiB/s wr, 26 op/s 2024-05-08T09:34:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:20 smithi070 ceph-mon[29591]: pgmap v5352: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 196 KiB/s wr, 11 op/s 2024-05-08T09:34:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:20 smithi172 ceph-mon[33377]: pgmap v5352: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 196 KiB/s wr, 11 op/s 2024-05-08T09:34:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:20 smithi194 ceph-mon[33679]: pgmap v5352: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 196 KiB/s wr, 11 op/s 2024-05-08T09:34:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:22 smithi070 ceph-mon[29591]: pgmap v5353: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 196 KiB/s wr, 11 op/s 2024-05-08T09:34:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:22 smithi070 ceph-mon[29591]: osdmap e412: 12 total, 12 up, 12 in 2024-05-08T09:34:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:22 smithi172 ceph-mon[33377]: pgmap v5353: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 196 KiB/s wr, 11 op/s 2024-05-08T09:34:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:22 smithi172 ceph-mon[33377]: osdmap e412: 12 total, 12 up, 12 in 2024-05-08T09:34:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:22 smithi194 ceph-mon[33679]: pgmap v5353: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 196 KiB/s wr, 11 op/s 2024-05-08T09:34:23.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:22 smithi194 ceph-mon[33679]: osdmap e412: 12 total, 12 up, 12 in 2024-05-08T09:34:23.617 INFO:tasks.quiescer.fs.[cephfs]:Total duration (53.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T09:34:23.617 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.85 2024-05-08T09:34:23.618 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:34:24.150 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:34:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:24 smithi070 ceph-mon[29591]: pgmap v5355: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 81 KiB/s wr, 9 op/s 2024-05-08T09:34:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:24 smithi172 ceph-mon[33377]: pgmap v5355: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 81 KiB/s wr, 9 op/s 2024-05-08T09:34:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:24 smithi194 ceph-mon[33679]: pgmap v5355: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 81 KiB/s wr, 9 op/s 2024-05-08T09:34:26.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.635+0000 7fc1ed200700 1 -- 172.21.15.70:0/1278300413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 msgr2=0x7fc1e81122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.635+0000 7fc1ed200700 1 --2- 172.21.15.70:0/1278300413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 0x7fc1e81122f0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000b0a0 tx=0x7fc1e000b3b0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.635+0000 7fc1ed200700 1 -- 172.21.15.70:0/1278300413 shutdown_connections 2024-05-08T09:34:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.635+0000 7fc1ed200700 1 --2- 172.21.15.70:0/1278300413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 0x7fc1e81122f0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.635+0000 7fc1ed200700 1 --2- 172.21.15.70:0/1278300413 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80756d0 0x7fc1e8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.635+0000 7fc1ed200700 1 --2- 172.21.15.70:0/1278300413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8075ff0 0x7fc1e810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.635+0000 7fc1ed200700 1 -- 172.21.15.70:0/1278300413 >> 172.21.15.70:0/1278300413 conn(0x7fc1e807a600 msgr2=0x7fc1e807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.636+0000 7fc1ed200700 1 -- 172.21.15.70:0/1278300413 shutdown_connections 2024-05-08T09:34:26.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.636+0000 7fc1ed200700 1 -- 172.21.15.70:0/1278300413 wait complete. 2024-05-08T09:34:26.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.637+0000 7fc1ed200700 1 Processor -- start 2024-05-08T09:34:26.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.637+0000 7fc1ed200700 1 -- start start 2024-05-08T09:34:26.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.638+0000 7fc1ed200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80756d0 0x7fc1e81a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:26.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.638+0000 7fc1ed200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8075ff0 0x7fc1e81a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:26.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.638+0000 7fc1ed200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 0x7fc1e819ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:26.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.638+0000 7fc1ed200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e8115720 con 0x7fc1e810ff00 2024-05-08T09:34:26.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.638+0000 7fc1ed200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e81155a0 con 0x7fc1e80756d0 2024-05-08T09:34:26.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.638+0000 7fc1ed200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e81158a0 con 0x7fc1e8075ff0 2024-05-08T09:34:26.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.638+0000 7fc1e6800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 0x7fc1e819ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:26.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.638+0000 7fc1e6800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 0x7fc1e819ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55358/0 (socket says 172.21.15.70:55358) 2024-05-08T09:34:26.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.638+0000 7fc1e6800700 1 -- 172.21.15.70:0/4113930991 learned_addr learned my addr 172.21.15.70:0/4113930991 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:34:26.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e5e00700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80756d0 0x7fc1e81a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:26.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e5400700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8075ff0 0x7fc1e81a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:26.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e6800700 1 -- 172.21.15.70:0/4113930991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8075ff0 msgr2=0x7fc1e81a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:26.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e6800700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8075ff0 0x7fc1e81a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e6800700 1 -- 172.21.15.70:0/4113930991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80756d0 msgr2=0x7fc1e81a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:26.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e6800700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80756d0 0x7fc1e81a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e6800700 1 -- 172.21.15.70:0/4113930991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e819c1a0 con 0x7fc1e810ff00 2024-05-08T09:34:26.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e5400700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8075ff0 0x7fc1e81a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:34:26.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e5e00700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80756d0 0x7fc1e81a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:34:26.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.639+0000 7fc1e6800700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 0x7fc1e819ba40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00062a0 tx=0x7fc1e0004e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:34:26.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.640+0000 7fc1dea00700 1 -- 172.21.15.70:0/4113930991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0021070 con 0x7fc1e810ff00 2024-05-08T09:34:26.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.640+0000 7fc1dea00700 1 -- 172.21.15.70:0/4113930991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc1e0007c80 con 0x7fc1e810ff00 2024-05-08T09:34:26.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.640+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e819c430 con 0x7fc1e810ff00 2024-05-08T09:34:26.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.640+0000 7fc1dea00700 1 -- 172.21.15.70:0/4113930991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e00052c0 con 0x7fc1e810ff00 2024-05-08T09:34:26.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.640+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e81a8700 con 0x7fc1e810ff00 2024-05-08T09:34:26.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.641+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e806a190 con 0x7fc1e810ff00 2024-05-08T09:34:26.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.645+0000 7fc1dea00700 1 -- 172.21.15.70:0/4113930991 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc1e0024070 con 0x7fc1e810ff00 2024-05-08T09:34:26.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.646+0000 7fc1dea00700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1cc0b29f0 0x7fc1cc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:26.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.647+0000 7fc1dea00700 1 -- 172.21.15.70:0/4113930991 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(412..412 src has 1..412) ==== 9583+0+0 (secure 0 0 0) 0x7fc1e000f020 con 0x7fc1e810ff00 2024-05-08T09:34:26.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.647+0000 7fc1e5e00700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1cc0b29f0 0x7fc1cc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:26.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.648+0000 7fc1e5e00700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1cc0b29f0 0x7fc1cc0b4eb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005950 tx=0x7fc1d8005f50 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:34:26.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.650+0000 7fc1dea00700 1 -- 172.21.15.70:0/4113930991 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc1e002b030 con 0x7fc1e810ff00 2024-05-08T09:34:26.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:26 smithi070 ceph-mon[29591]: pgmap v5356: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 270 KiB/s wr, 13 op/s 2024-05-08T09:34:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.976+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1e81a88d0 con 0x7fc1e810ff00 2024-05-08T09:34:26.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.977+0000 7fc1dea00700 1 -- 172.21.15.70:0/4113930991 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fc1e00ab9a0 con 0x7fc1e810ff00 2024-05-08T09:34:26.976 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:34:26.977 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.980+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1cc0b29f0 msgr2=0x7fc1cc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.980+0000 7fc1ed200700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1cc0b29f0 0x7fc1cc0b4eb0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8005950 tx=0x7fc1d8005f50 comp rx=0 tx=0).stop 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.980+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 msgr2=0x7fc1e819ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.980+0000 7fc1ed200700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 0x7fc1e819ba40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00062a0 tx=0x7fc1e0004e70 comp rx=0 tx=0).stop 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.981+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 shutdown_connections 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.981+0000 7fc1ed200700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc1cc0b29f0 0x7fc1cc0b4eb0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.981+0000 7fc1ed200700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc1e810ff00 0x7fc1e819ba40 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.981+0000 7fc1ed200700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc1e80756d0 0x7fc1e81a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.981+0000 7fc1ed200700 1 --2- 172.21.15.70:0/4113930991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1e8075ff0 0x7fc1e81a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:26.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.981+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 >> 172.21.15.70:0/4113930991 conn(0x7fc1e807a600 msgr2=0x7fc1e81018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:26.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.981+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 shutdown_connections 2024-05-08T09:34:26.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:26.981+0000 7fc1ed200700 1 -- 172.21.15.70:0/4113930991 wait complete. 2024-05-08T09:34:26.981 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:34:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:26 smithi172 ceph-mon[33377]: pgmap v5356: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 270 KiB/s wr, 13 op/s 2024-05-08T09:34:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:26 smithi194 ceph-mon[33679]: pgmap v5356: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 270 KiB/s wr, 13 op/s 2024-05-08T09:34:28.001 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:27 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4113930991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:34:28.083 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 86.85 --await-for 42.0' 2024-05-08T09:34:28.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 86.85 --await-for 42.0 2024-05-08T09:34:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:27 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4113930991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:34:28.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:27 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4113930991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:34:28.560 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:34:28.966 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:28 smithi070 ceph-mon[29591]: pgmap v5357: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 270 KiB/s wr, 13 op/s 2024-05-08T09:34:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:28 smithi172 ceph-mon[33377]: pgmap v5357: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 270 KiB/s wr, 13 op/s 2024-05-08T09:34:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:28 smithi194 ceph-mon[33679]: pgmap v5357: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 270 KiB/s wr, 13 op/s 2024-05-08T09:34:31.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:30 smithi070 ceph-mon[29591]: pgmap v5358: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 422 KiB/s wr, 12 op/s 2024-05-08T09:34:31.124 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:30 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:34:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:30 smithi172 ceph-mon[33377]: pgmap v5358: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 422 KiB/s wr, 12 op/s 2024-05-08T09:34:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:30 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:34:31.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.231+0000 7f3f36800700 1 -- 172.21.15.70:0/2178231392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30104ed0 msgr2=0x7f3f30109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:31.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.231+0000 7f3f36800700 1 --2- 172.21.15.70:0/2178231392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30104ed0 0x7f3f30109310 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0099c0 tx=0x7f3f1c009cd0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.231+0000 7f3f36800700 1 -- 172.21.15.70:0/2178231392 shutdown_connections 2024-05-08T09:34:31.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.231+0000 7f3f36800700 1 --2- 172.21.15.70:0/2178231392 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f30109a40 0x7f3f301103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.231+0000 7f3f36800700 1 --2- 172.21.15.70:0/2178231392 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f30104520 0x7f3f30104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.231+0000 7f3f36800700 1 --2- 172.21.15.70:0/2178231392 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30104ed0 0x7f3f30109310 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.231+0000 7f3f36800700 1 -- 172.21.15.70:0/2178231392 >> 172.21.15.70:0/2178231392 conn(0x7f3f300fdcf0 msgr2=0x7f3f30100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:31.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.231+0000 7f3f36800700 1 -- 172.21.15.70:0/2178231392 shutdown_connections 2024-05-08T09:34:31.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.231+0000 7f3f36800700 1 -- 172.21.15.70:0/2178231392 wait complete. 2024-05-08T09:34:31.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.233+0000 7f3f36800700 1 Processor -- start 2024-05-08T09:34:31.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.233+0000 7f3f36800700 1 -- start start 2024-05-08T09:34:31.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.233+0000 7f3f36800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f30104520 0x7f3f301a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.233+0000 7f3f36800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f30104ed0 0x7f3f301a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.233+0000 7f3f36800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30109a40 0x7f3f3019b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.234+0000 7f3f36800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301134c0 con 0x7f3f30109a40 2024-05-08T09:34:31.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.234+0000 7f3f36800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30113340 con 0x7f3f30104ed0 2024-05-08T09:34:31.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.234+0000 7f3f36800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30113640 con 0x7f3f30104520 2024-05-08T09:34:31.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.234+0000 7f3f35e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30109a40 0x7f3f3019b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.234+0000 7f3f35e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30109a40 0x7f3f3019b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36670/0 (socket says 172.21.15.70:36670) 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.234+0000 7f3f35e00700 1 -- 172.21.15.70:0/405919967 learned_addr learned my addr 172.21.15.70:0/405919967 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.234+0000 7f3f34a00700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f30104ed0 0x7f3f301a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.234+0000 7f3f35400700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f30104520 0x7f3f301a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.235+0000 7f3f35e00700 1 -- 172.21.15.70:0/405919967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f30104520 msgr2=0x7f3f301a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.235+0000 7f3f35e00700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f30104520 0x7f3f301a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.235+0000 7f3f35e00700 1 -- 172.21.15.70:0/405919967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f30104ed0 msgr2=0x7f3f301a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.235+0000 7f3f35e00700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f30104ed0 0x7f3f301a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.235+0000 7f3f35e00700 1 -- 172.21.15.70:0/405919967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3019c140 con 0x7f3f30109a40 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.235+0000 7f3f35e00700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30109a40 0x7f3f3019b9e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f3f28007ee0 tx=0x7f3f2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.235+0000 7f3f2e000700 1 -- 172.21.15.70:0/405919967 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28004bb0 con 0x7f3f30109a40 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.235+0000 7f3f2e000700 1 -- 172.21.15.70:0/405919967 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f28004d50 con 0x7f3f30109a40 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.235+0000 7f3f36800700 1 -- 172.21.15.70:0/405919967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3019c430 con 0x7f3f30109a40 2024-05-08T09:34:31.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.236+0000 7f3f2e000700 1 -- 172.21.15.70:0/405919967 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f280058b0 con 0x7f3f30109a40 2024-05-08T09:34:31.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.236+0000 7f3f36800700 1 -- 172.21.15.70:0/405919967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f301a86f0 con 0x7f3f30109a40 2024-05-08T09:34:31.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.241+0000 7f3f2e000700 1 -- 172.21.15.70:0/405919967 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3f2801a020 con 0x7f3f30109a40 2024-05-08T09:34:31.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.243+0000 7f3f2e000700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f180b2b20 0x7f3f180b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.243+0000 7f3f35400700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f180b2b20 0x7f3f180b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.243+0000 7f3f2e000700 1 -- 172.21.15.70:0/405919967 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(412..412 src has 1..412) ==== 9583+0+0 (secure 0 0 0) 0x7f3f280e1fe0 con 0x7f3f30109a40 2024-05-08T09:34:31.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.244+0000 7f3f35400700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f180b2b20 0x7f3f180b4fe0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3f24005950 tx=0x7f3f2400a300 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:34:31.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.258+0000 7f3f42727b80 1 Processor -- start 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.258+0000 7f3f42727b80 1 -- start start 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7399ff0 0x5560f739a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f7394520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 0x5560f7394fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f42727b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5560f72e6bb0 con 0x5560f739a910 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f42727b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5560f72848f0 con 0x5560f7399ff0 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f42727b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5560f72e2b70 con 0x5560f7394b40 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f34a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f7394520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f34a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f7394520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36676/0 (socket says 172.21.15.70:36676) 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f34a00700 1 -- 172.21.15.70:0/89642091 learned_addr learned my addr 172.21.15.70:0/89642091 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:34:31.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.259+0000 7f3f35400700 1 --2- 172.21.15.70:0/89642091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7399ff0 0x5560f739a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.260+0000 7f3f35e00700 1 --2- 172.21.15.70:0/89642091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 0x5560f7394fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.260+0000 7f3f34a00700 1 -- 172.21.15.70:0/89642091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 msgr2=0x5560f7394fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.260+0000 7f3f34a00700 1 --2- 172.21.15.70:0/89642091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 0x5560f7394fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.260+0000 7f3f34a00700 1 -- 172.21.15.70:0/89642091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7399ff0 msgr2=0x5560f739a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.260+0000 7f3f34a00700 1 --2- 172.21.15.70:0/89642091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7399ff0 0x5560f739a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.260+0000 7f3f34a00700 1 -- 172.21.15.70:0/89642091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f7233a60 con 0x5560f739a910 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.260+0000 7f3f34a00700 1 --2- 172.21.15.70:0/89642091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f7394520 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0099c0 tx=0x7f3f1c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37aa64bf48cfda41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.261+0000 7f3f22a00700 1 -- 172.21.15.70:0/89642091 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c027070 con 0x5560f739a910 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.261+0000 7f3f22a00700 1 -- 172.21.15.70:0/89642091 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f1c00bc20 con 0x5560f739a910 2024-05-08T09:34:31.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.261+0000 7f3f22a00700 1 -- 172.21.15.70:0/89642091 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0039b0 con 0x5560f739a910 2024-05-08T09:34:31.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:30 smithi194 ceph-mon[33679]: pgmap v5358: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 422 KiB/s wr, 12 op/s 2024-05-08T09:34:31.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:30 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:34:31.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.262+0000 7f3f42727b80 1 -- 172.21.15.70:0/89642091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 msgr2=0x5560f7394520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.262+0000 7f3f42727b80 1 --2- 172.21.15.70:0/89642091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f7394520 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0099c0 tx=0x7f3f1c005c00 comp rx=0 tx=0).stop 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.262+0000 7f3f42727b80 1 -- 172.21.15.70:0/89642091 shutdown_connections 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.262+0000 7f3f42727b80 1 --2- 172.21.15.70:0/89642091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 0x5560f7394fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.262+0000 7f3f42727b80 1 --2- 172.21.15.70:0/89642091 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7399ff0 0x5560f739a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.262+0000 7f3f42727b80 1 --2- 172.21.15.70:0/89642091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f7394520 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.262+0000 7f3f42727b80 1 -- 172.21.15.70:0/89642091 >> 172.21.15.70:0/89642091 conn(0x5560f72c2cf0 msgr2=0x5560f738f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.262+0000 7f3f42727b80 1 -- 172.21.15.70:0/89642091 shutdown_connections 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.263+0000 7f3f42727b80 1 -- 172.21.15.70:0/89642091 wait complete. 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.263+0000 7f3f42727b80 1 -- start start 2024-05-08T09:34:31.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.264+0000 7f3f42727b80 1 Processor -- start 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.264+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7394b40 0x5560f73a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.264+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 0x5560f739d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.264+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f739ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.264+0000 7f3f42727b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5560f73a13d0 con 0x5560f739a910 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.264+0000 7f3f42727b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5560f724ccb0 con 0x5560f7394b40 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.264+0000 7f3f42727b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5560f73a1550 con 0x5560f7399ff0 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.264+0000 7f3f42727b80 10 client.0 _ll_register_callbacks cb 0x5560f728de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.264+0000 7f3f35e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f739ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f35e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f739ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36688/0 (socket says 172.21.15.70:36688) 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f35400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7394b40 0x5560f73a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f35e00700 1 -- 172.21.15.70:0/3309445921 learned_addr learned my addr 172.21.15.70:0/3309445921 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f34a00700 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 0x5560f739d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f35e00700 1 -- 172.21.15.70:0/3309445921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 msgr2=0x5560f739d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f35e00700 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 0x5560f739d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f35e00700 1 -- 172.21.15.70:0/3309445921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7394b40 msgr2=0x5560f73a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f35e00700 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7394b40 0x5560f73a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f35e00700 1 -- 172.21.15.70:0/3309445921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f72ac5b0 con 0x5560f739a910 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f35e00700 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f739ded0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f3f28004b80 tx=0x7f3f280a8610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7922824bace07b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.265+0000 7f3f17400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.266+0000 7f3f17400700 1 -- 172.21.15.70:0/3309445921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f280a95a0 con 0x5560f739a910 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.266+0000 7f3f17400700 1 -- 172.21.15.70:0/3309445921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(412..412 src has 1..412) ==== 9583+0+0 (secure 0 0 0) 0x7f3f280a5490 con 0x5560f739a910 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.266+0000 7f3f42727b80 1 -- 172.21.15.70:0/3309445921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f1c00bc20 con 0x5560f739a910 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.266+0000 7f3f17400700 1 -- 172.21.15.70:0/3309445921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3f280a8ea0 con 0x5560f739a910 2024-05-08T09:34:31.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.266+0000 7f3f42727b80 10 client.19713 fetch_fsmap learned FSMap version 42 2024-05-08T09:34:31.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.266+0000 7f3f42727b80 1 -- 172.21.15.70:0/3309445921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5560f73abc80 con 0x5560f739a910 2024-05-08T09:34:31.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.266+0000 7f3f17400700 1 -- 172.21.15.70:0/3309445921 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f1c00bc20 con 0x5560f739a910 2024-05-08T09:34:31.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.267+0000 7f3f17400700 1 -- 172.21.15.70:0/3309445921 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3f280bf020 con 0x5560f739a910 2024-05-08T09:34:31.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.267+0000 7f3f42727b80 10 client.19713 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:34:31.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.267+0000 7f3f42727b80 10 client.19713 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:34:31.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.267+0000 7f3f42727b80 20 client.19713 populate_metadata read hostname 'smithi070' 2024-05-08T09:34:31.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.267+0000 7f3f42727b80 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5560f73ae2c0 0x5560f73b06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.267+0000 7f3f42727b80 4 client.19713 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:34:31.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.267+0000 7f3f42727b80 1 -- 172.21.15.70:0/3309445921 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560f7361230 con 0x5560f73ae2c0 2024-05-08T09:34:31.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.267+0000 7f3f35400700 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5560f73ae2c0 0x5560f73b06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.268+0000 7f3f35400700 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5560f73ae2c0 0x5560f73b06d0 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc273507137b4aec server_cookie=ca16fc4e2dc43854 in_seq=0 out_seq=0 2024-05-08T09:34:31.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.268+0000 7f3f17400700 10 client.19713 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:34:31.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.270+0000 7f3f17400700 1 -- 172.21.15.70:0/3309445921 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5560f7361230 con 0x5560f73ae2c0 2024-05-08T09:34:31.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.270+0000 7f3f17400700 10 client.19713 handle_command_reply: tid=0 2024-05-08T09:34:31.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.270+0000 7f3f42727b80 1 client.19713 shutdown 2024-05-08T09:34:31.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 -- 172.21.15.70:0/3309445921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 msgr2=0x5560f739ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:31.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f739ded0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f3f28004b80 tx=0x7f3f280a8610 comp rx=0 tx=0).stop 2024-05-08T09:34:31.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 -- 172.21.15.70:0/3309445921 shutdown_connections 2024-05-08T09:34:31.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5560f73ae2c0 0x5560f73b06d0 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f739a910 0x5560f739ded0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f7394b40 0x5560f73a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 --2- 172.21.15.70:0/3309445921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 0x5560f739d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 -- 172.21.15.70:0/3309445921 >> 172.21.15.70:0/3309445921 conn(0x5560f72c2cf0 msgr2=0x5560f7393510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:31.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f17400700 0 client.19713 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:34:31.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 -- 172.21.15.70:0/3309445921 shutdown_connections 2024-05-08T09:34:31.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.271+0000 7f3f42727b80 1 -- 172.21.15.70:0/3309445921 wait complete. 2024-05-08T09:34:31.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.272+0000 7f3f42727b80 20 client.19713 trim_cache size 0 max 16384 2024-05-08T09:34:31.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.300+0000 7f3f42727b80 1 Processor -- start 2024-05-08T09:34:31.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.300+0000 7f3f42727b80 1 -- start start 2024-05-08T09:34:31.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.300+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 0x5560f73b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.300+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7399ff0 0x5560f73b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.300+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 0x5560f7393e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.300+0000 7f3f42727b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b3ea0 con 0x5560f7399ff0 2024-05-08T09:34:31.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.300+0000 7f3f42727b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b1730 con 0x5560f739a910 2024-05-08T09:34:31.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.300+0000 7f3f42727b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301af5a0 con 0x5560f7394b40 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.301+0000 7f3f34a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7399ff0 0x5560f73b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.301+0000 7f3f34a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7399ff0 0x5560f73b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36696/0 (socket says 172.21.15.70:36696) 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.301+0000 7f3f34a00700 1 -- 172.21.15.70:0/4011908037 learned_addr learned my addr 172.21.15.70:0/4011908037 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.301+0000 7f3f35400700 1 --2- 172.21.15.70:0/4011908037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 0x5560f73b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.301+0000 7f3f35e00700 1 --2- 172.21.15.70:0/4011908037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 0x5560f7393e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.302+0000 7f3f34a00700 1 -- 172.21.15.70:0/4011908037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 msgr2=0x5560f73b5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.302+0000 7f3f34a00700 1 --2- 172.21.15.70:0/4011908037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 0x5560f73b5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.302+0000 7f3f34a00700 1 -- 172.21.15.70:0/4011908037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 msgr2=0x5560f7393e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.302+0000 7f3f34a00700 1 --2- 172.21.15.70:0/4011908037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 0x5560f7393e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.302+0000 7f3f34a00700 1 -- 172.21.15.70:0/4011908037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560f738b9b0 con 0x5560f7399ff0 2024-05-08T09:34:31.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.302+0000 7f3f34a00700 1 --2- 172.21.15.70:0/4011908037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7399ff0 0x5560f73b64e0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c025040 tx=0x7f3f1c005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9de48bbb99cfa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:34:31.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.303+0000 7f3f22000700 1 -- 172.21.15.70:0/4011908037 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c027040 con 0x5560f7399ff0 2024-05-08T09:34:31.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.303+0000 7f3f22000700 1 -- 172.21.15.70:0/4011908037 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f1c005470 con 0x5560f7399ff0 2024-05-08T09:34:31.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.303+0000 7f3f22000700 1 -- 172.21.15.70:0/4011908037 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0039d0 con 0x5560f7399ff0 2024-05-08T09:34:31.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.304+0000 7f3f42727b80 1 -- 172.21.15.70:0/4011908037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7399ff0 msgr2=0x5560f73b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:31.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.304+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4011908037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7399ff0 0x5560f73b64e0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c025040 tx=0x7f3f1c005ad0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.304+0000 7f3f42727b80 1 -- 172.21.15.70:0/4011908037 shutdown_connections 2024-05-08T09:34:31.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.304+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4011908037 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 0x5560f7393e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.304+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4011908037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7394b40 0x5560f73b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.304+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4011908037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7399ff0 0x5560f73b64e0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.304+0000 7f3f42727b80 1 -- 172.21.15.70:0/4011908037 >> 172.21.15.70:0/4011908037 conn(0x5560f72c2cf0 msgr2=0x5560f7397b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:31.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.304+0000 7f3f42727b80 1 -- 172.21.15.70:0/4011908037 shutdown_connections 2024-05-08T09:34:31.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.304+0000 7f3f42727b80 1 -- 172.21.15.70:0/4011908037 wait complete. 2024-05-08T09:34:31.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.305+0000 7f3f42727b80 1 -- start start 2024-05-08T09:34:31.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.305+0000 7f3f42727b80 1 Processor -- start 2024-05-08T09:34:31.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.305+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7394b40 0x5560f73a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.305+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 0x5560f73a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.305+0000 7f3f42727b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 0x5560f73a4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.305+0000 7f3f42727b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301afbf0 con 0x5560f7394b40 2024-05-08T09:34:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.305+0000 7f3f42727b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b1060 con 0x5560f739a910 2024-05-08T09:34:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.305+0000 7f3f42727b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b02c0 con 0x5560f7399ff0 2024-05-08T09:34:31.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f42727b80 10 client.0 _ll_register_callbacks cb 0x5560f728de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:34:31.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f35400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7394b40 0x5560f73a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f35400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7394b40 0x5560f73a37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36710/0 (socket says 172.21.15.70:36710) 2024-05-08T09:34:31.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f35400700 1 -- 172.21.15.70:0/4014475254 learned_addr learned my addr 172.21.15.70:0/4014475254 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:34:31.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f34a00700 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 0x5560f73a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f35e00700 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 0x5560f73a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f35400700 1 -- 172.21.15.70:0/4014475254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 msgr2=0x5560f73a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:34:31.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f35400700 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 0x5560f73a3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f35400700 1 -- 172.21.15.70:0/4014475254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 msgr2=0x5560f73a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:34:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f35400700 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 0x5560f73a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.306+0000 7f3f35400700 1 -- 172.21.15.70:0/4014475254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560f7418bb0 con 0x5560f7394b40 2024-05-08T09:34:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.307+0000 7f3f35e00700 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 0x5560f73a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:34:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.307+0000 7f3f35400700 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7394b40 0x5560f73a37b0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x5560f73b0f40 tx=0x7f3f240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6819ab8a3a34e6ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:34:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.307+0000 7f3f17400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:34:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.307+0000 7f3f17400700 1 -- 172.21.15.70:0/4014475254 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2402c070 con 0x5560f7394b40 2024-05-08T09:34:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.307+0000 7f3f17400700 1 -- 172.21.15.70:0/4014475254 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(412..412 src has 1..412) ==== 9583+0+0 (secure 0 0 0) 0x7f3f24028580 con 0x5560f7394b40 2024-05-08T09:34:31.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.307+0000 7f3f42727b80 1 -- 172.21.15.70:0/4014475254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f1c005470 con 0x5560f7394b40 2024-05-08T09:34:31.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.308+0000 7f3f17400700 1 -- 172.21.15.70:0/4014475254 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f3f24016070 con 0x5560f7394b40 2024-05-08T09:34:31.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.308+0000 7f3f42727b80 10 client.19719 fetch_fsmap learned FSMap version 42 2024-05-08T09:34:31.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.308+0000 7f3f42727b80 1 -- 172.21.15.70:0/4014475254 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5560f7419ed0 con 0x5560f7394b40 2024-05-08T09:34:31.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.308+0000 7f3f17400700 1 -- 172.21.15.70:0/4014475254 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3f1c005470 con 0x5560f7394b40 2024-05-08T09:34:31.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.308+0000 7f3f17400700 1 -- 172.21.15.70:0/4014475254 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f3f2401c420 con 0x5560f7394b40 2024-05-08T09:34:31.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.308+0000 7f3f42727b80 10 client.19719 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:34:31.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.308+0000 7f3f42727b80 10 client.19719 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:34:31.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.309+0000 7f3f42727b80 20 client.19719 populate_metadata read hostname 'smithi070' 2024-05-08T09:34:31.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.309+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5560f741a6b0 0x5560f741cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:34:31.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.309+0000 7f3f42727b80 4 client.19719 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.85, "await_for": 42.0}] 2024-05-08T09:34:31.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.309+0000 7f3f42727b80 1 -- 172.21.15.70:0/4014475254 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.85, "await_for": 42.0}) -- 0x5560f72f4590 con 0x5560f741a6b0 2024-05-08T09:34:31.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.309+0000 7f3f34a00700 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5560f741a6b0 0x5560f741cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:34:31.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.310+0000 7f3f34a00700 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5560f741a6b0 0x5560f741cad0 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cda173958ed44d21 server_cookie=d70be155bdc191ef in_seq=0 out_seq=0 2024-05-08T09:34:31.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:31.310+0000 7f3f17400700 10 client.19719 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:34:32.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:34:32.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:34:32.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:31 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:34:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:34:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:34:32.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:31 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:34:32.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:34:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:34:32.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:31 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:34:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:32 smithi070 ceph-mon[29591]: pgmap v5359: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 422 KiB/s wr, 12 op/s 2024-05-08T09:34:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:32 smithi172 ceph-mon[33377]: pgmap v5359: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 422 KiB/s wr, 12 op/s 2024-05-08T09:34:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:32 smithi194 ceph-mon[33679]: pgmap v5359: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 422 KiB/s wr, 12 op/s 2024-05-08T09:34:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:34 smithi070 ceph-mon[29591]: pgmap v5360: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 374 KiB/s wr, 11 op/s 2024-05-08T09:34:35.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:34 smithi172 ceph-mon[33377]: pgmap v5360: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 374 KiB/s wr, 11 op/s 2024-05-08T09:34:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:34 smithi194 ceph-mon[33679]: pgmap v5360: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 369 KiB/s rd, 374 KiB/s wr, 11 op/s 2024-05-08T09:34:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:36 smithi070 ceph-mon[29591]: pgmap v5361: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 504 KiB/s wr, 13 op/s 2024-05-08T09:34:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:36 smithi172 ceph-mon[33377]: pgmap v5361: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 504 KiB/s wr, 13 op/s 2024-05-08T09:34:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:36 smithi194 ceph-mon[33679]: pgmap v5361: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 504 KiB/s wr, 13 op/s 2024-05-08T09:34:39.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:38 smithi070 ceph-mon[29591]: pgmap v5362: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 335 KiB/s wr, 8 op/s 2024-05-08T09:34:39.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:38 smithi172 ceph-mon[33377]: pgmap v5362: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 335 KiB/s wr, 8 op/s 2024-05-08T09:34:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:38 smithi194 ceph-mon[33679]: pgmap v5362: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 335 KiB/s wr, 8 op/s 2024-05-08T09:34:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:40 smithi070 ceph-mon[29591]: pgmap v5363: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 335 KiB/s wr, 10 op/s 2024-05-08T09:34:41.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:40 smithi172 ceph-mon[33377]: pgmap v5363: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 335 KiB/s wr, 10 op/s 2024-05-08T09:34:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:40 smithi194 ceph-mon[33679]: pgmap v5363: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 335 KiB/s wr, 10 op/s 2024-05-08T09:34:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:42 smithi070 ceph-mon[29591]: pgmap v5364: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 5 op/s 2024-05-08T09:34:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:42 smithi172 ceph-mon[33377]: pgmap v5364: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 5 op/s 2024-05-08T09:34:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:42 smithi194 ceph-mon[33679]: pgmap v5364: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 5 op/s 2024-05-08T09:34:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:44 smithi172 ceph-mon[33377]: pgmap v5365: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 5 op/s 2024-05-08T09:34:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:44 smithi194 ceph-mon[33679]: pgmap v5365: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 5 op/s 2024-05-08T09:34:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:44 smithi070 ceph-mon[29591]: pgmap v5365: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 152 KiB/s wr, 5 op/s 2024-05-08T09:34:47.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:46 smithi172 ceph-mon[33377]: pgmap v5366: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 152 KiB/s wr, 8 op/s 2024-05-08T09:34:47.181 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:46 smithi070 ceph-mon[29591]: pgmap v5366: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 152 KiB/s wr, 8 op/s 2024-05-08T09:34:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:46 smithi194 ceph-mon[33679]: pgmap v5366: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 152 KiB/s wr, 8 op/s 2024-05-08T09:34:49.163 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:48 smithi070 ceph-mon[29591]: pgmap v5367: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T09:34:49.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:48 smithi172 ceph-mon[33377]: pgmap v5367: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T09:34:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:48 smithi194 ceph-mon[33679]: pgmap v5367: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T09:34:51.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:50 smithi172 ceph-mon[33377]: pgmap v5368: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T09:34:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:50 smithi194 ceph-mon[33679]: pgmap v5368: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T09:34:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:50 smithi070 ceph-mon[29591]: pgmap v5368: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T09:34:53.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:52 smithi172 ceph-mon[33377]: pgmap v5369: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T09:34:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:52 smithi194 ceph-mon[33679]: pgmap v5369: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T09:34:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:52 smithi070 ceph-mon[29591]: pgmap v5369: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T09:34:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.818+0000 7f3f17400700 1 -- 172.21.15.70:0/4014475254 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5560f72f4590 con 0x5560f741a6b0 2024-05-08T09:34:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.818+0000 7f3f17400700 10 client.19719 handle_command_reply: tid=0 2024-05-08T09:34:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.818+0000 7f3f42727b80 1 client.19719 shutdown 2024-05-08T09:34:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f42727b80 1 -- 172.21.15.70:0/4014475254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7394b40 msgr2=0x5560f73a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7394b40 0x5560f73a37b0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x5560f73b0f40 tx=0x7f3f240047c0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f42727b80 1 -- 172.21.15.70:0/4014475254 shutdown_connections 2024-05-08T09:34:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5560f741a6b0 0x5560f741cad0 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5560f739a910 0x5560f73a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5560f7394b40 0x5560f73a37b0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f42727b80 1 --2- 172.21.15.70:0/4014475254 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5560f7399ff0 0x5560f73a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f42727b80 1 -- 172.21.15.70:0/4014475254 >> 172.21.15.70:0/4014475254 conn(0x5560f72c2cf0 msgr2=0x5560f7393dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f17400700 0 client.19719 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:34:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.819+0000 7f3f42727b80 1 -- 172.21.15.70:0/4014475254 shutdown_connections 2024-05-08T09:34:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.820+0000 7f3f42727b80 1 -- 172.21.15.70:0/4014475254 wait complete. 2024-05-08T09:34:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.820+0000 7f3f42727b80 20 client.19719 trim_cache size 0 max 16384 2024-05-08T09:34:54.820 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 366, 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "48b580d3": { 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 366, 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:34:54.821 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.8, 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:34:54.822 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:34:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 -- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f180b2b20 msgr2=0x7f3f180b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f180b2b20 0x7f3f180b4fe0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f3f24005950 tx=0x7f3f2400a300 comp rx=0 tx=0).stop 2024-05-08T09:34:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 -- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30109a40 msgr2=0x7f3f3019b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:34:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30109a40 0x7f3f3019b9e0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f3f28007ee0 tx=0x7f3f2800d3b0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 -- 172.21.15.70:0/405919967 shutdown_connections 2024-05-08T09:34:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3f180b2b20 0x7f3f180b4fe0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f30109a40 0x7f3f3019b9e0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f30104520 0x7f3f301a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 --2- 172.21.15.70:0/405919967 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3f30104ed0 0x7f3f301a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:34:54.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.821+0000 7f3f36800700 1 -- 172.21.15.70:0/405919967 >> 172.21.15.70:0/405919967 conn(0x7f3f300fdcf0 msgr2=0x7f3f30102af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:34:54.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.822+0000 7f3f36800700 1 -- 172.21.15.70:0/405919967 shutdown_connections 2024-05-08T09:34:54.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:34:54.822+0000 7f3f36800700 1 -- 172.21.15.70:0/405919967 wait complete. 2024-05-08T09:34:55.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:54 smithi070 ceph-mon[29591]: pgmap v5370: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T09:34:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:54 smithi172 ceph-mon[33377]: pgmap v5370: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T09:34:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:54 smithi194 ceph-mon[33679]: pgmap v5370: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2024-05-08T09:34:55.841 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '48b580d3', quiesce took 32.2 seconds. Will release after: 26.85 2024-05-08T09:34:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:56 smithi070 ceph-mon[29591]: pgmap v5371: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2024-05-08T09:34:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:56 smithi172 ceph-mon[33377]: pgmap v5371: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2024-05-08T09:34:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:56 smithi194 ceph-mon[33679]: pgmap v5371: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.2 KiB/s wr, 7 op/s 2024-05-08T09:34:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:34:58 smithi172 ceph-mon[33377]: pgmap v5372: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2024-05-08T09:34:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:34:58 smithi194 ceph-mon[33679]: pgmap v5372: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2024-05-08T09:34:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:34:58 smithi070 ceph-mon[29591]: pgmap v5372: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.2 KiB/s wr, 5 op/s 2024-05-08T09:35:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:00 smithi194 ceph-mon[33679]: pgmap v5373: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 55 KiB/s wr, 8 op/s 2024-05-08T09:35:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:00 smithi070 ceph-mon[29591]: pgmap v5373: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 55 KiB/s wr, 8 op/s 2024-05-08T09:35:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:00 smithi172 ceph-mon[33377]: pgmap v5373: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 55 KiB/s wr, 8 op/s 2024-05-08T09:35:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:02 smithi194 ceph-mon[33679]: pgmap v5374: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 55 KiB/s wr, 6 op/s 2024-05-08T09:35:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:02 smithi070 ceph-mon[29591]: pgmap v5374: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 55 KiB/s wr, 6 op/s 2024-05-08T09:35:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:02 smithi172 ceph-mon[33377]: pgmap v5374: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 55 KiB/s wr, 6 op/s 2024-05-08T09:35:05.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:04 smithi172 ceph-mon[33377]: pgmap v5375: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 55 KiB/s wr, 6 op/s 2024-05-08T09:35:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:04 smithi194 ceph-mon[33679]: pgmap v5375: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 55 KiB/s wr, 6 op/s 2024-05-08T09:35:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:04 smithi070 ceph-mon[29591]: pgmap v5375: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 55 KiB/s wr, 6 op/s 2024-05-08T09:35:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:06 smithi194 ceph-mon[33679]: pgmap v5376: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 100 KiB/s wr, 28 op/s 2024-05-08T09:35:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:06 smithi070 ceph-mon[29591]: pgmap v5376: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 100 KiB/s wr, 28 op/s 2024-05-08T09:35:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:06 smithi172 ceph-mon[33377]: pgmap v5376: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 100 KiB/s wr, 28 op/s 2024-05-08T09:35:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:08 smithi194 ceph-mon[33679]: pgmap v5377: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 93 KiB/s wr, 25 op/s 2024-05-08T09:35:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:08 smithi070 ceph-mon[29591]: pgmap v5377: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 93 KiB/s wr, 25 op/s 2024-05-08T09:35:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:08 smithi172 ceph-mon[33377]: pgmap v5377: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 93 KiB/s wr, 25 op/s 2024-05-08T09:35:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:10 smithi194 ceph-mon[33679]: pgmap v5378: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 93 KiB/s wr, 28 op/s 2024-05-08T09:35:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:10 smithi194 ceph-mon[33679]: osdmap e413: 12 total, 12 up, 12 in 2024-05-08T09:35:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:10 smithi070 ceph-mon[29591]: pgmap v5378: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 93 KiB/s wr, 28 op/s 2024-05-08T09:35:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:10 smithi070 ceph-mon[29591]: osdmap e413: 12 total, 12 up, 12 in 2024-05-08T09:35:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:10 smithi172 ceph-mon[33377]: pgmap v5378: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 93 KiB/s wr, 28 op/s 2024-05-08T09:35:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:10 smithi172 ceph-mon[33377]: osdmap e413: 12 total, 12 up, 12 in 2024-05-08T09:35:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:12 smithi194 ceph-mon[33679]: pgmap v5380: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-05-08T09:35:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:12 smithi070 ceph-mon[29591]: pgmap v5380: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-05-08T09:35:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:12 smithi172 ceph-mon[33377]: pgmap v5380: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-05-08T09:35:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:14 smithi194 ceph-mon[33679]: pgmap v5381: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-05-08T09:35:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:14 smithi070 ceph-mon[29591]: pgmap v5381: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-05-08T09:35:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:14 smithi172 ceph-mon[33377]: pgmap v5381: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 30 op/s 2024-05-08T09:35:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:16 smithi070 ceph-mon[29591]: pgmap v5382: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:35:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:16 smithi172 ceph-mon[33377]: pgmap v5382: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:35:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:16 smithi194 ceph-mon[33679]: pgmap v5382: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:35:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:17 smithi070 ceph-mon[29591]: osdmap e414: 12 total, 12 up, 12 in 2024-05-08T09:35:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:17 smithi172 ceph-mon[33377]: osdmap e414: 12 total, 12 up, 12 in 2024-05-08T09:35:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:17 smithi194 ceph-mon[33679]: osdmap e414: 12 total, 12 up, 12 in 2024-05-08T09:35:19.132 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:18 smithi070 ceph-mon[29591]: pgmap v5384: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T09:35:19.163 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:18 smithi194 ceph-mon[33679]: pgmap v5384: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T09:35:19.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:18 smithi172 ceph-mon[33377]: pgmap v5384: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 255 B/s wr, 4 op/s 2024-05-08T09:35:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:20 smithi070 ceph-mon[29591]: pgmap v5385: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 336 B/s wr, 7 op/s 2024-05-08T09:35:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:20 smithi172 ceph-mon[33377]: pgmap v5385: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 336 B/s wr, 7 op/s 2024-05-08T09:35:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:20 smithi194 ceph-mon[33679]: pgmap v5385: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 336 B/s wr, 7 op/s 2024-05-08T09:35:22.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:35:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:22 smithi070 ceph-mon[29591]: pgmap v5386: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:35:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:22 smithi172 ceph-mon[33377]: pgmap v5386: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:35:23.250 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:35:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:22 smithi194 ceph-mon[33679]: pgmap v5386: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:35:25.039 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:24 smithi070 ceph-mon[29591]: pgmap v5387: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:35:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:24 smithi172 ceph-mon[33377]: pgmap v5387: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:35:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:24 smithi194 ceph-mon[33679]: pgmap v5387: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:35:25.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.594+0000 7f58eb200700 1 -- 172.21.15.70:0/168237185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec1087a0 msgr2=0x7f58ec110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.594+0000 7f58eb200700 1 --2- 172.21.15.70:0/168237185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec1087a0 0x7f58ec110350 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f58e400b0a0 tx=0x7f58e400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.594+0000 7f58eb200700 1 -- 172.21.15.70:0/168237185 shutdown_connections 2024-05-08T09:35:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.594+0000 7f58eb200700 1 --2- 172.21.15.70:0/168237185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec1087a0 0x7f58ec110350 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.594+0000 7f58eb200700 1 --2- 172.21.15.70:0/168237185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58ec101f30 0x7f58ec102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.594+0000 7f58eb200700 1 --2- 172.21.15.70:0/168237185 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58ec1028e0 0x7f58ec1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.594+0000 7f58eb200700 1 -- 172.21.15.70:0/168237185 >> 172.21.15.70:0/168237185 conn(0x7f58ec077650 msgr2=0x7f58ec077a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:25.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.594+0000 7f58eb200700 1 -- 172.21.15.70:0/168237185 shutdown_connections 2024-05-08T09:35:25.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.594+0000 7f58eb200700 1 -- 172.21.15.70:0/168237185 wait complete. 2024-05-08T09:35:25.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.596+0000 7f58eb200700 1 Processor -- start 2024-05-08T09:35:25.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.596+0000 7f58eb200700 1 -- start start 2024-05-08T09:35:25.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.597+0000 7f58eb200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec101f30 0x7f58ec19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:25.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.597+0000 7f58eb200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58ec1028e0 0x7f58ec19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:25.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.597+0000 7f58eb200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58ec1087a0 0x7f58ec199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:25.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.597+0000 7f58eb200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec1134d0 con 0x7f58ec101f30 2024-05-08T09:35:25.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.597+0000 7f58eb200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec113350 con 0x7f58ec1087a0 2024-05-08T09:35:25.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.597+0000 7f58eb200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f58ec113650 con 0x7f58ec1028e0 2024-05-08T09:35:25.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.597+0000 7f58e9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec101f30 0x7f58ec19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:25.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.597+0000 7f58e9e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec101f30 0x7f58ec19f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44726/0 (socket says 172.21.15.70:44726) 2024-05-08T09:35:25.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.597+0000 7f58e9e00700 1 -- 172.21.15.70:0/1859505598 learned_addr learned my addr 172.21.15.70:0/1859505598 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:25.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.598+0000 7f58e9400700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58ec1028e0 0x7f58ec19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:25.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.598+0000 7f58ea800700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58ec1087a0 0x7f58ec199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:25.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.598+0000 7f58e9e00700 1 -- 172.21.15.70:0/1859505598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58ec1028e0 msgr2=0x7f58ec19fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.598+0000 7f58e9e00700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58ec1028e0 0x7f58ec19fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.598+0000 7f58e9e00700 1 -- 172.21.15.70:0/1859505598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58ec1087a0 msgr2=0x7f58ec199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.598+0000 7f58e9e00700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58ec1087a0 0x7f58ec199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.598+0000 7f58e9e00700 1 -- 172.21.15.70:0/1859505598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ec19a050 con 0x7f58ec101f30 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.598+0000 7f58e9e00700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec101f30 0x7f58ec19f6a0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00d980 tx=0x7f58dc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.598+0000 7f58e2a00700 1 -- 172.21.15.70:0/1859505598 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc017070 con 0x7f58ec101f30 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.599+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ec19a2e0 con 0x7f58ec101f30 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.599+0000 7f58e2a00700 1 -- 172.21.15.70:0/1859505598 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58dc004830 con 0x7f58ec101f30 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.599+0000 7f58e2a00700 1 -- 172.21.15.70:0/1859505598 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58dc0053a0 con 0x7f58ec101f30 2024-05-08T09:35:25.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.599+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ec102fb0 con 0x7f58ec101f30 2024-05-08T09:35:25.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.600+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ec19a650 con 0x7f58ec101f30 2024-05-08T09:35:25.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.603+0000 7f58e2a00700 1 -- 172.21.15.70:0/1859505598 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f58dc0049e0 con 0x7f58ec101f30 2024-05-08T09:35:25.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.605+0000 7f58e2a00700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58d00b29f0 0x7f58d00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:25.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.605+0000 7f58e2a00700 1 -- 172.21.15.70:0/1859505598 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(414..414 src has 1..414) ==== 9583+0+0 (secure 0 0 0) 0x7f58dc0e2a40 con 0x7f58ec101f30 2024-05-08T09:35:25.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.605+0000 7f58e9400700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58d00b29f0 0x7f58d00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:25.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.606+0000 7f58e9400700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58d00b29f0 0x7f58d00b4eb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005950 tx=0x7f58d80058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:25.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.610+0000 7f58e2a00700 1 -- 172.21.15.70:0/1859505598 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f58ec19a650 con 0x7f58ec101f30 2024-05-08T09:35:25.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.914+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58ec19aca0 con 0x7f58ec101f30 2024-05-08T09:35:25.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.915+0000 7f58e2a00700 1 -- 172.21.15.70:0/1859505598 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f58dc020020 con 0x7f58ec101f30 2024-05-08T09:35:25.913 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:35:25.913 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.918+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58d00b29f0 msgr2=0x7f58d00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.918+0000 7f58eb200700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58d00b29f0 0x7f58d00b4eb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005950 tx=0x7f58d80058e0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec101f30 msgr2=0x7f58ec19f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec101f30 0x7f58ec19f6a0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f58dc00d980 tx=0x7f58dc00dd40 comp rx=0 tx=0).stop 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 shutdown_connections 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f58d00b29f0 0x7f58d00b4eb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f58ec1087a0 0x7f58ec199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f58ec101f30 0x7f58ec19f6a0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 --2- 172.21.15.70:0/1859505598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58ec1028e0 0x7f58ec19fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 >> 172.21.15.70:0/1859505598 conn(0x7f58ec077650 msgr2=0x7f58ec0ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 shutdown_connections 2024-05-08T09:35:25.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:25.919+0000 7f58eb200700 1 -- 172.21.15.70:0/1859505598 wait complete. 2024-05-08T09:35:25.918 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:35:26.731 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 48b580d3 --release --await' 2024-05-08T09:35:26.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 48b580d3 --release --await 2024-05-08T09:35:27.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:26 smithi070 ceph-mon[29591]: pgmap v5388: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:35:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:26 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1859505598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:35:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:26 smithi172 ceph-mon[33377]: pgmap v5388: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:35:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:26 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1859505598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:35:27.215 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:35:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:26 smithi194 ceph-mon[33679]: pgmap v5388: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:35:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:26 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1859505598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:35:29.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:28 smithi070 ceph-mon[29591]: pgmap v5389: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:35:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:28 smithi172 ceph-mon[33377]: pgmap v5389: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:35:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:28 smithi194 ceph-mon[33679]: pgmap v5389: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:35:30.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.964+0000 7f9659c00700 1 -- 172.21.15.70:0/4266324635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96541095d0 msgr2=0x7f96541099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:30.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.964+0000 7f9659c00700 1 --2- 172.21.15.70:0/4266324635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96541095d0 0x7f96541099b0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f96440099c0 tx=0x7f9644009cd0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.965+0000 7f9659c00700 1 -- 172.21.15.70:0/4266324635 shutdown_connections 2024-05-08T09:35:30.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.965+0000 7f9659c00700 1 --2- 172.21.15.70:0/4266324635 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9654103f10 0x7f96541103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.965+0000 7f9659c00700 1 --2- 172.21.15.70:0/4266324635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96541095d0 0x7f96541099b0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.965+0000 7f9659c00700 1 --2- 172.21.15.70:0/4266324635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9654103550 0x7f96541039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.965+0000 7f9659c00700 1 -- 172.21.15.70:0/4266324635 >> 172.21.15.70:0/4266324635 conn(0x7f965407a5f0 msgr2=0x7f965407aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:30.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.965+0000 7f9659c00700 1 -- 172.21.15.70:0/4266324635 shutdown_connections 2024-05-08T09:35:30.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.965+0000 7f9659c00700 1 -- 172.21.15.70:0/4266324635 wait complete. 2024-05-08T09:35:30.966 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:30 smithi070 ceph-mon[29591]: pgmap v5390: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:35:30.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.966+0000 7f9659c00700 1 Processor -- start 2024-05-08T09:35:30.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.966+0000 7f9659c00700 1 -- start start 2024-05-08T09:35:30.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.967+0000 7f9659c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9654103550 0x7f96541a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.967+0000 7f9659c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9654103f10 0x7f96541a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.967+0000 7f9659c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96541095d0 0x7f965410d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.967+0000 7f9659c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96541135d0 con 0x7f9654103550 2024-05-08T09:35:30.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.967+0000 7f9659c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9654113450 con 0x7f96541095d0 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.967+0000 7f9659c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9654113750 con 0x7f9654103f10 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.967+0000 7f9652a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9654103550 0x7f96541a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.967+0000 7f9652a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9654103550 0x7f96541a5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33270/0 (socket says 172.21.15.70:33270) 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.967+0000 7f9652a00700 1 -- 172.21.15.70:0/227899530 learned_addr learned my addr 172.21.15.70:0/227899530 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f9653400700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96541095d0 0x7f965410d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f9652a00700 1 -- 172.21.15.70:0/227899530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9654103f10 msgr2=0x7f96541a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f964be00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9654103f10 0x7f96541a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f9652a00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9654103f10 0x7f96541a63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f9652a00700 1 -- 172.21.15.70:0/227899530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96541095d0 msgr2=0x7f965410d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f9652a00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96541095d0 0x7f965410d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f9652a00700 1 -- 172.21.15.70:0/227899530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965410dd20 con 0x7f9654103550 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f9653400700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96541095d0 0x7f965410d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f964be00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9654103f10 0x7f96541a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:35:30.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.968+0000 7f9652a00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9654103550 0x7f96541a5e80 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f964400b580 tx=0x7f964400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:30.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.969+0000 7f964b400700 1 -- 172.21.15.70:0/227899530 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9644027070 con 0x7f9654103550 2024-05-08T09:35:30.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.969+0000 7f964b400700 1 -- 172.21.15.70:0/227899530 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f964400fdd0 con 0x7f9654103550 2024-05-08T09:35:30.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.969+0000 7f964b400700 1 -- 172.21.15.70:0/227899530 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96440173f0 con 0x7f9654103550 2024-05-08T09:35:30.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.969+0000 7f9659c00700 1 -- 172.21.15.70:0/227899530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965410df50 con 0x7f9654103550 2024-05-08T09:35:30.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.969+0000 7f9659c00700 1 -- 172.21.15.70:0/227899530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96541acc70 con 0x7f9654103550 2024-05-08T09:35:30.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.974+0000 7f964b400700 1 -- 172.21.15.70:0/227899530 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f964402a070 con 0x7f9654103550 2024-05-08T09:35:30.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.975+0000 7f964b400700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96380b2a70 0x7f96380b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.975+0000 7f964b400700 1 -- 172.21.15.70:0/227899530 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(414..414 src has 1..414) ==== 9583+0+0 (secure 0 0 0) 0x7f96440e3860 con 0x7f9654103550 2024-05-08T09:35:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.976+0000 7f964be00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96380b2a70 0x7f96380b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:30.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.976+0000 7f964be00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96380b2a70 0x7f96380b4f30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f963c005fd0 tx=0x7f963c005ee0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.994+0000 7f9664501b80 1 Processor -- start 2024-05-08T09:35:30.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.994+0000 7f9664501b80 1 -- start start 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f9664501b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 0x560e7e7e02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f9664501b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7da910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f9664501b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 0x560e7e7e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f9664501b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560e7e72cb20 con 0x560e7e7da490 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f9664501b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560e7e6ca860 con 0x560e7e7dae50 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f9664501b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560e7e728ae0 con 0x560e7e7dfec0 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f964be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7da910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f964be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7da910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33278/0 (socket says 172.21.15.70:33278) 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f964be00700 1 -- 172.21.15.70:0/125744622 learned_addr learned my addr 172.21.15.70:0/125744622 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f9652a00700 1 --2- 172.21.15.70:0/125744622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 0x560e7e7e02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.995+0000 7f9653400700 1 --2- 172.21.15.70:0/125744622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 0x560e7e7e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:30.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.996+0000 7f964be00700 1 -- 172.21.15.70:0/125744622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 msgr2=0x560e7e7e02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:30.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.996+0000 7f964be00700 1 --2- 172.21.15.70:0/125744622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 0x560e7e7e02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.996+0000 7f964be00700 1 -- 172.21.15.70:0/125744622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 msgr2=0x560e7e7e6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:30.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.996+0000 7f964be00700 1 --2- 172.21.15.70:0/125744622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 0x560e7e7e6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.996+0000 7f964be00700 1 -- 172.21.15.70:0/125744622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e7e6799d0 con 0x560e7e7da490 2024-05-08T09:35:30.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.996+0000 7f964be00700 1 --2- 172.21.15.70:0/125744622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7da910 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f963c009410 tx=0x7f963c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb3cc531387d28a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:30.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.996+0000 7f9643e00700 1 -- 172.21.15.70:0/125744622 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c011c90 con 0x560e7e7da490 2024-05-08T09:35:30.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.997+0000 7f9643e00700 1 -- 172.21.15.70:0/125744622 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f963c023070 con 0x560e7e7da490 2024-05-08T09:35:30.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.997+0000 7f9643e00700 1 -- 172.21.15.70:0/125744622 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f963c010630 con 0x560e7e7da490 2024-05-08T09:35:30.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.997+0000 7f9664501b80 1 -- 172.21.15.70:0/125744622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 msgr2=0x560e7e7da910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:30.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.997+0000 7f9664501b80 1 --2- 172.21.15.70:0/125744622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7da910 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f963c009410 tx=0x7f963c009f90 comp rx=0 tx=0).stop 2024-05-08T09:35:30.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.998+0000 7f9664501b80 1 -- 172.21.15.70:0/125744622 shutdown_connections 2024-05-08T09:35:30.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.998+0000 7f9664501b80 1 --2- 172.21.15.70:0/125744622 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 0x560e7e7e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.998+0000 7f9664501b80 1 --2- 172.21.15.70:0/125744622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 0x560e7e7e02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.998+0000 7f9664501b80 1 --2- 172.21.15.70:0/125744622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7da910 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:30.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.998+0000 7f9664501b80 1 -- 172.21.15.70:0/125744622 >> 172.21.15.70:0/125744622 conn(0x560e7e708c60 msgr2=0x560e7e7d4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:30.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.998+0000 7f9664501b80 1 -- 172.21.15.70:0/125744622 shutdown_connections 2024-05-08T09:35:30.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.998+0000 7f9664501b80 1 -- 172.21.15.70:0/125744622 wait complete. 2024-05-08T09:35:30.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.998+0000 7f9664501b80 1 -- start start 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.999+0000 7f9664501b80 1 Processor -- start 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.999+0000 7f9664501b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.999+0000 7f9664501b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 0x560e7e7e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.999+0000 7f9664501b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 0x560e7e7e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.999+0000 7f9664501b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560e7e7e7220 con 0x560e7e7da490 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.999+0000 7f9664501b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x560e7e692c20 con 0x560e7e7dae50 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.999+0000 7f9664501b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x560e7e7e73a0 con 0x560e7e7dfec0 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:30.999+0000 7f9664501b80 10 client.0 _ll_register_callbacks cb 0x560e7e6d3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f9652a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f9652a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33282/0 (socket says 172.21.15.70:33282) 2024-05-08T09:35:30.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f9652a00700 1 -- 172.21.15.70:0/2616797500 learned_addr learned my addr 172.21.15.70:0/2616797500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:31.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f964be00700 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 0x560e7e7e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f9653400700 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 0x560e7e7e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f9652a00700 1 -- 172.21.15.70:0/2616797500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 msgr2=0x560e7e7e41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f9652a00700 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 0x560e7e7e41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f9652a00700 1 -- 172.21.15.70:0/2616797500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 msgr2=0x560e7e7e3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f9652a00700 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 0x560e7e7e3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.000+0000 7f9652a00700 1 -- 172.21.15.70:0/2616797500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e7e6f2520 con 0x560e7e7da490 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.001+0000 7f964be00700 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 0x560e7e7e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.001+0000 7f9652a00700 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e68e0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f96440a79c0 tx=0x7f9644022950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3497139e82e2ddc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.001+0000 7f9640c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.001+0000 7f9640c00700 1 -- 172.21.15.70:0/2616797500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96440aa260 con 0x560e7e7da490 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.002+0000 7f9640c00700 1 -- 172.21.15.70:0/2616797500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(414..414 src has 1..414) ==== 9583+0+0 (secure 0 0 0) 0x7f96440922c0 con 0x560e7e7da490 2024-05-08T09:35:31.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.002+0000 7f9664501b80 1 -- 172.21.15.70:0/2616797500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f963c023070 con 0x560e7e7da490 2024-05-08T09:35:31.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.002+0000 7f9640c00700 1 -- 172.21.15.70:0/2616797500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9644022470 con 0x560e7e7da490 2024-05-08T09:35:31.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.002+0000 7f9664501b80 10 client.19737 fetch_fsmap learned FSMap version 42 2024-05-08T09:35:31.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.002+0000 7f9664501b80 1 -- 172.21.15.70:0/2616797500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560e7e7f1a80 con 0x560e7e7da490 2024-05-08T09:35:31.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.002+0000 7f9640c00700 1 -- 172.21.15.70:0/2616797500 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f963c023070 con 0x560e7e7da490 2024-05-08T09:35:31.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.002+0000 7f9640c00700 1 -- 172.21.15.70:0/2616797500 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f96440b3090 con 0x560e7e7da490 2024-05-08T09:35:31.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.003+0000 7f9664501b80 10 client.19737 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:35:31.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.003+0000 7f9664501b80 10 client.19737 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:35:31.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.003+0000 7f9664501b80 20 client.19737 populate_metadata read hostname 'smithi070' 2024-05-08T09:35:31.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.003+0000 7f9664501b80 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560e7e7f3f50 0x560e7e7f6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:31.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.003+0000 7f9664501b80 4 client.19737 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:35:31.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.003+0000 7f9664501b80 1 -- 172.21.15.70:0/2616797500 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e7e7a71a0 con 0x560e7e7f3f50 2024-05-08T09:35:31.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.003+0000 7f964be00700 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560e7e7f3f50 0x560e7e7f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.005+0000 7f9640c00700 10 client.19737 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:35:31.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.005+0000 7f964be00700 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560e7e7f3f50 0x560e7e7f6360 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7375520a691fc33 server_cookie=5f05a8865ce0f272 in_seq=0 out_seq=0 2024-05-08T09:35:31.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.006+0000 7f9640c00700 1 -- 172.21.15.70:0/2616797500 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560e7e7a71a0 con 0x560e7e7f3f50 2024-05-08T09:35:31.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.006+0000 7f9640c00700 10 client.19737 handle_command_reply: tid=0 2024-05-08T09:35:31.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 client.19737 shutdown 2024-05-08T09:35:31.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 -- 172.21.15.70:0/2616797500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 msgr2=0x560e7e7e68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:31.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e68e0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f96440a79c0 tx=0x7f9644022950 comp rx=0 tx=0).stop 2024-05-08T09:35:31.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 -- 172.21.15.70:0/2616797500 shutdown_connections 2024-05-08T09:35:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560e7e7f3f50 0x560e7e7f6360 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dfec0 0x560e7e7e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e68e0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 --2- 172.21.15.70:0/2616797500 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dae50 0x560e7e7e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 -- 172.21.15.70:0/2616797500 >> 172.21.15.70:0/2616797500 conn(0x560e7e708c60 msgr2=0x560e7e7cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9640c00700 0 client.19737 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:35:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 -- 172.21.15.70:0/2616797500 shutdown_connections 2024-05-08T09:35:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.007+0000 7f9664501b80 1 -- 172.21.15.70:0/2616797500 wait complete. 2024-05-08T09:35:31.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.008+0000 7f9664501b80 20 client.19737 trim_cache size 0 max 16384 2024-05-08T09:35:31.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.034+0000 7f9664501b80 1 Processor -- start 2024-05-08T09:35:31.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.034+0000 7f9664501b80 1 -- start start 2024-05-08T09:35:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.035+0000 7f9664501b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7da490 0x560e7e7f0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.035+0000 7f9664501b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 0x560e7e7df480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.035+0000 7f9664501b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7dfec0 0x560e7e7cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.035+0000 7f9664501b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96541b8400 con 0x560e7e7dfec0 2024-05-08T09:35:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.035+0000 7f9664501b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96541b5c90 con 0x560e7e7da490 2024-05-08T09:35:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.035+0000 7f9664501b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f96541b3b00 con 0x560e7e7dae50 2024-05-08T09:35:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.035+0000 7f9653400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7dfec0 0x560e7e7cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.035+0000 7f9653400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7dfec0 0x560e7e7cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33292/0 (socket says 172.21.15.70:33292) 2024-05-08T09:35:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.035+0000 7f9653400700 1 -- 172.21.15.70:0/1755396535 learned_addr learned my addr 172.21.15.70:0/1755396535 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9652a00700 1 --2- 172.21.15.70:0/1755396535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7da490 0x560e7e7f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f964be00700 1 --2- 172.21.15.70:0/1755396535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 0x560e7e7df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9653400700 1 -- 172.21.15.70:0/1755396535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 msgr2=0x560e7e7df480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9653400700 1 --2- 172.21.15.70:0/1755396535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 0x560e7e7df480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9653400700 1 -- 172.21.15.70:0/1755396535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7da490 msgr2=0x560e7e7f0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9653400700 1 --2- 172.21.15.70:0/1755396535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7da490 0x560e7e7f0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9653400700 1 -- 172.21.15.70:0/1755396535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e7e7e6520 con 0x560e7e7dfec0 2024-05-08T09:35:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9653400700 1 --2- 172.21.15.70:0/1755396535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7dfec0 0x560e7e7cefc0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f964c009ef0 tx=0x7f964c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c687e8766f4131e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9643400700 1 -- 172.21.15.70:0/1755396535 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c01b070 con 0x560e7e7dfec0 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9643400700 1 -- 172.21.15.70:0/1755396535 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f964c004bb0 con 0x560e7e7dfec0 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.036+0000 7f9643400700 1 -- 172.21.15.70:0/1755396535 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c005280 con 0x560e7e7dfec0 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.037+0000 7f9664501b80 1 -- 172.21.15.70:0/1755396535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7dfec0 msgr2=0x560e7e7cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.037+0000 7f9664501b80 1 --2- 172.21.15.70:0/1755396535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7dfec0 0x560e7e7cefc0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f964c009ef0 tx=0x7f964c0077e0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.037+0000 7f9664501b80 1 -- 172.21.15.70:0/1755396535 shutdown_connections 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.037+0000 7f9664501b80 1 --2- 172.21.15.70:0/1755396535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7dfec0 0x560e7e7cefc0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.037+0000 7f9664501b80 1 --2- 172.21.15.70:0/1755396535 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7da490 0x560e7e7f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.037+0000 7f9664501b80 1 --2- 172.21.15.70:0/1755396535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 0x560e7e7df480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.037+0000 7f9664501b80 1 -- 172.21.15.70:0/1755396535 >> 172.21.15.70:0/1755396535 conn(0x560e7e708c60 msgr2=0x560e7e7d9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.038+0000 7f9664501b80 1 -- 172.21.15.70:0/1755396535 shutdown_connections 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.038+0000 7f9664501b80 1 -- 172.21.15.70:0/1755396535 wait complete. 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.038+0000 7f9664501b80 1 -- start start 2024-05-08T09:35:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.038+0000 7f9664501b80 1 Processor -- start 2024-05-08T09:35:31.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9664501b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9664501b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 0x560e7e7e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9664501b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dfec0 0x560e7e7e8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9664501b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96541b4150 con 0x560e7e7da490 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9664501b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f96541b55c0 con 0x560e7e7dfec0 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9664501b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f96541b4820 con 0x560e7e7dae50 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9664501b80 10 client.0 _ll_register_callbacks cb 0x560e7e6d3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9652a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9652a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33308/0 (socket says 172.21.15.70:33308) 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.039+0000 7f9652a00700 1 -- 172.21.15.70:0/1831087807 learned_addr learned my addr 172.21.15.70:0/1831087807 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f964be00700 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 0x560e7e7e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f9653400700 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dfec0 0x560e7e7e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f9652a00700 1 -- 172.21.15.70:0/1831087807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 msgr2=0x560e7e7e7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:31.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f9652a00700 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 0x560e7e7e7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f9652a00700 1 -- 172.21.15.70:0/1831087807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dfec0 msgr2=0x560e7e7e8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f9652a00700 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dfec0 0x560e7e7e8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f9652a00700 1 -- 172.21.15.70:0/1831087807 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e7e85e820 con 0x560e7e7da490 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f9653400700 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dfec0 0x560e7e7e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f9652a00700 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e75b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f9644009990 tx=0x7f96440b3340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7284ef1520c698c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.040+0000 7f9640c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9640c00700 1 -- 172.21.15.70:0/1831087807 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96440e34f0 con 0x560e7e7da490 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9640c00700 1 -- 172.21.15.70:0/1831087807 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(414..414 src has 1..414) ==== 9583+0+0 (secure 0 0 0) 0x7f96440a6d40 con 0x560e7e7da490 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9664501b80 1 -- 172.21.15.70:0/1831087807 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f964c004bb0 con 0x560e7e7da490 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9640c00700 1 -- 172.21.15.70:0/1831087807 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9644089050 con 0x560e7e7da490 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9664501b80 10 client.19743 fetch_fsmap learned FSMap version 42 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9664501b80 1 -- 172.21.15.70:0/1831087807 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x560e7e85f9f0 con 0x560e7e7da490 2024-05-08T09:35:31.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9640c00700 1 -- 172.21.15.70:0/1831087807 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f964c004bb0 con 0x560e7e7da490 2024-05-08T09:35:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9640c00700 1 -- 172.21.15.70:0/1831087807 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f96440bfb10 con 0x560e7e7da490 2024-05-08T09:35:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9664501b80 10 client.19743 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:35:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.041+0000 7f9664501b80 10 client.19743 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:35:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.042+0000 7f9664501b80 20 client.19743 populate_metadata read hostname 'smithi070' 2024-05-08T09:35:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.042+0000 7f9664501b80 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560e7e85ff10 0x560e7e862350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.042+0000 7f9664501b80 4 client.19743 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "48b580d3", "release": true, "await": true}] 2024-05-08T09:35:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.042+0000 7f9664501b80 1 -- 172.21.15.70:0/1831087807 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "48b580d3", "release": true, "await": true}) -- 0x560e7e73a500 con 0x560e7e85ff10 2024-05-08T09:35:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.042+0000 7f964be00700 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560e7e85ff10 0x560e7e862350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:31.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.043+0000 7f964be00700 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560e7e85ff10 0x560e7e862350 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7fbfe642207c077 server_cookie=ca67aa7c8e385d98 in_seq=0 out_seq=0 2024-05-08T09:35:31.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:31.043+0000 7f9640c00700 10 client.19743 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:35:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:30 smithi172 ceph-mon[33377]: pgmap v5390: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:35:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:30 smithi194 ceph-mon[33679]: pgmap v5390: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:35:32.867 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:32 smithi070 ceph-mon[29591]: pgmap v5391: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:35:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:32 smithi172 ceph-mon[33377]: pgmap v5391: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:35:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:32 smithi194 ceph-mon[33679]: pgmap v5391: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:35:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:34 smithi070 ceph-mon[29591]: pgmap v5392: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:35:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:35:35.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:35:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:34 smithi172 ceph-mon[33377]: pgmap v5392: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:35:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:35:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:35:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:34 smithi194 ceph-mon[33679]: pgmap v5392: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:35:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:35:35.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:35:35.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.988+0000 7f9640c00700 1 -- 172.21.15.70:0/1831087807 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x560e7e73a500 con 0x560e7e85ff10 2024-05-08T09:35:35.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.988+0000 7f9640c00700 10 client.19743 handle_command_reply: tid=0 2024-05-08T09:35:35.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.988+0000 7f9664501b80 1 client.19743 shutdown 2024-05-08T09:35:35.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.989+0000 7f9664501b80 1 -- 172.21.15.70:0/1831087807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 msgr2=0x560e7e7e75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:35.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.989+0000 7f9664501b80 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e75b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f9644009990 tx=0x7f96440b3340 comp rx=0 tx=0).stop 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.989+0000 7f9664501b80 1 -- 172.21.15.70:0/1831087807 shutdown_connections 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.989+0000 7f9664501b80 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x560e7e85ff10 0x560e7e862350 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.990+0000 7f9664501b80 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x560e7e7dfec0 0x560e7e7e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.990+0000 7f9664501b80 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560e7e7da490 0x560e7e7e75b0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.990+0000 7f9664501b80 1 --2- 172.21.15.70:0/1831087807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560e7e7dae50 0x560e7e7e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.990+0000 7f9664501b80 1 -- 172.21.15.70:0/1831087807 >> 172.21.15.70:0/1831087807 conn(0x560e7e708c60 msgr2=0x560e7e7cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.990+0000 7f9640c00700 0 client.19743 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.990+0000 7f9664501b80 1 -- 172.21.15.70:0/1831087807 shutdown_connections 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.990+0000 7f9664501b80 1 -- 172.21.15.70:0/1831087807 wait complete. 2024-05-08T09:35:35.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.991+0000 7f9664501b80 20 client.19743 trim_cache size 0 max 16384 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 368, 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "48b580d3": { 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 368, 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:35:35.991 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.8, 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:35:35.992 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:35:35.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.992+0000 7f9659c00700 1 -- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96380b2a70 msgr2=0x7f96380b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:35.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.992+0000 7f9659c00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96380b2a70 0x7f96380b4f30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f963c005fd0 tx=0x7f963c005ee0 comp rx=0 tx=0).stop 2024-05-08T09:35:35.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.992+0000 7f9659c00700 1 -- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9654103550 msgr2=0x7f96541a5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:35.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.992+0000 7f9659c00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9654103550 0x7f96541a5e80 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f964400b580 tx=0x7f964400f510 comp rx=0 tx=0).stop 2024-05-08T09:35:35.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.993+0000 7f9659c00700 1 -- 172.21.15.70:0/227899530 shutdown_connections 2024-05-08T09:35:35.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.993+0000 7f9659c00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f96380b2a70 0x7f96380b4f30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:35.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.993+0000 7f9659c00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f96541095d0 0x7f965410d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:35.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.993+0000 7f9659c00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9654103550 0x7f96541a5e80 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:35.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.993+0000 7f9659c00700 1 --2- 172.21.15.70:0/227899530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9654103f10 0x7f96541a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:35.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.993+0000 7f9659c00700 1 -- 172.21.15.70:0/227899530 >> 172.21.15.70:0/227899530 conn(0x7f965407a5f0 msgr2=0x7f965410e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:35.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.993+0000 7f9659c00700 1 -- 172.21.15.70:0/227899530 shutdown_connections 2024-05-08T09:35:35.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:35.993+0000 7f9659c00700 1 -- 172.21.15.70:0/227899530 wait complete. 2024-05-08T09:35:37.014 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:36 smithi070 ceph-mon[29591]: pgmap v5393: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:37.067 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '48b580d3', seconds elapsed: 73.5 2024-05-08T09:35:37.068 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.85 2024-05-08T09:35:37.068 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:35:37.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:36 smithi172 ceph-mon[33377]: pgmap v5393: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:36 smithi194 ceph-mon[33679]: pgmap v5393: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:37.531 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:35:39.041 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:38 smithi070 ceph-mon[29591]: pgmap v5394: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:39.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:38 smithi172 ceph-mon[33377]: pgmap v5394: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:38 smithi194 ceph-mon[33679]: pgmap v5394: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.920+0000 7f926cc00700 1 -- 172.21.15.70:0/1034647658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 msgr2=0x7f926810d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.920+0000 7f926cc00700 1 --2- 172.21.15.70:0/1034647658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 0x7f926810d410 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f9250009990 tx=0x7f9250009ca0 comp rx=0 tx=0).stop 2024-05-08T09:35:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.920+0000 7f926cc00700 1 -- 172.21.15.70:0/1034647658 shutdown_connections 2024-05-08T09:35:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.920+0000 7f926cc00700 1 --2- 172.21.15.70:0/1034647658 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f926810da30 0x7f926810fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.920+0000 7f926cc00700 1 --2- 172.21.15.70:0/1034647658 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9268104600 0x7f92681049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.920+0000 7f926cc00700 1 --2- 172.21.15.70:0/1034647658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 0x7f926810d410 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.920+0000 7f926cc00700 1 -- 172.21.15.70:0/1034647658 >> 172.21.15.70:0/1034647658 conn(0x7f92680fde50 msgr2=0x7f9268100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.921+0000 7f926cc00700 1 -- 172.21.15.70:0/1034647658 shutdown_connections 2024-05-08T09:35:39.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.921+0000 7f926cc00700 1 -- 172.21.15.70:0/1034647658 wait complete. 2024-05-08T09:35:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.922+0000 7f926cc00700 1 Processor -- start 2024-05-08T09:35:39.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.922+0000 7f926cc00700 1 -- start start 2024-05-08T09:35:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f926cc00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9268104600 0x7f92681a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f926cc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 0x7f92681a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f926cc00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926810da30 0x7f926819ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f926cc00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9268113500 con 0x7f9268104f20 2024-05-08T09:35:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f926cc00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9268113380 con 0x7f9268104600 2024-05-08T09:35:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f926cc00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9268113680 con 0x7f926810da30 2024-05-08T09:35:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f925fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 0x7f92681a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f925fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 0x7f92681a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36950/0 (socket says 172.21.15.70:36950) 2024-05-08T09:35:39.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f925fe00700 1 -- 172.21.15.70:0/3682098187 learned_addr learned my addr 172.21.15.70:0/3682098187 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f925fe00700 1 -- 172.21.15.70:0/3682098187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926810da30 msgr2=0x7f926819ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f9267e00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926810da30 0x7f926819ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f9267400700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9268104600 0x7f92681a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f925fe00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926810da30 0x7f926819ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f925fe00700 1 -- 172.21.15.70:0/3682098187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9268104600 msgr2=0x7f92681a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:39.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f925fe00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9268104600 0x7f92681a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.923+0000 7f925fe00700 1 -- 172.21.15.70:0/3682098187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926819c1b0 con 0x7f9268104f20 2024-05-08T09:35:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.924+0000 7f925fe00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 0x7f92681a1dd0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f9250006010 tx=0x7f9250003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.924+0000 7f9264c00700 1 -- 172.21.15.70:0/3682098187 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250027070 con 0x7f9268104f20 2024-05-08T09:35:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.924+0000 7f9264c00700 1 -- 172.21.15.70:0/3682098187 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f925000fc00 con 0x7f9268104f20 2024-05-08T09:35:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.924+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926819c440 con 0x7f9268104f20 2024-05-08T09:35:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.924+0000 7f9264c00700 1 -- 172.21.15.70:0/3682098187 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250022c90 con 0x7f9268104f20 2024-05-08T09:35:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.924+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92681a8760 con 0x7f9268104f20 2024-05-08T09:35:39.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.926+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f926806a190 con 0x7f9268104f20 2024-05-08T09:35:39.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.928+0000 7f9264c00700 1 -- 172.21.15.70:0/3682098187 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f925002a070 con 0x7f9268104f20 2024-05-08T09:35:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.930+0000 7f9264c00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f924c0b29f0 0x7f924c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.930+0000 7f9264c00700 1 -- 172.21.15.70:0/3682098187 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(414..414 src has 1..414) ==== 9583+0+0 (secure 0 0 0) 0x7f92500e39d0 con 0x7f9268104f20 2024-05-08T09:35:39.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.930+0000 7f9267400700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f924c0b29f0 0x7f924c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:39.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.931+0000 7f9267400700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f924c0b29f0 0x7f924c0b4eb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f926819cb90 tx=0x7f9258005d70 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:39.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:39.935+0000 7f9264c00700 1 -- 172.21.15.70:0/3682098187 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9250013070 con 0x7f9268104f20 2024-05-08T09:35:40.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.251+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f926802e510 con 0x7f9268104f20 2024-05-08T09:35:40.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.253+0000 7f9264c00700 1 -- 172.21.15.70:0/3682098187 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f92500ab020 con 0x7f9268104f20 2024-05-08T09:35:40.252 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:35:40.252 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:35:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.256+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f924c0b29f0 msgr2=0x7f924c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.256+0000 7f926cc00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f924c0b29f0 0x7f924c0b4eb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f926819cb90 tx=0x7f9258005d70 comp rx=0 tx=0).stop 2024-05-08T09:35:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.256+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 msgr2=0x7f92681a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.257+0000 7f926cc00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 0x7f92681a1dd0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f9250006010 tx=0x7f9250003680 comp rx=0 tx=0).stop 2024-05-08T09:35:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.257+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 shutdown_connections 2024-05-08T09:35:40.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.257+0000 7f926cc00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f924c0b29f0 0x7f924c0b4eb0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.257+0000 7f926cc00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f926810da30 0x7f926819ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.257+0000 7f926cc00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9268104600 0x7f92681a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.257+0000 7f926cc00700 1 --2- 172.21.15.70:0/3682098187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9268104f20 0x7f92681a1dd0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.257+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 >> 172.21.15.70:0/3682098187 conn(0x7f92680fde50 msgr2=0x7f92680feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.257+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 shutdown_connections 2024-05-08T09:35:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:40.257+0000 7f926cc00700 1 -- 172.21.15.70:0/3682098187 wait complete. 2024-05-08T09:35:40.257 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:35:41.105 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 86.85 --await-for 42.0' 2024-05-08T09:35:41.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 86.85 --await-for 42.0 2024-05-08T09:35:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:40 smithi172 ceph-mon[33377]: pgmap v5395: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:40 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3682098187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:35:41.181 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:40 smithi070 ceph-mon[29591]: pgmap v5395: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:41.181 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:40 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3682098187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:35:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:40 smithi194 ceph-mon[33679]: pgmap v5395: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:41.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:40 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3682098187' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:35:41.592 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:35:43.118 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:42 smithi070 ceph-mon[29591]: pgmap v5396: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:42 smithi172 ceph-mon[33377]: pgmap v5396: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:42 smithi194 ceph-mon[33679]: pgmap v5396: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.039+0000 7ff9d4c00700 1 -- 172.21.15.70:0/730898209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006b3e0 msgr2=0x7ff9d006b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.039+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/730898209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006b3e0 0x7ff9d006b7c0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00099c0 tx=0x7ff9c0009cd0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.039+0000 7ff9d4c00700 1 -- 172.21.15.70:0/730898209 shutdown_connections 2024-05-08T09:35:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.039+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/730898209 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9d0108860 0x7ff9d01103e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.039+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/730898209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006b3e0 0x7ff9d006b7c0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.039+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/730898209 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d006bd90 0x7ff9d0108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.039+0000 7ff9d4c00700 1 -- 172.21.15.70:0/730898209 >> 172.21.15.70:0/730898209 conn(0x7ff9d0079340 msgr2=0x7ff9d0079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.039+0000 7ff9d4c00700 1 -- 172.21.15.70:0/730898209 shutdown_connections 2024-05-08T09:35:44.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.039+0000 7ff9d4c00700 1 -- 172.21.15.70:0/730898209 wait complete. 2024-05-08T09:35:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.040+0000 7ff9d4c00700 1 Processor -- start 2024-05-08T09:35:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.041+0000 7ff9d4c00700 1 -- start start 2024-05-08T09:35:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.041+0000 7ff9d4c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9d006b3e0 0x7ff9d01a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.041+0000 7ff9d4c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006bd90 0x7ff9d01a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.041+0000 7ff9d4c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d0108860 0x7ff9d019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.041+0000 7ff9d4c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d01134e0 con 0x7ff9d006bd90 2024-05-08T09:35:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.041+0000 7ff9d4c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d0113360 con 0x7ff9d0108860 2024-05-08T09:35:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.041+0000 7ff9d4c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d0113660 con 0x7ff9d006b3e0 2024-05-08T09:35:44.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9cd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006bd90 0x7ff9d01a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9cd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006bd90 0x7ff9d01a1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36966/0 (socket says 172.21.15.70:36966) 2024-05-08T09:35:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9cd400700 1 -- 172.21.15.70:0/316033398 learned_addr learned my addr 172.21.15.70:0/316033398 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9cde00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9d006b3e0 0x7ff9d01a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9ce800700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d0108860 0x7ff9d019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9cd400700 1 -- 172.21.15.70:0/316033398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9d006b3e0 msgr2=0x7ff9d01a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9cd400700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9d006b3e0 0x7ff9d01a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9cd400700 1 -- 172.21.15.70:0/316033398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d0108860 msgr2=0x7ff9d019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9cd400700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d0108860 0x7ff9d019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.042+0000 7ff9cd400700 1 -- 172.21.15.70:0/316033398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d019c0a0 con 0x7ff9d006bd90 2024-05-08T09:35:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.043+0000 7ff9cd400700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006bd90 0x7ff9d01a1cc0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00e9a0 tx=0x7ff9bc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.043+0000 7ff9c6a00700 1 -- 172.21.15.70:0/316033398 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00cbd0 con 0x7ff9d006bd90 2024-05-08T09:35:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.043+0000 7ff9c6a00700 1 -- 172.21.15.70:0/316033398 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9bc00cd70 con 0x7ff9d006bd90 2024-05-08T09:35:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.043+0000 7ff9c6a00700 1 -- 172.21.15.70:0/316033398 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc018680 con 0x7ff9d006bd90 2024-05-08T09:35:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.043+0000 7ff9d4c00700 1 -- 172.21.15.70:0/316033398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d019c390 con 0x7ff9d006bd90 2024-05-08T09:35:44.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.043+0000 7ff9d4c00700 1 -- 172.21.15.70:0/316033398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d01a8650 con 0x7ff9d006bd90 2024-05-08T09:35:44.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.048+0000 7ff9c6a00700 1 -- 172.21.15.70:0/316033398 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff9bc010950 con 0x7ff9d006bd90 2024-05-08T09:35:44.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.048+0000 7ff9df513b80 1 Processor -- start 2024-05-08T09:35:44.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.048+0000 7ff9df513b80 1 -- start start 2024-05-08T09:35:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba49f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 0x55a5ba4999a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499ee0 0x55a5ba4a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9df513b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a5ba3ebbb0 con 0x55a5ba49ef50 2024-05-08T09:35:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9df513b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a5ba3898f0 con 0x55a5ba499520 2024-05-08T09:35:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9df513b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a5ba3e7b70 con 0x55a5ba499ee0 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9ce800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba49f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9ce800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba49f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36972/0 (socket says 172.21.15.70:36972) 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9ce800700 1 -- 172.21.15.70:0/3242300561 learned_addr learned my addr 172.21.15.70:0/3242300561 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.049+0000 7ff9cde00700 1 --2- 172.21.15.70:0/3242300561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 0x55a5ba4999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.050+0000 7ff9cd400700 1 --2- 172.21.15.70:0/3242300561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499ee0 0x55a5ba4a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.050+0000 7ff9ce800700 1 -- 172.21.15.70:0/3242300561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499ee0 msgr2=0x55a5ba4a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.050+0000 7ff9ce800700 1 --2- 172.21.15.70:0/3242300561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499ee0 0x55a5ba4a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.050+0000 7ff9ce800700 1 -- 172.21.15.70:0/3242300561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 msgr2=0x55a5ba4999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.050+0000 7ff9ce800700 1 --2- 172.21.15.70:0/3242300561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 0x55a5ba4999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.050+0000 7ff9ce800700 1 -- 172.21.15.70:0/3242300561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ba338a60 con 0x55a5ba49ef50 2024-05-08T09:35:44.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.050+0000 7ff9c6a00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff9b40b2b20 0x7ff9b40b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.050+0000 7ff9c6a00700 1 -- 172.21.15.70:0/316033398 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(414..414 src has 1..414) ==== 9583+0+0 (secure 0 0 0) 0x7ff9bc0e2bd0 con 0x7ff9d006bd90 2024-05-08T09:35:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.050+0000 7ff9ce800700 1 --2- 172.21.15.70:0/3242300561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba49f330 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009440 tx=0x7ff9c8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a6110890bc161e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:44.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.051+0000 7ff9cde00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff9b40b2b20 0x7ff9b40b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.051+0000 7ff9bb400700 1 -- 172.21.15.70:0/3242300561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8013750 con 0x55a5ba49ef50 2024-05-08T09:35:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.051+0000 7ff9bb400700 1 -- 172.21.15.70:0/3242300561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9c8013d80 con 0x55a5ba49ef50 2024-05-08T09:35:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.051+0000 7ff9bb400700 1 -- 172.21.15.70:0/3242300561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8015e40 con 0x55a5ba49ef50 2024-05-08T09:35:44.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.052+0000 7ff9df513b80 1 -- 172.21.15.70:0/3242300561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 msgr2=0x55a5ba49f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.052+0000 7ff9df513b80 1 --2- 172.21.15.70:0/3242300561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba49f330 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009440 tx=0x7ff9c8009920 comp rx=0 tx=0).stop 2024-05-08T09:35:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.052+0000 7ff9cde00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff9b40b2b20 0x7ff9b40b4fe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0000c00 tx=0x7ff9c001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.052+0000 7ff9df513b80 1 -- 172.21.15.70:0/3242300561 shutdown_connections 2024-05-08T09:35:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.052+0000 7ff9df513b80 1 --2- 172.21.15.70:0/3242300561 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499ee0 0x55a5ba4a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.052+0000 7ff9df513b80 1 --2- 172.21.15.70:0/3242300561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba49f330 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.052+0000 7ff9df513b80 1 --2- 172.21.15.70:0/3242300561 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 0x55a5ba4999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.052+0000 7ff9df513b80 1 -- 172.21.15.70:0/3242300561 >> 172.21.15.70:0/3242300561 conn(0x55a5ba3c7cf0 msgr2=0x55a5ba493e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.053+0000 7ff9df513b80 1 -- 172.21.15.70:0/3242300561 shutdown_connections 2024-05-08T09:35:44.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.053+0000 7ff9df513b80 1 -- 172.21.15.70:0/3242300561 wait complete. 2024-05-08T09:35:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.053+0000 7ff9df513b80 1 -- start start 2024-05-08T09:35:44.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.054+0000 7ff9df513b80 1 Processor -- start 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.054+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499520 0x55a5ba4a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.054+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 0x55a5ba4a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.054+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.054+0000 7ff9df513b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a5ba4a6310 con 0x55a5ba49ef50 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.054+0000 7ff9df513b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a5ba351cb0 con 0x55a5ba499ee0 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.054+0000 7ff9df513b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a5ba4a6490 con 0x55a5ba499520 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.054+0000 7ff9df513b80 10 client.0 _ll_register_callbacks cb 0x55a5ba392e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.055+0000 7ff9ce800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.055+0000 7ff9ce800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36982/0 (socket says 172.21.15.70:36982) 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.055+0000 7ff9ce800700 1 -- 172.21.15.70:0/1615740699 learned_addr learned my addr 172.21.15.70:0/1615740699 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:44.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.055+0000 7ff9cde00700 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499520 0x55a5ba4a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.055+0000 7ff9cd400700 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 0x55a5ba4a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.055+0000 7ff9ce800700 1 -- 172.21.15.70:0/1615740699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499520 msgr2=0x55a5ba4a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.056+0000 7ff9ce800700 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499520 0x55a5ba4a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.056+0000 7ff9ce800700 1 -- 172.21.15.70:0/1615740699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 msgr2=0x55a5ba4a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.056+0000 7ff9ce800700 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 0x55a5ba4a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.056+0000 7ff9ce800700 1 -- 172.21.15.70:0/1615740699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ba3b15b0 con 0x55a5ba49ef50 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.056+0000 7ff9ce800700 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a3270 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8015670 tx=0x7ff9c80156a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b031fc9082bba85 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.056+0000 7ff9afe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.056+0000 7ff9afe00700 1 -- 172.21.15.70:0/1615740699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8023070 con 0x55a5ba49ef50 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.056+0000 7ff9afe00700 1 -- 172.21.15.70:0/1615740699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(414..414 src has 1..414) ==== 9583+0+0 (secure 0 0 0) 0x7ff9c8013550 con 0x55a5ba49ef50 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.057+0000 7ff9df513b80 1 -- 172.21.15.70:0/1615740699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9c8013d80 con 0x55a5ba49ef50 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.057+0000 7ff9afe00700 1 -- 172.21.15.70:0/1615740699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff9c8015e50 con 0x55a5ba49ef50 2024-05-08T09:35:44.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.057+0000 7ff9df513b80 10 client.19761 fetch_fsmap learned FSMap version 42 2024-05-08T09:35:44.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.057+0000 7ff9df513b80 1 -- 172.21.15.70:0/1615740699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a5ba4b0b80 con 0x55a5ba49ef50 2024-05-08T09:35:44.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.057+0000 7ff9afe00700 1 -- 172.21.15.70:0/1615740699 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9c8013d80 con 0x55a5ba49ef50 2024-05-08T09:35:44.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.058+0000 7ff9afe00700 1 -- 172.21.15.70:0/1615740699 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ff9c80054d0 con 0x55a5ba49ef50 2024-05-08T09:35:44.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.058+0000 7ff9df513b80 10 client.19761 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:35:44.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.058+0000 7ff9df513b80 10 client.19761 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:35:44.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.058+0000 7ff9df513b80 20 client.19761 populate_metadata read hostname 'smithi070' 2024-05-08T09:35:44.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.058+0000 7ff9df513b80 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a5ba4b3100 0x55a5ba4b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.058+0000 7ff9df513b80 4 client.19761 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:35:44.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.058+0000 7ff9df513b80 1 -- 172.21.15.70:0/1615740699 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5ba466230 con 0x55a5ba4b3100 2024-05-08T09:35:44.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.059+0000 7ff9cde00700 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a5ba4b3100 0x55a5ba4b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.060+0000 7ff9cde00700 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a5ba4b3100 0x55a5ba4b54f0 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735c1925f97f758f server_cookie=3f13b2f9504afed in_seq=0 out_seq=0 2024-05-08T09:35:44.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.060+0000 7ff9afe00700 10 client.19761 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:35:44.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.061+0000 7ff9afe00700 1 -- 172.21.15.70:0/1615740699 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a5ba466230 con 0x55a5ba4b3100 2024-05-08T09:35:44.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.061+0000 7ff9afe00700 10 client.19761 handle_command_reply: tid=0 2024-05-08T09:35:44.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 client.19761 shutdown 2024-05-08T09:35:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 -- 172.21.15.70:0/1615740699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 msgr2=0x55a5ba4a3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a3270 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8015670 tx=0x7ff9c80156a0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 -- 172.21.15.70:0/1615740699 shutdown_connections 2024-05-08T09:35:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a5ba4b3100 0x55a5ba4b54f0 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a3270 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba499520 0x55a5ba4a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 --2- 172.21.15.70:0/1615740699 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 0x55a5ba4a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 -- 172.21.15.70:0/1615740699 >> 172.21.15.70:0/1615740699 conn(0x55a5ba3c7cf0 msgr2=0x55a5ba48e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9afe00700 0 client.19761 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:35:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 -- 172.21.15.70:0/1615740699 shutdown_connections 2024-05-08T09:35:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 1 -- 172.21.15.70:0/1615740699 wait complete. 2024-05-08T09:35:44.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.062+0000 7ff9df513b80 20 client.19761 trim_cache size 0 max 16384 2024-05-08T09:35:44.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.089+0000 7ff9df513b80 1 Processor -- start 2024-05-08T09:35:44.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.089+0000 7ff9df513b80 1 -- start start 2024-05-08T09:35:44.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.089+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499520 0x55a5ba4b8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.089+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.089+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.089+0000 7ff9df513b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d01b40e0 con 0x55a5ba499520 2024-05-08T09:35:44.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.089+0000 7ff9df513b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d01b1970 con 0x55a5ba499ee0 2024-05-08T09:35:44.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.089+0000 7ff9df513b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d01af7e0 con 0x55a5ba49ef50 2024-05-08T09:35:44.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cde00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499520 0x55a5ba4b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cde00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499520 0x55a5ba4b8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36996/0 (socket says 172.21.15.70:36996) 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cde00700 1 -- 172.21.15.70:0/2495990068 learned_addr learned my addr 172.21.15.70:0/2495990068 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cd400700 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9ce800700 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cde00700 1 -- 172.21.15.70:0/2495990068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 msgr2=0x55a5ba4a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cde00700 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cde00700 1 -- 172.21.15.70:0/2495990068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 msgr2=0x55a5ba4b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cde00700 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cde00700 1 -- 172.21.15.70:0/2495990068 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ba4a55d0 con 0x55a5ba499520 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.090+0000 7ff9cd400700 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:35:44.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.091+0000 7ff9cde00700 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499520 0x55a5ba4b8510 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00099c0 tx=0x7ff9c0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cce2f5855d66578 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:44.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.091+0000 7ff9baa00700 1 -- 172.21.15.70:0/2495990068 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0003ba0 con 0x55a5ba499520 2024-05-08T09:35:44.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.091+0000 7ff9baa00700 1 -- 172.21.15.70:0/2495990068 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9c0003d40 con 0x55a5ba499520 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.091+0000 7ff9baa00700 1 -- 172.21.15.70:0/2495990068 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0035420 con 0x55a5ba499520 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.092+0000 7ff9df513b80 1 -- 172.21.15.70:0/2495990068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499520 msgr2=0x55a5ba4b8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.092+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499520 0x55a5ba4b8510 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00099c0 tx=0x7ff9c0021000 comp rx=0 tx=0).stop 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.092+0000 7ff9df513b80 1 -- 172.21.15.70:0/2495990068 shutdown_connections 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.092+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 0x55a5ba4a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.092+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499520 0x55a5ba4b8510 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.092+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2495990068 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.092+0000 7ff9df513b80 1 -- 172.21.15.70:0/2495990068 >> 172.21.15.70:0/2495990068 conn(0x55a5ba3c7cf0 msgr2=0x55a5ba48e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.092+0000 7ff9df513b80 1 -- 172.21.15.70:0/2495990068 shutdown_connections 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.092+0000 7ff9df513b80 1 -- 172.21.15.70:0/2495990068 wait complete. 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.093+0000 7ff9df513b80 1 -- start start 2024-05-08T09:35:44.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.093+0000 7ff9df513b80 1 Processor -- start 2024-05-08T09:35:44.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 0x55a5ba4b7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9df513b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 0x55a5ba4b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9df513b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d01afe30 con 0x55a5ba499ee0 2024-05-08T09:35:44.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9df513b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d01b12a0 con 0x55a5ba499520 2024-05-08T09:35:44.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9df513b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d01b0500 con 0x55a5ba49ef50 2024-05-08T09:35:44.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9df513b80 10 client.0 _ll_register_callbacks cb 0x55a5ba392e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:35:44.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9cd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9cd400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37004/0 (socket says 172.21.15.70:37004) 2024-05-08T09:35:44.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9cd400700 1 -- 172.21.15.70:0/2657523129 learned_addr learned my addr 172.21.15.70:0/2657523129 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:35:44.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9cde00700 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 0x55a5ba4b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.094+0000 7ff9ce800700 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 0x55a5ba4b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9cd400700 1 -- 172.21.15.70:0/2657523129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 msgr2=0x55a5ba4b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9cd400700 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 0x55a5ba4b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9cd400700 1 -- 172.21.15.70:0/2657523129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 msgr2=0x55a5ba4b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9cd400700 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 0x55a5ba4b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9cd400700 1 -- 172.21.15.70:0/2657523129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ba51d630 con 0x55a5ba499ee0 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9cde00700 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 0x55a5ba4b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9ce800700 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 0x55a5ba4b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9cd400700 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b7570 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00cfd0 tx=0x7ff9bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e52e59fcfa38b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:35:44.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9afe00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:35:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9afe00700 1 -- 172.21.15.70:0/2657523129 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0a9380 con 0x55a5ba499ee0 2024-05-08T09:35:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9afe00700 1 -- 172.21.15.70:0/2657523129 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(414..414 src has 1..414) ==== 9583+0+0 (secure 0 0 0) 0x7ff9bc0a8ea0 con 0x55a5ba499ee0 2024-05-08T09:35:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.095+0000 7ff9df513b80 1 -- 172.21.15.70:0/2657523129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9c0003d40 con 0x55a5ba499ee0 2024-05-08T09:35:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9afe00700 1 -- 172.21.15.70:0/2657523129 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff9bc0a51c0 con 0x55a5ba499ee0 2024-05-08T09:35:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9df513b80 10 client.19767 fetch_fsmap learned FSMap version 42 2024-05-08T09:35:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9df513b80 1 -- 172.21.15.70:0/2657523129 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a5ba51e840 con 0x55a5ba499ee0 2024-05-08T09:35:44.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9afe00700 1 -- 172.21.15.70:0/2657523129 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff9c0003d40 con 0x55a5ba499ee0 2024-05-08T09:35:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9afe00700 1 -- 172.21.15.70:0/2657523129 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7ff9bc0cace0 con 0x55a5ba499ee0 2024-05-08T09:35:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9df513b80 10 client.19767 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:35:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9df513b80 10 client.19767 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:35:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9df513b80 20 client.19767 populate_metadata read hostname 'smithi070' 2024-05-08T09:35:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a5ba51efc0 0x55a5ba5213e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:35:44.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9df513b80 4 client.19767 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.85, "await_for": 42.0}] 2024-05-08T09:35:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.096+0000 7ff9df513b80 1 -- 172.21.15.70:0/2657523129 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 86.85, "await_for": 42.0}) -- 0x55a5ba3f9590 con 0x55a5ba51efc0 2024-05-08T09:35:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.097+0000 7ff9cde00700 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a5ba51efc0 0x55a5ba5213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:35:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.098+0000 7ff9cde00700 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a5ba51efc0 0x55a5ba5213e0 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d79b07f0a82de8 server_cookie=7d8a0045e809af40 in_seq=0 out_seq=0 2024-05-08T09:35:44.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:35:44.098+0000 7ff9afe00700 10 client.19767 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:35:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:44 smithi172 ceph-mon[33377]: pgmap v5397: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:44 smithi194 ceph-mon[33679]: pgmap v5397: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:44 smithi070 ceph-mon[29591]: pgmap v5397: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:47.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:46 smithi172 ceph-mon[33377]: pgmap v5398: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:46 smithi194 ceph-mon[33679]: pgmap v5398: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:46 smithi070 ceph-mon[29591]: pgmap v5398: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:49.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:48 smithi172 ceph-mon[33377]: pgmap v5399: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:49.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:48 smithi070 ceph-mon[29591]: pgmap v5399: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:48 smithi194 ceph-mon[33679]: pgmap v5399: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:50 smithi172 ceph-mon[33377]: pgmap v5400: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:50 smithi194 ceph-mon[33679]: pgmap v5400: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:50 smithi070 ceph-mon[29591]: pgmap v5400: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:53.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:52 smithi172 ceph-mon[33377]: pgmap v5401: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:52 smithi194 ceph-mon[33679]: pgmap v5401: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:52 smithi070 ceph-mon[29591]: pgmap v5401: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:54 smithi194 ceph-mon[33679]: pgmap v5402: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:54 smithi070 ceph-mon[29591]: pgmap v5402: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:54 smithi172 ceph-mon[33377]: pgmap v5402: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:56 smithi194 ceph-mon[33679]: pgmap v5403: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:56 smithi070 ceph-mon[29591]: pgmap v5403: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:56 smithi172 ceph-mon[33377]: pgmap v5403: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:35:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:35:58 smithi194 ceph-mon[33679]: pgmap v5404: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:35:58 smithi070 ceph-mon[29591]: pgmap v5404: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:35:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:35:58 smithi172 ceph-mon[33377]: pgmap v5404: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:00 smithi194 ceph-mon[33679]: pgmap v5405: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:01.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:00 smithi070 ceph-mon[29591]: pgmap v5405: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:00 smithi172 ceph-mon[33377]: pgmap v5405: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:02 smithi194 ceph-mon[33679]: pgmap v5406: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:02 smithi070 ceph-mon[29591]: pgmap v5406: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:02 smithi172 ceph-mon[33377]: pgmap v5406: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:04 smithi194 ceph-mon[33679]: pgmap v5407: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:04 smithi070 ceph-mon[29591]: pgmap v5407: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:04 smithi172 ceph-mon[33377]: pgmap v5407: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:06.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.263+0000 7ff9afe00700 1 -- 172.21.15.70:0/2657523129 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55a5ba3f9590 con 0x55a5ba51efc0 2024-05-08T09:36:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.263+0000 7ff9afe00700 10 client.19767 handle_command_reply: tid=0 2024-05-08T09:36:06.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.263+0000 7ff9df513b80 1 client.19767 shutdown 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.264+0000 7ff9df513b80 1 -- 172.21.15.70:0/2657523129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499ee0 msgr2=0x55a5ba4b7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.264+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b7570 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00cfd0 tx=0x7ff9bc009840 comp rx=0 tx=0).stop 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.264+0000 7ff9df513b80 1 -- 172.21.15.70:0/2657523129 shutdown_connections 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.264+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a5ba51efc0 0x55a5ba5213e0 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.264+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a5ba49ef50 0x55a5ba4b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.264+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a5ba499520 0x55a5ba4b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.264+0000 7ff9df513b80 1 --2- 172.21.15.70:0/2657523129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a5ba499ee0 0x55a5ba4b7570 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.264+0000 7ff9df513b80 1 -- 172.21.15.70:0/2657523129 >> 172.21.15.70:0/2657523129 conn(0x55a5ba3c7cf0 msgr2=0x55a5ba48e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.265+0000 7ff9afe00700 0 client.19767 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:36:06.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.265+0000 7ff9df513b80 1 -- 172.21.15.70:0/2657523129 shutdown_connections 2024-05-08T09:36:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.265+0000 7ff9df513b80 1 -- 172.21.15.70:0/2657523129 wait complete. 2024-05-08T09:36:06.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.265+0000 7ff9df513b80 20 client.19767 trim_cache size 0 max 16384 2024-05-08T09:36:06.265 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:36:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:36:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:36:06.265 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 370, 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "6172c3f9": { 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 370, 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.8, 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:36:06.266 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:36:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:36:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:36:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:06.267 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:06.267 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:36:06.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.267+0000 7ff9d4c00700 1 -- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff9b40b2b20 msgr2=0x7ff9b40b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:06.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.267+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff9b40b2b20 0x7ff9b40b4fe0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0000c00 tx=0x7ff9c001a040 comp rx=0 tx=0).stop 2024-05-08T09:36:06.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.267+0000 7ff9d4c00700 1 -- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006bd90 msgr2=0x7ff9d01a1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:06.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.267+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006bd90 0x7ff9d01a1cc0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00e9a0 tx=0x7ff9bc00ed60 comp rx=0 tx=0).stop 2024-05-08T09:36:06.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.268+0000 7ff9d4c00700 1 -- 172.21.15.70:0/316033398 shutdown_connections 2024-05-08T09:36:06.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.268+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff9b40b2b20 0x7ff9b40b4fe0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:06.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.268+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff9d0108860 0x7ff9d019b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:06.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.268+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9d006b3e0 0x7ff9d01a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:06.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.268+0000 7ff9d4c00700 1 --2- 172.21.15.70:0/316033398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9d006bd90 0x7ff9d01a1cc0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:06.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.268+0000 7ff9d4c00700 1 -- 172.21.15.70:0/316033398 >> 172.21.15.70:0/316033398 conn(0x7ff9d0079340 msgr2=0x7ff9d0100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:06.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.268+0000 7ff9d4c00700 1 -- 172.21.15.70:0/316033398 shutdown_connections 2024-05-08T09:36:06.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:06.268+0000 7ff9d4c00700 1 -- 172.21.15.70:0/316033398 wait complete. 2024-05-08T09:36:07.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:06 smithi172 ceph-mon[33377]: pgmap v5408: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:36:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:06 smithi194 ceph-mon[33679]: pgmap v5408: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:36:07.270 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:06 smithi070 ceph-mon[29591]: pgmap v5408: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:36:07.274 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6172c3f9', quiesce took 30.2 seconds. Will release after: 26.85 2024-05-08T09:36:09.119 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:08 smithi070 ceph-mon[29591]: pgmap v5409: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:36:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:08 smithi194 ceph-mon[33679]: pgmap v5409: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:36:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:08 smithi172 ceph-mon[33377]: pgmap v5409: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:36:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:10 smithi194 ceph-mon[33679]: pgmap v5410: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:36:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:10 smithi070 ceph-mon[29591]: pgmap v5410: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:36:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:10 smithi172 ceph-mon[33377]: pgmap v5410: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:36:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:12 smithi194 ceph-mon[33679]: pgmap v5411: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:36:13.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:12 smithi194 ceph-mon[33679]: osdmap e415: 12 total, 12 up, 12 in 2024-05-08T09:36:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:12 smithi070 ceph-mon[29591]: pgmap v5411: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:36:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:12 smithi070 ceph-mon[29591]: osdmap e415: 12 total, 12 up, 12 in 2024-05-08T09:36:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:12 smithi172 ceph-mon[33377]: pgmap v5411: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:36:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:12 smithi172 ceph-mon[33377]: osdmap e415: 12 total, 12 up, 12 in 2024-05-08T09:36:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:15 smithi194 ceph-mon[33679]: pgmap v5413: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:36:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:15 smithi070 ceph-mon[29591]: pgmap v5413: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:36:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:15 smithi172 ceph-mon[33377]: pgmap v5413: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:36:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:16 smithi070 ceph-mon[29591]: pgmap v5414: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:36:16.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:16 smithi172 ceph-mon[33377]: pgmap v5414: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:36:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:16 smithi194 ceph-mon[33679]: pgmap v5414: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:36:18.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:17 smithi070 ceph-mon[29591]: osdmap e416: 12 total, 12 up, 12 in 2024-05-08T09:36:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:17 smithi172 ceph-mon[33377]: osdmap e416: 12 total, 12 up, 12 in 2024-05-08T09:36:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:17 smithi194 ceph-mon[33679]: osdmap e416: 12 total, 12 up, 12 in 2024-05-08T09:36:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:18 smithi070 ceph-mon[29591]: pgmap v5416: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T09:36:19.162 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:18 smithi194 ceph-mon[33679]: pgmap v5416: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T09:36:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:18 smithi172 ceph-mon[33377]: pgmap v5416: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T09:36:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:20 smithi070 ceph-mon[29591]: pgmap v5417: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-08T09:36:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:20 smithi172 ceph-mon[33377]: pgmap v5417: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-08T09:36:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:20 smithi194 ceph-mon[33679]: pgmap v5417: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-08T09:36:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:22 smithi070 ceph-mon[29591]: pgmap v5418: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 224 B/s wr, 7 op/s 2024-05-08T09:36:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:22 smithi172 ceph-mon[33377]: pgmap v5418: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 224 B/s wr, 7 op/s 2024-05-08T09:36:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:22 smithi194 ceph-mon[33679]: pgmap v5418: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 224 B/s wr, 7 op/s 2024-05-08T09:36:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:24 smithi070 ceph-mon[29591]: pgmap v5419: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:36:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:24 smithi172 ceph-mon[33377]: pgmap v5419: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:36:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:24 smithi194 ceph-mon[33679]: pgmap v5419: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:36:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:26 smithi172 ceph-mon[33377]: pgmap v5420: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:36:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:26 smithi194 ceph-mon[33679]: pgmap v5420: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:36:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:26 smithi070 ceph-mon[29591]: pgmap v5420: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:36:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:28 smithi172 ceph-mon[33377]: pgmap v5421: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:36:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:28 smithi194 ceph-mon[33679]: pgmap v5421: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:36:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:28 smithi070 ceph-mon[29591]: pgmap v5421: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:36:31.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:30 smithi172 ceph-mon[33377]: pgmap v5422: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:36:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:30 smithi194 ceph-mon[33679]: pgmap v5422: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:36:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:30 smithi070 ceph-mon[29591]: pgmap v5422: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:36:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:32 smithi172 ceph-mon[33377]: pgmap v5423: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:32 smithi194 ceph-mon[33679]: pgmap v5423: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:32 smithi070 ceph-mon[29591]: pgmap v5423: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:34.125 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:36:34.625 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:36:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:34 smithi070 ceph-mon[29591]: pgmap v5424: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:36:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:34 smithi172 ceph-mon[33377]: pgmap v5424: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:36:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:34 smithi194 ceph-mon[33679]: pgmap v5424: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:36:37.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:36 smithi070 ceph-mon[29591]: pgmap v5425: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:37.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:36 smithi172 ceph-mon[33377]: pgmap v5425: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:36 smithi194 ceph-mon[33679]: pgmap v5425: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:38.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:38 smithi194 ceph-mon[33679]: pgmap v5426: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:36:38.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:38 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.776 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:38 smithi070 ceph-mon[29591]: pgmap v5426: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:36:38.776 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.776 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.776 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.776 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:38 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:38 smithi172 ceph-mon[33377]: pgmap v5426: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:36:38.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:38.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:38 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:39.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.538+0000 7f4ab6400700 1 -- 172.21.15.70:0/925089655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103d90 msgr2=0x7f4ab01102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:39.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.538+0000 7f4ab6400700 1 --2- 172.21.15.70:0/925089655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103d90 0x7f4ab01102a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8009990 tx=0x7f4aa8009ca0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.538+0000 7f4ab6400700 1 -- 172.21.15.70:0/925089655 shutdown_connections 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.538+0000 7f4ab6400700 1 --2- 172.21.15.70:0/925089655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab0103d90 0x7f4ab01102a0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.538+0000 7f4ab6400700 1 --2- 172.21.15.70:0/925089655 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0109460 0x7f4ab0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.538+0000 7f4ab6400700 1 --2- 172.21.15.70:0/925089655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab01033d0 0x7f4ab0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.538+0000 7f4ab6400700 1 -- 172.21.15.70:0/925089655 >> 172.21.15.70:0/925089655 conn(0x7f4ab00fef20 msgr2=0x7f4ab0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.538+0000 7f4ab6400700 1 -- 172.21.15.70:0/925089655 shutdown_connections 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.538+0000 7f4ab6400700 1 -- 172.21.15.70:0/925089655 wait complete. 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.539+0000 7f4ab6400700 1 Processor -- start 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab6400700 1 -- start start 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab6400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab01033d0 0x7f4ab01a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab6400700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103d90 0x7f4ab01a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:39.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab6400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0109460 0x7f4ab019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab6400700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab01134a0 con 0x7f4ab01033d0 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab6400700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0113320 con 0x7f4ab0103d90 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab6400700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab0113620 con 0x7f4ab0109460 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab01033d0 0x7f4ab01a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab5000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab01033d0 0x7f4ab01a1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40762/0 (socket says 172.21.15.70:40762) 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.540+0000 7f4ab5000700 1 -- 172.21.15.70:0/2201426791 learned_addr learned my addr 172.21.15.70:0/2201426791 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4ab5a00700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0109460 0x7f4ab019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4aafe00700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103d90 0x7f4ab01a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4ab5000700 1 -- 172.21.15.70:0/2201426791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0109460 msgr2=0x7f4ab019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4ab5000700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0109460 0x7f4ab019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4ab5000700 1 -- 172.21.15.70:0/2201426791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103d90 msgr2=0x7f4ab01a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4ab5000700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103d90 0x7f4ab01a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4ab5000700 1 -- 172.21.15.70:0/2201426791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab019c120 con 0x7f4ab01033d0 2024-05-08T09:36:39.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4aafe00700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103d90 0x7f4ab01a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:36:39.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4ab5000700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab01033d0 0x7f4ab01a1800 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40060b0 tx=0x7f4aa4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:36:39.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.541+0000 7f4aad600700 1 -- 172.21.15.70:0/2201426791 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa401a070 con 0x7f4ab01033d0 2024-05-08T09:36:39.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.542+0000 7f4aad600700 1 -- 172.21.15.70:0/2201426791 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4aa400de20 con 0x7f4ab01033d0 2024-05-08T09:36:39.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.542+0000 7f4aad600700 1 -- 172.21.15.70:0/2201426791 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4014690 con 0x7f4ab01033d0 2024-05-08T09:36:39.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.542+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab019c410 con 0x7f4ab01033d0 2024-05-08T09:36:39.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.542+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab01a86d0 con 0x7f4ab01033d0 2024-05-08T09:36:39.718 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:36:39.718 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:36:39.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.543+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab006a190 con 0x7f4ab01033d0 2024-05-08T09:36:39.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.545+0000 7f4aad600700 1 -- 172.21.15.70:0/2201426791 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4aa401d070 con 0x7f4ab01033d0 2024-05-08T09:36:39.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.547+0000 7f4aad600700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:39.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.547+0000 7f4aad600700 1 -- 172.21.15.70:0/2201426791 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(416..416 src has 1..416) ==== 9583+0+0 (secure 0 0 0) 0x7f4aa40e2250 con 0x7f4ab01033d0 2024-05-08T09:36:39.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.547+0000 7f4aafe00700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:39.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.548+0000 7f4aafe00700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c005fd0 tx=0x7f4a9c005ee0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:36:39.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.551+0000 7f4aad600700 1 -- 172.21.15.70:0/2201426791 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4aa4010070 con 0x7f4ab01033d0 2024-05-08T09:36:39.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.873+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ab019cef0 con 0x7f4ab01033d0 2024-05-08T09:36:39.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.874+0000 7f4aad600700 1 -- 172.21.15.70:0/2201426791 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f4aa40a97b0 con 0x7f4ab01033d0 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 msgr2=0x7f4a980b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c005fd0 tx=0x7f4a9c005ee0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab01033d0 msgr2=0x7f4ab01a1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab01033d0 0x7f4ab01a1800 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40060b0 tx=0x7f4aa4007f90 comp rx=0 tx=0).stop 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 shutdown_connections 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4a980b2a70 0x7f4a980b4f30 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ab0109460 0x7f4ab019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ab01033d0 0x7f4ab01a1800 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 --2- 172.21.15.70:0/2201426791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4ab0103d90 0x7f4ab01a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:39.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.877+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 >> 172.21.15.70:0/2201426791 conn(0x7f4ab00fef20 msgr2=0x7f4ab010fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:39.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.878+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 shutdown_connections 2024-05-08T09:36:39.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:38.878+0000 7f4ab6400700 1 -- 172.21.15.70:0/2201426791 wait complete. 2024-05-08T09:36:39.721 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2201426791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.762 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:36:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:36:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2201426791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:36:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:36:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:36:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2201426791' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:36:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:39.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:40.604 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 6172c3f9 --release --await' 2024-05-08T09:36:40.604 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 6172c3f9 --release --await 2024-05-08T09:36:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:40 smithi194 ceph-mon[33679]: pgmap v5427: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:40 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:36:40.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:40 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:36:40.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:40 smithi070 ceph-mon[29591]: pgmap v5427: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:40.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:40 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:36:40.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:40 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:36:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:40 smithi172 ceph-mon[33377]: pgmap v5427: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:40 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:36:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:40 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:36:41.113 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:36:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:42 smithi070 ceph-mon[29591]: pgmap v5428: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:36:42.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:42 smithi172 ceph-mon[33377]: pgmap v5428: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:36:43.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:42 smithi194 ceph-mon[33679]: pgmap v5428: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:36:43.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.716+0000 7fb422000700 1 -- 172.21.15.70:0/2240005527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1060a0 msgr2=0x7fb41c1125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:43.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.717+0000 7fb422000700 1 --2- 172.21.15.70:0/2240005527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1060a0 0x7fb41c1125b0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7fb41400b0a0 tx=0x7fb41400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.717+0000 7fb422000700 1 -- 172.21.15.70:0/2240005527 shutdown_connections 2024-05-08T09:36:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.717+0000 7fb422000700 1 --2- 172.21.15.70:0/2240005527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1060a0 0x7fb41c1125b0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.717+0000 7fb422000700 1 --2- 172.21.15.70:0/2240005527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41c10b6e0 0x7fb41c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.717+0000 7fb422000700 1 --2- 172.21.15.70:0/2240005527 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb41c1056e0 0x7fb41c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.717+0000 7fb422000700 1 -- 172.21.15.70:0/2240005527 >> 172.21.15.70:0/2240005527 conn(0x7fb41c1011d0 msgr2=0x7fb41c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.717+0000 7fb422000700 1 -- 172.21.15.70:0/2240005527 shutdown_connections 2024-05-08T09:36:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.717+0000 7fb422000700 1 -- 172.21.15.70:0/2240005527 wait complete. 2024-05-08T09:36:43.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.719+0000 7fb422000700 1 Processor -- start 2024-05-08T09:36:43.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.719+0000 7fb422000700 1 -- start start 2024-05-08T09:36:43.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.719+0000 7fb422000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1056e0 0x7fb41c1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.719+0000 7fb422000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41c1060a0 0x7fb41c1a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.719+0000 7fb422000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb41c10b6e0 0x7fb41c19ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.719+0000 7fb422000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1157d0 con 0x7fb41c1056e0 2024-05-08T09:36:43.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.719+0000 7fb422000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c115650 con 0x7fb41c10b6e0 2024-05-08T09:36:43.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.719+0000 7fb422000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c115950 con 0x7fb41c1060a0 2024-05-08T09:36:43.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.720+0000 7fb41b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1056e0 0x7fb41c1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.720+0000 7fb41b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1056e0 0x7fb41c1a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40780/0 (socket says 172.21.15.70:40780) 2024-05-08T09:36:43.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.720+0000 7fb41b400700 1 -- 172.21.15.70:0/2319513966 learned_addr learned my addr 172.21.15.70:0/2319513966 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:36:43.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.720+0000 7fb41aa00700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41c1060a0 0x7fb41c1a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.720+0000 7fb41be00700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb41c10b6e0 0x7fb41c19ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.721+0000 7fb41aa00700 1 -- 172.21.15.70:0/2319513966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb41c10b6e0 msgr2=0x7fb41c19ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:43.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.721+0000 7fb41aa00700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb41c10b6e0 0x7fb41c19ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.721+0000 7fb41aa00700 1 -- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1056e0 msgr2=0x7fb41c1a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:43.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.721+0000 7fb41aa00700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1056e0 0x7fb41c1a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.721+0000 7fb41aa00700 1 -- 172.21.15.70:0/2319513966 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c19c1d0 con 0x7fb41c1060a0 2024-05-08T09:36:43.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.721+0000 7fb41b400700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1056e0 0x7fb41c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:36:43.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.722+0000 7fb41aa00700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41c1060a0 0x7fb41c1a1df0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb40800d950 tx=0x7fb40800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:36:43.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.722+0000 7fb413e00700 1 -- 172.21.15.70:0/2319513966 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408016070 con 0x7fb41c1060a0 2024-05-08T09:36:43.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.722+0000 7fb422000700 1 -- 172.21.15.70:0/2319513966 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb41c19c460 con 0x7fb41c1060a0 2024-05-08T09:36:43.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.722+0000 7fb413e00700 1 -- 172.21.15.70:0/2319513966 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb40800fd20 con 0x7fb41c1060a0 2024-05-08T09:36:43.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.722+0000 7fb413e00700 1 -- 172.21.15.70:0/2319513966 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40800e3b0 con 0x7fb41c1060a0 2024-05-08T09:36:43.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.722+0000 7fb422000700 1 -- 172.21.15.70:0/2319513966 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41c1a8780 con 0x7fb41c1060a0 2024-05-08T09:36:43.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.728+0000 7fb413e00700 1 -- 172.21.15.70:0/2319513966 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb408019070 con 0x7fb41c1060a0 2024-05-08T09:36:43.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.729+0000 7fb413e00700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb4000b2a70 0x7fb4000b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.730+0000 7fb413e00700 1 -- 172.21.15.70:0/2319513966 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(416..416 src has 1..416) ==== 9583+0+0 (secure 0 0 0) 0x7fb4080e23a0 con 0x7fb41c1060a0 2024-05-08T09:36:43.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.730+0000 7fb41b400700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb4000b2a70 0x7fb4000b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.731+0000 7fb41b400700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb4000b2a70 0x7fb4000b4f30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb41c19cbb0 tx=0x7fb40c00b480 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:36:43.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.762+0000 7fb42ca8ab80 1 Processor -- start 2024-05-08T09:36:43.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.763+0000 7fb42ca8ab80 1 -- start start 2024-05-08T09:36:43.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.763+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 0x55717fbf62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.763+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbf0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.763+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.763+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55717fb42b20 con 0x55717fbf0490 2024-05-08T09:36:43.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.763+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55717fae0860 con 0x55717fbf0e50 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.763+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55717fb3eae0 con 0x55717fbf5ec0 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbf0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbf0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40794/0 (socket says 172.21.15.70:40794) 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41aa00700 1 -- 172.21.15.70:0/245687586 learned_addr learned my addr 172.21.15.70:0/245687586 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41b400700 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 0x55717fbf62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41be00700 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41aa00700 1 -- 172.21.15.70:0/245687586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 msgr2=0x55717fbf62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41aa00700 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 0x55717fbf62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41aa00700 1 -- 172.21.15.70:0/245687586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 msgr2=0x55717fbfcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41aa00700 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41aa00700 1 -- 172.21.15.70:0/245687586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55717fa8f9d0 con 0x55717fbf0490 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.764+0000 7fb41be00700 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:36:43.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.765+0000 7fb41aa00700 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbf0910 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fb4080a91f0 tx=0x7fb4080a8aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a389a888b70b45e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:36:43.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.765+0000 7fb410c00700 1 -- 172.21.15.70:0/245687586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb408020040 con 0x55717fbf0490 2024-05-08T09:36:43.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.765+0000 7fb410c00700 1 -- 172.21.15.70:0/245687586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4080a9260 con 0x55717fbf0490 2024-05-08T09:36:43.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.765+0000 7fb410c00700 1 -- 172.21.15.70:0/245687586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4080b1c30 con 0x55717fbf0490 2024-05-08T09:36:43.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.766+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/245687586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 msgr2=0x55717fbf0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:43.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.766+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbf0910 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fb4080a91f0 tx=0x7fb4080a8aa0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.766+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/245687586 shutdown_connections 2024-05-08T09:36:43.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.766+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.766+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 0x55717fbf62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.766+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/245687586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbf0910 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.766+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/245687586 >> 172.21.15.70:0/245687586 conn(0x55717fb1ec60 msgr2=0x55717fbead80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:43.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.766+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/245687586 shutdown_connections 2024-05-08T09:36:43.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.766+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/245687586 wait complete. 2024-05-08T09:36:43.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.767+0000 7fb42ca8ab80 1 -- start start 2024-05-08T09:36:43.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.767+0000 7fb42ca8ab80 1 Processor -- start 2024-05-08T09:36:43.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.768+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0490 0x55717fbfc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.768+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0e50 0x55717fbf9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.768+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fbfa220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.768+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55717fbfd280 con 0x55717fbf5ec0 2024-05-08T09:36:43.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.768+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55717faa8c20 con 0x55717fbf0490 2024-05-08T09:36:43.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.768+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55717fbfd400 con 0x55717fbf0e50 2024-05-08T09:36:43.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.768+0000 7fb42ca8ab80 10 client.0 _ll_register_callbacks cb 0x55717fae9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fbfa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fbfa220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40802/0 (socket says 172.21.15.70:40802) 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41be00700 1 -- 172.21.15.70:0/806227 learned_addr learned my addr 172.21.15.70:0/806227 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41aa00700 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0e50 0x55717fbf9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41b400700 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0490 0x55717fbfc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41be00700 1 -- 172.21.15.70:0/806227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0e50 msgr2=0x55717fbf9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41be00700 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0e50 0x55717fbf9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41be00700 1 -- 172.21.15.70:0/806227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0490 msgr2=0x55717fbfc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41be00700 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0490 0x55717fbfc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41be00700 1 -- 172.21.15.70:0/806227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55717fb08520 con 0x55717fbf5ec0 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.769+0000 7fb41b400700 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0490 0x55717fbfc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.770+0000 7fb41be00700 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fbfa220 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb414004a10 tx=0x7fb414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cd11709f34536d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:36:43.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.770+0000 7fb405600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:36:43.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.770+0000 7fb405600700 1 -- 172.21.15.70:0/806227 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140076e0 con 0x55717fbf5ec0 2024-05-08T09:36:43.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.770+0000 7fb405600700 1 -- 172.21.15.70:0/806227 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(416..416 src has 1..416) ==== 9583+0+0 (secure 0 0 0) 0x7fb414007880 con 0x55717fbf5ec0 2024-05-08T09:36:43.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.770+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/806227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4080a9260 con 0x55717fbf5ec0 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.770+0000 7fb405600700 1 -- 172.21.15.70:0/806227 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb41402f050 con 0x55717fbf5ec0 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.770+0000 7fb42ca8ab80 10 client.19785 fetch_fsmap learned FSMap version 42 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.771+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/806227 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55717fc07aa0 con 0x55717fbf5ec0 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.771+0000 7fb405600700 1 -- 172.21.15.70:0/806227 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4080a9260 con 0x55717fbf5ec0 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.771+0000 7fb405600700 1 -- 172.21.15.70:0/806227 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fb414011070 con 0x55717fbf5ec0 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.771+0000 7fb42ca8ab80 10 client.19785 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.771+0000 7fb42ca8ab80 10 client.19785 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.771+0000 7fb42ca8ab80 20 client.19785 populate_metadata read hostname 'smithi070' 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.771+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55717fc0a0e0 0x55717fc0c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.771+0000 7fb42ca8ab80 4 client.19785 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:36:43.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.771+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/806227 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55717fbbd1a0 con 0x55717fc0a0e0 2024-05-08T09:36:43.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.772+0000 7fb41b400700 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55717fc0a0e0 0x55717fc0c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.773+0000 7fb41b400700 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55717fc0a0e0 0x55717fc0c4d0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1283b2debe9a261b server_cookie=24da187d4193b43b in_seq=0 out_seq=0 2024-05-08T09:36:43.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.773+0000 7fb405600700 10 client.19785 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:36:43.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.775+0000 7fb405600700 1 -- 172.21.15.70:0/806227 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55717fbbd1a0 con 0x55717fc0a0e0 2024-05-08T09:36:43.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.775+0000 7fb405600700 10 client.19785 handle_command_reply: tid=0 2024-05-08T09:36:43.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.775+0000 7fb42ca8ab80 1 client.19785 shutdown 2024-05-08T09:36:43.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/806227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 msgr2=0x55717fbfa220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:43.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fbfa220 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7fb414004a10 tx=0x7fb414004a40 comp rx=0 tx=0).stop 2024-05-08T09:36:43.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/806227 shutdown_connections 2024-05-08T09:36:43.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55717fc0a0e0 0x55717fc0c4d0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fbfa220 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0490 0x55717fbfc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/806227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0e50 0x55717fbf9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/806227 >> 172.21.15.70:0/806227 conn(0x55717fb1ec60 msgr2=0x55717fbe5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:43.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb405600700 0 client.19785 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:36:43.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/806227 shutdown_connections 2024-05-08T09:36:43.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/806227 wait complete. 2024-05-08T09:36:43.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.776+0000 7fb42ca8ab80 20 client.19785 trim_cache size 0 max 16384 2024-05-08T09:36:43.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.813+0000 7fb42ca8ab80 1 Processor -- start 2024-05-08T09:36:43.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.813+0000 7fb42ca8ab80 1 -- start start 2024-05-08T09:36:43.813 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:43.813 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:43 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.813+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0490 0x55717fc062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.813+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbf95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.814+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fc11d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.814+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1b4110 con 0x55717fbf5ec0 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.814+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1b19a0 con 0x55717fbf0e50 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.814+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1af810 con 0x55717fbf0490 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.814+0000 7fb41be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fc11d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.814+0000 7fb41be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fc11d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40814/0 (socket says 172.21.15.70:40814) 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.814+0000 7fb41be00700 1 -- 172.21.15.70:0/3985824384 learned_addr learned my addr 172.21.15.70:0/3985824384 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.814+0000 7fb41b400700 1 --2- 172.21.15.70:0/3985824384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0490 0x55717fc062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.814+0000 7fb41aa00700 1 --2- 172.21.15.70:0/3985824384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbf95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.815+0000 7fb41be00700 1 -- 172.21.15.70:0/3985824384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0490 msgr2=0x55717fc062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:36:43.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.815+0000 7fb41be00700 1 --2- 172.21.15.70:0/3985824384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0490 0x55717fc062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.815+0000 7fb41be00700 1 -- 172.21.15.70:0/3985824384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 msgr2=0x55717fbf95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:36:43.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.815+0000 7fb41be00700 1 --2- 172.21.15.70:0/3985824384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbf95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.815+0000 7fb41be00700 1 -- 172.21.15.70:0/3985824384 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55717fbe75a0 con 0x55717fbf5ec0 2024-05-08T09:36:43.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.815+0000 7fb41be00700 1 --2- 172.21.15.70:0/3985824384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fc11d60 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb414009a20 tx=0x7fb4140095d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb187aa81bda7b50 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:36:43.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.816+0000 7fb407e00700 1 -- 172.21.15.70:0/3985824384 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414005040 con 0x55717fbf5ec0 2024-05-08T09:36:43.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.816+0000 7fb407e00700 1 -- 172.21.15.70:0/3985824384 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4140074a0 con 0x55717fbf5ec0 2024-05-08T09:36:43.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.816+0000 7fb407e00700 1 -- 172.21.15.70:0/3985824384 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414026670 con 0x55717fbf5ec0 2024-05-08T09:36:43.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.817+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/3985824384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 msgr2=0x55717fc11d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:43.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.817+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/3985824384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fc11d60 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fb414009a20 tx=0x7fb4140095d0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.817+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/3985824384 shutdown_connections 2024-05-08T09:36:43.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.817+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/3985824384 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf5ec0 0x55717fc11d60 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.817+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/3985824384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf0490 0x55717fc062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.817+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/3985824384 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbf95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.817+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/3985824384 >> 172.21.15.70:0/3985824384 conn(0x55717fb1ec60 msgr2=0x55717fbe5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:43.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.817+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/3985824384 shutdown_connections 2024-05-08T09:36:43.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.817+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/3985824384 wait complete. 2024-05-08T09:36:43.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.818+0000 7fb42ca8ab80 1 -- start start 2024-05-08T09:36:43.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.818+0000 7fb42ca8ab80 1 Processor -- start 2024-05-08T09:36:43.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbfd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb42ca8ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 0x55717fbfe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1afe60 con 0x55717fbf0490 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1b12d0 con 0x55717fbf0e50 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb42ca8ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c1b0530 con 0x55717fbf5ec0 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb42ca8ab80 10 client.0 _ll_register_callbacks cb 0x55717fae9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb41b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbfd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb41b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbfd610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40824/0 (socket says 172.21.15.70:40824) 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.819+0000 7fb41b400700 1 -- 172.21.15.70:0/1327840417 learned_addr learned my addr 172.21.15.70:0/1327840417 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.820+0000 7fb41aa00700 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.820+0000 7fb41be00700 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 0x55717fbfe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.820+0000 7fb41b400700 1 -- 172.21.15.70:0/1327840417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 msgr2=0x55717fbfe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:36:43.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.820+0000 7fb41b400700 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 0x55717fbfe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.820+0000 7fb41b400700 1 -- 172.21.15.70:0/1327840417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 msgr2=0x55717fbfdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:36:43.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.820+0000 7fb41b400700 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:43.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.820+0000 7fb41b400700 1 -- 172.21.15.70:0/1327840417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55717fc74990 con 0x55717fbf0490 2024-05-08T09:36:43.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.820+0000 7fb41aa00700 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:36:43.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.821+0000 7fb41b400700 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbfd610 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fb40c010c00 tx=0x7fb40c013070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b209020312a4e1ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:36:43.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.821+0000 7fb405600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:36:43.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.821+0000 7fb405600700 1 -- 172.21.15.70:0/1327840417 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c027710 con 0x55717fbf0490 2024-05-08T09:36:43.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.821+0000 7fb405600700 1 -- 172.21.15.70:0/1327840417 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(416..416 src has 1..416) ==== 9583+0+0 (secure 0 0 0) 0x7fb40c0278b0 con 0x55717fbf0490 2024-05-08T09:36:43.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.821+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/1327840417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4140074a0 con 0x55717fbf0490 2024-05-08T09:36:43.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.822+0000 7fb405600700 1 -- 172.21.15.70:0/1327840417 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fb40c027ab0 con 0x55717fbf0490 2024-05-08T09:36:43.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.822+0000 7fb42ca8ab80 10 client.19791 fetch_fsmap learned FSMap version 42 2024-05-08T09:36:43.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.822+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/1327840417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55717fc75d30 con 0x55717fbf0490 2024-05-08T09:36:43.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.822+0000 7fb405600700 1 -- 172.21.15.70:0/1327840417 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4140074a0 con 0x55717fbf0490 2024-05-08T09:36:43.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.822+0000 7fb405600700 1 -- 172.21.15.70:0/1327840417 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7fb40c038020 con 0x55717fbf0490 2024-05-08T09:36:43.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.823+0000 7fb42ca8ab80 10 client.19791 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:36:43.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.823+0000 7fb42ca8ab80 10 client.19791 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:36:43.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.823+0000 7fb42ca8ab80 20 client.19791 populate_metadata read hostname 'smithi070' 2024-05-08T09:36:43.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.823+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55717fc76470 0x55717fc78890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:36:43.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.823+0000 7fb42ca8ab80 4 client.19791 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6172c3f9", "release": true, "await": true}] 2024-05-08T09:36:43.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.823+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/1327840417 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6172c3f9", "release": true, "await": true}) -- 0x55717fb50500 con 0x55717fc76470 2024-05-08T09:36:43.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.823+0000 7fb41aa00700 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55717fc76470 0x55717fc78890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:36:43.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.824+0000 7fb41aa00700 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55717fc76470 0x55717fc78890 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=326d993ba91874b9 server_cookie=da02af4ae47d7ccb in_seq=0 out_seq=0 2024-05-08T09:36:43.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:43.824+0000 7fb405600700 10 client.19791 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:36:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:43.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:43 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:44.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:44.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:43 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: pgmap v5429: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:36:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: pgmap v5429: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:36:45.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: pgmap v5429: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-05-08T09:36:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:36:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:36:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:36:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:36:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:36:45.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:36:46.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:46 smithi172 ceph-mon[33377]: pgmap v5430: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:47.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:46 smithi194 ceph-mon[33679]: pgmap v5430: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:46 smithi070 ceph-mon[29591]: pgmap v5430: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.500+0000 7fb405600700 1 -- 172.21.15.70:0/1327840417 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55717fb50500 con 0x55717fc76470 2024-05-08T09:36:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.500+0000 7fb405600700 10 client.19791 handle_command_reply: tid=0 2024-05-08T09:36:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.500+0000 7fb42ca8ab80 1 client.19791 shutdown 2024-05-08T09:36:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.501+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/1327840417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 msgr2=0x55717fbfd610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.501+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbfd610 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fb40c010c00 tx=0x7fb40c013070 comp rx=0 tx=0).stop 2024-05-08T09:36:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.501+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/1327840417 shutdown_connections 2024-05-08T09:36:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.501+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55717fc76470 0x55717fc78890 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.501+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55717fbf5ec0 0x55717fbfe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.501+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55717fbf0490 0x55717fbfd610 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.502+0000 7fb42ca8ab80 1 --2- 172.21.15.70:0/1327840417 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55717fbf0e50 0x55717fbfdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.502+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/1327840417 >> 172.21.15.70:0/1327840417 conn(0x55717fb1ec60 msgr2=0x55717fbf38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:48.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.502+0000 7fb405600700 0 client.19791 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:36:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.502+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/1327840417 shutdown_connections 2024-05-08T09:36:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.502+0000 7fb42ca8ab80 1 -- 172.21.15.70:0/1327840417 wait complete. 2024-05-08T09:36:48.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.503+0000 7fb42ca8ab80 20 client.19791 trim_cache size 0 max 16384 2024-05-08T09:36:48.502 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 372, 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "6172c3f9": { 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 372, 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:36:48.503 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 86.8, 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:36:48.504 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 -- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb4000b2a70 msgr2=0x7fb4000b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb4000b2a70 0x7fb4000b4f30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb41c19cbb0 tx=0x7fb40c00b480 comp rx=0 tx=0).stop 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 -- 172.21.15.70:0/2319513966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41c1060a0 msgr2=0x7fb41c1a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41c1060a0 0x7fb41c1a1df0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb40800d950 tx=0x7fb40800dc60 comp rx=0 tx=0).stop 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 -- 172.21.15.70:0/2319513966 shutdown_connections 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb4000b2a70 0x7fb4000b4f30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb41c10b6e0 0x7fb41c19ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb41c1056e0 0x7fb41c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 --2- 172.21.15.70:0/2319513966 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41c1060a0 0x7fb41c1a1df0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:36:48.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.504+0000 7fb422000700 1 -- 172.21.15.70:0/2319513966 >> 172.21.15.70:0/2319513966 conn(0x7fb41c1011d0 msgr2=0x7fb41c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:36:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.505+0000 7fb422000700 1 -- 172.21.15.70:0/2319513966 shutdown_connections 2024-05-08T09:36:48.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:36:48.505+0000 7fb422000700 1 -- 172.21.15.70:0/2319513966 wait complete. 2024-05-08T09:36:48.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:48 smithi070 ceph-mon[29591]: pgmap v5431: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:48.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:48 smithi172 ceph-mon[33377]: pgmap v5431: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:49.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:48 smithi194 ceph-mon[33679]: pgmap v5431: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:49.435 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6172c3f9', seconds elapsed: 72.4 2024-05-08T09:36:50.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:50 smithi070 ceph-mon[29591]: pgmap v5432: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:50.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:50 smithi172 ceph-mon[33377]: pgmap v5432: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:50 smithi194 ceph-mon[33679]: pgmap v5432: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:36:52.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:52 smithi172 ceph-mon[33377]: pgmap v5433: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:53.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:52 smithi194 ceph-mon[33679]: pgmap v5433: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:52 smithi070 ceph-mon[29591]: pgmap v5433: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:54.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:54 smithi172 ceph-mon[33377]: pgmap v5434: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:55.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:54 smithi194 ceph-mon[33679]: pgmap v5434: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:54 smithi070 ceph-mon[29591]: pgmap v5434: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:36:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:56 smithi172 ceph-mon[33377]: pgmap v5435: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 137 KiB/s wr, 8 op/s 2024-05-08T09:36:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:56 smithi194 ceph-mon[33679]: pgmap v5435: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 137 KiB/s wr, 8 op/s 2024-05-08T09:36:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:56 smithi070 ceph-mon[29591]: pgmap v5435: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 137 KiB/s wr, 8 op/s 2024-05-08T09:36:59.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:36:58 smithi194 ceph-mon[33679]: pgmap v5436: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 137 KiB/s wr, 6 op/s 2024-05-08T09:36:59.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:36:58 smithi070 ceph-mon[29591]: pgmap v5436: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 137 KiB/s wr, 6 op/s 2024-05-08T09:36:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:36:58 smithi172 ceph-mon[33377]: pgmap v5436: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 137 KiB/s wr, 6 op/s 2024-05-08T09:37:00.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:00 smithi070 ceph-mon[29591]: pgmap v5437: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 386 KiB/s wr, 15 op/s 2024-05-08T09:37:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:00 smithi194 ceph-mon[33679]: pgmap v5437: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 386 KiB/s wr, 15 op/s 2024-05-08T09:37:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:00 smithi172 ceph-mon[33377]: pgmap v5437: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 386 KiB/s wr, 15 op/s 2024-05-08T09:37:03.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:02 smithi194 ceph-mon[33679]: pgmap v5438: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 386 KiB/s wr, 13 op/s 2024-05-08T09:37:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:02 smithi070 ceph-mon[29591]: pgmap v5438: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 386 KiB/s wr, 13 op/s 2024-05-08T09:37:03.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:02 smithi172 ceph-mon[33377]: pgmap v5438: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 386 KiB/s wr, 13 op/s 2024-05-08T09:37:05.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:04 smithi194 ceph-mon[33679]: pgmap v5439: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 386 KiB/s wr, 13 op/s 2024-05-08T09:37:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:04 smithi070 ceph-mon[29591]: pgmap v5439: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 386 KiB/s wr, 13 op/s 2024-05-08T09:37:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:04 smithi172 ceph-mon[33377]: pgmap v5439: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 386 KiB/s wr, 13 op/s 2024-05-08T09:37:07.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:06 smithi194 ceph-mon[33679]: pgmap v5440: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 531 KiB/s wr, 38 op/s 2024-05-08T09:37:07.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:06 smithi070 ceph-mon[29591]: pgmap v5440: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 531 KiB/s wr, 38 op/s 2024-05-08T09:37:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:06 smithi172 ceph-mon[33377]: pgmap v5440: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 531 KiB/s wr, 38 op/s 2024-05-08T09:37:08.983 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:08 smithi172 ceph-mon[33377]: pgmap v5441: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 394 KiB/s wr, 34 op/s 2024-05-08T09:37:09.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:08 smithi194 ceph-mon[33679]: pgmap v5441: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 394 KiB/s wr, 34 op/s 2024-05-08T09:37:09.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:08 smithi070 ceph-mon[29591]: pgmap v5441: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 394 KiB/s wr, 34 op/s 2024-05-08T09:37:10.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:09 smithi194 ceph-mon[33679]: osdmap e417: 12 total, 12 up, 12 in 2024-05-08T09:37:10.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:09 smithi070 ceph-mon[29591]: osdmap e417: 12 total, 12 up, 12 in 2024-05-08T09:37:10.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:09 smithi172 ceph-mon[33377]: osdmap e417: 12 total, 12 up, 12 in 2024-05-08T09:37:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:10 smithi194 ceph-mon[33679]: pgmap v5443: 129 pgs: 1 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 120 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 339 KiB/s wr, 38 op/s 2024-05-08T09:37:11.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:10 smithi070 ceph-mon[29591]: pgmap v5443: 129 pgs: 1 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 120 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 339 KiB/s wr, 38 op/s 2024-05-08T09:37:11.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:10 smithi172 ceph-mon[33377]: pgmap v5443: 129 pgs: 1 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 120 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 339 KiB/s wr, 38 op/s 2024-05-08T09:37:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:12 smithi070 ceph-mon[29591]: pgmap v5444: 129 pgs: 1 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 120 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 339 KiB/s wr, 38 op/s 2024-05-08T09:37:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:12 smithi172 ceph-mon[33377]: pgmap v5444: 129 pgs: 1 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 120 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 339 KiB/s wr, 38 op/s 2024-05-08T09:37:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:12 smithi194 ceph-mon[33679]: pgmap v5444: 129 pgs: 1 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 120 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 339 KiB/s wr, 38 op/s 2024-05-08T09:37:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:14 smithi070 ceph-mon[29591]: pgmap v5445: 129 pgs: 1 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 120 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 339 KiB/s wr, 38 op/s 2024-05-08T09:37:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:14 smithi172 ceph-mon[33377]: pgmap v5445: 129 pgs: 1 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 120 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 339 KiB/s wr, 38 op/s 2024-05-08T09:37:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:14 smithi194 ceph-mon[33679]: pgmap v5445: 129 pgs: 1 active+clean+snaptrim, 8 active+clean+snaptrim_wait, 120 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 363 KiB/s rd, 339 KiB/s wr, 38 op/s 2024-05-08T09:37:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:16 smithi172 ceph-mon[33377]: pgmap v5446: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 336 KiB/s wr, 20 op/s 2024-05-08T09:37:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:16 smithi172 ceph-mon[33377]: osdmap e418: 12 total, 12 up, 12 in 2024-05-08T09:37:17.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:16 smithi194 ceph-mon[33679]: pgmap v5446: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 336 KiB/s wr, 20 op/s 2024-05-08T09:37:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:16 smithi194 ceph-mon[33679]: osdmap e418: 12 total, 12 up, 12 in 2024-05-08T09:37:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:16 smithi070 ceph-mon[29591]: pgmap v5446: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 285 KiB/s rd, 336 KiB/s wr, 20 op/s 2024-05-08T09:37:17.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:16 smithi070 ceph-mon[29591]: osdmap e418: 12 total, 12 up, 12 in 2024-05-08T09:37:19.020 INFO:tasks.workunit.client.0.smithi070.stdout: LD vmlinux.o 2024-05-08T09:37:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:18 smithi172 ceph-mon[33377]: pgmap v5448: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 399 KiB/s wr, 24 op/s 2024-05-08T09:37:19.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:18 smithi070 ceph-mon[29591]: pgmap v5448: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 399 KiB/s wr, 24 op/s 2024-05-08T09:37:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:18 smithi194 ceph-mon[33679]: pgmap v5448: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 399 KiB/s wr, 24 op/s 2024-05-08T09:37:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:20 smithi172 ceph-mon[33377]: pgmap v5449: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 336 KiB/s wr, 32 op/s 2024-05-08T09:37:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:20 smithi194 ceph-mon[33679]: pgmap v5449: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 336 KiB/s wr, 32 op/s 2024-05-08T09:37:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:20 smithi070 ceph-mon[29591]: pgmap v5449: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 336 KiB/s wr, 32 op/s 2024-05-08T09:37:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:22 smithi172 ceph-mon[33377]: pgmap v5450: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 336 KiB/s wr, 32 op/s 2024-05-08T09:37:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:22 smithi194 ceph-mon[33679]: pgmap v5450: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 336 KiB/s wr, 32 op/s 2024-05-08T09:37:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:22 smithi070 ceph-mon[29591]: pgmap v5450: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 336 KiB/s wr, 32 op/s 2024-05-08T09:37:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:24 smithi172 ceph-mon[33377]: pgmap v5451: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 336 KiB/s wr, 32 op/s 2024-05-08T09:37:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:24 smithi194 ceph-mon[33679]: pgmap v5451: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 336 KiB/s wr, 32 op/s 2024-05-08T09:37:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:24 smithi070 ceph-mon[29591]: pgmap v5451: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 336 KiB/s wr, 32 op/s 2024-05-08T09:37:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:26 smithi172 ceph-mon[33377]: pgmap v5452: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 294 KiB/s wr, 77 op/s 2024-05-08T09:37:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:26 smithi194 ceph-mon[33679]: pgmap v5452: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 294 KiB/s wr, 77 op/s 2024-05-08T09:37:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:26 smithi070 ceph-mon[29591]: pgmap v5452: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 294 KiB/s wr, 77 op/s 2024-05-08T09:37:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:28 smithi172 ceph-mon[33377]: pgmap v5453: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 286 KiB/s wr, 75 op/s 2024-05-08T09:37:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:28 smithi194 ceph-mon[33679]: pgmap v5453: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 286 KiB/s wr, 75 op/s 2024-05-08T09:37:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:28 smithi070 ceph-mon[29591]: pgmap v5453: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 815 KiB/s rd, 286 KiB/s wr, 75 op/s 2024-05-08T09:37:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:30 smithi194 ceph-mon[33679]: pgmap v5454: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 625 KiB/s wr, 104 op/s 2024-05-08T09:37:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:30 smithi070 ceph-mon[29591]: pgmap v5454: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 625 KiB/s wr, 104 op/s 2024-05-08T09:37:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:30 smithi172 ceph-mon[33377]: pgmap v5454: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 625 KiB/s wr, 104 op/s 2024-05-08T09:37:33.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:32 smithi194 ceph-mon[33679]: pgmap v5455: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 486 KiB/s wr, 88 op/s 2024-05-08T09:37:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:32 smithi070 ceph-mon[29591]: pgmap v5455: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 486 KiB/s wr, 88 op/s 2024-05-08T09:37:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:32 smithi172 ceph-mon[33377]: pgmap v5455: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 486 KiB/s wr, 88 op/s 2024-05-08T09:37:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:34 smithi194 ceph-mon[33679]: pgmap v5456: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 486 KiB/s wr, 88 op/s 2024-05-08T09:37:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:34 smithi070 ceph-mon[29591]: pgmap v5456: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 486 KiB/s wr, 88 op/s 2024-05-08T09:37:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:34 smithi172 ceph-mon[33377]: pgmap v5456: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 913 KiB/s rd, 486 KiB/s wr, 88 op/s 2024-05-08T09:37:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:36 smithi194 ceph-mon[33679]: pgmap v5457: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 569 KiB/s wr, 101 op/s 2024-05-08T09:37:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:36 smithi070 ceph-mon[29591]: pgmap v5457: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 569 KiB/s wr, 101 op/s 2024-05-08T09:37:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:36 smithi172 ceph-mon[33377]: pgmap v5457: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 569 KiB/s wr, 101 op/s 2024-05-08T09:37:39.231 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:38 smithi172 ceph-mon[33377]: pgmap v5458: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 462 KiB/s wr, 53 op/s 2024-05-08T09:37:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:38 smithi194 ceph-mon[33679]: pgmap v5458: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 462 KiB/s wr, 53 op/s 2024-05-08T09:37:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:38 smithi070 ceph-mon[29591]: pgmap v5458: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 462 KiB/s wr, 53 op/s 2024-05-08T09:37:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:40 smithi194 ceph-mon[33679]: pgmap v5459: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 542 KiB/s wr, 61 op/s 2024-05-08T09:37:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:40 smithi070 ceph-mon[29591]: pgmap v5459: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 542 KiB/s wr, 61 op/s 2024-05-08T09:37:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:40 smithi172 ceph-mon[33377]: pgmap v5459: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 751 KiB/s rd, 542 KiB/s wr, 61 op/s 2024-05-08T09:37:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:42 smithi194 ceph-mon[33679]: pgmap v5460: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 163 KiB/s wr, 21 op/s 2024-05-08T09:37:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:42 smithi070 ceph-mon[29591]: pgmap v5460: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 163 KiB/s wr, 21 op/s 2024-05-08T09:37:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:42 smithi172 ceph-mon[33377]: pgmap v5460: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 163 KiB/s wr, 21 op/s 2024-05-08T09:37:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:44 smithi194 ceph-mon[33679]: pgmap v5461: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 163 KiB/s wr, 21 op/s 2024-05-08T09:37:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:44 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:37:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:44 smithi070 ceph-mon[29591]: pgmap v5461: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 163 KiB/s wr, 21 op/s 2024-05-08T09:37:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:44 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:37:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:44 smithi172 ceph-mon[33377]: pgmap v5461: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 163 KiB/s wr, 21 op/s 2024-05-08T09:37:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:44 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:37:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:37:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:37:46.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:45 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:37:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:37:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:37:46.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:45 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:37:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:37:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:37:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:45 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:37:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:46 smithi194 ceph-mon[33679]: pgmap v5462: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 329 KiB/s wr, 28 op/s 2024-05-08T09:37:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:46 smithi070 ceph-mon[29591]: pgmap v5462: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 329 KiB/s wr, 28 op/s 2024-05-08T09:37:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:46 smithi172 ceph-mon[33377]: pgmap v5462: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 501 KiB/s rd, 329 KiB/s wr, 28 op/s 2024-05-08T09:37:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:49 smithi194 ceph-mon[33679]: pgmap v5463: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 247 KiB/s wr, 15 op/s 2024-05-08T09:37:49.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:49 smithi070 ceph-mon[29591]: pgmap v5463: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 247 KiB/s wr, 15 op/s 2024-05-08T09:37:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:49 smithi172 ceph-mon[33377]: pgmap v5463: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 247 KiB/s wr, 15 op/s 2024-05-08T09:37:51.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:51 smithi194 ceph-mon[33679]: pgmap v5464: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 407 KiB/s wr, 27 op/s 2024-05-08T09:37:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:51 smithi070 ceph-mon[29591]: pgmap v5464: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 407 KiB/s wr, 27 op/s 2024-05-08T09:37:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:51 smithi172 ceph-mon[33377]: pgmap v5464: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 407 KiB/s wr, 27 op/s 2024-05-08T09:37:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:53 smithi070 ceph-mon[29591]: pgmap v5465: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 327 KiB/s wr, 19 op/s 2024-05-08T09:37:53.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:53 smithi172 ceph-mon[33377]: pgmap v5465: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 327 KiB/s wr, 19 op/s 2024-05-08T09:37:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:53 smithi194 ceph-mon[33679]: pgmap v5465: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 327 KiB/s wr, 19 op/s 2024-05-08T09:37:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:55 smithi070 ceph-mon[29591]: pgmap v5466: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 327 KiB/s wr, 19 op/s 2024-05-08T09:37:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:55 smithi172 ceph-mon[33377]: pgmap v5466: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 327 KiB/s wr, 19 op/s 2024-05-08T09:37:55.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:55 smithi194 ceph-mon[33679]: pgmap v5466: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 327 KiB/s wr, 19 op/s 2024-05-08T09:37:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:56 smithi070 ceph-mon[29591]: pgmap v5467: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 398 KiB/s wr, 30 op/s 2024-05-08T09:37:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:56 smithi172 ceph-mon[33377]: pgmap v5467: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 398 KiB/s wr, 30 op/s 2024-05-08T09:37:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:56 smithi194 ceph-mon[33679]: pgmap v5467: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 398 KiB/s wr, 30 op/s 2024-05-08T09:37:58.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:37:58 smithi194 ceph-mon[33679]: pgmap v5468: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 232 KiB/s wr, 23 op/s 2024-05-08T09:37:58.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:37:58 smithi070 ceph-mon[29591]: pgmap v5468: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 232 KiB/s wr, 23 op/s 2024-05-08T09:37:58.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:37:58 smithi172 ceph-mon[33377]: pgmap v5468: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 232 KiB/s wr, 23 op/s 2024-05-08T09:38:00.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:00 smithi194 ceph-mon[33679]: pgmap v5469: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 339 KiB/s wr, 52 op/s 2024-05-08T09:38:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:00 smithi070 ceph-mon[29591]: pgmap v5469: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 339 KiB/s wr, 52 op/s 2024-05-08T09:38:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:00 smithi172 ceph-mon[33377]: pgmap v5469: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 339 KiB/s wr, 52 op/s 2024-05-08T09:38:02.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:02 smithi194 ceph-mon[33679]: pgmap v5470: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 178 KiB/s wr, 40 op/s 2024-05-08T09:38:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:02 smithi070 ceph-mon[29591]: pgmap v5470: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 178 KiB/s wr, 40 op/s 2024-05-08T09:38:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:02 smithi172 ceph-mon[33377]: pgmap v5470: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 178 KiB/s wr, 40 op/s 2024-05-08T09:38:04.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:04 smithi194 ceph-mon[33679]: pgmap v5471: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 178 KiB/s wr, 40 op/s 2024-05-08T09:38:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:04 smithi070 ceph-mon[29591]: pgmap v5471: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 178 KiB/s wr, 40 op/s 2024-05-08T09:38:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:04 smithi172 ceph-mon[33377]: pgmap v5471: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 318 KiB/s rd, 178 KiB/s wr, 40 op/s 2024-05-08T09:38:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:06 smithi070 ceph-mon[29591]: pgmap v5472: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.1 MiB/s wr, 216 op/s 2024-05-08T09:38:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:06 smithi172 ceph-mon[33377]: pgmap v5472: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.1 MiB/s wr, 216 op/s 2024-05-08T09:38:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:06 smithi194 ceph-mon[33679]: pgmap v5472: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 1.1 MiB/s wr, 216 op/s 2024-05-08T09:38:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:08 smithi070 ceph-mon[29591]: pgmap v5473: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 1.1 MiB/s wr, 205 op/s 2024-05-08T09:38:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:08 smithi172 ceph-mon[33377]: pgmap v5473: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 1.1 MiB/s wr, 205 op/s 2024-05-08T09:38:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:08 smithi194 ceph-mon[33679]: pgmap v5473: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 1.1 MiB/s wr, 205 op/s 2024-05-08T09:38:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:10 smithi070 ceph-mon[29591]: pgmap v5474: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 1.1 MiB/s wr, 213 op/s 2024-05-08T09:38:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:10 smithi070 ceph-mon[29591]: osdmap e419: 12 total, 12 up, 12 in 2024-05-08T09:38:10.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:10 smithi172 ceph-mon[33377]: pgmap v5474: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 1.1 MiB/s wr, 213 op/s 2024-05-08T09:38:10.682 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:10 smithi172 ceph-mon[33377]: osdmap e419: 12 total, 12 up, 12 in 2024-05-08T09:38:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:10 smithi194 ceph-mon[33679]: pgmap v5474: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 1.1 MiB/s wr, 213 op/s 2024-05-08T09:38:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:10 smithi194 ceph-mon[33679]: osdmap e419: 12 total, 12 up, 12 in 2024-05-08T09:38:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:12 smithi172 ceph-mon[33377]: pgmap v5476: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.2 MiB/s wr, 221 op/s 2024-05-08T09:38:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:12 smithi194 ceph-mon[33679]: pgmap v5476: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.2 MiB/s wr, 221 op/s 2024-05-08T09:38:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:12 smithi070 ceph-mon[29591]: pgmap v5476: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.2 MiB/s wr, 221 op/s 2024-05-08T09:38:15.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:14 smithi172 ceph-mon[33377]: pgmap v5477: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.2 MiB/s wr, 221 op/s 2024-05-08T09:38:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:14 smithi194 ceph-mon[33679]: pgmap v5477: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.2 MiB/s wr, 221 op/s 2024-05-08T09:38:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:14 smithi070 ceph-mon[29591]: pgmap v5477: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 1.2 MiB/s wr, 221 op/s 2024-05-08T09:38:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:16 smithi172 ceph-mon[33377]: pgmap v5478: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-05-08T09:38:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:16 smithi172 ceph-mon[33377]: osdmap e420: 12 total, 12 up, 12 in 2024-05-08T09:38:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:16 smithi194 ceph-mon[33679]: pgmap v5478: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-05-08T09:38:17.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:16 smithi194 ceph-mon[33679]: osdmap e420: 12 total, 12 up, 12 in 2024-05-08T09:38:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:16 smithi070 ceph-mon[29591]: pgmap v5478: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 89 KiB/s wr, 14 op/s 2024-05-08T09:38:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:16 smithi070 ceph-mon[29591]: osdmap e420: 12 total, 12 up, 12 in 2024-05-08T09:38:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:18 smithi172 ceph-mon[33377]: pgmap v5480: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T09:38:19.180 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:18 smithi070 ceph-mon[29591]: pgmap v5480: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T09:38:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:18 smithi194 ceph-mon[33679]: pgmap v5480: 129 pgs: 129 active+clean; 2.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 50 KiB/s wr, 6 op/s 2024-05-08T09:38:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:20 smithi172 ceph-mon[33377]: pgmap v5481: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 316 KiB/s wr, 118 op/s 2024-05-08T09:38:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:20 smithi194 ceph-mon[33679]: pgmap v5481: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 316 KiB/s wr, 118 op/s 2024-05-08T09:38:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:20 smithi070 ceph-mon[29591]: pgmap v5481: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 316 KiB/s wr, 118 op/s 2024-05-08T09:38:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:22 smithi172 ceph-mon[33377]: pgmap v5482: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 313 KiB/s wr, 117 op/s 2024-05-08T09:38:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:22 smithi194 ceph-mon[33679]: pgmap v5482: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 313 KiB/s wr, 117 op/s 2024-05-08T09:38:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:22 smithi070 ceph-mon[29591]: pgmap v5482: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 313 KiB/s wr, 117 op/s 2024-05-08T09:38:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:24 smithi194 ceph-mon[33679]: pgmap v5483: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 313 KiB/s wr, 117 op/s 2024-05-08T09:38:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:24 smithi070 ceph-mon[29591]: pgmap v5483: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 313 KiB/s wr, 117 op/s 2024-05-08T09:38:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:24 smithi172 ceph-mon[33377]: pgmap v5483: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 313 KiB/s wr, 117 op/s 2024-05-08T09:38:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:26 smithi194 ceph-mon[33679]: pgmap v5484: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 903 KiB/s wr, 156 op/s 2024-05-08T09:38:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:26 smithi070 ceph-mon[29591]: pgmap v5484: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 903 KiB/s wr, 156 op/s 2024-05-08T09:38:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:26 smithi172 ceph-mon[33377]: pgmap v5484: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 903 KiB/s wr, 156 op/s 2024-05-08T09:38:29.165 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.9 2024-05-08T09:38:29.166 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:38:29.246 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:28 smithi070 ceph-mon[29591]: pgmap v5485: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 877 KiB/s wr, 152 op/s 2024-05-08T09:38:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:28 smithi194 ceph-mon[33679]: pgmap v5485: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 877 KiB/s wr, 152 op/s 2024-05-08T09:38:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:28 smithi172 ceph-mon[33377]: pgmap v5485: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 877 KiB/s wr, 152 op/s 2024-05-08T09:38:29.641 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:38:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:30 smithi194 ceph-mon[33679]: pgmap v5486: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 3.4 MiB/s wr, 414 op/s 2024-05-08T09:38:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:30 smithi070 ceph-mon[29591]: pgmap v5486: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 3.4 MiB/s wr, 414 op/s 2024-05-08T09:38:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:30 smithi172 ceph-mon[33377]: pgmap v5486: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 3.4 MiB/s wr, 414 op/s 2024-05-08T09:38:33.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.092+0000 7f7813400700 1 -- 172.21.15.70:0/2806807587 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7808003b40 con 0x7f78140757c0 2024-05-08T09:38:33.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:32 smithi070 ceph-mon[29591]: pgmap v5487: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.2 MiB/s wr, 320 op/s 2024-05-08T09:38:33.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.093+0000 7f781a200700 1 -- 172.21.15.70:0/2806807587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140757c0 msgr2=0x7f7814075ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:33.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.093+0000 7f781a200700 1 --2- 172.21.15.70:0/2806807587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140757c0 0x7f7814075ba0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f7808009990 tx=0x7f7808009ca0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.093+0000 7f781a200700 1 -- 172.21.15.70:0/2806807587 shutdown_connections 2024-05-08T09:38:33.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.093+0000 7f781a200700 1 --2- 172.21.15.70:0/2806807587 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f781410fc90 0x7f7814112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.093+0000 7f781a200700 1 --2- 172.21.15.70:0/2806807587 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140757c0 0x7f7814075ba0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.093+0000 7f781a200700 1 --2- 172.21.15.70:0/2806807587 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78140760e0 0x7f781410f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.093+0000 7f781a200700 1 -- 172.21.15.70:0/2806807587 >> 172.21.15.70:0/2806807587 conn(0x7f78140fef00 msgr2=0x7f7814101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:38:33.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.094+0000 7f781a200700 1 -- 172.21.15.70:0/2806807587 shutdown_connections 2024-05-08T09:38:33.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.094+0000 7f781a200700 1 -- 172.21.15.70:0/2806807587 wait complete. 2024-05-08T09:38:33.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.095+0000 7f781a200700 1 Processor -- start 2024-05-08T09:38:33.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.095+0000 7f781a200700 1 -- start start 2024-05-08T09:38:33.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.095+0000 7f781a200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78140757c0 0x7f78141a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.095+0000 7f781a200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140760e0 0x7f78141a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.095+0000 7f781a200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f781410fc90 0x7f781419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.095+0000 7f781a200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7814115640 con 0x7f78140760e0 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.095+0000 7f781a200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78141154c0 con 0x7f781410fc90 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.095+0000 7f781a200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78141157c0 con 0x7f78140757c0 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7813e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140760e0 0x7f78141a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7813e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140760e0 0x7f78141a1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49286/0 (socket says 172.21.15.70:49286) 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7813e00700 1 -- 172.21.15.70:0/3871784636 learned_addr learned my addr 172.21.15.70:0/3871784636 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7818e00700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78140757c0 0x7f78141a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:33.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7819800700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f781410fc90 0x7f781419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:33.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7813e00700 1 -- 172.21.15.70:0/3871784636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78140757c0 msgr2=0x7f78141a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:33.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7813e00700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78140757c0 0x7f78141a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7813e00700 1 -- 172.21.15.70:0/3871784636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f781410fc90 msgr2=0x7f781419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:33.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7813e00700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f781410fc90 0x7f781419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7813e00700 1 -- 172.21.15.70:0/3871784636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f781419c160 con 0x7f78140760e0 2024-05-08T09:38:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.096+0000 7f7819800700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f781410fc90 0x7f781419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:38:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.097+0000 7f7813e00700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140760e0 0x7f78141a1d30 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f780000d950 tx=0x7f780000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:38:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.097+0000 7f7811600700 1 -- 172.21.15.70:0/3871784636 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800016070 con 0x7f78140760e0 2024-05-08T09:38:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.097+0000 7f7811600700 1 -- 172.21.15.70:0/3871784636 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7800009dd0 con 0x7f78140760e0 2024-05-08T09:38:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.097+0000 7f7811600700 1 -- 172.21.15.70:0/3871784636 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780000f3c0 con 0x7f78140760e0 2024-05-08T09:38:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.097+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f781419c450 con 0x7f78140760e0 2024-05-08T09:38:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.098+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78141a86c0 con 0x7f78140760e0 2024-05-08T09:38:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.099+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f781406a190 con 0x7f78140760e0 2024-05-08T09:38:33.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.102+0000 7f7811600700 1 -- 172.21.15.70:0/3871784636 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7800019070 con 0x7f78140760e0 2024-05-08T09:38:33.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.104+0000 7f7811600700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77fc0b29f0 0x7f77fc0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:33.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.104+0000 7f7811600700 1 -- 172.21.15.70:0/3871784636 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(420..420 src has 1..420) ==== 9583+0+0 (secure 0 0 0) 0x7f78000e2710 con 0x7f78140760e0 2024-05-08T09:38:33.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.104+0000 7f7818e00700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77fc0b29f0 0x7f77fc0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:33.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.105+0000 7f7818e00700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77fc0b29f0 0x7f77fc0b4eb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f780800b5c0 tx=0x7f780801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:38:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.110+0000 7f7811600700 1 -- 172.21.15.70:0/3871784636 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f78000a9c70 con 0x7f78140760e0 2024-05-08T09:38:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:32 smithi194 ceph-mon[33679]: pgmap v5487: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.2 MiB/s wr, 320 op/s 2024-05-08T09:38:33.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.417+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f781402e510 con 0x7f78140760e0 2024-05-08T09:38:33.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.419+0000 7f7811600700 1 -- 172.21.15.70:0/3871784636 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f78000a9570 con 0x7f78140760e0 2024-05-08T09:38:33.418 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:38:33.418 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:38:33.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77fc0b29f0 msgr2=0x7f77fc0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:33.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77fc0b29f0 0x7f77fc0b4eb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f780800b5c0 tx=0x7f780801a040 comp rx=0 tx=0).stop 2024-05-08T09:38:33.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140760e0 msgr2=0x7f78141a1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:33.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140760e0 0x7f78141a1d30 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f780000d950 tx=0x7f780000dc60 comp rx=0 tx=0).stop 2024-05-08T09:38:33.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 shutdown_connections 2024-05-08T09:38:33.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f77fc0b29f0 0x7f77fc0b4eb0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f781410fc90 0x7f781419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78140757c0 0x7f78141a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 --2- 172.21.15.70:0/3871784636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78140760e0 0x7f78141a1d30 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:33.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 >> 172.21.15.70:0/3871784636 conn(0x7f78140fef00 msgr2=0x7f78140ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:38:33.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 shutdown_connections 2024-05-08T09:38:33.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:33.423+0000 7f781a200700 1 -- 172.21.15.70:0/3871784636 wait complete. 2024-05-08T09:38:33.423 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:38:33.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:32 smithi172 ceph-mon[33377]: pgmap v5487: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.2 MiB/s wr, 320 op/s 2024-05-08T09:38:34.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:33 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3871784636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:38:34.248 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 73.9 --await-for 42.0' 2024-05-08T09:38:34.249 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 73.9 --await-for 42.0 2024-05-08T09:38:34.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:33 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3871784636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:38:34.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:33 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3871784636' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:38:34.738 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:38:35.242 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:34 smithi070 ceph-mon[29591]: pgmap v5488: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.2 MiB/s wr, 320 op/s 2024-05-08T09:38:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:34 smithi194 ceph-mon[33679]: pgmap v5488: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.2 MiB/s wr, 320 op/s 2024-05-08T09:38:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:34 smithi172 ceph-mon[33377]: pgmap v5488: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 3.2 MiB/s wr, 320 op/s 2024-05-08T09:38:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.044+0000 7f4246600700 1 -- 172.21.15.70:0/936085116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f424010daa0 msgr2=0x7f424010ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.045+0000 7f4246600700 1 --2- 172.21.15.70:0/936085116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f424010daa0 0x7f424010ff30 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f423800b0a0 tx=0x7f423800b3b0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.045+0000 7f4246600700 1 -- 172.21.15.70:0/936085116 shutdown_connections 2024-05-08T09:38:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.045+0000 7f4246600700 1 --2- 172.21.15.70:0/936085116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f424010daa0 0x7f424010ff30 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.045+0000 7f4246600700 1 --2- 172.21.15.70:0/936085116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4240104580 0x7f4240104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.045+0000 7f4246600700 1 --2- 172.21.15.70:0/936085116 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4240104f30 0x7f424010d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.045+0000 7f4246600700 1 -- 172.21.15.70:0/936085116 >> 172.21.15.70:0/936085116 conn(0x7f42400fdcf0 msgr2=0x7f4240100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:38:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.045+0000 7f4246600700 1 -- 172.21.15.70:0/936085116 shutdown_connections 2024-05-08T09:38:37.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.045+0000 7f4246600700 1 -- 172.21.15.70:0/936085116 wait complete. 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.046+0000 7f4246600700 1 Processor -- start 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.046+0000 7f4246600700 1 -- start start 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.047+0000 7f4246600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4240104580 0x7f424019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.047+0000 7f4246600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4240104f30 0x7f424019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.047+0000 7f4246600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f424010daa0 0x7f4240199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.047+0000 7f4246600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4240113580 con 0x7f4240104580 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.047+0000 7f4246600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4240113400 con 0x7f4240104f30 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.047+0000 7f4246600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4240113700 con 0x7f424010daa0 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.047+0000 7f4245200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4240104580 0x7f424019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.047+0000 7f4245200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4240104580 0x7f424019f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49306/0 (socket says 172.21.15.70:49306) 2024-05-08T09:38:37.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.047+0000 7f4245200700 1 -- 172.21.15.70:0/3231102409 learned_addr learned my addr 172.21.15.70:0/3231102409 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.048+0000 7f423fe00700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4240104f30 0x7f424019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.048+0000 7f4245c00700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f424010daa0 0x7f4240199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.048+0000 7f4245200700 1 -- 172.21.15.70:0/3231102409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f424010daa0 msgr2=0x7f4240199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.048+0000 7f4245200700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f424010daa0 0x7f4240199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.048+0000 7f4245200700 1 -- 172.21.15.70:0/3231102409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4240104f30 msgr2=0x7f424019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.048+0000 7f4245200700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4240104f30 0x7f424019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.048+0000 7f4245200700 1 -- 172.21.15.70:0/3231102409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4240199fc0 con 0x7f4240104580 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.048+0000 7f4245200700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4240104580 0x7f424019f6a0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f423400d980 tx=0x7f423400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.048+0000 7f423d600700 1 -- 172.21.15.70:0/3231102409 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234017070 con 0x7f4240104580 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.049+0000 7f423d600700 1 -- 172.21.15.70:0/3231102409 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4234004830 con 0x7f4240104580 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.049+0000 7f423d600700 1 -- 172.21.15.70:0/3231102409 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340053a0 con 0x7f4240104580 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.049+0000 7f4246600700 1 -- 172.21.15.70:0/3231102409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f424019a2b0 con 0x7f4240104580 2024-05-08T09:38:37.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.049+0000 7f4246600700 1 -- 172.21.15.70:0/3231102409 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42401a6570 con 0x7f4240104580 2024-05-08T09:38:37.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.053+0000 7f423d600700 1 -- 172.21.15.70:0/3231102409 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f42340049e0 con 0x7f4240104580 2024-05-08T09:38:37.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.055+0000 7f423d600700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42280b2b20 0x7f42280b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.055+0000 7f423d600700 1 -- 172.21.15.70:0/3231102409 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(420..420 src has 1..420) ==== 9583+0+0 (secure 0 0 0) 0x7f42340e29c0 con 0x7f4240104580 2024-05-08T09:38:37.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.056+0000 7f423fe00700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42280b2b20 0x7f42280b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.056+0000 7f423fe00700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42280b2b20 0x7f42280b4fe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f422c005950 tx=0x7f422c0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:38:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:36 smithi194 ceph-mon[33679]: pgmap v5489: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 6.6 MiB/s wr, 324 op/s 2024-05-08T09:38:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:36 smithi070 ceph-mon[29591]: pgmap v5489: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 6.6 MiB/s wr, 324 op/s 2024-05-08T09:38:37.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.386+0000 7f4252554b80 1 Processor -- start 2024-05-08T09:38:37.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.387+0000 7f4252554b80 1 -- start start 2024-05-08T09:38:37.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.387+0000 7f4252554b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8976c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.387+0000 7f4252554b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b891810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.387+0000 7f4252554b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b892290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.387+0000 7f4252554b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b51b7e3bb0 con 0x55b51b891e30 2024-05-08T09:38:37.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.387+0000 7f4252554b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b51b7818f0 con 0x55b51b897c00 2024-05-08T09:38:37.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.387+0000 7f4252554b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b51b7dfb70 con 0x55b51b8972e0 2024-05-08T09:38:37.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.388+0000 7f4245200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8976c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.388+0000 7f4245200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8976c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:35904/0 (socket says 172.21.15.70:35904) 2024-05-08T09:38:37.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.388+0000 7f4245200700 1 -- 172.21.15.70:0/3799999636 learned_addr learned my addr 172.21.15.70:0/3799999636 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:38:37.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.388+0000 7f4245c00700 1 --2- 172.21.15.70:0/3799999636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b892290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.388+0000 7f423fe00700 1 --2- 172.21.15.70:0/3799999636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b891810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.389+0000 7f4245200700 1 -- 172.21.15.70:0/3799999636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 msgr2=0x55b51b891810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:38:37.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.389+0000 7f4245200700 1 --2- 172.21.15.70:0/3799999636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b891810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.389+0000 7f4245200700 1 -- 172.21.15.70:0/3799999636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 msgr2=0x55b51b892290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:38:37.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.389+0000 7f4245200700 1 --2- 172.21.15.70:0/3799999636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b892290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.389+0000 7f4245200700 1 -- 172.21.15.70:0/3799999636 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51b730a60 con 0x55b51b8972e0 2024-05-08T09:38:37.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.390+0000 7f4245200700 1 --2- 172.21.15.70:0/3799999636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8976c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42340a97b0 tx=0x7f42340a93b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31709deeeb5faa19 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:38:37.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.390+0000 7f4232000700 1 -- 172.21.15.70:0/3799999636 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340a9820 con 0x55b51b8972e0 2024-05-08T09:38:37.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.390+0000 7f4232000700 1 -- 172.21.15.70:0/3799999636 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42340adbd0 con 0x55b51b8972e0 2024-05-08T09:38:37.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.390+0000 7f4232000700 1 -- 172.21.15.70:0/3799999636 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340a9ce0 con 0x55b51b8972e0 2024-05-08T09:38:37.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.392+0000 7f4252554b80 1 -- 172.21.15.70:0/3799999636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 msgr2=0x55b51b8976c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:37.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.392+0000 7f4252554b80 1 --2- 172.21.15.70:0/3799999636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8976c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42340a97b0 tx=0x7f42340a93b0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.392+0000 7f4252554b80 1 -- 172.21.15.70:0/3799999636 shutdown_connections 2024-05-08T09:38:37.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.392+0000 7f4252554b80 1 --2- 172.21.15.70:0/3799999636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b892290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.392+0000 7f4252554b80 1 --2- 172.21.15.70:0/3799999636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8976c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.392+0000 7f4252554b80 1 --2- 172.21.15.70:0/3799999636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b891810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.392+0000 7f4252554b80 1 -- 172.21.15.70:0/3799999636 >> 172.21.15.70:0/3799999636 conn(0x55b51b809860 msgr2=0x55b51b88c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:38:37.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.392+0000 7f4252554b80 1 -- 172.21.15.70:0/3799999636 shutdown_connections 2024-05-08T09:38:37.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.392+0000 7f4252554b80 1 -- 172.21.15.70:0/3799999636 wait complete. 2024-05-08T09:38:37.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.393+0000 7f4252554b80 1 -- start start 2024-05-08T09:38:37.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.393+0000 7f4252554b80 1 Processor -- start 2024-05-08T09:38:37.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.394+0000 7f4252554b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 0x55b51b89d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.394+0000 7f4252554b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b8972e0 0x55b51b89abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.394+0000 7f4252554b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b897c00 0x55b51b89b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.394+0000 7f4252554b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b51b8a2b30 con 0x55b51b897c00 2024-05-08T09:38:37.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.394+0000 7f4252554b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b51b749cb0 con 0x55b51b8972e0 2024-05-08T09:38:37.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.394+0000 7f4252554b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b51b8a2cb0 con 0x55b51b891e30 2024-05-08T09:38:37.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.394+0000 7f4252554b80 10 client.0 _ll_register_callbacks cb 0x55b51b78ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:38:37.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.394+0000 7f4245c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b897c00 0x55b51b89b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.395+0000 7f4245c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b897c00 0x55b51b89b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55258/0 (socket says 172.21.15.70:55258) 2024-05-08T09:38:37.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.395+0000 7f4245c00700 1 -- 172.21.15.70:0/4271625099 learned_addr learned my addr 172.21.15.70:0/4271625099 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.395+0000 7f4245200700 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 0x55b51b89d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.395+0000 7f423fe00700 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b8972e0 0x55b51b89abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.395+0000 7f4245c00700 1 -- 172.21.15.70:0/4271625099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 msgr2=0x55b51b89d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.395+0000 7f4245c00700 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 0x55b51b89d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.395+0000 7f4245c00700 1 -- 172.21.15.70:0/4271625099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b8972e0 msgr2=0x55b51b89abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.395+0000 7f4245c00700 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b8972e0 0x55b51b89abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.395+0000 7f4245c00700 1 -- 172.21.15.70:0/4271625099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51b7a95b0 con 0x55b51b897c00 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.396+0000 7f4245c00700 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b897c00 0x55b51b89b130 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f4238004c60 tx=0x7f4238004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbaf4c0f949b4c66 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.396+0000 7f4226a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:38:37.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.396+0000 7f4226a00700 1 -- 172.21.15.70:0/4271625099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42380076e0 con 0x55b51b897c00 2024-05-08T09:38:37.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.396+0000 7f4252554b80 1 -- 172.21.15.70:0/4271625099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42340adbd0 con 0x55b51b897c00 2024-05-08T09:38:37.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.397+0000 7f4226a00700 1 -- 172.21.15.70:0/4271625099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(420..420 src has 1..420) ==== 9583+0+0 (secure 0 0 0) 0x7f4238007880 con 0x55b51b897c00 2024-05-08T09:38:37.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.397+0000 7f4226a00700 1 -- 172.21.15.70:0/4271625099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f423802e050 con 0x55b51b897c00 2024-05-08T09:38:37.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.397+0000 7f4252554b80 10 client.19809 fetch_fsmap learned FSMap version 42 2024-05-08T09:38:37.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.397+0000 7f4252554b80 1 -- 172.21.15.70:0/4271625099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b51b8ad380 con 0x55b51b897c00 2024-05-08T09:38:37.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.397+0000 7f4226a00700 1 -- 172.21.15.70:0/4271625099 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42340adbd0 con 0x55b51b897c00 2024-05-08T09:38:37.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.398+0000 7f4226a00700 1 -- 172.21.15.70:0/4271625099 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f4238011070 con 0x55b51b897c00 2024-05-08T09:38:37.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.398+0000 7f4252554b80 10 client.19809 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:38:37.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.398+0000 7f4252554b80 10 client.19809 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:38:37.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.398+0000 7f4252554b80 20 client.19809 populate_metadata read hostname 'smithi070' 2024-05-08T09:38:37.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.398+0000 7f4252554b80 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b51b8af910 0x55b51b8b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.398+0000 7f4252554b80 4 client.19809 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:38:37.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.398+0000 7f4252554b80 1 -- 172.21.15.70:0/4271625099 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b51b85e2d0 con 0x55b51b8af910 2024-05-08T09:38:37.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.399+0000 7f4245200700 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b51b8af910 0x55b51b8b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.400+0000 7f4245200700 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b51b8af910 0x55b51b8b1d30 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4ed0bceb9936fad server_cookie=10fb3488747f5c07 in_seq=0 out_seq=0 2024-05-08T09:38:37.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.400+0000 7f4226a00700 10 client.19809 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:38:37.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4226a00700 1 -- 172.21.15.70:0/4271625099 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b51b85e2d0 con 0x55b51b8af910 2024-05-08T09:38:37.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4226a00700 10 client.19809 handle_command_reply: tid=0 2024-05-08T09:38:37.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4252554b80 1 client.19809 shutdown 2024-05-08T09:38:37.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4252554b80 1 -- 172.21.15.70:0/4271625099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b897c00 msgr2=0x55b51b89b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:37.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4252554b80 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b897c00 0x55b51b89b130 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f4238004c60 tx=0x7f4238004c90 comp rx=0 tx=0).stop 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4252554b80 1 -- 172.21.15.70:0/4271625099 shutdown_connections 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4252554b80 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b51b8af910 0x55b51b8b1d30 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4252554b80 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b897c00 0x55b51b89b130 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4252554b80 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 0x55b51b89d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4226a00700 0 client.19809 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4252554b80 1 --2- 172.21.15.70:0/4271625099 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b8972e0 0x55b51b89abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.402+0000 7f4252554b80 1 -- 172.21.15.70:0/4271625099 >> 172.21.15.70:0/4271625099 conn(0x55b51b809860 msgr2=0x55b51b890800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.403+0000 7f4252554b80 1 -- 172.21.15.70:0/4271625099 shutdown_connections 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.403+0000 7f4252554b80 1 -- 172.21.15.70:0/4271625099 wait complete. 2024-05-08T09:38:37.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.403+0000 7f4252554b80 20 client.19809 trim_cache size 0 max 16384 2024-05-08T09:38:37.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.429+0000 7f4252554b80 1 Processor -- start 2024-05-08T09:38:37.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.429+0000 7f4252554b80 1 -- start start 2024-05-08T09:38:37.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f4252554b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 0x55b51b8abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f4252554b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b8972e0 0x55b51b89b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f4252554b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b8b7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f4252554b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42401afab0 con 0x55b51b8972e0 2024-05-08T09:38:37.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f4252554b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42401ad340 con 0x55b51b897c00 2024-05-08T09:38:37.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f4252554b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42401ab1d0 con 0x55b51b891e30 2024-05-08T09:38:37.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f423fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b8972e0 0x55b51b89b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f423fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b8972e0 0x55b51b89b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55260/0 (socket says 172.21.15.70:55260) 2024-05-08T09:38:37.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f423fe00700 1 -- 172.21.15.70:0/4159779879 learned_addr learned my addr 172.21.15.70:0/4159779879 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:38:37.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.430+0000 7f4245200700 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 0x55b51b8abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.431+0000 7f4245c00700 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b8b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:36 smithi172 ceph-mon[33377]: pgmap v5489: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 6.6 MiB/s wr, 324 op/s 2024-05-08T09:38:37.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.431+0000 7f423fe00700 1 -- 172.21.15.70:0/4159779879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 msgr2=0x55b51b8abbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:38:37.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.431+0000 7f423fe00700 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 0x55b51b8abbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.431+0000 7f423fe00700 1 -- 172.21.15.70:0/4159779879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 msgr2=0x55b51b8b7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:38:37.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.431+0000 7f423fe00700 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b8b7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.431+0000 7f423fe00700 1 -- 172.21.15.70:0/4159779879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b51b890e40 con 0x55b51b8972e0 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.431+0000 7f4245c00700 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b8b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.431+0000 7f4245200700 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 0x55b51b8abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.431+0000 7f423fe00700 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b8972e0 0x55b51b89b160 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f424010ed50 tx=0x7f422c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb52941407e46c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.432+0000 7f4231600700 1 -- 172.21.15.70:0/4159779879 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c011bb0 con 0x55b51b8972e0 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.432+0000 7f4231600700 1 -- 172.21.15.70:0/4159779879 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f422c011d50 con 0x55b51b8972e0 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.432+0000 7f4231600700 1 -- 172.21.15.70:0/4159779879 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422c01e680 con 0x55b51b8972e0 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.433+0000 7f4252554b80 1 -- 172.21.15.70:0/4159779879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b8972e0 msgr2=0x55b51b89b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.433+0000 7f4252554b80 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b8972e0 0x55b51b89b160 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f424010ed50 tx=0x7f422c012000 comp rx=0 tx=0).stop 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.433+0000 7f4252554b80 1 -- 172.21.15.70:0/4159779879 shutdown_connections 2024-05-08T09:38:37.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.433+0000 7f4252554b80 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b8b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.433+0000 7f4252554b80 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b891e30 0x55b51b8abbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.433+0000 7f4252554b80 1 --2- 172.21.15.70:0/4159779879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b8972e0 0x55b51b89b160 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.433+0000 7f4252554b80 1 -- 172.21.15.70:0/4159779879 >> 172.21.15.70:0/4159779879 conn(0x55b51b809860 msgr2=0x55b51b8994e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:38:37.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.433+0000 7f4252554b80 1 -- 172.21.15.70:0/4159779879 shutdown_connections 2024-05-08T09:38:37.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.433+0000 7f4252554b80 1 -- 172.21.15.70:0/4159779879 wait complete. 2024-05-08T09:38:37.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.434+0000 7f4252554b80 1 -- start start 2024-05-08T09:38:37.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.434+0000 7f4252554b80 1 Processor -- start 2024-05-08T09:38:37.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4252554b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b8a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4252554b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4252554b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b9141c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4252554b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42401ab820 con 0x55b51b891e30 2024-05-08T09:38:37.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4252554b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f42401acc70 con 0x55b51b897c00 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4252554b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f42401abed0 con 0x55b51b8972e0 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4252554b80 10 client.0 _ll_register_callbacks cb 0x55b51b78ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4245200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b8a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4245200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b8a54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55264/0 (socket says 172.21.15.70:55264) 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4245200700 1 -- 172.21.15.70:0/951279596 learned_addr learned my addr 172.21.15.70:0/951279596 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f423fe00700 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4245c00700 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b9141c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4245200700 1 -- 172.21.15.70:0/951279596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 msgr2=0x55b51b8a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4245200700 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4245200700 1 -- 172.21.15.70:0/951279596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 msgr2=0x55b51b9141c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4245200700 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b9141c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f4245200700 1 -- 172.21.15.70:0/951279596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51b914830 con 0x55b51b891e30 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.435+0000 7f423fe00700 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:38:37.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.436+0000 7f4245200700 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b8a54f0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f42340a6a90 tx=0x7f423400de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4956be841691effb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.436+0000 7f4226a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.436+0000 7f4226a00700 1 -- 172.21.15.70:0/951279596 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42340adbd0 con 0x55b51b891e30 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.436+0000 7f4226a00700 1 -- 172.21.15.70:0/951279596 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(420..420 src has 1..420) ==== 9583+0+0 (secure 0 0 0) 0x7f4234005540 con 0x55b51b891e30 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.436+0000 7f4252554b80 1 -- 172.21.15.70:0/951279596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f422c011d50 con 0x55b51b891e30 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4226a00700 1 -- 172.21.15.70:0/951279596 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f4234005740 con 0x55b51b891e30 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4252554b80 10 client.19815 fetch_fsmap learned FSMap version 42 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4252554b80 1 -- 172.21.15.70:0/951279596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55b51b91bb00 con 0x55b51b891e30 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4226a00700 1 -- 172.21.15.70:0/951279596 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f422c011d50 con 0x55b51b891e30 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4226a00700 1 -- 172.21.15.70:0/951279596 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f42340c8030 con 0x55b51b891e30 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4252554b80 10 client.19815 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4252554b80 10 client.19815 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4252554b80 20 client.19815 populate_metadata read hostname 'smithi070' 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4252554b80 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b51b91be40 0x55b51b91e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:38:37.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4252554b80 4 client.19815 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 73.9, "await_for": 42.0}] 2024-05-08T09:38:37.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.437+0000 7f4252554b80 1 -- 172.21.15.70:0/951279596 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 73.9, "await_for": 42.0}) -- 0x55b51b7f1590 con 0x55b51b91be40 2024-05-08T09:38:37.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.438+0000 7f423fe00700 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b51b91be40 0x55b51b91e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:38:37.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.439+0000 7f4226a00700 10 client.19815 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:38:37.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:38:37.439+0000 7f423fe00700 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b51b91be40 0x55b51b91e230 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dff306621887f7e server_cookie=a6ff5995f0aa5fd9 in_seq=0 out_seq=0 2024-05-08T09:38:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:38 smithi194 ceph-mon[33679]: pgmap v5490: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 6.1 MiB/s wr, 287 op/s 2024-05-08T09:38:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:38 smithi070 ceph-mon[29591]: pgmap v5490: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 6.1 MiB/s wr, 287 op/s 2024-05-08T09:38:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:38 smithi172 ceph-mon[33377]: pgmap v5490: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 6.1 MiB/s wr, 287 op/s 2024-05-08T09:38:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:40 smithi194 ceph-mon[33679]: pgmap v5491: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.7 MiB/s wr, 290 op/s 2024-05-08T09:38:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:40 smithi070 ceph-mon[29591]: pgmap v5491: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.7 MiB/s wr, 290 op/s 2024-05-08T09:38:41.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:40 smithi172 ceph-mon[33377]: pgmap v5491: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 6.7 MiB/s wr, 290 op/s 2024-05-08T09:38:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:43 smithi194 ceph-mon[33679]: pgmap v5492: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 4.0 MiB/s wr, 6 op/s 2024-05-08T09:38:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:43 smithi070 ceph-mon[29591]: pgmap v5492: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 4.0 MiB/s wr, 6 op/s 2024-05-08T09:38:43.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:43 smithi172 ceph-mon[33377]: pgmap v5492: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 4.0 MiB/s wr, 6 op/s 2024-05-08T09:38:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:45 smithi194 ceph-mon[33679]: pgmap v5493: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 4.0 MiB/s wr, 6 op/s 2024-05-08T09:38:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:45 smithi070 ceph-mon[29591]: pgmap v5493: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 4.0 MiB/s wr, 6 op/s 2024-05-08T09:38:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:45 smithi172 ceph-mon[33377]: pgmap v5493: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 4.0 MiB/s wr, 6 op/s 2024-05-08T09:38:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:47 smithi070 ceph-mon[29591]: pgmap v5494: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 4.0 MiB/s wr, 8 op/s 2024-05-08T09:38:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:47 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:38:47.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:47 smithi172 ceph-mon[33377]: pgmap v5494: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 4.0 MiB/s wr, 8 op/s 2024-05-08T09:38:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:47 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:38:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:47 smithi194 ceph-mon[33679]: pgmap v5494: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 4.0 MiB/s wr, 8 op/s 2024-05-08T09:38:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:47 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:38:48.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:38:48.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:38:48.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:48 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:38:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:38:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:38:48.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:48 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:38:48.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:38:48.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:38:48.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:48 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:38:49.280 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:49 smithi070 ceph-mon[29591]: pgmap v5495: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 595 KiB/s wr, 5 op/s 2024-05-08T09:38:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:49 smithi172 ceph-mon[33377]: pgmap v5495: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 595 KiB/s wr, 5 op/s 2024-05-08T09:38:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:49 smithi194 ceph-mon[33679]: pgmap v5495: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 595 KiB/s wr, 5 op/s 2024-05-08T09:38:50.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:50 smithi070 ceph-mon[29591]: pgmap v5496: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 595 KiB/s wr, 7 op/s 2024-05-08T09:38:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:50 smithi172 ceph-mon[33377]: pgmap v5496: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 595 KiB/s wr, 7 op/s 2024-05-08T09:38:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:50 smithi194 ceph-mon[33679]: pgmap v5496: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 595 KiB/s wr, 7 op/s 2024-05-08T09:38:52.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:52 smithi070 ceph-mon[29591]: pgmap v5497: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:38:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:52 smithi172 ceph-mon[33377]: pgmap v5497: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:38:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:52 smithi194 ceph-mon[33679]: pgmap v5497: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:38:54.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:54 smithi070 ceph-mon[29591]: pgmap v5498: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:38:54.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:54 smithi172 ceph-mon[33377]: pgmap v5498: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:38:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:54 smithi194 ceph-mon[33679]: pgmap v5498: 129 pgs: 129 active+clean; 2.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:38:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:56 smithi070 ceph-mon[29591]: pgmap v5499: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T09:38:56.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:56 smithi172 ceph-mon[33377]: pgmap v5499: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T09:38:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:56 smithi194 ceph-mon[33679]: pgmap v5499: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T09:38:58.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:38:58 smithi070 ceph-mon[29591]: pgmap v5500: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 5 op/s 2024-05-08T09:38:58.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:38:58 smithi172 ceph-mon[33377]: pgmap v5500: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 5 op/s 2024-05-08T09:38:58.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:38:58 smithi194 ceph-mon[33679]: pgmap v5500: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 5 op/s 2024-05-08T09:39:00.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4226a00700 1 -- 172.21.15.70:0/951279596 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55b51b7f1590 con 0x55b51b91be40 2024-05-08T09:39:00.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4226a00700 10 client.19815 handle_command_reply: tid=0 2024-05-08T09:39:00.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4252554b80 1 client.19815 shutdown 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4252554b80 1 -- 172.21.15.70:0/951279596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 msgr2=0x55b51b8a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4252554b80 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b8a54f0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f42340a6a90 tx=0x7f423400de60 comp rx=0 tx=0).stop 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4252554b80 1 -- 172.21.15.70:0/951279596 shutdown_connections 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4252554b80 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b51b91be40 0x55b51b91e230 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4252554b80 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b51b897c00 0x55b51b9141c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4252554b80 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b51b891e30 0x55b51b8a54f0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4252554b80 1 --2- 172.21.15.70:0/951279596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b51b8972e0 0x55b51b8a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4226a00700 0 client.19815 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.141+0000 7f4252554b80 1 -- 172.21.15.70:0/951279596 >> 172.21.15.70:0/951279596 conn(0x55b51b809860 msgr2=0x55b51b897fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.142+0000 7f4252554b80 1 -- 172.21.15.70:0/951279596 shutdown_connections 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.142+0000 7f4252554b80 1 -- 172.21.15.70:0/951279596 wait complete. 2024-05-08T09:39:00.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.142+0000 7f4252554b80 20 client.19815 trim_cache size 0 max 16384 2024-05-08T09:39:00.143 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:39:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:39:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:39:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 374, 2024-05-08T09:39:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:39:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "56781d91": { 2024-05-08T09:39:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 374, 2024-05-08T09:39:00.143 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 73.9, 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:00.144 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:00.145 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:00.145 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:39:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 -- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42280b2b20 msgr2=0x7f42280b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42280b2b20 0x7f42280b4fe0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f422c005950 tx=0x7f422c0058e0 comp rx=0 tx=0).stop 2024-05-08T09:39:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 -- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4240104580 msgr2=0x7f424019f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4240104580 0x7f424019f6a0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f423400d980 tx=0x7f423400dd40 comp rx=0 tx=0).stop 2024-05-08T09:39:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 -- 172.21.15.70:0/3231102409 shutdown_connections 2024-05-08T09:39:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f42280b2b20 0x7f42280b4fe0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f424010daa0 0x7f4240199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4240104580 0x7f424019f6a0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 --2- 172.21.15.70:0/3231102409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4240104f30 0x7f424019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 -- 172.21.15.70:0/3231102409 >> 172.21.15.70:0/3231102409 conn(0x7f42400fdcf0 msgr2=0x7f42400fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 -- 172.21.15.70:0/3231102409 shutdown_connections 2024-05-08T09:39:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:00.144+0000 7f4246600700 1 -- 172.21.15.70:0/3231102409 wait complete. 2024-05-08T09:39:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:00 smithi070 ceph-mon[29591]: pgmap v5501: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T09:39:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:00 smithi172 ceph-mon[33377]: pgmap v5501: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T09:39:00.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:00 smithi194 ceph-mon[33679]: pgmap v5501: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 56 KiB/s wr, 7 op/s 2024-05-08T09:39:01.692 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '56781d91', quiesce took 32.5 seconds. Will release after: 13.9 2024-05-08T09:39:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:02 smithi070 ceph-mon[29591]: pgmap v5502: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 5 op/s 2024-05-08T09:39:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:02 smithi172 ceph-mon[33377]: pgmap v5502: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 5 op/s 2024-05-08T09:39:02.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:02 smithi194 ceph-mon[33679]: pgmap v5502: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 5 op/s 2024-05-08T09:39:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:04 smithi070 ceph-mon[29591]: pgmap v5503: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 5 op/s 2024-05-08T09:39:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:04 smithi172 ceph-mon[33377]: pgmap v5503: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 5 op/s 2024-05-08T09:39:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:04 smithi194 ceph-mon[33679]: pgmap v5503: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 5 op/s 2024-05-08T09:39:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:06 smithi070 ceph-mon[29591]: pgmap v5504: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 24 op/s 2024-05-08T09:39:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:06 smithi172 ceph-mon[33377]: pgmap v5504: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 24 op/s 2024-05-08T09:39:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:06 smithi194 ceph-mon[33679]: pgmap v5504: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 101 KiB/s wr, 24 op/s 2024-05-08T09:39:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:08 smithi070 ceph-mon[29591]: pgmap v5505: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:39:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:08 smithi172 ceph-mon[33377]: pgmap v5505: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:39:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:08 smithi194 ceph-mon[33679]: pgmap v5505: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:39:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:10 smithi070 ceph-mon[29591]: pgmap v5506: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:39:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:10 smithi070 ceph-mon[29591]: osdmap e421: 12 total, 12 up, 12 in 2024-05-08T09:39:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:10 smithi172 ceph-mon[33377]: pgmap v5506: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:39:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:10 smithi172 ceph-mon[33377]: osdmap e421: 12 total, 12 up, 12 in 2024-05-08T09:39:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:10 smithi194 ceph-mon[33679]: pgmap v5506: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:39:10.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:10 smithi194 ceph-mon[33679]: osdmap e421: 12 total, 12 up, 12 in 2024-05-08T09:39:12.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:12 smithi070 ceph-mon[29591]: pgmap v5508: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:39:12.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:12 smithi172 ceph-mon[33377]: pgmap v5508: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:39:12.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:12 smithi194 ceph-mon[33679]: pgmap v5508: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:39:14.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:14 smithi070 ceph-mon[29591]: pgmap v5509: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:39:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:14 smithi172 ceph-mon[33377]: pgmap v5509: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:39:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:14 smithi194 ceph-mon[33679]: pgmap v5509: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:39:15.593 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:39:16.119 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:39:16.527 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:16 smithi070 ceph-mon[29591]: pgmap v5510: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:39:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:16 smithi172 ceph-mon[33377]: pgmap v5510: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:39:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:16 smithi194 ceph-mon[33679]: pgmap v5510: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:39:18.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:17 smithi172 ceph-mon[33377]: osdmap e422: 12 total, 12 up, 12 in 2024-05-08T09:39:18.190 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:17 smithi070 ceph-mon[29591]: osdmap e422: 12 total, 12 up, 12 in 2024-05-08T09:39:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:17 smithi194 ceph-mon[33679]: osdmap e422: 12 total, 12 up, 12 in 2024-05-08T09:39:18.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.540+0000 7fcc3ce00700 1 -- 172.21.15.70:0/2751646464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc3810fc70 msgr2=0x7fcc38112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:18.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.540+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/2751646464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc3810fc70 0x7fcc38112080 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000b0a0 tx=0x7fcc3000b3b0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.540+0000 7fcc3ce00700 1 -- 172.21.15.70:0/2751646464 shutdown_connections 2024-05-08T09:39:18.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.540+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/2751646464 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc3810fc70 0x7fcc38112080 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.540+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/2751646464 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc38075870 0x7fcc38075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.540+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/2751646464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc38076190 0x7fcc3810f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.540+0000 7fcc3ce00700 1 -- 172.21.15.70:0/2751646464 >> 172.21.15.70:0/2751646464 conn(0x7fcc380fef20 msgr2=0x7fcc38101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:18.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.540+0000 7fcc3ce00700 1 -- 172.21.15.70:0/2751646464 shutdown_connections 2024-05-08T09:39:18.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.540+0000 7fcc3ce00700 1 -- 172.21.15.70:0/2751646464 wait complete. 2024-05-08T09:39:18.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.541+0000 7fcc3ce00700 1 Processor -- start 2024-05-08T09:39:18.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.542+0000 7fcc3ce00700 1 -- start start 2024-05-08T09:39:18.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.542+0000 7fcc3ce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc38075870 0x7fcc381a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:18.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.542+0000 7fcc3ce00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc38076190 0x7fcc381a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:18.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.542+0000 7fcc3ce00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc3810fc70 0x7fcc3819ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:18.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.542+0000 7fcc3ce00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcc381156c0 con 0x7fcc38075870 2024-05-08T09:39:18.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.542+0000 7fcc3ce00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38115540 con 0x7fcc3810fc70 2024-05-08T09:39:18.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.542+0000 7fcc3ce00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcc38115840 con 0x7fcc38076190 2024-05-08T09:39:18.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc38075870 0x7fcc381a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:18.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc38075870 0x7fcc381a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59082/0 (socket says 172.21.15.70:59082) 2024-05-08T09:39:18.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37400700 1 -- 172.21.15.70:0/1521076938 learned_addr learned my addr 172.21.15.70:0/1521076938 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:39:18.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37e00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc3810fc70 0x7fcc3819ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:18.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc2ea00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc38076190 0x7fcc381a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:18.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37400700 1 -- 172.21.15.70:0/1521076938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc38076190 msgr2=0x7fcc381a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:18.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37400700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc38076190 0x7fcc381a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37400700 1 -- 172.21.15.70:0/1521076938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc3810fc70 msgr2=0x7fcc3819ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:18.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37400700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc3810fc70 0x7fcc3819ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37400700 1 -- 172.21.15.70:0/1521076938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3819c180 con 0x7fcc38075870 2024-05-08T09:39:18.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc2ea00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc38076190 0x7fcc381a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:39:18.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.543+0000 7fcc37400700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc38075870 0x7fcc381a1810 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c920 tx=0x7fcc2800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:18.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.544+0000 7fcc34c00700 1 -- 172.21.15.70:0/1521076938 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28007b00 con 0x7fcc38075870 2024-05-08T09:39:18.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.544+0000 7fcc34c00700 1 -- 172.21.15.70:0/1521076938 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcc28004cc0 con 0x7fcc38075870 2024-05-08T09:39:18.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.544+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3819c470 con 0x7fcc38075870 2024-05-08T09:39:18.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.544+0000 7fcc34c00700 1 -- 172.21.15.70:0/1521076938 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc280054f0 con 0x7fcc38075870 2024-05-08T09:39:18.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.544+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc381a86e0 con 0x7fcc38075870 2024-05-08T09:39:18.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.545+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc3806a190 con 0x7fcc38075870 2024-05-08T09:39:18.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.547+0000 7fcc34c00700 1 -- 172.21.15.70:0/1521076938 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fcc28007ca0 con 0x7fcc38075870 2024-05-08T09:39:18.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.549+0000 7fcc34c00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc1c0b29f0 0x7fcc1c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:18.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.549+0000 7fcc34c00700 1 -- 172.21.15.70:0/1521076938 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(422..422 src has 1..422) ==== 9583+0+0 (secure 0 0 0) 0x7fcc280e26e0 con 0x7fcc38075870 2024-05-08T09:39:18.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.549+0000 7fcc2ea00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc1c0b29f0 0x7fcc1c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:18.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.550+0000 7fcc2ea00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc1c0b29f0 0x7fcc1c0b4eb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcc20005fd0 tx=0x7fcc20005d40 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:18.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.553+0000 7fcc34c00700 1 -- 172.21.15.70:0/1521076938 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcc28014030 con 0x7fcc38075870 2024-05-08T09:39:18.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.833+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc3819cf00 con 0x7fcc38075870 2024-05-08T09:39:18.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.835+0000 7fcc34c00700 1 -- 172.21.15.70:0/1521076938 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fcc280a9c40 con 0x7fcc38075870 2024-05-08T09:39:18.835 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:39:18.835 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:39:18.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc1c0b29f0 msgr2=0x7fcc1c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:18.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc1c0b29f0 0x7fcc1c0b4eb0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcc20005fd0 tx=0x7fcc20005d40 comp rx=0 tx=0).stop 2024-05-08T09:39:18.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc38075870 msgr2=0x7fcc381a1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:18.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc38075870 0x7fcc381a1810 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800c920 tx=0x7fcc2800cce0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 shutdown_connections 2024-05-08T09:39:18.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcc1c0b29f0 0x7fcc1c0b4eb0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcc3810fc70 0x7fcc3819ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcc38075870 0x7fcc381a1810 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 --2- 172.21.15.70:0/1521076938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc38076190 0x7fcc381a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:18.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.839+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 >> 172.21.15.70:0/1521076938 conn(0x7fcc380fef20 msgr2=0x7fcc380ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:18.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.840+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 shutdown_connections 2024-05-08T09:39:18.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:18.840+0000 7fcc3ce00700 1 -- 172.21.15.70:0/1521076938 wait complete. 2024-05-08T09:39:18.841 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:39:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:18 smithi070 ceph-mon[29591]: pgmap v5512: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T09:39:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:18 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1521076938' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:39:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:18 smithi194 ceph-mon[33679]: pgmap v5512: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T09:39:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:18 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1521076938' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:39:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:18 smithi172 ceph-mon[33377]: pgmap v5512: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T09:39:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:18 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1521076938' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:39:19.671 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 56781d91 --release --await' 2024-05-08T09:39:19.672 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 56781d91 --release --await 2024-05-08T09:39:20.129 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:39:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:20 smithi070 ceph-mon[29591]: pgmap v5513: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2024-05-08T09:39:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:20 smithi194 ceph-mon[33679]: pgmap v5513: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2024-05-08T09:39:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:20 smithi172 ceph-mon[33377]: pgmap v5513: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 207 B/s wr, 6 op/s 2024-05-08T09:39:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.528+0000 7f651ba00700 1 -- 172.21.15.70:0/1082815178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651410ff00 msgr2=0x7f65141122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.528+0000 7f651ba00700 1 --2- 172.21.15.70:0/1082815178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651410ff00 0x7f65141122f0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f650c00b0a0 tx=0x7f650c00b3b0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.529+0000 7f651ba00700 1 -- 172.21.15.70:0/1082815178 shutdown_connections 2024-05-08T09:39:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.529+0000 7f651ba00700 1 --2- 172.21.15.70:0/1082815178 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f651410ff00 0x7f65141122f0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.529+0000 7f651ba00700 1 --2- 172.21.15.70:0/1082815178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65140756d0 0x7f6514075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.529+0000 7f651ba00700 1 --2- 172.21.15.70:0/1082815178 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6514075ff0 0x7f651410f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.529+0000 7f651ba00700 1 -- 172.21.15.70:0/1082815178 >> 172.21.15.70:0/1082815178 conn(0x7f651407a5f0 msgr2=0x7f651407aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:22.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.529+0000 7f651ba00700 1 -- 172.21.15.70:0/1082815178 shutdown_connections 2024-05-08T09:39:22.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.529+0000 7f651ba00700 1 -- 172.21.15.70:0/1082815178 wait complete. 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.530+0000 7f651ba00700 1 Processor -- start 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.530+0000 7f651ba00700 1 -- start start 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.530+0000 7f651ba00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65140756d0 0x7f65141a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.530+0000 7f651ba00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6514075ff0 0x7f65141a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.530+0000 7f651ba00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f651410ff00 0x7f651419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.530+0000 7f651ba00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6514115810 con 0x7f6514075ff0 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.530+0000 7f651ba00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6514115690 con 0x7f651410ff00 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.530+0000 7f651ba00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6514115990 con 0x7f65140756d0 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.531+0000 7f6513e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6514075ff0 0x7f65141a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.531+0000 7f6513e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6514075ff0 0x7f65141a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59096/0 (socket says 172.21.15.70:59096) 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.531+0000 7f6513e00700 1 -- 172.21.15.70:0/1395680456 learned_addr learned my addr 172.21.15.70:0/1395680456 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.531+0000 7f6519a00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f651410ff00 0x7f651419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.531+0000 7f6513e00700 1 -- 172.21.15.70:0/1395680456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65140756d0 msgr2=0x7f65141a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.531+0000 7f6513e00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65140756d0 0x7f65141a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.531+0000 7f6513e00700 1 -- 172.21.15.70:0/1395680456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f651410ff00 msgr2=0x7f651419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.531+0000 7f6513e00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f651410ff00 0x7f651419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.531+0000 7f6513e00700 1 -- 172.21.15.70:0/1395680456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651419c2b0 con 0x7f6514075ff0 2024-05-08T09:39:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.532+0000 7f6513e00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6514075ff0 0x7f65141a1e80 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f650000b530 tx=0x7f650000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.532+0000 7f6511600700 1 -- 172.21.15.70:0/1395680456 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500015020 con 0x7f6514075ff0 2024-05-08T09:39:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.532+0000 7f6511600700 1 -- 172.21.15.70:0/1395680456 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6500011cc0 con 0x7f6514075ff0 2024-05-08T09:39:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.532+0000 7f651ba00700 1 -- 172.21.15.70:0/1395680456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651419c5a0 con 0x7f6514075ff0 2024-05-08T09:39:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.532+0000 7f6511600700 1 -- 172.21.15.70:0/1395680456 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6500010d30 con 0x7f6514075ff0 2024-05-08T09:39:22.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.532+0000 7f651ba00700 1 -- 172.21.15.70:0/1395680456 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65141a8810 con 0x7f6514075ff0 2024-05-08T09:39:22.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.536+0000 7f6511600700 1 -- 172.21.15.70:0/1395680456 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6500018020 con 0x7f6514075ff0 2024-05-08T09:39:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.537+0000 7f6511600700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64fc0b2a70 0x7f64fc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.537+0000 7f6511600700 1 -- 172.21.15.70:0/1395680456 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(422..422 src has 1..422) ==== 9583+0+0 (secure 0 0 0) 0x7f65000e21a0 con 0x7f6514075ff0 2024-05-08T09:39:22.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.537+0000 7f6519000700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64fc0b2a70 0x7f64fc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.538+0000 7f6519000700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64fc0b2a70 0x7f64fc0b4f30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6508005fd0 tx=0x7f6508005d00 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:22.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.551+0000 7f6526435b80 1 Processor -- start 2024-05-08T09:39:22.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.551+0000 7f6526435b80 1 -- start start 2024-05-08T09:39:22.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.551+0000 7f6526435b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e20062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.551+0000 7f6526435b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000490 0x5575e2000910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.551+0000 7f6526435b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e200cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.551+0000 7f6526435b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5575e1f52b20 con 0x5575e2000490 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.551+0000 7f6526435b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5575e1ef0860 con 0x5575e2000e50 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.551+0000 7f6526435b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5575e1f4eae0 con 0x5575e2005ec0 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6513e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000490 0x5575e2000910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6513e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000490 0x5575e2000910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59098/0 (socket says 172.21.15.70:59098) 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6513e00700 1 -- 172.21.15.70:0/2931257263 learned_addr learned my addr 172.21.15.70:0/2931257263 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6519000700 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e20062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6519a00700 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e200cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6513e00700 1 -- 172.21.15.70:0/2931257263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 msgr2=0x5575e20062a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6513e00700 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e20062a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6513e00700 1 -- 172.21.15.70:0/2931257263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 msgr2=0x5575e200cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:39:22.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6513e00700 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e200cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6513e00700 1 -- 172.21.15.70:0/2931257263 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e1e9f9d0 con 0x5575e2000490 2024-05-08T09:39:22.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.552+0000 7f6519a00700 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e200cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:39:22.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.553+0000 7f6513e00700 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000490 0x5575e2000910 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f65000a5190 tx=0x7f65000a8900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c2a27e416a0f1e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:22.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.553+0000 7f6506000700 1 -- 172.21.15.70:0/2931257263 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65000c3070 con 0x5575e2000490 2024-05-08T09:39:22.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.553+0000 7f6506000700 1 -- 172.21.15.70:0/2931257263 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65000a9810 con 0x5575e2000490 2024-05-08T09:39:22.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.553+0000 7f6506000700 1 -- 172.21.15.70:0/2931257263 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65000a9370 con 0x5575e2000490 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 -- 172.21.15.70:0/2931257263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000490 msgr2=0x5575e2000910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000490 0x5575e2000910 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f65000a5190 tx=0x7f65000a8900 comp rx=0 tx=0).stop 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 -- 172.21.15.70:0/2931257263 shutdown_connections 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e200cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e20062a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 --2- 172.21.15.70:0/2931257263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000490 0x5575e2000910 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 -- 172.21.15.70:0/2931257263 >> 172.21.15.70:0/2931257263 conn(0x5575e1f2ec60 msgr2=0x5575e1ffad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 -- 172.21.15.70:0/2931257263 shutdown_connections 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 -- 172.21.15.70:0/2931257263 wait complete. 2024-05-08T09:39:22.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.554+0000 7f6526435b80 1 -- start start 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.555+0000 7f6526435b80 1 Processor -- start 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.555+0000 7f6526435b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2000490 0x5575e200c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.555+0000 7f6526435b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e2009d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.555+0000 7f6526435b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2005ec0 0x5575e200a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.555+0000 7f6526435b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5575e200d280 con 0x5575e2005ec0 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.555+0000 7f6526435b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5575e1eb8c20 con 0x5575e2000e50 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.555+0000 7f6526435b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5575e200d400 con 0x5575e2000490 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.555+0000 7f6526435b80 10 client.0 _ll_register_callbacks cb 0x5575e1ef9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.555+0000 7f6519a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2005ec0 0x5575e200a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6519a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2005ec0 0x5575e200a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59112/0 (socket says 172.21.15.70:59112) 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6519a00700 1 -- 172.21.15.70:0/2339883220 learned_addr learned my addr 172.21.15.70:0/2339883220 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6513e00700 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e2009d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6519000700 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2000490 0x5575e200c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6519a00700 1 -- 172.21.15.70:0/2339883220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2000490 msgr2=0x5575e200c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:39:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6519a00700 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2000490 0x5575e200c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6519a00700 1 -- 172.21.15.70:0/2339883220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 msgr2=0x5575e2009d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:39:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6519a00700 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e2009d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6519a00700 1 -- 172.21.15.70:0/2339883220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e1f18520 con 0x5575e2005ec0 2024-05-08T09:39:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6513e00700 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e2009d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:39:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f6519a00700 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2005ec0 0x5575e200a2b0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f651406bd30 tx=0x7f650c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba7666127c9e7e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.556+0000 7f64faa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:39:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.557+0000 7f64faa00700 1 -- 172.21.15.70:0/2339883220 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c0076e0 con 0x5575e2005ec0 2024-05-08T09:39:22.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.557+0000 7f64faa00700 1 -- 172.21.15.70:0/2339883220 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(422..422 src has 1..422) ==== 9583+0+0 (secure 0 0 0) 0x7f650c007880 con 0x5575e2005ec0 2024-05-08T09:39:22.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.557+0000 7f6526435b80 1 -- 172.21.15.70:0/2339883220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65000a9810 con 0x5575e2005ec0 2024-05-08T09:39:22.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.557+0000 7f64faa00700 1 -- 172.21.15.70:0/2339883220 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f650c02f050 con 0x5575e2005ec0 2024-05-08T09:39:22.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.557+0000 7f6526435b80 10 client.19833 fetch_fsmap learned FSMap version 42 2024-05-08T09:39:22.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.557+0000 7f6526435b80 1 -- 172.21.15.70:0/2339883220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5575e2017b40 con 0x5575e2005ec0 2024-05-08T09:39:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.557+0000 7f64faa00700 1 -- 172.21.15.70:0/2339883220 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65000a9810 con 0x5575e2005ec0 2024-05-08T09:39:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.558+0000 7f64faa00700 1 -- 172.21.15.70:0/2339883220 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f650c011070 con 0x5575e2005ec0 2024-05-08T09:39:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.558+0000 7f6526435b80 10 client.19833 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:39:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.558+0000 7f6526435b80 10 client.19833 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:39:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.558+0000 7f6526435b80 20 client.19833 populate_metadata read hostname 'smithi070' 2024-05-08T09:39:22.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.558+0000 7f6526435b80 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575e201a180 0x5575e201c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.558+0000 7f6526435b80 4 client.19833 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:39:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.558+0000 7f6526435b80 1 -- 172.21.15.70:0/2339883220 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575e1fcd1a0 con 0x5575e201a180 2024-05-08T09:39:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.559+0000 7f6519000700 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575e201a180 0x5575e201c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.559+0000 7f6519000700 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575e201a180 0x5575e201c570 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=304ade5ac56d8c24 server_cookie=e9eb914ba9756467 in_seq=0 out_seq=0 2024-05-08T09:39:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.559+0000 7f64faa00700 10 client.19833 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:39:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.561+0000 7f64faa00700 1 -- 172.21.15.70:0/2339883220 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5575e1fcd1a0 con 0x5575e201a180 2024-05-08T09:39:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.561+0000 7f64faa00700 10 client.19833 handle_command_reply: tid=0 2024-05-08T09:39:22.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 client.19833 shutdown 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 -- 172.21.15.70:0/2339883220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2005ec0 msgr2=0x5575e200a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2005ec0 0x5575e200a2b0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f651406bd30 tx=0x7f650c004d30 comp rx=0 tx=0).stop 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 -- 172.21.15.70:0/2339883220 shutdown_connections 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575e201a180 0x5575e201c570 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2005ec0 0x5575e200a2b0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2000490 0x5575e200c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 --2- 172.21.15.70:0/2339883220 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000e50 0x5575e2009d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 -- 172.21.15.70:0/2339883220 >> 172.21.15.70:0/2339883220 conn(0x5575e1f2ec60 msgr2=0x5575e1ff5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f64faa00700 0 client.19833 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 -- 172.21.15.70:0/2339883220 shutdown_connections 2024-05-08T09:39:22.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 1 -- 172.21.15.70:0/2339883220 wait complete. 2024-05-08T09:39:22.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.562+0000 7f6526435b80 20 client.19833 trim_cache size 0 max 16384 2024-05-08T09:39:22.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.583+0000 7f6526435b80 1 Processor -- start 2024-05-08T09:39:22.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6526435b80 1 -- start start 2024-05-08T09:39:22.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6526435b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000490 0x5575e20162d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6526435b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e1ff56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6526435b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e2021dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6526435b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65141b4130 con 0x5575e2000e50 2024-05-08T09:39:22.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6526435b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65141b19c0 con 0x5575e2000490 2024-05-08T09:39:22.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6526435b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65141af830 con 0x5575e2005ec0 2024-05-08T09:39:22.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6513e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e1ff56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6513e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e1ff56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59122/0 (socket says 172.21.15.70:59122) 2024-05-08T09:39:22.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6513e00700 1 -- 172.21.15.70:0/2223060636 learned_addr learned my addr 172.21.15.70:0/2223060636 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:39:22.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6513e00700 1 -- 172.21.15.70:0/2223060636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 msgr2=0x5575e2021dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:39:22.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6513e00700 1 --2- 172.21.15.70:0/2223060636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e2021dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6513e00700 1 -- 172.21.15.70:0/2223060636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000490 msgr2=0x5575e20162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:39:22.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6513e00700 1 --2- 172.21.15.70:0/2223060636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000490 0x5575e20162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.584+0000 7f6513e00700 1 -- 172.21.15.70:0/2223060636 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e1ff7980 con 0x5575e2000e50 2024-05-08T09:39:22.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.585+0000 7f6513e00700 1 --2- 172.21.15.70:0/2223060636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e1ff56d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f65000a6380 tx=0x7f650000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed50032c8ad7f34 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.585+0000 7f6505600700 1 -- 172.21.15.70:0/2223060636 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65000c3040 con 0x5575e2000e50 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.585+0000 7f6505600700 1 -- 172.21.15.70:0/2223060636 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65000a9110 con 0x5575e2000e50 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.585+0000 7f6505600700 1 -- 172.21.15.70:0/2223060636 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65000a95d0 con 0x5575e2000e50 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 -- 172.21.15.70:0/2223060636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 msgr2=0x5575e1ff56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 --2- 172.21.15.70:0/2223060636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e1ff56d0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f65000a6380 tx=0x7f650000b480 comp rx=0 tx=0).stop 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 -- 172.21.15.70:0/2223060636 shutdown_connections 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 --2- 172.21.15.70:0/2223060636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e2021dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 --2- 172.21.15.70:0/2223060636 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000490 0x5575e20162d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 --2- 172.21.15.70:0/2223060636 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e1ff56d0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 -- 172.21.15.70:0/2223060636 >> 172.21.15.70:0/2223060636 conn(0x5575e1f2ec60 msgr2=0x5575e1ff4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 -- 172.21.15.70:0/2223060636 shutdown_connections 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 -- 172.21.15.70:0/2223060636 wait complete. 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.586+0000 7f6526435b80 1 -- start start 2024-05-08T09:39:22.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6526435b80 1 Processor -- start 2024-05-08T09:39:22.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6526435b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000490 0x5575e200d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6526435b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e200db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6526435b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e200e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6526435b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65141afe80 con 0x5575e2000e50 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6526435b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f65141b12f0 con 0x5575e2000490 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6526435b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f65141b0550 con 0x5575e2005ec0 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6526435b80 10 client.0 _ll_register_callbacks cb 0x5575e1ef9d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6513e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e200db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6513e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e200db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59128/0 (socket says 172.21.15.70:59128) 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.587+0000 7f6513e00700 1 -- 172.21.15.70:0/1171239668 learned_addr learned my addr 172.21.15.70:0/1171239668 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6519000700 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000490 0x5575e200d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6519a00700 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e200e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6513e00700 1 -- 172.21.15.70:0/1171239668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 msgr2=0x5575e200e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6513e00700 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e200e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6513e00700 1 -- 172.21.15.70:0/1171239668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000490 msgr2=0x5575e200d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:39:22.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6513e00700 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000490 0x5575e200d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6513e00700 1 -- 172.21.15.70:0/1171239668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e2084b80 con 0x5575e2000e50 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6519a00700 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e200e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6513e00700 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e200db50 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f65000a5190 tx=0x7f65000a8900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b4edaa39ee6190 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f64faa00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f64faa00700 1 -- 172.21.15.70:0/1171239668 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65000c3070 con 0x5575e2000e50 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f64faa00700 1 -- 172.21.15.70:0/1171239668 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(422..422 src has 1..422) ==== 9583+0+0 (secure 0 0 0) 0x7f65000a5700 con 0x5575e2000e50 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.588+0000 7f6526435b80 1 -- 172.21.15.70:0/1171239668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5575e1f60500 con 0x5575e2000e50 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f64faa00700 1 -- 172.21.15.70:0/1171239668 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f650008c050 con 0x5575e2000e50 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f6526435b80 10 client.19839 fetch_fsmap learned FSMap version 42 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f6526435b80 1 -- 172.21.15.70:0/1171239668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5575e2085e80 con 0x5575e2000e50 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f64faa00700 1 -- 172.21.15.70:0/1171239668 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5575e1f60500 con 0x5575e2000e50 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f64faa00700 1 -- 172.21.15.70:0/1171239668 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f65000dfbc0 con 0x5575e2000e50 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f6526435b80 10 client.19839 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f6526435b80 10 client.19839 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:39:22.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f6526435b80 20 client.19839 populate_metadata read hostname 'smithi070' 2024-05-08T09:39:22.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f6526435b80 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575e2086050 0x5575e2088440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:22.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f6526435b80 4 client.19839 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "56781d91", "release": true, "await": true}] 2024-05-08T09:39:22.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.589+0000 7f6526435b80 1 -- 172.21.15.70:0/1171239668 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "56781d91", "release": true, "await": true}) -- 0x5575e1f5a5a0 con 0x5575e2086050 2024-05-08T09:39:22.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.590+0000 7f6519000700 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575e2086050 0x5575e2088440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:22.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.591+0000 7f6519000700 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575e2086050 0x5575e2088440 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=551dbefed357109e server_cookie=ffa1b2d82346546f in_seq=0 out_seq=0 2024-05-08T09:39:22.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:22.591+0000 7f64faa00700 10 client.19839 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:39:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:22 smithi194 ceph-mon[33679]: pgmap v5514: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:39:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:22 smithi070 ceph-mon[29591]: pgmap v5514: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:39:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:22 smithi172 ceph-mon[33377]: pgmap v5514: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:39:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:24 smithi194 ceph-mon[33679]: pgmap v5515: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:39:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:24 smithi070 ceph-mon[29591]: pgmap v5515: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:39:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:24 smithi172 ceph-mon[33377]: pgmap v5515: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:39:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:26 smithi194 ceph-mon[33679]: pgmap v5516: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:39:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.268+0000 7f64faa00700 1 -- 172.21.15.70:0/1171239668 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5575e1f5a5a0 con 0x5575e2086050 2024-05-08T09:39:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.268+0000 7f64faa00700 10 client.19839 handle_command_reply: tid=0 2024-05-08T09:39:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.268+0000 7f6526435b80 1 client.19839 shutdown 2024-05-08T09:39:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.268+0000 7f6526435b80 1 -- 172.21.15.70:0/1171239668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 msgr2=0x5575e200db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.268+0000 7f6526435b80 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e200db50 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f65000a5190 tx=0x7f65000a8900 comp rx=0 tx=0).stop 2024-05-08T09:39:27.268 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:26 smithi070 ceph-mon[29591]: pgmap v5516: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:39:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.269+0000 7f6526435b80 1 -- 172.21.15.70:0/1171239668 shutdown_connections 2024-05-08T09:39:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.269+0000 7f6526435b80 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5575e2086050 0x5575e2088440 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.269+0000 7f6526435b80 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5575e2005ec0 0x5575e200e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.269+0000 7f6526435b80 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5575e2000490 0x5575e200d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.269+0000 7f6526435b80 1 --2- 172.21.15.70:0/1171239668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5575e2000e50 0x5575e200db50 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.269+0000 7f6526435b80 1 -- 172.21.15.70:0/1171239668 >> 172.21.15.70:0/1171239668 conn(0x5575e1f2ec60 msgr2=0x5575e1ff5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.269+0000 7f64faa00700 0 client.19839 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:39:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.269+0000 7f6526435b80 1 -- 172.21.15.70:0/1171239668 shutdown_connections 2024-05-08T09:39:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.269+0000 7f6526435b80 1 -- 172.21.15.70:0/1171239668 wait complete. 2024-05-08T09:39:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.270+0000 7f6526435b80 20 client.19839 trim_cache size 0 max 16384 2024-05-08T09:39:27.270 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:39:27.270 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:39:27.270 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:39:27.270 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 376, 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "56781d91": { 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 376, 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 73.9, 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:39:27.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:39:27.272 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:39:27.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:27.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:27.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:27.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:27.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:39:27.272 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:39:27.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.271+0000 7f651ba00700 1 -- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64fc0b2a70 msgr2=0x7f64fc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.271+0000 7f651ba00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64fc0b2a70 0x7f64fc0b4f30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6508005fd0 tx=0x7f6508005d00 comp rx=0 tx=0).stop 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.271+0000 7f651ba00700 1 -- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6514075ff0 msgr2=0x7f65141a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.271+0000 7f651ba00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6514075ff0 0x7f65141a1e80 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f650000b530 tx=0x7f650000b8f0 comp rx=0 tx=0).stop 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.272+0000 7f651ba00700 1 -- 172.21.15.70:0/1395680456 shutdown_connections 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.272+0000 7f651ba00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64fc0b2a70 0x7f64fc0b4f30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.272+0000 7f651ba00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f651410ff00 0x7f651419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.272+0000 7f651ba00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65140756d0 0x7f65141a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.272+0000 7f651ba00700 1 --2- 172.21.15.70:0/1395680456 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6514075ff0 0x7f65141a1e80 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.272+0000 7f651ba00700 1 -- 172.21.15.70:0/1395680456 >> 172.21.15.70:0/1395680456 conn(0x7f651407a5f0 msgr2=0x7f6514100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.272+0000 7f651ba00700 1 -- 172.21.15.70:0/1395680456 shutdown_connections 2024-05-08T09:39:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:27.272+0000 7f651ba00700 1 -- 172.21.15.70:0/1395680456 wait complete. 2024-05-08T09:39:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:26 smithi172 ceph-mon[33377]: pgmap v5516: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:39:28.267 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '56781d91', seconds elapsed: 59.1 2024-05-08T09:39:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:28 smithi194 ceph-mon[33679]: pgmap v5517: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:39:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:28 smithi070 ceph-mon[29591]: pgmap v5517: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:39:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:28 smithi172 ceph-mon[33377]: pgmap v5517: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 99 B/s wr, 6 op/s 2024-05-08T09:39:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:30 smithi194 ceph-mon[33679]: pgmap v5518: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:39:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:30 smithi070 ceph-mon[29591]: pgmap v5518: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:39:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:30 smithi172 ceph-mon[33377]: pgmap v5518: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:39:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:32 smithi194 ceph-mon[33679]: pgmap v5519: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:32 smithi070 ceph-mon[29591]: pgmap v5519: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:32 smithi172 ceph-mon[33377]: pgmap v5519: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:34 smithi194 ceph-mon[33679]: pgmap v5520: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:34 smithi070 ceph-mon[29591]: pgmap v5520: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:34 smithi172 ceph-mon[33377]: pgmap v5520: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:36 smithi194 ceph-mon[33679]: pgmap v5521: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:36 smithi070 ceph-mon[29591]: pgmap v5521: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:36 smithi172 ceph-mon[33377]: pgmap v5521: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:38 smithi194 ceph-mon[33679]: pgmap v5522: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:38 smithi070 ceph-mon[29591]: pgmap v5522: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:38 smithi172 ceph-mon[33377]: pgmap v5522: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:41 smithi194 ceph-mon[33679]: pgmap v5523: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:41 smithi070 ceph-mon[29591]: pgmap v5523: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:41 smithi172 ceph-mon[33377]: pgmap v5523: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:43 smithi194 ceph-mon[33679]: pgmap v5524: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:43 smithi070 ceph-mon[29591]: pgmap v5524: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:43 smithi172 ceph-mon[33377]: pgmap v5524: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:45 smithi070 ceph-mon[29591]: pgmap v5525: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:45 smithi172 ceph-mon[33377]: pgmap v5525: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:45 smithi194 ceph-mon[33679]: pgmap v5525: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:47 smithi070 ceph-mon[29591]: pgmap v5526: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:47 smithi172 ceph-mon[33377]: pgmap v5526: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:47 smithi194 ceph-mon[33679]: pgmap v5526: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:49 smithi070 ceph-mon[29591]: pgmap v5527: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:49 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:39:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:49 smithi172 ceph-mon[33377]: pgmap v5527: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:49 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:39:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:49 smithi194 ceph-mon[33679]: pgmap v5527: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:49 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:39:50.312 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:39:50.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:39:50.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:39:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:39:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:39:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:39:50.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:39:50.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:39:50.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:39:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:51 smithi070 ceph-mon[29591]: pgmap v5528: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:51 smithi172 ceph-mon[33377]: pgmap v5528: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:51 smithi194 ceph-mon[33679]: pgmap v5528: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:52 smithi070 ceph-mon[29591]: pgmap v5529: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:52 smithi172 ceph-mon[33377]: pgmap v5529: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:52 smithi194 ceph-mon[33679]: pgmap v5529: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:54.083 INFO:tasks.quiescer.fs.[cephfs]:Total duration (56.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T09:39:54.083 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.3 2024-05-08T09:39:54.083 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:39:54.576 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:39:54.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:54 smithi070 ceph-mon[29591]: pgmap v5530: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:54.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:54 smithi172 ceph-mon[33377]: pgmap v5530: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:54 smithi194 ceph-mon[33679]: pgmap v5530: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:56.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:56 smithi070 ceph-mon[29591]: pgmap v5531: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:56.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:56 smithi172 ceph-mon[33377]: pgmap v5531: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:56 smithi194 ceph-mon[33679]: pgmap v5531: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:39:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.846+0000 7fcf99a00700 1 -- 172.21.15.70:0/1331411266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 msgr2=0x7fcf94109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.846+0000 7fcf99a00700 1 --2- 172.21.15.70:0/1331411266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 0x7fcf94109840 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009990 tx=0x7fcf84009ca0 comp rx=0 tx=0).stop 2024-05-08T09:39:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.846+0000 7fcf99a00700 1 -- 172.21.15.70:0/1331411266 shutdown_connections 2024-05-08T09:39:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.846+0000 7fcf99a00700 1 --2- 172.21.15.70:0/1331411266 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf94103d90 0x7fcf941102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.846+0000 7fcf99a00700 1 --2- 172.21.15.70:0/1331411266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 0x7fcf94109840 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.846+0000 7fcf99a00700 1 --2- 172.21.15.70:0/1331411266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf941033d0 0x7fcf94103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.846+0000 7fcf99a00700 1 -- 172.21.15.70:0/1331411266 >> 172.21.15.70:0/1331411266 conn(0x7fcf940fef20 msgr2=0x7fcf94101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.846+0000 7fcf99a00700 1 -- 172.21.15.70:0/1331411266 shutdown_connections 2024-05-08T09:39:57.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.846+0000 7fcf99a00700 1 -- 172.21.15.70:0/1331411266 wait complete. 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.847+0000 7fcf99a00700 1 Processor -- start 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.848+0000 7fcf99a00700 1 -- start start 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.848+0000 7fcf99a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf941033d0 0x7fcf940757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.848+0000 7fcf99a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94103d90 0x7fcf94075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.848+0000 7fcf99a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 0x7fcf94076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.848+0000 7fcf99a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94113420 con 0x7fcf94109460 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.848+0000 7fcf99a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941132a0 con 0x7fcf941033d0 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.848+0000 7fcf99a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcf941135a0 con 0x7fcf94103d90 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf99000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 0x7fcf94076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf99000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 0x7fcf94076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34180/0 (socket says 172.21.15.70:34180) 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf99000700 1 -- 172.21.15.70:0/2284866484 learned_addr learned my addr 172.21.15.70:0/2284866484 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf93400700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94103d90 0x7fcf94075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:57.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf93e00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf941033d0 0x7fcf940757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:57.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf99000700 1 -- 172.21.15.70:0/2284866484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94103d90 msgr2=0x7fcf94075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:57.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf99000700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94103d90 0x7fcf94075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:57.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf99000700 1 -- 172.21.15.70:0/2284866484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf941033d0 msgr2=0x7fcf940757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:57.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf99000700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf941033d0 0x7fcf940757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf99000700 1 -- 172.21.15.70:0/2284866484 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf941a7eb0 con 0x7fcf94109460 2024-05-08T09:39:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.849+0000 7fcf93e00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf941033d0 0x7fcf940757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:39:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.850+0000 7fcf99000700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 0x7fcf94076220 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c007ee0 tx=0x7fcf8c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.850+0000 7fcf90c00700 1 -- 172.21.15.70:0/2284866484 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c00dbd0 con 0x7fcf94109460 2024-05-08T09:39:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.850+0000 7fcf90c00700 1 -- 172.21.15.70:0/2284866484 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf8c00dd70 con 0x7fcf94109460 2024-05-08T09:39:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.850+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf941a81a0 con 0x7fcf94109460 2024-05-08T09:39:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.850+0000 7fcf90c00700 1 -- 172.21.15.70:0/2284866484 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0058d0 con 0x7fcf94109460 2024-05-08T09:39:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.850+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf941a86e0 con 0x7fcf94109460 2024-05-08T09:39:57.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.851+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9406a190 con 0x7fcf94109460 2024-05-08T09:39:57.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.854+0000 7fcf90c00700 1 -- 172.21.15.70:0/2284866484 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fcf8c01a020 con 0x7fcf94109460 2024-05-08T09:39:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.856+0000 7fcf90c00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf780b29f0 0x7fcf780b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:39:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.856+0000 7fcf90c00700 1 -- 172.21.15.70:0/2284866484 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(422..422 src has 1..422) ==== 9583+0+0 (secure 0 0 0) 0x7fcf8c0e28f0 con 0x7fcf94109460 2024-05-08T09:39:57.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.856+0000 7fcf93e00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf780b29f0 0x7fcf780b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:39:57.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.857+0000 7fcf93e00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf780b29f0 0x7fcf780b4eb0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400b5c0 tx=0x7fcf8401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:39:57.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:57.859+0000 7fcf90c00700 1 -- 172.21.15.70:0/2284866484 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcf8c010070 con 0x7fcf94109460 2024-05-08T09:39:58.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.191+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf94076c80 con 0x7fcf94109460 2024-05-08T09:39:58.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.192+0000 7fcf90c00700 1 -- 172.21.15.70:0/2284866484 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fcf8c0a9e50 con 0x7fcf94109460 2024-05-08T09:39:58.190 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:39:58.191 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:39:58.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf780b29f0 msgr2=0x7fcf780b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf780b29f0 0x7fcf780b4eb0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400b5c0 tx=0x7fcf8401a040 comp rx=0 tx=0).stop 2024-05-08T09:39:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 msgr2=0x7fcf94076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:39:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 0x7fcf94076220 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c007ee0 tx=0x7fcf8c00d3b0 comp rx=0 tx=0).stop 2024-05-08T09:39:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 shutdown_connections 2024-05-08T09:39:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf780b29f0 0x7fcf780b4eb0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf94109460 0x7fcf94076220 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:58.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf941033d0 0x7fcf940757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 --2- 172.21.15.70:0/2284866484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf94103d90 0x7fcf94075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:39:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 >> 172.21.15.70:0/2284866484 conn(0x7fcf940fef20 msgr2=0x7fcf940ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:39:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 shutdown_connections 2024-05-08T09:39:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:39:58.196+0000 7fcf99a00700 1 -- 172.21.15.70:0/2284866484 wait complete. 2024-05-08T09:39:58.195 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:39:58.580 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:58 smithi070 ceph-mon[29591]: pgmap v5532: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:58.580 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:39:58 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2284866484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:39:58.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:58 smithi172 ceph-mon[33377]: pgmap v5532: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:58.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:39:58 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2284866484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:39:58.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:58 smithi194 ceph-mon[33679]: pgmap v5532: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:39:58.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:39:58 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2284866484' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:39:59.529 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 88.3 --await-for 42.0' 2024-05-08T09:39:59.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 88.3 --await-for 42.0 2024-05-08T09:40:00.007 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:40:00.444 INFO:tasks.workunit.client.0.smithi070.stdout: OBJCOPY modules.builtin.modinfo 2024-05-08T09:40:00.530 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:00 smithi070 ceph-mon[29591]: pgmap v5533: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:40:00.531 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T09:40:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:00 smithi172 ceph-mon[33377]: pgmap v5533: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:40:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T09:40:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:00 smithi194 ceph-mon[33679]: pgmap v5533: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:40:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T09:40:01.654 INFO:tasks.workunit.client.0.smithi070.stdout: GEN modules.builtin 2024-05-08T09:40:01.818 INFO:tasks.workunit.client.0.smithi070.stdout: MODPOST Module.symvers 2024-05-08T09:40:02.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.260+0000 7f9aba800700 1 -- 172.21.15.70:0/307527579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 msgr2=0x7f9ab4101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:02.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.260+0000 7f9aba800700 1 --2- 172.21.15.70:0/307527579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 0x7f9ab4101f10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009990 tx=0x7f9aa0009ca0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.261+0000 7f9aba800700 1 -- 172.21.15.70:0/307527579 shutdown_connections 2024-05-08T09:40:02.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.261+0000 7f9aba800700 1 --2- 172.21.15.70:0/307527579 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ab4102450 0x7f9ab41103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.261+0000 7f9aba800700 1 --2- 172.21.15.70:0/307527579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ab4108460 0x7f9ab4108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.261+0000 7f9aba800700 1 --2- 172.21.15.70:0/307527579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 0x7f9ab4101f10 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.261+0000 7f9aba800700 1 -- 172.21.15.70:0/307527579 >> 172.21.15.70:0/307527579 conn(0x7f9ab4078a40 msgr2=0x7f9ab40ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:40:02.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.261+0000 7f9aba800700 1 -- 172.21.15.70:0/307527579 shutdown_connections 2024-05-08T09:40:02.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.261+0000 7f9aba800700 1 -- 172.21.15.70:0/307527579 wait complete. 2024-05-08T09:40:02.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.262+0000 7f9aba800700 1 Processor -- start 2024-05-08T09:40:02.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.262+0000 7f9aba800700 1 -- start start 2024-05-08T09:40:02.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.262+0000 7f9aba800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 0x7f9ab4102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.262+0000 7f9aba800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ab4102450 0x7f9ab41031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.262+0000 7f9aba800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ab4108460 0x7f9ab41036f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9aba800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab41135d0 con 0x7f9ab4101a90 2024-05-08T09:40:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9aba800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab4113450 con 0x7f9ab4108460 2024-05-08T09:40:02.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9aba800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab4113750 con 0x7f9ab4102450 2024-05-08T09:40:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9ab3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 0x7f9ab4102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9ab3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 0x7f9ab4102c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34202/0 (socket says 172.21.15.70:34202) 2024-05-08T09:40:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9ab3400700 1 -- 172.21.15.70:0/1842756398 learned_addr learned my addr 172.21.15.70:0/1842756398 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:40:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ab4102450 0x7f9ab41031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9ab3e00700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ab4108460 0x7f9ab41036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9ab3400700 1 -- 172.21.15.70:0/1842756398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ab4102450 msgr2=0x7f9ab41031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.263+0000 7f9ab3400700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ab4102450 0x7f9ab41031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.264+0000 7f9ab3400700 1 -- 172.21.15.70:0/1842756398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ab4108460 msgr2=0x7f9ab41036f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.264+0000 7f9ab3400700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ab4108460 0x7f9ab41036f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.264+0000 7f9ab3400700 1 -- 172.21.15.70:0/1842756398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab41a7f90 con 0x7f9ab4101a90 2024-05-08T09:40:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.264+0000 7f9ab3400700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 0x7f9ab4102c70 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400b530 tx=0x7f9aa400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:40:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.264+0000 7f9aabe00700 1 -- 172.21.15.70:0/1842756398 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4015020 con 0x7f9ab4101a90 2024-05-08T09:40:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.264+0000 7f9aabe00700 1 -- 172.21.15.70:0/1842756398 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa4011cc0 con 0x7f9ab4101a90 2024-05-08T09:40:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.264+0000 7f9aba800700 1 -- 172.21.15.70:0/1842756398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab41a8280 con 0x7f9ab4101a90 2024-05-08T09:40:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.264+0000 7f9aabe00700 1 -- 172.21.15.70:0/1842756398 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4010d30 con 0x7f9ab4101a90 2024-05-08T09:40:02.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.264+0000 7f9aba800700 1 -- 172.21.15.70:0/1842756398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab41a8770 con 0x7f9ab4101a90 2024-05-08T09:40:02.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.269+0000 7f9aabe00700 1 -- 172.21.15.70:0/1842756398 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9aa4018020 con 0x7f9ab4101a90 2024-05-08T09:40:02.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.270+0000 7f9aabe00700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a980b2aa0 0x7f9a980b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.271+0000 7f9aabe00700 1 -- 172.21.15.70:0/1842756398 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(422..422 src has 1..422) ==== 9583+0+0 (secure 0 0 0) 0x7f9aa40e21b0 con 0x7f9ab4101a90 2024-05-08T09:40:02.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.271+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a980b2aa0 0x7f9a980b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.272+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a980b2aa0 0x7f9a980b4f60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0006010 tx=0x7f9aa001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:40:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.291+0000 7f9ac517ab80 1 Processor -- start 2024-05-08T09:40:02.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.291+0000 7f9ac517ab80 1 -- start start 2024-05-08T09:40:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.291+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d5a240 0x556380d5a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.291+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 0x556380d54c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.291+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d551d0 0x556380d61000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.291+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556380ca6bb0 con 0x556380d5a240 2024-05-08T09:40:02.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.291+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556380c448f0 con 0x556380d54810 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.291+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556380ca2b70 con 0x556380d551d0 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d5a240 0x556380d5a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d5a240 0x556380d5a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34204/0 (socket says 172.21.15.70:34204) 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab3400700 1 -- 172.21.15.70:0/1871644212 learned_addr learned my addr 172.21.15.70:0/1871644212 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab3e00700 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d551d0 0x556380d61000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 0x556380d54c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab3400700 1 -- 172.21.15.70:0/1871644212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d551d0 msgr2=0x556380d61000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab3400700 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d551d0 0x556380d61000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab3400700 1 -- 172.21.15.70:0/1871644212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 msgr2=0x556380d54c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab3400700 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 0x556380d54c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab3400700 1 -- 172.21.15.70:0/1871644212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556380bf3a60 con 0x556380d5a240 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.292+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 0x556380d54c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:40:02.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.293+0000 7f9ab3400700 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d5a240 0x556380d5a620 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40a5200 tx=0x7f9aa40a89f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8f8aeb33951d03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.293+0000 7f9aa8c00700 1 -- 172.21.15.70:0/1871644212 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40a9180 con 0x556380d5a240 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.293+0000 7f9aa8c00700 1 -- 172.21.15.70:0/1871644212 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa40ad530 con 0x556380d5a240 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.293+0000 7f9aa8c00700 1 -- 172.21.15.70:0/1871644212 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40b1b50 con 0x556380d5a240 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.294+0000 7f9ac517ab80 1 -- 172.21.15.70:0/1871644212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d5a240 msgr2=0x556380d5a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.294+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d5a240 0x556380d5a620 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40a5200 tx=0x7f9aa40a89f0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.294+0000 7f9ac517ab80 1 -- 172.21.15.70:0/1871644212 shutdown_connections 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.294+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d551d0 0x556380d61000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.294+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d5a240 0x556380d5a620 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.294+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/1871644212 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 0x556380d54c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.294+0000 7f9ac517ab80 1 -- 172.21.15.70:0/1871644212 >> 172.21.15.70:0/1871644212 conn(0x556380ccc860 msgr2=0x556380d4f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.294+0000 7f9ac517ab80 1 -- 172.21.15.70:0/1871644212 shutdown_connections 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.294+0000 7f9ac517ab80 1 -- 172.21.15.70:0/1871644212 wait complete. 2024-05-08T09:40:02.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.295+0000 7f9ac517ab80 1 -- start start 2024-05-08T09:40:02.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.295+0000 7f9ac517ab80 1 Processor -- start 2024-05-08T09:40:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.295+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d60c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.295+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 0x556380d5dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.295+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d5e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.295+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556380d61600 con 0x556380d54810 2024-05-08T09:40:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.295+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556380c0ccb0 con 0x556380d551d0 2024-05-08T09:40:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.295+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556380d61780 con 0x556380d5a240 2024-05-08T09:40:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.295+0000 7f9ac517ab80 10 client.0 _ll_register_callbacks cb 0x556380c4de00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:40:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d60c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d60c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34208/0 (socket says 172.21.15.70:34208) 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab3400700 1 -- 172.21.15.70:0/3384247637 learned_addr learned my addr 172.21.15.70:0/3384247637 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 0x556380d5dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab3e00700 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d5e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab3400700 1 -- 172.21.15.70:0/3384247637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 msgr2=0x556380d5e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab3400700 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d5e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab3400700 1 -- 172.21.15.70:0/3384247637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 msgr2=0x556380d5dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab3400700 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 0x556380d5dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.296+0000 7f9ab3400700 1 -- 172.21.15.70:0/3384247637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556380c6c5b0 con 0x556380d54810 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.297+0000 7f9ab3400700 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d60c40 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40df6a0 tx=0x7f9aa40ad3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806372c4807c098a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.297+0000 7f9a9d600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.297+0000 7f9a9d600700 1 -- 172.21.15.70:0/3384247637 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa406c020 con 0x556380d54810 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.297+0000 7f9a9d600700 1 -- 172.21.15.70:0/3384247637 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(422..422 src has 1..422) ==== 9583+0+0 (secure 0 0 0) 0x7f9aa40a95f0 con 0x556380d54810 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.297+0000 7f9ac517ab80 1 -- 172.21.15.70:0/3384247637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aa40ad530 con 0x556380d54810 2024-05-08T09:40:02.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.297+0000 7f9a9d600700 1 -- 172.21.15.70:0/3384247637 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9aa40a9180 con 0x556380d54810 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.297+0000 7f9ac517ab80 10 client.19857 fetch_fsmap learned FSMap version 42 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.297+0000 7f9ac517ab80 1 -- 172.21.15.70:0/3384247637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x556380d61600 con 0x556380d54810 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.298+0000 7f9a9d600700 1 -- 172.21.15.70:0/3384247637 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa40ad530 con 0x556380d54810 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.298+0000 7f9a9d600700 1 -- 172.21.15.70:0/3384247637 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9aa4068ba0 con 0x556380d54810 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.298+0000 7f9ac517ab80 10 client.19857 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.298+0000 7f9ac517ab80 10 client.19857 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.298+0000 7f9ac517ab80 20 client.19857 populate_metadata read hostname 'smithi070' 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.298+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556380d6e0b0 0x556380d704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.298+0000 7f9ac517ab80 4 client.19857 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:40:02.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.298+0000 7f9ac517ab80 1 -- 172.21.15.70:0/3384247637 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556380d212d0 con 0x556380d6e0b0 2024-05-08T09:40:02.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.299+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556380d6e0b0 0x556380d704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.300+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556380d6e0b0 0x556380d704a0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcbd1596d0b85808 server_cookie=7217deb331ddb604 in_seq=0 out_seq=0 2024-05-08T09:40:02.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.300+0000 7f9a9d600700 10 client.19857 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:40:02.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9a9d600700 1 -- 172.21.15.70:0/3384247637 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556380d212d0 con 0x556380d6e0b0 2024-05-08T09:40:02.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9a9d600700 10 client.19857 handle_command_reply: tid=0 2024-05-08T09:40:02.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 client.19857 shutdown 2024-05-08T09:40:02.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 -- 172.21.15.70:0/3384247637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 msgr2=0x556380d60c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:02.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d60c40 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40df6a0 tx=0x7f9aa40ad3d0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 -- 172.21.15.70:0/3384247637 shutdown_connections 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556380d6e0b0 0x556380d704a0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d5e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d60c40 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/3384247637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 0x556380d5dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 -- 172.21.15.70:0/3384247637 >> 172.21.15.70:0/3384247637 conn(0x556380ccc860 msgr2=0x556380d49bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9a9d600700 0 client.19857 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 -- 172.21.15.70:0/3384247637 shutdown_connections 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.302+0000 7f9ac517ab80 1 -- 172.21.15.70:0/3384247637 wait complete. 2024-05-08T09:40:02.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.303+0000 7f9ac517ab80 20 client.19857 trim_cache size 0 max 16384 2024-05-08T09:40:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.325+0000 7f9ac517ab80 1 Processor -- start 2024-05-08T09:40:02.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.325+0000 7f9ac517ab80 1 -- start start 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.325+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d6a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.325+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 0x556380d49340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.325+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d49880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.325+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab41b40a0 con 0x556380d54810 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.325+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab41b1930 con 0x556380d551d0 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.325+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab41af7a0 con 0x556380d5a240 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d6a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab3400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d6a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34222/0 (socket says 172.21.15.70:34222) 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab3400700 1 -- 172.21.15.70:0/211145482 learned_addr learned my addr 172.21.15.70:0/211145482 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:40:02.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/211145482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 0x556380d49340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab3e00700 1 --2- 172.21.15.70:0/211145482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d49880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab3400700 1 -- 172.21.15.70:0/211145482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 msgr2=0x556380d49880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:40:02.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab3400700 1 --2- 172.21.15.70:0/211145482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d49880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab3400700 1 -- 172.21.15.70:0/211145482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 msgr2=0x556380d49340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:40:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab3400700 1 --2- 172.21.15.70:0/211145482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 0x556380d49340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.326+0000 7f9ab3400700 1 -- 172.21.15.70:0/211145482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556380d60880 con 0x556380d54810 2024-05-08T09:40:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.327+0000 7f9ab3400700 1 --2- 172.21.15.70:0/211145482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d6a690 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40a9110 tx=0x7f9aa4011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3c9d723a1994c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:40:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.327+0000 7f9a9fe00700 1 -- 172.21.15.70:0/211145482 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa406c070 con 0x556380d54810 2024-05-08T09:40:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.327+0000 7f9a9fe00700 1 -- 172.21.15.70:0/211145482 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa40ad530 con 0x556380d54810 2024-05-08T09:40:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.327+0000 7f9a9fe00700 1 -- 172.21.15.70:0/211145482 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4068ba0 con 0x556380d54810 2024-05-08T09:40:02.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.328+0000 7f9ac517ab80 1 -- 172.21.15.70:0/211145482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 msgr2=0x556380d6a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.328+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/211145482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d6a690 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f9aa40a9110 tx=0x7f9aa4011e70 comp rx=0 tx=0).stop 2024-05-08T09:40:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.328+0000 7f9ac517ab80 1 -- 172.21.15.70:0/211145482 shutdown_connections 2024-05-08T09:40:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.328+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/211145482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d49880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.328+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/211145482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d54810 0x556380d6a690 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.328+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/211145482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d551d0 0x556380d49340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.328+0000 7f9ac517ab80 1 -- 172.21.15.70:0/211145482 >> 172.21.15.70:0/211145482 conn(0x556380ccc860 msgr2=0x556380d54090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:40:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.328+0000 7f9ac517ab80 1 -- 172.21.15.70:0/211145482 shutdown_connections 2024-05-08T09:40:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.329+0000 7f9ac517ab80 1 -- 172.21.15.70:0/211145482 wait complete. 2024-05-08T09:40:02.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.329+0000 7f9ac517ab80 1 -- start start 2024-05-08T09:40:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.329+0000 7f9ac517ab80 1 Processor -- start 2024-05-08T09:40:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 0x556380d66e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d551d0 0x556380d639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ac517ab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d63f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab41afdf0 con 0x556380d551d0 2024-05-08T09:40:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab41b1260 con 0x556380d54810 2024-05-08T09:40:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ac517ab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab41b04c0 con 0x556380d5a240 2024-05-08T09:40:02.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ac517ab80 10 client.0 _ll_register_callbacks cb 0x556380d59d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:40:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ab2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d551d0 0x556380d639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ab2a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d551d0 0x556380d639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34226/0 (socket says 172.21.15.70:34226) 2024-05-08T09:40:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.330+0000 7f9ab2a00700 1 -- 172.21.15.70:0/2531043508 learned_addr learned my addr 172.21.15.70:0/2531043508 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:40:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9ab3400700 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 0x556380d66e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9ab3e00700 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d63f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9ab2a00700 1 -- 172.21.15.70:0/2531043508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 msgr2=0x556380d63f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:40:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d63f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9ab2a00700 1 -- 172.21.15.70:0/2531043508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 msgr2=0x556380d66e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:40:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 0x556380d66e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9ab2a00700 1 -- 172.21.15.70:0/2531043508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556380d645f0 con 0x556380d551d0 2024-05-08T09:40:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9ab3e00700 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d63f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:40:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9ab2a00700 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d551d0 0x556380d639e0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0005b40 tx=0x7f9aa0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cefba4f49a34b49 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:40:02.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.331+0000 7f9a9d600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:40:02.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.337+0000 7f9a9d600700 1 -- 172.21.15.70:0/2531043508 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa000fb80 con 0x556380d551d0 2024-05-08T09:40:02.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.337+0000 7f9a9d600700 1 -- 172.21.15.70:0/2531043508 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(423..423 src has 1..423) ==== 9671+0+0 (secure 0 0 0) 0x7f9aa000fd20 con 0x556380d551d0 2024-05-08T09:40:02.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.337+0000 7f9ac517ab80 1 -- 172.21.15.70:0/2531043508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aa40ad530 con 0x556380d551d0 2024-05-08T09:40:02.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.338+0000 7f9a9d600700 1 -- 172.21.15.70:0/2531043508 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f9aa0034130 con 0x556380d551d0 2024-05-08T09:40:02.337 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:02 smithi070 ceph-mon[29591]: pgmap v5534: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:40:02.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.338+0000 7f9ac517ab80 10 client.19863 fetch_fsmap learned FSMap version 42 2024-05-08T09:40:02.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.338+0000 7f9ac517ab80 1 -- 172.21.15.70:0/2531043508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x556380dd9590 con 0x556380d551d0 2024-05-08T09:40:02.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.339+0000 7f9a9d600700 1 -- 172.21.15.70:0/2531043508 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa40ad530 con 0x556380d551d0 2024-05-08T09:40:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.340+0000 7f9a9d600700 1 -- 172.21.15.70:0/2531043508 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f9aa003d5c0 con 0x556380d551d0 2024-05-08T09:40:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.340+0000 7f9ac517ab80 10 client.19863 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:40:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.340+0000 7f9ac517ab80 10 client.19863 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:40:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.340+0000 7f9ac517ab80 20 client.19863 populate_metadata read hostname 'smithi070' 2024-05-08T09:40:02.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.340+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556380dd9c90 0x556380ddc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:02.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.340+0000 7f9ac517ab80 4 client.19863 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.3, "await_for": 42.0}] 2024-05-08T09:40:02.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.340+0000 7f9ac517ab80 1 -- 172.21.15.70:0/2531043508 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.3, "await_for": 42.0}) -- 0x556380cb4590 con 0x556380dd9c90 2024-05-08T09:40:02.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.341+0000 7f9ab3400700 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556380dd9c90 0x556380ddc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:02.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.344+0000 7f9ab3400700 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556380dd9c90 0x556380ddc0b0 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57287fa7eb093e90 server_cookie=99d1d90f58be164e in_seq=0 out_seq=0 2024-05-08T09:40:02.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:02.344+0000 7f9a9d600700 10 client.19863 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:40:02.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:02 smithi172 ceph-mon[33377]: pgmap v5534: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:40:02.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:02 smithi194 ceph-mon[33679]: pgmap v5534: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:40:03.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:03 smithi070 ceph-mon[29591]: osdmap e423: 12 total, 12 up, 12 in 2024-05-08T09:40:03.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:03 smithi172 ceph-mon[33377]: osdmap e423: 12 total, 12 up, 12 in 2024-05-08T09:40:03.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:03 smithi194 ceph-mon[33679]: osdmap e423: 12 total, 12 up, 12 in 2024-05-08T09:40:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:04 smithi070 ceph-mon[29591]: pgmap v5536: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:40:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:04 smithi172 ceph-mon[33377]: pgmap v5536: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:40:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:04 smithi194 ceph-mon[33679]: pgmap v5536: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:40:06.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:06 smithi070 ceph-mon[29591]: pgmap v5537: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 3.0 MiB/s wr, 35 op/s 2024-05-08T09:40:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:06 smithi172 ceph-mon[33377]: pgmap v5537: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 3.0 MiB/s wr, 35 op/s 2024-05-08T09:40:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:06 smithi194 ceph-mon[33679]: pgmap v5537: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 3.0 MiB/s wr, 35 op/s 2024-05-08T09:40:08.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:07 smithi194 ceph-mon[33679]: osdmap e424: 12 total, 12 up, 12 in 2024-05-08T09:40:08.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:07 smithi070 ceph-mon[29591]: osdmap e424: 12 total, 12 up, 12 in 2024-05-08T09:40:08.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:07 smithi172 ceph-mon[33377]: osdmap e424: 12 total, 12 up, 12 in 2024-05-08T09:40:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:08 smithi194 ceph-mon[33679]: pgmap v5539: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 3.8 MiB/s wr, 40 op/s 2024-05-08T09:40:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:08 smithi070 ceph-mon[29591]: pgmap v5539: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 3.8 MiB/s wr, 40 op/s 2024-05-08T09:40:09.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:08 smithi172 ceph-mon[33377]: pgmap v5539: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 3.8 MiB/s wr, 40 op/s 2024-05-08T09:40:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:10 smithi194 ceph-mon[33679]: pgmap v5540: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 3.8 MiB/s wr, 45 op/s 2024-05-08T09:40:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:10 smithi070 ceph-mon[29591]: pgmap v5540: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 3.8 MiB/s wr, 45 op/s 2024-05-08T09:40:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:10 smithi172 ceph-mon[33377]: pgmap v5540: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 457 KiB/s rd, 3.8 MiB/s wr, 45 op/s 2024-05-08T09:40:13.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:12 smithi172 ceph-mon[33377]: pgmap v5541: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 3.4 MiB/s wr, 40 op/s 2024-05-08T09:40:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:12 smithi194 ceph-mon[33679]: pgmap v5541: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 3.4 MiB/s wr, 40 op/s 2024-05-08T09:40:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:12 smithi070 ceph-mon[29591]: pgmap v5541: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 3.4 MiB/s wr, 40 op/s 2024-05-08T09:40:15.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:14 smithi194 ceph-mon[33679]: pgmap v5542: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 3.0 MiB/s wr, 36 op/s 2024-05-08T09:40:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:14 smithi070 ceph-mon[29591]: pgmap v5542: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 3.0 MiB/s wr, 36 op/s 2024-05-08T09:40:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:14 smithi172 ceph-mon[33377]: pgmap v5542: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 3.0 MiB/s wr, 36 op/s 2024-05-08T09:40:17.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:16 smithi194 ceph-mon[33679]: pgmap v5543: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 78 KiB/s wr, 8 op/s 2024-05-08T09:40:17.297 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:16 smithi172 ceph-mon[33377]: pgmap v5543: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 78 KiB/s wr, 8 op/s 2024-05-08T09:40:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:16 smithi070 ceph-mon[29591]: pgmap v5543: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 78 KiB/s wr, 8 op/s 2024-05-08T09:40:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:18 smithi194 ceph-mon[33679]: pgmap v5544: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 75 KiB/s wr, 8 op/s 2024-05-08T09:40:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:18 smithi070 ceph-mon[29591]: pgmap v5544: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 75 KiB/s wr, 8 op/s 2024-05-08T09:40:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:18 smithi172 ceph-mon[33377]: pgmap v5544: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 75 KiB/s wr, 8 op/s 2024-05-08T09:40:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:20 smithi070 ceph-mon[29591]: pgmap v5545: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 65 KiB/s wr, 10 op/s 2024-05-08T09:40:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:20 smithi194 ceph-mon[33679]: pgmap v5545: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 65 KiB/s wr, 10 op/s 2024-05-08T09:40:21.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:20 smithi172 ceph-mon[33377]: pgmap v5545: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 65 KiB/s wr, 10 op/s 2024-05-08T09:40:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:23 smithi194 ceph-mon[33679]: pgmap v5546: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 51 KiB/s wr, 7 op/s 2024-05-08T09:40:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:23 smithi070 ceph-mon[29591]: pgmap v5546: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 51 KiB/s wr, 7 op/s 2024-05-08T09:40:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:23 smithi172 ceph-mon[33377]: pgmap v5546: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 51 KiB/s wr, 7 op/s 2024-05-08T09:40:24.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9a9d600700 1 -- 172.21.15.70:0/2531043508 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x556380cb4590 con 0x556380dd9c90 2024-05-08T09:40:24.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9a9d600700 10 client.19863 handle_command_reply: tid=0 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9ac517ab80 1 client.19863 shutdown 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9ac517ab80 1 -- 172.21.15.70:0/2531043508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d551d0 msgr2=0x556380d639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d551d0 0x556380d639e0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0005b40 tx=0x7f9aa0009310 comp rx=0 tx=0).stop 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9ac517ab80 1 -- 172.21.15.70:0/2531043508 shutdown_connections 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x556380dd9c90 0x556380ddc0b0 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556380d5a240 0x556380d63f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556380d54810 0x556380d66e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9a9d600700 0 client.19863 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9ac517ab80 1 --2- 172.21.15.70:0/2531043508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556380d551d0 0x556380d639e0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.456+0000 7f9ac517ab80 1 -- 172.21.15.70:0/2531043508 >> 172.21.15.70:0/2531043508 conn(0x556380ccc860 msgr2=0x556380d57cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.457+0000 7f9ac517ab80 1 -- 172.21.15.70:0/2531043508 shutdown_connections 2024-05-08T09:40:24.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.457+0000 7f9ac517ab80 1 -- 172.21.15.70:0/2531043508 wait complete. 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.457+0000 7f9ac517ab80 20 client.19863 trim_cache size 0 max 16384 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 378, 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "f2d68e61": { 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 378, 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:40:24.460 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.3, 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:40:24.461 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:40:24.462 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:40:24.462 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:40:24.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.459+0000 7f9aba800700 1 -- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a980b2aa0 msgr2=0x7f9a980b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:24.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.459+0000 7f9aba800700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a980b2aa0 0x7f9a980b4f60 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0006010 tx=0x7f9aa001a040 comp rx=0 tx=0).stop 2024-05-08T09:40:24.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.459+0000 7f9aba800700 1 -- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 msgr2=0x7f9ab4102c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:24.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.459+0000 7f9aba800700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 0x7f9ab4102c70 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400b530 tx=0x7f9aa400b8f0 comp rx=0 tx=0).stop 2024-05-08T09:40:24.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.460+0000 7f9aba800700 1 -- 172.21.15.70:0/1842756398 shutdown_connections 2024-05-08T09:40:24.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.460+0000 7f9aba800700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a980b2aa0 0x7f9a980b4f60 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:24.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.460+0000 7f9aba800700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9ab4108460 0x7f9ab41036f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:24.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.460+0000 7f9aba800700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9ab4101a90 0x7f9ab4102c70 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:24.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.460+0000 7f9aba800700 1 --2- 172.21.15.70:0/1842756398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ab4102450 0x7f9ab41031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:24.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.460+0000 7f9aba800700 1 -- 172.21.15.70:0/1842756398 >> 172.21.15.70:0/1842756398 conn(0x7f9ab4078a40 msgr2=0x7f9ab4109a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:40:24.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.460+0000 7f9aba800700 1 -- 172.21.15.70:0/1842756398 shutdown_connections 2024-05-08T09:40:24.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:24.460+0000 7f9aba800700 1 -- 172.21.15.70:0/1842756398 wait complete. 2024-05-08T09:40:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:25 smithi070 ceph-mon[29591]: pgmap v5547: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 51 KiB/s wr, 7 op/s 2024-05-08T09:40:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:25 smithi172 ceph-mon[33377]: pgmap v5547: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 51 KiB/s wr, 7 op/s 2024-05-08T09:40:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:25 smithi194 ceph-mon[33679]: pgmap v5547: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 51 KiB/s wr, 7 op/s 2024-05-08T09:40:25.515 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f2d68e61', quiesce took 31.4 seconds. Will release after: 28.3 2024-05-08T09:40:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:27 smithi070 ceph-mon[29591]: pgmap v5548: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 51 KiB/s wr, 10 op/s 2024-05-08T09:40:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:27 smithi172 ceph-mon[33377]: pgmap v5548: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 51 KiB/s wr, 10 op/s 2024-05-08T09:40:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:27 smithi194 ceph-mon[33679]: pgmap v5548: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 51 KiB/s wr, 10 op/s 2024-05-08T09:40:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:29 smithi070 ceph-mon[29591]: pgmap v5549: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-08T09:40:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:29 smithi172 ceph-mon[33377]: pgmap v5549: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-08T09:40:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:29 smithi194 ceph-mon[33679]: pgmap v5549: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 0 B/s wr, 6 op/s 2024-05-08T09:40:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:31 smithi070 ceph-mon[29591]: pgmap v5550: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T09:40:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:31 smithi172 ceph-mon[33377]: pgmap v5550: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T09:40:31.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:31 smithi194 ceph-mon[33679]: pgmap v5550: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 0 B/s wr, 8 op/s 2024-05-08T09:40:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:33 smithi070 ceph-mon[29591]: pgmap v5551: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:33 smithi172 ceph-mon[33377]: pgmap v5551: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:33 smithi194 ceph-mon[33679]: pgmap v5551: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:35 smithi070 ceph-mon[29591]: pgmap v5552: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:35 smithi172 ceph-mon[33377]: pgmap v5552: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:35 smithi194 ceph-mon[33679]: pgmap v5552: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:37 smithi070 ceph-mon[29591]: pgmap v5553: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:37.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:37 smithi172 ceph-mon[33377]: pgmap v5553: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:37 smithi194 ceph-mon[33679]: pgmap v5553: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:39 smithi070 ceph-mon[29591]: pgmap v5554: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:39 smithi172 ceph-mon[33377]: pgmap v5554: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:39 smithi194 ceph-mon[33679]: pgmap v5554: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:40.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:40 smithi070 ceph-mon[29591]: pgmap v5555: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:40.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:40 smithi172 ceph-mon[33377]: pgmap v5555: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:40.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:40 smithi194 ceph-mon[33679]: pgmap v5555: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:42.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:42 smithi070 ceph-mon[29591]: pgmap v5556: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:42 smithi172 ceph-mon[33377]: pgmap v5556: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:42.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:42 smithi194 ceph-mon[33679]: pgmap v5556: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:44.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:44 smithi070 ceph-mon[29591]: pgmap v5557: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:44 smithi172 ceph-mon[33377]: pgmap v5557: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:44.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:44 smithi194 ceph-mon[33679]: pgmap v5557: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:46.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:46 smithi070 ceph-mon[29591]: pgmap v5558: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:46.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:46 smithi172 ceph-mon[33377]: pgmap v5558: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:46 smithi194 ceph-mon[33679]: pgmap v5558: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:48 smithi194 ceph-mon[33679]: pgmap v5559: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:49.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:48 smithi070 ceph-mon[29591]: pgmap v5559: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:48 smithi172 ceph-mon[33377]: pgmap v5559: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:50 smithi194 ceph-mon[33679]: pgmap v5560: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:50 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:40:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:50 smithi070 ceph-mon[29591]: pgmap v5560: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:50 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:40:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:50 smithi172 ceph-mon[33377]: pgmap v5560: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:50 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:40:52.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:40:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:40:52.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:51 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:40:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:40:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:40:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:51 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:40:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:40:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:40:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:51 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:40:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:52 smithi194 ceph-mon[33679]: pgmap v5561: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:52 smithi070 ceph-mon[29591]: pgmap v5561: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:53.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:52 smithi172 ceph-mon[33377]: pgmap v5561: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:53.817 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:40:54.272 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:40:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:54 smithi070 ceph-mon[29591]: pgmap v5562: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:54 smithi194 ceph-mon[33679]: pgmap v5562: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:54 smithi172 ceph-mon[33377]: pgmap v5562: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:56.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.643+0000 7f1847200700 1 -- 172.21.15.70:0/3502161332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1848103d90 msgr2=0x7f18481102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:56.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.643+0000 7f1847200700 1 --2- 172.21.15.70:0/3502161332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1848103d90 0x7f18481102a0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f184000b0a0 tx=0x7f184000b3b0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.643+0000 7f1847200700 1 -- 172.21.15.70:0/3502161332 shutdown_connections 2024-05-08T09:40:56.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.643+0000 7f1847200700 1 --2- 172.21.15.70:0/3502161332 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1848103d90 0x7f18481102a0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.643+0000 7f1847200700 1 --2- 172.21.15.70:0/3502161332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1848109460 0x7f1848109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.643+0000 7f1847200700 1 --2- 172.21.15.70:0/3502161332 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18481033d0 0x7f1848103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.643+0000 7f1847200700 1 -- 172.21.15.70:0/3502161332 >> 172.21.15.70:0/3502161332 conn(0x7f18480fef20 msgr2=0x7f1848101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:40:56.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.643+0000 7f1847200700 1 -- 172.21.15.70:0/3502161332 shutdown_connections 2024-05-08T09:40:56.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.644+0000 7f1847200700 1 -- 172.21.15.70:0/3502161332 wait complete. 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.644+0000 7f1847200700 1 Processor -- start 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.645+0000 7f1847200700 1 -- start start 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.645+0000 7f1847200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18481033d0 0x7f18481a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.645+0000 7f1847200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1848103d90 0x7f18481a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.645+0000 7f1847200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1848109460 0x7f184819ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.645+0000 7f1847200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18481134f0 con 0x7f1848109460 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.645+0000 7f1847200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1848113370 con 0x7f18481033d0 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.645+0000 7f1847200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1848113670 con 0x7f1848103d90 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.645+0000 7f1845400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1848103d90 0x7f18481a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1845400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1848103d90 0x7f18481a1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:52056/0 (socket says 172.21.15.70:52056) 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1845400700 1 -- 172.21.15.70:0/3435982769 learned_addr learned my addr 172.21.15.70:0/3435982769 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1846800700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1848109460 0x7f184819ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:56.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1845e00700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18481033d0 0x7f18481a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:56.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1846800700 1 -- 172.21.15.70:0/3435982769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1848103d90 msgr2=0x7f18481a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:56.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1846800700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1848103d90 0x7f18481a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1846800700 1 -- 172.21.15.70:0/3435982769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18481033d0 msgr2=0x7f18481a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:56.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1846800700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18481033d0 0x7f18481a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1846800700 1 -- 172.21.15.70:0/3435982769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184819c170 con 0x7f1848109460 2024-05-08T09:40:56.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1845e00700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18481033d0 0x7f18481a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:40:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.646+0000 7f1846800700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1848109460 0x7f184819ba10 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f184000b830 tx=0x7f1840004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:40:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.647+0000 7f183ea00700 1 -- 172.21.15.70:0/3435982769 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1840021070 con 0x7f1848109460 2024-05-08T09:40:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.647+0000 7f183ea00700 1 -- 172.21.15.70:0/3435982769 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1840007b80 con 0x7f1848109460 2024-05-08T09:40:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.647+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f184819c400 con 0x7f1848109460 2024-05-08T09:40:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.647+0000 7f183ea00700 1 -- 172.21.15.70:0/3435982769 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18400052a0 con 0x7f1848109460 2024-05-08T09:40:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.647+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18481a8720 con 0x7f1848109460 2024-05-08T09:40:56.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.648+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f184806a190 con 0x7f1848109460 2024-05-08T09:40:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.652+0000 7f183ea00700 1 -- 172.21.15.70:0/3435982769 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1840024070 con 0x7f1848109460 2024-05-08T09:40:56.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.654+0000 7f183ea00700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f182c0b2a70 0x7f182c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:40:56.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.654+0000 7f183ea00700 1 -- 172.21.15.70:0/3435982769 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(424..424 src has 1..424) ==== 9583+0+0 (secure 0 0 0) 0x7f184000f020 con 0x7f1848109460 2024-05-08T09:40:56.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.654+0000 7f1845e00700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f182c0b2a70 0x7f182c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:40:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.655+0000 7f1845e00700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f182c0b2a70 0x7f182c0b4f30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f184819cb50 tx=0x7f1838008040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:40:56.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.657+0000 7f183ea00700 1 -- 172.21.15.70:0/3435982769 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f184002b020 con 0x7f1848109460 2024-05-08T09:40:56.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.943+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18481a88f0 con 0x7f1848109460 2024-05-08T09:40:56.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.944+0000 7f183ea00700 1 -- 172.21.15.70:0/3435982769 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f18400abb60 con 0x7f1848109460 2024-05-08T09:40:56.944 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:40:56.944 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:40:56.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f182c0b2a70 msgr2=0x7f182c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f182c0b2a70 0x7f182c0b4f30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f184819cb50 tx=0x7f1838008040 comp rx=0 tx=0).stop 2024-05-08T09:40:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1848109460 msgr2=0x7f184819ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:40:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1848109460 0x7f184819ba10 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f184000b830 tx=0x7f1840004da0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 shutdown_connections 2024-05-08T09:40:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f182c0b2a70 0x7f182c0b4f30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1848109460 0x7f184819ba10 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f18481033d0 0x7f18481a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 --2- 172.21.15.70:0/3435982769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1848103d90 0x7f18481a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:40:56.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 >> 172.21.15.70:0/3435982769 conn(0x7f18480fef20 msgr2=0x7f184810eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:40:56.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 shutdown_connections 2024-05-08T09:40:56.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:40:56.948+0000 7f1847200700 1 -- 172.21.15.70:0/3435982769 wait complete. 2024-05-08T09:40:56.948 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:40:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:56 smithi194 ceph-mon[33679]: pgmap v5563: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:57.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:56 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3435982769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:40:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:56 smithi070 ceph-mon[29591]: pgmap v5563: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:57.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:56 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3435982769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:40:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:56 smithi172 ceph-mon[33377]: pgmap v5563: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:40:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:56 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3435982769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:40:57.790 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id f2d68e61 --release --await' 2024-05-08T09:40:57.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id f2d68e61 --release --await 2024-05-08T09:40:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:40:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:40:59 smithi194 ceph-mon[33679]: pgmap v5564: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:59.308 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:40:59 smithi070 ceph-mon[29591]: pgmap v5564: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:40:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:40:59 smithi172 ceph-mon[33377]: pgmap v5564: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:41:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.592+0000 7f24f1c00700 1 -- 172.21.15.70:0/1708577524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec0756d0 msgr2=0x7f24ec075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.592+0000 7f24f1c00700 1 --2- 172.21.15.70:0/1708577524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec0756d0 0x7f24ec075ab0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f24dc009990 tx=0x7f24dc009ca0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.592+0000 7f24f1c00700 1 -- 172.21.15.70:0/1708577524 shutdown_connections 2024-05-08T09:41:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.592+0000 7f24f1c00700 1 --2- 172.21.15.70:0/1708577524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24ec10ff00 0x7f24ec1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.592+0000 7f24f1c00700 1 --2- 172.21.15.70:0/1708577524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec0756d0 0x7f24ec075ab0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.592+0000 7f24f1c00700 1 --2- 172.21.15.70:0/1708577524 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec075ff0 0x7f24ec10f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.592+0000 7f24f1c00700 1 -- 172.21.15.70:0/1708577524 >> 172.21.15.70:0/1708577524 conn(0x7f24ec07a5f0 msgr2=0x7f24ec07aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.592+0000 7f24f1c00700 1 -- 172.21.15.70:0/1708577524 shutdown_connections 2024-05-08T09:41:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.592+0000 7f24f1c00700 1 -- 172.21.15.70:0/1708577524 wait complete. 2024-05-08T09:41:00.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.593+0000 7f24f1c00700 1 Processor -- start 2024-05-08T09:41:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.593+0000 7f24f1c00700 1 -- start start 2024-05-08T09:41:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.594+0000 7f24f1c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24ec0756d0 0x7f24ec19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.594+0000 7f24f1c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec075ff0 0x7f24ec19c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.594+0000 7f24f1c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec10ff00 0x7f24ec1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.594+0000 7f24f1c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec1157f0 con 0x7f24ec075ff0 2024-05-08T09:41:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.594+0000 7f24f1c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec115670 con 0x7f24ec10ff00 2024-05-08T09:41:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.594+0000 7f24f1c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec115970 con 0x7f24ec0756d0 2024-05-08T09:41:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.594+0000 7f24ea000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec075ff0 0x7f24ec19c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.594+0000 7f24ea000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec075ff0 0x7f24ec19c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57744/0 (socket says 172.21.15.70:57744) 2024-05-08T09:41:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.594+0000 7f24ea000700 1 -- 172.21.15.70:0/2540757241 learned_addr learned my addr 172.21.15.70:0/2540757241 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.595+0000 7f24eaa00700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24ec0756d0 0x7f24ec19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.595+0000 7f24eb400700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec10ff00 0x7f24ec1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.595+0000 7f24ea000700 1 -- 172.21.15.70:0/2540757241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24ec0756d0 msgr2=0x7f24ec19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.595+0000 7f24ea000700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24ec0756d0 0x7f24ec19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.595+0000 7f24ea000700 1 -- 172.21.15.70:0/2540757241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec10ff00 msgr2=0x7f24ec1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.595+0000 7f24ea000700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec10ff00 0x7f24ec1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.595+0000 7f24ea000700 1 -- 172.21.15.70:0/2540757241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ec1a0d20 con 0x7f24ec075ff0 2024-05-08T09:41:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.595+0000 7f24ea000700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec075ff0 0x7f24ec19c2a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f24d800d950 tx=0x7f24d800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.596+0000 7f24e3400700 1 -- 172.21.15.70:0/2540757241 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8016070 con 0x7f24ec075ff0 2024-05-08T09:41:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.596+0000 7f24e3400700 1 -- 172.21.15.70:0/2540757241 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24d8009dd0 con 0x7f24ec075ff0 2024-05-08T09:41:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.596+0000 7f24f1c00700 1 -- 172.21.15.70:0/2540757241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ec1a1010 con 0x7f24ec075ff0 2024-05-08T09:41:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.596+0000 7f24e3400700 1 -- 172.21.15.70:0/2540757241 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d800f3c0 con 0x7f24ec075ff0 2024-05-08T09:41:00.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.596+0000 7f24f1c00700 1 -- 172.21.15.70:0/2540757241 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ec1a8890 con 0x7f24ec075ff0 2024-05-08T09:41:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.600+0000 7f24e3400700 1 -- 172.21.15.70:0/2540757241 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f24d8019070 con 0x7f24ec075ff0 2024-05-08T09:41:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.601+0000 7f24fc4ccb80 1 Processor -- start 2024-05-08T09:41:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.601+0000 7f24fc4ccb80 1 -- start start 2024-05-08T09:41:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.601+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040c0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.601+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040ba780 0x562e040bac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.601+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 0x562e040c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.601+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e0400cb20 con 0x562e040c01b0 2024-05-08T09:41:00.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.601+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e03faa860 con 0x562e040bb140 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.601+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562e04008ae0 con 0x562e040ba780 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24eb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24eb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040c0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57758/0 (socket says 172.21.15.70:57758) 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24eb400700 1 -- 172.21.15.70:0/880217848 learned_addr learned my addr 172.21.15.70:0/880217848 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24eaa00700 1 --2- 172.21.15.70:0/880217848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040ba780 0x562e040bac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24ea000700 1 --2- 172.21.15.70:0/880217848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 0x562e040c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24e3400700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f24d00b29f0 0x7f24d00b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24eb400700 1 -- 172.21.15.70:0/880217848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040ba780 msgr2=0x562e040bac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24eb400700 1 --2- 172.21.15.70:0/880217848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040ba780 0x562e040bac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24eb400700 1 -- 172.21.15.70:0/880217848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 msgr2=0x562e040c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24eb400700 1 --2- 172.21.15.70:0/880217848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 0x562e040c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.602+0000 7f24eb400700 1 -- 172.21.15.70:0/880217848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e03f599d0 con 0x562e040c01b0 2024-05-08T09:41:00.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.603+0000 7f24e3400700 1 -- 172.21.15.70:0/2540757241 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(424..424 src has 1..424) ==== 9583+0+0 (secure 0 0 0) 0x7f24d80e20e0 con 0x7f24ec075ff0 2024-05-08T09:41:00.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.603+0000 7f24eb400700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f24d00b29f0 0x7f24d00b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.603+0000 7f24eb400700 1 --2- 172.21.15.70:0/880217848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040c0590 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009cb0 tx=0x7f24e4007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d898ab50bbcf6714 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:00.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.603+0000 7f24d7e00700 1 -- 172.21.15.70:0/880217848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4014610 con 0x562e040c01b0 2024-05-08T09:41:00.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.603+0000 7f24d7e00700 1 -- 172.21.15.70:0/880217848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24e4014c40 con 0x562e040c01b0 2024-05-08T09:41:00.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.603+0000 7f24d7e00700 1 -- 172.21.15.70:0/880217848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e40206a0 con 0x562e040c01b0 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.604+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/880217848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 msgr2=0x562e040c0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.604+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/880217848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040c0590 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009cb0 tx=0x7f24e4007500 comp rx=0 tx=0).stop 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.604+0000 7f24eb400700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f24d00b29f0 0x7f24d00b4eb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f24e4014fd0 tx=0x7f24e401eab0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.604+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/880217848 shutdown_connections 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.604+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/880217848 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 0x562e040c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.604+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/880217848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040c0590 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.604+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/880217848 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040ba780 0x562e040bac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.604+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/880217848 >> 172.21.15.70:0/880217848 conn(0x562e040327d0 msgr2=0x562e040b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.604+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/880217848 shutdown_connections 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.605+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/880217848 wait complete. 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.605+0000 7f24fc4ccb80 1 -- start start 2024-05-08T09:41:00.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.605+0000 7f24fc4ccb80 1 Processor -- start 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 0x562e040c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040bb140 0x562e040c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040c01b0 0x562e040c4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562e040c7570 con 0x562e040bb140 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x562e03f72c20 con 0x562e040ba780 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x562e040c76f0 con 0x562e040c01b0 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24fc4ccb80 10 client.0 _ll_register_callbacks cb 0x562e03fb3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24ea000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040bb140 0x562e040c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24ea000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040bb140 0x562e040c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57766/0 (socket says 172.21.15.70:57766) 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.606+0000 7f24ea000700 1 -- 172.21.15.70:0/3580021559 learned_addr learned my addr 172.21.15.70:0/3580021559 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24eb400700 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040c01b0 0x562e040c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24eaa00700 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 0x562e040c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24ea000700 1 -- 172.21.15.70:0/3580021559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040c01b0 msgr2=0x562e040c4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24ea000700 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040c01b0 0x562e040c4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24ea000700 1 -- 172.21.15.70:0/3580021559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 msgr2=0x562e040c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24ea000700 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 0x562e040c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24ea000700 1 -- 172.21.15.70:0/3580021559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e03fd2520 con 0x562e040bb140 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24ea000700 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040bb140 0x562e040c3e50 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f24d80a5020 tx=0x7f24d80a5650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3c8c09f92c6937 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24d4c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24d4c00700 1 -- 172.21.15.70:0/3580021559 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8020040 con 0x562e040bb140 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24d4c00700 1 -- 172.21.15.70:0/3580021559 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(424..424 src has 1..424) ==== 9583+0+0 (secure 0 0 0) 0x7f24d80a9200 con 0x562e040bb140 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.607+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/3580021559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24e4014c40 con 0x562e040bb140 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24d4c00700 1 -- 172.21.15.70:0/3580021559 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f24d80a8710 con 0x562e040bb140 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24fc4ccb80 10 client.19881 fetch_fsmap learned FSMap version 42 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/3580021559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562e040d1cb0 con 0x562e040bb140 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24d4c00700 1 -- 172.21.15.70:0/3580021559 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24e4014c40 con 0x562e040bb140 2024-05-08T09:41:00.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24d4c00700 1 -- 172.21.15.70:0/3580021559 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f24d80b1970 con 0x562e040bb140 2024-05-08T09:41:00.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24fc4ccb80 10 client.19881 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:41:00.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24fc4ccb80 10 client.19881 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:41:00.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24fc4ccb80 20 client.19881 populate_metadata read hostname 'smithi070' 2024-05-08T09:41:00.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e040d42f0 0x562e040d66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24fc4ccb80 4 client.19881 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:41:00.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.608+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/3580021559 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e04087240 con 0x562e040d42f0 2024-05-08T09:41:00.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.609+0000 7f24eaa00700 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e040d42f0 0x562e040d66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.610+0000 7f24eaa00700 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e040d42f0 0x562e040d66e0 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c533987469b4a1 server_cookie=6188e1a23d08cb1e in_seq=0 out_seq=0 2024-05-08T09:41:00.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.610+0000 7f24d4c00700 10 client.19881 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:41:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.612+0000 7f24d4c00700 1 -- 172.21.15.70:0/3580021559 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562e04087240 con 0x562e040d42f0 2024-05-08T09:41:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.612+0000 7f24d4c00700 10 client.19881 handle_command_reply: tid=0 2024-05-08T09:41:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.612+0000 7f24fc4ccb80 1 client.19881 shutdown 2024-05-08T09:41:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/3580021559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040bb140 msgr2=0x562e040c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040bb140 0x562e040c3e50 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f24d80a5020 tx=0x7f24d80a5650 comp rx=0 tx=0).stop 2024-05-08T09:41:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/3580021559 shutdown_connections 2024-05-08T09:41:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e040d42f0 0x562e040d66e0 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040c01b0 0x562e040c4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 0x562e040c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24d4c00700 0 client.19881 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:41:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/3580021559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040bb140 0x562e040c3e50 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/3580021559 >> 172.21.15.70:0/3580021559 conn(0x562e040327d0 msgr2=0x562e040afb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/3580021559 shutdown_connections 2024-05-08T09:41:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/3580021559 wait complete. 2024-05-08T09:41:00.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.613+0000 7f24fc4ccb80 20 client.19881 trim_cache size 0 max 16384 2024-05-08T09:41:00.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.635+0000 7f24fc4ccb80 1 Processor -- start 2024-05-08T09:41:00.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.635+0000 7f24fc4ccb80 1 -- start start 2024-05-08T09:41:00.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.635+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 0x562e040bf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.635+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040bb140 0x562e040d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.635+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040be340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.635+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec1b40b0 con 0x562e040c01b0 2024-05-08T09:41:00.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.635+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec1b1940 con 0x562e040ba780 2024-05-08T09:41:00.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.635+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec1af7b0 con 0x562e040bb140 2024-05-08T09:41:00.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.635+0000 7f24eb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040be340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eb400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040be340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57774/0 (socket says 172.21.15.70:57774) 2024-05-08T09:41:00.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eb400700 1 -- 172.21.15.70:0/1043883838 learned_addr learned my addr 172.21.15.70:0/1043883838 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:00.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24ea000700 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040bb140 0x562e040d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eaa00700 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 0x562e040bf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eb400700 1 -- 172.21.15.70:0/1043883838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040bb140 msgr2=0x562e040d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:00.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eb400700 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040bb140 0x562e040d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eb400700 1 -- 172.21.15.70:0/1043883838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 msgr2=0x562e040bf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:00.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eb400700 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 0x562e040bf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eb400700 1 -- 172.21.15.70:0/1043883838 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e040c3c20 con 0x562e040c01b0 2024-05-08T09:41:00.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eaa00700 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 0x562e040bf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:41:00.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.636+0000 7f24eb400700 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040be340 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f24e401b000 tx=0x7f24e4016050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50245b094519860d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:00.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.637+0000 7f24d7400700 1 -- 172.21.15.70:0/1043883838 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e40206a0 con 0x562e040c01b0 2024-05-08T09:41:00.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.637+0000 7f24d7400700 1 -- 172.21.15.70:0/1043883838 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24e402f070 con 0x562e040c01b0 2024-05-08T09:41:00.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.637+0000 7f24d7400700 1 -- 172.21.15.70:0/1043883838 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4014410 con 0x562e040c01b0 2024-05-08T09:41:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.637+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1043883838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 msgr2=0x562e040be340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.637+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040be340 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f24e401b000 tx=0x7f24e4016050 comp rx=0 tx=0).stop 2024-05-08T09:41:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.638+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1043883838 shutdown_connections 2024-05-08T09:41:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.638+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040c01b0 0x562e040be340 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.638+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040ba780 0x562e040bf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.638+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1043883838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040bb140 0x562e040d0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.638+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1043883838 >> 172.21.15.70:0/1043883838 conn(0x562e040327d0 msgr2=0x562e040bdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.638+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1043883838 shutdown_connections 2024-05-08T09:41:00.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.638+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1043883838 wait complete. 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.638+0000 7f24fc4ccb80 1 -- start start 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.638+0000 7f24fc4ccb80 1 Processor -- start 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040ba780 0x562e040cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 0x562e040c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24fc4ccb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040c01b0 0x562e040ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec1afe00 con 0x562e040ba780 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec1b1270 con 0x562e040bb140 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24fc4ccb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f24ec1b04d0 con 0x562e040c01b0 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24fc4ccb80 10 client.0 _ll_register_callbacks cb 0x562e03fb3d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24eaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040ba780 0x562e040cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24eaa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040ba780 0x562e040cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57784/0 (socket says 172.21.15.70:57784) 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.639+0000 7f24eaa00700 1 -- 172.21.15.70:0/1904036758 learned_addr learned my addr 172.21.15.70:0/1904036758 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24eaa00700 1 -- 172.21.15.70:0/1904036758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040c01b0 msgr2=0x562e040ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:00.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24eaa00700 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040c01b0 0x562e040ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24eaa00700 1 -- 172.21.15.70:0/1904036758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 msgr2=0x562e040c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24ea000700 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 0x562e040c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24eaa00700 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 0x562e040c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24eaa00700 1 -- 172.21.15.70:0/1904036758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e0413eb90 con 0x562e040ba780 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24eaa00700 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040ba780 0x562e040cd090 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f24dc000c00 tx=0x7f24dc005510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736dc0e90772bcff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24d4c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24d4c00700 1 -- 172.21.15.70:0/1904036758 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24dc003bd0 con 0x562e040ba780 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24d4c00700 1 -- 172.21.15.70:0/1904036758 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(424..424 src has 1..424) ==== 9583+0+0 (secure 0 0 0) 0x7f24dc003d70 con 0x562e040ba780 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.640+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1904036758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f24e402f070 con 0x562e040ba780 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24d4c00700 1 -- 172.21.15.70:0/1904036758 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f24dc038050 con 0x562e040ba780 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24fc4ccb80 10 client.19887 fetch_fsmap learned FSMap version 42 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1904036758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x562e0413fe70 con 0x562e040ba780 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24d4c00700 1 -- 172.21.15.70:0/1904036758 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f24e402f070 con 0x562e040ba780 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24d4c00700 1 -- 172.21.15.70:0/1904036758 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f24dc0283f0 con 0x562e040ba780 2024-05-08T09:41:00.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24fc4ccb80 10 client.19887 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:41:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24fc4ccb80 10 client.19887 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:41:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24fc4ccb80 20 client.19887 populate_metadata read hostname 'smithi070' 2024-05-08T09:41:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e041405b0 0x562e041429d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24fc4ccb80 4 client.19887 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f2d68e61", "release": true, "await": true}] 2024-05-08T09:41:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.641+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1904036758 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f2d68e61", "release": true, "await": true}) -- 0x562e0401a500 con 0x562e041405b0 2024-05-08T09:41:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.642+0000 7f24ea000700 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e041405b0 0x562e041429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.643+0000 7f24ea000700 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e041405b0 0x562e041429d0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=688cc58f41cafbd2 server_cookie=2aebe9132076c7d1 in_seq=0 out_seq=0 2024-05-08T09:41:00.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:00.643+0000 7f24d4c00700 10 client.19887 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:41:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:01 smithi194 ceph-mon[33679]: pgmap v5565: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:41:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:01 smithi070 ceph-mon[29591]: pgmap v5565: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:41:01.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:01 smithi172 ceph-mon[33377]: pgmap v5565: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:41:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:03 smithi070 ceph-mon[29591]: pgmap v5566: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:41:03.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:03 smithi172 ceph-mon[33377]: pgmap v5566: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:41:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:03 smithi194 ceph-mon[33679]: pgmap v5566: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:41:05.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.252+0000 7f24d4c00700 1 -- 172.21.15.70:0/1904036758 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x562e0401a500 con 0x562e041405b0 2024-05-08T09:41:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.253+0000 7f24d4c00700 10 client.19887 handle_command_reply: tid=0 2024-05-08T09:41:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.253+0000 7f24fc4ccb80 1 client.19887 shutdown 2024-05-08T09:41:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.253+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1904036758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040ba780 msgr2=0x562e040cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.253+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040ba780 0x562e040cd090 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f24dc000c00 tx=0x7f24dc005510 comp rx=0 tx=0).stop 2024-05-08T09:41:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.253+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1904036758 shutdown_connections 2024-05-08T09:41:05.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.254+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x562e041405b0 0x562e041429d0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.254+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x562e040c01b0 0x562e040ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.254+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562e040ba780 0x562e040cd090 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.254+0000 7f24fc4ccb80 1 --2- 172.21.15.70:0/1904036758 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x562e040bb140 0x562e040c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.254+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1904036758 >> 172.21.15.70:0/1904036758 conn(0x562e040327d0 msgr2=0x562e040bf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.254+0000 7f24d4c00700 0 client.19887 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:41:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.254+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1904036758 shutdown_connections 2024-05-08T09:41:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.254+0000 7f24fc4ccb80 1 -- 172.21.15.70:0/1904036758 wait complete. 2024-05-08T09:41:05.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.254+0000 7f24fc4ccb80 20 client.19887 trim_cache size 0 max 16384 2024-05-08T09:41:05.254 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:41:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:41:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:41:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 380, 2024-05-08T09:41:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:41:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "f2d68e61": { 2024-05-08T09:41:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 380, 2024-05-08T09:41:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:41:05.254 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.3, 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:05.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:05.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:05.256 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:41:05.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 -- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f24d00b29f0 msgr2=0x7f24d00b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:05.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f24d00b29f0 0x7f24d00b4eb0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f24e4014fd0 tx=0x7f24e401eab0 comp rx=0 tx=0).stop 2024-05-08T09:41:05.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 -- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec075ff0 msgr2=0x7f24ec19c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:05.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec075ff0 0x7f24ec19c2a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f24d800d950 tx=0x7f24d800dc60 comp rx=0 tx=0).stop 2024-05-08T09:41:05.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 -- 172.21.15.70:0/2540757241 shutdown_connections 2024-05-08T09:41:05.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f24d00b29f0 0x7f24d00b4eb0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:05.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f24ec10ff00 0x7f24ec1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:05.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24ec0756d0 0x7f24ec19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:05.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 --2- 172.21.15.70:0/2540757241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24ec075ff0 0x7f24ec19c2a0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:05.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 -- 172.21.15.70:0/2540757241 >> 172.21.15.70:0/2540757241 conn(0x7f24ec07a5f0 msgr2=0x7f24ec1007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:05.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 -- 172.21.15.70:0/2540757241 shutdown_connections 2024-05-08T09:41:05.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:05.256+0000 7f24f1c00700 1 -- 172.21.15.70:0/2540757241 wait complete. 2024-05-08T09:41:05.277 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:05 smithi070 ceph-mon[29591]: pgmap v5567: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:41:05.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:05 smithi172 ceph-mon[33377]: pgmap v5567: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:41:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:05 smithi194 ceph-mon[33679]: pgmap v5567: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:41:06.500 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f2d68e61', seconds elapsed: 72.4 2024-05-08T09:41:06.500 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 28.3 2024-05-08T09:41:06.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:41:06.945 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:41:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:07 smithi194 ceph-mon[33679]: pgmap v5568: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-08T09:41:07.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:07 smithi070 ceph-mon[29591]: pgmap v5568: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-08T09:41:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:07 smithi172 ceph-mon[33377]: pgmap v5568: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-08T09:41:09.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.207+0000 7fb86fa00700 1 -- 172.21.15.70:0/195370969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810fb60 msgr2=0x7fb86810ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:09.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.207+0000 7fb86fa00700 1 --2- 172.21.15.70:0/195370969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810fb60 0x7fb86810ff40 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009990 tx=0x7fb85c009ca0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.207+0000 7fb86fa00700 1 -- 172.21.15.70:0/195370969 shutdown_connections 2024-05-08T09:41:09.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.207+0000 7fb86fa00700 1 --2- 172.21.15.70:0/195370969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb86810a490 0x7fb8681169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.207+0000 7fb86fa00700 1 --2- 172.21.15.70:0/195370969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810fb60 0x7fb86810ff40 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.207+0000 7fb86fa00700 1 --2- 172.21.15.70:0/195370969 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb868109ad0 0x7fb868109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.207+0000 7fb86fa00700 1 -- 172.21.15.70:0/195370969 >> 172.21.15.70:0/195370969 conn(0x7fb868076c70 msgr2=0x7fb8681082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.207+0000 7fb86fa00700 1 -- 172.21.15.70:0/195370969 shutdown_connections 2024-05-08T09:41:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.207+0000 7fb86fa00700 1 -- 172.21.15.70:0/195370969 wait complete. 2024-05-08T09:41:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.209+0000 7fb86fa00700 1 Processor -- start 2024-05-08T09:41:09.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.209+0000 7fb86fa00700 1 -- start start 2024-05-08T09:41:09.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.209+0000 7fb86fa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb868109ad0 0x7fb8681a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:09.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.209+0000 7fb86fa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810a490 0x7fb8681a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:09.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.209+0000 7fb86fa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86810fb60 0x7fb8681a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:09.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.209+0000 7fb86fa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb868119bd0 con 0x7fb86810a490 2024-05-08T09:41:09.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.209+0000 7fb86fa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fb868119a50 con 0x7fb86810fb60 2024-05-08T09:41:09.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.209+0000 7fb86fa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fb868119d50 con 0x7fb868109ad0 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.209+0000 7fb867e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810a490 0x7fb8681a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb867e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810a490 0x7fb8681a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53978/0 (socket says 172.21.15.70:53978) 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb867e00700 1 -- 172.21.15.70:0/431159394 learned_addr learned my addr 172.21.15.70:0/431159394 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb86d000700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb868109ad0 0x7fb8681a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb86da00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86810fb60 0x7fb8681a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb867e00700 1 -- 172.21.15.70:0/431159394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb868109ad0 msgr2=0x7fb8681a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb867e00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb868109ad0 0x7fb8681a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb867e00700 1 -- 172.21.15.70:0/431159394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86810fb60 msgr2=0x7fb8681a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb867e00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86810fb60 0x7fb8681a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb867e00700 1 -- 172.21.15.70:0/431159394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8681a5060 con 0x7fb86810a490 2024-05-08T09:41:09.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb86d000700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb868109ad0 0x7fb8681a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:41:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.210+0000 7fb867e00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810a490 0x7fb8681a05e0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c9b0 tx=0x7fb85400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.211+0000 7fb865600700 1 -- 172.21.15.70:0/431159394 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854007b00 con 0x7fb86810a490 2024-05-08T09:41:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.211+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8681a5350 con 0x7fb86810a490 2024-05-08T09:41:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.211+0000 7fb865600700 1 -- 172.21.15.70:0/431159394 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb854007ca0 con 0x7fb86810a490 2024-05-08T09:41:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.211+0000 7fb865600700 1 -- 172.21.15.70:0/431159394 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854018660 con 0x7fb86810a490 2024-05-08T09:41:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.211+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8681acbd0 con 0x7fb86810a490 2024-05-08T09:41:09.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.212+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb86806a190 con 0x7fb86810a490 2024-05-08T09:41:09.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.214+0000 7fb865600700 1 -- 172.21.15.70:0/431159394 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb85400f450 con 0x7fb86810a490 2024-05-08T09:41:09.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.216+0000 7fb865600700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8500b29f0 0x7fb8500b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:09.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.216+0000 7fb865600700 1 -- 172.21.15.70:0/431159394 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(424..424 src has 1..424) ==== 9583+0+0 (secure 0 0 0) 0x7fb8540e2e30 con 0x7fb86810a490 2024-05-08T09:41:09.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.216+0000 7fb86d000700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8500b29f0 0x7fb8500b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:09.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.217+0000 7fb86d000700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8500b29f0 0x7fb8500b4eb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00b5c0 tx=0x7fb85c01a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:09.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.219+0000 7fb865600700 1 -- 172.21.15.70:0/431159394 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb854014030 con 0x7fb86810a490 2024-05-08T09:41:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:09 smithi070 ceph-mon[29591]: pgmap v5569: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T09:41:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:09 smithi172 ceph-mon[33377]: pgmap v5569: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T09:41:09.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.511+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb86802e510 con 0x7fb86810a490 2024-05-08T09:41:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:09 smithi194 ceph-mon[33679]: pgmap v5569: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T09:41:09.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.513+0000 7fb865600700 1 -- 172.21.15.70:0/431159394 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7fb8540aa420 con 0x7fb86810a490 2024-05-08T09:41:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:41:09.512 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8500b29f0 msgr2=0x7fb8500b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8500b29f0 0x7fb8500b4eb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00b5c0 tx=0x7fb85c01a040 comp rx=0 tx=0).stop 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810a490 msgr2=0x7fb8681a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810a490 0x7fb8681a05e0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c9b0 tx=0x7fb85400cd70 comp rx=0 tx=0).stop 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 shutdown_connections 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fb8500b29f0 0x7fb8500b4eb0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fb86810fb60 0x7fb8681a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb868109ad0 0x7fb8681a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 --2- 172.21.15.70:0/431159394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb86810a490 0x7fb8681a05e0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.516+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 >> 172.21.15.70:0/431159394 conn(0x7fb868076c70 msgr2=0x7fb868077270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.517+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 shutdown_connections 2024-05-08T09:41:09.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:09.517+0000 7fb86fa00700 1 -- 172.21.15.70:0/431159394 wait complete. 2024-05-08T09:41:09.517 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:41:10.351 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:10 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/431159394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:41:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:10 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/431159394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:41:10.431 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 88.3 --await-for 42.0' 2024-05-08T09:41:10.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 88.3 --await-for 42.0 2024-05-08T09:41:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:10 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/431159394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:41:10.936 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:41:11.302 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:11 smithi070 ceph-mon[29591]: pgmap v5570: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 66 KiB/s wr, 10 op/s 2024-05-08T09:41:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:11 smithi172 ceph-mon[33377]: pgmap v5570: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 66 KiB/s wr, 10 op/s 2024-05-08T09:41:11.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:11 smithi194 ceph-mon[33679]: pgmap v5570: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 66 KiB/s wr, 10 op/s 2024-05-08T09:41:11.679 INFO:tasks.workunit.client.0.smithi070.stdout: CC .vmlinux.export.o 2024-05-08T09:41:12.055 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] drivers/thermal/intel/x86_pkg_temp_thermal.mod.o 2024-05-08T09:41:12.056 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] fs/efivarfs/efivarfs.mod.o 2024-05-08T09:41:12.060 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/nf_log_syslog.mod.o 2024-05-08T09:41:12.063 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_nat.mod.o 2024-05-08T09:41:12.065 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_mark.mod.o 2024-05-08T09:41:12.066 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_MASQUERADE.mod.o 2024-05-08T09:41:12.066 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_LOG.mod.o 2024-05-08T09:41:13.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:13 smithi070 ceph-mon[29591]: pgmap v5571: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 66 KiB/s wr, 7 op/s 2024-05-08T09:41:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.316+0000 7f5be7c00700 1 -- 172.21.15.70:0/1902125120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be0102ed0 msgr2=0x7f5be01032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.316+0000 7f5be7c00700 1 --2- 172.21.15.70:0/1902125120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be0102ed0 0x7f5be01032b0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009990 tx=0x7f5bd4009ca0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.316+0000 7f5be7c00700 1 -- 172.21.15.70:0/1902125120 shutdown_connections 2024-05-08T09:41:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.316+0000 7f5be7c00700 1 --2- 172.21.15.70:0/1902125120 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be010ff50 0x7f5be0112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.316+0000 7f5be7c00700 1 --2- 172.21.15.70:0/1902125120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be0102ed0 0x7f5be01032b0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.316+0000 7f5be7c00700 1 --2- 172.21.15.70:0/1902125120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5be01037f0 0x7f5be010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.316+0000 7f5be7c00700 1 -- 172.21.15.70:0/1902125120 >> 172.21.15.70:0/1902125120 conn(0x7f5be0079340 msgr2=0x7f5be0079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.316+0000 7f5be7c00700 1 -- 172.21.15.70:0/1902125120 shutdown_connections 2024-05-08T09:41:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.316+0000 7f5be7c00700 1 -- 172.21.15.70:0/1902125120 wait complete. 2024-05-08T09:41:13.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.318+0000 7f5be7c00700 1 Processor -- start 2024-05-08T09:41:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.318+0000 7f5be7c00700 1 -- start start 2024-05-08T09:41:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.318+0000 7f5be7c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be0102ed0 0x7f5be010f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.318+0000 7f5be7c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5be01037f0 0x7f5be010c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.318+0000 7f5be7c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be010ff50 0x7f5be010ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.318+0000 7f5be7c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01157a0 con 0x7f5be010ff50 2024-05-08T09:41:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.318+0000 7f5be7c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0115620 con 0x7f5be0102ed0 2024-05-08T09:41:13.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.318+0000 7f5be7c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5be0115920 con 0x7f5be01037f0 2024-05-08T09:41:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.319+0000 7f5be5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be010ff50 0x7f5be010ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.319+0000 7f5be5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be010ff50 0x7f5be010ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54006/0 (socket says 172.21.15.70:54006) 2024-05-08T09:41:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.319+0000 7f5be5c00700 1 -- 172.21.15.70:0/3477279204 learned_addr learned my addr 172.21.15.70:0/3477279204 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.319+0000 7f5be5200700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be0102ed0 0x7f5be010f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.319+0000 7f5bdfe00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5be01037f0 0x7f5be010c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.320+0000 7f5be5c00700 1 -- 172.21.15.70:0/3477279204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5be01037f0 msgr2=0x7f5be010c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.320+0000 7f5be5c00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5be01037f0 0x7f5be010c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.320+0000 7f5be5c00700 1 -- 172.21.15.70:0/3477279204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be0102ed0 msgr2=0x7f5be010f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.320+0000 7f5be5c00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be0102ed0 0x7f5be010f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.320+0000 7f5be5c00700 1 -- 172.21.15.70:0/3477279204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be010d720 con 0x7f5be010ff50 2024-05-08T09:41:13.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.320+0000 7f5be5c00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be010ff50 0x7f5be010ce20 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8007d40 tx=0x7f5bd800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:13.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.320+0000 7f5bdd600700 1 -- 172.21.15.70:0/3477279204 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8016020 con 0x7f5be010ff50 2024-05-08T09:41:13.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.321+0000 7f5bdd600700 1 -- 172.21.15.70:0/3477279204 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bd800ad40 con 0x7f5be010ff50 2024-05-08T09:41:13.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.321+0000 7f5bdd600700 1 -- 172.21.15.70:0/3477279204 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8012e60 con 0x7f5be010ff50 2024-05-08T09:41:13.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.321+0000 7f5be7c00700 1 -- 172.21.15.70:0/3477279204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be01ac580 con 0x7f5be010ff50 2024-05-08T09:41:13.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.321+0000 7f5be7c00700 1 -- 172.21.15.70:0/3477279204 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be01aca70 con 0x7f5be010ff50 2024-05-08T09:41:13.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.325+0000 7f5bdd600700 1 -- 172.21.15.70:0/3477279204 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5bd8019020 con 0x7f5be010ff50 2024-05-08T09:41:13.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.327+0000 7f5bdd600700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5bc80b2b20 0x7f5bc80b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.327+0000 7f5bdd600700 1 -- 172.21.15.70:0/3477279204 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(424..424 src has 1..424) ==== 9583+0+0 (secure 0 0 0) 0x7f5bd80e2890 con 0x7f5be010ff50 2024-05-08T09:41:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.328+0000 7f5be5200700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5bc80b2b20 0x7f5bc80b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.328+0000 7f5bf2502b80 1 Processor -- start 2024-05-08T09:41:13.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.328+0000 7f5bf2502b80 1 -- start start 2024-05-08T09:41:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b7f50 0x55a6823b8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2520 0x55a6823b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823bed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a682304bb0 con 0x55a6823b2ee0 2024-05-08T09:41:13.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a6822a28f0 con 0x55a6823b7f50 2024-05-08T09:41:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a682300b70 con 0x55a6823b2520 2024-05-08T09:41:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5be5200700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5bc80b2b20 0x7f5bc80b4fe0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4006010 tx=0x7f5bd400b540 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5be5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823bed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5be5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823bed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54018/0 (socket says 172.21.15.70:54018) 2024-05-08T09:41:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5be5c00700 1 -- 172.21.15.70:0/2101828375 learned_addr learned my addr 172.21.15.70:0/2101828375 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:13.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5bdfe00700 1 --2- 172.21.15.70:0/2101828375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2520 0x55a6823b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.329+0000 7f5be5200700 1 --2- 172.21.15.70:0/2101828375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b7f50 0x55a6823b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.330+0000 7f5be5c00700 1 -- 172.21.15.70:0/2101828375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2520 msgr2=0x55a6823b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.330+0000 7f5be5c00700 1 --2- 172.21.15.70:0/2101828375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2520 0x55a6823b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.330+0000 7f5be5c00700 1 -- 172.21.15.70:0/2101828375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b7f50 msgr2=0x55a6823b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.330+0000 7f5be5c00700 1 --2- 172.21.15.70:0/2101828375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b7f50 0x55a6823b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.330+0000 7f5be5c00700 1 -- 172.21.15.70:0/2101828375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a682251a60 con 0x55a6823b2ee0 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.330+0000 7f5be5c00700 1 --2- 172.21.15.70:0/2101828375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823bed10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80dfbe0 tx=0x7f5bd8007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9464f65a8f41e96b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.331+0000 7f5bd2000700 1 -- 172.21.15.70:0/2101828375 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80a9800 con 0x55a6823b2ee0 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.331+0000 7f5bd2000700 1 -- 172.21.15.70:0/2101828375 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bd80adbb0 con 0x55a6823b2ee0 2024-05-08T09:41:13.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.331+0000 7f5bd2000700 1 -- 172.21.15.70:0/2101828375 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80b21d0 con 0x55a6823b2ee0 2024-05-08T09:41:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.332+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2101828375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 msgr2=0x55a6823bed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:13.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.332+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2101828375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823bed10 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80dfbe0 tx=0x7f5bd8007af0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.332+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2101828375 shutdown_connections 2024-05-08T09:41:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.332+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2101828375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823bed10 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.332+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2101828375 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b7f50 0x55a6823b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.332+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2101828375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2520 0x55a6823b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.332+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2101828375 >> 172.21.15.70:0/2101828375 conn(0x55a6822e0cf0 msgr2=0x55a6823ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.333+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2101828375 shutdown_connections 2024-05-08T09:41:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.333+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2101828375 wait complete. 2024-05-08T09:41:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.333+0000 7f5bf2502b80 1 -- start start 2024-05-08T09:41:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.334+0000 7f5bf2502b80 1 Processor -- start 2024-05-08T09:41:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.334+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.334+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2ee0 0x55a6823bbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b7f50 0x55a6823bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a6823bf2b0 con 0x55a6823b7f50 2024-05-08T09:41:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55a68226acb0 con 0x55a6823b2520 2024-05-08T09:41:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55a6823bf430 con 0x55a6823b2ee0 2024-05-08T09:41:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5bf2502b80 10 client.0 _ll_register_callbacks cb 0x55a6822abe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:41:13.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5be5c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b7f50 0x55a6823bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5be5200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5be5200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823be9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:35254/0 (socket says 172.21.15.70:35254) 2024-05-08T09:41:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5be5200700 1 -- 172.21.15.70:0/2531624615 learned_addr learned my addr 172.21.15.70:0/2531624615 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.335+0000 7f5bdfe00700 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2ee0 0x55a6823bbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.336+0000 7f5be5c00700 1 -- 172.21.15.70:0/2531624615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2ee0 msgr2=0x55a6823bbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.336+0000 7f5be5c00700 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2ee0 0x55a6823bbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.336+0000 7f5be5c00700 1 -- 172.21.15.70:0/2531624615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 msgr2=0x55a6823be9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.336+0000 7f5be5c00700 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823be9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.336+0000 7f5be5c00700 1 -- 172.21.15.70:0/2531624615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6822ca5b0 con 0x55a6823b7f50 2024-05-08T09:41:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.336+0000 7f5be5200700 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823be9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:41:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.337+0000 7f5be5c00700 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b7f50 0x55a6823bc2c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8007d10 tx=0x7f5bd8019540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a91d0158ba8d2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:13.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.337+0000 7f5bc6a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:41:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.337+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2531624615 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80a9800 con 0x55a6823b7f50 2024-05-08T09:41:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.337+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2531624615 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(424..424 src has 1..424) ==== 9583+0+0 (secure 0 0 0) 0x7f5bd80a9c70 con 0x55a6823b7f50 2024-05-08T09:41:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.337+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2531624615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bd80adbb0 con 0x55a6823b7f50 2024-05-08T09:41:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.338+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2531624615 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f5bd80b2660 con 0x55a6823b7f50 2024-05-08T09:41:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.338+0000 7f5bf2502b80 10 client.19905 fetch_fsmap learned FSMap version 42 2024-05-08T09:41:13.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.338+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2531624615 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a6823bf2b0 con 0x55a6823b7f50 2024-05-08T09:41:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.338+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2531624615 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bd80adbb0 con 0x55a6823b7f50 2024-05-08T09:41:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.338+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2531624615 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f5bd80aab30 con 0x55a6823b7f50 2024-05-08T09:41:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.338+0000 7f5bf2502b80 10 client.19905 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:41:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.338+0000 7f5bf2502b80 10 client.19905 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:41:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.338+0000 7f5bf2502b80 20 client.19905 populate_metadata read hostname 'smithi070' 2024-05-08T09:41:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.339+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a6823cbe80 0x55a6823ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.339+0000 7f5bf2502b80 4 client.19905 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:41:13.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.339+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2531624615 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a68237f230 con 0x55a6823cbe80 2024-05-08T09:41:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.339+0000 7f5be5200700 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a6823cbe80 0x55a6823ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.340+0000 7f5be5200700 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a6823cbe80 0x55a6823ce270 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d73fef5bf01b01a server_cookie=331ba7d16cdf6ec8 in_seq=0 out_seq=0 2024-05-08T09:41:13.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.340+0000 7f5bc6a00700 10 client.19905 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:41:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.342+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2531624615 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a68237f230 con 0x55a6823cbe80 2024-05-08T09:41:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.342+0000 7f5bc6a00700 10 client.19905 handle_command_reply: tid=0 2024-05-08T09:41:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.342+0000 7f5bf2502b80 1 client.19905 shutdown 2024-05-08T09:41:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.342+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2531624615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b7f50 msgr2=0x55a6823bc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:13.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.342+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b7f50 0x55a6823bc2c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8007d10 tx=0x7f5bd8019540 comp rx=0 tx=0).stop 2024-05-08T09:41:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2531624615 shutdown_connections 2024-05-08T09:41:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a6823cbe80 0x55a6823ce270 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b7f50 0x55a6823bc2c0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823be9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2531624615 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b2ee0 0x55a6823bbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bc6a00700 0 client.19905 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:41:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2531624615 >> 172.21.15.70:0/2531624615 conn(0x55a6822e0cf0 msgr2=0x55a6823a78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2531624615 shutdown_connections 2024-05-08T09:41:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2531624615 wait complete. 2024-05-08T09:41:13.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.343+0000 7f5bf2502b80 20 client.19905 trim_cache size 0 max 16384 2024-05-08T09:41:13.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.374+0000 7f5bf2502b80 1 Processor -- start 2024-05-08T09:41:13.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.374+0000 7f5bf2502b80 1 -- start start 2024-05-08T09:41:13.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.374+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.374+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.374+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 0x55a6823d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.374+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b8400 con 0x55a6823b2ee0 2024-05-08T09:41:13.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.374+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b5c90 con 0x55a6823b2520 2024-05-08T09:41:13.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.374+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b3b00 con 0x55a6823b7f50 2024-05-08T09:41:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.375+0000 7f5bdfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.375+0000 7f5bdfe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54036/0 (socket says 172.21.15.70:54036) 2024-05-08T09:41:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.375+0000 7f5bdfe00700 1 -- 172.21.15.70:0/2969414346 learned_addr learned my addr 172.21.15.70:0/2969414346 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.375+0000 7f5be5200700 1 --2- 172.21.15.70:0/2969414346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.375+0000 7f5be5c00700 1 --2- 172.21.15.70:0/2969414346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 0x55a6823d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.376+0000 7f5bdfe00700 1 -- 172.21.15.70:0/2969414346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 msgr2=0x55a6823d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.376+0000 7f5bdfe00700 1 --2- 172.21.15.70:0/2969414346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 0x55a6823d17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.376+0000 7f5bdfe00700 1 -- 172.21.15.70:0/2969414346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 msgr2=0x55a6823b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:13.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.376+0000 7f5bdfe00700 1 --2- 172.21.15.70:0/2969414346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.376+0000 7f5bdfe00700 1 -- 172.21.15.70:0/2969414346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6823b3300 con 0x55a6823b2ee0 2024-05-08T09:41:13.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.376+0000 7f5bdfe00700 1 --2- 172.21.15.70:0/2969414346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823d1290 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00bc40 tx=0x7f5bcc00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32eba204cc061bfa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:13.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.377+0000 7f5bd1600700 1 -- 172.21.15.70:0/2969414346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc0129d0 con 0x55a6823b2ee0 2024-05-08T09:41:13.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.377+0000 7f5bd1600700 1 -- 172.21.15.70:0/2969414346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bcc004030 con 0x55a6823b2ee0 2024-05-08T09:41:13.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.377+0000 7f5bd1600700 1 -- 172.21.15.70:0/2969414346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bcc003cb0 con 0x55a6823b2ee0 2024-05-08T09:41:13.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.378+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2969414346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 msgr2=0x55a6823d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:13.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.378+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2969414346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823d1290 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc00bc40 tx=0x7f5bcc00bf50 comp rx=0 tx=0).stop 2024-05-08T09:41:13.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.379+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2969414346 shutdown_connections 2024-05-08T09:41:13.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.379+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2969414346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 0x55a6823d17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.379+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2969414346 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2520 0x55a6823b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.379+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2969414346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2ee0 0x55a6823d1290 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.379+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2969414346 >> 172.21.15.70:0/2969414346 conn(0x55a6822e0cf0 msgr2=0x55a6823b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:13.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.379+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2969414346 shutdown_connections 2024-05-08T09:41:13.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.379+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2969414346 wait complete. 2024-05-08T09:41:13.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.380+0000 7f5bf2502b80 1 -- start start 2024-05-08T09:41:13.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.380+0000 7f5bf2502b80 1 Processor -- start 2024-05-08T09:41:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2520 0x55a6823cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2ee0 0x55a6823d0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5bf2502b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 0x55a6823d0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b4150 con 0x55a6823b2520 2024-05-08T09:41:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b55c0 con 0x55a6823b2ee0 2024-05-08T09:41:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5bf2502b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5be01b4820 con 0x55a6823b7f50 2024-05-08T09:41:13.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5bf2502b80 10 client.0 _ll_register_callbacks cb 0x55a6822abe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5be5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2520 0x55a6823cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5be5200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2520 0x55a6823cfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54050/0 (socket says 172.21.15.70:54050) 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5be5200700 1 -- 172.21.15.70:0/2900491538 learned_addr learned my addr 172.21.15.70:0/2900491538 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.381+0000 7f5be5c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 0x55a6823d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.382+0000 7f5bdfe00700 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2ee0 0x55a6823d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.382+0000 7f5be5200700 1 -- 172.21.15.70:0/2900491538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 msgr2=0x55a6823d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.382+0000 7f5be5200700 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 0x55a6823d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.382+0000 7f5be5200700 1 -- 172.21.15.70:0/2900491538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2ee0 msgr2=0x55a6823d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.382+0000 7f5be5200700 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2ee0 0x55a6823d0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:13.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.382+0000 7f5be5200700 1 -- 172.21.15.70:0/2900491538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6823a9a10 con 0x55a6823b2520 2024-05-08T09:41:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.382+0000 7f5be5200700 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2520 0x55a6823cfed0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4003760 tx=0x7f5bd4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35cdc13dd789ef4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:41:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.382+0000 7f5bc6a00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:41:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.383+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2900491538 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd400fc50 con 0x55a6823b2520 2024-05-08T09:41:13.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.383+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2900491538 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(424..424 src has 1..424) ==== 9583+0+0 (secure 0 0 0) 0x7f5bd400fdf0 con 0x55a6823b2520 2024-05-08T09:41:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.383+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2900491538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5bcc004030 con 0x55a6823b2520 2024-05-08T09:41:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.383+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2900491538 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f5bd4047050 con 0x55a6823b2520 2024-05-08T09:41:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.383+0000 7f5bf2502b80 10 client.19911 fetch_fsmap learned FSMap version 42 2024-05-08T09:41:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.383+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2900491538 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55a682437720 con 0x55a6823b2520 2024-05-08T09:41:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.384+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2900491538 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5bcc004030 con 0x55a6823b2520 2024-05-08T09:41:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.385+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2900491538 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7f5bd4024420 con 0x55a6823b2520 2024-05-08T09:41:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.385+0000 7f5bf2502b80 10 client.19911 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:41:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.385+0000 7f5bf2502b80 10 client.19911 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:41:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.385+0000 7f5bf2502b80 20 client.19911 populate_metadata read hostname 'smithi070' 2024-05-08T09:41:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.385+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a682437e40 0x55a68243a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:41:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.385+0000 7f5bf2502b80 4 client.19911 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.3, "await_for": 42.0}] 2024-05-08T09:41:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.385+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2900491538 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 88.3, "await_for": 42.0}) -- 0x55a682312590 con 0x55a682437e40 2024-05-08T09:41:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.386+0000 7f5bdfe00700 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a682437e40 0x55a68243a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:41:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.387+0000 7f5bc6a00700 10 client.19911 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:41:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:13.387+0000 7f5bdfe00700 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a682437e40 0x55a68243a230 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f35c2a380242a7f3 server_cookie=b54a43d4e83061b8 in_seq=0 out_seq=0 2024-05-08T09:41:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:13 smithi172 ceph-mon[33377]: pgmap v5571: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 66 KiB/s wr, 7 op/s 2024-05-08T09:41:13.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:13 smithi194 ceph-mon[33679]: pgmap v5571: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 66 KiB/s wr, 7 op/s 2024-05-08T09:41:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:15 smithi070 ceph-mon[29591]: pgmap v5572: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 66 KiB/s wr, 7 op/s 2024-05-08T09:41:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:15 smithi172 ceph-mon[33377]: pgmap v5572: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 66 KiB/s wr, 7 op/s 2024-05-08T09:41:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:15 smithi194 ceph-mon[33679]: pgmap v5572: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 66 KiB/s wr, 7 op/s 2024-05-08T09:41:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:16 smithi070 ceph-mon[29591]: pgmap v5573: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 451 KiB/s wr, 34 op/s 2024-05-08T09:41:16.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:16 smithi070 ceph-mon[29591]: osdmap e425: 12 total, 12 up, 12 in 2024-05-08T09:41:16.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:16 smithi172 ceph-mon[33377]: pgmap v5573: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 451 KiB/s wr, 34 op/s 2024-05-08T09:41:16.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:16 smithi172 ceph-mon[33377]: osdmap e425: 12 total, 12 up, 12 in 2024-05-08T09:41:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:16 smithi194 ceph-mon[33679]: pgmap v5573: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 413 KiB/s rd, 451 KiB/s wr, 34 op/s 2024-05-08T09:41:16.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:16 smithi194 ceph-mon[33679]: osdmap e425: 12 total, 12 up, 12 in 2024-05-08T09:41:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:18 smithi070 ceph-mon[29591]: pgmap v5575: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 541 KiB/s wr, 36 op/s 2024-05-08T09:41:18.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:18 smithi172 ceph-mon[33377]: pgmap v5575: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 541 KiB/s wr, 36 op/s 2024-05-08T09:41:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:18 smithi194 ceph-mon[33679]: pgmap v5575: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 541 KiB/s wr, 36 op/s 2024-05-08T09:41:20.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:20 smithi070 ceph-mon[29591]: pgmap v5576: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 462 KiB/s wr, 36 op/s 2024-05-08T09:41:20.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:20 smithi172 ceph-mon[33377]: pgmap v5576: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 462 KiB/s wr, 36 op/s 2024-05-08T09:41:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:20 smithi194 ceph-mon[33679]: pgmap v5576: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 462 KiB/s wr, 36 op/s 2024-05-08T09:41:23.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:22 smithi194 ceph-mon[33679]: pgmap v5577: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 462 KiB/s wr, 36 op/s 2024-05-08T09:41:23.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:22 smithi194 ceph-mon[33679]: osdmap e426: 12 total, 12 up, 12 in 2024-05-08T09:41:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:22 smithi070 ceph-mon[29591]: pgmap v5577: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 462 KiB/s wr, 36 op/s 2024-05-08T09:41:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:22 smithi070 ceph-mon[29591]: osdmap e426: 12 total, 12 up, 12 in 2024-05-08T09:41:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:22 smithi172 ceph-mon[33377]: pgmap v5577: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 462 KiB/s wr, 36 op/s 2024-05-08T09:41:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:22 smithi172 ceph-mon[33377]: osdmap e426: 12 total, 12 up, 12 in 2024-05-08T09:41:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:24 smithi194 ceph-mon[33679]: pgmap v5579: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-08T09:41:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:24 smithi070 ceph-mon[29591]: pgmap v5579: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-08T09:41:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:24 smithi172 ceph-mon[33377]: pgmap v5579: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-08T09:41:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:26 smithi194 ceph-mon[33679]: pgmap v5580: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 194 KiB/s wr, 9 op/s 2024-05-08T09:41:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:26 smithi070 ceph-mon[29591]: pgmap v5580: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 194 KiB/s wr, 9 op/s 2024-05-08T09:41:27.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:26 smithi172 ceph-mon[33377]: pgmap v5580: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 194 KiB/s wr, 9 op/s 2024-05-08T09:41:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:28 smithi194 ceph-mon[33679]: pgmap v5581: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 179 KiB/s wr, 8 op/s 2024-05-08T09:41:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:28 smithi070 ceph-mon[29591]: pgmap v5581: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 179 KiB/s wr, 8 op/s 2024-05-08T09:41:29.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:28 smithi172 ceph-mon[33377]: pgmap v5581: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 179 KiB/s wr, 8 op/s 2024-05-08T09:41:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:30 smithi194 ceph-mon[33679]: pgmap v5582: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 249 KiB/s wr, 8 op/s 2024-05-08T09:41:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:30 smithi070 ceph-mon[29591]: pgmap v5582: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 249 KiB/s wr, 8 op/s 2024-05-08T09:41:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:30 smithi172 ceph-mon[33377]: pgmap v5582: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 249 KiB/s wr, 8 op/s 2024-05-08T09:41:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:33 smithi194 ceph-mon[33679]: pgmap v5583: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 249 KiB/s wr, 8 op/s 2024-05-08T09:41:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:33 smithi070 ceph-mon[29591]: pgmap v5583: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 249 KiB/s wr, 8 op/s 2024-05-08T09:41:33.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:33 smithi172 ceph-mon[33377]: pgmap v5583: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 249 KiB/s wr, 8 op/s 2024-05-08T09:41:35.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.031+0000 7f5bc6a00700 1 -- 172.21.15.70:0/2900491538 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55a682312590 con 0x55a682437e40 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.031+0000 7f5bc6a00700 10 client.19911 handle_command_reply: tid=0 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.031+0000 7f5bf2502b80 1 client.19911 shutdown 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.031+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2900491538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2520 msgr2=0x55a6823cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.031+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2520 0x55a6823cfed0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4003760 tx=0x7f5bd4009310 comp rx=0 tx=0).stop 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.032+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2900491538 shutdown_connections 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.032+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55a682437e40 0x55a68243a230 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.032+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55a6823b7f50 0x55a6823d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.032+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a6823b2520 0x55a6823cfed0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.032+0000 7f5bf2502b80 1 --2- 172.21.15.70:0/2900491538 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55a6823b2ee0 0x55a6823d0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.032+0000 7f5bc6a00700 0 client.19911 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.032+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2900491538 >> 172.21.15.70:0/2900491538 conn(0x55a6822e0cf0 msgr2=0x55a6823a7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:35.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.032+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2900491538 shutdown_connections 2024-05-08T09:41:35.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.032+0000 7f5bf2502b80 1 -- 172.21.15.70:0/2900491538 wait complete. 2024-05-08T09:41:35.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.033+0000 7f5bf2502b80 20 client.19911 trim_cache size 0 max 16384 2024-05-08T09:41:35.032 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:41:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:41:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:41:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 382, 2024-05-08T09:41:35.032 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "82e3c7e5": { 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 382, 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.3, 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:41:35.033 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:41:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:35.034 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:41:35.034 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:41:35.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 -- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5bc80b2b20 msgr2=0x7f5bc80b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5bc80b2b20 0x7f5bc80b4fe0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4006010 tx=0x7f5bd400b540 comp rx=0 tx=0).stop 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 -- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be010ff50 msgr2=0x7f5be010ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be010ff50 0x7f5be010ce20 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8007d40 tx=0x7f5bd800a340 comp rx=0 tx=0).stop 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 -- 172.21.15.70:0/3477279204 shutdown_connections 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5bc80b2b20 0x7f5bc80b4fe0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5be010ff50 0x7f5be010ce20 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5be0102ed0 0x7f5be010f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 --2- 172.21.15.70:0/3477279204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5be01037f0 0x7f5be010c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.034+0000 7f5be7c00700 1 -- 172.21.15.70:0/3477279204 >> 172.21.15.70:0/3477279204 conn(0x7f5be0079340 msgr2=0x7f5be0111470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.035+0000 7f5be7c00700 1 -- 172.21.15.70:0/3477279204 shutdown_connections 2024-05-08T09:41:35.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:41:35.035+0000 7f5be7c00700 1 -- 172.21.15.70:0/3477279204 wait complete. 2024-05-08T09:41:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:35 smithi194 ceph-mon[33679]: pgmap v5584: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 220 KiB/s wr, 7 op/s 2024-05-08T09:41:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:35 smithi070 ceph-mon[29591]: pgmap v5584: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 220 KiB/s wr, 7 op/s 2024-05-08T09:41:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:35 smithi172 ceph-mon[33377]: pgmap v5584: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 220 KiB/s wr, 7 op/s 2024-05-08T09:41:36.032 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '82e3c7e5', quiesce took 29.5 seconds. Will release after: 28.3 2024-05-08T09:41:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:37 smithi070 ceph-mon[29591]: pgmap v5585: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 267 KiB/s wr, 13 op/s 2024-05-08T09:41:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:37 smithi172 ceph-mon[33377]: pgmap v5585: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 267 KiB/s wr, 13 op/s 2024-05-08T09:41:37.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:37 smithi194 ceph-mon[33679]: pgmap v5585: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 267 KiB/s wr, 13 op/s 2024-05-08T09:41:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:39 smithi070 ceph-mon[29591]: pgmap v5586: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 119 KiB/s wr, 10 op/s 2024-05-08T09:41:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:39 smithi172 ceph-mon[33377]: pgmap v5586: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 119 KiB/s wr, 10 op/s 2024-05-08T09:41:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:39 smithi194 ceph-mon[33679]: pgmap v5586: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 119 KiB/s wr, 10 op/s 2024-05-08T09:41:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:41 smithi070 ceph-mon[29591]: pgmap v5587: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 180 KiB/s wr, 14 op/s 2024-05-08T09:41:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:41 smithi172 ceph-mon[33377]: pgmap v5587: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 180 KiB/s wr, 14 op/s 2024-05-08T09:41:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:41 smithi194 ceph-mon[33679]: pgmap v5587: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 180 KiB/s wr, 14 op/s 2024-05-08T09:41:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:43 smithi070 ceph-mon[29591]: pgmap v5588: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-05-08T09:41:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:43 smithi172 ceph-mon[33377]: pgmap v5588: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-05-08T09:41:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:43 smithi194 ceph-mon[33679]: pgmap v5588: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-05-08T09:41:45.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:45 smithi070 ceph-mon[29591]: pgmap v5589: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-05-08T09:41:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:45 smithi172 ceph-mon[33377]: pgmap v5589: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-05-08T09:41:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:45 smithi194 ceph-mon[33679]: pgmap v5589: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 122 KiB/s wr, 11 op/s 2024-05-08T09:41:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:47 smithi070 ceph-mon[29591]: pgmap v5590: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 14 op/s 2024-05-08T09:41:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:47 smithi172 ceph-mon[33377]: pgmap v5590: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 14 op/s 2024-05-08T09:41:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:47 smithi194 ceph-mon[33679]: pgmap v5590: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 144 KiB/s wr, 14 op/s 2024-05-08T09:41:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:49 smithi070 ceph-mon[29591]: pgmap v5591: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2024-05-08T09:41:49.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:49 smithi172 ceph-mon[33377]: pgmap v5591: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2024-05-08T09:41:49.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:49 smithi194 ceph-mon[33679]: pgmap v5591: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 84 KiB/s wr, 7 op/s 2024-05-08T09:41:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:51 smithi070 ceph-mon[29591]: pgmap v5592: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 10 op/s 2024-05-08T09:41:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:51 smithi172 ceph-mon[33377]: pgmap v5592: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 10 op/s 2024-05-08T09:41:51.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:51 smithi194 ceph-mon[33679]: pgmap v5592: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 141 KiB/s wr, 10 op/s 2024-05-08T09:41:52.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:52 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:41:52.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:52 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:41:52.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:52 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:41:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:53 smithi070 ceph-mon[29591]: pgmap v5593: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2024-05-08T09:41:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:53 smithi172 ceph-mon[33377]: pgmap v5593: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2024-05-08T09:41:53.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:53 smithi194 ceph-mon[33679]: pgmap v5593: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2024-05-08T09:41:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:41:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:41:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:41:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:41:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:41:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:41:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:41:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:41:54.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:41:55.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:55 smithi070 ceph-mon[29591]: pgmap v5594: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2024-05-08T09:41:55.412 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:55 smithi194 ceph-mon[33679]: pgmap v5594: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2024-05-08T09:41:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:55 smithi172 ceph-mon[33377]: pgmap v5594: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 79 KiB/s wr, 6 op/s 2024-05-08T09:41:56.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:56 smithi070 ceph-mon[29591]: pgmap v5595: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 79 KiB/s wr, 8 op/s 2024-05-08T09:41:56.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:56 smithi172 ceph-mon[33377]: pgmap v5595: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 79 KiB/s wr, 8 op/s 2024-05-08T09:41:56.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:56 smithi194 ceph-mon[33679]: pgmap v5595: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 79 KiB/s wr, 8 op/s 2024-05-08T09:41:58.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:41:58 smithi070 ceph-mon[29591]: pgmap v5596: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 5 op/s 2024-05-08T09:41:58.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:41:58 smithi172 ceph-mon[33377]: pgmap v5596: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 5 op/s 2024-05-08T09:41:58.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:41:58 smithi194 ceph-mon[33679]: pgmap v5596: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 5 op/s 2024-05-08T09:42:00.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:00 smithi070 ceph-mon[29591]: pgmap v5597: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T09:42:00.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:00 smithi172 ceph-mon[33377]: pgmap v5597: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T09:42:00.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:00 smithi194 ceph-mon[33679]: pgmap v5597: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 57 KiB/s wr, 7 op/s 2024-05-08T09:42:02.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:02 smithi070 ceph-mon[29591]: pgmap v5598: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:42:02.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:02 smithi172 ceph-mon[33377]: pgmap v5598: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:42:02.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:02 smithi194 ceph-mon[33679]: pgmap v5598: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:42:04.333 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:42:04.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:04 smithi070 ceph-mon[29591]: pgmap v5599: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:42:04.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:04 smithi172 ceph-mon[33377]: pgmap v5599: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:42:04.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:04 smithi194 ceph-mon[33679]: pgmap v5599: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:42:04.777 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:42:06.660 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:06 smithi070 ceph-mon[29591]: pgmap v5600: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:42:06.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:06 smithi172 ceph-mon[33377]: pgmap v5600: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:42:06.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:06 smithi194 ceph-mon[33679]: pgmap v5600: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:42:07.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.158+0000 7f6dfd800700 1 -- 172.21.15.70:0/675044991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80761f0 msgr2=0x7f6df810f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:07.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.158+0000 7f6dfd800700 1 --2- 172.21.15.70:0/675044991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80761f0 0x7f6df810f6d0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009990 tx=0x7f6de4009ca0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.158+0000 7f6dfd800700 1 -- 172.21.15.70:0/675044991 shutdown_connections 2024-05-08T09:42:07.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.158+0000 7f6dfd800700 1 --2- 172.21.15.70:0/675044991 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df810fc10 0x7f6df8112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.158+0000 7f6dfd800700 1 --2- 172.21.15.70:0/675044991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6df80758d0 0x7f6df8075cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.158+0000 7f6dfd800700 1 --2- 172.21.15.70:0/675044991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80761f0 0x7f6df810f6d0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.158+0000 7f6dfd800700 1 -- 172.21.15.70:0/675044991 >> 172.21.15.70:0/675044991 conn(0x7f6df80fef20 msgr2=0x7f6df8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:42:07.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.159+0000 7f6dfd800700 1 -- 172.21.15.70:0/675044991 shutdown_connections 2024-05-08T09:42:07.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.159+0000 7f6dfd800700 1 -- 172.21.15.70:0/675044991 wait complete. 2024-05-08T09:42:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.160+0000 7f6dfd800700 1 Processor -- start 2024-05-08T09:42:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.160+0000 7f6dfd800700 1 -- start start 2024-05-08T09:42:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6dfd800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80758d0 0x7f6df81a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6dfd800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6df80761f0 0x7f6df81a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6dfd800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df810fc10 0x7f6df819bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6dfd800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6df81156c0 con 0x7f6df80758d0 2024-05-08T09:42:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6dfd800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6df8115540 con 0x7f6df810fc10 2024-05-08T09:42:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6dfd800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6df8115840 con 0x7f6df80761f0 2024-05-08T09:42:07.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80758d0 0x7f6df81a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80758d0 0x7f6df81a1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58736/0 (socket says 172.21.15.70:58736) 2024-05-08T09:42:07.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7e00700 1 -- 172.21.15.70:0/3551685280 learned_addr learned my addr 172.21.15.70:0/3551685280 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:42:07.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7400700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6df80761f0 0x7f6df81a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:07.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7e00700 1 -- 172.21.15.70:0/3551685280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6df80761f0 msgr2=0x7f6df81a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:07.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7e00700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6df80761f0 0x7f6df81a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7e00700 1 -- 172.21.15.70:0/3551685280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df810fc10 msgr2=0x7f6df819bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:07.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7e00700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df810fc10 0x7f6df819bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7e00700 1 -- 172.21.15.70:0/3551685280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df819c2b0 con 0x7f6df80758d0 2024-05-08T09:42:07.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.161+0000 7f6df7400700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6df80761f0 0x7f6df81a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:42:07.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.162+0000 7f6df7e00700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80758d0 0x7f6df81a1940 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f6de800ba50 tx=0x7f6de800be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:42:07.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.162+0000 7f6df4c00700 1 -- 172.21.15.70:0/3551685280 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8019070 con 0x7f6df80758d0 2024-05-08T09:42:07.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.162+0000 7f6df4c00700 1 -- 172.21.15.70:0/3551685280 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6de8014440 con 0x7f6df80758d0 2024-05-08T09:42:07.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.162+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df819c5a0 con 0x7f6df80758d0 2024-05-08T09:42:07.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.162+0000 7f6df4c00700 1 -- 172.21.15.70:0/3551685280 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de80075d0 con 0x7f6df80758d0 2024-05-08T09:42:07.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.162+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df81a8810 con 0x7f6df80758d0 2024-05-08T09:42:07.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.163+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df806a190 con 0x7f6df80758d0 2024-05-08T09:42:07.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.167+0000 7f6df4c00700 1 -- 172.21.15.70:0/3551685280 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6de801c070 con 0x7f6df80758d0 2024-05-08T09:42:07.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.169+0000 7f6df4c00700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6ddc0b2a70 0x7f6ddc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:07.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.169+0000 7f6df4c00700 1 -- 172.21.15.70:0/3551685280 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(426..426 src has 1..426) ==== 9583+0+0 (secure 0 0 0) 0x7f6de80e26d0 con 0x7f6df80758d0 2024-05-08T09:42:07.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.169+0000 7f6df7400700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6ddc0b2a70 0x7f6ddc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:07.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.170+0000 7f6df7400700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6ddc0b2a70 0x7f6ddc0b4f30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6de4000c00 tx=0x7f6de4005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:42:07.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.171+0000 7f6df4c00700 1 -- 172.21.15.70:0/3551685280 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6de8023070 con 0x7f6df80758d0 2024-05-08T09:42:07.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.453+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6df819cff0 con 0x7f6df80758d0 2024-05-08T09:42:07.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.454+0000 7f6df4c00700 1 -- 172.21.15.70:0/3551685280 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11876 (secure 0 0 0) 0x7f6de80a9d40 con 0x7f6df80758d0 2024-05-08T09:42:07.454 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:42:07.454 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T07:30:32.244588+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:42:07.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6ddc0b2a70 msgr2=0x7f6ddc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6ddc0b2a70 0x7f6ddc0b4f30 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6de4000c00 tx=0x7f6de4005fb0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80758d0 msgr2=0x7f6df81a1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80758d0 0x7f6df81a1940 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f6de800ba50 tx=0x7f6de800be10 comp rx=0 tx=0).stop 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 shutdown_connections 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6ddc0b2a70 0x7f6ddc0b4f30 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6df810fc10 0x7f6df819bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6df80758d0 0x7f6df81a1940 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 --2- 172.21.15.70:0/3551685280 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6df80761f0 0x7f6df81a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.457+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 >> 172.21.15.70:0/3551685280 conn(0x7f6df80fef20 msgr2=0x7f6df80ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.458+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 shutdown_connections 2024-05-08T09:42:07.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:07.458+0000 7f6dfd800700 1 -- 172.21.15.70:0/3551685280 wait complete. 2024-05-08T09:42:07.458 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 42 2024-05-08T09:42:08.303 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 82e3c7e5 --release --await' 2024-05-08T09:42:08.303 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 82e3c7e5 --release --await 2024-05-08T09:42:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:08 smithi070 ceph-mon[29591]: pgmap v5601: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:42:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3551685280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:42:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:08 smithi172 ceph-mon[33377]: pgmap v5601: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:42:08.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3551685280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:42:08.749 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:42:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:08 smithi194 ceph-mon[33679]: pgmap v5601: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:42:08.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3551685280' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:42:10.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:10 smithi172 ceph-mon[33377]: pgmap v5602: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:42:10.682 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:10 smithi070 ceph-mon[29591]: pgmap v5602: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:42:10.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:10 smithi194 ceph-mon[33679]: pgmap v5602: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:42:11.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.032+0000 7efc81e00700 1 -- 172.21.15.70:0/2061797121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 msgr2=0x7efc7c112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:11.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.032+0000 7efc81e00700 1 --2- 172.21.15.70:0/2061797121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 0x7efc7c112590 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7efc7400b0a0 tx=0x7efc7400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.032+0000 7efc81e00700 1 -- 172.21.15.70:0/2061797121 shutdown_connections 2024-05-08T09:42:11.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.032+0000 7efc81e00700 1 --2- 172.21.15.70:0/2061797121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 0x7efc7c112590 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.032+0000 7efc81e00700 1 --2- 172.21.15.70:0/2061797121 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc7c10b6c0 0x7efc7c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.032+0000 7efc81e00700 1 --2- 172.21.15.70:0/2061797121 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc7c1056c0 0x7efc7c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.032+0000 7efc81e00700 1 -- 172.21.15.70:0/2061797121 >> 172.21.15.70:0/2061797121 conn(0x7efc7c1011b0 msgr2=0x7efc7c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:42:11.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.033+0000 7efc81e00700 1 -- 172.21.15.70:0/2061797121 shutdown_connections 2024-05-08T09:42:11.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.033+0000 7efc81e00700 1 -- 172.21.15.70:0/2061797121 wait complete. 2024-05-08T09:42:11.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.034+0000 7efc81e00700 1 Processor -- start 2024-05-08T09:42:11.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.034+0000 7efc81e00700 1 -- start start 2024-05-08T09:42:11.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.034+0000 7efc81e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc7c1056c0 0x7efc7c1a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.034+0000 7efc81e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 0x7efc7c1a1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.034+0000 7efc81e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc7c10b6c0 0x7efc7c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.034+0000 7efc81e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c115750 con 0x7efc7c106080 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.034+0000 7efc81e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1155d0 con 0x7efc7c10b6c0 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.034+0000 7efc81e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1158d0 con 0x7efc7c1056c0 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 0x7efc7c1a1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 0x7efc7c1a1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50006/0 (socket says 172.21.15.70:50006) 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7a000700 1 -- 172.21.15.70:0/816827578 learned_addr learned my addr 172.21.15.70:0/816827578 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7aa00700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc7c1056c0 0x7efc7c1a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7b400700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc7c10b6c0 0x7efc7c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7a000700 1 -- 172.21.15.70:0/816827578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc7c1056c0 msgr2=0x7efc7c1a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7a000700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc7c1056c0 0x7efc7c1a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7a000700 1 -- 172.21.15.70:0/816827578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc7c10b6c0 msgr2=0x7efc7c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7a000700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc7c10b6c0 0x7efc7c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7a000700 1 -- 172.21.15.70:0/816827578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc7c19c110 con 0x7efc7c106080 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7b400700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc7c10b6c0 0x7efc7c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:42:11.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.035+0000 7efc7a000700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 0x7efc7c1a1d30 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7efc6800d950 tx=0x7efc6800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:42:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.036+0000 7efc80a00700 1 -- 172.21.15.70:0/816827578 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68016070 con 0x7efc7c106080 2024-05-08T09:42:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.036+0000 7efc80a00700 1 -- 172.21.15.70:0/816827578 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc68010460 con 0x7efc7c106080 2024-05-08T09:42:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.036+0000 7efc80a00700 1 -- 172.21.15.70:0/816827578 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6800f620 con 0x7efc7c106080 2024-05-08T09:42:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.036+0000 7efc81e00700 1 -- 172.21.15.70:0/816827578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc7c19c3a0 con 0x7efc7c106080 2024-05-08T09:42:11.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.036+0000 7efc81e00700 1 -- 172.21.15.70:0/816827578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc7c1a86c0 con 0x7efc7c106080 2024-05-08T09:42:11.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.039+0000 7efc80a00700 1 -- 172.21.15.70:0/816827578 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7efc68019070 con 0x7efc7c106080 2024-05-08T09:42:11.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.040+0000 7efc8c728b80 1 Processor -- start 2024-05-08T09:42:11.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc8c728b80 1 -- start start 2024-05-08T09:42:11.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc80a00700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc600b2a70 0x7efc600b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b774d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747490 0x5566b7747910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7753c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc8c728b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566b7699b20 con 0x5566b774cec0 2024-05-08T09:42:11.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc8c728b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5566b7637860 con 0x5566b7747e50 2024-05-08T09:42:11.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc8c728b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5566b7695ae0 con 0x5566b7747490 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc80a00700 1 -- 172.21.15.70:0/816827578 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(426..426 src has 1..426) ==== 9583+0+0 (secure 0 0 0) 0x7efc680e25d0 con 0x7efc7c106080 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.041+0000 7efc7b400700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc600b2a70 0x7efc600b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b774d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b774d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50010/0 (socket says 172.21.15.70:50010) 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7aa00700 1 -- 172.21.15.70:0/357953548 learned_addr learned my addr 172.21.15.70:0/357953548 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7a000700 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747490 0x5566b7747910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7b400700 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7753c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7aa00700 1 -- 172.21.15.70:0/357953548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747490 msgr2=0x5566b7747910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7aa00700 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747490 0x5566b7747910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7aa00700 1 -- 172.21.15.70:0/357953548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 msgr2=0x5566b7753c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7aa00700 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7753c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7aa00700 1 -- 172.21.15.70:0/357953548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566b75e69d0 con 0x5566b774cec0 2024-05-08T09:42:11.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.042+0000 7efc7b400700 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7753c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.043+0000 7efc7aa00700 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b774d2a0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7efc6c008b80 tx=0x7efc6c008e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae26bbd3295203d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.043+0000 7efc7b400700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc600b2a70 0x7efc600b4f30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efc74009e60 tx=0x7efc74009310 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.043+0000 7efc70c00700 1 -- 172.21.15.70:0/357953548 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c014070 con 0x5566b774cec0 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.043+0000 7efc70c00700 1 -- 172.21.15.70:0/357953548 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc6c00ed10 con 0x5566b774cec0 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.043+0000 7efc70c00700 1 -- 172.21.15.70:0/357953548 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c005690 con 0x5566b774cec0 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.044+0000 7efc8c728b80 1 -- 172.21.15.70:0/357953548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 msgr2=0x5566b774d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.044+0000 7efc8c728b80 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b774d2a0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7efc6c008b80 tx=0x7efc6c008e90 comp rx=0 tx=0).stop 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.044+0000 7efc8c728b80 1 -- 172.21.15.70:0/357953548 shutdown_connections 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.044+0000 7efc8c728b80 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7753c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.044+0000 7efc8c728b80 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b774d2a0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.044+0000 7efc8c728b80 1 --2- 172.21.15.70:0/357953548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747490 0x5566b7747910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.044+0000 7efc8c728b80 1 -- 172.21.15.70:0/357953548 >> 172.21.15.70:0/357953548 conn(0x5566b7675c60 msgr2=0x5566b7741d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.044+0000 7efc8c728b80 1 -- 172.21.15.70:0/357953548 shutdown_connections 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.044+0000 7efc8c728b80 1 -- 172.21.15.70:0/357953548 wait complete. 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.045+0000 7efc8c728b80 1 -- start start 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.045+0000 7efc8c728b80 1 Processor -- start 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.045+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7753860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.045+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7750c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.045+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 0x5566b7751190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.045+0000 7efc8c728b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5566b7754280 con 0x5566b7747490 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.045+0000 7efc8c728b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5566b75ffc20 con 0x5566b7747e50 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.045+0000 7efc8c728b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5566b7754400 con 0x5566b774cec0 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc8c728b80 10 client.0 _ll_register_callbacks cb 0x5566b7640d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7753860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7753860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50024/0 (socket says 172.21.15.70:50024) 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7aa00700 1 -- 172.21.15.70:0/3127132720 learned_addr learned my addr 172.21.15.70:0/3127132720 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:42:11.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7b400700 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 0x5566b7751190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7a000700 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7750c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7aa00700 1 -- 172.21.15.70:0/3127132720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 msgr2=0x5566b7751190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:42:11.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7aa00700 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 0x5566b7751190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7aa00700 1 -- 172.21.15.70:0/3127132720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 msgr2=0x5566b7750c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7aa00700 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7750c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.046+0000 7efc7aa00700 1 -- 172.21.15.70:0/3127132720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566b765f520 con 0x5566b7747490 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.047+0000 7efc7aa00700 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7753860 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7efc6c004980 tx=0x7efc6c004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b63a28766f9b602 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.047+0000 7efc65600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.047+0000 7efc65600700 1 -- 172.21.15.70:0/3127132720 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c014070 con 0x5566b7747490 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.047+0000 7efc65600700 1 -- 172.21.15.70:0/3127132720 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(426..426 src has 1..426) ==== 9583+0+0 (secure 0 0 0) 0x7efc6c00eb10 con 0x5566b7747490 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.047+0000 7efc8c728b80 1 -- 172.21.15.70:0/3127132720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc6c00ed10 con 0x5566b7747490 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.047+0000 7efc65600700 1 -- 172.21.15.70:0/3127132720 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7efc6c004030 con 0x5566b7747490 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.047+0000 7efc8c728b80 10 client.19929 fetch_fsmap learned FSMap version 42 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.047+0000 7efc8c728b80 1 -- 172.21.15.70:0/3127132720 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5566b775e9d0 con 0x5566b7747490 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.048+0000 7efc65600700 1 -- 172.21.15.70:0/3127132720 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc6c00ed10 con 0x5566b7747490 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.048+0000 7efc65600700 1 -- 172.21.15.70:0/3127132720 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7efc6c003af0 con 0x5566b7747490 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.048+0000 7efc8c728b80 10 client.19929 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.048+0000 7efc8c728b80 10 client.19929 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:42:11.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.048+0000 7efc8c728b80 20 client.19929 populate_metadata read hostname 'smithi070' 2024-05-08T09:42:11.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.048+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5566b7760fb0 0x5566b77633a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.048+0000 7efc8c728b80 4 client.19929 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:42:11.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.048+0000 7efc8c728b80 1 -- 172.21.15.70:0/3127132720 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566b77141a0 con 0x5566b7760fb0 2024-05-08T09:42:11.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.049+0000 7efc7a000700 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5566b7760fb0 0x5566b77633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.050+0000 7efc7a000700 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5566b7760fb0 0x5566b77633a0 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a79c414568a7e6b server_cookie=baa426cb735025f6 in_seq=0 out_seq=0 2024-05-08T09:42:11.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.050+0000 7efc65600700 10 client.19929 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:42:11.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc65600700 1 -- 172.21.15.70:0/3127132720 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5566b77141a0 con 0x5566b7760fb0 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc65600700 10 client.19929 handle_command_reply: tid=0 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 client.19929 shutdown 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 -- 172.21.15.70:0/3127132720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 msgr2=0x5566b7753860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7753860 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7efc6c004980 tx=0x7efc6c004a60 comp rx=0 tx=0).stop 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 -- 172.21.15.70:0/3127132720 shutdown_connections 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5566b7760fb0 0x5566b77633a0 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 0x5566b7751190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7753860 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3127132720 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7750c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc65600700 0 client.19929 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 -- 172.21.15.70:0/3127132720 >> 172.21.15.70:0/3127132720 conn(0x5566b7675c60 msgr2=0x5566b773c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 -- 172.21.15.70:0/3127132720 shutdown_connections 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.052+0000 7efc8c728b80 1 -- 172.21.15.70:0/3127132720 wait complete. 2024-05-08T09:42:11.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.053+0000 7efc8c728b80 20 client.19929 trim_cache size 0 max 16384 2024-05-08T09:42:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.074+0000 7efc8c728b80 1 Processor -- start 2024-05-08T09:42:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.074+0000 7efc8c728b80 1 -- start start 2024-05-08T09:42:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.074+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747490 0x5566b775d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.074+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747e50 0x5566b774b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.072 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.074+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b773bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.074+0000 7efc8c728b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1b4010 con 0x5566b774cec0 2024-05-08T09:42:11.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.074+0000 7efc8c728b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1b18a0 con 0x5566b7747490 2024-05-08T09:42:11.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.074+0000 7efc8c728b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1af710 con 0x5566b7747e50 2024-05-08T09:42:11.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b773bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b773bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50036/0 (socket says 172.21.15.70:50036) 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7b400700 1 -- 172.21.15.70:0/1411542698 learned_addr learned my addr 172.21.15.70:0/1411542698 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7a000700 1 --2- 172.21.15.70:0/1411542698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747e50 0x5566b774b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7aa00700 1 --2- 172.21.15.70:0/1411542698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747490 0x5566b775d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7b400700 1 -- 172.21.15.70:0/1411542698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747e50 msgr2=0x5566b774b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7b400700 1 --2- 172.21.15.70:0/1411542698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747e50 0x5566b774b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7b400700 1 -- 172.21.15.70:0/1411542698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747490 msgr2=0x5566b775d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7b400700 1 --2- 172.21.15.70:0/1411542698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747490 0x5566b775d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.075+0000 7efc7b400700 1 -- 172.21.15.70:0/1411542698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566b773e980 con 0x5566b774cec0 2024-05-08T09:42:11.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.076+0000 7efc7b400700 1 --2- 172.21.15.70:0/1411542698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b773bfc0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7efc74004d10 tx=0x7efc74023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243c54ee58e6ff43 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.076+0000 7efc67e00700 1 -- 172.21.15.70:0/1411542698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7402a480 con 0x5566b774cec0 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.076+0000 7efc67e00700 1 -- 172.21.15.70:0/1411542698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc7402aab0 con 0x5566b774cec0 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.076+0000 7efc67e00700 1 -- 172.21.15.70:0/1411542698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7401e860 con 0x5566b774cec0 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.077+0000 7efc8c728b80 1 -- 172.21.15.70:0/1411542698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 msgr2=0x5566b773bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.077+0000 7efc8c728b80 1 --2- 172.21.15.70:0/1411542698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b773bfc0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7efc74004d10 tx=0x7efc74023000 comp rx=0 tx=0).stop 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.077+0000 7efc8c728b80 1 -- 172.21.15.70:0/1411542698 shutdown_connections 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.077+0000 7efc8c728b80 1 --2- 172.21.15.70:0/1411542698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b774cec0 0x5566b773bfc0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.077+0000 7efc8c728b80 1 --2- 172.21.15.70:0/1411542698 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747490 0x5566b775d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.077+0000 7efc8c728b80 1 --2- 172.21.15.70:0/1411542698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b7747e50 0x5566b774b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.077+0000 7efc8c728b80 1 -- 172.21.15.70:0/1411542698 >> 172.21.15.70:0/1411542698 conn(0x5566b7675c60 msgr2=0x5566b7746d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.077+0000 7efc8c728b80 1 -- 172.21.15.70:0/1411542698 shutdown_connections 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.077+0000 7efc8c728b80 1 -- 172.21.15.70:0/1411542698 wait complete. 2024-05-08T09:42:11.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.078+0000 7efc8c728b80 1 -- start start 2024-05-08T09:42:11.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.078+0000 7efc8c728b80 1 Processor -- start 2024-05-08T09:42:11.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.078+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7759650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.078+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7759b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.078+0000 7efc8c728b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 0x5566b7756620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.078+0000 7efc8c728b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1afd60 con 0x5566b7747490 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.078+0000 7efc8c728b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1b11d0 con 0x5566b7747e50 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.078+0000 7efc8c728b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7efc7c1b0430 con 0x5566b774cec0 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc8c728b80 10 client.0 _ll_register_callbacks cb 0x5566b7640d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7759650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7759650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:50042/0 (socket says 172.21.15.70:50042) 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7aa00700 1 -- 172.21.15.70:0/3298238482 learned_addr learned my addr 172.21.15.70:0/3298238482 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7b400700 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 0x5566b7756620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7a000700 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7759b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7aa00700 1 -- 172.21.15.70:0/3298238482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 msgr2=0x5566b7756620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7aa00700 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 0x5566b7756620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7aa00700 1 -- 172.21.15.70:0/3298238482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 msgr2=0x5566b7759b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7aa00700 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7759b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7aa00700 1 -- 172.21.15.70:0/3298238482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566b7756b90 con 0x5566b7747490 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7b400700 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 0x5566b7756620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc7aa00700 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7759650 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7efc6c010520 tx=0x7efc6c004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c1284d4976b1a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.079+0000 7efc65600700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.080+0000 7efc65600700 1 -- 172.21.15.70:0/3298238482 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6c014070 con 0x5566b7747490 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.080+0000 7efc65600700 1 -- 172.21.15.70:0/3298238482 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(426..426 src has 1..426) ==== 9583+0+0 (secure 0 0 0) 0x7efc6c005000 con 0x5566b7747490 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.080+0000 7efc8c728b80 1 -- 172.21.15.70:0/3298238482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc7402aab0 con 0x5566b7747490 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.080+0000 7efc65600700 1 -- 172.21.15.70:0/3298238482 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7efc6c005690 con 0x5566b7747490 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.080+0000 7efc8c728b80 10 client.19935 fetch_fsmap learned FSMap version 42 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.080+0000 7efc8c728b80 1 -- 172.21.15.70:0/3298238482 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5566b77d4750 con 0x5566b7747490 2024-05-08T09:42:11.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.080+0000 7efc65600700 1 -- 172.21.15.70:0/3298238482 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc7402aab0 con 0x5566b7747490 2024-05-08T09:42:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.081+0000 7efc65600700 1 -- 172.21.15.70:0/3298238482 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 42) ==== 8346+0+0 (secure 0 0 0) 0x7efc6c010550 con 0x5566b7747490 2024-05-08T09:42:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.081+0000 7efc8c728b80 10 client.19935 fetch_fsmap finished waiting for FSMap version 42 2024-05-08T09:42:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.081+0000 7efc8c728b80 10 client.19935 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:42:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.081+0000 7efc8c728b80 20 client.19935 populate_metadata read hostname 'smithi070' 2024-05-08T09:42:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.081+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5566b77d4d40 0x5566b77d7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:42:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.081+0000 7efc8c728b80 4 client.19935 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "82e3c7e5", "release": true, "await": true}] 2024-05-08T09:42:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.081+0000 7efc8c728b80 1 -- 172.21.15.70:0/3298238482 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "82e3c7e5", "release": true, "await": true}) -- 0x5566b76a7500 con 0x5566b77d4d40 2024-05-08T09:42:11.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.081+0000 7efc7a000700 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5566b77d4d40 0x5566b77d7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:42:11.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.082+0000 7efc7a000700 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5566b77d4d40 0x5566b77d7160 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=455206c983306073 server_cookie=da93bfb1c9d0f026 in_seq=0 out_seq=0 2024-05-08T09:42:11.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:11.082+0000 7efc65600700 10 client.19935 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:42:12.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:12 smithi172 ceph-mon[33377]: pgmap v5603: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:42:12.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:12 smithi172 ceph-mon[33377]: osdmap e427: 12 total, 12 up, 12 in 2024-05-08T09:42:12.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:12 smithi194 ceph-mon[33679]: pgmap v5603: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:42:12.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:12 smithi194 ceph-mon[33679]: osdmap e427: 12 total, 12 up, 12 in 2024-05-08T09:42:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:12 smithi070 ceph-mon[29591]: pgmap v5603: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:42:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:12 smithi070 ceph-mon[29591]: osdmap e427: 12 total, 12 up, 12 in 2024-05-08T09:42:14.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:14 smithi172 ceph-mon[33377]: pgmap v5605: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:42:14.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:14 smithi194 ceph-mon[33679]: pgmap v5605: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:42:14.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:14 smithi070 ceph-mon[29591]: pgmap v5605: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:42:15.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.787+0000 7efc65600700 1 -- 172.21.15.70:0/3298238482 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5566b76a7500 con 0x5566b77d4d40 2024-05-08T09:42:15.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.787+0000 7efc65600700 10 client.19935 handle_command_reply: tid=0 2024-05-08T09:42:15.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.787+0000 7efc8c728b80 1 client.19935 shutdown 2024-05-08T09:42:15.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.787+0000 7efc8c728b80 1 -- 172.21.15.70:0/3298238482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 msgr2=0x5566b7759650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:15.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.787+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7759650 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7efc6c010520 tx=0x7efc6c004f00 comp rx=0 tx=0).stop 2024-05-08T09:42:15.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.788+0000 7efc8c728b80 1 -- 172.21.15.70:0/3298238482 shutdown_connections 2024-05-08T09:42:15.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.788+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5566b77d4d40 0x5566b77d7160 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:15.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.788+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5566b774cec0 0x5566b7756620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:15.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.788+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5566b7747490 0x5566b7759650 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:15.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.788+0000 7efc8c728b80 1 --2- 172.21.15.70:0/3298238482 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5566b7747e50 0x5566b7759b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:15.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.788+0000 7efc65600700 0 client.19935 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:42:15.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.788+0000 7efc8c728b80 1 -- 172.21.15.70:0/3298238482 >> 172.21.15.70:0/3298238482 conn(0x5566b7675c60 msgr2=0x5566b773bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:42:15.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.788+0000 7efc8c728b80 1 -- 172.21.15.70:0/3298238482 shutdown_connections 2024-05-08T09:42:15.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.789+0000 7efc8c728b80 1 -- 172.21.15.70:0/3298238482 wait complete. 2024-05-08T09:42:15.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.789+0000 7efc8c728b80 20 client.19935 trim_cache size 0 max 16384 2024-05-08T09:42:15.791 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:42:15.791 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 42, 2024-05-08T09:42:15.791 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:42:15.791 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 384, 2024-05-08T09:42:15.791 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:42:15.792 INFO:teuthology.orchestra.run.smithi070.stdout: "82e3c7e5": { 2024-05-08T09:42:15.792 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 384, 2024-05-08T09:42:15.792 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:42:15.792 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:42:15.792 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:42:15.792 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:42:15.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:42:15.793 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:42:15.793 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 88.3, 2024-05-08T09:42:15.793 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:42:15.793 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:42:15.794 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:42:15.794 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:42:15.794 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:42:15.794 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:42:15.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:42:15.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:42:15.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:42:15.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:42:15.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:42:15.795 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:42:15.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.790+0000 7efc81e00700 1 -- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc600b2a70 msgr2=0x7efc600b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:15.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.790+0000 7efc81e00700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc600b2a70 0x7efc600b4f30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efc74009e60 tx=0x7efc74009310 comp rx=0 tx=0).stop 2024-05-08T09:42:15.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.790+0000 7efc81e00700 1 -- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 msgr2=0x7efc7c1a1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:42:15.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.790+0000 7efc81e00700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 0x7efc7c1a1d30 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7efc6800d950 tx=0x7efc6800dd10 comp rx=0 tx=0).stop 2024-05-08T09:42:15.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.791+0000 7efc81e00700 1 -- 172.21.15.70:0/816827578 shutdown_connections 2024-05-08T09:42:15.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.791+0000 7efc81e00700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7efc600b2a70 0x7efc600b4f30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:15.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.791+0000 7efc81e00700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7efc7c10b6c0 0x7efc7c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:15.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.791+0000 7efc81e00700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc7c1056c0 0x7efc7c1a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:15.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.791+0000 7efc81e00700 1 --2- 172.21.15.70:0/816827578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc7c106080 0x7efc7c1a1d30 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:42:15.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.791+0000 7efc81e00700 1 -- 172.21.15.70:0/816827578 >> 172.21.15.70:0/816827578 conn(0x7efc7c1011b0 msgr2=0x7efc7c101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:42:15.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.791+0000 7efc81e00700 1 -- 172.21.15.70:0/816827578 shutdown_connections 2024-05-08T09:42:15.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:42:15.791+0000 7efc81e00700 1 -- 172.21.15.70:0/816827578 wait complete. 2024-05-08T09:42:16.595 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:16 smithi070 ceph-mon[29591]: pgmap v5606: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-05-08T09:42:16.651 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '82e3c7e5', seconds elapsed: 70.2 2024-05-08T09:42:16.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:16 smithi172 ceph-mon[33377]: pgmap v5606: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-05-08T09:42:16.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:16 smithi194 ceph-mon[33679]: pgmap v5606: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 3.7 KiB/s wr, 7 op/s 2024-05-08T09:42:17.652 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/netfilter/xt_addrtype.mod.o 2024-05-08T09:42:17.772 INFO:tasks.workunit.client.0.smithi070.stdout: CC [M] net/ipv4/netfilter/iptable_nat.mod.o 2024-05-08T09:42:17.892 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] fs/efivarfs/efivarfs.ko 2024-05-08T09:42:17.892 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-08T09:42:17.902 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] net/netfilter/nf_log_syslog.ko 2024-05-08T09:42:17.903 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] net/netfilter/xt_nat.ko 2024-05-08T09:42:17.909 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] net/netfilter/xt_LOG.ko 2024-05-08T09:42:18.040 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] net/netfilter/xt_MASQUERADE.ko 2024-05-08T09:42:18.050 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] net/netfilter/xt_mark.ko 2024-05-08T09:42:18.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:18 smithi194 ceph-mon[33679]: osdmap e428: 12 total, 12 up, 12 in 2024-05-08T09:42:18.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:18 smithi070 ceph-mon[29591]: osdmap e428: 12 total, 12 up, 12 in 2024-05-08T09:42:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:18 smithi172 ceph-mon[33377]: osdmap e428: 12 total, 12 up, 12 in 2024-05-08T09:42:19.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:19 smithi194 ceph-mon[33679]: pgmap v5608: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-05-08T09:42:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:19 smithi070 ceph-mon[29591]: pgmap v5608: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-05-08T09:42:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:19 smithi172 ceph-mon[33377]: pgmap v5608: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4.5 KiB/s wr, 5 op/s 2024-05-08T09:42:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:21 smithi070 ceph-mon[29591]: pgmap v5609: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 883 KiB/s wr, 48 op/s 2024-05-08T09:42:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:21 smithi172 ceph-mon[33377]: pgmap v5609: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 883 KiB/s wr, 48 op/s 2024-05-08T09:42:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:21 smithi194 ceph-mon[33679]: pgmap v5609: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 883 KiB/s wr, 48 op/s 2024-05-08T09:42:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:23 smithi070 ceph-mon[29591]: pgmap v5610: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 713 KiB/s wr, 39 op/s 2024-05-08T09:42:23.416 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] net/netfilter/xt_addrtype.ko 2024-05-08T09:42:23.428 INFO:tasks.workunit.client.0.smithi070.stdout: LD [M] net/ipv4/netfilter/iptable_nat.ko 2024-05-08T09:42:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:23 smithi172 ceph-mon[33377]: pgmap v5610: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 713 KiB/s wr, 39 op/s 2024-05-08T09:42:23.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:23 smithi194 ceph-mon[33679]: pgmap v5610: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 713 KiB/s wr, 39 op/s 2024-05-08T09:42:25.313 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:25 smithi194 ceph-mon[33679]: pgmap v5611: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 707 KiB/s wr, 38 op/s 2024-05-08T09:42:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:25 smithi070 ceph-mon[29591]: pgmap v5611: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 707 KiB/s wr, 38 op/s 2024-05-08T09:42:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:25 smithi172 ceph-mon[33377]: pgmap v5611: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 707 KiB/s wr, 38 op/s 2024-05-08T09:42:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:27 smithi070 ceph-mon[29591]: pgmap v5612: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 859 KiB/s wr, 47 op/s 2024-05-08T09:42:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:27 smithi172 ceph-mon[33377]: pgmap v5612: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 859 KiB/s wr, 47 op/s 2024-05-08T09:42:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:27 smithi194 ceph-mon[33679]: pgmap v5612: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 859 KiB/s wr, 47 op/s 2024-05-08T09:42:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:29 smithi070 ceph-mon[29591]: pgmap v5613: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 833 KiB/s wr, 45 op/s 2024-05-08T09:42:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:29 smithi172 ceph-mon[33377]: pgmap v5613: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 833 KiB/s wr, 45 op/s 2024-05-08T09:42:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:29 smithi194 ceph-mon[33679]: pgmap v5613: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 833 KiB/s wr, 45 op/s 2024-05-08T09:42:30.198 INFO:tasks.workunit.client.0.smithi070.stdout: UPD include/generated/utsversion.h 2024-05-08T09:42:30.273 INFO:tasks.workunit.client.0.smithi070.stdout: CC init/version-timestamp.o 2024-05-08T09:42:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:31 smithi070 ceph-mon[29591]: pgmap v5614: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 937 KiB/s wr, 45 op/s 2024-05-08T09:42:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:31 smithi172 ceph-mon[33377]: pgmap v5614: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 937 KiB/s wr, 45 op/s 2024-05-08T09:42:31.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:31 smithi194 ceph-mon[33679]: pgmap v5614: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 507 KiB/s rd, 937 KiB/s wr, 45 op/s 2024-05-08T09:42:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:33 smithi070 ceph-mon[29591]: pgmap v5615: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 17 op/s 2024-05-08T09:42:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:33 smithi172 ceph-mon[33377]: pgmap v5615: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 17 op/s 2024-05-08T09:42:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:33 smithi194 ceph-mon[33679]: pgmap v5615: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 17 op/s 2024-05-08T09:42:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:35 smithi070 ceph-mon[29591]: pgmap v5616: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 17 op/s 2024-05-08T09:42:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:35 smithi172 ceph-mon[33377]: pgmap v5616: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 17 op/s 2024-05-08T09:42:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:35 smithi194 ceph-mon[33679]: pgmap v5616: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 351 KiB/s wr, 17 op/s 2024-05-08T09:42:37.198 INFO:tasks.workunit.client.0.smithi070.stdout: LD .tmp_vmlinux.kallsyms1 2024-05-08T09:42:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:37 smithi070 ceph-mon[29591]: pgmap v5617: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 487 KiB/s wr, 22 op/s 2024-05-08T09:42:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:37 smithi172 ceph-mon[33377]: pgmap v5617: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 487 KiB/s wr, 22 op/s 2024-05-08T09:42:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:37 smithi194 ceph-mon[33679]: pgmap v5617: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 432 KiB/s rd, 487 KiB/s wr, 22 op/s 2024-05-08T09:42:39.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:39 smithi070 ceph-mon[29591]: pgmap v5618: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 357 KiB/s wr, 11 op/s 2024-05-08T09:42:39.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:39 smithi172 ceph-mon[33377]: pgmap v5618: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 357 KiB/s wr, 11 op/s 2024-05-08T09:42:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:39 smithi194 ceph-mon[33679]: pgmap v5618: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 311 KiB/s rd, 357 KiB/s wr, 11 op/s 2024-05-08T09:42:41.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:41 smithi070 ceph-mon[29591]: pgmap v5619: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 2.4 MiB/s wr, 25 op/s 2024-05-08T09:42:41.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:41 smithi172 ceph-mon[33377]: pgmap v5619: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 2.4 MiB/s wr, 25 op/s 2024-05-08T09:42:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:41 smithi194 ceph-mon[33679]: pgmap v5619: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 2.4 MiB/s wr, 25 op/s 2024-05-08T09:42:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:43 smithi070 ceph-mon[29591]: pgmap v5620: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 2.2 MiB/s wr, 18 op/s 2024-05-08T09:42:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:43 smithi172 ceph-mon[33377]: pgmap v5620: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 2.2 MiB/s wr, 18 op/s 2024-05-08T09:42:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:43 smithi194 ceph-mon[33679]: pgmap v5620: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 2.2 MiB/s wr, 18 op/s 2024-05-08T09:42:44.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:44 smithi070 ceph-mon[29591]: pgmap v5621: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 2.2 MiB/s wr, 18 op/s 2024-05-08T09:42:44.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:44 smithi172 ceph-mon[33377]: pgmap v5621: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 2.2 MiB/s wr, 18 op/s 2024-05-08T09:42:44.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:44 smithi194 ceph-mon[33679]: pgmap v5621: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 391 KiB/s rd, 2.2 MiB/s wr, 18 op/s 2024-05-08T09:42:46.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:46 smithi172 ceph-mon[33377]: pgmap v5622: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 2.7 MiB/s wr, 23 op/s 2024-05-08T09:42:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:46 smithi194 ceph-mon[33679]: pgmap v5622: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 2.7 MiB/s wr, 23 op/s 2024-05-08T09:42:46.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:46 smithi070 ceph-mon[29591]: pgmap v5622: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 2.7 MiB/s wr, 23 op/s 2024-05-08T09:42:48.671 INFO:tasks.workunit.client.0.smithi070.stdout: NM .tmp_vmlinux.kallsyms1.syms 2024-05-08T09:42:48.678 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:48 smithi172 ceph-mon[33377]: pgmap v5623: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 2.5 MiB/s wr, 18 op/s 2024-05-08T09:42:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:48 smithi194 ceph-mon[33679]: pgmap v5623: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 2.5 MiB/s wr, 18 op/s 2024-05-08T09:42:48.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:48 smithi070 ceph-mon[29591]: pgmap v5623: 129 pgs: 129 active+clean; 2.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 2.5 MiB/s wr, 18 op/s 2024-05-08T09:42:50.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:50 smithi172 ceph-mon[33377]: pgmap v5624: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 6.5 MiB/s wr, 25 op/s 2024-05-08T09:42:50.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:50 smithi194 ceph-mon[33679]: pgmap v5624: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 6.5 MiB/s wr, 25 op/s 2024-05-08T09:42:50.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:50 smithi070 ceph-mon[29591]: pgmap v5624: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 497 KiB/s rd, 6.5 MiB/s wr, 25 op/s 2024-05-08T09:42:50.983 INFO:tasks.workunit.client.0.smithi070.stdout: KSYMS .tmp_vmlinux.kallsyms1.S 2024-05-08T09:42:52.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:52 smithi172 ceph-mon[33377]: pgmap v5625: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-05-08T09:42:52.681 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:52 smithi070 ceph-mon[29591]: pgmap v5625: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-05-08T09:42:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:52 smithi194 ceph-mon[33679]: pgmap v5625: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-05-08T09:42:54.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:54 smithi172 ceph-mon[33377]: pgmap v5626: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-05-08T09:42:54.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:42:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:54 smithi194 ceph-mon[33679]: pgmap v5626: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-05-08T09:42:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:42:54.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:54 smithi070 ceph-mon[29591]: pgmap v5626: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 4.5 MiB/s wr, 12 op/s 2024-05-08T09:42:54.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:42:54.914 INFO:tasks.workunit.client.0.smithi070.stdout: AS .tmp_vmlinux.kallsyms1.S 2024-05-08T09:42:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:55 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:55 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:56.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:55 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:56.721 INFO:tasks.workunit.client.0.smithi070.stdout: LD .tmp_vmlinux.kallsyms2 2024-05-08T09:42:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:56 smithi194 ceph-mon[33679]: pgmap v5627: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-05-08T09:42:57.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:42:57.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:42:57.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:56 smithi070 ceph-mon[29591]: pgmap v5627: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-05-08T09:42:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:42:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:42:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:56 smithi172 ceph-mon[33377]: pgmap v5627: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 6.0 MiB/s wr, 19 op/s 2024-05-08T09:42:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:42:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:42:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:42:59.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:42:58 smithi194 ceph-mon[33679]: pgmap v5628: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 5.5 MiB/s wr, 14 op/s 2024-05-08T09:42:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:42:58 smithi070 ceph-mon[29591]: pgmap v5628: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 5.5 MiB/s wr, 14 op/s 2024-05-08T09:42:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:42:58 smithi172 ceph-mon[33377]: pgmap v5628: 129 pgs: 129 active+clean; 2.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 448 KiB/s rd, 5.5 MiB/s wr, 14 op/s 2024-05-08T09:43:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:00 smithi194 ceph-mon[33679]: pgmap v5629: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 9.3 MiB/s wr, 35 op/s 2024-05-08T09:43:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:00 smithi070 ceph-mon[29591]: pgmap v5629: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 9.3 MiB/s wr, 35 op/s 2024-05-08T09:43:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:00 smithi172 ceph-mon[33377]: pgmap v5629: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 693 KiB/s rd, 9.3 MiB/s wr, 35 op/s 2024-05-08T09:43:03.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:02 smithi194 ceph-mon[33679]: pgmap v5630: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.3 MiB/s wr, 27 op/s 2024-05-08T09:43:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:02 smithi070 ceph-mon[29591]: pgmap v5630: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.3 MiB/s wr, 27 op/s 2024-05-08T09:43:03.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:02 smithi172 ceph-mon[33377]: pgmap v5630: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.3 MiB/s wr, 27 op/s 2024-05-08T09:43:05.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:04 smithi194 ceph-mon[33679]: pgmap v5631: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.3 MiB/s wr, 27 op/s 2024-05-08T09:43:05.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:04 smithi070 ceph-mon[29591]: pgmap v5631: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.3 MiB/s wr, 27 op/s 2024-05-08T09:43:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:04 smithi172 ceph-mon[33377]: pgmap v5631: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 5.3 MiB/s wr, 27 op/s 2024-05-08T09:43:07.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:06 smithi194 ceph-mon[33679]: pgmap v5632: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 5.9 MiB/s wr, 93 op/s 2024-05-08T09:43:07.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:06 smithi070 ceph-mon[29591]: pgmap v5632: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 5.9 MiB/s wr, 93 op/s 2024-05-08T09:43:07.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:06 smithi172 ceph-mon[33377]: pgmap v5632: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 5.9 MiB/s wr, 93 op/s 2024-05-08T09:43:09.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:08 smithi194 ceph-mon[33679]: pgmap v5633: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 4.5 MiB/s wr, 86 op/s 2024-05-08T09:43:09.091 INFO:tasks.workunit.client.0.smithi070.stdout: NM .tmp_vmlinux.kallsyms2.syms 2024-05-08T09:43:09.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:08 smithi070 ceph-mon[29591]: pgmap v5633: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 4.5 MiB/s wr, 86 op/s 2024-05-08T09:43:09.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:08 smithi172 ceph-mon[33377]: pgmap v5633: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 4.5 MiB/s wr, 86 op/s 2024-05-08T09:43:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:10 smithi194 ceph-mon[33679]: pgmap v5634: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 8.2 MiB/s wr, 137 op/s 2024-05-08T09:43:11.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:10 smithi070 ceph-mon[29591]: pgmap v5634: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 8.2 MiB/s wr, 137 op/s 2024-05-08T09:43:11.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:10 smithi172 ceph-mon[33377]: pgmap v5634: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 452 KiB/s rd, 8.2 MiB/s wr, 137 op/s 2024-05-08T09:43:12.057 INFO:tasks.workunit.client.0.smithi070.stdout: KSYMS .tmp_vmlinux.kallsyms2.S 2024-05-08T09:43:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:12 smithi194 ceph-mon[33679]: pgmap v5635: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 4.4 MiB/s wr, 115 op/s 2024-05-08T09:43:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:12 smithi194 ceph-mon[33679]: osdmap e429: 12 total, 12 up, 12 in 2024-05-08T09:43:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:12 smithi070 ceph-mon[29591]: pgmap v5635: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 4.4 MiB/s wr, 115 op/s 2024-05-08T09:43:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:12 smithi070 ceph-mon[29591]: osdmap e429: 12 total, 12 up, 12 in 2024-05-08T09:43:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:12 smithi172 ceph-mon[33377]: pgmap v5635: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 4.4 MiB/s wr, 115 op/s 2024-05-08T09:43:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:12 smithi172 ceph-mon[33377]: osdmap e429: 12 total, 12 up, 12 in 2024-05-08T09:43:15.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:14 smithi194 ceph-mon[33679]: pgmap v5637: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 5.3 MiB/s wr, 138 op/s 2024-05-08T09:43:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:14 smithi070 ceph-mon[29591]: pgmap v5637: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 5.3 MiB/s wr, 138 op/s 2024-05-08T09:43:15.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:14 smithi172 ceph-mon[33377]: pgmap v5637: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 5.3 MiB/s wr, 138 op/s 2024-05-08T09:43:16.729 INFO:tasks.workunit.client.0.smithi070.stdout: AS .tmp_vmlinux.kallsyms2.S 2024-05-08T09:43:17.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:16 smithi194 ceph-mon[33679]: pgmap v5638: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 6.0 MiB/s wr, 70 op/s 2024-05-08T09:43:17.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:16 smithi070 ceph-mon[29591]: pgmap v5638: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 6.0 MiB/s wr, 70 op/s 2024-05-08T09:43:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:16 smithi172 ceph-mon[33377]: pgmap v5638: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 6.0 MiB/s wr, 70 op/s 2024-05-08T09:43:18.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:18 smithi070 ceph-mon[29591]: osdmap e430: 12 total, 12 up, 12 in 2024-05-08T09:43:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:18 smithi172 ceph-mon[33377]: osdmap e430: 12 total, 12 up, 12 in 2024-05-08T09:43:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:18 smithi194 ceph-mon[33679]: osdmap e430: 12 total, 12 up, 12 in 2024-05-08T09:43:18.673 INFO:tasks.workunit.client.0.smithi070.stdout: LD vmlinux 2024-05-08T09:43:19.380 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:19 smithi070 ceph-mon[29591]: pgmap v5640: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.9 MiB/s wr, 12 op/s 2024-05-08T09:43:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:19 smithi172 ceph-mon[33377]: pgmap v5640: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.9 MiB/s wr, 12 op/s 2024-05-08T09:43:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:19 smithi194 ceph-mon[33679]: pgmap v5640: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 1.9 MiB/s wr, 12 op/s 2024-05-08T09:43:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:21 smithi070 ceph-mon[29591]: pgmap v5641: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 5.9 MiB/s wr, 23 op/s 2024-05-08T09:43:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:21 smithi172 ceph-mon[33377]: pgmap v5641: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 5.9 MiB/s wr, 23 op/s 2024-05-08T09:43:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:21 smithi194 ceph-mon[33679]: pgmap v5641: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 5.9 MiB/s wr, 23 op/s 2024-05-08T09:43:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:23 smithi070 ceph-mon[29591]: pgmap v5642: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 4.9 MiB/s wr, 19 op/s 2024-05-08T09:43:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:23 smithi172 ceph-mon[33377]: pgmap v5642: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 4.9 MiB/s wr, 19 op/s 2024-05-08T09:43:23.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:23 smithi194 ceph-mon[33679]: pgmap v5642: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 633 KiB/s rd, 4.9 MiB/s wr, 19 op/s 2024-05-08T09:43:25.312 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:25 smithi194 ceph-mon[33679]: pgmap v5643: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 4.7 MiB/s wr, 18 op/s 2024-05-08T09:43:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:25 smithi070 ceph-mon[29591]: pgmap v5643: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 4.7 MiB/s wr, 18 op/s 2024-05-08T09:43:25.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:25 smithi172 ceph-mon[33377]: pgmap v5643: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 607 KiB/s rd, 4.7 MiB/s wr, 18 op/s 2024-05-08T09:43:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:27 smithi070 ceph-mon[29591]: pgmap v5644: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 5.5 MiB/s wr, 16 op/s 2024-05-08T09:43:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:27 smithi172 ceph-mon[33377]: pgmap v5644: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 5.5 MiB/s wr, 16 op/s 2024-05-08T09:43:27.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:27 smithi194 ceph-mon[33679]: pgmap v5644: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 5.5 MiB/s wr, 16 op/s 2024-05-08T09:43:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:29 smithi070 ceph-mon[29591]: pgmap v5645: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 5.3 MiB/s wr, 16 op/s 2024-05-08T09:43:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:29 smithi172 ceph-mon[33377]: pgmap v5645: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 5.3 MiB/s wr, 16 op/s 2024-05-08T09:43:29.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:29 smithi194 ceph-mon[33679]: pgmap v5645: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 5.3 MiB/s wr, 16 op/s 2024-05-08T09:43:29.569 INFO:tasks.workunit.client.0.smithi070.stdout: NM System.map 2024-05-08T09:43:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:31 smithi070 ceph-mon[29591]: pgmap v5646: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-05-08T09:43:31.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:31 smithi172 ceph-mon[33377]: pgmap v5646: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-05-08T09:43:31.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:31 smithi194 ceph-mon[33679]: pgmap v5646: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 5.7 MiB/s wr, 19 op/s 2024-05-08T09:43:32.068 INFO:tasks.workunit.client.0.smithi070.stdout: SORTTAB vmlinux 2024-05-08T09:43:32.442 INFO:tasks.workunit.client.0.smithi070.stdout: RELOCS arch/x86/boot/compressed/vmlinux.relocs 2024-05-08T09:43:32.787 INFO:tasks.workunit.client.0.smithi070.stdout: RSTRIP vmlinux 2024-05-08T09:43:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:33 smithi070 ceph-mon[29591]: pgmap v5647: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-05-08T09:43:33.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:33 smithi172 ceph-mon[33377]: pgmap v5647: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-05-08T09:43:33.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:33 smithi194 ceph-mon[33679]: pgmap v5647: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-05-08T09:43:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:35 smithi070 ceph-mon[29591]: pgmap v5648: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-05-08T09:43:35.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:35 smithi172 ceph-mon[33377]: pgmap v5648: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-05-08T09:43:35.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:35 smithi194 ceph-mon[33679]: pgmap v5648: 129 pgs: 129 active+clean; 2.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 3.1 MiB/s wr, 12 op/s 2024-05-08T09:43:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:37 smithi070 ceph-mon[29591]: pgmap v5649: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 8.3 MiB/s wr, 22 op/s 2024-05-08T09:43:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:37 smithi172 ceph-mon[33377]: pgmap v5649: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 8.3 MiB/s wr, 22 op/s 2024-05-08T09:43:37.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:37 smithi194 ceph-mon[33679]: pgmap v5649: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 8.3 MiB/s wr, 22 op/s 2024-05-08T09:43:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:38 smithi172 ceph-mon[33377]: pgmap v5650: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 6.4 MiB/s wr, 16 op/s 2024-05-08T09:43:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:38 smithi194 ceph-mon[33679]: pgmap v5650: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 6.4 MiB/s wr, 16 op/s 2024-05-08T09:43:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:38 smithi070 ceph-mon[29591]: pgmap v5650: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 346 KiB/s rd, 6.4 MiB/s wr, 16 op/s 2024-05-08T09:43:40.405 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/a20.o 2024-05-08T09:43:40.406 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/boot/bioscall.o 2024-05-08T09:43:40.415 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/cmdline.o 2024-05-08T09:43:40.415 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC arch/x86/boot/mkcpustr 2024-05-08T09:43:40.416 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/boot/copy.o 2024-05-08T09:43:40.420 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/cpucheck.o 2024-05-08T09:43:40.420 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/cpuflags.o 2024-05-08T09:43:40.423 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/early_serial_console.o 2024-05-08T09:43:40.582 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/edd.o 2024-05-08T09:43:40.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:40 smithi172 ceph-mon[33377]: pgmap v5651: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 13 MiB/s wr, 32 op/s 2024-05-08T09:43:40.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:40 smithi194 ceph-mon[33679]: pgmap v5651: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 13 MiB/s wr, 32 op/s 2024-05-08T09:43:40.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:40 smithi070 ceph-mon[29591]: pgmap v5651: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 13 MiB/s wr, 32 op/s 2024-05-08T09:43:41.690 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/main.o 2024-05-08T09:43:41.708 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/memory.o 2024-05-08T09:43:41.716 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/pm.o 2024-05-08T09:43:41.726 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/boot/pmjump.o 2024-05-08T09:43:41.736 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/printf.o 2024-05-08T09:43:41.741 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/regs.o 2024-05-08T09:43:41.823 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/string.o 2024-05-08T09:43:42.350 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/tty.o 2024-05-08T09:43:42.617 INFO:tasks.workunit.client.0.smithi070.stdout: LDS arch/x86/boot/compressed/vmlinux.lds 2024-05-08T09:43:42.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:42 smithi172 ceph-mon[33377]: pgmap v5652: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-05-08T09:43:42.698 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/video.o 2024-05-08T09:43:42.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:42 smithi194 ceph-mon[33679]: pgmap v5652: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-05-08T09:43:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:42 smithi070 ceph-mon[29591]: pgmap v5652: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-05-08T09:43:42.942 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/boot/compressed/kernel_info.o 2024-05-08T09:43:42.970 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/boot/compressed/head_64.o 2024-05-08T09:43:42.980 INFO:tasks.workunit.client.0.smithi070.stdout: VOFFSET arch/x86/boot/compressed/../voffset.h 2024-05-08T09:43:42.992 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/string.o 2024-05-08T09:43:43.065 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/video-mode.o 2024-05-08T09:43:43.196 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/cmdline.o 2024-05-08T09:43:43.207 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/version.o 2024-05-08T09:43:43.376 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/error.o 2024-05-08T09:43:43.635 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/video-vga.o 2024-05-08T09:43:43.826 INFO:tasks.workunit.client.0.smithi070.stdout: OBJCOPY arch/x86/boot/compressed/vmlinux.bin 2024-05-08T09:43:43.960 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC arch/x86/boot/compressed/mkpiggy 2024-05-08T09:43:44.060 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/video-vesa.o 2024-05-08T09:43:44.299 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/cpuflags.o 2024-05-08T09:43:44.388 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/early_serial_console.o 2024-05-08T09:43:44.474 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/video-bios.o 2024-05-08T09:43:44.626 INFO:tasks.workunit.client.0.smithi070.stdout: HOSTCC arch/x86/boot/tools/build 2024-05-08T09:43:44.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:44 smithi172 ceph-mon[33377]: pgmap v5653: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-05-08T09:43:44.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:44 smithi194 ceph-mon[33679]: pgmap v5653: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-05-08T09:43:44.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:44 smithi070 ceph-mon[29591]: pgmap v5653: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 12 MiB/s wr, 26 op/s 2024-05-08T09:43:44.926 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/kaslr.o 2024-05-08T09:43:45.332 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/ident_map_64.o 2024-05-08T09:43:45.413 INFO:tasks.workunit.client.0.smithi070.stdout: CPUSTR arch/x86/boot/cpustr.h 2024-05-08T09:43:45.436 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/idt_64.o 2024-05-08T09:43:45.451 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/boot/compressed/idt_handlers_64.o 2024-05-08T09:43:45.695 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/pgtable_64.o 2024-05-08T09:43:46.325 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/cpu.o 2024-05-08T09:43:46.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:46 smithi194 ceph-mon[33679]: pgmap v5654: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 13 MiB/s wr, 57 op/s 2024-05-08T09:43:46.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:46 smithi070 ceph-mon[29591]: pgmap v5654: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 13 MiB/s wr, 57 op/s 2024-05-08T09:43:46.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:46 smithi172 ceph-mon[33377]: pgmap v5654: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 13 MiB/s wr, 57 op/s 2024-05-08T09:43:47.468 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/acpi.o 2024-05-08T09:43:48.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:48 smithi194 ceph-mon[33679]: pgmap v5655: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 7.9 MiB/s wr, 47 op/s 2024-05-08T09:43:48.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:48 smithi070 ceph-mon[29591]: pgmap v5655: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 7.9 MiB/s wr, 47 op/s 2024-05-08T09:43:48.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:48 smithi172 ceph-mon[33377]: pgmap v5655: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 948 KiB/s rd, 7.9 MiB/s wr, 47 op/s 2024-05-08T09:43:50.435 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/efi.o 2024-05-08T09:43:50.578 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/boot/compressed/efi_mixed.o 2024-05-08T09:43:50.763 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:50 smithi194 ceph-mon[33679]: pgmap v5656: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 71 op/s 2024-05-08T09:43:50.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:50 smithi070 ceph-mon[29591]: pgmap v5656: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 71 op/s 2024-05-08T09:43:50.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:50 smithi172 ceph-mon[33377]: pgmap v5656: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 11 MiB/s wr, 71 op/s 2024-05-08T09:43:51.424 INFO:tasks.workunit.client.0.smithi070.stdout: CC arch/x86/boot/compressed/misc.o 2024-05-08T09:43:51.479 INFO:tasks.workunit.client.0.smithi070.stdout: GZIP arch/x86/boot/compressed/vmlinux.bin.gz 2024-05-08T09:43:52.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:52 smithi194 ceph-mon[33679]: pgmap v5657: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 4.9 MiB/s wr, 54 op/s 2024-05-08T09:43:52.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:52 smithi070 ceph-mon[29591]: pgmap v5657: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 4.9 MiB/s wr, 54 op/s 2024-05-08T09:43:52.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:52 smithi172 ceph-mon[33377]: pgmap v5657: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 4.9 MiB/s wr, 54 op/s 2024-05-08T09:43:54.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:54 smithi194 ceph-mon[33679]: pgmap v5658: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 4.9 MiB/s wr, 54 op/s 2024-05-08T09:43:54.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:54 smithi070 ceph-mon[29591]: pgmap v5658: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 4.9 MiB/s wr, 54 op/s 2024-05-08T09:43:54.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:54 smithi172 ceph-mon[33377]: pgmap v5658: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 4.9 MiB/s wr, 54 op/s 2024-05-08T09:43:54.967 INFO:tasks.workunit.client.0.smithi070.stdout: MKPIGGY arch/x86/boot/compressed/piggy.S 2024-05-08T09:43:55.041 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/boot/compressed/piggy.o 2024-05-08T09:43:56.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:56 smithi194 ceph-mon[33679]: pgmap v5659: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 69 op/s 2024-05-08T09:43:56.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:56 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:43:56.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:56 smithi070 ceph-mon[29591]: pgmap v5659: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 69 op/s 2024-05-08T09:43:56.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:56 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:43:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:56 smithi172 ceph-mon[33377]: pgmap v5659: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.5 MiB/s wr, 69 op/s 2024-05-08T09:43:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:56 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:43:58.094 INFO:tasks.workunit.client.0.smithi070.stdout: LD arch/x86/boot/compressed/vmlinux 2024-05-08T09:43:58.613 INFO:tasks.workunit.client.0.smithi070.stdout: OBJCOPY arch/x86/boot/vmlinux.bin 2024-05-08T09:43:58.615 INFO:tasks.workunit.client.0.smithi070.stdout: ZOFFSET arch/x86/boot/zoffset.h 2024-05-08T09:43:58.667 INFO:tasks.workunit.client.0.smithi070.stdout: AS arch/x86/boot/header.o 2024-05-08T09:43:59.209 INFO:tasks.workunit.client.0.smithi070.stdout: LD arch/x86/boot/setup.elf 2024-05-08T09:43:59.236 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:43:59 smithi070 ceph-mon[29591]: pgmap v5660: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 3.9 MiB/s wr, 38 op/s 2024-05-08T09:43:59.315 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:43:59 smithi172 ceph-mon[33377]: pgmap v5660: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 3.9 MiB/s wr, 38 op/s 2024-05-08T09:43:59.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:43:59 smithi194 ceph-mon[33679]: pgmap v5660: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 3.9 MiB/s wr, 38 op/s 2024-05-08T09:43:59.578 INFO:tasks.workunit.client.0.smithi070.stdout: OBJCOPY arch/x86/boot/setup.bin 2024-05-08T09:43:59.637 INFO:tasks.workunit.client.0.smithi070.stdout: BUILD arch/x86/boot/bzImage 2024-05-08T09:43:59.825 INFO:tasks.workunit.client.0.smithi070.stdout:Kernel: arch/x86/boot/bzImage is ready (#1) 2024-05-08T09:43:59.923 INFO:tasks.workunit.client.0.smithi070.stderr:+ cd .. 2024-05-08T09:43:59.942 INFO:tasks.workunit.client.0.smithi070.stderr:+ rm -rv linux-6.5.11 2024-05-08T09:44:01.233 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:01 smithi172 ceph-mon[33377]: pgmap v5661: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.0 MiB/s wr, 57 op/s 2024-05-08T09:44:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:01 smithi070 ceph-mon[29591]: pgmap v5661: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.0 MiB/s wr, 57 op/s 2024-05-08T09:44:01.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:01 smithi194 ceph-mon[33679]: pgmap v5661: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.0 MiB/s wr, 57 op/s 2024-05-08T09:44:01.766 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.8) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T09:44:01.766 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.4 2024-05-08T09:44:01.767 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:44:02.213 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/MAINTAINERS' 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/Kconfig' 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.vmlinux.export.o' 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/..vmlinux.export.o.cmd' 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.tmp_vmlinux.kallsyms1.o' 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.cocciconfig' 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.config' 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.tmp_vmlinux.kallsyms2.o' 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.tmp_vmlinux.kallsyms2.S' 2024-05-08T09:44:02.365 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.tmp_vmlinux.kallsyms1' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/..checked-atomic-long.h.cmd' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/CREDITS' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.missing-syscalls.d' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.vmlinux.cmd' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/modules.order' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.tmp_vmlinux.kallsyms2.syms' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/aosp.h' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/cmtp/Kconfig' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/cmtp/capi.c' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/cmtp/Makefile' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/cmtp/sock.c' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/cmtp/core.c' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/cmtp/cmtp.h' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/bluetooth/cmtp' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/Kconfig' 2024-05-08T09:44:02.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/msft.c' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/smp.h' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/l2cap_sock.c' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/leds.h' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_sock.c' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/mgmt_config.h' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/rfcomm/Kconfig' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/rfcomm/Makefile' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/rfcomm/sock.c' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/rfcomm/tty.c' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/rfcomm/core.c' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/bluetooth/rfcomm' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/smp.c' 2024-05-08T09:44:02.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_event.c' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/selftest.h' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/a2mp.h' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_debugfs.c' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/ecdh_helper.h' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/af_bluetooth.c' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/sco.c' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/leds.c' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/bnep/Kconfig' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/bnep/bnep.h' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/bnep/Makefile' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/bnep/sock.c' 2024-05-08T09:44:02.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/bnep/netdev.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/bnep/core.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/bluetooth/bnep' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/Makefile' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_request.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_core.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/a2mp.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/amp.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/coredump.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_codec.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/mgmt.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/iso.c' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/eir.h' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/msft.h' 2024-05-08T09:44:02.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/mgmt_util.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/selftest.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_sync.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_debugfs.h' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/aosp.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_conn.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_request.h' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/6lowpan.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/mgmt_util.h' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/l2cap_core.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/mgmt_config.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/lib.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/ecdh_helper.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/eir.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_sysfs.c' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hci_codec.h' 2024-05-08T09:44:02.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/amp.h' 2024-05-08T09:44:02.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hidp/Kconfig' 2024-05-08T09:44:02.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hidp/Makefile' 2024-05-08T09:44:02.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hidp/hidp.h' 2024-05-08T09:44:02.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hidp/sock.c' 2024-05-08T09:44:02.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bluetooth/hidp/core.c' 2024-05-08T09:44:02.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/bluetooth/hidp' 2024-05-08T09:44:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/bluetooth' 2024-05-08T09:44:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/Kconfig' 2024-05-08T09:44:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_ovs.c' 2024-05-08T09:44:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_CLASSIFY.c' 2024-05-08T09:44:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_queue.c' 2024-05-08T09:44:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_extend.c' 2024-05-08T09:44:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink_hook.c' 2024-05-08T09:44:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/Kconfig' 2024-05-08T09:44:03.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink_queue.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_NETMAP.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_length.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_core.o.cmd' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_set_hash.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_fib_netdev.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_LOG.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_proto_icmpv6.o.cmd' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_proto.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_LOG.ko' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_log.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_CONNSECMARK.o' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_numgen.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_proto_udp.o.cmd' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_cgroup.c' 2024-05-08T09:44:03.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_addrtype.mod' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink_cttimeout.c' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_HMARK.c' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_bpf.c' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink.o' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_addrtype.o' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_redir.c' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink.c' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_mark.ko.cmd' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_set_pipapo.h' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_hooks_lwtunnel.c' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_seqadj.c' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_irc.o.cmd' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/modules.order' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink_osf.c' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_nat.mod.o.cmd' 2024-05-08T09:44:03.142 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_extend.o' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_flow_table_ip.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_tables_core.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_connlimit.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_bpf.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_sctp.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_standalone.o' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_log.o.cmd' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_addrtype.o.cmd' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_MASQUERADE.mod.o' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_conntrack.o' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_compat.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_netbios_ns.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_synproxy.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_statistic.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_NFQUEUE.c' 2024-05-08T09:44:03.143 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_pkttype.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_nat.ko' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_quota.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_amanda.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_multiport.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_log_syslog.mod.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_fib_inet.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_CHECKSUM.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_labels.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_udp.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_expect.o' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_devgroup.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_addrtype.mod.cmd' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_chain_nat.c' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_nat_irc.o.cmd' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_ftp.o' 2024-05-08T09:44:03.144 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_nfacct.c' 2024-05-08T09:44:03.145 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_byteorder.c' 2024-05-08T09:44:03.145 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_expect.c' 2024-05-08T09:44:03.145 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_acct.o' 2024-05-08T09:44:03.145 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_nat.mod.c' 2024-05-08T09:44:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:03 smithi070 ceph-mon[29591]: pgmap v5662: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 4.7 MiB/s wr, 32 op/s 2024-05-08T09:44:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:03 smithi172 ceph-mon[33377]: pgmap v5662: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 4.7 MiB/s wr, 32 op/s 2024-05-08T09:44:03.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:03 smithi194 ceph-mon[33679]: pgmap v5662: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 4.7 MiB/s wr, 32 op/s 2024-05-08T09:44:03.796 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_tcpudp.o' 2024-05-08T09:44:03.796 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_core.o' 2024-05-08T09:44:03.796 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_policy.c' 2024-05-08T09:44:03.796 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_connlimit.c' 2024-05-08T09:44:03.796 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_hl.c' 2024-05-08T09:44:03.796 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_NFLOG.o' 2024-05-08T09:44:03.796 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_nat.o.cmd' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_cpu.c' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_addrtype.ko' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_addrtype.mod.c' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_ecache.c' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_state.c' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_LOG.ko.cmd' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_core.c' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_hashlimit.c' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_CONNSECMARK.o.cmd' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_pptp.c' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_seqadj.o' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_addrtype.mod.o' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_proto_generic.o.cmd' 2024-05-08T09:44:03.797 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_addrtype.c' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_mac.c' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_ipvs.c' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_RATEEST.c' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_icmpv6.o' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_set.c' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_log_syslog.o.cmd' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_TEE.c' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_cluster.c' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_SECMARK.o' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_mark.ko' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_log.o' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_expect.o.cmd' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_log_syslog.mod.cmd' 2024-05-08T09:44:03.798 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_u32.c' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_ct.c' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_state.o' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_inner.c' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_SECMARK.o.cmd' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_TCPMSS.o.cmd' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_netlink.c' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_chain_route.c' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_netlink.o.cmd' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_log_syslog.ko' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_physdev.c' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.core.o.cmd' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_proto_tcp.o.cmd' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_ecn.c' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_MASQUERADE.ko.cmd' 2024-05-08T09:44:03.799 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_sockopt.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.modules.order.cmd' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_range.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_reject_inet.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_TCPOPTSTRIP.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_osf.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_proto_icmp.o.cmd' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_nat.ko.cmd' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_iprange.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_helper.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_immediate.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_dup_netdev.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_LOG.mod.cmd' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_counter.c' 2024-05-08T09:44:03.800 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_MASQUERADE.o.cmd' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_log.c' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_queue.o' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink_log.o' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_udp.o' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_ftp.o.cmd' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_state.o.cmd' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/Kconfig' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_bitmap_port.c' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_gen.h' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_netnet.c' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_getport.c' 2024-05-08T09:44:03.801 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_net.c' 2024-05-08T09:44:04.998 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_ipmac.c' 2024-05-08T09:44:04.998 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_netport.c' 2024-05-08T09:44:04.998 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_mac.c' 2024-05-08T09:44:04.998 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/Makefile' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_bitmap_ip.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_netiface.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_bitmap_ipmac.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_ipmark.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_list_set.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_ip.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_netportnet.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_core.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_bitmap_gen.h' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_ipportnet.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_ipport.c' 2024-05-08T09:44:04.999 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/ip_set_hash_ipportip.c' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipset/pfxlen.c' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/netfilter/ipset' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_mark.o' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_acct.o.cmd' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_LOG.mod' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_flow_table_inet.c' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_nat.c' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_nat_helper.o.cmd' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_h323_asn1.c' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_addrtype.ko.cmd' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_proto.o' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_MASQUERADE.mod.o.cmd' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/Makefile' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_LOG.mod.c' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_twos.c' 2024-05-08T09:44:05.000 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/Kconfig' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_proto.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_pe.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_core.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_xmit.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_sed.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_nq.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_proto_sctp.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_proto_tcp.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_sh.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_wlc.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_proto_udp.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_app.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_pe_sip.c' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/Makefile' 2024-05-08T09:44:05.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_ftp.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_proto_ah_esp.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_lc.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_est.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_nfct.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_conn.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_sched.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_ctl.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_dh.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_lblcr.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_wrr.c' 2024-05-08T09:44:05.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_lblc.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_ovf.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_rr.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_sync.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_mh.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/ipvs/ip_vs_fo.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/netfilter/ipvs' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_tproxy.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_LED.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_log_syslog.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_TRACE.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_h323_types.c' 2024-05-08T09:44:05.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_seqadj.o.cmd' 2024-05-08T09:44:05.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_set_pipapo_avx2.h' 2024-05-08T09:44:05.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_sockopt.o' 2024-05-08T09:44:05.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_NFLOG.o.cmd' 2024-05-08T09:44:05.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:05 smithi172 ceph-mon[33377]: pgmap v5663: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 4.7 MiB/s wr, 32 op/s 2024-05-08T09:44:05.310 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:05 smithi070 ceph-mon[29591]: pgmap v5663: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 4.7 MiB/s wr, 32 op/s 2024-05-08T09:44:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:05 smithi194 ceph-mon[33679]: pgmap v5663: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 4.7 MiB/s wr, 32 op/s 2024-05-08T09:44:05.546 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_limit.c' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_meta.c' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.utils.o.cmd' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_IDLETIMER.c' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_nat_masquerade.o.cmd' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_queue.o.cmd' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_REDIRECT.c' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_AUDIT.c' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_tables_api.c' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_acct.c' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_core.c' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_generic.c' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_generic.o' 2024-05-08T09:44:05.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_tcpudp.o.cmd' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_LOG.mod.o' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_TPROXY.c' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_bpf_link.c' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_gre.c' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_nat_core.o.cmd' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_ftp.o' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_rt.c' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_ftp.c' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_h323_main.c' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_tables_offload.c' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_CT.c' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_LOG.mod.o.cmd' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_nat_sip.o.cmd' 2024-05-08T09:44:05.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_nat.o' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_ipcomp.c' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_irc.o' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_tftp.c' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_mark.mod.c' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_core.o' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_repldata.h' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_connbytes.c' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_conntrack.c' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/built-in.a' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_masq.c' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_set_pipapo.c' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink_log.c' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_policy.o.cmd' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_LOG.o' 2024-05-08T09:44:05.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_nat.mod.o' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nfnetlink.o.cmd' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_icmp.o' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_payload.c' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_fib.c' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_hash.c' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_TCPMSS.c' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_amanda.c' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_log_syslog.mod' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_xfrm.c' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nfnetlink_log.o.cmd' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_TCPMSS.o' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_addrtype.mod.o.cmd' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_nat_proto.o.cmd' 2024-05-08T09:44:05.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_exthdr.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_socket.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_tcpudp.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/utils.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_nat.mod' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_helper.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_dccp.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_tcpmss.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_sctp.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_chain_filter.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_conntrack.o.cmd' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_mark.mod' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_ct_fast.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_reject_netdev.c' 2024-05-08T09:44:05.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_mark.mod.cmd' 2024-05-08T09:44:05.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_helper.o' 2024-05-08T09:44:05.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_irc.o' 2024-05-08T09:44:05.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_MASQUERADE.mod' 2024-05-08T09:44:05.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_MASQUERADE.mod.cmd' 2024-05-08T09:44:05.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_mark.c' 2024-05-08T09:44:05.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.x_tables.o.cmd' 2024-05-08T09:44:06.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_log_syslog.o' 2024-05-08T09:44:06.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_recent.c' 2024-05-08T09:44:06.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_timestamp.c' 2024-05-08T09:44:06.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_limit.c' 2024-05-08T09:44:06.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/utils.o' 2024-05-08T09:44:06.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_tcp.o' 2024-05-08T09:44:06.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_flow_offload.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_queue.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_nat.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_sip.o' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_sip.o' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_flow_table_core.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_tftp.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_lookup.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_icmp.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_last.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_esp.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_MASQUERADE.mod.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_standalone.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_redirect.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_set_bitmap.c' 2024-05-08T09:44:06.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_set_rbtree.c' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_objref.c' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_tcp.c' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_masquerade.c' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_sane.c' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_nat_ftp.o.cmd' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_snmp.c' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_sip.o.cmd' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_MASQUERADE.c' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.built-in.a.cmd' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_LOG.o.cmd' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_dup_netdev.c' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_icmpv6.c' 2024-05-08T09:44:06.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_osf.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_connmark.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_cmp.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_bpf.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_netlink.o' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink_cthelper.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_synproxy_core.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_tables_trace.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_helper.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_helper.o.cmd' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_timeout.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_mark.mod.o' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_connlabel.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_sip.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_irc.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_ovs.c' 2024-05-08T09:44:06.343 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_realm.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_internals.h' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_log_syslog.mod.o' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_irc.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conncount.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_DSCP.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_tunnel.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_time.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_bitwise.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nfnetlink_acct.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_quota.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_string.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/x_tables.c' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_masquerade.o' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_log_syslog.ko.cmd' 2024-05-08T09:44:06.344 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_CONNSECMARK.c' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/core.c' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_MASQUERADE.o' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_proto.o.cmd' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_mark.o.cmd' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_l2tp.c' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_rateest.c' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto.o' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_nat.mod.cmd' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_comment.c' 2024-05-08T09:44:06.345 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.xt_mark.mod.o.cmd' 2024-05-08T09:44:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:06 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:44:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:06 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:06.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:06 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:44:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:06.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:06 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:06 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:44:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:06.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:06 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.870+0000 7fe581000700 1 -- 172.21.15.70:0/1995836064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe57c105ee0 msgr2=0x7fe57c106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.870+0000 7fe581000700 1 --2- 172.21.15.70:0/1995836064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe57c105ee0 0x7fe57c106370 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe574009f90 tx=0x7fe57400b330 comp rx=0 tx=0).stop 2024-05-08T09:44:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.872+0000 7fe581000700 1 -- 172.21.15.70:0/1995836064 shutdown_connections 2024-05-08T09:44:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.873+0000 7fe581000700 1 --2- 172.21.15.70:0/1995836064 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe57c105ee0 0x7fe57c106370 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.873+0000 7fe581000700 1 --2- 172.21.15.70:0/1995836064 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe57c1083d0 0x7fe57c06b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.873+0000 7fe581000700 1 --2- 172.21.15.70:0/1995836064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe57c06b6f0 0x7fe57c06bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.873+0000 7fe581000700 1 -- 172.21.15.70:0/1995836064 >> 172.21.15.70:0/1995836064 conn(0x7fe57c079350 msgr2=0x7fe57c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:44:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.873+0000 7fe581000700 1 -- 172.21.15.70:0/1995836064 shutdown_connections 2024-05-08T09:44:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.873+0000 7fe581000700 1 -- 172.21.15.70:0/1995836064 wait complete. 2024-05-08T09:44:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.875+0000 7fe581000700 1 Processor -- start 2024-05-08T09:44:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.876+0000 7fe581000700 1 -- start start 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.876+0000 7fe581000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe57c06b6f0 0x7fe57c1166d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.876+0000 7fe581000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe57c105ee0 0x7fe57c116c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.877+0000 7fe581000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe57c1083d0 0x7fe57c110870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.877+0000 7fe581000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c109100 con 0x7fe57c06b6f0 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.877+0000 7fe581000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c108f80 con 0x7fe57c1083d0 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.877+0000 7fe581000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c109280 con 0x7fe57c105ee0 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.877+0000 7fe579400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe57c105ee0 0x7fe57c116c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.877+0000 7fe579400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe57c105ee0 0x7fe57c116c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:32772/0 (socket says 172.21.15.70:32772) 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.877+0000 7fe579400700 1 -- 172.21.15.70:0/1403498730 learned_addr learned my addr 172.21.15.70:0/1403498730 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:44:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.877+0000 7fe579e00700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe57c06b6f0 0x7fe57c1166d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:06.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.877+0000 7fe57a800700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe57c1083d0 0x7fe57c110870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:06.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.878+0000 7fe579400700 1 -- 172.21.15.70:0/1403498730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe57c1083d0 msgr2=0x7fe57c110870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:06.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.878+0000 7fe579400700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe57c1083d0 0x7fe57c110870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:06.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.878+0000 7fe579400700 1 -- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe57c06b6f0 msgr2=0x7fe57c1166d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:06.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.878+0000 7fe579400700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe57c06b6f0 0x7fe57c1166d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:06.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.878+0000 7fe579400700 1 -- 172.21.15.70:0/1403498730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57c111170 con 0x7fe57c105ee0 2024-05-08T09:44:06.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.879+0000 7fe579400700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe57c105ee0 0x7fe57c116c10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe56800ec10 tx=0x7fe56800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:44:06.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.880+0000 7fe572a00700 1 -- 172.21.15.70:0/1403498730 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56800cc90 con 0x7fe57c105ee0 2024-05-08T09:44:06.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.880+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe57c111460 con 0x7fe57c105ee0 2024-05-08T09:44:06.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.880+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe57c1b53a0 con 0x7fe57c105ee0 2024-05-08T09:44:06.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.880+0000 7fe572a00700 1 -- 172.21.15.70:0/1403498730 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe56800ce30 con 0x7fe57c105ee0 2024-05-08T09:44:06.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.880+0000 7fe572a00700 1 -- 172.21.15.70:0/1403498730 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe568010430 con 0x7fe57c105ee0 2024-05-08T09:44:06.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.882+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe55c005330 con 0x7fe57c105ee0 2024-05-08T09:44:06.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.886+0000 7fe572a00700 1 -- 172.21.15.70:0/1403498730 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe568003680 con 0x7fe57c105ee0 2024-05-08T09:44:06.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.888+0000 7fe572a00700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe5600b2b80 0x7fe5600b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:06.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.888+0000 7fe572a00700 1 -- 172.21.15.70:0/1403498730 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(431..431 src has 1..431) ==== 9671+0+0 (secure 0 0 0) 0x7fe5680e2c60 con 0x7fe57c105ee0 2024-05-08T09:44:06.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.888+0000 7fe579e00700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe5600b2b80 0x7fe5600b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:06.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.889+0000 7fe579e00700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe5600b2b80 0x7fe5600b5040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe56c005950 tx=0x7fe56c00a300 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:44:06.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:06.891+0000 7fe572a00700 1 -- 172.21.15.70:0/1403498730 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe5680aa270 con 0x7fe57c105ee0 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_extend.o.cmd' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_log_syslog.mod.o.cmd' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_NFLOG.c' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_conntrack_standalone.o.cmd' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_broadcast.c' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/core.o' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_ftp.c' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_flow_table_procfs.c' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_socket.c' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/x_tables.o' 2024-05-08T09:44:06.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_fwd_netdev.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_MASQUERADE.ko' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_conntrack_proto_dccp.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_flow_table_offload.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_owner.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/.nf_sockopt.o.cmd' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_set_pipapo_avx2.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_dynset.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_policy.o' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_dscp.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_helper.o' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_SECMARK.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nft_reject.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/nf_nat_sip.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netfilter/xt_HL.c' 2024-05-08T09:44:06.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/netfilter' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l3mdev/Kconfig' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l3mdev/Makefile' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l3mdev/l3mdev.c' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/l3mdev' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.udplite.o.cmd' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.netfilter.o.cmd' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/tcpv6_offload.c' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/Kconfig' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6table_mangle.c' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_frag.c' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nf_reject_ipv6.o' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/Kconfig' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nf_reject_ipv6.c' 2024-05-08T09:44:06.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.nf_defrag_ipv6_hooks.o.cmd' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nf_defrag_ipv6_hooks.o' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_REJECT.o' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nf_conntrack_reasm.c' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/modules.order' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_ipv6header.c' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_SYNPROXY.c' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6table_filter.c' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_REJECT.c' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6table_filter.o' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_mh.c' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.nf_conntrack_reasm.o.cmd' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.modules.order.cmd' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nf_tproxy_ipv6.c' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_rt.c' 2024-05-08T09:44:06.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nft_reject_ipv6.c' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6table_raw.c' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/Makefile' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nf_dup_ipv6.c' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nf_conntrack_reasm.o' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6table_nat.c' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_NPT.c' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6_tables.o' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.ip6table_filter.o.cmd' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/built-in.a' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_eui64.c' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nf_defrag_ipv6_hooks.c' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nf_socket_ipv6.c' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.ip6t_REJECT.o.cmd' 2024-05-08T09:44:06.936 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.ip6t_ipv6header.o.cmd' 2024-05-08T09:44:06.937 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_rpfilter.c' 2024-05-08T09:44:06.937 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6_tables.c' 2024-05-08T09:44:06.937 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nft_fib_ipv6.c' 2024-05-08T09:44:06.937 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.ip6_tables.o.cmd' 2024-05-08T09:44:06.937 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_hbh.c' 2024-05-08T09:44:06.937 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_ah.c' 2024-05-08T09:44:07.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:07 smithi070 ceph-mon[29591]: pgmap v5664: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.5 MiB/s wr, 75 op/s 2024-05-08T09:44:07.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:07 smithi070 ceph-mon[29591]: osdmap e431: 12 total, 12 up, 12 in 2024-05-08T09:44:07.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.269+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe55c005620 con 0x7fe57c105ee0 2024-05-08T09:44:07.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.270+0000 7fe572a00700 1 -- 172.21.15.70:0/1403498730 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11877 (secure 0 0 0) 0x7fe5680a9b70 con 0x7fe57c105ee0 2024-05-08T09:44:07.269 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:44:07.269 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:44:04.913204+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T09:44:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe5600b2b80 msgr2=0x7fe5600b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe5600b2b80 0x7fe5600b5040 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe56c005950 tx=0x7fe56c00a300 comp rx=0 tx=0).stop 2024-05-08T09:44:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe57c105ee0 msgr2=0x7fe57c116c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe57c105ee0 0x7fe57c116c10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe56800ec10 tx=0x7fe56800ef20 comp rx=0 tx=0).stop 2024-05-08T09:44:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 shutdown_connections 2024-05-08T09:44:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe5600b2b80 0x7fe5600b5040 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:07.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe57c1083d0 0x7fe57c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe57c06b6f0 0x7fe57c1166d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 --2- 172.21.15.70:0/1403498730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe57c105ee0 0x7fe57c116c10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 >> 172.21.15.70:0/1403498730 conn(0x7fe57c079350 msgr2=0x7fe57c104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:44:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 shutdown_connections 2024-05-08T09:44:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:07.273+0000 7fe581000700 1 -- 172.21.15.70:0/1403498730 wait complete. 2024-05-08T09:44:07.273 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 43 2024-05-08T09:44:07.400 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.built-in.a.cmd' 2024-05-08T09:44:07.400 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_srh.c' 2024-05-08T09:44:07.400 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6t_ipv6header.o' 2024-05-08T09:44:07.400 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6table_security.c' 2024-05-08T09:44:07.400 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/nft_dup_ipv6.c' 2024-05-08T09:44:07.400 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.nf_reject_ipv6.o.cmd' 2024-05-08T09:44:07.400 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/ip6table_mangle.o' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter/.ip6table_mangle.o.cmd' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ipv6/netfilter' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_input.o' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/udplite.o' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/sysctl_net_ipv6.c' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ping.o' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_flowlabel.c' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/exthdrs_core.o' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_fib.o' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.route.o.cmd' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/tunnel6.c' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.inet6_connection_sock.o.cmd' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.reassembly.o.cmd' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_output.c' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.tcp_ipv6.o.cmd' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_vti.c' 2024-05-08T09:44:07.401 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/raw.c' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_checksum.o' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/inet6_connection_sock.c' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/udp.c' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_gre.c' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.af_inet6.o.cmd' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/exthdrs_core.c' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/datagram.o' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.exthdrs_offload.o.cmd' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/protocol.c' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/modules.order' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6mr.c' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_output.o' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ioam6_iptunnel.c' 2024-05-08T09:44:07.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/route.o' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ip6_checksum.o.cmd' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ip6_fib.o.cmd' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.fib6_notifier.o.cmd' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/exthdrs_offload.c' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/rpl.o' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_offload.h' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/seg6.c' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/rpl.c' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.sit.o.cmd' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_tunnel.c' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.xfrm6_output.o.cmd' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_offload.o' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/icmp.c' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/udp.o' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_output.c' 2024-05-08T09:44:07.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/fib6_notifier.o' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.output_core.o.cmd' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/addrconf_core.o' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_tunnel.c' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter.c' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/addrlabel.c' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/esp6.c' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/mcast.o' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_udp_tunnel.c' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ip6_output.o.cmd' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/raw.o' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.raw.o.cmd' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_icmp.c' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_protocol.o' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/inet6_hashtables.o' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.xfrm6_state.o.cmd' 2024-05-08T09:44:07.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ipv6_sockglue.o.cmd' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.addrconf.o.cmd' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/datagram.c' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.inet6_hashtables.o.cmd' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.addrconf_core.o.cmd' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_icmp.o' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.modules.order.cmd' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.udp_offload.o.cmd' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_output.o' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/addrconf.o' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/proc.o' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/sit.o' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/reassembly.o' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/syncookies.c' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/route.c' 2024-05-08T09:44:07.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.addrlabel.o.cmd' 2024-05-08T09:44:07.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/inet6_hashtables.c' 2024-05-08T09:44:07.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/addrconf_core.c' 2024-05-08T09:44:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:07 smithi172 ceph-mon[33377]: pgmap v5664: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.5 MiB/s wr, 75 op/s 2024-05-08T09:44:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:07 smithi172 ceph-mon[33377]: osdmap e431: 12 total, 12 up, 12 in 2024-05-08T09:44:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:07 smithi194 ceph-mon[33679]: pgmap v5664: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.5 MiB/s wr, 75 op/s 2024-05-08T09:44:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:07 smithi194 ceph-mon[33679]: osdmap e431: 12 total, 12 up, 12 in 2024-05-08T09:44:08.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/sysctl_net_ipv6.o' 2024-05-08T09:44:08.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/Makefile' 2024-05-08T09:44:08.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ah6.o' 2024-05-08T09:44:08.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ndisc.c' 2024-05-08T09:44:08.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_flowlabel.o' 2024-05-08T09:44:08.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/addrconf.c' 2024-05-08T09:44:08.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ipv6_sockglue.o' 2024-05-08T09:44:08.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_policy.c' 2024-05-08T09:44:08.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ip6_offload.o.cmd' 2024-05-08T09:44:08.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.protocol.o.cmd' 2024-05-08T09:44:08.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/exthdrs.o' 2024-05-08T09:44:08.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.proc.o.cmd' 2024-05-08T09:44:08.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/tcp_ipv6.o' 2024-05-08T09:44:08.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/calipso.c' 2024-05-08T09:44:08.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/udp_impl.h' 2024-05-08T09:44:08.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/udp_offload.o' 2024-05-08T09:44:08.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/esp6_offload.c' 2024-05-08T09:44:08.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.datagram.o.cmd' 2024-05-08T09:44:08.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ping.c' 2024-05-08T09:44:08.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.anycast.o.cmd' 2024-05-08T09:44:08.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ipcomp6.c' 2024-05-08T09:44:08.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/reassembly.c' 2024-05-08T09:44:08.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.syncookies.o.cmd' 2024-05-08T09:44:08.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/netfilter.o' 2024-05-08T09:44:08.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/output_core.o' 2024-05-08T09:44:08.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/anycast.c' 2024-05-08T09:44:08.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ioam6.o.cmd' 2024-05-08T09:44:08.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_state.c' 2024-05-08T09:44:08.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.esp6.o.cmd' 2024-05-08T09:44:08.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.rpl.o.cmd' 2024-05-08T09:44:08.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/protocol.o' 2024-05-08T09:44:08.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/anycast.o' 2024-05-08T09:44:08.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.mcast_snoop.o.cmd' 2024-05-08T09:44:08.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.mcast.o.cmd' 2024-05-08T09:44:08.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/sit.c' 2024-05-08T09:44:08.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_offload.c' 2024-05-08T09:44:08.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.udp.o.cmd' 2024-05-08T09:44:08.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/built-in.a' 2024-05-08T09:44:08.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.xfrm6_protocol.o.cmd' 2024-05-08T09:44:08.332 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ah6.c' 2024-05-08T09:44:08.332 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/udp_offload.c' 2024-05-08T09:44:08.332 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.icmp.o.cmd' 2024-05-08T09:44:08.332 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/tcp_ipv6.c' 2024-05-08T09:44:08.332 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/output_core.c' 2024-05-08T09:44:08.332 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/fib6_rules.c' 2024-05-08T09:44:08.333 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_input.o' 2024-05-08T09:44:08.333 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ila/ila_main.c' 2024-05-08T09:44:08.333 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ila/ila_xlat.c' 2024-05-08T09:44:08.333 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ila/Makefile' 2024-05-08T09:44:08.333 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ila/ila_common.c' 2024-05-08T09:44:08.333 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ila/ila_lwt.c' 2024-05-08T09:44:08.334 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ila/ila.h' 2024-05-08T09:44:08.334 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ipv6/ila' 2024-05-08T09:44:08.334 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ipv6_sockglue.c' 2024-05-08T09:44:08.334 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.exthdrs_core.o.cmd' 2024-05-08T09:44:08.334 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/udplite.c' 2024-05-08T09:44:08.334 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ip6_flowlabel.o.cmd' 2024-05-08T09:44:08.335 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/mcast.c' 2024-05-08T09:44:08.335 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.xfrm6_input.o.cmd' 2024-05-08T09:44:08.335 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_state.o' 2024-05-08T09:44:08.335 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/icmp.o' 2024-05-08T09:44:08.335 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_fib.c' 2024-05-08T09:44:08.335 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ndisc.o' 2024-05-08T09:44:08.335 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/seg6_hmac.c' 2024-05-08T09:44:08.335 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.tcpv6_offload.o.cmd' 2024-05-08T09:44:08.336 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/calipso.o' 2024-05-08T09:44:08.336 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/mip6.c' 2024-05-08T09:44:08.336 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ip6_input.o.cmd' 2024-05-08T09:44:08.336 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ndisc.o.cmd' 2024-05-08T09:44:08.336 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/seg6_local.c' 2024-05-08T09:44:08.336 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/exthdrs_offload.o' 2024-05-08T09:44:08.336 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/af_inet6.c' 2024-05-08T09:44:08.336 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/inet6_connection_sock.o' 2024-05-08T09:44:08.336 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/syncookies.o' 2024-05-08T09:44:08.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.exthdrs.o.cmd' 2024-05-08T09:44:08.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.built-in.a.cmd' 2024-05-08T09:44:08.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/mcast_snoop.c' 2024-05-08T09:44:08.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ah6.o.cmd' 2024-05-08T09:44:08.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.seg6.o.cmd' 2024-05-08T09:44:08.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ping.o.cmd' 2024-05-08T09:44:08.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_input.c' 2024-05-08T09:44:08.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_input.c' 2024-05-08T09:44:08.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/mcast_snoop.o' 2024-05-08T09:44:08.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/addrlabel.o' 2024-05-08T09:44:08.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ioam6.c' 2024-05-08T09:44:08.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_policy.o' 2024-05-08T09:44:08.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/rpl_iptunnel.c' 2024-05-08T09:44:08.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/fib6_notifier.c' 2024-05-08T09:44:08.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/esp6.o' 2024-05-08T09:44:08.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/af_inet6.o' 2024-05-08T09:44:08.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/exthdrs.c' 2024-05-08T09:44:08.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1403498730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:44:08.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:08 smithi172 ceph-mon[33377]: pgmap v5666: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.1 MiB/s wr, 73 op/s 2024-05-08T09:44:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1403498730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:44:08.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:08 smithi194 ceph-mon[33679]: pgmap v5666: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.1 MiB/s wr, 73 op/s 2024-05-08T09:44:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1403498730' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:44:08.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:08 smithi070 ceph-mon[29591]: pgmap v5666: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.1 MiB/s wr, 73 op/s 2024-05-08T09:44:09.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ioam6.o' 2024-05-08T09:44:09.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/seg6.o' 2024-05-08T09:44:09.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/fou6.c' 2024-05-08T09:44:09.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.calipso.o.cmd' 2024-05-08T09:44:09.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/ip6_checksum.c' 2024-05-08T09:44:09.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/proc.c' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/xfrm6_protocol.c' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.ip6_icmp.o.cmd' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/seg6_iptunnel.c' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/tcpv6_offload.o' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.sysctl_net_ipv6.o.cmd' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv6/.xfrm6_policy.o.cmd' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ipv6' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/Kconfig' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_addr.c' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/af_ax25.c' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_subr.c' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_timer.c' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_std_in.c' 2024-05-08T09:44:09.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_std_timer.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_ds_subr.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/sysctl_net_ax25.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_ip.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_in.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_route.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/Makefile' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_ds_timer.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_ds_in.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_uid.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_out.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_dev.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_iface.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ax25/ax25_std_subr.c' 2024-05-08T09:44:09.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ax25' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sysctl_net.c' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/devres.o' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/Kconfig' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/ncsi-netlink.h' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/ncsi-manage.c' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/ncsi-netlink.c' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/ncsi-pkt.h' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/ncsi-aen.c' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/internal.h' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/ncsi-rsp.c' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/Makefile' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ncsi/ncsi-cmd.c' 2024-05-08T09:44:09.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ncsi' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mctp/Kconfig' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mctp/device.c' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mctp/af_mctp.c' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mctp/route.c' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mctp/Makefile' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mctp/test/route-test.c' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mctp/test/utils.c' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mctp/test/utils.h' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/mctp/test' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mctp/neigh.c' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/mctp' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dcb/Kconfig' 2024-05-08T09:44:09.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dcb/Makefile' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dcb/dcbevent.c' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dcb/dcbnl.c' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/dcb' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/modules.order' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/Kconfig' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_clc.c' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_netlink.c' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_netlink.h' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_ism.c' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_ib.c' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_tx.h' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_wr.c' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_sysctl.c' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/Makefile' 2024-05-08T09:44:09.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc.h' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_sysctl.h' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_close.c' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_ism.h' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_llc.c' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_rx.h' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_tracepoint.h' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_tx.c' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_core.c' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_wr.h' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_rx.c' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_tracepoint.c' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_pnet.h' 2024-05-08T09:44:09.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_cdc.h' 2024-05-08T09:44:09.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_stats.h' 2024-05-08T09:44:09.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_core.h' 2024-05-08T09:44:09.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_cdc.c' 2024-05-08T09:44:09.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_ib.h' 2024-05-08T09:44:09.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_clc.h' 2024-05-08T09:44:09.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_netns.h' 2024-05-08T09:44:09.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_close.h' 2024-05-08T09:44:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:10 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:44:10.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:10 smithi172 ceph-mon[33377]: pgmap v5667: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 184 op/s 2024-05-08T09:44:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:10 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:44:10.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:10 smithi194 ceph-mon[33679]: pgmap v5667: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 184 op/s 2024-05-08T09:44:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:10 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:44:10.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:10 smithi070 ceph-mon[29591]: pgmap v5667: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 184 op/s 2024-05-08T09:44:11.201 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 80.4 --await-for 42.0' 2024-05-08T09:44:11.201 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 80.4 --await-for 42.0 2024-05-08T09:44:11.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_llc.h' 2024-05-08T09:44:11.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_diag.c' 2024-05-08T09:44:11.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_pnet.c' 2024-05-08T09:44:11.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/smc_stats.c' 2024-05-08T09:44:11.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/smc/af_smc.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/smc' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_pdu.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/Kconfig' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_if.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_proc.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_s_st.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_station.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_c_ac.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_c_ev.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_c_st.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_output.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/Makefile' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/sysctl_net_llc.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_sap.c' 2024-05-08T09:44:11.410 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_input.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_conn.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/af_llc.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_s_ac.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_core.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/llc/llc_s_ev.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/llc' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/Kconfig' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/l2tp_ip.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/l2tp_core.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/trace.h' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/l2tp_core.h' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/l2tp_ip6.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/Makefile' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/l2tp_netlink.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/l2tp_ppp.c' 2024-05-08T09:44:11.411 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/l2tp_debugfs.c' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/l2tp/l2tp_eth.c' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/l2tp' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/Kconfig' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/trans_virtio.o' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/.mod.o.cmd' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/trans_common.c' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/.error.o.cmd' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/client.c' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/protocol.c' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/modules.order' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/.trans_fd.o.cmd' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/mod.c' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/trans_common.h' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/protocol.h' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/trans_rdma.c' 2024-05-08T09:44:11.412 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/.modules.order.cmd' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/Makefile' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/.protocol.o.cmd' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/.client.o.cmd' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/trans_common.o' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/mod.o' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/protocol.o' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/built-in.a' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/trans_fd.c' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/client.o' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/trans_fd.o' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/.trans_common.o.cmd' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/.built-in.a.cmd' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/error.c' 2024-05-08T09:44:11.413 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/trans_xen.c' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/error.o' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/trans_virtio.c' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/9p/.trans_virtio.o.cmd' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/9p' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/Kconfig' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/vlanproc.c' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/vlan.c' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/vlan.h' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/vlanproc.h' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/vlan_gvrp.c' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/Makefile' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/vlan_core.c' 2024-05-08T09:44:11.414 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/vlan_netlink.c' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/vlan_mvrp.c' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/8021q/vlan_dev.c' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/8021q' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/Kconfig' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_main.c' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_framereg.h' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_slave.h' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_device.h' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_main.h' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/Makefile' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_framereg.c' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_forward.c' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_forward.h' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_netlink.c' 2024-05-08T09:44:11.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_slave.c' 2024-05-08T09:44:11.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_device.c' 2024-05-08T09:44:11.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_netlink.h' 2024-05-08T09:44:11.803 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:44:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/hsr/hsr_debugfs.c' 2024-05-08T09:44:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/hsr' 2024-05-08T09:44:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_rtl4_a.c' 2024-05-08T09:44:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/Kconfig' 2024-05-08T09:44:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_gswip.c' 2024-05-08T09:44:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_xrs700x.c' 2024-05-08T09:44:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_brcm.c' 2024-05-08T09:44:12.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/modules.order' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/switch.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/port.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/trace.h' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/dsa.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/trace.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_qca.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_ksz.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_8021q.h' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/stubs.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_none.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_rtl8_4.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag.h' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_rzn1_a5psw.c' 2024-05-08T09:44:12.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/.modules.order.cmd' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_trailer.c' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_ocelot_8021q.c' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/Makefile' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/port.h' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/master.h' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/switch.h' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/devlink.c' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/built-in.a' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_dsa.c' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_mtk.c' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_ar9331.c' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_sja1105.c' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_hellcreek.c' 2024-05-08T09:44:12.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/slave.c' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/master.c' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag.c' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_lan9303.c' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_ocelot.c' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/.built-in.a.cmd' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/slave.h' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/tag_8021q.c' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/devlink.h' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/netlink.c' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/dsa.h' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dsa/netlink.h' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/dsa' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/lapb/Kconfig' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/lapb/lapb_subr.c' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/lapb/Makefile' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/lapb/lapb_iface.c' 2024-05-08T09:44:12.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/lapb/lapb_out.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/lapb/lapb_in.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/lapb/lapb_timer.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/lapb' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/meter.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/Kconfig' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/actions.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/conntrack.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/vport-vxlan.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/conntrack.h' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/openvswitch_trace.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/flow_table.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/flow.h' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/flow_table.h' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/vport-netdev.h' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/vport-gre.c' 2024-05-08T09:44:12.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/flow_netlink.c' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/datapath.c' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/Makefile' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/meter.h' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/dp_notify.c' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/vport.h' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/openvswitch_trace.h' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/vport.c' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/flow.c' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/flow_netlink.h' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/vport-internal_dev.h' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/vport-geneve.c' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/datapath.h' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/vport-netdev.c' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/openvswitch/vport-internal_dev.c' 2024-05-08T09:44:12.109 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/openvswitch' 2024-05-08T09:44:12.110 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/Kconfig' 2024-05-08T09:44:12.110 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/chan.c' 2024-05-08T09:44:12.110 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/lib80211.c' 2024-05-08T09:44:12.110 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/reg.h' 2024-05-08T09:44:12.110 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/wext-proc.c' 2024-05-08T09:44:12.110 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.ibss.o.cmd' 2024-05-08T09:44:12.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/wext-compat.h' 2024-05-08T09:44:12.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/wext-compat.c' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/lib80211_crypt_wep.c' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/wext-core.c' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/debugfs.c' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/sme.o' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/modules.order' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/sysfs.c' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/nl80211.c' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/shipped-certs.c' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.shipped-certs.o.cmd' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/mlme.c' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.pmsr.o.cmd' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/sysfs.h' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/trace.o' 2024-05-08T09:44:12.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/ibss.c' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/trace.h' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/ap.c' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/nl80211.h' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/ethtool.c' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/pmsr.c' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/trace.c' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/scan.c' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.chan.o.cmd' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/ocb.o' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/wext-sme.c' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.ap.o.cmd' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.util.o.cmd' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/reg.o' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/ibss.o' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.ocb.o.cmd' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/wext-priv.c' 2024-05-08T09:44:12.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/debugfs.h' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.core.o.cmd' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.modules.order.cmd' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/radiotap.o' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/Makefile' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/pmsr.o' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/sysfs.o' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/sme.c' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/mlme.o' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.trace.o.cmd' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.sme.o.cmd' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.mesh.o.cmd' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/wext-spy.c' 2024-05-08T09:44:12.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/ap.o' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/ocb.c' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/lib80211_crypt_tkip.c' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/built-in.a' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/ethtool.o' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.nl80211.o.cmd' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/chan.o' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/nl80211.o' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.sysfs.o.cmd' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.ethtool.o.cmd' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/mesh.c' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/util.o' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/scan.o' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.scan.o.cmd' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.radiotap.o.cmd' 2024-05-08T09:44:12.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/util.c' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.built-in.a.cmd' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/mesh.o' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/core.h' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/shipped-certs.o' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.reg.o.cmd' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/core.c' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.gitignore' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/core.o' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/radiotap.c' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/reg.c' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/certs/sforshee.hex' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/wireless/certs' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/rdev-ops.h' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/of.c' 2024-05-08T09:44:12.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/.mlme.o.cmd' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/wireless/lib80211_crypt_ccmp.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/wireless' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/Kconfig' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/protocol.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/ulpqueue.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/chunk.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/tsnmap.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/stream_sched_prio.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/input.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/sm_make_chunk.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/ulpevent.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/ipv6.c' 2024-05-08T09:44:12.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/stream.c' 2024-05-08T09:44:13.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:13 smithi070 ceph-mon[29591]: pgmap v5668: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 184 op/s 2024-05-08T09:44:13.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:13 smithi070 ceph-mon[29591]: osdmap e432: 12 total, 12 up, 12 in 2024-05-08T09:44:13.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:13 smithi172 ceph-mon[33377]: pgmap v5668: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 184 op/s 2024-05-08T09:44:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:13 smithi172 ceph-mon[33377]: osdmap e432: 12 total, 12 up, 12 in 2024-05-08T09:44:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:13 smithi194 ceph-mon[33679]: pgmap v5668: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.6 MiB/s wr, 184 op/s 2024-05-08T09:44:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:13 smithi194 ceph-mon[33679]: osdmap e432: 12 total, 12 up, 12 in 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/sm_statetable.c' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/stream_sched_fc.c' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/outqueue.c' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/offload.c' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/output.c' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/diag.c' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/stream_sched_rr.c' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/transport.c' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/Makefile' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/socket.c' 2024-05-08T09:44:13.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/associola.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/stream_interleave.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/sm_statefuns.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/sm_sideeffect.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/stream_sched.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/debug.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/auth.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/sysctl.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/inqueue.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/primitive.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/bind_addr.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/endpointola.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/objcnt.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sctp/proc.c' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/sctp' 2024-05-08T09:44:13.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/.compat.o.cmd' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/switchdev/Kconfig' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/switchdev/Makefile' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/switchdev/switchdev.c' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/switchdev' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/Kconfig' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/modules.order' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/af_netlink.c' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/af_netlink.h' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/af_netlink.o' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/.modules.order.cmd' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/diag.c' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/.af_netlink.o.cmd' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/Makefile' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/genetlink.o' 2024-05-08T09:44:13.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/policy.c' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/.genetlink.o.cmd' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/built-in.a' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/.policy.o.cmd' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/.built-in.a.cmd' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/policy.o' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlink/genetlink.c' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/netlink' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/Kconfig' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfpkt_skbuff.c' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/caif_socket.c' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfveil.c' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cffrml.c' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfcnfg.c' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/Makefile' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfvidl.c' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfdbgl.c' 2024-05-08T09:44:13.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfserl.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfrfml.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfctrl.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfutill.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/caif_dev.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/chnl_net.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfdgml.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfmuxl.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/caif_usb.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/caif/cfsrvl.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/caif' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/devlink/devl_internal.h' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/devlink/health.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/devlink/Makefile' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/devlink/leftover.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/devlink/dev.c' 2024-05-08T09:44:13.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/devlink/core.c' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/devlink/netlink.c' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/devlink' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nsh/Kconfig' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nsh/nsh.c' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nsh/Makefile' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/nsh' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/devres.c' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mpls/Kconfig' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mpls/mpls_iptunnel.c' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mpls/af_mpls.c' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mpls/internal.h' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mpls/Makefile' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mpls/mpls_gso.c' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/mpls' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/.modules.order.cmd' 2024-05-08T09:44:13.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/key/Makefile' 2024-05-08T09:44:13.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/key/af_key.c' 2024-05-08T09:44:13.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/key' 2024-05-08T09:44:13.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/hash.h' 2024-05-08T09:44:13.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/Kconfig' 2024-05-08T09:44:14.356 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/send.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bridge_loop_avoidance.h' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/fragmentation.h' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/fragmentation.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/routing.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/distributed-arp-table.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/tvlv.h' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/tp_meter.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_v_ogm.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/gateway_common.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/network-coding.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/hash.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_v_ogm.h' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/tvlv.c' 2024-05-08T09:44:14.357 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/trace.h' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_iv_ogm.c' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/trace.c' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/gateway_client.c' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/gateway_client.h' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_iv_ogm.h' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/main.h' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/hard-interface.h' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/multicast.c' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/types.h' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/Makefile' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/hard-interface.c' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bitarray.h' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/multicast.h' 2024-05-08T09:44:14.358 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/translation-table.c' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/log.h' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/send.h' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/soft-interface.h' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bridge_loop_avoidance.c' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/gateway_common.h' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/tp_meter.h' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_v_elp.c' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/main.c' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/originator.c' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_algo.h' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/translation-table.h' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_v_elp.h' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_algo.c' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_v.h' 2024-05-08T09:44:14.359 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/routing.h' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/originator.h' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/log.c' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/soft-interface.c' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bat_v.c' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/distributed-arp-table.h' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/bitarray.c' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/netlink.c' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/netlink.h' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/batman-adv/network-coding.h' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/batman-adv' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/.devres.o.cmd' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/qrtr/Kconfig' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/qrtr/tun.c' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/qrtr/smd.c' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/qrtr/af_qrtr.c' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/qrtr/Makefile' 2024-05-08T09:44:14.360 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/qrtr/qrtr.h' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/qrtr/mhi.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/qrtr/ns.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/qrtr' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_fq_pie.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_red.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/Kconfig' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_sfb.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_flow.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_pedit.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_fifo.o' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_api.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/em_nbyte.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.ematch.o.cmd' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/modules.order' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_meta_skbtcindex.c' 2024-05-08T09:44:14.361 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_tunnel_key.c' 2024-05-08T09:44:14.362 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_drr.c' 2024-05-08T09:44:14.362 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_api.o' 2024-05-08T09:44:14.362 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_ctinfo.c' 2024-05-08T09:44:14.362 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_ets.c' 2024-05-08T09:44:14.362 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.sch_generic.o.cmd' 2024-05-08T09:44:14.362 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_teql.c' 2024-05-08T09:44:14.362 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_api.c' 2024-05-08T09:44:14.362 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/em_canid.c' 2024-05-08T09:44:14.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.756+0000 7f9aaa000700 1 -- 172.21.15.70:0/3558214130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4103550 msgr2=0x7f9aa4103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.756+0000 7f9aaa000700 1 --2- 172.21.15.70:0/3558214130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4103550 0x7f9aa4103930 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9a940099c0 tx=0x7f9a94009cd0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.756+0000 7f9aaa000700 1 -- 172.21.15.70:0/3558214130 shutdown_connections 2024-05-08T09:44:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.756+0000 7f9aaa000700 1 --2- 172.21.15.70:0/3558214130 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa4108630 0x7f9aa4110200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.756+0000 7f9aaa000700 1 --2- 172.21.15.70:0/3558214130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4103550 0x7f9aa4103930 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.756+0000 7f9aaa000700 1 --2- 172.21.15.70:0/3558214130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9aa4103f00 0x7f9aa4107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.756+0000 7f9aaa000700 1 -- 172.21.15.70:0/3558214130 >> 172.21.15.70:0/3558214130 conn(0x7f9aa40fee40 msgr2=0x7f9aa4101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:44:14.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.756+0000 7f9aaa000700 1 -- 172.21.15.70:0/3558214130 shutdown_connections 2024-05-08T09:44:14.756 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:14 smithi070 ceph-mon[29591]: pgmap v5670: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 166 op/s 2024-05-08T09:44:14.756 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:14.756 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:14.756 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:44:14.757 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:44:14.757 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.756+0000 7f9aaa000700 1 -- 172.21.15.70:0/3558214130 wait complete. 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.758+0000 7f9aaa000700 1 Processor -- start 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.758+0000 7f9aaa000700 1 -- start start 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.758+0000 7f9aaa000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa4103550 0x7f9aa40757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.758+0000 7f9aaa000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9aa4103f00 0x7f9aa4075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.758+0000 7f9aaa000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4108630 0x7f9aa4076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.758+0000 7f9aaa000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa4113370 con 0x7f9aa4108630 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.758+0000 7f9aaa000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41131f0 con 0x7f9aa4103550 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.758+0000 7f9aaa000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41134f0 con 0x7f9aa4103f00 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa9600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4108630 0x7f9aa4076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa9600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4108630 0x7f9aa4076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47428/0 (socket says 172.21.15.70:47428) 2024-05-08T09:44:14.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa9600700 1 -- 172.21.15.70:0/1869929725 learned_addr learned my addr 172.21.15.70:0/1869929725 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:44:14.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa4103550 0x7f9aa40757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9a9be00700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9aa4103f00 0x7f9aa4075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa9600700 1 -- 172.21.15.70:0/1869929725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9aa4103f00 msgr2=0x7f9aa4075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa9600700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9aa4103f00 0x7f9aa4075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa9600700 1 -- 172.21.15.70:0/1869929725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa4103550 msgr2=0x7f9aa40757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa9600700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa4103550 0x7f9aa40757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa9600700 1 -- 172.21.15.70:0/1869929725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa41a7d90 con 0x7f9aa4108630 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9a9be00700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9aa4103f00 0x7f9aa4075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.759+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa4103550 0x7f9aa40757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.760+0000 7f9aa9600700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4108630 0x7f9aa4076220 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c007ee0 tx=0x7f9a9c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.760+0000 7f9aa2000700 1 -- 172.21.15.70:0/1869929725 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00dbd0 con 0x7f9aa4108630 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.760+0000 7f9aa2000700 1 -- 172.21.15.70:0/1869929725 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a9c00dd70 con 0x7f9aa4108630 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.760+0000 7f9aaa000700 1 -- 172.21.15.70:0/1869929725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa41a8080 con 0x7f9aa4108630 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.760+0000 7f9aa2000700 1 -- 172.21.15.70:0/1869929725 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0058d0 con 0x7f9aa4108630 2024-05-08T09:44:14.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.760+0000 7f9aaa000700 1 -- 172.21.15.70:0/1869929725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa41a85c0 con 0x7f9aa4108630 2024-05-08T09:44:14.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:14 smithi194 ceph-mon[33679]: pgmap v5670: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 166 op/s 2024-05-08T09:44:14.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:14.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:14.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:44:14.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:44:14.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:14.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.765+0000 7f9aa2000700 1 -- 172.21.15.70:0/1869929725 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9a9c01a020 con 0x7f9aa4108630 2024-05-08T09:44:14.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.766+0000 7f9aa2000700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a880b2b20 0x7f9a880b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.766+0000 7f9aa2000700 1 -- 172.21.15.70:0/1869929725 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(432..432 src has 1..432) ==== 9583+0+0 (secure 0 0 0) 0x7f9a9c0e2230 con 0x7f9aa4108630 2024-05-08T09:44:14.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.767+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a880b2b20 0x7f9a880b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.767+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a880b2b20 0x7f9a880b4fe0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000c00 tx=0x7f9a9401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:44:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.793+0000 7f9ab6016b80 1 Processor -- start 2024-05-08T09:44:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.793+0000 7f9ab6016b80 1 -- start start 2024-05-08T09:44:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.793+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 0x55b8de0283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.793+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de022520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.793+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de022fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.793+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b8ddf74bb0 con 0x55b8de022b40 2024-05-08T09:44:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.793+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b8ddf128f0 con 0x55b8de028910 2024-05-08T09:44:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.793+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b8ddf70b70 con 0x55b8de027ff0 2024-05-08T09:44:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9aa9600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de022fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9aa8c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 0x55b8de0283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9aa9600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de022fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47440/0 (socket says 172.21.15.70:47440) 2024-05-08T09:44:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9aa9600700 1 -- 172.21.15.70:0/1894301637 learned_addr learned my addr 172.21.15.70:0/1894301637 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:44:14.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9a9be00700 1 --2- 172.21.15.70:0/1894301637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de022520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9aa9600700 1 -- 172.21.15.70:0/1894301637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 msgr2=0x55b8de0283d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:44:14.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9aa9600700 1 --2- 172.21.15.70:0/1894301637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 0x55b8de0283d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9aa9600700 1 -- 172.21.15.70:0/1894301637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 msgr2=0x55b8de022520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:44:14.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9aa9600700 1 --2- 172.21.15.70:0/1894301637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de022520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.794+0000 7f9aa9600700 1 -- 172.21.15.70:0/1894301637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ddec1a60 con 0x55b8de022b40 2024-05-08T09:44:14.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.795+0000 7f9aa9600700 1 --2- 172.21.15.70:0/1894301637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de022fa0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0a9020 tx=0x7f9a9c0a8f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2e72351fe1d548 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:44:14.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.795+0000 7f9a9a000700 1 -- 172.21.15.70:0/1894301637 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0a9090 con 0x55b8de022b40 2024-05-08T09:44:14.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.795+0000 7f9a9a000700 1 -- 172.21.15.70:0/1894301637 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a9c0ad440 con 0x55b8de022b40 2024-05-08T09:44:14.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.795+0000 7f9a9a000700 1 -- 172.21.15.70:0/1894301637 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0a92f0 con 0x55b8de022b40 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.796+0000 7f9ab6016b80 1 -- 172.21.15.70:0/1894301637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 msgr2=0x55b8de022fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.796+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/1894301637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de022fa0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0a9020 tx=0x7f9a9c0a8f90 comp rx=0 tx=0).stop 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.796+0000 7f9ab6016b80 1 -- 172.21.15.70:0/1894301637 shutdown_connections 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.796+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/1894301637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de022fa0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.796+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/1894301637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 0x55b8de0283d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.796+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/1894301637 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de022520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.796+0000 7f9ab6016b80 1 -- 172.21.15.70:0/1894301637 >> 172.21.15.70:0/1894301637 conn(0x55b8ddf50cf0 msgr2=0x55b8de01d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.796+0000 7f9ab6016b80 1 -- 172.21.15.70:0/1894301637 shutdown_connections 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.796+0000 7f9ab6016b80 1 -- 172.21.15.70:0/1894301637 wait complete. 2024-05-08T09:44:14.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.797+0000 7f9ab6016b80 1 -- start start 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.797+0000 7f9ab6016b80 1 Processor -- start 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de022b40 0x55b8de02e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de027ff0 0x55b8de02ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de02bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b8de02f3d0 con 0x55b8de027ff0 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55b8ddedacb0 con 0x55b8de028910 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55b8de02f550 con 0x55b8de022b40 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9ab6016b80 10 client.0 _ll_register_callbacks cb 0x55b8ddf1be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9a9be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de027ff0 0x55b8de02ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9a9be00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de027ff0 0x55b8de02ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47454/0 (socket says 172.21.15.70:47454) 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.798+0000 7f9a9be00700 1 -- 172.21.15.70:0/3206510727 learned_addr learned my addr 172.21.15.70:0/3206510727 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9aa9600700 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de02bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de022b40 0x55b8de02e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9a9be00700 1 -- 172.21.15.70:0/3206510727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de022b40 msgr2=0x55b8de02e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9a9be00700 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de022b40 0x55b8de02e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9a9be00700 1 -- 172.21.15.70:0/3206510727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 msgr2=0x55b8de02bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9a9be00700 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de02bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9a9be00700 1 -- 172.21.15.70:0/3206510727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8ddf3a5b0 con 0x55b8de027ff0 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9aa9600700 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de02bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de022b40 0x55b8de02e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9a9be00700 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de027ff0 0x55b8de02ba30 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f9a90010810 tx=0x7f9a90010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91acc479847d5897 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:44:14.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9a8ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:44:14.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3206510727 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90004220 con 0x55b8de027ff0 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3206510727 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(432..432 src has 1..432) ==== 9583+0+0 (secure 0 0 0) 0x7f9a900043c0 con 0x55b8de027ff0 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.799+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3206510727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a9c0ad440 con 0x55b8de027ff0 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.800+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3206510727 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9a90023050 con 0x55b8de027ff0 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.800+0000 7f9ab6016b80 10 client.19953 fetch_fsmap learned FSMap version 44 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.800+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3206510727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55b8de039c70 con 0x55b8de027ff0 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.800+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3206510727 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a9c0ad440 con 0x55b8de027ff0 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.800+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3206510727 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f9a90003a10 con 0x55b8de027ff0 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.801+0000 7f9ab6016b80 10 client.19953 fetch_fsmap finished waiting for FSMap version 44 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.801+0000 7f9ab6016b80 10 client.19953 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.801+0000 7f9ab6016b80 20 client.19953 populate_metadata read hostname 'smithi070' 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.801+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b8de03c200 0x55b8de03e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.801+0000 7f9ab6016b80 4 client.19953 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:44:14.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.801+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3206510727 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8ddfef230 con 0x55b8de03c200 2024-05-08T09:44:14.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.801+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b8de03c200 0x55b8de03e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.802+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b8de03c200 0x55b8de03e670 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c025b582d6eca98 server_cookie=5d05ec4beba297fc in_seq=0 out_seq=0 2024-05-08T09:44:14.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.802+0000 7f9a8ea00700 10 client.19953 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:44:14.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.804+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3206510727 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b8ddfef230 con 0x55b8de03c200 2024-05-08T09:44:14.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.804+0000 7f9a8ea00700 10 client.19953 handle_command_reply: tid=0 2024-05-08T09:44:14.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.804+0000 7f9ab6016b80 1 client.19953 shutdown 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.804+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3206510727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de027ff0 msgr2=0x55b8de02ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.804+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de027ff0 0x55b8de02ba30 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f9a90010810 tx=0x7f9a90010bd0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3206510727 shutdown_connections 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b8de03c200 0x55b8de03e670 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de02bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de022b40 0x55b8de02e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3206510727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de027ff0 0x55b8de02ba30 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3206510727 >> 172.21.15.70:0/3206510727 conn(0x55b8ddf50cf0 msgr2=0x55b8de021510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9a8ea00700 0 client.19953 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3206510727 shutdown_connections 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3206510727 wait complete. 2024-05-08T09:44:14.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.805+0000 7f9ab6016b80 20 client.19953 trim_cache size 0 max 16384 2024-05-08T09:44:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.828+0000 7f9ab6016b80 1 Processor -- start 2024-05-08T09:44:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.828+0000 7f9ab6016b80 1 -- start start 2024-05-08T09:44:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.828+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de02a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.828+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de027ff0 0x55b8de02a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.828+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de028910 0x55b8de043f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.828+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b3fd0 con 0x55b8de022b40 2024-05-08T09:44:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.828+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b1800 con 0x55b8de027ff0 2024-05-08T09:44:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.828+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41af670 con 0x55b8de028910 2024-05-08T09:44:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.829+0000 7f9aa8c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de02a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.829+0000 7f9aa9600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de028910 0x55b8de043f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.829+0000 7f9aa8c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de02a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47458/0 (socket says 172.21.15.70:47458) 2024-05-08T09:44:14.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.829+0000 7f9aa8c00700 1 -- 172.21.15.70:0/3093690738 learned_addr learned my addr 172.21.15.70:0/3093690738 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:44:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.829+0000 7f9a9be00700 1 --2- 172.21.15.70:0/3093690738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de027ff0 0x55b8de02a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.830+0000 7f9aa9600700 1 -- 172.21.15.70:0/3093690738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de027ff0 msgr2=0x55b8de02a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:44:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.830+0000 7f9aa9600700 1 --2- 172.21.15.70:0/3093690738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de027ff0 0x55b8de02a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.830+0000 7f9aa9600700 1 -- 172.21.15.70:0/3093690738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 msgr2=0x55b8de02a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:44:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.830+0000 7f9aa9600700 1 --2- 172.21.15.70:0/3093690738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de02a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.830+0000 7f9aa9600700 1 -- 172.21.15.70:0/3093690738 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8de02b800 con 0x55b8de028910 2024-05-08T09:44:14.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.830+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/3093690738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de02a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:44:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.830+0000 7f9aa9600700 1 --2- 172.21.15.70:0/3093690738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de028910 0x55b8de043f80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0a8d90 tx=0x7f9a9c0a5040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cebf47b7a523a4b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:44:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.831+0000 7f9a99600700 1 -- 172.21.15.70:0/3093690738 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0c2020 con 0x55b8de028910 2024-05-08T09:44:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.831+0000 7f9a99600700 1 -- 172.21.15.70:0/3093690738 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a9c0a9090 con 0x55b8de028910 2024-05-08T09:44:14.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.831+0000 7f9a99600700 1 -- 172.21.15.70:0/3093690738 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0a92f0 con 0x55b8de028910 2024-05-08T09:44:14.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3093690738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de028910 msgr2=0x55b8de043f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:14.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3093690738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de028910 0x55b8de043f80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0a8d90 tx=0x7f9a9c0a5040 comp rx=0 tx=0).stop 2024-05-08T09:44:14.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3093690738 shutdown_connections 2024-05-08T09:44:14.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3093690738 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de028910 0x55b8de043f80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3093690738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de02a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3093690738 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de027ff0 0x55b8de02a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3093690738 >> 172.21.15.70:0/3093690738 conn(0x55b8ddf50cf0 msgr2=0x55b8de021f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:44:14.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3093690738 shutdown_connections 2024-05-08T09:44:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3093690738 wait complete. 2024-05-08T09:44:14.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.832+0000 7f9ab6016b80 1 -- start start 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.833+0000 7f9ab6016b80 1 Processor -- start 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.833+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de031f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.833+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 0x55b8de0324b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.833+0000 7f9ab6016b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de0343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.833+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41afcc0 con 0x55b8de022b40 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.833+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b1130 con 0x55b8de028910 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.833+0000 7f9ab6016b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa41b0390 con 0x55b8de027ff0 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.833+0000 7f9ab6016b80 10 client.0 _ll_register_callbacks cb 0x55b8ddf1be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa8c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de031f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa8c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de031f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47474/0 (socket says 172.21.15.70:47474) 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa8c00700 1 -- 172.21.15.70:0/3321344563 learned_addr learned my addr 172.21.15.70:0/3321344563 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9a9be00700 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 0x55b8de0324b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa9600700 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de0343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa8c00700 1 -- 172.21.15.70:0/3321344563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 msgr2=0x55b8de0324b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 0x55b8de0324b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa8c00700 1 -- 172.21.15.70:0/3321344563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 msgr2=0x55b8de0343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de0343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa8c00700 1 -- 172.21.15.70:0/3321344563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8de034a20 con 0x55b8de022b40 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa9600700 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de0343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9aa8c00700 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de031f70 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f9a940098e0 tx=0x7f9a94009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34ba6ac2a2b8a88 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:44:14.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.834+0000 7f9a8ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:44:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.835+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3321344563 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9403b060 con 0x55b8de022b40 2024-05-08T09:44:14.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.835+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3321344563 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(432..432 src has 1..432) ==== 9583+0+0 (secure 0 0 0) 0x7f9a94003c50 con 0x55b8de022b40 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.835+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3321344563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a9c0a9090 con 0x55b8de022b40 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.835+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3321344563 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f9a94042050 con 0x55b8de022b40 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.835+0000 7f9ab6016b80 10 client.19959 fetch_fsmap learned FSMap version 44 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.835+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3321344563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55b8de0a86f0 con 0x55b8de022b40 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.835+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3321344563 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a9c0a9090 con 0x55b8de022b40 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.835+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3321344563 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f9a94022070 con 0x55b8de022b40 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.836+0000 7f9ab6016b80 10 client.19959 fetch_fsmap finished waiting for FSMap version 44 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.836+0000 7f9ab6016b80 10 client.19959 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.836+0000 7f9ab6016b80 20 client.19959 populate_metadata read hostname 'smithi070' 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.836+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b8de0a8e10 0x55b8de0ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.836+0000 7f9ab6016b80 4 client.19959 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.4, "await_for": 42.0}] 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.836+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3321344563 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.4, "await_for": 42.0}) -- 0x55b8ddf82590 con 0x55b8de0a8e10 2024-05-08T09:44:14.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.836+0000 7f9a9be00700 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b8de0a8e10 0x55b8de0ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:44:14.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.837+0000 7f9a9be00700 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b8de0a8e10 0x55b8de0ab200 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=551f8bb7bf9ee91a server_cookie=86d5a36a4c62d07d in_seq=0 out_seq=0 2024-05-08T09:44:14.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:14.837+0000 7f9a8ea00700 10 client.19959 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:44:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:14 smithi172 ceph-mon[33377]: pgmap v5670: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.0 MiB/s wr, 166 op/s 2024-05-08T09:44:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:44:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:44:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:44:16.732 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:16 smithi172 ceph-mon[33377]: pgmap v5671: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 269 op/s 2024-05-08T09:44:16.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:16 smithi194 ceph-mon[33679]: pgmap v5671: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 269 op/s 2024-05-08T09:44:16.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:16 smithi070 ceph-mon[29591]: pgmap v5671: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 269 op/s 2024-05-08T09:44:18.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:18 smithi194 ceph-mon[33679]: pgmap v5672: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 249 op/s 2024-05-08T09:44:18.762 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:18 smithi172 ceph-mon[33377]: pgmap v5672: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 249 op/s 2024-05-08T09:44:18.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:18 smithi070 ceph-mon[29591]: pgmap v5672: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 249 op/s 2024-05-08T09:44:20.731 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:20 smithi172 ceph-mon[33377]: pgmap v5673: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 154 op/s 2024-05-08T09:44:20.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:20 smithi194 ceph-mon[33679]: pgmap v5673: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 154 op/s 2024-05-08T09:44:20.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:20 smithi070 ceph-mon[29591]: pgmap v5673: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 154 op/s 2024-05-08T09:44:22.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:22 smithi194 ceph-mon[33679]: pgmap v5674: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 154 op/s 2024-05-08T09:44:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:22 smithi070 ceph-mon[29591]: pgmap v5674: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 154 op/s 2024-05-08T09:44:22.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:22 smithi172 ceph-mon[33377]: pgmap v5674: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.0 MiB/s wr, 154 op/s 2024-05-08T09:44:24.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:24 smithi194 ceph-mon[33679]: pgmap v5675: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 136 op/s 2024-05-08T09:44:24.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:24 smithi070 ceph-mon[29591]: pgmap v5675: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 136 op/s 2024-05-08T09:44:24.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:24 smithi172 ceph-mon[33377]: pgmap v5675: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 136 op/s 2024-05-08T09:44:26.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:26 smithi194 ceph-mon[33679]: pgmap v5676: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 175 op/s 2024-05-08T09:44:26.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:26 smithi070 ceph-mon[29591]: pgmap v5676: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 175 op/s 2024-05-08T09:44:26.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:26 smithi172 ceph-mon[33377]: pgmap v5676: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 175 op/s 2024-05-08T09:44:28.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:28 smithi194 ceph-mon[33679]: pgmap v5677: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 233 KiB/s wr, 78 op/s 2024-05-08T09:44:28.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:28 smithi070 ceph-mon[29591]: pgmap v5677: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 233 KiB/s wr, 78 op/s 2024-05-08T09:44:28.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:28 smithi172 ceph-mon[33377]: pgmap v5677: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 233 KiB/s wr, 78 op/s 2024-05-08T09:44:30.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:30 smithi194 ceph-mon[33679]: pgmap v5678: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 301 KiB/s wr, 85 op/s 2024-05-08T09:44:30.845 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:30 smithi172 ceph-mon[33377]: pgmap v5678: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 301 KiB/s wr, 85 op/s 2024-05-08T09:44:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:30 smithi070 ceph-mon[29591]: pgmap v5678: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 301 KiB/s wr, 85 op/s 2024-05-08T09:44:32.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:32 smithi194 ceph-mon[33679]: pgmap v5679: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-05-08T09:44:32.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:32 smithi070 ceph-mon[29591]: pgmap v5679: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-05-08T09:44:32.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:32 smithi172 ceph-mon[33377]: pgmap v5679: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-05-08T09:44:34.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:34 smithi194 ceph-mon[33679]: pgmap v5680: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-05-08T09:44:34.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:34 smithi070 ceph-mon[29591]: pgmap v5680: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-05-08T09:44:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:34 smithi172 ceph-mon[33377]: pgmap v5680: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-05-08T09:44:36.805 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:36 smithi070 ceph-mon[29591]: pgmap v5681: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 235 KiB/s wr, 57 op/s 2024-05-08T09:44:36.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:36 smithi172 ceph-mon[33377]: pgmap v5681: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 235 KiB/s wr, 57 op/s 2024-05-08T09:44:37.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:36 smithi194 ceph-mon[33679]: pgmap v5681: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 235 KiB/s wr, 57 op/s 2024-05-08T09:44:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.288+0000 7f9a8ea00700 1 -- 172.21.15.70:0/3321344563 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55b8ddf82590 con 0x55b8de0a8e10 2024-05-08T09:44:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.288+0000 7f9a8ea00700 10 client.19959 handle_command_reply: tid=0 2024-05-08T09:44:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.288+0000 7f9ab6016b80 1 client.19959 shutdown 2024-05-08T09:44:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3321344563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 msgr2=0x55b8de031f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de031f70 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f9a940098e0 tx=0x7f9a94009310 comp rx=0 tx=0).stop 2024-05-08T09:44:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3321344563 shutdown_connections 2024-05-08T09:44:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55b8de0a8e10 0x55b8de0ab200 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:38.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55b8de028910 0x55b8de0343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:38.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b8de022b40 0x55b8de031f70 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:38.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9ab6016b80 1 --2- 172.21.15.70:0/3321344563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b8de027ff0 0x55b8de0324b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:38.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3321344563 >> 172.21.15.70:0/3321344563 conn(0x55b8ddf50cf0 msgr2=0x55b8de025a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:44:38.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9a8ea00700 0 client.19959 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:44:38.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.289+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3321344563 shutdown_connections 2024-05-08T09:44:38.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.290+0000 7f9ab6016b80 1 -- 172.21.15.70:0/3321344563 wait complete. 2024-05-08T09:44:38.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.290+0000 7f9ab6016b80 20 client.19959 trim_cache size 0 max 16384 2024-05-08T09:44:38.290 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 44, 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 386, 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "e2d56bf2": { 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 386, 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:44:38.291 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.4, 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:44:38.292 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:44:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.291+0000 7f9aaa000700 1 -- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a880b2b20 msgr2=0x7f9a880b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.291+0000 7f9aaa000700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a880b2b20 0x7f9a880b4fe0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000c00 tx=0x7f9a9401a040 comp rx=0 tx=0).stop 2024-05-08T09:44:38.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.291+0000 7f9aaa000700 1 -- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4108630 msgr2=0x7f9aa4076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:44:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.291+0000 7f9aaa000700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4108630 0x7f9aa4076220 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c007ee0 tx=0x7f9a9c00d3b0 comp rx=0 tx=0).stop 2024-05-08T09:44:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.291+0000 7f9aaa000700 1 -- 172.21.15.70:0/1869929725 shutdown_connections 2024-05-08T09:44:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.291+0000 7f9aaa000700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f9a880b2b20 0x7f9a880b4fe0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.291+0000 7f9aaa000700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9aa4108630 0x7f9aa4076220 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.291+0000 7f9aaa000700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9aa4103550 0x7f9aa40757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.291+0000 7f9aaa000700 1 --2- 172.21.15.70:0/1869929725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9aa4103f00 0x7f9aa4075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:44:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.292+0000 7f9aaa000700 1 -- 172.21.15.70:0/1869929725 >> 172.21.15.70:0/1869929725 conn(0x7f9aa40fee40 msgr2=0x7f9aa41077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:44:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.292+0000 7f9aaa000700 1 -- 172.21.15.70:0/1869929725 shutdown_connections 2024-05-08T09:44:38.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:44:38.292+0000 7f9aaa000700 1 -- 172.21.15.70:0/1869929725 wait complete. 2024-05-08T09:44:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:38 smithi070 ceph-mon[29591]: pgmap v5682: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 10 op/s 2024-05-08T09:44:38.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:38 smithi172 ceph-mon[33377]: pgmap v5682: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 10 op/s 2024-05-08T09:44:39.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:38 smithi194 ceph-mon[33679]: pgmap v5682: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 127 KiB/s wr, 10 op/s 2024-05-08T09:44:39.291 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e2d56bf2', quiesce took 37.5 seconds. Will release after: 20.4 2024-05-08T09:44:40.881 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:40 smithi070 ceph-mon[29591]: pgmap v5683: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 207 KiB/s wr, 16 op/s 2024-05-08T09:44:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:40 smithi172 ceph-mon[33377]: pgmap v5683: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 207 KiB/s wr, 16 op/s 2024-05-08T09:44:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:40 smithi194 ceph-mon[33679]: pgmap v5683: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 207 KiB/s wr, 16 op/s 2024-05-08T09:44:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:42 smithi070 ceph-mon[29591]: pgmap v5684: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-05-08T09:44:42.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:42 smithi172 ceph-mon[33377]: pgmap v5684: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-05-08T09:44:43.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:42 smithi194 ceph-mon[33679]: pgmap v5684: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-05-08T09:44:44.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:44 smithi070 ceph-mon[29591]: pgmap v5685: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-05-08T09:44:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:44 smithi172 ceph-mon[33377]: pgmap v5685: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-05-08T09:44:45.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:44 smithi194 ceph-mon[33679]: pgmap v5685: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-05-08T09:44:46.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:46 smithi070 ceph-mon[29591]: pgmap v5686: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 13 op/s 2024-05-08T09:44:46.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:46 smithi172 ceph-mon[33377]: pgmap v5686: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 13 op/s 2024-05-08T09:44:47.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:46 smithi194 ceph-mon[33679]: pgmap v5686: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 241 KiB/s wr, 13 op/s 2024-05-08T09:44:48.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:48 smithi070 ceph-mon[29591]: pgmap v5687: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 10 op/s 2024-05-08T09:44:48.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:48 smithi172 ceph-mon[33377]: pgmap v5687: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 10 op/s 2024-05-08T09:44:49.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:48 smithi194 ceph-mon[33679]: pgmap v5687: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 183 KiB/s wr, 10 op/s 2024-05-08T09:44:50.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:50 smithi070 ceph-mon[29591]: pgmap v5688: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 241 KiB/s wr, 13 op/s 2024-05-08T09:44:50.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:50 smithi172 ceph-mon[33377]: pgmap v5688: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 241 KiB/s wr, 13 op/s 2024-05-08T09:44:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:50 smithi194 ceph-mon[33679]: pgmap v5688: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 241 KiB/s wr, 13 op/s 2024-05-08T09:44:52.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:52 smithi070 ceph-mon[29591]: pgmap v5689: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 7 op/s 2024-05-08T09:44:52.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:52 smithi172 ceph-mon[33377]: pgmap v5689: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 7 op/s 2024-05-08T09:44:53.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:52 smithi194 ceph-mon[33679]: pgmap v5689: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 7 op/s 2024-05-08T09:44:54.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:54 smithi070 ceph-mon[29591]: pgmap v5690: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 7 op/s 2024-05-08T09:44:54.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:54 smithi172 ceph-mon[33377]: pgmap v5690: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 7 op/s 2024-05-08T09:44:55.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:54 smithi194 ceph-mon[33679]: pgmap v5690: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 161 KiB/s wr, 7 op/s 2024-05-08T09:44:56.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:56 smithi070 ceph-mon[29591]: pgmap v5691: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 10 op/s 2024-05-08T09:44:56.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:56 smithi172 ceph-mon[33377]: pgmap v5691: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 10 op/s 2024-05-08T09:44:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:56 smithi194 ceph-mon[33679]: pgmap v5691: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 198 KiB/s wr, 10 op/s 2024-05-08T09:44:58.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:44:58 smithi070 ceph-mon[29591]: pgmap v5692: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2024-05-08T09:44:58.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:44:58 smithi172 ceph-mon[33377]: pgmap v5692: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2024-05-08T09:44:59.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:44:58 smithi194 ceph-mon[33679]: pgmap v5692: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 95 KiB/s wr, 6 op/s 2024-05-08T09:44:59.692 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:45:00.161 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:45:00.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:00 smithi070 ceph-mon[29591]: pgmap v5693: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 9 op/s 2024-05-08T09:45:00.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:00 smithi172 ceph-mon[33377]: pgmap v5693: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 9 op/s 2024-05-08T09:45:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:00 smithi194 ceph-mon[33679]: pgmap v5693: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 95 KiB/s wr, 9 op/s 2024-05-08T09:45:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.409+0000 7fc26aa00700 1 -- 172.21.15.70:0/819060597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc264109510 msgr2=0x7fc2641098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.409+0000 7fc26aa00700 1 --2- 172.21.15.70:0/819060597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc264109510 0x7fc2641098f0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fc254009990 tx=0x7fc254009ca0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.409+0000 7fc26aa00700 1 -- 172.21.15.70:0/819060597 shutdown_connections 2024-05-08T09:45:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.409+0000 7fc26aa00700 1 --2- 172.21.15.70:0/819060597 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc26406bb40 0x7fc264110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.409+0000 7fc26aa00700 1 --2- 172.21.15.70:0/819060597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc264109510 0x7fc2641098f0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.409+0000 7fc26aa00700 1 --2- 172.21.15.70:0/819060597 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc26406b180 0x7fc26406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.409+0000 7fc26aa00700 1 -- 172.21.15.70:0/819060597 >> 172.21.15.70:0/819060597 conn(0x7fc264079350 msgr2=0x7fc264079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.409+0000 7fc26aa00700 1 -- 172.21.15.70:0/819060597 shutdown_connections 2024-05-08T09:45:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.409+0000 7fc26aa00700 1 -- 172.21.15.70:0/819060597 wait complete. 2024-05-08T09:45:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.410+0000 7fc26aa00700 1 Processor -- start 2024-05-08T09:45:02.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.410+0000 7fc26aa00700 1 -- start start 2024-05-08T09:45:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.410+0000 7fc26aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc26406b180 0x7fc2641a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.410+0000 7fc26aa00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc26406bb40 0x7fc2641a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.410+0000 7fc26aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264109510 0x7fc26419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:02.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.410+0000 7fc26aa00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc2641134f0 con 0x7fc26406b180 2024-05-08T09:45:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc26aa00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fc264113370 con 0x7fc264109510 2024-05-08T09:45:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc26aa00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fc264113670 con 0x7fc26406bb40 2024-05-08T09:45:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc263e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc26406b180 0x7fc2641a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc263e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc26406b180 0x7fc2641a18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45018/0 (socket says 172.21.15.70:45018) 2024-05-08T09:45:02.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc263e00700 1 -- 172.21.15.70:0/3779161779 learned_addr learned my addr 172.21.15.70:0/3779161779 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc263400700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc26406bb40 0x7fc2641a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc268a00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264109510 0x7fc26419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc263e00700 1 -- 172.21.15.70:0/3779161779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc26406bb40 msgr2=0x7fc2641a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc263e00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc26406bb40 0x7fc2641a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc263e00700 1 -- 172.21.15.70:0/3779161779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264109510 msgr2=0x7fc26419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:02.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc263e00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264109510 0x7fc26419ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc263e00700 1 -- 172.21.15.70:0/3779161779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26419c1f0 con 0x7fc26406b180 2024-05-08T09:45:02.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.411+0000 7fc268a00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264109510 0x7fc26419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:45:02.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.412+0000 7fc263e00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc26406b180 0x7fc2641a18d0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fc2540057c0 tx=0x7fc254009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:02.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.412+0000 7fc260c00700 1 -- 172.21.15.70:0/3779161779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254027070 con 0x7fc26406b180 2024-05-08T09:45:02.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.412+0000 7fc260c00700 1 -- 172.21.15.70:0/3779161779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc25400fda0 con 0x7fc26406b180 2024-05-08T09:45:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.412+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc26419c480 con 0x7fc26406b180 2024-05-08T09:45:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.412+0000 7fc260c00700 1 -- 172.21.15.70:0/3779161779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254022ca0 con 0x7fc26406b180 2024-05-08T09:45:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.412+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2641a87a0 con 0x7fc26406b180 2024-05-08T09:45:02.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.414+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc26406a190 con 0x7fc26406b180 2024-05-08T09:45:02.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.417+0000 7fc260c00700 1 -- 172.21.15.70:0/3779161779 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc25402a070 con 0x7fc26406b180 2024-05-08T09:45:02.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.419+0000 7fc260c00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2480b2a70 0x7fc2480b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:02.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.419+0000 7fc260c00700 1 -- 172.21.15.70:0/3779161779 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(432..432 src has 1..432) ==== 9583+0+0 (secure 0 0 0) 0x7fc2540e3aa0 con 0x7fc26406b180 2024-05-08T09:45:02.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.419+0000 7fc263400700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2480b2a70 0x7fc2480b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:02.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.420+0000 7fc263400700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2480b2a70 0x7fc2480b4f30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc250005950 tx=0x7fc2500058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:02.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.422+0000 7fc260c00700 1 -- 172.21.15.70:0/3779161779 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc254031080 con 0x7fc26406b180 2024-05-08T09:45:02.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.801+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc26419cfc0 con 0x7fc26406b180 2024-05-08T09:45:02.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.803+0000 7fc260c00700 1 -- 172.21.15.70:0/3779161779 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11878 (secure 0 0 0) 0x7fc254013070 con 0x7fc26406b180 2024-05-08T09:45:02.803 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:45:02.803 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:44:08.302128+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:45:02.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.808+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2480b2a70 msgr2=0x7fc2480b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:02.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.808+0000 7fc26aa00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2480b2a70 0x7fc2480b4f30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc250005950 tx=0x7fc2500058e0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.808+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc26406b180 msgr2=0x7fc2641a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:02.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.808+0000 7fc26aa00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc26406b180 0x7fc2641a18d0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fc2540057c0 tx=0x7fc254009f90 comp rx=0 tx=0).stop 2024-05-08T09:45:02.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.809+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 shutdown_connections 2024-05-08T09:45:02.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.809+0000 7fc26aa00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fc2480b2a70 0x7fc2480b4f30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.809+0000 7fc26aa00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fc264109510 0x7fc26419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.809+0000 7fc26aa00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc26406b180 0x7fc2641a18d0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.809+0000 7fc26aa00700 1 --2- 172.21.15.70:0/3779161779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc26406bb40 0x7fc2641a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.809+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 >> 172.21.15.70:0/3779161779 conn(0x7fc264079350 msgr2=0x7fc26410e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.809+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 shutdown_connections 2024-05-08T09:45:02.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:02.809+0000 7fc26aa00700 1 -- 172.21.15.70:0/3779161779 wait complete. 2024-05-08T09:45:02.814 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 44 2024-05-08T09:45:02.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:02 smithi070 ceph-mon[29591]: pgmap v5694: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2024-05-08T09:45:02.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:02 smithi172 ceph-mon[33377]: pgmap v5694: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2024-05-08T09:45:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:02 smithi194 ceph-mon[33679]: pgmap v5694: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 37 KiB/s wr, 6 op/s 2024-05-08T09:45:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:03 smithi070 ceph-mon[29591]: osdmap e433: 12 total, 12 up, 12 in 2024-05-08T09:45:03.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:03 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3779161779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:45:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:03 smithi172 ceph-mon[33377]: osdmap e433: 12 total, 12 up, 12 in 2024-05-08T09:45:03.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:03 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3779161779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:45:04.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:03 smithi194 ceph-mon[33679]: osdmap e433: 12 total, 12 up, 12 in 2024-05-08T09:45:04.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:03 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3779161779' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:45:04.229 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id e2d56bf2 --release --await' 2024-05-08T09:45:04.229 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id e2d56bf2 --release --await 2024-05-08T09:45:04.811 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:45:04.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:04 smithi070 ceph-mon[29591]: pgmap v5696: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T09:45:04.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:04 smithi172 ceph-mon[33377]: pgmap v5696: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T09:45:05.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:04 smithi194 ceph-mon[33679]: pgmap v5696: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 KiB/s wr, 7 op/s 2024-05-08T09:45:06.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:06 smithi070 ceph-mon[29591]: pgmap v5697: 129 pgs: 16 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 65 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-05-08T09:45:06.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:06 smithi172 ceph-mon[33377]: pgmap v5697: 129 pgs: 16 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 65 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-05-08T09:45:07.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:06 smithi194 ceph-mon[33679]: pgmap v5697: 129 pgs: 16 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 65 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-05-08T09:45:07.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.110+0000 7f14dee00700 1 -- 172.21.15.70:0/2393477336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 msgr2=0x7f14d8112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:07.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.110+0000 7f14dee00700 1 --2- 172.21.15.70:0/2393477336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 0x7f14d8112590 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f14d000b0a0 tx=0x7f14d000b3b0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.111+0000 7f14dee00700 1 -- 172.21.15.70:0/2393477336 shutdown_connections 2024-05-08T09:45:07.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.111+0000 7f14dee00700 1 --2- 172.21.15.70:0/2393477336 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 0x7f14d8112590 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.111+0000 7f14dee00700 1 --2- 172.21.15.70:0/2393477336 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14d810b6c0 0x7f14d810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.111+0000 7f14dee00700 1 --2- 172.21.15.70:0/2393477336 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14d81056c0 0x7f14d8105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.111+0000 7f14dee00700 1 -- 172.21.15.70:0/2393477336 >> 172.21.15.70:0/2393477336 conn(0x7f14d81011b0 msgr2=0x7f14d81035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:07.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.111+0000 7f14dee00700 1 -- 172.21.15.70:0/2393477336 shutdown_connections 2024-05-08T09:45:07.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.111+0000 7f14dee00700 1 -- 172.21.15.70:0/2393477336 wait complete. 2024-05-08T09:45:07.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.112+0000 7f14dee00700 1 Processor -- start 2024-05-08T09:45:07.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.112+0000 7f14dee00700 1 -- start start 2024-05-08T09:45:07.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.112+0000 7f14dee00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14d81056c0 0x7f14d81a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.112+0000 7f14dee00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 0x7f14d81a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.112+0000 7f14dee00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14d810b6c0 0x7f14d819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.112+0000 7f14dee00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81157c0 con 0x7f14d8106080 2024-05-08T09:45:07.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.112+0000 7f14dee00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14d8115640 con 0x7f14d81056c0 2024-05-08T09:45:07.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.112+0000 7f14dee00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f14d8115940 con 0x7f14d810b6c0 2024-05-08T09:45:07.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 0x7f14d81a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 0x7f14d81a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45032/0 (socket says 172.21.15.70:45032) 2024-05-08T09:45:07.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7400700 1 -- 172.21.15.70:0/790217802 learned_addr learned my addr 172.21.15.70:0/790217802 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:07.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7e00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14d81056c0 0x7f14d81a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14dce00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14d810b6c0 0x7f14d819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7400700 1 -- 172.21.15.70:0/790217802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14d810b6c0 msgr2=0x7f14d819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7400700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14d810b6c0 0x7f14d819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7400700 1 -- 172.21.15.70:0/790217802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14d81056c0 msgr2=0x7f14d81a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7400700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14d81056c0 0x7f14d81a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7400700 1 -- 172.21.15.70:0/790217802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d819c1e0 con 0x7f14d8106080 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14dce00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14d810b6c0 0x7f14d819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.113+0000 7f14d7e00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14d81056c0 0x7f14d81a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.114+0000 7f14d7400700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 0x7f14d81a1e00 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f14c400d950 tx=0x7f14c400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.114+0000 7f14d4c00700 1 -- 172.21.15.70:0/790217802 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4016070 con 0x7f14d8106080 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.114+0000 7f14d4c00700 1 -- 172.21.15.70:0/790217802 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14c4010460 con 0x7f14d8106080 2024-05-08T09:45:07.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.114+0000 7f14dee00700 1 -- 172.21.15.70:0/790217802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d819c4d0 con 0x7f14d8106080 2024-05-08T09:45:07.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.114+0000 7f14d4c00700 1 -- 172.21.15.70:0/790217802 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c400f620 con 0x7f14d8106080 2024-05-08T09:45:07.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.114+0000 7f14dee00700 1 -- 172.21.15.70:0/790217802 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d81a8790 con 0x7f14d8106080 2024-05-08T09:45:07.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.118+0000 7f14d4c00700 1 -- 172.21.15.70:0/790217802 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f14c4019070 con 0x7f14d8106080 2024-05-08T09:45:07.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.120+0000 7f14d4c00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14bc0b2a70 0x7f14bc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.120+0000 7f14d4c00700 1 -- 172.21.15.70:0/790217802 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(433..433 src has 1..433) ==== 9671+0+0 (secure 0 0 0) 0x7f14c40e2630 con 0x7f14d8106080 2024-05-08T09:45:07.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.120+0000 7f14d7e00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14bc0b2a70 0x7f14bc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.121+0000 7f14d7e00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14bc0b2a70 0x7f14bc0b4f30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f14c8005e10 tx=0x7f14c8005da0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:07.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.139+0000 7f14e9763b80 1 Processor -- start 2024-05-08T09:45:07.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.139+0000 7f14e9763b80 1 -- start start 2024-05-08T09:45:07.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.139+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 0x55cfe42bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 0x55cfe42b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42c1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14e9763b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cfe4207b20 con 0x55cfe42b5e50 2024-05-08T09:45:07.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14e9763b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cfe41a5860 con 0x55cfe42b5490 2024-05-08T09:45:07.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14e9763b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cfe4203ae0 con 0x55cfe42baec0 2024-05-08T09:45:07.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14dce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42c1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14dce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42c1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45046/0 (socket says 172.21.15.70:45046) 2024-05-08T09:45:07.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14dce00700 1 -- 172.21.15.70:0/2429075496 learned_addr learned my addr 172.21.15.70:0/2429075496 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14d7e00700 1 --2- 172.21.15.70:0/2429075496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 0x55cfe42bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.140+0000 7f14d7400700 1 --2- 172.21.15.70:0/2429075496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 0x55cfe42b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.141+0000 7f14dce00700 1 -- 172.21.15.70:0/2429075496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 msgr2=0x55cfe42bb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.141+0000 7f14dce00700 1 --2- 172.21.15.70:0/2429075496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 0x55cfe42bb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.141+0000 7f14dce00700 1 -- 172.21.15.70:0/2429075496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 msgr2=0x55cfe42b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.141+0000 7f14dce00700 1 --2- 172.21.15.70:0/2429075496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 0x55cfe42b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.141+0000 7f14dce00700 1 -- 172.21.15.70:0/2429075496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfe41549d0 con 0x55cfe42b5e50 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.141+0000 7f14dce00700 1 --2- 172.21.15.70:0/2429075496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42c1c80 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009e50 tx=0x7f14d00090d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d85368c53a5087 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.141+0000 7f14cd600700 1 -- 172.21.15.70:0/2429075496 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0004a50 con 0x55cfe42b5e50 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.142+0000 7f14cd600700 1 -- 172.21.15.70:0/2429075496 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14d0004bf0 con 0x55cfe42b5e50 2024-05-08T09:45:07.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.142+0000 7f14cd600700 1 -- 172.21.15.70:0/2429075496 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d001c640 con 0x55cfe42b5e50 2024-05-08T09:45:07.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.142+0000 7f14e9763b80 1 -- 172.21.15.70:0/2429075496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 msgr2=0x55cfe42c1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:07.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.142+0000 7f14e9763b80 1 --2- 172.21.15.70:0/2429075496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42c1c80 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009e50 tx=0x7f14d00090d0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.143+0000 7f14e9763b80 1 -- 172.21.15.70:0/2429075496 shutdown_connections 2024-05-08T09:45:07.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.143+0000 7f14e9763b80 1 --2- 172.21.15.70:0/2429075496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42c1c80 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.143+0000 7f14e9763b80 1 --2- 172.21.15.70:0/2429075496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 0x55cfe42bb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.143+0000 7f14e9763b80 1 --2- 172.21.15.70:0/2429075496 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 0x55cfe42b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.143+0000 7f14e9763b80 1 -- 172.21.15.70:0/2429075496 >> 172.21.15.70:0/2429075496 conn(0x55cfe41e3c60 msgr2=0x55cfe42afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:07.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.143+0000 7f14e9763b80 1 -- 172.21.15.70:0/2429075496 shutdown_connections 2024-05-08T09:45:07.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.143+0000 7f14e9763b80 1 -- 172.21.15.70:0/2429075496 wait complete. 2024-05-08T09:45:07.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.143+0000 7f14e9763b80 1 -- start start 2024-05-08T09:45:07.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.144+0000 7f14e9763b80 1 Processor -- start 2024-05-08T09:45:07.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.144+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 0x55cfe42c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.144+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5e50 0x55cfe42bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.144+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42baec0 0x55cfe42bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.144+0000 7f14e9763b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cfe42c2220 con 0x55cfe42baec0 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.144+0000 7f14e9763b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55cfe416dc20 con 0x55cfe42b5e50 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.144+0000 7f14e9763b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55cfe42c23a0 con 0x55cfe42b5490 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.144+0000 7f14e9763b80 10 client.0 _ll_register_callbacks cb 0x55cfe41aed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.144+0000 7f14dce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42baec0 0x55cfe42bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14dce00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42baec0 0x55cfe42bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45062/0 (socket says 172.21.15.70:45062) 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14dce00700 1 -- 172.21.15.70:0/504845328 learned_addr learned my addr 172.21.15.70:0/504845328 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14d7e00700 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 0x55cfe42c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14d7400700 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5e50 0x55cfe42bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14dce00700 1 -- 172.21.15.70:0/504845328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 msgr2=0x55cfe42c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:07.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14dce00700 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 0x55cfe42c1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14dce00700 1 -- 172.21.15.70:0/504845328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5e50 msgr2=0x55cfe42bebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:07.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14dce00700 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5e50 0x55cfe42bebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14dce00700 1 -- 172.21.15.70:0/504845328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfe41cd520 con 0x55cfe42baec0 2024-05-08T09:45:07.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14dce00700 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42baec0 0x55cfe42bf0f0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f14d000b3f0 tx=0x7f14d0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf6e5e8b7071ce7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:07.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.145+0000 7f14c2000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:45:07.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.146+0000 7f14c2000700 1 -- 172.21.15.70:0/504845328 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d0007d70 con 0x55cfe42baec0 2024-05-08T09:45:07.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.146+0000 7f14c2000700 1 -- 172.21.15.70:0/504845328 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(433..433 src has 1..433) ==== 9671+0+0 (secure 0 0 0) 0x7f14d001c440 con 0x55cfe42baec0 2024-05-08T09:45:07.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.146+0000 7f14e9763b80 1 -- 172.21.15.70:0/504845328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14d0004bf0 con 0x55cfe42baec0 2024-05-08T09:45:07.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.146+0000 7f14c2000700 1 -- 172.21.15.70:0/504845328 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f14d0036050 con 0x55cfe42baec0 2024-05-08T09:45:07.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.146+0000 7f14e9763b80 10 client.19977 fetch_fsmap learned FSMap version 44 2024-05-08T09:45:07.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.146+0000 7f14e9763b80 1 -- 172.21.15.70:0/504845328 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55cfe42cc9a0 con 0x55cfe42baec0 2024-05-08T09:45:07.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.146+0000 7f14c2000700 1 -- 172.21.15.70:0/504845328 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14d0004bf0 con 0x55cfe42baec0 2024-05-08T09:45:07.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.147+0000 7f14c2000700 1 -- 172.21.15.70:0/504845328 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f14d0011070 con 0x55cfe42baec0 2024-05-08T09:45:07.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.147+0000 7f14e9763b80 10 client.19977 fetch_fsmap finished waiting for FSMap version 44 2024-05-08T09:45:07.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.147+0000 7f14e9763b80 10 client.19977 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:45:07.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.147+0000 7f14e9763b80 20 client.19977 populate_metadata read hostname 'smithi070' 2024-05-08T09:45:07.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.147+0000 7f14e9763b80 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cfe42cee70 0x55cfe42d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.147+0000 7f14e9763b80 4 client.19977 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:45:07.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.147+0000 7f14e9763b80 1 -- 172.21.15.70:0/504845328 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfe42821a0 con 0x55cfe42cee70 2024-05-08T09:45:07.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.147+0000 7f14d7e00700 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cfe42cee70 0x55cfe42d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.148+0000 7f14d7e00700 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cfe42cee70 0x55cfe42d1260 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf04f225df5ad5d3 server_cookie=9e0d4fe2ffbcae48 in_seq=0 out_seq=0 2024-05-08T09:45:07.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.148+0000 7f14c2000700 10 client.19977 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:45:07.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.150+0000 7f14c2000700 1 -- 172.21.15.70:0/504845328 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cfe42821a0 con 0x55cfe42cee70 2024-05-08T09:45:07.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.150+0000 7f14c2000700 10 client.19977 handle_command_reply: tid=0 2024-05-08T09:45:07.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.150+0000 7f14e9763b80 1 client.19977 shutdown 2024-05-08T09:45:07.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 -- 172.21.15.70:0/504845328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42baec0 msgr2=0x55cfe42bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:07.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42baec0 0x55cfe42bf0f0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f14d000b3f0 tx=0x7f14d0007780 comp rx=0 tx=0).stop 2024-05-08T09:45:07.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 -- 172.21.15.70:0/504845328 shutdown_connections 2024-05-08T09:45:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cfe42cee70 0x55cfe42d1260 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42baec0 0x55cfe42bf0f0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 0x55cfe42c1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 --2- 172.21.15.70:0/504845328 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5e50 0x55cfe42bebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 -- 172.21.15.70:0/504845328 >> 172.21.15.70:0/504845328 conn(0x55cfe41e3c60 msgr2=0x55cfe42aa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14c2000700 0 client.19977 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:45:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 -- 172.21.15.70:0/504845328 shutdown_connections 2024-05-08T09:45:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 1 -- 172.21.15.70:0/504845328 wait complete. 2024-05-08T09:45:07.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.151+0000 7f14e9763b80 20 client.19977 trim_cache size 0 max 16384 2024-05-08T09:45:07.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.173+0000 7f14e9763b80 1 Processor -- start 2024-05-08T09:45:07.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.173+0000 7f14e9763b80 1 -- start start 2024-05-08T09:45:07.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 0x55cfe42b9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42afc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42baec0 0x55cfe42bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14e9763b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81b4190 con 0x55cfe42b5e50 2024-05-08T09:45:07.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14e9763b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81b19c0 con 0x55cfe42baec0 2024-05-08T09:45:07.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14e9763b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81af830 con 0x55cfe42b5490 2024-05-08T09:45:07.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45078/0 (socket says 172.21.15.70:45078) 2024-05-08T09:45:07.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14d7400700 1 -- 172.21.15.70:0/4174859870 learned_addr learned my addr 172.21.15.70:0/4174859870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:07.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.174+0000 7f14d7e00700 1 --2- 172.21.15.70:0/4174859870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 0x55cfe42b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.175+0000 7f14d7400700 1 -- 172.21.15.70:0/4174859870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 msgr2=0x55cfe42b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:07.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.175+0000 7f14d7400700 1 --2- 172.21.15.70:0/4174859870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 0x55cfe42b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.175+0000 7f14d7400700 1 -- 172.21.15.70:0/4174859870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42baec0 msgr2=0x55cfe42bdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:07.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.175+0000 7f14d7400700 1 --2- 172.21.15.70:0/4174859870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42baec0 0x55cfe42bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.175+0000 7f14d7400700 1 -- 172.21.15.70:0/4174859870 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfe42ac980 con 0x55cfe42b5e50 2024-05-08T09:45:07.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.175+0000 7f14d7400700 1 --2- 172.21.15.70:0/4174859870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42afc10 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f14c40dff00 tx=0x7f14c40a5350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386b8eaa591939f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:07.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.175+0000 7f14ccc00700 1 -- 172.21.15.70:0/4174859870 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c4020030 con 0x55cfe42b5e50 2024-05-08T09:45:07.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.176+0000 7f14ccc00700 1 -- 172.21.15.70:0/4174859870 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14c40a9490 con 0x55cfe42b5e50 2024-05-08T09:45:07.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.176+0000 7f14ccc00700 1 -- 172.21.15.70:0/4174859870 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c40a9950 con 0x55cfe42b5e50 2024-05-08T09:45:07.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.176+0000 7f14e9763b80 1 -- 172.21.15.70:0/4174859870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 msgr2=0x55cfe42afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:07.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.176+0000 7f14e9763b80 1 --2- 172.21.15.70:0/4174859870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42afc10 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f14c40dff00 tx=0x7f14c40a5350 comp rx=0 tx=0).stop 2024-05-08T09:45:07.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.177+0000 7f14e9763b80 1 -- 172.21.15.70:0/4174859870 shutdown_connections 2024-05-08T09:45:07.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.177+0000 7f14e9763b80 1 --2- 172.21.15.70:0/4174859870 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42baec0 0x55cfe42bdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.177+0000 7f14e9763b80 1 --2- 172.21.15.70:0/4174859870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42b5490 0x55cfe42b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.177+0000 7f14e9763b80 1 --2- 172.21.15.70:0/4174859870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42afc10 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.177+0000 7f14e9763b80 1 -- 172.21.15.70:0/4174859870 >> 172.21.15.70:0/4174859870 conn(0x55cfe41e3c60 msgr2=0x55cfe42b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:07.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.177+0000 7f14e9763b80 1 -- 172.21.15.70:0/4174859870 shutdown_connections 2024-05-08T09:45:07.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.177+0000 7f14e9763b80 1 -- 172.21.15.70:0/4174859870 wait complete. 2024-05-08T09:45:07.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.177+0000 7f14e9763b80 1 -- start start 2024-05-08T09:45:07.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.177+0000 7f14e9763b80 1 Processor -- start 2024-05-08T09:45:07.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 0x55cfe42d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42d3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14e9763b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 0x55cfe43334c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14e9763b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81afe80 con 0x55cfe42b5e50 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14e9763b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81b12f0 con 0x55cfe42b5490 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14e9763b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f14d81b0550 con 0x55cfe42baec0 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14e9763b80 10 client.0 _ll_register_callbacks cb 0x55cfe41aed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42d3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14d7400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42d3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45088/0 (socket says 172.21.15.70:45088) 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.178+0000 7f14d7400700 1 -- 172.21.15.70:0/312720778 learned_addr learned my addr 172.21.15.70:0/312720778 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14d7e00700 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 0x55cfe42d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14dce00700 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 0x55cfe43334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14d7400700 1 -- 172.21.15.70:0/312720778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 msgr2=0x55cfe43334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14d7400700 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 0x55cfe43334c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14d7400700 1 -- 172.21.15.70:0/312720778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 msgr2=0x55cfe42d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14d7400700 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 0x55cfe42d37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:07.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14d7400700 1 -- 172.21.15.70:0/312720778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfe4333b30 con 0x55cfe42b5e50 2024-05-08T09:45:07.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14dce00700 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 0x55cfe43334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:45:07.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14d7400700 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42d3d20 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f14c40a5510 tx=0x7f14c40a5440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65724e5651225729 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:07.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.179+0000 7f14c2000700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:45:07.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.180+0000 7f14c2000700 1 -- 172.21.15.70:0/312720778 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c40c8060 con 0x55cfe42b5e50 2024-05-08T09:45:07.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.180+0000 7f14c2000700 1 -- 172.21.15.70:0/312720778 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(433..433 src has 1..433) ==== 9671+0+0 (secure 0 0 0) 0x7f14c40a96f0 con 0x55cfe42b5e50 2024-05-08T09:45:07.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.180+0000 7f14e9763b80 1 -- 172.21.15.70:0/312720778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14c40a9490 con 0x55cfe42b5e50 2024-05-08T09:45:07.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.180+0000 7f14c2000700 1 -- 172.21.15.70:0/312720778 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f14c4020050 con 0x55cfe42b5e50 2024-05-08T09:45:07.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.180+0000 7f14e9763b80 10 client.19983 fetch_fsmap learned FSMap version 44 2024-05-08T09:45:07.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.180+0000 7f14e9763b80 1 -- 172.21.15.70:0/312720778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55cfe433aef0 con 0x55cfe42b5e50 2024-05-08T09:45:07.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.180+0000 7f14c2000700 1 -- 172.21.15.70:0/312720778 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f14c40a9490 con 0x55cfe42b5e50 2024-05-08T09:45:07.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.180+0000 7f14c2000700 1 -- 172.21.15.70:0/312720778 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f14c408b080 con 0x55cfe42b5e50 2024-05-08T09:45:07.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.181+0000 7f14e9763b80 10 client.19983 fetch_fsmap finished waiting for FSMap version 44 2024-05-08T09:45:07.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.181+0000 7f14e9763b80 10 client.19983 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:45:07.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.181+0000 7f14e9763b80 20 client.19983 populate_metadata read hostname 'smithi070' 2024-05-08T09:45:07.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.181+0000 7f14e9763b80 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cfe433b500 0x55cfe433d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:07.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.181+0000 7f14e9763b80 4 client.19983 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e2d56bf2", "release": true, "await": true}] 2024-05-08T09:45:07.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.181+0000 7f14e9763b80 1 -- 172.21.15.70:0/312720778 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e2d56bf2", "release": true, "await": true}) -- 0x55cfe4215500 con 0x55cfe433b500 2024-05-08T09:45:07.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.181+0000 7f14d7e00700 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cfe433b500 0x55cfe433d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:07.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.182+0000 7f14d7e00700 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cfe433b500 0x55cfe433d920 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f26c8b5b1eb3a41b server_cookie=7029e0c2da207caa in_seq=0 out_seq=0 2024-05-08T09:45:07.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:07.182+0000 7f14c2000700 10 client.19983 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:45:08.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:08 smithi172 ceph-mon[33377]: pgmap v5698: 129 pgs: 16 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 65 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-05-08T09:45:09.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:08 smithi194 ceph-mon[33679]: pgmap v5698: 129 pgs: 16 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 65 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-05-08T09:45:09.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:08 smithi070 ceph-mon[29591]: pgmap v5698: 129 pgs: 16 active+clean+snaptrim, 48 active+clean+snaptrim_wait, 65 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 32 op/s 2024-05-08T09:45:10.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:10 smithi172 ceph-mon[33377]: pgmap v5699: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-05-08T09:45:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:10 smithi194 ceph-mon[33679]: pgmap v5699: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-05-08T09:45:11.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:10 smithi070 ceph-mon[29591]: pgmap v5699: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-05-08T09:45:11.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.813+0000 7f14c2000700 1 -- 172.21.15.70:0/312720778 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55cfe4215500 con 0x55cfe433b500 2024-05-08T09:45:11.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.813+0000 7f14c2000700 10 client.19983 handle_command_reply: tid=0 2024-05-08T09:45:11.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.813+0000 7f14e9763b80 1 client.19983 shutdown 2024-05-08T09:45:11.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14e9763b80 1 -- 172.21.15.70:0/312720778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 msgr2=0x55cfe42d3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:11.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14e9763b80 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42d3d20 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f14c40a5510 tx=0x7f14c40a5440 comp rx=0 tx=0).stop 2024-05-08T09:45:11.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14e9763b80 1 -- 172.21.15.70:0/312720778 shutdown_connections 2024-05-08T09:45:11.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14e9763b80 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55cfe433b500 0x55cfe433d920 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:11.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14e9763b80 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55cfe42baec0 0x55cfe43334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:11.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14e9763b80 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55cfe42b5490 0x55cfe42d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:11.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14e9763b80 1 --2- 172.21.15.70:0/312720778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfe42b5e50 0x55cfe42d3d20 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:11.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14e9763b80 1 -- 172.21.15.70:0/312720778 >> 172.21.15.70:0/312720778 conn(0x55cfe41e3c60 msgr2=0x55cfe42b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:11.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14c2000700 0 client.19983 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:45:11.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.814+0000 7f14e9763b80 1 -- 172.21.15.70:0/312720778 shutdown_connections 2024-05-08T09:45:11.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.815+0000 7f14e9763b80 1 -- 172.21.15.70:0/312720778 wait complete. 2024-05-08T09:45:11.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.815+0000 7f14e9763b80 20 client.19983 trim_cache size 0 max 16384 2024-05-08T09:45:11.815 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:45:11.815 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 44, 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 388, 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "e2d56bf2": { 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 388, 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.4, 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:45:11.816 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:11.817 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.816+0000 7f14dee00700 1 -- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14bc0b2a70 msgr2=0x7f14bc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.816+0000 7f14dee00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14bc0b2a70 0x7f14bc0b4f30 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f14c8005e10 tx=0x7f14c8005da0 comp rx=0 tx=0).stop 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.816+0000 7f14dee00700 1 -- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 msgr2=0x7f14d81a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.816+0000 7f14dee00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 0x7f14d81a1e00 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f14c400d950 tx=0x7f14c400dd10 comp rx=0 tx=0).stop 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.817+0000 7f14dee00700 1 -- 172.21.15.70:0/790217802 shutdown_connections 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.817+0000 7f14dee00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f14bc0b2a70 0x7f14bc0b4f30 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.817+0000 7f14dee00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14d810b6c0 0x7f14d819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.817+0000 7f14dee00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f14d81056c0 0x7f14d81a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.817+0000 7f14dee00700 1 --2- 172.21.15.70:0/790217802 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14d8106080 0x7f14d81a1e00 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:11.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.817+0000 7f14dee00700 1 -- 172.21.15.70:0/790217802 >> 172.21.15.70:0/790217802 conn(0x7f14d81011b0 msgr2=0x7f14d81017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:11.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.817+0000 7f14dee00700 1 -- 172.21.15.70:0/790217802 shutdown_connections 2024-05-08T09:45:11.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:11.817+0000 7f14dee00700 1 -- 172.21.15.70:0/790217802 wait complete. 2024-05-08T09:45:12.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/em_meta.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_hhf.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_mqprio.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_mq.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_basic.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/ematch.o' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_police.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_ct.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_generic.o' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/em_text.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_fifo.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.cls_cgroup.o.cmd' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_mpls.c' 2024-05-08T09:45:12.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.modules.order.cmd' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_ife.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_fq_codel.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_gred.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.sch_fifo.o.cmd' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_etf.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/ematch.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.cls_api.o.cmd' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/Makefile' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_flower.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_sample.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_hfsc.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_frag.o' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_simple.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_gate.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_ingress.c' 2024-05-08T09:45:12.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_u32.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_skbprio.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_mqprio_lib.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_plug.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/em_ipset.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_vlan.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_gact.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_cgroup.o' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_matchall.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/em_cmp.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_cake.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_csum.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_generic.c' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/built-in.a' 2024-05-08T09:45:12.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_prio.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_connmark.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_api.o' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_bpf.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_blackhole.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_cbs.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_mq.o' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_mirred.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_frag.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_qfq.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.sch_api.o.cmd' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_cgroup.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_fw.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_htb.c' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_mqprio_lib.h' 2024-05-08T09:45:12.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/em_u32.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_api.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_choke.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_taprio.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_fq.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_nat.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.built-in.a.cmd' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_ipt.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.sch_blackhole.o.cmd' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.act_api.o.cmd' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_tbf.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_netem.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_bpf.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_blackhole.o' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_skbedit.c' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_api.o' 2024-05-08T09:45:12.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_meta_skbprio.c' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_skbmod.c' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_sfq.c' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_codel.c' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_multiq.c' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/cls_route.c' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.sch_frag.o.cmd' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/em_ipt.c' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/sch_pie.c' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/act_meta_mark.c' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sched/.sch_mq.o.cmd' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/sched' 2024-05-08T09:45:12.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/Kconfig' 2024-05-08T09:45:12.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/af_can.h' 2024-05-08T09:45:12.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/j1939/Kconfig' 2024-05-08T09:45:12.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/j1939/transport.c' 2024-05-08T09:45:12.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/j1939/Makefile' 2024-05-08T09:45:12.708 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e2d56bf2', seconds elapsed: 70.9 2024-05-08T09:45:12.708 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.4 2024-05-08T09:45:12.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:45:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:45:13.242 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/j1939/socket.c' 2024-05-08T09:45:13.242 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/j1939/main.c' 2024-05-08T09:45:13.242 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/j1939/address-claim.c' 2024-05-08T09:45:13.242 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/j1939/j1939-priv.h' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/j1939/bus.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/can/j1939' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/raw.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/Makefile' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/bcm.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/af_can.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/gw.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/proc.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/can/isotp.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/can' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/page.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/connection.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/Kconfig' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/send.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/threads.c' 2024-05-08T09:45:13.243 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib_ring.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/tcp_recv.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib_rdma.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/rdma_transport.h' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/bind.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/tcp_listen.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/tcp.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/transport.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/tcp_stats.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/rds_single_path.h' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/Makefile' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/rds.h' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/rdma_transport.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/stats.c' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib.h' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/info.h' 2024-05-08T09:45:13.244 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/tcp.h' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib_mr.h' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/af_rds.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib_frmr.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/info.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/loop.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/sysctl.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/loop.h' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib_sysctl.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/tcp_send.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib_cm.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/recv.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/rdma.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib_stats.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/cong.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib_send.c' 2024-05-08T09:45:13.245 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/ib_recv.c' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/message.c' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rds/tcp_connect.c' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/rds' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/Makefile' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/socket.c' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/compat.c' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/Kconfig' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/buffer.c' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/auth_x_protocol.h' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/debugfs.c' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/msgpool.c' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/auth_none.c' 2024-05-08T09:45:13.246 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/messenger.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/crypto.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/pagelist.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/osdmap.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/crush/hash.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/crush/crush.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/crush/crush_ln_table.h' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/crush/mapper.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ceph/crush' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/ceph_strings.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/auth_x.h' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/ceph_hash.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/ceph_common.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/auth_x.c' 2024-05-08T09:45:13.247 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/Makefile' 2024-05-08T09:45:13.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/mon_client.c' 2024-05-08T09:45:13.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/messenger_v2.c' 2024-05-08T09:45:13.297 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/auth_none.h' 2024-05-08T09:45:13.297 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/decode.c' 2024-05-08T09:45:13.297 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/osd_client.c' 2024-05-08T09:45:13.297 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/striper.c' 2024-05-08T09:45:13.297 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/auth.c' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/messenger_v1.c' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/armor.c' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/crypto.h' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/cls_lock_client.c' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/string_table.c' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/snapshot.c' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ceph/pagevec.c' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ceph' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/Kconfig' 2024-05-08T09:45:13.298 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_forward.c' 2024-05-08T09:45:13.348 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:13 smithi070 ceph-mon[29591]: pgmap v5700: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-05-08T09:45:13.349 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:13 smithi070 ceph-mon[29591]: osdmap e434: 12 total, 12 up, 12 in 2024-05-08T09:45:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:13 smithi172 ceph-mon[33377]: pgmap v5700: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-05-08T09:45:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:13 smithi172 ceph-mon[33377]: osdmap e434: 12 total, 12 up, 12 in 2024-05-08T09:45:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:13 smithi194 ceph-mon[33679]: pgmap v5700: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-05-08T09:45:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:13 smithi194 ceph-mon[33679]: osdmap e434: 12 total, 12 up, 12 in 2024-05-08T09:45:14.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/sysctl_net_x25.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/af_x25.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_route.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_dev.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_proc.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_subr.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/Makefile' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_timer.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_link.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_in.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_out.c' 2024-05-08T09:45:14.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/x25/x25_facilities.c' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/x25' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_trie.o' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.udplite.o.cmd' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.netfilter.o.cmd' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/Kconfig' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_sockglue.o' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/Kconfig' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/arpt_mangle.c' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.nf_defrag_ipv4.o.cmd' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_filter.c' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_nat_snmp_basic.asn1' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.ip_tables.o.cmd' 2024-05-08T09:45:14.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_reject_ipv4.o' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/modules.order' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_defrag_ipv4.o' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.iptable_filter.o.cmd' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/ipt_REJECT.o' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_nat.c' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_mangle.c' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_filter.o' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_nat_snmp_basic_main.c' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/ip_tables.o' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.iptable_nat.ko.cmd' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nft_dup_ipv4.c' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.iptable_mangle.o.cmd' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_nat.ko' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_security.c' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_dup_ipv4.c' 2024-05-08T09:45:14.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.iptable_nat.mod.cmd' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.modules.order.cmd' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_mangle.o' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_reject_ipv4.c' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/Makefile' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nft_fib_ipv4.c' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_nat_h323.c' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/ipt_SYNPROXY.c' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_tproxy_ipv4.c' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/ipt_ah.c' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/ip_tables.c' 2024-05-08T09:45:14.013 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/built-in.a' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.nf_reject_ipv4.o.cmd' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/ipt_REJECT.c' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_nat.mod.o' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/arptable_filter.c' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_nat.o' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.ipt_REJECT.o.cmd' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.iptable_nat.mod.o.cmd' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_raw.c' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_nat.mod' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_socket_ipv4.c' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.iptable_nat.o.cmd' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/iptable_nat.mod.c' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/.built-in.a.cmd' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nft_reject_ipv4.c' 2024-05-08T09:45:14.014 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_nat_pptp.c' 2024-05-08T09:45:14.015 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/nf_defrag_ipv4.c' 2024-05-08T09:45:14.015 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/ipt_ECN.c' 2024-05-08T09:45:14.015 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/arp_tables.c' 2024-05-08T09:45:14.015 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter/ipt_rpfilter.c' 2024-05-08T09:45:14.015 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ipv4/netfilter' 2024-05-08T09:45:14.015 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udplite.o' 2024-05-08T09:45:14.015 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.inet_hashtables.o.cmd' 2024-05-08T09:45:14.015 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inet_timewait_sock.o' 2024-05-08T09:45:14.015 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ping.o' 2024-05-08T09:45:14.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:14 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:45:14.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:14 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:45:14.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:14 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_cubic.o.cmd' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inet_fragment.o' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_trie.c' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.fib_trie.o.cmd' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_lookup.h' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.route.o.cmd' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/metrics.o' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ip_forward.o.cmd' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_scalable.c' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/cipso_ipv4.o' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_frontend.o' 2024-05-08T09:45:14.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_policy.o' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_tunnel.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_offload.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/raw.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_input.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_htcp.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/arp.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/sysctl_net_ipv4.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_forward.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_hybla.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_tunnel.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.fib_notifier.o.cmd' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.fib_rules.o.cmd' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp.c' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/datagram.o' 2024-05-08T09:45:14.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_cong.o.cmd' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/protocol.c' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/modules.order' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp_bpf.c' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_timer.o' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_sockglue.c' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_vegas.c' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_dctcp.c' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_input.o' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/route.o' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_offload.o.cmd' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ip_input.o.cmd' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_vegas.h' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_cdg.c' 2024-05-08T09:45:14.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ip_options.o.cmd' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.udp_tunnel_stub.o.cmd' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_metrics.o' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tunnel4.c' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/bpf_tcp_ca.c' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.cipso_ipv4.o.cmd' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_cong.c' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ip_tunnel.o.cmd' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inet_fragment.c' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_fastopen.c' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_plb.o' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_bic.c' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_fastopen.o' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_tunnel_core.c' 2024-05-08T09:45:14.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/icmp.c' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inet_hashtables.c' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp.o' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inet_hashtables.o' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_state.c' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/igmp.o' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_options.c' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_input.c' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter.c' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_rules.o' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_diag.c' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_output.o' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ipcomp.c' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_output.o.cmd' 2024-05-08T09:45:14.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.xfrm4_protocol.o.cmd' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_notifier.o' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/raw.o' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_plb.o.cmd' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.raw.o.cmd' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fou_core.c' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_forward.o' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_timer.c' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_tunnel_core.o' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/devinet.o' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_notifier.c' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_ulp.o' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_highspeed.c' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_input.o' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/igmp.c' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/datagram.c' 2024-05-08T09:45:14.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.netlink.o.cmd' 2024-05-08T09:45:14.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/nexthop.c' 2024-05-08T09:45:14.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_fragment.o' 2024-05-08T09:45:14.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp_tunnel_core.c' 2024-05-08T09:45:14.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ipmr.c' 2024-05-08T09:45:14.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_timer.o.cmd' 2024-05-08T09:45:14.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.modules.order.cmd' 2024-05-08T09:45:15.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_recovery.o' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.udp_offload.o.cmd' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/cipso_ipv4.c' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_policy.c' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_gre.c' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_lp.c' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/devinet.c' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inet_timewait_sock.c' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/proc.o' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/nexthop.o' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/esp4.c' 2024-05-08T09:45:15.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp.c' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/syncookies.c' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/route.c' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_bbr.c' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.igmp.o.cmd' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_nv.c' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/arp.o' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/Makefile' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp.o' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_rate.c' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ip_sockglue.o.cmd' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_cubic.c' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ipmr_base.o.cmd' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.protocol.o.cmd' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.proc.o.cmd' 2024-05-08T09:45:15.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/af_inet.o' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.xfrm4_output.o.cmd' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/raw_diag.c' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_recovery.o.cmd' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp_impl.h' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_plb.c' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp_offload.o' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.datagram.o.cmd' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ping.c' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fou_nl.h' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ah4.c' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.syncookies.o.cmd' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_minisocks.c' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_frontend.c' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.inet_fragment.o.cmd' 2024-05-08T09:45:15.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.xfrm4_policy.o.cmd' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netfilter.o' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.inetpeer.o.cmd' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_options.o' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_offload.o' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/gre_offload.o' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/protocol.o' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ipmr.o' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/bpfilter/sockopt.c' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/bpfilter/Makefile' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ipv4/bpfilter' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netlink.o' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inetpeer.c' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.udp.o.cmd' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/built-in.a' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.fib_semantics.o.cmd' 2024-05-08T09:45:15.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ipconfig.o' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.fib_frontend.o.cmd' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inet_connection_sock.c' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_bpf.c' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp_offload.c' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.icmp.o.cmd' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_ipv4.c' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.inet_timewait_sock.o.cmd' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ipconfig.o.cmd' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.af_inet.o.cmd' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_ulp.c' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp_tunnel_stub.c' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inet_diag.c' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.metrics.o.cmd' 2024-05-08T09:45:15.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp.o.cmd' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_fragment.c' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fou_nl.c' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.xfrm4_input.o.cmd' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udplite.c' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_ulp.o.cmd' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_ipv4.o' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_input.o' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_cong.o' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.sysctl_net_ipv4.o.cmd' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/icmp.o' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/esp4_offload.c' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_minisocks.o.cmd' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp_tunnel_nic.c' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_protocol.c' 2024-05-08T09:45:15.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_semantics.o' 2024-05-08T09:45:15.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tunnel4.o.cmd' 2024-05-08T09:45:15.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.devinet.o.cmd' 2024-05-08T09:45:15.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/sysctl_net_ipv4.o' 2024-05-08T09:45:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:15 smithi070 ceph-mon[29591]: pgmap v5702: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-05-08T09:45:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:15 smithi172 ceph-mon[33377]: pgmap v5702: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-05-08T09:45:15.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:15 smithi194 ceph-mon[33679]: pgmap v5702: 129 pgs: 129 active+clean; 2.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 55 KiB/s wr, 31 op/s 2024-05-08T09:45:16.160 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/af_inet.c' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tunnel4.o' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_veno.c' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ip_fragment.o.cmd' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_metrics.o.cmd' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_rules.c' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/syncookies.o' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ip_tunnel_core.o.cmd' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_output.o' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/metrics.c' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_fastopen.o.cmd' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/gre_offload.c' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.built-in.a.cmd' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_ipv4.o.cmd' 2024-05-08T09:45:16.161 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_westwood.c' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_cubic.o' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.nexthop.o.cmd' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ping.o.cmd' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ipmr.o.cmd' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inet_connection_sock.o' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ipmr_base.c' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fib_semantics.c' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_output.c' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/fou_bpf.c' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_input.o.cmd' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/inetpeer.o' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_output.c' 2024-05-08T09:45:16.162 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.ip_output.o.cmd' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_dctcp.h' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ipmr_base.o' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ipconfig.c' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_output.c' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_rate.o' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_state.o' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/proc.c' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.arp.o.cmd' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_recovery.c' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/gre_demux.c' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.gre_offload.o.cmd' 2024-05-08T09:45:16.163 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_illinois.c' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_minisocks.o' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.inet_connection_sock.o.cmd' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.xfrm4_state.o.cmd' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_tunnel.o' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp_tunnel_stub.o' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_input.c' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/netlink.c' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_yeah.c' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ipip.c' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_output.o' 2024-05-08T09:45:16.164 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/ip_vti.c' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/.tcp_rate.o.cmd' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/xfrm4_protocol.o' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/tcp_metrics.c' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ipv4/udp_diag.c' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ipv4' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/Kconfig' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/mib.c' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/ieee802154_i.h' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/trace.h' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/trace.c' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/scan.c' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/driver-ops.h' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/cfg.c' 2024-05-08T09:45:16.165 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/rx.c' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/tx.c' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/iface.c' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/Makefile' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/mac_cmd.c' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/main.c' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/cfg.h' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/llsec.c' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/llsec.h' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac802154/util.c' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/mac802154' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/Kconfig' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/vsock_loopback.c' 2024-05-08T09:45:16.166 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/vmci_transport.c' 2024-05-08T09:45:16.167 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/vsock_addr.c' 2024-05-08T09:45:16.167 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/vmci_transport_notify.h' 2024-05-08T09:45:16.167 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/hyperv_transport.c' 2024-05-08T09:45:16.167 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/af_vsock_tap.c' 2024-05-08T09:45:16.167 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/vmci_transport.h' 2024-05-08T09:45:16.167 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/vsock_bpf.c' 2024-05-08T09:45:16.167 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/vmci_transport_notify.c' 2024-05-08T09:45:16.167 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/diag.c' 2024-05-08T09:45:16.167 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/Makefile' 2024-05-08T09:45:16.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/vmci_transport_notify_qstate.c' 2024-05-08T09:45:16.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/virtio_transport.c' 2024-05-08T09:45:16.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/virtio_transport_common.c' 2024-05-08T09:45:16.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/vmw_vsock/af_vsock.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/vmw_vsock' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/Kconfig' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/Kconfig' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_redirect.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/nft_meta_bridge.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_802_3.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_arp.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_arpreply.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/nft_reject_bridge.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/Makefile' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_limit.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebtable_filter.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_vlan.c' 2024-05-08T09:45:16.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_mark_m.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/nf_conntrack_bridge.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_among.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_nflog.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebtables.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_ip6.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_stp.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebtable_nat.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_mark.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_pkttype.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_snat.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebtable_broute.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_ip.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_dnat.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/netfilter/ebt_log.c' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/bridge/netfilter' 2024-05-08T09:45:16.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_vlan_tunnel.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_cfm.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_stp_bpdu.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_ioctl.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_netlink_tunnel.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_forward.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_stp_timer.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_fdb.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_device.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_cfm_netlink.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_mst.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_netfilter_ipv6.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_arp_nd_proxy.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_netlink.c' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_private_stp.h' 2024-05-08T09:45:16.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_mdb.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_private_mcast_eht.h' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_switchdev.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_mrp_netlink.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_input.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_vlan.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_multicast.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_private_tunnel.h' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/Makefile' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_mrp_switchdev.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_stp.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_nf_core.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_sysfs_br.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_sysfs_if.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_if.c' 2024-05-08T09:45:16.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_mrp.c' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_multicast_eht.c' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_stp_if.c' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br.c' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_private_mrp.h' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_vlan_options.c' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_netfilter_hooks.c' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_private.h' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bridge/br_private_cfm.h' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/bridge' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/iucv/Kconfig' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/iucv/af_iucv.c' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/iucv/Makefile' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/iucv/iucv.c' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/iucv' 2024-05-08T09:45:16.946 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/Kconfig' 2024-05-08T09:45:16.947 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/p8022.c' 2024-05-08T09:45:16.947 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/hippi.c' 2024-05-08T09:45:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.309+0000 7f6210600700 1 -- 172.21.15.70:0/1715341249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208108850 msgr2=0x7f62081103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.309+0000 7f6210600700 1 --2- 172.21.15.70:0/1715341249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208108850 0x7f62081103d0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f620000b0d0 tx=0x7f620000b3e0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.309+0000 7f6210600700 1 -- 172.21.15.70:0/1715341249 shutdown_connections 2024-05-08T09:45:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.309+0000 7f6210600700 1 --2- 172.21.15.70:0/1715341249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208108850 0x7f62081103d0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.309+0000 7f6210600700 1 --2- 172.21.15.70:0/1715341249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6208103750 0x7f6208103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.309+0000 7f6210600700 1 --2- 172.21.15.70:0/1715341249 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6208104100 0x7f6208108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.309+0000 7f6210600700 1 -- 172.21.15.70:0/1715341249 >> 172.21.15.70:0/1715341249 conn(0x7f620807a600 msgr2=0x7f620807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.309+0000 7f6210600700 1 -- 172.21.15.70:0/1715341249 shutdown_connections 2024-05-08T09:45:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.309+0000 7f6210600700 1 -- 172.21.15.70:0/1715341249 wait complete. 2024-05-08T09:45:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.310+0000 7f6210600700 1 Processor -- start 2024-05-08T09:45:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.310+0000 7f6210600700 1 -- start start 2024-05-08T09:45:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f6210600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208103750 0x7f62080757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f6210600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6208104100 0x7f6208075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f6210600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6208108850 0x7f6208076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f6210600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6208113540 con 0x7f6208103750 2024-05-08T09:45:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f6210600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f62081133c0 con 0x7f6208108850 2024-05-08T09:45:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f6210600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f62081136c0 con 0x7f6208104100 2024-05-08T09:45:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f620dc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208103750 0x7f62080757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f620dc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208103750 0x7f62080757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52996/0 (socket says 172.21.15.70:52996) 2024-05-08T09:45:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f620dc00700 1 -- 172.21.15.70:0/1698650733 learned_addr learned my addr 172.21.15.70:0/1698650733 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.311+0000 7f620e600700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6208108850 0x7f6208076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.312+0000 7f620d200700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6208104100 0x7f6208075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.312+0000 7f620dc00700 1 -- 172.21.15.70:0/1698650733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6208104100 msgr2=0x7f6208075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.312+0000 7f620dc00700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6208104100 0x7f6208075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.312+0000 7f620dc00700 1 -- 172.21.15.70:0/1698650733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6208108850 msgr2=0x7f6208076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.312+0000 7f620dc00700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6208108850 0x7f6208076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.312+0000 7f620dc00700 1 -- 172.21.15.70:0/1698650733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62081a7f60 con 0x7f6208103750 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.312+0000 7f620dc00700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208103750 0x7f62080757a0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00d980 tx=0x7f61fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.313+0000 7f6206000700 1 -- 172.21.15.70:0/1698650733 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc017070 con 0x7f6208103750 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.313+0000 7f6206000700 1 -- 172.21.15.70:0/1698650733 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f61fc005020 con 0x7f6208103750 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.313+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62081a8250 con 0x7f6208103750 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.313+0000 7f6206000700 1 -- 172.21.15.70:0/1698650733 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc00f980 con 0x7f6208103750 2024-05-08T09:45:17.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.313+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62081a8790 con 0x7f6208103750 2024-05-08T09:45:17.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.314+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f620810ba20 con 0x7f6208103750 2024-05-08T09:45:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.317+0000 7f6206000700 1 -- 172.21.15.70:0/1698650733 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f61fc004a30 con 0x7f6208103750 2024-05-08T09:45:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.318+0000 7f6206000700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61f00b2a70 0x7f61f00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.318+0000 7f6206000700 1 -- 172.21.15.70:0/1698650733 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(434..434 src has 1..434) ==== 9583+0+0 (secure 0 0 0) 0x7f61fc0e2c90 con 0x7f6208103750 2024-05-08T09:45:17.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.318+0000 7f620d200700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61f00b2a70 0x7f61f00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:17.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.319+0000 7f620d200700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61f00b2a70 0x7f61f00b4f30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6208103130 tx=0x7f61f4009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:17.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.321+0000 7f6206000700 1 -- 172.21.15.70:0/1698650733 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f61fc020020 con 0x7f6208103750 2024-05-08T09:45:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:17 smithi070 ceph-mon[29591]: pgmap v5703: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 686 KiB/s wr, 22 op/s 2024-05-08T09:45:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:17 smithi172 ceph-mon[33377]: pgmap v5703: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 686 KiB/s wr, 22 op/s 2024-05-08T09:45:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:17 smithi194 ceph-mon[33679]: pgmap v5703: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 686 KiB/s wr, 22 op/s 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/modules.order' 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/stp.c' 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/.modules.order.cmd' 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/garp.c' 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/Makefile' 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/built-in.a' 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/psnap.c' 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/fddi.c' 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/fc.c' 2024-05-08T09:45:17.625 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/mrp.c' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/802/.built-in.a.cmd' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/802' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/psample/Kconfig' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/psample/Makefile' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/psample/psample.c' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/psample' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpfilter/Kconfig' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpfilter/bpfilter_umh_blob.S' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpfilter/msgfmt.h' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpfilter/Makefile' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpfilter/bpfilter_kern.c' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpfilter/main.c' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpfilter/.gitignore' 2024-05-08T09:45:17.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/bpfilter' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ife/Kconfig' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ife/Makefile' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ife/ife.c' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ife' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/built-in.a' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/Kconfig' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/modules.order' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/.input.o.cmd' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/input.c' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/input.o' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/.core.o.cmd' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/.modules.order.cmd' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/rfkill-gpio.c' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/Makefile' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/rfkill.h' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/built-in.a' 2024-05-08T09:45:17.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/.built-in.a.cmd' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/core.c' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rfkill/core.o' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/rfkill' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethernet/modules.order' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethernet/.modules.order.cmd' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethernet/Makefile' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethernet/built-in.a' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethernet/.eth.o.cmd' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethernet/eth.c' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethernet/eth.o' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethernet/.built-in.a.cmd' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ethernet' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/Kconfig' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_compat.c' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_output.c' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_replay.o' 2024-05-08T09:45:17.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_hash.o.cmd' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_policy.c' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/modules.order' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_output.o' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_sysctl.o.cmd' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_user.o' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_proc.c' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_inout.h' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_state.o' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_input.o' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_hash.h' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_sysctl.o' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_hash.c' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.modules.order.cmd' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_state.c' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_input.o.cmd' 2024-05-08T09:45:17.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_algo.o' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_device.o' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/Makefile' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_user.o.cmd' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_hash.o' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_user.c' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_policy.o.cmd' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_replay.o.cmd' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/built-in.a' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_algo.c' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_device.o.cmd' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_interface_core.c' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_sysctl.c' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_policy.o' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_input.c' 2024-05-08T09:45:17.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.built-in.a.cmd' 2024-05-08T09:45:17.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_output.o.cmd' 2024-05-08T09:45:17.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_ipcomp.c' 2024-05-08T09:45:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.626+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f620810b400 con 0x7f6208103750 2024-05-08T09:45:17.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.627+0000 7f6206000700 1 -- 172.21.15.70:0/1698650733 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11878 (secure 0 0 0) 0x7f61fc0aa270 con 0x7f6208103750 2024-05-08T09:45:17.631 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:45:17.632 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:44:08.302128+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:45:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61f00b2a70 msgr2=0x7f61f00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61f00b2a70 0x7f61f00b4f30 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6208103130 tx=0x7f61f4009260 comp rx=0 tx=0).stop 2024-05-08T09:45:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208103750 msgr2=0x7f62080757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208103750 0x7f62080757a0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00d980 tx=0x7f61fc00dc90 comp rx=0 tx=0).stop 2024-05-08T09:45:17.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 shutdown_connections 2024-05-08T09:45:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f61f00b2a70 0x7f61f00b4f30 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6208108850 0x7f6208076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6208103750 0x7f62080757a0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 --2- 172.21.15.70:0/1698650733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6208104100 0x7f6208075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.630+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 >> 172.21.15.70:0/1698650733 conn(0x7f620807a600 msgr2=0x7f62081018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.631+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 shutdown_connections 2024-05-08T09:45:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:17.631+0000 7f6210600700 1 -- 172.21.15.70:0/1698650733 wait complete. 2024-05-08T09:45:17.633 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 44 2024-05-08T09:45:18.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:18 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1698650733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:45:18.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_device.c' 2024-05-08T09:45:18.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_state.o.cmd' 2024-05-08T09:45:18.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_interface_bpf.c' 2024-05-08T09:45:18.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/xfrm_replay.c' 2024-05-08T09:45:18.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/.xfrm_algo.o.cmd' 2024-05-08T09:45:18.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xfrm/espintcp.c' 2024-05-08T09:45:18.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/xfrm' 2024-05-08T09:45:18.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/Kconfig' 2024-05-08T09:45:18.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/debugfs.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_udp.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_dest.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_mobility.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_routing.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_ghc_ext_route.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_ghc_ext_hop.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/Makefile' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/ndisc.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_ghc_ext_frag.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/iphc.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_ipv6.c' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/6lowpan_i.h' 2024-05-08T09:45:18.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc.h' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_ghc_udp.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_ghc_icmpv6.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/core.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_hop.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_fragment.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/6lowpan/nhc_ghc_ext_dest.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/6lowpan' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/Kconfig' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/pm.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/crypto_test.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/pm_userspace.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/subflow.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/protocol.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/token_test.c' 2024-05-08T09:45:18.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/mib.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/sockopt.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/protocol.h' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/crypto.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/token.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/fastopen.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/diag.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/syncookies.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/Makefile' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/mptcp_diag.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/options.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/pm_netlink.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/mib.h' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/ctrl.c' 2024-05-08T09:45:18.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mptcp/bpf.c' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/mptcp' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/socket.o' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/Kconfig' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/mesh_pathtbl.c' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/mesh.h' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/pm.c' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/debugfs_key.c' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/ht.o' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/chan.c' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.s1g.o.cmd' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/pm.o' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.spectmgmt.o.cmd' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/debug.h' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/offchannel.c' 2024-05-08T09:45:18.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.ibss.o.cmd' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.rx.o.cmd' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.agg-tx.o.cmd' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/driver-ops.o' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/michael.h' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/rate.h' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/agg-tx.o' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/debugfs.c' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/modules.order' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/fils_aead.c' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/debugfs_sta.c' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/debugfs_netdev.c' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/tx.o' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/mesh_hwmp.c' 2024-05-08T09:45:18.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.main.o.cmd' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/s1g.c' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/airtime.o' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/tkip.c' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/wep.h' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.ht.o.cmd' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/mlme.c' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/ht.c' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aes_ccm.h' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/tkip.h' 2024-05-08T09:45:18.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/link.o' 2024-05-08T09:45:18.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:18 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1698650733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:45:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:18 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1698650733' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/mesh_ps.c' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/fils_aead.h' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/trace.o' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/ibss.c' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/debugfs_sta.h' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/offchannel.o' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/rc80211_minstrel_ht.h' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/trace.h' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/eht.c' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/ethtool.c' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aes_gmac.o' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/trace.c' 2024-05-08T09:45:19.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/scan.c' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.chan.o.cmd' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.iface.o.cmd' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/driver-ops.h' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/vht.o' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.agg-rx.o.cmd' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.rate.o.cmd' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/driver-ops.c' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/ocb.o' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.wpa.o.cmd' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/wpa.c' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/debugfs_key.h' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.util.o.cmd' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/drop.h' 2024-05-08T09:45:19.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.vht.o.cmd' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/agg-tx.c' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/cfg.c' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/ibss.o' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.ocb.o.cmd' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.offchannel.o.cmd' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/he.o' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/debugfs.h' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/debugfs_netdev.h' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/rx.c' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/tx.c' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.key.o.cmd' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.modules.order.cmd' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/rc80211_minstrel_ht.c' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.cfg.o.cmd' 2024-05-08T09:45:19.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/iface.c' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/s1g.o' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/iface.o' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/trace_msg.h' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/wpa.o' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/key.o' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/status.c' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/wep.o' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.tx.o.cmd' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/Makefile' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/rc80211_minstrel_ht_debugfs.c' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aes_gmac.c' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aead_api.h' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/eht.o' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.pm.o.cmd' 2024-05-08T09:45:19.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aes_cmac.h' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.aes_cmac.o.cmd' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/mlme.o' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.trace.o.cmd' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/ocb.c' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/he.c' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/rate.c' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/agg-rx.o' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/spectmgmt.c' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.wme.o.cmd' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/built-in.a' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/tdls.o' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/wme.o' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/sta_info.c' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.aead_api.o.cmd' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aead_api.c' 2024-05-08T09:45:19.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.status.o.cmd' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/sta_info.h' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.fils_aead.o.cmd' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aead_api.o' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/ethtool.o' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/vht.c' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/mesh_sync.c' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/led.c' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/spectmgmt.o' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/main.c' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/chan.o' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/led.o' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/cfg.o' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/fils_aead.o' 2024-05-08T09:45:19.054 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aes_cmac.c' 2024-05-08T09:45:19.055 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.wep.o.cmd' 2024-05-08T09:45:19.068 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 80.4 --await-for 42.0' 2024-05-08T09:45:19.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 80.4 --await-for 42.0 2024-05-08T09:45:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:19 smithi070 ceph-mon[29591]: pgmap v5704: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 686 KiB/s wr, 22 op/s 2024-05-08T09:45:19.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:19 smithi172 ceph-mon[33377]: pgmap v5704: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 686 KiB/s wr, 22 op/s 2024-05-08T09:45:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:19 smithi194 ceph-mon[33679]: pgmap v5704: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 686 KiB/s wr, 22 op/s 2024-05-08T09:45:19.581 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/airtime.c' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.michael.o.cmd' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.ethtool.o.cmd' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.he.o.cmd' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/wpa.h' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/rc80211_minstrel_ht.o' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/mesh.c' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/main.o' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/tkip.o' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.eht.o.cmd' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.led.o.cmd' 2024-05-08T09:45:19.769 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.tkip.o.cmd' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/util.o' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/mesh_plink.c' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/ieee80211_i.h' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/scan.o' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.scan.o.cmd' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.sta_info.o.cmd' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/util.c' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.built-in.a.cmd' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/sta_info.o' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.driver-ops.o.cmd' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/michael.c' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.tdls.o.cmd' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/michael.o' 2024-05-08T09:45:19.770 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/rate.o' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/link.c' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/wme.h' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aes_cmac.o' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/tdls.c' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/wme.c' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aes_gmac.h' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/led.h' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.link.o.cmd' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.airtime.o.cmd' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/aes_gcm.h' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/key.h' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/wep.c' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/key.c' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/rx.o' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.aes_gmac.o.cmd' 2024-05-08T09:45:19.771 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.rc80211_minstrel_ht.o.cmd' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/status.o' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/.mlme.o.cmd' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/mac80211/agg-rx.c' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/mac80211' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/Kconfig' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/pn_dev.c' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/datagram.c' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/Makefile' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/socket.c' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/pep-gprs.c' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/af_phonet.c' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/sysctl.c' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/pep.c' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/phonet/pn_netlink.c' 2024-05-08T09:45:19.772 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/phonet' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/modules.order' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/tlshd.c' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/trace.o' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/trace.c' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/request.o' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/.tlshd.o.cmd' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/.netlink.o.cmd' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/.modules.order.cmd' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/Makefile' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/.request.o.cmd' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/handshake-test.c' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/.trace.o.cmd' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/.kunitconfig' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/netlink.o' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/handshake.h' 2024-05-08T09:45:19.773 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/built-in.a' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/request.c' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/genl.h' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/genl.c' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/.genl.o.cmd' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/.built-in.a.cmd' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/tlshd.o' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/genl.o' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/handshake/netlink.c' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/handshake' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/Kconfig' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/.af_packet.o.cmd' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/modules.order' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/internal.h' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/.modules.order.cmd' 2024-05-08T09:45:19.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/diag.c' 2024-05-08T09:45:20.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:20 smithi070 ceph-mon[29591]: pgmap v5705: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 133 op/s 2024-05-08T09:45:20.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:20 smithi172 ceph-mon[33377]: pgmap v5705: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 133 op/s 2024-05-08T09:45:20.430 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:20 smithi194 ceph-mon[33679]: pgmap v5705: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 133 op/s 2024-05-08T09:45:20.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/Makefile' 2024-05-08T09:45:20.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/built-in.a' 2024-05-08T09:45:20.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/.built-in.a.cmd' 2024-05-08T09:45:20.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/af_packet.o' 2024-05-08T09:45:20.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/packet/af_packet.c' 2024-05-08T09:45:20.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/packet' 2024-05-08T09:45:20.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/Kconfig' 2024-05-08T09:45:20.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_cipso_v4.o' 2024-05-08T09:45:20.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_unlabeled.h' 2024-05-08T09:45:20.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_mgmt.o' 2024-05-08T09:45:20.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/modules.order' 2024-05-08T09:45:20.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_addrlist.c' 2024-05-08T09:45:20.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.netlabel_addrlist.o.cmd' 2024-05-08T09:45:20.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.netlabel_domainhash.o.cmd' 2024-05-08T09:45:20.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_unlabeled.o' 2024-05-08T09:45:20.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_cipso_v4.c' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_user.o' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_user.h' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_domainhash.o' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.netlabel_unlabeled.o.cmd' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.modules.order.cmd' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_mgmt.h' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_domainhash.c' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/Makefile' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.netlabel_mgmt.o.cmd' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_mgmt.c' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/built-in.a' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.netlabel_user.o.cmd' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_domainhash.h' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_calipso.o' 2024-05-08T09:45:20.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_addrlist.h' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_unlabeled.c' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.netlabel_kapi.o.cmd' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_kapi.c' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_kapi.o' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.netlabel_cipso_v4.o.cmd' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_cipso_v4.h' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.built-in.a.cmd' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_addrlist.o' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_calipso.c' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_user.c' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/.netlabel_calipso.o.cmd' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netlabel/netlabel_calipso.h' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/netlabel' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/Kconfig' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/modules.order' 2024-05-08T09:45:20.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/.sysctl_net_unix.o.cmd' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/sysctl_net_unix.c' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/.af_unix.o.cmd' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/.modules.order.cmd' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/garbage.o' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/garbage.c' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/diag.c' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/.scm.o.cmd' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/unix_bpf.c' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/Makefile' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/scm.c' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/built-in.a' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/sysctl_net_unix.o' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/.built-in.a.cmd' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/scm.h' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/.garbage.o.cmd' 2024-05-08T09:45:20.633 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/scm.o' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/af_unix.c' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/unix/af_unix.o' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/unix' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpf/modules.order' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpf/test_run.c' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpf/.modules.order.cmd' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpf/Makefile' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpf/bpf_dummy_struct_ops.c' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpf/built-in.a' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/bpf/.built-in.a.cmd' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/bpf' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/compat.o' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/.socket.o.cmd' 2024-05-08T09:45:20.634 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/Kconfig' 2024-05-08T09:45:20.635 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/dns_key.o' 2024-05-08T09:45:20.635 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/dns_query.o' 2024-05-08T09:45:20.635 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/modules.order' 2024-05-08T09:45:20.635 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/.dns_query.o.cmd' 2024-05-08T09:45:20.635 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/internal.h' 2024-05-08T09:45:21.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/.modules.order.cmd' 2024-05-08T09:45:21.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/Makefile' 2024-05-08T09:45:21.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/dns_key.c' 2024-05-08T09:45:21.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/built-in.a' 2024-05-08T09:45:21.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/dns_query.c' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/.built-in.a.cmd' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dns_resolver/.dns_key.o.cmd' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/dns_resolver' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/Kconfig' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/resources.c' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/addr.c' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/pppoatm.c' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/raw.c' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/lec.h' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/signaling.h' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/ioctl.c' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/clip.c' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/atm_misc.c' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/Makefile' 2024-05-08T09:45:21.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/protocols.h' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/svc.c' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/lec_arpc.h' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/mpc.h' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/common.h' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/resources.h' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/mpoa_caches.c' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/common.c' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/addr.h' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/atm_sysfs.c' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/br2684.c' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/mpoa_proc.c' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/mpoa_caches.h' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/mpc.c' 2024-05-08T09:45:21.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/signaling.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/pvc.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/lec.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/atm/proc.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/atm' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/.built-in.a.cmd' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/af_netrom.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/nr_timer.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/nr_loopback.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/nr_in.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/Makefile' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/nr_subr.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/nr_out.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/nr_dev.c' 2024-05-08T09:45:21.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/nr_route.c' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/netrom/sysctl_net_netrom.c' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/netrom' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/appletalk/ddp.c' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/appletalk/atalk_proc.c' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/appletalk/aarp.c' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/appletalk/Makefile' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/appletalk/sysctl_net_atalk.c' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/appletalk/dev.c' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/appletalk' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/Kconfig' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/link.h' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/addr.c' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/bcast.c' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/socket.h' 2024-05-08T09:45:21.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/msg.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/subscr.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/net.h' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/name_distr.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/bcast.h' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/group.h' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/ib_media.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/trace.h' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/netlink_compat.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/trace.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/monitor.h' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/crypto.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/eth_media.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/udp_media.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/diag.c' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/msg.h' 2024-05-08T09:45:21.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/name_table.c' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/udp_media.h' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/Makefile' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/socket.c' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/bearer.h' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/monitor.c' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/net.c' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/discover.c' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/node.h' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/group.c' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/addr.h' 2024-05-08T09:45:21.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/topsrv.c' 2024-05-08T09:45:21.559 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/name_table.h' 2024-05-08T09:45:21.559 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/sysctl.c' 2024-05-08T09:45:21.559 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/node.c' 2024-05-08T09:45:21.559 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/crypto.h' 2024-05-08T09:45:21.559 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/link.c' 2024-05-08T09:45:21.559 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/core.h' 2024-05-08T09:45:21.800 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:45:21.800 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:45:21.800 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:45:21.800 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:45:21.800 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:45:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:45:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:45:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:45:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:45:21.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:45:22.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:45:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:45:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:45:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:45:22.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:45:22.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.436+0000 7feb8d800700 1 -- 172.21.15.70:0/1038190895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 msgr2=0x7feb881080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:22.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.436+0000 7feb8d800700 1 --2- 172.21.15.70:0/1038190895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 0x7feb881080c0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7feb740099c0 tx=0x7feb74009cd0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.437+0000 7feb8d800700 1 -- 172.21.15.70:0/1038190895 shutdown_connections 2024-05-08T09:45:22.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.437+0000 7feb8d800700 1 --2- 172.21.15.70:0/1038190895 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb881087a0 0x7feb881103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.437+0000 7feb8d800700 1 --2- 172.21.15.70:0/1038190895 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb881037b0 0x7feb88103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.437+0000 7feb8d800700 1 --2- 172.21.15.70:0/1038190895 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 0x7feb881080c0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.437+0000 7feb8d800700 1 -- 172.21.15.70:0/1038190895 >> 172.21.15.70:0/1038190895 conn(0x7feb8807a570 msgr2=0x7feb8807a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:22.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.437+0000 7feb8d800700 1 -- 172.21.15.70:0/1038190895 shutdown_connections 2024-05-08T09:45:22.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.437+0000 7feb8d800700 1 -- 172.21.15.70:0/1038190895 wait complete. 2024-05-08T09:45:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.438+0000 7feb8d800700 1 Processor -- start 2024-05-08T09:45:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.438+0000 7feb8d800700 1 -- start start 2024-05-08T09:45:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb8d800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb881037b0 0x7feb8819f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb8d800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 0x7feb8819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb8d800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb881087a0 0x7feb881997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb8d800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb88113550 con 0x7feb88104160 2024-05-08T09:45:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb8d800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb881133d0 con 0x7feb881087a0 2024-05-08T09:45:22.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb8d800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feb881136d0 con 0x7feb881037b0 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb86000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 0x7feb8819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb86000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 0x7feb8819fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53016/0 (socket says 172.21.15.70:53016) 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb86000700 1 -- 172.21.15.70:0/344395592 learned_addr learned my addr 172.21.15.70:0/344395592 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb86a00700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb881037b0 0x7feb8819f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.439+0000 7feb87400700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb881087a0 0x7feb881997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb86000700 1 -- 172.21.15.70:0/344395592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb881037b0 msgr2=0x7feb8819f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb86000700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb881037b0 0x7feb8819f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb86000700 1 -- 172.21.15.70:0/344395592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb881087a0 msgr2=0x7feb881997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb86000700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb881087a0 0x7feb881997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb86000700 1 -- 172.21.15.70:0/344395592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb88199fd0 con 0x7feb88104160 2024-05-08T09:45:22.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb86000700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 0x7feb8819fbb0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7feb740098e0 tx=0x7feb740047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:22.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb7f400700 1 -- 172.21.15.70:0/344395592 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74027070 con 0x7feb88104160 2024-05-08T09:45:22.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb7f400700 1 -- 172.21.15.70:0/344395592 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb7400fd30 con 0x7feb88104160 2024-05-08T09:45:22.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb7f400700 1 -- 172.21.15.70:0/344395592 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74022dc0 con 0x7feb88104160 2024-05-08T09:45:22.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb8d800700 1 -- 172.21.15.70:0/344395592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8819a260 con 0x7feb88104160 2024-05-08T09:45:22.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.440+0000 7feb8d800700 1 -- 172.21.15.70:0/344395592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb881a64d0 con 0x7feb88104160 2024-05-08T09:45:22.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.444+0000 7feb7f400700 1 -- 172.21.15.70:0/344395592 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7feb7402a070 con 0x7feb88104160 2024-05-08T09:45:22.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.446+0000 7feb7f400700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb6c0b2aa0 0x7feb6c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.446+0000 7feb7f400700 1 -- 172.21.15.70:0/344395592 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(434..434 src has 1..434) ==== 9583+0+0 (secure 0 0 0) 0x7feb740e3880 con 0x7feb88104160 2024-05-08T09:45:22.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.446+0000 7feb86a00700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb6c0b2aa0 0x7feb6c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.447+0000 7feb86a00700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb6c0b2aa0 0x7feb6c0b4f60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7feb78005ea0 tx=0x7feb78005e30 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:22.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.469+0000 7feb9826bb80 1 Processor -- start 2024-05-08T09:45:22.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.469+0000 7feb9826bb80 1 -- start start 2024-05-08T09:45:22.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.469+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 0x55699a6441e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.469+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a6481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.469+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a648b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.469+0000 7feb9826bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55699a591bb0 con 0x55699a644720 2024-05-08T09:45:22.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.469+0000 7feb9826bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55699a52f8f0 con 0x55699a648710 2024-05-08T09:45:22.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.469+0000 7feb9826bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55699a58db70 con 0x55699a643e00 2024-05-08T09:45:22.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb86000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a6481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb86000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a6481d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53026/0 (socket says 172.21.15.70:53026) 2024-05-08T09:45:22.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb86000700 1 -- 172.21.15.70:0/3267463234 learned_addr learned my addr 172.21.15.70:0/3267463234 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:22.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb86a00700 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 0x55699a6441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb87400700 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a648b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb86000700 1 -- 172.21.15.70:0/3267463234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 msgr2=0x55699a6441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:22.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb86000700 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 0x55699a6441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb86000700 1 -- 172.21.15.70:0/3267463234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 msgr2=0x55699a648b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:22.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb86000700 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a648b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb86000700 1 -- 172.21.15.70:0/3267463234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a4dea60 con 0x55699a644720 2024-05-08T09:45:22.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.470+0000 7feb87400700 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a648b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:45:22.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.471+0000 7feb86000700 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a6481d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7feb740a67f0 tx=0x7feb740a6740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f43bc3712e6eb65 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:22.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.471+0000 7feb73e00700 1 -- 172.21.15.70:0/3267463234 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb740aae70 con 0x55699a644720 2024-05-08T09:45:22.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.471+0000 7feb73e00700 1 -- 172.21.15.70:0/3267463234 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb740aa770 con 0x55699a644720 2024-05-08T09:45:22.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.471+0000 7feb73e00700 1 -- 172.21.15.70:0/3267463234 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb740aa9d0 con 0x55699a644720 2024-05-08T09:45:22.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.472+0000 7feb9826bb80 1 -- 172.21.15.70:0/3267463234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 msgr2=0x55699a6481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:22.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.472+0000 7feb9826bb80 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a6481d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7feb740a67f0 tx=0x7feb740a6740 comp rx=0 tx=0).stop 2024-05-08T09:45:22.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.472+0000 7feb9826bb80 1 -- 172.21.15.70:0/3267463234 shutdown_connections 2024-05-08T09:45:22.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.472+0000 7feb9826bb80 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a648b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.472+0000 7feb9826bb80 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 0x55699a6441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.472+0000 7feb9826bb80 1 --2- 172.21.15.70:0/3267463234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a6481d0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.472+0000 7feb9826bb80 1 -- 172.21.15.70:0/3267463234 >> 172.21.15.70:0/3267463234 conn(0x55699a5b7860 msgr2=0x55699a63a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:22.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.472+0000 7feb9826bb80 1 -- 172.21.15.70:0/3267463234 shutdown_connections 2024-05-08T09:45:22.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.472+0000 7feb9826bb80 1 -- 172.21.15.70:0/3267463234 wait complete. 2024-05-08T09:45:22.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.473+0000 7feb9826bb80 1 -- start start 2024-05-08T09:45:22.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.473+0000 7feb9826bb80 1 Processor -- start 2024-05-08T09:45:22.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.473+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 0x55699a64fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a64cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a64d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb9826bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55699a650700 con 0x55699a644720 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb9826bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x55699a4f7cb0 con 0x55699a648710 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb9826bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55699a650880 con 0x55699a643e00 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb9826bb80 10 client.0 _ll_register_callbacks cb 0x55699a538e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb86000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a64cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb86000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a64cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53042/0 (socket says 172.21.15.70:53042) 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb86000700 1 -- 172.21.15.70:0/2953513090 learned_addr learned my addr 172.21.15.70:0/2953513090 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb86a00700 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 0x55699a64fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb87400700 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a64d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb86000700 1 -- 172.21.15.70:0/2953513090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 msgr2=0x55699a64fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb86000700 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 0x55699a64fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb86000700 1 -- 172.21.15.70:0/2953513090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 msgr2=0x55699a64d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:22.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb86000700 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a64d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.474+0000 7feb86000700 1 -- 172.21.15.70:0/2953513090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55699a5575b0 con 0x55699a644720 2024-05-08T09:45:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.475+0000 7feb86000700 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a64cf50 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7feb740b3010 tx=0x7feb74009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f25bec6518e3b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.475+0000 7feb70c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:45:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.475+0000 7feb70c00700 1 -- 172.21.15.70:0/2953513090 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb740c4020 con 0x55699a644720 2024-05-08T09:45:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.475+0000 7feb70c00700 1 -- 172.21.15.70:0/2953513090 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(434..434 src has 1..434) ==== 9583+0+0 (secure 0 0 0) 0x7feb740b32c0 con 0x55699a644720 2024-05-08T09:45:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.475+0000 7feb9826bb80 1 -- 172.21.15.70:0/2953513090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb740aa770 con 0x55699a644720 2024-05-08T09:45:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.475+0000 7feb70c00700 1 -- 172.21.15.70:0/2953513090 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7feb740aeb20 con 0x55699a644720 2024-05-08T09:45:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.475+0000 7feb9826bb80 10 client.20001 fetch_fsmap learned FSMap version 44 2024-05-08T09:45:22.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.475+0000 7feb9826bb80 1 -- 172.21.15.70:0/2953513090 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55699a650700 con 0x55699a644720 2024-05-08T09:45:22.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.476+0000 7feb70c00700 1 -- 172.21.15.70:0/2953513090 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb740aa770 con 0x55699a644720 2024-05-08T09:45:22.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.476+0000 7feb70c00700 1 -- 172.21.15.70:0/2953513090 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7feb740bfb30 con 0x55699a644720 2024-05-08T09:45:22.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.476+0000 7feb9826bb80 10 client.20001 fetch_fsmap finished waiting for FSMap version 44 2024-05-08T09:45:22.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.476+0000 7feb9826bb80 10 client.20001 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:45:22.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.476+0000 7feb9826bb80 20 client.20001 populate_metadata read hostname 'smithi070' 2024-05-08T09:45:22.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.476+0000 7feb9826bb80 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55699a65d2d0 0x55699a65f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.476+0000 7feb9826bb80 4 client.20001 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:45:22.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.476+0000 7feb9826bb80 1 -- 172.21.15.70:0/2953513090 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55699a60c2d0 con 0x55699a65d2d0 2024-05-08T09:45:22.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.477+0000 7feb86a00700 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55699a65d2d0 0x55699a65f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.478+0000 7feb70c00700 10 client.20001 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:45:22.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.478+0000 7feb86a00700 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55699a65d2d0 0x55699a65f6c0 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7d553b44d836007 server_cookie=8873154fd52e2efc in_seq=0 out_seq=0 2024-05-08T09:45:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb70c00700 1 -- 172.21.15.70:0/2953513090 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55699a60c2d0 con 0x55699a65d2d0 2024-05-08T09:45:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb70c00700 10 client.20001 handle_command_reply: tid=0 2024-05-08T09:45:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 client.20001 shutdown 2024-05-08T09:45:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 -- 172.21.15.70:0/2953513090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 msgr2=0x55699a64cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a64cf50 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7feb740b3010 tx=0x7feb74009310 comp rx=0 tx=0).stop 2024-05-08T09:45:22.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 -- 172.21.15.70:0/2953513090 shutdown_connections 2024-05-08T09:45:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55699a65d2d0 0x55699a65f6c0 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a64d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a643e00 0x55699a64fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 --2- 172.21.15.70:0/2953513090 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a644720 0x55699a64cf50 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 -- 172.21.15.70:0/2953513090 >> 172.21.15.70:0/2953513090 conn(0x55699a5b7860 msgr2=0x55699a63a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb70c00700 0 client.20001 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:45:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 -- 172.21.15.70:0/2953513090 shutdown_connections 2024-05-08T09:45:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 1 -- 172.21.15.70:0/2953513090 wait complete. 2024-05-08T09:45:22.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.480+0000 7feb9826bb80 20 client.20001 trim_cache size 0 max 16384 2024-05-08T09:45:22.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/name_distr.h' 2024-05-08T09:45:22.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/core.c' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/topsrv.h' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/discover.h' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/bearer.c' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/netlink.c' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/subscr.h' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tipc/netlink.h' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/tipc' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/Kconfig' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/tls_proc.c' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/tls_device.c' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/tls.h' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/trace.h' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/trace.c' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/tls_device_fallback.c' 2024-05-08T09:45:22.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/Makefile' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/tls_strp.c' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/tls_main.c' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/tls_sw.c' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/tls/tls_toe.c' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/tls' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/.sysctl_net.o.cmd' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/kcm/Kconfig' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/kcm/kcmsock.c' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/kcm/Makefile' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/kcm/kcmproc.c' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/kcm' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/rose_timer.c' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/rose_route.c' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/rose_loopback.c' 2024-05-08T09:45:22.496 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/Makefile' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/rose_link.c' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/rose_in.c' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/af_rose.c' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/rose_out.c' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/sysctl_net_rose.c' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/rose_dev.c' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rose/rose_subr.c' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/rose' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/strparser/Kconfig' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/strparser/Makefile' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/strparser/strparser.c' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/strparser' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/xsk_buff_pool.c' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/Kconfig' 2024-05-08T09:45:22.497 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/xsk.c' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/xsk.h' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/Makefile' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/xdp_umem.c' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/xsk_diag.c' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/xsk_queue.h' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/xskmap.c' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/xdp_umem.h' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/xdp/xsk_queue.c' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/xdp' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/flow_dissector.c' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/selftests.o' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dev_addr_lists_test.c' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netclassid_cgroup.c' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/neighbour.o' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.sock_reuseport.o.cmd' 2024-05-08T09:45:22.498 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/page_pool.c' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.fib_notifier.o.cmd' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.fib_rules.o.cmd' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/datagram.o' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/flow_offload.o' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/modules.order' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gen_estimator.c' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.skbuff.o.cmd' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.netevent.o.cmd' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.dev_ioctl.o.cmd' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.link_watch.o.cmd' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gro_cells.c' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netdev-genl.o' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/lwt_bpf.c' 2024-05-08T09:45:22.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/ptp_classifier.o' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gso.o' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.tso.o.cmd' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sysctl_net_core.o' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/net_namespace.c' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.dst.o.cmd' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.gen_stats.o.cmd' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dev.h' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.netpoll.o.cmd' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gro.c' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/net-procfs.o' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/xdp.c' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/fib_rules.o' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dst_cache.o' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/flow_dissector.o' 2024-05-08T09:45:22.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/fib_notifier.o' 2024-05-08T09:45:22.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gso.c' 2024-05-08T09:45:22.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/failover.o' 2024-05-08T09:45:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb9826bb80 1 Processor -- start 2024-05-08T09:45:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb9826bb80 1 -- start start 2024-05-08T09:45:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a6478c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a644720 0x55699a659750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a648710 0x55699a63a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb9826bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb881afb90 con 0x55699a643e00 2024-05-08T09:45:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb9826bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb881ad3c0 con 0x55699a644720 2024-05-08T09:45:22.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb9826bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feb881ab230 con 0x55699a648710 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb86a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a6478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb86a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a6478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53046/0 (socket says 172.21.15.70:53046) 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.504+0000 7feb86a00700 1 -- 172.21.15.70:0/3575645374 learned_addr learned my addr 172.21.15.70:0/3575645374 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.505+0000 7feb86000700 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a644720 0x55699a659750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.505+0000 7feb86a00700 1 -- 172.21.15.70:0/3575645374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a648710 msgr2=0x55699a63a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.505+0000 7feb87400700 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a648710 0x55699a63a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.505+0000 7feb86a00700 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a648710 0x55699a63a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.505+0000 7feb86a00700 1 -- 172.21.15.70:0/3575645374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a644720 msgr2=0x55699a659750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.505+0000 7feb86a00700 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a644720 0x55699a659750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.505+0000 7feb86a00700 1 -- 172.21.15.70:0/3575645374 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a636d00 con 0x55699a643e00 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.505+0000 7feb86000700 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a644720 0x55699a659750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:45:22.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.505+0000 7feb86a00700 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a6478c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7feb7800e9f0 tx=0x7feb7800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95bd3b431e329d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:22.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.506+0000 7feb73400700 1 -- 172.21.15.70:0/3575645374 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7801fc60 con 0x55699a643e00 2024-05-08T09:45:22.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.506+0000 7feb73400700 1 -- 172.21.15.70:0/3575645374 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb7802e070 con 0x55699a643e00 2024-05-08T09:45:22.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.506+0000 7feb73400700 1 -- 172.21.15.70:0/3575645374 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb780108f0 con 0x55699a643e00 2024-05-08T09:45:22.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.506+0000 7feb9826bb80 1 -- 172.21.15.70:0/3575645374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 msgr2=0x55699a6478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:22.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.506+0000 7feb9826bb80 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a6478c0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7feb7800e9f0 tx=0x7feb7800af90 comp rx=0 tx=0).stop 2024-05-08T09:45:22.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.506+0000 7feb9826bb80 1 -- 172.21.15.70:0/3575645374 shutdown_connections 2024-05-08T09:45:22.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.506+0000 7feb9826bb80 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a648710 0x55699a63a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.506+0000 7feb9826bb80 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a6478c0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.506+0000 7feb9826bb80 1 --2- 172.21.15.70:0/3575645374 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a644720 0x55699a659750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.507+0000 7feb9826bb80 1 -- 172.21.15.70:0/3575645374 >> 172.21.15.70:0/3575645374 conn(0x55699a5b7860 msgr2=0x55699a63e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.507+0000 7feb9826bb80 1 -- 172.21.15.70:0/3575645374 shutdown_connections 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.507+0000 7feb9826bb80 1 -- 172.21.15.70:0/3575645374 wait complete. 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.507+0000 7feb9826bb80 1 -- start start 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.507+0000 7feb9826bb80 1 Processor -- start 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a655f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a644720 0x55699a654300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb9826bb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a654840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb9826bb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feb881ab880 con 0x55699a643e00 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb9826bb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feb881accf0 con 0x55699a648710 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb9826bb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feb881abf50 con 0x55699a644720 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb9826bb80 10 client.0 _ll_register_callbacks cb 0x55699a538e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb86a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a655f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb86a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a655f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53052/0 (socket says 172.21.15.70:53052) 2024-05-08T09:45:22.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.508+0000 7feb86a00700 1 -- 172.21.15.70:0/1261029954 learned_addr learned my addr 172.21.15.70:0/1261029954 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:45:22.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb86000700 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a644720 0x55699a654300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb87400700 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a654840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb86a00700 1 -- 172.21.15.70:0/1261029954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a644720 msgr2=0x55699a654300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:22.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb86a00700 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a644720 0x55699a654300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb86a00700 1 -- 172.21.15.70:0/1261029954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 msgr2=0x55699a654840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:45:22.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb86a00700 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a654840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb86a00700 1 -- 172.21.15.70:0/1261029954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55699a636a70 con 0x55699a643e00 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb87400700 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a654840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb86a00700 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a655f50 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7feb78013040 tx=0x7feb7801fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd788cabf50c10 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.509+0000 7feb70c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.510+0000 7feb70c00700 1 -- 172.21.15.70:0/1261029954 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78036070 con 0x55699a643e00 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.510+0000 7feb70c00700 1 -- 172.21.15.70:0/1261029954 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(434..434 src has 1..434) ==== 9583+0+0 (secure 0 0 0) 0x7feb780287c0 con 0x55699a643e00 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.510+0000 7feb9826bb80 1 -- 172.21.15.70:0/1261029954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb7802e070 con 0x55699a643e00 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.510+0000 7feb70c00700 1 -- 172.21.15.70:0/1261029954 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7feb78042050 con 0x55699a643e00 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.510+0000 7feb9826bb80 10 client.20007 fetch_fsmap learned FSMap version 44 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.510+0000 7feb9826bb80 1 -- 172.21.15.70:0/1261029954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55699a6c8860 con 0x55699a643e00 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.510+0000 7feb70c00700 1 -- 172.21.15.70:0/1261029954 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feb7802e070 con 0x55699a643e00 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.511+0000 7feb70c00700 1 -- 172.21.15.70:0/1261029954 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7feb78004b90 con 0x55699a643e00 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.511+0000 7feb9826bb80 10 client.20007 fetch_fsmap finished waiting for FSMap version 44 2024-05-08T09:45:22.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.511+0000 7feb9826bb80 10 client.20007 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:45:22.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.511+0000 7feb9826bb80 20 client.20007 populate_metadata read hostname 'smithi070' 2024-05-08T09:45:22.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.511+0000 7feb9826bb80 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55699a6c8ef0 0x55699a6cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:45:22.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.511+0000 7feb9826bb80 4 client.20007 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.4, "await_for": 42.0}] 2024-05-08T09:45:22.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.511+0000 7feb9826bb80 1 -- 172.21.15.70:0/1261029954 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 80.4, "await_for": 42.0}) -- 0x55699a59f590 con 0x55699a6c8ef0 2024-05-08T09:45:22.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.511+0000 7feb86000700 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55699a6c8ef0 0x55699a6cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:45:22.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.512+0000 7feb86000700 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55699a6c8ef0 0x55699a6cb310 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd5b2f9ae5bae33a server_cookie=814ff4204b0b416f in_seq=0 out_seq=0 2024-05-08T09:45:22.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:22.512+0000 7feb70c00700 10 client.20007 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:45:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:22 smithi070 ceph-mon[29591]: pgmap v5706: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 133 op/s 2024-05-08T09:45:22.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:22 smithi172 ceph-mon[33377]: pgmap v5706: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 133 op/s 2024-05-08T09:45:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:22 smithi194 ceph-mon[33679]: pgmap v5706: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 133 op/s 2024-05-08T09:45:24.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:24 smithi070 ceph-mon[29591]: pgmap v5707: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 118 op/s 2024-05-08T09:45:24.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:24 smithi172 ceph-mon[33377]: pgmap v5707: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 118 op/s 2024-05-08T09:45:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:24 smithi194 ceph-mon[33679]: pgmap v5707: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 2.6 MiB/s wr, 118 op/s 2024-05-08T09:45:26.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:26 smithi070 ceph-mon[29591]: pgmap v5708: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2024-05-08T09:45:26.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:26 smithi172 ceph-mon[33377]: pgmap v5708: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2024-05-08T09:45:27.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:26 smithi194 ceph-mon[33679]: pgmap v5708: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 210 op/s 2024-05-08T09:45:28.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:28 smithi070 ceph-mon[29591]: pgmap v5709: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 194 op/s 2024-05-08T09:45:28.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:28 smithi172 ceph-mon[33377]: pgmap v5709: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 194 op/s 2024-05-08T09:45:29.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:28 smithi194 ceph-mon[33679]: pgmap v5709: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.0 MiB/s wr, 194 op/s 2024-05-08T09:45:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:30 smithi070 ceph-mon[29591]: pgmap v5710: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 217 op/s 2024-05-08T09:45:30.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:30 smithi172 ceph-mon[33377]: pgmap v5710: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 217 op/s 2024-05-08T09:45:31.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:30 smithi194 ceph-mon[33679]: pgmap v5710: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.1 MiB/s wr, 217 op/s 2024-05-08T09:45:32.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:32 smithi070 ceph-mon[29591]: pgmap v5711: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-05-08T09:45:32.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:32 smithi172 ceph-mon[33377]: pgmap v5711: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-05-08T09:45:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:32 smithi194 ceph-mon[33679]: pgmap v5711: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-05-08T09:45:34.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:34 smithi070 ceph-mon[29591]: pgmap v5712: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-05-08T09:45:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:34 smithi172 ceph-mon[33377]: pgmap v5712: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-05-08T09:45:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:34 smithi194 ceph-mon[33679]: pgmap v5712: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 121 op/s 2024-05-08T09:45:36.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:36 smithi070 ceph-mon[29591]: pgmap v5713: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 125 op/s 2024-05-08T09:45:36.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:36 smithi172 ceph-mon[33377]: pgmap v5713: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 125 op/s 2024-05-08T09:45:37.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:36 smithi194 ceph-mon[33679]: pgmap v5713: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 125 op/s 2024-05-08T09:45:38.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:38 smithi070 ceph-mon[29591]: pgmap v5714: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 26 op/s 2024-05-08T09:45:38.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:38 smithi172 ceph-mon[33377]: pgmap v5714: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 26 op/s 2024-05-08T09:45:38.969 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:38 smithi194 ceph-mon[33679]: pgmap v5714: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 138 KiB/s wr, 26 op/s 2024-05-08T09:45:40.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:40 smithi070 ceph-mon[29591]: pgmap v5715: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 209 KiB/s wr, 38 op/s 2024-05-08T09:45:40.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:40 smithi172 ceph-mon[33377]: pgmap v5715: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 209 KiB/s wr, 38 op/s 2024-05-08T09:45:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:40 smithi194 ceph-mon[33679]: pgmap v5715: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 209 KiB/s wr, 38 op/s 2024-05-08T09:45:42.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:42 smithi172 ceph-mon[33377]: pgmap v5716: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 16 op/s 2024-05-08T09:45:43.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:42 smithi194 ceph-mon[33679]: pgmap v5716: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 16 op/s 2024-05-08T09:45:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:42 smithi070 ceph-mon[29591]: pgmap v5716: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 16 op/s 2024-05-08T09:45:43.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.824+0000 7feb70c00700 1 -- 172.21.15.70:0/1261029954 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55699a59f590 con 0x55699a6c8ef0 2024-05-08T09:45:43.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.824+0000 7feb70c00700 10 client.20007 handle_command_reply: tid=0 2024-05-08T09:45:43.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.824+0000 7feb9826bb80 1 client.20007 shutdown 2024-05-08T09:45:43.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.825+0000 7feb9826bb80 1 -- 172.21.15.70:0/1261029954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 msgr2=0x55699a655f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:43.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.825+0000 7feb9826bb80 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a655f50 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7feb78013040 tx=0x7feb7801fce0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.825+0000 7feb9826bb80 1 -- 172.21.15.70:0/1261029954 shutdown_connections 2024-05-08T09:45:43.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.825+0000 7feb9826bb80 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x55699a6c8ef0 0x55699a6cb310 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.825+0000 7feb9826bb80 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55699a648710 0x55699a654840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.825+0000 7feb9826bb80 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55699a643e00 0x55699a655f50 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.825+0000 7feb9826bb80 1 --2- 172.21.15.70:0/1261029954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55699a644720 0x55699a654300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.825+0000 7feb9826bb80 1 -- 172.21.15.70:0/1261029954 >> 172.21.15.70:0/1261029954 conn(0x55699a5b7860 msgr2=0x55699a63f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:43.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.826+0000 7feb70c00700 0 client.20007 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:45:43.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.826+0000 7feb9826bb80 1 -- 172.21.15.70:0/1261029954 shutdown_connections 2024-05-08T09:45:43.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.826+0000 7feb9826bb80 1 -- 172.21.15.70:0/1261029954 wait complete. 2024-05-08T09:45:43.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.826+0000 7feb9826bb80 20 client.20007 trim_cache size 0 max 16384 2024-05-08T09:45:43.826 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 44, 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 390, 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "1dfd702": { 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 390, 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.4, 2024-05-08T09:45:43.827 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:45:43.828 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:45:43.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 -- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb6c0b2aa0 msgr2=0x7feb6c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:43.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb6c0b2aa0 0x7feb6c0b4f60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7feb78005ea0 tx=0x7feb78005e30 comp rx=0 tx=0).stop 2024-05-08T09:45:43.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 -- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 msgr2=0x7feb8819fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:45:43.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 0x7feb8819fbb0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7feb740098e0 tx=0x7feb740047b0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 -- 172.21.15.70:0/344395592 shutdown_connections 2024-05-08T09:45:43.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7feb6c0b2aa0 0x7feb6c0b4f60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feb881087a0 0x7feb881997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb881037b0 0x7feb8819f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 --2- 172.21.15.70:0/344395592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feb88104160 0x7feb8819fbb0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:45:43.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 -- 172.21.15.70:0/344395592 >> 172.21.15.70:0/344395592 conn(0x7feb8807a570 msgr2=0x7feb88102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:45:43.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.828+0000 7feb8d800700 1 -- 172.21.15.70:0/344395592 shutdown_connections 2024-05-08T09:45:43.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:45:43.829+0000 7feb8d800700 1 -- 172.21.15.70:0/344395592 wait complete. 2024-05-08T09:45:44.855 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1dfd702', quiesce took 32.1 seconds. Will release after: 20.4 2024-05-08T09:45:44.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:44 smithi172 ceph-mon[33377]: pgmap v5717: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 16 op/s 2024-05-08T09:45:45.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:44 smithi194 ceph-mon[33679]: pgmap v5717: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 16 op/s 2024-05-08T09:45:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:44 smithi070 ceph-mon[29591]: pgmap v5717: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 75 KiB/s wr, 16 op/s 2024-05-08T09:45:46.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:46 smithi070 ceph-mon[29591]: pgmap v5718: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 19 op/s 2024-05-08T09:45:46.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:46 smithi172 ceph-mon[33377]: pgmap v5718: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 19 op/s 2024-05-08T09:45:47.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:46 smithi194 ceph-mon[33679]: pgmap v5718: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 19 op/s 2024-05-08T09:45:48.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:48 smithi172 ceph-mon[33377]: pgmap v5719: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 130 KiB/s wr, 15 op/s 2024-05-08T09:45:49.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:48 smithi194 ceph-mon[33679]: pgmap v5719: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 130 KiB/s wr, 15 op/s 2024-05-08T09:45:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:48 smithi070 ceph-mon[29591]: pgmap v5719: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 130 KiB/s wr, 15 op/s 2024-05-08T09:45:50.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:50 smithi172 ceph-mon[33377]: pgmap v5720: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 130 KiB/s wr, 18 op/s 2024-05-08T09:45:51.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:50 smithi194 ceph-mon[33679]: pgmap v5720: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 130 KiB/s wr, 18 op/s 2024-05-08T09:45:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:50 smithi070 ceph-mon[29591]: pgmap v5720: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 130 KiB/s wr, 18 op/s 2024-05-08T09:45:52.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:52 smithi172 ceph-mon[33377]: pgmap v5721: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2024-05-08T09:45:53.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:52 smithi194 ceph-mon[33679]: pgmap v5721: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2024-05-08T09:45:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:52 smithi070 ceph-mon[29591]: pgmap v5721: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2024-05-08T09:45:54.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:54 smithi172 ceph-mon[33377]: pgmap v5722: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2024-05-08T09:45:54.931 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:54 smithi070 ceph-mon[29591]: pgmap v5722: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2024-05-08T09:45:55.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:54 smithi194 ceph-mon[33679]: pgmap v5722: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 6 op/s 2024-05-08T09:45:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:56 smithi172 ceph-mon[33377]: pgmap v5723: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2024-05-08T09:45:56.954 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:56 smithi070 ceph-mon[29591]: pgmap v5723: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2024-05-08T09:45:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:56 smithi194 ceph-mon[33679]: pgmap v5723: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 59 KiB/s wr, 8 op/s 2024-05-08T09:45:59.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:45:58 smithi194 ceph-mon[33679]: pgmap v5724: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:45:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:45:58 smithi070 ceph-mon[29591]: pgmap v5724: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:45:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:45:58 smithi172 ceph-mon[33377]: pgmap v5724: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:46:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:00 smithi194 ceph-mon[33679]: pgmap v5725: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:46:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:00 smithi070 ceph-mon[29591]: pgmap v5725: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:46:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:00 smithi172 ceph-mon[33377]: pgmap v5725: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-05-08T09:46:03.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:02 smithi194 ceph-mon[33679]: pgmap v5726: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:46:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:02 smithi070 ceph-mon[29591]: pgmap v5726: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:46:03.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:02 smithi172 ceph-mon[33377]: pgmap v5726: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:46:05.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:04 smithi194 ceph-mon[33679]: pgmap v5727: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:46:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:04 smithi070 ceph-mon[29591]: pgmap v5727: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:46:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:04 smithi172 ceph-mon[33377]: pgmap v5727: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-08T09:46:05.256 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:46:05.744 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:46:06.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:06 smithi070 ceph-mon[29591]: pgmap v5728: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-05-08T09:46:07.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:06 smithi194 ceph-mon[33679]: pgmap v5728: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-05-08T09:46:07.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:06 smithi172 ceph-mon[33377]: pgmap v5728: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 25 op/s 2024-05-08T09:46:08.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.280+0000 7fe45fe00700 1 -- 172.21.15.70:0/2218406252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe460075870 msgr2=0x7fe460075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:08.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.280+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2218406252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe460075870 0x7fe460075c50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0098f0 tx=0x7fe44c009c00 comp rx=0 tx=0).stop 2024-05-08T09:46:08.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.280+0000 7fe45fe00700 1 -- 172.21.15.70:0/2218406252 shutdown_connections 2024-05-08T09:46:08.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.280+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2218406252 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe46010fc70 0x7fe460112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:08.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.280+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2218406252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe460075870 0x7fe460075c50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:08.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.280+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2218406252 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe460076190 0x7fe46010f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:08.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.280+0000 7fe45fe00700 1 -- 172.21.15.70:0/2218406252 >> 172.21.15.70:0/2218406252 conn(0x7fe4600fef20 msgr2=0x7fe460101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:46:08.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.280+0000 7fe45fe00700 1 -- 172.21.15.70:0/2218406252 shutdown_connections 2024-05-08T09:46:08.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.280+0000 7fe45fe00700 1 -- 172.21.15.70:0/2218406252 wait complete. 2024-05-08T09:46:08.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.284+0000 7fe45fe00700 1 Processor -- start 2024-05-08T09:46:08.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.285+0000 7fe45fe00700 1 -- start start 2024-05-08T09:46:08.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.286+0000 7fe45fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe460075870 0x7fe460108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:08.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.286+0000 7fe45fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe460076190 0x7fe460109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:08.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.286+0000 7fe45fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46010fc70 0x7fe460103ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:08.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.286+0000 7fe45fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe4601156b0 con 0x7fe460075870 2024-05-08T09:46:08.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.286+0000 7fe45fe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe460115530 con 0x7fe460076190 2024-05-08T09:46:08.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.286+0000 7fe45fe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe460115830 con 0x7fe46010fc70 2024-05-08T09:46:08.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.288+0000 7fe45ea00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe460075870 0x7fe460108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:08.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.288+0000 7fe45f400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46010fc70 0x7fe460103ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:08.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.288+0000 7fe45f400700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46010fc70 0x7fe460103ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:59390/0 (socket says 172.21.15.70:59390) 2024-05-08T09:46:08.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.288+0000 7fe45f400700 1 -- 172.21.15.70:0/2627363703 learned_addr learned my addr 172.21.15.70:0/2627363703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:46:08.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.289+0000 7fe45ea00700 1 -- 172.21.15.70:0/2627363703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46010fc70 msgr2=0x7fe460103ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:08.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.289+0000 7fe45ea00700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46010fc70 0x7fe460103ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:08.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.289+0000 7fe45ea00700 1 -- 172.21.15.70:0/2627363703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe460076190 msgr2=0x7fe460109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:08.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.289+0000 7fe45ea00700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe460076190 0x7fe460109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:08.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.289+0000 7fe45ea00700 1 -- 172.21.15.70:0/2627363703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4601048f0 con 0x7fe460075870 2024-05-08T09:46:08.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.290+0000 7fe45f400700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46010fc70 0x7fe460103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:46:08.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.290+0000 7fe45ea00700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe460075870 0x7fe460108ed0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009fd0 tx=0x7fe44c00f990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:46:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.291+0000 7fe457400700 1 -- 172.21.15.70:0/2627363703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c00b5e0 con 0x7fe460075870 2024-05-08T09:46:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.291+0000 7fe457400700 1 -- 172.21.15.70:0/2627363703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe44c005040 con 0x7fe460075870 2024-05-08T09:46:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.291+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe460104b80 con 0x7fe460075870 2024-05-08T09:46:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.292+0000 7fe457400700 1 -- 172.21.15.70:0/2627363703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0038c0 con 0x7fe460075870 2024-05-08T09:46:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.292+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe46010edc0 con 0x7fe460075870 2024-05-08T09:46:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.295+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe460076f20 con 0x7fe460075870 2024-05-08T09:46:08.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.300+0000 7fe457400700 1 -- 172.21.15.70:0/2627363703 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe44c0051f0 con 0x7fe460075870 2024-05-08T09:46:08.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.302+0000 7fe457400700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4440b2a70 0x7fe4440b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:08.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.303+0000 7fe457400700 1 -- 172.21.15.70:0/2627363703 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(435..435 src has 1..435) ==== 9671+0+0 (secure 0 0 0) 0x7fe44c0e3870 con 0x7fe460075870 2024-05-08T09:46:08.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.303+0000 7fe45e000700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4440b2a70 0x7fe4440b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:08.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.305+0000 7fe45e000700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4440b2a70 0x7fe4440b4f30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe4601057b0 tx=0x7fe45800b040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:46:08.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.314+0000 7fe457400700 1 -- 172.21.15.70:0/2627363703 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe44c013030 con 0x7fe460075870 2024-05-08T09:46:08.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.831+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe46006a190 con 0x7fe460075870 2024-05-08T09:46:08.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.833+0000 7fe457400700 1 -- 172.21.15.70:0/2627363703 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11878 (secure 0 0 0) 0x7fe44c0aae60 con 0x7fe460075870 2024-05-08T09:46:08.833 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:46:08.833 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":44,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:44:08.302128+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:46:08.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.838+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4440b2a70 msgr2=0x7fe4440b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:08.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.838+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4440b2a70 0x7fe4440b4f30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe4601057b0 tx=0x7fe45800b040 comp rx=0 tx=0).stop 2024-05-08T09:46:08.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.838+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe460075870 msgr2=0x7fe460108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:08.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.838+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe460075870 0x7fe460108ed0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009fd0 tx=0x7fe44c00f990 comp rx=0 tx=0).stop 2024-05-08T09:46:08.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.839+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 shutdown_connections 2024-05-08T09:46:08.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.839+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe4440b2a70 0x7fe4440b4f30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:08.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.839+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe46010fc70 0x7fe460103ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:08.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.839+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe460075870 0x7fe460108ed0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:08.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.839+0000 7fe45fe00700 1 --2- 172.21.15.70:0/2627363703 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe460076190 0x7fe460109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:08.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.839+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 >> 172.21.15.70:0/2627363703 conn(0x7fe4600fef20 msgr2=0x7fe4600ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:46:08.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.840+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 shutdown_connections 2024-05-08T09:46:08.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:08.840+0000 7fe45fe00700 1 -- 172.21.15.70:0/2627363703 wait complete. 2024-05-08T09:46:08.843 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 44 2024-05-08T09:46:09.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:08 smithi194 ceph-mon[33679]: pgmap v5729: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:46:09.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:08 smithi194 ceph-mon[33679]: osdmap e435: 12 total, 12 up, 12 in 2024-05-08T09:46:09.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:08 smithi070 ceph-mon[29591]: pgmap v5729: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:46:09.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:08 smithi070 ceph-mon[29591]: osdmap e435: 12 total, 12 up, 12 in 2024-05-08T09:46:09.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:08 smithi172 ceph-mon[33377]: pgmap v5729: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:46:09.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:08 smithi172 ceph-mon[33377]: osdmap e435: 12 total, 12 up, 12 in 2024-05-08T09:46:10.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2627363703' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:46:10.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2627363703' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:46:10.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2627363703' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:46:10.217 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 1dfd702 --release --await' 2024-05-08T09:46:10.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 1dfd702 --release --await 2024-05-08T09:46:10.883 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:46:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:10 smithi194 ceph-mon[33679]: pgmap v5731: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T09:46:11.068 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:10 smithi070 ceph-mon[29591]: pgmap v5731: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T09:46:11.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:10 smithi172 ceph-mon[33377]: pgmap v5731: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T09:46:13.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:13 smithi070 ceph-mon[29591]: pgmap v5732: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T09:46:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:13 smithi172 ceph-mon[33377]: pgmap v5732: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T09:46:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:13 smithi194 ceph-mon[33679]: pgmap v5732: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T09:46:14.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.636+0000 7f6d5c200700 1 -- 172.21.15.70:0/2207308127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5410b6c0 msgr2=0x7f6d5410baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.636+0000 7f6d5c200700 1 --2- 172.21.15.70:0/2207308127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5410b6c0 0x7f6d5410baa0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009990 tx=0x7f6d48009ca0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.636+0000 7f6d5c200700 1 -- 172.21.15.70:0/2207308127 shutdown_connections 2024-05-08T09:46:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.636+0000 7f6d5c200700 1 --2- 172.21.15.70:0/2207308127 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d54106080 0x7f6d54112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.636+0000 7f6d5c200700 1 --2- 172.21.15.70:0/2207308127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d5410b6c0 0x7f6d5410baa0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.636+0000 7f6d5c200700 1 --2- 172.21.15.70:0/2207308127 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d541056c0 0x7f6d54105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.636+0000 7f6d5c200700 1 -- 172.21.15.70:0/2207308127 >> 172.21.15.70:0/2207308127 conn(0x7f6d541011b0 msgr2=0x7f6d541035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:46:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.636+0000 7f6d5c200700 1 -- 172.21.15.70:0/2207308127 shutdown_connections 2024-05-08T09:46:14.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.636+0000 7f6d5c200700 1 -- 172.21.15.70:0/2207308127 wait complete. 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.637+0000 7f6d5c200700 1 Processor -- start 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.637+0000 7f6d5c200700 1 -- start start 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d5c200700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d541056c0 0x7f6d5419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d5c200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d54106080 0x7f6d5419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d5c200700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5410b6c0 0x7f6d541a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d5c200700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d54115860 con 0x7f6d54106080 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d5c200700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541156e0 con 0x7f6d5410b6c0 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d5c200700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541159e0 con 0x7f6d541056c0 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d58e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d54106080 0x7f6d5419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d58e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d54106080 0x7f6d5419c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35860/0 (socket says 172.21.15.70:35860) 2024-05-08T09:46:14.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d58e00700 1 -- 172.21.15.70:0/3742239684 learned_addr learned my addr 172.21.15.70:0/3742239684 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:46:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.638+0000 7f6d59800700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d541056c0 0x7f6d5419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.639+0000 7f6d5a200700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5410b6c0 0x7f6d541a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.639+0000 7f6d58e00700 1 -- 172.21.15.70:0/3742239684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d541056c0 msgr2=0x7f6d5419be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.639+0000 7f6d58e00700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d541056c0 0x7f6d5419be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.639+0000 7f6d58e00700 1 -- 172.21.15.70:0/3742239684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5410b6c0 msgr2=0x7f6d541a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.639+0000 7f6d58e00700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5410b6c0 0x7f6d541a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.639+0000 7f6d58e00700 1 -- 172.21.15.70:0/3742239684 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d541a0e30 con 0x7f6d54106080 2024-05-08T09:46:14.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.639+0000 7f6d5a200700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5410b6c0 0x7f6d541a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:46:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.639+0000 7f6d58e00700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d54106080 0x7f6d5419c360 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000b530 tx=0x7f6d4000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:46:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.640+0000 7f6d52000700 1 -- 172.21.15.70:0/3742239684 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40015020 con 0x7f6d54106080 2024-05-08T09:46:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.640+0000 7f6d5c200700 1 -- 172.21.15.70:0/3742239684 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d541a1120 con 0x7f6d54106080 2024-05-08T09:46:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.640+0000 7f6d52000700 1 -- 172.21.15.70:0/3742239684 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d40011cc0 con 0x7f6d54106080 2024-05-08T09:46:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.640+0000 7f6d52000700 1 -- 172.21.15.70:0/3742239684 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40010dc0 con 0x7f6d54106080 2024-05-08T09:46:14.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.640+0000 7f6d5c200700 1 -- 172.21.15.70:0/3742239684 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d541a89a0 con 0x7f6d54106080 2024-05-08T09:46:14.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.643+0000 7f6d52000700 1 -- 172.21.15.70:0/3742239684 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6d40018020 con 0x7f6d54106080 2024-05-08T09:46:14.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.645+0000 7f6d52000700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.645+0000 7f6d52000700 1 -- 172.21.15.70:0/3742239684 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(435..435 src has 1..435) ==== 9671+0+0 (secure 0 0 0) 0x7f6d400e21d0 con 0x7f6d54106080 2024-05-08T09:46:14.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.645+0000 7f6d59800700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.646+0000 7f6d59800700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800b5c0 tx=0x7f6d48005fd0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:46:14.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.666+0000 7f6d66be5b80 1 Processor -- start 2024-05-08T09:46:14.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.666+0000 7f6d66be5b80 1 -- start start 2024-05-08T09:46:14.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.666+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c53b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.666+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c53f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.666+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c53fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.666+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56169c484b20 con 0x56169c53b7a0 2024-05-08T09:46:14.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.666+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56169c422860 con 0x56169c53f790 2024-05-08T09:46:14.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.666+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56169c480ae0 con 0x56169c53ae80 2024-05-08T09:46:14.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.667+0000 7f6d58e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c53f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.667+0000 7f6d58e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c53f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35864/0 (socket says 172.21.15.70:35864) 2024-05-08T09:46:14.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.667+0000 7f6d58e00700 1 -- 172.21.15.70:0/2458045711 learned_addr learned my addr 172.21.15.70:0/2458045711 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:46:14.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.667+0000 7f6d59800700 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c53b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.667+0000 7f6d5a200700 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c53fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d58e00700 1 -- 172.21.15.70:0/2458045711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 msgr2=0x56169c53b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:46:14.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d58e00700 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c53b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d58e00700 1 -- 172.21.15.70:0/2458045711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 msgr2=0x56169c53fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:46:14.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d58e00700 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c53fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d58e00700 1 -- 172.21.15.70:0/2458045711 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169c3d19d0 con 0x56169c53b7a0 2024-05-08T09:46:14.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d59800700 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c53b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:46:14.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d58e00700 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c53f250 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f6d400a5160 tx=0x7f6d400a88d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480697c9b1954d39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:46:14.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d46a00700 1 -- 172.21.15.70:0/2458045711 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d400a90e0 con 0x56169c53b7a0 2024-05-08T09:46:14.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d46a00700 1 -- 172.21.15.70:0/2458045711 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d400ad490 con 0x56169c53b7a0 2024-05-08T09:46:14.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.668+0000 7f6d46a00700 1 -- 172.21.15.70:0/2458045711 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d400b1ab0 con 0x56169c53b7a0 2024-05-08T09:46:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.669+0000 7f6d66be5b80 1 -- 172.21.15.70:0/2458045711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 msgr2=0x56169c53f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.669+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c53f250 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f6d400a5160 tx=0x7f6d400a88d0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.670+0000 7f6d66be5b80 1 -- 172.21.15.70:0/2458045711 shutdown_connections 2024-05-08T09:46:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.670+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c53fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.670+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c53b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.670+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/2458045711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c53f250 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.670+0000 7f6d66be5b80 1 -- 172.21.15.70:0/2458045711 >> 172.21.15.70:0/2458045711 conn(0x56169c460c60 msgr2=0x56169c52cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:46:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.670+0000 7f6d66be5b80 1 -- 172.21.15.70:0/2458045711 shutdown_connections 2024-05-08T09:46:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.670+0000 7f6d66be5b80 1 -- 172.21.15.70:0/2458045711 wait complete. 2024-05-08T09:46:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.670+0000 7f6d66be5b80 1 -- start start 2024-05-08T09:46:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.671+0000 7f6d66be5b80 1 Processor -- start 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.671+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c546d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.671+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c5440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.671+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c5445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.671+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56169c5479d0 con 0x56169c53b7a0 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.671+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x56169c3eac20 con 0x56169c53f790 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.671+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x56169c547b50 con 0x56169c53ae80 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.671+0000 7f6d66be5b80 10 client.0 _ll_register_callbacks cb 0x56169c42bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d58e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c5440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d58e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c5440a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35866/0 (socket says 172.21.15.70:35866) 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d58e00700 1 -- 172.21.15.70:0/1973674675 learned_addr learned my addr 172.21.15.70:0/1973674675 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:46:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d59800700 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c546d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d5a200700 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c5445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d58e00700 1 -- 172.21.15.70:0/1973674675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 msgr2=0x56169c546d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:46:14.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d58e00700 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c546d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d58e00700 1 -- 172.21.15.70:0/1973674675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 msgr2=0x56169c5445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d58e00700 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c5445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.672+0000 7f6d58e00700 1 -- 172.21.15.70:0/1973674675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169c44a520 con 0x56169c53b7a0 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.673+0000 7f6d58e00700 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c5440a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000b500 tx=0x7f6d400ad330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f42e9b4e6f0e7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.673+0000 7f6d3b400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.673+0000 7f6d3b400700 1 -- 172.21.15.70:0/1973674675 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d400c7070 con 0x56169c53b7a0 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.673+0000 7f6d3b400700 1 -- 172.21.15.70:0/1973674675 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(435..435 src has 1..435) ==== 9671+0+0 (secure 0 0 0) 0x7f6d400a9550 con 0x56169c53b7a0 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.673+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1973674675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d400ad490 con 0x56169c53b7a0 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.673+0000 7f6d3b400700 1 -- 172.21.15.70:0/1973674675 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f6d400a90e0 con 0x56169c53b7a0 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.673+0000 7f6d66be5b80 10 client.20025 fetch_fsmap learned FSMap version 44 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.673+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1973674675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56169c5479d0 con 0x56169c53b7a0 2024-05-08T09:46:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.674+0000 7f6d3b400700 1 -- 172.21.15.70:0/1973674675 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d400ad490 con 0x56169c53b7a0 2024-05-08T09:46:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.674+0000 7f6d3b400700 1 -- 172.21.15.70:0/1973674675 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f6d400a8340 con 0x56169c53b7a0 2024-05-08T09:46:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.674+0000 7f6d66be5b80 10 client.20025 fetch_fsmap finished waiting for FSMap version 44 2024-05-08T09:46:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.674+0000 7f6d66be5b80 10 client.20025 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:46:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.674+0000 7f6d66be5b80 20 client.20025 populate_metadata read hostname 'smithi070' 2024-05-08T09:46:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.674+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56169c5545d0 0x56169c5569c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.674+0000 7f6d66be5b80 4 client.20025 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:46:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.674+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1973674675 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56169c4ff1a0 con 0x56169c5545d0 2024-05-08T09:46:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.675+0000 7f6d59800700 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56169c5545d0 0x56169c5569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.676+0000 7f6d3b400700 10 client.20025 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:46:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.676+0000 7f6d59800700 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56169c5545d0 0x56169c5569c0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5f4986342b1bf18 server_cookie=bfcf8e33a7c688f9 in_seq=0 out_seq=0 2024-05-08T09:46:14.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d3b400700 1 -- 172.21.15.70:0/1973674675 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56169c4ff1a0 con 0x56169c5545d0 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d3b400700 10 client.20025 handle_command_reply: tid=0 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d66be5b80 1 client.20025 shutdown 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1973674675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 msgr2=0x56169c5440a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c5440a0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000b500 tx=0x7f6d400ad330 comp rx=0 tx=0).stop 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1973674675 shutdown_connections 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56169c5545d0 0x56169c5569c0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c5445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c546d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1973674675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53b7a0 0x56169c5440a0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1973674675 >> 172.21.15.70:0/1973674675 conn(0x56169c460c60 msgr2=0x56169c527850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.678+0000 7f6d3b400700 0 client.20025 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.679+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1973674675 shutdown_connections 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.679+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1973674675 wait complete. 2024-05-08T09:46:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.679+0000 7f6d66be5b80 20 client.20025 trim_cache size 0 max 16384 2024-05-08T09:46:14.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.700+0000 7f6d66be5b80 1 Processor -- start 2024-05-08T09:46:14.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.700+0000 7f6d66be5b80 1 -- start start 2024-05-08T09:46:14.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.701+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c550a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.701+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53b7a0 0x56169c542f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.701+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53f790 0x56169c55c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.701+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541affe0 con 0x56169c53f790 2024-05-08T09:46:14.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.701+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541ad810 con 0x56169c53b7a0 2024-05-08T09:46:14.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.701+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541ab680 con 0x56169c53ae80 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.701+0000 7f6d5a200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53f790 0x56169c55c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.701+0000 7f6d5a200700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53f790 0x56169c55c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35878/0 (socket says 172.21.15.70:35878) 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.701+0000 7f6d5a200700 1 -- 172.21.15.70:0/858765715 learned_addr learned my addr 172.21.15.70:0/858765715 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d59800700 1 --2- 172.21.15.70:0/858765715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c550a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d58e00700 1 --2- 172.21.15.70:0/858765715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53b7a0 0x56169c542f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d5a200700 1 -- 172.21.15.70:0/858765715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 msgr2=0x56169c550a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d5a200700 1 --2- 172.21.15.70:0/858765715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c550a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d5a200700 1 -- 172.21.15.70:0/858765715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53b7a0 msgr2=0x56169c542f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d5a200700 1 --2- 172.21.15.70:0/858765715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53b7a0 0x56169c542f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d5a200700 1 -- 172.21.15.70:0/858765715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56169c52ea30 con 0x56169c53f790 2024-05-08T09:46:14.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d5a200700 1 --2- 172.21.15.70:0/858765715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53f790 0x56169c55c0e0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009f40 tx=0x7f6d4c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75fc1c8e1dc639 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:46:14.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d46000700 1 -- 172.21.15.70:0/858765715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c01c070 con 0x56169c53f790 2024-05-08T09:46:14.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d46000700 1 -- 172.21.15.70:0/858765715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d4c017aa0 con 0x56169c53f790 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.702+0000 7f6d46000700 1 -- 172.21.15.70:0/858765715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c016ab0 con 0x56169c53f790 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.703+0000 7f6d66be5b80 1 -- 172.21.15.70:0/858765715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53f790 msgr2=0x56169c55c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.703+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/858765715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53f790 0x56169c55c0e0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009f40 tx=0x7f6d4c009f70 comp rx=0 tx=0).stop 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.703+0000 7f6d66be5b80 1 -- 172.21.15.70:0/858765715 shutdown_connections 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.703+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/858765715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53f790 0x56169c55c0e0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.703+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/858765715 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53ae80 0x56169c550a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.703+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/858765715 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53b7a0 0x56169c542f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.703+0000 7f6d66be5b80 1 -- 172.21.15.70:0/858765715 >> 172.21.15.70:0/858765715 conn(0x56169c460c60 msgr2=0x56169c542880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.704+0000 7f6d66be5b80 1 -- 172.21.15.70:0/858765715 shutdown_connections 2024-05-08T09:46:14.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.704+0000 7f6d66be5b80 1 -- 172.21.15.70:0/858765715 wait complete. 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.704+0000 7f6d66be5b80 1 -- start start 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.704+0000 7f6d66be5b80 1 Processor -- start 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53ae80 0x56169c54d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53b7a0 0x56169c54b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d66be5b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c54bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541abcd0 con 0x56169c53ae80 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541ad140 con 0x56169c53f790 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d66be5b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6d541ac3a0 con 0x56169c53b7a0 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d66be5b80 10 client.0 _ll_register_callbacks cb 0x56169c42bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d59800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53ae80 0x56169c54d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d59800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53ae80 0x56169c54d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35882/0 (socket says 172.21.15.70:35882) 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d59800700 1 -- 172.21.15.70:0/1086212504 learned_addr learned my addr 172.21.15.70:0/1086212504 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d58e00700 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53b7a0 0x56169c54b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d59800700 1 -- 172.21.15.70:0/1086212504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53b7a0 msgr2=0x56169c54b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d59800700 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53b7a0 0x56169c54b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d5a200700 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c54bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d59800700 1 -- 172.21.15.70:0/1086212504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 msgr2=0x56169c54bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.705+0000 7f6d59800700 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c54bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.706+0000 7f6d59800700 1 -- 172.21.15.70:0/1086212504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56169c53b4b0 con 0x56169c53ae80 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.706+0000 7f6d58e00700 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53b7a0 0x56169c54b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.706+0000 7f6d59800700 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53ae80 0x56169c54d310 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009990 tx=0x7f6d48009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2373a9506fed82 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.706+0000 7f6d3b400700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.706+0000 7f6d3b400700 1 -- 172.21.15.70:0/1086212504 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4800bea0 con 0x56169c53ae80 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.706+0000 7f6d3b400700 1 -- 172.21.15.70:0/1086212504 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(435..435 src has 1..435) ==== 9671+0+0 (secure 0 0 0) 0x7f6d4800fcd0 con 0x56169c53ae80 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.706+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1086212504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d4c017aa0 con 0x56169c53ae80 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d3b400700 1 -- 172.21.15.70:0/1086212504 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f6d48046050 con 0x56169c53ae80 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d66be5b80 10 client.20031 fetch_fsmap learned FSMap version 44 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1086212504 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x56169c5bfba0 con 0x56169c53ae80 2024-05-08T09:46:14.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d3b400700 1 -- 172.21.15.70:0/1086212504 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d4c017aa0 con 0x56169c53ae80 2024-05-08T09:46:14.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d3b400700 1 -- 172.21.15.70:0/1086212504 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 44) ==== 8354+0+0 (secure 0 0 0) 0x7f6d4803d430 con 0x56169c53ae80 2024-05-08T09:46:14.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d66be5b80 10 client.20031 fetch_fsmap finished waiting for FSMap version 44 2024-05-08T09:46:14.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d66be5b80 10 client.20031 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:46:14.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d66be5b80 20 client.20031 populate_metadata read hostname 'smithi070' 2024-05-08T09:46:14.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56169c5c0290 0x56169c5c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:46:14.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d66be5b80 4 client.20031 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1dfd702", "release": true, "await": true}] 2024-05-08T09:46:14.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.707+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1086212504 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1dfd702", "release": true, "await": true}) -- 0x56169c492500 con 0x56169c5c0290 2024-05-08T09:46:14.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.708+0000 7f6d58e00700 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56169c5c0290 0x56169c5c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:46:14.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.709+0000 7f6d58e00700 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56169c5c0290 0x56169c5c26d0 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33afdbda6e5714fa server_cookie=457415e1fac2472b in_seq=0 out_seq=0 2024-05-08T09:46:14.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:14.709+0000 7f6d3b400700 10 client.20031 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:46:15.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:15 smithi070 ceph-mon[29591]: pgmap v5733: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T09:46:15.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:15 smithi172 ceph-mon[33377]: pgmap v5733: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T09:46:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:15 smithi194 ceph-mon[33679]: pgmap v5733: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 27 op/s 2024-05-08T09:46:17.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:17 smithi070 ceph-mon[29591]: pgmap v5734: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:46:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:17 smithi172 ceph-mon[33377]: pgmap v5734: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:46:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:17 smithi194 ceph-mon[33679]: pgmap v5734: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:46:18.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:18 smithi070 ceph-mon[29591]: osdmap e436: 12 total, 12 up, 12 in 2024-05-08T09:46:18.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:18 smithi172 ceph-mon[33377]: osdmap e436: 12 total, 12 up, 12 in 2024-05-08T09:46:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:18 smithi194 ceph-mon[33679]: osdmap e436: 12 total, 12 up, 12 in 2024-05-08T09:46:19.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d3b400700 1 -- 172.21.15.70:0/1086212504 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56169c492500 con 0x56169c5c0290 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d3b400700 10 client.20031 handle_command_reply: tid=0 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d66be5b80 1 client.20031 shutdown 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1086212504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53ae80 msgr2=0x56169c54d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53ae80 0x56169c54d310 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009990 tx=0x7f6d48009ca0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1086212504 shutdown_connections 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x56169c5c0290 0x56169c5c26d0 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x56169c53f790 0x56169c54bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56169c53ae80 0x56169c54d310 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d3b400700 0 client.20031 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d66be5b80 1 --2- 172.21.15.70:0/1086212504 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56169c53b7a0 0x56169c54b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.350+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1086212504 >> 172.21.15.70:0/1086212504 conn(0x56169c460c60 msgr2=0x56169c53e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:46:19.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.351+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1086212504 shutdown_connections 2024-05-08T09:46:19.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.351+0000 7f6d66be5b80 1 -- 172.21.15.70:0/1086212504 wait complete. 2024-05-08T09:46:19.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.351+0000 7f6d66be5b80 20 client.20031 trim_cache size 0 max 16384 2024-05-08T09:46:19.352 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:46:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 44, 2024-05-08T09:46:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:46:19.352 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 392, 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "1dfd702": { 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 392, 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 80.4, 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:46:19.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:46:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:46:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:46:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:46:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:46:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:46:19.354 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:46:19.354 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:46:19.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 -- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 msgr2=0x7f6d3c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800b5c0 tx=0x7f6d48005fd0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 -- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d54106080 msgr2=0x7f6d5419c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d54106080 0x7f6d5419c360 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000b530 tx=0x7f6d4000b840 comp rx=0 tx=0).stop 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 -- 172.21.15.70:0/3742239684 shutdown_connections 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6d3c0b2a70 0x7f6d3c0b4f30 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d5410b6c0 0x7f6d541a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d541056c0 0x7f6d5419be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 --2- 172.21.15.70:0/3742239684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d54106080 0x7f6d5419c360 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.353+0000 7f6d5c200700 1 -- 172.21.15.70:0/3742239684 >> 172.21.15.70:0/3742239684 conn(0x7f6d541011b0 msgr2=0x7f6d54101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.354+0000 7f6d5c200700 1 -- 172.21.15.70:0/3742239684 shutdown_connections 2024-05-08T09:46:19.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:46:19.354+0000 7f6d5c200700 1 -- 172.21.15.70:0/3742239684 wait complete. 2024-05-08T09:46:19.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:19 smithi070 ceph-mon[29591]: pgmap v5736: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 211 B/s wr, 6 op/s 2024-05-08T09:46:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:19 smithi172 ceph-mon[33377]: pgmap v5736: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 211 B/s wr, 6 op/s 2024-05-08T09:46:19.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:19 smithi194 ceph-mon[33679]: pgmap v5736: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 211 B/s wr, 6 op/s 2024-05-08T09:46:20.190 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.neighbour.o.cmd' 2024-05-08T09:46:20.190 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netprio_cgroup.c' 2024-05-08T09:46:20.190 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/net-sysfs.c' 2024-05-08T09:46:20.190 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/skmsg.c' 2024-05-08T09:46:20.190 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/fib_notifier.c' 2024-05-08T09:46:20.190 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.dev.o.cmd' 2024-05-08T09:46:20.190 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netclassid_cgroup.o' 2024-05-08T09:46:20.190 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/stream.c' 2024-05-08T09:46:20.190 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netdev-genl-gen.c' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/datagram.c' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netpoll.c' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.dst_cache.o.cmd' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/lwtunnel.c' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/link_watch.o' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.modules.order.cmd' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/net-procfs.c' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dev_addr_lists.o' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netprio_cgroup.o' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.net_namespace.o.cmd' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.selftests.o.cmd' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.scm.o.cmd' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/selftests.c' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.flow_offload.o.cmd' 2024-05-08T09:46:20.191 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/filter.o' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/Makefile' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.netdev-genl.o.cmd' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.net-procfs.o.cmd' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dst_cache.c' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.utils.o.cmd' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/scm.c' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/request_sock.c' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netpoll.o' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.datagram.o.cmd' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sock_diag.o' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.request_sock.o.cmd' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/xdp.o' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.net-traces.o.cmd' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/flow_offload.c' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sysctl_net_core.c' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dev_addr_lists.c' 2024-05-08T09:46:20.192 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/net-traces.o' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/link_watch.c' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.failover.o.cmd' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/built-in.a' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sock_diag.c' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.gso.o.cmd' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sock.o' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/timestamping.c' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netdev-genl-gen.h' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sock.c' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/rtnetlink.o' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.filter.o.cmd' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/utils.c' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gro_cells.o' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/pktgen.c' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netevent.o' 2024-05-08T09:46:20.193 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netdev-genl.c' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dst.o' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/secure_seq.o' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/skbuff.o' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.stream.o.cmd' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/utils.o' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dev_ioctl.o' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netevent.c' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.netprio_cgroup.o.cmd' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/net-sysfs.h' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.gro_cells.o.cmd' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/hwbm.c' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gen_stats.o' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/filter.c' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gen_stats.c' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.secure_seq.o.cmd' 2024-05-08T09:46:20.194 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/of_net.c' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/net-sysfs.o' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gen_estimator.o' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/bpf_sk_storage.c' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/fib_rules.c' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sock_reuseport.o' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.gro.o.cmd' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.sock_diag.o.cmd' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/drop_monitor.c' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.built-in.a.cmd' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.xdp.o.cmd' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dev_ioctl.c' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/rtnetlink.c' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dev.c' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.sysctl_net_core.o.cmd' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/failover.c' 2024-05-08T09:46:20.195 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sock_reuseport.c' 2024-05-08T09:46:20.196 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/gro.o' 2024-05-08T09:46:20.212 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1dfd702', seconds elapsed: 67.5 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/secure_seq.c' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/request_sock.o' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.rtnetlink.o.cmd' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sock_destructor.h' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.sock.o.cmd' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/tso.c' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.net-sysfs.o.cmd' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dst.c' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.netdev-genl-gen.o.cmd' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.dev_addr_lists.o.cmd' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/skbuff.c' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/ptp_classifier.c' 2024-05-08T09:46:21.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/scm.o' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.gen_estimator.o.cmd' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/net-traces.c' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/neighbour.c' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/sock_map.c' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.netclassid_cgroup.o.cmd' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/dev.o' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/tso.o' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.ptp_classifier.o.cmd' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/stream.o' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/netdev-genl-gen.o' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/net_namespace.o' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/core/.flow_dissector.o.cmd' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/core' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/Kconfig' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/io_thread.c' 2024-05-08T09:46:21.084 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/conn_client.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/server_key.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/conn_service.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/af_rxrpc.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/ar-internal.h' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/rxperf.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/protocol.h' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/input.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/call_state.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/rxkad.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/output.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/security.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/conn_event.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/conn_object.c' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/Makefile' 2024-05-08T09:46:21.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/local_object.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/rtt.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/call_object.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/call_accept.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/peer_object.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/peer_event.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/txbuf.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/utils.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/local_event.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/call_event.c' 2024-05-08T09:46:21.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/sysctl.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/recvmsg.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/insecure.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/sendmsg.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/net_ns.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/misc.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/skbuff.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/proc.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/rxrpc/key.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/rxrpc' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/Kconfig.debug' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/Kconfig' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/nl802154.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/header_ops.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/sysfs.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/nl-mac.c' 2024-05-08T09:46:21.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/sysfs.h' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/trace.h' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/ieee802154.h' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/trace.c' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/nl-phy.c' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/Makefile' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/socket.c' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/6lowpan/Kconfig' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/6lowpan/rx.c' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/6lowpan/tx.c' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/6lowpan/Makefile' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/6lowpan/reassembly.c' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/6lowpan/6lowpan_i.h' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/6lowpan/core.c' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ieee802154/6lowpan' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/nl_policy.c' 2024-05-08T09:46:21.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/nl802154.h' 2024-05-08T09:46:21.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/core.h' 2024-05-08T09:46:21.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/core.c' 2024-05-08T09:46:21.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/netlink.c' 2024-05-08T09:46:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:21 smithi070 ceph-mon[29591]: pgmap v5737: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:46:21.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:21 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:46:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:21 smithi172 ceph-mon[33377]: pgmap v5737: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:46:21.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:21 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:46:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:21 smithi194 ceph-mon[33679]: pgmap v5737: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:46:21.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:21 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:46:21.689 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ieee802154/rdev-ops.h' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ieee802154' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/Kconfig' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_tls.o' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.rpcb_clnt.o.cmd' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.sysctl.o.cmd' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/socklib.c' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.xdr.o.cmd' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/addr.c' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.auth_tls.o.cmd' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.svcsock.o.cmd' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.stats.o.cmd' 2024-05-08T09:46:21.690 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.sunrpc_syms.o.cmd' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/debugfs.c' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/modules.order' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sysfs.c' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.socklib.o.cmd' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xdr.c' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/stats.o' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svcsock.o' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sunrpc_syms.o' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sysfs.h' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.sched.o.cmd' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/addr.o' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svc.o' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svcauth_unix.o' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svcauth_unix.c' 2024-05-08T09:46:21.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/timer.o' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/cache.c' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/clnt.c' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.addr.o.cmd' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprt.c' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/rpc_pipe.c' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.auth_null.o.cmd' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/fail.h' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sched.o' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.timer.o.cmd' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.svc.o.cmd' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/rpc_pipe.o' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/socklib.h' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.modules.order.cmd' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.xprt.o.cmd' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/svc_rdma_recvfrom.c' 2024-05-08T09:46:21.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/verbs.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/svc_rdma.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/rpc_rdma.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/backchannel.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/transport.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/Makefile' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/svc_rdma_rw.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/svc_rdma_transport.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/svc_rdma_backchannel.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/xprt_rdma.h' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/module.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/frwr_ops.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/svc_rdma_sendto.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtrdma/svc_rdma_pcl.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/sunrpc/xprtrdma' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sunrpc_syms.c' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.clnt.o.cmd' 2024-05-08T09:46:21.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.auth_unix.o.cmd' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_tls.c' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/Makefile' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/clnt.o' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svcsock.c' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprt.o' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svcauth.o' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svcauth.c' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sysfs.o' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svc.c' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sunrpc.h' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/stats.c' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_null.o' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/socklib.o' 2024-05-08T09:46:21.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_unix.c' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.kunitconfig' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/built-in.a' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtsock.c' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xdr.o' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_unix.o' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svc_xprt.o' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sched.c' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth.c' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.auth.o.cmd' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.sysfs.o.cmd' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.xprtmultipath.o.cmd' 2024-05-08T09:46:21.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sysctl.c' 2024-05-08T09:46:22.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.svcauth_unix.o.cmd' 2024-05-08T09:46:22.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtmultipath.o' 2024-05-08T09:46:22.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_internal.h' 2024-05-08T09:46:22.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_generic_token.c' 2024-05-08T09:46:22.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_rpc_upcall.c' 2024-05-08T09:46:22.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_crypto.c' 2024-05-08T09:46:22.415 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_wrap.o' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_seqnum.c' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_krb5_mech.o.cmd' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_rpc_xdr.o.cmd' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/modules.order' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_generic_token.o.cmd' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_mech.o' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_rpc_upcall.h' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_unseal.o' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/auth_gss.c' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/trace.o' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_mech_switch.o' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/trace.c' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_mech_switch.c' 2024-05-08T09:46:22.416 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_unseal.c' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_krb5_crypto.o.cmd' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_rpc_xdr.c' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_generic_token.o' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.modules.order.cmd' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_rpc_xdr.o' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/Makefile' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_mech.c' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.trace.o.cmd' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_seal.c' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_krb5_seal.o.cmd' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/built-in.a' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_krb5_wrap.o.cmd' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/svcauth_gss.o' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_rpc_upcall.o' 2024-05-08T09:46:22.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_rpc_xdr.h' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_krb5_seqnum.o.cmd' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_test.c' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_rpc_upcall.o.cmd' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.svcauth_gss.o.cmd' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/auth_gss_internal.h' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_crypto.o' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/auth_gss.o' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.built-in.a.cmd' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_keys.c' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_krb5_unseal.o.cmd' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/svcauth_gss.c' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.auth_gss.o.cmd' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_seqnum.o' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_krb5_keys.o.cmd' 2024-05-08T09:46:22.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/.gss_mech_switch.o.cmd' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_keys.o' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_wrap.c' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_gss/gss_krb5_seal.o' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/sunrpc/auth_gss' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/svc_xprt.c' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/rpcb_clnt.c' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/rpcb_clnt.o' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.built-in.a.cmd' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/backchannel_rqst.c' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.rpc_pipe.o.cmd' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.xprtsock.o.cmd' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.svcauth.o.cmd' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth_null.c' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.svc_xprt.o.cmd' 2024-05-08T09:46:22.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/sysctl.o' 2024-05-08T09:46:22.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtsock.o' 2024-05-08T09:46:22.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/.cache.o.cmd' 2024-05-08T09:46:22.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/auth.o' 2024-05-08T09:46:22.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/timer.c' 2024-05-08T09:46:22.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/cache.o' 2024-05-08T09:46:22.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/netns.h' 2024-05-08T09:46:23.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sunrpc/xprtmultipath.c' 2024-05-08T09:46:23.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/sunrpc' 2024-05-08T09:46:23.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/Kconfig' 2024-05-08T09:46:23.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/proto.c' 2024-05-08T09:46:23.402 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/minisocks.c' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ackvec.c' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/trace.h' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ipv6.h' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/input.c' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ipv6.c' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/output.c' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccid.c' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/diag.c' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ackvec.h' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/feat.h' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/Makefile' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/feat.c' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccid.h' 2024-05-08T09:46:23.403 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/qpolicy.c' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/dccp.h' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ipv4.c' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/sysctl.c' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/options.c' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/Kconfig' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/ccid3.c' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/lib/loss_interval.c' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/lib/tfrc.h' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/lib/packet_history.c' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/lib/tfrc_equation.c' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/lib/packet_history.h' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/lib/loss_interval.h' 2024-05-08T09:46:23.404 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/lib/tfrc.c' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/dccp/ccids/lib' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/ccid3.h' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/ccid2.h' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/ccids/ccid2.c' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/dccp/ccids' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/dccp/timer.c' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/dccp' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/Kconfig' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/Makefile' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/rawsock.c' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/af_nfc.c' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/llcp_commands.c' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/digital_core.c' 2024-05-08T09:46:23.405 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/llcp_sock.c' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/digital.h' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nfc.h' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/digital_dep.c' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/llcp.h' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/Kconfig' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/command.c' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/llc_nop.c' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/llc.c' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/llc.h' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/hcp.c' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/Makefile' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/llc_shdlc.c' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/hci.h' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/hci/core.c' 2024-05-08T09:46:23.406 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/nfc/hci' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/llcp_core.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/core.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/uart.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/Kconfig' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/rsp.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/Makefile' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/spi.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/hci.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/ntf.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/core.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/lib.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/nci/data.c' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/nfc/nci' 2024-05-08T09:46:23.407 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/digital_technology.c' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/nfc/netlink.c' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/nfc' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/sysctl_net.o' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.mm.o.cmd' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.linkmodes.o.cmd' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/linkstate.o' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/fec.o' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/linkstate.c' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.stats.o.cmd' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/pse-pd.c' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/phc_vclocks.c' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/rss.o' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/modules.order' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/coalesce.c' 2024-05-08T09:46:23.408 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.eee.o.cmd' 2024-05-08T09:46:23.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/phc_vclocks.o' 2024-05-08T09:46:23.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/stats.o' 2024-05-08T09:46:23.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/channels.o' 2024-05-08T09:46:23.409 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.channels.o.cmd' 2024-05-08T09:46:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:23 smithi172 ceph-mon[33377]: pgmap v5738: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:46:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:46:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:46:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:46:23.460 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:23 smithi070 ceph-mon[29591]: pgmap v5738: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:46:23.460 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:46:23.460 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:46:23.460 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:46:23.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:23 smithi194 ceph-mon[33679]: pgmap v5738: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:46:23.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:46:23.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:46:23.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:46:24.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/coalesce.o' 2024-05-08T09:46:24.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.privflags.o.cmd' 2024-05-08T09:46:24.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/wol.o' 2024-05-08T09:46:24.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.plca.o.cmd' 2024-05-08T09:46:24.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/ioctl.c' 2024-05-08T09:46:24.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/rings.o' 2024-05-08T09:46:24.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/plca.o' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.strset.o.cmd' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/linkinfo.o' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.phc_vclocks.o.cmd' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.common.o.cmd' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/fec.c' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.netlink.o.cmd' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/linkinfo.c' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.modules.order.cmd' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.tunnels.o.cmd' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/eee.o' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/privflags.o' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/strset.c' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/Makefile' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/linkmodes.c' 2024-05-08T09:46:24.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.linkstate.o.cmd' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/mm.c' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.pause.o.cmd' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.rss.o.cmd' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/tsinfo.c' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.ioctl.o.cmd' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/stats.c' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.pse-pd.o.cmd' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/features.o' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/bitset.c' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/rings.c' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/common.h' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/features.c' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/netlink.o' 2024-05-08T09:46:24.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/common.c' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/built-in.a' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/eeprom.o' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/bitset.h' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/tunnels.c' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.coalesce.o.cmd' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/debug.c' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.linkinfo.o.cmd' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.eeprom.o.cmd' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/pause.c' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.debug.o.cmd' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.bitset.o.cmd' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.features.o.cmd' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.module.o.cmd' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.fec.o.cmd' 2024-05-08T09:46:24.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/common.o' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/cabletest.o' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/tsinfo.o' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/pse-pd.o' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.built-in.a.cmd' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/module.c' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/debug.o' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.rings.o.cmd' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/bitset.o' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/cabletest.c' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/pause.o' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.wol.o.cmd' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/ioctl.o' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/privflags.c' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/module.o' 2024-05-08T09:46:24.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/channels.c' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/wol.c' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/eee.c' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/mm.o' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/eeprom.c' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/tunnels.o' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/rss.c' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/netlink.c' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/linkmodes.o' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/netlink.h' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.tsinfo.o.cmd' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/plca.c' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/strset.o' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/net/ethtool/.cabletest.o.cmd' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net/ethtool' 2024-05-08T09:46:24.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/net' 2024-05-08T09:46:24.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.checked-atomic-arch-fallback.h' 2024-05-08T09:46:24.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/Kconfig' 2024-05-08T09:46:24.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/Kconfig' 2024-05-08T09:46:24.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/modules.order' 2024-05-08T09:46:24.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/modules.order' 2024-05-08T09:46:24.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/pdaudiocf_core.c' 2024-05-08T09:46:24.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/.modules.order.cmd' 2024-05-08T09:46:24.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:24 smithi172 ceph-mon[33377]: pgmap v5739: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:46:24.512 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:24 smithi194 ceph-mon[33679]: pgmap v5739: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:46:24.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:24 smithi070 ceph-mon[29591]: pgmap v5739: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T09:46:24.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/Makefile' 2024-05-08T09:46:24.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/pdaudiocf.c' 2024-05-08T09:46:24.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/pdaudiocf_pcm.c' 2024-05-08T09:46:24.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/built-in.a' 2024-05-08T09:46:24.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/pdaudiocf.h' 2024-05-08T09:46:24.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/.built-in.a.cmd' 2024-05-08T09:46:24.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/pdaudiocf/pdaudiocf_irq.c' 2024-05-08T09:46:24.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pcmcia/pdaudiocf' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/.modules.order.cmd' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/Makefile' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/built-in.a' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/vx/modules.order' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/vx/.modules.order.cmd' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/vx/vxp_ops.c' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/vx/Makefile' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/vx/built-in.a' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/vx/vxp_mixer.c' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/vx/.built-in.a.cmd' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/vx/vxpocket.c' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/vx/vxpocket.h' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pcmcia/vx' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pcmcia/.built-in.a.cmd' 2024-05-08T09:46:24.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pcmcia' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/Kconfig' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/modules.order' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/util_mem.c' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/.modules.order.cmd' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/Makefile' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/built-in.a' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/.built-in.a.cmd' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/emux_seq.c' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/modules.order' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/emux_nrpn.c' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/emux_proc.c' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/.modules.order.cmd' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/emux_effect.c' 2024-05-08T09:46:24.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/emux_synth.c' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/Makefile' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/soundfont.c' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/built-in.a' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/emux_oss.c' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/emux.c' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/emux_voice.h' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/.built-in.a.cmd' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/synth/emux/emux_hwdep.c' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/synth/emux' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/synth' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ac97/Kconfig' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ac97/codec.c' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ac97/snd_ac97_compat.c' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ac97/ac97_core.h' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ac97/Makefile' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ac97/bus.c' 2024-05-08T09:46:24.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/ac97' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/Kconfig' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/modules.order' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/.modules.order.cmd' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/Makefile' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/pxa2xx-ac97.c' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/pxa2xx-ac97-regs.h' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/pxa2xx-ac97-lib.c' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/built-in.a' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/.built-in.a.cmd' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/pxa2xx-pcm-lib.c' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/aaci.h' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/arm/aaci.c' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/arm' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/modules.order' 2024-05-08T09:46:24.994 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/.sound_core.o.cmd' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/Kconfig' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/es1938.c' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme96.c' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/azt3328.h' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctamixer.h' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctvmem.c' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctdaio.c' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/modules.order' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ct20k1reg.h' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctresource.c' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctdaio.h' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/cthardware.h' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/cttimer.c' 2024-05-08T09:46:24.995 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/.modules.order.cmd' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/cthw20k2.c' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctpcm.c' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctsrc.c' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/Makefile' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctatc.h' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/cthw20k1.c' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctatc.c' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctmixer.h' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/built-in.a' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/cttimer.h' 2024-05-08T09:46:25.583 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctimap.c' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctmixer.c' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctsrc.h' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctresource.h' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctvmem.h' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctpcm.h' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/xfi.c' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctamixer.c' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/.built-in.a.cmd' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ctimap.h' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/cthardware.c' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/ct20k2reg.h' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/cthw20k1.h' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ctxfi/cthw20k2.h' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/ctxfi' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au8810.c' 2024-05-08T09:46:25.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au8830.c' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/modules.order' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0.c' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_a3d.c' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_a3d.h' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au8830.h' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_xtalk.c' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_synth.c' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_wt.h' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/.modules.order.cmd' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_game.c' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_a3ddata.c' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/Makefile' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_xtalk.h' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_mixer.c' 2024-05-08T09:46:25.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_eq.h' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_mpu401.c' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0.h' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/built-in.a' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_core.c' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au8810.h' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au8820.h' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_eq.c' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/.built-in.a.cmd' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au8820.c' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_eqdata.c' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/au88x0/au88x0_pcm.c' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/au88x0' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/lx6464es.h' 2024-05-08T09:46:25.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/modules.order' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/lx6464es.c' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/.modules.order.cmd' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/Makefile' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/built-in.a' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/lx_defs.h' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/.built-in.a.cmd' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/lx_core.c' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lx6464es/lx_core.h' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/lx6464es' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/ac97_patch.h' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/modules.order' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/ac97_patch.c' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/.modules.order.cmd' 2024-05-08T09:46:25.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/Makefile' 2024-05-08T09:46:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/built-in.a' 2024-05-08T09:46:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/ac97_codec.c' 2024-05-08T09:46:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/ac97_proc.c' 2024-05-08T09:46:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/.built-in.a.cmd' 2024-05-08T09:46:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/ac97_local.h' 2024-05-08T09:46:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/ac97_pcm.c' 2024-05-08T09:46:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ac97/ac97_id.h' 2024-05-08T09:46:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/ac97' 2024-05-08T09:46:25.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/modules.order' 2024-05-08T09:46:26.122 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/ca0106_proc.c' 2024-05-08T09:46:26.122 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/.modules.order.cmd' 2024-05-08T09:46:26.122 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/Makefile' 2024-05-08T09:46:26.122 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/ca0106_main.c' 2024-05-08T09:46:26.122 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/built-in.a' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/ca_midi.h' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/ca0106_mixer.c' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/ca_midi.c' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/.built-in.a.cmd' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ca0106/ca0106.h' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/ca0106' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/modules.order' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpicmn.h' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpi6000.c' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpi6000.h' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpi6205.c' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpidspcd.c' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpios.h' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpioctl.h' 2024-05-08T09:46:26.123 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpidebug.h' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/.modules.order.cmd' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/Makefile' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpimsginit.h' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpi_version.h' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpidebug.c' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpimsginit.c' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpifunc.c' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpios.c' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/built-in.a' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpipcida.h' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpi_internal.h' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpimsgx.c' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpidspcd.h' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpimsgx.h' 2024-05-08T09:46:26.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/.built-in.a.cmd' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/asihpi.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpi6205.h' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpioctl.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpi.h' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/asihpi/hpicmn.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/asihpi' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigoio.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigoio_dsp.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/echoaudio.h' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/mona_dsp.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/layla24_dsp.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/mia_dsp.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/modules.order' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigoiox.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/darla20.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/mona.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/echoaudio_gml.c' 2024-05-08T09:46:26.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/mia.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/echo3g_dsp.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/gina24.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/layla20.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/.modules.order.cmd' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/gina20_dsp.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/gina20.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/midi.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/Makefile' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/darla24_dsp.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigodjx_dsp.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigodj.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/built-in.a' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/echoaudio_dsp.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigo.c' 2024-05-08T09:46:26.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/echoaudio.c' 2024-05-08T09:46:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/darla20_dsp.c' 2024-05-08T09:46:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/darla24.c' 2024-05-08T09:46:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/gina24_dsp.c' 2024-05-08T09:46:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigo_dsp.c' 2024-05-08T09:46:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/.built-in.a.cmd' 2024-05-08T09:46:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/layla20_dsp.c' 2024-05-08T09:46:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/echoaudio_dsp.h' 2024-05-08T09:46:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigodj_dsp.c' 2024-05-08T09:46:26.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/echoaudio_3g.c' 2024-05-08T09:46:26.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:26 smithi194 ceph-mon[33679]: pgmap v5740: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 67 op/s 2024-05-08T09:46:26.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:26 smithi070 ceph-mon[29591]: pgmap v5740: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 67 op/s 2024-05-08T09:46:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigoiox_dsp.c' 2024-05-08T09:46:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/layla24.c' 2024-05-08T09:46:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigo_express_dsp.c' 2024-05-08T09:46:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/indigodjx.c' 2024-05-08T09:46:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/echoaudio/echo3g.c' 2024-05-08T09:46:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/echoaudio' 2024-05-08T09:46:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/modules.order' 2024-05-08T09:46:26.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/phase.h' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/delta.h' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/delta.c' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/ice1712.h' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/stac946x.h' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/revo.c' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/se.c' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/wm8766.c' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/modules.order' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/ews.h' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/vt1720_mobo.c' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/se.h' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/hoontech.h' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/wtm.c' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/prodigy_hifi.c' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/pontis.h' 2024-05-08T09:46:26.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/wtm.h' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/ews.c' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/juli.c' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/revo.h' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/.modules.order.cmd' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/ice1724.c' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/quartet.h' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/hoontech.c' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/Makefile' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/wm8766.h' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/pontis.c' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/ak4xxx.c' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/wm8776.c' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/amp.c' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/built-in.a' 2024-05-08T09:46:26.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/ice1712.c' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/maya44.h' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/juli.h' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/psc724.h' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/vt1720_mobo.h' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/aureon.h' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/prodigy192.c' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/.built-in.a.cmd' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/aureon.c' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/prodigy_hifi.h' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/maya44.c' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/quartet.c' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/envy24ht.h' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/prodigy192.h' 2024-05-08T09:46:26.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/wm8776.h' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/phase.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/amp.h' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ice1712/psc724.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/ice1712' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/intel8x0m.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emu10k1_patch.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/p17v.h' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emu10k1_main.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/modules.order' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/irq.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emumpu401.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emu10k1_callback.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/memory.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emufx.c' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/.modules.order.cmd' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/tina2.h' 2024-05-08T09:46:26.911 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emuproc.c' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/Makefile' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/io.c' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emu10k1_synth_local.h' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emupcm.c' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/built-in.a' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/voice.c' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emu10k1.c' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/p16v.c' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/.built-in.a.cmd' 2024-05-08T09:46:26.912 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emu10k1_synth.c' 2024-05-08T09:46:26.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:26 smithi172 ceph-mon[33377]: pgmap v5740: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 67 op/s 2024-05-08T09:46:27.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/p16v.h' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/timer.c' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emumixer.c' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/emu10k1/emu10k1x.c' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/emu10k1' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/saa7146.h' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/modules.order' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/aw2-tsl.c' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/.modules.order.cmd' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/Makefile' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/aw2-alsa.c' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/built-in.a' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/aw2-saa7146.h' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/.built-in.a.cmd' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/aw2/aw2-saa7146.c' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/aw2' 2024-05-08T09:46:27.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme9652/rme9652.c' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme9652/modules.order' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme9652/hdsp.c' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme9652/hdspm.c' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme9652/.modules.order.cmd' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme9652/Makefile' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme9652/built-in.a' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme9652/.built-in.a.cmd' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/rme9652' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/Kconfig' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_generic.h' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_hdmi.c' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_controller.c' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/ca0132_regs.h' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.hda_bind.o.cmd' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.hda_jack.o.cmd' 2024-05-08T09:46:27.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/modules.order' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_cirrus.c' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_bind.o' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_cs8409.h' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_via.c' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_tegra.c' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_sysfs.c' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/cs35l41_hda.c' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_intel.h' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_beep.c' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/cs35l41_hda.h' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.hda_intel.o.cmd' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_hwdep.o' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.hda_sysfs.o.cmd' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_proc.c' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/cs35l41_hda_i2c.c' 2024-05-08T09:46:27.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_ca0110.c' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_sigmatel.c' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/cs35l41_hda_spi.c' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.hda_controller.o.cmd' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_sysfs.o' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_proc.o' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_cmedia.c' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_jack.o' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.modules.order.cmd' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_auto_parser.c' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_intel_trace.h' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_codec.c' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.hda_codec.o.cmd' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/Makefile' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_beep.h' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_jack.h' 2024-05-08T09:46:27.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_analog.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/built-in.a' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_cs8409-tables.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_local.h' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_generic.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_cs8409.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_ca0132.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.hda_hwdep.o.cmd' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hp_x360_helper.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_realtek.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_codec.o' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_jack.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/thinkpad_helper.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_si3054.c' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_controller.o' 2024-05-08T09:46:27.735 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.hda_auto_parser.o.cmd' 2024-05-08T09:46:28.626 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_auto_parser.h' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_intel.o' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_controller_trace.h' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.hda_proc.o.cmd' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/.built-in.a.cmd' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_bind.c' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_cs_dsp_ctl.h' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/ideapad_s740_helper.c' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/patch_conexant.c' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_intel.c' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_auto_parser.o' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_component.h' 2024-05-08T09:46:28.627 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_hwdep.c' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_eld.c' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_cs_dsp_ctl.c' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/hda/hda_controller.h' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/hda' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/via82xx_modem.c' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/als4000.c' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/maestro3.c' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr_mix22.c' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/modules.order' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr_core.h' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr_mix22.h' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr_mixer.h' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/.modules.order.cmd' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr_core.c' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr_mixer.c' 2024-05-08T09:46:28.628 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/Makefile' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr.c' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/built-in.a' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr_hwdep.h' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr_hwdep.c' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/pcxhr.h' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/pcxhr/.built-in.a.cmd' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/pcxhr' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/via82xx.c' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ak4531_codec.c' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5530.c' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/azt3328.c' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/sis7019.c' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/nm256/nm256_coef.c' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/nm256/modules.order' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/nm256/.modules.order.cmd' 2024-05-08T09:46:28.629 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/nm256/Makefile' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/nm256/built-in.a' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/nm256/.built-in.a.cmd' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/nm256/nm256.c' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/nm256' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/sis7019.h' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/.modules.order.cmd' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/vx222/modules.order' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/vx222/vx222.c' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/vx222/.modules.order.cmd' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/vx222/vx222_ops.c' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/vx222/Makefile' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/vx222/built-in.a' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/vx222/vx222.h' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/vx222/.built-in.a.cmd' 2024-05-08T09:46:28.630 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/vx222' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ens1370.c' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/atiixp.c' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ymfpci/ymfpci_main.c' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ymfpci/modules.order' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ymfpci/.modules.order.cmd' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ymfpci/Makefile' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ymfpci/ymfpci.h' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ymfpci/built-in.a' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ymfpci/ymfpci.c' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ymfpci/.built-in.a.cmd' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/ymfpci' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/Makefile' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ens1371.c' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/es1968.c' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/oxygen_io.c' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/cs4362a.h' 2024-05-08T09:46:28.631 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/modules.order' 2024-05-08T09:46:28.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/cs4245.h' 2024-05-08T09:46:28.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/oxygen_lib.c' 2024-05-08T09:46:28.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/oxygen_mixer.c' 2024-05-08T09:46:28.632 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/xonar.h' 2024-05-08T09:46:28.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:28 smithi194 ceph-mon[33679]: pgmap v5741: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 65 op/s 2024-05-08T09:46:28.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:28 smithi070 ceph-mon[29591]: pgmap v5741: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 65 op/s 2024-05-08T09:46:28.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:28 smithi172 ceph-mon[33377]: pgmap v5741: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 65 op/s 2024-05-08T09:46:29.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/oxygen.h' 2024-05-08T09:46:29.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/xonar_pcm179x.c' 2024-05-08T09:46:29.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/.modules.order.cmd' 2024-05-08T09:46:29.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/virtuoso.c' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/Makefile' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/oxygen_pcm.c' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/wm8766.h' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/xonar_dg.c' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/se6x.c' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/xonar_dg.h' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/built-in.a' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/xonar_wm87x6.c' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/cs4398.h' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/.built-in.a.cmd' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/wm8785.h' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/cm9780.h' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/xonar_hdmi.c' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/cs2000.h' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/oxygen.c' 2024-05-08T09:46:29.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/pcm1796.h' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/ak4396.h' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/wm8776.h' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/xonar_cs43xx.c' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/oxygen_regs.h' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/xonar_lib.c' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/oxygen/xonar_dg_mixer.c' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/oxygen' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/built-in.a' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/lola_proc.c' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/modules.order' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/lola.c' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/lola_mixer.c' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/.modules.order.cmd' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/lola_pcm.c' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/Makefile' 2024-05-08T09:46:29.373 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/built-in.a' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/lola.h' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/.built-in.a.cmd' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/lola/lola_clock.c' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/lola' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/atiixp_modem.c' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/sonicvibes.c' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/fm801.c' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/rme32.c' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/modules.order' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/dsp_spos.c' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/.modules.order.cmd' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/cs46xx.c' 2024-05-08T09:46:29.374 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/Makefile' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/cs46xx.h' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/built-in.a' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/cs46xx_dsp_spos.h' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/cs46xx_dsp_scb_types.h' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/.built-in.a.cmd' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/cs46xx_dsp_task_types.h' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/cs46xx_lib.h' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/dsp_spos.h' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/dsp_spos_scb_lib.c' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs46xx/cs46xx_lib.c' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/cs46xx' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/riptide/modules.order' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/riptide/.modules.order.cmd' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/riptide/Makefile' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/riptide/built-in.a' 2024-05-08T09:46:29.375 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/riptide/riptide.c' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/riptide/.built-in.a.cmd' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/riptide' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs4281.c' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/als300.c' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/intel8x0.c' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/.built-in.a.cmd' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/mixart.h' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/modules.order' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/mixart_hwdep.c' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/mixart_core.c' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/.modules.order.cmd' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/mixart_mixer.c' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/Makefile' 2024-05-08T09:46:29.376 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/built-in.a' 2024-05-08T09:46:29.377 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/mixart_hwdep.h' 2024-05-08T09:46:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/.built-in.a.cmd' 2024-05-08T09:46:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/mixart_mixer.h' 2024-05-08T09:46:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/mixart.c' 2024-05-08T09:46:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/mixart/mixart_core.h' 2024-05-08T09:46:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/mixart' 2024-05-08T09:46:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/korg1212/modules.order' 2024-05-08T09:46:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/korg1212/korg1212.c' 2024-05-08T09:46:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/korg1212/.modules.order.cmd' 2024-05-08T09:46:30.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/korg1212/Makefile' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/korg1212/built-in.a' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/korg1212/.built-in.a.cmd' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/korg1212' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ad1889.h' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/cs5535audio.h' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/modules.order' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/cs5535audio.c' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/cs5535audio_pcm.c' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/.modules.order.cmd' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/Makefile' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/built-in.a' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/cs5535audio_olpc.c' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/.built-in.a.cmd' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cs5535audio/cs5535audio_pm.c' 2024-05-08T09:46:30.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/cs5535audio' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/cmipci.c' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ali5451/modules.order' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ali5451/.modules.order.cmd' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ali5451/Makefile' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ali5451/built-in.a' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ali5451/ali5451.c' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ali5451/.built-in.a.cmd' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/ali5451' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/ad1889.c' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/bt87x.c' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/trident/trident_memory.c' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/trident/modules.order' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/trident/.modules.order.cmd' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/trident/Makefile' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/trident/trident_main.c' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/trident/built-in.a' 2024-05-08T09:46:30.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/trident/trident.c' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/trident/.built-in.a.cmd' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/pci/trident/trident.h' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci/trident' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/pci' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/media.h' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/Kconfig' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_scarlett_gen2.h' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/quirks-table.h' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/quirks.c' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/modules.order' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_s1810c.h' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/stream.h' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_scarlett_gen2.c' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer.c' 2024-05-08T09:46:30.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/modules.order' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/device.c' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/input.c' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/control.c' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/.modules.order.cmd' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/control.h' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/audio.h' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/midi.c' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/Makefile' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/built-in.a' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/midi.h' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/device.h' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/.built-in.a.cmd' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/input.h' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/caiaq/audio.c' 2024-05-08T09:46:30.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/usb/caiaq' 2024-05-08T09:46:30.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/implicit.c' 2024-05-08T09:46:30.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/card.c' 2024-05-08T09:46:30.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/clock.c' 2024-05-08T09:46:30.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_us16x08.h' 2024-05-08T09:46:30.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/quirks.h' 2024-05-08T09:46:30.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_scarlett.h' 2024-05-08T09:46:30.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usbusx2y.c' 2024-05-08T09:46:30.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usb_stream.h' 2024-05-08T09:46:30.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usbusx2y.h' 2024-05-08T09:46:30.761 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:30 smithi194 ceph-mon[33679]: pgmap v5742: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 160 op/s 2024-05-08T09:46:30.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:30 smithi070 ceph-mon[29591]: pgmap v5742: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 160 op/s 2024-05-08T09:46:30.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:30 smithi172 ceph-mon[33377]: pgmap v5742: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 160 op/s 2024-05-08T09:46:31.085 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/modules.order' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usbusx2yaudio.c' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/us122l.h' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usX2Yhwdep.c' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/us122l.c' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/.modules.order.cmd' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/Makefile' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usb_stream.c' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usx2yhwdeppcm.c' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/built-in.a' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usX2Yhwdep.h' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usx2y.h' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/.built-in.a.cmd' 2024-05-08T09:46:31.086 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usbus428ctldefs.h' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usx2y/usx2yhwdeppcm.h' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/usb/usx2y' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/stream.c' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/pcm.h' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/clock.h' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/pcm.c' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/.modules.order.cmd' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/power.c' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/card.h' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/comm.c' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/modules.order' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/pcm.h' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/pcm.c' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/control.c' 2024-05-08T09:46:31.087 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/.modules.order.cmd' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/control.h' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/midi.c' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/Makefile' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/chip.c' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/common.h' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/built-in.a' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/firmware.c' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/comm.h' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/midi.h' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/firmware.h' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/chip.h' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/6fire/.built-in.a.cmd' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/usb/6fire' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/format.h' 2024-05-08T09:46:31.088 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/midi.c' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/Makefile' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/helper.c' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/format.c' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/power.h' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/hiface/modules.order' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/hiface/pcm.h' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/hiface/pcm.c' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/hiface/.modules.order.cmd' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/hiface/Makefile' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/hiface/chip.c' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/hiface/built-in.a' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/hiface/chip.h' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/hiface/.built-in.a.cmd' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/usb/hiface' 2024-05-08T09:46:31.089 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_quirks.c' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/proc.h' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/built-in.a' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_scarlett.c' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/implicit.h' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/midi2.c' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/midi.h' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/usbaudio.h' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_s1810c.c' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/endpoint.c' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/midi2.h' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer.h' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_maps.c' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/bcd2000/modules.order' 2024-05-08T09:46:31.090 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/bcd2000/.modules.order.cmd' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/bcd2000/Makefile' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/bcd2000/built-in.a' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/bcd2000/.built-in.a.cmd' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/bcd2000/bcd2000.c' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/usb/bcd2000' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/helper.h' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/.built-in.a.cmd' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/validate.c' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/media.c' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/pod.c' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/Kconfig' 2024-05-08T09:46:31.091 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/toneport.c' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/variax.c' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/driver.h' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/playback.c' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/podhd.c' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/capture.h' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/pcm.h' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/pcm.c' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/driver.c' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/midi.c' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/Makefile' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/midibuf.h' 2024-05-08T09:46:31.859 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/midi.h' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/capture.c' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/playback.h' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/line6/midibuf.c' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/usb/line6' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_us16x08.c' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/misc/modules.order' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/misc/.modules.order.cmd' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/misc/Makefile' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/misc/built-in.a' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/misc/.built-in.a.cmd' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/misc/ua101.c' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/usb/misc' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/mixer_quirks.h' 2024-05-08T09:46:31.860 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/proc.c' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/usb/endpoint.h' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/usb' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/Kconfig' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/modules.order' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/array.c' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_sysfs.c' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_regmap.c' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hda_bus_type.c' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/trace.o' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.intel-dsp-config.o.cmd' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/trace.h' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/trace.c' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hdmi_chmap.o.cmd' 2024-05-08T09:46:31.861 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hdac_device.o.cmd' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_controller.o' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/intel-dsp-config.o' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/ext/hdac_ext_bus.c' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/ext/Makefile' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/ext/hdac_ext_controller.c' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/ext/hdac_ext_stream.c' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/hda/ext' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/intel-dsp-config.c' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_device.c' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hdac_controller.o.cmd' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_controller.c' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.modules.order.cmd' 2024-05-08T09:46:31.862 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_sysfs.o' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_stream.c' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_i915.c' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hdac_regmap.o.cmd' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/Makefile' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_regmap.o' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/local.h' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hda_bus_type.o.cmd' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_bus.o' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.trace.o.cmd' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hdac_sysfs.o.cmd' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_bus.c' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.intel-nhlt.o.cmd' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_stream.o' 2024-05-08T09:46:31.863 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/built-in.a' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/intel-nhlt.o' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_component.c' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/intel-nhlt.c' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/intel-sdw-acpi.o' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_device.o' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/array.o' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.array.o.cmd' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hdac_stream.o.cmd' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hdac_i915.o.cmd' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.built-in.a.cmd' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/intel-sdw-acpi.c' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdmi_chmap.c' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hdac_component.o.cmd' 2024-05-08T09:46:31.864 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.intel-sdw-acpi.o.cmd' 2024-05-08T09:46:31.865 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_component.o' 2024-05-08T09:46:31.865 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/.hdac_bus.o.cmd' 2024-05-08T09:46:31.865 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hda_bus_type.o' 2024-05-08T09:46:31.865 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdmi_chmap.o' 2024-05-08T09:46:32.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:32 smithi194 ceph-mon[33679]: pgmap v5743: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 157 op/s 2024-05-08T09:46:32.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:32 smithi070 ceph-mon[29591]: pgmap v5743: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 157 op/s 2024-05-08T09:46:32.904 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/hda/hdac_i915.o' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/hda' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sound_core.c' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/spi/Kconfig' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/spi/modules.order' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/spi/.modules.order.cmd' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/spi/at73c213.c' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/spi/Makefile' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/spi/built-in.a' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/spi/at73c213.h' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/spi/.built-in.a.cmd' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/spi' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ac97_bus.c' 2024-05-08T09:46:32.905 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/tumbler.c' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/Kconfig' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/snd_ps3.c' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/burgundy.h' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/tumbler_volume.h' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/modules.order' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/snd_ps3.h' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/burgundy.c' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/.modules.order.cmd' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/daca.c' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/keywest.c' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/awacs.c' 2024-05-08T09:46:32.906 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/Makefile' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/awacs.h' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/pmac.c' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/pmac.h' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/built-in.a' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/snd_ps3_reg.h' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/.built-in.a.cmd' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/beep.c' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/ppc/powermac.c' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/ppc' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/Kconfig' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_pcm_ops.c' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/modules.order' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_ctl_msg.c' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/.modules.order.cmd' 2024-05-08T09:46:32.907 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_card.h' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_pcm.c' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_pcm_msg.c' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_card.c' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_pcm.h' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/Makefile' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_ctl_msg.h' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/built-in.a' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_jack.c' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/.built-in.a.cmd' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/virtio/virtio_chmap.c' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/virtio' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/Kconfig' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/modules.order' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/sgio2audio.c' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/ad1843.c' 2024-05-08T09:46:32.908 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/.modules.order.cmd' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/Makefile' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/hal2.c' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/built-in.a' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/.built-in.a.cmd' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/snd-n64.c' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/mips/hal2.h' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/mips' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/last.o' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sh/Kconfig' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sh/modules.order' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sh/aica.h' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sh/aica.c' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sh/.modules.order.cmd' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sh/Makefile' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sh/built-in.a' 2024-05-08T09:46:32.909 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sh/.built-in.a.cmd' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sh/sh_dac_audio.c' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/sh' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/x86/Kconfig' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/x86/modules.order' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/x86/.modules.order.cmd' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/x86/Makefile' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/x86/intel_hdmi_audio.c' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/x86/built-in.a' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/x86/intel_hdmi_lpe_audio.h' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/x86/.built-in.a.cmd' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/x86/intel_hdmi_audio.h' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/x86' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/.modules.order.cmd' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-mt6366-da7219-max98357.c' 2024-05-08T09:46:32.910 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-afe-common.h' 2024-05-08T09:46:32.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:32 smithi172 ceph-mon[33377]: pgmap v5743: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 157 op/s 2024-05-08T09:46:33.491 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-afe-clk.h' 2024-05-08T09:46:33.491 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-afe-pcm.c' 2024-05-08T09:46:33.491 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-reg.h' 2024-05-08T09:46:33.491 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-audsys-clkid.h' 2024-05-08T09:46:33.491 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-dai-pcm.c' 2024-05-08T09:46:33.491 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-dai-tdm.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-dai-adda.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-afe-gpio.h' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-afe-gpio.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-afe-clk.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-mt6366-common.h' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/Makefile' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-mt6366-rt1019-rt5682s.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-dai-src.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-afe-control.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-interconnection.h' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-dai-hostless.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-audsys-clk.h' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-dai-hw-gain.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-dai-i2s.c' 2024-05-08T09:46:33.492 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-audsys-clk.c' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-mt6366-common.c' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8186/mt8186-misc-control.c' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek/mt8186' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/Kconfig' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-interconnection.h' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-afe-clk.c' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-dai-i2s.c' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-dai-adda.c' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-reg.h' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-afe-pcm.c' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-dai-tdm.c' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/Makefile' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-afe-control.c' 2024-05-08T09:46:33.493 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-dai-pcm.c' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-afe-gpio.c' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-mt6359-rt1015-rt5682.c' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-afe-common.h' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-afe-clk.h' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8192/mt8192-afe-gpio.h' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek/mt8192' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-afe-clk.c' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-afe-pcm.c' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-audsys-clk.h' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-afe-clk.h' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-reg.h' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/Makefile' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-dai-pcm.c' 2024-05-08T09:46:33.494 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-mt6359.c' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-audsys-clk.c' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-dai-etdm.c' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-dai-adda.c' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-afe-common.h' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8195/mt8195-audsys-clkid.h' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek/mt8195' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt2701/mt2701-afe-pcm.c' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt2701/mt2701-wm8960.c' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt2701/mt2701-afe-clock-ctrl.c' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt2701/Makefile' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt2701/mt2701-afe-clock-ctrl.h' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt2701/mt2701-cs42448.c' 2024-05-08T09:46:33.495 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt2701/mt2701-reg.h' 2024-05-08T09:46:34.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt2701/mt2701-afe-common.h' 2024-05-08T09:46:34.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek/mt2701' 2024-05-08T09:46:34.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-mt6359.c' 2024-05-08T09:46:34.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-audsys-clk.c' 2024-05-08T09:46:34.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-afe-clk.h' 2024-05-08T09:46:34.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-audsys-clkid.h' 2024-05-08T09:46:34.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-afe-clk.c' 2024-05-08T09:46:34.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/Makefile' 2024-05-08T09:46:34.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-dai-pcm.c' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-afe-pcm.c' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-afe-common.h' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-audsys-clk.h' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-reg.h' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-dai-adda.c' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8188/mt8188-dai-etdm.c' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek/mt8188' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/Makefile' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-afe-clk.h' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-afe-pcm.c' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-dai-hostless.c' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-interconnection.h' 2024-05-08T09:46:34.138 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-afe-clk.c' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-afe-common.h' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/Makefile' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-dai-pcm.c' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-reg.h' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-dai-adda.c' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt6797/mt6797-mt6351.c' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek/mt6797' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8173/mt8173-rt5650.c' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8173/mt8173-rt5650-rt5676.c' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8173/mt8173-afe-pcm.c' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8173/Makefile' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8173/mt8173-max98090.c' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8173/mt8173-afe-common.h' 2024-05-08T09:46:34.139 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8173/mt8173-rt5650-rt5514.c' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek/mt8173' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-soc-card.h' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-afe-platform-driver.c' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/Makefile' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-dsp-sof-common.h' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-afe-fe-dai.c' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-afe-platform-driver.h' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-dsp-sof-common.c' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-btcvsd.c' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-soundcard-driver.c' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-soundcard-driver.h' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-afe-fe-dai.h' 2024-05-08T09:46:34.140 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/common/mtk-base-afe.h' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek/common' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-afe-common.h' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-afe-clk.c' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-dai-adda.c' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-interconnection.h' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-dai-pcm.c' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-dai-hostless.c' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-afe-clk.h' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-afe-pcm.c' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-mt6358-ts3a227-max98357.c' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/Makefile' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-da7219-max98357.c' 2024-05-08T09:46:34.141 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-dai-tdm.c' 2024-05-08T09:46:34.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:34 smithi070 ceph-mon[29591]: pgmap v5744: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 157 op/s 2024-05-08T09:46:34.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:34 smithi172 ceph-mon[33377]: pgmap v5744: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 157 op/s 2024-05-08T09:46:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:34 smithi194 ceph-mon[33679]: pgmap v5744: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.1 MiB/s wr, 157 op/s 2024-05-08T09:46:35.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-reg.h' 2024-05-08T09:46:35.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mediatek/mt8183/mt8183-dai-i2s.c' 2024-05-08T09:46:35.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek/mt8183' 2024-05-08T09:46:35.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mediatek' 2024-05-08T09:46:35.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/Kconfig' 2024-05-08T09:46:35.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/generic/Kconfig' 2024-05-08T09:46:35.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/generic/audio-graph-card2-custom-sample.c' 2024-05-08T09:46:35.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/generic/simple-card-utils.c' 2024-05-08T09:46:35.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/generic/simple-card.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/generic/Makefile' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/generic/audio-graph-card.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/generic/test-component.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/generic/audio-graph-card2-custom-sample.dtsi' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/generic/audio-graph-card2.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/generic' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/Kconfig' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-hdmi.h' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/apq8016_sbc.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/sc7280.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-cpu.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/sdw.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-hdmi.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/sdw.h' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/sc8280xp.c' 2024-05-08T09:46:35.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/sc7180.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/Makefile' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass.h' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/apq8096.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/common.h' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-cdc-dma.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/common.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/sdm845.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-sc7180.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-platform.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-sc7280.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/storm.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6adm.c' 2024-05-08T09:46:35.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6afe-clocks.c' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6dsp-lpass-clocks.h' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/audioreach.h' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6apm-dai.c' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6apm.h' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6adm.h' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6dsp-common.h' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6afe.c' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6asm.h' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6dsp-lpass-ports.h' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/Makefile' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6routing.h' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6prm.h' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/topology.c' 2024-05-08T09:46:35.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6dsp-errno.h' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6apm.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6dsp-common.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6asm.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6afe-dai.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6dsp-lpass-clocks.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6asm-dai.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6core.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6prm.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6afe.h' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6apm-lpass-dais.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6dsp-lpass-ports.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6core.h' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6routing.c' 2024-05-08T09:46:35.066 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/audioreach.c' 2024-05-08T09:46:35.067 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/qdsp6/q6prm-clocks.c' 2024-05-08T09:46:35.067 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/qcom/qdsp6' 2024-05-08T09:46:35.067 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/sm8250.c' 2024-05-08T09:46:35.067 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-ipq806x.c' 2024-05-08T09:46:35.067 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-apq8016.c' 2024-05-08T09:46:35.067 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/qcom/lpass-lpaif-reg.h' 2024-05-08T09:46:35.067 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/qcom' 2024-05-08T09:46:35.067 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-topology-test.c' 2024-05-08T09:46:35.067 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/Kconfig' 2024-05-08T09:46:35.926 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/mop500_ab8500.h' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/ux500_msp_i2s.c' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/ux500_pcm.c' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/Makefile' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/ux500_msp_dai.h' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/ux500_msp_dai.c' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/mop500_ab8500.c' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/mop500.c' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/ux500_pcm.h' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ux500/ux500_msp_i2s.h' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/ux500' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/modules.order' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/img/Kconfig' 2024-05-08T09:46:35.927 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/img/pistachio-internal-dac.c' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/img/img-i2s-out.c' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/img/img-i2s-in.c' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/img/Makefile' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/img/img-spdif-in.c' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/img/img-parallel-out.c' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/img/img-spdif-out.c' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/img' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/Kconfig' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/pxa-ssp.h' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/spitz.c' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/Makefile' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/pxa2xx-ac97.c' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/pxa2xx-i2s.h' 2024-05-08T09:46:35.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/pxa-ssp.c' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/mmp-sspa.c' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/mmp-sspa.h' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/pxa2xx-pcm.c' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/pxa/pxa2xx-i2s.c' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/pxa' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/loongson/Kconfig' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/loongson/loongson_i2s_pci.c' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/loongson/loongson_dma.c' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/loongson/Makefile' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/loongson/loongson_dma.h' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/loongson/loongson_i2s.h' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/loongson/loongson_i2s.c' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/loongson/loongson_card.c' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/loongson' 2024-05-08T09:46:35.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/Kconfig' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/raven/acp3x-i2s.c' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/raven/acp3x-pcm-dma.c' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/raven/Makefile' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/raven/acp3x.h' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/raven/chip_offset_byte.h' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/raven/pci-acp3x.c' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/amd/raven' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/renoir/rn-pci-acp3x.c' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/renoir/rn_acp3x.h' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/renoir/acp3x-pdm-dma.c' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/renoir/Makefile' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/renoir/acp3x-rn.c' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/renoir/rn_chip_offset_byte.h' 2024-05-08T09:46:35.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/amd/renoir' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp.h' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/yc/acp6x-pdm-dma.c' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/yc/acp6x-mach.c' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/yc/pci-acp6x.c' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/yc/Makefile' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/yc/acp6x_chip_offset_byte.h' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/yc/acp6x.h' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/amd/yc' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/mach-config.h' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/Kconfig' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-platform.c' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-sof-mach.c' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/amd.h' 2024-05-08T09:46:35.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-pdm.c' 2024-05-08T09:46:35.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-i2s.c' 2024-05-08T09:46:35.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/Makefile' 2024-05-08T09:46:35.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-rembrandt.c' 2024-05-08T09:46:35.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-renoir.c' 2024-05-08T09:46:35.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-mach-common.c' 2024-05-08T09:46:35.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-legacy-mach.c' 2024-05-08T09:46:35.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-pci.c' 2024-05-08T09:46:36.811 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/chip_offset_byte.h' 2024-05-08T09:46:36.811 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp/acp-mach.h' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/amd/acp' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/ps/pci-ps.c' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/ps/acp63.h' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/ps/Makefile' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/ps/ps-sdw-dma.c' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/ps/ps-mach.c' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/ps/ps-pdm-dma.c' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/amd/ps' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp-es8336.c' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/include/acp_2_2_enum.h' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/include/acp_2_2_sh_mask.h' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/include/acp_2_2_d.h' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/amd/include' 2024-05-08T09:46:36.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/Makefile' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp-rt5645.c' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/vangogh/acp5x-i2s.c' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/vangogh/acp5x-mach.c' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/vangogh/pci-acp5x.c' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/vangogh/Makefile' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/vangogh/vg_chip_offset_byte.h' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/vangogh/acp5x.h' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/vangogh/acp5x-pcm-dma.c' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/amd/vangogh' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp-pcm-dma.c' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp3x-rt5682-max9836.c' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp-da7219-max98357a.c' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/acp-config.c' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/rpl/rpl_acp6x.h' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/rpl/rpl_acp6x_chip_offset_byte.h' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/rpl/Makefile' 2024-05-08T09:46:36.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/amd/rpl/rpl-pci-acp6x.c' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/amd/rpl' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/amd' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/xilinx/Kconfig' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/xilinx/xlnx_i2s.c' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/xilinx/xlnx_spdif.c' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/xilinx/Makefile' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/xilinx/xlnx_formatter_pcm.c' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/xilinx' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/Kconfig' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-tdm.h' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/meson-codec-glue.h' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/meson-codec-glue.c' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/g12a-toacodec.c' 2024-05-08T09:46:36.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu-encoder-spdif.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-fifo.h' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-pdm.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-tdm-formatter.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-tdmout.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu-fifo-i2s.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/gx-card.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu-encoder-i2s.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/t9015.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/Makefile' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-spdifin.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu-codec-ctrl.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-spdifout.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-card.c' 2024-05-08T09:46:36.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu-fifo.h' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu-fifo.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu.h' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu-fifo-spdif.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/meson-card-utils.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-tdm-interface.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-toddr.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/meson-card.h' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/g12a-tohdmitx.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-fifo.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-tdm-formatter.h' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-frddr.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/aiu-acodec-ctrl.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/meson/axg-tdmin.c' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/meson' 2024-05-08T09:46:36.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-dai.c' 2024-05-08T09:46:36.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:36 smithi070 ceph-mon[29591]: pgmap v5745: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 254 op/s 2024-05-08T09:46:36.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:36 smithi172 ceph-mon[33377]: pgmap v5745: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 254 op/s 2024-05-08T09:46:37.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:36 smithi194 ceph-mon[33679]: pgmap v5745: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.6 MiB/s wr, 254 op/s 2024-05-08T09:46:37.678 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/jz4740/Kconfig' 2024-05-08T09:46:37.678 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/jz4740/Makefile' 2024-05-08T09:46:37.678 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/jz4740/jz4740-i2s.c' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/jz4740' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/adi/Kconfig' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/adi/Makefile' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/adi/axi-spdif.c' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/adi/axi-i2s.c' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/adi' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-ops.c' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_utils.h' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/Kconfig' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_ssi_dbg.c' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_easrc.h' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_sai.h' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/mpc5200_psc_ac97.c' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_easrc.c' 2024-05-08T09:46:37.679 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-audmix.c' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/mpc5200_dma.h' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_sai.c' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/mpc8610_hpcd.c' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_aud2htx.c' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-pcm.h' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_aud2htx.h' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl-asoc-card.c' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_spdif.h' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/p1022_ds.c' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-audmux.h' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-es8328.c' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_xcvr.h' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-pcm-rpmsg.c' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_asrc.h' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_asrc_common.h' 2024-05-08T09:46:37.680 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_dma.h' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_esai.h' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_audmix.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_asrc.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_audmix.h' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-card.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-sgtl5000.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/efika-audio-fabric.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-pcm-dma.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/Makefile' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-audio-rpmsg.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-ssi.h' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-hdmi.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-spdif.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_micfil.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-pcm-rpmsg.h' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_spdif.c' 2024-05-08T09:46:37.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_qmc_audio.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/p1022_rdk.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_ssi.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_utils.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/mpc5200_psc_i2s.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_dma.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_xcvr.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_esai.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_rpmsg.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_rpmsg.h' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-rpmsg.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_ssi.h' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_mqs.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/eukrea-tlv320.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-audmux.c' 2024-05-08T09:46:37.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_asrc_dma.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/imx-pcm-fiq.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/pcm030-audio-fabric.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/mpc5200_dma.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/fsl/fsl_micfil.h' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/fsl' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5514-spi.h' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5670.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da7213.h' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cq93vc.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l52.h' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4613.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/Kconfig' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8782.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98504.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l56-i2c.c' 2024-05-08T09:46:37.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tscs42xx.c' 2024-05-08T09:46:37.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm9713.h' 2024-05-08T09:46:38.230 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sigmadsp.h' 2024-05-08T09:46:38.230 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5677.c' 2024-05-08T09:46:38.230 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es8328.c' 2024-05-08T09:46:38.230 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es7134.c' 2024-05-08T09:46:38.230 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau-utils.c' 2024-05-08T09:46:38.230 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5677-spi.c' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2770.h' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42xx8.c' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320adcx140.h' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4118.c' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ssm2518.h' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1011.h' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5651.c' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ssm2602-i2c.c' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8903.h' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tscs454.h' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd938x-sdw.c' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8993.h' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8523.c' 2024-05-08T09:46:38.231 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt722-sdca-sdw.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt712-sdca-sdw.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8580.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l36.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1977-spi.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8997.h' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lpass-wsa-macro.h' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lm49453.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic32x4-clk.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l42.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ad1836.h' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98371.h' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau7118.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es8328-spi.c' 2024-05-08T09:46:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42xx8-i2c.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cpcap.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8960.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/simple-amplifier.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/gtm601.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8804-i2c.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sigmadsp.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98388.h' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2552.h' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1015.h' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lm4857.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1318-sdw.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98088.h' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9877.h' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8821.c' 2024-05-08T09:46:38.233 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt715-sdw.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8810.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/src4xxx-i2c.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm9713.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98090.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8737.h' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/isabelle.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt715.h' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1015p.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt286.h' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ab8500-codec.h' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8728.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8903.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas6424.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1308.c' 2024-05-08T09:46:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8540.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1308-sdw.h' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98926.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm9081.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2770.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8985.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l56.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2562.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98926.h' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs47l24.h' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1372-spi.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm179x-i2c.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lpass-rx-macro.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm179x.h' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cros_ec_codec.c' 2024-05-08T09:46:38.235 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm9090.c' 2024-05-08T09:46:38.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rk3328_codec.c' 2024-05-08T09:46:38.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:38 smithi070 ceph-mon[29591]: pgmap v5746: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 200 op/s 2024-05-08T09:46:38.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:38 smithi172 ceph-mon[33377]: pgmap v5746: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 200 op/s 2024-05-08T09:46:39.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:38 smithi194 ceph-mon[33679]: pgmap v5746: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 200 op/s 2024-05-08T09:46:39.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8510.c' 2024-05-08T09:46:39.124 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9860.c' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da7219-aad.c' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1016.c' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8350.c' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd934x.c' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic26.c' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8804.h' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm5102.h' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5670-dsp.h' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l45-i2c.c' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6359-accdet.h' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4271-i2c.c' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es8328.h' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98520.h' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4671.c' 2024-05-08T09:46:39.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/arizona-jack.c' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8983.c' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1761-i2c.c' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5677-spi.h' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/inno_rk3036.h' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm_adsp.c' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8978.h' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm1789-i2c.c' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/arizona.c' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8995.c' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6359.c' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8904.h' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tfa9879.c' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/madera.h' 2024-05-08T09:46:39.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ssm4567.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt711-sdw.h' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l56-spi.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8540.h' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4458.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1373.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs47l85.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas5086.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ad73311.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8804-spi.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8974.h' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98520.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ab8500-codec.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sta350.c' 2024-05-08T09:46:39.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3168a.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt712-sdca-dmic.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8962.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8711.h' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic31xx.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98373-sdw.h' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l41-lib.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs47l24.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rl6231.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3060-spi.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9860.h' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8940.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l45.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm_adsp.h' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98504.h' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l73.c' 2024-05-08T09:46:39.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4641.c' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt274.h' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adav801.c' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4104.c' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8400.h' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/hdac_hdmi.c' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sta32x.h' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1016.h' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4234.c' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd-mbhc-v2.h' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm5102.c' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt711.c' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt715-sdca-sdw.h' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm186x.c' 2024-05-08T09:46:39.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6359-accdet.c' 2024-05-08T09:46:39.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt715-sdca.c' 2024-05-08T09:46:39.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98925.c' 2024-05-08T09:46:39.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ml26124.c' 2024-05-08T09:46:39.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm2000.h' 2024-05-08T09:46:39.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5682s.c' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt711-sdca-sdw.h' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4458.h' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8985.h' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8731-i2c.c' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l42-i2c.c' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5514.c' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l51-i2c.c' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/twl6040.c' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rk817_codec.c' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1373.h' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm5110.c' 2024-05-08T09:46:39.836 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5665.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8996.h' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2552.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l34.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm9090.h' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da7218.h' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2780.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8988.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/spdif_transmitter.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic23.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5616.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8804.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5663.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adav803.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau7118-i2c.c' 2024-05-08T09:46:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8400.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt286.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd938x.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1977-i2c.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98095.h' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4554.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1761-spi.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm5100-tables.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2764.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/spdif_receiver.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l45-spi.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5645.c' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1318-sdw.h' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ssm2602.h' 2024-05-08T09:46:39.838 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd-clsh-v2.h' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm186x-spi.c' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tscs454.c' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8821.h' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/dmic.c' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt711.h' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8741.c' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/jz4770.c' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2780.h' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ssm2602-spi.c' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/stac9766.c' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm0010.c' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da9055.c' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt700-sdw.h' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l51.h' 2024-05-08T09:46:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm2000.c' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5631.c' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/src4xxx.c' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cx20442.c' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98088.c' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt722-sdca-sdw.h' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/zl38060.c' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da732x.h' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8955.h' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic26.h' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt700-sdw.c' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas5720.c' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es8328-i2c.c' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8900.h' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l32.h' 2024-05-08T09:46:39.840 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/idt821034.c' 2024-05-08T09:46:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6351.c' 2024-05-08T09:46:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ads117x.c' 2024-05-08T09:46:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1372.h' 2024-05-08T09:46:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/jz4740.c' 2024-05-08T09:46:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l56-sdw.c' 2024-05-08T09:46:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mc13783.h' 2024-05-08T09:46:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4341.c' 2024-05-08T09:46:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8770.h' 2024-05-08T09:46:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l35.h' 2024-05-08T09:46:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3008.c' 2024-05-08T09:46:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1305.h' 2024-05-08T09:46:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau-utils.h' 2024-05-08T09:46:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l34.h' 2024-05-08T09:46:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt715-sdw.h' 2024-05-08T09:46:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm512x.c' 2024-05-08T09:46:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l41-spi.c' 2024-05-08T09:46:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tfa9879.h' 2024-05-08T09:46:40.417 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4271-spi.c' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es8326.h' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ac97.c' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tscs42xx.h' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l56.h' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1316-sdw.h' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l35.c' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1015.c' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs53l30.h' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4642.c' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8996.c' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/msm8916-wcd-analog.c' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4234.h' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98927.h' 2024-05-08T09:46:40.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adav80x.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas5805m.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9867.h' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt9120.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l42-sdw.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/uda1334.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2562.h' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8580.h' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5659.h' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/Makefile' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98396.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98371.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau7002.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l41.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98373.c' 2024-05-08T09:46:40.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas6424.h' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak5386.c' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/alc5623.h' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs43130.h' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd-mbhc-v2.c' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98388.c' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wl1273.h' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5616.h' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98357a.c' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic23-spi.c' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9867.c' 2024-05-08T09:46:40.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8824.h' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/88pm860x-codec.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5514-spi.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8900.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/inno_rk3036.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ad193x-i2c.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/peb2466.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic32x4.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l56.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/l3.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9850.h' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/alc5623.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm9705.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic3x.c' 2024-05-08T09:46:40.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8510.h' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4270.c' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm1789.c' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm1681.c' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/hda.h' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5663.h' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wsa884x.c' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8770.c' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sma1303.h' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8991.c' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8988.h' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cirrus_legacy.h' 2024-05-08T09:46:40.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt722-sdca.c' 2024-05-08T09:46:40.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4535.h' 2024-05-08T09:46:40.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/uda134x.c' 2024-05-08T09:46:40.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/chv3-codec.c' 2024-05-08T09:46:40.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sma1303.c' 2024-05-08T09:46:40.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l73.h' 2024-05-08T09:46:40.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8978.c' 2024-05-08T09:46:40.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:40 smithi070 ceph-mon[29591]: pgmap v5747: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 288 op/s 2024-05-08T09:46:40.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:40 smithi172 ceph-mon[33377]: pgmap v5747: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 288 op/s 2024-05-08T09:46:41.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:40 smithi194 ceph-mon[33679]: pgmap v5747: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 4.6 MiB/s wr, 288 op/s 2024-05-08T09:46:41.070 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1305.c' 2024-05-08T09:46:41.070 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8824.c' 2024-05-08T09:46:41.070 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l45-tables.c' 2024-05-08T09:46:41.070 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ics43432.c' 2024-05-08T09:46:41.070 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ad1836.c' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98396.h' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8960.h' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5682-sdw.c' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l33.h' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8961.c' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8961.h' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8825.h' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320adcx140.c' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8737.c' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ad1980.c' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm_hubs.h' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8750.c' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4271.h' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1372-i2c.c' 2024-05-08T09:46:41.071 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau7118-hw.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6660.h' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rl6347a.h' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98090.h' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt715.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/hdac_hda.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/jz4725b.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic3x-spi.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98373-i2c.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8731.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8776.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1019.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd9335.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tpa6130a2.c' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas571x.h' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt712-sdca.h' 2024-05-08T09:46:41.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/alc5632.h' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sdw-mockup.c' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es7241.c' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1019.h' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5631.h' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt711-sdca-sdw.c' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic32x4-i2c.c' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4271.c' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98390.h' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l56-shared.c' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm179x.c' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/isabelle.h' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5645.h' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/uda134x.h' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt712-sdca.c' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm1250-ev1.c' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sgtl5000.h' 2024-05-08T09:46:41.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l36.h' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tfa989x.c' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm9712.c' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98390.c' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1701.h' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8822.c' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8962.h' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adav80x.h' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/si476x.c' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8998.c' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm5110.h' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98925.h' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8727.c' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sta529.c' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic32x4.h' 2024-05-08T09:46:41.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2764.h' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt712-sdca-sdw.h' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5660.c' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8810.h' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98363.c' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/aw8738.c' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2781-i2c.c' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4349.c' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l56.h' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4265.c' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6351.h' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak5558.h' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cx20442.h' 2024-05-08T09:46:41.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8971.c' 2024-05-08T09:46:42.001 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6358.c' 2024-05-08T09:46:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l45.h' 2024-05-08T09:46:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/msm8916-wcd-digital.c' 2024-05-08T09:46:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ad193x-spi.c' 2024-05-08T09:46:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/arizona.h' 2024-05-08T09:46:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ts3a227e.c' 2024-05-08T09:46:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/jz4760.c' 2024-05-08T09:46:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt298.h' 2024-05-08T09:46:42.002 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9759.c' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5640.c' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l42.h' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42xx8.h' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1308.h' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sgtl5000.c' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm512x-i2c.c' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8750.h' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic23.h' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da7213.c' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wl1273.c' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau17x1.h' 2024-05-08T09:46:42.003 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3008.h' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/aw88395/aw88395_device.c' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/aw88395/aw88395_lib.h' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/aw88395/aw88395_lib.c' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/aw88395/aw88395_device.h' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/aw88395/aw88395.c' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/aw88395/aw88395_data_type.h' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/aw88395/aw88395.h' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/aw88395/aw88395_reg.h' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/codecs/aw88395' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ssm2602.c' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98373-sdw.c' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/uda1380.c' 2024-05-08T09:46:42.004 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5668.h' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1372.c' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2781-fmwlib.c' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8974.c' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5682s.h' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt700.c' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l83-i2c.c' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt711-sdca.h' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5514.h' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da7210.c' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/src4xxx.h' 2024-05-08T09:46:42.005 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3060.h' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/bt-sco.c' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/simple-mux.c' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd9335.h' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8994.c' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5665.h' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6660.c' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8990.c' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ml26124.h' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd-clsh-v2.c' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lpass-wsa-macro.c' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wsa881x.c' 2024-05-08T09:46:42.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1781-spi.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau17x1.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm1789.h' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/88pm860x-codec.h' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm5100.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320dac33.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lpass-tx-macro.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs47l35.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4375.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1701.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs47l15.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320adc3xxx.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da7219.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3168a-i2c.c' 2024-05-08T09:46:42.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm512x-spi.c' 2024-05-08T09:46:42.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm186x-i2c.c' 2024-05-08T09:46:42.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt711-sdca.c' 2024-05-08T09:46:42.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8995.h' 2024-05-08T09:46:42.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cx2072x.c' 2024-05-08T09:46:42.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8958-dsp2.c' 2024-05-08T09:46:42.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sigmadsp-i2c.c' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8822.h' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm2200.h' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1977.c' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6358.h' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l41-i2c.c' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lochnagar-sc.c' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8524.c' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm512x.h' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es8316.h' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ts3a227e.h' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3168a-spi.c' 2024-05-08T09:46:42.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rl6347a.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5682.h' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm5100.h' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3060-i2c.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320dac33.h' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm5102a.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8825.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/hda.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic32x4-spi.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs53l30.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1761.h' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/madera.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9850.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l41.h' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8997.c' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8523.h' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8728.h' 2024-05-08T09:46:42.529 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1011.c' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mc13783.c' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ad193x.c' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rl6231.h' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1316-sdw.c' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8991.h' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l33.c' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es8316.c' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5651.h' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lm49453.h' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ad73311.h' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5659.c' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8711.c' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1977.h' 2024-05-08T09:46:42.530 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1761.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l51.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8731-spi.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1781.h' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm186x.h' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt715-sdca.h' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ssm2518.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98095.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs43130.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8993.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5668.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ad193x.h' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ssm3515.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5670.h' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3168a.h' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt711-sdw.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8904.c' 2024-05-08T09:46:42.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/hdac_hda.h' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rk3328_codec.h' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8741.h' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt715-sdca-sdw.c' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas5720.h' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic23-i2c.c' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8731.h' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic31xx.h' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sigmadsp-regmap.c' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas571x.c' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da732x_reg.h' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wcd938x.h' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1781.c' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5682.c' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9877.c' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ssm2305.c' 2024-05-08T09:46:42.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/alc5632.c' 2024-05-08T09:46:42.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8990.h' 2024-05-08T09:46:42.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/uda1380.h' 2024-05-08T09:46:42.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm2200.c' 2024-05-08T09:46:42.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/twl6040.h' 2024-05-08T09:46:42.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da7218.c' 2024-05-08T09:46:42.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:42 smithi070 ceph-mon[29591]: pgmap v5748: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 185 op/s 2024-05-08T09:46:42.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:42 smithi172 ceph-mon[33377]: pgmap v5748: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 185 op/s 2024-05-08T09:46:43.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:42 smithi194 ceph-mon[33679]: pgmap v5748: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 185 op/s 2024-05-08T09:46:43.304 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm3060.c' 2024-05-08T09:46:43.304 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8753.h' 2024-05-08T09:46:43.304 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/mt6359.h' 2024-05-08T09:46:43.304 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5640.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/hdac_hdmi.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da732x.c' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt722-sdca.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8940.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cx2072x.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98363.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8994.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic3x-i2c.c' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8983.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt700.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/nau8315.c' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm9081.h' 2024-05-08T09:46:43.305 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lpass-macro-common.h' 2024-05-08T09:46:43.306 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98373.h' 2024-05-08T09:46:43.306 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt1308-sdw.c' 2024-05-08T09:46:43.306 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/twl4030.c' 2024-05-08T09:46:43.306 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max9768.c' 2024-05-08T09:46:43.306 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8753.c' 2024-05-08T09:46:43.306 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8776.h' 2024-05-08T09:46:43.306 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt274.c' 2024-05-08T09:46:43.306 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sta350.h' 2024-05-08T09:46:43.306 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs47l92.c' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/hdmi-codec.c' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs47l90.c' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sti-sas.c' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da7219-aad.h' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/sta32x.c' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt712-sdca-dmic.h' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5677.h' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8955.c' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5660.h' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs35l32.c' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/da7219.h' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lpass-va-macro.c' 2024-05-08T09:46:43.307 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tlv320aic3x.h' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/hda-dai.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4349.h' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tas2781-comlib.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/pcm179x-spi.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/lpass-macro-common.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt298.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8971.h' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/es8326.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4671.h' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/rt5682-i2c.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wsa883x.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8350.h' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs42l52.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm_hubs.c' 2024-05-08T09:46:43.308 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tda7419.c' 2024-05-08T09:46:43.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/bd28623.c' 2024-05-08T09:46:43.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/tpa6130a2.h' 2024-05-08T09:46:43.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/cs4265.h' 2024-05-08T09:46:43.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak4535.c' 2024-05-08T09:46:43.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/max98927.c' 2024-05-08T09:46:43.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau1781-i2c.c' 2024-05-08T09:46:43.309 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/adau7118.h' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/ak5558.c' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/codecs/wm8998.h' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/codecs' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mxs/Kconfig' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mxs/mxs-pcm.h' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mxs/Makefile' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mxs/mxs-saif.c' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mxs/mxs-saif.h' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mxs/mxs-pcm.c' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/mxs/mxs-sgtl5000.c' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/mxs' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-component.c' 2024-05-08T09:46:43.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-acpi.c' 2024-05-08T09:46:43.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/Kconfig' 2024-05-08T09:46:43.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/siu.h' 2024-05-08T09:46:43.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rz-ssi.c' 2024-05-08T09:46:43.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/migor.c' 2024-05-08T09:46:43.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/Makefile' 2024-05-08T09:46:43.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/siu_dai.c' 2024-05-08T09:46:43.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/sh7760-ac97.c' 2024-05-08T09:46:43.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/dma-sh7760.c' 2024-05-08T09:46:44.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/ctu.c' 2024-05-08T09:46:44.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/debugfs.c' 2024-05-08T09:46:44.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/rsnd.h' 2024-05-08T09:46:44.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/cmd.c' 2024-05-08T09:46:44.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/src.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/adg.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/dvc.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/Makefile' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/mix.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/dma.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/ssiu.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/gen.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/ssi.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/rcar/core.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sh/rcar' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/fsi.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/hac.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/ssi.c' 2024-05-08T09:46:44.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sh/siu_pcm.c' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sh' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/stm/Kconfig' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/stm/stm32_adfsdm.c' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/stm/stm32_sai_sub.c' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/stm/stm32_spdifrx.c' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/stm/stm32_sai.c' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/stm/Makefile' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/stm/stm32_i2s.c' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/stm/stm32_sai.h' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/stm' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-devres.c' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/.modules.order.cmd' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/Kconfig' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/aio-pxs2.c' 2024-05-08T09:46:44.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/aio-ld11.c' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/aio-cpu.c' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/aio-compress.c' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/aio.h' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/Makefile' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/evea.c' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/aio-core.c' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/aio-dma.c' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/uniphier/aio-reg.h' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/uniphier' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-card.c' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/xtensa/Kconfig' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/xtensa/xtfpga-i2s.c' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/xtensa/Makefile' 2024-05-08T09:46:44.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/xtensa' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/Kconfig' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/osk5912.c' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-mcbsp-priv.h' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/rx51.c' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-mcpdm.c' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-dmic.h' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/edma-pcm.h' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/edma-pcm.c' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-hdmi.c' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/davinci-mcasp.c' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/sdma-pcm.c' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/Makefile' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-mcpdm.h' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/davinci-mcasp.h' 2024-05-08T09:46:44.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-mcbsp.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-mcbsp.h' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-mcbsp-st.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/ams-delta.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-abe-twl6040.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-dmic.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap-twl4030.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/omap3pandora.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/udma-pcm.h' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/j721e-evm.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/davinci-evm.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/davinci-i2s.h' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/davinci-i2s.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/n810.c' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/sdma-pcm.h' 2024-05-08T09:46:44.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/ti/udma-pcm.c' 2024-05-08T09:46:44.100 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/ti' 2024-05-08T09:46:44.100 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/Kconfig' 2024-05-08T09:46:44.100 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_i2s.c' 2024-05-08T09:46:44.100 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_spdif.c' 2024-05-08T09:46:44.100 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_i2s_tdm.h' 2024-05-08T09:46:44.872 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rk3399_gru_sound.c' 2024-05-08T09:46:44.872 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_i2s_tdm.c' 2024-05-08T09:46:44.872 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_pdm.h' 2024-05-08T09:46:44.872 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_spdif.h' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_max98090.c' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/Makefile' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_pdm.c' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rk3288_hdmi_analog.c' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_i2s.h' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/rockchip/rockchip_rt5645.c' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/rockchip' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/Makefile' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-core.c' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sti/Kconfig' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sti/Makefile' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sti/sti_uniperif.c' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sti/uniperif_reader.c' 2024-05-08T09:46:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sti/uniperif.h' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sti/uniperif_player.c' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sti' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-pcm.c' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/bcm/Kconfig' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/bcm/bcm63xx-pcm-whistler.c' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/bcm/bcm63xx-i2s.h' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/bcm/cygnus-pcm.c' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/bcm/Makefile' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/bcm/bcm2835-i2s.c' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/bcm/cygnus-ssp.c' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/bcm/cygnus-ssp.h' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/bcm/bcm63xx-i2s-whistler.c' 2024-05-08T09:46:44.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/bcm' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/Kconfig' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/ac97c.c' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/db1200.c' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/psc-i2s.c' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/db1000.c' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/dbdma2.c' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/i2sc.c' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/Makefile' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/psc.h' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/dma.c' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/au1x/psc-ac97.c' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/au1x' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/built-in.a' 2024-05-08T09:46:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/apple/Kconfig' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/apple/Makefile' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/apple/mca.c' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/apple' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/kirkwood/Kconfig' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/kirkwood/kirkwood.h' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/kirkwood/kirkwood-dma.c' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/kirkwood/Makefile' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/kirkwood/kirkwood-i2s.c' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/kirkwood/armada-370-db.c' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/kirkwood' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_admaif.c' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/Kconfig' 2024-05-08T09:46:44.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_peq.c' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_mvc.h' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_admaif.h' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra_audio_graph_card.c' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_amx.c' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra20_ac97.c' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra20_i2s.c' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra30_ahub.c' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra20_das.c' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_adx.h' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_ope.h' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_i2s.c' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_sfc.h' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_dmic.c' 2024-05-08T09:46:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra186_asrc.c' 2024-05-08T09:46:44.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra20_i2s.h' 2024-05-08T09:46:44.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra30_i2s.c' 2024-05-08T09:46:44.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_mvc.c' 2024-05-08T09:46:44.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_amx.h' 2024-05-08T09:46:44.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_adx.c' 2024-05-08T09:46:44.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_mbdrc.h' 2024-05-08T09:46:44.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_peq.h' 2024-05-08T09:46:44.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra_cif.h' 2024-05-08T09:46:44.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:44 smithi070 ceph-mon[29591]: pgmap v5749: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 185 op/s 2024-05-08T09:46:44.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:44 smithi172 ceph-mon[33377]: pgmap v5749: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 185 op/s 2024-05-08T09:46:45.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:44 smithi194 ceph-mon[33679]: pgmap v5749: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.9 MiB/s wr, 185 op/s 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_ahub.h' 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_mbdrc.c' 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/Makefile' 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra_asoc_machine.c' 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_mixer.c' 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_dmic.h' 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra186_asrc.h' 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra_pcm.h' 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra30_i2s.h' 2024-05-08T09:46:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_ahub.c' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra20_spdif.c' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra_asoc_machine.h' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra186_dspk.c' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra_wm8903.c' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_sfc.c' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_mixer.h' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra30_ahub.h' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_i2s.h' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra_pcm.c' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra20_ac97.h' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra210_ope.c' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra186_dspk.h' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/tegra/tegra20_spdif.h' 2024-05-08T09:46:45.506 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/tegra' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-compress.c' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/Kconfig' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/sun8i-codec-analog.c' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/sun8i-adda-pr-regmap.h' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/sun4i-spdif.c' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/sun8i-codec.c' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/sun8i-adda-pr-regmap.c' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/Makefile' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/sun4i-i2s.c' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/sun4i-codec.c' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/sun50i-codec-analog.c' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sunxi/sun50i-dmic.c' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sunxi' 2024-05-08T09:46:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/dwc/Kconfig' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/dwc/dwc-i2s.c' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/dwc/dwc-pcm.c' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/dwc/Makefile' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/dwc/local.h' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/dwc' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-generic-dmaengine-pcm.c' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/spear/Kconfig' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/spear/spdif_in.c' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/spear/spdif_out_regs.h' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/spear/spdif_in_regs.h' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/spear/Makefile' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/spear/spdif_out.c' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/spear/spear_pcm.h' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/spear/spear_pcm.c' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/spear' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-jack.c' 2024-05-08T09:46:45.508 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-topology.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/Kconfig' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/path.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/debugfs.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/Kconfig' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/i2s_test.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/probe.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/ssm4567.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/rt286.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/dmic.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/Makefile' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/max98373.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/max98357a.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/da7219.c' 2024-05-08T09:46:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/nau8825.c' 2024-05-08T09:46:45.510 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/hdaudio.c' 2024-05-08T09:46:45.510 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/rt5682.c' 2024-05-08T09:46:45.510 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/rt274.c' 2024-05-08T09:46:45.510 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/rt298.c' 2024-05-08T09:46:45.510 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/boards/max98927.c' 2024-05-08T09:46:45.510 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel/avs/boards' 2024-05-08T09:46:46.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/trace.h' 2024-05-08T09:46:46.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/board_selection.c' 2024-05-08T09:46:46.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/trace.c' 2024-05-08T09:46:46.072 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/registers.h' 2024-05-08T09:46:46.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/pcm.c' 2024-05-08T09:46:46.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/control.c' 2024-05-08T09:46:46.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/control.h' 2024-05-08T09:46:46.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/apl.c' 2024-05-08T09:46:46.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/dsp.c' 2024-05-08T09:46:46.073 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/Makefile' 2024-05-08T09:46:46.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/avs.h' 2024-05-08T09:46:46.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/topology.c' 2024-05-08T09:46:46.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/skl.c' 2024-05-08T09:46:46.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/utils.c' 2024-05-08T09:46:46.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/messages.h' 2024-05-08T09:46:46.074 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/cldma.c' 2024-05-08T09:46:46.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/loader.c' 2024-05-08T09:46:46.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/path.h' 2024-05-08T09:46:46.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/probes.c' 2024-05-08T09:46:46.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/messages.c' 2024-05-08T09:46:46.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/core.c' 2024-05-08T09:46:46.075 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/cldma.h' 2024-05-08T09:46:46.076 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/topology.h' 2024-05-08T09:46:46.076 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/avs/ipc.c' 2024-05-08T09:46:46.076 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel/avs' 2024-05-08T09:46:46.076 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/skl_nau88l25_max98357a.c' 2024-05-08T09:46:46.076 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_pcm512x.c' 2024-05-08T09:46:46.076 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/Kconfig' 2024-05-08T09:46:46.076 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/cml_rt1011_rt5682.c' 2024-05-08T09:46:46.077 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_wm8804.c' 2024-05-08T09:46:46.077 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_maxim_common.c' 2024-05-08T09:46:46.077 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bytcht_da7213.c' 2024-05-08T09:46:46.077 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_dmic.c' 2024-05-08T09:46:46.077 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_rt700.c' 2024-05-08T09:46:46.077 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_ssp_amp.c' 2024-05-08T09:46:46.078 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/skl_hda_dsp_common.c' 2024-05-08T09:46:46.078 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_realtek_common.h' 2024-05-08T09:46:46.078 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_rt712_sdca.c' 2024-05-08T09:46:46.078 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_cs42l42.c' 2024-05-08T09:46:46.078 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/hda_dsp_common.h' 2024-05-08T09:46:46.078 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bdw_rt286.c' 2024-05-08T09:46:46.078 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/kbl_rt5663_max98927.c' 2024-05-08T09:46:46.079 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_rt711.c' 2024-05-08T09:46:46.079 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_cirrus_common.h' 2024-05-08T09:46:46.079 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw.c' 2024-05-08T09:46:46.079 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/cht_bsw_nau8824.c' 2024-05-08T09:46:46.079 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/skl_rt286.c' 2024-05-08T09:46:46.079 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_maxim_common.h' 2024-05-08T09:46:46.080 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_rt5682.c' 2024-05-08T09:46:46.080 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/kbl_da7219_max98357a.c' 2024-05-08T09:46:46.080 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_cirrus_common.c' 2024-05-08T09:46:46.080 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/cht_bsw_rt5672.c' 2024-05-08T09:46:46.080 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bytcht_nocodec.c' 2024-05-08T09:46:46.081 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_rt5682.c' 2024-05-08T09:46:46.081 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bytcht_cx2072x.c' 2024-05-08T09:46:46.081 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bxt_rt298.c' 2024-05-08T09:46:46.081 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_rt_amp.c' 2024-05-08T09:46:46.081 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/cht_bsw_max98090_ti.c' 2024-05-08T09:46:46.081 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_nau8825.c' 2024-05-08T09:46:46.081 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/Makefile' 2024-05-08T09:46:46.082 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_rt_sdca_jack_common.c' 2024-05-08T09:46:46.082 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_realtek_common.c' 2024-05-08T09:46:46.082 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/ehl_rt5660.c' 2024-05-08T09:46:46.082 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_amp_coeff_tables.h' 2024-05-08T09:46:46.082 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_maxim.c' 2024-05-08T09:46:46.082 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_hdmi.c' 2024-05-08T09:46:46.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_rt715_sdca.c' 2024-05-08T09:46:46.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/hda_dsp_common.c' 2024-05-08T09:46:46.083 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_common.h' 2024-05-08T09:46:46.705 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/skl_hda_dsp_generic.c' 2024-05-08T09:46:46.705 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bytcht_es8316.c' 2024-05-08T09:46:46.705 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/kbl_rt5660.c' 2024-05-08T09:46:46.705 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bdw-rt5677.c' 2024-05-08T09:46:46.705 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bytcr_rt5651.c' 2024-05-08T09:46:46.705 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_es8336.c' 2024-05-08T09:46:46.705 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bdw-rt5650.c' 2024-05-08T09:46:46.705 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/skl_hda_dsp_common.h' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/cht_bsw_rt5645.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_da7219_max98373.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bytcr_rt5640.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/kbl_rt5663_rt5514_max98927.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/kbl_da7219_max98927.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/skl_nau88l25_ssm4567.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_cs42l42.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/hsw_rt5640.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bytcr_wm5102.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/glk_rt5682_max98357a.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/sof_sdw_rt715.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/boards/bxt_da7219_max98357a.c' 2024-05-08T09:46:46.706 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel/boards' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/cnl-sst.c' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-nhlt.c' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-i2s.h' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-topology.h' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-sst-dsp.c' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-ssp-clk.h' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-sst-cldma.c' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-sst-dsp.h' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-topology.c' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-sst.c' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-sst-cldma.h' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/Makefile' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/bxt-sst.c' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/cnl-sst-dsp.c' 2024-05-08T09:46:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl.c' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-sst-ipc.h' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-ssp-clk.c' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/cnl-sst-dsp.h' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-sst-ipc.c' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-debug.c' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-messages.c' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl.h' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-sst-utils.c' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/skylake/skl-pcm.c' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel/skylake' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/Makefile' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst-mfld-platform.h' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/Makefile' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst-mfld-dsp.h' 2024-05-08T09:46:46.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst-mfld-platform-pcm.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst-mfld-platform-compress.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst-atom-controls.h' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/sst.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/sst_pvt.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/sst.h' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/Makefile' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/sst_stream.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/sst_acpi.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/sst_pci.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/sst_ipc.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/sst_loader.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst/sst_drv_interface.c' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel/atom/sst' 2024-05-08T09:46:46.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/atom/sst-atom-controls.c' 2024-05-08T09:46:46.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel/atom' 2024-05-08T09:46:46.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/keembay/kmb_platform.h' 2024-05-08T09:46:46.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/keembay/Makefile' 2024-05-08T09:46:46.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:46 smithi070 ceph-mon[29591]: pgmap v5750: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 286 op/s 2024-05-08T09:46:46.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:46 smithi172 ceph-mon[33377]: pgmap v5750: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 286 op/s 2024-05-08T09:46:47.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:46 smithi194 ceph-mon[33679]: pgmap v5750: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.8 MiB/s wr, 286 op/s 2024-05-08T09:46:47.347 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/keembay/kmb_platform.c' 2024-05-08T09:46:47.348 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel/keembay' 2024-05-08T09:46:47.348 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/sysfs.c' 2024-05-08T09:46:47.348 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/trace.h' 2024-05-08T09:46:47.348 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/device.c' 2024-05-08T09:46:47.348 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/registers.h' 2024-05-08T09:46:47.348 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/pcm.c' 2024-05-08T09:46:47.348 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/dsp.c' 2024-05-08T09:46:47.349 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/Makefile' 2024-05-08T09:46:47.349 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/messages.h' 2024-05-08T09:46:47.349 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/loader.c' 2024-05-08T09:46:47.349 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/messages.c' 2024-05-08T09:46:47.349 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/core.h' 2024-05-08T09:46:47.349 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/catpt/ipc.c' 2024-05-08T09:46:47.349 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel/catpt' 2024-05-08T09:46:47.349 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-jsl-match.c' 2024-05-08T09:46:47.350 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-cnl-match.c' 2024-05-08T09:46:47.350 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/sst-dsp.c' 2024-05-08T09:46:47.350 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-hda-match.c' 2024-05-08T09:46:47.350 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-ehl-match.c' 2024-05-08T09:46:47.350 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/sst-dsp.h' 2024-05-08T09:46:47.350 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-tgl-match.c' 2024-05-08T09:46:47.350 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-sdw-mockup-match.h' 2024-05-08T09:46:47.350 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-icl-match.c' 2024-05-08T09:46:47.351 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/sst-ipc.c' 2024-05-08T09:46:47.351 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-intel-quirks.h' 2024-05-08T09:46:47.351 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-sdw-mockup-match.c' 2024-05-08T09:46:47.351 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-mtl-match.c' 2024-05-08T09:46:47.351 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/Makefile' 2024-05-08T09:46:47.351 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-skl-match.c' 2024-05-08T09:46:47.351 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-rpl-match.c' 2024-05-08T09:46:47.351 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-cht-match.c' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-glk-match.c' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-hsw-bdw-match.c' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/sst-ipc.h' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-adl-match.c' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-cfl-match.c' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-lnl-match.c' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-bxt-match.c' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-kbl-match.c' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/sst-dsp-priv.h' 2024-05-08T09:46:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-cml-match.c' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/intel/common/soc-acpi-intel-byt-match.c' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel/common' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/intel' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8186/mt8186-clk.c' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8186/mt8186.c' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8186/mt8186-loader.c' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8186/mt8186.h' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8186/Makefile' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8186/mt8186-clk.h' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sof/mediatek/mt8186' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/Kconfig' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8195/mt8195-loader.c' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8195/mt8195.c' 2024-05-08T09:46:47.353 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8195/mt8195-clk.h' 2024-05-08T09:46:47.354 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8195/Makefile' 2024-05-08T09:46:47.354 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8195/mt8195.h' 2024-05-08T09:46:47.354 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mt8195/mt8195-clk.c' 2024-05-08T09:46:47.354 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sof/mediatek/mt8195' 2024-05-08T09:46:47.354 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/Makefile' 2024-05-08T09:46:47.354 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mtk-adsp-common.c' 2024-05-08T09:46:47.354 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/mtk-adsp-common.h' 2024-05-08T09:46:47.354 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/mediatek/adsp_helper.h' 2024-05-08T09:46:48.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sof/mediatek' 2024-05-08T09:46:48.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/Kconfig' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/pm.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc4-topology.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-client-probes-ipc3.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc3.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ops.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/iomem-utils.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc3-loader.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc3-dtrace.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/compress.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-client-probes.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc3-priv.h' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-client-ipc-msg-injector.c' 2024-05-08T09:46:48.132 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc3-control.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/Kconfig' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/pci-rn.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/acp.h' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/acp-loader.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/pci-rmb.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/rembrandt.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/Makefile' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/acp-ipc.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/acp-pcm.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/acp-dsp-offset.h' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/renoir.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/acp-trace.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/acp-common.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/acp.c' 2024-05-08T09:46:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/amd/acp-stream.c' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sof/amd' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-acpi-dev.h' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc4-topology.h' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc3-pcm.c' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/nocodec.c' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-client-probes.h' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/trace.c' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc4-priv.h' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-client.h' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc3-topology.c' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/pcm.c' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/control.c' 2024-05-08T09:46:48.134 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-audio.h' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc4-loader.c' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-priv.h' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-utils.h' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/xtensa/Kconfig' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/xtensa/Makefile' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/xtensa/core.c' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sof/xtensa' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-pci-dev.h' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/Makefile' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/topology.c' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-acpi-dev.c' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-client-ipc-kernel-injector.c' 2024-05-08T09:46:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-client.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc4-control.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/stream-ipc.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-of-dev.h' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/debug.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc4-pcm.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-client-probes-ipc4.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/loader.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-pci-dev.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/Kconfig' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/icl.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/shim.h' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/ext_manifest.h' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/mtl.h' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-bus.c' 2024-05-08T09:46:48.136 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-loader-skl.c' 2024-05-08T09:46:48.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-dai-ops.c' 2024-05-08T09:46:48.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/bdw.c' 2024-05-08T09:46:48.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/pci-tgl.c' 2024-05-08T09:46:48.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/pci-apl.c' 2024-05-08T09:46:48.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-pcm.c' 2024-05-08T09:46:48.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-mlink.c' 2024-05-08T09:46:48.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-probes.c' 2024-05-08T09:46:48.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/apl.c' 2024-05-08T09:46:48.137 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/pci-icl.c' 2024-05-08T09:46:48.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:48 smithi070 ceph-mon[29591]: pgmap v5751: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 189 op/s 2024-05-08T09:46:48.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:48 smithi172 ceph-mon[33377]: pgmap v5751: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 189 op/s 2024-05-08T09:46:49.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:48 smithi194 ceph-mon[33679]: pgmap v5751: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 189 op/s 2024-05-08T09:46:49.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/atom.c' 2024-05-08T09:46:49.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/Makefile' 2024-05-08T09:46:49.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-trace.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/cnl.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda.h' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-stream.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/skl.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/tgl.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/atom.h' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-dsp.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-ipc.h' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-ctrl.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-ipc.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-loader.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/mtl.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/pci-cnl.c' 2024-05-08T09:46:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/byt.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-codec.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/pci-skl.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/pci-tng.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-common-ops.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/pci-mtl.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/intel/hda-dai.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sof/intel' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-utils.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc4-fw-reg.h' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc4.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/imx/Kconfig' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/imx/imx8ulp.c' 2024-05-08T09:46:49.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/imx/imx-common.c' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/imx/Makefile' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/imx/imx8.c' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/imx/imx-common.h' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/imx/imx8m.c' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sof/imx' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ops.h' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/core.c' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-of-dev.c' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-client-ipc-flood-test.c' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc4-mtrace.c' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/sof-audio.c' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sof/ipc.c' 2024-05-08T09:46:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sof' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sprd/Kconfig' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sprd/Makefile' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sprd/sprd-mcdt.h' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sprd/sprd-pcm-dma.c' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sprd/sprd-mcdt.c' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sprd/sprd-pcm-compress.c' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/sprd/sprd-pcm-dma.h' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/sprd' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-dapm.c' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/cirrus/Kconfig' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/cirrus/ep93xx-pcm.h' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/cirrus/Makefile' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/cirrus/edb93xx.c' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/cirrus/ep93xx-pcm.c' 2024-05-08T09:46:49.031 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/cirrus/ep93xx-i2s.c' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/cirrus' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/.built-in.a.cmd' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/Kconfig' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/arndale.c' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/littlemill.c' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/idma.h' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/smdk_wm8994.c' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/smdk_wm8994pcm.c' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/pcm.h' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/snow.c' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/pcm.c' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/dma.h' 2024-05-08T09:46:49.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/lowland.c' 2024-05-08T09:46:49.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/tobermory.c' 2024-05-08T09:46:49.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/Makefile' 2024-05-08T09:46:49.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/midas_wm1811.c' 2024-05-08T09:46:49.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/odroid.c' 2024-05-08T09:46:49.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/spdif.h' 2024-05-08T09:46:49.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/tm2_wm5110.c' 2024-05-08T09:46:49.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/i2s-regs.h' 2024-05-08T09:46:49.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/dmaengine.c' 2024-05-08T09:46:49.886 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/aries_wm8994.c' 2024-05-08T09:46:49.886 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/i2s.c' 2024-05-08T09:46:49.886 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/smdk_spdif.c' 2024-05-08T09:46:49.886 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/bells.c' 2024-05-08T09:46:49.886 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/idma.c' 2024-05-08T09:46:49.886 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/speyside.c' 2024-05-08T09:46:49.886 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/spdif.c' 2024-05-08T09:46:49.886 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/samsung/i2s.h' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/samsung' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-ac97.c' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/hisilicon/Kconfig' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/hisilicon/hi6210-i2s.c' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/hisilicon/Makefile' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/hisilicon/hi6210-i2s.h' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/hisilicon' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/google/Kconfig' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/google/Makefile' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/google/chv3-i2s.c' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/google' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/starfive/Kconfig' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/starfive/Makefile' 2024-05-08T09:46:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/starfive/jh7110_tdm.c' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/starfive' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-utils.c' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-link.c' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/Kconfig' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel-pcm-dma.c' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/mchp-i2s-mcc.c' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel-classd.h' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel-pcm.h' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/tse850-pcm5142.c' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel-pcm-pdc.c' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/mchp-spdiftx.c' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/mchp-spdifrx.c' 2024-05-08T09:46:49.888 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel-pdmic.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/sam9x5_wm8731.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel_wm8904.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel_ssc_dai.h' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/Makefile' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel-pdmic.h' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/mchp-pdmc.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel_ssc_dai.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/mikroe-proto.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel-i2s.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/sam9g20_wm8731.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/atmel/atmel-classd.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc/atmel' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/soc/soc-utils-test.c' 2024-05-08T09:46:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/soc' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/.last.o.cmd' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/Makefile' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/Kconfig' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/mtpav.c' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/serial-u16550.c' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/modules.order' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/portman2x4.c' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/.modules.order.cmd' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/opl4_proc.c' 2024-05-08T09:46:49.890 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/modules.order' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/yrw801.c' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/opl4_seq.c' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/.modules.order.cmd' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/opl4_mixer.c' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/Makefile' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/built-in.a' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/opl4_local.h' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/opl4_lib.c' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/opl4_synth.c' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl4/.built-in.a.cmd' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/drivers/opl4' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/Makefile' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/serial-generic.c' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/pcsp_lib.c' 2024-05-08T09:46:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/pcsp_input.c' 2024-05-08T09:46:49.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/modules.order' 2024-05-08T09:46:49.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/pcsp_mixer.c' 2024-05-08T09:46:49.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/.modules.order.cmd' 2024-05-08T09:46:49.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/Makefile' 2024-05-08T09:46:49.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/built-in.a' 2024-05-08T09:46:50.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:50 smithi070 ceph-mon[29591]: pgmap v5752: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 309 op/s 2024-05-08T09:46:50.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:50 smithi172 ceph-mon[33377]: pgmap v5752: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 309 op/s 2024-05-08T09:46:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:50 smithi194 ceph-mon[33679]: pgmap v5752: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 5.0 MiB/s wr, 309 op/s 2024-05-08T09:46:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/.built-in.a.cmd' 2024-05-08T09:46:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/pcsp.c' 2024-05-08T09:46:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/pcsp_input.h' 2024-05-08T09:46:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcsp/pcsp.h' 2024-05-08T09:46:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/drivers/pcsp' 2024-05-08T09:46:51.044 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/virmidi.c' 2024-05-08T09:46:51.045 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/built-in.a' 2024-05-08T09:46:51.045 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/modules.order' 2024-05-08T09:46:51.045 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/.modules.order.cmd' 2024-05-08T09:46:51.045 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/Makefile' 2024-05-08T09:46:51.045 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/vx_core.c' 2024-05-08T09:46:51.045 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/vx_cmd.c' 2024-05-08T09:46:51.045 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/built-in.a' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/vx_hwdep.c' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/vx_pcm.c' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/vx_cmd.h' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/.built-in.a.cmd' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/vx_mixer.c' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/vx/vx_uer.c' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/drivers/vx' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/aloop.c' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/mts64.c' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/pcmtest.c' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/.built-in.a.cmd' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/dummy.c' 2024-05-08T09:46:51.046 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/modules.order' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/opl3_oss.c' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/opl3_synth.c' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/opl3_lib.c' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/.modules.order.cmd' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/Makefile' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/opl3_drums.c' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/built-in.a' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/opl3_seq.c' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/opl3_midi.c' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/opl3_voice.h' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/opl3/.built-in.a.cmd' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/drivers/opl3' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/mpu401/modules.order' 2024-05-08T09:46:51.047 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/mpu401/.modules.order.cmd' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/mpu401/Makefile' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/mpu401/mpu401.c' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/mpu401/built-in.a' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/mpu401/mpu401_uart.c' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/drivers/mpu401/.built-in.a.cmd' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/drivers/mpu401' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/drivers' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/last.c' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/built-in.a' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/Kconfig' 2024-05-08T09:46:51.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sc6000.c' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sscape.c' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/galaxy/modules.order' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/galaxy/galaxy.c' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/galaxy/azt1605.c' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/galaxy/.modules.order.cmd' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/galaxy/Makefile' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/galaxy/built-in.a' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/galaxy/.built-in.a.cmd' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/galaxy/azt2316.c' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/galaxy' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/modules.order' 2024-05-08T09:46:51.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/es1688/modules.order' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/es1688/es1688_lib.c' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/es1688/.modules.order.cmd' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/es1688/es1688.c' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/es1688/Makefile' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/es1688/built-in.a' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/es1688/.built-in.a.cmd' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/es1688' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wavefront/wavefront.c' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wavefront/wavefront_midi.c' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wavefront/wavefront_synth.c' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wavefront/modules.order' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wavefront/.modules.order.cmd' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wavefront/Makefile' 2024-05-08T09:46:51.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wavefront/built-in.a' 2024-05-08T09:46:51.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wavefront/wavefront_fx.c' 2024-05-08T09:46:51.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wavefront/.built-in.a.cmd' 2024-05-08T09:46:51.802 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/wavefront' 2024-05-08T09:46:51.802 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/als100.c' 2024-05-08T09:46:51.802 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1816a/ad1816a_lib.c' 2024-05-08T09:46:51.802 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1816a/modules.order' 2024-05-08T09:46:51.802 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1816a/ad1816a.c' 2024-05-08T09:46:51.802 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1816a/.modules.order.cmd' 2024-05-08T09:46:51.802 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1816a/Makefile' 2024-05-08T09:46:51.802 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1816a/built-in.a' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1816a/.built-in.a.cmd' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/ad1816a' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cs423x/cs4236.c' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cs423x/modules.order' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cs423x/cs4236_lib.c' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cs423x/.modules.order.cmd' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cs423x/Makefile' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cs423x/cs4231.c' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cs423x/built-in.a' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cs423x/.built-in.a.cmd' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/cs423x' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/.modules.order.cmd' 2024-05-08T09:46:51.803 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/es18xx.c' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/modules.order' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/msnd_midi.c' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/msnd.c' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/msnd.h' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/msnd_pinnacle.c' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/msnd_pinnacle_mixer.c' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/.modules.order.cmd' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/Makefile' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/msnd_classic.h' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/built-in.a' 2024-05-08T09:46:51.804 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/msnd_pinnacle.h' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/.built-in.a.cmd' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/msnd/msnd_classic.c' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/msnd' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/Makefile' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/built-in.a' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_pcm.c' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gusextreme.c' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/modules.order' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_uart.c' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/interwave-stb.c' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_mixer.c' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_reset.c' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/.modules.order.cmd' 2024-05-08T09:46:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_irq.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_mem.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/Makefile' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_volume.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_io.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gusmax.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gusclassic.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/built-in.a' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_timer.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_main.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_mem_proc.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_dram.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/interwave.c' 2024-05-08T09:46:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_tables.h' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/.built-in.a.cmd' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/gus/gus_dma.c' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/gus' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wss/modules.order' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wss/wss_lib.c' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wss/.modules.order.cmd' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wss/Makefile' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wss/built-in.a' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/wss/.built-in.a.cmd' 2024-05-08T09:46:51.807 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/wss' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/adlib.c' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opti9xx/opti92x-cs4231.c' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opti9xx/modules.order' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opti9xx/.modules.order.cmd' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opti9xx/Makefile' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opti9xx/built-in.a' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opti9xx/opti92x-ad1848.c' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opti9xx/.built-in.a.cmd' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opti9xx/opti93x.c' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opti9xx/miro.c' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/opti9xx' 2024-05-08T09:46:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/azt2320.c' 2024-05-08T09:46:52.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:52 smithi070 ceph-mon[29591]: pgmap v5753: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 221 op/s 2024-05-08T09:46:52.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:52 smithi172 ceph-mon[33377]: pgmap v5753: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 221 op/s 2024-05-08T09:46:52.987 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/opl3sa2.c' 2024-05-08T09:46:52.987 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/.built-in.a.cmd' 2024-05-08T09:46:52.987 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cmi8328.c' 2024-05-08T09:46:52.987 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1848/ad1848.c' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1848/modules.order' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1848/.modules.order.cmd' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1848/Makefile' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1848/built-in.a' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/ad1848/.built-in.a.cmd' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/ad1848' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/emu8000_callback.c' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/jazz16.c' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/modules.order' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/sb8.c' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/sb16_main.c' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/emu8000_local.h' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/sbawe.c' 2024-05-08T09:46:52.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/emu8000_pcm.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/emu8000_synth.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/sb_mixer.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/.modules.order.cmd' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/Makefile' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/sb8_main.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/emu8000.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/sb8_midi.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/built-in.a' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/sb16_csp.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/.built-in.a.cmd' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/emu8000_patch.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/sb16.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/sb/sb_common.c' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa/sb' 2024-05-08T09:46:52.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/isa/cmi8330.c' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/isa' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sound_core.o' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/Kconfig' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/Kconfig' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/sysfs.c' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/Makefile' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/soundbus.h' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/i2sbus/pcm.c' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/i2sbus/control.c' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/i2sbus/Makefile' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/i2sbus/i2sbus.h' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/i2sbus/core.c' 2024-05-08T09:46:52.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/i2sbus/interface.h' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/aoa/soundbus/i2sbus' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/soundbus/core.c' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/aoa/soundbus' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/codecs/Kconfig' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/codecs/toonie.c' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/codecs/tas.h' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/codecs/onyx.c' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/codecs/tas.c' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/codecs/tas-gain-table.h' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/codecs/Makefile' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/codecs/tas-basstreble.h' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/codecs/onyx.h' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/aoa/codecs' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/aoa-gpio.h' 2024-05-08T09:46:52.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/Makefile' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/fabrics/Kconfig' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/fabrics/layout.c' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/fabrics/Makefile' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/aoa/fabrics' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/aoa.h' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/core/alsa.c' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/core/gpio-feature.c' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/core/Makefile' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/core/gpio-pmf.c' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/core/alsa.h' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/aoa/core/core.c' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/aoa/core' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/aoa' 2024-05-08T09:46:52.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/parisc/Kconfig' 2024-05-08T09:46:52.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/parisc/modules.order' 2024-05-08T09:46:52.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/parisc/harmony.h' 2024-05-08T09:46:52.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/parisc/.modules.order.cmd' 2024-05-08T09:46:52.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/parisc/Makefile' 2024-05-08T09:46:52.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/parisc/built-in.a' 2024-05-08T09:46:52.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/parisc/.built-in.a.cmd' 2024-05-08T09:46:52.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/parisc/harmony.c' 2024-05-08T09:46:52.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/parisc' 2024-05-08T09:46:53.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:52 smithi194 ceph-mon[33679]: pgmap v5753: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 221 op/s 2024-05-08T09:46:53.865 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/xen_snd_front_evtchnl.h' 2024-05-08T09:46:53.865 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/Kconfig' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/xen_snd_front_alsa.c' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/modules.order' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/xen_snd_front_cfg.c' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/xen_snd_front_cfg.h' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/.modules.order.cmd' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/Makefile' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/xen_snd_front.c' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/built-in.a' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/xen_snd_front_alsa.h' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/.built-in.a.cmd' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/xen_snd_front_evtchnl.c' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/xen/xen_snd_front.h' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/xen' 2024-05-08T09:46:53.866 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sparc/Kconfig' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sparc/modules.order' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sparc/amd7930.c' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sparc/.modules.order.cmd' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sparc/Makefile' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sparc/cs4231.c' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sparc/built-in.a' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sparc/dbri.c' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/sparc/.built-in.a.cmd' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/sparc' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/oss/dmasound/Kconfig' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/oss/dmasound/dmasound_paula.c' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/oss/dmasound/Makefile' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/oss/dmasound/dmasound.h' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/oss/dmasound/dmasound_core.c' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/oss/dmasound/dmasound_q40.c' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/oss/dmasound/dmasound_atari.c' 2024-05-08T09:46:53.867 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/oss/dmasound' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/oss/.gitignore' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/oss' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/modules.order' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/.modules.order.cmd' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/cs8427.c' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/tea6330t.c' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/Makefile' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/built-in.a' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/i2c.c' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/.built-in.a.cmd' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/ak4xxx-adda.c' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/modules.order' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/ak4117.c' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/.modules.order.cmd' 2024-05-08T09:46:53.868 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/ak4114.c' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/Makefile' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/pt2258.c' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/ak4113.c' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/built-in.a' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/i2c/other/.built-in.a.cmd' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/i2c/other' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/i2c' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/.built-in.a.cmd' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/Kconfig' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/amdtp-stream-trace.h' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/iso-resources.c' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/modules.order' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff.h' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff-proc.c' 2024-05-08T09:46:53.869 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff-pcm.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff-protocol-former.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/Makefile' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff-transaction.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff-stream.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff-midi.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/amdtp-ff.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff-protocol-latter.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireface/ff-hwdep.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/firewire/fireface' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/amdtp-am824.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/lib.h' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_pcm.c' 2024-05-08T09:46:53.870 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob.h' 2024-05-08T09:46:53.871 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob.c' 2024-05-08T09:46:53.871 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_stream.c' 2024-05-08T09:46:53.871 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_yamaha_terratec.c' 2024-05-08T09:46:54.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_hwdep.c' 2024-05-08T09:46:54.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_focusrite.c' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/Makefile' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_maudio.c' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_command.c' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_midi.c' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_terratec.c' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/bebob/bebob_proc.c' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/firewire/bebob' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/fireworks_pcm.c' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/fireworks.h' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/fireworks_hwdep.c' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/Makefile' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/fireworks_proc.c' 2024-05-08T09:46:54.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/fireworks_command.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/fireworks_transaction.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/fireworks_stream.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/fireworks.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fireworks/fireworks_midi.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/firewire/fireworks' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/isight.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/cmp.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/tascam-proc.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/tascam.h' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/tascam-stream.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/tascam-transaction.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/Makefile' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/tascam-pcm.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/tascam-midi.c' 2024-05-08T09:46:54.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/tascam.c' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/tascam-hwdep.c' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/tascam/amdtp-tascam.c' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/firewire/tascam' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fcp.h' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/.modules.order.cmd' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/cmp.h' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/packets-buffer.c' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/amdtp-am824.h' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/amdtp-stream.h' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/Makefile' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/digi00x-transaction.c' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/digi00x-hwdep.c' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/digi00x-stream.c' 2024-05-08T09:46:54.576 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/digi00x-midi.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/amdtp-dot.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/Makefile' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/digi00x.h' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/digi00x-proc.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/digi00x.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/digi00x/digi00x-pcm.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/firewire/digi00x' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-proc.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-transaction.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-midi.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-protocol-v3.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/amdtp-motu-trace.h' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-hwdep.c' 2024-05-08T09:46:54.577 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-protocol-v1.c' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu.c' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-stream.c' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/Makefile' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu.h' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-protocol-v2.c' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-command-dsp-message-parser.c' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-register-dsp-message-parser.c' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/amdtp-motu.c' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/motu/motu-pcm.c' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/firewire/motu' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/built-in.a' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/.built-in.a.cmd' 2024-05-08T09:46:54.578 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/fcp.c' 2024-05-08T09:46:54.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:54 smithi070 ceph-mon[29591]: pgmap v5754: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 221 op/s 2024-05-08T09:46:54.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:54 smithi172 ceph-mon[33377]: pgmap v5754: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 221 op/s 2024-05-08T09:46:55.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:54 smithi194 ceph-mon[33679]: pgmap v5754: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 221 op/s 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/iso-resources.h' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/amdtp-stream.c' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/lib.c' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/packets-buffer.h' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-alesis.c' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-hwdep.c' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-harman.c' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-extension.c' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-transaction.c' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice.c' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/Makefile' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-pcm.c' 2024-05-08T09:46:55.236 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-proc.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-interface.h' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-tcelectronic.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-presonus.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-stream.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-midi.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-mytek.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice.h' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/dice/dice-focusrite.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/firewire/dice' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw-proc.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw-command.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw-hwdep.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw.h' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw-pcm.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw-midi.c' 2024-05-08T09:46:55.237 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/Makefile' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw-spkr.c' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw-stream.c' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw-scs1x.c' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/firewire/oxfw/oxfw.c' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/firewire/oxfw' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/firewire' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/control.o' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/Kconfig' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/memalloc_local.h' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_compat.c' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/hrtimer.c' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.hrtimer.o.cmd' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/jack.o' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.seq_device.o.cmd' 2024-05-08T09:46:55.238 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_dmaengine.c' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_misc.o' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/modules.order' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/ctljack.c' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_drm_eld.c' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.pcm_lib.o.cmd' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/misc.o' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/sound.o' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/isadma.c' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/compress_offload.c' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.info.o.cmd' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/timer.o' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/vmaster.c' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/device.c' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/memalloc.c' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.jack.o.cmd' 2024-05-08T09:46:55.239 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/device.o' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.init.o.cmd' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.ctljack.o.cmd' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.timer.o.cmd' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/control_led.c' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_lib.o' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_iec958.c' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/hwdep.o' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/hwdep.c' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.misc.o.cmd' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.pcm_memory.o.cmd' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.pcm_misc.o.cmd' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/memory.c' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm.c' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/control.c' 2024-05-08T09:46:55.240 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_lib.c' 2024-05-08T09:46:55.241 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.modules.order.cmd' 2024-05-08T09:46:55.241 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/control_compat.c' 2024-05-08T09:46:55.241 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/jack.c' 2024-05-08T09:46:55.241 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm.o' 2024-05-08T09:46:55.241 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/memalloc.o' 2024-05-08T09:46:55.241 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_memory.o' 2024-05-08T09:46:55.241 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/Makefile' 2024-05-08T09:46:55.241 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/hwdep_compat.c' 2024-05-08T09:46:55.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:55 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:46:55.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:55 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/info_oss.c' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.memalloc.o.cmd' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/info.o' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_timer.c' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_native.c' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_memory.c' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq_device.c' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/built-in.a' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.device.o.cmd' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.hwdep.o.cmd' 2024-05-08T09:46:55.940 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/ump.c' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/info.c' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/sound.c' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/rawmidi.c' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.vmaster.o.cmd' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/hrtimer.o' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/isadma.o' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.control.o.cmd' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/init.c' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.pcm_native.o.cmd' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/memory.o' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.isadma.o.cmd' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_misc.c' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.pcm.o.cmd' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.memory.o.cmd' 2024-05-08T09:46:55.941 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/pcm_plugin.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/pcm_oss.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/pcm_plugin.h' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/copy.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/route.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/Makefile' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/io.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/linear.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/rate.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/mixer_oss.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/oss/mulaw.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/core/oss' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/vmaster.o' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/timer_compat.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/sound_oss.c' 2024-05-08T09:46:55.942 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq_device.o' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/rawmidi_compat.c' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.built-in.a.cmd' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/Kconfig' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_lock.o.cmd' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_memory.o.cmd' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_memory.o' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_info.h' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_prioq.o' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_virmidi.c' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_queue.h' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/modules.order' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_midi.c' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_prioq.c' 2024-05-08T09:46:55.943 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_queue.o.cmd' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_fifo.h' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_clientmgr.c' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_clientmgr.o' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq.o.cmd' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_queue.o' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_ump_convert.c' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_system.h' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_ports.o' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_system.o.cmd' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_info.o' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_info.c' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_fifo.o' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.modules.order.cmd' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_info.o.cmd' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_dummy.o' 2024-05-08T09:46:55.944 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_timer.c' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_prioq.o.cmd' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_lock.h' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_ports.o.cmd' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/Makefile' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_system.o' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_ump_convert.h' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_ump_client.c' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq.o' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_midi_event.c' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_memory.c' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_fifo.o.cmd' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_lock.o' 2024-05-08T09:46:55.945 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_timer.o' 2024-05-08T09:46:56.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:55 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:46:56.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:56 smithi070 ceph-mon[29591]: pgmap v5755: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.0 MiB/s wr, 316 op/s 2024-05-08T09:46:56.912 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:56 smithi194 ceph-mon[33679]: pgmap v5755: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.0 MiB/s wr, 316 op/s 2024-05-08T09:46:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:56 smithi172 ceph-mon[33377]: pgmap v5755: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 5.0 MiB/s wr, 316 op/s 2024-05-08T09:46:57.499 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_memory.h' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/built-in.a' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_dummy.o.cmd' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_midi_emul.c' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_queue.c' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_system.c' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_clientmgr.h' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_fifo.c' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_timer.h' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_dummy.c' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq.c' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_init.c' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_midi.c' 2024-05-08T09:46:57.500 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_synth.h' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_readq.c' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/Makefile' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_synth.c' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_event.c' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_rw.c' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_writeq.h' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss.c' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_timer.c' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_event.h' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_ioctl.c' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_readq.h' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_writeq.c' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_device.h' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_midi.h' 2024-05-08T09:46:57.501 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/oss/seq_oss_timer.h' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/core/seq/oss' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_lock.c' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.built-in.a.cmd' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_prioq.h' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_clientmgr.o.cmd' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_ports.c' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/.seq_timer.o.cmd' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_ports.h' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/seq/seq_compat.c' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/core/seq' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/ctljack.o' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/ump_convert.c' 2024-05-08T09:46:57.502 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.pcm_timer.o.cmd' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/init.o' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/misc.c' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_param_trace.h' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/timer.c' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_native.o' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_local.h' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_trace.h' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/.sound.o.cmd' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/core/pcm_timer.o' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/core' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/atmel/Kconfig' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/atmel/modules.order' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/atmel/ac97c.c' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/atmel/.modules.order.cmd' 2024-05-08T09:46:57.503 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/atmel/Makefile' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/atmel/ac97c.h' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/atmel/built-in.a' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/sound/atmel/.built-in.a.cmd' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound/atmel' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/sound' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.debug' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/head-object-list.txt' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/split-man.pl' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/.kallsyms.cmd' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/vmlinux-gdb.py' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/Makefile' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/vfs.py' 2024-05-08T09:46:57.504 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/cpus.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/lists.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/__init__.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/interrupts.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/radixtree.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/clk.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/Makefile' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/timerlist.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/device.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/utils.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/mm.py' 2024-05-08T09:46:57.505 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/genpd.py' 2024-05-08T09:46:58.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/constants.py.in' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/symbols.py' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/tasks.py' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/dmesg.py' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/modules.py' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/proc.py' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/config.py' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/rbtree.py' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gdb/linux/.gitignore' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/gdb/linux' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/gdb' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Kbuild.include' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/sorttable.c' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/bloat-o-meter' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/misc-check' 2024-05-08T09:46:58.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/pahole-flags.sh' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccicheck' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/sorttable' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/Kconfig' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/gcc-generate-gimple-pass.h' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/gcc-generate-simple_ipa-pass.h' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/gcc-generate-rtl-pass.h' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/latent_entropy_plugin.c' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/Makefile' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/gcc-common.h' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/stackleak_plugin.c' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/gcc-generate-ipa-pass.h' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/arm_ssp_per_task_plugin.c' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/structleak_plugin.c' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/sancov_plugin.c' 2024-05-08T09:46:58.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/randomize_layout_plugin.c' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-plugins/.gitignore' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/gcc-plugins' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/stackdelta' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/extract-ikconfig' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/syscallhdr.sh' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/checkdeclares.pl' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/cleanpatch' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.clang' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/min-tool-version.sh' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.modpost' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/tools-support-relr.sh' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/cleanfile' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.vmlinux' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/spdxcheck.py' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/check_extable.sh' 2024-05-08T09:46:58.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/remove-stale-files' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mkcompile_h' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/leaking_addresses.pl' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/profile2linkerlist.pl' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/spdxexclude' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kallsyms.c' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/xen-hypercalls.sh' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/const_structs.checkpatch' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/insert-sys-cert.c' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/sphinx-pre-install' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.extrawarn' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/check-git' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/headers_install.sh' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/.asn1_compiler.cmd' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/cc-can-link.sh' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/iterators/itnull.cocci' 2024-05-08T09:46:58.287 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/iterators/list_entry_update.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/iterators/for_each_child.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/iterators/use_after_iter.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/iterators/device_node_continue.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/coccinelle/iterators' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/tests/doublebitand.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/tests/unsigned_lesser_than_zero.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/tests/doubletest.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/tests/odd_ptr_err.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/coccinelle/tests' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/free/ifnulldev_put.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/free/clk_put.cocci' 2024-05-08T09:46:58.288 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/free/kfree.cocci' 2024-05-08T09:46:58.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:46:58 smithi070 ceph-mon[29591]: pgmap v5756: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 214 op/s 2024-05-08T09:46:58.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:46:58 smithi172 ceph-mon[33377]: pgmap v5756: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 214 op/s 2024-05-08T09:46:59.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:46:58 smithi194 ceph-mon[33679]: pgmap v5756: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 214 op/s 2024-05-08T09:46:59.026 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/free/devm_free.cocci' 2024-05-08T09:46:59.026 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/free/kfreeaddr.cocci' 2024-05-08T09:46:59.026 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/free/iounmap.cocci' 2024-05-08T09:46:59.026 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/free/ifnullfree.cocci' 2024-05-08T09:46:59.026 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/free/put_device.cocci' 2024-05-08T09:46:59.026 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/free/pci_free_consistent.cocci' 2024-05-08T09:46:59.026 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/coccinelle/free' 2024-05-08T09:46:59.026 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/resource_size.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/simple_open.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/stream_open.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/atomic_as_refcounter.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/pm_runtime.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/platform_no_drv_owner.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/memdup.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/device_attr_show.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/memdup_user.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/platform_get_irq.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/kfree_sensitive.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/d_find_alias.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/alloc/zalloc-simple.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/alloc/alloc_cast.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/alloc/pool_zalloc-simple.cocci' 2024-05-08T09:46:59.027 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/coccinelle/api/alloc' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/check_bq27xxx_data.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/kstrdup.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/err_cast.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/kvmalloc.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/kfree_mismatch.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/api/vma_pages.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/coccinelle/api' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/locks/double_lock.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/locks/flags.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/locks/mini_lock.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/locks/call_kern.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/coccinelle/locks' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/null/kmerr.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/null/badzero.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/null/deref_null.cocci' 2024-05-08T09:46:59.028 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/null/eno.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/coccinelle/null' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/irqf_oneshot.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/boolconv.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/doubleinit.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/noderef.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/swap.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/minmax.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/excluded_middle.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/add_namespace.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/array_size.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/array_size_dup.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/test_addr.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/returnvar.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/flexible_array.cocci' 2024-05-08T09:46:59.029 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/uninitialized_var.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/ifcol.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/of_table.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/badty.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/semicolon.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/newline_in_nl_msg.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/cond_no_effect.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/warn.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/do_div.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/orplus.cocci' 2024-05-08T09:46:59.030 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/coccinelle/misc/cstptr.cocci' 2024-05-08T09:46:59.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/coccinelle/misc' 2024-05-08T09:46:59.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/coccinelle' 2024-05-08T09:46:59.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/ver_linux' 2024-05-08T09:46:59.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/fdtput.c' 2024-05-08T09:46:59.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/update-dtc-source.sh' 2024-05-08T09:46:59.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/livetree.c' 2024-05-08T09:46:59.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/fdtoverlay.c' 2024-05-08T09:46:59.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/dtc-lexer.l' 2024-05-08T09:46:59.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/checks.c' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/Makefile' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/dtc.c' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/fstree.c' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/dtx_diff' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/fdtget.c' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/util.h' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/openrisc' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/riscv' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/arm' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/microblaze' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/mips' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/sh' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/nios2' 2024-05-08T09:46:59.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/powerpc' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/xtensa' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/arm64' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/dt-bindings' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/include-prefixes/arc' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/dtc/include-prefixes' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/version_gen.h' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/treesource.c' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/srcpos.h' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/util.c' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/flattree.c' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/of_unittest_expect' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt.h' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/libfdt.h' 2024-05-08T09:46:59.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt_wip.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt_rw.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt_overlay.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt_empty_tree.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt_ro.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt_addresses.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt_sw.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/libfdt_internal.h' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/fdt_strerror.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/libfdt/libfdt_env.h' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/dtc/libfdt' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/.gitignore' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/srcpos.c' 2024-05-08T09:46:59.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/data.c' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/dt-extract-compatibles' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/dtc-parser.y' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/dt_to_config' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/dtc.h' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dtc/yamltree.c' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/dtc' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/module.lds.S' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/setlocalversion' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/bootgraph.pl' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/recordmcount.pl' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/spdxcheck-test.sh' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/jobserver-exec' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.lib' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gfp-translate' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/link-vmlinux.sh' 2024-05-08T09:46:59.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/bpf_doc.py' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.compiler' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/rust_is_available.sh' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/test_fortify.sh' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/sign-file.c' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.gcc-plugins' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/xz_wrap.sh' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/package/buildtar' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/package/mkspec' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/package/deb-build-option' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/package/mkdebian' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/package/builddeb' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/package/gen-diff-patch' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/package/snapcraft.template' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/package' 2024-05-08T09:46:59.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/config' 2024-05-08T09:47:00.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:00 smithi070 ceph-mon[29591]: pgmap v5757: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 301 op/s 2024-05-08T09:47:00.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:00 smithi172 ceph-mon[33377]: pgmap v5757: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 301 op/s 2024-05-08T09:47:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:00 smithi194 ceph-mon[33679]: pgmap v5757: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 4.6 MiB/s wr, 301 op/s 2024-05-08T09:47:01.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.defconf' 2024-05-08T09:47:01.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/relocs_check.sh' 2024-05-08T09:47:01.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/is_rust_module.sh' 2024-05-08T09:47:01.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.conf.o.cmd' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/expr.c' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/streamline_config.pl' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/mconf-cfg.sh' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lxdialog/BIG.FAT.WARNING' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lxdialog/yesno.c' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lxdialog/inputbox.c' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lxdialog/checklist.c' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lxdialog/menubox.c' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lxdialog/util.c' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lxdialog/textbox.c' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lxdialog/dialog.h' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/lxdialog' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/preprocess.o' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/gconf.c' 2024-05-08T09:47:01.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/parser.tab.c' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/new_choice_with_dep/Kconfig' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/new_choice_with_dep/__init__.py' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/new_choice_with_dep/config' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/new_choice_with_dep/expected_stdout' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/new_choice_with_dep' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/auto_submenu/Kconfig' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/auto_submenu/__init__.py' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/auto_submenu/expected_stdout' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/auto_submenu' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/inter_choice/Kconfig' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/inter_choice/__init__.py' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/inter_choice/expected_config' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/inter_choice/defconfig' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/inter_choice' 2024-05-08T09:47:01.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/pytest.ini' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/err_recursive_inc/Kconfig' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/err_recursive_inc/__init__.py' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/err_recursive_inc/Kconfig.inc3' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/err_recursive_inc/Kconfig.inc2' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/err_recursive_inc/expected_stderr' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/err_recursive_inc/Kconfig.inc1' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/err_recursive_inc' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/err_recursive_dep/Kconfig' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/err_recursive_dep/__init__.py' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/err_recursive_dep/expected_stderr' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/err_recursive_dep' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/no_write_if_dep_unmet/Kconfig' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/no_write_if_dep_unmet/__init__.py' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/no_write_if_dep_unmet/config' 2024-05-08T09:47:01.653 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/no_write_if_dep_unmet/expected_config' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/no_write_if_dep_unmet' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice/Kconfig' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice/allyes_expected_config' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice/allmod_expected_config' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice/oldask1_expected_stdout' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice/oldask0_expected_stdout' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice/__init__.py' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice/alldef_expected_config' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice/allno_expected_config' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice/oldask1_config' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/choice' 2024-05-08T09:47:01.654 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice_value_with_m_dep/Kconfig' 2024-05-08T09:47:02.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice_value_with_m_dep/__init__.py' 2024-05-08T09:47:02.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice_value_with_m_dep/config' 2024-05-08T09:47:02.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice_value_with_m_dep/expected_config' 2024-05-08T09:47:02.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/choice_value_with_m_dep/expected_stdout' 2024-05-08T09:47:02.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/choice_value_with_m_dep' 2024-05-08T09:47:02.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/conftest.py' 2024-05-08T09:47:02.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/escape/Kconfig' 2024-05-08T09:47:02.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/escape/__init__.py' 2024-05-08T09:47:02.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/escape/expected_stderr' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/preprocess/escape' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/builtin_func/Kconfig' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/builtin_func/__init__.py' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/builtin_func/expected_stdout' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/builtin_func/expected_stderr' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/preprocess/builtin_func' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/circular_expansion/Kconfig' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/circular_expansion/__init__.py' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/circular_expansion/expected_stderr' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/preprocess/circular_expansion' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/variable/Kconfig' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/variable/__init__.py' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/tests/preprocess/variable/expected_stderr' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/preprocess/variable' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests/preprocess' 2024-05-08T09:47:02.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig/tests' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/parser.tab.o' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/menu.o' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/qconf.h' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.confdata.o.cmd' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/qconf.cc' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/conf.c' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/expr.h' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.util.o.cmd' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/images.c' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.lexer.lex.c.cmd' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/symbol.o' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/internal.h' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/qconf-cfg.sh' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lkc_proto.h' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/nconf.h' 2024-05-08T09:47:02.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/Makefile' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/symbol.c' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/gconf.glade' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.preprocess.o.cmd' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/menu.c' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/nconf.c' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/parser.tab.h' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.conf.cmd' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lexer.lex.c' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/mconf.c' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/conf' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/images.h' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/nconf-cfg.sh' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.menu.o.cmd' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.parser.tab.o.cmd' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/gconf-cfg.sh' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.expr.o.cmd' 2024-05-08T09:47:02.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.symbol.o.cmd' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.parser.tab.h.cmd' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/confdata.c' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/util.o' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lkc.h' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/merge_config.sh' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lexer.l' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/confdata.o' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/nconf.gui.c' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/util.c' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/lexer.lex.o' 2024-05-08T09:47:02.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/expr.o' 2024-05-08T09:47:02.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:02 smithi070 ceph-mon[29591]: pgmap v5758: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 181 op/s 2024-05-08T09:47:02.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:02 smithi172 ceph-mon[33377]: pgmap v5758: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 181 op/s 2024-05-08T09:47:03.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:02 smithi194 ceph-mon[33679]: pgmap v5758: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 181 op/s 2024-05-08T09:47:03.613 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.gitignore' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/parser.y' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/conf.o' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/list.h' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/.lexer.lex.o.cmd' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kconfig/preprocess.c' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/kconfig' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/subarch.include' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/basic/fixdep.c' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/basic/.fixdep.cmd' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/basic/Makefile' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/basic/fixdep' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/basic/.gitignore' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/basic' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/prune-kernel' 2024-05-08T09:47:03.614 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/diffconfig' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.dtbinst' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/markup_oops.pl' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/generate_rust_analyzer.py' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/nsdeps' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/get_dvb_firmware' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/asn1_compiler.c' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/as-version.sh' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/spelling.txt' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.vmlinux_o' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/decodecode' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.kasan' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/asn1_compiler' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/sorttable.h' 2024-05-08T09:47:03.615 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/mdp/mdp' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/mdp/.mdp.cmd' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/mdp/dbus_contexts' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/mdp/mdp.c' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/mdp/Makefile' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/mdp/.gitignore' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/selinux/mdp' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/Makefile' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/install_policy.sh' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/genheaders/Makefile' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/genheaders/genheaders.c' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/genheaders/genheaders' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/genheaders/.genheaders.cmd' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/genheaders/.gitignore' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/selinux/genheaders' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/selinux/README' 2024-05-08T09:47:03.616 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/selinux' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-x86_32-has-stack-protector.sh' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/install.sh' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.kmsan' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/extract_xc3028.pl' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/objdiff' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gen-randstruct-seed.sh' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/checkpatch.pl' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.package' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/show_delta' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/get_feat.pl' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/decode_stacktrace.sh' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/clang-tools/gen_compile_commands.py' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/clang-tools/run-clang-tools.py' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/clang-tools' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/generate_rust_target.rs' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/module.lds' 2024-05-08T09:47:03.617 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/headerdep.pl' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/extract-module-sig.pl' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/ld-version.sh' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/recordmcount.h' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/file-size.sh' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.modinst' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/extract-vmlinux' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/orc_hash.sh' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/check-sysctl-docs' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/ksymoops/README' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/ksymoops' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/checkkconfigsymbols.py' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/faddr2line' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/checkstack.pl' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/modules-check.sh' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/parse-maintainers.pl' 2024-05-08T09:47:03.618 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/find-unused-docs.sh' 2024-05-08T09:47:03.619 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/objdump-func' 2024-05-08T09:47:03.619 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/get_abi.pl' 2024-05-08T09:47:03.619 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Kconfig.include' 2024-05-08T09:47:04.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/unifdef.c' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/.module.lds.cmd' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mkuboot.sh' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/generate_initcall_order.pl' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/checksyscalls.sh' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.ubsan' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kallsyms' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.userprogs' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.modfinal' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/gcc-x86_64-has-stack-protector.sh' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/patch-kernel' 2024-05-08T09:47:04.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.kcsan' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/checkversion.pl' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/kernel-doc' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.build' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mksysmap' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/tags.sh' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/depmod.sh' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/documentation-file-ref-check' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.clean' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/get_maintainer.pl' 2024-05-08T09:47:04.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dummy-tools/objcopy' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dummy-tools/ld' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dummy-tools/gcc' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dummy-tools/dummy-plugin-dir/include/plugin-version.h' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/dummy-tools/dummy-plugin-dir/include' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/dummy-tools/dummy-plugin-dir' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dummy-tools/nm' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dummy-tools/pahole' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/dummy-tools' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.kcov' 2024-05-08T09:47:04.540 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/.gitignore' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/dev-needs.sh' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.asm-generic' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.host' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/checkincludes.pl' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/export_report.pl' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/.sorttable.cmd' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/cc-version.sh' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/recordmcount.c' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/syscalltbl.sh' 2024-05-08T09:47:04.541 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/pahole-version.sh' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Lindent' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.randstruct' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/andnot' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/dec_if_positive' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/xchg' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/cmpxchg' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/inc_and_test' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/inc' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/sub' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/inc_unless_negative' 2024-05-08T09:47:04.542 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/read' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/inc_not_zero' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/and' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/try_cmpxchg' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/xor' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/dec' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/sub_and_test' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/add' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/dec_unless_positive' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/add_negative' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/add_unless' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/dec_and_test' 2024-05-08T09:47:04.543 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/set' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/kerneldoc/or' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/atomic/kerneldoc' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/gen-atomic-long.sh' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/andnot' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/dec_if_positive' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/release' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/xchg' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/fetch_add_unless' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/cmpxchg' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/inc_and_test' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/inc' 2024-05-08T09:47:04.544 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/inc_unless_negative' 2024-05-08T09:47:04.545 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/inc_not_zero' 2024-05-08T09:47:04.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:04 smithi070 ceph-mon[29591]: pgmap v5759: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 181 op/s 2024-05-08T09:47:04.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:04 smithi172 ceph-mon[33377]: pgmap v5759: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 181 op/s 2024-05-08T09:47:05.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:04 smithi194 ceph-mon[33679]: pgmap v5759: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 181 op/s 2024-05-08T09:47:05.697 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/try_cmpxchg' 2024-05-08T09:47:05.697 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/dec' 2024-05-08T09:47:05.697 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/sub_and_test' 2024-05-08T09:47:05.697 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/read_acquire' 2024-05-08T09:47:05.697 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/dec_unless_positive' 2024-05-08T09:47:05.697 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/acquire' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/set_release' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/add_negative' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/add_unless' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/dec_and_test' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/fallbacks/fence' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/atomic/fallbacks' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/gen-atomic-fallback.sh' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/gen-atomic-instrumented.sh' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/atomic-tbl.sh' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/atomics.tbl' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/atomic/gen-atomics.sh' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/atomic' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/syscallnr.sh' 2024-05-08T09:47:05.698 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/genksyms/lex.l' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/genksyms/keywords.c' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/genksyms/genksyms.h' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/genksyms/Makefile' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/genksyms/.gitignore' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/genksyms/parse.y' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/genksyms/genksyms.c' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/genksyms' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/extract-sys-certs.pl' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/makelst' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/tracing/draw_functrace.py' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/tracing/ftrace-bisect.sh' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/tracing' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/rust_is_available_bindgen_libclang.h' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/stackusage' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/Makefile.headersinst' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/mk_elfconfig' 2024-05-08T09:47:05.699 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/modpost.c' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/file2alias.o' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/empty.c' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/sumversion.o' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/empty.o' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/.sumversion.o.cmd' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/devicetable-offsets.h' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/.file2alias.o.cmd' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/Makefile' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/modpost.h' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/sumversion.c' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/.empty.o.cmd' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/mk_elfconfig.c' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/.mk_elfconfig.cmd' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/.elfconfig.h.cmd' 2024-05-08T09:47:05.700 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/elfconfig.h' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/.modpost.o.cmd' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/file2alias.c' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/devicetable-offsets.s' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/.modpost.cmd' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/.devicetable-offsets.s.cmd' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/modpost.o' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/.gitignore' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/modpost' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/list.h' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/scripts/mod/devicetable-offsets.c' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts/mod' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/scripts' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/vmlinux.o' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/modules.builtin' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.clang-format' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.checked-atomic-long.h' 2024-05-08T09:47:05.701 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.tmp_vmlinux.kallsyms1.S' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.io_uring.o.cmd' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/tctx.o' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/opdef.h' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/splice.h' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/io_uring.o' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/epoll.o' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/rsrc.c' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/io_uring.c' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.notif.o.cmd' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/splice.c' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/advise.o' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/modules.order' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.cancel.o.cmd' 2024-05-08T09:47:05.702 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/notif.o' 2024-05-08T09:47:05.932 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:05 smithi172 ceph-mon[33377]: osdmap e437: 12 total, 12 up, 12 in 2024-05-08T09:47:06.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:05 smithi194 ceph-mon[33679]: osdmap e437: 12 total, 12 up, 12 in 2024-05-08T09:47:06.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:05 smithi070 ceph-mon[29591]: osdmap e437: 12 total, 12 up, 12 in 2024-05-08T09:47:06.603 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.splice.o.cmd' 2024-05-08T09:47:06.603 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/poll.c' 2024-05-08T09:47:06.603 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/net.h' 2024-05-08T09:47:06.603 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/nop.h' 2024-05-08T09:47:06.603 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/fdinfo.o' 2024-05-08T09:47:06.603 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/fs.o' 2024-05-08T09:47:06.603 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.filetable.o.cmd' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/msg_ring.o' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/fdinfo.h' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/epoll.c' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/epoll.h' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/openclose.o' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.msg_ring.o.cmd' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.opdef.o.cmd' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/refs.h' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.kbuf.o.cmd' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/uring_cmd.c' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/xattr.c' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/statx.c' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/poll.h' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/rw.o' 2024-05-08T09:47:06.604 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/fs.c' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/splice.o' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.xattr.o.cmd' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/slist.h' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.rw.o.cmd' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/io-wq.h' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/cancel.o' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.modules.order.cmd' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/notif.c' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/fdinfo.c' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/uring_cmd.o' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/io-wq.o' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/filetable.h' 2024-05-08T09:47:06.605 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.sync.o.cmd' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/cancel.c' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.advise.o.cmd' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/msg_ring.c' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.poll.o.cmd' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/io-wq.c' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/Makefile' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/kbuf.h' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/rw.c' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/timeout.h' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.statx.o.cmd' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.fdinfo.o.cmd' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/opdef.c' 2024-05-08T09:47:06.606 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/alloc_cache.h' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/filetable.c' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.fs.o.cmd' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.uring_cmd.o.cmd' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/net.c' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.timeout.o.cmd' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/advise.h' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/kbuf.c' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/cancel.h' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/nop.c' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/built-in.a' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/rsrc.h' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/filetable.o' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/xattr.o' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/statx.h' 2024-05-08T09:47:06.607 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/openclose.h' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/opdef.o' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.sqpoll.o.cmd' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/openclose.c' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.rsrc.o.cmd' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/tctx.c' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/statx.o' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/poll.o' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/nop.o' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/sync.c' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.io-wq.o.cmd' 2024-05-08T09:47:06.608 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.epoll.o.cmd' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/kbuf.o' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/msg_ring.h' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/fs.h' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.nop.o.cmd' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.built-in.a.cmd' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/rsrc.o' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/rw.h' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.openclose.o.cmd' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/timeout.c' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/sync.o' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/sqpoll.c' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/io_uring.h' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/net.o' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/tctx.h' 2024-05-08T09:47:06.609 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.net.o.cmd' 2024-05-08T09:47:06.610 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/notif.h' 2024-05-08T09:47:06.610 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/sqpoll.o' 2024-05-08T09:47:06.610 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/sync.h' 2024-05-08T09:47:06.610 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/uring_cmd.h' 2024-05-08T09:47:06.610 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/timeout.o' 2024-05-08T09:47:06.610 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/advise.c' 2024-05-08T09:47:06.610 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/.tctx.o.cmd' 2024-05-08T09:47:06.610 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/xattr.h' 2024-05-08T09:47:06.610 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/io_uring/sqpoll.h' 2024-05-08T09:47:06.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:06 smithi172 ceph-mon[33377]: pgmap v5761: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-05-08T09:47:07.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:06 smithi194 ceph-mon[33679]: pgmap v5761: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-05-08T09:47:07.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:06 smithi070 ceph-mon[29591]: pgmap v5761: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/io_uring' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mlock.o' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/fadvise.c' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/Kconfig' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/sparse.c' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/vmalloc.c' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.slab_common.o.cmd' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mlock.o.cmd' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/debug_vm_pgtable.c' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/hugetlb.o' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/ptdump.o' 2024-05-08T09:47:07.741 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/pgtable-generic.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.workingset.o.cmd' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/hw_tags.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/report_tags.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/tags.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/kasan_test_module.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/report_hw_tags.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/Makefile' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/generic.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/common.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/kasan_test.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/init.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/kasan.h' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/report.c' 2024-05-08T09:47:07.742 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/quarantine.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/report_generic.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/sw_tags.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/shadow.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kasan/report_sw_tags.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/mm/kasan' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/percpu-internal.h' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/slab.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.filemap.o.cmd' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/hugetlb_vmemmap.o' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/percpu-stats.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/shmem.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_table_check.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mmzone.o.cmd' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/interval_tree.c' 2024-05-08T09:47:07.743 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/shuffle.h' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.vmscan.o.cmd' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/init-mm.o' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mremap.c' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/shuffle.c' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.list_lru.o.cmd' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memblock.c' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memfd.c' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/fail_page_alloc.c' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/percpu.o' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.vmalloc.o.cmd' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/modules.order' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.sparse.o.cmd' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/vmalloc.o' 2024-05-08T09:47:07.744 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.page_io.o.cmd' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/gup.o' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmemleak.c' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.hugetlb_vmemmap.o.cmd' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.backing-dev.o.cmd' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/vmpressure.c' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_alloc.c' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mempool.c' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.init-mm.o.cmd' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/ioremap.c' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mremap.o' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mincore.c' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/early_ioremap.c' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mmap_lock.o.cmd' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/show_mem.o' 2024-05-08T09:47:07.745 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/debug_page_alloc.c' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/slab_common.o' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/hugetlb_vmemmap.c' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swapfile.o' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swap.c' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.gup.o.cmd' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/madvise.c' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mm_slot.h' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mempolicy.o' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mincore.o.cmd' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mmu_gather.o.cmd' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/pgalloc-track.h' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_vma_mapped.c' 2024-05-08T09:47:07.746 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/sparse-vmemmap.c' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmap.c' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.memfd.o.cmd' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/ptdump.c' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.maccess.o.cmd' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.truncate.o.cmd' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_idle.c' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.hugetlb_cgroup.o.cmd' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/vmscan.o' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmap_lock.o' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mempolicy.c' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/hugetlb.c' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.migrate.o.cmd' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/filemap.c' 2024-05-08T09:47:07.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.msync.o.cmd' 2024-05-08T09:47:07.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/oom_kill.c' 2024-05-08T09:47:07.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memory-failure.c' 2024-05-08T09:47:07.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memtest.c' 2024-05-08T09:47:07.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/migrate_device.c' 2024-05-08T09:47:07.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_vma_mapped.o' 2024-05-08T09:47:08.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:08 smithi172 ceph-mon[33377]: pgmap v5762: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-05-08T09:47:08.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_alloc.o' 2024-05-08T09:47:08.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.pagewalk.o.cmd' 2024-05-08T09:47:08.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/z3fold.c' 2024-05-08T09:47:08.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memremap.c' 2024-05-08T09:47:08.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.page_alloc.o.cmd' 2024-05-08T09:47:08.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/zbud.c' 2024-05-08T09:47:08.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.early_ioremap.o.cmd' 2024-05-08T09:47:08.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/maccess.c' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/hugetlb_cgroup.c' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.show_mem.o.cmd' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.readahead.o.cmd' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.interval_tree.o.cmd' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.util.o.cmd' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.page_counter.o.cmd' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memfd.o' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.process_vm_access.o.cmd' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/compaction.o' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.compaction.o.cmd' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_owner.c' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.madvise.o.cmd' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/maccess.o' 2024-05-08T09:47:08.961 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_counter.o' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/internal.h' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/userfaultfd.c' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_ext.c' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/hmm.c' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/vmstat.c' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/gup_test.c' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/slub.o' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.hugetlb.o.cmd' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/readahead.o' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/init-mm.c' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memory.c' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.modules.order.cmd' 2024-05-08T09:47:08.962 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.memory-tiers.o.cmd' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/process_vm_access.o' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swap.h' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/rmap.o' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/list_lru.c' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mm_init.o.cmd' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/cma.h' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mprotect.o' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.secretmem.o.cmd' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/migrate.o' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/cma_sysfs.c' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/percpu.c' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page-writeback.c' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/dmapool_test.c' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/balloon_compaction.c' 2024-05-08T09:47:08.963 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.swap_state.o.cmd' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/Makefile' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.dmapool.o.cmd' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/truncate.o' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mprotect.c' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memblock.o' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/workingset.c' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mincore.o' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/folio-compat.o' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/slub.c' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/failslab.c' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.page_vma_mapped.o.cmd' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_poison.c' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.swap.o.cmd' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.highmem.o.cmd' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/compaction.c' 2024-05-08T09:47:08.964 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page-writeback.o' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/highmem.c' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mempolicy.o.cmd' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/highmem.o' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmsan/kmsan_test.c' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmsan/Makefile' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmsan/instrumentation.c' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmsan/hooks.c' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmsan/kmsan.h' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmsan/init.c' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmsan/report.c' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmsan/shadow.c' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kmsan/core.c' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/mm/kmsan' 2024-05-08T09:47:08.965 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/slab_common.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_reporting.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/gup_test.h' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/readahead.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/frontswap.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/dmapool.o' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/percpu-km.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/rmap.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/show_mem.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/msync.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mapping_dirty_helpers.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/secretmem.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/zsmalloc.c' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/oom_kill.o' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swap_slots.o' 2024-05-08T09:47:08.966 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/built-in.a' 2024-05-08T09:47:08.967 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/gup.c' 2024-05-08T09:47:08.967 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/sparse.o' 2024-05-08T09:47:08.967 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmu_gather.o' 2024-05-08T09:47:08.967 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.swapfile.o.cmd' 2024-05-08T09:47:08.967 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kfence/kfence.h' 2024-05-08T09:47:08.967 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kfence/Makefile' 2024-05-08T09:47:08.967 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kfence/.kunitconfig' 2024-05-08T09:47:08.967 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kfence/kfence_test.c' 2024-05-08T09:47:08.967 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kfence/report.c' 2024-05-08T09:47:09.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:08 smithi194 ceph-mon[33679]: pgmap v5762: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-05-08T09:47:09.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:08 smithi070 ceph-mon[29591]: pgmap v5762: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.4 MiB/s wr, 220 op/s 2024-05-08T09:47:10.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/kfence/core.c' 2024-05-08T09:47:10.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/mm/kfence' 2024-05-08T09:47:10.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mm_init.o' 2024-05-08T09:47:10.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/percpu-vm.c' 2024-05-08T09:47:10.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/khugepaged.c' 2024-05-08T09:47:10.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/cma_debug.c' 2024-05-08T09:47:10.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/rodata_test.c' 2024-05-08T09:47:10.248 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mprotect.o.cmd' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/hugetlb_vmemmap.h' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/migrate.c' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/process_vm_access.c' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/Kconfig' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/sysfs.c' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/lru_sort.c' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/sysfs-schemes.c' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/paddr.c' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/vaddr-test.h' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/reclaim.c' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/dbgfs.c' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/Makefile' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/ops-common.c' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/modules-common.h' 2024-05-08T09:47:10.249 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/vaddr.c' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/core-test.h' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/sysfs-common.c' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/core.c' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/sysfs-common.h' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/modules-common.c' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/ops-common.h' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/damon/dbgfs-test.h' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/mm/damon' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memory-tiers.o' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/bootmem_info.c' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/interval_tree.o' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/dmapool.c' 2024-05-08T09:47:10.250 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/sparse-vmemmap.o' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.pgtable-generic.o.cmd' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mm_init.c' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/secretmem.o' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.folio-compat.o.cmd' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/debug.c' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/nommu.c' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swapfile.c' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/usercopy.c' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.debug.o.cmd' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mempool.o' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/truncate.c' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/workingset.o' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.oom_kill.o.cmd' 2024-05-08T09:47:10.251 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memcontrol.c' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/backing-dev.o' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/io-mapping.c' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memory.o' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swap_slots.c' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/huge_memory.c' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/ksm.c' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/hugetlb_cgroup.o' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmap_lock.c' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.memory.o.cmd' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swap_cgroup.c' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmap.o' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/util.o' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/pagewalk.c' 2024-05-08T09:47:10.252 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/filemap.o' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmzone.c' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mempool.o.cmd' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmu_notifier.o' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.shmem.o.cmd' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.swap_slots.o.cmd' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/hwpoison-inject.c' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/pagewalk.o' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swap_state.c' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/shmem.o' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/util.c' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.built-in.a.cmd' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memory_hotplug.c' 2024-05-08T09:47:10.253 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmu_gather.c' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mmu_notifier.o.cmd' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmu_notifier.c' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.memblock.o.cmd' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_counter.c' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/debug.o' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.slub.o.cmd' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/msync.o' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swap_state.o' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.fadvise.o.cmd' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.page-writeback.o.cmd' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.vmstat.o.cmd' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/vmscan.c' 2024-05-08T09:47:10.254 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/pgtable-generic.o' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/madvise.o' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/backing-dev.c' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/shrinker_debug.c' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/zswap.c' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_io.o' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mremap.o.cmd' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.ptdump.o.cmd' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/early_ioremap.o' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/list_lru.o' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mlock.c' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/vmstat.o' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/cma.c' 2024-05-08T09:47:10.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.rmap.o.cmd' 2024-05-08T09:47:11.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:10 smithi194 ceph-mon[33679]: pgmap v5763: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-05-08T09:47:11.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:10 smithi070 ceph-mon[29591]: pgmap v5763: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-05-08T09:47:11.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:10 smithi172 ceph-mon[33377]: pgmap v5763: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-05-08T09:47:11.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/debug_page_ref.c' 2024-05-08T09:47:11.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.sparse-vmemmap.o.cmd' 2024-05-08T09:47:11.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_io.c' 2024-05-08T09:47:11.366 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/Kconfig.debug' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/memory-tiers.c' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/fadvise.o' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.percpu.o.cmd' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/zpool.c' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/slab.h' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/mmzone.o' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_isolation.c' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/page_reporting.h' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/swap.o' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/.mmap.o.cmd' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/mm/folio-compat.c' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/mm' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_sort.c' 2024-05-08T09:47:11.367 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpi-cmp.o.cmd' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpi-mul.o.cmd' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-mod.c' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpih-mul.o.cmd' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-sub1.o' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/modules.order' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpi-pow.o.cmd' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-lshift.c' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-add.o' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-mul1.o' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.generic_mpih-mul3.o.cmd' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpih-cmp.o' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-lshift.o' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-sub-ui.c' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/longlong.h' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpiutil.c' 2024-05-08T09:47:11.368 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-mul1.c' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpih-div.o' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.generic_mpih-mul1.o.cmd' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-add1.c' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.generic_mpih-add1.o.cmd' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpih-mul.c' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpih-div.o.cmd' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.ec.o.cmd' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpih-mul.o' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-div.o' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-pow.c' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.modules.order.cmd' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-bit.c' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-div.c' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpi-inv.o.cmd' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpiutil.o' 2024-05-08T09:47:11.369 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-sub-ui.o' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-mul2.c' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-mul.o' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-internal.h' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/Makefile' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpicoder.o' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpicoder.c' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-mul3.c' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpi-add.o.cmd' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-add1.o' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpicoder.o.cmd' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-mod.o' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.generic_mpih-lshift.o.cmd' 2024-05-08T09:47:11.370 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-add.c' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-inline.h' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/built-in.a' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-cmp.c' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-rshift.c' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-pow.o' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-cmp.o' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpih-cmp.o.cmd' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-rshift.o' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-sub1.c' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-mul3.o' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpiutil.o.cmd' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpi-bit.o.cmd' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpi-sub-ui.o.cmd' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.generic_mpih-sub1.o.cmd' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpih-cmp.c' 2024-05-08T09:47:11.371 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.built-in.a.cmd' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/ec.o' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpi-div.o.cmd' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-mul.c' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-bit.o' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-inv.c' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/ec.c' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.generic_mpih-rshift.o.cmd' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.mpi-mod.o.cmd' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpi-inv.o' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/mpih-div.c' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/generic_mpih-mul2.o' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/mpi/.generic_mpih-mul2.o.cmd' 2024-05-08T09:47:11.372 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/mpi' 2024-05-08T09:47:12.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.rcuref.o.cmd' 2024-05-08T09:47:12.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/Kconfig' 2024-05-08T09:47:12.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dynamic_debug.c' 2024-05-08T09:47:12.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-rlock-hardirq.h' 2024-05-08T09:47:12.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dynamic_queue_limits.o' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-softirq.h' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/audit.c' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/find_bit.c' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/Kconfig.kfence' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bch.c' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_linear_ranges.c' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.generic-radix-tree.o.cmd' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.clz_ctz.o.cmd' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-rsem.h' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fault-inject.c' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.klist.o.cmd' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.group_cpus.o.cmd' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_ida.c' 2024-05-08T09:47:12.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress.c' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lockref.o' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/sg_pool.o' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_free_pages.c' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/list-test.c' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.strnlen_user.o.cmd' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.bitmap.o.cmd' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_inflate.c' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/devres.o' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.crc16.o.cmd' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.iov_iter.o.cmd' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/syscall.c' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/devmem_is_allowed.c' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/Kconfig' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_8x8.c' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/modules.order' 2024-05-08T09:47:12.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_sun12x22.c' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/.font_8x16.o.cmd' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/fonts.o' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_sun8x16.c' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_acorn_8x8.c' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_mini_4x6.c' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/.modules.order.cmd' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_pearl_8x8.c' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/Makefile' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/.fonts.o.cmd' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_8x16.c' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/built-in.a' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_10x18.c' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/.built-in.a.cmd' 2024-05-08T09:47:12.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_6x8.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_8x16.o' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_ter16x32.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_6x10.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_6x11.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/fonts.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fonts/font_7x14.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/fonts' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/gen_crc32table.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/asn1_decoder.o' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/packing.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/rbtree.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_bits.c' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.net_utils.o.cmd' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-spin.h' 2024-05-08T09:47:12.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.crc32.o.cmd' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc-ccitt.o' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/inflate.c' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/is_single_threaded.c' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.decompress_bunzip2.o.cmd' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/interval_tree.c' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.string.o.cmd' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/overflow_kunit.c' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/pldmfw/Makefile' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/pldmfw/pldmfw_private.h' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/pldmfw/pldmfw.c' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/pldmfw' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.once.o.cmd' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/string.o' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/lz4hc_compress.c' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/modules.order' 2024-05-08T09:47:12.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/.lz4_decompress.o.cmd' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/lz4defs.h' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/.modules.order.cmd' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/lz4_compress.c' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/Makefile' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/lz4_decompress.o' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/lz4_decompress.c' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/built-in.a' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lz4/.built-in.a.cmd' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/lz4' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/glob.o' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/vsprintf.o' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/syscall.o' 2024-05-08T09:47:12.317 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_hash.c' 2024-05-08T09:47:13.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.clz_tab.o.cmd' 2024-05-08T09:47:13.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/modules.order' 2024-05-08T09:47:13.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_module.c' 2024-05-08T09:47:13.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.random32.o.cmd' 2024-05-08T09:47:13.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/siphash_kunit.c' 2024-05-08T09:47:13.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/cmdline.c' 2024-05-08T09:47:13.006 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/percpu_test.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.cmdline.o.cmd' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/nmi_backtrace.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/notifier-error-inject.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/memweight.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ucs2_string.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/argv_split.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kstrtox.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/percpu_counter.o' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/radix-tree.o' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_list_sort.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/Kconfig' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/executor_test.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/string-stream-test.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/debugfs.c' 2024-05-08T09:47:13.007 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/try-catch-impl.h' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/try-catch.c' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/string-stream.c' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/debugfs.h' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/resource.c' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/Makefile' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/string-stream.h' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/assert.c' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/hooks.c' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/.kunitconfig' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/hooks-impl.h' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/executor.c' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/static_stub.c' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/test.c' 2024-05-08T09:47:13.008 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/kunit-example-test.c' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kunit/kunit-test.c' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/kunit' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_debug_virtual.c' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/buildid.o' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.nmi_backtrace.o.cmd' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.ratelimit.o.cmd' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bsearch.o' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-wsem.h' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/genalloc.o' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/strnlen_user.c' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/idr.o' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kasprintf.o' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dec_and_lock.c' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/cpu_rmap.o' 2024-05-08T09:47:13.009 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/find_bit_benchmark.c' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/stackdepot.c' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/earlycpio.o' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/argv_split.o' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unxz.o' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/list_sort.o' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_callbacks_mod.c' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_callbacks_busy.c' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_callbacks_demo2.c' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_state2.c' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_atomic_replace.c' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/Makefile' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_callbacks_demo.c' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_livepatch.c' 2024-05-08T09:47:13.010 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_shadow_vars.c' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_state3.c' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/livepatch/test_klp_state.c' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/livepatch' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.decompress_unzstd.o.cmd' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fdt_wip.c' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/errseq.o' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.assoc_array.o.cmd' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress.o' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_blackhole_dev.c' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/check_signature.o' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/atomic64_test.c' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.flex_proportions.o.cmd' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/btree.c' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.kstrtox.o.cmd' 2024-05-08T09:47:13.011 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/muldi3.c' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kobject_uevent.o' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/llist.o' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bitfield_kunit.c' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/error-inject.c' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_hexdump.c' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/base64.c' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_ref_tracker.c' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.debug_locks.o.cmd' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unlzma.o' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.dump_stack.o.cmd' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.xxhash.o.cmd' 2024-05-08T09:47:13.012 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.lib.a.cmd' 2024-05-08T09:47:13.013 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:12 smithi194 ceph-mon[33679]: pgmap v5764: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-05-08T09:47:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:12 smithi070 ceph-mon[29591]: pgmap v5764: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-05-08T09:47:13.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:12 smithi172 ceph-mon[33377]: pgmap v5764: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-05-08T09:47:13.914 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/nlattr.o' 2024-05-08T09:47:13.914 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.buildid.o.cmd' 2024-05-08T09:47:13.914 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.pci_iomap.o.cmd' 2024-05-08T09:47:13.914 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.kasprintf.o.cmd' 2024-05-08T09:47:13.914 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/memregion.c' 2024-05-08T09:47:13.914 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ashldi3.c' 2024-05-08T09:47:13.914 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.lockref.o.cmd' 2024-05-08T09:47:13.914 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/memcpy_kunit.c' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bitrev.c' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/oid_registry.c' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/recov_s390xc.c' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/algos.c' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/vpermxor.uc' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/neon.h' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/recov.c' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/recov_avx512.c' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/unroll.awk' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/Makefile' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/altivec.uc' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/avx2.c' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/neon.uc' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/int.uc' 2024-05-08T09:47:13.915 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/recov_neon_inner.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/x86.h' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/recov_ssse3.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/mktables.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/sse2.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/neon.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/avx512.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/recov_neon.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/mmx.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/.gitignore' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/sse1.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/test/Makefile' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/test/test.c' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/raid6/test' 2024-05-08T09:47:13.916 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/s390vx.uc' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/raid6/recov_avx2.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/raid6' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/seq_buf.o' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.decompress_unlzma.o.cmd' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bcd.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.sort.o.cmd' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/hexdump.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/generic-radix-tree.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_bitmap.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/net_utils.o' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_firmware.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/timerqueue.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/scatterlist.o' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fault-inject-usercopy.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/globtest.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_uuid.c' 2024-05-08T09:47:13.917 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.radix-tree.o.cmd' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.cpumask.o.cmd' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/net_utils.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-strscpy.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/read_overflow-memcmp.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-memcpy.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow_field-memmove.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-strcpy-lit.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow_field-memcpy.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-strlcpy.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/read_overflow2-memcpy.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-strncpy.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-memset.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/read_overflow2_field-memmove.c' 2024-05-08T09:47:13.918 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/test_fortify.h' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/read_overflow-memchr_inv.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow_field-memset.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-strncpy-src.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/read_overflow-memchr.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-strcpy.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/read_overflow2-memcmp.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/read_overflow-memscan.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-memmove.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/write_overflow-strlcpy-src.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/read_overflow2-memmove.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fortify/read_overflow2_field-memcpy.c' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/test_fortify' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.decompress_unlz4.o.cmd' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/rbtree.o' 2024-05-08T09:47:13.919 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/refcount.c' 2024-05-08T09:47:13.920 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fdt_rw.c' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/win_minmax.o' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/pci_iomap.c' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test-kstrtox.c' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/iomap.c' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/Kconfig.kasan' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_parman.c' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_xarray.c' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/radix-tree.h' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_objagg.c' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.is_single_threaded.o.cmd' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bootconfig.c' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-wlock-softirq.h' 2024-05-08T09:47:14.827 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.interval_tree.o.cmd' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc4.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/check_signature.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc32.o' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/earlycpio.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.earlycpio.o.cmd' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/cpumask_kunit.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/iommu-helper.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/sbitmap.o' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/asn1_encoder.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/cmdline_kunit.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bsearch.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_memcat_p.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/rhashtable.c' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.ucs2_string.o.cmd' 2024-05-08T09:47:14.828 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/Kconfig' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/reciprocal_div.c' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/gcd.o' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/reciprocal_div.o' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/.int_pow.o.cmd' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/modules.order' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/int_pow.o' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/.gcd.o.cmd' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/lcm.o' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/prime_numbers.c' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/div64.o' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/int_pow.c' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/div64.c' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/gcd.c' 2024-05-08T09:47:14.829 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/.modules.order.cmd' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/rational.c' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/.int_sqrt.o.cmd' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/Makefile' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/cordic.c' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/built-in.a' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/lcm.c' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/.div64.o.cmd' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/.lcm.o.cmd' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/int_sqrt.c' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/.built-in.a.cmd' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/rational-test.c' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/rational.o' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/.reciprocal_div.o.cmd' 2024-05-08T09:47:14.830 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/.rational.o.cmd' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/int_sqrt.o' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/math/test_div64.c' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/math' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bug.c' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/notifier-error-inject.h' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-rlock-softirq.h' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.sg_pool.o.cmd' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ratelimit.o' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/errname.c' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.rbtree.o.cmd' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/parser.o' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/stackdepot.o' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc32test.c' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/devres.c' 2024-05-08T09:47:14.831 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/generic-radix-tree.o' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_inflate.o' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/vdso/Kconfig' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/vdso/Makefile' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/vdso/gettimeofday.c' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/vdso' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/cpumask.o' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/polynomial.c' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.modules.order.cmd' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc-t10dif.c' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/is_single_threaded.o' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_rhashtable.c' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/.lzo1x_decompress_safe.o.cmd' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/modules.order' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/lzodefs.h' 2024-05-08T09:47:14.832 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/lzo1x_compress.o' 2024-05-08T09:47:14.833 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/lzo1x_decompress_safe.o' 2024-05-08T09:47:14.833 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/.modules.order.cmd' 2024-05-08T09:47:14.833 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/Makefile' 2024-05-08T09:47:14.833 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/built-in.a' 2024-05-08T09:47:14.833 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/lzo1x_compress.c' 2024-05-08T09:47:14.833 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/lzo1x_decompress_safe.c' 2024-05-08T09:47:14.833 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/.built-in.a.cmd' 2024-05-08T09:47:14.833 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lzo/.lzo1x_compress.o.cmd' 2024-05-08T09:47:15.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:14 smithi194 ceph-mon[33679]: pgmap v5765: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-05-08T09:47:15.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:14 smithi070 ceph-mon[29591]: pgmap v5765: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-05-08T09:47:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:14 smithi172 ceph-mon[33377]: pgmap v5765: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.3 MiB/s wr, 205 op/s 2024-05-08T09:47:15.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/lzo' 2024-05-08T09:47:15.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.seq_buf.o.cmd' 2024-05-08T09:47:15.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.devres.o.cmd' 2024-05-08T09:47:15.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/gen_crc64table.c' 2024-05-08T09:47:15.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/usercopy.o' 2024-05-08T09:47:15.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/strscpy_kunit.c' 2024-05-08T09:47:15.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.string_helpers.o.cmd' 2024-05-08T09:47:15.681 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/is_signed_type_kunit.c' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/siphash.o' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dhry_run.c' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.list_sort.o.cmd' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bcd.o' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_scanf.c' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/Kconfig.ubsan' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bootconfig-data.S' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/nlattr.c' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.dynamic_queue_limits.o.cmd' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/cpu_rmap.c' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dim/dim.c' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dim/Makefile' 2024-05-08T09:47:15.682 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dim/net_dim.c' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dim/rdma_dim.c' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/dim' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/842/Makefile' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/842/842_decompress.c' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/842/842_debugfs.h' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/842/842_compress.c' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/842/842.h' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/842' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.errseq.o.cmd' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/sort.o' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/rbtree_test.c' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/logic_pio.c' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/extable.c' 2024-05-08T09:47:15.683 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc32defs.h' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.base64.o.cmd' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/digsig.c' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/plist.c' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/Kconfig' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_dec_bcj.c' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_dec_bcj.o' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_crc32.c' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_stream.h' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/modules.order' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_private.h' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/.xz_dec_syms.o.cmd' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_dec_stream.c' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_dec_syms.o' 2024-05-08T09:47:15.684 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/.xz_dec_bcj.o.cmd' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/.modules.order.cmd' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/.xz_dec_stream.o.cmd' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_dec_test.c' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/Makefile' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_lzma2.h' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_dec_lzma2.c' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_dec_lzma2.o' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/.xz_dec_lzma2.o.cmd' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/built-in.a' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_dec_syms.c' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/xz_dec_stream.o' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xz/.built-in.a.cmd' 2024-05-08T09:47:15.685 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/xz' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.percpu-refcount.o.cmd' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.decompress_unlzo.o.cmd' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/rhashtable.o' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/Makefile' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/string_helpers.c' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.kfifo.o.cmd' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/buildid.c' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inflate_syms.o' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/infutil.h' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inffast.o' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inflate.c' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/infutil.o' 2024-05-08T09:47:15.686 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/modules.order' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/infutil.c' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inflate_syms.c' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inftrees.c' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inflate.o' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/.modules.order.cmd' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/.inflate_syms.o.cmd' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inffixed.h' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/Makefile' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/.inffast.o.cmd' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/.inflate.o.cmd' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/built-in.a' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inftrees.h' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inffast.h' 2024-05-08T09:47:15.687 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inflate.h' 2024-05-08T09:47:15.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inffast.c' 2024-05-08T09:47:15.688 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/.built-in.a.cmd' 2024-05-08T09:47:16.569 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/.infutil.o.cmd' 2024-05-08T09:47:16.569 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/inftrees.o' 2024-05-08T09:47:16.569 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_inflate/.inftrees.o.cmd' 2024-05-08T09:47:16.569 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/zlib_inflate' 2024-05-08T09:47:16.569 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.decompress_unxz.o.cmd' 2024-05-08T09:47:16.569 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc64-rocksoft.c' 2024-05-08T09:47:16.569 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.crc-ccitt.o.cmd' 2024-05-08T09:47:16.569 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-spin-softirq.h' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/iomap.o' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/of-reconfig-notifier-error-inject.c' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.scatterlist.o.cmd' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.gen_crc32table.cmd' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test-string_helpers.c' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bug.o' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dynamic_queue_limits.c' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-wlock-hardirq.h' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/stmp_device.c' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/seq_buf.c' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/reed_solomon/Makefile' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/reed_solomon/reed_solomon.c' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/reed_solomon/decode_rs.c' 2024-05-08T09:47:16.570 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/reed_solomon/test_rslib.c' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/reed_solomon/encode_rs.c' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/reed_solomon' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/maple_tree.o' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/percpu-refcount.c' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.bcd.o.cmd' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/Kconfig.kgdb' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/errname.o' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/hweight.c' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fpu.c' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/random32.o' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/debug_info.c' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kobject.c' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_hmm_uapi.h' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.strncpy_from_user.o.cmd' 2024-05-08T09:47:16.571 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/strcat_kunit.c' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fdt.c' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.usercopy.o.cmd' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/flex_proportions.c' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_bunzip2.c' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.iomap.o.cmd' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ts_bm.c' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/flex_proportions.o' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xarray.o' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bitmap.o' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/genalloc.c' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/sbitmap.c' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.syscall.o.cmd' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/debug_locks.o' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/irq_poll.c' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ref_tracker.c' 2024-05-08T09:47:16.572 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unzstd.c' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-hardirq.h' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/compat_audit.c' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ts_kmp.c' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.siphash.o.cmd' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/idr.c' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/logic_iomem.c' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/irq_regs.o' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.maple_tree.o.cmd' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/strncpy_from_user.c' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/klist.o' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lib.a' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unlzo.c' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/trace_readwrite.c' 2024-05-08T09:47:16.573 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/smp_processor_id.c' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/linear_ranges.c' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.llist.o.cmd' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_fprobe.c' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fdt_empty_tree.c' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unzstd.o' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bitmap.c' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/strncpy_from_user.o' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/clz_tab.o' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_kprobes.c' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/timerqueue.o' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.argv_split.o.cmd' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ucmpdi2.c' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc64.c' 2024-05-08T09:47:16.574 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/iov_iter.o' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unlzo.o' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/built-in.a' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/percpu_counter.c' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc32.c' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/scatterlist.c' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/pci_iomap.o' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bust_spinlocks.o' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.glob.o.cmd' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.xarray.o.cmd' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/stackinit_kunit.c' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/llist.c' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/maple_tree.c' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/cmdline.o' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.oid_registry.o.cmd' 2024-05-08T09:47:16.575 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc16.o' 2024-05-08T09:47:17.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:16 smithi194 ceph-mon[33679]: pgmap v5766: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-05-08T09:47:17.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:16 smithi070 ceph-mon[29591]: pgmap v5766: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-05-08T09:47:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:16 smithi172 ceph-mon[33377]: pgmap v5766: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 176 op/s 2024-05-08T09:47:17.280 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.kobject_uevent.o.cmd' 2024-05-08T09:47:17.280 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_lockup.c' 2024-05-08T09:47:17.280 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ucs2_string.o' 2024-05-08T09:47:17.280 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kstrtox.o' 2024-05-08T09:47:17.280 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/assoc_array.c' 2024-05-08T09:47:17.280 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dump_stack.c' 2024-05-08T09:47:17.280 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/build_OID_registry' 2024-05-08T09:47:17.280 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/sg_split.c' 2024-05-08T09:47:17.280 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ctype.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/checksum.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/slub_kunit.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/cpumask.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xarray.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/hexdump.o' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.bust_spinlocks.o.cmd' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bucket_locks.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.errname.o.cmd' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unlzma.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ubsan.h' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/interval_tree.o' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_kmod.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/once.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ratelimit.c' 2024-05-08T09:47:17.281 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unxz.c' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/interval_tree_test.c' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/base64.o' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.bsearch.o.cmd' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.refcount.o.cmd' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/memweight.o' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/modules.order' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_compress_superblock.c' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_fast.c' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_compress_literals.c' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_ldm_geartab.h' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_cwksp.h' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_lazy.h' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_opt.c' 2024-05-08T09:47:17.282 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_compress.c' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/clevels.h' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_compress_superblock.h' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_compress_sequences.h' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/fse_compress.c' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_lazy.c' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_compress_internal.h' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_fast.h' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_opt.h' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_ldm.c' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/huf_compress.c' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_double_fast.h' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_compress_sequences.c' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/hist.c' 2024-05-08T09:47:17.283 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_double_fast.c' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/hist.h' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_compress_literals.h' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/compress/zstd_ldm.h' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/zstd/compress' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/zstd_common_module.o' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/.modules.order.cmd' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/zstd_decompress_module.o' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/zstd_common_module.c' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/Makefile' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/zstd_compress_module.c' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/built-in.a' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/zstd_decompress_module.c' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/.zstd_decompress_module.o.cmd' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress_sources.h' 2024-05-08T09:47:17.284 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/.built-in.a.cmd' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/huf.h' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/portability_macros.h' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/debug.h' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/error_private.h' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/entropy_common.c' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/.fse_decompress.o.cmd' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/cpu.h' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/mem.h' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/error_private.o' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/zstd_common.o' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/fse_decompress.o' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/fse_decompress.c' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/.entropy_common.o.cmd' 2024-05-08T09:47:17.285 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/zstd_deps.h' 2024-05-08T09:47:17.286 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/error_private.c' 2024-05-08T09:47:17.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/bitstream.h' 2024-05-08T09:47:17.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/debug.c' 2024-05-08T09:47:17.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/.debug.o.cmd' 2024-05-08T09:47:17.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/zstd_internal.h' 2024-05-08T09:47:17.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/entropy_common.o' 2024-05-08T09:47:17.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/.zstd_common.o.cmd' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/debug.o' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/.error_private.o.cmd' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/fse.h' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/compiler.h' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/common/zstd_common.c' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/zstd/common' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/.zstd_common_module.o.cmd' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/zstd_ddict.h' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/.huf_decompress.o.cmd' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/zstd_ddict.o' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/zstd_decompress_internal.h' 2024-05-08T09:47:17.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/zstd_decompress.o' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/.zstd_ddict.o.cmd' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/huf_decompress.o' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/zstd_ddict.c' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/zstd_decompress_block.h' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/zstd_decompress_block.o' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/.zstd_decompress.o.cmd' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/zstd_decompress_block.c' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/.zstd_decompress_block.o.cmd' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/zstd_decompress.c' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zstd/decompress/huf_decompress.c' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/zstd/decompress' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/zstd' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.timerqueue.o.cmd' 2024-05-08T09:47:17.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/irq_regs.c' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/modules.order' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/deflate.c' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/defutil.h' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/deflate_syms.o' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/.modules.order.cmd' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/deflate.o' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/Makefile' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/deftree.c' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/.deflate_syms.o.cmd' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/built-in.a' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/deftree.o' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/.built-in.a.cmd' 2024-05-08T09:47:17.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/deflate_syms.c' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/.deftree.o.cmd' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_deflate/.deflate.o.cmd' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/zlib_deflate' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/oid_registry_data.c' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/refcount.o' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.ctype.o.cmd' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/usercopy.c' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_hmm.c' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-mutex.h' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fdt_ro.c' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_meminit.c' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc32table.h' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/win_minmax.c' 2024-05-08T09:47:17.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_bunzip2.o' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.asn1_decoder.o.cmd' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/radix-tree.c' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.kobject.o.cmd' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.extable.o.cmd' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_ubsan.c' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_dynamic_debug.c' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/clz_ctz.c' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.bug.o.cmd' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc-ccitt.c' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.find_bit.o.cmd' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/list_debug.c' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dhry.h' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lru_cache.c' 2024-05-08T09:47:17.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/rcuref.o' 2024-05-08T09:47:17.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-spin-hardirq.h' 2024-05-08T09:47:17.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.memweight.o.cmd' 2024-05-08T09:47:17.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/clz_tab.c' 2024-05-08T09:47:17.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.stackdepot.o.cmd' 2024-05-08T09:47:17.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_bitops.c' 2024-05-08T09:47:17.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_dfltcc/dfltcc_deflate.c' 2024-05-08T09:47:17.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_dfltcc/dfltcc.c' 2024-05-08T09:47:17.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_dfltcc/dfltcc_deflate.h' 2024-05-08T09:47:17.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_dfltcc/Makefile' 2024-05-08T09:47:18.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_dfltcc/dfltcc_inflate.c' 2024-05-08T09:47:18.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_dfltcc/dfltcc_util.h' 2024-05-08T09:47:18.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_dfltcc/dfltcc.h' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/zlib_dfltcc/dfltcc_inflate.h' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/zlib_dfltcc' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dump_stack.o' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/debugobjects.c' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/cmpdi2.c' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kasprintf.c' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dhry_2.c' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fdt_addresses.c' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fdt_sw.c' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/glob.c' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_sysctl.c' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.percpu_counter.o.cmd' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.dec_and_lock.o.cmd' 2024-05-08T09:47:18.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bucket_locks.o' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/klist.c' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/parman.c' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dhry_1.c' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/memcat_p.o' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/once.o' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lockref.c' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.logic_pio.o.cmd' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/libcrc32c.c' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-rtmutex.h' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest.c' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.decompress.o.cmd' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_printf.c' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/iomap_copy.o' 2024-05-08T09:47:18.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.built-in.a.cmd' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/asn1_decoder.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/list_sort.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/parser.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.idr.o.cmd' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/percpu-refcount.o' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_vmalloc.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/netdev-notifier-error-inject.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_static_keys.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-wlock.h' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fortify_kunit.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kobject_uevent.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ubsan.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_user_copy.c' 2024-05-08T09:47:18.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.nlattr.o.cmd' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/textsearch.c' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.check_signature.o.cmd' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/Kconfig.kmsan' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/sort.c' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/memcat_p.c' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_bpf.c' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.cpu_rmap.o.cmd' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ts_fsm.c' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.bitrev.o.cmd' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.win_minmax.o.cmd' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bust_spinlocks.c' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unlz4.c' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/bitrev.o' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.plist.o.cmd' 2024-05-08T09:47:18.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/uuid.o' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.vsprintf.o.cmd' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc7.c' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.iomap_copy.o.cmd' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ashrdi3.c' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/fdt_strerror.c' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/objagg.c' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/strnlen_user.o' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xxhash.o' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_maple_tree.c' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/random32.c' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/atomic64.c' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/gen_crc32table' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/assoc_array.o' 2024-05-08T09:47:18.650 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/siphash.c' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/dec_and_lock.o' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.gitignore' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.memcat_p.o.cmd' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc8.c' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/Kconfig.kcsan' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/locking-selftest-rlock.h' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.parser.o.cmd' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/pm-notifier-error-inject.c' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/group_cpus.c' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/checksum_kunit.c' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/debug_locks.c' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/uuid.c' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_string.c' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/decompress_unlz4.o' 2024-05-08T09:47:18.651 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/iomap_copy.c' 2024-05-08T09:47:18.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/sg_pool.c' 2024-05-08T09:47:18.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/nmi_backtrace.o' 2024-05-08T09:47:18.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/group_cpus.o' 2024-05-08T09:47:18.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.genalloc.o.cmd' 2024-05-08T09:47:18.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/string.c' 2024-05-08T09:47:18.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/Kconfig' 2024-05-08T09:47:18.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.sha256.o.cmd' 2024-05-08T09:47:18.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/poly1305-donna64.c' 2024-05-08T09:47:18.652 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/arc4.o' 2024-05-08T09:47:18.981 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:18 smithi172 ceph-mon[33377]: pgmap v5767: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 159 op/s 2024-05-08T09:47:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:18 smithi194 ceph-mon[33679]: pgmap v5767: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 159 op/s 2024-05-08T09:47:19.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:18 smithi070 ceph-mon[29591]: pgmap v5767: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 159 op/s 2024-05-08T09:47:19.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/modules.order' 2024-05-08T09:47:19.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.arc4.o.cmd' 2024-05-08T09:47:19.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/curve25519-hacl64.c' 2024-05-08T09:47:19.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/blake2s.o' 2024-05-08T09:47:19.531 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/des.c' 2024-05-08T09:47:19.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/chacha.c' 2024-05-08T09:47:19.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.chacha.o.cmd' 2024-05-08T09:47:19.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/curve25519.c' 2024-05-08T09:47:19.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.gf128mul.o.cmd' 2024-05-08T09:47:19.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/sha256.o' 2024-05-08T09:47:19.532 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.modules.order.cmd' 2024-05-08T09:47:19.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.memneq.o.cmd' 2024-05-08T09:47:19.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/aesgcm.c' 2024-05-08T09:47:19.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/curve25519-fiat32.c' 2024-05-08T09:47:19.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/aes.c' 2024-05-08T09:47:19.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/sha1.o' 2024-05-08T09:47:19.533 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/Makefile' 2024-05-08T09:47:19.534 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/chacha20poly1305-selftest.c' 2024-05-08T09:47:19.534 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/chacha20poly1305.c' 2024-05-08T09:47:19.534 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.utils.o.cmd' 2024-05-08T09:47:19.534 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/chacha.o' 2024-05-08T09:47:19.534 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/aes.o' 2024-05-08T09:47:19.534 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/curve25519-selftest.c' 2024-05-08T09:47:19.534 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/poly1305.c' 2024-05-08T09:47:19.534 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/arc4.c' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.blake2s.o.cmd' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/memneq.c' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/built-in.a' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/poly1305-donna32.c' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/utils.c' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/blake2s.c' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/blake2s-generic.c' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/gf128mul.c' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.aes.o.cmd' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/utils.o' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.sha1.o.cmd' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.blake2s-generic.o.cmd' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/sha256.c' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/.built-in.a.cmd' 2024-05-08T09:47:19.535 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/libchacha.c' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/curve25519-generic.c' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/blake2s-selftest.c' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/gf128mul.o' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/blake2s-generic.o' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/memneq.o' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crypto/sha1.c' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib/crypto' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/oid_registry.o' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.irq_regs.o.cmd' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.hexdump.o.cmd' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kobject.o' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/clz_ctz.o' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/extable.o' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/hashtable_test.c' 2024-05-08T09:47:19.536 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/vsprintf.c' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.rhashtable.o.cmd' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/plist.o' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/string_helpers.o' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/lshrdi3.c' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kfifo.o' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/Kconfig.debug' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/logic_pio.o' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc16.c' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/crc-itu-t.c' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/ctype.o' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.sbitmap.o.cmd' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_static_key_base.c' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/rcuref.c' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/iov_iter.c' 2024-05-08T09:47:19.537 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.decompress_inflate.o.cmd' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/test_min_heap.c' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/errseq.c' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/find_bit.o' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.uuid.o.cmd' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/xxhash.c' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/memory-notifier-error-inject.c' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/.bucket_locks.o.cmd' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kstrtox.h' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/lib/kfifo.c' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/lib' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/System.map' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/.modules.order.cmd' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/pcmcia/device_id.h' 2024-05-08T09:47:19.538 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/pcmcia/cistpl.h' 2024-05-08T09:47:19.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/pcmcia/ds.h' 2024-05-08T09:47:19.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/pcmcia/ss.h' 2024-05-08T09:47:19.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/pcmcia/ciscode.h' 2024-05-08T09:47:19.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/pcmcia/cisreg.h' 2024-05-08T09:47:19.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/pcmcia/soc_common.h' 2024-05-08T09:47:19.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/pcmcia' 2024-05-08T09:47:19.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kvm/arm_arch_timer.h' 2024-05-08T09:47:19.539 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kvm/arm_hypercalls.h' 2024-05-08T09:47:20.467 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kvm/iodev.h' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kvm/arm_pmu.h' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kvm/arm_vgic.h' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kvm/arm_psci.h' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/kvm' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/math-emu/double.h' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/math-emu/soft-fp.h' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/math-emu/op-common.h' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/math-emu/single.h' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/math-emu/op-8.h' 2024-05-08T09:47:20.468 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/math-emu/quad.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/math-emu/op-1.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/math-emu/op-2.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/math-emu/op-4.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/math-emu' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/encrypted-type.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/big_key-type.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/rxrpc-type.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/trusted-type.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/system_keyring.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/user-type.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/dns_resolver-type.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/request_key_auth-type.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/asymmetric-parser.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/trusted_tee.h' 2024-05-08T09:47:20.469 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/asymmetric-type.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/ceph-type.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/trusted_tpm.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/keyring-type.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/trusted_caam.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/keys/asymmetric-subtype.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/keys' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kunit/resource.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kunit/static_stub.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kunit/try-catch.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kunit/visibility.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kunit/test-bug.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kunit/assert.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/kunit/test.h' 2024-05-08T09:47:20.470 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/kunit' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/iso.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/sco.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/hci_core.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/rfcomm.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/hci_sync.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/l2cap.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/hci_sock.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/hci.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/mgmt.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/coredump.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/hci_mon.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bluetooth/bluetooth.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/bluetooth' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/switchdev.h' 2024-05-08T09:47:20.471 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/vxlan.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_nat_masquerade.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_tuple.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/ipv6/nf_defrag_ipv6.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/ipv6/nf_dup_ipv6.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/ipv6/nf_conntrack_ipv6.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/ipv6/nf_reject.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/netfilter/ipv6' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_bpf.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_hooks_lwtunnel.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nft_reject.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_flow_table.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_timestamp.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_l4proto.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_labels.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_helper.h' 2024-05-08T09:47:20.472 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_core.h' 2024-05-08T09:47:20.473 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_tproxy.h' 2024-05-08T09:47:20.473 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_synproxy.h' 2024-05-08T09:47:20.473 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nft_meta.h' 2024-05-08T09:47:20.473 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack.h' 2024-05-08T09:47:21.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:20 smithi194 ceph-mon[33679]: pgmap v5768: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 268 op/s 2024-05-08T09:47:21.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_expect.h' 2024-05-08T09:47:21.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_bpf_link.h' 2024-05-08T09:47:21.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/ipv4/nf_conntrack_ipv4.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/ipv4/nf_dup_ipv4.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/ipv4/nf_defrag_ipv4.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/ipv4/nf_reject.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/netfilter/ipv4' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_tables_ipv4.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_synproxy.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_tables_offload.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_zones.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_acct.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_tables_ipv6.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_nat.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_tables_core.h' 2024-05-08T09:47:21.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/br_netfilter.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_nat_redirect.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_bridge.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_extend.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_log.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_act_ct.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_nat_helper.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_seqadj.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_dup_netdev.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/xt_rateest.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_socket.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nft_fib.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_count.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_timeout.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_tables.h' 2024-05-08T09:47:21.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_queue.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_reject.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netfilter/nf_conntrack_ecache.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/netfilter' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/cfg802154.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/cipso_ipv4.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/snmp.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/flow_offload.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ipv6_stubs.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet_hashtables.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet_connection_sock.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet_common.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_ife.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_defact.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_tunnel_key.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_bpf.h' 2024-05-08T09:47:21.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_csum.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_vlan.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_sample.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_pedit.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_ct.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_gate.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_mirred.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_ipt.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_skbedit.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_nat.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_connmark.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_gact.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_mpls.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_ctinfo.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_police.h' 2024-05-08T09:47:21.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_act/tc_skbmod.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/tc_act' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/af_unix.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dcbevent.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ip_tunnels.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netlabel.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/route.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/udplite.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/xsk_buff_pool.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ipconfig.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/seg6.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ax88796.h' 2024-05-08T09:47:21.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_s_ac.h' 2024-05-08T09:47:21.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:20 smithi070 ceph-mon[29591]: pgmap v5768: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 268 op/s 2024-05-08T09:47:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:20 smithi172 ceph-mon[33377]: pgmap v5768: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 5.3 MiB/s wr, 268 op/s 2024-05-08T09:47:21.928 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sock.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/hash.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/can.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/ieee802154_6lowpan.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/xdp.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/mctp.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/packet.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/xfrm.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/conntrack.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/sctp.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/bpf.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/ipv6.h' 2024-05-08T09:47:21.929 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/nftables.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/flow_table.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/ipv4.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/smc.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/netfilter.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/mpls.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/nexthop.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/unix.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/core.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/generic.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netns/mib.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/netns' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_if.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dst.h' 2024-05-08T09:47:21.930 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/psample.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/xdp.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mctp.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/gro_cells.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet_sock.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bonding.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/addrconf.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/xdp_sock.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tls.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/neighbour.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet6_connection_sock.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/cfg80211.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/xdp_sock_drv.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/net_debug.h' 2024-05-08T09:47:21.931 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/pie.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/seg6_local.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mpls_iptunnel.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/af_vsock.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/codel_impl.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netdev_queues.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/9p/client.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/9p/transport.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/9p/9p.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/9p' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_s_st.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/firewire.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/gso.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ethoc.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/xfrm.h' 2024-05-08T09:47:21.932 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/hwbm.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/checksum.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_pdu.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ife.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/fib_rules.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/x25device.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/rpl.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/gre.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/gtp.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ipv6.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ieee802154_netdev.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/stream_sched.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/auth.h' 2024-05-08T09:47:21.933 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/ulpevent.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/checksum.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/sctp.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/structs.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/sm.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/ulpqueue.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/constants.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/stream_interleave.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/tsnmap.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sctp/command.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/sctp' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/rtnh.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tun_proto.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dcbnl.h' 2024-05-08T09:47:21.934 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/protocol.h' 2024-05-08T09:47:21.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/Space.h' 2024-05-08T09:47:21.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/cfctrl.h' 2024-05-08T09:47:21.935 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/caif_device.h' 2024-05-08T09:47:22.594 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/cffrml.h' 2024-05-08T09:47:22.594 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/cfsrvl.h' 2024-05-08T09:47:22.594 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/caif_dev.h' 2024-05-08T09:47:22.594 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/cfcnfg.h' 2024-05-08T09:47:22.594 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/cfpkt.h' 2024-05-08T09:47:22.594 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/caif_layer.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/cfserl.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/caif/cfmuxl.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/caif' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/af_rxrpc.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/rtnetlink.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/codel_qdisc.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/lag.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/slhc_vj.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/6lowpan.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/wext.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ipcomp.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sch_generic.h' 2024-05-08T09:47:22.595 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ip.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/fq_impl.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dst_cache.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/flow.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet_frag.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/rsi_91x.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet_ecn.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ip_vs.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bond_3ad.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dst_metadata.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/lwtunnel.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/raw.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/net_namespace.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dropreason.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inetpeer.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/macsec.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mld.h' 2024-05-08T09:47:22.596 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ioam6.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/esp.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/page_pool.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/geneve.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/seg6_hmac.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/fib_notifier.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/l3mdev.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet6_hashtables.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/busy_poll.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/af_ieee802154.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/net_ratelimit.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mctpdevice.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/smc.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mip6.h' 2024-05-08T09:47:22.597 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/regulatory.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netrom.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/selftests.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dsa_stubs.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tipc.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/genetlink.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/calipso.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/fq.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/udp.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tcp_states.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ip6_checksum.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ah.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dst_ops.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/nsh.h' 2024-05-08T09:47:22.598 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ieee80211_radiotap.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ip6_route.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/fou.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/gue.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ip6_tunnel.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/strparser.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/iucv/af_iucv.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/iucv/iucv.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/iucv' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/arp.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tcp.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tls_toe.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/lib80211.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/cfg80211-wext.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/handshake.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ipv6_frag.h' 2024-05-08T09:47:22.599 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bond_alb.h' 2024-05-08T09:47:22.600 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_c_ev.h' 2024-05-08T09:47:22.600 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dsfield.h' 2024-05-08T09:47:22.600 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/cls_cgroup.h' 2024-05-08T09:47:22.600 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/phonet/phonet.h' 2024-05-08T09:47:22.600 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/phonet/pep.h' 2024-05-08T09:47:22.600 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/phonet/pn_dev.h' 2024-05-08T09:47:22.600 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/phonet/gprs.h' 2024-05-08T09:47:22.600 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/phonet' 2024-05-08T09:47:23.261 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/icmp.h' 2024-05-08T09:47:23.261 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_c_st.h' 2024-05-08T09:47:23.261 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/stp.h' 2024-05-08T09:47:23.261 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/garp.h' 2024-05-08T09:47:23.261 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/compat.h' 2024-05-08T09:47:23.261 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/flow_dissector.h' 2024-05-08T09:47:23.261 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mrp.h' 2024-05-08T09:47:23.261 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/act_api.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/pkt_sched.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/secure_seq.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ip_fib.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/red.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet_dscp.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/rawv6.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/transp_v6.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/erspan.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/vsock_addr.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/lapb.h' 2024-05-08T09:47:23.262 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/atmclip.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bond_options.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bpf_sk_storage.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tso.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mac802154.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/bareudp.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/p8022.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/request_sock.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/pkt_cls.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/xdp_priv.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/kcm.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mpls.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netevent.h' 2024-05-08T09:47:23.263 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/codel.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ax25.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/gen_stats.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mptcp.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/psnap.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/nexthop.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/udp_tunnel.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/gro.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/scm.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_c_ac.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/x25.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/rose.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/nl802154.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/if_inet6.h' 2024-05-08T09:47:23.264 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/sock_reuseport.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/iw_handler.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/failover.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netprio_cgroup.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/pptp.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/devlink.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ila.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/timewait_sock.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ping.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ncsi.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mac80211.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/amt.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mana/hw_channel.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mana/gdma.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mana/shm_channel.h' 2024-05-08T09:47:23.265 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mana/mana.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/mana/mana_auxiliary.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/mana' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/inet_timewait_sock.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dropreason-core.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_s_ev.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ip6_fib.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/tc_wrapper.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/espintcp.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_sap.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/net_trackers.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/dsa.h' 2024-05-08T09:47:23.266 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/netlink.h' 2024-05-08T09:47:23.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/nfc/nci_core.h' 2024-05-08T09:47:23.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/nfc/llc.h' 2024-05-08T09:47:23.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/nfc/nci.h' 2024-05-08T09:47:23.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/nfc/digital.h' 2024-05-08T09:47:23.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/nfc/nfc.h' 2024-05-08T09:47:23.267 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/nfc/hci.h' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net/nfc' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/llc_conn.h' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/ndisc.h' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/net_failover.h' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/net/datalink.h' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/net' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm0010.h' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/da7213.h' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs42l52.h' 2024-05-08T09:47:23.268 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-acpi-intel-match.h' 2024-05-08T09:47:23.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:23 smithi070 ceph-mon[29591]: pgmap v5769: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 194 op/s 2024-05-08T09:47:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:23 smithi070 ceph-mon[29591]: osdmap e438: 12 total, 12 up, 12 in 2024-05-08T09:47:23.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:23 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:47:23.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:23 smithi172 ceph-mon[33377]: pgmap v5769: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 194 op/s 2024-05-08T09:47:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:23 smithi172 ceph-mon[33377]: osdmap e438: 12 total, 12 up, 12 in 2024-05-08T09:47:23.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:23 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:47:23.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:23 smithi194 ceph-mon[33679]: pgmap v5769: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 194 op/s 2024-05-08T09:47:23.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:23 smithi194 ceph-mon[33679]: osdmap e438: 12 total, 12 up, 12 in 2024-05-08T09:47:23.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:23 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:47:23.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ump_convert.h' 2024-05-08T09:47:23.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/pcm_iec958.h' 2024-05-08T09:47:23.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ump.h' 2024-05-08T09:47:23.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-dai.h' 2024-05-08T09:47:23.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm8903.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/max9768.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm8993.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ak4117.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hda_i915.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/opl4.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/mpu401.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt1015.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/max98088.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ad1843.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ac97/regs.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ac97/compat.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ac97/codec.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ac97/controller.h' 2024-05-08T09:47:23.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/sound/ac97' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/seq_oss_legacy.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt286.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-component.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tpa6130a2-plat.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/dmaengine_pcm.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm1250-ev1.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/pcm_params.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tas5086.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/spear_spdif.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/pcm_oss.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/snd_wavefront.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/vx_core.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/gus.h' 2024-05-08T09:47:23.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm8904.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rawmidi.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-jack.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hdaudio_ext.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/seq_device.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/seq_midi_emul.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sta32x.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ump_msg.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soundfont.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hda-mlink.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/emu10k1.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm2000.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/asequencer.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/designware_i2s.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sh_fsi.h' 2024-05-08T09:47:23.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/adau1373.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm8996.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm9090.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/da7218.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs8427.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/max98095.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sdw.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/pcm.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hda_register.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-card.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ak4xxx-adda.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm8955.h' 2024-05-08T09:47:23.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/compress_driver.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs4231-regs.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/minors.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/madera-pdata.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tas2552-plat.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sh_dac_audio.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hda_regmap.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs35l35.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs35l34.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/control.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-topology.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/acp63_chip_offset_byte.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hda_chmap.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs42l56.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hda_codec.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/memalloc.h' 2024-05-08T09:47:23.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/aci.h' 2024-05-08T09:47:23.818 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tas2781-dsp.h' 2024-05-08T09:47:23.818 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt5659.h' 2024-05-08T09:47:23.818 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/alc5623.h' 2024-05-08T09:47:23.818 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tas2781-tlv.h' 2024-05-08T09:47:23.818 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ak4641.h' 2024-05-08T09:47:23.818 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs8403.h' 2024-05-08T09:47:23.818 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sb.h' 2024-05-08T09:47:24.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/intel-dsp-config.h' 2024-05-08T09:47:24.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/asoundef.h' 2024-05-08T09:47:24.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ak4113.h' 2024-05-08T09:47:24.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt5663.h' 2024-05-08T09:47:24.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/emu10k1_synth.h' 2024-05-08T09:47:24.522 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hdmi-codec.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/seq_oss.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs42l73.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/util_mem.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/info.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm8960.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs35l33.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs4271.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-link.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hdaudio.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/max98090.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hda_verbs.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ak4531_codec.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/seq_kernel.h' 2024-05-08T09:47:24.523 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sb16_csp.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/asound.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/emux_synth.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/uda134x.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/emu8000_reg.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs35l36.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm8962.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hwdep.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/seq_virmidi.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-dapm.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tlv320aic32x4.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/graph_card.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/intel-nhlt.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs35l56.h' 2024-05-08T09:47:24.524 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/seq_midi_event.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt298.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tlv.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs42l42.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/emu8000.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/da9055.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/mixer_oss.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt5668.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt5682s.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt5514.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/pcm_drm_eld.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt5665.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/i2c.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ak4114.h' 2024-05-08T09:47:24.525 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/simple_card_utils.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wavefront.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tlv320dac33-plat.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/dai-imx.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/ext_manifest.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/debug.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/pm.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/stream.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/xtensa.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/trace.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/header.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/dai.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/control.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/info.h' 2024-05-08T09:47:24.526 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/ipc4/header.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/sound/sof/ipc4' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/dai-intel.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/ext_manifest4.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/dai-amd.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/dai-mediatek.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/channel_map.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sof/topology.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/sound/sof' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/omap-hdmi-audio.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm2200.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt5682.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm5100.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/simple_card.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/pt2258.h' 2024-05-08T09:47:24.527 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/pxa2xx-lib.h' 2024-05-08T09:47:24.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/cs35l41.h' 2024-05-08T09:47:24.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/timer.h' 2024-05-08T09:47:24.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/l3.h' 2024-05-08T09:47:24.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ad1816a.h' 2024-05-08T09:47:24.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/pcm-indirect.h' 2024-05-08T09:47:24.528 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tas2781.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/jack.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/emux_legacy.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/spear_dma.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/core.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hda_component.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/uda1380.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-dpcm.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/soc-acpi.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/opl3.h' 2024-05-08T09:47:25.322 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wm9081.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/ac97_codec.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/initval.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/tea6330t.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/hda_hwdep.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/sta350.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/es1688.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/da7219-aad.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/rt5660.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/da7219.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/sound/wss.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/sound' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/opa_addr.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/uverbs_ioctl.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/rdma_cm_ib.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_marshall.h' 2024-05-08T09:47:25.323 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/restrack.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_smi.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/signature.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/uverbs_types.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/rdma_vt.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_pma.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/uverbs_std_types.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/lag.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_addr.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_cm.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/rdmavt_cq.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/rdma_counter.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/opa_port_info.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_sysfs.h' 2024-05-08T09:47:25.324 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ibta_vol1_c12.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/uverbs_named_ioctl.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_hdrs.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/iw_cm.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_verbs.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/rdmavt_mr.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/rdma_cm.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_umem_odp.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/iw_portmap.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_cache.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_sa.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_mad.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_pack.h' 2024-05-08T09:47:25.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/ib_umem.h' 2024-05-08T09:47:25.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/mr_pool.h' 2024-05-08T09:47:25.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/opa_smi.h' 2024-05-08T09:47:25.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/iba.h' 2024-05-08T09:47:25.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/rw.h' 2024-05-08T09:47:25.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/rdmavt_qp.h' 2024-05-08T09:47:25.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/tid_rdma_defs.h' 2024-05-08T09:47:25.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/opa_vnic.h' 2024-05-08T09:47:25.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rdma/rdma_netlink.h' 2024-05-08T09:47:25.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/rdma' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/target/target_core_base.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/target/target_core_fabric.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/target/iscsi/iscsi_target_core.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/target/iscsi/iscsi_transport.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/target/iscsi/iscsi_target_stat.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/target/iscsi' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/target/target_core_backend.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/target' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/generated/autoconf.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/generated/utsversion.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/generated/asm-offsets.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/generated/compile.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/generated/utsrelease.h' 2024-05-08T09:47:25.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/generated/rustc_cfg' 2024-05-08T09:47:25.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/generated/bounds.h' 2024-05-08T09:47:25.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/generated/timeconst.h' 2024-05-08T09:47:25.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/generated/uapi/linux/version.h' 2024-05-08T09:47:25.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/generated/uapi/linux' 2024-05-08T09:47:25.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/generated/uapi' 2024-05-08T09:47:25.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/generated' 2024-05-08T09:47:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:25 smithi070 ceph-mon[29591]: pgmap v5771: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 233 op/s 2024-05-08T09:47:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:25 smithi172 ceph-mon[33377]: pgmap v5771: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 233 op/s 2024-05-08T09:47:25.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:25 smithi194 ceph-mon[33679]: pgmap v5771: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 233 op/s 2024-05-08T09:47:26.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/memory/renesas-rpc-if.h' 2024-05-08T09:47:26.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/memory' 2024-05-08T09:47:26.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/flat.h' 2024-05-08T09:47:26.093 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/getorder.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/statfs.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/audit_write.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/qrwlock.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/fb.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/kvm_para.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/vmlinux.lds.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/ide_iops.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/archrandom.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/hugetlb.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/seccomp.h' 2024-05-08T09:47:26.094 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/delay.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/syscall.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/vtime.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/shmparam.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/hardirq.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/rwonce.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/page.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/mmu.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/qspinlock_types.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/pci.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/uaccess.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/parport.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/logic_io.h' 2024-05-08T09:47:26.095 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/mcs_spinlock.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/resource.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/unaligned.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/mm_hooks.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/qrwlock_types.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/switch_to.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/syscalls.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/kmap_size.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/pci_iomap.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/cache.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/asm-offsets.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/checksum.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/msi.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/int-ll64.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitsperlong.h' 2024-05-08T09:47:26.096 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/memory_model.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/cmpxchg-local.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/pgtable-nopud.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/mmu_context.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/nommu_context.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/module.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/tlb.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/mshyperv.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/dma-mapping.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/module.lds.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/agp.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/pgtable-nop4d.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/ftrace.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/vdso/vsyscall.h' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/asm-generic/vdso' 2024-05-08T09:47:26.097 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/barrier.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/string.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/dma.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/access_ok.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/early_ioremap.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/irq.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/audit_signal.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/pgalloc.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/local.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/word-at-a-time.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/irq_regs.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/kvm_types.h' 2024-05-08T09:47:26.098 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/numa.h' 2024-05-08T09:47:26.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/xor.h' 2024-05-08T09:47:26.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bug.h' 2024-05-08T09:47:26.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/kdebug.h' 2024-05-08T09:47:26.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/div64.h' 2024-05-08T09:47:26.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/irqflags.h' 2024-05-08T09:47:26.099 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/exec.h' 2024-05-08T09:47:26.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/local64.h' 2024-05-08T09:47:26.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/softirq_stack.h' 2024-05-08T09:47:26.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/fixmap.h' 2024-05-08T09:47:26.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/spinlock_types.h' 2024-05-08T09:47:26.691 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/mmiowb.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/audit_read.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/asm-prototypes.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/cacheflush.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/compat.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/audit_change_attr.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/mmiowb_types.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/current.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/param.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/simd.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/trace_clock.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/pgtable-nopmd.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/futex.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/signal.h' 2024-05-08T09:47:26.692 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/percpu.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/hw_irq.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/device.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/audit_dir_write.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/irq_work.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/user.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/error-injection.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/preempt.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/atomic64.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/iomap.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/tlbflush.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/extable.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/spinlock.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/emergency-restart.h' 2024-05-08T09:47:26.693 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/export.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/sections.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/pgtable_uffd.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/vga.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/linkage.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/timex.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/atomic.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/hyperv-tlfs.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/vermagic.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/io.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/serial.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/cmpxchg.h' 2024-05-08T09:47:26.694 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/qspinlock.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/ioctl.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/builtin-ffs.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/ffz.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/fls.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/non-atomic.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/instrumented-non-atomic.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/arch_hweight.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/ext2-atomic.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/ffs.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/ext2-atomic-setbit.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/builtin-fls.h' 2024-05-08T09:47:26.695 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/const_hweight.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/builtin-__fls.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/__ffs.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/__fls.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/builtin-__ffs.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/instrumented-atomic.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/fls64.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/non-instrumented-non-atomic.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/hweight.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/sched.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/le.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/instrumented-lock.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/generic-non-atomic.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/lock.h' 2024-05-08T09:47:26.696 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops/atomic.h' 2024-05-08T09:47:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:26 smithi070 ceph-mon[29591]: pgmap v5772: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2024-05-08T09:47:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:26 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:26 smithi172 ceph-mon[33377]: pgmap v5772: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2024-05-08T09:47:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:26 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:26 smithi194 ceph-mon[33679]: pgmap v5772: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.6 MiB/s wr, 268 op/s 2024-05-08T09:47:27.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:26 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:27.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/asm-generic/bitops' 2024-05-08T09:47:27.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/set_memory.h' 2024-05-08T09:47:27.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/topology.h' 2024-05-08T09:47:27.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/bitops.h' 2024-05-08T09:47:27.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/Kbuild' 2024-05-08T09:47:27.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/asm-generic/kprobes.h' 2024-05-08T09:47:27.547 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/asm-generic' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MODIFY_LDT_SYSCALL' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_AUTHENC' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_EBPF_JIT' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_PTDUMP' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MD_AUTODETECT' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RPS' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ZSTD_DECOMPRESS' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SG_POOL' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/COMPAT_FOR_U64_ALIGNMENT' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_PETALYNX' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_NF_MANGLE' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AS_HAS_NON_CONST_LEB128' 2024-05-08T09:47:27.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_MISC' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCHED_CLUSTER' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_EISA' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_MQ_VIRTIO' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSTEM_TRUSTED_KEYS' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SPARSEMEM_VMEMMAP' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HOTPLUG_PCI' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HUGETLB_PAGE' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_CLS_CGROUP' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_USERPTR' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCHED_SMT' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/STRICT_MODULE_RWX' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_DYNAMIC_FTRACE_WITH_REGS' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BRANCH_PROFILE_NONE' 2024-05-08T09:47:27.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DUMMY_CONSOLE' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VHOST_MENU' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/E1000E' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/JBD2' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PAGE_TABLE_ISOLATION' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_UBSAN_SANITIZE_ALL' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCSI_VIRTIO' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_NET_CLASSID' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_XHCI_PCI' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_LTO_CLANG_THIN' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LEGACY_VSYSCALL_XONLY' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MIGRATION' 2024-05-08T09:47:27.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_PNP_BOOTP' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_DIRECT_GBPAGES' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CONTEXT_TRACKING_IDLE' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAS_IOMEM' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_USE_MEMREMAP_PROT' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RCU_NEED_SEGCBLIST' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_TARGET_SECMARK' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DECOMPRESS_LZMA' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RANDSTRUCT_NONE' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ISO9660_FS' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_SONY' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_X86' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_TARGET_CONNSECMARK' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAC80211_LEDS' 2024-05-08T09:47:27.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RETPOLINE' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HOTPLUG_CORE_SYNC_FULL' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_PROCESSOR' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ZONE_DMA32' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECURITY_SELINUX_BOOTPARAM' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/POWER_SUPPLY' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_INTEL_NHLT' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCHED_MC' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAVE_NMI_SAFE_CMPXCHG' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_NON_OVERLAPPING_ADDRESS_SPACE' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_MQ_STACKING' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLOCK' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_DISPLAY_HELPER' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_9P_VIRTIO' 2024-05-08T09:47:27.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_POSIX_CPU_TIMERS_TASK_WORK' 2024-05-08T09:47:27.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RELAY' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CFG80211_USE_KERNEL_REGDB_KEYS' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DQL' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SLAB_MERGE_DEFAULT' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/R8169' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_SMSC' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_USB' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NEED_PER_CPU_PAGE_FIRST_CHUNK' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LEDS_CLASS' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_CHELSIO' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOCALVERSION' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOCKD_V4' 2024-05-08T09:47:28.060 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_ACPI' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RFS_ACCEL' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_CHECK_BIOS_CORRUPTION' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KALLSYMS_ABSOLUTE_PERCPU' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_DYNAMIC_FTRACE_NO_PATCHABLE' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AMD_IOMMU' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/I8253_LOCK' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SOFTIRQ_ON_OWN_STACK' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_IOREMAP_PROT' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_USE_QUEUED_SPINLOCKS' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_LEDS' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_CORE' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_ACPI_CPUFREQ_CPB' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MIGHT_HAVE_PC_PARPORT' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IPV6' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VM_EVENT_COUNTERS' 2024-05-08T09:47:28.061 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HPET' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_EZCHIP' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HWDEP' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XZ_DEC_X86' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETPOLL' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CLOCKSOURCE_WATCHDOG_MAX_SKEW_US' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_MINIMUM_CPU_FAMILY' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_HMAC' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_ADAPTEC' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_SIS' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCCARD_NONSTATIC' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_PCI' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_REQUEST_TIMEOUT' 2024-05-08T09:47:28.062 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_TOUCHSCREEN' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUSPEND_POSSIBLE' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_CLOCKEVENTS_BROADCAST' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GLOB' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCHED_MM_CID' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_TIME_VSYSCALL' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRC32' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_BSG' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_EVDEV' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FS_MBCACHE' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_CUSTOM_SSDT_OVERLAYS' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_SYNOPSYS' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_MARVELL' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEVTMPFS_MOUNT' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANT_GENERAL_HUGETLB' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_CLOCKEVENTS' 2024-05-08T09:47:28.063 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROFILING' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_ANNOUNCE_NEW_DEVICES' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_RMAP' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_STACK_USAGE' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ATA_ACPI' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FIXED_PHY' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CARDBUS' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_UNRET_ENTRY' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NAMESPACES' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_RETURN_THUNK' 2024-05-08T09:47:28.064 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SATA_HOST' 2024-05-08T09:47:28.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_RALINK' 2024-05-08T09:47:28.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XTABLES' 2024-05-08T09:47:28.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_COMPRESS_ERROR' 2024-05-08T09:47:28.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_NO_PROFILE_FN_ATTR' 2024-05-08T09:47:28.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_IDLE_GOV_MENU' 2024-05-08T09:47:28.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_TEHUTI' 2024-05-08T09:47:28.065 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_VMX_FEATURE_NAMES' 2024-05-08T09:47:28.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: osdmap e439: 12 total, 12 up, 12 in 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:27 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: osdmap e439: 12 total, 12 up, 12 in 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:27 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi194 to 176.4M 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi194 to 185069158: error parsing value: Value '185069158' is below minimum 939524096 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: osdmap e439: 12 total, 12 up, 12 in 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:27 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:28.643 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_CT_NETLINK' 2024-05-08T09:47:28.643 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PREVENT_FIRMWARE_BUILD' 2024-05-08T09:47:28.644 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AMD_NB' 2024-05-08T09:47:28.644 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_PTP_CLASSIFY' 2024-05-08T09:47:28.644 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RD_LZO' 2024-05-08T09:47:28.644 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FUNCTION_ALIGNMENT_16B' 2024-05-08T09:47:28.644 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/STRICT_DEVMEM' 2024-05-08T09:47:28.644 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_MYRI' 2024-05-08T09:47:28.644 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAGIC_SYSRQ' 2024-05-08T09:47:28.644 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PM_SLEEP_SMP' 2024-05-08T09:47:28.644 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BQL' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_KERNEL' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFIVAR_FS' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MODULE_FORCE_UNLOAD' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_DMA_ADDR_T_64BIT' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_STRICT_KERNEL_RWX' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_TIMER' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_CTL_FAST_LOOKUP' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_BUG' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_INTEL_TSX_MODE_OFF' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/kernel.release' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MODULE_UNLOAD' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NR_CPUS' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IRQ_MSI_IOMMU' 2024-05-08T09:47:28.645 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XPS' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_RUNTIME_MAP' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_NAT' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CALL_THUNKS' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_JACK' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IOMMU_API' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EARLY_PRINTK_USB' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ASSOCIATIVE_ARRAY' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSCTL_EXCEPTION_TRACE' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LDISC_AUTOLOAD' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HUGETLBFS' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VGA_CONSOLE' 2024-05-08T09:47:28.646 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIO_LIBPS2' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KEXEC' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETWORK_FILESYSTEMS' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AS_IS_GNU' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_PREEMPT_TIMEOUT_COMPUTE' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FONT_8x16' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCSPKR_PLATFORM' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NR_CPUS_RANGE_END' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/POSIX_CPU_TIMERS_TASK_WORK' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CONSOLE_LOGLEVEL_QUIET' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_HARDLOCKUP_DETECTOR_BUDDY' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_WX' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DYNAMIC_SIGFRAME' 2024-05-08T09:47:28.647 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_PMEM_API' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CHECK_SIGNATURE' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMA_VIRTUAL_CHANNELS' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UNIX98_PTYS' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HARDIRQS_SW_RESEND' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_PCM' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XFRM' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_TTM' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BINFMT_MISC' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MMU' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_DMA_SHARED_BUFFER' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INET_TABLE_PERTURB_ORDER' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HZ_1000' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_VERSION_TEXT' 2024-05-08T09:47:28.648 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_HID' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_PCI' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/I2C_COMPAT' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCSI_CONSTANTS' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KRETPROBE_ON_RETHOOK' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FAT_FS' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_CONNTRACK_SIP' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCHED_MC_PRIO' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ATA' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ZISOFS' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCIEASPM' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PAGE_SIZE_LESS_THAN_64KB' 2024-05-08T09:47:28.649 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_DRIVERS' 2024-05-08T09:47:29.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: pgmap v5774: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 170 op/s 2024-05-08T09:47:29.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:47:29.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:47:29.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:47:29.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:47:29.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:28 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: pgmap v5774: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 170 op/s 2024-05-08T09:47:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:47:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:47:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:47:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:47:29.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:28 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: pgmap v5774: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.6 MiB/s wr, 170 op/s 2024-05-08T09:47:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi172 to 176.4M 2024-05-08T09:47:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi172 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-08T09:47:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T09:47:29.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:47:29.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:47:29.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:28 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEFAULT_SECURITY_SELINUX' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMA_ENGINE' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PAHOLE_VERSION' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAGIC_SYSRQ_DEFAULT_ENABLE' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TIMERFD' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_SUP_CENTAUR' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CDROM' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_SUP_ZHAOXIN' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_HOTPLUG_IOAPIC' 2024-05-08T09:47:29.310 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_PREEMPT_TIMEOUT' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SHMEM' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_BUDDY' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DM_ZERO' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EDAC_ATOMIC_SCRUB' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RD_BZIP2' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANT_DEFAULT_BPF_JIT' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_SEQIV' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_LIB_SHA1' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSVIPC_COMPAT' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_PRINTER' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_SYSTEM_POWER_STATES_SUPPORT' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_EXTENDED_PLATFORM' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_TI' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MPILIB' 2024-05-08T09:47:29.311 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CALL_PADDING' 2024-05-08T09:47:29.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HDA' 2024-05-08T09:47:29.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_LOGITECH' 2024-05-08T09:47:29.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAGIC_SYSRQ_SERIAL' 2024-05-08T09:47:29.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_OPTPROBES' 2024-05-08T09:47:29.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_FREQ' 2024-05-08T09:47:29.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HOTPLUG_SMT' 2024-05-08T09:47:29.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SPARSEMEM_EXTREME' 2024-05-08T09:47:29.312 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_CYPRESS' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPUSETS' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FAIR_GROUP_SCHED' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_INTEL' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECCOMP_FILTER' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NFS_V3_ACL' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RUNTIME_TESTING_MENU' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ATA_SFF' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_CPU_FINALIZE_INIT' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOG_BUF_SHIFT' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_CGROUP_IOLATENCY' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TASKSTATS' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NVMEM_SYSFS' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_SIG2' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CONTEXT_TRACKING' 2024-05-08T09:47:29.313 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_AKCIPHER2' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_64_ACPI_NUMA' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_DISPLAY_HDCP_HELPER' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IOSF_MBI' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_CRC32C' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_LIB_UTILS' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_PANEL_BRIDGE' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/COMPAT_32BIT_TIME' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_MANAGER' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_FUNCTION_TRACER' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_TIMESLICE_DURATION' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MISC_FILESYSTEMS' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FTRACE' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_STMICRO' 2024-05-08T09:47:29.314 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_SHA512' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAC80211_RC_MINSTREL' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KERNEL_XZ' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_DEC' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PTP_1588_CLOCK_OPTIONAL' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_PCSPKR_PLATFORM' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_ROCKER' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/8139TOO_PIO' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAILBOX' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HZ' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RCU_CPU_STALL_TIMEOUT' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TIGON3' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LSM_MMAP_MIN_ADDR' 2024-05-08T09:47:29.315 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PREEMPT_BUILD' 2024-05-08T09:47:29.316 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_PREEMPT_DYNAMIC' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MODPROBE_PATH' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAC80211_HAS_RC' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_MEMBARRIER_SYNC_CORE' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SPECULATION_MITIGATIONS' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOCK_DEBUGGING_SUPPORT' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FORCEDETH' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ATA_BMDMA' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_8390' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TRACE_IRQFLAGS_NMI_SUPPORT' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FONT_AUTOSELECT' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_IO_APIC' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRASH_CORE' 2024-05-08T09:47:29.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_STUB' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_INTERSIL' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/COMPAT_BINFMT_ELF' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_5LEVEL' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_GENIV' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOCK_MM_AND_FIND_VMA' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_DYNAMIC_FTRACE_WITH_DIRECT_CALLS' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EXT4_USE_FOR_EXT2' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSVIPC_SYSCTL' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_SUNPLUS' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_MC146818_LIB' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DM_MIRROR' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECURITY' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DCACHE_WORD_ACCESS' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_SR' 2024-05-08T09:47:29.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BASE_SMALL' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PRINTK' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_PNP' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FIX_EARLYCON_MEM' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_VSYSCALL_EMULATION' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_AUTOSUSPEND_DELAY' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_THREAD_STRUCT_WHITELIST' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LD_IS_BFD' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_DEBUG' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_LPSS' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_NAT_IRC' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_TARGET_LOG' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_RX_BUSY_POLL' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANTS_NO_INSTR' 2024-05-08T09:47:29.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MMAP_RND_BITS_MIN' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NFS_V4' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETCONSOLE' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_ANCHOR' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_CORE_CONSOLE' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_AEAD2' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PARAVIRT_CLOCK' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_KASAN_GENERIC' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IRQ_DOMAIN_HIERARCHY' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CONSOLE_LOGLEVEL_DEFAULT' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VMAP_STACK' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANT_COMPAT_IPC_PARSE_VERSION' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_DETECT_IRQ' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_IRQ_RESERVATION_MODE' 2024-05-08T09:47:29.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VT_CONSOLE_SLEEP' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_CMOV' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BINFMT_ELF' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/COMPACT_UNEVICTABLE_DEFAULT' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_FS_ALLOW_ALL' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_EXAR' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NLS' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_PROCESSOR_CSTATE' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_IP_TUNNEL' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XFRM_ALGO' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IO_URING' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FUNCTION_PADDING_CFI' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HSU_DMA' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_GIGANTIC_PAGE' 2024-05-08T09:47:29.959 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_IRQ_PROBE' 2024-05-08T09:47:29.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB' 2024-05-08T09:47:29.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_HANDSHAKE' 2024-05-08T09:47:29.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_PROC_KCORE_TEXT' 2024-05-08T09:47:29.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_A4TECH' 2024-05-08T09:47:29.960 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_OHCI_HCD_PCI' 2024-05-08T09:47:30.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:29 smithi070 ceph-mon[29591]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:47:30.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:29 smithi070 ceph-mon[29591]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:47:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:29 smithi172 ceph-mon[33377]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:47:30.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:29 smithi172 ceph-mon[33377]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:47:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:29 smithi194 ceph-mon[33679]: Adjusting osd_memory_target on smithi070 to 176.4M 2024-05-08T09:47:30.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:29 smithi194 ceph-mon[33679]: Unable to set osd_memory_target on smithi070 to 185047654: error parsing value: Value '185047654' is below minimum 939524096 2024-05-08T09:47:30.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCIE_PME' 2024-05-08T09:47:30.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_NET' 2024-05-08T09:47:30.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_JITTERENTROPY' 2024-05-08T09:47:30.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_CORRECT_STACKTRACE_ON_KRETPROBE' 2024-05-08T09:47:30.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_MD5' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_ZERO_CALL_USED_REGS' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TCP_MD5SIG' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_MANAGER_DISABLE_TESTS' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_EGRESS' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_NF_TARGET_REJECT' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TMPFS_POSIX_ACL' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_NMI_SAFE_THIS_CPU_OPS' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_LIB_AES' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_MMIOTRACE_SUPPORT' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_POLL_CONTROLLER' 2024-05-08T09:47:30.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_TRANSPARENT_HUGEPAGE' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/64BIT' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_GHASH' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FONT_SUPPORT' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_SMP_IDLE_THREAD' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_GYRATION' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RFKILL_LEDS' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TIME_NS' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/8139TOO' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HOTPLUG_CPU' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_FAST_GUP' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RWSEM_SPIN_ON_OWNER' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SLUB_CPU_PARTIAL' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NFS_FS' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_DEBUG_FPU' 2024-05-08T09:47:30.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/THERMAL_GOV_USER_SPACE' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_IDLE_GOV_HALTPOLL' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_EARLYCON' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_LITEX' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMA_ACPI' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_NAT' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_FREQ_GOV_SCHEDUTIL' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANTS_DYNAMIC_TASK_STRUCT' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP6_NF_MATCH_IPV6HEADER' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_ST' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_CAVIUM' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_DWLIB' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MMAP_RND_BITS' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NODES_SHIFT' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_IRQ_TIME_ACCOUNTING' 2024-05-08T09:47:30.714 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_PCC' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_CALL_THUNKS' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IOMMU_IO_PGTABLE' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_MROUTE_COMMON' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PKCS7_MESSAGE_PARSER' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TASK_DELAY_ACCT' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XFRM_USER' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RING_BUFFER' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_PCM_TIMER' 2024-05-08T09:47:30.715 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/YENTA_TI' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_TSC' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_PENDING_IRQ' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NR_CPUS_DEFAULT' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XZ_DEC_ARM' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/QUEUED_SPINLOCKS' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_AC' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_VMASTER' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_INTEL_DSP_CONFIG' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_PERF_EVENTS_NMI' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ELF_CORE' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_SEQ_DEVICE' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MODULES_TREE_LOOKUP' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KPROBES' 2024-05-08T09:47:30.716 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_LOG_ARP' 2024-05-08T09:47:30.717 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XFRM_ESP' 2024-05-08T09:47:30.717 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UNIX' 2024-05-08T09:47:30.717 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSTEM_DATA_VERIFICATION' 2024-05-08T09:47:30.717 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KERNFS' 2024-05-08T09:47:30.717 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MULTIUSER' 2024-05-08T09:47:30.717 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INET_TUNNEL' 2024-05-08T09:47:31.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:30 smithi070 ceph-mon[29591]: pgmap v5775: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.3 MiB/s wr, 330 op/s 2024-05-08T09:47:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:30 smithi172 ceph-mon[33377]: pgmap v5775: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.3 MiB/s wr, 330 op/s 2024-05-08T09:47:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:30 smithi194 ceph-mon[33679]: pgmap v5775: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 4.3 MiB/s wr, 330 op/s 2024-05-08T09:47:31.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_DOMAINS' 2024-05-08T09:47:31.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HDA_I915' 2024-05-08T09:47:31.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_IBRS_ENTRY' 2024-05-08T09:47:31.747 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/STANDALONE' 2024-05-08T09:47:31.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/YENTA' 2024-05-08T09:47:31.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_MIXED_BREAKPOINTS_REGS' 2024-05-08T09:47:31.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MQ_IOSCHED_DEADLINE' 2024-05-08T09:47:31.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_DLINK' 2024-05-08T09:47:31.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_NAT_FTP' 2024-05-08T09:47:31.748 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_MOVE_PUD' 2024-05-08T09:47:31.749 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_PERF_EVENTS' 2024-05-08T09:47:31.749 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN' 2024-05-08T09:47:31.749 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250' 2024-05-08T09:47:31.749 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_REROUTE_FOR_BROKEN_BOOT_IRQS' 2024-05-08T09:47:31.749 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KEXEC_CORE' 2024-05-08T09:47:31.749 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AGP' 2024-05-08T09:47:31.749 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_ENABLE_SPLIT_PMD_PTLOCK' 2024-05-08T09:47:31.749 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAS_DMA' 2024-05-08T09:47:31.750 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DNS_RESOLVER' 2024-05-08T09:47:31.750 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_KASAN' 2024-05-08T09:47:31.750 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/THERMAL' 2024-05-08T09:47:31.750 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_BROADCOM' 2024-05-08T09:47:31.750 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/QUEUED_RWLOCKS' 2024-05-08T09:47:31.751 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PACKET' 2024-05-08T09:47:31.751 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_CCM' 2024-05-08T09:47:31.751 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HOTPLUG_CORE_SYNC_DEAD' 2024-05-08T09:47:31.751 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_BUG_RELATIVE_POINTERS' 2024-05-08T09:47:31.751 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_SET_DIRECT_MAP' 2024-05-08T09:47:31.751 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_KEYBOARD' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USER_STACKTRACE_SUPPORT' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_EMATCH' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_LOG_SYSLOG' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_SYNAPTICS' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCMCIA_LOAD_CIS' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MQ_IOSCHED_KYBER' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_FLOW_LIMIT' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_EXIT_THREAD' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_FREQ_GOV_COMMON' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROC_SYSCTL' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DYNAMIC_EVENTS' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INET6_AH' 2024-05-08T09:47:31.752 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_LIFEBOOK' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_DEVICE' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_IDLE' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PHYLIB' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TASKS_RCU_GENERIC' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_GCM' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AS_AVX512' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_GEM_SHMEM_HELPER' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HIBERNATION_HEADER' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FAILOVER' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_REGS_AND_STACK_ACCESS_API' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TTY' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HARDLOCKUP_CHECK_TIMESTAMP' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MDIO_DEVRES' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM' 2024-05-08T09:47:31.753 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_ESPFIX64' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DECOMPRESS_LZO' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CLKBLD_I8253' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_RNG' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_VERBOSE_PROCFS' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_SHARE_IRQ' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_SPARSEKMAP' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_KMSAN' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/COMPAT' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_OBJTOOL_NOP_MCOUNT' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PERF_EVENTS_INTEL_UNCORE' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_I825XX' 2024-05-08T09:47:31.754 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_QUALCOMM' 2024-05-08T09:47:31.755 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_FUJITSU' 2024-05-08T09:47:31.755 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PANTHERLORD_FF' 2024-05-08T09:47:31.755 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_APPLE' 2024-05-08T09:47:31.755 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WERROR' 2024-05-08T09:47:31.755 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_PREEMPT_DYNAMIC_CALL' 2024-05-08T09:47:31.755 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_DYNAMIC_FTRACE' 2024-05-08T09:47:31.755 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/THERMAL_HWMON' 2024-05-08T09:47:31.755 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MICROCODE_AMD' 2024-05-08T09:47:32.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_ARCH_HAS_HCD' 2024-05-08T09:47:32.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSTEM_TRUSTED_KEYRING' 2024-05-08T09:47:32.774 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DECOMPRESS_LZ4' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PATA_OLDPIIX' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MODULE_COMPRESS_NONE' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANT_BATCHED_UNMAP_TLB_FLUSH' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RATIONAL' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/auto.conf' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SBITMAP' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IPV6_SIT' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEFAULT_CUBIC' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UPROBE_EVENTS' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SPARSEMEM_ENABLE' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FW_LOADER' 2024-05-08T09:47:32.775 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_STACKPROTECTOR' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MMU_GATHER_RCU_TABLE_FREE' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_GCOV_PROFILE_ALL' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ZLIB_DEFLATE' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_INGRESS' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_FORCE_PROBE' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_HARDLOCKUP_DETECTOR_PERF' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_DEBUGCTLMSR' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_ITE' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_DEFRAG_IPV6' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PM_SLEEP_DEBUG' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/OLD_SIGSUSPEND3' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/COREDUMP' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_HASH_INFO' 2024-05-08T09:47:32.776 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_RDMA' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PGTABLE_LEVELS' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAC80211_RC_DEFAULT_MINSTREL' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CORE_DUMP_DEFAULT_ELF_HEADERS' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KPROBE_EVENTS' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_PENSANDO' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PRINTK_TIME' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_TRANSPARENT_HUGEPAGE_PUD' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_STRICT_MODULE_RWX' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KALLSYMS_ALL' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KERNEL_GZIP' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/COMPACTION' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_STRNLEN_USER' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HIBERNATION_SNAPSHOT_DEV' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PM_SLEEP' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_ALACRITECH' 2024-05-08T09:47:32.777 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_CMPXCHG_LOCAL' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FS_IOMAP' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_PARANOID_L1D_FLUSH' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCHED_INFO' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_SECCOMP_FILTER' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ASN1' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FUNCTION_ALIGNMENT' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_EZKEY' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_JACK_INPUT_DEV' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYN_COOKIES' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IOMMU_DEFAULT_DMA_LAZY' 2024-05-08T09:47:32.778 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MEMBARRIER' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XZ_DEC_IA64' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_INT128' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ATA_PIIX' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_PANEL' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ATA_FORCE' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_MANY_PORTS' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_HASH' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_PCI_IOMAP' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_OHCI_LITTLE_ENDIAN' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_INPUT' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RFKILL_INPUT' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/POSIX_TIMERS' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_NR_UARTS' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_PCILIB' 2024-05-08T09:47:32.779 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_UPROBES' 2024-05-08T09:47:32.780 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_DAVICOM' 2024-05-08T09:47:32.780 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_CONNTRACK' 2024-05-08T09:47:32.780 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_9P_FD' 2024-05-08T09:47:33.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:32 smithi070 ceph-mon[29591]: pgmap v5776: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-05-08T09:47:33.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:32 smithi172 ceph-mon[33377]: pgmap v5776: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-05-08T09:47:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:32 smithi194 ceph-mon[33679]: pgmap v5776: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 3.7 MiB/s wr, 283 op/s 2024-05-08T09:47:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_SCH_FIFO' 2024-05-08T09:47:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SATA_MOBILE_LPM_POLICY' 2024-05-08T09:47:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VFAT_FS' 2024-05-08T09:47:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_MQ_PCI' 2024-05-08T09:47:33.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETDEVICES' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_CPU_FREQ_PSS' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECCOMP' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_DRBG_MENU' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_CONTEXT_TRACKING_USER' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UNINLINE_SPIN_UNLOCK' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IO_WQ' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TMPFS_XATTR' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WATCHDOG' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_MSI' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KALLSYMS' 2024-05-08T09:47:33.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HOTPLUG_SPLIT_STARTUP' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FSNOTIFY' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_CONNTRACK_IRC' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_NOINSTR_HACK' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SKB_EXTENSIONS' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_SHA256' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WATCHDOG_HANDLE_BOOT_ENABLED' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FIRMWARE_MEMMAP' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_SYNAPTICS_SMBUS' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_MOD_ARCH_SPECIFIC' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIO_I8042' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETWORK_SECMARK' 2024-05-08T09:47:33.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/I2C_SMBUS' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_MEMORY_INIT' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/I2C_HID' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UNIX_SCM' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_TARGET_MASQUERADE' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/STACKTRACE_SUPPORT' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_MAX_REQUEST_BUSYWAIT' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PTP_1588_CLOCK_KVM' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_BUILDTIME_MCOUNT_SORT' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LD_ORPHAN_WARN_LEVEL' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCSI_SPI_ATTRS' 2024-05-08T09:47:33.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MMU_LAZY_TLB_REFCOUNT' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_VIRTIO_GPU_KMS' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_SYNC_CORE_BEFORE_USERMODE' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PAGE_SIZE_LESS_THAN_256KB' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BUILD_SALT' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_ATS' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NEED_PER_CPU_EMBED_FIRST_CHUNK' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_FUNCTION_ERROR_INJECTION' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_PASID' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PTDUMP_CORE' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MDIO_BUS' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ISA_DMA_API' 2024-05-08T09:47:33.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_ADMTEK' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_LPIT' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INTEL_IOMMU_FLOPPY_WA' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NEED_DMA_MAP_STATE' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCSI_LOWLEVEL' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AS_GFNI' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_DEVMEM_IS_ALLOWED' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UCS2_STRING' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_PAGE_TABLE_CHECK' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_RENESAS' 2024-05-08T09:47:33.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_UNSTABLE_SCHED_CLOCK' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_EMATCH_STACK' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RANDOMIZE_KSTACK_OFFSET' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_PURELIFI' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_DEBUG_VM_PGTABLE' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/COMPAT_32' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ROOT_NFS' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_FREEZER' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_NAT_MASQUERADE' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KALLSYMS_BASE_RELATIVE' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/QUOTA_NETLINK_INTERFACE' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_NETLINK_LOG' 2024-05-08T09:47:33.425 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_MENU' 2024-05-08T09:47:34.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_REALTEK' 2024-05-08T09:47:34.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_HUGETLB' 2024-05-08T09:47:34.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_KMAP_LOCAL_FORCE_MAP' 2024-05-08T09:47:34.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLOCK_HOLDER_DEPRECATED' 2024-05-08T09:47:34.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_VIDEO' 2024-05-08T09:47:34.048 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_USE_QUEUED_RWLOCKS' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_OKI' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TIGON3_HWMON' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HPET_TIMER' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AUXILIARY_BUS' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_QUANTENNA' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_DM' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_SCHED' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_STRNCPY_FROM_USER' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_ROUTE_MULTIPATH' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_PNP_RARP' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_PREL32_RELOCATIONS' 2024-05-08T09:47:34.049 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_VMAP_STACK' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TICK_CPU_ACCOUNTING' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/THERMAL_DEFAULT_GOV_STEP_WISE' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_SUP_INTEL' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BACKLIGHT_CLASS_DEVICE' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_MISC' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_SOCIONEXT' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LLD_VERSION' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ASM_MODVERSIONS' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_MATCH_POLICY' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MMU_NOTIFIER' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HWMON' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RPCSEC_GSS_KRB5' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_TOPSEED' 2024-05-08T09:47:34.050 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_USERFAULT_AUTOSUSPEND' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECURITY_SELINUX' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AUTOFS_FS' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_IS_GCC' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MICROCODE_INTEL' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PPS' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_BUGVERBOSE' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IRQ_WORK' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AF_UNIX_OOB' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NVMEM' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_FUNCTION_ARG_ACCESS_API' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MODULES' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FW_CACHE' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_SKCIPHER2' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_MOVE_PMD' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAX_SKB_FRAGS' 2024-05-08T09:47:34.051 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FUTEX_PI' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FS_POSIX_ACL' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_MMCONFIG' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XZ_DEC_SPARC' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FUTEX' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_MEMORY_FAILURE' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_HUGE_VMAP' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TREE_SRCU' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_ASM_GOTO_OUTPUT' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_QLOGIC' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_LIB_BLAKE2S_GENERIC' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NVRAM' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECTION_MISMATCH_WARN_ONLY' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAGIC_SYSRQ_SERIAL_SEQUENCE' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_SILABS' 2024-05-08T09:47:34.052 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HIBERNATION_POSSIBLE' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_NETERION' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_SOFTIRQ_ON_OWN_STACK' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INOTIFY_USER' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_LIB_POLY1305_RSIZE' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANT_HUGE_PMD_SHARE' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_PROC_FS' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PATA_AMD' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETLABEL' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/OPTPROBES' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HW_RANDOM_VIA' 2024-05-08T09:47:34.053 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RELOCATABLE' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_L1_CACHE_SHIFT' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MEMFD_CREATE' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_BRIDGE' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XZ_DEC_ARMTHUMB' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EXTRA_FIRMWARE' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_KGDB' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_DXE_MEM_ATTRIBUTES' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CONTEXT_SWITCH_TRACER' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ACPI_APEI' 2024-05-08T09:47:34.584 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SATA_PMP' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCHED_OMIT_FRAME_POINTER' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FWNODE_MDIO' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_SOLARFLARE' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_MICROCHIP' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_MIXED' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HDA_POWER_SAVE_DEFAULT' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEVPORT' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_SEQ_DUMMY' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/POSIX_MQUEUE' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_ROUTE_VERBOSE' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_VIRT_CPU_ACCOUNTING_GEN' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_LIVEPATCH' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEFAULT_MMAP_MIN_ADDR' 2024-05-08T09:47:34.585 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_MATCH_ADDRTYPE' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NEED_SG_DMA_LENGTH' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_MARVELL' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LZO_DECOMPRESS' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_IOPL_IOPERM' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_RUNTIME_WRAPPERS' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_LOG_IPV4' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TASK_XACCT' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_SD' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CFG80211' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NFS_ACL_SUPPORT' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_FF_MEMLESS' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XZ_DEC_BCJ' 2024-05-08T09:47:34.586 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TMPFS' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_CHICONY' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_REDRAGON' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_TI' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_MICROSOFT' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SWAP' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_SYSCALL_WRAPPER' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MIGHT_HAVE_PC_SERIO' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_ATHEROS' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BCMA_POSSIBLE' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_NTRIG' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_RETHOOK' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_RSI' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_NOINSTR_VALIDATION' 2024-05-08T09:47:34.587 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PANIC_ON_OOPS_VALUE' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CFG80211_DEFAULT_PS' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_CADENCE' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_I2C_AND_SPI' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IRQ_DOMAIN' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_EARLYCON' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MIGHT_HAVE_ACPI_PDC' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_XIRCOM' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HDMI' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_FS' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UPROBES' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NFS_V2' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_BROCADE' 2024-05-08T09:47:34.588 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NLS_ASCII' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_TABLE_UPGRADE' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_DMA' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_LEGACY_TABLES_LOOKUP' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAS_IOPORT' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_ADD_PAGES' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECURITY_NETWORK' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_NET_DRIVERS' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BPF' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFS_SUPPORT' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_PERF_REGS' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCMCIA' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PM_TRACE_RTC' 2024-05-08T09:47:34.589 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_BGRT' 2024-05-08T09:47:35.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:34 smithi070 ceph-mon[29591]: pgmap v5777: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.5 MiB/s wr, 264 op/s 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SURFACE_PLATFORMS' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DUMMY_CONSOLE_ROWS' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCSI_COMMON' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_LTO_CLANG' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SOUND' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_MONTEREY' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_CGROUP' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_ISA_DMA' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_INTF_DEV' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_KERNEL_IBT' 2024-05-08T09:47:35.177 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_NF_NAT' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DNOTIFY' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XXHASH' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RANDOMIZE_BASE' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRC32_SLICEBY8' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_OPTIMIZE_FOR_PERFORMANCE' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MD' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BSD_PROCESS_ACCT' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SPARSEMEM_VMEMMAP_ENABLE' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SUSPEND_FREEZER' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PERF_EVENTS_INTEL_CSTATE' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_IMPLICIT_FALLTHROUGH' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_CLS_ACT' 2024-05-08T09:47:35.178 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_SANE_STACKPROTECTOR' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_MISC' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_USE_SYM_ANNOTATIONS' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KPROBES_ON_FTRACE' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HYPERVISOR_GUEST' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KCMP' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTL_CARDS' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_DYNAMIC_FTRACE_WITH_ARGS' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FUNCTION_PADDING_BYTES' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EEEPC_LAPTOP' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_FORTIFY_SOURCE' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECURITY_SELINUX_AVC_STATS' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XFRM_AH' 2024-05-08T09:47:35.179 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/STACKDEPOT' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_NONLEAF_PMD_YOUNG' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTUALIZATION' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INET' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_CPPC_LIB' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_COMMON' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_ENGLEDER' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANT_OLD_COMPAT_IPC' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_NS' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_MCE_THRESHOLD' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_LOOP_MIN_COUNT' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROC_PAGE_MONITOR' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_ALPS' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_ISOLATION' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIO_SERPORT' 2024-05-08T09:47:35.180 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_DISPLAY_HDMI_HELPER' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NFS_USE_KERNEL_DNS' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_NMI' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PERF_EVENTS_AMD_UNCORE' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIDEO_CMDLINE' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PREEMPT_VOLUNTARY' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KERNEL_ZSTD' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP6_NF_FILTER' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NLATTR' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CHR_DEV_SG' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROC_VMCORE' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_MCE' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_ENABLE_HUGEPAGE_MIGRATION' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_FREQ_GOV_PERFORMANCE' 2024-05-08T09:47:35.181 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_SYSTOHC' 2024-05-08T09:47:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_XHCI_HCD' 2024-05-08T09:47:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/YENTA_TOSHIBA' 2024-05-08T09:47:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYMBOLIC_ERRNAME' 2024-05-08T09:47:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/YENTA_RICOH' 2024-05-08T09:47:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KRETPROBES' 2024-05-08T09:47:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANT_OPTIMIZE_VMEMMAP' 2024-05-08T09:47:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INITRAMFS_PRESERVE_MTIME' 2024-05-08T09:47:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X509_CERTIFICATE_PARSER' 2024-05-08T09:47:35.182 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_PCI_LEGACY' 2024-05-08T09:47:35.182 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:34 smithi172 ceph-mon[33377]: pgmap v5777: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.5 MiB/s wr, 264 op/s 2024-05-08T09:47:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:34 smithi194 ceph-mon[33679]: pgmap v5777: 129 pgs: 129 active+clean; 2.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 3.5 MiB/s wr, 264 op/s 2024-05-08T09:47:35.984 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-08T09:47:35.985 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.7 2024-05-08T09:47:35.986 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:47:36.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_ACPI_TABLE_UPGRADE' 2024-05-08T09:47:36.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO' 2024-05-08T09:47:36.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_NUMA' 2024-05-08T09:47:36.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_SUPPORT' 2024-05-08T09:47:36.325 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SLUB' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_CONSOLE' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AUDIT' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CFG80211_REQUIRE_SIGNED_REGDB' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_SEQUENCER' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IRQ_FORCED_THREADING' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_CPUID' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BUG' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_SEQ_HRTIMER_DEFAULT' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_RANDOMIZE_KSTACK_OFFSET' 2024-05-08T09:47:36.326 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_ENTRY_PADDING' 2024-05-08T09:47:36.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_MSI_IRQ' 2024-05-08T09:47:36.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_JOYSTICK' 2024-05-08T09:47:36.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_NO_ARRAY_BOUNDS' 2024-05-08T09:47:36.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_DEVRES' 2024-05-08T09:47:36.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/QUOTACTL' 2024-05-08T09:47:36.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LZ4_DECOMPRESS' 2024-05-08T09:47:36.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MTRR' 2024-05-08T09:47:36.327 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NLS_CODEPAGE_437' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PTP_1588_CLOCK' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_SELFTESTS' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_3COM' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FIB_RULES' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TREE_RCU' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROC_FS' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_HIDDEV' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_MON' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_LOGIPS2PP' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HDA_CORE' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_VIVALDIFMAP' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BITREVERSE' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_GETTIMEOFDAY' 2024-05-08T09:47:36.328 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCSI_MOD' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_ADVANCED_ROUTER' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_INTEL_MEMORY_PROTECTION_KEYS' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SSB_POSSIBLE' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_MEM_ENCRYPT' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_RSEQ' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_MANAGER2' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMIID' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_TRACER' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_MSR' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ZLIB_INFLATE' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCHED_HRTICK' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LEGACY_TIOCSTI' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_PCI_LIB_LEGACY' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FRAME_WARN' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HDA_INTEL' 2024-05-08T09:47:36.329 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMA_OPS' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_UACCESS_VALIDATION' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_SAMSUNG' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_CGROUP_IOCOST' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TASK_IO_ACCOUNTING' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_DRBG_HMAC' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BINARY_PRINTF' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_USE_BUILTIN_BSWAP' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RCU_TRACE' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/OBJTOOL' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GRO_CELLS' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_LIB' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PANIC_TIMEOUT' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_TABLET' 2024-05-08T09:47:36.330 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_BUTTON' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HDA_COMPONENT' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GCC_VERSION' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_CTR' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_SMBUS' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INET6_ESP' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_FAST_MULTIPLIER' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECURITY_SELINUX_DEVELOP' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KEYBOARD_ATKBD' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCSI' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_IOMAP' 2024-05-08T09:47:36.331 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HDA_HWDEP' 2024-05-08T09:47:36.453 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:47:36.864 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:36 smithi070 ceph-mon[29591]: pgmap v5778: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 154 op/s 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_AGERE' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INTEGRITY_AUDIT' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RD_LZMA' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_THERMAL' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_MMAP_RND_COMPAT_BITS' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_WORKING_NOSANITIZE_ADDRESS' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PERF_EVENTS' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_QUIRKS' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CLANG_VERSION' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_MPPARSE' 2024-05-08T09:47:36.988 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AUDIT_ARCH' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_STOP_TIMEOUT' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_CMAC' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MESSAGE_LOGLEVEL_DEFAULT' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_PCMCIA' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ILLEGAL_POINTER_VALUE' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INIT_STACK_NONE' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_BYD' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_DEBUG_VIRTUAL' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UNWINDER_ORC' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_CONTEXT_TRACKING_USER_OFFSTACK' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRC_CCITT' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BASE_FULL' 2024-05-08T09:47:36.989 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_C_RECORDMCOUNT' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_ASIX' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_HUAWEI' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_VERTEXCOM' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCSI_DMA' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RD_XZ' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSFS_SYSCALL' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INTERVAL_TREE' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_MDIO' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PATA_SCH' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ASYMMETRIC_KEY_TYPE' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_FTRACE_MCOUNT_RECORD' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIO' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_SET_MEMORY' 2024-05-08T09:47:36.990 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/JUMP_LABEL' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_INTERNODE_CACHE_SHIFT' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/REALTEK_PHY' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EXT4_FS_POSIX_ACL' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PHYS_ADDR_T_64BIT' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ACPI_APEI_NMI' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/STACKPROTECTOR_STRONG' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_PM' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP6_NF_IPTABLES' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAS_IOPORT_MAP' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HW_RANDOM' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_TULIP' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_SCHED' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSVIPC' 2024-05-08T09:47:36.991 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WMI_BMOF' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_SLS' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FAT_DEFAULT_CODEPAGE' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_MULTIPLE_TABLES' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/STACKTRACE' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NR_CPUS_RANGE_BEGIN' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/YENTA_ENE_TUNE' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_MICREL' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_LOOP' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_MCE_AMD' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_CONTAINER' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_PCI' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WIRELESS' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FILE_LOCKING' 2024-05-08T09:47:36.992 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_MD' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_FREQ_GOV_ATTR_SET' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_MROUTE' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMI' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AS_TPAUSE' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MMU_GATHER_MERGE_VMAS' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HOTPLUG_PARALLEL' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCCARD' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ELFCORE' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_MATCH_CONNTRACK' 2024-05-08T09:47:36.993 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CONSOLE_TRANSLATIONS' 2024-05-08T09:47:37.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:36 smithi172 ceph-mon[33377]: pgmap v5778: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 154 op/s 2024-05-08T09:47:37.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:36 smithi194 ceph-mon[33679]: pgmap v5778: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.9 MiB/s wr, 154 op/s 2024-05-08T09:47:37.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_NUMA_BALANCING' 2024-05-08T09:47:37.708 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_EMULEX' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AIO' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_SUP_HYGON' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_KENSINGTON' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_CHERRY' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_16BIT' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IA32_FEAT_CTL' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DECOMPRESS_BZIP2' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_UACCESS_FLUSHCACHE' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TASKS_RCU' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LEGACY_DIRECT_IO' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_NULL2' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PREEMPT_COUNT' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EXCLUSIVE_SYSTEM_RAM' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_UHCI_HCD' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NEED_SG_DMA_FLAGS' 2024-05-08T09:47:37.709 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_SYSCALL_TRACEPOINTS' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_PACKET_ENGINES' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ALIGNED_STRUCT_PAGE' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_USES_HIGH_VMA_FLAGS' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/COMPAT_OLD_SIGACTION' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_KPP2' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_LABEL' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCPU_DEV_REFCNT' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROBE_EVENTS' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_EGRESS' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PARAVIRT' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_STATIC_CALL' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEFAULT_TCP_CONG' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_INTEL_TXT' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_64' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_CISCO' 2024-05-08T09:47:37.710 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EARLY_PRINTK' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_FOCALTECH' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PREFIX_SYMBOLS' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_BLK' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_UMIP' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_MULTICAST' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEFAULT_INIT' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_SRSO' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_WMI' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MAY_HAVE_PC_FDC' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RD_ZSTD' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RANDOMIZE_MEMORY_PHYSICAL_PADDING' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NFS_DISABLE_UDP_SUPPORT' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_NONSTANDARD' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_ECHAINIV' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_CLOCKEVENTS_MIN_ADJUST' 2024-05-08T09:47:37.711 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUPS' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_GCC_PLUGINS' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MMAP_RND_COMPAT_BITS' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GRACE_PERIOD' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SPARSEMEM_DEFAULT' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MACINTOSH_DRIVERS' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_NATSEMI' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECURITY_SELINUX_SID2STR_CACHE_SIZE' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_WITHIN_STACK_FRAMES' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_PCI' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MII' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_PLATFORM_DEVICES' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CONNECTOR' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_ENABLE_MEMORY_HOTPLUG' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_REV_OVERRIDE_POSSIBLE' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_CISCO' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_PARTITION' 2024-05-08T09:47:37.712 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HPET_EMULATE_RTC' 2024-05-08T09:47:37.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SGL_ALLOC' 2024-05-08T09:47:37.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_VERBOSE_BOOTUP' 2024-05-08T09:47:37.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NOP_TRACER' 2024-05-08T09:47:37.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XARRAY_MULTI' 2024-05-08T09:47:37.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TICK_ONESHOT' 2024-05-08T09:47:37.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_OBJTOOL' 2024-05-08T09:47:37.713 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_PANEL_ORIENTATION_QUIRKS' 2024-05-08T09:47:38.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KERNEL_LZMA' 2024-05-08T09:47:38.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_AKCIPHER' 2024-05-08T09:47:38.418 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DECOMPRESS_GZIP' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_CMOS_UPDATE' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_NVIDIA' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SIGNALFD' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_INTF_PROC' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IPC_NS' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_INTF_SYSFS' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CLKEVT_I8253' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_REJECT_IPV6' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_AEAD' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UTS_NS' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAC80211_STA_HASH_MAX_SIZE' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_JUMP_LABEL' 2024-05-08T09:47:38.419 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SUNRPC' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NLS_UTF8' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ATA_VERBOSE_ERROR' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/I2C_BOARDINFO' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TCP_CONG_CUBIC' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_LIB_ARC4' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_NAT_SIP' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INTEGRITY' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IA32_EMULATION' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HIGH_RES_TIMERS' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SOCK_RX_QUEUE_MAPPING' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_USE_CMPXCHG_LOCKREF' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_STACK_VALIDATION' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_HW' 2024-05-08T09:47:38.420 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP6_NF_TARGET_REJECT' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_ELF_RANDOMIZE' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_SAMPLE_FTRACE_DIRECT' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RD_GZIP' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USE_PERCPU_NUMA_NODE_ID' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSFS' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TRACING' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_MELLANOX' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_RSA' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_USES_PG_UNCACHED' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_IRQ_EXIT_ON_IRQ_STACK' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_RQ_ALLOC_TIME' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/I2C_I801' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_CAPTURE_ERROR' 2024-05-08T09:47:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROC_KCORE' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANT_LD_ORPHAN_WARN' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FHANDLE' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_CPU_RELAX' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_ACPI_CPUFREQ' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/THERMAL_EMERGENCY_POWEROFF_DELAY_MS' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_HEARTBEAT_INTERVAL' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MODULES_USE_ELF_RELA' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_TARGET_TCPMSS' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_FREQ_GOV_USERSPACE' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MUTEX_SPIN_ON_OWNER' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_DEPRECATED_OPTIONS' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCIEASPM_DEFAULT' 2024-05-08T09:47:38.422 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INSTRUCTION_DECODER' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_REJECT_IPV4' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_ATH' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/I2C' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AGP_AMD64' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CACHESTAT_SYSCALL' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PM_STD_PARTITION' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/JOLIET' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_AES' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INTEL_IOMMU' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_COMPAT_MMAP_BASES' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KRETPROBES' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_FREQ_GOV_ONDEMAND' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_PROCESSOR_IDLE' 2024-05-08T09:47:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SKY2' 2024-05-08T09:47:38.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SPLIT_PTLOCK_CPUS' 2024-05-08T09:47:38.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_MID' 2024-05-08T09:47:38.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PNPACPI' 2024-05-08T09:47:38.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HVC_DRIVER' 2024-05-08T09:47:38.424 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PER_VMA_LOCK' 2024-05-08T09:47:39.002 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:38 smithi070 ceph-mon[29591]: pgmap v5779: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 149 op/s 2024-05-08T09:47:39.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:38 smithi172 ceph-mon[33377]: pgmap v5779: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 149 op/s 2024-05-08T09:47:39.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:38 smithi194 ceph-mon[33679]: pgmap v5779: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 149 op/s 2024-05-08T09:47:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/THERMAL_WRITABLE_TRIPS' 2024-05-08T09:47:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_SECCOMP' 2024-05-08T09:47:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_PERF_USER_STACK_DUMP' 2024-05-08T09:47:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CLZ_TAB' 2024-05-08T09:47:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_FAN' 2024-05-08T09:47:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_CORE' 2024-05-08T09:47:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROVIDE_OHCI1394_DMA_INIT' 2024-05-08T09:47:39.337 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KERNEL_LZ4' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_LOCKLESS_CONFIG' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EPOLL' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_TRACEHOOK' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FUNCTION_ALIGNMENT_4B' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_ESRT' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EVENTFD' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOGITECH_FF' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_CPU_CACHE_INVALIDATE_MEMREGION' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KVM_GUEST' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NEW_LEDS' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/I2C_ALGOBIT' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INITRAMFS_SOURCE' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_ALLOCATOR' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LSM' 2024-05-08T09:47:39.338 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MMU_GATHER_TABLE_FREE' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HUGETLB_PAGE_OPTIMIZE_VMEMMAP' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCSI_PROC_FS' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MMAP_RND_COMPAT_BITS_MIN' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_DEFAULT_PERSIST' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CROSS_MEMORY_ATTACH' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_INGRESS' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_BOOTPARAM_MEMORY_CORRUPTION_CHECK' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_NETRONOME' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_HV_CALLBACK_VECTOR' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EFI_HANDOVER_PROTOCOL' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EXT4_FS' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NUMA' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_SETUP_PER_CPU_AREA' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/P2SB' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_KFENCE' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_AMD' 2024-05-08T09:47:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_PERICOM' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RCU_STALL_COMMON' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_CMPXCHG64' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_LIB_GF128MUL' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_NULL' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_HOTPLUG_CPU' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RCU_EXP_CPU_STALL_TIMEOUT' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_CMPXCHG_DOUBLE' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_NETLINK' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/E100' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_NF_IPTABLES' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/OUTPUT_FORMAT' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HOTPLUG_CORE_SYNC' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PM_TRACE' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KERNEL_BZIP2' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECURITY_SELINUX_SIDTAB_HASH_BITS' 2024-05-08T09:47:39.340 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_SAMPLE_FTRACE_DIRECT_MULTI' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_THERMAL_VECTOR' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PATA_TIMINGS' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DECOMPRESS_ZSTD' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/THREAD_INFO_IN_TASK' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KVM' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/E1000' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_STACKLEAK' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_MCE_INTEL' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KERNEL_GZIP' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_PANTHERLORD' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMA_SHARED_BUFFER' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_STATIC_CALL_INLINE' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_IRQ_MATRIX_ALLOCATOR' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_EHCI_HCD' 2024-05-08T09:47:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_NVMEM' 2024-05-08T09:47:39.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WATCHDOG_OPEN_TIMEOUT' 2024-05-08T09:47:39.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_PKEYS' 2024-05-08T09:47:39.342 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIRTIO_PCI_LIB' 2024-05-08T09:47:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.001+0000 7fea7fe00700 1 -- 172.21.15.70:0/2446505024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103620 msgr2=0x7fea80103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.001+0000 7fea7fe00700 1 --2- 172.21.15.70:0/2446505024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103620 0x7fea80103a00 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fea700099c0 tx=0x7fea70009cd0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.001+0000 7fea7fe00700 1 -- 172.21.15.70:0/2446505024 shutdown_connections 2024-05-08T09:47:39.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.001+0000 7fea7fe00700 1 --2- 172.21.15.70:0/2446505024 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea80108700 0x7fea801102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.001+0000 7fea7fe00700 1 --2- 172.21.15.70:0/2446505024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103620 0x7fea80103a00 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.001+0000 7fea7fe00700 1 --2- 172.21.15.70:0/2446505024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea80103fd0 0x7fea80108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.001+0000 7fea7fe00700 1 -- 172.21.15.70:0/2446505024 >> 172.21.15.70:0/2446505024 conn(0x7fea800feef0 msgr2=0x7fea80101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.001+0000 7fea7fe00700 1 -- 172.21.15.70:0/2446505024 shutdown_connections 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.001+0000 7fea7fe00700 1 -- 172.21.15.70:0/2446505024 wait complete. 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.002+0000 7fea7fe00700 1 Processor -- start 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7fe00700 1 -- start start 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7fe00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea80103620 0x7fea8019f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103fd0 0x7fea8019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7fe00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea80108700 0x7fea80199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:39.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7fe00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fea80113510 con 0x7fea80103fd0 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7fe00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fea80113390 con 0x7fea80108700 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7fe00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fea80113690 con 0x7fea80103620 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103fd0 0x7fea8019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7e000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103fd0 0x7fea8019fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57180/0 (socket says 172.21.15.70:57180) 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.003+0000 7fea7e000700 1 -- 172.21.15.70:0/811009161 learned_addr learned my addr 172.21.15.70:0/811009161 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea7ea00700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea80103620 0x7fea8019f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea7f400700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea80108700 0x7fea80199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea7e000700 1 -- 172.21.15.70:0/811009161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea80103620 msgr2=0x7fea8019f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea7e000700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea80103620 0x7fea8019f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea7e000700 1 -- 172.21.15.70:0/811009161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea80108700 msgr2=0x7fea80199990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea7e000700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea80108700 0x7fea80199990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea7e000700 1 -- 172.21.15.70:0/811009161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8019a0f0 con 0x7fea80103fd0 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea7e000700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103fd0 0x7fea8019fcc0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00b500 tx=0x7fea6c00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:47:39.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea77400700 1 -- 172.21.15.70:0/811009161 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c015020 con 0x7fea80103fd0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea77400700 1 -- 172.21.15.70:0/811009161 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fea6c011cc0 con 0x7fea80103fd0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea77400700 1 -- 172.21.15.70:0/811009161 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea6c010c80 con 0x7fea80103fd0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.004+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8019a3e0 con 0x7fea80103fd0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.005+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea801a6650 con 0x7fea80103fd0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.006+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8006a190 con 0x7fea80103fd0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.011+0000 7fea77400700 1 -- 172.21.15.70:0/811009161 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fea6c018020 con 0x7fea80103fd0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.013+0000 7fea77400700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea640b29f0 0x7fea640b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.013+0000 7fea77400700 1 -- 172.21.15.70:0/811009161 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(439..439 src has 1..439) ==== 9539+0+0 (secure 0 0 0) 0x7fea6c0e2770 con 0x7fea80103fd0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.013+0000 7fea7ea00700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea640b29f0 0x7fea640b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.014+0000 7fea7ea00700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea640b29f0 0x7fea640b4eb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fea70009990 tx=0x7fea7001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.015+0000 7fea77400700 1 -- 172.21.15.70:0/811009161 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fea6c01f020 con 0x7fea80103fd0 2024-05-08T09:47:39.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.344+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea8019ae70 con 0x7fea80103fd0 2024-05-08T09:47:39.594 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:47:39.594 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":45,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:46:54.433805+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T09:47:39.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.346+0000 7fea77400700 1 -- 172.21.15.70:0/811009161 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11879 (secure 0 0 0) 0x7fea6c0a3e20 con 0x7fea80103fd0 2024-05-08T09:47:39.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.348+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea640b29f0 msgr2=0x7fea640b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:39.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.348+0000 7fea7fe00700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea640b29f0 0x7fea640b4eb0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fea70009990 tx=0x7fea7001a040 comp rx=0 tx=0).stop 2024-05-08T09:47:39.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.348+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103fd0 msgr2=0x7fea8019fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.348+0000 7fea7fe00700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103fd0 0x7fea8019fcc0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fea6c00b500 tx=0x7fea6c00b8c0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.349+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 shutdown_connections 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.349+0000 7fea7fe00700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fea640b29f0 0x7fea640b4eb0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.349+0000 7fea7fe00700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fea80108700 0x7fea80199990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.349+0000 7fea7fe00700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea80103620 0x7fea8019f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.349+0000 7fea7fe00700 1 --2- 172.21.15.70:0/811009161 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fea80103fd0 0x7fea8019fcc0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.349+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 >> 172.21.15.70:0/811009161 conn(0x7fea800feef0 msgr2=0x7fea80100320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.349+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 shutdown_connections 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:39.349+0000 7fea7fe00700 1 -- 172.21.15.70:0/811009161 wait complete. 2024-05-08T09:47:39.595 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 45 2024-05-08T09:47:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_SAMSUNG' 2024-05-08T09:47:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AS_VERSION' 2024-05-08T09:47:40.125 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_GENERIC' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FAT_DEFAULT_IOCHARSET' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_CPU' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_LIB_SHA256' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SATA_AHCI' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SWIOTLB' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ZSTD_COMMON' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_BATTERY' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_BELKIN' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DECOMPRESS_XZ' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_IO_TRACE' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_DEBUG_WX' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_SHA3' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_DEBUG_PAGEALLOC' 2024-05-08T09:47:40.126 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NFS_COMMON' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VMAP_PFN' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_DIRECT' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_FENTRY' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOCK_SPIN_ON_OWNER' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_64_SMP' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SCHEDSTATS' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AS_SHA1_NI' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_EARLY_IOREMAP' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ETHERNET' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LD_VERSION' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_XILINX' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AMD_NUMA' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAC80211_RC_DEFAULT' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SWPHY' 2024-05-08T09:47:40.127 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_IBPB_ENTRY' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_ASM_INLINE' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLOCK_LEGACY_AUTOLOAD' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MMAP_RND_COMPAT_BITS_MAX' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_WIZNET' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HRTIMER' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_NET_UTILS' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_CFI_CLANG' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_SILAN' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_NF_FILTER' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_PCI' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_SYSTOHC_DEVICE' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_ALGAPI' 2024-05-08T09:47:40.128 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_PIMSM_V1' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_OBJTOOL_MCOUNT' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMAR_TABLE' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MSDOS_PARTITION' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PERF_EVENTS_INTEL_RAPL' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_KMS_HELPER' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_PKG_TEMP_THERMAL' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/auto.conf.cmd' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_RUNTIME_UARTS' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NLS_DEFAULT' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MHP_MEMMAP_ON_MEMORY_ENABLE' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INTEL_TCC' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_ALTEON' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_ASM_GOTO_TIED_OUTPUT' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_SPCR_TABLE' 2024-05-08T09:47:40.129 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEVTMPFS' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRASH_DUMP' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PREEMPTION' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/STACKPROTECTOR' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_CGROUP_IOPRIO' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_CLASS' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NO_HZ_COMMON' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_CPU_VULNERABILITIES' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RTC_DRV_CMOS' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_AUDITSYSCALL' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYNC_FILE' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_INTEL' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_MEDIATEK' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_PERF' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_LOCAL_APIC' 2024-05-08T09:47:40.130 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_IRQ_MIGRATION' 2024-05-08T09:47:40.131 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_VIA' 2024-05-08T09:47:40.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/811009161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:47:40.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/811009161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:47:40.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/811009161' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:47:40.981 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 78.7 --await-for 42.0' 2024-05-08T09:47:40.981 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 78.7 --await-for 42.0 2024-05-08T09:47:41.101 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_RELIABLE_STACKTRACE' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VT' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VT_CONSOLE' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOCKDEP_SUPPORT' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_CPUIDLE_HALTPOLL' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROC_PID_CPUSET' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PHYSICAL_ALIGN' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_DM_BUILTIN' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XZ_DEC_POWERPC' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/FREEZER' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_SUPPORT' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_STORAGE' 2024-05-08T09:47:41.102 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_SUPPORT_OLD_API' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_JUMP_LABEL_HACK' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_USER_RETURN_NOTIFIER' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_SANCOV_TRACE_PC' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_RDC' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_NET_PRIO' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PID_NS' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PREEMPT_RCU' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RT_MUTEXES' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LD_ORPHAN_WARN' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_COPY_MC' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RD_LZ4' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_PNP' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOGIWHEELS_FF' 2024-05-08T09:47:41.103 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_PIDS' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_HDA_PREALLOC_SIZE' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_IRQ_SHOW' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LZO_COMPRESS' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_CORTINA' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_JUMP_LABEL_RELATIVE' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/STRICT_KERNEL_RWX' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_GOOGLE' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IOMMU_SUPPORT' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DW_DMAC_CORE' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BINFMT_SCRIPT' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_RUST' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_INTEL_PSTATE' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MICROCODE' 2024-05-08T09:47:41.104 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_EHCI_PCI' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_DEBUG_KMEMLEAK' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KEYS' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/QUOTA' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SYSCTL' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_RNG_DEFAULT' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_I915_FENCE_TIMEOUT' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MMCONF_FAM10H' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TRACING_SUPPORT' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAC_EMUMOUSEBTN' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOCALVERSION_AUTO' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SECRETMEM' 2024-05-08T09:47:41.105 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMADEVICES' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/9P_FS' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ADVISE_SYSCALLS' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_HW_BREAKPOINT' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INTEL_GTT' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AS_SHA256_NI' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RETHUNK' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PNP_DEBUG_MESSAGES' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_SLEEP' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_SKIP_EGRESS' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VIDEO_NOMODESET' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_NF_TARGET_MASQUERADE' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PM_DEBUG' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_ATMEL' 2024-05-08T09:47:41.106 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DST_CACHE' 2024-05-08T09:47:41.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_DRBG' 2024-05-08T09:47:41.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_SOFT_DIRTY' 2024-05-08T09:47:41.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NO_HZ_IDLE' 2024-05-08T09:47:41.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_FREQ_DEFAULT_GOV_USERSPACE' 2024-05-08T09:47:41.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/OID_REGISTRY' 2024-05-08T09:47:41.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NO_HZ' 2024-05-08T09:47:41.107 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AGP_INTEL' 2024-05-08T09:47:41.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CLOCKSOURCE_WATCHDOG' 2024-05-08T09:47:41.108 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KCSAN_COMPILER' 2024-05-08T09:47:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:40 smithi070 ceph-mon[29591]: pgmap v5780: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 138 op/s 2024-05-08T09:47:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:40 smithi172 ceph-mon[33377]: pgmap v5780: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 138 op/s 2024-05-08T09:47:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:40 smithi194 ceph-mon[33679]: pgmap v5780: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.8 MiB/s wr, 138 op/s 2024-05-08T09:47:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_BROADCOM' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SPARSE_IRQ' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ALLOW_DEV_COREDUMP' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_MICROSOFT' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_HUGE_VMALLOC' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_KASAN_VMALLOC' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MSDOS_FS' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_PTE_SPECIAL' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCIEPORTBUS' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_UID16' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_ENTRY' 2024-05-08T09:47:41.953 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INIT_ENV_ARG_LIMIT' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_USE_MEMTEST' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/QFMT_V2' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DMI_SCAN_MACHINE_NON_EFI_FALLBACK' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CALL_DEPTH_TRACKING' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ETHTOOL_NETLINK' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEVMEM' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PREEMPT_DYNAMIC' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_HASH2' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_LOG_IPV6' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LTO_NONE' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GCC11_NO_ARRAY_BOUNDS' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCC' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/POSIX_MQUEUE_SYSCTL' 2024-05-08T09:47:41.954 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_SUN' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_EHCI_TT_NEWSCHED' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/E1000E_HWTS' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_EXTENDED' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROC_EVENTS' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_PRMT' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_KCSAN' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_CPU_AUTOPROBE' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRC16' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SMP' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_I2C_OPREGION' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EXT4_FS_SECURITY' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CGROUP_CPUACCT' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HIDRAW' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/YENTA_O2' 2024-05-08T09:47:41.955 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_DMA_CONTIGUOUS' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_CONSOLE' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HIBERNATE_CALLBACKS' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HW_CONSOLE' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_BOOT_PARAMS' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_CONNTRACK_FTP' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI_PRI' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_CLS' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TRACEPOINTS' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_AQUANTIA' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ZONE_DMA' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP6_NF_MANGLE' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_NEED_RELOCS' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_INITRD' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EVENT_TRACING' 2024-05-08T09:47:41.956 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_CLOCKSOURCE_INIT' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_ATOMIC_RMW' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IPV6_NDISC_NODETYPE' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TRACE_IRQFLAGS_SUPPORT' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EDAC_SUPPORT' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_DISPLAY_DP_HELPER' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_9P' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CLOCKSOURCE_VALIDATE_LAST_CYCLE' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOCKD' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PHYSICAL_START' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEBUG_FS' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_REALTEK' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/AUDITSYSCALL' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_INT128' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EARLY_PRINTK_DBGP' 2024-05-08T09:47:41.957 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_SKCIPHER' 2024-05-08T09:47:41.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PM' 2024-05-08T09:47:41.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RSEQ' 2024-05-08T09:47:41.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_CACHE_LINE_SIZE' 2024-05-08T09:47:41.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_MIPI_DSI' 2024-05-08T09:47:41.958 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RANDOMIZE_MEMORY' 2024-05-08T09:47:42.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_MMAP_RND_BITS_MAX' 2024-05-08T09:47:42.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_HAS_IBT' 2024-05-08T09:47:42.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_CALIBRATE_DELAY' 2024-05-08T09:47:42.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SPARSEMEM' 2024-05-08T09:47:42.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_ARC' 2024-05-08T09:47:42.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SERIAL_8250_RSA' 2024-05-08T09:47:42.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TRACE_CLOCK' 2024-05-08T09:47:42.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RETHOOK' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IO_DELAY_0X80' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MAC80211' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/KPROBES' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEBUG_INFO_NONE' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_PAT' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_MARK' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_ELFCORE_COMPAT' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_INTEL_SOUNDWIRE_ACPI' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_TRACKPOINT' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_NI' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_FUNGIBLE' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SUSPEND' 2024-05-08T09:47:42.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SOCK_CGROUP_DATA' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DYNAMIC_MEMORY_LAYOUT' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IOMMU_IOVA' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SLUB_DEBUG' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/I2C_HELPER_AUTO' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/QUOTA_TREE' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BUILDTIME_TABLE_SORT' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_PM_TIMER' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/XZ_DEC' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/POWER_SUPPLY_HWMON' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_MICROSEMI' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_KERNEL_LZO' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ASYMMETRIC_PUBLIC_KEY_SUBTYPE' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HALTPOLL_CPUIDLE' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/TCP_CONG_ADVANCED' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_STACKWALK' 2024-05-08T09:47:42.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_ALGAPI2' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DEFAULT_HOSTNAME' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/UID16' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_EFFICIENT_UNALIGNED_ACCESS' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INTEL_IOMMU_SCALABLE_MODE_DEFAULT_ON' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_TARGET_NFLOG' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_PTE_DEVMAP' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/THERMAL_GOV_STEP_WISE' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CPU_SUP_AMD' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LOG_CPU_MAX_BUF_SHIFT' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INTEL_IOMMU_PERF_EVENTS' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_VDSO_TIME_NS' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_WANTS_THP_SWAP' 2024-05-08T09:47:42.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VGA_ARB' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HIBERNATION' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_WANGXUN' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/EXPORTFS' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DRM_VIRTIO_GPU' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IOMMU_DMA' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SGETMASK_SYSCALL' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_KCOV' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PROC_PID_ARCH_STATUS' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/VGA_ARB_MAX_GPUS' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_CONNTRACK_SECMARK' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PNP' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_HAS_CURRENT_STACK_POINTER' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/LEDS_TRIGGERS' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MOUSE_PS2_CYPRESS' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NFS_V3' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/DUMMY_CONSOLE_COLUMNS' 2024-05-08T09:47:42.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_PIMSM_V2' 2024-05-08T09:47:42.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SUNRPC_GSS' 2024-05-08T09:47:42.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_ACOMP2' 2024-05-08T09:47:42.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_AMAZON' 2024-05-08T09:47:42.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CC_CAN_LINK' 2024-05-08T09:47:42.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ARCH_SUPPORTS_PER_VMA_LOCK' 2024-05-08T09:47:42.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NF_DEFRAG_IPV4' 2024-05-08T09:47:42.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NETFILTER_XT_MATCH_STATE' 2024-05-08T09:47:43.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:42 smithi070 ceph-mon[29591]: pgmap v5781: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 678 KiB/s wr, 32 op/s 2024-05-08T09:47:43.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:42 smithi172 ceph-mon[33377]: pgmap v5781: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 678 KiB/s wr, 32 op/s 2024-05-08T09:47:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:42 smithi194 ceph-mon[33679]: pgmap v5781: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 678 KiB/s wr, 32 op/s 2024-05-08T09:47:43.844 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_ARCH_MMAP_RND_BITS' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/USB_OHCI_HCD' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HAVE_GENERIC_VDSO' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/INPUT_MOUSE' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NLS_ISO8859_1' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/RFKILL' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PCI' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_VENDOR_SEEQ' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/REGMAP' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CFG80211_CRDA_SUPPORT' 2024-05-08T09:47:43.845 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/APERTURE_HELPERS' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/PAGE_COUNTER' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/NET_FAILOVER' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/GENERIC_IRQ_EFFECTIVE_AFF_MASK' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_MICROCHIP' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/HID_PID' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_RNG2' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/CRYPTO_CBC' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/IP_PNP_DHCP' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/ACPI_DOCK' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/SND_DMA_SGBUF' 2024-05-08T09:47:43.846 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/WLAN_VENDOR_ZYDAS' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/X86_SUPPORTS_MEMORY_FAILURE' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/MDIO_DEVICE' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/config/BLK_DEV_BSG_COMMON' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/config' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/limits.h' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/bits.h' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/time.h' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/clocksource.h' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/processor.h' 2024-05-08T09:47:43.847 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/time64.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/jiffies.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/vsyscall.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/helpers.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/time32.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/ktime.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/math64.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/const.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/vdso/datapage.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/vdso' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/ufs/unipro.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/ufs/ufs_quirks.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/ufs/ufs.h' 2024-05-08T09:47:43.848 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/ufs/ufshci.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/ufs/ufshcd.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/ufs' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/ras/ras_event.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/ras' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/syscall.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/define_trace.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/perf.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/define_custom_trace.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/filemap.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/napi.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/fib6.h' 2024-05-08T09:47:43.849 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/regulator.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/asoc.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/siox.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/ufs.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/nilfs2.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/osnoise.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/dma_fence.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/notifier.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/gpu_mem.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/bridge.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/sock.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/pwm.h' 2024-05-08T09:47:43.850 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/xen.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/printk.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/initcall.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/xdp.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/mctp.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/scsi.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/ext4.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/error_report.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/vmscan.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/vb2.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/skb.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/oom.h' 2024-05-08T09:47:43.851 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/fib.h' 2024-05-08T09:47:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rpcrdma.h' 2024-05-08T09:47:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/net.h' 2024-05-08T09:47:44.548 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/smbus.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/gpio.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/writeback.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/qla.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/syscalls.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/neigh.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/mlxsw.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/fsi_master_aspeed.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/migrate.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/sctp.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/swiotlb.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/fsi.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/thermal_pressure.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/module.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/tlb.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/cachefiles.h' 2024-05-08T09:47:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/avc.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/fs_dax.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/btrfs.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/kyber.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/mce.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/target.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/csd.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/jbd2.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rxrpc.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/spi.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/mmc.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/mmflags.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/iocost.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/spmi.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rtc.h' 2024-05-08T09:47:44.550 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/objagg.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/host1x.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/intel_ifs.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/i2c_slave.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/cma.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/page_pool.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/tegra_apb_dma.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/hwmon.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/irq_matrix.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/irq.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/power.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/sunvnet.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/habanalabs.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/preemptirq.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/qrtr.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/kvm.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/maple_tree.h' 2024-05-08T09:47:44.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/compaction.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/thp.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/udp.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/erofs.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/sunrpc.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/bpf_test_run.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rpcgss.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/wbt.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/devfreq.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rdma_core.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/afs.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/tcp.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/intel-sst.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/mmap.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/cpuhp.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/mmap_lock.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/handshake.h' 2024-05-08T09:47:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/bcache.h' 2024-05-08T09:47:44.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/power_cpu_migrate.h' 2024-05-08T09:47:44.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/net_probe_common.h' 2024-05-08T09:47:44.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/fsi_master_ast_cf.h' 2024-05-08T09:47:44.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/cgroup.h' 2024-05-08T09:47:44.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/sof.h' 2024-05-08T09:47:44.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/huge_memory.h' 2024-05-08T09:47:44.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/intel_ish.h' 2024-05-08T09:47:44.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/watchdog.h' 2024-05-08T09:47:44.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.651+0000 7fe0c4000700 1 -- 172.21.15.70:0/2886490179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0bc10a700 msgr2=0x7fe0bc10aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:44.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.651+0000 7fe0c4000700 1 --2- 172.21.15.70:0/2886490179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0bc10a700 0x7fe0bc10aae0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00099c0 tx=0x7fe0b0009cd0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.651+0000 7fe0c4000700 1 -- 172.21.15.70:0/2886490179 shutdown_connections 2024-05-08T09:47:44.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.651+0000 7fe0c4000700 1 --2- 172.21.15.70:0/2886490179 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0bc10eff0 0x7fe0bc10f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.651+0000 7fe0c4000700 1 --2- 172.21.15.70:0/2886490179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0bc10a700 0x7fe0bc10aae0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.651+0000 7fe0c4000700 1 --2- 172.21.15.70:0/2886490179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0bc10b020 0x7fe0bc10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.651+0000 7fe0c4000700 1 -- 172.21.15.70:0/2886490179 >> 172.21.15.70:0/2886490179 conn(0x7fe0bc06ea90 msgr2=0x7fe0bc06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:47:44.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.652+0000 7fe0c4000700 1 -- 172.21.15.70:0/2886490179 shutdown_connections 2024-05-08T09:47:44.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.653+0000 7fe0c4000700 1 -- 172.21.15.70:0/2886490179 wait complete. 2024-05-08T09:47:44.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.654+0000 7fe0c4000700 1 Processor -- start 2024-05-08T09:47:44.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.654+0000 7fe0c4000700 1 -- start start 2024-05-08T09:47:44.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c4000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0bc10a700 0x7fe0bc116200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c4000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0bc10b020 0x7fe0bc116740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c4000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0bc10eff0 0x7fe0bc1b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c4000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1195d0 con 0x7fe0bc10b020 2024-05-08T09:47:44.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c4000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc119450 con 0x7fe0bc10a700 2024-05-08T09:47:44.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c4000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc119750 con 0x7fe0bc10eff0 2024-05-08T09:47:44.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c2000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0bc10eff0 0x7fe0bc1b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c2000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0bc10eff0 0x7fe0bc1b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:47920/0 (socket says 172.21.15.70:47920) 2024-05-08T09:47:44.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c2000700 1 -- 172.21.15.70:0/3112301165 learned_addr learned my addr 172.21.15.70:0/3112301165 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:47:44.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.655+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0bc10b020 0x7fe0bc116740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.656+0000 7fe0c1600700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0bc10a700 0x7fe0bc116200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.656+0000 7fe0c2000700 1 -- 172.21.15.70:0/3112301165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0bc10a700 msgr2=0x7fe0bc116200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:44.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.656+0000 7fe0c2000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0bc10a700 0x7fe0bc116200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.656+0000 7fe0c2000700 1 -- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0bc10b020 msgr2=0x7fe0bc116740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:44.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.656+0000 7fe0c2000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0bc10b020 0x7fe0bc116740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.656+0000 7fe0c2000700 1 -- 172.21.15.70:0/3112301165 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0bc1b4c30 con 0x7fe0bc10eff0 2024-05-08T09:47:44.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.657+0000 7fe0c2000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0bc10eff0 0x7fe0bc1b4670 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400b970 tx=0x7fe0b400bc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:47:44.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.657+0000 7fe0ba000700 1 -- 172.21.15.70:0/3112301165 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4019070 con 0x7fe0bc10eff0 2024-05-08T09:47:44.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.657+0000 7fe0ba000700 1 -- 172.21.15.70:0/3112301165 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0b400cdc0 con 0x7fe0bc10eff0 2024-05-08T09:47:44.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.657+0000 7fe0c4000700 1 -- 172.21.15.70:0/3112301165 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0bc1b4f20 con 0x7fe0bc10eff0 2024-05-08T09:47:44.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.658+0000 7fe0ba000700 1 -- 172.21.15.70:0/3112301165 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4014e30 con 0x7fe0bc10eff0 2024-05-08T09:47:44.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.658+0000 7fe0c4000700 1 -- 172.21.15.70:0/3112301165 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0bc1b5380 con 0x7fe0bc10eff0 2024-05-08T09:47:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.666+0000 7fe0ba000700 1 -- 172.21.15.70:0/3112301165 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe0b401c070 con 0x7fe0bc10eff0 2024-05-08T09:47:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.669+0000 7fe0ba000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0a40b2a90 0x7fe0a40b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.669+0000 7fe0ba000700 1 -- 172.21.15.70:0/3112301165 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(439..439 src has 1..439) ==== 9539+0+0 (secure 0 0 0) 0x7fe0b40e1c90 con 0x7fe0bc10eff0 2024-05-08T09:47:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.670+0000 7fe0c1600700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0a40b2a90 0x7fe0a40b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.672+0000 7fe0c1600700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0a40b2a90 0x7fe0a40b4f50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00058e0 tx=0x7fe0b001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:47:44.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.695+0000 7fe0ce9fab80 1 Processor -- start 2024-05-08T09:47:44.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.696+0000 7fe0ce9fab80 1 -- start start 2024-05-08T09:47:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.696+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4047330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.696+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041520 0x5593f40419a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.697+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041ee0 0x5593f404dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.697+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5593f3f93bb0 con 0x5593f4046f50 2024-05-08T09:47:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.697+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5593f3f318f0 con 0x5593f4041ee0 2024-05-08T09:47:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.697+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5593f3f8fb70 con 0x5593f4041520 2024-05-08T09:47:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.697+0000 7fe0c1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4047330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.697+0000 7fe0c1600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4047330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57196/0 (socket says 172.21.15.70:57196) 2024-05-08T09:47:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.697+0000 7fe0c1600700 1 -- 172.21.15.70:0/2673227321 learned_addr learned my addr 172.21.15.70:0/2673227321 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:47:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.697+0000 7fe0c2000700 1 --2- 172.21.15.70:0/2673227321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041ee0 0x5593f404dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.697+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/2673227321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041520 0x5593f40419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.698+0000 7fe0c1600700 1 -- 172.21.15.70:0/2673227321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041520 msgr2=0x5593f40419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:47:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.698+0000 7fe0c1600700 1 --2- 172.21.15.70:0/2673227321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041520 0x5593f40419a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.698+0000 7fe0c1600700 1 -- 172.21.15.70:0/2673227321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041ee0 msgr2=0x5593f404dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:47:44.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.698+0000 7fe0c1600700 1 --2- 172.21.15.70:0/2673227321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041ee0 0x5593f404dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.698+0000 7fe0c1600700 1 -- 172.21.15.70:0/2673227321 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f3ee0a60 con 0x5593f4046f50 2024-05-08T09:47:44.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.698+0000 7fe0c1600700 1 --2- 172.21.15.70:0/2673227321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4047330 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00099c0 tx=0x7fe0b001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e178eca08e0e414f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:47:44.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.699+0000 7fe0aea00700 1 -- 172.21.15.70:0/2673227321 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0004690 con 0x5593f4046f50 2024-05-08T09:47:44.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.699+0000 7fe0aea00700 1 -- 172.21.15.70:0/2673227321 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0b0004cc0 con 0x5593f4046f50 2024-05-08T09:47:44.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.699+0000 7fe0aea00700 1 -- 172.21.15.70:0/2673227321 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b002fbe0 con 0x5593f4046f50 2024-05-08T09:47:44.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.700+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/2673227321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 msgr2=0x5593f4047330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:44.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.700+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/2673227321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4047330 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00099c0 tx=0x7fe0b001e000 comp rx=0 tx=0).stop 2024-05-08T09:47:44.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.700+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/2673227321 shutdown_connections 2024-05-08T09:47:44.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.700+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/2673227321 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041ee0 0x5593f404dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.700+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/2673227321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4047330 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.700+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/2673227321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041520 0x5593f40419a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.700+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/2673227321 >> 172.21.15.70:0/2673227321 conn(0x5593f3f6fcf0 msgr2=0x5593f403be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:47:44.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.700+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/2673227321 shutdown_connections 2024-05-08T09:47:44.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.700+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/2673227321 wait complete. 2024-05-08T09:47:44.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.701+0000 7fe0ce9fab80 1 -- start start 2024-05-08T09:47:44.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.701+0000 7fe0ce9fab80 1 Processor -- start 2024-05-08T09:47:44.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.702+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f404d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.702+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f404acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.702+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f404b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.702+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5593f404e2b0 con 0x5593f4046f50 2024-05-08T09:47:44.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.702+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5593f3ef9cb0 con 0x5593f4041520 2024-05-08T09:47:44.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.702+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5593f404e430 con 0x5593f4041ee0 2024-05-08T09:47:44.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.702+0000 7fe0ce9fab80 10 client.0 _ll_register_callbacks cb 0x5593f3f3ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:47:44.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.702+0000 7fe0c2000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f404b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.703+0000 7fe0c1600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f404d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.703+0000 7fe0c2000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f404b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57202/0 (socket says 172.21.15.70:57202) 2024-05-08T09:47:44.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.703+0000 7fe0c2000700 1 -- 172.21.15.70:0/252343605 learned_addr learned my addr 172.21.15.70:0/252343605 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:47:44.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.703+0000 7fe0c1600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f404d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:58812/0 (socket says 172.21.15.70:58812) 2024-05-08T09:47:44.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.703+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f404acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.703+0000 7fe0c1600700 1 -- 172.21.15.70:0/252343605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 msgr2=0x5593f404acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:47:44.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.703+0000 7fe0c1600700 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f404acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.703+0000 7fe0c1600700 1 -- 172.21.15.70:0/252343605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 msgr2=0x5593f404b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:47:44.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.704+0000 7fe0c1600700 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f404b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.704+0000 7fe0c1600700 1 -- 172.21.15.70:0/252343605 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f3f595b0 con 0x5593f4041520 2024-05-08T09:47:44.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.704+0000 7fe0c2000700 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f404b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:47:44.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.705+0000 7fe0c1600700 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f404d920 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00098e0 tx=0x7fe0b0009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9622ac8ba453a85e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:47:44.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.705+0000 7fe0a3400700 10 client.0 ms_handle_connect on v2:172.21.15.172:3300/0 2024-05-08T09:47:44.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.708+0000 7fe0a3400700 1 -- 172.21.15.70:0/252343605 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b002f860 con 0x5593f4041520 2024-05-08T09:47:44.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.708+0000 7fe0a3400700 1 -- 172.21.15.70:0/252343605 <== mon.2 v2:172.21.15.172:3300/0 2 ==== osd_map(439..439 src has 1..439) ==== 9539+0+0 (secure 0 0 0) 0x7fe0b002fa00 con 0x5593f4041520 2024-05-08T09:47:44.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.708+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/252343605 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0b0004cc0 con 0x5593f4041520 2024-05-08T09:47:44.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.711+0000 7fe0a3400700 1 -- 172.21.15.70:0/252343605 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fe0b002fc00 con 0x5593f4041520 2024-05-08T09:47:44.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.711+0000 7fe0ce9fab80 10 client.38402 fetch_fsmap learned FSMap version 45 2024-05-08T09:47:44.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.711+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/252343605 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5593f404e2b0 con 0x5593f4041520 2024-05-08T09:47:44.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.711+0000 7fe0a3400700 1 -- 172.21.15.70:0/252343605 <== mon.2 v2:172.21.15.172:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0b0004cc0 con 0x5593f4041520 2024-05-08T09:47:44.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.712+0000 7fe0a3400700 1 -- 172.21.15.70:0/252343605 <== mon.2 v2:172.21.15.172:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7fe0b0022070 con 0x5593f4041520 2024-05-08T09:47:44.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.712+0000 7fe0ce9fab80 10 client.38402 fetch_fsmap finished waiting for FSMap version 45 2024-05-08T09:47:44.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.712+0000 7fe0ce9fab80 10 client.38402 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:47:44.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.712+0000 7fe0ce9fab80 20 client.38402 populate_metadata read hostname 'smithi070' 2024-05-08T09:47:44.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.712+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5593f405ae10 0x5593f405d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.712+0000 7fe0ce9fab80 4 client.38402 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:47:44.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.712+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/252343605 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593f400e230 con 0x5593f405ae10 2024-05-08T09:47:44.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.713+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5593f405ae10 0x5593f405d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.715+0000 7fe0a3400700 10 client.38402 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:47:44.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.715+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5593f405ae10 0x5593f405d200 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e7a71d1d7a702b server_cookie=3892786ecdf85a6a in_seq=0 out_seq=0 2024-05-08T09:47:44.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.718+0000 7fe0a3400700 1 -- 172.21.15.70:0/252343605 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5593f400e230 con 0x5593f405ae10 2024-05-08T09:47:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.718+0000 7fe0a3400700 10 client.38402 handle_command_reply: tid=0 2024-05-08T09:47:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.718+0000 7fe0ce9fab80 1 client.38402 shutdown 2024-05-08T09:47:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.718+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/252343605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 msgr2=0x5593f404d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:44.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.718+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f404d920 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00098e0 tx=0x7fe0b0009310 comp rx=0 tx=0).stop 2024-05-08T09:47:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/252343605 shutdown_connections 2024-05-08T09:47:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5593f405ae10 0x5593f405d200 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0a3400700 0 client.38402 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:47:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f404b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f404d920 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/252343605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f404acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/252343605 >> 172.21.15.70:0/252343605 conn(0x5593f3f6fcf0 msgr2=0x5593f40368e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:47:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/252343605 shutdown_connections 2024-05-08T09:47:44.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/252343605 wait complete. 2024-05-08T09:47:44.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.719+0000 7fe0ce9fab80 20 client.38402 trim_cache size 0 max 16384 2024-05-08T09:47:44.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.758+0000 7fe0ce9fab80 1 Processor -- start 2024-05-08T09:47:44.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.758+0000 7fe0ce9fab80 1 -- start start 2024-05-08T09:47:44.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f40573a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4040b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4062860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1c0b70 con 0x5593f4046f50 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1be3a0 con 0x5593f4041520 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1bc210 con 0x5593f4041ee0 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0c1600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f40573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0c0c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0c0c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4040b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:47938/0 (socket says 172.21.15.70:47938) 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.759+0000 7fe0c0c00700 1 -- 172.21.15.70:0/3110996338 learned_addr learned my addr 172.21.15.70:0/3110996338 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.760+0000 7fe0c2000700 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4062860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.760+0000 7fe0c0c00700 1 -- 172.21.15.70:0/3110996338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 msgr2=0x5593f40573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:47:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.760+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f40573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.760+0000 7fe0c0c00700 1 -- 172.21.15.70:0/3110996338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 msgr2=0x5593f4062860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:47:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.760+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4062860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.760+0000 7fe0c0c00700 1 -- 172.21.15.70:0/3110996338 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f404d560 con 0x5593f4041ee0 2024-05-08T09:47:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.760+0000 7fe0c2000700 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4062860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:47:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.761+0000 7fe0c1600700 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f40573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:47:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.761+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4040b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009a40 tx=0x7fe0a8008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da028050cc65fa87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:47:44.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.763+0000 7fe0ae000700 1 -- 172.21.15.70:0/3110996338 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8017a80 con 0x5593f4041ee0 2024-05-08T09:47:44.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.763+0000 7fe0ae000700 1 -- 172.21.15.70:0/3110996338 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0a8021030 con 0x5593f4041ee0 2024-05-08T09:47:44.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.763+0000 7fe0ae000700 1 -- 172.21.15.70:0/3110996338 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80253d0 con 0x5593f4041ee0 2024-05-08T09:47:44.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.764+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/3110996338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 msgr2=0x5593f4040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:47:44.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.764+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4040b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009a40 tx=0x7fe0a8008040 comp rx=0 tx=0).stop 2024-05-08T09:47:44.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.764+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/3110996338 shutdown_connections 2024-05-08T09:47:44.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.764+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4046f50 0x5593f4062860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.764+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4041520 0x5593f40573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.764+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/3110996338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4040b80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.764+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/3110996338 >> 172.21.15.70:0/3110996338 conn(0x5593f3f6fcf0 msgr2=0x5593f4045260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:47:44.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.766+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/3110996338 shutdown_connections 2024-05-08T09:47:44.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.766+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/3110996338 wait complete. 2024-05-08T09:47:44.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.766+0000 7fe0ce9fab80 1 -- start start 2024-05-08T09:47:44.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.767+0000 7fe0ce9fab80 1 Processor -- start 2024-05-08T09:47:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4041520 0x5593f40506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4050c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0ce9fab80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4046f50 0x5593f4051170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1bc860 con 0x5593f4041520 2024-05-08T09:47:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1bdcd0 con 0x5593f4046f50 2024-05-08T09:47:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0ce9fab80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fe0bc1bcf30 con 0x5593f4041ee0 2024-05-08T09:47:44.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0ce9fab80 10 client.0 _ll_register_callbacks cb 0x5593f3f3ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:47:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0c0c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4050c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0c0c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4050c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.70:47950/0 (socket says 172.21.15.70:47950) 2024-05-08T09:47:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.768+0000 7fe0c0c00700 1 -- 172.21.15.70:0/4269151668 learned_addr learned my addr 172.21.15.70:0/4269151668 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:47:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.769+0000 7fe0c0c00700 1 -- 172.21.15.70:0/4269151668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4046f50 msgr2=0x5593f4051170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T09:47:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.769+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4046f50 0x5593f4051170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.769+0000 7fe0c0c00700 1 -- 172.21.15.70:0/4269151668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4041520 msgr2=0x5593f40506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:47:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.769+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4041520 0x5593f40506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:47:44.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.769+0000 7fe0c0c00700 1 -- 172.21.15.70:0/4269151668 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f40c5420 con 0x5593f4041ee0 2024-05-08T09:47:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.769+0000 7fe0c0c00700 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4050c30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8008010 tx=0x7fe0a801da80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cfdb7fd968043f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:47:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.770+0000 7fe0a3400700 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-05-08T09:47:44.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.770+0000 7fe0a3400700 1 -- 172.21.15.70:0/4269151668 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8017c80 con 0x5593f4041ee0 2024-05-08T09:47:44.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.770+0000 7fe0a3400700 1 -- 172.21.15.70:0/4269151668 <== mon.1 v2:172.21.15.194:3300/0 2 ==== osd_map(439..439 src has 1..439) ==== 9539+0+0 (secure 0 0 0) 0x7fe0a801d050 con 0x5593f4041ee0 2024-05-08T09:47:44.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.771+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/4269151668 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0a8021030 con 0x5593f4041ee0 2024-05-08T09:47:44.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.772+0000 7fe0a3400700 1 -- 172.21.15.70:0/4269151668 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fe0a8038050 con 0x5593f4041ee0 2024-05-08T09:47:44.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.772+0000 7fe0ce9fab80 10 client.28567 fetch_fsmap learned FSMap version 45 2024-05-08T09:47:44.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.772+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/4269151668 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5593f40c64f0 con 0x5593f4041ee0 2024-05-08T09:47:44.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.773+0000 7fe0a3400700 1 -- 172.21.15.70:0/4269151668 <== mon.1 v2:172.21.15.194:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0a8021030 con 0x5593f4041ee0 2024-05-08T09:47:44.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.774+0000 7fe0a3400700 1 -- 172.21.15.70:0/4269151668 <== mon.1 v2:172.21.15.194:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7fe0a801dce0 con 0x5593f4041ee0 2024-05-08T09:47:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.774+0000 7fe0ce9fab80 10 client.28567 fetch_fsmap finished waiting for FSMap version 45 2024-05-08T09:47:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.774+0000 7fe0ce9fab80 10 client.28567 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:47:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.774+0000 7fe0ce9fab80 20 client.28567 populate_metadata read hostname 'smithi070' 2024-05-08T09:47:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.774+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5593f405ae10 0x5593f40c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:47:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.774+0000 7fe0ce9fab80 4 client.28567 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.7, "await_for": 42.0}] 2024-05-08T09:47:44.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.774+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/4269151668 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.7, "await_for": 42.0}) -- 0x5593f3fa1590 con 0x5593f405ae10 2024-05-08T09:47:44.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.775+0000 7fe0c1600700 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5593f405ae10 0x5593f40c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:47:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.777+0000 7fe0c1600700 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5593f405ae10 0x5593f40c8c00 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa4f2e8c5fb92d01 server_cookie=9fe25f0c0e154ea9 in_seq=0 out_seq=0 2024-05-08T09:47:44.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:47:44.777+0000 7fe0a3400700 10 client.28567 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:47:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:44 smithi070 ceph-mon[29591]: pgmap v5782: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 678 KiB/s wr, 32 op/s 2024-05-08T09:47:45.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:44 smithi172 ceph-mon[33377]: pgmap v5782: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 678 KiB/s wr, 32 op/s 2024-05-08T09:47:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:44 smithi194 ceph-mon[33679]: pgmap v5782: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 676 KiB/s rd, 678 KiB/s wr, 32 op/s 2024-05-08T09:47:47.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:46 smithi172 ceph-mon[33377]: pgmap v5783: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 46 op/s 2024-05-08T09:47:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:46 smithi194 ceph-mon[33679]: pgmap v5783: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 46 op/s 2024-05-08T09:47:47.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:46 smithi070 ceph-mon[29591]: pgmap v5783: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 46 op/s 2024-05-08T09:47:49.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:48 smithi172 ceph-mon[33377]: pgmap v5784: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 843 KiB/s wr, 24 op/s 2024-05-08T09:47:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:48 smithi194 ceph-mon[33679]: pgmap v5784: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 843 KiB/s wr, 24 op/s 2024-05-08T09:47:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:48 smithi070 ceph-mon[29591]: pgmap v5784: 129 pgs: 129 active+clean; 2.6 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 843 KiB/s wr, 24 op/s 2024-05-08T09:47:51.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:50 smithi172 ceph-mon[33377]: pgmap v5785: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 35 op/s 2024-05-08T09:47:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:50 smithi194 ceph-mon[33679]: pgmap v5785: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 35 op/s 2024-05-08T09:47:51.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:50 smithi070 ceph-mon[29591]: pgmap v5785: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 35 op/s 2024-05-08T09:47:52.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:52 smithi172 ceph-mon[33377]: pgmap v5786: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 948 KiB/s wr, 25 op/s 2024-05-08T09:47:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:52 smithi194 ceph-mon[33679]: pgmap v5786: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 948 KiB/s wr, 25 op/s 2024-05-08T09:47:53.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:52 smithi070 ceph-mon[29591]: pgmap v5786: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 948 KiB/s wr, 25 op/s 2024-05-08T09:47:55.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:54 smithi172 ceph-mon[33377]: pgmap v5787: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 948 KiB/s wr, 25 op/s 2024-05-08T09:47:55.249 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:54 smithi070 ceph-mon[29591]: pgmap v5787: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 948 KiB/s wr, 25 op/s 2024-05-08T09:47:55.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:54 smithi194 ceph-mon[33679]: pgmap v5787: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 948 KiB/s wr, 25 op/s 2024-05-08T09:47:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:56 smithi172 ceph-mon[33377]: pgmap v5788: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 49 op/s 2024-05-08T09:47:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:56 smithi194 ceph-mon[33679]: pgmap v5788: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 49 op/s 2024-05-08T09:47:57.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:56 smithi070 ceph-mon[29591]: pgmap v5788: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 49 op/s 2024-05-08T09:47:59.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:47:58 smithi172 ceph-mon[33377]: pgmap v5789: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 498 KiB/s wr, 35 op/s 2024-05-08T09:47:59.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:47:58 smithi194 ceph-mon[33679]: pgmap v5789: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 498 KiB/s wr, 35 op/s 2024-05-08T09:47:59.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:47:58 smithi070 ceph-mon[29591]: pgmap v5789: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 498 KiB/s wr, 35 op/s 2024-05-08T09:48:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:00 smithi172 ceph-mon[33377]: pgmap v5790: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 632 KiB/s wr, 45 op/s 2024-05-08T09:48:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:00 smithi194 ceph-mon[33679]: pgmap v5790: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 632 KiB/s wr, 45 op/s 2024-05-08T09:48:01.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:00 smithi070 ceph-mon[29591]: pgmap v5790: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 753 KiB/s rd, 632 KiB/s wr, 45 op/s 2024-05-08T09:48:03.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:02 smithi172 ceph-mon[33377]: pgmap v5791: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 255 KiB/s wr, 34 op/s 2024-05-08T09:48:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:02 smithi194 ceph-mon[33679]: pgmap v5791: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 255 KiB/s wr, 34 op/s 2024-05-08T09:48:03.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:02 smithi070 ceph-mon[29591]: pgmap v5791: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 255 KiB/s wr, 34 op/s 2024-05-08T09:48:05.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:04 smithi194 ceph-mon[33679]: pgmap v5792: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 255 KiB/s wr, 34 op/s 2024-05-08T09:48:05.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:04 smithi070 ceph-mon[29591]: pgmap v5792: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 255 KiB/s wr, 34 op/s 2024-05-08T09:48:05.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.402+0000 7fe0a3400700 1 -- 172.21.15.70:0/4269151668 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5593f3fa1590 con 0x5593f405ae10 2024-05-08T09:48:05.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.402+0000 7fe0a3400700 10 client.28567 handle_command_reply: tid=0 2024-05-08T09:48:05.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.402+0000 7fe0ce9fab80 1 client.28567 shutdown 2024-05-08T09:48:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.403+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/4269151668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 msgr2=0x5593f4050c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.403+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4050c30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8008010 tx=0x7fe0a801da80 comp rx=0 tx=0).stop 2024-05-08T09:48:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.403+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/4269151668 shutdown_connections 2024-05-08T09:48:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.403+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5593f405ae10 0x5593f40c8c00 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.403+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5593f4046f50 0x5593f4051170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.403+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5593f4041520 0x5593f40506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.403+0000 7fe0ce9fab80 1 --2- 172.21.15.70:0/4269151668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5593f4041ee0 0x5593f4050c30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.403+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/4269151668 >> 172.21.15.70:0/4269151668 conn(0x5593f3f6fcf0 msgr2=0x5593f40449d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:05.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.403+0000 7fe0a3400700 0 client.28567 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:48:05.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.404+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/4269151668 shutdown_connections 2024-05-08T09:48:05.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.404+0000 7fe0ce9fab80 1 -- 172.21.15.70:0/4269151668 wait complete. 2024-05-08T09:48:05.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.404+0000 7fe0ce9fab80 20 client.28567 trim_cache size 0 max 16384 2024-05-08T09:48:05.404 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:48:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 45, 2024-05-08T09:48:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:48:05.404 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 394, 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "346f06c0": { 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 394, 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.7, 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:48:05.405 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:48:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCED", 2024-05-08T09:48:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:48:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:05.406 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:05.406 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 -- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0a40b2a90 msgr2=0x7fe0a40b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0a40b2a90 0x7fe0a40b4f50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00058e0 tx=0x7fe0b001a040 comp rx=0 tx=0).stop 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 -- 172.21.15.70:0/3112301165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0bc10eff0 msgr2=0x7fe0bc1b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0bc10eff0 0x7fe0bc1b4670 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe0b400b970 tx=0x7fe0b400bc80 comp rx=0 tx=0).stop 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 -- 172.21.15.70:0/3112301165 shutdown_connections 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fe0a40b2a90 0x7fe0a40b4f50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0bc10eff0 0x7fe0bc1b4670 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fe0bc10a700 0x7fe0bc116200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 --2- 172.21.15.70:0/3112301165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0bc10b020 0x7fe0bc116740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.405+0000 7fe0c4000700 1 -- 172.21.15.70:0/3112301165 >> 172.21.15.70:0/3112301165 conn(0x7fe0bc06ea90 msgr2=0x7fe0bc11a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:05.407 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.406+0000 7fe0c4000700 1 -- 172.21.15.70:0/3112301165 shutdown_connections 2024-05-08T09:48:05.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:05.406+0000 7fe0c4000700 1 -- 172.21.15.70:0/3112301165 wait complete. 2024-05-08T09:48:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:04 smithi172 ceph-mon[33377]: pgmap v5792: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 255 KiB/s wr, 34 op/s 2024-05-08T09:48:06.686 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '346f06c0', quiesce took 30.7 seconds. Will release after: 18.7 2024-05-08T09:48:07.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:06 smithi194 ceph-mon[33679]: pgmap v5793: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 255 KiB/s wr, 37 op/s 2024-05-08T09:48:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:06 smithi070 ceph-mon[29591]: pgmap v5793: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 255 KiB/s wr, 37 op/s 2024-05-08T09:48:07.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:06 smithi172 ceph-mon[33377]: pgmap v5793: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 255 KiB/s wr, 37 op/s 2024-05-08T09:48:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:08 smithi194 ceph-mon[33679]: pgmap v5794: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 13 op/s 2024-05-08T09:48:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:08 smithi070 ceph-mon[29591]: pgmap v5794: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 13 op/s 2024-05-08T09:48:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:08 smithi172 ceph-mon[33377]: pgmap v5794: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 134 KiB/s wr, 13 op/s 2024-05-08T09:48:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:10 smithi194 ceph-mon[33679]: pgmap v5795: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 231 KiB/s wr, 32 op/s 2024-05-08T09:48:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:10 smithi070 ceph-mon[29591]: pgmap v5795: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 231 KiB/s wr, 32 op/s 2024-05-08T09:48:11.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:10 smithi172 ceph-mon[33377]: pgmap v5795: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 231 KiB/s wr, 32 op/s 2024-05-08T09:48:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:13 smithi172 ceph-mon[33377]: pgmap v5796: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 97 KiB/s wr, 22 op/s 2024-05-08T09:48:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:13 smithi194 ceph-mon[33679]: pgmap v5796: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 97 KiB/s wr, 22 op/s 2024-05-08T09:48:13.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:13 smithi070 ceph-mon[29591]: pgmap v5796: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 97 KiB/s wr, 22 op/s 2024-05-08T09:48:15.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:15 smithi172 ceph-mon[33377]: pgmap v5797: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 97 KiB/s wr, 22 op/s 2024-05-08T09:48:15.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:15 smithi194 ceph-mon[33679]: pgmap v5797: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 97 KiB/s wr, 22 op/s 2024-05-08T09:48:15.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:15 smithi070 ceph-mon[29591]: pgmap v5797: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 97 KiB/s wr, 22 op/s 2024-05-08T09:48:16.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:16 smithi172 ceph-mon[33377]: osdmap e440: 12 total, 12 up, 12 in 2024-05-08T09:48:16.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:16 smithi194 ceph-mon[33679]: osdmap e440: 12 total, 12 up, 12 in 2024-05-08T09:48:16.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:16 smithi070 ceph-mon[29591]: osdmap e440: 12 total, 12 up, 12 in 2024-05-08T09:48:17.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:17 smithi172 ceph-mon[33377]: pgmap v5799: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 116 KiB/s wr, 25 op/s 2024-05-08T09:48:17.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:17 smithi194 ceph-mon[33679]: pgmap v5799: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 116 KiB/s wr, 25 op/s 2024-05-08T09:48:17.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:17 smithi070 ceph-mon[29591]: pgmap v5799: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 116 KiB/s wr, 25 op/s 2024-05-08T09:48:18.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:18 smithi194 ceph-mon[33679]: pgmap v5800: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 116 KiB/s wr, 25 op/s 2024-05-08T09:48:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:18 smithi070 ceph-mon[29591]: pgmap v5800: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 116 KiB/s wr, 25 op/s 2024-05-08T09:48:18.680 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:18 smithi172 ceph-mon[33377]: pgmap v5800: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 116 KiB/s wr, 25 op/s 2024-05-08T09:48:20.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:20 smithi070 ceph-mon[29591]: pgmap v5801: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T09:48:20.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:20 smithi172 ceph-mon[33377]: pgmap v5801: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T09:48:21.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:20 smithi194 ceph-mon[33679]: pgmap v5801: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T09:48:22.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:22 smithi070 ceph-mon[29591]: pgmap v5802: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T09:48:22.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:22 smithi172 ceph-mon[33377]: pgmap v5802: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T09:48:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:22 smithi194 ceph-mon[33679]: pgmap v5802: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T09:48:24.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:24 smithi070 ceph-mon[29591]: pgmap v5803: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T09:48:24.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:24 smithi172 ceph-mon[33377]: pgmap v5803: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T09:48:25.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:24 smithi194 ceph-mon[33679]: pgmap v5803: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 46 KiB/s wr, 7 op/s 2024-05-08T09:48:25.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:48:26.783 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:48:26.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:26 smithi070 ceph-mon[29591]: pgmap v5804: 129 pgs: 19 active+clean+snaptrim, 61 active+clean+snaptrim_wait, 49 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 7 op/s 2024-05-08T09:48:26.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:26 smithi172 ceph-mon[33377]: pgmap v5804: 129 pgs: 19 active+clean+snaptrim, 61 active+clean+snaptrim_wait, 49 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 7 op/s 2024-05-08T09:48:27.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:26 smithi194 ceph-mon[33679]: pgmap v5804: 129 pgs: 19 active+clean+snaptrim, 61 active+clean+snaptrim_wait, 49 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 7 op/s 2024-05-08T09:48:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:29 smithi172 ceph-mon[33377]: pgmap v5805: 129 pgs: 19 active+clean+snaptrim, 61 active+clean+snaptrim_wait, 49 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T09:48:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:29 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:48:29.446 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:29 smithi070 ceph-mon[29591]: pgmap v5805: 129 pgs: 19 active+clean+snaptrim, 61 active+clean+snaptrim_wait, 49 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T09:48:29.446 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:29 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:48:29.513 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:29 smithi194 ceph-mon[33679]: pgmap v5805: 129 pgs: 19 active+clean+snaptrim, 61 active+clean+snaptrim_wait, 49 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 KiB/s wr, 6 op/s 2024-05-08T09:48:29.514 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:29 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:48:31.422 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:31 smithi070 ceph-mon[29591]: pgmap v5806: 129 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 91 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 9 op/s 2024-05-08T09:48:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:31 smithi172 ceph-mon[33377]: pgmap v5806: 129 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 91 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 9 op/s 2024-05-08T09:48:31.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:31 smithi194 ceph-mon[33679]: pgmap v5806: 129 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 91 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 9 op/s 2024-05-08T09:48:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:32 smithi172 ceph-mon[33377]: pgmap v5807: 129 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 91 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T09:48:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:48:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:48:32.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:48:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:32 smithi194 ceph-mon[33679]: pgmap v5807: 129 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 91 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T09:48:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:48:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:48:32.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:48:32.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:32 smithi070 ceph-mon[29591]: pgmap v5807: 129 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 91 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T09:48:32.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:48:32.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:48:32.515 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:48:33.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.713+0000 7f2f3c000700 1 -- 172.21.15.70:0/298329855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 msgr2=0x7f2f34109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:33.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.713+0000 7f2f3c000700 1 --2- 172.21.15.70:0/298329855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 0x7f2f34109f50 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009990 tx=0x7f2f20009ca0 comp rx=0 tx=0).stop 2024-05-08T09:48:33.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.713+0000 7f2f3c000700 1 -- 172.21.15.70:0/298329855 shutdown_connections 2024-05-08T09:48:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.713+0000 7f2f3c000700 1 --2- 172.21.15.70:0/298329855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3410a490 0x7f2f341169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.713+0000 7f2f3c000700 1 --2- 172.21.15.70:0/298329855 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f3410fb60 0x7f2f3410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.713+0000 7f2f3c000700 1 --2- 172.21.15.70:0/298329855 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 0x7f2f34109f50 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.713+0000 7f2f3c000700 1 -- 172.21.15.70:0/298329855 >> 172.21.15.70:0/298329855 conn(0x7f2f34076c70 msgr2=0x7f2f341082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.713+0000 7f2f3c000700 1 -- 172.21.15.70:0/298329855 shutdown_connections 2024-05-08T09:48:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.713+0000 7f2f3c000700 1 -- 172.21.15.70:0/298329855 wait complete. 2024-05-08T09:48:33.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.714+0000 7f2f3c000700 1 Processor -- start 2024-05-08T09:48:33.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.714+0000 7f2f3c000700 1 -- start start 2024-05-08T09:48:33.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.714+0000 7f2f3c000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 0x7f2f341a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:33.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.714+0000 7f2f3c000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f3410a490 0x7f2f341a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:33.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.714+0000 7f2f3c000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3410fb60 0x7f2f341a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:33.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.714+0000 7f2f3c000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f34119c20 con 0x7f2f34109ad0 2024-05-08T09:48:33.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.714+0000 7f2f3c000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f2f34119aa0 con 0x7f2f3410a490 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.714+0000 7f2f3c000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f2f34119da0 con 0x7f2f3410fb60 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f39600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 0x7f2f341a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f39600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 0x7f2f341a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43442/0 (socket says 172.21.15.70:43442) 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f39600700 1 -- 172.21.15.70:0/3021991927 learned_addr learned my addr 172.21.15.70:0/3021991927 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f38c00700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f3410a490 0x7f2f341a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f3a000700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3410fb60 0x7f2f341a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f39600700 1 -- 172.21.15.70:0/3021991927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3410fb60 msgr2=0x7f2f341a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f39600700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3410fb60 0x7f2f341a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f39600700 1 -- 172.21.15.70:0/3021991927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f3410a490 msgr2=0x7f2f341a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f39600700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f3410a490 0x7f2f341a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f39600700 1 -- 172.21.15.70:0/3021991927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f341a5200 con 0x7f2f34109ad0 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f3a000700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3410fb60 0x7f2f341a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f38c00700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f3410a490 0x7f2f341a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:48:33.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.715+0000 7f2f39600700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 0x7f2f341a01f0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800b530 tx=0x7f2f2800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.716+0000 7f2f32000700 1 -- 172.21.15.70:0/3021991927 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28015020 con 0x7f2f34109ad0 2024-05-08T09:48:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.716+0000 7f2f32000700 1 -- 172.21.15.70:0/3021991927 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f28011cc0 con 0x7f2f34109ad0 2024-05-08T09:48:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.716+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f341a54f0 con 0x7f2f34109ad0 2024-05-08T09:48:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.716+0000 7f2f32000700 1 -- 172.21.15.70:0/3021991927 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28010d30 con 0x7f2f34109ad0 2024-05-08T09:48:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.716+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f341acd70 con 0x7f2f34109ad0 2024-05-08T09:48:33.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.717+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f3406a190 con 0x7f2f34109ad0 2024-05-08T09:48:33.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.719+0000 7f2f32000700 1 -- 172.21.15.70:0/3021991927 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2f28018020 con 0x7f2f34109ad0 2024-05-08T09:48:33.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.720+0000 7f2f32000700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b29f0 0x7f2f1c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:33.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.721+0000 7f2f32000700 1 -- 172.21.15.70:0/3021991927 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(440..440 src has 1..440) ==== 9671+0+0 (secure 0 0 0) 0x7f2f280e2230 con 0x7f2f34109ad0 2024-05-08T09:48:33.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.721+0000 7f2f38c00700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b29f0 0x7f2f1c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:33.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.721+0000 7f2f38c00700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b29f0 0x7f2f1c0b4eb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2f20006010 tx=0x7f2f2001a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:33.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:33.725+0000 7f2f32000700 1 -- 172.21.15.70:0/3021991927 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2f2801f020 con 0x7f2f34109ad0 2024-05-08T09:48:34.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.044+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f341a1550 con 0x7f2f34109ad0 2024-05-08T09:48:34.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.045+0000 7f2f32000700 1 -- 172.21.15.70:0/3021991927 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11879 (secure 0 0 0) 0x7f2f280a9840 con 0x7f2f34109ad0 2024-05-08T09:48:34.045 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:48:34.045 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":45,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:46:54.433805+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T09:48:34.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b29f0 msgr2=0x7f2f1c0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:34.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b29f0 0x7f2f1c0b4eb0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2f20006010 tx=0x7f2f2001a040 comp rx=0 tx=0).stop 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 msgr2=0x7f2f341a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 0x7f2f341a01f0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800b530 tx=0x7f2f2800b8f0 comp rx=0 tx=0).stop 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 shutdown_connections 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f2f1c0b29f0 0x7f2f1c0b4eb0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3410fb60 0x7f2f341a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f34109ad0 0x7f2f341a01f0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 --2- 172.21.15.70:0/3021991927 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f2f3410a490 0x7f2f341a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 >> 172.21.15.70:0/3021991927 conn(0x7f2f34076c70 msgr2=0x7f2f34077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 shutdown_connections 2024-05-08T09:48:34.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:34.049+0000 7f2f3c000700 1 -- 172.21.15.70:0/3021991927 wait complete. 2024-05-08T09:48:34.050 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 45 2024-05-08T09:48:34.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:34 smithi070 ceph-mon[29591]: pgmap v5808: 129 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 91 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T09:48:34.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:34 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3021991927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:48:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:34 smithi172 ceph-mon[33377]: pgmap v5808: 129 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 91 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T09:48:34.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:34 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3021991927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:48:34.955 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --set-id 346f06c0 --release --await' 2024-05-08T09:48:34.955 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --set-id 346f06c0 --release --await 2024-05-08T09:48:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:34 smithi194 ceph-mon[33679]: pgmap v5808: 129 pgs: 12 active+clean+snaptrim, 26 active+clean+snaptrim_wait, 91 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 KiB/s wr, 5 op/s 2024-05-08T09:48:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:34 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3021991927' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:48:35.425 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:48:36.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:36 smithi070 ceph-mon[29591]: pgmap v5809: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-05-08T09:48:36.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:36 smithi172 ceph-mon[33377]: pgmap v5809: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-05-08T09:48:37.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:36 smithi194 ceph-mon[33679]: pgmap v5809: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.7 KiB/s wr, 8 op/s 2024-05-08T09:48:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.920+0000 7ff277600700 1 -- 172.21.15.70:0/2484510083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 msgr2=0x7ff2701103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.920+0000 7ff277600700 1 --2- 172.21.15.70:0/2484510083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 0x7ff2701103a0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7ff26800b0d0 tx=0x7ff26800b3e0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.920+0000 7ff277600700 1 -- 172.21.15.70:0/2484510083 shutdown_connections 2024-05-08T09:48:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.920+0000 7ff277600700 1 --2- 172.21.15.70:0/2484510083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 0x7ff2701103a0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.920+0000 7ff277600700 1 --2- 172.21.15.70:0/2484510083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2701095d0 0x7ff2701099b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.920+0000 7ff277600700 1 --2- 172.21.15.70:0/2484510083 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270103550 0x7ff2701039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.920+0000 7ff277600700 1 -- 172.21.15.70:0/2484510083 >> 172.21.15.70:0/2484510083 conn(0x7ff27007a5f0 msgr2=0x7ff27007aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.920+0000 7ff277600700 1 -- 172.21.15.70:0/2484510083 shutdown_connections 2024-05-08T09:48:37.920 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.920+0000 7ff277600700 1 -- 172.21.15.70:0/2484510083 wait complete. 2024-05-08T09:48:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.921+0000 7ff277600700 1 Processor -- start 2024-05-08T09:48:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.921+0000 7ff277600700 1 -- start start 2024-05-08T09:48:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.921+0000 7ff277600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270103550 0x7ff2701a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.921+0000 7ff277600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 0x7ff2701a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.921+0000 7ff277600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2701095d0 0x7ff27019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.921+0000 7ff277600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff270113560 con 0x7ff270103f10 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.921+0000 7ff277600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701133e0 con 0x7ff270103550 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.921+0000 7ff277600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701136e0 con 0x7ff2701095d0 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff267e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 0x7ff2701a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff267e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 0x7ff2701a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37718/0 (socket says 172.21.15.70:37718) 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff267e00700 1 -- 172.21.15.70:0/1063450612 learned_addr learned my addr 172.21.15.70:0/1063450612 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff274c00700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270103550 0x7ff2701a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff275600700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2701095d0 0x7ff27019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff267e00700 1 -- 172.21.15.70:0/1063450612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2701095d0 msgr2=0x7ff27019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff267e00700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2701095d0 0x7ff27019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff267e00700 1 -- 172.21.15.70:0/1063450612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270103550 msgr2=0x7ff2701a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff267e00700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270103550 0x7ff2701a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff267e00700 1 -- 172.21.15.70:0/1063450612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27019c120 con 0x7ff270103f10 2024-05-08T09:48:37.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.922+0000 7ff274c00700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270103550 0x7ff2701a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:48:37.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.923+0000 7ff267e00700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 0x7ff2701a1d40 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7ff25800e9a0 tx=0x7ff25800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:37.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.923+0000 7ff26e000700 1 -- 172.21.15.70:0/1063450612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25800cbd0 con 0x7ff270103f10 2024-05-08T09:48:37.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.923+0000 7ff26e000700 1 -- 172.21.15.70:0/1063450612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff25800cd70 con 0x7ff270103f10 2024-05-08T09:48:37.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.923+0000 7ff26e000700 1 -- 172.21.15.70:0/1063450612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258018680 con 0x7ff270103f10 2024-05-08T09:48:37.923 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.923+0000 7ff277600700 1 -- 172.21.15.70:0/1063450612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27019c410 con 0x7ff270103f10 2024-05-08T09:48:37.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.923+0000 7ff277600700 1 -- 172.21.15.70:0/1063450612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2701a86d0 con 0x7ff270103f10 2024-05-08T09:48:37.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.927+0000 7ff26e000700 1 -- 172.21.15.70:0/1063450612 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff258010950 con 0x7ff270103f10 2024-05-08T09:48:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.928+0000 7ff26e000700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2540b29f0 0x7ff2540b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.928+0000 7ff26e000700 1 -- 172.21.15.70:0/1063450612 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(441..441 src has 1..441) ==== 9583+0+0 (secure 0 0 0) 0x7ff2580e2dd0 con 0x7ff270103f10 2024-05-08T09:48:37.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.929+0000 7ff274c00700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2540b29f0 0x7ff2540b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.929+0000 7ff274c00700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2540b29f0 0x7ff2540b4eb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff260005fd0 tx=0x7ff260005f60 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:37.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.941+0000 7ff281ef4b80 1 Processor -- start 2024-05-08T09:48:37.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.942+0000 7ff281ef4b80 1 -- start start 2024-05-08T09:48:37.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.942+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 0x5569a5c192a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.942+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13490 0x5569a5c13910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.942+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 0x5569a5c1fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.942+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569a5b65b20 con 0x5569a5c13490 2024-05-08T09:48:37.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.942+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5569a5b03860 con 0x5569a5c18ec0 2024-05-08T09:48:37.941 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.942+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5569a5b61ae0 con 0x5569a5c13e50 2024-05-08T09:48:37.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff267e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13490 0x5569a5c13910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff267e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13490 0x5569a5c13910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37730/0 (socket says 172.21.15.70:37730) 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff267e00700 1 -- 172.21.15.70:0/868992914 learned_addr learned my addr 172.21.15.70:0/868992914 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff275600700 1 --2- 172.21.15.70:0/868992914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 0x5569a5c1fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff274c00700 1 --2- 172.21.15.70:0/868992914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 0x5569a5c192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff267e00700 1 -- 172.21.15.70:0/868992914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 msgr2=0x5569a5c1fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff267e00700 1 --2- 172.21.15.70:0/868992914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 0x5569a5c1fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff267e00700 1 -- 172.21.15.70:0/868992914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 msgr2=0x5569a5c192a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff267e00700 1 --2- 172.21.15.70:0/868992914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 0x5569a5c192a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff267e00700 1 -- 172.21.15.70:0/868992914 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569a5ab29d0 con 0x5569a5c13490 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.943+0000 7ff267e00700 1 --2- 172.21.15.70:0/868992914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13490 0x5569a5c13910 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ff2580a9bc0 tx=0x7ff2580a9b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6cb1ea2a77309e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.944+0000 7ff266000700 1 -- 172.21.15.70:0/868992914 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2580aa330 con 0x5569a5c13490 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.944+0000 7ff266000700 1 -- 172.21.15.70:0/868992914 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2580a9c30 con 0x5569a5c13490 2024-05-08T09:48:37.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.944+0000 7ff266000700 1 -- 172.21.15.70:0/868992914 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff258010430 con 0x5569a5c13490 2024-05-08T09:48:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.944+0000 7ff281ef4b80 1 -- 172.21.15.70:0/868992914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13490 msgr2=0x5569a5c13910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.944+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/868992914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13490 0x5569a5c13910 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7ff2580a9bc0 tx=0x7ff2580a9b30 comp rx=0 tx=0).stop 2024-05-08T09:48:37.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.945+0000 7ff281ef4b80 1 -- 172.21.15.70:0/868992914 shutdown_connections 2024-05-08T09:48:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.945+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/868992914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 0x5569a5c1fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.945+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/868992914 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 0x5569a5c192a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.945+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/868992914 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13490 0x5569a5c13910 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.945+0000 7ff281ef4b80 1 -- 172.21.15.70:0/868992914 >> 172.21.15.70:0/868992914 conn(0x5569a5b41c60 msgr2=0x5569a5c0dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.945+0000 7ff281ef4b80 1 -- 172.21.15.70:0/868992914 shutdown_connections 2024-05-08T09:48:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.945+0000 7ff281ef4b80 1 -- 172.21.15.70:0/868992914 wait complete. 2024-05-08T09:48:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.945+0000 7ff281ef4b80 1 -- start start 2024-05-08T09:48:37.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff281ef4b80 1 Processor -- start 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 0x5569a5c1f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13e50 0x5569a5c1cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 0x5569a5c1d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569a5c20220 con 0x5569a5c13e50 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x5569a5acbc20 con 0x5569a5c18ec0 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x5569a5c203a0 con 0x5569a5c13490 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff281ef4b80 10 client.0 _ll_register_callbacks cb 0x5569a5b0cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff267e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13e50 0x5569a5c1cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff267e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13e50 0x5569a5c1cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37732/0 (socket says 172.21.15.70:37732) 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.946+0000 7ff267e00700 1 -- 172.21.15.70:0/4273802113 learned_addr learned my addr 172.21.15.70:0/4273802113 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff274c00700 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 0x5569a5c1f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff275600700 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 0x5569a5c1d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff267e00700 1 -- 172.21.15.70:0/4273802113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 msgr2=0x5569a5c1f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff267e00700 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 0x5569a5c1f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff267e00700 1 -- 172.21.15.70:0/4273802113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 msgr2=0x5569a5c1d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff267e00700 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 0x5569a5c1d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff267e00700 1 -- 172.21.15.70:0/4273802113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569a5b2b520 con 0x5569a5c13e50 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff267e00700 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13e50 0x5569a5c1cd50 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7ff25800efe0 tx=0x7ff2580aa330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9da9ae31697527 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff25ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.947+0000 7ff25ea00700 1 -- 172.21.15.70:0/4273802113 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2580c4310 con 0x5569a5c13e50 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.948+0000 7ff25ea00700 1 -- 172.21.15.70:0/4273802113 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(441..441 src has 1..441) ==== 9583+0+0 (secure 0 0 0) 0x7ff2580a90a0 con 0x5569a5c13e50 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.948+0000 7ff281ef4b80 1 -- 172.21.15.70:0/4273802113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2580a9c30 con 0x5569a5c13e50 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.948+0000 7ff25ea00700 1 -- 172.21.15.70:0/4273802113 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7ff2580b2a90 con 0x5569a5c13e50 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.948+0000 7ff281ef4b80 10 client.20067 fetch_fsmap learned FSMap version 45 2024-05-08T09:48:37.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.948+0000 7ff281ef4b80 1 -- 172.21.15.70:0/4273802113 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5569a5c20220 con 0x5569a5c13e50 2024-05-08T09:48:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.948+0000 7ff25ea00700 1 -- 172.21.15.70:0/4273802113 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2580a9c30 con 0x5569a5c13e50 2024-05-08T09:48:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.948+0000 7ff25ea00700 1 -- 172.21.15.70:0/4273802113 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7ff2580a8ac0 con 0x5569a5c13e50 2024-05-08T09:48:37.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.948+0000 7ff281ef4b80 10 client.20067 fetch_fsmap finished waiting for FSMap version 45 2024-05-08T09:48:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.948+0000 7ff281ef4b80 10 client.20067 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:48:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.949+0000 7ff281ef4b80 20 client.20067 populate_metadata read hostname 'smithi070' 2024-05-08T09:48:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.949+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5569a5c2cdf0 0x5569a5c2f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.949+0000 7ff281ef4b80 4 client.20067 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:48:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.949+0000 7ff281ef4b80 1 -- 172.21.15.70:0/4273802113 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569a5be01a0 con 0x5569a5c2cdf0 2024-05-08T09:48:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.949+0000 7ff274c00700 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5569a5c2cdf0 0x5569a5c2f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.950+0000 7ff274c00700 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5569a5c2cdf0 0x5569a5c2f1e0 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7413de05b899427 server_cookie=8c008963be77fc69 in_seq=0 out_seq=0 2024-05-08T09:48:37.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.950+0000 7ff25ea00700 10 client.20067 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:48:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff25ea00700 1 -- 172.21.15.70:0/4273802113 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5569a5be01a0 con 0x5569a5c2cdf0 2024-05-08T09:48:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff25ea00700 10 client.20067 handle_command_reply: tid=0 2024-05-08T09:48:37.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff281ef4b80 1 client.20067 shutdown 2024-05-08T09:48:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff281ef4b80 1 -- 172.21.15.70:0/4273802113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13e50 msgr2=0x5569a5c1cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13e50 0x5569a5c1cd50 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7ff25800efe0 tx=0x7ff2580aa330 comp rx=0 tx=0).stop 2024-05-08T09:48:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff281ef4b80 1 -- 172.21.15.70:0/4273802113 shutdown_connections 2024-05-08T09:48:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5569a5c2cdf0 0x5569a5c2f1e0 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c18ec0 0x5569a5c1d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 0x5569a5c1f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.952+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/4273802113 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c13e50 0x5569a5c1cd50 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.953+0000 7ff281ef4b80 1 -- 172.21.15.70:0/4273802113 >> 172.21.15.70:0/4273802113 conn(0x5569a5b41c60 msgr2=0x5569a5c08850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.953+0000 7ff25ea00700 0 client.20067 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:48:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.953+0000 7ff281ef4b80 1 -- 172.21.15.70:0/4273802113 shutdown_connections 2024-05-08T09:48:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.953+0000 7ff281ef4b80 1 -- 172.21.15.70:0/4273802113 wait complete. 2024-05-08T09:48:37.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.953+0000 7ff281ef4b80 20 client.20067 trim_cache size 0 max 16384 2024-05-08T09:48:37.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.975+0000 7ff281ef4b80 1 Processor -- start 2024-05-08T09:48:37.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.975+0000 7ff281ef4b80 1 -- start start 2024-05-08T09:48:37.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.975+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 0x5569a5c18780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.975+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13e50 0x5569a5c292b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.975+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c1eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.975+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701b4020 con 0x5569a5c18ec0 2024-05-08T09:48:37.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.975+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701b1850 con 0x5569a5c13e50 2024-05-08T09:48:37.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.975+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701af6c0 con 0x5569a5c13490 2024-05-08T09:48:37.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff275600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c1eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff275600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c1eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37734/0 (socket says 172.21.15.70:37734) 2024-05-08T09:48:37.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff275600700 1 -- 172.21.15.70:0/2747748841 learned_addr learned my addr 172.21.15.70:0/2747748841 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:37.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff274c00700 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 0x5569a5c18780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff267e00700 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13e50 0x5569a5c292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff275600700 1 -- 172.21.15.70:0/2747748841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 msgr2=0x5569a5c18780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:37.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff275600700 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 0x5569a5c18780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff275600700 1 -- 172.21.15.70:0/2747748841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13e50 msgr2=0x5569a5c292b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:37.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff275600700 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13e50 0x5569a5c292b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff275600700 1 -- 172.21.15.70:0/2747748841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569a5c1b2c0 con 0x5569a5c18ec0 2024-05-08T09:48:37.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff274c00700 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 0x5569a5c18780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:48:37.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.976+0000 7ff267e00700 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13e50 0x5569a5c292b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:48:37.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.977+0000 7ff275600700 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c1eac0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7ff268009310 tx=0x7ff268009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11f0d1316ad435d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:37.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.977+0000 7ff265600700 1 -- 172.21.15.70:0/2747748841 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff26800bca0 con 0x5569a5c18ec0 2024-05-08T09:48:37.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.977+0000 7ff265600700 1 -- 172.21.15.70:0/2747748841 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff268021070 con 0x5569a5c18ec0 2024-05-08T09:48:37.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.977+0000 7ff265600700 1 -- 172.21.15.70:0/2747748841 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268007c60 con 0x5569a5c18ec0 2024-05-08T09:48:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 -- 172.21.15.70:0/2747748841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 msgr2=0x5569a5c1eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c1eac0 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7ff268009310 tx=0x7ff268009340 comp rx=0 tx=0).stop 2024-05-08T09:48:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 -- 172.21.15.70:0/2747748841 shutdown_connections 2024-05-08T09:48:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c1eac0 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13490 0x5569a5c18780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/2747748841 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13e50 0x5569a5c292b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 -- 172.21.15.70:0/2747748841 >> 172.21.15.70:0/2747748841 conn(0x5569a5b41c60 msgr2=0x5569a5c1e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 -- 172.21.15.70:0/2747748841 shutdown_connections 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 -- 172.21.15.70:0/2747748841 wait complete. 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.978+0000 7ff281ef4b80 1 -- start start 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.979+0000 7ff281ef4b80 1 Processor -- start 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.979+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13490 0x5569a5c205f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.979+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 0x5569a5c20b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.979+0000 7ff281ef4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c21070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.979+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701afd10 con 0x5569a5c18ec0 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.979+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701b1180 con 0x5569a5c13490 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.979+0000 7ff281ef4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff2701b03e0 con 0x5569a5c13e50 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.979+0000 7ff281ef4b80 10 client.0 _ll_register_callbacks cb 0x5569a5b0cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:48:37.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff275600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c21070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff275600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c21070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37744/0 (socket says 172.21.15.70:37744) 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff275600700 1 -- 172.21.15.70:0/1677618941 learned_addr learned my addr 172.21.15.70:0/1677618941 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff274c00700 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13490 0x5569a5c205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff267e00700 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 0x5569a5c20b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff275600700 1 -- 172.21.15.70:0/1677618941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 msgr2=0x5569a5c20b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff275600700 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 0x5569a5c20b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff275600700 1 -- 172.21.15.70:0/1677618941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13490 msgr2=0x5569a5c205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff275600700 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13490 0x5569a5c205f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff275600700 1 -- 172.21.15.70:0/1677618941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569a5c9fe80 con 0x5569a5c18ec0 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff275600700 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c21070 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7ff26800b0d0 tx=0x7ff268007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbd51fcc5ae4ab11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:37.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.980+0000 7ff25ea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.981+0000 7ff25ea00700 1 -- 172.21.15.70:0/1677618941 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff268004e60 con 0x5569a5c18ec0 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.981+0000 7ff281ef4b80 1 -- 172.21.15.70:0/1677618941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff268021070 con 0x5569a5c18ec0 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.981+0000 7ff25ea00700 1 -- 172.21.15.70:0/1677618941 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(441..441 src has 1..441) ==== 9583+0+0 (secure 0 0 0) 0x7ff268005050 con 0x5569a5c18ec0 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.981+0000 7ff25ea00700 1 -- 172.21.15.70:0/1677618941 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7ff268005250 con 0x5569a5c18ec0 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.981+0000 7ff281ef4b80 10 client.20073 fetch_fsmap learned FSMap version 45 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.981+0000 7ff281ef4b80 1 -- 172.21.15.70:0/1677618941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5569a5ca11a0 con 0x5569a5c18ec0 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.981+0000 7ff25ea00700 1 -- 172.21.15.70:0/1677618941 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff268021070 con 0x5569a5c18ec0 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.982+0000 7ff25ea00700 1 -- 172.21.15.70:0/1677618941 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7ff268011070 con 0x5569a5c18ec0 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.982+0000 7ff281ef4b80 10 client.20073 fetch_fsmap finished waiting for FSMap version 45 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.982+0000 7ff281ef4b80 10 client.20073 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.982+0000 7ff281ef4b80 20 client.20073 populate_metadata read hostname 'smithi070' 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.982+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5569a5ca17e0 0x5569a5ca3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:37.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.982+0000 7ff281ef4b80 4 client.20073 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "346f06c0", "release": true, "await": true}] 2024-05-08T09:48:37.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.982+0000 7ff281ef4b80 1 -- 172.21.15.70:0/1677618941 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "set_id": "346f06c0", "release": true, "await": true}) -- 0x5569a5b73500 con 0x5569a5ca17e0 2024-05-08T09:48:37.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.982+0000 7ff274c00700 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5569a5ca17e0 0x5569a5ca3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:37.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.983+0000 7ff274c00700 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5569a5ca17e0 0x5569a5ca3c00 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2621bb8c48b984e1 server_cookie=b2ff92f486161b6 in_seq=0 out_seq=0 2024-05-08T09:48:37.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:37.983+0000 7ff25ea00700 10 client.20073 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:48:38.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:38 smithi172 ceph-mon[33377]: osdmap e441: 12 total, 12 up, 12 in 2024-05-08T09:48:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:38 smithi194 ceph-mon[33679]: osdmap e441: 12 total, 12 up, 12 in 2024-05-08T09:48:38.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:38 smithi070 ceph-mon[29591]: osdmap e441: 12 total, 12 up, 12 in 2024-05-08T09:48:39.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:39 smithi172 ceph-mon[33377]: pgmap v5811: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-05-08T09:48:39.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:39 smithi194 ceph-mon[33679]: pgmap v5811: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-05-08T09:48:39.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:39 smithi070 ceph-mon[29591]: pgmap v5811: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 6 op/s 2024-05-08T09:48:41.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:41 smithi172 ceph-mon[33377]: pgmap v5812: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T09:48:41.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:41 smithi194 ceph-mon[33679]: pgmap v5812: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T09:48:41.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:41 smithi070 ceph-mon[29591]: pgmap v5812: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T09:48:42.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.173+0000 7ff25ea00700 1 -- 172.21.15.70:0/1677618941 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x5569a5b73500 con 0x5569a5ca17e0 2024-05-08T09:48:42.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.173+0000 7ff25ea00700 10 client.20073 handle_command_reply: tid=0 2024-05-08T09:48:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.173+0000 7ff281ef4b80 1 client.20073 shutdown 2024-05-08T09:48:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.174+0000 7ff281ef4b80 1 -- 172.21.15.70:0/1677618941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 msgr2=0x5569a5c21070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.174+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c21070 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7ff26800b0d0 tx=0x7ff268007c00 comp rx=0 tx=0).stop 2024-05-08T09:48:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.174+0000 7ff281ef4b80 1 -- 172.21.15.70:0/1677618941 shutdown_connections 2024-05-08T09:48:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.174+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5569a5ca17e0 0x5569a5ca3c00 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:42.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.174+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569a5c18ec0 0x5569a5c21070 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:42.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.174+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5569a5c13490 0x5569a5c205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:42.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.174+0000 7ff281ef4b80 1 --2- 172.21.15.70:0/1677618941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5569a5c13e50 0x5569a5c20b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:42.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.174+0000 7ff281ef4b80 1 -- 172.21.15.70:0/1677618941 >> 172.21.15.70:0/1677618941 conn(0x5569a5b41c60 msgr2=0x5569a5c12d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:42.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.174+0000 7ff25ea00700 0 client.20073 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:48:42.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.175+0000 7ff281ef4b80 1 -- 172.21.15.70:0/1677618941 shutdown_connections 2024-05-08T09:48:42.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.175+0000 7ff281ef4b80 1 -- 172.21.15.70:0/1677618941 wait complete. 2024-05-08T09:48:42.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.175+0000 7ff281ef4b80 20 client.20073 trim_cache size 0 max 16384 2024-05-08T09:48:42.175 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 45, 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 396, 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "346f06c0": { 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 396, 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.7, 2024-05-08T09:48:42.176 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": false, 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RELEASED", 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:48:42.177 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:48:42.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.176+0000 7ff277600700 1 -- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2540b29f0 msgr2=0x7ff2540b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:42.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.176+0000 7ff277600700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2540b29f0 0x7ff2540b4eb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7ff260005fd0 tx=0x7ff260005f60 comp rx=0 tx=0).stop 2024-05-08T09:48:42.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.176+0000 7ff277600700 1 -- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 msgr2=0x7ff2701a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:42.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.176+0000 7ff277600700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 0x7ff2701a1d40 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7ff25800e9a0 tx=0x7ff25800ed60 comp rx=0 tx=0).stop 2024-05-08T09:48:42.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.176+0000 7ff277600700 1 -- 172.21.15.70:0/1063450612 shutdown_connections 2024-05-08T09:48:42.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.176+0000 7ff277600700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff2540b29f0 0x7ff2540b4eb0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:42.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.176+0000 7ff277600700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2701095d0 0x7ff27019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:42.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.177+0000 7ff277600700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff270103550 0x7ff2701a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:42.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.177+0000 7ff277600700 1 --2- 172.21.15.70:0/1063450612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff270103f10 0x7ff2701a1d40 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:42.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.177+0000 7ff277600700 1 -- 172.21.15.70:0/1063450612 >> 172.21.15.70:0/1063450612 conn(0x7ff27007a5f0 msgr2=0x7ff27010e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:42.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.177+0000 7ff277600700 1 -- 172.21.15.70:0/1063450612 shutdown_connections 2024-05-08T09:48:42.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:42.177+0000 7ff277600700 1 -- 172.21.15.70:0/1063450612 wait complete. 2024-05-08T09:48:42.811 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/v4l2.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/filelock.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/ib_mad.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/alarmtimer.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/iommu.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/sched.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/i2c.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/block.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rpm.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/page_isolation.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/sof_intel.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rwmmio.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/signal.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/percpu.h' 2024-05-08T09:48:42.812 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/scmi.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/nmi.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rcu.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/qdisc.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/nbd.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/fsi_master_gpio.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/pagemap.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/dlm.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/mptcp.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rseq.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/timer.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/f2fs.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/context_tracking.h' 2024-05-08T09:48:42.813 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/vsock_virtio_transport_common.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/pwc.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/io_uring.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/mdio.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/lock.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/page_ref.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/9p.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/ksm.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/iscsi.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/devlink.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/fscache.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/clk.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/netfs.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/libata.h' 2024-05-08T09:48:42.814 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/vmalloc.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/kmem.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/ipi.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/netlink.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/rv.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/damon.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/task.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/ib_umad.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/events/workqueue.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/trace/events' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/trace_custom_events.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/trace_events.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/stages/stage7_class_define.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/stages/stage4_event_fields.h' 2024-05-08T09:48:42.815 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/stages/stage5_get_offsets.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/stages/stage3_trace_output.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/stages/stage2_data_offsets.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/stages/init.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/stages/stage6_event_callback.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/stages/stage1_struct_define.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/trace/stages' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/misc/rdma.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/misc/sunrpc.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/misc/nfs.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/misc/fs.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/trace/misc' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/trace/bpf_probe.h' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/trace' 2024-05-08T09:48:42.816 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mediatek/smi.h' 2024-05-08T09:48:42.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/mediatek' 2024-05-08T09:48:42.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/bcm2835/raspberrypi-firmware.h' 2024-05-08T09:48:42.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/bcm2835' 2024-05-08T09:48:42.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/qcom/rpmh.h' 2024-05-08T09:48:42.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/qcom/cmd-db.h' 2024-05-08T09:48:42.817 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/qcom/spm.h' 2024-05-08T09:48:43.068 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '346f06c0', seconds elapsed: 67.1 2024-05-08T09:48:43.069 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.7 2024-05-08T09:48:43.069 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:48:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:43 smithi070 ceph-mon[29591]: pgmap v5813: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T09:48:43.381 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:43 smithi070 ceph-mon[29591]: osdmap e442: 12 total, 12 up, 12 in 2024-05-08T09:48:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:43 smithi172 ceph-mon[33377]: pgmap v5813: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T09:48:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:43 smithi172 ceph-mon[33377]: osdmap e442: 12 total, 12 up, 12 in 2024-05-08T09:48:43.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:43 smithi194 ceph-mon[33679]: pgmap v5813: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T09:48:43.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:43 smithi194 ceph-mon[33679]: osdmap e442: 12 total, 12 up, 12 in 2024-05-08T09:48:43.535 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:48:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/qcom/kryo-l2-accessors.h' 2024-05-08T09:48:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/qcom/qcom-spmi-pmic.h' 2024-05-08T09:48:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/qcom/tcs.h' 2024-05-08T09:48:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/qcom/ice.h' 2024-05-08T09:48:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/qcom/ocmem.h' 2024-05-08T09:48:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/qcom' 2024-05-08T09:48:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/microchip/mpfs.h' 2024-05-08T09:48:44.032 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/microchip' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/dpaa2-global.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/caam-blob.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/qe/immap_qe.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/qe/qe_tdm.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/qe/ucc_fast.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/qe/qe.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/qe/qmc.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/qe/ucc.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/qe/ucc_slow.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/fsl/qe' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/bman.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/dpaa2-fd.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/dpaa2-io.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/cpm.h' 2024-05-08T09:48:44.033 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/fsl/qman.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/fsl' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mscc/ocelot_sys.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mscc/ocelot_ana.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mscc/ocelot_hsio.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mscc/ocelot_ptp.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mscc/ocelot_vcap.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mscc/ocelot_qsys.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mscc/vsc7514_regs.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mscc/ocelot.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/mscc/ocelot_dev.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/mscc' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/rockchip/rockchip_sip.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/rockchip/pm_domains.h' 2024-05-08T09:48:44.034 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/rockchip/rk3399_grf.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/rockchip' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/canaan/k210-sysctl.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/canaan' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/sifive/sifive_ccache.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/sifive' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/pm.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/cpuidle.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/ahb.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/irq.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/common.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/flowctrl.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/ivc.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/mc.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/fuse.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/tegra-cbb.h' 2024-05-08T09:48:44.035 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/bpmp-abi.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/bpmp.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/tegra/pmc.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/tegra' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/amlogic/meson_ddr_pmu.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/amlogic' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/sa1100/pwer.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/sa1100' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/at91/atmel_tcb.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/at91/at91sam9_ddrsdr.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/at91/sama7-sfrbu.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/at91/atmel-secumod.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/at91/atmel-sfr.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/at91/at91sam9_sdramc.h' 2024-05-08T09:48:44.036 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/at91/sama7-ddr.h' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/at91' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/imx/cpu.h' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/imx/cpuidle.h' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/imx/revision.h' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/imx' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/starfive/reset-starfive-jh71x0.h' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/starfive' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/arc/timers.h' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/arc/mcip.h' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/soc/arc/aux.h' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc/arc' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/soc' 2024-05-08T09:48:44.037 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/clocksource/arm_arch_timer.h' 2024-05-08T09:48:44.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/clocksource/timer-xilinx.h' 2024-05-08T09:48:44.891 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/clocksource/samsung_pwm.h' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/clocksource/timer-goldfish.h' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/clocksource/hyperv_timer.h' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/clocksource/pxa.h' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/clocksource/timer-davinci.h' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/clocksource/timer-ti-dm.h' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/clocksource/timer-riscv.h' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/clocksource' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/actbl2.h' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acbuffer.h' 2024-05-08T09:48:44.892 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acpi_numa.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/button.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acpi_lpat.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/video.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/pcc.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/pdc_intel.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/hed.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acpi.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/cppc_acpi.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/nfit.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acpi_bus.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acpi_io.h' 2024-05-08T09:48:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acrestyp.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acpi_drivers.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/processor.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/actypes.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/battery.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/apei.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/reboot.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acnames.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/actbl.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acexcep.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/ghes.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acpiosxf.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/actbl1.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/actbl3.h' 2024-05-08T09:48:44.894 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acuuid.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acconfig.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acoutput.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/platform/aclinux.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/platform/acgccex.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/platform/aclinuxex.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/platform/acgcc.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/platform/aczephyr.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/platform/acenv.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/platform/acenvex.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/acpi/platform' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/acpi/acpixf.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/acpi' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_atomic_state_helper.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_crtc.h' 2024-05-08T09:48:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_color_mgmt.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_device.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/gud.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_auth.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_atomic_helper.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_rect.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_probe_helper.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_panel.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_modeset_helper.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_drv.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_sysfs.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/spsc_queue.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_flip_work.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_client.h' 2024-05-08T09:48:44.896 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_ioctl.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/i915_pciids.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_modeset_helper_vtables.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/intel-gtt.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/amd_asic_type.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_gem_vram_helper.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_crtc_helper.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_gem_ttm_helper.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_self_refresh_helper.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_audio_component.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_bridge.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_connector.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_mm.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_cache.h' 2024-05-08T09:48:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_plane_helper.h' 2024-05-08T09:48:44.898 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_vma_manager.h' 2024-05-08T09:48:45.294 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:45 smithi070 ceph-mon[29591]: pgmap v5815: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-05-08T09:48:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:45 smithi172 ceph-mon[33377]: pgmap v5815: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-05-08T09:48:45.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:45 smithi194 ceph-mon[33679]: pgmap v5815: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 3 op/s 2024-05-08T09:48:45.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.822+0000 7fec82c00700 1 -- 172.21.15.70:0/121392725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c075ff0 msgr2=0x7fec7c114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:45.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.822+0000 7fec82c00700 1 --2- 172.21.15.70:0/121392725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c075ff0 0x7fec7c114130 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fec68009990 tx=0x7fec68009ca0 comp rx=0 tx=0).stop 2024-05-08T09:48:45.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.822+0000 7fec82c00700 1 -- 172.21.15.70:0/121392725 shutdown_connections 2024-05-08T09:48:45.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.822+0000 7fec82c00700 1 --2- 172.21.15.70:0/121392725 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c114670 0x7fec7c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:45.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.822+0000 7fec82c00700 1 --2- 172.21.15.70:0/121392725 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c0756d0 0x7fec7c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:45.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.822+0000 7fec82c00700 1 --2- 172.21.15.70:0/121392725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c075ff0 0x7fec7c114130 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:45.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.822+0000 7fec82c00700 1 -- 172.21.15.70:0/121392725 >> 172.21.15.70:0/121392725 conn(0x7fec7c07a600 msgr2=0x7fec7c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:45.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.822+0000 7fec82c00700 1 -- 172.21.15.70:0/121392725 shutdown_connections 2024-05-08T09:48:45.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.822+0000 7fec82c00700 1 -- 172.21.15.70:0/121392725 wait complete. 2024-05-08T09:48:45.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.823+0000 7fec82c00700 1 Processor -- start 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.823+0000 7fec82c00700 1 -- start start 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec82c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c0756d0 0x7fec7c1a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec82c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c075ff0 0x7fec7c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec82c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c114670 0x7fec7c1a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec82c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c119b80 con 0x7fec7c114670 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec82c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c119a00 con 0x7fec7c0756d0 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec82c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c119d00 con 0x7fec7c075ff0 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec80c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c114670 0x7fec7c1a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec80c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c114670 0x7fec7c1a49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37762/0 (socket says 172.21.15.70:37762) 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec80c00700 1 -- 172.21.15.70:0/564549577 learned_addr learned my addr 172.21.15.70:0/564549577 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:45.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec7b400700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c075ff0 0x7fec7c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:45.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec7be00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c0756d0 0x7fec7c1a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:45.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec80c00700 1 -- 172.21.15.70:0/564549577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c075ff0 msgr2=0x7fec7c1a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:45.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.824+0000 7fec80c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c075ff0 0x7fec7c1a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:45.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.825+0000 7fec80c00700 1 -- 172.21.15.70:0/564549577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c0756d0 msgr2=0x7fec7c1a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:45.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.825+0000 7fec80c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c0756d0 0x7fec7c1a00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:45.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.825+0000 7fec80c00700 1 -- 172.21.15.70:0/564549577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c1a5100 con 0x7fec7c114670 2024-05-08T09:48:45.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.825+0000 7fec7b400700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c075ff0 0x7fec7c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:48:45.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.825+0000 7fec80c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c114670 0x7fec7c1a49c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fec740094f0 tx=0x7fec74007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:45.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.825+0000 7fec78c00700 1 -- 172.21.15.70:0/564549577 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74004db0 con 0x7fec7c114670 2024-05-08T09:48:45.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.825+0000 7fec78c00700 1 -- 172.21.15.70:0/564549577 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec74005020 con 0x7fec7c114670 2024-05-08T09:48:45.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.825+0000 7fec78c00700 1 -- 172.21.15.70:0/564549577 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74015660 con 0x7fec7c114670 2024-05-08T09:48:45.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.825+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c1a53f0 con 0x7fec7c114670 2024-05-08T09:48:45.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.826+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c1acc70 con 0x7fec7c114670 2024-05-08T09:48:45.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.827+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c06a190 con 0x7fec7c114670 2024-05-08T09:48:45.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.829+0000 7fec78c00700 1 -- 172.21.15.70:0/564549577 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fec740051d0 con 0x7fec7c114670 2024-05-08T09:48:45.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.831+0000 7fec78c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec600b29f0 0x7fec600b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:45.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.831+0000 7fec78c00700 1 -- 172.21.15.70:0/564549577 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7fec740e24e0 con 0x7fec7c114670 2024-05-08T09:48:45.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.831+0000 7fec7be00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec600b29f0 0x7fec600b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:45.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.832+0000 7fec7be00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec600b29f0 0x7fec600b4eb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009bf0 tx=0x7fec6c009260 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:45.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:45.836+0000 7fec78c00700 1 -- 172.21.15.70:0/564549577 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fec74010070 con 0x7fec7c114670 2024-05-08T09:48:45.874 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_framebuffer.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_print.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_modes.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_debugfs_crc.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/gma_drm.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_lease.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_encoder.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_prime.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_mipi_dbi.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/i915_pxp_tee_interface.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/task_barrier.h' 2024-05-08T09:48:45.875 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_debugfs.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/gpu_scheduler.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_format_helper.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_gem_framebuffer_helper.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_property.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_privacy_screen_consumer.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_utils.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_syncobj.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_gem.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_modeset_lock.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_util.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_mipi_dsi.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_vblank_work.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_legacy.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_fixed.h' 2024-05-08T09:48:45.876 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_of.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_gem_dma_helper.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/bridge/samsung-dsim.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/bridge/dw_hdmi.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/bridge/analogix_dp.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/bridge/dw_mipi_dsi.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/bridge/mhl.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/drm/bridge' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_mode_config.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/i915_gsc_proxy_mei_interface.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_file.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_managed.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_blend.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_edid.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_simple_kms_helper.h' 2024-05-08T09:48:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_atomic.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_fb_dma_helper.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_module.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/i915_hdcp_interface.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_suballoc.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_fourcc.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_fbdev_dma.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_pciids.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_aperture.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_atomic_uapi.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_buddy.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_bridge_connector.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_fb_helper.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_range_manager.h' 2024-05-08T09:48:45.878 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_pool.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_resource.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_caching.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_tt.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_device.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_bo.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_placement.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_execbuf_util.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/ttm/ttm_kmap_iter.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/drm/ttm' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/i2c/sil164.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/i2c/ch7006.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/i2c/tda998x.h' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/drm/i2c' 2024-05-08T09:48:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_privacy_screen_driver.h' 2024-05-08T09:48:45.880 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_damage_helper.h' 2024-05-08T09:48:45.880 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_gem_atomic_helper.h' 2024-05-08T09:48:45.880 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_kunit_helpers.h' 2024-05-08T09:48:45.880 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/i915_component.h' 2024-05-08T09:48:45.880 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_encoder_slave.h' 2024-05-08T09:48:45.880 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_displayid.h' 2024-05-08T09:48:45.880 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_plane.h' 2024-05-08T09:48:45.880 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_writeback.h' 2024-05-08T09:48:45.880 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_accel.h' 2024-05-08T09:48:46.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.127+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec7c1ace40 con 0x7fec7c114670 2024-05-08T09:48:46.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.128+0000 7fec78c00700 1 -- 172.21.15.70:0/564549577 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11879 (secure 0 0 0) 0x7fec740a9a60 con 0x7fec7c114670 2024-05-08T09:48:46.127 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:48:46.128 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":45,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:46:54.433805+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T09:48:46.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec600b29f0 msgr2=0x7fec600b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:46.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec600b29f0 0x7fec600b4eb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009bf0 tx=0x7fec6c009260 comp rx=0 tx=0).stop 2024-05-08T09:48:46.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c114670 msgr2=0x7fec7c1a49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:46.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c114670 0x7fec7c1a49c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fec740094f0 tx=0x7fec74007f90 comp rx=0 tx=0).stop 2024-05-08T09:48:46.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 shutdown_connections 2024-05-08T09:48:46.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec600b29f0 0x7fec600b4eb0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:46.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fec7c114670 0x7fec7c1a49c0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:46.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fec7c0756d0 0x7fec7c1a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:46.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 --2- 172.21.15.70:0/564549577 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec7c075ff0 0x7fec7c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:46.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 >> 172.21.15.70:0/564549577 conn(0x7fec7c07a600 msgr2=0x7fec7c110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:46.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 shutdown_connections 2024-05-08T09:48:46.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:46.132+0000 7fec82c00700 1 -- 172.21.15.70:0/564549577 wait complete. 2024-05-08T09:48:46.133 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 45 2024-05-08T09:48:46.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:46 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/564549577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:48:46.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:46 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/564549577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_vblank.h' 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_privacy_screen_machine.h' 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_scdc_helper.h' 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_dp_dual_mode_helper.h' 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_dp_mst_helper.h' 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_hdcp_helper.h' 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_hdcp.h' 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_dp_aux_bus.h' 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_scdc.h' 2024-05-08T09:48:46.786 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_dp.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_dsc.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_hdmi_helper.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_dp_helper.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/display/drm_dsc_helper.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/drm/display' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/i915_drm.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_fbdev_generic.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_mode_object.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/intel_lpe_audio.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/drm/drm_gem_shmem_helper.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/drm' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/features.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/xen.h' 2024-05-08T09:48:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/hvm/hvm_op.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/hvm/hvm_vcpu.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/hvm/params.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/hvm/start_info.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/hvm/dm_op.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/xen/interface/hvm' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/callback.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/physdev.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/xen-mca.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/grant_table.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/platform.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/xenpmu.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/version.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/netif.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/pciif.h' 2024-05-08T09:48:46.788 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/console.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/pvcalls.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/xs_wire.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/fbif.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/protocols.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/usbif.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/ring.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/blkif.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/9pfs.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/kbdif.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/sndif.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/tpmif.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/vscsiif.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/displif.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/io/xenbus.h' 2024-05-08T09:48:46.789 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/xen/interface/io' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/sched.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/event_channel.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/elfnote.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/nmi.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/memory.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/interface/vcpu.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/xen/interface' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/features.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/arm/page.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/arm/xen-ops.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/arm/hypervisor.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/arm/swiotlb-xen.h' 2024-05-08T09:48:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/arm/hypercall.h' 2024-05-08T09:48:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/arm/interface.h' 2024-05-08T09:48:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/xen/arm' 2024-05-08T09:48:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/xen.h' 2024-05-08T09:48:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/platform_pci.h' 2024-05-08T09:48:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/xenbus_dev.h' 2024-05-08T09:48:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/page.h' 2024-05-08T09:48:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/acpi.h' 2024-05-08T09:48:46.791 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/pci.h' 2024-05-08T09:48:47.001 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db / --timeout 60 --expiration 78.7 --await-for 42.0' 2024-05-08T09:48:47.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db / --timeout 60 --expiration 78.7 --await-for 42.0 2024-05-08T09:48:47.507 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:48:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:46 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/564549577' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:48:47.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:47 smithi194 ceph-mon[33679]: pgmap v5816: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 479 KiB/s wr, 9 op/s 2024-05-08T09:48:47.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:47 smithi070 ceph-mon[29591]: pgmap v5816: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 479 KiB/s wr, 9 op/s 2024-05-08T09:48:47.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:47 smithi172 ceph-mon[33377]: pgmap v5816: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 479 KiB/s wr, 9 op/s 2024-05-08T09:48:47.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/events.h' 2024-05-08T09:48:47.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/xen-ops.h' 2024-05-08T09:48:47.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/mem-reservation.h' 2024-05-08T09:48:47.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/hvc-console.h' 2024-05-08T09:48:47.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/hvm.h' 2024-05-08T09:48:47.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/grant_table.h' 2024-05-08T09:48:47.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/balloon.h' 2024-05-08T09:48:47.729 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/xen-front-pgdir-shbuf.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/swiotlb-xen.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/xen/xenbus.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/xen' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rv/instrumentation.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rv/da_monitor.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/rv/automata.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/rv' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/asoc.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/sfnt_info.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/usb_stream.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/firewire.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/emu10k1.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/asequencer.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/snd_ar_tokens.h' 2024-05-08T09:48:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/hdsp.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/asound_fm.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/sb16_csp.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/asound.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/tlv.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/compress_params.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/intel/avs/tokens.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/sound/intel/avs' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/sound/intel' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/sof/tokens.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/sof/abi.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/sof/header.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/sof/fw.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/sound/sof' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/snd_sst_tokens.h' 2024-05-08T09:48:47.731 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/hdspm.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/skl-tplg-interface.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/sound/compress_offload.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/sound' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/cxgb4-abi.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/mthca-abi.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/rdma_user_rxe.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/rvt-abi.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/hfi/hfi1_user.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/hfi/hfi1_ioctl.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/rdma/hfi' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/qedr-abi.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/ib_user_ioctl_cmds.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/erdma-abi.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/ib_user_mad.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/siw-abi.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/ib_user_verbs.h' 2024-05-08T09:48:47.732 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/ib_user_sa.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/ib_user_ioctl_verbs.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/rdma_user_cm.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/ocrdma-abi.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/efa-abi.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/rdma_user_ioctl_cmds.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/mlx5-abi.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/mana-abi.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/mlx5_user_ioctl_verbs.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/mlx4-abi.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/irdma-abi.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/vmw_pvrdma-abi.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/bnxt_re-abi.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/mlx5_user_ioctl_cmds.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/rdma_user_ioctl.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/hns-abi.h' 2024-05-08T09:48:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/rdma/rdma_netlink.h' 2024-05-08T09:48:47.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/rdma' 2024-05-08T09:48:47.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/statfs.h' 2024-05-08T09:48:47.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/kvm_para.h' 2024-05-08T09:48:47.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/ipcbuf.h' 2024-05-08T09:48:47.734 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/socket.h' 2024-05-08T09:48:48.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:48 smithi194 ceph-mon[33679]: pgmap v5817: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 399 KiB/s wr, 8 op/s 2024-05-08T09:48:48.551 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/hugetlb_encode.h' 2024-05-08T09:48:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/termios.h' 2024-05-08T09:48:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/int-l64.h' 2024-05-08T09:48:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/resource.h' 2024-05-08T09:48:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/errno-base.h' 2024-05-08T09:48:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/bpf_perf_event.h' 2024-05-08T09:48:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/int-ll64.h' 2024-05-08T09:48:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/bitsperlong.h' 2024-05-08T09:48:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/poll.h' 2024-05-08T09:48:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/posix_types.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/signal-defs.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/swab.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/termbits.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/types.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/setup.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/mman-common.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/stat.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/unistd.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/ioctls.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/ucontext.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/shmbuf.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/mman.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/param.h' 2024-05-08T09:48:48.554 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/msgbuf.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/auxvec.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/signal.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/termbits-common.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/sembuf.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/ioctl.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/fcntl.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/siginfo.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/sockios.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/Kbuild' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/asm-generic/errno.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/asm-generic' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/drm.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/habanalabs_accel.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/ivpu_accel.h' 2024-05-08T09:48:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/tegra_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/msm_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/lima_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/panfrost_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/qaic_accel.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/radeon_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/vc4_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/exynos_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/vmwgfx_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/qxl_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/nouveau_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/drm_fourcc.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/drm_sarea.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/vgem_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/amdgpu_drm.h' 2024-05-08T09:48:48.556 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/v3d_drm.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/omap_drm.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/virtgpu_drm.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/etnaviv_drm.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/armada_drm.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/i915_drm.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/drm/drm_mode.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/drm' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/xen/gntdev.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/xen/evtchn.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/xen/privcmd.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/xen/gntalloc.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/xen' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/mtd/mtd-abi.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/mtd/nftl-user.h' 2024-05-08T09:48:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/mtd/mtd-user.h' 2024-05-08T09:48:48.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/mtd/inftl-user.h' 2024-05-08T09:48:48.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/mtd/ubi-user.h' 2024-05-08T09:48:48.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed directory 'linux-6.5.11/include/uapi/mtd' 2024-05-08T09:48:48.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/misc/cxl.h' 2024-05-08T09:48:48.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/misc/fastrpc.h' 2024-05-08T09:48:48.558 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/misc/ocxl.h' 2024-05-08T09:48:48.581 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:48 smithi172 ceph-mon[33377]: pgmap v5817: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 399 KiB/s wr, 8 op/s 2024-05-08T09:48:48.601 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:48 smithi070 ceph-mon[29591]: pgmap v5817: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 399 KiB/s wr, 8 op/s 2024-05-08T09:48:49.254 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-05-08T09:48:49.255 INFO:tasks.workunit.client.0.smithi070.stdout:removed 'linux-6.5.11/include/uapi/misc/uacce/ 2024-05-08T09:48:49.256 INFO:tasks.workunit:Stopping ['kernel_untar_build.sh'] on client.0... 2024-05-08T09:48:49.256 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T09:48:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.893+0000 7ff441800700 1 -- 172.21.15.70:0/3201047941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c104160 msgr2=0x7ff43c1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.893+0000 7ff441800700 1 --2- 172.21.15.70:0/3201047941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c104160 0x7ff43c1080c0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7ff4240099c0 tx=0x7ff424009cd0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.893+0000 7ff441800700 1 -- 172.21.15.70:0/3201047941 shutdown_connections 2024-05-08T09:48:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.893+0000 7ff441800700 1 --2- 172.21.15.70:0/3201047941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43c1087a0 0x7ff43c1103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.893+0000 7ff441800700 1 --2- 172.21.15.70:0/3201047941 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c1037b0 0x7ff43c103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.893+0000 7ff441800700 1 --2- 172.21.15.70:0/3201047941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c104160 0x7ff43c1080c0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.893+0000 7ff441800700 1 -- 172.21.15.70:0/3201047941 >> 172.21.15.70:0/3201047941 conn(0x7ff43c07a570 msgr2=0x7ff43c07a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:49.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.893+0000 7ff441800700 1 -- 172.21.15.70:0/3201047941 shutdown_connections 2024-05-08T09:48:49.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.893+0000 7ff441800700 1 -- 172.21.15.70:0/3201047941 wait complete. 2024-05-08T09:48:49.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.894+0000 7ff441800700 1 Processor -- start 2024-05-08T09:48:49.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.894+0000 7ff441800700 1 -- start start 2024-05-08T09:48:49.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.894+0000 7ff441800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43c1037b0 0x7ff43c1a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.894+0000 7ff441800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c104160 0x7ff43c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.894+0000 7ff441800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c1087a0 0x7ff43c19bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.894+0000 7ff441800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c113650 con 0x7ff43c1087a0 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.894+0000 7ff441800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1134d0 con 0x7ff43c104160 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.894+0000 7ff441800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1137d0 con 0x7ff43c1037b0 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff43b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c1087a0 0x7ff43c19bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff43b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c1087a0 0x7ff43c19bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52638/0 (socket says 172.21.15.70:52638) 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff43b400700 1 -- 172.21.15.70:0/3289548651 learned_addr learned my addr 172.21.15.70:0/3289548651 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff43aa00700 1 --2- 172.21.15.70:0/3289548651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43c1037b0 0x7ff43c1a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff432000700 1 --2- 172.21.15.70:0/3289548651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c104160 0x7ff43c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff43b400700 1 -- 172.21.15.70:0/3289548651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43c1037b0 msgr2=0x7ff43c1a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff43b400700 1 --2- 172.21.15.70:0/3289548651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43c1037b0 0x7ff43c1a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff43b400700 1 -- 172.21.15.70:0/3289548651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c104160 msgr2=0x7ff43c1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff43b400700 1 --2- 172.21.15.70:0/3289548651 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ff43c104160 0x7ff43c1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.895+0000 7ff43b400700 1 -- 172.21.15.70:0/3289548651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c19c400 con 0x7ff43c1087a0 2024-05-08T09:48:49.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.896+0000 7ff43b400700 1 --2- 172.21.15.70:0/3289548651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff43c1087a0 0x7ff43c19bb20 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7ff43400b550 tx=0x7ff43400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.896+0000 7ff433e00700 1 -- 172.21.15.70:0/3289548651 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434015020 con 0x7ff43c1087a0 2024-05-08T09:48:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.896+0000 7ff433e00700 1 -- 172.21.15.70:0/3289548651 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff434011cc0 con 0x7ff43c1087a0 2024-05-08T09:48:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.896+0000 7ff433e00700 1 -- 172.21.15.70:0/3289548651 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff434010c80 con 0x7ff43c1087a0 2024-05-08T09:48:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.896+0000 7ff441800700 1 -- 172.21.15.70:0/3289548651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c19c6f0 con 0x7ff43c1087a0 2024-05-08T09:48:49.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.896+0000 7ff441800700 1 -- 172.21.15.70:0/3289548651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c1a89d0 con 0x7ff43c1087a0 2024-05-08T09:48:49.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.899+0000 7ff433e00700 1 -- 172.21.15.70:0/3289548651 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff434018020 con 0x7ff43c1087a0 2024-05-08T09:48:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.901+0000 7ff44c1cbb80 1 Processor -- start 2024-05-08T09:48:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.901+0000 7ff433e00700 1 --2- 172.21.15.70:0/3289548651 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff4200b2b20 0x7ff4200b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.901+0000 7ff44c1cbb80 1 -- start start 2024-05-08T09:48:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.901+0000 7ff433e00700 1 -- 172.21.15.70:0/3289548651 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7ff4340e1ff0 con 0x7ff43c1087a0 2024-05-08T09:48:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.901+0000 7ff432000700 1 --2- 172.21.15.70:0/3289548651 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff4200b2b20 0x7ff4200b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.901+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb83e240 0x564ffb83e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb838c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb8391d0 0x564ffb845000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564ffb78abb0 con 0x564ffb838810 2024-05-08T09:48:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ffb7288f0 con 0x564ffb83e240 2024-05-08T09:48:49.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564ffb786b70 con 0x564ffb8391d0 2024-05-08T09:48:49.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff43aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb83e240 0x564ffb83e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff43aa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb83e240 0x564ffb83e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:38510/0 (socket says 172.21.15.70:38510) 2024-05-08T09:48:49.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff43aa00700 1 -- 172.21.15.70:0/3650516289 learned_addr learned my addr 172.21.15.70:0/3650516289 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff43b400700 1 --2- 172.21.15.70:0/3650516289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb8391d0 0x564ffb845000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff432000700 1 --2- 172.21.15.70:0/3650516289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb838c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.902+0000 7ff432000700 1 --2- 172.21.15.70:0/3289548651 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ff4200b2b20 0x7ff4200b4fe0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7ff424009990 tx=0x7ff42401a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.903+0000 7ff432000700 1 -- 172.21.15.70:0/3650516289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb8391d0 msgr2=0x564ffb845000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.903+0000 7ff432000700 1 --2- 172.21.15.70:0/3650516289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb8391d0 0x564ffb845000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.903+0000 7ff432000700 1 -- 172.21.15.70:0/3650516289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb83e240 msgr2=0x564ffb83e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.903+0000 7ff432000700 1 --2- 172.21.15.70:0/3650516289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb83e240 0x564ffb83e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.903+0000 7ff432000700 1 -- 172.21.15.70:0/3650516289 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ffb6d7a60 con 0x564ffb838810 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.903+0000 7ff432000700 1 --2- 172.21.15.70:0/3650516289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb838c90 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7ff4240098e0 tx=0x7ff42401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe538aa6c41d6049 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.903+0000 7ff42be00700 1 -- 172.21.15.70:0/3650516289 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424005430 con 0x564ffb838810 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.904+0000 7ff42be00700 1 -- 172.21.15.70:0/3650516289 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff424004b20 con 0x564ffb838810 2024-05-08T09:48:49.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.904+0000 7ff42be00700 1 -- 172.21.15.70:0/3650516289 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42400f8d0 con 0x564ffb838810 2024-05-08T09:48:49.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.904+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3650516289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 msgr2=0x564ffb838c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:49.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.904+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3650516289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb838c90 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7ff4240098e0 tx=0x7ff42401e000 comp rx=0 tx=0).stop 2024-05-08T09:48:49.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.904+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3650516289 shutdown_connections 2024-05-08T09:48:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.904+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3650516289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb8391d0 0x564ffb845000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.904+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3650516289 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb83e240 0x564ffb83e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.904+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3650516289 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb838c90 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.904+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3650516289 >> 172.21.15.70:0/3650516289 conn(0x564ffb7b0860 msgr2=0x564ffb833100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.905+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3650516289 shutdown_connections 2024-05-08T09:48:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.905+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3650516289 wait complete. 2024-05-08T09:48:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.905+0000 7ff44c1cbb80 1 -- start start 2024-05-08T09:48:49.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.906+0000 7ff44c1cbb80 1 Processor -- start 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.906+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb838810 0x564ffb844bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.906+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 0x564ffb841f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.906+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb83e240 0x564ffb842490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.906+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564ffb8455a0 con 0x564ffb83e240 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.906+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x564ffb6f0cb0 con 0x564ffb8391d0 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.906+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x564ffb845720 con 0x564ffb838810 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.906+0000 7ff44c1cbb80 10 client.0 _ll_register_callbacks cb 0x564ffb731e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.906+0000 7ff43b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb83e240 0x564ffb842490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff43b400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb83e240 0x564ffb842490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52650/0 (socket says 172.21.15.70:52650) 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff43b400700 1 -- 172.21.15.70:0/3089852692 learned_addr learned my addr 172.21.15.70:0/3089852692 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:49.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff43aa00700 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb838810 0x564ffb844bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff432000700 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 0x564ffb841f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff43b400700 1 -- 172.21.15.70:0/3089852692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb838810 msgr2=0x564ffb844bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff43b400700 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb838810 0x564ffb844bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff43b400700 1 -- 172.21.15.70:0/3089852692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 msgr2=0x564ffb841f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff43b400700 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 0x564ffb841f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff43b400700 1 -- 172.21.15.70:0/3089852692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ffb7505b0 con 0x564ffb83e240 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff43b400700 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb83e240 0x564ffb842490 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7ff43400bfd0 tx=0x7ff4340a96c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b81c1de79b795be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff428c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff428c00700 1 -- 172.21.15.70:0/3089852692 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4340c2070 con 0x564ffb83e240 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff428c00700 1 -- 172.21.15.70:0/3089852692 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7ff4340a9220 con 0x564ffb83e240 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.907+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3089852692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff424004b20 con 0x564ffb83e240 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff428c00700 1 -- 172.21.15.70:0/3089852692 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7ff4340b1e20 con 0x564ffb83e240 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff44c1cbb80 10 client.20091 fetch_fsmap learned FSMap version 45 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3089852692 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x564ffb84fd40 con 0x564ffb83e240 2024-05-08T09:48:49.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff428c00700 1 -- 172.21.15.70:0/3089852692 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff424004b20 con 0x564ffb83e240 2024-05-08T09:48:49.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff428c00700 1 -- 172.21.15.70:0/3089852692 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7ff4340ab050 con 0x564ffb83e240 2024-05-08T09:48:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff44c1cbb80 10 client.20091 fetch_fsmap finished waiting for FSMap version 45 2024-05-08T09:48:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff44c1cbb80 10 client.20091 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:48:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff44c1cbb80 20 client.20091 populate_metadata read hostname 'smithi070' 2024-05-08T09:48:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564ffb852380 0x564ffb854770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff44c1cbb80 4 client.20091 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:48:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.908+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3089852692 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ffb8052d0 con 0x564ffb852380 2024-05-08T09:48:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.909+0000 7ff43aa00700 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564ffb852380 0x564ffb854770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.910+0000 7ff43aa00700 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564ffb852380 0x564ffb854770 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d5fb14cf566143a server_cookie=f07eabd1568da7e2 in_seq=0 out_seq=0 2024-05-08T09:48:49.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.910+0000 7ff428c00700 10 client.20091 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:48:49.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.912+0000 7ff428c00700 1 -- 172.21.15.70:0/3089852692 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564ffb8052d0 con 0x564ffb852380 2024-05-08T09:48:49.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.912+0000 7ff428c00700 10 client.20091 handle_command_reply: tid=0 2024-05-08T09:48:49.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.912+0000 7ff44c1cbb80 1 client.20091 shutdown 2024-05-08T09:48:49.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.912+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3089852692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb83e240 msgr2=0x564ffb842490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:49.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.912+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb83e240 0x564ffb842490 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7ff43400bfd0 tx=0x7ff4340a96c0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3089852692 shutdown_connections 2024-05-08T09:48:49.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564ffb852380 0x564ffb854770 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb83e240 0x564ffb842490 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb838810 0x564ffb844bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3089852692 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 0x564ffb841f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff428c00700 0 client.20091 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:48:49.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3089852692 >> 172.21.15.70:0/3089852692 conn(0x564ffb7b0860 msgr2=0x564ffb82dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:49.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3089852692 shutdown_connections 2024-05-08T09:48:49.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3089852692 wait complete. 2024-05-08T09:48:49.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.913+0000 7ff44c1cbb80 20 client.20091 trim_cache size 0 max 16384 2024-05-08T09:48:49.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.934+0000 7ff44c1cbb80 1 Processor -- start 2024-05-08T09:48:49.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff44c1cbb80 1 -- start start 2024-05-08T09:48:49.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb84e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 0x564ffb83da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 0x564ffb832f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1b4040 con 0x564ffb838810 2024-05-08T09:48:49.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1b1870 con 0x564ffb8391d0 2024-05-08T09:48:49.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1af6e0 con 0x564ffb83e240 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff43aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb84e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff43aa00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb84e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52656/0 (socket says 172.21.15.70:52656) 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.935+0000 7ff43aa00700 1 -- 172.21.15.70:0/3831466487 learned_addr learned my addr 172.21.15.70:0/3831466487 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff432000700 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 0x564ffb83da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff43b400700 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 0x564ffb832f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff43aa00700 1 -- 172.21.15.70:0/3831466487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 msgr2=0x564ffb832f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff43aa00700 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 0x564ffb832f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff43aa00700 1 -- 172.21.15.70:0/3831466487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 msgr2=0x564ffb83da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff43aa00700 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 0x564ffb83da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff43aa00700 1 -- 172.21.15.70:0/3831466487 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ffb82fd00 con 0x564ffb838810 2024-05-08T09:48:49.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff432000700 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 0x564ffb83da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:48:49.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff43b400700 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 0x564ffb832f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:48:49.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff43aa00700 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb84e630 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7ff42c000f80 tx=0x7ff42c0096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab835f41cdc23a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:49.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff42b400700 1 -- 172.21.15.70:0/3831466487 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c01d1d0 con 0x564ffb838810 2024-05-08T09:48:49.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff42b400700 1 -- 172.21.15.70:0/3831466487 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff42c01d800 con 0x564ffb838810 2024-05-08T09:48:49.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.936+0000 7ff42b400700 1 -- 172.21.15.70:0/3831466487 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff42c026bc0 con 0x564ffb838810 2024-05-08T09:48:49.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.937+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3831466487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 msgr2=0x564ffb84e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:49.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.937+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb84e630 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7ff42c000f80 tx=0x7ff42c0096d0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.937+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3831466487 shutdown_connections 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.937+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 0x564ffb832f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.937+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb838810 0x564ffb84e630 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.937+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/3831466487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb8391d0 0x564ffb83da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.937+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3831466487 >> 172.21.15.70:0/3831466487 conn(0x564ffb7b0860 msgr2=0x564ffb838090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.937+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3831466487 shutdown_connections 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.937+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/3831466487 wait complete. 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.938+0000 7ff44c1cbb80 1 -- start start 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.938+0000 7ff44c1cbb80 1 Processor -- start 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.938+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb838810 0x564ffb845c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb8391d0 0x564ffb846150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff44c1cbb80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 0x564ffb8bcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1afd30 con 0x564ffb8391d0 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1b11a0 con 0x564ffb838810 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff44c1cbb80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c1b0400 con 0x564ffb83e240 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff44c1cbb80 10 client.0 _ll_register_callbacks cb 0x564ffb731e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff432000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb8391d0 0x564ffb846150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff432000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb8391d0 0x564ffb846150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52662/0 (socket says 172.21.15.70:52662) 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff432000700 1 -- 172.21.15.70:0/1740820205 learned_addr learned my addr 172.21.15.70:0/1740820205 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff43b400700 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 0x564ffb8bcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff43aa00700 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb838810 0x564ffb845c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff432000700 1 -- 172.21.15.70:0/1740820205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 msgr2=0x564ffb8bcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff432000700 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 0x564ffb8bcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff432000700 1 -- 172.21.15.70:0/1740820205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb838810 msgr2=0x564ffb845c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff432000700 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb838810 0x564ffb845c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.939+0000 7ff432000700 1 -- 172.21.15.70:0/1740820205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ffb8bd0f0 con 0x564ffb8391d0 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.940+0000 7ff432000700 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb8391d0 0x564ffb846150 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7ff4240099c0 tx=0x7ff424004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1620b74723c964 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:49.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.940+0000 7ff428c00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.940+0000 7ff428c00700 1 -- 172.21.15.70:0/1740820205 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff424037020 con 0x564ffb8391d0 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.940+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/1740820205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff42c01d800 con 0x564ffb8391d0 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.940+0000 7ff428c00700 1 -- 172.21.15.70:0/1740820205 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7ff424004dd0 con 0x564ffb8391d0 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.940+0000 7ff428c00700 1 -- 172.21.15.70:0/1740820205 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7ff42402f460 con 0x564ffb8391d0 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff44c1cbb80 10 client.20097 fetch_fsmap learned FSMap version 45 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/1740820205 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x564ffb8be340 con 0x564ffb8391d0 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff428c00700 1 -- 172.21.15.70:0/1740820205 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff42c01d800 con 0x564ffb8391d0 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff428c00700 1 -- 172.21.15.70:0/1740820205 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7ff424022070 con 0x564ffb8391d0 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff44c1cbb80 10 client.20097 fetch_fsmap finished waiting for FSMap version 45 2024-05-08T09:48:49.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff44c1cbb80 10 client.20097 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:48:49.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff44c1cbb80 20 client.20097 populate_metadata read hostname 'smithi070' 2024-05-08T09:48:49.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564ffb8be810 0x564ffb8c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:49.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff44c1cbb80 4 client.20097 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.7, "await_for": 42.0}] 2024-05-08T09:48:49.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.941+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/1740820205 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.7, "await_for": 42.0}) -- 0x564ffb798590 con 0x564ffb8be810 2024-05-08T09:48:49.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.942+0000 7ff43aa00700 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564ffb8be810 0x564ffb8c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:49.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.943+0000 7ff43aa00700 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564ffb8be810 0x564ffb8c0c00 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cd0ce2d8ddf3da3 server_cookie=633d37fa0358ca4e in_seq=0 out_seq=0 2024-05-08T09:48:49.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:49.943+0000 7ff428c00700 10 client.20097 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:48:50.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:50 smithi070 ceph-mon[29591]: pgmap v5818: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 83 op/s 2024-05-08T09:48:50.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:50 smithi172 ceph-mon[33377]: pgmap v5818: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 83 op/s 2024-05-08T09:48:51.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:50 smithi194 ceph-mon[33679]: pgmap v5818: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 83 op/s 2024-05-08T09:48:51.497 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi070 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' 2024-05-08T09:48:53.889 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9a720fb2046d4f11b770da17b56a220c Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test kernel_untar_build.sh) on smithi070 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh' 2024-05-08T09:48:53.892 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-05-08T09:48:53.902 INFO:tasks.quiescer:joining Quiescers 2024-05-08T09:48:53.903 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-05-08T09:48:53.903 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:48:53.908 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:52 smithi194 ceph-mon[33679]: pgmap v5819: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 83 op/s 2024-05-08T09:48:53.908 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:52 smithi172 ceph-mon[33377]: pgmap v5819: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 83 op/s 2024-05-08T09:48:53.909 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:52 smithi070 ceph-mon[29591]: pgmap v5819: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 83 op/s 2024-05-08T09:48:54.368 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:48:54.754 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:54 smithi070 ceph-mon[29591]: pgmap v5820: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 73 op/s 2024-05-08T09:48:54.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:54 smithi172 ceph-mon[33377]: pgmap v5820: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 73 op/s 2024-05-08T09:48:55.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:54 smithi194 ceph-mon[33679]: pgmap v5820: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 73 op/s 2024-05-08T09:48:56.834 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:56 smithi070 ceph-mon[29591]: pgmap v5821: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-05-08T09:48:56.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:56 smithi172 ceph-mon[33377]: pgmap v5821: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-05-08T09:48:57.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:56 smithi194 ceph-mon[33679]: pgmap v5821: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 100 op/s 2024-05-08T09:48:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.981+0000 7f3e09600700 1 -- 172.21.15.70:0/2841831749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 msgr2=0x7f3e04112450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.981+0000 7f3e09600700 1 --2- 172.21.15.70:0/2841831749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 0x7f3e04112450 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00b0d0 tx=0x7f3dfc00b3e0 comp rx=0 tx=0).stop 2024-05-08T09:48:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.981+0000 7f3e09600700 1 -- 172.21.15.70:0/2841831749 shutdown_connections 2024-05-08T09:48:57.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.981+0000 7f3e09600700 1 --2- 172.21.15.70:0/2841831749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 0x7f3e04112450 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.981+0000 7f3e09600700 1 --2- 172.21.15.70:0/2841831749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e0410b680 0x7f3e0410ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.981+0000 7f3e09600700 1 --2- 172.21.15.70:0/2841831749 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e041055d0 0x7f3e04105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.981+0000 7f3e09600700 1 -- 172.21.15.70:0/2841831749 >> 172.21.15.70:0/2841831749 conn(0x7f3e04101080 msgr2=0x7f3e041034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.981+0000 7f3e09600700 1 -- 172.21.15.70:0/2841831749 shutdown_connections 2024-05-08T09:48:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.981+0000 7f3e09600700 1 -- 172.21.15.70:0/2841831749 wait complete. 2024-05-08T09:48:57.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.982+0000 7f3e09600700 1 Processor -- start 2024-05-08T09:48:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.982+0000 7f3e09600700 1 -- start start 2024-05-08T09:48:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e09600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e041055d0 0x7f3e041a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e09600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 0x7f3e041a1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:57.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e09600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e0410b680 0x7f3e0419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e09600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3e041156e0 con 0x7f3e04105f90 2024-05-08T09:48:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e09600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04115560 con 0x7f3e0410b680 2024-05-08T09:48:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e09600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f3e04115860 con 0x7f3e041055d0 2024-05-08T09:48:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e03400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 0x7f3e041a1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e03400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 0x7f3e041a1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51936/0 (socket says 172.21.15.70:51936) 2024-05-08T09:48:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e03400700 1 -- 172.21.15.70:0/2657585412 learned_addr learned my addr 172.21.15.70:0/2657585412 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:48:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e08c00700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e0410b680 0x7f3e0419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.983+0000 7f3e03e00700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e041055d0 0x7f3e041a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:57.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e03400700 1 -- 172.21.15.70:0/2657585412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e041055d0 msgr2=0x7f3e041a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e03400700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e041055d0 0x7f3e041a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e03400700 1 -- 172.21.15.70:0/2657585412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e0410b680 msgr2=0x7f3e0419b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e03400700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e0410b680 0x7f3e0419b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e03400700 1 -- 172.21.15.70:0/2657585412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0419c100 con 0x7f3e04105f90 2024-05-08T09:48:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e03400700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 0x7f3e041a1cd0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d950 tx=0x7f3df000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e00c00700 1 -- 172.21.15.70:0/2657585412 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0016070 con 0x7f3e04105f90 2024-05-08T09:48:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e00c00700 1 -- 172.21.15.70:0/2657585412 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3df0009dd0 con 0x7f3e04105f90 2024-05-08T09:48:57.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e00c00700 1 -- 172.21.15.70:0/2657585412 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df000f3c0 con 0x7f3e04105f90 2024-05-08T09:48:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.984+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0419c3f0 con 0x7f3e04105f90 2024-05-08T09:48:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.985+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e041a8660 con 0x7f3e04105f90 2024-05-08T09:48:57.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.986+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0410db10 con 0x7f3e04105f90 2024-05-08T09:48:57.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.989+0000 7f3e00c00700 1 -- 172.21.15.70:0/2657585412 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3df0019070 con 0x7f3e04105f90 2024-05-08T09:48:57.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.990+0000 7f3e00c00700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3de80b29f0 0x7f3de80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:48:57.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.991+0000 7f3e00c00700 1 -- 172.21.15.70:0/2657585412 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7f3df00e26f0 con 0x7f3e04105f90 2024-05-08T09:48:57.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.991+0000 7f3e03e00700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3de80b29f0 0x7f3de80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:48:57.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.992+0000 7f3e03e00700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3de80b29f0 0x7f3de80b4eb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3df4005950 tx=0x7f3df4005eb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:48:57.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:57.996+0000 7f3e00c00700 1 -- 172.21.15.70:0/2657585412 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3df00a9c70 con 0x7f3e04105f90 2024-05-08T09:48:58.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.294+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e0406a190 con 0x7f3e04105f90 2024-05-08T09:48:58.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.297+0000 7f3e00c00700 1 -- 172.21.15.70:0/2657585412 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+11879 (secure 0 0 0) 0x7f3df00a9570 con 0x7f3e04105f90 2024-05-08T09:48:58.297 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:48:58.297 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":45,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:46:54.433805+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34442,34379]},"id":1}]} 2024-05-08T09:48:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3de80b29f0 msgr2=0x7f3de80b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3de80b29f0 0x7f3de80b4eb0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3df4005950 tx=0x7f3df4005eb0 comp rx=0 tx=0).stop 2024-05-08T09:48:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 msgr2=0x7f3e041a1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:48:58.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 0x7f3e041a1cd0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d950 tx=0x7f3df000dc60 comp rx=0 tx=0).stop 2024-05-08T09:48:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 shutdown_connections 2024-05-08T09:48:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f3de80b29f0 0x7f3de80b4eb0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f3e0410b680 0x7f3e0419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3e041055d0 0x7f3e041a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:48:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 --2- 172.21.15.70:0/2657585412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3e04105f90 0x7f3e041a1cd0 secure :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d950 tx=0x7f3df000dc60 comp rx=0 tx=0).stop 2024-05-08T09:48:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.301+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 >> 172.21.15.70:0/2657585412 conn(0x7f3e04101080 msgr2=0x7f3e04102810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:48:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.302+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 shutdown_connections 2024-05-08T09:48:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:48:58.302+0000 7f3e09600700 1 -- 172.21.15.70:0/2657585412 wait complete. 2024-05-08T09:48:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 45 2024-05-08T09:48:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:58 smithi070 ceph-mon[29591]: pgmap v5822: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 96 op/s 2024-05-08T09:48:58.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:48:58 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2657585412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:48:58.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:58 smithi172 ceph-mon[33377]: pgmap v5822: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 96 op/s 2024-05-08T09:48:58.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:48:58 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2657585412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:48:59.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:58 smithi194 ceph-mon[33679]: pgmap v5822: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.5 MiB/s wr, 96 op/s 2024-05-08T09:48:59.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:48:58 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2657585412' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:48:59.426 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.34442 quiesce db --cancel --all' 2024-05-08T09:48:59.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- timeout 75 ceph tell mds.34442 quiesce db --cancel --all 2024-05-08T09:48:59.864 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:49:00.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:00 smithi070 ceph-mon[29591]: pgmap v5823: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 104 op/s 2024-05-08T09:49:00.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:00 smithi172 ceph-mon[33377]: pgmap v5823: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 104 op/s 2024-05-08T09:49:01.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:00 smithi194 ceph-mon[33679]: pgmap v5823: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 104 op/s 2024-05-08T09:49:02.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.120+0000 7f67de600700 1 -- 172.21.15.70:0/2323935612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 msgr2=0x7f67d8112450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.120+0000 7f67de600700 1 --2- 172.21.15.70:0/2323935612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 0x7f67d8112450 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f67d000b0d0 tx=0x7f67d000b3e0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.120+0000 7f67de600700 1 -- 172.21.15.70:0/2323935612 shutdown_connections 2024-05-08T09:49:02.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.120+0000 7f67de600700 1 --2- 172.21.15.70:0/2323935612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 0x7f67d8112450 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.120+0000 7f67de600700 1 --2- 172.21.15.70:0/2323935612 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d810b680 0x7f67d810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.121+0000 7f67de600700 1 --2- 172.21.15.70:0/2323935612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67d81055d0 0x7f67d8105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.121+0000 7f67de600700 1 -- 172.21.15.70:0/2323935612 >> 172.21.15.70:0/2323935612 conn(0x7f67d81010e0 msgr2=0x7f67d8103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:02.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.121+0000 7f67de600700 1 -- 172.21.15.70:0/2323935612 shutdown_connections 2024-05-08T09:49:02.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.121+0000 7f67de600700 1 -- 172.21.15.70:0/2323935612 wait complete. 2024-05-08T09:49:02.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.122+0000 7f67de600700 1 Processor -- start 2024-05-08T09:49:02.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.122+0000 7f67de600700 1 -- start start 2024-05-08T09:49:02.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.122+0000 7f67de600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67d81055d0 0x7f67d81a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.122+0000 7f67de600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 0x7f67d81a1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.122+0000 7f67de600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d810b680 0x7f67d819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.122+0000 7f67de600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f67d81156e0 con 0x7f67d8105f90 2024-05-08T09:49:02.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.122+0000 7f67de600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8115560 con 0x7f67d810b680 2024-05-08T09:49:02.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.122+0000 7f67de600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f67d8115860 con 0x7f67d81055d0 2024-05-08T09:49:02.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 0x7f67d81a1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 0x7f67d81a1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51944/0 (socket says 172.21.15.70:51944) 2024-05-08T09:49:02.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67d7e00700 1 -- 172.21.15.70:0/2576181756 learned_addr learned my addr 172.21.15.70:0/2576181756 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:02.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67dd200700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67d81055d0 0x7f67d81a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67ddc00700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d810b680 0x7f67d819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67d7e00700 1 -- 172.21.15.70:0/2576181756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67d81055d0 msgr2=0x7f67d81a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67d7e00700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67d81055d0 0x7f67d81a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67d7e00700 1 -- 172.21.15.70:0/2576181756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d810b680 msgr2=0x7f67d819b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67d7e00700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d810b680 0x7f67d819b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67d7e00700 1 -- 172.21.15.70:0/2576181756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d819c000 con 0x7f67d8105f90 2024-05-08T09:49:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67ddc00700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d810b680 0x7f67d819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:49:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.123+0000 7f67d7e00700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 0x7f67d81a1c20 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c9b0 tx=0x7f67c400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.124+0000 7f67d5600700 1 -- 172.21.15.70:0/2576181756 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4007b00 con 0x7f67d8105f90 2024-05-08T09:49:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.124+0000 7f67d5600700 1 -- 172.21.15.70:0/2576181756 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67c4007ca0 con 0x7f67d8105f90 2024-05-08T09:49:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.124+0000 7f67de600700 1 -- 172.21.15.70:0/2576181756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d819c2f0 con 0x7f67d8105f90 2024-05-08T09:49:02.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.124+0000 7f67d5600700 1 -- 172.21.15.70:0/2576181756 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4018660 con 0x7f67d8105f90 2024-05-08T09:49:02.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.124+0000 7f67de600700 1 -- 172.21.15.70:0/2576181756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d81a85b0 con 0x7f67d8105f90 2024-05-08T09:49:02.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.127+0000 7f67d5600700 1 -- 172.21.15.70:0/2576181756 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f67c400f450 con 0x7f67d8105f90 2024-05-08T09:49:02.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.129+0000 7f67d5600700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f67c00b2a70 0x7f67c00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.129+0000 7f67d5600700 1 -- 172.21.15.70:0/2576181756 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7f67c40e2ac0 con 0x7f67d8105f90 2024-05-08T09:49:02.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.129+0000 7f67dd200700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f67c00b2a70 0x7f67c00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.130+0000 7f67dd200700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f67c00b2a70 0x7f67c00b4f30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f67cc005950 tx=0x7f67cc0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:02.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.144+0000 7f67ea5a4b80 1 Processor -- start 2024-05-08T09:49:02.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.145+0000 7f67ea5a4b80 1 -- start start 2024-05-08T09:49:02.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.145+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556744022ed0 0x5567440232b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.145+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x55674401d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.145+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55674401da20 0x55674401de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.145+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556743f6fa90 con 0x55674401da20 2024-05-08T09:49:02.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.145+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556743f0d7d0 con 0x556744022ed0 2024-05-08T09:49:02.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.145+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x556743f6ba50 con 0x5567440237f0 2024-05-08T09:49:02.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.145+0000 7f67ddc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55674401da20 0x55674401de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67ddc00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55674401da20 0x55674401de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51946/0 (socket says 172.21.15.70:51946) 2024-05-08T09:49:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67ddc00700 1 -- 172.21.15.70:0/2793043048 learned_addr learned my addr 172.21.15.70:0/2793043048 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67dd200700 1 --2- 172.21.15.70:0/2793043048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556744022ed0 0x5567440232b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67d7e00700 1 --2- 172.21.15.70:0/2793043048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x55674401d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67ddc00700 1 -- 172.21.15.70:0/2793043048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 msgr2=0x55674401d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:49:02.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67ddc00700 1 --2- 172.21.15.70:0/2793043048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x55674401d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67ddc00700 1 -- 172.21.15.70:0/2793043048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556744022ed0 msgr2=0x5567440232b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:49:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67ddc00700 1 --2- 172.21.15.70:0/2793043048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556744022ed0 0x5567440232b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67ddc00700 1 -- 172.21.15.70:0/2793043048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556743ebc940 con 0x55674401da20 2024-05-08T09:49:02.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.146+0000 7f67ddc00700 1 --2- 172.21.15.70:0/2793043048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55674401da20 0x55674401de80 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009d40 tx=0x7f67d0009d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3a06422ffd587f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:02.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.147+0000 7f67ca000700 1 -- 172.21.15.70:0/2793043048 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d001f030 con 0x55674401da20 2024-05-08T09:49:02.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.147+0000 7f67ca000700 1 -- 172.21.15.70:0/2793043048 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67d00091d0 con 0x55674401da20 2024-05-08T09:49:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.147+0000 7f67ca000700 1 -- 172.21.15.70:0/2793043048 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d0007c40 con 0x55674401da20 2024-05-08T09:49:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.147+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2793043048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55674401da20 msgr2=0x55674401de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.148+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2793043048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55674401da20 0x55674401de80 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f67d0009d40 tx=0x7f67d0009d70 comp rx=0 tx=0).stop 2024-05-08T09:49:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.148+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2793043048 shutdown_connections 2024-05-08T09:49:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.148+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2793043048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55674401da20 0x55674401de80 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.148+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2793043048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x556744022ed0 0x5567440232b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.148+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2793043048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x55674401d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.148+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2793043048 >> 172.21.15.70:0/2793043048 conn(0x556743f4bbd0 msgr2=0x556744017f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.148+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2793043048 shutdown_connections 2024-05-08T09:49:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.148+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2793043048 wait complete. 2024-05-08T09:49:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.148+0000 7f67ea5a4b80 1 -- start start 2024-05-08T09:49:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67ea5a4b80 1 Processor -- start 2024-05-08T09:49:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 0x5567440294d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744026870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x556744026db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55674402a2b0 con 0x556744022ed0 2024-05-08T09:49:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x556743ed5b90 con 0x55674401da20 2024-05-08T09:49:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x55674402a430 con 0x5567440237f0 2024-05-08T09:49:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67ea5a4b80 10 client.0 _ll_register_callbacks cb 0x556743f16ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:49:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744026870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744026870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51948/0 (socket says 172.21.15.70:51948) 2024-05-08T09:49:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.149+0000 7f67d7e00700 1 -- 172.21.15.70:0/1979597012 learned_addr learned my addr 172.21.15.70:0/1979597012 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:02.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.150+0000 7f67dd200700 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 0x5567440294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.150+0000 7f67ddc00700 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x556744026db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.150+0000 7f67d7e00700 1 -- 172.21.15.70:0/1979597012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 msgr2=0x556744026db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:49:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.150+0000 7f67d7e00700 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x556744026db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.150+0000 7f67d7e00700 1 -- 172.21.15.70:0/1979597012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 msgr2=0x5567440294d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:49:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.150+0000 7f67d7e00700 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 0x5567440294d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.150+0000 7f67d7e00700 1 -- 172.21.15.70:0/1979597012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556743f35490 con 0x556744022ed0 2024-05-08T09:49:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.150+0000 7f67d7e00700 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744026870 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f67c40dfe10 tx=0x7f67c40a9500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c43c113f763bc7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:02.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.150+0000 7f67bea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:49:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67bea00700 1 -- 172.21.15.70:0/1979597012 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c408fe60 con 0x556744022ed0 2024-05-08T09:49:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67bea00700 1 -- 172.21.15.70:0/1979597012 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7f67c40a9ba0 con 0x556744022ed0 2024-05-08T09:49:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/1979597012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67d00091d0 con 0x556744022ed0 2024-05-08T09:49:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67bea00700 1 -- 172.21.15.70:0/1979597012 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f67c40a9940 con 0x556744022ed0 2024-05-08T09:49:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67ea5a4b80 10 client.20115 fetch_fsmap learned FSMap version 45 2024-05-08T09:49:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/1979597012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x556744034b10 con 0x556744022ed0 2024-05-08T09:49:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67bea00700 1 -- 172.21.15.70:0/1979597012 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67d00091d0 con 0x556744022ed0 2024-05-08T09:49:02.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67bea00700 1 -- 172.21.15.70:0/1979597012 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7f67c40b2310 con 0x556744022ed0 2024-05-08T09:49:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67ea5a4b80 10 client.20115 fetch_fsmap finished waiting for FSMap version 45 2024-05-08T09:49:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.151+0000 7f67ea5a4b80 10 client.20115 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:49:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.152+0000 7f67ea5a4b80 20 client.20115 populate_metadata read hostname 'smithi070' 2024-05-08T09:49:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.152+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5567440370a0 0x556744039490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.152+0000 7f67ea5a4b80 4 client.20115 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T09:49:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.152+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/1979597012 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556743fea110 con 0x5567440370a0 2024-05-08T09:49:02.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.152+0000 7f67dd200700 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5567440370a0 0x556744039490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.153+0000 7f67dd200700 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5567440370a0 0x556744039490 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f282f33f1c79f6b server_cookie=5f6a16825e30b1b1 in_seq=0 out_seq=0 2024-05-08T09:49:02.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.153+0000 7f67bea00700 10 client.20115 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:49:02.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.511+0000 7f67bea00700 1 -- 172.21.15.70:0/1979597012 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556743fea110 con 0x5567440370a0 2024-05-08T09:49:02.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.512+0000 7f67bea00700 10 client.20115 handle_command_reply: tid=0 2024-05-08T09:49:02.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.512+0000 7f67ea5a4b80 1 client.20115 shutdown 2024-05-08T09:49:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.512+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/1979597012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 msgr2=0x556744026870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744026870 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f67c40dfe10 tx=0x7f67c40a9500 comp rx=0 tx=0).stop 2024-05-08T09:49:02.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/1979597012 shutdown_connections 2024-05-08T09:49:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5567440370a0 0x556744039490 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x556744026db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 0x5567440294d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/1979597012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744026870 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67bea00700 0 client.20115 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:49:02.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/1979597012 >> 172.21.15.70:0/1979597012 conn(0x556743f4bbd0 msgr2=0x556744017e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:02.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/1979597012 shutdown_connections 2024-05-08T09:49:02.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.513+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/1979597012 wait complete. 2024-05-08T09:49:02.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.514+0000 7f67ea5a4b80 20 client.20115 trim_cache size 0 max 16384 2024-05-08T09:49:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.570+0000 7f67ea5a4b80 1 Processor -- start 2024-05-08T09:49:02.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.571+0000 7f67ea5a4b80 1 -- start start 2024-05-08T09:49:02.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.571+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55674401da20 0x55674401d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.571+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744033340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.571+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567440237f0 0x556744024380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.571+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f67d81b3c90 con 0x556744022ed0 2024-05-08T09:49:02.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.571+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f67d81b14c0 con 0x5567440237f0 2024-05-08T09:49:02.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.571+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f67d81af330 con 0x55674401da20 2024-05-08T09:49:02.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.572+0000 7f67d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744033340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.572+0000 7f67d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744033340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51964/0 (socket says 172.21.15.70:51964) 2024-05-08T09:49:02.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.572+0000 7f67d7e00700 1 -- 172.21.15.70:0/4176753547 learned_addr learned my addr 172.21.15.70:0/4176753547 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:02.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.572+0000 7f67ddc00700 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567440237f0 0x556744024380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.572+0000 7f67dd200700 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55674401da20 0x55674401d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.573+0000 7f67d7e00700 1 -- 172.21.15.70:0/4176753547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55674401da20 msgr2=0x55674401d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:49:02.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.573+0000 7f67d7e00700 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55674401da20 0x55674401d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.573+0000 7f67d7e00700 1 -- 172.21.15.70:0/4176753547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567440237f0 msgr2=0x556744024380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:49:02.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.573+0000 7f67d7e00700 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567440237f0 0x556744024380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.573+0000 7f67d7e00700 1 -- 172.21.15.70:0/4176753547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556744023500 con 0x556744022ed0 2024-05-08T09:49:02.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.573+0000 7f67ddc00700 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567440237f0 0x556744024380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T09:49:02.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.573+0000 7f67d7e00700 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744033340 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f67c400fcf0 tx=0x7f67c400a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2389eb79595da3ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:02.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.574+0000 7f67c9600700 1 -- 172.21.15.70:0/4176753547 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4088070 con 0x556744022ed0 2024-05-08T09:49:02.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.574+0000 7f67c9600700 1 -- 172.21.15.70:0/4176753547 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67c40adcf0 con 0x556744022ed0 2024-05-08T09:49:02.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.574+0000 7f67c9600700 1 -- 172.21.15.70:0/4176753547 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c40a9ba0 con 0x556744022ed0 2024-05-08T09:49:02.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.575+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/4176753547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 msgr2=0x556744033340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.575+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744033340 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f67c400fcf0 tx=0x7f67c400a5f0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.575+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/4176753547 shutdown_connections 2024-05-08T09:49:02.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.575+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x5567440237f0 0x556744024380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.575+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55674401da20 0x55674401d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.575+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/4176753547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x556744033340 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.575+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/4176753547 >> 172.21.15.70:0/4176753547 conn(0x556743f4bbd0 msgr2=0x556744023c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:02.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.575+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/4176753547 shutdown_connections 2024-05-08T09:49:02.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.575+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/4176753547 wait complete. 2024-05-08T09:49:02.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.576+0000 7f67ea5a4b80 1 -- start start 2024-05-08T09:49:02.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.576+0000 7f67ea5a4b80 1 Processor -- start 2024-05-08T09:49:02.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 0x55674402c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x55674402cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67ea5a4b80 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x55674402d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f67d81af980 con 0x556744022ed0 2024-05-08T09:49:02.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f67d81b0df0 con 0x55674401da20 2024-05-08T09:49:02.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67ea5a4b80 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f67d81b0050 con 0x5567440237f0 2024-05-08T09:49:02.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67ea5a4b80 10 client.0 _ll_register_callbacks cb 0x556743f16ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T09:49:02.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x55674402cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67d7e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x55674402cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51976/0 (socket says 172.21.15.70:51976) 2024-05-08T09:49:02.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67d7e00700 1 -- 172.21.15.70:0/2740410380 learned_addr learned my addr 172.21.15.70:0/2740410380 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:02.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.577+0000 7f67dd200700 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 0x55674402c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67ddc00700 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x55674402d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67d7e00700 1 -- 172.21.15.70:0/2740410380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 msgr2=0x55674402d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:49:02.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67d7e00700 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x55674402d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67d7e00700 1 -- 172.21.15.70:0/2740410380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 msgr2=0x55674402c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:49:02.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67d7e00700 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 0x55674402c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67d7e00700 1 -- 172.21.15.70:0/2740410380 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556744018260 con 0x556744022ed0 2024-05-08T09:49:02.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67dd200700 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 0x55674402c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:49:02.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67d7e00700 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x55674402cbd0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f67c40a9640 tx=0x7f67c40a9500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae9ee017c6d01f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:02.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67bea00700 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-05-08T09:49:02.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.578+0000 7f67bea00700 1 -- 172.21.15.70:0/2740410380 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c4088070 con 0x556744022ed0 2024-05-08T09:49:02.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.579+0000 7f67bea00700 1 -- 172.21.15.70:0/2740410380 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7f67c40a9ba0 con 0x556744022ed0 2024-05-08T09:49:02.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.579+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2740410380 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67c40adcf0 con 0x556744022ed0 2024-05-08T09:49:02.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.579+0000 7f67bea00700 1 -- 172.21.15.70:0/2740410380 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f67c40b27a0 con 0x556744022ed0 2024-05-08T09:49:02.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.579+0000 7f67ea5a4b80 10 client.20121 fetch_fsmap learned FSMap version 45 2024-05-08T09:49:02.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.579+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2740410380 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x5567440a2c00 con 0x556744022ed0 2024-05-08T09:49:02.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.579+0000 7f67bea00700 1 -- 172.21.15.70:0/2740410380 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67c40adcf0 con 0x556744022ed0 2024-05-08T09:49:02.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.579+0000 7f67bea00700 1 -- 172.21.15.70:0/2740410380 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 45) ==== 8358+0+0 (secure 0 0 0) 0x7f67c40aee80 con 0x556744022ed0 2024-05-08T09:49:02.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.580+0000 7f67ea5a4b80 10 client.20121 fetch_fsmap finished waiting for FSMap version 45 2024-05-08T09:49:02.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.580+0000 7f67ea5a4b80 10 client.20121 resolve_mds: validated gid 34442 aka daemon mds.b 2024-05-08T09:49:02.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.580+0000 7f67ea5a4b80 20 client.20121 populate_metadata read hostname 'smithi070' 2024-05-08T09:49:02.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.580+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5567440a3100 0x5567440a5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:02.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.580+0000 7f67ea5a4b80 4 client.20121 mds_command: new command op to 34442 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-05-08T09:49:02.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.580+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2740410380 --> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x556743f7d470 con 0x5567440a3100 2024-05-08T09:49:02.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.580+0000 7f67dd200700 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5567440a3100 0x5567440a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:02.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.581+0000 7f67dd200700 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5567440a3100 0x5567440a5520 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c3f9b41b6d605b5 server_cookie=38de17b796567f2c in_seq=0 out_seq=0 2024-05-08T09:49:02.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.581+0000 7f67bea00700 10 client.20121 ms_handle_connect on v2:172.21.15.172:6838/283788562 2024-05-08T09:49:02.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.688+0000 7f67bea00700 1 -- 172.21.15.70:0/2740410380 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: 0 ) ==== 8+0+81 (crc 0 0 0) 0x556743f7d470 con 0x5567440a3100 2024-05-08T09:49:02.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.688+0000 7f67bea00700 10 client.20121 handle_command_reply: tid=0 2024-05-08T09:49:02.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.688+0000 7f67ea5a4b80 1 client.20121 shutdown 2024-05-08T09:49:02.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.688+0000 7ff428c00700 1 -- 172.21.15.70:0/1740820205 <== mds.0 v2:172.21.15.172:6838/283788562 1 ==== command_reply(tid 0: -125 ) ==== 8+0+593 (crc 0 0 0) 0x564ffb798590 con 0x564ffb8be810 2024-05-08T09:49:02.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.688+0000 7ff428c00700 10 client.20097 handle_command_reply: tid=0 2024-05-08T09:49:02.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.688+0000 7ff44c1cbb80 1 client.20097 shutdown 2024-05-08T09:49:02.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2740410380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 msgr2=0x55674402cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x55674402cbd0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f67c40a9640 tx=0x7f67c40a9500 comp rx=0 tx=0).stop 2024-05-08T09:49:02.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/1740820205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb8391d0 msgr2=0x564ffb846150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb8391d0 0x564ffb846150 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7ff4240099c0 tx=0x7ff424004920 comp rx=0 tx=0).stop 2024-05-08T09:49:02.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2740410380 shutdown_connections 2024-05-08T09:49:02.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x5567440a3100 0x5567440a5520 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5567440237f0 0x55674402d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x55674401da20 0x55674402c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7f67ea5a4b80 1 --2- 172.21.15.70:0/2740410380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556744022ed0 0x55674402cbd0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7f67bea00700 0 client.20121 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:49:02.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2740410380 >> 172.21.15.70:0/2740410380 conn(0x556743f4bbd0 msgr2=0x556744026120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:02.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/1740820205 shutdown_connections 2024-05-08T09:49:02.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.172:6838/283788562,v1:172.21.15.172:6839/283788562] conn(0x564ffb8be810 0x564ffb8c0c00 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x564ffb83e240 0x564ffb8bcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x564ffb838810 0x564ffb845c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7ff428c00700 0 client.20097 ms_handle_reset on v2:172.21.15.172:6838/283788562 2024-05-08T09:49:02.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7ff44c1cbb80 1 --2- 172.21.15.70:0/1740820205 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564ffb8391d0 0x564ffb846150 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.689+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/1740820205 >> 172.21.15.70:0/1740820205 conn(0x564ffb7b0860 msgr2=0x564ffb83bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:02.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.690+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2740410380 shutdown_connections 2024-05-08T09:49:02.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.690+0000 7f67ea5a4b80 1 -- 172.21.15.70:0/2740410380 wait complete. 2024-05-08T09:49:02.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.690+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/1740820205 shutdown_connections 2024-05-08T09:49:02.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.690+0000 7f67ea5a4b80 20 client.20121 trim_cache size 0 max 16384 2024-05-08T09:49:02.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.690+0000 7ff44c1cbb80 1 -- 172.21.15.70:0/1740820205 wait complete. 2024-05-08T09:49:02.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.690+0000 7ff44c1cbb80 20 client.20097 trim_cache size 0 max 16384 2024-05-08T09:49:02.696 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:49:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 45, 2024-05-08T09:49:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:49:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 398, 2024-05-08T09:49:02.696 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": {} 2024-05-08T09:49:02.696 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:49:02.697 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:49:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 45, 2024-05-08T09:49:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "leader": 34442, 2024-05-08T09:49:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "set_version": 398, 2024-05-08T09:49:02.697 INFO:teuthology.orchestra.run.smithi070.stdout: "sets": { 2024-05-08T09:49:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: "51973f76": { 2024-05-08T09:49:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: "version": 398, 2024-05-08T09:49:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: "age_ref": 0.0, 2024-05-08T09:49:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:49:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "CANCELED", 2024-05-08T09:49:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 0.0 2024-05-08T09:49:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:02.698 INFO:teuthology.orchestra.run.smithi070.stdout: "timeout": 60.0, 2024-05-08T09:49:02.699 INFO:teuthology.orchestra.run.smithi070.stdout: "expiration": 78.7, 2024-05-08T09:49:02.699 INFO:teuthology.orchestra.run.smithi070.stdout: "members": { 2024-05-08T09:49:02.699 INFO:teuthology.orchestra.run.smithi070.stdout: "file:/": { 2024-05-08T09:49:02.699 INFO:teuthology.orchestra.run.smithi070.stdout: "excluded": true, 2024-05-08T09:49:02.699 INFO:teuthology.orchestra.run.smithi070.stdout: "state": { 2024-05-08T09:49:02.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "QUIESCING", 2024-05-08T09:49:02.699 INFO:teuthology.orchestra.run.smithi070.stdout: "age": 12.7 2024-05-08T09:49:02.699 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:02.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:02.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:02.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:02.700 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:02.700 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:49:02.700 INFO:teuthology.orchestra.run.smithi070.stderr:Error ECANCELED: 2024-05-08T09:49:02.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 -- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f67c00b2a70 msgr2=0x7f67c00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f67c00b2a70 0x7f67c00b4f30 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f67cc005950 tx=0x7f67cc0058e0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 -- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 msgr2=0x7f67d81a1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:02.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 0x7f67d81a1c20 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f67c400c9b0 tx=0x7f67c400cd70 comp rx=0 tx=0).stop 2024-05-08T09:49:02.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 -- 172.21.15.70:0/2576181756 shutdown_connections 2024-05-08T09:49:02.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f67c00b2a70 0x7f67c00b4f30 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f67d810b680 0x7f67d819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67d81055d0 0x7f67d81a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 --2- 172.21.15.70:0/2576181756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f67d8105f90 0x7f67d81a1c20 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:02.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 -- 172.21.15.70:0/2576181756 >> 172.21.15.70:0/2576181756 conn(0x7f67d81010e0 msgr2=0x7f67d81026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:02.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 -- 172.21.15.70:0/2576181756 shutdown_connections 2024-05-08T09:49:02.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:02.692+0000 7f67de600700 1 -- 172.21.15.70:0/2576181756 wait complete. 2024-05-08T09:49:02.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:02 smithi070 ceph-mon[29591]: pgmap v5824: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 261 KiB/s wr, 39 op/s 2024-05-08T09:49:02.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:02 smithi172 ceph-mon[33377]: pgmap v5824: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 261 KiB/s wr, 39 op/s 2024-05-08T09:49:03.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:02 smithi194 ceph-mon[33679]: pgmap v5824: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 261 KiB/s wr, 39 op/s 2024-05-08T09:49:04.261 DEBUG:teuthology.orchestra.run:got remote process result: 125 2024-05-08T09:49:04.265 WARNING:tasks.quiescer.fs.[cephfs]:Quiesce set got cancelled (cap = 10).Won't raise an error since this could be a failover, will wait for the next quiesce attempt 2024-05-08T09:49:04.667 INFO:tasks.quiescer:done joining Quiescers 2024-05-08T09:49:04.668 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-08T09:49:04.680 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-05-08T09:49:04.681 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T09:49:04.681 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T09:49:04.681 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-05-08T09:49:04.765 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:04 smithi070 ceph-mon[29591]: pgmap v5825: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 261 KiB/s wr, 39 op/s 2024-05-08T09:49:04.797 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-05-08T09:49:04.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-08T09:49:04.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:04 smithi172 ceph-mon[33377]: pgmap v5825: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 261 KiB/s wr, 39 op/s 2024-05-08T09:49:05.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:04 smithi194 ceph-mon[33679]: pgmap v5825: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 261 KiB/s wr, 39 op/s 2024-05-08T09:49:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.490+0000 7f78eda00640 1 -- 172.21.15.70:0/1811812918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 msgr2=0x7f78e810f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.490+0000 7f78eda00640 1 --2- 172.21.15.70:0/1811812918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 0x7f78e810f890 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009930 tx=0x7f78e002a420 comp rx=0 tx=0).stop 2024-05-08T09:49:05.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.490+0000 7f78eda00640 1 -- 172.21.15.70:0/1811812918 shutdown_connections 2024-05-08T09:49:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.490+0000 7f78eda00640 1 --2- 172.21.15.70:0/1811812918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 0x7f78e810f890 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.490+0000 7f78eda00640 1 --2- 172.21.15.70:0/1811812918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78e81029c0 0x7f78e8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.490+0000 7f78eda00640 1 --2- 172.21.15.70:0/1811812918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e81089d0 0x7f78e8108db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.490+0000 7f78eda00640 1 -- 172.21.15.70:0/1811812918 >> 172.21.15.70:0/1811812918 conn(0x7f78e8079e40 msgr2=0x7f78e807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.490+0000 7f78eda00640 1 -- 172.21.15.70:0/1811812918 shutdown_connections 2024-05-08T09:49:05.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.490+0000 7f78eda00640 1 -- 172.21.15.70:0/1811812918 wait complete. 2024-05-08T09:49:05.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.492+0000 7f78eda00640 1 Processor -- start 2024-05-08T09:49:05.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.492+0000 7f78eda00640 1 -- start start 2024-05-08T09:49:05.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.492+0000 7f78eda00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78e81029c0 0x7f78e8074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:05.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.492+0000 7f78eda00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 0x7f78e80751f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:05.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.492+0000 7f78eda00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e81089d0 0x7f78e8075730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:05.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.492+0000 7f78eda00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8112b90 con 0x7f78e8103380 2024-05-08T09:49:05.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.492+0000 7f78eda00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8112a10 con 0x7f78e81029c0 2024-05-08T09:49:05.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.492+0000 7f78eda00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f78e8112d10 con 0x7f78e81089d0 2024-05-08T09:49:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e6000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 0x7f78e80751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e6000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 0x7f78e80751f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51986/0 (socket says 172.21.15.70:51986) 2024-05-08T09:49:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e6000640 1 -- 172.21.15.70:0/2472403671 learned_addr learned my addr 172.21.15.70:0/2472403671 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:05.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e7400640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e81089d0 0x7f78e8075730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:05.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e6a00640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78e81029c0 0x7f78e8074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:05.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e6000640 1 -- 172.21.15.70:0/2472403671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e81089d0 msgr2=0x7f78e8075730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:05.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e6000640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e81089d0 0x7f78e8075730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:05.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e6000640 1 -- 172.21.15.70:0/2472403671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78e81029c0 msgr2=0x7f78e8074cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:05.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e6000640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78e81029c0 0x7f78e8074cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:05.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.493+0000 7f78e6000640 1 -- 172.21.15.70:0/2472403671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e81a7510 con 0x7f78e8103380 2024-05-08T09:49:05.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.494+0000 7f78e6000640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 0x7f78e80751f0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f78d800eab0 tx=0x7f78d800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.498+0000 7f78df400640 1 -- 172.21.15.70:0/2472403671 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d800ce40 con 0x7f78e8103380 2024-05-08T09:49:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.499+0000 7f78df400640 1 -- 172.21.15.70:0/2472403671 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78d8011900 con 0x7f78e8103380 2024-05-08T09:49:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.499+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e81a7800 con 0x7f78e8103380 2024-05-08T09:49:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.499+0000 7f78df400640 1 -- 172.21.15.70:0/2472403671 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8010990 con 0x7f78e8103380 2024-05-08T09:49:05.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.499+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e81a7d50 con 0x7f78e8103380 2024-05-08T09:49:05.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.500+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e8050740 con 0x7f78e8103380 2024-05-08T09:49:05.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.511+0000 7f78df400640 1 -- 172.21.15.70:0/2472403671 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f78d8011470 con 0x7f78e8103380 2024-05-08T09:49:05.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.514+0000 7f78df400640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78cc0b2b50 0x7f78cc0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:05.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.514+0000 7f78df400640 1 -- 172.21.15.70:0/2472403671 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7f78d80e3070 con 0x7f78e8103380 2024-05-08T09:49:05.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.515+0000 7f78e6a00640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78cc0b2b50 0x7f78cc0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:05.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.515+0000 7f78e6a00640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78cc0b2b50 0x7f78cc0b5010 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f78d0005d80 tx=0x7f78d0005c90 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:05.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.521+0000 7f78df400640 1 -- 172.21.15.70:0/2472403671 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f78d8016030 con 0x7f78e8103380 2024-05-08T09:49:05.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.807+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f78e8062df0 con 0x7f78cc0b2b50 2024-05-08T09:49:05.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.872+0000 7f78df400640 1 -- 172.21.15.70:0/2472403671 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+353 (secure 0 0 0) 0x7f78e8062df0 con 0x7f78cc0b2b50 2024-05-08T09:49:05.872 INFO:teuthology.orchestra.run.smithi070.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-08T00:00:00", "created": "2024-05-08T06:46:35", "first": "2024-05-08T06:47:00", "last": "2024-05-08T09:49:00", "last_pruned": "2024-05-08T09:48:05", "created_count": 183, "pruned_count": 173, "active": true} 2024-05-08T09:49:05.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78cc0b2b50 msgr2=0x7f78cc0b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:05.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78cc0b2b50 0x7f78cc0b5010 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f78d0005d80 tx=0x7f78d0005c90 comp rx=0 tx=0).stop 2024-05-08T09:49:05.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 msgr2=0x7f78e80751f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:05.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 0x7f78e80751f0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f78d800eab0 tx=0x7f78d800ef70 comp rx=0 tx=0).stop 2024-05-08T09:49:05.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 shutdown_connections 2024-05-08T09:49:05.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f78cc0b2b50 0x7f78cc0b5010 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:05.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78e81089d0 0x7f78e8075730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:05.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f78e8103380 0x7f78e80751f0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:05.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 --2- 172.21.15.70:0/2472403671 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f78e81029c0 0x7f78e8074cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:05.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.875+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 >> 172.21.15.70:0/2472403671 conn(0x7f78e8079e40 msgr2=0x7f78e8100240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:05.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.876+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 shutdown_connections 2024-05-08T09:49:05.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:05.876+0000 7f78eda00640 1 -- 172.21.15.70:0/2472403671 wait complete. 2024-05-08T09:49:05.907 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-08T09:49:06.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.090+0000 7f4f83c00640 1 -- 172.21.15.70:0/1147294677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 msgr2=0x7f4f7c0751c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.090+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1147294677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 0x7f4f7c0751c0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009900 tx=0x7f4f7002a480 comp rx=0 tx=0).stop 2024-05-08T09:49:06.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.090+0000 7f4f83c00640 1 -- 172.21.15.70:0/1147294677 shutdown_connections 2024-05-08T09:49:06.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.090+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1147294677 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f7c10f1f0 0x7f4f7c111640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.090+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1147294677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f7c075700 0x7f4f7c10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.090+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1147294677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 0x7f4f7c0751c0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.090+0000 7f4f83c00640 1 -- 172.21.15.70:0/1147294677 >> 172.21.15.70:0/1147294677 conn(0x7f4f7c0fe440 msgr2=0x7f4f7c100860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:06.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.090+0000 7f4f83c00640 1 -- 172.21.15.70:0/1147294677 shutdown_connections 2024-05-08T09:49:06.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.090+0000 7f4f83c00640 1 -- 172.21.15.70:0/1147294677 wait complete. 2024-05-08T09:49:06.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.091+0000 7f4f83c00640 1 Processor -- start 2024-05-08T09:49:06.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.091+0000 7f4f83c00640 1 -- start start 2024-05-08T09:49:06.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f83c00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 0x7f4f7c19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:06.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f83c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f7c075700 0x7f4f7c19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:06.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f83c00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f7c10f1f0 0x7f4f7c19fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:06.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f83c00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c114cf0 con 0x7f4f7c074de0 2024-05-08T09:49:06.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f83c00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c114b70 con 0x7f4f7c10f1f0 2024-05-08T09:49:06.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f83c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c114e70 con 0x7f4f7c075700 2024-05-08T09:49:06.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f81200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 0x7f4f7c19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:06.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f81200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 0x7f4f7c19b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52002/0 (socket says 172.21.15.70:52002) 2024-05-08T09:49:06.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f81200640 1 -- 172.21.15.70:0/1145896512 learned_addr learned my addr 172.21.15.70:0/1145896512 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:06.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f81c00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f7c10f1f0 0x7f4f7c19fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:06.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f7be00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f7c075700 0x7f4f7c19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:06.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f81200640 1 -- 172.21.15.70:0/1145896512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f7c075700 msgr2=0x7f4f7c19b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f81200640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f7c075700 0x7f4f7c19b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f81200640 1 -- 172.21.15.70:0/1145896512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f7c10f1f0 msgr2=0x7f4f7c19fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f81200640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f7c10f1f0 0x7f4f7c19fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.092+0000 7f4f81200640 1 -- 172.21.15.70:0/1145896512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c1a0260 con 0x7f4f7c074de0 2024-05-08T09:49:06.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.093+0000 7f4f81200640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 0x7f4f7c19b270 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009230 tx=0x7f4f70004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:06.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.093+0000 7f4f79600640 1 -- 172.21.15.70:0/1145896512 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7003f030 con 0x7f4f7c074de0 2024-05-08T09:49:06.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.093+0000 7f4f79600640 1 -- 172.21.15.70:0/1145896512 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f70003a80 con 0x7f4f7c074de0 2024-05-08T09:49:06.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.093+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c1a04f0 con 0x7f4f7c074de0 2024-05-08T09:49:06.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.093+0000 7f4f79600640 1 -- 172.21.15.70:0/1145896512 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70035070 con 0x7f4f7c074de0 2024-05-08T09:49:06.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.093+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c1a7de0 con 0x7f4f7c074de0 2024-05-08T09:49:06.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.095+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c050740 con 0x7f4f7c074de0 2024-05-08T09:49:06.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.097+0000 7f4f79600640 1 -- 172.21.15.70:0/1145896512 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4f70042030 con 0x7f4f7c074de0 2024-05-08T09:49:06.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.098+0000 7f4f79600640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4f640b2a90 0x7f4f640b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:06.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.099+0000 7f4f79600640 1 -- 172.21.15.70:0/1145896512 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7f4f70103590 con 0x7f4f7c074de0 2024-05-08T09:49:06.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.099+0000 7f4f7be00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4f640b2a90 0x7f4f640b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:06.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.100+0000 7f4f7be00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4f640b2a90 0x7f4f640b4f50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4f68005fd0 tx=0x7f4f68005850 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:06.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.105+0000 7f4f79600640 1 -- 172.21.15.70:0/1145896512 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4f700cab10 con 0x7f4f7c074de0 2024-05-08T09:49:06.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.341+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 --> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f4f7c10a3e0 con 0x7f4f640b2a90 2024-05-08T09:49:06.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.364+0000 7f4f79600640 1 -- 172.21.15.70:0/1145896512 <== mgr.15198 v2:172.21.15.70:6800/3968184776 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f4f6800fb30 con 0x7f4f640b2a90 2024-05-08T09:49:06.363 INFO:teuthology.orchestra.run.smithi070.stdout:/ 1m 6m3h 2024-05-08T09:49:06.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.366+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4f640b2a90 msgr2=0x7f4f640b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.366+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4f640b2a90 0x7f4f640b4f50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4f68005fd0 tx=0x7f4f68005850 comp rx=0 tx=0).stop 2024-05-08T09:49:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.366+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 msgr2=0x7f4f7c19b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.366+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 0x7f4f7c19b270 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f4f70009230 tx=0x7f4f70004270 comp rx=0 tx=0).stop 2024-05-08T09:49:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.366+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 shutdown_connections 2024-05-08T09:49:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.366+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f4f640b2a90 0x7f4f640b4f50 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.366+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f4f7c10f1f0 0x7f4f7c19fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.366+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f7c075700 0x7f4f7c19b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.367+0000 7f4f83c00640 1 --2- 172.21.15.70:0/1145896512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f7c074de0 0x7f4f7c19b270 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.367+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 >> 172.21.15.70:0/1145896512 conn(0x7f4f7c0fe440 msgr2=0x7f4f7c0ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:06.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.367+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 shutdown_connections 2024-05-08T09:49:06.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.367+0000 7f4f83c00640 1 -- 172.21.15.70:0/1145896512 wait complete. 2024-05-08T09:49:06.386 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-08T09:49:06.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T09:49:06.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.625+0000 7feca9000640 1 -- 172.21.15.70:0/4011563324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca40756a0 msgr2=0x7feca410ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.625+0000 7feca9000640 1 --2- 172.21.15.70:0/4011563324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca40756a0 0x7feca410ece0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fec90009900 tx=0x7fec9002a4a0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.625+0000 7feca9000640 1 -- 172.21.15.70:0/4011563324 shutdown_connections 2024-05-08T09:49:06.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.625+0000 7feca9000640 1 --2- 172.21.15.70:0/4011563324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca410f220 0x7feca4111630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.625+0000 7feca9000640 1 --2- 172.21.15.70:0/4011563324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca40756a0 0x7feca410ece0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.625+0000 7feca9000640 1 --2- 172.21.15.70:0/4011563324 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feca4074d80 0x7feca4075160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.625+0000 7feca9000640 1 -- 172.21.15.70:0/4011563324 >> 172.21.15.70:0/4011563324 conn(0x7feca4079d70 msgr2=0x7feca407a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:06.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.625+0000 7feca9000640 1 -- 172.21.15.70:0/4011563324 shutdown_connections 2024-05-08T09:49:06.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.625+0000 7feca9000640 1 -- 172.21.15.70:0/4011563324 wait complete. 2024-05-08T09:49:06.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.626+0000 7feca9000640 1 Processor -- start 2024-05-08T09:49:06.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.626+0000 7feca9000640 1 -- start start 2024-05-08T09:49:06.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca9000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca4074d80 0x7feca419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:06.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca9000640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feca40756a0 0x7feca419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:06.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca9000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca410f220 0x7feca419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:06.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca9000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7feca4114d40 con 0x7feca4074d80 2024-05-08T09:49:06.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca9000640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7feca4114bc0 con 0x7feca40756a0 2024-05-08T09:49:06.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca9000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7feca4114ec0 con 0x7feca410f220 2024-05-08T09:49:06.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca4074d80 0x7feca419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:06.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca4074d80 0x7feca419b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52024/0 (socket says 172.21.15.70:52024) 2024-05-08T09:49:06.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1e00640 1 -- 172.21.15.70:0/1803779234 learned_addr learned my addr 172.21.15.70:0/1803779234 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:06.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1400640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feca40756a0 0x7feca419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:06.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca2800640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca410f220 0x7feca419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:06.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1e00640 1 -- 172.21.15.70:0/1803779234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca410f220 msgr2=0x7feca419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1e00640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca410f220 0x7feca419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1e00640 1 -- 172.21.15.70:0/1803779234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feca40756a0 msgr2=0x7feca419b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1e00640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feca40756a0 0x7feca419b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1e00640 1 -- 172.21.15.70:0/1803779234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feca41a0370 con 0x7feca4074d80 2024-05-08T09:49:06.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca1400640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feca40756a0 0x7feca419b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:49:06.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.627+0000 7feca2800640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca410f220 0x7feca419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:49:06.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.628+0000 7feca1e00640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca4074d80 0x7feca419b380 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e9f0 tx=0x7fec9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:06.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.628+0000 7fec9aa00640 1 -- 172.21.15.70:0/1803779234 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec9400cd80 con 0x7feca4074d80 2024-05-08T09:49:06.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.628+0000 7fec9aa00640 1 -- 172.21.15.70:0/1803779234 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec940108c0 con 0x7feca4074d80 2024-05-08T09:49:06.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.628+0000 7fec9aa00640 1 -- 172.21.15.70:0/1803779234 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec940187c0 con 0x7feca4074d80 2024-05-08T09:49:06.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.628+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feca41a0660 con 0x7feca4074d80 2024-05-08T09:49:06.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.628+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feca41a7ef0 con 0x7feca4074d80 2024-05-08T09:49:06.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.629+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feca4069c20 con 0x7feca4074d80 2024-05-08T09:49:06.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.631+0000 7fec9aa00640 1 -- 172.21.15.70:0/1803779234 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fec94010430 con 0x7feca4074d80 2024-05-08T09:49:06.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.633+0000 7fec9aa00640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec880b29e0 0x7fec880b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.633+0000 7fec9aa00640 1 -- 172.21.15.70:0/1803779234 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7fec940e2ec0 con 0x7feca4074d80 2024-05-08T09:49:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.633+0000 7feca1400640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec880b29e0 0x7fec880b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:06.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.634+0000 7feca1400640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec880b29e0 0x7fec880b4ea0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fec90000c00 tx=0x7fec90032c20 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:06.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.637+0000 7fec9aa00640 1 -- 172.21.15.70:0/1803779234 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fec940aa440 con 0x7feca4074d80 2024-05-08T09:49:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.846+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feca4109e10 con 0x7feca4074d80 2024-05-08T09:49:06.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.861+0000 7fec9aa00640 1 -- 172.21.15.70:0/1803779234 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v442) ==== 74+0+25364 (secure 0 0 0) 0x7fec940a9d40 con 0x7feca4074d80 2024-05-08T09:49:06.861 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:49:06.862 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":442,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T09:48:42.156036+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"440","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":356,"snap_epoch":440,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"440","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":356,"snap_epoch":440,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/565155292":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6800/3718531938":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6801/3718531938":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2886471860":"2024-05-09T06:46:32.619296+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/2096266006":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/360029842":"2024-05-09T06:46:32.619296+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":343,"length":1},{"begin":356,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T09:49:06.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.864+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec880b29e0 msgr2=0x7fec880b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.864+0000 7feca9000640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec880b29e0 0x7fec880b4ea0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fec90000c00 tx=0x7fec90032c20 comp rx=0 tx=0).stop 2024-05-08T09:49:06.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.864+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca4074d80 msgr2=0x7feca419b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:06.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.864+0000 7feca9000640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca4074d80 0x7feca419b380 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fec9400e9f0 tx=0x7fec9400eeb0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.865+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 shutdown_connections 2024-05-08T09:49:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.865+0000 7feca9000640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fec880b29e0 0x7fec880b4ea0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.865+0000 7feca9000640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feca410f220 0x7feca419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.865+0000 7feca9000640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7feca40756a0 0x7feca419b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.865+0000 7feca9000640 1 --2- 172.21.15.70:0/1803779234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7feca4074d80 0x7feca419b380 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.865+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 >> 172.21.15.70:0/1803779234 conn(0x7feca4079d70 msgr2=0x7feca4101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.865+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 shutdown_connections 2024-05-08T09:49:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:06.865+0000 7feca9000640 1 -- 172.21.15.70:0/1803779234 wait complete. 2024-05-08T09:49:06.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:06 smithi070 ceph-mon[29591]: pgmap v5826: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 277 KiB/s wr, 43 op/s 2024-05-08T09:49:06.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:06 smithi070 ceph-mon[29591]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:49:06.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:06 smithi070 ceph-mon[29591]: from='client.20127 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T09:49:06.883 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T06:34:30.088563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T06:41:04.053091+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T06:41:08.479556+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '440', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 356, 'snap_epoch': 440, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-08T06:41:22.635580+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '440', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 356, 'snap_epoch': 440, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-08T09:49:06.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T09:49:06.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:06 smithi172 ceph-mon[33377]: pgmap v5826: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 277 KiB/s wr, 43 op/s 2024-05-08T09:49:06.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:06 smithi172 ceph-mon[33377]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:49:06.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:06 smithi172 ceph-mon[33377]: from='client.20127 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T09:49:07.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:06 smithi194 ceph-mon[33679]: pgmap v5826: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 420 KiB/s rd, 277 KiB/s wr, 43 op/s 2024-05-08T09:49:07.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:06 smithi194 ceph-mon[33679]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T09:49:07.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:06 smithi194 ceph-mon[33679]: from='client.20127 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T09:49:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.082+0000 7fae1aa00640 1 -- 172.21.15.70:0/1512658238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14113890 msgr2=0x7fae14115c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.082+0000 7fae1aa00640 1 --2- 172.21.15.70:0/1512658238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14113890 0x7fae14115c80 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fae0c009ca0 tx=0x7fae0c02a8c0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.082+0000 7fae1aa00640 1 -- 172.21.15.70:0/1512658238 shutdown_connections 2024-05-08T09:49:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.082+0000 7fae1aa00640 1 --2- 172.21.15.70:0/1512658238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14113890 0x7fae14115c80 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.082+0000 7fae1aa00640 1 --2- 172.21.15.70:0/1512658238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14077800 0x7fae14113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.082+0000 7fae1aa00640 1 --2- 172.21.15.70:0/1512658238 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae14076ee0 0x7fae140772c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.082+0000 7fae1aa00640 1 -- 172.21.15.70:0/1512658238 >> 172.21.15.70:0/1512658238 conn(0x7fae14100740 msgr2=0x7fae14102b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.082+0000 7fae1aa00640 1 -- 172.21.15.70:0/1512658238 shutdown_connections 2024-05-08T09:49:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.082+0000 7fae1aa00640 1 -- 172.21.15.70:0/1512658238 wait complete. 2024-05-08T09:49:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.083+0000 7fae1aa00640 1 Processor -- start 2024-05-08T09:49:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.083+0000 7fae1aa00640 1 -- start start 2024-05-08T09:49:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae1aa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14076ee0 0x7fae1419f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae1aa00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae14077800 0x7fae1419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae1aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113890 0x7fae141a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae1aa00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae14119110 con 0x7fae14076ee0 2024-05-08T09:49:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae1aa00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fae14118f90 con 0x7fae14077800 2024-05-08T09:49:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae1aa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fae14119290 con 0x7fae14113890 2024-05-08T09:49:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae13e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14076ee0 0x7fae1419f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae13e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14076ee0 0x7fae1419f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52048/0 (socket says 172.21.15.70:52048) 2024-05-08T09:49:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae13e00640 1 -- 172.21.15.70:0/3734276578 learned_addr learned my addr 172.21.15.70:0/3734276578 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae13e00640 1 -- 172.21.15.70:0/3734276578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113890 msgr2=0x7fae141a3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae13e00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113890 0x7fae141a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae13e00640 1 -- 172.21.15.70:0/3734276578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae14077800 msgr2=0x7fae1419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae13e00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae14077800 0x7fae1419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae13e00640 1 -- 172.21.15.70:0/3734276578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae141a4660 con 0x7fae14076ee0 2024-05-08T09:49:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.084+0000 7fae13e00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14076ee0 0x7fae1419f670 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fae0400d950 tx=0x7fae0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.085+0000 7fae10c00640 1 -- 172.21.15.70:0/3734276578 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04017070 con 0x7fae14076ee0 2024-05-08T09:49:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.085+0000 7fae10c00640 1 -- 172.21.15.70:0/3734276578 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae04009c30 con 0x7fae14076ee0 2024-05-08T09:49:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.085+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae141a4950 con 0x7fae14076ee0 2024-05-08T09:49:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.085+0000 7fae10c00640 1 -- 172.21.15.70:0/3734276578 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0400f620 con 0x7fae14076ee0 2024-05-08T09:49:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.085+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae141ac1e0 con 0x7fae14076ee0 2024-05-08T09:49:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.086+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae14069c20 con 0x7fae14076ee0 2024-05-08T09:49:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.088+0000 7fae10c00640 1 -- 172.21.15.70:0/3734276578 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fae04010460 con 0x7fae14076ee0 2024-05-08T09:49:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.090+0000 7fae10c00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fadf80b29e0 0x7fadf80b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.090+0000 7fae10c00640 1 -- 172.21.15.70:0/3734276578 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7fae040e26c0 con 0x7fae14076ee0 2024-05-08T09:49:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.090+0000 7fae13400640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fadf80b29e0 0x7fadf80b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.091+0000 7fae13400640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fadf80b29e0 0x7fadf80b4ea0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fae14079b50 tx=0x7fae00005c00 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.094+0000 7fae10c00640 1 -- 172.21.15.70:0/3734276578 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fae040a9c40 con 0x7fae14076ee0 2024-05-08T09:49:07.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.290+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fae1402db50 con 0x7fae14076ee0 2024-05-08T09:49:07.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.348+0000 7fae10c00640 1 -- 172.21.15.70:0/3734276578 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v442) ==== 93+0+10 (secure 0 0 0) 0x7fae04009de0 con 0x7fae14076ee0 2024-05-08T09:49:07.348 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-05-08T09:49:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fadf80b29e0 msgr2=0x7fadf80b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fadf80b29e0 0x7fadf80b4ea0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fae14079b50 tx=0x7fae00005c00 comp rx=0 tx=0).stop 2024-05-08T09:49:07.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14076ee0 msgr2=0x7fae1419f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14076ee0 0x7fae1419f670 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fae0400d950 tx=0x7fae0400de10 comp rx=0 tx=0).stop 2024-05-08T09:49:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 shutdown_connections 2024-05-08T09:49:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fadf80b29e0 0x7fadf80b4ea0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fae14113890 0x7fae141a3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fae14077800 0x7fae1419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 --2- 172.21.15.70:0/3734276578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae14076ee0 0x7fae1419f670 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 >> 172.21.15.70:0/3734276578 conn(0x7fae14100740 msgr2=0x7fae14102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:07.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 shutdown_connections 2024-05-08T09:49:07.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.351+0000 7fae1aa00640 1 -- 172.21.15.70:0/3734276578 wait complete. 2024-05-08T09:49:07.370 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T09:49:07.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.561+0000 7f9435800640 1 -- 172.21.15.70:0/4173808933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430108860 msgr2=0x7f9430108c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.561+0000 7f9435800640 1 --2- 172.21.15.70:0/4173808933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430108860 0x7f9430108c40 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f9420009930 tx=0x7f942002a420 comp rx=0 tx=0).stop 2024-05-08T09:49:07.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.562+0000 7f9435800640 1 -- 172.21.15.70:0/4173808933 shutdown_connections 2024-05-08T09:49:07.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.562+0000 7f9435800640 1 --2- 172.21.15.70:0/4173808933 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9430103210 0x7f943010f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.562+0000 7f9435800640 1 --2- 172.21.15.70:0/4173808933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9430102850 0x7f9430102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.562+0000 7f9435800640 1 --2- 172.21.15.70:0/4173808933 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430108860 0x7f9430108c40 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.562+0000 7f9435800640 1 -- 172.21.15.70:0/4173808933 >> 172.21.15.70:0/4173808933 conn(0x7f94300fe380 msgr2=0x7f94301007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:07.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.562+0000 7f9435800640 1 -- 172.21.15.70:0/4173808933 shutdown_connections 2024-05-08T09:49:07.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.562+0000 7f9435800640 1 -- 172.21.15.70:0/4173808933 wait complete. 2024-05-08T09:49:07.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f9435800640 1 Processor -- start 2024-05-08T09:49:07.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f9435800640 1 -- start start 2024-05-08T09:49:07.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f9435800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9430102850 0x7f9430074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:07.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f9435800640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430103210 0x7f94300751f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:07.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f9435800640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9430108860 0x7f9430075730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:07.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f9435800640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9430112a20 con 0x7f9430103210 2024-05-08T09:49:07.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f9435800640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f94301128a0 con 0x7f9430108860 2024-05-08T09:49:07.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f9435800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9430112ba0 con 0x7f9430102850 2024-05-08T09:49:07.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f942f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430103210 0x7f94300751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:07.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f942f400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430103210 0x7f94300751f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33776/0 (socket says 172.21.15.70:33776) 2024-05-08T09:49:07.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.563+0000 7f942f400640 1 -- 172.21.15.70:0/1192133187 learned_addr learned my addr 172.21.15.70:0/1192133187 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:07.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942fe00640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9430102850 0x7f9430074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:07.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f9434e00640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9430108860 0x7f9430075730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:07.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942f400640 1 -- 172.21.15.70:0/1192133187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9430102850 msgr2=0x7f9430074cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942f400640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9430102850 0x7f9430074cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942f400640 1 -- 172.21.15.70:0/1192133187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9430108860 msgr2=0x7f9430075730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942f400640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9430108860 0x7f9430075730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942f400640 1 -- 172.21.15.70:0/1192133187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94301a7500 con 0x7f9430103210 2024-05-08T09:49:07.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942fe00640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9430102850 0x7f9430074cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:49:07.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f9434e00640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9430108860 0x7f9430075730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:49:07.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942f400640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430103210 0x7f94300751f0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f941c00d770 tx=0x7f941c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:07.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942cc00640 1 -- 172.21.15.70:0/1192133187 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c017070 con 0x7f9430103210 2024-05-08T09:49:07.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942cc00640 1 -- 172.21.15.70:0/1192133187 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f941c0054b0 con 0x7f9430103210 2024-05-08T09:49:07.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94301a77f0 con 0x7f9430103210 2024-05-08T09:49:07.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f942cc00640 1 -- 172.21.15.70:0/1192133187 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c004c60 con 0x7f9430103210 2024-05-08T09:49:07.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.564+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94301a7d40 con 0x7f9430103210 2024-05-08T09:49:07.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.565+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94300696f0 con 0x7f9430103210 2024-05-08T09:49:07.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.568+0000 7f942cc00640 1 -- 172.21.15.70:0/1192133187 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f941c004e00 con 0x7f9430103210 2024-05-08T09:49:07.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.571+0000 7f942cc00640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94140b29e0 0x7f94140b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:07.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.571+0000 7f942cc00640 1 -- 172.21.15.70:0/1192133187 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7f941c0e2540 con 0x7f9430103210 2024-05-08T09:49:07.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.571+0000 7f942fe00640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94140b29e0 0x7f94140b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:07.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.572+0000 7f942fe00640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94140b29e0 0x7f94140b4ea0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9420005ab0 tx=0x7f9420005fd0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:07.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.576+0000 7f942cc00640 1 -- 172.21.15.70:0/1192133187 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f941c0a9ac0 con 0x7f9430103210 2024-05-08T09:49:07.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.771+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f943010adc0 con 0x7f9430103210 2024-05-08T09:49:07.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.772+0000 7f942cc00640 1 -- 172.21.15.70:0/1192133187 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v442) ==== 104+0+11 (secure 0 0 0) 0x7f941c0a93c0 con 0x7f9430103210 2024-05-08T09:49:07.772 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-05-08T09:49:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94140b29e0 msgr2=0x7f94140b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94140b29e0 0x7f94140b4ea0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9420005ab0 tx=0x7f9420005fd0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430103210 msgr2=0x7f94300751f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430103210 0x7f94300751f0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f941c00d770 tx=0x7f941c00dc30 comp rx=0 tx=0).stop 2024-05-08T09:49:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 shutdown_connections 2024-05-08T09:49:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f94140b29e0 0x7f94140b4ea0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9430108860 0x7f9430075730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9430103210 0x7f94300751f0 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 --2- 172.21.15.70:0/1192133187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9430102850 0x7f9430074cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 >> 172.21.15.70:0/1192133187 conn(0x7f94300fe380 msgr2=0x7f94300fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 shutdown_connections 2024-05-08T09:49:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:07.775+0000 7f9435800640 1 -- 172.21.15.70:0/1192133187 wait complete. 2024-05-08T09:49:07.794 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T09:49:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:07 smithi070 ceph-mon[29591]: from='client.20133 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T09:49:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:07 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1803779234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T09:49:07.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:07 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3734276578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T09:49:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:07 smithi172 ceph-mon[33377]: from='client.20133 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T09:49:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:07 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1803779234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T09:49:07.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:07 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3734276578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T09:49:07.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.000+0000 7ffaf1400640 1 -- 172.21.15.70:0/1711875864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec1098f0 msgr2=0x7ffaec115d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:07.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.000+0000 7ffaf1400640 1 --2- 172.21.15.70:0/1711875864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec1098f0 0x7ffaec115d10 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009ca0 tx=0x7ffae402a950 comp rx=0 tx=0).stop 2024-05-08T09:49:07.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.000+0000 7ffaf1400640 1 -- 172.21.15.70:0/1711875864 shutdown_connections 2024-05-08T09:49:07.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.000+0000 7ffaf1400640 1 --2- 172.21.15.70:0/1711875864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec1098f0 0x7ffaec115d10 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:07.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.000+0000 7ffaf1400640 1 --2- 172.21.15.70:0/1711875864 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec108f50 0x7ffaec1093b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.000+0000 7ffaf1400640 1 --2- 172.21.15.70:0/1711875864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec10ef70 0x7ffaec10f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.000+0000 7ffaf1400640 1 -- 172.21.15.70:0/1711875864 >> 172.21.15.70:0/1711875864 conn(0x7ffaec0787d0 msgr2=0x7ffaec1077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.000+0000 7ffaf1400640 1 -- 172.21.15.70:0/1711875864 shutdown_connections 2024-05-08T09:49:08.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.000+0000 7ffaf1400640 1 -- 172.21.15.70:0/1711875864 wait complete. 2024-05-08T09:49:08.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.001+0000 7ffaf1400640 1 Processor -- start 2024-05-08T09:49:08.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.001+0000 7ffaf1400640 1 -- start start 2024-05-08T09:49:08.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.001+0000 7ffaf1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec108f50 0x7ffaec19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.001+0000 7ffaf1400640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec1098f0 0x7ffaec19fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.001+0000 7ffaf1400640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec10ef70 0x7ffaec1a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.001+0000 7ffaf1400640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec118f90 con 0x7ffaec10ef70 2024-05-08T09:49:08.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.001+0000 7ffaf1400640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec118e10 con 0x7ffaec1098f0 2024-05-08T09:49:08.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.001+0000 7ffaf1400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7ffaec119110 con 0x7ffaec108f50 2024-05-08T09:49:08.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaf0a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec10ef70 0x7ffaec1a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaf0a00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec10ef70 0x7ffaec1a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33800/0 (socket says 172.21.15.70:33800) 2024-05-08T09:49:08.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaf0a00640 1 -- 172.21.15.70:0/2094168048 learned_addr learned my addr 172.21.15.70:0/2094168048 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:08.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffae3400640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec1098f0 0x7ffaec19fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaebe00640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec108f50 0x7ffaec19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaf0a00640 1 -- 172.21.15.70:0/2094168048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec108f50 msgr2=0x7ffaec19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaf0a00640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec108f50 0x7ffaec19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaf0a00640 1 -- 172.21.15.70:0/2094168048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec1098f0 msgr2=0x7ffaec19fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaf0a00640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec1098f0 0x7ffaec19fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaf0a00640 1 -- 172.21.15.70:0/2094168048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaec1a44c0 con 0x7ffaec10ef70 2024-05-08T09:49:08.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.002+0000 7ffaf0a00640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec10ef70 0x7ffaec1a3d90 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7ffae402ae70 tx=0x7ffae4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:08.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.003+0000 7ffae9600640 1 -- 172.21.15.70:0/2094168048 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4034040 con 0x7ffaec10ef70 2024-05-08T09:49:08.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.003+0000 7ffae9600640 1 -- 172.21.15.70:0/2094168048 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffae4030850 con 0x7ffaec10ef70 2024-05-08T09:49:08.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.003+0000 7ffae9600640 1 -- 172.21.15.70:0/2094168048 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae4004600 con 0x7ffaec10ef70 2024-05-08T09:49:08.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.003+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaec1a4750 con 0x7ffaec10ef70 2024-05-08T09:49:08.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.003+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaec1ac040 con 0x7ffaec10ef70 2024-05-08T09:49:08.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.004+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaec10a5a0 con 0x7ffaec10ef70 2024-05-08T09:49:08.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.006+0000 7ffae9600640 1 -- 172.21.15.70:0/2094168048 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ffae4037020 con 0x7ffaec10ef70 2024-05-08T09:49:08.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.008+0000 7ffae9600640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad00b29e0 0x7ffad00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.008+0000 7ffae9600640 1 -- 172.21.15.70:0/2094168048 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7ffae4103840 con 0x7ffaec10ef70 2024-05-08T09:49:08.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.008+0000 7ffaebe00640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad00b29e0 0x7ffad00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.009+0000 7ffaebe00640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad00b29e0 0x7ffad00b4ea0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ffadc005fd0 tx=0x7ffadc005850 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:08.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:07 smithi194 ceph-mon[33679]: from='client.20133 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T09:49:08.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:07 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1803779234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T09:49:08.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:07 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3734276578' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T09:49:08.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.012+0000 7ffae9600640 1 -- 172.21.15.70:0/2094168048 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffae40caed0 con 0x7ffaec10ef70 2024-05-08T09:49:08.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.219+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffaec111360 con 0x7ffaec10ef70 2024-05-08T09:49:08.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.220+0000 7ffae9600640 1 -- 172.21.15.70:0/2094168048 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v442) ==== 100+0+11 (secure 0 0 0) 0x7ffae40ca7d0 con 0x7ffaec10ef70 2024-05-08T09:49:08.219 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-05-08T09:49:08.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.222+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad00b29e0 msgr2=0x7ffad00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.222+0000 7ffaf1400640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad00b29e0 0x7ffad00b4ea0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ffadc005fd0 tx=0x7ffadc005850 comp rx=0 tx=0).stop 2024-05-08T09:49:08.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.222+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec10ef70 msgr2=0x7ffaec1a3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.222+0000 7ffaf1400640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec10ef70 0x7ffaec1a3d90 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7ffae402ae70 tx=0x7ffae4003ce0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.222+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 shutdown_connections 2024-05-08T09:49:08.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.223+0000 7ffaf1400640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7ffad00b29e0 0x7ffad00b4ea0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.223+0000 7ffaf1400640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaec10ef70 0x7ffaec1a3d90 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.223+0000 7ffaf1400640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7ffaec1098f0 0x7ffaec19fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.223+0000 7ffaf1400640 1 --2- 172.21.15.70:0/2094168048 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffaec108f50 0x7ffaec19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.223+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 >> 172.21.15.70:0/2094168048 conn(0x7ffaec0787d0 msgr2=0x7ffaec079a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.223+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 shutdown_connections 2024-05-08T09:49:08.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.223+0000 7ffaf1400640 1 -- 172.21.15.70:0/2094168048 wait complete. 2024-05-08T09:49:08.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-08T09:49:08.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.447+0000 7fabfbe00640 1 -- 172.21.15.70:0/212000007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc108f50 msgr2=0x7fabfc1093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.447+0000 7fabfbe00640 1 --2- 172.21.15.70:0/212000007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc108f50 0x7fabfc1093b0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fabe4009900 tx=0x7fabe402a480 comp rx=0 tx=0).stop 2024-05-08T09:49:08.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.447+0000 7fabfbe00640 1 -- 172.21.15.70:0/212000007 shutdown_connections 2024-05-08T09:49:08.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.447+0000 7fabfbe00640 1 --2- 172.21.15.70:0/212000007 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabfc1098f0 0x7fabfc115d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.447+0000 7fabfbe00640 1 --2- 172.21.15.70:0/212000007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc108f50 0x7fabfc1093b0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.447+0000 7fabfbe00640 1 --2- 172.21.15.70:0/212000007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc10ef70 0x7fabfc10f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.447+0000 7fabfbe00640 1 -- 172.21.15.70:0/212000007 >> 172.21.15.70:0/212000007 conn(0x7fabfc0787d0 msgr2=0x7fabfc1077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:08.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.447+0000 7fabfbe00640 1 -- 172.21.15.70:0/212000007 shutdown_connections 2024-05-08T09:49:08.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.447+0000 7fabfbe00640 1 -- 172.21.15.70:0/212000007 wait complete. 2024-05-08T09:49:08.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.448+0000 7fabfbe00640 1 Processor -- start 2024-05-08T09:49:08.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.448+0000 7fabfbe00640 1 -- start start 2024-05-08T09:49:08.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabfbe00640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabfc108f50 0x7fabfc19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabfbe00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc1098f0 0x7fabfc19fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabfbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc10ef70 0x7fabfc1a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabfbe00640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc119000 con 0x7fabfc1098f0 2024-05-08T09:49:08.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabfbe00640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc118e80 con 0x7fabfc108f50 2024-05-08T09:49:08.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabfbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc119180 con 0x7fabfc10ef70 2024-05-08T09:49:08.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabf3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc1098f0 0x7fabfc19fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabf3e00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc1098f0 0x7fabfc19fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33808/0 (socket says 172.21.15.70:33808) 2024-05-08T09:49:08.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabf3e00640 1 -- 172.21.15.70:0/1975123952 learned_addr learned my addr 172.21.15.70:0/1975123952 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:08.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabfaa00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabfc108f50 0x7fabfc19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabf3e00640 1 -- 172.21.15.70:0/1975123952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc10ef70 msgr2=0x7fabfc1a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabf3e00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc10ef70 0x7fabfc1a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabf3e00640 1 -- 172.21.15.70:0/1975123952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabfc108f50 msgr2=0x7fabfc19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabf3e00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabfc108f50 0x7fabfc19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabf3e00640 1 -- 172.21.15.70:0/1975123952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc1a44e0 con 0x7fabfc1098f0 2024-05-08T09:49:08.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.449+0000 7fabfaa00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabfc108f50 0x7fabfc19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:49:08.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.450+0000 7fabf3e00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc1098f0 0x7fabfc19fa80 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fabe402a9a0 tx=0x7fabe4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:08.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.450+0000 7fabf3400640 1 -- 172.21.15.70:0/1975123952 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe403f070 con 0x7fabfc1098f0 2024-05-08T09:49:08.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.450+0000 7fabf3400640 1 -- 172.21.15.70:0/1975123952 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabe4003e40 con 0x7fabfc1098f0 2024-05-08T09:49:08.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.450+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabfc1a4770 con 0x7fabfc1098f0 2024-05-08T09:49:08.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.450+0000 7fabf3400640 1 -- 172.21.15.70:0/1975123952 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4035030 con 0x7fabfc1098f0 2024-05-08T09:49:08.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.450+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabfc1ac060 con 0x7fabfc1098f0 2024-05-08T09:49:08.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.451+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabfc069b40 con 0x7fabfc1098f0 2024-05-08T09:49:08.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.454+0000 7fabf3400640 1 -- 172.21.15.70:0/1975123952 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fabe4042070 con 0x7fabfc1098f0 2024-05-08T09:49:08.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.456+0000 7fabf3400640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fabe00b2960 0x7fabe00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.456+0000 7fabf3400640 1 -- 172.21.15.70:0/1975123952 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7fabe4103340 con 0x7fabfc1098f0 2024-05-08T09:49:08.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.456+0000 7fabfaa00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fabe00b2960 0x7fabe00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.457+0000 7fabfaa00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fabe00b2960 0x7fabe00b4e20 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fabec009b40 tx=0x7fabec005e50 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:08.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.461+0000 7fabf3400640 1 -- 172.21.15.70:0/1975123952 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fabe40ca8c0 con 0x7fabfc1098f0 2024-05-08T09:49:08.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.665+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fabfc1113c0 con 0x7fabfc1098f0 2024-05-08T09:49:08.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.665+0000 7fabf3400640 1 -- 172.21.15.70:0/1975123952 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v442) ==== 103+0+11 (secure 0 0 0) 0x7fabe40ca1c0 con 0x7fabfc1098f0 2024-05-08T09:49:08.665 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-05-08T09:49:08.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fabe00b2960 msgr2=0x7fabe00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fabe00b2960 0x7fabe00b4e20 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fabec009b40 tx=0x7fabec005e50 comp rx=0 tx=0).stop 2024-05-08T09:49:08.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc1098f0 msgr2=0x7fabfc19fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc1098f0 0x7fabfc19fa80 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fabe402a9a0 tx=0x7fabe4003c20 comp rx=0 tx=0).stop 2024-05-08T09:49:08.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 shutdown_connections 2024-05-08T09:49:08.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fabe00b2960 0x7fabe00b4e20 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabfc10ef70 0x7fabfc1a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fabfc1098f0 0x7fabfc19fa80 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 --2- 172.21.15.70:0/1975123952 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fabfc108f50 0x7fabfc19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 >> 172.21.15.70:0/1975123952 conn(0x7fabfc0787d0 msgr2=0x7fabfc0798e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 shutdown_connections 2024-05-08T09:49:08.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.668+0000 7fabfbe00640 1 -- 172.21.15.70:0/1975123952 wait complete. 2024-05-08T09:49:08.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-08T09:49:08.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:08 smithi070 ceph-mon[29591]: pgmap v5827: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 111 KiB/s wr, 12 op/s 2024-05-08T09:49:08.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1192133187' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T09:49:08.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:08 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2094168048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T09:49:08.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.881+0000 7fcf61200640 1 -- 172.21.15.70:0/2976161167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c10cdd0 msgr2=0x7fcf5c10f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.881+0000 7fcf61200640 1 --2- 172.21.15.70:0/2976161167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c10cdd0 0x7fcf5c10f220 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009ca0 tx=0x7fcf5402a8b0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.881+0000 7fcf61200640 1 -- 172.21.15.70:0/2976161167 shutdown_connections 2024-05-08T09:49:08.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.881+0000 7fcf61200640 1 --2- 172.21.15.70:0/2976161167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c10cdd0 0x7fcf5c10f220 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.881+0000 7fcf61200640 1 --2- 172.21.15.70:0/2976161167 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf5c104280 0x7fcf5c10c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.881+0000 7fcf61200640 1 --2- 172.21.15.70:0/2976161167 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf5c103960 0x7fcf5c103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.881+0000 7fcf61200640 1 -- 172.21.15.70:0/2976161167 >> 172.21.15.70:0/2976161167 conn(0x7fcf5c0fd160 msgr2=0x7fcf5c0ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:08.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.881+0000 7fcf61200640 1 -- 172.21.15.70:0/2976161167 shutdown_connections 2024-05-08T09:49:08.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.881+0000 7fcf61200640 1 -- 172.21.15.70:0/2976161167 wait complete. 2024-05-08T09:49:08.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.882+0000 7fcf61200640 1 Processor -- start 2024-05-08T09:49:08.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.882+0000 7fcf61200640 1 -- start start 2024-05-08T09:49:08.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf61200640 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf5c103960 0x7fcf5c19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf61200640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c104280 0x7fcf5c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf61200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf5c10cdd0 0x7fcf5c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf61200640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c112930 con 0x7fcf5c104280 2024-05-08T09:49:08.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf61200640 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c1127b0 con 0x7fcf5c103960 2024-05-08T09:49:08.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf61200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5c112ab0 con 0x7fcf5c10cdd0 2024-05-08T09:49:08.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf5aa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c104280 0x7fcf5c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf5aa00640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c104280 0x7fcf5c19b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33832/0 (socket says 172.21.15.70:33832) 2024-05-08T09:49:08.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf5aa00640 1 -- 172.21.15.70:0/967524104 learned_addr learned my addr 172.21.15.70:0/967524104 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:49:08.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf5aa00640 1 -- 172.21.15.70:0/967524104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf5c10cdd0 msgr2=0x7fcf5c19f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf5be00640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf5c10cdd0 0x7fcf5c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.883+0000 7fcf5b400640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf5c103960 0x7fcf5c19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf5aa00640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf5c10cdd0 0x7fcf5c19f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf5aa00640 1 -- 172.21.15.70:0/967524104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf5c103960 msgr2=0x7fcf5c19af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:08.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf5aa00640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf5c103960 0x7fcf5c19af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:08.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf5aa00640 1 -- 172.21.15.70:0/967524104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5c19ff70 con 0x7fcf5c104280 2024-05-08T09:49:08.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf5b400640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf5c103960 0x7fcf5c19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:49:08.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf5aa00640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c104280 0x7fcf5c19b4c0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c970 tx=0x7fcf4800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:08.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf53e00640 1 -- 172.21.15.70:0/967524104 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf48007c10 con 0x7fcf5c104280 2024-05-08T09:49:08.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf53e00640 1 -- 172.21.15.70:0/967524104 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcf48007db0 con 0x7fcf5c104280 2024-05-08T09:49:08.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf53e00640 1 -- 172.21.15.70:0/967524104 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800f7d0 con 0x7fcf5c104280 2024-05-08T09:49:08.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf5c1a0260 con 0x7fcf5c104280 2024-05-08T09:49:08.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.884+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5c1a7af0 con 0x7fcf5c104280 2024-05-08T09:49:08.887 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:08 smithi172 ceph-mon[33377]: pgmap v5827: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 111 KiB/s wr, 12 op/s 2024-05-08T09:49:08.887 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1192133187' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T09:49:08.887 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:08 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2094168048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T09:49:08.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.885+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf5c069b40 con 0x7fcf5c104280 2024-05-08T09:49:08.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.888+0000 7fcf53e00640 1 -- 172.21.15.70:0/967524104 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fcf48018480 con 0x7fcf5c104280 2024-05-08T09:49:08.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.891+0000 7fcf53e00640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf400b2960 0x7fcf400b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:49:08.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.891+0000 7fcf53e00640 1 -- 172.21.15.70:0/967524104 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(442..442 src has 1..442) ==== 9539+0+0 (secure 0 0 0) 0x7fcf480e2dd0 con 0x7fcf5c104280 2024-05-08T09:49:08.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.891+0000 7fcf5b400640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf400b2960 0x7fcf400b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:49:08.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.892+0000 7fcf5b400640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf400b2960 0x7fcf400b4e20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00baa0 tx=0x7fcf4c005d90 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:49:08.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:08.895+0000 7fcf53e00640 1 -- 172.21.15.70:0/967524104 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcf480aa3e0 con 0x7fcf5c104280 2024-05-08T09:49:09.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:08 smithi194 ceph-mon[33679]: pgmap v5827: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 111 KiB/s wr, 12 op/s 2024-05-08T09:49:09.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1192133187' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T09:49:09.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:08 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2094168048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T09:49:09.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.138+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fcf5c19c2d0 con 0x7fcf5c104280 2024-05-08T09:49:09.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.194+0000 7fcf53e00640 1 -- 172.21.15.70:0/967524104 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+816174 (secure 0 0 0) 0x7fcf480a9ce0 con 0x7fcf5c104280 2024-05-08T09:49:09.206 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:49:09.206 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:49:09.206 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 25, 2024-05-08T09:49:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "active_gid": 15198, 2024-05-08T09:49:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "active_name": "x", 2024-05-08T09:49:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addrs": { 2024-05-08T09:49:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-05-08T09:49:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-05-08T09:49:09.207 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-05-08T09:49:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3968184776 2024-05-08T09:49:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-05-08T09:49:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-05-08T09:49:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3968184776 2024-05-08T09:49:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.208 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addr": "172.21.15.70:6801/3968184776", 2024-05-08T09:49:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "active_change": "2024-05-08T06:46:32.619816+0000", 2024-05-08T09:49:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "active_mgr_features": 4540701547738038271, 2024-05-08T09:49:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "available": true, 2024-05-08T09:49:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "standbys": [ 2024-05-08T09:49:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24787, 2024-05-08T09:49:09.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "y", 2024-05-08T09:49:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540701547738038271, 2024-05-08T09:49:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-05-08T09:49:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-05-08T09:49:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:09.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.212 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.213 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.215 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.217 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.219 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-05-08T09:49:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-05-08T09:49:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.221 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-05-08T09:49:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-05-08T09:49:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-05-08T09:49:09.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-05-08T09:49:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-05-08T09:49:09.223 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-05-08T09:49:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-05-08T09:49:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.224 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-05-08T09:49:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-05-08T09:49:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-05-08T09:49:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.226 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.227 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-05-08T09:49:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-05-08T09:49:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-05-08T09:49:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-05-08T09:49:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.229 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-05-08T09:49:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-05-08T09:49:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-05-08T09:49:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.231 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T09:49:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-05-08T09:49:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-05-08T09:49:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.232 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-05-08T09:49:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.234 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.235 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-05-08T09:49:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-05-08T09:49:09.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-05-08T09:49:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.237 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.238 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-05-08T09:49:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T09:49:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T09:49:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.239 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-05-08T09:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-05-08T09:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-05-08T09:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-05-08T09:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.240 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T09:49:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T09:49:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-05-08T09:49:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-05-08T09:49:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-05-08T09:49:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-05-08T09:49:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T09:49:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-05-08T09:49:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-05-08T09:49:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T09:49:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.243 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T09:49:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T09:49:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-05-08T09:49:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-05-08T09:49:09.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-05-08T09:49:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-05-08T09:49:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-05-08T09:49:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-05-08T09:49:09.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T09:49:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-05-08T09:49:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-05-08T09:49:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.246 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-05-08T09:49:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T09:49:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T09:49:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.247 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-05-08T09:49:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-05-08T09:49:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-05-08T09:49:09.248 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-05-08T09:49:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T09:49:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T09:49:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.250 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.251 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.252 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.253 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.254 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.257 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-05-08T09:49:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-05-08T09:49:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.258 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T09:49:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.260 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-05-08T09:49:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-05-08T09:49:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-05-08T09:49:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-05-08T09:49:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-05-08T09:49:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-05-08T09:49:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.261 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-05-08T09:49:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-05-08T09:49:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.262 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T09:49:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:09.263 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T09:49:09.264 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-05-08T09:49:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-05-08T09:49:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:09.267 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:09.268 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T09:49:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-05-08T09:49:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.270 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-05-08T09:49:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-05-08T09:49:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-05-08T09:49:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T09:49:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-05-08T09:49:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-05-08T09:49:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.272 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-05-08T09:49:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T09:49:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-05-08T09:49:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-05-08T09:49:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.274 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-05-08T09:49:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T09:49:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.275 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-05-08T09:49:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-05-08T09:49:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.276 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T09:49:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T09:49:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.277 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-05-08T09:49:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-05-08T09:49:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.278 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T09:49:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-05-08T09:49:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T09:49:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:09.279 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-05-08T09:49:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T09:49:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-05-08T09:49:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-05-08T09:49:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-05-08T09:49:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-05-08T09:49:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-05-08T09:49:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.282 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-08T09:49:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-05-08T09:49:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-05-08T09:49:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.283 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T09:49:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.284 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.285 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T09:49:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-05-08T09:49:09.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-05-08T09:49:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T09:49:09.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-05-08T09:49:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-05-08T09:49:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.288 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T09:49:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.289 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-05-08T09:49:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-05-08T09:49:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T09:49:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.290 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-05-08T09:49:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-05-08T09:49:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-05-08T09:49:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.291 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T09:49:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-05-08T09:49:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-05-08T09:49:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-05-08T09:49:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-08T09:49:09.293 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-05-08T09:49:09.294 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-05-08T09:49:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T09:49:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.295 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-05-08T09:49:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-05-08T09:49:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-05-08T09:49:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T09:49:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-05-08T09:49:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-05-08T09:49:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-05-08T09:49:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T09:49:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.298 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-05-08T09:49:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-05-08T09:49:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-05-08T09:49:09.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T09:49:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-05-08T09:49:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-05-08T09:49:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-05-08T09:49:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T09:49:09.301 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-05-08T09:49:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.302 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-05-08T09:49:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-05-08T09:49:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T09:49:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.303 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-05-08T09:49:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-05-08T09:49:09.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-05-08T09:49:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T09:49:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.305 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-05-08T09:49:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-05-08T09:49:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.306 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-08T09:49:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-05-08T09:49:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-05-08T09:49:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-05-08T09:49:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.308 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T09:49:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.309 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-05-08T09:49:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-05-08T09:49:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T09:49:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.310 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-05-08T09:49:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-05-08T09:49:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-05-08T09:49:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.311 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-08T09:49:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-05-08T09:49:09.312 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-05-08T09:49:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-05-08T09:49:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T09:49:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-05-08T09:49:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.314 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-05-08T09:49:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-05-08T09:49:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.315 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T09:49:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.316 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-05-08T09:49:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-05-08T09:49:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.317 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T09:49:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-05-08T09:49:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T09:49:09.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-05-08T09:49:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T09:49:09.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-05-08T09:49:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-05-08T09:49:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-05-08T09:49:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T09:49:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-05-08T09:49:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-05-08T09:49:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-05-08T09:49:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.322 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-05-08T09:49:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.323 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-05-08T09:49:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-05-08T09:49:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.324 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T09:49:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-05-08T09:49:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-05-08T09:49:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.325 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-05-08T09:49:09.326 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-05-08T09:49:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-05-08T09:49:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.327 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-08T09:49:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-08T09:49:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.328 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-05-08T09:49:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-05-08T09:49:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-05-08T09:49:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-05-08T09:49:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-05-08T09:49:09.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T09:49:09.331 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-05-08T09:49:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-05-08T09:49:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T09:49:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.333 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.334 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.335 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-05-08T09:49:09.336 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-05-08T09:49:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.337 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T09:49:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T09:49:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.340 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T09:49:09.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T09:49:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T09:49:09.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T09:49:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T09:49:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-05-08T09:49:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T09:49:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-05-08T09:49:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-05-08T09:49:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:09.347 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-05-08T09:49:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-05-08T09:49:09.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-05-08T09:49:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.349 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T09:49:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-05-08T09:49:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-05-08T09:49:09.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-05-08T09:49:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-05-08T09:49:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-05-08T09:49:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T09:49:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-05-08T09:49:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-05-08T09:49:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-05-08T09:49:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.354 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T09:49:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-05-08T09:49:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-05-08T09:49:09.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T09:49:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T09:49:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-05-08T09:49:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-05-08T09:49:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.357 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T09:49:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.358 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-05-08T09:49:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-05-08T09:49:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.359 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.360 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T09:49:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-05-08T09:49:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-05-08T09:49:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.362 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T09:49:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-05-08T09:49:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-05-08T09:49:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-05-08T09:49:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-05-08T09:49:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-05-08T09:49:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-05-08T09:49:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-05-08T09:49:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-05-08T09:49:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.368 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T09:49:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-05-08T09:49:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-05-08T09:49:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.370 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T09:49:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-05-08T09:49:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-05-08T09:49:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.372 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T09:49:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-05-08T09:49:09.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-05-08T09:49:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T09:49:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-05-08T09:49:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-05-08T09:49:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.375 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T09:49:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.376 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-05-08T09:49:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-05-08T09:49:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T09:49:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.378 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-05-08T09:49:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.380 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.382 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.384 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.385 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.386 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-05-08T09:49:09.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-05-08T09:49:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-05-08T09:49:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.388 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T09:49:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.389 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-05-08T09:49:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-05-08T09:49:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.391 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-05-08T09:49:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T09:49:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.392 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-05-08T09:49:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T09:49:09.393 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T09:49:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.394 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T09:49:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T09:49:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.396 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T09:49:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T09:49:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-05-08T09:49:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T09:49:09.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T09:49:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T09:49:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.400 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T09:49:09.401 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T09:49:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T09:49:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T09:49:09.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.404 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.405 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.406 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T09:49:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T09:49:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.407 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T09:49:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T09:49:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.409 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T09:49:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T09:49:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.410 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.411 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T09:49:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T09:49:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.412 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.413 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T09:49:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T09:49:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-05-08T09:49:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T09:49:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T09:49:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.419 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-05-08T09:49:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-05-08T09:49:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T09:49:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T09:49:09.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-05-08T09:49:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T09:49:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T09:49:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T09:49:09.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T09:49:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T09:49:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T09:49:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T09:49:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T09:49:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-08T09:49:09.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-08T09:49:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "[]", 2024-05-08T09:49:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.430 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "MULTICLUSTER_CONFIG": { 2024-05-08T09:49:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-08T09:49:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "{}", 2024-05-08T09:49:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T09:49:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T09:49:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.434 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T09:49:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T09:49:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.435 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T09:49:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T09:49:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.436 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T09:49:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T09:49:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.439 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T09:49:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T09:49:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.440 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T09:49:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T09:49:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T09:49:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T09:49:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T09:49:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T09:49:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.445 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T09:49:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T09:49:09.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T09:49:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T09:49:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T09:49:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T09:49:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T09:49:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T09:49:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T09:49:09.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.452 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T09:49:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T09:49:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-05-08T09:49:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.454 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T09:49:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T09:49:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-05-08T09:49:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.455 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T09:49:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T09:49:09.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T09:49:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T09:49:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-05-08T09:49:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T09:49:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T09:49:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.461 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T09:49:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T09:49:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.462 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T09:49:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T09:49:09.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T09:49:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T09:49:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T09:49:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T09:49:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:09.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T09:49:09.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T09:49:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-05-08T09:49:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-05-08T09:49:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.471 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-05-08T09:49:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-05-08T09:49:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-05-08T09:49:09.473 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-05-08T09:49:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.474 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-05-08T09:49:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-05-08T09:49:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-05-08T09:49:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-05-08T09:49:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-05-08T09:49:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-05-08T09:49:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.479 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.480 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.484 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.485 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-05-08T09:49:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-05-08T09:49:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-05-08T09:49:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-05-08T09:49:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T09:49:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-05-08T09:49:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-05-08T09:49:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-05-08T09:49:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-05-08T09:49:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-05-08T09:49:09.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-05-08T09:49:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.493 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.494 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-05-08T09:49:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-05-08T09:49:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.496 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.497 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-05-08T09:49:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-05-08T09:49:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-05-08T09:49:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-05-08T09:49:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-05-08T09:49:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.499 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-05-08T09:49:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-05-08T09:49:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-05-08T09:49:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-05-08T09:49:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-05-08T09:49:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-05-08T09:49:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-05-08T09:49:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-05-08T09:49:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-05-08T09:49:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-05-08T09:49:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-05-08T09:49:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-05-08T09:49:09.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.506 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.507 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.508 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.509 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.510 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.511 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.512 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.513 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.514 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-05-08T09:49:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-05-08T09:49:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-05-08T09:49:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T09:49:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-05-08T09:49:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-05-08T09:49:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-05-08T09:49:09.517 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T09:49:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.518 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-05-08T09:49:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-05-08T09:49:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-05-08T09:49:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.519 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-05-08T09:49:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-05-08T09:49:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-05-08T09:49:09.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-05-08T09:49:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T09:49:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-05-08T09:49:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-05-08T09:49:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.522 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T09:49:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.523 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.524 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T09:49:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.527 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T09:49:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-05-08T09:49:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.530 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.531 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.534 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-05-08T09:49:09.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-05-08T09:49:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-05-08T09:49:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-05-08T09:49:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.539 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.540 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.542 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.543 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-05-08T09:49:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-05-08T09:49:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-05-08T09:49:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-05-08T09:49:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-05-08T09:49:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-05-08T09:49:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T09:49:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-05-08T09:49:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-05-08T09:49:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-05-08T09:49:09.546 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T09:49:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.547 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-05-08T09:49:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-05-08T09:49:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.548 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-05-08T09:49:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.549 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-05-08T09:49:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-05-08T09:49:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T09:49:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.550 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.552 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.554 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.556 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.558 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.559 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-05-08T09:49:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-05-08T09:49:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.560 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-05-08T09:49:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-05-08T09:49:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-05-08T09:49:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.561 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-05-08T09:49:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-05-08T09:49:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.563 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-05-08T09:49:09.564 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-05-08T09:49:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-05-08T09:49:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.566 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-05-08T09:49:09.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-05-08T09:49:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.568 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-05-08T09:49:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-05-08T09:49:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-05-08T09:49:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-05-08T09:49:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T09:49:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.570 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-05-08T09:49:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.571 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.572 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.574 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.575 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.576 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.577 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.578 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.580 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-05-08T09:49:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.583 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.585 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.586 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.587 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.589 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.590 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.592 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-05-08T09:49:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-05-08T09:49:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-05-08T09:49:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-05-08T09:49:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T09:49:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-05-08T09:49:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-05-08T09:49:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-05-08T09:49:09.595 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T09:49:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.596 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.597 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.598 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.599 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.600 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.601 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.602 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.604 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-05-08T09:49:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-05-08T09:49:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T09:49:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.609 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.610 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.613 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.614 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.614 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.614 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.614 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.614 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.614 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.614 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.614 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.615 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.615 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.615 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.615 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.615 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.615 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.615 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.616 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.616 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.616 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.616 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.616 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.616 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.616 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.617 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.617 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.617 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-05-08T09:49:09.617 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-05-08T09:49:09.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.617 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.618 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.618 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.618 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.618 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-05-08T09:49:09.618 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T09:49:09.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.618 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.619 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-05-08T09:49:09.619 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-05-08T09:49:09.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.619 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-05-08T09:49:09.619 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-05-08T09:49:09.620 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.621 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.621 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-05-08T09:49:09.621 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.621 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.621 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T09:49:09.621 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.622 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.622 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.622 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-05-08T09:49:09.622 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-05-08T09:49:09.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.622 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.622 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.622 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.623 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.623 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.623 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-05-08T09:49:09.623 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.623 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.623 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.624 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.624 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.624 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.624 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.624 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.624 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.624 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-05-08T09:49:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-05-08T09:49:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-05-08T09:49:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T09:49:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T09:49:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.626 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.627 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.627 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.627 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-05-08T09:49:09.627 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.627 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.627 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.627 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.628 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.628 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.628 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.628 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.628 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.628 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.629 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.629 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.629 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.629 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.629 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.629 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.629 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.630 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.630 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.630 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.630 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.631 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.631 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.631 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.631 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.631 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.631 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.632 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.632 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.632 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.632 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.633 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.633 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.633 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.633 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.633 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.633 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.633 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.633 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.634 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.634 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.634 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.634 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.634 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.634 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.635 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.635 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.635 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.635 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.635 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.635 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.635 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.636 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-05-08T09:49:09.638 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.638 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.638 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.638 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.638 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.638 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.639 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.640 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.640 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.640 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.640 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.640 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.640 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.640 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.641 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.641 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.641 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.641 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.641 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.641 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.642 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.642 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.642 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.642 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.642 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.643 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.643 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.643 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.643 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.643 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.643 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.643 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.643 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.643 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.645 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.645 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.645 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.645 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.645 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.645 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.646 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.646 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.646 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.646 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.647 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.647 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.647 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.647 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.647 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.647 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.647 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.648 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-05-08T09:49:09.648 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.648 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.648 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.648 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.649 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.649 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.649 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.649 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.649 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.649 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.649 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.649 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.650 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.650 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.650 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.650 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.650 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.650 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.650 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.651 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.651 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.651 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.651 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.651 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.652 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.652 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.652 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.652 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.652 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.652 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.653 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.653 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.653 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.653 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.653 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.654 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.654 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.654 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.654 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.654 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.654 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.654 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.655 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.655 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.655 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.655 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.655 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.656 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.656 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.656 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.656 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.656 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.656 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.657 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.657 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.657 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.657 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.657 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.657 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-05-08T09:49:09.659 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.659 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.659 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.659 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-05-08T09:49:09.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-05-08T09:49:09.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.659 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.660 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.660 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T09:49:09.660 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.660 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.661 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.661 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.661 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.661 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.661 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.661 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.661 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.661 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.662 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.662 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.662 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.662 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.662 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.662 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.662 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.662 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.662 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.663 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.663 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.663 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.664 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.664 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.664 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.664 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.664 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.664 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.664 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.665 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.665 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.665 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.665 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.665 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.665 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.665 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.666 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.668 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.668 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.668 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.668 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.668 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.668 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-05-08T09:49:09.669 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-05-08T09:49:09.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.669 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.669 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.670 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-05-08T09:49:09.670 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-05-08T09:49:09.670 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-05-08T09:49:09.670 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.670 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-05-08T09:49:09.670 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.670 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.671 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.671 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.671 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.671 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.672 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.672 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.672 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.673 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.674 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.675 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.676 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.678 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.679 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.680 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.681 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-05-08T09:49:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.683 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.684 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.685 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.686 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.686 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.686 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.686 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.686 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.686 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.687 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.687 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.687 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.687 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.687 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.687 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.688 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.688 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.688 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.688 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.689 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.689 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.689 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.689 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.689 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.689 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.689 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.690 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.690 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.690 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.690 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.690 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.692 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.692 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.692 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.692 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.692 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.692 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.693 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.693 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.693 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-05-08T09:49:09.693 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.694 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.694 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.694 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.694 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.694 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.694 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.695 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.695 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.695 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.695 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.695 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.695 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.695 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.695 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.696 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.696 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.696 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.696 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.696 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.696 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.697 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.697 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.697 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.697 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.697 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.698 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.698 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.698 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.698 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.698 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.698 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.699 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.700 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.700 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.700 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.700 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.700 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.700 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.701 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.702 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:09.702 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:09.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.702 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:09.702 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.703 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.703 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.703 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.703 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.703 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.703 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.703 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.704 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.704 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.704 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.704 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.704 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.704 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.704 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.705 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-05-08T09:49:09.705 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-05-08T09:49:09.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:09.705 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.705 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-05-08T09:49:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-05-08T09:49:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-05-08T09:49:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T09:49:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.706 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.707 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.707 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.707 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-05-08T09:49:09.707 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.707 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.707 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.708 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-05-08T09:49:09.708 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-05-08T09:49:09.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.708 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.708 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.708 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.709 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.709 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.709 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T09:49:09.709 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.709 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.709 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-05-08T09:49:09.710 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-05-08T09:49:09.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.710 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.710 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.710 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.710 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.710 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.712 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.712 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.712 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.712 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.712 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.712 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.713 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.713 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.713 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.713 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.713 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.713 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.713 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.713 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.714 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.714 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.714 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.714 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.715 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.715 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.715 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.715 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.715 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.715 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.715 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.716 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.716 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.716 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.716 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.716 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.717 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.717 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.717 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.717 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.717 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.717 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.717 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.717 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.717 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.718 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.718 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.718 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.718 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.718 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.719 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.719 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.719 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.719 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.719 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.719 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.719 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.720 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.720 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-05-08T09:49:09.720 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-05-08T09:49:09.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.720 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.721 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.721 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-05-08T09:49:09.721 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.721 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.721 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.721 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-05-08T09:49:09.721 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.721 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.722 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:09.722 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:09.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.722 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:09.722 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.723 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.724 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.724 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.724 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.724 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.724 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.724 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.724 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-05-08T09:49:09.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-05-08T09:49:09.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.726 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.726 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.726 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.726 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.726 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.726 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.727 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.727 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.727 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-05-08T09:49:09.727 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-05-08T09:49:09.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.727 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.728 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.728 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.728 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.728 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T09:49:09.728 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T09:49:09.728 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.728 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.729 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.729 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.729 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.729 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.730 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.730 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.730 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.730 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.730 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.730 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.731 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.731 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.731 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.731 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.731 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.731 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.732 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.732 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.732 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.732 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.732 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.732 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.733 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.733 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.733 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.733 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.733 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.733 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.734 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.734 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.734 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.734 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.734 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.734 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.734 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.735 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.735 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.735 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.735 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.735 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.735 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.735 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.735 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.736 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.737 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.737 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.737 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.737 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.737 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-05-08T09:49:09.737 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-05-08T09:49:09.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.738 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.738 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.738 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.738 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.738 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T09:49:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T09:49:09.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-05-08T09:49:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-05-08T09:49:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-05-08T09:49:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-05-08T09:49:09.741 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-05-08T09:49:09.742 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-05-08T09:49:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-05-08T09:49:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T09:49:09.743 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-05-08T09:49:09.744 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T09:49:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.745 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.746 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-05-08T09:49:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-05-08T09:49:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.747 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-05-08T09:49:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.748 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-05-08T09:49:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-05-08T09:49:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-05-08T09:49:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.749 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-05-08T09:49:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-05-08T09:49:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.751 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.752 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-05-08T09:49:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.754 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.755 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.756 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.757 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.758 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.760 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-05-08T09:49:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-05-08T09:49:09.761 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.762 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-05-08T09:49:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T09:49:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.763 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.764 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.765 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-05-08T09:49:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-05-08T09:49:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.766 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.767 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-05-08T09:49:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.768 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-05-08T09:49:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-05-08T09:49:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.769 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-05-08T09:49:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-05-08T09:49:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.772 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.773 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.776 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.777 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.778 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.779 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-05-08T09:49:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-05-08T09:49:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.780 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.781 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-05-08T09:49:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-05-08T09:49:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.782 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.784 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-05-08T09:49:09.785 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.787 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.788 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.789 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.790 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.791 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.792 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.793 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.794 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.795 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.796 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-05-08T09:49:09.797 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.798 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.799 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.800 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.801 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.803 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.805 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.806 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.807 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-05-08T09:49:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-05-08T09:49:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.808 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-05-08T09:49:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T09:49:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.809 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-05-08T09:49:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.810 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.811 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.812 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.813 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.814 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.815 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.817 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-05-08T09:49:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-05-08T09:49:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.819 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-05-08T09:49:09.820 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-05-08T09:49:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-05-08T09:49:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.821 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-05-08T09:49:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-05-08T09:49:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-05-08T09:49:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-05-08T09:49:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.824 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:09.825 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-05-08T09:49:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-05-08T09:49:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.827 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-05-08T09:49:09.828 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-05-08T09:49:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.829 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-05-08T09:49:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-05-08T09:49:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.830 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.831 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-05-08T09:49:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-05-08T09:49:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:09.832 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.833 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-05-08T09:49:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-05-08T09:49:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.835 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-05-08T09:49:09.836 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-05-08T09:49:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-05-08T09:49:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.838 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.839 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smb", 2024-05-08T09:49:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.840 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.841 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.842 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.843 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.844 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.845 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.846 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.847 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.849 INFO:teuthology.orchestra.run.smithi070.stdout: "update_orchestration": { 2024-05-08T09:49:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "update_orchestration", 2024-05-08T09:49:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.850 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-08T09:49:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.851 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-05-08T09:49:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-05-08T09:49:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-05-08T09:49:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.852 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T09:49:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.853 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-05-08T09:49:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-05-08T09:49:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.854 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.856 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.858 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.860 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.861 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.862 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.864 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-05-08T09:49:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.866 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.867 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.868 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.869 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.870 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.871 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.872 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.873 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.874 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-05-08T09:49:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.875 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.876 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.877 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.878 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.880 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.881 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.882 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.883 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.884 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-05-08T09:49:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-05-08T09:49:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-05-08T09:49:09.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T09:49:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.887 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.888 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.889 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.890 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.891 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.892 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.893 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.894 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.895 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.896 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.897 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-05-08T09:49:09.898 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-05-08T09:49:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-05-08T09:49:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.899 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T09:49:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.900 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-05-08T09:49:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-05-08T09:49:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.901 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T09:49:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-05-08T09:49:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-05-08T09:49:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.902 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T09:49:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.903 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-05-08T09:49:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-05-08T09:49:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.904 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T09:49:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-05-08T09:49:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-05-08T09:49:09.905 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T09:49:09.906 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.907 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-05-08T09:49:09.908 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-05-08T09:49:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.909 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-05-08T09:49:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-05-08T09:49:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T09:49:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-05-08T09:49:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-05-08T09:49:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.912 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:09.913 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-05-08T09:49:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-05-08T09:49:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.915 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-05-08T09:49:09.916 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-05-08T09:49:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.917 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-05-08T09:49:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-05-08T09:49:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.918 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.920 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.921 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.922 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.923 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.924 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.925 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-05-08T09:49:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-05-08T09:49:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.928 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-05-08T09:49:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-05-08T09:49:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.929 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.930 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.931 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-05-08T09:49:09.932 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-05-08T09:49:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T09:49:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.933 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-05-08T09:49:09.934 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.935 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.936 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.938 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.939 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.941 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.942 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.943 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.944 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.945 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.946 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.948 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.949 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.950 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-05-08T09:49:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-05-08T09:49:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-05-08T09:49:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T09:49:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.954 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-05-08T09:49:09.955 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-05-08T09:49:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-05-08T09:49:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T09:49:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-05-08T09:49:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T09:49:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.958 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T09:49:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.959 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-05-08T09:49:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.961 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-05-08T09:49:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-05-08T09:49:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-05-08T09:49:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.962 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-05-08T09:49:09.963 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-05-08T09:49:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.964 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.965 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.966 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.967 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.968 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.970 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.971 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.972 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.974 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.975 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-05-08T09:49:09.976 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-05-08T09:49:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.977 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-05-08T09:49:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-05-08T09:49:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-05-08T09:49:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-05-08T09:49:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-05-08T09:49:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T09:49:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.980 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:09.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.982 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24793, 2024-05-08T09:49:09.982 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "z", 2024-05-08T09:49:09.982 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540701547738038271, 2024-05-08T09:49:09.982 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-05-08T09:49:09.982 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:09.982 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-05-08T09:49:09.982 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:09.983 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:09.983 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:09.983 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:09.983 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:09.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:09.983 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.983 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:09.984 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.984 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.985 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.985 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T09:49:09.985 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.985 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.986 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:09.986 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:09.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.986 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.986 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.986 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.987 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.987 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.987 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.987 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.987 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.987 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.987 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.987 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.988 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.988 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.988 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.988 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.988 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:09.988 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:09.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.989 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.989 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.989 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.989 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.989 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.989 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.989 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.990 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.990 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:09.990 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:09.990 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.990 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.990 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:09.991 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.991 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.991 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:09.991 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:09.991 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:09.991 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:09.991 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:09.991 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:09.991 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:09.992 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:09.992 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.992 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.992 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.992 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:09.992 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:09.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:09.993 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.993 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:09.993 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.993 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.993 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.993 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:09.993 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.994 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.994 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-05-08T09:49:09.994 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-05-08T09:49:09.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.994 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.994 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.995 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.995 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.995 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.995 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-05-08T09:49:09.995 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.995 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.995 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-05-08T09:49:09.996 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-05-08T09:49:09.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.996 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.996 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-05-08T09:49:09.996 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.996 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.996 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.996 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-05-08T09:49:09.997 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.997 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.997 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.997 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-05-08T09:49:09.997 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-05-08T09:49:09.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.997 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.998 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.998 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.998 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:09.998 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:09.998 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:09.998 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-05-08T09:49:09.998 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:09.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:09.998 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:09.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:09.999 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-05-08T09:49:09.999 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-05-08T09:49:09.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:09.999 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:09.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:09.999 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:09.999 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.000 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.000 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.000 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-05-08T09:49:10.000 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.000 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.000 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-05-08T09:49:10.001 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-05-08T09:49:10.001 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.001 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.001 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-05-08T09:49:10.001 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.001 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.001 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.001 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-05-08T09:49:10.002 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.002 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.002 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-05-08T09:49:10.002 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-05-08T09:49:10.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.002 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.003 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.003 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.003 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.003 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.003 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-05-08T09:49:10.003 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.003 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.004 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-05-08T09:49:10.004 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-05-08T09:49:10.004 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.004 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.004 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.004 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.004 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.005 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.005 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.005 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T09:49:10.005 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.005 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.005 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.005 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-05-08T09:49:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-05-08T09:49:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.006 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-05-08T09:49:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.008 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.008 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.008 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.008 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.008 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.008 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.008 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.009 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.009 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.009 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.009 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-05-08T09:49:10.009 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.009 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.010 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.010 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-05-08T09:49:10.010 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-05-08T09:49:10.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.010 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.010 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.010 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.010 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.011 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.011 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T09:49:10.011 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.011 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.011 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.011 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-05-08T09:49:10.011 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-05-08T09:49:10.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.012 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.012 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.012 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-05-08T09:49:10.012 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.012 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.012 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.012 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T09:49:10.013 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T09:49:10.013 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.013 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.013 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.013 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-05-08T09:49:10.013 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-05-08T09:49:10.013 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:10.013 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.014 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.014 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-05-08T09:49:10.014 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-05-08T09:49:10.014 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.014 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T09:49:10.014 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T09:49:10.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.015 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.015 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-05-08T09:49:10.015 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-05-08T09:49:10.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:10.015 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.015 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.015 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-05-08T09:49:10.016 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:10.016 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-05-08T09:49:10.016 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.016 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T09:49:10.016 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.016 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.017 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-05-08T09:49:10.017 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-05-08T09:49:10.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.017 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.017 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.017 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T09:49:10.017 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.017 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.017 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.018 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T09:49:10.018 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T09:49:10.018 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.018 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.018 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-05-08T09:49:10.018 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-05-08T09:49:10.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.019 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.019 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-05-08T09:49:10.019 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-05-08T09:49:10.019 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-05-08T09:49:10.019 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.019 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-05-08T09:49:10.019 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T09:49:10.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.020 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.020 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-05-08T09:49:10.020 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-05-08T09:49:10.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.020 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.021 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-05-08T09:49:10.021 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.021 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.021 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.021 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T09:49:10.021 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T09:49:10.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.022 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.022 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-05-08T09:49:10.022 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-05-08T09:49:10.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:10.022 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.022 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.022 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.023 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-05-08T09:49:10.023 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-05-08T09:49:10.023 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.023 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T09:49:10.023 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T09:49:10.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.023 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.024 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.025 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.026 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.028 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.029 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.030 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.031 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-05-08T09:49:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-05-08T09:49:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T09:49:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.033 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-05-08T09:49:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-05-08T09:49:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-05-08T09:49:10.034 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-05-08T09:49:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-05-08T09:49:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-05-08T09:49:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-05-08T09:49:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-05-08T09:49:10.035 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-05-08T09:49:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-05-08T09:49:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-05-08T09:49:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.036 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T09:49:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.038 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T09:49:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.040 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-05-08T09:49:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-05-08T09:49:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.041 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T09:49:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T09:49:10.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-05-08T09:49:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-05-08T09:49:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.043 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T09:49:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.044 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.045 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-05-08T09:49:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T09:49:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-05-08T09:49:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-05-08T09:49:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-05-08T09:49:10.047 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T09:49:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-05-08T09:49:10.048 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-05-08T09:49:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-05-08T09:49:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T09:49:10.049 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-05-08T09:49:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-05-08T09:49:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.050 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T09:49:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T09:49:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.051 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-05-08T09:49:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-05-08T09:49:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.052 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T09:49:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-05-08T09:49:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T09:49:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.053 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-05-08T09:49:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T09:49:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-05-08T09:49:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-05-08T09:49:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.056 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-05-08T09:49:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-05-08T09:49:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.057 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T09:49:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-05-08T09:49:10.058 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-05-08T09:49:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T09:49:10.059 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-05-08T09:49:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-05-08T09:49:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.060 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T09:49:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.061 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-05-08T09:49:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-05-08T09:49:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.062 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T09:49:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.063 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-05-08T09:49:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-05-08T09:49:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T09:49:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.064 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-05-08T09:49:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-05-08T09:49:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-05-08T09:49:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.065 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T09:49:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-05-08T09:49:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.066 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-05-08T09:49:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-05-08T09:49:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-08T09:49:10.067 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-05-08T09:49:10.068 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-05-08T09:49:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T09:49:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-05-08T09:49:10.069 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-05-08T09:49:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-05-08T09:49:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T09:49:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-05-08T09:49:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.072 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-05-08T09:49:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-05-08T09:49:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-05-08T09:49:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.073 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T09:49:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-05-08T09:49:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-05-08T09:49:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-05-08T09:49:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T09:49:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.075 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-05-08T09:49:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-05-08T09:49:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-05-08T09:49:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.076 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-05-08T09:49:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-05-08T09:49:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T09:49:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.078 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-05-08T09:49:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-05-08T09:49:10.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-08T09:49:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-05-08T09:49:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-05-08T09:49:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-05-08T09:49:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T09:49:10.081 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.082 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-05-08T09:49:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-05-08T09:49:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T09:49:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.083 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-05-08T09:49:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-05-08T09:49:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-05-08T09:49:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.084 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-08T09:49:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-05-08T09:49:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-05-08T09:49:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-05-08T09:49:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T09:49:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.086 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.087 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T09:49:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.088 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-05-08T09:49:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-05-08T09:49:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:10.089 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T09:49:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-05-08T09:49:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T09:49:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-05-08T09:49:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.091 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-05-08T09:49:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T09:49:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-05-08T09:49:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-05-08T09:49:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-05-08T09:49:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.094 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-05-08T09:49:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.095 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-05-08T09:49:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-05-08T09:49:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.096 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T09:49:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-05-08T09:49:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-05-08T09:49:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-05-08T09:49:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-05-08T09:49:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-05-08T09:49:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-08T09:49:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.099 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-08T09:49:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-05-08T09:49:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-05-08T09:49:10.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-05-08T09:49:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-05-08T09:49:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-05-08T09:49:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.102 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T09:49:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-05-08T09:49:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-05-08T09:49:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.104 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.106 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-05-08T09:49:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-05-08T09:49:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.108 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T09:49:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.109 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T09:49:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.111 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.112 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.114 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.115 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.116 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T09:49:10.116 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.116 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.116 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T09:49:10.116 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T09:49:10.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.116 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-05-08T09:49:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T09:49:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.117 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.118 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-05-08T09:49:10.118 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-05-08T09:49:10.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.118 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.118 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.118 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.119 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.119 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.119 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-05-08T09:49:10.119 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.119 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.120 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-05-08T09:49:10.120 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-05-08T09:49:10.120 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.120 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.120 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.120 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.120 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.120 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.121 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T09:49:10.121 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.121 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.121 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-05-08T09:49:10.121 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-05-08T09:49:10.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.122 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.122 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.122 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.122 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.122 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.122 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.122 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-05-08T09:49:10.122 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.122 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.123 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.123 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-05-08T09:49:10.123 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-05-08T09:49:10.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.123 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.123 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-05-08T09:49:10.123 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.124 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.124 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.124 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-05-08T09:49:10.124 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-05-08T09:49:10.124 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.124 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T09:49:10.124 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.124 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.125 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.126 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T09:49:10.126 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.126 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.126 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-05-08T09:49:10.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-05-08T09:49:10.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.127 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.127 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T09:49:10.127 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.127 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.127 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.127 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T09:49:10.127 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.128 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.129 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.129 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T09:49:10.129 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.129 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.129 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-05-08T09:49:10.129 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-05-08T09:49:10.129 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.130 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.130 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.130 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.130 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.130 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.130 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T09:49:10.130 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.131 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.131 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-05-08T09:49:10.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-05-08T09:49:10.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.131 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.132 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.132 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.132 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.132 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.132 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T09:49:10.132 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.132 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.133 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.134 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T09:49:10.134 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.134 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.134 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-05-08T09:49:10.134 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-05-08T09:49:10.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.135 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.135 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.135 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.135 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.135 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.135 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T09:49:10.135 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.136 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.136 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-05-08T09:49:10.136 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-05-08T09:49:10.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.136 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.136 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-05-08T09:49:10.136 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.137 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.137 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.137 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-05-08T09:49:10.137 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.137 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.137 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.138 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.138 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.138 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.138 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.138 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.138 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.138 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-05-08T09:49:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-05-08T09:49:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T09:49:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-05-08T09:49:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-05-08T09:49:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.141 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.142 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T09:49:10.142 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.142 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.142 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-05-08T09:49:10.142 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-05-08T09:49:10.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.143 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.143 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.143 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.143 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.143 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T09:49:10.143 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.144 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.144 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-05-08T09:49:10.144 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-05-08T09:49:10.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.144 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.144 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.144 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T09:49:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-05-08T09:49:10.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-05-08T09:49:10.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.146 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.146 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.146 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.146 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.146 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.146 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T09:49:10.146 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.147 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.147 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-05-08T09:49:10.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-05-08T09:49:10.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.147 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.148 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.149 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.149 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-05-08T09:49:10.149 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.149 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.149 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.149 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.149 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.150 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.150 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.150 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.150 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.150 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.150 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.150 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.150 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.151 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.152 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.152 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.152 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.152 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.152 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.152 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.152 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.153 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.153 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.153 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.153 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.153 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.154 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.155 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.155 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.155 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.155 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.155 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.155 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.156 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.156 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.156 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.156 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.156 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.156 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.156 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.157 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.158 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.158 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T09:49:10.158 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.158 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.158 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.158 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.160 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.161 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.161 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T09:49:10.161 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.161 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.161 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.162 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-05-08T09:49:10.162 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.162 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.162 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.162 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T09:49:10.162 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T09:49:10.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.162 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.163 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.163 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.163 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.163 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.164 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T09:49:10.164 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T09:49:10.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.164 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.164 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.164 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.164 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.165 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.165 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.165 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.165 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.165 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T09:49:10.165 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T09:49:10.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.166 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.166 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.166 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.166 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.166 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.166 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.166 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.167 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.168 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.168 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.168 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.168 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.168 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.168 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T09:49:10.168 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T09:49:10.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.169 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.169 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.169 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.169 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.169 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.169 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.169 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.170 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.170 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T09:49:10.170 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T09:49:10.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.170 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.170 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.171 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.171 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.171 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.171 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.171 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.171 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.171 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.172 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.173 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.173 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T09:49:10.173 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T09:49:10.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.173 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.173 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.174 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T09:49:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T09:49:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.175 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.176 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.177 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.177 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.177 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.177 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.177 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.177 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.177 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T09:49:10.178 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T09:49:10.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.178 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.178 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.178 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.178 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.178 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.178 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.179 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.179 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.179 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T09:49:10.179 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T09:49:10.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.179 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.180 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.180 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.180 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.180 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.180 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.180 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.180 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.181 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T09:49:10.181 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T09:49:10.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.181 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.181 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.181 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.181 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.182 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.182 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.182 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.182 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.182 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T09:49:10.182 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T09:49:10.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.183 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.183 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.183 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.183 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.183 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.183 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.183 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.184 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.184 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T09:49:10.184 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T09:49:10.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.184 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.184 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-05-08T09:49:10.184 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.185 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.185 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.185 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.185 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.185 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.185 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T09:49:10.185 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T09:49:10.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.186 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.186 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.186 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.186 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.186 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.186 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.187 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.188 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.188 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.188 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.188 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.188 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.188 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.188 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T09:49:10.189 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T09:49:10.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.189 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.189 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-05-08T09:49:10.189 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.189 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.189 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.190 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.190 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.190 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.190 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T09:49:10.190 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T09:49:10.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.190 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.191 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.191 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.191 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.191 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.191 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.191 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.191 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.192 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T09:49:10.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T09:49:10.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.192 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.192 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.192 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.192 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.193 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.193 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.193 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.193 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.193 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T09:49:10.193 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T09:49:10.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.194 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.194 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.194 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.194 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.194 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.194 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.195 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.195 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T09:49:10.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T09:49:10.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.195 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.195 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.195 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.196 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.196 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.196 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.196 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.196 INFO:teuthology.orchestra.run.smithi070.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-08T09:49:10.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-08T09:49:10.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.197 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "[]", 2024-05-08T09:49:10.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.197 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.197 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.197 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.198 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.198 INFO:teuthology.orchestra.run.smithi070.stdout: "MULTICLUSTER_CONFIG": { 2024-05-08T09:49:10.198 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-08T09:49:10.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.198 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.198 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "{}", 2024-05-08T09:49:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.199 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T09:49:10.200 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T09:49:10.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.200 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.200 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.200 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.200 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.200 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.200 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.201 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.201 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.201 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T09:49:10.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T09:49:10.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.201 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.202 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.202 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.202 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.202 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.202 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.202 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.203 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.204 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.204 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.204 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.204 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.204 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T09:49:10.204 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T09:49:10.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.205 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.206 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T09:49:10.206 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T09:49:10.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.206 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.206 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.206 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.206 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.207 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.207 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.207 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.207 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.207 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T09:49:10.207 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.209 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.209 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T09:49:10.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T09:49:10.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.209 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.209 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.210 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.210 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.210 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.210 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.210 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.210 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T09:49:10.211 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T09:49:10.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.211 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.211 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.211 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.211 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.211 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T09:49:10.213 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T09:49:10.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.214 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.214 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.214 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.214 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.214 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.214 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.215 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.215 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.215 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T09:49:10.215 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T09:49:10.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.215 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T09:49:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T09:49:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T09:49:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.217 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.218 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.218 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.218 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.218 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T09:49:10.218 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T09:49:10.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.219 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.219 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-05-08T09:49:10.219 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.219 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.219 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.219 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.219 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.220 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.220 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T09:49:10.220 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T09:49:10.220 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.220 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.220 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-05-08T09:49:10.220 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.221 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.221 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.221 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.221 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.221 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.221 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T09:49:10.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T09:49:10.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.222 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.222 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.222 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.222 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.222 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.222 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.223 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.223 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.223 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.223 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T09:49:10.223 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T09:49:10.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.224 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-05-08T09:49:10.224 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.224 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.224 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.224 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.224 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.224 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.225 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T09:49:10.225 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T09:49:10.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.225 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.225 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.225 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T09:49:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T09:49:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.226 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.227 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.227 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.227 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.227 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.227 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.227 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.227 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.228 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T09:49:10.228 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T09:49:10.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.228 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.228 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.228 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T09:49:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T09:49:10.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.230 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T09:49:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T09:49:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.232 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.233 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-05-08T09:49:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-05-08T09:49:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.234 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.235 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.236 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-05-08T09:49:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-05-08T09:49:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-05-08T09:49:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-05-08T09:49:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-05-08T09:49:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.241 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.242 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.243 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.245 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.246 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.247 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.248 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.249 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-05-08T09:49:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-05-08T09:49:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.250 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-05-08T09:49:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-05-08T09:49:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T09:49:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-05-08T09:49:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-05-08T09:49:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-05-08T09:49:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.253 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-05-08T09:49:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-05-08T09:49:10.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-05-08T09:49:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.256 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-05-08T09:49:10.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-05-08T09:49:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-05-08T09:49:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-05-08T09:49:10.259 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-05-08T09:49:10.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-05-08T09:49:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-05-08T09:49:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.261 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.262 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-05-08T09:49:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-05-08T09:49:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-05-08T09:49:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.263 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-05-08T09:49:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-05-08T09:49:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.264 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-05-08T09:49:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-05-08T09:49:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-05-08T09:49:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.266 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-05-08T09:49:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.267 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.268 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.269 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.272 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.273 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.276 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T09:49:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-05-08T09:49:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-05-08T09:49:10.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-05-08T09:49:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T09:49:10.278 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-05-08T09:49:10.279 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-05-08T09:49:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.280 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-05-08T09:49:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-05-08T09:49:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-05-08T09:49:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.281 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T09:49:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-05-08T09:49:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-05-08T09:49:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.282 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T09:49:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.283 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.284 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T09:49:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.285 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.286 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.287 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-05-08T09:49:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T09:49:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.288 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-05-08T09:49:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.290 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.291 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.292 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.293 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.294 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.295 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.296 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-05-08T09:49:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-05-08T09:49:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-05-08T09:49:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.298 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-05-08T09:49:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-05-08T09:49:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.299 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-05-08T09:49:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:10.301 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.302 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.303 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-05-08T09:49:10.304 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-05-08T09:49:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-05-08T09:49:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-05-08T09:49:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-05-08T09:49:10.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T09:49:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-05-08T09:49:10.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-05-08T09:49:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-05-08T09:49:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T09:49:10.307 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-05-08T09:49:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-05-08T09:49:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-05-08T09:49:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-05-08T09:49:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-05-08T09:49:10.310 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T09:49:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.312 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.314 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.316 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.318 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-05-08T09:49:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-05-08T09:49:10.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-05-08T09:49:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-05-08T09:49:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-05-08T09:49:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-05-08T09:49:10.321 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-05-08T09:49:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.322 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.323 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.324 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-05-08T09:49:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T09:49:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.325 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-05-08T09:49:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-05-08T09:49:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-05-08T09:49:10.326 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T09:49:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-05-08T09:49:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-05-08T09:49:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.327 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-05-08T09:49:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.328 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-05-08T09:49:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-05-08T09:49:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-05-08T09:49:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T09:49:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-05-08T09:49:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.332 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.333 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.334 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.336 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.339 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.342 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.346 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.348 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.349 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-05-08T09:49:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-05-08T09:49:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-05-08T09:49:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.351 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-05-08T09:49:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T09:49:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.352 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.353 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T09:49:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.355 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.356 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.357 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.359 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.362 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.363 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-05-08T09:49:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-05-08T09:49:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-05-08T09:49:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-05-08T09:49:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-05-08T09:49:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T09:49:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.369 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.370 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.371 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.372 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.372 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.373 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.373 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.373 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.373 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.373 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-05-08T09:49:10.374 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-05-08T09:49:10.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.374 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-05-08T09:49:10.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T09:49:10.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.375 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-05-08T09:49:10.375 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-05-08T09:49:10.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.375 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-05-08T09:49:10.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.376 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-05-08T09:49:10.376 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.376 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.376 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-05-08T09:49:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-05-08T09:49:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-05-08T09:49:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.378 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.379 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.379 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.379 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.379 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.379 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-05-08T09:49:10.379 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.380 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.380 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.380 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.380 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.380 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-05-08T09:49:10.382 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.382 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.382 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.382 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T09:49:10.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T09:49:10.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.383 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.384 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.385 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.385 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.385 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.385 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.385 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.385 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.385 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.385 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.386 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.386 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.386 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.386 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.387 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.387 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.387 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.388 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.388 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.389 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.389 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.389 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.389 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.389 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.389 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.389 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.389 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.390 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.390 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.390 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.390 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.390 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.391 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.391 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.393 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.393 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.393 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.393 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.393 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-05-08T09:49:10.396 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.396 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.396 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.396 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.397 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.397 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.397 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.397 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.397 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.397 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.397 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.398 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.398 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.398 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.398 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.400 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.401 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.402 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.402 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.402 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.402 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.402 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.404 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.404 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.404 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.406 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-05-08T09:49:10.406 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.406 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.406 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.406 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.407 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.408 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.408 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.408 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.408 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.409 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.409 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.409 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.410 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.410 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.411 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.412 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.412 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.412 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.412 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.412 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.412 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.412 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.412 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.413 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.413 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.413 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.413 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.413 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.414 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.414 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.414 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.414 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.415 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-05-08T09:49:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-05-08T09:49:10.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-05-08T09:49:10.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.417 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.417 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.417 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T09:49:10.418 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.418 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.418 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.419 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.419 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.419 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.419 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.419 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.420 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.420 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.420 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.420 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.420 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.420 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.421 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.422 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.423 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.423 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.423 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.424 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.426 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.426 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.426 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-05-08T09:49:10.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-05-08T09:49:10.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.427 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.427 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.427 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-05-08T09:49:10.427 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-05-08T09:49:10.427 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-05-08T09:49:10.428 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-05-08T09:49:10.428 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.428 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.428 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.428 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.428 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.429 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-05-08T09:49:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.430 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.431 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.431 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.431 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.432 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.432 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.432 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.432 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.432 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.432 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.432 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.433 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.433 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.433 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.433 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.434 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.434 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.434 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.434 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.435 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.436 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.436 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.436 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.436 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.436 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.436 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.436 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.436 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.437 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.437 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.438 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.439 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.439 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.439 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.439 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.439 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.440 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.440 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.440 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.440 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.441 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-05-08T09:49:10.441 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.441 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.441 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.441 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.442 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.442 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.442 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.442 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.443 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.445 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.446 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.446 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.446 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.446 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.446 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.446 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.446 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.447 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.447 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.447 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.447 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.448 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.448 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.449 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.449 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.450 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.450 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.451 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.451 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-05-08T09:49:10.451 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.451 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.451 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.452 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.452 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.452 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.452 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.452 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.454 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.454 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.454 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.455 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.455 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.455 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.455 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.455 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.456 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.458 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.459 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:10.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:10.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.460 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.461 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.461 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.461 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.461 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.462 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.462 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-05-08T09:49:10.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-05-08T09:49:10.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-05-08T09:49:10.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-05-08T09:49:10.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-05-08T09:49:10.463 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.464 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.465 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-05-08T09:49:10.465 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-05-08T09:49:10.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.465 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.465 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.465 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.465 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T09:49:10.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-05-08T09:49:10.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-05-08T09:49:10.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.468 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.468 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.469 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.469 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.469 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.469 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.469 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.470 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.470 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.470 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.470 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.470 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.470 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.472 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.473 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.473 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.473 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.473 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.473 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.473 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.474 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.474 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.474 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.474 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.474 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.474 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.475 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-05-08T09:49:10.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-05-08T09:49:10.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.476 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-05-08T09:49:10.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.477 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.477 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-05-08T09:49:10.477 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.477 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.478 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:10.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:10.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.478 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:10.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.479 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-05-08T09:49:10.479 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.479 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.480 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.480 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.480 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.481 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.482 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.482 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-05-08T09:49:10.482 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.482 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.482 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.483 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-05-08T09:49:10.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-05-08T09:49:10.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.484 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.484 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.484 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.484 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.484 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.484 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-05-08T09:49:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-05-08T09:49:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T09:49:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T09:49:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.486 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.488 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.488 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.488 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.488 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.488 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.488 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.488 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.489 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.490 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.490 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.491 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.491 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.491 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.491 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.492 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.492 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.492 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.493 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.494 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-05-08T09:49:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-05-08T09:49:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.496 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T09:49:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T09:49:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-05-08T09:49:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-05-08T09:49:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-05-08T09:49:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-05-08T09:49:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.501 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-05-08T09:49:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-05-08T09:49:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.502 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-05-08T09:49:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T09:49:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-05-08T09:49:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-05-08T09:49:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-05-08T09:49:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T09:49:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-05-08T09:49:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-05-08T09:49:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-05-08T09:49:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.508 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.509 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-05-08T09:49:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-05-08T09:49:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-05-08T09:49:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-05-08T09:49:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-05-08T09:49:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-05-08T09:49:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-05-08T09:49:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-05-08T09:49:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-05-08T09:49:10.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-05-08T09:49:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-05-08T09:49:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.514 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.515 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.516 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.518 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.520 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.521 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.522 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.523 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-05-08T09:49:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-05-08T09:49:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.524 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.525 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-05-08T09:49:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T09:49:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.526 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.527 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.528 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.529 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-05-08T09:49:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-05-08T09:49:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.530 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-05-08T09:49:10.532 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-05-08T09:49:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-05-08T09:49:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-05-08T09:49:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-05-08T09:49:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.538 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.540 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.541 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.542 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.543 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.545 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-05-08T09:49:10.546 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-05-08T09:49:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.547 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-05-08T09:49:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-05-08T09:49:10.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.550 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.551 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.552 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-05-08T09:49:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.553 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.554 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.555 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.557 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.558 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.559 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.560 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.561 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.564 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.565 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-05-08T09:49:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.566 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.567 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.568 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.570 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.572 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.573 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.575 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.576 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-05-08T09:49:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-05-08T09:49:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-05-08T09:49:10.578 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T09:49:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.579 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-05-08T09:49:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.580 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.582 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.583 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.584 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.586 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.587 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.588 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-05-08T09:49:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-05-08T09:49:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.590 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-05-08T09:49:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-05-08T09:49:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-05-08T09:49:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.593 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-05-08T09:49:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-05-08T09:49:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.594 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-05-08T09:49:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-05-08T09:49:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.596 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.598 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-05-08T09:49:10.598 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-05-08T09:49:10.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.598 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.598 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.598 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.598 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.599 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.599 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.599 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.599 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.600 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-05-08T09:49:10.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-05-08T09:49:10.600 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.600 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.600 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.600 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.601 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.601 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.601 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.601 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.601 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-05-08T09:49:10.602 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-05-08T09:49:10.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.602 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.602 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.602 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.602 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.603 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.603 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.603 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.603 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.603 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-05-08T09:49:10.603 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-05-08T09:49:10.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.604 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.604 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.604 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.604 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.604 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.605 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.605 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.605 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.605 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-05-08T09:49:10.605 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-05-08T09:49:10.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.606 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.606 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.606 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:10.606 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-05-08T09:49:10.606 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.606 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.607 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.607 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.607 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.608 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.608 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.608 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.609 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.609 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.609 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-05-08T09:49:10.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-05-08T09:49:10.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.610 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.610 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.610 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.610 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.610 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.610 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.611 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.611 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.611 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.611 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.611 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-05-08T09:49:10.611 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-05-08T09:49:10.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.612 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.612 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.612 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.613 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.613 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.613 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-05-08T09:49:10.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-05-08T09:49:10.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.613 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.614 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.614 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.614 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.614 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.614 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.615 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.615 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.615 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.615 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.615 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smb", 2024-05-08T09:49:10.615 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.616 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.616 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.616 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.616 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.616 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.617 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.617 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.617 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.617 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.617 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.617 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.618 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.618 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.618 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.618 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.618 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.618 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.619 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.619 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.619 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.619 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.620 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.620 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.620 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.620 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.620 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.620 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.621 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.621 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.621 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.621 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.621 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.622 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.622 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.622 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.622 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.622 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.622 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.622 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.623 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.623 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.623 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.623 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.623 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.623 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.624 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.624 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.624 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.624 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.624 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.625 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.625 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.625 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.625 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.625 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.625 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.626 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.626 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.626 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.627 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.627 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.627 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.627 INFO:teuthology.orchestra.run.smithi070.stdout: "update_orchestration": { 2024-05-08T09:49:10.628 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "update_orchestration", 2024-05-08T09:49:10.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.628 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.628 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.628 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.628 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.628 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-08T09:49:10.629 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.629 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.629 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.630 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-05-08T09:49:10.630 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.630 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.630 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.630 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-05-08T09:49:10.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-05-08T09:49:10.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.631 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.631 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.631 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.631 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.632 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T09:49:10.632 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.632 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.632 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-05-08T09:49:10.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-05-08T09:49:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.634 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-05-08T09:49:10.634 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.634 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.634 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.634 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.635 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.635 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.635 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.635 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.635 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.635 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.636 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.636 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.636 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.636 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.636 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.636 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.637 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.637 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.637 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.637 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.638 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.638 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.638 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.638 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.638 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.638 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.639 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.639 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.639 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.639 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.640 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.640 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.640 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.640 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.640 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.641 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.641 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.641 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.641 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.641 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.641 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.641 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.641 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.642 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.644 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.644 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.644 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.644 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.645 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.645 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.645 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.645 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.645 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.645 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.646 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.646 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-05-08T09:49:10.646 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.646 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.647 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.647 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.647 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.647 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.647 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.648 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.648 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.648 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.648 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.648 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.648 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.648 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.649 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.649 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.649 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.649 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.649 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.649 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.650 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.650 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.650 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.650 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.650 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.650 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.651 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.651 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.651 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.651 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.651 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.651 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.652 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.652 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.652 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.652 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.652 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.652 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.653 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.653 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.653 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.653 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.653 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.653 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.653 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.654 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.654 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.654 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.654 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.655 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.655 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.655 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.655 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.655 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.656 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.656 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.656 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.656 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.656 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.657 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.657 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.657 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.657 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.657 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.657 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.657 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.658 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.658 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-05-08T09:49:10.659 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.659 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.659 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.659 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.659 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.660 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.660 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.660 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.660 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.660 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.661 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.661 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.661 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.661 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.661 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.661 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.662 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.662 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.662 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.662 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.662 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.663 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.663 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.663 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.663 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.663 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.663 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.663 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.664 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.664 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.664 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.664 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.664 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.665 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.665 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.665 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.665 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.665 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.665 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.665 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.666 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.666 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.666 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.666 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.666 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.666 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.666 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.667 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.667 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.667 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.667 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.667 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.667 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.668 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.668 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.668 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.669 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.669 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.669 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.670 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.670 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.670 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-05-08T09:49:10.671 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.671 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.671 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.671 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-05-08T09:49:10.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-05-08T09:49:10.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.672 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T09:49:10.672 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.672 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.672 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.673 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.673 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:10.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:10.673 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.674 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.674 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-05-08T09:49:10.674 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.674 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.674 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.674 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.674 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.675 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.675 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.675 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.675 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.675 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.676 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.676 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.676 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.677 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.677 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.677 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.677 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.677 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.677 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.678 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.678 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.678 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.678 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.679 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.679 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.679 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.679 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.679 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.679 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.679 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.680 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.680 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.680 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.681 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.681 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.681 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.681 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.681 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.681 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.681 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.682 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.682 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.682 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.682 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.682 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.682 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.683 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.683 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.683 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.683 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.683 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.683 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.684 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.684 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.684 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.684 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.684 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.684 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.685 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.685 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.685 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.685 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.685 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.686 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.686 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.686 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.686 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.686 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.687 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.687 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.687 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.687 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-05-08T09:49:10.687 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.687 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.687 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.688 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-05-08T09:49:10.688 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-05-08T09:49:10.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.688 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.689 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.689 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T09:49:10.689 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.689 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.689 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.689 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-05-08T09:49:10.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-05-08T09:49:10.690 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.690 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.690 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.690 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.690 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.690 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.691 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.691 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T09:49:10.691 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.691 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.691 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.691 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.691 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-05-08T09:49:10.692 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-05-08T09:49:10.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.692 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.692 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.692 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.692 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.692 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.693 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T09:49:10.693 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.693 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.693 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-05-08T09:49:10.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-05-08T09:49:10.694 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.694 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.694 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.694 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.694 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.694 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T09:49:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-05-08T09:49:10.695 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-05-08T09:49:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.696 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T09:49:10.697 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.697 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.697 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-05-08T09:49:10.697 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-05-08T09:49:10.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.698 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.698 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.698 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.698 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.698 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.698 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.698 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.699 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.699 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.699 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.699 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-05-08T09:49:10.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-05-08T09:49:10.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.700 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.700 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.700 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.700 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.700 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.700 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.701 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.701 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.701 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-05-08T09:49:10.701 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-05-08T09:49:10.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.701 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T09:49:10.702 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.702 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.702 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.702 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.702 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-05-08T09:49:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-05-08T09:49:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.703 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.704 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-05-08T09:49:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-05-08T09:49:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-05-08T09:49:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-05-08T09:49:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.707 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-05-08T09:49:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.708 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.709 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-05-08T09:49:10.709 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-05-08T09:49:10.709 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.709 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.709 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.709 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.710 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-05-08T09:49:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-05-08T09:49:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.711 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.712 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.713 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.714 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.715 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.716 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.717 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.717 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.717 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.717 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.718 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.718 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.718 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.718 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.718 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.718 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.719 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.719 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.719 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.719 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.719 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.719 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.719 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.720 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.720 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.720 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.720 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.720 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.721 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.721 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.721 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.721 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.721 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.721 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-05-08T09:49:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-05-08T09:49:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.723 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.723 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.723 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.723 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.723 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.723 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.724 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-05-08T09:49:10.724 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-05-08T09:49:10.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.724 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.724 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.725 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.725 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.725 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.725 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.725 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.725 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.726 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.726 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.726 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.726 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.726 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.726 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.727 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.727 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.727 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.727 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.728 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-05-08T09:49:10.728 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-05-08T09:49:10.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.728 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.728 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T09:49:10.728 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.729 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.729 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.729 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.729 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.729 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.730 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.730 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-05-08T09:49:10.730 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.730 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.730 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.730 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.730 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.731 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.731 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.731 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.731 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.731 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.731 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.732 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.734 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.736 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.737 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.738 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.739 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.740 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.741 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.742 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-05-08T09:49:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.743 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.744 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.745 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.746 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.747 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.748 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.749 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.750 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.751 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.752 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.753 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-05-08T09:49:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-05-08T09:49:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-05-08T09:49:10.754 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T09:49:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.755 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-05-08T09:49:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-05-08T09:49:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.756 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-05-08T09:49:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-05-08T09:49:10.757 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-05-08T09:49:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.758 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T09:49:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-05-08T09:49:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T09:49:10.759 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.760 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T09:49:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.761 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.762 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.763 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-05-08T09:49:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-05-08T09:49:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-05-08T09:49:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-05-08T09:49:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-05-08T09:49:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-05-08T09:49:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.768 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.769 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.770 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.771 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.772 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.773 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.774 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.775 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.776 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.777 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.778 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.779 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.780 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-05-08T09:49:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-05-08T09:49:10.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.782 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-05-08T09:49:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-05-08T09:49:10.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-05-08T09:49:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.784 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-05-08T09:49:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-05-08T09:49:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.785 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T09:49:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.786 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:10.787 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "modules": [ 2024-05-08T09:49:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-05-08T09:49:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard", 2024-05-08T09:49:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "iostat", 2024-05-08T09:49:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "nfs", 2024-05-08T09:49:10.788 INFO:teuthology.orchestra.run.smithi070.stdout: "restful", 2024-05-08T09:49:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_schedule" 2024-05-08T09:49:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-05-08T09:49:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-05-08T09:49:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.789 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.790 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T09:49:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.791 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.792 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.793 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.794 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.795 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.796 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.797 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.798 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.800 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.801 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-05-08T09:49:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-05-08T09:49:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.802 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-05-08T09:49:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-05-08T09:49:10.803 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-05-08T09:49:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.805 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-05-08T09:49:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-05-08T09:49:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.806 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-05-08T09:49:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-05-08T09:49:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.807 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-05-08T09:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-05-08T09:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-05-08T09:49:10.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-05-08T09:49:10.809 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-05-08T09:49:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-05-08T09:49:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.810 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-05-08T09:49:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-05-08T09:49:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.811 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-05-08T09:49:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-05-08T09:49:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.812 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-05-08T09:49:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-05-08T09:49:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-05-08T09:49:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.813 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T09:49:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-05-08T09:49:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-05-08T09:49:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.815 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-05-08T09:49:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.816 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.817 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-05-08T09:49:10.818 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-05-08T09:49:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-05-08T09:49:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.819 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T09:49:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.820 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-05-08T09:49:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-05-08T09:49:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-05-08T09:49:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.821 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T09:49:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T09:49:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-05-08T09:49:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-05-08T09:49:10.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-05-08T09:49:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-05-08T09:49:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T09:49:10.823 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T09:49:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-05-08T09:49:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-05-08T09:49:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.824 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-05-08T09:49:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-05-08T09:49:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T09:49:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-05-08T09:49:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-05-08T09:49:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T09:49:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.826 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T09:49:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T09:49:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-05-08T09:49:10.827 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-05-08T09:49:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-05-08T09:49:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-05-08T09:49:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-05-08T09:49:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-05-08T09:49:10.828 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T09:49:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-05-08T09:49:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-05-08T09:49:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.829 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-05-08T09:49:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T09:49:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T09:49:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-05-08T09:49:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-05-08T09:49:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-05-08T09:49:10.831 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-05-08T09:49:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T09:49:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T09:49:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.832 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.833 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.835 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.836 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.837 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.838 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.839 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-05-08T09:49:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-05-08T09:49:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.841 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T09:49:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-05-08T09:49:10.842 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-05-08T09:49:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-05-08T09:49:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-05-08T09:49:10.843 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-05-08T09:49:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-05-08T09:49:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-05-08T09:49:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-05-08T09:49:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-05-08T09:49:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-05-08T09:49:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-05-08T09:49:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T09:49:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:10.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T09:49:10.847 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.848 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-05-08T09:49:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-05-08T09:49:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:10.850 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T09:49:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T09:49:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-05-08T09:49:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-05-08T09:49:10.851 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T09:49:10.852 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-05-08T09:49:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.853 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-05-08T09:49:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-05-08T09:49:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-05-08T09:49:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.854 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T09:49:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-05-08T09:49:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-05-08T09:49:10.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-05-08T09:49:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T09:49:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.856 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-05-08T09:49:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-05-08T09:49:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-05-08T09:49:10.857 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T09:49:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-05-08T09:49:10.858 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-05-08T09:49:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T09:49:10.859 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T09:49:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-05-08T09:49:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-05-08T09:49:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.860 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T09:49:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.861 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-05-08T09:49:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T09:49:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-05-08T09:49:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.862 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T09:49:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-05-08T09:49:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-05-08T09:49:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-05-08T09:49:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-05-08T09:49:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-05-08T09:49:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.864 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-08T09:49:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-05-08T09:49:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-05-08T09:49:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T09:49:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.866 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.867 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T09:49:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-05-08T09:49:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-05-08T09:49:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.868 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T09:49:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.869 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-05-08T09:49:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-05-08T09:49:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T09:49:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.870 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.871 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T09:49:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-05-08T09:49:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.872 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-05-08T09:49:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-05-08T09:49:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T09:49:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.873 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-05-08T09:49:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-05-08T09:49:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-05-08T09:49:10.874 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.875 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.876 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-05-08T09:49:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-05-08T09:49:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-05-08T09:49:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.877 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T09:49:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-05-08T09:49:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.878 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-05-08T09:49:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-05-08T09:49:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T09:49:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.879 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-05-08T09:49:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-05-08T09:49:10.880 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-05-08T09:49:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T09:49:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-05-08T09:49:10.881 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-05-08T09:49:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-05-08T09:49:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.882 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T09:49:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-05-08T09:49:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.883 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-05-08T09:49:10.884 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-05-08T09:49:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-05-08T09:49:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T09:49:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.887 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-05-08T09:49:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-05-08T09:49:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-05-08T09:49:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T09:49:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-05-08T09:49:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-05-08T09:49:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-05-08T09:49:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T09:49:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.890 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-08T09:49:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-05-08T09:49:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.893 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-05-08T09:49:10.894 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.894 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.894 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.894 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-05-08T09:49:10.894 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-05-08T09:49:10.894 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.894 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.895 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-05-08T09:49:10.896 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-05-08T09:49:10.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.896 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.896 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.896 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:10.896 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.896 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.896 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.896 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T09:49:10.897 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.897 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.897 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-05-08T09:49:10.897 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T09:49:10.897 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.897 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.898 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-05-08T09:49:10.898 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.898 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.898 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.898 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T09:49:10.898 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.898 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.899 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-05-08T09:49:10.899 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-05-08T09:49:10.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.899 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.899 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-05-08T09:49:10.899 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.899 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.899 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.900 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T09:49:10.900 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.900 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.900 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.900 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-05-08T09:49:10.900 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-05-08T09:49:10.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.900 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.901 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.901 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-05-08T09:49:10.901 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.901 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.901 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.901 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-05-08T09:49:10.901 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.901 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.902 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-05-08T09:49:10.902 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-05-08T09:49:10.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.902 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.902 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.902 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-05-08T09:49:10.903 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-05-08T09:49:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.905 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.905 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-05-08T09:49:10.905 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-05-08T09:49:10.905 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.905 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.905 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-08T09:49:10.905 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.906 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.906 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.906 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-08T09:49:10.906 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.906 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.906 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.906 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-05-08T09:49:10.907 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-05-08T09:49:10.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.907 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.907 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:10.907 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.907 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.907 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.907 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.908 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T09:49:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.909 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-05-08T09:49:10.910 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-05-08T09:49:10.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.910 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.910 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.910 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.910 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.910 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.910 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T09:49:10.911 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.911 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.911 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.911 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.911 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.911 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.912 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.912 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.912 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.912 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.912 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.912 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.912 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.912 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.912 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.913 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.913 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.913 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.913 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.913 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.913 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.913 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-05-08T09:49:10.913 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-05-08T09:49:10.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.914 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.914 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.914 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.914 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.914 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.914 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T09:49:10.915 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.915 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.915 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.915 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.915 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.915 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.915 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.916 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.916 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.916 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.916 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.916 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T09:49:10.916 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.916 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.917 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.917 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.917 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.917 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.917 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.917 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.918 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.918 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.918 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.918 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.918 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.918 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.918 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.918 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.918 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.919 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.919 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.919 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.919 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.919 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.920 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.920 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.920 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.920 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.920 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.920 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.920 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.920 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.921 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T09:49:10.921 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T09:49:10.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.921 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.921 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.921 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.921 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.921 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.922 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.922 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T09:49:10.922 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.922 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.922 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.922 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T09:49:10.922 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T09:49:10.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.923 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.923 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-05-08T09:49:10.923 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.923 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.923 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.923 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T09:49:10.924 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.924 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.924 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-05-08T09:49:10.924 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-05-08T09:49:10.924 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.924 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.924 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.925 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.925 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.925 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.925 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.925 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-05-08T09:49:10.925 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.925 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.925 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.926 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-05-08T09:49:10.926 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-05-08T09:49:10.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.926 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.926 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.926 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.927 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.927 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.927 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T09:49:10.927 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.927 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.927 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-05-08T09:49:10.927 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-05-08T09:49:10.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.928 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.928 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.928 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.928 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.928 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.928 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.928 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-05-08T09:49:10.928 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.929 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.929 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.929 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.929 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-05-08T09:49:10.929 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-05-08T09:49:10.929 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.929 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.929 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-05-08T09:49:10.930 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.930 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.930 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.930 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-05-08T09:49:10.930 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-05-08T09:49:10.930 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.930 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T09:49:10.930 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.931 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.931 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-05-08T09:49:10.931 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-05-08T09:49:10.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.931 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.931 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-05-08T09:49:10.931 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-05-08T09:49:10.932 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.933 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.933 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T09:49:10.933 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.933 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.933 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.933 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T09:49:10.933 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.933 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.934 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.934 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-05-08T09:49:10.934 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-05-08T09:49:10.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.934 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.934 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.935 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.935 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.935 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.935 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T09:49:10.935 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.935 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.935 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T09:49:10.936 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.937 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.937 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.937 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.937 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-05-08T09:49:10.937 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-05-08T09:49:10.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.937 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.937 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.938 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.938 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.938 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.938 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T09:49:10.938 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.938 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.939 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-05-08T09:49:10.939 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-05-08T09:49:10.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.939 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.939 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.939 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.939 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.939 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.940 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T09:49:10.940 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.940 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.940 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.940 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-05-08T09:49:10.940 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-05-08T09:49:10.940 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.940 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.941 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.941 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.941 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.941 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.941 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T09:49:10.941 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.941 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.941 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.942 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-05-08T09:49:10.942 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-05-08T09:49:10.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.942 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.942 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-05-08T09:49:10.942 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.943 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.944 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.944 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.944 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.944 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.944 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.944 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.944 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.944 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.945 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.946 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.946 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T09:49:10.946 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.946 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.946 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-05-08T09:49:10.946 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-05-08T09:49:10.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.947 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.947 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.947 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.947 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.947 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.947 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T09:49:10.947 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.947 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.948 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.948 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-05-08T09:49:10.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-05-08T09:49:10.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.948 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.948 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.948 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.949 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.949 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.949 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T09:49:10.949 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.949 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.949 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-05-08T09:49:10.949 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-05-08T09:49:10.950 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.950 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.950 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.950 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.950 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.950 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.950 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.950 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T09:49:10.950 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.951 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T09:49:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.952 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-05-08T09:49:10.953 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-05-08T09:49:10.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.953 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.953 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.953 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.953 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.953 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T09:49:10.954 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.954 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.954 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.954 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.954 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.954 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.954 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-05-08T09:49:10.955 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.955 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.955 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.955 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:10.955 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:10.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.955 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.956 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.956 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.956 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.956 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.956 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.956 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.956 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.956 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.956 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.957 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.957 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.957 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.957 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.957 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.957 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:10.958 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:10.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.958 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.958 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.958 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.958 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.958 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.958 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.959 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.959 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.959 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:10.959 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:10.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.959 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:10.960 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:10.961 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:10.961 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.961 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.961 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.961 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:10.961 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:10.961 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.962 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.962 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.962 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.962 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.962 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.962 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.962 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.963 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.963 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-05-08T09:49:10.963 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-05-08T09:49:10.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.963 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.963 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-05-08T09:49:10.963 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.964 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.964 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.964 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T09:49:10.964 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.964 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.964 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:10.964 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:10.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.965 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:10.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.965 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:10.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.965 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.965 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.965 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-05-08T09:49:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-05-08T09:49:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:10.967 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-05-08T09:49:10.967 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.967 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.967 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.967 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T09:49:10.967 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.967 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.967 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.967 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.968 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:10.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.968 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:10.968 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-05-08T09:49:10.968 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:10.968 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:10.968 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:10.968 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T09:49:10.968 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.970 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.970 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T09:49:10.970 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T09:49:10.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.970 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.970 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.971 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.971 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.971 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.971 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.971 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.971 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.971 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.972 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.973 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.973 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.973 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-05-08T09:49:10.973 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T09:49:10.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.973 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.973 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.974 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.974 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.974 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.974 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.974 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.974 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.974 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T09:49:10.975 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T09:49:10.975 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.975 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.975 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.975 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.975 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.975 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.975 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.975 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.976 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.976 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.976 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.976 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T09:49:10.976 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T09:49:10.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.976 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.977 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.977 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.977 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.977 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.977 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.977 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.977 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.978 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T09:49:10.978 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T09:49:10.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.978 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.978 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.978 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.978 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.979 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.979 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.979 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.979 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.979 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T09:49:10.979 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T09:49:10.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.980 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.980 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.980 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.980 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.980 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.980 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.980 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.981 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.981 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.981 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T09:49:10.981 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T09:49:10.981 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.981 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.981 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.981 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.982 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.982 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.982 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.982 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.982 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.982 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.982 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T09:49:10.983 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T09:49:10.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.983 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.983 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.983 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.983 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.983 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.984 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.984 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.984 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.984 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.984 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.984 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T09:49:10.984 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T09:49:10.984 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.984 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.985 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.985 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.985 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.985 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.985 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.985 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.985 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.986 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T09:49:10.986 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T09:49:10.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.986 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.986 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.986 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.987 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.987 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.987 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.987 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.987 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.987 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T09:49:10.987 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T09:49:10.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.988 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.988 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.988 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.988 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.988 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.988 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.988 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.989 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.989 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.989 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T09:49:10.989 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T09:49:10.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.989 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.989 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.990 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.990 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.990 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.990 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.990 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.990 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.990 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T09:49:10.991 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T09:49:10.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.991 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.991 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.991 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-05-08T09:49:10.991 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.991 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.991 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.991 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.992 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.992 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.992 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.992 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.992 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T09:49:10.992 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T09:49:10.992 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.992 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.993 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-05-08T09:49:10.994 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-05-08T09:49:10.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.994 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.994 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.994 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.994 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.994 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.995 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.995 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.995 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.995 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T09:49:10.995 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T09:49:10.995 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.995 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.996 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-05-08T09:49:10.996 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.996 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.996 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.996 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.996 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.996 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.997 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T09:49:10.997 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T09:49:10.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:10.997 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.997 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:10.997 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.997 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.998 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.998 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:10.998 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:10.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:10.998 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:10.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:10.998 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T09:49:10.998 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T09:49:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:10.999 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.000 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.000 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.000 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T09:49:11.000 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T09:49:11.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.000 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.000 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.001 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T09:49:11.002 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T09:49:11.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.002 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.002 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.002 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.002 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.002 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.003 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.003 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.003 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.003 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.003 INFO:teuthology.orchestra.run.smithi070.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-08T09:49:11.003 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-08T09:49:11.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.003 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.004 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.004 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "[]", 2024-05-08T09:49:11.004 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.004 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.004 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.004 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.004 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.004 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.005 INFO:teuthology.orchestra.run.smithi070.stdout: "MULTICLUSTER_CONFIG": { 2024-05-08T09:49:11.005 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-08T09:49:11.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.005 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.005 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "{}", 2024-05-08T09:49:11.005 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.005 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.006 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.006 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.006 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.006 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.006 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T09:49:11.006 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T09:49:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.007 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T09:49:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T09:49:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.008 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T09:49:11.009 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T09:49:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.010 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T09:49:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T09:49:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.011 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.013 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T09:49:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T09:49:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.014 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T09:49:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T09:49:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.016 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T09:49:11.017 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T09:49:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.018 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T09:49:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T09:49:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.020 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T09:49:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T09:49:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.021 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T09:49:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T09:49:11.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.023 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T09:49:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T09:49:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.024 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T09:49:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.025 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T09:49:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T09:49:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.026 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T09:49:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T09:49:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.027 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-05-08T09:49:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.028 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.029 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T09:49:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T09:49:11.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.031 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-05-08T09:49:11.032 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.033 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T09:49:11.034 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T09:49:11.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.034 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.034 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.034 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.034 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.034 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.034 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.035 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.035 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.035 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T09:49:11.035 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T09:49:11.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.035 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.037 INFO:teuthology.orchestra.run.smithi070.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T09:49:11.037 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T09:49:11.037 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.037 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.037 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.037 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.037 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.037 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.037 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.038 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.038 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.038 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.038 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.038 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.038 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T09:49:11.038 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T09:49:11.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.038 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.039 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.039 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.039 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.039 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.039 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.039 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.039 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.039 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.040 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.041 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.041 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.041 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.041 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T09:49:11.041 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T09:49:11.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.041 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.042 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.042 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:11.042 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.042 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.042 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.042 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.042 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.042 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.043 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-05-08T09:49:11.043 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-05-08T09:49:11.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.043 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.043 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.043 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.043 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.044 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.045 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.045 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.045 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.045 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.045 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.045 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.045 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.046 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-05-08T09:49:11.046 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-05-08T09:49:11.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.046 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.046 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.046 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.046 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.046 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.047 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.048 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-05-08T09:49:11.048 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.048 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.048 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.048 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.048 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.048 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.049 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.049 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-05-08T09:49:11.049 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-05-08T09:49:11.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.049 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.049 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.049 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.049 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.050 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.051 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.051 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.051 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.051 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.051 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.051 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.051 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.051 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.052 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.052 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.052 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.052 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.052 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.052 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.052 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.053 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.053 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.053 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.053 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.053 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.053 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.053 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.053 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.053 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.054 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.054 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.054 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.054 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.054 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.055 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.056 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.056 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.056 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.056 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.056 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.056 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.056 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.057 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.057 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.057 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.057 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.057 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.057 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.057 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.057 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.058 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.058 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-05-08T09:49:11.058 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-05-08T09:49:11.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.058 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.058 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.058 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.059 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.059 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.059 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-05-08T09:49:11.059 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.059 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.059 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-05-08T09:49:11.059 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.061 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.062 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.062 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.062 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.062 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.062 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-05-08T09:49:11.062 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-05-08T09:49:11.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.063 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.063 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-05-08T09:49:11.063 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.063 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.063 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.063 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.063 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.063 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.064 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-05-08T09:49:11.065 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.067 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.067 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.067 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-05-08T09:49:11.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-05-08T09:49:11.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.067 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.067 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-05-08T09:49:11.067 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-05-08T09:49:11.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.069 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.069 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-05-08T09:49:11.069 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.069 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.069 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.069 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.069 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-05-08T09:49:11.070 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.070 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.070 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.070 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.070 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-05-08T09:49:11.070 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-05-08T09:49:11.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.071 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.072 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-05-08T09:49:11.072 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-05-08T09:49:11.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.072 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.072 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.072 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.072 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.073 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-05-08T09:49:11.074 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.074 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.074 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.074 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-05-08T09:49:11.074 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-05-08T09:49:11.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.074 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.074 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.075 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.076 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.076 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.076 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.076 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.076 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.076 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.076 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.076 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.076 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.078 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.078 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.078 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.078 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.078 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.078 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.078 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.079 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.079 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.079 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.079 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.079 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.079 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.080 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.080 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.080 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.080 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.080 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.080 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.080 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.080 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.080 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.081 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.081 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.081 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.081 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.081 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.081 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.081 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.082 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.082 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.082 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.082 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.082 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.082 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.084 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-05-08T09:49:11.084 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.084 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.084 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.084 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T09:49:11.084 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.084 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.085 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T09:49:11.086 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.086 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.086 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-05-08T09:49:11.086 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-05-08T09:49:11.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.086 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.088 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-05-08T09:49:11.088 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-05-08T09:49:11.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.088 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.088 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-05-08T09:49:11.088 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.088 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.088 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.089 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T09:49:11.089 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.089 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.089 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-05-08T09:49:11.089 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-05-08T09:49:11.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.090 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.091 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:11.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:11.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.091 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.091 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:11.091 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.092 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.092 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.092 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T09:49:11.092 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.092 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.092 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.092 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.093 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.093 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.093 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.093 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.093 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.093 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.093 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.093 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.094 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.094 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-05-08T09:49:11.094 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-05-08T09:49:11.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.094 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.094 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.095 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.096 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.096 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-05-08T09:49:11.096 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.096 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.096 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.096 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.096 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.096 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.097 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.097 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.097 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.097 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.097 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.097 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.097 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.097 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.098 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.098 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.098 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.098 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.098 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.098 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.098 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.099 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.100 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.101 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.102 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.102 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.102 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.102 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.102 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.102 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.104 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.105 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.105 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.105 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.105 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.105 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-05-08T09:49:11.105 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-05-08T09:49:11.105 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.106 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.106 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-05-08T09:49:11.106 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.106 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.106 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.106 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.106 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.107 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.107 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:11.107 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:11.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.107 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.107 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-05-08T09:49:11.107 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.108 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.108 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.108 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.108 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.108 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.108 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.108 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.110 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.110 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.110 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.110 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-05-08T09:49:11.110 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-05-08T09:49:11.110 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-05-08T09:49:11.110 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.111 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T09:49:11.112 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.112 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.112 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.112 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-05-08T09:49:11.112 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-05-08T09:49:11.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.112 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-05-08T09:49:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-05-08T09:49:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.114 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-05-08T09:49:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-05-08T09:49:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T09:49:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.117 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.119 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.120 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.121 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.122 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.123 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-05-08T09:49:11.124 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-05-08T09:49:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-05-08T09:49:11.125 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-05-08T09:49:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-05-08T09:49:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.126 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-05-08T09:49:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-05-08T09:49:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.128 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-05-08T09:49:11.129 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-05-08T09:49:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-05-08T09:49:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T09:49:11.130 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-05-08T09:49:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-05-08T09:49:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.131 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-05-08T09:49:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T09:49:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-05-08T09:49:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-05-08T09:49:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.133 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-05-08T09:49:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-05-08T09:49:11.134 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-05-08T09:49:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-05-08T09:49:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T09:49:11.135 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.136 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.137 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.138 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.139 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.140 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.141 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.146 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.147 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.149 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.150 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.151 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.152 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.153 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.155 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.156 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-05-08T09:49:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-05-08T09:49:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-05-08T09:49:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-05-08T09:49:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T09:49:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.158 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-05-08T09:49:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-05-08T09:49:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-05-08T09:49:11.159 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T09:49:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.161 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.162 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.163 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.164 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.165 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.168 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-05-08T09:49:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-05-08T09:49:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-05-08T09:49:11.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-05-08T09:49:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-05-08T09:49:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T09:49:11.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.172 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.173 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.176 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.177 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.179 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-05-08T09:49:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-05-08T09:49:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.180 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-05-08T09:49:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T09:49:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-05-08T09:49:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-05-08T09:49:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-05-08T09:49:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.182 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-05-08T09:49:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-05-08T09:49:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-05-08T09:49:11.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-05-08T09:49:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T09:49:11.184 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-05-08T09:49:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-05-08T09:49:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.185 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-05-08T09:49:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.187 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-05-08T09:49:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-05-08T09:49:11.188 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-05-08T09:49:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T09:49:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T09:49:11.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-05-08T09:49:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.190 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.191 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.192 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.193 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.195 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.196 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.197 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.199 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-05-08T09:49:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.202 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.203 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.204 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.206 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.208 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.210 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-05-08T09:49:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.211 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.212 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.213 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.214 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.215 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.217 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.218 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.220 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.221 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.222 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-05-08T09:49:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-05-08T09:49:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-05-08T09:49:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.223 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T09:49:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.224 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.225 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.226 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.227 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.228 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.229 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.230 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.231 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-05-08T09:49:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-05-08T09:49:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.233 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.233 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.233 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.233 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.233 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-05-08T09:49:11.233 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-05-08T09:49:11.233 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-05-08T09:49:11.233 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.234 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-05-08T09:49:11.234 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.234 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.234 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.234 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.234 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.234 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.235 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.235 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.235 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.235 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.235 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.235 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.235 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.236 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.236 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-05-08T09:49:11.236 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.236 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.236 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.236 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.237 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.237 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.237 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.237 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.237 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.237 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.238 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.238 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.238 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.238 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.238 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.238 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.238 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.238 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.238 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.239 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.240 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.240 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.240 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.240 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.240 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.240 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.240 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.241 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.242 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.242 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.242 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.242 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.242 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.242 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.242 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.243 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.243 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.243 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.243 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.243 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.245 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.245 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.245 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.245 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.245 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-05-08T09:49:11.246 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.246 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.246 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.246 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.247 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.248 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.249 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.250 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.251 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.252 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.253 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.254 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-05-08T09:49:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.257 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.258 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.259 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.260 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.261 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.263 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.265 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.266 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-05-08T09:49:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-05-08T09:49:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-05-08T09:49:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T09:49:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.268 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-05-08T09:49:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-05-08T09:49:11.269 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-05-08T09:49:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T09:49:11.270 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-05-08T09:49:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-05-08T09:49:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.271 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.272 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.273 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.274 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.275 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.277 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.278 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.279 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-05-08T09:49:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-05-08T09:49:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-05-08T09:49:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-05-08T09:49:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-05-08T09:49:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-05-08T09:49:11.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-05-08T09:49:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-05-08T09:49:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.284 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.285 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-05-08T09:49:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-05-08T09:49:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-05-08T09:49:11.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-05-08T09:49:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-05-08T09:49:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.288 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T09:49:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T09:49:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.290 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.291 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.292 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.293 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.293 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.293 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.293 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.293 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.293 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.294 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.294 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.294 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.294 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.294 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.294 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.295 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.295 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.295 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.295 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.295 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.295 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.295 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.295 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.295 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.296 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.296 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.296 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.296 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.297 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.297 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.297 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.298 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.298 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-05-08T09:49:11.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-05-08T09:49:11.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.299 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.299 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.299 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.299 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.299 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T09:49:11.300 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T09:49:11.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.300 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-05-08T09:49:11.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.300 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.301 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.301 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-05-08T09:49:11.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-05-08T09:49:11.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:11.301 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.302 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-05-08T09:49:11.302 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.302 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.302 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.302 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.302 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.302 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.303 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-05-08T09:49:11.303 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-05-08T09:49:11.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.303 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.303 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-05-08T09:49:11.303 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.303 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.303 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.304 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T09:49:11.304 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.304 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.304 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-05-08T09:49:11.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-05-08T09:49:11.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.304 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.305 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-05-08T09:49:11.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.305 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.305 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.305 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T09:49:11.305 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.305 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.306 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.306 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.306 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.306 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.306 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.307 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.307 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.307 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.307 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-05-08T09:49:11.307 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.309 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.309 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-05-08T09:49:11.309 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-05-08T09:49:11.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.309 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.309 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-05-08T09:49:11.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.310 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.310 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.310 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-05-08T09:49:11.310 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-05-08T09:49:11.310 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.310 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.310 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.310 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.311 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-05-08T09:49:11.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-05-08T09:49:11.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.311 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.311 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.311 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-05-08T09:49:11.311 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-05-08T09:49:11.311 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-05-08T09:49:11.312 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.312 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.312 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.312 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.312 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.312 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.313 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-05-08T09:49:11.313 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.313 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.313 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.313 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.313 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.313 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.314 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.314 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.314 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.314 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.314 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.314 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.314 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.314 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.314 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.315 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.315 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.315 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.315 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.315 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.315 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.315 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.316 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.316 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.316 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.316 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.316 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.316 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.317 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.317 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.317 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.318 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.318 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.318 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.318 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.318 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.318 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.318 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.318 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.319 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.320 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.320 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.320 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.320 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.320 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.320 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.321 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.321 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-05-08T09:49:11.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-05-08T09:49:11.321 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.321 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.322 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-05-08T09:49:11.322 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.322 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.322 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.322 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.322 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.322 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.323 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-05-08T09:49:11.323 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T09:49:11.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.323 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.323 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.324 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.324 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.324 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.324 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.324 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.324 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.326 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.326 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-05-08T09:49:11.326 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-05-08T09:49:11.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.326 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-05-08T09:49:11.328 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.328 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.328 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.328 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-05-08T09:49:11.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-05-08T09:49:11.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.328 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.330 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-05-08T09:49:11.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-05-08T09:49:11.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.330 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.330 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.330 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.330 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.330 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.332 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.332 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.332 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.332 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.332 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.332 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.332 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.333 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.333 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.333 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.333 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.333 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.333 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.334 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.334 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.334 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.334 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.334 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.334 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.335 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.336 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.336 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.336 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.336 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.336 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.336 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.336 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.337 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.338 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.338 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.338 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.338 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.338 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.338 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.340 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.340 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.340 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.340 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-05-08T09:49:11.340 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-05-08T09:49:11.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.340 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.341 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.341 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.341 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.341 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.341 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.341 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.341 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.342 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.342 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.342 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.342 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-05-08T09:49:11.344 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.344 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.344 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.344 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.344 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.345 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.346 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.346 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.346 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.346 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.346 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.349 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.349 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.349 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.349 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.349 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.349 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.349 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.349 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.349 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.350 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.350 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.351 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.352 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.352 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.353 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.354 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.354 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.354 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.354 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.354 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.354 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.355 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.357 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.357 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.357 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.357 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.357 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.357 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.358 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.359 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.359 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.359 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.359 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.359 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.359 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.359 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.360 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.360 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.360 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.360 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.360 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.360 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.361 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.361 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.363 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-05-08T09:49:11.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-05-08T09:49:11.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.363 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-05-08T09:49:11.363 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.363 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.363 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-05-08T09:49:11.364 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.365 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.365 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.365 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.365 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.365 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.366 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.366 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.366 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.366 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.366 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.366 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.366 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.366 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.367 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.367 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.367 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.367 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.368 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.368 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.368 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.368 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.370 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.370 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.370 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.370 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.370 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.370 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.370 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.370 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.371 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.372 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.372 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.372 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.372 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.372 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.372 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-05-08T09:49:11.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-05-08T09:49:11.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.373 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.373 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.373 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.373 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.373 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.374 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.374 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.374 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-05-08T09:49:11.374 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-05-08T09:49:11.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.375 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-05-08T09:49:11.375 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.375 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.375 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.375 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.376 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-05-08T09:49:11.376 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-05-08T09:49:11.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.376 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.377 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.377 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.377 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.377 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-05-08T09:49:11.377 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-05-08T09:49:11.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.377 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.378 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.378 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.378 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.378 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-05-08T09:49:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-05-08T09:49:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-05-08T09:49:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.379 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-05-08T09:49:11.380 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-05-08T09:49:11.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.381 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.381 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.381 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.381 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.381 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.382 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.382 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-05-08T09:49:11.382 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-05-08T09:49:11.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.382 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-05-08T09:49:11.383 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-05-08T09:49:11.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.384 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.385 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-05-08T09:49:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-05-08T09:49:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.389 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.389 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.389 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.389 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.389 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.389 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.389 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-05-08T09:49:11.390 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-05-08T09:49:11.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.390 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.390 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.390 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.390 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.390 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.391 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.391 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.391 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.391 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-05-08T09:49:11.391 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-05-08T09:49:11.391 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.391 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.392 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.392 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.392 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.392 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.392 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.392 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.392 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.393 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.393 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.393 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smb", 2024-05-08T09:49:11.393 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.393 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.393 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.393 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.394 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.395 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.395 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.395 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.395 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.395 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.395 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.395 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.395 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.396 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.396 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.396 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.396 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.397 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.397 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.397 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.397 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.398 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.398 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.399 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.399 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.399 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.399 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.399 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.399 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.400 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.400 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.400 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.401 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.401 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.402 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.403 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.403 INFO:teuthology.orchestra.run.smithi070.stdout: "update_orchestration": { 2024-05-08T09:49:11.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "update_orchestration", 2024-05-08T09:49:11.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.403 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-08T09:49:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.405 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.405 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-05-08T09:49:11.405 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.405 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.405 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.405 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-05-08T09:49:11.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-05-08T09:49:11.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.406 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.406 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.406 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.406 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.406 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.407 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T09:49:11.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.407 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-05-08T09:49:11.407 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-05-08T09:49:11.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.407 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.408 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.408 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.408 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-05-08T09:49:11.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.409 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.409 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.409 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.410 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.410 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.410 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.410 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.410 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.410 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.410 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.411 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.411 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.411 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.412 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.412 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.413 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.413 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.413 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.414 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.414 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.414 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.414 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.414 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.414 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.414 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.414 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.414 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.415 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.415 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.415 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.415 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.416 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.418 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.418 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.418 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.418 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.418 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.418 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.420 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.420 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.420 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.420 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.420 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.420 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.421 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.421 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.421 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.421 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.421 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.422 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.423 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.423 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.423 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.423 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.424 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.424 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.424 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.425 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.425 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.425 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.425 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.425 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.425 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.425 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.426 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.426 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.427 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.428 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.429 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.429 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-05-08T09:49:11.430 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.430 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.430 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.430 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.431 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.431 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.431 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.431 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.431 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.431 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.432 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.432 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.432 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.432 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.432 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.433 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.434 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.434 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.435 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.436 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.436 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.436 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.436 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.436 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.436 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.436 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.436 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.438 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.439 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.439 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.439 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.439 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.439 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.439 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.439 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.439 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-05-08T09:49:11.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-05-08T09:49:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T09:49:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.442 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.442 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:11.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:11.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-05-08T09:49:11.443 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.443 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.443 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.444 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.445 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.446 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.446 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.446 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.446 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.448 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.448 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.448 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.449 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.449 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.449 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.449 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.450 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.450 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.451 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.451 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.451 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.451 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.451 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.452 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-05-08T09:49:11.453 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-05-08T09:49:11.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.454 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.454 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.454 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T09:49:11.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.455 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.455 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-05-08T09:49:11.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-05-08T09:49:11.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.456 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-05-08T09:49:11.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-05-08T09:49:11.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T09:49:11.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.458 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-05-08T09:49:11.458 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-05-08T09:49:11.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.459 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T09:49:11.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.461 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T09:49:11.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.461 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-05-08T09:49:11.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-05-08T09:49:11.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.462 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.462 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.462 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.463 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.463 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-05-08T09:49:11.463 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-05-08T09:49:11.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.464 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.464 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-05-08T09:49:11.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-05-08T09:49:11.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.465 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.465 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T09:49:11.465 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.465 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.465 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.465 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-05-08T09:49:11.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-05-08T09:49:11.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.466 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.467 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.468 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:11.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:11.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.468 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.468 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-05-08T09:49:11.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-05-08T09:49:11.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.469 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.469 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-05-08T09:49:11.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-05-08T09:49:11.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.470 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.470 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-05-08T09:49:11.470 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.470 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.470 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.471 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.471 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.471 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-05-08T09:49:11.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-05-08T09:49:11.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.473 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-05-08T09:49:11.473 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-05-08T09:49:11.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.473 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.473 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.474 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.475 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.475 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.475 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.475 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.477 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.477 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.477 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.477 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.477 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.478 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.478 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.478 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.479 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.480 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.480 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.480 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.480 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.481 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.482 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-05-08T09:49:11.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-05-08T09:49:11.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.482 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.484 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.484 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-05-08T09:49:11.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-05-08T09:49:11.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.484 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.485 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.485 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.486 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.486 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.486 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.487 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.488 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-05-08T09:49:11.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-05-08T09:49:11.488 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.488 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.488 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.488 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T09:49:11.488 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.488 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.489 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.489 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.490 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-05-08T09:49:11.490 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.490 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.490 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.490 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.491 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.491 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.491 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.492 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.492 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.492 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.492 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.492 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.493 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.493 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.494 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.494 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.494 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.494 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.494 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.495 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.496 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.496 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.496 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.496 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.496 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.496 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.496 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.496 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.497 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.498 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.498 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.498 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.498 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.498 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.499 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.499 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.499 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.500 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.500 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.500 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-05-08T09:49:11.501 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.501 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.501 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.501 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.501 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.502 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.502 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.502 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.502 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.502 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.502 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.502 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.503 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.503 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.503 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.503 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.503 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.504 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.504 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.505 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.505 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.506 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.506 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.506 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.506 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.506 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.507 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.507 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.507 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.507 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.507 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.507 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.507 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.507 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.508 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.508 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.508 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.508 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.509 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.509 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.509 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-05-08T09:49:11.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-05-08T09:49:11.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-05-08T09:49:11.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.511 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.511 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.511 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T09:49:11.511 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.511 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.511 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.511 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-05-08T09:49:11.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-05-08T09:49:11.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.512 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.512 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.512 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-05-08T09:49:11.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.513 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.513 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-05-08T09:49:11.513 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-05-08T09:49:11.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.513 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.514 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.514 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.514 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.514 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T09:49:11.514 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.514 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.515 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-05-08T09:49:11.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T09:49:11.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.515 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.515 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.515 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-05-08T09:49:11.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.516 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.516 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T09:49:11.516 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.516 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.516 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.516 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.517 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.518 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.518 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.518 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.518 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.518 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.518 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-05-08T09:49:11.518 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-05-08T09:49:11.519 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-05-08T09:49:11.519 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-05-08T09:49:11.519 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-05-08T09:49:11.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-05-08T09:49:11.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-05-08T09:49:11.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-05-08T09:49:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-05-08T09:49:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-05-08T09:49:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.521 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.522 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.522 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.522 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.522 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.522 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.522 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-05-08T09:49:11.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-05-08T09:49:11.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-05-08T09:49:11.523 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.523 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-05-08T09:49:11.523 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.523 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.523 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.523 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.524 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.524 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.524 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-05-08T09:49:11.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-05-08T09:49:11.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.524 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.525 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.525 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.525 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.525 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.525 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.525 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.526 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.526 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.526 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.526 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.526 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.526 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.526 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.526 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.527 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-05-08T09:49:11.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-05-08T09:49:11.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.528 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.528 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.528 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.528 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-05-08T09:49:11.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-05-08T09:49:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-05-08T09:49:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-05-08T09:49:11.530 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-05-08T09:49:11.530 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-05-08T09:49:11.530 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-05-08T09:49:11.530 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-05-08T09:49:11.530 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-05-08T09:49:11.530 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-05-08T09:49:11.530 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.530 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.531 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.531 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.531 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-05-08T09:49:11.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-05-08T09:49:11.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-05-08T09:49:11.531 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.532 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-05-08T09:49:11.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.532 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.532 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.532 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.533 INFO:teuthology.orchestra.run.smithi070.stdout: "sqlite3_killpoint": { 2024-05-08T09:49:11.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sqlite3_killpoint", 2024-05-08T09:49:11.533 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "dev", 2024-05-08T09:49:11.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-05-08T09:49:11.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-05-08T09:49:11.534 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.534 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.534 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.534 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.534 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.535 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-05-08T09:49:11.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-05-08T09:49:11.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.535 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.535 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-05-08T09:49:11.535 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.535 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.536 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.536 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-05-08T09:49:11.536 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-05-08T09:49:11.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-05-08T09:49:11.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-05-08T09:49:11.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.537 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.537 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.537 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.538 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.538 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.538 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-05-08T09:49:11.538 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-05-08T09:49:11.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-05-08T09:49:11.538 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-05-08T09:49:11.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-05-08T09:49:11.539 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T09:49:11.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-05-08T09:49:11.539 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-05-08T09:49:11.539 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-05-08T09:49:11.539 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-05-08T09:49:11.539 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-05-08T09:49:11.539 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-05-08T09:49:11.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-05-08T09:49:11.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.540 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.540 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.540 INFO:teuthology.orchestra.run.smithi070.stdout: "services": { 2024-05-08T09:49:11.540 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard": "https://172.21.15.70:8443/" 2024-05-08T09:49:11.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.541 INFO:teuthology.orchestra.run.smithi070.stdout: "always_on_modules": { 2024-05-08T09:49:11.541 INFO:teuthology.orchestra.run.smithi070.stdout: "octopus": [ 2024-05-08T09:49:11.541 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-05-08T09:49:11.541 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-05-08T09:49:11.541 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-05-08T09:49:11.541 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-05-08T09:49:11.541 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-05-08T09:49:11.541 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-05-08T09:49:11.541 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-05-08T09:49:11.542 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-05-08T09:49:11.542 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-05-08T09:49:11.542 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-05-08T09:49:11.542 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.542 INFO:teuthology.orchestra.run.smithi070.stdout: "pacific": [ 2024-05-08T09:49:11.542 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-05-08T09:49:11.542 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-05-08T09:49:11.542 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-05-08T09:49:11.543 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-05-08T09:49:11.543 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-05-08T09:49:11.543 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-05-08T09:49:11.543 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-05-08T09:49:11.543 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-05-08T09:49:11.543 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-05-08T09:49:11.543 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-05-08T09:49:11.543 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.543 INFO:teuthology.orchestra.run.smithi070.stdout: "quincy": [ 2024-05-08T09:49:11.544 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-05-08T09:49:11.544 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-05-08T09:49:11.544 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-05-08T09:49:11.544 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-05-08T09:49:11.544 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-05-08T09:49:11.544 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-05-08T09:49:11.544 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-05-08T09:49:11.544 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-05-08T09:49:11.545 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-05-08T09:49:11.545 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-05-08T09:49:11.545 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.545 INFO:teuthology.orchestra.run.smithi070.stdout: "reef": [ 2024-05-08T09:49:11.545 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-05-08T09:49:11.545 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-05-08T09:49:11.545 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-05-08T09:49:11.545 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-05-08T09:49:11.546 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-05-08T09:49:11.546 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-05-08T09:49:11.546 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-05-08T09:49:11.546 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-05-08T09:49:11.546 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-05-08T09:49:11.546 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-05-08T09:49:11.546 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-05-08T09:49:11.546 INFO:teuthology.orchestra.run.smithi070.stdout: "squid": [ 2024-05-08T09:49:11.547 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-05-08T09:49:11.547 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-05-08T09:49:11.547 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-05-08T09:49:11.547 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-05-08T09:49:11.547 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-05-08T09:49:11.547 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-05-08T09:49:11.547 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-05-08T09:49:11.547 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-05-08T09:49:11.548 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-05-08T09:49:11.548 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-05-08T09:49:11.548 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:11.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.548 INFO:teuthology.orchestra.run.smithi070.stdout: "last_failure_osd_epoch": 93, 2024-05-08T09:49:11.548 INFO:teuthology.orchestra.run.smithi070.stdout: "active_clients": [ 2024-05-08T09:49:11.548 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.549 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-05-08T09:49:11.549 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-05-08T09:49:11.549 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.549 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-05-08T09:49:11.549 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-05-08T09:49:11.549 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3251330705 2024-05-08T09:49:11.549 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.549 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:11.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.550 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "libcephsqlite", 2024-05-08T09:49:11.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-05-08T09:49:11.550 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-05-08T09:49:11.550 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-05-08T09:49:11.550 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3152694264 2024-05-08T09:49:11.551 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.551 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:11.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-05-08T09:49:11.551 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-05-08T09:49:11.551 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-05-08T09:49:11.551 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-05-08T09:49:11.552 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2471066878 2024-05-08T09:49:11.552 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.552 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:11.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.552 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-05-08T09:49:11.552 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-05-08T09:49:11.552 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-05-08T09:49:11.553 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-05-08T09:49:11.553 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2898668647 2024-05-08T09:49:11.553 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.553 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:11.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.553 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-05-08T09:49:11.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-05-08T09:49:11.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.554 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-05-08T09:49:11.554 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-05-08T09:49:11.554 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 864942170 2024-05-08T09:49:11.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.554 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:11.555 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:11.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-05-08T09:49:11.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-05-08T09:49:11.555 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-05-08T09:49:11.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-05-08T09:49:11.555 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-05-08T09:49:11.555 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4174596922 2024-05-08T09:49:11.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.556 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:11.556 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:11.556 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-05-08T09:49:11.556 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:49:11.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1975123952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-08T09:49:11.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:09 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/967524104' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T09:49:11.557 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:10 smithi194 ceph-mon[33679]: pgmap v5828: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 156 KiB/s wr, 35 op/s 2024-05-08T09:49:11.558 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1975123952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-08T09:49:11.558 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:09 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/967524104' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T09:49:11.558 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:10 smithi172 ceph-mon[33377]: pgmap v5828: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 156 KiB/s wr, 35 op/s 2024-05-08T09:49:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.206+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf400b2960 msgr2=0x7fcf400b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.206+0000 7fcf61200640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf400b2960 0x7fcf400b4e20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00baa0 tx=0x7fcf4c005d90 comp rx=0 tx=0).stop 2024-05-08T09:49:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.206+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c104280 msgr2=0x7fcf5c19b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:49:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.206+0000 7fcf61200640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c104280 0x7fcf5c19b4c0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800c970 tx=0x7fcf4800ce30 comp rx=0 tx=0).stop 2024-05-08T09:49:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.207+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 shutdown_connections 2024-05-08T09:49:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.207+0000 7fcf61200640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7fcf400b2960 0x7fcf400b4e20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.207+0000 7fcf61200640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf5c10cdd0 0x7fcf5c19f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.207+0000 7fcf61200640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf5c104280 0x7fcf5c19b4c0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.207+0000 7fcf61200640 1 --2- 172.21.15.70:0/967524104 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7fcf5c103960 0x7fcf5c19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:49:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.207+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 >> 172.21.15.70:0/967524104 conn(0x7fcf5c0fd160 msgr2=0x7fcf5c1014e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:49:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.207+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 shutdown_connections 2024-05-08T09:49:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:49:09.207+0000 7fcf61200640 1 -- 172.21.15.70:0/967524104 wait complete. 2024-05-08T09:49:11.569 DEBUG:tasks.check_counter:Getting stats from a 2024-05-08T09:49:11.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-08T09:49:11.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1975123952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-08T09:49:11.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:09 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/967524104' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T09:49:11.570 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:10 smithi070 ceph-mon[29591]: pgmap v5828: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 156 KiB/s wr, 35 op/s 2024-05-08T09:49:12.018 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:49:12.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:12 smithi070 ceph-mon[29591]: pgmap v5829: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-05-08T09:49:12.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:12 smithi172 ceph-mon[33377]: pgmap v5829: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-05-08T09:49:13.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:12 smithi194 ceph-mon[33679]: pgmap v5829: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-05-08T09:49:14.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:14 smithi070 ceph-mon[29591]: pgmap v5830: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-05-08T09:49:14.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:14 smithi172 ceph-mon[33377]: pgmap v5830: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-05-08T09:49:15.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:14 smithi194 ceph-mon[33679]: pgmap v5830: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 61 KiB/s wr, 27 op/s 2024-05-08T09:49:15.014 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:49:15.014 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:49:15.014 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-05-08T09:49:15.014 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-05-08T09:49:15.014 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-05-08T09:49:15.015 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-05-08T09:49:15.015 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-05-08T09:49:15.015 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-05-08T09:49:15.015 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.004404102, 2024-05-08T09:49:15.015 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T09:49:15.015 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000937643, 2024-05-08T09:49:15.015 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:49:15.016 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:15.016 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:15.016 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:15.016 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:15.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.016 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:15.016 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:15.016 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:15.016 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:15.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.017 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T09:49:15.017 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T09:49:15.017 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.017 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:49:15.017 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 18, 2024-05-08T09:49:15.017 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2280, 2024-05-08T09:49:15.017 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 5200, 2024-05-08T09:49:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1504944, 2024-05-08T09:49:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 17, 2024-05-08T09:49:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-05-08T09:49:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.363712499, 2024-05-08T09:49:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.298746731, 2024-05-08T09:49:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.019335669, 2024-05-08T09:49:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:49:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:15.018 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2278, 2024-05-08T09:49:15.019 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.267649648, 2024-05-08T09:49:15.019 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000117493 2024-05-08T09:49:15.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.019 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:15.019 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:15.019 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:15.019 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:15.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.019 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 5200, 2024-05-08T09:49:15.020 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 1504944 2024-05-08T09:49:15.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.020 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:49:15.020 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 2974, 2024-05-08T09:49:15.020 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2964, 2024-05-08T09:49:15.020 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2354608, 2024-05-08T09:49:15.020 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1845936, 2024-05-08T09:49:15.020 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-05-08T09:49:15.020 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-05-08T09:49:15.021 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.872464538, 2024-05-08T09:49:15.021 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.426093888, 2024-05-08T09:49:15.021 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.253580113, 2024-05-08T09:49:15.021 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.127813391, 2024-05-08T09:49:15.021 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:15.021 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2963, 2024-05-08T09:49:15.021 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.264228038, 2024-05-08T09:49:15.021 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000089175 2024-05-08T09:49:15.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.022 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:15.022 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:15.022 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:15.022 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:15.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.022 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2354608, 2024-05-08T09:49:15.022 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 1845936 2024-05-08T09:49:15.022 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.023 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-05-08T09:49:15.023 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-05-08T09:49:15.023 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-05-08T09:49:15.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.023 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-05-08T09:49:15.023 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:49:15.023 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-05-08T09:49:15.023 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:49:15.023 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:49:15.024 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:49:15.024 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:49:15.024 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:49:15.024 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:49:15.024 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:49:15.024 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:49:15.024 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:49:15.024 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:49:15.024 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:49:15.025 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:49:15.025 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:49:15.025 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-05-08T09:49:15.025 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:49:15.025 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-05-08T09:49:15.025 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:49:15.025 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:49:15.025 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:49:15.025 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:49:15.026 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:49:15.026 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:49:15.026 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:49:15.026 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-05-08T09:49:15.026 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:49:15.026 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:49:15.026 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:49:15.026 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-05-08T09:49:15.027 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-05-08T09:49:15.027 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-05-08T09:49:15.027 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:49:15.027 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:49:15.027 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:49:15.027 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:49:15.027 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148754, 2024-05-08T09:49:15.027 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 31, 2024-05-08T09:49:15.027 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:49:15.028 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-05-08T09:49:15.028 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-05-08T09:49:15.028 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-05-08T09:49:15.028 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:49:15.028 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-05-08T09:49:15.028 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:49:15.028 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-05-08T09:49:15.028 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-05-08T09:49:15.028 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-05-08T09:49:15.029 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:49:15.029 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:49:15.029 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-05-08T09:49:15.029 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-05-08T09:49:15.029 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-05-08T09:49:15.029 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-05-08T09:49:15.029 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-05-08T09:49:15.029 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-05-08T09:49:15.030 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-05-08T09:49:15.030 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-05-08T09:49:15.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:15.030 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:49:15.030 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-05-08T09:49:15.030 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-05-08T09:49:15.030 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-05-08T09:49:15.030 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 2988, 2024-05-08T09:49:15.030 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1933743, 2024-05-08T09:49:15.031 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:15.031 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 2988, 2024-05-08T09:49:15.031 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-05-08T09:49:15.031 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-05-08T09:49:15.031 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2988, 2024-05-08T09:49:15.031 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1933743, 2024-05-08T09:49:15.031 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-05-08T09:49:15.031 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:15.031 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:15.032 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:15.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:15.032 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:15.032 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:49:16.025 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-05-08T09:49:16.025 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-05-08T09:49:16.025 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-05-08T09:49:16.025 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-05-08T09:49:16.025 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-05-08T09:49:16.025 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-05-08T09:49:16.026 DEBUG:tasks.check_counter:Getting stats from d 2024-05-08T09:49:16.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-08T09:49:16.665 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:49:16.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:16 smithi172 ceph-mon[33377]: pgmap v5831: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 62 KiB/s wr, 29 op/s 2024-05-08T09:49:16.930 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:16 smithi172 ceph-mon[33377]: osdmap e443: 12 total, 12 up, 12 in 2024-05-08T09:49:17.002 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:16 smithi070 ceph-mon[29591]: pgmap v5831: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 62 KiB/s wr, 29 op/s 2024-05-08T09:49:17.003 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:16 smithi070 ceph-mon[29591]: osdmap e443: 12 total, 12 up, 12 in 2024-05-08T09:49:17.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:16 smithi194 ceph-mon[33679]: pgmap v5831: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 62 KiB/s wr, 29 op/s 2024-05-08T09:49:17.012 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:16 smithi194 ceph-mon[33679]: osdmap e443: 12 total, 12 up, 12 in 2024-05-08T09:49:18.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:18 smithi070 ceph-mon[29591]: pgmap v5833: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 30 op/s 2024-05-08T09:49:19.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:18 smithi194 ceph-mon[33679]: pgmap v5833: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 30 op/s 2024-05-08T09:49:19.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:18 smithi172 ceph-mon[33377]: pgmap v5833: 129 pgs: 129 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 55 KiB/s wr, 30 op/s 2024-05-08T09:49:20.876 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:49:20.876 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:49:20.876 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-05-08T09:49:20.876 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-05-08T09:49:20.876 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-05-08T09:49:20.876 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-05-08T09:49:20.877 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-05-08T09:49:20.877 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-05-08T09:49:20.877 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.003898917, 2024-05-08T09:49:20.877 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T09:49:20.877 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000614591, 2024-05-08T09:49:20.877 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:49:20.877 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:20.877 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:20.878 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:20.878 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:20.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.878 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:20.878 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:20.878 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:20.878 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:20.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.879 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T09:49:20.879 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T09:49:20.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.879 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:49:20.879 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 13, 2024-05-08T09:49:20.879 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2284, 2024-05-08T09:49:20.879 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2080, 2024-05-08T09:49:20.879 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1426688, 2024-05-08T09:49:20.880 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 16, 2024-05-08T09:49:20.880 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-05-08T09:49:20.880 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.378732155, 2024-05-08T09:49:20.880 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.315095119, 2024-05-08T09:49:20.880 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.017197029, 2024-05-08T09:49:20.880 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:49:20.880 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:20.880 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2281, 2024-05-08T09:49:20.881 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.250318236, 2024-05-08T09:49:20.881 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000109740 2024-05-08T09:49:20.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.881 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:20.881 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:20.881 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:20.881 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:20.881 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.882 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2080, 2024-05-08T09:49:20.882 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 1426688 2024-05-08T09:49:20.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.882 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:49:20.882 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 2988, 2024-05-08T09:49:20.882 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2976, 2024-05-08T09:49:20.882 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2360912, 2024-05-08T09:49:20.882 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1852480, 2024-05-08T09:49:20.882 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-05-08T09:49:20.883 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-05-08T09:49:20.883 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.889541155, 2024-05-08T09:49:20.883 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.429700100, 2024-05-08T09:49:20.883 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.262836559, 2024-05-08T09:49:20.883 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.133177432, 2024-05-08T09:49:20.883 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:20.883 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2976, 2024-05-08T09:49:20.883 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.264107128, 2024-05-08T09:49:20.883 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000088745 2024-05-08T09:49:20.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.884 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:20.884 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:20.884 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:20.884 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:20.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.884 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2360912, 2024-05-08T09:49:20.884 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 1852480 2024-05-08T09:49:20.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.885 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-05-08T09:49:20.885 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-05-08T09:49:20.885 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-05-08T09:49:20.885 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.885 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-05-08T09:49:20.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:49:20.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-05-08T09:49:20.885 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:49:20.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:49:20.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:49:20.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:49:20.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:49:20.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:49:20.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:49:20.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:49:20.886 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:49:20.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:49:20.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:49:20.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:49:20.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:49:20.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-05-08T09:49:20.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:49:20.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-05-08T09:49:20.887 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:49:20.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:49:20.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:49:20.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:49:20.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:49:20.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:49:20.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:49:20.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-05-08T09:49:20.888 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:49:20.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:49:20.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:49:20.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-05-08T09:49:20.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-05-08T09:49:20.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-05-08T09:49:20.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:49:20.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:49:20.889 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:49:20.890 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:49:20.890 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 147970, 2024-05-08T09:49:20.890 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 29, 2024-05-08T09:49:20.890 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:49:20.890 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-05-08T09:49:20.890 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-05-08T09:49:20.890 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-05-08T09:49:20.890 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:49:20.890 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-05-08T09:49:20.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:49:20.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-05-08T09:49:20.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-05-08T09:49:20.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-05-08T09:49:20.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:49:20.891 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:49:20.891 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-05-08T09:49:20.891 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-05-08T09:49:20.891 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-05-08T09:49:20.892 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-05-08T09:49:20.892 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-05-08T09:49:20.892 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-05-08T09:49:20.892 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-05-08T09:49:20.892 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-05-08T09:49:20.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:20.892 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:49:20.892 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-05-08T09:49:20.893 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-05-08T09:49:20.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-05-08T09:49:20.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 2997, 2024-05-08T09:49:20.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1935653, 2024-05-08T09:49:20.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:20.893 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 2997, 2024-05-08T09:49:20.893 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-05-08T09:49:20.893 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-05-08T09:49:20.894 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2997, 2024-05-08T09:49:20.894 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1935653, 2024-05-08T09:49:20.894 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-05-08T09:49:20.894 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:20.894 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:20.894 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:20.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:20.894 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:20.894 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:49:20.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:20 smithi070 ceph-mon[29591]: pgmap v5834: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:49:21.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:20 smithi194 ceph-mon[33679]: pgmap v5834: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:49:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:20 smithi172 ceph-mon[33377]: pgmap v5834: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:49:22.429 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-08T09:49:22.429 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-08T09:49:22.429 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-05-08T09:49:22.429 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-05-08T09:49:22.429 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-05-08T09:49:22.429 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-05-08T09:49:22.430 DEBUG:tasks.check_counter:Getting stats from g 2024-05-08T09:49:22.430 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-08T09:49:23.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:22 smithi194 ceph-mon[33679]: pgmap v5835: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:49:23.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:22 smithi070 ceph-mon[29591]: pgmap v5835: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:49:23.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:22 smithi172 ceph-mon[33377]: pgmap v5835: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:49:23.272 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:49:25.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:24 smithi194 ceph-mon[33679]: pgmap v5836: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:49:25.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:24 smithi070 ceph-mon[29591]: pgmap v5836: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:49:25.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:24 smithi172 ceph-mon[33377]: pgmap v5836: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 818 B/s wr, 6 op/s 2024-05-08T09:49:27.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:26 smithi194 ceph-mon[33679]: pgmap v5837: 129 pgs: 21 active+clean+snaptrim, 66 active+clean+snaptrim_wait, 42 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:49:27.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:26 smithi070 ceph-mon[29591]: pgmap v5837: 129 pgs: 21 active+clean+snaptrim, 66 active+clean+snaptrim_wait, 42 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:49:27.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:26 smithi172 ceph-mon[33377]: pgmap v5837: 129 pgs: 21 active+clean+snaptrim, 66 active+clean+snaptrim_wait, 42 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-08T09:49:28.810 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:28 smithi070 ceph-mon[29591]: pgmap v5838: 129 pgs: 21 active+clean+snaptrim, 66 active+clean+snaptrim_wait, 42 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 259 B/s wr, 5 op/s 2024-05-08T09:49:28.812 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:49:28.812 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:49:28.812 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 4, 2024-05-08T09:49:28.812 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 4, 2024-05-08T09:49:28.813 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2960, 2024-05-08T09:49:28.813 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 448, 2024-05-08T09:49:28.813 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-05-08T09:49:28.813 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-05-08T09:49:28.813 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.004662440, 2024-05-08T09:49:28.813 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000078436, 2024-05-08T09:49:28.813 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.001153010, 2024-05-08T09:49:28.814 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:49:28.814 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:28.814 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3, 2024-05-08T09:49:28.814 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.001611508, 2024-05-08T09:49:28.814 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000537169 2024-05-08T09:49:28.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.814 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:28.815 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:28.815 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:28.815 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:28.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.815 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-05-08T09:49:28.815 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T09:49:28.815 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.815 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:49:28.815 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 14, 2024-05-08T09:49:28.816 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2282, 2024-05-08T09:49:28.816 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2240, 2024-05-08T09:49:28.816 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1505200, 2024-05-08T09:49:28.816 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 17, 2024-05-08T09:49:28.816 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-05-08T09:49:28.816 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.376022072, 2024-05-08T09:49:28.816 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.311214165, 2024-05-08T09:49:28.816 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.018238456, 2024-05-08T09:49:28.817 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:49:28.817 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:28.817 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2279, 2024-05-08T09:49:28.817 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.257753471, 2024-05-08T09:49:28.817 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000113099 2024-05-08T09:49:28.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.817 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:28.817 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:28.817 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:28.818 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:28.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.818 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2240, 2024-05-08T09:49:28.818 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 1505200 2024-05-08T09:49:28.818 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.818 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:49:28.818 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 2979, 2024-05-08T09:49:28.818 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2969, 2024-05-08T09:49:28.819 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2355968, 2024-05-08T09:49:28.819 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1849136, 2024-05-08T09:49:28.819 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-05-08T09:49:28.819 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-05-08T09:49:28.819 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.877261676, 2024-05-08T09:49:28.819 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.430414583, 2024-05-08T09:49:28.819 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.242857996, 2024-05-08T09:49:28.819 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.132731580, 2024-05-08T09:49:28.820 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:28.820 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2968, 2024-05-08T09:49:28.820 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.265500512, 2024-05-08T09:49:28.820 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000089454 2024-05-08T09:49:28.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.820 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:28.820 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:28.820 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:28.820 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:28.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.821 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2355968, 2024-05-08T09:49:28.821 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 1849136 2024-05-08T09:49:28.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.821 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-05-08T09:49:28.821 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-05-08T09:49:28.821 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-05-08T09:49:28.821 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.822 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-05-08T09:49:28.822 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:49:28.822 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-05-08T09:49:28.822 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:49:28.822 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:49:28.822 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:49:28.822 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:49:28.822 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:49:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:49:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:49:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:49:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:49:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:49:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:49:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:49:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:49:28.823 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-05-08T09:49:28.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:49:28.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-05-08T09:49:28.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:49:28.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:49:28.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:49:28.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:49:28.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:49:28.824 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:49:28.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:49:28.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-05-08T09:49:28.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:49:28.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:49:28.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:49:28.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-05-08T09:49:28.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-05-08T09:49:28.825 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-05-08T09:49:28.826 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:49:28.826 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:49:28.826 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:49:28.826 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:49:28.826 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148714, 2024-05-08T09:49:28.826 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 30, 2024-05-08T09:49:28.826 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:49:28.826 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-05-08T09:49:28.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-05-08T09:49:28.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-05-08T09:49:28.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:49:28.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-05-08T09:49:28.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:49:28.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-05-08T09:49:28.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-05-08T09:49:28.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-05-08T09:49:28.827 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:49:28.828 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:49:28.828 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-05-08T09:49:28.828 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-05-08T09:49:28.828 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-05-08T09:49:28.828 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-05-08T09:49:28.828 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-05-08T09:49:28.828 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-05-08T09:49:28.828 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-05-08T09:49:28.828 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-05-08T09:49:28.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:28.829 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:49:28.829 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-05-08T09:49:28.829 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-05-08T09:49:28.829 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-05-08T09:49:28.829 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 2993, 2024-05-08T09:49:28.829 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1934393, 2024-05-08T09:49:28.829 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:28.829 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 2993, 2024-05-08T09:49:28.830 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-05-08T09:49:28.830 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-05-08T09:49:28.830 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 2993, 2024-05-08T09:49:28.830 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1934393, 2024-05-08T09:49:28.830 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-05-08T09:49:28.830 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:28.830 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:28.830 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:28.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:28.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:28.831 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:49:29.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:28 smithi194 ceph-mon[33679]: pgmap v5838: 129 pgs: 21 active+clean+snaptrim, 66 active+clean+snaptrim_wait, 42 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 259 B/s wr, 5 op/s 2024-05-08T09:49:29.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:28 smithi172 ceph-mon[33377]: pgmap v5838: 129 pgs: 21 active+clean+snaptrim, 66 active+clean+snaptrim_wait, 42 active+clean; 2.6 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 259 B/s wr, 5 op/s 2024-05-08T09:49:30.180 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-05-08T09:49:30.181 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-05-08T09:49:30.181 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-05-08T09:49:30.181 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-05-08T09:49:30.181 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-05-08T09:49:30.181 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-05-08T09:49:30.181 DEBUG:tasks.check_counter:Getting stats from j 2024-05-08T09:49:30.181 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-08T09:49:30.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:30 smithi070 ceph-mon[29591]: pgmap v5839: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-08T09:49:31.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:30 smithi194 ceph-mon[33679]: pgmap v5839: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-08T09:49:31.020 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:49:31.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:30 smithi172 ceph-mon[33377]: pgmap v5839: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-05-08T09:49:33.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:32 smithi194 ceph-mon[33679]: pgmap v5840: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:49:33.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:32 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:49:33.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:32 smithi070 ceph-mon[29591]: pgmap v5840: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:49:33.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:32 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:49:33.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:32 smithi172 ceph-mon[33377]: pgmap v5840: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:49:33.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:32 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:49:34.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:34 smithi070 ceph-mon[29591]: pgmap v5841: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:49:34.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:34.880 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:34 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:34 smithi194 ceph-mon[33679]: pgmap v5841: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:49:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:35.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:34 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:35.171 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-05-08T09:49:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:49:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-05-08T09:49:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-05-08T09:49:35.171 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-05-08T09:49:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-05-08T09:49:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-05-08T09:49:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-05-08T09:49:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.003826586, 2024-05-08T09:49:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T09:49:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000449007, 2024-05-08T09:49:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:49:35.172 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.173 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T09:49:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T09:49:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:49:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 18, 2024-05-08T09:49:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2291, 2024-05-08T09:49:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 5200, 2024-05-08T09:49:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1506880, 2024-05-08T09:49:35.174 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 17, 2024-05-08T09:49:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-05-08T09:49:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.372174257, 2024-05-08T09:49:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.308608040, 2024-05-08T09:49:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.017513854, 2024-05-08T09:49:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:49:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2289, 2024-05-08T09:49:35.175 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.250471018, 2024-05-08T09:49:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000109423 2024-05-08T09:49:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 5200, 2024-05-08T09:49:35.176 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 1506880 2024-05-08T09:49:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:49:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 2989, 2024-05-08T09:49:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2979, 2024-05-08T09:49:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 2359312, 2024-05-08T09:49:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 1855232, 2024-05-08T09:49:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-05-08T09:49:35.177 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-05-08T09:49:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.888522004, 2024-05-08T09:49:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.425977946, 2024-05-08T09:49:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.268922486, 2024-05-08T09:49:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.133748812, 2024-05-08T09:49:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 2978, 2024-05-08T09:49:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.262907685, 2024-05-08T09:49:35.178 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000088283 2024-05-08T09:49:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 2359312, 2024-05-08T09:49:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 1855232 2024-05-08T09:49:35.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-05-08T09:49:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-05-08T09:49:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-05-08T09:49:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-05-08T09:49:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:49:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-05-08T09:49:35.180 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:49:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:49:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:49:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:49:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:49:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:49:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:49:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:49:35.181 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:49:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:49:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:49:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:49:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:49:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-05-08T09:49:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:49:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-05-08T09:49:35.182 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:49:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:49:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:49:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:49:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:49:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:49:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:49:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-05-08T09:49:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:49:35.183 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:49:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:49:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-05-08T09:49:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-05-08T09:49:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-05-08T09:49:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:49:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:49:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:49:35.184 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:49:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148714, 2024-05-08T09:49:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 30, 2024-05-08T09:49:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:49:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-05-08T09:49:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-05-08T09:49:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-05-08T09:49:35.185 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:49:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-05-08T09:49:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:49:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-05-08T09:49:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-05-08T09:49:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-05-08T09:49:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:49:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:49:35.186 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-05-08T09:49:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-05-08T09:49:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-05-08T09:49:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-05-08T09:49:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-05-08T09:49:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-05-08T09:49:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-05-08T09:49:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-05-08T09:49:35.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-05-08T09:49:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:49:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-05-08T09:49:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-05-08T09:49:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-05-08T09:49:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 3003, 2024-05-08T09:49:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1936330, 2024-05-08T09:49:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:35.188 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 3003, 2024-05-08T09:49:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-05-08T09:49:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-05-08T09:49:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 3003, 2024-05-08T09:49:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1936330, 2024-05-08T09:49:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-05-08T09:49:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-05-08T09:49:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-05-08T09:49:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-05-08T09:49:35.189 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:35.190 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-05-08T09:49:35.190 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-05-08T09:49:35.190 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:34 smithi172 ceph-mon[33377]: pgmap v5841: 129 pgs: 16 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 59 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:49:35.190 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:35.190 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:34 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:36.890 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-08T09:49:36.891 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-08T09:49:36.891 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-05-08T09:49:36.891 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-05-08T09:49:36.891 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-05-08T09:49:36.891 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-05-08T09:49:36.891 DEBUG:tasks.check_counter:Getting stats from b 2024-05-08T09:49:36.892 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-08T09:49:37.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:36 smithi194 ceph-mon[33679]: pgmap v5842: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:49:37.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:37.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:37.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:49:37.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:49:37.011 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:37.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:36 smithi172 ceph-mon[33377]: pgmap v5842: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:49:37.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:37.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:37.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:49:37.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:49:37.095 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:36 smithi070 ceph-mon[29591]: pgmap v5842: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:49:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:49:37.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:49:37.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:49:37.530 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T09:49:38.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:38 smithi172 ceph-mon[33377]: pgmap v5843: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:49:39.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:38 smithi194 ceph-mon[33679]: pgmap v5843: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:49:39.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:38 smithi070 ceph-mon[29591]: pgmap v5843: 129 pgs: 13 active+clean+snaptrim, 40 active+clean+snaptrim_wait, 76 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:49:40.928 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:40 smithi172 ceph-mon[33377]: pgmap v5844: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:49:40.999 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-08T09:49:41.000 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:49:41.000 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 76081, 2024-05-08T09:49:41.000 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 66843, 2024-05-08T09:49:41.000 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 26535802, 2024-05-08T09:49:41.000 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 954885694, 2024-05-08T09:49:41.001 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 228, 2024-05-08T09:49:41.001 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-05-08T09:49:41.001 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 36.149624622, 2024-05-08T09:49:41.001 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 6.148617842, 2024-05-08T09:49:41.001 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 3.612516376, 2024-05-08T09:49:41.001 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 24.996053478, 2024-05-08T09:49:41.001 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:41.001 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 66839, 2024-05-08T09:49:41.002 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 70.101618124, 2024-05-08T09:49:41.002 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001048813 2024-05-08T09:49:41.002 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.002 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:41.002 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 18315, 2024-05-08T09:49:41.002 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.005946642, 2024-05-08T09:49:41.003 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000324 2024-05-08T09:49:41.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.003 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 9060368, 2024-05-08T09:49:41.003 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 6728120 2024-05-08T09:49:41.003 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.004 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:49:41.004 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 10677361, 2024-05-08T09:49:41.004 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 4077022, 2024-05-08T09:49:41.004 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 3551436195, 2024-05-08T09:49:41.004 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 1878891612, 2024-05-08T09:49:41.004 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 206, 2024-05-08T09:49:41.004 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-05-08T09:49:41.004 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 1006.296381189, 2024-05-08T09:49:41.005 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 439.476066158, 2024-05-08T09:49:41.005 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 848.291155744, 2024-05-08T09:49:41.005 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 35.809242024, 2024-05-08T09:49:41.005 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:41.005 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4077023, 2024-05-08T09:49:41.005 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 305.857208727, 2024-05-08T09:49:41.006 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000075019 2024-05-08T09:49:41.006 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.006 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:41.006 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 13794682, 2024-05-08T09:49:41.006 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 4.835584758, 2024-05-08T09:49:41.006 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000350 2024-05-08T09:49:41.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.007 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 640, 2024-05-08T09:49:41.007 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 2288144 2024-05-08T09:49:41.007 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.007 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:49:41.007 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 267231, 2024-05-08T09:49:41.007 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 296734, 2024-05-08T09:49:41.007 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 75702472, 2024-05-08T09:49:41.008 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 1430830006, 2024-05-08T09:49:41.008 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 14, 2024-05-08T09:49:41.008 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 8, 2024-05-08T09:49:41.008 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 64.255839911, 2024-05-08T09:49:41.008 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 27.545958816, 2024-05-08T09:49:41.008 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 22.285339928, 2024-05-08T09:49:41.008 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 17.597763610, 2024-05-08T09:49:41.009 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:41.009 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 296732, 2024-05-08T09:49:41.009 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 148.379406876, 2024-05-08T09:49:41.009 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000500045 2024-05-08T09:49:41.009 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.009 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:41.009 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 348114, 2024-05-08T09:49:41.009 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.144638907, 2024-05-08T09:49:41.010 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000415 2024-05-08T09:49:41.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.010 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 42960, 2024-05-08T09:49:41.010 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 2816 2024-05-08T09:49:41.010 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.010 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-08T09:49:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-08T09:49:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-08T09:49:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-08T09:49:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-08T09:49:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-08T09:49:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 45359, 2024-05-08T09:49:41.011 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 651.529408907, 2024-05-08T09:49:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.014363839 2024-05-08T09:49:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-08T09:49:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-08T09:49:41.012 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-08T09:49:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 29955, 2024-05-08T09:49:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 33.072565201, 2024-05-08T09:49:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001104074 2024-05-08T09:49:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.013 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-08T09:49:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 3196231, 2024-05-08T09:49:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 3174372, 2024-05-08T09:49:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-08T09:49:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3174372, 2024-05-08T09:49:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 23614.598779817, 2024-05-08T09:49:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.007439140 2024-05-08T09:49:41.014 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-08T09:49:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 21859, 2024-05-08T09:49:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 10, 2024-05-08T09:49:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-08T09:49:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 7923, 2024-05-08T09:49:41.015 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 163, 2024-05-08T09:49:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-08T09:49:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 108056, 2024-05-08T09:49:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 8169, 2024-05-08T09:49:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 99614, 2024-05-08T09:49:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 273, 2024-05-08T09:49:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 96385, 2024-05-08T09:49:41.016 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 9579, 2024-05-08T09:49:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 73013, 2024-05-08T09:49:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 73014, 2024-05-08T09:49:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 556, 2024-05-08T09:49:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 6260345, 2024-05-08T09:49:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 375341, 2024-05-08T09:49:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 21140, 2024-05-08T09:49:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 5, 2024-05-08T09:49:41.017 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 1, 2024-05-08T09:49:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-08T09:49:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 8, 2024-05-08T09:49:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-08T09:49:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-08T09:49:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 430, 2024-05-08T09:49:41.018 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 9572, 2024-05-08T09:49:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 97, 2024-05-08T09:49:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 4227, 2024-05-08T09:49:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-08T09:49:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-08T09:49:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-08T09:49:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 80484, 2024-05-08T09:49:41.019 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 1787463338, 2024-05-08T09:49:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 9, 2024-05-08T09:49:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T09:49:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-08T09:49:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T09:49:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-08T09:49:41.020 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-08T09:49:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T09:49:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T09:49:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-08T09:49:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 2, 2024-05-08T09:49:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 283964, 2024-05-08T09:49:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 106226, 2024-05-08T09:49:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 209, 2024-05-08T09:49:41.021 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T09:49:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T09:49:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 7236652, 2024-05-08T09:49:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 100575, 2024-05-08T09:49:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 1433, 2024-05-08T09:49:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 120148 2024-05-08T09:49:41.022 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-08T09:49:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-08T09:49:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-08T09:49:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-08T09:49:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 5, 2024-05-08T09:49:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 438, 2024-05-08T09:49:41.023 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 427, 2024-05-08T09:49:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-08T09:49:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-08T09:49:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 12562, 2024-05-08T09:49:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 12135, 2024-05-08T09:49:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-08T09:49:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-08T09:49:41.024 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-08T09:49:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-08T09:49:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-08T09:49:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-08T09:49:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-08T09:49:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 100, 2024-05-08T09:49:41.025 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 6775871, 2024-05-08T09:49:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T09:49:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 436, 2024-05-08T09:49:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-08T09:49:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 165, 2024-05-08T09:49:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-08T09:49:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-08T09:49:41.026 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-08T09:49:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 1005, 2024-05-08T09:49:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 742160, 2024-05-08T09:49:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 712143, 2024-05-08T09:49:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 700531, 2024-05-08T09:49:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 41629, 2024-05-08T09:49:41.027 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-08T09:49:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 11612, 2024-05-08T09:49:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 1052, 2024-05-08T09:49:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 924, 2024-05-08T09:49:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 910, 2024-05-08T09:49:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 142, 2024-05-08T09:49:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 4, 2024-05-08T09:49:41.028 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-08T09:49:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 14, 2024-05-08T09:49:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 2719374860, 2024-05-08T09:49:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 3244706228, 2024-05-08T09:49:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-05-08T09:49:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-08T09:49:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 22995, 2024-05-08T09:49:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1492.711301050, 2024-05-08T09:49:41.029 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.064914603 2024-05-08T09:49:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-05-08T09:49:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-08T09:49:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 91644, 2024-05-08T09:49:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 113340, 2024-05-08T09:49:41.030 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 21696, 2024-05-08T09:49:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 6090, 2024-05-08T09:49:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 6720, 2024-05-08T09:49:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 630, 2024-05-08T09:49:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 108056, 2024-05-08T09:49:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 136476, 2024-05-08T09:49:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 28420, 2024-05-08T09:49:41.031 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 73014, 2024-05-08T09:49:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 94903, 2024-05-08T09:49:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 21889, 2024-05-08T09:49:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 571092, 2024-05-08T09:49:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 231800 2024-05-08T09:49:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.032 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-08T09:49:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 3213382, 2024-05-08T09:49:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 65910, 2024-05-08T09:49:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 3196231, 2024-05-08T09:49:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 675, 2024-05-08T09:49:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 142478, 2024-05-08T09:49:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-08T09:49:41.033 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 89444, 2024-05-08T09:49:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 10110.688191558, 2024-05-08T09:49:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.113039311 2024-05-08T09:49:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-08T09:49:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 17686, 2024-05-08T09:49:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 84.341577848, 2024-05-08T09:49:41.034 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004768832 2024-05-08T09:49:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-08T09:49:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.035 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-08T09:49:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-08T09:49:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3040767, 2024-05-08T09:49:41.036 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 12326.535677828, 2024-05-08T09:49:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004053758 2024-05-08T09:49:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-08T09:49:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.037 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-08T09:49:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-08T09:49:41.038 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-08T09:49:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.039 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.040 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-08T09:49:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.041 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-08T09:49:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 183, 2024-05-08T09:49:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.218111797, 2024-05-08T09:49:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006656348 2024-05-08T09:49:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-08T09:49:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 5272, 2024-05-08T09:49:41.042 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 74.871574667, 2024-05-08T09:49:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.014201740 2024-05-08T09:49:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-08T09:49:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.043 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-08T09:49:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 183, 2024-05-08T09:49:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 245.312243785, 2024-05-08T09:49:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 1.340504064 2024-05-08T09:49:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-08T09:49:41.044 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 974, 2024-05-08T09:49:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 230.174634974, 2024-05-08T09:49:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.236318927 2024-05-08T09:49:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-08T09:49:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6942, 2024-05-08T09:49:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 29.615788899, 2024-05-08T09:49:41.045 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004266175 2024-05-08T09:49:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-08T09:49:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 15, 2024-05-08T09:49:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.075139164, 2024-05-08T09:49:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.005009277 2024-05-08T09:49:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.046 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-08T09:49:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-08T09:49:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.047 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-08T09:49:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 559, 2024-05-08T09:49:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 24.005793509, 2024-05-08T09:49:41.048 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.042944174 2024-05-08T09:49:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-08T09:49:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 174, 2024-05-08T09:49:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 71.582461627, 2024-05-08T09:49:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.411393457 2024-05-08T09:49:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.049 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-08T09:49:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.050 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-08T09:49:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 99, 2024-05-08T09:49:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.257413916, 2024-05-08T09:49:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002600140 2024-05-08T09:49:41.051 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-08T09:49:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.052 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-08T09:49:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.053 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-08T09:49:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.054 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-08T09:49:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 9, 2024-05-08T09:49:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.061512037, 2024-05-08T09:49:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006834670 2024-05-08T09:49:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-08T09:49:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 62, 2024-05-08T09:49:41.055 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.535144476, 2024-05-08T09:49:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.008631362 2024-05-08T09:49:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-08T09:49:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 12003, 2024-05-08T09:49:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 415.323513732, 2024-05-08T09:49:41.056 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.034601642 2024-05-08T09:49:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-08T09:49:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-08T09:49:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-08T09:49:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.057 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-08T09:49:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-05-08T09:49:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 7, 2024-05-08T09:49:41.058 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 5, 2024-05-08T09:49:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-05-08T09:49:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-08T09:49:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 3931, 2024-05-08T09:49:41.059 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 1965, 2024-05-08T09:49:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 10975, 2024-05-08T09:49:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-08T09:49:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-08T09:49:41.060 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 360, 2024-05-08T09:49:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 360, 2024-05-08T09:49:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:49:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:49:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:49:41.061 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:49:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:49:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:49:41.062 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:49:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:49:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:49:41.065 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:49:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:49:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:49:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:49:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-08T09:49:41.066 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:49:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-08T09:49:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:49:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:49:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:49:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:49:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:49:41.067 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:49:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:49:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-08T09:49:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:49:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:49:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:49:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-08T09:49:41.068 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-08T09:49:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-08T09:49:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:49:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:49:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:49:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:49:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 3759511, 2024-05-08T09:49:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 973, 2024-05-08T09:49:41.069 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:49:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-08T09:49:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-08T09:49:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-08T09:49:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:49:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-08T09:49:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:49:41.070 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-08T09:49:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 10040, 2024-05-08T09:49:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 194, 2024-05-08T09:49:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:49:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:49:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-08T09:49:41.071 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-08T09:49:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 315332108, 2024-05-08T09:49:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 2550213, 2024-05-08T09:49:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-08T09:49:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-08T09:49:41.072 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-08T09:49:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-08T09:49:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-08T09:49:41.073 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-08T09:49:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-08T09:49:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 230159, 2024-05-08T09:49:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 3410533608, 2024-05-08T09:49:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 37, 2024-05-08T09:49:41.074 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 230159, 2024-05-08T09:49:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-08T09:49:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 230159, 2024-05-08T09:49:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 32437.461439858, 2024-05-08T09:49:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.140935012 2024-05-08T09:49:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-08T09:49:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-08T09:49:41.075 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 230159, 2024-05-08T09:49:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 494035 2024-05-08T09:49:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 230159, 2024-05-08T09:49:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 2354, 2024-05-08T09:49:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 227805, 2024-05-08T09:49:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-08T09:49:41.076 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-08T09:49:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 2108, 2024-05-08T09:49:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 159590, 2024-05-08T09:49:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 2327, 2024-05-08T09:49:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 25324, 2024-05-08T09:49:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 2153, 2024-05-08T09:49:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-08T09:49:41.077 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-08T09:49:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-08T09:49:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 155, 2024-05-08T09:49:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 26127, 2024-05-08T09:49:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-08T09:49:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-08T09:49:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-08T09:49:41.078 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2024-05-08T09:49:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 241888, 2024-05-08T09:49:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-08T09:49:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-08T09:49:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-08T09:49:41.079 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-08T09:49:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-08T09:49:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-08T09:49:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T09:49:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-08T09:49:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-08T09:49:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 229, 2024-05-08T09:49:41.080 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-08T09:49:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-08T09:49:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-08T09:49:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-08T09:49:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-08T09:49:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-08T09:49:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-08T09:49:41.081 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-08T09:49:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-08T09:49:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-08T09:49:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-08T09:49:41.082 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-08T09:49:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-08T09:49:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-08T09:49:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-08T09:49:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-08T09:49:41.083 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 443, 2024-05-08T09:49:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-08T09:49:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 362, 2024-05-08T09:49:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-05-08T09:49:41.084 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 12, 2024-05-08T09:49:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 0, 2024-05-08T09:49:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-08T09:49:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 27665, 2024-05-08T09:49:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 37, 2024-05-08T09:49:41.085 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 6430 2024-05-08T09:49:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-08T09:49:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-05-08T09:49:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-08T09:49:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-08T09:49:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-08T09:49:41.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-08T09:49:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 6807108 2024-05-08T09:49:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-08T09:49:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-08T09:49:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 34, 2024-05-08T09:49:41.087 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-08T09:49:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 14, 2024-05-08T09:49:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 24188, 2024-05-08T09:49:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 12135, 2024-05-08T09:49:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-08T09:49:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:49:41.088 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-08T09:49:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 11020669, 2024-05-08T09:49:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 2660965474, 2024-05-08T09:49:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 11020669, 2024-05-08T09:49:41.089 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 11020669, 2024-05-08T09:49:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 2660965474, 2024-05-08T09:49:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:41.090 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-08T09:49:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:41.091 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-08T09:49:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:41.092 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 230159, 2024-05-08T09:49:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 3412414977, 2024-05-08T09:49:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 230159, 2024-05-08T09:49:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3412414977, 2024-05-08T09:49:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:41.093 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:41.094 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-08T09:49:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-08T09:49:41.095 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 230159, 2024-05-08T09:49:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 230159, 2024-05-08T09:49:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 230159, 2024-05-08T09:49:41.096 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 230159, 2024-05-08T09:49:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.097 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-08T09:49:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-08T09:49:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 12135, 2024-05-08T09:49:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 1882203, 2024-05-08T09:49:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:41.098 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 12135, 2024-05-08T09:49:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 2329, 2024-05-08T09:49:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 1882203, 2024-05-08T09:49:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.099 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55d47f540500": { 2024-05-08T09:49:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:41.100 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-08T09:49:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 742160, 2024-05-08T09:49:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 3240511924, 2024-05-08T09:49:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 742160, 2024-05-08T09:49:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:41.101 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 22995, 2024-05-08T09:49:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3240511924, 2024-05-08T09:49:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:41.102 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:41.103 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:41.103 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-08T09:49:41.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:40 smithi070 ceph-mon[29591]: pgmap v5844: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:49:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:40 smithi194 ceph-mon[33679]: pgmap v5844: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:49:42.433 INFO:tasks.check_counter:Daemon mds.b mds.exported=430 2024-05-08T09:49:42.433 INFO:tasks.check_counter:Daemon mds.b mds.imported=97 2024-05-08T09:49:42.433 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=9 2024-05-08T09:49:42.433 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=183 2024-05-08T09:49:42.434 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=174 2024-05-08T09:49:42.434 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=163 2024-05-08T09:49:42.434 DEBUG:tasks.check_counter:Getting stats from e 2024-05-08T09:49:42.435 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-08T09:49:42.863 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T09:49:43.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:42 smithi172 ceph-mon[33377]: pgmap v5845: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:49:43.030 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:42 smithi172 ceph-mon[33377]: osdmap e444: 12 total, 12 up, 12 in 2024-05-08T09:49:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:42 smithi070 ceph-mon[29591]: pgmap v5845: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:49:43.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:42 smithi070 ceph-mon[29591]: osdmap e444: 12 total, 12 up, 12 in 2024-05-08T09:49:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:42 smithi194 ceph-mon[33679]: pgmap v5845: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:49:43.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:42 smithi194 ceph-mon[33679]: osdmap e444: 12 total, 12 up, 12 in 2024-05-08T09:49:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:44 smithi070 ceph-mon[29591]: pgmap v5847: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:45.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:44 smithi172 ceph-mon[33377]: pgmap v5847: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:44 smithi194 ceph-mon[33679]: pgmap v5847: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:46.080 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-08T09:49:46.080 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:49:46.081 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 280061, 2024-05-08T09:49:46.081 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 60397, 2024-05-08T09:49:46.081 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 95962153, 2024-05-08T09:49:46.081 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 28402935, 2024-05-08T09:49:46.081 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 29, 2024-05-08T09:49:46.081 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-08T09:49:46.081 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 32.618644629, 2024-05-08T09:49:46.081 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 14.057953208, 2024-05-08T09:49:46.082 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 26.926420015, 2024-05-08T09:49:46.082 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.070846524, 2024-05-08T09:49:46.082 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:46.082 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 60395, 2024-05-08T09:49:46.082 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 5.246331876, 2024-05-08T09:49:46.082 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000086866 2024-05-08T09:49:46.082 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.082 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:46.083 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 330476, 2024-05-08T09:49:46.083 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.095105983, 2024-05-08T09:49:46.083 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000287 2024-05-08T09:49:46.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.083 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1584, 2024-05-08T09:49:46.083 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 1440 2024-05-08T09:49:46.083 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.083 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:49:46.084 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 6050, 2024-05-08T09:49:46.084 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 6372, 2024-05-08T09:49:46.084 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 3517534, 2024-05-08T09:49:46.084 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 12573838, 2024-05-08T09:49:46.084 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 25, 2024-05-08T09:49:46.084 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-05-08T09:49:46.084 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 1.675451282, 2024-05-08T09:49:46.084 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.734469634, 2024-05-08T09:49:46.085 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.527878036, 2024-05-08T09:49:46.085 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.301599853, 2024-05-08T09:49:46.085 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:46.085 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 6372, 2024-05-08T09:49:46.085 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.706123687, 2024-05-08T09:49:46.085 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000110816 2024-05-08T09:49:46.085 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.085 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:46.085 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 581, 2024-05-08T09:49:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000412747, 2024-05-08T09:49:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000710 2024-05-08T09:49:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2816320, 2024-05-08T09:49:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 2047088 2024-05-08T09:49:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:49:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 210130, 2024-05-08T09:49:46.086 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 171806, 2024-05-08T09:49:46.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 69071806, 2024-05-08T09:49:46.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 48502278, 2024-05-08T09:49:46.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 31, 2024-05-08T09:49:46.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-05-08T09:49:46.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 36.652695878, 2024-05-08T09:49:46.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 19.605602231, 2024-05-08T09:49:46.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 22.165042479, 2024-05-08T09:49:46.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.975938129, 2024-05-08T09:49:46.087 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:46.088 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 171803, 2024-05-08T09:49:46.088 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 14.010520032, 2024-05-08T09:49:46.088 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000081549 2024-05-08T09:49:46.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.088 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:46.088 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 349159, 2024-05-08T09:49:46.088 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.156362168, 2024-05-08T09:49:46.088 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000447 2024-05-08T09:49:46.088 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1280, 2024-05-08T09:49:46.089 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 4487032 2024-05-08T09:49:46.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.089 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-08T09:49:46.089 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-08T09:49:46.089 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-08T09:49:46.089 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.089 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-08T09:49:46.089 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-08T09:49:46.090 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-08T09:49:46.090 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4954, 2024-05-08T09:49:46.090 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 7.607274210, 2024-05-08T09:49:46.090 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001535582 2024-05-08T09:49:46.090 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:46.090 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.090 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-08T09:49:46.090 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-08T09:49:46.091 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-08T09:49:46.091 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1650, 2024-05-08T09:49:46.091 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.177927869, 2024-05-08T09:49:46.091 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000107835 2024-05-08T09:49:46.091 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:46.091 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.091 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-08T09:49:46.091 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 37564, 2024-05-08T09:49:46.092 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 37316, 2024-05-08T09:49:46.092 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-08T09:49:46.092 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 37316, 2024-05-08T09:49:46.092 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 880.090106094, 2024-05-08T09:49:46.092 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.023584792 2024-05-08T09:49:46.092 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.092 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-08T09:49:46.092 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 248, 2024-05-08T09:49:46.093 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-05-08T09:49:46.093 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-08T09:49:46.093 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 29, 2024-05-08T09:49:46.093 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 2, 2024-05-08T09:49:46.093 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-08T09:49:46.093 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 5034, 2024-05-08T09:49:46.093 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 66, 2024-05-08T09:49:46.093 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 1076, 2024-05-08T09:49:46.094 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 3892, 2024-05-08T09:49:46.094 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 4938, 2024-05-08T09:49:46.094 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 373, 2024-05-08T09:49:46.094 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 4162, 2024-05-08T09:49:46.094 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 4162, 2024-05-08T09:49:46.094 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 221, 2024-05-08T09:49:46.094 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 75705, 2024-05-08T09:49:46.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 11263, 2024-05-08T09:49:46.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 241, 2024-05-08T09:49:46.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 234, 2024-05-08T09:49:46.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-05-08T09:49:46.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-08T09:49:46.095 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-05-08T09:49:46.095 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-08T09:49:46.095 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-08T09:49:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 8, 2024-05-08T09:49:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 236, 2024-05-08T09:49:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 206, 2024-05-08T09:49:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 3683, 2024-05-08T09:49:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-08T09:49:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-08T09:49:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-08T09:49:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 80967, 2024-05-08T09:49:46.096 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 1791582323, 2024-05-08T09:49:46.097 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 9, 2024-05-08T09:49:46.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T09:49:46.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-08T09:49:46.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T09:49:46.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-08T09:49:46.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-08T09:49:46.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T09:49:46.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T09:49:46.097 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-08T09:49:46.098 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-05-08T09:49:46.098 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 12060, 2024-05-08T09:49:46.098 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 1197, 2024-05-08T09:49:46.098 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 14, 2024-05-08T09:49:46.098 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T09:49:46.098 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T09:49:46.098 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 240977, 2024-05-08T09:49:46.098 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 2827, 2024-05-08T09:49:46.098 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 183, 2024-05-08T09:49:46.099 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 1536 2024-05-08T09:49:46.099 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.099 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-08T09:49:46.099 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-08T09:49:46.099 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-08T09:49:46.099 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-08T09:49:46.099 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 219, 2024-05-08T09:49:46.099 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 5, 2024-05-08T09:49:46.099 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 2, 2024-05-08T09:49:46.100 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-08T09:49:46.100 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-08T09:49:46.100 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 341, 2024-05-08T09:49:46.100 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 339, 2024-05-08T09:49:46.100 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-08T09:49:46.100 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-08T09:49:46.100 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-08T09:49:46.100 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-08T09:49:46.101 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-08T09:49:46.101 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-08T09:49:46.101 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-08T09:49:46.101 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 100, 2024-05-08T09:49:46.101 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 371399, 2024-05-08T09:49:46.101 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T09:49:46.101 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 8, 2024-05-08T09:49:46.101 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-08T09:49:46.101 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 2, 2024-05-08T09:49:46.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-08T09:49:46.102 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-08T09:49:46.102 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.102 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-08T09:49:46.102 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-05-08T09:49:46.102 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 10664, 2024-05-08T09:49:46.102 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-05-08T09:49:46.102 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-05-08T09:49:46.103 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 10664, 2024-05-08T09:49:46.103 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-08T09:49:46.103 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-05-08T09:49:46.103 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 15, 2024-05-08T09:49:46.103 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-05-08T09:49:46.103 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-05-08T09:49:46.103 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 15, 2024-05-08T09:49:46.103 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 2, 2024-05-08T09:49:46.104 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-08T09:49:46.104 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-05-08T09:49:46.104 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-05-08T09:49:46.104 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 26009489, 2024-05-08T09:49:46.104 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-05-08T09:49:46.104 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-08T09:49:46.104 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1654, 2024-05-08T09:49:46.104 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 11.989553010, 2024-05-08T09:49:46.104 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.007248822 2024-05-08T09:49:46.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.105 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-05-08T09:49:46.105 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.105 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-08T09:49:46.105 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 4740, 2024-05-08T09:49:46.105 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 5214, 2024-05-08T09:49:46.105 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 474, 2024-05-08T09:49:46.105 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 693, 2024-05-08T09:49:46.106 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 731, 2024-05-08T09:49:46.106 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 38, 2024-05-08T09:49:46.106 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 5034, 2024-05-08T09:49:46.106 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 6172, 2024-05-08T09:49:46.106 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 1138, 2024-05-08T09:49:46.106 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 4162, 2024-05-08T09:49:46.106 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 4513, 2024-05-08T09:49:46.107 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 351, 2024-05-08T09:49:46.107 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 95612, 2024-05-08T09:49:46.107 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223608 2024-05-08T09:49:46.107 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.107 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-08T09:49:46.107 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 39717, 2024-05-08T09:49:46.107 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 3887, 2024-05-08T09:49:46.107 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 37564, 2024-05-08T09:49:46.108 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 228, 2024-05-08T09:49:46.108 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 42917, 2024-05-08T09:49:46.108 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-08T09:49:46.108 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 808, 2024-05-08T09:49:46.108 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 761.932331656, 2024-05-08T09:49:46.108 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.942985558 2024-05-08T09:49:46.108 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.108 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-08T09:49:46.108 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 208, 2024-05-08T09:49:46.109 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.166868427, 2024-05-08T09:49:46.109 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000802252 2024-05-08T09:49:46.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.109 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-08T09:49:46.109 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.109 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.109 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.109 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.109 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-08T09:49:46.110 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.110 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.110 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.110 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.110 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-08T09:49:46.110 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 35436, 2024-05-08T09:49:46.110 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 72.444252088, 2024-05-08T09:49:46.110 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002044368 2024-05-08T09:49:46.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.111 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-08T09:49:46.111 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.111 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.111 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.111 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.111 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-08T09:49:46.111 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.112 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.112 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.112 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-08T09:49:46.112 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.112 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.112 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.112 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.113 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-08T09:49:46.113 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.113 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.113 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.113 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.113 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-08T09:49:46.113 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.113 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.114 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.114 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.114 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-08T09:49:46.114 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.115 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.115 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.115 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-08T09:49:46.115 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2024-05-08T09:49:46.115 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.016515954, 2024-05-08T09:49:46.115 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004128988 2024-05-08T09:49:46.115 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.116 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-08T09:49:46.116 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.116 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.116 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.116 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.116 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-08T09:49:46.116 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.116 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.117 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.117 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-08T09:49:46.117 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 75, 2024-05-08T09:49:46.117 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.329495323, 2024-05-08T09:49:46.117 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004393270 2024-05-08T09:49:46.117 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.117 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-08T09:49:46.118 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 430, 2024-05-08T09:49:46.118 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.826493801, 2024-05-08T09:49:46.118 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001922078 2024-05-08T09:49:46.118 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.118 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-08T09:49:46.118 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 14, 2024-05-08T09:49:46.118 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.123850390, 2024-05-08T09:49:46.118 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.008846456 2024-05-08T09:49:46.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.119 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-08T09:49:46.119 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.119 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.119 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.119 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.119 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-08T09:49:46.119 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.120 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.120 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.120 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-08T09:49:46.120 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-05-08T09:49:46.120 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.085735443, 2024-05-08T09:49:46.120 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.042867721 2024-05-08T09:49:46.120 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.120 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-08T09:49:46.121 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.121 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.121 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.121 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.121 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-08T09:49:46.121 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.121 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.121 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.122 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.122 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-08T09:49:46.122 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.123 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.123 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.123 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.124 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-08T09:49:46.124 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.124 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.124 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.124 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.124 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-08T09:49:46.124 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.124 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.124 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.125 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-08T09:49:46.125 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.125 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.125 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.125 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.125 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-08T09:49:46.125 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.126 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.126 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.126 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-08T09:49:46.126 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.126 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.126 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.126 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.127 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-08T09:49:46.127 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 339, 2024-05-08T09:49:46.127 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 44.164563012, 2024-05-08T09:49:46.127 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.130278946 2024-05-08T09:49:46.127 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.127 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-08T09:49:46.127 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-08T09:49:46.127 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-08T09:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-08T09:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-05-08T09:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 3, 2024-05-08T09:49:46.128 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 1, 2024-05-08T09:49:46.129 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 2, 2024-05-08T09:49:46.129 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-08T09:49:46.129 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 41, 2024-05-08T09:49:46.129 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 20, 2024-05-08T09:49:46.129 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 10978, 2024-05-08T09:49:46.129 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-08T09:49:46.129 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.129 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-08T09:49:46.129 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:49:46.130 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-08T09:49:46.130 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:49:46.130 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:49:46.130 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:49:46.130 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:49:46.130 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:49:46.130 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:49:46.130 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:49:46.131 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:49:46.131 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:49:46.131 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:49:46.131 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:49:46.131 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:49:46.131 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:49:46.131 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-08T09:49:46.131 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:49:46.131 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-08T09:49:46.132 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:49:46.132 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:49:46.132 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:49:46.132 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:49:46.132 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:49:46.132 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:49:46.132 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:49:46.132 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-08T09:49:46.132 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:49:46.133 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:49:46.133 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:49:46.133 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-08T09:49:46.133 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-08T09:49:46.133 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-08T09:49:46.133 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:49:46.133 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:49:46.133 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:49:46.133 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:49:46.134 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 322695, 2024-05-08T09:49:46.134 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 117, 2024-05-08T09:49:46.134 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:49:46.134 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-08T09:49:46.134 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-08T09:49:46.134 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-08T09:49:46.134 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:49:46.134 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-08T09:49:46.135 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:49:46.135 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-08T09:49:46.135 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 10040, 2024-05-08T09:49:46.135 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 194, 2024-05-08T09:49:46.135 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:49:46.135 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:49:46.135 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-08T09:49:46.135 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-08T09:49:46.136 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 17110040, 2024-05-08T09:49:46.136 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 124907, 2024-05-08T09:49:46.136 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-08T09:49:46.136 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-08T09:49:46.136 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-08T09:49:46.136 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-08T09:49:46.136 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.136 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-08T09:49:46.136 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-08T09:49:46.137 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-08T09:49:46.137 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 4718, 2024-05-08T09:49:46.137 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 22607890, 2024-05-08T09:49:46.137 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 32, 2024-05-08T09:49:46.137 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 4718, 2024-05-08T09:49:46.137 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-08T09:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4718, 2024-05-08T09:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 33.618198768, 2024-05-08T09:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.007125519 2024-05-08T09:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-08T09:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-08T09:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4718, 2024-05-08T09:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 6435 2024-05-08T09:49:46.138 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 4718, 2024-05-08T09:49:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 216, 2024-05-08T09:49:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 4502, 2024-05-08T09:49:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-08T09:49:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-08T09:49:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-05-08T09:49:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-05-08T09:49:46.139 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 216, 2024-05-08T09:49:46.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 1870, 2024-05-08T09:49:46.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 440, 2024-05-08T09:49:46.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-08T09:49:46.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-08T09:49:46.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-08T09:49:46.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 2, 2024-05-08T09:49:46.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 695, 2024-05-08T09:49:46.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-08T09:49:46.140 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-08T09:49:46.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-08T09:49:46.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-05-08T09:49:46.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-05-08T09:49:46.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-08T09:49:46.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-08T09:49:46.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-08T09:49:46.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-08T09:49:46.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-08T09:49:46.141 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-08T09:49:46.142 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T09:49:46.142 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-08T09:49:46.142 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-08T09:49:46.142 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 14, 2024-05-08T09:49:46.142 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-08T09:49:46.142 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-08T09:49:46.142 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-08T09:49:46.142 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-08T09:49:46.142 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-08T09:49:46.143 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-08T09:49:46.143 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-08T09:49:46.143 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-08T09:49:46.143 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-08T09:49:46.143 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-08T09:49:46.143 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-08T09:49:46.143 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-08T09:49:46.143 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-08T09:49:46.143 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-08T09:49:46.144 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-08T09:49:46.144 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-08T09:49:46.144 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 444, 2024-05-08T09:49:46.144 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-08T09:49:46.144 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 354, 2024-05-08T09:49:46.144 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-05-08T09:49:46.144 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 56, 2024-05-08T09:49:46.144 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 44, 2024-05-08T09:49:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-08T09:49:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 2343, 2024-05-08T09:49:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 0, 2024-05-08T09:49:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 825 2024-05-08T09:49:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-08T09:49:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-05-08T09:49:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-08T09:49:46.145 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-08T09:49:46.146 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-08T09:49:46.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.146 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-08T09:49:46.146 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 373019 2024-05-08T09:49:46.146 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.146 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-08T09:49:46.146 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-08T09:49:46.146 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 16, 2024-05-08T09:49:46.146 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-08T09:49:46.147 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 8, 2024-05-08T09:49:46.147 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 678, 2024-05-08T09:49:46.147 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 339, 2024-05-08T09:49:46.147 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-08T09:49:46.147 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.147 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:49:46.147 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:46.147 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-08T09:49:46.147 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:46.148 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 496237, 2024-05-08T09:49:46.148 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 123707799, 2024-05-08T09:49:46.148 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:46.148 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 496237, 2024-05-08T09:49:46.148 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:46.148 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:46.148 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 496237, 2024-05-08T09:49:46.148 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 123707799, 2024-05-08T09:49:46.148 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:46.149 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.149 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.149 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.149 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:46.149 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.149 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-08T09:49:46.149 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:46.149 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-08T09:49:46.149 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:46.150 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:46.150 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:46.150 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:46.150 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:46.150 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4718, 2024-05-08T09:49:46.150 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 22653393, 2024-05-08T09:49:46.150 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4718, 2024-05-08T09:49:46.150 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 22653393, 2024-05-08T09:49:46.151 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:46.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.151 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.151 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.151 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:46.151 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.151 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-08T09:49:46.151 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:46.151 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-08T09:49:46.152 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:46.152 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:46.152 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:46.152 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:46.152 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:46.152 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 4718, 2024-05-08T09:49:46.152 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 4718, 2024-05-08T09:49:46.152 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 4718, 2024-05-08T09:49:46.152 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 4718, 2024-05-08T09:49:46.153 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:46.153 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.153 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.153 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.153 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:46.153 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.153 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-08T09:49:46.153 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:46.153 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-08T09:49:46.154 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:46.154 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 339, 2024-05-08T09:49:46.154 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 45503, 2024-05-08T09:49:46.154 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:46.154 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 339, 2024-05-08T09:49:46.154 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:46.154 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:46.154 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 216, 2024-05-08T09:49:46.154 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 45503, 2024-05-08T09:49:46.155 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:46.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.155 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.155 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.155 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:46.155 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:46.155 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x55a1f5504500": { 2024-05-08T09:49:46.155 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:46.156 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-08T09:49:46.156 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:46.156 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 10664, 2024-05-08T09:49:46.156 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 21815185, 2024-05-08T09:49:46.156 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:46.156 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 10664, 2024-05-08T09:49:46.156 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:46.156 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:46.156 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 1654, 2024-05-08T09:49:46.157 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 21815185, 2024-05-08T09:49:46.157 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:46.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:46.157 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:46.157 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:46.157 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:46.157 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:46.157 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-08T09:49:47.026 INFO:tasks.check_counter:Daemon mds.e mds.exported=8 2024-05-08T09:49:47.026 INFO:tasks.check_counter:Daemon mds.e mds.imported=206 2024-05-08T09:49:47.026 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=9 2024-05-08T09:49:47.026 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-05-08T09:49:47.027 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T09:49:47.027 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=2 2024-05-08T09:49:47.027 DEBUG:tasks.check_counter:Getting stats from h 2024-05-08T09:49:47.027 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-08T09:49:47.104 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:46 smithi172 ceph-mon[33377]: pgmap v5848: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:47.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:46 smithi070 ceph-mon[29591]: pgmap v5848: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:47.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:46 smithi194 ceph-mon[33679]: pgmap v5848: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:47.504 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T09:49:49.120 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:48 smithi172 ceph-mon[33377]: pgmap v5849: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:49.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:48 smithi070 ceph-mon[29591]: pgmap v5849: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:48 smithi194 ceph-mon[33679]: pgmap v5849: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:49.712 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-08T09:49:49.713 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:49:49.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 11509, 2024-05-08T09:49:49.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 13146, 2024-05-08T09:49:49.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 2643400, 2024-05-08T09:49:49.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 39280221, 2024-05-08T09:49:49.713 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 28, 2024-05-08T09:49:49.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-05-08T09:49:49.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 2.826666025, 2024-05-08T09:49:49.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 1.190659841, 2024-05-08T09:49:49.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.914793389, 2024-05-08T09:49:49.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.792109582, 2024-05-08T09:49:49.714 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:49.714 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 13140, 2024-05-08T09:49:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.198393963, 2024-05-08T09:49:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000091201 2024-05-08T09:49:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 17088, 2024-05-08T09:49:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.005037370, 2024-05-08T09:49:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000294 2024-05-08T09:49:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.715 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 8256, 2024-05-08T09:49:49.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 8736 2024-05-08T09:49:49.716 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.716 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:49:49.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 472703, 2024-05-08T09:49:49.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 250362, 2024-05-08T09:49:49.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 172261140, 2024-05-08T09:49:49.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 110133775, 2024-05-08T09:49:49.716 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 26, 2024-05-08T09:49:49.717 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 5, 2024-05-08T09:49:49.717 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 68.053472258, 2024-05-08T09:49:49.717 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 33.680816334, 2024-05-08T09:49:49.717 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 47.202061139, 2024-05-08T09:49:49.717 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 1.302265848, 2024-05-08T09:49:49.717 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:49.717 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 250364, 2024-05-08T09:49:49.718 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 19.943344284, 2024-05-08T09:49:49.718 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000079657 2024-05-08T09:49:49.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.718 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:49.718 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 670450, 2024-05-08T09:49:49.718 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.263736386, 2024-05-08T09:49:49.718 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000393 2024-05-08T09:49:49.718 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.719 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1280, 2024-05-08T09:49:49.719 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 4486680 2024-05-08T09:49:49.719 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.719 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:49:49.719 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 7735, 2024-05-08T09:49:49.719 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 7714, 2024-05-08T09:49:49.719 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 4351249, 2024-05-08T09:49:49.719 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 21029454, 2024-05-08T09:49:49.720 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 21, 2024-05-08T09:49:49.720 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 6, 2024-05-08T09:49:49.720 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 2.507121721, 2024-05-08T09:49:49.720 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.824670217, 2024-05-08T09:49:49.720 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 0.561844572, 2024-05-08T09:49:49.720 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 1.004369057, 2024-05-08T09:49:49.720 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:49.721 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7713, 2024-05-08T09:49:49.721 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.888800126, 2024-05-08T09:49:49.721 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000115234 2024-05-08T09:49:49.721 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.721 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:49.721 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 24, 2024-05-08T09:49:49.722 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000007092, 2024-05-08T09:49:49.722 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000295 2024-05-08T09:49:49.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.722 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2805072, 2024-05-08T09:49:49.722 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 1929904 2024-05-08T09:49:49.722 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.723 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-08T09:49:49.723 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-08T09:49:49.723 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-08T09:49:49.723 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.723 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-08T09:49:49.723 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-08T09:49:49.723 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-08T09:49:49.724 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 7568, 2024-05-08T09:49:49.724 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 27.430758074, 2024-05-08T09:49:49.724 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003624571 2024-05-08T09:49:49.724 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:49.724 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.724 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-08T09:49:49.724 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-08T09:49:49.724 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-08T09:49:49.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3943, 2024-05-08T09:49:49.725 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.099459680, 2024-05-08T09:49:49.725 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000278838 2024-05-08T09:49:49.725 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:49.725 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.725 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-08T09:49:49.725 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 22220, 2024-05-08T09:49:49.726 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 21758, 2024-05-08T09:49:49.726 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-08T09:49:49.726 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 21758, 2024-05-08T09:49:49.726 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 803.918482755, 2024-05-08T09:49:49.726 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.036948179 2024-05-08T09:49:49.726 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.726 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-08T09:49:49.727 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 462, 2024-05-08T09:49:49.727 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 7, 2024-05-08T09:49:49.727 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-08T09:49:49.727 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 165, 2024-05-08T09:49:49.727 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 18, 2024-05-08T09:49:49.727 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-08T09:49:49.727 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 9233, 2024-05-08T09:49:49.728 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 2, 2024-05-08T09:49:49.728 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 1, 2024-05-08T09:49:49.728 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 9230, 2024-05-08T09:49:49.728 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 9230, 2024-05-08T09:49:49.728 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 4430, 2024-05-08T09:49:49.728 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 8532, 2024-05-08T09:49:49.728 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 8532, 2024-05-08T09:49:49.728 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 223, 2024-05-08T09:49:49.729 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 43326, 2024-05-08T09:49:49.729 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 22289, 2024-05-08T09:49:49.729 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 432, 2024-05-08T09:49:49.729 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 250, 2024-05-08T09:49:49.729 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-05-08T09:49:49.729 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-08T09:49:49.729 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-05-08T09:49:49.729 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-08T09:49:49.730 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-08T09:49:49.730 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 96, 2024-05-08T09:49:49.730 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 4106, 2024-05-08T09:49:49.730 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 231, 2024-05-08T09:49:49.730 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 6004, 2024-05-08T09:49:49.730 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-08T09:49:49.730 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-08T09:49:49.730 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-08T09:49:49.730 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 80967, 2024-05-08T09:49:49.731 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 1791582323, 2024-05-08T09:49:49.731 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 9, 2024-05-08T09:49:49.731 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T09:49:49.731 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-08T09:49:49.731 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T09:49:49.731 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-08T09:49:49.732 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-08T09:49:49.732 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T09:49:49.732 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T09:49:49.732 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-08T09:49:49.732 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-05-08T09:49:49.732 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 27237, 2024-05-08T09:49:49.733 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 6546, 2024-05-08T09:49:49.733 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 5, 2024-05-08T09:49:49.733 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T09:49:49.733 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T09:49:49.733 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 248955, 2024-05-08T09:49:49.733 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 6799, 2024-05-08T09:49:49.733 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 86, 2024-05-08T09:49:49.734 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 8624 2024-05-08T09:49:49.734 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.734 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-08T09:49:49.734 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-08T09:49:49.734 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-08T09:49:49.734 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-08T09:49:49.734 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 236, 2024-05-08T09:49:49.735 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 18, 2024-05-08T09:49:49.735 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 3, 2024-05-08T09:49:49.735 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-08T09:49:49.735 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-08T09:49:49.735 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 1983, 2024-05-08T09:49:49.735 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 1980, 2024-05-08T09:49:49.735 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-08T09:49:49.735 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-08T09:49:49.736 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-08T09:49:49.736 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-08T09:49:49.736 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-08T09:49:49.736 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-08T09:49:49.736 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-08T09:49:49.736 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 100, 2024-05-08T09:49:49.736 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 852465, 2024-05-08T09:49:49.736 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T09:49:49.736 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 98, 2024-05-08T09:49:49.737 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-08T09:49:49.737 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 20, 2024-05-08T09:49:49.737 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-08T09:49:49.737 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-08T09:49:49.737 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.737 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-08T09:49:49.737 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-05-08T09:49:49.737 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 67626, 2024-05-08T09:49:49.738 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-05-08T09:49:49.738 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-05-08T09:49:49.738 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 67626, 2024-05-08T09:49:49.738 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-08T09:49:49.738 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-05-08T09:49:49.738 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 77, 2024-05-08T09:49:49.738 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-05-08T09:49:49.738 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-05-08T09:49:49.739 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 77, 2024-05-08T09:49:49.739 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 7, 2024-05-08T09:49:49.739 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-08T09:49:49.739 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-05-08T09:49:49.739 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 4194304, 2024-05-08T09:49:49.739 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 77780454, 2024-05-08T09:49:49.739 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 0, 2024-05-08T09:49:49.739 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-08T09:49:49.739 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3149, 2024-05-08T09:49:49.740 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 45.322065234, 2024-05-08T09:49:49.740 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.014392526 2024-05-08T09:49:49.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.740 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 0 2024-05-08T09:49:49.740 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.740 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-08T09:49:49.740 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 9184, 2024-05-08T09:49:49.741 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 13577, 2024-05-08T09:49:49.741 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 4393, 2024-05-08T09:49:49.741 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 866, 2024-05-08T09:49:49.741 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 1026, 2024-05-08T09:49:49.741 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 160, 2024-05-08T09:49:49.741 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 9233, 2024-05-08T09:49:49.741 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 16579, 2024-05-08T09:49:49.741 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 7346, 2024-05-08T09:49:49.742 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 8532, 2024-05-08T09:49:49.742 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 10740, 2024-05-08T09:49:49.742 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 2208, 2024-05-08T09:49:49.742 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 133692, 2024-05-08T09:49:49.742 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 223608 2024-05-08T09:49:49.742 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.743 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-08T09:49:49.743 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 29274, 2024-05-08T09:49:49.743 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 8813, 2024-05-08T09:49:49.743 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 22220, 2024-05-08T09:49:49.743 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 136, 2024-05-08T09:49:49.743 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 50460, 2024-05-08T09:49:49.743 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-08T09:49:49.744 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4491, 2024-05-08T09:49:49.744 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 535.192175717, 2024-05-08T09:49:49.744 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.119169934 2024-05-08T09:49:49.744 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.744 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-08T09:49:49.744 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 808, 2024-05-08T09:49:49.744 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.460460972, 2024-05-08T09:49:49.744 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001807501 2024-05-08T09:49:49.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.745 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-08T09:49:49.745 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.745 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.745 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.745 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.745 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-08T09:49:49.745 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.746 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.746 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.746 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-08T09:49:49.746 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 13272, 2024-05-08T09:49:49.746 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 160.087752384, 2024-05-08T09:49:49.746 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.012062066 2024-05-08T09:49:49.746 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.746 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-08T09:49:49.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.747 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.747 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.747 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-08T09:49:49.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.747 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.747 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.748 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-08T09:49:49.748 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.748 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.748 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.748 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.748 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-08T09:49:49.748 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.749 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.749 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.749 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.749 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-08T09:49:49.749 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.749 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.750 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.750 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.750 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-08T09:49:49.750 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.751 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.751 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-08T09:49:49.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 161, 2024-05-08T09:49:49.751 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.655558978, 2024-05-08T09:49:49.751 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.004071794 2024-05-08T09:49:49.751 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.752 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-08T09:49:49.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.752 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.752 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.752 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.753 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-08T09:49:49.753 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.753 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.753 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.753 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.753 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-08T09:49:49.754 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 69, 2024-05-08T09:49:49.754 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.069562629, 2024-05-08T09:49:49.754 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001008154 2024-05-08T09:49:49.754 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.754 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-08T09:49:49.754 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 967, 2024-05-08T09:49:49.754 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 2.633749031, 2024-05-08T09:49:49.755 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.002723628 2024-05-08T09:49:49.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.755 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-08T09:49:49.755 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 2, 2024-05-08T09:49:49.755 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.025077750, 2024-05-08T09:49:49.755 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.012538875 2024-05-08T09:49:49.755 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.756 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-08T09:49:49.756 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.756 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.756 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.756 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.756 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-08T09:49:49.756 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.756 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.756 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.757 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-08T09:49:49.757 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 3, 2024-05-08T09:49:49.757 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.099091121, 2024-05-08T09:49:49.757 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.033030373 2024-05-08T09:49:49.757 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.757 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-08T09:49:49.758 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.758 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.758 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.758 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.759 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-08T09:49:49.759 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.759 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.759 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.760 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-08T09:49:49.760 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 4, 2024-05-08T09:49:49.760 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.012381301, 2024-05-08T09:49:49.760 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.003095325 2024-05-08T09:49:49.760 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.761 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-08T09:49:49.761 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.761 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.761 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.761 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.761 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-08T09:49:49.761 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.762 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.762 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.762 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.762 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-08T09:49:49.762 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.762 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.762 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.763 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.763 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-08T09:49:49.763 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.763 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.764 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.764 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.764 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-08T09:49:49.764 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1, 2024-05-08T09:49:49.764 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.006340301, 2024-05-08T09:49:49.764 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.006340301 2024-05-08T09:49:49.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.765 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-08T09:49:49.765 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 1980, 2024-05-08T09:49:49.765 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 103.676332571, 2024-05-08T09:49:49.765 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.052361784 2024-05-08T09:49:49.765 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.765 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-08T09:49:49.765 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-08T09:49:49.766 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-08T09:49:49.766 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.766 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.766 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.766 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:49.766 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.766 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-08T09:49:49.766 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 1, 2024-05-08T09:49:49.767 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 4, 2024-05-08T09:49:49.767 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 3, 2024-05-08T09:49:49.767 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 1, 2024-05-08T09:49:49.767 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-08T09:49:49.767 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 1611, 2024-05-08T09:49:49.767 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 1611, 2024-05-08T09:49:49.767 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 10996, 2024-05-08T09:49:49.767 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-08T09:49:49.768 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.768 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-08T09:49:49.768 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:49:49.768 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-08T09:49:49.768 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:49:49.768 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:49:49.768 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:49:49.768 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:49:49.769 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:49:49.769 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:49:49.769 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:49:49.769 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:49:49.769 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:49:49.769 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:49:49.769 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:49:49.769 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:49:49.770 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:49:49.770 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-08T09:49:49.770 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:49:49.770 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-08T09:49:49.770 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:49:49.770 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:49:49.770 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:49:49.770 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:49:49.771 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:49:49.771 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:49:49.771 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:49:49.771 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-08T09:49:49.771 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:49:49.771 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:49:49.771 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:49:49.772 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-08T09:49:49.772 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-08T09:49:49.772 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-08T09:49:49.772 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:49:49.772 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:49:49.772 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:49:49.772 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:49:49.773 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 339783, 2024-05-08T09:49:49.773 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 117, 2024-05-08T09:49:49.773 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:49:49.773 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-08T09:49:49.773 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-08T09:49:49.774 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-08T09:49:49.774 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:49:49.774 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-08T09:49:49.774 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:49:49.774 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-08T09:49:49.774 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 9800, 2024-05-08T09:49:49.775 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 188, 2024-05-08T09:49:49.775 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:49:49.775 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:49:49.775 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-08T09:49:49.775 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-08T09:49:49.775 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 31550449, 2024-05-08T09:49:49.775 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 232931, 2024-05-08T09:49:49.775 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-08T09:49:49.776 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-08T09:49:49.776 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-08T09:49:49.776 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-08T09:49:49.776 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.776 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-08T09:49:49.776 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-08T09:49:49.776 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-08T09:49:49.776 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 9384, 2024-05-08T09:49:49.777 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 76821926, 2024-05-08T09:49:49.777 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 33, 2024-05-08T09:49:49.777 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 9384, 2024-05-08T09:49:49.777 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-08T09:49:49.777 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 9384, 2024-05-08T09:49:49.777 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 97.707666399, 2024-05-08T09:49:49.777 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.010412155 2024-05-08T09:49:49.777 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.778 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-08T09:49:49.778 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-08T09:49:49.778 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 9384, 2024-05-08T09:49:49.778 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 11331 2024-05-08T09:49:49.778 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.778 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 9384, 2024-05-08T09:49:49.778 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 126, 2024-05-08T09:49:49.779 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 9258, 2024-05-08T09:49:49.779 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-08T09:49:49.779 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-08T09:49:49.779 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 0, 2024-05-08T09:49:49.779 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 10, 2024-05-08T09:49:49.779 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 107, 2024-05-08T09:49:49.779 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 3256, 2024-05-08T09:49:49.779 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 299, 2024-05-08T09:49:49.780 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-08T09:49:49.780 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-08T09:49:49.780 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-08T09:49:49.780 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 10, 2024-05-08T09:49:49.780 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 3997, 2024-05-08T09:49:49.780 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-08T09:49:49.780 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-08T09:49:49.780 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-08T09:49:49.781 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 0, 2024-05-08T09:49:49.781 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 20, 2024-05-08T09:49:49.781 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-08T09:49:49.781 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-08T09:49:49.781 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-08T09:49:49.781 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-08T09:49:49.781 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-08T09:49:49.781 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-08T09:49:49.782 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T09:49:49.782 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-08T09:49:49.782 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-08T09:49:49.782 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 5, 2024-05-08T09:49:49.782 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-08T09:49:49.782 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-08T09:49:49.782 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-08T09:49:49.782 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-08T09:49:49.783 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-08T09:49:49.783 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-08T09:49:49.783 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-08T09:49:49.783 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-08T09:49:49.783 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-08T09:49:49.783 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-08T09:49:49.783 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-08T09:49:49.784 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-08T09:49:49.784 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-08T09:49:49.784 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-08T09:49:49.784 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-08T09:49:49.784 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-08T09:49:49.785 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 444, 2024-05-08T09:49:49.785 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-08T09:49:49.785 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 354, 2024-05-08T09:49:49.785 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 12, 2024-05-08T09:49:49.785 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 45, 2024-05-08T09:49:49.785 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 33, 2024-05-08T09:49:49.785 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-08T09:49:49.785 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 2761, 2024-05-08T09:49:49.786 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 26, 2024-05-08T09:49:49.786 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 840 2024-05-08T09:49:49.786 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.786 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-08T09:49:49.786 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 1, 2024-05-08T09:49:49.786 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-08T09:49:49.786 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-08T09:49:49.786 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-08T09:49:49.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.787 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-08T09:49:49.787 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 853955 2024-05-08T09:49:49.787 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.787 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-08T09:49:49.787 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-08T09:49:49.787 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 16, 2024-05-08T09:49:49.787 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-08T09:49:49.788 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 8, 2024-05-08T09:49:49.788 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 3960, 2024-05-08T09:49:49.788 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 1980, 2024-05-08T09:49:49.788 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-08T09:49:49.788 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.788 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:49:49.788 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:49.788 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-08T09:49:49.789 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:49.789 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 491943, 2024-05-08T09:49:49.789 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 134802182, 2024-05-08T09:49:49.789 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:49.789 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 491943, 2024-05-08T09:49:49.789 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:49.789 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:49.789 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 491943, 2024-05-08T09:49:49.790 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 134802182, 2024-05-08T09:49:49.790 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:49.790 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.790 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.790 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.790 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:49.790 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.790 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-08T09:49:49.791 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:49.791 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-08T09:49:49.791 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:49.791 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:49.791 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:49.791 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:49.791 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:49.791 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 9384, 2024-05-08T09:49:49.792 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 77159906, 2024-05-08T09:49:49.792 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 9384, 2024-05-08T09:49:49.792 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 77159906, 2024-05-08T09:49:49.792 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:49.792 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.792 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.792 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.792 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:49.793 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.793 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-08T09:49:49.793 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:49.793 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-08T09:49:49.793 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:49.793 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:49.793 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:49.794 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:49.794 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:49.794 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 9384, 2024-05-08T09:49:49.794 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 9384, 2024-05-08T09:49:49.795 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 9384, 2024-05-08T09:49:49.795 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 9384, 2024-05-08T09:49:49.795 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:49.795 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.795 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.795 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.795 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:49.795 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.796 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-08T09:49:49.796 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:49.796 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-08T09:49:49.796 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:49.796 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 1980, 2024-05-08T09:49:49.796 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 338476, 2024-05-08T09:49:49.796 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:49.796 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 1980, 2024-05-08T09:49:49.797 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:49.797 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:49.797 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 107, 2024-05-08T09:49:49.797 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 338476, 2024-05-08T09:49:49.797 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:49.797 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.797 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.797 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.798 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:49.798 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:49.798 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x5571f0924500": { 2024-05-08T09:49:49.798 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:49.798 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-08T09:49:49.798 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:49.798 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 67626, 2024-05-08T09:49:49.798 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 73586150, 2024-05-08T09:49:49.799 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:49.799 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 67626, 2024-05-08T09:49:49.799 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:49.799 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:49.799 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 3149, 2024-05-08T09:49:49.799 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 73586150, 2024-05-08T09:49:49.799 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:49.799 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:49.799 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:49.800 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:49.800 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:49.800 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:49.800 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-08T09:49:50.735 INFO:tasks.check_counter:Daemon mds.h mds.exported=96 2024-05-08T09:49:50.736 INFO:tasks.check_counter:Daemon mds.h mds.imported=231 2024-05-08T09:49:50.736 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=9 2024-05-08T09:49:50.736 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-05-08T09:49:50.736 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T09:49:50.736 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=18 2024-05-08T09:49:50.736 DEBUG:tasks.check_counter:Getting stats from k 2024-05-08T09:49:50.737 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-08T09:49:50.929 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:50 smithi172 ceph-mon[33377]: pgmap v5850: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:51.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:50 smithi070 ceph-mon[29591]: pgmap v5850: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:51.182 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T09:49:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:50 smithi194 ceph-mon[33679]: pgmap v5850: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:53.018 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:52 smithi172 ceph-mon[33377]: pgmap v5851: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:52 smithi070 ceph-mon[29591]: pgmap v5851: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:52 smithi194 ceph-mon[33679]: pgmap v5851: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:49:53.353 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2024-05-08T09:49:53.353 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:49:53.353 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 19444, 2024-05-08T09:49:53.353 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 19446, 2024-05-08T09:49:53.353 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 932314750, 2024-05-08T09:49:53.354 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 6183202, 2024-05-08T09:49:53.354 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 14, 2024-05-08T09:49:53.354 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-08T09:49:53.354 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 6.827685300, 2024-05-08T09:49:53.354 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 1.702038057, 2024-05-08T09:49:53.354 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 3.651980989, 2024-05-08T09:49:53.354 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 1.086836398, 2024-05-08T09:49:53.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:53.355 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 19444, 2024-05-08T09:49:53.355 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.639915631, 2024-05-08T09:49:53.355 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000084340 2024-05-08T09:49:53.355 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.355 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:53.355 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.355 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.356 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T09:49:53.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T09:49:53.356 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.356 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:49:53.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 13053, 2024-05-08T09:49:53.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 15332, 2024-05-08T09:49:53.356 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 1538708249, 2024-05-08T09:49:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 8691410, 2024-05-08T09:49:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 16, 2024-05-08T09:49:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 7, 2024-05-08T09:49:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 6.918834309, 2024-05-08T09:49:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 1.095967733, 2024-05-08T09:49:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 4.883512136, 2024-05-08T09:49:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.672197547, 2024-05-08T09:49:53.357 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:53.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 15329, 2024-05-08T09:49:53.358 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 1.276263490, 2024-05-08T09:49:53.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000083258 2024-05-08T09:49:53.358 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.358 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:53.358 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.358 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.359 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 1440, 2024-05-08T09:49:53.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 4543352 2024-05-08T09:49:53.359 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.359 INFO:teuthology.orchestra.run.smithi172.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:49:53.359 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_messages": 11161, 2024-05-08T09:49:53.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages": 11128, 2024-05-08T09:49:53.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_bytes": 848766765, 2024-05-08T09:49:53.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_bytes": 4397175, 2024-05-08T09:49:53.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_created_connections": 7, 2024-05-08T09:49:53.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_active_connections": 4, 2024-05-08T09:49:53.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_total_time": 5.187461735, 2024-05-08T09:49:53.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_send_time": 0.973345179, 2024-05-08T09:49:53.360 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_recv_time": 3.468753068, 2024-05-08T09:49:53.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_running_fast_dispatch_time": 0.552749565, 2024-05-08T09:49:53.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:53.361 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 11128, 2024-05-08T09:49:53.361 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.966580397, 2024-05-08T09:49:53.361 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000086860 2024-05-08T09:49:53.361 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.361 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:53.361 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.362 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.362 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.362 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_recv_encrypted_bytes": 2786432, 2024-05-08T09:49:53.362 INFO:teuthology.orchestra.run.smithi172.stdout: "msgr_send_encrypted_bytes": 1922816 2024-05-08T09:49:53.362 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.362 INFO:teuthology.orchestra.run.smithi172.stdout: "cct": { 2024-05-08T09:49:53.362 INFO:teuthology.orchestra.run.smithi172.stdout: "total_workers": 1, 2024-05-08T09:49:53.363 INFO:teuthology.orchestra.run.smithi172.stdout: "unhealthy_workers": 0 2024-05-08T09:49:53.363 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.363 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-MDSRank": { 2024-05-08T09:49:53.363 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-08T09:49:53.363 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-08T09:49:53.363 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 65746, 2024-05-08T09:49:53.363 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 5.290983903, 2024-05-08T09:49:53.363 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000080476 2024-05-08T09:49:53.364 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:53.364 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.364 INFO:teuthology.orchestra.run.smithi172.stdout: "finisher-PurgeQueue": { 2024-05-08T09:49:53.364 INFO:teuthology.orchestra.run.smithi172.stdout: "queue_len": 0, 2024-05-08T09:49:53.364 INFO:teuthology.orchestra.run.smithi172.stdout: "complete_latency": { 2024-05-08T09:49:53.364 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.364 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.364 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.365 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:53.365 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.365 INFO:teuthology.orchestra.run.smithi172.stdout: "mds": { 2024-05-08T09:49:53.365 INFO:teuthology.orchestra.run.smithi172.stdout: "request": 0, 2024-05-08T09:49:53.365 INFO:teuthology.orchestra.run.smithi172.stdout: "reply": 0, 2024-05-08T09:49:53.365 INFO:teuthology.orchestra.run.smithi172.stdout: "reply_latency": { 2024-05-08T09:49:53.365 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.365 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.365 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.366 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.366 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_reply": 0, 2024-05-08T09:49:53.366 INFO:teuthology.orchestra.run.smithi172.stdout: "forward": 0, 2024-05-08T09:49:53.366 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_complete": 0, 2024-05-08T09:49:53.366 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_fetch_keys": 0, 2024-05-08T09:49:53.366 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_commit": 0, 2024-05-08T09:49:53.366 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_split": 0, 2024-05-08T09:49:53.367 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_merge": 0, 2024-05-08T09:49:53.367 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes": 118681, 2024-05-08T09:49:53.367 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_top": 57193, 2024-05-08T09:49:53.367 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_bottom": 61488, 2024-05-08T09:49:53.367 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pin_tail": 0, 2024-05-08T09:49:53.368 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_pinned": 36978, 2024-05-08T09:49:53.368 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_expired": 0, 2024-05-08T09:49:53.368 INFO:teuthology.orchestra.run.smithi172.stdout: "inodes_with_caps": 0, 2024-05-08T09:49:53.368 INFO:teuthology.orchestra.run.smithi172.stdout: "caps": 0, 2024-05-08T09:49:53.368 INFO:teuthology.orchestra.run.smithi172.stdout: "subtrees": 384, 2024-05-08T09:49:53.368 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse": 0, 2024-05-08T09:49:53.368 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_hit": 0, 2024-05-08T09:49:53.368 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_forward": 0, 2024-05-08T09:49:53.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_discover": 0, 2024-05-08T09:49:53.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_dir_fetch": 0, 2024-05-08T09:49:53.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_remote_ino": 0, 2024-05-08T09:49:53.369 INFO:teuthology.orchestra.run.smithi172.stdout: "traverse_lock": 0, 2024-05-08T09:49:53.369 INFO:teuthology.orchestra.run.smithi172.stdout: "load_cent": 0, 2024-05-08T09:49:53.369 INFO:teuthology.orchestra.run.smithi172.stdout: "q": 0, 2024-05-08T09:49:53.369 INFO:teuthology.orchestra.run.smithi172.stdout: "exported": 0, 2024-05-08T09:49:53.369 INFO:teuthology.orchestra.run.smithi172.stdout: "exported_inodes": 0, 2024-05-08T09:49:53.370 INFO:teuthology.orchestra.run.smithi172.stdout: "imported": 0, 2024-05-08T09:49:53.370 INFO:teuthology.orchestra.run.smithi172.stdout: "imported_inodes": 0, 2024-05-08T09:49:53.370 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_dir_fetch": 0, 2024-05-08T09:49:53.370 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_backtrace_fetch": 0, 2024-05-08T09:49:53.370 INFO:teuthology.orchestra.run.smithi172.stdout: "openino_peer_discover": 0, 2024-05-08T09:49:53.370 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rfiles": 80484, 2024-05-08T09:49:53.370 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rbytes": 1787463338, 2024-05-08T09:49:53.370 INFO:teuthology.orchestra.run.smithi172.stdout: "root_rsnaps": 9, 2024-05-08T09:49:53.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T09:49:53.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_set_tag": 0, 2024-05-08T09:49:53.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T09:49:53.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_inotable_repaired": 0, 2024-05-08T09:49:53.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_inodes": 0, 2024-05-08T09:49:53.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T09:49:53.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T09:49:53.371 INFO:teuthology.orchestra.run.smithi172.stdout: "scrub_file_inodes": 0, 2024-05-08T09:49:53.372 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_inode_file_caps": 0, 2024-05-08T09:49:53.372 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T09:49:53.372 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_grant": 0, 2024-05-08T09:49:53.372 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T09:49:53.372 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T09:49:53.372 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T09:49:53.372 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps": 0, 2024-05-08T09:49:53.372 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_caps_dirty": 0, 2024-05-08T09:49:53.372 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_cap_release": 0, 2024-05-08T09:49:53.373 INFO:teuthology.orchestra.run.smithi172.stdout: "process_request_cap_release": 0 2024-05-08T09:49:53.373 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.373 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_cache": { 2024-05-08T09:49:53.373 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update": 0, 2024-05-08T09:49:53.373 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_update_receipt": 0, 2024-05-08T09:49:53.373 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_try_discover": 0, 2024-05-08T09:49:53.373 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_send_discover": 0, 2024-05-08T09:49:53.373 INFO:teuthology.orchestra.run.smithi172.stdout: "dir_handle_discover": 0, 2024-05-08T09:49:53.374 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays": 0, 2024-05-08T09:49:53.374 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_delayed": 0, 2024-05-08T09:49:53.374 INFO:teuthology.orchestra.run.smithi172.stdout: "num_strays_enqueuing": 0, 2024-05-08T09:49:53.374 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_created": 0, 2024-05-08T09:49:53.374 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_enqueued": 0, 2024-05-08T09:49:53.374 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_reintegrated": 0, 2024-05-08T09:49:53.374 INFO:teuthology.orchestra.run.smithi172.stdout: "strays_migrated": 0, 2024-05-08T09:49:53.374 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_processing": 0, 2024-05-08T09:49:53.375 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_enqueued": 0, 2024-05-08T09:49:53.375 INFO:teuthology.orchestra.run.smithi172.stdout: "num_recovering_prioritized": 0, 2024-05-08T09:49:53.375 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_started": 0, 2024-05-08T09:49:53.375 INFO:teuthology.orchestra.run.smithi172.stdout: "recovery_completed": 0, 2024-05-08T09:49:53.375 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_path": 0, 2024-05-08T09:49:53.375 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_quiesce_inode": 0, 2024-05-08T09:49:53.375 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T09:49:53.375 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_exportdir": 0, 2024-05-08T09:49:53.375 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_flush": 0, 2024-05-08T09:49:53.376 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragmentdir": 0, 2024-05-08T09:49:53.376 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_fragstats": 0, 2024-05-08T09:49:53.376 INFO:teuthology.orchestra.run.smithi172.stdout: "ireq_inodestats": 0 2024-05-08T09:49:53.376 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.376 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_log": { 2024-05-08T09:49:53.376 INFO:teuthology.orchestra.run.smithi172.stdout: "evlrg": 0, 2024-05-08T09:49:53.376 INFO:teuthology.orchestra.run.smithi172.stdout: "evadd": 0, 2024-05-08T09:49:53.376 INFO:teuthology.orchestra.run.smithi172.stdout: "evex": 0, 2024-05-08T09:49:53.376 INFO:teuthology.orchestra.run.smithi172.stdout: "evtrm": 0, 2024-05-08T09:49:53.377 INFO:teuthology.orchestra.run.smithi172.stdout: "ev": 742160, 2024-05-08T09:49:53.377 INFO:teuthology.orchestra.run.smithi172.stdout: "evexg": 0, 2024-05-08T09:49:53.377 INFO:teuthology.orchestra.run.smithi172.stdout: "evexd": 0, 2024-05-08T09:49:53.377 INFO:teuthology.orchestra.run.smithi172.stdout: "segadd": 0, 2024-05-08T09:49:53.377 INFO:teuthology.orchestra.run.smithi172.stdout: "segex": 0, 2024-05-08T09:49:53.377 INFO:teuthology.orchestra.run.smithi172.stdout: "segtrm": 0, 2024-05-08T09:49:53.377 INFO:teuthology.orchestra.run.smithi172.stdout: "seg": 142, 2024-05-08T09:49:53.377 INFO:teuthology.orchestra.run.smithi172.stdout: "segmjr": 62, 2024-05-08T09:49:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: "segexg": 0, 2024-05-08T09:49:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: "segexd": 0, 2024-05-08T09:49:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: "expos": 2719374860, 2024-05-08T09:49:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: "wrpos": 3244706228, 2024-05-08T09:49:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: "rdpos": 3244706092, 2024-05-08T09:49:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: "jlat": { 2024-05-08T09:49:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.378 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.379 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.379 INFO:teuthology.orchestra.run.smithi172.stdout: "replayed": 742160 2024-05-08T09:49:53.379 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.379 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_mem": { 2024-05-08T09:49:53.379 INFO:teuthology.orchestra.run.smithi172.stdout: "ino": 91655, 2024-05-08T09:49:53.379 INFO:teuthology.orchestra.run.smithi172.stdout: "ino+": 113339, 2024-05-08T09:49:53.379 INFO:teuthology.orchestra.run.smithi172.stdout: "ino-": 21684, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "dir": 6068, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "dir+": 6703, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "dir-": 635, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "dn": 118681, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "dn+": 128335, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "dn-": 9654, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "cap": 0, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "cap+": 0, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "cap-": 0, 2024-05-08T09:49:53.380 INFO:teuthology.orchestra.run.smithi172.stdout: "rss": 382864, 2024-05-08T09:49:53.381 INFO:teuthology.orchestra.run.smithi172.stdout: "heap": 215416 2024-05-08T09:49:53.381 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.381 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_server": { 2024-05-08T09:49:53.381 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_client_request": 0, 2024-05-08T09:49:53.381 INFO:teuthology.orchestra.run.smithi172.stdout: "dispatch_server_request": 0, 2024-05-08T09:49:53.381 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_request": 0, 2024-05-08T09:49:53.381 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_client_session": 0, 2024-05-08T09:49:53.381 INFO:teuthology.orchestra.run.smithi172.stdout: "handle_peer_request": 0, 2024-05-08T09:49:53.382 INFO:teuthology.orchestra.run.smithi172.stdout: "req_create_latency": { 2024-05-08T09:49:53.382 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.382 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.382 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.382 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.382 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getattr_latency": { 2024-05-08T09:49:53.382 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.382 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.382 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.383 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getfilelock_latency": { 2024-05-08T09:49:53.383 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.383 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.383 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.383 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.383 INFO:teuthology.orchestra.run.smithi172.stdout: "req_link_latency": { 2024-05-08T09:49:53.383 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.384 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.384 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.384 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookup_latency": { 2024-05-08T09:49:53.384 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.384 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.384 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.384 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.384 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookuphash_latency": { 2024-05-08T09:49:53.385 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.385 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.385 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.385 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupino_latency": { 2024-05-08T09:49:53.385 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.385 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.385 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.385 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.386 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupname_latency": { 2024-05-08T09:49:53.386 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.386 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.386 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.386 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.386 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupparent_latency": { 2024-05-08T09:49:53.386 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.387 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.387 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.387 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lookupsnap_latency": { 2024-05-08T09:49:53.387 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.387 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.387 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.387 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.387 INFO:teuthology.orchestra.run.smithi172.stdout: "req_lssnap_latency": { 2024-05-08T09:49:53.388 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.388 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.388 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.389 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mkdir_latency": { 2024-05-08T09:49:53.389 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.389 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.389 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.389 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.389 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mknod_latency": { 2024-05-08T09:49:53.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.390 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.390 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.390 INFO:teuthology.orchestra.run.smithi172.stdout: "req_mksnap_latency": { 2024-05-08T09:49:53.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.390 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.390 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.391 INFO:teuthology.orchestra.run.smithi172.stdout: "req_open_latency": { 2024-05-08T09:49:53.391 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.391 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.391 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.391 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.391 INFO:teuthology.orchestra.run.smithi172.stdout: "req_readdir_latency": { 2024-05-08T09:49:53.391 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rename_latency": { 2024-05-08T09:49:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.392 INFO:teuthology.orchestra.run.smithi172.stdout: "req_renamesnap_latency": { 2024-05-08T09:49:53.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.393 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.393 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.393 INFO:teuthology.orchestra.run.smithi172.stdout: "req_snapdiff_latency": { 2024-05-08T09:49:53.393 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.394 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.394 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.394 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmdir_latency": { 2024-05-08T09:49:53.394 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.394 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.394 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.394 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.395 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmsnap_latency": { 2024-05-08T09:49:53.395 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.395 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.395 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.395 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.395 INFO:teuthology.orchestra.run.smithi172.stdout: "req_rmxattr_latency": { 2024-05-08T09:49:53.395 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.395 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.396 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setattr_latency": { 2024-05-08T09:49:53.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.396 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.396 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.396 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setdirlayout_latency": { 2024-05-08T09:49:53.396 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.397 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.397 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setfilelock_latency": { 2024-05-08T09:49:53.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.397 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.397 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.397 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.398 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setlayout_latency": { 2024-05-08T09:49:53.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.398 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.398 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.398 INFO:teuthology.orchestra.run.smithi172.stdout: "req_setxattr_latency": { 2024-05-08T09:49:53.398 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.398 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.399 INFO:teuthology.orchestra.run.smithi172.stdout: "req_symlink_latency": { 2024-05-08T09:49:53.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.399 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.399 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.399 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.399 INFO:teuthology.orchestra.run.smithi172.stdout: "req_unlink_latency": { 2024-05-08T09:49:53.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.400 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.400 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.400 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_revoke_eviction": 0, 2024-05-08T09:49:53.400 INFO:teuthology.orchestra.run.smithi172.stdout: "cap_acquisition_throttle": 0, 2024-05-08T09:49:53.400 INFO:teuthology.orchestra.run.smithi172.stdout: "req_getvxattr_latency": { 2024-05-08T09:49:53.400 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.401 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.401 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.401 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:53.401 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.401 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_sessions": { 2024-05-08T09:49:53.401 INFO:teuthology.orchestra.run.smithi172.stdout: "session_count": 2, 2024-05-08T09:49:53.401 INFO:teuthology.orchestra.run.smithi172.stdout: "session_add": 7, 2024-05-08T09:49:53.401 INFO:teuthology.orchestra.run.smithi172.stdout: "session_remove": 5, 2024-05-08T09:49:53.402 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_open": 5, 2024-05-08T09:49:53.402 INFO:teuthology.orchestra.run.smithi172.stdout: "sessions_stale": 0, 2024-05-08T09:49:53.402 INFO:teuthology.orchestra.run.smithi172.stdout: "total_load": 0, 2024-05-08T09:49:53.402 INFO:teuthology.orchestra.run.smithi172.stdout: "average_load": 0, 2024-05-08T09:49:53.402 INFO:teuthology.orchestra.run.smithi172.stdout: "avg_session_uptime": 15203, 2024-05-08T09:49:53.402 INFO:teuthology.orchestra.run.smithi172.stdout: "mdthresh_evicted": 0 2024-05-08T09:49:53.402 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.402 INFO:teuthology.orchestra.run.smithi172.stdout: "mempool": { 2024-05-08T09:49:53.403 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:49:53.403 INFO:teuthology.orchestra.run.smithi172.stdout: "bloom_filter_items": 0, 2024-05-08T09:49:53.403 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:49:53.403 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:49:53.403 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:49:53.403 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:49:53.403 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:49:53.403 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:49:53.403 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:49:53.404 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:49:53.404 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:49:53.404 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:49:53.404 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:49:53.404 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:49:53.404 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:49:53.404 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_extent_items": 0, 2024-05-08T09:49:53.404 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:49:53.405 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_blob_items": 0, 2024-05-08T09:49:53.405 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:49:53.405 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:49:53.405 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:49:53.405 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:49:53.405 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:49:53.405 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:49:53.405 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:49:53.406 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_txc_items": 0, 2024-05-08T09:49:53.406 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:49:53.406 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:49:53.406 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:49:53.406 INFO:teuthology.orchestra.run.smithi172.stdout: "bluestore_writing_items": 0, 2024-05-08T09:49:53.406 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_bytes": 0, 2024-05-08T09:49:53.406 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_items": 0, 2024-05-08T09:49:53.406 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:49:53.407 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:49:53.407 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:49:53.407 INFO:teuthology.orchestra.run.smithi172.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:49:53.407 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_bytes": 243425, 2024-05-08T09:49:53.407 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_anon_items": 90, 2024-05-08T09:49:53.407 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:49:53.407 INFO:teuthology.orchestra.run.smithi172.stdout: "buffer_meta_items": 0, 2024-05-08T09:49:53.407 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_bytes": 0, 2024-05-08T09:49:53.408 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_items": 0, 2024-05-08T09:49:53.408 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:49:53.408 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_mapbl_items": 0, 2024-05-08T09:49:53.408 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:49:53.408 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_pglog_items": 0, 2024-05-08T09:49:53.408 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_bytes": 9800, 2024-05-08T09:49:53.408 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_items": 188, 2024-05-08T09:49:53.408 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:49:53.409 INFO:teuthology.orchestra.run.smithi172.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:49:53.409 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_bytes": 0, 2024-05-08T09:49:53.409 INFO:teuthology.orchestra.run.smithi172.stdout: "pgmap_items": 0, 2024-05-08T09:49:53.409 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_bytes": 289925791, 2024-05-08T09:49:53.409 INFO:teuthology.orchestra.run.smithi172.stdout: "mds_co_items": 1596417, 2024-05-08T09:49:53.409 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_bytes": 0, 2024-05-08T09:49:53.409 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_1_items": 0, 2024-05-08T09:49:53.409 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_bytes": 0, 2024-05-08T09:49:53.410 INFO:teuthology.orchestra.run.smithi172.stdout: "unittest_2_items": 0 2024-05-08T09:49:53.410 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.410 INFO:teuthology.orchestra.run.smithi172.stdout: "objecter": { 2024-05-08T09:49:53.410 INFO:teuthology.orchestra.run.smithi172.stdout: "op_active": 0, 2024-05-08T09:49:53.410 INFO:teuthology.orchestra.run.smithi172.stdout: "op_laggy": 0, 2024-05-08T09:49:53.410 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send": 40269, 2024-05-08T09:49:53.410 INFO:teuthology.orchestra.run.smithi172.stdout: "op_send_bytes": 26, 2024-05-08T09:49:53.410 INFO:teuthology.orchestra.run.smithi172.stdout: "op_resend": 4, 2024-05-08T09:49:53.410 INFO:teuthology.orchestra.run.smithi172.stdout: "op_reply": 40269, 2024-05-08T09:49:53.411 INFO:teuthology.orchestra.run.smithi172.stdout: "op_latency": { 2024-05-08T09:49:53.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 40269, 2024-05-08T09:49:53.411 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 75.860187553, 2024-05-08T09:49:53.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.001883835 2024-05-08T09:49:53.411 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.411 INFO:teuthology.orchestra.run.smithi172.stdout: "op_inflight": 0, 2024-05-08T09:49:53.411 INFO:teuthology.orchestra.run.smithi172.stdout: "oplen_avg": { 2024-05-08T09:49:53.411 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 40269, 2024-05-08T09:49:53.412 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 40270 2024-05-08T09:49:53.412 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.412 INFO:teuthology.orchestra.run.smithi172.stdout: "op": 40269, 2024-05-08T09:49:53.412 INFO:teuthology.orchestra.run.smithi172.stdout: "op_r": 40269, 2024-05-08T09:49:53.412 INFO:teuthology.orchestra.run.smithi172.stdout: "op_w": 0, 2024-05-08T09:49:53.412 INFO:teuthology.orchestra.run.smithi172.stdout: "op_rmw": 0, 2024-05-08T09:49:53.412 INFO:teuthology.orchestra.run.smithi172.stdout: "op_pg": 0, 2024-05-08T09:49:53.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_stat": 24002, 2024-05-08T09:49:53.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_create": 0, 2024-05-08T09:49:53.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_read": 16264, 2024-05-08T09:49:53.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_write": 0, 2024-05-08T09:49:53.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writefull": 0, 2024-05-08T09:49:53.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_writesame": 0, 2024-05-08T09:49:53.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_append": 0, 2024-05-08T09:49:53.413 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_zero": 0, 2024-05-08T09:49:53.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_truncate": 0, 2024-05-08T09:49:53.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_delete": 0, 2024-05-08T09:49:53.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_mapext": 0, 2024-05-08T09:49:53.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_sparse_read": 0, 2024-05-08T09:49:53.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_clonerange": 0, 2024-05-08T09:49:53.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_getxattr": 2, 2024-05-08T09:49:53.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_setxattr": 0, 2024-05-08T09:49:53.414 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_cmpxattr": 0, 2024-05-08T09:49:53.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_rmxattr": 0, 2024-05-08T09:49:53.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_resetxattrs": 0, 2024-05-08T09:49:53.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_call": 0, 2024-05-08T09:49:53.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_watch": 0, 2024-05-08T09:49:53.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_notify": 0, 2024-05-08T09:49:53.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T09:49:53.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls": 0, 2024-05-08T09:49:53.415 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_pgls_filter": 0, 2024-05-08T09:49:53.416 INFO:teuthology.orchestra.run.smithi172.stdout: "osdop_other": 0, 2024-05-08T09:49:53.416 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_active": 0, 2024-05-08T09:49:53.416 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_send": 0, 2024-05-08T09:49:53.416 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_resend": 0, 2024-05-08T09:49:53.416 INFO:teuthology.orchestra.run.smithi172.stdout: "linger_ping": 0, 2024-05-08T09:49:53.416 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_active": 0, 2024-05-08T09:49:53.416 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_send": 0, 2024-05-08T09:49:53.416 INFO:teuthology.orchestra.run.smithi172.stdout: "poolop_resend": 0, 2024-05-08T09:49:53.417 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_active": 0, 2024-05-08T09:49:53.417 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_send": 0, 2024-05-08T09:49:53.417 INFO:teuthology.orchestra.run.smithi172.stdout: "poolstat_resend": 0, 2024-05-08T09:49:53.417 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_active": 0, 2024-05-08T09:49:53.417 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_send": 0, 2024-05-08T09:49:53.417 INFO:teuthology.orchestra.run.smithi172.stdout: "statfs_resend": 0, 2024-05-08T09:49:53.417 INFO:teuthology.orchestra.run.smithi172.stdout: "command_active": 0, 2024-05-08T09:49:53.417 INFO:teuthology.orchestra.run.smithi172.stdout: "command_send": 0, 2024-05-08T09:49:53.417 INFO:teuthology.orchestra.run.smithi172.stdout: "command_resend": 0, 2024-05-08T09:49:53.418 INFO:teuthology.orchestra.run.smithi172.stdout: "map_epoch": 444, 2024-05-08T09:49:53.418 INFO:teuthology.orchestra.run.smithi172.stdout: "map_full": 0, 2024-05-08T09:49:53.418 INFO:teuthology.orchestra.run.smithi172.stdout: "map_inc": 354, 2024-05-08T09:49:53.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_sessions": 11, 2024-05-08T09:49:53.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_open": 19, 2024-05-08T09:49:53.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_session_close": 8, 2024-05-08T09:49:53.418 INFO:teuthology.orchestra.run.smithi172.stdout: "osd_laggy": 0, 2024-05-08T09:49:53.418 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_wr": 0, 2024-05-08T09:49:53.419 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_rd": 2, 2024-05-08T09:49:53.419 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_del": 0 2024-05-08T09:49:53.419 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.419 INFO:teuthology.orchestra.run.smithi172.stdout: "oft": { 2024-05-08T09:49:53.419 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_objs": 0, 2024-05-08T09:49:53.419 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_kv_pairs": 0, 2024-05-08T09:49:53.419 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_updates": 0, 2024-05-08T09:49:53.419 INFO:teuthology.orchestra.run.smithi172.stdout: "omap_total_removes": 0 2024-05-08T09:49:53.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.420 INFO:teuthology.orchestra.run.smithi172.stdout: "osd-slow-ops": { 2024-05-08T09:49:53.420 INFO:teuthology.orchestra.run.smithi172.stdout: "slow_ops_count": 0 2024-05-08T09:49:53.420 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.420 INFO:teuthology.orchestra.run.smithi172.stdout: "purge_queue": { 2024-05-08T09:49:53.420 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops": 0, 2024-05-08T09:49:53.420 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T09:49:53.420 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing": 0, 2024-05-08T09:49:53.420 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executing_high_water": 0, 2024-05-08T09:49:53.421 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed_ops": 0, 2024-05-08T09:49:53.421 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_executed": 0, 2024-05-08T09:49:53.421 INFO:teuthology.orchestra.run.smithi172.stdout: "pq_item_in_journal": 0 2024-05-08T09:49:53.421 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.421 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:49:53.421 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:53.421 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-08T09:49:53.421 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:53.422 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 43654, 2024-05-08T09:49:53.422 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 3315684633, 2024-05-08T09:49:53.422 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:53.422 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 43654, 2024-05-08T09:49:53.422 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:53.422 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:53.422 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 43654, 2024-05-08T09:49:53.422 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3315684633, 2024-05-08T09:49:53.423 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:53.423 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.423 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.423 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.423 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:53.423 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.423 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_bytes": { 2024-05-08T09:49:53.423 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 104857600, 2024-05-08T09:49:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 40269, 2024-05-08T09:49:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 3305817906, 2024-05-08T09:49:53.424 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 40269, 2024-05-08T09:49:53.425 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 3305817906, 2024-05-08T09:49:53.425 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:53.425 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.425 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.425 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.425 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:53.425 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.425 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-objecter_ops": { 2024-05-08T09:49:53.426 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:53.426 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 1024, 2024-05-08T09:49:53.426 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:53.426 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:53.426 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:53.426 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:53.426 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:53.426 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 40269, 2024-05-08T09:49:53.427 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 40269, 2024-05-08T09:49:53.427 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 40269, 2024-05-08T09:49:53.427 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 40269, 2024-05-08T09:49:53.427 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:53.427 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.427 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.427 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.427 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:53.428 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.428 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle": { 2024-05-08T09:49:53.428 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:53.428 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-08T09:49:53.428 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:53.428 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:53.428 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:53.428 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:53.429 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:53.429 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:53.429 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:53.429 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-08T09:49:53.429 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-08T09:49:53.429 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:53.429 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.429 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.430 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.430 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:53.430 INFO:teuthology.orchestra.run.smithi172.stdout: }, 2024-05-08T09:49:53.430 INFO:teuthology.orchestra.run.smithi172.stdout: "throttle-write_buf_throttle-0x5585f75f8780": { 2024-05-08T09:49:53.430 INFO:teuthology.orchestra.run.smithi172.stdout: "val": 0, 2024-05-08T09:49:53.430 INFO:teuthology.orchestra.run.smithi172.stdout: "max": 3758096384, 2024-05-08T09:49:53.430 INFO:teuthology.orchestra.run.smithi172.stdout: "get_started": 0, 2024-05-08T09:49:53.431 INFO:teuthology.orchestra.run.smithi172.stdout: "get": 0, 2024-05-08T09:49:53.431 INFO:teuthology.orchestra.run.smithi172.stdout: "get_sum": 0, 2024-05-08T09:49:53.431 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:53.431 INFO:teuthology.orchestra.run.smithi172.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:53.431 INFO:teuthology.orchestra.run.smithi172.stdout: "take": 0, 2024-05-08T09:49:53.431 INFO:teuthology.orchestra.run.smithi172.stdout: "take_sum": 0, 2024-05-08T09:49:53.431 INFO:teuthology.orchestra.run.smithi172.stdout: "put": 0, 2024-05-08T09:49:53.431 INFO:teuthology.orchestra.run.smithi172.stdout: "put_sum": 0, 2024-05-08T09:49:53.432 INFO:teuthology.orchestra.run.smithi172.stdout: "wait": { 2024-05-08T09:49:53.432 INFO:teuthology.orchestra.run.smithi172.stdout: "avgcount": 0, 2024-05-08T09:49:53.432 INFO:teuthology.orchestra.run.smithi172.stdout: "sum": 0.000000000, 2024-05-08T09:49:53.432 INFO:teuthology.orchestra.run.smithi172.stdout: "avgtime": 0.000000000 2024-05-08T09:49:53.432 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:53.432 INFO:teuthology.orchestra.run.smithi172.stdout: } 2024-05-08T09:49:53.432 INFO:teuthology.orchestra.run.smithi172.stdout:} 2024-05-08T09:49:54.277 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-05-08T09:49:54.277 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-05-08T09:49:54.277 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=9 2024-05-08T09:49:54.277 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-05-08T09:49:54.277 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T09:49:54.278 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-05-08T09:49:54.278 DEBUG:tasks.check_counter:Getting stats from c 2024-05-08T09:49:54.278 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-08T09:49:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T09:49:55.090 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:54 smithi194 ceph-mon[33679]: pgmap v5852: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T09:49:55.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:54 smithi070 ceph-mon[29591]: pgmap v5852: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T09:49:55.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:54 smithi172 ceph-mon[33377]: pgmap v5852: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-08T09:49:56.805 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-05-08T09:49:56.806 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:49:56.806 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 8985, 2024-05-08T09:49:56.806 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 8987, 2024-05-08T09:49:56.806 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 10714882, 2024-05-08T09:49:56.806 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 2857294, 2024-05-08T09:49:56.809 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 29, 2024-05-08T09:49:56.809 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2024-05-08T09:49:56.810 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 1.988794655, 2024-05-08T09:49:56.810 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.684976509, 2024-05-08T09:49:56.810 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.547319670, 2024-05-08T09:49:56.810 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.536800400, 2024-05-08T09:49:56.810 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:56.810 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 8985, 2024-05-08T09:49:56.810 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.850789416, 2024-05-08T09:49:56.810 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000094689 2024-05-08T09:49:56.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.811 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:56.811 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.811 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.811 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.811 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.811 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T09:49:56.811 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T09:49:56.812 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.812 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:49:56.812 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 14871, 2024-05-08T09:49:56.812 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 14840, 2024-05-08T09:49:56.812 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 14888421, 2024-05-08T09:49:56.812 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 5576331, 2024-05-08T09:49:56.812 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 14, 2024-05-08T09:49:56.812 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2024-05-08T09:49:56.812 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 3.928302724, 2024-05-08T09:49:56.813 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 1.640511019, 2024-05-08T09:49:56.813 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 1.028590367, 2024-05-08T09:49:56.813 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.930032472, 2024-05-08T09:49:56.813 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:56.813 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 14839, 2024-05-08T09:49:56.813 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.357630934, 2024-05-08T09:49:56.813 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000091490 2024-05-08T09:49:56.813 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 2785632, 2024-05-08T09:49:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 1919008 2024-05-08T09:49:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.814 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:49:56.815 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 13982, 2024-05-08T09:49:56.815 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 16255, 2024-05-08T09:49:56.815 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 8669238, 2024-05-08T09:49:56.815 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 9167150, 2024-05-08T09:49:56.815 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 21, 2024-05-08T09:49:56.815 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 5, 2024-05-08T09:49:56.815 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 3.330172226, 2024-05-08T09:49:56.815 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 1.281754333, 2024-05-08T09:49:56.816 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.805347240, 2024-05-08T09:49:56.816 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.853868400, 2024-05-08T09:49:56.816 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:49:56.816 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 16253, 2024-05-08T09:49:56.816 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 1.713384896, 2024-05-08T09:49:56.816 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000105419 2024-05-08T09:49:56.816 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.816 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:49:56.816 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 4400, 2024-05-08T09:49:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 4725008 2024-05-08T09:49:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-05-08T09:49:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-05-08T09:49:56.817 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-05-08T09:49:56.818 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.818 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-05-08T09:49:56.818 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-05-08T09:49:56.818 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-05-08T09:49:56.818 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 56506, 2024-05-08T09:49:56.818 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 3.576005461, 2024-05-08T09:49:56.818 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000063285 2024-05-08T09:49:56.818 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:49:56.819 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.819 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-05-08T09:49:56.819 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-05-08T09:49:56.819 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-05-08T09:49:56.819 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.819 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.819 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.820 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:49:56.820 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.820 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-05-08T09:49:56.820 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 0, 2024-05-08T09:49:56.820 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 0, 2024-05-08T09:49:56.820 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-05-08T09:49:56.820 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.820 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.820 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.821 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.821 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-05-08T09:49:56.821 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 0, 2024-05-08T09:49:56.821 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2024-05-08T09:49:56.821 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2024-05-08T09:49:56.821 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 0, 2024-05-08T09:49:56.821 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2024-05-08T09:49:56.821 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-05-08T09:49:56.821 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 5308, 2024-05-08T09:49:56.822 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 0, 2024-05-08T09:49:56.822 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 5308, 2024-05-08T09:49:56.822 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 0, 2024-05-08T09:49:56.822 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 5308, 2024-05-08T09:49:56.822 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 0, 2024-05-08T09:49:56.822 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2024-05-08T09:49:56.822 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2024-05-08T09:49:56.822 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 208, 2024-05-08T09:49:56.823 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 0, 2024-05-08T09:49:56.823 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 0, 2024-05-08T09:49:56.823 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 0, 2024-05-08T09:49:56.823 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 0, 2024-05-08T09:49:56.823 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2024-05-08T09:49:56.823 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-05-08T09:49:56.823 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2024-05-08T09:49:56.823 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-05-08T09:49:56.824 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-05-08T09:49:56.824 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 0, 2024-05-08T09:49:56.824 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 0, 2024-05-08T09:49:56.824 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 0, 2024-05-08T09:49:56.824 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 0, 2024-05-08T09:49:56.824 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-05-08T09:49:56.824 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2024-05-08T09:49:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-05-08T09:49:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 0, 2024-05-08T09:49:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 0, 2024-05-08T09:49:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 0, 2024-05-08T09:49:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T09:49:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-05-08T09:49:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T09:49:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-05-08T09:49:56.825 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2024-05-08T09:49:56.826 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T09:49:56.826 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T09:49:56.826 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2024-05-08T09:49:56.826 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2024-05-08T09:49:56.826 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T09:49:56.826 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 0, 2024-05-08T09:49:56.826 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T09:49:56.827 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T09:49:56.827 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T09:49:56.827 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 0, 2024-05-08T09:49:56.827 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 0, 2024-05-08T09:49:56.827 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 0, 2024-05-08T09:49:56.827 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 0 2024-05-08T09:49:56.827 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.827 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-05-08T09:49:56.828 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2024-05-08T09:49:56.828 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2024-05-08T09:49:56.828 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2024-05-08T09:49:56.828 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 0, 2024-05-08T09:49:56.828 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 0, 2024-05-08T09:49:56.828 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2024-05-08T09:49:56.828 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-05-08T09:49:56.828 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-05-08T09:49:56.829 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 0, 2024-05-08T09:49:56.829 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 0, 2024-05-08T09:49:56.829 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-05-08T09:49:56.829 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-05-08T09:49:56.829 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-05-08T09:49:56.829 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-05-08T09:49:56.829 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-05-08T09:49:56.829 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-05-08T09:49:56.829 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-05-08T09:49:56.830 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_path": 0, 2024-05-08T09:49:56.830 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_inode": 0, 2024-05-08T09:49:56.830 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T09:49:56.830 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 0, 2024-05-08T09:49:56.830 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-05-08T09:49:56.830 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2024-05-08T09:49:56.830 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-05-08T09:49:56.830 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2024-05-08T09:49:56.831 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.831 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-05-08T09:49:56.831 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2024-05-08T09:49:56.831 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 0, 2024-05-08T09:49:56.831 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2024-05-08T09:49:56.831 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2024-05-08T09:49:56.831 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 10664, 2024-05-08T09:49:56.832 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-05-08T09:49:56.832 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2024-05-08T09:49:56.832 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 0, 2024-05-08T09:49:56.832 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2024-05-08T09:49:56.832 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2024-05-08T09:49:56.832 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 15, 2024-05-08T09:49:56.832 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 2, 2024-05-08T09:49:56.832 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-05-08T09:49:56.832 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2024-05-08T09:49:56.833 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2024-05-08T09:49:56.833 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 26009489, 2024-05-08T09:49:56.833 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 25983751, 2024-05-08T09:49:56.833 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-05-08T09:49:56.833 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.833 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.833 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.833 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.834 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 10664 2024-05-08T09:49:56.834 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.834 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-05-08T09:49:56.834 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 4735, 2024-05-08T09:49:56.834 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 5222, 2024-05-08T09:49:56.834 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 487, 2024-05-08T09:49:56.834 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 583, 2024-05-08T09:49:56.834 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 655, 2024-05-08T09:49:56.834 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 72, 2024-05-08T09:49:56.835 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 5308, 2024-05-08T09:49:56.835 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 5576, 2024-05-08T09:49:56.835 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 268, 2024-05-08T09:49:56.835 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2024-05-08T09:49:56.835 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 0, 2024-05-08T09:49:56.835 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 0, 2024-05-08T09:49:56.835 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 70996, 2024-05-08T09:49:56.835 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 215416 2024-05-08T09:49:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-05-08T09:49:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 0, 2024-05-08T09:49:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 0, 2024-05-08T09:49:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 0, 2024-05-08T09:49:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 0, 2024-05-08T09:49:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 0, 2024-05-08T09:49:56.836 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-05-08T09:49:56.837 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.837 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.837 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.837 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-05-08T09:49:56.837 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.837 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.837 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.837 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.838 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-05-08T09:49:56.838 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.838 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.838 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.838 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.838 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-05-08T09:49:56.838 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.838 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-05-08T09:49:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-05-08T09:49:56.839 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.840 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.840 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.840 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.840 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-05-08T09:49:56.840 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.840 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.841 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.841 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-05-08T09:49:56.841 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.841 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.841 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.841 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.841 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-05-08T09:49:56.842 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.842 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.842 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.842 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.842 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-05-08T09:49:56.842 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.842 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.842 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.843 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-05-08T09:49:56.843 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.843 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.843 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.843 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.844 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-05-08T09:49:56.844 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.844 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.844 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.845 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-05-08T09:49:56.845 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.845 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.845 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.845 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.845 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-05-08T09:49:56.845 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.846 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.846 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.846 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-05-08T09:49:56.846 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.846 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.846 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.846 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.847 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-05-08T09:49:56.847 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.847 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.847 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.847 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.847 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-05-08T09:49:56.847 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.847 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.848 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.848 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-05-08T09:49:56.848 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.848 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.848 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.848 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.849 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-05-08T09:49:56.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.849 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.849 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.849 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-05-08T09:49:56.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.849 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.849 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.850 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-05-08T09:49:56.850 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.850 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.850 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.850 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.850 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-05-08T09:49:56.851 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.851 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.851 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.851 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.851 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-05-08T09:49:56.851 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.851 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.851 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-05-08T09:49:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-05-08T09:49:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.852 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-05-08T09:49:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-05-08T09:49:56.853 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-05-08T09:49:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.854 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-05-08T09:49:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-05-08T09:49:56.855 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-05-08T09:49:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-05-08T09:49:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:49:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-05-08T09:49:56.856 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 2, 2024-05-08T09:49:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 3, 2024-05-08T09:49:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 1, 2024-05-08T09:49:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 2, 2024-05-08T09:49:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-05-08T09:49:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 0, 2024-05-08T09:49:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 0, 2024-05-08T09:49:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 12702, 2024-05-08T09:49:56.857 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-05-08T09:49:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-05-08T09:49:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:49:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-05-08T09:49:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:49:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:49:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:49:56.858 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:49:56.859 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-05-08T09:49:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:49:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-05-08T09:49:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:49:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:49:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:49:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:49:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:49:56.860 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:49:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:49:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-05-08T09:49:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:49:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:49:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:49:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-05-08T09:49:56.861 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-05-08T09:49:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-05-08T09:49:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:49:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:49:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:49:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:49:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 210258, 2024-05-08T09:49:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 71, 2024-05-08T09:49:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:49:56.862 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-05-08T09:49:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-05-08T09:49:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-05-08T09:49:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:49:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-05-08T09:49:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:49:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-05-08T09:49:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9800, 2024-05-08T09:49:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 188, 2024-05-08T09:49:56.863 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:49:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:49:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-05-08T09:49:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-05-08T09:49:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 14809864, 2024-05-08T09:49:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 70752, 2024-05-08T09:49:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-05-08T09:49:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-05-08T09:49:56.864 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-05-08T09:49:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-05-08T09:49:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-05-08T09:49:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-05-08T09:49:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-05-08T09:49:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 34455, 2024-05-08T09:49:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 21, 2024-05-08T09:49:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 3, 2024-05-08T09:49:56.865 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 34455, 2024-05-08T09:49:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-05-08T09:49:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 34455, 2024-05-08T09:49:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 43.393115737, 2024-05-08T09:49:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001259414 2024-05-08T09:49:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-05-08T09:49:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-05-08T09:49:56.866 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 34455, 2024-05-08T09:49:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 34456 2024-05-08T09:49:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 34455, 2024-05-08T09:49:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 34455, 2024-05-08T09:49:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 0, 2024-05-08T09:49:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-05-08T09:49:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-05-08T09:49:56.867 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 22293, 2024-05-08T09:49:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 0, 2024-05-08T09:49:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 12160, 2024-05-08T09:49:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 0, 2024-05-08T09:49:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 0, 2024-05-08T09:49:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-05-08T09:49:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-05-08T09:49:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-05-08T09:49:56.868 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2024-05-08T09:49:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 0, 2024-05-08T09:49:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-05-08T09:49:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-05-08T09:49:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-05-08T09:49:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 1, 2024-05-08T09:49:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 0, 2024-05-08T09:49:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-05-08T09:49:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-05-08T09:49:56.869 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-05-08T09:49:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-05-08T09:49:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-05-08T09:49:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-05-08T09:49:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T09:49:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-05-08T09:49:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-05-08T09:49:56.870 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2024-05-08T09:49:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-05-08T09:49:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-05-08T09:49:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-05-08T09:49:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-05-08T09:49:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-05-08T09:49:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-05-08T09:49:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-05-08T09:49:56.871 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-05-08T09:49:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-05-08T09:49:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-05-08T09:49:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-05-08T09:49:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-05-08T09:49:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-05-08T09:49:56.872 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-05-08T09:49:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-05-08T09:49:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-05-08T09:49:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 444, 2024-05-08T09:49:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-05-08T09:49:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 354, 2024-05-08T09:49:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 7, 2024-05-08T09:49:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 46, 2024-05-08T09:49:56.873 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 39, 2024-05-08T09:49:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-05-08T09:49:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 0, 2024-05-08T09:49:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 2, 2024-05-08T09:49:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 0 2024-05-08T09:49:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-05-08T09:49:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 0, 2024-05-08T09:49:56.874 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-05-08T09:49:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-05-08T09:49:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-05-08T09:49:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2024-05-08T09:49:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-05-08T09:49:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-05-08T09:49:56.875 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-05-08T09:49:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T09:49:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-05-08T09:49:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 0, 2024-05-08T09:49:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 0, 2024-05-08T09:49:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 0, 2024-05-08T09:49:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-05-08T09:49:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:49:56.876 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:49:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-05-08T09:49:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:49:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 37834, 2024-05-08T09:49:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 30691521, 2024-05-08T09:49:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 37834, 2024-05-08T09:49:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-05-08T09:49:56.877 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-05-08T09:49:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 37834, 2024-05-08T09:49:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 30691521, 2024-05-08T09:49:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:49:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:49:56.878 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-05-08T09:49:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:49:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-05-08T09:49:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:49:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-05-08T09:49:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-05-08T09:49:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:56.879 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 34455, 2024-05-08T09:49:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 21818723, 2024-05-08T09:49:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 34455, 2024-05-08T09:49:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 21818723, 2024-05-08T09:49:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:49:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.880 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:49:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-05-08T09:49:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:49:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-05-08T09:49:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:49:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-05-08T09:49:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-05-08T09:49:56.881 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 34455, 2024-05-08T09:49:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 34455, 2024-05-08T09:49:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 34455, 2024-05-08T09:49:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 34455, 2024-05-08T09:49:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:49:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.882 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:49:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-05-08T09:49:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:49:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-05-08T09:49:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:49:56.883 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-05-08T09:49:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-05-08T09:49:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-05-08T09:49:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-05-08T09:49:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-05-08T09:49:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-05-08T09:49:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:49:56.884 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:49:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:49:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x556a6726e780": { 2024-05-08T09:49:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:49:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-05-08T09:49:56.885 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:49:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-05-08T09:49:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-05-08T09:49:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:49:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-05-08T09:49:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-05-08T09:49:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-05-08T09:49:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-05-08T09:49:56.886 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-05-08T09:49:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:49:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:49:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:49:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:49:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:49:56.887 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:49:56.887 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-05-08T09:49:57.014 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:56 smithi194 ceph-mon[33679]: pgmap v5853: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:49:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:56 smithi070 ceph-mon[29591]: pgmap v5853: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:49:57.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:56 smithi172 ceph-mon[33377]: pgmap v5853: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:49:57.811 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-08T09:49:57.811 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-08T09:49:57.811 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-05-08T09:49:57.811 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-05-08T09:49:57.812 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T09:49:57.812 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-05-08T09:49:57.812 DEBUG:tasks.check_counter:Getting stats from f 2024-05-08T09:49:57.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-08T09:49:58.265 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T09:49:59.010 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:49:58 smithi194 ceph-mon[33679]: pgmap v5854: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:49:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:49:58 smithi070 ceph-mon[29591]: pgmap v5854: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:49:59.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:49:58 smithi172 ceph-mon[33377]: pgmap v5854: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:00.343 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-05-08T09:50:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:50:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 2992, 2024-05-08T09:50:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2982, 2024-05-08T09:50:00.343 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 2358656, 2024-05-08T09:50:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 1857152, 2024-05-08T09:50:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 4, 2024-05-08T09:50:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 0, 2024-05-08T09:50:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 1.032865380, 2024-05-08T09:50:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.475749945, 2024-05-08T09:50:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.311531630, 2024-05-08T09:50:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.161416232, 2024-05-08T09:50:00.344 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:50:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2981, 2024-05-08T09:50:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.304213649, 2024-05-08T09:50:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000102050 2024-05-08T09:50:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:50:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:00.345 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 2358656, 2024-05-08T09:50:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 1857152 2024-05-08T09:50:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:50:00.346 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 17, 2024-05-08T09:50:00.347 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2292, 2024-05-08T09:50:00.347 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 5040, 2024-05-08T09:50:00.347 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 1297376, 2024-05-08T09:50:00.347 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 16, 2024-05-08T09:50:00.347 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2024-05-08T09:50:00.347 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.285016076, 2024-05-08T09:50:00.347 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.212225246, 2024-05-08T09:50:00.347 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.016455632, 2024-05-08T09:50:00.348 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:50:00.348 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:50:00.348 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2290, 2024-05-08T09:50:00.348 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.292411317, 2024-05-08T09:50:00.348 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000127690 2024-05-08T09:50:00.348 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.348 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:50:00.348 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 5040, 2024-05-08T09:50:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 1297376 2024-05-08T09:50:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.349 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:50:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 0, 2024-05-08T09:50:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2, 2024-05-08T09:50:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 0, 2024-05-08T09:50:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 0, 2024-05-08T09:50:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 2, 2024-05-08T09:50:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 1, 2024-05-08T09:50:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.000905653, 2024-05-08T09:50:00.350 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T09:50:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.000499403, 2024-05-08T09:50:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:50:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:50:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:50:00.351 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T09:50:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T09:50:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.352 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-05-08T09:50:00.353 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 0, 2024-05-08T09:50:00.353 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-05-08T09:50:00.353 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.353 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-05-08T09:50:00.353 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:50:00.353 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-05-08T09:50:00.353 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:50:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:50:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:50:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:50:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:50:00.354 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:50:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:50:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:50:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:50:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:50:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:50:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:50:00.355 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:50:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-05-08T09:50:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:50:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-05-08T09:50:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:50:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:50:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:50:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:50:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:50:00.356 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:50:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:50:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-05-08T09:50:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:50:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:50:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:50:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-05-08T09:50:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-05-08T09:50:00.357 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-05-08T09:50:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:50:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:50:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:50:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:50:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 148731, 2024-05-08T09:50:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 31, 2024-05-08T09:50:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:50:00.358 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-05-08T09:50:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-05-08T09:50:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-05-08T09:50:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:50:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-05-08T09:50:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:50:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-05-08T09:50:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 0, 2024-05-08T09:50:00.359 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 0, 2024-05-08T09:50:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:50:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:50:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-05-08T09:50:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-05-08T09:50:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 928, 2024-05-08T09:50:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 2, 2024-05-08T09:50:00.360 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-05-08T09:50:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-05-08T09:50:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-05-08T09:50:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-05-08T09:50:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:50:00.361 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:50:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-05-08T09:50:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:50:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 3005, 2024-05-08T09:50:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 1935219, 2024-05-08T09:50:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:50:00.362 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 3005, 2024-05-08T09:50:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-05-08T09:50:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-05-08T09:50:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 3005, 2024-05-08T09:50:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1935219, 2024-05-08T09:50:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:50:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:00.363 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:00.364 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:00.364 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-05-08T09:50:01.081 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:00 smithi194 ceph-mon[33679]: pgmap v5855: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:50:01.081 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:00 smithi194 ceph-mon[33679]: overall HEALTH_OK 2024-05-08T09:50:01.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:00 smithi070 ceph-mon[29591]: pgmap v5855: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:50:01.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:00 smithi070 ceph-mon[29591]: overall HEALTH_OK 2024-05-08T09:50:01.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:00 smithi172 ceph-mon[33377]: pgmap v5855: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T09:50:01.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:00 smithi172 ceph-mon[33377]: overall HEALTH_OK 2024-05-08T09:50:01.763 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-05-08T09:50:01.764 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-05-08T09:50:01.764 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-05-08T09:50:01.764 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-05-08T09:50:01.764 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-05-08T09:50:01.764 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.f 2024-05-08T09:50:01.764 DEBUG:tasks.check_counter:Getting stats from i 2024-05-08T09:50:01.764 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-08T09:50:02.393 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T09:50:03.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:02 smithi070 ceph-mon[29591]: pgmap v5856: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:03.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:02 smithi172 ceph-mon[33377]: pgmap v5856: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:03.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:02 smithi194 ceph-mon[33679]: pgmap v5856: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:04.683 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-05-08T09:50:04.683 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:50:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 23080, 2024-05-08T09:50:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 23080, 2024-05-08T09:50:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 36148731, 2024-05-08T09:50:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 7338623, 2024-05-08T09:50:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 24, 2024-05-08T09:50:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 2, 2024-05-08T09:50:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 4.948591081, 2024-05-08T09:50:04.684 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 1.711962912, 2024-05-08T09:50:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 1.326653231, 2024-05-08T09:50:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 1.412162919, 2024-05-08T09:50:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:50:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 23079, 2024-05-08T09:50:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 2.032787155, 2024-05-08T09:50:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000088079 2024-05-08T09:50:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.685 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:50:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 2960, 2024-05-08T09:50:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T09:50:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.686 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:50:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 5298, 2024-05-08T09:50:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 7574, 2024-05-08T09:50:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 26473098, 2024-05-08T09:50:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 6553232, 2024-05-08T09:50:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 38, 2024-05-08T09:50:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 4, 2024-05-08T09:50:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 1.584950047, 2024-05-08T09:50:04.687 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.614475359, 2024-05-08T09:50:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.404423967, 2024-05-08T09:50:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.378035816, 2024-05-08T09:50:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:50:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 7571, 2024-05-08T09:50:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.808531689, 2024-05-08T09:50:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000106793 2024-05-08T09:50:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.688 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:50:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 1760, 2024-05-08T09:50:04.689 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 4871904 2024-05-08T09:50:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:50:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 9178, 2024-05-08T09:50:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 9147, 2024-05-08T09:50:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 23351708, 2024-05-08T09:50:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 3765952, 2024-05-08T09:50:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 29, 2024-05-08T09:50:04.690 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 4, 2024-05-08T09:50:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 2.424385707, 2024-05-08T09:50:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.953439237, 2024-05-08T09:50:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.784244691, 2024-05-08T09:50:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.484602500, 2024-05-08T09:50:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:50:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 9146, 2024-05-08T09:50:04.691 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.940880895, 2024-05-08T09:50:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000102873 2024-05-08T09:50:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:50:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.692 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 2785632, 2024-05-08T09:50:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 1919008 2024-05-08T09:50:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-05-08T09:50:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 1, 2024-05-08T09:50:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-05-08T09:50:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-MDSRank": { 2024-05-08T09:50:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-05-08T09:50:04.693 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-05-08T09:50:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 55036, 2024-05-08T09:50:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 3.599654772, 2024-05-08T09:50:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000065405 2024-05-08T09:50:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "finisher-PurgeQueue": { 2024-05-08T09:50:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "queue_len": 0, 2024-05-08T09:50:04.694 INFO:teuthology.orchestra.run.smithi194.stdout: "complete_latency": { 2024-05-08T09:50:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "mds": { 2024-05-08T09:50:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "request": 0, 2024-05-08T09:50:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "reply": 0, 2024-05-08T09:50:04.695 INFO:teuthology.orchestra.run.smithi194.stdout: "reply_latency": { 2024-05-08T09:50:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_reply": 0, 2024-05-08T09:50:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "forward": 0, 2024-05-08T09:50:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_complete": 0, 2024-05-08T09:50:04.696 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_fetch_keys": 0, 2024-05-08T09:50:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_commit": 0, 2024-05-08T09:50:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_split": 0, 2024-05-08T09:50:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_merge": 0, 2024-05-08T09:50:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes": 11422, 2024-05-08T09:50:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_top": 0, 2024-05-08T09:50:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_bottom": 11422, 2024-05-08T09:50:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pin_tail": 0, 2024-05-08T09:50:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_pinned": 11422, 2024-05-08T09:50:04.697 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_expired": 0, 2024-05-08T09:50:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "inodes_with_caps": 0, 2024-05-08T09:50:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "caps": 0, 2024-05-08T09:50:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "subtrees": 206, 2024-05-08T09:50:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse": 0, 2024-05-08T09:50:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_hit": 0, 2024-05-08T09:50:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_forward": 0, 2024-05-08T09:50:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_discover": 0, 2024-05-08T09:50:04.698 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_dir_fetch": 0, 2024-05-08T09:50:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_remote_ino": 0, 2024-05-08T09:50:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "traverse_lock": 0, 2024-05-08T09:50:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "load_cent": 0, 2024-05-08T09:50:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "q": 0, 2024-05-08T09:50:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "exported": 0, 2024-05-08T09:50:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "exported_inodes": 0, 2024-05-08T09:50:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "imported": 0, 2024-05-08T09:50:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "imported_inodes": 0, 2024-05-08T09:50:04.699 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_dir_fetch": 0, 2024-05-08T09:50:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_backtrace_fetch": 0, 2024-05-08T09:50:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "openino_peer_discover": 0, 2024-05-08T09:50:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rfiles": 0, 2024-05-08T09:50:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rbytes": 0, 2024-05-08T09:50:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "root_rsnaps": 0, 2024-05-08T09:50:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T09:50:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_set_tag": 0, 2024-05-08T09:50:04.700 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T09:50:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_inotable_repaired": 0, 2024-05-08T09:50:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_inodes": 0, 2024-05-08T09:50:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T09:50:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T09:50:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "scrub_file_inodes": 0, 2024-05-08T09:50:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_inode_file_caps": 0, 2024-05-08T09:50:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T09:50:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_grant": 0, 2024-05-08T09:50:04.701 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T09:50:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T09:50:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T09:50:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps": 0, 2024-05-08T09:50:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_caps_dirty": 0, 2024-05-08T09:50:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_cap_release": 0, 2024-05-08T09:50:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "process_request_cap_release": 0 2024-05-08T09:50:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.702 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_cache": { 2024-05-08T09:50:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update": 0, 2024-05-08T09:50:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_update_receipt": 0, 2024-05-08T09:50:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_try_discover": 0, 2024-05-08T09:50:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_send_discover": 0, 2024-05-08T09:50:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "dir_handle_discover": 0, 2024-05-08T09:50:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays": 0, 2024-05-08T09:50:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_delayed": 0, 2024-05-08T09:50:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "num_strays_enqueuing": 0, 2024-05-08T09:50:04.703 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_created": 0, 2024-05-08T09:50:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_enqueued": 0, 2024-05-08T09:50:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_reintegrated": 0, 2024-05-08T09:50:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "strays_migrated": 0, 2024-05-08T09:50:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_processing": 0, 2024-05-08T09:50:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_enqueued": 0, 2024-05-08T09:50:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "num_recovering_prioritized": 0, 2024-05-08T09:50:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_started": 0, 2024-05-08T09:50:04.704 INFO:teuthology.orchestra.run.smithi194.stdout: "recovery_completed": 0, 2024-05-08T09:50:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_path": 0, 2024-05-08T09:50:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_quiesce_inode": 0, 2024-05-08T09:50:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T09:50:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_exportdir": 0, 2024-05-08T09:50:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_flush": 0, 2024-05-08T09:50:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragmentdir": 0, 2024-05-08T09:50:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_fragstats": 0, 2024-05-08T09:50:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: "ireq_inodestats": 0 2024-05-08T09:50:04.705 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_log": { 2024-05-08T09:50:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "evlrg": 0, 2024-05-08T09:50:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "evadd": 0, 2024-05-08T09:50:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "evex": 0, 2024-05-08T09:50:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "evtrm": 0, 2024-05-08T09:50:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "ev": 67626, 2024-05-08T09:50:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "evexg": 0, 2024-05-08T09:50:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "evexd": 0, 2024-05-08T09:50:04.706 INFO:teuthology.orchestra.run.smithi194.stdout: "segadd": 0, 2024-05-08T09:50:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "segex": 0, 2024-05-08T09:50:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "segtrm": 0, 2024-05-08T09:50:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "seg": 77, 2024-05-08T09:50:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "segmjr": 7, 2024-05-08T09:50:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "segexg": 0, 2024-05-08T09:50:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "segexd": 0, 2024-05-08T09:50:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "expos": 4194304, 2024-05-08T09:50:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "wrpos": 77780454, 2024-05-08T09:50:04.707 INFO:teuthology.orchestra.run.smithi194.stdout: "rdpos": 77765595, 2024-05-08T09:50:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "jlat": { 2024-05-08T09:50:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "replayed": 67626 2024-05-08T09:50:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.708 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_mem": { 2024-05-08T09:50:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "ino": 9392, 2024-05-08T09:50:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "ino+": 13591, 2024-05-08T09:50:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "ino-": 4199, 2024-05-08T09:50:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "dir": 771, 2024-05-08T09:50:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "dir+": 965, 2024-05-08T09:50:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "dir-": 194, 2024-05-08T09:50:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "dn": 11422, 2024-05-08T09:50:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "dn+": 15586, 2024-05-08T09:50:04.709 INFO:teuthology.orchestra.run.smithi194.stdout: "dn-": 4164, 2024-05-08T09:50:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "cap": 0, 2024-05-08T09:50:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "cap+": 0, 2024-05-08T09:50:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "cap-": 0, 2024-05-08T09:50:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "rss": 92720, 2024-05-08T09:50:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: "heap": 215416 2024-05-08T09:50:04.710 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_server": { 2024-05-08T09:50:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_client_request": 0, 2024-05-08T09:50:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "dispatch_server_request": 0, 2024-05-08T09:50:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_request": 0, 2024-05-08T09:50:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_client_session": 0, 2024-05-08T09:50:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "handle_peer_request": 0, 2024-05-08T09:50:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "req_create_latency": { 2024-05-08T09:50:04.711 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getattr_latency": { 2024-05-08T09:50:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.712 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getfilelock_latency": { 2024-05-08T09:50:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "req_link_latency": { 2024-05-08T09:50:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.713 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookup_latency": { 2024-05-08T09:50:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookuphash_latency": { 2024-05-08T09:50:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.714 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupino_latency": { 2024-05-08T09:50:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.715 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupname_latency": { 2024-05-08T09:50:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupparent_latency": { 2024-05-08T09:50:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.716 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lookupsnap_latency": { 2024-05-08T09:50:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "req_lssnap_latency": { 2024-05-08T09:50:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.717 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.718 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mkdir_latency": { 2024-05-08T09:50:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.719 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mknod_latency": { 2024-05-08T09:50:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "req_mksnap_latency": { 2024-05-08T09:50:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.720 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "req_open_latency": { 2024-05-08T09:50:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "req_readdir_latency": { 2024-05-08T09:50:04.721 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rename_latency": { 2024-05-08T09:50:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.722 INFO:teuthology.orchestra.run.smithi194.stdout: "req_renamesnap_latency": { 2024-05-08T09:50:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "req_snapdiff_latency": { 2024-05-08T09:50:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.723 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmdir_latency": { 2024-05-08T09:50:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmsnap_latency": { 2024-05-08T09:50:04.724 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "req_rmxattr_latency": { 2024-05-08T09:50:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.725 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setattr_latency": { 2024-05-08T09:50:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setdirlayout_latency": { 2024-05-08T09:50:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.726 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setfilelock_latency": { 2024-05-08T09:50:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setlayout_latency": { 2024-05-08T09:50:04.727 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "req_setxattr_latency": { 2024-05-08T09:50:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.728 INFO:teuthology.orchestra.run.smithi194.stdout: "req_symlink_latency": { 2024-05-08T09:50:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "req_unlink_latency": { 2024-05-08T09:50:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.729 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_revoke_eviction": 0, 2024-05-08T09:50:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "cap_acquisition_throttle": 0, 2024-05-08T09:50:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "req_getvxattr_latency": { 2024-05-08T09:50:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:04.730 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_sessions": { 2024-05-08T09:50:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "session_count": 1, 2024-05-08T09:50:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "session_add": 4, 2024-05-08T09:50:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "session_remove": 3, 2024-05-08T09:50:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_open": 4, 2024-05-08T09:50:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "sessions_stale": 0, 2024-05-08T09:50:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "total_load": 0, 2024-05-08T09:50:04.731 INFO:teuthology.orchestra.run.smithi194.stdout: "average_load": 0, 2024-05-08T09:50:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "avg_session_uptime": 17816, 2024-05-08T09:50:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "mdthresh_evicted": 0 2024-05-08T09:50:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-05-08T09:50:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:50:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-05-08T09:50:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:50:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:50:04.732 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:50:04.733 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:50:04.733 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:50:04.733 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:50:04.733 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:50:04.733 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:50:04.733 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:50:04.733 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:50:04.733 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:50:04.734 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:50:04.734 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:50:04.734 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-05-08T09:50:04.734 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:50:04.734 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-05-08T09:50:04.734 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:50:04.734 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:50:04.734 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:50:04.734 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:50:04.735 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:50:04.735 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:50:04.735 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:50:04.735 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-05-08T09:50:04.735 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:50:04.735 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:50:04.735 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:50:04.735 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-05-08T09:50:04.736 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-05-08T09:50:04.736 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-05-08T09:50:04.736 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:50:04.736 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:50:04.736 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:50:04.736 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:50:04.736 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 224759, 2024-05-08T09:50:04.736 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 71, 2024-05-08T09:50:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:50:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-05-08T09:50:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-05-08T09:50:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-05-08T09:50:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:50:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-05-08T09:50:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:50:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-05-08T09:50:04.737 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 9800, 2024-05-08T09:50:04.738 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 188, 2024-05-08T09:50:04.738 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:50:04.738 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:50:04.738 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-05-08T09:50:04.738 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-05-08T09:50:04.738 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 29293946, 2024-05-08T09:50:04.738 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 137916, 2024-05-08T09:50:04.738 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-05-08T09:50:04.739 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-05-08T09:50:04.739 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-05-08T09:50:04.739 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-05-08T09:50:04.739 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.739 INFO:teuthology.orchestra.run.smithi194.stdout: "objecter": { 2024-05-08T09:50:04.739 INFO:teuthology.orchestra.run.smithi194.stdout: "op_active": 0, 2024-05-08T09:50:04.739 INFO:teuthology.orchestra.run.smithi194.stdout: "op_laggy": 0, 2024-05-08T09:50:04.739 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send": 34171, 2024-05-08T09:50:04.739 INFO:teuthology.orchestra.run.smithi194.stdout: "op_send_bytes": 21, 2024-05-08T09:50:04.740 INFO:teuthology.orchestra.run.smithi194.stdout: "op_resend": 3, 2024-05-08T09:50:04.740 INFO:teuthology.orchestra.run.smithi194.stdout: "op_reply": 34171, 2024-05-08T09:50:04.740 INFO:teuthology.orchestra.run.smithi194.stdout: "op_latency": { 2024-05-08T09:50:04.740 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 34171, 2024-05-08T09:50:04.740 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 56.738840800, 2024-05-08T09:50:04.740 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.001660438 2024-05-08T09:50:04.740 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.740 INFO:teuthology.orchestra.run.smithi194.stdout: "op_inflight": 0, 2024-05-08T09:50:04.740 INFO:teuthology.orchestra.run.smithi194.stdout: "oplen_avg": { 2024-05-08T09:50:04.741 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 34171, 2024-05-08T09:50:04.741 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 34172 2024-05-08T09:50:04.741 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.741 INFO:teuthology.orchestra.run.smithi194.stdout: "op": 34171, 2024-05-08T09:50:04.741 INFO:teuthology.orchestra.run.smithi194.stdout: "op_r": 34171, 2024-05-08T09:50:04.741 INFO:teuthology.orchestra.run.smithi194.stdout: "op_w": 0, 2024-05-08T09:50:04.741 INFO:teuthology.orchestra.run.smithi194.stdout: "op_rmw": 0, 2024-05-08T09:50:04.741 INFO:teuthology.orchestra.run.smithi194.stdout: "op_pg": 0, 2024-05-08T09:50:04.742 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_stat": 22161, 2024-05-08T09:50:04.742 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_create": 0, 2024-05-08T09:50:04.742 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_read": 12008, 2024-05-08T09:50:04.742 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_write": 0, 2024-05-08T09:50:04.742 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writefull": 0, 2024-05-08T09:50:04.742 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_writesame": 0, 2024-05-08T09:50:04.742 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_append": 0, 2024-05-08T09:50:04.742 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_zero": 0, 2024-05-08T09:50:04.742 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_truncate": 0, 2024-05-08T09:50:04.743 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_delete": 0, 2024-05-08T09:50:04.743 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_mapext": 0, 2024-05-08T09:50:04.743 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_sparse_read": 0, 2024-05-08T09:50:04.743 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_clonerange": 0, 2024-05-08T09:50:04.743 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_getxattr": 1, 2024-05-08T09:50:04.743 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_setxattr": 0, 2024-05-08T09:50:04.743 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_cmpxattr": 0, 2024-05-08T09:50:04.743 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_rmxattr": 0, 2024-05-08T09:50:04.744 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_resetxattrs": 0, 2024-05-08T09:50:04.744 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_call": 0, 2024-05-08T09:50:04.744 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_watch": 0, 2024-05-08T09:50:04.744 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_notify": 0, 2024-05-08T09:50:04.744 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T09:50:04.744 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls": 0, 2024-05-08T09:50:04.744 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_pgls_filter": 0, 2024-05-08T09:50:04.744 INFO:teuthology.orchestra.run.smithi194.stdout: "osdop_other": 0, 2024-05-08T09:50:04.744 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_active": 0, 2024-05-08T09:50:04.745 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_send": 0, 2024-05-08T09:50:04.745 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_resend": 0, 2024-05-08T09:50:04.745 INFO:teuthology.orchestra.run.smithi194.stdout: "linger_ping": 0, 2024-05-08T09:50:04.745 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_active": 0, 2024-05-08T09:50:04.745 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_send": 0, 2024-05-08T09:50:04.745 INFO:teuthology.orchestra.run.smithi194.stdout: "poolop_resend": 0, 2024-05-08T09:50:04.745 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_active": 0, 2024-05-08T09:50:04.745 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_send": 0, 2024-05-08T09:50:04.746 INFO:teuthology.orchestra.run.smithi194.stdout: "poolstat_resend": 0, 2024-05-08T09:50:04.746 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_active": 0, 2024-05-08T09:50:04.746 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_send": 0, 2024-05-08T09:50:04.746 INFO:teuthology.orchestra.run.smithi194.stdout: "statfs_resend": 0, 2024-05-08T09:50:04.746 INFO:teuthology.orchestra.run.smithi194.stdout: "command_active": 0, 2024-05-08T09:50:04.746 INFO:teuthology.orchestra.run.smithi194.stdout: "command_send": 0, 2024-05-08T09:50:04.746 INFO:teuthology.orchestra.run.smithi194.stdout: "command_resend": 0, 2024-05-08T09:50:04.746 INFO:teuthology.orchestra.run.smithi194.stdout: "map_epoch": 444, 2024-05-08T09:50:04.746 INFO:teuthology.orchestra.run.smithi194.stdout: "map_full": 0, 2024-05-08T09:50:04.747 INFO:teuthology.orchestra.run.smithi194.stdout: "map_inc": 354, 2024-05-08T09:50:04.747 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_sessions": 9, 2024-05-08T09:50:04.747 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_open": 71, 2024-05-08T09:50:04.747 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_session_close": 62, 2024-05-08T09:50:04.747 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_laggy": 0, 2024-05-08T09:50:04.747 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_wr": 0, 2024-05-08T09:50:04.747 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_rd": 2, 2024-05-08T09:50:04.747 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_del": 0 2024-05-08T09:50:04.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.748 INFO:teuthology.orchestra.run.smithi194.stdout: "oft": { 2024-05-08T09:50:04.748 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_objs": 0, 2024-05-08T09:50:04.748 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_kv_pairs": 0, 2024-05-08T09:50:04.748 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_updates": 0, 2024-05-08T09:50:04.748 INFO:teuthology.orchestra.run.smithi194.stdout: "omap_total_removes": 0 2024-05-08T09:50:04.748 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.748 INFO:teuthology.orchestra.run.smithi194.stdout: "osd-slow-ops": { 2024-05-08T09:50:04.748 INFO:teuthology.orchestra.run.smithi194.stdout: "slow_ops_count": 0 2024-05-08T09:50:04.749 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.749 INFO:teuthology.orchestra.run.smithi194.stdout: "purge_queue": { 2024-05-08T09:50:04.749 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops": 0, 2024-05-08T09:50:04.749 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T09:50:04.749 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing": 0, 2024-05-08T09:50:04.749 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executing_high_water": 0, 2024-05-08T09:50:04.749 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed_ops": 0, 2024-05-08T09:50:04.749 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_executed": 0, 2024-05-08T09:50:04.750 INFO:teuthology.orchestra.run.smithi194.stdout: "pq_item_in_journal": 0 2024-05-08T09:50:04.750 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.750 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:50:04.750 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:50:04.750 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-05-08T09:50:04.750 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:50:04.750 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 37552, 2024-05-08T09:50:04.750 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 82417811, 2024-05-08T09:50:04.751 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:50:04.751 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 37552, 2024-05-08T09:50:04.751 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-05-08T09:50:04.751 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-05-08T09:50:04.751 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 37552, 2024-05-08T09:50:04.751 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 82417811, 2024-05-08T09:50:04.751 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:50:04.751 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.751 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.752 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.752 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:04.752 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.752 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_bytes": { 2024-05-08T09:50:04.752 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:50:04.752 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-05-08T09:50:04.752 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:50:04.752 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-05-08T09:50:04.752 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-05-08T09:50:04.753 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:50:04.753 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-05-08T09:50:04.753 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 34171, 2024-05-08T09:50:04.753 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 73588293, 2024-05-08T09:50:04.753 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 34171, 2024-05-08T09:50:04.753 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 73588293, 2024-05-08T09:50:04.753 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:50:04.753 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.754 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.754 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.754 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:04.754 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.754 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-objecter_ops": { 2024-05-08T09:50:04.754 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:50:04.754 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 1024, 2024-05-08T09:50:04.755 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:50:04.755 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-05-08T09:50:04.755 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-05-08T09:50:04.755 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:50:04.755 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-05-08T09:50:04.755 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 34171, 2024-05-08T09:50:04.755 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 34171, 2024-05-08T09:50:04.755 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 34171, 2024-05-08T09:50:04.755 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 34171, 2024-05-08T09:50:04.756 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:50:04.756 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.756 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.756 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.756 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:04.756 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.756 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle": { 2024-05-08T09:50:04.756 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:50:04.757 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-05-08T09:50:04.757 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:50:04.757 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-05-08T09:50:04.757 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-05-08T09:50:04.757 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:50:04.757 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-05-08T09:50:04.757 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-05-08T09:50:04.757 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-05-08T09:50:04.758 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-05-08T09:50:04.758 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-05-08T09:50:04.758 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:50:04.758 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.758 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.758 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.758 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:04.758 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:04.758 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-write_buf_throttle-0x55be1470c780": { 2024-05-08T09:50:04.759 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:50:04.759 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 3758096384, 2024-05-08T09:50:04.759 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:50:04.759 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 0, 2024-05-08T09:50:04.759 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 0, 2024-05-08T09:50:04.759 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:50:04.759 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 0, 2024-05-08T09:50:04.759 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-05-08T09:50:04.760 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-05-08T09:50:04.760 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 0, 2024-05-08T09:50:04.760 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 0, 2024-05-08T09:50:04.760 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:50:04.760 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:04.760 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:04.760 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:04.760 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:04.760 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:04.761 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-05-08T09:50:05.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:04 smithi070 ceph-mon[29591]: pgmap v5857: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:05.129 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:04 smithi194 ceph-mon[33679]: pgmap v5857: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:05.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:04 smithi172 ceph-mon[33377]: pgmap v5857: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:05.528 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-05-08T09:50:05.529 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-05-08T09:50:05.529 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-05-08T09:50:05.529 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-05-08T09:50:05.529 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T09:50:05.529 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-05-08T09:50:05.529 DEBUG:tasks.check_counter:Getting stats from l 2024-05-08T09:50:05.530 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-08T09:50:06.009 INFO:teuthology.orchestra.run.smithi194.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T09:50:07.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:06 smithi070 ceph-mon[29591]: pgmap v5858: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:50:07.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:06 smithi172 ceph-mon[33377]: pgmap v5858: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:50:07.184 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:06 smithi194 ceph-mon[33679]: pgmap v5858: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:50:08.145 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-05-08T09:50:08.146 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T09:50:08.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 3005, 2024-05-08T09:50:08.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2993, 2024-05-08T09:50:08.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 2365632, 2024-05-08T09:50:08.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 1863024, 2024-05-08T09:50:08.146 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 4, 2024-05-08T09:50:08.147 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 0, 2024-05-08T09:50:08.147 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 1.004367534, 2024-05-08T09:50:08.147 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.462264340, 2024-05-08T09:50:08.147 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.305210053, 2024-05-08T09:50:08.147 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.150778066, 2024-05-08T09:50:08.147 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:50:08.147 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2993, 2024-05-08T09:50:08.147 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.321414232, 2024-05-08T09:50:08.148 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000107388 2024-05-08T09:50:08.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.148 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:50:08.148 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:08.148 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:08.148 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:08.148 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.148 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 2365632, 2024-05-08T09:50:08.149 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 1863024 2024-05-08T09:50:08.149 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.149 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T09:50:08.149 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 14, 2024-05-08T09:50:08.149 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2297, 2024-05-08T09:50:08.149 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 2240, 2024-05-08T09:50:08.149 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 1377024, 2024-05-08T09:50:08.149 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 17, 2024-05-08T09:50:08.149 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 3, 2024-05-08T09:50:08.150 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.277833684, 2024-05-08T09:50:08.150 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.206708933, 2024-05-08T09:50:08.150 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.014806755, 2024-05-08T09:50:08.150 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:50:08.150 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:50:08.150 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 2294, 2024-05-08T09:50:08.150 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.314856014, 2024-05-08T09:50:08.150 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000137251 2024-05-08T09:50:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:50:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 2240, 2024-05-08T09:50:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 1377024 2024-05-08T09:50:08.151 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.152 INFO:teuthology.orchestra.run.smithi194.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T09:50:08.152 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_messages": 0, 2024-05-08T09:50:08.152 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages": 2, 2024-05-08T09:50:08.152 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_bytes": 0, 2024-05-08T09:50:08.152 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_bytes": 0, 2024-05-08T09:50:08.152 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_created_connections": 2, 2024-05-08T09:50:08.152 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_active_connections": 1, 2024-05-08T09:50:08.152 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_total_time": 0.001123239, 2024-05-08T09:50:08.152 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T09:50:08.153 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_recv_time": 0.000745240, 2024-05-08T09:50:08.153 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T09:50:08.153 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T09:50:08.153 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:08.153 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:08.153 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:08.153 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.153 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_handle_ack_lat": { 2024-05-08T09:50:08.153 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:08.154 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:08.154 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:08.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.154 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T09:50:08.154 INFO:teuthology.orchestra.run.smithi194.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T09:50:08.154 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.154 INFO:teuthology.orchestra.run.smithi194.stdout: "cct": { 2024-05-08T09:50:08.154 INFO:teuthology.orchestra.run.smithi194.stdout: "total_workers": 0, 2024-05-08T09:50:08.155 INFO:teuthology.orchestra.run.smithi194.stdout: "unhealthy_workers": 0 2024-05-08T09:50:08.155 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.155 INFO:teuthology.orchestra.run.smithi194.stdout: "mempool": { 2024-05-08T09:50:08.155 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_bytes": 0, 2024-05-08T09:50:08.155 INFO:teuthology.orchestra.run.smithi194.stdout: "bloom_filter_items": 0, 2024-05-08T09:50:08.155 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T09:50:08.155 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_alloc_items": 0, 2024-05-08T09:50:08.155 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T09:50:08.155 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_data_items": 0, 2024-05-08T09:50:08.156 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T09:50:08.156 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T09:50:08.156 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T09:50:08.156 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T09:50:08.156 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T09:50:08.156 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_other_items": 0, 2024-05-08T09:50:08.156 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T09:50:08.156 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T09:50:08.156 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_bytes": 0, 2024-05-08T09:50:08.157 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_extent_items": 0, 2024-05-08T09:50:08.157 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_bytes": 0, 2024-05-08T09:50:08.157 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_blob_items": 0, 2024-05-08T09:50:08.157 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T09:50:08.157 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T09:50:08.157 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T09:50:08.157 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T09:50:08.157 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T09:50:08.158 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_fsck_items": 0, 2024-05-08T09:50:08.158 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_bytes": 0, 2024-05-08T09:50:08.158 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_txc_items": 0, 2024-05-08T09:50:08.158 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T09:50:08.158 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T09:50:08.158 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_bytes": 0, 2024-05-08T09:50:08.158 INFO:teuthology.orchestra.run.smithi194.stdout: "bluestore_writing_items": 0, 2024-05-08T09:50:08.158 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_bytes": 0, 2024-05-08T09:50:08.158 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_items": 0, 2024-05-08T09:50:08.159 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T09:50:08.159 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_reader_items": 0, 2024-05-08T09:50:08.159 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T09:50:08.159 INFO:teuthology.orchestra.run.smithi194.stdout: "bluefs_file_writer_items": 0, 2024-05-08T09:50:08.159 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_bytes": 148714, 2024-05-08T09:50:08.159 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_anon_items": 30, 2024-05-08T09:50:08.159 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_bytes": 0, 2024-05-08T09:50:08.159 INFO:teuthology.orchestra.run.smithi194.stdout: "buffer_meta_items": 0, 2024-05-08T09:50:08.159 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_bytes": 0, 2024-05-08T09:50:08.160 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_items": 0, 2024-05-08T09:50:08.160 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_bytes": 0, 2024-05-08T09:50:08.160 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_mapbl_items": 0, 2024-05-08T09:50:08.160 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_bytes": 0, 2024-05-08T09:50:08.160 INFO:teuthology.orchestra.run.smithi194.stdout: "osd_pglog_items": 0, 2024-05-08T09:50:08.160 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_bytes": 0, 2024-05-08T09:50:08.160 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_items": 0, 2024-05-08T09:50:08.160 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T09:50:08.160 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_mapping_items": 0, 2024-05-08T09:50:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_bytes": 0, 2024-05-08T09:50:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: "pgmap_items": 0, 2024-05-08T09:50:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_bytes": 928, 2024-05-08T09:50:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: "mds_co_items": 2, 2024-05-08T09:50:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_bytes": 0, 2024-05-08T09:50:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_1_items": 0, 2024-05-08T09:50:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_bytes": 0, 2024-05-08T09:50:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: "unittest_2_items": 0 2024-05-08T09:50:08.161 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-05-08T09:50:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T09:50:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: "val": 0, 2024-05-08T09:50:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: "max": 104857600, 2024-05-08T09:50:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: "get_started": 0, 2024-05-08T09:50:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: "get": 3015, 2024-05-08T09:50:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: "get_sum": 1937993, 2024-05-08T09:50:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_fail": 0, 2024-05-08T09:50:08.162 INFO:teuthology.orchestra.run.smithi194.stdout: "get_or_fail_success": 3015, 2024-05-08T09:50:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: "take": 0, 2024-05-08T09:50:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: "take_sum": 0, 2024-05-08T09:50:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: "put": 3015, 2024-05-08T09:50:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: "put_sum": 1937993, 2024-05-08T09:50:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: "wait": { 2024-05-08T09:50:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: "avgcount": 0, 2024-05-08T09:50:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: "sum": 0.000000000, 2024-05-08T09:50:08.163 INFO:teuthology.orchestra.run.smithi194.stdout: "avgtime": 0.000000000 2024-05-08T09:50:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:08.164 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-05-08T09:50:08.164 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-05-08T09:50:09.042 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-05-08T09:50:09.043 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-05-08T09:50:09.043 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-05-08T09:50:09.043 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-05-08T09:50:09.043 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-05-08T09:50:09.043 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-05-08T09:50:09.044 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-08T09:50:09.057 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-08T09:50:09.057 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T09:50:09.058 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T09:50:09.124 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T09:50:09.124 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T09:50:09.132 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:08 smithi070 ceph-mon[29591]: pgmap v5859: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:50:09.180 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-08T09:50:09.181 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:08 smithi172 ceph-mon[33377]: pgmap v5859: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:50:09.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:08 smithi194 ceph-mon[33679]: pgmap v5859: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T09:50:09.624 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:50:10.878 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:10 smithi070 ceph-mon[29591]: pgmap v5860: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:50:11.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:10 smithi172 ceph-mon[33377]: pgmap v5860: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:50:11.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:10 smithi194 ceph-mon[33679]: pgmap v5860: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T09:50:12.166 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:11 smithi194 ceph-mon[33679]: osdmap e445: 12 total, 12 up, 12 in 2024-05-08T09:50:12.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:11 smithi172 ceph-mon[33377]: osdmap e445: 12 total, 12 up, 12 in 2024-05-08T09:50:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:11 smithi070 ceph-mon[29591]: osdmap e445: 12 total, 12 up, 12 in 2024-05-08T09:50:12.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.661+0000 7f2801a00700 1 -- 172.21.15.70:0/866988487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27fc06b180 msgr2=0x7f27fc06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:12.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.661+0000 7f2801a00700 1 --2- 172.21.15.70:0/866988487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27fc06b180 0x7f27fc06b600 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009990 tx=0x7f27ec009ca0 comp rx=0 tx=0).stop 2024-05-08T09:50:12.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.661+0000 7f2801a00700 1 -- 172.21.15.70:0/866988487 shutdown_connections 2024-05-08T09:50:12.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.661+0000 7f2801a00700 1 --2- 172.21.15.70:0/866988487 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27fc06bb40 0x7f27fc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:12.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.661+0000 7f2801a00700 1 --2- 172.21.15.70:0/866988487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27fc109510 0x7f27fc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:12.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.661+0000 7f2801a00700 1 --2- 172.21.15.70:0/866988487 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27fc06b180 0x7f27fc06b600 secure :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009990 tx=0x7f27ec009ca0 comp rx=0 tx=0).stop 2024-05-08T09:50:12.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.661+0000 7f2801a00700 1 -- 172.21.15.70:0/866988487 >> 172.21.15.70:0/866988487 conn(0x7f27fc079350 msgr2=0x7f27fc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:12.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.662+0000 7f2801a00700 1 -- 172.21.15.70:0/866988487 shutdown_connections 2024-05-08T09:50:12.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.662+0000 7f2801a00700 1 -- 172.21.15.70:0/866988487 wait complete. 2024-05-08T09:50:12.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.665+0000 7f2801a00700 1 Processor -- start 2024-05-08T09:50:12.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.665+0000 7f2801a00700 1 -- start start 2024-05-08T09:50:12.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.667+0000 7f2801a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27fc06bb40 0x7f27fc199db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:12.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.667+0000 7f2801a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27fc109510 0x7f27fc19a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:12.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.667+0000 7f2801a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27fc19e630 0x7f27fc19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:12.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.667+0000 7f2801a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc113610 con 0x7f27fc109510 2024-05-08T09:50:12.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.667+0000 7f2801a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc113490 con 0x7f27fc06bb40 2024-05-08T09:50:12.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.667+0000 7f2801a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f27fc113790 con 0x7f27fc19e630 2024-05-08T09:50:12.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.668+0000 7f27faa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27fc06bb40 0x7f27fc199db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:12.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.668+0000 7f27faa00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27fc06bb40 0x7f27fc199db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.172:3300/0 says I am v2:172.21.15.70:36730/0 (socket says 172.21.15.70:36730) 2024-05-08T09:50:12.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.668+0000 7f27faa00700 1 -- 172.21.15.70:0/2654612322 learned_addr learned my addr 172.21.15.70:0/2654612322 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:50:12.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.668+0000 7f27f2000700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27fc109510 0x7f27fc19a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:12.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.668+0000 7f27fb400700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27fc19e630 0x7f27fc19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:12.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.669+0000 7f27faa00700 1 -- 172.21.15.70:0/2654612322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27fc19e630 msgr2=0x7f27fc19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:12.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.669+0000 7f27faa00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27fc19e630 0x7f27fc19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:12.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.669+0000 7f27faa00700 1 -- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27fc109510 msgr2=0x7f27fc19a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:12.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.669+0000 7f27faa00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27fc109510 0x7f27fc19a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:12.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.669+0000 7f27faa00700 1 -- 172.21.15.70:0/2654612322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27fc19f150 con 0x7f27fc06bb40 2024-05-08T09:50:12.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.675+0000 7f27faa00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27fc06bb40 0x7f27fc199db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d980 tx=0x7f27e400dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:12.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.675+0000 7f27f3e00700 1 -- 172.21.15.70:0/2654612322 <== mon.2 v2:172.21.15.172:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4017070 con 0x7f27fc06bb40 2024-05-08T09:50:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.675+0000 7f27f3e00700 1 -- 172.21.15.70:0/2654612322 <== mon.2 v2:172.21.15.172:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f27e4005020 con 0x7f27fc06bb40 2024-05-08T09:50:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.675+0000 7f27f3e00700 1 -- 172.21.15.70:0/2654612322 <== mon.2 v2:172.21.15.172:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e400f980 con 0x7f27fc06bb40 2024-05-08T09:50:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.675+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27fc19f440 con 0x7f27fc06bb40 2024-05-08T09:50:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.676+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27fc1a6bd0 con 0x7f27fc06bb40 2024-05-08T09:50:12.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.677+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27fc10b9f0 con 0x7f27fc06bb40 2024-05-08T09:50:12.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.683+0000 7f27f3e00700 1 -- 172.21.15.70:0/2654612322 <== mon.2 v2:172.21.15.172:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f27e4004a30 con 0x7f27fc06bb40 2024-05-08T09:50:12.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.687+0000 7f27f3e00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f27e00b2b20 0x7f27e00b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:12.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.691+0000 7f27f3e00700 1 -- 172.21.15.70:0/2654612322 <== mon.2 v2:172.21.15.172:3300/0 5 ==== osd_map(445..445 src has 1..445) ==== 9671+0+0 (secure 0 0 0) 0x7f27e40e2e50 con 0x7f27fc06bb40 2024-05-08T09:50:12.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.694+0000 7f27f2000700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f27e00b2b20 0x7f27e00b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:12.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.695+0000 7f27f3e00700 1 -- 172.21.15.70:0/2654612322 <== mon.2 v2:172.21.15.172:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f27e4020020 con 0x7f27fc06bb40 2024-05-08T09:50:12.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:12.697+0000 7f27f2000700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f27e00b2b20 0x7f27e00b4fe0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006010 tx=0x7f27ec003680 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:13.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.136+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f27fc104bd0 con 0x7f27fc06bb40 2024-05-08T09:50:13.136 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:12 smithi070 ceph-mon[29591]: pgmap v5862: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:50:13.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.137+0000 7f27f3e00700 1 -- 172.21.15.70:0/2654612322 <== mon.2 v2:172.21.15.172:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v445) ==== 81+0+943 (secure 0 0 0) 0x7f27e40aa350 con 0x7f27fc06bb40 2024-05-08T09:50:13.141 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/565155292 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:13.141 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/3718531938 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:13.141 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1348548569 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:13.141 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/3718531938 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:13.141 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1348548569 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:13.141 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2886471860 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:13.142 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2786047947 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:13.142 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2185065524 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:13.142 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2096266006 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:13.142 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/2822740915 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:13.142 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3587006025 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:13.143 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3060551286 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:13.143 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/2822740915 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:13.143 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/360029842 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:13.143 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/902378241 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:13.143 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3911583705 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f27e00b2b20 msgr2=0x7f27e00b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f27e00b2b20 0x7f27e00b4fe0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f27ec006010 tx=0x7f27ec003680 comp rx=0 tx=0).stop 2024-05-08T09:50:13.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27fc06bb40 msgr2=0x7f27fc199db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27fc06bb40 0x7f27fc199db0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d980 tx=0x7f27e400dc90 comp rx=0 tx=0).stop 2024-05-08T09:50:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 shutdown_connections 2024-05-08T09:50:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f27e00b2b20 0x7f27e00b4fe0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27fc19e630 0x7f27fc19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f27fc06bb40 0x7f27fc199db0 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d980 tx=0x7f27e400dc90 comp rx=0 tx=0).stop 2024-05-08T09:50:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 --2- 172.21.15.70:0/2654612322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f27fc109510 0x7f27fc19a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.143+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 >> 172.21.15.70:0/2654612322 conn(0x7f27fc079350 msgr2=0x7f27fc101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:13.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.144+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 shutdown_connections 2024-05-08T09:50:13.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:13.144+0000 7f2801a00700 1 -- 172.21.15.70:0/2654612322 wait complete. 2024-05-08T09:50:13.148 INFO:teuthology.orchestra.run.smithi070.stderr:listed 16 entries 2024-05-08T09:50:13.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:12 smithi172 ceph-mon[33377]: pgmap v5862: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:50:13.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:12 smithi194 ceph-mon[33679]: pgmap v5862: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:50:14.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:13 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2654612322' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T09:50:14.247 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:13 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2654612322' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T09:50:14.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:13 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2654612322' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T09:50:14.325 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-05-08T09:50:14.325 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T09:50:14.385 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-08T09:50:15.131 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:50:15.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:14 smithi172 ceph-mon[33377]: pgmap v5863: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:50:15.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:14 smithi194 ceph-mon[33679]: pgmap v5863: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:50:15.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:14 smithi070 ceph-mon[29591]: pgmap v5863: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T09:50:17.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:16 smithi172 ceph-mon[33377]: pgmap v5864: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:50:17.227 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:16 smithi070 ceph-mon[29591]: pgmap v5864: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:50:17.268 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:16 smithi194 ceph-mon[33679]: pgmap v5864: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:50:19.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:18 smithi070 ceph-mon[29591]: pgmap v5865: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:50:19.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:18 smithi172 ceph-mon[33377]: pgmap v5865: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:50:19.265 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:18 smithi194 ceph-mon[33679]: pgmap v5865: 129 pgs: 24 active+clean+snaptrim, 72 active+clean+snaptrim_wait, 33 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:50:20.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.244+0000 7f1aa4e00700 1 -- 172.21.15.70:0/370487409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0109600 msgr2=0x7f1aa01099e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:20.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.244+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/370487409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0109600 0x7f1aa01099e0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000b0a0 tx=0x7f1a9000b3b0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.244+0000 7f1aa4e00700 1 -- 172.21.15.70:0/370487409 shutdown_connections 2024-05-08T09:50:20.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.244+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/370487409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aa0103eb0 0x7f1aa0110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.244+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/370487409 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0109600 0x7f1aa01099e0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.244+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/370487409 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa01034f0 0x7f1aa0103970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.244+0000 7f1aa4e00700 1 -- 172.21.15.70:0/370487409 >> 172.21.15.70:0/370487409 conn(0x7f1aa007a650 msgr2=0x7f1aa007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:20.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.246+0000 7f1aa4e00700 1 -- 172.21.15.70:0/370487409 shutdown_connections 2024-05-08T09:50:20.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.246+0000 7f1aa4e00700 1 -- 172.21.15.70:0/370487409 wait complete. 2024-05-08T09:50:20.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.248+0000 7f1aa4e00700 1 Processor -- start 2024-05-08T09:50:20.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.249+0000 7f1aa4e00700 1 -- start start 2024-05-08T09:50:20.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.249+0000 7f1aa4e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aa01034f0 0x7f1aa019bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.249+0000 7f1aa4e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0103eb0 0x7f1aa019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.249+0000 7f1aa4e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa01a0820 0x7f1aa01a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.249+0000 7f1aa4e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa0113620 con 0x7f1aa0103eb0 2024-05-08T09:50:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.249+0000 7f1aa4e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa01134a0 con 0x7f1aa01a0820 2024-05-08T09:50:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.249+0000 7f1aa4e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa01137a0 con 0x7f1aa01034f0 2024-05-08T09:50:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.250+0000 7f1a97e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0103eb0 0x7f1aa019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.250+0000 7f1a97e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0103eb0 0x7f1aa019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41528/0 (socket says 172.21.15.70:41528) 2024-05-08T09:50:20.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.250+0000 7f1a9de00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aa01034f0 0x7f1aa019bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:20.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.250+0000 7f1a97e00700 1 -- 172.21.15.70:0/2628045110 learned_addr learned my addr 172.21.15.70:0/2628045110 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:50:20.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.251+0000 7f1a97e00700 1 -- 172.21.15.70:0/2628045110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aa01034f0 msgr2=0x7f1aa019bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:20.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.251+0000 7f1a97e00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aa01034f0 0x7f1aa019bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.251+0000 7f1a97e00700 1 -- 172.21.15.70:0/2628045110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa01a0820 msgr2=0x7f1aa01a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:20.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.251+0000 7f1a97e00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa01a0820 0x7f1aa01a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.251+0000 7f1a97e00700 1 -- 172.21.15.70:0/2628045110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa01a1340 con 0x7f1aa0103eb0 2024-05-08T09:50:20.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.252+0000 7f1a97e00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0103eb0 0x7f1aa019c490 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c920 tx=0x7f1a8800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:20.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.252+0000 7f1a96a00700 1 -- 172.21.15.70:0/2628045110 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a88007b00 con 0x7f1aa0103eb0 2024-05-08T09:50:20.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.252+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa01a1630 con 0x7f1aa0103eb0 2024-05-08T09:50:20.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.252+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa01a8e60 con 0x7f1aa0103eb0 2024-05-08T09:50:20.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.254+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa006a190 con 0x7f1aa0103eb0 2024-05-08T09:50:20.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.255+0000 7f1a96a00700 1 -- 172.21.15.70:0/2628045110 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a88004cc0 con 0x7f1aa0103eb0 2024-05-08T09:50:20.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.255+0000 7f1a96a00700 1 -- 172.21.15.70:0/2628045110 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a8801d060 con 0x7f1aa0103eb0 2024-05-08T09:50:20.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.265+0000 7f1a96a00700 1 -- 172.21.15.70:0/2628045110 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1a88005480 con 0x7f1aa0103eb0 2024-05-08T09:50:20.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.268+0000 7f1a96a00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a840b2aa0 0x7f1a840b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:20.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.268+0000 7f1a96a00700 1 -- 172.21.15.70:0/2628045110 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(445..445 src has 1..445) ==== 9671+0+0 (secure 0 0 0) 0x7f1a880e2a40 con 0x7f1aa0103eb0 2024-05-08T09:50:20.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.269+0000 7f1a9de00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a840b2aa0 0x7f1a840b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:20.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.270+0000 7f1a9de00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a840b2aa0 0x7f1a840b4f60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009040 tx=0x7f1a9000b7f0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:20.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.272+0000 7f1a96a00700 1 -- 172.21.15.70:0/2628045110 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1a88014030 con 0x7f1aa0103eb0 2024-05-08T09:50:20.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.725+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1aa002e510 con 0x7f1aa0103eb0 2024-05-08T09:50:20.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.726+0000 7f1a96a00700 1 -- 172.21.15.70:0/2628045110 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v445) ==== 81+0+943 (secure 0 0 0) 0x7f1a880a9fa0 con 0x7f1aa0103eb0 2024-05-08T09:50:20.727 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/565155292 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:20.728 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/3718531938 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:20.728 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1348548569 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:20.728 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/3718531938 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:20.728 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1348548569 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:20.728 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2886471860 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:20.728 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2786047947 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:20.729 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2185065524 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:20.729 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2096266006 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:20.729 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/2822740915 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:20.729 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3587006025 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:20.729 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3060551286 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:20.729 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/2822740915 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:20.729 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/360029842 2024-05-09T06:46:32.619296+0000 2024-05-08T09:50:20.730 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/902378241 2024-05-09T06:31:13.904560+0000 2024-05-08T09:50:20.730 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3911583705 2024-05-09T06:30:38.292099+0000 2024-05-08T09:50:20.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.734+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a840b2aa0 msgr2=0x7f1a840b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:20.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.734+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a840b2aa0 0x7f1a840b4f60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1a90009040 tx=0x7f1a9000b7f0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.734+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0103eb0 msgr2=0x7f1aa019c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:20.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.734+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0103eb0 0x7f1aa019c490 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c920 tx=0x7f1a8800cce0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.735+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 shutdown_connections 2024-05-08T09:50:20.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.735+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f1a840b2aa0 0x7f1a840b4f60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.735+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f1aa01a0820 0x7f1aa01a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.735+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1aa01034f0 0x7f1aa019bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.735+0000 7f1aa4e00700 1 --2- 172.21.15.70:0/2628045110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1aa0103eb0 0x7f1aa019c490 secure :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800c920 tx=0x7f1a8800cce0 comp rx=0 tx=0).stop 2024-05-08T09:50:20.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.735+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 >> 172.21.15.70:0/2628045110 conn(0x7f1aa007a650 msgr2=0x7f1aa010eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:20.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.735+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 shutdown_connections 2024-05-08T09:50:20.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:20.736+0000 7f1aa4e00700 1 -- 172.21.15.70:0/2628045110 wait complete. 2024-05-08T09:50:20.740 INFO:teuthology.orchestra.run.smithi070.stderr:listed 16 entries 2024-05-08T09:50:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:20 smithi070 ceph-mon[29591]: pgmap v5866: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:50:21.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:20 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2628045110' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T09:50:21.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:20 smithi172 ceph-mon[33377]: pgmap v5866: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:50:21.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:20 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2628045110' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T09:50:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:20 smithi194 ceph-mon[33679]: pgmap v5866: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T09:50:21.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:20 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2628045110' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T09:50:21.702 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2024-05-08T09:50:21.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T09:50:21.702 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-08T09:50:21.866 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[88253]: fuse finished with error 0 and tester_r 0 2024-05-08T09:50:23.178 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:22 smithi172 ceph-mon[33377]: pgmap v5867: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 191 B/s wr, 5 op/s 2024-05-08T09:50:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:22 smithi194 ceph-mon[33679]: pgmap v5867: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 191 B/s wr, 5 op/s 2024-05-08T09:50:23.373 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:22 smithi070 ceph-mon[29591]: pgmap v5867: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 191 B/s wr, 5 op/s 2024-05-08T09:50:23.377 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T09:50:25.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:24 smithi194 ceph-mon[33679]: pgmap v5868: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T09:50:25.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:24 smithi070 ceph-mon[29591]: pgmap v5868: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T09:50:25.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:24 smithi172 ceph-mon[33377]: pgmap v5868: 129 pgs: 23 active+clean+snaptrim, 69 active+clean+snaptrim_wait, 37 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T09:50:27.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:26 smithi194 ceph-mon[33679]: pgmap v5869: 129 pgs: 17 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 58 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T09:50:27.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:26 smithi070 ceph-mon[29591]: pgmap v5869: 129 pgs: 17 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 58 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T09:50:27.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:26 smithi172 ceph-mon[33377]: pgmap v5869: 129 pgs: 17 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 58 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T09:50:29.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:28 smithi194 ceph-mon[33679]: pgmap v5870: 129 pgs: 17 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 58 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:50:29.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:28 smithi070 ceph-mon[29591]: pgmap v5870: 129 pgs: 17 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 58 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:50:29.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:28 smithi172 ceph-mon[33377]: pgmap v5870: 129 pgs: 17 active+clean+snaptrim, 54 active+clean+snaptrim_wait, 58 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T09:50:31.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:30 smithi194 ceph-mon[33679]: pgmap v5871: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:50:31.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:30 smithi070 ceph-mon[29591]: pgmap v5871: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:50:31.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:30 smithi172 ceph-mon[33377]: pgmap v5871: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T09:50:33.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:32 smithi194 ceph-mon[33679]: pgmap v5872: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:33.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:32 smithi070 ceph-mon[29591]: pgmap v5872: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:33.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:32 smithi172 ceph-mon[33377]: pgmap v5872: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:35.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:34 smithi172 ceph-mon[33377]: pgmap v5873: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:35.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:34 smithi194 ceph-mon[33679]: pgmap v5873: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:35.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:34 smithi070 ceph-mon[29591]: pgmap v5873: 129 pgs: 12 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 83 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T09:50:35.580 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T09:50:35.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T09:50:35.581 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T09:50:35.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T09:50:35.687 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-05-08T09:50:35.757 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T09:50:35.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T09:50:35.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T09:50:35.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T09:50:35.843 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-05-08T09:50:35.944 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-08T09:50:35.955 INFO:tasks.cephadm:Teardown begin 2024-05-08T09:50:35.956 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T09:50:35.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:50:36.431 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:50:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:36 smithi194 ceph-mon[33679]: pgmap v5874: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-08T09:50:37.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:36 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:50:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:36 smithi070 ceph-mon[29591]: pgmap v5874: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-08T09:50:37.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:36 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:50:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:36 smithi172 ceph-mon[33377]: pgmap v5874: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 767 B/s wr, 9 op/s 2024-05-08T09:50:37.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:36 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T09:50:38.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:38 smithi070 ceph-mon[29591]: osdmap e446: 12 total, 12 up, 12 in 2024-05-08T09:50:38.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:38 smithi070 ceph-mon[29591]: pgmap v5876: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 8 op/s 2024-05-08T09:50:38.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:38 smithi194 ceph-mon[33679]: osdmap e446: 12 total, 12 up, 12 in 2024-05-08T09:50:38.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:38 smithi194 ceph-mon[33679]: pgmap v5876: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 8 op/s 2024-05-08T09:50:38.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.591+0000 7f6489800700 1 -- 172.21.15.70:0/366444918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6484109510 msgr2=0x7f64841098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:38.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.591+0000 7f6489800700 1 --2- 172.21.15.70:0/366444918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6484109510 0x7f64841098f0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f647400b0a0 tx=0x7f647400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.592+0000 7f6489800700 1 -- 172.21.15.70:0/366444918 shutdown_connections 2024-05-08T09:50:38.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.592+0000 7f6489800700 1 --2- 172.21.15.70:0/366444918 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f648406bb40 0x7f6484110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.592+0000 7f6489800700 1 --2- 172.21.15.70:0/366444918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6484109510 0x7f64841098f0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.592+0000 7f6489800700 1 --2- 172.21.15.70:0/366444918 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f648406b180 0x7f648406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.592+0000 7f6489800700 1 -- 172.21.15.70:0/366444918 >> 172.21.15.70:0/366444918 conn(0x7f6484079350 msgr2=0x7f6484079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:38.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.592+0000 7f6489800700 1 -- 172.21.15.70:0/366444918 shutdown_connections 2024-05-08T09:50:38.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.592+0000 7f6489800700 1 -- 172.21.15.70:0/366444918 wait complete. 2024-05-08T09:50:38.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.593+0000 7f6489800700 1 Processor -- start 2024-05-08T09:50:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.593+0000 7f6489800700 1 -- start start 2024-05-08T09:50:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f6489800700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f648406b180 0x7f64841a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f6489800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f648406bb40 0x7f64841a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:38.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f6489800700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6484109510 0x7f648419ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f6489800700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64841134d0 con 0x7f648406bb40 2024-05-08T09:50:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f6489800700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6484113350 con 0x7f6484109510 2024-05-08T09:50:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f6489800700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6484113650 con 0x7f648406b180 2024-05-08T09:50:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f647a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f648406bb40 0x7f64841a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f647a000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f648406bb40 0x7f64841a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35156/0 (socket says 172.21.15.70:35156) 2024-05-08T09:50:38.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f647a000700 1 -- 172.21.15.70:0/1618446801 learned_addr learned my addr 172.21.15.70:0/1618446801 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:50:38.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.594+0000 7f6483400700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6484109510 0x7f648419ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:38.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f6482a00700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f648406b180 0x7f64841a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f647a000700 1 -- 172.21.15.70:0/1618446801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f648406b180 msgr2=0x7f64841a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f647a000700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f648406b180 0x7f64841a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f647a000700 1 -- 172.21.15.70:0/1618446801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6484109510 msgr2=0x7f648419ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f647a000700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6484109510 0x7f648419ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f647a000700 1 -- 172.21.15.70:0/1618446801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648419c190 con 0x7f648406bb40 2024-05-08T09:50:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f6482a00700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f648406b180 0x7f64841a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:50:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f647a000700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f648406bb40 0x7f64841a1db0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f646c00d950 tx=0x7f646c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:38.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f647be00700 1 -- 172.21.15.70:0/1618446801 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c016070 con 0x7f648406bb40 2024-05-08T09:50:38.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f647be00700 1 -- 172.21.15.70:0/1618446801 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f646c010460 con 0x7f648406bb40 2024-05-08T09:50:38.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f647be00700 1 -- 172.21.15.70:0/1618446801 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646c00f620 con 0x7f648406bb40 2024-05-08T09:50:38.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.595+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648419c420 con 0x7f648406bb40 2024-05-08T09:50:38.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.596+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64841a8740 con 0x7f648406bb40 2024-05-08T09:50:38.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.597+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648406a190 con 0x7f648406bb40 2024-05-08T09:50:38.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.599+0000 7f647be00700 1 -- 172.21.15.70:0/1618446801 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f646c019070 con 0x7f648406bb40 2024-05-08T09:50:38.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.600+0000 7f647be00700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64680b2a70 0x7f64680b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:38.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.601+0000 7f647be00700 1 -- 172.21.15.70:0/1618446801 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(446..446 src has 1..446) ==== 9583+0+0 (secure 0 0 0) 0x7f646c0e2660 con 0x7f648406bb40 2024-05-08T09:50:38.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.601+0000 7f6482a00700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64680b2a70 0x7f64680b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:38.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.602+0000 7f6482a00700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64680b2a70 0x7f64680b4f30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6474009e60 tx=0x7f647400b7b0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:38.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.603+0000 7f647be00700 1 -- 172.21.15.70:0/1618446801 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f646c0a9bc0 con 0x7f648406bb40 2024-05-08T09:50:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:38 smithi172 ceph-mon[33377]: osdmap e446: 12 total, 12 up, 12 in 2024-05-08T09:50:38.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:38 smithi172 ceph-mon[33377]: pgmap v5876: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 8 op/s 2024-05-08T09:50:38.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.894+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64841a8940 con 0x7f648406bb40 2024-05-08T09:50:38.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.901+0000 7f647be00700 1 -- 172.21.15.70:0/1618446801 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11878 (secure 0 0 0) 0x7f646c0a94c0 con 0x7f648406bb40 2024-05-08T09:50:38.900 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:50:38.900 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":46,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:49:05.468230+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:50:38.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64680b2a70 msgr2=0x7f64680b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:38.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64680b2a70 0x7f64680b4f30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6474009e60 tx=0x7f647400b7b0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f648406bb40 msgr2=0x7f64841a1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:38.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f648406bb40 0x7f64841a1db0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f646c00d950 tx=0x7f646c00dd10 comp rx=0 tx=0).stop 2024-05-08T09:50:38.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 shutdown_connections 2024-05-08T09:50:38.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f64680b2a70 0x7f64680b4f30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6484109510 0x7f648419ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f648406b180 0x7f64841a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 --2- 172.21.15.70:0/1618446801 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f648406bb40 0x7f64841a1db0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:38.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 >> 172.21.15.70:0/1618446801 conn(0x7f6484079350 msgr2=0x7f648410e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:38.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 shutdown_connections 2024-05-08T09:50:38.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:38.905+0000 7f6489800700 1 -- 172.21.15.70:0/1618446801 wait complete. 2024-05-08T09:50:38.905 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 46 2024-05-08T09:50:39.756 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T09:50:40.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:50:40.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:39 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1618446801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:50:40.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:50:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:50:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:50:40.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:39 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:50:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:50:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:39 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1618446801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:50:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:50:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:50:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:50:40.180 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:39 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:50:40.202 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:50:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:50:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:39 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1618446801' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:50:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:50:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T09:50:40.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T09:50:40.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:39 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' 2024-05-08T09:50:41.179 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:40 smithi172 ceph-mon[33377]: pgmap v5877: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 8 op/s 2024-05-08T09:50:41.197 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:40 smithi070 ceph-mon[29591]: pgmap v5877: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 8 op/s 2024-05-08T09:50:41.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:40 smithi194 ceph-mon[33679]: pgmap v5877: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 8 op/s 2024-05-08T09:50:43.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:42 smithi194 ceph-mon[33679]: pgmap v5878: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 8 op/s 2024-05-08T09:50:43.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:42 smithi194 ceph-mon[33679]: osdmap e447: 12 total, 12 up, 12 in 2024-05-08T09:50:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:42 smithi070 ceph-mon[29591]: pgmap v5878: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 8 op/s 2024-05-08T09:50:43.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:42 smithi070 ceph-mon[29591]: osdmap e447: 12 total, 12 up, 12 in 2024-05-08T09:50:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:42 smithi172 ceph-mon[33377]: pgmap v5878: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 921 B/s wr, 8 op/s 2024-05-08T09:50:43.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:42 smithi172 ceph-mon[33377]: osdmap e447: 12 total, 12 up, 12 in 2024-05-08T09:50:45.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:44 smithi070 ceph-mon[29591]: pgmap v5880: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-05-08T09:50:45.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:44 smithi194 ceph-mon[33679]: pgmap v5880: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-05-08T09:50:45.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.340+0000 7f84bde00700 1 -- 172.21.15.70:0/3501689791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b80756d0 msgr2=0x7f84b8075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:45.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.340+0000 7f84bde00700 1 --2- 172.21.15.70:0/3501689791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b80756d0 0x7f84b8075ab0 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f84a8009990 tx=0x7f84a8009ca0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.340+0000 7f84bde00700 1 -- 172.21.15.70:0/3501689791 shutdown_connections 2024-05-08T09:50:45.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.340+0000 7f84bde00700 1 --2- 172.21.15.70:0/3501689791 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84b810fea0 0x7f84b8112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.340+0000 7f84bde00700 1 --2- 172.21.15.70:0/3501689791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b80756d0 0x7f84b8075ab0 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.340+0000 7f84bde00700 1 --2- 172.21.15.70:0/3501689791 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b8075ff0 0x7f84b810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.340+0000 7f84bde00700 1 -- 172.21.15.70:0/3501689791 >> 172.21.15.70:0/3501689791 conn(0x7f84b807a600 msgr2=0x7f84b807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:45.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.341+0000 7f84bde00700 1 -- 172.21.15.70:0/3501689791 shutdown_connections 2024-05-08T09:50:45.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.341+0000 7f84bde00700 1 -- 172.21.15.70:0/3501689791 wait complete. 2024-05-08T09:50:45.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.342+0000 7f84bde00700 1 Processor -- start 2024-05-08T09:50:45.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.342+0000 7f84bde00700 1 -- start start 2024-05-08T09:50:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.342+0000 7f84bde00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b80756d0 0x7f84b81a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.342+0000 7f84bde00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b8075ff0 0x7f84b81a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.343+0000 7f84bde00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84b810fea0 0x7f84b819bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.343+0000 7f84bde00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8115700 con 0x7f84b8075ff0 2024-05-08T09:50:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.343+0000 7f84bde00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8115580 con 0x7f84b80756d0 2024-05-08T09:50:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.343+0000 7f84bde00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f84b8115880 con 0x7f84b810fea0 2024-05-08T09:50:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.343+0000 7f84b6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b8075ff0 0x7f84b81a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:45.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.343+0000 7f84b6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b8075ff0 0x7f84b81a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35170/0 (socket says 172.21.15.70:35170) 2024-05-08T09:50:45.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.343+0000 7f84b6000700 1 -- 172.21.15.70:0/3653278624 learned_addr learned my addr 172.21.15.70:0/3653278624 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:50:45.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.343+0000 7f84b6a00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b80756d0 0x7f84b81a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:45.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.343+0000 7f84b7400700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84b810fea0 0x7f84b819bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:45.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84b6000700 1 -- 172.21.15.70:0/3653278624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84b810fea0 msgr2=0x7f84b819bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:45.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84b6000700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84b810fea0 0x7f84b819bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84b6000700 1 -- 172.21.15.70:0/3653278624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b80756d0 msgr2=0x7f84b81a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:45.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84b6000700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b80756d0 0x7f84b81a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84b6000700 1 -- 172.21.15.70:0/3653278624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b819c240 con 0x7f84b8075ff0 2024-05-08T09:50:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84b6000700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b8075ff0 0x7f84b81a1e60 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c990 tx=0x7f84a400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84bca00700 1 -- 172.21.15.70:0/3653278624 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4007b00 con 0x7f84b8075ff0 2024-05-08T09:50:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84bca00700 1 -- 172.21.15.70:0/3653278624 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84a4007ca0 con 0x7f84b8075ff0 2024-05-08T09:50:45.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b819c530 con 0x7f84b8075ff0 2024-05-08T09:50:45.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84bca00700 1 -- 172.21.15.70:0/3653278624 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4018660 con 0x7f84b8075ff0 2024-05-08T09:50:45.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.344+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b81a87f0 con 0x7f84b8075ff0 2024-05-08T09:50:45.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.346+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b806a190 con 0x7f84b8075ff0 2024-05-08T09:50:45.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.348+0000 7f84bca00700 1 -- 172.21.15.70:0/3653278624 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f84a400f450 con 0x7f84b8075ff0 2024-05-08T09:50:45.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.349+0000 7f84bca00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f849c0b2a70 0x7f849c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:45.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.350+0000 7f84bca00700 1 -- 172.21.15.70:0/3653278624 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(447..447 src has 1..447) ==== 9539+0+0 (secure 0 0 0) 0x7f84a40e29a0 con 0x7f84b8075ff0 2024-05-08T09:50:45.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.350+0000 7f84b6a00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f849c0b2a70 0x7f849c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:45.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.351+0000 7f84b6a00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f849c0b2a70 0x7f849c0b4f30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f84a800b5c0 tx=0x7f84a8005960 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:45.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.355+0000 7f84bca00700 1 -- 172.21.15.70:0/3653278624 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f84a4014030 con 0x7f84b8075ff0 2024-05-08T09:50:45.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:44 smithi172 ceph-mon[33377]: pgmap v5880: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s 2024-05-08T09:50:45.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.645+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f84b802e510 con 0x7f84b8075ff0 2024-05-08T09:50:45.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.646+0000 7f84bca00700 1 -- 172.21.15.70:0/3653278624 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11878 (secure 0 0 0) 0x7f84a40a9f20 con 0x7f84b8075ff0 2024-05-08T09:50:45.646 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:50:45.646 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14499,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/2483099434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":2483099434},{"type":"v1","addr":"172.21.15.70:6835","nonce":2483099434}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14505,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/2593169616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":2593169616},{"type":"v1","addr":"172.21.15.70:6837","nonce":2593169616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14556,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/1788340379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":1788340379},{"type":"v1","addr":"172.21.15.70:6839","nonce":1788340379}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14568,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3780132216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3780132216},{"type":"v1","addr":"172.21.15.70:6841","nonce":3780132216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24364,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/2484800274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":2484800274},{"type":"v1","addr":"172.21.15.194:6833","nonce":2484800274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24391,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2911491669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":2911491669},{"type":"v1","addr":"172.21.15.194:6835","nonce":2911491669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":46,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T06:41:12.659763+0000","modified":"2024-05-08T09:49:05.468230+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34442,"mds_1":34409,"mds_2":34379},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24397":{"gid":24397,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6837/346722795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6836","nonce":346722795},{"type":"v1","addr":"172.21.15.194:6837","nonce":346722795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24409":{"gid":24409,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.194:6839/622098707","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6838","nonce":622098707},{"type":"v1","addr":"172.21.15.194:6839","nonce":622098707}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34364":{"gid":34364,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.172:6833/852809993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":852809993},{"type":"v1","addr":"172.21.15.172:6833","nonce":852809993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34379":{"gid":34379,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.172:6835/3516901387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6834","nonce":3516901387},{"type":"v1","addr":"172.21.15.172:6835","nonce":3516901387}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.172:6837/2037790761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6836","nonce":2037790761},{"type":"v1","addr":"172.21.15.172:6837","nonce":2037790761}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34442":{"gid":34442,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.172:6839/283788562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6838","nonce":283788562},{"type":"v1","addr":"172.21.15.172:6839","nonce":283788562}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34442,"qdb_cluster":[34409,34379,34442]},"id":1}]} 2024-05-08T09:50:45.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f849c0b2a70 msgr2=0x7f849c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:45.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f849c0b2a70 0x7f849c0b4f30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f84a800b5c0 tx=0x7f84a8005960 comp rx=0 tx=0).stop 2024-05-08T09:50:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b8075ff0 msgr2=0x7f84b81a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b8075ff0 0x7f84b81a1e60 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c990 tx=0x7f84a400cca0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 shutdown_connections 2024-05-08T09:50:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f849c0b2a70 0x7f849c0b4f30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84b810fea0 0x7f84b819bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f84b80756d0 0x7f84b81a1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 --2- 172.21.15.70:0/3653278624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f84b8075ff0 0x7f84b81a1e60 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 >> 172.21.15.70:0/3653278624 conn(0x7f84b807a600 msgr2=0x7f84b8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 shutdown_connections 2024-05-08T09:50:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:45.650+0000 7f84bde00700 1 -- 172.21.15.70:0/3653278624 wait complete. 2024-05-08T09:50:45.651 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 46 2024-05-08T09:50:46.061 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:45 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/3653278624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:50:46.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:45 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/3653278624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:50:46.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:45 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/3653278624' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T09:50:46.483 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T09:50:46.910 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:50:47.059 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:46 smithi070 ceph-mon[29591]: pgmap v5881: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T09:50:47.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:46 smithi194 ceph-mon[33679]: pgmap v5881: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T09:50:47.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:46 smithi172 ceph-mon[33377]: pgmap v5881: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-08T09:50:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.177+0000 7f6d14e00700 1 -- 172.21.15.70:0/478617478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103fd0 msgr2=0x7f6d10108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.177+0000 7f6d14e00700 1 --2- 172.21.15.70:0/478617478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103fd0 0x7f6d10108020 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80099c0 tx=0x7f6cf8009cd0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.177+0000 7f6d14e00700 1 -- 172.21.15.70:0/478617478 shutdown_connections 2024-05-08T09:50:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.177+0000 7f6d14e00700 1 --2- 172.21.15.70:0/478617478 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d10108700 0x7f6d101102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.177+0000 7f6d14e00700 1 --2- 172.21.15.70:0/478617478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d10103620 0x7f6d10103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.177+0000 7f6d14e00700 1 --2- 172.21.15.70:0/478617478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103fd0 0x7f6d10108020 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.177+0000 7f6d14e00700 1 -- 172.21.15.70:0/478617478 >> 172.21.15.70:0/478617478 conn(0x7f6d100feeb0 msgr2=0x7f6d101012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.177+0000 7f6d14e00700 1 -- 172.21.15.70:0/478617478 shutdown_connections 2024-05-08T09:50:49.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.177+0000 7f6d14e00700 1 -- 172.21.15.70:0/478617478 wait complete. 2024-05-08T09:50:49.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.178+0000 7f6d14e00700 1 Processor -- start 2024-05-08T09:50:49.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d14e00700 1 -- start start 2024-05-08T09:50:49.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d14e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103620 0x7f6d100757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d14e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d10103fd0 0x7f6d10075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d14e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d10108700 0x7f6d10076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d14e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d10113440 con 0x7f6d10103620 2024-05-08T09:50:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d14e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f6d101132c0 con 0x7f6d10103fd0 2024-05-08T09:50:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d14e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f6d101135c0 con 0x7f6d10108700 2024-05-08T09:50:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d0f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103620 0x7f6d100757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:49.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d0f400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103620 0x7f6d100757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35866/0 (socket says 172.21.15.70:35866) 2024-05-08T09:50:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.179+0000 7f6d0f400700 1 -- 172.21.15.70:0/4019909713 learned_addr learned my addr 172.21.15.70:0/4019909713 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:50:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.180+0000 7f6d07e00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d10103fd0 0x7f6d10075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.180+0000 7f6d0fe00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d10108700 0x7f6d10076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.180+0000 7f6d0f400700 1 -- 172.21.15.70:0/4019909713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d10108700 msgr2=0x7f6d10076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.180+0000 7f6d0f400700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d10108700 0x7f6d10076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.180+0000 7f6d0f400700 1 -- 172.21.15.70:0/4019909713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d10103fd0 msgr2=0x7f6d10075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.180+0000 7f6d0f400700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d10103fd0 0x7f6d10075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.180+0000 7f6d0f400700 1 -- 172.21.15.70:0/4019909713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d101a7fc0 con 0x7f6d10103620 2024-05-08T09:50:49.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.180+0000 7f6d0f400700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103620 0x7f6d100757a0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000d980 tx=0x7f6d0000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:49.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.180+0000 7f6d0cc00700 1 -- 172.21.15.70:0/4019909713 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00017070 con 0x7f6d10103620 2024-05-08T09:50:49.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.181+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d101a82b0 con 0x7f6d10103620 2024-05-08T09:50:49.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.181+0000 7f6d0cc00700 1 -- 172.21.15.70:0/4019909713 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d00004830 con 0x7f6d10103620 2024-05-08T09:50:49.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.181+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d101a87c0 con 0x7f6d10103620 2024-05-08T09:50:49.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.181+0000 7f6d0cc00700 1 -- 172.21.15.70:0/4019909713 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d00005340 con 0x7f6d10103620 2024-05-08T09:50:49.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.182+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1006a190 con 0x7f6d10103620 2024-05-08T09:50:49.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.184+0000 7f6d0cc00700 1 -- 172.21.15.70:0/4019909713 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6d000049e0 con 0x7f6d10103620 2024-05-08T09:50:49.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.185+0000 7f6d0cc00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6cf40b29f0 0x7f6cf40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.186+0000 7f6d0cc00700 1 -- 172.21.15.70:0/4019909713 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(447..447 src has 1..447) ==== 9539+0+0 (secure 0 0 0) 0x7f6d000e2c70 con 0x7f6d10103620 2024-05-08T09:50:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.186+0000 7f6d07e00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6cf40b29f0 0x7f6cf40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:49.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.187+0000 7f6d07e00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6cf40b29f0 0x7f6cf40b4eb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009990 tx=0x7f6cf801a040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:49.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.188+0000 7f6d0cc00700 1 -- 172.21.15.70:0/4019909713 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6d00020030 con 0x7f6d10103620 2024-05-08T09:50:49.232 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:48 smithi172 ceph-mon[33377]: pgmap v5882: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:49.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:48 smithi194 ceph-mon[33679]: pgmap v5882: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:49.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:48 smithi070 ceph-mon[29591]: pgmap v5882: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:49.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.422+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6d1002e510 con 0x7f6d10103620 2024-05-08T09:50:49.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.426+0000 7f6d0cc00700 1 -- 172.21.15.70:0/4019909713 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v447) ==== 74+0+25364 (secure 0 0 0) 0x7f6d0008b330 con 0x7f6d10103620 2024-05-08T09:50:49.426 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-05-08T09:50:49.427 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":447,"fsid":"3cf89df8-0d04-11ef-bc97-c7b262605968","created":"2024-05-08T06:30:04.772701+0000","modified":"2024-05-08T09:50:42.205776+0000","last_up_change":"2024-05-08T06:39:45.224475+0000","last_in_change":"2024-05-08T06:39:19.979062+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T06:34:30.088563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T06:41:04.053091+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T06:41:08.479556+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"445","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":360,"snap_epoch":445,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-08T06:41:22.635580+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"445","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":360,"snap_epoch":445,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e4faccd2-51f5-4d97-bf21-732ac8e6ff4f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6803","nonce":698641504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6805","nonce":698641504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6809","nonce":698641504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":698641504},{"type":"v1","addr":"172.21.15.70:6807","nonce":698641504}]},"public_addr":"172.21.15.70:6803/698641504","cluster_addr":"172.21.15.70:6805/698641504","heartbeat_back_addr":"172.21.15.70:6809/698641504","heartbeat_front_addr":"172.21.15.70:6807/698641504","state":["exists","up"]},{"osd":1,"uuid":"ad6b1754-8896-4721-8647-38c40794418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6801","nonce":3666956489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6803","nonce":3666956489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6807","nonce":3666956489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":3666956489},{"type":"v1","addr":"172.21.15.172:6805","nonce":3666956489}]},"public_addr":"172.21.15.172:6801/3666956489","cluster_addr":"172.21.15.172:6803/3666956489","heartbeat_back_addr":"172.21.15.172:6807/3666956489","heartbeat_front_addr":"172.21.15.172:6805/3666956489","state":["exists","up"]},{"osd":2,"uuid":"d439c3d9-e3fb-44b6-8bae-d0bb93a1c76b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6801","nonce":818198413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6803","nonce":818198413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6807","nonce":818198413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":818198413},{"type":"v1","addr":"172.21.15.194:6805","nonce":818198413}]},"public_addr":"172.21.15.194:6801/818198413","cluster_addr":"172.21.15.194:6803/818198413","heartbeat_back_addr":"172.21.15.194:6807/818198413","heartbeat_front_addr":"172.21.15.194:6805/818198413","state":["exists","up"]},{"osd":3,"uuid":"bd9bdf93-9e12-4613-8ff0-62b507edbd29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6811","nonce":3483817931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6813","nonce":3483817931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6817","nonce":3483817931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":3483817931},{"type":"v1","addr":"172.21.15.70:6815","nonce":3483817931}]},"public_addr":"172.21.15.70:6811/3483817931","cluster_addr":"172.21.15.70:6813/3483817931","heartbeat_back_addr":"172.21.15.70:6817/3483817931","heartbeat_front_addr":"172.21.15.70:6815/3483817931","state":["exists","up"]},{"osd":4,"uuid":"9c49b8a2-2234-4306-b3f2-35426e29e1c2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6809","nonce":3980608525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6811","nonce":3980608525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6815","nonce":3980608525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3980608525},{"type":"v1","addr":"172.21.15.172:6813","nonce":3980608525}]},"public_addr":"172.21.15.172:6809/3980608525","cluster_addr":"172.21.15.172:6811/3980608525","heartbeat_back_addr":"172.21.15.172:6815/3980608525","heartbeat_front_addr":"172.21.15.172:6813/3980608525","state":["exists","up"]},{"osd":5,"uuid":"acc9c880-48f9-41d7-bb61-6bcd1ecbc66d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6809","nonce":250291870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6811","nonce":250291870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6815","nonce":250291870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":250291870},{"type":"v1","addr":"172.21.15.194:6813","nonce":250291870}]},"public_addr":"172.21.15.194:6809/250291870","cluster_addr":"172.21.15.194:6811/250291870","heartbeat_back_addr":"172.21.15.194:6815/250291870","heartbeat_front_addr":"172.21.15.194:6813/250291870","state":["exists","up"]},{"osd":6,"uuid":"75960823-8e38-4f10-9bd2-42d4d4196126","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6819","nonce":2584912798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6821","nonce":2584912798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6825","nonce":2584912798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":2584912798},{"type":"v1","addr":"172.21.15.70:6823","nonce":2584912798}]},"public_addr":"172.21.15.70:6819/2584912798","cluster_addr":"172.21.15.70:6821/2584912798","heartbeat_back_addr":"172.21.15.70:6825/2584912798","heartbeat_front_addr":"172.21.15.70:6823/2584912798","state":["exists","up"]},{"osd":7,"uuid":"3fb26034-c4db-4bd4-b999-9d412750b779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6817","nonce":3099304179}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6819","nonce":3099304179}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6823","nonce":3099304179}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":3099304179},{"type":"v1","addr":"172.21.15.172:6821","nonce":3099304179}]},"public_addr":"172.21.15.172:6817/3099304179","cluster_addr":"172.21.15.172:6819/3099304179","heartbeat_back_addr":"172.21.15.172:6823/3099304179","heartbeat_front_addr":"172.21.15.172:6821/3099304179","state":["exists","up"]},{"osd":8,"uuid":"bbb0d4c1-736a-4dc1-b6f4-d3e7f2a74728","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6817","nonce":1974878207}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6819","nonce":1974878207}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6822","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6823","nonce":1974878207}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1974878207},{"type":"v1","addr":"172.21.15.194:6821","nonce":1974878207}]},"public_addr":"172.21.15.194:6817/1974878207","cluster_addr":"172.21.15.194:6819/1974878207","heartbeat_back_addr":"172.21.15.194:6823/1974878207","heartbeat_front_addr":"172.21.15.194:6821/1974878207","state":["exists","up"]},{"osd":9,"uuid":"d65536ca-d40f-4700-8631-2bddb2d0db04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6827","nonce":22141436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6829","nonce":22141436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6833","nonce":22141436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":22141436},{"type":"v1","addr":"172.21.15.70:6831","nonce":22141436}]},"public_addr":"172.21.15.70:6827/22141436","cluster_addr":"172.21.15.70:6829/22141436","heartbeat_back_addr":"172.21.15.70:6833/22141436","heartbeat_front_addr":"172.21.15.70:6831/22141436","state":["exists","up"]},{"osd":10,"uuid":"9a1572f4-f7bc-4dff-bfe1-497a3bc2a0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6825","nonce":1417359106}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6827","nonce":1417359106}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6831","nonce":1417359106}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":1417359106},{"type":"v1","addr":"172.21.15.172:6829","nonce":1417359106}]},"public_addr":"172.21.15.172:6825/1417359106","cluster_addr":"172.21.15.172:6827/1417359106","heartbeat_back_addr":"172.21.15.172:6831/1417359106","heartbeat_front_addr":"172.21.15.172:6829/1417359106","state":["exists","up"]},{"osd":11,"uuid":"820c95fd-0e17-4077-860c-ed32ad54d045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6825","nonce":2919544964}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6826","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6827","nonce":2919544964}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6831","nonce":2919544964}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":2919544964},{"type":"v1","addr":"172.21.15.194:6829","nonce":2919544964}]},"public_addr":"172.21.15.194:6825/2919544964","cluster_addr":"172.21.15.194:6827/2919544964","heartbeat_back_addr":"172.21.15.194:6831/2919544964","heartbeat_front_addr":"172.21.15.194:6829/2919544964","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:21.885012+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:33:54.577437+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:34:27.034547+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:01.938608+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:35:36.053088+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:09.827647+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:36:45.872979+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:20.309546+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:37:55.433963+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:38:31.971481+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:07.555726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T06:39:43.267330+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.19","mappings":[{"from":3,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.2d","mappings":[{"from":3,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.9","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:0/565155292":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6800/3718531938":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6801/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:6801/3718531938":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6800/1348548569":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2886471860":"2024-05-09T06:46:32.619296+0000","172.21.15.70:0/2786047947":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/2185065524":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/2096266006":"2024-05-09T06:46:32.619296+0000","172.21.15.70:6800/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/3587006025":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3060551286":"2024-05-09T06:30:38.292099+0000","172.21.15.70:6801/2822740915":"2024-05-09T06:30:38.292099+0000","172.21.15.70:0/360029842":"2024-05-09T06:46:32.619296+0000","172.21.15.70:0/902378241":"2024-05-09T06:31:13.904560+0000","172.21.15.70:0/3911583705":"2024-05-09T06:30:38.292099+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":4,"snaps":[{"begin":347,"length":1},{"begin":360,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T09:50:49.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.430+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6cf40b29f0 msgr2=0x7f6cf40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:49.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.430+0000 7f6d14e00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6cf40b29f0 0x7f6cf40b4eb0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009990 tx=0x7f6cf801a040 comp rx=0 tx=0).stop 2024-05-08T09:50:49.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.430+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103620 msgr2=0x7f6d100757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:49.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.430+0000 7f6d14e00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103620 0x7f6d100757a0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000d980 tx=0x7f6d0000dd40 comp rx=0 tx=0).stop 2024-05-08T09:50:49.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.430+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 shutdown_connections 2024-05-08T09:50:49.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.430+0000 7f6d14e00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f6cf40b29f0 0x7f6cf40b4eb0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.430+0000 7f6d14e00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d10108700 0x7f6d10076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.430+0000 7f6d14e00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d10103620 0x7f6d100757a0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.431+0000 7f6d14e00700 1 --2- 172.21.15.70:0/4019909713 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f6d10103fd0 0x7f6d10075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:49.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.431+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 >> 172.21.15.70:0/4019909713 conn(0x7f6d100feeb0 msgr2=0x7f6d101002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:49.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.431+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 shutdown_connections 2024-05-08T09:50:49.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:49.431+0000 7f6d14e00700 1 -- 172.21.15.70:0/4019909713 wait complete. 2024-05-08T09:50:50.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:49 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4019909713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T09:50:50.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:49 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4019909713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T09:50:50.264 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs fail cephfs 2024-05-08T09:50:50.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:49 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4019909713' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T09:50:50.722 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:50:51.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:50 smithi070 ceph-mon[29591]: pgmap v5883: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:51.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:50 smithi194 ceph-mon[33679]: pgmap v5883: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:51.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:50 smithi172 ceph-mon[33377]: pgmap v5883: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:52.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.943+0000 7f8b78a00700 1 -- 172.21.15.70:0/868106404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b741056c0 msgr2=0x7f8b74105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:52.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.943+0000 7f8b78a00700 1 --2- 172.21.15.70:0/868106404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b741056c0 0x7f8b74105b40 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f8b60009990 tx=0x7f8b60009ca0 comp rx=0 tx=0).stop 2024-05-08T09:50:52.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.943+0000 7f8b78a00700 1 -- 172.21.15.70:0/868106404 shutdown_connections 2024-05-08T09:50:52.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.943+0000 7f8b78a00700 1 --2- 172.21.15.70:0/868106404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b74106080 0x7f8b74112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:52.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.943+0000 7f8b78a00700 1 --2- 172.21.15.70:0/868106404 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b7410b6c0 0x7f8b7410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:52.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.943+0000 7f8b78a00700 1 --2- 172.21.15.70:0/868106404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b741056c0 0x7f8b74105b40 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:52.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.943+0000 7f8b78a00700 1 -- 172.21.15.70:0/868106404 >> 172.21.15.70:0/868106404 conn(0x7f8b741011b0 msgr2=0x7f8b741035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:52.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.943+0000 7f8b78a00700 1 -- 172.21.15.70:0/868106404 shutdown_connections 2024-05-08T09:50:52.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.943+0000 7f8b78a00700 1 -- 172.21.15.70:0/868106404 wait complete. 2024-05-08T09:50:52.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.945+0000 7f8b78a00700 1 Processor -- start 2024-05-08T09:50:52.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.945+0000 7f8b78a00700 1 -- start start 2024-05-08T09:50:52.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.945+0000 7f8b78a00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b741056c0 0x7f8b7419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:52.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.945+0000 7f8b78a00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b74106080 0x7f8b7419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:52.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.945+0000 7f8b78a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b7410b6c0 0x7f8b741a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:52.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.945+0000 7f8b78a00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b74115800 con 0x7f8b7410b6c0 2024-05-08T09:50:52.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.945+0000 7f8b78a00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f8b74115680 con 0x7f8b741056c0 2024-05-08T09:50:52.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.945+0000 7f8b78a00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f8b74115980 con 0x7f8b74106080 2024-05-08T09:50:52.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b72800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b7410b6c0 0x7f8b741a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:52.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b72800700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b7410b6c0 0x7f8b741a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35878/0 (socket says 172.21.15.70:35878) 2024-05-08T09:50:52.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b72800700 1 -- 172.21.15.70:0/1203363406 learned_addr learned my addr 172.21.15.70:0/1203363406 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:50:52.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b71e00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b741056c0 0x7f8b7419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:52.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b71400700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b74106080 0x7f8b7419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:52.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b72800700 1 -- 172.21.15.70:0/1203363406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b74106080 msgr2=0x7f8b7419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:52.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b72800700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b74106080 0x7f8b7419c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:52.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b72800700 1 -- 172.21.15.70:0/1203363406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b741056c0 msgr2=0x7f8b7419bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:52.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b72800700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b741056c0 0x7f8b7419bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:52.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b72800700 1 -- 172.21.15.70:0/1203363406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b741a0d40 con 0x7f8b7410b6c0 2024-05-08T09:50:52.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.946+0000 7f8b71400700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b74106080 0x7f8b7419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:50:52.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.947+0000 7f8b72800700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b7410b6c0 0x7f8b741a0600 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00b970 tx=0x7f8b6c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:52.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.947+0000 7f8b6aa00700 1 -- 172.21.15.70:0/1203363406 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c019070 con 0x7f8b7410b6c0 2024-05-08T09:50:52.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.947+0000 7f8b6aa00700 1 -- 172.21.15.70:0/1203363406 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8b6c00cdc0 con 0x7f8b7410b6c0 2024-05-08T09:50:52.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.947+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b741a1030 con 0x7f8b7410b6c0 2024-05-08T09:50:52.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.947+0000 7f8b6aa00700 1 -- 172.21.15.70:0/1203363406 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c014e30 con 0x7f8b7410b6c0 2024-05-08T09:50:52.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.947+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b741a88b0 con 0x7f8b7410b6c0 2024-05-08T09:50:52.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.948+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b7406a190 con 0x7f8b7410b6c0 2024-05-08T09:50:52.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.952+0000 7f8b6aa00700 1 -- 172.21.15.70:0/1203363406 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8b6c01c070 con 0x7f8b7410b6c0 2024-05-08T09:50:52.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.954+0000 7f8b6aa00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8b580b29f0 0x7f8b580b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:52.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.954+0000 7f8b6aa00700 1 -- 172.21.15.70:0/1203363406 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(447..447 src has 1..447) ==== 9539+0+0 (secure 0 0 0) 0x7f8b6c0e2190 con 0x7f8b7410b6c0 2024-05-08T09:50:52.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.954+0000 7f8b71e00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8b580b29f0 0x7f8b580b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:52.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.955+0000 7f8b71e00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8b580b29f0 0x7f8b580b4eb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8b64005950 tx=0x7f8b6400a300 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:52.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:52.956+0000 7f8b6aa00700 1 -- 172.21.15.70:0/1203363406 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8b6c0a9820 con 0x7f8b7410b6c0 2024-05-08T09:50:53.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:52 smithi070 ceph-mon[29591]: pgmap v5884: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:53.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.237+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8b7419d090 con 0x7f8b7410b6c0 2024-05-08T09:50:53.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:52 smithi194 ceph-mon[33679]: pgmap v5884: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:53.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.269+0000 7f8b6aa00700 1 -- 172.21.15.70:0/1203363406 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) ==== 161+0+0 (secure 0 0 0) 0x7f8b6c0a9120 con 0x7f8b7410b6c0 2024-05-08T09:50:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8b580b29f0 msgr2=0x7f8b580b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8b580b29f0 0x7f8b580b4eb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f8b64005950 tx=0x7f8b6400a300 comp rx=0 tx=0).stop 2024-05-08T09:50:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b7410b6c0 msgr2=0x7f8b741a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:53.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b7410b6c0 0x7f8b741a0600 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00b970 tx=0x7f8b6c00bc80 comp rx=0 tx=0).stop 2024-05-08T09:50:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 shutdown_connections 2024-05-08T09:50:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f8b580b29f0 0x7f8b580b4eb0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:53.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b7410b6c0 0x7f8b741a0600 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:53.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f8b741056c0 0x7f8b7419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:53.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 --2- 172.21.15.70:0/1203363406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b74106080 0x7f8b7419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:53.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.274+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 >> 172.21.15.70:0/1203363406 conn(0x7f8b741011b0 msgr2=0x7f8b741018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:53.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.275+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 shutdown_connections 2024-05-08T09:50:53.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:53.275+0000 7f8b78a00700 1 -- 172.21.15.70:0/1203363406 wait complete. 2024-05-08T09:50:53.275 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T09:50:53.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:52 smithi172 ceph-mon[33377]: pgmap v5884: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:53.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:53 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a[29587]: 2024-05-08T09:50:53.265+0000 7f4f26600700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T09:50:53.761 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c[64706]: ignoring --setuser ceph since I am not root 2024-05-08T09:50:53.762 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c[64706]: ignoring --setgroup ceph since I am not root 2024-05-08T09:50:53.762 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-mds[64710]: -- 172.21.15.194:0/1403452335 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562c8fc81a40 con 0x562c8fc54c00 2024-05-08T09:50:53.762 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c[64706]: starting mds.c at 2024-05-08T09:50:53.762 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:50:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i[65010]: ignoring --setuser ceph since I am not root 2024-05-08T09:50:53.763 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:50:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i[65010]: ignoring --setgroup ceph since I am not root 2024-05-08T09:50:53.763 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:50:53 smithi194 ceph-mds[65014]: -- 172.21.15.194:0/3359840727 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559d14ff9a40 con 0x559d14fcc800 2024-05-08T09:50:53.763 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:50:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i[65010]: starting mds.i at 2024-05-08T09:50:53.930 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h[62928]: ignoring --setuser ceph since I am not root 2024-05-08T09:50:53.930 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h[62928]: ignoring --setgroup ceph since I am not root 2024-05-08T09:50:53.930 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mds[62932]: -- 172.21.15.172:0/837040707 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d5aca59a40 con 0x55d5aca2d000 2024-05-08T09:50:53.930 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h[62928]: starting mds.h at 2024-05-08T09:50:53.931 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e[62618]: ignoring --setuser ceph since I am not root 2024-05-08T09:50:53.931 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e[62618]: ignoring --setgroup ceph since I am not root 2024-05-08T09:50:53.931 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mds[62622]: -- 172.21.15.172:0/934277542 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ca2bb9fa40 con 0x55ca2bb72c00 2024-05-08T09:50:53.931 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e[62618]: starting mds.e at 2024-05-08T09:50:53.932 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k[62303]: ignoring --setuser ceph since I am not root 2024-05-08T09:50:53.932 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k[62303]: ignoring --setgroup ceph since I am not root 2024-05-08T09:50:53.932 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mds[62308]: -- 172.21.15.172:0/4200863044 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562132c19a40 con 0x562132becc00 2024-05-08T09:50:53.932 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k[62303]: starting mds.k at 2024-05-08T09:50:53.932 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b[63250]: ignoring --setuser ceph since I am not root 2024-05-08T09:50:53.933 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b[63250]: ignoring --setgroup ceph since I am not root 2024-05-08T09:50:53.933 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mds[63256]: -- 172.21.15.172:0/902392520 <== mon.2 v2:172.21.15.172:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55da4507ba40 con 0x55da4504f000 2024-05-08T09:50:53.933 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b[63250]: starting mds.b at 2024-05-08T09:50:54.140 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T09:50:54.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1203363406' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T09:50:54.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-mon[33679]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T09:50:54.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-mon[33679]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T09:50:54.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1203363406' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T09:50:54.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-mon[33679]: osdmap e448: 12 total, 12 up, 12 in 2024-05-08T09:50:54.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:53 smithi194 ceph-mon[33679]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-08T09:50:54.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:53 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1203363406' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T09:50:54.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:53 smithi070 ceph-mon[29591]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T09:50:54.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:53 smithi070 ceph-mon[29591]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T09:50:54.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:53 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1203363406' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T09:50:54.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:53 smithi070 ceph-mon[29591]: osdmap e448: 12 total, 12 up, 12 in 2024-05-08T09:50:54.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:53 smithi070 ceph-mon[29591]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-08T09:50:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1203363406' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T09:50:54.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mon[33377]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T09:50:54.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mon[33377]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T09:50:54.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1203363406' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T09:50:54.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mon[33377]: osdmap e448: 12 total, 12 up, 12 in 2024-05-08T09:50:54.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:53 smithi172 ceph-mon[33377]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-08T09:50:54.597 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:50:55.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: pgmap v5886: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:55.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.194:6836/465989976,v1:172.21.15.194:6837/465989976] up:boot 2024-05-08T09:50:55.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.194:6838/1583062948,v1:172.21.15.194:6839/1583062948] up:boot 2024-05-08T09:50:55.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6832/1037372775,v1:172.21.15.172:6834/1037372775] up:boot 2024-05-08T09:50:55.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6835/1307520667,v1:172.21.15.172:6837/1307520667] up:boot 2024-05-08T09:50:55.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6833/656161549,v1:172.21.15.172:6836/656161549] up:boot 2024-05-08T09:50:55.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: mds.? [v2:172.21.15.172:6838/1593962443,v1:172.21.15.172:6839/1593962443] up:boot 2024-05-08T09:50:55.019 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-08T09:50:55.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T09:50:55.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T09:50:55.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T09:50:55.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T09:50:55.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T09:50:55.020 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:54 smithi070 ceph-mon[29591]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T09:50:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: pgmap v5886: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.194:6836/465989976,v1:172.21.15.194:6837/465989976] up:boot 2024-05-08T09:50:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.194:6838/1583062948,v1:172.21.15.194:6839/1583062948] up:boot 2024-05-08T09:50:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6832/1037372775,v1:172.21.15.172:6834/1037372775] up:boot 2024-05-08T09:50:55.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6835/1307520667,v1:172.21.15.172:6837/1307520667] up:boot 2024-05-08T09:50:55.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6833/656161549,v1:172.21.15.172:6836/656161549] up:boot 2024-05-08T09:50:55.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: mds.? [v2:172.21.15.172:6838/1593962443,v1:172.21.15.172:6839/1593962443] up:boot 2024-05-08T09:50:55.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-08T09:50:55.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T09:50:55.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T09:50:55.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T09:50:55.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T09:50:55.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T09:50:55.263 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:54 smithi194 ceph-mon[33679]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T09:50:55.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: pgmap v5886: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-08T09:50:55.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.194:6836/465989976,v1:172.21.15.194:6837/465989976] up:boot 2024-05-08T09:50:55.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.194:6838/1583062948,v1:172.21.15.194:6839/1583062948] up:boot 2024-05-08T09:50:55.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6832/1037372775,v1:172.21.15.172:6834/1037372775] up:boot 2024-05-08T09:50:55.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6835/1307520667,v1:172.21.15.172:6837/1307520667] up:boot 2024-05-08T09:50:55.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6833/656161549,v1:172.21.15.172:6836/656161549] up:boot 2024-05-08T09:50:55.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: mds.? [v2:172.21.15.172:6838/1593962443,v1:172.21.15.172:6839/1593962443] up:boot 2024-05-08T09:50:55.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-05-08T09:50:55.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T09:50:55.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T09:50:55.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T09:50:55.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T09:50:55.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T09:50:55.431 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:54 smithi172 ceph-mon[33377]: from='mgr.15198 172.21.15.70:0/1110311762' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T09:50:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.954+0000 7f16e6000700 1 -- 172.21.15.70:0/3377830954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 msgr2=0x7f16e0109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.954+0000 7f16e6000700 1 --2- 172.21.15.70:0/3377830954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 0x7f16e0109f50 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f16cc009990 tx=0x7f16cc009ca0 comp rx=0 tx=0).stop 2024-05-08T09:50:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.954+0000 7f16e6000700 1 -- 172.21.15.70:0/3377830954 shutdown_connections 2024-05-08T09:50:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.954+0000 7f16e6000700 1 --2- 172.21.15.70:0/3377830954 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16e010a490 0x7f16e01169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.954+0000 7f16e6000700 1 --2- 172.21.15.70:0/3377830954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e010fb60 0x7f16e010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.954+0000 7f16e6000700 1 --2- 172.21.15.70:0/3377830954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 0x7f16e0109f50 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.954+0000 7f16e6000700 1 -- 172.21.15.70:0/3377830954 >> 172.21.15.70:0/3377830954 conn(0x7f16e0076c70 msgr2=0x7f16e01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.955+0000 7f16e6000700 1 -- 172.21.15.70:0/3377830954 shutdown_connections 2024-05-08T09:50:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.955+0000 7f16e6000700 1 -- 172.21.15.70:0/3377830954 wait complete. 2024-05-08T09:50:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16e6000700 1 Processor -- start 2024-05-08T09:50:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16e6000700 1 -- start start 2024-05-08T09:50:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16e6000700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 0x7f16e01a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16e6000700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e010a490 0x7f16e01a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16e6000700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16e010fb60 0x7f16e01a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16e6000700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0119bd0 con 0x7f16e0109ad0 2024-05-08T09:50:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16e6000700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0119a50 con 0x7f16e010fb60 2024-05-08T09:50:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16e6000700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0119d50 con 0x7f16e010a490 2024-05-08T09:50:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16df400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 0x7f16e01a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.956+0000 7f16df400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 0x7f16e01a0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35892/0 (socket says 172.21.15.70:35892) 2024-05-08T09:50:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16df400700 1 -- 172.21.15.70:0/2733067831 learned_addr learned my addr 172.21.15.70:0/2733067831 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:50:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16dfe00700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16e010fb60 0x7f16e01a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16dea00700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e010a490 0x7f16e01a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16df400700 1 -- 172.21.15.70:0/2733067831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e010a490 msgr2=0x7f16e01a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16df400700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e010a490 0x7f16e01a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16df400700 1 -- 172.21.15.70:0/2733067831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16e010fb60 msgr2=0x7f16e01a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16df400700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16e010fb60 0x7f16e01a49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16df400700 1 -- 172.21.15.70:0/2733067831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e01a5110 con 0x7f16e0109ad0 2024-05-08T09:50:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16dea00700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e010a490 0x7f16e01a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:50:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.957+0000 7f16df400700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 0x7f16e01a0100 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f16d000d950 tx=0x7f16d000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.958+0000 7f16d7e00700 1 -- 172.21.15.70:0/2733067831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d0016070 con 0x7f16e0109ad0 2024-05-08T09:50:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.958+0000 7f16d7e00700 1 -- 172.21.15.70:0/2733067831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16d0010460 con 0x7f16e0109ad0 2024-05-08T09:50:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.958+0000 7f16d7e00700 1 -- 172.21.15.70:0/2733067831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d000f620 con 0x7f16e0109ad0 2024-05-08T09:50:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.958+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e01a5400 con 0x7f16e0109ad0 2024-05-08T09:50:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.958+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e01acc80 con 0x7f16e0109ad0 2024-05-08T09:50:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.959+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e006a190 con 0x7f16e0109ad0 2024-05-08T09:50:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.961+0000 7f16d7e00700 1 -- 172.21.15.70:0/2733067831 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f16d0019070 con 0x7f16e0109ad0 2024-05-08T09:50:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.963+0000 7f16d7e00700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f16c40b29f0 0x7f16c40b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:50:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.963+0000 7f16d7e00700 1 -- 172.21.15.70:0/2733067831 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(448..448 src has 1..448) ==== 9753+0+0 (secure 0 0 0) 0x7f16d00e2710 con 0x7f16e0109ad0 2024-05-08T09:50:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.963+0000 7f16dea00700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f16c40b29f0 0x7f16c40b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:50:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.964+0000 7f16dea00700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f16c40b29f0 0x7f16c40b4eb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f16cc003760 tx=0x7f16cc005fb0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:50:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:56.967+0000 7f16d7e00700 1 -- 172.21.15.70:0/2733067831 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f16d00a9bc0 con 0x7f16e0109ad0 2024-05-08T09:50:57.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:56 smithi070 ceph-mon[29591]: pgmap v5887: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T09:50:57.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:57.252+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f16e002e510 con 0x7f16e0109ad0 2024-05-08T09:50:57.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:56 smithi194 ceph-mon[33679]: pgmap v5887: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T09:50:57.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:56 smithi172 ceph-mon[33377]: pgmap v5887: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T09:50:58.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.010+0000 7f16d7e00700 1 -- 172.21.15.70:0/2733067831 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f16d00a94c0 con 0x7f16e0109ad0 2024-05-08T09:50:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f16c40b29f0 msgr2=0x7f16c40b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f16c40b29f0 0x7f16c40b4eb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f16cc003760 tx=0x7f16cc005fb0 comp rx=0 tx=0).stop 2024-05-08T09:50:58.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 msgr2=0x7f16e01a0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:50:58.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 0x7f16e01a0100 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f16d000d950 tx=0x7f16d000dd10 comp rx=0 tx=0).stop 2024-05-08T09:50:58.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 shutdown_connections 2024-05-08T09:50:58.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f16c40b29f0 0x7f16c40b4eb0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:58.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f16e010fb60 0x7f16e01a49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:58.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f16e0109ad0 0x7f16e01a0100 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:58.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 --2- 172.21.15.70:0/2733067831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16e010a490 0x7f16e01a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:50:58.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 >> 172.21.15.70:0/2733067831 conn(0x7f16e0076c70 msgr2=0x7f16e0077390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:50:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 shutdown_connections 2024-05-08T09:50:58.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:50:58.014+0000 7f16e6000700 1 -- 172.21.15.70:0/2733067831 wait complete. 2024-05-08T09:50:58.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:57 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2733067831' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T09:50:58.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:57 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2733067831' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T09:50:58.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:58 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2733067831' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T09:50:58.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T09:50:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:59 smithi070 ceph-mon[29591]: pgmap v5888: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T09:50:59.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:59 smithi070 ceph-mon[29591]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T09:50:59.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:59 smithi070 ceph-mon[29591]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T09:50:59.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:59 smithi070 ceph-mon[29591]: Cluster is now healthy 2024-05-08T09:50:59.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:59 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2733067831' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T09:50:59.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:50:59 smithi070 ceph-mon[29591]: fsmap 12 up:standby 2024-05-08T09:50:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:59 smithi194 ceph-mon[33679]: pgmap v5888: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T09:50:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:59 smithi194 ceph-mon[33679]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T09:50:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:59 smithi194 ceph-mon[33679]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T09:50:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:59 smithi194 ceph-mon[33679]: Cluster is now healthy 2024-05-08T09:50:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:59 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2733067831' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T09:50:59.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:50:59 smithi194 ceph-mon[33679]: fsmap 12 up:standby 2024-05-08T09:50:59.311 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:50:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:59 smithi172 ceph-mon[33377]: pgmap v5888: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-05-08T09:50:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:59 smithi172 ceph-mon[33377]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T09:50:59.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:59 smithi172 ceph-mon[33377]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T09:50:59.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:59 smithi172 ceph-mon[33377]: Cluster is now healthy 2024-05-08T09:50:59.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:59 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2733067831' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T09:50:59.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:50:59 smithi172 ceph-mon[33377]: fsmap 12 up:standby 2024-05-08T09:51:01.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:01 smithi194 ceph-mon[33679]: pgmap v5889: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-05-08T09:51:01.272 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:01 smithi070 ceph-mon[29591]: pgmap v5889: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-05-08T09:51:01.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:01 smithi172 ceph-mon[33377]: pgmap v5889: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-05-08T09:51:01.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.619+0000 7f9769c00700 1 -- 172.21.15.70:0/1877632996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764108460 msgr2=0x7f9764108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:01.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.619+0000 7f9769c00700 1 --2- 172.21.15.70:0/1877632996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764108460 0x7f9764108840 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f975400b0a0 tx=0x7f975400b3b0 comp rx=0 tx=0).stop 2024-05-08T09:51:01.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.619+0000 7f9769c00700 1 -- 172.21.15.70:0/1877632996 shutdown_connections 2024-05-08T09:51:01.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.619+0000 7f9769c00700 1 --2- 172.21.15.70:0/1877632996 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9764103ef0 0x7f97641103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:01.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.619+0000 7f9769c00700 1 --2- 172.21.15.70:0/1877632996 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764108460 0x7f9764108840 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:01.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.619+0000 7f9769c00700 1 --2- 172.21.15.70:0/1877632996 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9764103550 0x7f97641039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:01.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.619+0000 7f9769c00700 1 -- 172.21.15.70:0/1877632996 >> 172.21.15.70:0/1877632996 conn(0x7f976407a600 msgr2=0x7f976407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:51:01.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.620+0000 7f9769c00700 1 -- 172.21.15.70:0/1877632996 shutdown_connections 2024-05-08T09:51:01.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.620+0000 7f9769c00700 1 -- 172.21.15.70:0/1877632996 wait complete. 2024-05-08T09:51:01.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.621+0000 7f9769c00700 1 Processor -- start 2024-05-08T09:51:01.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.621+0000 7f9769c00700 1 -- start start 2024-05-08T09:51:01.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.622+0000 7f9769c00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764103550 0x7f97641a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:01.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.622+0000 7f9769c00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9764103ef0 0x7f97641a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:01.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.622+0000 7f9769c00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9764108460 0x7f976419bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:01.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.622+0000 7f9769c00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f97641135b0 con 0x7f9764103550 2024-05-08T09:51:01.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.622+0000 7f9769c00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f9764113430 con 0x7f9764108460 2024-05-08T09:51:01.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.622+0000 7f9769c00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f9764113730 con 0x7f9764103ef0 2024-05-08T09:51:01.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.622+0000 7f9762a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764103550 0x7f97641a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:01.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.622+0000 7f9762a00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764103550 0x7f97641a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40100/0 (socket says 172.21.15.70:40100) 2024-05-08T09:51:01.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.622+0000 7f9762a00700 1 -- 172.21.15.70:0/2948438365 learned_addr learned my addr 172.21.15.70:0/2948438365 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:51:01.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f975a000700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9764103ef0 0x7f97641a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:01.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f9763400700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9764108460 0x7f976419bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:01.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f9762a00700 1 -- 172.21.15.70:0/2948438365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9764103ef0 msgr2=0x7f97641a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:01.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f9762a00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9764103ef0 0x7f97641a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:01.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f9762a00700 1 -- 172.21.15.70:0/2948438365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9764108460 msgr2=0x7f976419bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:01.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f9762a00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9764108460 0x7f976419bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:01.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f9762a00700 1 -- 172.21.15.70:0/2948438365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976419c410 con 0x7f9764103550 2024-05-08T09:51:01.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f9763400700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9764108460 0x7f976419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T09:51:01.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f9762a00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764103550 0x7f97641a1a60 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f975400b830 tx=0x7f9754004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:51:01.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f975be00700 1 -- 172.21.15.70:0/2948438365 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754021070 con 0x7f9764103550 2024-05-08T09:51:01.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f975be00700 1 -- 172.21.15.70:0/2948438365 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9754007c80 con 0x7f9764103550 2024-05-08T09:51:01.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976419c6a0 con 0x7f9764103550 2024-05-08T09:51:01.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.623+0000 7f975be00700 1 -- 172.21.15.70:0/2948438365 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754005260 con 0x7f9764103550 2024-05-08T09:51:01.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.624+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97641a89e0 con 0x7f9764103550 2024-05-08T09:51:01.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.625+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9764104c10 con 0x7f9764103550 2024-05-08T09:51:01.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.627+0000 7f975be00700 1 -- 172.21.15.70:0/2948438365 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9754024070 con 0x7f9764103550 2024-05-08T09:51:01.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.629+0000 7f975be00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f97480b2a70 0x7f97480b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:01.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.629+0000 7f975be00700 1 -- 172.21.15.70:0/2948438365 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(448..448 src has 1..448) ==== 9753+0+0 (secure 0 0 0) 0x7f975400f020 con 0x7f9764103550 2024-05-08T09:51:01.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.629+0000 7f975a000700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f97480b2a70 0x7f97480b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:01.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.630+0000 7f975a000700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f97480b2a70 0x7f97480b4f30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f974c005950 tx=0x7f974c0058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:51:01.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.631+0000 7f975be00700 1 -- 172.21.15.70:0/2948438365 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f975402b020 con 0x7f9764103550 2024-05-08T09:51:01.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:01.861+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f976419cff0 con 0x7f9764103550 2024-05-08T09:51:02.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.022+0000 7f975be00700 1 -- 172.21.15.70:0/2948438365 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v449) ==== 181+0+0 (secure 0 0 0) 0x7f97540abb00 con 0x7f9764103550 2024-05-08T09:51:02.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.026+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f97480b2a70 msgr2=0x7f97480b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:02.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f97480b2a70 0x7f97480b4f30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f974c005950 tx=0x7f974c0058e0 comp rx=0 tx=0).stop 2024-05-08T09:51:02.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764103550 msgr2=0x7f97641a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:02.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764103550 0x7f97641a1a60 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f975400b830 tx=0x7f9754004db0 comp rx=0 tx=0).stop 2024-05-08T09:51:02.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 shutdown_connections 2024-05-08T09:51:02.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f97480b2a70 0x7f97480b4f30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:02.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f9764108460 0x7f976419bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:02.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9764103550 0x7f97641a1a60 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:02.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 --2- 172.21.15.70:0/2948438365 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9764103ef0 0x7f97641a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:02.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 >> 172.21.15.70:0/2948438365 conn(0x7f976407a600 msgr2=0x7f97641013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:51:02.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 shutdown_connections 2024-05-08T09:51:02.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:02.027+0000 7f9769c00700 1 -- 172.21.15.70:0/2948438365 wait complete. 2024-05-08T09:51:02.028 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2024-05-08T09:51:02.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:02 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2948438365' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T09:51:02.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:02 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2948438365' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T09:51:02.457 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:02 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2948438365' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T09:51:02.923 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T09:51:03.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:03 smithi070 ceph-mon[29591]: pgmap v5890: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-05-08T09:51:03.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:03 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/2948438365' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T09:51:03.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:03 smithi070 ceph-mon[29591]: osdmap e449: 12 total, 12 up, 12 in 2024-05-08T09:51:03.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:03 smithi194 ceph-mon[33679]: pgmap v5890: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-05-08T09:51:03.261 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:03 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/2948438365' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T09:51:03.262 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:03 smithi194 ceph-mon[33679]: osdmap e449: 12 total, 12 up, 12 in 2024-05-08T09:51:03.365 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:51:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:03 smithi172 ceph-mon[33377]: pgmap v5890: 129 pgs: 129 active+clean; 2.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-05-08T09:51:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:03 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/2948438365' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T09:51:03.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:03 smithi172 ceph-mon[33377]: osdmap e449: 12 total, 12 up, 12 in 2024-05-08T09:51:05.307 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:05 smithi070 ceph-mon[29591]: pgmap v5892: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:05.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:05 smithi172 ceph-mon[33377]: pgmap v5892: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:05.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:05 smithi194 ceph-mon[33679]: pgmap v5892: 97 pgs: 97 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:05.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.602+0000 7f5f66600700 1 -- 172.21.15.70:0/3729377422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 msgr2=0x7f5f601103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:05.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.602+0000 7f5f66600700 1 --2- 172.21.15.70:0/3729377422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 0x7f5f601103d0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f5f580099c0 tx=0x7f5f58009cd0 comp rx=0 tx=0).stop 2024-05-08T09:51:05.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.602+0000 7f5f66600700 1 -- 172.21.15.70:0/3729377422 shutdown_connections 2024-05-08T09:51:05.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.602+0000 7f5f66600700 1 --2- 172.21.15.70:0/3729377422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 0x7f5f601103d0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.602+0000 7f5f66600700 1 --2- 172.21.15.70:0/3729377422 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60103750 0x7f5f60103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.602+0000 7f5f66600700 1 --2- 172.21.15.70:0/3729377422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f60104100 0x7f5f60108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.602+0000 7f5f66600700 1 -- 172.21.15.70:0/3729377422 >> 172.21.15.70:0/3729377422 conn(0x7f5f6007a600 msgr2=0x7f5f6007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:51:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.602+0000 7f5f66600700 1 -- 172.21.15.70:0/3729377422 shutdown_connections 2024-05-08T09:51:05.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.602+0000 7f5f66600700 1 -- 172.21.15.70:0/3729377422 wait complete. 2024-05-08T09:51:05.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.603+0000 7f5f66600700 1 Processor -- start 2024-05-08T09:51:05.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.604+0000 7f5f66600700 1 -- start start 2024-05-08T09:51:05.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.604+0000 7f5f66600700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60103750 0x7f5f601a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:05.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.604+0000 7f5f66600700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f60104100 0x7f5f601a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:05.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.604+0000 7f5f66600700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 0x7f5f6019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:05.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.604+0000 7f5f66600700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60113540 con 0x7f5f60108850 2024-05-08T09:51:05.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.604+0000 7f5f66600700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601133c0 con 0x7f5f60103750 2024-05-08T09:51:05.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.604+0000 7f5f66600700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601136c0 con 0x7f5f60104100 2024-05-08T09:51:05.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.604+0000 7f5f5fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 0x7f5f6019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:05.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5fe00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 0x7f5f6019b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40114/0 (socket says 172.21.15.70:40114) 2024-05-08T09:51:05.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5fe00700 1 -- 172.21.15.70:0/1851091831 learned_addr learned my addr 172.21.15.70:0/1851091831 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:51:05.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5f400700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60103750 0x7f5f601a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:05.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5ea00700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f60104100 0x7f5f601a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:05.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5fe00700 1 -- 172.21.15.70:0/1851091831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f60104100 msgr2=0x7f5f601a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:05.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5fe00700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f60104100 0x7f5f601a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:05.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5fe00700 1 -- 172.21.15.70:0/1851091831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60103750 msgr2=0x7f5f601a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:05.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5fe00700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60103750 0x7f5f601a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:05.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5fe00700 1 -- 172.21.15.70:0/1851091831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6019c130 con 0x7f5f60108850 2024-05-08T09:51:05.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5ea00700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f60104100 0x7f5f601a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:51:05.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5f400700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60103750 0x7f5f601a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T09:51:05.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.605+0000 7f5f5fe00700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 0x7f5f6019b9d0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800b580 tx=0x7f5f5800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:51:05.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.606+0000 7f5f57e00700 1 -- 172.21.15.70:0/1851091831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58026070 con 0x7f5f60108850 2024-05-08T09:51:05.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.606+0000 7f5f57e00700 1 -- 172.21.15.70:0/1851091831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f580054c0 con 0x7f5f60108850 2024-05-08T09:51:05.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.606+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6019c3c0 con 0x7f5f60108850 2024-05-08T09:51:05.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.606+0000 7f5f57e00700 1 -- 172.21.15.70:0/1851091831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58004be0 con 0x7f5f60108850 2024-05-08T09:51:05.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.606+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f601a86e0 con 0x7f5f60108850 2024-05-08T09:51:05.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.607+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6006a190 con 0x7f5f60108850 2024-05-08T09:51:05.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.611+0000 7f5f57e00700 1 -- 172.21.15.70:0/1851091831 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5f58029070 con 0x7f5f60108850 2024-05-08T09:51:05.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.612+0000 7f5f57e00700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5f440b29f0 0x7f5f440b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:05.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.612+0000 7f5f57e00700 1 -- 172.21.15.70:0/1851091831 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(449..449 src has 1..449) ==== 9228+0+0 (secure 0 0 0) 0x7f5f580e39e0 con 0x7f5f60108850 2024-05-08T09:51:05.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.613+0000 7f5f5f400700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5f440b29f0 0x7f5f440b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:05.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.613+0000 7f5f5f400700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5f440b29f0 0x7f5f440b4eb0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5f6019cb10 tx=0x7f5f50009040 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:51:05.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.615+0000 7f5f57e00700 1 -- 172.21.15.70:0/1851091831 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5f58030020 con 0x7f5f60108850 2024-05-08T09:51:05.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:05.845+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5f601a88b0 con 0x7f5f60108850 2024-05-08T09:51:06.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.049+0000 7f5f57e00700 1 -- 172.21.15.70:0/1851091831 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v450) ==== 169+0+0 (secure 0 0 0) 0x7f5f58013070 con 0x7f5f60108850 2024-05-08T09:51:06.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.055+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5f440b29f0 msgr2=0x7f5f440b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.055+0000 7f5f66600700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5f440b29f0 0x7f5f440b4eb0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5f6019cb10 tx=0x7f5f50009040 comp rx=0 tx=0).stop 2024-05-08T09:51:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.055+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 msgr2=0x7f5f6019b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:06.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.055+0000 7f5f66600700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 0x7f5f6019b9d0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800b580 tx=0x7f5f5800f740 comp rx=0 tx=0).stop 2024-05-08T09:51:06.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.057+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 shutdown_connections 2024-05-08T09:51:06.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.057+0000 7f5f66600700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f5f440b29f0 0x7f5f440b4eb0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:06.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.057+0000 7f5f66600700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f60108850 0x7f5f6019b9d0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:06.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.057+0000 7f5f66600700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f5f60103750 0x7f5f601a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:06.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.057+0000 7f5f66600700 1 --2- 172.21.15.70:0/1851091831 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f60104100 0x7f5f601a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:06.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.057+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 >> 172.21.15.70:0/1851091831 conn(0x7f5f6007a600 msgr2=0x7f5f601014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:51:06.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.058+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 shutdown_connections 2024-05-08T09:51:06.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:06.059+0000 7f5f66600700 1 -- 172.21.15.70:0/1851091831 wait complete. 2024-05-08T09:51:06.062 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2024-05-08T09:51:06.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:06 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1851091831' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T09:51:06.428 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:06 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1851091831' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T09:51:06.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:06 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1851091831' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T09:51:07.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-08T09:51:07.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:07 smithi070 ceph-mon[29591]: pgmap v5893: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:07.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:07 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/1851091831' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T09:51:07.379 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:07 smithi070 ceph-mon[29591]: osdmap e450: 12 total, 12 up, 12 in 2024-05-08T09:51:07.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:07 smithi172 ceph-mon[33377]: pgmap v5893: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:07.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:07 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/1851091831' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T09:51:07.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:07 smithi172 ceph-mon[33377]: osdmap e450: 12 total, 12 up, 12 in 2024-05-08T09:51:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:07 smithi194 ceph-mon[33679]: pgmap v5893: 97 pgs: 97 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:07.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:07 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/1851091831' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T09:51:07.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:07 smithi194 ceph-mon[33679]: osdmap e450: 12 total, 12 up, 12 in 2024-05-08T09:51:07.533 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T09:51:09.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:09 smithi070 ceph-mon[29591]: pgmap v5895: 33 pgs: 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:09.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:09 smithi172 ceph-mon[33377]: pgmap v5895: 33 pgs: 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:09.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:09 smithi194 ceph-mon[33679]: pgmap v5895: 33 pgs: 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.477+0000 7f0853e00700 1 -- 172.21.15.70:0/524471276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c108410 msgr2=0x7f084c1087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.477+0000 7f0853e00700 1 --2- 172.21.15.70:0/524471276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c108410 0x7f084c1087f0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f0840009990 tx=0x7f0840009ca0 comp rx=0 tx=0).stop 2024-05-08T09:51:10.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.477+0000 7f0853e00700 1 -- 172.21.15.70:0/524471276 shutdown_connections 2024-05-08T09:51:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.477+0000 7f0853e00700 1 --2- 172.21.15.70:0/524471276 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f084c102d60 0x7f084c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.477+0000 7f0853e00700 1 --2- 172.21.15.70:0/524471276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c108410 0x7f084c1087f0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.477+0000 7f0853e00700 1 --2- 172.21.15.70:0/524471276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f084c1023a0 0x7f084c102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.477+0000 7f0853e00700 1 -- 172.21.15.70:0/524471276 >> 172.21.15.70:0/524471276 conn(0x7f084c079350 msgr2=0x7f084c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:51:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.478+0000 7f0853e00700 1 -- 172.21.15.70:0/524471276 shutdown_connections 2024-05-08T09:51:10.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.478+0000 7f0853e00700 1 -- 172.21.15.70:0/524471276 wait complete. 2024-05-08T09:51:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.479+0000 7f0853e00700 1 Processor -- start 2024-05-08T09:51:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.479+0000 7f0853e00700 1 -- start start 2024-05-08T09:51:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.479+0000 7f0853e00700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c1023a0 0x7f084c1a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.479+0000 7f0853e00700 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f084c102d60 0x7f084c1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.479+0000 7f0853e00700 1 --2- >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f084c108410 0x7f084c19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.479+0000 7f0853e00700 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f084c112410 con 0x7f084c1023a0 2024-05-08T09:51:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.479+0000 7f0853e00700 1 -- --> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] -- mon_getmap magic: 0 -- 0x7f084c112290 con 0x7f084c108410 2024-05-08T09:51:10.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.479+0000 7f0853e00700 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 -- 0x7f084c112590 con 0x7f084c102d60 2024-05-08T09:51:10.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0851400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c1023a0 0x7f084c1a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:10.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0851400700 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c1023a0 0x7f084c1a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57418/0 (socket says 172.21.15.70:57418) 2024-05-08T09:51:10.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0851400700 1 -- 172.21.15.70:0/4092128216 learned_addr learned my addr 172.21.15.70:0/4092128216 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-05-08T09:51:10.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0850a00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f084c102d60 0x7f084c1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:10.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0851e00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f084c108410 0x7f084c19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:10.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0851400700 1 -- 172.21.15.70:0/4092128216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f084c102d60 msgr2=0x7f084c1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:10.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0851400700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f084c102d60 0x7f084c1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:10.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0851400700 1 -- 172.21.15.70:0/4092128216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f084c108410 msgr2=0x7f084c19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:10.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0851400700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f084c108410 0x7f084c19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:10.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.480+0000 7f0851400700 1 -- 172.21.15.70:0/4092128216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084c19c2f0 con 0x7f084c1023a0 2024-05-08T09:51:10.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.481+0000 7f0851400700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c1023a0 0x7f084c1a19f0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f0840000c00 tx=0x7f0840009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:51:10.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.481+0000 7f084a000700 1 -- 172.21.15.70:0/4092128216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0840027070 con 0x7f084c1023a0 2024-05-08T09:51:10.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.481+0000 7f084a000700 1 -- 172.21.15.70:0/4092128216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f084000fc70 con 0x7f084c1023a0 2024-05-08T09:51:10.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.481+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084c19c580 con 0x7f084c1023a0 2024-05-08T09:51:10.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.481+0000 7f084a000700 1 -- 172.21.15.70:0/4092128216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0840022d40 con 0x7f084c1023a0 2024-05-08T09:51:10.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.481+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084c1a8810 con 0x7f084c1023a0 2024-05-08T09:51:10.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.483+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f084c06a190 con 0x7f084c1023a0 2024-05-08T09:51:10.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.485+0000 7f084a000700 1 -- 172.21.15.70:0/4092128216 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f084002a070 con 0x7f084c1023a0 2024-05-08T09:51:10.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.486+0000 7f084a000700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08340b2a70 0x7f08340b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:51:10.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.487+0000 7f084a000700 1 -- 172.21.15.70:0/4092128216 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(450..450 src has 1..450) ==== 8582+0+0 (secure 0 0 0) 0x7f08400e3b30 con 0x7f084c1023a0 2024-05-08T09:51:10.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.487+0000 7f0850a00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08340b2a70 0x7f08340b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:51:10.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.488+0000 7f0850a00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08340b2a70 0x7f08340b4f30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0838005950 tx=0x7f08380058e0 comp rx=0 tx=0).ready entity=mgr.15198 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:51:10.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.489+0000 7f084a000700 1 -- 172.21.15.70:0/4092128216 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0840031070 con 0x7f084c1023a0 2024-05-08T09:51:10.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:10.720+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f084c1a8a40 con 0x7f084c1023a0 2024-05-08T09:51:11.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.065+0000 7f084a000700 1 -- 172.21.15.70:0/4092128216 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v451) ==== 178+0+0 (secure 0 0 0) 0x7f0840013070 con 0x7f084c1023a0 2024-05-08T09:51:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.070+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08340b2a70 msgr2=0x7f08340b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.070+0000 7f0853e00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08340b2a70 0x7f08340b4f30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f0838005950 tx=0x7f08380058e0 comp rx=0 tx=0).stop 2024-05-08T09:51:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.070+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c1023a0 msgr2=0x7f084c1a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:51:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.070+0000 7f0853e00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c1023a0 0x7f084c1a19f0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f0840000c00 tx=0x7f0840009f90 comp rx=0 tx=0).stop 2024-05-08T09:51:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.071+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 shutdown_connections 2024-05-08T09:51:11.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.071+0000 7f0853e00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:6800/3968184776,v1:172.21.15.70:6801/3968184776] conn(0x7f08340b2a70 0x7f08340b4f30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.071+0000 7f0853e00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] conn(0x7f084c108410 0x7f084c19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.071+0000 7f0853e00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f084c1023a0 0x7f084c1a19f0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.071+0000 7f0853e00700 1 --2- 172.21.15.70:0/4092128216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f084c102d60 0x7f084c1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:51:11.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.071+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 >> 172.21.15.70:0/4092128216 conn(0x7f084c079350 msgr2=0x7f084c06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:51:11.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.071+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 shutdown_connections 2024-05-08T09:51:11.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-05-08T09:51:11.071+0000 7f0853e00700 1 -- 172.21.15.70:0/4092128216 wait complete. 2024-05-08T09:51:11.071 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data_ec' removed 2024-05-08T09:51:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:11 smithi070 ceph-mon[29591]: pgmap v5896: 33 pgs: 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:11.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:11 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4092128216' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T09:51:11.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:11 smithi172 ceph-mon[33377]: pgmap v5896: 33 pgs: 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:11.430 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:11 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4092128216' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T09:51:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:11 smithi194 ceph-mon[33679]: pgmap v5896: 33 pgs: 33 active+clean; 1.9 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:11.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:11 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4092128216' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T09:51:12.044 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T09:51:12.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T09:51:12.356 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:12 smithi172 ceph-mon[33377]: from='client.? 172.21.15.70:0/4092128216' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T09:51:12.356 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:12 smithi172 ceph-mon[33377]: osdmap e451: 12 total, 12 up, 12 in 2024-05-08T09:51:12.359 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T09:51:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:12 smithi070 ceph-mon[29591]: from='client.? 172.21.15.70:0/4092128216' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T09:51:12.378 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:12 smithi070 ceph-mon[29591]: osdmap e451: 12 total, 12 up, 12 in 2024-05-08T09:51:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:12 smithi194 ceph-mon[33679]: from='client.? 172.21.15.70:0/4092128216' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T09:51:12.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:12 smithi194 ceph-mon[33679]: osdmap e451: 12 total, 12 up, 12 in 2024-05-08T09:51:12.568 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-08T09:51:12.569 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T09:51:12.647 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T09:51:12.712 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T09:51:12.763 INFO:tasks.cephadm:Stopping all daemons... 2024-05-08T09:51:12.764 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-08T09:51:12.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.a 2024-05-08T09:51:13.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:12 smithi070 systemd[1]: Stopping Ceph mon.a for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:51:13.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:13 smithi070 ceph-mon[29591]: pgmap v5898: 1 pgs: 1 active+clean; 577 KiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:13.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:13 smithi172 ceph-mon[33377]: pgmap v5898: 1 pgs: 1 active+clean; 577 KiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:13.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:13 smithi194 ceph-mon[33679]: pgmap v5898: 1 pgs: 1 active+clean; 577 KiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T09:51:13.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:13 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a[29587]: 2024-05-08T09:51:13.485+0000 7f4f2d400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:51:13.862 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:13 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a[29587]: 2024-05-08T09:51:13.495+0000 7f4f2d400700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-08T09:51:14.128 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:13 smithi070 podman[368606]: 2024-05-08 09:51:13.864235726 +0000 UTC m=+0.556134817 container stop 65b3c1175be85fae198ea76d8bbc1d523b5d14dedf20f3de17fa1bf887936b67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:51:14.129 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:13 smithi070 podman[368606]: 2024-05-08 09:51:13.890499948 +0000 UTC m=+0.582399052 container died 65b3c1175be85fae198ea76d8bbc1d523b5d14dedf20f3de17fa1bf887936b67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507) 2024-05-08T09:51:18.628 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:18 smithi070 podman[368606]: 2024-05-08 09:51:18.310325703 +0000 UTC m=+5.002224832 container cleanup 65b3c1175be85fae198ea76d8bbc1d523b5d14dedf20f3de17fa1bf887936b67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-08T09:51:18.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:18 smithi070 bash[368606]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a 2024-05-08T09:51:18.901 INFO:journalctl@ceph.mon.a.smithi070.stdout:May 08 09:51:18 smithi070 podman[368617]: 2024-05-08 09:51:18.636922434 +0000 UTC m=+4.756766511 container remove 65b3c1175be85fae198ea76d8bbc1d523b5d14dedf20f3de17fa1bf887936b67 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:51:18.941 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.a.service' 2024-05-08T09:51:19.091 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:51:19.091 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-08T09:51:19.092 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-08T09:51:19.092 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.b 2024-05-08T09:51:19.429 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:19 smithi172 systemd[1]: Stopping Ceph mon.b for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:51:20.157 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:19 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-b[33373]: 2024-05-08T09:51:19.781+0000 7f37f6600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:51:20.157 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:19 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-b[33373]: 2024-05-08T09:51:19.781+0000 7f37f6600700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-08T09:51:20.157 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:19 smithi172 podman[118232]: 2024-05-08 09:51:19.939383883 +0000 UTC m=+0.316065886 container died 561491463ef692c560f303a9b7fd6571a881aab86f95b554db959f7a36cc6725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-08T09:51:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:20 smithi172 podman[118232]: 2024-05-08 09:51:20.416062416 +0000 UTC m=+0.792744444 container cleanup 561491463ef692c560f303a9b7fd6571a881aab86f95b554db959f7a36cc6725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-08T09:51:20.679 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:20 smithi172 bash[118232]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-b 2024-05-08T09:51:21.006 INFO:journalctl@ceph.mon.b.smithi172.stdout:May 08 09:51:20 smithi172 podman[118246]: 2024-05-08 09:51:20.697521884 +0000 UTC m=+0.741560952 container remove 561491463ef692c560f303a9b7fd6571a881aab86f95b554db959f7a36cc6725 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-08T09:51:21.109 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.b.service' 2024-05-08T09:51:21.226 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:51:21.227 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-08T09:51:21.227 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-08T09:51:21.227 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.c 2024-05-08T09:51:21.760 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:21 smithi194 systemd[1]: Stopping Ceph mon.c for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:51:22.510 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-c[33673]: 2024-05-08T09:51:22.018+0000 7f2086600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:51:22.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-c[33673]: 2024-05-08T09:51:22.018+0000 7f2086600700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-08T09:51:22.511 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:22 smithi194 podman[118058]: 2024-05-08 09:51:22.239157178 +0000 UTC m=+0.428287539 container died b7a8571bfaf570d943aa8d595eefa8ab9601c4ad9adff8d77b709fbba8688ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-c, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T09:51:22.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:22 smithi194 podman[118058]: 2024-05-08 09:51:22.802940244 +0000 UTC m=+0.992070666 container cleanup b7a8571bfaf570d943aa8d595eefa8ab9601c4ad9adff8d77b709fbba8688ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:51:22.833 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:22 smithi194 bash[118058]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-c 2024-05-08T09:51:23.260 INFO:journalctl@ceph.mon.c.smithi194.stdout:May 08 09:51:23 smithi194 podman[118072]: 2024-05-08 09:51:23.03819457 +0000 UTC m=+0.788272576 container remove b7a8571bfaf570d943aa8d595eefa8ab9601c4ad9adff8d77b709fbba8688ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mon-c, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-08T09:51:23.541 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mon.c.service' 2024-05-08T09:51:23.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:51:23.661 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-08T09:51:23.661 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-08T09:51:23.661 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.x 2024-05-08T09:51:24.128 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 09:51:23 smithi070 systemd[1]: Stopping Ceph mgr.x for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:51:24.628 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 09:51:24 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T09:51:24.246+0000 7fc13dc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:51:24.628 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 09:51:24 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x[29820]: 2024-05-08T09:51:24.246+0000 7fc13dc00700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-08T09:51:24.629 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 09:51:24 smithi070 podman[368734]: 2024-05-08 09:51:24.35020139 +0000 UTC m=+0.244934324 container died b3eb8e91a91d103ed9297a2b296b7ac80fc951f8826a25cf1cc303ee5254fffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2) 2024-05-08T09:51:25.378 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 09:51:24 smithi070 podman[368734]: 2024-05-08 09:51:24.983392877 +0000 UTC m=+0.878125848 container cleanup b3eb8e91a91d103ed9297a2b296b7ac80fc951f8826a25cf1cc303ee5254fffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-08T09:51:25.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 09:51:24 smithi070 bash[368734]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x 2024-05-08T09:51:25.379 INFO:journalctl@ceph.mgr.x.smithi070.stdout:May 08 09:51:25 smithi070 podman[368748]: 2024-05-08 09:51:25.218711147 +0000 UTC m=+0.852369875 container remove b3eb8e91a91d103ed9297a2b296b7ac80fc951f8826a25cf1cc303ee5254fffd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-08T09:51:25.701 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-08T09:51:25.808 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:51:25.809 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-08T09:51:25.809 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-08T09:51:25.809 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.y 2024-05-08T09:51:26.179 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 09:51:25 smithi172 systemd[1]: Stopping Ceph mgr.y for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:51:26.768 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 09:51:26 smithi172 podman[118366]: 2024-05-08 09:51:26.463719419 +0000 UTC m=+0.241016670 container died 1705bf982e23683c78f41ab1c01f6f728e8a6745c6d42bbc38ab4167630f3568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-08T09:51:27.179 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 09:51:26 smithi172 podman[118366]: 2024-05-08 09:51:26.929419259 +0000 UTC m=+0.706716488 container cleanup 1705bf982e23683c78f41ab1c01f6f728e8a6745c6d42bbc38ab4167630f3568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-08T09:51:27.179 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 09:51:26 smithi172 bash[118366]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y 2024-05-08T09:51:27.679 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 09:51:27 smithi172 podman[118380]: 2024-05-08 09:51:27.197659712 +0000 UTC m=+0.705145548 container remove 1705bf982e23683c78f41ab1c01f6f728e8a6745c6d42bbc38ab4167630f3568 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-y, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:51:27.679 INFO:journalctl@ceph.mgr.y.smithi172.stdout:May 08 09:51:27 smithi172 systemd[1]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-08T09:51:27.715 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-08T09:51:27.822 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:51:27.823 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-08T09:51:27.823 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-08T09:51:27.823 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.z 2024-05-08T09:51:28.261 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 09:51:27 smithi194 systemd[1]: Stopping Ceph mgr.z for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:51:28.760 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 09:51:28 smithi194 podman[118178]: 2024-05-08 09:51:28.503201791 +0000 UTC m=+0.240442445 container died 16d92c7bdac7463f25c4f5beff194c4dd20316efd18fab5b1db96893ef096a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T09:51:29.259 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 09:51:29 smithi194 podman[118178]: 2024-05-08 09:51:29.008383793 +0000 UTC m=+0.745624457 container cleanup 16d92c7bdac7463f25c4f5beff194c4dd20316efd18fab5b1db96893ef096a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-05-08T09:51:29.259 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 09:51:29 smithi194 bash[118178]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z 2024-05-08T09:51:29.510 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 09:51:29 smithi194 podman[118192]: 2024-05-08 09:51:29.260305898 +0000 UTC m=+0.742969550 container remove 16d92c7bdac7463f25c4f5beff194c4dd20316efd18fab5b1db96893ef096a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mgr-z, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-08T09:51:29.510 INFO:journalctl@ceph.mgr.z.smithi194.stdout:May 08 09:51:29 smithi194 systemd[1]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-08T09:51:29.756 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-08T09:51:29.851 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:51:29.851 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-08T09:51:29.851 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-08T09:51:29.851 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.0 2024-05-08T09:51:30.378 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:29 smithi070 systemd[1]: Stopping Ceph osd.0 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:51:30.878 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0[43849]: 2024-05-08T09:51:30.378+0000 7fc909800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:51:30.878 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0[43849]: 2024-05-08T09:51:30.389+0000 7fc909800700 -1 osd.0 451 *** Got signal Terminated *** 2024-05-08T09:51:30.879 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0[43849]: 2024-05-08T09:51:30.389+0000 7fc909800700 -1 osd.0 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:51:36.378 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:36 smithi070 podman[368853]: 2024-05-08 09:51:36.12463313 +0000 UTC m=+5.891922939 container died 65937b9a2c534eeec968fab2a2d03a48f5ea50fe6aa8617b1c354fd227cab5fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:51:36.813 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:36 smithi070 podman[368853]: 2024-05-08 09:51:36.571133652 +0000 UTC m=+6.338423438 container cleanup 65937b9a2c534eeec968fab2a2d03a48f5ea50fe6aa8617b1c354fd227cab5fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2) 2024-05-08T09:51:36.813 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:36 smithi070 bash[368853]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0 2024-05-08T09:51:37.127 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:36 smithi070 podman[368873]: 2024-05-08 09:51:36.814581031 +0000 UTC m=+0.673759278 container remove 65937b9a2c534eeec968fab2a2d03a48f5ea50fe6aa8617b1c354fd227cab5fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-08T09:51:37.993 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:37 smithi070 podman[368961]: 2024-05-08 09:51:37.566947886 +0000 UTC m=+0.033598330 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:51:37.993 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:37 smithi070 podman[368961]: 2024-05-08 09:51:37.690624081 +0000 UTC m=+0.157274553 container create a88351fb61c7e61fe75b9e1047ca53743d942636eff4a4936b511ac1e5e54325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5) 2024-05-08T09:51:37.993 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:37 smithi070 podman[368961]: 2024-05-08 09:51:37.994492052 +0000 UTC m=+0.461142527 container init a88351fb61c7e61fe75b9e1047ca53743d942636eff4a4936b511ac1e5e54325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-08T09:51:38.378 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:38 smithi070 podman[368961]: 2024-05-08 09:51:38.006043086 +0000 UTC m=+0.472693585 container start a88351fb61c7e61fe75b9e1047ca53743d942636eff4a4936b511ac1e5e54325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:51:38.378 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:38 smithi070 podman[368961]: 2024-05-08 09:51:38.126798973 +0000 UTC m=+0.593449410 container attach a88351fb61c7e61fe75b9e1047ca53743d942636eff4a4936b511ac1e5e54325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-08T09:51:40.628 INFO:journalctl@ceph.osd.0.smithi070.stdout:May 08 09:51:40 smithi070 podman[368961]: 2024-05-08 09:51:40.154890568 +0000 UTC m=+2.621541029 container died a88351fb61c7e61fe75b9e1047ca53743d942636eff4a4936b511ac1e5e54325 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-0-deactivate, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-08T09:51:41.363 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.0.service' 2024-05-08T09:51:41.475 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:51:41.475 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-08T09:51:41.475 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-08T09:51:41.475 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.1 2024-05-08T09:51:41.928 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:41 smithi172 systemd[1]: Stopping Ceph osd.1 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:51:42.429 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1[37937]: 2024-05-08T09:51:42.023+0000 7febbba00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:51:42.430 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1[37937]: 2024-05-08T09:51:42.023+0000 7febbba00700 -1 osd.1 451 *** Got signal Terminated *** 2024-05-08T09:51:42.430 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1[37937]: 2024-05-08T09:51:42.023+0000 7febbba00700 -1 osd.1 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:51:48.087 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:47 smithi172 podman[118489]: 2024-05-08 09:51:47.753996855 +0000 UTC m=+5.865416636 container stop 322768becd8548160369019a929d28f30577213e6d56cd48b46783fcdadb1a48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-08T09:51:48.087 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:47 smithi172 podman[118489]: 2024-05-08 09:51:47.781730306 +0000 UTC m=+5.893150044 container died 322768becd8548160369019a929d28f30577213e6d56cd48b46783fcdadb1a48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-08T09:51:48.428 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:48 smithi172 podman[118489]: 2024-05-08 09:51:48.216742195 +0000 UTC m=+6.328161970 container cleanup 322768becd8548160369019a929d28f30577213e6d56cd48b46783fcdadb1a48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:51:48.428 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:48 smithi172 bash[118489]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1 2024-05-08T09:51:48.928 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:48 smithi172 podman[118508]: 2024-05-08 09:51:48.459727381 +0000 UTC m=+0.689132877 container remove 322768becd8548160369019a929d28f30577213e6d56cd48b46783fcdadb1a48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:51:49.672 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:49 smithi172 podman[118600]: 2024-05-08 09:51:49.233336411 +0000 UTC m=+0.035441862 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:51:49.672 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:49 smithi172 podman[118600]: 2024-05-08 09:51:49.369092265 +0000 UTC m=+0.171197743 container create 3dab5eb4f1d53f564b7d8ca2f2422cc0f6fc518ba5a977cc5df4f920147f3f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS) 2024-05-08T09:51:49.673 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:49 smithi172 podman[118600]: 2024-05-08 09:51:49.67335048 +0000 UTC m=+0.475455965 container init 3dab5eb4f1d53f564b7d8ca2f2422cc0f6fc518ba5a977cc5df4f920147f3f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True) 2024-05-08T09:51:49.928 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:49 smithi172 podman[118600]: 2024-05-08 09:51:49.685447248 +0000 UTC m=+0.487552736 container start 3dab5eb4f1d53f564b7d8ca2f2422cc0f6fc518ba5a977cc5df4f920147f3f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1-deactivate, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-08T09:51:49.929 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:49 smithi172 podman[118600]: 2024-05-08 09:51:49.789071209 +0000 UTC m=+0.591176707 container attach 3dab5eb4f1d53f564b7d8ca2f2422cc0f6fc518ba5a977cc5df4f920147f3f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux ) 2024-05-08T09:51:50.928 INFO:journalctl@ceph.osd.1.smithi172.stdout:May 08 09:51:50 smithi172 podman[118600]: 2024-05-08 09:51:50.645011491 +0000 UTC m=+1.447116989 container died 3dab5eb4f1d53f564b7d8ca2f2422cc0f6fc518ba5a977cc5df4f920147f3f48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-05-08T09:51:51.426 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.1.service' 2024-05-08T09:51:51.523 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:51:51.523 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-08T09:51:51.523 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-08T09:51:51.523 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.2 2024-05-08T09:51:52.010 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:51 smithi194 systemd[1]: Stopping Ceph osd.2 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:51:52.510 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2[38848]: 2024-05-08T09:51:52.102+0000 7f368be00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:51:52.510 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2[38848]: 2024-05-08T09:51:52.102+0000 7f368be00700 -1 osd.2 451 *** Got signal Terminated *** 2024-05-08T09:51:52.511 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2[38848]: 2024-05-08T09:51:52.102+0000 7f368be00700 -1 osd.2 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:51:57.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:51:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:51:56.835+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:51:58.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:51:57 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:51:57.742+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:51:58.129 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:51:57 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:51:57.875+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:51:58.251 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:51:57 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:51:57.879+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:51:58.252 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:57 smithi194 podman[118313]: 2024-05-08 09:51:57.922535091 +0000 UTC m=+5.972289408 container died 6fd089774f83047b8b3449f9240145f95380cb281d7a006b452b07426dacf607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T09:51:58.910 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:58 smithi194 podman[118313]: 2024-05-08 09:51:58.579351606 +0000 UTC m=+6.629105877 container cleanup 6fd089774f83047b8b3449f9240145f95380cb281d7a006b452b07426dacf607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, ceph=True) 2024-05-08T09:51:58.911 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:58 smithi194 bash[118313]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2 2024-05-08T09:51:58.911 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:51:58 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:51:58.754+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:51:59.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:51:58 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:51:58.758+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:51:59.128 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:51:58 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:51:58.888+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:51:59.259 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:59 smithi194 podman[118331]: 2024-05-08 09:51:59.073116047 +0000 UTC m=+1.102573981 container remove 6fd089774f83047b8b3449f9240145f95380cb281d7a006b452b07426dacf607 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:51:59.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:51:58 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:51:58.911+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:51:59.873 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:51:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:51:59.709+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:00.107 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:59 smithi194 podman[118419]: 2024-05-08 09:51:59.827267512 +0000 UTC m=+0.034491763 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:52:00.107 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:51:59 smithi194 podman[118419]: 2024-05-08 09:51:59.940649217 +0000 UTC m=+0.147873501 container create 78d7498d1fb28367125f120fb63e7f913029d10e2a0bb4115f17b08e11b52767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-08T09:52:00.107 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:51:59 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:51:59.865+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:00.108 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:51:59 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:51:59.762+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:00.127 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:51:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:51:59.874+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:52:00.358 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:52:00 smithi194 podman[118419]: 2024-05-08 09:52:00.2360125 +0000 UTC m=+0.443236805 container init 78d7498d1fb28367125f120fb63e7f913029d10e2a0bb4115f17b08e11b52767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-08T09:52:00.358 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:52:00 smithi194 podman[118419]: 2024-05-08 09:52:00.24673571 +0000 UTC m=+0.453959991 container start 78d7498d1fb28367125f120fb63e7f913029d10e2a0bb4115f17b08e11b52767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T09:52:00.723 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:52:00 smithi194 podman[118419]: 2024-05-08 09:52:00.360101844 +0000 UTC m=+0.567326158 container attach 78d7498d1fb28367125f120fb63e7f913029d10e2a0bb4115f17b08e11b52767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-08T09:52:00.847 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:00.736+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:01.010 INFO:journalctl@ceph.osd.2.smithi194.stdout:May 08 09:52:00 smithi194 podman[118419]: 2024-05-08 09:52:00.913483447 +0000 UTC m=+1.120707699 container died 78d7498d1fb28367125f120fb63e7f913029d10e2a0bb4115f17b08e11b52767 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:52:01.011 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:00 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:00.830+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:01.011 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:00 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:00.723+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:01.127 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:00.848+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:52:01.679 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.2.service' 2024-05-08T09:52:01.762 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:52:01.763 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-08T09:52:01.763 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-08T09:52:01.763 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.3 2024-05-08T09:52:02.010 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:01 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:01.750+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:02.010 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:01 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:01.814+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:02.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:01 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:01.721+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:02.127 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:01 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:01.811+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:52:02.127 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:01 smithi070 systemd[1]: Stopping Ceph osd.3 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:52:02.627 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:02.348+0000 7f664c200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:52:02.628 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:02.348+0000 7f664c200700 -1 osd.3 451 *** Got signal Terminated *** 2024-05-08T09:52:02.628 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:02.348+0000 7f664c200700 -1 osd.3 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:52:02.928 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:02 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:02.493+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:03.127 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:02.764+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:52:03.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:02.713+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:03.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:02 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:02.799+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:03.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:02 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:02.767+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:03.928 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:03.474+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:04.009 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:03 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:03.800+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:04.010 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:03 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:03.740+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:04.127 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:03 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:03.748+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:52:04.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:03 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:03.707+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:04.928 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:04 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:04.515+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:05.010 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:04 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:04.839+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:05.010 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:04 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:04.714+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:05.127 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:04 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:04.750+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:52:05.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:04 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:04.728+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:05.928 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:05 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:05.492+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:06.009 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:05 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:05.880+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:06.010 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:05 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:05.748+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:06.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:05 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:05.778+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:06.127 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:05 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:05.781+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:52:06.928 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:06 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:06.472+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:07.127 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:06 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3[50356]: 2024-05-08T09:52:06.761+0000 7f6647a00700 -1 osd.3 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.198367+0000 front 2024-05-08T09:51:35.198450+0000 (oldest deadline 2024-05-08T09:51:57.498429+0000) 2024-05-08T09:52:07.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:06 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:06.801+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:07.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:06 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:06.909+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:07.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:06 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:06.773+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:07.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:07 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:07.424+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:08.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:07 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:07.770+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:08.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:07 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:07.879+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:08.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:07.862+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:08.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:07.768+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:08.602 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:08 smithi070 podman[369078]: 2024-05-08 09:52:08.275768045 +0000 UTC m=+6.063773754 container died 44356bbb89038974f1cd80f86542314f3023c3baf8ffb428ad20f9c2b8cf13d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:52:08.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:08.396+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:08.877 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:08 smithi070 podman[369078]: 2024-05-08 09:52:08.756848148 +0000 UTC m=+6.544853850 container cleanup 44356bbb89038974f1cd80f86542314f3023c3baf8ffb428ad20f9c2b8cf13d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-08T09:52:08.877 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:08 smithi070 bash[369078]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3 2024-05-08T09:52:08.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:08 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:08.810+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:08.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:08 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:08.810+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:09.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:08.837+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:09.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:08.871+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:09.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:08.871+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:09.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:08.790+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:09.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:08.790+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:09.377 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:09 smithi070 podman[369097]: 2024-05-08 09:52:09.125123355 +0000 UTC m=+0.833214877 container remove 44356bbb89038974f1cd80f86542314f3023c3baf8ffb428ad20f9c2b8cf13d8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-08T09:52:09.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:09.419+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:09.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:09.419+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:10.062 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:09 smithi070 podman[369188]: 2024-05-08 09:52:09.631276603 +0000 UTC m=+0.036401755 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:52:10.062 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:09 smithi070 podman[369188]: 2024-05-08 09:52:09.759407632 +0000 UTC m=+0.164532786 container create 88737a43d636d97b57cf5519dd5e13e1c0c627ee26778005bfd4655a97559900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3-deactivate, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:52:10.062 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:09 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:09.776+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:10.063 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:09 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:09.776+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:10.177 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:09.835+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:10.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:09.912+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:10.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:09.912+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:10.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:09.786+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:10.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:09.786+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:10.377 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:10 smithi070 podman[369188]: 2024-05-08 09:52:10.06347091 +0000 UTC m=+0.468596131 container init 88737a43d636d97b57cf5519dd5e13e1c0c627ee26778005bfd4655a97559900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-05-08T09:52:10.377 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:10 smithi070 podman[369188]: 2024-05-08 09:52:10.074670578 +0000 UTC m=+0.479795725 container start 88737a43d636d97b57cf5519dd5e13e1c0c627ee26778005bfd4655a97559900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-05-08T09:52:10.377 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:10 smithi070 podman[369188]: 2024-05-08 09:52:10.178952663 +0000 UTC m=+0.584077870 container attach 88737a43d636d97b57cf5519dd5e13e1c0c627ee26778005bfd4655a97559900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-05-08T09:52:10.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:10.429+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:10.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:10.429+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:10.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:10.253+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:10.778 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:10 smithi070 podman[369188]: 2024-05-08 09:52:10.530779669 +0000 UTC m=+0.935904883 container died 88737a43d636d97b57cf5519dd5e13e1c0c627ee26778005bfd4655a97559900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:52:10.779 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:10 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:10.466+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:11.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:10 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:10.780+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:11.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:10 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:10.780+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:11.177 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:10.811+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:11.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:10.933+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:11.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:10.933+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:11.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:10.818+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:11.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:10.818+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:11.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:11.232+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:11.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:11.406+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:11.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:11.406+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:11.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.3.service' 2024-05-08T09:52:11.746 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:11 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:11.455+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:11.746 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:11 smithi070 podman[369214]: 2024-05-08 09:52:11.635470408 +0000 UTC m=+1.089441367 container remove 88737a43d636d97b57cf5519dd5e13e1c0c627ee26778005bfd4655a97559900 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-05-08T09:52:11.746 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:11 smithi070 systemd[1]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.3.service: Deactivated successfully. 2024-05-08T09:52:11.747 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:11 smithi070 systemd[1]: Stopped Ceph osd.3 for 3cf89df8-0d04-11ef-bc97-c7b262605968. 2024-05-08T09:52:11.747 INFO:journalctl@ceph.osd.3.smithi070.stdout:May 08 09:52:11 smithi070 systemd[1]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.3.service: Consumed 17min 28.415s CPU time. 2024-05-08T09:52:11.760 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:11.379+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:11.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:52:11.788 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-08T09:52:11.788 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-08T09:52:11.788 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.4 2024-05-08T09:52:12.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:11 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:11.748+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:12.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:11 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:11.748+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:11.852+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:12.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:11 smithi172 systemd[1]: Stopping Ceph osd.4 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:52:12.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:11.900+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:12.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:11.900+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:12.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:11.810+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:12.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:11.810+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:12.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:12.241+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:12.679 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:12.342+0000 7fe292800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:52:12.679 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:12.342+0000 7fe292800700 -1 osd.4 451 *** Got signal Terminated *** 2024-05-08T09:52:12.679 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:12.342+0000 7fe292800700 -1 osd.4 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:52:12.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:12.373+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:12.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:12.373+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:12.739 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:12 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:12.422+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:12.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:12.369+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:13.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:12 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:12.741+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:13.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:12 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:12.741+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:13.177 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:12.873+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:13.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:12.865+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:13.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:12.865+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:13.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:12.767+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:13.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:12.767+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:13.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:13.214+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:13.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:13.349+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:13.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:13.349+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:13.734 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:13 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:13.388+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:13.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:13.394+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:14.080 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:13.866+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:14.080 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:13.866+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:14.081 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:13.779+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:14.081 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:13.779+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:14.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:13 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:13.737+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:14.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:13 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:13.737+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:14.174 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:13.914+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:14.428 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:14 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:14.175+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:14.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:14 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:14.355+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:14.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:14 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:14.355+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:14.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:14 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:14.351+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:14.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:14.367+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:15.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:14 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:14.746+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:15.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:14 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:14.746+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:15.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:14 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:14.877+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:15.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:14.856+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:15.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:14.857+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:15.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:14.827+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:15.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:14.827+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:15.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:15 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:15.313+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:15.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:15 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:15.204+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:15.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:15 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:15.379+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:15.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:15 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:15.379+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:15.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:15.398+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:16.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:15 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:15.744+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:16.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:15 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:15.744+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:16.177 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:15 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:15.869+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:16.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:15.828+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:16.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:15.828+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:16.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:15.844+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:16.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:15.844+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:16.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:16 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:16.335+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:16.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:16 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:16.226+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:16.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:16 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:16.407+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:16.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:16 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:16.407+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:16.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:16.441+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:17.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:16 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:16.766+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:17.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:16 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:16.766+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:17.177 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:16 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4[44430]: 2024-05-08T09:52:16.840+0000 7fe289000700 -1 osd.4 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:41.859256+0000 front 2024-05-08T09:51:41.859138+0000 (oldest deadline 2024-05-08T09:52:07.759342+0000) 2024-05-08T09:52:17.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:16.876+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:17.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:16.876+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:17.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:16.826+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:17.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:16.826+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:17.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:17 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:17.336+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:17.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:17 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:17.424+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:17.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:17 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:17.424+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:17.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:17 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:17.268+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:17.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:17.404+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:18.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:17 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:17.805+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:18.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:17 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:17.805+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:18.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:17.824+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:18.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:17.824+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:18.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:17.846+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:18.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:17.846+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:18.290 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:18 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:18.220+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:18.290 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:18 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:18.220+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:18.290 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:18 smithi172 podman[118717]: 2024-05-08 09:52:18.018689305 +0000 UTC m=+5.814296043 container died a56602009f5c72b83ce9c20c152d3bf1c66fdff51dcb98ada74738ba27110c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-08T09:52:18.626 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:18 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:18.294+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:18.660 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:18 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:18.448+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:18.660 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:18 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:18.448+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:18.661 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:18 smithi172 podman[118717]: 2024-05-08 09:52:18.420261325 +0000 UTC m=+6.215868063 container cleanup a56602009f5c72b83ce9c20c152d3bf1c66fdff51dcb98ada74738ba27110c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS) 2024-05-08T09:52:18.661 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:18 smithi172 bash[118717]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4 2024-05-08T09:52:18.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:18.364+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:18.927 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:18 smithi172 podman[118737]: 2024-05-08 09:52:18.663034185 +0000 UTC m=+0.628053290 container remove a56602009f5c72b83ce9c20c152d3bf1c66fdff51dcb98ada74738ba27110c1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-08T09:52:19.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:18 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:18.789+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:19.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:18 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:18.789+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:19.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:18.819+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:19.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:18.819+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:19.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:18.842+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:19.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:18.842+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:19.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:18.842+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.806096+0000 front 2024-05-08T09:51:55.806220+0000 (oldest deadline 2024-05-08T09:52:18.106331+0000) 2024-05-08T09:52:19.446 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:19 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:19.196+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:19.446 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:19 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:19.196+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:19.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:19 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:19.288+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:19.702 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:19 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:19.448+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:19.702 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:19 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:19.448+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:19.703 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:19 smithi172 podman[118823]: 2024-05-08 09:52:19.409389486 +0000 UTC m=+0.051517815 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:52:19.703 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:19 smithi172 podman[118823]: 2024-05-08 09:52:19.539180431 +0000 UTC m=+0.181308790 container create a951efb89c2aef85cd98362ff56f63d799c4a865ae81f3d2a0681909af0d04c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-08T09:52:19.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:19.343+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:20.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:19 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:19.779+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:20.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:19 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:19.779+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:20.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:19 smithi172 podman[118823]: 2024-05-08 09:52:19.843120396 +0000 UTC m=+0.485248762 container init a951efb89c2aef85cd98362ff56f63d799c4a865ae81f3d2a0681909af0d04c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD) 2024-05-08T09:52:20.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:19 smithi172 podman[118823]: 2024-05-08 09:52:19.855019665 +0000 UTC m=+0.497148034 container start a951efb89c2aef85cd98362ff56f63d799c4a865ae81f3d2a0681909af0d04c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True) 2024-05-08T09:52:20.178 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:19 smithi172 podman[118823]: 2024-05-08 09:52:19.917039082 +0000 UTC m=+0.559167425 container attach a951efb89c2aef85cd98362ff56f63d799c4a865ae81f3d2a0681909af0d04c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-08T09:52:20.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:19.840+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:20.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:19.840+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:20.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:19.840+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.806096+0000 front 2024-05-08T09:51:55.806220+0000 (oldest deadline 2024-05-08T09:52:18.106331+0000) 2024-05-08T09:52:20.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:19.816+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:20.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:19.816+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:20.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:20 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:20.266+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:20.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:20 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:20.266+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:20.639 INFO:journalctl@ceph.osd.4.smithi172.stdout:May 08 09:52:20 smithi172 podman[118823]: 2024-05-08 09:52:20.311711604 +0000 UTC m=+0.953839969 container died a951efb89c2aef85cd98362ff56f63d799c4a865ae81f3d2a0681909af0d04c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-4-deactivate, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-08T09:52:20.639 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:20 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:20.235+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:20.640 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:20 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:20.235+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:20.640 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:20 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:20.439+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:20.640 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:20 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:20.439+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:20.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:20.367+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:21.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.4.service' 2024-05-08T09:52:21.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:20 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:20.796+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:21.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:20 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:20.796+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:21.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:20 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:20.796+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:21.139 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:52:21.139 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-08T09:52:21.139 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-08T09:52:21.140 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.5 2024-05-08T09:52:21.217 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:20.802+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:21.218 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:20.802+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:21.218 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:20.864+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:21.218 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:20.864+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:21.218 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:20.864+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.806096+0000 front 2024-05-08T09:51:55.806220+0000 (oldest deadline 2024-05-08T09:52:18.106331+0000) 2024-05-08T09:52:21.428 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:21 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:21.234+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:21.428 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:21 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:21.234+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:21.509 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:21 smithi194 systemd[1]: Stopping Ceph osd.5 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:52:21.509 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:21.356+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:21.509 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:21.356+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:21.626 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:21 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:21.235+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:21.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:21 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:21.235+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:21.927 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:21 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:21.471+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:21.928 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:21 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:21.471+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:21.928 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:21 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:21.471+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:22.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:21.848+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:22.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:21.848+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:22.010 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:21.848+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:22.010 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:21.733+0000 7f1e95000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:52:22.010 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:21.733+0000 7f1e95000700 -1 osd.5 451 *** Got signal Terminated *** 2024-05-08T09:52:22.010 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:21.733+0000 7f1e95000700 -1 osd.5 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:52:22.010 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:21.871+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:22.010 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:21.871+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:22.010 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:21.871+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.806096+0000 front 2024-05-08T09:51:55.806220+0000 (oldest deadline 2024-05-08T09:52:18.106331+0000) 2024-05-08T09:52:22.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:21 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:21.749+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:22.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:21 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:21.749+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:22.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:21 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:21.749+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:22.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:22 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:22.217+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:22.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:22 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:22.217+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:22.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:22 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:22.237+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:22.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:22 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:22.237+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:22.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:22 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:22.447+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:22.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:22 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:22.447+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:22.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:22 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:22.447+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:22.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:22.406+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:22.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:22.406+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:23.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:22 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:22.797+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:23.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:22 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:22.797+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:23.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:22 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:22.797+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:23.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:22.889+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:23.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:22.889+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:23.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:22.889+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.806096+0000 front 2024-05-08T09:51:55.806220+0000 (oldest deadline 2024-05-08T09:52:18.106331+0000) 2024-05-08T09:52:23.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:22.841+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:23.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:22.841+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:23.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:22.841+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:23.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:23.233+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:23.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:23.233+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:23.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:23.267+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:23.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:23.267+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:23.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:23.458+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:23.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:23.458+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:23.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:23 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:23.458+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:23.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:23.395+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:23.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:23.395+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:24.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:23.764+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:24.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:23.764+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:24.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:23 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:23.764+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:24.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:23.928+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:24.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:23.928+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:24.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:23.928+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.806096+0000 front 2024-05-08T09:51:55.806220+0000 (oldest deadline 2024-05-08T09:52:18.106331+0000) 2024-05-08T09:52:24.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:23.843+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:24.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:23.843+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:24.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:23 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:23.843+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:24.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:24 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:24.215+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:24.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:24 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:24.215+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:24.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:24 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:24.282+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:24.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:24 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:24.282+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:24.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:24 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:24.409+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:24.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:24 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:24.409+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:24.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:24 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:24.409+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:24.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:24.439+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:24.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:24.439+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:25.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:24 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:24.744+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:25.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:24 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:24.744+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:25.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:24 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:24.744+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:25.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:24.953+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:25.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:24.953+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:25.260 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:24.953+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.806096+0000 front 2024-05-08T09:51:55.806220+0000 (oldest deadline 2024-05-08T09:52:18.106331+0000) 2024-05-08T09:52:25.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:24.825+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:25.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:24.825+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:25.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:24 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:24.825+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:25.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:25 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:25.235+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:25.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:25 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:25.235+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:25.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:25 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:25.262+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:25.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:25 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:25.262+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:25.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:25 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:25.392+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:25.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:25 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:25.392+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:25.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:25 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:25.392+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:25.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:25.430+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:25.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:25.430+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:26.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:25 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:25.700+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:26.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:25 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:25.700+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:26.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:25 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:25.700+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:26.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:25.914+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.495414+0000 front 2024-05-08T09:51:34.498077+0000 (oldest deadline 2024-05-08T09:51:56.795193+0000) 2024-05-08T09:52:26.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:25.914+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:42.599802+0000 front 2024-05-08T09:51:42.599483+0000 (oldest deadline 2024-05-08T09:52:07.899042+0000) 2024-05-08T09:52:26.259 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5[45440]: 2024-05-08T09:52:25.914+0000 7f1e8b800700 -1 osd.5 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.806096+0000 front 2024-05-08T09:51:55.806220+0000 (oldest deadline 2024-05-08T09:52:18.106331+0000) 2024-05-08T09:52:26.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:25.822+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:26.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:25.822+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:26.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:25 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:25.822+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:26.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:26 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:26.211+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:26.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:26 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:26.212+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:26.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:26 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:26.232+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:26.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:26 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:26.232+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:26.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:26 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:26.370+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:26.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:26 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:26.370+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:26.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:26 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:26.370+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:26.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:26 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:26.448+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:26.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:26 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:26.448+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:27.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:26 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:26.700+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:27.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:26 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:26.700+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:27.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:26 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:26.700+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:27.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:26 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:26.804+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:27.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:26 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:26.804+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:27.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:26 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:26.804+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:27.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:27 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:27.222+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:27.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:27 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:27.222+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:27.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:27 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:27.232+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:27.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:27 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:27.232+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:27.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:27 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:27.368+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:27.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:27 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:27.368+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:27.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:27 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:27.368+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:27.759 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:27 smithi194 podman[118538]: 2024-05-08 09:52:27.691200758 +0000 UTC m=+6.107152607 container died a039aaf2b0ce25af4ab6ab7ca7a46f1aae24ef91eac4268534d764d1cd9e48fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:52:27.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:27 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:27.460+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:27.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:27 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:27.460+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:28.066 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:28 smithi194 podman[118538]: 2024-05-08 09:52:28.06008693 +0000 UTC m=+6.476038806 container cleanup a039aaf2b0ce25af4ab6ab7ca7a46f1aae24ef91eac4268534d764d1cd9e48fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-08T09:52:28.067 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:28 smithi194 bash[118538]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5 2024-05-08T09:52:28.067 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:27 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:27.809+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:28.067 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:27 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:27.810+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:28.067 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:27 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:27.810+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:28.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:27 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:27.655+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:28.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:27 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:27.655+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:28.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:27 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:27.655+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:28.457 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:28 smithi194 podman[118558]: 2024-05-08 09:52:28.28655124 +0000 UTC m=+0.582463405 container remove a039aaf2b0ce25af4ab6ab7ca7a46f1aae24ef91eac4268534d764d1cd9e48fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0) 2024-05-08T09:52:28.507 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:28 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:28.242+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:28.507 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:28 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:28.242+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:28.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:28 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:28.190+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:28.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:28 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:28.190+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:28.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:28 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:28.403+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:28.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:28 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:28.403+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:28.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:28 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:28.403+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:28.758 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:28 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:28.459+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:28.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:28 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:28.459+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:28.823 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:28 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:28.702+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:28.823 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:28 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:28.703+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:28.823 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:28 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:28.703+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:29.092 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:28 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:28.806+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:29.092 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:28 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:28.806+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:29.092 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:28 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:28.806+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:29.406 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:29 smithi194 podman[118644]: 2024-05-08 09:52:29.004960642 +0000 UTC m=+0.055995998 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:52:29.406 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:29 smithi194 podman[118644]: 2024-05-08 09:52:29.137578939 +0000 UTC m=+0.188614313 container create dbed20674a08ea5c1d177604318a9fbc2fba6ff401f0a4454fe2f74d7f3f88b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-08T09:52:29.406 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:29 smithi194 podman[118644]: 2024-05-08 09:52:29.407864748 +0000 UTC m=+0.458900132 container init dbed20674a08ea5c1d177604318a9fbc2fba6ff401f0a4454fe2f74d7f3f88b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-08T09:52:29.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:29.242+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:29.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:29.242+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:29.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:29.242+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.423378+0000 front 2024-05-08T09:52:05.423339+0000 (oldest deadline 2024-05-08T09:52:28.323343+0000) 2024-05-08T09:52:29.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:29 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:29.221+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:29.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:29 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:29.221+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:29.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:29 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:29.392+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:29.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:29 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:29.392+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:29.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:29 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:29.392+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:29.759 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:29 smithi194 podman[118644]: 2024-05-08 09:52:29.420114756 +0000 UTC m=+0.471150120 container start dbed20674a08ea5c1d177604318a9fbc2fba6ff401f0a4454fe2f74d7f3f88b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-08T09:52:29.759 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:29 smithi194 podman[118644]: 2024-05-08 09:52:29.506786191 +0000 UTC m=+0.557821598 container attach dbed20674a08ea5c1d177604318a9fbc2fba6ff401f0a4454fe2f74d7f3f88b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:52:29.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:29 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:29.481+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:29.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:29 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:29.481+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:29.760 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:29 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:29.481+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:30.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:29.655+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:30.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:29.655+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:30.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:29 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:29.655+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:30.210 INFO:journalctl@ceph.osd.5.smithi194.stdout:May 08 09:52:29 smithi194 podman[118644]: 2024-05-08 09:52:29.885905104 +0000 UTC m=+0.936940488 container died dbed20674a08ea5c1d177604318a9fbc2fba6ff401f0a4454fe2f74d7f3f88b7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-08T09:52:30.211 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:29 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:29.804+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:30.211 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:29 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:29.804+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:30.211 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:29 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:29.804+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:30.573 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.5.service' 2024-05-08T09:52:30.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:30.285+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:30.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:30.285+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:30.628 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:30.285+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.423378+0000 front 2024-05-08T09:52:05.423339+0000 (oldest deadline 2024-05-08T09:52:28.323343+0000) 2024-05-08T09:52:30.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:30 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:30.259+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:30.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:30 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:30.259+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:30.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:30 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:30.384+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:30.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:30 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:30.384+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:30.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:30 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:30.384+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:30.686 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:52:30.686 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-08T09:52:30.687 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-08T09:52:30.687 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.6 2024-05-08T09:52:30.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:30 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:30.510+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:30.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:30 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:30.510+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:30.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:30 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:30.510+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:31.127 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:30 smithi070 systemd[1]: Stopping Ceph osd.6 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:52:31.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:30.651+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:31.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:30.651+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:31.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:30 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:30.651+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:31.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:30 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:30.764+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:31.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:30 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:30.764+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:31.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:30 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:30.764+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:31.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:31.258+0000 7f20f2400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:52:31.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:31.258+0000 7f20f2400700 -1 osd.6 451 *** Got signal Terminated *** 2024-05-08T09:52:31.628 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:31.258+0000 7f20f2400700 -1 osd.6 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:52:31.628 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:31.278+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:31.628 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:31.278+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:31.628 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:31.278+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.423378+0000 front 2024-05-08T09:52:05.423339+0000 (oldest deadline 2024-05-08T09:52:28.323343+0000) 2024-05-08T09:52:31.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:31 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:31.213+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:31.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:31 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:31.213+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:31.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:31 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:31.213+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:31.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:31 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:31.347+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:31.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:31 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:31.347+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:31.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:31 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:31.347+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:32.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:31 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:31.771+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:32.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:31 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:31.771+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:32.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:31 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:31.771+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:32.010 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:31 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:31.541+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:32.010 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:31 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:31.541+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:32.010 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:31 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:31.541+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:32.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:31.658+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:32.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:31.658+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:32.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:31.658+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:32.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:31 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:31.658+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:32.428 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:32 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:32.178+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:32.428 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:32 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:32.178+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:32.428 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:32 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:32.178+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:32.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:32 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:32.334+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:32.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:32 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:32.334+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:32.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:32 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:32.334+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:32.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:32.324+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:32.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:32.324+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:32.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:32.324+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.423378+0000 front 2024-05-08T09:52:05.423339+0000 (oldest deadline 2024-05-08T09:52:28.323343+0000) 2024-05-08T09:52:32.787 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:32 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:32.519+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:32.788 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:32 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:32.519+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:32.788 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:32 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:32.519+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:33.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:32.642+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:33.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:32.642+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:33.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:32.642+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:33.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:32.642+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:33.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:32 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:32.789+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:33.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:32 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:32.789+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:33.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:32 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:32.789+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:33.609 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:33.331+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:33.610 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:33.331+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:33.610 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:33.331+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.423378+0000 front 2024-05-08T09:52:05.423339+0000 (oldest deadline 2024-05-08T09:52:28.323343+0000) 2024-05-08T09:52:33.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:33 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:33.182+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:33.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:33 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:33.182+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:33.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:33 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:33.182+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:33.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:33 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:33.303+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:33.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:33 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:33.303+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:33.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:33 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:33.303+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:33.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:33.611+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:33.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:33.611+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:33.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:33.611+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:33.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:33 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:33.611+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:34.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:33 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:33.781+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:34.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:33 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:33.781+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:34.010 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:33 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:33.781+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:34.010 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:33 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:33.543+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:34.010 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:33 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:33.543+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:34.010 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:33 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:33.543+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:34.618 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:34.339+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:34.618 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:34.339+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:34.618 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:34.339+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.423378+0000 front 2024-05-08T09:52:05.423339+0000 (oldest deadline 2024-05-08T09:52:28.323343+0000) 2024-05-08T09:52:34.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:34 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:34.215+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:34.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:34 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:34.215+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:34.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:34 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:34.215+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:34.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:34 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:34.327+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:34.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:34 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:34.327+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:34.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:34 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:34.327+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:34.680 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:34 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:34.327+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:34.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:34 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:34.502+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:34.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:34 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:34.502+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:34.760 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:34 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:34.502+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:34.876 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:34.620+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:34.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:34.620+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:34.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:34.620+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:34.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:34 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:34.620+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:35.047 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:34 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:34.770+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:35.047 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:34 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:34.770+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:35.047 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:34 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:34.770+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:35.627 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:35.579+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:35.627 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:35.579+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:35.627 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:35.579+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:35.627 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:35.579+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:35.627 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:35.343+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:46.116389+0000 front 2024-05-08T09:51:46.116605+0000 (oldest deadline 2024-05-08T09:52:09.616406+0000) 2024-05-08T09:52:35.628 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:35.343+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:54.821041+0000 front 2024-05-08T09:51:54.820578+0000 (oldest deadline 2024-05-08T09:52:19.520881+0000) 2024-05-08T09:52:35.628 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:35 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6[57112]: 2024-05-08T09:52:35.343+0000 7f20e8c00700 -1 osd.6 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.423378+0000 front 2024-05-08T09:52:05.423339+0000 (oldest deadline 2024-05-08T09:52:28.323343+0000) 2024-05-08T09:52:35.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:35 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:35.255+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:35.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:35 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:35.255+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:35.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:35 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:35.255+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:35.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:35 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:35.323+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:35.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:35 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:35.323+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:35.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:35 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:35.323+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:35.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:35 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:35.323+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:35.729 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:35 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:35.471+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:35.730 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:35 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:35.471+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:35.730 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:35 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:35.471+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:36.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:35 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:35.812+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:36.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:35 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:35.812+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:36.009 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:35 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:35.812+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:36.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:36 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:36.294+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:36.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:36 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:36.294+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:36.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:36 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:36.294+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:36.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:36 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:36.315+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:36.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:36 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:36.315+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:36.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:36 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:36.315+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:36.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:36 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:36.315+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:36.762 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:36 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:36.503+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:36.762 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:36 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:36.503+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:36.763 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:36 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:36.503+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:36.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:36 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:36.606+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:36.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:36 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:36.606+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:36.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:36 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:36.606+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:36.878 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:36 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:36.606+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:37.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:36 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:36.823+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:37.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:36 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:36.823+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:37.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:36 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:36.823+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:37.363 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:37 smithi070 podman[369306]: 2024-05-08 09:52:37.066600215 +0000 UTC m=+5.965439290 container died b9383ac892d407de392ba0230115aa1e3c981bb60b55b3a298d55de08594b692 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-08T09:52:37.615 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:37 smithi070 podman[369306]: 2024-05-08 09:52:37.610771379 +0000 UTC m=+6.509610461 container cleanup b9383ac892d407de392ba0230115aa1e3c981bb60b55b3a298d55de08594b692 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=) 2024-05-08T09:52:37.615 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:37 smithi070 bash[369306]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6 2024-05-08T09:52:37.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:37 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:37.292+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:37.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:37 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:37.292+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:37.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:37 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:37.292+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:37.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:37 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:37.270+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:37.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:37 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:37.270+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:37.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:37 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:37.270+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:37.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:37 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:37.270+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:37.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:37 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:37.498+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:37.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:37 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:37.498+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:37.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:37 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:37.498+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:37.901 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:37 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:37.645+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:37.902 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:37 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:37.645+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:37.902 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:37 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:37.645+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:37.902 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:37 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:37.645+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:38.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:37 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:37.843+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:38.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:37 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:37.843+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:38.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:37 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:37.843+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:38.376 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:37 smithi070 podman[369324]: 2024-05-08 09:52:37.90439724 +0000 UTC m=+0.828502218 container remove b9383ac892d407de392ba0230115aa1e3c981bb60b55b3a298d55de08594b692 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-08T09:52:38.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:38 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:38.321+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:38.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:38 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:38.321+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:38.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:38 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:38.321+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:38.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:38 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:38.270+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:38.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:38 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:38.270+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:38.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:38 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:38.270+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:38.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:38 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:38.270+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:38.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:38 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:38.463+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:38.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:38 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:38.463+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:38.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:38 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:38.463+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:38.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:38 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:38.463+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:39.022 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:38 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:38.673+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:39.023 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:38 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:38.673+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:39.023 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:38 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:38.673+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:39.023 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:38 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:38.673+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:39.023 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:38 smithi070 podman[369410]: 2024-05-08 09:52:38.706746032 +0000 UTC m=+0.038968936 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:52:39.024 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:38 smithi070 podman[369410]: 2024-05-08 09:52:38.85515509 +0000 UTC m=+0.187378018 container create e03896318bcc447bcb389eaca02110c04d2e59336659ad097a456c9ef5d23244 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-08T09:52:39.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:38 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:38.882+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:39.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:38 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:38.882+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:39.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:38 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:38.882+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:39.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:38 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:38.882+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:39.376 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:39 smithi070 podman[369410]: 2024-05-08 09:52:39.142641998 +0000 UTC m=+0.474864926 container init e03896318bcc447bcb389eaca02110c04d2e59336659ad097a456c9ef5d23244 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True) 2024-05-08T09:52:39.377 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:39 smithi070 podman[369410]: 2024-05-08 09:52:39.154734635 +0000 UTC m=+0.486957526 container start e03896318bcc447bcb389eaca02110c04d2e59336659ad097a456c9ef5d23244 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-08T09:52:39.377 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:39 smithi070 podman[369410]: 2024-05-08 09:52:39.262511174 +0000 UTC m=+0.594734128 container attach e03896318bcc447bcb389eaca02110c04d2e59336659ad097a456c9ef5d23244 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:52:39.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:39 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:39.368+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:39.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:39 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:39.368+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:39.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:39 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:39.368+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:39.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:39 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:39.285+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:39.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:39 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:39.285+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:39.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:39 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:39.285+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:39.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:39 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:39.285+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:39.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:39 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:39.477+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:39.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:39 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:39.477+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:39.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:39 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:39.477+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:39.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:39 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:39.477+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:39.877 INFO:journalctl@ceph.osd.6.smithi070.stdout:May 08 09:52:39 smithi070 podman[369410]: 2024-05-08 09:52:39.615250326 +0000 UTC m=+0.947473237 container died e03896318bcc447bcb389eaca02110c04d2e59336659ad097a456c9ef5d23244 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-08T09:52:39.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:39 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:39.683+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:39.878 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:39 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:39.683+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:39.878 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:39 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:39.683+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:39.878 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:39 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:39.683+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:39.878 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:39 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:39.683+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:40.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:39 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:39.886+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:40.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:39 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:39.886+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:40.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:39 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:39.886+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:40.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:39 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:39.886+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:40.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.6.service' 2024-05-08T09:52:40.599 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:52:40.599 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-08T09:52:40.600 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-08T09:52:40.600 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.7 2024-05-08T09:52:40.674 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:40 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:40.371+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:40.675 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:40 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:40.371+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:40.675 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:40 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:40.371+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:40.675 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:40 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:40.273+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:40.675 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:40 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:40.273+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:40.675 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:40 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:40.273+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:40.675 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:40 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:40.273+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:40.676 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:40 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:40.273+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:40.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:40 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:40.450+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:40.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:40 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:40.450+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:40.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:40 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:40.450+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:40.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:40 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:40.450+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:40.927 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:40 smithi172 systemd[1]: Stopping Ceph osd.7 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:52:41.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:40 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:40.645+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:41.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:40 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:40.645+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:41.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:40 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:40.645+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:41.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:40 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:40.645+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:41.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:40 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:40.645+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:41.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:40 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:40.878+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:41.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:40 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:40.878+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:41.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:40 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:40.878+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:41.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:40 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:40.878+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:41.400 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:41.138+0000 7f9326800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:52:41.400 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:41.138+0000 7f9326800700 -1 osd.7 451 *** Got signal Terminated *** 2024-05-08T09:52:41.400 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:41.138+0000 7f9326800700 -1 osd.7 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:52:41.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:41.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:41.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:41.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:41.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:41.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:41.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:41.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:41.401 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:41.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:41.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:41.402+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:41.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:41.402+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:41.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:41.402+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:41.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:41 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:41.402+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.082544+0000 front 2024-05-08T09:52:16.082783+0000 (oldest deadline 2024-05-08T09:52:41.382765+0000) 2024-05-08T09:52:41.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:41 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:41.400+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:41.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:41 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:41.400+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:41.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:41 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:41.400+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:41.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:41 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:41.400+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:41.876 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:41 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:41.625+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:41.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:41 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:41.625+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:41.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:41 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:41.625+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:41.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:41 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:41.625+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:41.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:41 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:41.625+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:42.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:41 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:41.855+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:42.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:41 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:41.855+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:42.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:41 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:41.855+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:42.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:41 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:41.855+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:42.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:42.388+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:42.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:42.388+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:42.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:42.388+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:42.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:42.388+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.082544+0000 front 2024-05-08T09:52:16.082783+0000 (oldest deadline 2024-05-08T09:52:41.382765+0000) 2024-05-08T09:52:42.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:42.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:42.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:42.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:42.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:42.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:42.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:42.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:42.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:42 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:42.253+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:42.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:42 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:42.421+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:42.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:42 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:42.421+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:42.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:42 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:42.421+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:42.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:42 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:42.421+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:43.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:42 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:42.647+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:43.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:42 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:42.647+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:43.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:42 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:42.647+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:43.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:42 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:42.647+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:43.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:42 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:42.647+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:43.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:42 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:42.878+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:43.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:42 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:42.878+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:43.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:42 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:42.878+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:43.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:42 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:42.878+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:43.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:43 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:43.339+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:43.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:43 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:43.339+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:43.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:43 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:43.339+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:43.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:43 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:43.339+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.082544+0000 front 2024-05-08T09:52:16.082783+0000 (oldest deadline 2024-05-08T09:52:41.382765+0000) 2024-05-08T09:52:43.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:43 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:43.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:43.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:43 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:43.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:43.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:43 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:43.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:43.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:43 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:43.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:43.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:43 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:43.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:43.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:43 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:43.432+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:43.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:43 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:43.432+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:43.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:43 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:43.432+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:43.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:43 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:43.432+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:44.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:43 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:43.657+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:44.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:43 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:43.657+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:44.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:43 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:43.657+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:44.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:43 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:43.657+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:44.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:43 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:43.657+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:44.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:43 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:43.865+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:44.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:43 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:43.865+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:44.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:43 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:43.865+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:44.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:43 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:43.865+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:44.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:44 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:44.375+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:44.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:44 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:44.375+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:44.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:44 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:44.375+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:44.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:44 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:44.375+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.082544+0000 front 2024-05-08T09:52:16.082783+0000 (oldest deadline 2024-05-08T09:52:41.382765+0000) 2024-05-08T09:52:44.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:44 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:44.242+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:44.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:44 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:44.242+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:44.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:44 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:44.242+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:44.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:44 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:44.242+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:44.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:44 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:44.242+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:44.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:44.435+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:44.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:44.435+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:44.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:44.435+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:44.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:44.435+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:44.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:44.620+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:44.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:44.620+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:44.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:44.620+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:44.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:44.620+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:44.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:44.620+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:45.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:44.821+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:45.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:44.821+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:45.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:44.821+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:45.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:44 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:44.821+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:45.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:45 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:45.410+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:44.573242+0000 front 2024-05-08T09:51:44.573075+0000 (oldest deadline 2024-05-08T09:52:09.273331+0000) 2024-05-08T09:52:45.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:45 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:45.410+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.175620+0000 front 2024-05-08T09:51:52.175766+0000 (oldest deadline 2024-05-08T09:52:18.075426+0000) 2024-05-08T09:52:45.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:45 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:45.410+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.079155+0000 front 2024-05-08T09:52:02.078706+0000 (oldest deadline 2024-05-08T09:52:30.879285+0000) 2024-05-08T09:52:45.678 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:45 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7[51188]: 2024-05-08T09:52:45.410+0000 7f931d000700 -1 osd.7 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.082544+0000 front 2024-05-08T09:52:16.082783+0000 (oldest deadline 2024-05-08T09:52:41.382765+0000) 2024-05-08T09:52:45.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:45 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:45.211+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:45.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:45 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:45.211+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:45.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:45 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:45.211+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:45.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:45 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:45.211+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:45.679 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:45 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:45.211+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:45.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:45 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:45.468+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:45.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:45 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:45.468+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:45.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:45 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:45.468+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:45.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:45 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:45.468+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:45.876 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:45 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:45.574+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:45.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:45 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:45.574+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:45.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:45 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:45.574+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:45.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:45 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:45.574+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:45.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:45 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:45.574+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:46.110 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:45 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:45.850+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:46.110 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:45 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:45.850+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:46.110 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:45 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:45.850+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:46.110 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:45 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:45.850+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:46.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:46 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:46.233+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:46.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:46 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:46.233+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:46.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:46 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:46.233+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:46.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:46 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:46.233+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:46.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:46 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:46.233+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:46.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:46 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:46.493+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:46.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:46 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:46.494+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:46.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:46 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:46.494+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:46.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:46 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:46.494+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:46.876 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:46 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:46.588+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:46.876 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:46 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:46.588+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:46.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:46 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:46.588+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:46.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:46 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:46.588+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:46.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:46 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:46.588+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:47.032 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:46 smithi172 podman[118927]: 2024-05-08 09:52:46.773442093 +0000 UTC m=+5.768153919 container died 0cbc5c49cc60abea0d793874b9c18b9a778d9d0efc28fda02867412279037db3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-08T09:52:47.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:46 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:46.842+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:47.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:46 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:46.842+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:47.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:46 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:46.842+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:47.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:46 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:46.842+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:47.361 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:47 smithi172 podman[118927]: 2024-05-08 09:52:47.146887079 +0000 UTC m=+6.141598902 container cleanup 0cbc5c49cc60abea0d793874b9c18b9a778d9d0efc28fda02867412279037db3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:52:47.362 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:47 smithi172 bash[118927]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7 2024-05-08T09:52:47.362 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:47 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:47.279+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:47.362 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:47 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:47.279+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:47.363 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:47 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:47.279+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:47.363 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:47 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:47.279+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:47.363 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:47 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:47.279+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:47.677 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:47 smithi172 podman[118945]: 2024-05-08 09:52:47.36434129 +0000 UTC m=+0.571712913 container remove 0cbc5c49cc60abea0d793874b9c18b9a778d9d0efc28fda02867412279037db3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-08T09:52:47.758 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:47 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:47.462+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:47.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:47 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:47.462+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:47.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:47 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:47.462+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:47.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:47 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:47.462+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:48.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:47 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:47.636+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:48.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:47 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:47.636+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:48.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:47 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:47.636+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:48.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:47 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:47.636+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:48.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:47 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:47.636+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:48.258 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:47 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:47.870+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:48.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:47 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:47.870+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:48.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:47 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:47.870+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:48.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:47 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:47.870+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:48.491 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:48 smithi172 podman[119037]: 2024-05-08 09:52:48.101647415 +0000 UTC m=+0.033237902 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:52:48.491 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:48 smithi172 podman[119037]: 2024-05-08 09:52:48.215209755 +0000 UTC m=+0.146800288 container create 4afa0d4d6fe4963b9b808da7441798f6f475e792ef4acb351d0bd3e19b756e06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, ceph=True) 2024-05-08T09:52:48.492 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:48 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:48.251+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:48.492 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:48 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:48.251+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:48.492 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:48 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:48.251+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:48.492 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:48 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:48.251+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:48.492 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:48 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:48.251+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:48.835 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:48.511+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:48.835 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:48.511+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:48.835 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:48.511+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:48.835 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:48.511+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:48.835 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:48.511+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.277000+0000 front 2024-05-08T09:52:26.276944+0000 (oldest deadline 2024-05-08T09:52:47.976582+0000) 2024-05-08T09:52:48.927 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:48 smithi172 podman[119037]: 2024-05-08 09:52:48.494091712 +0000 UTC m=+0.425682242 container init 4afa0d4d6fe4963b9b808da7441798f6f475e792ef4acb351d0bd3e19b756e06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS) 2024-05-08T09:52:48.927 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:48 smithi172 podman[119037]: 2024-05-08 09:52:48.504765319 +0000 UTC m=+0.436355814 container start 4afa0d4d6fe4963b9b808da7441798f6f475e792ef4acb351d0bd3e19b756e06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-08T09:52:48.927 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:48 smithi172 podman[119037]: 2024-05-08 09:52:48.583987001 +0000 UTC m=+0.515577581 container attach 4afa0d4d6fe4963b9b808da7441798f6f475e792ef4acb351d0bd3e19b756e06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5) 2024-05-08T09:52:49.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:48 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:48.667+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:49.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:48 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:48.667+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:49.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:48 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:48.667+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:49.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:48 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:48.667+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:49.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:48 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:48.667+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:49.246 INFO:journalctl@ceph.osd.7.smithi172.stdout:May 08 09:52:48 smithi172 podman[119037]: 2024-05-08 09:52:48.964224962 +0000 UTC m=+0.895815467 container died 4afa0d4d6fe4963b9b808da7441798f6f475e792ef4acb351d0bd3e19b756e06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, ceph=True, GIT_CLEAN=True) 2024-05-08T09:52:49.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:48.836+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:49.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:48.836+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:49.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:48.836+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:49.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:48.836+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:49.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:48 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:48.836+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:49.593 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:49 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:49.248+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:49.594 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:49 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:49.248+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:49.594 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:49 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:49.248+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:49.594 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:49 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:49.248+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:49.594 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:49 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:49.248+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:49.594 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:49 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:49.248+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:49.641 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.7.service' 2024-05-08T09:52:49.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:52:49.736 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-08T09:52:49.736 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-08T09:52:49.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.8 2024-05-08T09:52:49.814 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:49.534+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:49.815 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:49.534+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:49.815 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:49.534+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:49.815 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:49.534+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:49.815 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:49.534+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.277000+0000 front 2024-05-08T09:52:26.276944+0000 (oldest deadline 2024-05-08T09:52:47.976582+0000) 2024-05-08T09:52:50.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:49 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:49.646+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:50.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:49 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:49.646+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:50.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:49 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:49.646+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:50.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:49 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:49.646+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:50.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:49 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:49.646+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:50.259 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:49 smithi194 systemd[1]: Stopping Ceph osd.8 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:52:50.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:49.863+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:50.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:49.863+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:50.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:49.863+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:50.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:49.863+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:50.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:49 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:49.863+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:50.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:50 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:50.243+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:50.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:50 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:50.243+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:50.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:50 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:50.243+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:50.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:50 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:50.243+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:50.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:50 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:50.243+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:50.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:50 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:50.243+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:50.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:50.360+0000 7fe56f400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:52:50.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:50.360+0000 7fe56f400700 -1 osd.8 451 *** Got signal Terminated *** 2024-05-08T09:52:50.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:50.360+0000 7fe56f400700 -1 osd.8 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:52:50.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:50.582+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:50.760 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:50.582+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:50.760 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:50.582+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:50.760 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:50.582+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:50.760 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:50.582+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.277000+0000 front 2024-05-08T09:52:26.276944+0000 (oldest deadline 2024-05-08T09:52:47.976582+0000) 2024-05-08T09:52:51.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:50 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:50.631+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:51.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:50 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:50.631+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:51.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:50 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:50.631+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:51.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:50 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:50.631+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:51.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:50 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:50.631+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:51.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:50 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:50.631+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:52:51.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:50.897+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:51.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:50.897+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:51.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:50.897+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:51.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:50.897+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:51.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:50 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:50.898+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:51.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:51 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:51.247+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:51.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:51 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:51.247+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:51.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:51 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:51.247+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:51.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:51 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:51.247+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:51.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:51 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:51.247+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:51.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:51 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:51.247+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:51.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:51.597+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:51.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:51.597+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:51.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:51.597+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:51.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:51.597+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:51.878 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:51.597+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:51.878 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:51 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:51.597+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:52:51.906 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:51.580+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:51.907 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:51.580+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:51.907 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:51.580+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:51.907 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:51.580+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:51.907 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:51.580+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.277000+0000 front 2024-05-08T09:52:26.276944+0000 (oldest deadline 2024-05-08T09:52:47.976582+0000) 2024-05-08T09:52:52.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:51.908+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:52.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:51.908+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:52.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:51.908+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:52.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:51.908+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:52.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:51 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:51.908+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:52.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:52 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:52.294+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:52.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:52 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:52.294+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:52.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:52 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:52.294+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:52.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:52 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:52.294+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:52.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:52 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:52.294+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:52.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:52 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:52.294+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:52.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:52 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:52.627+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:52.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:52 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:52.627+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:52.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:52 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:52.627+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:52.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:52 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:52.627+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:52.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:52 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:52.627+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:52.877 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:52 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:52.627+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:52:52.900 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:52.593+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:52.900 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:52.593+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:52.900 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:52.593+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:52.900 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:52.593+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:52.900 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:52.593+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.277000+0000 front 2024-05-08T09:52:26.276944+0000 (oldest deadline 2024-05-08T09:52:47.976582+0000) 2024-05-08T09:52:53.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:52.901+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:53.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:52.901+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:53.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:52.901+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:53.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:52.901+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:53.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:52 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:52.901+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:53.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:53.262+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:53.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:53.262+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:53.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:53.262+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:53.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:53.262+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:53.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:53.262+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:53.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:53 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:53.262+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:53.889 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:53.545+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:53.890 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:53.545+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:53.890 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:53.545+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:53.890 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:53.545+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:53.890 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:53.545+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.277000+0000 front 2024-05-08T09:52:26.276944+0000 (oldest deadline 2024-05-08T09:52:47.976582+0000) 2024-05-08T09:52:54.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:53 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:53.657+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:54.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:53 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:53.657+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:54.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:53 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:53.657+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:54.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:53 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:53.658+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:54.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:53 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:53.658+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:54.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:53 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:53.658+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:52:54.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:53.890+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:54.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:53.890+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:54.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:53.890+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:54.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:53.890+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:54.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:53 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:53.890+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:54.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:54 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:54.249+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:54.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:54 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:54.249+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:54.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:54 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:54.249+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:54.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:54 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:54.249+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:54.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:54 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:54.249+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:54.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:54 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:54.249+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:54.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:54.506+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.166914+0000 front 2024-05-08T09:51:45.167075+0000 (oldest deadline 2024-05-08T09:52:10.467145+0000) 2024-05-08T09:52:54.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:54.506+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.169655+0000 front 2024-05-08T09:51:55.169852+0000 (oldest deadline 2024-05-08T09:52:20.469912+0000) 2024-05-08T09:52:54.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:54.506+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:05.772289+0000 front 2024-05-08T09:52:05.771917+0000 (oldest deadline 2024-05-08T09:52:28.672024+0000) 2024-05-08T09:52:54.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:54.506+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:12.774561+0000 front 2024-05-08T09:52:12.774088+0000 (oldest deadline 2024-05-08T09:52:38.073885+0000) 2024-05-08T09:52:54.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8[52284]: 2024-05-08T09:52:54.506+0000 7fe56ac00700 -1 osd.8 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.277000+0000 front 2024-05-08T09:52:26.276944+0000 (oldest deadline 2024-05-08T09:52:47.976582+0000) 2024-05-08T09:52:55.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:54 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:54.703+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:55.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:54 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:54.703+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:55.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:54 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:54.703+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:55.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:54 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:54.703+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:55.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:54 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:54.703+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:55.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:54 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:54.703+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:52:55.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:54.932+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:55.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:54.932+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:55.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:54.932+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:55.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:54.932+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:55.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:54 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:54.932+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:55.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:55.229+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:55.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:55.229+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:55.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:55.229+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:55.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:55.229+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:55.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:55.229+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:55.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:55.229+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:56.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:55 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:55.751+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:56.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:55 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:55.751+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:56.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:55 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:55.751+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:56.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:55 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:55.751+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:56.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:55 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:55.751+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:56.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:55 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:55.751+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:52:56.258 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:56 smithi194 podman[118763]: 2024-05-08 09:52:56.183647544 +0000 UTC m=+6.052590155 container died 9d3c72844e9de0a9ba0ba4b850c248c8fc90732457a682ec96a770b6d0701344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:52:56.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:55 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:55.940+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:56.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:55 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:55.940+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:56.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:55 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:55.940+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:56.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:55 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:55.940+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:56.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:55 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:55.940+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:56.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:56.228+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:56.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:56.228+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:56.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:56.228+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:56.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:56.228+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:56.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:56.228+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:56.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:56 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:56.228+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:56.758 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:56 smithi194 podman[118763]: 2024-05-08 09:52:56.612313213 +0000 UTC m=+6.481255817 container cleanup 9d3c72844e9de0a9ba0ba4b850c248c8fc90732457a682ec96a770b6d0701344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507) 2024-05-08T09:52:56.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:56 smithi194 bash[118763]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8 2024-05-08T09:52:57.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:56 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:56.792+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:57.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:56 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:56.792+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:57.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:56 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:56.792+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:57.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:56 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:56.792+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:57.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:56 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:56.792+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:57.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:56 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:56.792+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:52:57.258 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:56 smithi194 podman[118781]: 2024-05-08 09:52:56.880234806 +0000 UTC m=+0.679733571 container remove 9d3c72844e9de0a9ba0ba4b850c248c8fc90732457a682ec96a770b6d0701344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-08T09:52:57.258 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:56.907+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:57.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:56.907+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:57.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:56.907+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:57.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:56.907+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:57.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:56 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:56.907+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:57.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:57 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:57.231+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:57.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:57 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:57.231+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:57.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:57 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:57.231+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:57.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:57 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:57.231+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:57.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:57 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:57.231+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:57.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:57 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:57.231+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:57.758 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:57 smithi194 podman[118870]: 2024-05-08 09:52:57.405541998 +0000 UTC m=+0.034475191 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:52:57.759 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:57 smithi194 podman[118870]: 2024-05-08 09:52:57.531103379 +0000 UTC m=+0.160036619 container create 9123ffa2ed93c89736848ae6cd1641eecc11b6b5772d030621924cb190fa3162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-08T09:52:58.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:57 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:57.841+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:58.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:57 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:57.841+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:58.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:57 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:57.841+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:58.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:57 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:57.841+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:58.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:57 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:57.841+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:58.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:57 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:57.841+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:52:58.230 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:57 smithi194 podman[118870]: 2024-05-08 09:52:57.777359622 +0000 UTC m=+0.406292882 container init 9123ffa2ed93c89736848ae6cd1641eecc11b6b5772d030621924cb190fa3162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-08T09:52:58.230 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:57 smithi194 podman[118870]: 2024-05-08 09:52:57.788220617 +0000 UTC m=+0.417153846 container start 9123ffa2ed93c89736848ae6cd1641eecc11b6b5772d030621924cb190fa3162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-08T09:52:58.230 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:57 smithi194 podman[118870]: 2024-05-08 09:52:57.875243958 +0000 UTC m=+0.504177231 container attach 9123ffa2ed93c89736848ae6cd1641eecc11b6b5772d030621924cb190fa3162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-05-08T09:52:58.231 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:57 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:57.858+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:58.231 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:57 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:57.858+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:58.231 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:57 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:57.858+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:58.231 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:57 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:57.858+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:58.231 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:57 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:57.858+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:58.508 INFO:journalctl@ceph.osd.8.smithi194.stdout:May 08 09:52:58 smithi194 podman[118870]: 2024-05-08 09:52:58.233510142 +0000 UTC m=+0.862443375 container died 9123ffa2ed93c89736848ae6cd1641eecc11b6b5772d030621924cb190fa3162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-05-08T09:52:58.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:58 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:58.277+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:58.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:58 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:58.277+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:58.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:58 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:58.277+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:58.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:58 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:58.277+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:58.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:58 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:58.277+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:58.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:58 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:58.277+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:52:58.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.8.service' 2024-05-08T09:52:59.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:52:59.109 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-08T09:52:59.109 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-08T09:52:59.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.9 2024-05-08T09:52:59.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:58 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:58.800+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:52:59.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:58 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:58.800+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:52:59.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:58 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:58.800+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:52:59.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:58 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:58.800+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:52:59.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:58 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:58.800+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:52:59.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:58 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:58.800+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:52:59.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:58 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:58.871+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:52:59.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:58 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:58.871+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:52:59.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:58 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:58.871+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:52:59.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:58 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:58.871+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:52:59.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:58 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:58.871+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:52:59.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:58 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:58.871+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:52:59.626 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 systemd[1]: Stopping Ceph osd.9 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:52:59.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:59.264+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:52:59.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:59.264+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:52:59.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:59.264+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:52:59.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:59.264+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:52:59.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:59.264+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:52:59.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:52:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:52:59.264+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:00.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:59.702+0000 7f9631e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:00.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:59.702+0000 7f9631e00700 -1 osd.9 451 *** Got signal Terminated *** 2024-05-08T09:53:00.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:59.702+0000 7f9631e00700 -1 osd.9 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:53:00.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:59.758+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:53:00.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:59.758+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:53:00.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:59.758+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:53:00.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:59.758+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:53:00.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:59.758+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:53:00.128 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:52:59 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:52:59.758+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:53:00.258 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:59 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:59.910+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:00.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:59 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:59.910+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:00.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:59 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:59.910+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:00.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:59 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:59.910+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:00.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:59 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:59.910+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:00.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:52:59 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:52:59.910+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:00.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:00.276+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:00.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:00.276+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:00.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:00.276+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:00.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:00.276+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:00.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:00.276+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:00.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:00.276+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:00.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:00 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:00.276+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:01.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:00.796+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:53:01.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:00.796+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:53:01.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:00.796+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:53:01.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:00.796+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:53:01.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:00.796+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:53:01.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:00 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:00.796+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:53:01.258 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:00 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:00.936+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:01.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:00 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:00.936+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:01.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:00 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:00.936+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:01.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:00 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:00.936+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:01.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:00 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:00.936+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:01.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:00 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:00.936+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:01.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:01 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:01.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:01.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:01 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:01.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:01.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:01 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:01.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:01.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:01 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:01.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:01.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:01 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:01.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:01.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:01 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:01.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:01.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:01 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:01.227+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:02.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:01 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:01.753+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:53:02.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:01 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:01.753+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:53:02.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:01 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:01.753+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:53:02.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:01 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:01.753+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:53:02.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:01 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:01.753+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:53:02.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:01 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:01.753+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:53:02.258 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:01 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:01.925+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:02.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:01 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:01.925+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:02.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:01 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:01.925+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:02.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:01 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:01.925+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:02.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:01 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:01.925+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:02.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:01 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:01.925+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:02.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:02 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:02.191+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:02.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:02 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:02.191+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:02.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:02 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:02.191+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:02.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:02 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:02.191+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:02.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:02 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:02.191+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:02.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:02 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:02.191+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:02.678 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:02 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:02.191+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:03.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:02.795+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:53:03.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:02.795+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:53:03.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:02.795+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:53:03.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:02.795+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:53:03.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:02.795+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:53:03.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:02 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:02.795+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:53:03.258 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:02 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:02.952+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:03.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:02 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:02.952+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:03.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:02 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:02.952+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:03.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:02 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:02.952+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:03.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:02 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:02.952+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:03.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:02 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:02.952+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:03.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:03.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:03.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:03.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:03.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:03.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:03.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:03.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:03.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:03.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:03.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:03.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:03.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:03.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:04.126 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:03 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:03.766+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.079115+0000 front 2024-05-08T09:51:34.079217+0000 (oldest deadline 2024-05-08T09:51:57.579313+0000) 2024-05-08T09:53:04.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:03 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:03.766+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.382741+0000 front 2024-05-08T09:51:43.383027+0000 (oldest deadline 2024-05-08T09:52:08.082976+0000) 2024-05-08T09:53:04.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:03 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:03.766+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:52.185394+0000 front 2024-05-08T09:51:52.185650+0000 (oldest deadline 2024-05-08T09:52:19.787245+0000) 2024-05-08T09:53:04.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:03 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:03.766+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:02.089683+0000 front 2024-05-08T09:52:02.089742+0000 (oldest deadline 2024-05-08T09:52:31.490943+0000) 2024-05-08T09:53:04.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:03 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:03.766+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:15.493626+0000 front 2024-05-08T09:52:15.493876+0000 (oldest deadline 2024-05-08T09:52:39.593577+0000) 2024-05-08T09:53:04.127 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:03 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9[63709]: 2024-05-08T09:53:03.766+0000 7f9628600700 -1 osd.9 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:24.296072+0000 front 2024-05-08T09:52:24.296033+0000 (oldest deadline 2024-05-08T09:52:50.195753+0000) 2024-05-08T09:53:04.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:03 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:03.961+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:04.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:03 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:03.961+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:04.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:03 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:03.961+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:04.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:03 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:03.961+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:04.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:03 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:03.961+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:04.260 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:03 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:03.961+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:04.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:04 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:04.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:04.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:04 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:04.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:04.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:04 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:04.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:04.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:04 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:04.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:04.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:04 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:04.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:04.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:04 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:04.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:04.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:04 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:04.159+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:05.258 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:05 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:04.999+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:05.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:05 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:05.000+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:05.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:05 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:05.000+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:05.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:05 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:05.000+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:05.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:05 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:05.000+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:05.259 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:05 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:05.000+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:05.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:05 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:05.128+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:05.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:05 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:05.128+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:05.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:05 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:05.128+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:05.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:05 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:05.128+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:05.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:05 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:05.128+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:05.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:05 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:05.128+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:05.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:05 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:05.128+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:05.580 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:05 smithi070 podman[369526]: 2024-05-08 09:53:05.301860867 +0000 UTC m=+5.749096459 container died 4f2069fd48c826b98884344f1b29f58e2ce82f20e08e62ef321cbc43750898eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T09:53:05.875 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:05 smithi070 podman[369526]: 2024-05-08 09:53:05.787253094 +0000 UTC m=+6.234488736 container cleanup 4f2069fd48c826b98884344f1b29f58e2ce82f20e08e62ef321cbc43750898eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T09:53:05.876 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:05 smithi070 bash[369526]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9 2024-05-08T09:53:06.375 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:06 smithi070 podman[369543]: 2024-05-08 09:53:06.088915968 +0000 UTC m=+0.771877027 container remove 4f2069fd48c826b98884344f1b29f58e2ce82f20e08e62ef321cbc43750898eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-08T09:53:06.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:06 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:06.103+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:06.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:06 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:06.103+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:06.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:06 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:06.103+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:06.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:06 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:06.103+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:06.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:06 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:06.103+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:06.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:06 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:06.103+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:06.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:06 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:06.103+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:06.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:06 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:06.046+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:06.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:06 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:06.046+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:06.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:06 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:06.046+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:06.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:06 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:06.047+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:06.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:06 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:06.047+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:06.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:06 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:06.047+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:06.948 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:06 smithi070 podman[369632]: 2024-05-08 09:53:06.59205824 +0000 UTC m=+0.033179278 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:53:06.948 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:06 smithi070 podman[369632]: 2024-05-08 09:53:06.697947633 +0000 UTC m=+0.139068702 container create 7a26c1c970897b6b1680523e0c4bdf59a31d9d3579e2aa28d471e8418cd6b878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:53:06.948 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:06 smithi070 podman[369632]: 2024-05-08 09:53:06.951272723 +0000 UTC m=+0.392393802 container init 7a26c1c970897b6b1680523e0c4bdf59a31d9d3579e2aa28d471e8418cd6b878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-08T09:53:07.376 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:06 smithi070 podman[369632]: 2024-05-08 09:53:06.962282566 +0000 UTC m=+0.403403642 container start 7a26c1c970897b6b1680523e0c4bdf59a31d9d3579e2aa28d471e8418cd6b878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD) 2024-05-08T09:53:07.376 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:07 smithi070 podman[369632]: 2024-05-08 09:53:07.033351987 +0000 UTC m=+0.474473116 container attach 7a26c1c970897b6b1680523e0c4bdf59a31d9d3579e2aa28d471e8418cd6b878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-08T09:53:07.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:07 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:07.069+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:07.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:07 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:07.069+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:07.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:07 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:07.069+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:07.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:07 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:07.069+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:07.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:07 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:07.069+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:07.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:07 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:07.069+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:07.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:07 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:07.069+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:07.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:07.052+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:07.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:07.052+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:07.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:07.052+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:07.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:07.052+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:07.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:07.052+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:07.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:07.052+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:07.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:07.052+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:07.728 INFO:journalctl@ceph.osd.9.smithi070.stdout:May 08 09:53:07 smithi070 podman[369632]: 2024-05-08 09:53:07.400420994 +0000 UTC m=+0.841542090 container died 7a26c1c970897b6b1680523e0c4bdf59a31d9d3579e2aa28d471e8418cd6b878 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-08T09:53:08.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.9.service' 2024-05-08T09:53:08.285 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:53:08.285 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-08T09:53:08.286 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-08T09:53:08.286 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.10 2024-05-08T09:53:08.364 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.048+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:08.364 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.048+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:08.365 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.048+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:08.365 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.048+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:08.365 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.048+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:08.365 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.048+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:08.366 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.048+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:08.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:08.036+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:08.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:08.036+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:08.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:08.036+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:08.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:08.036+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:08.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:08.036+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:08.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:08.036+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:08.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:08 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:08.036+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:08.677 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 systemd[1]: Stopping Ceph osd.10 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:53:09.177 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.887+0000 7f9d27800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:09.178 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.887+0000 7f9d27800700 -1 osd.10 451 *** Got signal Terminated *** 2024-05-08T09:53:09.178 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:08 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:08.887+0000 7f9d27800700 -1 osd.10 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:53:09.178 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:09.027+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:09.178 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:09.027+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:09.178 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:09.027+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:09.178 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:09.027+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:09.179 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:09.027+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:09.179 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:09.027+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:09.179 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:09 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:09.027+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:09.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:09.069+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:09.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:09.069+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:09.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:09.069+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:09.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:09.069+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:09.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:09.069+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:09.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:09.069+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:09.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:09 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:09.069+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:10.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:10.028+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:10.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:10.028+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:10.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:10.028+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:10.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:10.028+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:10.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:10.028+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:10.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:10.028+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:10.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:10 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:10.028+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:10.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:10.113+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:10.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:10.113+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:10.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:10.113+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:10.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:10.113+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:10.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:10.113+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:10.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:10.113+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:10.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:10 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:10.113+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:11.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:11.075+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:11.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:11.075+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:11.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:11.075+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:11.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:11.075+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:11.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:11.075+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:11.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:11.075+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:11.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:11 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:11.075+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:11.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:11.088+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:11.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:11.088+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:11.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:11.088+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:11.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:11.088+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:11.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:11.088+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:11.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:11.088+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:11.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:11.088+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:12.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:12.112+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:12.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:12.112+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:12.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:12.112+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:12.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:12.112+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:12.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:12.112+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:12.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:12.112+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:12.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:12 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:12.112+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:12.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:12.129+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:12.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:12.129+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:12.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:12.129+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:12.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:12.129+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:12.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:12.129+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:12.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:12.129+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:12.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:12 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:12.129+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:13.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:13.080+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:34.087823+0000 front 2024-05-08T09:51:34.087891+0000 (oldest deadline 2024-05-08T09:52:01.689505+0000) 2024-05-08T09:53:13.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:13.080+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:43.391954+0000 front 2024-05-08T09:51:43.392583+0000 (oldest deadline 2024-05-08T09:52:09.292048+0000) 2024-05-08T09:53:13.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:13.080+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:56.697642+0000 front 2024-05-08T09:51:56.697575+0000 (oldest deadline 2024-05-08T09:52:20.797426+0000) 2024-05-08T09:53:13.427 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:13.080+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-05-08T09:52:01.900123+0000 front 2024-05-08T09:52:01.899837+0000 (oldest deadline 2024-05-08T09:52:33.700960+0000) 2024-05-08T09:53:13.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:13.081+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:13.702011+0000 front 2024-05-08T09:52:13.702116+0000 (oldest deadline 2024-05-08T09:52:39.602223+0000) 2024-05-08T09:53:13.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:13.081+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:25.504402+0000 front 2024-05-08T09:52:25.504487+0000 (oldest deadline 2024-05-08T09:52:48.404508+0000) 2024-05-08T09:53:13.428 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:13 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10[57759]: 2024-05-08T09:53:13.081+0000 7f9d1e000700 -1 osd.10 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:34.207712+0000 front 2024-05-08T09:52:34.207653+0000 (oldest deadline 2024-05-08T09:52:59.507246+0000) 2024-05-08T09:53:13.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:13.114+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:13.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:13.114+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:13.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:13.114+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:13.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:13.114+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:13.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:13.114+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:13.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:13.114+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:13.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:13 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:13.114+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:14.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:14.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:14.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:14.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:14.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:14.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:14.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:14.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:14.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:14.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:14.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:14.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:14.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:14 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:14.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:14.815 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:14 smithi172 podman[119153]: 2024-05-08 09:53:14.524053794 +0000 UTC m=+5.805930172 container died 84dedf7809d5bbcd54d5fed37df23e6210088fc74aedac9b8b57d142c8ea8791 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:53:15.128 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:14 smithi172 podman[119153]: 2024-05-08 09:53:14.930304682 +0000 UTC m=+6.212181096 container cleanup 84dedf7809d5bbcd54d5fed37df23e6210088fc74aedac9b8b57d142c8ea8791 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:53:15.129 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:14 smithi172 bash[119153]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10 2024-05-08T09:53:15.426 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:15 smithi172 podman[119173]: 2024-05-08 09:53:15.131318948 +0000 UTC m=+0.581706827 container remove 84dedf7809d5bbcd54d5fed37df23e6210088fc74aedac9b8b57d142c8ea8791 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-08T09:53:15.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:15.130+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:15.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:15.130+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:15.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:15.130+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:15.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:15.130+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:15.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:15.130+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:15.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:15.130+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:15.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:15.130+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:16.177 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:15 smithi172 podman[119258]: 2024-05-08 09:53:15.81817038 +0000 UTC m=+0.034720043 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:53:16.177 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:15 smithi172 podman[119258]: 2024-05-08 09:53:15.932181708 +0000 UTC m=+0.148731396 container create 54d6ee43bb9f5675e6eaa05c03d03c86620c605e3474b96528ee584ff68ba3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5) 2024-05-08T09:53:16.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:16.120+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:16.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:16.120+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:16.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:16.120+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:16.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:16.120+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:16.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:16.120+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:16.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:16.120+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:16.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:16 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:16.120+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:16.658 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:16 smithi172 podman[119258]: 2024-05-08 09:53:16.19396538 +0000 UTC m=+0.410515075 container init 54d6ee43bb9f5675e6eaa05c03d03c86620c605e3474b96528ee584ff68ba3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD) 2024-05-08T09:53:16.659 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:16 smithi172 podman[119258]: 2024-05-08 09:53:16.205026071 +0000 UTC m=+0.421575789 container start 54d6ee43bb9f5675e6eaa05c03d03c86620c605e3474b96528ee584ff68ba3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-08T09:53:16.659 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:16 smithi172 podman[119258]: 2024-05-08 09:53:16.292620824 +0000 UTC m=+0.509170569 container attach 54d6ee43bb9f5675e6eaa05c03d03c86620c605e3474b96528ee584ff68ba3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-08T09:53:16.926 INFO:journalctl@ceph.osd.10.smithi172.stdout:May 08 09:53:16 smithi172 podman[119258]: 2024-05-08 09:53:16.662881369 +0000 UTC m=+0.879431087 container died 54d6ee43bb9f5675e6eaa05c03d03c86620c605e3474b96528ee584ff68ba3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507) 2024-05-08T09:53:17.397 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.10.service' 2024-05-08T09:53:17.507 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:53:17.508 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-08T09:53:17.508 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-08T09:53:17.508 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.11 2024-05-08T09:53:17.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:17.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:17.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:17.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:17.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:17.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:17.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:17.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:17.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:17.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:17.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:17.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:17.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:17.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:17.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:17 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:17.123+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-05-08T09:52:50.265015+0000 front 2024-05-08T09:52:50.265171+0000 (oldest deadline 2024-05-08T09:53:16.665485+0000) 2024-05-08T09:53:18.008 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:17 smithi194 systemd[1]: Stopping Ceph osd.11 for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:53:18.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.052+0000 7fbc84400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:18.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.052+0000 7fbc84400700 -1 osd.11 451 *** Got signal Terminated *** 2024-05-08T09:53:18.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.052+0000 7fbc84400700 -1 osd.11 451 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T09:53:18.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.157+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:18.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.157+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:18.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.157+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:18.511 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.157+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:18.511 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.157+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:18.511 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.157+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:18.511 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.157+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:18.511 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:18 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:18.157+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-05-08T09:52:50.265015+0000 front 2024-05-08T09:52:50.265171+0000 (oldest deadline 2024-05-08T09:53:16.665485+0000) 2024-05-08T09:53:19.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:19.141+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:19.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:19.141+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:19.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:19.141+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:19.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:19.141+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:19.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:19.142+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:19.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:19.142+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:19.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:19.142+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:19.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:19.142+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-05-08T09:52:50.265015+0000 front 2024-05-08T09:52:50.265171+0000 (oldest deadline 2024-05-08T09:53:16.665485+0000) 2024-05-08T09:53:20.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:20.187+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:20.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:20.187+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:20.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:20.187+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:20.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:20.187+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:20.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:20.187+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:20.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:20.187+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:20.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:20.187+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:20.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:20 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:20.187+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-05-08T09:52:50.265015+0000 front 2024-05-08T09:52:50.265171+0000 (oldest deadline 2024-05-08T09:53:16.665485+0000) 2024-05-08T09:53:21.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:21.195+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:21.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:21.195+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:21.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:21.195+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:21.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:21.195+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:21.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:21.195+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:21.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:21.195+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:21.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:21.195+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:21.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:21 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:21.195+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-05-08T09:52:50.265015+0000 front 2024-05-08T09:52:50.265171+0000 (oldest deadline 2024-05-08T09:53:16.665485+0000) 2024-05-08T09:53:22.508 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:22.170+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-05-08T09:51:35.333235+0000 front 2024-05-08T09:51:35.333309+0000 (oldest deadline 2024-05-08T09:51:58.233517+0000) 2024-05-08T09:53:22.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:22.170+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6804 osd.1 since back 2024-05-08T09:51:45.837882+0000 front 2024-05-08T09:51:45.837947+0000 (oldest deadline 2024-05-08T09:52:08.738150+0000) 2024-05-08T09:53:22.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:22.170+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6804 osd.2 since back 2024-05-08T09:51:55.141627+0000 front 2024-05-08T09:51:55.142298+0000 (oldest deadline 2024-05-08T09:52:21.041895+0000) 2024-05-08T09:53:22.509 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:22.170+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6812 osd.4 since back 2024-05-08T09:52:16.848872+0000 front 2024-05-08T09:52:16.849187+0000 (oldest deadline 2024-05-08T09:52:38.549110+0000) 2024-05-08T09:53:22.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:22.170+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6812 osd.5 since back 2024-05-08T09:52:26.555527+0000 front 2024-05-08T09:52:26.555640+0000 (oldest deadline 2024-05-08T09:52:48.255431+0000) 2024-05-08T09:53:22.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:22.170+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-05-08T09:52:35.858935+0000 front 2024-05-08T09:52:35.858802+0000 (oldest deadline 2024-05-08T09:52:58.158601+0000) 2024-05-08T09:53:22.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:22.170+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.172:6820 osd.7 since back 2024-05-08T09:52:43.361823+0000 front 2024-05-08T09:52:43.362043+0000 (oldest deadline 2024-05-08T09:53:06.861670+0000) 2024-05-08T09:53:22.510 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:22 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11[59393]: 2024-05-08T09:53:22.170+0000 7fbc7fc00700 -1 osd.11 451 heartbeat_check: no reply from 172.21.15.194:6820 osd.8 since back 2024-05-08T09:52:50.265015+0000 front 2024-05-08T09:52:50.265171+0000 (oldest deadline 2024-05-08T09:53:16.665485+0000) 2024-05-08T09:53:24.006 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:23 smithi194 podman[118975]: 2024-05-08 09:53:23.710898735 +0000 UTC m=+5.800457263 container died 30c94bac5a1524ec7effa8390a32ee98aafc1927ef4f1a798cb36d9d3b48ca9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:53:24.258 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:24 smithi194 podman[118975]: 2024-05-08 09:53:24.137998187 +0000 UTC m=+6.227556731 container cleanup 30c94bac5a1524ec7effa8390a32ee98aafc1927ef4f1a798cb36d9d3b48ca9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-08T09:53:24.258 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:24 smithi194 bash[118975]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11 2024-05-08T09:53:24.758 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:24 smithi194 podman[118994]: 2024-05-08 09:53:24.405615003 +0000 UTC m=+0.680676549 container remove 30c94bac5a1524ec7effa8390a32ee98aafc1927ef4f1a798cb36d9d3b48ca9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-08T09:53:25.467 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:25 smithi194 podman[119081]: 2024-05-08 09:53:25.082489921 +0000 UTC m=+0.033562654 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T09:53:25.467 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:25 smithi194 podman[119081]: 2024-05-08 09:53:25.189480886 +0000 UTC m=+0.140553643 container create c5342c8eac5f6a9acc550cde004ac980049df619164b6262cea96afafac846e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-08T09:53:25.758 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:25 smithi194 podman[119081]: 2024-05-08 09:53:25.471010564 +0000 UTC m=+0.422083328 container init c5342c8eac5f6a9acc550cde004ac980049df619164b6262cea96afafac846e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11-deactivate, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-08T09:53:25.758 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:25 smithi194 podman[119081]: 2024-05-08 09:53:25.48162495 +0000 UTC m=+0.432697744 container start c5342c8eac5f6a9acc550cde004ac980049df619164b6262cea96afafac846e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-08T09:53:25.758 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:25 smithi194 podman[119081]: 2024-05-08 09:53:25.558503499 +0000 UTC m=+0.509576286 container attach c5342c8eac5f6a9acc550cde004ac980049df619164b6262cea96afafac846e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:53:26.219 INFO:journalctl@ceph.osd.11.smithi194.stdout:May 08 09:53:25 smithi194 podman[119081]: 2024-05-08 09:53:25.943403932 +0000 UTC m=+0.894476735 container died c5342c8eac5f6a9acc550cde004ac980049df619164b6262cea96afafac846e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-08T09:53:26.592 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@osd.11.service' 2024-05-08T09:53:26.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:53:26.700 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-08T09:53:26.700 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-08T09:53:26.700 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.a 2024-05-08T09:53:27.125 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 09:53:26 smithi070 systemd[1]: Stopping Ceph mds.a for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:53:27.627 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 09:53:27 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a[71127]: 2024-05-08T09:53:27.277+0000 7f2d16a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:27.627 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 09:53:27 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a[71127]: 2024-05-08T09:53:27.277+0000 7f2d16a00700 -1 mds.a *** got signal Terminated *** 2024-05-08T09:53:31.429 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 09:53:31 smithi070 podman[369736]: 2024-05-08 09:53:31.145294113 +0000 UTC m=+4.018956291 container died 81b92b14b79a557a73c5eb6dbf2128eb7f20db4740949dd9e5fe36995b1398f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-08T09:53:31.876 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 09:53:31 smithi070 podman[369736]: 2024-05-08 09:53:31.644373775 +0000 UTC m=+4.518035972 container cleanup 81b92b14b79a557a73c5eb6dbf2128eb7f20db4740949dd9e5fe36995b1398f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5) 2024-05-08T09:53:31.876 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 09:53:31 smithi070 bash[369736]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a 2024-05-08T09:53:32.191 INFO:journalctl@ceph.mds.a.smithi070.stdout:May 08 09:53:31 smithi070 podman[369762]: 2024-05-08 09:53:31.962425883 +0000 UTC m=+0.796433967 container remove 81b92b14b79a557a73c5eb6dbf2128eb7f20db4740949dd9e5fe36995b1398f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-08T09:53:32.223 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.a.service' 2024-05-08T09:53:32.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:53:32.332 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-08T09:53:32.332 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-08T09:53:32.332 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.d 2024-05-08T09:53:32.876 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 09:53:32 smithi070 systemd[1]: Stopping Ceph mds.d for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:53:33.376 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 09:53:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d[69785]: 2024-05-08T09:53:32.905+0000 7f0a8fa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:33.376 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 09:53:32 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d[69785]: 2024-05-08T09:53:32.905+0000 7f0a8fa00700 -1 mds.d *** got signal Terminated *** 2024-05-08T09:53:37.217 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 09:53:36 smithi070 podman[369868]: 2024-05-08 09:53:36.925639774 +0000 UTC m=+4.159822543 container died b66c6737f9e157e81af9f6ec30222336614ef83ad8f13c997da9f1955bb0ea9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5) 2024-05-08T09:53:37.480 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 09:53:37 smithi070 podman[369868]: 2024-05-08 09:53:37.447994426 +0000 UTC m=+4.682177211 container cleanup b66c6737f9e157e81af9f6ec30222336614ef83ad8f13c997da9f1955bb0ea9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-08T09:53:37.480 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 09:53:37 smithi070 bash[369868]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d 2024-05-08T09:53:38.122 INFO:journalctl@ceph.mds.d.smithi070.stdout:May 08 09:53:37 smithi070 podman[369881]: 2024-05-08 09:53:37.666635035 +0000 UTC m=+0.719921557 container remove b66c6737f9e157e81af9f6ec30222336614ef83ad8f13c997da9f1955bb0ea9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:53:38.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.d.service' 2024-05-08T09:53:38.256 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:53:38.256 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-08T09:53:38.256 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-08T09:53:38.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.g 2024-05-08T09:53:38.854 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 09:53:38 smithi070 systemd[1]: Stopping Ceph mds.g for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:53:39.125 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 09:53:38 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g[70722]: 2024-05-08T09:53:38.857+0000 7f3d10e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:39.126 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 09:53:38 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g[70722]: 2024-05-08T09:53:38.857+0000 7f3d10e00700 -1 mds.g *** got signal Terminated *** 2024-05-08T09:53:42.875 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 09:53:42 smithi070 podman[369986]: 2024-05-08 09:53:42.594166919 +0000 UTC m=+3.861766008 container died 47a74fa6473f00d04895ebc7ab20400683f2a8cbbb49f1d6c899af48cb968f0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-08T09:53:43.358 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 09:53:43 smithi070 podman[369986]: 2024-05-08 09:53:43.143434386 +0000 UTC m=+4.411033468 container cleanup 47a74fa6473f00d04895ebc7ab20400683f2a8cbbb49f1d6c899af48cb968f0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:53:43.358 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 09:53:43 smithi070 bash[369986]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g 2024-05-08T09:53:43.625 INFO:journalctl@ceph.mds.g.smithi070.stdout:May 08 09:53:43 smithi070 podman[370000]: 2024-05-08 09:53:43.361596489 +0000 UTC m=+0.743722315 container remove 47a74fa6473f00d04895ebc7ab20400683f2a8cbbb49f1d6c899af48cb968f0d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-g, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-08T09:53:43.852 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.g.service' 2024-05-08T09:53:43.957 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:53:43.957 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-08T09:53:43.957 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-08T09:53:43.957 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.j 2024-05-08T09:53:44.375 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 09:53:44 smithi070 systemd[1]: Stopping Ceph mds.j for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:53:44.876 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 09:53:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j[69372]: 2024-05-08T09:53:44.562+0000 7f5f7a800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:44.876 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 09:53:44 smithi070 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j[69372]: 2024-05-08T09:53:44.562+0000 7f5f7a800700 -1 mds.j *** got signal Terminated *** 2024-05-08T09:53:48.861 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 09:53:48 smithi070 podman[370106]: 2024-05-08 09:53:48.589552092 +0000 UTC m=+4.167316308 container died c21a1d87e7c2137801ec04ad720bc2a61a792c4937f551314c26a47d397359b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:53:49.125 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 09:53:49 smithi070 podman[370106]: 2024-05-08 09:53:49.072125402 +0000 UTC m=+4.649889615 container cleanup c21a1d87e7c2137801ec04ad720bc2a61a792c4937f551314c26a47d397359b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-08T09:53:49.125 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 09:53:49 smithi070 bash[370106]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j 2024-05-08T09:53:49.625 INFO:journalctl@ceph.mds.j.smithi070.stdout:May 08 09:53:49 smithi070 podman[370120]: 2024-05-08 09:53:49.306792817 +0000 UTC m=+0.700036975 container remove c21a1d87e7c2137801ec04ad720bc2a61a792c4937f551314c26a47d397359b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-j, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-08T09:53:49.790 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.j.service' 2024-05-08T09:53:49.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:53:49.889 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-08T09:53:49.890 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-08T09:53:49.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.b 2024-05-08T09:53:50.426 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:53:50 smithi172 systemd[1]: Stopping Ceph mds.b for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:53:50.926 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:53:50 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b[63250]: 2024-05-08T09:53:50.543+0000 7f9c0ce00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:50.926 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:53:50 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b[63250]: 2024-05-08T09:53:50.543+0000 7f9c0ce00700 -1 mds.b *** got signal Terminated *** 2024-05-08T09:53:53.887 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:53:53 smithi172 podman[119374]: 2024-05-08 09:53:53.59959487 +0000 UTC m=+3.288546081 container died ec1d4a357875c755a5c36d658ab2c75f3aad2601a683a1f9ffadc17de6460231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-08T09:53:54.176 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:53:54 smithi172 podman[119374]: 2024-05-08 09:53:54.011341917 +0000 UTC m=+3.700293122 container cleanup ec1d4a357875c755a5c36d658ab2c75f3aad2601a683a1f9ffadc17de6460231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T09:53:54.176 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:53:54 smithi172 bash[119374]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b 2024-05-08T09:53:54.676 INFO:journalctl@ceph.mds.b.smithi172.stdout:May 08 09:53:54 smithi172 podman[119400]: 2024-05-08 09:53:54.312347024 +0000 UTC m=+0.700235945 container remove ec1d4a357875c755a5c36d658ab2c75f3aad2601a683a1f9ffadc17de6460231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-b, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-08T09:53:54.795 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.b.service' 2024-05-08T09:53:54.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:53:54.904 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-08T09:53:54.904 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-08T09:53:54.904 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.e 2024-05-08T09:53:55.176 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:53:55 smithi172 systemd[1]: Stopping Ceph mds.e for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:53:55.926 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:53:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e[62618]: 2024-05-08T09:53:55.470+0000 7f0194800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:55.926 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:53:55 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e[62618]: 2024-05-08T09:53:55.470+0000 7f0194800700 -1 mds.e *** got signal Terminated *** 2024-05-08T09:53:57.974 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:53:57 smithi172 podman[119505]: 2024-05-08 09:53:57.687093797 +0000 UTC m=+2.357153468 container died 6aafeff435d3e8836f60604ab0f377df414e92ea8d75992e1c1b6c78e8954181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-05-08T09:53:58.295 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:53:58 smithi172 podman[119505]: 2024-05-08 09:53:58.106017456 +0000 UTC m=+2.776077133 container cleanup 6aafeff435d3e8836f60604ab0f377df414e92ea8d75992e1c1b6c78e8954181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-05-08T09:53:58.295 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:53:58 smithi172 bash[119505]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e 2024-05-08T09:53:58.676 INFO:journalctl@ceph.mds.e.smithi172.stdout:May 08 09:53:58 smithi172 podman[119519]: 2024-05-08 09:53:58.298746032 +0000 UTC m=+0.597501587 container remove 6aafeff435d3e8836f60604ab0f377df414e92ea8d75992e1c1b6c78e8954181 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:53:58.802 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.e.service' 2024-05-08T09:53:58.908 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:53:58.908 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-08T09:53:58.908 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-08T09:53:58.908 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.h 2024-05-08T09:53:59.176 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:53:59 smithi172 systemd[1]: Stopping Ceph mds.h for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:53:59.926 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:53:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h[62928]: 2024-05-08T09:53:59.448+0000 7f3bcf000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:53:59.926 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:53:59 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h[62928]: 2024-05-08T09:53:59.448+0000 7f3bcf000700 -1 mds.h *** got signal Terminated *** 2024-05-08T09:54:01.864 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:54:01 smithi172 podman[119626]: 2024-05-08 09:54:01.614915636 +0000 UTC m=+2.286745792 container died 52df82662be39d32c01223688200b447c8c927070bd473ed6ba0ffb9a04175e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T09:54:02.176 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:54:01 smithi172 podman[119626]: 2024-05-08 09:54:01.967645091 +0000 UTC m=+2.639475243 container cleanup 52df82662be39d32c01223688200b447c8c927070bd473ed6ba0ffb9a04175e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, ceph=True) 2024-05-08T09:54:02.176 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:54:01 smithi172 bash[119626]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h 2024-05-08T09:54:02.512 INFO:journalctl@ceph.mds.h.smithi172.stdout:May 08 09:54:02 smithi172 podman[119640]: 2024-05-08 09:54:02.210298221 +0000 UTC m=+0.577768661 container remove 52df82662be39d32c01223688200b447c8c927070bd473ed6ba0ffb9a04175e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-08T09:54:02.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.h.service' 2024-05-08T09:54:02.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:54:02.787 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-08T09:54:02.788 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-08T09:54:02.788 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.k 2024-05-08T09:54:03.175 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:54:02 smithi172 systemd[1]: Stopping Ceph mds.k for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:54:03.676 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:54:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k[62303]: 2024-05-08T09:54:03.360+0000 7ff518800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:54:03.676 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:54:03 smithi172 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k[62303]: 2024-05-08T09:54:03.360+0000 7ff518800700 -1 mds.k *** got signal Terminated *** 2024-05-08T09:54:05.881 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:54:05 smithi172 podman[119745]: 2024-05-08 09:54:05.601114128 +0000 UTC m=+2.369543292 container died 14898a50e74385fafd16fcaf4b4fd2b19ecec9133ee040753ed75b94b6b9c5b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-08T09:54:06.176 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:54:06 smithi172 podman[119745]: 2024-05-08 09:54:06.004523328 +0000 UTC m=+2.772952528 container cleanup 14898a50e74385fafd16fcaf4b4fd2b19ecec9133ee040753ed75b94b6b9c5b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:54:06.176 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:54:06 smithi172 bash[119745]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k 2024-05-08T09:54:06.604 INFO:journalctl@ceph.mds.k.smithi172.stdout:May 08 09:54:06 smithi172 podman[119759]: 2024-05-08 09:54:06.188612153 +0000 UTC m=+0.551422054 container remove 14898a50e74385fafd16fcaf4b4fd2b19ecec9133ee040753ed75b94b6b9c5b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-k, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-08T09:54:06.638 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.k.service' 2024-05-08T09:54:06.740 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:54:06.740 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-08T09:54:06.740 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-08T09:54:06.741 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.c 2024-05-08T09:54:07.257 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:54:06 smithi194 systemd[1]: Stopping Ceph mds.c for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:54:07.757 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:54:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c[64706]: 2024-05-08T09:54:07.299+0000 7fe209800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:54:07.757 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:54:07 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c[64706]: 2024-05-08T09:54:07.299+0000 7fe209800700 -1 mds.c *** got signal Terminated *** 2024-05-08T09:54:09.716 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:54:09 smithi194 podman[119185]: 2024-05-08 09:54:09.436881732 +0000 UTC m=+2.268655284 container died 62408756d1333ff881187b535af005d73d02e21cec8be83f647aa022b93a62eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, ceph=True) 2024-05-08T09:54:10.007 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:54:09 smithi194 podman[119185]: 2024-05-08 09:54:09.850315 +0000 UTC m=+2.682088533 container cleanup 62408756d1333ff881187b535af005d73d02e21cec8be83f647aa022b93a62eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True) 2024-05-08T09:54:10.007 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:54:09 smithi194 bash[119185]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c 2024-05-08T09:54:10.507 INFO:journalctl@ceph.mds.c.smithi194.stdout:May 08 09:54:10 smithi194 podman[119210]: 2024-05-08 09:54:10.118136042 +0000 UTC m=+0.662837588 container remove 62408756d1333ff881187b535af005d73d02e21cec8be83f647aa022b93a62eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:54:10.552 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.c.service' 2024-05-08T09:54:10.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:54:10.666 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-08T09:54:10.666 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-08T09:54:10.666 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.f 2024-05-08T09:54:11.223 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 09:54:10 smithi194 systemd[1]: Stopping Ceph mds.f for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:54:11.507 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 09:54:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f[64398]: 2024-05-08T09:54:11.227+0000 7fc1c0a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:54:11.507 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 09:54:11 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f[64398]: 2024-05-08T09:54:11.227+0000 7fc1c0a00700 -1 mds.f *** got signal Terminated *** 2024-05-08T09:54:14.196 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 09:54:13 smithi194 podman[119314]: 2024-05-08 09:54:13.925929677 +0000 UTC m=+2.814360735 container died 00732f4e84384ecc6ef04b2467539808b91be5ec5681c520ff0f17f2542f50b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-08T09:54:14.507 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 09:54:14 smithi194 podman[119314]: 2024-05-08 09:54:14.320427593 +0000 UTC m=+3.208858644 container cleanup 00732f4e84384ecc6ef04b2467539808b91be5ec5681c520ff0f17f2542f50b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-05-08T09:54:14.507 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 09:54:14 smithi194 bash[119314]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f 2024-05-08T09:54:14.986 INFO:journalctl@ceph.mds.f.smithi194.stdout:May 08 09:54:14 smithi194 podman[119329]: 2024-05-08 09:54:14.521423571 +0000 UTC m=+0.581204000 container remove 00732f4e84384ecc6ef04b2467539808b91be5ec5681c520ff0f17f2542f50b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-f, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:54:15.017 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.f.service' 2024-05-08T09:54:15.123 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:54:15.123 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-08T09:54:15.123 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-08T09:54:15.124 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.i 2024-05-08T09:54:15.718 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:54:15 smithi194 systemd[1]: Stopping Ceph mds.i for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:54:16.007 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:54:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i[65010]: 2024-05-08T09:54:15.722+0000 7f9c03200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:54:16.007 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:54:15 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i[65010]: 2024-05-08T09:54:15.722+0000 7f9c03200700 -1 mds.i *** got signal Terminated *** 2024-05-08T09:54:17.749 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:54:17 smithi194 podman[119435]: 2024-05-08 09:54:17.444448622 +0000 UTC m=+1.848877272 container died c832faa498d4e47c8a19eef61634fe40eb1c86b30b5b53a41cd76b9c049b7c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:54:18.007 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:54:17 smithi194 podman[119435]: 2024-05-08 09:54:17.882216476 +0000 UTC m=+2.286645129 container cleanup c832faa498d4e47c8a19eef61634fe40eb1c86b30b5b53a41cd76b9c049b7c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f) 2024-05-08T09:54:18.007 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:54:17 smithi194 bash[119435]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i 2024-05-08T09:54:18.507 INFO:journalctl@ceph.mds.i.smithi194.stdout:May 08 09:54:18 smithi194 podman[119449]: 2024-05-08 09:54:18.13321414 +0000 UTC m=+0.665972379 container remove c832faa498d4e47c8a19eef61634fe40eb1c86b30b5b53a41cd76b9c049b7c6e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-08T09:54:18.633 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.i.service' 2024-05-08T09:54:18.733 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:54:18.734 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-08T09:54:18.734 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-08T09:54:18.734 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.l 2024-05-08T09:54:19.257 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 09:54:18 smithi194 systemd[1]: Stopping Ceph mds.l for 3cf89df8-0d04-11ef-bc97-c7b262605968... 2024-05-08T09:54:19.757 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 09:54:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l[64088]: 2024-05-08T09:54:19.308+0000 7f2f20e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T09:54:19.757 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 09:54:19 smithi194 ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l[64088]: 2024-05-08T09:54:19.308+0000 7f2f20e00700 -1 mds.l *** got signal Terminated *** 2024-05-08T09:54:23.643 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 09:54:23 smithi194 podman[119557]: 2024-05-08 09:54:23.336393571 +0000 UTC m=+4.152548055 container died d20071ef51b7d8e5051685853d9c2f8f068a2d68d33667a2f7e0c47d532063da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-08T09:54:24.007 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 09:54:23 smithi194 podman[119557]: 2024-05-08 09:54:23.760341945 +0000 UTC m=+4.576496443 container cleanup d20071ef51b7d8e5051685853d9c2f8f068a2d68d33667a2f7e0c47d532063da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T09:54:24.007 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 09:54:23 smithi194 bash[119557]: ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l 2024-05-08T09:54:24.507 INFO:journalctl@ceph.mds.l.smithi194.stdout:May 08 09:54:24 smithi194 podman[119571]: 2024-05-08 09:54:24.04236658 +0000 UTC m=+0.685432003 container remove d20071ef51b7d8e5051685853d9c2f8f068a2d68d33667a2f7e0c47d532063da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-3cf89df8-0d04-11ef-bc97-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T09:54:24.538 DEBUG:teuthology.orchestra.run.smithi194:> sudo pkill -f 'journalctl -f -n 0 -u ceph-3cf89df8-0d04-11ef-bc97-c7b262605968@mds.l.service' 2024-05-08T09:54:24.639 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T09:54:24.639 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-08T09:54:24.639 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T09:54:24.957 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T09:54:30.645 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T09:54:30.959 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T09:54:35.871 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T09:54:36.183 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T09:54:41.154 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T09:54:41.248 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T09:54:41.344 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T09:54:41.436 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-08T09:54:41.438 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/remote/smithi070/crash 2024-05-08T09:54:41.439 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/crash -- . 2024-05-08T09:54:41.574 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T09:54:41.575 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now 2024-05-08T09:54:41.580 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/remote/smithi172/crash 2024-05-08T09:54:41.581 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/crash -- . 2024-05-08T09:54:41.675 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T09:54:41.676 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2024-05-08T09:54:41.679 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/remote/smithi194/crash 2024-05-08T09:54:41.680 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/crash -- . 2024-05-08T09:54:41.784 INFO:teuthology.orchestra.run.smithi194.stderr:tar: /var/lib/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T09:54:41.785 INFO:teuthology.orchestra.run.smithi194.stderr:tar: Error is not recoverable: exiting now 2024-05-08T09:54:41.788 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-08T09:54:41.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-08T09:54:41.959 INFO:tasks.cephadm:Compressing logs... 2024-05-08T09:54:41.959 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T09:54:41.964 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T09:54:41.970 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T09:54:42.053 INFO:teuthology.orchestra.run.smithi172.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-08T09:54:42.053 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log 2024-05-08T09:54:42.056 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-08T09:54:42.057 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.7.log 2024-05-08T09:54:42.058 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.b.log 2024-05-08T09:54:42.060 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-08T09:54:42.060 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-08T09:54:42.061 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mgr.y.log 2024-05-08T09:54:42.062 INFO:teuthology.orchestra.run.smithi194.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-08T09:54:42.062 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log 2024-05-08T09:54:42.062 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-08T09:54:42.063 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.h.log 2024-05-08T09:54:42.063 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.10.log 2024-05-08T09:54:42.064 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.f.log 2024-05-08T09:54:42.064 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-08T09:54:42.065 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-08T09:54:42.066 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-08T09:54:42.066 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.e.log 2024-05-08T09:54:42.066 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-08T09:54:42.068 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.c.log 2024-05-08T09:54:42.068 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mon.c.log 2024-05-08T09:54:42.068 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mon.b.log 2024-05-08T09:54:42.068 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.k.log 2024-05-08T09:54:42.069 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-08T09:54:42.070 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mgr.z.log 2024-05-08T09:54:42.070 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.i.log 2024-05-08T09:54:42.070 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-08T09:54:42.071 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 --verbose 2024-05-08T09:54:42.072 INFO:teuthology.orchestra.run.smithi070.stderr: -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log 2024-05-08T09:54:42.072 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.11.log 2024-05-08T09:54:42.072 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.8.log 2024-05-08T09:54:42.073 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-08T09:54:42.074 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-08T09:54:42.075 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.g.log 2024-05-08T09:54:42.075 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.l.log 2024-05-08T09:54:42.076 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-08T09:54:42.076 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.j.log 2024-05-08T09:54:42.077 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-08T09:54:42.079 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-08T09:54:42.080 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mgr.x.log 2024-05-08T09:54:42.081 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mon.a.log 2024-05-08T09:54:42.082 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.6.log 2024-05-08T09:54:42.083 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-08T09:54:42.084 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.a.log 2024-05-08T09:54:42.085 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-08T09:54:42.086 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.d.log 2024-05-08T09:54:42.087 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.9.log 2024-05-08T09:54:42.088 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-05-08T09:54:42.089 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-08T09:54:42.090 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-05-08T09:54:42.090 INFO:teuthology.orchestra.run.smithi070.stderr: 88.6% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-08T09:54:42.095 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 94.2% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.f.log.gz 2024-05-08T09:54:42.106 INFO:teuthology.orchestra.run.smithi194.stderr: 94.1% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mgr.z.log.gz 2024-05-08T09:54:42.107 INFO:teuthology.orchestra.run.smithi194.stderr: 94.2% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.l.log.gz 2024-05-08T09:54:42.221 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 91.0% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-08T09:54:42.226 INFO:teuthology.orchestra.run.smithi194.stderr: 87.9% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-08T09:54:42.239 INFO:teuthology.orchestra.run.smithi194.stderr: 91.2% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-08T09:54:42.245 INFO:teuthology.orchestra.run.smithi194.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-08T09:54:42.251 INFO:teuthology.orchestra.run.smithi172.stderr: 88.0% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-08T09:54:42.272 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-08T09:54:42.273 INFO:teuthology.orchestra.run.smithi194.stderr: 91.1% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-08T09:54:42.281 INFO:teuthology.orchestra.run.smithi172.stderr: 91.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-08T09:54:42.396 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 87.6% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-08T09:54:42.447 INFO:teuthology.orchestra.run.smithi070.stderr: 92.5% 91.1% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-05-08T09:54:42.448 INFO:teuthology.orchestra.run.smithi070.stderr: -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-08T09:54:42.448 INFO:teuthology.orchestra.run.smithi070.stderr: 94.4% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.a.log.gz 2024-05-08T09:54:42.469 INFO:teuthology.orchestra.run.smithi070.stderr: 91.1% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-08T09:54:42.478 INFO:teuthology.orchestra.run.smithi070.stderr: 94.4% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.d.log.gz 2024-05-08T09:54:42.481 INFO:teuthology.orchestra.run.smithi070.stderr: 94.5% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.g.log.gz 2024-05-08T09:54:42.520 INFO:teuthology.orchestra.run.smithi070.stderr: 94.4% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.j.log.gz 2024-05-08T09:54:42.553 INFO:teuthology.orchestra.run.smithi172.stderr: 91.2% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-08T09:54:42.583 INFO:teuthology.orchestra.run.smithi172.stderr: 94.1% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mgr.y.log.gz 2024-05-08T09:54:42.839 INFO:teuthology.orchestra.run.smithi172.stderr: 88.6% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-08T09:54:42.945 INFO:teuthology.orchestra.run.smithi070.stderr: 94.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-08T09:54:43.661 INFO:teuthology.orchestra.run.smithi194.stderr: 93.7% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.c.log.gz 2024-05-08T09:54:46.000 INFO:teuthology.orchestra.run.smithi194.stderr: 91.7% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mon.c.log.gz 2024-05-08T09:54:46.845 INFO:teuthology.orchestra.run.smithi194.stderr: 94.8% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.i.log.gz 2024-05-08T09:55:38.400 INFO:teuthology.orchestra.run.smithi194.stderr: 91.5% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.8.log.gz 2024-05-08T09:55:44.099 INFO:teuthology.orchestra.run.smithi194.stderr: 91.6% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.11.log.gz 2024-05-08T09:55:44.580 INFO:teuthology.orchestra.run.smithi070.stderr: 90.4% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mgr.x.log.gz 2024-05-08T09:55:49.746 INFO:teuthology.orchestra.run.smithi194.stderr: 91.5% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-08T09:56:07.071 INFO:teuthology.orchestra.run.smithi194.stderr: 91.5% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-08T09:56:07.074 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-05-08T09:56:07.074 INFO:teuthology.orchestra.run.smithi194.stderr:real 1m25.052s 2024-05-08T09:56:07.074 INFO:teuthology.orchestra.run.smithi194.stderr:user 3m44.670s 2024-05-08T09:56:07.074 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m18.352s 2024-05-08T09:57:05.175 INFO:teuthology.orchestra.run.smithi070.stderr: 90.0% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mon.a.log.gz 2024-05-08T10:00:59.700 INFO:teuthology.orchestra.run.smithi172.stderr: 92.2% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mon.b.log.gz 2024-05-08T10:05:46.456 INFO:teuthology.orchestra.run.smithi070.stderr: 91.6% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-08T10:07:02.423 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-08T10:07:18.298 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.6.log.gz 2024-05-08T10:07:27.762 INFO:teuthology.orchestra.run.smithi172.stderr: 93.7% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.k.log.gz 2024-05-08T10:08:30.999 INFO:teuthology.orchestra.run.smithi070.stderr: 91.5% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.9.log.gz 2024-05-08T10:12:46.472 INFO:teuthology.orchestra.run.smithi172.stderr: 91.5% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.10.log.gz 2024-05-08T10:13:23.385 INFO:teuthology.orchestra.run.smithi172.stderr: 91.6% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-08T10:19:14.261 INFO:teuthology.orchestra.run.smithi172.stderr: 91.6% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.7.log.gz 2024-05-08T10:24:53.242 INFO:teuthology.orchestra.run.smithi172.stderr: 91.6% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-08T10:32:23.243 INFO:teuthology.orchestra.run.smithi070.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-05-08T10:32:23.248 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-05-08T10:32:23.248 INFO:teuthology.orchestra.run.smithi070.stderr:real 37m41.246s 2024-05-08T10:32:23.248 INFO:teuthology.orchestra.run.smithi070.stderr:user 33m41.399s 2024-05-08T10:32:23.248 INFO:teuthology.orchestra.run.smithi070.stderr:sys 4m53.883s 2024-05-08T10:34:53.661 INFO:teuthology.orchestra.run.smithi172.stderr: 96.5% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.e.log.gz 2024-05-08T10:47:37.664 INFO:teuthology.orchestra.run.smithi172.stderr: 96.8% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.h.log.gz 2024-05-08T11:36:34.783 INFO:teuthology.orchestra.run.smithi172.stderr: 96.1% -- replaced with /var/log/ceph/3cf89df8-0d04-11ef-bc97-c7b262605968/ceph-mds.b.log.gz 2024-05-08T11:36:34.801 INFO:teuthology.orchestra.run.smithi172.stderr: 2024-05-08T11:36:34.801 INFO:teuthology.orchestra.run.smithi172.stderr:real 101m52.767s 2024-05-08T11:36:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:user 76m51.601s 2024-05-08T11:36:34.802 INFO:teuthology.orchestra.run.smithi172.stderr:sys 12m5.067s 2024-05-08T11:36:34.802 INFO:tasks.cephadm:Archiving logs... 2024-05-08T11:36:34.804 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/remote/smithi070/log 2024-05-08T11:36:34.806 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T11:40:39.732 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/remote/smithi172/log 2024-05-08T11:40:39.734 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T11:46:51.855 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/remote/smithi194/log 2024-05-08T11:46:51.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T11:47:29.426 INFO:tasks.cephadm:Removing cluster... 2024-05-08T11:47:29.427 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 --force 2024-05-08T11:47:30.150 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T11:47:31.243 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 --force 2024-05-08T11:47:31.927 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T11:47:35.973 DEBUG:teuthology.orchestra.run.smithi194:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 3cf89df8-0d04-11ef-bc97-c7b262605968 --force 2024-05-08T11:47:36.293 INFO:teuthology.orchestra.run.smithi194.stdout:Deleting cluster with fsid: 3cf89df8-0d04-11ef-bc97-c7b262605968 2024-05-08T11:47:37.780 INFO:tasks.cephadm:Removing cephadm ... 2024-05-08T11:47:37.780 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T11:47:37.846 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T11:47:38.184 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T11:47:38.245 INFO:tasks.cephadm:Teardown complete 2024-05-08T11:47:38.246 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T11:47:38.257 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T11:47:38.258 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T11:47:38.265 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T11:47:38.273 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T11:47:38.458 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T11:47:38.469 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T11:47:38.469 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T11:47:38.477 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T11:47:38.485 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T11:47:38.537 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-05-08T11:47:38.538 INFO:teuthology.orchestra.run.smithi172.stderr:bash: line 1: ntpq: command not found 2024-05-08T11:47:38.538 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-05-08T11:47:38.635 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T11:47:38.636 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-05-08T11:47:38.636 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 7 377 127 -1336us[-1339us] +/- 65ms 2024-05-08T11:47:38.636 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 124 +683us[ +683us] +/- 55ms 2024-05-08T11:47:38.636 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 +1057us[+1057us] +/- 71ms 2024-05-08T11:47:38.636 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T11:47:38.644 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T11:47:38.644 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-05-08T11:47:38.645 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv01.front.sepia.ceph.com 3 7 377 76 -1403us[-1415us] +/- 66ms 2024-05-08T11:47:38.645 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 113 +633us[ +620us] +/- 55ms 2024-05-08T11:47:38.645 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +1008us[+1008us] +/- 72ms 2024-05-08T11:47:38.645 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T11:47:38.694 INFO:teuthology.orchestra.run.smithi172.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T11:47:38.695 INFO:teuthology.orchestra.run.smithi172.stdout:=============================================================================== 2024-05-08T11:47:38.695 INFO:teuthology.orchestra.run.smithi172.stdout:^* hv01.front.sepia.ceph.com 3 6 377 22 -1555us[-1514us] +/- 67ms 2024-05-08T11:47:38.695 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 63 +558us[ +599us] +/- 56ms 2024-05-08T11:47:38.695 INFO:teuthology.orchestra.run.smithi172.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 129 +970us[+1008us] +/- 70ms 2024-05-08T11:47:38.695 INFO:teuthology.orchestra.run.smithi172.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T11:47:38.699 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T11:47:38.713 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T11:47:38.713 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T11:47:38.725 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T11:47:39.118 DEBUG:teuthology.orchestra.run.smithi172:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T11:47:39.436 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T11:47:39.667 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T11:47:39.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T11:47:39.765 DEBUG:teuthology.orchestra.run.smithi172:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T11:47:39.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T11:47:39.860 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T11:47:39.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T11:47:39.955 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T11:47:39.967 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T11:47:39.977 INFO:teuthology.task.internal:Duration was 19688.699812 seconds 2024-05-08T11:47:39.978 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T11:47:39.988 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T11:47:39.989 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T11:47:39.997 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T11:47:40.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T11:47:40.152 INFO:teuthology.orchestra.run.smithi172.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T11:47:40.166 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T11:47:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T11:47:40.557 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T11:47:40.557 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-05-08T11:47:40.557 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T11:47:40.633 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2024-05-08T11:47:40.634 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T11:47:40.721 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-05-08T11:47:40.722 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T11:47:40.796 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T11:47:40.797 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T11:47:40.804 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T11:47:40.811 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T11:47:40.893 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T11:47:40.893 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T11:47:40.899 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T11:47:40.904 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T11:47:43.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T11:47:43.517 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T11:47:43.517 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T11:47:43.611 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T11:47:43.702 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T11:47:43.873 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T11:47:43.886 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T11:47:43.894 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T11:47:43.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T11:47:44.008 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-05-08T11:47:44.009 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-05-08T11:47:44.015 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2024-05-08T11:47:44.075 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T11:47:44.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T11:47:44.126 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T11:47:44.183 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T11:47:44.184 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T11:47:44.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T11:47:44.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T11:47:44.254 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T11:47:44.256 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/remote/smithi070 2024-05-08T11:47:44.257 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T11:47:44.425 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/remote/smithi172 2024-05-08T11:47:44.425 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T11:47:44.530 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268/remote/smithi194 2024-05-08T11:47:44.530 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T11:47:44.640 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T11:47:44.640 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T11:47:44.648 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T11:47:44.656 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T11:47:44.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T11:47:44.726 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T11:47:44.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T11:47:44.737 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T11:47:44.737 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T11:47:44.744 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T11:47:44.750 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T11:47:44.795 INFO:teuthology.orchestra.run.smithi070.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 11:47 /home/ubuntu/cephtest 2024-05-08T11:47:44.799 INFO:teuthology.orchestra.run.smithi172.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 11:47 /home/ubuntu/cephtest 2024-05-08T11:47:44.809 INFO:teuthology.orchestra.run.smithi194.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 11:47 /home/ubuntu/cephtest 2024-05-08T11:47:44.812 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T11:47:44.824 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T11:47:44.848 INFO:teuthology.nuke:Checking targets against current locks 2024-05-08T11:47:44.875 DEBUG:teuthology.nuke:shortname: smithi070 2024-05-08T11:47:44.876 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T11:47:44.896 DEBUG:teuthology.nuke:shortname: smithi172 2024-05-08T11:47:44.896 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T11:47:44.901 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 06:09:06.764657', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBByaTvOVN4a4vRqIFmU5ANMQW8CL6moADjXa5PsbP2dTgy2r+72TTv6IAoFrxcvscGtEcEcvPo+apFfiSE3PGZc='} 2024-05-08T11:47:44.915 DEBUG:teuthology.nuke:shortname: smithi194 2024-05-08T11:47:44.916 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T11:47:44.921 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 06:09:06.761449', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOqnOf/ygypimMDZKEGhIX7xHMSnkcI+04oh5vNd0ira2wt1SVymcUQGcmzUx5/uo6CSvCbUrQdxZWos5fnc+Wg='} 2024-05-08T11:47:44.950 INFO:teuthology.orchestra.console.smithi070:Power off 2024-05-08T11:47:44.950 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-08T11:47:44.960 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 06:09:06.763134', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDZvBCXy2hBXaWv7Ot2kjEAl1/x9vjaYjFfsHx0+vKVBhQ8x7QN0hGtAX5Nz1Y1VHGEAtnhh90o/g1pHdg+Kusc='} 2024-05-08T11:47:44.975 DEBUG:teuthology.orchestra.console.smithi070:power off output: Chassis Power Control: Down/Off 2024-05-08T11:47:44.975 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:44.993 INFO:teuthology.orchestra.console.smithi172:Power off 2024-05-08T11:47:44.994 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-08T11:47:45.009 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-05-08T11:47:45.018 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2024-05-08T11:47:45.018 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:45.036 INFO:teuthology.orchestra.console.smithi194:Power off 2024-05-08T11:47:45.037 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-08T11:47:45.047 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-05-08T11:47:45.059 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-05-08T11:47:45.059 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:45.086 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-05-08T11:47:49.010 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:49.048 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:49.088 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:49.121 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is on 2024-05-08T11:47:49.159 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2024-05-08T11:47:49.199 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-05-08T11:47:53.122 DEBUG:teuthology.orchestra.console.smithi070:pexpect command: ipmitool -H smithi070.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:53.160 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:53.201 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:53.235 DEBUG:teuthology.orchestra.console.smithi070:check power output: Chassis Power is off 2024-05-08T11:47:53.274 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2024-05-08T11:47:53.314 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-05-08T11:47:53.337 INFO:teuthology.orchestra.console.smithi070:Power off completed 2024-05-08T11:47:53.376 INFO:teuthology.orchestra.console.smithi172:Power off completed 2024-05-08T11:47:57.319 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-08T11:47:57.430 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-05-08T11:47:57.531 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-05-08T11:47:57.639 INFO:teuthology.run:Summary data: description: fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/kernel_untar_build}} duration: 19688.699811935425 failure_reason: 'Command failed (workunit test kernel_untar_build.sh) on smithi070 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh''' flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.c-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9a720fb2046d4f11b770da17b56a220c status: fail success: false 2024-05-08T11:47:57.640 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T11:47:57.738 INFO:teuthology.run:FAIL